2023-11-04T01:10:10.606 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-04T01:10:10.606 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918 --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} --verbose --name pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918/orig.config.yaml 2023-11-04T01:10:10.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:10:10.724 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918 branch: main description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} email: pdonnell@redhat.com first_in_suite: false job_id: '7445918' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - RECENT_CRASH sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: dry_run: true install: ceph: flavor: default sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231103.180916 sha1: 702f9e6492477037e018f68dfdf636a30c24f329 owner: scheduled_pdonnell@teuthology priority: 50 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7192 sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-batrick-testing-20231103.180916 suite_path: /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 702f9e6492477037e018f68dfdf636a30c24f329 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGNwtC3sRo9An1v0162xAkwK5ps/9wuy22pqR7mLCVyuHAp+SMJP1gJTJrIcOGhgZ5r3AB7uteoz2/0A66uhnyc= smithi141.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHbgkzfTEigi1OIdnkvi6vLGap0GXnDZHAy7U0RidR/plsRSMGBTBmY6ay7iBTK7Wx0oHt5X/mViCu1YWdr+z04= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - exec: mon.a: - ceph config set mgr mgr/crash/warn_recent_interval 0 - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_snapshots teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-03_18:12:33 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822 2023-11-04T01:10:10.724 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa; will attempt to use it 2023-11-04T01:10:10.725 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks 2023-11-04T01:10:10.725 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-04T01:10:10.726 INFO:teuthology.task.internal:Checking packages... 2023-11-04T01:10:10.753 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4' 2023-11-04T01:10:10.753 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-04T01:10:10.753 INFO:teuthology.packaging:ref: None 2023-11-04T01:10:10.753 INFO:teuthology.packaging:tag: None 2023-11-04T01:10:10.754 INFO:teuthology.packaging:branch: main 2023-11-04T01:10:10.754 INFO:teuthology.packaging:sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:10:10.754 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2023-11-04T01:10:10.999 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7052.g7188d8cd 2023-11-04T01:10:10.999 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-04T01:10:11.013 INFO:teuthology.task.internal:no buildpackages task found 2023-11-04T01:10:11.013 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-04T01:10:11.020 INFO:teuthology.task.internal:Saving configuration 2023-11-04T01:10:11.036 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-04T01:10:11.049 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:10:11.068 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:35.341149', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGNwtC3sRo9An1v0162xAkwK5ps/9wuy22pqR7mLCVyuHAp+SMJP1gJTJrIcOGhgZ5r3AB7uteoz2/0A66uhnyc='} 2023-11-04T01:10:11.090 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:35.342577', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHbgkzfTEigi1OIdnkvi6vLGap0GXnDZHAy7U0RidR/plsRSMGBTBmY6ay7iBTK7Wx0oHt5X/mViCu1YWdr+z04='} 2023-11-04T01:10:11.090 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-04T01:10:11.099 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-04T01:10:11.099 INFO:teuthology.task.internal:roles: ubuntu@smithi141.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-04T01:10:11.099 INFO:teuthology.run_tasks:Running task console_log... 2023-11-04T01:10:11.164 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc3c1db4ee0>, signals=[15]) 2023-11-04T01:10:11.164 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-04T01:10:11.170 INFO:teuthology.task.internal:Opening connections... 2023-11-04T01:10:11.171 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:10:11.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:10:11.256 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:10:11.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:10:11.338 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-04T01:10:11.346 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2023-11-04T01:10:11.361 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2023-11-04T01:10:11.361 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-11-04T01:10:11.415 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2023-11-04T01:10:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9" 2023-11-04T01:10:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2023-11-04T01:10:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2023-11-04T01:10:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9" 2023-11-04T01:10:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9" 2023-11-04T01:10:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T01:10:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-11-04T01:10:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon" 2023-11-04T01:10:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T01:10:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2023-11-04T01:10:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T01:10:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T01:10:11.417 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T01:10:11.417 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-11-04T01:10:11.439 DEBUG:teuthology.orchestra.run.smithi141:> uname -m 2023-11-04T01:10:11.457 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2023-11-04T01:10:11.457 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-11-04T01:10:11.513 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream" 2023-11-04T01:10:11.513 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="9" 2023-11-04T01:10:11.513 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos" 2023-11-04T01:10:11.513 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora" 2023-11-04T01:10:11.513 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="9" 2023-11-04T01:10:11.513 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el9" 2023-11-04T01:10:11.513 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T01:10:11.513 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-11-04T01:10:11.513 INFO:teuthology.orchestra.run.smithi141.stdout:LOGO="fedora-logo-icon" 2023-11-04T01:10:11.514 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T01:10:11.514 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/" 2023-11-04T01:10:11.514 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T01:10:11.514 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T01:10:11.514 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T01:10:11.514 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-11-04T01:10:11.531 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-04T01:10:11.539 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-04T01:10:11.545 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-04T01:10:11.545 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2023-11-04T01:10:11.547 DEBUG:teuthology.orchestra.run.smithi141:> test '!' -e /home/ubuntu/cephtest 2023-11-04T01:10:11.568 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-04T01:10:11.574 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-04T01:10:11.574 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2023-11-04T01:10:11.601 DEBUG:teuthology.orchestra.run.smithi141:> test -z $(ls -A /var/lib/ceph) 2023-11-04T01:10:11.724 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-04T01:10:11.780 INFO:teuthology.run_tasks:Running task kernel... 2023-11-04T01:10:11.795 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-04T01:10:11.795 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-04T01:10:11.796 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-04T01:10:11.796 DEBUG:teuthology.orchestra.run.smithi141:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-04T01:10:11.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:10:11.811 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2023-11-04T01:10:11.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:10:11.813 DEBUG:teuthology.orchestra.run.smithi141:> uname -r 2023-11-04T01:10:11.866 INFO:teuthology.orchestra.run.smithi114.stdout:5.14.0-361.el9.x86_64 2023-11-04T01:10:11.866 INFO:teuthology.task.kernel:Running kernel on smithi114: 5.14.0-361.el9.x86_64 2023-11-04T01:10:11.866 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum install -y kernel 2023-11-04T01:10:11.870 INFO:teuthology.orchestra.run.smithi141.stdout:5.14.0-361.el9.x86_64 2023-11-04T01:10:11.870 INFO:teuthology.task.kernel:Running kernel on smithi141: 5.14.0-361.el9.x86_64 2023-11-04T01:10:11.870 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum install -y kernel 2023-11-04T01:10:14.241 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS-9 - AppStream 8.2 MB/s | 6.3 MB 00:00 2023-11-04T01:10:14.256 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS-9 - AppStream 8.7 MB/s | 6.3 MB 00:00 2023-11-04T01:10:15.691 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS-9 - BaseOS 4.9 MB/s | 2.0 MB 00:00 2023-11-04T01:10:15.706 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS-9 - BaseOS 4.9 MB/s | 2.0 MB 00:00 2023-11-04T01:10:17.055 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS Stream 9 - BaseOS 7.7 MB/s | 7.9 MB 00:01 2023-11-04T01:10:17.098 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - BaseOS 7.0 MB/s | 7.9 MB 00:01 2023-11-04T01:10:18.856 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS Stream 9 - AppStream 23 MB/s | 18 MB 00:00 2023-11-04T01:10:23.568 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 5.8 MB 00:01 2023-11-04T01:10:24.841 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 15 kB 00:00 2023-11-04T01:10:26.009 INFO:teuthology.orchestra.run.smithi141.stdout:Extra Packages for Enterprise Linux 18 MB/s | 19 MB 00:01 2023-11-04T01:10:28.215 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - AppStream 1.8 MB/s | 18 MB 00:10 2023-11-04T01:10:30.534 INFO:teuthology.orchestra.run.smithi141.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2023-11-04T01:10:32.632 INFO:teuthology.orchestra.run.smithi141.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-04T01:10:32.632 INFO:teuthology.orchestra.run.smithi141.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-04T01:10:32.719 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-11-04T01:10:32.730 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-11-04T01:10:32.730 INFO:teuthology.orchestra.run.smithi141.stdout: Package Architecture Version Repository Size 2023-11-04T01:10:32.730 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-11-04T01:10:32.730 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-11-04T01:10:32.731 INFO:teuthology.orchestra.run.smithi141.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-04T01:10:32.731 INFO:teuthology.orchestra.run.smithi141.stdout:Installing dependencies: 2023-11-04T01:10:32.731 INFO:teuthology.orchestra.run.smithi141.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-04T01:10:32.731 INFO:teuthology.orchestra.run.smithi141.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-04T01:10:32.731 INFO:teuthology.orchestra.run.smithi141.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-04T01:10:32.731 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:10:32.731 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-11-04T01:10:32.731 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2023-11-04T01:10:32.731 INFO:teuthology.orchestra.run.smithi141.stdout:Install 4 Packages 2023-11-04T01:10:32.731 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:10:32.732 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 95 M 2023-11-04T01:10:32.732 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 120 M 2023-11-04T01:10:32.732 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-11-04T01:10:33.291 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 5.8 MB 00:01 2023-11-04T01:10:33.768 INFO:teuthology.orchestra.run.smithi141.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 5.4 MB/s | 5.3 MB 00:00 2023-11-04T01:10:34.477 INFO:teuthology.orchestra.run.smithi141.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 12 MB/s | 20 MB 00:01 2023-11-04T01:10:35.360 INFO:teuthology.orchestra.run.smithi141.stdout:(3/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 15 MB/s | 38 MB 00:02 2023-11-04T01:10:35.583 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 15 kB 00:01 2023-11-04T01:10:35.835 INFO:teuthology.orchestra.run.smithi141.stdout:(4/4): kernel-modules-core-5.14.0-378.el9.x86_6 16 MB/s | 32 MB 00:02 2023-11-04T01:10:35.836 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-11-04T01:10:35.836 INFO:teuthology.orchestra.run.smithi141.stdout:Total 31 MB/s | 95 MB 00:03 2023-11-04T01:10:36.690 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-11-04T01:10:37.066 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-11-04T01:10:37.066 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-11-04T01:10:37.362 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 12 MB/s | 19 MB 00:01 2023-11-04T01:10:38.340 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-11-04T01:10:38.340 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-11-04T01:10:41.234 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-11-04T01:10:41.826 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-11-04T01:10:41.867 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-04T01:10:42.002 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:10:43.949 INFO:teuthology.orchestra.run.smithi114.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-04T01:10:43.950 INFO:teuthology.orchestra.run.smithi114.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-04T01:10:44.055 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2023-11-04T01:10:44.066 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2023-11-04T01:10:44.066 INFO:teuthology.orchestra.run.smithi114.stdout: Package Architecture Version Repository Size 2023-11-04T01:10:44.066 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2023-11-04T01:10:44.066 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2023-11-04T01:10:44.066 INFO:teuthology.orchestra.run.smithi114.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-04T01:10:44.066 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2023-11-04T01:10:44.067 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-04T01:10:44.067 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-04T01:10:44.067 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-04T01:10:44.067 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:10:44.067 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2023-11-04T01:10:44.067 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2023-11-04T01:10:44.067 INFO:teuthology.orchestra.run.smithi114.stdout:Install 4 Packages 2023-11-04T01:10:44.067 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:10:44.068 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 95 M 2023-11-04T01:10:44.068 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 120 M 2023-11-04T01:10:44.068 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2023-11-04T01:10:44.795 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:10:44.988 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:10:47.119 INFO:teuthology.orchestra.run.smithi114.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 1.9 MB/s | 5.3 MB 00:02 2023-11-04T01:10:49.615 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:10:49.744 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:10:53.610 INFO:teuthology.orchestra.run.smithi114.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 2.1 MB/s | 20 MB 00:09 2023-11-04T01:10:54.358 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:10:57.002 INFO:teuthology.orchestra.run.smithi114.stdout:(3/4): kernel-modules-core-5.14.0-378.el9.x86_6 3.2 MB/s | 32 MB 00:09 2023-11-04T01:10:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:(4/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 2.6 MB/s | 38 MB 00:14 2023-11-04T01:10:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2023-11-04T01:10:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:Total 6.5 MB/s | 95 MB 00:14 2023-11-04T01:10:59.628 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2023-11-04T01:10:59.993 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2023-11-04T01:10:59.993 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2023-11-04T01:11:01.325 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2023-11-04T01:11:01.326 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2023-11-04T01:11:03.953 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2023-11-04T01:11:04.576 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-04T01:11:04.702 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:11:07.458 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:11:07.636 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:11:12.246 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:11:12.359 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:17.025 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:23.352 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:23.394 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:23.867 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:23.867 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-04T01:11:23.867 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:11:23.867 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:11:24.311 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:11:24.311 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:11:24.311 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-11-04T01:11:24.312 INFO:teuthology.orchestra.run.smithi141.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-04T01:11:24.312 INFO:teuthology.orchestra.run.smithi141.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-04T01:11:24.312 INFO:teuthology.orchestra.run.smithi141.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-04T01:11:24.312 INFO:teuthology.orchestra.run.smithi141.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-04T01:11:24.312 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:11:24.312 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-11-04T01:11:24.811 DEBUG:teuthology.orchestra.run.smithi141:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T01:11:24.953 INFO:teuthology.orchestra.run.smithi141.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T01:11:24.953 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T01:11:24.953 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-04T01:11:24.954 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-04T01:11:24.954 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-04T01:11:24.954 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-04T01:11:24.954 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi141.front.sepia.ceph.com, path=None, version=distro) 2023-11-04T01:11:24.954 DEBUG:teuthology.orchestra.run.smithi141:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T01:11:25.071 INFO:teuthology.orchestra.run.smithi141.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T01:11:25.071 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T01:11:25.071 DEBUG:teuthology.orchestra.run.smithi141:> sudo rpm -qi grub2-tools 2023-11-04T01:11:25.111 INFO:teuthology.orchestra.run.smithi141.stdout:Name : grub2-tools 2023-11-04T01:11:25.111 INFO:teuthology.orchestra.run.smithi141.stdout:Epoch : 1 2023-11-04T01:11:25.111 INFO:teuthology.orchestra.run.smithi141.stdout:Version : 2.06 2023-11-04T01:11:25.112 INFO:teuthology.orchestra.run.smithi141.stdout:Release : 68.el9 2023-11-04T01:11:25.112 INFO:teuthology.orchestra.run.smithi141.stdout:Architecture: x86_64 2023-11-04T01:11:25.112 INFO:teuthology.orchestra.run.smithi141.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-04T01:11:25.112 INFO:teuthology.orchestra.run.smithi141.stdout:Group : Unspecified 2023-11-04T01:11:25.112 INFO:teuthology.orchestra.run.smithi141.stdout:Size : 8264254 2023-11-04T01:11:25.112 INFO:teuthology.orchestra.run.smithi141.stdout:License : GPLv3+ 2023-11-04T01:11:25.112 INFO:teuthology.orchestra.run.smithi141.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-04T01:11:25.112 INFO:teuthology.orchestra.run.smithi141.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-04T01:11:25.112 INFO:teuthology.orchestra.run.smithi141.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-04T01:11:25.113 INFO:teuthology.orchestra.run.smithi141.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-04T01:11:25.113 INFO:teuthology.orchestra.run.smithi141.stdout:Packager : builder@centos.org 2023-11-04T01:11:25.113 INFO:teuthology.orchestra.run.smithi141.stdout:Vendor : CentOS 2023-11-04T01:11:25.113 INFO:teuthology.orchestra.run.smithi141.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-04T01:11:25.113 INFO:teuthology.orchestra.run.smithi141.stdout:Summary : Support tools for GRUB. 2023-11-04T01:11:25.113 INFO:teuthology.orchestra.run.smithi141.stdout:Description : 2023-11-04T01:11:25.113 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:11:25.113 INFO:teuthology.orchestra.run.smithi141.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-04T01:11:25.113 INFO:teuthology.orchestra.run.smithi141.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-04T01:11:25.113 INFO:teuthology.orchestra.run.smithi141.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-04T01:11:25.114 INFO:teuthology.orchestra.run.smithi141.stdout:hardware devices. 2023-11-04T01:11:25.114 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:11:25.114 INFO:teuthology.orchestra.run.smithi141.stdout:This subpackage provides tools for support of all platforms. 2023-11-04T01:11:25.115 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-04T01:11:25.115 INFO:teuthology.task.kernel:Updating grub on smithi141 to boot 5.14.0-378.el9.x86_64 2023-11-04T01:11:25.115 DEBUG:teuthology.orchestra.run.smithi141:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-04T01:11:25.755 INFO:teuthology.orchestra.run.smithi141.stderr:Generating grub configuration file ... 2023-11-04T01:11:27.111 INFO:teuthology.orchestra.run.smithi141.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-04T01:11:27.140 INFO:teuthology.orchestra.run.smithi141.stderr:done 2023-11-04T01:11:27.143 DEBUG:teuthology.orchestra.run.smithi141:> mktemp 2023-11-04T01:11:27.158 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.4lh0GmHdmv 2023-11-04T01:11:27.158 DEBUG:teuthology.orchestra.run.smithi141:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4lh0GmHdmv 2023-11-04T01:11:27.230 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.4lh0GmHdmv 2023-11-04T01:11:27.368 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.4lh0GmHdmv is 6KB 2023-11-04T01:11:27.386 DEBUG:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.4lh0GmHdmv 2023-11-04T01:11:27.400 DEBUG:teuthology.orchestra.run.smithi141:> sudo /bin/ls /boot/loader/entries || true 2023-11-04T01:11:27.465 INFO:teuthology.orchestra.run.smithi141.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-04T01:11:27.465 INFO:teuthology.orchestra.run.smithi141.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-04T01:11:27.465 INFO:teuthology.orchestra.run.smithi141.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-04T01:11:27.465 INFO:teuthology.orchestra.run.smithi141.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-04T01:11:27.466 DEBUG:teuthology.orchestra.run.smithi141:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-04T01:11:27.625 DEBUG:teuthology.orchestra.run.smithi141:> sudo shutdown -r now 2023-11-04T01:11:45.706 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:22:49.639 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-04T01:22:49.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-11-04T01:22:49.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:22:49.651 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:22:49.651 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:22:49.651 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-04T01:22:49.651 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:22:49.652 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:22:49.652 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:22:49.652 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:22:49.652 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2023-11-04T01:22:49.652 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-04T01:22:49.652 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-04T01:22:49.653 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-04T01:22:49.653 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-04T01:22:49.653 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:22:49.653 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2023-11-04T01:22:49.654 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T01:22:49.884 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T01:22:49.885 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T01:22:49.885 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-04T01:22:49.885 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-04T01:22:49.885 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-04T01:22:49.885 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-04T01:22:49.885 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi114.front.sepia.ceph.com, path=None, version=distro) 2023-11-04T01:22:49.885 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T01:22:50.005 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T01:22:50.005 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T01:22:50.006 DEBUG:teuthology.orchestra.run.smithi114:> sudo rpm -qi grub2-tools 2023-11-04T01:22:50.040 INFO:teuthology.orchestra.run.smithi114.stdout:Name : grub2-tools 2023-11-04T01:22:50.040 INFO:teuthology.orchestra.run.smithi114.stdout:Epoch : 1 2023-11-04T01:22:50.040 INFO:teuthology.orchestra.run.smithi114.stdout:Version : 2.06 2023-11-04T01:22:50.040 INFO:teuthology.orchestra.run.smithi114.stdout:Release : 68.el9 2023-11-04T01:22:50.040 INFO:teuthology.orchestra.run.smithi114.stdout:Architecture: x86_64 2023-11-04T01:22:50.040 INFO:teuthology.orchestra.run.smithi114.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-04T01:22:50.040 INFO:teuthology.orchestra.run.smithi114.stdout:Group : Unspecified 2023-11-04T01:22:50.040 INFO:teuthology.orchestra.run.smithi114.stdout:Size : 8264254 2023-11-04T01:22:50.040 INFO:teuthology.orchestra.run.smithi114.stdout:License : GPLv3+ 2023-11-04T01:22:50.040 INFO:teuthology.orchestra.run.smithi114.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-04T01:22:50.040 INFO:teuthology.orchestra.run.smithi114.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-04T01:22:50.041 INFO:teuthology.orchestra.run.smithi114.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-04T01:22:50.041 INFO:teuthology.orchestra.run.smithi114.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-04T01:22:50.041 INFO:teuthology.orchestra.run.smithi114.stdout:Packager : builder@centos.org 2023-11-04T01:22:50.041 INFO:teuthology.orchestra.run.smithi114.stdout:Vendor : CentOS 2023-11-04T01:22:50.041 INFO:teuthology.orchestra.run.smithi114.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-04T01:22:50.041 INFO:teuthology.orchestra.run.smithi114.stdout:Summary : Support tools for GRUB. 2023-11-04T01:22:50.041 INFO:teuthology.orchestra.run.smithi114.stdout:Description : 2023-11-04T01:22:50.041 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:22:50.041 INFO:teuthology.orchestra.run.smithi114.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-04T01:22:50.041 INFO:teuthology.orchestra.run.smithi114.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-04T01:22:50.041 INFO:teuthology.orchestra.run.smithi114.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-04T01:22:50.041 INFO:teuthology.orchestra.run.smithi114.stdout:hardware devices. 2023-11-04T01:22:50.041 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:22:50.042 INFO:teuthology.orchestra.run.smithi114.stdout:This subpackage provides tools for support of all platforms. 2023-11-04T01:22:50.042 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-04T01:22:50.042 INFO:teuthology.task.kernel:Updating grub on smithi114 to boot 5.14.0-378.el9.x86_64 2023-11-04T01:22:50.043 DEBUG:teuthology.orchestra.run.smithi114:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-04T01:22:50.063 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-11-04T01:22:50.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-11-04T01:22:50.432 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-378.el9.x86_64"... 2023-11-04T01:22:50.432 DEBUG:teuthology.orchestra.run.smithi141:> uname -r 2023-11-04T01:22:50.447 INFO:teuthology.orchestra.run.smithi141.stdout:5.14.0-378.el9.x86_64 2023-11-04T01:22:50.447 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-04T01:22:50.447 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-04T01:22:50.447 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-04T01:22:50.612 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2023-11-04T01:22:51.448 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-04T01:22:51.448 DEBUG:teuthology.orchestra.run.smithi141:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-04T01:22:51.551 INFO:teuthology.orchestra.run.smithi141.stdout:ttyS1 2023-11-04T01:22:51.593 DEBUG:teuthology.parallel:result is None 2023-11-04T01:22:52.050 INFO:teuthology.orchestra.run.smithi114.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-04T01:22:52.094 INFO:teuthology.orchestra.run.smithi114.stderr:done 2023-11-04T01:22:52.097 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2023-11-04T01:22:52.111 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.AyC0rcqtP0 2023-11-04T01:22:52.111 DEBUG:teuthology.orchestra.run.smithi114:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.AyC0rcqtP0 2023-11-04T01:22:52.181 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.AyC0rcqtP0 2023-11-04T01:22:52.319 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.AyC0rcqtP0 is 6KB 2023-11-04T01:22:52.366 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.AyC0rcqtP0 2023-11-04T01:22:52.381 DEBUG:teuthology.orchestra.run.smithi114:> sudo /bin/ls /boot/loader/entries || true 2023-11-04T01:22:52.447 INFO:teuthology.orchestra.run.smithi114.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-04T01:22:52.447 INFO:teuthology.orchestra.run.smithi114.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-04T01:22:52.447 INFO:teuthology.orchestra.run.smithi114.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-04T01:22:52.448 INFO:teuthology.orchestra.run.smithi114.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-04T01:22:52.449 DEBUG:teuthology.orchestra.run.smithi114:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-04T01:22:52.592 DEBUG:teuthology.orchestra.run.smithi114:> sudo shutdown -r now 2023-11-04T01:23:22.594 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-04T01:23:22.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-11-04T01:23:22.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:24:22.598 DEBUG:teuthology.orchestra.remote:timed out 2023-11-04T01:24:31.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-11-04T01:24:31.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:24:39.107 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-11-04T01:24:39.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-11-04T01:24:39.488 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-378.el9.x86_64"... 2023-11-04T01:24:39.488 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2023-11-04T01:24:39.502 INFO:teuthology.orchestra.run.smithi114.stdout:5.14.0-378.el9.x86_64 2023-11-04T01:24:39.502 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-04T01:24:39.502 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-04T01:24:39.503 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-04T01:24:40.504 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-04T01:24:40.504 DEBUG:teuthology.orchestra.run.smithi114:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-04T01:24:40.570 INFO:teuthology.orchestra.run.smithi114.stdout:ttyS1 2023-11-04T01:24:40.617 DEBUG:teuthology.parallel:result is None 2023-11-04T01:24:40.617 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-04T01:24:40.625 INFO:teuthology.task.internal:Creating test directory... 2023-11-04T01:24:40.625 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-04T01:24:40.627 DEBUG:teuthology.orchestra.run.smithi141:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-04T01:24:40.646 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-04T01:24:40.654 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-04T01:24:40.662 INFO:teuthology.task.internal:Creating archive directory... 2023-11-04T01:24:40.662 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-04T01:24:40.687 DEBUG:teuthology.orchestra.run.smithi141:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-04T01:24:40.727 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-04T01:24:40.735 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-04T01:24:40.736 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-04T01:24:40.744 DEBUG:teuthology.orchestra.run.smithi141:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-04T01:24:40.768 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:24:40.781 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:24:40.809 INFO:teuthology.orchestra.run.smithi141.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:24:40.823 INFO:teuthology.orchestra.run.smithi141.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:24:40.825 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-04T01:24:40.833 INFO:teuthology.task.internal:Configuring sudo... 2023-11-04T01:24:40.833 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-04T01:24:40.836 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-04T01:24:40.865 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-04T01:24:40.874 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-04T01:24:40.874 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-04T01:24:40.906 DEBUG:teuthology.orchestra.run.smithi141:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-04T01:24:40.922 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:24:41.005 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:24:41.059 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:24:41.145 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:24:41.190 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:24:41.191 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-04T01:24:41.262 DEBUG:teuthology.orchestra.run.smithi141:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:24:41.303 DEBUG:teuthology.orchestra.run.smithi141:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:24:41.387 DEBUG:teuthology.orchestra.run.smithi141:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:24:41.429 DEBUG:teuthology.orchestra.run.smithi141:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:24:41.472 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:24:41.472 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-04T01:24:41.539 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2023-11-04T01:24:41.542 DEBUG:teuthology.orchestra.run.smithi141:> sudo service rsyslog restart 2023-11-04T01:24:41.594 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T01:24:41.634 INFO:teuthology.orchestra.run.smithi141.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T01:24:42.142 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-04T01:24:42.150 INFO:teuthology.task.internal:Starting timer... 2023-11-04T01:24:42.150 INFO:teuthology.run_tasks:Running task pcp... 2023-11-04T01:24:42.164 INFO:teuthology.run_tasks:Running task selinux... 2023-11-04T01:24:42.174 DEBUG:teuthology.orchestra.run.smithi114:> sudo service auditd rotate 2023-11-04T01:24:42.262 INFO:teuthology.orchestra.run.smithi114.stdout:Rotating logs: 2023-11-04T01:24:42.264 DEBUG:teuthology.orchestra.run.smithi141:> sudo service auditd rotate 2023-11-04T01:24:42.336 INFO:teuthology.orchestra.run.smithi141.stdout:Rotating logs: 2023-11-04T01:24:42.338 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-04T01:24:42.338 DEBUG:teuthology.orchestra.run.smithi114:> /usr/sbin/getenforce 2023-11-04T01:24:42.376 INFO:teuthology.orchestra.run.smithi114.stdout:Permissive 2023-11-04T01:24:42.377 DEBUG:teuthology.orchestra.run.smithi141:> /usr/sbin/getenforce 2023-11-04T01:24:42.399 INFO:teuthology.orchestra.run.smithi141.stdout:Permissive 2023-11-04T01:24:42.400 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi114.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi141.front.sepia.ceph.com': 'permissive'} 2023-11-04T01:24:42.400 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T01:24:42.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:24:42.472 DEBUG:teuthology.orchestra.run.smithi141:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T01:24:42.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:24:42.499 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-04T01:24:42.499 DEBUG:teuthology.orchestra.run.smithi114:> sudo /usr/sbin/setenforce permissive 2023-11-04T01:24:42.663 DEBUG:teuthology.orchestra.run.smithi141:> sudo /usr/sbin/setenforce permissive 2023-11-04T01:24:42.701 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-04T01:24:42.712 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-04T01:24:42.712 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-04T01:24:42.734 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-04T01:24:42.735 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi114.front.sepia.ceph.com,smithi141.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-04T01:33:21.618 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi114.front.sepia.ceph.com'), Remote(name='ubuntu@smithi141.front.sepia.ceph.com')] 2023-11-04T01:33:21.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-11-04T01:33:21.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:33:21.709 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-11-04T01:33:21.780 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-11-04T01:33:21.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-11-04T01:33:21.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:33:21.865 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-11-04T01:33:21.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-11-04T01:33:21.936 INFO:teuthology.run_tasks:Running task clock... 2023-11-04T01:33:21.948 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-04T01:33:21.948 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-04T01:33:21.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:33:21.952 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-04T01:33:21.952 DEBUG:teuthology.orchestra.run.smithi141:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:33:21.984 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-04T01:33:22.007 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-04T01:33:22.013 INFO:teuthology.orchestra.run.smithi141.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-04T01:33:22.030 INFO:teuthology.orchestra.run.smithi141.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-04T01:33:22.037 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: ntpd: command not found 2023-11-04T01:33:22.049 INFO:teuthology.orchestra.run.smithi114.stdout:506 Cannot talk to daemon 2023-11-04T01:33:22.061 INFO:teuthology.orchestra.run.smithi141.stderr:sudo: ntpd: command not found 2023-11-04T01:33:22.070 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-04T01:33:22.075 INFO:teuthology.orchestra.run.smithi141.stdout:506 Cannot talk to daemon 2023-11-04T01:33:22.081 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-04T01:33:22.092 INFO:teuthology.orchestra.run.smithi141.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-04T01:33:22.108 INFO:teuthology.orchestra.run.smithi141.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-04T01:33:22.125 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: ntpq: command not found 2023-11-04T01:33:22.128 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T01:33:22.129 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2023-11-04T01:33:22.129 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:22.129 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:22.129 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:22.129 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:22.151 INFO:teuthology.orchestra.run.smithi141.stderr:bash: line 1: ntpq: command not found 2023-11-04T01:33:22.156 INFO:teuthology.orchestra.run.smithi141.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T01:33:22.156 INFO:teuthology.orchestra.run.smithi141.stdout:=============================================================================== 2023-11-04T01:33:22.156 INFO:teuthology.orchestra.run.smithi141.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:22.156 INFO:teuthology.orchestra.run.smithi141.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:22.156 INFO:teuthology.orchestra.run.smithi141.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:22.156 INFO:teuthology.orchestra.run.smithi141.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:33:22.156 INFO:teuthology.run_tasks:Running task install... 2023-11-04T01:33:22.171 DEBUG:teuthology.task.install:project ceph 2023-11-04T01:33:22.171 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}} 2023-11-04T01:33:22.171 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'} 2023-11-04T01:33:22.172 INFO:teuthology.task.install:Using flavor: default 2023-11-04T01:33:22.180 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-04T01:33:22.180 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-04T01:33:22.181 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'tag': None, 'wait_for_package': False} 2023-11-04T01:33:22.185 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:33:22.189 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'tag': None, 'wait_for_package': False} 2023-11-04T01:33:22.191 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:33:22.377 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/ 2023-11-04T01:33:22.377 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7035.g7532011a 2023-11-04T01:33:22.394 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/ 2023-11-04T01:33:22.394 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7035.g7532011a 2023-11-04T01:33:22.590 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-04T01:33:22.591 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:33:22.591 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-04T01:33:22.611 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-04T01:33:22.611 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:33:22.611 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-04T01:33:22.624 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-04T01:33:22.624 DEBUG:teuthology.orchestra.run.smithi114:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-04T01:33:22.645 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-04T01:33:22.645 DEBUG:teuthology.orchestra.run.smithi141:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-04T01:33:22.693 DEBUG:teuthology.orchestra.run.smithi114:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-04T01:33:22.717 DEBUG:teuthology.orchestra.run.smithi141:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-04T01:33:22.772 DEBUG:teuthology.orchestra.run.smithi114:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-04T01:33:22.802 DEBUG:teuthology.orchestra.run.smithi141:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-04T01:33:22.838 INFO:teuthology.orchestra.run.smithi114.stdout:check_obsoletes = 1 2023-11-04T01:33:22.844 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum clean all 2023-11-04T01:33:22.869 INFO:teuthology.orchestra.run.smithi141.stdout:check_obsoletes = 1 2023-11-04T01:33:22.875 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum clean all 2023-11-04T01:33:23.080 INFO:teuthology.orchestra.run.smithi114.stdout:72 files removed 2023-11-04T01:33:23.108 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-04T01:33:23.121 INFO:teuthology.orchestra.run.smithi141.stdout:72 files removed 2023-11-04T01:33:23.148 DEBUG:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-04T01:33:23.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph packages for x86_64 249 kB/s | 78 kB 00:00 2023-11-04T01:33:23.899 INFO:teuthology.orchestra.run.smithi141.stdout:ceph packages for x86_64 184 kB/s | 78 kB 00:00 2023-11-04T01:33:24.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph noarch packages 27 kB/s | 9.4 kB 00:00 2023-11-04T01:33:24.259 INFO:teuthology.orchestra.run.smithi141.stdout:ceph noarch packages 30 kB/s | 9.4 kB 00:00 2023-11-04T01:33:24.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2023-11-04T01:33:24.667 INFO:teuthology.orchestra.run.smithi141.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2023-11-04T01:33:24.875 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS-9 - AppStream 18 MB/s | 6.3 MB 00:00 2023-11-04T01:33:25.053 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS-9 - AppStream 18 MB/s | 6.3 MB 00:00 2023-11-04T01:33:26.184 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS-9 - BaseOS 7.7 MB/s | 2.0 MB 00:00 2023-11-04T01:33:26.487 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS-9 - BaseOS 5.0 MB/s | 2.0 MB 00:00 2023-11-04T01:33:28.575 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - BaseOS 3.8 MB/s | 7.9 MB 00:02 2023-11-04T01:33:32.511 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS Stream 9 - BaseOS 1.4 MB/s | 7.9 MB 00:05 2023-11-04T01:33:34.080 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - AppStream 4.0 MB/s | 18 MB 00:04 2023-11-04T01:33:37.111 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS Stream 9 - AppStream 5.1 MB/s | 18 MB 00:03 2023-11-04T01:33:38.868 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 5.8 MB 00:01 2023-11-04T01:33:40.193 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 15 kB 00:00 2023-11-04T01:33:41.212 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 5.8 MB 00:00 2023-11-04T01:33:42.529 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 15 kB 00:00 2023-11-04T01:33:42.907 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 7.5 MB/s | 19 MB 00:02 2023-11-04T01:33:47.495 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2023-11-04T01:33:49.840 INFO:teuthology.orchestra.run.smithi114.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-04T01:33:49.840 INFO:teuthology.orchestra.run.smithi114.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-04T01:33:49.855 INFO:teuthology.orchestra.run.smithi114.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-04T01:33:49.855 INFO:teuthology.orchestra.run.smithi114.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-04T01:33:49.856 INFO:teuthology.orchestra.run.smithi114.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-04T01:33:49.857 INFO:teuthology.orchestra.run.smithi114.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-04T01:33:49.859 INFO:teuthology.orchestra.run.smithi114.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-04T01:33:49.862 INFO:teuthology.orchestra.run.smithi114.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-04T01:33:49.866 INFO:teuthology.orchestra.run.smithi114.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-04T01:33:49.932 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2023-11-04T01:33:49.952 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================================ 2023-11-04T01:33:49.953 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2023-11-04T01:33:49.953 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================================ 2023-11-04T01:33:49.953 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2023-11-04T01:33:49.953 INFO:teuthology.orchestra.run.smithi114.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-04T01:33:49.953 INFO:teuthology.orchestra.run.smithi114.stdout: ceph x86_64 2:18.0.0-7035.g7532011a.el9 ceph 6.5 k 2023-11-04T01:33:49.953 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base x86_64 2:18.0.0-7035.g7532011a.el9 ceph 5.2 M 2023-11-04T01:33:49.953 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 859 k 2023-11-04T01:33:49.953 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7035.g7532011a.el9 ceph 140 k 2023-11-04T01:33:49.953 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr x86_64 2:18.0.0-7035.g7532011a.el9 ceph 1.5 M 2023-11-04T01:33:49.953 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 132 k 2023-11-04T01:33:49.953 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 1.8 M 2023-11-04T01:33:49.954 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 7.4 M 2023-11-04T01:33:49.954 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 48 k 2023-11-04T01:33:49.954 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw x86_64 2:18.0.0-7035.g7532011a.el9 ceph 8.7 M 2023-11-04T01:33:49.954 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test x86_64 2:18.0.0-7035.g7532011a.el9 ceph 41 M 2023-11-04T01:33:49.954 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-volume noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 262 k 2023-11-04T01:33:49.954 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 270 k 2023-11-04T01:33:49.954 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror x86_64 2:18.0.0-7035.g7532011a.el9 ceph 217 k 2023-11-04T01:33:49.954 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-top noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 18 k 2023-11-04T01:33:49.954 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-11-04T01:33:49.954 INFO:teuthology.orchestra.run.smithi114.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-04T01:33:49.954 INFO:teuthology.orchestra.run.smithi114.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-04T01:33:49.955 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel x86_64 2:18.0.0-7035.g7532011a.el9 ceph 31 k 2023-11-04T01:33:49.955 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 718 k 2023-11-04T01:33:49.955 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel x86_64 2:18.0.0-7035.g7532011a.el9 ceph 126 k 2023-11-04T01:33:49.955 INFO:teuthology.orchestra.run.smithi114.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-04T01:33:49.955 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-11-04T01:33:49.955 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-11-04T01:33:49.955 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-04T01:33:49.955 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-04T01:33:49.955 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-04T01:33:49.955 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs x86_64 2:18.0.0-7035.g7532011a.el9 ceph 162 k 2023-11-04T01:33:49.955 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados x86_64 2:18.0.0-7035.g7532011a.el9 ceph 320 k 2023-11-04T01:33:49.955 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 299 k 2023-11-04T01:33:49.956 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw x86_64 2:18.0.0-7035.g7532011a.el9 ceph 99 k 2023-11-04T01:33:49.956 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 84 k 2023-11-04T01:33:49.956 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.0 M 2023-11-04T01:33:49.956 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 169 k 2023-11-04T01:33:49.956 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-11-04T01:33:49.956 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrading: 2023-11-04T01:33:49.956 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager x86_64 1:1.45.5-1.el9 CentOS-BaseOS 2.2 M 2023-11-04T01:33:49.956 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-libnm x86_64 1:1.45.5-1.el9 CentOS-BaseOS 1.8 M 2023-11-04T01:33:49.956 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-team x86_64 1:1.45.5-1.el9 CentOS-BaseOS 42 k 2023-11-04T01:33:49.956 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-tui x86_64 1:1.45.5-1.el9 CentOS-BaseOS 245 k 2023-11-04T01:33:49.956 INFO:teuthology.orchestra.run.smithi114.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-04T01:33:49.956 INFO:teuthology.orchestra.run.smithi114.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-04T01:33:49.957 INFO:teuthology.orchestra.run.smithi114.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-04T01:33:49.957 INFO:teuthology.orchestra.run.smithi114.stdout: librados2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.3 M 2023-11-04T01:33:49.957 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.0 M 2023-11-04T01:33:49.957 INFO:teuthology.orchestra.run.smithi114.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-04T01:33:49.957 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2023-11-04T01:33:49.957 INFO:teuthology.orchestra.run.smithi114.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-11-04T01:33:49.957 INFO:teuthology.orchestra.run.smithi114.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-04T01:33:49.958 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common x86_64 2:18.0.0-7035.g7532011a.el9 ceph 19 M 2023-11-04T01:33:49.958 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 23 k 2023-11-04T01:33:49.958 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds x86_64 2:18.0.0-7035.g7532011a.el9 ceph 2.1 M 2023-11-04T01:33:49.958 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 243 k 2023-11-04T01:33:49.958 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon x86_64 2:18.0.0-7035.g7532011a.el9 ceph 4.4 M 2023-11-04T01:33:49.958 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 18 M 2023-11-04T01:33:49.958 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 15 k 2023-11-04T01:33:49.958 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux x86_64 2:18.0.0-7035.g7532011a.el9 ceph 24 k 2023-11-04T01:33:49.958 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-04T01:33:49.958 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-04T01:33:49.958 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-04T01:33:49.959 INFO:teuthology.orchestra.run.smithi114.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-04T01:33:49.959 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-04T01:33:49.959 INFO:teuthology.orchestra.run.smithi114.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-04T01:33:49.959 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-04T01:33:49.959 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-04T01:33:49.959 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite x86_64 2:18.0.0-7035.g7532011a.el9 ceph 163 k 2023-11-04T01:33:49.959 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-04T01:33:49.959 INFO:teuthology.orchestra.run.smithi114.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-04T01:33:49.959 INFO:teuthology.orchestra.run.smithi114.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-04T01:33:49.959 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-04T01:33:49.959 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-04T01:33:49.959 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 476 k 2023-11-04T01:33:49.959 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-04T01:33:49.960 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 4.8 M 2023-11-04T01:33:49.960 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-04T01:33:49.960 INFO:teuthology.orchestra.run.smithi114.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-04T01:33:49.960 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-04T01:33:49.960 INFO:teuthology.orchestra.run.smithi114.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-04T01:33:49.960 INFO:teuthology.orchestra.run.smithi114.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-04T01:33:49.960 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-04T01:33:49.960 INFO:teuthology.orchestra.run.smithi114.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-04T01:33:49.960 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-04T01:33:49.960 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-04T01:33:49.960 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-04T01:33:49.960 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-04T01:33:49.961 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-04T01:33:49.961 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 45 k 2023-11-04T01:33:49.961 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common x86_64 2:18.0.0-7035.g7532011a.el9 ceph 127 k 2023-11-04T01:33:49.961 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-04T01:33:49.961 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-04T01:33:49.961 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-04T01:33:49.961 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-04T01:33:49.961 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-04T01:33:49.962 INFO:teuthology.orchestra.run.smithi114.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-04T01:33:49.962 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-04T01:33:49.962 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-04T01:33:49.962 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-04T01:33:49.962 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-04T01:33:49.962 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-04T01:33:49.962 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-04T01:33:49.962 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-04T01:33:49.962 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-04T01:33:49.962 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-04T01:33:49.963 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-04T01:33:49.963 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-04T01:33:49.963 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-04T01:33:49.963 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-04T01:33:49.963 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-04T01:33:49.963 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-04T01:33:49.964 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-04T01:33:49.964 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-04T01:33:49.964 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-04T01:33:49.964 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-04T01:33:49.964 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-04T01:33:49.964 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-04T01:33:49.964 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-04T01:33:49.964 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-04T01:33:49.964 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-04T01:33:49.964 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-04T01:33:49.964 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-04T01:33:49.964 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-04T01:33:49.964 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-04T01:33:49.965 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-04T01:33:49.965 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-04T01:33:49.965 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-04T01:33:49.965 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-04T01:33:49.965 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-04T01:33:49.965 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-04T01:33:49.965 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-04T01:33:49.965 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-04T01:33:49.965 INFO:teuthology.orchestra.run.smithi114.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-04T01:33:49.965 INFO:teuthology.orchestra.run.smithi114.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-04T01:33:49.965 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-04T01:33:49.965 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-04T01:33:49.965 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-04T01:33:49.966 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-04T01:33:49.966 INFO:teuthology.orchestra.run.smithi114.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-04T01:33:49.966 INFO:teuthology.orchestra.run.smithi114.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-04T01:33:49.966 INFO:teuthology.orchestra.run.smithi114.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-04T01:33:49.966 INFO:teuthology.orchestra.run.smithi114.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-04T01:33:49.966 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-04T01:33:49.966 INFO:teuthology.orchestra.run.smithi114.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-11-04T01:33:49.966 INFO:teuthology.orchestra.run.smithi114.stdout:Installing weak dependencies: 2023-11-04T01:33:49.966 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-04T01:33:49.966 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:33:49.966 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2023-11-04T01:33:49.966 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================================ 2023-11-04T01:33:49.967 INFO:teuthology.orchestra.run.smithi114.stdout:Install 132 Packages 2023-11-04T01:33:49.967 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrade 10 Packages 2023-11-04T01:33:49.967 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:33:49.968 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 200 M 2023-11-04T01:33:49.968 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2023-11-04T01:33:50.813 INFO:teuthology.orchestra.run.smithi114.stdout:(1/142): ceph-18.0.0-7035.g7532011a.el9.x86_64. 28 kB/s | 6.5 kB 00:00 2023-11-04T01:33:51.099 INFO:teuthology.orchestra.run.smithi114.stdout:(2/142): ceph-fuse-18.0.0-7035.g7532011a.el9.x8 3.0 MB/s | 859 kB 00:00 2023-11-04T01:33:51.205 INFO:teuthology.orchestra.run.smithi114.stdout:(3/142): ceph-base-18.0.0-7035.g7532011a.el9.x8 8.4 MB/s | 5.2 MB 00:00 2023-11-04T01:33:51.230 INFO:teuthology.orchestra.run.smithi114.stdout:(4/142): ceph-immutable-object-cache-18.0.0-703 1.0 MB/s | 140 kB 00:00 2023-11-04T01:33:51.406 INFO:teuthology.orchestra.run.smithi114.stdout:(5/142): ceph-mds-18.0.0-7035.g7532011a.el9.x86 10 MB/s | 2.1 MB 00:00 2023-11-04T01:33:51.514 INFO:teuthology.orchestra.run.smithi114.stdout:(6/142): ceph-mgr-18.0.0-7035.g7532011a.el9.x86 5.2 MB/s | 1.5 MB 00:00 2023-11-04T01:33:51.894 INFO:teuthology.orchestra.run.smithi114.stdout:(7/142): ceph-mon-18.0.0-7035.g7532011a.el9.x86 9.0 MB/s | 4.4 MB 00:00 2023-11-04T01:33:52.773 INFO:teuthology.orchestra.run.smithi114.stdout:(8/142): ceph-radosgw-18.0.0-7035.g7532011a.el9 9.9 MB/s | 8.7 MB 00:00 2023-11-04T01:33:52.833 INFO:teuthology.orchestra.run.smithi114.stdout:(9/142): ceph-selinux-18.0.0-7035.g7532011a.el9 413 kB/s | 24 kB 00:00 2023-11-04T01:33:53.416 INFO:teuthology.orchestra.run.smithi114.stdout:(10/142): ceph-common-18.0.0-7035.g7532011a.el9 6.7 MB/s | 19 MB 00:02 2023-11-04T01:33:53.590 INFO:teuthology.orchestra.run.smithi114.stdout:(11/142): ceph-osd-18.0.0-7035.g7532011a.el9.x8 8.5 MB/s | 18 MB 00:02 2023-11-04T01:33:53.615 INFO:teuthology.orchestra.run.smithi114.stdout:(12/142): cephfs-mirror-18.0.0-7035.g7532011a.e 1.1 MB/s | 217 kB 00:00 2023-11-04T01:33:53.649 INFO:teuthology.orchestra.run.smithi114.stdout:(13/142): libcephfs-devel-18.0.0-7035.g7532011a 533 kB/s | 31 kB 00:00 2023-11-04T01:33:53.741 INFO:teuthology.orchestra.run.smithi114.stdout:(14/142): libcephsqlite-18.0.0-7035.g7532011a.e 1.7 MB/s | 163 kB 00:00 2023-11-04T01:33:53.775 INFO:teuthology.orchestra.run.smithi114.stdout:(15/142): libcephfs2-18.0.0-7035.g7532011a.el9. 4.4 MB/s | 718 kB 00:00 2023-11-04T01:33:53.842 INFO:teuthology.orchestra.run.smithi114.stdout:(16/142): librados-devel-18.0.0-7035.g7532011a. 1.2 MB/s | 126 kB 00:00 2023-11-04T01:33:53.908 INFO:teuthology.orchestra.run.smithi114.stdout:(17/142): libradosstriper1-18.0.0-7035.g7532011 3.5 MB/s | 476 kB 00:00 2023-11-04T01:33:53.984 INFO:teuthology.orchestra.run.smithi114.stdout:(18/142): python3-ceph-argparse-18.0.0-7035.g75 602 kB/s | 45 kB 00:00 2023-11-04T01:33:54.076 INFO:teuthology.orchestra.run.smithi114.stdout:(19/142): python3-ceph-common-18.0.0-7035.g7532 1.3 MB/s | 127 kB 00:00 2023-11-04T01:33:54.159 INFO:teuthology.orchestra.run.smithi114.stdout:(20/142): python3-cephfs-18.0.0-7035.g7532011a. 1.9 MB/s | 162 kB 00:00 2023-11-04T01:33:54.252 INFO:teuthology.orchestra.run.smithi114.stdout:(21/142): python3-rados-18.0.0-7035.g7532011a.e 3.4 MB/s | 320 kB 00:00 2023-11-04T01:33:54.343 INFO:teuthology.orchestra.run.smithi114.stdout:(22/142): librgw2-18.0.0-7035.g7532011a.el9.x86 9.6 MB/s | 4.8 MB 00:00 2023-11-04T01:33:54.369 INFO:teuthology.orchestra.run.smithi114.stdout:(23/142): python3-rbd-18.0.0-7035.g7532011a.el9 2.5 MB/s | 299 kB 00:00 2023-11-04T01:33:54.410 INFO:teuthology.orchestra.run.smithi114.stdout:(24/142): python3-rgw-18.0.0-7035.g7532011a.el9 1.5 MB/s | 99 kB 00:00 2023-11-04T01:33:54.436 INFO:teuthology.orchestra.run.smithi114.stdout:(25/142): rbd-fuse-18.0.0-7035.g7532011a.el9.x8 1.2 MB/s | 84 kB 00:00 2023-11-04T01:33:54.528 INFO:teuthology.orchestra.run.smithi114.stdout:(26/142): rbd-nbd-18.0.0-7035.g7532011a.el9.x86 1.8 MB/s | 169 kB 00:00 2023-11-04T01:33:54.611 INFO:teuthology.orchestra.run.smithi114.stdout:(27/142): ceph-grafana-dashboards-18.0.0-7035.g 278 kB/s | 23 kB 00:00 2023-11-04T01:33:54.722 INFO:teuthology.orchestra.run.smithi114.stdout:(28/142): rbd-mirror-18.0.0-7035.g7532011a.el9. 9.7 MB/s | 3.0 MB 00:00 2023-11-04T01:33:54.746 INFO:teuthology.orchestra.run.smithi114.stdout:(29/142): ceph-mgr-cephadm-18.0.0-7035.g7532011 989 kB/s | 132 kB 00:00 2023-11-04T01:33:54.946 INFO:teuthology.orchestra.run.smithi114.stdout:(30/142): ceph-mgr-dashboard-18.0.0-7035.g75320 7.8 MB/s | 1.8 MB 00:00 2023-11-04T01:33:55.038 INFO:teuthology.orchestra.run.smithi114.stdout:(31/142): ceph-mgr-modules-core-18.0.0-7035.g75 2.6 MB/s | 243 kB 00:00 2023-11-04T01:33:55.125 INFO:teuthology.orchestra.run.smithi114.stdout:(32/142): ceph-mgr-rook-18.0.0-7035.g7532011a.e 573 kB/s | 48 kB 00:00 2023-11-04T01:33:55.205 INFO:teuthology.orchestra.run.smithi114.stdout:(33/142): ceph-prometheus-alerts-18.0.0-7035.g7 181 kB/s | 15 kB 00:00 2023-11-04T01:33:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:(34/142): ceph-volume-18.0.0-7035.g7532011a.el9 2.2 MB/s | 262 kB 00:00 2023-11-04T01:33:55.441 INFO:teuthology.orchestra.run.smithi114.stdout:(35/142): cephadm-18.0.0-7035.g7532011a.el9.noa 2.3 MB/s | 270 kB 00:00 2023-11-04T01:33:55.531 INFO:teuthology.orchestra.run.smithi114.stdout:(36/142): cephfs-top-18.0.0-7035.g7532011a.el9. 199 kB/s | 18 kB 00:00 2023-11-04T01:33:55.656 INFO:teuthology.orchestra.run.smithi114.stdout:(37/142): ceph-mgr-diskprediction-local-18.0.0- 8.1 MB/s | 7.4 MB 00:00 2023-11-04T01:33:55.715 INFO:teuthology.orchestra.run.smithi114.stdout:(38/142): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2023-11-04T01:33:55.749 INFO:teuthology.orchestra.run.smithi114.stdout:(39/142): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 920 kB 00:00 2023-11-04T01:33:55.778 INFO:teuthology.orchestra.run.smithi114.stdout:(40/142): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2023-11-04T01:33:55.791 INFO:teuthology.orchestra.run.smithi114.stdout:(41/142): flexiblas-3.0.4-8.el9.x86_64.rpm 765 kB/s | 32 kB 00:00 2023-11-04T01:33:55.859 INFO:teuthology.orchestra.run.smithi114.stdout:(42/142): flexiblas-netlib-3.0.4-8.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2023-11-04T01:33:55.874 INFO:teuthology.orchestra.run.smithi114.stdout:(43/142): flexiblas-openblas-openmp-3.0.4-8.el9 211 kB/s | 17 kB 00:00 2023-11-04T01:33:55.900 INFO:teuthology.orchestra.run.smithi114.stdout:(44/142): libaio-devel-0.3.111-13.el9.x86_64.rp 407 kB/s | 10 kB 00:00 2023-11-04T01:33:55.926 INFO:teuthology.orchestra.run.smithi114.stdout:(45/142): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-11-04T01:33:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:(46/142): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-11-04T01:33:55.976 INFO:teuthology.orchestra.run.smithi114.stdout:(47/142): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2023-11-04T01:33:55.993 INFO:teuthology.orchestra.run.smithi114.stdout:(48/142): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2023-11-04T01:33:56.019 INFO:teuthology.orchestra.run.smithi114.stdout:(49/142): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2023-11-04T01:33:56.043 INFO:teuthology.orchestra.run.smithi114.stdout:(50/142): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2023-11-04T01:33:56.060 INFO:teuthology.orchestra.run.smithi114.stdout:(51/142): openblas-0.3.21-2.el9.x86_64.rpm 824 kB/s | 34 kB 00:00 2023-11-04T01:33:56.144 INFO:teuthology.orchestra.run.smithi114.stdout:(52/142): openblas-openmp-0.3.21-2.el9.x86_64.r 47 MB/s | 4.7 MB 00:00 2023-11-04T01:33:56.186 INFO:teuthology.orchestra.run.smithi114.stdout:(53/142): postgresql-13.11-1.el9.x86_64.rpm 12 MB/s | 1.5 MB 00:00 2023-11-04T01:33:56.228 INFO:teuthology.orchestra.run.smithi114.stdout:(54/142): postgresql-contrib-13.11-1.el9.x86_64 9.8 MB/s | 811 kB 00:00 2023-11-04T01:33:56.253 INFO:teuthology.orchestra.run.smithi114.stdout:(55/142): postgresql-private-libs-13.11-1.el9.x 2.0 MB/s | 134 kB 00:00 2023-11-04T01:33:56.345 INFO:teuthology.orchestra.run.smithi114.stdout:(56/142): postgresql-server-13.11-1.el9.x86_64. 49 MB/s | 5.7 MB 00:00 2023-11-04T01:33:56.714 INFO:teuthology.orchestra.run.smithi114.stdout:(57/142): ceph-test-18.0.0-7035.g7532011a.el9.x 11 MB/s | 41 MB 00:03 2023-11-04T01:33:56.787 INFO:teuthology.orchestra.run.smithi114.stdout:(58/142): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 5.8 MB 00:00 2023-11-04T01:33:56.812 INFO:teuthology.orchestra.run.smithi114.stdout:(59/142): python3-devel-3.9.17-2.el9.x86_64.rpm 441 kB/s | 205 kB 00:00 2023-11-04T01:33:56.838 INFO:teuthology.orchestra.run.smithi114.stdout:(60/142): python3-jinja2-2.11.3-4.el9.noarch.rp 1.8 MB/s | 228 kB 00:00 2023-11-04T01:33:56.864 INFO:teuthology.orchestra.run.smithi114.stdout:(61/142): python3-jsonpatch-1.21-16.el9.noarch. 492 kB/s | 24 kB 00:00 2023-11-04T01:33:56.890 INFO:teuthology.orchestra.run.smithi114.stdout:(62/142): python3-jsonpointer-2.0-4.el9.noarch. 242 kB/s | 18 kB 00:00 2023-11-04T01:33:56.907 INFO:teuthology.orchestra.run.smithi114.stdout:(63/142): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2023-11-04T01:33:56.930 INFO:teuthology.orchestra.run.smithi114.stdout:(64/142): python3-markupsafe-1.1.1-12.el9.x86_6 763 kB/s | 32 kB 00:00 2023-11-04T01:33:56.998 INFO:teuthology.orchestra.run.smithi114.stdout:(65/142): python3-numpy-1.20.1-5.el9.x86_64.rpm 44 MB/s | 4.8 MB 00:00 2023-11-04T01:33:57.023 INFO:teuthology.orchestra.run.smithi114.stdout:(66/142): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.9 MB/s | 217 kB 00:00 2023-11-04T01:33:57.048 INFO:teuthology.orchestra.run.smithi114.stdout:(67/142): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 174 kB 00:00 2023-11-04T01:33:57.073 INFO:teuthology.orchestra.run.smithi114.stdout:(68/142): python3-prettytable-0.7.2-27.el9.noar 552 kB/s | 41 kB 00:00 2023-11-04T01:33:57.097 INFO:teuthology.orchestra.run.smithi114.stdout:(69/142): python3-pyasn1-modules-0.4.8-6.el9.no 4.3 MB/s | 211 kB 00:00 2023-11-04T01:33:57.122 INFO:teuthology.orchestra.run.smithi114.stdout:(70/142): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 132 kB 00:00 2023-11-04T01:33:57.147 INFO:teuthology.orchestra.run.smithi114.stdout:(71/142): python3-requests-oauthlib-1.3.0-12.el 584 kB/s | 43 kB 00:00 2023-11-04T01:33:57.339 INFO:teuthology.orchestra.run.smithi114.stdout:(72/142): python3-scipy-1.6.2-8.el9.x86_64.rpm 65 MB/s | 16 MB 00:00 2023-11-04T01:33:57.364 INFO:teuthology.orchestra.run.smithi114.stdout:(73/142): python3-toml-0.10.2-6.el9.noarch.rpm 180 kB/s | 39 kB 00:00 2023-11-04T01:33:57.390 INFO:teuthology.orchestra.run.smithi114.stdout:(74/142): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 300 kB 00:00 2023-11-04T01:33:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:(75/142): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2023-11-04T01:33:57.465 INFO:teuthology.orchestra.run.smithi114.stdout:(76/142): xmlstarlet-1.6.1-20.el9.x86_64.rpm 630 kB/s | 63 kB 00:00 2023-11-04T01:33:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:(77/142): fuse-2.9.9-15.el9.x86_64.rpm 783 kB/s | 79 kB 00:00 2023-11-04T01:33:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:(78/142): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2023-11-04T01:33:57.555 INFO:teuthology.orchestra.run.smithi114.stdout:(79/142): libgfortran-11.4.1-2.3.el9.x86_64.rpm 9.3 MB/s | 803 kB 00:00 2023-11-04T01:33:57.575 INFO:teuthology.orchestra.run.smithi114.stdout:(80/142): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.8 MB/s | 241 kB 00:00 2023-11-04T01:33:57.602 INFO:teuthology.orchestra.run.smithi114.stdout:(81/142): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2023-11-04T01:33:57.625 INFO:teuthology.orchestra.run.smithi114.stdout:(82/142): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2023-11-04T01:33:57.650 INFO:teuthology.orchestra.run.smithi114.stdout:(83/142): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-11-04T01:33:57.677 INFO:teuthology.orchestra.run.smithi114.stdout:(84/142): python3-urllib3-1.26.5-4.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2023-11-04T01:33:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:(85/142): elfutils-libelf-devel-0.189-3.el9.x86 57 kB/s | 22 kB 00:00 2023-11-04T01:33:58.385 INFO:teuthology.orchestra.run.smithi114.stdout:(86/142): jq-1.6-15.el9.x86_64.rpm 590 kB/s | 187 kB 00:00 2023-11-04T01:33:58.509 INFO:teuthology.orchestra.run.smithi114.stdout:(87/142): automake-1.16.2-8.el9.noarch.rpm 803 kB/s | 689 kB 00:00 2023-11-04T01:33:58.527 INFO:teuthology.orchestra.run.smithi114.stdout:(88/142): librabbitmq-0.11.0-7.el9.x86_64.rpm 319 kB/s | 45 kB 00:00 2023-11-04T01:33:58.644 INFO:teuthology.orchestra.run.smithi114.stdout:(89/142): libuuid-devel-2.37.4-15.el9.x86_64.rp 191 kB/s | 26 kB 00:00 2023-11-04T01:33:58.961 INFO:teuthology.orchestra.run.smithi114.stdout:(90/142): python3-pytz-2021.1-5.el9.noarch.rpm 161 kB/s | 51 kB 00:00 2023-11-04T01:33:59.028 INFO:teuthology.orchestra.run.smithi114.stdout:(91/142): openssl-devel-3.0.7-24.el9.x86_64.rpm 8.2 MB/s | 4.1 MB 00:00 2023-11-04T01:33:59.064 INFO:teuthology.orchestra.run.smithi114.stdout:(92/142): python3-cryptography-36.0.1-4.el9.x86 890 kB/s | 1.2 MB 00:01 2023-11-04T01:33:59.087 INFO:teuthology.orchestra.run.smithi114.stdout:(93/142): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 690 kB/s | 86 kB 00:00 2023-11-04T01:33:59.129 INFO:teuthology.orchestra.run.smithi114.stdout:(94/142): zlib-devel-1.2.11-40.el9.x86_64.rpm 449 kB/s | 45 kB 00:00 2023-11-04T01:33:59.279 INFO:teuthology.orchestra.run.smithi114.stdout:(95/142): libarrow-doc-9.0.0-9.el9.noarch.rpm 162 kB/s | 24 kB 00:00 2023-11-04T01:33:59.363 INFO:teuthology.orchestra.run.smithi114.stdout:(96/142): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.0 MB/s | 309 kB 00:00 2023-11-04T01:33:59.388 INFO:teuthology.orchestra.run.smithi114.stdout:(97/142): liboath-2.6.7-2.el9.x86_64.rpm 448 kB/s | 49 kB 00:00 2023-11-04T01:33:59.438 INFO:teuthology.orchestra.run.smithi114.stdout:(98/142): libunwind-1.6.2-1.el9.x86_64.rpm 896 kB/s | 67 kB 00:00 2023-11-04T01:33:59.547 INFO:teuthology.orchestra.run.smithi114.stdout:(99/142): libarrow-9.0.0-9.el9.x86_64.rpm 9.6 MB/s | 4.4 MB 00:00 2023-11-04T01:33:59.573 INFO:teuthology.orchestra.run.smithi114.stdout:(100/142): python3-asyncssh-2.13.2-3.el9.noarch 4.0 MB/s | 548 kB 00:00 2023-11-04T01:33:59.614 INFO:teuthology.orchestra.run.smithi114.stdout:(101/142): python3-bcrypt-3.2.2-1.el9.x86_64.rp 652 kB/s | 43 kB 00:00 2023-11-04T01:33:59.647 INFO:teuthology.orchestra.run.smithi114.stdout:(102/142): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.2 MB/s | 837 kB 00:00 2023-11-04T01:33:59.673 INFO:teuthology.orchestra.run.smithi114.stdout:(103/142): python3-cachetools-4.2.4-1.el9.noarc 320 kB/s | 32 kB 00:00 2023-11-04T01:33:59.699 INFO:teuthology.orchestra.run.smithi114.stdout:(104/142): python3-certifi-2021.10.8-2.el9.noar 179 kB/s | 15 kB 00:00 2023-11-04T01:33:59.723 INFO:teuthology.orchestra.run.smithi114.stdout:(105/142): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2023-11-04T01:33:59.757 INFO:teuthology.orchestra.run.smithi114.stdout:(106/142): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2023-11-04T01:33:59.782 INFO:teuthology.orchestra.run.smithi114.stdout:(107/142): python3-google-auth-2.23.3-1.el9.noa 2.3 MB/s | 197 kB 00:00 2023-11-04T01:33:59.807 INFO:teuthology.orchestra.run.smithi114.stdout:(108/142): python3-jaraco-8.2.1-3.el9.noarch.rp 127 kB/s | 11 kB 00:00 2023-11-04T01:33:59.824 INFO:teuthology.orchestra.run.smithi114.stdout:(109/142): python3-jaraco-classes-3.2.1-5.el9.n 262 kB/s | 18 kB 00:00 2023-11-04T01:33:59.844 INFO:teuthology.orchestra.run.smithi114.stdout:(110/142): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2023-11-04T01:33:59.858 INFO:teuthology.orchestra.run.smithi114.stdout:(111/142): python3-jaraco-functools-3.5.0-2.el9 385 kB/s | 19 kB 00:00 2023-11-04T01:33:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:(112/142): python3-jaraco-text-3.2.0-6.el9.noar 389 kB/s | 20 kB 00:00 2023-11-04T01:33:59.901 INFO:teuthology.orchestra.run.smithi114.stdout:(113/142): python3-jwt+crypto-2.4.0-1.el9.noarc 154 kB/s | 9.0 kB 00:00 2023-11-04T01:33:59.918 INFO:teuthology.orchestra.run.smithi114.stdout:(114/142): python3-jwt-2.4.0-1.el9.noarch.rpm 694 kB/s | 41 kB 00:00 2023-11-04T01:33:59.959 INFO:teuthology.orchestra.run.smithi114.stdout:(115/142): python3-logutils-0.3.5-21.el9.noarch 790 kB/s | 46 kB 00:00 2023-11-04T01:33:59.987 INFO:teuthology.orchestra.run.smithi114.stdout:(116/142): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2023-11-04T01:34:00.010 INFO:teuthology.orchestra.run.smithi114.stdout:(117/142): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2023-11-04T01:34:00.035 INFO:teuthology.orchestra.run.smithi114.stdout:(118/142): python3-natsort-7.1.1-5.el9.noarch.r 764 kB/s | 58 kB 00:00 2023-11-04T01:34:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:(119/142): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2023-11-04T01:34:00.086 INFO:teuthology.orchestra.run.smithi114.stdout:(120/142): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2023-11-04T01:34:00.203 INFO:teuthology.orchestra.run.smithi114.stdout:(121/142): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2023-11-04T01:34:00.228 INFO:teuthology.orchestra.run.smithi114.stdout:(122/142): python3-repoze-lru-0.7-16.el9.noarch 184 kB/s | 31 kB 00:00 2023-11-04T01:34:00.254 INFO:teuthology.orchestra.run.smithi114.stdout:(123/142): python3-pyOpenSSL-21.0.0-1.el9.noarc 413 kB/s | 90 kB 00:00 2023-11-04T01:34:00.470 INFO:teuthology.orchestra.run.smithi114.stdout:(124/142): python3-rsa-4.9-2.el9.noarch.rpm 221 kB/s | 59 kB 00:00 2023-11-04T01:34:00.516 INFO:teuthology.orchestra.run.smithi114.stdout:(125/142): python3-tempora-5.0.0-2.el9.noarch.r 125 kB/s | 36 kB 00:00 2023-11-04T01:34:00.543 INFO:teuthology.orchestra.run.smithi114.stdout:(126/142): python3-typing-extensions-4.4.0-2.el 178 kB/s | 51 kB 00:00 2023-11-04T01:34:00.564 INFO:teuthology.orchestra.run.smithi114.stdout:(127/142): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2023-11-04T01:34:00.607 INFO:teuthology.orchestra.run.smithi114.stdout:(128/142): python3-websocket-client-1.2.3-2.el9 972 kB/s | 90 kB 00:00 2023-11-04T01:34:00.640 INFO:teuthology.orchestra.run.smithi114.stdout:(129/142): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2023-11-04T01:34:00.666 INFO:teuthology.orchestra.run.smithi114.stdout:(130/142): python3-zc-lockfile-2.0-10.el9.noarc 198 kB/s | 20 kB 00:00 2023-11-04T01:34:00.692 INFO:teuthology.orchestra.run.smithi114.stdout:(131/142): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2023-11-04T01:34:00.741 INFO:teuthology.orchestra.run.smithi114.stdout:(132/142): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2023-11-04T01:34:00.775 INFO:teuthology.orchestra.run.smithi114.stdout:(133/142): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-11-04T01:34:00.834 INFO:teuthology.orchestra.run.smithi114.stdout:(134/142): NetworkManager-1.45.5-1.el9.x86_64.r 39 MB/s | 2.2 MB 00:00 2023-11-04T01:34:00.892 INFO:teuthology.orchestra.run.smithi114.stdout:(135/142): NetworkManager-libnm-1.45.5-1.el9.x8 30 MB/s | 1.8 MB 00:00 2023-11-04T01:34:00.926 INFO:teuthology.orchestra.run.smithi114.stdout:(136/142): NetworkManager-team-1.45.5-1.el9.x86 1.2 MB/s | 42 kB 00:00 2023-11-04T01:34:00.959 INFO:teuthology.orchestra.run.smithi114.stdout:(137/142): NetworkManager-tui-1.45.5-1.el9.x86_ 7.3 MB/s | 245 kB 00:00 2023-11-04T01:34:00.994 INFO:teuthology.orchestra.run.smithi114.stdout:(138/142): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-11-04T01:34:01.044 INFO:teuthology.orchestra.run.smithi114.stdout:(139/142): libacl-2.3.1-4.el9.x86_64.rpm 432 kB/s | 22 kB 00:00 2023-11-04T01:34:01.088 INFO:teuthology.orchestra.run.smithi114.stdout:(140/142): xfsdump-3.1.12-4.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2023-11-04T01:34:01.144 INFO:teuthology.orchestra.run.smithi114.stdout:(141/142): librbd1-18.0.0-7035.g7532011a.el9.x8 6.7 MB/s | 3.0 MB 00:00 2023-11-04T01:34:01.235 INFO:teuthology.orchestra.run.smithi114.stdout:(142/142): librados2-18.0.0-7035.g7532011a.el9. 5.8 MB/s | 3.3 MB 00:00 2023-11-04T01:34:01.240 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2023-11-04T01:34:01.241 INFO:teuthology.orchestra.run.smithi114.stdout:Total 18 MB/s | 200 MB 00:11 2023-11-04T01:34:01.383 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2023-11-04T01:34:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2023-11-04T01:34:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2023-11-04T01:34:03.294 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2023-11-04T01:34:03.295 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2023-11-04T01:34:04.420 INFO:teuthology.orchestra.run.smithi141.stdout:Extra Packages for Enterprise Linux 911 kB/s | 19 MB 00:21 2023-11-04T01:34:08.856 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2023-11-04T01:34:08.921 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2023-11-04T01:34:08.946 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2023-11-04T01:34:08.973 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2023-11-04T01:34:09.011 INFO:teuthology.orchestra.run.smithi141.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2023-11-04T01:34:09.028 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/152 2023-11-04T01:34:09.403 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/152 2023-11-04T01:34:09.431 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librados2-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:34:09.567 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:34:09.602 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:34:09.682 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:34:09.732 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 8/152 2023-11-04T01:34:09.772 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/152 2023-11-04T01:34:09.946 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/152 2023-11-04T01:34:09.997 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/152 2023-11-04T01:34:10.020 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:34:10.105 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:34:10.138 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 13/152 2023-11-04T01:34:10.191 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 13/152 2023-11-04T01:34:10.389 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/152 2023-11-04T01:34:10.509 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 15/152 2023-11-04T01:34:10.560 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 15/152 2023-11-04T01:34:10.654 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:34:10.695 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:34:10.973 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:34:11.008 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/152 2023-11-04T01:34:11.042 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2023-11-04T01:34:11.112 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2023-11-04T01:34:11.172 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 20/152 2023-11-04T01:34:11.203 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/152 2023-11-04T01:34:11.248 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/152 2023-11-04T01:34:11.322 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/152 2023-11-04T01:34:11.351 INFO:teuthology.orchestra.run.smithi141.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-04T01:34:11.353 INFO:teuthology.orchestra.run.smithi141.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-04T01:34:11.363 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/152 2023-11-04T01:34:11.365 INFO:teuthology.orchestra.run.smithi141.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-04T01:34:11.366 INFO:teuthology.orchestra.run.smithi141.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-04T01:34:11.367 INFO:teuthology.orchestra.run.smithi141.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-04T01:34:11.370 INFO:teuthology.orchestra.run.smithi141.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-04T01:34:11.371 INFO:teuthology.orchestra.run.smithi141.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-04T01:34:11.375 INFO:teuthology.orchestra.run.smithi141.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-04T01:34:11.375 INFO:teuthology.orchestra.run.smithi141.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-04T01:34:11.397 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/152 2023-11-04T01:34:11.444 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies resolved. 2023-11-04T01:34:11.466 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2023-11-04T01:34:11.472 INFO:teuthology.orchestra.run.smithi141.stdout:============================================================================================ 2023-11-04T01:34:11.472 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2023-11-04T01:34:11.472 INFO:teuthology.orchestra.run.smithi141.stdout:============================================================================================ 2023-11-04T01:34:11.472 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2023-11-04T01:34:11.472 INFO:teuthology.orchestra.run.smithi141.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-04T01:34:11.472 INFO:teuthology.orchestra.run.smithi141.stdout: ceph x86_64 2:18.0.0-7035.g7532011a.el9 ceph 6.5 k 2023-11-04T01:34:11.472 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-base x86_64 2:18.0.0-7035.g7532011a.el9 ceph 5.2 M 2023-11-04T01:34:11.472 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-fuse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 859 k 2023-11-04T01:34:11.472 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7035.g7532011a.el9 ceph 140 k 2023-11-04T01:34:11.472 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr x86_64 2:18.0.0-7035.g7532011a.el9 ceph 1.5 M 2023-11-04T01:34:11.472 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 132 k 2023-11-04T01:34:11.473 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 1.8 M 2023-11-04T01:34:11.473 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 7.4 M 2023-11-04T01:34:11.473 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-rook noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 48 k 2023-11-04T01:34:11.473 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-radosgw x86_64 2:18.0.0-7035.g7532011a.el9 ceph 8.7 M 2023-11-04T01:34:11.473 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-test x86_64 2:18.0.0-7035.g7532011a.el9 ceph 41 M 2023-11-04T01:34:11.473 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-volume noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 262 k 2023-11-04T01:34:11.473 INFO:teuthology.orchestra.run.smithi141.stdout: cephadm noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 270 k 2023-11-04T01:34:11.473 INFO:teuthology.orchestra.run.smithi141.stdout: cephfs-mirror x86_64 2:18.0.0-7035.g7532011a.el9 ceph 217 k 2023-11-04T01:34:11.473 INFO:teuthology.orchestra.run.smithi141.stdout: cephfs-top noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 18 k 2023-11-04T01:34:11.473 INFO:teuthology.orchestra.run.smithi141.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-11-04T01:34:11.473 INFO:teuthology.orchestra.run.smithi141.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-04T01:34:11.473 INFO:teuthology.orchestra.run.smithi141.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-04T01:34:11.473 INFO:teuthology.orchestra.run.smithi141.stdout: libcephfs-devel x86_64 2:18.0.0-7035.g7532011a.el9 ceph 31 k 2023-11-04T01:34:11.474 INFO:teuthology.orchestra.run.smithi141.stdout: libcephfs2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 718 k 2023-11-04T01:34:11.474 INFO:teuthology.orchestra.run.smithi141.stdout: librados-devel x86_64 2:18.0.0-7035.g7532011a.el9 ceph 126 k 2023-11-04T01:34:11.474 INFO:teuthology.orchestra.run.smithi141.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-04T01:34:11.474 INFO:teuthology.orchestra.run.smithi141.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-11-04T01:34:11.474 INFO:teuthology.orchestra.run.smithi141.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-11-04T01:34:11.474 INFO:teuthology.orchestra.run.smithi141.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-04T01:34:11.475 INFO:teuthology.orchestra.run.smithi141.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-04T01:34:11.475 INFO:teuthology.orchestra.run.smithi141.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-04T01:34:11.475 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cephfs x86_64 2:18.0.0-7035.g7532011a.el9 ceph 162 k 2023-11-04T01:34:11.475 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rados x86_64 2:18.0.0-7035.g7532011a.el9 ceph 320 k 2023-11-04T01:34:11.475 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rbd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 299 k 2023-11-04T01:34:11.475 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rgw x86_64 2:18.0.0-7035.g7532011a.el9 ceph 99 k 2023-11-04T01:34:11.475 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-fuse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 84 k 2023-11-04T01:34:11.475 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-mirror x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.0 M 2023-11-04T01:34:11.475 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-nbd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 169 k 2023-11-04T01:34:11.475 INFO:teuthology.orchestra.run.smithi141.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-11-04T01:34:11.475 INFO:teuthology.orchestra.run.smithi141.stdout:Upgrading: 2023-11-04T01:34:11.475 INFO:teuthology.orchestra.run.smithi141.stdout: NetworkManager x86_64 1:1.45.5-1.el9 CentOS-BaseOS 2.2 M 2023-11-04T01:34:11.476 INFO:teuthology.orchestra.run.smithi141.stdout: NetworkManager-libnm x86_64 1:1.45.5-1.el9 CentOS-BaseOS 1.8 M 2023-11-04T01:34:11.476 INFO:teuthology.orchestra.run.smithi141.stdout: NetworkManager-team x86_64 1:1.45.5-1.el9 CentOS-BaseOS 42 k 2023-11-04T01:34:11.476 INFO:teuthology.orchestra.run.smithi141.stdout: NetworkManager-tui x86_64 1:1.45.5-1.el9 CentOS-BaseOS 245 k 2023-11-04T01:34:11.476 INFO:teuthology.orchestra.run.smithi141.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-04T01:34:11.476 INFO:teuthology.orchestra.run.smithi141.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-04T01:34:11.476 INFO:teuthology.orchestra.run.smithi141.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-04T01:34:11.476 INFO:teuthology.orchestra.run.smithi141.stdout: librados2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.3 M 2023-11-04T01:34:11.476 INFO:teuthology.orchestra.run.smithi141.stdout: librbd1 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.0 M 2023-11-04T01:34:11.476 INFO:teuthology.orchestra.run.smithi141.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-04T01:34:11.476 INFO:teuthology.orchestra.run.smithi141.stdout:Installing dependencies: 2023-11-04T01:34:11.476 INFO:teuthology.orchestra.run.smithi141.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-11-04T01:34:11.476 INFO:teuthology.orchestra.run.smithi141.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-04T01:34:11.476 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-common x86_64 2:18.0.0-7035.g7532011a.el9 ceph 19 M 2023-11-04T01:34:11.476 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 23 k 2023-11-04T01:34:11.477 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mds x86_64 2:18.0.0-7035.g7532011a.el9 ceph 2.1 M 2023-11-04T01:34:11.477 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 243 k 2023-11-04T01:34:11.477 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mon x86_64 2:18.0.0-7035.g7532011a.el9 ceph 4.4 M 2023-11-04T01:34:11.477 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-osd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 18 M 2023-11-04T01:34:11.477 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 15 k 2023-11-04T01:34:11.477 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-selinux x86_64 2:18.0.0-7035.g7532011a.el9 ceph 24 k 2023-11-04T01:34:11.477 INFO:teuthology.orchestra.run.smithi141.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-04T01:34:11.477 INFO:teuthology.orchestra.run.smithi141.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-04T01:34:11.477 INFO:teuthology.orchestra.run.smithi141.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-04T01:34:11.477 INFO:teuthology.orchestra.run.smithi141.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-04T01:34:11.477 INFO:teuthology.orchestra.run.smithi141.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-04T01:34:11.477 INFO:teuthology.orchestra.run.smithi141.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-04T01:34:11.478 INFO:teuthology.orchestra.run.smithi141.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-04T01:34:11.478 INFO:teuthology.orchestra.run.smithi141.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-04T01:34:11.478 INFO:teuthology.orchestra.run.smithi141.stdout: libcephsqlite x86_64 2:18.0.0-7035.g7532011a.el9 ceph 163 k 2023-11-04T01:34:11.478 INFO:teuthology.orchestra.run.smithi141.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-04T01:34:11.478 INFO:teuthology.orchestra.run.smithi141.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-04T01:34:11.478 INFO:teuthology.orchestra.run.smithi141.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-04T01:34:11.478 INFO:teuthology.orchestra.run.smithi141.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-04T01:34:11.478 INFO:teuthology.orchestra.run.smithi141.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-04T01:34:11.490 INFO:teuthology.orchestra.run.smithi141.stdout: libradosstriper1 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 476 k 2023-11-04T01:34:11.490 INFO:teuthology.orchestra.run.smithi141.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-04T01:34:11.490 INFO:teuthology.orchestra.run.smithi141.stdout: librgw2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 4.8 M 2023-11-04T01:34:11.490 INFO:teuthology.orchestra.run.smithi141.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-04T01:34:11.490 INFO:teuthology.orchestra.run.smithi141.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-04T01:34:11.491 INFO:teuthology.orchestra.run.smithi141.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-04T01:34:11.491 INFO:teuthology.orchestra.run.smithi141.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-04T01:34:11.491 INFO:teuthology.orchestra.run.smithi141.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-04T01:34:11.491 INFO:teuthology.orchestra.run.smithi141.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-04T01:34:11.491 INFO:teuthology.orchestra.run.smithi141.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-04T01:34:11.491 INFO:teuthology.orchestra.run.smithi141.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-04T01:34:11.491 INFO:teuthology.orchestra.run.smithi141.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-04T01:34:11.491 INFO:teuthology.orchestra.run.smithi141.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-04T01:34:11.491 INFO:teuthology.orchestra.run.smithi141.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-04T01:34:11.491 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-04T01:34:11.491 INFO:teuthology.orchestra.run.smithi141.stdout: python3-ceph-argparse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 45 k 2023-11-04T01:34:11.491 INFO:teuthology.orchestra.run.smithi141.stdout: python3-ceph-common x86_64 2:18.0.0-7035.g7532011a.el9 ceph 127 k 2023-11-04T01:34:11.492 INFO:teuthology.orchestra.run.smithi141.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-04T01:34:11.492 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-04T01:34:11.492 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-04T01:34:11.492 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-04T01:34:11.492 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-04T01:34:11.492 INFO:teuthology.orchestra.run.smithi141.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-04T01:34:11.492 INFO:teuthology.orchestra.run.smithi141.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-04T01:34:11.492 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-04T01:34:11.492 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-04T01:34:11.492 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-04T01:34:11.492 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-04T01:34:11.492 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-04T01:34:11.492 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-04T01:34:11.493 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-04T01:34:11.493 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-04T01:34:11.493 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-04T01:34:11.493 INFO:teuthology.orchestra.run.smithi141.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-04T01:34:11.493 INFO:teuthology.orchestra.run.smithi141.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-04T01:34:11.493 INFO:teuthology.orchestra.run.smithi141.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-04T01:34:11.493 INFO:teuthology.orchestra.run.smithi141.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-04T01:34:11.493 INFO:teuthology.orchestra.run.smithi141.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-04T01:34:11.493 INFO:teuthology.orchestra.run.smithi141.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-04T01:34:11.493 INFO:teuthology.orchestra.run.smithi141.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-04T01:34:11.493 INFO:teuthology.orchestra.run.smithi141.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-04T01:34:11.493 INFO:teuthology.orchestra.run.smithi141.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-04T01:34:11.493 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-04T01:34:11.494 INFO:teuthology.orchestra.run.smithi141.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-04T01:34:11.495 INFO:teuthology.orchestra.run.smithi141.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-04T01:34:11.495 INFO:teuthology.orchestra.run.smithi141.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-04T01:34:11.495 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-04T01:34:11.496 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-04T01:34:11.496 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-04T01:34:11.496 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-04T01:34:11.496 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-04T01:34:11.496 INFO:teuthology.orchestra.run.smithi141.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-04T01:34:11.496 INFO:teuthology.orchestra.run.smithi141.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-04T01:34:11.496 INFO:teuthology.orchestra.run.smithi141.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-04T01:34:11.496 INFO:teuthology.orchestra.run.smithi141.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-04T01:34:11.496 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-04T01:34:11.496 INFO:teuthology.orchestra.run.smithi141.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-04T01:34:11.497 INFO:teuthology.orchestra.run.smithi141.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-04T01:34:11.497 INFO:teuthology.orchestra.run.smithi141.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-04T01:34:11.497 INFO:teuthology.orchestra.run.smithi141.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-04T01:34:11.497 INFO:teuthology.orchestra.run.smithi141.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-04T01:34:11.497 INFO:teuthology.orchestra.run.smithi141.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-04T01:34:11.497 INFO:teuthology.orchestra.run.smithi141.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-04T01:34:11.497 INFO:teuthology.orchestra.run.smithi141.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-04T01:34:11.497 INFO:teuthology.orchestra.run.smithi141.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-04T01:34:11.497 INFO:teuthology.orchestra.run.smithi141.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-04T01:34:11.498 INFO:teuthology.orchestra.run.smithi141.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-04T01:34:11.498 INFO:teuthology.orchestra.run.smithi141.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-04T01:34:11.498 INFO:teuthology.orchestra.run.smithi141.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-04T01:34:11.498 INFO:teuthology.orchestra.run.smithi141.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-04T01:34:11.498 INFO:teuthology.orchestra.run.smithi141.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-11-04T01:34:11.498 INFO:teuthology.orchestra.run.smithi141.stdout:Installing weak dependencies: 2023-11-04T01:34:11.498 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-04T01:34:11.498 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:34:11.506 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2023-11-04T01:34:11.506 INFO:teuthology.orchestra.run.smithi141.stdout:============================================================================================ 2023-11-04T01:34:11.507 INFO:teuthology.orchestra.run.smithi141.stdout:Install 132 Packages 2023-11-04T01:34:11.507 INFO:teuthology.orchestra.run.smithi141.stdout:Upgrade 10 Packages 2023-11-04T01:34:11.507 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:34:11.507 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-common-2:18.0.0-7035.g7532011a.el9. 27/152 2023-11-04T01:34:11.510 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 200 M 2023-11-04T01:34:11.511 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading Packages: 2023-11-04T01:34:11.545 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 28/152 2023-11-04T01:34:11.618 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_6 29/152 2023-11-04T01:34:11.752 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/152 2023-11-04T01:34:11.805 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/152 2023-11-04T01:34:12.246 INFO:teuthology.orchestra.run.smithi141.stdout:(1/142): ceph-18.0.0-7035.g7532011a.el9.x86_64. 19 kB/s | 6.5 kB 00:00 2023-11-04T01:34:12.330 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/152 2023-11-04T01:34:12.409 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/152 2023-11-04T01:34:12.448 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/152 2023-11-04T01:34:12.485 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librados-devel-2:18.0.0-7035.g7532011a.el9.x86_6 35/152 2023-11-04T01:34:12.515 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/152 2023-11-04T01:34:12.621 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/152 2023-11-04T01:34:12.638 INFO:teuthology.orchestra.run.smithi141.stdout:(2/142): ceph-base-18.0.0-7035.g7532011a.el9.x8 7.1 MB/s | 5.2 MB 00:00 2023-11-04T01:34:12.661 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/152 2023-11-04T01:34:12.688 INFO:teuthology.orchestra.run.smithi141.stdout:(3/142): ceph-immutable-object-cache-18.0.0-703 2.8 MB/s | 140 kB 00:00 2023-11-04T01:34:12.715 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/152 2023-11-04T01:34:12.782 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/152 2023-11-04T01:34:12.811 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/152 2023-11-04T01:34:12.848 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/152 2023-11-04T01:34:12.895 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/152 2023-11-04T01:34:12.940 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/152 2023-11-04T01:34:12.950 INFO:teuthology.orchestra.run.smithi141.stdout:(4/142): ceph-mds-18.0.0-7035.g7532011a.el9.x86 8.0 MB/s | 2.1 MB 00:00 2023-11-04T01:34:12.982 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/152 2023-11-04T01:34:13.079 INFO:teuthology.orchestra.run.smithi141.stdout:(5/142): ceph-fuse-18.0.0-7035.g7532011a.el9.x8 1.0 MB/s | 859 kB 00:00 2023-11-04T01:34:13.118 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/152 2023-11-04T01:34:13.159 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/152 2023-11-04T01:34:13.204 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/152 2023-11-04T01:34:13.294 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/152 2023-11-04T01:34:13.317 INFO:teuthology.orchestra.run.smithi141.stdout:(6/142): ceph-common-18.0.0-7035.g7532011a.el9. 13 MB/s | 19 MB 00:01 2023-11-04T01:34:13.326 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 50/152 2023-11-04T01:34:13.361 INFO:teuthology.orchestra.run.smithi141.stdout:(7/142): ceph-mgr-18.0.0-7035.g7532011a.el9.x86 3.6 MB/s | 1.5 MB 00:00 2023-11-04T01:34:13.367 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/152 2023-11-04T01:34:13.403 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/152 2023-11-04T01:34:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/152 2023-11-04T01:34:13.454 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 54/152 2023-11-04T01:34:13.542 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 55/152 2023-11-04T01:34:13.587 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : automake-1.16.2-8.el9.noarch 56/152 2023-11-04T01:34:13.635 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ply-3.11-14.el9.noarch 57/152 2023-11-04T01:34:13.704 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 58/152 2023-11-04T01:34:13.901 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 59/152 2023-11-04T01:34:13.949 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 60/152 2023-11-04T01:34:14.078 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 61/152 2023-11-04T01:34:14.119 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 62/152 2023-11-04T01:34:14.148 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 63/152 2023-11-04T01:34:14.183 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 64/152 2023-11-04T01:34:14.215 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 65/152 2023-11-04T01:34:14.247 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : fuse-2.9.9-15.el9.x86_64 66/152 2023-11-04T01:34:14.302 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/152 2023-11-04T01:34:14.401 INFO:teuthology.orchestra.run.smithi141.stdout:(8/142): ceph-osd-18.0.0-7035.g7532011a.el9.x86 16 MB/s | 18 MB 00:01 2023-11-04T01:34:14.447 INFO:teuthology.orchestra.run.smithi141.stdout:(9/142): ceph-selinux-18.0.0-7035.g7532011a.el9 582 kB/s | 24 kB 00:00 2023-11-04T01:34:14.497 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/152 2023-11-04T01:34:14.530 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 69/152 2023-11-04T01:34:14.570 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 70/152 2023-11-04T01:34:14.643 INFO:teuthology.orchestra.run.smithi141.stdout:(10/142): ceph-radosgw-18.0.0-7035.g7532011a.el 6.8 MB/s | 8.7 MB 00:01 2023-11-04T01:34:14.646 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 71/152 2023-11-04T01:34:14.678 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 72/152 2023-11-04T01:34:14.710 INFO:teuthology.orchestra.run.smithi141.stdout:(11/142): ceph-mon-18.0.0-7035.g7532011a.el9.x8 2.7 MB/s | 4.4 MB 00:01 2023-11-04T01:34:14.712 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/152 2023-11-04T01:34:14.735 INFO:teuthology.orchestra.run.smithi141.stdout:(12/142): cephfs-mirror-18.0.0-7035.g7532011a.e 2.3 MB/s | 217 kB 00:00 2023-11-04T01:34:14.753 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/152 2023-11-04T01:34:14.761 INFO:teuthology.orchestra.run.smithi141.stdout:(13/142): libcephfs-devel-18.0.0-7035.g7532011a 622 kB/s | 31 kB 00:00 2023-11-04T01:34:14.787 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/152 2023-11-04T01:34:14.836 INFO:teuthology.orchestra.run.smithi141.stdout:(14/142): libcephfs2-18.0.0-7035.g7532011a.el9. 7.0 MB/s | 718 kB 00:00 2023-11-04T01:34:14.861 INFO:teuthology.orchestra.run.smithi141.stdout:(15/142): libcephsqlite-18.0.0-7035.g7532011a.e 1.6 MB/s | 163 kB 00:00 2023-11-04T01:34:14.877 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/152 2023-11-04T01:34:14.903 INFO:teuthology.orchestra.run.smithi141.stdout:(16/142): librados-devel-18.0.0-7035.g7532011a. 1.8 MB/s | 126 kB 00:00 2023-11-04T01:34:14.915 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/152 2023-11-04T01:34:15.017 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 78/152 2023-11-04T01:34:15.020 INFO:teuthology.orchestra.run.smithi141.stdout:(17/142): libradosstriper1-18.0.0-7035.g7532011 2.9 MB/s | 476 kB 00:00 2023-11-04T01:34:15.065 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2023-11-04T01:34:15.115 INFO:teuthology.orchestra.run.smithi141.stdout:(18/142): python3-ceph-argparse-18.0.0-7035.g75 493 kB/s | 45 kB 00:00 2023-11-04T01:34:15.212 INFO:teuthology.orchestra.run.smithi141.stdout:(19/142): python3-ceph-common-18.0.0-7035.g7532 1.2 MB/s | 127 kB 00:00 2023-11-04T01:34:15.313 INFO:teuthology.orchestra.run.smithi141.stdout:(20/142): python3-cephfs-18.0.0-7035.g7532011a. 1.6 MB/s | 162 kB 00:00 2023-11-04T01:34:15.438 INFO:teuthology.orchestra.run.smithi141.stdout:(21/142): python3-rados-18.0.0-7035.g7532011a.e 2.5 MB/s | 320 kB 00:00 2023-11-04T01:34:15.589 INFO:teuthology.orchestra.run.smithi141.stdout:(22/142): librgw2-18.0.0-7035.g7532011a.el9.x86 7.0 MB/s | 4.8 MB 00:00 2023-11-04T01:34:15.614 INFO:teuthology.orchestra.run.smithi141.stdout:(23/142): python3-rbd-18.0.0-7035.g7532011a.el9 1.7 MB/s | 299 kB 00:00 2023-11-04T01:34:15.649 INFO:teuthology.orchestra.run.smithi141.stdout:(24/142): python3-rgw-18.0.0-7035.g7532011a.el9 1.7 MB/s | 99 kB 00:00 2023-11-04T01:34:15.706 INFO:teuthology.orchestra.run.smithi141.stdout:(25/142): rbd-fuse-18.0.0-7035.g7532011a.el9.x8 917 kB/s | 84 kB 00:00 2023-11-04T01:34:15.798 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2023-11-04T01:34:15.806 INFO:teuthology.orchestra.run.smithi141.stdout:(26/142): rbd-nbd-18.0.0-7035.g7532011a.el9.x86 1.7 MB/s | 169 kB 00:00 2023-11-04T01:34:15.846 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2023-11-04T01:34:15.880 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2023-11-04T01:34:15.907 INFO:teuthology.orchestra.run.smithi141.stdout:(27/142): ceph-grafana-dashboards-18.0.0-7035.g 232 kB/s | 23 kB 00:00 2023-11-04T01:34:15.978 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2023-11-04T01:34:16.016 INFO:teuthology.orchestra.run.smithi141.stdout:(28/142): ceph-mgr-cephadm-18.0.0-7035.g7532011 1.2 MB/s | 132 kB 00:00 2023-11-04T01:34:16.022 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 84/152 2023-11-04T01:34:16.067 INFO:teuthology.orchestra.run.smithi141.stdout:(29/142): rbd-mirror-18.0.0-7035.g7532011a.el9. 7.2 MB/s | 3.0 MB 00:00 2023-11-04T01:34:16.199 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-0.3.21-2.el9.x86_64 85/152 2023-11-04T01:34:16.228 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 86/152 2023-11-04T01:34:16.305 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/152 2023-11-04T01:34:16.466 INFO:teuthology.orchestra.run.smithi141.stdout:(30/142): ceph-mgr-dashboard-18.0.0-7035.g75320 3.9 MB/s | 1.8 MB 00:00 2023-11-04T01:34:16.583 INFO:teuthology.orchestra.run.smithi141.stdout:(31/142): ceph-mgr-modules-core-18.0.0-7035.g75 2.0 MB/s | 243 kB 00:00 2023-11-04T01:34:16.958 INFO:teuthology.orchestra.run.smithi141.stdout:(32/142): ceph-test-18.0.0-7035.g7532011a.el9.x 16 MB/s | 41 MB 00:02 2023-11-04T01:34:16.975 INFO:teuthology.orchestra.run.smithi141.stdout:(33/142): ceph-mgr-rook-18.0.0-7035.g7532011a.e 122 kB/s | 48 kB 00:00 2023-11-04T01:34:16.977 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 88/152 2023-11-04T01:34:16.992 INFO:teuthology.orchestra.run.smithi141.stdout:(34/142): ceph-prometheus-alerts-18.0.0-7035.g7 456 kB/s | 15 kB 00:00 2023-11-04T01:34:17.083 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 89/152 2023-11-04T01:34:17.084 INFO:teuthology.orchestra.run.smithi141.stdout:(35/142): ceph-mgr-diskprediction-local-18.0.0- 7.3 MB/s | 7.4 MB 00:01 2023-11-04T01:34:17.121 INFO:teuthology.orchestra.run.smithi141.stdout:(36/142): ceph-volume-18.0.0-7035.g7532011a.el9 1.8 MB/s | 262 kB 00:00 2023-11-04T01:34:17.143 INFO:teuthology.orchestra.run.smithi141.stdout:(37/142): cephadm-18.0.0-7035.g7532011a.el9.noa 1.8 MB/s | 270 kB 00:00 2023-11-04T01:34:17.160 INFO:teuthology.orchestra.run.smithi141.stdout:(38/142): cephfs-top-18.0.0-7035.g7532011a.el9. 243 kB/s | 18 kB 00:00 2023-11-04T01:34:17.302 INFO:teuthology.orchestra.run.smithi141.stdout:(39/142): boost-program-options-1.75.0-8.el9.x8 669 kB/s | 106 kB 00:00 2023-11-04T01:34:17.327 INFO:teuthology.orchestra.run.smithi141.stdout:(40/142): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 307 kB 00:00 2023-11-04T01:34:17.369 INFO:teuthology.orchestra.run.smithi141.stdout:(41/142): bison-3.7.4-5.el9.x86_64.rpm 4.0 MB/s | 920 kB 00:00 2023-11-04T01:34:17.386 INFO:teuthology.orchestra.run.smithi141.stdout:(42/142): flexiblas-3.0.4-8.el9.x86_64.rpm 378 kB/s | 32 kB 00:00 2023-11-04T01:34:17.446 INFO:teuthology.orchestra.run.smithi141.stdout:(43/142): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2023-11-04T01:34:17.461 INFO:teuthology.orchestra.run.smithi141.stdout:(44/142): flexiblas-openblas-openmp-3.0.4-8.el9 191 kB/s | 17 kB 00:00 2023-11-04T01:34:17.478 INFO:teuthology.orchestra.run.smithi141.stdout:(45/142): libaio-devel-0.3.111-13.el9.x86_64.rp 112 kB/s | 10 kB 00:00 2023-11-04T01:34:17.503 INFO:teuthology.orchestra.run.smithi141.stdout:(46/142): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2023-11-04T01:34:17.538 INFO:teuthology.orchestra.run.smithi141.stdout:(47/142): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2023-11-04T01:34:17.571 INFO:teuthology.orchestra.run.smithi141.stdout:(48/142): libtool-2.4.6-45.el9.x86_64.rpm 6.2 MB/s | 578 kB 00:00 2023-11-04T01:34:17.596 INFO:teuthology.orchestra.run.smithi141.stdout:(49/142): libzstd-devel-1.5.1-2.el9.x86_64.rpm 804 kB/s | 46 kB 00:00 2023-11-04T01:34:17.630 INFO:teuthology.orchestra.run.smithi141.stdout:(50/142): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.0 MB/s | 282 kB 00:00 2023-11-04T01:34:17.655 INFO:teuthology.orchestra.run.smithi141.stdout:(51/142): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.5 MB/s | 217 kB 00:00 2023-11-04T01:34:17.680 INFO:teuthology.orchestra.run.smithi141.stdout:(52/142): openblas-0.3.21-2.el9.x86_64.rpm 685 kB/s | 34 kB 00:00 2023-11-04T01:34:17.747 INFO:teuthology.orchestra.run.smithi141.stdout:(53/142): openblas-openmp-0.3.21-2.el9.x86_64.r 41 MB/s | 4.7 MB 00:00 2023-11-04T01:34:17.789 INFO:teuthology.orchestra.run.smithi141.stdout:(54/142): postgresql-13.11-1.el9.x86_64.rpm 12 MB/s | 1.5 MB 00:00 2023-11-04T01:34:17.815 INFO:teuthology.orchestra.run.smithi141.stdout:(55/142): postgresql-contrib-13.11-1.el9.x86_64 6.0 MB/s | 811 kB 00:00 2023-11-04T01:34:17.840 INFO:teuthology.orchestra.run.smithi141.stdout:(56/142): postgresql-private-libs-13.11-1.el9.x 1.5 MB/s | 134 kB 00:00 2023-11-04T01:34:17.949 INFO:teuthology.orchestra.run.smithi141.stdout:(57/142): postgresql-server-13.11-1.el9.x86_64. 43 MB/s | 5.7 MB 00:00 2023-11-04T01:34:18.020 INFO:teuthology.orchestra.run.smithi141.stdout:(58/142): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 5.8 MB 00:00 2023-11-04T01:34:18.049 INFO:teuthology.orchestra.run.smithi141.stdout:(59/142): python3-devel-3.9.17-2.el9.x86_64.rpm 985 kB/s | 205 kB 00:00 2023-11-04T01:34:18.091 INFO:teuthology.orchestra.run.smithi141.stdout:(60/142): python3-jinja2-2.11.3-4.el9.noarch.rp 1.6 MB/s | 228 kB 00:00 2023-11-04T01:34:18.116 INFO:teuthology.orchestra.run.smithi141.stdout:(61/142): python3-jsonpatch-1.21-16.el9.noarch. 367 kB/s | 24 kB 00:00 2023-11-04T01:34:18.133 INFO:teuthology.orchestra.run.smithi141.stdout:(62/142): python3-jsonpointer-2.0-4.el9.noarch. 217 kB/s | 18 kB 00:00 2023-11-04T01:34:18.160 INFO:teuthology.orchestra.run.smithi141.stdout:(63/142): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2023-11-04T01:34:18.184 INFO:teuthology.orchestra.run.smithi141.stdout:(64/142): python3-markupsafe-1.1.1-12.el9.x86_6 631 kB/s | 32 kB 00:00 2023-11-04T01:34:18.259 INFO:teuthology.orchestra.run.smithi141.stdout:(65/142): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 4.8 MB 00:00 2023-11-04T01:34:18.286 INFO:teuthology.orchestra.run.smithi141.stdout:(66/142): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 217 kB 00:00 2023-11-04T01:34:18.309 INFO:teuthology.orchestra.run.smithi141.stdout:(67/142): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 174 kB 00:00 2023-11-04T01:34:18.330 INFO:teuthology.orchestra.run.smithi141.stdout:(68/142): python3-prettytable-0.7.2-27.el9.noar 622 kB/s | 41 kB 00:00 2023-11-04T01:34:18.336 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 90/152 2023-11-04T01:34:18.351 INFO:teuthology.orchestra.run.smithi141.stdout:(69/142): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2023-11-04T01:34:18.377 INFO:teuthology.orchestra.run.smithi141.stdout:(70/142): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2023-11-04T01:34:18.395 INFO:teuthology.orchestra.run.smithi141.stdout:(71/142): python3-requests-oauthlib-1.3.0-12.el 645 kB/s | 43 kB 00:00 2023-11-04T01:34:18.412 INFO:teuthology.orchestra.run.smithi141.stdout:(72/142): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-11-04T01:34:18.428 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 91/152 2023-11-04T01:34:18.468 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 92/152 2023-11-04T01:34:18.486 INFO:teuthology.orchestra.run.smithi141.stdout:(73/142): socat-1.7.4.1-5.el9.x86_64.rpm 3.2 MB/s | 300 kB 00:00 2023-11-04T01:34:18.499 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : jq-1.6-15.el9.x86_64 93/152 2023-11-04T01:34:18.526 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2023-11-04T01:34:18.678 INFO:teuthology.orchestra.run.smithi141.stdout:(74/142): python3-scipy-1.6.2-8.el9.x86_64.rpm 52 MB/s | 16 MB 00:00 2023-11-04T01:34:18.695 INFO:teuthology.orchestra.run.smithi141.stdout:(75/142): uuid-1.6.2-55.el9.x86_64.rpm 200 kB/s | 56 kB 00:00 2023-11-04T01:34:18.712 INFO:teuthology.orchestra.run.smithi141.stdout:(76/142): xmlstarlet-1.6.1-20.el9.x86_64.rpm 281 kB/s | 63 kB 00:00 2023-11-04T01:34:18.737 INFO:teuthology.orchestra.run.smithi141.stdout:(77/142): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-11-04T01:34:18.765 INFO:teuthology.orchestra.run.smithi141.stdout:(78/142): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2023-11-04T01:34:18.796 INFO:teuthology.orchestra.run.smithi141.stdout:(79/142): libgfortran-11.4.1-2.3.el9.x86_64.rpm 9.4 MB/s | 803 kB 00:00 2023-11-04T01:34:18.821 INFO:teuthology.orchestra.run.smithi141.stdout:(80/142): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.8 MB/s | 241 kB 00:00 2023-11-04T01:34:18.825 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 95/152 2023-11-04T01:34:18.846 INFO:teuthology.orchestra.run.smithi141.stdout:(81/142): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2023-11-04T01:34:18.865 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 96/152 2023-11-04T01:34:18.874 INFO:teuthology.orchestra.run.smithi141.stdout:(82/142): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-11-04T01:34:18.897 INFO:teuthology.orchestra.run.smithi141.stdout:(83/142): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 124 kB 00:00 2023-11-04T01:34:18.922 INFO:teuthology.orchestra.run.smithi141.stdout:(84/142): python3-urllib3-1.26.5-4.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2023-11-04T01:34:18.955 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 96/152 2023-11-04T01:34:18.985 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 97/152 2023-11-04T01:34:19.047 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 98/152 2023-11-04T01:34:19.181 INFO:teuthology.orchestra.run.smithi141.stdout:(85/142): elfutils-libelf-devel-0.189-3.el9.x86 86 kB/s | 22 kB 00:00 2023-11-04T01:34:19.290 INFO:teuthology.orchestra.run.smithi141.stdout:(86/142): python3-cryptography-36.0.1-4.el9.x86 2.9 MB/s | 1.2 MB 00:00 2023-11-04T01:34:19.475 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 99/152 2023-11-04T01:34:19.505 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 100/152 2023-11-04T01:34:19.523 INFO:teuthology.orchestra.run.smithi141.stdout:(87/142): jq-1.6-15.el9.x86_64.rpm 547 kB/s | 187 kB 00:00 2023-11-04T01:34:19.548 INFO:teuthology.orchestra.run.smithi141.stdout:(88/142): librabbitmq-0.11.0-7.el9.x86_64.rpm 176 kB/s | 45 kB 00:00 2023-11-04T01:34:19.562 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 100/152 2023-11-04T01:34:19.574 INFO:teuthology.orchestra.run.smithi141.stdout:(89/142): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 689 kB 00:00 2023-11-04T01:34:19.585 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 101/152 2023-11-04T01:34:19.782 INFO:teuthology.orchestra.run.smithi141.stdout:(90/142): libuuid-devel-2.37.4-15.el9.x86_64.rp 99 kB/s | 26 kB 00:00 2023-11-04T01:34:19.916 INFO:teuthology.orchestra.run.smithi141.stdout:(91/142): python3-pytz-2021.1-5.el9.noarch.rpm 174 kB/s | 51 kB 00:00 2023-11-04T01:34:20.158 INFO:teuthology.orchestra.run.smithi141.stdout:(92/142): zlib-devel-1.2.11-40.el9.x86_64.rpm 187 kB/s | 45 kB 00:00 2023-11-04T01:34:20.208 INFO:teuthology.orchestra.run.smithi141.stdout:(93/142): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 203 kB/s | 86 kB 00:00 2023-11-04T01:34:20.558 INFO:teuthology.orchestra.run.smithi141.stdout:(94/142): gperftools-libs-2.9.1-2.el9.x86_64.rp 772 kB/s | 309 kB 00:00 2023-11-04T01:34:20.642 INFO:teuthology.orchestra.run.smithi141.stdout:(95/142): libarrow-doc-9.0.0-9.el9.noarch.rpm 293 kB/s | 24 kB 00:00 2023-11-04T01:34:20.725 INFO:teuthology.orchestra.run.smithi141.stdout:(96/142): liboath-2.6.7-2.el9.x86_64.rpm 587 kB/s | 49 kB 00:00 2023-11-04T01:34:20.792 INFO:teuthology.orchestra.run.smithi141.stdout:(97/142): libarrow-9.0.0-9.el9.x86_64.rpm 7.9 MB/s | 4.4 MB 00:00 2023-11-04T01:34:20.818 INFO:teuthology.orchestra.run.smithi141.stdout:(98/142): libunwind-1.6.2-1.el9.x86_64.rpm 743 kB/s | 67 kB 00:00 2023-11-04T01:34:21.001 INFO:teuthology.orchestra.run.smithi141.stdout:(99/142): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.9 MB/s | 837 kB 00:00 2023-11-04T01:34:21.068 INFO:teuthology.orchestra.run.smithi141.stdout:(100/142): python3-asyncssh-2.13.2-3.el9.noarch 2.1 MB/s | 548 kB 00:00 2023-11-04T01:34:21.093 INFO:teuthology.orchestra.run.smithi141.stdout:(101/142): python3-bcrypt-3.2.2-1.el9.x86_64.rp 476 kB/s | 43 kB 00:00 2023-11-04T01:34:21.152 INFO:teuthology.orchestra.run.smithi141.stdout:(102/142): python3-cachetools-4.2.4-1.el9.noarc 385 kB/s | 32 kB 00:00 2023-11-04T01:34:21.177 INFO:teuthology.orchestra.run.smithi141.stdout:(103/142): python3-certifi-2021.10.8-2.el9.noar 179 kB/s | 15 kB 00:00 2023-11-04T01:34:21.236 INFO:teuthology.orchestra.run.smithi141.stdout:(104/142): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2023-11-04T01:34:21.286 INFO:teuthology.orchestra.run.smithi141.stdout:(105/142): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2023-11-04T01:34:21.313 INFO:teuthology.orchestra.run.smithi141.stdout:(106/142): python3-google-auth-2.23.3-1.el9.noa 2.6 MB/s | 197 kB 00:00 2023-11-04T01:34:21.362 INFO:teuthology.orchestra.run.smithi141.stdout:(107/142): python3-jaraco-8.2.1-3.el9.noarch.rp 141 kB/s | 11 kB 00:00 2023-11-04T01:34:21.382 INFO:teuthology.orchestra.run.smithi141.stdout:(108/142): python3-jaraco-classes-3.2.1-5.el9.n 264 kB/s | 18 kB 00:00 2023-11-04T01:34:21.421 INFO:teuthology.orchestra.run.smithi141.stdout:(109/142): python3-jaraco-collections-3.0.0-8.e 393 kB/s | 23 kB 00:00 2023-11-04T01:34:21.438 INFO:teuthology.orchestra.run.smithi141.stdout:(110/142): python3-jaraco-functools-3.5.0-2.el9 330 kB/s | 19 kB 00:00 2023-11-04T01:34:21.480 INFO:teuthology.orchestra.run.smithi141.stdout:(111/142): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2023-11-04T01:34:21.514 INFO:teuthology.orchestra.run.smithi141.stdout:(112/142): python3-jwt+crypto-2.4.0-1.el9.noarc 120 kB/s | 9.0 kB 00:00 2023-11-04T01:34:21.543 INFO:teuthology.orchestra.run.smithi141.stdout:(113/142): python3-jwt-2.4.0-1.el9.noarch.rpm 698 kB/s | 41 kB 00:00 2023-11-04T01:34:21.689 INFO:teuthology.orchestra.run.smithi141.stdout:(114/142): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2023-11-04T01:34:21.706 INFO:teuthology.orchestra.run.smithi141.stdout:(115/142): python3-logutils-0.3.5-21.el9.noarch 277 kB/s | 46 kB 00:00 2023-11-04T01:34:21.774 INFO:teuthology.orchestra.run.smithi141.stdout:(116/142): python3-more-itertools-8.12.0-2.el9. 942 kB/s | 79 kB 00:00 2023-11-04T01:34:21.790 INFO:teuthology.orchestra.run.smithi141.stdout:(117/142): python3-natsort-7.1.1-5.el9.noarch.r 689 kB/s | 58 kB 00:00 2023-11-04T01:34:21.875 INFO:teuthology.orchestra.run.smithi141.stdout:(118/142): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2023-11-04T01:34:21.891 INFO:teuthology.orchestra.run.smithi141.stdout:(119/142): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2023-11-04T01:34:21.896 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:21.924 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:21.966 INFO:teuthology.orchestra.run.smithi141.stdout:(120/142): python3-pyOpenSSL-21.0.0-1.el9.noarc 979 kB/s | 90 kB 00:00 2023-11-04T01:34:21.983 INFO:teuthology.orchestra.run.smithi141.stdout:(121/142): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2023-11-04T01:34:22.058 INFO:teuthology.orchestra.run.smithi141.stdout:(122/142): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2023-11-04T01:34:22.076 INFO:teuthology.orchestra.run.smithi141.stdout:(123/142): python3-rsa-4.9-2.el9.noarch.rpm 642 kB/s | 59 kB 00:00 2023-11-04T01:34:22.159 INFO:teuthology.orchestra.run.smithi141.stdout:(124/142): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2023-11-04T01:34:22.176 INFO:teuthology.orchestra.run.smithi141.stdout:(125/142): python3-typing-extensions-4.4.0-2.el 508 kB/s | 51 kB 00:00 2023-11-04T01:34:22.246 INFO:teuthology.orchestra.run.smithi141.stdout:(126/142): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2023-11-04T01:34:22.268 INFO:teuthology.orchestra.run.smithi141.stdout:(127/142): python3-websocket-client-1.2.3-2.el9 974 kB/s | 90 kB 00:00 2023-11-04T01:34:22.336 INFO:teuthology.orchestra.run.smithi141.stdout:(128/142): python3-werkzeug-2.0.3-3.el9.1.noarc 4.6 MB/s | 427 kB 00:00 2023-11-04T01:34:22.361 INFO:teuthology.orchestra.run.smithi141.stdout:(129/142): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2023-11-04T01:34:22.419 INFO:teuthology.orchestra.run.smithi141.stdout:(130/142): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2023-11-04T01:34:22.511 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:22.544 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 103/152 2023-11-04T01:34:22.595 INFO:teuthology.orchestra.run.smithi141.stdout:(131/142): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2023-11-04T01:34:22.665 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 103/152 2023-11-04T01:34:22.666 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-04T01:34:22.666 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-04T01:34:22.666 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:34:22.707 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 104/152 2023-11-04T01:34:22.887 INFO:teuthology.orchestra.run.smithi141.stdout:(132/142): librbd1-18.0.0-7035.g7532011a.el9.x8 10 MB/s | 3.0 MB 00:00 2023-11-04T01:34:22.920 INFO:teuthology.orchestra.run.smithi141.stdout:(133/142): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-11-04T01:34:22.979 INFO:teuthology.orchestra.run.smithi141.stdout:(134/142): NetworkManager-1.45.5-1.el9.x86_64.r 38 MB/s | 2.2 MB 00:00 2023-11-04T01:34:23.046 INFO:teuthology.orchestra.run.smithi141.stdout:(135/142): NetworkManager-libnm-1.45.5-1.el9.x8 26 MB/s | 1.8 MB 00:00 2023-11-04T01:34:23.098 INFO:teuthology.orchestra.run.smithi141.stdout:(136/142): librados2-18.0.0-7035.g7532011a.el9. 4.9 MB/s | 3.3 MB 00:00 2023-11-04T01:34:23.122 INFO:teuthology.orchestra.run.smithi141.stdout:(137/142): NetworkManager-team-1.45.5-1.el9.x86 556 kB/s | 42 kB 00:00 2023-11-04T01:34:23.155 INFO:teuthology.orchestra.run.smithi141.stdout:(138/142): NetworkManager-tui-1.45.5-1.el9.x86_ 4.1 MB/s | 245 kB 00:00 2023-11-04T01:34:23.181 INFO:teuthology.orchestra.run.smithi141.stdout:(139/142): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2023-11-04T01:34:23.206 INFO:teuthology.orchestra.run.smithi141.stdout:(140/142): libacl-2.3.1-4.el9.x86_64.rpm 436 kB/s | 22 kB 00:00 2023-11-04T01:34:23.239 INFO:teuthology.orchestra.run.smithi141.stdout:(141/142): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2023-11-04T01:34:23.299 INFO:teuthology.orchestra.run.smithi141.stdout:(142/142): openssl-devel-3.0.7-24.el9.x86_64.rp 1.1 MB/s | 4.1 MB 00:03 2023-11-04T01:34:23.306 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2023-11-04T01:34:23.306 INFO:teuthology.orchestra.run.smithi141.stdout:Total 17 MB/s | 200 MB 00:11 2023-11-04T01:34:23.441 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2023-11-04T01:34:23.567 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction check succeeded. 2023-11-04T01:34:23.567 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2023-11-04T01:34:25.329 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded. 2023-11-04T01:34:25.330 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2023-11-04T01:34:30.848 INFO:teuthology.orchestra.run.smithi141.stdout: Preparing : 1/1 2023-11-04T01:34:30.933 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2023-11-04T01:34:30.959 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2023-11-04T01:34:30.986 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2023-11-04T01:34:31.035 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/152 2023-11-04T01:34:31.364 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/152 2023-11-04T01:34:31.420 INFO:teuthology.orchestra.run.smithi141.stdout: Upgrading : librados2-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:34:31.522 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librados2-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:34:31.545 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:34:31.637 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:34:31.695 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 8/152 2023-11-04T01:34:31.743 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/152 2023-11-04T01:34:31.906 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/152 2023-11-04T01:34:31.958 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/152 2023-11-04T01:34:31.987 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:34:32.069 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:34:32.092 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 13/152 2023-11-04T01:34:32.137 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 13/152 2023-11-04T01:34:32.328 INFO:teuthology.orchestra.run.smithi141.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/152 2023-11-04T01:34:32.447 INFO:teuthology.orchestra.run.smithi141.stdout: Upgrading : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 15/152 2023-11-04T01:34:32.507 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 15/152 2023-11-04T01:34:32.609 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:34:32.667 INFO:teuthology.orchestra.run.smithi141.stdout: Upgrading : NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:34:32.956 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:34:32.990 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/152 2023-11-04T01:34:33.026 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2023-11-04T01:34:33.090 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2023-11-04T01:34:33.163 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 20/152 2023-11-04T01:34:33.200 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/152 2023-11-04T01:34:33.243 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/152 2023-11-04T01:34:33.314 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/152 2023-11-04T01:34:33.354 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/152 2023-11-04T01:34:33.385 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/152 2023-11-04T01:34:33.455 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2023-11-04T01:34:33.490 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-ceph-common-2:18.0.0-7035.g7532011a.el9. 27/152 2023-11-04T01:34:33.533 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 28/152 2023-11-04T01:34:33.605 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_6 29/152 2023-11-04T01:34:33.719 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 104/152 2023-11-04T01:34:33.720 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /sys 2023-11-04T01:34:33.720 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /proc 2023-11-04T01:34:33.720 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /mnt 2023-11-04T01:34:33.720 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /var/tmp 2023-11-04T01:34:33.720 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /home 2023-11-04T01:34:33.720 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /root 2023-11-04T01:34:33.720 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /tmp 2023-11-04T01:34:33.720 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:34:33.750 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/152 2023-11-04T01:34:33.802 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/152 2023-11-04T01:34:33.898 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 105/152 2023-11-04T01:34:33.917 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 105/152 2023-11-04T01:34:33.917 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:33.918 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-04T01:34:33.918 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:34:34.328 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/152 2023-11-04T01:34:34.405 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/152 2023-11-04T01:34:34.453 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/152 2023-11-04T01:34:34.500 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : librados-devel-2:18.0.0-7035.g7532011a.el9.x86_6 35/152 2023-11-04T01:34:34.530 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/152 2023-11-04T01:34:34.636 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/152 2023-11-04T01:34:34.674 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/152 2023-11-04T01:34:34.730 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/152 2023-11-04T01:34:34.802 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/152 2023-11-04T01:34:34.833 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/152 2023-11-04T01:34:34.870 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/152 2023-11-04T01:34:34.916 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/152 2023-11-04T01:34:34.992 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/152 2023-11-04T01:34:35.045 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/152 2023-11-04T01:34:35.180 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/152 2023-11-04T01:34:35.234 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/152 2023-11-04T01:34:35.273 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/152 2023-11-04T01:34:35.365 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/152 2023-11-04T01:34:35.398 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 50/152 2023-11-04T01:34:35.438 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/152 2023-11-04T01:34:35.451 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 106/152 2023-11-04T01:34:35.468 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/152 2023-11-04T01:34:35.476 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 106/152 2023-11-04T01:34:35.477 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:35.477 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-04T01:34:35.477 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T01:34:35.477 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T01:34:35.477 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:34:35.493 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/152 2023-11-04T01:34:35.521 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 54/152 2023-11-04T01:34:35.608 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 55/152 2023-11-04T01:34:35.648 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : automake-1.16.2-8.el9.noarch 56/152 2023-11-04T01:34:35.685 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 107/152 2023-11-04T01:34:35.703 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-ply-3.11-14.el9.noarch 57/152 2023-11-04T01:34:35.707 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 107/152 2023-11-04T01:34:35.708 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:35.708 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-04T01:34:35.708 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T01:34:35.708 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T01:34:35.708 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:34:35.767 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 58/152 2023-11-04T01:34:35.961 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 59/152 2023-11-04T01:34:36.050 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 60/152 2023-11-04T01:34:36.144 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 108/152 2023-11-04T01:34:36.166 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 108/152 2023-11-04T01:34:36.167 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:36.167 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-04T01:34:36.167 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T01:34:36.167 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T01:34:36.167 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:34:36.187 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 61/152 2023-11-04T01:34:36.239 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 62/152 2023-11-04T01:34:36.274 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 63/152 2023-11-04T01:34:36.307 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 64/152 2023-11-04T01:34:36.343 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 65/152 2023-11-04T01:34:36.372 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : fuse-2.9.9-15.el9.x86_64 66/152 2023-11-04T01:34:36.409 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/152 2023-11-04T01:34:36.453 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/152 2023-11-04T01:34:36.520 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 69/152 2023-11-04T01:34:36.545 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephadm-2:18.0.0-7035.g7532011a.el9.noarch 109/152 2023-11-04T01:34:36.568 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephadm-2:18.0.0-7035.g7532011a.el9.noarch 109/152 2023-11-04T01:34:36.597 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 110/152 2023-11-04T01:34:36.658 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 111/152 2023-11-04T01:34:36.686 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 112/152 2023-11-04T01:34:36.694 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 70/152 2023-11-04T01:34:36.853 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 71/152 2023-11-04T01:34:36.905 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 112/152 2023-11-04T01:34:36.926 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 72/152 2023-11-04T01:34:36.933 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 113/152 2023-11-04T01:34:36.960 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/152 2023-11-04T01:34:37.001 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/152 2023-11-04T01:34:37.036 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/152 2023-11-04T01:34:37.128 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/152 2023-11-04T01:34:37.164 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/152 2023-11-04T01:34:37.267 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 78/152 2023-11-04T01:34:37.318 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2023-11-04T01:34:37.891 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 113/152 2023-11-04T01:34:37.917 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 114/152 2023-11-04T01:34:38.015 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 114/152 2023-11-04T01:34:38.062 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2023-11-04T01:34:38.128 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2023-11-04T01:34:38.162 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2023-11-04T01:34:38.164 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 115/152 2023-11-04T01:34:38.195 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 116/152 2023-11-04T01:34:38.216 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 116/152 2023-11-04T01:34:38.217 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:38.217 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-04T01:34:38.217 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T01:34:38.217 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T01:34:38.217 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:34:38.261 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 117/152 2023-11-04T01:34:38.264 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2023-11-04T01:34:38.272 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 117/152 2023-11-04T01:34:38.299 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 84/152 2023-11-04T01:34:38.476 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : openblas-0.3.21-2.el9.x86_64 85/152 2023-11-04T01:34:38.511 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 86/152 2023-11-04T01:34:38.597 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/152 2023-11-04T01:34:39.050 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-2:18.0.0-7035.g7532011a.el9.x86_64 118/152 2023-11-04T01:34:39.079 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 119/152 2023-11-04T01:34:39.103 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 119/152 2023-11-04T01:34:39.104 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:39.104 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-04T01:34:39.104 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:34:39.104 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:34:39.104 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:34:39.138 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7035.g75320 120/152 2023-11-04T01:34:39.161 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7035.g75320 120/152 2023-11-04T01:34:39.162 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:39.162 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-04T01:34:39.162 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:34:39.205 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 121/152 2023-11-04T01:34:39.227 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 121/152 2023-11-04T01:34:39.228 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:39.228 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-04T01:34:39.228 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:34:39.228 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:34:39.228 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:34:39.265 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 88/152 2023-11-04T01:34:39.375 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 89/152 2023-11-04T01:34:39.523 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 122/152 2023-11-04T01:34:39.545 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 122/152 2023-11-04T01:34:39.545 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:39.545 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-04T01:34:39.545 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T01:34:39.546 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T01:34:39.546 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:34:40.643 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 90/152 2023-11-04T01:34:40.729 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 91/152 2023-11-04T01:34:40.759 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 92/152 2023-11-04T01:34:40.798 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : jq-1.6-15.el9.x86_64 93/152 2023-11-04T01:34:40.834 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2023-11-04T01:34:41.147 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 95/152 2023-11-04T01:34:41.297 INFO:teuthology.orchestra.run.smithi141.stdout: Upgrading : librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 96/152 2023-11-04T01:34:41.375 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 96/152 2023-11-04T01:34:41.402 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 97/152 2023-11-04T01:34:41.439 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 98/152 2023-11-04T01:34:41.873 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 99/152 2023-11-04T01:34:41.900 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 100/152 2023-11-04T01:34:41.972 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 100/152 2023-11-04T01:34:42.002 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 101/152 2023-11-04T01:34:43.358 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 123/152 2023-11-04T01:34:43.400 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 124/152 2023-11-04T01:34:43.431 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 125/152 2023-11-04T01:34:43.609 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 126/152 2023-11-04T01:34:43.720 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 127/152 2023-11-04T01:34:43.773 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 128/152 2023-11-04T01:34:43.814 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/152 2023-11-04T01:34:43.847 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 130/152 2023-11-04T01:34:43.869 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_ 131/152 2023-11-04T01:34:43.901 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-team-1:1.45.5-1.el9.x86_64 132/152 2023-11-04T01:34:43.979 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-tui-1:1.45.5-1.el9.x86_64 133/152 2023-11-04T01:34:44.043 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 134/152 2023-11-04T01:34:44.081 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 135/152 2023-11-04T01:34:44.455 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:44.490 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:44.685 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:34:44.724 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:34:44.741 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:34:44.783 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 137/152 2023-11-04T01:34:45.044 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:34:45.080 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 103/152 2023-11-04T01:34:45.166 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 103/152 2023-11-04T01:34:45.167 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-04T01:34:45.167 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-04T01:34:45.167 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:34:45.203 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 104/152 2023-11-04T01:34:45.621 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 138/152 2023-11-04T01:34:45.701 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 139/152 2023-11-04T01:34:45.742 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 140/152 2023-11-04T01:34:45.833 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flex-2.6.4-9.el9.x86_64 141/152 2023-11-04T01:34:45.863 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : bison-3.7.4-5.el9.x86_64 142/152 2023-11-04T01:34:45.890 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 143/152 2023-11-04T01:34:45.890 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 144/152 2023-11-04T01:34:45.966 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 144/152 2023-11-04T01:34:45.990 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 145/152 2023-11-04T01:34:46.017 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 146/152 2023-11-04T01:34:46.040 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 147/152 2023-11-04T01:34:46.048 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:34:46.048 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:34:46.237 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:34:46.237 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/152 2023-11-04T01:34:46.321 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/152 2023-11-04T01:34:46.351 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 150/152 2023-11-04T01:34:46.351 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 151/152 2023-11-04T01:34:46.419 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 151/152 2023-11-04T01:34:46.486 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:34:51.024 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:34:51.025 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-2:18.0.0-7035.g7532011a.el9.x86_64 1/152 2023-11-04T01:34:51.026 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 2/152 2023-11-04T01:34:51.026 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 3/152 2023-11-04T01:34:51.026 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 4/152 2023-11-04T01:34:51.026 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7035.g75320 5/152 2023-11-04T01:34:51.026 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:34:51.026 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:34:51.026 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 8/152 2023-11-04T01:34:51.026 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 9/152 2023-11-04T01:34:51.026 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 10/152 2023-11-04T01:34:51.026 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 11/152 2023-11-04T01:34:51.026 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:34:51.027 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 13/152 2023-11-04T01:34:51.027 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_ 14/152 2023-11-04T01:34:51.027 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 15/152 2023-11-04T01:34:51.032 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 16/152 2023-11-04T01:34:51.032 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados-devel-2:18.0.0-7035.g7532011a.el9.x86_6 17/152 2023-11-04T01:34:51.032 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 18/152 2023-11-04T01:34:51.032 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 19/152 2023-11-04T01:34:51.032 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 20/152 2023-11-04T01:34:51.032 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-common-2:18.0.0-7035.g7532011a.el9. 21/152 2023-11-04T01:34:51.033 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_6 22/152 2023-11-04T01:34:51.033 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 23/152 2023-11-04T01:34:51.033 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 24/152 2023-11-04T01:34:51.033 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 25/152 2023-11-04T01:34:51.033 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 26/152 2023-11-04T01:34:51.033 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 27/152 2023-11-04T01:34:51.033 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 28/152 2023-11-04T01:34:51.033 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 29/152 2023-11-04T01:34:51.033 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 30/152 2023-11-04T01:34:51.033 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 31/152 2023-11-04T01:34:51.034 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 32/152 2023-11-04T01:34:51.034 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 33/152 2023-11-04T01:34:51.034 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 34/152 2023-11-04T01:34:51.034 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 35/152 2023-11-04T01:34:51.034 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 36/152 2023-11-04T01:34:51.034 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephadm-2:18.0.0-7035.g7532011a.el9.noarch 37/152 2023-11-04T01:34:51.034 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 38/152 2023-11-04T01:34:51.034 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/152 2023-11-04T01:34:51.034 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/152 2023-11-04T01:34:51.034 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/152 2023-11-04T01:34:51.034 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/152 2023-11-04T01:34:51.034 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/152 2023-11-04T01:34:51.035 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/152 2023-11-04T01:34:51.035 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/152 2023-11-04T01:34:51.035 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/152 2023-11-04T01:34:51.041 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/152 2023-11-04T01:34:51.041 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/152 2023-11-04T01:34:51.041 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/152 2023-11-04T01:34:51.041 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/152 2023-11-04T01:34:51.042 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/152 2023-11-04T01:34:51.042 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/152 2023-11-04T01:34:51.042 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/152 2023-11-04T01:34:51.042 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/152 2023-11-04T01:34:51.042 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/152 2023-11-04T01:34:51.042 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/152 2023-11-04T01:34:51.042 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/152 2023-11-04T01:34:51.042 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/152 2023-11-04T01:34:51.042 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/152 2023-11-04T01:34:51.042 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/152 2023-11-04T01:34:51.042 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/152 2023-11-04T01:34:51.042 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/152 2023-11-04T01:34:51.042 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/152 2023-11-04T01:34:51.043 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/152 2023-11-04T01:34:51.043 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/152 2023-11-04T01:34:51.043 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/152 2023-11-04T01:34:51.043 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/152 2023-11-04T01:34:51.043 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/152 2023-11-04T01:34:51.043 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/152 2023-11-04T01:34:51.043 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/152 2023-11-04T01:34:51.043 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/152 2023-11-04T01:34:51.043 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/152 2023-11-04T01:34:51.043 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/152 2023-11-04T01:34:51.043 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/152 2023-11-04T01:34:51.043 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/152 2023-11-04T01:34:51.044 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/152 2023-11-04T01:34:51.044 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/152 2023-11-04T01:34:51.044 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/152 2023-11-04T01:34:51.044 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/152 2023-11-04T01:34:51.044 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/152 2023-11-04T01:34:51.044 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/152 2023-11-04T01:34:51.044 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/152 2023-11-04T01:34:51.044 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/152 2023-11-04T01:34:51.044 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 84/152 2023-11-04T01:34:51.044 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/152 2023-11-04T01:34:51.044 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/152 2023-11-04T01:34:51.044 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/152 2023-11-04T01:34:51.045 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : jq-1.6-15.el9.x86_64 88/152 2023-11-04T01:34:51.045 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/152 2023-11-04T01:34:51.045 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/152 2023-11-04T01:34:51.045 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/152 2023-11-04T01:34:51.045 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/152 2023-11-04T01:34:51.045 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/152 2023-11-04T01:34:51.045 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/152 2023-11-04T01:34:51.046 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/152 2023-11-04T01:34:51.046 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/152 2023-11-04T01:34:51.046 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/152 2023-11-04T01:34:51.046 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/152 2023-11-04T01:34:51.046 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/152 2023-11-04T01:34:51.046 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/152 2023-11-04T01:34:51.046 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/152 2023-11-04T01:34:51.046 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/152 2023-11-04T01:34:51.046 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/152 2023-11-04T01:34:51.046 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/152 2023-11-04T01:34:51.046 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/152 2023-11-04T01:34:51.047 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/152 2023-11-04T01:34:51.047 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 107/152 2023-11-04T01:34:51.047 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/152 2023-11-04T01:34:51.047 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/152 2023-11-04T01:34:51.047 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/152 2023-11-04T01:34:51.047 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/152 2023-11-04T01:34:51.047 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/152 2023-11-04T01:34:51.047 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/152 2023-11-04T01:34:51.047 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/152 2023-11-04T01:34:51.047 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/152 2023-11-04T01:34:51.047 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/152 2023-11-04T01:34:51.047 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/152 2023-11-04T01:34:51.048 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/152 2023-11-04T01:34:51.048 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/152 2023-11-04T01:34:51.048 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/152 2023-11-04T01:34:51.049 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/152 2023-11-04T01:34:51.049 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/152 2023-11-04T01:34:51.049 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/152 2023-11-04T01:34:51.049 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/152 2023-11-04T01:34:51.050 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/152 2023-11-04T01:34:51.052 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/152 2023-11-04T01:34:51.052 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/152 2023-11-04T01:34:51.052 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/152 2023-11-04T01:34:51.052 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/152 2023-11-04T01:34:51.053 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/152 2023-11-04T01:34:51.053 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/152 2023-11-04T01:34:51.053 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/152 2023-11-04T01:34:51.053 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:18.0.0-7035.g7532011a.el9.x86_64 133/152 2023-11-04T01:34:51.053 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/152 2023-11-04T01:34:51.053 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 135/152 2023-11-04T01:34:51.053 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/152 2023-11-04T01:34:51.053 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/152 2023-11-04T01:34:51.054 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/152 2023-11-04T01:34:51.054 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-1:1.45.5-1.el9.x86_64 139/152 2023-11-04T01:34:51.054 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/152 2023-11-04T01:34:51.054 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 141/152 2023-11-04T01:34:51.054 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/152 2023-11-04T01:34:51.054 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-team-1:1.45.5-1.el9.x86_64 143/152 2023-11-04T01:34:51.054 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/152 2023-11-04T01:34:51.054 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-tui-1:1.45.5-1.el9.x86_64 145/152 2023-11-04T01:34:51.055 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/152 2023-11-04T01:34:51.055 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/152 2023-11-04T01:34:51.055 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/152 2023-11-04T01:34:51.055 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 149/152 2023-11-04T01:34:51.055 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 150/152 2023-11-04T01:34:51.055 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 151/152 2023-11-04T01:34:53.404 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:34:53.404 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:34:53.404 INFO:teuthology.orchestra.run.smithi114.stdout:Upgraded: 2023-11-04T01:34:53.404 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:53.405 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:53.405 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-team-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:53.405 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-tui-1:1.45.5-1.el9.x86_64 2023-11-04T01:34:53.405 INFO:teuthology.orchestra.run.smithi114.stdout: acl-2.3.1-4.el9.x86_64 2023-11-04T01:34:53.405 INFO:teuthology.orchestra.run.smithi114.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-04T01:34:53.405 INFO:teuthology.orchestra.run.smithi114.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-04T01:34:53.405 INFO:teuthology.orchestra.run.smithi114.stdout: librados2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.405 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.405 INFO:teuthology.orchestra.run.smithi114.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-04T01:34:53.405 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2023-11-04T01:34:53.405 INFO:teuthology.orchestra.run.smithi114.stdout: automake-1.16.2-8.el9.noarch 2023-11-04T01:34:53.406 INFO:teuthology.orchestra.run.smithi114.stdout: bison-3.7.4-5.el9.x86_64 2023-11-04T01:34:53.406 INFO:teuthology.orchestra.run.smithi114.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-04T01:34:53.406 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.406 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.406 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.406 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.406 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:53.406 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.406 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.406 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.406 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:53.406 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:53.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:53.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:53.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:53.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:53.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.407 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:53.408 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:53.408 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.408 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:34:53.408 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-11-04T01:34:53.408 INFO:teuthology.orchestra.run.smithi114.stdout: flex-2.6.4-9.el9.x86_64 2023-11-04T01:34:53.408 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-04T01:34:53.408 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-04T01:34:53.408 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-04T01:34:53.408 INFO:teuthology.orchestra.run.smithi114.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-04T01:34:53.408 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-04T01:34:53.408 INFO:teuthology.orchestra.run.smithi114.stdout: jq-1.6-15.el9.x86_64 2023-11-04T01:34:53.409 INFO:teuthology.orchestra.run.smithi114.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-04T01:34:53.409 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-04T01:34:53.410 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-04T01:34:53.410 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.410 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.410 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.411 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-04T01:34:53.411 INFO:teuthology.orchestra.run.smithi114.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-04T01:34:53.411 INFO:teuthology.orchestra.run.smithi114.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-04T01:34:53.411 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-04T01:34:53.411 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-04T01:34:53.411 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.411 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.411 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-04T01:34:53.411 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.411 INFO:teuthology.orchestra.run.smithi114.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-04T01:34:53.412 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-04T01:34:53.413 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-04T01:34:53.413 INFO:teuthology.orchestra.run.smithi114.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-04T01:34:53.414 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-04T01:34:53.414 INFO:teuthology.orchestra.run.smithi114.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-04T01:34:53.414 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-04T01:34:53.414 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-04T01:34:53.414 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-04T01:34:53.414 INFO:teuthology.orchestra.run.smithi114.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-04T01:34:53.414 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-13.11-1.el9.x86_64 2023-11-04T01:34:53.414 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-04T01:34:53.414 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-04T01:34:53.417 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-04T01:34:53.418 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-04T01:34:53.418 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-04T01:34:53.418 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-04T01:34:53.418 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-04T01:34:53.418 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.418 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.418 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.418 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-04T01:34:53.418 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-04T01:34:53.418 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-04T01:34:53.418 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-04T01:34:53.418 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-04T01:34:53.419 INFO:teuthology.orchestra.run.smithi114.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-04T01:34:53.419 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-04T01:34:53.419 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-04T01:34:53.419 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-04T01:34:53.419 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-04T01:34:53.420 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-04T01:34:53.420 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-04T01:34:53.420 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-04T01:34:53.420 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-04T01:34:53.420 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-04T01:34:53.420 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-04T01:34:53.420 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-04T01:34:53.420 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-04T01:34:53.421 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-04T01:34:53.421 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-04T01:34:53.421 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-04T01:34:53.421 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-04T01:34:53.421 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-04T01:34:53.421 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-04T01:34:53.421 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-04T01:34:53.421 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-04T01:34:53.421 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-04T01:34:53.430 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ply-3.11-14.el9.noarch 2023-11-04T01:34:53.430 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-04T01:34:53.431 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-04T01:34:53.431 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-04T01:34:53.431 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-04T01:34:53.431 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-04T01:34:53.431 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-04T01:34:53.431 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-04T01:34:53.431 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.431 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.431 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-04T01:34:53.431 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-04T01:34:53.431 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-04T01:34:53.431 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.432 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-04T01:34:53.432 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-04T01:34:53.432 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-04T01:34:53.432 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-04T01:34:53.432 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-04T01:34:53.432 INFO:teuthology.orchestra.run.smithi114.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-04T01:34:53.432 INFO:teuthology.orchestra.run.smithi114.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-04T01:34:53.432 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-04T01:34:53.432 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-04T01:34:53.432 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-04T01:34:53.432 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-04T01:34:53.432 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.433 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.433 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:34:53.433 INFO:teuthology.orchestra.run.smithi114.stdout: re2-1:20211101-3.el9.x86_64 2023-11-04T01:34:53.433 INFO:teuthology.orchestra.run.smithi114.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-04T01:34:53.433 INFO:teuthology.orchestra.run.smithi114.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-04T01:34:53.433 INFO:teuthology.orchestra.run.smithi114.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-04T01:34:53.433 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-04T01:34:53.433 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-04T01:34:53.434 INFO:teuthology.orchestra.run.smithi114.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-04T01:34:53.434 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:34:53.434 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2023-11-04T01:34:53.804 DEBUG:teuthology.parallel:result is None 2023-11-04T01:34:56.584 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 104/152 2023-11-04T01:34:56.584 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /sys 2023-11-04T01:34:56.584 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /proc 2023-11-04T01:34:56.584 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /mnt 2023-11-04T01:34:56.584 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /var/tmp 2023-11-04T01:34:56.584 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /home 2023-11-04T01:34:56.584 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /root 2023-11-04T01:34:56.585 INFO:teuthology.orchestra.run.smithi141.stdout:skipping the directory /tmp 2023-11-04T01:34:56.585 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:34:56.749 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 105/152 2023-11-04T01:34:56.765 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 105/152 2023-11-04T01:34:56.765 INFO:teuthology.orchestra.run.smithi141.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:56.765 INFO:teuthology.orchestra.run.smithi141.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-04T01:34:56.765 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:34:58.345 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 106/152 2023-11-04T01:34:58.370 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 106/152 2023-11-04T01:34:58.370 INFO:teuthology.orchestra.run.smithi141.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:58.370 INFO:teuthology.orchestra.run.smithi141.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-04T01:34:58.370 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T01:34:58.370 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T01:34:58.370 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:34:58.586 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 107/152 2023-11-04T01:34:58.608 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 107/152 2023-11-04T01:34:58.608 INFO:teuthology.orchestra.run.smithi141.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:58.608 INFO:teuthology.orchestra.run.smithi141.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-04T01:34:58.608 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T01:34:58.608 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T01:34:58.609 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:34:59.045 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 108/152 2023-11-04T01:34:59.067 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 108/152 2023-11-04T01:34:59.067 INFO:teuthology.orchestra.run.smithi141.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:34:59.067 INFO:teuthology.orchestra.run.smithi141.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-04T01:34:59.067 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T01:34:59.067 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T01:34:59.067 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:34:59.479 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: cephadm-2:18.0.0-7035.g7532011a.el9.noarch 109/152 2023-11-04T01:34:59.512 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : cephadm-2:18.0.0-7035.g7532011a.el9.noarch 109/152 2023-11-04T01:34:59.540 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 110/152 2023-11-04T01:34:59.611 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 111/152 2023-11-04T01:34:59.643 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 112/152 2023-11-04T01:34:59.867 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 112/152 2023-11-04T01:34:59.902 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 113/152 2023-11-04T01:35:00.873 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 113/152 2023-11-04T01:35:00.902 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 114/152 2023-11-04T01:35:01.001 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 114/152 2023-11-04T01:35:01.159 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 115/152 2023-11-04T01:35:01.187 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 116/152 2023-11-04T01:35:01.210 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 116/152 2023-11-04T01:35:01.210 INFO:teuthology.orchestra.run.smithi141.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:35:01.210 INFO:teuthology.orchestra.run.smithi141.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-04T01:35:01.210 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T01:35:01.210 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T01:35:01.210 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:01.257 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 117/152 2023-11-04T01:35:01.268 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 117/152 2023-11-04T01:35:02.058 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-2:18.0.0-7035.g7532011a.el9.x86_64 118/152 2023-11-04T01:35:02.099 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 119/152 2023-11-04T01:35:02.122 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 119/152 2023-11-04T01:35:02.122 INFO:teuthology.orchestra.run.smithi141.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:35:02.122 INFO:teuthology.orchestra.run.smithi141.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-04T01:35:02.122 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:35:02.122 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:35:02.123 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:02.167 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7035.g75320 120/152 2023-11-04T01:35:02.190 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7035.g75320 120/152 2023-11-04T01:35:02.191 INFO:teuthology.orchestra.run.smithi141.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:35:02.191 INFO:teuthology.orchestra.run.smithi141.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-04T01:35:02.191 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:02.242 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 121/152 2023-11-04T01:35:02.265 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 121/152 2023-11-04T01:35:02.265 INFO:teuthology.orchestra.run.smithi141.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:35:02.265 INFO:teuthology.orchestra.run.smithi141.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-04T01:35:02.265 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:35:02.265 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:35:02.265 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:02.560 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 122/152 2023-11-04T01:35:02.582 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 122/152 2023-11-04T01:35:02.583 INFO:teuthology.orchestra.run.smithi141.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:35:02.583 INFO:teuthology.orchestra.run.smithi141.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-04T01:35:02.583 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T01:35:02.583 INFO:teuthology.orchestra.run.smithi141.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T01:35:02.583 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:06.454 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 123/152 2023-11-04T01:35:06.496 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 124/152 2023-11-04T01:35:06.526 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 125/152 2023-11-04T01:35:06.711 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 126/152 2023-11-04T01:35:06.834 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 127/152 2023-11-04T01:35:06.891 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 128/152 2023-11-04T01:35:06.935 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/152 2023-11-04T01:35:06.968 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 130/152 2023-11-04T01:35:07.007 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_ 131/152 2023-11-04T01:35:07.045 INFO:teuthology.orchestra.run.smithi141.stdout: Upgrading : NetworkManager-team-1:1.45.5-1.el9.x86_64 132/152 2023-11-04T01:35:07.128 INFO:teuthology.orchestra.run.smithi141.stdout: Upgrading : NetworkManager-tui-1:1.45.5-1.el9.x86_64 133/152 2023-11-04T01:35:07.191 INFO:teuthology.orchestra.run.smithi141.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 134/152 2023-11-04T01:35:07.239 INFO:teuthology.orchestra.run.smithi141.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 135/152 2023-11-04T01:35:07.755 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:35:07.792 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:35:07.812 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:35:07.854 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 137/152 2023-11-04T01:35:08.685 INFO:teuthology.orchestra.run.smithi141.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 138/152 2023-11-04T01:35:08.790 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 139/152 2023-11-04T01:35:08.831 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 140/152 2023-11-04T01:35:08.919 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : flex-2.6.4-9.el9.x86_64 141/152 2023-11-04T01:35:08.952 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : bison-3.7.4-5.el9.x86_64 142/152 2023-11-04T01:35:08.982 INFO:teuthology.orchestra.run.smithi141.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 143/152 2023-11-04T01:35:08.982 INFO:teuthology.orchestra.run.smithi141.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 144/152 2023-11-04T01:35:09.062 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 144/152 2023-11-04T01:35:09.087 INFO:teuthology.orchestra.run.smithi141.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 145/152 2023-11-04T01:35:09.112 INFO:teuthology.orchestra.run.smithi141.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 146/152 2023-11-04T01:35:09.146 INFO:teuthology.orchestra.run.smithi141.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 147/152 2023-11-04T01:35:09.162 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:35:09.163 INFO:teuthology.orchestra.run.smithi141.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:35:09.349 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:35:09.349 INFO:teuthology.orchestra.run.smithi141.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/152 2023-11-04T01:35:09.423 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/152 2023-11-04T01:35:09.448 INFO:teuthology.orchestra.run.smithi141.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 150/152 2023-11-04T01:35:09.448 INFO:teuthology.orchestra.run.smithi141.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 151/152 2023-11-04T01:35:09.517 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 151/152 2023-11-04T01:35:09.582 INFO:teuthology.orchestra.run.smithi141.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:35:14.276 INFO:teuthology.orchestra.run.smithi141.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:35:14.276 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-2:18.0.0-7035.g7532011a.el9.x86_64 1/152 2023-11-04T01:35:14.276 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 2/152 2023-11-04T01:35:14.276 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 3/152 2023-11-04T01:35:14.276 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 4/152 2023-11-04T01:35:14.276 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7035.g75320 5/152 2023-11-04T01:35:14.276 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:35:14.276 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:35:14.276 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 8/152 2023-11-04T01:35:14.277 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 9/152 2023-11-04T01:35:14.277 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 10/152 2023-11-04T01:35:14.277 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 11/152 2023-11-04T01:35:14.277 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:35:14.277 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 13/152 2023-11-04T01:35:14.277 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_ 14/152 2023-11-04T01:35:14.277 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 15/152 2023-11-04T01:35:14.277 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 16/152 2023-11-04T01:35:14.277 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librados-devel-2:18.0.0-7035.g7532011a.el9.x86_6 17/152 2023-11-04T01:35:14.277 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 18/152 2023-11-04T01:35:14.277 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 19/152 2023-11-04T01:35:14.277 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 20/152 2023-11-04T01:35:14.278 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-ceph-common-2:18.0.0-7035.g7532011a.el9. 21/152 2023-11-04T01:35:14.278 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_6 22/152 2023-11-04T01:35:14.278 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 23/152 2023-11-04T01:35:14.278 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 24/152 2023-11-04T01:35:14.278 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 25/152 2023-11-04T01:35:14.278 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 26/152 2023-11-04T01:35:14.278 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 27/152 2023-11-04T01:35:14.278 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 28/152 2023-11-04T01:35:14.278 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 29/152 2023-11-04T01:35:14.278 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 30/152 2023-11-04T01:35:14.278 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 31/152 2023-11-04T01:35:14.278 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 32/152 2023-11-04T01:35:14.279 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 33/152 2023-11-04T01:35:14.279 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 34/152 2023-11-04T01:35:14.279 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 35/152 2023-11-04T01:35:14.279 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 36/152 2023-11-04T01:35:14.279 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : cephadm-2:18.0.0-7035.g7532011a.el9.noarch 37/152 2023-11-04T01:35:14.279 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 38/152 2023-11-04T01:35:14.279 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/152 2023-11-04T01:35:14.279 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/152 2023-11-04T01:35:14.279 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/152 2023-11-04T01:35:14.279 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/152 2023-11-04T01:35:14.280 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/152 2023-11-04T01:35:14.280 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/152 2023-11-04T01:35:14.280 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/152 2023-11-04T01:35:14.280 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/152 2023-11-04T01:35:14.280 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/152 2023-11-04T01:35:14.280 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/152 2023-11-04T01:35:14.280 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/152 2023-11-04T01:35:14.280 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/152 2023-11-04T01:35:14.280 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/152 2023-11-04T01:35:14.281 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/152 2023-11-04T01:35:14.281 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/152 2023-11-04T01:35:14.281 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/152 2023-11-04T01:35:14.281 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/152 2023-11-04T01:35:14.281 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/152 2023-11-04T01:35:14.281 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/152 2023-11-04T01:35:14.282 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/152 2023-11-04T01:35:14.282 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/152 2023-11-04T01:35:14.282 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/152 2023-11-04T01:35:14.282 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/152 2023-11-04T01:35:14.282 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/152 2023-11-04T01:35:14.282 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/152 2023-11-04T01:35:14.282 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/152 2023-11-04T01:35:14.282 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/152 2023-11-04T01:35:14.282 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/152 2023-11-04T01:35:14.282 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/152 2023-11-04T01:35:14.282 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/152 2023-11-04T01:35:14.282 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/152 2023-11-04T01:35:14.283 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/152 2023-11-04T01:35:14.283 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/152 2023-11-04T01:35:14.283 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/152 2023-11-04T01:35:14.283 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/152 2023-11-04T01:35:14.283 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/152 2023-11-04T01:35:14.283 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/152 2023-11-04T01:35:14.283 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/152 2023-11-04T01:35:14.283 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/152 2023-11-04T01:35:14.283 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/152 2023-11-04T01:35:14.283 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/152 2023-11-04T01:35:14.283 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/152 2023-11-04T01:35:14.283 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/152 2023-11-04T01:35:14.284 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/152 2023-11-04T01:35:14.284 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/152 2023-11-04T01:35:14.284 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 84/152 2023-11-04T01:35:14.284 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/152 2023-11-04T01:35:14.284 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/152 2023-11-04T01:35:14.284 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/152 2023-11-04T01:35:14.284 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : jq-1.6-15.el9.x86_64 88/152 2023-11-04T01:35:14.284 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/152 2023-11-04T01:35:14.284 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/152 2023-11-04T01:35:14.284 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/152 2023-11-04T01:35:14.284 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/152 2023-11-04T01:35:14.284 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/152 2023-11-04T01:35:14.284 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/152 2023-11-04T01:35:14.285 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/152 2023-11-04T01:35:14.285 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/152 2023-11-04T01:35:14.285 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/152 2023-11-04T01:35:14.285 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/152 2023-11-04T01:35:14.285 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/152 2023-11-04T01:35:14.285 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/152 2023-11-04T01:35:14.285 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/152 2023-11-04T01:35:14.285 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/152 2023-11-04T01:35:14.285 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/152 2023-11-04T01:35:14.285 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/152 2023-11-04T01:35:14.285 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/152 2023-11-04T01:35:14.285 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/152 2023-11-04T01:35:14.286 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 107/152 2023-11-04T01:35:14.286 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/152 2023-11-04T01:35:14.286 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/152 2023-11-04T01:35:14.286 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/152 2023-11-04T01:35:14.286 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/152 2023-11-04T01:35:14.286 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/152 2023-11-04T01:35:14.286 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/152 2023-11-04T01:35:14.286 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/152 2023-11-04T01:35:14.286 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/152 2023-11-04T01:35:14.286 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/152 2023-11-04T01:35:14.286 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/152 2023-11-04T01:35:14.286 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/152 2023-11-04T01:35:14.286 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/152 2023-11-04T01:35:14.287 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/152 2023-11-04T01:35:14.287 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/152 2023-11-04T01:35:14.287 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/152 2023-11-04T01:35:14.287 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/152 2023-11-04T01:35:14.287 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/152 2023-11-04T01:35:14.287 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/152 2023-11-04T01:35:14.287 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/152 2023-11-04T01:35:14.287 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/152 2023-11-04T01:35:14.287 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/152 2023-11-04T01:35:14.287 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/152 2023-11-04T01:35:14.287 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/152 2023-11-04T01:35:14.287 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/152 2023-11-04T01:35:14.287 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/152 2023-11-04T01:35:14.288 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librados2-2:18.0.0-7035.g7532011a.el9.x86_64 133/152 2023-11-04T01:35:14.288 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/152 2023-11-04T01:35:14.288 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 135/152 2023-11-04T01:35:14.288 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/152 2023-11-04T01:35:14.288 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/152 2023-11-04T01:35:14.288 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/152 2023-11-04T01:35:14.288 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : NetworkManager-1:1.45.5-1.el9.x86_64 139/152 2023-11-04T01:35:14.288 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/152 2023-11-04T01:35:14.288 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 141/152 2023-11-04T01:35:14.288 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/152 2023-11-04T01:35:14.288 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : NetworkManager-team-1:1.45.5-1.el9.x86_64 143/152 2023-11-04T01:35:14.288 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/152 2023-11-04T01:35:14.288 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : NetworkManager-tui-1:1.45.5-1.el9.x86_64 145/152 2023-11-04T01:35:14.289 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/152 2023-11-04T01:35:14.289 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/152 2023-11-04T01:35:14.289 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/152 2023-11-04T01:35:14.289 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 149/152 2023-11-04T01:35:14.289 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 150/152 2023-11-04T01:35:14.289 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 151/152 2023-11-04T01:35:16.921 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:35:16.921 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:16.921 INFO:teuthology.orchestra.run.smithi141.stdout:Upgraded: 2023-11-04T01:35:16.921 INFO:teuthology.orchestra.run.smithi141.stdout: NetworkManager-1:1.45.5-1.el9.x86_64 2023-11-04T01:35:16.921 INFO:teuthology.orchestra.run.smithi141.stdout: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 2023-11-04T01:35:16.921 INFO:teuthology.orchestra.run.smithi141.stdout: NetworkManager-team-1:1.45.5-1.el9.x86_64 2023-11-04T01:35:16.921 INFO:teuthology.orchestra.run.smithi141.stdout: NetworkManager-tui-1:1.45.5-1.el9.x86_64 2023-11-04T01:35:16.922 INFO:teuthology.orchestra.run.smithi141.stdout: acl-2.3.1-4.el9.x86_64 2023-11-04T01:35:16.922 INFO:teuthology.orchestra.run.smithi141.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-04T01:35:16.922 INFO:teuthology.orchestra.run.smithi141.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-04T01:35:16.922 INFO:teuthology.orchestra.run.smithi141.stdout: librados2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.922 INFO:teuthology.orchestra.run.smithi141.stdout: librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.922 INFO:teuthology.orchestra.run.smithi141.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-04T01:35:16.922 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2023-11-04T01:35:16.922 INFO:teuthology.orchestra.run.smithi141.stdout: automake-1.16.2-8.el9.noarch 2023-11-04T01:35:16.922 INFO:teuthology.orchestra.run.smithi141.stdout: bison-3.7.4-5.el9.x86_64 2023-11-04T01:35:16.922 INFO:teuthology.orchestra.run.smithi141.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-04T01:35:16.922 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.922 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.923 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.923 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.923 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-grafana-dashboards-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:35:16.923 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-immutable-object-cache-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.923 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.923 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.923 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:35:16.923 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:35:16.923 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:35:16.923 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:35:16.923 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:35:16.923 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.923 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.924 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:35:16.924 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.924 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.924 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.924 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:35:16.924 INFO:teuthology.orchestra.run.smithi141.stdout: cephadm-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:35:16.924 INFO:teuthology.orchestra.run.smithi141.stdout: cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.924 INFO:teuthology.orchestra.run.smithi141.stdout: cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:35:16.924 INFO:teuthology.orchestra.run.smithi141.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-11-04T01:35:16.924 INFO:teuthology.orchestra.run.smithi141.stdout: flex-2.6.4-9.el9.x86_64 2023-11-04T01:35:16.924 INFO:teuthology.orchestra.run.smithi141.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-04T01:35:16.925 INFO:teuthology.orchestra.run.smithi141.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-04T01:35:16.925 INFO:teuthology.orchestra.run.smithi141.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-04T01:35:16.925 INFO:teuthology.orchestra.run.smithi141.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-04T01:35:16.925 INFO:teuthology.orchestra.run.smithi141.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-04T01:35:16.925 INFO:teuthology.orchestra.run.smithi141.stdout: jq-1.6-15.el9.x86_64 2023-11-04T01:35:16.925 INFO:teuthology.orchestra.run.smithi141.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-04T01:35:16.925 INFO:teuthology.orchestra.run.smithi141.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-04T01:35:16.925 INFO:teuthology.orchestra.run.smithi141.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-04T01:35:16.925 INFO:teuthology.orchestra.run.smithi141.stdout: libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.925 INFO:teuthology.orchestra.run.smithi141.stdout: libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.925 INFO:teuthology.orchestra.run.smithi141.stdout: libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.925 INFO:teuthology.orchestra.run.smithi141.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-04T01:35:16.926 INFO:teuthology.orchestra.run.smithi141.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-04T01:35:16.926 INFO:teuthology.orchestra.run.smithi141.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-04T01:35:16.927 INFO:teuthology.orchestra.run.smithi141.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-04T01:35:16.927 INFO:teuthology.orchestra.run.smithi141.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-04T01:35:16.927 INFO:teuthology.orchestra.run.smithi141.stdout: librados-devel-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.927 INFO:teuthology.orchestra.run.smithi141.stdout: libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.927 INFO:teuthology.orchestra.run.smithi141.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-04T01:35:16.927 INFO:teuthology.orchestra.run.smithi141.stdout: librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.928 INFO:teuthology.orchestra.run.smithi141.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-04T01:35:16.928 INFO:teuthology.orchestra.run.smithi141.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-04T01:35:16.928 INFO:teuthology.orchestra.run.smithi141.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-04T01:35:16.928 INFO:teuthology.orchestra.run.smithi141.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-04T01:35:16.928 INFO:teuthology.orchestra.run.smithi141.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-04T01:35:16.928 INFO:teuthology.orchestra.run.smithi141.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-04T01:35:16.928 INFO:teuthology.orchestra.run.smithi141.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-04T01:35:16.928 INFO:teuthology.orchestra.run.smithi141.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-04T01:35:16.928 INFO:teuthology.orchestra.run.smithi141.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-04T01:35:16.928 INFO:teuthology.orchestra.run.smithi141.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-04T01:35:16.929 INFO:teuthology.orchestra.run.smithi141.stdout: postgresql-13.11-1.el9.x86_64 2023-11-04T01:35:16.929 INFO:teuthology.orchestra.run.smithi141.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-04T01:35:16.929 INFO:teuthology.orchestra.run.smithi141.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-04T01:35:16.929 INFO:teuthology.orchestra.run.smithi141.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-04T01:35:16.929 INFO:teuthology.orchestra.run.smithi141.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-04T01:35:16.929 INFO:teuthology.orchestra.run.smithi141.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-04T01:35:16.929 INFO:teuthology.orchestra.run.smithi141.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-04T01:35:16.929 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-04T01:35:16.929 INFO:teuthology.orchestra.run.smithi141.stdout: python3-ceph-argparse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.929 INFO:teuthology.orchestra.run.smithi141.stdout: python3-ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.929 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.929 INFO:teuthology.orchestra.run.smithi141.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-04T01:35:16.930 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-04T01:35:16.930 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-04T01:35:16.930 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-04T01:35:16.930 INFO:teuthology.orchestra.run.smithi141.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-04T01:35:16.930 INFO:teuthology.orchestra.run.smithi141.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-04T01:35:16.930 INFO:teuthology.orchestra.run.smithi141.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-04T01:35:16.930 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-04T01:35:16.930 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-04T01:35:16.930 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-04T01:35:16.930 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-04T01:35:16.930 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-04T01:35:16.930 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-04T01:35:16.931 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-04T01:35:16.931 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-04T01:35:16.931 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-04T01:35:16.931 INFO:teuthology.orchestra.run.smithi141.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-04T01:35:16.931 INFO:teuthology.orchestra.run.smithi141.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-04T01:35:16.931 INFO:teuthology.orchestra.run.smithi141.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-04T01:35:16.931 INFO:teuthology.orchestra.run.smithi141.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-04T01:35:16.931 INFO:teuthology.orchestra.run.smithi141.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-04T01:35:16.931 INFO:teuthology.orchestra.run.smithi141.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-04T01:35:16.931 INFO:teuthology.orchestra.run.smithi141.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-04T01:35:16.931 INFO:teuthology.orchestra.run.smithi141.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-04T01:35:16.932 INFO:teuthology.orchestra.run.smithi141.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-04T01:35:16.932 INFO:teuthology.orchestra.run.smithi141.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-04T01:35:16.932 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-04T01:35:16.932 INFO:teuthology.orchestra.run.smithi141.stdout: python3-ply-3.11-14.el9.noarch 2023-11-04T01:35:16.932 INFO:teuthology.orchestra.run.smithi141.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-04T01:35:16.936 INFO:teuthology.orchestra.run.smithi141.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-04T01:35:16.936 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-04T01:35:16.937 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-04T01:35:16.937 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-04T01:35:16.937 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-04T01:35:16.937 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-04T01:35:16.937 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.937 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.937 INFO:teuthology.orchestra.run.smithi141.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-04T01:35:16.938 INFO:teuthology.orchestra.run.smithi141.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-04T01:35:16.938 INFO:teuthology.orchestra.run.smithi141.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-04T01:35:16.938 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.938 INFO:teuthology.orchestra.run.smithi141.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-04T01:35:16.938 INFO:teuthology.orchestra.run.smithi141.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-04T01:35:16.938 INFO:teuthology.orchestra.run.smithi141.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-04T01:35:16.938 INFO:teuthology.orchestra.run.smithi141.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-04T01:35:16.938 INFO:teuthology.orchestra.run.smithi141.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-04T01:35:16.938 INFO:teuthology.orchestra.run.smithi141.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-04T01:35:16.938 INFO:teuthology.orchestra.run.smithi141.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-04T01:35:16.938 INFO:teuthology.orchestra.run.smithi141.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-04T01:35:16.939 INFO:teuthology.orchestra.run.smithi141.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-04T01:35:16.939 INFO:teuthology.orchestra.run.smithi141.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-04T01:35:16.939 INFO:teuthology.orchestra.run.smithi141.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-04T01:35:16.939 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.939 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.939 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:35:16.939 INFO:teuthology.orchestra.run.smithi141.stdout: re2-1:20211101-3.el9.x86_64 2023-11-04T01:35:16.939 INFO:teuthology.orchestra.run.smithi141.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-04T01:35:16.939 INFO:teuthology.orchestra.run.smithi141.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-04T01:35:16.939 INFO:teuthology.orchestra.run.smithi141.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-04T01:35:16.939 INFO:teuthology.orchestra.run.smithi141.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-04T01:35:16.939 INFO:teuthology.orchestra.run.smithi141.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-04T01:35:16.948 INFO:teuthology.orchestra.run.smithi141.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-04T01:35:16.948 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:16.948 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2023-11-04T01:35:17.331 DEBUG:teuthology.parallel:result is None 2023-11-04T01:35:17.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:35:17.560 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-04T01:35:17.585 INFO:teuthology.orchestra.run.smithi114.stdout:18.0.0-7035.g7532011a.el9 2023-11-04T01:35:17.586 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7035.g7532011a.el9 2023-11-04T01:35:17.586 INFO:teuthology.task.install:The correct ceph version 18.0.0-7035.g7532011a is installed. 2023-11-04T01:35:17.587 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:35:17.825 DEBUG:teuthology.orchestra.run.smithi141:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-04T01:35:17.849 INFO:teuthology.orchestra.run.smithi141.stdout:18.0.0-7035.g7532011a.el9 2023-11-04T01:35:17.849 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7035.g7532011a.el9 2023-11-04T01:35:17.849 INFO:teuthology.task.install:The correct ceph version 18.0.0-7035.g7532011a is installed. 2023-11-04T01:35:17.849 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-04T01:35:17.849 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:17.850 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-04T01:35:17.885 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:17.935 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-04T01:35:17.969 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-04T01:35:17.970 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:17.970 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2023-11-04T01:35:18.000 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-04T01:35:18.071 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:18.071 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/usr/bin/daemon-helper 2023-11-04T01:35:18.101 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-04T01:35:18.168 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-04T01:35:18.168 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:18.168 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-04T01:35:18.200 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-04T01:35:18.270 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:18.270 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-04T01:35:18.301 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-04T01:35:18.368 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-04T01:35:18.369 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:18.369 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2023-11-04T01:35:18.396 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-04T01:35:18.466 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:18.466 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/usr/bin/stdin-killer 2023-11-04T01:35:18.492 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-04T01:35:18.565 INFO:teuthology.run_tasks:Running task ceph... 2023-11-04T01:35:18.693 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-04T01:35:18.693 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /var/log/ceph 2023-11-04T01:35:18.697 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod 777 /var/log/ceph 2023-11-04T01:35:18.723 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-04T01:35:18.724 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-04T01:35:18.764 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-04T01:35:18.790 INFO:tasks.ceph:Creating extra log directories... 2023-11-04T01:35:18.791 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-04T01:35:18.831 DEBUG:teuthology.orchestra.run.smithi141:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-04T01:35:18.870 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-04T01:35:18.870 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-04T01:35:18.871 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-04T01:35:18.871 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:18.871 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-04T01:35:18.910 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-04T01:35:19.030 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-04T01:35:19.058 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:19.058 DEBUG:teuthology.orchestra.run.smithi141:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-04T01:35:19.074 DEBUG:teuthology.orchestra.run.smithi141:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-04T01:35:19.191 DEBUG:teuthology.orchestra.run.smithi141:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-04T01:35:19.223 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-04T01:35:19.224 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-04T01:35:19.224 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918', 'branch': 'main', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7445918', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'dry_run': True}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20231103.180916', 'sha1': '702f9e6492477037e018f68dfdf636a30c24f329'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 50, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7192, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-batrick-testing-20231103.180916', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '702f9e6492477037e018f68dfdf636a30c24f329', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi114.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGNwtC3sRo9An1v0162xAkwK5ps/9wuy22pqR7mLCVyuHAp+SMJP1gJTJrIcOGhgZ5r3AB7uteoz2/0A66uhnyc=', 'smithi141.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHbgkzfTEigi1OIdnkvi6vLGap0GXnDZHAy7U0RidR/plsRSMGBTBmY6ay7iBTK7Wx0oHt5X/mViCu1YWdr+z04='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'exec': {'mon.a': ['ceph config set mgr mgr/crash/warn_recent_interval 0']}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_snapshots']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-03_18:12:33', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822'} 2023-11-04T01:35:19.224 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-04T01:35:19.227 DEBUG:teuthology.orchestra.run.smithi141:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-04T01:35:19.272 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/run/ceph 2023-11-04T01:35:19.281 DEBUG:teuthology.orchestra.run.smithi141:> sudo install -d -m0777 -- /var/run/ceph 2023-11-04T01:35:19.342 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:19.342 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/scratch_devs of=/dev/stdout 2023-11-04T01:35:19.368 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-04T01:35:19.368 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 2023-11-04T01:35:19.422 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-04T01:35:19.423 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:35:19.423 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-11-04T01:35:19.423 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:35:19.423 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:35:19.423 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-11-04 01:34:46.805626565 +0000 2023-11-04T01:35:19.423 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-11-04 01:32:26.255000901 +0000 2023-11-04T01:35:19.423 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-11-04 01:32:26.255000901 +0000 2023-11-04T01:35:19.423 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2023-11-04 01:32:26.255000901 +0000 2023-11-04T01:35:19.423 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-04T01:35:19.487 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-11-04T01:35:19.488 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-11-04T01:35:19.488 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000273464 s, 1.9 MB/s 2023-11-04T01:35:19.489 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-04T01:35:19.544 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 2023-11-04T01:35:19.599 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-04T01:35:19.599 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:35:19.599 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-11-04T01:35:19.599 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:35:19.600 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:35:19.600 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-11-04 01:34:46.805626565 +0000 2023-11-04T01:35:19.600 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-11-04 01:32:27.266979244 +0000 2023-11-04T01:35:19.600 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-11-04 01:32:27.266979244 +0000 2023-11-04T01:35:19.600 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2023-11-04 01:32:27.266979244 +0000 2023-11-04T01:35:19.600 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-04T01:35:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-11-04T01:35:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-11-04T01:35:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000214463 s, 2.4 MB/s 2023-11-04T01:35:19.667 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-04T01:35:19.723 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 2023-11-04T01:35:19.778 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-04T01:35:19.778 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:35:19.778 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 703 Links: 1 2023-11-04T01:35:19.778 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:35:19.778 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:35:19.779 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-11-04 01:34:46.806626544 +0000 2023-11-04T01:35:19.779 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-11-04 01:32:28.242958358 +0000 2023-11-04T01:35:19.779 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-11-04 01:32:28.242958358 +0000 2023-11-04T01:35:19.779 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2023-11-04 01:32:28.242958358 +0000 2023-11-04T01:35:19.779 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-04T01:35:19.843 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-11-04T01:35:19.844 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-11-04T01:35:19.844 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000204306 s, 2.5 MB/s 2023-11-04T01:35:19.845 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-04T01:35:19.900 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 2023-11-04T01:35:19.955 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-04T01:35:19.955 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:35:19.955 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-11-04T01:35:19.955 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:35:19.956 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:35:19.956 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-11-04 01:34:46.806626544 +0000 2023-11-04T01:35:19.956 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-11-04 01:32:29.159938734 +0000 2023-11-04T01:35:19.956 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-11-04 01:32:29.159938734 +0000 2023-11-04T01:35:19.956 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2023-11-04 01:32:29.159938734 +0000 2023-11-04T01:35:19.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-04T01:35:20.021 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-11-04T01:35:20.021 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-11-04T01:35:20.021 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000225091 s, 2.3 MB/s 2023-11-04T01:35:20.022 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-04T01:35:20.078 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:20.078 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:20.086 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/scratch_devs of=/dev/stdout 2023-11-04T01:35:20.106 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-04T01:35:20.106 DEBUG:teuthology.orchestra.run.smithi141:> stat /dev/vg_nvme/lv_1 2023-11-04T01:35:20.162 INFO:teuthology.orchestra.run.smithi141.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-04T01:35:20.162 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:35:20.162 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 5h/5d Inode: 664 Links: 1 2023-11-04T01:35:20.162 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:35:20.162 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:35:20.162 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 2023-11-04 01:35:09.919897135 +0000 2023-11-04T01:35:20.162 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2023-11-04 01:32:29.095238064 +0000 2023-11-04T01:35:20.163 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2023-11-04 01:32:29.095238064 +0000 2023-11-04T01:35:20.163 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: 2023-11-04 01:32:29.095238064 +0000 2023-11-04T01:35:20.163 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-04T01:35:20.230 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records in 2023-11-04T01:35:20.230 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records out 2023-11-04T01:35:20.230 INFO:teuthology.orchestra.run.smithi141.stderr:512 bytes copied, 0.000203031 s, 2.5 MB/s 2023-11-04T01:35:20.230 DEBUG:teuthology.orchestra.run.smithi141:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-04T01:35:20.286 DEBUG:teuthology.orchestra.run.smithi141:> stat /dev/vg_nvme/lv_2 2023-11-04T01:35:20.342 INFO:teuthology.orchestra.run.smithi141.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-04T01:35:20.342 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:35:20.342 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-11-04T01:35:20.342 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:35:20.342 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:35:20.342 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 2023-11-04 01:35:09.919897135 +0000 2023-11-04T01:35:20.342 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2023-11-04 01:32:30.205214206 +0000 2023-11-04T01:35:20.342 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2023-11-04 01:32:30.205214206 +0000 2023-11-04T01:35:20.343 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: 2023-11-04 01:32:30.205214206 +0000 2023-11-04T01:35:20.343 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-04T01:35:20.408 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records in 2023-11-04T01:35:20.408 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records out 2023-11-04T01:35:20.408 INFO:teuthology.orchestra.run.smithi141.stderr:512 bytes copied, 0.000238129 s, 2.2 MB/s 2023-11-04T01:35:20.409 DEBUG:teuthology.orchestra.run.smithi141:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-04T01:35:20.471 DEBUG:teuthology.orchestra.run.smithi141:> stat /dev/vg_nvme/lv_3 2023-11-04T01:35:20.528 INFO:teuthology.orchestra.run.smithi141.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-04T01:35:20.529 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:35:20.529 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-11-04T01:35:20.529 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:35:20.529 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:35:20.529 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 2023-11-04 01:35:09.920897114 +0000 2023-11-04T01:35:20.529 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2023-11-04 01:32:31.580184651 +0000 2023-11-04T01:35:20.529 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2023-11-04 01:32:31.580184651 +0000 2023-11-04T01:35:20.529 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: 2023-11-04 01:32:31.580184651 +0000 2023-11-04T01:35:20.529 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-04T01:35:20.593 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records in 2023-11-04T01:35:20.593 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records out 2023-11-04T01:35:20.593 INFO:teuthology.orchestra.run.smithi141.stderr:512 bytes copied, 0.000207233 s, 2.5 MB/s 2023-11-04T01:35:20.594 DEBUG:teuthology.orchestra.run.smithi141:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-04T01:35:20.649 DEBUG:teuthology.orchestra.run.smithi141:> stat /dev/vg_nvme/lv_4 2023-11-04T01:35:20.705 INFO:teuthology.orchestra.run.smithi141.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-04T01:35:20.705 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:35:20.705 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 5h/5d Inode: 720 Links: 1 2023-11-04T01:35:20.705 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:35:20.705 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:35:20.706 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 2023-11-04 01:35:09.920897114 +0000 2023-11-04T01:35:20.706 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2023-11-04 01:32:32.840157568 +0000 2023-11-04T01:35:20.706 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2023-11-04 01:32:32.840157568 +0000 2023-11-04T01:35:20.706 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: 2023-11-04 01:32:32.840157568 +0000 2023-11-04T01:35:20.706 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-04T01:35:20.770 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records in 2023-11-04T01:35:20.771 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records out 2023-11-04T01:35:20.771 INFO:teuthology.orchestra.run.smithi141.stderr:512 bytes copied, 0.000162978 s, 3.1 MB/s 2023-11-04T01:35:20.772 DEBUG:teuthology.orchestra.run.smithi141:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-04T01:35:20.831 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:20.831 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi141.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-04T01:35:20.831 INFO:tasks.ceph:Generating config... 2023-11-04T01:35:20.832 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-04T01:35:20.833 INFO:tasks.ceph:[client] debug client = 20 2023-11-04T01:35:20.833 INFO:tasks.ceph:[client] debug ms = 1 2023-11-04T01:35:20.833 INFO:tasks.ceph:[client] pid file = 2023-11-04T01:35:20.833 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-04T01:35:20.833 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-04T01:35:20.833 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-04T01:35:20.833 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-04T01:35:20.833 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-04T01:35:20.833 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-04T01:35:20.833 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-04T01:35:20.833 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-04T01:35:20.833 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-04T01:35:20.834 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-04T01:35:20.834 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-04T01:35:20.834 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-04T01:35:20.834 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-04T01:35:20.834 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-04T01:35:20.834 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-04T01:35:20.834 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-04T01:35:20.834 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-04T01:35:20.834 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-04T01:35:20.834 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-04T01:35:20.834 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-04T01:35:20.834 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-04T01:35:20.834 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-04T01:35:20.835 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-04T01:35:20.835 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-04T01:35:20.835 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-04T01:35:20.835 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-04T01:35:20.835 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-04T01:35:20.835 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-04T01:35:20.835 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-04T01:35:20.835 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-04T01:35:20.835 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-04T01:35:20.835 INFO:tasks.ceph:Setting up mon.a... 2023-11-04T01:35:20.835 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-04T01:35:20.887 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.keyring 2023-11-04T01:35:20.892 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-04T01:35:20.936 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:35:20.963 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.114'), ('mon.b', '172.21.15.141'), ('mon.c', '[v2:172.21.15.141:3301,v1:172.21.15.141:6790]')] 2023-11-04T01:35:20.963 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.114,172.21.15.141,[v2:172.21.15.141:3301,v1:172.21.15.141:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-04T01:35:20.964 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:20.964 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-04T01:35:21.024 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.114 --add b 172.21.15.141 --addv c '[v2:172.21.15.141:3301,v1:172.21.15.141:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:21.108 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:21.108 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: generated fsid d683c50f-778a-409d-b3d8-acedf37b842d 2023-11-04T01:35:21.108 INFO:teuthology.orchestra.run.smithi114.stdout:setting min_mon_release = pacific 2023-11-04T01:35:21.109 INFO:teuthology.orchestra.run.smithi114.stdout:epoch 0 2023-11-04T01:35:21.109 INFO:teuthology.orchestra.run.smithi114.stdout:fsid d683c50f-778a-409d-b3d8-acedf37b842d 2023-11-04T01:35:21.109 INFO:teuthology.orchestra.run.smithi114.stdout:last_changed 2023-11-04T01:35:21.107633+0000 2023-11-04T01:35:21.109 INFO:teuthology.orchestra.run.smithi114.stdout:created 2023-11-04T01:35:21.107633+0000 2023-11-04T01:35:21.109 INFO:teuthology.orchestra.run.smithi114.stdout:min_mon_release 16 (pacific) 2023-11-04T01:35:21.109 INFO:teuthology.orchestra.run.smithi114.stdout:election_strategy: 1 2023-11-04T01:35:21.109 INFO:teuthology.orchestra.run.smithi114.stdout:0: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.a 2023-11-04T01:35:21.109 INFO:teuthology.orchestra.run.smithi114.stdout:1: [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] mon.b 2023-11-04T01:35:21.109 INFO:teuthology.orchestra.run.smithi114.stdout:2: [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] mon.c 2023-11-04T01:35:21.109 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-04T01:35:21.115 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-04T01:35:21.165 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d683c50f-778a-409d-b3d8-acedf37b842d... 2023-11-04T01:35:21.166 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:35:21.208 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:35:21.255 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2023-11-04T01:35:21.255 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2023-11-04T01:35:21.255 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:35:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2023-11-04T01:35:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2023-11-04T01:35:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2023-11-04T01:35:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2023-11-04T01:35:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2023-11-04T01:35:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2023-11-04T01:35:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2023-11-04T01:35:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:35:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2023-11-04T01:35:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:35:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:35:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2023-11-04T01:35:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2023-11-04T01:35:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2023-11-04T01:35:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:35:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:35:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2023-11-04T01:35:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:35:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2023-11-04T01:35:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:35:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:35:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2023-11-04T01:35:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:35:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2023-11-04T01:35:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2023-11-04T01:35:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2023-11-04T01:35:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2023-11-04T01:35:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2023-11-04T01:35:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = "172.21.15.114,172.21.15.141,[v2:172.21.15.141:3301,v1:172.21.15.141:6790]" 2023-11-04T01:35:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = d683c50f-778a-409d-b3d8-acedf37b842d 2023-11-04T01:35:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.259 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2023-11-04T01:35:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2023-11-04T01:35:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2023-11-04T01:35:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2023-11-04T01:35:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:35:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2023-11-04T01:35:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2023-11-04T01:35:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2023-11-04T01:35:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2023-11-04T01:35:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2023-11-04T01:35:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug trim objects = true 2023-11-04T01:35:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2023-11-04T01:35:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2023-11-04T01:35:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:35:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2023-11-04T01:35:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2023-11-04T01:35:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:35:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2023-11-04T01:35:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2023-11-04T01:35:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2023-11-04T01:35:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2023-11-04T01:35:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2023-11-04T01:35:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 20 2023-11-04T01:35:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 20 2023-11-04T01:35:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-11-04T01:35:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2023-11-04T01:35:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 10 2023-11-04T01:35:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:35:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2023-11-04T01:35:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:35:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:35:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2023-11-04T01:35:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2023-11-04T01:35:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.263 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2023-11-04T01:35:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-11-04T01:35:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2023-11-04T01:35:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2023-11-04T01:35:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2023-11-04T01:35:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:35:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:35:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2023-11-04T01:35:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.264 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2023-11-04T01:35:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-11-04T01:35:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2023-11-04T01:35:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2023-11-04T01:35:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2023-11-04T01:35:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2023-11-04T01:35:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2023-11-04T01:35:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:35:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2023-11-04T01:35:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2023-11-04T01:35:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:35:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:35:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:35:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:35:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:35:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:35:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:35:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2023-11-04T01:35:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:35:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:35:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: mon op complaint time = 120 2023-11-04T01:35:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:35:21.266 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2023-11-04T01:35:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2023-11-04T01:35:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2023-11-04T01:35:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2023-11-04T01:35:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:35:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:35:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: client mount timeout = 600 2023-11-04T01:35:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2023-11-04T01:35:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-11-04T01:35:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = "" 2023-11-04T01:35:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2023-11-04T01:35:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2023-11-04T01:35:21.267 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2023-11-04T01:35:21.267 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.b] 2023-11-04T01:35:21.267 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.c] 2023-11-04T01:35:21.267 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2023-11-04T01:35:21.267 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2023-11-04T01:35:21.267 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2023-11-04T01:35:21.267 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2023-11-04T01:35:21.267 INFO:teuthology.orchestra.run.smithi114.stdout:[mds] 2023-11-04T01:35:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds = 20 2023-11-04T01:35:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds balancer = 20 2023-11-04T01:35:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-11-04T01:35:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug frag = True 2023-11-04T01:35:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug scatterstat = True 2023-11-04T01:35:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: mds op complaint time = 180 2023-11-04T01:35:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: mds verify scatter = True 2023-11-04T01:35:21.272 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2023-11-04T01:35:21.272 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2023-11-04T01:35:21.273 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2023-11-04T01:35:21.274 INFO:teuthology.orchestra.run.smithi141.stdout:[global] 2023-11-04T01:35:21.275 INFO:teuthology.orchestra.run.smithi141.stdout: chdir = "" 2023-11-04T01:35:21.275 INFO:teuthology.orchestra.run.smithi141.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:35:21.275 INFO:teuthology.orchestra.run.smithi141.stdout: auth supported = cephx 2023-11-04T01:35:21.275 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.275 INFO:teuthology.orchestra.run.smithi141.stdout: filestore xattr use omap = true 2023-11-04T01:35:21.275 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.275 INFO:teuthology.orchestra.run.smithi141.stdout: mon clock drift allowed = 1.000 2023-11-04T01:35:21.275 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.275 INFO:teuthology.orchestra.run.smithi141.stdout: osd crush chooseleaf type = 0 2023-11-04T01:35:21.275 INFO:teuthology.orchestra.run.smithi141.stdout: auth debug = true 2023-11-04T01:35:21.275 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.275 INFO:teuthology.orchestra.run.smithi141.stdout: ms die on old message = true 2023-11-04T01:35:21.276 INFO:teuthology.orchestra.run.smithi141.stdout: ms die on bug = true 2023-11-04T01:35:21.276 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.276 INFO:teuthology.orchestra.run.smithi141.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:35:21.276 INFO:teuthology.orchestra.run.smithi141.stdout: mon pg warn max object skew = 0 2023-11-04T01:35:21.276 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.276 INFO:teuthology.orchestra.run.smithi141.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:35:21.276 INFO:teuthology.orchestra.run.smithi141.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:35:21.276 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.276 INFO:teuthology.orchestra.run.smithi141.stdout: osd pool default size = 2 2023-11-04T01:35:21.276 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.276 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd allow primary affinity = true 2023-11-04T01:35:21.276 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd allow pg remap = true 2023-11-04T01:35:21.277 INFO:teuthology.orchestra.run.smithi141.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:35:21.277 INFO:teuthology.orchestra.run.smithi141.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:35:21.277 INFO:teuthology.orchestra.run.smithi141.stdout: mon warn on no sortbitwise = false 2023-11-04T01:35:21.277 INFO:teuthology.orchestra.run.smithi141.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:35:21.277 INFO:teuthology.orchestra.run.smithi141.stdout: mon warn on too few osds = false 2023-11-04T01:35:21.278 INFO:teuthology.orchestra.run.smithi141.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:35:21.278 INFO:teuthology.orchestra.run.smithi141.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:35:21.278 INFO:teuthology.orchestra.run.smithi141.stdout: mon_allow_pool_size_one = true 2023-11-04T01:35:21.279 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.279 INFO:teuthology.orchestra.run.smithi141.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:35:21.279 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.280 INFO:teuthology.orchestra.run.smithi141.stdout: osd default data pool replay window = 5 2023-11-04T01:35:21.280 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.280 INFO:teuthology.orchestra.run.smithi141.stdout: mon allow pool delete = true 2023-11-04T01:35:21.280 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.280 INFO:teuthology.orchestra.run.smithi141.stdout: mon cluster log file level = debug 2023-11-04T01:35:21.280 INFO:teuthology.orchestra.run.smithi141.stdout: debug asserts on shutdown = true 2023-11-04T01:35:21.280 INFO:teuthology.orchestra.run.smithi141.stdout: mon health detail to clog = false 2023-11-04T01:35:21.280 INFO:teuthology.orchestra.run.smithi141.stdout: mon host = "172.21.15.114,172.21.15.141,[v2:172.21.15.141:3301,v1:172.21.15.141:6790]" 2023-11-04T01:35:21.280 INFO:teuthology.orchestra.run.smithi141.stdout: fsid = d683c50f-778a-409d-b3d8-acedf37b842d 2023-11-04T01:35:21.280 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.280 INFO:teuthology.orchestra.run.smithi141.stdout:[osd] 2023-11-04T01:35:21.280 INFO:teuthology.orchestra.run.smithi141.stdout: osd journal size = 100 2023-11-04T01:35:21.281 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.281 INFO:teuthology.orchestra.run.smithi141.stdout: osd scrub load threshold = 5.0 2023-11-04T01:35:21.281 INFO:teuthology.orchestra.run.smithi141.stdout: osd scrub max interval = 600 2023-11-04T01:35:21.281 INFO:teuthology.orchestra.run.smithi141.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:35:21.281 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.281 INFO:teuthology.orchestra.run.smithi141.stdout: osd recover clone overlap = true 2023-11-04T01:35:21.281 INFO:teuthology.orchestra.run.smithi141.stdout: osd recovery max chunk = 1048576 2023-11-04T01:35:21.282 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.282 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug shutdown = true 2023-11-04T01:35:21.283 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug op order = true 2023-11-04T01:35:21.283 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug verify stray on activate = true 2023-11-04T01:35:21.283 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug trim objects = true 2023-11-04T01:35:21.283 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.283 INFO:teuthology.orchestra.run.smithi141.stdout: osd open classes on start = true 2023-11-04T01:35:21.283 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug pg log writeout = true 2023-11-04T01:35:21.283 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.283 INFO:teuthology.orchestra.run.smithi141.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:35:21.283 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.283 INFO:teuthology.orchestra.run.smithi141.stdout: osd map max advance = 10 2023-11-04T01:35:21.283 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.283 INFO:teuthology.orchestra.run.smithi141.stdout: journal zero on create = true 2023-11-04T01:35:21.283 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.283 INFO:teuthology.orchestra.run.smithi141.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:35:21.284 INFO:teuthology.orchestra.run.smithi141.stdout: filestore apply finisher threads = 3 2023-11-04T01:35:21.284 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.284 INFO:teuthology.orchestra.run.smithi141.stdout: bdev debug aio = true 2023-11-04T01:35:21.284 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug misdirected ops = true 2023-11-04T01:35:21.284 INFO:teuthology.orchestra.run.smithi141.stdout: bluestore block size = 96636764160 2023-11-04T01:35:21.284 INFO:teuthology.orchestra.run.smithi141.stdout: bluestore fsck on mount = True 2023-11-04T01:35:21.284 INFO:teuthology.orchestra.run.smithi141.stdout: debug bluefs = 20 2023-11-04T01:35:21.284 INFO:teuthology.orchestra.run.smithi141.stdout: debug bluestore = 20 2023-11-04T01:35:21.285 INFO:teuthology.orchestra.run.smithi141.stdout: debug ms = 1 2023-11-04T01:35:21.285 INFO:teuthology.orchestra.run.smithi141.stdout: debug osd = 20 2023-11-04T01:35:21.285 INFO:teuthology.orchestra.run.smithi141.stdout: debug rocksdb = 10 2023-11-04T01:35:21.285 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:35:21.285 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd full ratio = 0.9 2023-11-04T01:35:21.285 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:35:21.285 INFO:teuthology.orchestra.run.smithi141.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:35:21.285 INFO:teuthology.orchestra.run.smithi141.stdout: osd objectstore = bluestore 2023-11-04T01:35:21.285 INFO:teuthology.orchestra.run.smithi141.stdout: osd op complaint time = 180 2023-11-04T01:35:21.285 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.285 INFO:teuthology.orchestra.run.smithi141.stdout:[mgr] 2023-11-04T01:35:21.285 INFO:teuthology.orchestra.run.smithi141.stdout: debug ms = 1 2023-11-04T01:35:21.285 INFO:teuthology.orchestra.run.smithi141.stdout: debug mgr = 20 2023-11-04T01:35:21.285 INFO:teuthology.orchestra.run.smithi141.stdout: debug mon = 20 2023-11-04T01:35:21.286 INFO:teuthology.orchestra.run.smithi141.stdout: debug auth = 20 2023-11-04T01:35:21.286 INFO:teuthology.orchestra.run.smithi141.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:35:21.286 INFO:teuthology.orchestra.run.smithi141.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:35:21.286 INFO:teuthology.orchestra.run.smithi141.stdout: mgr/telemetry/nag = false 2023-11-04T01:35:21.286 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.286 INFO:teuthology.orchestra.run.smithi141.stdout:[mon] 2023-11-04T01:35:21.286 INFO:teuthology.orchestra.run.smithi141.stdout: debug ms = 1 2023-11-04T01:35:21.286 INFO:teuthology.orchestra.run.smithi141.stdout: debug mon = 20 2023-11-04T01:35:21.286 INFO:teuthology.orchestra.run.smithi141.stdout: debug paxos = 20 2023-11-04T01:35:21.286 INFO:teuthology.orchestra.run.smithi141.stdout: debug auth = 20 2023-11-04T01:35:21.286 INFO:teuthology.orchestra.run.smithi141.stdout: mon data avail warn = 5 2023-11-04T01:35:21.286 INFO:teuthology.orchestra.run.smithi141.stdout: mon mgr mkfs grace = 240 2023-11-04T01:35:21.286 INFO:teuthology.orchestra.run.smithi141.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:35:21.287 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd reporter subtree level = osd 2023-11-04T01:35:21.287 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd prime pg temp = true 2023-11-04T01:35:21.287 INFO:teuthology.orchestra.run.smithi141.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:35:21.287 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.287 INFO:teuthology.orchestra.run.smithi141.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:35:21.287 INFO:teuthology.orchestra.run.smithi141.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:35:21.287 INFO:teuthology.orchestra.run.smithi141.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:35:21.287 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.288 INFO:teuthology.orchestra.run.smithi141.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:35:21.288 INFO:teuthology.orchestra.run.smithi141.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:35:21.288 INFO:teuthology.orchestra.run.smithi141.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:35:21.288 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.288 INFO:teuthology.orchestra.run.smithi141.stdout: # 1m isn't quite enough 2023-11-04T01:35:21.288 INFO:teuthology.orchestra.run.smithi141.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:35:21.288 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.289 INFO:teuthology.orchestra.run.smithi141.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:35:21.289 INFO:teuthology.orchestra.run.smithi141.stdout: mon op complaint time = 120 2023-11-04T01:35:21.290 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:35:21.290 INFO:teuthology.orchestra.run.smithi141.stdout:[client] 2023-11-04T01:35:21.290 INFO:teuthology.orchestra.run.smithi141.stdout: rgw cache enabled = true 2023-11-04T01:35:21.290 INFO:teuthology.orchestra.run.smithi141.stdout: rgw enable ops log = true 2023-11-04T01:35:21.290 INFO:teuthology.orchestra.run.smithi141.stdout: rgw enable usage log = true 2023-11-04T01:35:21.290 INFO:teuthology.orchestra.run.smithi141.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:35:21.290 INFO:teuthology.orchestra.run.smithi141.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:35:21.291 INFO:teuthology.orchestra.run.smithi141.stdout: client mount timeout = 600 2023-11-04T01:35:21.291 INFO:teuthology.orchestra.run.smithi141.stdout: debug client = 20 2023-11-04T01:35:21.291 INFO:teuthology.orchestra.run.smithi141.stdout: debug ms = 1 2023-11-04T01:35:21.291 INFO:teuthology.orchestra.run.smithi141.stdout: pid file = "" 2023-11-04T01:35:21.291 INFO:teuthology.orchestra.run.smithi141.stdout: rados mon op timeout = 900 2023-11-04T01:35:21.291 INFO:teuthology.orchestra.run.smithi141.stdout: rados osd op timeout = 900 2023-11-04T01:35:21.291 INFO:teuthology.orchestra.run.smithi141.stdout:[mon.a] 2023-11-04T01:35:21.291 INFO:teuthology.orchestra.run.smithi141.stdout:[mon.b] 2023-11-04T01:35:21.291 INFO:teuthology.orchestra.run.smithi141.stdout:[mon.c] 2023-11-04T01:35:21.291 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.a] 2023-11-04T01:35:21.291 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.c] 2023-11-04T01:35:21.291 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.b] 2023-11-04T01:35:21.291 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.d] 2023-11-04T01:35:21.291 INFO:teuthology.orchestra.run.smithi141.stdout:[mds] 2023-11-04T01:35:21.292 INFO:teuthology.orchestra.run.smithi141.stdout: debug mds = 20 2023-11-04T01:35:21.292 INFO:teuthology.orchestra.run.smithi141.stdout: debug mds balancer = 20 2023-11-04T01:35:21.292 INFO:teuthology.orchestra.run.smithi141.stdout: debug ms = 1 2023-11-04T01:35:21.292 INFO:teuthology.orchestra.run.smithi141.stdout: mds debug frag = True 2023-11-04T01:35:21.292 INFO:teuthology.orchestra.run.smithi141.stdout: mds debug scatterstat = True 2023-11-04T01:35:21.292 INFO:teuthology.orchestra.run.smithi141.stdout: mds op complaint time = 180 2023-11-04T01:35:21.292 INFO:teuthology.orchestra.run.smithi141.stdout: mds verify scatter = True 2023-11-04T01:35:21.292 INFO:teuthology.orchestra.run.smithi141.stdout: osd op complaint time = 180 2023-11-04T01:35:21.292 INFO:teuthology.orchestra.run.smithi141.stdout: rados mon op timeout = 900 2023-11-04T01:35:21.292 INFO:teuthology.orchestra.run.smithi141.stdout: rados osd op timeout = 900 2023-11-04T01:35:21.293 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-04T01:35:21.293 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-04T01:35:21.348 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-04T01:35:21.348 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:21.348 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-04T01:35:21.363 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:21.363 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-04T01:35:21.418 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:35:21.418 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:21.418 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-04T01:35:21.418 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:35:21.496 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:21.496 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:21.555 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:35:21.555 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:21.555 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-04T01:35:21.555 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:35:21.594 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:21.594 DEBUG:teuthology.orchestra.run.smithi141:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:21.650 INFO:tasks.ceph:Setting up mon nodes... 2023-11-04T01:35:21.650 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-04T01:35:21.650 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-04T01:35:21.705 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-04T01:35:21.707 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-04T01:35:21.781 INFO:teuthology.orchestra.run.smithi141.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-04T01:35:21.783 INFO:tasks.ceph:Setting up mds nodes... 2023-11-04T01:35:21.784 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-04T01:35:21.838 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-04T01:35:21.840 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-04T01:35:21.866 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-04T01:35:21.964 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-04T01:35:21.965 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-04T01:35:21.991 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-04T01:35:22.045 INFO:teuthology.orchestra.run.smithi141.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-04T01:35:22.048 DEBUG:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-04T01:35:22.074 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-04T01:35:22.168 INFO:teuthology.orchestra.run.smithi141.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-04T01:35:22.170 DEBUG:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-04T01:35:22.201 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-04T01:35:22.201 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-04T01:35:22.249 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-04T01:35:22.264 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-04T01:35:22.347 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-04T01:35:22.362 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-04T01:35:22.406 INFO:teuthology.orchestra.run.smithi141.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-04T01:35:22.419 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-04T01:35:22.506 INFO:teuthology.orchestra.run.smithi141.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-04T01:35:22.517 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-04T01:35:22.517 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi141.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-04T01:35:22.518 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-04T01:35:22.544 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:22.544 INFO:tasks.ceph:role: osd.0 2023-11-04T01:35:22.544 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:35:22.545 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-04T01:35:22.618 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:22.618 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:22.618 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:22.618 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:22.619 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:22.619 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:22.619 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:22.619 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:22.619 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:22.619 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:23.132 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2023-11-04T01:35:23.135 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2023-11-04T01:35:23.135 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-04T01:35:23.262 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-04T01:35:23.304 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-04T01:35:23.373 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:23.374 INFO:tasks.ceph:role: osd.1 2023-11-04T01:35:23.374 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:35:23.374 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-04T01:35:23.449 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:23.450 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:23.450 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:23.450 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:23.450 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:23.450 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:23.450 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:23.450 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:23.450 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:23.450 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:23.901 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2023-11-04T01:35:23.904 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2023-11-04T01:35:23.904 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-04T01:35:24.006 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-04T01:35:24.041 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-04T01:35:24.111 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:24.111 INFO:tasks.ceph:role: osd.2 2023-11-04T01:35:24.111 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:35:24.111 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-04T01:35:24.188 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:24.188 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:24.188 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:24.188 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:24.188 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:24.189 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:24.189 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:24.189 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:24.189 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:24.189 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:24.682 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2023-11-04T01:35:24.683 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2023-11-04T01:35:24.683 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-04T01:35:24.836 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-04T01:35:24.872 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-04T01:35:24.943 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:24.943 INFO:tasks.ceph:role: osd.3 2023-11-04T01:35:24.943 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:35:24.944 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-04T01:35:25.020 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:25.020 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:25.020 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:25.020 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:25.020 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:25.020 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:25.020 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:25.021 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:25.021 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:25.021 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:25.535 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2023-11-04T01:35:25.535 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2023-11-04T01:35:25.535 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-04T01:35:25.670 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-04T01:35:25.707 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:25.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:25.814+0000 7fd6c35e0500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-04T01:35:25.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:25.815+0000 7fd6c35e0500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-04T01:35:25.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:25.815+0000 7fd6c35e0500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:35:25.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:25.815+0000 7fd6c35e0500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:35:25.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:25.815+0000 7fd6c35e0500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:35:25.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:25.815+0000 7fd6c35e0500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-04T01:35:28.677 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-04T01:35:28.708 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:28.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:28.796+0000 7f274c0c7500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-04T01:35:28.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:28.796+0000 7f274c0c7500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-04T01:35:28.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:28.796+0000 7f274c0c7500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:35:28.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:28.796+0000 7f274c0c7500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:35:28.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:28.796+0000 7f274c0c7500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:35:28.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:28.797+0000 7f274c0c7500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-04T01:35:31.644 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-04T01:35:31.676 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:31.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:31.766+0000 7fdb50814500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-04T01:35:31.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:31.767+0000 7fdb50814500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-04T01:35:31.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:31.767+0000 7fdb50814500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:35:31.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:31.767+0000 7fdb50814500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:35:31.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:31.767+0000 7fdb50814500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:35:31.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:31.767+0000 7fdb50814500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-04T01:35:34.614 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-04T01:35:34.645 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:34.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:34.732+0000 7f9e7d812500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-04T01:35:34.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:34.733+0000 7f9e7d812500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-04T01:35:34.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:34.733+0000 7f9e7d812500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:35:34.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:34.733+0000 7f9e7d812500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:35:34.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:34.733+0000 7f9e7d812500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:35:34.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:34.733+0000 7f9e7d812500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-04T01:35:37.587 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-04T01:35:37.618 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-04T01:35:37.649 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:37.650 INFO:tasks.ceph:role: osd.4 2023-11-04T01:35:37.650 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:35:37.650 DEBUG:teuthology.orchestra.run.smithi141:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-04T01:35:37.727 INFO:teuthology.orchestra.run.smithi141.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:37.727 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:37.727 INFO:teuthology.orchestra.run.smithi141.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:37.728 INFO:teuthology.orchestra.run.smithi141.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:37.728 INFO:teuthology.orchestra.run.smithi141.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:37.728 INFO:teuthology.orchestra.run.smithi141.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:37.728 INFO:teuthology.orchestra.run.smithi141.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:37.728 INFO:teuthology.orchestra.run.smithi141.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:37.728 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:37.728 INFO:teuthology.orchestra.run.smithi141.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:38.237 INFO:teuthology.orchestra.run.smithi141.stdout:Discarding blocks...Done. 2023-11-04T01:35:38.239 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi141.front.sepia.ceph.com -o noatime 2023-11-04T01:35:38.239 DEBUG:teuthology.orchestra.run.smithi141:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-04T01:35:38.348 DEBUG:teuthology.orchestra.run.smithi141:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-04T01:35:38.381 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-04T01:35:38.449 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:38.449 INFO:tasks.ceph:role: osd.5 2023-11-04T01:35:38.449 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:35:38.450 DEBUG:teuthology.orchestra.run.smithi141:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-04T01:35:38.527 INFO:teuthology.orchestra.run.smithi141.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:38.529 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:38.529 INFO:teuthology.orchestra.run.smithi141.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:38.529 INFO:teuthology.orchestra.run.smithi141.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:38.529 INFO:teuthology.orchestra.run.smithi141.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:38.529 INFO:teuthology.orchestra.run.smithi141.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:38.529 INFO:teuthology.orchestra.run.smithi141.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:38.529 INFO:teuthology.orchestra.run.smithi141.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:38.530 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:38.530 INFO:teuthology.orchestra.run.smithi141.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:38.981 INFO:teuthology.orchestra.run.smithi141.stdout:Discarding blocks...Done. 2023-11-04T01:35:38.983 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi141.front.sepia.ceph.com -o noatime 2023-11-04T01:35:38.983 DEBUG:teuthology.orchestra.run.smithi141:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-04T01:35:39.069 DEBUG:teuthology.orchestra.run.smithi141:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-04T01:35:39.100 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-04T01:35:39.168 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:39.168 INFO:tasks.ceph:role: osd.6 2023-11-04T01:35:39.168 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:35:39.168 DEBUG:teuthology.orchestra.run.smithi141:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-04T01:35:39.242 INFO:teuthology.orchestra.run.smithi141.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:39.243 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:39.243 INFO:teuthology.orchestra.run.smithi141.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:39.243 INFO:teuthology.orchestra.run.smithi141.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:39.243 INFO:teuthology.orchestra.run.smithi141.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:39.243 INFO:teuthology.orchestra.run.smithi141.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:39.243 INFO:teuthology.orchestra.run.smithi141.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:39.243 INFO:teuthology.orchestra.run.smithi141.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:39.243 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:39.243 INFO:teuthology.orchestra.run.smithi141.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:39.731 INFO:teuthology.orchestra.run.smithi141.stdout:Discarding blocks...Done. 2023-11-04T01:35:39.733 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi141.front.sepia.ceph.com -o noatime 2023-11-04T01:35:39.733 DEBUG:teuthology.orchestra.run.smithi141:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-04T01:35:39.882 DEBUG:teuthology.orchestra.run.smithi141:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-04T01:35:39.915 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-04T01:35:39.987 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:35:39.987 INFO:tasks.ceph:role: osd.7 2023-11-04T01:35:39.987 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:35:39.987 DEBUG:teuthology.orchestra.run.smithi141:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-04T01:35:40.065 INFO:teuthology.orchestra.run.smithi141.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:35:40.065 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:35:40.065 INFO:teuthology.orchestra.run.smithi141.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:35:40.065 INFO:teuthology.orchestra.run.smithi141.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:35:40.065 INFO:teuthology.orchestra.run.smithi141.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:35:40.065 INFO:teuthology.orchestra.run.smithi141.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:35:40.065 INFO:teuthology.orchestra.run.smithi141.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:35:40.066 INFO:teuthology.orchestra.run.smithi141.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:35:40.066 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:35:40.066 INFO:teuthology.orchestra.run.smithi141.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:35:40.581 INFO:teuthology.orchestra.run.smithi141.stdout:Discarding blocks...Done. 2023-11-04T01:35:40.582 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi141.front.sepia.ceph.com -o noatime 2023-11-04T01:35:40.582 DEBUG:teuthology.orchestra.run.smithi141:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-04T01:35:40.718 DEBUG:teuthology.orchestra.run.smithi141:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-04T01:35:40.752 DEBUG:teuthology.orchestra.run.smithi141:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:40.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:40.845+0000 7f3ed202b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-04T01:35:40.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:40.845+0000 7f3ed202b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-04T01:35:40.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:40.845+0000 7f3ed202b500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:35:40.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:40.845+0000 7f3ed202b500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:35:40.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:40.845+0000 7f3ed202b500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:35:40.847 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:40.845+0000 7f3ed202b500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-04T01:35:43.701 DEBUG:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-04T01:35:43.732 DEBUG:teuthology.orchestra.run.smithi141:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:43.825 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:43.821+0000 7fd3c7eb2500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-04T01:35:43.825 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:43.821+0000 7fd3c7eb2500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-04T01:35:43.825 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:43.821+0000 7fd3c7eb2500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:35:43.825 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:43.821+0000 7fd3c7eb2500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:35:43.825 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:43.821+0000 7fd3c7eb2500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:35:43.825 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:43.822+0000 7fd3c7eb2500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-04T01:35:46.680 DEBUG:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-04T01:35:46.711 DEBUG:teuthology.orchestra.run.smithi141:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:46.804 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:46.802+0000 7f93e400f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-04T01:35:46.804 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:46.802+0000 7f93e400f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-04T01:35:46.804 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:46.802+0000 7f93e400f500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:35:46.804 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:46.802+0000 7f93e400f500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:35:46.804 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:46.802+0000 7f93e400f500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:35:46.805 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:46.803+0000 7f93e400f500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-04T01:35:49.225 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:35:49.228 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:35:49.659 DEBUG:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-04T01:35:49.688 DEBUG:teuthology.orchestra.run.smithi141:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:49.776 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:49.774+0000 7f64b8814500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-04T01:35:49.776 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:49.774+0000 7f64b8814500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-04T01:35:49.776 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:49.774+0000 7f64b8814500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:35:49.776 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:49.774+0000 7f64b8814500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:35:49.777 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:49.774+0000 7f64b8814500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:35:49.777 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:35:49.775+0000 7f64b8814500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-04T01:35:52.640 DEBUG:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-04T01:35:52.671 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-04T01:35:52.672 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:52.672 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-04T01:35:52.704 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:52.705 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-04T01:35:52.776 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:52.776 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-04T01:35:52.850 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:52.850 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-04T01:35:52.922 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:52.922 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-04T01:35:52.991 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:52.991 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-04T01:35:53.060 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:53.060 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-04T01:35:53.128 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:53.128 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-04T01:35:53.160 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:53.160 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-04T01:35:53.231 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:53.231 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-04T01:35:53.302 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:53.302 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-04T01:35:53.370 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:53.372 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-04T01:35:53.443 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:53.443 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-04T01:35:53.511 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:53.511 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-04T01:35:53.578 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:53.578 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-04T01:35:53.600 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:35:53.600 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-04T01:35:53.656 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:53.656 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-04T01:35:53.675 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:35:53.675 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-04T01:35:53.730 INFO:tasks.ceph:Adding keys to all mons... 2023-11-04T01:35:53.730 DEBUG:teuthology.orchestra.run.smithi114:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-04T01:35:53.733 DEBUG:teuthology.orchestra.run.smithi141:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-04T01:35:53.773 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.y] 2023-11-04T01:35:53.773 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDZn0VluGn6KRAAHsThhoAbKIz+kqF2DYyvkg== 2023-11-04T01:35:53.774 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2023-11-04T01:35:53.774 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDZn0VlswblMRAAotQqAxFKxonbXL/aDdoEPw== 2023-11-04T01:35:53.774 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2023-11-04T01:35:53.774 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDZn0VlUsc9ORAAmZhkDVK2hR4wbky+cLfo+A== 2023-11-04T01:35:53.774 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.0] 2023-11-04T01:35:53.774 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDdn0Vl/xmgMBAANQCw5RUd/IlxHaDvCz2Gbg== 2023-11-04T01:35:53.774 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.1] 2023-11-04T01:35:53.774 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDgn0VlTpuDLxAAf5vdQMiWBcLfx0Vf8Petyg== 2023-11-04T01:35:53.774 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.2] 2023-11-04T01:35:53.774 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDjn0VlZonFLRAAHJMf/0DasOCeOrz4u8uV2w== 2023-11-04T01:35:53.775 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.3] 2023-11-04T01:35:53.775 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDmn0VlLKK7KxAAKJzogyZTtMzEtAL+LL1V0w== 2023-11-04T01:35:53.775 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.x] 2023-11-04T01:35:53.775 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDZn0Vlb1WELhAAcUQ6WxKBsUeJfXvaE+h0GQ== 2023-11-04T01:35:53.775 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2023-11-04T01:35:53.775 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDan0VluZGwAhAAZPVNOe2pR5yFwajeNFbXzw== 2023-11-04T01:35:53.775 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2023-11-04T01:35:53.775 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDan0VlfxP9CRAAQppp4Lmc1v2xMGYc/AD7pA== 2023-11-04T01:35:53.775 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.4] 2023-11-04T01:35:53.775 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDsn0VlLitpMhAA6ow9uVmS5YtOnqSWSB66ww== 2023-11-04T01:35:53.775 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.5] 2023-11-04T01:35:53.775 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDvn0VlfkL/MBAA/LYWJLF7F12XMEICf18BwA== 2023-11-04T01:35:53.776 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.6] 2023-11-04T01:35:53.776 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDyn0Vl8ZrhLxAAKDbE5KvbWhguLsNNi+3duA== 2023-11-04T01:35:53.776 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.7] 2023-11-04T01:35:53.776 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQD1n0Vlues1LhAARQs1LLq8y63wl8nAs8GbGQ== 2023-11-04T01:35:53.776 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2023-11-04T01:35:53.776 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDan0Vl3QHODhAA6LWlhd+avWYsoYsWMbOiVA== 2023-11-04T01:35:53.776 INFO:teuthology.orchestra.run.smithi114.stdout:[client.2] 2023-11-04T01:35:53.778 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDan0VlgV6sFBAAxheFKb52kyZly4byr78vfw== 2023-11-04T01:35:53.778 INFO:teuthology.orchestra.run.smithi114.stdout:[client.1] 2023-11-04T01:35:53.778 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDan0VlRvgLGBAAAAhF9alG2eD5A/xjWXcVWA== 2023-11-04T01:35:53.779 INFO:teuthology.orchestra.run.smithi114.stdout:[client.3] 2023-11-04T01:35:53.779 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDan0VltiLUHRAAY0QtK328vB9H/l8FWCNB4g== 2023-11-04T01:35:53.796 INFO:teuthology.orchestra.run.smithi141.stdout:[mgr.y] 2023-11-04T01:35:53.796 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDZn0VluGn6KRAAHsThhoAbKIz+kqF2DYyvkg== 2023-11-04T01:35:53.796 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.a] 2023-11-04T01:35:53.796 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDZn0VlswblMRAAotQqAxFKxonbXL/aDdoEPw== 2023-11-04T01:35:53.796 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.c] 2023-11-04T01:35:53.797 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDZn0VlUsc9ORAAmZhkDVK2hR4wbky+cLfo+A== 2023-11-04T01:35:53.797 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.0] 2023-11-04T01:35:53.797 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDdn0Vl/xmgMBAANQCw5RUd/IlxHaDvCz2Gbg== 2023-11-04T01:35:53.797 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.1] 2023-11-04T01:35:53.797 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDgn0VlTpuDLxAAf5vdQMiWBcLfx0Vf8Petyg== 2023-11-04T01:35:53.797 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.2] 2023-11-04T01:35:53.797 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDjn0VlZonFLRAAHJMf/0DasOCeOrz4u8uV2w== 2023-11-04T01:35:53.797 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.3] 2023-11-04T01:35:53.797 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDmn0VlLKK7KxAAKJzogyZTtMzEtAL+LL1V0w== 2023-11-04T01:35:53.797 INFO:teuthology.orchestra.run.smithi141.stdout:[mgr.x] 2023-11-04T01:35:53.797 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDZn0Vlb1WELhAAcUQ6WxKBsUeJfXvaE+h0GQ== 2023-11-04T01:35:53.798 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.b] 2023-11-04T01:35:53.798 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDan0VluZGwAhAAZPVNOe2pR5yFwajeNFbXzw== 2023-11-04T01:35:53.798 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.d] 2023-11-04T01:35:53.798 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDan0VlfxP9CRAAQppp4Lmc1v2xMGYc/AD7pA== 2023-11-04T01:35:53.798 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.4] 2023-11-04T01:35:53.798 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDsn0VlLitpMhAA6ow9uVmS5YtOnqSWSB66ww== 2023-11-04T01:35:53.798 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.5] 2023-11-04T01:35:53.798 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDvn0VlfkL/MBAA/LYWJLF7F12XMEICf18BwA== 2023-11-04T01:35:53.798 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.6] 2023-11-04T01:35:53.799 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDyn0Vl8ZrhLxAAKDbE5KvbWhguLsNNi+3duA== 2023-11-04T01:35:53.799 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.7] 2023-11-04T01:35:53.799 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQD1n0Vlues1LhAARQs1LLq8y63wl8nAs8GbGQ== 2023-11-04T01:35:53.799 INFO:teuthology.orchestra.run.smithi141.stdout:[client.0] 2023-11-04T01:35:53.799 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDan0Vl3QHODhAA6LWlhd+avWYsoYsWMbOiVA== 2023-11-04T01:35:53.799 INFO:teuthology.orchestra.run.smithi141.stdout:[client.2] 2023-11-04T01:35:53.799 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDan0VlgV6sFBAAxheFKb52kyZly4byr78vfw== 2023-11-04T01:35:53.799 INFO:teuthology.orchestra.run.smithi141.stdout:[client.1] 2023-11-04T01:35:53.800 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDan0VlRvgLGBAAAAhF9alG2eD5A/xjWXcVWA== 2023-11-04T01:35:53.800 INFO:teuthology.orchestra.run.smithi141.stdout:[client.3] 2023-11-04T01:35:53.801 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQDan0VltiLUHRAAY0QtK328vB9H/l8FWCNB4g== 2023-11-04T01:35:53.802 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:35:53.823 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:35:53.893 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:53.896 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:53.952 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:53.954 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:54.008 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:54.016 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:54.068 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:54.071 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:54.122 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:54.125 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:54.176 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:54.178 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:54.235 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:35:54.239 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:35:54.295 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:54.298 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:54.352 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:54.354 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:35:54.409 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:54.412 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:54.463 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:54.465 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:54.523 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:54.531 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:54.583 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:54.585 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:35:54.637 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:54.663 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:54.718 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:54.720 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:54.775 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:54.777 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:54.835 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:54.840 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:35:54.897 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-04T01:35:54.897 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-04T01:35:54.927 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:35:55.023 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-04T01:35:55.050 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-04T01:35:55.078 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:35:55.176 DEBUG:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-04T01:35:55.202 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-04T01:35:55.269 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:35:55.366 DEBUG:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-04T01:35:55.393 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:55.396 DEBUG:teuthology.orchestra.run.smithi141:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:35:55.448 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-04T01:35:55.449 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-04T01:35:55.449 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-04T01:35:55.451 INFO:tasks.ceph.mon.a:Started 2023-11-04T01:35:55.451 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-04T01:35:55.451 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-04T01:35:55.495 INFO:tasks.ceph.mon.b:Started 2023-11-04T01:35:55.496 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-04T01:35:55.496 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-04T01:35:55.498 INFO:tasks.ceph.mon.c:Started 2023-11-04T01:35:55.498 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-04T01:35:55.498 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-04T01:35:55.498 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-04T01:35:55.500 INFO:tasks.ceph.mgr.y:Started 2023-11-04T01:35:55.501 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-04T01:35:55.501 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-04T01:35:55.513 INFO:tasks.ceph.mgr.x:Started 2023-11-04T01:35:55.513 INFO:tasks.ceph:Setting crush tunables to default 2023-11-04T01:35:55.513 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd crush tunables default 2023-11-04T01:35:55.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.615+0000 7f5d1d961640 1 Processor -- start 2023-11-04T01:35:55.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.615+0000 7f5d1d961640 1 -- start start 2023-11-04T01:35:55.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.616+0000 7f5d1d961640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 0x7f5d1806b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.616+0000 7f5d1d961640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 0x7f5d1815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:55.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.616+0000 7f5d1d961640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1806b170 con 0x7f5d181592c0 2023-11-04T01:35:55.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.616+0000 7f5d1d961640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1815de20 con 0x7f5d1815ce30 2023-11-04T01:35:55.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.616+0000 7f5d1d961640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1806bb40 con 0x7f5d1806d480 2023-11-04T01:35:55.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.616+0000 7f5d16ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5d181592c0 0x7f5d1806cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47596/0 (socket says 172.21.15.114:47596) 2023-11-04T01:35:55.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.616+0000 7f5d177fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 0x7f5d1815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.616+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 learned_addr learned my addr 172.21.15.114:0/3386636275 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:35:55.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.616+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 msgr2=0x7f5d1815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-04T01:35:55.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.616+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 msgr2=0x7f5d1815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:35:55.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.616+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 0x7f5d1815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:35:55.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.616+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 0x7f5d1815d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:35:55.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.616+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 0x7f5d1806b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.617+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 msgr2=0x7f5d1806b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:35:55.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.617+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 msgr2=0x7f5d1806b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:35:55.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.617+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 0x7f5d1806b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:35:55.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.617+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 0x7f5d1806b600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:35:55.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.817+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 0x7f5d1815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.817+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 msgr2=0x7f5d1815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:35:55.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.817+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 msgr2=0x7f5d1815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:35:55.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.817+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 0x7f5d1815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:35:55.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.817+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 0x7f5d1815d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:35:55.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.818+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 0x7f5d1806b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:55.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.818+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 msgr2=0x7f5d1806b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:35:55.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.818+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 msgr2=0x7f5d1806b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:35:55.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.818+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 0x7f5d1806b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:35:55.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:55.818+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 0x7f5d1806b600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:35:56.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:56.218+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 0x7f5d1815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:56.218+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 msgr2=0x7f5d1815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:35:56.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:56.218+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 msgr2=0x7f5d1815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:35:56.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:56.218+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 0x7f5d1815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:35:56.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:56.218+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 0x7f5d1815d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:35:56.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:56.219+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 0x7f5d1806b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:56.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:56.219+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 msgr2=0x7f5d1806b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:35:56.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:56.219+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 msgr2=0x7f5d1806b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:35:56.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:56.219+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 0x7f5d1806b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:35:56.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:56.219+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 0x7f5d1806b600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:35:57.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:57.019+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 0x7f5d1815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:57.019+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 msgr2=0x7f5d1815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:35:57.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:57.019+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 msgr2=0x7f5d1815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:35:57.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:57.019+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 0x7f5d1815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:35:57.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:57.019+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 0x7f5d1815d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:35:57.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:57.020+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 0x7f5d1806b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:57.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:57.020+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 msgr2=0x7f5d1806b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:35:57.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:57.020+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 msgr2=0x7f5d1806b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:35:57.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:57.020+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 0x7f5d1806b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:35:57.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:57.020+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 0x7f5d1806b600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:35:58.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.617+0000 7f5d14ff9640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 msgr2=0x7f5d1806b600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:35:58.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.617+0000 7f5d14ff9640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d1806d480 0x7f5d1806b600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.617+0000 7f5d14ff9640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 msgr2=0x7f5d1815d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:35:58.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.617+0000 7f5d14ff9640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d1815ce30 0x7f5d1815d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:35:58.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.617+0000 7f5d14ff9640 1 -- 172.21.15.114:0/3386636275 >> v1:172.21.15.114:6789/0 conn(0x7f5d181592c0 legacy=0x7f5d1806cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:35:58.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.617+0000 7f5d14ff9640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 0x7f5d04005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:35:58.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.617+0000 7f5d14ff9640 1 -- 172.21.15.114:0/3386636275 --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d181596a0 con 0x7f5d04006170 2023-11-04T01:35:58.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.617+0000 7f5d14ff9640 1 -- 172.21.15.114:0/3386636275 --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1815de20 con 0x7f5d040036e0 2023-11-04T01:35:58.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.617+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 0x7f5d04005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.617+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 msgr2=0x7f5d04005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:35:58.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.617+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 msgr2=0x7f5d04005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:35:58.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.617+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 0x7f5d04005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:35:58.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.617+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 0x7f5d04005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:35:58.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.818+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 0x7f5d04005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:58.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.818+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 msgr2=0x7f5d04005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:35:58.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.818+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 msgr2=0x7f5d04005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:35:58.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.818+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 0x7f5d04005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:35:58.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:58.818+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 0x7f5d04005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:35:59.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:59.219+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 0x7f5d04005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:35:59.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:59.219+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 msgr2=0x7f5d04005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:35:59.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:59.219+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 msgr2=0x7f5d04005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:35:59.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:59.219+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 0x7f5d04005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:35:59.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:35:59.219+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 0x7f5d04005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:36:00.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:00.020+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 0x7f5d04005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:00.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:00.020+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 msgr2=0x7f5d04005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:36:00.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:00.020+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 msgr2=0x7f5d04005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:36:00.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:00.020+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 0x7f5d04005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:36:00.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:00.020+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 0x7f5d04005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:36:01.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d14ff9640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 msgr2=0x7f5d04005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:36:01.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d14ff9640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d040036e0 0x7f5d04005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:01.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d14ff9640 1 -- 172.21.15.114:0/3386636275 >> v1:172.21.15.141:6789/0 conn(0x7f5d04006170 legacy=0x7f5d04008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:01.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d14ff9640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 0x7f5d0400a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:01.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 reap_dead start 2023-11-04T01:36:01.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d14ff9640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 0x7f5d0400f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:01.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d14ff9640 1 -- 172.21.15.114:0/3386636275 --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d0400d180 con 0x7f5d0400a9a0 2023-11-04T01:36:01.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d14ff9640 1 -- 172.21.15.114:0/3386636275 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1815de20 con 0x7f5d04003ba0 2023-11-04T01:36:01.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d14ff9640 1 -- 172.21.15.114:0/3386636275 --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1806bb40 con 0x7f5d04009fb0 2023-11-04T01:36:01.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 0x7f5d0400f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:01.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 0x7f5d0400a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:01.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 msgr2=0x7f5d0400f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-04T01:36:01.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 msgr2=0x7f5d0400f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:36:01.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 0x7f5d0400f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:36:01.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 msgr2=0x7f5d0400a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:36:01.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 msgr2=0x7f5d0400a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:36:01.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 0x7f5d0400a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:36:01.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 0x7f5d0400f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:36:01.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.617+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 0x7f5d0400a390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:36:01.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.818+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 0x7f5d0400f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:01.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.818+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 0x7f5d0400a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:01.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.818+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 msgr2=0x7f5d0400f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:36:01.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.818+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 msgr2=0x7f5d0400f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:36:01.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.818+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 0x7f5d0400f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:36:01.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.818+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 0x7f5d0400f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:36:01.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.818+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 msgr2=0x7f5d0400a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-04T01:36:01.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.818+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 msgr2=0x7f5d0400a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:36:01.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.818+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 0x7f5d0400a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:36:01.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:01.818+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 0x7f5d0400a390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:36:02.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:02.219+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 0x7f5d0400f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:02.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:02.219+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 msgr2=0x7f5d0400f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:36:02.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:02.219+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 msgr2=0x7f5d0400f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:36:02.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:02.219+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 0x7f5d0400f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:36:02.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:02.219+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 0x7f5d0400f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:36:02.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:02.219+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 0x7f5d0400a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:02.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:02.219+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 msgr2=0x7f5d0400a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-04T01:36:02.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:02.219+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 msgr2=0x7f5d0400a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:36:02.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:02.219+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 0x7f5d0400a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:36:02.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:02.219+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 0x7f5d0400a390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:36:03.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:03.020+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 0x7f5d0400f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:03.020+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 msgr2=0x7f5d0400f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:36:03.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:03.020+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 msgr2=0x7f5d0400f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:36:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:03.020+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 0x7f5d0400f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:36:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:03.020+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 0x7f5d0400f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:36:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:03.020+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 0x7f5d0400a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:03.020+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 msgr2=0x7f5d0400a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-04T01:36:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:03.020+0000 7f5d16ffd640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 msgr2=0x7f5d0400a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:36:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:03.020+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 0x7f5d0400a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:36:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:03.020+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 0x7f5d0400a390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.617+0000 7f5d14ff9640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 msgr2=0x7f5d0400a390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.617+0000 7f5d14ff9640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.141:3300/0 conn(0x7f5d04009fb0 0x7f5d0400a390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.617+0000 7f5d14ff9640 1 -- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 msgr2=0x7f5d0400f480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.617+0000 7f5d14ff9640 1 --2- 172.21.15.114:0/3386636275 >> v2:172.21.15.114:3300/0 conn(0x7f5d04003ba0 0x7f5d0400f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.617+0000 7f5d14ff9640 1 -- 172.21.15.114:0/3386636275 >> v1:172.21.15.141:6789/0 conn(0x7f5d0400a9a0 legacy=0x7f5d04008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.617+0000 7f5d14ff9640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 0x7f5d040162d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.617+0000 7f5d14ff9640 1 -- 172.21.15.114:0/3386636275 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d04010c90 con 0x7f5d0400fd40 2023-11-04T01:36:04.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.617+0000 7f5d14ff9640 1 -- 172.21.15.114:0/3386636275 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1815de20 con 0x7f5d04013ee0 2023-11-04T01:36:04.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.617+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 0x7f5d040162d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.617+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 msgr2=0x7f5d040162d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:36:04.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.617+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 msgr2=0x7f5d040162d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:36:04.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.617+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 0x7f5d040162d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:36:04.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.617+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 0x7f5d040162d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:36:04.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.818+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 0x7f5d040162d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:04.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.818+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 msgr2=0x7f5d040162d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:36:04.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.818+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 msgr2=0x7f5d040162d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:36:04.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.818+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 0x7f5d040162d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:36:04.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:04.818+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 0x7f5d040162d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:36:05.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.219+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 0x7f5d040162d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.219+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 msgr2=0x7f5d040162d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:36:05.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.219+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 msgr2=0x7f5d040162d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:36:05.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.219+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 0x7f5d040162d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:36:05.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.219+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 0x7f5d040162d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:36:05.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.838+0000 7f5d15ffb640 1 -- 172.21.15.114:0/3386636275 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823438144 0 0) 0x7f5d04010c90 con 0x7f5d0400fd40 2023-11-04T01:36:05.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.838+0000 7f5d15ffb640 1 -- 172.21.15.114:0/3386636275 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d00003520 con 0x7f5d0400fd40 2023-11-04T01:36:05.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.839+0000 7f5d15ffb640 1 -- 172.21.15.114:0/3386636275 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3866812219 0 0) 0x7f5d00003520 con 0x7f5d0400fd40 2023-11-04T01:36:05.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.839+0000 7f5d15ffb640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 msgr2=0x7f5d040162d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:36:05.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.839+0000 7f5d15ffb640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 0x7f5d040162d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.839+0000 7f5d15ffb640 1 -- 172.21.15.114:0/3386636275 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d040178a0 con 0x7f5d0400fd40 2023-11-04T01:36:05.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.839+0000 7f5d15ffb640 1 -- 172.21.15.114:0/3386636275 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f5d0c001260 con 0x7f5d0400fd40 2023-11-04T01:36:05.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.839+0000 7f5d15ffb640 1 -- 172.21.15.114:0/3386636275 >> v1:172.21.15.114:6789/0 conn(0x7f5d0400fd40 legacy=0x7f5d04010150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.839+0000 7f5d177fe640 1 -- 172.21.15.114:0/3386636275 reap_dead start 2023-11-04T01:36:05.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.839+0000 7f5d15ffb640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 0x7f5d00003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.839+0000 7f5d15ffb640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d00003f80 0x7f5d000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.839+0000 7f5d15ffb640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d00004d00 0x7f5d00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.839+0000 7f5d15ffb640 1 -- 172.21.15.114:0/3386636275 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1815de20 con 0x7f5d00003f80 2023-11-04T01:36:05.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.839+0000 7f5d15ffb640 1 -- 172.21.15.114:0/3386636275 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0000bb70 con 0x7f5d00004d00 2023-11-04T01:36:05.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.839+0000 7f5d15ffb640 1 -- 172.21.15.114:0/3386636275 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0000bd30 con 0x7f5d04013ee0 2023-11-04T01:36:05.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.840+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d00003f80 0x7f5d000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.840+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d00004d00 0x7f5d00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.840+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 0x7f5d00003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.840+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 msgr2=0x7f5d00003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:05.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.840+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 0x7f5d00003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.840+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d00004d00 msgr2=0x7f5d00005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:05.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.840+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d00004d00 0x7f5d00005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.840+0000 7f5d167fc640 1 -- 172.21.15.114:0/3386636275 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d00003520 con 0x7f5d00003f80 2023-11-04T01:36:05.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.841+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d00003f80 0x7f5d000047c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009d70 tx=0x7f5d000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4abdacecac43a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.841+0000 7f5d15ffb640 1 -- 172.21.15.114:0/3386636275 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0802dc10 con 0x7f5d00003f80 2023-11-04T01:36:05.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.841+0000 7f5d15ffb640 1 -- 172.21.15.114:0/3386636275 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d08031070 con 0x7f5d00003f80 2023-11-04T01:36:05.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.841+0000 7f5d15ffb640 1 -- 172.21.15.114:0/3386636275 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d08004030 con 0x7f5d00003f80 2023-11-04T01:36:05.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.842+0000 7f5d1d961640 1 -- 172.21.15.114:0/3386636275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d00003f80 msgr2=0x7f5d000047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.842+0000 7f5d1d961640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d00003f80 0x7f5d000047c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009d70 tx=0x7f5d000057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.842+0000 7f5d1d961640 1 -- 172.21.15.114:0/3386636275 shutdown_connections 2023-11-04T01:36:05.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.842+0000 7f5d1d961640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d00004d00 0x7f5d00005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.842+0000 7f5d1d961640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d00003f80 0x7f5d000047c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.842+0000 7f5d1d961640 1 --2- 172.21.15.114:0/3386636275 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d04013ee0 0x7f5d00003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.842+0000 7f5d1d961640 1 -- 172.21.15.114:0/3386636275 >> 172.21.15.114:0/3386636275 conn(0x7f5d180cf140 msgr2=0x7f5d180cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:05.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.842+0000 7f5d1d961640 1 -- 172.21.15.114:0/3386636275 shutdown_connections 2023-11-04T01:36:05.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.842+0000 7f5d1d961640 1 -- 172.21.15.114:0/3386636275 wait complete. 2023-11-04T01:36:05.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.844+0000 7f5d1d961640 1 Processor -- start 2023-11-04T01:36:05.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.844+0000 7f5d1d961640 1 -- start start 2023-11-04T01:36:05.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.845+0000 7f5d1d961640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d00003f80 0x7f5d1814b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.845+0000 7f5d1d961640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d00004d00 0x7f5d180c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.845+0000 7f5d1d961640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d04013ee0 0x7f5d180c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:05.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.845+0000 7f5d1d961640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1815bb90 con 0x7f5d04013ee0 2023-11-04T01:36:05.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.845+0000 7f5d1d961640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1815b2a0 con 0x7f5d00003f80 2023-11-04T01:36:05.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.845+0000 7f5d1d961640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1815c9d0 con 0x7f5d00004d00 2023-11-04T01:36:05.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.846+0000 7f5d177fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d04013ee0 0x7f5d180c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.846+0000 7f5d177fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d04013ee0 0x7f5d180c4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49356/0 (socket says 172.21.15.114:49356) 2023-11-04T01:36:05.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.846+0000 7f5d177fe640 1 -- 172.21.15.114:0/3616189763 learned_addr learned my addr 172.21.15.114:0/3616189763 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:05.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.846+0000 7f5d167fc640 1 --2- 172.21.15.114:0/3616189763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d00004d00 0x7f5d180c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.846+0000 7f5d16ffd640 1 --2- 172.21.15.114:0/3616189763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d00003f80 0x7f5d1814b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:05.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.846+0000 7f5d177fe640 1 -- 172.21.15.114:0/3616189763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d00004d00 msgr2=0x7f5d180c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.846+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3616189763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d00004d00 0x7f5d180c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.846+0000 7f5d177fe640 1 -- 172.21.15.114:0/3616189763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d00003f80 msgr2=0x7f5d1814b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.846+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3616189763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d00003f80 0x7f5d1814b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.846+0000 7f5d177fe640 1 -- 172.21.15.114:0/3616189763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1815b540 con 0x7f5d04013ee0 2023-11-04T01:36:05.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.846+0000 7f5d177fe640 1 --2- 172.21.15.114:0/3616189763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d04013ee0 0x7f5d180c4d10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009dd0 tx=0x7f5d1001aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:05.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.847+0000 7f5cfffff640 1 -- 172.21.15.114:0/3616189763 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1001f070 con 0x7f5d04013ee0 2023-11-04T01:36:05.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.847+0000 7f5cfffff640 1 -- 172.21.15.114:0/3616189763 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d10010040 con 0x7f5d04013ee0 2023-11-04T01:36:05.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.847+0000 7f5d1d961640 1 -- 172.21.15.114:0/3616189763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1815b820 con 0x7f5d04013ee0 2023-11-04T01:36:05.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.847+0000 7f5cfffff640 1 -- 172.21.15.114:0/3616189763 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d10018db0 con 0x7f5d04013ee0 2023-11-04T01:36:05.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.847+0000 7f5d1d961640 1 -- 172.21.15.114:0/3616189763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d18158e20 con 0x7f5d04013ee0 2023-11-04T01:36:05.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.848+0000 7f5cfffff640 1 -- 172.21.15.114:0/3616189763 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5d10024420 con 0x7f5d04013ee0 2023-11-04T01:36:05.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.848+0000 7f5cfffff640 1 -- 172.21.15.114:0/3616189763 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5d10023820 con 0x7f5d04013ee0 2023-11-04T01:36:05.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.849+0000 7f5d1d961640 1 -- 172.21.15.114:0/3616189763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d180674e0 con 0x7f5d04013ee0 2023-11-04T01:36:05.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.851+0000 7f5cfffff640 1 -- 172.21.15.114:0/3616189763 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f5d10023a40 con 0x7f5d04013ee0 2023-11-04T01:36:05.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.917+0000 7f5d1d961640 1 -- 172.21.15.114:0/3616189763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f5d18071a40 con 0x7f5d04013ee0 2023-11-04T01:36:05.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.921+0000 7f5cfffff640 1 -- 172.21.15.114:0/3616189763 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5d10023be0 con 0x7f5d04013ee0 2023-11-04T01:36:05.923 INFO:teuthology.orchestra.run.smithi114.stderr:adjusted tunables profile to default 2023-11-04T01:36:05.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.922+0000 7f5d1d961640 1 -- 172.21.15.114:0/3616189763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d04013ee0 msgr2=0x7f5d180c4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:05.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.922+0000 7f5d1d961640 1 --2- 172.21.15.114:0/3616189763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d04013ee0 0x7f5d180c4d10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009dd0 tx=0x7f5d1001aed0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.922+0000 7f5d1d961640 1 -- 172.21.15.114:0/3616189763 shutdown_connections 2023-11-04T01:36:05.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.922+0000 7f5d1d961640 1 --2- 172.21.15.114:0/3616189763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d04013ee0 0x7f5d180c4d10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.922+0000 7f5d1d961640 1 --2- 172.21.15.114:0/3616189763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5d00004d00 0x7f5d180c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.922+0000 7f5d1d961640 1 --2- 172.21.15.114:0/3616189763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5d00003f80 0x7f5d1814b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:05.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.922+0000 7f5d1d961640 1 -- 172.21.15.114:0/3616189763 >> 172.21.15.114:0/3616189763 conn(0x7f5d180cf140 msgr2=0x7f5d180ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:05.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.922+0000 7f5d1d961640 1 -- 172.21.15.114:0/3616189763 shutdown_connections 2023-11-04T01:36:05.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:05.922+0000 7f5d1d961640 1 -- 172.21.15.114:0/3616189763 wait complete. 2023-11-04T01:36:05.935 INFO:tasks.ceph:check_enable_crimson: False 2023-11-04T01:36:05.935 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-04T01:36:05.936 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:36:05.936 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-04T01:36:05.967 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:36:05.967 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-04T01:36:06.036 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:36:06.036 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-04T01:36:06.104 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:36:06.105 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-04T01:36:06.171 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:36:06.172 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-04T01:36:06.198 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:36:06.198 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-04T01:36:06.268 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:36:06.268 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-04T01:36:06.297 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:06.295+0000 7f3518630040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-04T01:36:06.311 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:06.309+0000 7f6b17416040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-04T01:36:06.323 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:36:06.323 DEBUG:teuthology.orchestra.run.smithi141:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-04T01:36:06.351 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:06.349+0000 7f3518630040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-04T01:36:06.361 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:06.359+0000 7f6b17416040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-04T01:36:06.377 DEBUG:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new cf03fd88-0363-478d-8cb0-afd2b8e110c7 0 2023-11-04T01:36:06.517 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.515+0000 7f1834dee640 1 Processor -- start 2023-11-04T01:36:06.517 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.515+0000 7f1834dee640 1 -- start start 2023-11-04T01:36:06.519 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f1834dee640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18301603d0 0x7f18300b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.519 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f1834dee640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f18300722a0 0x7f183006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.519 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f1834dee640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f183006a660 0x7f1830160b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.519 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f1834dee640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18300b19d0 con 0x7f18300722a0 2023-11-04T01:36:06.519 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f1834dee640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183006aaf0 con 0x7f183006a660 2023-11-04T01:36:06.519 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f1834dee640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18300cdf80 con 0x7f18301603d0 2023-11-04T01:36:06.519 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f182ed9d640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f183006a660 0x7f1830160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.519 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f182e59c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18301603d0 0x7f18300b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.519 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f182ed9d640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f183006a660 0x7f1830160b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:36180/0 (socket says 172.21.15.141:36180) 2023-11-04T01:36:06.519 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f182e59c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18301603d0 0x7f18300b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:53614/0 (socket says 172.21.15.141:53614) 2023-11-04T01:36:06.520 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f182ed9d640 1 -- 172.21.15.141:0/2029120115 learned_addr learned my addr 172.21.15.141:0/2029120115 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-04T01:36:06.520 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f1827fff640 1 --2- 172.21.15.141:0/2029120115 >> v2:172.21.15.114:3300/0 conn(0x7f18300722a0 0x7f183006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.520 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f182ed9d640 1 -- 172.21.15.141:0/2029120115 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18301603d0 msgr2=0x7f18300b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.520 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f182ed9d640 1 --2- 172.21.15.141:0/2029120115 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18301603d0 0x7f18300b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.520 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f182ed9d640 1 -- 172.21.15.141:0/2029120115 >> v2:172.21.15.114:3300/0 conn(0x7f18300722a0 msgr2=0x7f183006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.520 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f182ed9d640 1 --2- 172.21.15.141:0/2029120115 >> v2:172.21.15.114:3300/0 conn(0x7f18300722a0 0x7f183006a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.520 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f182ed9d640 1 -- 172.21.15.141:0/2029120115 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18300ce6f0 con 0x7f183006a660 2023-11-04T01:36:06.520 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.516+0000 7f182e59c640 1 --2- 172.21.15.141:0/2029120115 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18301603d0 0x7f18300b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:06.520 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.517+0000 7f182ed9d640 1 --2- 172.21.15.141:0/2029120115 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f183006a660 0x7f1830160b30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f18300b5940 tx=0x7f182802be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a05df600700dcdaf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.520 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.517+0000 7f182dd9b640 1 -- 172.21.15.141:0/2029120115 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182802c9e0 con 0x7f183006a660 2023-11-04T01:36:06.520 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.517+0000 7f182dd9b640 1 -- 172.21.15.141:0/2029120115 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182802cb40 con 0x7f183006a660 2023-11-04T01:36:06.520 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.517+0000 7f182dd9b640 1 -- 172.21.15.141:0/2029120115 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18280343f0 con 0x7f183006a660 2023-11-04T01:36:06.530 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.518+0000 7f1834dee640 1 -- 172.21.15.141:0/2029120115 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f183006a660 msgr2=0x7f1830160b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.531 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.518+0000 7f1834dee640 1 --2- 172.21.15.141:0/2029120115 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f183006a660 0x7f1830160b30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f18300b5940 tx=0x7f182802be40 comp rx=0 tx=0).stop 2023-11-04T01:36:06.531 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.518+0000 7f1834dee640 1 -- 172.21.15.141:0/2029120115 shutdown_connections 2023-11-04T01:36:06.531 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.518+0000 7f1834dee640 1 --2- 172.21.15.141:0/2029120115 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f183006a660 0x7f1830160b30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.531 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.518+0000 7f1834dee640 1 --2- 172.21.15.141:0/2029120115 >> v2:172.21.15.114:3300/0 conn(0x7f18300722a0 0x7f183006a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.531 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.518+0000 7f1834dee640 1 --2- 172.21.15.141:0/2029120115 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18301603d0 0x7f18300b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.531 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.518+0000 7f1834dee640 1 -- 172.21.15.141:0/2029120115 >> 172.21.15.141:0/2029120115 conn(0x7f183006d800 msgr2=0x7f183006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.531 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.518+0000 7f1834dee640 1 -- 172.21.15.141:0/2029120115 shutdown_connections 2023-11-04T01:36:06.531 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.518+0000 7f1834dee640 1 -- 172.21.15.141:0/2029120115 wait complete. 2023-11-04T01:36:06.531 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.519+0000 7f1834dee640 1 Processor -- start 2023-11-04T01:36:06.531 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.519+0000 7f1834dee640 1 -- start start 2023-11-04T01:36:06.532 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f1834dee640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f183006a660 0x7f18301efeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.532 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f1834dee640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18300722a0 0x7f18301f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.532 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f1834dee640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18301603d0 0x7f1830153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.532 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f1834dee640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18301f3810 con 0x7f18301603d0 2023-11-04T01:36:06.532 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f1834dee640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18301f3250 con 0x7f18300722a0 2023-11-04T01:36:06.532 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f1834dee640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18301f3530 con 0x7f183006a660 2023-11-04T01:36:06.532 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f1827fff640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18300722a0 0x7f18301f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.532 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f182e59c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f183006a660 0x7f18301efeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.532 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f1827fff640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18300722a0 0x7f18301f2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:36192/0 (socket says 172.21.15.141:36192) 2023-11-04T01:36:06.532 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f1827fff640 1 -- 172.21.15.141:0/1574891368 learned_addr learned my addr 172.21.15.141:0/1574891368 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-04T01:36:06.541 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f182ed9d640 1 --2- 172.21.15.141:0/1574891368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18301603d0 0x7f1830153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.541 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f1827fff640 1 -- 172.21.15.141:0/1574891368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f183006a660 msgr2=0x7f18301efeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.541 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f1827fff640 1 --2- 172.21.15.141:0/1574891368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f183006a660 0x7f18301efeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.542 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f1827fff640 1 -- 172.21.15.141:0/1574891368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18301603d0 msgr2=0x7f1830153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.542 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f1827fff640 1 --2- 172.21.15.141:0/1574891368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18301603d0 0x7f1830153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.542 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f1827fff640 1 -- 172.21.15.141:0/1574891368 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1820009400 con 0x7f18300722a0 2023-11-04T01:36:06.542 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f182e59c640 1 --2- 172.21.15.141:0/1574891368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f183006a660 0x7f18301efeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:06.542 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.520+0000 7f182ed9d640 1 --2- 172.21.15.141:0/1574891368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18301603d0 0x7f1830153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:06.542 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.521+0000 7f1827fff640 1 --2- 172.21.15.141:0/1574891368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18300722a0 0x7f18301f2890 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f181800e9b0 tx=0x7f181800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.542 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.521+0000 7f1826ffd640 1 -- 172.21.15.141:0/1574891368 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1818009670 con 0x7f18300722a0 2023-11-04T01:36:06.542 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.521+0000 7f1826ffd640 1 -- 172.21.15.141:0/1574891368 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181800c9a0 con 0x7f18300722a0 2023-11-04T01:36:06.542 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.521+0000 7f1834dee640 1 -- 172.21.15.141:0/1574891368 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1828009b30 con 0x7f18300722a0 2023-11-04T01:36:06.542 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.521+0000 7f1826ffd640 1 -- 172.21.15.141:0/1574891368 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181800cd50 con 0x7f18300722a0 2023-11-04T01:36:06.542 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.521+0000 7f1834dee640 1 -- 172.21.15.141:0/1574891368 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1830152fe0 con 0x7f18300722a0 2023-11-04T01:36:06.549 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.521+0000 7f1826ffd640 1 -- 172.21.15.141:0/1574891368 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1818005c90 con 0x7f18300722a0 2023-11-04T01:36:06.549 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.521+0000 7f1826ffd640 1 -- 172.21.15.141:0/1574891368 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f18180137b0 con 0x7f18300722a0 2023-11-04T01:36:06.550 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.522+0000 7f1834dee640 1 -- 172.21.15.141:0/1574891368 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18300b37c0 con 0x7f18300722a0 2023-11-04T01:36:06.550 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.524+0000 7f1826ffd640 1 -- 172.21.15.141:0/1574891368 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f1818021060 con 0x7f18300722a0 2023-11-04T01:36:06.594 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.593+0000 7f1834dee640 1 -- 172.21.15.141:0/1574891368 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cf03fd88-0363-478d-8cb0-afd2b8e110c7", "id": 0} v 0) v1 -- 0x7f1830155c00 con 0x7f18300722a0 2023-11-04T01:36:06.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.596+0000 7f1826ffd640 1 -- 172.21.15.141:0/1574891368 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cf03fd88-0363-478d-8cb0-afd2b8e110c7", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1818017070 con 0x7f18300722a0 2023-11-04T01:36:06.598 INFO:teuthology.orchestra.run.smithi141.stdout:0 2023-11-04T01:36:06.598 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.597+0000 7f1834dee640 1 -- 172.21.15.141:0/1574891368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18300722a0 msgr2=0x7f18301f2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.599 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.597+0000 7f1834dee640 1 --2- 172.21.15.141:0/1574891368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18300722a0 0x7f18301f2890 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f181800e9b0 tx=0x7f181800ee70 comp rx=0 tx=0).stop 2023-11-04T01:36:06.599 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.597+0000 7f1834dee640 1 -- 172.21.15.141:0/1574891368 shutdown_connections 2023-11-04T01:36:06.599 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.597+0000 7f1834dee640 1 --2- 172.21.15.141:0/1574891368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18301603d0 0x7f1830153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.599 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.597+0000 7f1834dee640 1 --2- 172.21.15.141:0/1574891368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18300722a0 0x7f18301f2890 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.599 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.597+0000 7f1834dee640 1 --2- 172.21.15.141:0/1574891368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f183006a660 0x7f18301efeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.599 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.597+0000 7f1834dee640 1 -- 172.21.15.141:0/1574891368 >> 172.21.15.141:0/1574891368 conn(0x7f183006d800 msgr2=0x7f18300c5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.599 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.597+0000 7f1834dee640 1 -- 172.21.15.141:0/1574891368 shutdown_connections 2023-11-04T01:36:06.599 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.597+0000 7f1834dee640 1 -- 172.21.15.141:0/1574891368 wait complete. 2023-11-04T01:36:06.609 DEBUG:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new 113b3539-702f-4596-8a3b-b3bdaab37075 1 2023-11-04T01:36:06.708 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.707+0000 7f4b7e8b4640 1 Processor -- start 2023-11-04T01:36:06.709 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.707+0000 7f4b7e8b4640 1 -- start start 2023-11-04T01:36:06.710 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.707+0000 7f4b7e8b4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b78070f80 0x7f4b780cac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.710 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.708+0000 7f4b7e8b4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4b7806b450 0x7f4b78071360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.710 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.708+0000 7f4b7e8b4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b78159f30 con 0x7f4b7806a9c0 2023-11-04T01:36:06.711 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.708+0000 7f4b7e8b4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b780718a0 con 0x7f4b7806b450 2023-11-04T01:36:06.711 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.708+0000 7f4b7e8b4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780cb370 con 0x7f4b78070f80 2023-11-04T01:36:06.711 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.708+0000 7f4b77fff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b78070f80 0x7f4b780cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.711 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.708+0000 7f4b77fff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b78070f80 0x7f4b780cac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:53624/0 (socket says 172.21.15.141:53624) 2023-11-04T01:36:06.711 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.708+0000 7f4b77fff640 1 -- 172.21.15.141:0/3853287730 learned_addr learned my addr 172.21.15.141:0/3853287730 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-04T01:36:06.711 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.708+0000 7f4b777fe640 1 --2- 172.21.15.141:0/3853287730 >> v2:172.21.15.114:3300/0 conn(0x7f4b7806b450 0x7f4b78071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.711 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.708+0000 7f4b77fff640 1 -- 172.21.15.141:0/3853287730 >> v2:172.21.15.114:3300/0 conn(0x7f4b7806b450 msgr2=0x7f4b78071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.711 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.708+0000 7f4b77fff640 1 --2- 172.21.15.141:0/3853287730 >> v2:172.21.15.114:3300/0 conn(0x7f4b7806b450 0x7f4b78071360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.711 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.708+0000 7f4b77fff640 1 -- 172.21.15.141:0/3853287730 >> v1:172.21.15.114:6789/0 conn(0x7f4b7806a9c0 legacy=0x7f4b780ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:06.711 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.708+0000 7f4b77fff640 1 -- 172.21.15.141:0/3853287730 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b780cb650 con 0x7f4b78070f80 2023-11-04T01:36:06.711 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.709+0000 7f4b77fff640 1 --2- 172.21.15.141:0/3853287730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b78070f80 0x7f4b780cac90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009870 tx=0x7f4b6c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fdcbf0a2b91fadf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.711 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.709+0000 7f4b76ffd640 1 -- 172.21.15.141:0/3853287730 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c030840 con 0x7f4b78070f80 2023-11-04T01:36:06.711 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.709+0000 7f4b76ffd640 1 -- 172.21.15.141:0/3853287730 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c0309a0 con 0x7f4b78070f80 2023-11-04T01:36:06.712 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.709+0000 7f4b76ffd640 1 -- 172.21.15.141:0/3853287730 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c030d30 con 0x7f4b78070f80 2023-11-04T01:36:06.715 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.709+0000 7f4b7e8b4640 1 -- 172.21.15.141:0/3853287730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b78070f80 msgr2=0x7f4b780cac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.715 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.709+0000 7f4b7e8b4640 1 --2- 172.21.15.141:0/3853287730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b78070f80 0x7f4b780cac90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009870 tx=0x7f4b6c02b980 comp rx=0 tx=0).stop 2023-11-04T01:36:06.715 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.709+0000 7f4b7e8b4640 1 -- 172.21.15.141:0/3853287730 shutdown_connections 2023-11-04T01:36:06.715 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.709+0000 7f4b7e8b4640 1 --2- 172.21.15.141:0/3853287730 >> v2:172.21.15.114:3300/0 conn(0x7f4b7806b450 0x7f4b78071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.715 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.709+0000 7f4b7e8b4640 1 --2- 172.21.15.141:0/3853287730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b78070f80 0x7f4b780cac90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.715 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.709+0000 7f4b7e8b4640 1 -- 172.21.15.141:0/3853287730 >> 172.21.15.141:0/3853287730 conn(0x7f4b780cf140 msgr2=0x7f4b780cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.715 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.709+0000 7f4b7e8b4640 1 -- 172.21.15.141:0/3853287730 shutdown_connections 2023-11-04T01:36:06.716 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.709+0000 7f4b7e8b4640 1 -- 172.21.15.141:0/3853287730 wait complete. 2023-11-04T01:36:06.716 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.710+0000 7f4b7e8b4640 1 Processor -- start 2023-11-04T01:36:06.716 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.711+0000 7f4b7e8b4640 1 -- start start 2023-11-04T01:36:06.716 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.711+0000 7f4b7e8b4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b7806a9c0 0x7f4b7814e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.716 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.711+0000 7f4b7e8b4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b7806b450 0x7f4b780a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.716 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.711+0000 7f4b7e8b4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b78070f80 0x7f4b780c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.716 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.711+0000 7f4b7e8b4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780ab240 con 0x7f4b78070f80 2023-11-04T01:36:06.716 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.711+0000 7f4b7e8b4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7814e970 con 0x7f4b7806a9c0 2023-11-04T01:36:06.716 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.711+0000 7f4b7e8b4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780aa1a0 con 0x7f4b7806b450 2023-11-04T01:36:06.716 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.711+0000 7f4b777fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b7806b450 0x7f4b780a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.716 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.711+0000 7f4b777fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b7806b450 0x7f4b780a96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:53640/0 (socket says 172.21.15.141:53640) 2023-11-04T01:36:06.716 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b777fe640 1 -- 172.21.15.141:0/3537191288 learned_addr learned my addr 172.21.15.141:0/3537191288 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-04T01:36:06.716 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b77fff640 1 --2- 172.21.15.141:0/3537191288 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b7806a9c0 0x7f4b7814e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.717 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b7ce51640 1 --2- 172.21.15.141:0/3537191288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b78070f80 0x7f4b780c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.717 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b777fe640 1 -- 172.21.15.141:0/3537191288 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b7806a9c0 msgr2=0x7f4b7814e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.717 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b777fe640 1 --2- 172.21.15.141:0/3537191288 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b7806a9c0 0x7f4b7814e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.717 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b777fe640 1 -- 172.21.15.141:0/3537191288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b78070f80 msgr2=0x7f4b780c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.717 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b777fe640 1 --2- 172.21.15.141:0/3537191288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b78070f80 0x7f4b780c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.717 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b777fe640 1 -- 172.21.15.141:0/3537191288 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c0094d0 con 0x7f4b7806b450 2023-11-04T01:36:06.717 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b77fff640 1 --2- 172.21.15.141:0/3537191288 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b7806a9c0 0x7f4b7814e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:06.717 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b777fe640 1 --2- 172.21.15.141:0/3537191288 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b7806b450 0x7f4b780a96e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800d5f0 tx=0x7f4b6800dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.717 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b74ff9640 1 -- 172.21.15.141:0/3537191288 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b680125f0 con 0x7f4b7806b450 2023-11-04T01:36:06.717 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b74ff9640 1 -- 172.21.15.141:0/3537191288 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b68012750 con 0x7f4b7806b450 2023-11-04T01:36:06.717 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b7e8b4640 1 -- 172.21.15.141:0/3537191288 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b780aa480 con 0x7f4b7806b450 2023-11-04T01:36:06.717 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b74ff9640 1 -- 172.21.15.141:0/3537191288 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68012b00 con 0x7f4b7806b450 2023-11-04T01:36:06.717 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b7e8b4640 1 -- 172.21.15.141:0/3537191288 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b780aaa40 con 0x7f4b7806b450 2023-11-04T01:36:06.718 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b74ff9640 1 -- 172.21.15.141:0/3537191288 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4b6801e460 con 0x7f4b7806b450 2023-11-04T01:36:06.718 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.712+0000 7f4b74ff9640 1 -- 172.21.15.141:0/3537191288 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f4b68014910 con 0x7f4b7806b450 2023-11-04T01:36:06.718 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.713+0000 7f4b7e8b4640 1 -- 172.21.15.141:0/3537191288 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b78072000 con 0x7f4b7806b450 2023-11-04T01:36:06.718 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.715+0000 7f4b74ff9640 1 -- 172.21.15.141:0/3537191288 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f4b68014b20 con 0x7f4b7806b450 2023-11-04T01:36:06.788 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.787+0000 7f4b7e8b4640 1 -- 172.21.15.141:0/3537191288 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd new", "uuid": "113b3539-702f-4596-8a3b-b3bdaab37075", "id": 1} v 0) v1 -- 0x7f4b7815cb50 con 0x7f4b7806b450 2023-11-04T01:36:06.793 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.792+0000 7f4b74ff9640 1 -- 172.21.15.141:0/3537191288 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "113b3539-702f-4596-8a3b-b3bdaab37075", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4b68014df0 con 0x7f4b7806b450 2023-11-04T01:36:06.794 INFO:teuthology.orchestra.run.smithi141.stdout:1 2023-11-04T01:36:06.795 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.793+0000 7f4b7e8b4640 1 -- 172.21.15.141:0/3537191288 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b7806b450 msgr2=0x7f4b780a96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.795 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.793+0000 7f4b7e8b4640 1 --2- 172.21.15.141:0/3537191288 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b7806b450 0x7f4b780a96e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800d5f0 tx=0x7f4b6800dab0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.795 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.793+0000 7f4b7e8b4640 1 -- 172.21.15.141:0/3537191288 shutdown_connections 2023-11-04T01:36:06.795 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.793+0000 7f4b7e8b4640 1 --2- 172.21.15.141:0/3537191288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b78070f80 0x7f4b780c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.795 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.793+0000 7f4b7e8b4640 1 --2- 172.21.15.141:0/3537191288 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4b7806b450 0x7f4b780a96e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.795 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.793+0000 7f4b7e8b4640 1 --2- 172.21.15.141:0/3537191288 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4b7806a9c0 0x7f4b7814e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.795 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.793+0000 7f4b7e8b4640 1 -- 172.21.15.141:0/3537191288 >> 172.21.15.141:0/3537191288 conn(0x7f4b780cf140 msgr2=0x7f4b7815c440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.795 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.793+0000 7f4b7e8b4640 1 -- 172.21.15.141:0/3537191288 shutdown_connections 2023-11-04T01:36:06.795 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.793+0000 7f4b7e8b4640 1 -- 172.21.15.141:0/3537191288 wait complete. 2023-11-04T01:36:06.807 DEBUG:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new b0997e6c-31a7-46e7-8e9e-e550ad1010be 2 2023-11-04T01:36:06.879 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:06.877+0000 7f6b17416040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-04T01:36:06.907 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.905+0000 7fa1c3aa9640 1 Processor -- start 2023-11-04T01:36:06.907 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.906+0000 7fa1c3aa9640 1 -- start start 2023-11-04T01:36:06.908 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.906+0000 7fa1c3aa9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa1bc071690 0x7fa1bc0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.908 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.906+0000 7fa1c3aa9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1bc0cb5f0 con 0x7fa1bc159c40 2023-11-04T01:36:06.908 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.906+0000 7fa1c3aa9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1bc0cb8d0 con 0x7fa1bc15e2e0 2023-11-04T01:36:06.908 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.906+0000 7fa1c3aa9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1bc0ce710 con 0x7fa1bc071690 2023-11-04T01:36:06.909 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.907+0000 7fa1c2046640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa1bc071690 0x7fa1bc0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.909 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.907+0000 7fa1c2046640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa1bc071690 0x7fa1bc0ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:36222/0 (socket says 172.21.15.141:36222) 2023-11-04T01:36:06.909 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.907+0000 7fa1c1044640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fa1bc15e2e0 0x7fa1bc070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.141:46976/0 (socket says 172.21.15.141:46976) 2023-11-04T01:36:06.909 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.907+0000 7fa1c2046640 1 -- 172.21.15.141:0/1554012493 learned_addr learned my addr 172.21.15.141:0/1554012493 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-04T01:36:06.909 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.907+0000 7fa1c2046640 1 -- 172.21.15.141:0/1554012493 >> v1:172.21.15.141:6789/0 conn(0x7fa1bc15e2e0 legacy=0x7fa1bc070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.909 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.907+0000 7fa1c2046640 1 -- 172.21.15.141:0/1554012493 >> v1:172.21.15.114:6789/0 conn(0x7fa1bc159c40 legacy=0x7fa1bc0cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.909 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.907+0000 7fa1c2046640 1 -- 172.21.15.141:0/1554012493 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1bc0ce050 con 0x7fa1bc071690 2023-11-04T01:36:06.910 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.908+0000 7fa1c2046640 1 --2- 172.21.15.141:0/1554012493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1bc071690 0x7fa1bc0ceb30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400d150 tx=0x7fa1b402e200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfbc00a2a0ae69fb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.910 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.908+0000 7fa1c0843640 1 -- 172.21.15.141:0/1554012493 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b400b0d0 con 0x7fa1bc071690 2023-11-04T01:36:06.910 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.908+0000 7fa1c0843640 1 -- 172.21.15.141:0/1554012493 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b400b230 con 0x7fa1bc071690 2023-11-04T01:36:06.910 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.908+0000 7fa1c0843640 1 -- 172.21.15.141:0/1554012493 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4009600 con 0x7fa1bc071690 2023-11-04T01:36:06.911 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.908+0000 7fa1c3aa9640 1 -- 172.21.15.141:0/1554012493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1bc071690 msgr2=0x7fa1bc0ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.911 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.908+0000 7fa1c3aa9640 1 --2- 172.21.15.141:0/1554012493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1bc071690 0x7fa1bc0ceb30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400d150 tx=0x7fa1b402e200 comp rx=0 tx=0).stop 2023-11-04T01:36:06.911 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.908+0000 7fa1c3aa9640 1 -- 172.21.15.141:0/1554012493 shutdown_connections 2023-11-04T01:36:06.911 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.908+0000 7fa1c3aa9640 1 --2- 172.21.15.141:0/1554012493 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1bc071690 0x7fa1bc0ceb30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.911 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.908+0000 7fa1c3aa9640 1 -- 172.21.15.141:0/1554012493 >> 172.21.15.141:0/1554012493 conn(0x7fa1bc0cf140 msgr2=0x7fa1bc0cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.911 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.908+0000 7fa1c3aa9640 1 -- 172.21.15.141:0/1554012493 shutdown_connections 2023-11-04T01:36:06.911 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.908+0000 7fa1c3aa9640 1 -- 172.21.15.141:0/1554012493 wait complete. 2023-11-04T01:36:06.913 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.910+0000 7fa1c3aa9640 1 Processor -- start 2023-11-04T01:36:06.913 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.910+0000 7fa1c3aa9640 1 -- start start 2023-11-04T01:36:06.913 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.910+0000 7fa1c3aa9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1bc071690 0x7fa1bc14fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.913 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.910+0000 7fa1c3aa9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1bc159c40 0x7fa1bc0c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.913 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.910+0000 7fa1c3aa9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1bc15e2e0 0x7fa1bc0c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:06.914 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.910+0000 7fa1c3aa9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc0cb410 con 0x7fa1bc159c40 2023-11-04T01:36:06.914 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.910+0000 7fa1c3aa9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc150a00 con 0x7fa1bc15e2e0 2023-11-04T01:36:06.914 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.910+0000 7fa1c3aa9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc0c48a0 con 0x7fa1bc071690 2023-11-04T01:36:06.914 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.910+0000 7fa1c2046640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1bc15e2e0 0x7fa1bc0c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.914 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.910+0000 7fa1c1845640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1bc071690 0x7fa1bc14fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.914 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.910+0000 7fa1c2046640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1bc15e2e0 0x7fa1bc0c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:36236/0 (socket says 172.21.15.141:36236) 2023-11-04T01:36:06.914 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.910+0000 7fa1c2046640 1 -- 172.21.15.141:0/2435873490 learned_addr learned my addr 172.21.15.141:0/2435873490 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-04T01:36:06.914 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.911+0000 7fa1c1044640 1 --2- 172.21.15.141:0/2435873490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1bc159c40 0x7fa1bc0c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:06.914 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.911+0000 7fa1c2046640 1 -- 172.21.15.141:0/2435873490 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1bc071690 msgr2=0x7fa1bc14fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.914 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.911+0000 7fa1c2046640 1 --2- 172.21.15.141:0/2435873490 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1bc071690 0x7fa1bc14fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.914 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.911+0000 7fa1c2046640 1 -- 172.21.15.141:0/2435873490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1bc159c40 msgr2=0x7fa1bc0c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.914 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.911+0000 7fa1c2046640 1 --2- 172.21.15.141:0/2435873490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1bc159c40 0x7fa1bc0c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.915 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.911+0000 7fa1c2046640 1 -- 172.21.15.141:0/2435873490 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b400bd40 con 0x7fa1bc15e2e0 2023-11-04T01:36:06.915 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.911+0000 7fa1c1845640 1 --2- 172.21.15.141:0/2435873490 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1bc071690 0x7fa1bc14fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:06.915 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.911+0000 7fa1c2046640 1 --2- 172.21.15.141:0/2435873490 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1bc15e2e0 0x7fa1bc0c4200 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400d150 tx=0x7fa1b4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:06.915 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.911+0000 7fa1b27fc640 1 -- 172.21.15.141:0/2435873490 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b400b720 con 0x7fa1bc15e2e0 2023-11-04T01:36:06.915 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.911+0000 7fa1b27fc640 1 -- 172.21.15.141:0/2435873490 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b4040660 con 0x7fa1bc15e2e0 2023-11-04T01:36:06.915 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.911+0000 7fa1b27fc640 1 -- 172.21.15.141:0/2435873490 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b40409f0 con 0x7fa1bc15e2e0 2023-11-04T01:36:06.915 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.911+0000 7fa1c3aa9640 1 -- 172.21.15.141:0/2435873490 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1bc0c4b80 con 0x7fa1bc15e2e0 2023-11-04T01:36:06.915 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.911+0000 7fa1c3aa9640 1 -- 172.21.15.141:0/2435873490 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1bc0c5140 con 0x7fa1bc15e2e0 2023-11-04T01:36:06.915 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.911+0000 7fa1b27fc640 1 -- 172.21.15.141:0/2435873490 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa1b404a400 con 0x7fa1bc15e2e0 2023-11-04T01:36:06.915 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.911+0000 7fa1b27fc640 1 -- 172.21.15.141:0/2435873490 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fa1b4041820 con 0x7fa1bc15e2e0 2023-11-04T01:36:06.915 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.912+0000 7fa1c3aa9640 1 -- 172.21.15.141:0/2435873490 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1bc06bbb0 con 0x7fa1bc15e2e0 2023-11-04T01:36:06.917 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.916+0000 7fa1b27fc640 1 -- 172.21.15.141:0/2435873490 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa1b4068b40 con 0x7fa1bc15e2e0 2023-11-04T01:36:06.933 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:06.929+0000 7f6b17416040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-04T01:36:06.953 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:06.952+0000 7f3518630040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-04T01:36:06.974 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:06.973+0000 7f6b17416040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-04T01:36:06.989 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.988+0000 7fa1c3aa9640 1 -- 172.21.15.141:0/2435873490 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b0997e6c-31a7-46e7-8e9e-e550ad1010be", "id": 2} v 0) v1 -- 0x7fa1bc0cd440 con 0x7fa1bc15e2e0 2023-11-04T01:36:06.997 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.993+0000 7fa1b27fc640 1 -- 172.21.15.141:0/2435873490 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b0997e6c-31a7-46e7-8e9e-e550ad1010be", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa1b4057030 con 0x7fa1bc15e2e0 2023-11-04T01:36:06.998 INFO:teuthology.orchestra.run.smithi141.stdout:2 2023-11-04T01:36:06.999 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.994+0000 7fa1c3aa9640 1 -- 172.21.15.141:0/2435873490 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1bc15e2e0 msgr2=0x7fa1bc0c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:06.999 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.994+0000 7fa1c3aa9640 1 --2- 172.21.15.141:0/2435873490 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1bc15e2e0 0x7fa1bc0c4200 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400d150 tx=0x7fa1b4004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:06.999 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.994+0000 7fa1c3aa9640 1 -- 172.21.15.141:0/2435873490 shutdown_connections 2023-11-04T01:36:06.999 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.994+0000 7fa1c3aa9640 1 --2- 172.21.15.141:0/2435873490 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1bc15e2e0 0x7fa1bc0c4200 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.999 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.994+0000 7fa1c3aa9640 1 --2- 172.21.15.141:0/2435873490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1bc159c40 0x7fa1bc0c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.999 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.994+0000 7fa1c3aa9640 1 --2- 172.21.15.141:0/2435873490 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1bc071690 0x7fa1bc14fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:06.999 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.994+0000 7fa1c3aa9640 1 -- 172.21.15.141:0/2435873490 >> 172.21.15.141:0/2435873490 conn(0x7fa1bc0cf140 msgr2=0x7fa1bc158f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:06.999 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.994+0000 7fa1c3aa9640 1 -- 172.21.15.141:0/2435873490 shutdown_connections 2023-11-04T01:36:06.999 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:06.994+0000 7fa1c3aa9640 1 -- 172.21.15.141:0/2435873490 wait complete. 2023-11-04T01:36:07.006 DEBUG:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new caa8d0cf-dcf6-442c-8540-81e0ac16ac26 3 2023-11-04T01:36:07.009 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:07.008+0000 7f3518630040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-04T01:36:07.027 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:07.025+0000 7f6b17416040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-04T01:36:07.057 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:07.055+0000 7f3518630040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-04T01:36:07.068 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:07.066+0000 7f6b17416040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-04T01:36:07.106 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.104+0000 7f4e59232640 1 Processor -- start 2023-11-04T01:36:07.106 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.104+0000 7f4e59232640 1 -- start start 2023-11-04T01:36:07.107 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.105+0000 7f4e59232640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4e5415cfd0 0x7f4e5406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.108 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.105+0000 7f4e59232640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e540cea20 con 0x7f4e540cf180 2023-11-04T01:36:07.108 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.105+0000 7f4e59232640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e540cf610 con 0x7f4e540cd570 2023-11-04T01:36:07.108 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.105+0000 7f4e59232640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5415d3b0 con 0x7f4e5415cfd0 2023-11-04T01:36:07.108 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.105+0000 7f4e52d9d640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4e5415cfd0 0x7f4e5406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.108 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.105+0000 7f4e52d9d640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4e5415cfd0 0x7f4e5406c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:36246/0 (socket says 172.21.15.141:36246) 2023-11-04T01:36:07.108 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.105+0000 7f4e52d9d640 1 -- 172.21.15.141:0/1787404026 learned_addr learned my addr 172.21.15.141:0/1787404026 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-04T01:36:07.108 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.106+0000 7f4e52d9d640 1 -- 172.21.15.141:0/1787404026 >> v1:172.21.15.141:6789/0 conn(0x7f4e540cd570 legacy=0x7f4e540cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.108 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.106+0000 7f4e52d9d640 1 -- 172.21.15.141:0/1787404026 >> v1:172.21.15.114:6789/0 conn(0x7f4e540cf180 legacy=0x7f4e54161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.109 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.106+0000 7f4e52d9d640 1 -- 172.21.15.141:0/1787404026 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e540cf8f0 con 0x7f4e5415cfd0 2023-11-04T01:36:07.124 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.106+0000 7f4e52d9d640 1 --2- 172.21.15.141:0/1787404026 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4e5415cfd0 0x7f4e5406c0a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009870 tx=0x7f4e4402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f17a43515dcdf3e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:07.124 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.107+0000 7f4e5259c640 1 -- 172.21.15.141:0/1787404026 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e44030860 con 0x7f4e5415cfd0 2023-11-04T01:36:07.124 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.107+0000 7f4e5259c640 1 -- 172.21.15.141:0/1787404026 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e440309c0 con 0x7f4e5415cfd0 2023-11-04T01:36:07.124 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.107+0000 7f4e5259c640 1 -- 172.21.15.141:0/1787404026 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e44030d50 con 0x7f4e5415cfd0 2023-11-04T01:36:07.124 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.107+0000 7f4e59232640 1 -- 172.21.15.141:0/1787404026 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4e5415cfd0 msgr2=0x7f4e5406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.125 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.107+0000 7f4e59232640 1 --2- 172.21.15.141:0/1787404026 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4e5415cfd0 0x7f4e5406c0a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009870 tx=0x7f4e4402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.130 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.107+0000 7f4e59232640 1 -- 172.21.15.141:0/1787404026 shutdown_connections 2023-11-04T01:36:07.131 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.107+0000 7f4e59232640 1 --2- 172.21.15.141:0/1787404026 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4e5415cfd0 0x7f4e5406c0a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.131 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.107+0000 7f4e59232640 1 -- 172.21.15.141:0/1787404026 >> 172.21.15.141:0/1787404026 conn(0x7f4e5406ea20 msgr2=0x7f4e5406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:07.131 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.107+0000 7f4e59232640 1 -- 172.21.15.141:0/1787404026 shutdown_connections 2023-11-04T01:36:07.131 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.107+0000 7f4e59232640 1 -- 172.21.15.141:0/1787404026 wait complete. 2023-11-04T01:36:07.131 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.109+0000 7f4e59232640 1 Processor -- start 2023-11-04T01:36:07.131 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.109+0000 7f4e59232640 1 -- start start 2023-11-04T01:36:07.131 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.109+0000 7f4e59232640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4e540cd570 0x7f4e540b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.131 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.109+0000 7f4e59232640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e5415cfd0 0x7f4e540c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.131 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.109+0000 7f4e59232640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4e5414eb50 0x7f4e540c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.131 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.109+0000 7f4e59232640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540b0a40 con 0x7f4e5415cfd0 2023-11-04T01:36:07.132 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.109+0000 7f4e59232640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540c9410 con 0x7f4e5414eb50 2023-11-04T01:36:07.132 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.109+0000 7f4e59232640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540b0230 con 0x7f4e540cd570 2023-11-04T01:36:07.132 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.109+0000 7f4e5359e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4e5414eb50 0x7f4e540c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.132 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.109+0000 7f4e52d9d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4e540cd570 0x7f4e540b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.132 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.109+0000 7f4e52d9d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4e540cd570 0x7f4e540b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:53660/0 (socket says 172.21.15.141:53660) 2023-11-04T01:36:07.132 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.109+0000 7f4e5359e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4e5414eb50 0x7f4e540c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:36260/0 (socket says 172.21.15.141:36260) 2023-11-04T01:36:07.132 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.109+0000 7f4e52d9d640 1 -- 172.21.15.141:0/3536413812 learned_addr learned my addr 172.21.15.141:0/3536413812 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-04T01:36:07.132 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.109+0000 7f4e4bfff640 1 --2- 172.21.15.141:0/3536413812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e5415cfd0 0x7f4e540c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.132 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.110+0000 7f4e5359e640 1 -- 172.21.15.141:0/3536413812 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4e540cd570 msgr2=0x7f4e540b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.132 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.110+0000 7f4e5359e640 1 --2- 172.21.15.141:0/3536413812 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4e540cd570 0x7f4e540b2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.132 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.110+0000 7f4e5359e640 1 -- 172.21.15.141:0/3536413812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e5415cfd0 msgr2=0x7f4e540c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.132 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.110+0000 7f4e5359e640 1 --2- 172.21.15.141:0/3536413812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e5415cfd0 0x7f4e540c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.132 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.110+0000 7f4e5359e640 1 -- 172.21.15.141:0/3536413812 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e440094d0 con 0x7f4e5414eb50 2023-11-04T01:36:07.133 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.110+0000 7f4e52d9d640 1 --2- 172.21.15.141:0/3536413812 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4e540cd570 0x7f4e540b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:07.146 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.110+0000 7f4e5359e640 1 --2- 172.21.15.141:0/3536413812 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4e5414eb50 0x7f4e540c9830 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00c700 tx=0x7f4e4c00cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:07.146 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.110+0000 7f4e4b7fe640 1 -- 172.21.15.141:0/3536413812 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c003b70 con 0x7f4e5414eb50 2023-11-04T01:36:07.146 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.110+0000 7f4e4b7fe640 1 -- 172.21.15.141:0/3536413812 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c003cd0 con 0x7f4e5414eb50 2023-11-04T01:36:07.146 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.110+0000 7f4e59232640 1 -- 172.21.15.141:0/3536413812 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e540b31b0 con 0x7f4e5414eb50 2023-11-04T01:36:07.146 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.110+0000 7f4e4b7fe640 1 -- 172.21.15.141:0/3536413812 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c005310 con 0x7f4e5414eb50 2023-11-04T01:36:07.146 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.110+0000 7f4e59232640 1 -- 172.21.15.141:0/3536413812 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e540b0760 con 0x7f4e5414eb50 2023-11-04T01:36:07.146 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.110+0000 7f4e4b7fe640 1 -- 172.21.15.141:0/3536413812 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4e4c00a640 con 0x7f4e5414eb50 2023-11-04T01:36:07.147 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.110+0000 7f4e4b7fe640 1 -- 172.21.15.141:0/3536413812 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f4e4c0128b0 con 0x7f4e5414eb50 2023-11-04T01:36:07.147 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.111+0000 7f4e59232640 1 -- 172.21.15.141:0/3536413812 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e540c9550 con 0x7f4e5414eb50 2023-11-04T01:36:07.147 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:07.112+0000 7f3518630040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-04T01:36:07.147 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.115+0000 7f4e4b7fe640 1 -- 172.21.15.141:0/3536413812 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f4e4c012420 con 0x7f4e5414eb50 2023-11-04T01:36:07.158 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:07.157+0000 7f3518630040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-04T01:36:07.168 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:07.166+0000 7f6b17416040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-04T01:36:07.188 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.186+0000 7f4e59232640 1 -- 172.21.15.141:0/3536413812 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd new", "uuid": "caa8d0cf-dcf6-442c-8540-81e0ac16ac26", "id": 3} v 0) v1 -- 0x7f4e5406d3c0 con 0x7f4e5414eb50 2023-11-04T01:36:07.193 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.191+0000 7f4e4b7fe640 1 -- 172.21.15.141:0/3536413812 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "caa8d0cf-dcf6-442c-8540-81e0ac16ac26", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4e4c012680 con 0x7f4e5414eb50 2023-11-04T01:36:07.193 INFO:teuthology.orchestra.run.smithi141.stdout:3 2023-11-04T01:36:07.194 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.192+0000 7f4e59232640 1 -- 172.21.15.141:0/3536413812 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4e5414eb50 msgr2=0x7f4e540c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.194 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.192+0000 7f4e59232640 1 --2- 172.21.15.141:0/3536413812 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4e5414eb50 0x7f4e540c9830 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00c700 tx=0x7f4e4c00cbc0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.194 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.192+0000 7f4e59232640 1 -- 172.21.15.141:0/3536413812 shutdown_connections 2023-11-04T01:36:07.194 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.192+0000 7f4e59232640 1 --2- 172.21.15.141:0/3536413812 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4e5414eb50 0x7f4e540c9830 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.194 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.192+0000 7f4e59232640 1 --2- 172.21.15.141:0/3536413812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e5415cfd0 0x7f4e540c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.194 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.192+0000 7f4e59232640 1 --2- 172.21.15.141:0/3536413812 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4e540cd570 0x7f4e540b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.194 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.192+0000 7f4e59232640 1 -- 172.21.15.141:0/3536413812 >> 172.21.15.141:0/3536413812 conn(0x7f4e5406ea20 msgr2=0x7f4e5415d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:07.195 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.192+0000 7f4e59232640 1 -- 172.21.15.141:0/3536413812 shutdown_connections 2023-11-04T01:36:07.195 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.192+0000 7f4e59232640 1 -- 172.21.15.141:0/3536413812 wait complete. 2023-11-04T01:36:07.204 DEBUG:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new 28711f7b-6b23-4495-b56a-ceb781be62f4 4 2023-11-04T01:36:07.238 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:07.234+0000 7f6b17416040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-04T01:36:07.266 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:07.263+0000 7f3518630040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-04T01:36:07.280 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:07.279+0000 7f6b17416040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-04T01:36:07.304 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.302+0000 7f563394c640 1 Processor -- start 2023-11-04T01:36:07.304 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.302+0000 7f563394c640 1 -- start start 2023-11-04T01:36:07.305 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.303+0000 7f563394c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f562c15cfd0 0x7f562c06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.303+0000 7f563394c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f562c0cf180 0x7f562c161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.303+0000 7f563394c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f562c0cea20 con 0x7f562c0cd570 2023-11-04T01:36:07.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.303+0000 7f563394c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f562c15d3b0 con 0x7f562c15cfd0 2023-11-04T01:36:07.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.303+0000 7f563394c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f562c161980 con 0x7f562c0cf180 2023-11-04T01:36:07.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.303+0000 7f5630ee7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f562c0cf180 0x7f562c161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.306 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.303+0000 7f5630ee7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f562c0cf180 0x7f562c161440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:36268/0 (socket says 172.21.15.141:36268) 2023-11-04T01:36:07.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.303+0000 7f5630ee7640 1 -- 172.21.15.141:0/959479694 learned_addr learned my addr 172.21.15.141:0/959479694 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-04T01:36:07.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.303+0000 7f56316e8640 1 --2- 172.21.15.141:0/959479694 >> v2:172.21.15.114:3300/0 conn(0x7f562c15cfd0 0x7f562c06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.303+0000 7f5630ee7640 1 -- 172.21.15.141:0/959479694 >> v2:172.21.15.114:3300/0 conn(0x7f562c15cfd0 msgr2=0x7f562c06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:07.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.303+0000 7f5630ee7640 1 --2- 172.21.15.141:0/959479694 >> v2:172.21.15.114:3300/0 conn(0x7f562c15cfd0 0x7f562c06c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.303+0000 7f5630ee7640 1 -- 172.21.15.141:0/959479694 >> v1:172.21.15.114:6789/0 conn(0x7f562c0cd570 legacy=0x7f562c0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.307 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.303+0000 7f5630ee7640 1 -- 172.21.15.141:0/959479694 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562c0cf610 con 0x7f562c0cf180 2023-11-04T01:36:07.313 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.305+0000 7f5630ee7640 1 --2- 172.21.15.141:0/959479694 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f562c0cf180 0x7f562c161440 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f562c06b0c0 tx=0x7f562802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d659dd29f229d880 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:07.313 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.305+0000 7f5623fff640 1 -- 172.21.15.141:0/959479694 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628031870 con 0x7f562c0cf180 2023-11-04T01:36:07.313 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.305+0000 7f5623fff640 1 -- 172.21.15.141:0/959479694 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56280319d0 con 0x7f562c0cf180 2023-11-04T01:36:07.313 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.305+0000 7f5623fff640 1 -- 172.21.15.141:0/959479694 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628031d60 con 0x7f562c0cf180 2023-11-04T01:36:07.313 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.305+0000 7f563394c640 1 -- 172.21.15.141:0/959479694 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f562c0cf180 msgr2=0x7f562c161440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.314 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.305+0000 7f563394c640 1 --2- 172.21.15.141:0/959479694 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f562c0cf180 0x7f562c161440 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f562c06b0c0 tx=0x7f562802b910 comp rx=0 tx=0).stop 2023-11-04T01:36:07.314 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.305+0000 7f563394c640 1 -- 172.21.15.141:0/959479694 shutdown_connections 2023-11-04T01:36:07.314 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.305+0000 7f563394c640 1 --2- 172.21.15.141:0/959479694 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f562c0cf180 0x7f562c161440 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.314 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.305+0000 7f563394c640 1 --2- 172.21.15.141:0/959479694 >> v2:172.21.15.114:3300/0 conn(0x7f562c15cfd0 0x7f562c06c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.315 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.305+0000 7f563394c640 1 -- 172.21.15.141:0/959479694 >> 172.21.15.141:0/959479694 conn(0x7f562c06ea20 msgr2=0x7f562c06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:07.315 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.305+0000 7f563394c640 1 -- 172.21.15.141:0/959479694 shutdown_connections 2023-11-04T01:36:07.315 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.305+0000 7f563394c640 1 -- 172.21.15.141:0/959479694 wait complete. 2023-11-04T01:36:07.315 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.307+0000 7f563394c640 1 Processor -- start 2023-11-04T01:36:07.315 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.307+0000 7f563394c640 1 -- start start 2023-11-04T01:36:07.316 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.307+0000 7f563394c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f562c0cd570 0x7f562c0b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.316 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.307+0000 7f563394c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f562c15cfd0 0x7f562c15f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.316 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.307+0000 7f563394c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f562c0b1410 0x7f562c156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.316 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.307+0000 7f563394c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c0b3120 con 0x7f562c0cd570 2023-11-04T01:36:07.316 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.307+0000 7f563394c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c0c8140 con 0x7f562c15cfd0 2023-11-04T01:36:07.316 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.307+0000 7f563394c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562c0c7e10 con 0x7f562c0b1410 2023-11-04T01:36:07.317 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.307+0000 7f5630ee7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f562c15cfd0 0x7f562c15f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.317 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.307+0000 7f5631ee9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f562c0b1410 0x7f562c156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.317 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.307+0000 7f5630ee7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f562c15cfd0 0x7f562c15f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:36278/0 (socket says 172.21.15.141:36278) 2023-11-04T01:36:07.317 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.307+0000 7f5630ee7640 1 -- 172.21.15.141:0/1173460838 learned_addr learned my addr 172.21.15.141:0/1173460838 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-04T01:36:07.318 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.308+0000 7f56316e8640 1 --2- 172.21.15.141:0/1173460838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f562c0cd570 0x7f562c0b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.318 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.308+0000 7f5630ee7640 1 -- 172.21.15.141:0/1173460838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f562c0b1410 msgr2=0x7f562c156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.319 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.308+0000 7f5630ee7640 1 --2- 172.21.15.141:0/1173460838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f562c0b1410 0x7f562c156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.319 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.308+0000 7f5630ee7640 1 -- 172.21.15.141:0/1173460838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f562c0cd570 msgr2=0x7f562c0b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.320 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.308+0000 7f5630ee7640 1 --2- 172.21.15.141:0/1173460838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f562c0cd570 0x7f562c0b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.321 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.308+0000 7f5630ee7640 1 -- 172.21.15.141:0/1173460838 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56280094d0 con 0x7f562c15cfd0 2023-11-04T01:36:07.321 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.308+0000 7f56316e8640 1 --2- 172.21.15.141:0/1173460838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f562c0cd570 0x7f562c0b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:07.321 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.308+0000 7f5630ee7640 1 --2- 172.21.15.141:0/1173460838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f562c15cfd0 0x7f562c15f840 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f562802b950 tx=0x7f56280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:07.321 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.308+0000 7f5621ffb640 1 -- 172.21.15.141:0/1173460838 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562803abe0 con 0x7f562c15cfd0 2023-11-04T01:36:07.321 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.308+0000 7f5621ffb640 1 -- 172.21.15.141:0/1173460838 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562803ad60 con 0x7f562c15cfd0 2023-11-04T01:36:07.321 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.308+0000 7f563394c640 1 -- 172.21.15.141:0/1173460838 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f562c0b2b60 con 0x7f562c15cfd0 2023-11-04T01:36:07.321 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.308+0000 7f5621ffb640 1 -- 172.21.15.141:0/1173460838 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628044630 con 0x7f562c15cfd0 2023-11-04T01:36:07.321 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.308+0000 7f563394c640 1 -- 172.21.15.141:0/1173460838 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f562c0b2840 con 0x7f562c15cfd0 2023-11-04T01:36:07.321 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.309+0000 7f5621ffb640 1 -- 172.21.15.141:0/1173460838 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5628044a90 con 0x7f562c15cfd0 2023-11-04T01:36:07.321 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.309+0000 7f5621ffb640 1 -- 172.21.15.141:0/1173460838 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f562802d040 con 0x7f562c15cfd0 2023-11-04T01:36:07.322 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.309+0000 7f563394c640 1 -- 172.21.15.141:0/1173460838 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f562c0c7c50 con 0x7f562c15cfd0 2023-11-04T01:36:07.322 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.311+0000 7f5621ffb640 1 -- 172.21.15.141:0/1173460838 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f5628052060 con 0x7f562c15cfd0 2023-11-04T01:36:07.332 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:07.330+0000 7f6b17416040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-04T01:36:07.342 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:07.336+0000 7f3518630040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-04T01:36:07.379 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:07.376+0000 7f6b17416040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-04T01:36:07.383 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.381+0000 7f563394c640 1 -- 172.21.15.141:0/1173460838 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd new", "uuid": "28711f7b-6b23-4495-b56a-ceb781be62f4", "id": 4} v 0) v1 -- 0x7f562c0c7f50 con 0x7f562c15cfd0 2023-11-04T01:36:07.383 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:07.382+0000 7f3518630040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-04T01:36:07.389 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.386+0000 7f5621ffb640 1 -- 172.21.15.141:0/1173460838 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "28711f7b-6b23-4495-b56a-ceb781be62f4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5628035020 con 0x7f562c15cfd0 2023-11-04T01:36:07.390 INFO:teuthology.orchestra.run.smithi141.stdout:4 2023-11-04T01:36:07.391 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.387+0000 7f563394c640 1 -- 172.21.15.141:0/1173460838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f562c15cfd0 msgr2=0x7f562c15f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.391 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.387+0000 7f563394c640 1 --2- 172.21.15.141:0/1173460838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f562c15cfd0 0x7f562c15f840 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f562802b950 tx=0x7f56280046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.391 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.387+0000 7f563394c640 1 -- 172.21.15.141:0/1173460838 shutdown_connections 2023-11-04T01:36:07.391 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.387+0000 7f563394c640 1 --2- 172.21.15.141:0/1173460838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f562c0b1410 0x7f562c156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.392 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.387+0000 7f563394c640 1 --2- 172.21.15.141:0/1173460838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f562c15cfd0 0x7f562c15f840 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.392 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.387+0000 7f563394c640 1 --2- 172.21.15.141:0/1173460838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f562c0cd570 0x7f562c0b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.392 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.387+0000 7f563394c640 1 -- 172.21.15.141:0/1173460838 >> 172.21.15.141:0/1173460838 conn(0x7f562c06ea20 msgr2=0x7f562c0c66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:07.392 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.387+0000 7f563394c640 1 -- 172.21.15.141:0/1173460838 shutdown_connections 2023-11-04T01:36:07.392 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.387+0000 7f563394c640 1 -- 172.21.15.141:0/1173460838 wait complete. 2023-11-04T01:36:07.401 DEBUG:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new aea1cd1f-d96a-48b5-bf75-30430c23dfd6 5 2023-11-04T01:36:07.440 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:07.438+0000 7f3518630040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-04T01:36:07.489 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:07.487+0000 7f3518630040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-04T01:36:07.508 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.504+0000 7f32fb13c640 1 Processor -- start 2023-11-04T01:36:07.508 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.504+0000 7f32fb13c640 1 -- start start 2023-11-04T01:36:07.508 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.505+0000 7f32fb13c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32f40b64c0 0x7f32f40b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.509 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.505+0000 7f32fb13c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f32f40cd3b0 0x7f32f40cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.509 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.505+0000 7f32fb13c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f40d01f0 con 0x7f32f415af20 2023-11-04T01:36:07.509 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.505+0000 7f32fb13c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f40cc380 con 0x7f32f40cd3b0 2023-11-04T01:36:07.509 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.505+0000 7f32fb13c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f40cdd80 con 0x7f32f40b64c0 2023-11-04T01:36:07.509 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.505+0000 7f32f3fff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32f40b64c0 0x7f32f40b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.509 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.505+0000 7f32f96d9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f32f40cd3b0 0x7f32f40cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.509 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.505+0000 7f32f3fff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32f40b64c0 0x7f32f40b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:35440/0 (socket says 172.21.15.141:35440) 2023-11-04T01:36:07.509 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.505+0000 7f32f3fff640 1 -- 172.21.15.141:0/4028099446 learned_addr learned my addr 172.21.15.141:0/4028099446 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-04T01:36:07.509 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.506+0000 7f32f3fff640 1 -- 172.21.15.141:0/4028099446 >> v2:172.21.15.141:3300/0 conn(0x7f32f40cd3b0 msgr2=0x7f32f40cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:07.509 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.506+0000 7f32f3fff640 1 --2- 172.21.15.141:0/4028099446 >> v2:172.21.15.141:3300/0 conn(0x7f32f40cd3b0 0x7f32f40cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.510 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.506+0000 7f32f3fff640 1 -- 172.21.15.141:0/4028099446 >> v1:172.21.15.141:6789/0 conn(0x7f32f415af20 legacy=0x7f32f40cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.510 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.506+0000 7f32f3fff640 1 -- 172.21.15.141:0/4028099446 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f40b6a40 con 0x7f32f40b64c0 2023-11-04T01:36:07.510 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.506+0000 7f32f96d9640 1 --2- 172.21.15.141:0/4028099446 >> v2:172.21.15.141:3300/0 conn(0x7f32f40cd3b0 0x7f32f40cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:07.510 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.506+0000 7f32f3fff640 1 --2- 172.21.15.141:0/4028099446 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32f40b64c0 0x7f32f40b3cd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009870 tx=0x7f32e002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba7a1d64e459faaa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:07.510 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.507+0000 7f32f37fe640 1 -- 172.21.15.141:0/4028099446 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0030840 con 0x7f32f40b64c0 2023-11-04T01:36:07.510 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.507+0000 7f32f37fe640 1 -- 172.21.15.141:0/4028099446 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e00309a0 con 0x7f32f40b64c0 2023-11-04T01:36:07.510 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.507+0000 7f32f37fe640 1 -- 172.21.15.141:0/4028099446 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0030d30 con 0x7f32f40b64c0 2023-11-04T01:36:07.526 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.507+0000 7f32fb13c640 1 -- 172.21.15.141:0/4028099446 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32f40b64c0 msgr2=0x7f32f40b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.526 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.507+0000 7f32fb13c640 1 --2- 172.21.15.141:0/4028099446 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32f40b64c0 0x7f32f40b3cd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009870 tx=0x7f32e002b980 comp rx=0 tx=0).stop 2023-11-04T01:36:07.526 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.507+0000 7f32fb13c640 1 -- 172.21.15.141:0/4028099446 shutdown_connections 2023-11-04T01:36:07.526 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.507+0000 7f32fb13c640 1 --2- 172.21.15.141:0/4028099446 >> v2:172.21.15.141:3300/0 conn(0x7f32f40cd3b0 0x7f32f40cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.526 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.507+0000 7f32fb13c640 1 --2- 172.21.15.141:0/4028099446 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32f40b64c0 0x7f32f40b3cd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.526 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.507+0000 7f32fb13c640 1 -- 172.21.15.141:0/4028099446 >> 172.21.15.141:0/4028099446 conn(0x7f32f406ea20 msgr2=0x7f32f406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:07.527 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.507+0000 7f32fb13c640 1 -- 172.21.15.141:0/4028099446 shutdown_connections 2023-11-04T01:36:07.527 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.507+0000 7f32fb13c640 1 -- 172.21.15.141:0/4028099446 wait complete. 2023-11-04T01:36:07.527 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.508+0000 7f32fb13c640 1 Processor -- start 2023-11-04T01:36:07.527 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.508+0000 7f32fb13c640 1 -- start start 2023-11-04T01:36:07.527 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.509+0000 7f32fb13c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32f40b64c0 0x7f32f4154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.527 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.509+0000 7f32fb13c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32f40cd3b0 0x7f32f40c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.528 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.509+0000 7f32fb13c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32f415af20 0x7f32f40b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.528 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.509+0000 7f32fb13c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f40c8800 con 0x7f32f40cd3b0 2023-11-04T01:36:07.528 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.509+0000 7f32fb13c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f4154cd0 con 0x7f32f40b64c0 2023-11-04T01:36:07.528 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.509+0000 7f32fb13c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f4154fb0 con 0x7f32f415af20 2023-11-04T01:36:07.528 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.509+0000 7f32f96d9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32f415af20 0x7f32f40b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.528 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.509+0000 7f32f8ed8640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32f40b64c0 0x7f32f4154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.528 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.509+0000 7f32f96d9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32f415af20 0x7f32f40b05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:35442/0 (socket says 172.21.15.141:35442) 2023-11-04T01:36:07.528 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.509+0000 7f32f96d9640 1 -- 172.21.15.141:0/3138867082 learned_addr learned my addr 172.21.15.141:0/3138867082 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-04T01:36:07.528 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.510+0000 7f32f3fff640 1 --2- 172.21.15.141:0/3138867082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32f40cd3b0 0x7f32f40c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.528 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.510+0000 7f32f96d9640 1 -- 172.21.15.141:0/3138867082 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32f40b64c0 msgr2=0x7f32f4154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.529 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.510+0000 7f32f96d9640 1 --2- 172.21.15.141:0/3138867082 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32f40b64c0 0x7f32f4154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.529 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.510+0000 7f32f96d9640 1 -- 172.21.15.141:0/3138867082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32f40cd3b0 msgr2=0x7f32f40c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.529 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.510+0000 7f32f96d9640 1 --2- 172.21.15.141:0/3138867082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32f40cd3b0 0x7f32f40c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.529 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.510+0000 7f32f96d9640 1 -- 172.21.15.141:0/3138867082 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ec009a70 con 0x7f32f415af20 2023-11-04T01:36:07.529 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.510+0000 7f32f3fff640 1 --2- 172.21.15.141:0/3138867082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32f40cd3b0 0x7f32f40c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:07.529 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.510+0000 7f32f96d9640 1 --2- 172.21.15.141:0/3138867082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32f415af20 0x7f32f40b05d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00b330 tx=0x7f32ec00b7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:07.529 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.510+0000 7f32f17fa640 1 -- 172.21.15.141:0/3138867082 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec015070 con 0x7f32f415af20 2023-11-04T01:36:07.529 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.510+0000 7f32f17fa640 1 -- 172.21.15.141:0/3138867082 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec003990 con 0x7f32f415af20 2023-11-04T01:36:07.529 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.510+0000 7f32fb13c640 1 -- 172.21.15.141:0/3138867082 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e00094d0 con 0x7f32f415af20 2023-11-04T01:36:07.529 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.510+0000 7f32f17fa640 1 -- 172.21.15.141:0/3138867082 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec009d70 con 0x7f32f415af20 2023-11-04T01:36:07.530 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.510+0000 7f32fb13c640 1 -- 172.21.15.141:0/3138867082 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f40c8aa0 con 0x7f32f415af20 2023-11-04T01:36:07.530 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.510+0000 7f32f17fa640 1 -- 172.21.15.141:0/3138867082 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f32ec004020 con 0x7f32f415af20 2023-11-04T01:36:07.530 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.510+0000 7f32f17fa640 1 -- 172.21.15.141:0/3138867082 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f32ec0042d0 con 0x7f32f415af20 2023-11-04T01:36:07.530 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.511+0000 7f32fb13c640 1 -- 172.21.15.141:0/3138867082 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f40cdb30 con 0x7f32f415af20 2023-11-04T01:36:07.530 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.514+0000 7f32f17fa640 1 -- 172.21.15.141:0/3138867082 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f32ec027060 con 0x7f32f415af20 2023-11-04T01:36:07.587 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.586+0000 7f32fb13c640 1 -- 172.21.15.141:0/3138867082 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aea1cd1f-d96a-48b5-bf75-30430c23dfd6", "id": 5} v 0) v1 -- 0x7f32f406efe0 con 0x7f32f415af20 2023-11-04T01:36:07.595 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.591+0000 7f32f17fa640 1 -- 172.21.15.141:0/3138867082 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aea1cd1f-d96a-48b5-bf75-30430c23dfd6", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f32ec0045b0 con 0x7f32f415af20 2023-11-04T01:36:07.595 INFO:teuthology.orchestra.run.smithi141.stdout:5 2023-11-04T01:36:07.596 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.592+0000 7f32fb13c640 1 -- 172.21.15.141:0/3138867082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32f415af20 msgr2=0x7f32f40b05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.596 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.592+0000 7f32fb13c640 1 --2- 172.21.15.141:0/3138867082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32f415af20 0x7f32f40b05d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00b330 tx=0x7f32ec00b7f0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.596 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.592+0000 7f32fb13c640 1 -- 172.21.15.141:0/3138867082 shutdown_connections 2023-11-04T01:36:07.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.592+0000 7f32fb13c640 1 --2- 172.21.15.141:0/3138867082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32f415af20 0x7f32f40b05d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.592+0000 7f32fb13c640 1 --2- 172.21.15.141:0/3138867082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32f40cd3b0 0x7f32f40c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.592+0000 7f32fb13c640 1 --2- 172.21.15.141:0/3138867082 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32f40b64c0 0x7f32f4154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.592+0000 7f32fb13c640 1 -- 172.21.15.141:0/3138867082 >> 172.21.15.141:0/3138867082 conn(0x7f32f406ea20 msgr2=0x7f32f4156800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:07.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.592+0000 7f32fb13c640 1 -- 172.21.15.141:0/3138867082 shutdown_connections 2023-11-04T01:36:07.597 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.592+0000 7f32fb13c640 1 -- 172.21.15.141:0/3138867082 wait complete. 2023-11-04T01:36:07.604 DEBUG:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new 8089dcf3-5d4c-4580-a21f-e6650bf52eae 6 2023-11-04T01:36:07.745 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.743+0000 7fd46dd5e640 1 Processor -- start 2023-11-04T01:36:07.745 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.743+0000 7fd46dd5e640 1 -- start start 2023-11-04T01:36:07.747 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.744+0000 7fd46dd5e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd46815cfd0 0x7fd46806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.747 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.744+0000 7fd46dd5e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4680cf180 0x7fd468161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.747 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.744+0000 7fd46dd5e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4680cea20 con 0x7fd4680cd570 2023-11-04T01:36:07.747 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.744+0000 7fd46dd5e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46815d3b0 con 0x7fd46815cfd0 2023-11-04T01:36:07.747 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.744+0000 7fd46dd5e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd468161980 con 0x7fd4680cf180 2023-11-04T01:36:07.747 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.744+0000 7fd45effd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4680cf180 0x7fd468161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.748 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.744+0000 7fd4677fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd46815cfd0 0x7fd46806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.748 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.744+0000 7fd4677fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd46815cfd0 0x7fd46806c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:59424/0 (socket says 172.21.15.141:59424) 2023-11-04T01:36:07.748 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.744+0000 7fd45effd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4680cf180 0x7fd468161440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:35444/0 (socket says 172.21.15.141:35444) 2023-11-04T01:36:07.748 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.744+0000 7fd4677fe640 1 -- 172.21.15.141:0/952996094 learned_addr learned my addr 172.21.15.141:0/952996094 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-04T01:36:07.748 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.745+0000 7fd45effd640 1 -- 172.21.15.141:0/952996094 >> v2:172.21.15.141:3300/0 conn(0x7fd46815cfd0 msgr2=0x7fd46806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:07.748 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.745+0000 7fd45effd640 1 --2- 172.21.15.141:0/952996094 >> v2:172.21.15.141:3300/0 conn(0x7fd46815cfd0 0x7fd46806c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.748 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.745+0000 7fd45effd640 1 -- 172.21.15.141:0/952996094 >> v1:172.21.15.141:6789/0 conn(0x7fd4680cd570 legacy=0x7fd4680cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.748 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.745+0000 7fd45effd640 1 -- 172.21.15.141:0/952996094 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4680cf610 con 0x7fd4680cf180 2023-11-04T01:36:07.748 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.745+0000 7fd4677fe640 1 --2- 172.21.15.141:0/952996094 >> v2:172.21.15.141:3300/0 conn(0x7fd46815cfd0 0x7fd46806c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:07.748 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.745+0000 7fd45effd640 1 --2- 172.21.15.141:0/952996094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4680cf180 0x7fd468161440 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd4500097a0 tx=0x7fd45002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=356df55eb65944a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:07.748 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.746+0000 7fd466ffd640 1 -- 172.21.15.141:0/952996094 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45002e070 con 0x7fd4680cf180 2023-11-04T01:36:07.748 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.746+0000 7fd466ffd640 1 -- 172.21.15.141:0/952996094 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4500315a0 con 0x7fd4680cf180 2023-11-04T01:36:07.748 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.746+0000 7fd466ffd640 1 -- 172.21.15.141:0/952996094 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450031930 con 0x7fd4680cf180 2023-11-04T01:36:07.750 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.746+0000 7fd46dd5e640 1 -- 172.21.15.141:0/952996094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4680cf180 msgr2=0x7fd468161440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.750 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.746+0000 7fd46dd5e640 1 --2- 172.21.15.141:0/952996094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4680cf180 0x7fd468161440 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd4500097a0 tx=0x7fd45002b840 comp rx=0 tx=0).stop 2023-11-04T01:36:07.750 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.746+0000 7fd46dd5e640 1 -- 172.21.15.141:0/952996094 shutdown_connections 2023-11-04T01:36:07.750 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.746+0000 7fd46dd5e640 1 --2- 172.21.15.141:0/952996094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4680cf180 0x7fd468161440 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.751 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.746+0000 7fd46dd5e640 1 --2- 172.21.15.141:0/952996094 >> v2:172.21.15.141:3300/0 conn(0x7fd46815cfd0 0x7fd46806c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.751 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.746+0000 7fd46dd5e640 1 -- 172.21.15.141:0/952996094 >> 172.21.15.141:0/952996094 conn(0x7fd46806ea20 msgr2=0x7fd46806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:07.751 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.746+0000 7fd46dd5e640 1 -- 172.21.15.141:0/952996094 shutdown_connections 2023-11-04T01:36:07.751 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.746+0000 7fd46dd5e640 1 -- 172.21.15.141:0/952996094 wait complete. 2023-11-04T01:36:07.751 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.748+0000 7fd46dd5e640 1 Processor -- start 2023-11-04T01:36:07.751 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.748+0000 7fd46dd5e640 1 -- start start 2023-11-04T01:36:07.751 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:07.748+0000 7f6b17416040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-04T01:36:07.754 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd46dd5e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4680cd570 0x7fd4680b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.754 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd46dd5e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd46815cfd0 0x7fd468156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.754 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd46dd5e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd46815f300 0x7fd46815f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.754 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd46dd5e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46815fcd0 con 0x7fd46815cfd0 2023-11-04T01:36:07.755 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd46dd5e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4680b4790 con 0x7fd4680cd570 2023-11-04T01:36:07.755 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd46dd5e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4680c8860 con 0x7fd46815f300 2023-11-04T01:36:07.755 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd467fff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd46815f300 0x7fd46815f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.755 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd4677fe640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4680cd570 0x7fd4680b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.755 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd467fff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd46815f300 0x7fd46815f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.141:35460/0 (socket says 172.21.15.141:35460) 2023-11-04T01:36:07.755 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd467fff640 1 -- 172.21.15.141:0/2938275008 learned_addr learned my addr 172.21.15.141:0/2938275008 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-04T01:36:07.755 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd45effd640 1 --2- 172.21.15.141:0/2938275008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd46815cfd0 0x7fd468156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.755 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd4677fe640 1 -- 172.21.15.141:0/2938275008 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd46815f300 msgr2=0x7fd46815f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.755 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd4677fe640 1 --2- 172.21.15.141:0/2938275008 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd46815f300 0x7fd46815f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.755 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd4677fe640 1 -- 172.21.15.141:0/2938275008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd46815cfd0 msgr2=0x7fd468156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.755 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd4677fe640 1 --2- 172.21.15.141:0/2938275008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd46815cfd0 0x7fd468156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.756 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd4677fe640 1 -- 172.21.15.141:0/2938275008 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4580094d0 con 0x7fd4680cd570 2023-11-04T01:36:07.756 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd4677fe640 1 --2- 172.21.15.141:0/2938275008 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4680cd570 0x7fd4680b0430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd45800e900 tx=0x7fd45800edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:07.756 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd464ff9640 1 -- 172.21.15.141:0/2938275008 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45800ca00 con 0x7fd4680cd570 2023-11-04T01:36:07.756 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd464ff9640 1 -- 172.21.15.141:0/2938275008 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45800cb60 con 0x7fd4680cd570 2023-11-04T01:36:07.756 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd46dd5e640 1 -- 172.21.15.141:0/2938275008 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd450009400 con 0x7fd4680cd570 2023-11-04T01:36:07.756 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd464ff9640 1 -- 172.21.15.141:0/2938275008 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458004030 con 0x7fd4680cd570 2023-11-04T01:36:07.756 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.749+0000 7fd46dd5e640 1 -- 172.21.15.141:0/2938275008 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4680b09c0 con 0x7fd4680cd570 2023-11-04T01:36:07.756 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.750+0000 7fd464ff9640 1 -- 172.21.15.141:0/2938275008 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd458005990 con 0x7fd4680cd570 2023-11-04T01:36:07.756 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.750+0000 7fd464ff9640 1 -- 172.21.15.141:0/2938275008 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fd458006020 con 0x7fd4680cd570 2023-11-04T01:36:07.756 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.750+0000 7fd46dd5e640 1 -- 172.21.15.141:0/2938275008 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46806b300 con 0x7fd4680cd570 2023-11-04T01:36:07.756 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.752+0000 7fd464ff9640 1 -- 172.21.15.141:0/2938275008 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fd458020060 con 0x7fd4680cd570 2023-11-04T01:36:07.825 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.824+0000 7fd46dd5e640 1 -- 172.21.15.141:0/2938275008 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8089dcf3-5d4c-4580-a21f-e6650bf52eae", "id": 6} v 0) v1 -- 0x7fd4680cda60 con 0x7fd4680cd570 2023-11-04T01:36:07.831 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.829+0000 7fd464ff9640 1 -- 172.21.15.141:0/2938275008 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8089dcf3-5d4c-4580-a21f-e6650bf52eae", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd458005e20 con 0x7fd4680cd570 2023-11-04T01:36:07.831 INFO:teuthology.orchestra.run.smithi141.stdout:6 2023-11-04T01:36:07.832 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.830+0000 7fd46dd5e640 1 -- 172.21.15.141:0/2938275008 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4680cd570 msgr2=0x7fd4680b0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.832 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.830+0000 7fd46dd5e640 1 --2- 172.21.15.141:0/2938275008 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4680cd570 0x7fd4680b0430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd45800e900 tx=0x7fd45800edc0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.832 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.830+0000 7fd46dd5e640 1 -- 172.21.15.141:0/2938275008 shutdown_connections 2023-11-04T01:36:07.832 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.830+0000 7fd46dd5e640 1 --2- 172.21.15.141:0/2938275008 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd46815f300 0x7fd46815f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.832 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.830+0000 7fd46dd5e640 1 --2- 172.21.15.141:0/2938275008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd46815cfd0 0x7fd468156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.832 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.830+0000 7fd46dd5e640 1 --2- 172.21.15.141:0/2938275008 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4680cd570 0x7fd4680b0430 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.833 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.830+0000 7fd46dd5e640 1 -- 172.21.15.141:0/2938275008 >> 172.21.15.141:0/2938275008 conn(0x7fd46806ea20 msgr2=0x7fd468160770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:07.833 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.830+0000 7fd46dd5e640 1 -- 172.21.15.141:0/2938275008 shutdown_connections 2023-11-04T01:36:07.833 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.830+0000 7fd46dd5e640 1 -- 172.21.15.141:0/2938275008 wait complete. 2023-11-04T01:36:07.846 DEBUG:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new 376f771f-a662-4387-8ae2-4e41699973d8 7 2023-11-04T01:36:07.883 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:07.881+0000 7f6b17416040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-04T01:36:07.890 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:07.888+0000 7f3518630040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-04T01:36:07.953 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.951+0000 7f69928a9640 1 Processor -- start 2023-11-04T01:36:07.953 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.951+0000 7f69928a9640 1 -- start start 2023-11-04T01:36:07.955 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.952+0000 7f69928a9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f698c1603d0 0x7f698c0b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.955 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.952+0000 7f69928a9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f698c06a830 0x7f698c0ca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.955 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.952+0000 7f69928a9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698c0cdf80 con 0x7f698c0722a0 2023-11-04T01:36:07.955 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.952+0000 7f69928a9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698c0b19d0 con 0x7f698c06a830 2023-11-04T01:36:07.955 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.952+0000 7f69928a9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698c0ce6f0 con 0x7f698c1603d0 2023-11-04T01:36:07.955 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.952+0000 7f698bfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f698c1603d0 0x7f698c0b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.955 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.952+0000 7f698bfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f698c1603d0 0x7f698c0b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:59442/0 (socket says 172.21.15.141:59442) 2023-11-04T01:36:07.955 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.952+0000 7f698bfff640 1 -- 172.21.15.141:0/675023201 learned_addr learned my addr 172.21.15.141:0/675023201 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-04T01:36:07.955 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.952+0000 7f6990e46640 1 --2- 172.21.15.141:0/675023201 >> v2:172.21.15.114:3300/0 conn(0x7f698c06a830 0x7f698c0ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.955 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.952+0000 7f698bfff640 1 -- 172.21.15.141:0/675023201 >> v2:172.21.15.114:3300/0 conn(0x7f698c06a830 msgr2=0x7f698c0ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:07.955 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.952+0000 7f698bfff640 1 --2- 172.21.15.141:0/675023201 >> v2:172.21.15.114:3300/0 conn(0x7f698c06a830 0x7f698c0ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.955 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.952+0000 7f698bfff640 1 -- 172.21.15.141:0/675023201 >> v1:172.21.15.141:6789/0 conn(0x7f698c0722a0 legacy=0x7f698c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.956 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.952+0000 7f698bfff640 1 -- 172.21.15.141:0/675023201 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c072700 con 0x7f698c1603d0 2023-11-04T01:36:07.956 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.952+0000 7f6990e46640 1 --2- 172.21.15.141:0/675023201 >> v2:172.21.15.114:3300/0 conn(0x7f698c06a830 0x7f698c0ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:07.956 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.953+0000 7f698bfff640 1 --2- 172.21.15.141:0/675023201 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f698c1603d0 0x7f698c0b1490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f698c0cd530 tx=0x7f698002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6adc6f1db095ecf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:07.956 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.953+0000 7f698affd640 1 -- 172.21.15.141:0/675023201 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6980031870 con 0x7f698c1603d0 2023-11-04T01:36:07.956 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.953+0000 7f698affd640 1 -- 172.21.15.141:0/675023201 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69800319d0 con 0x7f698c1603d0 2023-11-04T01:36:07.956 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.953+0000 7f698affd640 1 -- 172.21.15.141:0/675023201 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6980031d60 con 0x7f698c1603d0 2023-11-04T01:36:07.958 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.954+0000 7f69928a9640 1 -- 172.21.15.141:0/675023201 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f698c1603d0 msgr2=0x7f698c0b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.958 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.954+0000 7f69928a9640 1 --2- 172.21.15.141:0/675023201 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f698c1603d0 0x7f698c0b1490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f698c0cd530 tx=0x7f698002b910 comp rx=0 tx=0).stop 2023-11-04T01:36:07.958 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.954+0000 7f69928a9640 1 -- 172.21.15.141:0/675023201 shutdown_connections 2023-11-04T01:36:07.958 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.954+0000 7f69928a9640 1 --2- 172.21.15.141:0/675023201 >> v2:172.21.15.114:3300/0 conn(0x7f698c06a830 0x7f698c0ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.958 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.954+0000 7f69928a9640 1 --2- 172.21.15.141:0/675023201 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f698c1603d0 0x7f698c0b1490 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.958 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.954+0000 7f69928a9640 1 -- 172.21.15.141:0/675023201 >> 172.21.15.141:0/675023201 conn(0x7f698c06d800 msgr2=0x7f698c06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:07.958 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.954+0000 7f69928a9640 1 -- 172.21.15.141:0/675023201 shutdown_connections 2023-11-04T01:36:07.958 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.954+0000 7f69928a9640 1 -- 172.21.15.141:0/675023201 wait complete. 2023-11-04T01:36:07.959 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.955+0000 7f69928a9640 1 Processor -- start 2023-11-04T01:36:07.959 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.956+0000 7f69928a9640 1 -- start start 2023-11-04T01:36:07.960 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f69928a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f698c06a830 0x7f698c14ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.961 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f69928a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f698c0722a0 0x7f698c0ad570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.961 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f69928a9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f698c1603d0 0x7f698c0c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:07.961 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f69928a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c15e010 con 0x7f698c06a830 2023-11-04T01:36:07.961 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f69928a9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c150440 con 0x7f698c1603d0 2023-11-04T01:36:07.961 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f69928a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c15e430 con 0x7f698c0722a0 2023-11-04T01:36:07.961 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f6990e46640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f698c1603d0 0x7f698c0c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.961 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f698b7fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f698c0722a0 0x7f698c0ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.961 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f6990e46640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f698c1603d0 0x7f698c0c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.141:59446/0 (socket says 172.21.15.141:59446) 2023-11-04T01:36:07.961 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f6990e46640 1 -- 172.21.15.141:0/1604375903 learned_addr learned my addr 172.21.15.141:0/1604375903 (peer_addr_for_me v2:172.21.15.141:0/0) 2023-11-04T01:36:07.965 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f698bfff640 1 --2- 172.21.15.141:0/1604375903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f698c06a830 0x7f698c14ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:07.966 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f698b7fe640 1 -- 172.21.15.141:0/1604375903 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f698c1603d0 msgr2=0x7f698c0c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.966 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f698b7fe640 1 --2- 172.21.15.141:0/1604375903 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f698c1603d0 0x7f698c0c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.966 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f698b7fe640 1 -- 172.21.15.141:0/1604375903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f698c06a830 msgr2=0x7f698c14ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:07.966 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f698b7fe640 1 --2- 172.21.15.141:0/1604375903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f698c06a830 0x7f698c14ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:07.966 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f698b7fe640 1 -- 172.21.15.141:0/1604375903 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69800094d0 con 0x7f698c0722a0 2023-11-04T01:36:07.966 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f6990e46640 1 --2- 172.21.15.141:0/1604375903 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f698c1603d0 0x7f698c0c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:07.966 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f698bfff640 1 --2- 172.21.15.141:0/1604375903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f698c06a830 0x7f698c14ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:07.966 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.957+0000 7f698b7fe640 1 --2- 172.21.15.141:0/1604375903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f698c0722a0 0x7f698c0ad570 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f697c00c390 tx=0x7f697c00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:07.967 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.958+0000 7f6988ff9640 1 -- 172.21.15.141:0/1604375903 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c0052d0 con 0x7f698c0722a0 2023-11-04T01:36:07.967 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.958+0000 7f6988ff9640 1 -- 172.21.15.141:0/1604375903 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c005430 con 0x7f698c0722a0 2023-11-04T01:36:07.967 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.958+0000 7f69928a9640 1 -- 172.21.15.141:0/1604375903 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698c15d390 con 0x7f698c0722a0 2023-11-04T01:36:07.967 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.958+0000 7f6988ff9640 1 -- 172.21.15.141:0/1604375903 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c003830 con 0x7f698c0722a0 2023-11-04T01:36:07.969 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.958+0000 7f69928a9640 1 -- 172.21.15.141:0/1604375903 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698c15d950 con 0x7f698c0722a0 2023-11-04T01:36:07.969 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.958+0000 7f6988ff9640 1 -- 172.21.15.141:0/1604375903 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f697c003c90 con 0x7f698c0722a0 2023-11-04T01:36:07.969 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.958+0000 7f6988ff9640 1 -- 172.21.15.141:0/1604375903 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f697c012a80 con 0x7f698c0722a0 2023-11-04T01:36:07.969 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.959+0000 7f69928a9640 1 -- 172.21.15.141:0/1604375903 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698c15e150 con 0x7f698c0722a0 2023-11-04T01:36:07.970 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:07.961+0000 7f6988ff9640 1 -- 172.21.15.141:0/1604375903 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f698c15e150 con 0x7f698c0722a0 2023-11-04T01:36:07.999 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:07.995+0000 7f6b17416040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-04T01:36:08.030 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:08.028+0000 7f3518630040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-04T01:36:08.033 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:08.031+0000 7f69928a9640 1 -- 172.21.15.141:0/1604375903 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd new", "uuid": "376f771f-a662-4387-8ae2-4e41699973d8", "id": 7} v 0) v1 -- 0x7f698c0b5990 con 0x7f698c0722a0 2023-11-04T01:36:08.040 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:08.037+0000 7f6988ff9640 1 -- 172.21.15.141:0/1604375903 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "376f771f-a662-4387-8ae2-4e41699973d8", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f697c017070 con 0x7f698c0722a0 2023-11-04T01:36:08.040 INFO:teuthology.orchestra.run.smithi141.stdout:7 2023-11-04T01:36:08.041 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:08.038+0000 7f69928a9640 1 -- 172.21.15.141:0/1604375903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f698c0722a0 msgr2=0x7f698c0ad570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:08.041 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:08.038+0000 7f69928a9640 1 --2- 172.21.15.141:0/1604375903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f698c0722a0 0x7f698c0ad570 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f697c00c390 tx=0x7f697c00c850 comp rx=0 tx=0).stop 2023-11-04T01:36:08.041 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:08.038+0000 7f69928a9640 1 -- 172.21.15.141:0/1604375903 shutdown_connections 2023-11-04T01:36:08.041 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:08.038+0000 7f69928a9640 1 --2- 172.21.15.141:0/1604375903 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f698c1603d0 0x7f698c0c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.041 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:08.038+0000 7f69928a9640 1 --2- 172.21.15.141:0/1604375903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f698c0722a0 0x7f698c0ad570 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.041 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:08.038+0000 7f69928a9640 1 --2- 172.21.15.141:0/1604375903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f698c06a830 0x7f698c14ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.041 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:08.038+0000 7f69928a9640 1 -- 172.21.15.141:0/1604375903 >> 172.21.15.141:0/1604375903 conn(0x7f698c06d800 msgr2=0x7f698c0c7830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:08.042 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:08.038+0000 7f69928a9640 1 -- 172.21.15.141:0/1604375903 shutdown_connections 2023-11-04T01:36:08.042 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:36:08.038+0000 7f69928a9640 1 -- 172.21.15.141:0/1604375903 wait complete. 2023-11-04T01:36:08.042 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:08.039+0000 7f6b17416040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-04T01:36:08.051 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-04T01:36:08.051 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-04T01:36:08.055 INFO:tasks.ceph.osd.0:Started 2023-11-04T01:36:08.055 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-04T01:36:08.055 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-04T01:36:08.062 INFO:tasks.ceph.osd.1:Started 2023-11-04T01:36:08.062 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-04T01:36:08.062 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-04T01:36:08.064 INFO:tasks.ceph.osd.2:Started 2023-11-04T01:36:08.064 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-04T01:36:08.064 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-04T01:36:08.067 INFO:tasks.ceph.osd.3:Started 2023-11-04T01:36:08.067 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-04T01:36:08.067 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-04T01:36:08.094 INFO:tasks.ceph.osd.4:Started 2023-11-04T01:36:08.094 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-04T01:36:08.094 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-04T01:36:08.096 INFO:tasks.ceph.osd.5:Started 2023-11-04T01:36:08.096 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-04T01:36:08.096 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-04T01:36:08.098 INFO:tasks.ceph.osd.6:Started 2023-11-04T01:36:08.100 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-04T01:36:08.100 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-04T01:36:08.104 INFO:tasks.ceph.osd.7:Started 2023-11-04T01:36:08.104 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:08.173 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:08.171+0000 7f6b17416040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:36:08.196 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:08.195+0000 7f3518630040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-04T01:36:08.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.218+0000 7f3b4f4a9640 1 Processor -- start 2023-11-04T01:36:08.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.218+0000 7f3b4f4a9640 1 -- start start 2023-11-04T01:36:08.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.219+0000 7f3b4f4a9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3b480cce10 0x7f3b480b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:08.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.219+0000 7f3b4f4a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b4806a830 0x7f3b4815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:08.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.219+0000 7f3b4f4a9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4815e6e0 con 0x7f3b480b18b0 2023-11-04T01:36:08.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.219+0000 7f3b4f4a9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4815dd10 con 0x7f3b480cce10 2023-11-04T01:36:08.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.219+0000 7f3b4f4a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4815d720 con 0x7f3b4806a830 2023-11-04T01:36:08.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.219+0000 7f3b4ca44640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3b480b18b0 0x7f3b4806a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46722/0 (socket says 172.21.15.114:46722) 2023-11-04T01:36:08.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.219+0000 7f3b4ca44640 1 -- 172.21.15.114:0/1412790553 learned_addr learned my addr 172.21.15.114:0/1412790553 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:08.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.219+0000 7f3b4d245640 1 --2- 172.21.15.114:0/1412790553 >> v2:172.21.15.141:3300/0 conn(0x7f3b480cce10 0x7f3b480b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:08.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.219+0000 7f3b4da46640 1 --2- 172.21.15.114:0/1412790553 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b4806a830 0x7f3b4815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:08.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.220+0000 7f3b3ffff640 1 -- 172.21.15.114:0/1412790553 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196741470 0 0) 0x7f3b38001110 con 0x7f3b480b18b0 2023-11-04T01:36:08.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.220+0000 7f3b3ffff640 1 -- 172.21.15.114:0/1412790553 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b34003520 con 0x7f3b480b18b0 2023-11-04T01:36:08.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.220+0000 7f3b4d245640 1 -- 172.21.15.114:0/1412790553 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b4806a830 msgr2=0x7f3b4815e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:08.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.220+0000 7f3b4d245640 1 --2- 172.21.15.114:0/1412790553 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b4806a830 0x7f3b4815e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.220+0000 7f3b4d245640 1 -- 172.21.15.114:0/1412790553 >> v1:172.21.15.114:6789/0 conn(0x7f3b480b18b0 legacy=0x7f3b4806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:08.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.220+0000 7f3b4d245640 1 -- 172.21.15.114:0/1412790553 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4806fe00 con 0x7f3b480cce10 2023-11-04T01:36:08.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.221+0000 7f3b4d245640 1 --2- 172.21.15.114:0/1412790553 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b480cce10 0x7f3b480b1fc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3b400097a0 tx=0x7f3b4002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d730a226970bffd9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:08.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.221+0000 7f3b3ffff640 1 -- 172.21.15.114:0/1412790553 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b400316f0 con 0x7f3b480cce10 2023-11-04T01:36:08.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.221+0000 7f3b3ffff640 1 -- 172.21.15.114:0/1412790553 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b40031850 con 0x7f3b480cce10 2023-11-04T01:36:08.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.221+0000 7f3b3ffff640 1 -- 172.21.15.114:0/1412790553 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b40031be0 con 0x7f3b480cce10 2023-11-04T01:36:08.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.221+0000 7f3b4f4a9640 1 -- 172.21.15.114:0/1412790553 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b480cce10 msgr2=0x7f3b480b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:08.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.221+0000 7f3b4f4a9640 1 --2- 172.21.15.114:0/1412790553 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b480cce10 0x7f3b480b1fc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3b400097a0 tx=0x7f3b4002b790 comp rx=0 tx=0).stop 2023-11-04T01:36:08.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.221+0000 7f3b4f4a9640 1 -- 172.21.15.114:0/1412790553 shutdown_connections 2023-11-04T01:36:08.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.221+0000 7f3b4f4a9640 1 --2- 172.21.15.114:0/1412790553 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b4806a830 0x7f3b4815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.221+0000 7f3b4f4a9640 1 --2- 172.21.15.114:0/1412790553 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b480cce10 0x7f3b480b1fc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.221+0000 7f3b4f4a9640 1 -- 172.21.15.114:0/1412790553 >> 172.21.15.114:0/1412790553 conn(0x7f3b4806d8b0 msgr2=0x7f3b4806dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:08.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.221+0000 7f3b4f4a9640 1 -- 172.21.15.114:0/1412790553 shutdown_connections 2023-11-04T01:36:08.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.221+0000 7f3b4f4a9640 1 -- 172.21.15.114:0/1412790553 wait complete. 2023-11-04T01:36:08.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.223+0000 7f3b4f4a9640 1 Processor -- start 2023-11-04T01:36:08.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.223+0000 7f3b4f4a9640 1 -- start start 2023-11-04T01:36:08.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.223+0000 7f3b4f4a9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b4806a830 0x7f3b480b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:08.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.223+0000 7f3b4f4a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b480b18b0 0x7f3b480c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:08.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.223+0000 7f3b4f4a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b480cce10 0x7f3b4815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:08.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.223+0000 7f3b4f4a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4815d5d0 con 0x7f3b480cce10 2023-11-04T01:36:08.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.223+0000 7f3b4f4a9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b480c56d0 con 0x7f3b4806a830 2023-11-04T01:36:08.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.223+0000 7f3b4f4a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4815caf0 con 0x7f3b480b18b0 2023-11-04T01:36:08.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.223+0000 7f3b4da46640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b480cce10 0x7f3b4815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:08.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.223+0000 7f3b4da46640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b480cce10 0x7f3b4815c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45026/0 (socket says 172.21.15.114:45026) 2023-11-04T01:36:08.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.223+0000 7f3b4da46640 1 -- 172.21.15.114:0/3039096650 learned_addr learned my addr 172.21.15.114:0/3039096650 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:08.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.223+0000 7f3b4d245640 1 --2- 172.21.15.114:0/3039096650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b4806a830 0x7f3b480b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:08.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.223+0000 7f3b4ca44640 1 --2- 172.21.15.114:0/3039096650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b480b18b0 0x7f3b480c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:08.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.224+0000 7f3b4da46640 1 -- 172.21.15.114:0/3039096650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b480b18b0 msgr2=0x7f3b480c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:08.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.224+0000 7f3b4da46640 1 --2- 172.21.15.114:0/3039096650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b480b18b0 0x7f3b480c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.224+0000 7f3b4da46640 1 -- 172.21.15.114:0/3039096650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b4806a830 msgr2=0x7f3b480b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:08.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.224+0000 7f3b4da46640 1 --2- 172.21.15.114:0/3039096650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b4806a830 0x7f3b480b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.224+0000 7f3b4da46640 1 -- 172.21.15.114:0/3039096650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b40009400 con 0x7f3b480cce10 2023-11-04T01:36:08.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.224+0000 7f3b4da46640 1 --2- 172.21.15.114:0/3039096650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b480cce10 0x7f3b4815c5b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400ef90 tx=0x7f3b4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:08.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.224+0000 7f3b3dffb640 1 -- 172.21.15.114:0/3039096650 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44009b20 con 0x7f3b480cce10 2023-11-04T01:36:08.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.224+0000 7f3b3dffb640 1 -- 172.21.15.114:0/3039096650 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4400f040 con 0x7f3b480cce10 2023-11-04T01:36:08.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.224+0000 7f3b4f4a9640 1 -- 172.21.15.114:0/3039096650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b480b3500 con 0x7f3b480cce10 2023-11-04T01:36:08.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.224+0000 7f3b3dffb640 1 -- 172.21.15.114:0/3039096650 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b440146c0 con 0x7f3b480cce10 2023-11-04T01:36:08.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.224+0000 7f3b4f4a9640 1 -- 172.21.15.114:0/3039096650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b480c5080 con 0x7f3b480cce10 2023-11-04T01:36:08.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.224+0000 7f3b3dffb640 1 -- 172.21.15.114:0/3039096650 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3b44014b20 con 0x7f3b480cce10 2023-11-04T01:36:08.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.224+0000 7f3b3dffb640 1 -- 172.21.15.114:0/3039096650 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3b4401dc90 con 0x7f3b480cce10 2023-11-04T01:36:08.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.226+0000 7f3b4f4a9640 1 -- 172.21.15.114:0/3039096650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b480674e0 con 0x7f3b480cce10 2023-11-04T01:36:08.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.229+0000 7f3b3dffb640 1 -- 172.21.15.114:0/3039096650 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3b4403bb40 con 0x7f3b480cce10 2023-11-04T01:36:08.243 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:08.241+0000 7f3518630040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-04T01:36:08.274 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:08.272+0000 7f6b17416040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-04T01:36:08.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.289+0000 7f3b4f4a9640 1 -- 172.21.15.114:0/3039096650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b480c5810 con 0x7f3b480cce10 2023-11-04T01:36:08.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.289+0000 7f3b3dffb640 1 -- 172.21.15.114:0/3039096650 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3b4402a070 con 0x7f3b480cce10 2023-11-04T01:36:08.297 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:08.297 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":10,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:08.033113+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:08.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.290+0000 7f3b4f4a9640 1 -- 172.21.15.114:0/3039096650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b480cce10 msgr2=0x7f3b4815c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:08.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.290+0000 7f3b4f4a9640 1 --2- 172.21.15.114:0/3039096650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b480cce10 0x7f3b4815c5b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400ef90 tx=0x7f3b4400c490 comp rx=0 tx=0).stop 2023-11-04T01:36:08.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.290+0000 7f3b4f4a9640 1 -- 172.21.15.114:0/3039096650 shutdown_connections 2023-11-04T01:36:08.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.290+0000 7f3b4f4a9640 1 --2- 172.21.15.114:0/3039096650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b480cce10 0x7f3b4815c5b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.290+0000 7f3b4f4a9640 1 --2- 172.21.15.114:0/3039096650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b480b18b0 0x7f3b480c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.290+0000 7f3b4f4a9640 1 --2- 172.21.15.114:0/3039096650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b4806a830 0x7f3b480b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.290+0000 7f3b4f4a9640 1 -- 172.21.15.114:0/3039096650 >> 172.21.15.114:0/3039096650 conn(0x7f3b4806d8b0 msgr2=0x7f3b480c8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.290+0000 7f3b4f4a9640 1 -- 172.21.15.114:0/3039096650 shutdown_connections 2023-11-04T01:36:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:08.290+0000 7f3b4f4a9640 1 -- 172.21.15.114:0/3039096650 wait complete. 2023-11-04T01:36:08.303 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-04T01:36:08.303 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-04T01:36:08.339 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:08.337+0000 7f3518630040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:36:08.417 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:08.415+0000 7f6b17416040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:36:08.433 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:08.432+0000 7f3518630040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-04T01:36:08.459 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:08.457+0000 7f6b17416040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-04T01:36:08.573 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:08.571+0000 7f3518630040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:36:08.596 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:08.594+0000 7f6b17416040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-04T01:36:08.613 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:08.612+0000 7f3518630040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-04T01:36:08.660 INFO:tasks.ceph.osd.0.smithi114.stderr:2023-11-04T01:36:08.658+0000 7fc7fcc1c500 -1 Falling back to public interface 2023-11-04T01:36:08.670 INFO:tasks.ceph.osd.1.smithi114.stderr:2023-11-04T01:36:08.668+0000 7f9b22616500 -1 Falling back to public interface 2023-11-04T01:36:08.674 INFO:tasks.ceph.osd.3.smithi114.stderr:2023-11-04T01:36:08.672+0000 7f127788c500 -1 Falling back to public interface 2023-11-04T01:36:08.683 INFO:tasks.ceph.osd.2.smithi114.stderr:2023-11-04T01:36:08.681+0000 7f394621f500 -1 Falling back to public interface 2023-11-04T01:36:08.696 INFO:tasks.ceph.osd.4.smithi141.stderr:2023-11-04T01:36:08.694+0000 7f4a05849500 -1 Falling back to public interface 2023-11-04T01:36:08.701 INFO:tasks.ceph.osd.6.smithi141.stderr:2023-11-04T01:36:08.698+0000 7f286b82a500 -1 Falling back to public interface 2023-11-04T01:36:08.701 INFO:tasks.ceph.osd.5.smithi141.stderr:2023-11-04T01:36:08.699+0000 7ff230810500 -1 Falling back to public interface 2023-11-04T01:36:08.701 INFO:tasks.ceph.osd.5.smithi141.stderr:2023-11-04T01:36:08.700+0000 7ff22f0f8640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6813/0: (98) Address already in use 2023-11-04T01:36:08.710 INFO:tasks.ceph.osd.7.smithi141.stderr:2023-11-04T01:36:08.709+0000 7f6456a2a500 -1 Falling back to public interface 2023-11-04T01:36:08.766 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:08.759+0000 7f3518630040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-04T01:36:09.115 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:09.206 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.204+0000 7f2d13d5e640 1 Processor -- start 2023-11-04T01:36:09.206 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.204+0000 7f2d13d5e640 1 -- start start 2023-11-04T01:36:09.207 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.205+0000 7f2d13d5e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2d0c15a2d0 0x7f2d0c0b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.207 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.205+0000 7f2d13d5e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c0b2870 con 0x7f2d0c0cc3a0 2023-11-04T01:36:09.207 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.205+0000 7f2d13d5e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c0cea40 con 0x7f2d0c0cc780 2023-11-04T01:36:09.208 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.205+0000 7f2d13d5e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0c0cb2e0 con 0x7f2d0c15a2d0 2023-11-04T01:36:09.208 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.205+0000 7f2d112f9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2d0c15a2d0 0x7f2d0c0b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.208 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.205+0000 7f2d112f9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2d0c15a2d0 0x7f2d0c0b2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45038/0 (socket says 172.21.15.114:45038) 2023-11-04T01:36:09.208 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.205+0000 7f2d112f9640 1 -- 172.21.15.114:0/1920363160 learned_addr learned my addr 172.21.15.114:0/1920363160 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:09.208 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.205+0000 7f2d11afa640 1 --1- 172.21.15.114:0/1920363160 >> v1:172.21.15.114:6789/0 conn(0x7f2d0c0cc3a0 0x7f2d0c159bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46730/0 (socket says 172.21.15.114:46730) 2023-11-04T01:36:09.208 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.205+0000 7f2d112f9640 1 -- 172.21.15.114:0/1920363160 >> v1:172.21.15.141:6789/0 conn(0x7f2d0c0cc780 legacy=0x7f2d0c0b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.208 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.205+0000 7f2d112f9640 1 -- 172.21.15.114:0/1920363160 >> v1:172.21.15.114:6789/0 conn(0x7f2d0c0cc3a0 legacy=0x7f2d0c159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.208 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.205+0000 7f2d10af8640 1 -- 172.21.15.114:0/1920363160 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823829681 0 0) 0x7f2d0c0b2870 con 0x7f2d0c0cc3a0 2023-11-04T01:36:09.208 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.205+0000 7f2d112f9640 1 -- 172.21.15.114:0/1920363160 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c0cb5c0 con 0x7f2d0c15a2d0 2023-11-04T01:36:09.209 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.206+0000 7f2d112f9640 1 --2- 172.21.15.114:0/1920363160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c15a2d0 0x7f2d0c0b2fe0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009870 tx=0x7f2d0802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5de8711f18adbb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:09.209 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.206+0000 7f2d10af8640 1 -- 172.21.15.114:0/1920363160 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08030860 con 0x7f2d0c15a2d0 2023-11-04T01:36:09.210 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.206+0000 7f2d10af8640 1 -- 172.21.15.114:0/1920363160 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d080309c0 con 0x7f2d0c15a2d0 2023-11-04T01:36:09.210 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.206+0000 7f2d10af8640 1 -- 172.21.15.114:0/1920363160 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08030d50 con 0x7f2d0c15a2d0 2023-11-04T01:36:09.210 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.207+0000 7f2d13d5e640 1 -- 172.21.15.114:0/1920363160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c15a2d0 msgr2=0x7f2d0c0b2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.220 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.207+0000 7f2d13d5e640 1 --2- 172.21.15.114:0/1920363160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c15a2d0 0x7f2d0c0b2fe0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009870 tx=0x7f2d0802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.220 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.207+0000 7f2d13d5e640 1 -- 172.21.15.114:0/1920363160 shutdown_connections 2023-11-04T01:36:09.220 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.207+0000 7f2d13d5e640 1 --2- 172.21.15.114:0/1920363160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c15a2d0 0x7f2d0c0b2fe0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.220 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.207+0000 7f2d13d5e640 1 -- 172.21.15.114:0/1920363160 >> 172.21.15.114:0/1920363160 conn(0x7f2d0c0cfa20 msgr2=0x7f2d0c0cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:09.220 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.207+0000 7f2d13d5e640 1 -- 172.21.15.114:0/1920363160 shutdown_connections 2023-11-04T01:36:09.222 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.207+0000 7f2d13d5e640 1 -- 172.21.15.114:0/1920363160 wait complete. 2023-11-04T01:36:09.234 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.208+0000 7f2d13d5e640 1 Processor -- start 2023-11-04T01:36:09.234 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.208+0000 7f2d13d5e640 1 -- start start 2023-11-04T01:36:09.234 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d13d5e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c0cc3a0 0x7f2d0c0c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.234 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d13d5e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d0c0cc780 0x7f2d0c1456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.234 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d13d5e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d0c15a2d0 0x7f2d0c0c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:09.234 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d13d5e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c15da10 con 0x7f2d0c0cc3a0 2023-11-04T01:36:09.235 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d13d5e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c15d450 con 0x7f2d0c15a2d0 2023-11-04T01:36:09.235 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d13d5e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c15d730 con 0x7f2d0c0cc780 2023-11-04T01:36:09.235 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d11afa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c0cc3a0 0x7f2d0c0c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.235 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d11afa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c0cc3a0 0x7f2d0c0c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45040/0 (socket says 172.21.15.114:45040) 2023-11-04T01:36:09.235 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d11afa640 1 -- 172.21.15.114:0/3719573755 learned_addr learned my addr 172.21.15.114:0/3719573755 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:09.235 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d122fb640 1 --2- 172.21.15.114:0/3719573755 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d0c15a2d0 0x7f2d0c0c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:09.235 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d11afa640 1 -- 172.21.15.114:0/3719573755 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d0c0cc780 msgr2=0x7f2d0c1456f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.235 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d11afa640 1 --2- 172.21.15.114:0/3719573755 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d0c0cc780 0x7f2d0c1456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.235 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d11afa640 1 -- 172.21.15.114:0/3719573755 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d0c15a2d0 msgr2=0x7f2d0c0c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.235 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d11afa640 1 --2- 172.21.15.114:0/3719573755 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d0c15a2d0 0x7f2d0c0c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.235 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d11afa640 1 -- 172.21.15.114:0/3719573755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d080094d0 con 0x7f2d0c0cc3a0 2023-11-04T01:36:09.235 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d122fb640 1 --2- 172.21.15.114:0/3719573755 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d0c15a2d0 0x7f2d0c0c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:09.236 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d11afa640 1 --2- 172.21.15.114:0/3719573755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c0cc3a0 0x7f2d0c0c8370 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00c4a0 tx=0x7f2cfc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:09.236 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d027fc640 1 -- 172.21.15.114:0/3719573755 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0074e0 con 0x7f2d0c0cc3a0 2023-11-04T01:36:09.236 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.209+0000 7f2d027fc640 1 -- 172.21.15.114:0/3719573755 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc007640 con 0x7f2d0c0cc3a0 2023-11-04T01:36:09.236 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.210+0000 7f2d027fc640 1 -- 172.21.15.114:0/3719573755 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc004a00 con 0x7f2d0c0cc3a0 2023-11-04T01:36:09.236 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.210+0000 7f2d13d5e640 1 -- 172.21.15.114:0/3719573755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0c0b3080 con 0x7f2d0c0cc3a0 2023-11-04T01:36:09.236 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.210+0000 7f2d13d5e640 1 -- 172.21.15.114:0/3719573755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0c15d120 con 0x7f2d0c0cc3a0 2023-11-04T01:36:09.236 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.210+0000 7f2d027fc640 1 -- 172.21.15.114:0/3719573755 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2cfc012400 con 0x7f2d0c0cc3a0 2023-11-04T01:36:09.236 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.210+0000 7f2d027fc640 1 -- 172.21.15.114:0/3719573755 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2cfc01ba30 con 0x7f2d0c0cc3a0 2023-11-04T01:36:09.236 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.211+0000 7f2d13d5e640 1 -- 172.21.15.114:0/3719573755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0c0b2ee0 con 0x7f2d0c0cc3a0 2023-11-04T01:36:09.236 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.213+0000 7f2d027fc640 1 -- 172.21.15.114:0/3719573755 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2d0c0b2ee0 con 0x7f2d0c0cc3a0 2023-11-04T01:36:09.275 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.273+0000 7f2d13d5e640 1 -- 172.21.15.114:0/3719573755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d0c0b35a0 con 0x7f2d0c0cc3a0 2023-11-04T01:36:09.276 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.274+0000 7f2d027fc640 1 -- 172.21.15.114:0/3719573755 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f2d0c0b35a0 con 0x7f2d0c0cc3a0 2023-11-04T01:36:09.276 INFO:teuthology.misc.health.smithi114.stdout: 2023-11-04T01:36:09.276 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":10,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:08.033113+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:09.277 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.275+0000 7f2d13d5e640 1 -- 172.21.15.114:0/3719573755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c0cc3a0 msgr2=0x7f2d0c0c8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:09.277 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.275+0000 7f2d13d5e640 1 --2- 172.21.15.114:0/3719573755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c0cc3a0 0x7f2d0c0c8370 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00c4a0 tx=0x7f2cfc00c960 comp rx=0 tx=0).stop 2023-11-04T01:36:09.277 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.275+0000 7f2d13d5e640 1 -- 172.21.15.114:0/3719573755 shutdown_connections 2023-11-04T01:36:09.277 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.275+0000 7f2d13d5e640 1 --2- 172.21.15.114:0/3719573755 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d0c15a2d0 0x7f2d0c0c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.277 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.275+0000 7f2d13d5e640 1 --2- 172.21.15.114:0/3719573755 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d0c0cc780 0x7f2d0c1456f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.278 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.275+0000 7f2d13d5e640 1 --2- 172.21.15.114:0/3719573755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0c0cc3a0 0x7f2d0c0c8370 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:09.278 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.275+0000 7f2d13d5e640 1 -- 172.21.15.114:0/3719573755 >> 172.21.15.114:0/3719573755 conn(0x7f2d0c0cfa20 msgr2=0x7f2d0c06e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:09.278 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.275+0000 7f2d13d5e640 1 -- 172.21.15.114:0/3719573755 shutdown_connections 2023-11-04T01:36:09.278 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:09.275+0000 7f2d13d5e640 1 -- 172.21.15.114:0/3719573755 wait complete. 2023-11-04T01:36:09.286 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-04T01:36:09.411 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:09.410+0000 7f6b17416040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-04T01:36:09.568 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:09.566+0000 7f3518630040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-04T01:36:09.683 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:09.681+0000 7f6b17416040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-04T01:36:09.734 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:09.732+0000 7f6b17416040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-04T01:36:09.835 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:09.833+0000 7f6b17416040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-04T01:36:09.836 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:09.835+0000 7f3518630040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-04T01:36:09.892 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:09.890+0000 7f3518630040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-04T01:36:09.993 INFO:tasks.ceph.mgr.x.smithi141.stderr:2023-11-04T01:36:09.991+0000 7f3518630040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-04T01:36:10.863 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:10.858+0000 7f6ab8315640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-04T01:36:10.863 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:36:10.859+0000 7f6ab8315640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-04T01:36:12.119 INFO:tasks.ceph.osd.1.smithi114.stderr:2023-11-04T01:36:12.117+0000 7f9b22616500 -1 osd.1 0 log_to_monitors true 2023-11-04T01:36:12.157 INFO:tasks.ceph.osd.0.smithi114.stderr:2023-11-04T01:36:12.156+0000 7fc7fcc1c500 -1 osd.0 0 log_to_monitors true 2023-11-04T01:36:12.190 INFO:tasks.ceph.osd.2.smithi114.stderr:2023-11-04T01:36:12.189+0000 7f394621f500 -1 osd.2 0 log_to_monitors true 2023-11-04T01:36:12.195 INFO:tasks.ceph.osd.3.smithi114.stderr:2023-11-04T01:36:12.193+0000 7f127788c500 -1 osd.3 0 log_to_monitors true 2023-11-04T01:36:12.243 INFO:tasks.ceph.osd.7.smithi141.stderr:2023-11-04T01:36:12.242+0000 7f6456a2a500 -1 osd.7 0 log_to_monitors true 2023-11-04T01:36:12.245 INFO:tasks.ceph.osd.4.smithi141.stderr:2023-11-04T01:36:12.243+0000 7f4a05849500 -1 osd.4 0 log_to_monitors true 2023-11-04T01:36:12.251 INFO:tasks.ceph.osd.5.smithi141.stderr:2023-11-04T01:36:12.250+0000 7ff230810500 -1 osd.5 0 log_to_monitors true 2023-11-04T01:36:12.254 INFO:tasks.ceph.osd.6.smithi141.stderr:2023-11-04T01:36:12.253+0000 7f286b82a500 -1 osd.6 0 log_to_monitors true 2023-11-04T01:36:15.999 INFO:tasks.ceph.osd.3.smithi114.stderr:2023-11-04T01:36:15.997+0000 7f127381c640 -1 osd.3 0 waiting for initial osdmap 2023-11-04T01:36:16.014 INFO:tasks.ceph.osd.3.smithi114.stderr:2023-11-04T01:36:16.012+0000 7f126b643640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:36:16.014 INFO:tasks.ceph.osd.2.smithi114.stderr:2023-11-04T01:36:16.013+0000 7f3941b65640 -1 osd.2 0 waiting for initial osdmap 2023-11-04T01:36:16.016 INFO:tasks.ceph.osd.0.smithi114.stderr:2023-11-04T01:36:16.014+0000 7fc7f84ed640 -1 osd.0 0 waiting for initial osdmap 2023-11-04T01:36:16.016 INFO:tasks.ceph.osd.6.smithi141.stderr:2023-11-04T01:36:16.014+0000 7f2866d10640 -1 osd.6 0 waiting for initial osdmap 2023-11-04T01:36:16.018 INFO:tasks.ceph.osd.1.smithi114.stderr:2023-11-04T01:36:16.016+0000 7f9b1e076640 -1 osd.1 0 waiting for initial osdmap 2023-11-04T01:36:16.027 INFO:tasks.ceph.osd.2.smithi114.stderr:2023-11-04T01:36:16.025+0000 7f393998c640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:36:16.033 INFO:tasks.ceph.osd.0.smithi114.stderr:2023-11-04T01:36:16.029+0000 7fc7f0314640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:36:16.034 INFO:tasks.ceph.osd.1.smithi114.stderr:2023-11-04T01:36:16.030+0000 7f9b15e9d640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:36:16.038 INFO:tasks.ceph.osd.5.smithi141.stderr:2023-11-04T01:36:16.036+0000 7ff22c0df640 -1 osd.5 0 waiting for initial osdmap 2023-11-04T01:36:16.038 INFO:tasks.ceph.osd.6.smithi141.stderr:2023-11-04T01:36:16.037+0000 7f285eb37640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:36:16.041 INFO:tasks.ceph.osd.4.smithi141.stderr:2023-11-04T01:36:16.039+0000 7f4a017d7640 -1 osd.4 0 waiting for initial osdmap 2023-11-04T01:36:16.053 INFO:tasks.ceph.osd.5.smithi141.stderr:2023-11-04T01:36:16.052+0000 7ff223f06640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:36:16.059 INFO:tasks.ceph.osd.4.smithi141.stderr:2023-11-04T01:36:16.058+0000 7f49f95fe640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:36:16.066 INFO:tasks.ceph.osd.7.smithi141.stderr:2023-11-04T01:36:16.064+0000 7f6451f5a640 -1 osd.7 0 waiting for initial osdmap 2023-11-04T01:36:16.081 INFO:tasks.ceph.osd.7.smithi141.stderr:2023-11-04T01:36:16.078+0000 7f6449d81640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:36:16.096 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:16.184 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.182+0000 7fec6a07c640 1 Processor -- start 2023-11-04T01:36:16.184 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.182+0000 7fec6a07c640 1 -- start start 2023-11-04T01:36:16.185 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.183+0000 7fec6a07c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fec6415b1c0 0x7fec64070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.185 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.183+0000 7fec6a07c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fec640b1be0 0x7fec640b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.185 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.183+0000 7fec6a07c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6406e5a0 con 0x7fec6415ade0 2023-11-04T01:36:16.185 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.183+0000 7fec6a07c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec640cf750 con 0x7fec6415b1c0 2023-11-04T01:36:16.185 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.183+0000 7fec6a07c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec6406e2c0 con 0x7fec640b1be0 2023-11-04T01:36:16.186 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.183+0000 7fec62ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fec6415b1c0 0x7fec64070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.186 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.183+0000 7fec637fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fec6415ade0 0x7fec640707a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46734/0 (socket says 172.21.15.114:46734) 2023-11-04T01:36:16.186 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.183+0000 7fec637fe640 1 -- 172.21.15.114:0/4285767544 learned_addr learned my addr 172.21.15.114:0/4285767544 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:16.186 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.183+0000 7fec62ffd640 1 --2- 172.21.15.114:0/4285767544 >> v2:172.21.15.114:3300/0 conn(0x7fec6415b1c0 0x7fec64070eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45154/0 (socket says 172.21.15.114:45154) 2023-11-04T01:36:16.186 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.183+0000 7fec63fff640 1 --2- 172.21.15.114:0/4285767544 >> v2:172.21.15.141:3300/0 conn(0x7fec640b1be0 0x7fec640b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.186 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.183+0000 7fec62ffd640 1 -- 172.21.15.114:0/4285767544 >> v2:172.21.15.141:3300/0 conn(0x7fec640b1be0 msgr2=0x7fec640b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:16.186 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.183+0000 7fec62ffd640 1 --2- 172.21.15.114:0/4285767544 >> v2:172.21.15.141:3300/0 conn(0x7fec640b1be0 0x7fec640b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.186 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.183+0000 7fec62ffd640 1 -- 172.21.15.114:0/4285767544 >> v1:172.21.15.114:6789/0 conn(0x7fec6415ade0 legacy=0x7fec640707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.186 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.183+0000 7fec62ffd640 1 -- 172.21.15.114:0/4285767544 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec640c9ab0 con 0x7fec6415b1c0 2023-11-04T01:36:16.186 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.183+0000 7fec627fc640 1 -- 172.21.15.114:0/4285767544 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824607079 0 0) 0x7fec6406e5a0 con 0x7fec6415ade0 2023-11-04T01:36:16.186 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.183+0000 7fec63fff640 1 --2- 172.21.15.114:0/4285767544 >> v2:172.21.15.141:3300/0 conn(0x7fec640b1be0 0x7fec640b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:16.188 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.184+0000 7fec62ffd640 1 --2- 172.21.15.114:0/4285767544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec6415b1c0 0x7fec64070eb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fec640b4b00 tx=0x7fec5802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4c4584ff9f8726 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.188 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.184+0000 7fec627fc640 1 -- 172.21.15.114:0/4285767544 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5802e070 con 0x7fec6415b1c0 2023-11-04T01:36:16.188 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.184+0000 7fec627fc640 1 -- 172.21.15.114:0/4285767544 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec580315a0 con 0x7fec6415b1c0 2023-11-04T01:36:16.188 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.184+0000 7fec627fc640 1 -- 172.21.15.114:0/4285767544 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec58031930 con 0x7fec6415b1c0 2023-11-04T01:36:16.188 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.185+0000 7fec6a07c640 1 -- 172.21.15.114:0/4285767544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec6415b1c0 msgr2=0x7fec64070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.188 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.185+0000 7fec6a07c640 1 --2- 172.21.15.114:0/4285767544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec6415b1c0 0x7fec64070eb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fec640b4b00 tx=0x7fec5802b840 comp rx=0 tx=0).stop 2023-11-04T01:36:16.188 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.185+0000 7fec6a07c640 1 -- 172.21.15.114:0/4285767544 shutdown_connections 2023-11-04T01:36:16.188 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.185+0000 7fec6a07c640 1 --2- 172.21.15.114:0/4285767544 >> v2:172.21.15.141:3300/0 conn(0x7fec640b1be0 0x7fec640b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.188 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.185+0000 7fec6a07c640 1 --2- 172.21.15.114:0/4285767544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec6415b1c0 0x7fec64070eb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.189 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.185+0000 7fec6a07c640 1 -- 172.21.15.114:0/4285767544 >> 172.21.15.114:0/4285767544 conn(0x7fec640ce9b0 msgr2=0x7fec640cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:16.189 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.185+0000 7fec6a07c640 1 -- 172.21.15.114:0/4285767544 shutdown_connections 2023-11-04T01:36:16.189 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.185+0000 7fec6a07c640 1 -- 172.21.15.114:0/4285767544 wait complete. 2023-11-04T01:36:16.189 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.186+0000 7fec6a07c640 1 Processor -- start 2023-11-04T01:36:16.189 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.186+0000 7fec6a07c640 1 -- start start 2023-11-04T01:36:16.193 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.187+0000 7fec6a07c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec640b1be0 0x7fec640c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.193 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.187+0000 7fec6a07c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec6415ade0 0x7fec640c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.193 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.187+0000 7fec6a07c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec6415b1c0 0x7fec64158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.193 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.187+0000 7fec6a07c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec640cc580 con 0x7fec640b1be0 2023-11-04T01:36:16.193 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.187+0000 7fec6a07c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec640cc860 con 0x7fec6415b1c0 2023-11-04T01:36:16.193 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.187+0000 7fec6a07c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec640c3ea0 con 0x7fec6415ade0 2023-11-04T01:36:16.193 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.187+0000 7fec637fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec640b1be0 0x7fec640c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.193 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.187+0000 7fec637fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec640b1be0 0x7fec640c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45158/0 (socket says 172.21.15.114:45158) 2023-11-04T01:36:16.193 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.187+0000 7fec637fe640 1 -- 172.21.15.114:0/460443157 learned_addr learned my addr 172.21.15.114:0/460443157 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:16.194 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.187+0000 7fec62ffd640 1 --2- 172.21.15.114:0/460443157 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec6415ade0 0x7fec640c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.194 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.187+0000 7fec63fff640 1 --2- 172.21.15.114:0/460443157 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec6415b1c0 0x7fec64158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.194 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.187+0000 7fec637fe640 1 -- 172.21.15.114:0/460443157 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec6415ade0 msgr2=0x7fec640c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.194 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.187+0000 7fec637fe640 1 --2- 172.21.15.114:0/460443157 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec6415ade0 0x7fec640c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.194 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.187+0000 7fec637fe640 1 -- 172.21.15.114:0/460443157 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec6415b1c0 msgr2=0x7fec64158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.194 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.187+0000 7fec637fe640 1 --2- 172.21.15.114:0/460443157 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec6415b1c0 0x7fec64158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.194 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.187+0000 7fec637fe640 1 -- 172.21.15.114:0/460443157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec58009400 con 0x7fec640b1be0 2023-11-04T01:36:16.194 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.188+0000 7fec637fe640 1 --2- 172.21.15.114:0/460443157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec640b1be0 0x7fec640c7d00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fec5400c4d0 tx=0x7fec5400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.194 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.190+0000 7fec4bfff640 1 -- 172.21.15.114:0/460443157 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec540074e0 con 0x7fec640b1be0 2023-11-04T01:36:16.194 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.190+0000 7fec4bfff640 1 -- 172.21.15.114:0/460443157 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec54007660 con 0x7fec640b1be0 2023-11-04T01:36:16.194 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.190+0000 7fec6a07c640 1 -- 172.21.15.114:0/460443157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec640c4180 con 0x7fec640b1be0 2023-11-04T01:36:16.194 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.190+0000 7fec4bfff640 1 -- 172.21.15.114:0/460443157 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54004a20 con 0x7fec640b1be0 2023-11-04T01:36:16.195 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.190+0000 7fec6a07c640 1 -- 172.21.15.114:0/460443157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec640c8240 con 0x7fec640b1be0 2023-11-04T01:36:16.195 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.191+0000 7fec6a07c640 1 -- 172.21.15.114:0/460443157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6404e490 con 0x7fec640b1be0 2023-11-04T01:36:16.195 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.191+0000 7fec4bfff640 1 -- 172.21.15.114:0/460443157 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fec54004b80 con 0x7fec640b1be0 2023-11-04T01:36:16.196 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.192+0000 7fec4bfff640 1 --2- 172.21.15.114:0/460443157 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec5006ade0 0x7fec5006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:16.196 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.192+0000 7fec4bfff640 1 -- 172.21.15.114:0/460443157 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fec540878b0 con 0x7fec640b1be0 2023-11-04T01:36:16.206 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.192+0000 7fec62ffd640 1 --2- 172.21.15.114:0/460443157 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec5006ade0 0x7fec5006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:16.206 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.192+0000 7fec62ffd640 1 --2- 172.21.15.114:0/460443157 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec5006ade0 0x7fec5006d2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fec58036000 tx=0x7fec5803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:16.207 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.196+0000 7fec4bfff640 1 -- 172.21.15.114:0/460443157 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fec54053880 con 0x7fec640b1be0 2023-11-04T01:36:16.365 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.363+0000 7fec6a07c640 1 -- 172.21.15.114:0/460443157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec640b44f0 con 0x7fec640b1be0 2023-11-04T01:36:16.366 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.364+0000 7fec4bfff640 1 -- 172.21.15.114:0/460443157 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fec54018070 con 0x7fec640b1be0 2023-11-04T01:36:16.366 INFO:teuthology.misc.health.smithi114.stdout: 2023-11-04T01:36:16.366 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":12,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:13.861633+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:16.368 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.366+0000 7fec6a07c640 1 -- 172.21.15.114:0/460443157 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec5006ade0 msgr2=0x7fec5006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.368 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.366+0000 7fec6a07c640 1 --2- 172.21.15.114:0/460443157 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec5006ade0 0x7fec5006d2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fec58036000 tx=0x7fec5803d040 comp rx=0 tx=0).stop 2023-11-04T01:36:16.368 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.366+0000 7fec6a07c640 1 -- 172.21.15.114:0/460443157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec640b1be0 msgr2=0x7fec640c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:16.368 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.366+0000 7fec6a07c640 1 --2- 172.21.15.114:0/460443157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec640b1be0 0x7fec640c7d00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fec5400c4d0 tx=0x7fec5400c990 comp rx=0 tx=0).stop 2023-11-04T01:36:16.369 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.366+0000 7fec6a07c640 1 -- 172.21.15.114:0/460443157 shutdown_connections 2023-11-04T01:36:16.369 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.366+0000 7fec6a07c640 1 --2- 172.21.15.114:0/460443157 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec5006ade0 0x7fec5006d2a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.369 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.366+0000 7fec6a07c640 1 --2- 172.21.15.114:0/460443157 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec6415b1c0 0x7fec64158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.369 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.366+0000 7fec6a07c640 1 --2- 172.21.15.114:0/460443157 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec6415ade0 0x7fec640c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.369 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.366+0000 7fec6a07c640 1 --2- 172.21.15.114:0/460443157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec640b1be0 0x7fec640c7d00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:16.369 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.366+0000 7fec6a07c640 1 -- 172.21.15.114:0/460443157 >> 172.21.15.114:0/460443157 conn(0x7fec640ce9b0 msgr2=0x7fec640ae410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:16.369 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.366+0000 7fec6a07c640 1 -- 172.21.15.114:0/460443157 shutdown_connections 2023-11-04T01:36:16.369 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:16.366+0000 7fec6a07c640 1 -- 172.21.15.114:0/460443157 wait complete. 2023-11-04T01:36:16.377 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-04T01:36:19.306 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:36:19.309 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:36:23.184 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:23.283 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.281+0000 7fedb4026640 1 Processor -- start 2023-11-04T01:36:23.283 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.281+0000 7fedb4026640 1 -- start start 2023-11-04T01:36:23.283 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.282+0000 7fedb4026640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fedac0cda70 0x7fedac0cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.284 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.282+0000 7fedb4026640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac0b63e0 con 0x7fedac0cd600 2023-11-04T01:36:23.284 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.282+0000 7fedb4026640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac0cb240 con 0x7fedac15ade0 2023-11-04T01:36:23.284 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.282+0000 7fedb4026640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedac0cc2f0 con 0x7fedac0cda70 2023-11-04T01:36:23.284 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.282+0000 7fedb25c3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fedac0cda70 0x7fedac0cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.284 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.282+0000 7fedb15c1640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fedac0cd600 0x7fedac0ce8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:57380/0 (socket says 172.21.15.114:57380) 2023-11-04T01:36:23.284 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.282+0000 7fedb15c1640 1 -- 172.21.15.114:0/474076573 learned_addr learned my addr 172.21.15.114:0/474076573 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:23.286 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.282+0000 7fedb25c3640 1 -- 172.21.15.114:0/474076573 >> v1:172.21.15.141:6789/0 conn(0x7fedac15ade0 legacy=0x7fedac0cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:23.286 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.282+0000 7fedb25c3640 1 -- 172.21.15.114:0/474076573 >> v1:172.21.15.114:6789/0 conn(0x7fedac0cd600 legacy=0x7fedac0ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.286 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.282+0000 7fedb0dc0640 1 -- 172.21.15.114:0/474076573 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204496656 0 0) 0x7fedac0b63e0 con 0x7fedac0cd600 2023-11-04T01:36:23.286 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.282+0000 7fedb25c3640 1 -- 172.21.15.114:0/474076573 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac0cb520 con 0x7fedac0cda70 2023-11-04T01:36:23.286 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.283+0000 7fedb25c3640 1 --2- 172.21.15.114:0/474076573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedac0cda70 0x7fedac0cefd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feda4009d90 tx=0x7feda402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107b5e1a64d115b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.286 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.283+0000 7fedb0dc0640 1 -- 172.21.15.114:0/474076573 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda402cc60 con 0x7fedac0cda70 2023-11-04T01:36:23.286 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.283+0000 7fedb0dc0640 1 -- 172.21.15.114:0/474076573 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda402cdc0 con 0x7fedac0cda70 2023-11-04T01:36:23.286 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.283+0000 7fedb0dc0640 1 -- 172.21.15.114:0/474076573 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda4034660 con 0x7fedac0cda70 2023-11-04T01:36:23.286 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.284+0000 7fedb4026640 1 -- 172.21.15.114:0/474076573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedac0cda70 msgr2=0x7fedac0cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.287 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.284+0000 7fedb4026640 1 --2- 172.21.15.114:0/474076573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedac0cda70 0x7fedac0cefd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feda4009d90 tx=0x7feda402beb0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.287 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.284+0000 7fedb4026640 1 -- 172.21.15.114:0/474076573 shutdown_connections 2023-11-04T01:36:23.287 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.284+0000 7fedb4026640 1 --2- 172.21.15.114:0/474076573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedac0cda70 0x7fedac0cefd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.287 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.284+0000 7fedb4026640 1 -- 172.21.15.114:0/474076573 >> 172.21.15.114:0/474076573 conn(0x7fedac06ea40 msgr2=0x7fedac06ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:23.287 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.284+0000 7fedb4026640 1 -- 172.21.15.114:0/474076573 shutdown_connections 2023-11-04T01:36:23.287 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.284+0000 7fedb4026640 1 -- 172.21.15.114:0/474076573 wait complete. 2023-11-04T01:36:23.289 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.285+0000 7fedb4026640 1 Processor -- start 2023-11-04T01:36:23.289 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.285+0000 7fedb4026640 1 -- start start 2023-11-04T01:36:23.289 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb4026640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fedac0cd600 0x7fedac150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.289 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb4026640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fedac0cda70 0x7fedac1532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.289 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb4026640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedac15ade0 0x7fedac155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.289 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb4026640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac153c60 con 0x7fedac15ade0 2023-11-04T01:36:23.289 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb4026640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac155850 con 0x7fedac0cd600 2023-11-04T01:36:23.290 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb4026640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac153980 con 0x7fedac0cda70 2023-11-04T01:36:23.290 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb25c3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedac15ade0 0x7fedac155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.290 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb25c3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedac15ade0 0x7fedac155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51652/0 (socket says 172.21.15.114:51652) 2023-11-04T01:36:23.290 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb25c3640 1 -- 172.21.15.114:0/1699445979 learned_addr learned my addr 172.21.15.114:0/1699445979 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:23.290 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb1dc2640 1 --2- 172.21.15.114:0/1699445979 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fedac0cd600 0x7fedac150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.290 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb15c1640 1 --2- 172.21.15.114:0/1699445979 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fedac0cda70 0x7fedac1532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.290 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb25c3640 1 -- 172.21.15.114:0/1699445979 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fedac0cda70 msgr2=0x7fedac1532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.290 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb25c3640 1 --2- 172.21.15.114:0/1699445979 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fedac0cda70 0x7fedac1532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.290 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb25c3640 1 -- 172.21.15.114:0/1699445979 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fedac0cd600 msgr2=0x7fedac150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.290 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb25c3640 1 --2- 172.21.15.114:0/1699445979 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fedac0cd600 0x7fedac150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.290 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb25c3640 1 -- 172.21.15.114:0/1699445979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda4009a70 con 0x7fedac15ade0 2023-11-04T01:36:23.290 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb1dc2640 1 --2- 172.21.15.114:0/1699445979 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fedac0cd600 0x7fedac150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:23.291 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7fedb25c3640 1 --2- 172.21.15.114:0/1699445979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedac15ade0 0x7fedac155310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feda4009d90 tx=0x7feda4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.291 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7feda27fc640 1 -- 172.21.15.114:0/1699445979 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda403e610 con 0x7fedac15ade0 2023-11-04T01:36:23.291 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.286+0000 7feda27fc640 1 -- 172.21.15.114:0/1699445979 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda403e790 con 0x7fedac15ade0 2023-11-04T01:36:23.291 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.287+0000 7fedb4026640 1 -- 172.21.15.114:0/1699445979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac15c0f0 con 0x7fedac15ade0 2023-11-04T01:36:23.291 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.287+0000 7feda27fc640 1 -- 172.21.15.114:0/1699445979 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda403eb40 con 0x7fedac15ade0 2023-11-04T01:36:23.291 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.287+0000 7fedb4026640 1 -- 172.21.15.114:0/1699445979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedac15c6b0 con 0x7fedac15ade0 2023-11-04T01:36:23.292 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.288+0000 7fedb4026640 1 -- 172.21.15.114:0/1699445979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedac15bf50 con 0x7fedac15ade0 2023-11-04T01:36:23.292 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.288+0000 7feda27fc640 1 -- 172.21.15.114:0/1699445979 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feda403b050 con 0x7fedac15ade0 2023-11-04T01:36:23.292 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.288+0000 7feda27fc640 1 --2- 172.21.15.114:0/1699445979 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed9006ae70 0x7fed9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.292 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.288+0000 7feda27fc640 1 -- 172.21.15.114:0/1699445979 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feda40abd40 con 0x7fedac15ade0 2023-11-04T01:36:23.292 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.288+0000 7fedb1dc2640 1 --2- 172.21.15.114:0/1699445979 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed9006ae70 0x7fed9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.292 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.289+0000 7fedb1dc2640 1 --2- 172.21.15.114:0/1699445979 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed9006ae70 0x7fed9006d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feda800a830 tx=0x7feda8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.294 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.293+0000 7feda27fc640 1 -- 172.21.15.114:0/1699445979 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fedac15bf50 con 0x7fedac15ade0 2023-11-04T01:36:23.462 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.458+0000 7fedb4026640 1 -- 172.21.15.114:0/1699445979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedac15bf50 con 0x7fedac15ade0 2023-11-04T01:36:23.462 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.459+0000 7feda27fc640 1 -- 172.21.15.114:0/1699445979 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12910 (secure 0 0 0) 0x7fedac15bf50 con 0x7fedac15ade0 2023-11-04T01:36:23.462 INFO:teuthology.misc.health.smithi114.stdout: 2023-11-04T01:36:23.462 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":16,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:20.031904+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:23.463 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.461+0000 7fedb4026640 1 -- 172.21.15.114:0/1699445979 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed9006ae70 msgr2=0x7fed9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.463 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.461+0000 7fedb4026640 1 --2- 172.21.15.114:0/1699445979 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed9006ae70 0x7fed9006d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feda800a830 tx=0x7feda8008040 comp rx=0 tx=0).stop 2023-11-04T01:36:23.464 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.461+0000 7fedb4026640 1 -- 172.21.15.114:0/1699445979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedac15ade0 msgr2=0x7fedac155310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.464 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.461+0000 7fedb4026640 1 --2- 172.21.15.114:0/1699445979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedac15ade0 0x7fedac155310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feda4009d90 tx=0x7feda4004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:23.464 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.461+0000 7fedb4026640 1 -- 172.21.15.114:0/1699445979 shutdown_connections 2023-11-04T01:36:23.464 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.461+0000 7fedb4026640 1 --2- 172.21.15.114:0/1699445979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedac15ade0 0x7fedac155310 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.464 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.461+0000 7fedb4026640 1 --2- 172.21.15.114:0/1699445979 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fedac0cda70 0x7fedac1532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.464 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.461+0000 7fedb4026640 1 --2- 172.21.15.114:0/1699445979 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed9006ae70 0x7fed9006d330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.464 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.461+0000 7fedb4026640 1 --2- 172.21.15.114:0/1699445979 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fedac0cd600 0x7fedac150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.464 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.461+0000 7fedb4026640 1 -- 172.21.15.114:0/1699445979 >> 172.21.15.114:0/1699445979 conn(0x7fedac06ea40 msgr2=0x7fedac0cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:23.464 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.461+0000 7fedb4026640 1 -- 172.21.15.114:0/1699445979 shutdown_connections 2023-11-04T01:36:23.464 INFO:teuthology.misc.health.smithi114.stderr:2023-11-04T01:36:23.461+0000 7fedb4026640 1 -- 172.21.15.114:0/1699445979 wait complete. 2023-11-04T01:36:23.473 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-04T01:36:23.473 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-04T01:36:23.473 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:36:23.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:36:23.481 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:36:23.481 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:36:23.481 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:36:23.483 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:36:23.483 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:36:23.483 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:36:23.486 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:36:23.486 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:36:23.486 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:36:23.488 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:36:23.488 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-04T01:36:23.489 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:23.552 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2023-11-04T01:36:23.560 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2023-11-04T01:36:23.574 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-04T01:36:23.574 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-04T01:36:23.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.591+0000 7fc4aac4f640 1 Processor -- start 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.591+0000 7fc4aac4f640 1 -- start start 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.592+0000 7fc4aac4f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc4a40cde60 0x7fc4a415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.592+0000 7fc4aac4f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc4a40ce240 0x7fc4a40d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.592+0000 7fc4aac4f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a415e000 con 0x7fc4a415daa0 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.592+0000 7fc4aac4f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a415e5c0 con 0x7fc4a40ce240 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.592+0000 7fc4aac4f640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a415e2e0 con 0x7fc4a40cde60 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.592+0000 7fc4a91ec640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc4a40ce240 0x7fc4a40d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.592+0000 7fc4a91ec640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc4a40ce240 0x7fc4a40d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51678/0 (socket says 172.21.15.114:51678) 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.592+0000 7fc4a91ec640 1 -- 172.21.15.114:0/1568116770 learned_addr learned my addr 172.21.15.114:0/1568116770 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.592+0000 7fc4a89eb640 1 --2- 172.21.15.114:0/1568116770 >> v2:172.21.15.141:3300/0 conn(0x7fc4a40cde60 0x7fc4a415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.593+0000 7fc4a91ec640 1 -- 172.21.15.114:0/1568116770 >> v2:172.21.15.141:3300/0 conn(0x7fc4a40cde60 msgr2=0x7fc4a415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.593+0000 7fc4a91ec640 1 --2- 172.21.15.114:0/1568116770 >> v2:172.21.15.141:3300/0 conn(0x7fc4a40cde60 0x7fc4a415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.593+0000 7fc4a91ec640 1 -- 172.21.15.114:0/1568116770 >> v1:172.21.15.114:6789/0 conn(0x7fc4a415daa0 legacy=0x7fc4a4157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.593+0000 7fc4a91ec640 1 -- 172.21.15.114:0/1568116770 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a40d1120 con 0x7fc4a40ce240 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.593+0000 7fc4a91ec640 1 --2- 172.21.15.114:0/1568116770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a40ce240 0x7fc4a40d1920 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40b5550 tx=0x7fc49c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c7590e0237f6d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.593+0000 7fc4a37fe640 1 -- 172.21.15.114:0/1568116770 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c02cb20 con 0x7fc4a40ce240 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.593+0000 7fc4a37fe640 1 -- 172.21.15.114:0/1568116770 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c02cc80 con 0x7fc4a40ce240 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.593+0000 7fc4a37fe640 1 -- 172.21.15.114:0/1568116770 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0343f0 con 0x7fc4a40ce240 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.594+0000 7fc4aac4f640 1 -- 172.21.15.114:0/1568116770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a40ce240 msgr2=0x7fc4a40d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.594+0000 7fc4aac4f640 1 --2- 172.21.15.114:0/1568116770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a40ce240 0x7fc4a40d1920 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40b5550 tx=0x7fc49c02bf80 comp rx=0 tx=0).stop 2023-11-04T01:36:23.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.594+0000 7fc4aac4f640 1 -- 172.21.15.114:0/1568116770 shutdown_connections 2023-11-04T01:36:23.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.594+0000 7fc4aac4f640 1 --2- 172.21.15.114:0/1568116770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a40ce240 0x7fc4a40d1920 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.594+0000 7fc4aac4f640 1 --2- 172.21.15.114:0/1568116770 >> v2:172.21.15.141:3300/0 conn(0x7fc4a40cde60 0x7fc4a415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.594+0000 7fc4aac4f640 1 -- 172.21.15.114:0/1568116770 >> 172.21.15.114:0/1568116770 conn(0x7fc4a4071f30 msgr2=0x7fc4a40cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:23.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.594+0000 7fc4aac4f640 1 -- 172.21.15.114:0/1568116770 shutdown_connections 2023-11-04T01:36:23.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.594+0000 7fc4aac4f640 1 -- 172.21.15.114:0/1568116770 wait complete. 2023-11-04T01:36:23.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.595+0000 7fc4aac4f640 1 Processor -- start 2023-11-04T01:36:23.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.595+0000 7fc4aac4f640 1 -- start start 2023-11-04T01:36:23.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.596+0000 7fc4aac4f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4a40cde60 0x7fc4a4153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.596+0000 7fc4aac4f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4a40ce240 0x7fc4a41f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.596+0000 7fc4aac4f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a415daa0 0x7fc4a41502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.596+0000 7fc4aac4f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a41f2c20 con 0x7fc4a415daa0 2023-11-04T01:36:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.596+0000 7fc4aac4f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a41f2ec0 con 0x7fc4a40ce240 2023-11-04T01:36:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.596+0000 7fc4aac4f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a41f31a0 con 0x7fc4a40cde60 2023-11-04T01:36:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.596+0000 7fc4a91ec640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a415daa0 0x7fc4a41502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.596+0000 7fc4a91ec640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a415daa0 0x7fc4a41502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51682/0 (socket says 172.21.15.114:51682) 2023-11-04T01:36:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.596+0000 7fc4a91ec640 1 -- 172.21.15.114:0/3606122392 learned_addr learned my addr 172.21.15.114:0/3606122392 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.596+0000 7fc4a89eb640 1 --2- 172.21.15.114:0/3606122392 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4a40cde60 0x7fc4a4153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.596+0000 7fc4a3fff640 1 --2- 172.21.15.114:0/3606122392 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4a40ce240 0x7fc4a41f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.596+0000 7fc4a91ec640 1 -- 172.21.15.114:0/3606122392 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4a40cde60 msgr2=0x7fc4a4153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.596+0000 7fc4a91ec640 1 --2- 172.21.15.114:0/3606122392 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4a40cde60 0x7fc4a4153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.596+0000 7fc4a91ec640 1 -- 172.21.15.114:0/3606122392 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4a40ce240 msgr2=0x7fc4a41f26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.596+0000 7fc4a91ec640 1 --2- 172.21.15.114:0/3606122392 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4a40ce240 0x7fc4a41f26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.596+0000 7fc4a91ec640 1 -- 172.21.15.114:0/3606122392 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c009b30 con 0x7fc4a415daa0 2023-11-04T01:36:23.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.597+0000 7fc4a91ec640 1 --2- 172.21.15.114:0/3606122392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a415daa0 0x7fc4a41502e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc49c036040 tx=0x7fc49c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.597+0000 7fc4a17fa640 1 -- 172.21.15.114:0/3606122392 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c007e70 con 0x7fc4a415daa0 2023-11-04T01:36:23.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.597+0000 7fc4a17fa640 1 -- 172.21.15.114:0/3606122392 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c009510 con 0x7fc4a415daa0 2023-11-04T01:36:23.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.597+0000 7fc4a17fa640 1 -- 172.21.15.114:0/3606122392 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c03e690 con 0x7fc4a415daa0 2023-11-04T01:36:23.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.597+0000 7fc4aac4f640 1 -- 172.21.15.114:0/3606122392 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a41f3480 con 0x7fc4a415daa0 2023-11-04T01:36:23.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.597+0000 7fc4aac4f640 1 -- 172.21.15.114:0/3606122392 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a414e400 con 0x7fc4a415daa0 2023-11-04T01:36:23.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.598+0000 7fc4aac4f640 1 -- 172.21.15.114:0/3606122392 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a414ef70 con 0x7fc4a415daa0 2023-11-04T01:36:23.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.598+0000 7fc4a17fa640 1 -- 172.21.15.114:0/3606122392 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc49c03e7f0 con 0x7fc4a415daa0 2023-11-04T01:36:23.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.598+0000 7fc4a17fa640 1 --2- 172.21.15.114:0/3606122392 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc48806ae70 0x7fc48806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.599+0000 7fc4a89eb640 1 --2- 172.21.15.114:0/3606122392 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc48806ae70 0x7fc48806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.599+0000 7fc4a17fa640 1 -- 172.21.15.114:0/3606122392 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc49c0abe60 con 0x7fc4a415daa0 2023-11-04T01:36:23.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.599+0000 7fc4a89eb640 1 --2- 172.21.15.114:0/3606122392 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc48806ae70 0x7fc48806d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc498006fd0 tx=0x7fc498008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.603+0000 7fc4a17fa640 1 -- 172.21.15.114:0/3606122392 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc49c077260 con 0x7fc4a415daa0 2023-11-04T01:36:23.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.772+0000 7fc4aac4f640 1 -- 172.21.15.114:0/3606122392 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4a414f310 con 0x7fc4a415daa0 2023-11-04T01:36:23.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.773+0000 7fc4a17fa640 1 -- 172.21.15.114:0/3606122392 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12910 (secure 0 0 0) 0x7fc49c07a880 con 0x7fc4a415daa0 2023-11-04T01:36:23.775 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:23.775 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":16,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:20.031904+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:23.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.775+0000 7fc4aac4f640 1 -- 172.21.15.114:0/3606122392 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc48806ae70 msgr2=0x7fc48806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.775+0000 7fc4aac4f640 1 --2- 172.21.15.114:0/3606122392 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc48806ae70 0x7fc48806d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc498006fd0 tx=0x7fc498008040 comp rx=0 tx=0).stop 2023-11-04T01:36:23.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.775+0000 7fc4aac4f640 1 -- 172.21.15.114:0/3606122392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a415daa0 msgr2=0x7fc4a41502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.775+0000 7fc4aac4f640 1 --2- 172.21.15.114:0/3606122392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a415daa0 0x7fc4a41502e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc49c036040 tx=0x7fc49c004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:23.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.775+0000 7fc4aac4f640 1 -- 172.21.15.114:0/3606122392 shutdown_connections 2023-11-04T01:36:23.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.775+0000 7fc4aac4f640 1 --2- 172.21.15.114:0/3606122392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4a415daa0 0x7fc4a41502e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.775+0000 7fc4aac4f640 1 --2- 172.21.15.114:0/3606122392 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc48806ae70 0x7fc48806d330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.775+0000 7fc4aac4f640 1 --2- 172.21.15.114:0/3606122392 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4a40ce240 0x7fc4a41f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.775+0000 7fc4aac4f640 1 --2- 172.21.15.114:0/3606122392 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4a40cde60 0x7fc4a4153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.775+0000 7fc4aac4f640 1 -- 172.21.15.114:0/3606122392 >> 172.21.15.114:0/3606122392 conn(0x7fc4a4071f30 msgr2=0x7fc4a40c9200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:23.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.775+0000 7fc4aac4f640 1 -- 172.21.15.114:0/3606122392 shutdown_connections 2023-11-04T01:36:23.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.775+0000 7fc4aac4f640 1 -- 172.21.15.114:0/3606122392 wait complete. 2023-11-04T01:36:23.787 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:36:23.788 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:23.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.888+0000 7fcca6426640 1 Processor -- start 2023-11-04T01:36:23.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.888+0000 7fcca6426640 1 -- start start 2023-11-04T01:36:23.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.888+0000 7fcca6426640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca01603d0 0x7fcca00b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.888+0000 7fcca6426640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fcca00722a0 0x7fcca006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.888+0000 7fcca6426640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcca006a660 0x7fcca0160b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.888+0000 7fcca6426640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca00b19d0 con 0x7fcca006a660 2023-11-04T01:36:23.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.888+0000 7fcca6426640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca006aaf0 con 0x7fcca00722a0 2023-11-04T01:36:23.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.888+0000 7fcca6426640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00cdf80 con 0x7fcca01603d0 2023-11-04T01:36:23.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.888+0000 7fcca49c3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcca006a660 0x7fcca0160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.888+0000 7fcca49c3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcca006a660 0x7fcca0160b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51694/0 (socket says 172.21.15.114:51694) 2023-11-04T01:36:23.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.888+0000 7fcca49c3640 1 -- 172.21.15.114:0/645301828 learned_addr learned my addr 172.21.15.114:0/645301828 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:23.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.889+0000 7fcc9ffff640 1 --2- 172.21.15.114:0/645301828 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca01603d0 0x7fcca00b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.889+0000 7fcc9f7fe640 1 --2- 172.21.15.114:0/645301828 >> v2:172.21.15.141:3300/0 conn(0x7fcca00722a0 0x7fcca006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.889+0000 7fcca49c3640 1 -- 172.21.15.114:0/645301828 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca01603d0 msgr2=0x7fcca00b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:23.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.889+0000 7fcca49c3640 1 --2- 172.21.15.114:0/645301828 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca01603d0 0x7fcca00b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.889+0000 7fcca49c3640 1 -- 172.21.15.114:0/645301828 >> v2:172.21.15.141:3300/0 conn(0x7fcca00722a0 msgr2=0x7fcca006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:23.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.889+0000 7fcca49c3640 1 --2- 172.21.15.114:0/645301828 >> v2:172.21.15.141:3300/0 conn(0x7fcca00722a0 0x7fcca006a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.889+0000 7fcca49c3640 1 -- 172.21.15.114:0/645301828 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca00ce6f0 con 0x7fcca006a660 2023-11-04T01:36:23.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.889+0000 7fcc9ffff640 1 --2- 172.21.15.114:0/645301828 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca01603d0 0x7fcca00b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:23.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.889+0000 7fcca49c3640 1 --2- 172.21.15.114:0/645301828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcca006a660 0x7fcca0160b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcca006cb60 tx=0x7fcc9802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdcf921ab5f38bf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.889+0000 7fcc9effd640 1 -- 172.21.15.114:0/645301828 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9802c9e0 con 0x7fcca006a660 2023-11-04T01:36:23.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.890+0000 7fcc9effd640 1 -- 172.21.15.114:0/645301828 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9802cb40 con 0x7fcca006a660 2023-11-04T01:36:23.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.890+0000 7fcc9effd640 1 -- 172.21.15.114:0/645301828 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc980343f0 con 0x7fcca006a660 2023-11-04T01:36:23.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.890+0000 7fcca6426640 1 -- 172.21.15.114:0/645301828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcca006a660 msgr2=0x7fcca0160b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.890+0000 7fcca6426640 1 --2- 172.21.15.114:0/645301828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcca006a660 0x7fcca0160b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcca006cb60 tx=0x7fcc9802be40 comp rx=0 tx=0).stop 2023-11-04T01:36:23.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.890+0000 7fcca6426640 1 -- 172.21.15.114:0/645301828 shutdown_connections 2023-11-04T01:36:23.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.890+0000 7fcca6426640 1 --2- 172.21.15.114:0/645301828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcca006a660 0x7fcca0160b30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.890+0000 7fcca6426640 1 --2- 172.21.15.114:0/645301828 >> v2:172.21.15.141:3300/0 conn(0x7fcca00722a0 0x7fcca006a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.890+0000 7fcca6426640 1 --2- 172.21.15.114:0/645301828 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca01603d0 0x7fcca00b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.890+0000 7fcca6426640 1 -- 172.21.15.114:0/645301828 >> 172.21.15.114:0/645301828 conn(0x7fcca006d800 msgr2=0x7fcca006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:23.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.890+0000 7fcca6426640 1 -- 172.21.15.114:0/645301828 shutdown_connections 2023-11-04T01:36:23.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.890+0000 7fcca6426640 1 -- 172.21.15.114:0/645301828 wait complete. 2023-11-04T01:36:23.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.891+0000 7fcca6426640 1 Processor -- start 2023-11-04T01:36:23.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.891+0000 7fcca6426640 1 -- start start 2023-11-04T01:36:23.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.892+0000 7fcca6426640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcca006a660 0x7fcca0151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.892+0000 7fcca6426640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca00722a0 0x7fcca0153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.892+0000 7fcca6426640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcca01603d0 0x7fcca00ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.892+0000 7fcca6426640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00b5130 con 0x7fcca01603d0 2023-11-04T01:36:23.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.892+0000 7fcca6426640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00b45b0 con 0x7fcca006a660 2023-11-04T01:36:23.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.892+0000 7fcca6426640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00b4890 con 0x7fcca00722a0 2023-11-04T01:36:23.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.892+0000 7fcca49c3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcca01603d0 0x7fcca00ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.892+0000 7fcca49c3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcca01603d0 0x7fcca00ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51710/0 (socket says 172.21.15.114:51710) 2023-11-04T01:36:23.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.892+0000 7fcca49c3640 1 -- 172.21.15.114:0/1939990759 learned_addr learned my addr 172.21.15.114:0/1939990759 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:23.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.892+0000 7fcc9f7fe640 1 --2- 172.21.15.114:0/1939990759 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca00722a0 0x7fcca0153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.893+0000 7fcc9ffff640 1 --2- 172.21.15.114:0/1939990759 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcca006a660 0x7fcca0151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.893+0000 7fcca49c3640 1 -- 172.21.15.114:0/1939990759 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca00722a0 msgr2=0x7fcca0153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.893+0000 7fcca49c3640 1 --2- 172.21.15.114:0/1939990759 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca00722a0 0x7fcca0153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.893+0000 7fcca49c3640 1 -- 172.21.15.114:0/1939990759 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcca006a660 msgr2=0x7fcca0151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:23.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.893+0000 7fcca49c3640 1 --2- 172.21.15.114:0/1939990759 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcca006a660 0x7fcca0151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:23.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.893+0000 7fcca49c3640 1 -- 172.21.15.114:0/1939990759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc98009b30 con 0x7fcca01603d0 2023-11-04T01:36:23.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.893+0000 7fcc9f7fe640 1 --2- 172.21.15.114:0/1939990759 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca00722a0 0x7fcca0153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:23.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.893+0000 7fcc9ffff640 1 --2- 172.21.15.114:0/1939990759 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcca006a660 0x7fcca0151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:23.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.893+0000 7fcca49c3640 1 --2- 172.21.15.114:0/1939990759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcca01603d0 0x7fcca00ca340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009f40 tx=0x7fcc98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.893+0000 7fcc9cff9640 1 -- 172.21.15.114:0/1939990759 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98009510 con 0x7fcca01603d0 2023-11-04T01:36:23.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.893+0000 7fcc9cff9640 1 -- 172.21.15.114:0/1939990759 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9803e450 con 0x7fcca01603d0 2023-11-04T01:36:23.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.893+0000 7fcca6426640 1 -- 172.21.15.114:0/1939990759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca00b4b70 con 0x7fcca01603d0 2023-11-04T01:36:23.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.893+0000 7fcc9cff9640 1 -- 172.21.15.114:0/1939990759 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9803e7e0 con 0x7fcca01603d0 2023-11-04T01:36:23.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.893+0000 7fcca6426640 1 -- 172.21.15.114:0/1939990759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca0152380 con 0x7fcca01603d0 2023-11-04T01:36:23.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.894+0000 7fcca6426640 1 -- 172.21.15.114:0/1939990759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca01f2740 con 0x7fcca01603d0 2023-11-04T01:36:23.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.894+0000 7fcc9cff9640 1 -- 172.21.15.114:0/1939990759 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc9803e940 con 0x7fcca01603d0 2023-11-04T01:36:23.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.895+0000 7fcc9cff9640 1 --2- 172.21.15.114:0/1939990759 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcc8c06ae70 0x7fcc8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:23.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.895+0000 7fcc9cff9640 1 -- 172.21.15.114:0/1939990759 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcc980ac110 con 0x7fcca01603d0 2023-11-04T01:36:23.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.895+0000 7fcc9ffff640 1 --2- 172.21.15.114:0/1939990759 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcc8c06ae70 0x7fcc8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:23.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.895+0000 7fcc9ffff640 1 --2- 172.21.15.114:0/1939990759 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcc8c06ae70 0x7fcc8c06d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcc94006fd0 tx=0x7fcc94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:23.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:23.899+0000 7fcc9cff9640 1 -- 172.21.15.114:0/1939990759 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcc98077510 con 0x7fcca01603d0 2023-11-04T01:36:24.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.065+0000 7fcca6426640 1 -- 172.21.15.114:0/1939990759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcca00674e0 con 0x7fcca01603d0 2023-11-04T01:36:24.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.065+0000 7fcc9cff9640 1 -- 172.21.15.114:0/1939990759 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc9807ab30 con 0x7fcca01603d0 2023-11-04T01:36:24.067 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:36:24.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.067+0000 7fcca6426640 1 -- 172.21.15.114:0/1939990759 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcc8c06ae70 msgr2=0x7fcc8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.067+0000 7fcca6426640 1 --2- 172.21.15.114:0/1939990759 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcc8c06ae70 0x7fcc8c06d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcc94006fd0 tx=0x7fcc94008040 comp rx=0 tx=0).stop 2023-11-04T01:36:24.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.067+0000 7fcca6426640 1 -- 172.21.15.114:0/1939990759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcca01603d0 msgr2=0x7fcca00ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.067+0000 7fcca6426640 1 --2- 172.21.15.114:0/1939990759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcca01603d0 0x7fcca00ca340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009f40 tx=0x7fcc98004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:24.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.067+0000 7fcca6426640 1 -- 172.21.15.114:0/1939990759 shutdown_connections 2023-11-04T01:36:24.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.067+0000 7fcca6426640 1 --2- 172.21.15.114:0/1939990759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcca01603d0 0x7fcca00ca340 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.067+0000 7fcca6426640 1 --2- 172.21.15.114:0/1939990759 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcca00722a0 0x7fcca0153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.067+0000 7fcca6426640 1 --2- 172.21.15.114:0/1939990759 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcc8c06ae70 0x7fcc8c06d330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.067+0000 7fcca6426640 1 --2- 172.21.15.114:0/1939990759 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcca006a660 0x7fcca0151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.067+0000 7fcca6426640 1 -- 172.21.15.114:0/1939990759 >> 172.21.15.114:0/1939990759 conn(0x7fcca006d800 msgr2=0x7fcca0071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:24.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.068+0000 7fcca6426640 1 -- 172.21.15.114:0/1939990759 shutdown_connections 2023-11-04T01:36:24.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.068+0000 7fcca6426640 1 -- 172.21.15.114:0/1939990759 wait complete. 2023-11-04T01:36:24.080 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:24.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.177+0000 7f94e4d41640 1 Processor -- start 2023-11-04T01:36:24.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.177+0000 7f94e4d41640 1 -- start start 2023-11-04T01:36:24.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.178+0000 7f94e4d41640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f94e00cde60 0x7f94e015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.178+0000 7f94e4d41640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f94e015daa0 0x7f94e0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.178+0000 7f94e4d41640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e015e000 con 0x7f94e00ce240 2023-11-04T01:36:24.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.178+0000 7f94e4d41640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e015e5c0 con 0x7f94e015daa0 2023-11-04T01:36:24.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.178+0000 7f94e4d41640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e015e2e0 con 0x7f94e00cde60 2023-11-04T01:36:24.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.178+0000 7f94ded9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f94e00ce240 0x7f94e006b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:57416/0 (socket says 172.21.15.114:57416) 2023-11-04T01:36:24.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.178+0000 7f94ded9d640 1 -- 172.21.15.114:0/249948789 learned_addr learned my addr 172.21.15.114:0/249948789 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:24.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.178+0000 7f94de59c640 1 --2- 172.21.15.114:0/249948789 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f94e00cde60 0x7f94e015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.178+0000 7f94d5d9b640 1 --2- 172.21.15.114:0/249948789 >> v2:172.21.15.141:3300/0 conn(0x7f94e015daa0 0x7f94e0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.178+0000 7f94ddd9b640 1 -- 172.21.15.114:0/249948789 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536711 0 0) 0x7f94e015e000 con 0x7f94e00ce240 2023-11-04T01:36:24.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.178+0000 7f94ddd9b640 1 -- 172.21.15.114:0/249948789 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94cc003520 con 0x7f94e00ce240 2023-11-04T01:36:24.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.178+0000 7f94de59c640 1 -- 172.21.15.114:0/249948789 >> v2:172.21.15.141:3300/0 conn(0x7f94e015daa0 msgr2=0x7f94e0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:24.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.178+0000 7f94de59c640 1 --2- 172.21.15.114:0/249948789 >> v2:172.21.15.141:3300/0 conn(0x7f94e015daa0 0x7f94e0157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.178+0000 7f94de59c640 1 -- 172.21.15.114:0/249948789 >> v1:172.21.15.114:6789/0 conn(0x7f94e00ce240 legacy=0x7f94e006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.178+0000 7f94ddd9b640 1 -- 172.21.15.114:0/249948789 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 305852742 0 0) 0x7f94cc003520 con 0x7f94e00ce240 2023-11-04T01:36:24.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.178+0000 7f94de59c640 1 -- 172.21.15.114:0/249948789 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e00d1120 con 0x7f94e00cde60 2023-11-04T01:36:24.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.179+0000 7f94de59c640 1 --2- 172.21.15.114:0/249948789 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f94e00cde60 0x7f94e015d560 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f94d00097a0 tx=0x7f94d002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44cea371215f5ed7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:24.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.179+0000 7f94ddd9b640 1 -- 172.21.15.114:0/249948789 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d80019f0 con 0x7f94e00cde60 2023-11-04T01:36:24.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.179+0000 7f94ddd9b640 1 -- 172.21.15.114:0/249948789 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d002e050 con 0x7f94e00cde60 2023-11-04T01:36:24.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.179+0000 7f94ddd9b640 1 -- 172.21.15.114:0/249948789 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0030710 con 0x7f94e00cde60 2023-11-04T01:36:24.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.180+0000 7f94e4d41640 1 -- 172.21.15.114:0/249948789 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f94e00cde60 msgr2=0x7f94e015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.180+0000 7f94e4d41640 1 --2- 172.21.15.114:0/249948789 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f94e00cde60 0x7f94e015d560 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f94d00097a0 tx=0x7f94d002b790 comp rx=0 tx=0).stop 2023-11-04T01:36:24.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.180+0000 7f94e4d41640 1 -- 172.21.15.114:0/249948789 shutdown_connections 2023-11-04T01:36:24.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.180+0000 7f94e4d41640 1 --2- 172.21.15.114:0/249948789 >> v2:172.21.15.141:3300/0 conn(0x7f94e015daa0 0x7f94e0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.180+0000 7f94e4d41640 1 --2- 172.21.15.114:0/249948789 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f94e00cde60 0x7f94e015d560 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.180+0000 7f94e4d41640 1 -- 172.21.15.114:0/249948789 >> 172.21.15.114:0/249948789 conn(0x7f94e0071f30 msgr2=0x7f94e00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:24.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.180+0000 7f94e4d41640 1 -- 172.21.15.114:0/249948789 shutdown_connections 2023-11-04T01:36:24.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.180+0000 7f94e4d41640 1 -- 172.21.15.114:0/249948789 wait complete. 2023-11-04T01:36:24.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.181+0000 7f94e4d41640 1 Processor -- start 2023-11-04T01:36:24.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.181+0000 7f94e4d41640 1 -- start start 2023-11-04T01:36:24.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94e4d41640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f94e00cde60 0x7f94e01f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94e4d41640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f94e00ce240 0x7f94e0152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94e4d41640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e015daa0 0x7f94e00c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94e4d41640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e01e4160 con 0x7f94e015daa0 2023-11-04T01:36:24.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94e4d41640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0153390 con 0x7f94e00cde60 2023-11-04T01:36:24.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94e4d41640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e01543c0 con 0x7f94e00ce240 2023-11-04T01:36:24.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94ded9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e015daa0 0x7f94e00c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94ded9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e015daa0 0x7f94e00c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51716/0 (socket says 172.21.15.114:51716) 2023-11-04T01:36:24.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94ded9d640 1 -- 172.21.15.114:0/2461469397 learned_addr learned my addr 172.21.15.114:0/2461469397 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:24.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94d5d9b640 1 --2- 172.21.15.114:0/2461469397 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f94e00ce240 0x7f94e0152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94ded9d640 1 -- 172.21.15.114:0/2461469397 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f94e00ce240 msgr2=0x7f94e0152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94de59c640 1 --2- 172.21.15.114:0/2461469397 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f94e00cde60 0x7f94e01f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94ded9d640 1 --2- 172.21.15.114:0/2461469397 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f94e00ce240 0x7f94e0152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94ded9d640 1 -- 172.21.15.114:0/2461469397 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f94e00cde60 msgr2=0x7f94e01f25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94ded9d640 1 --2- 172.21.15.114:0/2461469397 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f94e00cde60 0x7f94e01f25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94ded9d640 1 -- 172.21.15.114:0/2461469397 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d0009400 con 0x7f94e015daa0 2023-11-04T01:36:24.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94d5d9b640 1 --2- 172.21.15.114:0/2461469397 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f94e00ce240 0x7f94e0152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:24.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94de59c640 1 --2- 172.21.15.114:0/2461469397 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f94e00cde60 0x7f94e01f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:24.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.182+0000 7f94ded9d640 1 --2- 172.21.15.114:0/2461469397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e015daa0 0x7f94e00c6950 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f94d8001f70 tx=0x7f94d800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:24.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.183+0000 7f94d77fe640 1 -- 172.21.15.114:0/2461469397 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8012400 con 0x7f94e015daa0 2023-11-04T01:36:24.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.183+0000 7f94d77fe640 1 -- 172.21.15.114:0/2461469397 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d8012560 con 0x7f94e015daa0 2023-11-04T01:36:24.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.183+0000 7f94e4d41640 1 -- 172.21.15.114:0/2461469397 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e01546a0 con 0x7f94e015daa0 2023-11-04T01:36:24.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.183+0000 7f94d77fe640 1 -- 172.21.15.114:0/2461469397 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8012910 con 0x7f94e015daa0 2023-11-04T01:36:24.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.183+0000 7f94e4d41640 1 -- 172.21.15.114:0/2461469397 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e00c6e90 con 0x7f94e015daa0 2023-11-04T01:36:24.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.184+0000 7f94e4d41640 1 -- 172.21.15.114:0/2461469397 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e01e3c50 con 0x7f94e015daa0 2023-11-04T01:36:24.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.184+0000 7f94d77fe640 1 -- 172.21.15.114:0/2461469397 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f94d8012a70 con 0x7f94e015daa0 2023-11-04T01:36:24.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.184+0000 7f94d77fe640 1 --2- 172.21.15.114:0/2461469397 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f94c006aea0 0x7f94c006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:24.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.184+0000 7f94d77fe640 1 -- 172.21.15.114:0/2461469397 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f94d8089b00 con 0x7f94e015daa0 2023-11-04T01:36:24.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.184+0000 7f94de59c640 1 --2- 172.21.15.114:0/2461469397 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f94c006aea0 0x7f94c006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:24.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.185+0000 7f94de59c640 1 --2- 172.21.15.114:0/2461469397 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f94c006aea0 0x7f94c006d360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f94d0034000 tx=0x7f94d002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:24.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.188+0000 7f94d77fe640 1 -- 172.21.15.114:0/2461469397 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f94e01e3c50 con 0x7f94e015daa0 2023-11-04T01:36:24.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.388+0000 7f94e4d41640 1 -- 172.21.15.114:0/2461469397 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94e01e3c50 con 0x7f94e015daa0 2023-11-04T01:36:24.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.389+0000 7f94d77fe640 1 -- 172.21.15.114:0/2461469397 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f94e01e3c50 con 0x7f94e015daa0 2023-11-04T01:36:24.391 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:24.391 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3079825621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3079825621},{"type":"v1","addr":"172.21.15.114:6835","nonce":3079825621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-04T01:36:24.391 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 2 2023-11-04T01:36:24.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.391+0000 7f94e4d41640 1 -- 172.21.15.114:0/2461469397 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f94c006aea0 msgr2=0x7f94c006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.391+0000 7f94e4d41640 1 --2- 172.21.15.114:0/2461469397 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f94c006aea0 0x7f94c006d360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f94d0034000 tx=0x7f94d002f000 comp rx=0 tx=0).stop 2023-11-04T01:36:24.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.391+0000 7f94e4d41640 1 -- 172.21.15.114:0/2461469397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e015daa0 msgr2=0x7f94e00c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:24.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.391+0000 7f94e4d41640 1 --2- 172.21.15.114:0/2461469397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e015daa0 0x7f94e00c6950 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f94d8001f70 tx=0x7f94d800a430 comp rx=0 tx=0).stop 2023-11-04T01:36:24.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.391+0000 7f94e4d41640 1 -- 172.21.15.114:0/2461469397 shutdown_connections 2023-11-04T01:36:24.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.391+0000 7f94e4d41640 1 --2- 172.21.15.114:0/2461469397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e015daa0 0x7f94e00c6950 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.391+0000 7f94e4d41640 1 --2- 172.21.15.114:0/2461469397 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f94e00ce240 0x7f94e0152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.391+0000 7f94e4d41640 1 --2- 172.21.15.114:0/2461469397 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f94c006aea0 0x7f94c006d360 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.391+0000 7f94e4d41640 1 --2- 172.21.15.114:0/2461469397 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f94e00cde60 0x7f94e01f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:24.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.391+0000 7f94e4d41640 1 -- 172.21.15.114:0/2461469397 >> 172.21.15.114:0/2461469397 conn(0x7f94e0071f30 msgr2=0x7f94e0156410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:24.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.391+0000 7f94e4d41640 1 -- 172.21.15.114:0/2461469397 shutdown_connections 2023-11-04T01:36:24.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:24.391+0000 7f94e4d41640 1 -- 172.21.15.114:0/2461469397 wait complete. 2023-11-04T01:36:26.405 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.513+0000 7ff4fe5c9640 1 Processor -- start 2023-11-04T01:36:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.513+0000 7ff4fe5c9640 1 -- start start 2023-11-04T01:36:26.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.513+0000 7ff4fe5c9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff4f815bfb0 0x7ff4f80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.513+0000 7ff4fe5c9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff4f80cd860 0x7ff4f80ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.513+0000 7ff4fe5c9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f80cc450 con 0x7ff4f815ae40 2023-11-04T01:36:26.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.513+0000 7ff4fe5c9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f815f400 con 0x7ff4f80cd860 2023-11-04T01:36:26.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.514+0000 7ff4fe5c9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f815b220 con 0x7ff4f815bfb0 2023-11-04T01:36:26.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.514+0000 7ff4fcb66640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff4f80cd860 0x7ff4f80ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.514+0000 7ff4fcb66640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff4f80cd860 0x7ff4f80ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36082/0 (socket says 172.21.15.114:36082) 2023-11-04T01:36:26.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.514+0000 7ff4fcb66640 1 -- 172.21.15.114:0/2095079799 learned_addr learned my addr 172.21.15.114:0/2095079799 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:26.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.514+0000 7ff4f77fe640 1 --2- 172.21.15.114:0/2095079799 >> v2:172.21.15.141:3300/0 conn(0x7ff4f815bfb0 0x7ff4f80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.514+0000 7ff4fcb66640 1 -- 172.21.15.114:0/2095079799 >> v2:172.21.15.141:3300/0 conn(0x7ff4f815bfb0 msgr2=0x7ff4f80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:26.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.514+0000 7ff4fcb66640 1 --2- 172.21.15.114:0/2095079799 >> v2:172.21.15.141:3300/0 conn(0x7ff4f815bfb0 0x7ff4f80cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.514+0000 7ff4fcb66640 1 -- 172.21.15.114:0/2095079799 >> v1:172.21.15.141:6789/0 conn(0x7ff4f815ae40 legacy=0x7ff4f80cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.514+0000 7ff4fcb66640 1 -- 172.21.15.114:0/2095079799 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f815f890 con 0x7ff4f80cd860 2023-11-04T01:36:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.515+0000 7ff4fcb66640 1 --2- 172.21.15.114:0/2095079799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80cd860 0x7ff4f80ced70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80b05d0 tx=0x7ff4f002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81d8f76d8f92e0a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.515+0000 7ff4f6ffd640 1 -- 172.21.15.114:0/2095079799 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f002cb20 con 0x7ff4f80cd860 2023-11-04T01:36:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.515+0000 7ff4f6ffd640 1 -- 172.21.15.114:0/2095079799 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f002cc80 con 0x7ff4f80cd860 2023-11-04T01:36:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.515+0000 7ff4f6ffd640 1 -- 172.21.15.114:0/2095079799 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00343f0 con 0x7ff4f80cd860 2023-11-04T01:36:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.515+0000 7ff4fe5c9640 1 -- 172.21.15.114:0/2095079799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80cd860 msgr2=0x7ff4f80ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.515+0000 7ff4fe5c9640 1 --2- 172.21.15.114:0/2095079799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80cd860 0x7ff4f80ced70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80b05d0 tx=0x7ff4f002bf80 comp rx=0 tx=0).stop 2023-11-04T01:36:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.515+0000 7ff4fe5c9640 1 -- 172.21.15.114:0/2095079799 shutdown_connections 2023-11-04T01:36:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.515+0000 7ff4fe5c9640 1 --2- 172.21.15.114:0/2095079799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80cd860 0x7ff4f80ced70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.515+0000 7ff4fe5c9640 1 --2- 172.21.15.114:0/2095079799 >> v2:172.21.15.141:3300/0 conn(0x7ff4f815bfb0 0x7ff4f80cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.515+0000 7ff4fe5c9640 1 -- 172.21.15.114:0/2095079799 >> 172.21.15.114:0/2095079799 conn(0x7ff4f806ea90 msgr2=0x7ff4f806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.515+0000 7ff4fe5c9640 1 -- 172.21.15.114:0/2095079799 shutdown_connections 2023-11-04T01:36:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.516+0000 7ff4fe5c9640 1 -- 172.21.15.114:0/2095079799 wait complete. 2023-11-04T01:36:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.517+0000 7ff4fe5c9640 1 Processor -- start 2023-11-04T01:36:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.517+0000 7ff4fe5c9640 1 -- start start 2023-11-04T01:36:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4fe5c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80cd860 0x7ff4f814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4fe5c9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4f815ae40 0x7ff4f80c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4fe5c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4f815bfb0 0x7ff4f80c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4fe5c9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f81f1730 con 0x7ff4f80cd860 2023-11-04T01:36:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4fe5c9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f81f06f0 con 0x7ff4f815ae40 2023-11-04T01:36:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4fe5c9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f81f0970 con 0x7ff4f815bfb0 2023-11-04T01:36:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4f7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80cd860 0x7ff4f814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4f7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80cd860 0x7ff4f814f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36096/0 (socket says 172.21.15.114:36096) 2023-11-04T01:36:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4f7fff640 1 -- 172.21.15.114:0/456407813 learned_addr learned my addr 172.21.15.114:0/456407813 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4f77fe640 1 --2- 172.21.15.114:0/456407813 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4f815ae40 0x7ff4f80c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4fcb66640 1 --2- 172.21.15.114:0/456407813 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4f815bfb0 0x7ff4f80c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4f7fff640 1 -- 172.21.15.114:0/456407813 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4f815bfb0 msgr2=0x7ff4f80c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4f7fff640 1 --2- 172.21.15.114:0/456407813 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4f815bfb0 0x7ff4f80c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4f7fff640 1 -- 172.21.15.114:0/456407813 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4f815ae40 msgr2=0x7ff4f80c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4f7fff640 1 --2- 172.21.15.114:0/456407813 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4f815ae40 0x7ff4f80c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4f7fff640 1 -- 172.21.15.114:0/456407813 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0009b30 con 0x7ff4f80cd860 2023-11-04T01:36:26.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4f77fe640 1 --2- 172.21.15.114:0/456407813 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4f815ae40 0x7ff4f80c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:26.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4f7fff640 1 --2- 172.21.15.114:0/456407813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80cd860 0x7ff4f814f3b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800c450 tx=0x7ff4e800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:26.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4f4ff9640 1 -- 172.21.15.114:0/456407813 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80052d0 con 0x7ff4f80cd860 2023-11-04T01:36:26.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4f4ff9640 1 -- 172.21.15.114:0/456407813 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e8005430 con 0x7ff4f80cd860 2023-11-04T01:36:26.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4f4ff9640 1 -- 172.21.15.114:0/456407813 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8003830 con 0x7ff4f80cd860 2023-11-04T01:36:26.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4fe5c9640 1 -- 172.21.15.114:0/456407813 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f81f0c50 con 0x7ff4f80cd860 2023-11-04T01:36:26.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.518+0000 7ff4fe5c9640 1 -- 172.21.15.114:0/456407813 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f81f1210 con 0x7ff4f80cd860 2023-11-04T01:36:26.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.519+0000 7ff4fe5c9640 1 -- 172.21.15.114:0/456407813 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f80ce2d0 con 0x7ff4f80cd860 2023-11-04T01:36:26.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.520+0000 7ff4f4ff9640 1 -- 172.21.15.114:0/456407813 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4e8003990 con 0x7ff4f80cd860 2023-11-04T01:36:26.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.520+0000 7ff4f4ff9640 1 --2- 172.21.15.114:0/456407813 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff4e406aea0 0x7ff4e406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.520+0000 7ff4f77fe640 1 --2- 172.21.15.114:0/456407813 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff4e406aea0 0x7ff4e406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.520+0000 7ff4f4ff9640 1 -- 172.21.15.114:0/456407813 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff4e8088660 con 0x7ff4f80cd860 2023-11-04T01:36:26.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.521+0000 7ff4f77fe640 1 --2- 172.21.15.114:0/456407813 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff4e406aea0 0x7ff4e406d360 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80c5680 tx=0x7ff4ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:26.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.524+0000 7ff4f4ff9640 1 -- 172.21.15.114:0/456407813 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4e8053af0 con 0x7ff4f80cd860 2023-11-04T01:36:26.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.724+0000 7ff4fe5c9640 1 -- 172.21.15.114:0/456407813 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4f80cc450 con 0x7ff4f80cd860 2023-11-04T01:36:26.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.725+0000 7ff4f4ff9640 1 -- 172.21.15.114:0/456407813 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3706 (secure 0 0 0) 0x7ff4f80cc450 con 0x7ff4f80cd860 2023-11-04T01:36:26.727 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:26.727 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1590879236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1590879236},{"type":"v1","addr":"172.21.15.141:6834","nonce":1590879236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3079825621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3079825621},{"type":"v1","addr":"172.21.15.114:6835","nonce":3079825621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1526155664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1526155664},{"type":"v1","addr":"172.21.15.114:6837","nonce":1526155664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4305,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/4231924170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4231924170},{"type":"v1","addr":"172.21.15.141:6835","nonce":4231924170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-04T01:36:26.727 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 3 2023-11-04T01:36:26.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.726+0000 7ff4fe5c9640 1 -- 172.21.15.114:0/456407813 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff4e406aea0 msgr2=0x7ff4e406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.726+0000 7ff4fe5c9640 1 --2- 172.21.15.114:0/456407813 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff4e406aea0 0x7ff4e406d360 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80c5680 tx=0x7ff4ec008040 comp rx=0 tx=0).stop 2023-11-04T01:36:26.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.726+0000 7ff4fe5c9640 1 -- 172.21.15.114:0/456407813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80cd860 msgr2=0x7ff4f814f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.726+0000 7ff4fe5c9640 1 --2- 172.21.15.114:0/456407813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80cd860 0x7ff4f814f3b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800c450 tx=0x7ff4e800c910 comp rx=0 tx=0).stop 2023-11-04T01:36:26.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.726+0000 7ff4fe5c9640 1 -- 172.21.15.114:0/456407813 shutdown_connections 2023-11-04T01:36:26.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.726+0000 7ff4fe5c9640 1 --2- 172.21.15.114:0/456407813 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4f815bfb0 0x7ff4f80c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.726+0000 7ff4fe5c9640 1 --2- 172.21.15.114:0/456407813 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff4e406aea0 0x7ff4e406d360 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.726+0000 7ff4fe5c9640 1 --2- 172.21.15.114:0/456407813 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4f815ae40 0x7ff4f80c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.726+0000 7ff4fe5c9640 1 --2- 172.21.15.114:0/456407813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80cd860 0x7ff4f814f3b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.726+0000 7ff4fe5c9640 1 -- 172.21.15.114:0/456407813 >> 172.21.15.114:0/456407813 conn(0x7ff4f806ea90 msgr2=0x7ff4f80b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:26.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.727+0000 7ff4fe5c9640 1 -- 172.21.15.114:0/456407813 shutdown_connections 2023-11-04T01:36:26.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.727+0000 7ff4fe5c9640 1 -- 172.21.15.114:0/456407813 wait complete. 2023-11-04T01:36:26.739 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:26.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.836+0000 7fda26ec9640 1 Processor -- start 2023-11-04T01:36:26.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.836+0000 7fda26ec9640 1 -- start start 2023-11-04T01:36:26.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.837+0000 7fda26ec9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fda2006a1b0 0x7fda2006b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.837+0000 7fda26ec9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda200c9a40 0x7fda200c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.837+0000 7fda26ec9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2006cf60 con 0x7fda2015ad80 2023-11-04T01:36:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.837+0000 7fda26ec9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda200ca430 con 0x7fda200c9a40 2023-11-04T01:36:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.837+0000 7fda26ec9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2015b160 con 0x7fda2006a1b0 2023-11-04T01:36:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.837+0000 7fda24c65640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fda2015ad80 0x7fda200abe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:57612/0 (socket says 172.21.15.114:57612) 2023-11-04T01:36:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.837+0000 7fda24c65640 1 -- 172.21.15.114:0/657999207 learned_addr learned my addr 172.21.15.114:0/657999207 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.837+0000 7fda25466640 1 --2- 172.21.15.114:0/657999207 >> v2:172.21.15.114:3300/0 conn(0x7fda200c9a40 0x7fda200c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.838+0000 7fda25466640 1 -- 172.21.15.114:0/657999207 >> v2:172.21.15.141:3300/0 conn(0x7fda2006a1b0 msgr2=0x7fda2006b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.838+0000 7fda25466640 1 --2- 172.21.15.114:0/657999207 >> v2:172.21.15.141:3300/0 conn(0x7fda2006a1b0 0x7fda2006b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.838+0000 7fda25466640 1 -- 172.21.15.114:0/657999207 >> v1:172.21.15.114:6789/0 conn(0x7fda2015ad80 legacy=0x7fda200abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.838+0000 7fda25466640 1 -- 172.21.15.114:0/657999207 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2006b9b0 con 0x7fda200c9a40 2023-11-04T01:36:26.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.838+0000 7fda25466640 1 --2- 172.21.15.114:0/657999207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda200c9a40 0x7fda200c9ef0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fda200b1b70 tx=0x7fda1802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d7fccc5ece118d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:26.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.838+0000 7fda1f7fe640 1 -- 172.21.15.114:0/657999207 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1802cc80 con 0x7fda200c9a40 2023-11-04T01:36:26.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.838+0000 7fda1f7fe640 1 -- 172.21.15.114:0/657999207 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1802cde0 con 0x7fda200c9a40 2023-11-04T01:36:26.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.838+0000 7fda1f7fe640 1 -- 172.21.15.114:0/657999207 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18034660 con 0x7fda200c9a40 2023-11-04T01:36:26.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.839+0000 7fda26ec9640 1 -- 172.21.15.114:0/657999207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda200c9a40 msgr2=0x7fda200c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.839+0000 7fda26ec9640 1 --2- 172.21.15.114:0/657999207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda200c9a40 0x7fda200c9ef0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fda200b1b70 tx=0x7fda1802bed0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.839+0000 7fda26ec9640 1 -- 172.21.15.114:0/657999207 shutdown_connections 2023-11-04T01:36:26.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.839+0000 7fda26ec9640 1 --2- 172.21.15.114:0/657999207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda200c9a40 0x7fda200c9ef0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.839+0000 7fda26ec9640 1 --2- 172.21.15.114:0/657999207 >> v2:172.21.15.141:3300/0 conn(0x7fda2006a1b0 0x7fda2006b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.839+0000 7fda26ec9640 1 -- 172.21.15.114:0/657999207 >> 172.21.15.114:0/657999207 conn(0x7fda200b0cd0 msgr2=0x7fda200b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:26.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.839+0000 7fda26ec9640 1 -- 172.21.15.114:0/657999207 shutdown_connections 2023-11-04T01:36:26.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.839+0000 7fda26ec9640 1 -- 172.21.15.114:0/657999207 wait complete. 2023-11-04T01:36:26.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.840+0000 7fda26ec9640 1 Processor -- start 2023-11-04T01:36:26.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.840+0000 7fda26ec9640 1 -- start start 2023-11-04T01:36:26.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda26ec9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2006a1b0 0x7fda2015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda26ec9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fda200c9a40 0x7fda201f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda26ec9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda2015ad80 0x7fda201f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda26ec9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda200c7d10 con 0x7fda2006a1b0 2023-11-04T01:36:26.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda26ec9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda200c5cb0 con 0x7fda200c9a40 2023-11-04T01:36:26.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda26ec9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda200c7f60 con 0x7fda2015ad80 2023-11-04T01:36:26.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda24c65640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2006a1b0 0x7fda2015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda24c65640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2006a1b0 0x7fda2015a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36104/0 (socket says 172.21.15.114:36104) 2023-11-04T01:36:26.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda24c65640 1 -- 172.21.15.114:0/543867726 learned_addr learned my addr 172.21.15.114:0/543867726 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda1ffff640 1 --2- 172.21.15.114:0/543867726 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fda200c9a40 0x7fda201f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda24c65640 1 -- 172.21.15.114:0/543867726 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda2015ad80 msgr2=0x7fda201f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda25466640 1 --2- 172.21.15.114:0/543867726 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda2015ad80 0x7fda201f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda24c65640 1 --2- 172.21.15.114:0/543867726 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda2015ad80 0x7fda201f40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda24c65640 1 -- 172.21.15.114:0/543867726 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fda200c9a40 msgr2=0x7fda201f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:26.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda24c65640 1 --2- 172.21.15.114:0/543867726 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fda200c9a40 0x7fda201f3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:26.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda24c65640 1 -- 172.21.15.114:0/543867726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda18009a70 con 0x7fda2006a1b0 2023-11-04T01:36:26.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda1ffff640 1 --2- 172.21.15.114:0/543867726 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fda200c9a40 0x7fda201f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:26.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.841+0000 7fda24c65640 1 --2- 172.21.15.114:0/543867726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2006a1b0 0x7fda2015a0f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fda1000c480 tx=0x7fda1000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:26.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.842+0000 7fda1d7fa640 1 -- 172.21.15.114:0/543867726 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10005ce0 con 0x7fda2006a1b0 2023-11-04T01:36:26.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.842+0000 7fda1d7fa640 1 -- 172.21.15.114:0/543867726 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda10005e40 con 0x7fda2006a1b0 2023-11-04T01:36:26.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.842+0000 7fda26ec9640 1 -- 172.21.15.114:0/543867726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda200c8240 con 0x7fda2006a1b0 2023-11-04T01:36:26.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.842+0000 7fda1d7fa640 1 -- 172.21.15.114:0/543867726 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda100072f0 con 0x7fda2006a1b0 2023-11-04T01:36:26.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.842+0000 7fda26ec9640 1 -- 172.21.15.114:0/543867726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda201f4880 con 0x7fda2006a1b0 2023-11-04T01:36:26.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.843+0000 7fda26ec9640 1 -- 172.21.15.114:0/543867726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda201f4a10 con 0x7fda2006a1b0 2023-11-04T01:36:26.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.843+0000 7fda1d7fa640 1 -- 172.21.15.114:0/543867726 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda10007450 con 0x7fda2006a1b0 2023-11-04T01:36:26.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.843+0000 7fda1d7fa640 1 --2- 172.21.15.114:0/543867726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fda0c06aea0 0x7fda0c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:26.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.844+0000 7fda1ffff640 1 --2- 172.21.15.114:0/543867726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fda0c06aea0 0x7fda0c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:26.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.844+0000 7fda1d7fa640 1 -- 172.21.15.114:0/543867726 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fda100886c0 con 0x7fda2006a1b0 2023-11-04T01:36:26.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.844+0000 7fda1ffff640 1 --2- 172.21.15.114:0/543867726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fda0c06aea0 0x7fda0c06d360 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fda14006fd0 tx=0x7fda14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:26.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:26.848+0000 7fda1d7fa640 1 -- 172.21.15.114:0/543867726 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fda10053c00 con 0x7fda2006a1b0 2023-11-04T01:36:27.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.014+0000 7fda26ec9640 1 -- 172.21.15.114:0/543867726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda20074290 con 0x7fda2006a1b0 2023-11-04T01:36:27.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.015+0000 7fda1d7fa640 1 -- 172.21.15.114:0/543867726 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12910 (secure 0 0 0) 0x7fda10017090 con 0x7fda2006a1b0 2023-11-04T01:36:27.017 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:27.017 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":16,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:20.031904+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:27.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.017+0000 7fda26ec9640 1 -- 172.21.15.114:0/543867726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fda0c06aea0 msgr2=0x7fda0c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.017+0000 7fda26ec9640 1 --2- 172.21.15.114:0/543867726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fda0c06aea0 0x7fda0c06d360 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fda14006fd0 tx=0x7fda14008040 comp rx=0 tx=0).stop 2023-11-04T01:36:27.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.017+0000 7fda26ec9640 1 -- 172.21.15.114:0/543867726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2006a1b0 msgr2=0x7fda2015a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.017+0000 7fda26ec9640 1 --2- 172.21.15.114:0/543867726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2006a1b0 0x7fda2015a0f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fda1000c480 tx=0x7fda1000c940 comp rx=0 tx=0).stop 2023-11-04T01:36:27.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.017+0000 7fda26ec9640 1 -- 172.21.15.114:0/543867726 shutdown_connections 2023-11-04T01:36:27.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.017+0000 7fda26ec9640 1 --2- 172.21.15.114:0/543867726 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fda2015ad80 0x7fda201f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.017+0000 7fda26ec9640 1 --2- 172.21.15.114:0/543867726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fda0c06aea0 0x7fda0c06d360 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.017+0000 7fda26ec9640 1 --2- 172.21.15.114:0/543867726 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fda200c9a40 0x7fda201f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.017+0000 7fda26ec9640 1 --2- 172.21.15.114:0/543867726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2006a1b0 0x7fda2015a0f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.017+0000 7fda26ec9640 1 -- 172.21.15.114:0/543867726 >> 172.21.15.114:0/543867726 conn(0x7fda200b0cd0 msgr2=0x7fda200ace50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:27.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.017+0000 7fda26ec9640 1 -- 172.21.15.114:0/543867726 shutdown_connections 2023-11-04T01:36:27.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.017+0000 7fda26ec9640 1 -- 172.21.15.114:0/543867726 wait complete. 2023-11-04T01:36:27.029 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:36:27.030 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:27.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.129+0000 7f3744333640 1 Processor -- start 2023-11-04T01:36:27.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.129+0000 7f3744333640 1 -- start start 2023-11-04T01:36:27.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.130+0000 7f3744333640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f373c153e60 0x7f373c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.130+0000 7f3744333640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f373c0cd6d0 0x7f373c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.130+0000 7f3744333640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373c0cde60 con 0x7f373c0b4880 2023-11-04T01:36:27.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.130+0000 7f3744333640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f373c160f90 con 0x7f373c0cd6d0 2023-11-04T01:36:27.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.130+0000 7f3744333640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f373c15e400 con 0x7f373c153e60 2023-11-04T01:36:27.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.130+0000 7f37418ce640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f373c0cd6d0 0x7f373c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.130+0000 7f37418ce640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f373c0cd6d0 0x7f373c161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36114/0 (socket says 172.21.15.114:36114) 2023-11-04T01:36:27.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.130+0000 7f37418ce640 1 -- 172.21.15.114:0/2035375191 learned_addr learned my addr 172.21.15.114:0/2035375191 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:27.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.130+0000 7f37420cf640 1 --2- 172.21.15.114:0/2035375191 >> v2:172.21.15.141:3300/0 conn(0x7f373c153e60 0x7f373c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.131+0000 7f37418ce640 1 -- 172.21.15.114:0/2035375191 >> v2:172.21.15.141:3300/0 conn(0x7f373c153e60 msgr2=0x7f373c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:27.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.131+0000 7f37418ce640 1 --2- 172.21.15.114:0/2035375191 >> v2:172.21.15.141:3300/0 conn(0x7f373c153e60 0x7f373c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.131+0000 7f37418ce640 1 -- 172.21.15.114:0/2035375191 >> v1:172.21.15.141:6789/0 conn(0x7f373c0b4880 legacy=0x7f373c06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.131+0000 7f37418ce640 1 -- 172.21.15.114:0/2035375191 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c161960 con 0x7f373c0cd6d0 2023-11-04T01:36:27.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.131+0000 7f37420cf640 1 --2- 172.21.15.114:0/2035375191 >> v2:172.21.15.141:3300/0 conn(0x7f373c153e60 0x7f373c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:27.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.131+0000 7f37418ce640 1 --2- 172.21.15.114:0/2035375191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f373c0cd6d0 0x7f373c161420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f373c08abe0 tx=0x7f372c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc4eed70d28e389 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.131+0000 7f37410cd640 1 -- 172.21.15.114:0/2035375191 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c030860 con 0x7f373c0cd6d0 2023-11-04T01:36:27.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.131+0000 7f37410cd640 1 -- 172.21.15.114:0/2035375191 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c0309c0 con 0x7f373c0cd6d0 2023-11-04T01:36:27.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.131+0000 7f37410cd640 1 -- 172.21.15.114:0/2035375191 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c030d50 con 0x7f373c0cd6d0 2023-11-04T01:36:27.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.132+0000 7f3744333640 1 -- 172.21.15.114:0/2035375191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f373c0cd6d0 msgr2=0x7f373c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.132+0000 7f3744333640 1 --2- 172.21.15.114:0/2035375191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f373c0cd6d0 0x7f373c161420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f373c08abe0 tx=0x7f372c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.132+0000 7f3744333640 1 -- 172.21.15.114:0/2035375191 shutdown_connections 2023-11-04T01:36:27.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.132+0000 7f3744333640 1 --2- 172.21.15.114:0/2035375191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f373c0cd6d0 0x7f373c161420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.132+0000 7f3744333640 1 --2- 172.21.15.114:0/2035375191 >> v2:172.21.15.141:3300/0 conn(0x7f373c153e60 0x7f373c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.132+0000 7f3744333640 1 -- 172.21.15.114:0/2035375191 >> 172.21.15.114:0/2035375191 conn(0x7f373c0cf880 msgr2=0x7f373c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:27.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.132+0000 7f3744333640 1 -- 172.21.15.114:0/2035375191 shutdown_connections 2023-11-04T01:36:27.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.132+0000 7f3744333640 1 -- 172.21.15.114:0/2035375191 wait complete. 2023-11-04T01:36:27.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.133+0000 7f3744333640 1 Processor -- start 2023-11-04T01:36:27.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.133+0000 7f3744333640 1 -- start start 2023-11-04T01:36:27.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f3744333640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f373c0b4880 0x7f373c0c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f3744333640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f373c0cd6d0 0x7f373c0c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f3744333640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f373c153e60 0x7f373c0cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f3744333640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c0c5ff0 con 0x7f373c0cd6d0 2023-11-04T01:36:27.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f3744333640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c0cc110 con 0x7f373c153e60 2023-11-04T01:36:27.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f3744333640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c0ccc50 con 0x7f373c0b4880 2023-11-04T01:36:27.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f37418ce640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f373c0cd6d0 0x7f373c0c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f37418ce640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f373c0cd6d0 0x7f373c0c5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36118/0 (socket says 172.21.15.114:36118) 2023-11-04T01:36:27.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f37418ce640 1 -- 172.21.15.114:0/3541742704 learned_addr learned my addr 172.21.15.114:0/3541742704 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:27.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f37420cf640 1 --2- 172.21.15.114:0/3541742704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f373c0b4880 0x7f373c0c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f37428d0640 1 --2- 172.21.15.114:0/3541742704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f373c153e60 0x7f373c0cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f37418ce640 1 -- 172.21.15.114:0/3541742704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f373c0b4880 msgr2=0x7f373c0c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f37418ce640 1 --2- 172.21.15.114:0/3541742704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f373c0b4880 0x7f373c0c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f37418ce640 1 -- 172.21.15.114:0/3541742704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f373c153e60 msgr2=0x7f373c0cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f37418ce640 1 --2- 172.21.15.114:0/3541742704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f373c153e60 0x7f373c0cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f37418ce640 1 -- 172.21.15.114:0/3541742704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c0094d0 con 0x7f373c0cd6d0 2023-11-04T01:36:27.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f37418ce640 1 --2- 172.21.15.114:0/3541742704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f373c0cd6d0 0x7f373c0c5ab0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f372c02b9e0 tx=0x7f372c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.134+0000 7f3732ffd640 1 -- 172.21.15.114:0/3541742704 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c039d60 con 0x7f373c0cd6d0 2023-11-04T01:36:27.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.135+0000 7f3732ffd640 1 -- 172.21.15.114:0/3541742704 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c043400 con 0x7f373c0cd6d0 2023-11-04T01:36:27.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.135+0000 7f3744333640 1 -- 172.21.15.114:0/3541742704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373c0cc3b0 con 0x7f373c0cd6d0 2023-11-04T01:36:27.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.135+0000 7f3732ffd640 1 -- 172.21.15.114:0/3541742704 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c0437b0 con 0x7f373c0cd6d0 2023-11-04T01:36:27.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.135+0000 7f3744333640 1 -- 172.21.15.114:0/3541742704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373c0cc970 con 0x7f373c0cd6d0 2023-11-04T01:36:27.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.136+0000 7f3744333640 1 -- 172.21.15.114:0/3541742704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373c066920 con 0x7f373c0cd6d0 2023-11-04T01:36:27.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.136+0000 7f3732ffd640 1 -- 172.21.15.114:0/3541742704 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f372c043910 con 0x7f373c0cd6d0 2023-11-04T01:36:27.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.136+0000 7f3732ffd640 1 --2- 172.21.15.114:0/3541742704 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f372006aea0 0x7f372006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.137+0000 7f3732ffd640 1 -- 172.21.15.114:0/3541742704 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f372c03e070 con 0x7f373c0cd6d0 2023-11-04T01:36:27.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.137+0000 7f37420cf640 1 --2- 172.21.15.114:0/3541742704 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f372006aea0 0x7f372006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.137+0000 7f37420cf640 1 --2- 172.21.15.114:0/3541742704 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f372006aea0 0x7f372006d360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3738006fd0 tx=0x7f3738008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.141+0000 7f3732ffd640 1 -- 172.21.15.114:0/3541742704 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f372c077830 con 0x7f373c0cd6d0 2023-11-04T01:36:27.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.305+0000 7f3744333640 1 -- 172.21.15.114:0/3541742704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f373c074290 con 0x7f373c0cd6d0 2023-11-04T01:36:27.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.305+0000 7f3732ffd640 1 -- 172.21.15.114:0/3541742704 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f372c034020 con 0x7f373c0cd6d0 2023-11-04T01:36:27.307 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:36:27.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.307+0000 7f3744333640 1 -- 172.21.15.114:0/3541742704 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f372006aea0 msgr2=0x7f372006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.307+0000 7f3744333640 1 --2- 172.21.15.114:0/3541742704 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f372006aea0 0x7f372006d360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3738006fd0 tx=0x7f3738008040 comp rx=0 tx=0).stop 2023-11-04T01:36:27.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.307+0000 7f3744333640 1 -- 172.21.15.114:0/3541742704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f373c0cd6d0 msgr2=0x7f373c0c5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.307+0000 7f3744333640 1 --2- 172.21.15.114:0/3541742704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f373c0cd6d0 0x7f373c0c5ab0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f372c02b9e0 tx=0x7f372c004730 comp rx=0 tx=0).stop 2023-11-04T01:36:27.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.307+0000 7f3744333640 1 -- 172.21.15.114:0/3541742704 shutdown_connections 2023-11-04T01:36:27.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.307+0000 7f3744333640 1 --2- 172.21.15.114:0/3541742704 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f372006aea0 0x7f372006d360 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.307+0000 7f3744333640 1 --2- 172.21.15.114:0/3541742704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f373c153e60 0x7f373c0cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.307+0000 7f3744333640 1 --2- 172.21.15.114:0/3541742704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f373c0cd6d0 0x7f373c0c5ab0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.307+0000 7f3744333640 1 --2- 172.21.15.114:0/3541742704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f373c0b4880 0x7f373c0c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.307+0000 7f3744333640 1 -- 172.21.15.114:0/3541742704 >> 172.21.15.114:0/3541742704 conn(0x7f373c0cf880 msgr2=0x7f373c0b4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:27.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.307+0000 7f3744333640 1 -- 172.21.15.114:0/3541742704 shutdown_connections 2023-11-04T01:36:27.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.307+0000 7f3744333640 1 -- 172.21.15.114:0/3541742704 wait complete. 2023-11-04T01:36:27.321 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:36:27.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.419+0000 7fd436ec2640 1 Processor -- start 2023-11-04T01:36:27.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.419+0000 7fd436ec2640 1 -- start start 2023-11-04T01:36:27.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd436ec2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4300cbea0 0x7fd43006eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd436ec2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4300cc2f0 con 0x7fd43015ab70 2023-11-04T01:36:27.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd436ec2640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43006d310 con 0x7fd43006a830 2023-11-04T01:36:27.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd436ec2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300cba70 con 0x7fd4300cbea0 2023-11-04T01:36:27.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd434c5e640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd43015ab70 0x7fd43006a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:57622/0 (socket says 172.21.15.114:57622) 2023-11-04T01:36:27.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd434c5e640 1 -- 172.21.15.114:0/3802859773 learned_addr learned my addr 172.21.15.114:0/3802859773 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:27.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd43545f640 1 --2- 172.21.15.114:0/3802859773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4300cbea0 0x7fd43006eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 -- 172.21.15.114:0/3802859773 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055824155 0 0) 0x7fd4300cc2f0 con 0x7fd43015ab70 2023-11-04T01:36:27.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 -- 172.21.15.114:0/3802859773 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd420003520 con 0x7fd43015ab70 2023-11-04T01:36:27.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 -- 172.21.15.114:0/3802859773 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446216635 0 0) 0x7fd43006d310 con 0x7fd43006a830 2023-11-04T01:36:27.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 -- 172.21.15.114:0/3802859773 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4300cc2f0 con 0x7fd43006a830 2023-11-04T01:36:27.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 -- 172.21.15.114:0/3802859773 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2625129729 0 0) 0x7fd420003520 con 0x7fd43015ab70 2023-11-04T01:36:27.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 -- 172.21.15.114:0/3802859773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4300cbea0 msgr2=0x7fd43006eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:27.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 --2- 172.21.15.114:0/3802859773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4300cbea0 0x7fd43006eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 -- 172.21.15.114:0/3802859773 >> v1:172.21.15.141:6789/0 conn(0x7fd43006a830 legacy=0x7fd4300ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 -- 172.21.15.114:0/3802859773 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43015d860 con 0x7fd43015ab70 2023-11-04T01:36:27.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 -- 172.21.15.114:0/3802859773 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fd4240017f0 con 0x7fd43015ab70 2023-11-04T01:36:27.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 -- 172.21.15.114:0/3802859773 >> v1:172.21.15.114:6789/0 conn(0x7fd43015ab70 legacy=0x7fd43006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 --2- 172.21.15.114:0/3802859773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd420003b30 0x7fd420003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 --2- 172.21.15.114:0/3802859773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4200047c0 0x7fd420004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 --2- 172.21.15.114:0/3802859773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4300cbea0 0x7fd4200051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 -- 172.21.15.114:0/3802859773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300cba70 con 0x7fd4200047c0 2023-11-04T01:36:27.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 -- 172.21.15.114:0/3802859773 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42000ba90 con 0x7fd420003b30 2023-11-04T01:36:27.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42f7fe640 1 -- 172.21.15.114:0/3802859773 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42000bc50 con 0x7fd4300cbea0 2023-11-04T01:36:27.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd42ffff640 1 --2- 172.21.15.114:0/3802859773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4200047c0 0x7fd420004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd434c5e640 1 --2- 172.21.15.114:0/3802859773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd420003b30 0x7fd420003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.420+0000 7fd43545f640 1 --2- 172.21.15.114:0/3802859773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4300cbea0 0x7fd4200051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.421+0000 7fd42ffff640 1 -- 172.21.15.114:0/3802859773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4300cbea0 msgr2=0x7fd4200051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:27.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.421+0000 7fd42ffff640 1 --2- 172.21.15.114:0/3802859773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4300cbea0 0x7fd4200051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.421+0000 7fd42ffff640 1 -- 172.21.15.114:0/3802859773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd420003b30 msgr2=0x7fd420003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:27.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.421+0000 7fd42ffff640 1 --2- 172.21.15.114:0/3802859773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd420003b30 0x7fd420003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.421+0000 7fd42ffff640 1 -- 172.21.15.114:0/3802859773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd420003520 con 0x7fd4200047c0 2023-11-04T01:36:27.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.421+0000 7fd42ffff640 1 --2- 172.21.15.114:0/3802859773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4200047c0 0x7fd420004c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd4300716b0 tx=0x7fd4200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95bcdf976f058d6e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.421+0000 7fd42f7fe640 1 -- 172.21.15.114:0/3802859773 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c0052d0 con 0x7fd4200047c0 2023-11-04T01:36:27.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.422+0000 7fd42f7fe640 1 -- 172.21.15.114:0/3802859773 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c005430 con 0x7fd4200047c0 2023-11-04T01:36:27.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.422+0000 7fd42f7fe640 1 -- 172.21.15.114:0/3802859773 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c003860 con 0x7fd4200047c0 2023-11-04T01:36:27.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.422+0000 7fd436ec2640 1 -- 172.21.15.114:0/3802859773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4200047c0 msgr2=0x7fd420004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.422+0000 7fd436ec2640 1 --2- 172.21.15.114:0/3802859773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4200047c0 0x7fd420004c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd4300716b0 tx=0x7fd4200057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.422+0000 7fd43545f640 1 -- 172.21.15.114:0/3802859773 reap_dead start 2023-11-04T01:36:27.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.422+0000 7fd436ec2640 1 -- 172.21.15.114:0/3802859773 shutdown_connections 2023-11-04T01:36:27.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.422+0000 7fd436ec2640 1 -- 172.21.15.114:0/3802859773 >> 172.21.15.114:0/3802859773 conn(0x7fd430098d40 msgr2=0x7fd4300cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:27.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.422+0000 7fd436ec2640 1 -- 172.21.15.114:0/3802859773 shutdown_connections 2023-11-04T01:36:27.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.422+0000 7fd436ec2640 1 -- 172.21.15.114:0/3802859773 wait complete. 2023-11-04T01:36:27.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.423+0000 7fd436ec2640 1 Processor -- start 2023-11-04T01:36:27.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.423+0000 7fd436ec2640 1 -- start start 2023-11-04T01:36:27.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.424+0000 7fd436ec2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4200047c0 0x7fd43014bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.424+0000 7fd436ec2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd430159a70 0x7fd4300b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.424+0000 7fd436ec2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4300c56b0 0x7fd4300c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.424+0000 7fd436ec2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd430161c50 con 0x7fd4300c56b0 2023-11-04T01:36:27.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.424+0000 7fd436ec2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd430099b70 con 0x7fd430159a70 2023-11-04T01:36:27.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.424+0000 7fd436ec2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300c60a0 con 0x7fd4200047c0 2023-11-04T01:36:27.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.424+0000 7fd43545f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4300c56b0 0x7fd4300c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.424+0000 7fd43545f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4300c56b0 0x7fd4300c5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36126/0 (socket says 172.21.15.114:36126) 2023-11-04T01:36:27.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.424+0000 7fd43545f640 1 -- 172.21.15.114:0/3808304454 learned_addr learned my addr 172.21.15.114:0/3808304454 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:27.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.424+0000 7fd43545f640 1 -- 172.21.15.114:0/3808304454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4200047c0 msgr2=0x7fd43014bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.424+0000 7fd43545f640 1 --2- 172.21.15.114:0/3808304454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4200047c0 0x7fd43014bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.424+0000 7fd43545f640 1 -- 172.21.15.114:0/3808304454 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd430159a70 msgr2=0x7fd4300b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.424+0000 7fd43545f640 1 --2- 172.21.15.114:0/3808304454 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd430159a70 0x7fd4300b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.424+0000 7fd43545f640 1 -- 172.21.15.114:0/3808304454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4300997b0 con 0x7fd4300c56b0 2023-11-04T01:36:27.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.425+0000 7fd43545f640 1 --2- 172.21.15.114:0/3808304454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4300c56b0 0x7fd4300c5b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd430067560 tx=0x7fd42800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.425+0000 7fd42d7fa640 1 -- 172.21.15.114:0/3808304454 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42800e040 con 0x7fd4300c56b0 2023-11-04T01:36:27.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.425+0000 7fd42d7fa640 1 -- 172.21.15.114:0/3808304454 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42800f040 con 0x7fd4300c56b0 2023-11-04T01:36:27.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.425+0000 7fd436ec2640 1 -- 172.21.15.114:0/3808304454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4300b4b30 con 0x7fd4300c56b0 2023-11-04T01:36:27.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.425+0000 7fd42d7fa640 1 -- 172.21.15.114:0/3808304454 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428015670 con 0x7fd4300c56b0 2023-11-04T01:36:27.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.425+0000 7fd436ec2640 1 -- 172.21.15.114:0/3808304454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4300b50f0 con 0x7fd4300c56b0 2023-11-04T01:36:27.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.426+0000 7fd436ec2640 1 -- 172.21.15.114:0/3808304454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd430099cb0 con 0x7fd4300c56b0 2023-11-04T01:36:27.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.426+0000 7fd42d7fa640 1 -- 172.21.15.114:0/3808304454 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4280157d0 con 0x7fd4300c56b0 2023-11-04T01:36:27.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.426+0000 7fd42d7fa640 1 --2- 172.21.15.114:0/3808304454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd41406ae70 0x7fd41406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.426+0000 7fd42d7fa640 1 -- 172.21.15.114:0/3808304454 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd428089c30 con 0x7fd4300c56b0 2023-11-04T01:36:27.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.426+0000 7fd434c5e640 1 --2- 172.21.15.114:0/3808304454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd41406ae70 0x7fd41406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.427+0000 7fd434c5e640 1 --2- 172.21.15.114:0/3808304454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd41406ae70 0x7fd41406d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd424000ef0 tx=0x7fd424009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.431+0000 7fd42d7fa640 1 -- 172.21.15.114:0/3808304454 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd430099cb0 con 0x7fd4300c56b0 2023-11-04T01:36:27.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.600+0000 7fd436ec2640 1 -- 172.21.15.114:0/3808304454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd430099cb0 con 0x7fd4300c56b0 2023-11-04T01:36:27.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.600+0000 7fd42d7fa640 1 -- 172.21.15.114:0/3808304454 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd430099cb0 con 0x7fd4300c56b0 2023-11-04T01:36:27.602 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:27.602 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2023-11-04T01:36:27.602 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:36:27.603 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2023-11-04T01:36:27.603 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2023-11-04T01:36:27.603 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:36:27.603 INFO:teuthology.orchestra.run.smithi114.stdout:] 2023-11-04T01:36:27.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.602+0000 7fd436ec2640 1 -- 172.21.15.114:0/3808304454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd41406ae70 msgr2=0x7fd41406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.602+0000 7fd436ec2640 1 --2- 172.21.15.114:0/3808304454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd41406ae70 0x7fd41406d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd424000ef0 tx=0x7fd424009040 comp rx=0 tx=0).stop 2023-11-04T01:36:27.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.602+0000 7fd436ec2640 1 -- 172.21.15.114:0/3808304454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4300c56b0 msgr2=0x7fd4300c5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.602+0000 7fd436ec2640 1 --2- 172.21.15.114:0/3808304454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4300c56b0 0x7fd4300c5b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd430067560 tx=0x7fd42800f580 comp rx=0 tx=0).stop 2023-11-04T01:36:27.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.602+0000 7fd436ec2640 1 -- 172.21.15.114:0/3808304454 shutdown_connections 2023-11-04T01:36:27.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.602+0000 7fd436ec2640 1 --2- 172.21.15.114:0/3808304454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4300c56b0 0x7fd4300c5b60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.602+0000 7fd436ec2640 1 --2- 172.21.15.114:0/3808304454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd41406ae70 0x7fd41406d330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.602+0000 7fd436ec2640 1 --2- 172.21.15.114:0/3808304454 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd430159a70 0x7fd4300b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.602+0000 7fd436ec2640 1 --2- 172.21.15.114:0/3808304454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4200047c0 0x7fd43014bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.602+0000 7fd436ec2640 1 -- 172.21.15.114:0/3808304454 >> 172.21.15.114:0/3808304454 conn(0x7fd430098d40 msgr2=0x7fd43006a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:27.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.602+0000 7fd436ec2640 1 -- 172.21.15.114:0/3808304454 shutdown_connections 2023-11-04T01:36:27.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.602+0000 7fd436ec2640 1 -- 172.21.15.114:0/3808304454 wait complete. 2023-11-04T01:36:27.614 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:36:27.615 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:36:27.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.715+0000 7f98d68d4640 1 Processor -- start 2023-11-04T01:36:27.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.715+0000 7f98d68d4640 1 -- start start 2023-11-04T01:36:27.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.716+0000 7f98d68d4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f98d0160530 0x7f98d00b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.716+0000 7f98d68d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98d006a830 0x7f98d0160b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.716+0000 7f98d68d4640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d006f380 con 0x7f98d00ca420 2023-11-04T01:36:27.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.716+0000 7f98d68d4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d0160910 con 0x7f98d0160530 2023-11-04T01:36:27.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.716+0000 7f98d68d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d00b1a00 con 0x7f98d006a830 2023-11-04T01:36:27.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.716+0000 7f98cffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f98d0160530 0x7f98d00b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.716+0000 7f98cffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f98d0160530 0x7f98d00b14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36132/0 (socket says 172.21.15.114:36132) 2023-11-04T01:36:27.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.716+0000 7f98cffff640 1 -- 172.21.15.114:0/4264932331 learned_addr learned my addr 172.21.15.114:0/4264932331 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:27.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.717+0000 7f98d4e71640 1 --2- 172.21.15.114:0/4264932331 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98d006a830 0x7f98d0160b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.717+0000 7f98cffff640 1 -- 172.21.15.114:0/4264932331 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98d006a830 msgr2=0x7f98d0160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:27.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.717+0000 7f98cffff640 1 --2- 172.21.15.114:0/4264932331 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98d006a830 0x7f98d0160b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.717+0000 7f98cffff640 1 -- 172.21.15.114:0/4264932331 >> v1:172.21.15.141:6789/0 conn(0x7f98d00ca420 legacy=0x7f98d006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:27.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.717+0000 7f98cffff640 1 -- 172.21.15.114:0/4264932331 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d00cd9b0 con 0x7f98d0160530 2023-11-04T01:36:27.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.717+0000 7f98d4e71640 1 --2- 172.21.15.114:0/4264932331 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98d006a830 0x7f98d0160b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:27.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.717+0000 7f98cffff640 1 --2- 172.21.15.114:0/4264932331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98d0160530 0x7f98d00b14c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f98c0009870 tx=0x7f98c002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2f65e8b0dc1d21 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.718+0000 7f98ceffd640 1 -- 172.21.15.114:0/4264932331 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c00317c0 con 0x7f98d0160530 2023-11-04T01:36:27.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.718+0000 7f98ceffd640 1 -- 172.21.15.114:0/4264932331 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c0031920 con 0x7f98d0160530 2023-11-04T01:36:27.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.718+0000 7f98ceffd640 1 -- 172.21.15.114:0/4264932331 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c0031cb0 con 0x7f98d0160530 2023-11-04T01:36:27.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.718+0000 7f98d68d4640 1 -- 172.21.15.114:0/4264932331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98d0160530 msgr2=0x7f98d00b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.718+0000 7f98d68d4640 1 --2- 172.21.15.114:0/4264932331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98d0160530 0x7f98d00b14c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f98c0009870 tx=0x7f98c002b860 comp rx=0 tx=0).stop 2023-11-04T01:36:27.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.718+0000 7f98d68d4640 1 -- 172.21.15.114:0/4264932331 shutdown_connections 2023-11-04T01:36:27.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.718+0000 7f98d68d4640 1 --2- 172.21.15.114:0/4264932331 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98d006a830 0x7f98d0160b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.718+0000 7f98d68d4640 1 --2- 172.21.15.114:0/4264932331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98d0160530 0x7f98d00b14c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.718+0000 7f98d68d4640 1 -- 172.21.15.114:0/4264932331 >> 172.21.15.114:0/4264932331 conn(0x7f98d006d890 msgr2=0x7f98d006dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:27.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.718+0000 7f98d68d4640 1 -- 172.21.15.114:0/4264932331 shutdown_connections 2023-11-04T01:36:27.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.718+0000 7f98d68d4640 1 -- 172.21.15.114:0/4264932331 wait complete. 2023-11-04T01:36:27.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.719+0000 7f98d68d4640 1 Processor -- start 2023-11-04T01:36:27.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.720+0000 7f98d68d4640 1 -- start start 2023-11-04T01:36:27.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.720+0000 7f98d68d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98d006a830 0x7f98d0151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.720+0000 7f98d68d4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98d00ca420 0x7f98d00b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.720+0000 7f98d68d4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98d0160530 0x7f98d00ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.720+0000 7f98d68d4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d0151ca0 con 0x7f98d00ca420 2023-11-04T01:36:27.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.720+0000 7f98d68d4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d01550c0 con 0x7f98d0160530 2023-11-04T01:36:27.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.720+0000 7f98d68d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d0152130 con 0x7f98d006a830 2023-11-04T01:36:27.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.720+0000 7f98cf7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98d00ca420 0x7f98d00b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.720+0000 7f98cf7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98d00ca420 0x7f98d00b2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36146/0 (socket says 172.21.15.114:36146) 2023-11-04T01:36:27.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.720+0000 7f98cf7fe640 1 -- 172.21.15.114:0/2277248615 learned_addr learned my addr 172.21.15.114:0/2277248615 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:27.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.721+0000 7f98cffff640 1 --2- 172.21.15.114:0/2277248615 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98d006a830 0x7f98d0151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.721+0000 7f98d4e71640 1 --2- 172.21.15.114:0/2277248615 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98d0160530 0x7f98d00ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.721+0000 7f98cf7fe640 1 -- 172.21.15.114:0/2277248615 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98d006a830 msgr2=0x7f98d0151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.721+0000 7f98cf7fe640 1 --2- 172.21.15.114:0/2277248615 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98d006a830 0x7f98d0151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.721+0000 7f98cf7fe640 1 -- 172.21.15.114:0/2277248615 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98d0160530 msgr2=0x7f98d00ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:27.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.721+0000 7f98cf7fe640 1 --2- 172.21.15.114:0/2277248615 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98d0160530 0x7f98d00ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:27.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.721+0000 7f98cf7fe640 1 -- 172.21.15.114:0/2277248615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c00094d0 con 0x7f98d00ca420 2023-11-04T01:36:27.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.721+0000 7f98d4e71640 1 --2- 172.21.15.114:0/2277248615 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98d0160530 0x7f98d00ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:27.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.721+0000 7f98cf7fe640 1 --2- 172.21.15.114:0/2277248615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98d00ca420 0x7f98d00b2660 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f98c400b3c0 tx=0x7f98c400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.721+0000 7f98ccff9640 1 -- 172.21.15.114:0/2277248615 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c4011830 con 0x7f98d00ca420 2023-11-04T01:36:27.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.721+0000 7f98ccff9640 1 -- 172.21.15.114:0/2277248615 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c4011990 con 0x7f98d00ca420 2023-11-04T01:36:27.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.721+0000 7f98d68d4640 1 -- 172.21.15.114:0/2277248615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d01544b0 con 0x7f98d00ca420 2023-11-04T01:36:27.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.721+0000 7f98ccff9640 1 -- 172.21.15.114:0/2277248615 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c4011d80 con 0x7f98d00ca420 2023-11-04T01:36:27.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.721+0000 7f98d68d4640 1 -- 172.21.15.114:0/2277248615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d0154a70 con 0x7f98d00ca420 2023-11-04T01:36:27.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.722+0000 7f98d68d4640 1 -- 172.21.15.114:0/2277248615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d00cf320 con 0x7f98d00ca420 2023-11-04T01:36:27.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.722+0000 7f98ccff9640 1 -- 172.21.15.114:0/2277248615 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f98c401b460 con 0x7f98d00ca420 2023-11-04T01:36:27.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.723+0000 7f98ccff9640 1 --2- 172.21.15.114:0/2277248615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f98bc06aea0 0x7f98bc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:27.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.723+0000 7f98cffff640 1 --2- 172.21.15.114:0/2277248615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f98bc06aea0 0x7f98bc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:27.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.723+0000 7f98ccff9640 1 -- 172.21.15.114:0/2277248615 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f98c4088e70 con 0x7f98d00ca420 2023-11-04T01:36:27.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.723+0000 7f98cffff640 1 --2- 172.21.15.114:0/2277248615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f98bc06aea0 0x7f98bc06d360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f98c0036000 tx=0x7f98c003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:27.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.727+0000 7f98ccff9640 1 -- 172.21.15.114:0/2277248615 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f98c4054270 con 0x7f98d00ca420 2023-11-04T01:36:27.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:27.893+0000 7f98d68d4640 1 -- 172.21.15.114:0/2277248615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f98d0155230 con 0x7f98d00ca420 2023-11-04T01:36:28.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.541+0000 7f98ccff9640 1 -- 172.21.15.114:0/2277248615 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f98c4057890 con 0x7f98d00ca420 2023-11-04T01:36:28.543 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2023-11-04T01:36:28.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.543+0000 7f98d68d4640 1 -- 172.21.15.114:0/2277248615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f98bc06aea0 msgr2=0x7f98bc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:28.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.543+0000 7f98d68d4640 1 --2- 172.21.15.114:0/2277248615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f98bc06aea0 0x7f98bc06d360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f98c0036000 tx=0x7f98c003d040 comp rx=0 tx=0).stop 2023-11-04T01:36:28.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.543+0000 7f98d68d4640 1 -- 172.21.15.114:0/2277248615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98d00ca420 msgr2=0x7f98d00b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:28.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.543+0000 7f98d68d4640 1 --2- 172.21.15.114:0/2277248615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98d00ca420 0x7f98d00b2660 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f98c400b3c0 tx=0x7f98c400b880 comp rx=0 tx=0).stop 2023-11-04T01:36:28.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.543+0000 7f98d68d4640 1 -- 172.21.15.114:0/2277248615 shutdown_connections 2023-11-04T01:36:28.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.543+0000 7f98d68d4640 1 --2- 172.21.15.114:0/2277248615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f98bc06aea0 0x7f98bc06d360 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.543+0000 7f98d68d4640 1 --2- 172.21.15.114:0/2277248615 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98d0160530 0x7f98d00ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.543+0000 7f98d68d4640 1 --2- 172.21.15.114:0/2277248615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98d00ca420 0x7f98d00b2660 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.543+0000 7f98d68d4640 1 --2- 172.21.15.114:0/2277248615 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98d006a830 0x7f98d0151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.543+0000 7f98d68d4640 1 -- 172.21.15.114:0/2277248615 >> 172.21.15.114:0/2277248615 conn(0x7f98d006d890 msgr2=0x7f98d00af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:28.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.543+0000 7f98d68d4640 1 -- 172.21.15.114:0/2277248615 shutdown_connections 2023-11-04T01:36:28.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.543+0000 7f98d68d4640 1 -- 172.21.15.114:0/2277248615 wait complete. 2023-11-04T01:36:28.563 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-04T01:36:28.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.672+0000 7f661796c640 1 Processor -- start 2023-11-04T01:36:28.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.672+0000 7f661796c640 1 -- start start 2023-11-04T01:36:28.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.673+0000 7f661796c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f66100cd6d0 0x7f6610161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:28.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.673+0000 7f661796c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66100b4880 0x7f66100b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:28.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.673+0000 7f661796c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66100cde60 con 0x7f6610153e60 2023-11-04T01:36:28.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.673+0000 7f661796c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6610160f90 con 0x7f66100cd6d0 2023-11-04T01:36:28.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.673+0000 7f661796c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6610161960 con 0x7f66100b4880 2023-11-04T01:36:28.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.673+0000 7f6614f07640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f66100cd6d0 0x7f6610161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:28.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.673+0000 7f6615f09640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66100b4880 0x7f66100b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:28.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.673+0000 7f6614f07640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f66100cd6d0 0x7f6610161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:34428/0 (socket says 172.21.15.114:34428) 2023-11-04T01:36:28.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.673+0000 7f6615708640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f6610153e60 0x7f661015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:46348/0 (socket says 172.21.15.114:46348) 2023-11-04T01:36:28.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.673+0000 7f6614f07640 1 -- 172.21.15.114:0/3966295987 learned_addr learned my addr 172.21.15.114:0/3966295987 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:28.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.673+0000 7f6615f09640 1 -- 172.21.15.114:0/3966295987 >> v2:172.21.15.141:3300/0 conn(0x7f66100cd6d0 msgr2=0x7f6610161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:28.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.673+0000 7f6615f09640 1 --2- 172.21.15.114:0/3966295987 >> v2:172.21.15.141:3300/0 conn(0x7f66100cd6d0 0x7f6610161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.673+0000 7f6615f09640 1 -- 172.21.15.114:0/3966295987 >> v1:172.21.15.141:6789/0 conn(0x7f6610153e60 legacy=0x7f661015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:28.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.673+0000 7f6615f09640 1 -- 172.21.15.114:0/3966295987 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66100b5220 con 0x7f66100b4880 2023-11-04T01:36:28.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.673+0000 7f6614f07640 1 --2- 172.21.15.114:0/3966295987 >> v2:172.21.15.141:3300/0 conn(0x7f66100cd6d0 0x7f6610161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:28.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.674+0000 7f6615f09640 1 --2- 172.21.15.114:0/3966295987 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66100b4880 0x7f66100b4ce0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6608009d90 tx=0x7f660802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bf94496642797d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:28.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.674+0000 7f6607fff640 1 -- 172.21.15.114:0/3966295987 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660802cc50 con 0x7f66100b4880 2023-11-04T01:36:28.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.674+0000 7f6607fff640 1 -- 172.21.15.114:0/3966295987 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660802cdb0 con 0x7f66100b4880 2023-11-04T01:36:28.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.674+0000 7f6607fff640 1 -- 172.21.15.114:0/3966295987 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608034660 con 0x7f66100b4880 2023-11-04T01:36:28.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.675+0000 7f661796c640 1 -- 172.21.15.114:0/3966295987 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66100b4880 msgr2=0x7f66100b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:28.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.675+0000 7f661796c640 1 --2- 172.21.15.114:0/3966295987 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66100b4880 0x7f66100b4ce0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6608009d90 tx=0x7f660802bea0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.675+0000 7f661796c640 1 -- 172.21.15.114:0/3966295987 shutdown_connections 2023-11-04T01:36:28.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.675+0000 7f661796c640 1 --2- 172.21.15.114:0/3966295987 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66100b4880 0x7f66100b4ce0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.675+0000 7f661796c640 1 --2- 172.21.15.114:0/3966295987 >> v2:172.21.15.141:3300/0 conn(0x7f66100cd6d0 0x7f6610161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.675+0000 7f661796c640 1 -- 172.21.15.114:0/3966295987 >> 172.21.15.114:0/3966295987 conn(0x7f66100cf880 msgr2=0x7f66100cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:28.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.675+0000 7f661796c640 1 -- 172.21.15.114:0/3966295987 shutdown_connections 2023-11-04T01:36:28.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.675+0000 7f661796c640 1 -- 172.21.15.114:0/3966295987 wait complete. 2023-11-04T01:36:28.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.676+0000 7f661796c640 1 Processor -- start 2023-11-04T01:36:28.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.676+0000 7f661796c640 1 -- start start 2023-11-04T01:36:28.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f661796c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66100b4880 0x7f66101f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:28.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f661796c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66100cd6d0 0x7f6610144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:28.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f661796c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6610153e60 0x7f6610144e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:28.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f661796c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66100cb8d0 con 0x7f66100b4880 2023-11-04T01:36:28.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f661796c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66100cb5f0 con 0x7f66100cd6d0 2023-11-04T01:36:28.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f661796c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6610157ca0 con 0x7f6610153e60 2023-11-04T01:36:28.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f6615708640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66100b4880 0x7f66101f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:28.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f6615708640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66100b4880 0x7f66101f1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36148/0 (socket says 172.21.15.114:36148) 2023-11-04T01:36:28.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f6615708640 1 -- 172.21.15.114:0/1860459095 learned_addr learned my addr 172.21.15.114:0/1860459095 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:28.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f6615f09640 1 --2- 172.21.15.114:0/1860459095 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6610153e60 0x7f6610144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:28.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f6614f07640 1 --2- 172.21.15.114:0/1860459095 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66100cd6d0 0x7f6610144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:28.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f6615708640 1 -- 172.21.15.114:0/1860459095 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6610153e60 msgr2=0x7f6610144e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:28.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f6615708640 1 --2- 172.21.15.114:0/1860459095 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6610153e60 0x7f6610144e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f6615708640 1 -- 172.21.15.114:0/1860459095 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66100cd6d0 msgr2=0x7f6610144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:28.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f6615708640 1 --2- 172.21.15.114:0/1860459095 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66100cd6d0 0x7f6610144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:28.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f6615708640 1 -- 172.21.15.114:0/1860459095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66000094d0 con 0x7f66100b4880 2023-11-04T01:36:28.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.677+0000 7f6615708640 1 --2- 172.21.15.114:0/1860459095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66100b4880 0x7f66101f1e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f660c00c3c0 tx=0x7f660c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:28.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.678+0000 7f6605ffb640 1 -- 172.21.15.114:0/1860459095 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c0074e0 con 0x7f66100b4880 2023-11-04T01:36:28.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.678+0000 7f6605ffb640 1 -- 172.21.15.114:0/1860459095 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660c007640 con 0x7f66100b4880 2023-11-04T01:36:28.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.678+0000 7f6605ffb640 1 -- 172.21.15.114:0/1860459095 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c004a00 con 0x7f66100b4880 2023-11-04T01:36:28.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.678+0000 7f661796c640 1 -- 172.21.15.114:0/1860459095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6608009a70 con 0x7f66100b4880 2023-11-04T01:36:28.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.678+0000 7f661796c640 1 -- 172.21.15.114:0/1860459095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6610158260 con 0x7f66100b4880 2023-11-04T01:36:28.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.679+0000 7f661796c640 1 -- 172.21.15.114:0/1860459095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6610074290 con 0x7f66100b4880 2023-11-04T01:36:28.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.679+0000 7f6605ffb640 1 -- 172.21.15.114:0/1860459095 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f660c004b60 con 0x7f66100b4880 2023-11-04T01:36:28.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.679+0000 7f6605ffb640 1 --2- 172.21.15.114:0/1860459095 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f65f406ae70 0x7f65f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:28.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.680+0000 7f6605ffb640 1 -- 172.21.15.114:0/1860459095 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f660c088c60 con 0x7f66100b4880 2023-11-04T01:36:28.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.680+0000 7f6614f07640 1 --2- 172.21.15.114:0/1860459095 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f65f406ae70 0x7f65f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:28.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.680+0000 7f6614f07640 1 --2- 172.21.15.114:0/1860459095 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f65f406ae70 0x7f65f406d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f661015aac0 tx=0x7f6600009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:28.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.684+0000 7f6605ffb640 1 -- 172.21.15.114:0/1860459095 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f660c053fa0 con 0x7f66100b4880 2023-11-04T01:36:28.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:28.853+0000 7f661796c640 1 -- 172.21.15.114:0/1860459095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f66100d1340 con 0x7f66100b4880 2023-11-04T01:36:29.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.543+0000 7f6605ffb640 1 -- 172.21.15.114:0/1860459095 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f660c0575c0 con 0x7f66100b4880 2023-11-04T01:36:29.545 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2023-11-04T01:36:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.545+0000 7f661796c640 1 -- 172.21.15.114:0/1860459095 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f65f406ae70 msgr2=0x7f65f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.545+0000 7f661796c640 1 --2- 172.21.15.114:0/1860459095 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f65f406ae70 0x7f65f406d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f661015aac0 tx=0x7f6600009240 comp rx=0 tx=0).stop 2023-11-04T01:36:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.546+0000 7f661796c640 1 -- 172.21.15.114:0/1860459095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66100b4880 msgr2=0x7f66101f1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.546+0000 7f661796c640 1 --2- 172.21.15.114:0/1860459095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66100b4880 0x7f66101f1e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f660c00c3c0 tx=0x7f660c00c880 comp rx=0 tx=0).stop 2023-11-04T01:36:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.546+0000 7f661796c640 1 -- 172.21.15.114:0/1860459095 shutdown_connections 2023-11-04T01:36:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.546+0000 7f661796c640 1 --2- 172.21.15.114:0/1860459095 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6610153e60 0x7f6610144e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.546+0000 7f661796c640 1 --2- 172.21.15.114:0/1860459095 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f65f406ae70 0x7f65f406d330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.546+0000 7f661796c640 1 --2- 172.21.15.114:0/1860459095 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66100cd6d0 0x7f6610144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.546+0000 7f661796c640 1 --2- 172.21.15.114:0/1860459095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66100b4880 0x7f66101f1e00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.546+0000 7f661796c640 1 -- 172.21.15.114:0/1860459095 >> 172.21.15.114:0/1860459095 conn(0x7f66100cf880 msgr2=0x7f66100d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.546+0000 7f661796c640 1 -- 172.21.15.114:0/1860459095 shutdown_connections 2023-11-04T01:36:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.546+0000 7f661796c640 1 -- 172.21.15.114:0/1860459095 wait complete. 2023-11-04T01:36:29.569 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:36:29.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.673+0000 7f4d94a56640 1 Processor -- start 2023-11-04T01:36:29.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.673+0000 7f4d94a56640 1 -- start start 2023-11-04T01:36:29.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.674+0000 7f4d94a56640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4d900cdc20 0x7f4d90165950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:29.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.674+0000 7f4d94a56640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d900d0280 con 0x7f4d9015e430 2023-11-04T01:36:29.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.674+0000 7f4d94a56640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d900cf670 con 0x7f4d900d0710 2023-11-04T01:36:29.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.674+0000 7f4d94a56640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d900cf950 con 0x7f4d900cdc20 2023-11-04T01:36:29.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8e59c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4d9015e430 0x7f4d900cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:57630/0 (socket says 172.21.15.114:57630) 2023-11-04T01:36:29.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8e59c640 1 -- 172.21.15.114:0/2291990361 learned_addr learned my addr 172.21.15.114:0/2291990361 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:29.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8ed9d640 1 --2- 172.21.15.114:0/2291990361 >> v2:172.21.15.141:3300/0 conn(0x7f4d900cdc20 0x7f4d90165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:29.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 -- 172.21.15.114:0/2291990361 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849151325 0 0) 0x7f4d900d0280 con 0x7f4d9015e430 2023-11-04T01:36:29.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 -- 172.21.15.114:0/2291990361 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d78003520 con 0x7f4d9015e430 2023-11-04T01:36:29.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 -- 172.21.15.114:0/2291990361 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855636048 0 0) 0x7f4d900cf670 con 0x7f4d900d0710 2023-11-04T01:36:29.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 -- 172.21.15.114:0/2291990361 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d900d0280 con 0x7f4d900d0710 2023-11-04T01:36:29.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 -- 172.21.15.114:0/2291990361 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1216945236 0 0) 0x7f4d78003520 con 0x7f4d9015e430 2023-11-04T01:36:29.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 -- 172.21.15.114:0/2291990361 >> v2:172.21.15.141:3300/0 conn(0x7f4d900cdc20 msgr2=0x7f4d90165950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:29.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 --2- 172.21.15.114:0/2291990361 >> v2:172.21.15.141:3300/0 conn(0x7f4d900cdc20 0x7f4d90165950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:29.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 -- 172.21.15.114:0/2291990361 >> v1:172.21.15.141:6789/0 conn(0x7f4d900d0710 legacy=0x7f4d900cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:29.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 -- 172.21.15.114:0/2291990361 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d900cfc30 con 0x7f4d9015e430 2023-11-04T01:36:29.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 -- 172.21.15.114:0/2291990361 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f4d80001970 con 0x7f4d9015e430 2023-11-04T01:36:29.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 -- 172.21.15.114:0/2291990361 >> v1:172.21.15.114:6789/0 conn(0x7f4d9015e430 legacy=0x7f4d900cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:29.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 --2- 172.21.15.114:0/2291990361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d78003b50 0x7f4d78003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:29.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 --2- 172.21.15.114:0/2291990361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d780047c0 0x7f4d78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:29.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 --2- 172.21.15.114:0/2291990361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d78005180 0x7f4d7800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:29.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 -- 172.21.15.114:0/2291990361 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d900cf950 con 0x7f4d780047c0 2023-11-04T01:36:29.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 -- 172.21.15.114:0/2291990361 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7800c050 con 0x7f4d78003b50 2023-11-04T01:36:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8d59a640 1 -- 172.21.15.114:0/2291990361 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7800c210 con 0x7f4d78005180 2023-11-04T01:36:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8dd9b640 1 --2- 172.21.15.114:0/2291990361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d780047c0 0x7f4d78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8e59c640 1 --2- 172.21.15.114:0/2291990361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d78003b50 0x7f4d78003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8ed9d640 1 --2- 172.21.15.114:0/2291990361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d78005180 0x7f4d7800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8dd9b640 1 -- 172.21.15.114:0/2291990361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d78005180 msgr2=0x7f4d7800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8dd9b640 1 --2- 172.21.15.114:0/2291990361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d78005180 0x7f4d7800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8dd9b640 1 -- 172.21.15.114:0/2291990361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d78003b50 msgr2=0x7f4d78003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8dd9b640 1 --2- 172.21.15.114:0/2291990361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d78003b50 0x7f4d78003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8dd9b640 1 -- 172.21.15.114:0/2291990361 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d78003520 con 0x7f4d780047c0 2023-11-04T01:36:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.675+0000 7f4d8ed9d640 1 -- 172.21.15.114:0/2291990361 reap_dead start 2023-11-04T01:36:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.676+0000 7f4d8dd9b640 1 --2- 172.21.15.114:0/2291990361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d780047c0 0x7f4d78004c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d840018d0 tx=0x7f4d780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df43e3564712568 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.676+0000 7f4d8d59a640 1 -- 172.21.15.114:0/2291990361 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d840052d0 con 0x7f4d780047c0 2023-11-04T01:36:29.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.676+0000 7f4d8d59a640 1 -- 172.21.15.114:0/2291990361 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d84005430 con 0x7f4d780047c0 2023-11-04T01:36:29.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.676+0000 7f4d8d59a640 1 -- 172.21.15.114:0/2291990361 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84003810 con 0x7f4d780047c0 2023-11-04T01:36:29.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.677+0000 7f4d94a56640 1 -- 172.21.15.114:0/2291990361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d780047c0 msgr2=0x7f4d78004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:29.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.677+0000 7f4d94a56640 1 --2- 172.21.15.114:0/2291990361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d780047c0 0x7f4d78004c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d840018d0 tx=0x7f4d780057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:29.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.677+0000 7f4d94a56640 1 -- 172.21.15.114:0/2291990361 shutdown_connections 2023-11-04T01:36:29.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.677+0000 7f4d94a56640 1 --2- 172.21.15.114:0/2291990361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d780047c0 0x7f4d78004c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:29.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.677+0000 7f4d94a56640 1 -- 172.21.15.114:0/2291990361 >> 172.21.15.114:0/2291990361 conn(0x7f4d9006ea20 msgr2=0x7f4d9006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:29.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.677+0000 7f4d94a56640 1 -- 172.21.15.114:0/2291990361 shutdown_connections 2023-11-04T01:36:29.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.677+0000 7f4d94a56640 1 -- 172.21.15.114:0/2291990361 wait complete. 2023-11-04T01:36:29.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.678+0000 7f4d94a56640 1 Processor -- start 2023-11-04T01:36:29.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.678+0000 7f4d94a56640 1 -- start start 2023-11-04T01:36:29.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d94a56640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d780047c0 0x7f4d90159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:29.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d94a56640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d900ca2e0 0x7f4d900c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d94a56640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d900c6f80 0x7f4d900b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d94a56640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d901f1180 con 0x7f4d900ca2e0 2023-11-04T01:36:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d94a56640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d900c56c0 con 0x7f4d900c6f80 2023-11-04T01:36:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d94a56640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d900c59a0 con 0x7f4d780047c0 2023-11-04T01:36:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d8dd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d900ca2e0 0x7f4d900c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d8dd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d900ca2e0 0x7f4d900c6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36168/0 (socket says 172.21.15.114:36168) 2023-11-04T01:36:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d8dd9b640 1 -- 172.21.15.114:0/3463549696 learned_addr learned my addr 172.21.15.114:0/3463549696 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d8e59c640 1 --2- 172.21.15.114:0/3463549696 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d780047c0 0x7f4d90159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d8ed9d640 1 --2- 172.21.15.114:0/3463549696 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d900c6f80 0x7f4d900b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d8dd9b640 1 -- 172.21.15.114:0/3463549696 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d780047c0 msgr2=0x7f4d90159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d8dd9b640 1 --2- 172.21.15.114:0/3463549696 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d780047c0 0x7f4d90159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d8dd9b640 1 -- 172.21.15.114:0/3463549696 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d900c6f80 msgr2=0x7f4d900b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:29.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d8dd9b640 1 --2- 172.21.15.114:0/3463549696 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d900c6f80 0x7f4d900b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:29.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d8dd9b640 1 -- 172.21.15.114:0/3463549696 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d900c5c80 con 0x7f4d900ca2e0 2023-11-04T01:36:29.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d8ed9d640 1 --2- 172.21.15.114:0/3463549696 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d900c6f80 0x7f4d900b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:29.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.679+0000 7f4d8dd9b640 1 --2- 172.21.15.114:0/3463549696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d900ca2e0 0x7f4d900c6a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d84035040 tx=0x7f4d840012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:29.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.680+0000 7f4d7effd640 1 -- 172.21.15.114:0/3463549696 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84007250 con 0x7f4d900ca2e0 2023-11-04T01:36:29.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.680+0000 7f4d7effd640 1 -- 172.21.15.114:0/3463549696 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d840073b0 con 0x7f4d900ca2e0 2023-11-04T01:36:29.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.680+0000 7f4d94a56640 1 -- 172.21.15.114:0/3463549696 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d900c5f60 con 0x7f4d900ca2e0 2023-11-04T01:36:29.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.680+0000 7f4d7effd640 1 -- 172.21.15.114:0/3463549696 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84007720 con 0x7f4d900ca2e0 2023-11-04T01:36:29.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.680+0000 7f4d94a56640 1 -- 172.21.15.114:0/3463549696 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d900c6520 con 0x7f4d900ca2e0 2023-11-04T01:36:29.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.681+0000 7f4d94a56640 1 -- 172.21.15.114:0/3463549696 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d900c66b0 con 0x7f4d900ca2e0 2023-11-04T01:36:29.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.681+0000 7f4d7effd640 1 -- 172.21.15.114:0/3463549696 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4d840035f0 con 0x7f4d900ca2e0 2023-11-04T01:36:29.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.681+0000 7f4d7effd640 1 --2- 172.21.15.114:0/3463549696 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4d7006aea0 0x7f4d7006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:29.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.681+0000 7f4d7effd640 1 -- 172.21.15.114:0/3463549696 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4d840aace0 con 0x7f4d900ca2e0 2023-11-04T01:36:29.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.682+0000 7f4d8e59c640 1 --2- 172.21.15.114:0/3463549696 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4d7006aea0 0x7f4d7006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:29.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.682+0000 7f4d8e59c640 1 --2- 172.21.15.114:0/3463549696 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4d7006aea0 0x7f4d7006d360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4d800013d0 tx=0x7f4d80006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:29.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.686+0000 7f4d7effd640 1 -- 172.21.15.114:0/3463549696 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d84075ea0 con 0x7f4d900ca2e0 2023-11-04T01:36:29.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:29.887+0000 7f4d94a56640 1 -- 172.21.15.114:0/3463549696 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4d90074290 con 0x7f4d900ca2e0 2023-11-04T01:36:30.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.566+0000 7f4d7effd640 1 -- 172.21.15.114:0/3463549696 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4d840370c0 con 0x7f4d900ca2e0 2023-11-04T01:36:30.568 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 2 and data pool 3 2023-11-04T01:36:30.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.570+0000 7f4d94a56640 1 -- 172.21.15.114:0/3463549696 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4d7006aea0 msgr2=0x7f4d7006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.570+0000 7f4d94a56640 1 --2- 172.21.15.114:0/3463549696 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4d7006aea0 0x7f4d7006d360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4d800013d0 tx=0x7f4d80006040 comp rx=0 tx=0).stop 2023-11-04T01:36:30.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.570+0000 7f4d94a56640 1 -- 172.21.15.114:0/3463549696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d900ca2e0 msgr2=0x7f4d900c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.570+0000 7f4d94a56640 1 --2- 172.21.15.114:0/3463549696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d900ca2e0 0x7f4d900c6a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d84035040 tx=0x7f4d840012d0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.570+0000 7f4d94a56640 1 -- 172.21.15.114:0/3463549696 shutdown_connections 2023-11-04T01:36:30.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.570+0000 7f4d94a56640 1 --2- 172.21.15.114:0/3463549696 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4d7006aea0 0x7f4d7006d360 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.570+0000 7f4d94a56640 1 --2- 172.21.15.114:0/3463549696 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d900c6f80 0x7f4d900b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.570+0000 7f4d94a56640 1 --2- 172.21.15.114:0/3463549696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d900ca2e0 0x7f4d900c6a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.570+0000 7f4d94a56640 1 --2- 172.21.15.114:0/3463549696 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d780047c0 0x7f4d90159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.570+0000 7f4d94a56640 1 -- 172.21.15.114:0/3463549696 >> 172.21.15.114:0/3463549696 conn(0x7f4d9006ea20 msgr2=0x7f4d9015cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:30.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.570+0000 7f4d94a56640 1 -- 172.21.15.114:0/3463549696 shutdown_connections 2023-11-04T01:36:30.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.570+0000 7f4d94a56640 1 -- 172.21.15.114:0/3463549696 wait complete. 2023-11-04T01:36:30.586 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-04T01:36:30.587 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-04T01:36:30.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.690+0000 7f27ead5e640 1 Processor -- start 2023-11-04T01:36:30.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.690+0000 7f27ead5e640 1 -- start start 2023-11-04T01:36:30.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27ead5e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f27e415d910 0x7f27e40d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27ead5e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e40d1320 con 0x7f27e415d4b0 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27ead5e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e415df10 con 0x7f27e40cd9f0 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27ead5e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e415e4d0 con 0x7f27e415d910 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e3fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f27e415d4b0 0x7f27e40d17b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:57642/0 (socket says 172.21.15.114:57642) 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e3fff640 1 -- 172.21.15.114:0/4175232422 learned_addr learned my addr 172.21.15.114:0/4175232422 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e92fb640 1 --2- 172.21.15.114:0/4175232422 >> v2:172.21.15.141:3300/0 conn(0x7f27e415d910 0x7f27e40d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e37fe640 1 -- 172.21.15.114:0/4175232422 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329795773 0 0) 0x7f27e40d1320 con 0x7f27e415d4b0 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e37fe640 1 -- 172.21.15.114:0/4175232422 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d4003520 con 0x7f27e415d4b0 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e37fe640 1 -- 172.21.15.114:0/4175232422 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 411087464 0 0) 0x7f27d4003520 con 0x7f27e415d4b0 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e37fe640 1 -- 172.21.15.114:0/4175232422 >> v2:172.21.15.141:3300/0 conn(0x7f27e415d910 msgr2=0x7f27e40d1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e37fe640 1 --2- 172.21.15.114:0/4175232422 >> v2:172.21.15.141:3300/0 conn(0x7f27e415d910 0x7f27e40d1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e37fe640 1 -- 172.21.15.114:0/4175232422 >> v1:172.21.15.141:6789/0 conn(0x7f27e40cd9f0 legacy=0x7f27e40cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e37fe640 1 -- 172.21.15.114:0/4175232422 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e415e1f0 con 0x7f27e415d4b0 2023-11-04T01:36:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e37fe640 1 -- 172.21.15.114:0/4175232422 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f27d0001670 con 0x7f27e415d4b0 2023-11-04T01:36:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e37fe640 1 -- 172.21.15.114:0/4175232422 >> v1:172.21.15.114:6789/0 conn(0x7f27e415d4b0 legacy=0x7f27e40d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e37fe640 1 --2- 172.21.15.114:0/4175232422 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27d40039a0 0x7f27d4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e37fe640 1 --2- 172.21.15.114:0/4175232422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d40047c0 0x7f27d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e37fe640 1 --2- 172.21.15.114:0/4175232422 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f27d4005180 0x7f27d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e37fe640 1 -- 172.21.15.114:0/4175232422 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e415e4d0 con 0x7f27d40047c0 2023-11-04T01:36:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e37fe640 1 -- 172.21.15.114:0/4175232422 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d400c030 con 0x7f27d4005180 2023-11-04T01:36:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e37fe640 1 -- 172.21.15.114:0/4175232422 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d400c1f0 con 0x7f27d40039a0 2023-11-04T01:36:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e3fff640 1 --2- 172.21.15.114:0/4175232422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d40047c0 0x7f27d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e8afa640 1 --2- 172.21.15.114:0/4175232422 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27d40039a0 0x7f27d4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.691+0000 7f27e92fb640 1 --2- 172.21.15.114:0/4175232422 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f27d4005180 0x7f27d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.692+0000 7f27e3fff640 1 -- 172.21.15.114:0/4175232422 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27d40039a0 msgr2=0x7f27d4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.692+0000 7f27e3fff640 1 --2- 172.21.15.114:0/4175232422 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27d40039a0 0x7f27d4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.692+0000 7f27e3fff640 1 -- 172.21.15.114:0/4175232422 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f27d4005180 msgr2=0x7f27d400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.692+0000 7f27e3fff640 1 --2- 172.21.15.114:0/4175232422 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f27d4005180 0x7f27d400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.692+0000 7f27e3fff640 1 -- 172.21.15.114:0/4175232422 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d4003520 con 0x7f27d40047c0 2023-11-04T01:36:30.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.692+0000 7f27e92fb640 1 -- 172.21.15.114:0/4175232422 reap_dead start 2023-11-04T01:36:30.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.692+0000 7f27e3fff640 1 --2- 172.21.15.114:0/4175232422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d40047c0 0x7f27d4004c40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c240 tx=0x7f27d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660951174331e68e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:30.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.692+0000 7f27e37fe640 1 -- 172.21.15.114:0/4175232422 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0005ad0 con 0x7f27d40047c0 2023-11-04T01:36:30.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.692+0000 7f27e37fe640 1 -- 172.21.15.114:0/4175232422 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d0005c30 con 0x7f27d40047c0 2023-11-04T01:36:30.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.692+0000 7f27e37fe640 1 -- 172.21.15.114:0/4175232422 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d002ca90 con 0x7f27d40047c0 2023-11-04T01:36:30.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.693+0000 7f27ead5e640 1 -- 172.21.15.114:0/4175232422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d40047c0 msgr2=0x7f27d4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.693+0000 7f27ead5e640 1 --2- 172.21.15.114:0/4175232422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d40047c0 0x7f27d4004c40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c240 tx=0x7f27d40057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.693+0000 7f27ead5e640 1 -- 172.21.15.114:0/4175232422 shutdown_connections 2023-11-04T01:36:30.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.693+0000 7f27ead5e640 1 --2- 172.21.15.114:0/4175232422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d40047c0 0x7f27d4004c40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.693+0000 7f27ead5e640 1 -- 172.21.15.114:0/4175232422 >> 172.21.15.114:0/4175232422 conn(0x7f27e4071c40 msgr2=0x7f27e4072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:30.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.693+0000 7f27ead5e640 1 -- 172.21.15.114:0/4175232422 shutdown_connections 2023-11-04T01:36:30.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.693+0000 7f27ead5e640 1 -- 172.21.15.114:0/4175232422 wait complete. 2023-11-04T01:36:30.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.694+0000 7f27ead5e640 1 Processor -- start 2023-11-04T01:36:30.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.694+0000 7f27ead5e640 1 -- start start 2023-11-04T01:36:30.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27ead5e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27d40047c0 0x7f27e40b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27ead5e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f27e41524a0 0x7f27e40c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27ead5e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e40ca2e0 0x7f27e41e5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27ead5e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40ca760 con 0x7f27e40ca2e0 2023-11-04T01:36:30.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27ead5e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40caeb0 con 0x7f27e41524a0 2023-11-04T01:36:30.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27ead5e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40cb190 con 0x7f27d40047c0 2023-11-04T01:36:30.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27e92fb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e40ca2e0 0x7f27e41e5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27e92fb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e40ca2e0 0x7f27e41e5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36198/0 (socket says 172.21.15.114:36198) 2023-11-04T01:36:30.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27e92fb640 1 -- 172.21.15.114:0/376285710 learned_addr learned my addr 172.21.15.114:0/376285710 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:30.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27e3fff640 1 --2- 172.21.15.114:0/376285710 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f27e41524a0 0x7f27e40c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27e8afa640 1 --2- 172.21.15.114:0/376285710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27d40047c0 0x7f27e40b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27e92fb640 1 -- 172.21.15.114:0/376285710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27d40047c0 msgr2=0x7f27e40b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27e92fb640 1 --2- 172.21.15.114:0/376285710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27d40047c0 0x7f27e40b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27e92fb640 1 -- 172.21.15.114:0/376285710 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f27e41524a0 msgr2=0x7f27e40c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:30.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27e92fb640 1 --2- 172.21.15.114:0/376285710 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f27e41524a0 0x7f27e40c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:30.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27e92fb640 1 -- 172.21.15.114:0/376285710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e40cb470 con 0x7f27e40ca2e0 2023-11-04T01:36:30.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27e8afa640 1 --2- 172.21.15.114:0/376285710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27d40047c0 0x7f27e40b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:30.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.695+0000 7f27e92fb640 1 --2- 172.21.15.114:0/376285710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e40ca2e0 0x7f27e41e5720 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f27e40d3210 tx=0x7f27dc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:30.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.696+0000 7f27e17fa640 1 -- 172.21.15.114:0/376285710 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc00e040 con 0x7f27e40ca2e0 2023-11-04T01:36:30.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.696+0000 7f27e17fa640 1 -- 172.21.15.114:0/376285710 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc00f040 con 0x7f27e40ca2e0 2023-11-04T01:36:30.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.696+0000 7f27e17fa640 1 -- 172.21.15.114:0/376285710 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc015430 con 0x7f27e40ca2e0 2023-11-04T01:36:30.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.696+0000 7f27ead5e640 1 -- 172.21.15.114:0/376285710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e40cb750 con 0x7f27e40ca2e0 2023-11-04T01:36:30.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.696+0000 7f27ead5e640 1 -- 172.21.15.114:0/376285710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e40c66e0 con 0x7f27e40ca2e0 2023-11-04T01:36:30.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.697+0000 7f27ead5e640 1 -- 172.21.15.114:0/376285710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e40cb940 con 0x7f27e40ca2e0 2023-11-04T01:36:30.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.697+0000 7f27e17fa640 1 -- 172.21.15.114:0/376285710 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f27dc015590 con 0x7f27e40ca2e0 2023-11-04T01:36:30.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.697+0000 7f27e17fa640 1 --2- 172.21.15.114:0/376285710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27c806aea0 0x7f27c806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:30.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.698+0000 7f27e17fa640 1 -- 172.21.15.114:0/376285710 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27dc089e60 con 0x7f27e40ca2e0 2023-11-04T01:36:30.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.698+0000 7f27e8afa640 1 --2- 172.21.15.114:0/376285710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27c806aea0 0x7f27c806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:30.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.698+0000 7f27e8afa640 1 --2- 172.21.15.114:0/376285710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27c806aea0 0x7f27c806d360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f27d8005580 tx=0x7f27d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:30.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.702+0000 7f27e17fa640 1 -- 172.21.15.114:0/376285710 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f27dc054f10 con 0x7f27e40ca2e0 2023-11-04T01:36:30.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:30.878+0000 7f27ead5e640 1 -- 172.21.15.114:0/376285710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f27e404e490 con 0x7f27e40ca2e0 2023-11-04T01:36:31.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.536+0000 7f27e17fa640 1 -- 172.21.15.114:0/376285710 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f27dc058530 con 0x7f27e40ca2e0 2023-11-04T01:36:31.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.539+0000 7f27ead5e640 1 -- 172.21.15.114:0/376285710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27c806aea0 msgr2=0x7f27c806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:31.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.539+0000 7f27ead5e640 1 --2- 172.21.15.114:0/376285710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27c806aea0 0x7f27c806d360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f27d8005580 tx=0x7f27d8009040 comp rx=0 tx=0).stop 2023-11-04T01:36:31.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.539+0000 7f27ead5e640 1 -- 172.21.15.114:0/376285710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e40ca2e0 msgr2=0x7f27e41e5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:31.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.539+0000 7f27ead5e640 1 --2- 172.21.15.114:0/376285710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e40ca2e0 0x7f27e41e5720 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f27e40d3210 tx=0x7f27dc00f580 comp rx=0 tx=0).stop 2023-11-04T01:36:31.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.539+0000 7f27ead5e640 1 -- 172.21.15.114:0/376285710 shutdown_connections 2023-11-04T01:36:31.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.539+0000 7f27ead5e640 1 --2- 172.21.15.114:0/376285710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e40ca2e0 0x7f27e41e5720 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:31.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.539+0000 7f27ead5e640 1 --2- 172.21.15.114:0/376285710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27c806aea0 0x7f27c806d360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:31.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.539+0000 7f27ead5e640 1 --2- 172.21.15.114:0/376285710 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f27e41524a0 0x7f27e40c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:31.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.539+0000 7f27ead5e640 1 --2- 172.21.15.114:0/376285710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27d40047c0 0x7f27e40b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:31.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.539+0000 7f27ead5e640 1 -- 172.21.15.114:0/376285710 >> 172.21.15.114:0/376285710 conn(0x7f27e4071c40 msgr2=0x7f27e41543c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:31.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.539+0000 7f27ead5e640 1 -- 172.21.15.114:0/376285710 shutdown_connections 2023-11-04T01:36:31.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.539+0000 7f27ead5e640 1 -- 172.21.15.114:0/376285710 wait complete. 2023-11-04T01:36:31.553 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:36:31.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.664+0000 7fb006190640 1 Processor -- start 2023-11-04T01:36:31.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.664+0000 7fb006190640 1 -- start start 2023-11-04T01:36:31.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7fb006190640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb000160a50 0x7fb0000d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7fb006190640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0000d2ba0 con 0x7fb0000d09f0 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7fb006190640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0000b8db0 con 0x7fb0000cdbf0 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7fb006190640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0001618d0 con 0x7fb000160a50 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb0000d09f0 0x7fb00015da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:57658/0 (socket says 172.21.15.114:57658) 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffffff640 1 -- 172.21.15.114:0/4148364270 learned_addr learned my addr 172.21.15.114:0/4148364270 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffe7fc640 1 -- 172.21.15.114:0/4148364270 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147325549 0 0) 0x7fb0000d2ba0 con 0x7fb0000d09f0 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffe7fc640 1 -- 172.21.15.114:0/4148364270 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe8003520 con 0x7fb0000d09f0 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffeffd640 1 --2- 172.21.15.114:0/4148364270 >> v2:172.21.15.141:3300/0 conn(0x7fb000160a50 0x7fb0000d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffe7fc640 1 -- 172.21.15.114:0/4148364270 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2730685887 0 0) 0x7fafe8003520 con 0x7fb0000d09f0 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffe7fc640 1 -- 172.21.15.114:0/4148364270 >> v2:172.21.15.141:3300/0 conn(0x7fb000160a50 msgr2=0x7fb0000d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:31.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffe7fc640 1 --2- 172.21.15.114:0/4148364270 >> v2:172.21.15.141:3300/0 conn(0x7fb000160a50 0x7fb0000d2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffe7fc640 1 -- 172.21.15.114:0/4148364270 >> v1:172.21.15.141:6789/0 conn(0x7fb0000cdbf0 legacy=0x7fb0000cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffe7fc640 1 -- 172.21.15.114:0/4148364270 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000161030 con 0x7fb0000d09f0 2023-11-04T01:36:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffe7fc640 1 -- 172.21.15.114:0/4148364270 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7faff80019f0 con 0x7fb0000d09f0 2023-11-04T01:36:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffe7fc640 1 -- 172.21.15.114:0/4148364270 >> v1:172.21.15.114:6789/0 conn(0x7fb0000d09f0 legacy=0x7fb00015da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffe7fc640 1 --2- 172.21.15.114:0/4148364270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe8003970 0x7fafe8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffe7fc640 1 --2- 172.21.15.114:0/4148364270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fafe80047c0 0x7fafe8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffe7fc640 1 --2- 172.21.15.114:0/4148364270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafe8005180 0x7fafe800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffe7fc640 1 -- 172.21.15.114:0/4148364270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0001618d0 con 0x7fafe8003970 2023-11-04T01:36:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffe7fc640 1 -- 172.21.15.114:0/4148364270 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe800c0d0 con 0x7fafe80047c0 2023-11-04T01:36:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7faffe7fc640 1 -- 172.21.15.114:0/4148364270 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe800c290 con 0x7fafe8005180 2023-11-04T01:36:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.665+0000 7fafff7fe640 1 --2- 172.21.15.114:0/4148364270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe8003970 0x7fafe8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.666+0000 7faffeffd640 1 --2- 172.21.15.114:0/4148364270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fafe80047c0 0x7fafe8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.666+0000 7faffffff640 1 --2- 172.21.15.114:0/4148364270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafe8005180 0x7fafe800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.666+0000 7fafff7fe640 1 -- 172.21.15.114:0/4148364270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafe8005180 msgr2=0x7fafe800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.666+0000 7fafff7fe640 1 --2- 172.21.15.114:0/4148364270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafe8005180 0x7fafe800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.666+0000 7fafff7fe640 1 -- 172.21.15.114:0/4148364270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fafe80047c0 msgr2=0x7fafe8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.666+0000 7fafff7fe640 1 --2- 172.21.15.114:0/4148364270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fafe80047c0 0x7fafe8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.666+0000 7fafff7fe640 1 -- 172.21.15.114:0/4148364270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe8003520 con 0x7fafe8003970 2023-11-04T01:36:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.666+0000 7faffeffd640 1 --2- 172.21.15.114:0/4148364270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fafe80047c0 0x7fafe8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.666+0000 7faffffff640 1 --2- 172.21.15.114:0/4148364270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafe8005180 0x7fafe800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.666+0000 7faffffff640 1 -- 172.21.15.114:0/4148364270 reap_dead start 2023-11-04T01:36:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.666+0000 7fafff7fe640 1 --2- 172.21.15.114:0/4148364270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe8003970 0x7fafe8003d90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faff0001750 tx=0x7fafe80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8f9353a5e6fc5e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.666+0000 7faffe7fc640 1 -- 172.21.15.114:0/4148364270 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff00052d0 con 0x7fafe8003970 2023-11-04T01:36:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.666+0000 7faffe7fc640 1 -- 172.21.15.114:0/4148364270 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff002e050 con 0x7fafe8003970 2023-11-04T01:36:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.666+0000 7faffe7fc640 1 -- 172.21.15.114:0/4148364270 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0003830 con 0x7fafe8003970 2023-11-04T01:36:31.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.667+0000 7fb006190640 1 -- 172.21.15.114:0/4148364270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe8003970 msgr2=0x7fafe8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:31.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.667+0000 7fb006190640 1 --2- 172.21.15.114:0/4148364270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe8003970 0x7fafe8003d90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faff0001750 tx=0x7fafe80057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:31.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.667+0000 7fb006190640 1 -- 172.21.15.114:0/4148364270 shutdown_connections 2023-11-04T01:36:31.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.667+0000 7fb006190640 1 --2- 172.21.15.114:0/4148364270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe8003970 0x7fafe8003d90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:31.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.667+0000 7fb006190640 1 -- 172.21.15.114:0/4148364270 >> 172.21.15.114:0/4148364270 conn(0x7fb000071f30 msgr2=0x7fb0000cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:31.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.667+0000 7fb006190640 1 -- 172.21.15.114:0/4148364270 shutdown_connections 2023-11-04T01:36:31.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.667+0000 7fb006190640 1 -- 172.21.15.114:0/4148364270 wait complete. 2023-11-04T01:36:31.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.668+0000 7fb006190640 1 Processor -- start 2023-11-04T01:36:31.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.668+0000 7fb006190640 1 -- start start 2023-11-04T01:36:31.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.669+0000 7fb006190640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafe8003970 0x7fb0000cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:31.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.669+0000 7fb006190640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb00014b110 0x7fb00015bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:31.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.669+0000 7fb006190640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb00015c1d0 0x7fb0000c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:31.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.669+0000 7fb006190640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00015c650 con 0x7fb00014b110 2023-11-04T01:36:31.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.669+0000 7fb006190640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0000c7920 con 0x7fb00015c1d0 2023-11-04T01:36:31.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.669+0000 7fb006190640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0000c6d10 con 0x7fafe8003970 2023-11-04T01:36:31.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.669+0000 7faffeffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb00014b110 0x7fb00015bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:31.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.669+0000 7faffeffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb00014b110 0x7fb00015bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36210/0 (socket says 172.21.15.114:36210) 2023-11-04T01:36:31.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.669+0000 7faffeffd640 1 -- 172.21.15.114:0/3754767671 learned_addr learned my addr 172.21.15.114:0/3754767671 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:31.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.669+0000 7fafff7fe640 1 --2- 172.21.15.114:0/3754767671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafe8003970 0x7fb0000cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:31.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.669+0000 7faffeffd640 1 -- 172.21.15.114:0/3754767671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafe8003970 msgr2=0x7fb0000cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:31.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.669+0000 7faffeffd640 1 --2- 172.21.15.114:0/3754767671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafe8003970 0x7fb0000cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:31.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.669+0000 7faffeffd640 1 -- 172.21.15.114:0/3754767671 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb00015c1d0 msgr2=0x7fb0000c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:31.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.669+0000 7faffffff640 1 --2- 172.21.15.114:0/3754767671 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb00015c1d0 0x7fb0000c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:31.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.669+0000 7faffeffd640 1 --2- 172.21.15.114:0/3754767671 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb00015c1d0 0x7fb0000c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:31.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.669+0000 7faffeffd640 1 -- 172.21.15.114:0/3754767671 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0000c6ff0 con 0x7fb00014b110 2023-11-04T01:36:31.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.670+0000 7faffeffd640 1 --2- 172.21.15.114:0/3754767671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb00014b110 0x7fb00015bc90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faff400f510 tx=0x7faff4004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:31.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.670+0000 7fafe7fff640 1 -- 172.21.15.114:0/3754767671 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff4014870 con 0x7fb00014b110 2023-11-04T01:36:31.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.670+0000 7fafe7fff640 1 -- 172.21.15.114:0/3754767671 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff40149d0 con 0x7fb00014b110 2023-11-04T01:36:31.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.670+0000 7fafe7fff640 1 -- 172.21.15.114:0/3754767671 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff4014d60 con 0x7fb00014b110 2023-11-04T01:36:31.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.670+0000 7fb006190640 1 -- 172.21.15.114:0/3754767671 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0000c72d0 con 0x7fb00014b110 2023-11-04T01:36:31.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.670+0000 7fb006190640 1 -- 172.21.15.114:0/3754767671 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0000c8420 con 0x7fb00014b110 2023-11-04T01:36:31.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.671+0000 7fb006190640 1 -- 172.21.15.114:0/3754767671 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb000074290 con 0x7fb00014b110 2023-11-04T01:36:31.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.671+0000 7fafe7fff640 1 -- 172.21.15.114:0/3754767671 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faff4015410 con 0x7fb00014b110 2023-11-04T01:36:31.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.672+0000 7fafe7fff640 1 --2- 172.21.15.114:0/3754767671 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fafec06ae70 0x7fafec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:31.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.672+0000 7fafe7fff640 1 -- 172.21.15.114:0/3754767671 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7faff4089f70 con 0x7fb00014b110 2023-11-04T01:36:31.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.672+0000 7fafff7fe640 1 --2- 172.21.15.114:0/3754767671 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fafec06ae70 0x7fafec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:31.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.672+0000 7fafff7fe640 1 --2- 172.21.15.114:0/3754767671 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fafec06ae70 0x7fafec06d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faff0033000 tx=0x7faff0009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:31.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.676+0000 7fafe7fff640 1 -- 172.21.15.114:0/3754767671 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faff40bcca0 con 0x7fb00014b110 2023-11-04T01:36:31.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:31.844+0000 7fb006190640 1 -- 172.21.15.114:0/3754767671 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb0000c7a60 con 0x7fb00014b110 2023-11-04T01:36:33.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.582+0000 7fafe7fff640 1 -- 172.21.15.114:0/3754767671 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7faff4054fd0 con 0x7fb00014b110 2023-11-04T01:36:33.587 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data_ec' created 2023-11-04T01:36:33.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.586+0000 7fb006190640 1 -- 172.21.15.114:0/3754767671 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fafec06ae70 msgr2=0x7fafec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:33.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.586+0000 7fb006190640 1 --2- 172.21.15.114:0/3754767671 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fafec06ae70 0x7fafec06d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faff0033000 tx=0x7faff0009030 comp rx=0 tx=0).stop 2023-11-04T01:36:33.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.586+0000 7fb006190640 1 -- 172.21.15.114:0/3754767671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb00014b110 msgr2=0x7fb00015bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:33.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.586+0000 7fb006190640 1 --2- 172.21.15.114:0/3754767671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb00014b110 0x7fb00015bc90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faff400f510 tx=0x7faff4004610 comp rx=0 tx=0).stop 2023-11-04T01:36:33.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.586+0000 7fb006190640 1 -- 172.21.15.114:0/3754767671 shutdown_connections 2023-11-04T01:36:33.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.586+0000 7fb006190640 1 --2- 172.21.15.114:0/3754767671 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fafec06ae70 0x7fafec06d330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.586+0000 7fb006190640 1 --2- 172.21.15.114:0/3754767671 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb00015c1d0 0x7fb0000c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.586+0000 7fb006190640 1 --2- 172.21.15.114:0/3754767671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb00014b110 0x7fb00015bc90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.586+0000 7fb006190640 1 --2- 172.21.15.114:0/3754767671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafe8003970 0x7fb0000cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.586+0000 7fb006190640 1 -- 172.21.15.114:0/3754767671 >> 172.21.15.114:0/3754767671 conn(0x7fb000071f30 msgr2=0x7fb000072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:33.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.586+0000 7fb006190640 1 -- 172.21.15.114:0/3754767671 shutdown_connections 2023-11-04T01:36:33.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.586+0000 7fb006190640 1 -- 172.21.15.114:0/3754767671 wait complete. 2023-11-04T01:36:33.606 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-04T01:36:33.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.712+0000 7f2a27b4c640 1 Processor -- start 2023-11-04T01:36:33.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.713+0000 7f2a27b4c640 1 -- start start 2023-11-04T01:36:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.713+0000 7f2a27b4c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a200cd9f0 0x7f2a200cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.713+0000 7f2a27b4c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a200d27c0 0x7f2a2015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.713+0000 7f2a27b4c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a200d1320 con 0x7f2a2015d4b0 2023-11-04T01:36:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.713+0000 7f2a27b4c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2015e4d0 con 0x7f2a200d27c0 2023-11-04T01:36:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.713+0000 7f2a27b4c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200ce310 con 0x7f2a200cd9f0 2023-11-04T01:36:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.714+0000 7f2a260e9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a200d27c0 0x7f2a2015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.714+0000 7f2a260e9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a200d27c0 0x7f2a2015d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36216/0 (socket says 172.21.15.114:36216) 2023-11-04T01:36:33.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.714+0000 7f2a260e9640 1 -- 172.21.15.114:0/2138749028 learned_addr learned my addr 172.21.15.114:0/2138749028 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:33.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.714+0000 7f2a258e8640 1 --2- 172.21.15.114:0/2138749028 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a200cd9f0 0x7f2a200cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.714+0000 7f2a260e9640 1 -- 172.21.15.114:0/2138749028 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a200cd9f0 msgr2=0x7f2a200cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:33.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.714+0000 7f2a260e9640 1 --2- 172.21.15.114:0/2138749028 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a200cd9f0 0x7f2a200cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.714+0000 7f2a260e9640 1 -- 172.21.15.114:0/2138749028 >> v1:172.21.15.141:6789/0 conn(0x7f2a2015d4b0 legacy=0x7f2a200b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:33.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.714+0000 7f2a260e9640 1 -- 172.21.15.114:0/2138749028 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2015df10 con 0x7f2a200d27c0 2023-11-04T01:36:33.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.715+0000 7f2a260e9640 1 --2- 172.21.15.114:0/2138749028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a200d27c0 0x7f2a2015d910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009e50 tx=0x7f2a1802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82e508ad09de7d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:33.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.715+0000 7f2a248e6640 1 -- 172.21.15.114:0/2138749028 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1802cb90 con 0x7f2a200d27c0 2023-11-04T01:36:33.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.715+0000 7f2a248e6640 1 -- 172.21.15.114:0/2138749028 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1802ccf0 con 0x7f2a200d27c0 2023-11-04T01:36:33.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.715+0000 7f2a248e6640 1 -- 172.21.15.114:0/2138749028 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18034610 con 0x7f2a200d27c0 2023-11-04T01:36:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.715+0000 7f2a27b4c640 1 -- 172.21.15.114:0/2138749028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a200d27c0 msgr2=0x7f2a2015d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.715+0000 7f2a27b4c640 1 --2- 172.21.15.114:0/2138749028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a200d27c0 0x7f2a2015d910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009e50 tx=0x7f2a1802bff0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.715+0000 7f2a27b4c640 1 -- 172.21.15.114:0/2138749028 shutdown_connections 2023-11-04T01:36:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.715+0000 7f2a27b4c640 1 --2- 172.21.15.114:0/2138749028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a200d27c0 0x7f2a2015d910 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.715+0000 7f2a27b4c640 1 --2- 172.21.15.114:0/2138749028 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a200cd9f0 0x7f2a200cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.715+0000 7f2a27b4c640 1 -- 172.21.15.114:0/2138749028 >> 172.21.15.114:0/2138749028 conn(0x7f2a20071c40 msgr2=0x7f2a20072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.715+0000 7f2a27b4c640 1 -- 172.21.15.114:0/2138749028 shutdown_connections 2023-11-04T01:36:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.715+0000 7f2a27b4c640 1 -- 172.21.15.114:0/2138749028 wait complete. 2023-11-04T01:36:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.716+0000 7f2a27b4c640 1 Processor -- start 2023-11-04T01:36:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.716+0000 7f2a27b4c640 1 -- start start 2023-11-04T01:36:33.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.717+0000 7f2a27b4c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a200cd9f0 0x7f2a20151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.717+0000 7f2a27b4c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a200d27c0 0x7f2a200cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.717+0000 7f2a27b4c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a2015d4b0 0x7f2a200b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.717+0000 7f2a27b4c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200ca850 con 0x7f2a2015d4b0 2023-11-04T01:36:33.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.717+0000 7f2a27b4c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200ca040 con 0x7f2a200cd9f0 2023-11-04T01:36:33.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.717+0000 7f2a27b4c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200b2db0 con 0x7f2a200d27c0 2023-11-04T01:36:33.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.717+0000 7f2a260e9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a2015d4b0 0x7f2a200b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.717+0000 7f2a260e9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a2015d4b0 0x7f2a200b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36222/0 (socket says 172.21.15.114:36222) 2023-11-04T01:36:33.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.717+0000 7f2a260e9640 1 -- 172.21.15.114:0/214721911 learned_addr learned my addr 172.21.15.114:0/214721911 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:33.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.717+0000 7f2a250e7640 1 --2- 172.21.15.114:0/214721911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a200d27c0 0x7f2a200cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.717+0000 7f2a258e8640 1 --2- 172.21.15.114:0/214721911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a200cd9f0 0x7f2a20151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.718+0000 7f2a260e9640 1 -- 172.21.15.114:0/214721911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a200d27c0 msgr2=0x7f2a200cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.718+0000 7f2a260e9640 1 --2- 172.21.15.114:0/214721911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a200d27c0 0x7f2a200cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.718+0000 7f2a260e9640 1 -- 172.21.15.114:0/214721911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a200cd9f0 msgr2=0x7f2a20151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.718+0000 7f2a260e9640 1 --2- 172.21.15.114:0/214721911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a200cd9f0 0x7f2a20151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.718+0000 7f2a260e9640 1 -- 172.21.15.114:0/214721911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a18009b30 con 0x7f2a2015d4b0 2023-11-04T01:36:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.718+0000 7f2a250e7640 1 --2- 172.21.15.114:0/214721911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a200d27c0 0x7f2a200cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:33.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.718+0000 7f2a260e9640 1 --2- 172.21.15.114:0/214721911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a2015d4b0 0x7f2a200b2870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009e50 tx=0x7f2a18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.718+0000 7f2a167fc640 1 -- 172.21.15.114:0/214721911 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18009510 con 0x7f2a2015d4b0 2023-11-04T01:36:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.718+0000 7f2a167fc640 1 -- 172.21.15.114:0/214721911 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1803e450 con 0x7f2a2015d4b0 2023-11-04T01:36:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.718+0000 7f2a27b4c640 1 -- 172.21.15.114:0/214721911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a200ca290 con 0x7f2a2015d4b0 2023-11-04T01:36:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.718+0000 7f2a167fc640 1 -- 172.21.15.114:0/214721911 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1803e800 con 0x7f2a2015d4b0 2023-11-04T01:36:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.718+0000 7f2a27b4c640 1 -- 172.21.15.114:0/214721911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a200b46d0 con 0x7f2a2015d4b0 2023-11-04T01:36:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.719+0000 7f2a27b4c640 1 -- 172.21.15.114:0/214721911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a200b4510 con 0x7f2a2015d4b0 2023-11-04T01:36:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.719+0000 7f2a167fc640 1 -- 172.21.15.114:0/214721911 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a1803e960 con 0x7f2a2015d4b0 2023-11-04T01:36:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.720+0000 7f2a167fc640 1 --2- 172.21.15.114:0/214721911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a0406ae70 0x7f2a0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.720+0000 7f2a167fc640 1 -- 172.21.15.114:0/214721911 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f2a180ac370 con 0x7f2a2015d4b0 2023-11-04T01:36:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.720+0000 7f2a258e8640 1 --2- 172.21.15.114:0/214721911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a0406ae70 0x7f2a0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:33.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.720+0000 7f2a258e8640 1 --2- 172.21.15.114:0/214721911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a0406ae70 0x7f2a0406d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009aa0 tx=0x7f2a1c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.724+0000 7f2a167fc640 1 -- 172.21.15.114:0/214721911 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2a18077150 con 0x7f2a2015d4b0 2023-11-04T01:36:33.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:33.891+0000 7f2a27b4c640 1 -- 172.21.15.114:0/214721911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f2a200b48f0 con 0x7f2a2015d4b0 2023-11-04T01:36:34.582 INFO:tasks.ceph.mds.b.smithi141.stderr:2023-11-04T01:36:34.580+0000 7fd9255a8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:36:34.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.587+0000 7f2a167fc640 1 -- 172.21.15.114:0/214721911 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2a1802ce60 con 0x7f2a2015d4b0 2023-11-04T01:36:34.589 INFO:teuthology.orchestra.run.smithi114.stderr:set pool 4 allow_ec_overwrites to true 2023-11-04T01:36:34.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.591+0000 7f2a27b4c640 1 -- 172.21.15.114:0/214721911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a0406ae70 msgr2=0x7f2a0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.591+0000 7f2a27b4c640 1 --2- 172.21.15.114:0/214721911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a0406ae70 0x7f2a0406d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009aa0 tx=0x7f2a1c009190 comp rx=0 tx=0).stop 2023-11-04T01:36:34.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.591+0000 7f2a27b4c640 1 -- 172.21.15.114:0/214721911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a2015d4b0 msgr2=0x7f2a200b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.591+0000 7f2a27b4c640 1 --2- 172.21.15.114:0/214721911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a2015d4b0 0x7f2a200b2870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009e50 tx=0x7f2a18004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:34.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.593+0000 7f2a27b4c640 1 -- 172.21.15.114:0/214721911 shutdown_connections 2023-11-04T01:36:34.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.593+0000 7f2a27b4c640 1 --2- 172.21.15.114:0/214721911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a2015d4b0 0x7f2a200b2870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.593+0000 7f2a27b4c640 1 --2- 172.21.15.114:0/214721911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a200d27c0 0x7f2a200cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.593+0000 7f2a27b4c640 1 --2- 172.21.15.114:0/214721911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a0406ae70 0x7f2a0406d330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.593+0000 7f2a27b4c640 1 --2- 172.21.15.114:0/214721911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a200cd9f0 0x7f2a20151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.593+0000 7f2a27b4c640 1 -- 172.21.15.114:0/214721911 >> 172.21.15.114:0/214721911 conn(0x7f2a20071c40 msgr2=0x7f2a2015c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:34.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.599+0000 7f2a27b4c640 1 -- 172.21.15.114:0/214721911 shutdown_connections 2023-11-04T01:36:34.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.600+0000 7f2a27b4c640 1 -- 172.21.15.114:0/214721911 wait complete. 2023-11-04T01:36:34.625 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-04T01:36:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.728+0000 7fca4a232640 1 Processor -- start 2023-11-04T01:36:34.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.728+0000 7fca4a232640 1 -- start start 2023-11-04T01:36:34.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.729+0000 7fca4a232640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca4415e430 0x7fca440cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.729+0000 7fca4a232640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fca440d0710 0x7fca440b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.729+0000 7fca4a232640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca440d0280 con 0x7fca440cf160 2023-11-04T01:36:34.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.729+0000 7fca4a232640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca440cf670 con 0x7fca4415e430 2023-11-04T01:36:34.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.729+0000 7fca4a232640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca440cf950 con 0x7fca440d0710 2023-11-04T01:36:34.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.729+0000 7fca437fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca4415e430 0x7fca440cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.729+0000 7fca437fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca4415e430 0x7fca440cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36234/0 (socket says 172.21.15.114:36234) 2023-11-04T01:36:34.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.729+0000 7fca437fe640 1 -- 172.21.15.114:0/3444338656 learned_addr learned my addr 172.21.15.114:0/3444338656 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:34.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.729+0000 7fca437fe640 1 -- 172.21.15.114:0/3444338656 >> v2:172.21.15.141:3300/0 conn(0x7fca440d0710 msgr2=0x7fca440b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:34.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.729+0000 7fca43fff640 1 --2- 172.21.15.114:0/3444338656 >> v2:172.21.15.141:3300/0 conn(0x7fca440d0710 0x7fca440b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.729+0000 7fca437fe640 1 --2- 172.21.15.114:0/3444338656 >> v2:172.21.15.141:3300/0 conn(0x7fca440d0710 0x7fca440b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.729+0000 7fca437fe640 1 -- 172.21.15.114:0/3444338656 >> v1:172.21.15.141:6789/0 conn(0x7fca440cf160 legacy=0x7fca440cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:34.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.729+0000 7fca437fe640 1 -- 172.21.15.114:0/3444338656 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca440cfc30 con 0x7fca4415e430 2023-11-04T01:36:34.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.730+0000 7fca437fe640 1 --2- 172.21.15.114:0/3444338656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca4415e430 0x7fca440cec20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca440b6250 tx=0x7fca3402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589930c4003dc622 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:34.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.730+0000 7fca427fc640 1 -- 172.21.15.114:0/3444338656 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34031870 con 0x7fca4415e430 2023-11-04T01:36:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.730+0000 7fca427fc640 1 -- 172.21.15.114:0/3444338656 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca340319d0 con 0x7fca4415e430 2023-11-04T01:36:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.730+0000 7fca427fc640 1 -- 172.21.15.114:0/3444338656 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34031d60 con 0x7fca4415e430 2023-11-04T01:36:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.731+0000 7fca4a232640 1 -- 172.21.15.114:0/3444338656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca4415e430 msgr2=0x7fca440cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.731+0000 7fca4a232640 1 --2- 172.21.15.114:0/3444338656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca4415e430 0x7fca440cec20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca440b6250 tx=0x7fca3402b910 comp rx=0 tx=0).stop 2023-11-04T01:36:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.731+0000 7fca4a232640 1 -- 172.21.15.114:0/3444338656 shutdown_connections 2023-11-04T01:36:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.731+0000 7fca4a232640 1 --2- 172.21.15.114:0/3444338656 >> v2:172.21.15.141:3300/0 conn(0x7fca440d0710 0x7fca440b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.731+0000 7fca4a232640 1 --2- 172.21.15.114:0/3444338656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca4415e430 0x7fca440cec20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.731+0000 7fca4a232640 1 -- 172.21.15.114:0/3444338656 >> 172.21.15.114:0/3444338656 conn(0x7fca4406ea20 msgr2=0x7fca4406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.731+0000 7fca4a232640 1 -- 172.21.15.114:0/3444338656 shutdown_connections 2023-11-04T01:36:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.731+0000 7fca4a232640 1 -- 172.21.15.114:0/3444338656 wait complete. 2023-11-04T01:36:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.732+0000 7fca4a232640 1 Processor -- start 2023-11-04T01:36:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.732+0000 7fca4a232640 1 -- start start 2023-11-04T01:36:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca4a232640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca440cf160 0x7fca4414efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca4a232640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca440d0710 0x7fca441f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca4a232640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fca4415e430 0x7fca440ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca4a232640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca44152a00 con 0x7fca440cf160 2023-11-04T01:36:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca4a232640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca44152440 con 0x7fca440d0710 2023-11-04T01:36:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca4a232640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca44152720 con 0x7fca4415e430 2023-11-04T01:36:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca437fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca440cf160 0x7fca4414efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca437fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca440cf160 0x7fca4414efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36244/0 (socket says 172.21.15.114:36244) 2023-11-04T01:36:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca437fe640 1 -- 172.21.15.114:0/3074176726 learned_addr learned my addr 172.21.15.114:0/3074176726 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca42ffd640 1 --2- 172.21.15.114:0/3074176726 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca440d0710 0x7fca441f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca43fff640 1 --2- 172.21.15.114:0/3074176726 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fca4415e430 0x7fca440ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca437fe640 1 -- 172.21.15.114:0/3074176726 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fca4415e430 msgr2=0x7fca440ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca437fe640 1 --2- 172.21.15.114:0/3074176726 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fca4415e430 0x7fca440ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca437fe640 1 -- 172.21.15.114:0/3074176726 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca440d0710 msgr2=0x7fca441f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:34.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca437fe640 1 --2- 172.21.15.114:0/3074176726 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca440d0710 0x7fca441f3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:34.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca437fe640 1 -- 172.21.15.114:0/3074176726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca340094d0 con 0x7fca440cf160 2023-11-04T01:36:34.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca437fe640 1 --2- 172.21.15.114:0/3074176726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca440cf160 0x7fca4414efb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fca34000c00 tx=0x7fca340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:34.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca2bfff640 1 -- 172.21.15.114:0/3074176726 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34031840 con 0x7fca440cf160 2023-11-04T01:36:34.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca2bfff640 1 -- 172.21.15.114:0/3074176726 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca340443f0 con 0x7fca440cf160 2023-11-04T01:36:34.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca4a232640 1 -- 172.21.15.114:0/3074176726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca441f2890 con 0x7fca440cf160 2023-11-04T01:36:34.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca2bfff640 1 -- 172.21.15.114:0/3074176726 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca340447a0 con 0x7fca440cf160 2023-11-04T01:36:34.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.733+0000 7fca4a232640 1 -- 172.21.15.114:0/3074176726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4414f4f0 con 0x7fca440cf160 2023-11-04T01:36:34.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.734+0000 7fca4a232640 1 -- 172.21.15.114:0/3074176726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca441f2db0 con 0x7fca440cf160 2023-11-04T01:36:34.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.735+0000 7fca2bfff640 1 -- 172.21.15.114:0/3074176726 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca3404d450 con 0x7fca440cf160 2023-11-04T01:36:34.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.735+0000 7fca2bfff640 1 --2- 172.21.15.114:0/3074176726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fca3006ae70 0x7fca3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:34.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.735+0000 7fca42ffd640 1 --2- 172.21.15.114:0/3074176726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fca3006ae70 0x7fca3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:34.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.735+0000 7fca2bfff640 1 -- 172.21.15.114:0/3074176726 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fca3402d040 con 0x7fca440cf160 2023-11-04T01:36:34.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.736+0000 7fca42ffd640 1 --2- 172.21.15.114:0/3074176726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fca3006ae70 0x7fca3006d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fca38006fd0 tx=0x7fca38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:34.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.740+0000 7fca2bfff640 1 -- 172.21.15.114:0/3074176726 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fca441f2db0 con 0x7fca440cf160 2023-11-04T01:36:34.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:34.949+0000 7fca4a232640 1 -- 172.21.15.114:0/3074176726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fca44074290 con 0x7fca440cf160 2023-11-04T01:36:35.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.598+0000 7fca2bfff640 1 -- 172.21.15.114:0/3074176726 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fca34076ec0 con 0x7fca440cf160 2023-11-04T01:36:35.601 INFO:teuthology.orchestra.run.smithi114.stderr:added data pool 4 to fsmap 2023-11-04T01:36:35.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.601+0000 7fca4a232640 1 -- 172.21.15.114:0/3074176726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fca3006ae70 msgr2=0x7fca3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.601+0000 7fca4a232640 1 --2- 172.21.15.114:0/3074176726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fca3006ae70 0x7fca3006d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fca38006fd0 tx=0x7fca38008040 comp rx=0 tx=0).stop 2023-11-04T01:36:35.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.601+0000 7fca4a232640 1 -- 172.21.15.114:0/3074176726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca440cf160 msgr2=0x7fca4414efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.601+0000 7fca4a232640 1 --2- 172.21.15.114:0/3074176726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca440cf160 0x7fca4414efb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fca34000c00 tx=0x7fca340046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.601+0000 7fca4a232640 1 -- 172.21.15.114:0/3074176726 shutdown_connections 2023-11-04T01:36:35.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.601+0000 7fca4a232640 1 --2- 172.21.15.114:0/3074176726 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fca4415e430 0x7fca440ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.601+0000 7fca4a232640 1 --2- 172.21.15.114:0/3074176726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fca3006ae70 0x7fca3006d330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.601+0000 7fca4a232640 1 --2- 172.21.15.114:0/3074176726 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca440d0710 0x7fca441f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.601+0000 7fca4a232640 1 --2- 172.21.15.114:0/3074176726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca440cf160 0x7fca4414efb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.601+0000 7fca4a232640 1 -- 172.21.15.114:0/3074176726 >> 172.21.15.114:0/3074176726 conn(0x7fca4406ea20 msgr2=0x7fca4415d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:35.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.601+0000 7fca4a232640 1 -- 172.21.15.114:0/3074176726 shutdown_connections 2023-11-04T01:36:35.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.601+0000 7fca4a232640 1 -- 172.21.15.114:0/3074176726 wait complete. 2023-11-04T01:36:35.616 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:35.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.721+0000 7f6ee0fd7640 1 Processor -- start 2023-11-04T01:36:35.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.721+0000 7f6ee0fd7640 1 -- start start 2023-11-04T01:36:35.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ee0fd7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6edc15d250 0x7f6edc0c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ee0fd7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6edc06a120 con 0x7f6edc15ce70 2023-11-04T01:36:35.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ee0fd7640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6edc06a370 con 0x7f6edc0c9d70 2023-11-04T01:36:35.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ee0fd7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0cdc10 con 0x7f6edc15d250 2023-11-04T01:36:35.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6eda59c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6edc15ce70 0x7f6edc06d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:57672/0 (socket says 172.21.15.114:57672) 2023-11-04T01:36:35.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6eda59c640 1 -- 172.21.15.114:0/2946154361 learned_addr learned my addr 172.21.15.114:0/2946154361 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:35.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed3fff640 1 --2- 172.21.15.114:0/2946154361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6edc15d250 0x7f6edc0c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed9d9b640 1 -- 172.21.15.114:0/2946154361 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421385031 0 0) 0x7f6edc06a120 con 0x7f6edc15ce70 2023-11-04T01:36:35.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed9d9b640 1 -- 172.21.15.114:0/2946154361 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ec8003520 con 0x7f6edc15ce70 2023-11-04T01:36:35.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed9d9b640 1 -- 172.21.15.114:0/2946154361 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3579167852 0 0) 0x7f6ec8003520 con 0x7f6edc15ce70 2023-11-04T01:36:35.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed9d9b640 1 -- 172.21.15.114:0/2946154361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6edc15d250 msgr2=0x7f6edc0c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:35.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed9d9b640 1 --2- 172.21.15.114:0/2946154361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6edc15d250 0x7f6edc0c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed9d9b640 1 -- 172.21.15.114:0/2946154361 >> v1:172.21.15.141:6789/0 conn(0x7f6edc0c9d70 legacy=0x7f6edc0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed9d9b640 1 -- 172.21.15.114:0/2946154361 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc06a650 con 0x7f6edc15ce70 2023-11-04T01:36:35.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed9d9b640 1 -- 172.21.15.114:0/2946154361 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f6ecc001670 con 0x7f6edc15ce70 2023-11-04T01:36:35.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed9d9b640 1 -- 172.21.15.114:0/2946154361 >> v1:172.21.15.114:6789/0 conn(0x7f6edc15ce70 legacy=0x7f6edc06d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed9d9b640 1 --2- 172.21.15.114:0/2946154361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6edc15d250 0x7f6ec80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed9d9b640 1 --2- 172.21.15.114:0/2946154361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec8003ee0 0x7f6ec80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed9d9b640 1 --2- 172.21.15.114:0/2946154361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec8004d00 0x7f6ec8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed9d9b640 1 -- 172.21.15.114:0/2946154361 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0cdc10 con 0x7f6ec8003ee0 2023-11-04T01:36:35.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed9d9b640 1 -- 172.21.15.114:0/2946154361 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec800ba30 con 0x7f6ec8004d00 2023-11-04T01:36:35.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed9d9b640 1 -- 172.21.15.114:0/2946154361 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec800bbf0 con 0x7f6edc15d250 2023-11-04T01:36:35.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6ed3fff640 1 --2- 172.21.15.114:0/2946154361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec8003ee0 0x7f6ec80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.722+0000 7f6eda59c640 1 --2- 172.21.15.114:0/2946154361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6edc15d250 0x7f6ec80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.723+0000 7f6edad9d640 1 --2- 172.21.15.114:0/2946154361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec8004d00 0x7f6ec8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.723+0000 7f6ed3fff640 1 -- 172.21.15.114:0/2946154361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6edc15d250 msgr2=0x7f6ec80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:35.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.723+0000 7f6ed3fff640 1 --2- 172.21.15.114:0/2946154361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6edc15d250 0x7f6ec80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.723+0000 7f6ed3fff640 1 -- 172.21.15.114:0/2946154361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec8004d00 msgr2=0x7f6ec8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:35.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.723+0000 7f6ed3fff640 1 --2- 172.21.15.114:0/2946154361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ec8004d00 0x7f6ec8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.723+0000 7f6ed3fff640 1 -- 172.21.15.114:0/2946154361 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec8003520 con 0x7f6ec8003ee0 2023-11-04T01:36:35.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.723+0000 7f6ed3fff640 1 --2- 172.21.15.114:0/2946154361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec8003ee0 0x7f6ec80047c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009a90 tx=0x7f6ec80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e65c514bd77cdf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:35.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.723+0000 7f6ed9d9b640 1 -- 172.21.15.114:0/2946154361 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec402c680 con 0x7f6ec8003ee0 2023-11-04T01:36:35.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.724+0000 7f6ed9d9b640 1 -- 172.21.15.114:0/2946154361 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec402c7e0 con 0x7f6ec8003ee0 2023-11-04T01:36:35.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.724+0000 7f6ed9d9b640 1 -- 172.21.15.114:0/2946154361 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec402cb90 con 0x7f6ec8003ee0 2023-11-04T01:36:35.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.724+0000 7f6ee0fd7640 1 -- 172.21.15.114:0/2946154361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec8003ee0 msgr2=0x7f6ec80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.724+0000 7f6ee0fd7640 1 --2- 172.21.15.114:0/2946154361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec8003ee0 0x7f6ec80047c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009a90 tx=0x7f6ec80057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.724+0000 7f6edad9d640 1 -- 172.21.15.114:0/2946154361 reap_dead start 2023-11-04T01:36:35.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.724+0000 7f6ee0fd7640 1 -- 172.21.15.114:0/2946154361 shutdown_connections 2023-11-04T01:36:35.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.724+0000 7f6ee0fd7640 1 -- 172.21.15.114:0/2946154361 >> 172.21.15.114:0/2946154361 conn(0x7f6edc0b0cd0 msgr2=0x7f6edc0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:35.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.724+0000 7f6ee0fd7640 1 -- 172.21.15.114:0/2946154361 shutdown_connections 2023-11-04T01:36:35.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.724+0000 7f6ee0fd7640 1 -- 172.21.15.114:0/2946154361 wait complete. 2023-11-04T01:36:35.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.725+0000 7f6ee0fd7640 1 Processor -- start 2023-11-04T01:36:35.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.725+0000 7f6ee0fd7640 1 -- start start 2023-11-04T01:36:35.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.726+0000 7f6ee0fd7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec8003ee0 0x7f6edc0c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.726+0000 7f6ee0fd7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6edc1e6e00 0x7f6edc0b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.726+0000 7f6ee0fd7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6edc152070 0x7f6edc1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.726+0000 7f6ee0fd7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0c86b0 con 0x7f6edc1e6e00 2023-11-04T01:36:35.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.726+0000 7f6ee0fd7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc151af0 con 0x7f6edc152070 2023-11-04T01:36:35.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.726+0000 7f6ee0fd7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0c93e0 con 0x7f6ec8003ee0 2023-11-04T01:36:35.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.726+0000 7f6ed3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6edc1e6e00 0x7f6edc0b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.726+0000 7f6ed3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6edc1e6e00 0x7f6edc0b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36258/0 (socket says 172.21.15.114:36258) 2023-11-04T01:36:35.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.726+0000 7f6ed3fff640 1 -- 172.21.15.114:0/289619652 learned_addr learned my addr 172.21.15.114:0/289619652 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:35.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.726+0000 7f6edad9d640 1 --2- 172.21.15.114:0/289619652 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6edc152070 0x7f6edc1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.726+0000 7f6eda59c640 1 --2- 172.21.15.114:0/289619652 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec8003ee0 0x7f6edc0c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.726+0000 7f6ed3fff640 1 -- 172.21.15.114:0/289619652 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec8003ee0 msgr2=0x7f6edc0c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.726+0000 7f6ed3fff640 1 --2- 172.21.15.114:0/289619652 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec8003ee0 0x7f6edc0c62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.726+0000 7f6ed3fff640 1 -- 172.21.15.114:0/289619652 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6edc152070 msgr2=0x7f6edc1524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.726+0000 7f6ed3fff640 1 --2- 172.21.15.114:0/289619652 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6edc152070 0x7f6edc1524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.726+0000 7f6ed3fff640 1 -- 172.21.15.114:0/289619652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc1e7380 con 0x7f6edc1e6e00 2023-11-04T01:36:35.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.727+0000 7f6ed3fff640 1 --2- 172.21.15.114:0/289619652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6edc1e6e00 0x7f6edc0b02f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4037040 tx=0x7f6ec4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:35.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.727+0000 7f6ed2ffd640 1 -- 172.21.15.114:0/289619652 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4034910 con 0x7f6edc1e6e00 2023-11-04T01:36:35.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.727+0000 7f6ed2ffd640 1 -- 172.21.15.114:0/289619652 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec4034a90 con 0x7f6edc1e6e00 2023-11-04T01:36:35.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.727+0000 7f6ee0fd7640 1 -- 172.21.15.114:0/289619652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6edc0c86b0 con 0x7f6edc1e6e00 2023-11-04T01:36:35.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.727+0000 7f6ed2ffd640 1 -- 172.21.15.114:0/289619652 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4034e40 con 0x7f6edc1e6e00 2023-11-04T01:36:35.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.727+0000 7f6ee0fd7640 1 -- 172.21.15.114:0/289619652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc0c8be0 con 0x7f6edc1e6e00 2023-11-04T01:36:35.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.728+0000 7f6ee0fd7640 1 -- 172.21.15.114:0/289619652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6edc1560e0 con 0x7f6edc1e6e00 2023-11-04T01:36:35.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.728+0000 7f6ed2ffd640 1 -- 172.21.15.114:0/289619652 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ec403b050 con 0x7f6edc1e6e00 2023-11-04T01:36:35.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.728+0000 7f6ed2ffd640 1 --2- 172.21.15.114:0/289619652 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ebc06ae70 0x7f6ebc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:35.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.729+0000 7f6ed2ffd640 1 -- 172.21.15.114:0/289619652 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6ec40ab680 con 0x7f6edc1e6e00 2023-11-04T01:36:35.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.729+0000 7f6eda59c640 1 --2- 172.21.15.114:0/289619652 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ebc06ae70 0x7f6ebc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:35.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.729+0000 7f6eda59c640 1 --2- 172.21.15.114:0/289619652 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ebc06ae70 0x7f6ebc06d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc007c60 tx=0x7f6ecc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:35.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.733+0000 7f6ed2ffd640 1 -- 172.21.15.114:0/289619652 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ec4076610 con 0x7f6edc1e6e00 2023-11-04T01:36:35.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.936+0000 7f6ee0fd7640 1 -- 172.21.15.114:0/289619652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6edc06a370 con 0x7f6edc1e6e00 2023-11-04T01:36:35.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.936+0000 7f6ed2ffd640 1 -- 172.21.15.114:0/289619652 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f6ec4039090 con 0x7f6edc1e6e00 2023-11-04T01:36:35.939 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:35.939 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1590879236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1590879236},{"type":"v1","addr":"172.21.15.141:6834","nonce":1590879236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3079825621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3079825621},{"type":"v1","addr":"172.21.15.114:6835","nonce":3079825621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1526155664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1526155664},{"type":"v1","addr":"172.21.15.114:6837","nonce":1526155664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:36:29.888918+0000","modified":"2023-11-04T01:36:34.951084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6835/4231924170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4231924170},{"type":"v1","addr":"172.21.15.141:6835","nonce":4231924170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-04T01:36:35.939 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 7 2023-11-04T01:36:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.938+0000 7f6ee0fd7640 1 -- 172.21.15.114:0/289619652 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ebc06ae70 msgr2=0x7f6ebc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.938+0000 7f6ee0fd7640 1 --2- 172.21.15.114:0/289619652 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ebc06ae70 0x7f6ebc06d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc007c60 tx=0x7f6ecc009040 comp rx=0 tx=0).stop 2023-11-04T01:36:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.938+0000 7f6ee0fd7640 1 -- 172.21.15.114:0/289619652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6edc1e6e00 msgr2=0x7f6edc0b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.938+0000 7f6ee0fd7640 1 --2- 172.21.15.114:0/289619652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6edc1e6e00 0x7f6edc0b02f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4037040 tx=0x7f6ec4004730 comp rx=0 tx=0).stop 2023-11-04T01:36:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.938+0000 7f6ee0fd7640 1 -- 172.21.15.114:0/289619652 shutdown_connections 2023-11-04T01:36:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.938+0000 7f6ee0fd7640 1 --2- 172.21.15.114:0/289619652 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ebc06ae70 0x7f6ebc06d330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.938+0000 7f6ee0fd7640 1 --2- 172.21.15.114:0/289619652 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6edc152070 0x7f6edc1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.938+0000 7f6ee0fd7640 1 --2- 172.21.15.114:0/289619652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6edc1e6e00 0x7f6edc0b02f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.938+0000 7f6ee0fd7640 1 --2- 172.21.15.114:0/289619652 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ec8003ee0 0x7f6edc0c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:35.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.938+0000 7f6ee0fd7640 1 -- 172.21.15.114:0/289619652 >> 172.21.15.114:0/289619652 conn(0x7f6edc0b0cd0 msgr2=0x7f6edc0cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:35.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.938+0000 7f6ee0fd7640 1 -- 172.21.15.114:0/289619652 shutdown_connections 2023-11-04T01:36:35.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:35.939+0000 7f6ee0fd7640 1 -- 172.21.15.114:0/289619652 wait complete. 2023-11-04T01:36:35.951 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:36.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.049+0000 7f1108051640 1 Processor -- start 2023-11-04T01:36:36.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.049+0000 7f1108051640 1 -- start start 2023-11-04T01:36:36.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1108051640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f110015ae40 0x7f110015bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1108051640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11000cc450 con 0x7f11000cbc00 2023-11-04T01:36:36.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1108051640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110015f400 con 0x7f11000cda30 2023-11-04T01:36:36.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1108051640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110015b220 con 0x7f110015ae40 2023-11-04T01:36:36.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f11055ec640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f11000cbc00 0x7f11000cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:57686/0 (socket says 172.21.15.114:57686) 2023-11-04T01:36:36.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f11055ec640 1 -- 172.21.15.114:0/2887745946 learned_addr learned my addr 172.21.15.114:0/2887745946 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:36.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1105ded640 1 --2- 172.21.15.114:0/2887745946 >> v2:172.21.15.141:3300/0 conn(0x7f110015ae40 0x7f110015bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1104deb640 1 -- 172.21.15.114:0/2887745946 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166533688 0 0) 0x7f10f0001110 con 0x7f11000cbc00 2023-11-04T01:36:36.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1104deb640 1 -- 172.21.15.114:0/2887745946 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10ec003520 con 0x7f11000cbc00 2023-11-04T01:36:36.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1104deb640 1 -- 172.21.15.114:0/2887745946 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875154728 0 0) 0x7f110015f400 con 0x7f11000cda30 2023-11-04T01:36:36.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1104deb640 1 -- 172.21.15.114:0/2887745946 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f0001110 con 0x7f11000cda30 2023-11-04T01:36:36.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1104deb640 1 -- 172.21.15.114:0/2887745946 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3097451772 0 0) 0x7f10ec003520 con 0x7f11000cbc00 2023-11-04T01:36:36.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1104deb640 1 -- 172.21.15.114:0/2887745946 >> v2:172.21.15.141:3300/0 conn(0x7f110015ae40 msgr2=0x7f110015bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1104deb640 1 --2- 172.21.15.114:0/2887745946 >> v2:172.21.15.141:3300/0 conn(0x7f110015ae40 0x7f110015bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1104deb640 1 -- 172.21.15.114:0/2887745946 >> v1:172.21.15.141:6789/0 conn(0x7f11000cda30 legacy=0x7f11000ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1104deb640 1 -- 172.21.15.114:0/2887745946 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110015f890 con 0x7f11000cbc00 2023-11-04T01:36:36.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1104deb640 1 -- 172.21.15.114:0/2887745946 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f10f0001800 con 0x7f11000cbc00 2023-11-04T01:36:36.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1105ded640 1 --2- 172.21.15.114:0/2887745946 >> v2:172.21.15.141:3300/0 conn(0x7f110015ae40 0x7f110015bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:36.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1104deb640 1 -- 172.21.15.114:0/2887745946 >> v1:172.21.15.114:6789/0 conn(0x7f11000cbc00 legacy=0x7f11000cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1104deb640 1 --2- 172.21.15.114:0/2887745946 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10ec003b00 0x7f10ec003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1104deb640 1 --2- 172.21.15.114:0/2887745946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10ec0047c0 0x7f10ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.050+0000 7f1104deb640 1 --2- 172.21.15.114:0/2887745946 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10ec005180 0x7f10ec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.051+0000 7f1104deb640 1 -- 172.21.15.114:0/2887745946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110015b220 con 0x7f10ec0047c0 2023-11-04T01:36:36.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.051+0000 7f1104deb640 1 -- 172.21.15.114:0/2887745946 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec00c000 con 0x7f10ec003b00 2023-11-04T01:36:36.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.051+0000 7f1104deb640 1 -- 172.21.15.114:0/2887745946 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec00c1c0 con 0x7f10ec005180 2023-11-04T01:36:36.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.051+0000 7f11055ec640 1 --2- 172.21.15.114:0/2887745946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10ec0047c0 0x7f10ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.051+0000 7f1105ded640 1 --2- 172.21.15.114:0/2887745946 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10ec003b00 0x7f10ec003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.051+0000 7f11065ee640 1 --2- 172.21.15.114:0/2887745946 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10ec005180 0x7f10ec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.051+0000 7f11055ec640 1 -- 172.21.15.114:0/2887745946 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10ec005180 msgr2=0x7f10ec00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.051+0000 7f11055ec640 1 --2- 172.21.15.114:0/2887745946 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10ec005180 0x7f10ec00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.051+0000 7f11055ec640 1 -- 172.21.15.114:0/2887745946 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10ec003b00 msgr2=0x7f10ec003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.051+0000 7f11055ec640 1 --2- 172.21.15.114:0/2887745946 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10ec003b00 0x7f10ec003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.051+0000 7f11055ec640 1 -- 172.21.15.114:0/2887745946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec003520 con 0x7f10ec0047c0 2023-11-04T01:36:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.051+0000 7f11065ee640 1 -- 172.21.15.114:0/2887745946 reap_dead start 2023-11-04T01:36:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.052+0000 7f11055ec640 1 --2- 172.21.15.114:0/2887745946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10ec0047c0 0x7f10ec004c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f10f000c160 tx=0x7f10ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157b00eca707a18c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.052+0000 7f1104deb640 1 -- 172.21.15.114:0/2887745946 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f0005ad0 con 0x7f10ec0047c0 2023-11-04T01:36:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.052+0000 7f1104deb640 1 -- 172.21.15.114:0/2887745946 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f0005c50 con 0x7f10ec0047c0 2023-11-04T01:36:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.052+0000 7f1104deb640 1 -- 172.21.15.114:0/2887745946 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f002c810 con 0x7f10ec0047c0 2023-11-04T01:36:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.052+0000 7f1108051640 1 -- 172.21.15.114:0/2887745946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10ec0047c0 msgr2=0x7f10ec004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.052+0000 7f1108051640 1 --2- 172.21.15.114:0/2887745946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10ec0047c0 0x7f10ec004c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f10f000c160 tx=0x7f10ec0057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.052+0000 7f1108051640 1 -- 172.21.15.114:0/2887745946 shutdown_connections 2023-11-04T01:36:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.052+0000 7f1108051640 1 --2- 172.21.15.114:0/2887745946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10ec0047c0 0x7f10ec004c40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.052+0000 7f1108051640 1 -- 172.21.15.114:0/2887745946 >> 172.21.15.114:0/2887745946 conn(0x7f110006ea90 msgr2=0x7f110006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.052+0000 7f1108051640 1 -- 172.21.15.114:0/2887745946 shutdown_connections 2023-11-04T01:36:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.052+0000 7f1108051640 1 -- 172.21.15.114:0/2887745946 wait complete. 2023-11-04T01:36:36.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.053+0000 7f1108051640 1 Processor -- start 2023-11-04T01:36:36.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.054+0000 7f1108051640 1 -- start start 2023-11-04T01:36:36.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.054+0000 7f1108051640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10ec0047c0 0x7f11001480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.054+0000 7f1108051640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11000c46b0 0x7f11000c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.054+0000 7f1108051640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11000b5750 0x7f11000b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.054+0000 7f1108051640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11000b6110 con 0x7f10ec0047c0 2023-11-04T01:36:36.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.054+0000 7f1108051640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11000c56f0 con 0x7f11000b5750 2023-11-04T01:36:36.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.054+0000 7f1108051640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11001485f0 con 0x7f11000c46b0 2023-11-04T01:36:36.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.054+0000 7f1105ded640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10ec0047c0 0x7f11001480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.054+0000 7f1105ded640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10ec0047c0 0x7f11001480b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36278/0 (socket says 172.21.15.114:36278) 2023-11-04T01:36:36.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.054+0000 7f1105ded640 1 -- 172.21.15.114:0/930977933 learned_addr learned my addr 172.21.15.114:0/930977933 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:36.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.054+0000 7f11055ec640 1 --2- 172.21.15.114:0/930977933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11000c46b0 0x7f11000c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.054+0000 7f11065ee640 1 --2- 172.21.15.114:0/930977933 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11000b5750 0x7f11000b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.055+0000 7f1105ded640 1 -- 172.21.15.114:0/930977933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11000c46b0 msgr2=0x7f11000c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.055+0000 7f1105ded640 1 --2- 172.21.15.114:0/930977933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11000c46b0 0x7f11000c4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.055+0000 7f1105ded640 1 -- 172.21.15.114:0/930977933 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11000b5750 msgr2=0x7f11000b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.055+0000 7f1105ded640 1 --2- 172.21.15.114:0/930977933 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11000b5750 0x7f11000b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.055+0000 7f1105ded640 1 -- 172.21.15.114:0/930977933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11000c5130 con 0x7f10ec0047c0 2023-11-04T01:36:36.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.055+0000 7f11055ec640 1 --2- 172.21.15.114:0/930977933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11000c46b0 0x7f11000c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:36.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.055+0000 7f1105ded640 1 --2- 172.21.15.114:0/930977933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10ec0047c0 0x7f11001480b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f10fc011d00 tx=0x7f10fc00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.055+0000 7f10f67fc640 1 -- 172.21.15.114:0/930977933 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc00fcc0 con 0x7f10ec0047c0 2023-11-04T01:36:36.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.055+0000 7f10f67fc640 1 -- 172.21.15.114:0/930977933 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc00fe20 con 0x7f10ec0047c0 2023-11-04T01:36:36.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.055+0000 7f1108051640 1 -- 172.21.15.114:0/930977933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11000c5410 con 0x7f10ec0047c0 2023-11-04T01:36:36.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.055+0000 7f10f67fc640 1 -- 172.21.15.114:0/930977933 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc004270 con 0x7f10ec0047c0 2023-11-04T01:36:36.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.055+0000 7f1108051640 1 -- 172.21.15.114:0/930977933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11000c8080 con 0x7f10ec0047c0 2023-11-04T01:36:36.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.056+0000 7f1108051640 1 -- 172.21.15.114:0/930977933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11000ce2d0 con 0x7f10ec0047c0 2023-11-04T01:36:36.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.056+0000 7f10f67fc640 1 -- 172.21.15.114:0/930977933 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f10fc0043d0 con 0x7f10ec0047c0 2023-11-04T01:36:36.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.057+0000 7f10f67fc640 1 --2- 172.21.15.114:0/930977933 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f10e406ae70 0x7f10e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.057+0000 7f10f67fc640 1 -- 172.21.15.114:0/930977933 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f10fc089ec0 con 0x7f10ec0047c0 2023-11-04T01:36:36.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.057+0000 7f11055ec640 1 --2- 172.21.15.114:0/930977933 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f10e406ae70 0x7f10e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.057+0000 7f11055ec640 1 --2- 172.21.15.114:0/930977933 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f10e406ae70 0x7f10e406d330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f10f0034000 tx=0x7f10f0007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.061+0000 7f10f67fc640 1 -- 172.21.15.114:0/930977933 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f10fc054d10 con 0x7f10ec0047c0 2023-11-04T01:36:36.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.232+0000 7f1108051640 1 -- 172.21.15.114:0/930977933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1100074290 con 0x7f10ec0047c0 2023-11-04T01:36:36.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.233+0000 7f10f67fc640 1 -- 172.21.15.114:0/930977933 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18406 (secure 0 0 0) 0x7f10fc022070 con 0x7f10ec0047c0 2023-11-04T01:36:36.235 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:36.235 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:34.950923+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:36.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.235+0000 7f1108051640 1 -- 172.21.15.114:0/930977933 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f10e406ae70 msgr2=0x7f10e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.235+0000 7f1108051640 1 --2- 172.21.15.114:0/930977933 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f10e406ae70 0x7f10e406d330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f10f0034000 tx=0x7f10f0007000 comp rx=0 tx=0).stop 2023-11-04T01:36:36.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.235+0000 7f1108051640 1 -- 172.21.15.114:0/930977933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10ec0047c0 msgr2=0x7f11001480b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.235+0000 7f1108051640 1 --2- 172.21.15.114:0/930977933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10ec0047c0 0x7f11001480b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f10fc011d00 tx=0x7f10fc00f610 comp rx=0 tx=0).stop 2023-11-04T01:36:36.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.235+0000 7f1108051640 1 -- 172.21.15.114:0/930977933 shutdown_connections 2023-11-04T01:36:36.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.235+0000 7f1108051640 1 --2- 172.21.15.114:0/930977933 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f10e406ae70 0x7f10e406d330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.235+0000 7f1108051640 1 --2- 172.21.15.114:0/930977933 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11000b5750 0x7f11000b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.235+0000 7f1108051640 1 --2- 172.21.15.114:0/930977933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11000c46b0 0x7f11000c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.235+0000 7f1108051640 1 --2- 172.21.15.114:0/930977933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10ec0047c0 0x7f11001480b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.235+0000 7f1108051640 1 -- 172.21.15.114:0/930977933 >> 172.21.15.114:0/930977933 conn(0x7f110006ea90 msgr2=0x7f1100072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:36.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.235+0000 7f1108051640 1 -- 172.21.15.114:0/930977933 shutdown_connections 2023-11-04T01:36:36.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.235+0000 7f1108051640 1 -- 172.21.15.114:0/930977933 wait complete. 2023-11-04T01:36:36.251 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:36.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.350+0000 7f0c4977c640 1 Processor -- start 2023-11-04T01:36:36.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.350+0000 7f0c4977c640 1 -- start start 2023-11-04T01:36:36.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.350+0000 7f0c4977c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0c440cde60 0x7f0c4415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.350+0000 7f0c4977c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c4415daa0 0x7f0c44157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.351+0000 7f0c4977c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4415e000 con 0x7f0c440ce240 2023-11-04T01:36:36.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.351+0000 7f0c4977c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4415e5c0 con 0x7f0c4415daa0 2023-11-04T01:36:36.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.351+0000 7f0c4977c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4415e2e0 con 0x7f0c440cde60 2023-11-04T01:36:36.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.351+0000 7f0c427fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c4415daa0 0x7f0c44157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.351+0000 7f0c427fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c4415daa0 0x7f0c44157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36290/0 (socket says 172.21.15.114:36290) 2023-11-04T01:36:36.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.351+0000 7f0c427fc640 1 -- 172.21.15.114:0/2628338732 learned_addr learned my addr 172.21.15.114:0/2628338732 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:36.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.351+0000 7f0c42ffd640 1 --2- 172.21.15.114:0/2628338732 >> v2:172.21.15.141:3300/0 conn(0x7f0c440cde60 0x7f0c4415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.351+0000 7f0c427fc640 1 -- 172.21.15.114:0/2628338732 >> v2:172.21.15.141:3300/0 conn(0x7f0c440cde60 msgr2=0x7f0c4415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.351+0000 7f0c427fc640 1 --2- 172.21.15.114:0/2628338732 >> v2:172.21.15.141:3300/0 conn(0x7f0c440cde60 0x7f0c4415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.351+0000 7f0c427fc640 1 -- 172.21.15.114:0/2628338732 >> v1:172.21.15.114:6789/0 conn(0x7f0c440ce240 legacy=0x7f0c4406b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.351+0000 7f0c427fc640 1 -- 172.21.15.114:0/2628338732 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c440d1120 con 0x7f0c4415daa0 2023-11-04T01:36:36.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.352+0000 7f0c427fc640 1 --2- 172.21.15.114:0/2628338732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4415daa0 0x7f0c44157000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0c440b5550 tx=0x7f0c3802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755b2e88152ccbef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.352+0000 7f0c41ffb640 1 -- 172.21.15.114:0/2628338732 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38030860 con 0x7f0c4415daa0 2023-11-04T01:36:36.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.352+0000 7f0c41ffb640 1 -- 172.21.15.114:0/2628338732 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c380309c0 con 0x7f0c4415daa0 2023-11-04T01:36:36.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.352+0000 7f0c41ffb640 1 -- 172.21.15.114:0/2628338732 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38030d50 con 0x7f0c4415daa0 2023-11-04T01:36:36.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.352+0000 7f0c4977c640 1 -- 172.21.15.114:0/2628338732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4415daa0 msgr2=0x7f0c44157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.352+0000 7f0c4977c640 1 --2- 172.21.15.114:0/2628338732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4415daa0 0x7f0c44157000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0c440b5550 tx=0x7f0c3802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.352+0000 7f0c4977c640 1 -- 172.21.15.114:0/2628338732 shutdown_connections 2023-11-04T01:36:36.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.352+0000 7f0c4977c640 1 --2- 172.21.15.114:0/2628338732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4415daa0 0x7f0c44157000 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.352+0000 7f0c4977c640 1 --2- 172.21.15.114:0/2628338732 >> v2:172.21.15.141:3300/0 conn(0x7f0c440cde60 0x7f0c4415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.352+0000 7f0c4977c640 1 -- 172.21.15.114:0/2628338732 >> 172.21.15.114:0/2628338732 conn(0x7f0c44071f30 msgr2=0x7f0c440cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:36.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.352+0000 7f0c4977c640 1 -- 172.21.15.114:0/2628338732 shutdown_connections 2023-11-04T01:36:36.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.352+0000 7f0c4977c640 1 -- 172.21.15.114:0/2628338732 wait complete. 2023-11-04T01:36:36.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.354+0000 7f0c4977c640 1 Processor -- start 2023-11-04T01:36:36.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.354+0000 7f0c4977c640 1 -- start start 2023-11-04T01:36:36.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.354+0000 7f0c4977c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c440cde60 0x7f0c4414e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.354+0000 7f0c4977c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c440ce240 0x7f0c44152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.354+0000 7f0c4977c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4415daa0 0x7f0c441511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.354+0000 7f0c4977c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c44153590 con 0x7f0c4415daa0 2023-11-04T01:36:36.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.354+0000 7f0c4977c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c44153f00 con 0x7f0c440ce240 2023-11-04T01:36:36.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.354+0000 7f0c4977c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c44152fd0 con 0x7f0c440cde60 2023-11-04T01:36:36.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.354+0000 7f0c437fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4415daa0 0x7f0c441511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.354+0000 7f0c437fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4415daa0 0x7f0c441511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36296/0 (socket says 172.21.15.114:36296) 2023-11-04T01:36:36.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.354+0000 7f0c437fe640 1 -- 172.21.15.114:0/1974255700 learned_addr learned my addr 172.21.15.114:0/1974255700 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:36.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.355+0000 7f0c427fc640 1 --2- 172.21.15.114:0/1974255700 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c440ce240 0x7f0c44152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.355+0000 7f0c42ffd640 1 --2- 172.21.15.114:0/1974255700 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c440cde60 0x7f0c4414e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.355+0000 7f0c437fe640 1 -- 172.21.15.114:0/1974255700 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c440cde60 msgr2=0x7f0c4414e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.355+0000 7f0c437fe640 1 --2- 172.21.15.114:0/1974255700 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c440cde60 0x7f0c4414e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.355+0000 7f0c437fe640 1 -- 172.21.15.114:0/1974255700 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c440ce240 msgr2=0x7f0c44152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.355+0000 7f0c437fe640 1 --2- 172.21.15.114:0/1974255700 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c440ce240 0x7f0c44152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.355+0000 7f0c437fe640 1 -- 172.21.15.114:0/1974255700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c380094d0 con 0x7f0c4415daa0 2023-11-04T01:36:36.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.355+0000 7f0c437fe640 1 --2- 172.21.15.114:0/1974255700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4415daa0 0x7f0c441511d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00c760 tx=0x7f0c3c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.355+0000 7f0c2b7fe640 1 -- 172.21.15.114:0/1974255700 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c003b70 con 0x7f0c4415daa0 2023-11-04T01:36:36.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.355+0000 7f0c2b7fe640 1 -- 172.21.15.114:0/1974255700 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3c003cd0 con 0x7f0c4415daa0 2023-11-04T01:36:36.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.355+0000 7f0c4977c640 1 -- 172.21.15.114:0/1974255700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c441532b0 con 0x7f0c4415daa0 2023-11-04T01:36:36.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.355+0000 7f0c2b7fe640 1 -- 172.21.15.114:0/1974255700 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00aa90 con 0x7f0c4415daa0 2023-11-04T01:36:36.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.355+0000 7f0c4977c640 1 -- 172.21.15.114:0/1974255700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4414e740 con 0x7f0c4415daa0 2023-11-04T01:36:36.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.356+0000 7f0c4977c640 1 -- 172.21.15.114:0/1974255700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c44153980 con 0x7f0c4415daa0 2023-11-04T01:36:36.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.356+0000 7f0c2b7fe640 1 -- 172.21.15.114:0/1974255700 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c3c00abf0 con 0x7f0c4415daa0 2023-11-04T01:36:36.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.357+0000 7f0c2b7fe640 1 --2- 172.21.15.114:0/1974255700 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0c3006ae70 0x7f0c3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.357+0000 7f0c42ffd640 1 --2- 172.21.15.114:0/1974255700 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0c3006ae70 0x7f0c3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.357+0000 7f0c2b7fe640 1 -- 172.21.15.114:0/1974255700 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0c3c0895d0 con 0x7f0c4415daa0 2023-11-04T01:36:36.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.357+0000 7f0c42ffd640 1 --2- 172.21.15.114:0/1974255700 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0c3006ae70 0x7f0c3006d330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0c34006fd0 tx=0x7f0c34008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.361+0000 7f0c2b7fe640 1 -- 172.21.15.114:0/1974255700 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0c44153980 con 0x7f0c4415daa0 2023-11-04T01:36:36.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.528+0000 7f0c4977c640 1 -- 172.21.15.114:0/1974255700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c44154040 con 0x7f0c4415daa0 2023-11-04T01:36:36.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.529+0000 7f0c2b7fe640 1 -- 172.21.15.114:0/1974255700 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18406 (secure 0 0 0) 0x7f0c44154040 con 0x7f0c4415daa0 2023-11-04T01:36:36.532 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:36.532 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:34.950923+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:36.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.531+0000 7f0c4977c640 1 -- 172.21.15.114:0/1974255700 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0c3006ae70 msgr2=0x7f0c3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.531+0000 7f0c4977c640 1 --2- 172.21.15.114:0/1974255700 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0c3006ae70 0x7f0c3006d330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0c34006fd0 tx=0x7f0c34008040 comp rx=0 tx=0).stop 2023-11-04T01:36:36.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.531+0000 7f0c4977c640 1 -- 172.21.15.114:0/1974255700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4415daa0 msgr2=0x7f0c441511d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.531+0000 7f0c4977c640 1 --2- 172.21.15.114:0/1974255700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4415daa0 0x7f0c441511d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00c760 tx=0x7f0c3c00cc20 comp rx=0 tx=0).stop 2023-11-04T01:36:36.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.531+0000 7f0c4977c640 1 -- 172.21.15.114:0/1974255700 shutdown_connections 2023-11-04T01:36:36.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.531+0000 7f0c4977c640 1 --2- 172.21.15.114:0/1974255700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4415daa0 0x7f0c441511d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.531+0000 7f0c4977c640 1 --2- 172.21.15.114:0/1974255700 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0c3006ae70 0x7f0c3006d330 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.531+0000 7f0c4977c640 1 --2- 172.21.15.114:0/1974255700 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0c440ce240 0x7f0c44152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.531+0000 7f0c4977c640 1 --2- 172.21.15.114:0/1974255700 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0c440cde60 0x7f0c4414e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.531+0000 7f0c4977c640 1 -- 172.21.15.114:0/1974255700 >> 172.21.15.114:0/1974255700 conn(0x7f0c44071f30 msgr2=0x7f0c440c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:36.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.531+0000 7f0c4977c640 1 -- 172.21.15.114:0/1974255700 shutdown_connections 2023-11-04T01:36:36.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.531+0000 7f0c4977c640 1 -- 172.21.15.114:0/1974255700 wait complete. 2023-11-04T01:36:36.563 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:36.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.661+0000 7f71e3353640 1 Processor -- start 2023-11-04T01:36:36.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.661+0000 7f71e3353640 1 -- start start 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.662+0000 7f71e3353640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f71dc15e1c0 0x7f71dc06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.662+0000 7f71e3353640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f71dc0b14a0 0x7f71dc06a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.662+0000 7f71e3353640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc06fe80 0x7f71dc0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.662+0000 7f71e3353640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc0b1b80 con 0x7f71dc0b14a0 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.662+0000 7f71e3353640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc0b1e60 con 0x7f71dc15e1c0 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.662+0000 7f71e3353640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0b2140 con 0x7f71dc06fe80 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.662+0000 7f71e08ee640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f71dc0b14a0 0x7f71dc06a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.662+0000 7f71e08ee640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f71dc0b14a0 0x7f71dc06a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48628/0 (socket says 172.21.15.114:48628) 2023-11-04T01:36:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.662+0000 7f71e08ee640 1 -- 172.21.15.114:0/4263951463 learned_addr learned my addr 172.21.15.114:0/4263951463 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.663+0000 7f71e18f0640 1 --2- 172.21.15.114:0/4263951463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc06fe80 0x7f71dc0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.663+0000 7f71e10ef640 1 --2- 172.21.15.114:0/4263951463 >> v2:172.21.15.141:3300/0 conn(0x7f71dc15e1c0 0x7f71dc06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.663+0000 7f71e08ee640 1 -- 172.21.15.114:0/4263951463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc06fe80 msgr2=0x7f71dc0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.663+0000 7f71e08ee640 1 --2- 172.21.15.114:0/4263951463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc06fe80 0x7f71dc0cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.663+0000 7f71e08ee640 1 -- 172.21.15.114:0/4263951463 >> v2:172.21.15.141:3300/0 conn(0x7f71dc15e1c0 msgr2=0x7f71dc06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.663+0000 7f71e08ee640 1 --2- 172.21.15.114:0/4263951463 >> v2:172.21.15.141:3300/0 conn(0x7f71dc15e1c0 0x7f71dc06a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.663+0000 7f71e08ee640 1 -- 172.21.15.114:0/4263951463 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0ca990 con 0x7f71dc0b14a0 2023-11-04T01:36:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.663+0000 7f71e18f0640 1 --2- 172.21.15.114:0/4263951463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc06fe80 0x7f71dc0cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:36.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.663+0000 7f71e08ee640 1 --2- 172.21.15.114:0/4263951463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71dc0b14a0 0x7f71dc06a660 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f71dc06af00 tx=0x7f71cc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9f3736094904d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.663+0000 7f71d3fff640 1 -- 172.21.15.114:0/4263951463 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc031870 con 0x7f71dc0b14a0 2023-11-04T01:36:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.664+0000 7f71d3fff640 1 -- 172.21.15.114:0/4263951463 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc0319d0 con 0x7f71dc0b14a0 2023-11-04T01:36:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.664+0000 7f71d3fff640 1 -- 172.21.15.114:0/4263951463 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc031d60 con 0x7f71dc0b14a0 2023-11-04T01:36:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.664+0000 7f71e3353640 1 -- 172.21.15.114:0/4263951463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71dc0b14a0 msgr2=0x7f71dc06a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.664+0000 7f71e3353640 1 --2- 172.21.15.114:0/4263951463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71dc0b14a0 0x7f71dc06a660 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f71dc06af00 tx=0x7f71cc02b910 comp rx=0 tx=0).stop 2023-11-04T01:36:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.664+0000 7f71e3353640 1 -- 172.21.15.114:0/4263951463 shutdown_connections 2023-11-04T01:36:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.664+0000 7f71e3353640 1 --2- 172.21.15.114:0/4263951463 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc06fe80 0x7f71dc0cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.664+0000 7f71e3353640 1 --2- 172.21.15.114:0/4263951463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71dc0b14a0 0x7f71dc06a660 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.664+0000 7f71e3353640 1 --2- 172.21.15.114:0/4263951463 >> v2:172.21.15.141:3300/0 conn(0x7f71dc15e1c0 0x7f71dc06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.664+0000 7f71e3353640 1 -- 172.21.15.114:0/4263951463 >> 172.21.15.114:0/4263951463 conn(0x7f71dc06d8b0 msgr2=0x7f71dc06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.664+0000 7f71e3353640 1 -- 172.21.15.114:0/4263951463 shutdown_connections 2023-11-04T01:36:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.664+0000 7f71e3353640 1 -- 172.21.15.114:0/4263951463 wait complete. 2023-11-04T01:36:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.665+0000 7f71e3353640 1 Processor -- start 2023-11-04T01:36:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.665+0000 7f71e3353640 1 -- start start 2023-11-04T01:36:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.666+0000 7f71e3353640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71dc06fe80 0x7f71dc149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.666+0000 7f71e3353640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc0b14a0 0x7f71dc146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.666+0000 7f71e3353640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71dc15e1c0 0x7f71dc146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.666+0000 7f71e3353640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc158a80 con 0x7f71dc06fe80 2023-11-04T01:36:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.666+0000 7f71e3353640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc157bd0 con 0x7f71dc15e1c0 2023-11-04T01:36:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.666+0000 7f71e3353640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc149b40 con 0x7f71dc0b14a0 2023-11-04T01:36:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.666+0000 7f71e10ef640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71dc06fe80 0x7f71dc149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.666+0000 7f71e10ef640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71dc06fe80 0x7f71dc149600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48630/0 (socket says 172.21.15.114:48630) 2023-11-04T01:36:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.666+0000 7f71e10ef640 1 -- 172.21.15.114:0/1578102080 learned_addr learned my addr 172.21.15.114:0/1578102080 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.666+0000 7f71e18f0640 1 --2- 172.21.15.114:0/1578102080 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71dc15e1c0 0x7f71dc146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.666+0000 7f71e10ef640 1 -- 172.21.15.114:0/1578102080 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc0b14a0 msgr2=0x7f71dc146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.666+0000 7f71e10ef640 1 --2- 172.21.15.114:0/1578102080 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc0b14a0 0x7f71dc146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.666+0000 7f71e10ef640 1 -- 172.21.15.114:0/1578102080 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71dc15e1c0 msgr2=0x7f71dc146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.666+0000 7f71e10ef640 1 --2- 172.21.15.114:0/1578102080 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71dc15e1c0 0x7f71dc146220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.666+0000 7f71e10ef640 1 -- 172.21.15.114:0/1578102080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc0094d0 con 0x7f71dc06fe80 2023-11-04T01:36:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.666+0000 7f71e10ef640 1 --2- 172.21.15.114:0/1578102080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71dc06fe80 0x7f71dc149600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f71d8007ef0 tx=0x7f71d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.667+0000 7f71d1ffb640 1 -- 172.21.15.114:0/1578102080 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d8014620 con 0x7f71dc06fe80 2023-11-04T01:36:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.667+0000 7f71d1ffb640 1 -- 172.21.15.114:0/1578102080 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d8014780 con 0x7f71dc06fe80 2023-11-04T01:36:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.667+0000 7f71e3353640 1 -- 172.21.15.114:0/1578102080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc157e70 con 0x7f71dc06fe80 2023-11-04T01:36:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.667+0000 7f71d1ffb640 1 -- 172.21.15.114:0/1578102080 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d8014b30 con 0x7f71dc06fe80 2023-11-04T01:36:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.667+0000 7f71e3353640 1 -- 172.21.15.114:0/1578102080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc158430 con 0x7f71dc06fe80 2023-11-04T01:36:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.668+0000 7f71e3353640 1 -- 172.21.15.114:0/1578102080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc0674e0 con 0x7f71dc06fe80 2023-11-04T01:36:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.668+0000 7f71d1ffb640 1 -- 172.21.15.114:0/1578102080 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71d8014c90 con 0x7f71dc06fe80 2023-11-04T01:36:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.668+0000 7f71d1ffb640 1 --2- 172.21.15.114:0/1578102080 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f71c006ae70 0x7f71c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.669+0000 7f71d1ffb640 1 -- 172.21.15.114:0/1578102080 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f71d808a2a0 con 0x7f71dc06fe80 2023-11-04T01:36:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.669+0000 7f71e08ee640 1 --2- 172.21.15.114:0/1578102080 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f71c006ae70 0x7f71c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.669+0000 7f71e08ee640 1 --2- 172.21.15.114:0/1578102080 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f71c006ae70 0x7f71c006d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71cc036000 tx=0x7f71cc030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.673+0000 7f71d1ffb640 1 -- 172.21.15.114:0/1578102080 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f71d8055060 con 0x7f71dc06fe80 2023-11-04T01:36:36.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.874+0000 7f71e3353640 1 -- 172.21.15.114:0/1578102080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71dc072df0 con 0x7f71dc06fe80 2023-11-04T01:36:36.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.874+0000 7f71d1ffb640 1 -- 172.21.15.114:0/1578102080 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f71d8058680 con 0x7f71dc06fe80 2023-11-04T01:36:36.878 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:36.878 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1590879236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1590879236},{"type":"v1","addr":"172.21.15.141:6834","nonce":1590879236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3079825621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3079825621},{"type":"v1","addr":"172.21.15.114:6835","nonce":3079825621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1526155664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1526155664},{"type":"v1","addr":"172.21.15.114:6837","nonce":1526155664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:36:29.888918+0000","modified":"2023-11-04T01:36:34.951084+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6835/4231924170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4231924170},{"type":"v1","addr":"172.21.15.141:6835","nonce":4231924170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-04T01:36:36.879 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 7 2023-11-04T01:36:36.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.876+0000 7f71e3353640 1 -- 172.21.15.114:0/1578102080 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f71c006ae70 msgr2=0x7f71c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.876+0000 7f71e3353640 1 --2- 172.21.15.114:0/1578102080 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f71c006ae70 0x7f71c006d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71cc036000 tx=0x7f71cc030000 comp rx=0 tx=0).stop 2023-11-04T01:36:36.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.876+0000 7f71e3353640 1 -- 172.21.15.114:0/1578102080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71dc06fe80 msgr2=0x7f71dc149600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.876+0000 7f71e3353640 1 --2- 172.21.15.114:0/1578102080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71dc06fe80 0x7f71dc149600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f71d8007ef0 tx=0x7f71d800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.877+0000 7f71e3353640 1 -- 172.21.15.114:0/1578102080 shutdown_connections 2023-11-04T01:36:36.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.877+0000 7f71e3353640 1 --2- 172.21.15.114:0/1578102080 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f71c006ae70 0x7f71c006d330 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.877+0000 7f71e3353640 1 --2- 172.21.15.114:0/1578102080 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71dc15e1c0 0x7f71dc146220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.877+0000 7f71e3353640 1 --2- 172.21.15.114:0/1578102080 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71dc0b14a0 0x7f71dc146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.877+0000 7f71e3353640 1 --2- 172.21.15.114:0/1578102080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71dc06fe80 0x7f71dc149600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.877+0000 7f71e3353640 1 -- 172.21.15.114:0/1578102080 >> 172.21.15.114:0/1578102080 conn(0x7f71dc06d8b0 msgr2=0x7f71dc0afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:36.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.877+0000 7f71e3353640 1 -- 172.21.15.114:0/1578102080 shutdown_connections 2023-11-04T01:36:36.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.877+0000 7f71e3353640 1 -- 172.21.15.114:0/1578102080 wait complete. 2023-11-04T01:36:36.889 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:36.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.987+0000 7f9988821640 1 Processor -- start 2023-11-04T01:36:36.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.987+0000 7f9988821640 1 -- start start 2023-11-04T01:36:36.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.988+0000 7f9988821640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99840cda60 0x7f99840ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.988+0000 7f9988821640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f99840b0cd0 0x7f9984070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:36.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.988+0000 7f9988821640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99840cc990 con 0x7f99840cace0 2023-11-04T01:36:36.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.988+0000 7f9988821640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99840ccc70 con 0x7f99840cda60 2023-11-04T01:36:36.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.988+0000 7f9988821640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99840c9ce0 con 0x7f99840b0cd0 2023-11-04T01:36:36.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.988+0000 7f998259c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99840cda60 0x7f99840ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.988+0000 7f998259c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99840cda60 0x7f99840ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48642/0 (socket says 172.21.15.114:48642) 2023-11-04T01:36:36.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.988+0000 7f998259c640 1 -- 172.21.15.114:0/528192202 learned_addr learned my addr 172.21.15.114:0/528192202 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:36.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.988+0000 7f9981d9b640 1 --2- 172.21.15.114:0/528192202 >> v2:172.21.15.141:3300/0 conn(0x7f99840b0cd0 0x7f9984070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:36.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.988+0000 7f998259c640 1 -- 172.21.15.114:0/528192202 >> v2:172.21.15.141:3300/0 conn(0x7f99840b0cd0 msgr2=0x7f9984070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:36.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.988+0000 7f998259c640 1 --2- 172.21.15.114:0/528192202 >> v2:172.21.15.141:3300/0 conn(0x7f99840b0cd0 0x7f9984070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.988+0000 7f998259c640 1 -- 172.21.15.114:0/528192202 >> v1:172.21.15.141:6789/0 conn(0x7f99840cace0 legacy=0x7f998406c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.988+0000 7f998259c640 1 -- 172.21.15.114:0/528192202 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99840c9fc0 con 0x7f99840cda60 2023-11-04T01:36:36.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.989+0000 7f998259c640 1 --2- 172.21.15.114:0/528192202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99840cda60 0x7f99840ca7a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f998406e330 tx=0x7f997402e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159f7f295e2d5654 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:36.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.989+0000 7f998159a640 1 -- 172.21.15.114:0/528192202 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974036440 con 0x7f99840cda60 2023-11-04T01:36:36.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.989+0000 7f998159a640 1 -- 172.21.15.114:0/528192202 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99740365a0 con 0x7f99840cda60 2023-11-04T01:36:36.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.989+0000 7f998159a640 1 -- 172.21.15.114:0/528192202 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974036930 con 0x7f99840cda60 2023-11-04T01:36:36.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.989+0000 7f9988821640 1 -- 172.21.15.114:0/528192202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99840cda60 msgr2=0x7f99840ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:36.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.989+0000 7f9988821640 1 --2- 172.21.15.114:0/528192202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99840cda60 0x7f99840ca7a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f998406e330 tx=0x7f997402e170 comp rx=0 tx=0).stop 2023-11-04T01:36:36.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.990+0000 7f9988821640 1 -- 172.21.15.114:0/528192202 shutdown_connections 2023-11-04T01:36:36.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.990+0000 7f9988821640 1 --2- 172.21.15.114:0/528192202 >> v2:172.21.15.141:3300/0 conn(0x7f99840b0cd0 0x7f9984070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.990+0000 7f9988821640 1 --2- 172.21.15.114:0/528192202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99840cda60 0x7f99840ca7a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:36.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.990+0000 7f9988821640 1 -- 172.21.15.114:0/528192202 >> 172.21.15.114:0/528192202 conn(0x7f99840ce950 msgr2=0x7f99840ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:36.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.990+0000 7f9988821640 1 -- 172.21.15.114:0/528192202 shutdown_connections 2023-11-04T01:36:36.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.990+0000 7f9988821640 1 -- 172.21.15.114:0/528192202 wait complete. 2023-11-04T01:36:37.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.991+0000 7f9988821640 1 Processor -- start 2023-11-04T01:36:37.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.991+0000 7f9988821640 1 -- start start 2023-11-04T01:36:37.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9988821640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99840b0cd0 0x7f998414fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9988821640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99840cace0 0x7f99841e4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9988821640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99840cda60 0x7f99841e4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9988821640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99841e1c50 con 0x7f99840cace0 2023-11-04T01:36:37.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9988821640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99840c7340 con 0x7f99840cda60 2023-11-04T01:36:37.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9988821640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99841e1ef0 con 0x7f99840b0cd0 2023-11-04T01:36:37.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9981d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99840cace0 0x7f99841e4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9981d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99840cace0 0x7f99841e4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48656/0 (socket says 172.21.15.114:48656) 2023-11-04T01:36:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9981d9b640 1 -- 172.21.15.114:0/467096488 learned_addr learned my addr 172.21.15.114:0/467096488 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9982d9d640 1 --2- 172.21.15.114:0/467096488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99840cda60 0x7f99841e4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f998259c640 1 --2- 172.21.15.114:0/467096488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99840b0cd0 0x7f998414fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9981d9b640 1 -- 172.21.15.114:0/467096488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99840b0cd0 msgr2=0x7f998414fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9981d9b640 1 --2- 172.21.15.114:0/467096488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99840b0cd0 0x7f998414fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9981d9b640 1 -- 172.21.15.114:0/467096488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99840cda60 msgr2=0x7f99841e4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9981d9b640 1 --2- 172.21.15.114:0/467096488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99840cda60 0x7f99841e4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9981d9b640 1 -- 172.21.15.114:0/467096488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997400b770 con 0x7f99840cace0 2023-11-04T01:36:37.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f998259c640 1 --2- 172.21.15.114:0/467096488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99840b0cd0 0x7f998414fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:37.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9981d9b640 1 --2- 172.21.15.114:0/467096488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99840cace0 0x7f99841e4210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f997800e980 tx=0x7f997800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9972ffd640 1 -- 172.21.15.114:0/467096488 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978009670 con 0x7f99840cace0 2023-11-04T01:36:37.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9972ffd640 1 -- 172.21.15.114:0/467096488 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997800ca00 con 0x7f99840cace0 2023-11-04T01:36:37.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9988821640 1 -- 172.21.15.114:0/467096488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99841e21d0 con 0x7f99840cace0 2023-11-04T01:36:37.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9972ffd640 1 -- 172.21.15.114:0/467096488 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997800cd90 con 0x7f99840cace0 2023-11-04T01:36:37.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.992+0000 7f9988821640 1 -- 172.21.15.114:0/467096488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99840c7620 con 0x7f99840cace0 2023-11-04T01:36:37.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.993+0000 7f9988821640 1 -- 172.21.15.114:0/467096488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9984074290 con 0x7f99840cace0 2023-11-04T01:36:37.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.994+0000 7f9972ffd640 1 -- 172.21.15.114:0/467096488 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9978013470 con 0x7f99840cace0 2023-11-04T01:36:37.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.994+0000 7f9972ffd640 1 --2- 172.21.15.114:0/467096488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f996406aea0 0x7f996406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.994+0000 7f998259c640 1 --2- 172.21.15.114:0/467096488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f996406aea0 0x7f996406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.994+0000 7f9972ffd640 1 -- 172.21.15.114:0/467096488 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9978089a40 con 0x7f99840cace0 2023-11-04T01:36:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.995+0000 7f998259c640 1 --2- 172.21.15.114:0/467096488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f996406aea0 0x7f996406d360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9974038000 tx=0x7f9974032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:36.998+0000 7f9972ffd640 1 -- 172.21.15.114:0/467096488 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f997808be60 con 0x7f99840cace0 2023-11-04T01:36:37.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.165+0000 7f9988821640 1 -- 172.21.15.114:0/467096488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99840b48b0 con 0x7f99840cace0 2023-11-04T01:36:37.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.166+0000 7f9972ffd640 1 -- 172.21.15.114:0/467096488 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18406 (secure 0 0 0) 0x7f9978017090 con 0x7f99840cace0 2023-11-04T01:36:37.168 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:37.169 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:34.950923+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:37.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.168+0000 7f9988821640 1 -- 172.21.15.114:0/467096488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f996406aea0 msgr2=0x7f996406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.168+0000 7f9988821640 1 --2- 172.21.15.114:0/467096488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f996406aea0 0x7f996406d360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9974038000 tx=0x7f9974032000 comp rx=0 tx=0).stop 2023-11-04T01:36:37.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.168+0000 7f9988821640 1 -- 172.21.15.114:0/467096488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99840cace0 msgr2=0x7f99841e4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.168+0000 7f9988821640 1 --2- 172.21.15.114:0/467096488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99840cace0 0x7f99841e4210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f997800e980 tx=0x7f997800ee40 comp rx=0 tx=0).stop 2023-11-04T01:36:37.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.168+0000 7f9988821640 1 -- 172.21.15.114:0/467096488 shutdown_connections 2023-11-04T01:36:37.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.168+0000 7f9988821640 1 --2- 172.21.15.114:0/467096488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f996406aea0 0x7f996406d360 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.168+0000 7f9988821640 1 --2- 172.21.15.114:0/467096488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99840cda60 0x7f99841e4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.168+0000 7f9988821640 1 --2- 172.21.15.114:0/467096488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99840cace0 0x7f99841e4210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.168+0000 7f9988821640 1 --2- 172.21.15.114:0/467096488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99840b0cd0 0x7f998414fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.168+0000 7f9988821640 1 -- 172.21.15.114:0/467096488 >> 172.21.15.114:0/467096488 conn(0x7f99840ce950 msgr2=0x7f9984070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:37.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.168+0000 7f9988821640 1 -- 172.21.15.114:0/467096488 shutdown_connections 2023-11-04T01:36:37.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.168+0000 7f9988821640 1 -- 172.21.15.114:0/467096488 wait complete. 2023-11-04T01:36:37.584 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:36:29.888918+0000', 'modified': '2023-11-04T01:36:34.951084+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4305}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4305': {'gid': 4305, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.141:6835/4231924170', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.141:6833', 'nonce': 4231924170}, {'type': 'v1', 'addr': '172.21.15.141:6835', 'nonce': 4231924170}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-04T01:36:37.584 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:36:37.584 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:36:37.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.683+0000 7f3fa8bb6640 1 Processor -- start 2023-11-04T01:36:37.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.683+0000 7f3fa8bb6640 1 -- start start 2023-11-04T01:36:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.684+0000 7f3fa8bb6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3fa41605b0 0x7f3fa40ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.684+0000 7f3fa8bb6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa4160990 con 0x7f3fa40b1a40 2023-11-04T01:36:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.684+0000 7f3fa8bb6640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa40cc7c0 con 0x7f3fa406a830 2023-11-04T01:36:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.684+0000 7f3fa8bb6640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa40cd750 con 0x7f3fa41605b0 2023-11-04T01:36:37.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.684+0000 7f3fa1d9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3fa40b1a40 0x7f3fa406a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45388/0 (socket says 172.21.15.114:45388) 2023-11-04T01:36:37.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.684+0000 7f3fa1d9b640 1 -- 172.21.15.114:0/1303221129 learned_addr learned my addr 172.21.15.114:0/1303221129 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:37.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.684+0000 7f3fa259c640 1 --2- 172.21.15.114:0/1303221129 >> v2:172.21.15.141:3300/0 conn(0x7f3fa41605b0 0x7f3fa40ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa159a640 1 -- 172.21.15.114:0/1303221129 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316614644 0 0) 0x7f3fa4160990 con 0x7f3fa40b1a40 2023-11-04T01:36:37.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa159a640 1 -- 172.21.15.114:0/1303221129 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f8c003520 con 0x7f3fa40b1a40 2023-11-04T01:36:37.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa159a640 1 -- 172.21.15.114:0/1303221129 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1223906063 0 0) 0x7f3f8c003520 con 0x7f3fa40b1a40 2023-11-04T01:36:37.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa159a640 1 -- 172.21.15.114:0/1303221129 >> v2:172.21.15.141:3300/0 conn(0x7f3fa41605b0 msgr2=0x7f3fa40ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:37.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa159a640 1 --2- 172.21.15.114:0/1303221129 >> v2:172.21.15.141:3300/0 conn(0x7f3fa41605b0 0x7f3fa40ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa159a640 1 -- 172.21.15.114:0/1303221129 >> v1:172.21.15.141:6789/0 conn(0x7f3fa406a830 legacy=0x7f3fa40cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa159a640 1 -- 172.21.15.114:0/1303221129 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa40cc4e0 con 0x7f3fa40b1a40 2023-11-04T01:36:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa159a640 1 -- 172.21.15.114:0/1303221129 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f3f98001670 con 0x7f3fa40b1a40 2023-11-04T01:36:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa259c640 1 --2- 172.21.15.114:0/1303221129 >> v2:172.21.15.141:3300/0 conn(0x7f3fa41605b0 0x7f3fa40ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa159a640 1 -- 172.21.15.114:0/1303221129 >> v1:172.21.15.114:6789/0 conn(0x7f3fa40b1a40 legacy=0x7f3fa406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa159a640 1 --2- 172.21.15.114:0/1303221129 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f8c003970 0x7f3f8c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa159a640 1 --2- 172.21.15.114:0/1303221129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f8c0047c0 0x7f3f8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa159a640 1 --2- 172.21.15.114:0/1303221129 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f8c0052a0 0x7f3f8c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa159a640 1 -- 172.21.15.114:0/1303221129 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40cd750 con 0x7f3f8c0047c0 2023-11-04T01:36:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa159a640 1 -- 172.21.15.114:0/1303221129 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c00c170 con 0x7f3f8c003970 2023-11-04T01:36:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa159a640 1 -- 172.21.15.114:0/1303221129 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c00c330 con 0x7f3f8c0052a0 2023-11-04T01:36:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa1d9b640 1 --2- 172.21.15.114:0/1303221129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f8c0047c0 0x7f3f8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa259c640 1 --2- 172.21.15.114:0/1303221129 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f8c003970 0x7f3f8c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa2d9d640 1 --2- 172.21.15.114:0/1303221129 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f8c0052a0 0x7f3f8c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa1d9b640 1 -- 172.21.15.114:0/1303221129 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f8c0052a0 msgr2=0x7f3f8c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa1d9b640 1 --2- 172.21.15.114:0/1303221129 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3f8c0052a0 0x7f3f8c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa1d9b640 1 -- 172.21.15.114:0/1303221129 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f8c003970 msgr2=0x7f3f8c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa1d9b640 1 --2- 172.21.15.114:0/1303221129 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3f8c003970 0x7f3f8c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa1d9b640 1 -- 172.21.15.114:0/1303221129 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c003520 con 0x7f3f8c0047c0 2023-11-04T01:36:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.685+0000 7f3fa2d9d640 1 -- 172.21.15.114:0/1303221129 reap_dead start 2023-11-04T01:36:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.686+0000 7f3fa1d9b640 1 --2- 172.21.15.114:0/1303221129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f8c0047c0 0x7f3f8c004c40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800c210 tx=0x7f3f8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4778b35d709660 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.686+0000 7f3fa159a640 1 -- 172.21.15.114:0/1303221129 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98005ad0 con 0x7f3f8c0047c0 2023-11-04T01:36:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.686+0000 7f3fa159a640 1 -- 172.21.15.114:0/1303221129 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f98005c30 con 0x7f3f8c0047c0 2023-11-04T01:36:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.686+0000 7f3fa159a640 1 -- 172.21.15.114:0/1303221129 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9802cab0 con 0x7f3f8c0047c0 2023-11-04T01:36:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.687+0000 7f3fa8bb6640 1 -- 172.21.15.114:0/1303221129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f8c0047c0 msgr2=0x7f3f8c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.687+0000 7f3fa8bb6640 1 --2- 172.21.15.114:0/1303221129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f8c0047c0 0x7f3f8c004c40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800c210 tx=0x7f3f8c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.687+0000 7f3fa8bb6640 1 -- 172.21.15.114:0/1303221129 shutdown_connections 2023-11-04T01:36:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.687+0000 7f3fa8bb6640 1 --2- 172.21.15.114:0/1303221129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f8c0047c0 0x7f3f8c004c40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.687+0000 7f3fa8bb6640 1 -- 172.21.15.114:0/1303221129 >> 172.21.15.114:0/1303221129 conn(0x7f3fa4071820 msgr2=0x7f3fa4071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.687+0000 7f3fa8bb6640 1 -- 172.21.15.114:0/1303221129 shutdown_connections 2023-11-04T01:36:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.687+0000 7f3fa8bb6640 1 -- 172.21.15.114:0/1303221129 wait complete. 2023-11-04T01:36:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.688+0000 7f3fa8bb6640 1 Processor -- start 2023-11-04T01:36:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.688+0000 7f3fa8bb6640 1 -- start start 2023-11-04T01:36:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa8bb6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f8c0047c0 0x7f3fa414f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa8bb6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3fa414edb0 0x7f3fa415d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa8bb6640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3fa415dc00 0x7f3fa415ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa8bb6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa415e160 con 0x7f3f8c0047c0 2023-11-04T01:36:37.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa8bb6640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40b3d20 con 0x7f3fa415dc00 2023-11-04T01:36:37.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa8bb6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40b4000 con 0x7f3fa414edb0 2023-11-04T01:36:37.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f8c0047c0 0x7f3fa414f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f8c0047c0 0x7f3fa414f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48684/0 (socket says 172.21.15.114:48684) 2023-11-04T01:36:37.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa259c640 1 -- 172.21.15.114:0/3822913260 learned_addr learned my addr 172.21.15.114:0/3822913260 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:37.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa1d9b640 1 --2- 172.21.15.114:0/3822913260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3fa414edb0 0x7f3fa415d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa2d9d640 1 --2- 172.21.15.114:0/3822913260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3fa415dc00 0x7f3fa415ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa259c640 1 -- 172.21.15.114:0/3822913260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3fa414edb0 msgr2=0x7f3fa415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa259c640 1 --2- 172.21.15.114:0/3822913260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3fa414edb0 0x7f3fa415d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa259c640 1 -- 172.21.15.114:0/3822913260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3fa415dc00 msgr2=0x7f3fa415ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa259c640 1 --2- 172.21.15.114:0/3822913260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3fa415dc00 0x7f3fa415ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa259c640 1 -- 172.21.15.114:0/3822913260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa40b42e0 con 0x7f3f8c0047c0 2023-11-04T01:36:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa2d9d640 1 --2- 172.21.15.114:0/3822913260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3fa415dc00 0x7f3fa415ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa259c640 1 --2- 172.21.15.114:0/3822913260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f8c0047c0 0x7f3fa414f930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400f430 tx=0x7f3f9400f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3f92ffd640 1 -- 172.21.15.114:0/3822913260 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400e040 con 0x7f3f8c0047c0 2023-11-04T01:36:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3f92ffd640 1 -- 172.21.15.114:0/3822913260 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9400f040 con 0x7f3f8c0047c0 2023-11-04T01:36:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa8bb6640 1 -- 172.21.15.114:0/3822913260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa40b45c0 con 0x7f3f8c0047c0 2023-11-04T01:36:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3f92ffd640 1 -- 172.21.15.114:0/3822913260 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94003db0 con 0x7f3f8c0047c0 2023-11-04T01:36:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.689+0000 7f3fa8bb6640 1 -- 172.21.15.114:0/3822913260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa414fe70 con 0x7f3f8c0047c0 2023-11-04T01:36:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.691+0000 7f3f92ffd640 1 -- 172.21.15.114:0/3822913260 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3f94015640 con 0x7f3f8c0047c0 2023-11-04T01:36:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.691+0000 7f3f92ffd640 1 --2- 172.21.15.114:0/3822913260 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3f8406ae70 0x7f3f8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.691+0000 7f3fa1d9b640 1 --2- 172.21.15.114:0/3822913260 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3f8406ae70 0x7f3f8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.691+0000 7f3f92ffd640 1 -- 172.21.15.114:0/3822913260 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3f9408a680 con 0x7f3f8c0047c0 2023-11-04T01:36:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.691+0000 7f3fa1d9b640 1 --2- 172.21.15.114:0/3822913260 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3f8406ae70 0x7f3f8406d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f98034000 tx=0x7f3f98009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.692+0000 7f3fab826740 1 Processor -- start 2023-11-04T01:36:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.692+0000 7f3fab826740 1 -- start start 2023-11-04T01:36:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.693+0000 7f3fab826740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x558865021850 0x558864ff4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.693+0000 7f3fab826740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558865021c30 0x5588650245e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.693+0000 7f3fab826740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558864ff4c90 0x558865024b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.693+0000 7f3fab826740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558864f05740 con 0x558865021c30 2023-11-04T01:36:37.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.693+0000 7f3fab826740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x558864f678d0 con 0x558864ff4c90 2023-11-04T01:36:37.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.693+0000 7f3fab826740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x558864f64fc0 con 0x558865021850 2023-11-04T01:36:37.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.693+0000 7f3fa1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558865021c30 0x5588650245e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.693+0000 7f3fa1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558865021c30 0x5588650245e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48690/0 (socket says 172.21.15.114:48690) 2023-11-04T01:36:37.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.693+0000 7f3fa1d9b640 1 -- 172.21.15.114:0/2827638803 learned_addr learned my addr 172.21.15.114:0/2827638803 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:37.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.693+0000 7f3fa1d9b640 1 -- 172.21.15.114:0/2827638803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x558865021850 msgr2=0x558864ff4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:37.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.693+0000 7f3fa1d9b640 1 --2- 172.21.15.114:0/2827638803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x558865021850 0x558864ff4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.693+0000 7f3fa1d9b640 1 -- 172.21.15.114:0/2827638803 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558864ff4c90 msgr2=0x558865024b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:37.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.693+0000 7f3fa1d9b640 1 --2- 172.21.15.114:0/2827638803 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558864ff4c90 0x558865024b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.693+0000 7f3fa1d9b640 1 -- 172.21.15.114:0/2827638803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558864f23ca0 con 0x558865021c30 2023-11-04T01:36:37.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.693+0000 7f3fa1d9b640 1 --2- 172.21.15.114:0/2827638803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558865021c30 0x5588650245e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3f9802c4e0 tx=0x7f3f98007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14df289e3a4b3061 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.693+0000 7f3f83fff640 1 -- 172.21.15.114:0/2827638803 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98001430 con 0x558865021c30 2023-11-04T01:36:37.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.694+0000 7f3f83fff640 1 -- 172.21.15.114:0/2827638803 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9803d040 con 0x558865021c30 2023-11-04T01:36:37.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.694+0000 7f3f83fff640 1 -- 172.21.15.114:0/2827638803 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98007070 con 0x558865021c30 2023-11-04T01:36:37.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.694+0000 7f3fab826740 1 -- 172.21.15.114:0/2827638803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558865021c30 msgr2=0x5588650245e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.694+0000 7f3fab826740 1 --2- 172.21.15.114:0/2827638803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558865021c30 0x5588650245e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3f9802c4e0 tx=0x7f3f98007000 comp rx=0 tx=0).stop 2023-11-04T01:36:37.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.694+0000 7f3fab826740 1 -- 172.21.15.114:0/2827638803 shutdown_connections 2023-11-04T01:36:37.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.694+0000 7f3fab826740 1 --2- 172.21.15.114:0/2827638803 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558864ff4c90 0x558865024b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.694+0000 7f3fab826740 1 --2- 172.21.15.114:0/2827638803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558865021c30 0x5588650245e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.694+0000 7f3fab826740 1 --2- 172.21.15.114:0/2827638803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x558865021850 0x558864ff4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.694+0000 7f3fab826740 1 -- 172.21.15.114:0/2827638803 >> 172.21.15.114:0/2827638803 conn(0x558864ff6a60 msgr2=0x55886503f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:37.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.694+0000 7f3fab826740 1 -- 172.21.15.114:0/2827638803 shutdown_connections 2023-11-04T01:36:37.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.694+0000 7f3fab826740 1 -- 172.21.15.114:0/2827638803 wait complete. 2023-11-04T01:36:37.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.695+0000 7f3fab826740 1 -- start start 2023-11-04T01:36:37.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.695+0000 7f3fab826740 1 Processor -- start 2023-11-04T01:36:37.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fab826740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558865021850 0x558865015dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fab826740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x558865021c30 0x558865052d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fab826740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588650532d0 0x558864ff34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fab826740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558864f608b0 con 0x5588650532d0 2023-11-04T01:36:37.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fab826740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x558864f1ac80 con 0x558865021850 2023-11-04T01:36:37.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fab826740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x558864f1a920 con 0x558865021c30 2023-11-04T01:36:37.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fab826740 10 client.0 _ll_register_callbacks cb 0x558864c72ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:36:37.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fa2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588650532d0 0x558864ff34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fa2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588650532d0 0x558864ff34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48696/0 (socket says 172.21.15.114:48696) 2023-11-04T01:36:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fa2d9d640 1 -- 172.21.15.114:0/32258798 learned_addr learned my addr 172.21.15.114:0/32258798 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fa259c640 1 --2- 172.21.15.114:0/32258798 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558865021850 0x558865015dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fa1d9b640 1 --2- 172.21.15.114:0/32258798 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x558865021c30 0x558865052d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fa2d9d640 1 -- 172.21.15.114:0/32258798 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x558865021c30 msgr2=0x558865052d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fa2d9d640 1 --2- 172.21.15.114:0/32258798 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x558865021c30 0x558865052d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fa2d9d640 1 -- 172.21.15.114:0/32258798 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558865021850 msgr2=0x558865015dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fa2d9d640 1 --2- 172.21.15.114:0/32258798 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558865021850 0x558865015dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fa2d9d640 1 -- 172.21.15.114:0/32258798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8c003520 con 0x5588650532d0 2023-11-04T01:36:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fa2d9d640 1 --2- 172.21.15.114:0/32258798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588650532d0 0x558864ff34f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40669d0 tx=0x7f3f9c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd50c8198fe4103 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3f817fa640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:36:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3f817fa640 1 -- 172.21.15.114:0/32258798 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0019d0 con 0x5588650532d0 2023-11-04T01:36:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3f817fa640 1 -- 172.21.15.114:0/32258798 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3f9c001b30 con 0x5588650532d0 2023-11-04T01:36:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.696+0000 7f3fab826740 1 -- 172.21.15.114:0/32258798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558864f0cbf0 con 0x5588650532d0 2023-11-04T01:36:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.697+0000 7f3f817fa640 1 -- 172.21.15.114:0/32258798 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f9c001cf0 con 0x5588650532d0 2023-11-04T01:36:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.697+0000 7f3fab826740 10 client.4434 fetch_fsmap learned FSMap version 7 2023-11-04T01:36:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.697+0000 7f3fab826740 1 -- 172.21.15.114:0/32258798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x558864f5ef30 con 0x5588650532d0 2023-11-04T01:36:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.697+0000 7f3f817fa640 1 -- 172.21.15.114:0/32258798 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558864f0cbf0 con 0x5588650532d0 2023-11-04T01:36:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.697+0000 7f3f817fa640 1 -- 172.21.15.114:0/32258798 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f3f9c014400 con 0x5588650532d0 2023-11-04T01:36:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.697+0000 7f3fab826740 10 client.4434 fetch_fsmap finished waiting for FSMap version 7 2023-11-04T01:36:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.697+0000 7f3fab826740 10 client.4434 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:36:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.697+0000 7f3fab826740 20 client.4434 populate_metadata read hostname 'smithi114' 2023-11-04T01:36:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.697+0000 7f3fab826740 1 --2- 172.21.15.114:0/32258798 >> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] conn(0x558865026620 0x558865026a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.697+0000 7f3fab826740 4 client.4434 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:36:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.697+0000 7f3fab826740 1 -- 172.21.15.114:0/32258798 --> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558864f59890 con 0x558865026620 2023-11-04T01:36:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.697+0000 7f3fa259c640 1 --2- 172.21.15.114:0/32258798 >> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] conn(0x558865026620 0x558865026a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.698+0000 7f3fa259c640 1 --2- 172.21.15.114:0/32258798 >> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] conn(0x558865026620 0x558865026a00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e195ceecde348f64 server_cookie=aead9b5954b074bd in_seq=0 out_seq=0 2023-11-04T01:36:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.698+0000 7f3f817fa640 10 client.4434 ms_handle_connect on v2:172.21.15.141:6833/4231924170 2023-11-04T01:36:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.698+0000 7f3f817fa640 1 -- 172.21.15.114:0/32258798 <== mds.0 v2:172.21.15.141:6833/4231924170 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558864f59890 con 0x558865026620 2023-11-04T01:36:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.698+0000 7f3f817fa640 10 client.4434 handle_command_reply: tid=0 2023-11-04T01:36:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.698+0000 7f3fab826740 1 client.4434 shutdown 2023-11-04T01:36:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.698+0000 7f3fab826740 1 -- 172.21.15.114:0/32258798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588650532d0 msgr2=0x558864ff34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.698+0000 7f3fab826740 1 --2- 172.21.15.114:0/32258798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588650532d0 0x558864ff34f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40669d0 tx=0x7f3f9c003d40 comp rx=0 tx=0).stop 2023-11-04T01:36:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.698+0000 7f3fab826740 1 -- 172.21.15.114:0/32258798 shutdown_connections 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.698+0000 7f3fab826740 1 --2- 172.21.15.114:0/32258798 >> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] conn(0x558865026620 0x558865026a00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.698+0000 7f3fab826740 1 --2- 172.21.15.114:0/32258798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588650532d0 0x558864ff34f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.698+0000 7f3fab826740 1 --2- 172.21.15.114:0/32258798 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x558865021c30 0x558865052d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.698+0000 7f3fab826740 1 --2- 172.21.15.114:0/32258798 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558865021850 0x558865015dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.698+0000 7f3f817fa640 0 client.4434 ms_handle_reset on v2:172.21.15.141:6833/4231924170 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.698+0000 7f3fab826740 1 -- 172.21.15.114:0/32258798 >> 172.21.15.114:0/32258798 conn(0x558864ff4c90 msgr2=0x5588650432f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.698+0000 7f3fab826740 1 -- 172.21.15.114:0/32258798 shutdown_connections 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.699+0000 7f3fab826740 1 -- 172.21.15.114:0/32258798 wait complete. 2023-11-04T01:36:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.699+0000 7f3fab826740 20 client.4434 trim_cache size 0 max 16384 2023-11-04T01:36:37.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.714+0000 7f3fab826740 1 Processor -- start 2023-11-04T01:36:37.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.714+0000 7f3fab826740 1 -- start start 2023-11-04T01:36:37.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3fab826740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558865021850 0x558865052910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3fab826740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558865021c30 0x558865034f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3fab826740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5588650532d0 0x5588650354b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3fab826740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558864ee0280 con 0x558865021c30 2023-11-04T01:36:37.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3fab826740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x558865036190 con 0x558865021850 2023-11-04T01:36:37.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3fab826740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x558864ff5870 con 0x5588650532d0 2023-11-04T01:36:37.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3fa1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558865021c30 0x558865034f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3fa1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558865021c30 0x558865034f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48700/0 (socket says 172.21.15.114:48700) 2023-11-04T01:36:37.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3fa1d9b640 1 -- 172.21.15.114:0/1933511113 learned_addr learned my addr 172.21.15.114:0/1933511113 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:37.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3fa1d9b640 1 -- 172.21.15.114:0/1933511113 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5588650532d0 msgr2=0x5588650354b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:37.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3fa1d9b640 1 --2- 172.21.15.114:0/1933511113 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5588650532d0 0x5588650354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3fa1d9b640 1 -- 172.21.15.114:0/1933511113 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558865021850 msgr2=0x558865052910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:37.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3fa259c640 1 --2- 172.21.15.114:0/1933511113 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558865021850 0x558865052910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3fa1d9b640 1 --2- 172.21.15.114:0/1933511113 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558865021850 0x558865052910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3fa1d9b640 1 -- 172.21.15.114:0/1933511113 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558864efcd10 con 0x558865021c30 2023-11-04T01:36:37.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3fa1d9b640 1 --2- 172.21.15.114:0/1933511113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558865021c30 0x558865034f70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f9804e040 tx=0x7f3f9803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f7693e34622f69 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3f90ff9640 1 -- 172.21.15.114:0/1933511113 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98001630 con 0x558865021c30 2023-11-04T01:36:37.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3f90ff9640 1 -- 172.21.15.114:0/1933511113 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f980070c0 con 0x558865021c30 2023-11-04T01:36:37.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.715+0000 7f3f90ff9640 1 -- 172.21.15.114:0/1933511113 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98007430 con 0x558865021c30 2023-11-04T01:36:37.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.716+0000 7f3fab826740 1 -- 172.21.15.114:0/1933511113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558865021c30 msgr2=0x558865034f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.716+0000 7f3fab826740 1 --2- 172.21.15.114:0/1933511113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558865021c30 0x558865034f70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f9804e040 tx=0x7f3f9803f000 comp rx=0 tx=0).stop 2023-11-04T01:36:37.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.716+0000 7f3fab826740 1 -- 172.21.15.114:0/1933511113 shutdown_connections 2023-11-04T01:36:37.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.716+0000 7f3fab826740 1 --2- 172.21.15.114:0/1933511113 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5588650532d0 0x5588650354b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.716+0000 7f3fab826740 1 --2- 172.21.15.114:0/1933511113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558865021c30 0x558865034f70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.716+0000 7f3fab826740 1 --2- 172.21.15.114:0/1933511113 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558865021850 0x558865052910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.716+0000 7f3fab826740 1 -- 172.21.15.114:0/1933511113 >> 172.21.15.114:0/1933511113 conn(0x558864ff4c90 msgr2=0x5588650245d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:37.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.716+0000 7f3fab826740 1 -- 172.21.15.114:0/1933511113 shutdown_connections 2023-11-04T01:36:37.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.716+0000 7f3fab826740 1 -- 172.21.15.114:0/1933511113 wait complete. 2023-11-04T01:36:37.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.716+0000 7f3fab826740 1 -- start start 2023-11-04T01:36:37.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.717+0000 7f3fab826740 1 Processor -- start 2023-11-04T01:36:37.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.717+0000 7f3fab826740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558865021850 0x55886503a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.717+0000 7f3fab826740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x558865021c30 0x5588650a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.717+0000 7f3fab826740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588650532d0 0x558865062400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.717+0000 7f3fab826740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55886503d250 con 0x5588650532d0 2023-11-04T01:36:37.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.717+0000 7f3fab826740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x558864ff9bf0 con 0x558865021850 2023-11-04T01:36:37.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.717+0000 7f3fab826740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55886503ceb0 con 0x558865021c30 2023-11-04T01:36:37.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.717+0000 7f3fab826740 10 client.0 _ll_register_callbacks cb 0x7f3f8c0036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:36:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fa2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588650532d0 0x558865062400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fa2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588650532d0 0x558865062400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48706/0 (socket says 172.21.15.114:48706) 2023-11-04T01:36:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fa2d9d640 1 -- 172.21.15.114:0/2088235367 learned_addr learned my addr 172.21.15.114:0/2088235367 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fa259c640 1 --2- 172.21.15.114:0/2088235367 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558865021850 0x55886503a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fa1d9b640 1 --2- 172.21.15.114:0/2088235367 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x558865021c30 0x5588650a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fa2d9d640 1 -- 172.21.15.114:0/2088235367 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x558865021c30 msgr2=0x5588650a3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fa2d9d640 1 --2- 172.21.15.114:0/2088235367 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x558865021c30 0x5588650a3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fa2d9d640 1 -- 172.21.15.114:0/2088235367 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558865021850 msgr2=0x55886503a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:37.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fa2d9d640 1 --2- 172.21.15.114:0/2088235367 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558865021850 0x55886503a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fa2d9d640 1 -- 172.21.15.114:0/2088235367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558864f23ca0 con 0x5588650532d0 2023-11-04T01:36:37.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fa259c640 1 --2- 172.21.15.114:0/2088235367 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558865021850 0x55886503a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:37.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fa2d9d640 1 --2- 172.21.15.114:0/2088235367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588650532d0 0x558865062400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c017040 tx=0x7f3f9c001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b758755145c16b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3f817fa640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:36:37.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3f817fa640 1 -- 172.21.15.114:0/2088235367 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0019d0 con 0x5588650532d0 2023-11-04T01:36:37.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3f817fa640 1 -- 172.21.15.114:0/2088235367 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3f9c02dde0 con 0x5588650532d0 2023-11-04T01:36:37.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fab826740 1 -- 172.21.15.114:0/2088235367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f9803d040 con 0x5588650532d0 2023-11-04T01:36:37.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3f817fa640 1 -- 172.21.15.114:0/2088235367 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f9c001660 con 0x5588650532d0 2023-11-04T01:36:37.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fab826740 10 client.4440 fetch_fsmap learned FSMap version 7 2023-11-04T01:36:37.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fab826740 1 -- 172.21.15.114:0/2088235367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x558864f22500 con 0x5588650532d0 2023-11-04T01:36:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3f817fa640 1 -- 172.21.15.114:0/2088235367 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9803d040 con 0x5588650532d0 2023-11-04T01:36:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3f817fa640 1 -- 172.21.15.114:0/2088235367 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f3f9c001b30 con 0x5588650532d0 2023-11-04T01:36:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fab826740 10 client.4440 fetch_fsmap finished waiting for FSMap version 7 2023-11-04T01:36:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fab826740 10 client.4440 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:36:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fab826740 20 client.4440 populate_metadata read hostname 'smithi114' 2023-11-04T01:36:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.718+0000 7f3fab826740 1 --2- 172.21.15.114:0/2088235367 >> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] conn(0x55886503e020 0x55886503e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3fab826740 4 client.4440 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:36:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3fab826740 1 -- 172.21.15.114:0/2088235367 --> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558864f595b0 con 0x55886503e020 2023-11-04T01:36:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3fa259c640 1 --2- 172.21.15.114:0/2088235367 >> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] conn(0x55886503e020 0x55886503e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3fa259c640 1 --2- 172.21.15.114:0/2088235367 >> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] conn(0x55886503e020 0x55886503e400 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38791324c7cc34ec server_cookie=595ee0db627eb438 in_seq=0 out_seq=0 2023-11-04T01:36:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3f817fa640 10 client.4440 ms_handle_connect on v2:172.21.15.141:6833/4231924170 2023-11-04T01:36:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3f817fa640 1 -- 172.21.15.114:0/2088235367 <== mds.0 v2:172.21.15.141:6833/4231924170 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x558864f595b0 con 0x55886503e020 2023-11-04T01:36:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3f817fa640 10 client.4440 handle_command_reply: tid=0 2023-11-04T01:36:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3fab826740 1 client.4440 shutdown 2023-11-04T01:36:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3fab826740 1 -- 172.21.15.114:0/2088235367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588650532d0 msgr2=0x558865062400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3fab826740 1 --2- 172.21.15.114:0/2088235367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588650532d0 0x558865062400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c017040 tx=0x7f3f9c001190 comp rx=0 tx=0).stop 2023-11-04T01:36:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3fab826740 1 -- 172.21.15.114:0/2088235367 shutdown_connections 2023-11-04T01:36:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3fab826740 1 --2- 172.21.15.114:0/2088235367 >> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] conn(0x55886503e020 0x55886503e400 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3fab826740 1 --2- 172.21.15.114:0/2088235367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5588650532d0 0x558865062400 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3fab826740 1 --2- 172.21.15.114:0/2088235367 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x558865021c30 0x5588650a3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3f817fa640 0 client.4440 ms_handle_reset on v2:172.21.15.141:6833/4231924170 2023-11-04T01:36:37.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3fab826740 1 --2- 172.21.15.114:0/2088235367 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x558865021850 0x55886503a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.719+0000 7f3fab826740 1 -- 172.21.15.114:0/2088235367 >> 172.21.15.114:0/2088235367 conn(0x558864ff4c90 msgr2=0x558865026a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:37.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.720+0000 7f3fab826740 1 -- 172.21.15.114:0/2088235367 shutdown_connections 2023-11-04T01:36:37.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.720+0000 7f3fab826740 1 -- 172.21.15.114:0/2088235367 wait complete. 2023-11-04T01:36:37.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.720+0000 7f3fab826740 20 client.4440 trim_cache size 0 max 16384 2023-11-04T01:36:37.749 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:36:37.749 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:36:37.749 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-11-04T01:36:37.749 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4305, 2023-11-04T01:36:37.749 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:36:37.749 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:36:37.749 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:36:37.749 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 7.1523697430000004, 2023-11-04T01:36:37.749 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 7, 2023-11-04T01:36:37.749 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 24, 2023-11-04T01:36:37.749 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 24, 2023-11-04T01:36:37.749 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 14.149820852 2023-11-04T01:36:37.750 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:36:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.720+0000 7f3fa8bb6640 1 -- 172.21.15.114:0/3822913260 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3f8406ae70 msgr2=0x7f3f8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.720+0000 7f3fa8bb6640 1 --2- 172.21.15.114:0/3822913260 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3f8406ae70 0x7f3f8406d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f98034000 tx=0x7f3f98009030 comp rx=0 tx=0).stop 2023-11-04T01:36:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.720+0000 7f3fa8bb6640 1 -- 172.21.15.114:0/3822913260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f8c0047c0 msgr2=0x7f3fa414f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.720+0000 7f3fa8bb6640 1 --2- 172.21.15.114:0/3822913260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f8c0047c0 0x7f3fa414f930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400f430 tx=0x7f3f9400f8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.720+0000 7f3fa8bb6640 1 -- 172.21.15.114:0/3822913260 shutdown_connections 2023-11-04T01:36:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.720+0000 7f3fa8bb6640 1 --2- 172.21.15.114:0/3822913260 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3f8406ae70 0x7f3f8406d330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.720+0000 7f3fa8bb6640 1 --2- 172.21.15.114:0/3822913260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3fa415dc00 0x7f3fa415ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.720+0000 7f3fa8bb6640 1 --2- 172.21.15.114:0/3822913260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3fa414edb0 0x7f3fa415d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.720+0000 7f3fa8bb6640 1 --2- 172.21.15.114:0/3822913260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f8c0047c0 0x7f3fa414f930 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.720+0000 7f3fa8bb6640 1 -- 172.21.15.114:0/3822913260 >> 172.21.15.114:0/3822913260 conn(0x7f3fa4071820 msgr2=0x7f3fa40c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:37.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.720+0000 7f3fa8bb6640 1 -- 172.21.15.114:0/3822913260 shutdown_connections 2023-11-04T01:36:37.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.720+0000 7f3fa8bb6640 1 -- 172.21.15.114:0/3822913260 wait complete. 2023-11-04T01:36:37.752 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:36:37.752 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:37.752 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:36:37.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.849+0000 7fb174c4b640 1 Processor -- start 2023-11-04T01:36:37.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.850+0000 7fb174c4b640 1 -- start start 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.850+0000 7fb174c4b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb17015ce70 0x7fb17006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.850+0000 7fb174c4b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb17015d250 0x7fb1700c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.850+0000 7fb174c4b640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17006a120 con 0x7fb1700c9d70 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.850+0000 7fb174c4b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1700cdc10 con 0x7fb17015ce70 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.850+0000 7fb174c4b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17006def0 con 0x7fb17015d250 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.851+0000 7fb16e59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb17015ce70 0x7fb17006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.851+0000 7fb16e59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb17015ce70 0x7fb17006d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48710/0 (socket says 172.21.15.114:48710) 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.851+0000 7fb16e59c640 1 -- 172.21.15.114:0/1792558702 learned_addr learned my addr 172.21.15.114:0/1792558702 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.851+0000 7fb16dd9b640 1 --2- 172.21.15.114:0/1792558702 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb17015d250 0x7fb1700c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.851+0000 7fb16e59c640 1 -- 172.21.15.114:0/1792558702 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb17015d250 msgr2=0x7fb1700c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:37.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.851+0000 7fb16e59c640 1 --2- 172.21.15.114:0/1792558702 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb17015d250 0x7fb1700c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.851+0000 7fb16e59c640 1 -- 172.21.15.114:0/1792558702 >> v1:172.21.15.141:6789/0 conn(0x7fb1700c9d70 legacy=0x7fb1700ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.851+0000 7fb16e59c640 1 -- 172.21.15.114:0/1792558702 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17006a370 con 0x7fb17015ce70 2023-11-04T01:36:37.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.852+0000 7fb16e59c640 1 --2- 172.21.15.114:0/1792558702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17015ce70 0x7fb17006d9b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb158009870 tx=0x7fb15802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576a6756b7a4c46a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.852+0000 7fb16d59a640 1 -- 172.21.15.114:0/1792558702 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158030840 con 0x7fb17015ce70 2023-11-04T01:36:37.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.852+0000 7fb16d59a640 1 -- 172.21.15.114:0/1792558702 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1580309a0 con 0x7fb17015ce70 2023-11-04T01:36:37.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.852+0000 7fb16d59a640 1 -- 172.21.15.114:0/1792558702 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158030d30 con 0x7fb17015ce70 2023-11-04T01:36:37.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.852+0000 7fb174c4b640 1 -- 172.21.15.114:0/1792558702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17015ce70 msgr2=0x7fb17006d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.852+0000 7fb174c4b640 1 --2- 172.21.15.114:0/1792558702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17015ce70 0x7fb17006d9b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb158009870 tx=0x7fb15802b980 comp rx=0 tx=0).stop 2023-11-04T01:36:37.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.852+0000 7fb174c4b640 1 -- 172.21.15.114:0/1792558702 shutdown_connections 2023-11-04T01:36:37.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.852+0000 7fb174c4b640 1 --2- 172.21.15.114:0/1792558702 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb17015d250 0x7fb1700c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.852+0000 7fb174c4b640 1 --2- 172.21.15.114:0/1792558702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17015ce70 0x7fb17006d9b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.852+0000 7fb174c4b640 1 -- 172.21.15.114:0/1792558702 >> 172.21.15.114:0/1792558702 conn(0x7fb1700b0cd0 msgr2=0x7fb1700b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:37.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.852+0000 7fb174c4b640 1 -- 172.21.15.114:0/1792558702 shutdown_connections 2023-11-04T01:36:37.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.852+0000 7fb174c4b640 1 -- 172.21.15.114:0/1792558702 wait complete. 2023-11-04T01:36:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.854+0000 7fb174c4b640 1 Processor -- start 2023-11-04T01:36:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.854+0000 7fb174c4b640 1 -- start start 2023-11-04T01:36:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.854+0000 7fb174c4b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17015ce70 0x7fb1700c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.854+0000 7fb174c4b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb17015d250 0x7fb1700c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.854+0000 7fb174c4b640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb170146c60 0x7fb1701470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.854+0000 7fb174c4b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb170147990 con 0x7fb17015ce70 2023-11-04T01:36:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.854+0000 7fb174c4b640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb170147c70 con 0x7fb170146c60 2023-11-04T01:36:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.854+0000 7fb174c4b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb170147f50 con 0x7fb17015d250 2023-11-04T01:36:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.855+0000 7fb16e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17015ce70 0x7fb1700c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.855+0000 7fb16e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17015ce70 0x7fb1700c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48726/0 (socket says 172.21.15.114:48726) 2023-11-04T01:36:37.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.855+0000 7fb16e59c640 1 -- 172.21.15.114:0/2291386344 learned_addr learned my addr 172.21.15.114:0/2291386344 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:37.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.855+0000 7fb16dd9b640 1 --2- 172.21.15.114:0/2291386344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb17015d250 0x7fb1700c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.855+0000 7fb16ed9d640 1 --2- 172.21.15.114:0/2291386344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb170146c60 0x7fb1701470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.855+0000 7fb16e59c640 1 -- 172.21.15.114:0/2291386344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb17015d250 msgr2=0x7fb1700c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.855+0000 7fb16e59c640 1 --2- 172.21.15.114:0/2291386344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb17015d250 0x7fb1700c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.855+0000 7fb16e59c640 1 -- 172.21.15.114:0/2291386344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb170146c60 msgr2=0x7fb1701470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:37.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.855+0000 7fb16e59c640 1 --2- 172.21.15.114:0/2291386344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb170146c60 0x7fb1701470f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:37.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.855+0000 7fb16e59c640 1 -- 172.21.15.114:0/2291386344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1580094d0 con 0x7fb17015ce70 2023-11-04T01:36:37.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.855+0000 7fb16e59c640 1 --2- 172.21.15.114:0/2291386344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17015ce70 0x7fb1700c7db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb158000c00 tx=0x7fb158004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.855+0000 7fb166ffd640 1 -- 172.21.15.114:0/2291386344 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158039c90 con 0x7fb17015ce70 2023-11-04T01:36:37.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.855+0000 7fb166ffd640 1 -- 172.21.15.114:0/2291386344 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb158039df0 con 0x7fb17015ce70 2023-11-04T01:36:37.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.855+0000 7fb166ffd640 1 -- 172.21.15.114:0/2291386344 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158043640 con 0x7fb17015ce70 2023-11-04T01:36:37.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.855+0000 7fb174c4b640 1 -- 172.21.15.114:0/2291386344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb170148230 con 0x7fb17015ce70 2023-11-04T01:36:37.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.855+0000 7fb174c4b640 1 -- 172.21.15.114:0/2291386344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb170147630 con 0x7fb17015ce70 2023-11-04T01:36:37.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.856+0000 7fb174c4b640 1 -- 172.21.15.114:0/2291386344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb170074290 con 0x7fb17015ce70 2023-11-04T01:36:37.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.856+0000 7fb166ffd640 1 -- 172.21.15.114:0/2291386344 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1580437a0 con 0x7fb17015ce70 2023-11-04T01:36:37.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.857+0000 7fb166ffd640 1 --2- 172.21.15.114:0/2291386344 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb15006ae70 0x7fb15006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:37.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.857+0000 7fb166ffd640 1 -- 172.21.15.114:0/2291386344 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb15803e070 con 0x7fb17015ce70 2023-11-04T01:36:37.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.857+0000 7fb16dd9b640 1 --2- 172.21.15.114:0/2291386344 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb15006ae70 0x7fb15006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:37.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.857+0000 7fb16dd9b640 1 --2- 172.21.15.114:0/2291386344 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb15006ae70 0x7fb15006d330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1701e5b40 tx=0x7fb160008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:37.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:37.861+0000 7fb166ffd640 1 -- 172.21.15.114:0/2291386344 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb158077760 con 0x7fb17015ce70 2023-11-04T01:36:38.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:38.066+0000 7fb174c4b640 1 -- 172.21.15.114:0/2291386344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb17015cc50 con 0x7fb17015ce70 2023-11-04T01:36:38.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:38.066+0000 7fb166ffd640 1 -- 172.21.15.114:0/2291386344 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb15807ad80 con 0x7fb17015ce70 2023-11-04T01:36:38.069 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:36:38.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:38.068+0000 7fb174c4b640 1 -- 172.21.15.114:0/2291386344 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb15006ae70 msgr2=0x7fb15006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:38.068+0000 7fb174c4b640 1 --2- 172.21.15.114:0/2291386344 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb15006ae70 0x7fb15006d330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1701e5b40 tx=0x7fb160008040 comp rx=0 tx=0).stop 2023-11-04T01:36:38.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:38.068+0000 7fb174c4b640 1 -- 172.21.15.114:0/2291386344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17015ce70 msgr2=0x7fb1700c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:38.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:38.068+0000 7fb174c4b640 1 --2- 172.21.15.114:0/2291386344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17015ce70 0x7fb1700c7db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb158000c00 tx=0x7fb158004730 comp rx=0 tx=0).stop 2023-11-04T01:36:38.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:38.068+0000 7fb174c4b640 1 -- 172.21.15.114:0/2291386344 shutdown_connections 2023-11-04T01:36:38.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:38.068+0000 7fb174c4b640 1 --2- 172.21.15.114:0/2291386344 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb15006ae70 0x7fb15006d330 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:38.068+0000 7fb174c4b640 1 --2- 172.21.15.114:0/2291386344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb170146c60 0x7fb1701470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:38.068+0000 7fb174c4b640 1 --2- 172.21.15.114:0/2291386344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb17015d250 0x7fb1700c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:38.068+0000 7fb174c4b640 1 --2- 172.21.15.114:0/2291386344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb17015ce70 0x7fb1700c7db0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:38.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:38.068+0000 7fb174c4b640 1 -- 172.21.15.114:0/2291386344 >> 172.21.15.114:0/2291386344 conn(0x7fb1700b0cd0 msgr2=0x7fb1700ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:38.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:38.068+0000 7fb174c4b640 1 -- 172.21.15.114:0/2291386344 shutdown_connections 2023-11-04T01:36:38.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:38.068+0000 7fb174c4b640 1 -- 172.21.15.114:0/2291386344 wait complete. 2023-11-04T01:36:38.083 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-04T01:36:38.084 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:36:38.085 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-11-04T01:36:38.085 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-04T01:36:38.085 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:38.085 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-04T01:36:38.085 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:36:38.085 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:36:38.085 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-04T01:36:38.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:38.085 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-11-04T01:36:38.110 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:36:38.110 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:36:38.110 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:36:38.110 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:38.110 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-04T01:36:38.110 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:38.110 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:38.111 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:38.111 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-11-04T01:36:38.111 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:38.111 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:38.111 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-11-04T01:36:38.111 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:36:38.111 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:38.111 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:36:38.112 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:36:38.112 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:36:38.112 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42477sec preferred_lft 42477sec 2023-11-04T01:36:38.112 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-11-04T01:36:38.112 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:36:38.113 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T01:36:38.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:38.113 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:36:38.113 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:36:38.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2023-11-04T01:36:38.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2023-11-04T01:36:38.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2023-11-04T01:36:38.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T01:36:38.113 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:36:38.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:38.284 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:36:38.311 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-11-04T01:36:38.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:38.313 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-11-04T01:36:38.379 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-11-04T01:36:38.379 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:36:38.379 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:36:38.379 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:36:38.379 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:36:38.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:38.380 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:36:38.380 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:36:38.380 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:36:38.380 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:36:38.380 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:36:38.380 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:36:38.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:38.643 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-04T01:36:38.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:38.659 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2023-11-04T01:36:38.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:38.716 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:36:38.716 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:36:38.716 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:38.716 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-04T01:36:38.716 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:36:38.797 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-04T01:36:38.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:38.798 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:36:38.798 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:36:38.798 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-04T01:36:38.798 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T01:36:38.798 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-04T01:36:38.798 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-04T01:36:38.798 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-04T01:36:38.798 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:36:38.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:38.992 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:36:38.992 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:36:38.992 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-11-04T01:36:38.993 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T01:36:38.993 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:36:39.036 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-04T01:36:39.036 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:39.037 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:39.092 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-04T01:36:39.092 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:36:39.092 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:39.148 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:39.207 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:36:39.208 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:36:39.208 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:36:39.208 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:36:39.208 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:36:39.208 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:36:39.209 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:36:39.209 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:36:39.209 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:36:39.209 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:36:39.209 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:36:39.210 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:36:39.210 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:39.212 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:36:39.212 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:36:39.212 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:36:39.212 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:36:39.212 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:39.212 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:39.212 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:36:39.212 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:39.213 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:39.213 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:39.213 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:36:39.213 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:36:39.213 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:39.213 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:39.213 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:39.213 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:39.213 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:36:39.213 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:39.213 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:39.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:39.214 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:36:39.263 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:36:39.263 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-11-04T01:36:39.305 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:36:39.320 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:39.321 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:39.322 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:39.323 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:39.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:39.324 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:36:39.474 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi114.stderr:2023-11-04T01:36:39.472+0000 7fc6f423d480 -1 init, newargv = 0x558f18f17310 newargc=15 2023-11-04T01:36:39.475 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi114.stderr:ceph-fuse[95208]: starting ceph client 2023-11-04T01:36:39.480 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi114.stderr:ceph-fuse[95208]: starting fuse 2023-11-04T01:36:40.481 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:36:40.500 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:36:40.501 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:36:40.502 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:36:40.502 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:36:40.502 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:36:40.502 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:36:40.502 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:36:40.502 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:36:40.502 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:36:40.502 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:36:40.502 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:36:40.502 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:36:40.502 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:36:40.502 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:36:40.503 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:36:40.503 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:36:40.503 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:36:40.503 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:36:40.503 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:36:40.503 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:36:40.503 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:36:40.503 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:40.503 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:36:40.503 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:40.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:40.504 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:36:40.559 INFO:teuthology.orchestra.run.smithi114.stdout:41 2023-11-04T01:36:40.560 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:36:40.560 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:36:40.560 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2023-11-04T01:36:40.560 DEBUG:teuthology.orchestra.run.smithi114:> import re 2023-11-04T01:36:40.560 DEBUG:teuthology.orchestra.run.smithi114:> import os 2023-11-04T01:36:40.560 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2023-11-04T01:36:40.560 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:36:40.560 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2023-11-04T01:36:40.560 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-04T01:36:40.561 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2023-11-04T01:36:40.561 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-04T01:36:40.561 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:36:40.561 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2023-11-04T01:36:40.561 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2023-11-04T01:36:40.561 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2023-11-04T01:36:40.561 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2023-11-04T01:36:40.561 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:36:40.561 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2023-11-04T01:36:40.561 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:36:40.561 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:36:40.561 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:36:40.561 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2023-11-04T01:36:40.561 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2023-11-04T01:36:40.562 DEBUG:teuthology.orchestra.run.smithi114:> return f 2023-11-04T01:36:40.562 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:36:40.562 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:36:40.562 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.admin")) 2023-11-04T01:36:40.562 DEBUG:teuthology.orchestra.run.smithi114:> ' 2023-11-04T01:36:40.689 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.admin.95208.asok 2023-11-04T01:36:40.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:40.701 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.95208.asok 2023-11-04T01:36:40.701 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:40.701 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.admin.95208.asok status 2023-11-04T01:36:40.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:40.871 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:36:40.871 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2023-11-04T01:36:40.871 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:36:40.871 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:36:40.871 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "admin", 2023-11-04T01:36:40.871 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2023-11-04T01:36:40.871 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-04T01:36:40.871 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "95208", 2023-11-04T01:36:40.873 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2023-11-04T01:36:40.873 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:36:40.873 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2023-11-04T01:36:40.873 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2023-11-04T01:36:40.873 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4452, 2023-11-04T01:36:40.873 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2023-11-04T01:36:40.874 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2023-11-04T01:36:40.874 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2023-11-04T01:36:40.874 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 4452 2023-11-04T01:36:40.874 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:36:40.876 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:36:40.876 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:36:40.876 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:36:40.876 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2978528884 2023-11-04T01:36:40.876 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:36:40.876 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:36:40.876 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:36:40.876 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:36:40.876 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:36:40.877 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2978528884 2023-11-04T01:36:40.877 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:36:40.877 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.4452 192.168.0.1:0/2978528884", 2023-11-04T01:36:40.877 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "192.168.0.1:0/2978528884", 2023-11-04T01:36:40.877 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2023-11-04T01:36:40.877 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 7, 2023-11-04T01:36:40.877 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 24, 2023-11-04T01:36:40.877 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:36:40.877 INFO:teuthology.orchestra.run.smithi114.stdout: "blocklisted": false, 2023-11-04T01:36:40.877 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2023-11-04T01:36:40.877 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:36:40.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:40.885 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:40.885 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:36:40.886 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:40.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:40.945 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2023-11-04T01:36:40.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:40.952 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:40.952 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:40.952 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:41.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:41.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:41.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:41.019 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-04T01:36:41.057 INFO:teuthology.orchestra.run.smithi114.stdout:# file: . 2023-11-04T01:36:41.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-04T01:36:41.057 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:41.057 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:36:41.057 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:41.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:41.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.251+0000 7f1836d7c640 1 Processor -- start 2023-11-04T01:36:41.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.251+0000 7f1836d7c640 1 -- start start 2023-11-04T01:36:41.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.251+0000 7f1836d7c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f18300b0cd0 0x7f1830070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.251+0000 7f1836d7c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18300cde40 0x7f1830070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.251+0000 7f1836d7c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18300cc990 con 0x7f18300cda60 2023-11-04T01:36:41.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.251+0000 7f1836d7c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18300ccc70 con 0x7f18300b0cd0 2023-11-04T01:36:41.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.251+0000 7f1836d7c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18300c9ce0 con 0x7f18300cde40 2023-11-04T01:36:41.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f1834b18640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f18300cda60 0x7f18300ca7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45394/0 (socket says 172.21.15.114:45394) 2023-11-04T01:36:41.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f1834b18640 1 -- 172.21.15.114:0/3489230709 learned_addr learned my addr 172.21.15.114:0/3489230709 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:41.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f1835319640 1 --2- 172.21.15.114:0/3489230709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18300cde40 0x7f1830070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182ffff640 1 --2- 172.21.15.114:0/3489230709 >> v2:172.21.15.141:3300/0 conn(0x7f18300b0cd0 0x7f1830070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182f7fe640 1 -- 172.21.15.114:0/3489230709 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260785201 0 0) 0x7f18300cc990 con 0x7f18300cda60 2023-11-04T01:36:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182f7fe640 1 -- 172.21.15.114:0/3489230709 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1818003520 con 0x7f18300cda60 2023-11-04T01:36:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182f7fe640 1 -- 172.21.15.114:0/3489230709 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1861438505 0 0) 0x7f1818003520 con 0x7f18300cda60 2023-11-04T01:36:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182f7fe640 1 -- 172.21.15.114:0/3489230709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18300cde40 msgr2=0x7f1830070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182f7fe640 1 --2- 172.21.15.114:0/3489230709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18300cde40 0x7f1830070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182f7fe640 1 -- 172.21.15.114:0/3489230709 >> v2:172.21.15.141:3300/0 conn(0x7f18300b0cd0 msgr2=0x7f1830070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182f7fe640 1 --2- 172.21.15.114:0/3489230709 >> v2:172.21.15.141:3300/0 conn(0x7f18300b0cd0 0x7f1830070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182f7fe640 1 -- 172.21.15.114:0/3489230709 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18300c9fc0 con 0x7f18300cda60 2023-11-04T01:36:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182f7fe640 1 -- 172.21.15.114:0/3489230709 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f1820001670 con 0x7f18300cda60 2023-11-04T01:36:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182f7fe640 1 -- 172.21.15.114:0/3489230709 >> v1:172.21.15.114:6789/0 conn(0x7f18300cda60 legacy=0x7f18300ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182f7fe640 1 --2- 172.21.15.114:0/3489230709 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1818003970 0x7f1818003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182f7fe640 1 --2- 172.21.15.114:0/3489230709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18180047c0 0x7f1818004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182f7fe640 1 --2- 172.21.15.114:0/3489230709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18300cde40 0x7f1818005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182f7fe640 1 -- 172.21.15.114:0/3489230709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18300ccc70 con 0x7f18180047c0 2023-11-04T01:36:41.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182f7fe640 1 -- 172.21.15.114:0/3489230709 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18300c9ce0 con 0x7f1818003970 2023-11-04T01:36:41.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182f7fe640 1 -- 172.21.15.114:0/3489230709 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181800b980 con 0x7f18300cde40 2023-11-04T01:36:41.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182ffff640 1 --2- 172.21.15.114:0/3489230709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18180047c0 0x7f1818004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f1834b18640 1 --2- 172.21.15.114:0/3489230709 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1818003970 0x7f1818003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f1835319640 1 --2- 172.21.15.114:0/3489230709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18300cde40 0x7f1818005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.252+0000 7f182ffff640 1 -- 172.21.15.114:0/3489230709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18300cde40 msgr2=0x7f1818005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.253+0000 7f182ffff640 1 --2- 172.21.15.114:0/3489230709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f18300cde40 0x7f1818005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.253+0000 7f182ffff640 1 -- 172.21.15.114:0/3489230709 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1818003970 msgr2=0x7f1818003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.253+0000 7f182ffff640 1 --2- 172.21.15.114:0/3489230709 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1818003970 0x7f1818003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.253+0000 7f182ffff640 1 -- 172.21.15.114:0/3489230709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1818003520 con 0x7f18180047c0 2023-11-04T01:36:41.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.253+0000 7f182ffff640 1 --2- 172.21.15.114:0/3489230709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18180047c0 0x7f1818004c40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1824009a90 tx=0x7f18180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a25176529e463e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.253+0000 7f182f7fe640 1 -- 172.21.15.114:0/3489230709 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182402c6b0 con 0x7f18180047c0 2023-11-04T01:36:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.253+0000 7f182f7fe640 1 -- 172.21.15.114:0/3489230709 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182402c810 con 0x7f18180047c0 2023-11-04T01:36:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.253+0000 7f182f7fe640 1 -- 172.21.15.114:0/3489230709 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182402cba0 con 0x7f18180047c0 2023-11-04T01:36:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.254+0000 7f1836d7c640 1 -- 172.21.15.114:0/3489230709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18180047c0 msgr2=0x7f1818004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.254+0000 7f1836d7c640 1 --2- 172.21.15.114:0/3489230709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18180047c0 0x7f1818004c40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1824009a90 tx=0x7f18180057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.254+0000 7f1835319640 1 -- 172.21.15.114:0/3489230709 reap_dead start 2023-11-04T01:36:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.254+0000 7f1836d7c640 1 -- 172.21.15.114:0/3489230709 shutdown_connections 2023-11-04T01:36:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.254+0000 7f1836d7c640 1 -- 172.21.15.114:0/3489230709 >> 172.21.15.114:0/3489230709 conn(0x7f18300ce950 msgr2=0x7f18300ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.254+0000 7f1836d7c640 1 -- 172.21.15.114:0/3489230709 shutdown_connections 2023-11-04T01:36:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.254+0000 7f1836d7c640 1 -- 172.21.15.114:0/3489230709 wait complete. 2023-11-04T01:36:41.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.255+0000 7f1836d7c640 1 Processor -- start 2023-11-04T01:36:41.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.255+0000 7f1836d7c640 1 -- start start 2023-11-04T01:36:41.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.256+0000 7f1836d7c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18180047c0 0x7f1830152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.256+0000 7f1836d7c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1830153ff0 0x7f1830154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.256+0000 7f1836d7c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18301502d0 0x7f1830150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.256+0000 7f1836d7c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1830150c90 con 0x7f18301502d0 2023-11-04T01:36:41.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.256+0000 7f1836d7c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1830155070 con 0x7f18180047c0 2023-11-04T01:36:41.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.256+0000 7f1836d7c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1830154ab0 con 0x7f1830153ff0 2023-11-04T01:36:41.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.256+0000 7f1835319640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18301502d0 0x7f1830150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.256+0000 7f1835319640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18301502d0 0x7f1830150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48750/0 (socket says 172.21.15.114:48750) 2023-11-04T01:36:41.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.256+0000 7f1835319640 1 -- 172.21.15.114:0/3139835977 learned_addr learned my addr 172.21.15.114:0/3139835977 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:41.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.256+0000 7f1835319640 1 -- 172.21.15.114:0/3139835977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1830153ff0 msgr2=0x7f1830154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.256+0000 7f1835319640 1 --2- 172.21.15.114:0/3139835977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1830153ff0 0x7f1830154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.256+0000 7f1834b18640 1 --2- 172.21.15.114:0/3139835977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18180047c0 0x7f1830152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.256+0000 7f1835319640 1 -- 172.21.15.114:0/3139835977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18180047c0 msgr2=0x7f1830152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.256+0000 7f1835319640 1 --2- 172.21.15.114:0/3139835977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18180047c0 0x7f1830152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.256+0000 7f1835319640 1 -- 172.21.15.114:0/3139835977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1830154d90 con 0x7f18301502d0 2023-11-04T01:36:41.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.256+0000 7f1835319640 1 --2- 172.21.15.114:0/3139835977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18301502d0 0x7f1830150750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f183015ce70 tx=0x7f182800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.257+0000 7f182d7fa640 1 -- 172.21.15.114:0/3139835977 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182800e040 con 0x7f18301502d0 2023-11-04T01:36:41.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.257+0000 7f182d7fa640 1 -- 172.21.15.114:0/3139835977 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182800f040 con 0x7f18301502d0 2023-11-04T01:36:41.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.257+0000 7f182d7fa640 1 -- 172.21.15.114:0/3139835977 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1828015670 con 0x7f18301502d0 2023-11-04T01:36:41.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.257+0000 7f1836d7c640 1 -- 172.21.15.114:0/3139835977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1830149750 con 0x7f18301502d0 2023-11-04T01:36:41.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.257+0000 7f1836d7c640 1 -- 172.21.15.114:0/3139835977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1830152ac0 con 0x7f18301502d0 2023-11-04T01:36:41.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.258+0000 7f1836d7c640 1 -- 172.21.15.114:0/3139835977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1830074290 con 0x7f18301502d0 2023-11-04T01:36:41.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.258+0000 7f182d7fa640 1 -- 172.21.15.114:0/3139835977 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f18280157d0 con 0x7f18301502d0 2023-11-04T01:36:41.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.258+0000 7f182d7fa640 1 --2- 172.21.15.114:0/3139835977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f181c06aea0 0x7f181c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.259+0000 7f1834b18640 1 --2- 172.21.15.114:0/3139835977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f181c06aea0 0x7f181c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.259+0000 7f182d7fa640 1 -- 172.21.15.114:0/3139835977 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f182808a270 con 0x7f18301502d0 2023-11-04T01:36:41.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.259+0000 7f1834b18640 1 --2- 172.21.15.114:0/3139835977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f181c06aea0 0x7f181c06d360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f18301f4f60 tx=0x7f1820009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.263+0000 7f182d7fa640 1 -- 172.21.15.114:0/3139835977 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f18280550c0 con 0x7f18301502d0 2023-11-04T01:36:41.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.430+0000 7f1836d7c640 1 -- 172.21.15.114:0/3139835977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18300b48d0 con 0x7f18301502d0 2023-11-04T01:36:41.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.431+0000 7f182d7fa640 1 -- 172.21.15.114:0/3139835977 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18406 (secure 0 0 0) 0x7f18280586e0 con 0x7f18301502d0 2023-11-04T01:36:41.433 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:41.433 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:34.950923+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:41.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.433+0000 7f1836d7c640 1 -- 172.21.15.114:0/3139835977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f181c06aea0 msgr2=0x7f181c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.433+0000 7f1836d7c640 1 --2- 172.21.15.114:0/3139835977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f181c06aea0 0x7f181c06d360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f18301f4f60 tx=0x7f1820009040 comp rx=0 tx=0).stop 2023-11-04T01:36:41.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.433+0000 7f1836d7c640 1 -- 172.21.15.114:0/3139835977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18301502d0 msgr2=0x7f1830150750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.433+0000 7f1836d7c640 1 --2- 172.21.15.114:0/3139835977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18301502d0 0x7f1830150750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f183015ce70 tx=0x7f182800f580 comp rx=0 tx=0).stop 2023-11-04T01:36:41.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.433+0000 7f1836d7c640 1 -- 172.21.15.114:0/3139835977 shutdown_connections 2023-11-04T01:36:41.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.433+0000 7f1836d7c640 1 --2- 172.21.15.114:0/3139835977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18301502d0 0x7f1830150750 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.433+0000 7f1836d7c640 1 --2- 172.21.15.114:0/3139835977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1830153ff0 0x7f1830154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.433+0000 7f1836d7c640 1 --2- 172.21.15.114:0/3139835977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f181c06aea0 0x7f181c06d360 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.433+0000 7f1836d7c640 1 --2- 172.21.15.114:0/3139835977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f18180047c0 0x7f1830152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.433+0000 7f1836d7c640 1 -- 172.21.15.114:0/3139835977 >> 172.21.15.114:0/3139835977 conn(0x7f18300ce950 msgr2=0x7f1830070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:41.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.433+0000 7f1836d7c640 1 -- 172.21.15.114:0/3139835977 shutdown_connections 2023-11-04T01:36:41.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.433+0000 7f1836d7c640 1 -- 172.21.15.114:0/3139835977 wait complete. 2023-11-04T01:36:41.445 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:41.446 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:41.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.545+0000 7fe3277a5640 1 Processor -- start 2023-11-04T01:36:41.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.545+0000 7fe3277a5640 1 -- start start 2023-11-04T01:36:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.546+0000 7fe3277a5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3200d0710 0x7fe3200cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.546+0000 7fe3277a5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe3200cda50 0x7fe3200b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.546+0000 7fe3277a5640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3200d0280 con 0x7fe32015e430 2023-11-04T01:36:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.546+0000 7fe3277a5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3200cdf00 con 0x7fe3200cda50 2023-11-04T01:36:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.546+0000 7fe3277a5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200cf670 con 0x7fe3200d0710 2023-11-04T01:36:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.546+0000 7fe325d42640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe3200cda50 0x7fe3200b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.546+0000 7fe325d42640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe3200cda50 0x7fe3200b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48764/0 (socket says 172.21.15.114:48764) 2023-11-04T01:36:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.546+0000 7fe325d42640 1 -- 172.21.15.114:0/3269989959 learned_addr learned my addr 172.21.15.114:0/3269989959 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.546+0000 7fe324d40640 1 --2- 172.21.15.114:0/3269989959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3200d0710 0x7fe3200cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.546+0000 7fe325d42640 1 -- 172.21.15.114:0/3269989959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3200d0710 msgr2=0x7fe3200cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.546+0000 7fe325d42640 1 --2- 172.21.15.114:0/3269989959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3200d0710 0x7fe3200cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.546+0000 7fe325d42640 1 -- 172.21.15.114:0/3269989959 >> v1:172.21.15.141:6789/0 conn(0x7fe32015e430 legacy=0x7fe3200cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.547+0000 7fe325d42640 1 -- 172.21.15.114:0/3269989959 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3200cf950 con 0x7fe3200cda50 2023-11-04T01:36:41.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.547+0000 7fe325d42640 1 --2- 172.21.15.114:0/3269989959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3200cda50 0x7fe3200b3d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe318009e50 tx=0x7fe31802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3078b089c78ed6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.547+0000 7fe317fff640 1 -- 172.21.15.114:0/3269989959 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31802ca70 con 0x7fe3200cda50 2023-11-04T01:36:41.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.547+0000 7fe317fff640 1 -- 172.21.15.114:0/3269989959 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31802cbd0 con 0x7fe3200cda50 2023-11-04T01:36:41.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.547+0000 7fe317fff640 1 -- 172.21.15.114:0/3269989959 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3180343f0 con 0x7fe3200cda50 2023-11-04T01:36:41.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.548+0000 7fe3277a5640 1 -- 172.21.15.114:0/3269989959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3200cda50 msgr2=0x7fe3200b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.548+0000 7fe3277a5640 1 --2- 172.21.15.114:0/3269989959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3200cda50 0x7fe3200b3d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe318009e50 tx=0x7fe31802bed0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.548+0000 7fe3277a5640 1 -- 172.21.15.114:0/3269989959 shutdown_connections 2023-11-04T01:36:41.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.548+0000 7fe3277a5640 1 --2- 172.21.15.114:0/3269989959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3200cda50 0x7fe3200b3d40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.548+0000 7fe3277a5640 1 --2- 172.21.15.114:0/3269989959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3200d0710 0x7fe3200cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.548+0000 7fe3277a5640 1 -- 172.21.15.114:0/3269989959 >> 172.21.15.114:0/3269989959 conn(0x7fe32006ea20 msgr2=0x7fe32006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:41.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.548+0000 7fe3277a5640 1 -- 172.21.15.114:0/3269989959 shutdown_connections 2023-11-04T01:36:41.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.548+0000 7fe3277a5640 1 -- 172.21.15.114:0/3269989959 wait complete. 2023-11-04T01:36:41.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.549+0000 7fe3277a5640 1 Processor -- start 2023-11-04T01:36:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.549+0000 7fe3277a5640 1 -- start start 2023-11-04T01:36:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.550+0000 7fe3277a5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3200cda50 0x7fe3200c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.550+0000 7fe3277a5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3200d0710 0x7fe3200b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.550+0000 7fe3277a5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe32015e430 0x7fe3200c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.550+0000 7fe3277a5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200b17d0 con 0x7fe3200cda50 2023-11-04T01:36:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.550+0000 7fe3277a5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200c4ce0 con 0x7fe32015e430 2023-11-04T01:36:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.550+0000 7fe3277a5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200c4fc0 con 0x7fe3200d0710 2023-11-04T01:36:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.550+0000 7fe325541640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3200cda50 0x7fe3200c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.550+0000 7fe325541640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3200cda50 0x7fe3200c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48774/0 (socket says 172.21.15.114:48774) 2023-11-04T01:36:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.550+0000 7fe325541640 1 -- 172.21.15.114:0/2696125432 learned_addr learned my addr 172.21.15.114:0/2696125432 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.550+0000 7fe325541640 1 -- 172.21.15.114:0/2696125432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3200d0710 msgr2=0x7fe3200b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.550+0000 7fe325541640 1 --2- 172.21.15.114:0/2696125432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3200d0710 0x7fe3200b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.550+0000 7fe325541640 1 -- 172.21.15.114:0/2696125432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe32015e430 msgr2=0x7fe3200c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.550+0000 7fe325541640 1 --2- 172.21.15.114:0/2696125432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe32015e430 0x7fe3200c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.550+0000 7fe325541640 1 -- 172.21.15.114:0/2696125432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe318009b30 con 0x7fe3200cda50 2023-11-04T01:36:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.550+0000 7fe325541640 1 --2- 172.21.15.114:0/2696125432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3200cda50 0x7fe3200c4650 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00b3f0 tx=0x7fe31c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.551+0000 7fe315ffb640 1 -- 172.21.15.114:0/2696125432 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c011830 con 0x7fe3200cda50 2023-11-04T01:36:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.551+0000 7fe315ffb640 1 -- 172.21.15.114:0/2696125432 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c011990 con 0x7fe3200cda50 2023-11-04T01:36:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.551+0000 7fe3277a5640 1 -- 172.21.15.114:0/2696125432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3200c52a0 con 0x7fe3200cda50 2023-11-04T01:36:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.551+0000 7fe315ffb640 1 -- 172.21.15.114:0/2696125432 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c011d40 con 0x7fe3200cda50 2023-11-04T01:36:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.551+0000 7fe3277a5640 1 -- 172.21.15.114:0/2696125432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3200c5860 con 0x7fe3200cda50 2023-11-04T01:36:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.552+0000 7fe3277a5640 1 -- 172.21.15.114:0/2696125432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3200c5a50 con 0x7fe3200cda50 2023-11-04T01:36:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.552+0000 7fe315ffb640 1 -- 172.21.15.114:0/2696125432 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe31c01a400 con 0x7fe3200cda50 2023-11-04T01:36:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.553+0000 7fe315ffb640 1 --2- 172.21.15.114:0/2696125432 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe30406ae70 0x7fe30406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.553+0000 7fe315ffb640 1 -- 172.21.15.114:0/2696125432 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe31c0896b0 con 0x7fe3200cda50 2023-11-04T01:36:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.553+0000 7fe324d40640 1 --2- 172.21.15.114:0/2696125432 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe30406ae70 0x7fe30406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.553+0000 7fe324d40640 1 --2- 172.21.15.114:0/2696125432 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe30406ae70 0x7fe30406d330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe3200cb350 tx=0x7fe310008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.557+0000 7fe315ffb640 1 -- 172.21.15.114:0/2696125432 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe31c054500 con 0x7fe3200cda50 2023-11-04T01:36:41.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.722+0000 7fe3277a5640 1 -- 172.21.15.114:0/2696125432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe320074290 con 0x7fe3200cda50 2023-11-04T01:36:41.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.722+0000 7fe315ffb640 1 -- 172.21.15.114:0/2696125432 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe31c057b20 con 0x7fe3200cda50 2023-11-04T01:36:41.724 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:36:41.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.724+0000 7fe3277a5640 1 -- 172.21.15.114:0/2696125432 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe30406ae70 msgr2=0x7fe30406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.724+0000 7fe3277a5640 1 --2- 172.21.15.114:0/2696125432 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe30406ae70 0x7fe30406d330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe3200cb350 tx=0x7fe310008040 comp rx=0 tx=0).stop 2023-11-04T01:36:41.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.724+0000 7fe3277a5640 1 -- 172.21.15.114:0/2696125432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3200cda50 msgr2=0x7fe3200c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.724+0000 7fe3277a5640 1 --2- 172.21.15.114:0/2696125432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3200cda50 0x7fe3200c4650 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00b3f0 tx=0x7fe31c00b8b0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.724+0000 7fe3277a5640 1 -- 172.21.15.114:0/2696125432 shutdown_connections 2023-11-04T01:36:41.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.724+0000 7fe3277a5640 1 --2- 172.21.15.114:0/2696125432 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe30406ae70 0x7fe30406d330 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.724+0000 7fe3277a5640 1 --2- 172.21.15.114:0/2696125432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe32015e430 0x7fe3200c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.724+0000 7fe3277a5640 1 --2- 172.21.15.114:0/2696125432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3200d0710 0x7fe3200b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.724+0000 7fe3277a5640 1 --2- 172.21.15.114:0/2696125432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3200cda50 0x7fe3200c4650 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.724+0000 7fe3277a5640 1 -- 172.21.15.114:0/2696125432 >> 172.21.15.114:0/2696125432 conn(0x7fe32006ea20 msgr2=0x7fe32015afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:41.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.724+0000 7fe3277a5640 1 -- 172.21.15.114:0/2696125432 shutdown_connections 2023-11-04T01:36:41.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.724+0000 7fe3277a5640 1 -- 172.21.15.114:0/2696125432 wait complete. 2023-11-04T01:36:41.736 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:41.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.837+0000 7eff10b73640 1 Processor -- start 2023-11-04T01:36:41.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.837+0000 7eff10b73640 1 -- start start 2023-11-04T01:36:41.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.838+0000 7eff10b73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff0c153e60 0x7eff0c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.838+0000 7eff10b73640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0c0cde60 con 0x7eff0c0cd6d0 2023-11-04T01:36:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.838+0000 7eff10b73640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0c160f90 con 0x7eff0c0b4880 2023-11-04T01:36:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.838+0000 7eff10b73640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c15e400 con 0x7eff0c153e60 2023-11-04T01:36:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.838+0000 7eff09d9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7eff0c0cd6d0 0x7eff0c161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45410/0 (socket says 172.21.15.114:45410) 2023-11-04T01:36:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.838+0000 7eff09d9b640 1 -- 172.21.15.114:0/1577402183 learned_addr learned my addr 172.21.15.114:0/1577402183 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.838+0000 7eff0959a640 1 -- 172.21.15.114:0/1577402183 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701528516 0 0) 0x7eff0c0cde60 con 0x7eff0c0cd6d0 2023-11-04T01:36:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.838+0000 7eff0959a640 1 -- 172.21.15.114:0/1577402183 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efef4003520 con 0x7eff0c0cd6d0 2023-11-04T01:36:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.838+0000 7eff0a59c640 1 --2- 172.21.15.114:0/1577402183 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff0c153e60 0x7eff0c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff0959a640 1 -- 172.21.15.114:0/1577402183 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2479028805 0 0) 0x7efef4003520 con 0x7eff0c0cd6d0 2023-11-04T01:36:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff0959a640 1 -- 172.21.15.114:0/1577402183 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff0c153e60 msgr2=0x7eff0c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff0959a640 1 --2- 172.21.15.114:0/1577402183 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff0c153e60 0x7eff0c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff0959a640 1 -- 172.21.15.114:0/1577402183 >> v1:172.21.15.141:6789/0 conn(0x7eff0c0b4880 legacy=0x7eff0c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff0959a640 1 -- 172.21.15.114:0/1577402183 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c0ce090 con 0x7eff0c0cd6d0 2023-11-04T01:36:41.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff0959a640 1 -- 172.21.15.114:0/1577402183 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7eff00001670 con 0x7eff0c0cd6d0 2023-11-04T01:36:41.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff0959a640 1 -- 172.21.15.114:0/1577402183 >> v1:172.21.15.114:6789/0 conn(0x7eff0c0cd6d0 legacy=0x7eff0c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff0959a640 1 --2- 172.21.15.114:0/1577402183 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efef40039a0 0x7efef4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff0959a640 1 --2- 172.21.15.114:0/1577402183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40047c0 0x7efef4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff0959a640 1 --2- 172.21.15.114:0/1577402183 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff0c153e60 0x7efef4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff0959a640 1 -- 172.21.15.114:0/1577402183 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c15e400 con 0x7efef40047c0 2023-11-04T01:36:41.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff0959a640 1 -- 172.21.15.114:0/1577402183 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef400ba60 con 0x7efef40039a0 2023-11-04T01:36:41.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff0959a640 1 -- 172.21.15.114:0/1577402183 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef400bc20 con 0x7eff0c153e60 2023-11-04T01:36:41.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff09d9b640 1 --2- 172.21.15.114:0/1577402183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40047c0 0x7efef4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff0a59c640 1 --2- 172.21.15.114:0/1577402183 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efef40039a0 0x7efef4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff0ad9d640 1 --2- 172.21.15.114:0/1577402183 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff0c153e60 0x7efef4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff09d9b640 1 -- 172.21.15.114:0/1577402183 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff0c153e60 msgr2=0x7efef4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff09d9b640 1 --2- 172.21.15.114:0/1577402183 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff0c153e60 0x7efef4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff09d9b640 1 -- 172.21.15.114:0/1577402183 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efef40039a0 msgr2=0x7efef4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:41.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff09d9b640 1 --2- 172.21.15.114:0/1577402183 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efef40039a0 0x7efef4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.839+0000 7eff09d9b640 1 -- 172.21.15.114:0/1577402183 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef4003520 con 0x7efef40047c0 2023-11-04T01:36:41.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.840+0000 7eff09d9b640 1 --2- 172.21.15.114:0/1577402183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40047c0 0x7efef4004c40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7eff00001050 tx=0x7efef40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ca72d93d4ad346 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.840+0000 7eff0959a640 1 -- 172.21.15.114:0/1577402183 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00005ad0 con 0x7efef40047c0 2023-11-04T01:36:41.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.840+0000 7eff0959a640 1 -- 172.21.15.114:0/1577402183 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff00005c50 con 0x7efef40047c0 2023-11-04T01:36:41.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.840+0000 7eff0959a640 1 -- 172.21.15.114:0/1577402183 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00007070 con 0x7efef40047c0 2023-11-04T01:36:41.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.840+0000 7eff10b73640 1 -- 172.21.15.114:0/1577402183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40047c0 msgr2=0x7efef4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.840+0000 7eff10b73640 1 --2- 172.21.15.114:0/1577402183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40047c0 0x7efef4004c40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7eff00001050 tx=0x7efef40057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.841+0000 7eff0ad9d640 1 -- 172.21.15.114:0/1577402183 reap_dead start 2023-11-04T01:36:41.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.841+0000 7eff10b73640 1 -- 172.21.15.114:0/1577402183 shutdown_connections 2023-11-04T01:36:41.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.841+0000 7eff10b73640 1 -- 172.21.15.114:0/1577402183 >> 172.21.15.114:0/1577402183 conn(0x7eff0c0cf880 msgr2=0x7eff0c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:41.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.841+0000 7eff10b73640 1 -- 172.21.15.114:0/1577402183 shutdown_connections 2023-11-04T01:36:41.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.841+0000 7eff10b73640 1 -- 172.21.15.114:0/1577402183 wait complete. 2023-11-04T01:36:41.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.842+0000 7eff10b73640 1 Processor -- start 2023-11-04T01:36:41.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.842+0000 7eff10b73640 1 -- start start 2023-11-04T01:36:41.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff10b73640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40047c0 0x7eff0c14cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff10b73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff0c0b7020 0x7eff0c0b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff10b73640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff0c0cab10 0x7eff0c0caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff10b73640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0cbe40 con 0x7efef40047c0 2023-11-04T01:36:41.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff10b73640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0b79e0 con 0x7eff0c0cab10 2023-11-04T01:36:41.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff10b73640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0c7340 con 0x7eff0c0b7020 2023-11-04T01:36:41.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff0a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40047c0 0x7eff0c14cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff0a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40047c0 0x7eff0c14cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48796/0 (socket says 172.21.15.114:48796) 2023-11-04T01:36:41.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff0a59c640 1 -- 172.21.15.114:0/856547295 learned_addr learned my addr 172.21.15.114:0/856547295 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:41.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff0ad9d640 1 --2- 172.21.15.114:0/856547295 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff0c0cab10 0x7eff0c0caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff09d9b640 1 --2- 172.21.15.114:0/856547295 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff0c0b7020 0x7eff0c0b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff0a59c640 1 -- 172.21.15.114:0/856547295 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff0c0b7020 msgr2=0x7eff0c0b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff0a59c640 1 --2- 172.21.15.114:0/856547295 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff0c0b7020 0x7eff0c0b74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff0a59c640 1 -- 172.21.15.114:0/856547295 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff0c0cab10 msgr2=0x7eff0c0caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:41.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff0a59c640 1 --2- 172.21.15.114:0/856547295 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff0c0cab10 0x7eff0c0caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:41.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff0a59c640 1 -- 172.21.15.114:0/856547295 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c0c6d30 con 0x7efef40047c0 2023-11-04T01:36:41.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff0a59c640 1 --2- 172.21.15.114:0/856547295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40047c0 0x7eff0c14cbc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efefc0119a0 tx=0x7efefc011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7efefaffd640 1 -- 172.21.15.114:0/856547295 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc00faf0 con 0x7efef40047c0 2023-11-04T01:36:41.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7efefaffd640 1 -- 172.21.15.114:0/856547295 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc00fc50 con 0x7efef40047c0 2023-11-04T01:36:41.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7efefaffd640 1 -- 172.21.15.114:0/856547295 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc014440 con 0x7efef40047c0 2023-11-04T01:36:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff10b73640 1 -- 172.21.15.114:0/856547295 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0c14d100 con 0x7efef40047c0 2023-11-04T01:36:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.843+0000 7eff10b73640 1 -- 172.21.15.114:0/856547295 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c0cbb60 con 0x7efef40047c0 2023-11-04T01:36:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.845+0000 7eff10b73640 1 -- 172.21.15.114:0/856547295 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0c074290 con 0x7efef40047c0 2023-11-04T01:36:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.845+0000 7efefaffd640 1 -- 172.21.15.114:0/856547295 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efefc0145a0 con 0x7efef40047c0 2023-11-04T01:36:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.845+0000 7efefaffd640 1 --2- 172.21.15.114:0/856547295 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efeec06ae70 0x7efeec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.845+0000 7efefaffd640 1 -- 172.21.15.114:0/856547295 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efefc08a1a0 con 0x7efef40047c0 2023-11-04T01:36:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.845+0000 7eff09d9b640 1 --2- 172.21.15.114:0/856547295 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efeec06ae70 0x7efeec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.846+0000 7eff09d9b640 1 --2- 172.21.15.114:0/856547295 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efeec06ae70 0x7efeec06d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7eff00034000 tx=0x7eff00007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:41.849+0000 7efefaffd640 1 -- 172.21.15.114:0/856547295 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efefc054f60 con 0x7efef40047c0 2023-11-04T01:36:42.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.015+0000 7eff10b73640 1 -- 172.21.15.114:0/856547295 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff0c0c7090 con 0x7efef40047c0 2023-11-04T01:36:42.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.016+0000 7efefaffd640 1 -- 172.21.15.114:0/856547295 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7efefc058580 con 0x7efef40047c0 2023-11-04T01:36:42.019 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:36:42.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.018+0000 7eff10b73640 1 -- 172.21.15.114:0/856547295 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efeec06ae70 msgr2=0x7efeec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.018+0000 7eff10b73640 1 --2- 172.21.15.114:0/856547295 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efeec06ae70 0x7efeec06d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7eff00034000 tx=0x7eff00007000 comp rx=0 tx=0).stop 2023-11-04T01:36:42.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.018+0000 7eff10b73640 1 -- 172.21.15.114:0/856547295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40047c0 msgr2=0x7eff0c14cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.018+0000 7eff10b73640 1 --2- 172.21.15.114:0/856547295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40047c0 0x7eff0c14cbc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efefc0119a0 tx=0x7efefc011e60 comp rx=0 tx=0).stop 2023-11-04T01:36:42.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.018+0000 7eff10b73640 1 -- 172.21.15.114:0/856547295 shutdown_connections 2023-11-04T01:36:42.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.018+0000 7eff10b73640 1 --2- 172.21.15.114:0/856547295 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efeec06ae70 0x7efeec06d330 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.018+0000 7eff10b73640 1 --2- 172.21.15.114:0/856547295 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff0c0cab10 0x7eff0c0caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.018+0000 7eff10b73640 1 --2- 172.21.15.114:0/856547295 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff0c0b7020 0x7eff0c0b74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.018+0000 7eff10b73640 1 --2- 172.21.15.114:0/856547295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40047c0 0x7eff0c14cbc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.018+0000 7eff10b73640 1 -- 172.21.15.114:0/856547295 >> 172.21.15.114:0/856547295 conn(0x7eff0c0cf880 msgr2=0x7eff0c0d2300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.018+0000 7eff10b73640 1 -- 172.21.15.114:0/856547295 shutdown_connections 2023-11-04T01:36:42.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.018+0000 7eff10b73640 1 -- 172.21.15.114:0/856547295 wait complete. 2023-11-04T01:36:42.030 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:42.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.131+0000 7f3411ea2640 1 Processor -- start 2023-11-04T01:36:42.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.131+0000 7f3411ea2640 1 -- start start 2023-11-04T01:36:42.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f3411ea2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f340c153e60 0x7f340c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f3411ea2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f340c0cd6d0 0x7f340c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f3411ea2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f340c0b4880 0x7f340c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f3411ea2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f340c0cde60 con 0x7f340c0cd6d0 2023-11-04T01:36:42.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f3411ea2640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f340c160f90 con 0x7f340c0b4880 2023-11-04T01:36:42.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f3411ea2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340c0b5200 con 0x7f340c153e60 2023-11-04T01:36:42.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f340affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f340c0cd6d0 0x7f340c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f340affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f340c0cd6d0 0x7f340c161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48798/0 (socket says 172.21.15.114:48798) 2023-11-04T01:36:42.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f340affd640 1 -- 172.21.15.114:0/3636503843 learned_addr learned my addr 172.21.15.114:0/3636503843 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:42.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f340b7fe640 1 --2- 172.21.15.114:0/3636503843 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f340c153e60 0x7f340c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f340bfff640 1 --2- 172.21.15.114:0/3636503843 >> v2:172.21.15.141:3300/0 conn(0x7f340c0b4880 0x7f340c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f340affd640 1 -- 172.21.15.114:0/3636503843 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f340c153e60 msgr2=0x7f340c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:42.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f340affd640 1 --2- 172.21.15.114:0/3636503843 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f340c153e60 0x7f340c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f340affd640 1 -- 172.21.15.114:0/3636503843 >> v2:172.21.15.141:3300/0 conn(0x7f340c0b4880 msgr2=0x7f340c0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:42.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f340affd640 1 --2- 172.21.15.114:0/3636503843 >> v2:172.21.15.141:3300/0 conn(0x7f340c0b4880 0x7f340c0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f340affd640 1 -- 172.21.15.114:0/3636503843 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c15e400 con 0x7f340c0cd6d0 2023-11-04T01:36:42.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.132+0000 7f340bfff640 1 --2- 172.21.15.114:0/3636503843 >> v2:172.21.15.141:3300/0 conn(0x7f340c0b4880 0x7f340c0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:42.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.133+0000 7f340affd640 1 --2- 172.21.15.114:0/3636503843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340c0cd6d0 0x7f340c161420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f340c0c9e50 tx=0x7f340002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937a8c3fd733ad52 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.133+0000 7f340a7fc640 1 -- 172.21.15.114:0/3636503843 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400031870 con 0x7f340c0cd6d0 2023-11-04T01:36:42.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.133+0000 7f340a7fc640 1 -- 172.21.15.114:0/3636503843 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34000319d0 con 0x7f340c0cd6d0 2023-11-04T01:36:42.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.133+0000 7f340a7fc640 1 -- 172.21.15.114:0/3636503843 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400031d60 con 0x7f340c0cd6d0 2023-11-04T01:36:42.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.134+0000 7f3411ea2640 1 -- 172.21.15.114:0/3636503843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340c0cd6d0 msgr2=0x7f340c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.134+0000 7f3411ea2640 1 --2- 172.21.15.114:0/3636503843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340c0cd6d0 0x7f340c161420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f340c0c9e50 tx=0x7f340002b910 comp rx=0 tx=0).stop 2023-11-04T01:36:42.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.134+0000 7f3411ea2640 1 -- 172.21.15.114:0/3636503843 shutdown_connections 2023-11-04T01:36:42.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.134+0000 7f3411ea2640 1 --2- 172.21.15.114:0/3636503843 >> v2:172.21.15.141:3300/0 conn(0x7f340c0b4880 0x7f340c0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.134+0000 7f3411ea2640 1 --2- 172.21.15.114:0/3636503843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340c0cd6d0 0x7f340c161420 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.134+0000 7f3411ea2640 1 --2- 172.21.15.114:0/3636503843 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f340c153e60 0x7f340c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.134+0000 7f3411ea2640 1 -- 172.21.15.114:0/3636503843 >> 172.21.15.114:0/3636503843 conn(0x7f340c0cf880 msgr2=0x7f340c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.134+0000 7f3411ea2640 1 -- 172.21.15.114:0/3636503843 shutdown_connections 2023-11-04T01:36:42.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.134+0000 7f3411ea2640 1 -- 172.21.15.114:0/3636503843 wait complete. 2023-11-04T01:36:42.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.135+0000 7f3411ea2640 1 Processor -- start 2023-11-04T01:36:42.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.135+0000 7f3411ea2640 1 -- start start 2023-11-04T01:36:42.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f3411ea2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f340c0b4880 0x7f340c1f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f3411ea2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f340c0cd6d0 0x7f340c0cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f3411ea2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340c153e60 0x7f340c0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f3411ea2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c1f6250 con 0x7f340c153e60 2023-11-04T01:36:42.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f3411ea2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c156b90 con 0x7f340c0cd6d0 2023-11-04T01:36:42.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f3411ea2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340c155ca0 con 0x7f340c0b4880 2023-11-04T01:36:42.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f340bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340c153e60 0x7f340c0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f340bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340c153e60 0x7f340c0cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48804/0 (socket says 172.21.15.114:48804) 2023-11-04T01:36:42.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f340bfff640 1 -- 172.21.15.114:0/3525809484 learned_addr learned my addr 172.21.15.114:0/3525809484 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:42.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f340affd640 1 --2- 172.21.15.114:0/3525809484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f340c0cd6d0 0x7f340c0cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f340b7fe640 1 --2- 172.21.15.114:0/3525809484 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f340c0b4880 0x7f340c1f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f340bfff640 1 -- 172.21.15.114:0/3525809484 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f340c0b4880 msgr2=0x7f340c1f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f340bfff640 1 --2- 172.21.15.114:0/3525809484 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f340c0b4880 0x7f340c1f5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f340bfff640 1 -- 172.21.15.114:0/3525809484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f340c0cd6d0 msgr2=0x7f340c0cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f340bfff640 1 --2- 172.21.15.114:0/3525809484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f340c0cd6d0 0x7f340c0cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f340bfff640 1 -- 172.21.15.114:0/3525809484 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34000094d0 con 0x7f340c153e60 2023-11-04T01:36:42.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f340affd640 1 --2- 172.21.15.114:0/3525809484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f340c0cd6d0 0x7f340c0cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:42.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f340bfff640 1 --2- 172.21.15.114:0/3525809484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340c153e60 0x7f340c0cc2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3404007e10 tx=0x7f340400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f33f3fff640 1 -- 172.21.15.114:0/3525809484 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404003b90 con 0x7f340c153e60 2023-11-04T01:36:42.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f33f3fff640 1 -- 172.21.15.114:0/3525809484 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340400f040 con 0x7f340c153e60 2023-11-04T01:36:42.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f33f3fff640 1 -- 172.21.15.114:0/3525809484 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340400de80 con 0x7f340c153e60 2023-11-04T01:36:42.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.136+0000 7f3411ea2640 1 -- 172.21.15.114:0/3525809484 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340c155f80 con 0x7f340c153e60 2023-11-04T01:36:42.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.137+0000 7f3411ea2640 1 -- 172.21.15.114:0/3525809484 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340c156540 con 0x7f340c153e60 2023-11-04T01:36:42.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.137+0000 7f3411ea2640 1 -- 172.21.15.114:0/3525809484 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340c156d20 con 0x7f340c153e60 2023-11-04T01:36:42.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.138+0000 7f33f3fff640 1 -- 172.21.15.114:0/3525809484 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3404004030 con 0x7f340c153e60 2023-11-04T01:36:42.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.138+0000 7f33f3fff640 1 --2- 172.21.15.114:0/3525809484 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f33f806aea0 0x7f33f806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.138+0000 7f33f3fff640 1 -- 172.21.15.114:0/3525809484 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3404089bb0 con 0x7f340c153e60 2023-11-04T01:36:42.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.138+0000 7f340b7fe640 1 --2- 172.21.15.114:0/3525809484 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f33f806aea0 0x7f33f806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.139+0000 7f340b7fe640 1 --2- 172.21.15.114:0/3525809484 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f33f806aea0 0x7f33f806d360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f33fc006fd0 tx=0x7f33fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.142+0000 7f33f3fff640 1 -- 172.21.15.114:0/3525809484 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3404054980 con 0x7f340c153e60 2023-11-04T01:36:42.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.308+0000 7f3411ea2640 1 -- 172.21.15.114:0/3525809484 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f340c074290 con 0x7f340c153e60 2023-11-04T01:36:42.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.309+0000 7f33f3fff640 1 -- 172.21.15.114:0/3525809484 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3404057fa0 con 0x7f340c153e60 2023-11-04T01:36:42.311 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:36:42.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.311+0000 7f3411ea2640 1 -- 172.21.15.114:0/3525809484 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f33f806aea0 msgr2=0x7f33f806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.311+0000 7f3411ea2640 1 --2- 172.21.15.114:0/3525809484 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f33f806aea0 0x7f33f806d360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f33fc006fd0 tx=0x7f33fc008040 comp rx=0 tx=0).stop 2023-11-04T01:36:42.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.311+0000 7f3411ea2640 1 -- 172.21.15.114:0/3525809484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340c153e60 msgr2=0x7f340c0cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.311+0000 7f3411ea2640 1 --2- 172.21.15.114:0/3525809484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340c153e60 0x7f340c0cc2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3404007e10 tx=0x7f340400d4a0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.311+0000 7f3411ea2640 1 -- 172.21.15.114:0/3525809484 shutdown_connections 2023-11-04T01:36:42.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.311+0000 7f3411ea2640 1 --2- 172.21.15.114:0/3525809484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340c153e60 0x7f340c0cc2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.311+0000 7f3411ea2640 1 --2- 172.21.15.114:0/3525809484 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f33f806aea0 0x7f33f806d360 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.311+0000 7f3411ea2640 1 --2- 172.21.15.114:0/3525809484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f340c0cd6d0 0x7f340c0cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.311+0000 7f3411ea2640 1 --2- 172.21.15.114:0/3525809484 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f340c0b4880 0x7f340c1f5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.311+0000 7f3411ea2640 1 -- 172.21.15.114:0/3525809484 >> 172.21.15.114:0/3525809484 conn(0x7f340c0cf880 msgr2=0x7f340c15e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.311+0000 7f3411ea2640 1 -- 172.21.15.114:0/3525809484 shutdown_connections 2023-11-04T01:36:42.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.311+0000 7f3411ea2640 1 -- 172.21.15.114:0/3525809484 wait complete. 2023-11-04T01:36:42.323 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:42.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.424+0000 7f068a6e7640 1 Processor -- start 2023-11-04T01:36:42.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.424+0000 7f068a6e7640 1 -- start start 2023-11-04T01:36:42.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f068a6e7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06840d0710 0x7f06840cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f068a6e7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06840d0280 con 0x7f068415e430 2023-11-04T01:36:42.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f068a6e7640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06840cdf00 con 0x7f06840cda50 2023-11-04T01:36:42.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f068a6e7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06840cf670 con 0x7f06840d0710 2023-11-04T01:36:42.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0683fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f068415e430 0x7f06840cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45418/0 (socket says 172.21.15.114:45418) 2023-11-04T01:36:42.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0683fff640 1 -- 172.21.15.114:0/4045663230 learned_addr learned my addr 172.21.15.114:0/4045663230 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:42.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0682ffd640 1 -- 172.21.15.114:0/4045663230 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534574831 0 0) 0x7f06840d0280 con 0x7f068415e430 2023-11-04T01:36:42.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f06837fe640 1 --2- 172.21.15.114:0/4045663230 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06840d0710 0x7f06840cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0682ffd640 1 -- 172.21.15.114:0/4045663230 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f066c003520 con 0x7f068415e430 2023-11-04T01:36:42.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0682ffd640 1 -- 172.21.15.114:0/4045663230 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2494887075 0 0) 0x7f066c003520 con 0x7f068415e430 2023-11-04T01:36:42.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0682ffd640 1 -- 172.21.15.114:0/4045663230 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06840d0710 msgr2=0x7f06840cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:42.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0682ffd640 1 --2- 172.21.15.114:0/4045663230 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06840d0710 0x7f06840cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0682ffd640 1 -- 172.21.15.114:0/4045663230 >> v1:172.21.15.141:6789/0 conn(0x7f06840cda50 legacy=0x7f06840b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0682ffd640 1 -- 172.21.15.114:0/4045663230 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06840cf950 con 0x7f068415e430 2023-11-04T01:36:42.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0682ffd640 1 -- 172.21.15.114:0/4045663230 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f0674001670 con 0x7f068415e430 2023-11-04T01:36:42.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0682ffd640 1 -- 172.21.15.114:0/4045663230 >> v1:172.21.15.114:6789/0 conn(0x7f068415e430 legacy=0x7f06840cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0682ffd640 1 --2- 172.21.15.114:0/4045663230 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06840d0710 0x7f066c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0682ffd640 1 --2- 172.21.15.114:0/4045663230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066c003f20 0x7f066c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0682ffd640 1 --2- 172.21.15.114:0/4045663230 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f066c004d00 0x7f066c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0682ffd640 1 -- 172.21.15.114:0/4045663230 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06840cf670 con 0x7f066c003f20 2023-11-04T01:36:42.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0682ffd640 1 -- 172.21.15.114:0/4045663230 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c00ba60 con 0x7f066c004d00 2023-11-04T01:36:42.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f0682ffd640 1 -- 172.21.15.114:0/4045663230 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066c00bc20 con 0x7f06840d0710 2023-11-04T01:36:42.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.425+0000 7f06837fe640 1 --2- 172.21.15.114:0/4045663230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066c003f20 0x7f066c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.426+0000 7f0683fff640 1 --2- 172.21.15.114:0/4045663230 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06840d0710 0x7f066c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.426+0000 7f0688c84640 1 --2- 172.21.15.114:0/4045663230 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f066c004d00 0x7f066c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.426+0000 7f06837fe640 1 -- 172.21.15.114:0/4045663230 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06840d0710 msgr2=0x7f066c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:42.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.426+0000 7f06837fe640 1 --2- 172.21.15.114:0/4045663230 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06840d0710 0x7f066c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.426+0000 7f06837fe640 1 -- 172.21.15.114:0/4045663230 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f066c004d00 msgr2=0x7f066c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:42.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.426+0000 7f06837fe640 1 --2- 172.21.15.114:0/4045663230 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f066c004d00 0x7f066c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.426+0000 7f06837fe640 1 -- 172.21.15.114:0/4045663230 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c003520 con 0x7f066c003f20 2023-11-04T01:36:42.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.426+0000 7f0688c84640 1 --2- 172.21.15.114:0/4045663230 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f066c004d00 0x7f066c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:42.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.426+0000 7f06837fe640 1 --2- 172.21.15.114:0/4045663230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066c003f20 0x7f066c0047c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0678009a90 tx=0x7f066c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b837368f80fde4a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.427+0000 7f0682ffd640 1 -- 172.21.15.114:0/4045663230 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067802c680 con 0x7f066c003f20 2023-11-04T01:36:42.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.427+0000 7f0682ffd640 1 -- 172.21.15.114:0/4045663230 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067802c7e0 con 0x7f066c003f20 2023-11-04T01:36:42.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.427+0000 7f0682ffd640 1 -- 172.21.15.114:0/4045663230 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067802cb90 con 0x7f066c003f20 2023-11-04T01:36:42.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.427+0000 7f068a6e7640 1 -- 172.21.15.114:0/4045663230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066c003f20 msgr2=0x7f066c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.427+0000 7f068a6e7640 1 --2- 172.21.15.114:0/4045663230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066c003f20 0x7f066c0047c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0678009a90 tx=0x7f066c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.427+0000 7f0688c84640 1 -- 172.21.15.114:0/4045663230 reap_dead start 2023-11-04T01:36:42.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.427+0000 7f068a6e7640 1 -- 172.21.15.114:0/4045663230 shutdown_connections 2023-11-04T01:36:42.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.427+0000 7f068a6e7640 1 -- 172.21.15.114:0/4045663230 >> 172.21.15.114:0/4045663230 conn(0x7f068406ea20 msgr2=0x7f068406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.427+0000 7f068a6e7640 1 -- 172.21.15.114:0/4045663230 shutdown_connections 2023-11-04T01:36:42.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.427+0000 7f068a6e7640 1 -- 172.21.15.114:0/4045663230 wait complete. 2023-11-04T01:36:42.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.428+0000 7f068a6e7640 1 Processor -- start 2023-11-04T01:36:42.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.428+0000 7f068a6e7640 1 -- start start 2023-11-04T01:36:42.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.429+0000 7f068a6e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066c003f20 0x7f06841ede10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.429+0000 7f068a6e7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06840b2ad0 0x7f06841f12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.429+0000 7f068a6e7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06840c9640 0x7f06840c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.429+0000 7f068a6e7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06841ee350 con 0x7f066c003f20 2023-11-04T01:36:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.429+0000 7f068a6e7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06840ca010 con 0x7f06840c9640 2023-11-04T01:36:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.429+0000 7f068a6e7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06840c8e90 con 0x7f06840b2ad0 2023-11-04T01:36:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.429+0000 7f0683fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066c003f20 0x7f06841ede10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.429+0000 7f0683fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066c003f20 0x7f06841ede10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48828/0 (socket says 172.21.15.114:48828) 2023-11-04T01:36:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.429+0000 7f0683fff640 1 -- 172.21.15.114:0/2378362972 learned_addr learned my addr 172.21.15.114:0/2378362972 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.429+0000 7f0688c84640 1 --2- 172.21.15.114:0/2378362972 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06840c9640 0x7f06840c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.429+0000 7f06837fe640 1 --2- 172.21.15.114:0/2378362972 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06840b2ad0 0x7f06841f12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.429+0000 7f0683fff640 1 -- 172.21.15.114:0/2378362972 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06840b2ad0 msgr2=0x7f06841f12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.429+0000 7f0683fff640 1 --2- 172.21.15.114:0/2378362972 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06840b2ad0 0x7f06841f12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.430+0000 7f0683fff640 1 -- 172.21.15.114:0/2378362972 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06840c9640 msgr2=0x7f06840c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.430+0000 7f0683fff640 1 --2- 172.21.15.114:0/2378362972 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06840c9640 0x7f06840c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.430+0000 7f0683fff640 1 -- 172.21.15.114:0/2378362972 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06841f1800 con 0x7f066c003f20 2023-11-04T01:36:42.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.430+0000 7f0683fff640 1 --2- 172.21.15.114:0/2378362972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066c003f20 0x7f06841ede10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0674007290 tx=0x7f0674007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.430+0000 7f0680ff9640 1 -- 172.21.15.114:0/2378362972 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067400f9a0 con 0x7f066c003f20 2023-11-04T01:36:42.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.430+0000 7f0680ff9640 1 -- 172.21.15.114:0/2378362972 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067400fb20 con 0x7f066c003f20 2023-11-04T01:36:42.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.430+0000 7f068a6e7640 1 -- 172.21.15.114:0/2378362972 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06840c7df0 con 0x7f066c003f20 2023-11-04T01:36:42.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.430+0000 7f0680ff9640 1 -- 172.21.15.114:0/2378362972 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067400fed0 con 0x7f066c003f20 2023-11-04T01:36:42.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.430+0000 7f068a6e7640 1 -- 172.21.15.114:0/2378362972 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06840c83b0 con 0x7f066c003f20 2023-11-04T01:36:42.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.431+0000 7f068a6e7640 1 -- 172.21.15.114:0/2378362972 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0684074290 con 0x7f066c003f20 2023-11-04T01:36:42.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.431+0000 7f0680ff9640 1 -- 172.21.15.114:0/2378362972 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f067401d460 con 0x7f066c003f20 2023-11-04T01:36:42.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.432+0000 7f0680ff9640 1 --2- 172.21.15.114:0/2378362972 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f067006ae70 0x7f067006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.432+0000 7f0680ff9640 1 -- 172.21.15.114:0/2378362972 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0674089ad0 con 0x7f066c003f20 2023-11-04T01:36:42.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.432+0000 7f06837fe640 1 --2- 172.21.15.114:0/2378362972 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f067006ae70 0x7f067006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.432+0000 7f06837fe640 1 --2- 172.21.15.114:0/2378362972 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f067006ae70 0x7f067006d330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0678036000 tx=0x7f0678030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.436+0000 7f0680ff9640 1 -- 172.21.15.114:0/2378362972 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f06740549d0 con 0x7f066c003f20 2023-11-04T01:36:42.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.599+0000 7f068a6e7640 1 -- 172.21.15.114:0/2378362972 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f068415b120 con 0x7f066c003f20 2023-11-04T01:36:42.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.599+0000 7f0680ff9640 1 -- 172.21.15.114:0/2378362972 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0674057ff0 con 0x7f066c003f20 2023-11-04T01:36:42.601 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:36:42.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.601+0000 7f068a6e7640 1 -- 172.21.15.114:0/2378362972 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f067006ae70 msgr2=0x7f067006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.601+0000 7f068a6e7640 1 --2- 172.21.15.114:0/2378362972 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f067006ae70 0x7f067006d330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0678036000 tx=0x7f0678030000 comp rx=0 tx=0).stop 2023-11-04T01:36:42.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.601+0000 7f068a6e7640 1 -- 172.21.15.114:0/2378362972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066c003f20 msgr2=0x7f06841ede10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.601+0000 7f068a6e7640 1 --2- 172.21.15.114:0/2378362972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066c003f20 0x7f06841ede10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0674007290 tx=0x7f0674007690 comp rx=0 tx=0).stop 2023-11-04T01:36:42.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.601+0000 7f068a6e7640 1 -- 172.21.15.114:0/2378362972 shutdown_connections 2023-11-04T01:36:42.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.601+0000 7f068a6e7640 1 --2- 172.21.15.114:0/2378362972 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f067006ae70 0x7f067006d330 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.601+0000 7f068a6e7640 1 --2- 172.21.15.114:0/2378362972 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f06840c9640 0x7f06840c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.601+0000 7f068a6e7640 1 --2- 172.21.15.114:0/2378362972 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f06840b2ad0 0x7f06841f12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.601+0000 7f068a6e7640 1 --2- 172.21.15.114:0/2378362972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066c003f20 0x7f06841ede10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.601+0000 7f068a6e7640 1 -- 172.21.15.114:0/2378362972 >> 172.21.15.114:0/2378362972 conn(0x7f068406ea20 msgr2=0x7f06840c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.601+0000 7f068a6e7640 1 -- 172.21.15.114:0/2378362972 shutdown_connections 2023-11-04T01:36:42.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.601+0000 7f068a6e7640 1 -- 172.21.15.114:0/2378362972 wait complete. 2023-11-04T01:36:42.618 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:42.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.716+0000 7f888e8d4640 1 Processor -- start 2023-11-04T01:36:42.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.716+0000 7f888e8d4640 1 -- start start 2023-11-04T01:36:42.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.717+0000 7f888e8d4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8888159c00 0x7f88880cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.717+0000 7f888e8d4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f888815aff0 con 0x7f88880ae1d0 2023-11-04T01:36:42.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.717+0000 7f888e8d4640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f888815a3e0 con 0x7f88880c48e0 2023-11-04T01:36:42.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.717+0000 7f888e8d4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f888815a6c0 con 0x7f8888159c00 2023-11-04T01:36:42.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.717+0000 7f8887fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8888159c00 0x7f88880cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.717+0000 7f888ce71640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f88880ae1d0 0x7f88880709f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45422/0 (socket says 172.21.15.114:45422) 2023-11-04T01:36:42.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.717+0000 7f888ce71640 1 -- 172.21.15.114:0/310421779 learned_addr learned my addr 172.21.15.114:0/310421779 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:42.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.718+0000 7f8887fff640 1 -- 172.21.15.114:0/310421779 >> v1:172.21.15.141:6789/0 conn(0x7f88880c48e0 legacy=0x7f88880adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:42.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.718+0000 7f8887fff640 1 -- 172.21.15.114:0/310421779 >> v1:172.21.15.114:6789/0 conn(0x7f88880ae1d0 legacy=0x7f88880709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.718+0000 7f8887fff640 1 -- 172.21.15.114:0/310421779 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888815a9a0 con 0x7f8888159c00 2023-11-04T01:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.718+0000 7f8886ffd640 1 -- 172.21.15.114:0/310421779 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641005227 0 0) 0x7f888815aff0 con 0x7f88880ae1d0 2023-11-04T01:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.718+0000 7f8887fff640 1 --2- 172.21.15.114:0/310421779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8888159c00 0x7f88880cc890 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f88780097a0 tx=0x7f887802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf055b639584b50 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.718+0000 7f8886ffd640 1 -- 172.21.15.114:0/310421779 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887802e070 con 0x7f8888159c00 2023-11-04T01:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.718+0000 7f8886ffd640 1 -- 172.21.15.114:0/310421779 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88780315a0 con 0x7f8888159c00 2023-11-04T01:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.719+0000 7f8886ffd640 1 -- 172.21.15.114:0/310421779 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878031930 con 0x7f8888159c00 2023-11-04T01:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.719+0000 7f888e8d4640 1 -- 172.21.15.114:0/310421779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8888159c00 msgr2=0x7f88880cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.719+0000 7f888e8d4640 1 --2- 172.21.15.114:0/310421779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8888159c00 0x7f88880cc890 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f88780097a0 tx=0x7f887802b840 comp rx=0 tx=0).stop 2023-11-04T01:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.719+0000 7f888e8d4640 1 -- 172.21.15.114:0/310421779 shutdown_connections 2023-11-04T01:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.719+0000 7f888e8d4640 1 --2- 172.21.15.114:0/310421779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8888159c00 0x7f88880cc890 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.719+0000 7f888e8d4640 1 -- 172.21.15.114:0/310421779 >> 172.21.15.114:0/310421779 conn(0x7f88880ce950 msgr2=0x7f88880ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.719+0000 7f888e8d4640 1 -- 172.21.15.114:0/310421779 shutdown_connections 2023-11-04T01:36:42.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.719+0000 7f888e8d4640 1 -- 172.21.15.114:0/310421779 wait complete. 2023-11-04T01:36:42.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.720+0000 7f888e8d4640 1 Processor -- start 2023-11-04T01:36:42.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.720+0000 7f888e8d4640 1 -- start start 2023-11-04T01:36:42.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f888e8d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f88880ae1d0 0x7f88881f1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f888e8d4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88880c48e0 0x7f88880c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f888e8d4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8888159c00 0x7f88880c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f888e8d4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8888150350 con 0x7f88880c48e0 2023-11-04T01:36:42.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f888e8d4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888814cd90 con 0x7f8888159c00 2023-11-04T01:36:42.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f888e8d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88881507f0 con 0x7f88880ae1d0 2023-11-04T01:36:42.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f88877fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88880c48e0 0x7f88880c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f88877fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88880c48e0 0x7f88880c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48844/0 (socket says 172.21.15.114:48844) 2023-11-04T01:36:42.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f88877fe640 1 -- 172.21.15.114:0/1678467159 learned_addr learned my addr 172.21.15.114:0/1678467159 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:42.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f888ce71640 1 --2- 172.21.15.114:0/1678467159 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8888159c00 0x7f88880c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f88877fe640 1 -- 172.21.15.114:0/1678467159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f88880ae1d0 msgr2=0x7f88881f1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f8887fff640 1 --2- 172.21.15.114:0/1678467159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f88880ae1d0 0x7f88881f1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f88877fe640 1 --2- 172.21.15.114:0/1678467159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f88880ae1d0 0x7f88881f1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f88877fe640 1 -- 172.21.15.114:0/1678467159 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8888159c00 msgr2=0x7f88880c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f88877fe640 1 --2- 172.21.15.114:0/1678467159 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8888159c00 0x7f88880c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f88877fe640 1 -- 172.21.15.114:0/1678467159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8878009400 con 0x7f88880c48e0 2023-11-04T01:36:42.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f8887fff640 1 --2- 172.21.15.114:0/1678467159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f88880ae1d0 0x7f88881f1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:42.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.721+0000 7f888ce71640 1 --2- 172.21.15.114:0/1678467159 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8888159c00 0x7f88880c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:42.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.722+0000 7f88877fe640 1 --2- 172.21.15.114:0/1678467159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88880c48e0 0x7f88880c7a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f887c00c430 tx=0x7f887c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.722+0000 7f8884ff9640 1 -- 172.21.15.114:0/1678467159 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c011790 con 0x7f88880c48e0 2023-11-04T01:36:42.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.722+0000 7f8884ff9640 1 -- 172.21.15.114:0/1678467159 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887c0118f0 con 0x7f88880c48e0 2023-11-04T01:36:42.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.722+0000 7f888e8d4640 1 -- 172.21.15.114:0/1678467159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88881f1760 con 0x7f88880c48e0 2023-11-04T01:36:42.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.722+0000 7f8884ff9640 1 -- 172.21.15.114:0/1678467159 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c011ce0 con 0x7f88880c48e0 2023-11-04T01:36:42.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.722+0000 7f888e8d4640 1 -- 172.21.15.114:0/1678467159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888814f320 con 0x7f88880c48e0 2023-11-04T01:36:42.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.723+0000 7f888e8d4640 1 -- 172.21.15.114:0/1678467159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8888074290 con 0x7f88880c48e0 2023-11-04T01:36:42.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.723+0000 7f8884ff9640 1 -- 172.21.15.114:0/1678467159 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f887c01c460 con 0x7f88880c48e0 2023-11-04T01:36:42.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.723+0000 7f8884ff9640 1 --2- 172.21.15.114:0/1678467159 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f887406aea0 0x7f887406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:42.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.724+0000 7f8884ff9640 1 -- 172.21.15.114:0/1678467159 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f887c089890 con 0x7f88880c48e0 2023-11-04T01:36:42.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.724+0000 7f8887fff640 1 --2- 172.21.15.114:0/1678467159 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f887406aea0 0x7f887406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:42.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.724+0000 7f8887fff640 1 --2- 172.21.15.114:0/1678467159 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f887406aea0 0x7f887406d360 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8878036000 tx=0x7f887803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:42.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.728+0000 7f8884ff9640 1 -- 172.21.15.114:0/1678467159 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f887c054650 con 0x7f88880c48e0 2023-11-04T01:36:42.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.910+0000 7f888e8d4640 1 -- 172.21.15.114:0/1678467159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f88880cedd0 con 0x7f88880c48e0 2023-11-04T01:36:42.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.910+0000 7f8884ff9640 1 -- 172.21.15.114:0/1678467159 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f887c057c70 con 0x7f88880c48e0 2023-11-04T01:36:42.912 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-11-04T01:36:42.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.912+0000 7f888e8d4640 1 -- 172.21.15.114:0/1678467159 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f887406aea0 msgr2=0x7f887406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.912+0000 7f888e8d4640 1 --2- 172.21.15.114:0/1678467159 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f887406aea0 0x7f887406d360 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8878036000 tx=0x7f887803d040 comp rx=0 tx=0).stop 2023-11-04T01:36:42.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.912+0000 7f888e8d4640 1 -- 172.21.15.114:0/1678467159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88880c48e0 msgr2=0x7f88880c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:42.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.912+0000 7f888e8d4640 1 --2- 172.21.15.114:0/1678467159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88880c48e0 0x7f88880c7a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f887c00c430 tx=0x7f887c00c8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.912+0000 7f888e8d4640 1 -- 172.21.15.114:0/1678467159 shutdown_connections 2023-11-04T01:36:42.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.912+0000 7f888e8d4640 1 --2- 172.21.15.114:0/1678467159 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f887406aea0 0x7f887406d360 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.912+0000 7f888e8d4640 1 --2- 172.21.15.114:0/1678467159 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8888159c00 0x7f88880c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.912+0000 7f888e8d4640 1 --2- 172.21.15.114:0/1678467159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88880c48e0 0x7f88880c7a30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.912+0000 7f888e8d4640 1 --2- 172.21.15.114:0/1678467159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f88880ae1d0 0x7f88881f1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:42.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.912+0000 7f888e8d4640 1 -- 172.21.15.114:0/1678467159 >> 172.21.15.114:0/1678467159 conn(0x7f88880ce950 msgr2=0x7f888806cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:42.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.912+0000 7f888e8d4640 1 -- 172.21.15.114:0/1678467159 shutdown_connections 2023-11-04T01:36:42.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:42.912+0000 7f888e8d4640 1 -- 172.21.15.114:0/1678467159 wait complete. 2023-11-04T01:36:42.926 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:36:42.927 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:36:42.942 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:43.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.082+0000 7f8140aa9640 1 Processor -- start 2023-11-04T01:36:43.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.082+0000 7f8140aa9640 1 -- start start 2023-11-04T01:36:43.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.083+0000 7f8140aa9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f813c15ae40 0x7f813c15bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.083+0000 7f8140aa9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f813c0cbc00 0x7f813c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.083+0000 7f8140aa9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f813c0cd860 0x7f813c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.083+0000 7f8140aa9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813c0cc450 con 0x7f813c0cd860 2023-11-04T01:36:43.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.083+0000 7f8140aa9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813c15f400 con 0x7f813c0cbc00 2023-11-04T01:36:43.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.083+0000 7f8140aa9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c15b220 con 0x7f813c15ae40 2023-11-04T01:36:43.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.083+0000 7f813ad9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f813c0cd860 0x7f813c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.084+0000 7f813ad9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f813c0cd860 0x7f813c0b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48846/0 (socket says 172.21.15.114:48846) 2023-11-04T01:36:43.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.084+0000 7f813ad9d640 1 -- 172.21.15.114:0/2286340325 learned_addr learned my addr 172.21.15.114:0/2286340325 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:43.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.084+0000 7f813a59c640 1 --2- 172.21.15.114:0/2286340325 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f813c15ae40 0x7f813c15bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.084+0000 7f8139d9b640 1 --2- 172.21.15.114:0/2286340325 >> v2:172.21.15.141:3300/0 conn(0x7f813c0cbc00 0x7f813c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.084+0000 7f813ad9d640 1 -- 172.21.15.114:0/2286340325 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f813c15ae40 msgr2=0x7f813c15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:43.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.084+0000 7f813ad9d640 1 --2- 172.21.15.114:0/2286340325 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f813c15ae40 0x7f813c15bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.084+0000 7f813ad9d640 1 -- 172.21.15.114:0/2286340325 >> v2:172.21.15.141:3300/0 conn(0x7f813c0cbc00 msgr2=0x7f813c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:43.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.084+0000 7f813ad9d640 1 --2- 172.21.15.114:0/2286340325 >> v2:172.21.15.141:3300/0 conn(0x7f813c0cbc00 0x7f813c0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.084+0000 7f813ad9d640 1 -- 172.21.15.114:0/2286340325 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c15f890 con 0x7f813c0cd860 2023-11-04T01:36:43.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.084+0000 7f813ad9d640 1 --2- 172.21.15.114:0/2286340325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f813c0cd860 0x7f813c0b2620 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f813c0b36a0 tx=0x7f812c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b10622dd52c5aa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.085+0000 7f813959a640 1 -- 172.21.15.114:0/2286340325 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c02ca70 con 0x7f813c0cd860 2023-11-04T01:36:43.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.085+0000 7f813959a640 1 -- 172.21.15.114:0/2286340325 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c02cbd0 con 0x7f813c0cd860 2023-11-04T01:36:43.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.085+0000 7f813959a640 1 -- 172.21.15.114:0/2286340325 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c0343f0 con 0x7f813c0cd860 2023-11-04T01:36:43.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.085+0000 7f8140aa9640 1 -- 172.21.15.114:0/2286340325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f813c0cd860 msgr2=0x7f813c0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.085+0000 7f8140aa9640 1 --2- 172.21.15.114:0/2286340325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f813c0cd860 0x7f813c0b2620 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f813c0b36a0 tx=0x7f812c02bed0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.085+0000 7f8140aa9640 1 -- 172.21.15.114:0/2286340325 shutdown_connections 2023-11-04T01:36:43.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.085+0000 7f8140aa9640 1 --2- 172.21.15.114:0/2286340325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f813c0cd860 0x7f813c0b2620 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.085+0000 7f8140aa9640 1 --2- 172.21.15.114:0/2286340325 >> v2:172.21.15.141:3300/0 conn(0x7f813c0cbc00 0x7f813c0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.085+0000 7f8140aa9640 1 --2- 172.21.15.114:0/2286340325 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f813c15ae40 0x7f813c15bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.085+0000 7f8140aa9640 1 -- 172.21.15.114:0/2286340325 >> 172.21.15.114:0/2286340325 conn(0x7f813c06ea90 msgr2=0x7f813c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.085+0000 7f8140aa9640 1 -- 172.21.15.114:0/2286340325 shutdown_connections 2023-11-04T01:36:43.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.085+0000 7f8140aa9640 1 -- 172.21.15.114:0/2286340325 wait complete. 2023-11-04T01:36:43.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.087+0000 7f8140aa9640 1 Processor -- start 2023-11-04T01:36:43.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.087+0000 7f8140aa9640 1 -- start start 2023-11-04T01:36:43.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.087+0000 7f8140aa9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f813c0cbc00 0x7f813c0c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.087+0000 7f8140aa9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f813c0cd860 0x7f813c0ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.087+0000 7f8140aa9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f813c15ae40 0x7f813c155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.087+0000 7f8140aa9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0c6090 con 0x7f813c0cd860 2023-11-04T01:36:43.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.087+0000 7f8140aa9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0c92e0 con 0x7f813c0cbc00 2023-11-04T01:36:43.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.087+0000 7f8140aa9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0c54a0 con 0x7f813c15ae40 2023-11-04T01:36:43.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.087+0000 7f8139d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f813c0cd860 0x7f813c0ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.087+0000 7f8139d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f813c0cd860 0x7f813c0ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48860/0 (socket says 172.21.15.114:48860) 2023-11-04T01:36:43.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.087+0000 7f8139d9b640 1 -- 172.21.15.114:0/3023466589 learned_addr learned my addr 172.21.15.114:0/3023466589 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:43.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.087+0000 7f813a59c640 1 --2- 172.21.15.114:0/3023466589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f813c0cbc00 0x7f813c0c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.087+0000 7f813ad9d640 1 --2- 172.21.15.114:0/3023466589 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f813c15ae40 0x7f813c155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.088+0000 7f8139d9b640 1 -- 172.21.15.114:0/3023466589 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f813c15ae40 msgr2=0x7f813c155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.088+0000 7f8139d9b640 1 --2- 172.21.15.114:0/3023466589 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f813c15ae40 0x7f813c155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.088+0000 7f8139d9b640 1 -- 172.21.15.114:0/3023466589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f813c0cbc00 msgr2=0x7f813c0c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.088+0000 7f8139d9b640 1 --2- 172.21.15.114:0/3023466589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f813c0cbc00 0x7f813c0c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.088+0000 7f8139d9b640 1 -- 172.21.15.114:0/3023466589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c009b30 con 0x7f813c0cd860 2023-11-04T01:36:43.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.088+0000 7f8139d9b640 1 --2- 172.21.15.114:0/3023466589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f813c0cd860 0x7f813c0ca0f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f813000c5a0 tx=0x7f813000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.088+0000 7f812affd640 1 -- 172.21.15.114:0/3023466589 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130004220 con 0x7f813c0cd860 2023-11-04T01:36:43.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.088+0000 7f812affd640 1 -- 172.21.15.114:0/3023466589 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8130004380 con 0x7f813c0cd860 2023-11-04T01:36:43.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.088+0000 7f8140aa9640 1 -- 172.21.15.114:0/3023466589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813c0c56f0 con 0x7f813c0cd860 2023-11-04T01:36:43.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.088+0000 7f812affd640 1 -- 172.21.15.114:0/3023466589 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130003850 con 0x7f813c0cd860 2023-11-04T01:36:43.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.088+0000 7f8140aa9640 1 -- 172.21.15.114:0/3023466589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813c0c5cb0 con 0x7f813c0cd860 2023-11-04T01:36:43.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.089+0000 7f8140aa9640 1 -- 172.21.15.114:0/3023466589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813c0ce2d0 con 0x7f813c0cd860 2023-11-04T01:36:43.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.089+0000 7f812affd640 1 -- 172.21.15.114:0/3023466589 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81300039b0 con 0x7f813c0cd860 2023-11-04T01:36:43.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.090+0000 7f812affd640 1 --2- 172.21.15.114:0/3023466589 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f811c06ae70 0x7f811c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.090+0000 7f812affd640 1 -- 172.21.15.114:0/3023466589 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8130089400 con 0x7f813c0cd860 2023-11-04T01:36:43.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.090+0000 7f813a59c640 1 --2- 172.21.15.114:0/3023466589 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f811c06ae70 0x7f811c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.090+0000 7f813a59c640 1 --2- 172.21.15.114:0/3023466589 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f811c06ae70 0x7f811c06d330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f813400aac0 tx=0x7f8134008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.094+0000 7f812affd640 1 -- 172.21.15.114:0/3023466589 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8130054300 con 0x7f813c0cd860 2023-11-04T01:36:43.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.265+0000 7f8140aa9640 1 -- 172.21.15.114:0/3023466589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f813c0c61d0 con 0x7f813c0cd860 2023-11-04T01:36:43.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.266+0000 7f812affd640 1 -- 172.21.15.114:0/3023466589 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18406 (secure 0 0 0) 0x7f813c0c61d0 con 0x7f813c0cd860 2023-11-04T01:36:43.268 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:43.268 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:34.950923+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:43.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.268+0000 7f8140aa9640 1 -- 172.21.15.114:0/3023466589 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f811c06ae70 msgr2=0x7f811c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.268+0000 7f8140aa9640 1 --2- 172.21.15.114:0/3023466589 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f811c06ae70 0x7f811c06d330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f813400aac0 tx=0x7f8134008040 comp rx=0 tx=0).stop 2023-11-04T01:36:43.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.268+0000 7f8140aa9640 1 -- 172.21.15.114:0/3023466589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f813c0cd860 msgr2=0x7f813c0ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.268+0000 7f8140aa9640 1 --2- 172.21.15.114:0/3023466589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f813c0cd860 0x7f813c0ca0f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f813000c5a0 tx=0x7f813000ca60 comp rx=0 tx=0).stop 2023-11-04T01:36:43.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.268+0000 7f8140aa9640 1 -- 172.21.15.114:0/3023466589 shutdown_connections 2023-11-04T01:36:43.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.268+0000 7f8140aa9640 1 --2- 172.21.15.114:0/3023466589 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f813c15ae40 0x7f813c155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.268+0000 7f8140aa9640 1 --2- 172.21.15.114:0/3023466589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f813c0cd860 0x7f813c0ca0f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.268+0000 7f8140aa9640 1 --2- 172.21.15.114:0/3023466589 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f811c06ae70 0x7f811c06d330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.268+0000 7f8140aa9640 1 --2- 172.21.15.114:0/3023466589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f813c0cbc00 0x7f813c0c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.268+0000 7f8140aa9640 1 -- 172.21.15.114:0/3023466589 >> 172.21.15.114:0/3023466589 conn(0x7f813c06ea90 msgr2=0x7f813c0b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.268+0000 7f8140aa9640 1 -- 172.21.15.114:0/3023466589 shutdown_connections 2023-11-04T01:36:43.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.268+0000 7f8140aa9640 1 -- 172.21.15.114:0/3023466589 wait complete. 2023-11-04T01:36:43.280 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:43.281 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:43.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.381+0000 7f7c1407c640 1 Processor -- start 2023-11-04T01:36:43.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.381+0000 7f7c1407c640 1 -- start start 2023-11-04T01:36:43.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.382+0000 7f7c1407c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7c0c160430 0x7f7c0c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.382+0000 7f7c1407c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c06c3a0 0x7f7c0c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.382+0000 7f7c1407c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c0b2fc0 con 0x7f7c0c0b2b60 2023-11-04T01:36:43.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.382+0000 7f7c1407c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0c0cb580 con 0x7f7c0c160430 2023-11-04T01:36:43.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.382+0000 7f7c1407c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c06c7f0 con 0x7f7c0c06c3a0 2023-11-04T01:36:43.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.382+0000 7f7c11e18640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7c0c160430 0x7f7c0c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.382+0000 7f7c11e18640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7c0c160430 0x7f7c0c0b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48872/0 (socket says 172.21.15.114:48872) 2023-11-04T01:36:43.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.382+0000 7f7c11e18640 1 -- 172.21.15.114:0/1827202205 learned_addr learned my addr 172.21.15.114:0/1827202205 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:43.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.382+0000 7f7c11617640 1 --1- 172.21.15.114:0/1827202205 >> v1:172.21.15.114:6789/0 conn(0x7f7c0c0b2b60 0x7f7c0c06bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45424/0 (socket says 172.21.15.114:45424) 2023-11-04T01:36:43.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.383+0000 7f7c12619640 1 --2- 172.21.15.114:0/1827202205 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c06c3a0 0x7f7c0c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.383+0000 7f7c11e18640 1 -- 172.21.15.114:0/1827202205 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c06c3a0 msgr2=0x7f7c0c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:43.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.383+0000 7f7c11e18640 1 --2- 172.21.15.114:0/1827202205 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c06c3a0 0x7f7c0c0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.383+0000 7f7c11e18640 1 -- 172.21.15.114:0/1827202205 >> v1:172.21.15.114:6789/0 conn(0x7f7c0c0b2b60 legacy=0x7f7c0c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.383+0000 7f7c10e16640 1 -- 172.21.15.114:0/1827202205 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812346881 0 0) 0x7f7c0c0b2fc0 con 0x7f7c0c0b2b60 2023-11-04T01:36:43.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.383+0000 7f7c11e18640 1 -- 172.21.15.114:0/1827202205 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c06ca40 con 0x7f7c0c160430 2023-11-04T01:36:43.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.383+0000 7f7c12619640 1 --2- 172.21.15.114:0/1827202205 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c06c3a0 0x7f7c0c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:43.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.383+0000 7f7c11e18640 1 --2- 172.21.15.114:0/1827202205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c0c160430 0x7f7c0c0b2620 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009e50 tx=0x7f7bfc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994665a9d461c9e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.383+0000 7f7c10e16640 1 -- 172.21.15.114:0/1827202205 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc02cb00 con 0x7f7c0c160430 2023-11-04T01:36:43.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.383+0000 7f7c10e16640 1 -- 172.21.15.114:0/1827202205 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc02cc60 con 0x7f7c0c160430 2023-11-04T01:36:43.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.383+0000 7f7c10e16640 1 -- 172.21.15.114:0/1827202205 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0343f0 con 0x7f7c0c160430 2023-11-04T01:36:43.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.384+0000 7f7c1407c640 1 -- 172.21.15.114:0/1827202205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c0c160430 msgr2=0x7f7c0c0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.384+0000 7f7c1407c640 1 --2- 172.21.15.114:0/1827202205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c0c160430 0x7f7c0c0b2620 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009e50 tx=0x7f7bfc02bf60 comp rx=0 tx=0).stop 2023-11-04T01:36:43.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.384+0000 7f7c1407c640 1 -- 172.21.15.114:0/1827202205 shutdown_connections 2023-11-04T01:36:43.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.384+0000 7f7c1407c640 1 --2- 172.21.15.114:0/1827202205 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c06c3a0 0x7f7c0c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.384+0000 7f7c1407c640 1 --2- 172.21.15.114:0/1827202205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c0c160430 0x7f7c0c0b2620 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.384+0000 7f7c1407c640 1 -- 172.21.15.114:0/1827202205 >> 172.21.15.114:0/1827202205 conn(0x7f7c0c06ea20 msgr2=0x7f7c0c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.384+0000 7f7c1407c640 1 -- 172.21.15.114:0/1827202205 shutdown_connections 2023-11-04T01:36:43.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.384+0000 7f7c1407c640 1 -- 172.21.15.114:0/1827202205 wait complete. 2023-11-04T01:36:43.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.385+0000 7f7c1407c640 1 Processor -- start 2023-11-04T01:36:43.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.385+0000 7f7c1407c640 1 -- start start 2023-11-04T01:36:43.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c1407c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c0c06c3a0 0x7f7c0c152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c1407c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c0c0b2b60 0x7f7c0c0c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c1407c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c160430 0x7f7c0c0ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c1407c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c1f6910 con 0x7f7c0c0b2b60 2023-11-04T01:36:43.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c1407c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c1f5fe0 con 0x7f7c0c06c3a0 2023-11-04T01:36:43.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c1407c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c1f62c0 con 0x7f7c0c160430 2023-11-04T01:36:43.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c11617640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c0c0b2b60 0x7f7c0c0c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c11617640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c0c0b2b60 0x7f7c0c0c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48882/0 (socket says 172.21.15.114:48882) 2023-11-04T01:36:43.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c11617640 1 -- 172.21.15.114:0/1197617679 learned_addr learned my addr 172.21.15.114:0/1197617679 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:43.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c11e18640 1 --2- 172.21.15.114:0/1197617679 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c0c06c3a0 0x7f7c0c152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c12619640 1 --2- 172.21.15.114:0/1197617679 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c160430 0x7f7c0c0ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c11617640 1 -- 172.21.15.114:0/1197617679 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c160430 msgr2=0x7f7c0c0ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c11617640 1 --2- 172.21.15.114:0/1197617679 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c160430 0x7f7c0c0ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c11617640 1 -- 172.21.15.114:0/1197617679 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c0c06c3a0 msgr2=0x7f7c0c152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c11617640 1 --2- 172.21.15.114:0/1197617679 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c0c06c3a0 0x7f7c0c152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c11617640 1 -- 172.21.15.114:0/1197617679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bfc009b30 con 0x7f7c0c0b2b60 2023-11-04T01:36:43.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c11e18640 1 --2- 172.21.15.114:0/1197617679 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c0c06c3a0 0x7f7c0c152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:43.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.386+0000 7f7c12619640 1 --2- 172.21.15.114:0/1197617679 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c160430 0x7f7c0c0ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:43.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.387+0000 7f7c11617640 1 --2- 172.21.15.114:0/1197617679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c0c0b2b60 0x7f7c0c0c9da0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000c4d0 tx=0x7f7c0000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.387+0000 7f7c0a7fc640 1 -- 172.21.15.114:0/1197617679 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c000074e0 con 0x7f7c0c0b2b60 2023-11-04T01:36:43.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.387+0000 7f7c0a7fc640 1 -- 172.21.15.114:0/1197617679 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c00007660 con 0x7f7c0c0b2b60 2023-11-04T01:36:43.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.387+0000 7f7c0a7fc640 1 -- 172.21.15.114:0/1197617679 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00004a20 con 0x7f7c0c0b2b60 2023-11-04T01:36:43.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.387+0000 7f7c1407c640 1 -- 172.21.15.114:0/1197617679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0c1f65a0 con 0x7f7c0c0b2b60 2023-11-04T01:36:43.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.387+0000 7f7c1407c640 1 -- 172.21.15.114:0/1197617679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c1f2aa0 con 0x7f7c0c0b2b60 2023-11-04T01:36:43.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.388+0000 7f7c1407c640 1 -- 172.21.15.114:0/1197617679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0c074290 con 0x7f7c0c0b2b60 2023-11-04T01:36:43.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.388+0000 7f7c0a7fc640 1 -- 172.21.15.114:0/1197617679 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c00004b80 con 0x7f7c0c0b2b60 2023-11-04T01:36:43.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.388+0000 7f7c0a7fc640 1 --2- 172.21.15.114:0/1197617679 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7bf806ae70 0x7f7bf806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.389+0000 7f7c0a7fc640 1 -- 172.21.15.114:0/1197617679 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7c00088a10 con 0x7f7c0c0b2b60 2023-11-04T01:36:43.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.389+0000 7f7c11e18640 1 --2- 172.21.15.114:0/1197617679 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7bf806ae70 0x7f7bf806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.389+0000 7f7c11e18640 1 --2- 172.21.15.114:0/1197617679 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7bf806ae70 0x7f7bf806d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc035000 tx=0x7f7bfc030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.393+0000 7f7c0a7fc640 1 -- 172.21.15.114:0/1197617679 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c00053860 con 0x7f7c0c0b2b60 2023-11-04T01:36:43.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.559+0000 7f7c1407c640 1 -- 172.21.15.114:0/1197617679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c0c0b6b20 con 0x7f7c0c0b2b60 2023-11-04T01:36:43.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.559+0000 7f7c0a7fc640 1 -- 172.21.15.114:0/1197617679 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7c00018020 con 0x7f7c0c0b2b60 2023-11-04T01:36:43.561 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:36:43.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.561+0000 7f7c1407c640 1 -- 172.21.15.114:0/1197617679 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7bf806ae70 msgr2=0x7f7bf806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.561+0000 7f7c1407c640 1 --2- 172.21.15.114:0/1197617679 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7bf806ae70 0x7f7bf806d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc035000 tx=0x7f7bfc030000 comp rx=0 tx=0).stop 2023-11-04T01:36:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.561+0000 7f7c1407c640 1 -- 172.21.15.114:0/1197617679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c0c0b2b60 msgr2=0x7f7c0c0c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.561+0000 7f7c1407c640 1 --2- 172.21.15.114:0/1197617679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c0c0b2b60 0x7f7c0c0c9da0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000c4d0 tx=0x7f7c0000c990 comp rx=0 tx=0).stop 2023-11-04T01:36:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.561+0000 7f7c1407c640 1 -- 172.21.15.114:0/1197617679 shutdown_connections 2023-11-04T01:36:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.561+0000 7f7c1407c640 1 --2- 172.21.15.114:0/1197617679 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7c0c160430 0x7f7c0c0ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.561+0000 7f7c1407c640 1 --2- 172.21.15.114:0/1197617679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c0c0b2b60 0x7f7c0c0c9da0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.561+0000 7f7c1407c640 1 --2- 172.21.15.114:0/1197617679 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7bf806ae70 0x7f7bf806d330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.561+0000 7f7c1407c640 1 --2- 172.21.15.114:0/1197617679 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7c0c06c3a0 0x7f7c0c152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.561+0000 7f7c1407c640 1 -- 172.21.15.114:0/1197617679 >> 172.21.15.114:0/1197617679 conn(0x7f7c0c06ea20 msgr2=0x7f7c0c0ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.561+0000 7f7c1407c640 1 -- 172.21.15.114:0/1197617679 shutdown_connections 2023-11-04T01:36:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.561+0000 7f7c1407c640 1 -- 172.21.15.114:0/1197617679 wait complete. 2023-11-04T01:36:43.574 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:43.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.674+0000 7f9833933640 1 Processor -- start 2023-11-04T01:36:43.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.674+0000 7f9833933640 1 -- start start 2023-11-04T01:36:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.675+0000 7f9833933640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f982c160430 0x7f982c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.675+0000 7f9833933640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f982c0b2b60 0x7f982c06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.675+0000 7f9833933640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982c0b2fc0 con 0x7f982c06c1d0 2023-11-04T01:36:43.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.675+0000 7f9833933640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982c0cb580 con 0x7f982c0b2b60 2023-11-04T01:36:43.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.675+0000 7f9833933640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c06ca40 con 0x7f982c160430 2023-11-04T01:36:43.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.675+0000 7f9830ece640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f982c0b2b60 0x7f982c06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.675+0000 7f9831ed0640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f982c06c1d0 0x7f982c160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45438/0 (socket says 172.21.15.114:45438) 2023-11-04T01:36:43.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.675+0000 7f9831ed0640 1 -- 172.21.15.114:0/3119237369 learned_addr learned my addr 172.21.15.114:0/3119237369 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:43.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.675+0000 7f98316cf640 1 --2- 172.21.15.114:0/3119237369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f982c160430 0x7f982c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.676+0000 7f9830ece640 1 -- 172.21.15.114:0/3119237369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f982c160430 msgr2=0x7f982c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:43.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.676+0000 7f9830ece640 1 --2- 172.21.15.114:0/3119237369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f982c160430 0x7f982c0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.676+0000 7f9830ece640 1 -- 172.21.15.114:0/3119237369 >> v1:172.21.15.114:6789/0 conn(0x7f982c06c1d0 legacy=0x7f982c160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.676+0000 7f9830ece640 1 -- 172.21.15.114:0/3119237369 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c06cd20 con 0x7f982c0b2b60 2023-11-04T01:36:43.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.676+0000 7f9830ece640 1 --2- 172.21.15.114:0/3119237369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f982c0b2b60 0x7f982c06bc90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f981c0097a0 tx=0x7f981c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4191071daa9170e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.676+0000 7f9823fff640 1 -- 172.21.15.114:0/3119237369 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c031830 con 0x7f982c0b2b60 2023-11-04T01:36:43.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.676+0000 7f9823fff640 1 -- 172.21.15.114:0/3119237369 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c031990 con 0x7f982c0b2b60 2023-11-04T01:36:43.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.676+0000 7f9823fff640 1 -- 172.21.15.114:0/3119237369 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c031d20 con 0x7f982c0b2b60 2023-11-04T01:36:43.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.677+0000 7f9833933640 1 -- 172.21.15.114:0/3119237369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f982c0b2b60 msgr2=0x7f982c06bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.677+0000 7f9833933640 1 --2- 172.21.15.114:0/3119237369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f982c0b2b60 0x7f982c06bc90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f981c0097a0 tx=0x7f981c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.677+0000 7f9833933640 1 -- 172.21.15.114:0/3119237369 shutdown_connections 2023-11-04T01:36:43.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.677+0000 7f9833933640 1 --2- 172.21.15.114:0/3119237369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f982c0b2b60 0x7f982c06bc90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.677+0000 7f9833933640 1 --2- 172.21.15.114:0/3119237369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f982c160430 0x7f982c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.677+0000 7f9833933640 1 -- 172.21.15.114:0/3119237369 >> 172.21.15.114:0/3119237369 conn(0x7f982c06ea20 msgr2=0x7f982c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.677+0000 7f9833933640 1 -- 172.21.15.114:0/3119237369 shutdown_connections 2023-11-04T01:36:43.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.677+0000 7f9833933640 1 -- 172.21.15.114:0/3119237369 wait complete. 2023-11-04T01:36:43.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.678+0000 7f9833933640 1 Processor -- start 2023-11-04T01:36:43.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.678+0000 7f9833933640 1 -- start start 2023-11-04T01:36:43.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f9833933640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f982c06c1d0 0x7f982c0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f9833933640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f982c0b2b60 0x7f982c0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f9833933640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f982c160430 0x7f982c1f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f9833933640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0b4790 con 0x7f982c06c1d0 2023-11-04T01:36:43.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f9833933640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0b4be0 con 0x7f982c0b2b60 2023-11-04T01:36:43.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f9833933640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0b3c10 con 0x7f982c160430 2023-11-04T01:36:43.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f98316cf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f982c06c1d0 0x7f982c0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f98316cf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f982c06c1d0 0x7f982c0cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48886/0 (socket says 172.21.15.114:48886) 2023-11-04T01:36:43.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f98316cf640 1 -- 172.21.15.114:0/2397338208 learned_addr learned my addr 172.21.15.114:0/2397338208 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:43.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f9831ed0640 1 --2- 172.21.15.114:0/2397338208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f982c160430 0x7f982c1f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f9830ece640 1 --2- 172.21.15.114:0/2397338208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f982c0b2b60 0x7f982c0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f98316cf640 1 -- 172.21.15.114:0/2397338208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f982c160430 msgr2=0x7f982c1f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f98316cf640 1 --2- 172.21.15.114:0/2397338208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f982c160430 0x7f982c1f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f98316cf640 1 -- 172.21.15.114:0/2397338208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f982c0b2b60 msgr2=0x7f982c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f98316cf640 1 --2- 172.21.15.114:0/2397338208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f982c0b2b60 0x7f982c0cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f98316cf640 1 -- 172.21.15.114:0/2397338208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c009400 con 0x7f982c06c1d0 2023-11-04T01:36:43.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f9831ed0640 1 --2- 172.21.15.114:0/2397338208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f982c160430 0x7f982c1f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:43.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f9830ece640 1 --2- 172.21.15.114:0/2397338208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f982c0b2b60 0x7f982c0cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:43.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.679+0000 7f98316cf640 1 --2- 172.21.15.114:0/2397338208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f982c06c1d0 0x7f982c0cce30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9828007e40 tx=0x7f982800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.680+0000 7f9821ffb640 1 -- 172.21.15.114:0/2397338208 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828014620 con 0x7f982c06c1d0 2023-11-04T01:36:43.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.680+0000 7f9821ffb640 1 -- 172.21.15.114:0/2397338208 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982800ee90 con 0x7f982c06c1d0 2023-11-04T01:36:43.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.680+0000 7f9833933640 1 -- 172.21.15.114:0/2397338208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982c0b3ef0 con 0x7f982c06c1d0 2023-11-04T01:36:43.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.680+0000 7f9821ffb640 1 -- 172.21.15.114:0/2397338208 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98280149c0 con 0x7f982c06c1d0 2023-11-04T01:36:43.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.680+0000 7f9833933640 1 -- 172.21.15.114:0/2397338208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c0b44b0 con 0x7f982c06c1d0 2023-11-04T01:36:43.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.681+0000 7f9833933640 1 -- 172.21.15.114:0/2397338208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982c074290 con 0x7f982c06c1d0 2023-11-04T01:36:43.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.681+0000 7f9821ffb640 1 -- 172.21.15.114:0/2397338208 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9828014b20 con 0x7f982c06c1d0 2023-11-04T01:36:43.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.682+0000 7f9821ffb640 1 --2- 172.21.15.114:0/2397338208 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f981006ae70 0x7f981006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.682+0000 7f9821ffb640 1 -- 172.21.15.114:0/2397338208 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f982808a360 con 0x7f982c06c1d0 2023-11-04T01:36:43.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.682+0000 7f9830ece640 1 --2- 172.21.15.114:0/2397338208 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f981006ae70 0x7f981006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.682+0000 7f9830ece640 1 --2- 172.21.15.114:0/2397338208 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f981006ae70 0x7f981006d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f981c036000 tx=0x7f981c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.686+0000 7f9821ffb640 1 -- 172.21.15.114:0/2397338208 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9828055090 con 0x7f982c06c1d0 2023-11-04T01:36:43.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.850+0000 7f9833933640 1 -- 172.21.15.114:0/2397338208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f982c0c9470 con 0x7f982c06c1d0 2023-11-04T01:36:43.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.850+0000 7f9821ffb640 1 -- 172.21.15.114:0/2397338208 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f98280586b0 con 0x7f982c06c1d0 2023-11-04T01:36:43.853 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:36:43.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.852+0000 7f9833933640 1 -- 172.21.15.114:0/2397338208 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f981006ae70 msgr2=0x7f981006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.852+0000 7f9833933640 1 --2- 172.21.15.114:0/2397338208 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f981006ae70 0x7f981006d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f981c036000 tx=0x7f981c008030 comp rx=0 tx=0).stop 2023-11-04T01:36:43.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.852+0000 7f9833933640 1 -- 172.21.15.114:0/2397338208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f982c06c1d0 msgr2=0x7f982c0cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.852+0000 7f9833933640 1 --2- 172.21.15.114:0/2397338208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f982c06c1d0 0x7f982c0cce30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9828007e40 tx=0x7f982800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.852+0000 7f9833933640 1 -- 172.21.15.114:0/2397338208 shutdown_connections 2023-11-04T01:36:43.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.852+0000 7f9833933640 1 --2- 172.21.15.114:0/2397338208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f982c160430 0x7f982c1f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.852+0000 7f9833933640 1 --2- 172.21.15.114:0/2397338208 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f981006ae70 0x7f981006d330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.852+0000 7f9833933640 1 --2- 172.21.15.114:0/2397338208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f982c0b2b60 0x7f982c0cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.852+0000 7f9833933640 1 --2- 172.21.15.114:0/2397338208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f982c06c1d0 0x7f982c0cce30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.852+0000 7f9833933640 1 -- 172.21.15.114:0/2397338208 >> 172.21.15.114:0/2397338208 conn(0x7f982c06ea20 msgr2=0x7f982c15d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.852+0000 7f9833933640 1 -- 172.21.15.114:0/2397338208 shutdown_connections 2023-11-04T01:36:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.853+0000 7f9833933640 1 -- 172.21.15.114:0/2397338208 wait complete. 2023-11-04T01:36:43.865 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:43.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.965+0000 7fea28fd0640 1 Processor -- start 2023-11-04T01:36:43.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.965+0000 7fea28fd0640 1 -- start start 2023-11-04T01:36:43.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.966+0000 7fea28fd0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fea24160430 0x7fea240b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.966+0000 7fea28fd0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea240b2b60 0x7fea2406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.966+0000 7fea28fd0640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea240b2fc0 con 0x7fea2406c1d0 2023-11-04T01:36:43.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.966+0000 7fea28fd0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea240cb580 con 0x7fea24160430 2023-11-04T01:36:43.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.966+0000 7fea28fd0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2406ca40 con 0x7fea240b2b60 2023-11-04T01:36:43.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.966+0000 7fea2259c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fea24160430 0x7fea240b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.966+0000 7fea2259c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fea24160430 0x7fea240b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48890/0 (socket says 172.21.15.114:48890) 2023-11-04T01:36:43.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.966+0000 7fea2259c640 1 -- 172.21.15.114:0/16089454 learned_addr learned my addr 172.21.15.114:0/16089454 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:43.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.966+0000 7fea2259c640 1 -- 172.21.15.114:0/16089454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea240b2b60 msgr2=0x7fea2406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:43.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.966+0000 7fea2259c640 1 --2- 172.21.15.114:0/16089454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea240b2b60 0x7fea2406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.966+0000 7fea2259c640 1 -- 172.21.15.114:0/16089454 >> v1:172.21.15.141:6789/0 conn(0x7fea2406c1d0 legacy=0x7fea24160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:43.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.966+0000 7fea2259c640 1 -- 172.21.15.114:0/16089454 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2406cd20 con 0x7fea24160430 2023-11-04T01:36:43.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.967+0000 7fea2259c640 1 --2- 172.21.15.114:0/16089454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea24160430 0x7fea240b2620 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009870 tx=0x7fea1c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481967bbd76e3f40 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.967+0000 7fea2159a640 1 -- 172.21.15.114:0/16089454 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c031640 con 0x7fea24160430 2023-11-04T01:36:43.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.967+0000 7fea2159a640 1 -- 172.21.15.114:0/16089454 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1c0317a0 con 0x7fea24160430 2023-11-04T01:36:43.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.967+0000 7fea2159a640 1 -- 172.21.15.114:0/16089454 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c031b30 con 0x7fea24160430 2023-11-04T01:36:43.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.968+0000 7fea28fd0640 1 -- 172.21.15.114:0/16089454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea24160430 msgr2=0x7fea240b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.968+0000 7fea28fd0640 1 --2- 172.21.15.114:0/16089454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea24160430 0x7fea240b2620 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009870 tx=0x7fea1c02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.968+0000 7fea28fd0640 1 -- 172.21.15.114:0/16089454 shutdown_connections 2023-11-04T01:36:43.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.968+0000 7fea28fd0640 1 --2- 172.21.15.114:0/16089454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea240b2b60 0x7fea2406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.968+0000 7fea28fd0640 1 --2- 172.21.15.114:0/16089454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea24160430 0x7fea240b2620 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.968+0000 7fea28fd0640 1 -- 172.21.15.114:0/16089454 >> 172.21.15.114:0/16089454 conn(0x7fea2406ea20 msgr2=0x7fea2406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:43.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.968+0000 7fea28fd0640 1 -- 172.21.15.114:0/16089454 shutdown_connections 2023-11-04T01:36:43.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.968+0000 7fea28fd0640 1 -- 172.21.15.114:0/16089454 wait complete. 2023-11-04T01:36:43.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.969+0000 7fea28fd0640 1 Processor -- start 2023-11-04T01:36:43.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.969+0000 7fea28fd0640 1 -- start start 2023-11-04T01:36:43.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea28fd0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea2406c1d0 0x7fea241f6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea28fd0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea240b2b60 0x7fea240b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea28fd0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea24160430 0x7fea240cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea28fd0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea241f7060 con 0x7fea2406c1d0 2023-11-04T01:36:43.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea28fd0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea240b5f00 con 0x7fea240b2b60 2023-11-04T01:36:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea28fd0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea241f67c0 con 0x7fea24160430 2023-11-04T01:36:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea2259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea2406c1d0 0x7fea241f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea2259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea2406c1d0 0x7fea241f6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48892/0 (socket says 172.21.15.114:48892) 2023-11-04T01:36:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea2259c640 1 -- 172.21.15.114:0/2734099452 learned_addr learned my addr 172.21.15.114:0/2734099452 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea21d9b640 1 --2- 172.21.15.114:0/2734099452 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea240b2b60 0x7fea240b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea2259c640 1 -- 172.21.15.114:0/2734099452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea24160430 msgr2=0x7fea240cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea22d9d640 1 --2- 172.21.15.114:0/2734099452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea24160430 0x7fea240cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea2259c640 1 --2- 172.21.15.114:0/2734099452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea24160430 0x7fea240cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea2259c640 1 -- 172.21.15.114:0/2734099452 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea240b2b60 msgr2=0x7fea240b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:43.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea2259c640 1 --2- 172.21.15.114:0/2734099452 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea240b2b60 0x7fea240b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:43.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea2259c640 1 -- 172.21.15.114:0/2734099452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c0094d0 con 0x7fea2406c1d0 2023-11-04T01:36:43.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea2259c640 1 --2- 172.21.15.114:0/2734099452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea2406c1d0 0x7fea241f6130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009870 tx=0x7fea1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea12ffd640 1 -- 172.21.15.114:0/2734099452 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c03ac60 con 0x7fea2406c1d0 2023-11-04T01:36:43.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea12ffd640 1 -- 172.21.15.114:0/2734099452 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1c03adc0 con 0x7fea2406c1d0 2023-11-04T01:36:43.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea28fd0640 1 -- 172.21.15.114:0/2734099452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea241f6aa0 con 0x7fea2406c1d0 2023-11-04T01:36:43.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.970+0000 7fea12ffd640 1 -- 172.21.15.114:0/2734099452 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c044630 con 0x7fea2406c1d0 2023-11-04T01:36:43.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.971+0000 7fea28fd0640 1 -- 172.21.15.114:0/2734099452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea241f2ce0 con 0x7fea2406c1d0 2023-11-04T01:36:43.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.971+0000 7fea28fd0640 1 -- 172.21.15.114:0/2734099452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea241f2b40 con 0x7fea2406c1d0 2023-11-04T01:36:43.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.972+0000 7fea12ffd640 1 -- 172.21.15.114:0/2734099452 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea1c02f050 con 0x7fea2406c1d0 2023-11-04T01:36:43.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.972+0000 7fea12ffd640 1 --2- 172.21.15.114:0/2734099452 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fea0406ae70 0x7fea0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:43.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.972+0000 7fea12ffd640 1 -- 172.21.15.114:0/2734099452 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fea1c0ab8e0 con 0x7fea2406c1d0 2023-11-04T01:36:43.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.972+0000 7fea21d9b640 1 --2- 172.21.15.114:0/2734099452 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fea0406ae70 0x7fea0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:43.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.973+0000 7fea21d9b640 1 --2- 172.21.15.114:0/2734099452 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fea0406ae70 0x7fea0406d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fea24155e80 tx=0x7fea18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:43.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:43.976+0000 7fea12ffd640 1 -- 172.21.15.114:0/2734099452 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fea241f2b40 con 0x7fea2406c1d0 2023-11-04T01:36:44.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.142+0000 7fea28fd0640 1 -- 172.21.15.114:0/2734099452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea241f2b40 con 0x7fea2406c1d0 2023-11-04T01:36:44.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.143+0000 7fea12ffd640 1 -- 172.21.15.114:0/2734099452 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea241f2b40 con 0x7fea2406c1d0 2023-11-04T01:36:44.145 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:36:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.144+0000 7fea28fd0640 1 -- 172.21.15.114:0/2734099452 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fea0406ae70 msgr2=0x7fea0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.144+0000 7fea28fd0640 1 --2- 172.21.15.114:0/2734099452 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fea0406ae70 0x7fea0406d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fea24155e80 tx=0x7fea18008040 comp rx=0 tx=0).stop 2023-11-04T01:36:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.144+0000 7fea28fd0640 1 -- 172.21.15.114:0/2734099452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea2406c1d0 msgr2=0x7fea241f6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.144+0000 7fea28fd0640 1 --2- 172.21.15.114:0/2734099452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea2406c1d0 0x7fea241f6130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009870 tx=0x7fea1c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.144+0000 7fea28fd0640 1 -- 172.21.15.114:0/2734099452 shutdown_connections 2023-11-04T01:36:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.144+0000 7fea28fd0640 1 --2- 172.21.15.114:0/2734099452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fea24160430 0x7fea240cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.144+0000 7fea28fd0640 1 --2- 172.21.15.114:0/2734099452 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fea0406ae70 0x7fea0406d330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.144+0000 7fea28fd0640 1 --2- 172.21.15.114:0/2734099452 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fea240b2b60 0x7fea240b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.144+0000 7fea28fd0640 1 --2- 172.21.15.114:0/2734099452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea2406c1d0 0x7fea241f6130 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.145+0000 7fea28fd0640 1 -- 172.21.15.114:0/2734099452 >> 172.21.15.114:0/2734099452 conn(0x7fea2406ea20 msgr2=0x7fea240c9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.145+0000 7fea28fd0640 1 -- 172.21.15.114:0/2734099452 shutdown_connections 2023-11-04T01:36:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.145+0000 7fea28fd0640 1 -- 172.21.15.114:0/2734099452 wait complete. 2023-11-04T01:36:44.159 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:44.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.259+0000 7f3b911a5640 1 Processor -- start 2023-11-04T01:36:44.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.259+0000 7f3b911a5640 1 -- start start 2023-11-04T01:36:44.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.260+0000 7f3b911a5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3b8c071f90 0x7f3b8c0b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.260+0000 7f3b911a5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8c0b1cc0 con 0x7f3b8c072370 2023-11-04T01:36:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.260+0000 7f3b911a5640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8c15a2f0 con 0x7f3b8c15add0 2023-11-04T01:36:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.260+0000 7f3b911a5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8c0b1fa0 con 0x7f3b8c071f90 2023-11-04T01:36:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.260+0000 7f3b8ad9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3b8c071f90 0x7f3b8c0b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.260+0000 7f3b8ad9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3b8c071f90 0x7f3b8c0b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48904/0 (socket says 172.21.15.114:48904) 2023-11-04T01:36:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.260+0000 7f3b8b59e640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3b8c072370 0x7f3b8c0cc5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45448/0 (socket says 172.21.15.114:45448) 2023-11-04T01:36:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.260+0000 7f3b8ad9d640 1 -- 172.21.15.114:0/2614401713 learned_addr learned my addr 172.21.15.114:0/2614401713 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.260+0000 7f3b8ad9d640 1 -- 172.21.15.114:0/2614401713 >> v1:172.21.15.141:6789/0 conn(0x7f3b8c15add0 legacy=0x7f3b8c0cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.260+0000 7f3b8ad9d640 1 -- 172.21.15.114:0/2614401713 >> v1:172.21.15.114:6789/0 conn(0x7f3b8c072370 legacy=0x7f3b8c0cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.260+0000 7f3b8ad9d640 1 -- 172.21.15.114:0/2614401713 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8c15a5d0 con 0x7f3b8c071f90 2023-11-04T01:36:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.260+0000 7f3b89d9b640 1 -- 172.21.15.114:0/2614401713 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206433455 0 0) 0x7f3b8c0b1cc0 con 0x7f3b8c072370 2023-11-04T01:36:44.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.261+0000 7f3b8ad9d640 1 --2- 172.21.15.114:0/2614401713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b8c071f90 0x7f3b8c0b1490 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00d150 tx=0x7f3b7c02e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1c54c5fd9441fc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.261+0000 7f3b89d9b640 1 -- 172.21.15.114:0/2614401713 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c00b0d0 con 0x7f3b8c071f90 2023-11-04T01:36:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.261+0000 7f3b89d9b640 1 -- 172.21.15.114:0/2614401713 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7c00b230 con 0x7f3b8c071f90 2023-11-04T01:36:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.261+0000 7f3b89d9b640 1 -- 172.21.15.114:0/2614401713 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c009600 con 0x7f3b8c071f90 2023-11-04T01:36:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.262+0000 7f3b911a5640 1 -- 172.21.15.114:0/2614401713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b8c071f90 msgr2=0x7f3b8c0b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.262+0000 7f3b911a5640 1 --2- 172.21.15.114:0/2614401713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b8c071f90 0x7f3b8c0b1490 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00d150 tx=0x7f3b7c02e170 comp rx=0 tx=0).stop 2023-11-04T01:36:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.262+0000 7f3b911a5640 1 -- 172.21.15.114:0/2614401713 shutdown_connections 2023-11-04T01:36:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.262+0000 7f3b911a5640 1 --2- 172.21.15.114:0/2614401713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b8c071f90 0x7f3b8c0b1490 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.262+0000 7f3b911a5640 1 -- 172.21.15.114:0/2614401713 >> 172.21.15.114:0/2614401713 conn(0x7f3b8c06d800 msgr2=0x7f3b8c06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.262+0000 7f3b911a5640 1 -- 172.21.15.114:0/2614401713 shutdown_connections 2023-11-04T01:36:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.262+0000 7f3b911a5640 1 -- 172.21.15.114:0/2614401713 wait complete. 2023-11-04T01:36:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.263+0000 7f3b911a5640 1 Processor -- start 2023-11-04T01:36:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.263+0000 7f3b911a5640 1 -- start start 2023-11-04T01:36:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b911a5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b8c071f90 0x7f3b8c14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b911a5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b8c072370 0x7f3b8c0b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b911a5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b8c15add0 0x7f3b8c0c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b911a5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c0af780 con 0x7f3b8c072370 2023-11-04T01:36:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b911a5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c14f100 con 0x7f3b8c071f90 2023-11-04T01:36:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b911a5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c0b2dc0 con 0x7f3b8c15add0 2023-11-04T01:36:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b8a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b8c072370 0x7f3b8c0b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b8a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b8c072370 0x7f3b8c0b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48910/0 (socket says 172.21.15.114:48910) 2023-11-04T01:36:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b8a59c640 1 -- 172.21.15.114:0/3551442349 learned_addr learned my addr 172.21.15.114:0/3551442349 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b8ad9d640 1 --2- 172.21.15.114:0/3551442349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b8c071f90 0x7f3b8c14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b8b59e640 1 --2- 172.21.15.114:0/3551442349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b8c15add0 0x7f3b8c0c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b8a59c640 1 -- 172.21.15.114:0/3551442349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b8c15add0 msgr2=0x7f3b8c0c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b8a59c640 1 --2- 172.21.15.114:0/3551442349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b8c15add0 0x7f3b8c0c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b8a59c640 1 -- 172.21.15.114:0/3551442349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b8c071f90 msgr2=0x7f3b8c14ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b8a59c640 1 --2- 172.21.15.114:0/3551442349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b8c071f90 0x7f3b8c14ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b8a59c640 1 -- 172.21.15.114:0/3551442349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c00bd40 con 0x7f3b8c072370 2023-11-04T01:36:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b8b59e640 1 --2- 172.21.15.114:0/3551442349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b8c15add0 0x7f3b8c0c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.264+0000 7f3b8ad9d640 1 --2- 172.21.15.114:0/3551442349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b8c071f90 0x7f3b8c14ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.265+0000 7f3b8a59c640 1 --2- 172.21.15.114:0/3551442349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b8c072370 0x7f3b8c0b3800 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000c430 tx=0x7f3b8000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.265+0000 7f3b737fe640 1 -- 172.21.15.114:0/3551442349 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80011790 con 0x7f3b8c072370 2023-11-04T01:36:44.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.265+0000 7f3b737fe640 1 -- 172.21.15.114:0/3551442349 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b800118f0 con 0x7f3b8c072370 2023-11-04T01:36:44.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.265+0000 7f3b911a5640 1 -- 172.21.15.114:0/3551442349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8c0b30a0 con 0x7f3b8c072370 2023-11-04T01:36:44.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.265+0000 7f3b737fe640 1 -- 172.21.15.114:0/3551442349 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80011ca0 con 0x7f3b8c072370 2023-11-04T01:36:44.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.265+0000 7f3b911a5640 1 -- 172.21.15.114:0/3551442349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8c0af410 con 0x7f3b8c072370 2023-11-04T01:36:44.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.266+0000 7f3b911a5640 1 -- 172.21.15.114:0/3551442349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8c1514c0 con 0x7f3b8c072370 2023-11-04T01:36:44.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.266+0000 7f3b737fe640 1 -- 172.21.15.114:0/3551442349 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b8001c460 con 0x7f3b8c072370 2023-11-04T01:36:44.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.267+0000 7f3b737fe640 1 --2- 172.21.15.114:0/3551442349 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3b7806aea0 0x7f3b7806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.267+0000 7f3b8ad9d640 1 --2- 172.21.15.114:0/3551442349 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3b7806aea0 0x7f3b7806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.267+0000 7f3b737fe640 1 -- 172.21.15.114:0/3551442349 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3b80089870 con 0x7f3b8c072370 2023-11-04T01:36:44.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.267+0000 7f3b8ad9d640 1 --2- 172.21.15.114:0/3551442349 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3b7806aea0 0x7f3b7806d360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c037000 tx=0x7f3b7c032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.271+0000 7f3b737fe640 1 -- 172.21.15.114:0/3551442349 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b80054630 con 0x7f3b8c072370 2023-11-04T01:36:44.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.435+0000 7f3b911a5640 1 -- 172.21.15.114:0/3551442349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3b8c0cea70 con 0x7f3b8c072370 2023-11-04T01:36:44.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.436+0000 7f3b737fe640 1 -- 172.21.15.114:0/3551442349 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3b80057c50 con 0x7f3b8c072370 2023-11-04T01:36:44.437 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:36:44.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.437+0000 7f3b911a5640 1 -- 172.21.15.114:0/3551442349 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3b7806aea0 msgr2=0x7f3b7806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.437+0000 7f3b911a5640 1 --2- 172.21.15.114:0/3551442349 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3b7806aea0 0x7f3b7806d360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c037000 tx=0x7f3b7c032000 comp rx=0 tx=0).stop 2023-11-04T01:36:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.437+0000 7f3b911a5640 1 -- 172.21.15.114:0/3551442349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b8c072370 msgr2=0x7f3b8c0b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.437+0000 7f3b911a5640 1 --2- 172.21.15.114:0/3551442349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b8c072370 0x7f3b8c0b3800 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000c430 tx=0x7f3b8000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.437+0000 7f3b911a5640 1 -- 172.21.15.114:0/3551442349 shutdown_connections 2023-11-04T01:36:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.437+0000 7f3b911a5640 1 --2- 172.21.15.114:0/3551442349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3b8c15add0 0x7f3b8c0c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.437+0000 7f3b911a5640 1 --2- 172.21.15.114:0/3551442349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b8c072370 0x7f3b8c0b3800 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.437+0000 7f3b911a5640 1 --2- 172.21.15.114:0/3551442349 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3b7806aea0 0x7f3b7806d360 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.437+0000 7f3b911a5640 1 --2- 172.21.15.114:0/3551442349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3b8c071f90 0x7f3b8c14ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.437+0000 7f3b911a5640 1 -- 172.21.15.114:0/3551442349 >> 172.21.15.114:0/3551442349 conn(0x7f3b8c06d800 msgr2=0x7f3b8c0cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.437+0000 7f3b911a5640 1 -- 172.21.15.114:0/3551442349 shutdown_connections 2023-11-04T01:36:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.438+0000 7f3b911a5640 1 -- 172.21.15.114:0/3551442349 wait complete. 2023-11-04T01:36:44.450 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:36:44.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.548+0000 7fd6de505640 1 Processor -- start 2023-11-04T01:36:44.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.548+0000 7fd6de505640 1 -- start start 2023-11-04T01:36:44.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.549+0000 7fd6de505640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6d80d0710 0x7fd6d80cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.549+0000 7fd6de505640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d80d0280 con 0x7fd6d815e430 2023-11-04T01:36:44.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.549+0000 7fd6de505640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d80cdf00 con 0x7fd6d80cda50 2023-11-04T01:36:44.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.549+0000 7fd6de505640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80cf670 con 0x7fd6d80d0710 2023-11-04T01:36:44.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.549+0000 7fd6d7fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd6d815e430 0x7fd6d80cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45462/0 (socket says 172.21.15.114:45462) 2023-11-04T01:36:44.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.549+0000 7fd6d7fff640 1 -- 172.21.15.114:0/758694949 learned_addr learned my addr 172.21.15.114:0/758694949 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:44.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.549+0000 7fd6d77fe640 1 --2- 172.21.15.114:0/758694949 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6d80d0710 0x7fd6d80cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.549+0000 7fd6d6ffd640 1 -- 172.21.15.114:0/758694949 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530379976 0 0) 0x7fd6d80d0280 con 0x7fd6d815e430 2023-11-04T01:36:44.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.549+0000 7fd6d6ffd640 1 -- 172.21.15.114:0/758694949 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6c4003520 con 0x7fd6d815e430 2023-11-04T01:36:44.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.550+0000 7fd6d6ffd640 1 -- 172.21.15.114:0/758694949 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954219586 0 0) 0x7fd6d80cdf00 con 0x7fd6d80cda50 2023-11-04T01:36:44.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.550+0000 7fd6d6ffd640 1 -- 172.21.15.114:0/758694949 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d80d0280 con 0x7fd6d80cda50 2023-11-04T01:36:44.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.550+0000 7fd6d6ffd640 1 -- 172.21.15.114:0/758694949 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3583555404 0 0) 0x7fd6c4003520 con 0x7fd6d815e430 2023-11-04T01:36:44.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.550+0000 7fd6d77fe640 1 -- 172.21.15.114:0/758694949 >> v1:172.21.15.141:6789/0 conn(0x7fd6d80cda50 legacy=0x7fd6d80b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.550+0000 7fd6d77fe640 1 -- 172.21.15.114:0/758694949 >> v1:172.21.15.114:6789/0 conn(0x7fd6d815e430 legacy=0x7fd6d80cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.550+0000 7fd6d77fe640 1 -- 172.21.15.114:0/758694949 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d80cf950 con 0x7fd6d80d0710 2023-11-04T01:36:44.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.550+0000 7fd6d77fe640 1 --2- 172.21.15.114:0/758694949 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6d80d0710 0x7fd6d80cd510 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd6c00097d0 tx=0x7fd6c002b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28013eaf337057eb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.551+0000 7fd6d6ffd640 1 -- 172.21.15.114:0/758694949 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8001670 con 0x7fd6d80d0710 2023-11-04T01:36:44.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.551+0000 7fd6d6ffd640 1 -- 172.21.15.114:0/758694949 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c002e050 con 0x7fd6d80d0710 2023-11-04T01:36:44.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.551+0000 7fd6d6ffd640 1 -- 172.21.15.114:0/758694949 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0030730 con 0x7fd6d80d0710 2023-11-04T01:36:44.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.551+0000 7fd6de505640 1 -- 172.21.15.114:0/758694949 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6d80d0710 msgr2=0x7fd6d80cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.551+0000 7fd6de505640 1 --2- 172.21.15.114:0/758694949 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6d80d0710 0x7fd6d80cd510 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd6c00097d0 tx=0x7fd6c002b800 comp rx=0 tx=0).stop 2023-11-04T01:36:44.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.551+0000 7fd6de505640 1 -- 172.21.15.114:0/758694949 shutdown_connections 2023-11-04T01:36:44.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.551+0000 7fd6de505640 1 --2- 172.21.15.114:0/758694949 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6d80d0710 0x7fd6d80cd510 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.551+0000 7fd6de505640 1 -- 172.21.15.114:0/758694949 >> 172.21.15.114:0/758694949 conn(0x7fd6d806ea20 msgr2=0x7fd6d806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.551+0000 7fd6de505640 1 -- 172.21.15.114:0/758694949 shutdown_connections 2023-11-04T01:36:44.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.551+0000 7fd6de505640 1 -- 172.21.15.114:0/758694949 wait complete. 2023-11-04T01:36:44.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.552+0000 7fd6de505640 1 Processor -- start 2023-11-04T01:36:44.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.553+0000 7fd6de505640 1 -- start start 2023-11-04T01:36:44.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.553+0000 7fd6de505640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6d80cda50 0x7fd6d815a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.553+0000 7fd6de505640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6d80d0710 0x7fd6d81f0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.553+0000 7fd6de505640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6d815e430 0x7fd6d80a7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.553+0000 7fd6de505640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80b4000 con 0x7fd6d815e430 2023-11-04T01:36:44.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.553+0000 7fd6de505640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d815a820 con 0x7fd6d80cda50 2023-11-04T01:36:44.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.553+0000 7fd6de505640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80c8b70 con 0x7fd6d80d0710 2023-11-04T01:36:44.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.553+0000 7fd6dcaa2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6d815e430 0x7fd6d80a7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.553+0000 7fd6dcaa2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6d815e430 0x7fd6d80a7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48922/0 (socket says 172.21.15.114:48922) 2023-11-04T01:36:44.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.553+0000 7fd6dcaa2640 1 -- 172.21.15.114:0/1211223977 learned_addr learned my addr 172.21.15.114:0/1211223977 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:44.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.554+0000 7fd6d7fff640 1 --2- 172.21.15.114:0/1211223977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6d80cda50 0x7fd6d815a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.554+0000 7fd6d77fe640 1 --2- 172.21.15.114:0/1211223977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6d80d0710 0x7fd6d81f0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.554+0000 7fd6dcaa2640 1 -- 172.21.15.114:0/1211223977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6d80d0710 msgr2=0x7fd6d81f0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.554+0000 7fd6dcaa2640 1 --2- 172.21.15.114:0/1211223977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6d80d0710 0x7fd6d81f0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.554+0000 7fd6dcaa2640 1 -- 172.21.15.114:0/1211223977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6d80cda50 msgr2=0x7fd6d815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.554+0000 7fd6dcaa2640 1 --2- 172.21.15.114:0/1211223977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6d80cda50 0x7fd6d815a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.554+0000 7fd6dcaa2640 1 -- 172.21.15.114:0/1211223977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c0009400 con 0x7fd6d815e430 2023-11-04T01:36:44.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.554+0000 7fd6dcaa2640 1 --2- 172.21.15.114:0/1211223977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6d815e430 0x7fd6d80a7540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000c710 tx=0x7fd6d000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.554+0000 7fd6d4ff9640 1 -- 172.21.15.114:0/1211223977 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0003b70 con 0x7fd6d815e430 2023-11-04T01:36:44.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.554+0000 7fd6d4ff9640 1 -- 172.21.15.114:0/1211223977 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d0003cd0 con 0x7fd6d815e430 2023-11-04T01:36:44.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.554+0000 7fd6de505640 1 -- 172.21.15.114:0/1211223977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d80c8de0 con 0x7fd6d815e430 2023-11-04T01:36:44.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.554+0000 7fd6d4ff9640 1 -- 172.21.15.114:0/1211223977 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d000aa50 con 0x7fd6d815e430 2023-11-04T01:36:44.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.554+0000 7fd6de505640 1 -- 172.21.15.114:0/1211223977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d80c93a0 con 0x7fd6d815e430 2023-11-04T01:36:44.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.555+0000 7fd6de505640 1 -- 172.21.15.114:0/1211223977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d8074290 con 0x7fd6d815e430 2023-11-04T01:36:44.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.555+0000 7fd6d4ff9640 1 -- 172.21.15.114:0/1211223977 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd6d000abb0 con 0x7fd6d815e430 2023-11-04T01:36:44.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.556+0000 7fd6d4ff9640 1 --2- 172.21.15.114:0/1211223977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd6b806ae70 0x7fd6b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:44.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.556+0000 7fd6d4ff9640 1 -- 172.21.15.114:0/1211223977 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd6d0089730 con 0x7fd6d815e430 2023-11-04T01:36:44.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.556+0000 7fd6d7fff640 1 --2- 172.21.15.114:0/1211223977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd6b806ae70 0x7fd6b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:44.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.556+0000 7fd6d7fff640 1 --2- 172.21.15.114:0/1211223977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd6b806ae70 0x7fd6b806d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8000f60 tx=0x7fd6c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:44.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.560+0000 7fd6d4ff9640 1 -- 172.21.15.114:0/1211223977 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd6d00544f0 con 0x7fd6d815e430 2023-11-04T01:36:44.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.739+0000 7fd6de505640 1 -- 172.21.15.114:0/1211223977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd6d80af7f0 con 0x7fd6d815e430 2023-11-04T01:36:44.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.739+0000 7fd6d4ff9640 1 -- 172.21.15.114:0/1211223977 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd6d000ae60 con 0x7fd6d815e430 2023-11-04T01:36:44.741 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-11-04T01:36:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.741+0000 7fd6de505640 1 -- 172.21.15.114:0/1211223977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd6b806ae70 msgr2=0x7fd6b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.741+0000 7fd6de505640 1 --2- 172.21.15.114:0/1211223977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd6b806ae70 0x7fd6b806d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8000f60 tx=0x7fd6c8009040 comp rx=0 tx=0).stop 2023-11-04T01:36:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.741+0000 7fd6de505640 1 -- 172.21.15.114:0/1211223977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6d815e430 msgr2=0x7fd6d80a7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.741+0000 7fd6de505640 1 --2- 172.21.15.114:0/1211223977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6d815e430 0x7fd6d80a7540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000c710 tx=0x7fd6d000cbd0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.741+0000 7fd6de505640 1 -- 172.21.15.114:0/1211223977 shutdown_connections 2023-11-04T01:36:44.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.741+0000 7fd6de505640 1 --2- 172.21.15.114:0/1211223977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6d815e430 0x7fd6d80a7540 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.741+0000 7fd6de505640 1 --2- 172.21.15.114:0/1211223977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd6d80d0710 0x7fd6d81f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.741+0000 7fd6de505640 1 --2- 172.21.15.114:0/1211223977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd6b806ae70 0x7fd6b806d330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.741+0000 7fd6de505640 1 --2- 172.21.15.114:0/1211223977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd6d80cda50 0x7fd6d815a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:44.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.741+0000 7fd6de505640 1 -- 172.21.15.114:0/1211223977 >> 172.21.15.114:0/1211223977 conn(0x7fd6d806ea20 msgr2=0x7fd6d815d160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:44.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.741+0000 7fd6de505640 1 -- 172.21.15.114:0/1211223977 shutdown_connections 2023-11-04T01:36:44.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44.741+0000 7fd6de505640 1 -- 172.21.15.114:0/1211223977 wait complete. 2023-11-04T01:36:44.754 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi114.front.sepia.ceph.com... 2023-11-04T01:36:44.754 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:36:44.754 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:36:44.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:36:44.814 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi114.stderr:ceph-fuse[95208]: fuse finished with error 0 and tester_r 0 2023-11-04T01:36:44.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:44.818 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi114.stderr:2023-11-04T01:36:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:36:44.821 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:36:44.827 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:36:44.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:36:44.827 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-04T01:36:44.886 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:45.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.023+0000 7f1e23f4c640 1 Processor -- start 2023-11-04T01:36:45.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.023+0000 7f1e23f4c640 1 -- start start 2023-11-04T01:36:45.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.024+0000 7f1e23f4c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1e1c0cde60 0x7f1e1c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.024+0000 7f1e23f4c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e1c15daa0 0x7f1e1c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.024+0000 7f1e23f4c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c15e000 con 0x7f1e1c0ce240 2023-11-04T01:36:45.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.024+0000 7f1e23f4c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c15e5c0 con 0x7f1e1c0cde60 2023-11-04T01:36:45.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.024+0000 7f1e23f4c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c15e2e0 con 0x7f1e1c15daa0 2023-11-04T01:36:45.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.024+0000 7f1e21ce8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1e1c0cde60 0x7f1e1c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.024+0000 7f1e21ce8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1e1c0cde60 0x7f1e1c15d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48924/0 (socket says 172.21.15.114:48924) 2023-11-04T01:36:45.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.024+0000 7f1e21ce8640 1 -- 172.21.15.114:0/1763259005 learned_addr learned my addr 172.21.15.114:0/1763259005 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:45.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.024+0000 7f1e214e7640 1 --2- 172.21.15.114:0/1763259005 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e1c15daa0 0x7f1e1c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.024+0000 7f1e21ce8640 1 -- 172.21.15.114:0/1763259005 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e1c15daa0 msgr2=0x7f1e1c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:45.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.024+0000 7f1e21ce8640 1 --2- 172.21.15.114:0/1763259005 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e1c15daa0 0x7f1e1c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.024+0000 7f1e21ce8640 1 -- 172.21.15.114:0/1763259005 >> v1:172.21.15.141:6789/0 conn(0x7f1e1c0ce240 legacy=0x7f1e1c06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:45.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.024+0000 7f1e21ce8640 1 -- 172.21.15.114:0/1763259005 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0d1120 con 0x7f1e1c0cde60 2023-11-04T01:36:45.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.025+0000 7f1e21ce8640 1 --2- 172.21.15.114:0/1763259005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e1c0cde60 0x7f1e1c15d560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009870 tx=0x7f1e1802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa69350518be57b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.025+0000 7f1e20ce6640 1 -- 172.21.15.114:0/1763259005 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18030840 con 0x7f1e1c0cde60 2023-11-04T01:36:45.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.025+0000 7f1e20ce6640 1 -- 172.21.15.114:0/1763259005 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e180309a0 con 0x7f1e1c0cde60 2023-11-04T01:36:45.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.025+0000 7f1e20ce6640 1 -- 172.21.15.114:0/1763259005 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18030d30 con 0x7f1e1c0cde60 2023-11-04T01:36:45.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.026+0000 7f1e23f4c640 1 -- 172.21.15.114:0/1763259005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e1c0cde60 msgr2=0x7f1e1c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.026+0000 7f1e23f4c640 1 --2- 172.21.15.114:0/1763259005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e1c0cde60 0x7f1e1c15d560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009870 tx=0x7f1e1802b980 comp rx=0 tx=0).stop 2023-11-04T01:36:45.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.026+0000 7f1e23f4c640 1 -- 172.21.15.114:0/1763259005 shutdown_connections 2023-11-04T01:36:45.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.026+0000 7f1e23f4c640 1 --2- 172.21.15.114:0/1763259005 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e1c15daa0 0x7f1e1c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.026+0000 7f1e23f4c640 1 --2- 172.21.15.114:0/1763259005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e1c0cde60 0x7f1e1c15d560 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.026+0000 7f1e23f4c640 1 -- 172.21.15.114:0/1763259005 >> 172.21.15.114:0/1763259005 conn(0x7f1e1c071f30 msgr2=0x7f1e1c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.026+0000 7f1e23f4c640 1 -- 172.21.15.114:0/1763259005 shutdown_connections 2023-11-04T01:36:45.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.026+0000 7f1e23f4c640 1 -- 172.21.15.114:0/1763259005 wait complete. 2023-11-04T01:36:45.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.027+0000 7f1e23f4c640 1 Processor -- start 2023-11-04T01:36:45.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.027+0000 7f1e23f4c640 1 -- start start 2023-11-04T01:36:45.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e23f4c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e1c0cde60 0x7f1e1c1f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e23f4c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e1c0ce240 0x7f1e1c1f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e23f4c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e1c15daa0 0x7f1e1c0c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e23f4c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c1f63f0 con 0x7f1e1c0ce240 2023-11-04T01:36:45.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e23f4c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c1f66d0 con 0x7f1e1c15daa0 2023-11-04T01:36:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e23f4c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c1f69b0 con 0x7f1e1c0cde60 2023-11-04T01:36:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e214e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e1c0ce240 0x7f1e1c1f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e214e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e1c0ce240 0x7f1e1c1f2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48938/0 (socket says 172.21.15.114:48938) 2023-11-04T01:36:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e214e7640 1 -- 172.21.15.114:0/2689162508 learned_addr learned my addr 172.21.15.114:0/2689162508 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e21ce8640 1 --2- 172.21.15.114:0/2689162508 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e1c0cde60 0x7f1e1c1f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e224e9640 1 --2- 172.21.15.114:0/2689162508 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e1c15daa0 0x7f1e1c0c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e214e7640 1 -- 172.21.15.114:0/2689162508 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e1c0cde60 msgr2=0x7f1e1c1f5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e214e7640 1 --2- 172.21.15.114:0/2689162508 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e1c0cde60 0x7f1e1c1f5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e214e7640 1 -- 172.21.15.114:0/2689162508 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e1c15daa0 msgr2=0x7f1e1c0c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e214e7640 1 --2- 172.21.15.114:0/2689162508 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e1c15daa0 0x7f1e1c0c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e214e7640 1 -- 172.21.15.114:0/2689162508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e180094d0 con 0x7f1e1c0ce240 2023-11-04T01:36:45.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e214e7640 1 --2- 172.21.15.114:0/2689162508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e1c0ce240 0x7f1e1c1f2e30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00d5f0 tx=0x7f1e0c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e127fc640 1 -- 172.21.15.114:0/2689162508 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c0125f0 con 0x7f1e1c0ce240 2023-11-04T01:36:45.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e127fc640 1 -- 172.21.15.114:0/2689162508 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c012750 con 0x7f1e1c0ce240 2023-11-04T01:36:45.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e23f4c640 1 -- 172.21.15.114:0/2689162508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c1f2630 con 0x7f1e1c0ce240 2023-11-04T01:36:45.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e127fc640 1 -- 172.21.15.114:0/2689162508 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c012b00 con 0x7f1e1c0ce240 2023-11-04T01:36:45.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.028+0000 7f1e23f4c640 1 -- 172.21.15.114:0/2689162508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c1f6050 con 0x7f1e1c0ce240 2023-11-04T01:36:45.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.030+0000 7f1e23f4c640 1 -- 172.21.15.114:0/2689162508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c074290 con 0x7f1e1c0ce240 2023-11-04T01:36:45.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.030+0000 7f1e127fc640 1 -- 172.21.15.114:0/2689162508 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e0c012c60 con 0x7f1e1c0ce240 2023-11-04T01:36:45.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.030+0000 7f1e127fc640 1 --2- 172.21.15.114:0/2689162508 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e0006ae70 0x7f1e0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.030+0000 7f1e127fc640 1 -- 172.21.15.114:0/2689162508 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1e0c089c90 con 0x7f1e1c0ce240 2023-11-04T01:36:45.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.030+0000 7f1e21ce8640 1 --2- 172.21.15.114:0/2689162508 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e0006ae70 0x7f1e0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.031+0000 7f1e21ce8640 1 --2- 172.21.15.114:0/2689162508 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e0006ae70 0x7f1e0006d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1e18036000 tx=0x7f1e18008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.035+0000 7f1e127fc640 1 -- 172.21.15.114:0/2689162508 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1e0c054b00 con 0x7f1e1c0ce240 2023-11-04T01:36:45.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.202+0000 7f1e23f4c640 1 -- 172.21.15.114:0/2689162508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e1c1569b0 con 0x7f1e1c0ce240 2023-11-04T01:36:45.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.203+0000 7f1e127fc640 1 -- 172.21.15.114:0/2689162508 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18406 (secure 0 0 0) 0x7f1e0c058120 con 0x7f1e1c0ce240 2023-11-04T01:36:45.205 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:45.205 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:34.950923+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.205+0000 7f1e23f4c640 1 -- 172.21.15.114:0/2689162508 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e0006ae70 msgr2=0x7f1e0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.205+0000 7f1e23f4c640 1 --2- 172.21.15.114:0/2689162508 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e0006ae70 0x7f1e0006d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1e18036000 tx=0x7f1e18008030 comp rx=0 tx=0).stop 2023-11-04T01:36:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.205+0000 7f1e23f4c640 1 -- 172.21.15.114:0/2689162508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e1c0ce240 msgr2=0x7f1e1c1f2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.205+0000 7f1e23f4c640 1 --2- 172.21.15.114:0/2689162508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e1c0ce240 0x7f1e1c1f2e30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00d5f0 tx=0x7f1e0c00dab0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.205+0000 7f1e23f4c640 1 -- 172.21.15.114:0/2689162508 shutdown_connections 2023-11-04T01:36:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.205+0000 7f1e23f4c640 1 --2- 172.21.15.114:0/2689162508 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e0006ae70 0x7f1e0006d330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.205+0000 7f1e23f4c640 1 --2- 172.21.15.114:0/2689162508 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e1c15daa0 0x7f1e1c0c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.205+0000 7f1e23f4c640 1 --2- 172.21.15.114:0/2689162508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e1c0ce240 0x7f1e1c1f2e30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.205+0000 7f1e23f4c640 1 --2- 172.21.15.114:0/2689162508 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e1c0cde60 0x7f1e1c1f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.205+0000 7f1e23f4c640 1 -- 172.21.15.114:0/2689162508 >> 172.21.15.114:0/2689162508 conn(0x7f1e1c071f30 msgr2=0x7f1e1c0c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.205+0000 7f1e23f4c640 1 -- 172.21.15.114:0/2689162508 shutdown_connections 2023-11-04T01:36:45.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.205+0000 7f1e23f4c640 1 -- 172.21.15.114:0/2689162508 wait complete. 2023-11-04T01:36:45.217 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:45.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.315+0000 7fdf99178640 1 Processor -- start 2023-11-04T01:36:45.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.315+0000 7fdf99178640 1 -- start start 2023-11-04T01:36:45.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.316+0000 7fdf99178640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf9415ac70 0x7fdf940d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.316+0000 7fdf99178640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fdf940b2d10 0x7fdf940b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.316+0000 7fdf99178640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf940b3c10 con 0x7fdf940cec10 2023-11-04T01:36:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.316+0000 7fdf99178640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf940cf180 con 0x7fdf940b2d10 2023-11-04T01:36:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.316+0000 7fdf99178640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940cf460 con 0x7fdf9415ac70 2023-11-04T01:36:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.316+0000 7fdf9359e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fdf940b2d10 0x7fdf940b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.316+0000 7fdf9259c640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fdf940cec10 0x7fdf940b2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:39746/0 (socket says 172.21.15.114:39746) 2023-11-04T01:36:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.316+0000 7fdf9259c640 1 -- 172.21.15.114:0/1464171600 learned_addr learned my addr 172.21.15.114:0/1464171600 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.316+0000 7fdf92d9d640 1 --2- 172.21.15.114:0/1464171600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf9415ac70 0x7fdf940d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.317+0000 7fdf9359e640 1 -- 172.21.15.114:0/1464171600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf9415ac70 msgr2=0x7fdf940d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.317+0000 7fdf9359e640 1 --2- 172.21.15.114:0/1464171600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf9415ac70 0x7fdf940d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.317+0000 7fdf9359e640 1 -- 172.21.15.114:0/1464171600 >> v1:172.21.15.141:6789/0 conn(0x7fdf940cec10 legacy=0x7fdf940b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.317+0000 7fdf9359e640 1 -- 172.21.15.114:0/1464171600 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf940cf740 con 0x7fdf940b2d10 2023-11-04T01:36:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.317+0000 7fdf91d9b640 1 -- 172.21.15.114:0/1464171600 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282155882 0 0) 0x7fdf940b3c10 con 0x7fdf940cec10 2023-11-04T01:36:45.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.317+0000 7fdf9359e640 1 --2- 172.21.15.114:0/1464171600 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf940b2d10 0x7fdf940b4080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0097a0 tx=0x7fdf8c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59ec5df0f266dd80 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.318+0000 7fdf91d9b640 1 -- 172.21.15.114:0/1464171600 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c031830 con 0x7fdf940b2d10 2023-11-04T01:36:45.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.318+0000 7fdf91d9b640 1 -- 172.21.15.114:0/1464171600 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c031990 con 0x7fdf940b2d10 2023-11-04T01:36:45.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.318+0000 7fdf91d9b640 1 -- 172.21.15.114:0/1464171600 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c031d20 con 0x7fdf940b2d10 2023-11-04T01:36:45.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.318+0000 7fdf99178640 1 -- 172.21.15.114:0/1464171600 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf940b2d10 msgr2=0x7fdf940b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.318+0000 7fdf99178640 1 --2- 172.21.15.114:0/1464171600 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf940b2d10 0x7fdf940b4080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0097a0 tx=0x7fdf8c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.318+0000 7fdf99178640 1 -- 172.21.15.114:0/1464171600 shutdown_connections 2023-11-04T01:36:45.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.318+0000 7fdf99178640 1 --2- 172.21.15.114:0/1464171600 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf940b2d10 0x7fdf940b4080 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.318+0000 7fdf99178640 1 --2- 172.21.15.114:0/1464171600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf9415ac70 0x7fdf940d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.318+0000 7fdf99178640 1 -- 172.21.15.114:0/1464171600 >> 172.21.15.114:0/1464171600 conn(0x7fdf940cd600 msgr2=0x7fdf940cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.318+0000 7fdf99178640 1 -- 172.21.15.114:0/1464171600 shutdown_connections 2023-11-04T01:36:45.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.318+0000 7fdf99178640 1 -- 172.21.15.114:0/1464171600 wait complete. 2023-11-04T01:36:45.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.320+0000 7fdf99178640 1 Processor -- start 2023-11-04T01:36:45.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.320+0000 7fdf99178640 1 -- start start 2023-11-04T01:36:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.320+0000 7fdf99178640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf940b2d10 0x7fdf94157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.320+0000 7fdf99178640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf940cec10 0x7fdf9406bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.320+0000 7fdf99178640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf9415ac70 0x7fdf940c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.320+0000 7fdf99178640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940c5670 con 0x7fdf940b2d10 2023-11-04T01:36:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.320+0000 7fdf99178640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9406cb10 con 0x7fdf940cec10 2023-11-04T01:36:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.320+0000 7fdf99178640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf941576d0 con 0x7fdf9415ac70 2023-11-04T01:36:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.320+0000 7fdf92d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf940b2d10 0x7fdf94157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.320+0000 7fdf92d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf940b2d10 0x7fdf94157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48952/0 (socket says 172.21.15.114:48952) 2023-11-04T01:36:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.320+0000 7fdf92d9d640 1 -- 172.21.15.114:0/119414424 learned_addr learned my addr 172.21.15.114:0/119414424 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.320+0000 7fdf9259c640 1 --2- 172.21.15.114:0/119414424 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf940cec10 0x7fdf9406bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.320+0000 7fdf9359e640 1 --2- 172.21.15.114:0/119414424 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf9415ac70 0x7fdf940c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.321+0000 7fdf92d9d640 1 -- 172.21.15.114:0/119414424 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf9415ac70 msgr2=0x7fdf940c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.321+0000 7fdf92d9d640 1 --2- 172.21.15.114:0/119414424 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf9415ac70 0x7fdf940c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.321+0000 7fdf92d9d640 1 -- 172.21.15.114:0/119414424 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf940cec10 msgr2=0x7fdf9406bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.321+0000 7fdf92d9d640 1 --2- 172.21.15.114:0/119414424 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf940cec10 0x7fdf9406bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.321+0000 7fdf92d9d640 1 -- 172.21.15.114:0/119414424 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c009400 con 0x7fdf940b2d10 2023-11-04T01:36:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.321+0000 7fdf92d9d640 1 --2- 172.21.15.114:0/119414424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf940b2d10 0x7fdf94157190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009d60 tx=0x7fdf8400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.321+0000 7fdf7b7fe640 1 -- 172.21.15.114:0/119414424 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84014480 con 0x7fdf940b2d10 2023-11-04T01:36:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.321+0000 7fdf99178640 1 -- 172.21.15.114:0/119414424 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf940c4a60 con 0x7fdf940b2d10 2023-11-04T01:36:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.321+0000 7fdf7b7fe640 1 -- 172.21.15.114:0/119414424 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8400f040 con 0x7fdf940b2d10 2023-11-04T01:36:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.321+0000 7fdf7b7fe640 1 -- 172.21.15.114:0/119414424 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84014800 con 0x7fdf940b2d10 2023-11-04T01:36:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.321+0000 7fdf99178640 1 -- 172.21.15.114:0/119414424 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf940c5020 con 0x7fdf940b2d10 2023-11-04T01:36:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.322+0000 7fdf99178640 1 -- 172.21.15.114:0/119414424 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf940b6b00 con 0x7fdf940b2d10 2023-11-04T01:36:45.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.323+0000 7fdf7b7fe640 1 -- 172.21.15.114:0/119414424 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf84014960 con 0x7fdf940b2d10 2023-11-04T01:36:45.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.323+0000 7fdf7b7fe640 1 --2- 172.21.15.114:0/119414424 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf8006ae70 0x7fdf8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.323+0000 7fdf9259c640 1 --2- 172.21.15.114:0/119414424 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf8006ae70 0x7fdf8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.323+0000 7fdf7b7fe640 1 -- 172.21.15.114:0/119414424 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdf8408a7a0 con 0x7fdf940b2d10 2023-11-04T01:36:45.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.323+0000 7fdf9259c640 1 --2- 172.21.15.114:0/119414424 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf8006ae70 0x7fdf8006d330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdf940cfe60 tx=0x7fdf88007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.327+0000 7fdf7b7fe640 1 -- 172.21.15.114:0/119414424 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf84055590 con 0x7fdf940b2d10 2023-11-04T01:36:45.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.494+0000 7fdf99178640 1 -- 172.21.15.114:0/119414424 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf940b5710 con 0x7fdf940b2d10 2023-11-04T01:36:45.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.495+0000 7fdf7b7fe640 1 -- 172.21.15.114:0/119414424 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18406 (secure 0 0 0) 0x7fdf84058bb0 con 0x7fdf940b2d10 2023-11-04T01:36:45.497 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:45.497 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:34.950923+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.497+0000 7fdf99178640 1 -- 172.21.15.114:0/119414424 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf8006ae70 msgr2=0x7fdf8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.497+0000 7fdf99178640 1 --2- 172.21.15.114:0/119414424 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf8006ae70 0x7fdf8006d330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdf940cfe60 tx=0x7fdf88007d50 comp rx=0 tx=0).stop 2023-11-04T01:36:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.497+0000 7fdf99178640 1 -- 172.21.15.114:0/119414424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf940b2d10 msgr2=0x7fdf94157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.497+0000 7fdf99178640 1 --2- 172.21.15.114:0/119414424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf940b2d10 0x7fdf94157190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009d60 tx=0x7fdf8400c490 comp rx=0 tx=0).stop 2023-11-04T01:36:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.497+0000 7fdf99178640 1 -- 172.21.15.114:0/119414424 shutdown_connections 2023-11-04T01:36:45.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.497+0000 7fdf99178640 1 --2- 172.21.15.114:0/119414424 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf9415ac70 0x7fdf940c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.497+0000 7fdf99178640 1 --2- 172.21.15.114:0/119414424 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf8006ae70 0x7fdf8006d330 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.497+0000 7fdf99178640 1 --2- 172.21.15.114:0/119414424 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf940cec10 0x7fdf9406bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.497+0000 7fdf99178640 1 --2- 172.21.15.114:0/119414424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf940b2d10 0x7fdf94157190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.497+0000 7fdf99178640 1 -- 172.21.15.114:0/119414424 >> 172.21.15.114:0/119414424 conn(0x7fdf940cd600 msgr2=0x7fdf940cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.497+0000 7fdf99178640 1 -- 172.21.15.114:0/119414424 shutdown_connections 2023-11-04T01:36:45.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.497+0000 7fdf99178640 1 -- 172.21.15.114:0/119414424 wait complete. 2023-11-04T01:36:45.513 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:36:45.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.615+0000 7fcaf7916640 1 Processor -- start 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.615+0000 7fcaf7916640 1 -- start start 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.616+0000 7fcaf7916640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaf015e0f0 0x7fcaf00b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.616+0000 7fcaf7916640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf00b4660 con 0x7fcaf00cb870 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.616+0000 7fcaf7916640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf00b4940 con 0x7fcaf00b67f0 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.616+0000 7fcaf7916640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf00b4c20 con 0x7fcaf015e0f0 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.616+0000 7fcaf5eb3640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcaf00cb870 0x7fcaf00b5700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45476/0 (socket says 172.21.15.114:45476) 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.616+0000 7fcaf5eb3640 1 -- 172.21.15.114:0/3485958646 learned_addr learned my addr 172.21.15.114:0/3485958646 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.616+0000 7fcaf56b2640 1 --2- 172.21.15.114:0/3485958646 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaf015e0f0 0x7fcaf00b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.616+0000 7fcae7fff640 1 -- 172.21.15.114:0/3485958646 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549118528 0 0) 0x7fcaf00b4660 con 0x7fcaf00cb870 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.616+0000 7fcae7fff640 1 -- 172.21.15.114:0/3485958646 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcadc003520 con 0x7fcaf00cb870 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.616+0000 7fcae7fff640 1 -- 172.21.15.114:0/3485958646 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349618252 0 0) 0x7fcaf00b4940 con 0x7fcaf00b67f0 2023-11-04T01:36:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.616+0000 7fcaf56b2640 1 -- 172.21.15.114:0/3485958646 >> v1:172.21.15.141:6789/0 conn(0x7fcaf00b67f0 legacy=0x7fcaf00cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.616+0000 7fcaf56b2640 1 -- 172.21.15.114:0/3485958646 >> v1:172.21.15.114:6789/0 conn(0x7fcaf00cb870 legacy=0x7fcaf00b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.616+0000 7fcaf56b2640 1 -- 172.21.15.114:0/3485958646 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf00b4f00 con 0x7fcaf015e0f0 2023-11-04T01:36:45.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.617+0000 7fcaf56b2640 1 --2- 172.21.15.114:0/3485958646 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaf015e0f0 0x7fcaf00b3cd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0097d0 tx=0x7fcaec02b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a266f6b7a205eb51 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.617+0000 7fcae7fff640 1 -- 172.21.15.114:0/3485958646 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae80019f0 con 0x7fcaf015e0f0 2023-11-04T01:36:45.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.617+0000 7fcae7fff640 1 -- 172.21.15.114:0/3485958646 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec02e050 con 0x7fcaf015e0f0 2023-11-04T01:36:45.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.617+0000 7fcae7fff640 1 -- 172.21.15.114:0/3485958646 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec030730 con 0x7fcaf015e0f0 2023-11-04T01:36:45.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.618+0000 7fcaf7916640 1 -- 172.21.15.114:0/3485958646 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaf015e0f0 msgr2=0x7fcaf00b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.618+0000 7fcaf7916640 1 --2- 172.21.15.114:0/3485958646 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaf015e0f0 0x7fcaf00b3cd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0097d0 tx=0x7fcaec02b730 comp rx=0 tx=0).stop 2023-11-04T01:36:45.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.618+0000 7fcaf7916640 1 -- 172.21.15.114:0/3485958646 shutdown_connections 2023-11-04T01:36:45.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.618+0000 7fcaf7916640 1 --2- 172.21.15.114:0/3485958646 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaf015e0f0 0x7fcaf00b3cd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.618+0000 7fcaf7916640 1 -- 172.21.15.114:0/3485958646 >> 172.21.15.114:0/3485958646 conn(0x7fcaf006a510 msgr2=0x7fcaf006a920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:45.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.618+0000 7fcaf7916640 1 -- 172.21.15.114:0/3485958646 shutdown_connections 2023-11-04T01:36:45.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.618+0000 7fcaf7916640 1 -- 172.21.15.114:0/3485958646 wait complete. 2023-11-04T01:36:45.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.619+0000 7fcaf7916640 1 Processor -- start 2023-11-04T01:36:45.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.619+0000 7fcaf7916640 1 -- start start 2023-11-04T01:36:45.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf7916640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf00b67f0 0x7fcaf0156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf7916640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaf00cb870 0x7fcaf0151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf7916640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcaf015e0f0 0x7fcaf00c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf7916640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf0154f80 con 0x7fcaf00b67f0 2023-11-04T01:36:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf7916640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf0155260 con 0x7fcaf015e0f0 2023-11-04T01:36:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf7916640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf0155540 con 0x7fcaf00cb870 2023-11-04T01:36:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf56b2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf00b67f0 0x7fcaf0156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf56b2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf00b67f0 0x7fcaf0156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48954/0 (socket says 172.21.15.114:48954) 2023-11-04T01:36:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf56b2640 1 -- 172.21.15.114:0/3821890881 learned_addr learned my addr 172.21.15.114:0/3821890881 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf5eb3640 1 --2- 172.21.15.114:0/3821890881 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcaf015e0f0 0x7fcaf00c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf4eb1640 1 --2- 172.21.15.114:0/3821890881 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaf00cb870 0x7fcaf0151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf56b2640 1 -- 172.21.15.114:0/3821890881 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaf00cb870 msgr2=0x7fcaf0151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf56b2640 1 --2- 172.21.15.114:0/3821890881 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaf00cb870 0x7fcaf0151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf56b2640 1 -- 172.21.15.114:0/3821890881 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcaf015e0f0 msgr2=0x7fcaf00c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:45.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf56b2640 1 --2- 172.21.15.114:0/3821890881 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcaf015e0f0 0x7fcaf00c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:45.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf56b2640 1 -- 172.21.15.114:0/3821890881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec009400 con 0x7fcaf00b67f0 2023-11-04T01:36:45.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf4eb1640 1 --2- 172.21.15.114:0/3821890881 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaf00cb870 0x7fcaf0151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:45.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf56b2640 1 --2- 172.21.15.114:0/3821890881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf00b67f0 0x7fcaf0156020 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcaec035040 tx=0x7fcaec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcae5ffb640 1 -- 172.21.15.114:0/3821890881 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec03d890 con 0x7fcaf00b67f0 2023-11-04T01:36:45.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcae5ffb640 1 -- 172.21.15.114:0/3821890881 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec03d9f0 con 0x7fcaf00b67f0 2023-11-04T01:36:45.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcaf7916640 1 -- 172.21.15.114:0/3821890881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf0155820 con 0x7fcaf00b67f0 2023-11-04T01:36:45.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.620+0000 7fcae5ffb640 1 -- 172.21.15.114:0/3821890881 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec03dda0 con 0x7fcaf00b67f0 2023-11-04T01:36:45.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.621+0000 7fcaf7916640 1 -- 172.21.15.114:0/3821890881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf0154be0 con 0x7fcaf00b67f0 2023-11-04T01:36:45.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.622+0000 7fcaf7916640 1 -- 172.21.15.114:0/3821890881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf0155680 con 0x7fcaf00b67f0 2023-11-04T01:36:45.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.622+0000 7fcae5ffb640 1 -- 172.21.15.114:0/3821890881 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcaec039040 con 0x7fcaf00b67f0 2023-11-04T01:36:45.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.622+0000 7fcae5ffb640 1 --2- 172.21.15.114:0/3821890881 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcad406ae70 0x7fcad406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:45.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.622+0000 7fcae5ffb640 1 -- 172.21.15.114:0/3821890881 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcaec0ab820 con 0x7fcaf00b67f0 2023-11-04T01:36:45.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.622+0000 7fcaf4eb1640 1 --2- 172.21.15.114:0/3821890881 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcad406ae70 0x7fcad406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:45.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.623+0000 7fcaf4eb1640 1 --2- 172.21.15.114:0/3821890881 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcad406ae70 0x7fcad406d330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00c67f0 tx=0x7fcae0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:45.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.627+0000 7fcae5ffb640 1 -- 172.21.15.114:0/3821890881 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcaf0155680 con 0x7fcaf00b67f0 2023-11-04T01:36:45.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:45.827+0000 7fcaf7916640 1 -- 172.21.15.114:0/3821890881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcaf0155680 con 0x7fcaf00b67f0 2023-11-04T01:36:46.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.635+0000 7fcae5ffb640 1 -- 172.21.15.114:0/3821890881 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcaf0155680 con 0x7fcaf00b67f0 2023-11-04T01:36:46.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.638+0000 7fcaf7916640 1 -- 172.21.15.114:0/3821890881 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcad406ae70 msgr2=0x7fcad406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.638+0000 7fcaf7916640 1 --2- 172.21.15.114:0/3821890881 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcad406ae70 0x7fcad406d330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00c67f0 tx=0x7fcae0009040 comp rx=0 tx=0).stop 2023-11-04T01:36:46.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.638+0000 7fcaf7916640 1 -- 172.21.15.114:0/3821890881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf00b67f0 msgr2=0x7fcaf0156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.638+0000 7fcaf7916640 1 --2- 172.21.15.114:0/3821890881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf00b67f0 0x7fcaf0156020 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcaec035040 tx=0x7fcaec0046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.638+0000 7fcaf7916640 1 -- 172.21.15.114:0/3821890881 shutdown_connections 2023-11-04T01:36:46.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.638+0000 7fcaf7916640 1 --2- 172.21.15.114:0/3821890881 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcad406ae70 0x7fcad406d330 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.638+0000 7fcaf7916640 1 --2- 172.21.15.114:0/3821890881 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcaf015e0f0 0x7fcaf00c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.638+0000 7fcaf7916640 1 --2- 172.21.15.114:0/3821890881 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaf00cb870 0x7fcaf0151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.638+0000 7fcaf7916640 1 --2- 172.21.15.114:0/3821890881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf00b67f0 0x7fcaf0156020 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.638+0000 7fcaf7916640 1 -- 172.21.15.114:0/3821890881 >> 172.21.15.114:0/3821890881 conn(0x7fcaf006a510 msgr2=0x7fcaf00cf500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:46.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.638+0000 7fcaf7916640 1 -- 172.21.15.114:0/3821890881 shutdown_connections 2023-11-04T01:36:46.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.638+0000 7fcaf7916640 1 -- 172.21.15.114:0/3821890881 wait complete. 2023-11-04T01:36:46.653 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-11-04T01:36:46.653 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:36:46.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.759+0000 7f27e5ab4640 1 Processor -- start 2023-11-04T01:36:46.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.760+0000 7f27e5ab4640 1 -- start start 2023-11-04T01:36:46.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.760+0000 7f27e5ab4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f27e015add0 0x7f27e00cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.760+0000 7f27e5ab4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e00b1cc0 con 0x7f27e0072370 2023-11-04T01:36:46.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.760+0000 7f27e5ab4640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e015a2f0 con 0x7f27e0071f90 2023-11-04T01:36:46.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.760+0000 7f27e5ab4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e00b1fa0 con 0x7f27e015add0 2023-11-04T01:36:46.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.760+0000 7f27d6ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f27e015add0 0x7f27e00cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.761+0000 7f27d6ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f27e015add0 0x7f27e00cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49008/0 (socket says 172.21.15.114:49008) 2023-11-04T01:36:46.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.761+0000 7f27d6ffd640 1 -- 172.21.15.114:0/3167782694 learned_addr learned my addr 172.21.15.114:0/3167782694 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:46.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.761+0000 7f27d6ffd640 1 -- 172.21.15.114:0/3167782694 >> v1:172.21.15.141:6789/0 conn(0x7f27e0071f90 legacy=0x7f27e00b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:46.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.761+0000 7f27d6ffd640 1 -- 172.21.15.114:0/3167782694 >> v1:172.21.15.114:6789/0 conn(0x7f27e0072370 legacy=0x7f27e00cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.761+0000 7f27d6ffd640 1 -- 172.21.15.114:0/3167782694 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e015a5d0 con 0x7f27e015add0 2023-11-04T01:36:46.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.761+0000 7f27d6ffd640 1 --2- 172.21.15.114:0/3167782694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e015add0 0x7f27e00cecc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009870 tx=0x7f27c802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a11905bc5fb3ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.762+0000 7f27deffd640 1 -- 172.21.15.114:0/3167782694 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8030860 con 0x7f27e015add0 2023-11-04T01:36:46.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.762+0000 7f27deffd640 1 -- 172.21.15.114:0/3167782694 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c80309c0 con 0x7f27e015add0 2023-11-04T01:36:46.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.762+0000 7f27deffd640 1 -- 172.21.15.114:0/3167782694 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8030d50 con 0x7f27e015add0 2023-11-04T01:36:46.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.762+0000 7f27e5ab4640 1 -- 172.21.15.114:0/3167782694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e015add0 msgr2=0x7f27e00cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.762+0000 7f27e5ab4640 1 --2- 172.21.15.114:0/3167782694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e015add0 0x7f27e00cecc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009870 tx=0x7f27c802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.762+0000 7f27e5ab4640 1 -- 172.21.15.114:0/3167782694 shutdown_connections 2023-11-04T01:36:46.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.762+0000 7f27e5ab4640 1 --2- 172.21.15.114:0/3167782694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e015add0 0x7f27e00cecc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.762+0000 7f27e5ab4640 1 -- 172.21.15.114:0/3167782694 >> 172.21.15.114:0/3167782694 conn(0x7f27e006d800 msgr2=0x7f27e006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:46.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.762+0000 7f27e5ab4640 1 -- 172.21.15.114:0/3167782694 shutdown_connections 2023-11-04T01:36:46.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.762+0000 7f27e5ab4640 1 -- 172.21.15.114:0/3167782694 wait complete. 2023-11-04T01:36:46.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.763+0000 7f27e5ab4640 1 Processor -- start 2023-11-04T01:36:46.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.764+0000 7f27e5ab4640 1 -- start start 2023-11-04T01:36:46.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.764+0000 7f27e5ab4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e0071f90 0x7f27e01f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.764+0000 7f27e5ab4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27e0072370 0x7f27e0158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.764+0000 7f27e5ab4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f27e015add0 0x7f27e0158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.764+0000 7f27e5ab4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00c81a0 con 0x7f27e0071f90 2023-11-04T01:36:46.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.764+0000 7f27e5ab4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00b0690 con 0x7f27e015add0 2023-11-04T01:36:46.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.764+0000 7f27e5ab4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00b2e90 con 0x7f27e0072370 2023-11-04T01:36:46.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.764+0000 7f27df7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e0071f90 0x7f27e01f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.764+0000 7f27df7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e0071f90 0x7f27e01f25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49010/0 (socket says 172.21.15.114:49010) 2023-11-04T01:36:46.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.765+0000 7f27df7fe640 1 -- 172.21.15.114:0/212338412 learned_addr learned my addr 172.21.15.114:0/212338412 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:46.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.765+0000 7f27d6ffd640 1 --2- 172.21.15.114:0/212338412 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27e0072370 0x7f27e0158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.765+0000 7f27dffff640 1 --2- 172.21.15.114:0/212338412 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f27e015add0 0x7f27e0158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.765+0000 7f27df7fe640 1 -- 172.21.15.114:0/212338412 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27e0072370 msgr2=0x7f27e0158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.765+0000 7f27df7fe640 1 --2- 172.21.15.114:0/212338412 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27e0072370 0x7f27e0158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.765+0000 7f27df7fe640 1 -- 172.21.15.114:0/212338412 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f27e015add0 msgr2=0x7f27e0158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:46.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.765+0000 7f27df7fe640 1 --2- 172.21.15.114:0/212338412 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f27e015add0 0x7f27e0158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:46.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.765+0000 7f27df7fe640 1 -- 172.21.15.114:0/212338412 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c80094d0 con 0x7f27e0071f90 2023-11-04T01:36:46.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.765+0000 7f27df7fe640 1 --2- 172.21.15.114:0/212338412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e0071f90 0x7f27e01f25e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f27d000b410 tx=0x7f27d000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.765+0000 7f27dcff9640 1 -- 172.21.15.114:0/212338412 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0011830 con 0x7f27e0071f90 2023-11-04T01:36:46.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.765+0000 7f27dcff9640 1 -- 172.21.15.114:0/212338412 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d0011990 con 0x7f27e0071f90 2023-11-04T01:36:46.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.765+0000 7f27e5ab4640 1 -- 172.21.15.114:0/212338412 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e00b2280 con 0x7f27e0071f90 2023-11-04T01:36:46.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.765+0000 7f27dcff9640 1 -- 172.21.15.114:0/212338412 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0011d40 con 0x7f27e0071f90 2023-11-04T01:36:46.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.765+0000 7f27e5ab4640 1 -- 172.21.15.114:0/212338412 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e00b2840 con 0x7f27e0071f90 2023-11-04T01:36:46.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.766+0000 7f27e5ab4640 1 -- 172.21.15.114:0/212338412 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e00cb4b0 con 0x7f27e0071f90 2023-11-04T01:36:46.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.766+0000 7f27dcff9640 1 -- 172.21.15.114:0/212338412 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f27d001a400 con 0x7f27e0071f90 2023-11-04T01:36:46.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.767+0000 7f27dcff9640 1 --2- 172.21.15.114:0/212338412 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27c006ae70 0x7f27c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:46.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.767+0000 7f27d6ffd640 1 --2- 172.21.15.114:0/212338412 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27c006ae70 0x7f27c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:46.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.767+0000 7f27dcff9640 1 -- 172.21.15.114:0/212338412 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f27d0089ad0 con 0x7f27e0071f90 2023-11-04T01:36:46.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.767+0000 7f27d6ffd640 1 --2- 172.21.15.114:0/212338412 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27c006ae70 0x7f27c006d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f27c8036000 tx=0x7f27c8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:46.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.771+0000 7f27dcff9640 1 -- 172.21.15.114:0/212338412 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f27d0054890 con 0x7f27e0071f90 2023-11-04T01:36:46.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:46.974+0000 7f27e5ab4640 1 -- 172.21.15.114:0/212338412 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f27e00cea70 con 0x7f27e0071f90 2023-11-04T01:36:47.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.643+0000 7f27dcff9640 1 -- 172.21.15.114:0/212338412 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f27d0015020 con 0x7f27e0071f90 2023-11-04T01:36:47.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.646+0000 7f27e5ab4640 1 -- 172.21.15.114:0/212338412 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27c006ae70 msgr2=0x7f27c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.646+0000 7f27e5ab4640 1 --2- 172.21.15.114:0/212338412 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27c006ae70 0x7f27c006d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f27c8036000 tx=0x7f27c8008030 comp rx=0 tx=0).stop 2023-11-04T01:36:47.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.646+0000 7f27e5ab4640 1 -- 172.21.15.114:0/212338412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e0071f90 msgr2=0x7f27e01f25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.646+0000 7f27e5ab4640 1 --2- 172.21.15.114:0/212338412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e0071f90 0x7f27e01f25e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f27d000b410 tx=0x7f27d000b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.646+0000 7f27e5ab4640 1 -- 172.21.15.114:0/212338412 shutdown_connections 2023-11-04T01:36:47.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.646+0000 7f27e5ab4640 1 --2- 172.21.15.114:0/212338412 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27c006ae70 0x7f27c006d330 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.646+0000 7f27e5ab4640 1 --2- 172.21.15.114:0/212338412 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f27e015add0 0x7f27e0158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.646+0000 7f27e5ab4640 1 --2- 172.21.15.114:0/212338412 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f27e0072370 0x7f27e0158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.646+0000 7f27e5ab4640 1 --2- 172.21.15.114:0/212338412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e0071f90 0x7f27e01f25e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.646+0000 7f27e5ab4640 1 -- 172.21.15.114:0/212338412 >> 172.21.15.114:0/212338412 conn(0x7f27e006d800 msgr2=0x7f27e00cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:47.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.646+0000 7f27e5ab4640 1 -- 172.21.15.114:0/212338412 shutdown_connections 2023-11-04T01:36:47.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.646+0000 7f27e5ab4640 1 -- 172.21.15.114:0/212338412 wait complete. 2023-11-04T01:36:47.661 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:36:47.661 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:47.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.764+0000 7fcbc99b6640 1 Processor -- start 2023-11-04T01:36:47.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.764+0000 7fcbc99b6640 1 -- start start 2023-11-04T01:36:47.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.765+0000 7fcbc99b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcbc40ce240 0x7fcbc4157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.765+0000 7fcbc99b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fcbc4157540 0x7fcbc40d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.765+0000 7fcbc99b6640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc415e000 con 0x7fcbc40cde60 2023-11-04T01:36:47.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.765+0000 7fcbc99b6640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc415e5c0 con 0x7fcbc40ce240 2023-11-04T01:36:47.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.765+0000 7fcbc99b6640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc415e2e0 con 0x7fcbc4157540 2023-11-04T01:36:47.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.765+0000 7fcbbbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcbc40ce240 0x7fcbc4157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.765+0000 7fcbbbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcbc40ce240 0x7fcbc4157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49022/0 (socket says 172.21.15.114:49022) 2023-11-04T01:36:47.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.765+0000 7fcbbbfff640 1 -- 172.21.15.114:0/4122610374 learned_addr learned my addr 172.21.15.114:0/4122610374 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:47.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.765+0000 7fcbc37fe640 1 --2- 172.21.15.114:0/4122610374 >> v2:172.21.15.141:3300/0 conn(0x7fcbc4157540 0x7fcbc40d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.765+0000 7fcbbbfff640 1 -- 172.21.15.114:0/4122610374 >> v2:172.21.15.141:3300/0 conn(0x7fcbc4157540 msgr2=0x7fcbc40d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.765+0000 7fcbbbfff640 1 --2- 172.21.15.114:0/4122610374 >> v2:172.21.15.141:3300/0 conn(0x7fcbc4157540 0x7fcbc40d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.765+0000 7fcbbbfff640 1 -- 172.21.15.114:0/4122610374 >> v1:172.21.15.141:6789/0 conn(0x7fcbc40cde60 legacy=0x7fcbc415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.765+0000 7fcbbbfff640 1 -- 172.21.15.114:0/4122610374 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc40d1120 con 0x7fcbc40ce240 2023-11-04T01:36:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.765+0000 7fcbc37fe640 1 --2- 172.21.15.114:0/4122610374 >> v2:172.21.15.141:3300/0 conn(0x7fcbc4157540 0x7fcbc40d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.766+0000 7fcbbbfff640 1 --2- 172.21.15.114:0/4122610374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc40ce240 0x7fcbc4157000 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40cf2e0 tx=0x7fcbac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95ba7a5db4c297d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.766+0000 7fcbc27fc640 1 -- 172.21.15.114:0/4122610374 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac031870 con 0x7fcbc40ce240 2023-11-04T01:36:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.766+0000 7fcbc27fc640 1 -- 172.21.15.114:0/4122610374 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac0319d0 con 0x7fcbc40ce240 2023-11-04T01:36:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.766+0000 7fcbc27fc640 1 -- 172.21.15.114:0/4122610374 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac031d60 con 0x7fcbc40ce240 2023-11-04T01:36:47.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.767+0000 7fcbc99b6640 1 -- 172.21.15.114:0/4122610374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc40ce240 msgr2=0x7fcbc4157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.767+0000 7fcbc99b6640 1 --2- 172.21.15.114:0/4122610374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc40ce240 0x7fcbc4157000 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40cf2e0 tx=0x7fcbac02b910 comp rx=0 tx=0).stop 2023-11-04T01:36:47.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.767+0000 7fcbc99b6640 1 -- 172.21.15.114:0/4122610374 shutdown_connections 2023-11-04T01:36:47.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.767+0000 7fcbc99b6640 1 --2- 172.21.15.114:0/4122610374 >> v2:172.21.15.141:3300/0 conn(0x7fcbc4157540 0x7fcbc40d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.767+0000 7fcbc99b6640 1 --2- 172.21.15.114:0/4122610374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc40ce240 0x7fcbc4157000 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.767+0000 7fcbc99b6640 1 -- 172.21.15.114:0/4122610374 >> 172.21.15.114:0/4122610374 conn(0x7fcbc4071f30 msgr2=0x7fcbc40cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:47.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.767+0000 7fcbc99b6640 1 -- 172.21.15.114:0/4122610374 shutdown_connections 2023-11-04T01:36:47.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.767+0000 7fcbc99b6640 1 -- 172.21.15.114:0/4122610374 wait complete. 2023-11-04T01:36:47.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.768+0000 7fcbc99b6640 1 Processor -- start 2023-11-04T01:36:47.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.768+0000 7fcbc99b6640 1 -- start start 2023-11-04T01:36:47.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.768+0000 7fcbc99b6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc40cde60 0x7fcbc4148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.768+0000 7fcbc99b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbc40ce240 0x7fcbc40cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.768+0000 7fcbc99b6640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcbc4157540 0x7fcbc40cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.768+0000 7fcbc99b6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc41494c0 con 0x7fcbc40cde60 2023-11-04T01:36:47.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.768+0000 7fcbc99b6640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc4149760 con 0x7fcbc4157540 2023-11-04T01:36:47.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.768+0000 7fcbc99b6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc4149a40 con 0x7fcbc40ce240 2023-11-04T01:36:47.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.769+0000 7fcbc2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc40cde60 0x7fcbc4148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.769+0000 7fcbc2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc40cde60 0x7fcbc4148f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49028/0 (socket says 172.21.15.114:49028) 2023-11-04T01:36:47.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.769+0000 7fcbc2ffd640 1 -- 172.21.15.114:0/2758288202 learned_addr learned my addr 172.21.15.114:0/2758288202 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:47.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.769+0000 7fcbc37fe640 1 --2- 172.21.15.114:0/2758288202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcbc4157540 0x7fcbc40cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.769+0000 7fcbbbfff640 1 --2- 172.21.15.114:0/2758288202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbc40ce240 0x7fcbc40cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.769+0000 7fcbc2ffd640 1 -- 172.21.15.114:0/2758288202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbc40ce240 msgr2=0x7fcbc40cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.769+0000 7fcbc2ffd640 1 --2- 172.21.15.114:0/2758288202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbc40ce240 0x7fcbc40cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.769+0000 7fcbc2ffd640 1 -- 172.21.15.114:0/2758288202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcbc4157540 msgr2=0x7fcbc40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.769+0000 7fcbc2ffd640 1 --2- 172.21.15.114:0/2758288202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcbc4157540 0x7fcbc40cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.769+0000 7fcbc2ffd640 1 -- 172.21.15.114:0/2758288202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac0094d0 con 0x7fcbc40cde60 2023-11-04T01:36:47.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.769+0000 7fcbc2ffd640 1 --2- 172.21.15.114:0/2758288202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc40cde60 0x7fcbc4148f80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400c430 tx=0x7fcbb400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.769+0000 7fcbc0ff9640 1 -- 172.21.15.114:0/2758288202 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4011790 con 0x7fcbc40cde60 2023-11-04T01:36:47.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.769+0000 7fcbc0ff9640 1 -- 172.21.15.114:0/2758288202 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb40118f0 con 0x7fcbc40cde60 2023-11-04T01:36:47.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.769+0000 7fcbc99b6640 1 -- 172.21.15.114:0/2758288202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc4149d20 con 0x7fcbc40cde60 2023-11-04T01:36:47.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.769+0000 7fcbc0ff9640 1 -- 172.21.15.114:0/2758288202 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4011ce0 con 0x7fcbc40cde60 2023-11-04T01:36:47.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.769+0000 7fcbc99b6640 1 -- 172.21.15.114:0/2758288202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc414a2e0 con 0x7fcbc40cde60 2023-11-04T01:36:47.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.770+0000 7fcbc99b6640 1 -- 172.21.15.114:0/2758288202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc4074290 con 0x7fcbc40cde60 2023-11-04T01:36:47.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.771+0000 7fcbc0ff9640 1 -- 172.21.15.114:0/2758288202 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcbb401c460 con 0x7fcbc40cde60 2023-11-04T01:36:47.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.771+0000 7fcbc0ff9640 1 --2- 172.21.15.114:0/2758288202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcba406ae70 0x7fcba406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:47.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.771+0000 7fcbc0ff9640 1 -- 172.21.15.114:0/2758288202 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbb40898c0 con 0x7fcbc40cde60 2023-11-04T01:36:47.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.771+0000 7fcbbbfff640 1 --2- 172.21.15.114:0/2758288202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcba406ae70 0x7fcba406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:47.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.771+0000 7fcbbbfff640 1 --2- 172.21.15.114:0/2758288202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcba406ae70 0x7fcba406d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcbac036000 tx=0x7fcbac03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:47.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.775+0000 7fcbc0ff9640 1 -- 172.21.15.114:0/2758288202 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcbb4054680 con 0x7fcbc40cde60 2023-11-04T01:36:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.975+0000 7fcbc99b6640 1 -- 172.21.15.114:0/2758288202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbc40cfb50 con 0x7fcbc40cde60 2023-11-04T01:36:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.976+0000 7fcbc0ff9640 1 -- 172.21.15.114:0/2758288202 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7fcbb4057ca0 con 0x7fcbc40cde60 2023-11-04T01:36:47.978 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:47.978 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1590879236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1590879236},{"type":"v1","addr":"172.21.15.141:6834","nonce":1590879236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3079825621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3079825621},{"type":"v1","addr":"172.21.15.114:6835","nonce":3079825621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1526155664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1526155664},{"type":"v1","addr":"172.21.15.114:6837","nonce":1526155664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:36:29.888918+0000","modified":"2023-11-04T01:36:46.975998+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6835/4231924170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4231924170},{"type":"v1","addr":"172.21.15.141:6835","nonce":4231924170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:36:47.978 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2023-11-04T01:36:47.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.977+0000 7fcbc99b6640 1 -- 172.21.15.114:0/2758288202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcba406ae70 msgr2=0x7fcba406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.977+0000 7fcbc99b6640 1 --2- 172.21.15.114:0/2758288202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcba406ae70 0x7fcba406d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcbac036000 tx=0x7fcbac03c040 comp rx=0 tx=0).stop 2023-11-04T01:36:47.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.977+0000 7fcbc99b6640 1 -- 172.21.15.114:0/2758288202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc40cde60 msgr2=0x7fcbc4148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:47.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.977+0000 7fcbc99b6640 1 --2- 172.21.15.114:0/2758288202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc40cde60 0x7fcbc4148f80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400c430 tx=0x7fcbb400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.977+0000 7fcbc99b6640 1 -- 172.21.15.114:0/2758288202 shutdown_connections 2023-11-04T01:36:47.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.977+0000 7fcbc99b6640 1 --2- 172.21.15.114:0/2758288202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcba406ae70 0x7fcba406d330 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.977+0000 7fcbc99b6640 1 --2- 172.21.15.114:0/2758288202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcbc4157540 0x7fcbc40cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.977+0000 7fcbc99b6640 1 --2- 172.21.15.114:0/2758288202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbc40ce240 0x7fcbc40cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.977+0000 7fcbc99b6640 1 --2- 172.21.15.114:0/2758288202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc40cde60 0x7fcbc4148f80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:47.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.977+0000 7fcbc99b6640 1 -- 172.21.15.114:0/2758288202 >> 172.21.15.114:0/2758288202 conn(0x7fcbc4071f30 msgr2=0x7fcbc40d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:47.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.977+0000 7fcbc99b6640 1 -- 172.21.15.114:0/2758288202 shutdown_connections 2023-11-04T01:36:47.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:47.977+0000 7fcbc99b6640 1 -- 172.21.15.114:0/2758288202 wait complete. 2023-11-04T01:36:47.990 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:48.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.088+0000 7f7ac155e640 1 Processor -- start 2023-11-04T01:36:48.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.088+0000 7f7ac155e640 1 -- start start 2023-11-04T01:36:48.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.089+0000 7f7ac155e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7abc0d0db0 0x7f7abc0b4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.089+0000 7f7ac155e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7abc0b5d50 0x7f7abc0b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.089+0000 7f7ac155e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7abc0b62c0 con 0x7f7abc15cdf0 2023-11-04T01:36:48.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.089+0000 7f7ac155e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc0b65a0 con 0x7f7abc0d0db0 2023-11-04T01:36:48.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.089+0000 7f7ac155e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0b6880 con 0x7f7abc0b5d50 2023-11-04T01:36:48.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.089+0000 7f7ab3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7abc0d0db0 0x7f7abc0b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.089+0000 7f7ab3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7abc0d0db0 0x7f7abc0b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49030/0 (socket says 172.21.15.114:49030) 2023-11-04T01:36:48.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.089+0000 7f7ab3fff640 1 -- 172.21.15.114:0/2388330743 learned_addr learned my addr 172.21.15.114:0/2388330743 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:48.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.089+0000 7f7abb7fe640 1 --2- 172.21.15.114:0/2388330743 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7abc0b5d50 0x7f7abc0b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.089+0000 7f7ab3fff640 1 -- 172.21.15.114:0/2388330743 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7abc0b5d50 msgr2=0x7f7abc0b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.089+0000 7f7ab3fff640 1 --2- 172.21.15.114:0/2388330743 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7abc0b5d50 0x7f7abc0b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.089+0000 7f7ab3fff640 1 -- 172.21.15.114:0/2388330743 >> v1:172.21.15.141:6789/0 conn(0x7f7abc15cdf0 legacy=0x7f7abc0b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.089+0000 7f7ab3fff640 1 -- 172.21.15.114:0/2388330743 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc0b6b60 con 0x7f7abc0d0db0 2023-11-04T01:36:48.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.090+0000 7f7ab3fff640 1 --2- 172.21.15.114:0/2388330743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc0d0db0 0x7f7abc0b4810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009870 tx=0x7f7aa402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe8cfc05b9bf187 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.090+0000 7f7aba7fc640 1 -- 172.21.15.114:0/2388330743 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4030840 con 0x7f7abc0d0db0 2023-11-04T01:36:48.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.090+0000 7f7aba7fc640 1 -- 172.21.15.114:0/2388330743 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa40309a0 con 0x7f7abc0d0db0 2023-11-04T01:36:48.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.090+0000 7f7aba7fc640 1 -- 172.21.15.114:0/2388330743 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4030d30 con 0x7f7abc0d0db0 2023-11-04T01:36:48.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.090+0000 7f7ac155e640 1 -- 172.21.15.114:0/2388330743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc0d0db0 msgr2=0x7f7abc0b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.090+0000 7f7ac155e640 1 --2- 172.21.15.114:0/2388330743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc0d0db0 0x7f7abc0b4810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009870 tx=0x7f7aa402b980 comp rx=0 tx=0).stop 2023-11-04T01:36:48.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.091+0000 7f7ac155e640 1 -- 172.21.15.114:0/2388330743 shutdown_connections 2023-11-04T01:36:48.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.091+0000 7f7ac155e640 1 --2- 172.21.15.114:0/2388330743 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7abc0b5d50 0x7f7abc0b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.091+0000 7f7ac155e640 1 --2- 172.21.15.114:0/2388330743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc0d0db0 0x7f7abc0b4810 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.091+0000 7f7ac155e640 1 -- 172.21.15.114:0/2388330743 >> 172.21.15.114:0/2388330743 conn(0x7f7abc071c70 msgr2=0x7f7abc072080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.091+0000 7f7ac155e640 1 -- 172.21.15.114:0/2388330743 shutdown_connections 2023-11-04T01:36:48.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.091+0000 7f7ac155e640 1 -- 172.21.15.114:0/2388330743 wait complete. 2023-11-04T01:36:48.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.092+0000 7f7ac155e640 1 Processor -- start 2023-11-04T01:36:48.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.092+0000 7f7ac155e640 1 -- start start 2023-11-04T01:36:48.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.092+0000 7f7ac155e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7abc0b5d50 0x7f7abc15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.092+0000 7f7ac155e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc0d0db0 0x7f7abc152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.092+0000 7f7ac155e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7abc15cdf0 0x7f7abc158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.092+0000 7f7ac155e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0c69c0 con 0x7f7abc0d0db0 2023-11-04T01:36:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.092+0000 7f7ac155e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc15f250 con 0x7f7abc0b5d50 2023-11-04T01:36:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.092+0000 7f7ac155e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc15f530 con 0x7f7abc15cdf0 2023-11-04T01:36:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.092+0000 7f7ab3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc0d0db0 0x7f7abc152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7ab3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc0d0db0 0x7f7abc152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49036/0 (socket says 172.21.15.114:49036) 2023-11-04T01:36:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7ab3fff640 1 -- 172.21.15.114:0/2708319534 learned_addr learned my addr 172.21.15.114:0/2708319534 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7abaffd640 1 --2- 172.21.15.114:0/2708319534 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7abc0b5d50 0x7f7abc15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7abb7fe640 1 --2- 172.21.15.114:0/2708319534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7abc15cdf0 0x7f7abc158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7ab3fff640 1 -- 172.21.15.114:0/2708319534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7abc15cdf0 msgr2=0x7f7abc158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7ab3fff640 1 --2- 172.21.15.114:0/2708319534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7abc15cdf0 0x7f7abc158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7ab3fff640 1 -- 172.21.15.114:0/2708319534 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7abc0b5d50 msgr2=0x7f7abc15eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7ab3fff640 1 --2- 172.21.15.114:0/2708319534 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7abc0b5d50 0x7f7abc15eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7ab3fff640 1 -- 172.21.15.114:0/2708319534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa40094d0 con 0x7f7abc0d0db0 2023-11-04T01:36:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7abaffd640 1 --2- 172.21.15.114:0/2708319534 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7abc0b5d50 0x7f7abc15eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7abb7fe640 1 --2- 172.21.15.114:0/2708319534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7abc15cdf0 0x7f7abc158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7ab3fff640 1 --2- 172.21.15.114:0/2708319534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc0d0db0 0x7f7abc152dc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009870 tx=0x7f7aa4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7ab37fe640 1 -- 172.21.15.114:0/2708319534 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4039c90 con 0x7f7abc0d0db0 2023-11-04T01:36:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7ab37fe640 1 -- 172.21.15.114:0/2708319534 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa4039df0 con 0x7f7abc0d0db0 2023-11-04T01:36:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7ab37fe640 1 -- 172.21.15.114:0/2708319534 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4043620 con 0x7f7abc0d0db0 2023-11-04T01:36:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7ac155e640 1 -- 172.21.15.114:0/2708319534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc15f810 con 0x7f7abc0d0db0 2023-11-04T01:36:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.093+0000 7f7ac155e640 1 -- 172.21.15.114:0/2708319534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc15fdd0 con 0x7f7abc0d0db0 2023-11-04T01:36:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.094+0000 7f7ac155e640 1 -- 172.21.15.114:0/2708319534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7abc067c50 con 0x7f7abc0d0db0 2023-11-04T01:36:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.095+0000 7f7ab37fe640 1 -- 172.21.15.114:0/2708319534 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7aa4043780 con 0x7f7abc0d0db0 2023-11-04T01:36:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.095+0000 7f7ab37fe640 1 --2- 172.21.15.114:0/2708319534 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9c06ae70 0x7f7a9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.095+0000 7f7ab37fe640 1 -- 172.21.15.114:0/2708319534 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7aa403e070 con 0x7f7abc0d0db0 2023-11-04T01:36:48.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.095+0000 7f7abaffd640 1 --2- 172.21.15.114:0/2708319534 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9c06ae70 0x7f7a9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.095+0000 7f7abaffd640 1 --2- 172.21.15.114:0/2708319534 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9c06ae70 0x7f7a9c06d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00a830 tx=0x7f7aac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.099+0000 7f7ab37fe640 1 -- 172.21.15.114:0/2708319534 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7aa4077790 con 0x7f7abc0d0db0 2023-11-04T01:36:48.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.266+0000 7f7ac155e640 1 -- 172.21.15.114:0/2708319534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7abc0674e0 con 0x7f7abc0d0db0 2023-11-04T01:36:48.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.267+0000 7f7ab37fe640 1 -- 172.21.15.114:0/2708319534 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18406 (secure 0 0 0) 0x7f7aa407adb0 con 0x7f7abc0d0db0 2023-11-04T01:36:48.269 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:48.269 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:34.950923+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:48.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.269+0000 7f7ac155e640 1 -- 172.21.15.114:0/2708319534 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9c06ae70 msgr2=0x7f7a9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.269+0000 7f7ac155e640 1 --2- 172.21.15.114:0/2708319534 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9c06ae70 0x7f7a9c06d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00a830 tx=0x7f7aac008040 comp rx=0 tx=0).stop 2023-11-04T01:36:48.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.269+0000 7f7ac155e640 1 -- 172.21.15.114:0/2708319534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc0d0db0 msgr2=0x7f7abc152dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.269+0000 7f7ac155e640 1 --2- 172.21.15.114:0/2708319534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc0d0db0 0x7f7abc152dc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009870 tx=0x7f7aa4004730 comp rx=0 tx=0).stop 2023-11-04T01:36:48.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.269+0000 7f7ac155e640 1 -- 172.21.15.114:0/2708319534 shutdown_connections 2023-11-04T01:36:48.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.269+0000 7f7ac155e640 1 --2- 172.21.15.114:0/2708319534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7abc15cdf0 0x7f7abc158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.269+0000 7f7ac155e640 1 --2- 172.21.15.114:0/2708319534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc0d0db0 0x7f7abc152dc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.269+0000 7f7ac155e640 1 --2- 172.21.15.114:0/2708319534 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9c06ae70 0x7f7a9c06d330 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.269+0000 7f7ac155e640 1 --2- 172.21.15.114:0/2708319534 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7abc0b5d50 0x7f7abc15eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.269+0000 7f7ac155e640 1 -- 172.21.15.114:0/2708319534 >> 172.21.15.114:0/2708319534 conn(0x7f7abc071c70 msgr2=0x7f7abc156e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.269+0000 7f7ac155e640 1 -- 172.21.15.114:0/2708319534 shutdown_connections 2023-11-04T01:36:48.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.269+0000 7f7ac155e640 1 -- 172.21.15.114:0/2708319534 wait complete. 2023-11-04T01:36:48.282 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:36:48.282 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:36:48.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.380+0000 7f11b6d5e640 1 Processor -- start 2023-11-04T01:36:48.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.381+0000 7f11b6d5e640 1 -- start start 2023-11-04T01:36:48.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.381+0000 7f11b6d5e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f11b015cd20 0x7f11b01613b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.381+0000 7f11b6d5e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11b00b2d10 0x7f11b00cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.381+0000 7f11b6d5e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b006c650 con 0x7f11b006cae0 2023-11-04T01:36:48.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.381+0000 7f11b6d5e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b006b830 con 0x7f11b015cd20 2023-11-04T01:36:48.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.381+0000 7f11b6d5e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b01618f0 con 0x7f11b00b2d10 2023-11-04T01:36:48.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.382+0000 7f11b4afa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f11b015cd20 0x7f11b01613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.382+0000 7f11b4afa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f11b015cd20 0x7f11b01613b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49040/0 (socket says 172.21.15.114:49040) 2023-11-04T01:36:48.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.382+0000 7f11b4afa640 1 -- 172.21.15.114:0/3116685384 learned_addr learned my addr 172.21.15.114:0/3116685384 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:48.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.382+0000 7f11b52fb640 1 --2- 172.21.15.114:0/3116685384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11b00b2d10 0x7f11b00cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.382+0000 7f11b4afa640 1 -- 172.21.15.114:0/3116685384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11b00b2d10 msgr2=0x7f11b00cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.382+0000 7f11b4afa640 1 --2- 172.21.15.114:0/3116685384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11b00b2d10 0x7f11b00cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.382+0000 7f11b4afa640 1 -- 172.21.15.114:0/3116685384 >> v1:172.21.15.141:6789/0 conn(0x7f11b006cae0 legacy=0x7f11b00b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.382+0000 7f11b4afa640 1 -- 172.21.15.114:0/3116685384 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b006ba40 con 0x7f11b015cd20 2023-11-04T01:36:48.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.382+0000 7f11b52fb640 1 --2- 172.21.15.114:0/3116685384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11b00b2d10 0x7f11b00cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:48.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.383+0000 7f11b4afa640 1 --2- 172.21.15.114:0/3116685384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11b015cd20 0x7f11b01613b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009ea0 tx=0x7f11a802bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117d6c5abcb436e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.383+0000 7f11af7fe640 1 -- 172.21.15.114:0/3116685384 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a802cab0 con 0x7f11b015cd20 2023-11-04T01:36:48.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.383+0000 7f11af7fe640 1 -- 172.21.15.114:0/3116685384 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a802cc10 con 0x7f11b015cd20 2023-11-04T01:36:48.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.383+0000 7f11af7fe640 1 -- 172.21.15.114:0/3116685384 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a80343f0 con 0x7f11b015cd20 2023-11-04T01:36:48.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.383+0000 7f11b6d5e640 1 -- 172.21.15.114:0/3116685384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11b015cd20 msgr2=0x7f11b01613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.383+0000 7f11b6d5e640 1 --2- 172.21.15.114:0/3116685384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11b015cd20 0x7f11b01613b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009ea0 tx=0x7f11a802bf10 comp rx=0 tx=0).stop 2023-11-04T01:36:48.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.383+0000 7f11b6d5e640 1 -- 172.21.15.114:0/3116685384 shutdown_connections 2023-11-04T01:36:48.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.383+0000 7f11b6d5e640 1 --2- 172.21.15.114:0/3116685384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11b00b2d10 0x7f11b00cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.383+0000 7f11b6d5e640 1 --2- 172.21.15.114:0/3116685384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11b015cd20 0x7f11b01613b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.383+0000 7f11b6d5e640 1 -- 172.21.15.114:0/3116685384 >> 172.21.15.114:0/3116685384 conn(0x7f11b00cd600 msgr2=0x7f11b00cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.383+0000 7f11b6d5e640 1 -- 172.21.15.114:0/3116685384 shutdown_connections 2023-11-04T01:36:48.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.383+0000 7f11b6d5e640 1 -- 172.21.15.114:0/3116685384 wait complete. 2023-11-04T01:36:48.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.384+0000 7f11b6d5e640 1 Processor -- start 2023-11-04T01:36:48.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.384+0000 7f11b6d5e640 1 -- start start 2023-11-04T01:36:48.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.385+0000 7f11b6d5e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11b006cae0 0x7f11b0150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.385+0000 7f11b6d5e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11b00b2d10 0x7f11b00b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.385+0000 7f11b6d5e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11b015cd20 0x7f11b00b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.385+0000 7f11b6d5e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00c7670 con 0x7f11b015cd20 2023-11-04T01:36:48.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.385+0000 7f11b6d5e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00b3a40 con 0x7f11b00b2d10 2023-11-04T01:36:48.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.385+0000 7f11b6d5e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00b5c30 con 0x7f11b006cae0 2023-11-04T01:36:48.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.385+0000 7f11b52fb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11b015cd20 0x7f11b00b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.385+0000 7f11b52fb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11b015cd20 0x7f11b00b53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49046/0 (socket says 172.21.15.114:49046) 2023-11-04T01:36:48.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.385+0000 7f11b52fb640 1 -- 172.21.15.114:0/2347100189 learned_addr learned my addr 172.21.15.114:0/2347100189 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:48.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.386+0000 7f11affff640 1 --2- 172.21.15.114:0/2347100189 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11b00b2d10 0x7f11b00b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.386+0000 7f11b4afa640 1 --2- 172.21.15.114:0/2347100189 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11b006cae0 0x7f11b0150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.386+0000 7f11b52fb640 1 -- 172.21.15.114:0/2347100189 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11b006cae0 msgr2=0x7f11b0150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.386+0000 7f11b52fb640 1 --2- 172.21.15.114:0/2347100189 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11b006cae0 0x7f11b0150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.386+0000 7f11b52fb640 1 -- 172.21.15.114:0/2347100189 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11b00b2d10 msgr2=0x7f11b00b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.386+0000 7f11b52fb640 1 --2- 172.21.15.114:0/2347100189 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11b00b2d10 0x7f11b00b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.386+0000 7f11b52fb640 1 -- 172.21.15.114:0/2347100189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a8009b30 con 0x7f11b015cd20 2023-11-04T01:36:48.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.386+0000 7f11affff640 1 --2- 172.21.15.114:0/2347100189 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11b00b2d10 0x7f11b00b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:48.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.386+0000 7f11b4afa640 1 --2- 172.21.15.114:0/2347100189 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11b006cae0 0x7f11b0150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:48.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.386+0000 7f11b52fb640 1 --2- 172.21.15.114:0/2347100189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11b015cd20 0x7f11b00b53a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f119800c7f0 tx=0x7f119800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.386+0000 7f11ad7fa640 1 -- 172.21.15.114:0/2347100189 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198007820 con 0x7f11b015cd20 2023-11-04T01:36:48.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.386+0000 7f11ad7fa640 1 -- 172.21.15.114:0/2347100189 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1198007980 con 0x7f11b015cd20 2023-11-04T01:36:48.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.386+0000 7f11b6d5e640 1 -- 172.21.15.114:0/2347100189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b00b5f10 con 0x7f11b015cd20 2023-11-04T01:36:48.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.386+0000 7f11ad7fa640 1 -- 172.21.15.114:0/2347100189 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198007d70 con 0x7f11b015cd20 2023-11-04T01:36:48.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.386+0000 7f11b6d5e640 1 -- 172.21.15.114:0/2347100189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b00c4750 con 0x7f11b015cd20 2023-11-04T01:36:48.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.387+0000 7f11b6d5e640 1 -- 172.21.15.114:0/2347100189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b00c4970 con 0x7f11b015cd20 2023-11-04T01:36:48.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.387+0000 7f11ad7fa640 1 -- 172.21.15.114:0/2347100189 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f11980113f0 con 0x7f11b015cd20 2023-11-04T01:36:48.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.388+0000 7f11ad7fa640 1 --2- 172.21.15.114:0/2347100189 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f119006ae70 0x7f119006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.388+0000 7f11ad7fa640 1 -- 172.21.15.114:0/2347100189 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1198089a30 con 0x7f11b015cd20 2023-11-04T01:36:48.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.388+0000 7f11b4afa640 1 --2- 172.21.15.114:0/2347100189 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f119006ae70 0x7f119006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.388+0000 7f11b4afa640 1 --2- 172.21.15.114:0/2347100189 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f119006ae70 0x7f119006d330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f11a8035000 tx=0x7f11a8030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.392+0000 7f11ad7fa640 1 -- 172.21.15.114:0/2347100189 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f11980547f0 con 0x7f11b015cd20 2023-11-04T01:36:48.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.556+0000 7f11b6d5e640 1 -- 172.21.15.114:0/2347100189 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11b00b0230 con 0x7f119006ae70 2023-11-04T01:36:48.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.565+0000 7f11ad7fa640 1 -- 172.21.15.114:0/2347100189 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345241 (secure 0 0 0) 0x7f11b00b0230 con 0x7f119006ae70 2023-11-04T01:36:48.571 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:48.573 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:36:48.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.568+0000 7f11b6d5e640 1 -- 172.21.15.114:0/2347100189 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f119006ae70 msgr2=0x7f119006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.568+0000 7f11b6d5e640 1 --2- 172.21.15.114:0/2347100189 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f119006ae70 0x7f119006d330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f11a8035000 tx=0x7f11a8030000 comp rx=0 tx=0).stop 2023-11-04T01:36:48.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.568+0000 7f11b6d5e640 1 -- 172.21.15.114:0/2347100189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11b015cd20 msgr2=0x7f11b00b53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.568+0000 7f11b6d5e640 1 --2- 172.21.15.114:0/2347100189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11b015cd20 0x7f11b00b53a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f119800c7f0 tx=0x7f119800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.568+0000 7f11b6d5e640 1 -- 172.21.15.114:0/2347100189 shutdown_connections 2023-11-04T01:36:48.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.568+0000 7f11b6d5e640 1 --2- 172.21.15.114:0/2347100189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11b015cd20 0x7f11b00b53a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.568+0000 7f11b6d5e640 1 --2- 172.21.15.114:0/2347100189 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f119006ae70 0x7f119006d330 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.568+0000 7f11b6d5e640 1 --2- 172.21.15.114:0/2347100189 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f11b00b2d10 0x7f11b00b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.568+0000 7f11b6d5e640 1 --2- 172.21.15.114:0/2347100189 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11b006cae0 0x7f11b0150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.568+0000 7f11b6d5e640 1 -- 172.21.15.114:0/2347100189 >> 172.21.15.114:0/2347100189 conn(0x7f11b00cd600 msgr2=0x7f11b0070a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.568+0000 7f11b6d5e640 1 -- 172.21.15.114:0/2347100189 shutdown_connections 2023-11-04T01:36:48.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.568+0000 7f11b6d5e640 1 -- 172.21.15.114:0/2347100189 wait complete. 2023-11-04T01:36:48.581 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-11-04T01:36:47.861314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594866,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1988068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2088,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002494"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601943+0000","last_change":"2023-11-04T01:36:29.561242+0000","last_active":"2023-11-04T01:36:34.601943+0000","last_peered":"2023-11-04T01:36:34.601943+0000","last_clean":"2023-11-04T01:36:34.601943+0000","last_became_active":"2023-11-04T01:36:29.560999+0000","last_became_peered":"2023-11-04T01:36:29.560999+0000","last_unstale":"2023-11-04T01:36:34.601943+0000","last_undegraded":"2023-11-04T01:36:34.601943+0000","last_fullsized":"2023-11-04T01:36:34.601943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:24.009190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591589+0000","last_change":"2023-11-04T01:36:30.553781+0000","last_active":"2023-11-04T01:36:34.591589+0000","last_peered":"2023-11-04T01:36:34.591589+0000","last_clean":"2023-11-04T01:36:34.591589+0000","last_became_active":"2023-11-04T01:36:30.553037+0000","last_became_peered":"2023-11-04T01:36:30.553037+0000","last_unstale":"2023-11-04T01:36:34.591589+0000","last_undegraded":"2023-11-04T01:36:34.591589+0000","last_fullsized":"2023-11-04T01:36:34.591589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:12.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597204+0000","last_change":"2023-11-04T01:36:34.756965+0000","last_active":"2023-11-04T01:36:35.597204+0000","last_peered":"2023-11-04T01:36:35.597204+0000","last_clean":"2023-11-04T01:36:35.597204+0000","last_became_active":"2023-11-04T01:36:34.756574+0000","last_became_peered":"2023-11-04T01:36:34.756574+0000","last_unstale":"2023-11-04T01:36:35.597204+0000","last_undegraded":"2023-11-04T01:36:35.597204+0000","last_fullsized":"2023-11-04T01:36:35.597204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:51.521044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591774+0000","last_change":"2023-11-04T01:36:29.560879+0000","last_active":"2023-11-04T01:36:34.591774+0000","last_peered":"2023-11-04T01:36:34.591774+0000","last_clean":"2023-11-04T01:36:34.591774+0000","last_became_active":"2023-11-04T01:36:29.560620+0000","last_became_peered":"2023-11-04T01:36:29.560620+0000","last_unstale":"2023-11-04T01:36:34.591774+0000","last_undegraded":"2023-11-04T01:36:34.591774+0000","last_fullsized":"2023-11-04T01:36:34.591774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:46:08.796108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601678+0000","last_change":"2023-11-04T01:36:30.557037+0000","last_active":"2023-11-04T01:36:34.601678+0000","last_peered":"2023-11-04T01:36:34.601678+0000","last_clean":"2023-11-04T01:36:34.601678+0000","last_became_active":"2023-11-04T01:36:30.556650+0000","last_became_peered":"2023-11-04T01:36:30.556650+0000","last_unstale":"2023-11-04T01:36:34.601678+0000","last_undegraded":"2023-11-04T01:36:34.601678+0000","last_fullsized":"2023-11-04T01:36:34.601678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539725+0000","last_change":"2023-11-04T01:36:34.610121+0000","last_active":"2023-11-04T01:36:35.539725+0000","last_peered":"2023-11-04T01:36:35.539725+0000","last_clean":"2023-11-04T01:36:35.539725+0000","last_became_active":"2023-11-04T01:36:34.609174+0000","last_became_peered":"2023-11-04T01:36:34.609174+0000","last_unstale":"2023-11-04T01:36:35.539725+0000","last_undegraded":"2023-11-04T01:36:35.539725+0000","last_fullsized":"2023-11-04T01:36:35.539725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:26:28.949242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752732+0000","last_change":"2023-11-04T01:36:29.568730+0000","last_active":"2023-11-04T01:36:34.752732+0000","last_peered":"2023-11-04T01:36:34.752732+0000","last_clean":"2023-11-04T01:36:34.752732+0000","last_became_active":"2023-11-04T01:36:29.568238+0000","last_became_peered":"2023-11-04T01:36:29.568238+0000","last_unstale":"2023-11-04T01:36:34.752732+0000","last_undegraded":"2023-11-04T01:36:34.752732+0000","last_fullsized":"2023-11-04T01:36:34.752732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:35.972647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600781+0000","last_change":"2023-11-04T01:36:30.555874+0000","last_active":"2023-11-04T01:36:34.600781+0000","last_peered":"2023-11-04T01:36:34.600781+0000","last_clean":"2023-11-04T01:36:34.600781+0000","last_became_active":"2023-11-04T01:36:30.555047+0000","last_became_peered":"2023-11-04T01:36:30.555047+0000","last_unstale":"2023-11-04T01:36:34.600781+0000","last_undegraded":"2023-11-04T01:36:34.600781+0000","last_fullsized":"2023-11-04T01:36:34.600781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:14.190359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540452+0000","last_change":"2023-11-04T01:36:34.609278+0000","last_active":"2023-11-04T01:36:35.540452+0000","last_peered":"2023-11-04T01:36:35.540452+0000","last_clean":"2023-11-04T01:36:35.540452+0000","last_became_active":"2023-11-04T01:36:34.608869+0000","last_became_peered":"2023-11-04T01:36:34.608869+0000","last_unstale":"2023-11-04T01:36:35.540452+0000","last_undegraded":"2023-11-04T01:36:35.540452+0000","last_fullsized":"2023-11-04T01:36:35.540452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:31.223962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752371+0000","last_change":"2023-11-04T01:36:29.566622+0000","last_active":"2023-11-04T01:36:34.752371+0000","last_peered":"2023-11-04T01:36:34.752371+0000","last_clean":"2023-11-04T01:36:34.752371+0000","last_became_active":"2023-11-04T01:36:29.566344+0000","last_became_peered":"2023-11-04T01:36:29.566344+0000","last_unstale":"2023-11-04T01:36:34.752371+0000","last_undegraded":"2023-11-04T01:36:34.752371+0000","last_fullsized":"2023-11-04T01:36:34.752371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:28.954776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600963+0000","last_change":"2023-11-04T01:36:30.555732+0000","last_active":"2023-11-04T01:36:34.600963+0000","last_peered":"2023-11-04T01:36:34.600963+0000","last_clean":"2023-11-04T01:36:34.600963+0000","last_became_active":"2023-11-04T01:36:30.555435+0000","last_became_peered":"2023-11-04T01:36:30.555435+0000","last_unstale":"2023-11-04T01:36:34.600963+0000","last_undegraded":"2023-11-04T01:36:34.600963+0000","last_fullsized":"2023-11-04T01:36:34.600963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:24.536087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539719+0000","last_change":"2023-11-04T01:36:34.610431+0000","last_active":"2023-11-04T01:36:35.539719+0000","last_peered":"2023-11-04T01:36:35.539719+0000","last_clean":"2023-11-04T01:36:35.539719+0000","last_became_active":"2023-11-04T01:36:34.609116+0000","last_became_peered":"2023-11-04T01:36:34.609116+0000","last_unstale":"2023-11-04T01:36:35.539719+0000","last_undegraded":"2023-11-04T01:36:35.539719+0000","last_fullsized":"2023-11-04T01:36:35.539719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:19.082626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592957+0000","last_change":"2023-11-04T01:36:30.552617+0000","last_active":"2023-11-04T01:36:34.592957+0000","last_peered":"2023-11-04T01:36:34.592957+0000","last_clean":"2023-11-04T01:36:34.592957+0000","last_became_active":"2023-11-04T01:36:30.552315+0000","last_became_peered":"2023-11-04T01:36:30.552315+0000","last_unstale":"2023-11-04T01:36:34.592957+0000","last_undegraded":"2023-11-04T01:36:34.592957+0000","last_fullsized":"2023-11-04T01:36:34.592957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:10.369120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752388+0000","last_change":"2023-11-04T01:36:29.568663+0000","last_active":"2023-11-04T01:36:34.752388+0000","last_peered":"2023-11-04T01:36:34.752388+0000","last_clean":"2023-11-04T01:36:34.752388+0000","last_became_active":"2023-11-04T01:36:29.568262+0000","last_became_peered":"2023-11-04T01:36:29.568262+0000","last_unstale":"2023-11-04T01:36:34.752388+0000","last_undegraded":"2023-11-04T01:36:34.752388+0000","last_fullsized":"2023-11-04T01:36:34.752388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:11.541445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540192+0000","last_change":"2023-11-04T01:36:34.607200+0000","last_active":"2023-11-04T01:36:35.540192+0000","last_peered":"2023-11-04T01:36:35.540192+0000","last_clean":"2023-11-04T01:36:35.540192+0000","last_became_active":"2023-11-04T01:36:34.606762+0000","last_became_peered":"2023-11-04T01:36:34.606762+0000","last_unstale":"2023-11-04T01:36:35.540192+0000","last_undegraded":"2023-11-04T01:36:35.540192+0000","last_fullsized":"2023-11-04T01:36:35.540192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:54.343995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591387+0000","last_change":"2023-11-04T01:36:30.555385+0000","last_active":"2023-11-04T01:36:34.591387+0000","last_peered":"2023-11-04T01:36:34.591387+0000","last_clean":"2023-11-04T01:36:34.591387+0000","last_became_active":"2023-11-04T01:36:30.555109+0000","last_became_peered":"2023-11-04T01:36:30.555109+0000","last_unstale":"2023-11-04T01:36:34.591387+0000","last_undegraded":"2023-11-04T01:36:34.591387+0000","last_fullsized":"2023-11-04T01:36:34.591387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:26:24.912249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597945+0000","last_change":"2023-11-04T01:36:29.568618+0000","last_active":"2023-11-04T01:36:34.597945+0000","last_peered":"2023-11-04T01:36:34.597945+0000","last_clean":"2023-11-04T01:36:34.597945+0000","last_became_active":"2023-11-04T01:36:29.568318+0000","last_became_peered":"2023-11-04T01:36:29.568318+0000","last_unstale":"2023-11-04T01:36:34.597945+0000","last_undegraded":"2023-11-04T01:36:34.597945+0000","last_fullsized":"2023-11-04T01:36:34.597945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:55.902083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540096+0000","last_change":"2023-11-04T01:36:34.609429+0000","last_active":"2023-11-04T01:36:35.540096+0000","last_peered":"2023-11-04T01:36:35.540096+0000","last_clean":"2023-11-04T01:36:35.540096+0000","last_became_active":"2023-11-04T01:36:34.608964+0000","last_became_peered":"2023-11-04T01:36:34.608964+0000","last_unstale":"2023-11-04T01:36:35.540096+0000","last_undegraded":"2023-11-04T01:36:35.540096+0000","last_fullsized":"2023-11-04T01:36:35.540096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:18.227352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591308+0000","last_change":"2023-11-04T01:36:30.548722+0000","last_active":"2023-11-04T01:36:34.591308+0000","last_peered":"2023-11-04T01:36:34.591308+0000","last_clean":"2023-11-04T01:36:34.591308+0000","last_became_active":"2023-11-04T01:36:30.548380+0000","last_became_peered":"2023-11-04T01:36:30.548380+0000","last_unstale":"2023-11-04T01:36:34.591308+0000","last_undegraded":"2023-11-04T01:36:34.591308+0000","last_fullsized":"2023-11-04T01:36:34.591308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:10.369120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597698+0000","last_change":"2023-11-04T01:36:29.563976+0000","last_active":"2023-11-04T01:36:34.597698+0000","last_peered":"2023-11-04T01:36:34.597698+0000","last_clean":"2023-11-04T01:36:34.597698+0000","last_became_active":"2023-11-04T01:36:29.563703+0000","last_became_peered":"2023-11-04T01:36:29.563703+0000","last_unstale":"2023-11-04T01:36:34.597698+0000","last_undegraded":"2023-11-04T01:36:34.597698+0000","last_fullsized":"2023-11-04T01:36:34.597698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:19.388284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597228+0000","last_change":"2023-11-04T01:36:34.754663+0000","last_active":"2023-11-04T01:36:35.597228+0000","last_peered":"2023-11-04T01:36:35.597228+0000","last_clean":"2023-11-04T01:36:35.597228+0000","last_became_active":"2023-11-04T01:36:34.754298+0000","last_became_peered":"2023-11-04T01:36:34.754298+0000","last_unstale":"2023-11-04T01:36:35.597228+0000","last_undegraded":"2023-11-04T01:36:35.597228+0000","last_fullsized":"2023-11-04T01:36:35.597228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:11.471843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593223+0000","last_change":"2023-11-04T01:36:30.552453+0000","last_active":"2023-11-04T01:36:34.593223+0000","last_peered":"2023-11-04T01:36:34.593223+0000","last_clean":"2023-11-04T01:36:34.593223+0000","last_became_active":"2023-11-04T01:36:30.551991+0000","last_became_peered":"2023-11-04T01:36:30.551991+0000","last_unstale":"2023-11-04T01:36:34.593223+0000","last_undegraded":"2023-11-04T01:36:34.593223+0000","last_fullsized":"2023-11-04T01:36:34.593223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:09.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.751896+0000","last_change":"2023-11-04T01:36:29.566350+0000","last_active":"2023-11-04T01:36:34.751896+0000","last_peered":"2023-11-04T01:36:34.751896+0000","last_clean":"2023-11-04T01:36:34.751896+0000","last_became_active":"2023-11-04T01:36:29.566017+0000","last_became_peered":"2023-11-04T01:36:29.566017+0000","last_unstale":"2023-11-04T01:36:34.751896+0000","last_undegraded":"2023-11-04T01:36:34.751896+0000","last_fullsized":"2023-11-04T01:36:34.751896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:14.041288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539829+0000","last_change":"2023-11-04T01:36:34.610359+0000","last_active":"2023-11-04T01:36:35.539829+0000","last_peered":"2023-11-04T01:36:35.539829+0000","last_clean":"2023-11-04T01:36:35.539829+0000","last_became_active":"2023-11-04T01:36:34.609199+0000","last_became_peered":"2023-11-04T01:36:34.609199+0000","last_unstale":"2023-11-04T01:36:35.539829+0000","last_undegraded":"2023-11-04T01:36:35.539829+0000","last_fullsized":"2023-11-04T01:36:35.539829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:33.296091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601796+0000","last_change":"2023-11-04T01:36:30.552716+0000","last_active":"2023-11-04T01:36:34.601796+0000","last_peered":"2023-11-04T01:36:34.601796+0000","last_clean":"2023-11-04T01:36:34.601796+0000","last_became_active":"2023-11-04T01:36:30.552100+0000","last_became_peered":"2023-11-04T01:36:30.552100+0000","last_unstale":"2023-11-04T01:36:34.601796+0000","last_undegraded":"2023-11-04T01:36:34.601796+0000","last_fullsized":"2023-11-04T01:36:34.601796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:36.996384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593302+0000","last_change":"2023-11-04T01:36:29.559145+0000","last_active":"2023-11-04T01:36:34.593302+0000","last_peered":"2023-11-04T01:36:34.593302+0000","last_clean":"2023-11-04T01:36:34.593302+0000","last_became_active":"2023-11-04T01:36:29.558717+0000","last_became_peered":"2023-11-04T01:36:29.558717+0000","last_unstale":"2023-11-04T01:36:34.593302+0000","last_undegraded":"2023-11-04T01:36:34.593302+0000","last_fullsized":"2023-11-04T01:36:34.593302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:27.522090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540333+0000","last_change":"2023-11-04T01:36:34.757021+0000","last_active":"2023-11-04T01:36:35.540333+0000","last_peered":"2023-11-04T01:36:35.540333+0000","last_clean":"2023-11-04T01:36:35.540333+0000","last_became_active":"2023-11-04T01:36:34.756621+0000","last_became_peered":"2023-11-04T01:36:34.756621+0000","last_unstale":"2023-11-04T01:36:35.540333+0000","last_undegraded":"2023-11-04T01:36:35.540333+0000","last_fullsized":"2023-11-04T01:36:35.540333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:09.612714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591751+0000","last_change":"2023-11-04T01:36:30.558233+0000","last_active":"2023-11-04T01:36:34.591751+0000","last_peered":"2023-11-04T01:36:34.591751+0000","last_clean":"2023-11-04T01:36:34.591751+0000","last_became_active":"2023-11-04T01:36:30.557978+0000","last_became_peered":"2023-11-04T01:36:30.557978+0000","last_unstale":"2023-11-04T01:36:34.591751+0000","last_undegraded":"2023-11-04T01:36:34.591751+0000","last_fullsized":"2023-11-04T01:36:34.591751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.045633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597917+0000","last_change":"2023-11-04T01:36:29.562995+0000","last_active":"2023-11-04T01:36:34.597917+0000","last_peered":"2023-11-04T01:36:34.597917+0000","last_clean":"2023-11-04T01:36:34.597917+0000","last_became_active":"2023-11-04T01:36:29.561703+0000","last_became_peered":"2023-11-04T01:36:29.561703+0000","last_unstale":"2023-11-04T01:36:34.597917+0000","last_undegraded":"2023-11-04T01:36:34.597917+0000","last_fullsized":"2023-11-04T01:36:34.597917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:24.009190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.595578+0000","last_change":"2023-11-04T01:36:34.754583+0000","last_active":"2023-11-04T01:36:35.595578+0000","last_peered":"2023-11-04T01:36:35.595578+0000","last_clean":"2023-11-04T01:36:35.595578+0000","last_became_active":"2023-11-04T01:36:34.754217+0000","last_became_peered":"2023-11-04T01:36:34.754217+0000","last_unstale":"2023-11-04T01:36:35.595578+0000","last_undegraded":"2023-11-04T01:36:35.595578+0000","last_fullsized":"2023-11-04T01:36:35.595578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:52.513758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597832+0000","last_change":"2023-11-04T01:36:30.551747+0000","last_active":"2023-11-04T01:36:34.597832+0000","last_peered":"2023-11-04T01:36:34.597832+0000","last_clean":"2023-11-04T01:36:34.597832+0000","last_became_active":"2023-11-04T01:36:30.551482+0000","last_became_peered":"2023-11-04T01:36:30.551482+0000","last_unstale":"2023-11-04T01:36:34.597832+0000","last_undegraded":"2023-11-04T01:36:34.597832+0000","last_fullsized":"2023-11-04T01:36:34.597832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:36.996384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752833+0000","last_change":"2023-11-04T01:36:29.571353+0000","last_active":"2023-11-04T01:36:34.752833+0000","last_peered":"2023-11-04T01:36:34.752833+0000","last_clean":"2023-11-04T01:36:34.752833+0000","last_became_active":"2023-11-04T01:36:29.571116+0000","last_became_peered":"2023-11-04T01:36:29.571116+0000","last_unstale":"2023-11-04T01:36:34.752833+0000","last_undegraded":"2023-11-04T01:36:34.752833+0000","last_fullsized":"2023-11-04T01:36:34.752833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:28.254753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597205+0000","last_change":"2023-11-04T01:36:34.752449+0000","last_active":"2023-11-04T01:36:35.597205+0000","last_peered":"2023-11-04T01:36:35.597205+0000","last_clean":"2023-11-04T01:36:35.597205+0000","last_became_active":"2023-11-04T01:36:34.752021+0000","last_became_peered":"2023-11-04T01:36:34.752021+0000","last_unstale":"2023-11-04T01:36:35.597205+0000","last_undegraded":"2023-11-04T01:36:35.597205+0000","last_fullsized":"2023-11-04T01:36:35.597205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:09.612714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600961+0000","last_change":"2023-11-04T01:36:30.558205+0000","last_active":"2023-11-04T01:36:34.600961+0000","last_peered":"2023-11-04T01:36:34.600961+0000","last_clean":"2023-11-04T01:36:34.600961+0000","last_became_active":"2023-11-04T01:36:30.557948+0000","last_became_peered":"2023-11-04T01:36:30.557948+0000","last_unstale":"2023-11-04T01:36:34.600961+0000","last_undegraded":"2023-11-04T01:36:34.600961+0000","last_fullsized":"2023-11-04T01:36:34.600961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:05.575722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597915+0000","last_change":"2023-11-04T01:36:29.566447+0000","last_active":"2023-11-04T01:36:34.597915+0000","last_peered":"2023-11-04T01:36:34.597915+0000","last_clean":"2023-11-04T01:36:34.597915+0000","last_became_active":"2023-11-04T01:36:29.566149+0000","last_became_peered":"2023-11-04T01:36:29.566149+0000","last_unstale":"2023-11-04T01:36:34.597915+0000","last_undegraded":"2023-11-04T01:36:34.597915+0000","last_fullsized":"2023-11-04T01:36:34.597915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:36.610872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.596192+0000","last_change":"2023-11-04T01:36:34.612816+0000","last_active":"2023-11-04T01:36:35.596192+0000","last_peered":"2023-11-04T01:36:35.596192+0000","last_clean":"2023-11-04T01:36:35.596192+0000","last_became_active":"2023-11-04T01:36:34.612411+0000","last_became_peered":"2023-11-04T01:36:34.612411+0000","last_unstale":"2023-11-04T01:36:35.596192+0000","last_undegraded":"2023-11-04T01:36:35.596192+0000","last_fullsized":"2023-11-04T01:36:35.596192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:28.573079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592465+0000","last_change":"2023-11-04T01:36:30.553297+0000","last_active":"2023-11-04T01:36:34.592465+0000","last_peered":"2023-11-04T01:36:34.592465+0000","last_clean":"2023-11-04T01:36:34.592465+0000","last_became_active":"2023-11-04T01:36:30.552992+0000","last_became_peered":"2023-11-04T01:36:30.552992+0000","last_unstale":"2023-11-04T01:36:34.592465+0000","last_undegraded":"2023-11-04T01:36:34.592465+0000","last_fullsized":"2023-11-04T01:36:34.592465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:25.013535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600577+0000","last_change":"2023-11-04T01:36:29.564983+0000","last_active":"2023-11-04T01:36:34.600577+0000","last_peered":"2023-11-04T01:36:34.600577+0000","last_clean":"2023-11-04T01:36:34.600577+0000","last_became_active":"2023-11-04T01:36:29.564679+0000","last_became_peered":"2023-11-04T01:36:29.564679+0000","last_unstale":"2023-11-04T01:36:34.600577+0000","last_undegraded":"2023-11-04T01:36:34.600577+0000","last_fullsized":"2023-11-04T01:36:34.600577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:35.972647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.596517+0000","last_change":"2023-11-04T01:36:34.609968+0000","last_active":"2023-11-04T01:36:35.596517+0000","last_peered":"2023-11-04T01:36:35.596517+0000","last_clean":"2023-11-04T01:36:35.596517+0000","last_became_active":"2023-11-04T01:36:34.609460+0000","last_became_peered":"2023-11-04T01:36:34.609460+0000","last_unstale":"2023-11-04T01:36:35.596517+0000","last_undegraded":"2023-11-04T01:36:35.596517+0000","last_fullsized":"2023-11-04T01:36:35.596517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:09.612714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597523+0000","last_change":"2023-11-04T01:36:30.551741+0000","last_active":"2023-11-04T01:36:34.597523+0000","last_peered":"2023-11-04T01:36:34.597523+0000","last_clean":"2023-11-04T01:36:34.597523+0000","last_became_active":"2023-11-04T01:36:30.551456+0000","last_became_peered":"2023-11-04T01:36:30.551456+0000","last_unstale":"2023-11-04T01:36:34.597523+0000","last_undegraded":"2023-11-04T01:36:34.597523+0000","last_fullsized":"2023-11-04T01:36:34.597523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:36.976993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603079+0000","last_change":"2023-11-04T01:36:29.562224+0000","last_active":"2023-11-04T01:36:34.603079+0000","last_peered":"2023-11-04T01:36:34.603079+0000","last_clean":"2023-11-04T01:36:34.603079+0000","last_became_active":"2023-11-04T01:36:29.561870+0000","last_became_peered":"2023-11-04T01:36:29.561870+0000","last_unstale":"2023-11-04T01:36:34.603079+0000","last_undegraded":"2023-11-04T01:36:34.603079+0000","last_fullsized":"2023-11-04T01:36:34.603079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:08.164823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597173+0000","last_change":"2023-11-04T01:36:34.610751+0000","last_active":"2023-11-04T01:36:35.597173+0000","last_peered":"2023-11-04T01:36:35.597173+0000","last_clean":"2023-11-04T01:36:35.597173+0000","last_became_active":"2023-11-04T01:36:34.610375+0000","last_became_peered":"2023-11-04T01:36:34.610375+0000","last_unstale":"2023-11-04T01:36:35.597173+0000","last_undegraded":"2023-11-04T01:36:35.597173+0000","last_fullsized":"2023-11-04T01:36:35.597173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:34.881207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.599741+0000","last_change":"2023-11-04T01:36:30.553476+0000","last_active":"2023-11-04T01:36:34.599741+0000","last_peered":"2023-11-04T01:36:34.599741+0000","last_clean":"2023-11-04T01:36:34.599741+0000","last_became_active":"2023-11-04T01:36:30.553178+0000","last_became_peered":"2023-11-04T01:36:30.553178+0000","last_unstale":"2023-11-04T01:36:34.599741+0000","last_undegraded":"2023-11-04T01:36:34.599741+0000","last_fullsized":"2023-11-04T01:36:34.599741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:28.526436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752210+0000","last_change":"2023-11-04T01:36:29.565970+0000","last_active":"2023-11-04T01:36:34.752210+0000","last_peered":"2023-11-04T01:36:34.752210+0000","last_clean":"2023-11-04T01:36:34.752210+0000","last_became_active":"2023-11-04T01:36:29.565617+0000","last_became_peered":"2023-11-04T01:36:29.565617+0000","last_unstale":"2023-11-04T01:36:34.752210+0000","last_undegraded":"2023-11-04T01:36:34.752210+0000","last_fullsized":"2023-11-04T01:36:34.752210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:00.121926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597914+0000","last_change":"2023-11-04T01:36:34.755484+0000","last_active":"2023-11-04T01:36:35.597914+0000","last_peered":"2023-11-04T01:36:35.597914+0000","last_clean":"2023-11-04T01:36:35.597914+0000","last_became_active":"2023-11-04T01:36:34.755124+0000","last_became_peered":"2023-11-04T01:36:34.755124+0000","last_unstale":"2023-11-04T01:36:35.597914+0000","last_undegraded":"2023-11-04T01:36:35.597914+0000","last_fullsized":"2023-11-04T01:36:35.597914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:54:21.582207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590734+0000","last_change":"2023-11-04T01:36:30.558717+0000","last_active":"2023-11-04T01:36:34.590734+0000","last_peered":"2023-11-04T01:36:34.590734+0000","last_clean":"2023-11-04T01:36:34.590734+0000","last_became_active":"2023-11-04T01:36:30.558442+0000","last_became_peered":"2023-11-04T01:36:30.558442+0000","last_unstale":"2023-11-04T01:36:34.590734+0000","last_undegraded":"2023-11-04T01:36:34.590734+0000","last_fullsized":"2023-11-04T01:36:34.590734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600670+0000","last_change":"2023-11-04T01:36:29.558941+0000","last_active":"2023-11-04T01:36:34.600670+0000","last_peered":"2023-11-04T01:36:34.600670+0000","last_clean":"2023-11-04T01:36:34.600670+0000","last_became_active":"2023-11-04T01:36:29.558628+0000","last_became_peered":"2023-11-04T01:36:29.558628+0000","last_unstale":"2023-11-04T01:36:34.600670+0000","last_undegraded":"2023-11-04T01:36:34.600670+0000","last_fullsized":"2023-11-04T01:36:34.600670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:32:58.476395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752215+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:36:34.752215+0000","last_peered":"2023-11-04T01:36:34.752215+0000","last_clean":"2023-11-04T01:36:34.752215+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:36:34.752215+0000","last_undegraded":"2023-11-04T01:36:34.752215+0000","last_fullsized":"2023-11-04T01:36:34.752215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539400+0000","last_change":"2023-11-04T01:36:34.754650+0000","last_active":"2023-11-04T01:36:35.539400+0000","last_peered":"2023-11-04T01:36:35.539400+0000","last_clean":"2023-11-04T01:36:35.539400+0000","last_became_active":"2023-11-04T01:36:34.754266+0000","last_became_peered":"2023-11-04T01:36:34.754266+0000","last_unstale":"2023-11-04T01:36:35.539400+0000","last_undegraded":"2023-11-04T01:36:35.539400+0000","last_fullsized":"2023-11-04T01:36:35.539400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:28.573079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752605+0000","last_change":"2023-11-04T01:36:30.559432+0000","last_active":"2023-11-04T01:36:34.752605+0000","last_peered":"2023-11-04T01:36:34.752605+0000","last_clean":"2023-11-04T01:36:34.752605+0000","last_became_active":"2023-11-04T01:36:30.559164+0000","last_became_peered":"2023-11-04T01:36:30.559164+0000","last_unstale":"2023-11-04T01:36:34.752605+0000","last_undegraded":"2023-11-04T01:36:34.752605+0000","last_fullsized":"2023-11-04T01:36:34.752605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:07.434851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603732+0000","last_change":"2023-11-04T01:36:29.559481+0000","last_active":"2023-11-04T01:36:34.603732+0000","last_peered":"2023-11-04T01:36:34.603732+0000","last_clean":"2023-11-04T01:36:34.603732+0000","last_became_active":"2023-11-04T01:36:29.559232+0000","last_became_peered":"2023-11-04T01:36:29.559232+0000","last_unstale":"2023-11-04T01:36:34.603732+0000","last_undegraded":"2023-11-04T01:36:34.603732+0000","last_fullsized":"2023-11-04T01:36:34.603732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:39.985078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539003+0000","last_change":"2023-11-04T01:36:34.752537+0000","last_active":"2023-11-04T01:36:35.539003+0000","last_peered":"2023-11-04T01:36:35.539003+0000","last_clean":"2023-11-04T01:36:35.539003+0000","last_became_active":"2023-11-04T01:36:34.752122+0000","last_became_peered":"2023-11-04T01:36:34.752122+0000","last_unstale":"2023-11-04T01:36:35.539003+0000","last_undegraded":"2023-11-04T01:36:35.539003+0000","last_fullsized":"2023-11-04T01:36:35.539003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:54.343995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600864+0000","last_change":"2023-11-04T01:36:30.559114+0000","last_active":"2023-11-04T01:36:34.600864+0000","last_peered":"2023-11-04T01:36:34.600864+0000","last_clean":"2023-11-04T01:36:34.600864+0000","last_became_active":"2023-11-04T01:36:30.556702+0000","last_became_peered":"2023-11-04T01:36:30.556702+0000","last_unstale":"2023-11-04T01:36:34.600864+0000","last_undegraded":"2023-11-04T01:36:34.600864+0000","last_fullsized":"2023-11-04T01:36:34.600864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:30.844215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597914+0000","last_change":"2023-11-04T01:36:29.563452+0000","last_active":"2023-11-04T01:36:34.597914+0000","last_peered":"2023-11-04T01:36:34.597914+0000","last_clean":"2023-11-04T01:36:34.597914+0000","last_became_active":"2023-11-04T01:36:29.561923+0000","last_became_peered":"2023-11-04T01:36:29.561923+0000","last_unstale":"2023-11-04T01:36:34.597914+0000","last_undegraded":"2023-11-04T01:36:34.597914+0000","last_fullsized":"2023-11-04T01:36:34.597914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:27.522090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597420+0000","last_change":"2023-11-04T01:36:34.608316+0000","last_active":"2023-11-04T01:36:35.597420+0000","last_peered":"2023-11-04T01:36:35.597420+0000","last_clean":"2023-11-04T01:36:35.597420+0000","last_became_active":"2023-11-04T01:36:34.607936+0000","last_became_peered":"2023-11-04T01:36:34.607936+0000","last_unstale":"2023-11-04T01:36:35.597420+0000","last_undegraded":"2023-11-04T01:36:35.597420+0000","last_fullsized":"2023-11-04T01:36:35.597420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:31.223962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752975+0000","last_change":"2023-11-04T01:36:30.557506+0000","last_active":"2023-11-04T01:36:34.752975+0000","last_peered":"2023-11-04T01:36:34.752975+0000","last_clean":"2023-11-04T01:36:34.752975+0000","last_became_active":"2023-11-04T01:36:30.557188+0000","last_became_peered":"2023-11-04T01:36:30.557188+0000","last_unstale":"2023-11-04T01:36:34.752975+0000","last_undegraded":"2023-11-04T01:36:34.752975+0000","last_fullsized":"2023-11-04T01:36:34.752975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:59.924265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603522+0000","last_change":"2023-11-04T01:36:29.561929+0000","last_active":"2023-11-04T01:36:34.603522+0000","last_peered":"2023-11-04T01:36:34.603522+0000","last_clean":"2023-11-04T01:36:34.603522+0000","last_became_active":"2023-11-04T01:36:29.561665+0000","last_became_peered":"2023-11-04T01:36:29.561665+0000","last_unstale":"2023-11-04T01:36:34.603522+0000","last_undegraded":"2023-11-04T01:36:34.603522+0000","last_fullsized":"2023-11-04T01:36:34.603522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:55.902083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.595491+0000","last_change":"2023-11-04T01:36:34.755096+0000","last_active":"2023-11-04T01:36:35.595491+0000","last_peered":"2023-11-04T01:36:35.595491+0000","last_clean":"2023-11-04T01:36:35.595491+0000","last_became_active":"2023-11-04T01:36:34.754200+0000","last_became_peered":"2023-11-04T01:36:34.754200+0000","last_unstale":"2023-11-04T01:36:35.595491+0000","last_undegraded":"2023-11-04T01:36:35.595491+0000","last_fullsized":"2023-11-04T01:36:35.595491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:51.521044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752673+0000","last_change":"2023-11-04T01:36:30.556808+0000","last_active":"2023-11-04T01:36:34.752673+0000","last_peered":"2023-11-04T01:36:34.752673+0000","last_clean":"2023-11-04T01:36:34.752673+0000","last_became_active":"2023-11-04T01:36:30.556522+0000","last_became_peered":"2023-11-04T01:36:30.556522+0000","last_unstale":"2023-11-04T01:36:34.752673+0000","last_undegraded":"2023-11-04T01:36:34.752673+0000","last_fullsized":"2023-11-04T01:36:34.752673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:48.476765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591829+0000","last_change":"2023-11-04T01:36:29.560106+0000","last_active":"2023-11-04T01:36:34.591829+0000","last_peered":"2023-11-04T01:36:34.591829+0000","last_clean":"2023-11-04T01:36:34.591829+0000","last_became_active":"2023-11-04T01:36:29.559786+0000","last_became_peered":"2023-11-04T01:36:29.559786+0000","last_unstale":"2023-11-04T01:36:34.591829+0000","last_undegraded":"2023-11-04T01:36:34.591829+0000","last_fullsized":"2023-11-04T01:36:34.591829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:37:02.831923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539853+0000","last_change":"2023-11-04T01:36:34.610033+0000","last_active":"2023-11-04T01:36:35.539853+0000","last_peered":"2023-11-04T01:36:35.539853+0000","last_clean":"2023-11-04T01:36:35.539853+0000","last_became_active":"2023-11-04T01:36:34.609439+0000","last_became_peered":"2023-11-04T01:36:34.609439+0000","last_unstale":"2023-11-04T01:36:35.539853+0000","last_undegraded":"2023-11-04T01:36:35.539853+0000","last_fullsized":"2023-11-04T01:36:35.539853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:57.965365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752112+0000","last_change":"2023-11-04T01:36:30.556245+0000","last_active":"2023-11-04T01:36:34.752112+0000","last_peered":"2023-11-04T01:36:34.752112+0000","last_clean":"2023-11-04T01:36:34.752112+0000","last_became_active":"2023-11-04T01:36:30.555523+0000","last_became_peered":"2023-11-04T01:36:30.555523+0000","last_unstale":"2023-11-04T01:36:34.752112+0000","last_undegraded":"2023-11-04T01:36:34.752112+0000","last_fullsized":"2023-11-04T01:36:34.752112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:24.536087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603267+0000","last_change":"2023-11-04T01:36:29.558752+0000","last_active":"2023-11-04T01:36:34.603267+0000","last_peered":"2023-11-04T01:36:34.603267+0000","last_clean":"2023-11-04T01:36:34.603267+0000","last_became_active":"2023-11-04T01:36:29.558430+0000","last_became_peered":"2023-11-04T01:36:29.558430+0000","last_unstale":"2023-11-04T01:36:34.603267+0000","last_undegraded":"2023-11-04T01:36:34.603267+0000","last_fullsized":"2023-11-04T01:36:34.603267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:46.170109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597667+0000","last_change":"2023-11-04T01:36:34.610894+0000","last_active":"2023-11-04T01:36:35.597667+0000","last_peered":"2023-11-04T01:36:35.597667+0000","last_clean":"2023-11-04T01:36:35.597667+0000","last_became_active":"2023-11-04T01:36:34.609868+0000","last_became_peered":"2023-11-04T01:36:34.609868+0000","last_unstale":"2023-11-04T01:36:35.597667+0000","last_undegraded":"2023-11-04T01:36:35.597667+0000","last_fullsized":"2023-11-04T01:36:35.597667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:11.471843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590924+0000","last_change":"2023-11-04T01:36:30.553108+0000","last_active":"2023-11-04T01:36:34.590924+0000","last_peered":"2023-11-04T01:36:34.590924+0000","last_clean":"2023-11-04T01:36:34.590924+0000","last_became_active":"2023-11-04T01:36:30.552812+0000","last_became_peered":"2023-11-04T01:36:30.552812+0000","last_unstale":"2023-11-04T01:36:34.590924+0000","last_undegraded":"2023-11-04T01:36:34.590924+0000","last_fullsized":"2023-11-04T01:36:34.590924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:17.787245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591689+0000","last_change":"2023-11-04T01:36:29.555166+0000","last_active":"2023-11-04T01:36:34.591689+0000","last_peered":"2023-11-04T01:36:34.591689+0000","last_clean":"2023-11-04T01:36:34.591689+0000","last_became_active":"2023-11-04T01:36:29.554537+0000","last_became_peered":"2023-11-04T01:36:29.554537+0000","last_unstale":"2023-11-04T01:36:34.591689+0000","last_undegraded":"2023-11-04T01:36:34.591689+0000","last_fullsized":"2023-11-04T01:36:34.591689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:28.954776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597394+0000","last_change":"2023-11-04T01:36:34.754737+0000","last_active":"2023-11-04T01:36:35.597394+0000","last_peered":"2023-11-04T01:36:35.597394+0000","last_clean":"2023-11-04T01:36:35.597394+0000","last_became_active":"2023-11-04T01:36:34.754360+0000","last_became_peered":"2023-11-04T01:36:34.754360+0000","last_unstale":"2023-11-04T01:36:35.597394+0000","last_undegraded":"2023-11-04T01:36:35.597394+0000","last_fullsized":"2023-11-04T01:36:35.597394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:25.393431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752320+0000","last_change":"2023-11-04T01:36:30.555902+0000","last_active":"2023-11-04T01:36:34.752320+0000","last_peered":"2023-11-04T01:36:34.752320+0000","last_clean":"2023-11-04T01:36:34.752320+0000","last_became_active":"2023-11-04T01:36:30.555624+0000","last_became_peered":"2023-11-04T01:36:30.555624+0000","last_unstale":"2023-11-04T01:36:34.752320+0000","last_undegraded":"2023-11-04T01:36:34.752320+0000","last_fullsized":"2023-11-04T01:36:34.752320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:27.186969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600516+0000","last_change":"2023-11-04T01:36:29.566041+0000","last_active":"2023-11-04T01:36:34.600516+0000","last_peered":"2023-11-04T01:36:34.600516+0000","last_clean":"2023-11-04T01:36:34.600516+0000","last_became_active":"2023-11-04T01:36:29.565674+0000","last_became_peered":"2023-11-04T01:36:29.565674+0000","last_unstale":"2023-11-04T01:36:34.600516+0000","last_undegraded":"2023-11-04T01:36:34.600516+0000","last_fullsized":"2023-11-04T01:36:34.600516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:11.541445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597902+0000","last_change":"2023-11-04T01:36:34.752418+0000","last_active":"2023-11-04T01:36:35.597902+0000","last_peered":"2023-11-04T01:36:35.597902+0000","last_clean":"2023-11-04T01:36:35.597902+0000","last_became_active":"2023-11-04T01:36:34.752054+0000","last_became_peered":"2023-11-04T01:36:34.752054+0000","last_unstale":"2023-11-04T01:36:35.597902+0000","last_undegraded":"2023-11-04T01:36:35.597902+0000","last_fullsized":"2023-11-04T01:36:35.597902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:44.979273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601844+0000","last_change":"2023-11-04T01:36:30.559566+0000","last_active":"2023-11-04T01:36:34.601844+0000","last_peered":"2023-11-04T01:36:34.601844+0000","last_clean":"2023-11-04T01:36:34.601844+0000","last_became_active":"2023-11-04T01:36:30.559372+0000","last_became_peered":"2023-11-04T01:36:30.559372+0000","last_unstale":"2023-11-04T01:36:34.601844+0000","last_undegraded":"2023-11-04T01:36:34.601844+0000","last_fullsized":"2023-11-04T01:36:34.601844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:17.787245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603204+0000","last_change":"2023-11-04T01:36:29.559883+0000","last_active":"2023-11-04T01:36:34.603204+0000","last_peered":"2023-11-04T01:36:34.603204+0000","last_clean":"2023-11-04T01:36:34.603204+0000","last_became_active":"2023-11-04T01:36:29.559623+0000","last_became_peered":"2023-11-04T01:36:29.559623+0000","last_unstale":"2023-11-04T01:36:34.603204+0000","last_undegraded":"2023-11-04T01:36:34.603204+0000","last_fullsized":"2023-11-04T01:36:34.603204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:19.388284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.596818+0000","last_change":"2023-11-04T01:36:34.752434+0000","last_active":"2023-11-04T01:36:35.596818+0000","last_peered":"2023-11-04T01:36:35.596818+0000","last_clean":"2023-11-04T01:36:35.596818+0000","last_became_active":"2023-11-04T01:36:34.752050+0000","last_became_peered":"2023-11-04T01:36:34.752050+0000","last_unstale":"2023-11-04T01:36:35.596818+0000","last_undegraded":"2023-11-04T01:36:35.596818+0000","last_fullsized":"2023-11-04T01:36:35.596818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:38:03.961257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752508+0000","last_change":"2023-11-04T01:36:30.554177+0000","last_active":"2023-11-04T01:36:34.752508+0000","last_peered":"2023-11-04T01:36:34.752508+0000","last_clean":"2023-11-04T01:36:34.752508+0000","last_became_active":"2023-11-04T01:36:30.553678+0000","last_became_peered":"2023-11-04T01:36:30.553678+0000","last_unstale":"2023-11-04T01:36:34.752508+0000","last_undegraded":"2023-11-04T01:36:34.752508+0000","last_fullsized":"2023-11-04T01:36:34.752508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:30.844215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:39.478764+0000","last_change":"2023-11-04T01:36:29.563305+0000","last_active":"2023-11-04T01:36:39.478764+0000","last_peered":"2023-11-04T01:36:39.478764+0000","last_clean":"2023-11-04T01:36:39.478764+0000","last_became_active":"2023-11-04T01:36:29.563013+0000","last_became_peered":"2023-11-04T01:36:29.563013+0000","last_unstale":"2023-11-04T01:36:39.478764+0000","last_undegraded":"2023-11-04T01:36:39.478764+0000","last_fullsized":"2023-11-04T01:36:39.478764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:46:08.796108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.596633+0000","last_change":"2023-11-04T01:36:34.608299+0000","last_active":"2023-11-04T01:36:35.596633+0000","last_peered":"2023-11-04T01:36:35.596633+0000","last_clean":"2023-11-04T01:36:35.596633+0000","last_became_active":"2023-11-04T01:36:34.607909+0000","last_became_peered":"2023-11-04T01:36:34.607909+0000","last_unstale":"2023-11-04T01:36:35.596633+0000","last_undegraded":"2023-11-04T01:36:35.596633+0000","last_fullsized":"2023-11-04T01:36:35.596633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:31.223962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592418+0000","last_change":"2023-11-04T01:36:30.557781+0000","last_active":"2023-11-04T01:36:34.592418+0000","last_peered":"2023-11-04T01:36:34.592418+0000","last_clean":"2023-11-04T01:36:34.592418+0000","last_became_active":"2023-11-04T01:36:30.557449+0000","last_became_peered":"2023-11-04T01:36:30.557449+0000","last_unstale":"2023-11-04T01:36:34.592418+0000","last_undegraded":"2023-11-04T01:36:34.592418+0000","last_fullsized":"2023-11-04T01:36:34.592418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:29.959121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597825+0000","last_change":"2023-11-04T01:36:29.565926+0000","last_active":"2023-11-04T01:36:34.597825+0000","last_peered":"2023-11-04T01:36:34.597825+0000","last_clean":"2023-11-04T01:36:34.597825+0000","last_became_active":"2023-11-04T01:36:29.564825+0000","last_became_peered":"2023-11-04T01:36:29.564825+0000","last_unstale":"2023-11-04T01:36:34.597825+0000","last_undegraded":"2023-11-04T01:36:34.597825+0000","last_fullsized":"2023-11-04T01:36:34.597825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:08.164823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540301+0000","last_change":"2023-11-04T01:36:34.607153+0000","last_active":"2023-11-04T01:36:35.540301+0000","last_peered":"2023-11-04T01:36:35.540301+0000","last_clean":"2023-11-04T01:36:35.540301+0000","last_became_active":"2023-11-04T01:36:34.606735+0000","last_became_peered":"2023-11-04T01:36:34.606735+0000","last_unstale":"2023-11-04T01:36:35.540301+0000","last_undegraded":"2023-11-04T01:36:35.540301+0000","last_fullsized":"2023-11-04T01:36:35.540301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:28.573079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601770+0000","last_change":"2023-11-04T01:36:30.556826+0000","last_active":"2023-11-04T01:36:34.601770+0000","last_peered":"2023-11-04T01:36:34.601770+0000","last_clean":"2023-11-04T01:36:34.601770+0000","last_became_active":"2023-11-04T01:36:30.556539+0000","last_became_peered":"2023-11-04T01:36:30.556539+0000","last_unstale":"2023-11-04T01:36:34.601770+0000","last_undegraded":"2023-11-04T01:36:34.601770+0000","last_fullsized":"2023-11-04T01:36:34.601770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.045633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601013+0000","last_change":"2023-11-04T01:36:29.561123+0000","last_active":"2023-11-04T01:36:34.601013+0000","last_peered":"2023-11-04T01:36:34.601013+0000","last_clean":"2023-11-04T01:36:34.601013+0000","last_became_active":"2023-11-04T01:36:29.560854+0000","last_became_peered":"2023-11-04T01:36:29.560854+0000","last_unstale":"2023-11-04T01:36:34.601013+0000","last_undegraded":"2023-11-04T01:36:34.601013+0000","last_fullsized":"2023-11-04T01:36:34.601013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:09.364774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.595884+0000","last_change":"2023-11-04T01:36:34.601066+0000","last_active":"2023-11-04T01:36:35.595884+0000","last_peered":"2023-11-04T01:36:35.595884+0000","last_clean":"2023-11-04T01:36:35.595884+0000","last_became_active":"2023-11-04T01:36:34.599090+0000","last_became_peered":"2023-11-04T01:36:34.599090+0000","last_unstale":"2023-11-04T01:36:35.595884+0000","last_undegraded":"2023-11-04T01:36:35.595884+0000","last_fullsized":"2023-11-04T01:36:35.595884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:55:45.766187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600942+0000","last_change":"2023-11-04T01:36:30.561795+0000","last_active":"2023-11-04T01:36:34.600942+0000","last_peered":"2023-11-04T01:36:34.600942+0000","last_clean":"2023-11-04T01:36:34.600942+0000","last_became_active":"2023-11-04T01:36:30.561540+0000","last_became_peered":"2023-11-04T01:36:30.561540+0000","last_unstale":"2023-11-04T01:36:34.600942+0000","last_undegraded":"2023-11-04T01:36:34.600942+0000","last_fullsized":"2023-11-04T01:36:34.600942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:50.307002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593216+0000","last_change":"2023-11-04T01:36:29.559999+0000","last_active":"2023-11-04T01:36:34.593216+0000","last_peered":"2023-11-04T01:36:34.593216+0000","last_clean":"2023-11-04T01:36:34.593216+0000","last_became_active":"2023-11-04T01:36:29.559724+0000","last_became_peered":"2023-11-04T01:36:29.559724+0000","last_unstale":"2023-11-04T01:36:34.593216+0000","last_undegraded":"2023-11-04T01:36:34.593216+0000","last_fullsized":"2023-11-04T01:36:34.593216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:19.388284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597352+0000","last_change":"2023-11-04T01:36:34.754539+0000","last_active":"2023-11-04T01:36:35.597352+0000","last_peered":"2023-11-04T01:36:35.597352+0000","last_clean":"2023-11-04T01:36:35.597352+0000","last_became_active":"2023-11-04T01:36:34.754171+0000","last_became_peered":"2023-11-04T01:36:34.754171+0000","last_unstale":"2023-11-04T01:36:35.597352+0000","last_undegraded":"2023-11-04T01:36:35.597352+0000","last_fullsized":"2023-11-04T01:36:35.597352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:38:03.961257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597516+0000","last_change":"2023-11-04T01:36:34.754646+0000","last_active":"2023-11-04T01:36:35.597516+0000","last_peered":"2023-11-04T01:36:35.597516+0000","last_clean":"2023-11-04T01:36:35.597516+0000","last_became_active":"2023-11-04T01:36:34.754295+0000","last_became_peered":"2023-11-04T01:36:34.754295+0000","last_unstale":"2023-11-04T01:36:35.597516+0000","last_undegraded":"2023-11-04T01:36:35.597516+0000","last_fullsized":"2023-11-04T01:36:35.597516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:34.881207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597360+0000","last_change":"2023-11-04T01:36:30.549880+0000","last_active":"2023-11-04T01:36:34.597360+0000","last_peered":"2023-11-04T01:36:34.597360+0000","last_clean":"2023-11-04T01:36:34.597360+0000","last_became_active":"2023-11-04T01:36:30.549601+0000","last_became_peered":"2023-11-04T01:36:30.549601+0000","last_unstale":"2023-11-04T01:36:34.597360+0000","last_undegraded":"2023-11-04T01:36:34.597360+0000","last_fullsized":"2023-11-04T01:36:34.597360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:12.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600522+0000","last_change":"2023-11-04T01:36:29.561272+0000","last_active":"2023-11-04T01:36:34.600522+0000","last_peered":"2023-11-04T01:36:34.600522+0000","last_clean":"2023-11-04T01:36:34.600522+0000","last_became_active":"2023-11-04T01:36:29.561002+0000","last_became_peered":"2023-11-04T01:36:29.561002+0000","last_unstale":"2023-11-04T01:36:34.600522+0000","last_undegraded":"2023-11-04T01:36:34.600522+0000","last_fullsized":"2023-11-04T01:36:34.600522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:55.902083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540190+0000","last_change":"2023-11-04T01:36:34.605037+0000","last_active":"2023-11-04T01:36:35.540190+0000","last_peered":"2023-11-04T01:36:35.540190+0000","last_clean":"2023-11-04T01:36:35.540190+0000","last_became_active":"2023-11-04T01:36:34.604643+0000","last_became_peered":"2023-11-04T01:36:34.604643+0000","last_unstale":"2023-11-04T01:36:35.540190+0000","last_undegraded":"2023-11-04T01:36:35.540190+0000","last_fullsized":"2023-11-04T01:36:35.540190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:09.612714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591215+0000","last_change":"2023-11-04T01:36:30.554876+0000","last_active":"2023-11-04T01:36:34.591215+0000","last_peered":"2023-11-04T01:36:34.591215+0000","last_clean":"2023-11-04T01:36:34.591215+0000","last_became_active":"2023-11-04T01:36:30.554614+0000","last_became_peered":"2023-11-04T01:36:30.554614+0000","last_unstale":"2023-11-04T01:36:34.591215+0000","last_undegraded":"2023-11-04T01:36:34.591215+0000","last_fullsized":"2023-11-04T01:36:34.591215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:17.787245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591406+0000","last_change":"2023-11-04T01:36:29.561077+0000","last_active":"2023-11-04T01:36:34.591406+0000","last_peered":"2023-11-04T01:36:34.591406+0000","last_clean":"2023-11-04T01:36:34.591406+0000","last_became_active":"2023-11-04T01:36:29.560004+0000","last_became_peered":"2023-11-04T01:36:29.560004+0000","last_unstale":"2023-11-04T01:36:34.591406+0000","last_undegraded":"2023-11-04T01:36:34.591406+0000","last_fullsized":"2023-11-04T01:36:34.591406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:27.522090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593048+0000","last_change":"2023-11-04T01:36:29.554796+0000","last_active":"2023-11-04T01:36:34.593048+0000","last_peered":"2023-11-04T01:36:34.593048+0000","last_clean":"2023-11-04T01:36:34.593048+0000","last_became_active":"2023-11-04T01:36:29.554404+0000","last_became_peered":"2023-11-04T01:36:29.554404+0000","last_unstale":"2023-11-04T01:36:34.593048+0000","last_undegraded":"2023-11-04T01:36:34.593048+0000","last_fullsized":"2023-11-04T01:36:34.593048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:24.009190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603121+0000","last_change":"2023-11-04T01:36:30.555821+0000","last_active":"2023-11-04T01:36:34.603121+0000","last_peered":"2023-11-04T01:36:34.603121+0000","last_clean":"2023-11-04T01:36:34.603121+0000","last_became_active":"2023-11-04T01:36:30.555189+0000","last_became_peered":"2023-11-04T01:36:30.555189+0000","last_unstale":"2023-11-04T01:36:34.603121+0000","last_undegraded":"2023-11-04T01:36:34.603121+0000","last_fullsized":"2023-11-04T01:36:34.603121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:36.976993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540760+0000","last_change":"2023-11-04T01:36:34.609254+0000","last_active":"2023-11-04T01:36:35.540760+0000","last_peered":"2023-11-04T01:36:35.540760+0000","last_clean":"2023-11-04T01:36:35.540760+0000","last_became_active":"2023-11-04T01:36:34.608845+0000","last_became_peered":"2023-11-04T01:36:34.608845+0000","last_unstale":"2023-11-04T01:36:35.540760+0000","last_undegraded":"2023-11-04T01:36:35.540760+0000","last_fullsized":"2023-11-04T01:36:35.540760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:32.563428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591589+0000","last_change":"2023-11-04T01:36:29.564267+0000","last_active":"2023-11-04T01:36:34.591589+0000","last_peered":"2023-11-04T01:36:34.591589+0000","last_clean":"2023-11-04T01:36:34.591589+0000","last_became_active":"2023-11-04T01:36:29.563992+0000","last_became_peered":"2023-11-04T01:36:29.563992+0000","last_unstale":"2023-11-04T01:36:34.591589+0000","last_undegraded":"2023-11-04T01:36:34.591589+0000","last_fullsized":"2023-11-04T01:36:34.591589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:28.954776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592935+0000","last_change":"2023-11-04T01:36:30.552063+0000","last_active":"2023-11-04T01:36:34.592935+0000","last_peered":"2023-11-04T01:36:34.592935+0000","last_clean":"2023-11-04T01:36:34.592935+0000","last_became_active":"2023-11-04T01:36:30.551686+0000","last_became_peered":"2023-11-04T01:36:30.551686+0000","last_unstale":"2023-11-04T01:36:34.592935+0000","last_undegraded":"2023-11-04T01:36:34.592935+0000","last_fullsized":"2023-11-04T01:36:34.592935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:56.906428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597623+0000","last_change":"2023-11-04T01:36:34.607234+0000","last_active":"2023-11-04T01:36:35.597623+0000","last_peered":"2023-11-04T01:36:35.597623+0000","last_clean":"2023-11-04T01:36:35.597623+0000","last_became_active":"2023-11-04T01:36:34.606850+0000","last_became_peered":"2023-11-04T01:36:34.606850+0000","last_unstale":"2023-11-04T01:36:35.597623+0000","last_undegraded":"2023-11-04T01:36:35.597623+0000","last_fullsized":"2023-11-04T01:36:35.597623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:18.885568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590846+0000","last_change":"2023-11-04T01:36:30.554613+0000","last_active":"2023-11-04T01:36:34.590846+0000","last_peered":"2023-11-04T01:36:34.590846+0000","last_clean":"2023-11-04T01:36:34.590846+0000","last_became_active":"2023-11-04T01:36:30.554329+0000","last_became_peered":"2023-11-04T01:36:30.554329+0000","last_unstale":"2023-11-04T01:36:34.590846+0000","last_undegraded":"2023-11-04T01:36:34.590846+0000","last_fullsized":"2023-11-04T01:36:34.590846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:37.615217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.602985+0000","last_change":"2023-11-04T01:36:30.557052+0000","last_active":"2023-11-04T01:36:34.602985+0000","last_peered":"2023-11-04T01:36:34.602985+0000","last_clean":"2023-11-04T01:36:34.602985+0000","last_became_active":"2023-11-04T01:36:30.556744+0000","last_became_peered":"2023-11-04T01:36:30.556744+0000","last_unstale":"2023-11-04T01:36:34.602985+0000","last_undegraded":"2023-11-04T01:36:34.602985+0000","last_fullsized":"2023-11-04T01:36:34.602985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:29.959121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600475+0000","last_change":"2023-11-04T01:36:30.557244+0000","last_active":"2023-11-04T01:36:34.600475+0000","last_peered":"2023-11-04T01:36:34.600475+0000","last_clean":"2023-11-04T01:36:34.600475+0000","last_became_active":"2023-11-04T01:36:30.556922+0000","last_became_peered":"2023-11-04T01:36:30.556922+0000","last_unstale":"2023-11-04T01:36:34.600475+0000","last_undegraded":"2023-11-04T01:36:34.600475+0000","last_fullsized":"2023-11-04T01:36:34.600475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:27.186969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603035+0000","last_change":"2023-11-04T01:36:30.553115+0000","last_active":"2023-11-04T01:36:34.603035+0000","last_peered":"2023-11-04T01:36:34.603035+0000","last_clean":"2023-11-04T01:36:34.603035+0000","last_became_active":"2023-11-04T01:36:30.552004+0000","last_became_peered":"2023-11-04T01:36:30.552004+0000","last_unstale":"2023-11-04T01:36:34.603035+0000","last_undegraded":"2023-11-04T01:36:34.603035+0000","last_fullsized":"2023-11-04T01:36:34.603035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:10.369120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592230+0000","last_change":"2023-11-04T01:36:30.549121+0000","last_active":"2023-11-04T01:36:34.592230+0000","last_peered":"2023-11-04T01:36:34.592230+0000","last_clean":"2023-11-04T01:36:34.592230+0000","last_became_active":"2023-11-04T01:36:30.548845+0000","last_became_peered":"2023-11-04T01:36:30.548845+0000","last_unstale":"2023-11-04T01:36:34.592230+0000","last_undegraded":"2023-11-04T01:36:34.592230+0000","last_fullsized":"2023-11-04T01:36:34.592230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:53.928372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597717+0000","last_change":"2023-11-04T01:36:30.549624+0000","last_active":"2023-11-04T01:36:34.597717+0000","last_peered":"2023-11-04T01:36:34.597717+0000","last_clean":"2023-11-04T01:36:34.597717+0000","last_became_active":"2023-11-04T01:36:30.549352+0000","last_became_peered":"2023-11-04T01:36:30.549352+0000","last_unstale":"2023-11-04T01:36:34.597717+0000","last_undegraded":"2023-11-04T01:36:34.597717+0000","last_fullsized":"2023-11-04T01:36:34.597717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593105+0000","last_change":"2023-11-04T01:36:30.560044+0000","last_active":"2023-11-04T01:36:34.593105+0000","last_peered":"2023-11-04T01:36:34.593105+0000","last_clean":"2023-11-04T01:36:34.593105+0000","last_became_active":"2023-11-04T01:36:30.559776+0000","last_became_peered":"2023-11-04T01:36:30.559776+0000","last_unstale":"2023-11-04T01:36:34.593105+0000","last_undegraded":"2023-11-04T01:36:34.593105+0000","last_fullsized":"2023-11-04T01:36:34.593105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:36.996384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591659+0000","last_change":"2023-11-04T01:36:30.554726+0000","last_active":"2023-11-04T01:36:34.591659+0000","last_peered":"2023-11-04T01:36:34.591659+0000","last_clean":"2023-11-04T01:36:34.591659+0000","last_became_active":"2023-11-04T01:36:30.554463+0000","last_became_peered":"2023-11-04T01:36:30.554463+0000","last_unstale":"2023-11-04T01:36:34.591659+0000","last_undegraded":"2023-11-04T01:36:34.591659+0000","last_fullsized":"2023-11-04T01:36:34.591659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:29.259099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600433+0000","last_change":"2023-11-04T01:36:30.558538+0000","last_active":"2023-11-04T01:36:34.600433+0000","last_peered":"2023-11-04T01:36:34.600433+0000","last_clean":"2023-11-04T01:36:34.600433+0000","last_became_active":"2023-11-04T01:36:30.558255+0000","last_became_peered":"2023-11-04T01:36:30.558255+0000","last_unstale":"2023-11-04T01:36:34.600433+0000","last_undegraded":"2023-11-04T01:36:34.600433+0000","last_fullsized":"2023-11-04T01:36:34.600433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:26:24.912249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591246+0000","last_change":"2023-11-04T01:36:30.555242+0000","last_active":"2023-11-04T01:36:34.591246+0000","last_peered":"2023-11-04T01:36:34.591246+0000","last_clean":"2023-11-04T01:36:34.591246+0000","last_became_active":"2023-11-04T01:36:30.554999+0000","last_became_peered":"2023-11-04T01:36:30.554999+0000","last_unstale":"2023-11-04T01:36:34.591246+0000","last_undegraded":"2023-11-04T01:36:34.591246+0000","last_fullsized":"2023-11-04T01:36:34.591246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:37.615217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600436+0000","last_change":"2023-11-04T01:36:30.561171+0000","last_active":"2023-11-04T01:36:34.600436+0000","last_peered":"2023-11-04T01:36:34.600436+0000","last_clean":"2023-11-04T01:36:34.600436+0000","last_became_active":"2023-11-04T01:36:30.560077+0000","last_became_peered":"2023-11-04T01:36:30.560077+0000","last_unstale":"2023-11-04T01:36:34.600436+0000","last_undegraded":"2023-11-04T01:36:34.600436+0000","last_fullsized":"2023-11-04T01:36:34.600436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:53.928372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.602937+0000","last_change":"2023-11-04T01:36:30.559653+0000","last_active":"2023-11-04T01:36:34.602937+0000","last_peered":"2023-11-04T01:36:34.602937+0000","last_clean":"2023-11-04T01:36:34.602937+0000","last_became_active":"2023-11-04T01:36:30.559390+0000","last_became_peered":"2023-11-04T01:36:30.559390+0000","last_unstale":"2023-11-04T01:36:34.602937+0000","last_undegraded":"2023-11-04T01:36:34.602937+0000","last_fullsized":"2023-11-04T01:36:34.602937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:37.615217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592681+0000","last_change":"2023-11-04T01:36:30.553925+0000","last_active":"2023-11-04T01:36:34.592681+0000","last_peered":"2023-11-04T01:36:34.592681+0000","last_clean":"2023-11-04T01:36:34.592681+0000","last_became_active":"2023-11-04T01:36:30.553654+0000","last_became_peered":"2023-11-04T01:36:30.553654+0000","last_unstale":"2023-11-04T01:36:34.592681+0000","last_undegraded":"2023-11-04T01:36:34.592681+0000","last_fullsized":"2023-11-04T01:36:34.592681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752906+0000","last_change":"2023-11-04T01:36:30.557205+0000","last_active":"2023-11-04T01:36:34.752906+0000","last_peered":"2023-11-04T01:36:34.752906+0000","last_clean":"2023-11-04T01:36:34.752906+0000","last_became_active":"2023-11-04T01:36:30.556906+0000","last_became_peered":"2023-11-04T01:36:30.556906+0000","last_unstale":"2023-11-04T01:36:34.752906+0000","last_undegraded":"2023-11-04T01:36:34.752906+0000","last_fullsized":"2023-11-04T01:36:34.752906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:54:17.545215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603431+0000","last_change":"2023-11-04T01:36:30.548944+0000","last_active":"2023-11-04T01:36:34.603431+0000","last_peered":"2023-11-04T01:36:34.603431+0000","last_clean":"2023-11-04T01:36:34.603431+0000","last_became_active":"2023-11-04T01:36:30.548680+0000","last_became_peered":"2023-11-04T01:36:30.548680+0000","last_unstale":"2023-11-04T01:36:34.603431+0000","last_undegraded":"2023-11-04T01:36:34.603431+0000","last_fullsized":"2023-11-04T01:36:34.603431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:25.013535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601391+0000","last_change":"2023-11-04T01:36:30.560336+0000","last_active":"2023-11-04T01:36:34.601391+0000","last_peered":"2023-11-04T01:36:34.601391+0000","last_clean":"2023-11-04T01:36:34.601391+0000","last_became_active":"2023-11-04T01:36:30.559694+0000","last_became_peered":"2023-11-04T01:36:30.559694+0000","last_unstale":"2023-11-04T01:36:34.601391+0000","last_undegraded":"2023-11-04T01:36:34.601391+0000","last_fullsized":"2023-11-04T01:36:34.601391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:07.434851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600395+0000","last_change":"2023-11-04T01:36:30.553100+0000","last_active":"2023-11-04T01:36:34.600395+0000","last_peered":"2023-11-04T01:36:34.600395+0000","last_clean":"2023-11-04T01:36:34.600395+0000","last_became_active":"2023-11-04T01:36:30.552783+0000","last_became_peered":"2023-11-04T01:36:30.552783+0000","last_unstale":"2023-11-04T01:36:34.600395+0000","last_undegraded":"2023-11-04T01:36:34.600395+0000","last_fullsized":"2023-11-04T01:36:34.600395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597636+0000","last_change":"2023-11-04T01:36:30.549860+0000","last_active":"2023-11-04T01:36:34.597636+0000","last_peered":"2023-11-04T01:36:34.597636+0000","last_clean":"2023-11-04T01:36:34.597636+0000","last_became_active":"2023-11-04T01:36:30.549522+0000","last_became_peered":"2023-11-04T01:36:30.549522+0000","last_unstale":"2023-11-04T01:36:34.597636+0000","last_undegraded":"2023-11-04T01:36:34.597636+0000","last_fullsized":"2023-11-04T01:36:34.597636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:10.369120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601798+0000","last_change":"2023-11-04T01:36:30.550358+0000","last_active":"2023-11-04T01:36:34.601798+0000","last_peered":"2023-11-04T01:36:34.601798+0000","last_clean":"2023-11-04T01:36:34.601798+0000","last_became_active":"2023-11-04T01:36:30.550025+0000","last_became_peered":"2023-11-04T01:36:30.550025+0000","last_unstale":"2023-11-04T01:36:34.601798+0000","last_undegraded":"2023-11-04T01:36:34.601798+0000","last_fullsized":"2023-11-04T01:36:34.601798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:46:09.800453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590613+0000","last_change":"2023-11-04T01:36:30.552408+0000","last_active":"2023-11-04T01:36:34.590613+0000","last_peered":"2023-11-04T01:36:34.590613+0000","last_clean":"2023-11-04T01:36:34.590613+0000","last_became_active":"2023-11-04T01:36:30.552144+0000","last_became_peered":"2023-11-04T01:36:30.552144+0000","last_unstale":"2023-11-04T01:36:34.590613+0000","last_undegraded":"2023-11-04T01:36:34.590613+0000","last_fullsized":"2023-11-04T01:36:34.590613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:36.996384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592329+0000","last_change":"2023-11-04T01:36:30.551603+0000","last_active":"2023-11-04T01:36:34.592329+0000","last_peered":"2023-11-04T01:36:34.592329+0000","last_clean":"2023-11-04T01:36:34.592329+0000","last_became_active":"2023-11-04T01:36:30.551211+0000","last_became_peered":"2023-11-04T01:36:30.551211+0000","last_unstale":"2023-11-04T01:36:34.592329+0000","last_undegraded":"2023-11-04T01:36:34.592329+0000","last_fullsized":"2023-11-04T01:36:34.592329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:15:10.559940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593132+0000","last_change":"2023-11-04T01:36:30.557060+0000","last_active":"2023-11-04T01:36:34.593132+0000","last_peered":"2023-11-04T01:36:34.593132+0000","last_clean":"2023-11-04T01:36:34.593132+0000","last_became_active":"2023-11-04T01:36:30.556780+0000","last_became_peered":"2023-11-04T01:36:30.556780+0000","last_unstale":"2023-11-04T01:36:34.593132+0000","last_undegraded":"2023-11-04T01:36:34.593132+0000","last_fullsized":"2023-11-04T01:36:34.593132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:12.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593025+0000","last_change":"2023-11-04T01:36:30.557384+0000","last_active":"2023-11-04T01:36:34.593025+0000","last_peered":"2023-11-04T01:36:34.593025+0000","last_clean":"2023-11-04T01:36:34.593025+0000","last_became_active":"2023-11-04T01:36:30.556515+0000","last_became_peered":"2023-11-04T01:36:30.556515+0000","last_unstale":"2023-11-04T01:36:34.593025+0000","last_undegraded":"2023-11-04T01:36:34.593025+0000","last_fullsized":"2023-11-04T01:36:34.593025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:36.976993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752897+0000","last_change":"2023-11-04T01:36:30.558458+0000","last_active":"2023-11-04T01:36:34.752897+0000","last_peered":"2023-11-04T01:36:34.752897+0000","last_clean":"2023-11-04T01:36:34.752897+0000","last_became_active":"2023-11-04T01:36:30.558111+0000","last_became_peered":"2023-11-04T01:36:30.558111+0000","last_unstale":"2023-11-04T01:36:34.752897+0000","last_undegraded":"2023-11-04T01:36:34.752897+0000","last_fullsized":"2023-11-04T01:36:34.752897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:47.484051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590565+0000","last_change":"2023-11-04T01:36:30.558798+0000","last_active":"2023-11-04T01:36:34.590565+0000","last_peered":"2023-11-04T01:36:34.590565+0000","last_clean":"2023-11-04T01:36:34.590565+0000","last_became_active":"2023-11-04T01:36:30.558197+0000","last_became_peered":"2023-11-04T01:36:30.558197+0000","last_unstale":"2023-11-04T01:36:34.590565+0000","last_undegraded":"2023-11-04T01:36:34.590565+0000","last_fullsized":"2023-11-04T01:36:34.590565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:36.976993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752395+0000","last_change":"2023-11-04T01:36:30.556288+0000","last_active":"2023-11-04T01:36:34.752395+0000","last_peered":"2023-11-04T01:36:34.752395+0000","last_clean":"2023-11-04T01:36:34.752395+0000","last_became_active":"2023-11-04T01:36:30.556011+0000","last_became_peered":"2023-11-04T01:36:30.556011+0000","last_unstale":"2023-11-04T01:36:34.752395+0000","last_undegraded":"2023-11-04T01:36:34.752395+0000","last_fullsized":"2023-11-04T01:36:34.752395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:50.307002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600393+0000","last_change":"2023-11-04T01:36:30.556023+0000","last_active":"2023-11-04T01:36:34.600393+0000","last_peered":"2023-11-04T01:36:34.600393+0000","last_clean":"2023-11-04T01:36:34.600393+0000","last_became_active":"2023-11-04T01:36:30.555394+0000","last_became_peered":"2023-11-04T01:36:30.555394+0000","last_unstale":"2023-11-04T01:36:34.600393+0000","last_undegraded":"2023-11-04T01:36:34.600393+0000","last_fullsized":"2023-11-04T01:36:34.600393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.045633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752224+0000","last_change":"2023-11-04T01:36:30.555404+0000","last_active":"2023-11-04T01:36:34.752224+0000","last_peered":"2023-11-04T01:36:34.752224+0000","last_clean":"2023-11-04T01:36:34.752224+0000","last_became_active":"2023-11-04T01:36:30.555125+0000","last_became_peered":"2023-11-04T01:36:30.555125+0000","last_unstale":"2023-11-04T01:36:34.752224+0000","last_undegraded":"2023-11-04T01:36:34.752224+0000","last_fullsized":"2023-11-04T01:36:34.752224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:05.575722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600734+0000","last_change":"2023-11-04T01:36:30.559120+0000","last_active":"2023-11-04T01:36:34.600734+0000","last_peered":"2023-11-04T01:36:34.600734+0000","last_clean":"2023-11-04T01:36:34.600734+0000","last_became_active":"2023-11-04T01:36:30.558412+0000","last_became_peered":"2023-11-04T01:36:30.558412+0000","last_unstale":"2023-11-04T01:36:34.600734+0000","last_undegraded":"2023-11-04T01:36:34.600734+0000","last_fullsized":"2023-11-04T01:36:34.600734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:29.259099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601077+0000","last_change":"2023-11-04T01:36:30.552546+0000","last_active":"2023-11-04T01:36:34.601077+0000","last_peered":"2023-11-04T01:36:34.601077+0000","last_clean":"2023-11-04T01:36:34.601077+0000","last_became_active":"2023-11-04T01:36:30.551809+0000","last_became_peered":"2023-11-04T01:36:30.551809+0000","last_unstale":"2023-11-04T01:36:34.601077+0000","last_undegraded":"2023-11-04T01:36:34.601077+0000","last_fullsized":"2023-11-04T01:36:34.601077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:12.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597814+0000","last_change":"2023-11-04T01:36:30.554657+0000","last_active":"2023-11-04T01:36:34.597814+0000","last_peered":"2023-11-04T01:36:34.597814+0000","last_clean":"2023-11-04T01:36:34.597814+0000","last_became_active":"2023-11-04T01:36:30.554335+0000","last_became_peered":"2023-11-04T01:36:30.554335+0000","last_unstale":"2023-11-04T01:36:34.597814+0000","last_undegraded":"2023-11-04T01:36:34.597814+0000","last_fullsized":"2023-11-04T01:36:34.597814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.045633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752772+0000","last_change":"2023-11-04T01:36:30.557755+0000","last_active":"2023-11-04T01:36:34.752772+0000","last_peered":"2023-11-04T01:36:34.752772+0000","last_clean":"2023-11-04T01:36:34.752772+0000","last_became_active":"2023-11-04T01:36:30.557432+0000","last_became_peered":"2023-11-04T01:36:30.557432+0000","last_unstale":"2023-11-04T01:36:34.752772+0000","last_undegraded":"2023-11-04T01:36:34.752772+0000","last_fullsized":"2023-11-04T01:36:34.752772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:55:41.729195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4498,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":690798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:36:48.588 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:36:48.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.719+0000 7fa63e5e2640 1 Processor -- start 2023-11-04T01:36:48.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.719+0000 7fa63e5e2640 1 -- start start 2023-11-04T01:36:48.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.720+0000 7fa63e5e2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6381605a0 0x7fa638070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.720+0000 7fa63e5e2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa6380b25d0 0x7fa6380b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.720+0000 7fa63e5e2640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6380ce690 con 0x7fa6380cc050 2023-11-04T01:36:48.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.720+0000 7fa63e5e2640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6380cefa0 con 0x7fa6380b25d0 2023-11-04T01:36:48.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.720+0000 7fa63e5e2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6380b2f20 con 0x7fa6381605a0 2023-11-04T01:36:48.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.720+0000 7fa63cb7f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa6380b25d0 0x7fa6380b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.720+0000 7fa637fff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6381605a0 0x7fa638070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.720+0000 7fa6377fe640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fa6380cc050 0x7fa6380cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:45662/0 (socket says 172.21.15.114:45662) 2023-11-04T01:36:48.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.720+0000 7fa637fff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6381605a0 0x7fa638070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:51532/0 (socket says 172.21.15.114:51532) 2023-11-04T01:36:48.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.720+0000 7fa63cb7f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa6380b25d0 0x7fa6380b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:34910/0 (socket says 172.21.15.114:34910) 2023-11-04T01:36:48.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.720+0000 7fa6377fe640 1 -- 172.21.15.114:0/1631272698 learned_addr learned my addr 172.21.15.114:0/1631272698 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:48.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.720+0000 7fa63cb7f640 1 -- 172.21.15.114:0/1631272698 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6381605a0 msgr2=0x7fa638070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:48.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.720+0000 7fa63cb7f640 1 --2- 172.21.15.114:0/1631272698 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6381605a0 0x7fa638070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.720+0000 7fa63cb7f640 1 -- 172.21.15.114:0/1631272698 >> v1:172.21.15.141:6789/0 conn(0x7fa6380cc050 legacy=0x7fa6380cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.720+0000 7fa63cb7f640 1 -- 172.21.15.114:0/1631272698 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6380cc7f0 con 0x7fa6380b25d0 2023-11-04T01:36:48.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.720+0000 7fa637fff640 1 --2- 172.21.15.114:0/1631272698 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6381605a0 0x7fa638070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:48.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.721+0000 7fa63cb7f640 1 --2- 172.21.15.114:0/1631272698 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6380b25d0 0x7fa6380b29e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa630009d90 tx=0x7fa63002be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd4e06fd66253145 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.721+0000 7fa636ffd640 1 -- 172.21.15.114:0/1631272698 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63002cbc0 con 0x7fa6380b25d0 2023-11-04T01:36:48.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.721+0000 7fa636ffd640 1 -- 172.21.15.114:0/1631272698 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63002cd20 con 0x7fa6380b25d0 2023-11-04T01:36:48.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.721+0000 7fa636ffd640 1 -- 172.21.15.114:0/1631272698 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630034660 con 0x7fa6380b25d0 2023-11-04T01:36:48.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.722+0000 7fa63e5e2640 1 -- 172.21.15.114:0/1631272698 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6380b25d0 msgr2=0x7fa6380b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.722+0000 7fa63e5e2640 1 --2- 172.21.15.114:0/1631272698 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6380b25d0 0x7fa6380b29e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa630009d90 tx=0x7fa63002be10 comp rx=0 tx=0).stop 2023-11-04T01:36:48.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.722+0000 7fa63e5e2640 1 -- 172.21.15.114:0/1631272698 shutdown_connections 2023-11-04T01:36:48.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.722+0000 7fa63e5e2640 1 --2- 172.21.15.114:0/1631272698 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6380b25d0 0x7fa6380b29e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.722+0000 7fa63e5e2640 1 --2- 172.21.15.114:0/1631272698 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6381605a0 0x7fa638070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.722+0000 7fa63e5e2640 1 -- 172.21.15.114:0/1631272698 >> 172.21.15.114:0/1631272698 conn(0x7fa6380d0b50 msgr2=0x7fa6380d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.722+0000 7fa63e5e2640 1 -- 172.21.15.114:0/1631272698 shutdown_connections 2023-11-04T01:36:48.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.722+0000 7fa63e5e2640 1 -- 172.21.15.114:0/1631272698 wait complete. 2023-11-04T01:36:48.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.723+0000 7fa63e5e2640 1 Processor -- start 2023-11-04T01:36:48.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.723+0000 7fa63e5e2640 1 -- start start 2023-11-04T01:36:48.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.724+0000 7fa63e5e2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6380b25d0 0x7fa6380c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.724+0000 7fa63e5e2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6380cc050 0x7fa63815ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.724+0000 7fa63e5e2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6381605a0 0x7fa6380c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.724+0000 7fa63e5e2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6381f7310 con 0x7fa6380cc050 2023-11-04T01:36:48.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.724+0000 7fa63e5e2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6380c8660 con 0x7fa6380b25d0 2023-11-04T01:36:48.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.724+0000 7fa63e5e2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6380b6090 con 0x7fa6381605a0 2023-11-04T01:36:48.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.724+0000 7fa6377fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6380cc050 0x7fa63815ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.724+0000 7fa6377fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6380cc050 0x7fa63815ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49052/0 (socket says 172.21.15.114:49052) 2023-11-04T01:36:48.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.724+0000 7fa6377fe640 1 -- 172.21.15.114:0/2204647953 learned_addr learned my addr 172.21.15.114:0/2204647953 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:48.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.724+0000 7fa637fff640 1 --2- 172.21.15.114:0/2204647953 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6380b25d0 0x7fa6380c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.724+0000 7fa63cb7f640 1 --2- 172.21.15.114:0/2204647953 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6381605a0 0x7fa6380c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.724+0000 7fa6377fe640 1 -- 172.21.15.114:0/2204647953 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6381605a0 msgr2=0x7fa6380c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.724+0000 7fa6377fe640 1 --2- 172.21.15.114:0/2204647953 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6381605a0 0x7fa6380c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.724+0000 7fa6377fe640 1 -- 172.21.15.114:0/2204647953 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6380b25d0 msgr2=0x7fa6380c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.724+0000 7fa6377fe640 1 --2- 172.21.15.114:0/2204647953 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6380b25d0 0x7fa6380c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.724+0000 7fa6377fe640 1 -- 172.21.15.114:0/2204647953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa628009400 con 0x7fa6380cc050 2023-11-04T01:36:48.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.725+0000 7fa6377fe640 1 --2- 172.21.15.114:0/2204647953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6380cc050 0x7fa63815ac00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00c4a0 tx=0x7fa62c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.725+0000 7fa634ff9640 1 -- 172.21.15.114:0/2204647953 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c005ce0 con 0x7fa6380cc050 2023-11-04T01:36:48.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.725+0000 7fa634ff9640 1 -- 172.21.15.114:0/2204647953 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c005e40 con 0x7fa6380cc050 2023-11-04T01:36:48.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.725+0000 7fa634ff9640 1 -- 172.21.15.114:0/2204647953 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c007270 con 0x7fa6380cc050 2023-11-04T01:36:48.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.725+0000 7fa63e5e2640 1 -- 172.21.15.114:0/2204647953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa630009a70 con 0x7fa6380cc050 2023-11-04T01:36:48.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.725+0000 7fa63e5e2640 1 -- 172.21.15.114:0/2204647953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6380c8010 con 0x7fa6380cc050 2023-11-04T01:36:48.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.726+0000 7fa63e5e2640 1 -- 172.21.15.114:0/2204647953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa638074290 con 0x7fa6380cc050 2023-11-04T01:36:48.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.726+0000 7fa634ff9640 1 -- 172.21.15.114:0/2204647953 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa62c007490 con 0x7fa6380cc050 2023-11-04T01:36:48.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.726+0000 7fa634ff9640 1 --2- 172.21.15.114:0/2204647953 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa62406ae70 0x7fa62406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:48.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.727+0000 7fa634ff9640 1 -- 172.21.15.114:0/2204647953 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa62c088cb0 con 0x7fa6380cc050 2023-11-04T01:36:48.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.727+0000 7fa637fff640 1 --2- 172.21.15.114:0/2204647953 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa62406ae70 0x7fa62406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:48.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.727+0000 7fa637fff640 1 --2- 172.21.15.114:0/2204647953 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa62406ae70 0x7fa62406d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa628009cd0 tx=0x7fa628009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:48.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.731+0000 7fa634ff9640 1 -- 172.21.15.114:0/2204647953 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa62c053bb0 con 0x7fa6380cc050 2023-11-04T01:36:48.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.894+0000 7fa63e5e2640 1 -- 172.21.15.114:0/2204647953 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6380cebc0 con 0x7fa62406ae70 2023-11-04T01:36:48.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.902+0000 7fa634ff9640 1 -- 172.21.15.114:0/2204647953 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345241 (secure 0 0 0) 0x7fa628009920 con 0x7fa62406ae70 2023-11-04T01:36:48.907 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:48.909 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:36:48.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.905+0000 7fa63e5e2640 1 -- 172.21.15.114:0/2204647953 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa62406ae70 msgr2=0x7fa62406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.905+0000 7fa63e5e2640 1 --2- 172.21.15.114:0/2204647953 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa62406ae70 0x7fa62406d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa628009cd0 tx=0x7fa628009190 comp rx=0 tx=0).stop 2023-11-04T01:36:48.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.905+0000 7fa63e5e2640 1 -- 172.21.15.114:0/2204647953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6380cc050 msgr2=0x7fa63815ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:48.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.905+0000 7fa63e5e2640 1 --2- 172.21.15.114:0/2204647953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6380cc050 0x7fa63815ac00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00c4a0 tx=0x7fa62c00c960 comp rx=0 tx=0).stop 2023-11-04T01:36:48.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.905+0000 7fa63e5e2640 1 -- 172.21.15.114:0/2204647953 shutdown_connections 2023-11-04T01:36:48.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.905+0000 7fa63e5e2640 1 --2- 172.21.15.114:0/2204647953 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa6381605a0 0x7fa6380c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.905+0000 7fa63e5e2640 1 --2- 172.21.15.114:0/2204647953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6380cc050 0x7fa63815ac00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.905+0000 7fa63e5e2640 1 --2- 172.21.15.114:0/2204647953 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa62406ae70 0x7fa62406d330 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.905+0000 7fa63e5e2640 1 --2- 172.21.15.114:0/2204647953 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6380b25d0 0x7fa6380c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:48.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.905+0000 7fa63e5e2640 1 -- 172.21.15.114:0/2204647953 >> 172.21.15.114:0/2204647953 conn(0x7fa6380d0b50 msgr2=0x7fa6380b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:48.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.905+0000 7fa63e5e2640 1 -- 172.21.15.114:0/2204647953 shutdown_connections 2023-11-04T01:36:48.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:48.905+0000 7fa63e5e2640 1 -- 172.21.15.114:0/2204647953 wait complete. 2023-11-04T01:36:48.917 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-11-04T01:36:47.861314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594866,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1988068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2088,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002494"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601943+0000","last_change":"2023-11-04T01:36:29.561242+0000","last_active":"2023-11-04T01:36:34.601943+0000","last_peered":"2023-11-04T01:36:34.601943+0000","last_clean":"2023-11-04T01:36:34.601943+0000","last_became_active":"2023-11-04T01:36:29.560999+0000","last_became_peered":"2023-11-04T01:36:29.560999+0000","last_unstale":"2023-11-04T01:36:34.601943+0000","last_undegraded":"2023-11-04T01:36:34.601943+0000","last_fullsized":"2023-11-04T01:36:34.601943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:24.009190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591589+0000","last_change":"2023-11-04T01:36:30.553781+0000","last_active":"2023-11-04T01:36:34.591589+0000","last_peered":"2023-11-04T01:36:34.591589+0000","last_clean":"2023-11-04T01:36:34.591589+0000","last_became_active":"2023-11-04T01:36:30.553037+0000","last_became_peered":"2023-11-04T01:36:30.553037+0000","last_unstale":"2023-11-04T01:36:34.591589+0000","last_undegraded":"2023-11-04T01:36:34.591589+0000","last_fullsized":"2023-11-04T01:36:34.591589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:12.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597204+0000","last_change":"2023-11-04T01:36:34.756965+0000","last_active":"2023-11-04T01:36:35.597204+0000","last_peered":"2023-11-04T01:36:35.597204+0000","last_clean":"2023-11-04T01:36:35.597204+0000","last_became_active":"2023-11-04T01:36:34.756574+0000","last_became_peered":"2023-11-04T01:36:34.756574+0000","last_unstale":"2023-11-04T01:36:35.597204+0000","last_undegraded":"2023-11-04T01:36:35.597204+0000","last_fullsized":"2023-11-04T01:36:35.597204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:51.521044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591774+0000","last_change":"2023-11-04T01:36:29.560879+0000","last_active":"2023-11-04T01:36:34.591774+0000","last_peered":"2023-11-04T01:36:34.591774+0000","last_clean":"2023-11-04T01:36:34.591774+0000","last_became_active":"2023-11-04T01:36:29.560620+0000","last_became_peered":"2023-11-04T01:36:29.560620+0000","last_unstale":"2023-11-04T01:36:34.591774+0000","last_undegraded":"2023-11-04T01:36:34.591774+0000","last_fullsized":"2023-11-04T01:36:34.591774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:46:08.796108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601678+0000","last_change":"2023-11-04T01:36:30.557037+0000","last_active":"2023-11-04T01:36:34.601678+0000","last_peered":"2023-11-04T01:36:34.601678+0000","last_clean":"2023-11-04T01:36:34.601678+0000","last_became_active":"2023-11-04T01:36:30.556650+0000","last_became_peered":"2023-11-04T01:36:30.556650+0000","last_unstale":"2023-11-04T01:36:34.601678+0000","last_undegraded":"2023-11-04T01:36:34.601678+0000","last_fullsized":"2023-11-04T01:36:34.601678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539725+0000","last_change":"2023-11-04T01:36:34.610121+0000","last_active":"2023-11-04T01:36:35.539725+0000","last_peered":"2023-11-04T01:36:35.539725+0000","last_clean":"2023-11-04T01:36:35.539725+0000","last_became_active":"2023-11-04T01:36:34.609174+0000","last_became_peered":"2023-11-04T01:36:34.609174+0000","last_unstale":"2023-11-04T01:36:35.539725+0000","last_undegraded":"2023-11-04T01:36:35.539725+0000","last_fullsized":"2023-11-04T01:36:35.539725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:26:28.949242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752732+0000","last_change":"2023-11-04T01:36:29.568730+0000","last_active":"2023-11-04T01:36:34.752732+0000","last_peered":"2023-11-04T01:36:34.752732+0000","last_clean":"2023-11-04T01:36:34.752732+0000","last_became_active":"2023-11-04T01:36:29.568238+0000","last_became_peered":"2023-11-04T01:36:29.568238+0000","last_unstale":"2023-11-04T01:36:34.752732+0000","last_undegraded":"2023-11-04T01:36:34.752732+0000","last_fullsized":"2023-11-04T01:36:34.752732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:35.972647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600781+0000","last_change":"2023-11-04T01:36:30.555874+0000","last_active":"2023-11-04T01:36:34.600781+0000","last_peered":"2023-11-04T01:36:34.600781+0000","last_clean":"2023-11-04T01:36:34.600781+0000","last_became_active":"2023-11-04T01:36:30.555047+0000","last_became_peered":"2023-11-04T01:36:30.555047+0000","last_unstale":"2023-11-04T01:36:34.600781+0000","last_undegraded":"2023-11-04T01:36:34.600781+0000","last_fullsized":"2023-11-04T01:36:34.600781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:14.190359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540452+0000","last_change":"2023-11-04T01:36:34.609278+0000","last_active":"2023-11-04T01:36:35.540452+0000","last_peered":"2023-11-04T01:36:35.540452+0000","last_clean":"2023-11-04T01:36:35.540452+0000","last_became_active":"2023-11-04T01:36:34.608869+0000","last_became_peered":"2023-11-04T01:36:34.608869+0000","last_unstale":"2023-11-04T01:36:35.540452+0000","last_undegraded":"2023-11-04T01:36:35.540452+0000","last_fullsized":"2023-11-04T01:36:35.540452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:31.223962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752371+0000","last_change":"2023-11-04T01:36:29.566622+0000","last_active":"2023-11-04T01:36:34.752371+0000","last_peered":"2023-11-04T01:36:34.752371+0000","last_clean":"2023-11-04T01:36:34.752371+0000","last_became_active":"2023-11-04T01:36:29.566344+0000","last_became_peered":"2023-11-04T01:36:29.566344+0000","last_unstale":"2023-11-04T01:36:34.752371+0000","last_undegraded":"2023-11-04T01:36:34.752371+0000","last_fullsized":"2023-11-04T01:36:34.752371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:28.954776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600963+0000","last_change":"2023-11-04T01:36:30.555732+0000","last_active":"2023-11-04T01:36:34.600963+0000","last_peered":"2023-11-04T01:36:34.600963+0000","last_clean":"2023-11-04T01:36:34.600963+0000","last_became_active":"2023-11-04T01:36:30.555435+0000","last_became_peered":"2023-11-04T01:36:30.555435+0000","last_unstale":"2023-11-04T01:36:34.600963+0000","last_undegraded":"2023-11-04T01:36:34.600963+0000","last_fullsized":"2023-11-04T01:36:34.600963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:24.536087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539719+0000","last_change":"2023-11-04T01:36:34.610431+0000","last_active":"2023-11-04T01:36:35.539719+0000","last_peered":"2023-11-04T01:36:35.539719+0000","last_clean":"2023-11-04T01:36:35.539719+0000","last_became_active":"2023-11-04T01:36:34.609116+0000","last_became_peered":"2023-11-04T01:36:34.609116+0000","last_unstale":"2023-11-04T01:36:35.539719+0000","last_undegraded":"2023-11-04T01:36:35.539719+0000","last_fullsized":"2023-11-04T01:36:35.539719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:19.082626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592957+0000","last_change":"2023-11-04T01:36:30.552617+0000","last_active":"2023-11-04T01:36:34.592957+0000","last_peered":"2023-11-04T01:36:34.592957+0000","last_clean":"2023-11-04T01:36:34.592957+0000","last_became_active":"2023-11-04T01:36:30.552315+0000","last_became_peered":"2023-11-04T01:36:30.552315+0000","last_unstale":"2023-11-04T01:36:34.592957+0000","last_undegraded":"2023-11-04T01:36:34.592957+0000","last_fullsized":"2023-11-04T01:36:34.592957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:10.369120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752388+0000","last_change":"2023-11-04T01:36:29.568663+0000","last_active":"2023-11-04T01:36:34.752388+0000","last_peered":"2023-11-04T01:36:34.752388+0000","last_clean":"2023-11-04T01:36:34.752388+0000","last_became_active":"2023-11-04T01:36:29.568262+0000","last_became_peered":"2023-11-04T01:36:29.568262+0000","last_unstale":"2023-11-04T01:36:34.752388+0000","last_undegraded":"2023-11-04T01:36:34.752388+0000","last_fullsized":"2023-11-04T01:36:34.752388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:11.541445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540192+0000","last_change":"2023-11-04T01:36:34.607200+0000","last_active":"2023-11-04T01:36:35.540192+0000","last_peered":"2023-11-04T01:36:35.540192+0000","last_clean":"2023-11-04T01:36:35.540192+0000","last_became_active":"2023-11-04T01:36:34.606762+0000","last_became_peered":"2023-11-04T01:36:34.606762+0000","last_unstale":"2023-11-04T01:36:35.540192+0000","last_undegraded":"2023-11-04T01:36:35.540192+0000","last_fullsized":"2023-11-04T01:36:35.540192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:54.343995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591387+0000","last_change":"2023-11-04T01:36:30.555385+0000","last_active":"2023-11-04T01:36:34.591387+0000","last_peered":"2023-11-04T01:36:34.591387+0000","last_clean":"2023-11-04T01:36:34.591387+0000","last_became_active":"2023-11-04T01:36:30.555109+0000","last_became_peered":"2023-11-04T01:36:30.555109+0000","last_unstale":"2023-11-04T01:36:34.591387+0000","last_undegraded":"2023-11-04T01:36:34.591387+0000","last_fullsized":"2023-11-04T01:36:34.591387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:26:24.912249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597945+0000","last_change":"2023-11-04T01:36:29.568618+0000","last_active":"2023-11-04T01:36:34.597945+0000","last_peered":"2023-11-04T01:36:34.597945+0000","last_clean":"2023-11-04T01:36:34.597945+0000","last_became_active":"2023-11-04T01:36:29.568318+0000","last_became_peered":"2023-11-04T01:36:29.568318+0000","last_unstale":"2023-11-04T01:36:34.597945+0000","last_undegraded":"2023-11-04T01:36:34.597945+0000","last_fullsized":"2023-11-04T01:36:34.597945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:55.902083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540096+0000","last_change":"2023-11-04T01:36:34.609429+0000","last_active":"2023-11-04T01:36:35.540096+0000","last_peered":"2023-11-04T01:36:35.540096+0000","last_clean":"2023-11-04T01:36:35.540096+0000","last_became_active":"2023-11-04T01:36:34.608964+0000","last_became_peered":"2023-11-04T01:36:34.608964+0000","last_unstale":"2023-11-04T01:36:35.540096+0000","last_undegraded":"2023-11-04T01:36:35.540096+0000","last_fullsized":"2023-11-04T01:36:35.540096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:18.227352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591308+0000","last_change":"2023-11-04T01:36:30.548722+0000","last_active":"2023-11-04T01:36:34.591308+0000","last_peered":"2023-11-04T01:36:34.591308+0000","last_clean":"2023-11-04T01:36:34.591308+0000","last_became_active":"2023-11-04T01:36:30.548380+0000","last_became_peered":"2023-11-04T01:36:30.548380+0000","last_unstale":"2023-11-04T01:36:34.591308+0000","last_undegraded":"2023-11-04T01:36:34.591308+0000","last_fullsized":"2023-11-04T01:36:34.591308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:10.369120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597698+0000","last_change":"2023-11-04T01:36:29.563976+0000","last_active":"2023-11-04T01:36:34.597698+0000","last_peered":"2023-11-04T01:36:34.597698+0000","last_clean":"2023-11-04T01:36:34.597698+0000","last_became_active":"2023-11-04T01:36:29.563703+0000","last_became_peered":"2023-11-04T01:36:29.563703+0000","last_unstale":"2023-11-04T01:36:34.597698+0000","last_undegraded":"2023-11-04T01:36:34.597698+0000","last_fullsized":"2023-11-04T01:36:34.597698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:19.388284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597228+0000","last_change":"2023-11-04T01:36:34.754663+0000","last_active":"2023-11-04T01:36:35.597228+0000","last_peered":"2023-11-04T01:36:35.597228+0000","last_clean":"2023-11-04T01:36:35.597228+0000","last_became_active":"2023-11-04T01:36:34.754298+0000","last_became_peered":"2023-11-04T01:36:34.754298+0000","last_unstale":"2023-11-04T01:36:35.597228+0000","last_undegraded":"2023-11-04T01:36:35.597228+0000","last_fullsized":"2023-11-04T01:36:35.597228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:11.471843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593223+0000","last_change":"2023-11-04T01:36:30.552453+0000","last_active":"2023-11-04T01:36:34.593223+0000","last_peered":"2023-11-04T01:36:34.593223+0000","last_clean":"2023-11-04T01:36:34.593223+0000","last_became_active":"2023-11-04T01:36:30.551991+0000","last_became_peered":"2023-11-04T01:36:30.551991+0000","last_unstale":"2023-11-04T01:36:34.593223+0000","last_undegraded":"2023-11-04T01:36:34.593223+0000","last_fullsized":"2023-11-04T01:36:34.593223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:09.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.751896+0000","last_change":"2023-11-04T01:36:29.566350+0000","last_active":"2023-11-04T01:36:34.751896+0000","last_peered":"2023-11-04T01:36:34.751896+0000","last_clean":"2023-11-04T01:36:34.751896+0000","last_became_active":"2023-11-04T01:36:29.566017+0000","last_became_peered":"2023-11-04T01:36:29.566017+0000","last_unstale":"2023-11-04T01:36:34.751896+0000","last_undegraded":"2023-11-04T01:36:34.751896+0000","last_fullsized":"2023-11-04T01:36:34.751896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:14.041288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539829+0000","last_change":"2023-11-04T01:36:34.610359+0000","last_active":"2023-11-04T01:36:35.539829+0000","last_peered":"2023-11-04T01:36:35.539829+0000","last_clean":"2023-11-04T01:36:35.539829+0000","last_became_active":"2023-11-04T01:36:34.609199+0000","last_became_peered":"2023-11-04T01:36:34.609199+0000","last_unstale":"2023-11-04T01:36:35.539829+0000","last_undegraded":"2023-11-04T01:36:35.539829+0000","last_fullsized":"2023-11-04T01:36:35.539829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:33.296091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601796+0000","last_change":"2023-11-04T01:36:30.552716+0000","last_active":"2023-11-04T01:36:34.601796+0000","last_peered":"2023-11-04T01:36:34.601796+0000","last_clean":"2023-11-04T01:36:34.601796+0000","last_became_active":"2023-11-04T01:36:30.552100+0000","last_became_peered":"2023-11-04T01:36:30.552100+0000","last_unstale":"2023-11-04T01:36:34.601796+0000","last_undegraded":"2023-11-04T01:36:34.601796+0000","last_fullsized":"2023-11-04T01:36:34.601796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:36.996384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593302+0000","last_change":"2023-11-04T01:36:29.559145+0000","last_active":"2023-11-04T01:36:34.593302+0000","last_peered":"2023-11-04T01:36:34.593302+0000","last_clean":"2023-11-04T01:36:34.593302+0000","last_became_active":"2023-11-04T01:36:29.558717+0000","last_became_peered":"2023-11-04T01:36:29.558717+0000","last_unstale":"2023-11-04T01:36:34.593302+0000","last_undegraded":"2023-11-04T01:36:34.593302+0000","last_fullsized":"2023-11-04T01:36:34.593302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:27.522090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540333+0000","last_change":"2023-11-04T01:36:34.757021+0000","last_active":"2023-11-04T01:36:35.540333+0000","last_peered":"2023-11-04T01:36:35.540333+0000","last_clean":"2023-11-04T01:36:35.540333+0000","last_became_active":"2023-11-04T01:36:34.756621+0000","last_became_peered":"2023-11-04T01:36:34.756621+0000","last_unstale":"2023-11-04T01:36:35.540333+0000","last_undegraded":"2023-11-04T01:36:35.540333+0000","last_fullsized":"2023-11-04T01:36:35.540333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:09.612714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591751+0000","last_change":"2023-11-04T01:36:30.558233+0000","last_active":"2023-11-04T01:36:34.591751+0000","last_peered":"2023-11-04T01:36:34.591751+0000","last_clean":"2023-11-04T01:36:34.591751+0000","last_became_active":"2023-11-04T01:36:30.557978+0000","last_became_peered":"2023-11-04T01:36:30.557978+0000","last_unstale":"2023-11-04T01:36:34.591751+0000","last_undegraded":"2023-11-04T01:36:34.591751+0000","last_fullsized":"2023-11-04T01:36:34.591751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.045633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597917+0000","last_change":"2023-11-04T01:36:29.562995+0000","last_active":"2023-11-04T01:36:34.597917+0000","last_peered":"2023-11-04T01:36:34.597917+0000","last_clean":"2023-11-04T01:36:34.597917+0000","last_became_active":"2023-11-04T01:36:29.561703+0000","last_became_peered":"2023-11-04T01:36:29.561703+0000","last_unstale":"2023-11-04T01:36:34.597917+0000","last_undegraded":"2023-11-04T01:36:34.597917+0000","last_fullsized":"2023-11-04T01:36:34.597917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:24.009190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.595578+0000","last_change":"2023-11-04T01:36:34.754583+0000","last_active":"2023-11-04T01:36:35.595578+0000","last_peered":"2023-11-04T01:36:35.595578+0000","last_clean":"2023-11-04T01:36:35.595578+0000","last_became_active":"2023-11-04T01:36:34.754217+0000","last_became_peered":"2023-11-04T01:36:34.754217+0000","last_unstale":"2023-11-04T01:36:35.595578+0000","last_undegraded":"2023-11-04T01:36:35.595578+0000","last_fullsized":"2023-11-04T01:36:35.595578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:52.513758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597832+0000","last_change":"2023-11-04T01:36:30.551747+0000","last_active":"2023-11-04T01:36:34.597832+0000","last_peered":"2023-11-04T01:36:34.597832+0000","last_clean":"2023-11-04T01:36:34.597832+0000","last_became_active":"2023-11-04T01:36:30.551482+0000","last_became_peered":"2023-11-04T01:36:30.551482+0000","last_unstale":"2023-11-04T01:36:34.597832+0000","last_undegraded":"2023-11-04T01:36:34.597832+0000","last_fullsized":"2023-11-04T01:36:34.597832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:36.996384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752833+0000","last_change":"2023-11-04T01:36:29.571353+0000","last_active":"2023-11-04T01:36:34.752833+0000","last_peered":"2023-11-04T01:36:34.752833+0000","last_clean":"2023-11-04T01:36:34.752833+0000","last_became_active":"2023-11-04T01:36:29.571116+0000","last_became_peered":"2023-11-04T01:36:29.571116+0000","last_unstale":"2023-11-04T01:36:34.752833+0000","last_undegraded":"2023-11-04T01:36:34.752833+0000","last_fullsized":"2023-11-04T01:36:34.752833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:28.254753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597205+0000","last_change":"2023-11-04T01:36:34.752449+0000","last_active":"2023-11-04T01:36:35.597205+0000","last_peered":"2023-11-04T01:36:35.597205+0000","last_clean":"2023-11-04T01:36:35.597205+0000","last_became_active":"2023-11-04T01:36:34.752021+0000","last_became_peered":"2023-11-04T01:36:34.752021+0000","last_unstale":"2023-11-04T01:36:35.597205+0000","last_undegraded":"2023-11-04T01:36:35.597205+0000","last_fullsized":"2023-11-04T01:36:35.597205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:09.612714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600961+0000","last_change":"2023-11-04T01:36:30.558205+0000","last_active":"2023-11-04T01:36:34.600961+0000","last_peered":"2023-11-04T01:36:34.600961+0000","last_clean":"2023-11-04T01:36:34.600961+0000","last_became_active":"2023-11-04T01:36:30.557948+0000","last_became_peered":"2023-11-04T01:36:30.557948+0000","last_unstale":"2023-11-04T01:36:34.600961+0000","last_undegraded":"2023-11-04T01:36:34.600961+0000","last_fullsized":"2023-11-04T01:36:34.600961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:05.575722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597915+0000","last_change":"2023-11-04T01:36:29.566447+0000","last_active":"2023-11-04T01:36:34.597915+0000","last_peered":"2023-11-04T01:36:34.597915+0000","last_clean":"2023-11-04T01:36:34.597915+0000","last_became_active":"2023-11-04T01:36:29.566149+0000","last_became_peered":"2023-11-04T01:36:29.566149+0000","last_unstale":"2023-11-04T01:36:34.597915+0000","last_undegraded":"2023-11-04T01:36:34.597915+0000","last_fullsized":"2023-11-04T01:36:34.597915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:36.610872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.596192+0000","last_change":"2023-11-04T01:36:34.612816+0000","last_active":"2023-11-04T01:36:35.596192+0000","last_peered":"2023-11-04T01:36:35.596192+0000","last_clean":"2023-11-04T01:36:35.596192+0000","last_became_active":"2023-11-04T01:36:34.612411+0000","last_became_peered":"2023-11-04T01:36:34.612411+0000","last_unstale":"2023-11-04T01:36:35.596192+0000","last_undegraded":"2023-11-04T01:36:35.596192+0000","last_fullsized":"2023-11-04T01:36:35.596192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:28.573079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592465+0000","last_change":"2023-11-04T01:36:30.553297+0000","last_active":"2023-11-04T01:36:34.592465+0000","last_peered":"2023-11-04T01:36:34.592465+0000","last_clean":"2023-11-04T01:36:34.592465+0000","last_became_active":"2023-11-04T01:36:30.552992+0000","last_became_peered":"2023-11-04T01:36:30.552992+0000","last_unstale":"2023-11-04T01:36:34.592465+0000","last_undegraded":"2023-11-04T01:36:34.592465+0000","last_fullsized":"2023-11-04T01:36:34.592465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:25.013535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600577+0000","last_change":"2023-11-04T01:36:29.564983+0000","last_active":"2023-11-04T01:36:34.600577+0000","last_peered":"2023-11-04T01:36:34.600577+0000","last_clean":"2023-11-04T01:36:34.600577+0000","last_became_active":"2023-11-04T01:36:29.564679+0000","last_became_peered":"2023-11-04T01:36:29.564679+0000","last_unstale":"2023-11-04T01:36:34.600577+0000","last_undegraded":"2023-11-04T01:36:34.600577+0000","last_fullsized":"2023-11-04T01:36:34.600577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:35.972647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.596517+0000","last_change":"2023-11-04T01:36:34.609968+0000","last_active":"2023-11-04T01:36:35.596517+0000","last_peered":"2023-11-04T01:36:35.596517+0000","last_clean":"2023-11-04T01:36:35.596517+0000","last_became_active":"2023-11-04T01:36:34.609460+0000","last_became_peered":"2023-11-04T01:36:34.609460+0000","last_unstale":"2023-11-04T01:36:35.596517+0000","last_undegraded":"2023-11-04T01:36:35.596517+0000","last_fullsized":"2023-11-04T01:36:35.596517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:09.612714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597523+0000","last_change":"2023-11-04T01:36:30.551741+0000","last_active":"2023-11-04T01:36:34.597523+0000","last_peered":"2023-11-04T01:36:34.597523+0000","last_clean":"2023-11-04T01:36:34.597523+0000","last_became_active":"2023-11-04T01:36:30.551456+0000","last_became_peered":"2023-11-04T01:36:30.551456+0000","last_unstale":"2023-11-04T01:36:34.597523+0000","last_undegraded":"2023-11-04T01:36:34.597523+0000","last_fullsized":"2023-11-04T01:36:34.597523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:36.976993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603079+0000","last_change":"2023-11-04T01:36:29.562224+0000","last_active":"2023-11-04T01:36:34.603079+0000","last_peered":"2023-11-04T01:36:34.603079+0000","last_clean":"2023-11-04T01:36:34.603079+0000","last_became_active":"2023-11-04T01:36:29.561870+0000","last_became_peered":"2023-11-04T01:36:29.561870+0000","last_unstale":"2023-11-04T01:36:34.603079+0000","last_undegraded":"2023-11-04T01:36:34.603079+0000","last_fullsized":"2023-11-04T01:36:34.603079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:08.164823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597173+0000","last_change":"2023-11-04T01:36:34.610751+0000","last_active":"2023-11-04T01:36:35.597173+0000","last_peered":"2023-11-04T01:36:35.597173+0000","last_clean":"2023-11-04T01:36:35.597173+0000","last_became_active":"2023-11-04T01:36:34.610375+0000","last_became_peered":"2023-11-04T01:36:34.610375+0000","last_unstale":"2023-11-04T01:36:35.597173+0000","last_undegraded":"2023-11-04T01:36:35.597173+0000","last_fullsized":"2023-11-04T01:36:35.597173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:34.881207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.599741+0000","last_change":"2023-11-04T01:36:30.553476+0000","last_active":"2023-11-04T01:36:34.599741+0000","last_peered":"2023-11-04T01:36:34.599741+0000","last_clean":"2023-11-04T01:36:34.599741+0000","last_became_active":"2023-11-04T01:36:30.553178+0000","last_became_peered":"2023-11-04T01:36:30.553178+0000","last_unstale":"2023-11-04T01:36:34.599741+0000","last_undegraded":"2023-11-04T01:36:34.599741+0000","last_fullsized":"2023-11-04T01:36:34.599741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:28.526436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752210+0000","last_change":"2023-11-04T01:36:29.565970+0000","last_active":"2023-11-04T01:36:34.752210+0000","last_peered":"2023-11-04T01:36:34.752210+0000","last_clean":"2023-11-04T01:36:34.752210+0000","last_became_active":"2023-11-04T01:36:29.565617+0000","last_became_peered":"2023-11-04T01:36:29.565617+0000","last_unstale":"2023-11-04T01:36:34.752210+0000","last_undegraded":"2023-11-04T01:36:34.752210+0000","last_fullsized":"2023-11-04T01:36:34.752210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:00.121926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597914+0000","last_change":"2023-11-04T01:36:34.755484+0000","last_active":"2023-11-04T01:36:35.597914+0000","last_peered":"2023-11-04T01:36:35.597914+0000","last_clean":"2023-11-04T01:36:35.597914+0000","last_became_active":"2023-11-04T01:36:34.755124+0000","last_became_peered":"2023-11-04T01:36:34.755124+0000","last_unstale":"2023-11-04T01:36:35.597914+0000","last_undegraded":"2023-11-04T01:36:35.597914+0000","last_fullsized":"2023-11-04T01:36:35.597914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:54:21.582207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590734+0000","last_change":"2023-11-04T01:36:30.558717+0000","last_active":"2023-11-04T01:36:34.590734+0000","last_peered":"2023-11-04T01:36:34.590734+0000","last_clean":"2023-11-04T01:36:34.590734+0000","last_became_active":"2023-11-04T01:36:30.558442+0000","last_became_peered":"2023-11-04T01:36:30.558442+0000","last_unstale":"2023-11-04T01:36:34.590734+0000","last_undegraded":"2023-11-04T01:36:34.590734+0000","last_fullsized":"2023-11-04T01:36:34.590734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600670+0000","last_change":"2023-11-04T01:36:29.558941+0000","last_active":"2023-11-04T01:36:34.600670+0000","last_peered":"2023-11-04T01:36:34.600670+0000","last_clean":"2023-11-04T01:36:34.600670+0000","last_became_active":"2023-11-04T01:36:29.558628+0000","last_became_peered":"2023-11-04T01:36:29.558628+0000","last_unstale":"2023-11-04T01:36:34.600670+0000","last_undegraded":"2023-11-04T01:36:34.600670+0000","last_fullsized":"2023-11-04T01:36:34.600670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:32:58.476395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752215+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:36:34.752215+0000","last_peered":"2023-11-04T01:36:34.752215+0000","last_clean":"2023-11-04T01:36:34.752215+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:36:34.752215+0000","last_undegraded":"2023-11-04T01:36:34.752215+0000","last_fullsized":"2023-11-04T01:36:34.752215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539400+0000","last_change":"2023-11-04T01:36:34.754650+0000","last_active":"2023-11-04T01:36:35.539400+0000","last_peered":"2023-11-04T01:36:35.539400+0000","last_clean":"2023-11-04T01:36:35.539400+0000","last_became_active":"2023-11-04T01:36:34.754266+0000","last_became_peered":"2023-11-04T01:36:34.754266+0000","last_unstale":"2023-11-04T01:36:35.539400+0000","last_undegraded":"2023-11-04T01:36:35.539400+0000","last_fullsized":"2023-11-04T01:36:35.539400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:28.573079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752605+0000","last_change":"2023-11-04T01:36:30.559432+0000","last_active":"2023-11-04T01:36:34.752605+0000","last_peered":"2023-11-04T01:36:34.752605+0000","last_clean":"2023-11-04T01:36:34.752605+0000","last_became_active":"2023-11-04T01:36:30.559164+0000","last_became_peered":"2023-11-04T01:36:30.559164+0000","last_unstale":"2023-11-04T01:36:34.752605+0000","last_undegraded":"2023-11-04T01:36:34.752605+0000","last_fullsized":"2023-11-04T01:36:34.752605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:07.434851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603732+0000","last_change":"2023-11-04T01:36:29.559481+0000","last_active":"2023-11-04T01:36:34.603732+0000","last_peered":"2023-11-04T01:36:34.603732+0000","last_clean":"2023-11-04T01:36:34.603732+0000","last_became_active":"2023-11-04T01:36:29.559232+0000","last_became_peered":"2023-11-04T01:36:29.559232+0000","last_unstale":"2023-11-04T01:36:34.603732+0000","last_undegraded":"2023-11-04T01:36:34.603732+0000","last_fullsized":"2023-11-04T01:36:34.603732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:39.985078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539003+0000","last_change":"2023-11-04T01:36:34.752537+0000","last_active":"2023-11-04T01:36:35.539003+0000","last_peered":"2023-11-04T01:36:35.539003+0000","last_clean":"2023-11-04T01:36:35.539003+0000","last_became_active":"2023-11-04T01:36:34.752122+0000","last_became_peered":"2023-11-04T01:36:34.752122+0000","last_unstale":"2023-11-04T01:36:35.539003+0000","last_undegraded":"2023-11-04T01:36:35.539003+0000","last_fullsized":"2023-11-04T01:36:35.539003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:54.343995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600864+0000","last_change":"2023-11-04T01:36:30.559114+0000","last_active":"2023-11-04T01:36:34.600864+0000","last_peered":"2023-11-04T01:36:34.600864+0000","last_clean":"2023-11-04T01:36:34.600864+0000","last_became_active":"2023-11-04T01:36:30.556702+0000","last_became_peered":"2023-11-04T01:36:30.556702+0000","last_unstale":"2023-11-04T01:36:34.600864+0000","last_undegraded":"2023-11-04T01:36:34.600864+0000","last_fullsized":"2023-11-04T01:36:34.600864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:30.844215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597914+0000","last_change":"2023-11-04T01:36:29.563452+0000","last_active":"2023-11-04T01:36:34.597914+0000","last_peered":"2023-11-04T01:36:34.597914+0000","last_clean":"2023-11-04T01:36:34.597914+0000","last_became_active":"2023-11-04T01:36:29.561923+0000","last_became_peered":"2023-11-04T01:36:29.561923+0000","last_unstale":"2023-11-04T01:36:34.597914+0000","last_undegraded":"2023-11-04T01:36:34.597914+0000","last_fullsized":"2023-11-04T01:36:34.597914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:27.522090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597420+0000","last_change":"2023-11-04T01:36:34.608316+0000","last_active":"2023-11-04T01:36:35.597420+0000","last_peered":"2023-11-04T01:36:35.597420+0000","last_clean":"2023-11-04T01:36:35.597420+0000","last_became_active":"2023-11-04T01:36:34.607936+0000","last_became_peered":"2023-11-04T01:36:34.607936+0000","last_unstale":"2023-11-04T01:36:35.597420+0000","last_undegraded":"2023-11-04T01:36:35.597420+0000","last_fullsized":"2023-11-04T01:36:35.597420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:31.223962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752975+0000","last_change":"2023-11-04T01:36:30.557506+0000","last_active":"2023-11-04T01:36:34.752975+0000","last_peered":"2023-11-04T01:36:34.752975+0000","last_clean":"2023-11-04T01:36:34.752975+0000","last_became_active":"2023-11-04T01:36:30.557188+0000","last_became_peered":"2023-11-04T01:36:30.557188+0000","last_unstale":"2023-11-04T01:36:34.752975+0000","last_undegraded":"2023-11-04T01:36:34.752975+0000","last_fullsized":"2023-11-04T01:36:34.752975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:59.924265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603522+0000","last_change":"2023-11-04T01:36:29.561929+0000","last_active":"2023-11-04T01:36:34.603522+0000","last_peered":"2023-11-04T01:36:34.603522+0000","last_clean":"2023-11-04T01:36:34.603522+0000","last_became_active":"2023-11-04T01:36:29.561665+0000","last_became_peered":"2023-11-04T01:36:29.561665+0000","last_unstale":"2023-11-04T01:36:34.603522+0000","last_undegraded":"2023-11-04T01:36:34.603522+0000","last_fullsized":"2023-11-04T01:36:34.603522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:55.902083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.595491+0000","last_change":"2023-11-04T01:36:34.755096+0000","last_active":"2023-11-04T01:36:35.595491+0000","last_peered":"2023-11-04T01:36:35.595491+0000","last_clean":"2023-11-04T01:36:35.595491+0000","last_became_active":"2023-11-04T01:36:34.754200+0000","last_became_peered":"2023-11-04T01:36:34.754200+0000","last_unstale":"2023-11-04T01:36:35.595491+0000","last_undegraded":"2023-11-04T01:36:35.595491+0000","last_fullsized":"2023-11-04T01:36:35.595491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:51.521044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752673+0000","last_change":"2023-11-04T01:36:30.556808+0000","last_active":"2023-11-04T01:36:34.752673+0000","last_peered":"2023-11-04T01:36:34.752673+0000","last_clean":"2023-11-04T01:36:34.752673+0000","last_became_active":"2023-11-04T01:36:30.556522+0000","last_became_peered":"2023-11-04T01:36:30.556522+0000","last_unstale":"2023-11-04T01:36:34.752673+0000","last_undegraded":"2023-11-04T01:36:34.752673+0000","last_fullsized":"2023-11-04T01:36:34.752673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:48.476765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591829+0000","last_change":"2023-11-04T01:36:29.560106+0000","last_active":"2023-11-04T01:36:34.591829+0000","last_peered":"2023-11-04T01:36:34.591829+0000","last_clean":"2023-11-04T01:36:34.591829+0000","last_became_active":"2023-11-04T01:36:29.559786+0000","last_became_peered":"2023-11-04T01:36:29.559786+0000","last_unstale":"2023-11-04T01:36:34.591829+0000","last_undegraded":"2023-11-04T01:36:34.591829+0000","last_fullsized":"2023-11-04T01:36:34.591829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:37:02.831923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539853+0000","last_change":"2023-11-04T01:36:34.610033+0000","last_active":"2023-11-04T01:36:35.539853+0000","last_peered":"2023-11-04T01:36:35.539853+0000","last_clean":"2023-11-04T01:36:35.539853+0000","last_became_active":"2023-11-04T01:36:34.609439+0000","last_became_peered":"2023-11-04T01:36:34.609439+0000","last_unstale":"2023-11-04T01:36:35.539853+0000","last_undegraded":"2023-11-04T01:36:35.539853+0000","last_fullsized":"2023-11-04T01:36:35.539853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:57.965365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752112+0000","last_change":"2023-11-04T01:36:30.556245+0000","last_active":"2023-11-04T01:36:34.752112+0000","last_peered":"2023-11-04T01:36:34.752112+0000","last_clean":"2023-11-04T01:36:34.752112+0000","last_became_active":"2023-11-04T01:36:30.555523+0000","last_became_peered":"2023-11-04T01:36:30.555523+0000","last_unstale":"2023-11-04T01:36:34.752112+0000","last_undegraded":"2023-11-04T01:36:34.752112+0000","last_fullsized":"2023-11-04T01:36:34.752112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:24.536087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603267+0000","last_change":"2023-11-04T01:36:29.558752+0000","last_active":"2023-11-04T01:36:34.603267+0000","last_peered":"2023-11-04T01:36:34.603267+0000","last_clean":"2023-11-04T01:36:34.603267+0000","last_became_active":"2023-11-04T01:36:29.558430+0000","last_became_peered":"2023-11-04T01:36:29.558430+0000","last_unstale":"2023-11-04T01:36:34.603267+0000","last_undegraded":"2023-11-04T01:36:34.603267+0000","last_fullsized":"2023-11-04T01:36:34.603267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:46.170109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597667+0000","last_change":"2023-11-04T01:36:34.610894+0000","last_active":"2023-11-04T01:36:35.597667+0000","last_peered":"2023-11-04T01:36:35.597667+0000","last_clean":"2023-11-04T01:36:35.597667+0000","last_became_active":"2023-11-04T01:36:34.609868+0000","last_became_peered":"2023-11-04T01:36:34.609868+0000","last_unstale":"2023-11-04T01:36:35.597667+0000","last_undegraded":"2023-11-04T01:36:35.597667+0000","last_fullsized":"2023-11-04T01:36:35.597667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:11.471843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590924+0000","last_change":"2023-11-04T01:36:30.553108+0000","last_active":"2023-11-04T01:36:34.590924+0000","last_peered":"2023-11-04T01:36:34.590924+0000","last_clean":"2023-11-04T01:36:34.590924+0000","last_became_active":"2023-11-04T01:36:30.552812+0000","last_became_peered":"2023-11-04T01:36:30.552812+0000","last_unstale":"2023-11-04T01:36:34.590924+0000","last_undegraded":"2023-11-04T01:36:34.590924+0000","last_fullsized":"2023-11-04T01:36:34.590924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:17.787245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591689+0000","last_change":"2023-11-04T01:36:29.555166+0000","last_active":"2023-11-04T01:36:34.591689+0000","last_peered":"2023-11-04T01:36:34.591689+0000","last_clean":"2023-11-04T01:36:34.591689+0000","last_became_active":"2023-11-04T01:36:29.554537+0000","last_became_peered":"2023-11-04T01:36:29.554537+0000","last_unstale":"2023-11-04T01:36:34.591689+0000","last_undegraded":"2023-11-04T01:36:34.591689+0000","last_fullsized":"2023-11-04T01:36:34.591689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:28.954776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597394+0000","last_change":"2023-11-04T01:36:34.754737+0000","last_active":"2023-11-04T01:36:35.597394+0000","last_peered":"2023-11-04T01:36:35.597394+0000","last_clean":"2023-11-04T01:36:35.597394+0000","last_became_active":"2023-11-04T01:36:34.754360+0000","last_became_peered":"2023-11-04T01:36:34.754360+0000","last_unstale":"2023-11-04T01:36:35.597394+0000","last_undegraded":"2023-11-04T01:36:35.597394+0000","last_fullsized":"2023-11-04T01:36:35.597394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:25.393431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752320+0000","last_change":"2023-11-04T01:36:30.555902+0000","last_active":"2023-11-04T01:36:34.752320+0000","last_peered":"2023-11-04T01:36:34.752320+0000","last_clean":"2023-11-04T01:36:34.752320+0000","last_became_active":"2023-11-04T01:36:30.555624+0000","last_became_peered":"2023-11-04T01:36:30.555624+0000","last_unstale":"2023-11-04T01:36:34.752320+0000","last_undegraded":"2023-11-04T01:36:34.752320+0000","last_fullsized":"2023-11-04T01:36:34.752320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:27.186969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600516+0000","last_change":"2023-11-04T01:36:29.566041+0000","last_active":"2023-11-04T01:36:34.600516+0000","last_peered":"2023-11-04T01:36:34.600516+0000","last_clean":"2023-11-04T01:36:34.600516+0000","last_became_active":"2023-11-04T01:36:29.565674+0000","last_became_peered":"2023-11-04T01:36:29.565674+0000","last_unstale":"2023-11-04T01:36:34.600516+0000","last_undegraded":"2023-11-04T01:36:34.600516+0000","last_fullsized":"2023-11-04T01:36:34.600516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:11.541445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597902+0000","last_change":"2023-11-04T01:36:34.752418+0000","last_active":"2023-11-04T01:36:35.597902+0000","last_peered":"2023-11-04T01:36:35.597902+0000","last_clean":"2023-11-04T01:36:35.597902+0000","last_became_active":"2023-11-04T01:36:34.752054+0000","last_became_peered":"2023-11-04T01:36:34.752054+0000","last_unstale":"2023-11-04T01:36:35.597902+0000","last_undegraded":"2023-11-04T01:36:35.597902+0000","last_fullsized":"2023-11-04T01:36:35.597902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:44.979273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601844+0000","last_change":"2023-11-04T01:36:30.559566+0000","last_active":"2023-11-04T01:36:34.601844+0000","last_peered":"2023-11-04T01:36:34.601844+0000","last_clean":"2023-11-04T01:36:34.601844+0000","last_became_active":"2023-11-04T01:36:30.559372+0000","last_became_peered":"2023-11-04T01:36:30.559372+0000","last_unstale":"2023-11-04T01:36:34.601844+0000","last_undegraded":"2023-11-04T01:36:34.601844+0000","last_fullsized":"2023-11-04T01:36:34.601844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:17.787245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603204+0000","last_change":"2023-11-04T01:36:29.559883+0000","last_active":"2023-11-04T01:36:34.603204+0000","last_peered":"2023-11-04T01:36:34.603204+0000","last_clean":"2023-11-04T01:36:34.603204+0000","last_became_active":"2023-11-04T01:36:29.559623+0000","last_became_peered":"2023-11-04T01:36:29.559623+0000","last_unstale":"2023-11-04T01:36:34.603204+0000","last_undegraded":"2023-11-04T01:36:34.603204+0000","last_fullsized":"2023-11-04T01:36:34.603204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:19.388284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.596818+0000","last_change":"2023-11-04T01:36:34.752434+0000","last_active":"2023-11-04T01:36:35.596818+0000","last_peered":"2023-11-04T01:36:35.596818+0000","last_clean":"2023-11-04T01:36:35.596818+0000","last_became_active":"2023-11-04T01:36:34.752050+0000","last_became_peered":"2023-11-04T01:36:34.752050+0000","last_unstale":"2023-11-04T01:36:35.596818+0000","last_undegraded":"2023-11-04T01:36:35.596818+0000","last_fullsized":"2023-11-04T01:36:35.596818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:38:03.961257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752508+0000","last_change":"2023-11-04T01:36:30.554177+0000","last_active":"2023-11-04T01:36:34.752508+0000","last_peered":"2023-11-04T01:36:34.752508+0000","last_clean":"2023-11-04T01:36:34.752508+0000","last_became_active":"2023-11-04T01:36:30.553678+0000","last_became_peered":"2023-11-04T01:36:30.553678+0000","last_unstale":"2023-11-04T01:36:34.752508+0000","last_undegraded":"2023-11-04T01:36:34.752508+0000","last_fullsized":"2023-11-04T01:36:34.752508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:30.844215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:39.478764+0000","last_change":"2023-11-04T01:36:29.563305+0000","last_active":"2023-11-04T01:36:39.478764+0000","last_peered":"2023-11-04T01:36:39.478764+0000","last_clean":"2023-11-04T01:36:39.478764+0000","last_became_active":"2023-11-04T01:36:29.563013+0000","last_became_peered":"2023-11-04T01:36:29.563013+0000","last_unstale":"2023-11-04T01:36:39.478764+0000","last_undegraded":"2023-11-04T01:36:39.478764+0000","last_fullsized":"2023-11-04T01:36:39.478764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:46:08.796108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.596633+0000","last_change":"2023-11-04T01:36:34.608299+0000","last_active":"2023-11-04T01:36:35.596633+0000","last_peered":"2023-11-04T01:36:35.596633+0000","last_clean":"2023-11-04T01:36:35.596633+0000","last_became_active":"2023-11-04T01:36:34.607909+0000","last_became_peered":"2023-11-04T01:36:34.607909+0000","last_unstale":"2023-11-04T01:36:35.596633+0000","last_undegraded":"2023-11-04T01:36:35.596633+0000","last_fullsized":"2023-11-04T01:36:35.596633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:31.223962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592418+0000","last_change":"2023-11-04T01:36:30.557781+0000","last_active":"2023-11-04T01:36:34.592418+0000","last_peered":"2023-11-04T01:36:34.592418+0000","last_clean":"2023-11-04T01:36:34.592418+0000","last_became_active":"2023-11-04T01:36:30.557449+0000","last_became_peered":"2023-11-04T01:36:30.557449+0000","last_unstale":"2023-11-04T01:36:34.592418+0000","last_undegraded":"2023-11-04T01:36:34.592418+0000","last_fullsized":"2023-11-04T01:36:34.592418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:29.959121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597825+0000","last_change":"2023-11-04T01:36:29.565926+0000","last_active":"2023-11-04T01:36:34.597825+0000","last_peered":"2023-11-04T01:36:34.597825+0000","last_clean":"2023-11-04T01:36:34.597825+0000","last_became_active":"2023-11-04T01:36:29.564825+0000","last_became_peered":"2023-11-04T01:36:29.564825+0000","last_unstale":"2023-11-04T01:36:34.597825+0000","last_undegraded":"2023-11-04T01:36:34.597825+0000","last_fullsized":"2023-11-04T01:36:34.597825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:08.164823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540301+0000","last_change":"2023-11-04T01:36:34.607153+0000","last_active":"2023-11-04T01:36:35.540301+0000","last_peered":"2023-11-04T01:36:35.540301+0000","last_clean":"2023-11-04T01:36:35.540301+0000","last_became_active":"2023-11-04T01:36:34.606735+0000","last_became_peered":"2023-11-04T01:36:34.606735+0000","last_unstale":"2023-11-04T01:36:35.540301+0000","last_undegraded":"2023-11-04T01:36:35.540301+0000","last_fullsized":"2023-11-04T01:36:35.540301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:28.573079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601770+0000","last_change":"2023-11-04T01:36:30.556826+0000","last_active":"2023-11-04T01:36:34.601770+0000","last_peered":"2023-11-04T01:36:34.601770+0000","last_clean":"2023-11-04T01:36:34.601770+0000","last_became_active":"2023-11-04T01:36:30.556539+0000","last_became_peered":"2023-11-04T01:36:30.556539+0000","last_unstale":"2023-11-04T01:36:34.601770+0000","last_undegraded":"2023-11-04T01:36:34.601770+0000","last_fullsized":"2023-11-04T01:36:34.601770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.045633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601013+0000","last_change":"2023-11-04T01:36:29.561123+0000","last_active":"2023-11-04T01:36:34.601013+0000","last_peered":"2023-11-04T01:36:34.601013+0000","last_clean":"2023-11-04T01:36:34.601013+0000","last_became_active":"2023-11-04T01:36:29.560854+0000","last_became_peered":"2023-11-04T01:36:29.560854+0000","last_unstale":"2023-11-04T01:36:34.601013+0000","last_undegraded":"2023-11-04T01:36:34.601013+0000","last_fullsized":"2023-11-04T01:36:34.601013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:09.364774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.595884+0000","last_change":"2023-11-04T01:36:34.601066+0000","last_active":"2023-11-04T01:36:35.595884+0000","last_peered":"2023-11-04T01:36:35.595884+0000","last_clean":"2023-11-04T01:36:35.595884+0000","last_became_active":"2023-11-04T01:36:34.599090+0000","last_became_peered":"2023-11-04T01:36:34.599090+0000","last_unstale":"2023-11-04T01:36:35.595884+0000","last_undegraded":"2023-11-04T01:36:35.595884+0000","last_fullsized":"2023-11-04T01:36:35.595884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:55:45.766187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600942+0000","last_change":"2023-11-04T01:36:30.561795+0000","last_active":"2023-11-04T01:36:34.600942+0000","last_peered":"2023-11-04T01:36:34.600942+0000","last_clean":"2023-11-04T01:36:34.600942+0000","last_became_active":"2023-11-04T01:36:30.561540+0000","last_became_peered":"2023-11-04T01:36:30.561540+0000","last_unstale":"2023-11-04T01:36:34.600942+0000","last_undegraded":"2023-11-04T01:36:34.600942+0000","last_fullsized":"2023-11-04T01:36:34.600942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:50.307002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593216+0000","last_change":"2023-11-04T01:36:29.559999+0000","last_active":"2023-11-04T01:36:34.593216+0000","last_peered":"2023-11-04T01:36:34.593216+0000","last_clean":"2023-11-04T01:36:34.593216+0000","last_became_active":"2023-11-04T01:36:29.559724+0000","last_became_peered":"2023-11-04T01:36:29.559724+0000","last_unstale":"2023-11-04T01:36:34.593216+0000","last_undegraded":"2023-11-04T01:36:34.593216+0000","last_fullsized":"2023-11-04T01:36:34.593216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:19.388284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597352+0000","last_change":"2023-11-04T01:36:34.754539+0000","last_active":"2023-11-04T01:36:35.597352+0000","last_peered":"2023-11-04T01:36:35.597352+0000","last_clean":"2023-11-04T01:36:35.597352+0000","last_became_active":"2023-11-04T01:36:34.754171+0000","last_became_peered":"2023-11-04T01:36:34.754171+0000","last_unstale":"2023-11-04T01:36:35.597352+0000","last_undegraded":"2023-11-04T01:36:35.597352+0000","last_fullsized":"2023-11-04T01:36:35.597352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:38:03.961257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597516+0000","last_change":"2023-11-04T01:36:34.754646+0000","last_active":"2023-11-04T01:36:35.597516+0000","last_peered":"2023-11-04T01:36:35.597516+0000","last_clean":"2023-11-04T01:36:35.597516+0000","last_became_active":"2023-11-04T01:36:34.754295+0000","last_became_peered":"2023-11-04T01:36:34.754295+0000","last_unstale":"2023-11-04T01:36:35.597516+0000","last_undegraded":"2023-11-04T01:36:35.597516+0000","last_fullsized":"2023-11-04T01:36:35.597516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:34.881207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597360+0000","last_change":"2023-11-04T01:36:30.549880+0000","last_active":"2023-11-04T01:36:34.597360+0000","last_peered":"2023-11-04T01:36:34.597360+0000","last_clean":"2023-11-04T01:36:34.597360+0000","last_became_active":"2023-11-04T01:36:30.549601+0000","last_became_peered":"2023-11-04T01:36:30.549601+0000","last_unstale":"2023-11-04T01:36:34.597360+0000","last_undegraded":"2023-11-04T01:36:34.597360+0000","last_fullsized":"2023-11-04T01:36:34.597360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:12.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600522+0000","last_change":"2023-11-04T01:36:29.561272+0000","last_active":"2023-11-04T01:36:34.600522+0000","last_peered":"2023-11-04T01:36:34.600522+0000","last_clean":"2023-11-04T01:36:34.600522+0000","last_became_active":"2023-11-04T01:36:29.561002+0000","last_became_peered":"2023-11-04T01:36:29.561002+0000","last_unstale":"2023-11-04T01:36:34.600522+0000","last_undegraded":"2023-11-04T01:36:34.600522+0000","last_fullsized":"2023-11-04T01:36:34.600522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:55.902083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540190+0000","last_change":"2023-11-04T01:36:34.605037+0000","last_active":"2023-11-04T01:36:35.540190+0000","last_peered":"2023-11-04T01:36:35.540190+0000","last_clean":"2023-11-04T01:36:35.540190+0000","last_became_active":"2023-11-04T01:36:34.604643+0000","last_became_peered":"2023-11-04T01:36:34.604643+0000","last_unstale":"2023-11-04T01:36:35.540190+0000","last_undegraded":"2023-11-04T01:36:35.540190+0000","last_fullsized":"2023-11-04T01:36:35.540190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:09.612714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591215+0000","last_change":"2023-11-04T01:36:30.554876+0000","last_active":"2023-11-04T01:36:34.591215+0000","last_peered":"2023-11-04T01:36:34.591215+0000","last_clean":"2023-11-04T01:36:34.591215+0000","last_became_active":"2023-11-04T01:36:30.554614+0000","last_became_peered":"2023-11-04T01:36:30.554614+0000","last_unstale":"2023-11-04T01:36:34.591215+0000","last_undegraded":"2023-11-04T01:36:34.591215+0000","last_fullsized":"2023-11-04T01:36:34.591215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:17.787245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591406+0000","last_change":"2023-11-04T01:36:29.561077+0000","last_active":"2023-11-04T01:36:34.591406+0000","last_peered":"2023-11-04T01:36:34.591406+0000","last_clean":"2023-11-04T01:36:34.591406+0000","last_became_active":"2023-11-04T01:36:29.560004+0000","last_became_peered":"2023-11-04T01:36:29.560004+0000","last_unstale":"2023-11-04T01:36:34.591406+0000","last_undegraded":"2023-11-04T01:36:34.591406+0000","last_fullsized":"2023-11-04T01:36:34.591406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:27.522090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593048+0000","last_change":"2023-11-04T01:36:29.554796+0000","last_active":"2023-11-04T01:36:34.593048+0000","last_peered":"2023-11-04T01:36:34.593048+0000","last_clean":"2023-11-04T01:36:34.593048+0000","last_became_active":"2023-11-04T01:36:29.554404+0000","last_became_peered":"2023-11-04T01:36:29.554404+0000","last_unstale":"2023-11-04T01:36:34.593048+0000","last_undegraded":"2023-11-04T01:36:34.593048+0000","last_fullsized":"2023-11-04T01:36:34.593048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:24.009190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603121+0000","last_change":"2023-11-04T01:36:30.555821+0000","last_active":"2023-11-04T01:36:34.603121+0000","last_peered":"2023-11-04T01:36:34.603121+0000","last_clean":"2023-11-04T01:36:34.603121+0000","last_became_active":"2023-11-04T01:36:30.555189+0000","last_became_peered":"2023-11-04T01:36:30.555189+0000","last_unstale":"2023-11-04T01:36:34.603121+0000","last_undegraded":"2023-11-04T01:36:34.603121+0000","last_fullsized":"2023-11-04T01:36:34.603121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:36.976993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540760+0000","last_change":"2023-11-04T01:36:34.609254+0000","last_active":"2023-11-04T01:36:35.540760+0000","last_peered":"2023-11-04T01:36:35.540760+0000","last_clean":"2023-11-04T01:36:35.540760+0000","last_became_active":"2023-11-04T01:36:34.608845+0000","last_became_peered":"2023-11-04T01:36:34.608845+0000","last_unstale":"2023-11-04T01:36:35.540760+0000","last_undegraded":"2023-11-04T01:36:35.540760+0000","last_fullsized":"2023-11-04T01:36:35.540760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:32.563428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591589+0000","last_change":"2023-11-04T01:36:29.564267+0000","last_active":"2023-11-04T01:36:34.591589+0000","last_peered":"2023-11-04T01:36:34.591589+0000","last_clean":"2023-11-04T01:36:34.591589+0000","last_became_active":"2023-11-04T01:36:29.563992+0000","last_became_peered":"2023-11-04T01:36:29.563992+0000","last_unstale":"2023-11-04T01:36:34.591589+0000","last_undegraded":"2023-11-04T01:36:34.591589+0000","last_fullsized":"2023-11-04T01:36:34.591589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:28.954776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592935+0000","last_change":"2023-11-04T01:36:30.552063+0000","last_active":"2023-11-04T01:36:34.592935+0000","last_peered":"2023-11-04T01:36:34.592935+0000","last_clean":"2023-11-04T01:36:34.592935+0000","last_became_active":"2023-11-04T01:36:30.551686+0000","last_became_peered":"2023-11-04T01:36:30.551686+0000","last_unstale":"2023-11-04T01:36:34.592935+0000","last_undegraded":"2023-11-04T01:36:34.592935+0000","last_fullsized":"2023-11-04T01:36:34.592935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:56.906428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597623+0000","last_change":"2023-11-04T01:36:34.607234+0000","last_active":"2023-11-04T01:36:35.597623+0000","last_peered":"2023-11-04T01:36:35.597623+0000","last_clean":"2023-11-04T01:36:35.597623+0000","last_became_active":"2023-11-04T01:36:34.606850+0000","last_became_peered":"2023-11-04T01:36:34.606850+0000","last_unstale":"2023-11-04T01:36:35.597623+0000","last_undegraded":"2023-11-04T01:36:35.597623+0000","last_fullsized":"2023-11-04T01:36:35.597623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:18.885568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590846+0000","last_change":"2023-11-04T01:36:30.554613+0000","last_active":"2023-11-04T01:36:34.590846+0000","last_peered":"2023-11-04T01:36:34.590846+0000","last_clean":"2023-11-04T01:36:34.590846+0000","last_became_active":"2023-11-04T01:36:30.554329+0000","last_became_peered":"2023-11-04T01:36:30.554329+0000","last_unstale":"2023-11-04T01:36:34.590846+0000","last_undegraded":"2023-11-04T01:36:34.590846+0000","last_fullsized":"2023-11-04T01:36:34.590846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:37.615217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.602985+0000","last_change":"2023-11-04T01:36:30.557052+0000","last_active":"2023-11-04T01:36:34.602985+0000","last_peered":"2023-11-04T01:36:34.602985+0000","last_clean":"2023-11-04T01:36:34.602985+0000","last_became_active":"2023-11-04T01:36:30.556744+0000","last_became_peered":"2023-11-04T01:36:30.556744+0000","last_unstale":"2023-11-04T01:36:34.602985+0000","last_undegraded":"2023-11-04T01:36:34.602985+0000","last_fullsized":"2023-11-04T01:36:34.602985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:29.959121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600475+0000","last_change":"2023-11-04T01:36:30.557244+0000","last_active":"2023-11-04T01:36:34.600475+0000","last_peered":"2023-11-04T01:36:34.600475+0000","last_clean":"2023-11-04T01:36:34.600475+0000","last_became_active":"2023-11-04T01:36:30.556922+0000","last_became_peered":"2023-11-04T01:36:30.556922+0000","last_unstale":"2023-11-04T01:36:34.600475+0000","last_undegraded":"2023-11-04T01:36:34.600475+0000","last_fullsized":"2023-11-04T01:36:34.600475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:27.186969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603035+0000","last_change":"2023-11-04T01:36:30.553115+0000","last_active":"2023-11-04T01:36:34.603035+0000","last_peered":"2023-11-04T01:36:34.603035+0000","last_clean":"2023-11-04T01:36:34.603035+0000","last_became_active":"2023-11-04T01:36:30.552004+0000","last_became_peered":"2023-11-04T01:36:30.552004+0000","last_unstale":"2023-11-04T01:36:34.603035+0000","last_undegraded":"2023-11-04T01:36:34.603035+0000","last_fullsized":"2023-11-04T01:36:34.603035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:10.369120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592230+0000","last_change":"2023-11-04T01:36:30.549121+0000","last_active":"2023-11-04T01:36:34.592230+0000","last_peered":"2023-11-04T01:36:34.592230+0000","last_clean":"2023-11-04T01:36:34.592230+0000","last_became_active":"2023-11-04T01:36:30.548845+0000","last_became_peered":"2023-11-04T01:36:30.548845+0000","last_unstale":"2023-11-04T01:36:34.592230+0000","last_undegraded":"2023-11-04T01:36:34.592230+0000","last_fullsized":"2023-11-04T01:36:34.592230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:53.928372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597717+0000","last_change":"2023-11-04T01:36:30.549624+0000","last_active":"2023-11-04T01:36:34.597717+0000","last_peered":"2023-11-04T01:36:34.597717+0000","last_clean":"2023-11-04T01:36:34.597717+0000","last_became_active":"2023-11-04T01:36:30.549352+0000","last_became_peered":"2023-11-04T01:36:30.549352+0000","last_unstale":"2023-11-04T01:36:34.597717+0000","last_undegraded":"2023-11-04T01:36:34.597717+0000","last_fullsized":"2023-11-04T01:36:34.597717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593105+0000","last_change":"2023-11-04T01:36:30.560044+0000","last_active":"2023-11-04T01:36:34.593105+0000","last_peered":"2023-11-04T01:36:34.593105+0000","last_clean":"2023-11-04T01:36:34.593105+0000","last_became_active":"2023-11-04T01:36:30.559776+0000","last_became_peered":"2023-11-04T01:36:30.559776+0000","last_unstale":"2023-11-04T01:36:34.593105+0000","last_undegraded":"2023-11-04T01:36:34.593105+0000","last_fullsized":"2023-11-04T01:36:34.593105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:36.996384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591659+0000","last_change":"2023-11-04T01:36:30.554726+0000","last_active":"2023-11-04T01:36:34.591659+0000","last_peered":"2023-11-04T01:36:34.591659+0000","last_clean":"2023-11-04T01:36:34.591659+0000","last_became_active":"2023-11-04T01:36:30.554463+0000","last_became_peered":"2023-11-04T01:36:30.554463+0000","last_unstale":"2023-11-04T01:36:34.591659+0000","last_undegraded":"2023-11-04T01:36:34.591659+0000","last_fullsized":"2023-11-04T01:36:34.591659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:29.259099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600433+0000","last_change":"2023-11-04T01:36:30.558538+0000","last_active":"2023-11-04T01:36:34.600433+0000","last_peered":"2023-11-04T01:36:34.600433+0000","last_clean":"2023-11-04T01:36:34.600433+0000","last_became_active":"2023-11-04T01:36:30.558255+0000","last_became_peered":"2023-11-04T01:36:30.558255+0000","last_unstale":"2023-11-04T01:36:34.600433+0000","last_undegraded":"2023-11-04T01:36:34.600433+0000","last_fullsized":"2023-11-04T01:36:34.600433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:26:24.912249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591246+0000","last_change":"2023-11-04T01:36:30.555242+0000","last_active":"2023-11-04T01:36:34.591246+0000","last_peered":"2023-11-04T01:36:34.591246+0000","last_clean":"2023-11-04T01:36:34.591246+0000","last_became_active":"2023-11-04T01:36:30.554999+0000","last_became_peered":"2023-11-04T01:36:30.554999+0000","last_unstale":"2023-11-04T01:36:34.591246+0000","last_undegraded":"2023-11-04T01:36:34.591246+0000","last_fullsized":"2023-11-04T01:36:34.591246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:37.615217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600436+0000","last_change":"2023-11-04T01:36:30.561171+0000","last_active":"2023-11-04T01:36:34.600436+0000","last_peered":"2023-11-04T01:36:34.600436+0000","last_clean":"2023-11-04T01:36:34.600436+0000","last_became_active":"2023-11-04T01:36:30.560077+0000","last_became_peered":"2023-11-04T01:36:30.560077+0000","last_unstale":"2023-11-04T01:36:34.600436+0000","last_undegraded":"2023-11-04T01:36:34.600436+0000","last_fullsized":"2023-11-04T01:36:34.600436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:53.928372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.602937+0000","last_change":"2023-11-04T01:36:30.559653+0000","last_active":"2023-11-04T01:36:34.602937+0000","last_peered":"2023-11-04T01:36:34.602937+0000","last_clean":"2023-11-04T01:36:34.602937+0000","last_became_active":"2023-11-04T01:36:30.559390+0000","last_became_peered":"2023-11-04T01:36:30.559390+0000","last_unstale":"2023-11-04T01:36:34.602937+0000","last_undegraded":"2023-11-04T01:36:34.602937+0000","last_fullsized":"2023-11-04T01:36:34.602937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:37.615217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592681+0000","last_change":"2023-11-04T01:36:30.553925+0000","last_active":"2023-11-04T01:36:34.592681+0000","last_peered":"2023-11-04T01:36:34.592681+0000","last_clean":"2023-11-04T01:36:34.592681+0000","last_became_active":"2023-11-04T01:36:30.553654+0000","last_became_peered":"2023-11-04T01:36:30.553654+0000","last_unstale":"2023-11-04T01:36:34.592681+0000","last_undegraded":"2023-11-04T01:36:34.592681+0000","last_fullsized":"2023-11-04T01:36:34.592681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752906+0000","last_change":"2023-11-04T01:36:30.557205+0000","last_active":"2023-11-04T01:36:34.752906+0000","last_peered":"2023-11-04T01:36:34.752906+0000","last_clean":"2023-11-04T01:36:34.752906+0000","last_became_active":"2023-11-04T01:36:30.556906+0000","last_became_peered":"2023-11-04T01:36:30.556906+0000","last_unstale":"2023-11-04T01:36:34.752906+0000","last_undegraded":"2023-11-04T01:36:34.752906+0000","last_fullsized":"2023-11-04T01:36:34.752906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:54:17.545215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603431+0000","last_change":"2023-11-04T01:36:30.548944+0000","last_active":"2023-11-04T01:36:34.603431+0000","last_peered":"2023-11-04T01:36:34.603431+0000","last_clean":"2023-11-04T01:36:34.603431+0000","last_became_active":"2023-11-04T01:36:30.548680+0000","last_became_peered":"2023-11-04T01:36:30.548680+0000","last_unstale":"2023-11-04T01:36:34.603431+0000","last_undegraded":"2023-11-04T01:36:34.603431+0000","last_fullsized":"2023-11-04T01:36:34.603431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:25.013535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601391+0000","last_change":"2023-11-04T01:36:30.560336+0000","last_active":"2023-11-04T01:36:34.601391+0000","last_peered":"2023-11-04T01:36:34.601391+0000","last_clean":"2023-11-04T01:36:34.601391+0000","last_became_active":"2023-11-04T01:36:30.559694+0000","last_became_peered":"2023-11-04T01:36:30.559694+0000","last_unstale":"2023-11-04T01:36:34.601391+0000","last_undegraded":"2023-11-04T01:36:34.601391+0000","last_fullsized":"2023-11-04T01:36:34.601391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:07.434851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600395+0000","last_change":"2023-11-04T01:36:30.553100+0000","last_active":"2023-11-04T01:36:34.600395+0000","last_peered":"2023-11-04T01:36:34.600395+0000","last_clean":"2023-11-04T01:36:34.600395+0000","last_became_active":"2023-11-04T01:36:30.552783+0000","last_became_peered":"2023-11-04T01:36:30.552783+0000","last_unstale":"2023-11-04T01:36:34.600395+0000","last_undegraded":"2023-11-04T01:36:34.600395+0000","last_fullsized":"2023-11-04T01:36:34.600395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597636+0000","last_change":"2023-11-04T01:36:30.549860+0000","last_active":"2023-11-04T01:36:34.597636+0000","last_peered":"2023-11-04T01:36:34.597636+0000","last_clean":"2023-11-04T01:36:34.597636+0000","last_became_active":"2023-11-04T01:36:30.549522+0000","last_became_peered":"2023-11-04T01:36:30.549522+0000","last_unstale":"2023-11-04T01:36:34.597636+0000","last_undegraded":"2023-11-04T01:36:34.597636+0000","last_fullsized":"2023-11-04T01:36:34.597636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:10.369120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601798+0000","last_change":"2023-11-04T01:36:30.550358+0000","last_active":"2023-11-04T01:36:34.601798+0000","last_peered":"2023-11-04T01:36:34.601798+0000","last_clean":"2023-11-04T01:36:34.601798+0000","last_became_active":"2023-11-04T01:36:30.550025+0000","last_became_peered":"2023-11-04T01:36:30.550025+0000","last_unstale":"2023-11-04T01:36:34.601798+0000","last_undegraded":"2023-11-04T01:36:34.601798+0000","last_fullsized":"2023-11-04T01:36:34.601798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:46:09.800453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590613+0000","last_change":"2023-11-04T01:36:30.552408+0000","last_active":"2023-11-04T01:36:34.590613+0000","last_peered":"2023-11-04T01:36:34.590613+0000","last_clean":"2023-11-04T01:36:34.590613+0000","last_became_active":"2023-11-04T01:36:30.552144+0000","last_became_peered":"2023-11-04T01:36:30.552144+0000","last_unstale":"2023-11-04T01:36:34.590613+0000","last_undegraded":"2023-11-04T01:36:34.590613+0000","last_fullsized":"2023-11-04T01:36:34.590613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:36.996384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592329+0000","last_change":"2023-11-04T01:36:30.551603+0000","last_active":"2023-11-04T01:36:34.592329+0000","last_peered":"2023-11-04T01:36:34.592329+0000","last_clean":"2023-11-04T01:36:34.592329+0000","last_became_active":"2023-11-04T01:36:30.551211+0000","last_became_peered":"2023-11-04T01:36:30.551211+0000","last_unstale":"2023-11-04T01:36:34.592329+0000","last_undegraded":"2023-11-04T01:36:34.592329+0000","last_fullsized":"2023-11-04T01:36:34.592329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:15:10.559940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593132+0000","last_change":"2023-11-04T01:36:30.557060+0000","last_active":"2023-11-04T01:36:34.593132+0000","last_peered":"2023-11-04T01:36:34.593132+0000","last_clean":"2023-11-04T01:36:34.593132+0000","last_became_active":"2023-11-04T01:36:30.556780+0000","last_became_peered":"2023-11-04T01:36:30.556780+0000","last_unstale":"2023-11-04T01:36:34.593132+0000","last_undegraded":"2023-11-04T01:36:34.593132+0000","last_fullsized":"2023-11-04T01:36:34.593132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:12.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593025+0000","last_change":"2023-11-04T01:36:30.557384+0000","last_active":"2023-11-04T01:36:34.593025+0000","last_peered":"2023-11-04T01:36:34.593025+0000","last_clean":"2023-11-04T01:36:34.593025+0000","last_became_active":"2023-11-04T01:36:30.556515+0000","last_became_peered":"2023-11-04T01:36:30.556515+0000","last_unstale":"2023-11-04T01:36:34.593025+0000","last_undegraded":"2023-11-04T01:36:34.593025+0000","last_fullsized":"2023-11-04T01:36:34.593025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:36.976993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752897+0000","last_change":"2023-11-04T01:36:30.558458+0000","last_active":"2023-11-04T01:36:34.752897+0000","last_peered":"2023-11-04T01:36:34.752897+0000","last_clean":"2023-11-04T01:36:34.752897+0000","last_became_active":"2023-11-04T01:36:30.558111+0000","last_became_peered":"2023-11-04T01:36:30.558111+0000","last_unstale":"2023-11-04T01:36:34.752897+0000","last_undegraded":"2023-11-04T01:36:34.752897+0000","last_fullsized":"2023-11-04T01:36:34.752897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:47.484051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590565+0000","last_change":"2023-11-04T01:36:30.558798+0000","last_active":"2023-11-04T01:36:34.590565+0000","last_peered":"2023-11-04T01:36:34.590565+0000","last_clean":"2023-11-04T01:36:34.590565+0000","last_became_active":"2023-11-04T01:36:30.558197+0000","last_became_peered":"2023-11-04T01:36:30.558197+0000","last_unstale":"2023-11-04T01:36:34.590565+0000","last_undegraded":"2023-11-04T01:36:34.590565+0000","last_fullsized":"2023-11-04T01:36:34.590565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:36.976993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752395+0000","last_change":"2023-11-04T01:36:30.556288+0000","last_active":"2023-11-04T01:36:34.752395+0000","last_peered":"2023-11-04T01:36:34.752395+0000","last_clean":"2023-11-04T01:36:34.752395+0000","last_became_active":"2023-11-04T01:36:30.556011+0000","last_became_peered":"2023-11-04T01:36:30.556011+0000","last_unstale":"2023-11-04T01:36:34.752395+0000","last_undegraded":"2023-11-04T01:36:34.752395+0000","last_fullsized":"2023-11-04T01:36:34.752395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:50.307002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600393+0000","last_change":"2023-11-04T01:36:30.556023+0000","last_active":"2023-11-04T01:36:34.600393+0000","last_peered":"2023-11-04T01:36:34.600393+0000","last_clean":"2023-11-04T01:36:34.600393+0000","last_became_active":"2023-11-04T01:36:30.555394+0000","last_became_peered":"2023-11-04T01:36:30.555394+0000","last_unstale":"2023-11-04T01:36:34.600393+0000","last_undegraded":"2023-11-04T01:36:34.600393+0000","last_fullsized":"2023-11-04T01:36:34.600393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.045633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752224+0000","last_change":"2023-11-04T01:36:30.555404+0000","last_active":"2023-11-04T01:36:34.752224+0000","last_peered":"2023-11-04T01:36:34.752224+0000","last_clean":"2023-11-04T01:36:34.752224+0000","last_became_active":"2023-11-04T01:36:30.555125+0000","last_became_peered":"2023-11-04T01:36:30.555125+0000","last_unstale":"2023-11-04T01:36:34.752224+0000","last_undegraded":"2023-11-04T01:36:34.752224+0000","last_fullsized":"2023-11-04T01:36:34.752224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:05.575722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600734+0000","last_change":"2023-11-04T01:36:30.559120+0000","last_active":"2023-11-04T01:36:34.600734+0000","last_peered":"2023-11-04T01:36:34.600734+0000","last_clean":"2023-11-04T01:36:34.600734+0000","last_became_active":"2023-11-04T01:36:30.558412+0000","last_became_peered":"2023-11-04T01:36:30.558412+0000","last_unstale":"2023-11-04T01:36:34.600734+0000","last_undegraded":"2023-11-04T01:36:34.600734+0000","last_fullsized":"2023-11-04T01:36:34.600734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:29.259099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601077+0000","last_change":"2023-11-04T01:36:30.552546+0000","last_active":"2023-11-04T01:36:34.601077+0000","last_peered":"2023-11-04T01:36:34.601077+0000","last_clean":"2023-11-04T01:36:34.601077+0000","last_became_active":"2023-11-04T01:36:30.551809+0000","last_became_peered":"2023-11-04T01:36:30.551809+0000","last_unstale":"2023-11-04T01:36:34.601077+0000","last_undegraded":"2023-11-04T01:36:34.601077+0000","last_fullsized":"2023-11-04T01:36:34.601077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:12.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597814+0000","last_change":"2023-11-04T01:36:30.554657+0000","last_active":"2023-11-04T01:36:34.597814+0000","last_peered":"2023-11-04T01:36:34.597814+0000","last_clean":"2023-11-04T01:36:34.597814+0000","last_became_active":"2023-11-04T01:36:30.554335+0000","last_became_peered":"2023-11-04T01:36:30.554335+0000","last_unstale":"2023-11-04T01:36:34.597814+0000","last_undegraded":"2023-11-04T01:36:34.597814+0000","last_fullsized":"2023-11-04T01:36:34.597814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.045633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752772+0000","last_change":"2023-11-04T01:36:30.557755+0000","last_active":"2023-11-04T01:36:34.752772+0000","last_peered":"2023-11-04T01:36:34.752772+0000","last_clean":"2023-11-04T01:36:34.752772+0000","last_became_active":"2023-11-04T01:36:30.557432+0000","last_became_peered":"2023-11-04T01:36:30.557432+0000","last_unstale":"2023-11-04T01:36:34.752772+0000","last_undegraded":"2023-11-04T01:36:34.752772+0000","last_fullsized":"2023-11-04T01:36:34.752772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:55:41.729195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4498,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":690798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:36:48.923 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:36:48.923 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-04T01:36:48.923 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-04T01:36:48.924 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-04T01:36:48.924 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-04T01:36:49.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.055+0000 7fdfca19e640 1 Processor -- start 2023-11-04T01:36:49.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.055+0000 7fdfca19e640 1 -- start start 2023-11-04T01:36:49.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.056+0000 7fdfca19e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfc40c9f70 0x7fdfc40b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.056+0000 7fdfca19e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc415e630 con 0x7fdfc40cced0 2023-11-04T01:36:49.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.056+0000 7fdfca19e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc40cab60 con 0x7fdfc415e250 2023-11-04T01:36:49.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.056+0000 7fdfca19e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc40b1790 con 0x7fdfc40c9f70 2023-11-04T01:36:49.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.056+0000 7fdfc899b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdfc40cced0 0x7fdfc40b28e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41074/0 (socket says 172.21.15.114:41074) 2023-11-04T01:36:49.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.056+0000 7fdfc899b640 1 -- 172.21.15.114:0/612823369 learned_addr learned my addr 172.21.15.114:0/612823369 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:49.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.057+0000 7fdfc999d640 1 --2- 172.21.15.114:0/612823369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfc40c9f70 0x7fdfc40b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.057+0000 7fdfbbfff640 1 -- 172.21.15.114:0/612823369 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325409910 0 0) 0x7fdfc415e630 con 0x7fdfc40cced0 2023-11-04T01:36:49.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.057+0000 7fdfbbfff640 1 -- 172.21.15.114:0/612823369 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb0003520 con 0x7fdfc40cced0 2023-11-04T01:36:49.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.057+0000 7fdfbbfff640 1 -- 172.21.15.114:0/612823369 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845327457 0 0) 0x7fdfc40cab60 con 0x7fdfc415e250 2023-11-04T01:36:49.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.057+0000 7fdfbbfff640 1 -- 172.21.15.114:0/612823369 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc415e630 con 0x7fdfc415e250 2023-11-04T01:36:49.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.057+0000 7fdfc999d640 1 -- 172.21.15.114:0/612823369 >> v1:172.21.15.141:6789/0 conn(0x7fdfc415e250 legacy=0x7fdfc40cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.057+0000 7fdfc999d640 1 -- 172.21.15.114:0/612823369 >> v1:172.21.15.114:6789/0 conn(0x7fdfc40cced0 legacy=0x7fdfc40b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.057+0000 7fdfc999d640 1 -- 172.21.15.114:0/612823369 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc40b1a70 con 0x7fdfc40c9f70 2023-11-04T01:36:49.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.058+0000 7fdfc999d640 1 --2- 172.21.15.114:0/612823369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfc40c9f70 0x7fdfc40b2ff0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0097d0 tx=0x7fdfbc02b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b94ff74cfcacae88 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.058+0000 7fdfbbfff640 1 -- 172.21.15.114:0/612823369 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc030880 con 0x7fdfc40c9f70 2023-11-04T01:36:49.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.058+0000 7fdfbbfff640 1 -- 172.21.15.114:0/612823369 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc0309e0 con 0x7fdfc40c9f70 2023-11-04T01:36:49.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.058+0000 7fdfbbfff640 1 -- 172.21.15.114:0/612823369 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc030d70 con 0x7fdfc40c9f70 2023-11-04T01:36:49.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.058+0000 7fdfca19e640 1 -- 172.21.15.114:0/612823369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfc40c9f70 msgr2=0x7fdfc40b2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.058+0000 7fdfca19e640 1 --2- 172.21.15.114:0/612823369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfc40c9f70 0x7fdfc40b2ff0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0097d0 tx=0x7fdfbc02b9c0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.058+0000 7fdfca19e640 1 -- 172.21.15.114:0/612823369 shutdown_connections 2023-11-04T01:36:49.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.058+0000 7fdfca19e640 1 --2- 172.21.15.114:0/612823369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfc40c9f70 0x7fdfc40b2ff0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.058+0000 7fdfca19e640 1 -- 172.21.15.114:0/612823369 >> 172.21.15.114:0/612823369 conn(0x7fdfc406b620 msgr2=0x7fdfc406ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:49.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.058+0000 7fdfca19e640 1 -- 172.21.15.114:0/612823369 shutdown_connections 2023-11-04T01:36:49.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.058+0000 7fdfca19e640 1 -- 172.21.15.114:0/612823369 wait complete. 2023-11-04T01:36:49.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.060+0000 7fdfca19e640 1 Processor -- start 2023-11-04T01:36:49.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.060+0000 7fdfca19e640 1 -- start start 2023-11-04T01:36:49.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfca19e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfc40c9f70 0x7fdfc40c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfca19e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc40cced0 0x7fdfc41f4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfca19e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfc415e250 0x7fdfc41f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfca19e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41f11d0 con 0x7fdfc40cced0 2023-11-04T01:36:49.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfca19e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41f4d90 con 0x7fdfc415e250 2023-11-04T01:36:49.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfca19e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc40c9600 con 0x7fdfc40c9f70 2023-11-04T01:36:49.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfc899b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc40cced0 0x7fdfc41f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfc899b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc40cced0 0x7fdfc41f4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49062/0 (socket says 172.21.15.114:49062) 2023-11-04T01:36:49.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfc899b640 1 -- 172.21.15.114:0/2701993801 learned_addr learned my addr 172.21.15.114:0/2701993801 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:49.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfc999d640 1 --2- 172.21.15.114:0/2701993801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfc415e250 0x7fdfc41f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfc919c640 1 --2- 172.21.15.114:0/2701993801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfc40c9f70 0x7fdfc40c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfc899b640 1 -- 172.21.15.114:0/2701993801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfc40c9f70 msgr2=0x7fdfc40c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfc899b640 1 --2- 172.21.15.114:0/2701993801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfc40c9f70 0x7fdfc40c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfc899b640 1 -- 172.21.15.114:0/2701993801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfc415e250 msgr2=0x7fdfc41f0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfc899b640 1 --2- 172.21.15.114:0/2701993801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfc415e250 0x7fdfc41f0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfc899b640 1 -- 172.21.15.114:0/2701993801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc009400 con 0x7fdfc40cced0 2023-11-04T01:36:49.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfc999d640 1 --2- 172.21.15.114:0/2701993801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfc415e250 0x7fdfc41f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:49.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfc919c640 1 --2- 172.21.15.114:0/2701993801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfc40c9f70 0x7fdfc40c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:49.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfc899b640 1 --2- 172.21.15.114:0/2701993801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc40cced0 0x7fdfc41f4850 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400c500 tx=0x7fdfb400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfb9ffb640 1 -- 172.21.15.114:0/2701993801 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4005ce0 con 0x7fdfc40cced0 2023-11-04T01:36:49.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfb9ffb640 1 -- 172.21.15.114:0/2701993801 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb4005e40 con 0x7fdfc40cced0 2023-11-04T01:36:49.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfca19e640 1 -- 172.21.15.114:0/2701993801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc41f0b10 con 0x7fdfc40cced0 2023-11-04T01:36:49.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.061+0000 7fdfb9ffb640 1 -- 172.21.15.114:0/2701993801 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40072f0 con 0x7fdfc40cced0 2023-11-04T01:36:49.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.062+0000 7fdfca19e640 1 -- 172.21.15.114:0/2701993801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc41f15f0 con 0x7fdfc40cced0 2023-11-04T01:36:49.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.062+0000 7fdfca19e640 1 -- 172.21.15.114:0/2701993801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc41f1310 con 0x7fdfc40cced0 2023-11-04T01:36:49.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.063+0000 7fdfb9ffb640 1 -- 172.21.15.114:0/2701993801 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdfb4007450 con 0x7fdfc40cced0 2023-11-04T01:36:49.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.063+0000 7fdfb9ffb640 1 --2- 172.21.15.114:0/2701993801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdfa806ae70 0x7fdfa806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.063+0000 7fdfb9ffb640 1 -- 172.21.15.114:0/2701993801 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdfb4088d90 con 0x7fdfc40cced0 2023-11-04T01:36:49.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.063+0000 7fdfc919c640 1 --2- 172.21.15.114:0/2701993801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdfa806ae70 0x7fdfa806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.064+0000 7fdfc919c640 1 --2- 172.21.15.114:0/2701993801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdfa806ae70 0x7fdfa806d330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0001560 tx=0x7fdfc0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.067+0000 7fdfb9ffb640 1 -- 172.21.15.114:0/2701993801 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdfc41f1310 con 0x7fdfc40cced0 2023-11-04T01:36:49.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.277+0000 7fdfca19e640 1 -- 172.21.15.114:0/2701993801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdfc41f1310 con 0x7fdfc40cced0 2023-11-04T01:36:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.280+0000 7fdfb9ffb640 1 -- 172.21.15.114:0/2701993801 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171038 (secure 0 0 0) 0x7fdfc41f1310 con 0x7fdfc40cced0 2023-11-04T01:36:49.284 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:49.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.282+0000 7fdfca19e640 1 -- 172.21.15.114:0/2701993801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdfa806ae70 msgr2=0x7fdfa806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.282+0000 7fdfca19e640 1 --2- 172.21.15.114:0/2701993801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdfa806ae70 0x7fdfa806d330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0001560 tx=0x7fdfc0009040 comp rx=0 tx=0).stop 2023-11-04T01:36:49.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.282+0000 7fdfca19e640 1 -- 172.21.15.114:0/2701993801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc40cced0 msgr2=0x7fdfc41f4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.282+0000 7fdfca19e640 1 --2- 172.21.15.114:0/2701993801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc40cced0 0x7fdfc41f4850 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400c500 tx=0x7fdfb400c9c0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.282+0000 7fdfca19e640 1 -- 172.21.15.114:0/2701993801 shutdown_connections 2023-11-04T01:36:49.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.282+0000 7fdfca19e640 1 --2- 172.21.15.114:0/2701993801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdfa806ae70 0x7fdfa806d330 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.282+0000 7fdfca19e640 1 --2- 172.21.15.114:0/2701993801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdfc415e250 0x7fdfc41f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.282+0000 7fdfca19e640 1 --2- 172.21.15.114:0/2701993801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc40cced0 0x7fdfc41f4850 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.282+0000 7fdfca19e640 1 --2- 172.21.15.114:0/2701993801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdfc40c9f70 0x7fdfc40c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.282+0000 7fdfca19e640 1 -- 172.21.15.114:0/2701993801 >> 172.21.15.114:0/2701993801 conn(0x7fdfc406b620 msgr2=0x7fdfc415d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:49.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.282+0000 7fdfca19e640 1 -- 172.21.15.114:0/2701993801 shutdown_connections 2023-11-04T01:36:49.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.282+0000 7fdfca19e640 1 -- 172.21.15.114:0/2701993801 wait complete. 2023-11-04T01:36:49.295 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":5,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1641722674},{"type":"v1","addr":"172.21.15.114:6833","nonce":1641722674}]},"active_addr":"172.21.15.114:6833/1641722674","active_change":"2023-11-04T01:36:09.848379+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":1001544740}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":325401848}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":3070511989}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":2820795490}]}]} 2023-11-04T01:36:49.298 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-04T01:36:49.298 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-04T01:36:49.298 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:49.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.397+0000 7f3571210640 1 Processor -- start 2023-11-04T01:36:49.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.398+0000 7f3571210640 1 -- start start 2023-11-04T01:36:49.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.398+0000 7f3571210640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f356c0cc870 0x7f356c0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.398+0000 7f3571210640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356c0cd690 con 0x7f356c0cc430 2023-11-04T01:36:49.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.398+0000 7f3571210640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356c0cd970 con 0x7f356c159da0 2023-11-04T01:36:49.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.398+0000 7f3571210640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356c0cdc50 con 0x7f356c0cc870 2023-11-04T01:36:49.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.398+0000 7f356b59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f356c0cc870 0x7f356c0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.399+0000 7f356b59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f356c0cc870 0x7f356c0cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49076/0 (socket says 172.21.15.114:49076) 2023-11-04T01:36:49.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.399+0000 7f356b59e640 1 -- 172.21.15.114:0/3276076397 learned_addr learned my addr 172.21.15.114:0/3276076397 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:49.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.399+0000 7f356b59e640 1 -- 172.21.15.114:0/3276076397 >> v1:172.21.15.141:6789/0 conn(0x7f356c159da0 legacy=0x7f356c0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.399+0000 7f356b59e640 1 -- 172.21.15.114:0/3276076397 >> v1:172.21.15.114:6789/0 conn(0x7f356c0cc430 legacy=0x7f356c0ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.399+0000 7f356b59e640 1 -- 172.21.15.114:0/3276076397 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c0cdf30 con 0x7f356c0cc870 2023-11-04T01:36:49.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.400+0000 7f356b59e640 1 --2- 172.21.15.114:0/3276076397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356c0cc870 0x7f356c0cee40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3564009e50 tx=0x7f356402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32395223d9d2c8a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.400+0000 7f3569d9b640 1 -- 172.21.15.114:0/3276076397 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356402cbb0 con 0x7f356c0cc870 2023-11-04T01:36:49.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.400+0000 7f3569d9b640 1 -- 172.21.15.114:0/3276076397 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356402cd10 con 0x7f356c0cc870 2023-11-04T01:36:49.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.400+0000 7f3569d9b640 1 -- 172.21.15.114:0/3276076397 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564034610 con 0x7f356c0cc870 2023-11-04T01:36:49.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.400+0000 7f3571210640 1 -- 172.21.15.114:0/3276076397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356c0cc870 msgr2=0x7f356c0cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.400+0000 7f3571210640 1 --2- 172.21.15.114:0/3276076397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356c0cc870 0x7f356c0cee40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3564009e50 tx=0x7f356402c010 comp rx=0 tx=0).stop 2023-11-04T01:36:49.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.400+0000 7f3571210640 1 -- 172.21.15.114:0/3276076397 shutdown_connections 2023-11-04T01:36:49.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.400+0000 7f3571210640 1 --2- 172.21.15.114:0/3276076397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356c0cc870 0x7f356c0cee40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.400+0000 7f3571210640 1 -- 172.21.15.114:0/3276076397 >> 172.21.15.114:0/3276076397 conn(0x7f356c06d8b0 msgr2=0x7f356c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:49.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.400+0000 7f3571210640 1 -- 172.21.15.114:0/3276076397 shutdown_connections 2023-11-04T01:36:49.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.400+0000 7f3571210640 1 -- 172.21.15.114:0/3276076397 wait complete. 2023-11-04T01:36:49.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.402+0000 7f3571210640 1 Processor -- start 2023-11-04T01:36:49.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.402+0000 7f3571210640 1 -- start start 2023-11-04T01:36:49.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.402+0000 7f3571210640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f356c0cc430 0x7f356c1f4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f3571210640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356c0cc870 0x7f356c0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f3571210640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f356c159da0 0x7f356c0b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f3571210640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c1f12e0 con 0x7f356c0cc870 2023-11-04T01:36:49.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f3571210640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c1f0d20 con 0x7f356c159da0 2023-11-04T01:36:49.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f3571210640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c1f1000 con 0x7f356c0cc430 2023-11-04T01:36:49.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f356a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356c0cc870 0x7f356c0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f356a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356c0cc870 0x7f356c0b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49078/0 (socket says 172.21.15.114:49078) 2023-11-04T01:36:49.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f356a59c640 1 -- 172.21.15.114:0/1959050724 learned_addr learned my addr 172.21.15.114:0/1959050724 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:49.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f356b59e640 1 --2- 172.21.15.114:0/1959050724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f356c159da0 0x7f356c0b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f356ad9d640 1 --2- 172.21.15.114:0/1959050724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f356c0cc430 0x7f356c1f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f356a59c640 1 -- 172.21.15.114:0/1959050724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f356c0cc430 msgr2=0x7f356c1f4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f356a59c640 1 --2- 172.21.15.114:0/1959050724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f356c0cc430 0x7f356c1f4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f356a59c640 1 -- 172.21.15.114:0/1959050724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f356c159da0 msgr2=0x7f356c0b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f356a59c640 1 --2- 172.21.15.114:0/1959050724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f356c159da0 0x7f356c0b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f356a59c640 1 -- 172.21.15.114:0/1959050724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3564009b30 con 0x7f356c0cc870 2023-11-04T01:36:49.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f356b59e640 1 --2- 172.21.15.114:0/1959050724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f356c159da0 0x7f356c0b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:49.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f356a59c640 1 --2- 172.21.15.114:0/1959050724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356c0cc870 0x7f356c0b1690 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f356000c450 tx=0x7f356000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f35537fe640 1 -- 172.21.15.114:0/1959050724 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35600052d0 con 0x7f356c0cc870 2023-11-04T01:36:49.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f35537fe640 1 -- 172.21.15.114:0/1959050724 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3560005430 con 0x7f356c0cc870 2023-11-04T01:36:49.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f35537fe640 1 -- 172.21.15.114:0/1959050724 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3560012870 con 0x7f356c0cc870 2023-11-04T01:36:49.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f3571210640 1 -- 172.21.15.114:0/1959050724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356c1f3a40 con 0x7f356c0cc870 2023-11-04T01:36:49.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.403+0000 7f3571210640 1 -- 172.21.15.114:0/1959050724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356c1f4780 con 0x7f356c0cc870 2023-11-04T01:36:49.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.404+0000 7f3571210640 1 -- 172.21.15.114:0/1959050724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356c1f3f60 con 0x7f356c0cc870 2023-11-04T01:36:49.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.405+0000 7f35537fe640 1 -- 172.21.15.114:0/1959050724 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f35600129d0 con 0x7f356c0cc870 2023-11-04T01:36:49.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.405+0000 7f35537fe640 1 --2- 172.21.15.114:0/1959050724 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f355806ae70 0x7f355806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.406+0000 7f35537fe640 1 -- 172.21.15.114:0/1959050724 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f35600893b0 con 0x7f356c0cc870 2023-11-04T01:36:49.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.406+0000 7f356ad9d640 1 --2- 172.21.15.114:0/1959050724 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f355806ae70 0x7f355806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.406+0000 7f356ad9d640 1 --2- 172.21.15.114:0/1959050724 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f355806ae70 0x7f355806d330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f355c000f60 tx=0x7f355c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.410+0000 7f35537fe640 1 -- 172.21.15.114:0/1959050724 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f356c1f3f60 con 0x7f356c0cc870 2023-11-04T01:36:49.548 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:36:49.553 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:36:49.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.585+0000 7f3571210640 1 -- 172.21.15.114:0/1959050724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f356c1f3f60 con 0x7f356c0cc870 2023-11-04T01:36:49.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.586+0000 7f35537fe640 1 -- 172.21.15.114:0/1959050724 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18406 (secure 0 0 0) 0x7f356c1f3f60 con 0x7f356c0cc870 2023-11-04T01:36:49.589 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:49.590 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:34.950923+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:49.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.588+0000 7f3571210640 1 -- 172.21.15.114:0/1959050724 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f355806ae70 msgr2=0x7f355806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.588+0000 7f3571210640 1 --2- 172.21.15.114:0/1959050724 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f355806ae70 0x7f355806d330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f355c000f60 tx=0x7f355c009040 comp rx=0 tx=0).stop 2023-11-04T01:36:49.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.588+0000 7f3571210640 1 -- 172.21.15.114:0/1959050724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356c0cc870 msgr2=0x7f356c0b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.588+0000 7f3571210640 1 --2- 172.21.15.114:0/1959050724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356c0cc870 0x7f356c0b1690 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f356000c450 tx=0x7f356000c910 comp rx=0 tx=0).stop 2023-11-04T01:36:49.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.588+0000 7f3571210640 1 -- 172.21.15.114:0/1959050724 shutdown_connections 2023-11-04T01:36:49.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.588+0000 7f3571210640 1 --2- 172.21.15.114:0/1959050724 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f355806ae70 0x7f355806d330 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.588+0000 7f3571210640 1 --2- 172.21.15.114:0/1959050724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f356c159da0 0x7f356c0b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.588+0000 7f3571210640 1 --2- 172.21.15.114:0/1959050724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356c0cc870 0x7f356c0b1690 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.588+0000 7f3571210640 1 --2- 172.21.15.114:0/1959050724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f356c0cc430 0x7f356c1f4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.588+0000 7f3571210640 1 -- 172.21.15.114:0/1959050724 >> 172.21.15.114:0/1959050724 conn(0x7f356c06d8b0 msgr2=0x7f356c0b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:49.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.588+0000 7f3571210640 1 -- 172.21.15.114:0/1959050724 shutdown_connections 2023-11-04T01:36:49.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.588+0000 7f3571210640 1 -- 172.21.15.114:0/1959050724 wait complete. 2023-11-04T01:36:49.602 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-04T01:36:49.603 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:49.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.758+0000 7f63e9c34640 1 Processor -- start 2023-11-04T01:36:49.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.758+0000 7f63e9c34640 1 -- start start 2023-11-04T01:36:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.759+0000 7f63e9c34640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63e4159fb0 0x7f63e40aef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.759+0000 7f63e9c34640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f63e40cb840 0x7f63e40cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.759+0000 7f63e9c34640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e415a390 con 0x7f63e40b14f0 2023-11-04T01:36:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.759+0000 7f63e9c34640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e40cb3b0 con 0x7f63e40cb840 2023-11-04T01:36:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.759+0000 7f63e9c34640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e40ceb60 con 0x7f63e4159fb0 2023-11-04T01:36:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.759+0000 7f63e2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f63e40cb840 0x7f63e40cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.759+0000 7f63e2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f63e40cb840 0x7f63e40cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49082/0 (socket says 172.21.15.114:49082) 2023-11-04T01:36:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.759+0000 7f63e2ffd640 1 -- 172.21.15.114:0/408369511 learned_addr learned my addr 172.21.15.114:0/408369511 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.759+0000 7f63e37fe640 1 --2- 172.21.15.114:0/408369511 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63e4159fb0 0x7f63e40aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.759+0000 7f63e2ffd640 1 -- 172.21.15.114:0/408369511 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63e4159fb0 msgr2=0x7f63e40aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.759+0000 7f63e2ffd640 1 --2- 172.21.15.114:0/408369511 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63e4159fb0 0x7f63e40aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.759+0000 7f63e2ffd640 1 -- 172.21.15.114:0/408369511 >> v1:172.21.15.114:6789/0 conn(0x7f63e40b14f0 legacy=0x7f63e415da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.759+0000 7f63e2ffd640 1 -- 172.21.15.114:0/408369511 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e40caa80 con 0x7f63e40cb840 2023-11-04T01:36:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.760+0000 7f63e2ffd640 1 --2- 172.21.15.114:0/408369511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63e40cb840 0x7f63e40cd7c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009850 tx=0x7f63d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f14837d9b38f4f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.760+0000 7f63e27fc640 1 -- 172.21.15.114:0/408369511 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8004230 con 0x7f63e40cb840 2023-11-04T01:36:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.760+0000 7f63e27fc640 1 -- 172.21.15.114:0/408369511 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d8004390 con 0x7f63e40cb840 2023-11-04T01:36:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.760+0000 7f63e27fc640 1 -- 172.21.15.114:0/408369511 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8031830 con 0x7f63e40cb840 2023-11-04T01:36:49.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.761+0000 7f63e9c34640 1 -- 172.21.15.114:0/408369511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63e40cb840 msgr2=0x7f63e40cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.761+0000 7f63e9c34640 1 --2- 172.21.15.114:0/408369511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63e40cb840 0x7f63e40cd7c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009850 tx=0x7f63d802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.761+0000 7f63e9c34640 1 -- 172.21.15.114:0/408369511 shutdown_connections 2023-11-04T01:36:49.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.761+0000 7f63e9c34640 1 --2- 172.21.15.114:0/408369511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63e40cb840 0x7f63e40cd7c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.761+0000 7f63e9c34640 1 --2- 172.21.15.114:0/408369511 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63e4159fb0 0x7f63e40aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.761+0000 7f63e9c34640 1 -- 172.21.15.114:0/408369511 >> 172.21.15.114:0/408369511 conn(0x7f63e4098d40 msgr2=0x7f63e40cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:49.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.761+0000 7f63e9c34640 1 -- 172.21.15.114:0/408369511 shutdown_connections 2023-11-04T01:36:49.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.761+0000 7f63e9c34640 1 -- 172.21.15.114:0/408369511 wait complete. 2023-11-04T01:36:49.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.762+0000 7f63e9c34640 1 Processor -- start 2023-11-04T01:36:49.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.762+0000 7f63e9c34640 1 -- start start 2023-11-04T01:36:49.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e9c34640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63e40b14f0 0x7f63e4150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e9c34640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63e40cb840 0x7f63e414fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e9c34640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63e4159fb0 0x7f63e40c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e9c34640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e40c3d00 con 0x7f63e40b14f0 2023-11-04T01:36:49.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e9c34640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e40c4660 con 0x7f63e40cb840 2023-11-04T01:36:49.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e9c34640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e40c5810 con 0x7f63e4159fb0 2023-11-04T01:36:49.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63e40b14f0 0x7f63e4150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63e40b14f0 0x7f63e4150270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49090/0 (socket says 172.21.15.114:49090) 2023-11-04T01:36:49.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e37fe640 1 -- 172.21.15.114:0/907467590 learned_addr learned my addr 172.21.15.114:0/907467590 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:49.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e3fff640 1 --2- 172.21.15.114:0/907467590 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63e4159fb0 0x7f63e40c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e2ffd640 1 --2- 172.21.15.114:0/907467590 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63e40cb840 0x7f63e414fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e37fe640 1 -- 172.21.15.114:0/907467590 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63e4159fb0 msgr2=0x7f63e40c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e37fe640 1 --2- 172.21.15.114:0/907467590 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63e4159fb0 0x7f63e40c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e37fe640 1 -- 172.21.15.114:0/907467590 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63e40cb840 msgr2=0x7f63e414fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e37fe640 1 --2- 172.21.15.114:0/907467590 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63e40cb840 0x7f63e414fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e37fe640 1 -- 172.21.15.114:0/907467590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d8009460 con 0x7f63e40b14f0 2023-11-04T01:36:49.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.763+0000 7f63e37fe640 1 --2- 172.21.15.114:0/907467590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63e40b14f0 0x7f63e4150270 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f63d400e960 tx=0x7f63d400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.764+0000 7f63cbfff640 1 -- 172.21.15.114:0/907467590 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4009660 con 0x7f63e40b14f0 2023-11-04T01:36:49.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.764+0000 7f63cbfff640 1 -- 172.21.15.114:0/907467590 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d400ca00 con 0x7f63e40b14f0 2023-11-04T01:36:49.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.764+0000 7f63e9c34640 1 -- 172.21.15.114:0/907467590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e40c5530 con 0x7f63e40b14f0 2023-11-04T01:36:49.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.764+0000 7f63cbfff640 1 -- 172.21.15.114:0/907467590 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d400cd70 con 0x7f63e40b14f0 2023-11-04T01:36:49.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.764+0000 7f63e9c34640 1 -- 172.21.15.114:0/907467590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e40c3920 con 0x7f63e40b14f0 2023-11-04T01:36:49.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.765+0000 7f63e9c34640 1 -- 172.21.15.114:0/907467590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e40c3f70 con 0x7f63e40b14f0 2023-11-04T01:36:49.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.765+0000 7f63cbfff640 1 -- 172.21.15.114:0/907467590 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f63d4013470 con 0x7f63e40b14f0 2023-11-04T01:36:49.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.766+0000 7f63cbfff640 1 --2- 172.21.15.114:0/907467590 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f63d006ae70 0x7f63d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:49.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.766+0000 7f63e2ffd640 1 --2- 172.21.15.114:0/907467590 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f63d006ae70 0x7f63d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:49.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.766+0000 7f63cbfff640 1 -- 172.21.15.114:0/907467590 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f63d4089d70 con 0x7f63e40b14f0 2023-11-04T01:36:49.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.766+0000 7f63e2ffd640 1 --2- 172.21.15.114:0/907467590 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f63d006ae70 0x7f63d006d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f63d8035000 tx=0x7f63d8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:49.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.770+0000 7f63cbfff640 1 -- 172.21.15.114:0/907467590 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f63d4054c70 con 0x7f63e40b14f0 2023-11-04T01:36:49.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.946+0000 7f63e9c34640 1 -- 172.21.15.114:0/907467590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63e4074290 con 0x7f63e40b14f0 2023-11-04T01:36:49.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.947+0000 7f63cbfff640 1 -- 172.21.15.114:0/907467590 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18406 (secure 0 0 0) 0x7f63d4021090 con 0x7f63e40b14f0 2023-11-04T01:36:49.951 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:49.951 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:34.950923+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:49.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.949+0000 7f63e9c34640 1 -- 172.21.15.114:0/907467590 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f63d006ae70 msgr2=0x7f63d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.949+0000 7f63e9c34640 1 --2- 172.21.15.114:0/907467590 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f63d006ae70 0x7f63d006d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f63d8035000 tx=0x7f63d8008030 comp rx=0 tx=0).stop 2023-11-04T01:36:49.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.949+0000 7f63e9c34640 1 -- 172.21.15.114:0/907467590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63e40b14f0 msgr2=0x7f63e4150270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:49.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.949+0000 7f63e9c34640 1 --2- 172.21.15.114:0/907467590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63e40b14f0 0x7f63e4150270 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f63d400e960 tx=0x7f63d400ee20 comp rx=0 tx=0).stop 2023-11-04T01:36:49.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.949+0000 7f63e9c34640 1 -- 172.21.15.114:0/907467590 shutdown_connections 2023-11-04T01:36:49.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.949+0000 7f63e9c34640 1 --2- 172.21.15.114:0/907467590 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63e4159fb0 0x7f63e40c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.949+0000 7f63e9c34640 1 --2- 172.21.15.114:0/907467590 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f63d006ae70 0x7f63d006d330 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.949+0000 7f63e9c34640 1 --2- 172.21.15.114:0/907467590 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63e40cb840 0x7f63e414fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.949+0000 7f63e9c34640 1 --2- 172.21.15.114:0/907467590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63e40b14f0 0x7f63e4150270 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:49.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.949+0000 7f63e9c34640 1 -- 172.21.15.114:0/907467590 >> 172.21.15.114:0/907467590 conn(0x7f63e4098d40 msgr2=0x7f63e40ac5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:49.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.949+0000 7f63e9c34640 1 -- 172.21.15.114:0/907467590 shutdown_connections 2023-11-04T01:36:49.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:49.949+0000 7f63e9c34640 1 -- 172.21.15.114:0/907467590 wait complete. 2023-11-04T01:36:49.964 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-04T01:36:49.964 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-04T01:36:49.964 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-04T01:36:49.965 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-04T01:36:49.965 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-04T01:36:49.966 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-04T01:36:49.966 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-04T01:36:49.966 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-04T01:36:50.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.138+0000 7faa45044640 1 Processor -- start 2023-11-04T01:36:50.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.138+0000 7faa45044640 1 -- start start 2023-11-04T01:36:50.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.136+0000 7f0df5d3c640 1 Processor -- start 2023-11-04T01:36:50.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.136+0000 7f0df5d3c640 1 -- start start 2023-11-04T01:36:50.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.138+0000 7f0df5d3c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0df014a6a0 0x7f0df00cad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.138+0000 7f0df5d3c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0df0164db0 0x7f0df01651f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.139+0000 7faa3ed9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7faa40158c80 0x7faa400ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41090/0 (socket says 172.21.15.114:41090) 2023-11-04T01:36:50.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.139+0000 7faa3ed9d640 1 -- 172.21.15.114:0/3364710352 learned_addr learned my addr 172.21.15.114:0/3364710352 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:50.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.138+0000 7f0df5d3c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df014aa80 con 0x7f0df00cb5b0 2023-11-04T01:36:50.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.138+0000 7f0df5d3c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df00cb290 con 0x7f0df0164db0 2023-11-04T01:36:50.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.138+0000 7f0df5d3c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df0165900 con 0x7f0df014a6a0 2023-11-04T01:36:50.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.138+0000 7f0deeffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0df0164db0 0x7f0df01651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.138+0000 7f0deeffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0df0164db0 0x7f0df01651f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49096/0 (socket says 172.21.15.114:49096) 2023-11-04T01:36:50.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.138+0000 7f0deeffd640 1 -- 172.21.15.114:0/2684865825 learned_addr learned my addr 172.21.15.114:0/2684865825 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.139+0000 7f0deeffd640 1 -- 172.21.15.114:0/2684865825 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0df014a6a0 msgr2=0x7f0df00cad50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:36:50.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.139+0000 7f0deeffd640 1 --2- 172.21.15.114:0/2684865825 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0df014a6a0 0x7f0df00cad50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.139+0000 7f0deeffd640 1 -- 172.21.15.114:0/2684865825 >> v1:172.21.15.141:6789/0 conn(0x7f0df00cb5b0 legacy=0x7f0df00cc520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:36:50.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.139+0000 7f0deeffd640 1 -- 172.21.15.114:0/2684865825 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df0165be0 con 0x7f0df0164db0 2023-11-04T01:36:50.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.140+0000 7faa45044640 1 --2- 172.21.15.114:0/3364710352 >> v2:172.21.15.141:3300/0 conn(0x7faa40159060 0x7faa400cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.140+0000 7f0deeffd640 1 --2- 172.21.15.114:0/2684865825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df0164db0 0x7f0df01651f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009870 tx=0x7f0dd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8b4a3f9145061e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.140+0000 7faa45044640 1 --2- 172.21.15.114:0/3364710352 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa4015a070 0x7faa400ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.140+0000 7f0dee7fc640 1 -- 172.21.15.114:0/2684865825 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8031870 con 0x7f0df0164db0 2023-11-04T01:36:50.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.140+0000 7f0dee7fc640 1 -- 172.21.15.114:0/2684865825 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd80319d0 con 0x7f0df0164db0 2023-11-04T01:36:50.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.140+0000 7f0dee7fc640 1 -- 172.21.15.114:0/2684865825 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8031d60 con 0x7f0df0164db0 2023-11-04T01:36:50.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.141+0000 7faa45044640 1 -- 172.21.15.114:0/3364710352 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa400cb1e0 con 0x7faa40158c80 2023-11-04T01:36:50.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.141+0000 7faa3f59e640 1 --2- 172.21.15.114:0/3364710352 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa4015a070 0x7faa400ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.141+0000 7faa3e59c640 1 -- 172.21.15.114:0/3364710352 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566895202 0 0) 0x7faa400cb1e0 con 0x7faa40158c80 2023-11-04T01:36:50.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.141+0000 7faa37fff640 1 --2- 172.21.15.114:0/3364710352 >> v2:172.21.15.141:3300/0 conn(0x7faa40159060 0x7faa400cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.141+0000 7faa45044640 1 -- 172.21.15.114:0/3364710352 --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa400cad00 con 0x7faa40159060 2023-11-04T01:36:50.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.141+0000 7faa45044640 1 -- 172.21.15.114:0/3364710352 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa401595d0 con 0x7faa4015a070 2023-11-04T01:36:50.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.141+0000 7faa3e59c640 1 -- 172.21.15.114:0/3364710352 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa2c003520 con 0x7faa40158c80 2023-11-04T01:36:50.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.141+0000 7f0df5d3c640 1 -- 172.21.15.114:0/2684865825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df0164db0 msgr2=0x7f0df01651f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.141+0000 7f0df5d3c640 1 --2- 172.21.15.114:0/2684865825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df0164db0 0x7f0df01651f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009870 tx=0x7f0dd802b910 comp rx=0 tx=0).stop 2023-11-04T01:36:50.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.142+0000 7faa3f59e640 1 -- 172.21.15.114:0/3364710352 >> v2:172.21.15.141:3300/0 conn(0x7faa40159060 msgr2=0x7faa400cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.142+0000 7faa3f59e640 1 --2- 172.21.15.114:0/3364710352 >> v2:172.21.15.141:3300/0 conn(0x7faa40159060 0x7faa400cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.142+0000 7faa3f59e640 1 -- 172.21.15.114:0/3364710352 >> v1:172.21.15.114:6789/0 conn(0x7faa40158c80 legacy=0x7faa400ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.142+0000 7faa3f59e640 1 -- 172.21.15.114:0/3364710352 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa400caf00 con 0x7faa4015a070 2023-11-04T01:36:50.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.143+0000 7faa37fff640 1 --2- 172.21.15.114:0/3364710352 >> v2:172.21.15.141:3300/0 conn(0x7faa40159060 0x7faa400cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:50.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.143+0000 7faa3f59e640 1 --2- 172.21.15.114:0/3364710352 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa4015a070 0x7faa400ce2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faa3800c2e0 tx=0x7faa3802c2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=322300306737963f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.144+0000 7faa3e59c640 1 -- 172.21.15.114:0/3364710352 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3800a2d0 con 0x7faa4015a070 2023-11-04T01:36:50.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.144+0000 7faa3e59c640 1 -- 172.21.15.114:0/3364710352 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3800a430 con 0x7faa4015a070 2023-11-04T01:36:50.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.145+0000 7faa3e59c640 1 -- 172.21.15.114:0/3364710352 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3800a7c0 con 0x7faa4015a070 2023-11-04T01:36:50.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.143+0000 7f0df5d3c640 1 -- 172.21.15.114:0/2684865825 shutdown_connections 2023-11-04T01:36:50.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.143+0000 7f0df5d3c640 1 --2- 172.21.15.114:0/2684865825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df0164db0 0x7f0df01651f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.143+0000 7f0df5d3c640 1 --2- 172.21.15.114:0/2684865825 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0df014a6a0 0x7f0df00cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.143+0000 7f0df5d3c640 1 -- 172.21.15.114:0/2684865825 >> 172.21.15.114:0/2684865825 conn(0x7f0df006a120 msgr2=0x7f0df006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.144+0000 7f75844e0640 1 Processor -- start 2023-11-04T01:36:50.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.144+0000 7f75844e0640 1 -- start start 2023-11-04T01:36:50.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.145+0000 7fcc0aa7c640 1 Processor -- start 2023-11-04T01:36:50.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.145+0000 7fcc0aa7c640 1 -- start start 2023-11-04T01:36:50.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7faa45044640 1 -- 172.21.15.114:0/3364710352 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa4015a070 msgr2=0x7faa400ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7faa45044640 1 --2- 172.21.15.114:0/3364710352 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa4015a070 0x7faa400ce2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faa3800c2e0 tx=0x7faa3802c2a0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7faa45044640 1 -- 172.21.15.114:0/3364710352 shutdown_connections 2023-11-04T01:36:50.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7faa45044640 1 --2- 172.21.15.114:0/3364710352 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa4015a070 0x7faa400ce2f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7faa45044640 1 --2- 172.21.15.114:0/3364710352 >> v2:172.21.15.141:3300/0 conn(0x7faa40159060 0x7faa400cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7faa45044640 1 -- 172.21.15.114:0/3364710352 >> 172.21.15.114:0/3364710352 conn(0x7faa4006a120 msgr2=0x7faa4006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7faa45044640 1 -- 172.21.15.114:0/3364710352 shutdown_connections 2023-11-04T01:36:50.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7faa45044640 1 -- 172.21.15.114:0/3364710352 wait complete. 2023-11-04T01:36:50.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7fcc0aa7c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fcbfc0e77a0 0x7fcbfc04f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7f0df5d3c640 1 -- 172.21.15.114:0/2684865825 shutdown_connections 2023-11-04T01:36:50.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.147+0000 7f3ab8075640 1 Processor -- start 2023-11-04T01:36:50.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.145+0000 7f75844e0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f757c164e80 0x7f757c165260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.145+0000 7f75844e0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f757c071b50 0x7f757c1657a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.145+0000 7f7581a7b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f757c071b50 0x7f757c1657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.145+0000 7f758227c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f757c164e80 0x7f757c165260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7f758227c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f757c164e80 0x7f757c165260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49100/0 (socket says 172.21.15.114:49100) 2023-11-04T01:36:50.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7f7581a7b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f757c071b50 0x7f757c1657a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:51614/0 (socket says 172.21.15.114:51614) 2023-11-04T01:36:50.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7f758227c640 1 -- 172.21.15.114:0/1006820554 learned_addr learned my addr 172.21.15.114:0/1006820554 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7f75844e0640 1 -- 172.21.15.114:0/1006820554 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757c165ce0 con 0x7f757c161680 2023-11-04T01:36:50.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7f758127a640 1 -- 172.21.15.114:0/1006820554 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592057089 0 0) 0x7f757c165ce0 con 0x7f757c161680 2023-11-04T01:36:50.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7f75844e0640 1 -- 172.21.15.114:0/1006820554 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c0caf20 con 0x7f757c164e80 2023-11-04T01:36:50.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7f75844e0640 1 -- 172.21.15.114:0/1006820554 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c0cb200 con 0x7f757c071b50 2023-11-04T01:36:50.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7f758127a640 1 -- 172.21.15.114:0/1006820554 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7568003520 con 0x7f757c161680 2023-11-04T01:36:50.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.147+0000 7f7581a7b640 1 -- 172.21.15.114:0/1006820554 >> v2:172.21.15.114:3300/0 conn(0x7f757c164e80 msgr2=0x7f757c165260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.147+0000 7f758127a640 1 -- 172.21.15.114:0/1006820554 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 255998241 0 0) 0x7f7568003520 con 0x7f757c161680 2023-11-04T01:36:50.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.147+0000 7f7581a7b640 1 --2- 172.21.15.114:0/1006820554 >> v2:172.21.15.114:3300/0 conn(0x7f757c164e80 0x7f757c165260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.147+0000 7f7581a7b640 1 -- 172.21.15.114:0/1006820554 >> v1:172.21.15.114:6789/0 conn(0x7f757c161680 legacy=0x7f757c161b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.147+0000 7f7581a7b640 1 -- 172.21.15.114:0/1006820554 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c0cc960 con 0x7f757c071b50 2023-11-04T01:36:50.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.148+0000 7f758227c640 1 --2- 172.21.15.114:0/1006820554 >> v2:172.21.15.114:3300/0 conn(0x7f757c164e80 0x7f757c165260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:50.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7faa45044640 1 Processor -- start 2023-11-04T01:36:50.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7faa45044640 1 -- start start 2023-11-04T01:36:50.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.148+0000 7f60e78f2640 1 Processor -- start 2023-11-04T01:36:50.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.148+0000 7f60e78f2640 1 -- start start 2023-11-04T01:36:50.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7f0df5d3c640 1 -- 172.21.15.114:0/2684865825 wait complete. 2023-11-04T01:36:50.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.148+0000 7f0df5d3c640 1 Processor -- start 2023-11-04T01:36:50.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7f0df5d3c640 1 -- start start 2023-11-04T01:36:50.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7fcc0aa7c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbfc0eb1b0 0x7fcbfc0eb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.146+0000 7fcc08818640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fcbfc0e77a0 0x7fcbfc04f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.147+0000 7fcc08818640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fcbfc0e77a0 0x7fcbfc04f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:34966/0 (socket says 172.21.15.114:34966) 2023-11-04T01:36:50.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.148+0000 7fcc08818640 1 -- 172.21.15.114:0/788333944 learned_addr learned my addr 172.21.15.114:0/788333944 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.148+0000 7fcc03fff640 1 --2- 172.21.15.114:0/788333944 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbfc0eb1b0 0x7fcbfc0eb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7fcc0aa7c640 1 -- 172.21.15.114:0/788333944 --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbfc050230 con 0x7fcbfc052ed0 2023-11-04T01:36:50.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7fcc0aa7c640 1 -- 172.21.15.114:0/788333944 --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbfc006370 con 0x7fcbfc0e77a0 2023-11-04T01:36:50.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7fcc0aa7c640 1 -- 172.21.15.114:0/788333944 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc0ebb30 con 0x7fcbfc0eb1b0 2023-11-04T01:36:50.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.147+0000 7f3ab8075640 1 -- start start 2023-11-04T01:36:50.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.148+0000 7f3ab8075640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3aa80eb2f0 0x7f3aa80eb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.148+0000 7f3ab8075640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa8050370 con 0x7f3aa80e78e0 2023-11-04T01:36:50.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.148+0000 7f3ab8075640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa80064b0 con 0x7f3aa8006940 2023-11-04T01:36:50.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.148+0000 7f3ab8075640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa80ebc70 con 0x7f3aa80eb2f0 2023-11-04T01:36:50.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7f3ab5e11640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3aa80e78e0 0x7f3aa804f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41108/0 (socket says 172.21.15.114:41108) 2023-11-04T01:36:50.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7f3ab5e11640 1 -- 172.21.15.114:0/3335387935 learned_addr learned my addr 172.21.15.114:0/3335387935 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:50.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7f3ab5610640 1 --2- 172.21.15.114:0/3335387935 >> v2:172.21.15.141:3300/0 conn(0x7f3aa80eb2f0 0x7f3aa80eb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7f3ab4e0f640 1 -- 172.21.15.114:0/3335387935 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657838575 0 0) 0x7f3aa80064b0 con 0x7f3aa8006940 2023-11-04T01:36:50.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7f3ab4e0f640 1 -- 172.21.15.114:0/3335387935 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a9c003520 con 0x7f3aa8006940 2023-11-04T01:36:50.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.150+0000 7f7581a7b640 1 --2- 172.21.15.114:0/1006820554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f757c071b50 0x7f757c1657a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f756c0097a0 tx=0x7f756c02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25393f5e0dfa14a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.150+0000 7f3ab5610640 1 -- 172.21.15.114:0/3335387935 >> v1:172.21.15.141:6789/0 conn(0x7f3aa8006940 legacy=0x7f3aa8006dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.150+0000 7f3ab5610640 1 -- 172.21.15.114:0/3335387935 >> v1:172.21.15.114:6789/0 conn(0x7f3aa80e78e0 legacy=0x7f3aa804f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.150+0000 7f3ab5610640 1 -- 172.21.15.114:0/3335387935 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa804fdb0 con 0x7f3aa80eb2f0 2023-11-04T01:36:50.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.150+0000 7faa45044640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa40158c80 0x7faa4014f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.150+0000 7f60e78f2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f60e00b64c0 0x7f60e00b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.150+0000 7f60e78f2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60e00cd3b0 0x7f60e00cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.150+0000 7f60e78f2640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e00d01f0 con 0x7f60e015af20 2023-11-04T01:36:50.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.150+0000 7f60e78f2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e00cc380 con 0x7f60e00b64c0 2023-11-04T01:36:50.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.150+0000 7f60e78f2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e00cdd80 con 0x7f60e00cd3b0 2023-11-04T01:36:50.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.150+0000 7faa3ed9d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa40158c80 0x7faa4014f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.150+0000 7faa3ed9d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa40158c80 0x7faa4014f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:51652/0 (socket says 172.21.15.114:51652) 2023-11-04T01:36:50.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.150+0000 7faa3ed9d640 1 -- 172.21.15.114:0/2752738673 learned_addr learned my addr 172.21.15.114:0/2752738673 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.150+0000 7f0df5d3c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df00cb5b0 0x7f0df00c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7faa45044640 1 --2- 172.21.15.114:0/2752738673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa40159060 0x7faa40149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7faa45044640 1 --2- 172.21.15.114:0/2752738673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa4015a070 0x7faa400c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7f3ab4e0f640 1 -- 172.21.15.114:0/3335387935 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536292669 0 0) 0x7f3aa8050370 con 0x7f3aa80e78e0 2023-11-04T01:36:50.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7fcc037fe640 1 -- 172.21.15.114:0/788333944 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189451446 0 0) 0x7fcbfc050230 con 0x7fcbfc052ed0 2023-11-04T01:36:50.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7fcc037fe640 1 -- 172.21.15.114:0/788333944 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf4003520 con 0x7fcbfc052ed0 2023-11-04T01:36:50.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7fcc03fff640 1 -- 172.21.15.114:0/788333944 >> v2:172.21.15.141:3300/0 conn(0x7fcbfc0e77a0 msgr2=0x7fcbfc04f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7fcc03fff640 1 --2- 172.21.15.114:0/788333944 >> v2:172.21.15.141:3300/0 conn(0x7fcbfc0e77a0 0x7fcbfc04f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7f60e5e8f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60e00cd3b0 0x7f60e00cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7f60e5e8f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60e00cd3b0 0x7f60e00cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:51642/0 (socket says 172.21.15.114:51642) 2023-11-04T01:36:50.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7f60e5e8f640 1 -- 172.21.15.114:0/3504451871 learned_addr learned my addr 172.21.15.114:0/3504451871 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7faa45044640 1 -- 172.21.15.114:0/2752738673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4014a520 con 0x7faa40159060 2023-11-04T01:36:50.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7faa45044640 1 -- 172.21.15.114:0/2752738673 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4014f530 con 0x7faa4015a070 2023-11-04T01:36:50.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7faa45044640 1 -- 172.21.15.114:0/2752738673 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa401ee520 con 0x7faa40158c80 2023-11-04T01:36:50.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7fcc03fff640 1 -- 172.21.15.114:0/788333944 >> v1:172.21.15.141:6789/0 conn(0x7fcbfc052ed0 legacy=0x7fcbfc053360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.149+0000 7fcc03fff640 1 -- 172.21.15.114:0/788333944 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc007810 con 0x7fcbfc0eb1b0 2023-11-04T01:36:50.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7fcc03fff640 1 --2- 172.21.15.114:0/788333944 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbfc0eb1b0 0x7fcbfc0eb5f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00097a0 tx=0x7fcbf002b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fab3b1806be69c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7f60e4e8d640 1 --2- 172.21.15.114:0/3504451871 >> v2:172.21.15.114:3300/0 conn(0x7f60e00b64c0 0x7f60e00b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7f3ab5610640 1 --2- 172.21.15.114:0/3335387935 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3aa80eb2f0 0x7f3aa80eb730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3ab002cce0 tx=0x7f3aa002b600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=195105fd477ccf66 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7faa37fff640 1 --2- 172.21.15.114:0/2752738673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa40159060 0x7faa40149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7faa3f59e640 1 --2- 172.21.15.114:0/2752738673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa4015a070 0x7faa400c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7f60e5e8f640 1 -- 172.21.15.114:0/3504451871 >> v2:172.21.15.114:3300/0 conn(0x7f60e00b64c0 msgr2=0x7f60e00b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7f60e5e8f640 1 --2- 172.21.15.114:0/3504451871 >> v2:172.21.15.114:3300/0 conn(0x7f60e00b64c0 0x7f60e00b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7f60e5e8f640 1 -- 172.21.15.114:0/3504451871 >> v1:172.21.15.141:6789/0 conn(0x7f60e015af20 legacy=0x7f60e00cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7f60e5e8f640 1 -- 172.21.15.114:0/3504451871 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e00b6a40 con 0x7f60e00cd3b0 2023-11-04T01:36:50.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7f0def7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df00cb5b0 0x7f0df00c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7faa37fff640 1 -- 172.21.15.114:0/2752738673 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa40158c80 msgr2=0x7faa4014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7faa37fff640 1 --2- 172.21.15.114:0/2752738673 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa40158c80 0x7faa4014f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7faa37fff640 1 -- 172.21.15.114:0/2752738673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa4015a070 msgr2=0x7faa400c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7faa37fff640 1 --2- 172.21.15.114:0/2752738673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa4015a070 0x7faa400c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7faa37fff640 1 -- 172.21.15.114:0/2752738673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3800c050 con 0x7faa40159060 2023-11-04T01:36:50.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7f0def7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df00cb5b0 0x7f0df00c5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49102/0 (socket says 172.21.15.114:49102) 2023-11-04T01:36:50.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7f0def7fe640 1 -- 172.21.15.114:0/2611182855 learned_addr learned my addr 172.21.15.114:0/2611182855 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7f0df5d3c640 1 --2- 172.21.15.114:0/2611182855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0df014a6a0 0x7f0df01f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7f0df5d3c640 1 --2- 172.21.15.114:0/2611182855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0df0164db0 0x7f0df00b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7f0df5d3c640 1 -- 172.21.15.114:0/2611182855 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df013f380 con 0x7f0df00cb5b0 2023-11-04T01:36:50.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7f0df5d3c640 1 -- 172.21.15.114:0/2611182855 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00c5f60 con 0x7f0df0164db0 2023-11-04T01:36:50.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7f0deffff640 1 --2- 172.21.15.114:0/2611182855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0df0164db0 0x7f0df00b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7f0df5d3c640 1 -- 172.21.15.114:0/2611182855 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df01f6780 con 0x7f0df014a6a0 2023-11-04T01:36:50.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7fcc037fe640 1 -- 172.21.15.114:0/788333944 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0031710 con 0x7fcbfc0eb1b0 2023-11-04T01:36:50.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7fcc037fe640 1 -- 172.21.15.114:0/788333944 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf002f050 con 0x7fcbfc0eb1b0 2023-11-04T01:36:50.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7fcc037fe640 1 -- 172.21.15.114:0/788333944 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0031a70 con 0x7fcbfc0eb1b0 2023-11-04T01:36:50.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.151+0000 7f3ab4e0f640 1 -- 172.21.15.114:0/3335387935 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0073cb0 con 0x7f3aa80eb2f0 2023-11-04T01:36:50.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7f3ab4e0f640 1 -- 172.21.15.114:0/3335387935 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa002e050 con 0x7f3aa80eb2f0 2023-11-04T01:36:50.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7faa37fff640 1 --2- 172.21.15.114:0/2752738673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa40159060 0x7faa40149fe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faa28009a90 tx=0x7faa28009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7f0deeffd640 1 --2- 172.21.15.114:0/2611182855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0df014a6a0 0x7f0df01f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7fcc0aa7c640 1 -- 172.21.15.114:0/788333944 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbfc0eb1b0 msgr2=0x7fcbfc0eb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7fcc0aa7c640 1 --2- 172.21.15.114:0/788333944 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbfc0eb1b0 0x7fcbfc0eb5f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00097a0 tx=0x7fcbf002b7b0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7f3ab4e0f640 1 -- 172.21.15.114:0/3335387935 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0073cb0 con 0x7f3aa80eb2f0 2023-11-04T01:36:50.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7f0def7fe640 1 -- 172.21.15.114:0/2611182855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0df014a6a0 msgr2=0x7f0df01f6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7f0def7fe640 1 --2- 172.21.15.114:0/2611182855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0df014a6a0 0x7f0df01f6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7fcc0aa7c640 1 -- 172.21.15.114:0/788333944 shutdown_connections 2023-11-04T01:36:50.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7fcc0aa7c640 1 --2- 172.21.15.114:0/788333944 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbfc0eb1b0 0x7fcbfc0eb5f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7fcc0aa7c640 1 --2- 172.21.15.114:0/788333944 >> v2:172.21.15.141:3300/0 conn(0x7fcbfc0e77a0 0x7fcbfc04f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7fcc0aa7c640 1 -- 172.21.15.114:0/788333944 >> 172.21.15.114:0/788333944 conn(0x7fcbfc054b00 msgr2=0x7fcbfc054ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7f758127a640 1 -- 172.21.15.114:0/1006820554 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75740019f0 con 0x7f757c071b50 2023-11-04T01:36:50.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7faa377fe640 1 -- 172.21.15.114:0/2752738673 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28015070 con 0x7faa40159060 2023-11-04T01:36:50.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7f758127a640 1 -- 172.21.15.114:0/1006820554 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c02e050 con 0x7f757c071b50 2023-11-04T01:36:50.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7faa377fe640 1 -- 172.21.15.114:0/2752738673 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa280127b0 con 0x7faa40159060 2023-11-04T01:36:50.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7f0def7fe640 1 -- 172.21.15.114:0/2611182855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0df0164db0 msgr2=0x7f0df00b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.152+0000 7f758127a640 1 -- 172.21.15.114:0/1006820554 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c030730 con 0x7f757c071b50 2023-11-04T01:36:50.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7fcc0aa7c640 1 -- 172.21.15.114:0/788333944 shutdown_connections 2023-11-04T01:36:50.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7f3ab8075640 1 -- 172.21.15.114:0/3335387935 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3aa80eb2f0 msgr2=0x7f3aa80eb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7f3ab8075640 1 --2- 172.21.15.114:0/3335387935 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3aa80eb2f0 0x7f3aa80eb730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3ab002cce0 tx=0x7f3aa002b600 comp rx=0 tx=0).stop 2023-11-04T01:36:50.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7f3ab8075640 1 -- 172.21.15.114:0/3335387935 shutdown_connections 2023-11-04T01:36:50.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7f3ab8075640 1 --2- 172.21.15.114:0/3335387935 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3aa80eb2f0 0x7f3aa80eb730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7f3ab8075640 1 -- 172.21.15.114:0/3335387935 >> 172.21.15.114:0/3335387935 conn(0x7f3aa8054c40 msgr2=0x7f3aa8055020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7f60e5e8f640 1 --2- 172.21.15.114:0/3504451871 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60e00cd3b0 0x7f60e00cd840 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009e50 tx=0x7f60d802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f5a680c536264e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7faa377fe640 1 -- 172.21.15.114:0/2752738673 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28012b20 con 0x7faa40159060 2023-11-04T01:36:50.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7faa45044640 1 -- 172.21.15.114:0/2752738673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4014e920 con 0x7faa40159060 2023-11-04T01:36:50.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7faa45044640 1 -- 172.21.15.114:0/2752738673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4014eee0 con 0x7faa40159060 2023-11-04T01:36:50.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7f60d7fff640 1 -- 172.21.15.114:0/3504451871 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d802cb00 con 0x7f60e00cd3b0 2023-11-04T01:36:50.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7f60d7fff640 1 -- 172.21.15.114:0/3504451871 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d802cc60 con 0x7f60e00cd3b0 2023-11-04T01:36:50.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7f0def7fe640 1 --2- 172.21.15.114:0/2611182855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0df0164db0 0x7f0df00b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7f0def7fe640 1 -- 172.21.15.114:0/2611182855 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd80094d0 con 0x7f0df00cb5b0 2023-11-04T01:36:50.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7fcc0aa7c640 1 -- 172.21.15.114:0/788333944 wait complete. 2023-11-04T01:36:50.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7f75844e0640 1 -- 172.21.15.114:0/1006820554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f757c071b50 msgr2=0x7f757c1657a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.153+0000 7f75844e0640 1 --2- 172.21.15.114:0/1006820554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f757c071b50 0x7f757c1657a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f756c0097a0 tx=0x7f756c02b790 comp rx=0 tx=0).stop 2023-11-04T01:36:50.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.154+0000 7f75844e0640 1 -- 172.21.15.114:0/1006820554 shutdown_connections 2023-11-04T01:36:50.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.154+0000 7f75844e0640 1 --2- 172.21.15.114:0/1006820554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f757c071b50 0x7f757c1657a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.154+0000 7f75844e0640 1 --2- 172.21.15.114:0/1006820554 >> v2:172.21.15.114:3300/0 conn(0x7f757c164e80 0x7f757c165260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.154+0000 7f75844e0640 1 -- 172.21.15.114:0/1006820554 >> 172.21.15.114:0/1006820554 conn(0x7f757c06a120 msgr2=0x7f757c06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.154+0000 7faa45044640 1 -- 172.21.15.114:0/2752738673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa40159b50 con 0x7faa40159060 2023-11-04T01:36:50.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.154+0000 7f60e78f2640 1 -- 172.21.15.114:0/3504451871 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60e00cd3b0 msgr2=0x7f60e00cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.154+0000 7f60e78f2640 1 --2- 172.21.15.114:0/3504451871 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60e00cd3b0 0x7f60e00cd840 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009e50 tx=0x7f60d802bf60 comp rx=0 tx=0).stop 2023-11-04T01:36:50.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.154+0000 7f60e78f2640 1 -- 172.21.15.114:0/3504451871 shutdown_connections 2023-11-04T01:36:50.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.154+0000 7f60e78f2640 1 --2- 172.21.15.114:0/3504451871 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60e00cd3b0 0x7f60e00cd840 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.154+0000 7f60e78f2640 1 --2- 172.21.15.114:0/3504451871 >> v2:172.21.15.114:3300/0 conn(0x7f60e00b64c0 0x7f60e00b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.154+0000 7f60e78f2640 1 -- 172.21.15.114:0/3504451871 >> 172.21.15.114:0/3504451871 conn(0x7f60e006ea20 msgr2=0x7f60e006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.154+0000 7f3ab8075640 1 -- 172.21.15.114:0/3335387935 shutdown_connections 2023-11-04T01:36:50.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.154+0000 7f3ab8075640 1 -- 172.21.15.114:0/3335387935 wait complete. 2023-11-04T01:36:50.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.155+0000 7f60e78f2640 1 -- 172.21.15.114:0/3504451871 shutdown_connections 2023-11-04T01:36:50.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.155+0000 7fcc0aa7c640 1 Processor -- start 2023-11-04T01:36:50.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.155+0000 7f0def7fe640 1 --2- 172.21.15.114:0/2611182855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df00cb5b0 0x7f0df00c5a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0de000b6d0 tx=0x7f0de000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.155+0000 7fcc0aa7c640 1 -- start start 2023-11-04T01:36:50.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.154+0000 7f75844e0640 1 -- 172.21.15.114:0/1006820554 shutdown_connections 2023-11-04T01:36:50.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.154+0000 7f75844e0640 1 -- 172.21.15.114:0/1006820554 wait complete. 2023-11-04T01:36:50.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.156+0000 7f75844e0640 1 Processor -- start 2023-11-04T01:36:50.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.156+0000 7faa377fe640 1 -- 172.21.15.114:0/2752738673 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa28012c80 con 0x7faa40159060 2023-11-04T01:36:50.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7faa377fe640 1 --2- 172.21.15.114:0/2752738673 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faa2006af70 0x7faa2006d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7faa377fe640 1 -- 172.21.15.114:0/2752738673 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faa2808e2b0 con 0x7faa40159060 2023-11-04T01:36:50.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.155+0000 7f0de7fff640 1 -- 172.21.15.114:0/2611182855 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de000c720 con 0x7f0df00cb5b0 2023-11-04T01:36:50.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.156+0000 7f0de7fff640 1 -- 172.21.15.114:0/2611182855 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de000c880 con 0x7f0df00cb5b0 2023-11-04T01:36:50.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.156+0000 7f0de7fff640 1 -- 172.21.15.114:0/2611182855 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de000cc70 con 0x7f0df00cb5b0 2023-11-04T01:36:50.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7f0df5d3c640 1 -- 172.21.15.114:0/2611182855 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df00b21e0 con 0x7f0df00cb5b0 2023-11-04T01:36:50.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.156+0000 7fcc0aa7c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcbfc052ed0 0x7fcbfc0dbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7fcc0aa7c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbfc0e77a0 0x7fcbfc0d90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7fcc08818640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcbfc052ed0 0x7fcbfc0dbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7fcc08818640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcbfc052ed0 0x7fcbfc0dbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35022/0 (socket says 172.21.15.114:35022) 2023-11-04T01:36:50.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7fcc03fff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbfc0e77a0 0x7fcbfc0d90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7fcc03fff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbfc0e77a0 0x7fcbfc0d90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:51672/0 (socket says 172.21.15.114:51672) 2023-11-04T01:36:50.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7fcc0aa7c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbfc0eb1b0 0x7fcbfc0da270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.156+0000 7f75844e0640 1 -- start start 2023-11-04T01:36:50.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.156+0000 7f3ab8075640 1 Processor -- start 2023-11-04T01:36:50.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7faa377fe640 1 --2- 172.21.15.114:0/2752738673 >> [v2:172.21.15.114:6808/2234532734,v1:172.21.15.114:6809/2234532734] conn(0x7faa200745b0 0x7faa200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7fcc09019640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbfc0eb1b0 0x7fcbfc0da270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7fcc09019640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbfc0eb1b0 0x7fcbfc0da270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49132/0 (socket says 172.21.15.114:49132) 2023-11-04T01:36:50.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7fcc08818640 1 -- 172.21.15.114:0/2667584089 learned_addr learned my addr 172.21.15.114:0/2667584089 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7faa377fe640 1 -- 172.21.15.114:0/2752738673 --> [v2:172.21.15.114:6808/2234532734,v1:172.21.15.114:6809/2234532734] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa200770c0 con 0x7faa200745b0 2023-11-04T01:36:50.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7faa377fe640 1 -- 172.21.15.114:0/2752738673 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa2808e660 con 0x7faa40159060 2023-11-04T01:36:50.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7faa3f59e640 1 --2- 172.21.15.114:0/2752738673 >> [v2:172.21.15.114:6808/2234532734,v1:172.21.15.114:6809/2234532734] conn(0x7faa200745b0 0x7faa200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7fcc0aa7c640 1 -- 172.21.15.114:0/2667584089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc0db930 con 0x7fcbfc0eb1b0 2023-11-04T01:36:50.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7fcc0aa7c640 1 -- 172.21.15.114:0/2667584089 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc0dad20 con 0x7fcbfc052ed0 2023-11-04T01:36:50.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7fcc0aa7c640 1 -- 172.21.15.114:0/2667584089 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc0db000 con 0x7fcbfc0e77a0 2023-11-04T01:36:50.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.156+0000 7f3ab8075640 1 -- start start 2023-11-04T01:36:50.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7fcc03fff640 1 -- 172.21.15.114:0/2667584089 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcbfc052ed0 msgr2=0x7fcbfc0dbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7f3ab8075640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3aa8006940 0x7f3aa80e3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7f3ab8075640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3aa80e78e0 0x7f3aa80e6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7f3ab8075640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3aa80eb2f0 0x7f3aa80e65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7f3ab8075640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa8186270 con 0x7f3aa8006940 2023-11-04T01:36:50.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7f3ab8075640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80e70f0 con 0x7f3aa80e78e0 2023-11-04T01:36:50.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7f3ab8075640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80e6e10 con 0x7f3aa80eb2f0 2023-11-04T01:36:50.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7f3ab5610640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3aa80e78e0 0x7f3aa80e6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7fcc03fff640 1 --2- 172.21.15.114:0/2667584089 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcbfc052ed0 0x7fcbfc0dbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7f3ab5610640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3aa80e78e0 0x7f3aa80e6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35028/0 (socket says 172.21.15.114:35028) 2023-11-04T01:36:50.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7f3ab5610640 1 -- 172.21.15.114:0/2077454707 learned_addr learned my addr 172.21.15.114:0/2077454707 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7faa3f59e640 1 --2- 172.21.15.114:0/2752738673 >> [v2:172.21.15.114:6808/2234532734,v1:172.21.15.114:6809/2234532734] conn(0x7faa200745b0 0x7faa200769f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7faa3ed9d640 1 --2- 172.21.15.114:0/2752738673 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faa2006af70 0x7faa2006d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7fcc03fff640 1 -- 172.21.15.114:0/2667584089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbfc0eb1b0 msgr2=0x7fcbfc0da270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7fcc03fff640 1 --2- 172.21.15.114:0/2667584089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbfc0eb1b0 0x7fcbfc0da270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7f3ab5610640 1 -- 172.21.15.114:0/2077454707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3aa80eb2f0 msgr2=0x7f3aa80e65c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-04T01:36:50.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7f3ab5610640 1 --2- 172.21.15.114:0/2077454707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3aa80eb2f0 0x7f3aa80e65c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7f3ab5610640 1 -- 172.21.15.114:0/2077454707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3aa8006940 msgr2=0x7f3aa80e3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7f3ab5610640 1 --2- 172.21.15.114:0/2077454707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3aa8006940 0x7f3aa80e3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7f3ab5610640 1 -- 172.21.15.114:0/2077454707 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa0009400 con 0x7f3aa80e78e0 2023-11-04T01:36:50.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7fcc03fff640 1 -- 172.21.15.114:0/2667584089 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf0009400 con 0x7fcbfc0e77a0 2023-11-04T01:36:50.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7fcc03fff640 1 --2- 172.21.15.114:0/2667584089 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbfc0e77a0 0x7fcbfc0d90e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0033000 tx=0x7fcbf00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7fcc017fa640 1 -- 172.21.15.114:0/2667584089 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0031920 con 0x7fcbfc0e77a0 2023-11-04T01:36:50.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7f3ab5610640 1 --2- 172.21.15.114:0/2077454707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3aa80e78e0 0x7f3aa80e6080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0009810 tx=0x7f3aa00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7fcc0aa7c640 1 -- 172.21.15.114:0/2667584089 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbfc0db2e0 con 0x7fcbfc0e77a0 2023-11-04T01:36:50.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7fcc0aa7c640 1 -- 172.21.15.114:0/2667584089 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbfc0d9620 con 0x7fcbfc0e77a0 2023-11-04T01:36:50.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7f75844e0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f757c071b50 0x7f757c1ff030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7f75844e0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f757c161680 0x7f757c15f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7f75844e0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f757c164e80 0x7f757c0af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7f75844e0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c160080 con 0x7f757c161680 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7f75844e0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c160360 con 0x7f757c071b50 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7f75844e0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c160640 con 0x7f757c164e80 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7f7581a7b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f757c161680 0x7f757c15f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7f758227c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f757c071b50 0x7f757c1ff030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7f7581a7b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f757c161680 0x7f757c15f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49136/0 (socket says 172.21.15.114:49136) 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7f7581a7b640 1 -- 172.21.15.114:0/686604736 learned_addr learned my addr 172.21.15.114:0/686604736 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7f7581a7b640 1 -- 172.21.15.114:0/686604736 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f757c164e80 msgr2=0x7f757c0af280 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7f7581a7b640 1 --2- 172.21.15.114:0/686604736 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f757c164e80 0x7f757c0af280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7f7581a7b640 1 -- 172.21.15.114:0/686604736 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f757c071b50 msgr2=0x7f757c1ff030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7f7581a7b640 1 --2- 172.21.15.114:0/686604736 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f757c071b50 0x7f757c1ff030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7f7581a7b640 1 -- 172.21.15.114:0/686604736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c009400 con 0x7f757c161680 2023-11-04T01:36:50.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7f758227c640 1 --2- 172.21.15.114:0/686604736 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f757c071b50 0x7f757c1ff030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:50.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.158+0000 7f7581a7b640 1 --2- 172.21.15.114:0/686604736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f757c161680 0x7f757c15f630 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f756c0098c0 tx=0x7f756c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7f7572ffd640 1 -- 172.21.15.114:0/686604736 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c032a50 con 0x7f757c161680 2023-11-04T01:36:50.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7f75844e0640 1 -- 172.21.15.114:0/686604736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757c160920 con 0x7f757c161680 2023-11-04T01:36:50.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7f75844e0640 1 -- 172.21.15.114:0/686604736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c06cfc0 con 0x7f757c161680 2023-11-04T01:36:50.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.160+0000 7f7572ffd640 1 -- 172.21.15.114:0/686604736 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c032bd0 con 0x7f757c161680 2023-11-04T01:36:50.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.160+0000 7f7572ffd640 1 -- 172.21.15.114:0/686604736 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c03c410 con 0x7f757c161680 2023-11-04T01:36:50.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7f3aa67fc640 1 -- 172.21.15.114:0/2077454707 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0030710 con 0x7f3aa80e78e0 2023-11-04T01:36:50.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7f3aa67fc640 1 -- 172.21.15.114:0/2077454707 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa0030870 con 0x7f3aa80e78e0 2023-11-04T01:36:50.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7f3aa67fc640 1 -- 172.21.15.114:0/2077454707 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0030be0 con 0x7f3aa80e78e0 2023-11-04T01:36:50.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7f3ab8075640 1 -- 172.21.15.114:0/2077454707 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa8185c20 con 0x7f3aa80e78e0 2023-11-04T01:36:50.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7f3ab8075640 1 -- 172.21.15.114:0/2077454707 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa80e6b00 con 0x7f3aa80e78e0 2023-11-04T01:36:50.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.159+0000 7f60e78f2640 1 -- 172.21.15.114:0/3504451871 wait complete. 2023-11-04T01:36:50.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.161+0000 7f60e78f2640 1 Processor -- start 2023-11-04T01:36:50.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.157+0000 7f0df5d3c640 1 -- 172.21.15.114:0/2611182855 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df013efa0 con 0x7f0df00cb5b0 2023-11-04T01:36:50.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.160+0000 7f0df5d3c640 1 -- 172.21.15.114:0/2611182855 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0df00ca830 con 0x7f0df00cb5b0 2023-11-04T01:36:50.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.161+0000 7fcbeeffd640 1 -- 172.21.15.114:0/2667584089 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcbfc04ff50 con 0x7fcbfc0e77a0 2023-11-04T01:36:50.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.161+0000 7f3ab8075640 1 -- 172.21.15.114:0/2077454707 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a98000fc0 con 0x7f3aa80e78e0 2023-11-04T01:36:50.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.161+0000 7f60e78f2640 1 -- start start 2023-11-04T01:36:50.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.162+0000 7fcc017fa640 1 -- 172.21.15.114:0/2667584089 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf0031ac0 con 0x7fcbfc0e77a0 2023-11-04T01:36:50.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.162+0000 7f60e78f2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60e00b64c0 0x7f60e0155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.162+0000 7f60e78f2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60e00cd3b0 0x7f60e00c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.162+0000 7f60e78f2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60e015af20 0x7f60e01f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.162+0000 7f60e78f2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01f28c0 con 0x7f60e00b64c0 2023-11-04T01:36:50.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.162+0000 7f60e78f2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0157290 con 0x7f60e00cd3b0 2023-11-04T01:36:50.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.162+0000 7f60e78f2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0156680 con 0x7f60e015af20 2023-11-04T01:36:50.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.161+0000 7f0de7fff640 1 -- 172.21.15.114:0/2611182855 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0de001c360 con 0x7f0df00cb5b0 2023-11-04T01:36:50.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.162+0000 7f0de7fff640 1 --2- 172.21.15.114:0/2611182855 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0dd006af40 0x7f0dd006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.162+0000 7f0de7fff640 1 -- 172.21.15.114:0/2611182855 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0de00897d0 con 0x7f0df00cb5b0 2023-11-04T01:36:50.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.162+0000 7f0de7fff640 1 --2- 172.21.15.114:0/2611182855 >> [v2:172.21.15.114:6816/3751724895,v1:172.21.15.114:6817/3751724895] conn(0x7f0dd0074410 0x7f0dd0076850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.162+0000 7f0de7fff640 1 -- 172.21.15.114:0/2611182855 --> [v2:172.21.15.114:6816/3751724895,v1:172.21.15.114:6817/3751724895] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0dd0076f20 con 0x7f0dd0074410 2023-11-04T01:36:50.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.162+0000 7f0de7fff640 1 -- 172.21.15.114:0/2611182855 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0de0089b80 con 0x7f0df00cb5b0 2023-11-04T01:36:50.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.163+0000 7faa377fe640 1 -- 172.21.15.114:0/2752738673 <== osd.1 v2:172.21.15.114:6808/2234532734 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7faa200770c0 con 0x7faa200745b0 2023-11-04T01:36:50.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.163+0000 7f60e568e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60e00b64c0 0x7f60e0155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.163+0000 7f0deeffd640 1 --2- 172.21.15.114:0/2611182855 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0dd006af40 0x7f0dd006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.163+0000 7f60e568e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60e00b64c0 0x7f60e0155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49152/0 (socket says 172.21.15.114:49152) 2023-11-04T01:36:50.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.163+0000 7f60e568e640 1 -- 172.21.15.114:0/1749565170 learned_addr learned my addr 172.21.15.114:0/1749565170 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.163+0000 7fcc017fa640 1 -- 172.21.15.114:0/2667584089 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0031e70 con 0x7fcbfc0e77a0 2023-11-04T01:36:50.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.163+0000 7fcc017fa640 1 -- 172.21.15.114:0/2667584089 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcbf003f450 con 0x7fcbfc0e77a0 2023-11-04T01:36:50.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.163+0000 7f60e5e8f640 1 --2- 172.21.15.114:0/1749565170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60e015af20 0x7f60e01f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.163+0000 7f60e4e8d640 1 --2- 172.21.15.114:0/1749565170 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60e00cd3b0 0x7f60e00c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.163+0000 7f0deffff640 1 --2- 172.21.15.114:0/2611182855 >> [v2:172.21.15.114:6816/3751724895,v1:172.21.15.114:6817/3751724895] conn(0x7f0dd0074410 0x7f0dd0076850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.162+0000 7f3aa67fc640 1 -- 172.21.15.114:0/2077454707 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3aa0030d40 con 0x7f3aa80e78e0 2023-11-04T01:36:50.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.163+0000 7f3aa67fc640 1 --2- 172.21.15.114:0/2077454707 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a9406af70 0x7f3a9406d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.163+0000 7f3aa67fc640 1 -- 172.21.15.114:0/2077454707 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3aa00ac2b0 con 0x7f3aa80e78e0 2023-11-04T01:36:50.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.163+0000 7f3aa67fc640 1 --2- 172.21.15.114:0/2077454707 >> [v2:172.21.15.141:6824/4009772147,v1:172.21.15.141:6825/4009772147] conn(0x7f3a940745b0 0x7f3a940769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.163+0000 7f3aa67fc640 1 -- 172.21.15.114:0/2077454707 --> [v2:172.21.15.141:6824/4009772147,v1:172.21.15.141:6825/4009772147] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a940770c0 con 0x7f3a940745b0 2023-11-04T01:36:50.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.163+0000 7f3aa67fc640 1 -- 172.21.15.114:0/2077454707 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3aa00ac660 con 0x7f3aa80e78e0 2023-11-04T01:36:50.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.163+0000 7f3ab5e11640 1 --2- 172.21.15.114:0/2077454707 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a9406af70 0x7f3a9406d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.164+0000 7f3ab6612640 1 --2- 172.21.15.114:0/2077454707 >> [v2:172.21.15.141:6824/4009772147,v1:172.21.15.141:6825/4009772147] conn(0x7f3a940745b0 0x7f3a940769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.164+0000 7f0deffff640 1 --2- 172.21.15.114:0/2611182855 >> [v2:172.21.15.114:6816/3751724895,v1:172.21.15.114:6817/3751724895] conn(0x7f0dd0074410 0x7f0dd0076850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.165+0000 7fcc017fa640 1 --2- 172.21.15.114:0/2667584089 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcbe806afc0 0x7fcbe806d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.165+0000 7fcc017fa640 1 -- 172.21.15.114:0/2667584089 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbf00ab680 con 0x7fcbfc0e77a0 2023-11-04T01:36:50.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.164+0000 7f75844e0640 1 -- 172.21.15.114:0/686604736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7564000fc0 con 0x7f757c161680 2023-11-04T01:36:50.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.164+0000 7f7572ffd640 1 -- 172.21.15.114:0/686604736 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f756c039070 con 0x7f757c161680 2023-11-04T01:36:50.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.165+0000 7f7572ffd640 1 --2- 172.21.15.114:0/686604736 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f756006af40 0x7f756006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.165+0000 7f7572ffd640 1 -- 172.21.15.114:0/686604736 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f756c0ab570 con 0x7f757c161680 2023-11-04T01:36:50.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.165+0000 7f7572ffd640 1 --2- 172.21.15.114:0/686604736 >> [v2:172.21.15.141:6808/1912829833,v1:172.21.15.141:6809/1912829833] conn(0x7f7560074580 0x7f75600769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.165+0000 7f7572ffd640 1 -- 172.21.15.114:0/686604736 --> [v2:172.21.15.141:6808/1912829833,v1:172.21.15.141:6809/1912829833] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7560077090 con 0x7f7560074580 2023-11-04T01:36:50.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.165+0000 7f7572ffd640 1 -- 172.21.15.114:0/686604736 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f756c0adb90 con 0x7f757c161680 2023-11-04T01:36:50.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.165+0000 7fcc017fa640 1 --2- 172.21.15.114:0/2667584089 >> [v2:172.21.15.141:6800/3610353173,v1:172.21.15.141:6801/3610353173] conn(0x7fcbe8074490 0x7fcbe80768d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.165+0000 7f0de7fff640 1 -- 172.21.15.114:0/2611182855 <== osd.3 v2:172.21.15.114:6816/3751724895 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f0dd0076f20 con 0x7f0dd0074410 2023-11-04T01:36:50.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.165+0000 7fcc017fa640 1 -- 172.21.15.114:0/2667584089 --> [v2:172.21.15.141:6800/3610353173,v1:172.21.15.141:6801/3610353173] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcbe8076fa0 con 0x7fcbe8074490 2023-11-04T01:36:50.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.165+0000 7f3ab6612640 1 --2- 172.21.15.114:0/2077454707 >> [v2:172.21.15.141:6824/4009772147,v1:172.21.15.141:6825/4009772147] conn(0x7f3a940745b0 0x7f3a940769f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.165+0000 7fcc017fa640 1 -- 172.21.15.114:0/2667584089 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbf00adbd0 con 0x7fcbfc0e77a0 2023-11-04T01:36:50.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.165+0000 7f3ab5e11640 1 --2- 172.21.15.114:0/2077454707 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a9406af70 0x7f3a9406d430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3aac007fd0 tx=0x7f3aac007980 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.165+0000 7f7582a7d640 1 --2- 172.21.15.114:0/686604736 >> [v2:172.21.15.141:6808/1912829833,v1:172.21.15.141:6809/1912829833] conn(0x7f7560074580 0x7f75600769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.166+0000 7f0deeffd640 1 --2- 172.21.15.114:0/2611182855 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0dd006af40 0x7f0dd006d400 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8036000 tx=0x7f0dd803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.166+0000 7f60e5e8f640 1 -- 172.21.15.114:0/1749565170 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60e00cd3b0 msgr2=0x7f60e00c38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.166+0000 7f60e5e8f640 1 --2- 172.21.15.114:0/1749565170 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60e00cd3b0 0x7f60e00c38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.166+0000 7f60e5e8f640 1 -- 172.21.15.114:0/1749565170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60e00b64c0 msgr2=0x7f60e0155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.166+0000 7f60e5e8f640 1 --2- 172.21.15.114:0/1749565170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60e00b64c0 0x7f60e0155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.166+0000 7f60e5e8f640 1 -- 172.21.15.114:0/1749565170 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d8009b30 con 0x7f60e015af20 2023-11-04T01:36:50.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.164+0000 7faa3ed9d640 1 --2- 172.21.15.114:0/2752738673 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faa2006af70 0x7faa2006d430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faa30005880 tx=0x7faa30009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.166+0000 7f7582a7d640 1 --2- 172.21.15.114:0/686604736 >> [v2:172.21.15.141:6808/1912829833,v1:172.21.15.141:6809/1912829833] conn(0x7f7560074580 0x7f75600769c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.165+0000 7fcc08818640 1 --2- 172.21.15.114:0/2667584089 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcbe806afc0 0x7fcbe806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.166+0000 7fcc09019640 1 --2- 172.21.15.114:0/2667584089 >> [v2:172.21.15.141:6800/3610353173,v1:172.21.15.141:6801/3610353173] conn(0x7fcbe8074490 0x7fcbe80768d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.166+0000 7fcc09019640 1 --2- 172.21.15.114:0/2667584089 >> [v2:172.21.15.141:6800/3610353173,v1:172.21.15.141:6801/3610353173] conn(0x7fcbe8074490 0x7fcbe80768d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.166+0000 7fcc08818640 1 --2- 172.21.15.114:0/2667584089 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcbe806afc0 0x7fcbe806d480 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcc04069c50 tx=0x7fcc04073d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.166+0000 7f3aa67fc640 1 -- 172.21.15.114:0/2077454707 <== osd.7 v2:172.21.15.141:6824/4009772147 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f3ab0094890 con 0x7f3a940745b0 2023-11-04T01:36:50.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.167+0000 7f758227c640 1 --2- 172.21.15.114:0/686604736 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f756006af40 0x7f756006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.167+0000 7f60e5e8f640 1 --2- 172.21.15.114:0/1749565170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60e015af20 0x7f60e01f2380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f60e00b3760 tx=0x7f60d8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.167+0000 7f758227c640 1 --2- 172.21.15.114:0/686604736 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f756006af40 0x7f756006d400 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f757800c9b0 tx=0x7f7578008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.167+0000 7f60d5ffb640 1 -- 172.21.15.114:0/1749565170 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8040880 con 0x7f60e015af20 2023-11-04T01:36:50.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.167+0000 7f60d5ffb640 1 -- 172.21.15.114:0/1749565170 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d8040a00 con 0x7f60e015af20 2023-11-04T01:36:50.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.167+0000 7f60d5ffb640 1 -- 172.21.15.114:0/1749565170 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8040db0 con 0x7f60e015af20 2023-11-04T01:36:50.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.167+0000 7f60e78f2640 1 -- 172.21.15.114:0/1749565170 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e0156960 con 0x7f60e015af20 2023-11-04T01:36:50.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.168+0000 7f60e78f2640 1 -- 172.21.15.114:0/1749565170 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e0156f20 con 0x7f60e015af20 2023-11-04T01:36:50.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.168+0000 7f7572ffd640 1 -- 172.21.15.114:0/686604736 <== osd.6 v2:172.21.15.141:6808/1912829833 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f7560077090 con 0x7f7560074580 2023-11-04T01:36:50.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.169+0000 7f60e78f2640 1 -- 172.21.15.114:0/1749565170 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60e00d0790 con 0x7f60e015af20 2023-11-04T01:36:50.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.168+0000 7fcc017fa640 1 -- 172.21.15.114:0/2667584089 <== osd.4 v2:172.21.15.141:6800/3610353173 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fcbe8076fa0 con 0x7fcbe8074490 2023-11-04T01:36:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.174+0000 7f60d5ffb640 1 -- 172.21.15.114:0/1749565170 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60d803e420 con 0x7f60e015af20 2023-11-04T01:36:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.174+0000 7f60d5ffb640 1 --2- 172.21.15.114:0/1749565170 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60c406af40 0x7f60c406d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.174+0000 7f60d5ffb640 1 -- 172.21.15.114:0/1749565170 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f60d80ac730 con 0x7f60e015af20 2023-11-04T01:36:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.174+0000 7f60d5ffb640 1 --2- 172.21.15.114:0/1749565170 >> [v2:172.21.15.114:6824/3823972084,v1:172.21.15.114:6825/3823972084] conn(0x7f60c4074500 0x7f60c4076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.174+0000 7f60d5ffb640 1 -- 172.21.15.114:0/1749565170 --> [v2:172.21.15.114:6824/3823972084,v1:172.21.15.114:6825/3823972084] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60c4077010 con 0x7f60c4074500 2023-11-04T01:36:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.175+0000 7f60d5ffb640 1 -- 172.21.15.114:0/1749565170 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60d80343f0 con 0x7f60e015af20 2023-11-04T01:36:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.175+0000 7f60e568e640 1 --2- 172.21.15.114:0/1749565170 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60c406af40 0x7f60c406d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.176+0000 7f60e568e640 1 --2- 172.21.15.114:0/1749565170 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60c406af40 0x7f60c406d400 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f60e015e5d0 tx=0x7f60dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.176+0000 7f60e4e8d640 1 --2- 172.21.15.114:0/1749565170 >> [v2:172.21.15.114:6824/3823972084,v1:172.21.15.114:6825/3823972084] conn(0x7f60c4074500 0x7f60c4076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.177+0000 7f60e4e8d640 1 --2- 172.21.15.114:0/1749565170 >> [v2:172.21.15.114:6824/3823972084,v1:172.21.15.114:6825/3823972084] conn(0x7f60c4074500 0x7f60c4076940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.178+0000 7f60d5ffb640 1 -- 172.21.15.114:0/1749565170 <== osd.2 v2:172.21.15.114:6824/3823972084 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f60c4077010 con 0x7f60c4074500 2023-11-04T01:36:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.181+0000 7fb7c080f640 1 Processor -- start 2023-11-04T01:36:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.181+0000 7fb7c080f640 1 -- start start 2023-11-04T01:36:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.182+0000 7fb7c080f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb7b40e7680 0x7fb7b40090c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.182+0000 7fb7c080f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb7b4050d80 0x7fb7b4006c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.182+0000 7fb7c080f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b4053d00 con 0x7fb7b4007140 2023-11-04T01:36:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.182+0000 7fb7c080f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b40075d0 con 0x7fb7b40e7680 2023-11-04T01:36:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.182+0000 7fb7c080f640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b40512d0 con 0x7fb7b4050d80 2023-11-04T01:36:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.182+0000 7fb7bb59e640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb7b4007140 0x7fb7b40eb2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41112/0 (socket says 172.21.15.114:41112) 2023-11-04T01:36:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.182+0000 7fb7bb59e640 1 -- 172.21.15.114:0/1095964381 learned_addr learned my addr 172.21.15.114:0/1095964381 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.183+0000 7fb7b9d9b640 1 -- 172.21.15.114:0/1095964381 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947531050 0 0) 0x7fb7b4053d00 con 0x7fb7b4007140 2023-11-04T01:36:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.183+0000 7fb7b9d9b640 1 -- 172.21.15.114:0/1095964381 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7a4003520 con 0x7fb7b4007140 2023-11-04T01:36:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.183+0000 7fb7b9d9b640 1 -- 172.21.15.114:0/1095964381 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 466209278 0 0) 0x7fb7a4003520 con 0x7fb7b4007140 2023-11-04T01:36:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.183+0000 7fb7b9d9b640 1 -- 172.21.15.114:0/1095964381 >> v2:172.21.15.141:3300/0 conn(0x7fb7b4050d80 msgr2=0x7fb7b4006c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.183+0000 7fb7b9d9b640 1 --2- 172.21.15.114:0/1095964381 >> v2:172.21.15.141:3300/0 conn(0x7fb7b4050d80 0x7fb7b4006c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.183+0000 7fb7b9d9b640 1 -- 172.21.15.114:0/1095964381 >> v2:172.21.15.114:3300/0 conn(0x7fb7b40e7680 msgr2=0x7fb7b40090c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.183+0000 7fb7b9d9b640 1 --2- 172.21.15.114:0/1095964381 >> v2:172.21.15.114:3300/0 conn(0x7fb7b40e7680 0x7fb7b40090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.183+0000 7fb7b9d9b640 1 -- 172.21.15.114:0/1095964381 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b40515b0 con 0x7fb7b4007140 2023-11-04T01:36:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.183+0000 7fb7b9d9b640 1 -- 172.21.15.114:0/1095964381 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fb7bc073cb0 con 0x7fb7b4007140 2023-11-04T01:36:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.183+0000 7fb7b9d9b640 1 -- 172.21.15.114:0/1095964381 >> v1:172.21.15.114:6789/0 conn(0x7fb7b4007140 legacy=0x7fb7b40eb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.183+0000 7fb7b9d9b640 1 --2- 172.21.15.114:0/1095964381 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7a4003970 0x7fb7a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.183+0000 7fb7b9d9b640 1 --2- 172.21.15.114:0/1095964381 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7a40047c0 0x7fb7a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.183+0000 7fb7b9d9b640 1 --2- 172.21.15.114:0/1095964381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7a4005180 0x7fb7a402d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.183+0000 7fb7b9d9b640 1 -- 172.21.15.114:0/1095964381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b40075d0 con 0x7fb7a4005180 2023-11-04T01:36:50.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.183+0000 7fb7b9d9b640 1 -- 172.21.15.114:0/1095964381 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b40512d0 con 0x7fb7a40047c0 2023-11-04T01:36:50.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.183+0000 7fb7b9d9b640 1 -- 172.21.15.114:0/1095964381 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a402e0e0 con 0x7fb7a4003970 2023-11-04T01:36:50.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.184+0000 7fb7bb59e640 1 --2- 172.21.15.114:0/1095964381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7a4005180 0x7fb7a402d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.184+0000 7fb7ba59c640 1 --2- 172.21.15.114:0/1095964381 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7a40047c0 0x7fb7a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.184+0000 7fb7bad9d640 1 --2- 172.21.15.114:0/1095964381 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7a4003970 0x7fb7a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.188+0000 7fb7bad9d640 1 -- 172.21.15.114:0/1095964381 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7a40047c0 msgr2=0x7fb7a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.188+0000 7fb7bad9d640 1 --2- 172.21.15.114:0/1095964381 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7a40047c0 0x7fb7a4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.188+0000 7fb7bad9d640 1 -- 172.21.15.114:0/1095964381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7a4005180 msgr2=0x7fb7a402d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.188+0000 7fb7bad9d640 1 --2- 172.21.15.114:0/1095964381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7a4005180 0x7fb7a402d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.188+0000 7fb7bad9d640 1 -- 172.21.15.114:0/1095964381 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b40515b0 con 0x7fb7a4003970 2023-11-04T01:36:50.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.188+0000 7fb7bb59e640 1 -- 172.21.15.114:0/1095964381 reap_dead start 2023-11-04T01:36:50.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.189+0000 7fb7ba59c640 1 --2- 172.21.15.114:0/1095964381 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7a40047c0 0x7fb7a4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.192+0000 7fb7bad9d640 1 --2- 172.21.15.114:0/1095964381 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7a4003970 0x7fb7a4003d90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009860 tx=0x7fb7a40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce905753926c5d02 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.198+0000 7fcbeeffd640 1 -- 172.21.15.114:0/2667584089 --> [v2:172.21.15.141:6800/3610353173,v1:172.21.15.141:6801/3610353173] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcbfc04fc70 con 0x7fcbe8074490 2023-11-04T01:36:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.198+0000 7f3ab8075640 1 -- 172.21.15.114:0/2077454707 --> [v2:172.21.15.141:6824/4009772147,v1:172.21.15.141:6825/4009772147] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3a98002cb0 con 0x7f3a940745b0 2023-11-04T01:36:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.198+0000 7f3aa67fc640 1 -- 172.21.15.114:0/2077454707 <== osd.7 v2:172.21.15.141:6824/4009772147 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3a98002cb0 con 0x7f3a940745b0 2023-11-04T01:36:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.198+0000 7fcc017fa640 1 -- 172.21.15.114:0/2667584089 <== osd.4 v2:172.21.15.141:6800/3610353173 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcbf8001390 con 0x7fcbe8074490 2023-11-04T01:36:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.197+0000 7fb7b9d9b640 1 -- 172.21.15.114:0/1095964381 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac032600 con 0x7fb7a4003970 2023-11-04T01:36:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.197+0000 7fb7b9d9b640 1 -- 172.21.15.114:0/1095964381 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac02e050 con 0x7fb7a4003970 2023-11-04T01:36:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.197+0000 7fb7b9d9b640 1 -- 172.21.15.114:0/1095964381 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac032a20 con 0x7fb7a4003970 2023-11-04T01:36:50.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.198+0000 7fb7c080f640 1 -- 172.21.15.114:0/1095964381 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7a4003970 msgr2=0x7fb7a4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.198+0000 7fb7c080f640 1 --2- 172.21.15.114:0/1095964381 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7a4003970 0x7fb7a4003d90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009860 tx=0x7fb7a40057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.199+0000 7fcbeeffd640 1 -- 172.21.15.114:0/2667584089 >> [v2:172.21.15.141:6800/3610353173,v1:172.21.15.141:6801/3610353173] conn(0x7fcbe8074490 msgr2=0x7fcbe80768d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.199+0000 7fcbeeffd640 1 --2- 172.21.15.114:0/2667584089 >> [v2:172.21.15.141:6800/3610353173,v1:172.21.15.141:6801/3610353173] conn(0x7fcbe8074490 0x7fcbe80768d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.199+0000 7fb7c080f640 1 -- 172.21.15.114:0/1095964381 shutdown_connections 2023-11-04T01:36:50.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.199+0000 7fb7c080f640 1 --2- 172.21.15.114:0/1095964381 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7a4003970 0x7fb7a4003d90 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009860 tx=0x7fb7a40057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.199+0000 7fb7c080f640 1 -- 172.21.15.114:0/1095964381 >> 172.21.15.114:0/1095964381 conn(0x7fb7b4055d20 msgr2=0x7fb7b4056130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.199+0000 7f3a93fff640 1 -- 172.21.15.114:0/2077454707 >> [v2:172.21.15.141:6824/4009772147,v1:172.21.15.141:6825/4009772147] conn(0x7f3a940745b0 msgr2=0x7f3a940769f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.199+0000 7f3a93fff640 1 --2- 172.21.15.114:0/2077454707 >> [v2:172.21.15.141:6824/4009772147,v1:172.21.15.141:6825/4009772147] conn(0x7f3a940745b0 0x7f3a940769f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.199+0000 7fcbeeffd640 1 -- 172.21.15.114:0/2667584089 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcbe806afc0 msgr2=0x7fcbe806d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.199+0000 7fb7c080f640 1 -- 172.21.15.114:0/1095964381 shutdown_connections 2023-11-04T01:36:50.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.199+0000 7fcbeeffd640 1 --2- 172.21.15.114:0/2667584089 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcbe806afc0 0x7fcbe806d480 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcc04069c50 tx=0x7fcc04073d30 comp rx=0 tx=0).stop 2023-11-04T01:36:50.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.199+0000 7fcbeeffd640 1 -- 172.21.15.114:0/2667584089 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbfc0e77a0 msgr2=0x7fcbfc0d90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.199+0000 7fcbeeffd640 1 --2- 172.21.15.114:0/2667584089 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcbfc0e77a0 0x7fcbfc0d90e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0033000 tx=0x7fcbf00046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.199+0000 7fcc09019640 1 -- 172.21.15.114:0/2667584089 reap_dead start 2023-11-04T01:36:50.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.200+0000 7fcbeeffd640 1 -- 172.21.15.114:0/2667584089 shutdown_connections 2023-11-04T01:36:50.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.200+0000 7fcbeeffd640 1 -- 172.21.15.114:0/2667584089 >> 172.21.15.114:0/2667584089 conn(0x7fcbfc054b00 msgr2=0x7fcbfc037c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.200+0000 7f3a93fff640 1 -- 172.21.15.114:0/2077454707 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a9406af70 msgr2=0x7f3a9406d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.200+0000 7f3a93fff640 1 --2- 172.21.15.114:0/2077454707 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a9406af70 0x7f3a9406d430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3aac007fd0 tx=0x7f3aac007980 comp rx=0 tx=0).stop 2023-11-04T01:36:50.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.200+0000 7f3a93fff640 1 -- 172.21.15.114:0/2077454707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3aa80e78e0 msgr2=0x7f3aa80e6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.200+0000 7f3a93fff640 1 --2- 172.21.15.114:0/2077454707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3aa80e78e0 0x7f3aa80e6080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0009810 tx=0x7f3aa00046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.200+0000 7f3ab6612640 1 -- 172.21.15.114:0/2077454707 reap_dead start 2023-11-04T01:36:50.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.200+0000 7f3a93fff640 1 -- 172.21.15.114:0/2077454707 shutdown_connections 2023-11-04T01:36:50.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.200+0000 7f3a93fff640 1 -- 172.21.15.114:0/2077454707 >> 172.21.15.114:0/2077454707 conn(0x7f3aa8054c40 msgr2=0x7f3aa8055020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.200+0000 7fb7c080f640 1 -- 172.21.15.114:0/1095964381 wait complete. 2023-11-04T01:36:50.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.200+0000 7f3a93fff640 1 -- 172.21.15.114:0/2077454707 shutdown_connections 2023-11-04T01:36:50.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.200+0000 7f0df5d3c640 1 -- 172.21.15.114:0/2611182855 --> [v2:172.21.15.114:6816/3751724895,v1:172.21.15.114:6817/3751724895] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0df00ca550 con 0x7f0dd0074410 2023-11-04T01:36:50.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.200+0000 7f3a93fff640 1 -- 172.21.15.114:0/2077454707 wait complete. 2023-11-04T01:36:50.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.201+0000 7f0de7fff640 1 -- 172.21.15.114:0/2611182855 <== osd.3 v2:172.21.15.114:6816/3751724895 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0de8009bd0 con 0x7f0dd0074410 2023-11-04T01:36:50.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.201+0000 7fcbeeffd640 1 -- 172.21.15.114:0/2667584089 shutdown_connections 2023-11-04T01:36:50.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.201+0000 7fcbeeffd640 1 -- 172.21.15.114:0/2667584089 wait complete. 2023-11-04T01:36:50.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.201+0000 7faa45044640 1 -- 172.21.15.114:0/2752738673 --> [v2:172.21.15.114:6808/2234532734,v1:172.21.15.114:6809/2234532734] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa40159870 con 0x7faa200745b0 2023-11-04T01:36:50.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.202+0000 7faa377fe640 1 -- 172.21.15.114:0/2752738673 <== osd.1 v2:172.21.15.114:6808/2234532734 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faa3800a0d0 con 0x7faa200745b0 2023-11-04T01:36:50.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.202+0000 7f0de5ffb640 1 -- 172.21.15.114:0/2611182855 >> [v2:172.21.15.114:6816/3751724895,v1:172.21.15.114:6817/3751724895] conn(0x7f0dd0074410 msgr2=0x7f0dd0076850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.202+0000 7f0de5ffb640 1 --2- 172.21.15.114:0/2611182855 >> [v2:172.21.15.114:6816/3751724895,v1:172.21.15.114:6817/3751724895] conn(0x7f0dd0074410 0x7f0dd0076850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.202+0000 7f0de5ffb640 1 -- 172.21.15.114:0/2611182855 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0dd006af40 msgr2=0x7f0dd006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.202+0000 7f0de5ffb640 1 --2- 172.21.15.114:0/2611182855 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0dd006af40 0x7f0dd006d400 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8036000 tx=0x7f0dd803c040 comp rx=0 tx=0).stop 2023-11-04T01:36:50.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.203+0000 7f0de5ffb640 1 -- 172.21.15.114:0/2611182855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df00cb5b0 msgr2=0x7f0df00c5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.203+0000 7f0de5ffb640 1 --2- 172.21.15.114:0/2611182855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df00cb5b0 0x7f0df00c5a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0de000b6d0 tx=0x7f0de000bb90 comp rx=0 tx=0).stop 2023-11-04T01:36:50.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.203+0000 7f0deffff640 1 -- 172.21.15.114:0/2611182855 reap_dead start 2023-11-04T01:36:50.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.203+0000 7f0de5ffb640 1 -- 172.21.15.114:0/2611182855 shutdown_connections 2023-11-04T01:36:50.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.203+0000 7f0de5ffb640 1 -- 172.21.15.114:0/2611182855 >> 172.21.15.114:0/2611182855 conn(0x7f0df006a120 msgr2=0x7f0df00c38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.203+0000 7faa45044640 1 -- 172.21.15.114:0/2752738673 >> [v2:172.21.15.114:6808/2234532734,v1:172.21.15.114:6809/2234532734] conn(0x7faa200745b0 msgr2=0x7faa200769f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.203+0000 7faa45044640 1 --2- 172.21.15.114:0/2752738673 >> [v2:172.21.15.114:6808/2234532734,v1:172.21.15.114:6809/2234532734] conn(0x7faa200745b0 0x7faa200769f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.203+0000 7faa45044640 1 -- 172.21.15.114:0/2752738673 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faa2006af70 msgr2=0x7faa2006d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.203+0000 7faa45044640 1 --2- 172.21.15.114:0/2752738673 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faa2006af70 0x7faa2006d430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faa30005880 tx=0x7faa30009040 comp rx=0 tx=0).stop 2023-11-04T01:36:50.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.203+0000 7faa45044640 1 -- 172.21.15.114:0/2752738673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa40159060 msgr2=0x7faa40149fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.203+0000 7faa45044640 1 --2- 172.21.15.114:0/2752738673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa40159060 0x7faa40149fe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faa28009a90 tx=0x7faa28009f50 comp rx=0 tx=0).stop 2023-11-04T01:36:50.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.204+0000 7faa3f59e640 1 -- 172.21.15.114:0/2752738673 reap_dead start 2023-11-04T01:36:50.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.204+0000 7faa45044640 1 -- 172.21.15.114:0/2752738673 shutdown_connections 2023-11-04T01:36:50.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.204+0000 7faa45044640 1 -- 172.21.15.114:0/2752738673 >> 172.21.15.114:0/2752738673 conn(0x7faa4006a120 msgr2=0x7faa400cdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.204+0000 7faa45044640 1 -- 172.21.15.114:0/2752738673 shutdown_connections 2023-11-04T01:36:50.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.204+0000 7faa45044640 1 -- 172.21.15.114:0/2752738673 wait complete. 2023-11-04T01:36:50.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.203+0000 7fb7c080f640 1 Processor -- start 2023-11-04T01:36:50.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.203+0000 7fb7c080f640 1 -- start start 2023-11-04T01:36:50.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.205+0000 7f75844e0640 1 -- 172.21.15.114:0/686604736 --> [v2:172.21.15.141:6808/1912829833,v1:172.21.15.141:6809/1912829833] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7564002cb0 con 0x7f7560074580 2023-11-04T01:36:50.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.204+0000 7fb7c080f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7b40cfae0 0x7fb7b40345a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.205+0000 7fb7c080f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7b404cf10 0x7fb7b40eb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.205+0000 7fb7c080f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7b40eb6f0 0x7fb7b40d7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.205+0000 7fb7c080f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b40ebba0 con 0x7fb7b404cf10 2023-11-04T01:36:50.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.205+0000 7fb7c080f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b404fbc0 con 0x7fb7b40cfae0 2023-11-04T01:36:50.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.205+0000 7fb7c080f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b4034ae0 con 0x7fb7b40eb6f0 2023-11-04T01:36:50.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.205+0000 7fb7bb59e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7b40eb6f0 0x7fb7b40d7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.205+0000 7fb7bb59e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7b40eb6f0 0x7fb7b40d7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:51724/0 (socket says 172.21.15.114:51724) 2023-11-04T01:36:50.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.205+0000 7fb7bb59e640 1 -- 172.21.15.114:0/996818596 learned_addr learned my addr 172.21.15.114:0/996818596 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.205+0000 7fb7bb59e640 1 -- 172.21.15.114:0/996818596 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7b40cfae0 msgr2=0x7fb7b40345a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.205+0000 7fb7bb59e640 1 --2- 172.21.15.114:0/996818596 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7b40cfae0 0x7fb7b40345a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.205+0000 7fb7bb59e640 1 -- 172.21.15.114:0/996818596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7b404cf10 msgr2=0x7fb7b40eb1b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:36:50.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.205+0000 7fb7bb59e640 1 --2- 172.21.15.114:0/996818596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7b404cf10 0x7fb7b40eb1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.205+0000 7fb7bb59e640 1 -- 172.21.15.114:0/996818596 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b4050050 con 0x7fb7b40eb6f0 2023-11-04T01:36:50.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.206+0000 7fb7bb59e640 1 --2- 172.21.15.114:0/996818596 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7b40eb6f0 0x7fb7b40d7cf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc04fd90 tx=0x7fb7bc072810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.206+0000 7f0de5ffb640 1 -- 172.21.15.114:0/2611182855 shutdown_connections 2023-11-04T01:36:50.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.206+0000 7f0de5ffb640 1 -- 172.21.15.114:0/2611182855 wait complete. 2023-11-04T01:36:50.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.206+0000 7fb7a37fe640 1 -- 172.21.15.114:0/996818596 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc093430 con 0x7fb7b40eb6f0 2023-11-04T01:36:50.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.206+0000 7fb7a37fe640 1 -- 172.21.15.114:0/996818596 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc093590 con 0x7fb7b40eb6f0 2023-11-04T01:36:50.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.206+0000 7fb7c080f640 1 -- 172.21.15.114:0/996818596 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b404efb0 con 0x7fb7b40eb6f0 2023-11-04T01:36:50.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.206+0000 7fb7a37fe640 1 -- 172.21.15.114:0/996818596 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc093900 con 0x7fb7b40eb6f0 2023-11-04T01:36:50.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.207+0000 7fb7c080f640 1 -- 172.21.15.114:0/996818596 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b404f570 con 0x7fb7b40eb6f0 2023-11-04T01:36:50.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.209+0000 7fb7a37fe640 1 -- 172.21.15.114:0/996818596 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb7bc0b8060 con 0x7fb7b40eb6f0 2023-11-04T01:36:50.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.209+0000 7fb7c080f640 1 -- 172.21.15.114:0/996818596 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7b4053990 con 0x7fb7b40eb6f0 2023-11-04T01:36:50.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.209+0000 7fb7a37fe640 1 --2- 172.21.15.114:0/996818596 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb7a806af40 0x7fb7a806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.209+0000 7fb7a37fe640 1 -- 172.21.15.114:0/996818596 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb7bc0b6070 con 0x7fb7b40eb6f0 2023-11-04T01:36:50.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.210+0000 7fb7a37fe640 1 --2- 172.21.15.114:0/996818596 >> [v2:172.21.15.114:6800/2535026958,v1:172.21.15.114:6801/2535026958] conn(0x7fb7a80744f0 0x7fb7a8076930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.210+0000 7fb7a37fe640 1 -- 172.21.15.114:0/996818596 --> [v2:172.21.15.114:6800/2535026958,v1:172.21.15.114:6801/2535026958] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7a8077000 con 0x7fb7a80744f0 2023-11-04T01:36:50.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.210+0000 7fb7a37fe640 1 -- 172.21.15.114:0/996818596 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7bc0b5030 con 0x7fb7b40eb6f0 2023-11-04T01:36:50.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.210+0000 7f7572ffd640 1 -- 172.21.15.114:0/686604736 <== osd.6 v2:172.21.15.141:6808/1912829833 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7564002cb0 con 0x7f7560074580 2023-11-04T01:36:50.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.210+0000 7fb7ba59c640 1 --2- 172.21.15.114:0/996818596 >> [v2:172.21.15.114:6800/2535026958,v1:172.21.15.114:6801/2535026958] conn(0x7fb7a80744f0 0x7fb7a8076930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.210+0000 7fb7bad9d640 1 --2- 172.21.15.114:0/996818596 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb7a806af40 0x7fb7a806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.211+0000 7f60e78f2640 1 -- 172.21.15.114:0/1749565170 --> [v2:172.21.15.114:6824/3823972084,v1:172.21.15.114:6825/3823972084] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f60e00d04b0 con 0x7f60c4074500 2023-11-04T01:36:50.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.211+0000 7f60d5ffb640 1 -- 172.21.15.114:0/1749565170 <== osd.2 v2:172.21.15.114:6824/3823972084 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f60c4077010 con 0x7f60c4074500 2023-11-04T01:36:50.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.211+0000 7fb7bad9d640 1 --2- 172.21.15.114:0/996818596 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb7a806af40 0x7fb7a806d400 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac034000 tx=0x7fb7ac02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.211+0000 7f464ecec640 1 Processor -- start 2023-11-04T01:36:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.211+0000 7f464ecec640 1 -- start start 2023-11-04T01:36:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.213+0000 7f464ecec640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4648169b30 0x7f4648070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.213+0000 7f464ecec640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f464806db50 0x7f46480890e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.213+0000 7f464ecec640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4648071560 con 0x7f464816e390 2023-11-04T01:36:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.213+0000 7f464ecec640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464816df70 con 0x7f4648169b30 2023-11-04T01:36:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.213+0000 7f464ecec640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4648071280 con 0x7f464806db50 2023-11-04T01:36:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.213+0000 7f464d289640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f464806db50 0x7f46480890e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.213+0000 7f4647fff640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f464816e390 0x7f464806d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:45726/0 (socket says 172.21.15.114:45726) 2023-11-04T01:36:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.213+0000 7f4647fff640 1 -- 172.21.15.114:0/1827885031 learned_addr learned my addr 172.21.15.114:0/1827885031 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.213+0000 7f464ca88640 1 --2- 172.21.15.114:0/1827885031 >> v2:172.21.15.141:3300/0 conn(0x7f4648169b30 0x7f4648070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.213+0000 7f75844e0640 1 -- 172.21.15.114:0/686604736 >> [v2:172.21.15.141:6808/1912829833,v1:172.21.15.141:6809/1912829833] conn(0x7f7560074580 msgr2=0x7f75600769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.213+0000 7f75844e0640 1 --2- 172.21.15.114:0/686604736 >> [v2:172.21.15.141:6808/1912829833,v1:172.21.15.141:6809/1912829833] conn(0x7f7560074580 0x7f75600769c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.213+0000 7f75844e0640 1 -- 172.21.15.114:0/686604736 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f756006af40 msgr2=0x7f756006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.213+0000 7f75844e0640 1 --2- 172.21.15.114:0/686604736 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f756006af40 0x7f756006d400 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f757800c9b0 tx=0x7f7578008040 comp rx=0 tx=0).stop 2023-11-04T01:36:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.213+0000 7f75844e0640 1 -- 172.21.15.114:0/686604736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f757c161680 msgr2=0x7f757c15f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.213+0000 7f75844e0640 1 --2- 172.21.15.114:0/686604736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f757c161680 0x7f757c15f630 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f756c0098c0 tx=0x7f756c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.214+0000 7fb7ba59c640 1 --2- 172.21.15.114:0/996818596 >> [v2:172.21.15.114:6800/2535026958,v1:172.21.15.114:6801/2535026958] conn(0x7fb7a80744f0 0x7fb7a8076930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.214+0000 7f464d289640 1 -- 172.21.15.114:0/1827885031 >> v2:172.21.15.141:3300/0 conn(0x7f4648169b30 msgr2=0x7f4648070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.214+0000 7f46477fe640 1 -- 172.21.15.114:0/1827885031 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192751942 0 0) 0x7f4648071560 con 0x7f464816e390 2023-11-04T01:36:50.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.214+0000 7f464d289640 1 --2- 172.21.15.114:0/1827885031 >> v2:172.21.15.141:3300/0 conn(0x7f4648169b30 0x7f4648070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.214+0000 7f464d289640 1 -- 172.21.15.114:0/1827885031 >> v1:172.21.15.141:6789/0 conn(0x7f464816e390 legacy=0x7f464806d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.214+0000 7f464d289640 1 -- 172.21.15.114:0/1827885031 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464816d8b0 con 0x7f464806db50 2023-11-04T01:36:50.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.214+0000 7f464ca88640 1 --2- 172.21.15.114:0/1827885031 >> v2:172.21.15.141:3300/0 conn(0x7f4648169b30 0x7f4648070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.215+0000 7f60e78f2640 1 -- 172.21.15.114:0/1749565170 >> [v2:172.21.15.114:6824/3823972084,v1:172.21.15.114:6825/3823972084] conn(0x7f60c4074500 msgr2=0x7f60c4076940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.215+0000 7f60e78f2640 1 --2- 172.21.15.114:0/1749565170 >> [v2:172.21.15.114:6824/3823972084,v1:172.21.15.114:6825/3823972084] conn(0x7f60c4074500 0x7f60c4076940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.215+0000 7f7582a7d640 1 -- 172.21.15.114:0/686604736 reap_dead start 2023-11-04T01:36:50.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.215+0000 7f60e78f2640 1 -- 172.21.15.114:0/1749565170 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60c406af40 msgr2=0x7f60c406d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.215+0000 7f60e78f2640 1 --2- 172.21.15.114:0/1749565170 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60c406af40 0x7f60c406d400 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f60e015e5d0 tx=0x7f60dc009040 comp rx=0 tx=0).stop 2023-11-04T01:36:50.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.215+0000 7fb7a37fe640 1 -- 172.21.15.114:0/996818596 <== osd.0 v2:172.21.15.114:6800/2535026958 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fb7a8077000 con 0x7fb7a80744f0 2023-11-04T01:36:50.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.215+0000 7f60e78f2640 1 -- 172.21.15.114:0/1749565170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60e015af20 msgr2=0x7f60e01f2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.215+0000 7f60e78f2640 1 --2- 172.21.15.114:0/1749565170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60e015af20 0x7f60e01f2380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f60e00b3760 tx=0x7f60d8004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.215+0000 7f60e5e8f640 1 -- 172.21.15.114:0/1749565170 reap_dead start 2023-11-04T01:36:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.215+0000 7f464d289640 1 --2- 172.21.15.114:0/1827885031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f464806db50 0x7f46480890e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4640009d90 tx=0x7f464002be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea0f57a2024afd0d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.217+0000 7f60e78f2640 1 -- 172.21.15.114:0/1749565170 shutdown_connections 2023-11-04T01:36:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.217+0000 7f60e78f2640 1 -- 172.21.15.114:0/1749565170 >> 172.21.15.114:0/1749565170 conn(0x7f60e006ea20 msgr2=0x7f60e00d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.216+0000 7f46477fe640 1 -- 172.21.15.114:0/1827885031 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464002cbd0 con 0x7f464806db50 2023-11-04T01:36:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.216+0000 7f46477fe640 1 -- 172.21.15.114:0/1827885031 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464002cd30 con 0x7f464806db50 2023-11-04T01:36:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.216+0000 7f46477fe640 1 -- 172.21.15.114:0/1827885031 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464002cea0 con 0x7f464806db50 2023-11-04T01:36:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.217+0000 7f464ecec640 1 -- 172.21.15.114:0/1827885031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f464806db50 msgr2=0x7f46480890e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.217+0000 7f464ecec640 1 --2- 172.21.15.114:0/1827885031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f464806db50 0x7f46480890e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4640009d90 tx=0x7f464002be20 comp rx=0 tx=0).stop 2023-11-04T01:36:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.217+0000 7f464ecec640 1 -- 172.21.15.114:0/1827885031 shutdown_connections 2023-11-04T01:36:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.217+0000 7f464ecec640 1 --2- 172.21.15.114:0/1827885031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f464806db50 0x7f46480890e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.217+0000 7f60e78f2640 1 -- 172.21.15.114:0/1749565170 shutdown_connections 2023-11-04T01:36:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.217+0000 7f60e78f2640 1 -- 172.21.15.114:0/1749565170 wait complete. 2023-11-04T01:36:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.217+0000 7f464ecec640 1 --2- 172.21.15.114:0/1827885031 >> v2:172.21.15.141:3300/0 conn(0x7f4648169b30 0x7f4648070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.217+0000 7f464ecec640 1 -- 172.21.15.114:0/1827885031 >> 172.21.15.114:0/1827885031 conn(0x7f464806a120 msgr2=0x7f464806a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.217+0000 7f464ecec640 1 -- 172.21.15.114:0/1827885031 shutdown_connections 2023-11-04T01:36:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.217+0000 7f464ecec640 1 -- 172.21.15.114:0/1827885031 wait complete. 2023-11-04T01:36:50.250 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-11-04T01:36:50.251 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-04T01:36:50.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.219+0000 7f464ecec640 1 Processor -- start 2023-11-04T01:36:50.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.219+0000 7f464ecec640 1 -- start start 2023-11-04T01:36:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.220+0000 7f75844e0640 1 -- 172.21.15.114:0/686604736 shutdown_connections 2023-11-04T01:36:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.220+0000 7f75844e0640 1 -- 172.21.15.114:0/686604736 >> 172.21.15.114:0/686604736 conn(0x7f757c06a120 msgr2=0x7f757c06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.220+0000 7f75844e0640 1 -- 172.21.15.114:0/686604736 shutdown_connections 2023-11-04T01:36:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.220+0000 7f75844e0640 1 -- 172.21.15.114:0/686604736 wait complete. 2023-11-04T01:36:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.220+0000 7f464ecec640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f464806db50 0x7f46480ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.221+0000 7f464ecec640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4648169b30 0x7f464816c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.221+0000 7f464ecec640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f464816e390 0x7f46480b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.221+0000 7f464ca88640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f464806db50 0x7f46480ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.221+0000 7f464ca88640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f464806db50 0x7f46480ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49186/0 (socket says 172.21.15.114:49186) 2023-11-04T01:36:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.221+0000 7f464ecec640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46480b0480 con 0x7f464806db50 2023-11-04T01:36:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.221+0000 7f464ca88640 1 -- 172.21.15.114:0/966697208 learned_addr learned my addr 172.21.15.114:0/966697208 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.221+0000 7f464ecec640 1 -- 172.21.15.114:0/966697208 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4648088880 con 0x7f4648169b30 2023-11-04T01:36:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.221+0000 7f464ecec640 1 -- 172.21.15.114:0/966697208 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4648088b60 con 0x7f464816e390 2023-11-04T01:36:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.221+0000 7f4647fff640 1 --2- 172.21.15.114:0/966697208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4648169b30 0x7f464816c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.221+0000 7f464d289640 1 --2- 172.21.15.114:0/966697208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f464816e390 0x7f46480b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.222+0000 7f4647fff640 1 -- 172.21.15.114:0/966697208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f464816e390 msgr2=0x7f46480b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.222+0000 7f4647fff640 1 --2- 172.21.15.114:0/966697208 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f464816e390 0x7f46480b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.222+0000 7f4647fff640 1 -- 172.21.15.114:0/966697208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f464806db50 msgr2=0x7f46480ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.222+0000 7f4647fff640 1 --2- 172.21.15.114:0/966697208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f464806db50 0x7f46480ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.222+0000 7f4647fff640 1 -- 172.21.15.114:0/966697208 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c009400 con 0x7f4648169b30 2023-11-04T01:36:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.222+0000 7f4647fff640 1 --2- 172.21.15.114:0/966697208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4648169b30 0x7f464816c690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f463400c450 tx=0x7f463400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.222+0000 7f46457fa640 1 -- 172.21.15.114:0/966697208 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46340074e0 con 0x7f4648169b30 2023-11-04T01:36:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.222+0000 7f464ecec640 1 -- 172.21.15.114:0/966697208 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4640009a70 con 0x7f4648169b30 2023-11-04T01:36:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.222+0000 7f464ecec640 1 -- 172.21.15.114:0/966697208 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46480b0050 con 0x7f4648169b30 2023-11-04T01:36:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.222+0000 7f464ca88640 1 --2- 172.21.15.114:0/966697208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f464806db50 0x7f46480ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:50.257 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-11-04T01:36:50.257 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-04T01:36:50.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.223+0000 7f46457fa640 1 -- 172.21.15.114:0/966697208 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4634007640 con 0x7f4648169b30 2023-11-04T01:36:50.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.223+0000 7f46457fa640 1 -- 172.21.15.114:0/966697208 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634004a00 con 0x7f4648169b30 2023-11-04T01:36:50.258 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-11-04T01:36:50.259 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-04T01:36:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.225+0000 7f464ecec640 1 -- 172.21.15.114:0/966697208 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46480adfb0 con 0x7f4648169b30 2023-11-04T01:36:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.225+0000 7f46457fa640 1 -- 172.21.15.114:0/966697208 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4634004b60 con 0x7f4648169b30 2023-11-04T01:36:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.226+0000 7f46457fa640 1 --2- 172.21.15.114:0/966697208 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f462c06aea0 0x7f462c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.226+0000 7f46457fa640 1 -- 172.21.15.114:0/966697208 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4634088ee0 con 0x7f4648169b30 2023-11-04T01:36:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.226+0000 7f464ca88640 1 --2- 172.21.15.114:0/966697208 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f462c06aea0 0x7f462c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.226+0000 7f46457fa640 1 --2- 172.21.15.114:0/966697208 >> [v2:172.21.15.141:6814/2089373315,v1:172.21.15.141:6816/2089373315] conn(0x7f462c0744e0 0x7f462c076920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.226+0000 7f46457fa640 1 -- 172.21.15.114:0/966697208 --> [v2:172.21.15.141:6814/2089373315,v1:172.21.15.141:6816/2089373315] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f462c076ff0 con 0x7f462c0744e0 2023-11-04T01:36:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.226+0000 7f46457fa640 1 -- 172.21.15.114:0/966697208 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f463408b500 con 0x7f4648169b30 2023-11-04T01:36:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.226+0000 7f464d289640 1 --2- 172.21.15.114:0/966697208 >> [v2:172.21.15.141:6814/2089373315,v1:172.21.15.141:6816/2089373315] conn(0x7f462c0744e0 0x7f462c076920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.226+0000 7f464ca88640 1 --2- 172.21.15.114:0/966697208 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f462c06aea0 0x7f462c06d360 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f46480ad150 tx=0x7f463c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.227+0000 7f464d289640 1 --2- 172.21.15.114:0/966697208 >> [v2:172.21.15.141:6814/2089373315,v1:172.21.15.141:6816/2089373315] conn(0x7f462c0744e0 0x7f462c076920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.227+0000 7f46457fa640 1 -- 172.21.15.114:0/966697208 <== osd.5 v2:172.21.15.141:6814/2089373315 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f462c076ff0 con 0x7f462c0744e0 2023-11-04T01:36:50.261 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-11-04T01:36:50.262 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T01:36:50.262 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-11-04T01:36:50.263 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T01:36:50.263 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2023-11-04T01:36:50.264 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-04T01:36:50.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.240+0000 7fb7c080f640 1 -- 172.21.15.114:0/996818596 --> [v2:172.21.15.114:6800/2535026958,v1:172.21.15.114:6801/2535026958] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb7b4051890 con 0x7fb7a80744f0 2023-11-04T01:36:50.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.241+0000 7fb7a37fe640 1 -- 172.21.15.114:0/996818596 <== osd.0 v2:172.21.15.114:6800/2535026958 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb7b0005a60 con 0x7fb7a80744f0 2023-11-04T01:36:50.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.241+0000 7fb7c080f640 1 -- 172.21.15.114:0/996818596 >> [v2:172.21.15.114:6800/2535026958,v1:172.21.15.114:6801/2535026958] conn(0x7fb7a80744f0 msgr2=0x7fb7a8076930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.241+0000 7fb7c080f640 1 --2- 172.21.15.114:0/996818596 >> [v2:172.21.15.114:6800/2535026958,v1:172.21.15.114:6801/2535026958] conn(0x7fb7a80744f0 0x7fb7a8076930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.241+0000 7fb7c080f640 1 -- 172.21.15.114:0/996818596 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb7a806af40 msgr2=0x7fb7a806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.241+0000 7fb7c080f640 1 --2- 172.21.15.114:0/996818596 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb7a806af40 0x7fb7a806d400 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac034000 tx=0x7fb7ac02f000 comp rx=0 tx=0).stop 2023-11-04T01:36:50.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.241+0000 7fb7c080f640 1 -- 172.21.15.114:0/996818596 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7b40eb6f0 msgr2=0x7fb7b40d7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.241+0000 7fb7c080f640 1 --2- 172.21.15.114:0/996818596 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7b40eb6f0 0x7fb7b40d7cf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc04fd90 tx=0x7fb7bc072810 comp rx=0 tx=0).stop 2023-11-04T01:36:50.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.241+0000 7fb7bb59e640 1 -- 172.21.15.114:0/996818596 reap_dead start 2023-11-04T01:36:50.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.242+0000 7fb7c080f640 1 -- 172.21.15.114:0/996818596 shutdown_connections 2023-11-04T01:36:50.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.242+0000 7fb7c080f640 1 -- 172.21.15.114:0/996818596 >> 172.21.15.114:0/996818596 conn(0x7fb7b4055d20 msgr2=0x7fb7b40e7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.242+0000 7fb7c080f640 1 -- 172.21.15.114:0/996818596 shutdown_connections 2023-11-04T01:36:50.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.242+0000 7fb7c080f640 1 -- 172.21.15.114:0/996818596 wait complete. 2023-11-04T01:36:50.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.242+0000 7f464ecec640 1 -- 172.21.15.114:0/966697208 --> [v2:172.21.15.141:6814/2089373315,v1:172.21.15.141:6816/2089373315] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f464816db90 con 0x7f462c0744e0 2023-11-04T01:36:50.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.243+0000 7f46457fa640 1 -- 172.21.15.114:0/966697208 <== osd.5 v2:172.21.15.141:6814/2089373315 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4640009450 con 0x7f462c0744e0 2023-11-04T01:36:50.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.243+0000 7f464ecec640 1 -- 172.21.15.114:0/966697208 >> [v2:172.21.15.141:6814/2089373315,v1:172.21.15.141:6816/2089373315] conn(0x7f462c0744e0 msgr2=0x7f462c076920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.243+0000 7f464ecec640 1 --2- 172.21.15.114:0/966697208 >> [v2:172.21.15.141:6814/2089373315,v1:172.21.15.141:6816/2089373315] conn(0x7f462c0744e0 0x7f462c076920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.243+0000 7f464ecec640 1 -- 172.21.15.114:0/966697208 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f462c06aea0 msgr2=0x7f462c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.243+0000 7f464ecec640 1 --2- 172.21.15.114:0/966697208 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f462c06aea0 0x7f462c06d360 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f46480ad150 tx=0x7f463c008040 comp rx=0 tx=0).stop 2023-11-04T01:36:50.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.243+0000 7f464ecec640 1 -- 172.21.15.114:0/966697208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4648169b30 msgr2=0x7f464816c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.243+0000 7f464ecec640 1 --2- 172.21.15.114:0/966697208 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4648169b30 0x7f464816c690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f463400c450 tx=0x7f463400c910 comp rx=0 tx=0).stop 2023-11-04T01:36:50.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.243+0000 7f464d289640 1 -- 172.21.15.114:0/966697208 reap_dead start 2023-11-04T01:36:50.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.243+0000 7f464ecec640 1 -- 172.21.15.114:0/966697208 shutdown_connections 2023-11-04T01:36:50.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.243+0000 7f464ecec640 1 -- 172.21.15.114:0/966697208 >> 172.21.15.114:0/966697208 conn(0x7f464806a120 msgr2=0x7f4648070610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.244+0000 7f464ecec640 1 -- 172.21.15.114:0/966697208 shutdown_connections 2023-11-04T01:36:50.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.244+0000 7f464ecec640 1 -- 172.21.15.114:0/966697208 wait complete. 2023-11-04T01:36:50.269 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2023-11-04T01:36:50.270 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T01:36:50.270 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2023-11-04T01:36:50.271 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-04T01:36:50.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.461+0000 7fe00b59e640 1 Processor -- start 2023-11-04T01:36:50.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.461+0000 7fe00b59e640 1 -- start start 2023-11-04T01:36:50.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.462+0000 7fe00b59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe00c158ad0 0x7fe00c0c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.462+0000 7fe00b59e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe00c0ce6c0 0x7fe00c0ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.462+0000 7fe00b59e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00c15d3c0 con 0x7fe00c158eb0 2023-11-04T01:36:50.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.462+0000 7fe00b59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00c0cf090 con 0x7fe00c158ad0 2023-11-04T01:36:50.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.463+0000 7fe00b59e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00c0c90b0 con 0x7fe00c0ce6c0 2023-11-04T01:36:50.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.463+0000 7fe00a59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe00c158ad0 0x7fe00c0c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.463+0000 7fe00a59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe00c158ad0 0x7fe00c0c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49194/0 (socket says 172.21.15.114:49194) 2023-11-04T01:36:50.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.463+0000 7fe00a59c640 1 -- 172.21.15.114:0/625268250 learned_addr learned my addr 172.21.15.114:0/625268250 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.464+0000 7fe00a59c640 1 -- 172.21.15.114:0/625268250 >> v2:172.21.15.141:3300/0 conn(0x7fe00c0ce6c0 msgr2=0x7fe00c0ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.464+0000 7fe00a59c640 1 --2- 172.21.15.114:0/625268250 >> v2:172.21.15.141:3300/0 conn(0x7fe00c0ce6c0 0x7fe00c0ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.464+0000 7fe00a59c640 1 -- 172.21.15.114:0/625268250 >> v1:172.21.15.141:6789/0 conn(0x7fe00c158eb0 legacy=0x7fe00c15c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.464+0000 7fe00a59c640 1 -- 172.21.15.114:0/625268250 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c15d6a0 con 0x7fe00c158ad0 2023-11-04T01:36:50.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.465+0000 7fe00a59c640 1 --2- 172.21.15.114:0/625268250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00c158ad0 0x7fe00c0c9ac0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0ca230 tx=0x7fdffc02b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efaca4cfa0419a76 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.469+0000 7fe00959a640 1 -- 172.21.15.114:0/625268250 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc031800 con 0x7fe00c158ad0 2023-11-04T01:36:50.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.469+0000 7fe00959a640 1 -- 172.21.15.114:0/625268250 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc031960 con 0x7fe00c158ad0 2023-11-04T01:36:50.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.469+0000 7fe00959a640 1 -- 172.21.15.114:0/625268250 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc031cf0 con 0x7fe00c158ad0 2023-11-04T01:36:50.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.470+0000 7fe00b59e640 1 -- 172.21.15.114:0/625268250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00c158ad0 msgr2=0x7fe00c0c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.470+0000 7fe00b59e640 1 --2- 172.21.15.114:0/625268250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00c158ad0 0x7fe00c0c9ac0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0ca230 tx=0x7fdffc02b8a0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.471+0000 7fe00b59e640 1 -- 172.21.15.114:0/625268250 shutdown_connections 2023-11-04T01:36:50.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.471+0000 7fe00b59e640 1 --2- 172.21.15.114:0/625268250 >> v2:172.21.15.141:3300/0 conn(0x7fe00c0ce6c0 0x7fe00c0ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.471+0000 7fe00b59e640 1 --2- 172.21.15.114:0/625268250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00c158ad0 0x7fe00c0c9ac0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.471+0000 7fe00b59e640 1 -- 172.21.15.114:0/625268250 >> 172.21.15.114:0/625268250 conn(0x7fe00c06a120 msgr2=0x7fe00c06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.471+0000 7fc081225640 1 Processor -- start 2023-11-04T01:36:50.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.471+0000 7fc081225640 1 -- start start 2023-11-04T01:36:50.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.472+0000 7f340b167640 1 Processor -- start 2023-11-04T01:36:50.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.472+0000 7f340b167640 1 -- start start 2023-11-04T01:36:50.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.472+0000 7fe00b59e640 1 -- 172.21.15.114:0/625268250 shutdown_connections 2023-11-04T01:36:50.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.472+0000 7fc081225640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc07c158ad0 0x7fc07c0c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.472+0000 7fc081225640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc07c158eb0 0x7fc07c15c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.472+0000 7fc081225640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07c15d3c0 con 0x7fc07c15ce40 2023-11-04T01:36:50.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.472+0000 7fc081225640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07c0c90b0 con 0x7fc07c158eb0 2023-11-04T01:36:50.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.472+0000 7fc081225640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0ca000 con 0x7fc07c158ad0 2023-11-04T01:36:50.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.473+0000 7fc07b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc07c158eb0 0x7fc07c15c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.473+0000 7fc07b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc07c158eb0 0x7fc07c15c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49198/0 (socket says 172.21.15.114:49198) 2023-11-04T01:36:50.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.473+0000 7fc07b7fe640 1 -- 172.21.15.114:0/2278038043 learned_addr learned my addr 172.21.15.114:0/2278038043 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.473+0000 7fc07bfff640 1 --2- 172.21.15.114:0/2278038043 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc07c158ad0 0x7fc07c0c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.472+0000 7fe00b59e640 1 -- 172.21.15.114:0/625268250 wait complete. 2023-11-04T01:36:50.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.473+0000 7f340b167640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f340415cc60 0x7f34040d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.473+0000 7fc07b7fe640 1 -- 172.21.15.114:0/2278038043 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc07c158ad0 msgr2=0x7fc07c0c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.473+0000 7f340b167640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34040b8970 0x7f34040cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.473+0000 7fc07b7fe640 1 --2- 172.21.15.114:0/2278038043 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc07c158ad0 0x7fc07c0c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.473+0000 7fc07b7fe640 1 -- 172.21.15.114:0/2278038043 >> v1:172.21.15.141:6789/0 conn(0x7fc07c15ce40 legacy=0x7fc07c0ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.473+0000 7f340a165640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f340415cc60 0x7f34040d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.473+0000 7f340a165640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f340415cc60 0x7f34040d0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35086/0 (socket says 172.21.15.114:35086) 2023-11-04T01:36:50.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.473+0000 7fc07b7fe640 1 -- 172.21.15.114:0/2278038043 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c15d6a0 con 0x7fc07c158eb0 2023-11-04T01:36:50.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.474+0000 7f340a165640 1 -- 172.21.15.114:0/2231212032 learned_addr learned my addr 172.21.15.114:0/2231212032 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.474+0000 7f3409964640 1 --2- 172.21.15.114:0/2231212032 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34040b8970 0x7f34040cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.474+0000 7f340b167640 1 -- 172.21.15.114:0/2231212032 --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34040d2220 con 0x7f34040d1170 2023-11-04T01:36:50.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.474+0000 7f340b167640 1 -- 172.21.15.114:0/2231212032 --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34040d1610 con 0x7f340415cc60 2023-11-04T01:36:50.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.474+0000 7f340b167640 1 -- 172.21.15.114:0/2231212032 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34040d18f0 con 0x7f34040b8970 2023-11-04T01:36:50.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.475+0000 7f30c2ebb640 1 Processor -- start 2023-11-04T01:36:50.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.475+0000 7fc07b7fe640 1 --2- 172.21.15.114:0/2278038043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc07c158eb0 0x7fc07c15c900 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc070008870 tx=0x7fc07002df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbb7b9e94758e11 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.474+0000 7f340a165640 1 -- 172.21.15.114:0/2231212032 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34040b8970 msgr2=0x7f34040cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.474+0000 7f340a165640 1 --2- 172.21.15.114:0/2231212032 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34040b8970 0x7f34040cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.474+0000 7f340a165640 1 -- 172.21.15.114:0/2231212032 >> v1:172.21.15.141:6789/0 conn(0x7f34040d1170 legacy=0x7f34040b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.474+0000 7f340a165640 1 -- 172.21.15.114:0/2231212032 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34040d1bd0 con 0x7f340415cc60 2023-11-04T01:36:50.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.476+0000 7f340a165640 1 --2- 172.21.15.114:0/2231212032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f340415cc60 0x7f34040d0c30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3400009870 tx=0x7f340002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa9965baef69ec3e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.475+0000 7fc07affd640 1 -- 172.21.15.114:0/2278038043 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07002ed00 con 0x7fc07c158eb0 2023-11-04T01:36:50.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.475+0000 7fc07affd640 1 -- 172.21.15.114:0/2278038043 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc070032070 con 0x7fc07c158eb0 2023-11-04T01:36:50.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.475+0000 7fc07affd640 1 -- 172.21.15.114:0/2278038043 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07002eea0 con 0x7fc07c158eb0 2023-11-04T01:36:50.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.476+0000 7f3409163640 1 -- 172.21.15.114:0/2231212032 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400030860 con 0x7f340415cc60 2023-11-04T01:36:50.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.476+0000 7f3409163640 1 -- 172.21.15.114:0/2231212032 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34000309c0 con 0x7f340415cc60 2023-11-04T01:36:50.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.476+0000 7f3409163640 1 -- 172.21.15.114:0/2231212032 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400030d90 con 0x7f340415cc60 2023-11-04T01:36:50.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.474+0000 7fe00b59e640 1 Processor -- start 2023-11-04T01:36:50.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.474+0000 7fe00b59e640 1 -- start start 2023-11-04T01:36:50.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.475+0000 7fe00b59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00c0ce6c0 0x7fe00c1666c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.475+0000 7fe00b59e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe00c158ad0 0x7fe00c0afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.475+0000 7fe00b59e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe00c158eb0 0x7fe00c0b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.475+0000 7fe00b59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c1fad30 con 0x7fe00c0ce6c0 2023-11-04T01:36:50.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.475+0000 7fe00b59e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c1fb010 con 0x7fe00c158eb0 2023-11-04T01:36:50.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.475+0000 7fe00b59e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c1fb2f0 con 0x7fe00c158ad0 2023-11-04T01:36:50.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.476+0000 7fe00ad9d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe00c158eb0 0x7fe00c0b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.476+0000 7fe009d9b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe00c158ad0 0x7fe00c0afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.476+0000 7fe009d9b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe00c158ad0 0x7fe00c0afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:51762/0 (socket says 172.21.15.114:51762) 2023-11-04T01:36:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.476+0000 7fe009d9b640 1 -- 172.21.15.114:0/3696996128 learned_addr learned my addr 172.21.15.114:0/3696996128 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.476+0000 7fe00a59c640 1 --2- 172.21.15.114:0/3696996128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00c0ce6c0 0x7fe00c1666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.476+0000 7fe009d9b640 1 -- 172.21.15.114:0/3696996128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe00c158eb0 msgr2=0x7fe00c0b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.476+0000 7fe009d9b640 1 --2- 172.21.15.114:0/3696996128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe00c158eb0 0x7fe00c0b0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.476+0000 7fe009d9b640 1 -- 172.21.15.114:0/3696996128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00c0ce6c0 msgr2=0x7fe00c1666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.476+0000 7fe009d9b640 1 --2- 172.21.15.114:0/3696996128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00c0ce6c0 0x7fe00c1666c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.476+0000 7fe009d9b640 1 -- 172.21.15.114:0/3696996128 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc0094d0 con 0x7fe00c158ad0 2023-11-04T01:36:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.476+0000 7fe00a59c640 1 --2- 172.21.15.114:0/3696996128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00c0ce6c0 0x7fe00c1666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7fe009d9b640 1 --2- 172.21.15.114:0/3696996128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe00c158ad0 0x7fe00c0afd20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe00000b3e0 tx=0x7fe00000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7fc081225640 1 -- 172.21.15.114:0/2278038043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc07c158eb0 msgr2=0x7fc07c15c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7fc081225640 1 --2- 172.21.15.114:0/2278038043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc07c158eb0 0x7fc07c15c900 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc070008870 tx=0x7fc07002df50 comp rx=0 tx=0).stop 2023-11-04T01:36:50.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7fc081225640 1 -- 172.21.15.114:0/2278038043 shutdown_connections 2023-11-04T01:36:50.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7fc081225640 1 --2- 172.21.15.114:0/2278038043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc07c158eb0 0x7fc07c15c900 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7f340b167640 1 -- 172.21.15.114:0/2231212032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f340415cc60 msgr2=0x7f34040d0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7fdffaffd640 1 -- 172.21.15.114:0/3696996128 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000011830 con 0x7fe00c158ad0 2023-11-04T01:36:50.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7f340b167640 1 --2- 172.21.15.114:0/2231212032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f340415cc60 0x7f34040d0c30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3400009870 tx=0x7f340002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7fc081225640 1 --2- 172.21.15.114:0/2278038043 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc07c158ad0 0x7fc07c0c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7fc081225640 1 -- 172.21.15.114:0/2278038043 >> 172.21.15.114:0/2278038043 conn(0x7fc07c06a120 msgr2=0x7fc07c06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7fe00b59e640 1 -- 172.21.15.114:0/3696996128 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00c1fb5d0 con 0x7fe00c158ad0 2023-11-04T01:36:50.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7fe00b59e640 1 -- 172.21.15.114:0/3696996128 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00c166c00 con 0x7fe00c158ad0 2023-11-04T01:36:50.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7f340b167640 1 -- 172.21.15.114:0/2231212032 shutdown_connections 2023-11-04T01:36:50.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7f340b167640 1 --2- 172.21.15.114:0/2231212032 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34040b8970 0x7f34040cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7f340b167640 1 --2- 172.21.15.114:0/2231212032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f340415cc60 0x7f34040d0c30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7f340b167640 1 -- 172.21.15.114:0/2231212032 >> 172.21.15.114:0/2231212032 conn(0x7f340406b4a0 msgr2=0x7f340406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7f340b167640 1 -- 172.21.15.114:0/2231212032 shutdown_connections 2023-11-04T01:36:50.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.477+0000 7f340b167640 1 -- 172.21.15.114:0/2231212032 wait complete. 2023-11-04T01:36:50.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.475+0000 7f30c2ebb640 1 -- start start 2023-11-04T01:36:50.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.478+0000 7f30c2ebb640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f30b4050470 0x7f30b4048b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.478+0000 7f30c2ebb640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f30b40538e0 0x7f30b4053d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.478+0000 7f30c2ebb640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b40509e0 con 0x7f30b4006b10 2023-11-04T01:36:50.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.478+0000 7f30c2ebb640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b4051660 con 0x7f30b4050470 2023-11-04T01:36:50.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.478+0000 7f30c2ebb640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b4050cc0 con 0x7f30b40538e0 2023-11-04T01:36:50.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.478+0000 7fdffaffd640 1 -- 172.21.15.114:0/3696996128 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0000119b0 con 0x7fe00c158ad0 2023-11-04T01:36:50.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.478+0000 7f30c1458640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f30b40538e0 0x7f30b4053d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.478+0000 7f30bbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f30b4050470 0x7f30b4048b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.479+0000 7f30bbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f30b4050470 0x7f30b4048b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49224/0 (socket says 172.21.15.114:49224) 2023-11-04T01:36:50.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.479+0000 7f30c1458640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f30b40538e0 0x7f30b4053d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35112/0 (socket says 172.21.15.114:35112) 2023-11-04T01:36:50.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.479+0000 7f30c1458640 1 -- 172.21.15.114:0/2719371544 learned_addr learned my addr 172.21.15.114:0/2719371544 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.479+0000 7f30c1458640 1 -- 172.21.15.114:0/2719371544 >> v2:172.21.15.114:3300/0 conn(0x7f30b4050470 msgr2=0x7f30b4048b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.479+0000 7f30c1458640 1 --2- 172.21.15.114:0/2719371544 >> v2:172.21.15.114:3300/0 conn(0x7f30b4050470 0x7f30b4048b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.479+0000 7f30c1458640 1 -- 172.21.15.114:0/2719371544 >> v1:172.21.15.141:6789/0 conn(0x7f30b4006b10 legacy=0x7f30b4006ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.479+0000 7f30c1458640 1 -- 172.21.15.114:0/2719371544 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b4050fa0 con 0x7f30b40538e0 2023-11-04T01:36:50.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.479+0000 7fdffaffd640 1 -- 172.21.15.114:0/3696996128 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000011d60 con 0x7fe00c158ad0 2023-11-04T01:36:50.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.479+0000 7f340b167640 1 Processor -- start 2023-11-04T01:36:50.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.480+0000 7f340b167640 1 -- start start 2023-11-04T01:36:50.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.480+0000 7fdff8ff9640 1 -- 172.21.15.114:0/3696996128 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00c1fbaf0 con 0x7fe00c158ad0 2023-11-04T01:36:50.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.480+0000 7fe803fff640 1 Processor -- start 2023-11-04T01:36:50.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.480+0000 7fe803fff640 1 -- start start 2023-11-04T01:36:50.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.480+0000 7f30c1458640 1 --2- 172.21.15.114:0/2719371544 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30b40538e0 0x7f30b4053d70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f30b40ec170 tx=0x7f30a802b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9df274cdb9dd9b1b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.480+0000 7fa5e5f39640 1 Processor -- start 2023-11-04T01:36:50.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.480+0000 7fdffaffd640 1 -- 172.21.15.114:0/3696996128 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe00001a400 con 0x7fe00c158ad0 2023-11-04T01:36:50.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.480+0000 7fc081225640 1 -- 172.21.15.114:0/2278038043 shutdown_connections 2023-11-04T01:36:50.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.480+0000 7fc081225640 1 -- 172.21.15.114:0/2278038043 wait complete. 2023-11-04T01:36:50.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.481+0000 7f30bb7fe640 1 -- 172.21.15.114:0/2719371544 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a80317e0 con 0x7f30b40538e0 2023-11-04T01:36:50.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.481+0000 7f30bb7fe640 1 -- 172.21.15.114:0/2719371544 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a8031940 con 0x7f30b40538e0 2023-11-04T01:36:50.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.481+0000 7f30bb7fe640 1 -- 172.21.15.114:0/2719371544 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a8031cd0 con 0x7f30b40538e0 2023-11-04T01:36:50.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.481+0000 7f340b167640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34040b8970 0x7f34041f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.481+0000 7fdffaffd640 1 --2- 172.21.15.114:0/3696996128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdfec06af40 0x7fdfec06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.481+0000 7f340b167640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34040d1170 0x7f340415dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.481+0000 7fe803fff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7fc0346c0 0x7fe7fc038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7f340a165640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34040b8970 0x7f34041f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7f340a165640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34040b8970 0x7f34041f5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:51774/0 (socket says 172.21.15.114:51774) 2023-11-04T01:36:50.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fe803fff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc0e3e70 con 0x7fe7fc050f50 2023-11-04T01:36:50.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fe803fff640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc0e4150 con 0x7fe7fc0e0360 2023-11-04T01:36:50.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fe803fff640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0516a0 con 0x7fe7fc0346c0 2023-11-04T01:36:50.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fe8037fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe7fc050f50 0x7fe7fc0394f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41114/0 (socket says 172.21.15.114:41114) 2023-11-04T01:36:50.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fe8037fe640 1 -- 172.21.15.114:0/3368591787 learned_addr learned my addr 172.21.15.114:0/3368591787 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:50.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.481+0000 7fa5e5f39640 1 -- start start 2023-11-04T01:36:50.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7f340a165640 1 -- 172.21.15.114:0/1699009302 learned_addr learned my addr 172.21.15.114:0/1699009302 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7f3409964640 1 --2- 172.21.15.114:0/1699009302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34040d1170 0x7f340415dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7f340b167640 1 --2- 172.21.15.114:0/1699009302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340415cc60 0x7f3404157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fe801ffb640 1 -- 172.21.15.114:0/3368591787 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640060027 0 0) 0x7fe7fc0e3e70 con 0x7fe7fc050f50 2023-11-04T01:36:50.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fe801ffb640 1 -- 172.21.15.114:0/3368591787 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7ec003520 con 0x7fe7fc050f50 2023-11-04T01:36:50.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fdffaffd640 1 -- 172.21.15.114:0/3696996128 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe000089850 con 0x7fe00c158ad0 2023-11-04T01:36:50.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fe00a59c640 1 --2- 172.21.15.114:0/3696996128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdfec06af40 0x7fdfec06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fa5e5f39640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5e01612b0 0x7fa5e00cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fa5e5f39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5e006b120 0x7fa5e006cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fa5e5f39640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa5e006d2b0 0x7fa5e00c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fa5e5f39640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e006d740 con 0x7fa5e01612b0 2023-11-04T01:36:50.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fa5e5f39640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e0165860 con 0x7fa5e006d2b0 2023-11-04T01:36:50.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fa5e5f39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e0164f30 con 0x7fa5e006b120 2023-11-04T01:36:50.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fe801ffb640 1 -- 172.21.15.114:0/3368591787 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1375599943 0 0) 0x7fe7ec003520 con 0x7fe7fc050f50 2023-11-04T01:36:50.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fe801ffb640 1 -- 172.21.15.114:0/3368591787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7fc0346c0 msgr2=0x7fe7fc038fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:36:50.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fe801ffb640 1 --2- 172.21.15.114:0/3368591787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7fc0346c0 0x7fe7fc038fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fe801ffb640 1 -- 172.21.15.114:0/3368591787 >> v1:172.21.15.141:6789/0 conn(0x7fe7fc0e0360 legacy=0x7fe7fc050840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:36:50.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7fe801ffb640 1 -- 172.21.15.114:0/3368591787 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc0e4430 con 0x7fe7fc050f50 2023-11-04T01:36:50.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fe801ffb640 1 -- 172.21.15.114:0/3368591787 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fe7f4001670 con 0x7fe7fc050f50 2023-11-04T01:36:50.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.482+0000 7f340b167640 1 -- 172.21.15.114:0/1699009302 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340415f2e0 con 0x7f340415cc60 2023-11-04T01:36:50.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2719371544 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30b40538e0 msgr2=0x7f30b4053d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7f30c2ebb640 1 --2- 172.21.15.114:0/2719371544 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30b40538e0 0x7f30b4053d70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f30b40ec170 tx=0x7f30a802b880 comp rx=0 tx=0).stop 2023-11-04T01:36:50.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7f340a966640 1 --2- 172.21.15.114:0/1699009302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340415cc60 0x7f3404157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7f340b167640 1 -- 172.21.15.114:0/1699009302 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340415e6d0 con 0x7f34040d1170 2023-11-04T01:36:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fe801ffb640 1 -- 172.21.15.114:0/3368591787 >> v1:172.21.15.114:6789/0 conn(0x7fe7fc050f50 legacy=0x7fe7fc0394f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fe801ffb640 1 --2- 172.21.15.114:0/3368591787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7ec0039a0 0x7fe7ec003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fe801ffb640 1 --2- 172.21.15.114:0/3368591787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7ec0047c0 0x7fe7ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fe801ffb640 1 --2- 172.21.15.114:0/3368591787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7ec0052a0 0x7fe7ec00ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fa5dffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa5e006d2b0 0x7fa5e00c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fa5dffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa5e006d2b0 0x7fa5e00c1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35136/0 (socket says 172.21.15.114:35136) 2023-11-04T01:36:50.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fa5dffff640 1 -- 172.21.15.114:0/3113932340 learned_addr learned my addr 172.21.15.114:0/3113932340 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fe801ffb640 1 -- 172.21.15.114:0/3368591787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec010580 con 0x7fe7ec0052a0 2023-11-04T01:36:50.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fe801ffb640 1 -- 172.21.15.114:0/3368591787 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec0106f0 con 0x7fe7ec0039a0 2023-11-04T01:36:50.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fe801ffb640 1 -- 172.21.15.114:0/3368591787 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec00bb80 con 0x7fe7ec0047c0 2023-11-04T01:36:50.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fc081225640 1 Processor -- start 2023-11-04T01:36:50.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2719371544 shutdown_connections 2023-11-04T01:36:50.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7f30c2ebb640 1 --2- 172.21.15.114:0/2719371544 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30b40538e0 0x7f30b4053d70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7f30c2ebb640 1 --2- 172.21.15.114:0/2719371544 >> v2:172.21.15.114:3300/0 conn(0x7f30b4050470 0x7f30b4048b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2719371544 >> 172.21.15.114:0/2719371544 conn(0x7f30b4055c10 msgr2=0x7f30b4056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7f340b167640 1 -- 172.21.15.114:0/1699009302 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340415e9b0 con 0x7f34040b8970 2023-11-04T01:36:50.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fa5df7fe640 1 --2- 172.21.15.114:0/3113932340 >> v2:172.21.15.114:3300/0 conn(0x7fa5e01612b0 0x7fa5e00cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fe802ffd640 1 --2- 172.21.15.114:0/3368591787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7ec0039a0 0x7fe7ec003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fe8027fc640 1 --2- 172.21.15.114:0/3368591787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7ec0047c0 0x7fe7ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2719371544 shutdown_connections 2023-11-04T01:36:50.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2719371544 wait complete. 2023-11-04T01:36:50.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fe802ffd640 1 -- 172.21.15.114:0/3368591787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7ec0047c0 msgr2=0x7fe7ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fc081225640 1 -- start start 2023-11-04T01:36:50.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fa5deffd640 1 --2- 172.21.15.114:0/3113932340 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5e006b120 0x7fa5e006cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fe00a59c640 1 --2- 172.21.15.114:0/3696996128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdfec06af40 0x7fdfec06d400 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdffc036000 tx=0x7fdffc03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fe802ffd640 1 --2- 172.21.15.114:0/3368591787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7ec0047c0 0x7fe7ec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fe802ffd640 1 -- 172.21.15.114:0/3368591787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7ec0052a0 msgr2=0x7fe7ec00ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fe802ffd640 1 --2- 172.21.15.114:0/3368591787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7ec0052a0 0x7fe7ec00ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.483+0000 7fe802ffd640 1 -- 172.21.15.114:0/3368591787 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc0e4430 con 0x7fe7ec0039a0 2023-11-04T01:36:50.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.484+0000 7fe8027fc640 1 --2- 172.21.15.114:0/3368591787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7ec0047c0 0x7fe7ec004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:50.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.484+0000 7fc081225640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc07c158ad0 0x7fc07c0c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.484+0000 7fc081225640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc07c158eb0 0x7fc07c154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.484+0000 7fc081225640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc07c15ce40 0x7fc07c0c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7fc081225640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0c3050 con 0x7fc07c158eb0 2023-11-04T01:36:50.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7fc081225640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0c3280 con 0x7fc07c15ce40 2023-11-04T01:36:50.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7fc081225640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0c3560 con 0x7fc07c158ad0 2023-11-04T01:36:50.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.484+0000 7fa5df7fe640 1 -- 172.21.15.114:0/3113932340 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5e006b120 msgr2=0x7fa5e006cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.484+0000 7fa5df7fe640 1 --2- 172.21.15.114:0/3113932340 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5e006b120 0x7fa5e006cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.484+0000 7fa5df7fe640 1 -- 172.21.15.114:0/3113932340 >> v2:172.21.15.141:3300/0 conn(0x7fa5e006d2b0 msgr2=0x7fa5e00c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.484+0000 7fa5df7fe640 1 --2- 172.21.15.114:0/3113932340 >> v2:172.21.15.141:3300/0 conn(0x7fa5e006d2b0 0x7fa5e00c1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.484+0000 7fa5df7fe640 1 -- 172.21.15.114:0/3113932340 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e0165210 con 0x7fa5e01612b0 2023-11-04T01:36:50.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.484+0000 7f340a165640 1 -- 172.21.15.114:0/1699009302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34040d1170 msgr2=0x7f340415dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.484+0000 7f340a165640 1 --2- 172.21.15.114:0/1699009302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34040d1170 0x7f340415dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.484+0000 7f340a165640 1 -- 172.21.15.114:0/1699009302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340415cc60 msgr2=0x7f3404157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.484+0000 7f340a165640 1 --2- 172.21.15.114:0/1699009302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340415cc60 0x7f3404157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.484+0000 7f340a165640 1 -- 172.21.15.114:0/1699009302 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34000094d0 con 0x7f34040b8970 2023-11-04T01:36:50.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7fe802ffd640 1 --2- 172.21.15.114:0/3368591787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7ec0039a0 0x7fe7ec003da0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe80404fc70 tx=0x7fe7ec0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79690d995a553fa7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7fc07bfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc07c158ad0 0x7fc07c0c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7f340a966640 1 --2- 172.21.15.114:0/1699009302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340415cc60 0x7f3404157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:50.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7fe801ffb640 1 -- 172.21.15.114:0/3368591787 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040a6a90 con 0x7fe7ec0039a0 2023-11-04T01:36:50.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7fe801ffb640 1 -- 172.21.15.114:0/3368591787 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8040a6c90 con 0x7fe7ec0039a0 2023-11-04T01:36:50.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7fe801ffb640 1 -- 172.21.15.114:0/3368591787 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040ae680 con 0x7fe7ec0039a0 2023-11-04T01:36:50.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7fc080a24640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc07c15ce40 0x7fc07c0c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7fc080a24640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc07c15ce40 0x7fc07c0c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35152/0 (socket says 172.21.15.114:35152) 2023-11-04T01:36:50.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7fc080a24640 1 -- 172.21.15.114:0/1879227406 learned_addr learned my addr 172.21.15.114:0/1879227406 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7f30c2ebb640 1 Processor -- start 2023-11-04T01:36:50.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7f30c2ebb640 1 -- start start 2023-11-04T01:36:50.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7f340a165640 1 --2- 172.21.15.114:0/1699009302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34040b8970 0x7f34041f5800 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3400009870 tx=0x7f3400004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7fa5df7fe640 1 --2- 172.21.15.114:0/3113932340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5e01612b0 0x7fa5e00cd700 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00ccf50 tx=0x7fa5d002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907f9dca12a45a27 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7fa5de7fc640 1 -- 172.21.15.114:0/3113932340 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d002e070 con 0x7fa5e01612b0 2023-11-04T01:36:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7fa5de7fc640 1 -- 172.21.15.114:0/3113932340 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d00315a0 con 0x7fa5e01612b0 2023-11-04T01:36:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7fc080a24640 1 -- 172.21.15.114:0/1879227406 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc07c158ad0 msgr2=0x7fc07c0c2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7fc080a24640 1 --2- 172.21.15.114:0/1879227406 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc07c158ad0 0x7fc07c0c2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.485+0000 7fc080a24640 1 -- 172.21.15.114:0/1879227406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc07c158eb0 msgr2=0x7fc07c154dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:36:50.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7fa5de7fc640 1 -- 172.21.15.114:0/3113932340 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0031930 con 0x7fa5e01612b0 2023-11-04T01:36:50.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7fc07b7fe640 1 --2- 172.21.15.114:0/1879227406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc07c158eb0 0x7fc07c154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7fdffaffd640 1 -- 172.21.15.114:0/3696996128 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe00c1fbaf0 con 0x7fe00c158ad0 2023-11-04T01:36:50.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7f33faffd640 1 -- 172.21.15.114:0/1699009302 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400039e50 con 0x7f34040b8970 2023-11-04T01:36:50.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7f33faffd640 1 -- 172.21.15.114:0/1699009302 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3400047070 con 0x7f34040b8970 2023-11-04T01:36:50.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7fe803fff640 1 -- 172.21.15.114:0/3368591787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7ec0039a0 msgr2=0x7fe7ec003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7fe803fff640 1 --2- 172.21.15.114:0/3368591787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7ec0039a0 0x7fe7ec003da0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe80404fc70 tx=0x7fe7ec0057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7fe8037fe640 1 -- 172.21.15.114:0/3368591787 reap_dead start 2023-11-04T01:36:50.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7fe803fff640 1 -- 172.21.15.114:0/3368591787 shutdown_connections 2023-11-04T01:36:50.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7fe803fff640 1 -- 172.21.15.114:0/3368591787 >> 172.21.15.114:0/3368591787 conn(0x7fe7fc00a550 msgr2=0x7fe7fc00a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7fe803fff640 1 -- 172.21.15.114:0/3368591787 shutdown_connections 2023-11-04T01:36:50.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7fe803fff640 1 -- 172.21.15.114:0/3368591787 wait complete. 2023-11-04T01:36:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7fc080a24640 1 --2- 172.21.15.114:0/1879227406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc07c158eb0 0x7fc07c154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.487+0000 7f33faffd640 1 -- 172.21.15.114:0/1699009302 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400043ae0 con 0x7f34040b8970 2023-11-04T01:36:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.487+0000 7f340b167640 1 -- 172.21.15.114:0/1699009302 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340415ec90 con 0x7f34040b8970 2023-11-04T01:36:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7fc080a24640 1 -- 172.21.15.114:0/1879227406 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc070008550 con 0x7fc07c15ce40 2023-11-04T01:36:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.487+0000 7fc080a24640 1 --2- 172.21.15.114:0/1879227406 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc07c15ce40 0x7fc07c0c46a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc07400c730 tx=0x7fc07400cb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.487+0000 7fc078ff9640 1 -- 172.21.15.114:0/1879227406 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074006d50 con 0x7fc07c15ce40 2023-11-04T01:36:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.487+0000 7f340b167640 1 -- 172.21.15.114:0/1699009302 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34041f5d40 con 0x7f34040b8970 2023-11-04T01:36:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.487+0000 7fc078ff9640 1 -- 172.21.15.114:0/1879227406 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc074003970 con 0x7fc07c15ce40 2023-11-04T01:36:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.487+0000 7fc078ff9640 1 -- 172.21.15.114:0/1879227406 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074003d20 con 0x7fc07c15ce40 2023-11-04T01:36:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7fa5e5f39640 1 -- 172.21.15.114:0/3113932340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5e01612b0 msgr2=0x7fa5e00cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.486+0000 7fa5e5f39640 1 --2- 172.21.15.114:0/3113932340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5e01612b0 0x7fa5e00cd700 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00ccf50 tx=0x7fa5d002b840 comp rx=0 tx=0).stop 2023-11-04T01:36:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.488+0000 7fa5e5f39640 1 -- 172.21.15.114:0/3113932340 shutdown_connections 2023-11-04T01:36:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.488+0000 7fa5e5f39640 1 --2- 172.21.15.114:0/3113932340 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5e006b120 0x7fa5e006cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.488+0000 7fa5e5f39640 1 --2- 172.21.15.114:0/3113932340 >> v2:172.21.15.141:3300/0 conn(0x7fa5e006d2b0 0x7fa5e00c1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.488+0000 7fa5e5f39640 1 --2- 172.21.15.114:0/3113932340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5e01612b0 0x7fa5e00cd700 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.488+0000 7fa5e5f39640 1 -- 172.21.15.114:0/3113932340 >> 172.21.15.114:0/3113932340 conn(0x7fa5e00cf140 msgr2=0x7fa5e00cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.489+0000 7f30c2ebb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b4006b10 0x7f30b404d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.488+0000 7fc081225640 1 -- 172.21.15.114:0/1879227406 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07c15a470 con 0x7fc07c15ce40 2023-11-04T01:36:50.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.489+0000 7fe803fff640 1 Processor -- start 2023-11-04T01:36:50.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.488+0000 7fc081225640 1 -- 172.21.15.114:0/1879227406 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07c15aa30 con 0x7fc07c15ce40 2023-11-04T01:36:50.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.489+0000 7fe803fff640 1 -- start start 2023-11-04T01:36:50.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.489+0000 7f30c2ebb640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30b4050470 0x7f30b404b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.489+0000 7f340b167640 1 -- 172.21.15.114:0/1699009302 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34040d2690 con 0x7f34040b8970 2023-11-04T01:36:50.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.490+0000 7f30c2ebb640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30b40538e0 0x7f30b404be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.490+0000 7fc081225640 1 -- 172.21.15.114:0/1879227406 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc07c04ece0 con 0x7fc07c15ce40 2023-11-04T01:36:50.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.490+0000 7f30bbfff640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30b4050470 0x7f30b404b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.490+0000 7f30bbfff640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30b4050470 0x7f30b404b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35158/0 (socket says 172.21.15.114:35158) 2023-11-04T01:36:50.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.490+0000 7f30bbfff640 1 -- 172.21.15.114:0/2434614172 learned_addr learned my addr 172.21.15.114:0/2434614172 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.490+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2434614172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b4039470 con 0x7f30b4006b10 2023-11-04T01:36:50.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.490+0000 7fe803fff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7ec0039a0 0x7fe7fc0cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.490+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2434614172 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b404d010 con 0x7f30b4050470 2023-11-04T01:36:50.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.490+0000 7fe803fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7fc0cb010 0x7fe7fc0e1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.490+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2434614172 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b404cce0 con 0x7f30b40538e0 2023-11-04T01:36:50.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.490+0000 7f30c0c57640 1 --2- 172.21.15.114:0/2434614172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b4006b10 0x7f30b404d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.490+0000 7f33faffd640 1 -- 172.21.15.114:0/1699009302 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3400043c40 con 0x7f34040b8970 2023-11-04T01:36:50.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.491+0000 7f33faffd640 1 --2- 172.21.15.114:0/1699009302 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f33e806af40 0x7f33e806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.491+0000 7fc078ff9640 1 -- 172.21.15.114:0/1879227406 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc0740050d0 con 0x7fc07c15ce40 2023-11-04T01:36:50.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.491+0000 7f33faffd640 1 -- 172.21.15.114:0/1699009302 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f34000b43d0 con 0x7f34040b8970 2023-11-04T01:36:50.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.491+0000 7f30c0c57640 1 -- 172.21.15.114:0/2434614172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30b40538e0 msgr2=0x7f30b404be30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-04T01:36:50.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.491+0000 7f30c1458640 1 --2- 172.21.15.114:0/2434614172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30b40538e0 0x7f30b404be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.491+0000 7f30c0c57640 1 --2- 172.21.15.114:0/2434614172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30b40538e0 0x7f30b404be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.491+0000 7f30c0c57640 1 -- 172.21.15.114:0/2434614172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30b4050470 msgr2=0x7f30b404b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.491+0000 7f30c0c57640 1 --2- 172.21.15.114:0/2434614172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30b4050470 0x7f30b404b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.491+0000 7f30c0c57640 1 -- 172.21.15.114:0/2434614172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a80094d0 con 0x7f30b4006b10 2023-11-04T01:36:50.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.492+0000 7f30c1458640 1 --2- 172.21.15.114:0/2434614172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30b40538e0 0x7f30b404be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:50.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.491+0000 7fc078ff9640 1 --2- 172.21.15.114:0/1879227406 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc06806ae70 0x7fc06806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.492+0000 7fc078ff9640 1 -- 172.21.15.114:0/1879227406 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc0740896c0 con 0x7fc07c15ce40 2023-11-04T01:36:50.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.491+0000 7fe803fff640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7fc0e1f50 0x7fe7fc036310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.491+0000 7fe803fff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc037e30 con 0x7fe7fc0cb010 2023-11-04T01:36:50.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.491+0000 7fe803fff640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0e0c90 con 0x7fe7fc0e1f50 2023-11-04T01:36:50.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.491+0000 7fe803fff640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc04bc60 con 0x7fe7ec0039a0 2023-11-04T01:36:50.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.490+0000 7fa5e5f39640 1 -- 172.21.15.114:0/3113932340 shutdown_connections 2023-11-04T01:36:50.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.490+0000 7fa5e5f39640 1 -- 172.21.15.114:0/3113932340 wait complete. 2023-11-04T01:36:50.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.492+0000 7fe802ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7ec0039a0 0x7fe7fc0cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.492+0000 7fe802ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7ec0039a0 0x7fe7fc0cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:51834/0 (socket says 172.21.15.114:51834) 2023-11-04T01:36:50.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.492+0000 7fe802ffd640 1 -- 172.21.15.114:0/2251565951 learned_addr learned my addr 172.21.15.114:0/2251565951 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.492+0000 7fc07bfff640 1 --2- 172.21.15.114:0/1879227406 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc06806ae70 0x7fc06806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.492+0000 7fe8037fe640 1 --2- 172.21.15.114:0/2251565951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7fc0e1f50 0x7fe7fc036310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.492+0000 7fe8027fc640 1 --2- 172.21.15.114:0/2251565951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7fc0cb010 0x7fe7fc0e1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.492+0000 7fa5e5f39640 1 Processor -- start 2023-11-04T01:36:50.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.492+0000 7fe802ffd640 1 -- 172.21.15.114:0/2251565951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7fc0e1f50 msgr2=0x7fe7fc036310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.492+0000 7fe802ffd640 1 --2- 172.21.15.114:0/2251565951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7fc0e1f50 0x7fe7fc036310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.492+0000 7fe802ffd640 1 -- 172.21.15.114:0/2251565951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7fc0cb010 msgr2=0x7fe7fc0e1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.492+0000 7fe802ffd640 1 --2- 172.21.15.114:0/2251565951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7fc0cb010 0x7fe7fc0e1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.492+0000 7fe802ffd640 1 -- 172.21.15.114:0/2251565951 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc0e0f30 con 0x7fe7ec0039a0 2023-11-04T01:36:50.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.492+0000 7fa5e5f39640 1 -- start start 2023-11-04T01:36:50.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.493+0000 7f30c0c57640 1 --2- 172.21.15.114:0/2434614172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b4006b10 0x7f30b404d4a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f30b000c410 tx=0x7f30b000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.493+0000 7fc07bfff640 1 --2- 172.21.15.114:0/1879227406 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc06806ae70 0x7fc06806d330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc06c006fd0 tx=0x7fc06c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.493+0000 7f3409964640 1 --2- 172.21.15.114:0/1699009302 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f33e806af40 0x7f33e806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.493+0000 7fe802ffd640 1 --2- 172.21.15.114:0/2251565951 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7ec0039a0 0x7fe7fc0cb510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe804069c50 tx=0x7fe804069f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.493+0000 7f30b97fa640 1 -- 172.21.15.114:0/2434614172 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b0005230 con 0x7f30b4006b10 2023-11-04T01:36:50.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.493+0000 7f30b97fa640 1 -- 172.21.15.114:0/2434614172 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b0005390 con 0x7f30b4006b10 2023-11-04T01:36:50.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.493+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2434614172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b41867c0 con 0x7f30b4006b10 2023-11-04T01:36:50.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.494+0000 7fa5e5f39640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5e006b120 0x7fa5e00c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.494+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2434614172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b404d9e0 con 0x7f30b4006b10 2023-11-04T01:36:50.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.493+0000 7f30b97fa640 1 -- 172.21.15.114:0/2434614172 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b0004820 con 0x7f30b4006b10 2023-11-04T01:36:50.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.494+0000 7f3409964640 1 --2- 172.21.15.114:0/1699009302 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f33e806af40 0x7f33e806d400 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f34040a9530 tx=0x7f33f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7fa5e5f39640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5e006d2b0 0x7fa5e00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7fa5e5f39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5e01612b0 0x7fa5e01fecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7fa5e5f39640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e00b21c0 con 0x7fa5e006d2b0 2023-11-04T01:36:50.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7fa5e5f39640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e00b24a0 con 0x7fa5e006b120 2023-11-04T01:36:50.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7fa5e5f39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e00b2780 con 0x7fa5e01612b0 2023-11-04T01:36:50.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7fa5df7fe640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5e006b120 0x7fa5e00c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7fa5df7fe640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5e006b120 0x7fa5e00c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35164/0 (socket says 172.21.15.114:35164) 2023-11-04T01:36:50.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7fa5df7fe640 1 -- 172.21.15.114:0/1128721317 learned_addr learned my addr 172.21.15.114:0/1128721317 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7fa5deffd640 1 --2- 172.21.15.114:0/1128721317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5e006d2b0 0x7fa5e00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7fa5dffff640 1 --2- 172.21.15.114:0/1128721317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5e01612b0 0x7fa5e01fecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7fa5df7fe640 1 -- 172.21.15.114:0/1128721317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5e01612b0 msgr2=0x7fa5e01fecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7fa5df7fe640 1 --2- 172.21.15.114:0/1128721317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5e01612b0 0x7fa5e01fecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2434614172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b40068e0 con 0x7f30b4006b10 2023-11-04T01:36:50.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7fa5df7fe640 1 -- 172.21.15.114:0/1128721317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5e006d2b0 msgr2=0x7fa5e00b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7fa5df7fe640 1 --2- 172.21.15.114:0/1128721317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5e006d2b0 0x7fa5e00b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7fa5df7fe640 1 -- 172.21.15.114:0/1128721317 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d0009400 con 0x7fa5e006b120 2023-11-04T01:36:50.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.496+0000 7fa5df7fe640 1 --2- 172.21.15.114:0/1128721317 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5e006b120 0x7fa5e00c8430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0000c00 tx=0x7fa5d00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.495+0000 7f30b97fa640 1 -- 172.21.15.114:0/2434614172 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f30b0004980 con 0x7f30b4006b10 2023-11-04T01:36:50.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.496+0000 7f30b97fa640 1 --2- 172.21.15.114:0/2434614172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f30a006af40 0x7f30a006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.496+0000 7f30b97fa640 1 -- 172.21.15.114:0/2434614172 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f30b0088ef0 con 0x7f30b4006b10 2023-11-04T01:36:50.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.496+0000 7f30bbfff640 1 --2- 172.21.15.114:0/2434614172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f30a006af40 0x7f30a006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.497+0000 7f30bbfff640 1 --2- 172.21.15.114:0/2434614172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f30a006af40 0x7f30a006d400 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f30bc069740 tx=0x7f30bc069f20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.500+0000 7fc078ff9640 1 -- 172.21.15.114:0/1879227406 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc074057f80 con 0x7fc07c15ce40 2023-11-04T01:36:50.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.500+0000 7fa5c7fff640 1 -- 172.21.15.114:0/1128721317 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0031f10 con 0x7fa5e006b120 2023-11-04T01:36:50.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.500+0000 7fa5c7fff640 1 -- 172.21.15.114:0/1128721317 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d0032860 con 0x7fa5e006b120 2023-11-04T01:36:50.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.500+0000 7fa5c7fff640 1 -- 172.21.15.114:0/1128721317 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0032c10 con 0x7fa5e006b120 2023-11-04T01:36:50.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.500+0000 7fe7eb7fe640 1 -- 172.21.15.114:0/2251565951 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040b8410 con 0x7fe7ec0039a0 2023-11-04T01:36:50.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.500+0000 7fe7eb7fe640 1 -- 172.21.15.114:0/2251565951 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8040b8570 con 0x7fe7ec0039a0 2023-11-04T01:36:50.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.500+0000 7fe803fff640 1 -- 172.21.15.114:0/2251565951 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc0e1210 con 0x7fe7ec0039a0 2023-11-04T01:36:50.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.500+0000 7fa5e5f39640 1 -- 172.21.15.114:0/1128721317 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e00b2a60 con 0x7fa5e006b120 2023-11-04T01:36:50.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.500+0000 7fe803fff640 1 -- 172.21.15.114:0/2251565951 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7fc034c80 con 0x7fe7ec0039a0 2023-11-04T01:36:50.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.500+0000 7f33faffd640 1 -- 172.21.15.114:0/1699009302 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f34040d2690 con 0x7f34040b8970 2023-11-04T01:36:50.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.500+0000 7fa5e5f39640 1 -- 172.21.15.114:0/1128721317 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e00c7690 con 0x7fa5e006b120 2023-11-04T01:36:50.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.502+0000 7fa5c7fff640 1 -- 172.21.15.114:0/1128721317 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa5d003b3f0 con 0x7fa5e006b120 2023-11-04T01:36:50.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.503+0000 7f30b97fa640 1 -- 172.21.15.114:0/2434614172 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f30b0053c90 con 0x7f30b4006b10 2023-11-04T01:36:50.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.503+0000 7fa5c7fff640 1 --2- 172.21.15.114:0/1128721317 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa5cc06ae70 0x7fa5cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.503+0000 7fa5c7fff640 1 -- 172.21.15.114:0/1128721317 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa5d00ab710 con 0x7fa5e006b120 2023-11-04T01:36:50.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.504+0000 7fa5deffd640 1 --2- 172.21.15.114:0/1128721317 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa5cc06ae70 0x7fa5cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.504+0000 7fa5deffd640 1 --2- 172.21.15.114:0/1128721317 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa5cc06ae70 0x7fa5cc06d330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa5e01597e0 tx=0x7fa5d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.502+0000 7fe7eb7fe640 1 -- 172.21.15.114:0/2251565951 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040b8960 con 0x7fe7ec0039a0 2023-11-04T01:36:50.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.503+0000 7fe7eb7fe640 1 -- 172.21.15.114:0/2251565951 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe8040b5050 con 0x7fe7ec0039a0 2023-11-04T01:36:50.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.503+0000 7fe7eb7fe640 1 --2- 172.21.15.114:0/2251565951 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe7f006af70 0x7fe7f006d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.503+0000 7fe7eb7fe640 1 -- 172.21.15.114:0/2251565951 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe8041253a0 con 0x7fe7ec0039a0 2023-11-04T01:36:50.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.505+0000 7fa5e5f39640 1 -- 172.21.15.114:0/1128721317 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c0005250 con 0x7fa5e006b120 2023-11-04T01:36:50.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.504+0000 7fe7e97fa640 1 -- 172.21.15.114:0/2251565951 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7fc0e1730 con 0x7fe7ec0039a0 2023-11-04T01:36:50.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.505+0000 7fe8027fc640 1 --2- 172.21.15.114:0/2251565951 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe7f006af70 0x7fe7f006d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.505+0000 7fe8027fc640 1 --2- 172.21.15.114:0/2251565951 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe7f006af70 0x7fe7f006d430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0e3840 tx=0x7fe7f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.513+0000 7fe7eb7fe640 1 -- 172.21.15.114:0/2251565951 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7fc0e1730 con 0x7fe7ec0039a0 2023-11-04T01:36:50.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.526+0000 7fa5c7fff640 1 -- 172.21.15.114:0/1128721317 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5d0076570 con 0x7fa5e006b120 2023-11-04T01:36:50.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.532+0000 7f51299a9640 1 Processor -- start 2023-11-04T01:36:50.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.533+0000 7f51299a9640 1 -- start start 2023-11-04T01:36:50.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.534+0000 7f51299a9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5124158c80 0x7f51240ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.534+0000 7f51299a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51240ce4c0 0x7f512415ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.534+0000 7f51299a9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51240cb1e0 con 0x7f5124159060 2023-11-04T01:36:50.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.534+0000 7f51299a9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51241595d0 con 0x7f5124158c80 2023-11-04T01:36:50.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.534+0000 7f51299a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51240caf00 con 0x7f51240ce4c0 2023-11-04T01:36:50.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.534+0000 7f5122ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5124158c80 0x7f51240ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.534+0000 7f51227fc640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f5124159060 0x7f51240cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:45796/0 (socket says 172.21.15.114:45796) 2023-11-04T01:36:50.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.534+0000 7f51227fc640 1 -- 172.21.15.114:0/822169317 learned_addr learned my addr 172.21.15.114:0/822169317 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:50.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.535+0000 7f51237fe640 1 --2- 172.21.15.114:0/822169317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51240ce4c0 0x7f512415ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.535+0000 7f5121ffb640 1 -- 172.21.15.114:0/822169317 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968547561 0 0) 0x7f51240cb1e0 con 0x7f5124159060 2023-11-04T01:36:50.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.535+0000 7f5121ffb640 1 -- 172.21.15.114:0/822169317 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f510c003520 con 0x7f5124159060 2023-11-04T01:36:50.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.535+0000 7f5122ffd640 1 -- 172.21.15.114:0/822169317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51240ce4c0 msgr2=0x7f512415ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:50.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.535+0000 7f5121ffb640 1 -- 172.21.15.114:0/822169317 <== mon.1 v1:172.21.15.141:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1734865793 0 0) 0x7f510c003520 con 0x7f5124159060 2023-11-04T01:36:50.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.535+0000 7f5122ffd640 1 --2- 172.21.15.114:0/822169317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51240ce4c0 0x7f512415ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.535+0000 7f5122ffd640 1 -- 172.21.15.114:0/822169317 >> v1:172.21.15.141:6789/0 conn(0x7f5124159060 legacy=0x7f51240cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.535+0000 7f5122ffd640 1 -- 172.21.15.114:0/822169317 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5124159870 con 0x7f5124158c80 2023-11-04T01:36:50.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.537+0000 7f5122ffd640 1 --2- 172.21.15.114:0/822169317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5124158c80 0x7f51240ca5f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f511c0095f0 tx=0x7f511c02e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2906f527eb7702f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.537+0000 7f5121ffb640 1 -- 172.21.15.114:0/822169317 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5114001670 con 0x7f5124158c80 2023-11-04T01:36:50.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.537+0000 7f5121ffb640 1 -- 172.21.15.114:0/822169317 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c02eaa0 con 0x7f5124158c80 2023-11-04T01:36:50.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.537+0000 7f5121ffb640 1 -- 172.21.15.114:0/822169317 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c02ee30 con 0x7f5124158c80 2023-11-04T01:36:50.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.539+0000 7f51299a9640 1 -- 172.21.15.114:0/822169317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5124158c80 msgr2=0x7f51240ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.539+0000 7f51299a9640 1 --2- 172.21.15.114:0/822169317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5124158c80 0x7f51240ca5f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f511c0095f0 tx=0x7f511c02e180 comp rx=0 tx=0).stop 2023-11-04T01:36:50.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.541+0000 7f51299a9640 1 -- 172.21.15.114:0/822169317 shutdown_connections 2023-11-04T01:36:50.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.541+0000 7f51299a9640 1 --2- 172.21.15.114:0/822169317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51240ce4c0 0x7f512415ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.541+0000 7f51299a9640 1 --2- 172.21.15.114:0/822169317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5124158c80 0x7f51240ca5f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.541+0000 7f51299a9640 1 -- 172.21.15.114:0/822169317 >> 172.21.15.114:0/822169317 conn(0x7f512406a120 msgr2=0x7f512406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.541+0000 7f51299a9640 1 -- 172.21.15.114:0/822169317 shutdown_connections 2023-11-04T01:36:50.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.541+0000 7f51299a9640 1 -- 172.21.15.114:0/822169317 wait complete. 2023-11-04T01:36:50.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.543+0000 7f51299a9640 1 Processor -- start 2023-11-04T01:36:50.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.543+0000 7f51299a9640 1 -- start start 2023-11-04T01:36:50.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.545+0000 7f51299a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51240ce4c0 0x7f51240c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.545+0000 7f51299a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5124158c80 0x7f51241e2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.545+0000 7f51299a9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5124159060 0x7f51241e3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.545+0000 7f51299a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51240b3ef0 con 0x7f5124158c80 2023-11-04T01:36:50.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.545+0000 7f51299a9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5124145f10 con 0x7f5124159060 2023-11-04T01:36:50.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.545+0000 7f51299a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51240b3650 con 0x7f51240ce4c0 2023-11-04T01:36:50.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.545+0000 7f51227fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5124158c80 0x7f51241e2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.545+0000 7f51227fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5124158c80 0x7f51241e2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49322/0 (socket says 172.21.15.114:49322) 2023-11-04T01:36:50.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.546+0000 7f51227fc640 1 -- 172.21.15.114:0/819089263 learned_addr learned my addr 172.21.15.114:0/819089263 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.546+0000 7f5122ffd640 1 --2- 172.21.15.114:0/819089263 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51240ce4c0 0x7f51240c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.546+0000 7f51237fe640 1 --2- 172.21.15.114:0/819089263 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5124159060 0x7f51241e3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.546+0000 7f51227fc640 1 -- 172.21.15.114:0/819089263 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51240ce4c0 msgr2=0x7f51240c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.546+0000 7f51227fc640 1 --2- 172.21.15.114:0/819089263 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51240ce4c0 0x7f51240c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.546+0000 7f51227fc640 1 -- 172.21.15.114:0/819089263 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5124159060 msgr2=0x7f51241e3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.546+0000 7f51227fc640 1 --2- 172.21.15.114:0/819089263 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5124159060 0x7f51241e3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.546+0000 7f51227fc640 1 -- 172.21.15.114:0/819089263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c00c300 con 0x7f5124158c80 2023-11-04T01:36:50.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.547+0000 7f51227fc640 1 --2- 172.21.15.114:0/819089263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5124158c80 0x7f51241e2c10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f511400c780 tx=0x7f511400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.547+0000 7f510bfff640 1 -- 172.21.15.114:0/819089263 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5114005ad0 con 0x7f5124158c80 2023-11-04T01:36:50.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.547+0000 7f51299a9640 1 -- 172.21.15.114:0/819089263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51240b3930 con 0x7f5124158c80 2023-11-04T01:36:50.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.547+0000 7f51299a9640 1 -- 172.21.15.114:0/819089263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5124147070 con 0x7f5124158c80 2023-11-04T01:36:50.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.548+0000 7f510bfff640 1 -- 172.21.15.114:0/819089263 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5114005c30 con 0x7f5124158c80 2023-11-04T01:36:50.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.548+0000 7f510bfff640 1 -- 172.21.15.114:0/819089263 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5114007070 con 0x7f5124158c80 2023-11-04T01:36:50.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.550+0000 7f510bfff640 1 -- 172.21.15.114:0/819089263 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51140071d0 con 0x7f5124158c80 2023-11-04T01:36:50.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.550+0000 7f0f3496c640 1 Processor -- start 2023-11-04T01:36:50.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.550+0000 7f0f3496c640 1 -- start start 2023-11-04T01:36:50.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.551+0000 7f0f3496c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0f28007310 0x7f0f280f2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.551+0000 7f510bfff640 1 --2- 172.21.15.114:0/819089263 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f511006af40 0x7f511006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.551+0000 7f510bfff640 1 -- 172.21.15.114:0/819089263 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f51140894f0 con 0x7f5124158c80 2023-11-04T01:36:50.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.551+0000 7f0f3496c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f28053d00 con 0x7f0f28050d80 2023-11-04T01:36:50.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.551+0000 7f0f3496c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f280512d0 con 0x7f0f280e7680 2023-11-04T01:36:50.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.551+0000 7f0f3496c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f280515b0 con 0x7f0f28007310 2023-11-04T01:36:50.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.551+0000 7f0f2ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0f28007310 0x7f0f280f2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.551+0000 7f0f2ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0f28007310 0x7f0f280f2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35186/0 (socket says 172.21.15.114:35186) 2023-11-04T01:36:50.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.551+0000 7f0f2ffff640 1 -- 172.21.15.114:0/3338411038 learned_addr learned my addr 172.21.15.114:0/3338411038 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.552+0000 7f51299a9640 1 -- 172.21.15.114:0/819089263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5104005250 con 0x7f5124158c80 2023-11-04T01:36:50.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.552+0000 7f5122ffd640 1 --2- 172.21.15.114:0/819089263 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f511006af40 0x7f511006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.553+0000 7f5122ffd640 1 --2- 172.21.15.114:0/819089263 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f511006af40 0x7f511006d400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f511c038000 tx=0x7f511c032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.553+0000 7f0f2e7fc640 1 -- 172.21.15.114:0/3338411038 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646227049 0 0) 0x7f0f28053d00 con 0x7f0f28050d80 2023-11-04T01:36:50.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.553+0000 7f0f2e7fc640 1 -- 172.21.15.114:0/3338411038 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f20003520 con 0x7f0f28050d80 2023-11-04T01:36:50.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.553+0000 7f0f2e7fc640 1 -- 172.21.15.114:0/3338411038 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112298588 0 0) 0x7f0f280512d0 con 0x7f0f280e7680 2023-11-04T01:36:50.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.553+0000 7f0f2e7fc640 1 -- 172.21.15.114:0/3338411038 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f28053d00 con 0x7f0f280e7680 2023-11-04T01:36:50.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.553+0000 7f0f2ffff640 1 -- 172.21.15.114:0/3338411038 >> v1:172.21.15.141:6789/0 conn(0x7f0f280e7680 legacy=0x7f0f280090c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.553+0000 7f0f2ffff640 1 -- 172.21.15.114:0/3338411038 >> v1:172.21.15.114:6789/0 conn(0x7f0f28050d80 legacy=0x7f0f28006c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.554+0000 7f0f2ffff640 1 -- 172.21.15.114:0/3338411038 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f28051890 con 0x7f0f28007310 2023-11-04T01:36:50.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.561+0000 7f0f2ffff640 1 --2- 172.21.15.114:0/3338411038 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f28007310 0x7f0f280f2610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0f3002cce0 tx=0x7f0f300a6200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae8a54c4bd5fce86 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.563+0000 7f510bfff640 1 -- 172.21.15.114:0/819089263 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5114054380 con 0x7f5124158c80 2023-11-04T01:36:50.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.563+0000 7f0f2e7fc640 1 -- 172.21.15.114:0/3338411038 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f300a6e60 con 0x7f0f28007310 2023-11-04T01:36:50.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.563+0000 7f0f2e7fc640 1 -- 172.21.15.114:0/3338411038 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f300ae440 con 0x7f0f28007310 2023-11-04T01:36:50.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.563+0000 7f0f2e7fc640 1 -- 172.21.15.114:0/3338411038 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f300ae870 con 0x7f0f28007310 2023-11-04T01:36:50.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.564+0000 7f0f3496c640 1 -- 172.21.15.114:0/3338411038 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f28007310 msgr2=0x7f0f280f2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.564+0000 7f0f3496c640 1 --2- 172.21.15.114:0/3338411038 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f28007310 0x7f0f280f2610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0f3002cce0 tx=0x7f0f300a6200 comp rx=0 tx=0).stop 2023-11-04T01:36:50.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.564+0000 7f0f3496c640 1 -- 172.21.15.114:0/3338411038 shutdown_connections 2023-11-04T01:36:50.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.564+0000 7f0f3496c640 1 --2- 172.21.15.114:0/3338411038 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f28007310 0x7f0f280f2610 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.564+0000 7f0f3496c640 1 -- 172.21.15.114:0/3338411038 >> 172.21.15.114:0/3338411038 conn(0x7f0f28055d20 msgr2=0x7f0f28056130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.568+0000 7f0f3496c640 1 -- 172.21.15.114:0/3338411038 shutdown_connections 2023-11-04T01:36:50.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.568+0000 7f0f3496c640 1 -- 172.21.15.114:0/3338411038 wait complete. 2023-11-04T01:36:50.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.570+0000 7f0f3496c640 1 Processor -- start 2023-11-04T01:36:50.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.574+0000 7f0f3496c640 1 -- start start 2023-11-04T01:36:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.575+0000 7f0f3496c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0f28007310 0x7f0f2804edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.575+0000 7f0f3496c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f28050d80 0x7f0f2817d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.576+0000 7f0f3496c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f280e7680 0x7f0f2803a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.576+0000 7f0f2f7fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0f28007310 0x7f0f2804edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.576+0000 7f0f2f7fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0f28007310 0x7f0f2804edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:51862/0 (socket says 172.21.15.114:51862) 2023-11-04T01:36:50.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.576+0000 7f0f2f7fe640 1 -- 172.21.15.114:0/1451241045 learned_addr learned my addr 172.21.15.114:0/1451241045 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:50.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.576+0000 7f0f3496c640 1 -- 172.21.15.114:0/1451241045 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f280500a0 con 0x7f0f28050d80 2023-11-04T01:36:50.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.576+0000 7f0f2ffff640 1 --2- 172.21.15.114:0/1451241045 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f280e7680 0x7f0f2803a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.576+0000 7f0f3496c640 1 -- 172.21.15.114:0/1451241045 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2804f330 con 0x7f0f280e7680 2023-11-04T01:36:50.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.576+0000 7f0f2effd640 1 --2- 172.21.15.114:0/1451241045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f28050d80 0x7f0f2817d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.582+0000 7f0f3496c640 1 -- 172.21.15.114:0/1451241045 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2804f520 con 0x7f0f28007310 2023-11-04T01:36:50.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.583+0000 7f0f2effd640 1 -- 172.21.15.114:0/1451241045 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0f28007310 msgr2=0x7f0f2804edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.583+0000 7f0f2effd640 1 --2- 172.21.15.114:0/1451241045 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0f28007310 0x7f0f2804edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.583+0000 7f0f2effd640 1 -- 172.21.15.114:0/1451241045 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f280e7680 msgr2=0x7f0f2803a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.583+0000 7f0f2effd640 1 --2- 172.21.15.114:0/1451241045 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f280e7680 0x7f0f2803a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.583+0000 7f0f2effd640 1 -- 172.21.15.114:0/1451241045 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2804f800 con 0x7f0f28050d80 2023-11-04T01:36:50.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.583+0000 7f0f2effd640 1 --2- 172.21.15.114:0/1451241045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f28050d80 0x7f0f2817d800 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00c370 tx=0x7f0f1c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.584+0000 7f0f1bfff640 1 -- 172.21.15.114:0/1451241045 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c0052d0 con 0x7f0f28050d80 2023-11-04T01:36:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.584+0000 7f0f3496c640 1 -- 172.21.15.114:0/1451241045 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f2804fae0 con 0x7f0f28050d80 2023-11-04T01:36:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.584+0000 7f0f3496c640 1 -- 172.21.15.114:0/1451241045 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2817dd40 con 0x7f0f28050d80 2023-11-04T01:36:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.585+0000 7f0f1bfff640 1 -- 172.21.15.114:0/1451241045 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1c005430 con 0x7f0f28050d80 2023-11-04T01:36:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.585+0000 7f0f1bfff640 1 -- 172.21.15.114:0/1451241045 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c011890 con 0x7f0f28050d80 2023-11-04T01:36:50.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.600+0000 7f0f19ffb640 1 -- 172.21.15.114:0/1451241045 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f10005250 con 0x7f0f28050d80 2023-11-04T01:36:50.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.605+0000 7f0f1bfff640 1 -- 172.21.15.114:0/1451241045 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f1c0119f0 con 0x7f0f28050d80 2023-11-04T01:36:50.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.606+0000 7f0f1bfff640 1 --2- 172.21.15.114:0/1451241045 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0f1406ae70 0x7f0f1406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:50.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.606+0000 7f0f1bfff640 1 -- 172.21.15.114:0/1451241045 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0f1c088f00 con 0x7f0f28050d80 2023-11-04T01:36:50.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.609+0000 7f0f2f7fe640 1 --2- 172.21.15.114:0/1451241045 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0f1406ae70 0x7f0f1406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:50.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.609+0000 7f0f2f7fe640 1 --2- 172.21.15.114:0/1451241045 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0f1406ae70 0x7f0f1406d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f24000f60 tx=0x7f0f24009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:50.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.612+0000 7f0f1bfff640 1 -- 172.21.15.114:0/1451241045 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0f1c053c20 con 0x7f0f28050d80 2023-11-04T01:36:50.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.882+0000 7f340b167640 1 -- 172.21.15.114:0/1699009302 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f34040d2690 con 0x7f34040b8970 2023-11-04T01:36:50.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.883+0000 7f33faffd640 1 -- 172.21.15.114:0/1699009302 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3400034020 con 0x7f34040b8970 2023-11-04T01:36:50.885 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2023-11-04T01:36:50.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.885+0000 7f340b167640 1 -- 172.21.15.114:0/1699009302 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f33e806af40 msgr2=0x7f33e806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.886+0000 7f340b167640 1 --2- 172.21.15.114:0/1699009302 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f33e806af40 0x7f33e806d400 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f34040a9530 tx=0x7f33f4008040 comp rx=0 tx=0).stop 2023-11-04T01:36:50.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.886+0000 7f340b167640 1 -- 172.21.15.114:0/1699009302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34040b8970 msgr2=0x7f34041f5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.886+0000 7f340b167640 1 --2- 172.21.15.114:0/1699009302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34040b8970 0x7f34041f5800 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3400009870 tx=0x7f3400004730 comp rx=0 tx=0).stop 2023-11-04T01:36:50.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.886+0000 7f340b167640 1 -- 172.21.15.114:0/1699009302 shutdown_connections 2023-11-04T01:36:50.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.886+0000 7f340b167640 1 --2- 172.21.15.114:0/1699009302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f340415cc60 0x7f3404157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.886+0000 7f340b167640 1 --2- 172.21.15.114:0/1699009302 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f33e806af40 0x7f33e806d400 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.886+0000 7f340b167640 1 --2- 172.21.15.114:0/1699009302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34040d1170 0x7f340415dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.886+0000 7f340b167640 1 --2- 172.21.15.114:0/1699009302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34040b8970 0x7f34041f5800 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.887+0000 7f340b167640 1 -- 172.21.15.114:0/1699009302 >> 172.21.15.114:0/1699009302 conn(0x7f340406b4a0 msgr2=0x7f340415ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.887+0000 7f340b167640 1 -- 172.21.15.114:0/1699009302 shutdown_connections 2023-11-04T01:36:50.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.887+0000 7f340b167640 1 -- 172.21.15.114:0/1699009302 wait complete. 2023-11-04T01:36:50.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.900+0000 7fdff8ff9640 1 -- 172.21.15.114:0/3696996128 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe00c1fbaf0 con 0x7fe00c158ad0 2023-11-04T01:36:50.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.901+0000 7fdffaffd640 1 -- 172.21.15.114:0/3696996128 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe00c1fbaf0 con 0x7fe00c158ad0 2023-11-04T01:36:50.904 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2023-11-04T01:36:50.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.902+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2434614172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f30b4052490 con 0x7f30b4006b10 2023-11-04T01:36:50.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.902+0000 7fc081225640 1 -- 172.21.15.114:0/1879227406 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc07c15ac20 con 0x7fc07c15ce40 2023-11-04T01:36:50.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.903+0000 7fc078ff9640 1 -- 172.21.15.114:0/1879227406 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc074057b10 con 0x7fc07c15ce40 2023-11-04T01:36:50.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.903+0000 7f30b97fa640 1 -- 172.21.15.114:0/2434614172 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f30b0017090 con 0x7f30b4006b10 2023-11-04T01:36:50.906 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2023-11-04T01:36:50.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2023-11-04T01:36:50.908 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-11-04T01:36:50.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.905+0000 7fdff8ff9640 1 -- 172.21.15.114:0/3696996128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdfec06af40 msgr2=0x7fdfec06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.905+0000 7fdff8ff9640 1 --2- 172.21.15.114:0/3696996128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdfec06af40 0x7fdfec06d400 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdffc036000 tx=0x7fdffc03c040 comp rx=0 tx=0).stop 2023-11-04T01:36:50.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.905+0000 7fdff8ff9640 1 -- 172.21.15.114:0/3696996128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe00c158ad0 msgr2=0x7fe00c0afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.905+0000 7fdff8ff9640 1 --2- 172.21.15.114:0/3696996128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe00c158ad0 0x7fe00c0afd20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe00000b3e0 tx=0x7fe00000b8a0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.905+0000 7fdff8ff9640 1 -- 172.21.15.114:0/3696996128 shutdown_connections 2023-11-04T01:36:50.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.905+0000 7fdff8ff9640 1 --2- 172.21.15.114:0/3696996128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdfec06af40 0x7fdfec06d400 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.905+0000 7fdff8ff9640 1 --2- 172.21.15.114:0/3696996128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe00c158eb0 0x7fe00c0b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.905+0000 7fdff8ff9640 1 --2- 172.21.15.114:0/3696996128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe00c158ad0 0x7fe00c0afd20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.905+0000 7fdff8ff9640 1 --2- 172.21.15.114:0/3696996128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00c0ce6c0 0x7fe00c1666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.905+0000 7fdff8ff9640 1 -- 172.21.15.114:0/3696996128 >> 172.21.15.114:0/3696996128 conn(0x7fe00c06a120 msgr2=0x7fe00c06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.905+0000 7fdff8ff9640 1 -- 172.21.15.114:0/3696996128 shutdown_connections 2023-11-04T01:36:50.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.905+0000 7fdff8ff9640 1 -- 172.21.15.114:0/3696996128 wait complete. 2023-11-04T01:36:50.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.906+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2434614172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f30a006af40 msgr2=0x7f30a006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.906+0000 7f30c2ebb640 1 --2- 172.21.15.114:0/2434614172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f30a006af40 0x7f30a006d400 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f30bc069740 tx=0x7f30bc069f20 comp rx=0 tx=0).stop 2023-11-04T01:36:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.906+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2434614172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b4006b10 msgr2=0x7f30b404d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.906+0000 7f30c2ebb640 1 --2- 172.21.15.114:0/2434614172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b4006b10 0x7f30b404d4a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f30b000c410 tx=0x7f30b000c8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.906+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2434614172 shutdown_connections 2023-11-04T01:36:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.906+0000 7f30c2ebb640 1 --2- 172.21.15.114:0/2434614172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f30b40538e0 0x7f30b404be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.906+0000 7f30c2ebb640 1 --2- 172.21.15.114:0/2434614172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f30a006af40 0x7f30a006d400 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.906+0000 7f30c2ebb640 1 --2- 172.21.15.114:0/2434614172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30b4050470 0x7f30b404b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.906+0000 7f30c2ebb640 1 --2- 172.21.15.114:0/2434614172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b4006b10 0x7f30b404d4a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.906+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2434614172 >> 172.21.15.114:0/2434614172 conn(0x7f30b4055c10 msgr2=0x7f30b40e7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.907+0000 7fc081225640 1 -- 172.21.15.114:0/1879227406 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc06806ae70 msgr2=0x7fc06806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.907+0000 7fc081225640 1 --2- 172.21.15.114:0/1879227406 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc06806ae70 0x7fc06806d330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc06c006fd0 tx=0x7fc06c008040 comp rx=0 tx=0).stop 2023-11-04T01:36:50.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.907+0000 7fc081225640 1 -- 172.21.15.114:0/1879227406 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc07c15ce40 msgr2=0x7fc07c0c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.907+0000 7fc081225640 1 --2- 172.21.15.114:0/1879227406 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc07c15ce40 0x7fc07c0c46a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc07400c730 tx=0x7fc07400cb30 comp rx=0 tx=0).stop 2023-11-04T01:36:50.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.907+0000 7fc081225640 1 -- 172.21.15.114:0/1879227406 shutdown_connections 2023-11-04T01:36:50.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.907+0000 7fc081225640 1 --2- 172.21.15.114:0/1879227406 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc06806ae70 0x7fc06806d330 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.907+0000 7fc081225640 1 --2- 172.21.15.114:0/1879227406 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc07c15ce40 0x7fc07c0c46a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.907+0000 7fc081225640 1 --2- 172.21.15.114:0/1879227406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc07c158eb0 0x7fc07c154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.907+0000 7fc081225640 1 --2- 172.21.15.114:0/1879227406 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc07c158ad0 0x7fc07c0c2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.907+0000 7fc081225640 1 -- 172.21.15.114:0/1879227406 >> 172.21.15.114:0/1879227406 conn(0x7fc07c06a120 msgr2=0x7fc07c0b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.907+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2434614172 shutdown_connections 2023-11-04T01:36:50.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.907+0000 7f30c2ebb640 1 -- 172.21.15.114:0/2434614172 wait complete. 2023-11-04T01:36:50.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.907+0000 7fc081225640 1 -- 172.21.15.114:0/1879227406 shutdown_connections 2023-11-04T01:36:50.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.907+0000 7fc081225640 1 -- 172.21.15.114:0/1879227406 wait complete. 2023-11-04T01:36:50.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2023-11-04T01:36:50.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2023-11-04T01:36:50.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2023-11-04T01:36:50.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.928+0000 7fa5e5f39640 1 -- 172.21.15.114:0/1128721317 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa5c0005500 con 0x7fa5e006b120 2023-11-04T01:36:50.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.928+0000 7fa5c7fff640 1 -- 172.21.15.114:0/1128721317 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5d0079b90 con 0x7fa5e006b120 2023-11-04T01:36:50.931 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2023-11-04T01:36:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.930+0000 7fa5e5f39640 1 -- 172.21.15.114:0/1128721317 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa5cc06ae70 msgr2=0x7fa5cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.930+0000 7fa5e5f39640 1 --2- 172.21.15.114:0/1128721317 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa5cc06ae70 0x7fa5cc06d330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa5e01597e0 tx=0x7fa5d4008040 comp rx=0 tx=0).stop 2023-11-04T01:36:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.930+0000 7fa5e5f39640 1 -- 172.21.15.114:0/1128721317 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5e006b120 msgr2=0x7fa5e00c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.930+0000 7fa5e5f39640 1 --2- 172.21.15.114:0/1128721317 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5e006b120 0x7fa5e00c8430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0000c00 tx=0x7fa5d00046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.930+0000 7fa5e5f39640 1 -- 172.21.15.114:0/1128721317 shutdown_connections 2023-11-04T01:36:50.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.930+0000 7fa5e5f39640 1 --2- 172.21.15.114:0/1128721317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa5e01612b0 0x7fa5e01fecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.930+0000 7fa5e5f39640 1 --2- 172.21.15.114:0/1128721317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5e006d2b0 0x7fa5e00b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.930+0000 7fa5e5f39640 1 --2- 172.21.15.114:0/1128721317 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa5cc06ae70 0x7fa5cc06d330 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.930+0000 7fa5e5f39640 1 --2- 172.21.15.114:0/1128721317 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa5e006b120 0x7fa5e00c8430 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.930+0000 7fa5e5f39640 1 -- 172.21.15.114:0/1128721317 >> 172.21.15.114:0/1128721317 conn(0x7fa5e00cf140 msgr2=0x7fa5e00c5680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.930+0000 7fa5e5f39640 1 -- 172.21.15.114:0/1128721317 shutdown_connections 2023-11-04T01:36:50.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.930+0000 7fa5e5f39640 1 -- 172.21.15.114:0/1128721317 wait complete. 2023-11-04T01:36:50.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2023-11-04T01:36:50.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.955+0000 7fe7e97fa640 1 -- 172.21.15.114:0/2251565951 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe7fc0e1730 con 0x7fe7ec0039a0 2023-11-04T01:36:50.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.955+0000 7fe7eb7fe640 1 -- 172.21.15.114:0/2251565951 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe7fc0e1730 con 0x7fe7ec0039a0 2023-11-04T01:36:50.957 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2023-11-04T01:36:50.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.956+0000 7fe7e97fa640 1 -- 172.21.15.114:0/2251565951 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe7f006af70 msgr2=0x7fe7f006d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.956+0000 7fe7e97fa640 1 --2- 172.21.15.114:0/2251565951 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe7f006af70 0x7fe7f006d430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0e3840 tx=0x7fe7f8008040 comp rx=0 tx=0).stop 2023-11-04T01:36:50.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.956+0000 7fe7e97fa640 1 -- 172.21.15.114:0/2251565951 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7ec0039a0 msgr2=0x7fe7fc0cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.956+0000 7fe7e97fa640 1 --2- 172.21.15.114:0/2251565951 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7ec0039a0 0x7fe7fc0cb510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe804069c50 tx=0x7fe804069f20 comp rx=0 tx=0).stop 2023-11-04T01:36:50.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.956+0000 7fe7e97fa640 1 -- 172.21.15.114:0/2251565951 shutdown_connections 2023-11-04T01:36:50.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.956+0000 7fe7e97fa640 1 --2- 172.21.15.114:0/2251565951 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe7f006af70 0x7fe7f006d430 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.957+0000 7fe7e97fa640 1 --2- 172.21.15.114:0/2251565951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7fc0e1f50 0x7fe7fc036310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.957+0000 7fe7e97fa640 1 --2- 172.21.15.114:0/2251565951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7fc0cb010 0x7fe7fc0e1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.957+0000 7fe7e97fa640 1 --2- 172.21.15.114:0/2251565951 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7ec0039a0 0x7fe7fc0cb510 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.957+0000 7fe7e97fa640 1 -- 172.21.15.114:0/2251565951 >> 172.21.15.114:0/2251565951 conn(0x7fe7fc00a550 msgr2=0x7fe7fc04c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.957+0000 7fe7e97fa640 1 -- 172.21.15.114:0/2251565951 shutdown_connections 2023-11-04T01:36:50.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.957+0000 7fe7e97fa640 1 -- 172.21.15.114:0/2251565951 wait complete. 2023-11-04T01:36:50.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2023-11-04T01:36:50.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.981+0000 7f51299a9640 1 -- 172.21.15.114:0/819089263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5104005500 con 0x7f5124158c80 2023-11-04T01:36:50.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.981+0000 7f510bfff640 1 -- 172.21.15.114:0/819089263 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f51140579a0 con 0x7f5124158c80 2023-11-04T01:36:50.984 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-11-04T01:36:50.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.983+0000 7f51299a9640 1 -- 172.21.15.114:0/819089263 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f511006af40 msgr2=0x7f511006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.983+0000 7f51299a9640 1 --2- 172.21.15.114:0/819089263 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f511006af40 0x7f511006d400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f511c038000 tx=0x7f511c032000 comp rx=0 tx=0).stop 2023-11-04T01:36:50.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.983+0000 7f51299a9640 1 -- 172.21.15.114:0/819089263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5124158c80 msgr2=0x7f51241e2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:50.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.983+0000 7f51299a9640 1 --2- 172.21.15.114:0/819089263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5124158c80 0x7f51241e2c10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f511400c780 tx=0x7f511400cc40 comp rx=0 tx=0).stop 2023-11-04T01:36:50.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.983+0000 7f51299a9640 1 -- 172.21.15.114:0/819089263 shutdown_connections 2023-11-04T01:36:50.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.983+0000 7f51299a9640 1 --2- 172.21.15.114:0/819089263 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f511006af40 0x7f511006d400 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.983+0000 7f51299a9640 1 --2- 172.21.15.114:0/819089263 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5124159060 0x7f51241e3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.983+0000 7f51299a9640 1 --2- 172.21.15.114:0/819089263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5124158c80 0x7f51241e2c10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.983+0000 7f51299a9640 1 --2- 172.21.15.114:0/819089263 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51240ce4c0 0x7f51240c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.983+0000 7f51299a9640 1 -- 172.21.15.114:0/819089263 >> 172.21.15.114:0/819089263 conn(0x7f512406a120 msgr2=0x7f51240b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.983+0000 7f51299a9640 1 -- 172.21.15.114:0/819089263 shutdown_connections 2023-11-04T01:36:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:50.983+0000 7f51299a9640 1 -- 172.21.15.114:0/819089263 wait complete. 2023-11-04T01:36:50.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2023-11-04T01:36:51.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:51.005+0000 7f0f19ffb640 1 -- 172.21.15.114:0/1451241045 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0f10005500 con 0x7f0f28050d80 2023-11-04T01:36:51.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:51.005+0000 7f0f1bfff640 1 -- 172.21.15.114:0/1451241045 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0f1c017090 con 0x7f0f28050d80 2023-11-04T01:36:51.007 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-11-04T01:36:51.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:51.007+0000 7f0f19ffb640 1 -- 172.21.15.114:0/1451241045 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0f1406ae70 msgr2=0x7f0f1406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:51.007+0000 7f0f19ffb640 1 --2- 172.21.15.114:0/1451241045 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0f1406ae70 0x7f0f1406d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f24000f60 tx=0x7f0f24009040 comp rx=0 tx=0).stop 2023-11-04T01:36:51.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:51.007+0000 7f0f19ffb640 1 -- 172.21.15.114:0/1451241045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f28050d80 msgr2=0x7f0f2817d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:51.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:51.007+0000 7f0f19ffb640 1 --2- 172.21.15.114:0/1451241045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f28050d80 0x7f0f2817d800 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00c370 tx=0x7f0f1c00c830 comp rx=0 tx=0).stop 2023-11-04T01:36:51.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:51.007+0000 7f0f19ffb640 1 -- 172.21.15.114:0/1451241045 shutdown_connections 2023-11-04T01:36:51.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:51.007+0000 7f0f19ffb640 1 --2- 172.21.15.114:0/1451241045 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0f1406ae70 0x7f0f1406d330 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:51.007+0000 7f0f19ffb640 1 --2- 172.21.15.114:0/1451241045 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0f280e7680 0x7f0f2803a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:51.007+0000 7f0f19ffb640 1 --2- 172.21.15.114:0/1451241045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f28050d80 0x7f0f2817d800 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:51.007+0000 7f0f19ffb640 1 --2- 172.21.15.114:0/1451241045 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0f28007310 0x7f0f2804edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:51.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:51.007+0000 7f0f19ffb640 1 -- 172.21.15.114:0/1451241045 >> 172.21.15.114:0/1451241045 conn(0x7f0f28055d20 msgr2=0x7f0f2804b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:51.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:51.007+0000 7f0f19ffb640 1 -- 172.21.15.114:0/1451241045 shutdown_connections 2023-11-04T01:36:51.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:51.007+0000 7f0f19ffb640 1 -- 172.21.15.114:0/1451241045 wait complete. 2023-11-04T01:36:51.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2023-11-04T01:36:51.909 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-04T01:36:51.927 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-04T01:36:51.929 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-04T01:36:51.929 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T01:36:51.945 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-04T01:36:51.971 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T01:36:51.997 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T01:36:52.024 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-04T01:36:52.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.048+0000 7f5bb1f7c640 1 Processor -- start 2023-11-04T01:36:52.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.049+0000 7f5bb1f7c640 1 -- start start 2023-11-04T01:36:52.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.050+0000 7f5bb1f7c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5bac071f90 0x7f5bac0b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.050+0000 7f5bb1f7c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5bac15add0 0x7f5bac0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.050+0000 7f5bb1f7c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bac0b1cc0 con 0x7f5bac072370 2023-11-04T01:36:52.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.050+0000 7f5bb1f7c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bac0b1fa0 con 0x7f5bac15add0 2023-11-04T01:36:52.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.050+0000 7f5bb1f7c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac15a0e0 con 0x7f5bac071f90 2023-11-04T01:36:52.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.050+0000 7f5babfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5bac072370 0x7f5bac0cf200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41122/0 (socket says 172.21.15.114:41122) 2023-11-04T01:36:52.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.050+0000 7f5babfff640 1 -- 172.21.15.114:0/399795272 learned_addr learned my addr 172.21.15.114:0/399795272 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:52.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.050+0000 7f5baaffd640 1 --2- 172.21.15.114:0/399795272 >> v2:172.21.15.114:3300/0 conn(0x7f5bac15add0 0x7f5bac0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.051+0000 7f5bab7fe640 1 --2- 172.21.15.114:0/399795272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5bac071f90 0x7f5bac0b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.051+0000 7f5baaffd640 1 -- 172.21.15.114:0/399795272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5bac071f90 msgr2=0x7f5bac0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:52.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.051+0000 7f5baaffd640 1 --2- 172.21.15.114:0/399795272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5bac071f90 0x7f5bac0b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.051+0000 7f5baaffd640 1 -- 172.21.15.114:0/399795272 >> v1:172.21.15.114:6789/0 conn(0x7f5bac072370 legacy=0x7f5bac0cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.051+0000 7f5baaffd640 1 -- 172.21.15.114:0/399795272 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac15a2f0 con 0x7f5bac15add0 2023-11-04T01:36:52.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.053+0000 7f5baaffd640 1 --2- 172.21.15.114:0/399795272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bac15add0 0x7f5bac0cecc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009d90 tx=0x7f5ba402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8def0788581f727 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.053+0000 7f5baa7fc640 1 -- 172.21.15.114:0/399795272 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba402cc90 con 0x7f5bac15add0 2023-11-04T01:36:52.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.053+0000 7f5baa7fc640 1 -- 172.21.15.114:0/399795272 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba402cdf0 con 0x7f5bac15add0 2023-11-04T01:36:52.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.053+0000 7f5baa7fc640 1 -- 172.21.15.114:0/399795272 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4034660 con 0x7f5bac15add0 2023-11-04T01:36:52.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.055+0000 7f5bb1f7c640 1 -- 172.21.15.114:0/399795272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bac15add0 msgr2=0x7f5bac0cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.055+0000 7f5bb1f7c640 1 --2- 172.21.15.114:0/399795272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bac15add0 0x7f5bac0cecc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009d90 tx=0x7f5ba402bee0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.055+0000 7f5bb1f7c640 1 -- 172.21.15.114:0/399795272 shutdown_connections 2023-11-04T01:36:52.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.055+0000 7f5bb1f7c640 1 --2- 172.21.15.114:0/399795272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bac15add0 0x7f5bac0cecc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.055+0000 7f5bb1f7c640 1 --2- 172.21.15.114:0/399795272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5bac071f90 0x7f5bac0b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.055+0000 7f5bb1f7c640 1 -- 172.21.15.114:0/399795272 >> 172.21.15.114:0/399795272 conn(0x7f5bac06d800 msgr2=0x7f5bac06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.056+0000 7f5bb1f7c640 1 -- 172.21.15.114:0/399795272 shutdown_connections 2023-11-04T01:36:52.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.056+0000 7f5bb1f7c640 1 -- 172.21.15.114:0/399795272 wait complete. 2023-11-04T01:36:52.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.058+0000 7f5bb1f7c640 1 Processor -- start 2023-11-04T01:36:52.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.058+0000 7f5bb1f7c640 1 -- start start 2023-11-04T01:36:52.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.060+0000 7f5bb1f7c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bac071f90 0x7f5bac14ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.060+0000 7f5bb1f7c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5bac072370 0x7f5bac14e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.060+0000 7f5bb1f7c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5bac15add0 0x7f5bac0b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.060+0000 7f5bb1f7c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac0d0040 con 0x7f5bac071f90 2023-11-04T01:36:52.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.060+0000 7f5bb1f7c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac14eaf0 con 0x7f5bac15add0 2023-11-04T01:36:52.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.060+0000 7f5bb1f7c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac0b33c0 con 0x7f5bac072370 2023-11-04T01:36:52.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.060+0000 7f5baaffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5bac072370 0x7f5bac14e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.060+0000 7f5babfff640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5bac15add0 0x7f5bac0b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.060+0000 7f5babfff640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5bac15add0 0x7f5bac0b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35200/0 (socket says 172.21.15.114:35200) 2023-11-04T01:36:52.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.060+0000 7f5babfff640 1 -- 172.21.15.114:0/2437706285 learned_addr learned my addr 172.21.15.114:0/2437706285 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:52.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.061+0000 7f5bab7fe640 1 --2- 172.21.15.114:0/2437706285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bac071f90 0x7f5bac14ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.061+0000 7f5babfff640 1 -- 172.21.15.114:0/2437706285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5bac072370 msgr2=0x7f5bac14e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.061+0000 7f5babfff640 1 --2- 172.21.15.114:0/2437706285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5bac072370 0x7f5bac14e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.061+0000 7f5babfff640 1 -- 172.21.15.114:0/2437706285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bac071f90 msgr2=0x7f5bac14ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.062+0000 7f5babfff640 1 --2- 172.21.15.114:0/2437706285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bac071f90 0x7f5bac14ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.062+0000 7f5babfff640 1 -- 172.21.15.114:0/2437706285 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba4009a70 con 0x7f5bac15add0 2023-11-04T01:36:52.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.062+0000 7f5bab7fe640 1 --2- 172.21.15.114:0/2437706285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bac071f90 0x7f5bac14ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:52.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.062+0000 7f5babfff640 1 --2- 172.21.15.114:0/2437706285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5bac15add0 0x7f5bac0b3800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000c3f0 tx=0x7f5ba000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.063+0000 7f5b93fff640 1 -- 172.21.15.114:0/2437706285 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0005ce0 con 0x7f5bac15add0 2023-11-04T01:36:52.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.063+0000 7f5bb1f7c640 1 -- 172.21.15.114:0/2437706285 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bac0cf6a0 con 0x7f5bac15add0 2023-11-04T01:36:52.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.063+0000 7f5bb1f7c640 1 -- 172.21.15.114:0/2437706285 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bac0cfc60 con 0x7f5bac15add0 2023-11-04T01:36:52.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.064+0000 7f5b93fff640 1 -- 172.21.15.114:0/2437706285 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba0005e40 con 0x7f5bac15add0 2023-11-04T01:36:52.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.064+0000 7f5b93fff640 1 -- 172.21.15.114:0/2437706285 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00072f0 con 0x7f5bac15add0 2023-11-04T01:36:52.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.066+0000 7f5bb1f7c640 1 -- 172.21.15.114:0/2437706285 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b8c005250 con 0x7f5bac15add0 2023-11-04T01:36:52.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.067+0000 7f5b93fff640 1 -- 172.21.15.114:0/2437706285 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ba0007450 con 0x7f5bac15add0 2023-11-04T01:36:52.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.067+0000 7f5b93fff640 1 --2- 172.21.15.114:0/2437706285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5b9806ae70 0x7f5b9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.068+0000 7f5bab7fe640 1 --2- 172.21.15.114:0/2437706285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5b9806ae70 0x7f5b9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.068+0000 7f5b93fff640 1 -- 172.21.15.114:0/2437706285 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5ba0088f40 con 0x7f5bac15add0 2023-11-04T01:36:52.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.069+0000 7f5bab7fe640 1 --2- 172.21.15.114:0/2437706285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5b9806ae70 0x7f5b9806d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c006fd0 tx=0x7f5b9c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.074+0000 7f5b93fff640 1 -- 172.21.15.114:0/2437706285 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5ba0053e20 con 0x7f5bac15add0 2023-11-04T01:36:52.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.100+0000 7fa532e4b640 1 Processor -- start 2023-11-04T01:36:52.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.101+0000 7fa532e4b640 1 -- start start 2023-11-04T01:36:52.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.102+0000 7fa532e4b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa52c0ce4c0 0x7fa52c163d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.102+0000 7fa532e4b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52c0cb1e0 con 0x7fa52c159060 2023-11-04T01:36:52.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.102+0000 7fa532e4b640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52c1595d0 con 0x7fa52c158c80 2023-11-04T01:36:52.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.102+0000 7fa532e4b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa52c0cad00 con 0x7fa52c0ce4c0 2023-11-04T01:36:52.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.103+0000 7fa52bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa52c159060 0x7fa52c0cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41134/0 (socket says 172.21.15.114:41134) 2023-11-04T01:36:52.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.103+0000 7fa52bfff640 1 -- 172.21.15.114:0/89398247 learned_addr learned my addr 172.21.15.114:0/89398247 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:52.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.103+0000 7fa5313e8640 1 --2- 172.21.15.114:0/89398247 >> v2:172.21.15.114:3300/0 conn(0x7fa52c0ce4c0 0x7fa52c163d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.103+0000 7fa5313e8640 1 -- 172.21.15.114:0/89398247 >> v1:172.21.15.141:6789/0 conn(0x7fa52c158c80 legacy=0x7fa52c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:52.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.103+0000 7fa5313e8640 1 -- 172.21.15.114:0/89398247 >> v1:172.21.15.114:6789/0 conn(0x7fa52c159060 legacy=0x7fa52c0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.104+0000 7fa52b7fe640 1 -- 172.21.15.114:0/89398247 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133685674 0 0) 0x7fa52c0cb1e0 con 0x7fa52c159060 2023-11-04T01:36:52.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.104+0000 7fa5313e8640 1 -- 172.21.15.114:0/89398247 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c0caf00 con 0x7fa52c0ce4c0 2023-11-04T01:36:52.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.105+0000 7fa5313e8640 1 --2- 172.21.15.114:0/89398247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa52c0ce4c0 0x7fa52c163d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa524009d90 tx=0x7fa52402e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c32607a4e18ef7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.106+0000 7fa52b7fe640 1 -- 172.21.15.114:0/89398247 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52402eea0 con 0x7fa52c0ce4c0 2023-11-04T01:36:52.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.106+0000 7fa52b7fe640 1 -- 172.21.15.114:0/89398247 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa524036440 con 0x7fa52c0ce4c0 2023-11-04T01:36:52.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.107+0000 7fa52b7fe640 1 -- 172.21.15.114:0/89398247 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa524036810 con 0x7fa52c0ce4c0 2023-11-04T01:36:52.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.107+0000 7fa532e4b640 1 -- 172.21.15.114:0/89398247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa52c0ce4c0 msgr2=0x7fa52c163d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.107+0000 7fa532e4b640 1 --2- 172.21.15.114:0/89398247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa52c0ce4c0 0x7fa52c163d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa524009d90 tx=0x7fa52402e0f0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.107+0000 7fa532e4b640 1 -- 172.21.15.114:0/89398247 shutdown_connections 2023-11-04T01:36:52.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.107+0000 7fa532e4b640 1 --2- 172.21.15.114:0/89398247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa52c0ce4c0 0x7fa52c163d90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.107+0000 7fa532e4b640 1 -- 172.21.15.114:0/89398247 >> 172.21.15.114:0/89398247 conn(0x7fa52c06a120 msgr2=0x7fa52c06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.107+0000 7fa532e4b640 1 -- 172.21.15.114:0/89398247 shutdown_connections 2023-11-04T01:36:52.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.107+0000 7fa532e4b640 1 -- 172.21.15.114:0/89398247 wait complete. 2023-11-04T01:36:52.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.109+0000 7fa532e4b640 1 Processor -- start 2023-11-04T01:36:52.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.109+0000 7fa532e4b640 1 -- start start 2023-11-04T01:36:52.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.108+0000 7f488d02e640 1 Processor -- start 2023-11-04T01:36:52.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.108+0000 7f488d02e640 1 -- start start 2023-11-04T01:36:52.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.109+0000 7f488d02e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4880052f60 0x7f48800504f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.109+0000 7f488d02e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f48800062c0 0x7f4880054350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.109+0000 7f488d02e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48800381e0 con 0x7f48800e7800 2023-11-04T01:36:52.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.109+0000 7f488d02e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488004fa80 con 0x7f48800062c0 2023-11-04T01:36:52.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.109+0000 7f488d02e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4880054890 con 0x7f4880052f60 2023-11-04T01:36:52.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.110+0000 7f48877fe640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f48800e7800 0x7f4880050a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:45830/0 (socket says 172.21.15.114:45830) 2023-11-04T01:36:52.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.110+0000 7f48877fe640 1 -- 172.21.15.114:0/1004918709 learned_addr learned my addr 172.21.15.114:0/1004918709 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:52.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.110+0000 7f4887fff640 1 --2- 172.21.15.114:0/1004918709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4880052f60 0x7f48800504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.110+0000 7fa532e4b640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa52c0ce4c0 0x7fa52c14b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.110+0000 7f488c82d640 1 --2- 172.21.15.114:0/1004918709 >> v2:172.21.15.141:3300/0 conn(0x7f48800062c0 0x7f4880054350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.110+0000 7fa532e4b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa52c158c80 0x7fa52c0c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.111+0000 7f4886ffd640 1 -- 172.21.15.114:0/1004918709 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938748580 0 0) 0x7f48800381e0 con 0x7f48800e7800 2023-11-04T01:36:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.111+0000 7f4886ffd640 1 -- 172.21.15.114:0/1004918709 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4878003520 con 0x7f48800e7800 2023-11-04T01:36:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.111+0000 7f4887fff640 1 -- 172.21.15.114:0/1004918709 >> v2:172.21.15.141:3300/0 conn(0x7f48800062c0 msgr2=0x7f4880054350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.111+0000 7f4887fff640 1 --2- 172.21.15.114:0/1004918709 >> v2:172.21.15.141:3300/0 conn(0x7f48800062c0 0x7f4880054350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.111+0000 7f4887fff640 1 -- 172.21.15.114:0/1004918709 >> v1:172.21.15.141:6789/0 conn(0x7f48800e7800 legacy=0x7f4880050a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.111+0000 7f4887fff640 1 -- 172.21.15.114:0/1004918709 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4880006810 con 0x7f4880052f60 2023-11-04T01:36:52.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.111+0000 7fa530be7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa52c0ce4c0 0x7fa52c14b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.111+0000 7fa530be7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa52c0ce4c0 0x7fa52c14b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35210/0 (socket says 172.21.15.114:35210) 2023-11-04T01:36:52.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.111+0000 7fa52bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa52c158c80 0x7fa52c0c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.111+0000 7fa52bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa52c158c80 0x7fa52c0c5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49382/0 (socket says 172.21.15.114:49382) 2023-11-04T01:36:52.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.111+0000 7fa530be7640 1 -- 172.21.15.114:0/966538478 learned_addr learned my addr 172.21.15.114:0/966538478 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:52.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.111+0000 7fa532e4b640 1 --2- 172.21.15.114:0/966538478 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa52c159060 0x7fa52c1572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.111+0000 7fa532e4b640 1 -- 172.21.15.114:0/966538478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c1f7f10 con 0x7fa52c158c80 2023-11-04T01:36:52.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.111+0000 7fa532e4b640 1 -- 172.21.15.114:0/966538478 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c15c030 con 0x7fa52c0ce4c0 2023-11-04T01:36:52.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.111+0000 7fa532e4b640 1 -- 172.21.15.114:0/966538478 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c1f7300 con 0x7fa52c159060 2023-11-04T01:36:52.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.112+0000 7fa52bfff640 1 -- 172.21.15.114:0/966538478 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa52c159060 msgr2=0x7fa52c1572c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:36:52.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.112+0000 7f4887fff640 1 --2- 172.21.15.114:0/1004918709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4880052f60 0x7f48800504f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f48740097a0 tx=0x7f487402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceaba4cb92f529ce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.112+0000 7fa52bfff640 1 --2- 172.21.15.114:0/966538478 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa52c159060 0x7fa52c1572c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.112+0000 7fa52bfff640 1 -- 172.21.15.114:0/966538478 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa52c0ce4c0 msgr2=0x7fa52c14b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.112+0000 7fa52bfff640 1 --2- 172.21.15.114:0/966538478 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa52c0ce4c0 0x7fa52c14b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.112+0000 7fa52bfff640 1 -- 172.21.15.114:0/966538478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa524009a70 con 0x7fa52c158c80 2023-11-04T01:36:52.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.113+0000 7f4886ffd640 1 -- 172.21.15.114:0/1004918709 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4874031830 con 0x7f4880052f60 2023-11-04T01:36:52.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.113+0000 7f4886ffd640 1 -- 172.21.15.114:0/1004918709 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4874031990 con 0x7f4880052f60 2023-11-04T01:36:52.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.113+0000 7fa52bfff640 1 --2- 172.21.15.114:0/966538478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa52c158c80 0x7fa52c0c5a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00c750 tx=0x7fa51c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.114+0000 7f488d02e640 1 -- 172.21.15.114:0/1004918709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4880052f60 msgr2=0x7f48800504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.114+0000 7f488d02e640 1 --2- 172.21.15.114:0/1004918709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4880052f60 0x7f48800504f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f48740097a0 tx=0x7f487402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.114+0000 7f488d02e640 1 -- 172.21.15.114:0/1004918709 shutdown_connections 2023-11-04T01:36:52.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.114+0000 7f488d02e640 1 --2- 172.21.15.114:0/1004918709 >> v2:172.21.15.141:3300/0 conn(0x7f48800062c0 0x7f4880054350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.114+0000 7f488d02e640 1 --2- 172.21.15.114:0/1004918709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4880052f60 0x7f48800504f0 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f48740097a0 tx=0x7f487402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.114+0000 7f488d02e640 1 -- 172.21.15.114:0/1004918709 >> 172.21.15.114:0/1004918709 conn(0x7f4880055390 msgr2=0x7f48800557a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.114+0000 7fa5297fa640 1 -- 172.21.15.114:0/966538478 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0070d0 con 0x7fa52c158c80 2023-11-04T01:36:52.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.114+0000 7fa532e4b640 1 -- 172.21.15.114:0/966538478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52c1f75e0 con 0x7fa52c158c80 2023-11-04T01:36:52.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.114+0000 7fa532e4b640 1 -- 172.21.15.114:0/966538478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52c1f7ba0 con 0x7fa52c158c80 2023-11-04T01:36:52.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.114+0000 7fa5297fa640 1 -- 172.21.15.114:0/966538478 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c007230 con 0x7fa52c158c80 2023-11-04T01:36:52.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.115+0000 7fa5297fa640 1 -- 172.21.15.114:0/966538478 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c007600 con 0x7fa52c158c80 2023-11-04T01:36:52.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.117+0000 7f488d02e640 1 -- 172.21.15.114:0/1004918709 shutdown_connections 2023-11-04T01:36:52.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.117+0000 7f488d02e640 1 -- 172.21.15.114:0/1004918709 wait complete. 2023-11-04T01:36:52.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.117+0000 7fa532e4b640 1 -- 172.21.15.114:0/966538478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50c005250 con 0x7fa52c158c80 2023-11-04T01:36:52.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.118+0000 7fa5297fa640 1 -- 172.21.15.114:0/966538478 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa51c0047e0 con 0x7fa52c158c80 2023-11-04T01:36:52.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.119+0000 7fa5297fa640 1 --2- 172.21.15.114:0/966538478 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa51806af40 0x7fa51806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.119+0000 7fa5297fa640 1 -- 172.21.15.114:0/966538478 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa51c088c70 con 0x7fa52c158c80 2023-11-04T01:36:52.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.119+0000 7f488d02e640 1 Processor -- start 2023-11-04T01:36:52.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.118+0000 7f065282b640 1 Processor -- start 2023-11-04T01:36:52.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.118+0000 7f065282b640 1 -- start start 2023-11-04T01:36:52.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.119+0000 7f065282b640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f064404f9f0 0x7f064403a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.119+0000 7f065282b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06440e7a60 0x7f064403aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.119+0000 7f065282b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0644034770 con 0x7f0644007b90 2023-11-04T01:36:52.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.119+0000 7f065282b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0644034a50 con 0x7f06440e7a60 2023-11-04T01:36:52.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.119+0000 7f065282b640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06440070b0 con 0x7f064404f9f0 2023-11-04T01:36:52.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.120+0000 7f064bfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f064404f9f0 0x7f064403a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.120+0000 7f064bfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f064404f9f0 0x7f064403a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35216/0 (socket says 172.21.15.114:35216) 2023-11-04T01:36:52.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.120+0000 7fa530be7640 1 --2- 172.21.15.114:0/966538478 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa51806af40 0x7fa51806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.120+0000 7f064bfff640 1 -- 172.21.15.114:0/1205609668 learned_addr learned my addr 172.21.15.114:0/1205609668 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:52.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.120+0000 7f488d02e640 1 -- start start 2023-11-04T01:36:52.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.121+0000 7fa530be7640 1 --2- 172.21.15.114:0/966538478 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa51806af40 0x7fa51806d400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa520005020 tx=0x7fa520007ef0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.121+0000 7f064bfff640 1 -- 172.21.15.114:0/1205609668 >> v2:172.21.15.114:3300/0 conn(0x7f06440e7a60 msgr2=0x7f064403aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:52.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.121+0000 7f064bfff640 1 --2- 172.21.15.114:0/1205609668 >> v2:172.21.15.114:3300/0 conn(0x7f06440e7a60 0x7f064403aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.121+0000 7f064bfff640 1 -- 172.21.15.114:0/1205609668 >> v1:172.21.15.114:6789/0 conn(0x7f0644007b90 legacy=0x7f06440e7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:52.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.121+0000 7f064bfff640 1 -- 172.21.15.114:0/1205609668 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0644007390 con 0x7f064404f9f0 2023-11-04T01:36:52.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.121+0000 7f488d02e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48800062c0 0x7f488004f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.121+0000 7f488d02e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48800e7800 0x7f48800cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.121+0000 7f488d02e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48800cdf30 0x7f48800451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.121+0000 7f488d02e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48800d0a20 con 0x7f48800062c0 2023-11-04T01:36:52.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.122+0000 7f488d02e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48800ce3c0 con 0x7f48800e7800 2023-11-04T01:36:52.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.122+0000 7f488d02e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48800cfda0 con 0x7f48800cdf30 2023-11-04T01:36:52.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.122+0000 7f488c82d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48800cdf30 0x7f48800451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.122+0000 7f488c82d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48800cdf30 0x7f48800451b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:51904/0 (socket says 172.21.15.114:51904) 2023-11-04T01:36:52.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.122+0000 7f488c82d640 1 -- 172.21.15.114:0/2969006084 learned_addr learned my addr 172.21.15.114:0/2969006084 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:52.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.122+0000 7f4887fff640 1 --2- 172.21.15.114:0/2969006084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48800062c0 0x7f488004f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.122+0000 7f488c82d640 1 -- 172.21.15.114:0/2969006084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48800e7800 msgr2=0x7f48800cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.122+0000 7f064bfff640 1 --2- 172.21.15.114:0/1205609668 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f064404f9f0 0x7f064403a4c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0644008c80 tx=0x7f063802b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9c59ba051c5f03c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.122+0000 7f48877fe640 1 --2- 172.21.15.114:0/2969006084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48800e7800 0x7f48800cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.122+0000 7f488c82d640 1 --2- 172.21.15.114:0/2969006084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48800e7800 0x7f48800cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.122+0000 7f488c82d640 1 -- 172.21.15.114:0/2969006084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48800062c0 msgr2=0x7f488004f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.122+0000 7f488c82d640 1 --2- 172.21.15.114:0/2969006084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48800062c0 0x7f488004f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.122+0000 7f488c82d640 1 -- 172.21.15.114:0/2969006084 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4874009400 con 0x7f48800cdf30 2023-11-04T01:36:52.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.123+0000 7f4887fff640 1 --2- 172.21.15.114:0/2969006084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48800062c0 0x7f488004f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:52.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.123+0000 7f48877fe640 1 --2- 172.21.15.114:0/2969006084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48800e7800 0x7f48800cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:52.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.123+0000 7f488c82d640 1 --2- 172.21.15.114:0/2969006084 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48800cdf30 0x7f48800451b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4888063cf0 tx=0x7f4888067460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.123+0000 7f064affd640 1 -- 172.21.15.114:0/1205609668 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638031890 con 0x7f064404f9f0 2023-11-04T01:36:52.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.123+0000 7f064affd640 1 -- 172.21.15.114:0/1205609668 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06380319f0 con 0x7f064404f9f0 2023-11-04T01:36:52.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.123+0000 7f064affd640 1 -- 172.21.15.114:0/1205609668 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638031890 con 0x7f064404f9f0 2023-11-04T01:36:52.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.123+0000 7f4884ff9640 1 -- 172.21.15.114:0/2969006084 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888073210 con 0x7f48800cdf30 2023-11-04T01:36:52.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.123+0000 7f4884ff9640 1 -- 172.21.15.114:0/2969006084 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4888093430 con 0x7f48800cdf30 2023-11-04T01:36:52.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.123+0000 7f4884ff9640 1 -- 172.21.15.114:0/2969006084 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48880937a0 con 0x7f48800cdf30 2023-11-04T01:36:52.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.123+0000 7f488d02e640 1 -- 172.21.15.114:0/2969006084 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48800d0080 con 0x7f48800cdf30 2023-11-04T01:36:52.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.123+0000 7f488d02e640 1 -- 172.21.15.114:0/2969006084 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48800d0640 con 0x7f48800cdf30 2023-11-04T01:36:52.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.124+0000 7f065282b640 1 -- 172.21.15.114:0/1205609668 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f064404f9f0 msgr2=0x7f064403a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.124+0000 7f065282b640 1 --2- 172.21.15.114:0/1205609668 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f064404f9f0 0x7f064403a4c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0644008c80 tx=0x7f063802b930 comp rx=0 tx=0).stop 2023-11-04T01:36:52.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.124+0000 7f065282b640 1 -- 172.21.15.114:0/1205609668 shutdown_connections 2023-11-04T01:36:52.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.124+0000 7f065282b640 1 --2- 172.21.15.114:0/1205609668 >> v2:172.21.15.114:3300/0 conn(0x7f06440e7a60 0x7f064403aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.124+0000 7f065282b640 1 --2- 172.21.15.114:0/1205609668 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f064404f9f0 0x7f064403a4c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.124+0000 7f065282b640 1 -- 172.21.15.114:0/1205609668 >> 172.21.15.114:0/1205609668 conn(0x7f0644055130 msgr2=0x7f0644055540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.124+0000 7f065282b640 1 -- 172.21.15.114:0/1205609668 shutdown_connections 2023-11-04T01:36:52.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.124+0000 7f065282b640 1 -- 172.21.15.114:0/1205609668 wait complete. 2023-11-04T01:36:52.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.125+0000 7f4884ff9640 1 -- 172.21.15.114:0/2969006084 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4888093900 con 0x7f48800cdf30 2023-11-04T01:36:52.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.125+0000 7f47dbb3e640 1 Processor -- start 2023-11-04T01:36:52.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.126+0000 7f47dbb3e640 1 -- start start 2023-11-04T01:36:52.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.126+0000 7f4884ff9640 1 --2- 172.21.15.114:0/2969006084 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f486c06aef0 0x7f486c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.126+0000 7f4884ff9640 1 -- 172.21.15.114:0/2969006084 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f48881043c0 con 0x7f48800cdf30 2023-11-04T01:36:52.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.126+0000 7f4887fff640 1 --2- 172.21.15.114:0/2969006084 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f486c06aef0 0x7f486c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.126+0000 7f065282b640 1 Processor -- start 2023-11-04T01:36:52.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.127+0000 7f065282b640 1 -- start start 2023-11-04T01:36:52.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.127+0000 7f4887fff640 1 --2- 172.21.15.114:0/2969006084 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f486c06aef0 0x7f486c06d3b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4874036000 tx=0x7f4874008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.127+0000 7f47dbb3e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f47d4156aa0 0x7f47d4159df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.127+0000 7f48727fc640 1 -- 172.21.15.114:0/2969006084 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48800074b0 con 0x7f48800cdf30 2023-11-04T01:36:52.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.127+0000 7f47dbb3e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f47d40cc9e0 0x7f47d40709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.127+0000 7f47dbb3e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d40cdb90 con 0x7f47d4070f30 2023-11-04T01:36:52.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.127+0000 7f47dbb3e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d406ca50 con 0x7f47d40cc9e0 2023-11-04T01:36:52.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.127+0000 7f47dbb3e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d40713c0 con 0x7f47d4156aa0 2023-11-04T01:36:52.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.127+0000 7f47d98da640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f47d4156aa0 0x7f47d4159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.128+0000 7f47d98da640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f47d4156aa0 0x7f47d4159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:51908/0 (socket says 172.21.15.114:51908) 2023-11-04T01:36:52.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.128+0000 7f47d98da640 1 -- 172.21.15.114:0/896444737 learned_addr learned my addr 172.21.15.114:0/896444737 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:52.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.128+0000 7f47d90d9640 1 --2- 172.21.15.114:0/896444737 >> v2:172.21.15.114:3300/0 conn(0x7f47d40cc9e0 0x7f47d40709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.128+0000 7f065282b640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0644007b90 0x7f064404dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.128+0000 7f47d98da640 1 -- 172.21.15.114:0/896444737 >> v2:172.21.15.114:3300/0 conn(0x7f47d40cc9e0 msgr2=0x7f47d40709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:52.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.128+0000 7f47d98da640 1 --2- 172.21.15.114:0/896444737 >> v2:172.21.15.114:3300/0 conn(0x7f47d40cc9e0 0x7f47d40709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.128+0000 7f47d98da640 1 -- 172.21.15.114:0/896444737 >> v1:172.21.15.141:6789/0 conn(0x7f47d4070f30 legacy=0x7f47d415c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.128+0000 7f47d98da640 1 -- 172.21.15.114:0/896444737 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d415a330 con 0x7f47d4156aa0 2023-11-04T01:36:52.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.128+0000 7f065282b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f064404f9f0 0x7f064404aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.128+0000 7f065282b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06440e7a60 0x7f0644034c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.128+0000 7f064bfff640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0644007b90 0x7f064404dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.128+0000 7f064bfff640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0644007b90 0x7f064404dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35240/0 (socket says 172.21.15.114:35240) 2023-11-04T01:36:52.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.128+0000 7f064b7fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f064404f9f0 0x7f064404aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.128+0000 7f064b7fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f064404f9f0 0x7f064404aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:51924/0 (socket says 172.21.15.114:51924) 2023-11-04T01:36:52.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.128+0000 7f064bfff640 1 -- 172.21.15.114:0/111910819 learned_addr learned my addr 172.21.15.114:0/111910819 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:52.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.128+0000 7f065282b640 1 -- 172.21.15.114:0/111910819 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06440d1380 con 0x7f06440e7a60 2023-11-04T01:36:52.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.129+0000 7f06515c9640 1 --2- 172.21.15.114:0/111910819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06440e7a60 0x7f0644034c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.129+0000 7f065282b640 1 -- 172.21.15.114:0/111910819 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0644035950 con 0x7f0644007b90 2023-11-04T01:36:52.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.129+0000 7fa5297fa640 1 -- 172.21.15.114:0/966538478 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa51c053b80 con 0x7fa52c158c80 2023-11-04T01:36:52.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.129+0000 7f065282b640 1 -- 172.21.15.114:0/111910819 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064404e500 con 0x7f064404f9f0 2023-11-04T01:36:52.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.129+0000 7f47d98da640 1 --2- 172.21.15.114:0/896444737 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f47d4156aa0 0x7f47d4159df0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009870 tx=0x7f47c402ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cc00fedb7acdaf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.129+0000 7f064bfff640 1 -- 172.21.15.114:0/111910819 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f064404f9f0 msgr2=0x7f064404aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.129+0000 7f064bfff640 1 --2- 172.21.15.114:0/111910819 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f064404f9f0 0x7f064404aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.129+0000 7f064bfff640 1 -- 172.21.15.114:0/111910819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06440e7a60 msgr2=0x7f0644034c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.129+0000 7f064bfff640 1 --2- 172.21.15.114:0/111910819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06440e7a60 0x7f0644034c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.129+0000 7f064bfff640 1 -- 172.21.15.114:0/111910819 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06380094d0 con 0x7f0644007b90 2023-11-04T01:36:52.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.129+0000 7f064b7fe640 1 --2- 172.21.15.114:0/111910819 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f064404f9f0 0x7f064404aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:52.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.129+0000 7f064bfff640 1 --2- 172.21.15.114:0/111910819 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0644007b90 0x7f064404dfc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f063802b970 tx=0x7f06380046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.130+0000 7f0648ff9640 1 -- 172.21.15.114:0/111910819 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638031890 con 0x7f0644007b90 2023-11-04T01:36:52.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.130+0000 7f0648ff9640 1 -- 172.21.15.114:0/111910819 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06380305f0 con 0x7f0644007b90 2023-11-04T01:36:52.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.130+0000 7f0648ff9640 1 -- 172.21.15.114:0/111910819 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638030980 con 0x7f0644007b90 2023-11-04T01:36:52.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.130+0000 7f065282b640 1 -- 172.21.15.114:0/111910819 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064404d200 con 0x7f0644007b90 2023-11-04T01:36:52.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.130+0000 7f065282b640 1 -- 172.21.15.114:0/111910819 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064404d7c0 con 0x7f0644007b90 2023-11-04T01:36:52.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.131+0000 7f065282b640 1 -- 172.21.15.114:0/111910819 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0644009040 con 0x7f0644007b90 2023-11-04T01:36:52.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.132+0000 7f0648ff9640 1 -- 172.21.15.114:0/111910819 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0638030ae0 con 0x7f0644007b90 2023-11-04T01:36:52.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.133+0000 7f4884ff9640 1 -- 172.21.15.114:0/2969006084 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f48880cf1f0 con 0x7f48800cdf30 2023-11-04T01:36:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.133+0000 7f47d88d8640 1 -- 172.21.15.114:0/896444737 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c402da60 con 0x7f47d4156aa0 2023-11-04T01:36:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.133+0000 7f47d88d8640 1 -- 172.21.15.114:0/896444737 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c402dbc0 con 0x7f47d4156aa0 2023-11-04T01:36:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.133+0000 7f47d88d8640 1 -- 172.21.15.114:0/896444737 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4035440 con 0x7f47d4156aa0 2023-11-04T01:36:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.134+0000 7f47dbb3e640 1 -- 172.21.15.114:0/896444737 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f47d4156aa0 msgr2=0x7f47d4159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.134+0000 7f47dbb3e640 1 --2- 172.21.15.114:0/896444737 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f47d4156aa0 0x7f47d4159df0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009870 tx=0x7f47c402ccb0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.134+0000 7f47dbb3e640 1 -- 172.21.15.114:0/896444737 shutdown_connections 2023-11-04T01:36:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.134+0000 7f47dbb3e640 1 --2- 172.21.15.114:0/896444737 >> v2:172.21.15.114:3300/0 conn(0x7f47d40cc9e0 0x7f47d40709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.134+0000 7f47dbb3e640 1 --2- 172.21.15.114:0/896444737 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f47d4156aa0 0x7f47d4159df0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.134+0000 7f47dbb3e640 1 -- 172.21.15.114:0/896444737 >> 172.21.15.114:0/896444737 conn(0x7f47d40b06f0 msgr2=0x7f47d40b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.132+0000 7f0648ff9640 1 --2- 172.21.15.114:0/111910819 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f063006ae70 0x7f063006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.133+0000 7f0648ff9640 1 -- 172.21.15.114:0/111910819 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f06380ac440 con 0x7f0644007b90 2023-11-04T01:36:52.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.135+0000 7f47dbb3e640 1 -- 172.21.15.114:0/896444737 shutdown_connections 2023-11-04T01:36:52.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.135+0000 7f47dbb3e640 1 -- 172.21.15.114:0/896444737 wait complete. 2023-11-04T01:36:52.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.135+0000 7f064b7fe640 1 --2- 172.21.15.114:0/111910819 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f063006ae70 0x7f063006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.135+0000 7f064b7fe640 1 --2- 172.21.15.114:0/111910819 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f063006ae70 0x7f063006d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f06440d3a40 tx=0x7f0640009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.137+0000 7f47dbb3e640 1 Processor -- start 2023-11-04T01:36:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.137+0000 7f47dbb3e640 1 -- start start 2023-11-04T01:36:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.137+0000 7f0648ff9640 1 -- 172.21.15.114:0/111910819 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0638077210 con 0x7f0644007b90 2023-11-04T01:36:52.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.138+0000 7f47dbb3e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47d4070f30 0x7f47d41537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.139+0000 7f47d98da640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47d4070f30 0x7f47d41537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.139+0000 7f47d98da640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47d4070f30 0x7f47d41537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49432/0 (socket says 172.21.15.114:49432) 2023-11-04T01:36:52.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.139+0000 7f47d98da640 1 -- 172.21.15.114:0/3643197905 learned_addr learned my addr 172.21.15.114:0/3643197905 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:52.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.139+0000 7f47dbb3e640 1 --2- 172.21.15.114:0/3643197905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f47d40cc9e0 0x7f47d41526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.139+0000 7f47dbb3e640 1 --2- 172.21.15.114:0/3643197905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f47d4156aa0 0x7f47d414e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.139+0000 7f47dbb3e640 1 -- 172.21.15.114:0/3643197905 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d4152c00 con 0x7f47d4070f30 2023-11-04T01:36:52.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.139+0000 7f47d90d9640 1 --2- 172.21.15.114:0/3643197905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f47d40cc9e0 0x7f47d41526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.139+0000 7f47da0db640 1 --2- 172.21.15.114:0/3643197905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f47d4156aa0 0x7f47d414e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.140+0000 7f47dbb3e640 1 -- 172.21.15.114:0/3643197905 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d414e5d0 con 0x7f47d4156aa0 2023-11-04T01:36:52.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.140+0000 7f47dbb3e640 1 -- 172.21.15.114:0/3643197905 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d4156e80 con 0x7f47d40cc9e0 2023-11-04T01:36:52.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.140+0000 7f47d98da640 1 -- 172.21.15.114:0/3643197905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f47d40cc9e0 msgr2=0x7f47d41526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.140+0000 7f47d98da640 1 --2- 172.21.15.114:0/3643197905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f47d40cc9e0 0x7f47d41526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.140+0000 7f47d98da640 1 -- 172.21.15.114:0/3643197905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f47d4156aa0 msgr2=0x7f47d414e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.140+0000 7f47d98da640 1 --2- 172.21.15.114:0/3643197905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f47d4156aa0 0x7f47d414e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.140+0000 7f47d98da640 1 -- 172.21.15.114:0/3643197905 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c40094d0 con 0x7f47d4070f30 2023-11-04T01:36:52.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.141+0000 7f47d98da640 1 --2- 172.21.15.114:0/3643197905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47d4070f30 0x7f47d41537f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f47c40090b0 tx=0x7f47c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.142+0000 7f47ca7fc640 1 -- 172.21.15.114:0/3643197905 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4040620 con 0x7f47d4070f30 2023-11-04T01:36:52.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.142+0000 7f47ca7fc640 1 -- 172.21.15.114:0/3643197905 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c40407a0 con 0x7f47d4070f30 2023-11-04T01:36:52.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.142+0000 7f47dbb3e640 1 -- 172.21.15.114:0/3643197905 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d4153e80 con 0x7f47d4070f30 2023-11-04T01:36:52.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.145+0000 7f47ca7fc640 1 -- 172.21.15.114:0/3643197905 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4040b50 con 0x7f47d4070f30 2023-11-04T01:36:52.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.145+0000 7f47ca7fc640 1 -- 172.21.15.114:0/3643197905 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47c403c040 con 0x7f47d4070f30 2023-11-04T01:36:52.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.146+0000 7f47dbb3e640 1 -- 172.21.15.114:0/3643197905 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d4157400 con 0x7f47d4070f30 2023-11-04T01:36:52.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.146+0000 7f47ca7fc640 1 --2- 172.21.15.114:0/3643197905 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f47b806af40 0x7f47b806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.147+0000 7f47d90d9640 1 --2- 172.21.15.114:0/3643197905 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f47b806af40 0x7f47b806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.147+0000 7f47ca7fc640 1 -- 172.21.15.114:0/3643197905 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f47c407a7d0 con 0x7f47d4070f30 2023-11-04T01:36:52.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.147+0000 7f47dbb3e640 1 -- 172.21.15.114:0/3643197905 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d404ece0 con 0x7f47d4070f30 2023-11-04T01:36:52.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.148+0000 7f47d90d9640 1 --2- 172.21.15.114:0/3643197905 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f47b806af40 0x7f47b806d400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f47d40b4b50 tx=0x7f47d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.156+0000 7f47ca7fc640 1 -- 172.21.15.114:0/3643197905 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47c40b0060 con 0x7f47d4070f30 2023-11-04T01:36:52.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.162+0000 7f1929fbf640 1 Processor -- start 2023-11-04T01:36:52.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.163+0000 7f1929fbf640 1 -- start start 2023-11-04T01:36:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.164+0000 7f1929fbf640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f191c0dff00 0x7f191c053cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.164+0000 7f1929fbf640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f191c03b9c0 0x7f191c038d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.164+0000 7f1929fbf640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191c0e02e0 con 0x7f191c054200 2023-11-04T01:36:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.164+0000 7f1929fbf640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f191c055320 con 0x7f191c03b9c0 2023-11-04T01:36:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.164+0000 7f1929fbf640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191c0546a0 con 0x7f191c0dff00 2023-11-04T01:36:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.164+0000 7f1923fff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f191c03b9c0 0x7f191c038d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.165+0000 7f1923fff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f191c03b9c0 0x7f191c038d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35262/0 (socket says 172.21.15.114:35262) 2023-11-04T01:36:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.165+0000 7f1923fff640 1 -- 172.21.15.114:0/2523701744 learned_addr learned my addr 172.21.15.114:0/2523701744 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:52.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.165+0000 7f1923fff640 1 -- 172.21.15.114:0/2523701744 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f191c0dff00 msgr2=0x7f191c053cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:36:52.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.165+0000 7f1923fff640 1 --2- 172.21.15.114:0/2523701744 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f191c0dff00 0x7f191c053cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.165+0000 7f1923fff640 1 -- 172.21.15.114:0/2523701744 >> v1:172.21.15.114:6789/0 conn(0x7f191c054200 legacy=0x7f191c039280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:36:52.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.166+0000 7f1923fff640 1 -- 172.21.15.114:0/2523701744 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c054980 con 0x7f191c03b9c0 2023-11-04T01:36:52.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.167+0000 7f1923fff640 1 --2- 172.21.15.114:0/2523701744 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f191c03b9c0 0x7f191c038d40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1918009870 tx=0x7f191802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae8d4a93c203c95f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.167+0000 7fd89f175640 1 Processor -- start 2023-11-04T01:36:52.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.167+0000 7f19237fe640 1 -- 172.21.15.114:0/2523701744 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918030860 con 0x7f191c03b9c0 2023-11-04T01:36:52.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.168+0000 7f19237fe640 1 -- 172.21.15.114:0/2523701744 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19180309c0 con 0x7f191c03b9c0 2023-11-04T01:36:52.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.169+0000 7f1929fbf640 1 -- 172.21.15.114:0/2523701744 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f191c03b9c0 msgr2=0x7f191c038d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.169+0000 7f1929fbf640 1 --2- 172.21.15.114:0/2523701744 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f191c03b9c0 0x7f191c038d40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1918009870 tx=0x7f191802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.167+0000 7fd89f175640 1 -- start start 2023-11-04T01:36:52.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.169+0000 7fd89f175640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd89806ac10 0x7fd8980c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.169+0000 7fd89f175640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd89815c900 0x7fd89815cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.169+0000 7fd89f175640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd8980ce6c0 0x7fd8980ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.169+0000 7fd89f175640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8980cf090 con 0x7fd89806ac10 2023-11-04T01:36:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.169+0000 7fd89f175640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8980c90b0 con 0x7fd8980ce6c0 2023-11-04T01:36:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.169+0000 7fd89f175640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8980ca000 con 0x7fd89815c900 2023-11-04T01:36:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.169+0000 7fd89e974640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd8980ce6c0 0x7fd8980ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.169+0000 7fd89e974640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd8980ce6c0 0x7fd8980ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35268/0 (socket says 172.21.15.114:35268) 2023-11-04T01:36:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.169+0000 7fd89e974640 1 -- 172.21.15.114:0/3886750805 learned_addr learned my addr 172.21.15.114:0/3886750805 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.169+0000 7fd89e173640 1 --2- 172.21.15.114:0/3886750805 >> v2:172.21.15.114:3300/0 conn(0x7fd89806ac10 0x7fd8980c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.169+0000 7fd89d972640 1 --2- 172.21.15.114:0/3886750805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd89815c900 0x7fd89815cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.170+0000 7fd89e974640 1 -- 172.21.15.114:0/3886750805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd89815c900 msgr2=0x7fd89815cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.170+0000 7fd89e974640 1 --2- 172.21.15.114:0/3886750805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd89815c900 0x7fd89815cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.170+0000 7fd89e974640 1 -- 172.21.15.114:0/3886750805 >> v2:172.21.15.114:3300/0 conn(0x7fd89806ac10 msgr2=0x7fd8980c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.170+0000 7fd89e974640 1 --2- 172.21.15.114:0/3886750805 >> v2:172.21.15.114:3300/0 conn(0x7fd89806ac10 0x7fd8980c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.170+0000 7fd89e974640 1 -- 172.21.15.114:0/3886750805 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89815d3c0 con 0x7fd8980ce6c0 2023-11-04T01:36:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.170+0000 7fd89e173640 1 --2- 172.21.15.114:0/3886750805 >> v2:172.21.15.114:3300/0 conn(0x7fd89806ac10 0x7fd8980c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.171+0000 7f1929fbf640 1 -- 172.21.15.114:0/2523701744 shutdown_connections 2023-11-04T01:36:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.171+0000 7f1929fbf640 1 --2- 172.21.15.114:0/2523701744 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f191c03b9c0 0x7f191c038d40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.171+0000 7f1929fbf640 1 --2- 172.21.15.114:0/2523701744 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f191c0dff00 0x7f191c053cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.171+0000 7f1929fbf640 1 -- 172.21.15.114:0/2523701744 >> 172.21.15.114:0/2523701744 conn(0x7f191c055c10 msgr2=0x7f191c056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.171+0000 7f1929fbf640 1 -- 172.21.15.114:0/2523701744 shutdown_connections 2023-11-04T01:36:52.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.171+0000 7fd89e974640 1 --2- 172.21.15.114:0/3886750805 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8980ce6c0 0x7fd8980ceb50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8980b43d0 tx=0x7fd89402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50383256f2026b08 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.171+0000 7f1929fbf640 1 -- 172.21.15.114:0/2523701744 wait complete. 2023-11-04T01:36:52.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.172+0000 7fd89d171640 1 -- 172.21.15.114:0/3886750805 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8940317c0 con 0x7fd8980ce6c0 2023-11-04T01:36:52.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.172+0000 7fd89d171640 1 -- 172.21.15.114:0/3886750805 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd894031920 con 0x7fd8980ce6c0 2023-11-04T01:36:52.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.172+0000 7fd89d171640 1 -- 172.21.15.114:0/3886750805 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894031cb0 con 0x7fd8980ce6c0 2023-11-04T01:36:52.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.173+0000 7f1929fbf640 1 Processor -- start 2023-11-04T01:36:52.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.173+0000 7f1929fbf640 1 -- start start 2023-11-04T01:36:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.173+0000 7fd89f175640 1 -- 172.21.15.114:0/3886750805 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8980ce6c0 msgr2=0x7fd8980ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.173+0000 7fd89f175640 1 --2- 172.21.15.114:0/3886750805 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8980ce6c0 0x7fd8980ceb50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8980b43d0 tx=0x7fd89402b860 comp rx=0 tx=0).stop 2023-11-04T01:36:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.173+0000 7fd89f175640 1 -- 172.21.15.114:0/3886750805 shutdown_connections 2023-11-04T01:36:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.173+0000 7fd89f175640 1 --2- 172.21.15.114:0/3886750805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd89815c900 0x7fd89815cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.173+0000 7fd89f175640 1 --2- 172.21.15.114:0/3886750805 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8980ce6c0 0x7fd8980ceb50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.173+0000 7fd89f175640 1 --2- 172.21.15.114:0/3886750805 >> v2:172.21.15.114:3300/0 conn(0x7fd89806ac10 0x7fd8980c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.173+0000 7fd89f175640 1 -- 172.21.15.114:0/3886750805 >> 172.21.15.114:0/3886750805 conn(0x7fd89806a120 msgr2=0x7fd89806a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.173+0000 7fd89f175640 1 -- 172.21.15.114:0/3886750805 shutdown_connections 2023-11-04T01:36:52.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.175+0000 7f1929fbf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f191c054200 0x7f191c04f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.175+0000 7f1929fbf640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f191c0dff00 0x7f191c0d8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.175+0000 7f1929fbf640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f191c0d9430 0x7f191c0c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.175+0000 7f1929fbf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c0d98e0 con 0x7f191c054200 2023-11-04T01:36:52.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.175+0000 7f1929fbf640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c04f6f0 con 0x7f191c0d9430 2023-11-04T01:36:52.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.175+0000 7f1929fbf640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191c178b90 con 0x7f191c0dff00 2023-11-04T01:36:52.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.175+0000 7f19297be640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f191c0d9430 0x7f191c0c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.175+0000 7f19297be640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f191c0d9430 0x7f191c0c4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35276/0 (socket says 172.21.15.114:35276) 2023-11-04T01:36:52.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.173+0000 7fd89f175640 1 -- 172.21.15.114:0/3886750805 wait complete. 2023-11-04T01:36:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.175+0000 7fd89f175640 1 Processor -- start 2023-11-04T01:36:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.175+0000 7f19297be640 1 -- 172.21.15.114:0/1598612997 learned_addr learned my addr 172.21.15.114:0/1598612997 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.176+0000 7fd89f175640 1 -- start start 2023-11-04T01:36:52.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.176+0000 7f1928fbd640 1 --2- 172.21.15.114:0/1598612997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f191c054200 0x7f191c04f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.176+0000 7f19297be640 1 -- 172.21.15.114:0/1598612997 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f191c0dff00 msgr2=0x7f191c0d8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.176+0000 7f19297be640 1 --2- 172.21.15.114:0/1598612997 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f191c0dff00 0x7f191c0d8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.176+0000 7f19297be640 1 -- 172.21.15.114:0/1598612997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f191c054200 msgr2=0x7f191c04f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.176+0000 7f19297be640 1 --2- 172.21.15.114:0/1598612997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f191c054200 0x7f191c04f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.176+0000 7f19297be640 1 -- 172.21.15.114:0/1598612997 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19180094d0 con 0x7f191c0d9430 2023-11-04T01:36:52.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.176+0000 7f1928fbd640 1 --2- 172.21.15.114:0/1598612997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f191c054200 0x7f191c04f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:52.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.176+0000 7f19297be640 1 --2- 172.21.15.114:0/1598612997 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f191c0d9430 0x7f191c0c4f50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1924069c50 tx=0x7f1924072860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.177+0000 7f19217fa640 1 -- 172.21.15.114:0/1598612997 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924073050 con 0x7f191c0d9430 2023-11-04T01:36:52.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.177+0000 7f1929fbf640 1 -- 172.21.15.114:0/1598612997 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191c04e110 con 0x7f191c0d9430 2023-11-04T01:36:52.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.177+0000 7fd89f175640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd89806ac10 0x7fd8982004c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.177+0000 7fd89f175640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8980ce6c0 0x7fd89816ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.177+0000 7f1929fbf640 1 -- 172.21.15.114:0/1598612997 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191c04e6d0 con 0x7f191c0d9430 2023-11-04T01:36:52.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.177+0000 7fd89f175640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd89815c900 0x7fd8980c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.177+0000 7fd89d972640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8980ce6c0 0x7fd89816ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.177+0000 7fd89d972640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8980ce6c0 0x7fd89816ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35280/0 (socket says 172.21.15.114:35280) 2023-11-04T01:36:52.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.178+0000 7fd89d972640 1 -- 172.21.15.114:0/2607355704 learned_addr learned my addr 172.21.15.114:0/2607355704 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:52.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.178+0000 7fd89f175640 1 -- 172.21.15.114:0/2607355704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8980c6840 con 0x7fd89815c900 2023-11-04T01:36:52.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.178+0000 7fd89e974640 1 --2- 172.21.15.114:0/2607355704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd89815c900 0x7fd8980c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.178+0000 7fd89f175640 1 -- 172.21.15.114:0/2607355704 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8980c6b20 con 0x7fd8980ce6c0 2023-11-04T01:36:52.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.178+0000 7fd89f175640 1 -- 172.21.15.114:0/2607355704 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8980c21a0 con 0x7fd89806ac10 2023-11-04T01:36:52.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.178+0000 7fd89d972640 1 -- 172.21.15.114:0/2607355704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd89806ac10 msgr2=0x7fd8982004c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.178+0000 7fd89e173640 1 --2- 172.21.15.114:0/2607355704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd89806ac10 0x7fd8982004c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.179+0000 7fd89d972640 1 --2- 172.21.15.114:0/2607355704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd89806ac10 0x7fd8982004c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.179+0000 7fd89d972640 1 -- 172.21.15.114:0/2607355704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd89815c900 msgr2=0x7fd8980c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.179+0000 7fd89d972640 1 --2- 172.21.15.114:0/2607355704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd89815c900 0x7fd8980c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.179+0000 7fd89d972640 1 -- 172.21.15.114:0/2607355704 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd888009400 con 0x7fd8980ce6c0 2023-11-04T01:36:52.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.179+0000 7fd89d972640 1 --2- 172.21.15.114:0/2607355704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8980ce6c0 0x7fd89816ad50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd89000efc0 tx=0x7fd89000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.179+0000 7f19217fa640 1 -- 172.21.15.114:0/1598612997 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19240731d0 con 0x7f191c0d9430 2023-11-04T01:36:52.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.179+0000 7fd89e974640 1 --2- 172.21.15.114:0/2607355704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd89815c900 0x7fd8980c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:52.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.179+0000 7fd89e173640 1 --2- 172.21.15.114:0/2607355704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd89806ac10 0x7fd8982004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:52.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.179+0000 7fd88effd640 1 -- 172.21.15.114:0/2607355704 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd890014480 con 0x7fd8980ce6c0 2023-11-04T01:36:52.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.180+0000 7fd88effd640 1 -- 172.21.15.114:0/2607355704 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89000f040 con 0x7fd8980ce6c0 2023-11-04T01:36:52.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.180+0000 7fd89f175640 1 -- 172.21.15.114:0/2607355704 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8940094d0 con 0x7fd8980ce6c0 2023-11-04T01:36:52.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.180+0000 7fd89f175640 1 -- 172.21.15.114:0/2607355704 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8980c6e00 con 0x7fd8980ce6c0 2023-11-04T01:36:52.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.180+0000 7fd88effd640 1 -- 172.21.15.114:0/2607355704 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd890014800 con 0x7fd8980ce6c0 2023-11-04T01:36:52.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.181+0000 7f19217fa640 1 -- 172.21.15.114:0/1598612997 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924070670 con 0x7f191c0d9430 2023-11-04T01:36:52.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.181+0000 7f19217fa640 1 -- 172.21.15.114:0/1598612997 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1924070890 con 0x7f191c0d9430 2023-11-04T01:36:52.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.182+0000 7f19217fa640 1 --2- 172.21.15.114:0/1598612997 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f190806afc0 0x7f190806d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.182+0000 7fd89f175640 1 -- 172.21.15.114:0/2607355704 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd880005250 con 0x7fd8980ce6c0 2023-11-04T01:36:52.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.182+0000 7f19217fa640 1 -- 172.21.15.114:0/1598612997 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1924103ec0 con 0x7f191c0d9430 2023-11-04T01:36:52.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.183+0000 7f190effd640 1 -- 172.21.15.114:0/1598612997 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1904005250 con 0x7f191c0d9430 2023-11-04T01:36:52.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.183+0000 7f1928fbd640 1 --2- 172.21.15.114:0/1598612997 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f190806afc0 0x7f190806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.184+0000 7f1928fbd640 1 --2- 172.21.15.114:0/1598612997 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f190806afc0 0x7f190806d480 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f191000a810 tx=0x7f1910008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.184+0000 7fd88effd640 1 -- 172.21.15.114:0/2607355704 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd890014960 con 0x7fd8980ce6c0 2023-11-04T01:36:52.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.185+0000 7fd88effd640 1 --2- 172.21.15.114:0/2607355704 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd87c06af40 0x7fd87c06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.185+0000 7fd88effd640 1 -- 172.21.15.114:0/2607355704 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd89008a8d0 con 0x7fd8980ce6c0 2023-11-04T01:36:52.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.185+0000 7fd89e173640 1 --2- 172.21.15.114:0/2607355704 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd87c06af40 0x7fd87c06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.186+0000 7fd89e173640 1 --2- 172.21.15.114:0/2607355704 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd87c06af40 0x7fd87c06d400 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd888009b30 tx=0x7fd888008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.188+0000 7fd88effd640 1 -- 172.21.15.114:0/2607355704 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd890055670 con 0x7fd8980ce6c0 2023-11-04T01:36:52.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.193+0000 7f19217fa640 1 -- 172.21.15.114:0/1598612997 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f192408e020 con 0x7f191c0d9430 2023-11-04T01:36:52.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.219+0000 7fab7f59e640 1 Processor -- start 2023-11-04T01:36:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.219+0000 7fab7f59e640 1 -- start start 2023-11-04T01:36:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.220+0000 7fab7f59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fab780ebb20 0x7fab780542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.220+0000 7fab7f59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab78055c90 con 0x7fab780e76d0 2023-11-04T01:36:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.220+0000 7fab7f59e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab780517b0 con 0x7fab780ec040 2023-11-04T01:36:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.220+0000 7fab7f59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab780556d0 con 0x7fab780ebb20 2023-11-04T01:36:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.220+0000 7fab7ed9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fab780ebb20 0x7fab780542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.221+0000 7fab7ed9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fab780ebb20 0x7fab780542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49474/0 (socket says 172.21.15.114:49474) 2023-11-04T01:36:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.221+0000 7fab7ed9d640 1 -- 172.21.15.114:0/225669729 learned_addr learned my addr 172.21.15.114:0/225669729 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.221+0000 7fab7ed9d640 1 -- 172.21.15.114:0/225669729 >> v1:172.21.15.141:6789/0 conn(0x7fab780ec040 legacy=0x7fab78052250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.221+0000 7fab7ed9d640 1 -- 172.21.15.114:0/225669729 >> v1:172.21.15.114:6789/0 conn(0x7fab780e76d0 legacy=0x7fab780eb410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:36:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.221+0000 7fab7ed9d640 1 -- 172.21.15.114:0/225669729 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab780559b0 con 0x7fab780ebb20 2023-11-04T01:36:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.222+0000 7fab7ed9d640 1 --2- 172.21.15.114:0/225669729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab780ebb20 0x7fab780542b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fab8002cce0 tx=0x7fab800a6190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81511d3d636afad2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.223+0000 7fab7d59a640 1 -- 172.21.15.114:0/225669729 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab800a6df0 con 0x7fab780ebb20 2023-11-04T01:36:52.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.223+0000 7fab7d59a640 1 -- 172.21.15.114:0/225669729 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab800ae440 con 0x7fab780ebb20 2023-11-04T01:36:52.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.224+0000 7fab7f59e640 1 -- 172.21.15.114:0/225669729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab780ebb20 msgr2=0x7fab780542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.224+0000 7fab7f59e640 1 --2- 172.21.15.114:0/225669729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab780ebb20 0x7fab780542b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fab8002cce0 tx=0x7fab800a6190 comp rx=0 tx=0).stop 2023-11-04T01:36:52.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.224+0000 7fab7f59e640 1 -- 172.21.15.114:0/225669729 shutdown_connections 2023-11-04T01:36:52.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.224+0000 7fab7f59e640 1 --2- 172.21.15.114:0/225669729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab780ebb20 0x7fab780542b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.224+0000 7fab7f59e640 1 -- 172.21.15.114:0/225669729 >> 172.21.15.114:0/225669729 conn(0x7fab78053790 msgr2=0x7fab78053ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.224+0000 7fab7f59e640 1 -- 172.21.15.114:0/225669729 shutdown_connections 2023-11-04T01:36:52.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.224+0000 7fab7f59e640 1 -- 172.21.15.114:0/225669729 wait complete. 2023-11-04T01:36:52.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.226+0000 7fab7f59e640 1 Processor -- start 2023-11-04T01:36:52.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.226+0000 7fab7f59e640 1 -- start start 2023-11-04T01:36:52.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.228+0000 7fab7f59e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab780e76d0 0x7fab780505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.228+0000 7fab7f59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab780ec040 0x7fab78039930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.228+0000 7fab7f59e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab780d3e80 0x7fab7803bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.228+0000 7fab7f59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7803b7c0 con 0x7fab780ec040 2023-11-04T01:36:52.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.228+0000 7fab7f59e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab780e3310 con 0x7fab780e76d0 2023-11-04T01:36:52.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.228+0000 7fab7f59e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab780e35f0 con 0x7fab780d3e80 2023-11-04T01:36:52.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.228+0000 7fab7e59c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab780e76d0 0x7fab780505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.228+0000 7fab7e59c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab780e76d0 0x7fab780505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35288/0 (socket says 172.21.15.114:35288) 2023-11-04T01:36:52.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.228+0000 7fab7e59c640 1 -- 172.21.15.114:0/1673963915 learned_addr learned my addr 172.21.15.114:0/1673963915 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:52.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.228+0000 7fab7dd9b640 1 --2- 172.21.15.114:0/1673963915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab780ec040 0x7fab78039930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.228+0000 7fab7ed9d640 1 --2- 172.21.15.114:0/1673963915 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab780d3e80 0x7fab7803bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.229+0000 7fab7e59c640 1 -- 172.21.15.114:0/1673963915 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab780d3e80 msgr2=0x7fab7803bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.229+0000 7fab7e59c640 1 --2- 172.21.15.114:0/1673963915 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab780d3e80 0x7fab7803bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.229+0000 7fab7e59c640 1 -- 172.21.15.114:0/1673963915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab780ec040 msgr2=0x7fab78039930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.229+0000 7fab7e59c640 1 --2- 172.21.15.114:0/1673963915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab780ec040 0x7fab78039930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.229+0000 7fab7e59c640 1 -- 172.21.15.114:0/1673963915 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8004ea00 con 0x7fab780e76d0 2023-11-04T01:36:52.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.229+0000 7fab7dd9b640 1 --2- 172.21.15.114:0/1673963915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab780ec040 0x7fab78039930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:52.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.230+0000 7fab7e59c640 1 --2- 172.21.15.114:0/1673963915 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab780e76d0 0x7fab780505f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fab7400c3b0 tx=0x7fab7400c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.234+0000 7fab6effd640 1 -- 172.21.15.114:0/1673963915 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74016070 con 0x7fab780e76d0 2023-11-04T01:36:52.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.234+0000 7fab6effd640 1 -- 172.21.15.114:0/1673963915 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab74007020 con 0x7fab780e76d0 2023-11-04T01:36:52.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.234+0000 7fab6effd640 1 -- 172.21.15.114:0/1673963915 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74007410 con 0x7fab780e76d0 2023-11-04T01:36:52.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.234+0000 7fab7f59e640 1 -- 172.21.15.114:0/1673963915 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab780e38d0 con 0x7fab780e76d0 2023-11-04T01:36:52.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.234+0000 7fab7f59e640 1 -- 172.21.15.114:0/1673963915 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7803c120 con 0x7fab780e76d0 2023-11-04T01:36:52.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.236+0000 7fab7f59e640 1 -- 172.21.15.114:0/1673963915 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab78051a10 con 0x7fab780e76d0 2023-11-04T01:36:52.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.237+0000 7fab6effd640 1 -- 172.21.15.114:0/1673963915 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab74007570 con 0x7fab780e76d0 2023-11-04T01:36:52.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.238+0000 7fab6effd640 1 --2- 172.21.15.114:0/1673963915 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab6006af40 0x7fab6006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:52.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.238+0000 7fab6effd640 1 -- 172.21.15.114:0/1673963915 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab740890d0 con 0x7fab780e76d0 2023-11-04T01:36:52.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.238+0000 7fab7dd9b640 1 --2- 172.21.15.114:0/1673963915 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab6006af40 0x7fab6006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:52.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.239+0000 7fab7dd9b640 1 --2- 172.21.15.114:0/1673963915 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab6006af40 0x7fab6006d400 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab780c9e10 tx=0x7fab70006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:52.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.241+0000 7fab6effd640 1 -- 172.21.15.114:0/1673963915 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fab74053fb0 con 0x7fab780e76d0 2023-11-04T01:36:52.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.463+0000 7f5bb1f7c640 1 -- 172.21.15.114:0/2437706285 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5b8c0057d0 con 0x7f5bac15add0 2023-11-04T01:36:52.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.463+0000 7f5b93fff640 1 -- 172.21.15.114:0/2437706285 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ba0017020 con 0x7f5bac15add0 2023-11-04T01:36:52.465 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2023-11-04T01:36:52.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.466+0000 7f5b91ffb640 1 -- 172.21.15.114:0/2437706285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5b9806ae70 msgr2=0x7f5b9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.467+0000 7f5b91ffb640 1 --2- 172.21.15.114:0/2437706285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5b9806ae70 0x7f5b9806d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c006fd0 tx=0x7f5b9c008040 comp rx=0 tx=0).stop 2023-11-04T01:36:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.467+0000 7f5b91ffb640 1 -- 172.21.15.114:0/2437706285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5bac15add0 msgr2=0x7f5bac0b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.467+0000 7f5b91ffb640 1 --2- 172.21.15.114:0/2437706285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5bac15add0 0x7f5bac0b3800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000c3f0 tx=0x7f5ba000c8b0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.467+0000 7f5b91ffb640 1 -- 172.21.15.114:0/2437706285 shutdown_connections 2023-11-04T01:36:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.467+0000 7f5b91ffb640 1 --2- 172.21.15.114:0/2437706285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5b9806ae70 0x7f5b9806d330 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.467+0000 7f5b91ffb640 1 --2- 172.21.15.114:0/2437706285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5bac15add0 0x7f5bac0b3800 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.467+0000 7f5b91ffb640 1 --2- 172.21.15.114:0/2437706285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5bac072370 0x7f5bac14e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.467+0000 7f5b91ffb640 1 --2- 172.21.15.114:0/2437706285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bac071f90 0x7f5bac14ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.467+0000 7f5b91ffb640 1 -- 172.21.15.114:0/2437706285 >> 172.21.15.114:0/2437706285 conn(0x7f5bac06d800 msgr2=0x7f5bac15d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.468+0000 7f5b91ffb640 1 -- 172.21.15.114:0/2437706285 shutdown_connections 2023-11-04T01:36:52.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.468+0000 7f5b91ffb640 1 -- 172.21.15.114:0/2437706285 wait complete. 2023-11-04T01:36:52.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2023-11-04T01:36:52.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.500+0000 7f48727fc640 1 -- 172.21.15.114:0/2969006084 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f48800d0b60 con 0x7f48800cdf30 2023-11-04T01:36:52.503 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2023-11-04T01:36:52.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.500+0000 7f4884ff9640 1 -- 172.21.15.114:0/2969006084 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48800d0b60 con 0x7f48800cdf30 2023-11-04T01:36:52.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.503+0000 7f48727fc640 1 -- 172.21.15.114:0/2969006084 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f486c06aef0 msgr2=0x7f486c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.503+0000 7f48727fc640 1 --2- 172.21.15.114:0/2969006084 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f486c06aef0 0x7f486c06d3b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4874036000 tx=0x7f4874008030 comp rx=0 tx=0).stop 2023-11-04T01:36:52.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.503+0000 7f48727fc640 1 -- 172.21.15.114:0/2969006084 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48800cdf30 msgr2=0x7f48800451b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.503+0000 7f48727fc640 1 --2- 172.21.15.114:0/2969006084 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48800cdf30 0x7f48800451b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4888063cf0 tx=0x7f4888067460 comp rx=0 tx=0).stop 2023-11-04T01:36:52.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.503+0000 7f48727fc640 1 -- 172.21.15.114:0/2969006084 shutdown_connections 2023-11-04T01:36:52.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.503+0000 7f48727fc640 1 --2- 172.21.15.114:0/2969006084 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48800cdf30 0x7f48800451b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.503+0000 7f48727fc640 1 --2- 172.21.15.114:0/2969006084 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f486c06aef0 0x7f486c06d3b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.503+0000 7f48727fc640 1 --2- 172.21.15.114:0/2969006084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48800e7800 0x7f48800cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.503+0000 7f48727fc640 1 --2- 172.21.15.114:0/2969006084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48800062c0 0x7f488004f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.503+0000 7f48727fc640 1 -- 172.21.15.114:0/2969006084 >> 172.21.15.114:0/2969006084 conn(0x7f4880055390 msgr2=0x7f48800503f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.503+0000 7f48727fc640 1 -- 172.21.15.114:0/2969006084 shutdown_connections 2023-11-04T01:36:52.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.503+0000 7f48727fc640 1 -- 172.21.15.114:0/2969006084 wait complete. 2023-11-04T01:36:52.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.506+0000 7f065282b640 1 -- 172.21.15.114:0/111910819 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0644005970 con 0x7f0644007b90 2023-11-04T01:36:52.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.507+0000 7f0648ff9640 1 -- 172.21.15.114:0/111910819 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f063807a830 con 0x7f0644007b90 2023-11-04T01:36:52.509 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2023-11-04T01:36:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.511+0000 7f065282b640 1 -- 172.21.15.114:0/111910819 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f063006ae70 msgr2=0x7f063006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.511+0000 7f065282b640 1 --2- 172.21.15.114:0/111910819 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f063006ae70 0x7f063006d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f06440d3a40 tx=0x7f0640009040 comp rx=0 tx=0).stop 2023-11-04T01:36:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.511+0000 7f065282b640 1 -- 172.21.15.114:0/111910819 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0644007b90 msgr2=0x7f064404dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.511+0000 7f065282b640 1 --2- 172.21.15.114:0/111910819 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0644007b90 0x7f064404dfc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f063802b970 tx=0x7f06380046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.511+0000 7f065282b640 1 -- 172.21.15.114:0/111910819 shutdown_connections 2023-11-04T01:36:52.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.511+0000 7f065282b640 1 --2- 172.21.15.114:0/111910819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06440e7a60 0x7f0644034c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.511+0000 7f065282b640 1 --2- 172.21.15.114:0/111910819 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f064404f9f0 0x7f064404aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.511+0000 7f065282b640 1 --2- 172.21.15.114:0/111910819 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f063006ae70 0x7f063006d330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.511+0000 7f065282b640 1 --2- 172.21.15.114:0/111910819 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0644007b90 0x7f064404dfc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.511+0000 7f065282b640 1 -- 172.21.15.114:0/111910819 >> 172.21.15.114:0/111910819 conn(0x7f0644055130 msgr2=0x7f06440da1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.512+0000 7f065282b640 1 -- 172.21.15.114:0/111910819 shutdown_connections 2023-11-04T01:36:52.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.512+0000 7f065282b640 1 -- 172.21.15.114:0/111910819 wait complete. 2023-11-04T01:36:52.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2023-11-04T01:36:52.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2023-11-04T01:36:52.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.535+0000 7fa532e4b640 1 -- 172.21.15.114:0/966538478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa50c005500 con 0x7fa52c158c80 2023-11-04T01:36:52.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.536+0000 7fa5297fa640 1 -- 172.21.15.114:0/966538478 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa51c018020 con 0x7fa52c158c80 2023-11-04T01:36:52.538 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-11-04T01:36:52.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.537+0000 7fa532e4b640 1 -- 172.21.15.114:0/966538478 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa51806af40 msgr2=0x7fa51806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.537+0000 7fa532e4b640 1 --2- 172.21.15.114:0/966538478 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa51806af40 0x7fa51806d400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa520005020 tx=0x7fa520007ef0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.538+0000 7fa532e4b640 1 -- 172.21.15.114:0/966538478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa52c158c80 msgr2=0x7fa52c0c5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.538+0000 7fa532e4b640 1 --2- 172.21.15.114:0/966538478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa52c158c80 0x7fa52c0c5a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00c750 tx=0x7fa51c00cc10 comp rx=0 tx=0).stop 2023-11-04T01:36:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.538+0000 7fa532e4b640 1 -- 172.21.15.114:0/966538478 shutdown_connections 2023-11-04T01:36:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.538+0000 7fa532e4b640 1 --2- 172.21.15.114:0/966538478 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa52c159060 0x7fa52c1572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.538+0000 7fa532e4b640 1 --2- 172.21.15.114:0/966538478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa52c158c80 0x7fa52c0c5a20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.538+0000 7fa532e4b640 1 --2- 172.21.15.114:0/966538478 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa51806af40 0x7fa51806d400 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.538+0000 7fa532e4b640 1 --2- 172.21.15.114:0/966538478 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa52c0ce4c0 0x7fa52c14b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.538+0000 7fa532e4b640 1 -- 172.21.15.114:0/966538478 >> 172.21.15.114:0/966538478 conn(0x7fa52c06a120 msgr2=0x7fa52c15d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.538+0000 7fa532e4b640 1 -- 172.21.15.114:0/966538478 shutdown_connections 2023-11-04T01:36:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.538+0000 7fa532e4b640 1 -- 172.21.15.114:0/966538478 wait complete. 2023-11-04T01:36:52.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.542+0000 7f47dbb3e640 1 -- 172.21.15.114:0/3643197905 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f47d40cb230 con 0x7f47d4070f30 2023-11-04T01:36:52.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.543+0000 7f47ca7fc640 1 -- 172.21.15.114:0/3643197905 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f47c403a090 con 0x7f47d4070f30 2023-11-04T01:36:52.544 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2023-11-04T01:36:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.546+0000 7f47dbb3e640 1 -- 172.21.15.114:0/3643197905 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f47b806af40 msgr2=0x7f47b806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.546+0000 7f47dbb3e640 1 --2- 172.21.15.114:0/3643197905 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f47b806af40 0x7f47b806d400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f47d40b4b50 tx=0x7f47d0008040 comp rx=0 tx=0).stop 2023-11-04T01:36:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.546+0000 7f47dbb3e640 1 -- 172.21.15.114:0/3643197905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47d4070f30 msgr2=0x7f47d41537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.546+0000 7f47dbb3e640 1 --2- 172.21.15.114:0/3643197905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47d4070f30 0x7f47d41537f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f47c40090b0 tx=0x7f47c40046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.546+0000 7f47dbb3e640 1 -- 172.21.15.114:0/3643197905 shutdown_connections 2023-11-04T01:36:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.546+0000 7f47dbb3e640 1 --2- 172.21.15.114:0/3643197905 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f47b806af40 0x7f47b806d400 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.546+0000 7f47dbb3e640 1 --2- 172.21.15.114:0/3643197905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f47d4156aa0 0x7f47d414e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.546+0000 7f47dbb3e640 1 --2- 172.21.15.114:0/3643197905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f47d40cc9e0 0x7f47d41526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.546+0000 7f47dbb3e640 1 --2- 172.21.15.114:0/3643197905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47d4070f30 0x7f47d41537f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.546+0000 7f47dbb3e640 1 -- 172.21.15.114:0/3643197905 >> 172.21.15.114:0/3643197905 conn(0x7f47d40b06f0 msgr2=0x7f47d406cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.546+0000 7f47dbb3e640 1 -- 172.21.15.114:0/3643197905 shutdown_connections 2023-11-04T01:36:52.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.546+0000 7f47dbb3e640 1 -- 172.21.15.114:0/3643197905 wait complete. 2023-11-04T01:36:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.548+0000 7fd89f175640 1 -- 172.21.15.114:0/2607355704 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd8800057d0 con 0x7fd8980ce6c0 2023-11-04T01:36:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.548+0000 7fd88effd640 1 -- 172.21.15.114:0/2607355704 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd890018020 con 0x7fd8980ce6c0 2023-11-04T01:36:52.551 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-11-04T01:36:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.551+0000 7fd89f175640 1 -- 172.21.15.114:0/2607355704 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd87c06af40 msgr2=0x7fd87c06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.551+0000 7fd89f175640 1 --2- 172.21.15.114:0/2607355704 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd87c06af40 0x7fd87c06d400 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd888009b30 tx=0x7fd888008040 comp rx=0 tx=0).stop 2023-11-04T01:36:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.551+0000 7fd89f175640 1 -- 172.21.15.114:0/2607355704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8980ce6c0 msgr2=0x7fd89816ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.551+0000 7fd89f175640 1 --2- 172.21.15.114:0/2607355704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8980ce6c0 0x7fd89816ad50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd89000efc0 tx=0x7fd89000c490 comp rx=0 tx=0).stop 2023-11-04T01:36:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.551+0000 7fd89f175640 1 -- 172.21.15.114:0/2607355704 shutdown_connections 2023-11-04T01:36:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.551+0000 7fd89f175640 1 --2- 172.21.15.114:0/2607355704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd89815c900 0x7fd8980c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.551+0000 7fd89f175640 1 --2- 172.21.15.114:0/2607355704 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd87c06af40 0x7fd87c06d400 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.551+0000 7fd89f175640 1 --2- 172.21.15.114:0/2607355704 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8980ce6c0 0x7fd89816ad50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.551+0000 7fd89f175640 1 --2- 172.21.15.114:0/2607355704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd89806ac10 0x7fd8982004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.551+0000 7fd89f175640 1 -- 172.21.15.114:0/2607355704 >> 172.21.15.114:0/2607355704 conn(0x7fd89806a120 msgr2=0x7fd8980b02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.551+0000 7fd89f175640 1 -- 172.21.15.114:0/2607355704 shutdown_connections 2023-11-04T01:36:52.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.551+0000 7fd89f175640 1 -- 172.21.15.114:0/2607355704 wait complete. 2023-11-04T01:36:52.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2023-11-04T01:36:52.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2023-11-04T01:36:52.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2023-11-04T01:36:52.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.587+0000 7f190effd640 1 -- 172.21.15.114:0/1598612997 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1904005500 con 0x7f191c0d9430 2023-11-04T01:36:52.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.588+0000 7f19217fa640 1 -- 172.21.15.114:0/1598612997 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f19240cecf0 con 0x7f191c0d9430 2023-11-04T01:36:52.590 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2023-11-04T01:36:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.590+0000 7f190effd640 1 -- 172.21.15.114:0/1598612997 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f190806afc0 msgr2=0x7f190806d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.590+0000 7f190effd640 1 --2- 172.21.15.114:0/1598612997 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f190806afc0 0x7f190806d480 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f191000a810 tx=0x7f1910008040 comp rx=0 tx=0).stop 2023-11-04T01:36:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.590+0000 7f190effd640 1 -- 172.21.15.114:0/1598612997 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f191c0d9430 msgr2=0x7f191c0c4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.590+0000 7f190effd640 1 --2- 172.21.15.114:0/1598612997 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f191c0d9430 0x7f191c0c4f50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1924069c50 tx=0x7f1924072860 comp rx=0 tx=0).stop 2023-11-04T01:36:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.590+0000 7f190effd640 1 -- 172.21.15.114:0/1598612997 shutdown_connections 2023-11-04T01:36:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.590+0000 7f190effd640 1 --2- 172.21.15.114:0/1598612997 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f190806afc0 0x7f190806d480 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.590+0000 7f190effd640 1 --2- 172.21.15.114:0/1598612997 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f191c0d9430 0x7f191c0c4f50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.590+0000 7f190effd640 1 --2- 172.21.15.114:0/1598612997 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f191c0dff00 0x7f191c0d8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.590+0000 7f190effd640 1 --2- 172.21.15.114:0/1598612997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f191c054200 0x7f191c04f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.590+0000 7f190effd640 1 -- 172.21.15.114:0/1598612997 >> 172.21.15.114:0/1598612997 conn(0x7f191c055c10 msgr2=0x7f191c008b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.590+0000 7f190effd640 1 -- 172.21.15.114:0/1598612997 shutdown_connections 2023-11-04T01:36:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.590+0000 7f190effd640 1 -- 172.21.15.114:0/1598612997 wait complete. 2023-11-04T01:36:52.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2023-11-04T01:36:52.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.608+0000 7fab7f59e640 1 -- 172.21.15.114:0/1673963915 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fab780e3450 con 0x7fab780e76d0 2023-11-04T01:36:52.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.608+0000 7fab6effd640 1 -- 172.21.15.114:0/1673963915 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab780e3450 con 0x7fab780e76d0 2023-11-04T01:36:52.610 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-11-04T01:36:52.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.610+0000 7fab7f59e640 1 -- 172.21.15.114:0/1673963915 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab6006af40 msgr2=0x7fab6006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.610+0000 7fab7f59e640 1 --2- 172.21.15.114:0/1673963915 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab6006af40 0x7fab6006d400 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab780c9e10 tx=0x7fab70006f90 comp rx=0 tx=0).stop 2023-11-04T01:36:52.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.610+0000 7fab7f59e640 1 -- 172.21.15.114:0/1673963915 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab780e76d0 msgr2=0x7fab780505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:52.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.610+0000 7fab7f59e640 1 --2- 172.21.15.114:0/1673963915 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab780e76d0 0x7fab780505f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fab7400c3b0 tx=0x7fab7400c870 comp rx=0 tx=0).stop 2023-11-04T01:36:52.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.610+0000 7fab7f59e640 1 -- 172.21.15.114:0/1673963915 shutdown_connections 2023-11-04T01:36:52.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.610+0000 7fab7f59e640 1 --2- 172.21.15.114:0/1673963915 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab780d3e80 0x7fab7803bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.610+0000 7fab7f59e640 1 --2- 172.21.15.114:0/1673963915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab780ec040 0x7fab78039930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.610+0000 7fab7f59e640 1 --2- 172.21.15.114:0/1673963915 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab6006af40 0x7fab6006d400 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.610+0000 7fab7f59e640 1 --2- 172.21.15.114:0/1673963915 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab780e76d0 0x7fab780505f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:52.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.610+0000 7fab7f59e640 1 -- 172.21.15.114:0/1673963915 >> 172.21.15.114:0/1673963915 conn(0x7fab78053790 msgr2=0x7fab78053b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:52.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.610+0000 7fab7f59e640 1 -- 172.21.15.114:0/1673963915 shutdown_connections 2023-11-04T01:36:52.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:52.610+0000 7fab7f59e640 1 -- 172.21.15.114:0/1673963915 wait complete. 2023-11-04T01:36:52.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2023-11-04T01:36:53.488 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-04T01:36:53.518 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-04T01:36:53.530 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-04T01:36:53.556 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-04T01:36:53.563 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T01:36:53.567 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T01:36:53.604 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T01:36:53.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.619+0000 7efefaf0c640 1 Processor -- start 2023-11-04T01:36:53.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.619+0000 7efefaf0c640 1 -- start start 2023-11-04T01:36:53.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.621+0000 7efefaf0c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efef40c5370 0x7efef40cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.621+0000 7efefaf0c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efef415a1b0 0x7efef40ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.621+0000 7efef3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efef40c5370 0x7efef40cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.621+0000 7efef3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efef40c5370 0x7efef40cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49488/0 (socket says 172.21.15.114:49488) 2023-11-04T01:36:53.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.621+0000 7efef3fff640 1 -- 172.21.15.114:0/3583737811 learned_addr learned my addr 172.21.15.114:0/3583737811 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:53.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.621+0000 7efefaf0c640 1 -- 172.21.15.114:0/3583737811 --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef4070e20 con 0x7efef41534a0 2023-11-04T01:36:53.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.621+0000 7efef94a9640 1 --2- 172.21.15.114:0/3583737811 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efef415a1b0 0x7efef40ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.621+0000 7efefaf0c640 1 -- 172.21.15.114:0/3583737811 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef4159410 con 0x7efef40c5370 2023-11-04T01:36:53.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.621+0000 7efefaf0c640 1 -- 172.21.15.114:0/3583737811 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef4071080 con 0x7efef415a1b0 2023-11-04T01:36:53.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.622+0000 7efef37fe640 1 -- 172.21.15.114:0/3583737811 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020827593 0 0) 0x7efef4070e20 con 0x7efef41534a0 2023-11-04T01:36:53.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.622+0000 7efef37fe640 1 -- 172.21.15.114:0/3583737811 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efee4005730 con 0x7efef41534a0 2023-11-04T01:36:53.624 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-04T01:36:53.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.622+0000 7efef3fff640 1 -- 172.21.15.114:0/3583737811 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efef415a1b0 msgr2=0x7efef40ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.622+0000 7efef3fff640 1 --2- 172.21.15.114:0/3583737811 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efef415a1b0 0x7efef40ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.622+0000 7efef3fff640 1 -- 172.21.15.114:0/3583737811 >> v1:172.21.15.141:6789/0 conn(0x7efef41534a0 legacy=0x7efef4070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.622+0000 7efef3fff640 1 -- 172.21.15.114:0/3583737811 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef41596d0 con 0x7efef40c5370 2023-11-04T01:36:53.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.624+0000 7efef3fff640 1 --2- 172.21.15.114:0/3583737811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40c5370 0x7efef40cdd40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efee0007040 tx=0x7efee002b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861b651148a53f04 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.624+0000 7efef37fe640 1 -- 172.21.15.114:0/3583737811 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee0007ce0 con 0x7efef40c5370 2023-11-04T01:36:53.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.624+0000 7efef37fe640 1 -- 172.21.15.114:0/3583737811 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee0007e40 con 0x7efef40c5370 2023-11-04T01:36:53.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.625+0000 7efef37fe640 1 -- 172.21.15.114:0/3583737811 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee00092d0 con 0x7efef40c5370 2023-11-04T01:36:53.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.626+0000 7efefaf0c640 1 -- 172.21.15.114:0/3583737811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40c5370 msgr2=0x7efef40cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.626+0000 7efefaf0c640 1 --2- 172.21.15.114:0/3583737811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40c5370 0x7efef40cdd40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efee0007040 tx=0x7efee002b930 comp rx=0 tx=0).stop 2023-11-04T01:36:53.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.626+0000 7efefaf0c640 1 -- 172.21.15.114:0/3583737811 shutdown_connections 2023-11-04T01:36:53.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.626+0000 7efefaf0c640 1 --2- 172.21.15.114:0/3583737811 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efef415a1b0 0x7efef40ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.626+0000 7efefaf0c640 1 --2- 172.21.15.114:0/3583737811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40c5370 0x7efef40cdd40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.626+0000 7efefaf0c640 1 -- 172.21.15.114:0/3583737811 >> 172.21.15.114:0/3583737811 conn(0x7efef40ce950 msgr2=0x7efef40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.627+0000 7efefaf0c640 1 -- 172.21.15.114:0/3583737811 shutdown_connections 2023-11-04T01:36:53.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.627+0000 7efefaf0c640 1 -- 172.21.15.114:0/3583737811 wait complete. 2023-11-04T01:36:53.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.629+0000 7efefaf0c640 1 Processor -- start 2023-11-04T01:36:53.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.629+0000 7efefaf0c640 1 -- start start 2023-11-04T01:36:53.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.631+0000 7efefaf0c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40c5370 0x7efef41402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.631+0000 7efef8ca8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40c5370 0x7efef41402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.631+0000 7efef8ca8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40c5370 0x7efef41402e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49504/0 (socket says 172.21.15.114:49504) 2023-11-04T01:36:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.632+0000 7efef8ca8640 1 -- 172.21.15.114:0/3388091221 learned_addr learned my addr 172.21.15.114:0/3388091221 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.632+0000 7efefaf0c640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efef41534a0 0x7efef414b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.632+0000 7efefaf0c640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efef415a1b0 0x7efef40b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.632+0000 7efefaf0c640 1 -- 172.21.15.114:0/3388091221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef40c7930 con 0x7efef40c5370 2023-11-04T01:36:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.632+0000 7efefaf0c640 1 -- 172.21.15.114:0/3388091221 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef40c7020 con 0x7efef41534a0 2023-11-04T01:36:53.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.632+0000 7efef3fff640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efef41534a0 0x7efef414b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.632+0000 7efef94a9640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efef415a1b0 0x7efef40b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.632+0000 7efefaf0c640 1 -- 172.21.15.114:0/3388091221 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef4140820 con 0x7efef415a1b0 2023-11-04T01:36:53.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.633+0000 7efef8ca8640 1 -- 172.21.15.114:0/3388091221 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efef415a1b0 msgr2=0x7efef40b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.633+0000 7efef8ca8640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efef415a1b0 0x7efef40b1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.633+0000 7efef8ca8640 1 -- 172.21.15.114:0/3388091221 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efef41534a0 msgr2=0x7efef414b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.633+0000 7efef8ca8640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efef41534a0 0x7efef414b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.633+0000 7efef8ca8640 1 -- 172.21.15.114:0/3388091221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee000d040 con 0x7efef40c5370 2023-11-04T01:36:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.633+0000 7efef94a9640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efef415a1b0 0x7efef40b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.634+0000 7efef8ca8640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40c5370 0x7efef41402e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efee8001a10 tx=0x7efee800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.635+0000 7efef17fa640 1 -- 172.21.15.114:0/3388091221 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee8010250 con 0x7efef40c5370 2023-11-04T01:36:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.635+0000 7efef17fa640 1 -- 172.21.15.114:0/3388091221 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee80103b0 con 0x7efef40c5370 2023-11-04T01:36:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.635+0000 7efefaf0c640 1 -- 172.21.15.114:0/3388091221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef40b25a0 con 0x7efef40c5370 2023-11-04T01:36:53.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.637+0000 7efefaf0c640 1 -- 172.21.15.114:0/3388091221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef40c7550 con 0x7efef40c5370 2023-11-04T01:36:53.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.639+0000 7efef17fa640 1 -- 172.21.15.114:0/3388091221 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee80052f0 con 0x7efef40c5370 2023-11-04T01:36:53.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.639+0000 7efef17fa640 1 -- 172.21.15.114:0/3388091221 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efee800a890 con 0x7efef40c5370 2023-11-04T01:36:53.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.640+0000 7efef17fa640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efee406b400 0x7efee406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.640+0000 7efef3fff640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efee406b400 0x7efee406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.640+0000 7efef17fa640 1 -- 172.21.15.114:0/3388091221 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efee808ca50 con 0x7efef40c5370 2023-11-04T01:36:53.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.641+0000 7efef3fff640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efee406b400 0x7efee406d8c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efee0035000 tx=0x7efee0009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.642+0000 7efefaf0c640 1 -- 172.21.15.114:0/3388091221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef4074290 con 0x7efef40c5370 2023-11-04T01:36:53.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.651+0000 7efef17fa640 1 -- 172.21.15.114:0/3388091221 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efee80578e0 con 0x7efef40c5370 2023-11-04T01:36:53.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.674+0000 7fc3bb7ce640 1 Processor -- start 2023-11-04T01:36:53.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.674+0000 7fc3bb7ce640 1 -- start start 2023-11-04T01:36:53.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.675+0000 7f9e81cd4640 1 Processor -- start 2023-11-04T01:36:53.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.675+0000 7f9e81cd4640 1 -- start start 2023-11-04T01:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7f9e81cd4640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9e7c14a6a0 0x7f9e7c0cad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7f9e81cd4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9e7c0cbcc0 0x7f9e7c1651f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7f9e81cd4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7c14aa80 con 0x7f9e7c164db0 2023-11-04T01:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7f9e81cd4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e7c0cb290 con 0x7f9e7c0cbcc0 2023-11-04T01:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7f9e81cd4640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e7c165900 con 0x7f9e7c14a6a0 2023-11-04T01:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7f9e7b7fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9e7c14a6a0 0x7f9e7c0cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7f9e7bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9e7c0cbcc0 0x7f9e7c1651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7f9e7b7fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9e7c14a6a0 0x7f9e7c0cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35310/0 (socket says 172.21.15.114:35310) 2023-11-04T01:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7f9e7b7fe640 1 -- 172.21.15.114:0/1285379866 learned_addr learned my addr 172.21.15.114:0/1285379866 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.677+0000 7f9e7bfff640 1 -- 172.21.15.114:0/1285379866 >> v2:172.21.15.141:3300/0 conn(0x7f9e7c14a6a0 msgr2=0x7f9e7c0cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.677+0000 7f9e7bfff640 1 --2- 172.21.15.114:0/1285379866 >> v2:172.21.15.141:3300/0 conn(0x7f9e7c14a6a0 0x7f9e7c0cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.677+0000 7f9e7bfff640 1 -- 172.21.15.114:0/1285379866 >> v1:172.21.15.114:6789/0 conn(0x7f9e7c164db0 legacy=0x7f9e7c0cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.677+0000 7f9e7bfff640 1 -- 172.21.15.114:0/1285379866 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c165be0 con 0x7f9e7c0cbcc0 2023-11-04T01:36:53.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.675+0000 7fc3bb7ce640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc3b415cbf0 0x7fc3b40c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.675+0000 7fc3bb7ce640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc3b406f280 0x7fc3b406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.675+0000 7fc3bb7ce640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3b406a120 0x7fc3b406a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.675+0000 7fc3bb7ce640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b40b1f20 con 0x7fc3b406f280 2023-11-04T01:36:53.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.675+0000 7fc3bb7ce640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b40ca2c0 con 0x7fc3b415cbf0 2023-11-04T01:36:53.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.675+0000 7fc3bb7ce640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b406ff20 con 0x7fc3b406a120 2023-11-04T01:36:53.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7fc3b956a640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc3b415cbf0 0x7fc3b40c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7fc3b956a640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc3b415cbf0 0x7fc3b40c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35304/0 (socket says 172.21.15.114:35304) 2023-11-04T01:36:53.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7fc3b956a640 1 -- 172.21.15.114:0/239337224 learned_addr learned my addr 172.21.15.114:0/239337224 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:53.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7fc3b8d69640 1 --2- 172.21.15.114:0/239337224 >> v2:172.21.15.114:3300/0 conn(0x7fc3b406f280 0x7fc3b406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7fc3b956a640 1 -- 172.21.15.114:0/239337224 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3b406a120 msgr2=0x7fc3b406a590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:36:53.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7fc3b956a640 1 --2- 172.21.15.114:0/239337224 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3b406a120 0x7fc3b406a590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7fc3b956a640 1 -- 172.21.15.114:0/239337224 >> v2:172.21.15.114:3300/0 conn(0x7fc3b406f280 msgr2=0x7fc3b406f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7fc3b956a640 1 --2- 172.21.15.114:0/239337224 >> v2:172.21.15.114:3300/0 conn(0x7fc3b406f280 0x7fc3b406f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.676+0000 7fc3b956a640 1 -- 172.21.15.114:0/239337224 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b415cfd0 con 0x7fc3b415cbf0 2023-11-04T01:36:53.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.678+0000 7fc3b8d69640 1 --2- 172.21.15.114:0/239337224 >> v2:172.21.15.114:3300/0 conn(0x7fc3b406f280 0x7fc3b406f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:53.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.679+0000 7f9e7bfff640 1 --2- 172.21.15.114:0/1285379866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e7c0cbcc0 0x7f9e7c1651f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c06c8a0 tx=0x7f9e7402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb3a7646e9a9789 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.679+0000 7fc3b956a640 1 --2- 172.21.15.114:0/239337224 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3b415cbf0 0x7fc3b40c9d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4070f10 tx=0x7fc3ac03d1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b32670b674d6bd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.679+0000 7f9e7a7fc640 1 -- 172.21.15.114:0/1285379866 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7402cc70 con 0x7f9e7c0cbcc0 2023-11-04T01:36:53.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.679+0000 7f9e7a7fc640 1 -- 172.21.15.114:0/1285379866 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7402cdd0 con 0x7f9e7c0cbcc0 2023-11-04T01:36:53.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.679+0000 7f9e7a7fc640 1 -- 172.21.15.114:0/1285379866 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e74034660 con 0x7f9e7c0cbcc0 2023-11-04T01:36:53.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.680+0000 7f9e81cd4640 1 -- 172.21.15.114:0/1285379866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e7c0cbcc0 msgr2=0x7f9e7c1651f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.680+0000 7f9e81cd4640 1 --2- 172.21.15.114:0/1285379866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e7c0cbcc0 0x7f9e7c1651f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c06c8a0 tx=0x7f9e7402bec0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.681+0000 7f9e81cd4640 1 -- 172.21.15.114:0/1285379866 shutdown_connections 2023-11-04T01:36:53.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.681+0000 7f9e81cd4640 1 --2- 172.21.15.114:0/1285379866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e7c0cbcc0 0x7f9e7c1651f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.681+0000 7f9e81cd4640 1 --2- 172.21.15.114:0/1285379866 >> v2:172.21.15.141:3300/0 conn(0x7f9e7c14a6a0 0x7f9e7c0cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.681+0000 7f9e81cd4640 1 -- 172.21.15.114:0/1285379866 >> 172.21.15.114:0/1285379866 conn(0x7f9e7c06a120 msgr2=0x7f9e7c06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.679+0000 7fc3abfff640 1 -- 172.21.15.114:0/239337224 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac045440 con 0x7fc3b415cbf0 2023-11-04T01:36:53.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.680+0000 7fc3abfff640 1 -- 172.21.15.114:0/239337224 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ac0455a0 con 0x7fc3b415cbf0 2023-11-04T01:36:53.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.680+0000 7fc3abfff640 1 -- 172.21.15.114:0/239337224 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac045930 con 0x7fc3b415cbf0 2023-11-04T01:36:53.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.681+0000 7fc3bb7ce640 1 -- 172.21.15.114:0/239337224 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3b415cbf0 msgr2=0x7fc3b40c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.681+0000 7fc3bb7ce640 1 --2- 172.21.15.114:0/239337224 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3b415cbf0 0x7fc3b40c9d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4070f10 tx=0x7fc3ac03d1c0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.681+0000 7fc3bb7ce640 1 -- 172.21.15.114:0/239337224 shutdown_connections 2023-11-04T01:36:53.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.681+0000 7fc3bb7ce640 1 --2- 172.21.15.114:0/239337224 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3b406a120 0x7fc3b406a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.681+0000 7fc3bb7ce640 1 --2- 172.21.15.114:0/239337224 >> v2:172.21.15.114:3300/0 conn(0x7fc3b406f280 0x7fc3b406f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.681+0000 7fc3bb7ce640 1 --2- 172.21.15.114:0/239337224 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3b415cbf0 0x7fc3b40c9d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.681+0000 7fc3bb7ce640 1 -- 172.21.15.114:0/239337224 >> 172.21.15.114:0/239337224 conn(0x7fc3b40cc100 msgr2=0x7fc3b40cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.681+0000 7fc3bb7ce640 1 -- 172.21.15.114:0/239337224 shutdown_connections 2023-11-04T01:36:53.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.681+0000 7fc3bb7ce640 1 -- 172.21.15.114:0/239337224 wait complete. 2023-11-04T01:36:53.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.683+0000 7fc3bb7ce640 1 Processor -- start 2023-11-04T01:36:53.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.683+0000 7fc3bb7ce640 1 -- start start 2023-11-04T01:36:53.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.684+0000 7fc3bb7ce640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3b406a120 0x7fc3b414ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7fc3bb7ce640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3b406f280 0x7fc3b41573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7fc3bb7ce640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3b415cbf0 0x7fc3b415b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7fc3bb7ce640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b4158a60 con 0x7fc3b415cbf0 2023-11-04T01:36:53.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7fc3bb7ce640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b4157e50 con 0x7fc3b406f280 2023-11-04T01:36:53.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7fc3b956a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3b406a120 0x7fc3b414ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7fc3b956a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3b406a120 0x7fc3b414ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:52014/0 (socket says 172.21.15.114:52014) 2023-11-04T01:36:53.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7fc3b956a640 1 -- 172.21.15.114:0/3100481285 learned_addr learned my addr 172.21.15.114:0/3100481285 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:53.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7fc3bb7ce640 1 -- 172.21.15.114:0/3100481285 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b4158130 con 0x7fc3b406a120 2023-11-04T01:36:53.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.686+0000 7fc3b8d69640 1 --2- 172.21.15.114:0/3100481285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3b406f280 0x7fc3b41573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.686+0000 7fc3b956a640 1 -- 172.21.15.114:0/3100481285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3b406f280 msgr2=0x7fc3b41573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.686+0000 7fc3b956a640 1 --2- 172.21.15.114:0/3100481285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3b406f280 0x7fc3b41573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.686+0000 7fc3b956a640 1 -- 172.21.15.114:0/3100481285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3b415cbf0 msgr2=0x7fc3b415b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:36:53.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.686+0000 7fc3b956a640 1 --2- 172.21.15.114:0/3100481285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3b415cbf0 0x7fc3b415b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.686+0000 7fc3b956a640 1 -- 172.21.15.114:0/3100481285 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b0009400 con 0x7fc3b406a120 2023-11-04T01:36:53.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.687+0000 7fc3b956a640 1 --2- 172.21.15.114:0/3100481285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3b406a120 0x7fc3b414ca80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac03d200 tx=0x7fc3ac002350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.681+0000 7f9e81cd4640 1 -- 172.21.15.114:0/1285379866 shutdown_connections 2023-11-04T01:36:53.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.681+0000 7f9e81cd4640 1 -- 172.21.15.114:0/1285379866 wait complete. 2023-11-04T01:36:53.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.683+0000 7f9e81cd4640 1 Processor -- start 2023-11-04T01:36:53.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.683+0000 7f9e81cd4640 1 -- start start 2023-11-04T01:36:53.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.684+0000 7f9e81cd4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e7c0cbcc0 0x7f9e7c0c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7f9e7b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e7c0cbcc0 0x7f9e7c0c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7f9e7b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e7c0cbcc0 0x7f9e7c0c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49540/0 (socket says 172.21.15.114:49540) 2023-11-04T01:36:53.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7f9e81cd4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e7c14a6a0 0x7f9e7c0adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7f9e81cd4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9e7c164db0 0x7f9e7c13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7f9e81cd4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c0c7fd0 con 0x7f9e7c0cbcc0 2023-11-04T01:36:53.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7f9e81cd4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c0b2760 con 0x7f9e7c164db0 2023-11-04T01:36:53.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7f9e81cd4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c0b2a40 con 0x7f9e7c14a6a0 2023-11-04T01:36:53.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7f9e7b7fe640 1 -- 172.21.15.114:0/2225508850 learned_addr learned my addr 172.21.15.114:0/2225508850 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:53.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7f9e7b7fe640 1 -- 172.21.15.114:0/2225508850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e7c14a6a0 msgr2=0x7f9e7c0adc90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:36:53.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7f9e7b7fe640 1 --2- 172.21.15.114:0/2225508850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e7c14a6a0 0x7f9e7c0adc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7f9e7b7fe640 1 -- 172.21.15.114:0/2225508850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9e7c164db0 msgr2=0x7f9e7c13f3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:36:53.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7f9e7b7fe640 1 --2- 172.21.15.114:0/2225508850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9e7c164db0 0x7f9e7c13f3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.685+0000 7f9e7b7fe640 1 -- 172.21.15.114:0/2225508850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e74009a70 con 0x7f9e7c0cbcc0 2023-11-04T01:36:53.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.686+0000 7f9e7b7fe640 1 --2- 172.21.15.114:0/2225508850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e7c0cbcc0 0x7f9e7c0c84d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c00ebb0 tx=0x7f9e6c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.687+0000 7f9e63fff640 1 -- 172.21.15.114:0/2225508850 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c00ed60 con 0x7f9e7c0cbcc0 2023-11-04T01:36:53.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.687+0000 7f9e63fff640 1 -- 172.21.15.114:0/2225508850 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6c00eec0 con 0x7f9e7c0cbcc0 2023-11-04T01:36:53.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.687+0000 7f9e63fff640 1 -- 172.21.15.114:0/2225508850 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c00ce30 con 0x7f9e7c0cbcc0 2023-11-04T01:36:53.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.688+0000 7f9e81cd4640 1 -- 172.21.15.114:0/2225508850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7c0b2d20 con 0x7f9e7c0cbcc0 2023-11-04T01:36:53.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.688+0000 7f9e81cd4640 1 -- 172.21.15.114:0/2225508850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7c0b32e0 con 0x7f9e7c0cbcc0 2023-11-04T01:36:53.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.690+0000 7f9e61ffb640 1 -- 172.21.15.114:0/2225508850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7c0b3500 con 0x7f9e7c0cbcc0 2023-11-04T01:36:53.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.690+0000 7fc3a9ffb640 1 -- 172.21.15.114:0/3100481285 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac045440 con 0x7fc3b406a120 2023-11-04T01:36:53.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.690+0000 7fc3bb7ce640 1 -- 172.21.15.114:0/3100481285 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ac009a10 con 0x7fc3b406a120 2023-11-04T01:36:53.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.690+0000 7fc3bb7ce640 1 -- 172.21.15.114:0/3100481285 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b41586f0 con 0x7fc3b406a120 2023-11-04T01:36:53.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.691+0000 7fc3a9ffb640 1 -- 172.21.15.114:0/3100481285 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ac043a80 con 0x7fc3b406a120 2023-11-04T01:36:53.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.691+0000 7fc3a9ffb640 1 -- 172.21.15.114:0/3100481285 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac046ea0 con 0x7fc3b406a120 2023-11-04T01:36:53.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.694+0000 7fc3a9ffb640 1 -- 172.21.15.114:0/3100481285 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc3ac04c050 con 0x7fc3b406a120 2023-11-04T01:36:53.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.694+0000 7fc3a9ffb640 1 --2- 172.21.15.114:0/3100481285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc39806af40 0x7fc39806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.695+0000 7fc3b8d69640 1 --2- 172.21.15.114:0/3100481285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc39806af40 0x7fc39806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.695+0000 7fc3b8d69640 1 --2- 172.21.15.114:0/3100481285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc39806af40 0x7fc39806d400 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40cb340 tx=0x7fc3b0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.696+0000 7fc3a9ffb640 1 -- 172.21.15.114:0/3100481285 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc3ac0bd700 con 0x7fc3b406a120 2023-11-04T01:36:53.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.696+0000 7fc3bb7ce640 1 -- 172.21.15.114:0/3100481285 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b4067180 con 0x7fc3b406a120 2023-11-04T01:36:53.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.697+0000 7f9e63fff640 1 -- 172.21.15.114:0/2225508850 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e6c013470 con 0x7f9e7c0cbcc0 2023-11-04T01:36:53.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.698+0000 7f9e63fff640 1 --2- 172.21.15.114:0/2225508850 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9e6806af70 0x7f9e6806d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.698+0000 7f9e63fff640 1 -- 172.21.15.114:0/2225508850 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9e6c089930 con 0x7f9e7c0cbcc0 2023-11-04T01:36:53.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.699+0000 7f9e7affd640 1 --2- 172.21.15.114:0/2225508850 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9e6806af70 0x7f9e6806d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.699+0000 7f9e7affd640 1 --2- 172.21.15.114:0/2225508850 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9e6806af70 0x7f9e6806d430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c164d80 tx=0x7f9e70007950 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.700+0000 7f9e63fff640 1 -- 172.21.15.114:0/2225508850 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9e6c054760 con 0x7f9e7c0cbcc0 2023-11-04T01:36:53.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.702+0000 7fc3a9ffb640 1 -- 172.21.15.114:0/3100481285 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc3ac0885c0 con 0x7fc3b406a120 2023-11-04T01:36:53.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.734+0000 7f4519aa3640 1 Processor -- start 2023-11-04T01:36:53.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.734+0000 7f4519aa3640 1 -- start start 2023-11-04T01:36:53.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.736+0000 7f4519aa3640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f451406e140 0x7f451406f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.736+0000 7f4519aa3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45140b1f60 0x7f451406e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.737+0000 7f8635264640 1 Processor -- start 2023-11-04T01:36:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.736+0000 7f4518aa1640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f451406e140 0x7f451406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.736+0000 7f4513fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45140b1f60 0x7f451406e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.736+0000 7f4518aa1640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f451406e140 0x7f451406f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35320/0 (socket says 172.21.15.114:35320) 2023-11-04T01:36:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.736+0000 7f4513fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45140b1f60 0x7f451406e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49556/0 (socket says 172.21.15.114:49556) 2023-11-04T01:36:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.736+0000 7f45192a2640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f451406a120 0x7f451406a590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41188/0 (socket says 172.21.15.114:41188) 2023-11-04T01:36:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.736+0000 7f4518aa1640 1 -- 172.21.15.114:0/560386771 learned_addr learned my addr 172.21.15.114:0/560386771 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.736+0000 7f4519aa3640 1 -- 172.21.15.114:0/560386771 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451406ea60 con 0x7f451406a120 2023-11-04T01:36:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.737+0000 7f4519aa3640 1 -- 172.21.15.114:0/560386771 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45140b2460 con 0x7f45140b1f60 2023-11-04T01:36:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.737+0000 7f4519aa3640 1 -- 172.21.15.114:0/560386771 --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45140b2740 con 0x7f451406e140 2023-11-04T01:36:53.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.737+0000 7f8635264640 1 -- start start 2023-11-04T01:36:53.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.737+0000 7f45137fe640 1 -- 172.21.15.114:0/560386771 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489621100 0 0) 0x7f451406ea60 con 0x7f451406a120 2023-11-04T01:36:53.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.737+0000 7f45137fe640 1 -- 172.21.15.114:0/560386771 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4504003520 con 0x7f451406a120 2023-11-04T01:36:53.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f8635264640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f86280dff00 0x7f8628053cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f8635264640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f862803b9c0 0x7f8628038d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f45137fe640 1 -- 172.21.15.114:0/560386771 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4183253800 0 0) 0x7f4504003520 con 0x7f451406a120 2023-11-04T01:36:53.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f45137fe640 1 -- 172.21.15.114:0/560386771 >> v2:172.21.15.141:3300/0 conn(0x7f451406e140 msgr2=0x7f451406f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f45137fe640 1 --2- 172.21.15.114:0/560386771 >> v2:172.21.15.141:3300/0 conn(0x7f451406e140 0x7f451406f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f45137fe640 1 -- 172.21.15.114:0/560386771 >> v2:172.21.15.114:3300/0 conn(0x7f45140b1f60 msgr2=0x7f451406e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f45137fe640 1 --2- 172.21.15.114:0/560386771 >> v2:172.21.15.114:3300/0 conn(0x7f45140b1f60 0x7f451406e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f45137fe640 1 -- 172.21.15.114:0/560386771 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45140b2a20 con 0x7f451406a120 2023-11-04T01:36:53.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f45137fe640 1 -- 172.21.15.114:0/560386771 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f450c0019f0 con 0x7f451406a120 2023-11-04T01:36:53.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f45137fe640 1 -- 172.21.15.114:0/560386771 >> v1:172.21.15.114:6789/0 conn(0x7f451406a120 legacy=0x7f451406a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f45137fe640 1 --2- 172.21.15.114:0/560386771 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4504003970 0x7f4504003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f45137fe640 1 --2- 172.21.15.114:0/560386771 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45040047c0 0x7f4504004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f45137fe640 1 --2- 172.21.15.114:0/560386771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4504005180 0x7f450400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f45137fe640 1 -- 172.21.15.114:0/560386771 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45140b2460 con 0x7f4504005180 2023-11-04T01:36:53.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f45137fe640 1 -- 172.21.15.114:0/560386771 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45140b2740 con 0x7f4504003970 2023-11-04T01:36:53.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f45137fe640 1 -- 172.21.15.114:0/560386771 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45040147d0 con 0x7f45040047c0 2023-11-04T01:36:53.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f8635264640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8628054200 0x7f8628039280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f8635264640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8628055320 con 0x7f86280dff00 2023-11-04T01:36:53.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f8635264640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86280e02e0 con 0x7f862803b9c0 2023-11-04T01:36:53.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.738+0000 7f8635264640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86280546a0 con 0x7f8628054200 2023-11-04T01:36:53.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.739+0000 7f4513fff640 1 --2- 172.21.15.114:0/560386771 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45040047c0 0x7f4504004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.739+0000 7f862effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f86280dff00 0x7f8628053cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.739+0000 7f862effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f86280dff00 0x7f8628053cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49580/0 (socket says 172.21.15.114:49580) 2023-11-04T01:36:53.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.739+0000 7f862effd640 1 -- 172.21.15.114:0/26042503 learned_addr learned my addr 172.21.15.114:0/26042503 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:53.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.739+0000 7f862e7fc640 1 --2- 172.21.15.114:0/26042503 >> v2:172.21.15.141:3300/0 conn(0x7f862803b9c0 0x7f8628038d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.739+0000 7f45192a2640 1 --2- 172.21.15.114:0/560386771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4504005180 0x7f450400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.739+0000 7f45192a2640 1 -- 172.21.15.114:0/560386771 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45040047c0 msgr2=0x7f4504004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.739+0000 7f45192a2640 1 --2- 172.21.15.114:0/560386771 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45040047c0 0x7f4504004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.739+0000 7f45192a2640 1 -- 172.21.15.114:0/560386771 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4504003970 msgr2=0x7f4504003d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:36:53.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.739+0000 7f45192a2640 1 --2- 172.21.15.114:0/560386771 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4504003970 0x7f4504003d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.740+0000 7f45192a2640 1 -- 172.21.15.114:0/560386771 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45140b2a20 con 0x7f4504005180 2023-11-04T01:36:53.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.740+0000 7f4513fff640 1 --2- 172.21.15.114:0/560386771 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45040047c0 0x7f4504004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:53.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.739+0000 7f862e7fc640 1 -- 172.21.15.114:0/26042503 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8628054200 msgr2=0x7f8628039280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:36:53.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.739+0000 7f862e7fc640 1 --2- 172.21.15.114:0/26042503 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8628054200 0x7f8628039280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.739+0000 7f862e7fc640 1 -- 172.21.15.114:0/26042503 >> v2:172.21.15.114:3300/0 conn(0x7f86280dff00 msgr2=0x7f8628053cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:53.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.739+0000 7f862e7fc640 1 --2- 172.21.15.114:0/26042503 >> v2:172.21.15.114:3300/0 conn(0x7f86280dff00 0x7f8628053cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.739+0000 7f862e7fc640 1 -- 172.21.15.114:0/26042503 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8628054980 con 0x7f862803b9c0 2023-11-04T01:36:53.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.739+0000 7f862effd640 1 --2- 172.21.15.114:0/26042503 >> v2:172.21.15.114:3300/0 conn(0x7f86280dff00 0x7f8628053cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:53.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.741+0000 7fa9572d1640 1 Processor -- start 2023-11-04T01:36:53.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.741+0000 7fa9572d1640 1 -- start start 2023-11-04T01:36:53.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.741+0000 7f862e7fc640 1 --2- 172.21.15.114:0/26042503 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f862803b9c0 0x7f8628038d40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8628052660 tx=0x7f862002e0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a55c1d9fefcc270f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.741+0000 7f45192a2640 1 --2- 172.21.15.114:0/560386771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4504005180 0x7f450400b980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f450c00c500 tx=0x7f45040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da9ad8a46db1e26 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.741+0000 7f45192a2640 1 -- 172.21.15.114:0/560386771 reap_dead start 2023-11-04T01:36:53.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.741+0000 7f862dffb640 1 -- 172.21.15.114:0/26042503 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862002ee60 con 0x7f862803b9c0 2023-11-04T01:36:53.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.742+0000 7f862dffb640 1 -- 172.21.15.114:0/26042503 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8620036440 con 0x7f862803b9c0 2023-11-04T01:36:53.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.742+0000 7f8635264640 1 -- 172.21.15.114:0/26042503 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f862803b9c0 msgr2=0x7f8628038d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.742+0000 7f8635264640 1 --2- 172.21.15.114:0/26042503 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f862803b9c0 0x7f8628038d40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8628052660 tx=0x7f862002e0b0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.741+0000 7f45137fe640 1 -- 172.21.15.114:0/560386771 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c02cdb0 con 0x7f4504005180 2023-11-04T01:36:53.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.741+0000 7f45137fe640 1 -- 172.21.15.114:0/560386771 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c005b90 con 0x7f4504005180 2023-11-04T01:36:53.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.741+0000 7f45137fe640 1 -- 172.21.15.114:0/560386771 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c007070 con 0x7f4504005180 2023-11-04T01:36:53.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.742+0000 7f4519aa3640 1 -- 172.21.15.114:0/560386771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4504005180 msgr2=0x7f450400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.742+0000 7f4519aa3640 1 --2- 172.21.15.114:0/560386771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4504005180 0x7f450400b980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f450c00c500 tx=0x7f45040057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.742+0000 7fa9572d1640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948033eb0 0x7fa948053040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7f8635264640 1 -- 172.21.15.114:0/26042503 shutdown_connections 2023-11-04T01:36:53.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7f8635264640 1 --2- 172.21.15.114:0/26042503 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8628054200 0x7f8628039280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7f8635264640 1 --2- 172.21.15.114:0/26042503 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f862803b9c0 0x7f8628038d40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7f8635264640 1 --2- 172.21.15.114:0/26042503 >> v2:172.21.15.114:3300/0 conn(0x7f86280dff00 0x7f8628053cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7f8635264640 1 -- 172.21.15.114:0/26042503 >> 172.21.15.114:0/26042503 conn(0x7f8628055c10 msgr2=0x7f8628056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7f4519aa3640 1 -- 172.21.15.114:0/560386771 shutdown_connections 2023-11-04T01:36:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7f4519aa3640 1 --2- 172.21.15.114:0/560386771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4504005180 0x7f450400b980 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7f4519aa3640 1 -- 172.21.15.114:0/560386771 >> 172.21.15.114:0/560386771 conn(0x7f45140cf050 msgr2=0x7f45140cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7fa9562cf640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948033eb0 0x7fa948053040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7fa9562cf640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948033eb0 0x7fa948053040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:52038/0 (socket says 172.21.15.114:52038) 2023-11-04T01:36:53.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7fa9562cf640 1 -- 172.21.15.114:0/2800925891 learned_addr learned my addr 172.21.15.114:0/2800925891 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:53.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7fa9572d1640 1 -- 172.21.15.114:0/2800925891 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9480542e0 con 0x7fa948007090 2023-11-04T01:36:53.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7fa9572d1640 1 -- 172.21.15.114:0/2800925891 --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa948034290 con 0x7fa948050120 2023-11-04T01:36:53.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7fa9572d1640 1 -- 172.21.15.114:0/2800925891 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9480e3b20 con 0x7fa948033eb0 2023-11-04T01:36:53.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7fa9552cd640 1 -- 172.21.15.114:0/2800925891 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128513147 0 0) 0x7fa948034290 con 0x7fa948050120 2023-11-04T01:36:53.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7fa9552cd640 1 -- 172.21.15.114:0/2800925891 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa93c003520 con 0x7fa948050120 2023-11-04T01:36:53.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7fa9552cd640 1 -- 172.21.15.114:0/2800925891 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623984335 0 0) 0x7fa9480542e0 con 0x7fa948007090 2023-11-04T01:36:53.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.743+0000 7fa9552cd640 1 -- 172.21.15.114:0/2800925891 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa948034290 con 0x7fa948007090 2023-11-04T01:36:53.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.744+0000 7f8635264640 1 -- 172.21.15.114:0/26042503 shutdown_connections 2023-11-04T01:36:53.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.744+0000 7fa9562cf640 1 -- 172.21.15.114:0/2800925891 >> v1:172.21.15.141:6789/0 conn(0x7fa948050120 legacy=0x7fa9480e2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.744+0000 7fa9562cf640 1 -- 172.21.15.114:0/2800925891 >> v1:172.21.15.114:6789/0 conn(0x7fa948007090 legacy=0x7fa9480e3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.744+0000 7fa9562cf640 1 -- 172.21.15.114:0/2800925891 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9480536d0 con 0x7fa948033eb0 2023-11-04T01:36:53.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.744+0000 7f8635264640 1 -- 172.21.15.114:0/26042503 wait complete. 2023-11-04T01:36:53.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.745+0000 7f4519aa3640 1 -- 172.21.15.114:0/560386771 shutdown_connections 2023-11-04T01:36:53.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.745+0000 7fa9562cf640 1 --2- 172.21.15.114:0/2800925891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948033eb0 0x7fa948053040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009820 tx=0x7fa94c02fbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7798f81bd92fcf04 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.745+0000 7f4519aa3640 1 -- 172.21.15.114:0/560386771 wait complete. 2023-11-04T01:36:53.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.745+0000 7fa9552cd640 1 -- 172.21.15.114:0/2800925891 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9400015a0 con 0x7fa948033eb0 2023-11-04T01:36:53.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.745+0000 7fa9552cd640 1 -- 172.21.15.114:0/2800925891 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c030790 con 0x7fa948033eb0 2023-11-04T01:36:53.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.745+0000 7fa9552cd640 1 -- 172.21.15.114:0/2800925891 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c030b20 con 0x7fa948033eb0 2023-11-04T01:36:53.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.746+0000 7fa9572d1640 1 -- 172.21.15.114:0/2800925891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948033eb0 msgr2=0x7fa948053040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.746+0000 7fa9572d1640 1 --2- 172.21.15.114:0/2800925891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948033eb0 0x7fa948053040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009820 tx=0x7fa94c02fbe0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.747+0000 7fa9572d1640 1 -- 172.21.15.114:0/2800925891 shutdown_connections 2023-11-04T01:36:53.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.747+0000 7fa9572d1640 1 --2- 172.21.15.114:0/2800925891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948033eb0 0x7fa948053040 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.747+0000 7fa9572d1640 1 -- 172.21.15.114:0/2800925891 >> 172.21.15.114:0/2800925891 conn(0x7fa948054b00 msgr2=0x7fa948054ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.747+0000 7f4519aa3640 1 Processor -- start 2023-11-04T01:36:53.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.747+0000 7fa9572d1640 1 -- 172.21.15.114:0/2800925891 shutdown_connections 2023-11-04T01:36:53.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.747+0000 7fa9572d1640 1 -- 172.21.15.114:0/2800925891 wait complete. 2023-11-04T01:36:53.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.747+0000 7f8635264640 1 Processor -- start 2023-11-04T01:36:53.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.747+0000 7f4519aa3640 1 -- start start 2023-11-04T01:36:53.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.748+0000 7f4519aa3640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4504005180 0x7f451414c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.747+0000 7f8635264640 1 -- start start 2023-11-04T01:36:53.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f8635264640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8628054200 0x7f862804efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f8635264640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86280dff00 0x7f86280e0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f8635264640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86280d7610 0x7f86280e2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f4519aa3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45141f1af0 0x7f45141eef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f8635264640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86280e2300 con 0x7f86280d7610 2023-11-04T01:36:53.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f8635264640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862804f660 con 0x7f86280dff00 2023-11-04T01:36:53.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f8635264640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86280e14d0 con 0x7f8628054200 2023-11-04T01:36:53.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f862f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86280d7610 0x7f86280e2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f862f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86280d7610 0x7f86280e2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49588/0 (socket says 172.21.15.114:49588) 2023-11-04T01:36:53.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f862f7fe640 1 -- 172.21.15.114:0/2248868352 learned_addr learned my addr 172.21.15.114:0/2248868352 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:53.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f862effd640 1 --2- 172.21.15.114:0/2248868352 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8628054200 0x7f862804efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f862e7fc640 1 --2- 172.21.15.114:0/2248868352 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86280dff00 0x7f86280e0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f4519aa3640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45141e3180 0x7f4514157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f4519aa3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45141e1d90 con 0x7f45141f1af0 2023-11-04T01:36:53.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7fa9572d1640 1 Processor -- start 2023-11-04T01:36:53.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.750+0000 7fa9572d1640 1 -- start start 2023-11-04T01:36:53.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f4519aa3640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4514150070 con 0x7f45141e3180 2023-11-04T01:36:53.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f4519aa3640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45141ef4c0 con 0x7f4504005180 2023-11-04T01:36:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f4513fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45141f1af0 0x7f45141eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f4513fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45141f1af0 0x7f45141eef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49584/0 (socket says 172.21.15.114:49584) 2023-11-04T01:36:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f4513fff640 1 -- 172.21.15.114:0/2456890219 learned_addr learned my addr 172.21.15.114:0/2456890219 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.749+0000 7f4518aa1640 1 --2- 172.21.15.114:0/2456890219 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4504005180 0x7f451414c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.750+0000 7f4513fff640 1 -- 172.21.15.114:0/2456890219 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4504005180 msgr2=0x7f451414c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.750+0000 7f862effd640 1 -- 172.21.15.114:0/2248868352 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86280dff00 msgr2=0x7f86280e0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.750+0000 7f862effd640 1 --2- 172.21.15.114:0/2248868352 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86280dff00 0x7f86280e0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.750+0000 7f862effd640 1 -- 172.21.15.114:0/2248868352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86280d7610 msgr2=0x7f86280e2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.750+0000 7f862effd640 1 --2- 172.21.15.114:0/2248868352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86280d7610 0x7f86280e2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.750+0000 7f862effd640 1 -- 172.21.15.114:0/2248868352 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240094d0 con 0x7f8628054200 2023-11-04T01:36:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.750+0000 7f862f7fe640 1 --2- 172.21.15.114:0/2248868352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86280d7610 0x7f86280e2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.750+0000 7f4513fff640 1 --2- 172.21.15.114:0/2456890219 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4504005180 0x7f451414c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.750+0000 7f4513fff640 1 -- 172.21.15.114:0/2456890219 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45141e3180 msgr2=0x7f4514157b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:36:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.750+0000 7f4513fff640 1 --2- 172.21.15.114:0/2456890219 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45141e3180 0x7f4514157b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.750+0000 7f4513fff640 1 -- 172.21.15.114:0/2456890219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45141f1ff0 con 0x7f45141f1af0 2023-11-04T01:36:53.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.750+0000 7f4513fff640 1 --2- 172.21.15.114:0/2456890219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45141f1af0 0x7f45141eef80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f45080106f0 tx=0x7f4508010bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.750+0000 7f45117fa640 1 -- 172.21.15.114:0/2456890219 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450800ea50 con 0x7f45141f1af0 2023-11-04T01:36:53.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.750+0000 7f45117fa640 1 -- 172.21.15.114:0/2456890219 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450800ebb0 con 0x7f45141f1af0 2023-11-04T01:36:53.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.751+0000 7fa9572d1640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948007090 0x7fa948035810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.750+0000 7f862effd640 1 --2- 172.21.15.114:0/2248868352 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8628054200 0x7f862804efa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f862400e7f0 tx=0x7f862400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.751+0000 7f86177fe640 1 -- 172.21.15.114:0/2248868352 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862400c940 con 0x7f8628054200 2023-11-04T01:36:53.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.751+0000 7f86177fe640 1 -- 172.21.15.114:0/2248868352 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862400caa0 con 0x7f8628054200 2023-11-04T01:36:53.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.751+0000 7fa9572d1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa948033eb0 0x7fa948035d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.751+0000 7fa9572d1640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948050120 0x7fa9480db640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.751+0000 7f8635264640 1 -- 172.21.15.114:0/2248868352 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862000b6a0 con 0x7f8628054200 2023-11-04T01:36:53.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.751+0000 7f8635264640 1 -- 172.21.15.114:0/2248868352 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86280e19d0 con 0x7f8628054200 2023-11-04T01:36:53.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.752+0000 7f86177fe640 1 -- 172.21.15.114:0/2248868352 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862400ce10 con 0x7f8628054200 2023-11-04T01:36:53.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.751+0000 7fa9572d1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa948178c20 con 0x7fa948033eb0 2023-11-04T01:36:53.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.751+0000 7fa9572d1640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa948177fa0 con 0x7fa948050120 2023-11-04T01:36:53.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.751+0000 7fa9572d1640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa948178280 con 0x7fa948007090 2023-11-04T01:36:53.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.752+0000 7fa9562cf640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948007090 0x7fa948035810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.752+0000 7fa956ad0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948050120 0x7fa9480db640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.752+0000 7fa956ad0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948050120 0x7fa9480db640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35348/0 (socket says 172.21.15.114:35348) 2023-11-04T01:36:53.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.752+0000 7fa956ad0640 1 -- 172.21.15.114:0/2103214756 learned_addr learned my addr 172.21.15.114:0/2103214756 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:53.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.751+0000 7fa955ace640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa948033eb0 0x7fa948035d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.753+0000 7fa955ace640 1 -- 172.21.15.114:0/2103214756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948007090 msgr2=0x7fa948035810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.753+0000 7fa955ace640 1 --2- 172.21.15.114:0/2103214756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948007090 0x7fa948035810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.753+0000 7fa955ace640 1 -- 172.21.15.114:0/2103214756 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948050120 msgr2=0x7fa9480db640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.753+0000 7fa955ace640 1 --2- 172.21.15.114:0/2103214756 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948050120 0x7fa9480db640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.753+0000 7fa955ace640 1 -- 172.21.15.114:0/2103214756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c0094d0 con 0x7fa948033eb0 2023-11-04T01:36:53.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.751+0000 7f4519aa3640 1 -- 172.21.15.114:0/2456890219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45141f22d0 con 0x7f45141f1af0 2023-11-04T01:36:53.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.751+0000 7f4519aa3640 1 -- 172.21.15.114:0/2456890219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45141f2890 con 0x7f45141f1af0 2023-11-04T01:36:53.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.753+0000 7f45117fa640 1 -- 172.21.15.114:0/2456890219 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508013470 con 0x7f45141f1af0 2023-11-04T01:36:53.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.753+0000 7f8635264640 1 -- 172.21.15.114:0/2248868352 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8628006900 con 0x7f8628054200 2023-11-04T01:36:53.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.753+0000 7f44feffd640 1 -- 172.21.15.114:0/2456890219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451404ece0 con 0x7f45141f1af0 2023-11-04T01:36:53.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.753+0000 7fa955ace640 1 --2- 172.21.15.114:0/2103214756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa948033eb0 0x7fa948035d50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa94000c780 tx=0x7fa94000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.754+0000 7fa946ffd640 1 -- 172.21.15.114:0/2103214756 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940005270 con 0x7fa948033eb0 2023-11-04T01:36:53.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.755+0000 7fa9572d1640 1 -- 172.21.15.114:0/2103214756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa948178560 con 0x7fa948033eb0 2023-11-04T01:36:53.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.755+0000 7fa9572d1640 1 -- 172.21.15.114:0/2103214756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9480d08e0 con 0x7fa948033eb0 2023-11-04T01:36:53.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.755+0000 7f86177fe640 1 -- 172.21.15.114:0/2248868352 <== mon.2 v2:172.21.15.141:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8624005990 con 0x7f8628054200 2023-11-04T01:36:53.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.755+0000 7fa9562cf640 1 --2- 172.21.15.114:0/2103214756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948007090 0x7fa948035810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:53.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.755+0000 7fa956ad0640 1 --2- 172.21.15.114:0/2103214756 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948050120 0x7fa9480db640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:53.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.755+0000 7f86177fe640 1 --2- 172.21.15.114:0/2248868352 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f861c06af70 0x7f861c06d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.756+0000 7f862e7fc640 1 --2- 172.21.15.114:0/2248868352 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f861c06af70 0x7f861c06d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.756+0000 7f86177fe640 1 -- 172.21.15.114:0/2248868352 <== mon.2 v2:172.21.15.141:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8624089a90 con 0x7f8628054200 2023-11-04T01:36:53.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.757+0000 7f862e7fc640 1 --2- 172.21.15.114:0/2248868352 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f861c06af70 0x7f861c06d430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8620038000 tx=0x7f8620032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.757+0000 7fa9572d1640 1 -- 172.21.15.114:0/2103214756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa948005340 con 0x7fa948033eb0 2023-11-04T01:36:53.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.758+0000 7f45117fa640 1 -- 172.21.15.114:0/2456890219 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f45080135d0 con 0x7f45141f1af0 2023-11-04T01:36:53.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.758+0000 7f86177fe640 1 -- 172.21.15.114:0/2248868352 <== mon.2 v2:172.21.15.141:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8624054970 con 0x7f8628054200 2023-11-04T01:36:53.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.758+0000 7f45117fa640 1 --2- 172.21.15.114:0/2456890219 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44f806aec0 0x7f44f806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.759+0000 7f4518aa1640 1 --2- 172.21.15.114:0/2456890219 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44f806aec0 0x7f44f806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.759+0000 7f4518aa1640 1 --2- 172.21.15.114:0/2456890219 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44f806aec0 0x7f44f806d380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f45141554f0 tx=0x7f4500009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.760+0000 7f45117fa640 1 -- 172.21.15.114:0/2456890219 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4508089fe0 con 0x7f45141f1af0 2023-11-04T01:36:53.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.766+0000 7fa946ffd640 1 -- 172.21.15.114:0/2103214756 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9400053d0 con 0x7fa948033eb0 2023-11-04T01:36:53.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.766+0000 7fa946ffd640 1 -- 172.21.15.114:0/2103214756 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94000a840 con 0x7fa948033eb0 2023-11-04T01:36:53.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.767+0000 7f45117fa640 1 -- 172.21.15.114:0/2456890219 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4508054de0 con 0x7f45141f1af0 2023-11-04T01:36:53.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.767+0000 7fa946ffd640 1 -- 172.21.15.114:0/2103214756 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa94000aa60 con 0x7fa948033eb0 2023-11-04T01:36:53.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.767+0000 7fa946ffd640 1 --2- 172.21.15.114:0/2103214756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa93406ae70 0x7fa93406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.767+0000 7fa946ffd640 1 -- 172.21.15.114:0/2103214756 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa940089480 con 0x7fa948033eb0 2023-11-04T01:36:53.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.771+0000 7fa9562cf640 1 --2- 172.21.15.114:0/2103214756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa93406ae70 0x7fa93406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.772+0000 7fa9562cf640 1 --2- 172.21.15.114:0/2103214756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa93406ae70 0x7fa93406d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa94c03a000 tx=0x7fa94c034000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.775+0000 7fa946ffd640 1 -- 172.21.15.114:0/2103214756 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa940054380 con 0x7fa948033eb0 2023-11-04T01:36:53.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.787+0000 7f753621a640 1 Processor -- start 2023-11-04T01:36:53.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.787+0000 7f753621a640 1 -- start start 2023-11-04T01:36:53.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.788+0000 7f753621a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f75300c4220 0x7f75300ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.788+0000 7f753621a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7530164fe0 0x7f753006b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.788+0000 7f753621a640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75300cb840 con 0x7f75300b2620 2023-11-04T01:36:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.788+0000 7f753621a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75300b3510 con 0x7f75300c4220 2023-11-04T01:36:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.788+0000 7f753621a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753006bf00 con 0x7f7530164fe0 2023-11-04T01:36:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.789+0000 7f752ffff640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f75300b2620 0x7f75300cbcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:45888/0 (socket says 172.21.15.114:45888) 2023-11-04T01:36:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.789+0000 7f752ffff640 1 -- 172.21.15.114:0/743585284 learned_addr learned my addr 172.21.15.114:0/743585284 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.789+0000 7f752effd640 1 --2- 172.21.15.114:0/743585284 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7530164fe0 0x7f753006b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.789+0000 7f752effd640 1 -- 172.21.15.114:0/743585284 >> v2:172.21.15.114:3300/0 conn(0x7f75300c4220 msgr2=0x7f75300ce770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:36:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.790+0000 7f752f7fe640 1 --2- 172.21.15.114:0/743585284 >> v2:172.21.15.114:3300/0 conn(0x7f75300c4220 0x7f75300ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.790+0000 7f752effd640 1 --2- 172.21.15.114:0/743585284 >> v2:172.21.15.114:3300/0 conn(0x7f75300c4220 0x7f75300ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.790+0000 7f752effd640 1 -- 172.21.15.114:0/743585284 >> v1:172.21.15.141:6789/0 conn(0x7f75300b2620 legacy=0x7f75300cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.790+0000 7f752effd640 1 -- 172.21.15.114:0/743585284 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75300cb510 con 0x7f7530164fe0 2023-11-04T01:36:53.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.791+0000 7f752f7fe640 1 --2- 172.21.15.114:0/743585284 >> v2:172.21.15.114:3300/0 conn(0x7f75300c4220 0x7f75300ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:53.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.788+0000 7f4f41d89640 1 Processor -- start 2023-11-04T01:36:53.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.788+0000 7f4f41d89640 1 -- start start 2023-11-04T01:36:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.790+0000 7f4f41d89640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4f3c153e60 0x7f4f3c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.790+0000 7f4f3b7fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4f3c153e60 0x7f4f3c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.790+0000 7f4f3b7fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4f3c153e60 0x7f4f3c15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:35364/0 (socket says 172.21.15.114:35364) 2023-11-04T01:36:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.790+0000 7f4f3b7fe640 1 -- 172.21.15.114:0/1241402121 learned_addr learned my addr 172.21.15.114:0/1241402121 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.790+0000 7f4f41d89640 1 -- 172.21.15.114:0/1241402121 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c0cde60 con 0x7f4f3c0cd6d0 2023-11-04T01:36:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.790+0000 7f4f41d89640 1 -- 172.21.15.114:0/1241402121 --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c160f90 con 0x7f4f3c0b4880 2023-11-04T01:36:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.790+0000 7f4f41d89640 1 -- 172.21.15.114:0/1241402121 --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c15e400 con 0x7f4f3c153e60 2023-11-04T01:36:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.790+0000 7f4f3a7fc640 1 -- 172.21.15.114:0/1241402121 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080106757 0 0) 0x7f4f3c160f90 con 0x7f4f3c0b4880 2023-11-04T01:36:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.791+0000 7f4f3a7fc640 1 -- 172.21.15.114:0/1241402121 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f24003520 con 0x7f4f3c0b4880 2023-11-04T01:36:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.791+0000 7f4f3b7fe640 1 -- 172.21.15.114:0/1241402121 >> v1:172.21.15.141:6789/0 conn(0x7f4f3c0b4880 legacy=0x7f4f3c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.791+0000 7f4f3b7fe640 1 -- 172.21.15.114:0/1241402121 >> v1:172.21.15.114:6789/0 conn(0x7f4f3c0cd6d0 legacy=0x7f4f3c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.791+0000 7f4f3b7fe640 1 -- 172.21.15.114:0/1241402121 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c0ce090 con 0x7f4f3c153e60 2023-11-04T01:36:53.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.792+0000 7f752effd640 1 --2- 172.21.15.114:0/743585284 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7530164fe0 0x7f753006b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f75200097a0 tx=0x7f752002b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3a07cba8c3b4972 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.792+0000 7f4f3b7fe640 1 --2- 172.21.15.114:0/1241402121 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f3c153e60 0x7f4f3c15dec0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0097f0 tx=0x7f4f2c02b7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf46435cdecb74fc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.792+0000 7f4f3a7fc640 1 -- 172.21.15.114:0/1241402121 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30001670 con 0x7f4f3c153e60 2023-11-04T01:36:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.792+0000 7f4f3a7fc640 1 -- 172.21.15.114:0/1241402121 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c033420 con 0x7f4f3c153e60 2023-11-04T01:36:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.793+0000 7f4f41d89640 1 -- 172.21.15.114:0/1241402121 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f3c153e60 msgr2=0x7f4f3c15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.793+0000 7f4f3a7fc640 1 -- 172.21.15.114:0/1241402121 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30001670 con 0x7f4f3c153e60 2023-11-04T01:36:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.793+0000 7f4f41d89640 1 --2- 172.21.15.114:0/1241402121 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f3c153e60 0x7f4f3c15dec0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0097f0 tx=0x7f4f2c02b7d0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.792+0000 7f752e7fc640 1 -- 172.21.15.114:0/743585284 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520030710 con 0x7f7530164fe0 2023-11-04T01:36:53.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.792+0000 7f752e7fc640 1 -- 172.21.15.114:0/743585284 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752002e050 con 0x7f7530164fe0 2023-11-04T01:36:53.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.792+0000 7f752e7fc640 1 -- 172.21.15.114:0/743585284 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520030a90 con 0x7f7530164fe0 2023-11-04T01:36:53.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.794+0000 7f753621a640 1 -- 172.21.15.114:0/743585284 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7530164fe0 msgr2=0x7f753006b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.794+0000 7f753621a640 1 --2- 172.21.15.114:0/743585284 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7530164fe0 0x7f753006b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f75200097a0 tx=0x7f752002b710 comp rx=0 tx=0).stop 2023-11-04T01:36:53.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.794+0000 7f4f41d89640 1 -- 172.21.15.114:0/1241402121 shutdown_connections 2023-11-04T01:36:53.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.794+0000 7f4f41d89640 1 --2- 172.21.15.114:0/1241402121 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f3c153e60 0x7f4f3c15dec0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.794+0000 7f4f41d89640 1 -- 172.21.15.114:0/1241402121 >> 172.21.15.114:0/1241402121 conn(0x7f4f3c0cf880 msgr2=0x7f4f3c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.794+0000 7f753621a640 1 -- 172.21.15.114:0/743585284 shutdown_connections 2023-11-04T01:36:53.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.794+0000 7f753621a640 1 --2- 172.21.15.114:0/743585284 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7530164fe0 0x7f753006b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.794+0000 7f753621a640 1 --2- 172.21.15.114:0/743585284 >> v2:172.21.15.114:3300/0 conn(0x7f75300c4220 0x7f75300ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.794+0000 7f753621a640 1 -- 172.21.15.114:0/743585284 >> 172.21.15.114:0/743585284 conn(0x7f753006ea20 msgr2=0x7f753006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:53.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.794+0000 7f753621a640 1 -- 172.21.15.114:0/743585284 shutdown_connections 2023-11-04T01:36:53.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.794+0000 7f753621a640 1 -- 172.21.15.114:0/743585284 wait complete. 2023-11-04T01:36:53.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.795+0000 7f4f41d89640 1 -- 172.21.15.114:0/1241402121 shutdown_connections 2023-11-04T01:36:53.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.795+0000 7f4f41d89640 1 -- 172.21.15.114:0/1241402121 wait complete. 2023-11-04T01:36:53.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.796+0000 7f753621a640 1 Processor -- start 2023-11-04T01:36:53.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.796+0000 7f753621a640 1 -- start start 2023-11-04T01:36:53.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.798+0000 7f753621a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75300b2620 0x7f7530164230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.798+0000 7f753621a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75300c4220 0x7f7530151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.798+0000 7f753621a640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7530164fe0 0x7f75300c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.798+0000 7f753621a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7530152330 con 0x7f75300c4220 2023-11-04T01:36:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.798+0000 7f752effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75300c4220 0x7f7530151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.798+0000 7f753621a640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75301627c0 con 0x7f7530164fe0 2023-11-04T01:36:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.798+0000 7f753621a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7530162aa0 con 0x7f75300b2620 2023-11-04T01:36:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.798+0000 7f752effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75300c4220 0x7f7530151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49606/0 (socket says 172.21.15.114:49606) 2023-11-04T01:36:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.798+0000 7f752effd640 1 -- 172.21.15.114:0/3784350346 learned_addr learned my addr 172.21.15.114:0/3784350346 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.798+0000 7f752ffff640 1 --2- 172.21.15.114:0/3784350346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7530164fe0 0x7f75300c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.799+0000 7f752f7fe640 1 --2- 172.21.15.114:0/3784350346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75300b2620 0x7f7530164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.799+0000 7f752ffff640 1 -- 172.21.15.114:0/3784350346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75300b2620 msgr2=0x7f7530164230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.799+0000 7f752ffff640 1 --2- 172.21.15.114:0/3784350346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75300b2620 0x7f7530164230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.799+0000 7f752ffff640 1 -- 172.21.15.114:0/3784350346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75300c4220 msgr2=0x7f7530151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.799+0000 7f752ffff640 1 --2- 172.21.15.114:0/3784350346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75300c4220 0x7f7530151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.799+0000 7f752ffff640 1 -- 172.21.15.114:0/3784350346 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520009400 con 0x7f7530164fe0 2023-11-04T01:36:53.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.797+0000 7f4f41d89640 1 Processor -- start 2023-11-04T01:36:53.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.798+0000 7f4f41d89640 1 -- start start 2023-11-04T01:36:53.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.799+0000 7f4f41d89640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f3c0b4880 0x7f4f3c0cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.799+0000 7f4f41d89640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c0cd6d0 0x7f4f3c0c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.799+0000 7f4f41d89640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f3c153e60 0x7f4f3c0b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.799+0000 7f4f41d89640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c0b3860 con 0x7f4f3c0cd6d0 2023-11-04T01:36:53.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.799+0000 7f4f41d89640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c0b3b40 con 0x7f4f3c153e60 2023-11-04T01:36:53.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.799+0000 7f4f41d89640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c0b1f40 con 0x7f4f3c0b4880 2023-11-04T01:36:53.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.800+0000 7f4f3affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c0cd6d0 0x7f4f3c0c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.800+0000 7f4f3affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c0cd6d0 0x7f4f3c0c7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49608/0 (socket says 172.21.15.114:49608) 2023-11-04T01:36:53.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.800+0000 7f4f3affd640 1 -- 172.21.15.114:0/119720930 learned_addr learned my addr 172.21.15.114:0/119720930 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:53.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.800+0000 7f4f3affd640 1 -- 172.21.15.114:0/119720930 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f3c0b4880 msgr2=0x7f4f3c0cb930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:36:53.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.800+0000 7f4f3affd640 1 --2- 172.21.15.114:0/119720930 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f3c0b4880 0x7f4f3c0cb930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.800+0000 7f4f3affd640 1 -- 172.21.15.114:0/119720930 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f3c153e60 msgr2=0x7f4f3c0b2740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:36:53.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.800+0000 7f4f3affd640 1 --2- 172.21.15.114:0/119720930 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f3c153e60 0x7f4f3c0b2740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:53.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.800+0000 7f4f3affd640 1 -- 172.21.15.114:0/119720930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c0094d0 con 0x7f4f3c0cd6d0 2023-11-04T01:36:53.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.800+0000 7f4f3affd640 1 --2- 172.21.15.114:0/119720930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c0cd6d0 0x7f4f3c0c7540 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400c7a0 tx=0x7f4f3400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.801+0000 7f4f23fff640 1 -- 172.21.15.114:0/119720930 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34003b70 con 0x7f4f3c0cd6d0 2023-11-04T01:36:53.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.801+0000 7f4f41d89640 1 -- 172.21.15.114:0/119720930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3c0b2220 con 0x7f4f3c0cd6d0 2023-11-04T01:36:53.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.801+0000 7f4f41d89640 1 -- 172.21.15.114:0/119720930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c0cbe70 con 0x7f4f3c0cd6d0 2023-11-04T01:36:53.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.800+0000 7f752ffff640 1 --2- 172.21.15.114:0/3784350346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7530164fe0 0x7f75300c9c90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f752800cac0 tx=0x7f752800cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.800+0000 7f7517fff640 1 -- 172.21.15.114:0/3784350346 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752800a640 con 0x7f7530164fe0 2023-11-04T01:36:53.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.800+0000 7f753621a640 1 -- 172.21.15.114:0/3784350346 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7530162d80 con 0x7f7530164fe0 2023-11-04T01:36:53.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.800+0000 7f753621a640 1 -- 172.21.15.114:0/3784350346 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7530163340 con 0x7f7530164fe0 2023-11-04T01:36:53.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.800+0000 7f7517fff640 1 -- 172.21.15.114:0/3784350346 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752800a7a0 con 0x7f7530164fe0 2023-11-04T01:36:53.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.801+0000 7f7517fff640 1 -- 172.21.15.114:0/3784350346 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752800ab50 con 0x7f7530164fe0 2023-11-04T01:36:53.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.802+0000 7f4f23fff640 1 -- 172.21.15.114:0/119720930 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f34003cd0 con 0x7f4f3c0cd6d0 2023-11-04T01:36:53.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.802+0000 7f4f23fff640 1 -- 172.21.15.114:0/119720930 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400aa90 con 0x7f4f3c0cd6d0 2023-11-04T01:36:53.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.802+0000 7f753621a640 1 -- 172.21.15.114:0/3784350346 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7510005250 con 0x7f7530164fe0 2023-11-04T01:36:53.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.804+0000 7f7517fff640 1 -- 172.21.15.114:0/3784350346 <== mon.1 v2:172.21.15.141:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f75280070d0 con 0x7f7530164fe0 2023-11-04T01:36:53.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.804+0000 7f7517fff640 1 --2- 172.21.15.114:0/3784350346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f751c06af40 0x7f751c06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.804+0000 7f7517fff640 1 -- 172.21.15.114:0/3784350346 <== mon.1 v2:172.21.15.141:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7528089290 con 0x7f7530164fe0 2023-11-04T01:36:53.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.805+0000 7f4f23fff640 1 -- 172.21.15.114:0/119720930 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f3400abf0 con 0x7f4f3c0cd6d0 2023-11-04T01:36:53.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.805+0000 7f4f23fff640 1 --2- 172.21.15.114:0/119720930 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f2806af70 0x7f4f2806d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:53.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.805+0000 7f4f3b7fe640 1 --2- 172.21.15.114:0/119720930 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f2806af70 0x7f4f2806d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.806+0000 7f4f23fff640 1 -- 172.21.15.114:0/119720930 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4f340896d0 con 0x7f4f3c0cd6d0 2023-11-04T01:36:53.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.806+0000 7f752f7fe640 1 --2- 172.21.15.114:0/3784350346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f751c06af40 0x7f751c06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:53.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.806+0000 7f4f3b7fe640 1 --2- 172.21.15.114:0/119720930 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f2806af70 0x7f4f2806d430 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c035000 tx=0x7f4f2c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.806+0000 7f4f41d89640 1 -- 172.21.15.114:0/119720930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1c005250 con 0x7f4f3c0cd6d0 2023-11-04T01:36:53.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.807+0000 7f752f7fe640 1 --2- 172.21.15.114:0/3784350346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f751c06af40 0x7f751c06d400 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7524008850 tx=0x7f7524008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:53.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.809+0000 7f7517fff640 1 -- 172.21.15.114:0/3784350346 <== mon.1 v2:172.21.15.141:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7528054170 con 0x7f7530164fe0 2023-11-04T01:36:53.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:53.814+0000 7f4f23fff640 1 -- 172.21.15.114:0/119720930 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f34054500 con 0x7f4f3c0cd6d0 2023-11-04T01:36:54.044 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-11-04T01:36:54.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.042+0000 7efefaf0c640 1 -- 172.21.15.114:0/3388091221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efef40c6e00 con 0x7efef40c5370 2023-11-04T01:36:54.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.042+0000 7efef17fa640 1 -- 172.21.15.114:0/3388091221 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efee805af00 con 0x7efef40c5370 2023-11-04T01:36:54.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.046+0000 7efefaf0c640 1 -- 172.21.15.114:0/3388091221 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efee406b400 msgr2=0x7efee406d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.046+0000 7efefaf0c640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efee406b400 0x7efee406d8c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efee0035000 tx=0x7efee0009000 comp rx=0 tx=0).stop 2023-11-04T01:36:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.046+0000 7efefaf0c640 1 -- 172.21.15.114:0/3388091221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40c5370 msgr2=0x7efef41402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.046+0000 7efefaf0c640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40c5370 0x7efef41402e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efee8001a10 tx=0x7efee800a060 comp rx=0 tx=0).stop 2023-11-04T01:36:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.046+0000 7efefaf0c640 1 -- 172.21.15.114:0/3388091221 shutdown_connections 2023-11-04T01:36:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.046+0000 7efefaf0c640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efef415a1b0 0x7efef40b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.046+0000 7efefaf0c640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efee406b400 0x7efee406d8c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.046+0000 7efefaf0c640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efef41534a0 0x7efef414b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.046+0000 7efefaf0c640 1 --2- 172.21.15.114:0/3388091221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efef40c5370 0x7efef41402e0 secure :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efee8001a10 tx=0x7efee800a060 comp rx=0 tx=0).stop 2023-11-04T01:36:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.046+0000 7efefaf0c640 1 -- 172.21.15.114:0/3388091221 >> 172.21.15.114:0/3388091221 conn(0x7efef40ce950 msgr2=0x7efef40cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.047+0000 7efefaf0c640 1 -- 172.21.15.114:0/3388091221 shutdown_connections 2023-11-04T01:36:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.047+0000 7efefaf0c640 1 -- 172.21.15.114:0/3388091221 wait complete. 2023-11-04T01:36:54.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-11-04T01:36:54.065 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:54.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.078+0000 7fc3bb7ce640 1 -- 172.21.15.114:0/3100481285 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc3b406aa50 con 0x7fc3b406a120 2023-11-04T01:36:54.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.079+0000 7fc3a9ffb640 1 -- 172.21.15.114:0/3100481285 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc3ac04a070 con 0x7fc3b406a120 2023-11-04T01:36:54.081 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-11-04T01:36:54.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.081+0000 7fc3bb7ce640 1 -- 172.21.15.114:0/3100481285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc39806af40 msgr2=0x7fc39806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.081+0000 7fc3bb7ce640 1 --2- 172.21.15.114:0/3100481285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc39806af40 0x7fc39806d400 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40cb340 tx=0x7fc3b0009190 comp rx=0 tx=0).stop 2023-11-04T01:36:54.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.081+0000 7fc3bb7ce640 1 -- 172.21.15.114:0/3100481285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3b406a120 msgr2=0x7fc3b414ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.081+0000 7fc3bb7ce640 1 --2- 172.21.15.114:0/3100481285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3b406a120 0x7fc3b414ca80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac03d200 tx=0x7fc3ac002350 comp rx=0 tx=0).stop 2023-11-04T01:36:54.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.081+0000 7fc3bb7ce640 1 -- 172.21.15.114:0/3100481285 shutdown_connections 2023-11-04T01:36:54.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.081+0000 7fc3bb7ce640 1 --2- 172.21.15.114:0/3100481285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3b415cbf0 0x7fc3b415b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.081+0000 7fc3bb7ce640 1 --2- 172.21.15.114:0/3100481285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc39806af40 0x7fc39806d400 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.081+0000 7fc3bb7ce640 1 --2- 172.21.15.114:0/3100481285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3b406f280 0x7fc3b41573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.081+0000 7fc3bb7ce640 1 --2- 172.21.15.114:0/3100481285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3b406a120 0x7fc3b414ca80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.081+0000 7fc3bb7ce640 1 -- 172.21.15.114:0/3100481285 >> 172.21.15.114:0/3100481285 conn(0x7fc3b40cc100 msgr2=0x7fc3b415a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.081+0000 7fc3bb7ce640 1 -- 172.21.15.114:0/3100481285 shutdown_connections 2023-11-04T01:36:54.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.081+0000 7fc3bb7ce640 1 -- 172.21.15.114:0/3100481285 wait complete. 2023-11-04T01:36:54.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2023-11-04T01:36:54.094 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:54.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.098+0000 7f9e61ffb640 1 -- 172.21.15.114:0/2225508850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9e7c074290 con 0x7f9e7c0cbcc0 2023-11-04T01:36:54.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.098+0000 7f9e63fff640 1 -- 172.21.15.114:0/2225508850 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9e6c057d80 con 0x7f9e7c0cbcc0 2023-11-04T01:36:54.100 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-11-04T01:36:54.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.101+0000 7f9e61ffb640 1 -- 172.21.15.114:0/2225508850 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9e6806af70 msgr2=0x7f9e6806d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.101+0000 7f9e61ffb640 1 --2- 172.21.15.114:0/2225508850 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9e6806af70 0x7f9e6806d430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c164d80 tx=0x7f9e70007950 comp rx=0 tx=0).stop 2023-11-04T01:36:54.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.101+0000 7f9e61ffb640 1 -- 172.21.15.114:0/2225508850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e7c0cbcc0 msgr2=0x7f9e7c0c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.101+0000 7f9e61ffb640 1 --2- 172.21.15.114:0/2225508850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e7c0cbcc0 0x7f9e7c0c84d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c00ebb0 tx=0x7f9e6c00c520 comp rx=0 tx=0).stop 2023-11-04T01:36:54.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.101+0000 7f9e61ffb640 1 -- 172.21.15.114:0/2225508850 shutdown_connections 2023-11-04T01:36:54.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.101+0000 7f9e61ffb640 1 --2- 172.21.15.114:0/2225508850 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9e6806af70 0x7f9e6806d430 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.101+0000 7f9e61ffb640 1 --2- 172.21.15.114:0/2225508850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9e7c164db0 0x7f9e7c13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.101+0000 7f9e61ffb640 1 --2- 172.21.15.114:0/2225508850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e7c14a6a0 0x7f9e7c0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.101+0000 7f9e61ffb640 1 --2- 172.21.15.114:0/2225508850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e7c0cbcc0 0x7f9e7c0c84d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.101+0000 7f9e61ffb640 1 -- 172.21.15.114:0/2225508850 >> 172.21.15.114:0/2225508850 conn(0x7f9e7c06a120 msgr2=0x7f9e7c0cdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.101+0000 7f9e61ffb640 1 -- 172.21.15.114:0/2225508850 shutdown_connections 2023-11-04T01:36:54.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.101+0000 7f9e61ffb640 1 -- 172.21.15.114:0/2225508850 wait complete. 2023-11-04T01:36:54.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-11-04T01:36:54.118 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:54.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.131+0000 7f8635264640 1 -- 172.21.15.114:0/2248868352 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8628005790 con 0x7f8628054200 2023-11-04T01:36:54.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.132+0000 7f86177fe640 1 -- 172.21.15.114:0/2248868352 <== mon.2 v2:172.21.15.141:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8624017090 con 0x7f8628054200 2023-11-04T01:36:54.134 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2023-11-04T01:36:54.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.134+0000 7f8635264640 1 -- 172.21.15.114:0/2248868352 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f861c06af70 msgr2=0x7f861c06d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.134+0000 7f8635264640 1 --2- 172.21.15.114:0/2248868352 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f861c06af70 0x7f861c06d430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8620038000 tx=0x7f8620032000 comp rx=0 tx=0).stop 2023-11-04T01:36:54.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.134+0000 7f8635264640 1 -- 172.21.15.114:0/2248868352 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8628054200 msgr2=0x7f862804efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.134+0000 7f8635264640 1 --2- 172.21.15.114:0/2248868352 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8628054200 0x7f862804efa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f862400e7f0 tx=0x7f862400ecb0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.134+0000 7f8635264640 1 -- 172.21.15.114:0/2248868352 shutdown_connections 2023-11-04T01:36:54.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.134+0000 7f8635264640 1 --2- 172.21.15.114:0/2248868352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86280d7610 0x7f86280e2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.134+0000 7f8635264640 1 --2- 172.21.15.114:0/2248868352 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f861c06af70 0x7f861c06d430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.134+0000 7f8635264640 1 --2- 172.21.15.114:0/2248868352 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86280dff00 0x7f86280e0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.134+0000 7f8635264640 1 --2- 172.21.15.114:0/2248868352 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8628054200 0x7f862804efa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.134+0000 7f8635264640 1 -- 172.21.15.114:0/2248868352 >> 172.21.15.114:0/2248868352 conn(0x7f8628055c10 msgr2=0x7f862803a420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.134+0000 7f8635264640 1 -- 172.21.15.114:0/2248868352 shutdown_connections 2023-11-04T01:36:54.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.134+0000 7f8635264640 1 -- 172.21.15.114:0/2248868352 wait complete. 2023-11-04T01:36:54.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2023-11-04T01:36:54.147 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:54.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.172+0000 7f44feffd640 1 -- 172.21.15.114:0/2456890219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f45140b32a0 con 0x7f45141f1af0 2023-11-04T01:36:54.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.172+0000 7f45117fa640 1 -- 172.21.15.114:0/2456890219 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4508058400 con 0x7f45141f1af0 2023-11-04T01:36:54.175 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-11-04T01:36:54.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.174+0000 7fa9572d1640 1 -- 172.21.15.114:0/2103214756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa948052bf0 con 0x7fa948033eb0 2023-11-04T01:36:54.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.174+0000 7fa946ffd640 1 -- 172.21.15.114:0/2103214756 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9400579a0 con 0x7fa948033eb0 2023-11-04T01:36:54.176 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2023-11-04T01:36:54.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.175+0000 7f44feffd640 1 -- 172.21.15.114:0/2456890219 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44f806aec0 msgr2=0x7f44f806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.175+0000 7f44feffd640 1 --2- 172.21.15.114:0/2456890219 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44f806aec0 0x7f44f806d380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f45141554f0 tx=0x7f4500009240 comp rx=0 tx=0).stop 2023-11-04T01:36:54.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.175+0000 7f44feffd640 1 -- 172.21.15.114:0/2456890219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45141f1af0 msgr2=0x7f45141eef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.175+0000 7f44feffd640 1 --2- 172.21.15.114:0/2456890219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45141f1af0 0x7f45141eef80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f45080106f0 tx=0x7f4508010bb0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.175+0000 7f44feffd640 1 -- 172.21.15.114:0/2456890219 shutdown_connections 2023-11-04T01:36:54.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.175+0000 7f44feffd640 1 --2- 172.21.15.114:0/2456890219 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44f806aec0 0x7f44f806d380 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.175+0000 7f44feffd640 1 --2- 172.21.15.114:0/2456890219 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45141e3180 0x7f4514157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.175+0000 7f44feffd640 1 --2- 172.21.15.114:0/2456890219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45141f1af0 0x7f45141eef80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.175+0000 7f44feffd640 1 --2- 172.21.15.114:0/2456890219 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4504005180 0x7f451414c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.175+0000 7f44feffd640 1 -- 172.21.15.114:0/2456890219 >> 172.21.15.114:0/2456890219 conn(0x7f45140cf050 msgr2=0x7f45140cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.175+0000 7f44feffd640 1 -- 172.21.15.114:0/2456890219 shutdown_connections 2023-11-04T01:36:54.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.175+0000 7f44feffd640 1 -- 172.21.15.114:0/2456890219 wait complete. 2023-11-04T01:36:54.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.177+0000 7fa9572d1640 1 -- 172.21.15.114:0/2103214756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa93406ae70 msgr2=0x7fa93406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.177+0000 7fa9572d1640 1 --2- 172.21.15.114:0/2103214756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa93406ae70 0x7fa93406d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa94c03a000 tx=0x7fa94c034000 comp rx=0 tx=0).stop 2023-11-04T01:36:54.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.177+0000 7fa9572d1640 1 -- 172.21.15.114:0/2103214756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa948033eb0 msgr2=0x7fa948035d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.177+0000 7fa9572d1640 1 --2- 172.21.15.114:0/2103214756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa948033eb0 0x7fa948035d50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa94000c780 tx=0x7fa94000cc40 comp rx=0 tx=0).stop 2023-11-04T01:36:54.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.177+0000 7fa9572d1640 1 -- 172.21.15.114:0/2103214756 shutdown_connections 2023-11-04T01:36:54.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.177+0000 7fa9572d1640 1 --2- 172.21.15.114:0/2103214756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa93406ae70 0x7fa93406d330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.177+0000 7fa9572d1640 1 --2- 172.21.15.114:0/2103214756 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa948050120 0x7fa9480db640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.177+0000 7fa9572d1640 1 --2- 172.21.15.114:0/2103214756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa948033eb0 0x7fa948035d50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.177+0000 7fa9572d1640 1 --2- 172.21.15.114:0/2103214756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa948007090 0x7fa948035810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.177+0000 7fa9572d1640 1 -- 172.21.15.114:0/2103214756 >> 172.21.15.114:0/2103214756 conn(0x7fa948054b00 msgr2=0x7fa948004bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.177+0000 7fa9572d1640 1 -- 172.21.15.114:0/2103214756 shutdown_connections 2023-11-04T01:36:54.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.177+0000 7fa9572d1640 1 -- 172.21.15.114:0/2103214756 wait complete. 2023-11-04T01:36:54.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2023-11-04T01:36:54.193 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:54.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2023-11-04T01:36:54.193 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:54.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.212+0000 7f753621a640 1 -- 172.21.15.114:0/3784350346 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7510005500 con 0x7f7530164fe0 2023-11-04T01:36:54.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.213+0000 7f7517fff640 1 -- 172.21.15.114:0/3784350346 <== mon.1 v2:172.21.15.141:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f752800acb0 con 0x7f7530164fe0 2023-11-04T01:36:54.214 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2023-11-04T01:36:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.215+0000 7f753621a640 1 -- 172.21.15.114:0/3784350346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f751c06af40 msgr2=0x7f751c06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.215+0000 7f753621a640 1 --2- 172.21.15.114:0/3784350346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f751c06af40 0x7f751c06d400 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7524008850 tx=0x7f7524008040 comp rx=0 tx=0).stop 2023-11-04T01:36:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.215+0000 7f753621a640 1 -- 172.21.15.114:0/3784350346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7530164fe0 msgr2=0x7f75300c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.215+0000 7f753621a640 1 --2- 172.21.15.114:0/3784350346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7530164fe0 0x7f75300c9c90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f752800cac0 tx=0x7f752800cf80 comp rx=0 tx=0).stop 2023-11-04T01:36:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.216+0000 7f753621a640 1 -- 172.21.15.114:0/3784350346 shutdown_connections 2023-11-04T01:36:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.216+0000 7f753621a640 1 --2- 172.21.15.114:0/3784350346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f751c06af40 0x7f751c06d400 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.216+0000 7f753621a640 1 --2- 172.21.15.114:0/3784350346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7530164fe0 0x7f75300c9c90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.216+0000 7f753621a640 1 --2- 172.21.15.114:0/3784350346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75300c4220 0x7f7530151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.216+0000 7f753621a640 1 --2- 172.21.15.114:0/3784350346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75300b2620 0x7f7530164230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.216+0000 7f753621a640 1 -- 172.21.15.114:0/3784350346 >> 172.21.15.114:0/3784350346 conn(0x7f753006ea20 msgr2=0x7f75300b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.216+0000 7f753621a640 1 -- 172.21.15.114:0/3784350346 shutdown_connections 2023-11-04T01:36:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.216+0000 7f753621a640 1 -- 172.21.15.114:0/3784350346 wait complete. 2023-11-04T01:36:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.219+0000 7f4f41d89640 1 -- 172.21.15.114:0/119720930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4f1c005500 con 0x7f4f3c0cd6d0 2023-11-04T01:36:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.219+0000 7f4f23fff640 1 -- 172.21.15.114:0/119720930 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f34057b20 con 0x7f4f3c0cd6d0 2023-11-04T01:36:54.222 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-11-04T01:36:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.223+0000 7f4f41d89640 1 -- 172.21.15.114:0/119720930 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f2806af70 msgr2=0x7f4f2806d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.223+0000 7f4f41d89640 1 --2- 172.21.15.114:0/119720930 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f2806af70 0x7f4f2806d430 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c035000 tx=0x7f4f2c008030 comp rx=0 tx=0).stop 2023-11-04T01:36:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.223+0000 7f4f41d89640 1 -- 172.21.15.114:0/119720930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c0cd6d0 msgr2=0x7f4f3c0c7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.223+0000 7f4f41d89640 1 --2- 172.21.15.114:0/119720930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c0cd6d0 0x7f4f3c0c7540 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400c7a0 tx=0x7f4f3400cc60 comp rx=0 tx=0).stop 2023-11-04T01:36:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.223+0000 7f4f41d89640 1 -- 172.21.15.114:0/119720930 shutdown_connections 2023-11-04T01:36:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.223+0000 7f4f41d89640 1 --2- 172.21.15.114:0/119720930 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f2806af70 0x7f4f2806d430 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.223+0000 7f4f41d89640 1 --2- 172.21.15.114:0/119720930 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f3c153e60 0x7f4f3c0b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.223+0000 7f4f41d89640 1 --2- 172.21.15.114:0/119720930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c0cd6d0 0x7f4f3c0c7540 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.223+0000 7f4f41d89640 1 --2- 172.21.15.114:0/119720930 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f3c0b4880 0x7f4f3c0cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.223+0000 7f4f41d89640 1 -- 172.21.15.114:0/119720930 >> 172.21.15.114:0/119720930 conn(0x7f4f3c0cf880 msgr2=0x7f4f3c15e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.223+0000 7f4f41d89640 1 -- 172.21.15.114:0/119720930 shutdown_connections 2023-11-04T01:36:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.223+0000 7f4f41d89640 1 -- 172.21.15.114:0/119720930 wait complete. 2023-11-04T01:36:54.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2023-11-04T01:36:54.232 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:54.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2023-11-04T01:36:54.237 DEBUG:teuthology.parallel:result is None 2023-11-04T01:36:54.237 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-04T01:36:54.237 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:36:54.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.375+0000 7f8d70e44640 1 Processor -- start 2023-11-04T01:36:54.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.375+0000 7f8d70e44640 1 -- start start 2023-11-04T01:36:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.376+0000 7f8d70e44640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8d6c15ce60 0x7f8d6c06b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.376+0000 7f8d70e44640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8d6c0cf160 0x7f8d6c0cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.376+0000 7f8d70e44640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6c1615d0 con 0x7f8d6c06bd30 2023-11-04T01:36:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.376+0000 7f8d70e44640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6c0cbde0 con 0x7f8d6c0cf160 2023-11-04T01:36:54.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.376+0000 7f8d70e44640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c0cfb50 con 0x7f8d6c15ce60 2023-11-04T01:36:54.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.376+0000 7f8d6ad9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8d6c0cf160 0x7f8d6c0cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.376+0000 7f8d6ad9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8d6c0cf160 0x7f8d6c0cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49610/0 (socket says 172.21.15.114:49610) 2023-11-04T01:36:54.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.376+0000 7f8d6ad9d640 1 -- 172.21.15.114:0/936742805 learned_addr learned my addr 172.21.15.114:0/936742805 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:54.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.376+0000 7f8d6a59c640 1 --2- 172.21.15.114:0/936742805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8d6c15ce60 0x7f8d6c06b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.376+0000 7f8d6ad9d640 1 -- 172.21.15.114:0/936742805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8d6c15ce60 msgr2=0x7f8d6c06b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:54.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.376+0000 7f8d6ad9d640 1 --2- 172.21.15.114:0/936742805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8d6c15ce60 0x7f8d6c06b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.376+0000 7f8d6ad9d640 1 -- 172.21.15.114:0/936742805 >> v1:172.21.15.114:6789/0 conn(0x7f8d6c06bd30 legacy=0x7f8d6c160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.376+0000 7f8d6ad9d640 1 -- 172.21.15.114:0/936742805 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c1618b0 con 0x7f8d6c0cf160 2023-11-04T01:36:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.377+0000 7f8d6ad9d640 1 --2- 172.21.15.114:0/936742805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d6c0cf160 0x7f8d6c0cf610 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009e50 tx=0x7f8d6402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0d52f4614fb72 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.377+0000 7f8d6959a640 1 -- 172.21.15.114:0/936742805 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6402cb00 con 0x7f8d6c0cf160 2023-11-04T01:36:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.377+0000 7f8d6959a640 1 -- 172.21.15.114:0/936742805 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6402cc60 con 0x7f8d6c0cf160 2023-11-04T01:36:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.377+0000 7f8d6959a640 1 -- 172.21.15.114:0/936742805 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d640343f0 con 0x7f8d6c0cf160 2023-11-04T01:36:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.378+0000 7f8d70e44640 1 -- 172.21.15.114:0/936742805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d6c0cf160 msgr2=0x7f8d6c0cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.378+0000 7f8d70e44640 1 --2- 172.21.15.114:0/936742805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d6c0cf160 0x7f8d6c0cf610 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009e50 tx=0x7f8d6402bf60 comp rx=0 tx=0).stop 2023-11-04T01:36:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.378+0000 7f8d70e44640 1 -- 172.21.15.114:0/936742805 shutdown_connections 2023-11-04T01:36:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.378+0000 7f8d70e44640 1 --2- 172.21.15.114:0/936742805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d6c0cf160 0x7f8d6c0cf610 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.378+0000 7f8d70e44640 1 --2- 172.21.15.114:0/936742805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8d6c15ce60 0x7f8d6c06b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.378+0000 7f8d70e44640 1 -- 172.21.15.114:0/936742805 >> 172.21.15.114:0/936742805 conn(0x7f8d6c06ea90 msgr2=0x7f8d6c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.378+0000 7f8d70e44640 1 -- 172.21.15.114:0/936742805 shutdown_connections 2023-11-04T01:36:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.378+0000 7f8d70e44640 1 -- 172.21.15.114:0/936742805 wait complete. 2023-11-04T01:36:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.379+0000 7f8d70e44640 1 Processor -- start 2023-11-04T01:36:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.379+0000 7f8d70e44640 1 -- start start 2023-11-04T01:36:54.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d70e44640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d6c0cf160 0x7f8d6c14f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d70e44640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8d6c15ce60 0x7f8d6c15fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d70e44640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8d6c14f9d0 0x7f8d6c1f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d70e44640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c1f6cf0 con 0x7f8d6c0cf160 2023-11-04T01:36:54.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d70e44640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c14c8a0 con 0x7f8d6c14f9d0 2023-11-04T01:36:54.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d70e44640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c14cf30 con 0x7f8d6c15ce60 2023-11-04T01:36:54.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d6a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d6c0cf160 0x7f8d6c14f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d6a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d6c0cf160 0x7f8d6c14f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49620/0 (socket says 172.21.15.114:49620) 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d6a59c640 1 -- 172.21.15.114:0/1019396624 learned_addr learned my addr 172.21.15.114:0/1019396624 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d69d9b640 1 --2- 172.21.15.114:0/1019396624 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8d6c15ce60 0x7f8d6c15fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d6ad9d640 1 --2- 172.21.15.114:0/1019396624 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8d6c14f9d0 0x7f8d6c1f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d6a59c640 1 -- 172.21.15.114:0/1019396624 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8d6c15ce60 msgr2=0x7f8d6c15fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d6a59c640 1 --2- 172.21.15.114:0/1019396624 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8d6c15ce60 0x7f8d6c15fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d6a59c640 1 -- 172.21.15.114:0/1019396624 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8d6c14f9d0 msgr2=0x7f8d6c1f5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d6a59c640 1 --2- 172.21.15.114:0/1019396624 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8d6c14f9d0 0x7f8d6c1f5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d6a59c640 1 -- 172.21.15.114:0/1019396624 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d64009b30 con 0x7f8d6c0cf160 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d6a59c640 1 --2- 172.21.15.114:0/1019396624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d6c0cf160 0x7f8d6c14f370 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00d5f0 tx=0x7f8d5c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d5affd640 1 -- 172.21.15.114:0/1019396624 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c0125f0 con 0x7f8d6c0cf160 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d5affd640 1 -- 172.21.15.114:0/1019396624 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c012750 con 0x7f8d6c0cf160 2023-11-04T01:36:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.380+0000 7f8d70e44640 1 -- 172.21.15.114:0/1019396624 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6c14d210 con 0x7f8d6c0cf160 2023-11-04T01:36:54.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.381+0000 7f8d5affd640 1 -- 172.21.15.114:0/1019396624 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c012b00 con 0x7f8d6c0cf160 2023-11-04T01:36:54.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.381+0000 7f8d70e44640 1 -- 172.21.15.114:0/1019396624 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6c14d7d0 con 0x7f8d6c0cf160 2023-11-04T01:36:54.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.381+0000 7f8d70e44640 1 -- 172.21.15.114:0/1019396624 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d6c14d990 con 0x7f8d6c0cf160 2023-11-04T01:36:54.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.382+0000 7f8d5affd640 1 -- 172.21.15.114:0/1019396624 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d5c012c60 con 0x7f8d6c0cf160 2023-11-04T01:36:54.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.382+0000 7f8d5affd640 1 --2- 172.21.15.114:0/1019396624 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8d4c06ae70 0x7f8d4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.382+0000 7f8d69d9b640 1 --2- 172.21.15.114:0/1019396624 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8d4c06ae70 0x7f8d4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.382+0000 7f8d5affd640 1 -- 172.21.15.114:0/1019396624 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8d5c089dd0 con 0x7f8d6c0cf160 2023-11-04T01:36:54.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.383+0000 7f8d69d9b640 1 --2- 172.21.15.114:0/1019396624 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8d4c06ae70 0x7f8d4c06d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8d60000f60 tx=0x7f8d60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.387+0000 7f8d5affd640 1 -- 172.21.15.114:0/1019396624 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d5c054b90 con 0x7f8d6c0cf160 2023-11-04T01:36:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.549+0000 7f8d70e44640 1 -- 172.21.15.114:0/1019396624 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d6c0ce970 con 0x7f8d4c06ae70 2023-11-04T01:36:54.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.559+0000 7f8d5affd640 1 -- 172.21.15.114:0/1019396624 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345257 (secure 0 0 0) 0x7f8d60001390 con 0x7f8d4c06ae70 2023-11-04T01:36:54.566 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:54.568 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:36:54.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.562+0000 7f8d70e44640 1 -- 172.21.15.114:0/1019396624 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8d4c06ae70 msgr2=0x7f8d4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.562+0000 7f8d70e44640 1 --2- 172.21.15.114:0/1019396624 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8d4c06ae70 0x7f8d4c06d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8d60000f60 tx=0x7f8d60009040 comp rx=0 tx=0).stop 2023-11-04T01:36:54.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.562+0000 7f8d70e44640 1 -- 172.21.15.114:0/1019396624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d6c0cf160 msgr2=0x7f8d6c14f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.562+0000 7f8d70e44640 1 --2- 172.21.15.114:0/1019396624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d6c0cf160 0x7f8d6c14f370 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00d5f0 tx=0x7f8d5c00dab0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.562+0000 7f8d70e44640 1 -- 172.21.15.114:0/1019396624 shutdown_connections 2023-11-04T01:36:54.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.562+0000 7f8d70e44640 1 --2- 172.21.15.114:0/1019396624 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8d4c06ae70 0x7f8d4c06d330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.562+0000 7f8d70e44640 1 --2- 172.21.15.114:0/1019396624 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8d6c14f9d0 0x7f8d6c1f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.562+0000 7f8d70e44640 1 --2- 172.21.15.114:0/1019396624 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8d6c15ce60 0x7f8d6c15fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.562+0000 7f8d70e44640 1 --2- 172.21.15.114:0/1019396624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d6c0cf160 0x7f8d6c14f370 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.562+0000 7f8d70e44640 1 -- 172.21.15.114:0/1019396624 >> 172.21.15.114:0/1019396624 conn(0x7f8d6c06ea90 msgr2=0x7f8d6c06c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.563+0000 7f8d70e44640 1 -- 172.21.15.114:0/1019396624 shutdown_connections 2023-11-04T01:36:54.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.563+0000 7f8d70e44640 1 -- 172.21.15.114:0/1019396624 wait complete. 2023-11-04T01:36:54.576 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-11-04T01:36:53.862728+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1988350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002521"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601943+0000","last_change":"2023-11-04T01:36:29.561242+0000","last_active":"2023-11-04T01:36:34.601943+0000","last_peered":"2023-11-04T01:36:34.601943+0000","last_clean":"2023-11-04T01:36:34.601943+0000","last_became_active":"2023-11-04T01:36:29.560999+0000","last_became_peered":"2023-11-04T01:36:29.560999+0000","last_unstale":"2023-11-04T01:36:34.601943+0000","last_undegraded":"2023-11-04T01:36:34.601943+0000","last_fullsized":"2023-11-04T01:36:34.601943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:24.009190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591589+0000","last_change":"2023-11-04T01:36:30.553781+0000","last_active":"2023-11-04T01:36:34.591589+0000","last_peered":"2023-11-04T01:36:34.591589+0000","last_clean":"2023-11-04T01:36:34.591589+0000","last_became_active":"2023-11-04T01:36:30.553037+0000","last_became_peered":"2023-11-04T01:36:30.553037+0000","last_unstale":"2023-11-04T01:36:34.591589+0000","last_undegraded":"2023-11-04T01:36:34.591589+0000","last_fullsized":"2023-11-04T01:36:34.591589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:12.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597204+0000","last_change":"2023-11-04T01:36:34.756965+0000","last_active":"2023-11-04T01:36:35.597204+0000","last_peered":"2023-11-04T01:36:35.597204+0000","last_clean":"2023-11-04T01:36:35.597204+0000","last_became_active":"2023-11-04T01:36:34.756574+0000","last_became_peered":"2023-11-04T01:36:34.756574+0000","last_unstale":"2023-11-04T01:36:35.597204+0000","last_undegraded":"2023-11-04T01:36:35.597204+0000","last_fullsized":"2023-11-04T01:36:35.597204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:51.521044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591774+0000","last_change":"2023-11-04T01:36:29.560879+0000","last_active":"2023-11-04T01:36:34.591774+0000","last_peered":"2023-11-04T01:36:34.591774+0000","last_clean":"2023-11-04T01:36:34.591774+0000","last_became_active":"2023-11-04T01:36:29.560620+0000","last_became_peered":"2023-11-04T01:36:29.560620+0000","last_unstale":"2023-11-04T01:36:34.591774+0000","last_undegraded":"2023-11-04T01:36:34.591774+0000","last_fullsized":"2023-11-04T01:36:34.591774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:46:08.796108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601678+0000","last_change":"2023-11-04T01:36:30.557037+0000","last_active":"2023-11-04T01:36:34.601678+0000","last_peered":"2023-11-04T01:36:34.601678+0000","last_clean":"2023-11-04T01:36:34.601678+0000","last_became_active":"2023-11-04T01:36:30.556650+0000","last_became_peered":"2023-11-04T01:36:30.556650+0000","last_unstale":"2023-11-04T01:36:34.601678+0000","last_undegraded":"2023-11-04T01:36:34.601678+0000","last_fullsized":"2023-11-04T01:36:34.601678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539725+0000","last_change":"2023-11-04T01:36:34.610121+0000","last_active":"2023-11-04T01:36:35.539725+0000","last_peered":"2023-11-04T01:36:35.539725+0000","last_clean":"2023-11-04T01:36:35.539725+0000","last_became_active":"2023-11-04T01:36:34.609174+0000","last_became_peered":"2023-11-04T01:36:34.609174+0000","last_unstale":"2023-11-04T01:36:35.539725+0000","last_undegraded":"2023-11-04T01:36:35.539725+0000","last_fullsized":"2023-11-04T01:36:35.539725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:26:28.949242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752732+0000","last_change":"2023-11-04T01:36:29.568730+0000","last_active":"2023-11-04T01:36:34.752732+0000","last_peered":"2023-11-04T01:36:34.752732+0000","last_clean":"2023-11-04T01:36:34.752732+0000","last_became_active":"2023-11-04T01:36:29.568238+0000","last_became_peered":"2023-11-04T01:36:29.568238+0000","last_unstale":"2023-11-04T01:36:34.752732+0000","last_undegraded":"2023-11-04T01:36:34.752732+0000","last_fullsized":"2023-11-04T01:36:34.752732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:35.972647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600781+0000","last_change":"2023-11-04T01:36:30.555874+0000","last_active":"2023-11-04T01:36:34.600781+0000","last_peered":"2023-11-04T01:36:34.600781+0000","last_clean":"2023-11-04T01:36:34.600781+0000","last_became_active":"2023-11-04T01:36:30.555047+0000","last_became_peered":"2023-11-04T01:36:30.555047+0000","last_unstale":"2023-11-04T01:36:34.600781+0000","last_undegraded":"2023-11-04T01:36:34.600781+0000","last_fullsized":"2023-11-04T01:36:34.600781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:14.190359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540452+0000","last_change":"2023-11-04T01:36:34.609278+0000","last_active":"2023-11-04T01:36:35.540452+0000","last_peered":"2023-11-04T01:36:35.540452+0000","last_clean":"2023-11-04T01:36:35.540452+0000","last_became_active":"2023-11-04T01:36:34.608869+0000","last_became_peered":"2023-11-04T01:36:34.608869+0000","last_unstale":"2023-11-04T01:36:35.540452+0000","last_undegraded":"2023-11-04T01:36:35.540452+0000","last_fullsized":"2023-11-04T01:36:35.540452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:31.223962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752371+0000","last_change":"2023-11-04T01:36:29.566622+0000","last_active":"2023-11-04T01:36:34.752371+0000","last_peered":"2023-11-04T01:36:34.752371+0000","last_clean":"2023-11-04T01:36:34.752371+0000","last_became_active":"2023-11-04T01:36:29.566344+0000","last_became_peered":"2023-11-04T01:36:29.566344+0000","last_unstale":"2023-11-04T01:36:34.752371+0000","last_undegraded":"2023-11-04T01:36:34.752371+0000","last_fullsized":"2023-11-04T01:36:34.752371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:28.954776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600963+0000","last_change":"2023-11-04T01:36:30.555732+0000","last_active":"2023-11-04T01:36:34.600963+0000","last_peered":"2023-11-04T01:36:34.600963+0000","last_clean":"2023-11-04T01:36:34.600963+0000","last_became_active":"2023-11-04T01:36:30.555435+0000","last_became_peered":"2023-11-04T01:36:30.555435+0000","last_unstale":"2023-11-04T01:36:34.600963+0000","last_undegraded":"2023-11-04T01:36:34.600963+0000","last_fullsized":"2023-11-04T01:36:34.600963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:24.536087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539719+0000","last_change":"2023-11-04T01:36:34.610431+0000","last_active":"2023-11-04T01:36:35.539719+0000","last_peered":"2023-11-04T01:36:35.539719+0000","last_clean":"2023-11-04T01:36:35.539719+0000","last_became_active":"2023-11-04T01:36:34.609116+0000","last_became_peered":"2023-11-04T01:36:34.609116+0000","last_unstale":"2023-11-04T01:36:35.539719+0000","last_undegraded":"2023-11-04T01:36:35.539719+0000","last_fullsized":"2023-11-04T01:36:35.539719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:19.082626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592957+0000","last_change":"2023-11-04T01:36:30.552617+0000","last_active":"2023-11-04T01:36:34.592957+0000","last_peered":"2023-11-04T01:36:34.592957+0000","last_clean":"2023-11-04T01:36:34.592957+0000","last_became_active":"2023-11-04T01:36:30.552315+0000","last_became_peered":"2023-11-04T01:36:30.552315+0000","last_unstale":"2023-11-04T01:36:34.592957+0000","last_undegraded":"2023-11-04T01:36:34.592957+0000","last_fullsized":"2023-11-04T01:36:34.592957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:10.369120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752388+0000","last_change":"2023-11-04T01:36:29.568663+0000","last_active":"2023-11-04T01:36:34.752388+0000","last_peered":"2023-11-04T01:36:34.752388+0000","last_clean":"2023-11-04T01:36:34.752388+0000","last_became_active":"2023-11-04T01:36:29.568262+0000","last_became_peered":"2023-11-04T01:36:29.568262+0000","last_unstale":"2023-11-04T01:36:34.752388+0000","last_undegraded":"2023-11-04T01:36:34.752388+0000","last_fullsized":"2023-11-04T01:36:34.752388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:11.541445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540192+0000","last_change":"2023-11-04T01:36:34.607200+0000","last_active":"2023-11-04T01:36:35.540192+0000","last_peered":"2023-11-04T01:36:35.540192+0000","last_clean":"2023-11-04T01:36:35.540192+0000","last_became_active":"2023-11-04T01:36:34.606762+0000","last_became_peered":"2023-11-04T01:36:34.606762+0000","last_unstale":"2023-11-04T01:36:35.540192+0000","last_undegraded":"2023-11-04T01:36:35.540192+0000","last_fullsized":"2023-11-04T01:36:35.540192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:54.343995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591387+0000","last_change":"2023-11-04T01:36:30.555385+0000","last_active":"2023-11-04T01:36:34.591387+0000","last_peered":"2023-11-04T01:36:34.591387+0000","last_clean":"2023-11-04T01:36:34.591387+0000","last_became_active":"2023-11-04T01:36:30.555109+0000","last_became_peered":"2023-11-04T01:36:30.555109+0000","last_unstale":"2023-11-04T01:36:34.591387+0000","last_undegraded":"2023-11-04T01:36:34.591387+0000","last_fullsized":"2023-11-04T01:36:34.591387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:26:24.912249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597945+0000","last_change":"2023-11-04T01:36:29.568618+0000","last_active":"2023-11-04T01:36:34.597945+0000","last_peered":"2023-11-04T01:36:34.597945+0000","last_clean":"2023-11-04T01:36:34.597945+0000","last_became_active":"2023-11-04T01:36:29.568318+0000","last_became_peered":"2023-11-04T01:36:29.568318+0000","last_unstale":"2023-11-04T01:36:34.597945+0000","last_undegraded":"2023-11-04T01:36:34.597945+0000","last_fullsized":"2023-11-04T01:36:34.597945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:55.902083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540096+0000","last_change":"2023-11-04T01:36:34.609429+0000","last_active":"2023-11-04T01:36:35.540096+0000","last_peered":"2023-11-04T01:36:35.540096+0000","last_clean":"2023-11-04T01:36:35.540096+0000","last_became_active":"2023-11-04T01:36:34.608964+0000","last_became_peered":"2023-11-04T01:36:34.608964+0000","last_unstale":"2023-11-04T01:36:35.540096+0000","last_undegraded":"2023-11-04T01:36:35.540096+0000","last_fullsized":"2023-11-04T01:36:35.540096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:18.227352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591308+0000","last_change":"2023-11-04T01:36:30.548722+0000","last_active":"2023-11-04T01:36:34.591308+0000","last_peered":"2023-11-04T01:36:34.591308+0000","last_clean":"2023-11-04T01:36:34.591308+0000","last_became_active":"2023-11-04T01:36:30.548380+0000","last_became_peered":"2023-11-04T01:36:30.548380+0000","last_unstale":"2023-11-04T01:36:34.591308+0000","last_undegraded":"2023-11-04T01:36:34.591308+0000","last_fullsized":"2023-11-04T01:36:34.591308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:10.369120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597698+0000","last_change":"2023-11-04T01:36:29.563976+0000","last_active":"2023-11-04T01:36:34.597698+0000","last_peered":"2023-11-04T01:36:34.597698+0000","last_clean":"2023-11-04T01:36:34.597698+0000","last_became_active":"2023-11-04T01:36:29.563703+0000","last_became_peered":"2023-11-04T01:36:29.563703+0000","last_unstale":"2023-11-04T01:36:34.597698+0000","last_undegraded":"2023-11-04T01:36:34.597698+0000","last_fullsized":"2023-11-04T01:36:34.597698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:19.388284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597228+0000","last_change":"2023-11-04T01:36:34.754663+0000","last_active":"2023-11-04T01:36:35.597228+0000","last_peered":"2023-11-04T01:36:35.597228+0000","last_clean":"2023-11-04T01:36:35.597228+0000","last_became_active":"2023-11-04T01:36:34.754298+0000","last_became_peered":"2023-11-04T01:36:34.754298+0000","last_unstale":"2023-11-04T01:36:35.597228+0000","last_undegraded":"2023-11-04T01:36:35.597228+0000","last_fullsized":"2023-11-04T01:36:35.597228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:11.471843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593223+0000","last_change":"2023-11-04T01:36:30.552453+0000","last_active":"2023-11-04T01:36:34.593223+0000","last_peered":"2023-11-04T01:36:34.593223+0000","last_clean":"2023-11-04T01:36:34.593223+0000","last_became_active":"2023-11-04T01:36:30.551991+0000","last_became_peered":"2023-11-04T01:36:30.551991+0000","last_unstale":"2023-11-04T01:36:34.593223+0000","last_undegraded":"2023-11-04T01:36:34.593223+0000","last_fullsized":"2023-11-04T01:36:34.593223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:09.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.751896+0000","last_change":"2023-11-04T01:36:29.566350+0000","last_active":"2023-11-04T01:36:34.751896+0000","last_peered":"2023-11-04T01:36:34.751896+0000","last_clean":"2023-11-04T01:36:34.751896+0000","last_became_active":"2023-11-04T01:36:29.566017+0000","last_became_peered":"2023-11-04T01:36:29.566017+0000","last_unstale":"2023-11-04T01:36:34.751896+0000","last_undegraded":"2023-11-04T01:36:34.751896+0000","last_fullsized":"2023-11-04T01:36:34.751896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:14.041288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539829+0000","last_change":"2023-11-04T01:36:34.610359+0000","last_active":"2023-11-04T01:36:35.539829+0000","last_peered":"2023-11-04T01:36:35.539829+0000","last_clean":"2023-11-04T01:36:35.539829+0000","last_became_active":"2023-11-04T01:36:34.609199+0000","last_became_peered":"2023-11-04T01:36:34.609199+0000","last_unstale":"2023-11-04T01:36:35.539829+0000","last_undegraded":"2023-11-04T01:36:35.539829+0000","last_fullsized":"2023-11-04T01:36:35.539829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:33.296091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601796+0000","last_change":"2023-11-04T01:36:30.552716+0000","last_active":"2023-11-04T01:36:34.601796+0000","last_peered":"2023-11-04T01:36:34.601796+0000","last_clean":"2023-11-04T01:36:34.601796+0000","last_became_active":"2023-11-04T01:36:30.552100+0000","last_became_peered":"2023-11-04T01:36:30.552100+0000","last_unstale":"2023-11-04T01:36:34.601796+0000","last_undegraded":"2023-11-04T01:36:34.601796+0000","last_fullsized":"2023-11-04T01:36:34.601796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:36.996384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593302+0000","last_change":"2023-11-04T01:36:29.559145+0000","last_active":"2023-11-04T01:36:34.593302+0000","last_peered":"2023-11-04T01:36:34.593302+0000","last_clean":"2023-11-04T01:36:34.593302+0000","last_became_active":"2023-11-04T01:36:29.558717+0000","last_became_peered":"2023-11-04T01:36:29.558717+0000","last_unstale":"2023-11-04T01:36:34.593302+0000","last_undegraded":"2023-11-04T01:36:34.593302+0000","last_fullsized":"2023-11-04T01:36:34.593302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:27.522090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540333+0000","last_change":"2023-11-04T01:36:34.757021+0000","last_active":"2023-11-04T01:36:35.540333+0000","last_peered":"2023-11-04T01:36:35.540333+0000","last_clean":"2023-11-04T01:36:35.540333+0000","last_became_active":"2023-11-04T01:36:34.756621+0000","last_became_peered":"2023-11-04T01:36:34.756621+0000","last_unstale":"2023-11-04T01:36:35.540333+0000","last_undegraded":"2023-11-04T01:36:35.540333+0000","last_fullsized":"2023-11-04T01:36:35.540333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:09.612714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591751+0000","last_change":"2023-11-04T01:36:30.558233+0000","last_active":"2023-11-04T01:36:34.591751+0000","last_peered":"2023-11-04T01:36:34.591751+0000","last_clean":"2023-11-04T01:36:34.591751+0000","last_became_active":"2023-11-04T01:36:30.557978+0000","last_became_peered":"2023-11-04T01:36:30.557978+0000","last_unstale":"2023-11-04T01:36:34.591751+0000","last_undegraded":"2023-11-04T01:36:34.591751+0000","last_fullsized":"2023-11-04T01:36:34.591751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.045633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597917+0000","last_change":"2023-11-04T01:36:29.562995+0000","last_active":"2023-11-04T01:36:34.597917+0000","last_peered":"2023-11-04T01:36:34.597917+0000","last_clean":"2023-11-04T01:36:34.597917+0000","last_became_active":"2023-11-04T01:36:29.561703+0000","last_became_peered":"2023-11-04T01:36:29.561703+0000","last_unstale":"2023-11-04T01:36:34.597917+0000","last_undegraded":"2023-11-04T01:36:34.597917+0000","last_fullsized":"2023-11-04T01:36:34.597917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:24.009190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.595578+0000","last_change":"2023-11-04T01:36:34.754583+0000","last_active":"2023-11-04T01:36:35.595578+0000","last_peered":"2023-11-04T01:36:35.595578+0000","last_clean":"2023-11-04T01:36:35.595578+0000","last_became_active":"2023-11-04T01:36:34.754217+0000","last_became_peered":"2023-11-04T01:36:34.754217+0000","last_unstale":"2023-11-04T01:36:35.595578+0000","last_undegraded":"2023-11-04T01:36:35.595578+0000","last_fullsized":"2023-11-04T01:36:35.595578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:52.513758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597832+0000","last_change":"2023-11-04T01:36:30.551747+0000","last_active":"2023-11-04T01:36:34.597832+0000","last_peered":"2023-11-04T01:36:34.597832+0000","last_clean":"2023-11-04T01:36:34.597832+0000","last_became_active":"2023-11-04T01:36:30.551482+0000","last_became_peered":"2023-11-04T01:36:30.551482+0000","last_unstale":"2023-11-04T01:36:34.597832+0000","last_undegraded":"2023-11-04T01:36:34.597832+0000","last_fullsized":"2023-11-04T01:36:34.597832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:36.996384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752833+0000","last_change":"2023-11-04T01:36:29.571353+0000","last_active":"2023-11-04T01:36:34.752833+0000","last_peered":"2023-11-04T01:36:34.752833+0000","last_clean":"2023-11-04T01:36:34.752833+0000","last_became_active":"2023-11-04T01:36:29.571116+0000","last_became_peered":"2023-11-04T01:36:29.571116+0000","last_unstale":"2023-11-04T01:36:34.752833+0000","last_undegraded":"2023-11-04T01:36:34.752833+0000","last_fullsized":"2023-11-04T01:36:34.752833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:28.254753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597205+0000","last_change":"2023-11-04T01:36:34.752449+0000","last_active":"2023-11-04T01:36:35.597205+0000","last_peered":"2023-11-04T01:36:35.597205+0000","last_clean":"2023-11-04T01:36:35.597205+0000","last_became_active":"2023-11-04T01:36:34.752021+0000","last_became_peered":"2023-11-04T01:36:34.752021+0000","last_unstale":"2023-11-04T01:36:35.597205+0000","last_undegraded":"2023-11-04T01:36:35.597205+0000","last_fullsized":"2023-11-04T01:36:35.597205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:09.612714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600961+0000","last_change":"2023-11-04T01:36:30.558205+0000","last_active":"2023-11-04T01:36:34.600961+0000","last_peered":"2023-11-04T01:36:34.600961+0000","last_clean":"2023-11-04T01:36:34.600961+0000","last_became_active":"2023-11-04T01:36:30.557948+0000","last_became_peered":"2023-11-04T01:36:30.557948+0000","last_unstale":"2023-11-04T01:36:34.600961+0000","last_undegraded":"2023-11-04T01:36:34.600961+0000","last_fullsized":"2023-11-04T01:36:34.600961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:05.575722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597915+0000","last_change":"2023-11-04T01:36:29.566447+0000","last_active":"2023-11-04T01:36:34.597915+0000","last_peered":"2023-11-04T01:36:34.597915+0000","last_clean":"2023-11-04T01:36:34.597915+0000","last_became_active":"2023-11-04T01:36:29.566149+0000","last_became_peered":"2023-11-04T01:36:29.566149+0000","last_unstale":"2023-11-04T01:36:34.597915+0000","last_undegraded":"2023-11-04T01:36:34.597915+0000","last_fullsized":"2023-11-04T01:36:34.597915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:36.610872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.596192+0000","last_change":"2023-11-04T01:36:34.612816+0000","last_active":"2023-11-04T01:36:35.596192+0000","last_peered":"2023-11-04T01:36:35.596192+0000","last_clean":"2023-11-04T01:36:35.596192+0000","last_became_active":"2023-11-04T01:36:34.612411+0000","last_became_peered":"2023-11-04T01:36:34.612411+0000","last_unstale":"2023-11-04T01:36:35.596192+0000","last_undegraded":"2023-11-04T01:36:35.596192+0000","last_fullsized":"2023-11-04T01:36:35.596192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:28.573079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592465+0000","last_change":"2023-11-04T01:36:30.553297+0000","last_active":"2023-11-04T01:36:34.592465+0000","last_peered":"2023-11-04T01:36:34.592465+0000","last_clean":"2023-11-04T01:36:34.592465+0000","last_became_active":"2023-11-04T01:36:30.552992+0000","last_became_peered":"2023-11-04T01:36:30.552992+0000","last_unstale":"2023-11-04T01:36:34.592465+0000","last_undegraded":"2023-11-04T01:36:34.592465+0000","last_fullsized":"2023-11-04T01:36:34.592465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:25.013535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600577+0000","last_change":"2023-11-04T01:36:29.564983+0000","last_active":"2023-11-04T01:36:34.600577+0000","last_peered":"2023-11-04T01:36:34.600577+0000","last_clean":"2023-11-04T01:36:34.600577+0000","last_became_active":"2023-11-04T01:36:29.564679+0000","last_became_peered":"2023-11-04T01:36:29.564679+0000","last_unstale":"2023-11-04T01:36:34.600577+0000","last_undegraded":"2023-11-04T01:36:34.600577+0000","last_fullsized":"2023-11-04T01:36:34.600577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:35.972647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.596517+0000","last_change":"2023-11-04T01:36:34.609968+0000","last_active":"2023-11-04T01:36:35.596517+0000","last_peered":"2023-11-04T01:36:35.596517+0000","last_clean":"2023-11-04T01:36:35.596517+0000","last_became_active":"2023-11-04T01:36:34.609460+0000","last_became_peered":"2023-11-04T01:36:34.609460+0000","last_unstale":"2023-11-04T01:36:35.596517+0000","last_undegraded":"2023-11-04T01:36:35.596517+0000","last_fullsized":"2023-11-04T01:36:35.596517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:09.612714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597523+0000","last_change":"2023-11-04T01:36:30.551741+0000","last_active":"2023-11-04T01:36:34.597523+0000","last_peered":"2023-11-04T01:36:34.597523+0000","last_clean":"2023-11-04T01:36:34.597523+0000","last_became_active":"2023-11-04T01:36:30.551456+0000","last_became_peered":"2023-11-04T01:36:30.551456+0000","last_unstale":"2023-11-04T01:36:34.597523+0000","last_undegraded":"2023-11-04T01:36:34.597523+0000","last_fullsized":"2023-11-04T01:36:34.597523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:36.976993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603079+0000","last_change":"2023-11-04T01:36:29.562224+0000","last_active":"2023-11-04T01:36:34.603079+0000","last_peered":"2023-11-04T01:36:34.603079+0000","last_clean":"2023-11-04T01:36:34.603079+0000","last_became_active":"2023-11-04T01:36:29.561870+0000","last_became_peered":"2023-11-04T01:36:29.561870+0000","last_unstale":"2023-11-04T01:36:34.603079+0000","last_undegraded":"2023-11-04T01:36:34.603079+0000","last_fullsized":"2023-11-04T01:36:34.603079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:08.164823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597173+0000","last_change":"2023-11-04T01:36:34.610751+0000","last_active":"2023-11-04T01:36:35.597173+0000","last_peered":"2023-11-04T01:36:35.597173+0000","last_clean":"2023-11-04T01:36:35.597173+0000","last_became_active":"2023-11-04T01:36:34.610375+0000","last_became_peered":"2023-11-04T01:36:34.610375+0000","last_unstale":"2023-11-04T01:36:35.597173+0000","last_undegraded":"2023-11-04T01:36:35.597173+0000","last_fullsized":"2023-11-04T01:36:35.597173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:34.881207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.599741+0000","last_change":"2023-11-04T01:36:30.553476+0000","last_active":"2023-11-04T01:36:34.599741+0000","last_peered":"2023-11-04T01:36:34.599741+0000","last_clean":"2023-11-04T01:36:34.599741+0000","last_became_active":"2023-11-04T01:36:30.553178+0000","last_became_peered":"2023-11-04T01:36:30.553178+0000","last_unstale":"2023-11-04T01:36:34.599741+0000","last_undegraded":"2023-11-04T01:36:34.599741+0000","last_fullsized":"2023-11-04T01:36:34.599741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:28.526436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752210+0000","last_change":"2023-11-04T01:36:29.565970+0000","last_active":"2023-11-04T01:36:34.752210+0000","last_peered":"2023-11-04T01:36:34.752210+0000","last_clean":"2023-11-04T01:36:34.752210+0000","last_became_active":"2023-11-04T01:36:29.565617+0000","last_became_peered":"2023-11-04T01:36:29.565617+0000","last_unstale":"2023-11-04T01:36:34.752210+0000","last_undegraded":"2023-11-04T01:36:34.752210+0000","last_fullsized":"2023-11-04T01:36:34.752210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:00.121926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597914+0000","last_change":"2023-11-04T01:36:34.755484+0000","last_active":"2023-11-04T01:36:35.597914+0000","last_peered":"2023-11-04T01:36:35.597914+0000","last_clean":"2023-11-04T01:36:35.597914+0000","last_became_active":"2023-11-04T01:36:34.755124+0000","last_became_peered":"2023-11-04T01:36:34.755124+0000","last_unstale":"2023-11-04T01:36:35.597914+0000","last_undegraded":"2023-11-04T01:36:35.597914+0000","last_fullsized":"2023-11-04T01:36:35.597914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:54:21.582207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590734+0000","last_change":"2023-11-04T01:36:30.558717+0000","last_active":"2023-11-04T01:36:34.590734+0000","last_peered":"2023-11-04T01:36:34.590734+0000","last_clean":"2023-11-04T01:36:34.590734+0000","last_became_active":"2023-11-04T01:36:30.558442+0000","last_became_peered":"2023-11-04T01:36:30.558442+0000","last_unstale":"2023-11-04T01:36:34.590734+0000","last_undegraded":"2023-11-04T01:36:34.590734+0000","last_fullsized":"2023-11-04T01:36:34.590734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600670+0000","last_change":"2023-11-04T01:36:29.558941+0000","last_active":"2023-11-04T01:36:34.600670+0000","last_peered":"2023-11-04T01:36:34.600670+0000","last_clean":"2023-11-04T01:36:34.600670+0000","last_became_active":"2023-11-04T01:36:29.558628+0000","last_became_peered":"2023-11-04T01:36:29.558628+0000","last_unstale":"2023-11-04T01:36:34.600670+0000","last_undegraded":"2023-11-04T01:36:34.600670+0000","last_fullsized":"2023-11-04T01:36:34.600670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:32:58.476395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752215+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:36:34.752215+0000","last_peered":"2023-11-04T01:36:34.752215+0000","last_clean":"2023-11-04T01:36:34.752215+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:36:34.752215+0000","last_undegraded":"2023-11-04T01:36:34.752215+0000","last_fullsized":"2023-11-04T01:36:34.752215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539400+0000","last_change":"2023-11-04T01:36:34.754650+0000","last_active":"2023-11-04T01:36:35.539400+0000","last_peered":"2023-11-04T01:36:35.539400+0000","last_clean":"2023-11-04T01:36:35.539400+0000","last_became_active":"2023-11-04T01:36:34.754266+0000","last_became_peered":"2023-11-04T01:36:34.754266+0000","last_unstale":"2023-11-04T01:36:35.539400+0000","last_undegraded":"2023-11-04T01:36:35.539400+0000","last_fullsized":"2023-11-04T01:36:35.539400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:28.573079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752605+0000","last_change":"2023-11-04T01:36:30.559432+0000","last_active":"2023-11-04T01:36:34.752605+0000","last_peered":"2023-11-04T01:36:34.752605+0000","last_clean":"2023-11-04T01:36:34.752605+0000","last_became_active":"2023-11-04T01:36:30.559164+0000","last_became_peered":"2023-11-04T01:36:30.559164+0000","last_unstale":"2023-11-04T01:36:34.752605+0000","last_undegraded":"2023-11-04T01:36:34.752605+0000","last_fullsized":"2023-11-04T01:36:34.752605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:07.434851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603732+0000","last_change":"2023-11-04T01:36:29.559481+0000","last_active":"2023-11-04T01:36:34.603732+0000","last_peered":"2023-11-04T01:36:34.603732+0000","last_clean":"2023-11-04T01:36:34.603732+0000","last_became_active":"2023-11-04T01:36:29.559232+0000","last_became_peered":"2023-11-04T01:36:29.559232+0000","last_unstale":"2023-11-04T01:36:34.603732+0000","last_undegraded":"2023-11-04T01:36:34.603732+0000","last_fullsized":"2023-11-04T01:36:34.603732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:39.985078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539003+0000","last_change":"2023-11-04T01:36:34.752537+0000","last_active":"2023-11-04T01:36:35.539003+0000","last_peered":"2023-11-04T01:36:35.539003+0000","last_clean":"2023-11-04T01:36:35.539003+0000","last_became_active":"2023-11-04T01:36:34.752122+0000","last_became_peered":"2023-11-04T01:36:34.752122+0000","last_unstale":"2023-11-04T01:36:35.539003+0000","last_undegraded":"2023-11-04T01:36:35.539003+0000","last_fullsized":"2023-11-04T01:36:35.539003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:54.343995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600864+0000","last_change":"2023-11-04T01:36:30.559114+0000","last_active":"2023-11-04T01:36:34.600864+0000","last_peered":"2023-11-04T01:36:34.600864+0000","last_clean":"2023-11-04T01:36:34.600864+0000","last_became_active":"2023-11-04T01:36:30.556702+0000","last_became_peered":"2023-11-04T01:36:30.556702+0000","last_unstale":"2023-11-04T01:36:34.600864+0000","last_undegraded":"2023-11-04T01:36:34.600864+0000","last_fullsized":"2023-11-04T01:36:34.600864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:30.844215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597914+0000","last_change":"2023-11-04T01:36:29.563452+0000","last_active":"2023-11-04T01:36:34.597914+0000","last_peered":"2023-11-04T01:36:34.597914+0000","last_clean":"2023-11-04T01:36:34.597914+0000","last_became_active":"2023-11-04T01:36:29.561923+0000","last_became_peered":"2023-11-04T01:36:29.561923+0000","last_unstale":"2023-11-04T01:36:34.597914+0000","last_undegraded":"2023-11-04T01:36:34.597914+0000","last_fullsized":"2023-11-04T01:36:34.597914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:27.522090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597420+0000","last_change":"2023-11-04T01:36:34.608316+0000","last_active":"2023-11-04T01:36:35.597420+0000","last_peered":"2023-11-04T01:36:35.597420+0000","last_clean":"2023-11-04T01:36:35.597420+0000","last_became_active":"2023-11-04T01:36:34.607936+0000","last_became_peered":"2023-11-04T01:36:34.607936+0000","last_unstale":"2023-11-04T01:36:35.597420+0000","last_undegraded":"2023-11-04T01:36:35.597420+0000","last_fullsized":"2023-11-04T01:36:35.597420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:31.223962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752975+0000","last_change":"2023-11-04T01:36:30.557506+0000","last_active":"2023-11-04T01:36:34.752975+0000","last_peered":"2023-11-04T01:36:34.752975+0000","last_clean":"2023-11-04T01:36:34.752975+0000","last_became_active":"2023-11-04T01:36:30.557188+0000","last_became_peered":"2023-11-04T01:36:30.557188+0000","last_unstale":"2023-11-04T01:36:34.752975+0000","last_undegraded":"2023-11-04T01:36:34.752975+0000","last_fullsized":"2023-11-04T01:36:34.752975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:59.924265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603522+0000","last_change":"2023-11-04T01:36:29.561929+0000","last_active":"2023-11-04T01:36:34.603522+0000","last_peered":"2023-11-04T01:36:34.603522+0000","last_clean":"2023-11-04T01:36:34.603522+0000","last_became_active":"2023-11-04T01:36:29.561665+0000","last_became_peered":"2023-11-04T01:36:29.561665+0000","last_unstale":"2023-11-04T01:36:34.603522+0000","last_undegraded":"2023-11-04T01:36:34.603522+0000","last_fullsized":"2023-11-04T01:36:34.603522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:55.902083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.595491+0000","last_change":"2023-11-04T01:36:34.755096+0000","last_active":"2023-11-04T01:36:35.595491+0000","last_peered":"2023-11-04T01:36:35.595491+0000","last_clean":"2023-11-04T01:36:35.595491+0000","last_became_active":"2023-11-04T01:36:34.754200+0000","last_became_peered":"2023-11-04T01:36:34.754200+0000","last_unstale":"2023-11-04T01:36:35.595491+0000","last_undegraded":"2023-11-04T01:36:35.595491+0000","last_fullsized":"2023-11-04T01:36:35.595491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:51.521044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752673+0000","last_change":"2023-11-04T01:36:30.556808+0000","last_active":"2023-11-04T01:36:34.752673+0000","last_peered":"2023-11-04T01:36:34.752673+0000","last_clean":"2023-11-04T01:36:34.752673+0000","last_became_active":"2023-11-04T01:36:30.556522+0000","last_became_peered":"2023-11-04T01:36:30.556522+0000","last_unstale":"2023-11-04T01:36:34.752673+0000","last_undegraded":"2023-11-04T01:36:34.752673+0000","last_fullsized":"2023-11-04T01:36:34.752673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:48.476765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591829+0000","last_change":"2023-11-04T01:36:29.560106+0000","last_active":"2023-11-04T01:36:34.591829+0000","last_peered":"2023-11-04T01:36:34.591829+0000","last_clean":"2023-11-04T01:36:34.591829+0000","last_became_active":"2023-11-04T01:36:29.559786+0000","last_became_peered":"2023-11-04T01:36:29.559786+0000","last_unstale":"2023-11-04T01:36:34.591829+0000","last_undegraded":"2023-11-04T01:36:34.591829+0000","last_fullsized":"2023-11-04T01:36:34.591829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:37:02.831923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539853+0000","last_change":"2023-11-04T01:36:34.610033+0000","last_active":"2023-11-04T01:36:35.539853+0000","last_peered":"2023-11-04T01:36:35.539853+0000","last_clean":"2023-11-04T01:36:35.539853+0000","last_became_active":"2023-11-04T01:36:34.609439+0000","last_became_peered":"2023-11-04T01:36:34.609439+0000","last_unstale":"2023-11-04T01:36:35.539853+0000","last_undegraded":"2023-11-04T01:36:35.539853+0000","last_fullsized":"2023-11-04T01:36:35.539853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:57.965365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752112+0000","last_change":"2023-11-04T01:36:30.556245+0000","last_active":"2023-11-04T01:36:34.752112+0000","last_peered":"2023-11-04T01:36:34.752112+0000","last_clean":"2023-11-04T01:36:34.752112+0000","last_became_active":"2023-11-04T01:36:30.555523+0000","last_became_peered":"2023-11-04T01:36:30.555523+0000","last_unstale":"2023-11-04T01:36:34.752112+0000","last_undegraded":"2023-11-04T01:36:34.752112+0000","last_fullsized":"2023-11-04T01:36:34.752112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:24.536087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603267+0000","last_change":"2023-11-04T01:36:29.558752+0000","last_active":"2023-11-04T01:36:34.603267+0000","last_peered":"2023-11-04T01:36:34.603267+0000","last_clean":"2023-11-04T01:36:34.603267+0000","last_became_active":"2023-11-04T01:36:29.558430+0000","last_became_peered":"2023-11-04T01:36:29.558430+0000","last_unstale":"2023-11-04T01:36:34.603267+0000","last_undegraded":"2023-11-04T01:36:34.603267+0000","last_fullsized":"2023-11-04T01:36:34.603267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:46.170109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597667+0000","last_change":"2023-11-04T01:36:34.610894+0000","last_active":"2023-11-04T01:36:35.597667+0000","last_peered":"2023-11-04T01:36:35.597667+0000","last_clean":"2023-11-04T01:36:35.597667+0000","last_became_active":"2023-11-04T01:36:34.609868+0000","last_became_peered":"2023-11-04T01:36:34.609868+0000","last_unstale":"2023-11-04T01:36:35.597667+0000","last_undegraded":"2023-11-04T01:36:35.597667+0000","last_fullsized":"2023-11-04T01:36:35.597667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:11.471843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590924+0000","last_change":"2023-11-04T01:36:30.553108+0000","last_active":"2023-11-04T01:36:34.590924+0000","last_peered":"2023-11-04T01:36:34.590924+0000","last_clean":"2023-11-04T01:36:34.590924+0000","last_became_active":"2023-11-04T01:36:30.552812+0000","last_became_peered":"2023-11-04T01:36:30.552812+0000","last_unstale":"2023-11-04T01:36:34.590924+0000","last_undegraded":"2023-11-04T01:36:34.590924+0000","last_fullsized":"2023-11-04T01:36:34.590924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:17.787245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591689+0000","last_change":"2023-11-04T01:36:29.555166+0000","last_active":"2023-11-04T01:36:34.591689+0000","last_peered":"2023-11-04T01:36:34.591689+0000","last_clean":"2023-11-04T01:36:34.591689+0000","last_became_active":"2023-11-04T01:36:29.554537+0000","last_became_peered":"2023-11-04T01:36:29.554537+0000","last_unstale":"2023-11-04T01:36:34.591689+0000","last_undegraded":"2023-11-04T01:36:34.591689+0000","last_fullsized":"2023-11-04T01:36:34.591689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:28.954776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597394+0000","last_change":"2023-11-04T01:36:34.754737+0000","last_active":"2023-11-04T01:36:35.597394+0000","last_peered":"2023-11-04T01:36:35.597394+0000","last_clean":"2023-11-04T01:36:35.597394+0000","last_became_active":"2023-11-04T01:36:34.754360+0000","last_became_peered":"2023-11-04T01:36:34.754360+0000","last_unstale":"2023-11-04T01:36:35.597394+0000","last_undegraded":"2023-11-04T01:36:35.597394+0000","last_fullsized":"2023-11-04T01:36:35.597394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:25.393431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752320+0000","last_change":"2023-11-04T01:36:30.555902+0000","last_active":"2023-11-04T01:36:34.752320+0000","last_peered":"2023-11-04T01:36:34.752320+0000","last_clean":"2023-11-04T01:36:34.752320+0000","last_became_active":"2023-11-04T01:36:30.555624+0000","last_became_peered":"2023-11-04T01:36:30.555624+0000","last_unstale":"2023-11-04T01:36:34.752320+0000","last_undegraded":"2023-11-04T01:36:34.752320+0000","last_fullsized":"2023-11-04T01:36:34.752320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:27.186969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600516+0000","last_change":"2023-11-04T01:36:29.566041+0000","last_active":"2023-11-04T01:36:34.600516+0000","last_peered":"2023-11-04T01:36:34.600516+0000","last_clean":"2023-11-04T01:36:34.600516+0000","last_became_active":"2023-11-04T01:36:29.565674+0000","last_became_peered":"2023-11-04T01:36:29.565674+0000","last_unstale":"2023-11-04T01:36:34.600516+0000","last_undegraded":"2023-11-04T01:36:34.600516+0000","last_fullsized":"2023-11-04T01:36:34.600516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:11.541445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597902+0000","last_change":"2023-11-04T01:36:34.752418+0000","last_active":"2023-11-04T01:36:35.597902+0000","last_peered":"2023-11-04T01:36:35.597902+0000","last_clean":"2023-11-04T01:36:35.597902+0000","last_became_active":"2023-11-04T01:36:34.752054+0000","last_became_peered":"2023-11-04T01:36:34.752054+0000","last_unstale":"2023-11-04T01:36:35.597902+0000","last_undegraded":"2023-11-04T01:36:35.597902+0000","last_fullsized":"2023-11-04T01:36:35.597902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:44.979273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601844+0000","last_change":"2023-11-04T01:36:30.559566+0000","last_active":"2023-11-04T01:36:34.601844+0000","last_peered":"2023-11-04T01:36:34.601844+0000","last_clean":"2023-11-04T01:36:34.601844+0000","last_became_active":"2023-11-04T01:36:30.559372+0000","last_became_peered":"2023-11-04T01:36:30.559372+0000","last_unstale":"2023-11-04T01:36:34.601844+0000","last_undegraded":"2023-11-04T01:36:34.601844+0000","last_fullsized":"2023-11-04T01:36:34.601844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:17.787245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603204+0000","last_change":"2023-11-04T01:36:29.559883+0000","last_active":"2023-11-04T01:36:34.603204+0000","last_peered":"2023-11-04T01:36:34.603204+0000","last_clean":"2023-11-04T01:36:34.603204+0000","last_became_active":"2023-11-04T01:36:29.559623+0000","last_became_peered":"2023-11-04T01:36:29.559623+0000","last_unstale":"2023-11-04T01:36:34.603204+0000","last_undegraded":"2023-11-04T01:36:34.603204+0000","last_fullsized":"2023-11-04T01:36:34.603204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:19.388284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.596818+0000","last_change":"2023-11-04T01:36:34.752434+0000","last_active":"2023-11-04T01:36:35.596818+0000","last_peered":"2023-11-04T01:36:35.596818+0000","last_clean":"2023-11-04T01:36:35.596818+0000","last_became_active":"2023-11-04T01:36:34.752050+0000","last_became_peered":"2023-11-04T01:36:34.752050+0000","last_unstale":"2023-11-04T01:36:35.596818+0000","last_undegraded":"2023-11-04T01:36:35.596818+0000","last_fullsized":"2023-11-04T01:36:35.596818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:38:03.961257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752508+0000","last_change":"2023-11-04T01:36:30.554177+0000","last_active":"2023-11-04T01:36:34.752508+0000","last_peered":"2023-11-04T01:36:34.752508+0000","last_clean":"2023-11-04T01:36:34.752508+0000","last_became_active":"2023-11-04T01:36:30.553678+0000","last_became_peered":"2023-11-04T01:36:30.553678+0000","last_unstale":"2023-11-04T01:36:34.752508+0000","last_undegraded":"2023-11-04T01:36:34.752508+0000","last_fullsized":"2023-11-04T01:36:34.752508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:30.844215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:41.053098+0000","last_change":"2023-11-04T01:36:29.563305+0000","last_active":"2023-11-04T01:36:41.053098+0000","last_peered":"2023-11-04T01:36:41.053098+0000","last_clean":"2023-11-04T01:36:41.053098+0000","last_became_active":"2023-11-04T01:36:29.563013+0000","last_became_peered":"2023-11-04T01:36:29.563013+0000","last_unstale":"2023-11-04T01:36:41.053098+0000","last_undegraded":"2023-11-04T01:36:41.053098+0000","last_fullsized":"2023-11-04T01:36:41.053098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:46:08.796108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.596633+0000","last_change":"2023-11-04T01:36:34.608299+0000","last_active":"2023-11-04T01:36:35.596633+0000","last_peered":"2023-11-04T01:36:35.596633+0000","last_clean":"2023-11-04T01:36:35.596633+0000","last_became_active":"2023-11-04T01:36:34.607909+0000","last_became_peered":"2023-11-04T01:36:34.607909+0000","last_unstale":"2023-11-04T01:36:35.596633+0000","last_undegraded":"2023-11-04T01:36:35.596633+0000","last_fullsized":"2023-11-04T01:36:35.596633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:31.223962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592418+0000","last_change":"2023-11-04T01:36:30.557781+0000","last_active":"2023-11-04T01:36:34.592418+0000","last_peered":"2023-11-04T01:36:34.592418+0000","last_clean":"2023-11-04T01:36:34.592418+0000","last_became_active":"2023-11-04T01:36:30.557449+0000","last_became_peered":"2023-11-04T01:36:30.557449+0000","last_unstale":"2023-11-04T01:36:34.592418+0000","last_undegraded":"2023-11-04T01:36:34.592418+0000","last_fullsized":"2023-11-04T01:36:34.592418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:29.959121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597825+0000","last_change":"2023-11-04T01:36:29.565926+0000","last_active":"2023-11-04T01:36:34.597825+0000","last_peered":"2023-11-04T01:36:34.597825+0000","last_clean":"2023-11-04T01:36:34.597825+0000","last_became_active":"2023-11-04T01:36:29.564825+0000","last_became_peered":"2023-11-04T01:36:29.564825+0000","last_unstale":"2023-11-04T01:36:34.597825+0000","last_undegraded":"2023-11-04T01:36:34.597825+0000","last_fullsized":"2023-11-04T01:36:34.597825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:08.164823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540301+0000","last_change":"2023-11-04T01:36:34.607153+0000","last_active":"2023-11-04T01:36:35.540301+0000","last_peered":"2023-11-04T01:36:35.540301+0000","last_clean":"2023-11-04T01:36:35.540301+0000","last_became_active":"2023-11-04T01:36:34.606735+0000","last_became_peered":"2023-11-04T01:36:34.606735+0000","last_unstale":"2023-11-04T01:36:35.540301+0000","last_undegraded":"2023-11-04T01:36:35.540301+0000","last_fullsized":"2023-11-04T01:36:35.540301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:28.573079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601770+0000","last_change":"2023-11-04T01:36:30.556826+0000","last_active":"2023-11-04T01:36:34.601770+0000","last_peered":"2023-11-04T01:36:34.601770+0000","last_clean":"2023-11-04T01:36:34.601770+0000","last_became_active":"2023-11-04T01:36:30.556539+0000","last_became_peered":"2023-11-04T01:36:30.556539+0000","last_unstale":"2023-11-04T01:36:34.601770+0000","last_undegraded":"2023-11-04T01:36:34.601770+0000","last_fullsized":"2023-11-04T01:36:34.601770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.045633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601013+0000","last_change":"2023-11-04T01:36:29.561123+0000","last_active":"2023-11-04T01:36:34.601013+0000","last_peered":"2023-11-04T01:36:34.601013+0000","last_clean":"2023-11-04T01:36:34.601013+0000","last_became_active":"2023-11-04T01:36:29.560854+0000","last_became_peered":"2023-11-04T01:36:29.560854+0000","last_unstale":"2023-11-04T01:36:34.601013+0000","last_undegraded":"2023-11-04T01:36:34.601013+0000","last_fullsized":"2023-11-04T01:36:34.601013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:09.364774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.595884+0000","last_change":"2023-11-04T01:36:34.601066+0000","last_active":"2023-11-04T01:36:35.595884+0000","last_peered":"2023-11-04T01:36:35.595884+0000","last_clean":"2023-11-04T01:36:35.595884+0000","last_became_active":"2023-11-04T01:36:34.599090+0000","last_became_peered":"2023-11-04T01:36:34.599090+0000","last_unstale":"2023-11-04T01:36:35.595884+0000","last_undegraded":"2023-11-04T01:36:35.595884+0000","last_fullsized":"2023-11-04T01:36:35.595884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:55:45.766187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600942+0000","last_change":"2023-11-04T01:36:30.561795+0000","last_active":"2023-11-04T01:36:34.600942+0000","last_peered":"2023-11-04T01:36:34.600942+0000","last_clean":"2023-11-04T01:36:34.600942+0000","last_became_active":"2023-11-04T01:36:30.561540+0000","last_became_peered":"2023-11-04T01:36:30.561540+0000","last_unstale":"2023-11-04T01:36:34.600942+0000","last_undegraded":"2023-11-04T01:36:34.600942+0000","last_fullsized":"2023-11-04T01:36:34.600942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:50.307002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593216+0000","last_change":"2023-11-04T01:36:29.559999+0000","last_active":"2023-11-04T01:36:34.593216+0000","last_peered":"2023-11-04T01:36:34.593216+0000","last_clean":"2023-11-04T01:36:34.593216+0000","last_became_active":"2023-11-04T01:36:29.559724+0000","last_became_peered":"2023-11-04T01:36:29.559724+0000","last_unstale":"2023-11-04T01:36:34.593216+0000","last_undegraded":"2023-11-04T01:36:34.593216+0000","last_fullsized":"2023-11-04T01:36:34.593216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:19.388284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597352+0000","last_change":"2023-11-04T01:36:34.754539+0000","last_active":"2023-11-04T01:36:35.597352+0000","last_peered":"2023-11-04T01:36:35.597352+0000","last_clean":"2023-11-04T01:36:35.597352+0000","last_became_active":"2023-11-04T01:36:34.754171+0000","last_became_peered":"2023-11-04T01:36:34.754171+0000","last_unstale":"2023-11-04T01:36:35.597352+0000","last_undegraded":"2023-11-04T01:36:35.597352+0000","last_fullsized":"2023-11-04T01:36:35.597352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:38:03.961257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597516+0000","last_change":"2023-11-04T01:36:34.754646+0000","last_active":"2023-11-04T01:36:35.597516+0000","last_peered":"2023-11-04T01:36:35.597516+0000","last_clean":"2023-11-04T01:36:35.597516+0000","last_became_active":"2023-11-04T01:36:34.754295+0000","last_became_peered":"2023-11-04T01:36:34.754295+0000","last_unstale":"2023-11-04T01:36:35.597516+0000","last_undegraded":"2023-11-04T01:36:35.597516+0000","last_fullsized":"2023-11-04T01:36:35.597516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:34.881207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597360+0000","last_change":"2023-11-04T01:36:30.549880+0000","last_active":"2023-11-04T01:36:34.597360+0000","last_peered":"2023-11-04T01:36:34.597360+0000","last_clean":"2023-11-04T01:36:34.597360+0000","last_became_active":"2023-11-04T01:36:30.549601+0000","last_became_peered":"2023-11-04T01:36:30.549601+0000","last_unstale":"2023-11-04T01:36:34.597360+0000","last_undegraded":"2023-11-04T01:36:34.597360+0000","last_fullsized":"2023-11-04T01:36:34.597360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:12.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600522+0000","last_change":"2023-11-04T01:36:29.561272+0000","last_active":"2023-11-04T01:36:34.600522+0000","last_peered":"2023-11-04T01:36:34.600522+0000","last_clean":"2023-11-04T01:36:34.600522+0000","last_became_active":"2023-11-04T01:36:29.561002+0000","last_became_peered":"2023-11-04T01:36:29.561002+0000","last_unstale":"2023-11-04T01:36:34.600522+0000","last_undegraded":"2023-11-04T01:36:34.600522+0000","last_fullsized":"2023-11-04T01:36:34.600522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:55.902083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540190+0000","last_change":"2023-11-04T01:36:34.605037+0000","last_active":"2023-11-04T01:36:35.540190+0000","last_peered":"2023-11-04T01:36:35.540190+0000","last_clean":"2023-11-04T01:36:35.540190+0000","last_became_active":"2023-11-04T01:36:34.604643+0000","last_became_peered":"2023-11-04T01:36:34.604643+0000","last_unstale":"2023-11-04T01:36:35.540190+0000","last_undegraded":"2023-11-04T01:36:35.540190+0000","last_fullsized":"2023-11-04T01:36:35.540190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:09.612714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591215+0000","last_change":"2023-11-04T01:36:30.554876+0000","last_active":"2023-11-04T01:36:34.591215+0000","last_peered":"2023-11-04T01:36:34.591215+0000","last_clean":"2023-11-04T01:36:34.591215+0000","last_became_active":"2023-11-04T01:36:30.554614+0000","last_became_peered":"2023-11-04T01:36:30.554614+0000","last_unstale":"2023-11-04T01:36:34.591215+0000","last_undegraded":"2023-11-04T01:36:34.591215+0000","last_fullsized":"2023-11-04T01:36:34.591215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:17.787245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591406+0000","last_change":"2023-11-04T01:36:29.561077+0000","last_active":"2023-11-04T01:36:34.591406+0000","last_peered":"2023-11-04T01:36:34.591406+0000","last_clean":"2023-11-04T01:36:34.591406+0000","last_became_active":"2023-11-04T01:36:29.560004+0000","last_became_peered":"2023-11-04T01:36:29.560004+0000","last_unstale":"2023-11-04T01:36:34.591406+0000","last_undegraded":"2023-11-04T01:36:34.591406+0000","last_fullsized":"2023-11-04T01:36:34.591406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:27.522090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593048+0000","last_change":"2023-11-04T01:36:29.554796+0000","last_active":"2023-11-04T01:36:34.593048+0000","last_peered":"2023-11-04T01:36:34.593048+0000","last_clean":"2023-11-04T01:36:34.593048+0000","last_became_active":"2023-11-04T01:36:29.554404+0000","last_became_peered":"2023-11-04T01:36:29.554404+0000","last_unstale":"2023-11-04T01:36:34.593048+0000","last_undegraded":"2023-11-04T01:36:34.593048+0000","last_fullsized":"2023-11-04T01:36:34.593048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:24.009190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603121+0000","last_change":"2023-11-04T01:36:30.555821+0000","last_active":"2023-11-04T01:36:34.603121+0000","last_peered":"2023-11-04T01:36:34.603121+0000","last_clean":"2023-11-04T01:36:34.603121+0000","last_became_active":"2023-11-04T01:36:30.555189+0000","last_became_peered":"2023-11-04T01:36:30.555189+0000","last_unstale":"2023-11-04T01:36:34.603121+0000","last_undegraded":"2023-11-04T01:36:34.603121+0000","last_fullsized":"2023-11-04T01:36:34.603121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:36.976993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540760+0000","last_change":"2023-11-04T01:36:34.609254+0000","last_active":"2023-11-04T01:36:35.540760+0000","last_peered":"2023-11-04T01:36:35.540760+0000","last_clean":"2023-11-04T01:36:35.540760+0000","last_became_active":"2023-11-04T01:36:34.608845+0000","last_became_peered":"2023-11-04T01:36:34.608845+0000","last_unstale":"2023-11-04T01:36:35.540760+0000","last_undegraded":"2023-11-04T01:36:35.540760+0000","last_fullsized":"2023-11-04T01:36:35.540760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:32.563428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591589+0000","last_change":"2023-11-04T01:36:29.564267+0000","last_active":"2023-11-04T01:36:34.591589+0000","last_peered":"2023-11-04T01:36:34.591589+0000","last_clean":"2023-11-04T01:36:34.591589+0000","last_became_active":"2023-11-04T01:36:29.563992+0000","last_became_peered":"2023-11-04T01:36:29.563992+0000","last_unstale":"2023-11-04T01:36:34.591589+0000","last_undegraded":"2023-11-04T01:36:34.591589+0000","last_fullsized":"2023-11-04T01:36:34.591589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:28.954776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592935+0000","last_change":"2023-11-04T01:36:30.552063+0000","last_active":"2023-11-04T01:36:34.592935+0000","last_peered":"2023-11-04T01:36:34.592935+0000","last_clean":"2023-11-04T01:36:34.592935+0000","last_became_active":"2023-11-04T01:36:30.551686+0000","last_became_peered":"2023-11-04T01:36:30.551686+0000","last_unstale":"2023-11-04T01:36:34.592935+0000","last_undegraded":"2023-11-04T01:36:34.592935+0000","last_fullsized":"2023-11-04T01:36:34.592935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:56.906428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597623+0000","last_change":"2023-11-04T01:36:34.607234+0000","last_active":"2023-11-04T01:36:35.597623+0000","last_peered":"2023-11-04T01:36:35.597623+0000","last_clean":"2023-11-04T01:36:35.597623+0000","last_became_active":"2023-11-04T01:36:34.606850+0000","last_became_peered":"2023-11-04T01:36:34.606850+0000","last_unstale":"2023-11-04T01:36:35.597623+0000","last_undegraded":"2023-11-04T01:36:35.597623+0000","last_fullsized":"2023-11-04T01:36:35.597623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:18.885568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590846+0000","last_change":"2023-11-04T01:36:30.554613+0000","last_active":"2023-11-04T01:36:34.590846+0000","last_peered":"2023-11-04T01:36:34.590846+0000","last_clean":"2023-11-04T01:36:34.590846+0000","last_became_active":"2023-11-04T01:36:30.554329+0000","last_became_peered":"2023-11-04T01:36:30.554329+0000","last_unstale":"2023-11-04T01:36:34.590846+0000","last_undegraded":"2023-11-04T01:36:34.590846+0000","last_fullsized":"2023-11-04T01:36:34.590846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:37.615217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.602985+0000","last_change":"2023-11-04T01:36:30.557052+0000","last_active":"2023-11-04T01:36:34.602985+0000","last_peered":"2023-11-04T01:36:34.602985+0000","last_clean":"2023-11-04T01:36:34.602985+0000","last_became_active":"2023-11-04T01:36:30.556744+0000","last_became_peered":"2023-11-04T01:36:30.556744+0000","last_unstale":"2023-11-04T01:36:34.602985+0000","last_undegraded":"2023-11-04T01:36:34.602985+0000","last_fullsized":"2023-11-04T01:36:34.602985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:29.959121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600475+0000","last_change":"2023-11-04T01:36:30.557244+0000","last_active":"2023-11-04T01:36:34.600475+0000","last_peered":"2023-11-04T01:36:34.600475+0000","last_clean":"2023-11-04T01:36:34.600475+0000","last_became_active":"2023-11-04T01:36:30.556922+0000","last_became_peered":"2023-11-04T01:36:30.556922+0000","last_unstale":"2023-11-04T01:36:34.600475+0000","last_undegraded":"2023-11-04T01:36:34.600475+0000","last_fullsized":"2023-11-04T01:36:34.600475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:27.186969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603035+0000","last_change":"2023-11-04T01:36:30.553115+0000","last_active":"2023-11-04T01:36:34.603035+0000","last_peered":"2023-11-04T01:36:34.603035+0000","last_clean":"2023-11-04T01:36:34.603035+0000","last_became_active":"2023-11-04T01:36:30.552004+0000","last_became_peered":"2023-11-04T01:36:30.552004+0000","last_unstale":"2023-11-04T01:36:34.603035+0000","last_undegraded":"2023-11-04T01:36:34.603035+0000","last_fullsized":"2023-11-04T01:36:34.603035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:10.369120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592230+0000","last_change":"2023-11-04T01:36:30.549121+0000","last_active":"2023-11-04T01:36:34.592230+0000","last_peered":"2023-11-04T01:36:34.592230+0000","last_clean":"2023-11-04T01:36:34.592230+0000","last_became_active":"2023-11-04T01:36:30.548845+0000","last_became_peered":"2023-11-04T01:36:30.548845+0000","last_unstale":"2023-11-04T01:36:34.592230+0000","last_undegraded":"2023-11-04T01:36:34.592230+0000","last_fullsized":"2023-11-04T01:36:34.592230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:53.928372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597717+0000","last_change":"2023-11-04T01:36:30.549624+0000","last_active":"2023-11-04T01:36:34.597717+0000","last_peered":"2023-11-04T01:36:34.597717+0000","last_clean":"2023-11-04T01:36:34.597717+0000","last_became_active":"2023-11-04T01:36:30.549352+0000","last_became_peered":"2023-11-04T01:36:30.549352+0000","last_unstale":"2023-11-04T01:36:34.597717+0000","last_undegraded":"2023-11-04T01:36:34.597717+0000","last_fullsized":"2023-11-04T01:36:34.597717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593105+0000","last_change":"2023-11-04T01:36:30.560044+0000","last_active":"2023-11-04T01:36:34.593105+0000","last_peered":"2023-11-04T01:36:34.593105+0000","last_clean":"2023-11-04T01:36:34.593105+0000","last_became_active":"2023-11-04T01:36:30.559776+0000","last_became_peered":"2023-11-04T01:36:30.559776+0000","last_unstale":"2023-11-04T01:36:34.593105+0000","last_undegraded":"2023-11-04T01:36:34.593105+0000","last_fullsized":"2023-11-04T01:36:34.593105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:36.996384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591659+0000","last_change":"2023-11-04T01:36:30.554726+0000","last_active":"2023-11-04T01:36:34.591659+0000","last_peered":"2023-11-04T01:36:34.591659+0000","last_clean":"2023-11-04T01:36:34.591659+0000","last_became_active":"2023-11-04T01:36:30.554463+0000","last_became_peered":"2023-11-04T01:36:30.554463+0000","last_unstale":"2023-11-04T01:36:34.591659+0000","last_undegraded":"2023-11-04T01:36:34.591659+0000","last_fullsized":"2023-11-04T01:36:34.591659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:29.259099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600433+0000","last_change":"2023-11-04T01:36:30.558538+0000","last_active":"2023-11-04T01:36:34.600433+0000","last_peered":"2023-11-04T01:36:34.600433+0000","last_clean":"2023-11-04T01:36:34.600433+0000","last_became_active":"2023-11-04T01:36:30.558255+0000","last_became_peered":"2023-11-04T01:36:30.558255+0000","last_unstale":"2023-11-04T01:36:34.600433+0000","last_undegraded":"2023-11-04T01:36:34.600433+0000","last_fullsized":"2023-11-04T01:36:34.600433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:26:24.912249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591246+0000","last_change":"2023-11-04T01:36:30.555242+0000","last_active":"2023-11-04T01:36:34.591246+0000","last_peered":"2023-11-04T01:36:34.591246+0000","last_clean":"2023-11-04T01:36:34.591246+0000","last_became_active":"2023-11-04T01:36:30.554999+0000","last_became_peered":"2023-11-04T01:36:30.554999+0000","last_unstale":"2023-11-04T01:36:34.591246+0000","last_undegraded":"2023-11-04T01:36:34.591246+0000","last_fullsized":"2023-11-04T01:36:34.591246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:37.615217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600436+0000","last_change":"2023-11-04T01:36:30.561171+0000","last_active":"2023-11-04T01:36:34.600436+0000","last_peered":"2023-11-04T01:36:34.600436+0000","last_clean":"2023-11-04T01:36:34.600436+0000","last_became_active":"2023-11-04T01:36:30.560077+0000","last_became_peered":"2023-11-04T01:36:30.560077+0000","last_unstale":"2023-11-04T01:36:34.600436+0000","last_undegraded":"2023-11-04T01:36:34.600436+0000","last_fullsized":"2023-11-04T01:36:34.600436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:53.928372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.602937+0000","last_change":"2023-11-04T01:36:30.559653+0000","last_active":"2023-11-04T01:36:34.602937+0000","last_peered":"2023-11-04T01:36:34.602937+0000","last_clean":"2023-11-04T01:36:34.602937+0000","last_became_active":"2023-11-04T01:36:30.559390+0000","last_became_peered":"2023-11-04T01:36:30.559390+0000","last_unstale":"2023-11-04T01:36:34.602937+0000","last_undegraded":"2023-11-04T01:36:34.602937+0000","last_fullsized":"2023-11-04T01:36:34.602937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:37.615217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592681+0000","last_change":"2023-11-04T01:36:30.553925+0000","last_active":"2023-11-04T01:36:34.592681+0000","last_peered":"2023-11-04T01:36:34.592681+0000","last_clean":"2023-11-04T01:36:34.592681+0000","last_became_active":"2023-11-04T01:36:30.553654+0000","last_became_peered":"2023-11-04T01:36:30.553654+0000","last_unstale":"2023-11-04T01:36:34.592681+0000","last_undegraded":"2023-11-04T01:36:34.592681+0000","last_fullsized":"2023-11-04T01:36:34.592681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752906+0000","last_change":"2023-11-04T01:36:30.557205+0000","last_active":"2023-11-04T01:36:34.752906+0000","last_peered":"2023-11-04T01:36:34.752906+0000","last_clean":"2023-11-04T01:36:34.752906+0000","last_became_active":"2023-11-04T01:36:30.556906+0000","last_became_peered":"2023-11-04T01:36:30.556906+0000","last_unstale":"2023-11-04T01:36:34.752906+0000","last_undegraded":"2023-11-04T01:36:34.752906+0000","last_fullsized":"2023-11-04T01:36:34.752906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:54:17.545215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603431+0000","last_change":"2023-11-04T01:36:30.548944+0000","last_active":"2023-11-04T01:36:34.603431+0000","last_peered":"2023-11-04T01:36:34.603431+0000","last_clean":"2023-11-04T01:36:34.603431+0000","last_became_active":"2023-11-04T01:36:30.548680+0000","last_became_peered":"2023-11-04T01:36:30.548680+0000","last_unstale":"2023-11-04T01:36:34.603431+0000","last_undegraded":"2023-11-04T01:36:34.603431+0000","last_fullsized":"2023-11-04T01:36:34.603431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:25.013535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601391+0000","last_change":"2023-11-04T01:36:30.560336+0000","last_active":"2023-11-04T01:36:34.601391+0000","last_peered":"2023-11-04T01:36:34.601391+0000","last_clean":"2023-11-04T01:36:34.601391+0000","last_became_active":"2023-11-04T01:36:30.559694+0000","last_became_peered":"2023-11-04T01:36:30.559694+0000","last_unstale":"2023-11-04T01:36:34.601391+0000","last_undegraded":"2023-11-04T01:36:34.601391+0000","last_fullsized":"2023-11-04T01:36:34.601391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:07.434851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600395+0000","last_change":"2023-11-04T01:36:30.553100+0000","last_active":"2023-11-04T01:36:34.600395+0000","last_peered":"2023-11-04T01:36:34.600395+0000","last_clean":"2023-11-04T01:36:34.600395+0000","last_became_active":"2023-11-04T01:36:30.552783+0000","last_became_peered":"2023-11-04T01:36:30.552783+0000","last_unstale":"2023-11-04T01:36:34.600395+0000","last_undegraded":"2023-11-04T01:36:34.600395+0000","last_fullsized":"2023-11-04T01:36:34.600395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597636+0000","last_change":"2023-11-04T01:36:30.549860+0000","last_active":"2023-11-04T01:36:34.597636+0000","last_peered":"2023-11-04T01:36:34.597636+0000","last_clean":"2023-11-04T01:36:34.597636+0000","last_became_active":"2023-11-04T01:36:30.549522+0000","last_became_peered":"2023-11-04T01:36:30.549522+0000","last_unstale":"2023-11-04T01:36:34.597636+0000","last_undegraded":"2023-11-04T01:36:34.597636+0000","last_fullsized":"2023-11-04T01:36:34.597636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:10.369120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601798+0000","last_change":"2023-11-04T01:36:30.550358+0000","last_active":"2023-11-04T01:36:34.601798+0000","last_peered":"2023-11-04T01:36:34.601798+0000","last_clean":"2023-11-04T01:36:34.601798+0000","last_became_active":"2023-11-04T01:36:30.550025+0000","last_became_peered":"2023-11-04T01:36:30.550025+0000","last_unstale":"2023-11-04T01:36:34.601798+0000","last_undegraded":"2023-11-04T01:36:34.601798+0000","last_fullsized":"2023-11-04T01:36:34.601798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:46:09.800453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590613+0000","last_change":"2023-11-04T01:36:30.552408+0000","last_active":"2023-11-04T01:36:34.590613+0000","last_peered":"2023-11-04T01:36:34.590613+0000","last_clean":"2023-11-04T01:36:34.590613+0000","last_became_active":"2023-11-04T01:36:30.552144+0000","last_became_peered":"2023-11-04T01:36:30.552144+0000","last_unstale":"2023-11-04T01:36:34.590613+0000","last_undegraded":"2023-11-04T01:36:34.590613+0000","last_fullsized":"2023-11-04T01:36:34.590613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:36.996384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592329+0000","last_change":"2023-11-04T01:36:30.551603+0000","last_active":"2023-11-04T01:36:34.592329+0000","last_peered":"2023-11-04T01:36:34.592329+0000","last_clean":"2023-11-04T01:36:34.592329+0000","last_became_active":"2023-11-04T01:36:30.551211+0000","last_became_peered":"2023-11-04T01:36:30.551211+0000","last_unstale":"2023-11-04T01:36:34.592329+0000","last_undegraded":"2023-11-04T01:36:34.592329+0000","last_fullsized":"2023-11-04T01:36:34.592329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:15:10.559940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593132+0000","last_change":"2023-11-04T01:36:30.557060+0000","last_active":"2023-11-04T01:36:34.593132+0000","last_peered":"2023-11-04T01:36:34.593132+0000","last_clean":"2023-11-04T01:36:34.593132+0000","last_became_active":"2023-11-04T01:36:30.556780+0000","last_became_peered":"2023-11-04T01:36:30.556780+0000","last_unstale":"2023-11-04T01:36:34.593132+0000","last_undegraded":"2023-11-04T01:36:34.593132+0000","last_fullsized":"2023-11-04T01:36:34.593132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:12.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593025+0000","last_change":"2023-11-04T01:36:30.557384+0000","last_active":"2023-11-04T01:36:34.593025+0000","last_peered":"2023-11-04T01:36:34.593025+0000","last_clean":"2023-11-04T01:36:34.593025+0000","last_became_active":"2023-11-04T01:36:30.556515+0000","last_became_peered":"2023-11-04T01:36:30.556515+0000","last_unstale":"2023-11-04T01:36:34.593025+0000","last_undegraded":"2023-11-04T01:36:34.593025+0000","last_fullsized":"2023-11-04T01:36:34.593025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:36.976993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752897+0000","last_change":"2023-11-04T01:36:30.558458+0000","last_active":"2023-11-04T01:36:34.752897+0000","last_peered":"2023-11-04T01:36:34.752897+0000","last_clean":"2023-11-04T01:36:34.752897+0000","last_became_active":"2023-11-04T01:36:30.558111+0000","last_became_peered":"2023-11-04T01:36:30.558111+0000","last_unstale":"2023-11-04T01:36:34.752897+0000","last_undegraded":"2023-11-04T01:36:34.752897+0000","last_fullsized":"2023-11-04T01:36:34.752897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:47.484051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590565+0000","last_change":"2023-11-04T01:36:30.558798+0000","last_active":"2023-11-04T01:36:34.590565+0000","last_peered":"2023-11-04T01:36:34.590565+0000","last_clean":"2023-11-04T01:36:34.590565+0000","last_became_active":"2023-11-04T01:36:30.558197+0000","last_became_peered":"2023-11-04T01:36:30.558197+0000","last_unstale":"2023-11-04T01:36:34.590565+0000","last_undegraded":"2023-11-04T01:36:34.590565+0000","last_fullsized":"2023-11-04T01:36:34.590565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:36.976993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752395+0000","last_change":"2023-11-04T01:36:30.556288+0000","last_active":"2023-11-04T01:36:34.752395+0000","last_peered":"2023-11-04T01:36:34.752395+0000","last_clean":"2023-11-04T01:36:34.752395+0000","last_became_active":"2023-11-04T01:36:30.556011+0000","last_became_peered":"2023-11-04T01:36:30.556011+0000","last_unstale":"2023-11-04T01:36:34.752395+0000","last_undegraded":"2023-11-04T01:36:34.752395+0000","last_fullsized":"2023-11-04T01:36:34.752395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:50.307002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600393+0000","last_change":"2023-11-04T01:36:30.556023+0000","last_active":"2023-11-04T01:36:34.600393+0000","last_peered":"2023-11-04T01:36:34.600393+0000","last_clean":"2023-11-04T01:36:34.600393+0000","last_became_active":"2023-11-04T01:36:30.555394+0000","last_became_peered":"2023-11-04T01:36:30.555394+0000","last_unstale":"2023-11-04T01:36:34.600393+0000","last_undegraded":"2023-11-04T01:36:34.600393+0000","last_fullsized":"2023-11-04T01:36:34.600393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.045633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752224+0000","last_change":"2023-11-04T01:36:30.555404+0000","last_active":"2023-11-04T01:36:34.752224+0000","last_peered":"2023-11-04T01:36:34.752224+0000","last_clean":"2023-11-04T01:36:34.752224+0000","last_became_active":"2023-11-04T01:36:30.555125+0000","last_became_peered":"2023-11-04T01:36:30.555125+0000","last_unstale":"2023-11-04T01:36:34.752224+0000","last_undegraded":"2023-11-04T01:36:34.752224+0000","last_fullsized":"2023-11-04T01:36:34.752224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:05.575722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600734+0000","last_change":"2023-11-04T01:36:30.559120+0000","last_active":"2023-11-04T01:36:34.600734+0000","last_peered":"2023-11-04T01:36:34.600734+0000","last_clean":"2023-11-04T01:36:34.600734+0000","last_became_active":"2023-11-04T01:36:30.558412+0000","last_became_peered":"2023-11-04T01:36:30.558412+0000","last_unstale":"2023-11-04T01:36:34.600734+0000","last_undegraded":"2023-11-04T01:36:34.600734+0000","last_fullsized":"2023-11-04T01:36:34.600734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:29.259099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601077+0000","last_change":"2023-11-04T01:36:30.552546+0000","last_active":"2023-11-04T01:36:34.601077+0000","last_peered":"2023-11-04T01:36:34.601077+0000","last_clean":"2023-11-04T01:36:34.601077+0000","last_became_active":"2023-11-04T01:36:30.551809+0000","last_became_peered":"2023-11-04T01:36:30.551809+0000","last_unstale":"2023-11-04T01:36:34.601077+0000","last_undegraded":"2023-11-04T01:36:34.601077+0000","last_fullsized":"2023-11-04T01:36:34.601077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:12.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597814+0000","last_change":"2023-11-04T01:36:30.554657+0000","last_active":"2023-11-04T01:36:34.597814+0000","last_peered":"2023-11-04T01:36:34.597814+0000","last_clean":"2023-11-04T01:36:34.597814+0000","last_became_active":"2023-11-04T01:36:30.554335+0000","last_became_peered":"2023-11-04T01:36:30.554335+0000","last_unstale":"2023-11-04T01:36:34.597814+0000","last_undegraded":"2023-11-04T01:36:34.597814+0000","last_fullsized":"2023-11-04T01:36:34.597814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.045633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752772+0000","last_change":"2023-11-04T01:36:30.557755+0000","last_active":"2023-11-04T01:36:34.752772+0000","last_peered":"2023-11-04T01:36:34.752772+0000","last_clean":"2023-11-04T01:36:34.752772+0000","last_became_active":"2023-11-04T01:36:30.557432+0000","last_became_peered":"2023-11-04T01:36:30.557432+0000","last_unstale":"2023-11-04T01:36:34.752772+0000","last_undegraded":"2023-11-04T01:36:34.752772+0000","last_fullsized":"2023-11-04T01:36:34.752772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:55:41.729195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":690798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:36:54.584 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:36:54.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.716+0000 7fd35a1ce640 1 Processor -- start 2023-11-04T01:36:54.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.716+0000 7fd35a1ce640 1 -- start start 2023-11-04T01:36:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.716+0000 7fd35a1ce640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd3540d0db0 0x7fd3540b4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.716+0000 7fd35a1ce640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3540b62c0 con 0x7fd3540b5d50 2023-11-04T01:36:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.716+0000 7fd35a1ce640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3540b65a0 con 0x7fd35415cdf0 2023-11-04T01:36:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.716+0000 7fd35a1ce640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3540b6880 con 0x7fd3540d0db0 2023-11-04T01:36:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.717+0000 7fd353fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd3540b5d50 0x7fd3540b7360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41216/0 (socket says 172.21.15.114:41216) 2023-11-04T01:36:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.717+0000 7fd353fff640 1 -- 172.21.15.114:0/377242990 learned_addr learned my addr 172.21.15.114:0/377242990 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.717+0000 7fd352ffd640 1 --2- 172.21.15.114:0/377242990 >> v2:172.21.15.141:3300/0 conn(0x7fd3540d0db0 0x7fd3540b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.717+0000 7fd3527fc640 1 -- 172.21.15.114:0/377242990 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327219480 0 0) 0x7fd3540b62c0 con 0x7fd3540b5d50 2023-11-04T01:36:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.717+0000 7fd3527fc640 1 -- 172.21.15.114:0/377242990 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd33c003520 con 0x7fd3540b5d50 2023-11-04T01:36:54.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.717+0000 7fd352ffd640 1 -- 172.21.15.114:0/377242990 >> v1:172.21.15.141:6789/0 conn(0x7fd35415cdf0 legacy=0x7fd3540b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.717+0000 7fd3527fc640 1 -- 172.21.15.114:0/377242990 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 703099096 0 0) 0x7fd33c003520 con 0x7fd3540b5d50 2023-11-04T01:36:54.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.717+0000 7fd352ffd640 1 -- 172.21.15.114:0/377242990 >> v1:172.21.15.114:6789/0 conn(0x7fd3540b5d50 legacy=0x7fd3540b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.717+0000 7fd352ffd640 1 -- 172.21.15.114:0/377242990 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3540b6b60 con 0x7fd3540d0db0 2023-11-04T01:36:54.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.718+0000 7fd352ffd640 1 --2- 172.21.15.114:0/377242990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3540d0db0 0x7fd3540b4810 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd3480097a0 tx=0x7fd34802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ed7d05dda02b676 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.718+0000 7fd3527fc640 1 -- 172.21.15.114:0/377242990 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0019f0 con 0x7fd3540d0db0 2023-11-04T01:36:54.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.718+0000 7fd3527fc640 1 -- 172.21.15.114:0/377242990 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd348031590 con 0x7fd3540d0db0 2023-11-04T01:36:54.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.718+0000 7fd3527fc640 1 -- 172.21.15.114:0/377242990 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348031900 con 0x7fd3540d0db0 2023-11-04T01:36:54.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.718+0000 7fd35a1ce640 1 -- 172.21.15.114:0/377242990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3540d0db0 msgr2=0x7fd3540b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.718+0000 7fd35a1ce640 1 --2- 172.21.15.114:0/377242990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3540d0db0 0x7fd3540b4810 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd3480097a0 tx=0x7fd34802b8b0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.719+0000 7fd35a1ce640 1 -- 172.21.15.114:0/377242990 shutdown_connections 2023-11-04T01:36:54.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.719+0000 7fd35a1ce640 1 --2- 172.21.15.114:0/377242990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3540d0db0 0x7fd3540b4810 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.719+0000 7fd35a1ce640 1 -- 172.21.15.114:0/377242990 >> 172.21.15.114:0/377242990 conn(0x7fd354071c70 msgr2=0x7fd354072080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.719+0000 7fd35a1ce640 1 -- 172.21.15.114:0/377242990 shutdown_connections 2023-11-04T01:36:54.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.719+0000 7fd35a1ce640 1 -- 172.21.15.114:0/377242990 wait complete. 2023-11-04T01:36:54.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.720+0000 7fd35a1ce640 1 Processor -- start 2023-11-04T01:36:54.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.720+0000 7fd35a1ce640 1 -- start start 2023-11-04T01:36:54.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.720+0000 7fd35a1ce640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3540b5d50 0x7fd35414c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd35a1ce640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3540d0db0 0x7fd3540c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd35a1ce640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35415cdf0 0x7fd35415b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd35a1ce640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3540c80e0 con 0x7fd35415cdf0 2023-11-04T01:36:54.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd35a1ce640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3540ca420 con 0x7fd3540b5d50 2023-11-04T01:36:54.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd35a1ce640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3540c6900 con 0x7fd3540d0db0 2023-11-04T01:36:54.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd353fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35415cdf0 0x7fd35415b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd353fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35415cdf0 0x7fd35415b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49630/0 (socket says 172.21.15.114:49630) 2023-11-04T01:36:54.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd353fff640 1 -- 172.21.15.114:0/2634406430 learned_addr learned my addr 172.21.15.114:0/2634406430 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:54.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd352ffd640 1 --2- 172.21.15.114:0/2634406430 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3540d0db0 0x7fd3540c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd3537fe640 1 --2- 172.21.15.114:0/2634406430 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3540b5d50 0x7fd35414c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd353fff640 1 -- 172.21.15.114:0/2634406430 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3540d0db0 msgr2=0x7fd3540c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd353fff640 1 --2- 172.21.15.114:0/2634406430 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3540d0db0 0x7fd3540c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd353fff640 1 -- 172.21.15.114:0/2634406430 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3540b5d50 msgr2=0x7fd35414c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd353fff640 1 --2- 172.21.15.114:0/2634406430 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3540b5d50 0x7fd35414c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd353fff640 1 -- 172.21.15.114:0/2634406430 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd348009400 con 0x7fd35415cdf0 2023-11-04T01:36:54.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd353fff640 1 --2- 172.21.15.114:0/2634406430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35415cdf0 0x7fd35415b480 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd34c001830 tx=0x7fd34c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd33bfff640 1 -- 172.21.15.114:0/2634406430 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c012400 con 0x7fd35415cdf0 2023-11-04T01:36:54.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd33bfff640 1 -- 172.21.15.114:0/2634406430 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c012560 con 0x7fd35415cdf0 2023-11-04T01:36:54.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd33bfff640 1 -- 172.21.15.114:0/2634406430 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c012910 con 0x7fd35415cdf0 2023-11-04T01:36:54.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd35a1ce640 1 -- 172.21.15.114:0/2634406430 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3540c7d40 con 0x7fd35415cdf0 2023-11-04T01:36:54.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.721+0000 7fd35a1ce640 1 -- 172.21.15.114:0/2634406430 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3540c6df0 con 0x7fd35415cdf0 2023-11-04T01:36:54.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.722+0000 7fd35a1ce640 1 -- 172.21.15.114:0/2634406430 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd354067c50 con 0x7fd35415cdf0 2023-11-04T01:36:54.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.723+0000 7fd33bfff640 1 -- 172.21.15.114:0/2634406430 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd34c012a70 con 0x7fd35415cdf0 2023-11-04T01:36:54.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.723+0000 7fd33bfff640 1 --2- 172.21.15.114:0/2634406430 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd34006ae70 0x7fd34006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:54.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.723+0000 7fd33bfff640 1 -- 172.21.15.114:0/2634406430 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd34c08a090 con 0x7fd35415cdf0 2023-11-04T01:36:54.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.723+0000 7fd3537fe640 1 --2- 172.21.15.114:0/2634406430 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd34006ae70 0x7fd34006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:54.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.724+0000 7fd3537fe640 1 --2- 172.21.15.114:0/2634406430 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd34006ae70 0x7fd34006d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd344000f60 tx=0x7fd344009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:54.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.727+0000 7fd33bfff640 1 -- 172.21.15.114:0/2634406430 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd34c054e50 con 0x7fd35415cdf0 2023-11-04T01:36:54.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.890+0000 7fd35a1ce640 1 -- 172.21.15.114:0/2634406430 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3540b8ce0 con 0x7fd34006ae70 2023-11-04T01:36:54.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.898+0000 7fd33bfff640 1 -- 172.21.15.114:0/2634406430 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345257 (secure 0 0 0) 0x7fd3440050d0 con 0x7fd34006ae70 2023-11-04T01:36:54.904 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:54.905 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:36:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.902+0000 7fd35a1ce640 1 -- 172.21.15.114:0/2634406430 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd34006ae70 msgr2=0x7fd34006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.902+0000 7fd35a1ce640 1 --2- 172.21.15.114:0/2634406430 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd34006ae70 0x7fd34006d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd344000f60 tx=0x7fd344009040 comp rx=0 tx=0).stop 2023-11-04T01:36:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.902+0000 7fd35a1ce640 1 -- 172.21.15.114:0/2634406430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35415cdf0 msgr2=0x7fd35415b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.902+0000 7fd35a1ce640 1 --2- 172.21.15.114:0/2634406430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35415cdf0 0x7fd35415b480 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd34c001830 tx=0x7fd34c00a430 comp rx=0 tx=0).stop 2023-11-04T01:36:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.902+0000 7fd35a1ce640 1 -- 172.21.15.114:0/2634406430 shutdown_connections 2023-11-04T01:36:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.902+0000 7fd35a1ce640 1 --2- 172.21.15.114:0/2634406430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35415cdf0 0x7fd35415b480 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.902+0000 7fd35a1ce640 1 --2- 172.21.15.114:0/2634406430 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd3540d0db0 0x7fd3540c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.902+0000 7fd35a1ce640 1 --2- 172.21.15.114:0/2634406430 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd34006ae70 0x7fd34006d330 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.902+0000 7fd35a1ce640 1 --2- 172.21.15.114:0/2634406430 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd3540b5d50 0x7fd35414c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.902+0000 7fd35a1ce640 1 -- 172.21.15.114:0/2634406430 >> 172.21.15.114:0/2634406430 conn(0x7fd354071c70 msgr2=0x7fd3540b85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.902+0000 7fd35a1ce640 1 -- 172.21.15.114:0/2634406430 shutdown_connections 2023-11-04T01:36:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:54.902+0000 7fd35a1ce640 1 -- 172.21.15.114:0/2634406430 wait complete. 2023-11-04T01:36:54.914 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-11-04T01:36:53.862728+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1988350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002521"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601943+0000","last_change":"2023-11-04T01:36:29.561242+0000","last_active":"2023-11-04T01:36:34.601943+0000","last_peered":"2023-11-04T01:36:34.601943+0000","last_clean":"2023-11-04T01:36:34.601943+0000","last_became_active":"2023-11-04T01:36:29.560999+0000","last_became_peered":"2023-11-04T01:36:29.560999+0000","last_unstale":"2023-11-04T01:36:34.601943+0000","last_undegraded":"2023-11-04T01:36:34.601943+0000","last_fullsized":"2023-11-04T01:36:34.601943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:24.009190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591589+0000","last_change":"2023-11-04T01:36:30.553781+0000","last_active":"2023-11-04T01:36:34.591589+0000","last_peered":"2023-11-04T01:36:34.591589+0000","last_clean":"2023-11-04T01:36:34.591589+0000","last_became_active":"2023-11-04T01:36:30.553037+0000","last_became_peered":"2023-11-04T01:36:30.553037+0000","last_unstale":"2023-11-04T01:36:34.591589+0000","last_undegraded":"2023-11-04T01:36:34.591589+0000","last_fullsized":"2023-11-04T01:36:34.591589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:12.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597204+0000","last_change":"2023-11-04T01:36:34.756965+0000","last_active":"2023-11-04T01:36:35.597204+0000","last_peered":"2023-11-04T01:36:35.597204+0000","last_clean":"2023-11-04T01:36:35.597204+0000","last_became_active":"2023-11-04T01:36:34.756574+0000","last_became_peered":"2023-11-04T01:36:34.756574+0000","last_unstale":"2023-11-04T01:36:35.597204+0000","last_undegraded":"2023-11-04T01:36:35.597204+0000","last_fullsized":"2023-11-04T01:36:35.597204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:51.521044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591774+0000","last_change":"2023-11-04T01:36:29.560879+0000","last_active":"2023-11-04T01:36:34.591774+0000","last_peered":"2023-11-04T01:36:34.591774+0000","last_clean":"2023-11-04T01:36:34.591774+0000","last_became_active":"2023-11-04T01:36:29.560620+0000","last_became_peered":"2023-11-04T01:36:29.560620+0000","last_unstale":"2023-11-04T01:36:34.591774+0000","last_undegraded":"2023-11-04T01:36:34.591774+0000","last_fullsized":"2023-11-04T01:36:34.591774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:46:08.796108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601678+0000","last_change":"2023-11-04T01:36:30.557037+0000","last_active":"2023-11-04T01:36:34.601678+0000","last_peered":"2023-11-04T01:36:34.601678+0000","last_clean":"2023-11-04T01:36:34.601678+0000","last_became_active":"2023-11-04T01:36:30.556650+0000","last_became_peered":"2023-11-04T01:36:30.556650+0000","last_unstale":"2023-11-04T01:36:34.601678+0000","last_undegraded":"2023-11-04T01:36:34.601678+0000","last_fullsized":"2023-11-04T01:36:34.601678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539725+0000","last_change":"2023-11-04T01:36:34.610121+0000","last_active":"2023-11-04T01:36:35.539725+0000","last_peered":"2023-11-04T01:36:35.539725+0000","last_clean":"2023-11-04T01:36:35.539725+0000","last_became_active":"2023-11-04T01:36:34.609174+0000","last_became_peered":"2023-11-04T01:36:34.609174+0000","last_unstale":"2023-11-04T01:36:35.539725+0000","last_undegraded":"2023-11-04T01:36:35.539725+0000","last_fullsized":"2023-11-04T01:36:35.539725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:26:28.949242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752732+0000","last_change":"2023-11-04T01:36:29.568730+0000","last_active":"2023-11-04T01:36:34.752732+0000","last_peered":"2023-11-04T01:36:34.752732+0000","last_clean":"2023-11-04T01:36:34.752732+0000","last_became_active":"2023-11-04T01:36:29.568238+0000","last_became_peered":"2023-11-04T01:36:29.568238+0000","last_unstale":"2023-11-04T01:36:34.752732+0000","last_undegraded":"2023-11-04T01:36:34.752732+0000","last_fullsized":"2023-11-04T01:36:34.752732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:35.972647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600781+0000","last_change":"2023-11-04T01:36:30.555874+0000","last_active":"2023-11-04T01:36:34.600781+0000","last_peered":"2023-11-04T01:36:34.600781+0000","last_clean":"2023-11-04T01:36:34.600781+0000","last_became_active":"2023-11-04T01:36:30.555047+0000","last_became_peered":"2023-11-04T01:36:30.555047+0000","last_unstale":"2023-11-04T01:36:34.600781+0000","last_undegraded":"2023-11-04T01:36:34.600781+0000","last_fullsized":"2023-11-04T01:36:34.600781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:14.190359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540452+0000","last_change":"2023-11-04T01:36:34.609278+0000","last_active":"2023-11-04T01:36:35.540452+0000","last_peered":"2023-11-04T01:36:35.540452+0000","last_clean":"2023-11-04T01:36:35.540452+0000","last_became_active":"2023-11-04T01:36:34.608869+0000","last_became_peered":"2023-11-04T01:36:34.608869+0000","last_unstale":"2023-11-04T01:36:35.540452+0000","last_undegraded":"2023-11-04T01:36:35.540452+0000","last_fullsized":"2023-11-04T01:36:35.540452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:31.223962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752371+0000","last_change":"2023-11-04T01:36:29.566622+0000","last_active":"2023-11-04T01:36:34.752371+0000","last_peered":"2023-11-04T01:36:34.752371+0000","last_clean":"2023-11-04T01:36:34.752371+0000","last_became_active":"2023-11-04T01:36:29.566344+0000","last_became_peered":"2023-11-04T01:36:29.566344+0000","last_unstale":"2023-11-04T01:36:34.752371+0000","last_undegraded":"2023-11-04T01:36:34.752371+0000","last_fullsized":"2023-11-04T01:36:34.752371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:28.954776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600963+0000","last_change":"2023-11-04T01:36:30.555732+0000","last_active":"2023-11-04T01:36:34.600963+0000","last_peered":"2023-11-04T01:36:34.600963+0000","last_clean":"2023-11-04T01:36:34.600963+0000","last_became_active":"2023-11-04T01:36:30.555435+0000","last_became_peered":"2023-11-04T01:36:30.555435+0000","last_unstale":"2023-11-04T01:36:34.600963+0000","last_undegraded":"2023-11-04T01:36:34.600963+0000","last_fullsized":"2023-11-04T01:36:34.600963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:24.536087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539719+0000","last_change":"2023-11-04T01:36:34.610431+0000","last_active":"2023-11-04T01:36:35.539719+0000","last_peered":"2023-11-04T01:36:35.539719+0000","last_clean":"2023-11-04T01:36:35.539719+0000","last_became_active":"2023-11-04T01:36:34.609116+0000","last_became_peered":"2023-11-04T01:36:34.609116+0000","last_unstale":"2023-11-04T01:36:35.539719+0000","last_undegraded":"2023-11-04T01:36:35.539719+0000","last_fullsized":"2023-11-04T01:36:35.539719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:19.082626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592957+0000","last_change":"2023-11-04T01:36:30.552617+0000","last_active":"2023-11-04T01:36:34.592957+0000","last_peered":"2023-11-04T01:36:34.592957+0000","last_clean":"2023-11-04T01:36:34.592957+0000","last_became_active":"2023-11-04T01:36:30.552315+0000","last_became_peered":"2023-11-04T01:36:30.552315+0000","last_unstale":"2023-11-04T01:36:34.592957+0000","last_undegraded":"2023-11-04T01:36:34.592957+0000","last_fullsized":"2023-11-04T01:36:34.592957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:10.369120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752388+0000","last_change":"2023-11-04T01:36:29.568663+0000","last_active":"2023-11-04T01:36:34.752388+0000","last_peered":"2023-11-04T01:36:34.752388+0000","last_clean":"2023-11-04T01:36:34.752388+0000","last_became_active":"2023-11-04T01:36:29.568262+0000","last_became_peered":"2023-11-04T01:36:29.568262+0000","last_unstale":"2023-11-04T01:36:34.752388+0000","last_undegraded":"2023-11-04T01:36:34.752388+0000","last_fullsized":"2023-11-04T01:36:34.752388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:11.541445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540192+0000","last_change":"2023-11-04T01:36:34.607200+0000","last_active":"2023-11-04T01:36:35.540192+0000","last_peered":"2023-11-04T01:36:35.540192+0000","last_clean":"2023-11-04T01:36:35.540192+0000","last_became_active":"2023-11-04T01:36:34.606762+0000","last_became_peered":"2023-11-04T01:36:34.606762+0000","last_unstale":"2023-11-04T01:36:35.540192+0000","last_undegraded":"2023-11-04T01:36:35.540192+0000","last_fullsized":"2023-11-04T01:36:35.540192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:54.343995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591387+0000","last_change":"2023-11-04T01:36:30.555385+0000","last_active":"2023-11-04T01:36:34.591387+0000","last_peered":"2023-11-04T01:36:34.591387+0000","last_clean":"2023-11-04T01:36:34.591387+0000","last_became_active":"2023-11-04T01:36:30.555109+0000","last_became_peered":"2023-11-04T01:36:30.555109+0000","last_unstale":"2023-11-04T01:36:34.591387+0000","last_undegraded":"2023-11-04T01:36:34.591387+0000","last_fullsized":"2023-11-04T01:36:34.591387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:26:24.912249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597945+0000","last_change":"2023-11-04T01:36:29.568618+0000","last_active":"2023-11-04T01:36:34.597945+0000","last_peered":"2023-11-04T01:36:34.597945+0000","last_clean":"2023-11-04T01:36:34.597945+0000","last_became_active":"2023-11-04T01:36:29.568318+0000","last_became_peered":"2023-11-04T01:36:29.568318+0000","last_unstale":"2023-11-04T01:36:34.597945+0000","last_undegraded":"2023-11-04T01:36:34.597945+0000","last_fullsized":"2023-11-04T01:36:34.597945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:55.902083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540096+0000","last_change":"2023-11-04T01:36:34.609429+0000","last_active":"2023-11-04T01:36:35.540096+0000","last_peered":"2023-11-04T01:36:35.540096+0000","last_clean":"2023-11-04T01:36:35.540096+0000","last_became_active":"2023-11-04T01:36:34.608964+0000","last_became_peered":"2023-11-04T01:36:34.608964+0000","last_unstale":"2023-11-04T01:36:35.540096+0000","last_undegraded":"2023-11-04T01:36:35.540096+0000","last_fullsized":"2023-11-04T01:36:35.540096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:18.227352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591308+0000","last_change":"2023-11-04T01:36:30.548722+0000","last_active":"2023-11-04T01:36:34.591308+0000","last_peered":"2023-11-04T01:36:34.591308+0000","last_clean":"2023-11-04T01:36:34.591308+0000","last_became_active":"2023-11-04T01:36:30.548380+0000","last_became_peered":"2023-11-04T01:36:30.548380+0000","last_unstale":"2023-11-04T01:36:34.591308+0000","last_undegraded":"2023-11-04T01:36:34.591308+0000","last_fullsized":"2023-11-04T01:36:34.591308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:10.369120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597698+0000","last_change":"2023-11-04T01:36:29.563976+0000","last_active":"2023-11-04T01:36:34.597698+0000","last_peered":"2023-11-04T01:36:34.597698+0000","last_clean":"2023-11-04T01:36:34.597698+0000","last_became_active":"2023-11-04T01:36:29.563703+0000","last_became_peered":"2023-11-04T01:36:29.563703+0000","last_unstale":"2023-11-04T01:36:34.597698+0000","last_undegraded":"2023-11-04T01:36:34.597698+0000","last_fullsized":"2023-11-04T01:36:34.597698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:19.388284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597228+0000","last_change":"2023-11-04T01:36:34.754663+0000","last_active":"2023-11-04T01:36:35.597228+0000","last_peered":"2023-11-04T01:36:35.597228+0000","last_clean":"2023-11-04T01:36:35.597228+0000","last_became_active":"2023-11-04T01:36:34.754298+0000","last_became_peered":"2023-11-04T01:36:34.754298+0000","last_unstale":"2023-11-04T01:36:35.597228+0000","last_undegraded":"2023-11-04T01:36:35.597228+0000","last_fullsized":"2023-11-04T01:36:35.597228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:11.471843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593223+0000","last_change":"2023-11-04T01:36:30.552453+0000","last_active":"2023-11-04T01:36:34.593223+0000","last_peered":"2023-11-04T01:36:34.593223+0000","last_clean":"2023-11-04T01:36:34.593223+0000","last_became_active":"2023-11-04T01:36:30.551991+0000","last_became_peered":"2023-11-04T01:36:30.551991+0000","last_unstale":"2023-11-04T01:36:34.593223+0000","last_undegraded":"2023-11-04T01:36:34.593223+0000","last_fullsized":"2023-11-04T01:36:34.593223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:09.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.751896+0000","last_change":"2023-11-04T01:36:29.566350+0000","last_active":"2023-11-04T01:36:34.751896+0000","last_peered":"2023-11-04T01:36:34.751896+0000","last_clean":"2023-11-04T01:36:34.751896+0000","last_became_active":"2023-11-04T01:36:29.566017+0000","last_became_peered":"2023-11-04T01:36:29.566017+0000","last_unstale":"2023-11-04T01:36:34.751896+0000","last_undegraded":"2023-11-04T01:36:34.751896+0000","last_fullsized":"2023-11-04T01:36:34.751896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:14.041288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539829+0000","last_change":"2023-11-04T01:36:34.610359+0000","last_active":"2023-11-04T01:36:35.539829+0000","last_peered":"2023-11-04T01:36:35.539829+0000","last_clean":"2023-11-04T01:36:35.539829+0000","last_became_active":"2023-11-04T01:36:34.609199+0000","last_became_peered":"2023-11-04T01:36:34.609199+0000","last_unstale":"2023-11-04T01:36:35.539829+0000","last_undegraded":"2023-11-04T01:36:35.539829+0000","last_fullsized":"2023-11-04T01:36:35.539829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:33.296091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601796+0000","last_change":"2023-11-04T01:36:30.552716+0000","last_active":"2023-11-04T01:36:34.601796+0000","last_peered":"2023-11-04T01:36:34.601796+0000","last_clean":"2023-11-04T01:36:34.601796+0000","last_became_active":"2023-11-04T01:36:30.552100+0000","last_became_peered":"2023-11-04T01:36:30.552100+0000","last_unstale":"2023-11-04T01:36:34.601796+0000","last_undegraded":"2023-11-04T01:36:34.601796+0000","last_fullsized":"2023-11-04T01:36:34.601796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:36.996384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593302+0000","last_change":"2023-11-04T01:36:29.559145+0000","last_active":"2023-11-04T01:36:34.593302+0000","last_peered":"2023-11-04T01:36:34.593302+0000","last_clean":"2023-11-04T01:36:34.593302+0000","last_became_active":"2023-11-04T01:36:29.558717+0000","last_became_peered":"2023-11-04T01:36:29.558717+0000","last_unstale":"2023-11-04T01:36:34.593302+0000","last_undegraded":"2023-11-04T01:36:34.593302+0000","last_fullsized":"2023-11-04T01:36:34.593302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:27.522090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540333+0000","last_change":"2023-11-04T01:36:34.757021+0000","last_active":"2023-11-04T01:36:35.540333+0000","last_peered":"2023-11-04T01:36:35.540333+0000","last_clean":"2023-11-04T01:36:35.540333+0000","last_became_active":"2023-11-04T01:36:34.756621+0000","last_became_peered":"2023-11-04T01:36:34.756621+0000","last_unstale":"2023-11-04T01:36:35.540333+0000","last_undegraded":"2023-11-04T01:36:35.540333+0000","last_fullsized":"2023-11-04T01:36:35.540333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:09.612714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591751+0000","last_change":"2023-11-04T01:36:30.558233+0000","last_active":"2023-11-04T01:36:34.591751+0000","last_peered":"2023-11-04T01:36:34.591751+0000","last_clean":"2023-11-04T01:36:34.591751+0000","last_became_active":"2023-11-04T01:36:30.557978+0000","last_became_peered":"2023-11-04T01:36:30.557978+0000","last_unstale":"2023-11-04T01:36:34.591751+0000","last_undegraded":"2023-11-04T01:36:34.591751+0000","last_fullsized":"2023-11-04T01:36:34.591751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.045633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597917+0000","last_change":"2023-11-04T01:36:29.562995+0000","last_active":"2023-11-04T01:36:34.597917+0000","last_peered":"2023-11-04T01:36:34.597917+0000","last_clean":"2023-11-04T01:36:34.597917+0000","last_became_active":"2023-11-04T01:36:29.561703+0000","last_became_peered":"2023-11-04T01:36:29.561703+0000","last_unstale":"2023-11-04T01:36:34.597917+0000","last_undegraded":"2023-11-04T01:36:34.597917+0000","last_fullsized":"2023-11-04T01:36:34.597917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:24.009190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.595578+0000","last_change":"2023-11-04T01:36:34.754583+0000","last_active":"2023-11-04T01:36:35.595578+0000","last_peered":"2023-11-04T01:36:35.595578+0000","last_clean":"2023-11-04T01:36:35.595578+0000","last_became_active":"2023-11-04T01:36:34.754217+0000","last_became_peered":"2023-11-04T01:36:34.754217+0000","last_unstale":"2023-11-04T01:36:35.595578+0000","last_undegraded":"2023-11-04T01:36:35.595578+0000","last_fullsized":"2023-11-04T01:36:35.595578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:52.513758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597832+0000","last_change":"2023-11-04T01:36:30.551747+0000","last_active":"2023-11-04T01:36:34.597832+0000","last_peered":"2023-11-04T01:36:34.597832+0000","last_clean":"2023-11-04T01:36:34.597832+0000","last_became_active":"2023-11-04T01:36:30.551482+0000","last_became_peered":"2023-11-04T01:36:30.551482+0000","last_unstale":"2023-11-04T01:36:34.597832+0000","last_undegraded":"2023-11-04T01:36:34.597832+0000","last_fullsized":"2023-11-04T01:36:34.597832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:36.996384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752833+0000","last_change":"2023-11-04T01:36:29.571353+0000","last_active":"2023-11-04T01:36:34.752833+0000","last_peered":"2023-11-04T01:36:34.752833+0000","last_clean":"2023-11-04T01:36:34.752833+0000","last_became_active":"2023-11-04T01:36:29.571116+0000","last_became_peered":"2023-11-04T01:36:29.571116+0000","last_unstale":"2023-11-04T01:36:34.752833+0000","last_undegraded":"2023-11-04T01:36:34.752833+0000","last_fullsized":"2023-11-04T01:36:34.752833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:28.254753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597205+0000","last_change":"2023-11-04T01:36:34.752449+0000","last_active":"2023-11-04T01:36:35.597205+0000","last_peered":"2023-11-04T01:36:35.597205+0000","last_clean":"2023-11-04T01:36:35.597205+0000","last_became_active":"2023-11-04T01:36:34.752021+0000","last_became_peered":"2023-11-04T01:36:34.752021+0000","last_unstale":"2023-11-04T01:36:35.597205+0000","last_undegraded":"2023-11-04T01:36:35.597205+0000","last_fullsized":"2023-11-04T01:36:35.597205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:09.612714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600961+0000","last_change":"2023-11-04T01:36:30.558205+0000","last_active":"2023-11-04T01:36:34.600961+0000","last_peered":"2023-11-04T01:36:34.600961+0000","last_clean":"2023-11-04T01:36:34.600961+0000","last_became_active":"2023-11-04T01:36:30.557948+0000","last_became_peered":"2023-11-04T01:36:30.557948+0000","last_unstale":"2023-11-04T01:36:34.600961+0000","last_undegraded":"2023-11-04T01:36:34.600961+0000","last_fullsized":"2023-11-04T01:36:34.600961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:05.575722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597915+0000","last_change":"2023-11-04T01:36:29.566447+0000","last_active":"2023-11-04T01:36:34.597915+0000","last_peered":"2023-11-04T01:36:34.597915+0000","last_clean":"2023-11-04T01:36:34.597915+0000","last_became_active":"2023-11-04T01:36:29.566149+0000","last_became_peered":"2023-11-04T01:36:29.566149+0000","last_unstale":"2023-11-04T01:36:34.597915+0000","last_undegraded":"2023-11-04T01:36:34.597915+0000","last_fullsized":"2023-11-04T01:36:34.597915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:36.610872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.596192+0000","last_change":"2023-11-04T01:36:34.612816+0000","last_active":"2023-11-04T01:36:35.596192+0000","last_peered":"2023-11-04T01:36:35.596192+0000","last_clean":"2023-11-04T01:36:35.596192+0000","last_became_active":"2023-11-04T01:36:34.612411+0000","last_became_peered":"2023-11-04T01:36:34.612411+0000","last_unstale":"2023-11-04T01:36:35.596192+0000","last_undegraded":"2023-11-04T01:36:35.596192+0000","last_fullsized":"2023-11-04T01:36:35.596192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:28.573079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592465+0000","last_change":"2023-11-04T01:36:30.553297+0000","last_active":"2023-11-04T01:36:34.592465+0000","last_peered":"2023-11-04T01:36:34.592465+0000","last_clean":"2023-11-04T01:36:34.592465+0000","last_became_active":"2023-11-04T01:36:30.552992+0000","last_became_peered":"2023-11-04T01:36:30.552992+0000","last_unstale":"2023-11-04T01:36:34.592465+0000","last_undegraded":"2023-11-04T01:36:34.592465+0000","last_fullsized":"2023-11-04T01:36:34.592465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:25.013535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600577+0000","last_change":"2023-11-04T01:36:29.564983+0000","last_active":"2023-11-04T01:36:34.600577+0000","last_peered":"2023-11-04T01:36:34.600577+0000","last_clean":"2023-11-04T01:36:34.600577+0000","last_became_active":"2023-11-04T01:36:29.564679+0000","last_became_peered":"2023-11-04T01:36:29.564679+0000","last_unstale":"2023-11-04T01:36:34.600577+0000","last_undegraded":"2023-11-04T01:36:34.600577+0000","last_fullsized":"2023-11-04T01:36:34.600577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:35.972647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.596517+0000","last_change":"2023-11-04T01:36:34.609968+0000","last_active":"2023-11-04T01:36:35.596517+0000","last_peered":"2023-11-04T01:36:35.596517+0000","last_clean":"2023-11-04T01:36:35.596517+0000","last_became_active":"2023-11-04T01:36:34.609460+0000","last_became_peered":"2023-11-04T01:36:34.609460+0000","last_unstale":"2023-11-04T01:36:35.596517+0000","last_undegraded":"2023-11-04T01:36:35.596517+0000","last_fullsized":"2023-11-04T01:36:35.596517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:09.612714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597523+0000","last_change":"2023-11-04T01:36:30.551741+0000","last_active":"2023-11-04T01:36:34.597523+0000","last_peered":"2023-11-04T01:36:34.597523+0000","last_clean":"2023-11-04T01:36:34.597523+0000","last_became_active":"2023-11-04T01:36:30.551456+0000","last_became_peered":"2023-11-04T01:36:30.551456+0000","last_unstale":"2023-11-04T01:36:34.597523+0000","last_undegraded":"2023-11-04T01:36:34.597523+0000","last_fullsized":"2023-11-04T01:36:34.597523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:36.976993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603079+0000","last_change":"2023-11-04T01:36:29.562224+0000","last_active":"2023-11-04T01:36:34.603079+0000","last_peered":"2023-11-04T01:36:34.603079+0000","last_clean":"2023-11-04T01:36:34.603079+0000","last_became_active":"2023-11-04T01:36:29.561870+0000","last_became_peered":"2023-11-04T01:36:29.561870+0000","last_unstale":"2023-11-04T01:36:34.603079+0000","last_undegraded":"2023-11-04T01:36:34.603079+0000","last_fullsized":"2023-11-04T01:36:34.603079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:08.164823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597173+0000","last_change":"2023-11-04T01:36:34.610751+0000","last_active":"2023-11-04T01:36:35.597173+0000","last_peered":"2023-11-04T01:36:35.597173+0000","last_clean":"2023-11-04T01:36:35.597173+0000","last_became_active":"2023-11-04T01:36:34.610375+0000","last_became_peered":"2023-11-04T01:36:34.610375+0000","last_unstale":"2023-11-04T01:36:35.597173+0000","last_undegraded":"2023-11-04T01:36:35.597173+0000","last_fullsized":"2023-11-04T01:36:35.597173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:34.881207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.599741+0000","last_change":"2023-11-04T01:36:30.553476+0000","last_active":"2023-11-04T01:36:34.599741+0000","last_peered":"2023-11-04T01:36:34.599741+0000","last_clean":"2023-11-04T01:36:34.599741+0000","last_became_active":"2023-11-04T01:36:30.553178+0000","last_became_peered":"2023-11-04T01:36:30.553178+0000","last_unstale":"2023-11-04T01:36:34.599741+0000","last_undegraded":"2023-11-04T01:36:34.599741+0000","last_fullsized":"2023-11-04T01:36:34.599741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:28.526436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752210+0000","last_change":"2023-11-04T01:36:29.565970+0000","last_active":"2023-11-04T01:36:34.752210+0000","last_peered":"2023-11-04T01:36:34.752210+0000","last_clean":"2023-11-04T01:36:34.752210+0000","last_became_active":"2023-11-04T01:36:29.565617+0000","last_became_peered":"2023-11-04T01:36:29.565617+0000","last_unstale":"2023-11-04T01:36:34.752210+0000","last_undegraded":"2023-11-04T01:36:34.752210+0000","last_fullsized":"2023-11-04T01:36:34.752210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:00.121926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597914+0000","last_change":"2023-11-04T01:36:34.755484+0000","last_active":"2023-11-04T01:36:35.597914+0000","last_peered":"2023-11-04T01:36:35.597914+0000","last_clean":"2023-11-04T01:36:35.597914+0000","last_became_active":"2023-11-04T01:36:34.755124+0000","last_became_peered":"2023-11-04T01:36:34.755124+0000","last_unstale":"2023-11-04T01:36:35.597914+0000","last_undegraded":"2023-11-04T01:36:35.597914+0000","last_fullsized":"2023-11-04T01:36:35.597914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:54:21.582207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590734+0000","last_change":"2023-11-04T01:36:30.558717+0000","last_active":"2023-11-04T01:36:34.590734+0000","last_peered":"2023-11-04T01:36:34.590734+0000","last_clean":"2023-11-04T01:36:34.590734+0000","last_became_active":"2023-11-04T01:36:30.558442+0000","last_became_peered":"2023-11-04T01:36:30.558442+0000","last_unstale":"2023-11-04T01:36:34.590734+0000","last_undegraded":"2023-11-04T01:36:34.590734+0000","last_fullsized":"2023-11-04T01:36:34.590734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600670+0000","last_change":"2023-11-04T01:36:29.558941+0000","last_active":"2023-11-04T01:36:34.600670+0000","last_peered":"2023-11-04T01:36:34.600670+0000","last_clean":"2023-11-04T01:36:34.600670+0000","last_became_active":"2023-11-04T01:36:29.558628+0000","last_became_peered":"2023-11-04T01:36:29.558628+0000","last_unstale":"2023-11-04T01:36:34.600670+0000","last_undegraded":"2023-11-04T01:36:34.600670+0000","last_fullsized":"2023-11-04T01:36:34.600670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:32:58.476395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752215+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:36:34.752215+0000","last_peered":"2023-11-04T01:36:34.752215+0000","last_clean":"2023-11-04T01:36:34.752215+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:36:34.752215+0000","last_undegraded":"2023-11-04T01:36:34.752215+0000","last_fullsized":"2023-11-04T01:36:34.752215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539400+0000","last_change":"2023-11-04T01:36:34.754650+0000","last_active":"2023-11-04T01:36:35.539400+0000","last_peered":"2023-11-04T01:36:35.539400+0000","last_clean":"2023-11-04T01:36:35.539400+0000","last_became_active":"2023-11-04T01:36:34.754266+0000","last_became_peered":"2023-11-04T01:36:34.754266+0000","last_unstale":"2023-11-04T01:36:35.539400+0000","last_undegraded":"2023-11-04T01:36:35.539400+0000","last_fullsized":"2023-11-04T01:36:35.539400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:28.573079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752605+0000","last_change":"2023-11-04T01:36:30.559432+0000","last_active":"2023-11-04T01:36:34.752605+0000","last_peered":"2023-11-04T01:36:34.752605+0000","last_clean":"2023-11-04T01:36:34.752605+0000","last_became_active":"2023-11-04T01:36:30.559164+0000","last_became_peered":"2023-11-04T01:36:30.559164+0000","last_unstale":"2023-11-04T01:36:34.752605+0000","last_undegraded":"2023-11-04T01:36:34.752605+0000","last_fullsized":"2023-11-04T01:36:34.752605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:07.434851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603732+0000","last_change":"2023-11-04T01:36:29.559481+0000","last_active":"2023-11-04T01:36:34.603732+0000","last_peered":"2023-11-04T01:36:34.603732+0000","last_clean":"2023-11-04T01:36:34.603732+0000","last_became_active":"2023-11-04T01:36:29.559232+0000","last_became_peered":"2023-11-04T01:36:29.559232+0000","last_unstale":"2023-11-04T01:36:34.603732+0000","last_undegraded":"2023-11-04T01:36:34.603732+0000","last_fullsized":"2023-11-04T01:36:34.603732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:39.985078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539003+0000","last_change":"2023-11-04T01:36:34.752537+0000","last_active":"2023-11-04T01:36:35.539003+0000","last_peered":"2023-11-04T01:36:35.539003+0000","last_clean":"2023-11-04T01:36:35.539003+0000","last_became_active":"2023-11-04T01:36:34.752122+0000","last_became_peered":"2023-11-04T01:36:34.752122+0000","last_unstale":"2023-11-04T01:36:35.539003+0000","last_undegraded":"2023-11-04T01:36:35.539003+0000","last_fullsized":"2023-11-04T01:36:35.539003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:54.343995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600864+0000","last_change":"2023-11-04T01:36:30.559114+0000","last_active":"2023-11-04T01:36:34.600864+0000","last_peered":"2023-11-04T01:36:34.600864+0000","last_clean":"2023-11-04T01:36:34.600864+0000","last_became_active":"2023-11-04T01:36:30.556702+0000","last_became_peered":"2023-11-04T01:36:30.556702+0000","last_unstale":"2023-11-04T01:36:34.600864+0000","last_undegraded":"2023-11-04T01:36:34.600864+0000","last_fullsized":"2023-11-04T01:36:34.600864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:30.844215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597914+0000","last_change":"2023-11-04T01:36:29.563452+0000","last_active":"2023-11-04T01:36:34.597914+0000","last_peered":"2023-11-04T01:36:34.597914+0000","last_clean":"2023-11-04T01:36:34.597914+0000","last_became_active":"2023-11-04T01:36:29.561923+0000","last_became_peered":"2023-11-04T01:36:29.561923+0000","last_unstale":"2023-11-04T01:36:34.597914+0000","last_undegraded":"2023-11-04T01:36:34.597914+0000","last_fullsized":"2023-11-04T01:36:34.597914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:27.522090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597420+0000","last_change":"2023-11-04T01:36:34.608316+0000","last_active":"2023-11-04T01:36:35.597420+0000","last_peered":"2023-11-04T01:36:35.597420+0000","last_clean":"2023-11-04T01:36:35.597420+0000","last_became_active":"2023-11-04T01:36:34.607936+0000","last_became_peered":"2023-11-04T01:36:34.607936+0000","last_unstale":"2023-11-04T01:36:35.597420+0000","last_undegraded":"2023-11-04T01:36:35.597420+0000","last_fullsized":"2023-11-04T01:36:35.597420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:31.223962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752975+0000","last_change":"2023-11-04T01:36:30.557506+0000","last_active":"2023-11-04T01:36:34.752975+0000","last_peered":"2023-11-04T01:36:34.752975+0000","last_clean":"2023-11-04T01:36:34.752975+0000","last_became_active":"2023-11-04T01:36:30.557188+0000","last_became_peered":"2023-11-04T01:36:30.557188+0000","last_unstale":"2023-11-04T01:36:34.752975+0000","last_undegraded":"2023-11-04T01:36:34.752975+0000","last_fullsized":"2023-11-04T01:36:34.752975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:59.924265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603522+0000","last_change":"2023-11-04T01:36:29.561929+0000","last_active":"2023-11-04T01:36:34.603522+0000","last_peered":"2023-11-04T01:36:34.603522+0000","last_clean":"2023-11-04T01:36:34.603522+0000","last_became_active":"2023-11-04T01:36:29.561665+0000","last_became_peered":"2023-11-04T01:36:29.561665+0000","last_unstale":"2023-11-04T01:36:34.603522+0000","last_undegraded":"2023-11-04T01:36:34.603522+0000","last_fullsized":"2023-11-04T01:36:34.603522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:55.902083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.595491+0000","last_change":"2023-11-04T01:36:34.755096+0000","last_active":"2023-11-04T01:36:35.595491+0000","last_peered":"2023-11-04T01:36:35.595491+0000","last_clean":"2023-11-04T01:36:35.595491+0000","last_became_active":"2023-11-04T01:36:34.754200+0000","last_became_peered":"2023-11-04T01:36:34.754200+0000","last_unstale":"2023-11-04T01:36:35.595491+0000","last_undegraded":"2023-11-04T01:36:35.595491+0000","last_fullsized":"2023-11-04T01:36:35.595491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:51.521044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752673+0000","last_change":"2023-11-04T01:36:30.556808+0000","last_active":"2023-11-04T01:36:34.752673+0000","last_peered":"2023-11-04T01:36:34.752673+0000","last_clean":"2023-11-04T01:36:34.752673+0000","last_became_active":"2023-11-04T01:36:30.556522+0000","last_became_peered":"2023-11-04T01:36:30.556522+0000","last_unstale":"2023-11-04T01:36:34.752673+0000","last_undegraded":"2023-11-04T01:36:34.752673+0000","last_fullsized":"2023-11-04T01:36:34.752673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:48.476765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591829+0000","last_change":"2023-11-04T01:36:29.560106+0000","last_active":"2023-11-04T01:36:34.591829+0000","last_peered":"2023-11-04T01:36:34.591829+0000","last_clean":"2023-11-04T01:36:34.591829+0000","last_became_active":"2023-11-04T01:36:29.559786+0000","last_became_peered":"2023-11-04T01:36:29.559786+0000","last_unstale":"2023-11-04T01:36:34.591829+0000","last_undegraded":"2023-11-04T01:36:34.591829+0000","last_fullsized":"2023-11-04T01:36:34.591829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:37:02.831923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.539853+0000","last_change":"2023-11-04T01:36:34.610033+0000","last_active":"2023-11-04T01:36:35.539853+0000","last_peered":"2023-11-04T01:36:35.539853+0000","last_clean":"2023-11-04T01:36:35.539853+0000","last_became_active":"2023-11-04T01:36:34.609439+0000","last_became_peered":"2023-11-04T01:36:34.609439+0000","last_unstale":"2023-11-04T01:36:35.539853+0000","last_undegraded":"2023-11-04T01:36:35.539853+0000","last_fullsized":"2023-11-04T01:36:35.539853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:57.965365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752112+0000","last_change":"2023-11-04T01:36:30.556245+0000","last_active":"2023-11-04T01:36:34.752112+0000","last_peered":"2023-11-04T01:36:34.752112+0000","last_clean":"2023-11-04T01:36:34.752112+0000","last_became_active":"2023-11-04T01:36:30.555523+0000","last_became_peered":"2023-11-04T01:36:30.555523+0000","last_unstale":"2023-11-04T01:36:34.752112+0000","last_undegraded":"2023-11-04T01:36:34.752112+0000","last_fullsized":"2023-11-04T01:36:34.752112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:24.536087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603267+0000","last_change":"2023-11-04T01:36:29.558752+0000","last_active":"2023-11-04T01:36:34.603267+0000","last_peered":"2023-11-04T01:36:34.603267+0000","last_clean":"2023-11-04T01:36:34.603267+0000","last_became_active":"2023-11-04T01:36:29.558430+0000","last_became_peered":"2023-11-04T01:36:29.558430+0000","last_unstale":"2023-11-04T01:36:34.603267+0000","last_undegraded":"2023-11-04T01:36:34.603267+0000","last_fullsized":"2023-11-04T01:36:34.603267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:46.170109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597667+0000","last_change":"2023-11-04T01:36:34.610894+0000","last_active":"2023-11-04T01:36:35.597667+0000","last_peered":"2023-11-04T01:36:35.597667+0000","last_clean":"2023-11-04T01:36:35.597667+0000","last_became_active":"2023-11-04T01:36:34.609868+0000","last_became_peered":"2023-11-04T01:36:34.609868+0000","last_unstale":"2023-11-04T01:36:35.597667+0000","last_undegraded":"2023-11-04T01:36:35.597667+0000","last_fullsized":"2023-11-04T01:36:35.597667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:11.471843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590924+0000","last_change":"2023-11-04T01:36:30.553108+0000","last_active":"2023-11-04T01:36:34.590924+0000","last_peered":"2023-11-04T01:36:34.590924+0000","last_clean":"2023-11-04T01:36:34.590924+0000","last_became_active":"2023-11-04T01:36:30.552812+0000","last_became_peered":"2023-11-04T01:36:30.552812+0000","last_unstale":"2023-11-04T01:36:34.590924+0000","last_undegraded":"2023-11-04T01:36:34.590924+0000","last_fullsized":"2023-11-04T01:36:34.590924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:17.787245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591689+0000","last_change":"2023-11-04T01:36:29.555166+0000","last_active":"2023-11-04T01:36:34.591689+0000","last_peered":"2023-11-04T01:36:34.591689+0000","last_clean":"2023-11-04T01:36:34.591689+0000","last_became_active":"2023-11-04T01:36:29.554537+0000","last_became_peered":"2023-11-04T01:36:29.554537+0000","last_unstale":"2023-11-04T01:36:34.591689+0000","last_undegraded":"2023-11-04T01:36:34.591689+0000","last_fullsized":"2023-11-04T01:36:34.591689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:28.954776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597394+0000","last_change":"2023-11-04T01:36:34.754737+0000","last_active":"2023-11-04T01:36:35.597394+0000","last_peered":"2023-11-04T01:36:35.597394+0000","last_clean":"2023-11-04T01:36:35.597394+0000","last_became_active":"2023-11-04T01:36:34.754360+0000","last_became_peered":"2023-11-04T01:36:34.754360+0000","last_unstale":"2023-11-04T01:36:35.597394+0000","last_undegraded":"2023-11-04T01:36:35.597394+0000","last_fullsized":"2023-11-04T01:36:35.597394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:25.393431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752320+0000","last_change":"2023-11-04T01:36:30.555902+0000","last_active":"2023-11-04T01:36:34.752320+0000","last_peered":"2023-11-04T01:36:34.752320+0000","last_clean":"2023-11-04T01:36:34.752320+0000","last_became_active":"2023-11-04T01:36:30.555624+0000","last_became_peered":"2023-11-04T01:36:30.555624+0000","last_unstale":"2023-11-04T01:36:34.752320+0000","last_undegraded":"2023-11-04T01:36:34.752320+0000","last_fullsized":"2023-11-04T01:36:34.752320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:27.186969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600516+0000","last_change":"2023-11-04T01:36:29.566041+0000","last_active":"2023-11-04T01:36:34.600516+0000","last_peered":"2023-11-04T01:36:34.600516+0000","last_clean":"2023-11-04T01:36:34.600516+0000","last_became_active":"2023-11-04T01:36:29.565674+0000","last_became_peered":"2023-11-04T01:36:29.565674+0000","last_unstale":"2023-11-04T01:36:34.600516+0000","last_undegraded":"2023-11-04T01:36:34.600516+0000","last_fullsized":"2023-11-04T01:36:34.600516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:11.541445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597902+0000","last_change":"2023-11-04T01:36:34.752418+0000","last_active":"2023-11-04T01:36:35.597902+0000","last_peered":"2023-11-04T01:36:35.597902+0000","last_clean":"2023-11-04T01:36:35.597902+0000","last_became_active":"2023-11-04T01:36:34.752054+0000","last_became_peered":"2023-11-04T01:36:34.752054+0000","last_unstale":"2023-11-04T01:36:35.597902+0000","last_undegraded":"2023-11-04T01:36:35.597902+0000","last_fullsized":"2023-11-04T01:36:35.597902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:44.979273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601844+0000","last_change":"2023-11-04T01:36:30.559566+0000","last_active":"2023-11-04T01:36:34.601844+0000","last_peered":"2023-11-04T01:36:34.601844+0000","last_clean":"2023-11-04T01:36:34.601844+0000","last_became_active":"2023-11-04T01:36:30.559372+0000","last_became_peered":"2023-11-04T01:36:30.559372+0000","last_unstale":"2023-11-04T01:36:34.601844+0000","last_undegraded":"2023-11-04T01:36:34.601844+0000","last_fullsized":"2023-11-04T01:36:34.601844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:17.787245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603204+0000","last_change":"2023-11-04T01:36:29.559883+0000","last_active":"2023-11-04T01:36:34.603204+0000","last_peered":"2023-11-04T01:36:34.603204+0000","last_clean":"2023-11-04T01:36:34.603204+0000","last_became_active":"2023-11-04T01:36:29.559623+0000","last_became_peered":"2023-11-04T01:36:29.559623+0000","last_unstale":"2023-11-04T01:36:34.603204+0000","last_undegraded":"2023-11-04T01:36:34.603204+0000","last_fullsized":"2023-11-04T01:36:34.603204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:19.388284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.596818+0000","last_change":"2023-11-04T01:36:34.752434+0000","last_active":"2023-11-04T01:36:35.596818+0000","last_peered":"2023-11-04T01:36:35.596818+0000","last_clean":"2023-11-04T01:36:35.596818+0000","last_became_active":"2023-11-04T01:36:34.752050+0000","last_became_peered":"2023-11-04T01:36:34.752050+0000","last_unstale":"2023-11-04T01:36:35.596818+0000","last_undegraded":"2023-11-04T01:36:35.596818+0000","last_fullsized":"2023-11-04T01:36:35.596818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:38:03.961257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752508+0000","last_change":"2023-11-04T01:36:30.554177+0000","last_active":"2023-11-04T01:36:34.752508+0000","last_peered":"2023-11-04T01:36:34.752508+0000","last_clean":"2023-11-04T01:36:34.752508+0000","last_became_active":"2023-11-04T01:36:30.553678+0000","last_became_peered":"2023-11-04T01:36:30.553678+0000","last_unstale":"2023-11-04T01:36:34.752508+0000","last_undegraded":"2023-11-04T01:36:34.752508+0000","last_fullsized":"2023-11-04T01:36:34.752508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:30.844215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:41.053098+0000","last_change":"2023-11-04T01:36:29.563305+0000","last_active":"2023-11-04T01:36:41.053098+0000","last_peered":"2023-11-04T01:36:41.053098+0000","last_clean":"2023-11-04T01:36:41.053098+0000","last_became_active":"2023-11-04T01:36:29.563013+0000","last_became_peered":"2023-11-04T01:36:29.563013+0000","last_unstale":"2023-11-04T01:36:41.053098+0000","last_undegraded":"2023-11-04T01:36:41.053098+0000","last_fullsized":"2023-11-04T01:36:41.053098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:46:08.796108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.596633+0000","last_change":"2023-11-04T01:36:34.608299+0000","last_active":"2023-11-04T01:36:35.596633+0000","last_peered":"2023-11-04T01:36:35.596633+0000","last_clean":"2023-11-04T01:36:35.596633+0000","last_became_active":"2023-11-04T01:36:34.607909+0000","last_became_peered":"2023-11-04T01:36:34.607909+0000","last_unstale":"2023-11-04T01:36:35.596633+0000","last_undegraded":"2023-11-04T01:36:35.596633+0000","last_fullsized":"2023-11-04T01:36:35.596633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:31.223962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592418+0000","last_change":"2023-11-04T01:36:30.557781+0000","last_active":"2023-11-04T01:36:34.592418+0000","last_peered":"2023-11-04T01:36:34.592418+0000","last_clean":"2023-11-04T01:36:34.592418+0000","last_became_active":"2023-11-04T01:36:30.557449+0000","last_became_peered":"2023-11-04T01:36:30.557449+0000","last_unstale":"2023-11-04T01:36:34.592418+0000","last_undegraded":"2023-11-04T01:36:34.592418+0000","last_fullsized":"2023-11-04T01:36:34.592418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:29.959121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597825+0000","last_change":"2023-11-04T01:36:29.565926+0000","last_active":"2023-11-04T01:36:34.597825+0000","last_peered":"2023-11-04T01:36:34.597825+0000","last_clean":"2023-11-04T01:36:34.597825+0000","last_became_active":"2023-11-04T01:36:29.564825+0000","last_became_peered":"2023-11-04T01:36:29.564825+0000","last_unstale":"2023-11-04T01:36:34.597825+0000","last_undegraded":"2023-11-04T01:36:34.597825+0000","last_fullsized":"2023-11-04T01:36:34.597825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:08.164823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540301+0000","last_change":"2023-11-04T01:36:34.607153+0000","last_active":"2023-11-04T01:36:35.540301+0000","last_peered":"2023-11-04T01:36:35.540301+0000","last_clean":"2023-11-04T01:36:35.540301+0000","last_became_active":"2023-11-04T01:36:34.606735+0000","last_became_peered":"2023-11-04T01:36:34.606735+0000","last_unstale":"2023-11-04T01:36:35.540301+0000","last_undegraded":"2023-11-04T01:36:35.540301+0000","last_fullsized":"2023-11-04T01:36:35.540301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:58:28.573079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601770+0000","last_change":"2023-11-04T01:36:30.556826+0000","last_active":"2023-11-04T01:36:34.601770+0000","last_peered":"2023-11-04T01:36:34.601770+0000","last_clean":"2023-11-04T01:36:34.601770+0000","last_became_active":"2023-11-04T01:36:30.556539+0000","last_became_peered":"2023-11-04T01:36:30.556539+0000","last_unstale":"2023-11-04T01:36:34.601770+0000","last_undegraded":"2023-11-04T01:36:34.601770+0000","last_fullsized":"2023-11-04T01:36:34.601770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.045633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601013+0000","last_change":"2023-11-04T01:36:29.561123+0000","last_active":"2023-11-04T01:36:34.601013+0000","last_peered":"2023-11-04T01:36:34.601013+0000","last_clean":"2023-11-04T01:36:34.601013+0000","last_became_active":"2023-11-04T01:36:29.560854+0000","last_became_peered":"2023-11-04T01:36:29.560854+0000","last_unstale":"2023-11-04T01:36:34.601013+0000","last_undegraded":"2023-11-04T01:36:34.601013+0000","last_fullsized":"2023-11-04T01:36:34.601013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:09.364774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.595884+0000","last_change":"2023-11-04T01:36:34.601066+0000","last_active":"2023-11-04T01:36:35.595884+0000","last_peered":"2023-11-04T01:36:35.595884+0000","last_clean":"2023-11-04T01:36:35.595884+0000","last_became_active":"2023-11-04T01:36:34.599090+0000","last_became_peered":"2023-11-04T01:36:34.599090+0000","last_unstale":"2023-11-04T01:36:35.595884+0000","last_undegraded":"2023-11-04T01:36:35.595884+0000","last_fullsized":"2023-11-04T01:36:35.595884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:55:45.766187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600942+0000","last_change":"2023-11-04T01:36:30.561795+0000","last_active":"2023-11-04T01:36:34.600942+0000","last_peered":"2023-11-04T01:36:34.600942+0000","last_clean":"2023-11-04T01:36:34.600942+0000","last_became_active":"2023-11-04T01:36:30.561540+0000","last_became_peered":"2023-11-04T01:36:30.561540+0000","last_unstale":"2023-11-04T01:36:34.600942+0000","last_undegraded":"2023-11-04T01:36:34.600942+0000","last_fullsized":"2023-11-04T01:36:34.600942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:50.307002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593216+0000","last_change":"2023-11-04T01:36:29.559999+0000","last_active":"2023-11-04T01:36:34.593216+0000","last_peered":"2023-11-04T01:36:34.593216+0000","last_clean":"2023-11-04T01:36:34.593216+0000","last_became_active":"2023-11-04T01:36:29.559724+0000","last_became_peered":"2023-11-04T01:36:29.559724+0000","last_unstale":"2023-11-04T01:36:34.593216+0000","last_undegraded":"2023-11-04T01:36:34.593216+0000","last_fullsized":"2023-11-04T01:36:34.593216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:19.388284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597352+0000","last_change":"2023-11-04T01:36:34.754539+0000","last_active":"2023-11-04T01:36:35.597352+0000","last_peered":"2023-11-04T01:36:35.597352+0000","last_clean":"2023-11-04T01:36:35.597352+0000","last_became_active":"2023-11-04T01:36:34.754171+0000","last_became_peered":"2023-11-04T01:36:34.754171+0000","last_unstale":"2023-11-04T01:36:35.597352+0000","last_undegraded":"2023-11-04T01:36:35.597352+0000","last_fullsized":"2023-11-04T01:36:35.597352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:38:03.961257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597516+0000","last_change":"2023-11-04T01:36:34.754646+0000","last_active":"2023-11-04T01:36:35.597516+0000","last_peered":"2023-11-04T01:36:35.597516+0000","last_clean":"2023-11-04T01:36:35.597516+0000","last_became_active":"2023-11-04T01:36:34.754295+0000","last_became_peered":"2023-11-04T01:36:34.754295+0000","last_unstale":"2023-11-04T01:36:35.597516+0000","last_undegraded":"2023-11-04T01:36:35.597516+0000","last_fullsized":"2023-11-04T01:36:35.597516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:34.881207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597360+0000","last_change":"2023-11-04T01:36:30.549880+0000","last_active":"2023-11-04T01:36:34.597360+0000","last_peered":"2023-11-04T01:36:34.597360+0000","last_clean":"2023-11-04T01:36:34.597360+0000","last_became_active":"2023-11-04T01:36:30.549601+0000","last_became_peered":"2023-11-04T01:36:30.549601+0000","last_unstale":"2023-11-04T01:36:34.597360+0000","last_undegraded":"2023-11-04T01:36:34.597360+0000","last_fullsized":"2023-11-04T01:36:34.597360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:12.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600522+0000","last_change":"2023-11-04T01:36:29.561272+0000","last_active":"2023-11-04T01:36:34.600522+0000","last_peered":"2023-11-04T01:36:34.600522+0000","last_clean":"2023-11-04T01:36:34.600522+0000","last_became_active":"2023-11-04T01:36:29.561002+0000","last_became_peered":"2023-11-04T01:36:29.561002+0000","last_unstale":"2023-11-04T01:36:34.600522+0000","last_undegraded":"2023-11-04T01:36:34.600522+0000","last_fullsized":"2023-11-04T01:36:34.600522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:55.902083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540190+0000","last_change":"2023-11-04T01:36:34.605037+0000","last_active":"2023-11-04T01:36:35.540190+0000","last_peered":"2023-11-04T01:36:35.540190+0000","last_clean":"2023-11-04T01:36:35.540190+0000","last_became_active":"2023-11-04T01:36:34.604643+0000","last_became_peered":"2023-11-04T01:36:34.604643+0000","last_unstale":"2023-11-04T01:36:35.540190+0000","last_undegraded":"2023-11-04T01:36:35.540190+0000","last_fullsized":"2023-11-04T01:36:35.540190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:09.612714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591215+0000","last_change":"2023-11-04T01:36:30.554876+0000","last_active":"2023-11-04T01:36:34.591215+0000","last_peered":"2023-11-04T01:36:34.591215+0000","last_clean":"2023-11-04T01:36:34.591215+0000","last_became_active":"2023-11-04T01:36:30.554614+0000","last_became_peered":"2023-11-04T01:36:30.554614+0000","last_unstale":"2023-11-04T01:36:34.591215+0000","last_undegraded":"2023-11-04T01:36:34.591215+0000","last_fullsized":"2023-11-04T01:36:34.591215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:17.787245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591406+0000","last_change":"2023-11-04T01:36:29.561077+0000","last_active":"2023-11-04T01:36:34.591406+0000","last_peered":"2023-11-04T01:36:34.591406+0000","last_clean":"2023-11-04T01:36:34.591406+0000","last_became_active":"2023-11-04T01:36:29.560004+0000","last_became_peered":"2023-11-04T01:36:29.560004+0000","last_unstale":"2023-11-04T01:36:34.591406+0000","last_undegraded":"2023-11-04T01:36:34.591406+0000","last_fullsized":"2023-11-04T01:36:34.591406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:27.522090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593048+0000","last_change":"2023-11-04T01:36:29.554796+0000","last_active":"2023-11-04T01:36:34.593048+0000","last_peered":"2023-11-04T01:36:34.593048+0000","last_clean":"2023-11-04T01:36:34.593048+0000","last_became_active":"2023-11-04T01:36:29.554404+0000","last_became_peered":"2023-11-04T01:36:29.554404+0000","last_unstale":"2023-11-04T01:36:34.593048+0000","last_undegraded":"2023-11-04T01:36:34.593048+0000","last_fullsized":"2023-11-04T01:36:34.593048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:24.009190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603121+0000","last_change":"2023-11-04T01:36:30.555821+0000","last_active":"2023-11-04T01:36:34.603121+0000","last_peered":"2023-11-04T01:36:34.603121+0000","last_clean":"2023-11-04T01:36:34.603121+0000","last_became_active":"2023-11-04T01:36:30.555189+0000","last_became_peered":"2023-11-04T01:36:30.555189+0000","last_unstale":"2023-11-04T01:36:34.603121+0000","last_undegraded":"2023-11-04T01:36:34.603121+0000","last_fullsized":"2023-11-04T01:36:34.603121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:36.976993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.540760+0000","last_change":"2023-11-04T01:36:34.609254+0000","last_active":"2023-11-04T01:36:35.540760+0000","last_peered":"2023-11-04T01:36:35.540760+0000","last_clean":"2023-11-04T01:36:35.540760+0000","last_became_active":"2023-11-04T01:36:34.608845+0000","last_became_peered":"2023-11-04T01:36:34.608845+0000","last_unstale":"2023-11-04T01:36:35.540760+0000","last_undegraded":"2023-11-04T01:36:35.540760+0000","last_fullsized":"2023-11-04T01:36:35.540760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:32.563428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591589+0000","last_change":"2023-11-04T01:36:29.564267+0000","last_active":"2023-11-04T01:36:34.591589+0000","last_peered":"2023-11-04T01:36:34.591589+0000","last_clean":"2023-11-04T01:36:34.591589+0000","last_became_active":"2023-11-04T01:36:29.563992+0000","last_became_peered":"2023-11-04T01:36:29.563992+0000","last_unstale":"2023-11-04T01:36:34.591589+0000","last_undegraded":"2023-11-04T01:36:34.591589+0000","last_fullsized":"2023-11-04T01:36:34.591589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:28.537559+0000","last_clean_scrub_stamp":"2023-11-04T01:36:28.537559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:28.954776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592935+0000","last_change":"2023-11-04T01:36:30.552063+0000","last_active":"2023-11-04T01:36:34.592935+0000","last_peered":"2023-11-04T01:36:34.592935+0000","last_clean":"2023-11-04T01:36:34.592935+0000","last_became_active":"2023-11-04T01:36:30.551686+0000","last_became_peered":"2023-11-04T01:36:30.551686+0000","last_unstale":"2023-11-04T01:36:34.592935+0000","last_undegraded":"2023-11-04T01:36:34.592935+0000","last_fullsized":"2023-11-04T01:36:34.592935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:56.906428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:36:35.597623+0000","last_change":"2023-11-04T01:36:34.607234+0000","last_active":"2023-11-04T01:36:35.597623+0000","last_peered":"2023-11-04T01:36:35.597623+0000","last_clean":"2023-11-04T01:36:35.597623+0000","last_became_active":"2023-11-04T01:36:34.606850+0000","last_became_peered":"2023-11-04T01:36:34.606850+0000","last_unstale":"2023-11-04T01:36:35.597623+0000","last_undegraded":"2023-11-04T01:36:35.597623+0000","last_fullsized":"2023-11-04T01:36:35.597623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:33.578897+0000","last_clean_scrub_stamp":"2023-11-04T01:36:33.578897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:18.885568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590846+0000","last_change":"2023-11-04T01:36:30.554613+0000","last_active":"2023-11-04T01:36:34.590846+0000","last_peered":"2023-11-04T01:36:34.590846+0000","last_clean":"2023-11-04T01:36:34.590846+0000","last_became_active":"2023-11-04T01:36:30.554329+0000","last_became_peered":"2023-11-04T01:36:30.554329+0000","last_unstale":"2023-11-04T01:36:34.590846+0000","last_undegraded":"2023-11-04T01:36:34.590846+0000","last_fullsized":"2023-11-04T01:36:34.590846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:37.615217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.602985+0000","last_change":"2023-11-04T01:36:30.557052+0000","last_active":"2023-11-04T01:36:34.602985+0000","last_peered":"2023-11-04T01:36:34.602985+0000","last_clean":"2023-11-04T01:36:34.602985+0000","last_became_active":"2023-11-04T01:36:30.556744+0000","last_became_peered":"2023-11-04T01:36:30.556744+0000","last_unstale":"2023-11-04T01:36:34.602985+0000","last_undegraded":"2023-11-04T01:36:34.602985+0000","last_fullsized":"2023-11-04T01:36:34.602985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:29.959121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600475+0000","last_change":"2023-11-04T01:36:30.557244+0000","last_active":"2023-11-04T01:36:34.600475+0000","last_peered":"2023-11-04T01:36:34.600475+0000","last_clean":"2023-11-04T01:36:34.600475+0000","last_became_active":"2023-11-04T01:36:30.556922+0000","last_became_peered":"2023-11-04T01:36:30.556922+0000","last_unstale":"2023-11-04T01:36:34.600475+0000","last_undegraded":"2023-11-04T01:36:34.600475+0000","last_fullsized":"2023-11-04T01:36:34.600475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:27.186969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603035+0000","last_change":"2023-11-04T01:36:30.553115+0000","last_active":"2023-11-04T01:36:34.603035+0000","last_peered":"2023-11-04T01:36:34.603035+0000","last_clean":"2023-11-04T01:36:34.603035+0000","last_became_active":"2023-11-04T01:36:30.552004+0000","last_became_peered":"2023-11-04T01:36:30.552004+0000","last_unstale":"2023-11-04T01:36:34.603035+0000","last_undegraded":"2023-11-04T01:36:34.603035+0000","last_fullsized":"2023-11-04T01:36:34.603035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:10.369120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592230+0000","last_change":"2023-11-04T01:36:30.549121+0000","last_active":"2023-11-04T01:36:34.592230+0000","last_peered":"2023-11-04T01:36:34.592230+0000","last_clean":"2023-11-04T01:36:34.592230+0000","last_became_active":"2023-11-04T01:36:30.548845+0000","last_became_peered":"2023-11-04T01:36:30.548845+0000","last_unstale":"2023-11-04T01:36:34.592230+0000","last_undegraded":"2023-11-04T01:36:34.592230+0000","last_fullsized":"2023-11-04T01:36:34.592230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:53.928372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597717+0000","last_change":"2023-11-04T01:36:30.549624+0000","last_active":"2023-11-04T01:36:34.597717+0000","last_peered":"2023-11-04T01:36:34.597717+0000","last_clean":"2023-11-04T01:36:34.597717+0000","last_became_active":"2023-11-04T01:36:30.549352+0000","last_became_peered":"2023-11-04T01:36:30.549352+0000","last_unstale":"2023-11-04T01:36:34.597717+0000","last_undegraded":"2023-11-04T01:36:34.597717+0000","last_fullsized":"2023-11-04T01:36:34.597717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593105+0000","last_change":"2023-11-04T01:36:30.560044+0000","last_active":"2023-11-04T01:36:34.593105+0000","last_peered":"2023-11-04T01:36:34.593105+0000","last_clean":"2023-11-04T01:36:34.593105+0000","last_became_active":"2023-11-04T01:36:30.559776+0000","last_became_peered":"2023-11-04T01:36:30.559776+0000","last_unstale":"2023-11-04T01:36:34.593105+0000","last_undegraded":"2023-11-04T01:36:34.593105+0000","last_fullsized":"2023-11-04T01:36:34.593105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:36.996384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591659+0000","last_change":"2023-11-04T01:36:30.554726+0000","last_active":"2023-11-04T01:36:34.591659+0000","last_peered":"2023-11-04T01:36:34.591659+0000","last_clean":"2023-11-04T01:36:34.591659+0000","last_became_active":"2023-11-04T01:36:30.554463+0000","last_became_peered":"2023-11-04T01:36:30.554463+0000","last_unstale":"2023-11-04T01:36:34.591659+0000","last_undegraded":"2023-11-04T01:36:34.591659+0000","last_fullsized":"2023-11-04T01:36:34.591659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:29.259099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600433+0000","last_change":"2023-11-04T01:36:30.558538+0000","last_active":"2023-11-04T01:36:34.600433+0000","last_peered":"2023-11-04T01:36:34.600433+0000","last_clean":"2023-11-04T01:36:34.600433+0000","last_became_active":"2023-11-04T01:36:30.558255+0000","last_became_peered":"2023-11-04T01:36:30.558255+0000","last_unstale":"2023-11-04T01:36:34.600433+0000","last_undegraded":"2023-11-04T01:36:34.600433+0000","last_fullsized":"2023-11-04T01:36:34.600433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:26:24.912249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.591246+0000","last_change":"2023-11-04T01:36:30.555242+0000","last_active":"2023-11-04T01:36:34.591246+0000","last_peered":"2023-11-04T01:36:34.591246+0000","last_clean":"2023-11-04T01:36:34.591246+0000","last_became_active":"2023-11-04T01:36:30.554999+0000","last_became_peered":"2023-11-04T01:36:30.554999+0000","last_unstale":"2023-11-04T01:36:34.591246+0000","last_undegraded":"2023-11-04T01:36:34.591246+0000","last_fullsized":"2023-11-04T01:36:34.591246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:37.615217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600436+0000","last_change":"2023-11-04T01:36:30.561171+0000","last_active":"2023-11-04T01:36:34.600436+0000","last_peered":"2023-11-04T01:36:34.600436+0000","last_clean":"2023-11-04T01:36:34.600436+0000","last_became_active":"2023-11-04T01:36:30.560077+0000","last_became_peered":"2023-11-04T01:36:30.560077+0000","last_unstale":"2023-11-04T01:36:34.600436+0000","last_undegraded":"2023-11-04T01:36:34.600436+0000","last_fullsized":"2023-11-04T01:36:34.600436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:53.928372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.602937+0000","last_change":"2023-11-04T01:36:30.559653+0000","last_active":"2023-11-04T01:36:34.602937+0000","last_peered":"2023-11-04T01:36:34.602937+0000","last_clean":"2023-11-04T01:36:34.602937+0000","last_became_active":"2023-11-04T01:36:30.559390+0000","last_became_peered":"2023-11-04T01:36:30.559390+0000","last_unstale":"2023-11-04T01:36:34.602937+0000","last_undegraded":"2023-11-04T01:36:34.602937+0000","last_fullsized":"2023-11-04T01:36:34.602937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:37.615217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592681+0000","last_change":"2023-11-04T01:36:30.553925+0000","last_active":"2023-11-04T01:36:34.592681+0000","last_peered":"2023-11-04T01:36:34.592681+0000","last_clean":"2023-11-04T01:36:34.592681+0000","last_became_active":"2023-11-04T01:36:30.553654+0000","last_became_peered":"2023-11-04T01:36:30.553654+0000","last_unstale":"2023-11-04T01:36:34.592681+0000","last_undegraded":"2023-11-04T01:36:34.592681+0000","last_fullsized":"2023-11-04T01:36:34.592681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752906+0000","last_change":"2023-11-04T01:36:30.557205+0000","last_active":"2023-11-04T01:36:34.752906+0000","last_peered":"2023-11-04T01:36:34.752906+0000","last_clean":"2023-11-04T01:36:34.752906+0000","last_became_active":"2023-11-04T01:36:30.556906+0000","last_became_peered":"2023-11-04T01:36:30.556906+0000","last_unstale":"2023-11-04T01:36:34.752906+0000","last_undegraded":"2023-11-04T01:36:34.752906+0000","last_fullsized":"2023-11-04T01:36:34.752906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:54:17.545215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.603431+0000","last_change":"2023-11-04T01:36:30.548944+0000","last_active":"2023-11-04T01:36:34.603431+0000","last_peered":"2023-11-04T01:36:34.603431+0000","last_clean":"2023-11-04T01:36:34.603431+0000","last_became_active":"2023-11-04T01:36:30.548680+0000","last_became_peered":"2023-11-04T01:36:30.548680+0000","last_unstale":"2023-11-04T01:36:34.603431+0000","last_undegraded":"2023-11-04T01:36:34.603431+0000","last_fullsized":"2023-11-04T01:36:34.603431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:25.013535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601391+0000","last_change":"2023-11-04T01:36:30.560336+0000","last_active":"2023-11-04T01:36:34.601391+0000","last_peered":"2023-11-04T01:36:34.601391+0000","last_clean":"2023-11-04T01:36:34.601391+0000","last_became_active":"2023-11-04T01:36:30.559694+0000","last_became_peered":"2023-11-04T01:36:30.559694+0000","last_unstale":"2023-11-04T01:36:34.601391+0000","last_undegraded":"2023-11-04T01:36:34.601391+0000","last_fullsized":"2023-11-04T01:36:34.601391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:07.434851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600395+0000","last_change":"2023-11-04T01:36:30.553100+0000","last_active":"2023-11-04T01:36:34.600395+0000","last_peered":"2023-11-04T01:36:34.600395+0000","last_clean":"2023-11-04T01:36:34.600395+0000","last_became_active":"2023-11-04T01:36:30.552783+0000","last_became_peered":"2023-11-04T01:36:30.552783+0000","last_unstale":"2023-11-04T01:36:34.600395+0000","last_undegraded":"2023-11-04T01:36:34.600395+0000","last_fullsized":"2023-11-04T01:36:34.600395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:01.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597636+0000","last_change":"2023-11-04T01:36:30.549860+0000","last_active":"2023-11-04T01:36:34.597636+0000","last_peered":"2023-11-04T01:36:34.597636+0000","last_clean":"2023-11-04T01:36:34.597636+0000","last_became_active":"2023-11-04T01:36:30.549522+0000","last_became_peered":"2023-11-04T01:36:30.549522+0000","last_unstale":"2023-11-04T01:36:34.597636+0000","last_undegraded":"2023-11-04T01:36:34.597636+0000","last_fullsized":"2023-11-04T01:36:34.597636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:10.369120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601798+0000","last_change":"2023-11-04T01:36:30.550358+0000","last_active":"2023-11-04T01:36:34.601798+0000","last_peered":"2023-11-04T01:36:34.601798+0000","last_clean":"2023-11-04T01:36:34.601798+0000","last_became_active":"2023-11-04T01:36:30.550025+0000","last_became_peered":"2023-11-04T01:36:30.550025+0000","last_unstale":"2023-11-04T01:36:34.601798+0000","last_undegraded":"2023-11-04T01:36:34.601798+0000","last_fullsized":"2023-11-04T01:36:34.601798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:46:09.800453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590613+0000","last_change":"2023-11-04T01:36:30.552408+0000","last_active":"2023-11-04T01:36:34.590613+0000","last_peered":"2023-11-04T01:36:34.590613+0000","last_clean":"2023-11-04T01:36:34.590613+0000","last_became_active":"2023-11-04T01:36:30.552144+0000","last_became_peered":"2023-11-04T01:36:30.552144+0000","last_unstale":"2023-11-04T01:36:34.590613+0000","last_undegraded":"2023-11-04T01:36:34.590613+0000","last_fullsized":"2023-11-04T01:36:34.590613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:36.996384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.592329+0000","last_change":"2023-11-04T01:36:30.551603+0000","last_active":"2023-11-04T01:36:34.592329+0000","last_peered":"2023-11-04T01:36:34.592329+0000","last_clean":"2023-11-04T01:36:34.592329+0000","last_became_active":"2023-11-04T01:36:30.551211+0000","last_became_peered":"2023-11-04T01:36:30.551211+0000","last_unstale":"2023-11-04T01:36:34.592329+0000","last_undegraded":"2023-11-04T01:36:34.592329+0000","last_fullsized":"2023-11-04T01:36:34.592329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:15:10.559940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593132+0000","last_change":"2023-11-04T01:36:30.557060+0000","last_active":"2023-11-04T01:36:34.593132+0000","last_peered":"2023-11-04T01:36:34.593132+0000","last_clean":"2023-11-04T01:36:34.593132+0000","last_became_active":"2023-11-04T01:36:30.556780+0000","last_became_peered":"2023-11-04T01:36:30.556780+0000","last_unstale":"2023-11-04T01:36:34.593132+0000","last_undegraded":"2023-11-04T01:36:34.593132+0000","last_fullsized":"2023-11-04T01:36:34.593132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:12.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.593025+0000","last_change":"2023-11-04T01:36:30.557384+0000","last_active":"2023-11-04T01:36:34.593025+0000","last_peered":"2023-11-04T01:36:34.593025+0000","last_clean":"2023-11-04T01:36:34.593025+0000","last_became_active":"2023-11-04T01:36:30.556515+0000","last_became_peered":"2023-11-04T01:36:30.556515+0000","last_unstale":"2023-11-04T01:36:34.593025+0000","last_undegraded":"2023-11-04T01:36:34.593025+0000","last_fullsized":"2023-11-04T01:36:34.593025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:36.976993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752897+0000","last_change":"2023-11-04T01:36:30.558458+0000","last_active":"2023-11-04T01:36:34.752897+0000","last_peered":"2023-11-04T01:36:34.752897+0000","last_clean":"2023-11-04T01:36:34.752897+0000","last_became_active":"2023-11-04T01:36:30.558111+0000","last_became_peered":"2023-11-04T01:36:30.558111+0000","last_unstale":"2023-11-04T01:36:34.752897+0000","last_undegraded":"2023-11-04T01:36:34.752897+0000","last_fullsized":"2023-11-04T01:36:34.752897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:47.484051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.590565+0000","last_change":"2023-11-04T01:36:30.558798+0000","last_active":"2023-11-04T01:36:34.590565+0000","last_peered":"2023-11-04T01:36:34.590565+0000","last_clean":"2023-11-04T01:36:34.590565+0000","last_became_active":"2023-11-04T01:36:30.558197+0000","last_became_peered":"2023-11-04T01:36:30.558197+0000","last_unstale":"2023-11-04T01:36:34.590565+0000","last_undegraded":"2023-11-04T01:36:34.590565+0000","last_fullsized":"2023-11-04T01:36:34.590565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:36.976993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752395+0000","last_change":"2023-11-04T01:36:30.556288+0000","last_active":"2023-11-04T01:36:34.752395+0000","last_peered":"2023-11-04T01:36:34.752395+0000","last_clean":"2023-11-04T01:36:34.752395+0000","last_became_active":"2023-11-04T01:36:30.556011+0000","last_became_peered":"2023-11-04T01:36:30.556011+0000","last_unstale":"2023-11-04T01:36:34.752395+0000","last_undegraded":"2023-11-04T01:36:34.752395+0000","last_fullsized":"2023-11-04T01:36:34.752395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:50.307002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600393+0000","last_change":"2023-11-04T01:36:30.556023+0000","last_active":"2023-11-04T01:36:34.600393+0000","last_peered":"2023-11-04T01:36:34.600393+0000","last_clean":"2023-11-04T01:36:34.600393+0000","last_became_active":"2023-11-04T01:36:30.555394+0000","last_became_peered":"2023-11-04T01:36:30.555394+0000","last_unstale":"2023-11-04T01:36:34.600393+0000","last_undegraded":"2023-11-04T01:36:34.600393+0000","last_fullsized":"2023-11-04T01:36:34.600393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.045633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752224+0000","last_change":"2023-11-04T01:36:30.555404+0000","last_active":"2023-11-04T01:36:34.752224+0000","last_peered":"2023-11-04T01:36:34.752224+0000","last_clean":"2023-11-04T01:36:34.752224+0000","last_became_active":"2023-11-04T01:36:30.555125+0000","last_became_peered":"2023-11-04T01:36:30.555125+0000","last_unstale":"2023-11-04T01:36:34.752224+0000","last_undegraded":"2023-11-04T01:36:34.752224+0000","last_fullsized":"2023-11-04T01:36:34.752224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:05.575722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.600734+0000","last_change":"2023-11-04T01:36:30.559120+0000","last_active":"2023-11-04T01:36:34.600734+0000","last_peered":"2023-11-04T01:36:34.600734+0000","last_clean":"2023-11-04T01:36:34.600734+0000","last_became_active":"2023-11-04T01:36:30.558412+0000","last_became_peered":"2023-11-04T01:36:30.558412+0000","last_unstale":"2023-11-04T01:36:34.600734+0000","last_undegraded":"2023-11-04T01:36:34.600734+0000","last_fullsized":"2023-11-04T01:36:34.600734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:29.259099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.601077+0000","last_change":"2023-11-04T01:36:30.552546+0000","last_active":"2023-11-04T01:36:34.601077+0000","last_peered":"2023-11-04T01:36:34.601077+0000","last_clean":"2023-11-04T01:36:34.601077+0000","last_became_active":"2023-11-04T01:36:30.551809+0000","last_became_peered":"2023-11-04T01:36:30.551809+0000","last_unstale":"2023-11-04T01:36:34.601077+0000","last_undegraded":"2023-11-04T01:36:34.601077+0000","last_fullsized":"2023-11-04T01:36:34.601077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:12.545791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.597814+0000","last_change":"2023-11-04T01:36:30.554657+0000","last_active":"2023-11-04T01:36:34.597814+0000","last_peered":"2023-11-04T01:36:34.597814+0000","last_clean":"2023-11-04T01:36:34.597814+0000","last_became_active":"2023-11-04T01:36:30.554335+0000","last_became_peered":"2023-11-04T01:36:30.554335+0000","last_unstale":"2023-11-04T01:36:34.597814+0000","last_undegraded":"2023-11-04T01:36:34.597814+0000","last_fullsized":"2023-11-04T01:36:34.597814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.045633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:36:34.752772+0000","last_change":"2023-11-04T01:36:30.557755+0000","last_active":"2023-11-04T01:36:34.752772+0000","last_peered":"2023-11-04T01:36:34.752772+0000","last_clean":"2023-11-04T01:36:34.752772+0000","last_became_active":"2023-11-04T01:36:30.557432+0000","last_became_peered":"2023-11-04T01:36:30.557432+0000","last_unstale":"2023-11-04T01:36:34.752772+0000","last_undegraded":"2023-11-04T01:36:34.752772+0000","last_fullsized":"2023-11-04T01:36:34.752772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:29.541904+0000","last_clean_scrub_stamp":"2023-11-04T01:36:29.541904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:55:41.729195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":690798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:36:54.919 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-04T01:36:54.920 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-04T01:36:54.920 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-04T01:36:54.920 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-04T01:36:55.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.050+0000 7fee35c9b640 1 Processor -- start 2023-11-04T01:36:55.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.051+0000 7fee35c9b640 1 -- start start 2023-11-04T01:36:55.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.051+0000 7fee35c9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fee300ce240 0x7fee30157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.051+0000 7fee35c9b640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fee30157540 0x7fee300d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.051+0000 7fee35c9b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3015e000 con 0x7fee300cde60 2023-11-04T01:36:55.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.051+0000 7fee35c9b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3015e5c0 con 0x7fee300ce240 2023-11-04T01:36:55.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.051+0000 7fee35c9b640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3015e2e0 con 0x7fee30157540 2023-11-04T01:36:55.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.051+0000 7fee2effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fee300ce240 0x7fee30157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.051+0000 7fee2effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fee300ce240 0x7fee30157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49642/0 (socket says 172.21.15.114:49642) 2023-11-04T01:36:55.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.052+0000 7fee2effd640 1 -- 172.21.15.114:0/3808455588 learned_addr learned my addr 172.21.15.114:0/3808455588 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:55.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.052+0000 7fee2ffff640 1 --2- 172.21.15.114:0/3808455588 >> v2:172.21.15.141:3300/0 conn(0x7fee30157540 0x7fee300d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.052+0000 7fee2effd640 1 -- 172.21.15.114:0/3808455588 >> v2:172.21.15.141:3300/0 conn(0x7fee30157540 msgr2=0x7fee300d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.052+0000 7fee2effd640 1 --2- 172.21.15.114:0/3808455588 >> v2:172.21.15.141:3300/0 conn(0x7fee30157540 0x7fee300d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.052+0000 7fee2effd640 1 -- 172.21.15.114:0/3808455588 >> v1:172.21.15.114:6789/0 conn(0x7fee300cde60 legacy=0x7fee3015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.052+0000 7fee2effd640 1 -- 172.21.15.114:0/3808455588 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee300d1120 con 0x7fee300ce240 2023-11-04T01:36:55.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.053+0000 7fee2effd640 1 --2- 172.21.15.114:0/3808455588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee300ce240 0x7fee30157000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fee300cf2e0 tx=0x7fee1802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fb73563eb5a323 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.053+0000 7fee2e7fc640 1 -- 172.21.15.114:0/3808455588 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee18030860 con 0x7fee300ce240 2023-11-04T01:36:55.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.053+0000 7fee2e7fc640 1 -- 172.21.15.114:0/3808455588 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee180309c0 con 0x7fee300ce240 2023-11-04T01:36:55.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.053+0000 7fee2e7fc640 1 -- 172.21.15.114:0/3808455588 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee18030d50 con 0x7fee300ce240 2023-11-04T01:36:55.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.053+0000 7fee35c9b640 1 -- 172.21.15.114:0/3808455588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee300ce240 msgr2=0x7fee30157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.053+0000 7fee35c9b640 1 --2- 172.21.15.114:0/3808455588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee300ce240 0x7fee30157000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fee300cf2e0 tx=0x7fee1802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.053+0000 7fee35c9b640 1 -- 172.21.15.114:0/3808455588 shutdown_connections 2023-11-04T01:36:55.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.053+0000 7fee35c9b640 1 --2- 172.21.15.114:0/3808455588 >> v2:172.21.15.141:3300/0 conn(0x7fee30157540 0x7fee300d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.053+0000 7fee35c9b640 1 --2- 172.21.15.114:0/3808455588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee300ce240 0x7fee30157000 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.053+0000 7fee35c9b640 1 -- 172.21.15.114:0/3808455588 >> 172.21.15.114:0/3808455588 conn(0x7fee30071f30 msgr2=0x7fee300cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.053+0000 7fee35c9b640 1 -- 172.21.15.114:0/3808455588 shutdown_connections 2023-11-04T01:36:55.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.053+0000 7fee35c9b640 1 -- 172.21.15.114:0/3808455588 wait complete. 2023-11-04T01:36:55.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.054+0000 7fee35c9b640 1 Processor -- start 2023-11-04T01:36:55.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.055+0000 7fee35c9b640 1 -- start start 2023-11-04T01:36:55.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.055+0000 7fee35c9b640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee300cde60 0x7fee3015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.055+0000 7fee35c9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee300ce240 0x7fee301f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.055+0000 7fee35c9b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee30157540 0x7fee301f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.055+0000 7fee35c9b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee301f4610 con 0x7fee300ce240 2023-11-04T01:36:55.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.055+0000 7fee35c9b640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee301f58e0 con 0x7fee300cde60 2023-11-04T01:36:55.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.055+0000 7fee35c9b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee301f4840 con 0x7fee30157540 2023-11-04T01:36:55.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.055+0000 7fee2effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee300ce240 0x7fee301f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.055+0000 7fee2effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee300ce240 0x7fee301f3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49652/0 (socket says 172.21.15.114:49652) 2023-11-04T01:36:55.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.056+0000 7fee2effd640 1 -- 172.21.15.114:0/648829730 learned_addr learned my addr 172.21.15.114:0/648829730 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:55.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.056+0000 7fee2f7fe640 1 --2- 172.21.15.114:0/648829730 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee300cde60 0x7fee3015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.056+0000 7fee2ffff640 1 --2- 172.21.15.114:0/648829730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee30157540 0x7fee301f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.056+0000 7fee2effd640 1 -- 172.21.15.114:0/648829730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee30157540 msgr2=0x7fee301f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.056+0000 7fee2effd640 1 --2- 172.21.15.114:0/648829730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee30157540 0x7fee301f40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.056+0000 7fee2effd640 1 -- 172.21.15.114:0/648829730 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee300cde60 msgr2=0x7fee3015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.056+0000 7fee2effd640 1 --2- 172.21.15.114:0/648829730 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee300cde60 0x7fee3015a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.056+0000 7fee2effd640 1 -- 172.21.15.114:0/648829730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee180094d0 con 0x7fee300ce240 2023-11-04T01:36:55.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.056+0000 7fee2effd640 1 --2- 172.21.15.114:0/648829730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee300ce240 0x7fee301f3070 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fee1802b9e0 tx=0x7fee18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.056+0000 7fee27fff640 1 -- 172.21.15.114:0/648829730 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee18039d60 con 0x7fee300ce240 2023-11-04T01:36:55.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.056+0000 7fee27fff640 1 -- 172.21.15.114:0/648829730 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee18043400 con 0x7fee300ce240 2023-11-04T01:36:55.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.056+0000 7fee27fff640 1 -- 172.21.15.114:0/648829730 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee180437b0 con 0x7fee300ce240 2023-11-04T01:36:55.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.056+0000 7fee35c9b640 1 -- 172.21.15.114:0/648829730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee301f4b20 con 0x7fee300ce240 2023-11-04T01:36:55.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.056+0000 7fee35c9b640 1 -- 172.21.15.114:0/648829730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee301f50e0 con 0x7fee300ce240 2023-11-04T01:36:55.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.057+0000 7fee35c9b640 1 -- 172.21.15.114:0/648829730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee30074290 con 0x7fee300ce240 2023-11-04T01:36:55.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.057+0000 7fee27fff640 1 -- 172.21.15.114:0/648829730 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee18043910 con 0x7fee300ce240 2023-11-04T01:36:55.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.058+0000 7fee27fff640 1 --2- 172.21.15.114:0/648829730 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee1006aea0 0x7fee1006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.058+0000 7fee27fff640 1 -- 172.21.15.114:0/648829730 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fee1803e070 con 0x7fee300ce240 2023-11-04T01:36:55.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.058+0000 7fee2f7fe640 1 --2- 172.21.15.114:0/648829730 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee1006aea0 0x7fee1006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.058+0000 7fee2f7fe640 1 --2- 172.21.15.114:0/648829730 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee1006aea0 0x7fee1006d360 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee200012e0 tx=0x7fee20009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.062+0000 7fee27fff640 1 -- 172.21.15.114:0/648829730 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fee18077830 con 0x7fee300ce240 2023-11-04T01:36:55.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.264+0000 7fee35c9b640 1 -- 172.21.15.114:0/648829730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fee300c95b0 con 0x7fee300ce240 2023-11-04T01:36:55.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.264+0000 7fee27fff640 1 -- 172.21.15.114:0/648829730 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fee18034080 con 0x7fee300ce240 2023-11-04T01:36:55.267 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-04T01:36:55.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.266+0000 7fee35c9b640 1 -- 172.21.15.114:0/648829730 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee1006aea0 msgr2=0x7fee1006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.266+0000 7fee35c9b640 1 --2- 172.21.15.114:0/648829730 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee1006aea0 0x7fee1006d360 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee200012e0 tx=0x7fee20009040 comp rx=0 tx=0).stop 2023-11-04T01:36:55.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.266+0000 7fee35c9b640 1 -- 172.21.15.114:0/648829730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee300ce240 msgr2=0x7fee301f3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.266+0000 7fee35c9b640 1 --2- 172.21.15.114:0/648829730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee300ce240 0x7fee301f3070 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fee1802b9e0 tx=0x7fee18004730 comp rx=0 tx=0).stop 2023-11-04T01:36:55.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.266+0000 7fee35c9b640 1 -- 172.21.15.114:0/648829730 shutdown_connections 2023-11-04T01:36:55.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.266+0000 7fee35c9b640 1 --2- 172.21.15.114:0/648829730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fee30157540 0x7fee301f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.266+0000 7fee35c9b640 1 --2- 172.21.15.114:0/648829730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee300ce240 0x7fee301f3070 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.266+0000 7fee35c9b640 1 --2- 172.21.15.114:0/648829730 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee1006aea0 0x7fee1006d360 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.266+0000 7fee35c9b640 1 --2- 172.21.15.114:0/648829730 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fee300cde60 0x7fee3015a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.266+0000 7fee35c9b640 1 -- 172.21.15.114:0/648829730 >> 172.21.15.114:0/648829730 conn(0x7fee30071f30 msgr2=0x7fee300d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.266+0000 7fee35c9b640 1 -- 172.21.15.114:0/648829730 shutdown_connections 2023-11-04T01:36:55.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.266+0000 7fee35c9b640 1 -- 172.21.15.114:0/648829730 wait complete. 2023-11-04T01:36:55.279 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-04T01:36:55.279 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:55.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.377+0000 7ff4c2355640 1 Processor -- start 2023-11-04T01:36:55.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.377+0000 7ff4c2355640 1 -- start start 2023-11-04T01:36:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.378+0000 7ff4c2355640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff4bc06a830 0x7ff4bc0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.378+0000 7ff4c2355640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4bc06eba0 0x7ff4bc0ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.378+0000 7ff4c2355640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc06d310 con 0x7ff4bc15ab70 2023-11-04T01:36:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.378+0000 7ff4c2355640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc0cba70 con 0x7ff4bc06a830 2023-11-04T01:36:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.378+0000 7ff4c2355640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc161c50 con 0x7ff4bc06eba0 2023-11-04T01:36:55.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.378+0000 7ff4bb7fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff4bc06a830 0x7ff4bc0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.378+0000 7ff4c08f2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4bc06eba0 0x7ff4bc0ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.378+0000 7ff4bbfff640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7ff4bc15ab70 0x7ff4bc06a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:45916/0 (socket says 172.21.15.114:45916) 2023-11-04T01:36:55.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.378+0000 7ff4bbfff640 1 -- 172.21.15.114:0/2899216457 learned_addr learned my addr 172.21.15.114:0/2899216457 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:55.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.378+0000 7ff4c08f2640 1 -- 172.21.15.114:0/2899216457 >> v2:172.21.15.141:3300/0 conn(0x7ff4bc06a830 msgr2=0x7ff4bc0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.378+0000 7ff4c08f2640 1 --2- 172.21.15.114:0/2899216457 >> v2:172.21.15.141:3300/0 conn(0x7ff4bc06a830 0x7ff4bc0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.378+0000 7ff4c08f2640 1 -- 172.21.15.114:0/2899216457 >> v1:172.21.15.141:6789/0 conn(0x7ff4bc15ab70 legacy=0x7ff4bc06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.378+0000 7ff4c08f2640 1 -- 172.21.15.114:0/2899216457 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc15d860 con 0x7ff4bc06eba0 2023-11-04T01:36:55.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.378+0000 7ff4baffd640 1 -- 172.21.15.114:0/2899216457 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020189815 0 0) 0x7ff4bc06d310 con 0x7ff4bc15ab70 2023-11-04T01:36:55.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.379+0000 7ff4c08f2640 1 --2- 172.21.15.114:0/2899216457 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4bc06eba0 0x7ff4bc0ae5e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009d90 tx=0x7ff4b402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bb6196631a3ac9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.379+0000 7ff4baffd640 1 -- 172.21.15.114:0/2899216457 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b402cbc0 con 0x7ff4bc06eba0 2023-11-04T01:36:55.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.379+0000 7ff4baffd640 1 -- 172.21.15.114:0/2899216457 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b402cd20 con 0x7ff4bc06eba0 2023-11-04T01:36:55.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.379+0000 7ff4baffd640 1 -- 172.21.15.114:0/2899216457 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4034660 con 0x7ff4bc06eba0 2023-11-04T01:36:55.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.380+0000 7ff4c2355640 1 -- 172.21.15.114:0/2899216457 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4bc06eba0 msgr2=0x7ff4bc0ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.380+0000 7ff4c2355640 1 --2- 172.21.15.114:0/2899216457 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4bc06eba0 0x7ff4bc0ae5e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009d90 tx=0x7ff4b402be10 comp rx=0 tx=0).stop 2023-11-04T01:36:55.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.380+0000 7ff4c2355640 1 -- 172.21.15.114:0/2899216457 shutdown_connections 2023-11-04T01:36:55.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.380+0000 7ff4c2355640 1 --2- 172.21.15.114:0/2899216457 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4bc06eba0 0x7ff4bc0ae5e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.380+0000 7ff4c2355640 1 --2- 172.21.15.114:0/2899216457 >> v2:172.21.15.141:3300/0 conn(0x7ff4bc06a830 0x7ff4bc0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.380+0000 7ff4c2355640 1 -- 172.21.15.114:0/2899216457 >> 172.21.15.114:0/2899216457 conn(0x7ff4bc098d40 msgr2=0x7ff4bc0cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.380+0000 7ff4c2355640 1 -- 172.21.15.114:0/2899216457 shutdown_connections 2023-11-04T01:36:55.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.380+0000 7ff4c2355640 1 -- 172.21.15.114:0/2899216457 wait complete. 2023-11-04T01:36:55.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.381+0000 7ff4c2355640 1 Processor -- start 2023-11-04T01:36:55.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.381+0000 7ff4c2355640 1 -- start start 2023-11-04T01:36:55.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4c2355640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4bc06a830 0x7ff4bc0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4c2355640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc06eba0 0x7ff4bc0b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4c2355640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4bc15ab70 0x7ff4bc0b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4c2355640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0c3610 con 0x7ff4bc06eba0 2023-11-04T01:36:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4c2355640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0c38b0 con 0x7ff4bc06a830 2023-11-04T01:36:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4c2355640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0c3b90 con 0x7ff4bc15ab70 2023-11-04T01:36:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4bb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc06eba0 0x7ff4bc0b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4bb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc06eba0 0x7ff4bc0b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49654/0 (socket says 172.21.15.114:49654) 2023-11-04T01:36:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4bb7fe640 1 -- 172.21.15.114:0/1274353415 learned_addr learned my addr 172.21.15.114:0/1274353415 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4bbfff640 1 --2- 172.21.15.114:0/1274353415 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4bc06a830 0x7ff4bc0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4c08f2640 1 --2- 172.21.15.114:0/1274353415 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4bc15ab70 0x7ff4bc0b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4bb7fe640 1 -- 172.21.15.114:0/1274353415 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4bc15ab70 msgr2=0x7ff4bc0b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4bb7fe640 1 --2- 172.21.15.114:0/1274353415 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4bc15ab70 0x7ff4bc0b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4bb7fe640 1 -- 172.21.15.114:0/1274353415 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4bc06a830 msgr2=0x7ff4bc0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4bb7fe640 1 --2- 172.21.15.114:0/1274353415 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4bc06a830 0x7ff4bc0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4bb7fe640 1 -- 172.21.15.114:0/1274353415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b4009a70 con 0x7ff4bc06eba0 2023-11-04T01:36:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4c08f2640 1 --2- 172.21.15.114:0/1274353415 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4bc15ab70 0x7ff4bc0b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4bb7fe640 1 --2- 172.21.15.114:0/1274353415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc06eba0 0x7ff4bc0b2630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000e840 tx=0x7ff4b000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4b8ff9640 1 -- 172.21.15.114:0/1274353415 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00095c0 con 0x7ff4bc06eba0 2023-11-04T01:36:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.382+0000 7ff4b8ff9640 1 -- 172.21.15.114:0/1274353415 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b000c940 con 0x7ff4bc06eba0 2023-11-04T01:36:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.383+0000 7ff4c2355640 1 -- 172.21.15.114:0/1274353415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc0c3e70 con 0x7ff4bc06eba0 2023-11-04T01:36:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.383+0000 7ff4b8ff9640 1 -- 172.21.15.114:0/1274353415 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b000ccd0 con 0x7ff4bc06eba0 2023-11-04T01:36:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.383+0000 7ff4c2355640 1 -- 172.21.15.114:0/1274353415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4bc0b5260 con 0x7ff4bc06eba0 2023-11-04T01:36:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.383+0000 7ff4c2355640 1 -- 172.21.15.114:0/1274353415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4bc074290 con 0x7ff4bc06eba0 2023-11-04T01:36:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.384+0000 7ff4b8ff9640 1 -- 172.21.15.114:0/1274353415 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4b0013470 con 0x7ff4bc06eba0 2023-11-04T01:36:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.384+0000 7ff4b8ff9640 1 --2- 172.21.15.114:0/1274353415 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff4a806ae70 0x7ff4a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.384+0000 7ff4b8ff9640 1 -- 172.21.15.114:0/1274353415 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff4b0089dd0 con 0x7ff4bc06eba0 2023-11-04T01:36:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.384+0000 7ff4bbfff640 1 --2- 172.21.15.114:0/1274353415 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff4a806ae70 0x7ff4a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.385+0000 7ff4bbfff640 1 --2- 172.21.15.114:0/1274353415 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff4a806ae70 0x7ff4a806d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac000fb0 tx=0x7ff4ac007b00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.388+0000 7ff4b8ff9640 1 -- 172.21.15.114:0/1274353415 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4b0054c20 con 0x7ff4bc06eba0 2023-11-04T01:36:55.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.555+0000 7ff4c2355640 1 -- 172.21.15.114:0/1274353415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4bc0cd650 con 0x7ff4bc06eba0 2023-11-04T01:36:55.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.557+0000 7ff4b8ff9640 1 -- 172.21.15.114:0/1274353415 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18406 (secure 0 0 0) 0x7ff4b0021090 con 0x7ff4bc06eba0 2023-11-04T01:36:55.559 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:34.950923+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:55.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.559+0000 7ff4c2355640 1 -- 172.21.15.114:0/1274353415 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff4a806ae70 msgr2=0x7ff4a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.559+0000 7ff4c2355640 1 --2- 172.21.15.114:0/1274353415 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff4a806ae70 0x7ff4a806d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac000fb0 tx=0x7ff4ac007b00 comp rx=0 tx=0).stop 2023-11-04T01:36:55.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.559+0000 7ff4c2355640 1 -- 172.21.15.114:0/1274353415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc06eba0 msgr2=0x7ff4bc0b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.559+0000 7ff4c2355640 1 --2- 172.21.15.114:0/1274353415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc06eba0 0x7ff4bc0b2630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000e840 tx=0x7ff4b000ed00 comp rx=0 tx=0).stop 2023-11-04T01:36:55.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.559+0000 7ff4c2355640 1 -- 172.21.15.114:0/1274353415 shutdown_connections 2023-11-04T01:36:55.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.559+0000 7ff4c2355640 1 --2- 172.21.15.114:0/1274353415 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff4bc15ab70 0x7ff4bc0b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.559+0000 7ff4c2355640 1 --2- 172.21.15.114:0/1274353415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4bc06eba0 0x7ff4bc0b2630 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.559+0000 7ff4c2355640 1 --2- 172.21.15.114:0/1274353415 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff4a806ae70 0x7ff4a806d330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.559+0000 7ff4c2355640 1 --2- 172.21.15.114:0/1274353415 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff4bc06a830 0x7ff4bc0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.559+0000 7ff4c2355640 1 -- 172.21.15.114:0/1274353415 >> 172.21.15.114:0/1274353415 conn(0x7ff4bc098d40 msgr2=0x7ff4bc15ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.559+0000 7ff4c2355640 1 -- 172.21.15.114:0/1274353415 shutdown_connections 2023-11-04T01:36:55.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.559+0000 7ff4c2355640 1 -- 172.21.15.114:0/1274353415 wait complete. 2023-11-04T01:36:55.571 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:55.572 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:55.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.672+0000 7ff2c8aaf640 1 Processor -- start 2023-11-04T01:36:55.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.672+0000 7ff2c8aaf640 1 -- start start 2023-11-04T01:36:55.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.673+0000 7ff2c8aaf640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff2c4067090 0x7ff2c406e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.673+0000 7ff2c8aaf640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c40b24f0 con 0x7ff2c415b140 2023-11-04T01:36:55.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.673+0000 7ff2c8aaf640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c40ce220 con 0x7ff2c406cbd0 2023-11-04T01:36:55.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.673+0000 7ff2c8aaf640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c40cdc60 con 0x7ff2c4067090 2023-11-04T01:36:55.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.673+0000 7ff2c1d9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff2c415b140 0x7ff2c40b2980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41236/0 (socket says 172.21.15.114:41236) 2023-11-04T01:36:55.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.673+0000 7ff2c1d9b640 1 -- 172.21.15.114:0/2897942708 learned_addr learned my addr 172.21.15.114:0/2897942708 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:55.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.673+0000 7ff2c2d9d640 1 --2- 172.21.15.114:0/2897942708 >> v2:172.21.15.141:3300/0 conn(0x7ff2c4067090 0x7ff2c406e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.673+0000 7ff2c2d9d640 1 -- 172.21.15.114:0/2897942708 >> v1:172.21.15.141:6789/0 conn(0x7ff2c406cbd0 legacy=0x7ff2c406cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.673+0000 7ff2c2d9d640 1 -- 172.21.15.114:0/2897942708 >> v1:172.21.15.114:6789/0 conn(0x7ff2c415b140 legacy=0x7ff2c40b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.673+0000 7ff2c2d9d640 1 -- 172.21.15.114:0/2897942708 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c40cdf40 con 0x7ff2c4067090 2023-11-04T01:36:55.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.674+0000 7ff2c2d9d640 1 --2- 172.21.15.114:0/2897942708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2c4067090 0x7ff2c406e180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009d90 tx=0x7ff2bc02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e03909b88079f0f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.679+0000 7ff2c159a640 1 -- 172.21.15.114:0/2897942708 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc02cc60 con 0x7ff2c4067090 2023-11-04T01:36:55.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.679+0000 7ff2c159a640 1 -- 172.21.15.114:0/2897942708 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc02cdc0 con 0x7ff2c4067090 2023-11-04T01:36:55.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.679+0000 7ff2c159a640 1 -- 172.21.15.114:0/2897942708 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc034660 con 0x7ff2c4067090 2023-11-04T01:36:55.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.679+0000 7ff2c8aaf640 1 -- 172.21.15.114:0/2897942708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2c4067090 msgr2=0x7ff2c406e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.679+0000 7ff2c8aaf640 1 --2- 172.21.15.114:0/2897942708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2c4067090 0x7ff2c406e180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009d90 tx=0x7ff2bc02beb0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.679+0000 7ff2c8aaf640 1 -- 172.21.15.114:0/2897942708 shutdown_connections 2023-11-04T01:36:55.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.679+0000 7ff2c8aaf640 1 --2- 172.21.15.114:0/2897942708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2c4067090 0x7ff2c406e180 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.679+0000 7ff2c8aaf640 1 -- 172.21.15.114:0/2897942708 >> 172.21.15.114:0/2897942708 conn(0x7ff2c406a120 msgr2=0x7ff2c406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.679+0000 7ff2c8aaf640 1 -- 172.21.15.114:0/2897942708 shutdown_connections 2023-11-04T01:36:55.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.679+0000 7ff2c8aaf640 1 -- 172.21.15.114:0/2897942708 wait complete. 2023-11-04T01:36:55.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.681+0000 7ff2c8aaf640 1 Processor -- start 2023-11-04T01:36:55.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.681+0000 7ff2c8aaf640 1 -- start start 2023-11-04T01:36:55.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.681+0000 7ff2c8aaf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2c4067090 0x7ff2c4151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.681+0000 7ff2c8aaf640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2c406cbd0 0x7ff2c414d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.681+0000 7ff2c8aaf640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2c415b140 0x7ff2c4158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.681+0000 7ff2c8aaf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c40c2840 con 0x7ff2c4067090 2023-11-04T01:36:55.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.681+0000 7ff2c8aaf640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c414e2e0 con 0x7ff2c406cbd0 2023-11-04T01:36:55.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.681+0000 7ff2c8aaf640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c40c3350 con 0x7ff2c415b140 2023-11-04T01:36:55.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2c259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2c4067090 0x7ff2c4151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2c259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2c4067090 0x7ff2c4151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49660/0 (socket says 172.21.15.114:49660) 2023-11-04T01:36:55.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2c259c640 1 -- 172.21.15.114:0/1055277635 learned_addr learned my addr 172.21.15.114:0/1055277635 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:55.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2c2d9d640 1 --2- 172.21.15.114:0/1055277635 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2c415b140 0x7ff2c4158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2c1d9b640 1 --2- 172.21.15.114:0/1055277635 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2c406cbd0 0x7ff2c414d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2c259c640 1 -- 172.21.15.114:0/1055277635 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2c415b140 msgr2=0x7ff2c4158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2c259c640 1 --2- 172.21.15.114:0/1055277635 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2c415b140 0x7ff2c4158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2c259c640 1 -- 172.21.15.114:0/1055277635 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2c406cbd0 msgr2=0x7ff2c414d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2c259c640 1 --2- 172.21.15.114:0/1055277635 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2c406cbd0 0x7ff2c414d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2c259c640 1 -- 172.21.15.114:0/1055277635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc009a70 con 0x7ff2c4067090 2023-11-04T01:36:55.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2c2d9d640 1 --2- 172.21.15.114:0/1055277635 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2c415b140 0x7ff2c4158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:55.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2c259c640 1 --2- 172.21.15.114:0/1055277635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2c4067090 0x7ff2c4151ef0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400c450 tx=0x7ff2b400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2b2ffd640 1 -- 172.21.15.114:0/1055277635 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b40052d0 con 0x7ff2c4067090 2023-11-04T01:36:55.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2b2ffd640 1 -- 172.21.15.114:0/1055277635 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b4005430 con 0x7ff2c4067090 2023-11-04T01:36:55.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2c8aaf640 1 -- 172.21.15.114:0/1055277635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c40c2a20 con 0x7ff2c4067090 2023-11-04T01:36:55.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2b2ffd640 1 -- 172.21.15.114:0/1055277635 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4012870 con 0x7ff2c4067090 2023-11-04T01:36:55.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.682+0000 7ff2c8aaf640 1 -- 172.21.15.114:0/1055277635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c40c2fe0 con 0x7ff2c4067090 2023-11-04T01:36:55.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.683+0000 7ff2c8aaf640 1 -- 172.21.15.114:0/1055277635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c4074290 con 0x7ff2c4067090 2023-11-04T01:36:55.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.684+0000 7ff2b2ffd640 1 -- 172.21.15.114:0/1055277635 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff2b40129d0 con 0x7ff2c4067090 2023-11-04T01:36:55.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.684+0000 7ff2b2ffd640 1 --2- 172.21.15.114:0/1055277635 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff2a406aea0 0x7ff2a406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.684+0000 7ff2c1d9b640 1 --2- 172.21.15.114:0/1055277635 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff2a406aea0 0x7ff2a406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.684+0000 7ff2b2ffd640 1 -- 172.21.15.114:0/1055277635 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff2b40894d0 con 0x7ff2c4067090 2023-11-04T01:36:55.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.684+0000 7ff2c1d9b640 1 --2- 172.21.15.114:0/1055277635 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff2a406aea0 0x7ff2a406d360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4150210 tx=0x7ff2b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.688+0000 7ff2b2ffd640 1 -- 172.21.15.114:0/1055277635 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff2b4054200 con 0x7ff2c4067090 2023-11-04T01:36:55.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.856+0000 7ff2c8aaf640 1 -- 172.21.15.114:0/1055277635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2c40b2150 con 0x7ff2c4067090 2023-11-04T01:36:55.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.856+0000 7ff2b2ffd640 1 -- 172.21.15.114:0/1055277635 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2b4057820 con 0x7ff2c4067090 2023-11-04T01:36:55.858 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:36:55.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.858+0000 7ff2c8aaf640 1 -- 172.21.15.114:0/1055277635 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff2a406aea0 msgr2=0x7ff2a406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.858+0000 7ff2c8aaf640 1 --2- 172.21.15.114:0/1055277635 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff2a406aea0 0x7ff2a406d360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4150210 tx=0x7ff2b8009040 comp rx=0 tx=0).stop 2023-11-04T01:36:55.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.858+0000 7ff2c8aaf640 1 -- 172.21.15.114:0/1055277635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2c4067090 msgr2=0x7ff2c4151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.858+0000 7ff2c8aaf640 1 --2- 172.21.15.114:0/1055277635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2c4067090 0x7ff2c4151ef0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400c450 tx=0x7ff2b400c910 comp rx=0 tx=0).stop 2023-11-04T01:36:55.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.858+0000 7ff2c8aaf640 1 -- 172.21.15.114:0/1055277635 shutdown_connections 2023-11-04T01:36:55.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.858+0000 7ff2c8aaf640 1 --2- 172.21.15.114:0/1055277635 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2c415b140 0x7ff2c4158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.858+0000 7ff2c8aaf640 1 --2- 172.21.15.114:0/1055277635 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff2a406aea0 0x7ff2a406d360 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.858+0000 7ff2c8aaf640 1 --2- 172.21.15.114:0/1055277635 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2c406cbd0 0x7ff2c414d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.858+0000 7ff2c8aaf640 1 --2- 172.21.15.114:0/1055277635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2c4067090 0x7ff2c4151ef0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.858+0000 7ff2c8aaf640 1 -- 172.21.15.114:0/1055277635 >> 172.21.15.114:0/1055277635 conn(0x7ff2c406a120 msgr2=0x7ff2c4158730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.858+0000 7ff2c8aaf640 1 -- 172.21.15.114:0/1055277635 shutdown_connections 2023-11-04T01:36:55.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.858+0000 7ff2c8aaf640 1 -- 172.21.15.114:0/1055277635 wait complete. 2023-11-04T01:36:55.871 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:55.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.972+0000 7f55987ce640 1 Processor -- start 2023-11-04T01:36:55.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.972+0000 7f55987ce640 1 -- start start 2023-11-04T01:36:55.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.972+0000 7f55987ce640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f559015e430 0x7f55900cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.972+0000 7f55987ce640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55900cf160 0x7f55900cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.972+0000 7f55987ce640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f55900d0710 0x7f55900cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.973+0000 7f55987ce640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55900cdf90 con 0x7f559015e430 2023-11-04T01:36:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.973+0000 7f55987ce640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55900d0280 con 0x7f55900d0710 2023-11-04T01:36:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.973+0000 7f55987ce640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55900cf670 con 0x7f55900cf160 2023-11-04T01:36:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.973+0000 7f559656a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f559015e430 0x7f55900cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.973+0000 7f559656a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f559015e430 0x7f55900cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49672/0 (socket says 172.21.15.114:49672) 2023-11-04T01:36:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.973+0000 7f559656a640 1 -- 172.21.15.114:0/1436718659 learned_addr learned my addr 172.21.15.114:0/1436718659 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.973+0000 7f5595d69640 1 --2- 172.21.15.114:0/1436718659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55900cf160 0x7f55900cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.973+0000 7f5596d6b640 1 --2- 172.21.15.114:0/1436718659 >> v2:172.21.15.141:3300/0 conn(0x7f55900d0710 0x7f55900cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.973+0000 7f559656a640 1 -- 172.21.15.114:0/1436718659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55900cf160 msgr2=0x7f55900cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.973+0000 7f559656a640 1 --2- 172.21.15.114:0/1436718659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55900cf160 0x7f55900cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.973+0000 7f559656a640 1 -- 172.21.15.114:0/1436718659 >> v2:172.21.15.141:3300/0 conn(0x7f55900d0710 msgr2=0x7f55900cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.973+0000 7f559656a640 1 --2- 172.21.15.114:0/1436718659 >> v2:172.21.15.141:3300/0 conn(0x7f55900d0710 0x7f55900cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.973+0000 7f559656a640 1 -- 172.21.15.114:0/1436718659 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55900cf950 con 0x7f559015e430 2023-11-04T01:36:55.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.973+0000 7f5595d69640 1 --2- 172.21.15.114:0/1436718659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55900cf160 0x7f55900cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:55.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.974+0000 7f559656a640 1 --2- 172.21.15.114:0/1436718659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f559015e430 0x7f55900cec20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f559006f860 tx=0x7f558c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efec94ea6a9ad386 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.974+0000 7f5595568640 1 -- 172.21.15.114:0/1436718659 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c031870 con 0x7f559015e430 2023-11-04T01:36:55.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.974+0000 7f5595568640 1 -- 172.21.15.114:0/1436718659 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c0319d0 con 0x7f559015e430 2023-11-04T01:36:55.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.974+0000 7f5595568640 1 -- 172.21.15.114:0/1436718659 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c031d60 con 0x7f559015e430 2023-11-04T01:36:55.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.974+0000 7f55987ce640 1 -- 172.21.15.114:0/1436718659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f559015e430 msgr2=0x7f55900cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.974+0000 7f55987ce640 1 --2- 172.21.15.114:0/1436718659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f559015e430 0x7f55900cec20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f559006f860 tx=0x7f558c02b910 comp rx=0 tx=0).stop 2023-11-04T01:36:55.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.974+0000 7f55987ce640 1 -- 172.21.15.114:0/1436718659 shutdown_connections 2023-11-04T01:36:55.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.974+0000 7f55987ce640 1 --2- 172.21.15.114:0/1436718659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55900cf160 0x7f55900cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.974+0000 7f55987ce640 1 --2- 172.21.15.114:0/1436718659 >> v2:172.21.15.141:3300/0 conn(0x7f55900d0710 0x7f55900cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.974+0000 7f55987ce640 1 --2- 172.21.15.114:0/1436718659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f559015e430 0x7f55900cec20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.974+0000 7f55987ce640 1 -- 172.21.15.114:0/1436718659 >> 172.21.15.114:0/1436718659 conn(0x7f559006ea20 msgr2=0x7f559006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:55.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.974+0000 7f55987ce640 1 -- 172.21.15.114:0/1436718659 shutdown_connections 2023-11-04T01:36:55.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.974+0000 7f55987ce640 1 -- 172.21.15.114:0/1436718659 wait complete. 2023-11-04T01:36:55.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.976+0000 7f55987ce640 1 Processor -- start 2023-11-04T01:36:55.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.976+0000 7f55987ce640 1 -- start start 2023-11-04T01:36:55.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.976+0000 7f55987ce640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55900cf160 0x7f55900a7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.976+0000 7f55987ce640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55900d0710 0x7f55901f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.976+0000 7f55987ce640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f559015e430 0x7f55900b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.976+0000 7f55987ce640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559014a7a0 con 0x7f55900cf160 2023-11-04T01:36:55.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.976+0000 7f55987ce640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559014d290 con 0x7f559015e430 2023-11-04T01:36:55.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.976+0000 7f55987ce640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559014d720 con 0x7f55900d0710 2023-11-04T01:36:55.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.976+0000 7f559656a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55900cf160 0x7f55900a7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.976+0000 7f559656a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55900cf160 0x7f55900a7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49686/0 (socket says 172.21.15.114:49686) 2023-11-04T01:36:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.976+0000 7f559656a640 1 -- 172.21.15.114:0/1987823683 learned_addr learned my addr 172.21.15.114:0/1987823683 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.977+0000 7f5595d69640 1 --2- 172.21.15.114:0/1987823683 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55900d0710 0x7f55901f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.977+0000 7f5596d6b640 1 --2- 172.21.15.114:0/1987823683 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f559015e430 0x7f55900b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.977+0000 7f559656a640 1 -- 172.21.15.114:0/1987823683 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55900d0710 msgr2=0x7f55901f17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.977+0000 7f559656a640 1 --2- 172.21.15.114:0/1987823683 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55900d0710 0x7f55901f17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.977+0000 7f559656a640 1 -- 172.21.15.114:0/1987823683 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f559015e430 msgr2=0x7f55900b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:55.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.977+0000 7f559656a640 1 --2- 172.21.15.114:0/1987823683 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f559015e430 0x7f55900b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:55.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.977+0000 7f559656a640 1 -- 172.21.15.114:0/1987823683 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c0094d0 con 0x7f55900cf160 2023-11-04T01:36:55.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.977+0000 7f5596d6b640 1 --2- 172.21.15.114:0/1987823683 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f559015e430 0x7f55900b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:55.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.977+0000 7f559656a640 1 --2- 172.21.15.114:0/1987823683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55900cf160 0x7f55900a7540 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f558c02b950 tx=0x7f558c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.977+0000 7f5586ffd640 1 -- 172.21.15.114:0/1987823683 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c03ad30 con 0x7f55900cf160 2023-11-04T01:36:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.977+0000 7f5586ffd640 1 -- 172.21.15.114:0/1987823683 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c0443f0 con 0x7f55900cf160 2023-11-04T01:36:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.977+0000 7f55987ce640 1 -- 172.21.15.114:0/1987823683 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559014c960 con 0x7f55900cf160 2023-11-04T01:36:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.977+0000 7f5586ffd640 1 -- 172.21.15.114:0/1987823683 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c0447a0 con 0x7f55900cf160 2023-11-04T01:36:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.977+0000 7f55987ce640 1 -- 172.21.15.114:0/1987823683 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559014cf20 con 0x7f55900cf160 2023-11-04T01:36:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.978+0000 7f55987ce640 1 -- 172.21.15.114:0/1987823683 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5590074290 con 0x7f55900cf160 2023-11-04T01:36:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.978+0000 7f5586ffd640 1 -- 172.21.15.114:0/1987823683 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f558c04d450 con 0x7f55900cf160 2023-11-04T01:36:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.979+0000 7f5586ffd640 1 --2- 172.21.15.114:0/1987823683 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f557406ae70 0x7f557406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.979+0000 7f5586ffd640 1 -- 172.21.15.114:0/1987823683 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f558c02d040 con 0x7f55900cf160 2023-11-04T01:36:55.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.979+0000 7f5595d69640 1 --2- 172.21.15.114:0/1987823683 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f557406ae70 0x7f557406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:55.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.979+0000 7f5595d69640 1 --2- 172.21.15.114:0/1987823683 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f557406ae70 0x7f557406d330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f55900af700 tx=0x7f5580008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:55.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:55.983+0000 7f5586ffd640 1 -- 172.21.15.114:0/1987823683 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f558c076c20 con 0x7f55900cf160 2023-11-04T01:36:56.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.149+0000 7f55987ce640 1 -- 172.21.15.114:0/1987823683 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55900b57f0 con 0x7f55900cf160 2023-11-04T01:36:56.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.149+0000 7f5586ffd640 1 -- 172.21.15.114:0/1987823683 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f558c035020 con 0x7f55900cf160 2023-11-04T01:36:56.152 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:36:56.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.151+0000 7f55987ce640 1 -- 172.21.15.114:0/1987823683 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f557406ae70 msgr2=0x7f557406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.151+0000 7f55987ce640 1 --2- 172.21.15.114:0/1987823683 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f557406ae70 0x7f557406d330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f55900af700 tx=0x7f5580008040 comp rx=0 tx=0).stop 2023-11-04T01:36:56.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.151+0000 7f55987ce640 1 -- 172.21.15.114:0/1987823683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55900cf160 msgr2=0x7f55900a7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.151+0000 7f55987ce640 1 --2- 172.21.15.114:0/1987823683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55900cf160 0x7f55900a7540 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f558c02b950 tx=0x7f558c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.151+0000 7f55987ce640 1 -- 172.21.15.114:0/1987823683 shutdown_connections 2023-11-04T01:36:56.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.151+0000 7f55987ce640 1 --2- 172.21.15.114:0/1987823683 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f557406ae70 0x7f557406d330 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.151+0000 7f55987ce640 1 --2- 172.21.15.114:0/1987823683 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f559015e430 0x7f55900b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.151+0000 7f55987ce640 1 --2- 172.21.15.114:0/1987823683 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55900d0710 0x7f55901f17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.151+0000 7f55987ce640 1 --2- 172.21.15.114:0/1987823683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55900cf160 0x7f55900a7540 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.151+0000 7f55987ce640 1 -- 172.21.15.114:0/1987823683 >> 172.21.15.114:0/1987823683 conn(0x7f559006ea20 msgr2=0x7f559015c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.152+0000 7f55987ce640 1 -- 172.21.15.114:0/1987823683 shutdown_connections 2023-11-04T01:36:56.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.152+0000 7f55987ce640 1 -- 172.21.15.114:0/1987823683 wait complete. 2023-11-04T01:36:56.164 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:56.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.264+0000 7f5c6d27c640 1 Processor -- start 2023-11-04T01:36:56.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.264+0000 7f5c6d27c640 1 -- start start 2023-11-04T01:36:56.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.265+0000 7f5c6d27c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c6815e430 0x7f5c680cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.265+0000 7f5c6d27c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c680d0280 con 0x7f5c680d0710 2023-11-04T01:36:56.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.265+0000 7f5c6d27c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c680cf670 con 0x7f5c680cf160 2023-11-04T01:36:56.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.265+0000 7f5c6d27c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c680cf950 con 0x7f5c6815e430 2023-11-04T01:36:56.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.265+0000 7f5c66ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c6815e430 0x7f5c680cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.265+0000 7f5c66ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c6815e430 0x7f5c680cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49690/0 (socket says 172.21.15.114:49690) 2023-11-04T01:36:56.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.265+0000 7f5c66ffd640 1 -- 172.21.15.114:0/3475992866 learned_addr learned my addr 172.21.15.114:0/3475992866 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:56.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.265+0000 7f5c66ffd640 1 -- 172.21.15.114:0/3475992866 >> v1:172.21.15.141:6789/0 conn(0x7f5c680cf160 legacy=0x7f5c680cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.265+0000 7f5c66ffd640 1 -- 172.21.15.114:0/3475992866 >> v1:172.21.15.114:6789/0 conn(0x7f5c680d0710 legacy=0x7f5c680b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.265+0000 7f5c66ffd640 1 -- 172.21.15.114:0/3475992866 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c680cfc30 con 0x7f5c6815e430 2023-11-04T01:36:56.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.266+0000 7f5c66ffd640 1 --2- 172.21.15.114:0/3475992866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c6815e430 0x7f5c680cec20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009870 tx=0x7f5c5802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bf69a924670608 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.266+0000 7f5c667fc640 1 -- 172.21.15.114:0/3475992866 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5802f840 con 0x7f5c6815e430 2023-11-04T01:36:56.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.266+0000 7f5c667fc640 1 -- 172.21.15.114:0/3475992866 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5802f9a0 con 0x7f5c6815e430 2023-11-04T01:36:56.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.266+0000 7f5c667fc640 1 -- 172.21.15.114:0/3475992866 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5802fd30 con 0x7f5c6815e430 2023-11-04T01:36:56.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.267+0000 7f5c6d27c640 1 -- 172.21.15.114:0/3475992866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c6815e430 msgr2=0x7f5c680cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.267+0000 7f5c6d27c640 1 --2- 172.21.15.114:0/3475992866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c6815e430 0x7f5c680cec20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009870 tx=0x7f5c5802ba20 comp rx=0 tx=0).stop 2023-11-04T01:36:56.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.267+0000 7f5c6d27c640 1 -- 172.21.15.114:0/3475992866 shutdown_connections 2023-11-04T01:36:56.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.267+0000 7f5c6d27c640 1 --2- 172.21.15.114:0/3475992866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c6815e430 0x7f5c680cec20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.267+0000 7f5c6d27c640 1 -- 172.21.15.114:0/3475992866 >> 172.21.15.114:0/3475992866 conn(0x7f5c6806ea20 msgr2=0x7f5c6806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.267+0000 7f5c6d27c640 1 -- 172.21.15.114:0/3475992866 shutdown_connections 2023-11-04T01:36:56.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.267+0000 7f5c6d27c640 1 -- 172.21.15.114:0/3475992866 wait complete. 2023-11-04T01:36:56.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.268+0000 7f5c6d27c640 1 Processor -- start 2023-11-04T01:36:56.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.268+0000 7f5c6d27c640 1 -- start start 2023-11-04T01:36:56.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c6d27c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c680cf160 0x7f5c680c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c6d27c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c680d0710 0x7f5c681576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c6d27c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c6815e430 0x7f5c68158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c6d27c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c681572b0 con 0x7f5c680d0710 2023-11-04T01:36:56.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c6d27c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c68158cd0 con 0x7f5c6815e430 2023-11-04T01:36:56.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c6d27c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c68156910 con 0x7f5c680cf160 2023-11-04T01:36:56.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c5e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c680d0710 0x7f5c681576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c5e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c680d0710 0x7f5c681576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49692/0 (socket says 172.21.15.114:49692) 2023-11-04T01:36:56.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c5e7fc640 1 -- 172.21.15.114:0/2946093748 learned_addr learned my addr 172.21.15.114:0/2946093748 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:56.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c66ffd640 1 --2- 172.21.15.114:0/2946093748 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c680cf160 0x7f5c680c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c677fe640 1 --2- 172.21.15.114:0/2946093748 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c6815e430 0x7f5c68158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c5e7fc640 1 -- 172.21.15.114:0/2946093748 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c680cf160 msgr2=0x7f5c680c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c5e7fc640 1 --2- 172.21.15.114:0/2946093748 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c680cf160 0x7f5c680c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c5e7fc640 1 -- 172.21.15.114:0/2946093748 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c6815e430 msgr2=0x7f5c68158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c5e7fc640 1 --2- 172.21.15.114:0/2946093748 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c6815e430 0x7f5c68158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c5e7fc640 1 -- 172.21.15.114:0/2946093748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c580094d0 con 0x7f5c680d0710 2023-11-04T01:36:56.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c66ffd640 1 --2- 172.21.15.114:0/2946093748 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c680cf160 0x7f5c680c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:56.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c677fe640 1 --2- 172.21.15.114:0/2946093748 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c6815e430 0x7f5c68158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:56.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c5e7fc640 1 --2- 172.21.15.114:0/2946093748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c680d0710 0x7f5c681576d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000c480 tx=0x7f5c5000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c5ffff640 1 -- 172.21.15.114:0/2946093748 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c500052d0 con 0x7f5c680d0710 2023-11-04T01:36:56.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c5ffff640 1 -- 172.21.15.114:0/2946093748 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c50005430 con 0x7f5c680d0710 2023-11-04T01:36:56.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c6d27c640 1 -- 172.21.15.114:0/2946093748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c68156bf0 con 0x7f5c680d0710 2023-11-04T01:36:56.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c5ffff640 1 -- 172.21.15.114:0/2946093748 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50012870 con 0x7f5c680d0710 2023-11-04T01:36:56.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.269+0000 7f5c6d27c640 1 -- 172.21.15.114:0/2946093748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c68157c10 con 0x7f5c680d0710 2023-11-04T01:36:56.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.270+0000 7f5c6d27c640 1 -- 172.21.15.114:0/2946093748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c68074290 con 0x7f5c680d0710 2023-11-04T01:36:56.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.271+0000 7f5c5ffff640 1 -- 172.21.15.114:0/2946093748 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5c500129d0 con 0x7f5c680d0710 2023-11-04T01:36:56.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.271+0000 7f5c5ffff640 1 --2- 172.21.15.114:0/2946093748 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c4806aea0 0x7f5c4806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.271+0000 7f5c5ffff640 1 -- 172.21.15.114:0/2946093748 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5c50089410 con 0x7f5c680d0710 2023-11-04T01:36:56.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.271+0000 7f5c66ffd640 1 --2- 172.21.15.114:0/2946093748 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c4806aea0 0x7f5c4806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.272+0000 7f5c66ffd640 1 --2- 172.21.15.114:0/2946093748 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c4806aea0 0x7f5c4806d360 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5c58036000 tx=0x7f5c58008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.275+0000 7f5c5ffff640 1 -- 172.21.15.114:0/2946093748 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5c50054260 con 0x7f5c680d0710 2023-11-04T01:36:56.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.440+0000 7f5c6d27c640 1 -- 172.21.15.114:0/2946093748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c680c4140 con 0x7f5c680d0710 2023-11-04T01:36:56.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.440+0000 7f5c5ffff640 1 -- 172.21.15.114:0/2946093748 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c50057880 con 0x7f5c680d0710 2023-11-04T01:36:56.443 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:36:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.442+0000 7f5c6d27c640 1 -- 172.21.15.114:0/2946093748 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c4806aea0 msgr2=0x7f5c4806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.442+0000 7f5c6d27c640 1 --2- 172.21.15.114:0/2946093748 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c4806aea0 0x7f5c4806d360 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5c58036000 tx=0x7f5c58008030 comp rx=0 tx=0).stop 2023-11-04T01:36:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.442+0000 7f5c6d27c640 1 -- 172.21.15.114:0/2946093748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c680d0710 msgr2=0x7f5c681576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.442+0000 7f5c6d27c640 1 --2- 172.21.15.114:0/2946093748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c680d0710 0x7f5c681576d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000c480 tx=0x7f5c5000c940 comp rx=0 tx=0).stop 2023-11-04T01:36:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.442+0000 7f5c6d27c640 1 -- 172.21.15.114:0/2946093748 shutdown_connections 2023-11-04T01:36:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.442+0000 7f5c6d27c640 1 --2- 172.21.15.114:0/2946093748 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c4806aea0 0x7f5c4806d360 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.442+0000 7f5c6d27c640 1 --2- 172.21.15.114:0/2946093748 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c6815e430 0x7f5c68158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.442+0000 7f5c6d27c640 1 --2- 172.21.15.114:0/2946093748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c680d0710 0x7f5c681576d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.442+0000 7f5c6d27c640 1 --2- 172.21.15.114:0/2946093748 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c680cf160 0x7f5c680c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.442+0000 7f5c6d27c640 1 -- 172.21.15.114:0/2946093748 >> 172.21.15.114:0/2946093748 conn(0x7f5c6806ea20 msgr2=0x7f5c6815cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.443+0000 7f5c6d27c640 1 -- 172.21.15.114:0/2946093748 shutdown_connections 2023-11-04T01:36:56.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.443+0000 7f5c6d27c640 1 -- 172.21.15.114:0/2946093748 wait complete. 2023-11-04T01:36:56.455 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:56.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.555+0000 7fcd0ad39640 1 Processor -- start 2023-11-04T01:36:56.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.556+0000 7fcd0ad39640 1 -- start start 2023-11-04T01:36:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.556+0000 7fcd0ad39640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd04071f90 0x7fcd040b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.556+0000 7fcd0ad39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd0415add0 0x7fcd040cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.556+0000 7fcd0ad39640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd040b1cc0 con 0x7fcd04072370 2023-11-04T01:36:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.556+0000 7fcd0ad39640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd040b1fa0 con 0x7fcd04071f90 2023-11-04T01:36:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.556+0000 7fcd0ad39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0415a0e0 con 0x7fcd0415add0 2023-11-04T01:36:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.556+0000 7fcd08ad5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd04071f90 0x7fcd040b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.557+0000 7fcd08ad5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd04071f90 0x7fcd040b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45050/0 (socket says 172.21.15.114:45050) 2023-11-04T01:36:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.557+0000 7fcd08ad5640 1 -- 172.21.15.114:0/3876783159 learned_addr learned my addr 172.21.15.114:0/3876783159 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.557+0000 7fcd03fff640 1 --2- 172.21.15.114:0/3876783159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd0415add0 0x7fcd040cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.557+0000 7fcd08ad5640 1 -- 172.21.15.114:0/3876783159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd0415add0 msgr2=0x7fcd040cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.557+0000 7fcd08ad5640 1 --2- 172.21.15.114:0/3876783159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd0415add0 0x7fcd040cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.557+0000 7fcd08ad5640 1 -- 172.21.15.114:0/3876783159 >> v1:172.21.15.141:6789/0 conn(0x7fcd04072370 legacy=0x7fcd040cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.557+0000 7fcd08ad5640 1 -- 172.21.15.114:0/3876783159 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0415a2f0 con 0x7fcd04071f90 2023-11-04T01:36:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.557+0000 7fcd08ad5640 1 --2- 172.21.15.114:0/3876783159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd04071f90 0x7fcd040b1490 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009e50 tx=0x7fccf402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13fd3605d9d705e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.558+0000 7fcd037fe640 1 -- 172.21.15.114:0/3876783159 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf402cb00 con 0x7fcd04071f90 2023-11-04T01:36:56.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.558+0000 7fcd037fe640 1 -- 172.21.15.114:0/3876783159 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf402cc60 con 0x7fcd04071f90 2023-11-04T01:36:56.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.558+0000 7fcd037fe640 1 -- 172.21.15.114:0/3876783159 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf40343f0 con 0x7fcd04071f90 2023-11-04T01:36:56.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.558+0000 7fcd0ad39640 1 -- 172.21.15.114:0/3876783159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd04071f90 msgr2=0x7fcd040b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.558+0000 7fcd0ad39640 1 --2- 172.21.15.114:0/3876783159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd04071f90 0x7fcd040b1490 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009e50 tx=0x7fccf402bf60 comp rx=0 tx=0).stop 2023-11-04T01:36:56.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.558+0000 7fcd0ad39640 1 -- 172.21.15.114:0/3876783159 shutdown_connections 2023-11-04T01:36:56.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.558+0000 7fcd0ad39640 1 --2- 172.21.15.114:0/3876783159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd0415add0 0x7fcd040cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.558+0000 7fcd0ad39640 1 --2- 172.21.15.114:0/3876783159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd04071f90 0x7fcd040b1490 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.558+0000 7fcd0ad39640 1 -- 172.21.15.114:0/3876783159 >> 172.21.15.114:0/3876783159 conn(0x7fcd0406d800 msgr2=0x7fcd0406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.558+0000 7fcd0ad39640 1 -- 172.21.15.114:0/3876783159 shutdown_connections 2023-11-04T01:36:56.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.558+0000 7fcd0ad39640 1 -- 172.21.15.114:0/3876783159 wait complete. 2023-11-04T01:36:56.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.559+0000 7fcd0ad39640 1 Processor -- start 2023-11-04T01:36:56.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.559+0000 7fcd0ad39640 1 -- start start 2023-11-04T01:36:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.560+0000 7fcd0ad39640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd04071f90 0x7fcd041529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.560+0000 7fcd0ad39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd04072370 0x7fcd041521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.560+0000 7fcd0ad39640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd0415add0 0x7fcd040c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.560+0000 7fcd0ad39640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd040c75b0 con 0x7fcd04071f90 2023-11-04T01:36:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.560+0000 7fcd0ad39640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd040cc430 con 0x7fcd0415add0 2023-11-04T01:36:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.560+0000 7fcd0ad39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd040c6c10 con 0x7fcd04072370 2023-11-04T01:36:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.560+0000 7fcd08ad5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd04071f90 0x7fcd041529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.560+0000 7fcd08ad5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd04071f90 0x7fcd041529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45062/0 (socket says 172.21.15.114:45062) 2023-11-04T01:36:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.560+0000 7fcd08ad5640 1 -- 172.21.15.114:0/3537413403 learned_addr learned my addr 172.21.15.114:0/3537413403 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.560+0000 7fcd03fff640 1 --2- 172.21.15.114:0/3537413403 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd04072370 0x7fcd041521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.560+0000 7fcd092d6640 1 --2- 172.21.15.114:0/3537413403 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd0415add0 0x7fcd040c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.561+0000 7fcd08ad5640 1 -- 172.21.15.114:0/3537413403 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd04072370 msgr2=0x7fcd041521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.561+0000 7fcd08ad5640 1 --2- 172.21.15.114:0/3537413403 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd04072370 0x7fcd041521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.561+0000 7fcd08ad5640 1 -- 172.21.15.114:0/3537413403 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd0415add0 msgr2=0x7fcd040c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.561+0000 7fcd08ad5640 1 --2- 172.21.15.114:0/3537413403 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd0415add0 0x7fcd040c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.561+0000 7fcd08ad5640 1 -- 172.21.15.114:0/3537413403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf4009b30 con 0x7fcd04071f90 2023-11-04T01:36:56.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.561+0000 7fcd092d6640 1 --2- 172.21.15.114:0/3537413403 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd0415add0 0x7fcd040c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:56.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.561+0000 7fcd08ad5640 1 --2- 172.21.15.114:0/3537413403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd04071f90 0x7fcd041529f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fccf4000f80 tx=0x7fccf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.561+0000 7fcd017fa640 1 -- 172.21.15.114:0/3537413403 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4009510 con 0x7fcd04071f90 2023-11-04T01:36:56.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.561+0000 7fcd017fa640 1 -- 172.21.15.114:0/3537413403 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf403e450 con 0x7fcd04071f90 2023-11-04T01:36:56.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.561+0000 7fcd0ad39640 1 -- 172.21.15.114:0/3537413403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd040c6ef0 con 0x7fcd04071f90 2023-11-04T01:36:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.561+0000 7fcd017fa640 1 -- 172.21.15.114:0/3537413403 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf403e800 con 0x7fcd04071f90 2023-11-04T01:36:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.561+0000 7fcd0ad39640 1 -- 172.21.15.114:0/3537413403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd04152730 con 0x7fcd04071f90 2023-11-04T01:36:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.562+0000 7fcd0ad39640 1 -- 172.21.15.114:0/3537413403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd040c7820 con 0x7fcd04071f90 2023-11-04T01:36:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.562+0000 7fcd017fa640 1 -- 172.21.15.114:0/3537413403 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fccf403e960 con 0x7fcd04071f90 2023-11-04T01:36:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.563+0000 7fcd017fa640 1 --2- 172.21.15.114:0/3537413403 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fccf006ae70 0x7fccf006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.563+0000 7fcd017fa640 1 -- 172.21.15.114:0/3537413403 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fccf40ac5b0 con 0x7fcd04071f90 2023-11-04T01:36:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.563+0000 7fcd03fff640 1 --2- 172.21.15.114:0/3537413403 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fccf006ae70 0x7fccf006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.563+0000 7fcd03fff640 1 --2- 172.21.15.114:0/3537413403 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fccf006ae70 0x7fccf006d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcd041f3b70 tx=0x7fccf8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.567+0000 7fcd017fa640 1 -- 172.21.15.114:0/3537413403 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fccf4077520 con 0x7fcd04071f90 2023-11-04T01:36:56.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.735+0000 7fcd0ad39640 1 -- 172.21.15.114:0/3537413403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcd040718d0 con 0x7fcd04071f90 2023-11-04T01:36:56.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.736+0000 7fcd017fa640 1 -- 172.21.15.114:0/3537413403 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fccf407ab40 con 0x7fcd04071f90 2023-11-04T01:36:56.738 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:36:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.738+0000 7fcd0ad39640 1 -- 172.21.15.114:0/3537413403 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fccf006ae70 msgr2=0x7fccf006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.738+0000 7fcd0ad39640 1 --2- 172.21.15.114:0/3537413403 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fccf006ae70 0x7fccf006d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcd041f3b70 tx=0x7fccf8008040 comp rx=0 tx=0).stop 2023-11-04T01:36:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.738+0000 7fcd0ad39640 1 -- 172.21.15.114:0/3537413403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd04071f90 msgr2=0x7fcd041529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.738+0000 7fcd0ad39640 1 --2- 172.21.15.114:0/3537413403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd04071f90 0x7fcd041529f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fccf4000f80 tx=0x7fccf4004a40 comp rx=0 tx=0).stop 2023-11-04T01:36:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.738+0000 7fcd0ad39640 1 -- 172.21.15.114:0/3537413403 shutdown_connections 2023-11-04T01:36:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.738+0000 7fcd0ad39640 1 --2- 172.21.15.114:0/3537413403 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fccf006ae70 0x7fccf006d330 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.738+0000 7fcd0ad39640 1 --2- 172.21.15.114:0/3537413403 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd0415add0 0x7fcd040c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.738+0000 7fcd0ad39640 1 --2- 172.21.15.114:0/3537413403 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd04072370 0x7fcd041521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.738+0000 7fcd0ad39640 1 --2- 172.21.15.114:0/3537413403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd04071f90 0x7fcd041529f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.738+0000 7fcd0ad39640 1 -- 172.21.15.114:0/3537413403 >> 172.21.15.114:0/3537413403 conn(0x7fcd0406d800 msgr2=0x7fcd040cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.738+0000 7fcd0ad39640 1 -- 172.21.15.114:0/3537413403 shutdown_connections 2023-11-04T01:36:56.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.738+0000 7fcd0ad39640 1 -- 172.21.15.114:0/3537413403 wait complete. 2023-11-04T01:36:56.751 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:56.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.847+0000 7f6e3396c640 1 Processor -- start 2023-11-04T01:36:56.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.847+0000 7f6e3396c640 1 -- start start 2023-11-04T01:36:56.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.848+0000 7f6e3396c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e2c0af060 0x7f6e2c0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.848+0000 7f6e3396c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e2c06ef40 0x7f6e2c0cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.848+0000 7f6e3396c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2c0b1590 con 0x7f6e2c0aec80 2023-11-04T01:36:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.848+0000 7f6e3396c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2c155a40 con 0x7f6e2c06ef40 2023-11-04T01:36:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.848+0000 7f6e3396c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c06a8e0 con 0x7f6e2c0af060 2023-11-04T01:36:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.848+0000 7f6e31708640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6e2c0aec80 0x7f6e2c06a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59068/0 (socket says 172.21.15.114:59068) 2023-11-04T01:36:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.848+0000 7f6e31708640 1 -- 172.21.15.114:0/2882748560 learned_addr learned my addr 172.21.15.114:0/2882748560 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.848+0000 7f6e31f09640 1 --2- 172.21.15.114:0/2882748560 >> v2:172.21.15.114:3300/0 conn(0x7f6e2c06ef40 0x7f6e2c0cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.848+0000 7f6e30f07640 1 --2- 172.21.15.114:0/2882748560 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e2c0af060 0x7f6e2c0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.848+0000 7f6e31f09640 1 -- 172.21.15.114:0/2882748560 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e2c0af060 msgr2=0x7f6e2c0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.848+0000 7f6e31f09640 1 --2- 172.21.15.114:0/2882748560 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e2c0af060 0x7f6e2c0b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.848+0000 7f6e31f09640 1 -- 172.21.15.114:0/2882748560 >> v1:172.21.15.114:6789/0 conn(0x7f6e2c0aec80 legacy=0x7f6e2c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.848+0000 7f6e31f09640 1 -- 172.21.15.114:0/2882748560 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c0b1800 con 0x7f6e2c06ef40 2023-11-04T01:36:56.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.849+0000 7f6e31f09640 1 --2- 172.21.15.114:0/2882748560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2c06ef40 0x7f6e2c0cb7a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6e28009d90 tx=0x7f6e2802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e108883a6a30c7ba server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.849+0000 7f6e23fff640 1 -- 172.21.15.114:0/2882748560 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2802cc50 con 0x7f6e2c06ef40 2023-11-04T01:36:56.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.849+0000 7f6e23fff640 1 -- 172.21.15.114:0/2882748560 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2802cdb0 con 0x7f6e2c06ef40 2023-11-04T01:36:56.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.849+0000 7f6e23fff640 1 -- 172.21.15.114:0/2882748560 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28034660 con 0x7f6e2c06ef40 2023-11-04T01:36:56.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.850+0000 7f6e3396c640 1 -- 172.21.15.114:0/2882748560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2c06ef40 msgr2=0x7f6e2c0cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.850+0000 7f6e3396c640 1 --2- 172.21.15.114:0/2882748560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2c06ef40 0x7f6e2c0cb7a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6e28009d90 tx=0x7f6e2802bea0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.850+0000 7f6e3396c640 1 -- 172.21.15.114:0/2882748560 shutdown_connections 2023-11-04T01:36:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.850+0000 7f6e3396c640 1 --2- 172.21.15.114:0/2882748560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2c06ef40 0x7f6e2c0cb7a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.850+0000 7f6e3396c640 1 --2- 172.21.15.114:0/2882748560 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e2c0af060 0x7f6e2c0b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.850+0000 7f6e3396c640 1 -- 172.21.15.114:0/2882748560 >> 172.21.15.114:0/2882748560 conn(0x7f6e2c098d40 msgr2=0x7f6e2c0cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.850+0000 7f6e3396c640 1 -- 172.21.15.114:0/2882748560 shutdown_connections 2023-11-04T01:36:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.850+0000 7f6e3396c640 1 -- 172.21.15.114:0/2882748560 wait complete. 2023-11-04T01:36:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.851+0000 7f6e3396c640 1 Processor -- start 2023-11-04T01:36:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.851+0000 7f6e3396c640 1 -- start start 2023-11-04T01:36:56.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.852+0000 7f6e3396c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e2c06ef40 0x7f6e2c1f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.852+0000 7f6e3396c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2c0aec80 0x7f6e2c0ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.852+0000 7f6e3396c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e2c0af060 0x7f6e2c159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.852+0000 7f6e3396c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0c83a0 con 0x7f6e2c0aec80 2023-11-04T01:36:56.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.852+0000 7f6e3396c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0c8530 con 0x7f6e2c06ef40 2023-11-04T01:36:56.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.852+0000 7f6e3396c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0cdb20 con 0x7f6e2c0af060 2023-11-04T01:36:56.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.852+0000 7f6e30f07640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2c0aec80 0x7f6e2c0ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.852+0000 7f6e30f07640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2c0aec80 0x7f6e2c0ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45080/0 (socket says 172.21.15.114:45080) 2023-11-04T01:36:56.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.852+0000 7f6e30f07640 1 -- 172.21.15.114:0/295142798 learned_addr learned my addr 172.21.15.114:0/295142798 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:56.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.852+0000 7f6e30f07640 1 -- 172.21.15.114:0/295142798 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e2c0af060 msgr2=0x7f6e2c159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.852+0000 7f6e31f09640 1 --2- 172.21.15.114:0/295142798 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e2c0af060 0x7f6e2c159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.852+0000 7f6e30f07640 1 --2- 172.21.15.114:0/295142798 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e2c0af060 0x7f6e2c159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.852+0000 7f6e30f07640 1 -- 172.21.15.114:0/295142798 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e2c06ef40 msgr2=0x7f6e2c1f2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.852+0000 7f6e30f07640 1 --2- 172.21.15.114:0/295142798 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e2c06ef40 0x7f6e2c1f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.852+0000 7f6e30f07640 1 -- 172.21.15.114:0/295142798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e28009a70 con 0x7f6e2c0aec80 2023-11-04T01:36:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.852+0000 7f6e30f07640 1 --2- 172.21.15.114:0/295142798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2c0aec80 0x7f6e2c0ced10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00e840 tx=0x7f6e1c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.853+0000 7f6e21ffb640 1 -- 172.21.15.114:0/295142798 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0095c0 con 0x7f6e2c0aec80 2023-11-04T01:36:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.853+0000 7f6e21ffb640 1 -- 172.21.15.114:0/295142798 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c00c940 con 0x7f6e2c0aec80 2023-11-04T01:36:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.853+0000 7f6e3396c640 1 -- 172.21.15.114:0/295142798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2c0cde00 con 0x7f6e2c0aec80 2023-11-04T01:36:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.853+0000 7f6e21ffb640 1 -- 172.21.15.114:0/295142798 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c00ccf0 con 0x7f6e2c0aec80 2023-11-04T01:36:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.853+0000 7f6e3396c640 1 -- 172.21.15.114:0/295142798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2c0ce3c0 con 0x7f6e2c0aec80 2023-11-04T01:36:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.854+0000 7f6e3396c640 1 -- 172.21.15.114:0/295142798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2c074290 con 0x7f6e2c0aec80 2023-11-04T01:36:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.854+0000 7f6e21ffb640 1 -- 172.21.15.114:0/295142798 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e1c013470 con 0x7f6e2c0aec80 2023-11-04T01:36:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.855+0000 7f6e21ffb640 1 --2- 172.21.15.114:0/295142798 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e1006aea0 0x7f6e1006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.855+0000 7f6e21ffb640 1 -- 172.21.15.114:0/295142798 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6e1c089e10 con 0x7f6e2c0aec80 2023-11-04T01:36:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.855+0000 7f6e31708640 1 --2- 172.21.15.114:0/295142798 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e1006aea0 0x7f6e1006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.855+0000 7f6e31708640 1 --2- 172.21.15.114:0/295142798 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e1006aea0 0x7f6e1006d360 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6e240015d0 tx=0x7f6e240078b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:56.859+0000 7f6e21ffb640 1 -- 172.21.15.114:0/295142798 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e1c054bd0 con 0x7f6e2c0aec80 2023-11-04T01:36:57.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.058+0000 7f6e3396c640 1 -- 172.21.15.114:0/295142798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e2c0c86a0 con 0x7f6e2c0aec80 2023-11-04T01:36:57.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.059+0000 7f6e21ffb640 1 -- 172.21.15.114:0/295142798 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f6e1c021090 con 0x7f6e2c0aec80 2023-11-04T01:36:57.062 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:57.062 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1590879236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1590879236},{"type":"v1","addr":"172.21.15.141:6834","nonce":1590879236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3079825621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3079825621},{"type":"v1","addr":"172.21.15.114:6835","nonce":3079825621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1526155664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1526155664},{"type":"v1","addr":"172.21.15.114:6837","nonce":1526155664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:36:29.888918+0000","modified":"2023-11-04T01:36:46.975998+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6835/4231924170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4231924170},{"type":"v1","addr":"172.21.15.141:6835","nonce":4231924170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:36:57.063 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2023-11-04T01:36:57.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.061+0000 7f6e3396c640 1 -- 172.21.15.114:0/295142798 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e1006aea0 msgr2=0x7f6e1006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.061+0000 7f6e3396c640 1 --2- 172.21.15.114:0/295142798 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e1006aea0 0x7f6e1006d360 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6e240015d0 tx=0x7f6e240078b0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.061+0000 7f6e3396c640 1 -- 172.21.15.114:0/295142798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2c0aec80 msgr2=0x7f6e2c0ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.061+0000 7f6e3396c640 1 --2- 172.21.15.114:0/295142798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2c0aec80 0x7f6e2c0ced10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00e840 tx=0x7f6e1c00ed00 comp rx=0 tx=0).stop 2023-11-04T01:36:57.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.061+0000 7f6e3396c640 1 -- 172.21.15.114:0/295142798 shutdown_connections 2023-11-04T01:36:57.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.061+0000 7f6e3396c640 1 --2- 172.21.15.114:0/295142798 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e2c0af060 0x7f6e2c159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.061+0000 7f6e3396c640 1 --2- 172.21.15.114:0/295142798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2c0aec80 0x7f6e2c0ced10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.061+0000 7f6e3396c640 1 --2- 172.21.15.114:0/295142798 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e1006aea0 0x7f6e1006d360 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.061+0000 7f6e3396c640 1 --2- 172.21.15.114:0/295142798 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e2c06ef40 0x7f6e2c1f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.061+0000 7f6e3396c640 1 -- 172.21.15.114:0/295142798 >> 172.21.15.114:0/295142798 conn(0x7f6e2c098d40 msgr2=0x7f6e2c154e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.061+0000 7f6e3396c640 1 -- 172.21.15.114:0/295142798 shutdown_connections 2023-11-04T01:36:57.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.061+0000 7f6e3396c640 1 -- 172.21.15.114:0/295142798 wait complete. 2023-11-04T01:36:57.074 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:57.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.170+0000 7f8632bfb640 1 Processor -- start 2023-11-04T01:36:57.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.170+0000 7f8632bfb640 1 -- start start 2023-11-04T01:36:57.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.171+0000 7f8632bfb640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f862c15ce70 0x7f862c06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.171+0000 7f8632bfb640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f862c0cb5c0 0x7f862c0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.171+0000 7f8632bfb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f862c06a120 con 0x7f862c15d250 2023-11-04T01:36:57.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.171+0000 7f8632bfb640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f862c0cdc10 con 0x7f862c15ce70 2023-11-04T01:36:57.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.171+0000 7f8632bfb640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862c06def0 con 0x7f862c0cb5c0 2023-11-04T01:36:57.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.171+0000 7f862bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f862c15d250 0x7f862c0c9830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59078/0 (socket says 172.21.15.114:59078) 2023-11-04T01:36:57.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.171+0000 7f862bfff640 1 -- 172.21.15.114:0/2706780241 learned_addr learned my addr 172.21.15.114:0/2706780241 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:57.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.171+0000 7f8631198640 1 --2- 172.21.15.114:0/2706780241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f862c0cb5c0 0x7f862c0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.171+0000 7f8630997640 1 --2- 172.21.15.114:0/2706780241 >> v2:172.21.15.141:3300/0 conn(0x7f862c15ce70 0x7f862c06d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862b7fe640 1 -- 172.21.15.114:0/2706780241 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660603094 0 0) 0x7f862c06a120 con 0x7f862c15d250 2023-11-04T01:36:57.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862b7fe640 1 -- 172.21.15.114:0/2706780241 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8618003520 con 0x7f862c15d250 2023-11-04T01:36:57.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862b7fe640 1 -- 172.21.15.114:0/2706780241 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3176393199 0 0) 0x7f8618003520 con 0x7f862c15d250 2023-11-04T01:36:57.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862b7fe640 1 -- 172.21.15.114:0/2706780241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f862c0cb5c0 msgr2=0x7f862c0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:57.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862b7fe640 1 --2- 172.21.15.114:0/2706780241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f862c0cb5c0 0x7f862c0ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862b7fe640 1 -- 172.21.15.114:0/2706780241 >> v2:172.21.15.141:3300/0 conn(0x7f862c15ce70 msgr2=0x7f862c06d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:57.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862b7fe640 1 --2- 172.21.15.114:0/2706780241 >> v2:172.21.15.141:3300/0 conn(0x7f862c15ce70 0x7f862c06d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862b7fe640 1 -- 172.21.15.114:0/2706780241 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c0c9f40 con 0x7f862c15d250 2023-11-04T01:36:57.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862b7fe640 1 -- 172.21.15.114:0/2706780241 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f8614001670 con 0x7f862c15d250 2023-11-04T01:36:57.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862b7fe640 1 -- 172.21.15.114:0/2706780241 >> v1:172.21.15.114:6789/0 conn(0x7f862c15d250 legacy=0x7f862c0c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862b7fe640 1 --2- 172.21.15.114:0/2706780241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8618003970 0x7f8618003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862b7fe640 1 --2- 172.21.15.114:0/2706780241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f862c0cb5c0 0x7f86180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862b7fe640 1 --2- 172.21.15.114:0/2706780241 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8618004d00 0x7f8618005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862b7fe640 1 -- 172.21.15.114:0/2706780241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c0cdc10 con 0x7f8618003970 2023-11-04T01:36:57.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862b7fe640 1 -- 172.21.15.114:0/2706780241 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c06def0 con 0x7f8618004d00 2023-11-04T01:36:57.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862b7fe640 1 -- 172.21.15.114:0/2706780241 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861800b980 con 0x7f862c0cb5c0 2023-11-04T01:36:57.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f8630997640 1 --2- 172.21.15.114:0/2706780241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8618003970 0x7f8618003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f862bfff640 1 --2- 172.21.15.114:0/2706780241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f862c0cb5c0 0x7f86180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f8631198640 1 --2- 172.21.15.114:0/2706780241 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8618004d00 0x7f8618005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f8630997640 1 -- 172.21.15.114:0/2706780241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f862c0cb5c0 msgr2=0x7f86180047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:57.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f8630997640 1 --2- 172.21.15.114:0/2706780241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f862c0cb5c0 0x7f86180047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f8630997640 1 -- 172.21.15.114:0/2706780241 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8618004d00 msgr2=0x7f8618005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:57.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f8630997640 1 --2- 172.21.15.114:0/2706780241 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8618004d00 0x7f8618005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.172+0000 7f8630997640 1 -- 172.21.15.114:0/2706780241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8618003520 con 0x7f8618003970 2023-11-04T01:36:57.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.173+0000 7f8630997640 1 --2- 172.21.15.114:0/2706780241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8618003970 0x7f8618003db0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8624009fc0 tx=0x7f86180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7aff88c2510462 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.173+0000 7f862b7fe640 1 -- 172.21.15.114:0/2706780241 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862402cc60 con 0x7f8618003970 2023-11-04T01:36:57.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.173+0000 7f862b7fe640 1 -- 172.21.15.114:0/2706780241 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862400f040 con 0x7f8618003970 2023-11-04T01:36:57.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.173+0000 7f862b7fe640 1 -- 172.21.15.114:0/2706780241 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8624034440 con 0x7f8618003970 2023-11-04T01:36:57.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.174+0000 7f8632bfb640 1 -- 172.21.15.114:0/2706780241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8618003970 msgr2=0x7f8618003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.174+0000 7f8632bfb640 1 --2- 172.21.15.114:0/2706780241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8618003970 0x7f8618003db0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8624009fc0 tx=0x7f86180057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.174+0000 7f8631198640 1 -- 172.21.15.114:0/2706780241 reap_dead start 2023-11-04T01:36:57.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.174+0000 7f8632bfb640 1 -- 172.21.15.114:0/2706780241 shutdown_connections 2023-11-04T01:36:57.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.174+0000 7f8632bfb640 1 -- 172.21.15.114:0/2706780241 >> 172.21.15.114:0/2706780241 conn(0x7f862c0b0cd0 msgr2=0x7f862c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.174+0000 7f8632bfb640 1 -- 172.21.15.114:0/2706780241 shutdown_connections 2023-11-04T01:36:57.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.174+0000 7f8632bfb640 1 -- 172.21.15.114:0/2706780241 wait complete. 2023-11-04T01:36:57.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.175+0000 7f8632bfb640 1 Processor -- start 2023-11-04T01:36:57.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.175+0000 7f8632bfb640 1 -- start start 2023-11-04T01:36:57.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f8632bfb640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8618003970 0x7f862c152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f8632bfb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f862c0c6cc0 0x7f862c1e6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f8632bfb640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f862c1e7210 0x7f862c1f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f8632bfb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c1e7690 con 0x7f862c0c6cc0 2023-11-04T01:36:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f8632bfb640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c159b80 con 0x7f8618003970 2023-11-04T01:36:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f8632bfb640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862c152e80 con 0x7f862c1e7210 2023-11-04T01:36:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f862bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f862c0c6cc0 0x7f862c1e6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f862bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f862c0c6cc0 0x7f862c1e6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45094/0 (socket says 172.21.15.114:45094) 2023-11-04T01:36:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f862bfff640 1 -- 172.21.15.114:0/3817957192 learned_addr learned my addr 172.21.15.114:0/3817957192 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f8630997640 1 --2- 172.21.15.114:0/3817957192 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8618003970 0x7f862c152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f8631198640 1 --2- 172.21.15.114:0/3817957192 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f862c1e7210 0x7f862c1f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f862bfff640 1 -- 172.21.15.114:0/3817957192 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f862c1e7210 msgr2=0x7f862c1f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f862bfff640 1 --2- 172.21.15.114:0/3817957192 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f862c1e7210 0x7f862c1f60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f862bfff640 1 -- 172.21.15.114:0/3817957192 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8618003970 msgr2=0x7f862c152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f862bfff640 1 --2- 172.21.15.114:0/3817957192 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8618003970 0x7f862c152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f862bfff640 1 -- 172.21.15.114:0/3817957192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c159dd0 con 0x7f862c0c6cc0 2023-11-04T01:36:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f8630997640 1 --2- 172.21.15.114:0/3817957192 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8618003970 0x7f862c152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f862bfff640 1 --2- 172.21.15.114:0/3817957192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f862c0c6cc0 0x7f862c1e6cd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8614001aa0 tx=0x7f86140077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f86297fa640 1 -- 172.21.15.114:0/3817957192 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8614007e60 con 0x7f862c0c6cc0 2023-11-04T01:36:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f86297fa640 1 -- 172.21.15.114:0/3817957192 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861400f9c0 con 0x7f862c0c6cc0 2023-11-04T01:36:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f86297fa640 1 -- 172.21.15.114:0/3817957192 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861400fd70 con 0x7f862c0c6cc0 2023-11-04T01:36:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f8632bfb640 1 -- 172.21.15.114:0/3817957192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862c15a0b0 con 0x7f862c0c6cc0 2023-11-04T01:36:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.176+0000 7f8632bfb640 1 -- 172.21.15.114:0/3817957192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862c15a670 con 0x7f862c0c6cc0 2023-11-04T01:36:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.177+0000 7f8632bfb640 1 -- 172.21.15.114:0/3817957192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862c074290 con 0x7f862c0c6cc0 2023-11-04T01:36:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.178+0000 7f86297fa640 1 -- 172.21.15.114:0/3817957192 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f861401d460 con 0x7f862c0c6cc0 2023-11-04T01:36:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.178+0000 7f86297fa640 1 --2- 172.21.15.114:0/3817957192 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f860c06ae70 0x7f860c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.178+0000 7f86297fa640 1 -- 172.21.15.114:0/3817957192 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86140899f0 con 0x7f862c0c6cc0 2023-11-04T01:36:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.178+0000 7f8630997640 1 --2- 172.21.15.114:0/3817957192 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f860c06ae70 0x7f860c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.179+0000 7f8630997640 1 --2- 172.21.15.114:0/3817957192 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f860c06ae70 0x7f860c06d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8624036000 tx=0x7f862402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.182+0000 7f86297fa640 1 -- 172.21.15.114:0/3817957192 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8614054840 con 0x7f862c0c6cc0 2023-11-04T01:36:57.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.349+0000 7f8632bfb640 1 -- 172.21.15.114:0/3817957192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f862c06ac00 con 0x7f862c0c6cc0 2023-11-04T01:36:57.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.350+0000 7f86297fa640 1 -- 172.21.15.114:0/3817957192 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18406 (secure 0 0 0) 0x7f8614057e60 con 0x7f862c0c6cc0 2023-11-04T01:36:57.352 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:57.353 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:34.950923+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:57.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.352+0000 7f8632bfb640 1 -- 172.21.15.114:0/3817957192 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f860c06ae70 msgr2=0x7f860c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.352+0000 7f8632bfb640 1 --2- 172.21.15.114:0/3817957192 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f860c06ae70 0x7f860c06d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8624036000 tx=0x7f862402e000 comp rx=0 tx=0).stop 2023-11-04T01:36:57.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.352+0000 7f8632bfb640 1 -- 172.21.15.114:0/3817957192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f862c0c6cc0 msgr2=0x7f862c1e6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.352+0000 7f8632bfb640 1 --2- 172.21.15.114:0/3817957192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f862c0c6cc0 0x7f862c1e6cd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8614001aa0 tx=0x7f86140077a0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.352+0000 7f8632bfb640 1 -- 172.21.15.114:0/3817957192 shutdown_connections 2023-11-04T01:36:57.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.352+0000 7f8632bfb640 1 --2- 172.21.15.114:0/3817957192 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f862c1e7210 0x7f862c1f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.352+0000 7f8632bfb640 1 --2- 172.21.15.114:0/3817957192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f862c0c6cc0 0x7f862c1e6cd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.352+0000 7f8632bfb640 1 --2- 172.21.15.114:0/3817957192 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f860c06ae70 0x7f860c06d330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.352+0000 7f8632bfb640 1 --2- 172.21.15.114:0/3817957192 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8618003970 0x7f862c152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.352+0000 7f8632bfb640 1 -- 172.21.15.114:0/3817957192 >> 172.21.15.114:0/3817957192 conn(0x7f862c0b0cd0 msgr2=0x7f862c0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.352+0000 7f8632bfb640 1 -- 172.21.15.114:0/3817957192 shutdown_connections 2023-11-04T01:36:57.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.352+0000 7f8632bfb640 1 -- 172.21.15.114:0/3817957192 wait complete. 2023-11-04T01:36:57.365 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:36:57.366 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:36:57.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.466+0000 7f4cb8fc0640 1 Processor -- start 2023-11-04T01:36:57.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.466+0000 7f4cb8fc0640 1 -- start start 2023-11-04T01:36:57.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.467+0000 7f4cb8fc0640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4cb4159c00 0x7f4cb40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.467+0000 7f4cb8fc0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb415aff0 con 0x7f4cb40ae1d0 2023-11-04T01:36:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.467+0000 7f4cb8fc0640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb415a3e0 con 0x7f4cb40c48e0 2023-11-04T01:36:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.467+0000 7f4cb8fc0640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb415a6c0 con 0x7f4cb4159c00 2023-11-04T01:36:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.467+0000 7f4cb2d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4cb40ae1d0 0x7f4cb40709f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59080/0 (socket says 172.21.15.114:59080) 2023-11-04T01:36:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.467+0000 7f4cb2d9d640 1 -- 172.21.15.114:0/592856093 learned_addr learned my addr 172.21.15.114:0/592856093 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.467+0000 7f4cb259c640 1 --2- 172.21.15.114:0/592856093 >> v2:172.21.15.141:3300/0 conn(0x7f4cb4159c00 0x7f4cb40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.467+0000 7f4cb159a640 1 -- 172.21.15.114:0/592856093 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754631432 0 0) 0x7f4cb415aff0 con 0x7f4cb40ae1d0 2023-11-04T01:36:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.467+0000 7f4cb159a640 1 -- 172.21.15.114:0/592856093 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c9c003520 con 0x7f4cb40ae1d0 2023-11-04T01:36:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.468+0000 7f4cb259c640 1 -- 172.21.15.114:0/592856093 >> v1:172.21.15.141:6789/0 conn(0x7f4cb40c48e0 legacy=0x7f4cb40adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.468+0000 7f4cb159a640 1 -- 172.21.15.114:0/592856093 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1528321642 0 0) 0x7f4c9c003520 con 0x7f4cb40ae1d0 2023-11-04T01:36:57.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.468+0000 7f4cb259c640 1 -- 172.21.15.114:0/592856093 >> v1:172.21.15.114:6789/0 conn(0x7f4cb40ae1d0 legacy=0x7f4cb40709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.468+0000 7f4cb259c640 1 -- 172.21.15.114:0/592856093 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb415a9a0 con 0x7f4cb4159c00 2023-11-04T01:36:57.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.468+0000 7f4cb259c640 1 --2- 172.21.15.114:0/592856093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4cb4159c00 0x7f4cb40cc890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009d90 tx=0x7f4ca402bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96c150b1802e8dfd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.469+0000 7f4cb159a640 1 -- 172.21.15.114:0/592856093 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac001670 con 0x7f4cb4159c00 2023-11-04T01:36:57.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.469+0000 7f4cb159a640 1 -- 172.21.15.114:0/592856093 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca402c8b0 con 0x7f4cb4159c00 2023-11-04T01:36:57.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.469+0000 7f4cb159a640 1 -- 172.21.15.114:0/592856093 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca402cc20 con 0x7f4cb4159c00 2023-11-04T01:36:57.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.469+0000 7f4cb8fc0640 1 -- 172.21.15.114:0/592856093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4cb4159c00 msgr2=0x7f4cb40cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.469+0000 7f4cb8fc0640 1 --2- 172.21.15.114:0/592856093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4cb4159c00 0x7f4cb40cc890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009d90 tx=0x7f4ca402bd80 comp rx=0 tx=0).stop 2023-11-04T01:36:57.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.469+0000 7f4cb8fc0640 1 -- 172.21.15.114:0/592856093 shutdown_connections 2023-11-04T01:36:57.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.469+0000 7f4cb8fc0640 1 --2- 172.21.15.114:0/592856093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4cb4159c00 0x7f4cb40cc890 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.469+0000 7f4cb8fc0640 1 -- 172.21.15.114:0/592856093 >> 172.21.15.114:0/592856093 conn(0x7f4cb40ce950 msgr2=0x7f4cb40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.469+0000 7f4cb8fc0640 1 -- 172.21.15.114:0/592856093 shutdown_connections 2023-11-04T01:36:57.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.469+0000 7f4cb8fc0640 1 -- 172.21.15.114:0/592856093 wait complete. 2023-11-04T01:36:57.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.471+0000 7f4cb8fc0640 1 Processor -- start 2023-11-04T01:36:57.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.471+0000 7f4cb8fc0640 1 -- start start 2023-11-04T01:36:57.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.471+0000 7f4cb8fc0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4cb40ae1d0 0x7f4cb40c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.471+0000 7f4cb8fc0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cb40c48e0 0x7f4cb40c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.471+0000 7f4cb8fc0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4cb4159c00 0x7f4cb413ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.471+0000 7f4cb8fc0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb4151c50 con 0x7f4cb40c48e0 2023-11-04T01:36:57.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.471+0000 7f4cb8fc0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb4156b50 con 0x7f4cb4159c00 2023-11-04T01:36:57.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.471+0000 7f4cb8fc0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb4157f90 con 0x7f4cb40ae1d0 2023-11-04T01:36:57.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.471+0000 7f4cb1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cb40c48e0 0x7f4cb40c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.471+0000 7f4cb1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cb40c48e0 0x7f4cb40c77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45096/0 (socket says 172.21.15.114:45096) 2023-11-04T01:36:57.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.471+0000 7f4cb1d9b640 1 -- 172.21.15.114:0/4133064198 learned_addr learned my addr 172.21.15.114:0/4133064198 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:57.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.472+0000 7f4cb259c640 1 --2- 172.21.15.114:0/4133064198 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4cb40ae1d0 0x7f4cb40c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.472+0000 7f4cb2d9d640 1 --2- 172.21.15.114:0/4133064198 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4cb4159c00 0x7f4cb413ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.472+0000 7f4cb1d9b640 1 -- 172.21.15.114:0/4133064198 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4cb40ae1d0 msgr2=0x7f4cb40c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.472+0000 7f4cb1d9b640 1 --2- 172.21.15.114:0/4133064198 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4cb40ae1d0 0x7f4cb40c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.472+0000 7f4cb1d9b640 1 -- 172.21.15.114:0/4133064198 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4cb4159c00 msgr2=0x7f4cb413ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.472+0000 7f4cb1d9b640 1 --2- 172.21.15.114:0/4133064198 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4cb4159c00 0x7f4cb413ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.472+0000 7f4cb1d9b640 1 -- 172.21.15.114:0/4133064198 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca4009a70 con 0x7f4cb40c48e0 2023-11-04T01:36:57.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.472+0000 7f4cb1d9b640 1 --2- 172.21.15.114:0/4133064198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cb40c48e0 0x7f4cb40c77f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800c450 tx=0x7f4ca800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.472+0000 7f4ca2ffd640 1 -- 172.21.15.114:0/4133064198 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80052d0 con 0x7f4cb40c48e0 2023-11-04T01:36:57.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.472+0000 7f4ca2ffd640 1 -- 172.21.15.114:0/4133064198 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca8005430 con 0x7f4cb40c48e0 2023-11-04T01:36:57.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.472+0000 7f4ca2ffd640 1 -- 172.21.15.114:0/4133064198 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8012870 con 0x7f4cb40c48e0 2023-11-04T01:36:57.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.472+0000 7f4cb8fc0640 1 -- 172.21.15.114:0/4133064198 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb4158230 con 0x7f4cb40c48e0 2023-11-04T01:36:57.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.472+0000 7f4cb8fc0640 1 -- 172.21.15.114:0/4133064198 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb41587f0 con 0x7f4cb40c48e0 2023-11-04T01:36:57.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.473+0000 7f4cb8fc0640 1 -- 172.21.15.114:0/4133064198 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb4074290 con 0x7f4cb40c48e0 2023-11-04T01:36:57.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.474+0000 7f4ca2ffd640 1 -- 172.21.15.114:0/4133064198 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ca80129d0 con 0x7f4cb40c48e0 2023-11-04T01:36:57.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.474+0000 7f4ca2ffd640 1 --2- 172.21.15.114:0/4133064198 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4c9406ae70 0x7f4c9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.474+0000 7f4cb259c640 1 --2- 172.21.15.114:0/4133064198 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4c9406ae70 0x7f4c9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.474+0000 7f4ca2ffd640 1 -- 172.21.15.114:0/4133064198 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ca80892f0 con 0x7f4cb40c48e0 2023-11-04T01:36:57.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.474+0000 7f4cb259c640 1 --2- 172.21.15.114:0/4133064198 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4c9406ae70 0x7f4c9406d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4036000 tx=0x7f4ca4030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.478+0000 7f4ca2ffd640 1 -- 172.21.15.114:0/4133064198 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ca8054160 con 0x7f4cb40c48e0 2023-11-04T01:36:57.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.643+0000 7f4cb8fc0640 1 -- 172.21.15.114:0/4133064198 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4cb406c7b0 con 0x7f4cb40c48e0 2023-11-04T01:36:57.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.643+0000 7f4ca2ffd640 1 -- 172.21.15.114:0/4133064198 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ca8057780 con 0x7f4cb40c48e0 2023-11-04T01:36:57.645 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:36:57.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.645+0000 7f4cb8fc0640 1 -- 172.21.15.114:0/4133064198 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4c9406ae70 msgr2=0x7f4c9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.645+0000 7f4cb8fc0640 1 --2- 172.21.15.114:0/4133064198 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4c9406ae70 0x7f4c9406d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4036000 tx=0x7f4ca4030000 comp rx=0 tx=0).stop 2023-11-04T01:36:57.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.645+0000 7f4cb8fc0640 1 -- 172.21.15.114:0/4133064198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cb40c48e0 msgr2=0x7f4cb40c77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.645+0000 7f4cb8fc0640 1 --2- 172.21.15.114:0/4133064198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cb40c48e0 0x7f4cb40c77f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800c450 tx=0x7f4ca800c910 comp rx=0 tx=0).stop 2023-11-04T01:36:57.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.645+0000 7f4cb8fc0640 1 -- 172.21.15.114:0/4133064198 shutdown_connections 2023-11-04T01:36:57.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.645+0000 7f4cb8fc0640 1 --2- 172.21.15.114:0/4133064198 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4c9406ae70 0x7f4c9406d330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.645+0000 7f4cb8fc0640 1 --2- 172.21.15.114:0/4133064198 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4cb4159c00 0x7f4cb413ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.645+0000 7f4cb8fc0640 1 --2- 172.21.15.114:0/4133064198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cb40c48e0 0x7f4cb40c77f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.645+0000 7f4cb8fc0640 1 --2- 172.21.15.114:0/4133064198 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4cb40ae1d0 0x7f4cb40c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.645+0000 7f4cb8fc0640 1 -- 172.21.15.114:0/4133064198 >> 172.21.15.114:0/4133064198 conn(0x7f4cb40ce950 msgr2=0x7f4cb406ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.645+0000 7f4cb8fc0640 1 -- 172.21.15.114:0/4133064198 shutdown_connections 2023-11-04T01:36:57.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.645+0000 7f4cb8fc0640 1 -- 172.21.15.114:0/4133064198 wait complete. 2023-11-04T01:36:57.657 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:36:57.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.758+0000 7f02f45e2640 1 Processor -- start 2023-11-04T01:36:57.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.758+0000 7f02f45e2640 1 -- start start 2023-11-04T01:36:57.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.759+0000 7f02f45e2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f02ec1605b0 0x7f02ec0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.759+0000 7f02f45e2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02ec06a830 0x7f02ec0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.759+0000 7f02f45e2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02ec160990 con 0x7f02ec0b1a40 2023-11-04T01:36:57.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.759+0000 7f02f45e2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02ec0cc7c0 con 0x7f02ec1605b0 2023-11-04T01:36:57.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.759+0000 7f02f45e2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec0cd750 con 0x7f02ec06a830 2023-11-04T01:36:57.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.759+0000 7f02f237e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f02ec1605b0 0x7f02ec0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.759+0000 7f02f237e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f02ec1605b0 0x7f02ec0ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45110/0 (socket says 172.21.15.114:45110) 2023-11-04T01:36:57.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.759+0000 7f02f237e640 1 -- 172.21.15.114:0/1010354503 learned_addr learned my addr 172.21.15.114:0/1010354503 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:57.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.759+0000 7f02f2b7f640 1 --2- 172.21.15.114:0/1010354503 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02ec06a830 0x7f02ec0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.759+0000 7f02f237e640 1 -- 172.21.15.114:0/1010354503 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02ec06a830 msgr2=0x7f02ec0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:57.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.759+0000 7f02f237e640 1 --2- 172.21.15.114:0/1010354503 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02ec06a830 0x7f02ec0cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.759+0000 7f02f237e640 1 -- 172.21.15.114:0/1010354503 >> v1:172.21.15.114:6789/0 conn(0x7f02ec0b1a40 legacy=0x7f02ec06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.759+0000 7f02f237e640 1 -- 172.21.15.114:0/1010354503 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ec0cc4e0 con 0x7f02ec1605b0 2023-11-04T01:36:57.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.760+0000 7f02f237e640 1 --2- 172.21.15.114:0/1010354503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02ec1605b0 0x7f02ec0ccbc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009870 tx=0x7f02e802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c09072c394836c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.760+0000 7f02f137c640 1 -- 172.21.15.114:0/1010354503 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e80317c0 con 0x7f02ec1605b0 2023-11-04T01:36:57.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.760+0000 7f02f137c640 1 -- 172.21.15.114:0/1010354503 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e8031920 con 0x7f02ec1605b0 2023-11-04T01:36:57.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.760+0000 7f02f137c640 1 -- 172.21.15.114:0/1010354503 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8031cb0 con 0x7f02ec1605b0 2023-11-04T01:36:57.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.760+0000 7f02f45e2640 1 -- 172.21.15.114:0/1010354503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02ec1605b0 msgr2=0x7f02ec0ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.760+0000 7f02f45e2640 1 --2- 172.21.15.114:0/1010354503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02ec1605b0 0x7f02ec0ccbc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009870 tx=0x7f02e802b860 comp rx=0 tx=0).stop 2023-11-04T01:36:57.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.761+0000 7f02f45e2640 1 -- 172.21.15.114:0/1010354503 shutdown_connections 2023-11-04T01:36:57.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.761+0000 7f02f45e2640 1 --2- 172.21.15.114:0/1010354503 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02ec06a830 0x7f02ec0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.761+0000 7f02f45e2640 1 --2- 172.21.15.114:0/1010354503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02ec1605b0 0x7f02ec0ccbc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.761+0000 7f02f45e2640 1 -- 172.21.15.114:0/1010354503 >> 172.21.15.114:0/1010354503 conn(0x7f02ec071820 msgr2=0x7f02ec071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.761+0000 7f02f45e2640 1 -- 172.21.15.114:0/1010354503 shutdown_connections 2023-11-04T01:36:57.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.761+0000 7f02f45e2640 1 -- 172.21.15.114:0/1010354503 wait complete. 2023-11-04T01:36:57.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.762+0000 7f02f45e2640 1 Processor -- start 2023-11-04T01:36:57.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.762+0000 7f02f45e2640 1 -- start start 2023-11-04T01:36:57.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.762+0000 7f02f45e2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02ec06a830 0x7f02ec15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.762+0000 7f02f45e2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02ec1605b0 0x7f02ec0c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.762+0000 7f02f45e2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02ec0acbd0 0x7f02ec15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.762+0000 7f02f45e2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec0ab8e0 con 0x7f02ec1605b0 2023-11-04T01:36:57.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.762+0000 7f02f45e2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec0abb30 con 0x7f02ec0acbd0 2023-11-04T01:36:57.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.762+0000 7f02f45e2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec0abe10 con 0x7f02ec06a830 2023-11-04T01:36:57.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02f1b7d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02ec1605b0 0x7f02ec0c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02f1b7d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02ec1605b0 0x7f02ec0c96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45120/0 (socket says 172.21.15.114:45120) 2023-11-04T01:36:57.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02f1b7d640 1 -- 172.21.15.114:0/2524556544 learned_addr learned my addr 172.21.15.114:0/2524556544 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:57.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02f237e640 1 --2- 172.21.15.114:0/2524556544 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02ec06a830 0x7f02ec15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02f2b7f640 1 --2- 172.21.15.114:0/2524556544 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02ec0acbd0 0x7f02ec15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02f1b7d640 1 -- 172.21.15.114:0/2524556544 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02ec06a830 msgr2=0x7f02ec15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02f1b7d640 1 --2- 172.21.15.114:0/2524556544 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02ec06a830 0x7f02ec15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02f1b7d640 1 -- 172.21.15.114:0/2524556544 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02ec0acbd0 msgr2=0x7f02ec15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02f1b7d640 1 --2- 172.21.15.114:0/2524556544 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02ec0acbd0 0x7f02ec15b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02f1b7d640 1 -- 172.21.15.114:0/2524556544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e80094d0 con 0x7f02ec1605b0 2023-11-04T01:36:57.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02f2b7f640 1 --2- 172.21.15.114:0/2524556544 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02ec0acbd0 0x7f02ec15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:57.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02f1b7d640 1 --2- 172.21.15.114:0/2524556544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02ec1605b0 0x7f02ec0c96d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00c400 tx=0x7f02dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02e2ffd640 1 -- 172.21.15.114:0/2524556544 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc0052d0 con 0x7f02ec1605b0 2023-11-04T01:36:57.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02e2ffd640 1 -- 172.21.15.114:0/2524556544 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02dc005430 con 0x7f02ec1605b0 2023-11-04T01:36:57.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02e2ffd640 1 -- 172.21.15.114:0/2524556544 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc003830 con 0x7f02ec1605b0 2023-11-04T01:36:57.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02f45e2640 1 -- 172.21.15.114:0/2524556544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ec0ac0f0 con 0x7f02ec1605b0 2023-11-04T01:36:57.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.763+0000 7f02f45e2640 1 -- 172.21.15.114:0/2524556544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ec0ac6b0 con 0x7f02ec1605b0 2023-11-04T01:36:57.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.764+0000 7f02f45e2640 1 -- 172.21.15.114:0/2524556544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02ec0672a0 con 0x7f02ec1605b0 2023-11-04T01:36:57.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.765+0000 7f02e2ffd640 1 -- 172.21.15.114:0/2524556544 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f02dc003990 con 0x7f02ec1605b0 2023-11-04T01:36:57.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.765+0000 7f02e2ffd640 1 --2- 172.21.15.114:0/2524556544 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f02d006ae70 0x7f02d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:57.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.765+0000 7f02e2ffd640 1 -- 172.21.15.114:0/2524556544 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f02dc088dd0 con 0x7f02ec1605b0 2023-11-04T01:36:57.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.765+0000 7f02f237e640 1 --2- 172.21.15.114:0/2524556544 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f02d006ae70 0x7f02d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:57.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.765+0000 7f02f237e640 1 --2- 172.21.15.114:0/2524556544 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f02d006ae70 0x7f02d006d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f02e8036000 tx=0x7f02e803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:57.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.769+0000 7f02e2ffd640 1 -- 172.21.15.114:0/2524556544 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02dc053c40 con 0x7f02ec1605b0 2023-11-04T01:36:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.936+0000 7f02f45e2640 1 -- 172.21.15.114:0/2524556544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02ec074290 con 0x7f02ec1605b0 2023-11-04T01:36:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.936+0000 7f02e2ffd640 1 -- 172.21.15.114:0/2524556544 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f02dc017020 con 0x7f02ec1605b0 2023-11-04T01:36:57.938 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:36:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.938+0000 7f02f45e2640 1 -- 172.21.15.114:0/2524556544 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f02d006ae70 msgr2=0x7f02d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.938+0000 7f02f45e2640 1 --2- 172.21.15.114:0/2524556544 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f02d006ae70 0x7f02d006d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f02e8036000 tx=0x7f02e803d040 comp rx=0 tx=0).stop 2023-11-04T01:36:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.938+0000 7f02f45e2640 1 -- 172.21.15.114:0/2524556544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02ec1605b0 msgr2=0x7f02ec0c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.938+0000 7f02f45e2640 1 --2- 172.21.15.114:0/2524556544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02ec1605b0 0x7f02ec0c96d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00c400 tx=0x7f02dc00c8c0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.938+0000 7f02f45e2640 1 -- 172.21.15.114:0/2524556544 shutdown_connections 2023-11-04T01:36:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.938+0000 7f02f45e2640 1 --2- 172.21.15.114:0/2524556544 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f02d006ae70 0x7f02d006d330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.938+0000 7f02f45e2640 1 --2- 172.21.15.114:0/2524556544 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02ec0acbd0 0x7f02ec15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.938+0000 7f02f45e2640 1 --2- 172.21.15.114:0/2524556544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02ec1605b0 0x7f02ec0c96d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.938+0000 7f02f45e2640 1 --2- 172.21.15.114:0/2524556544 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02ec06a830 0x7f02ec15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:57.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.938+0000 7f02f45e2640 1 -- 172.21.15.114:0/2524556544 >> 172.21.15.114:0/2524556544 conn(0x7f02ec071820 msgr2=0x7f02ec0cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:57.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.938+0000 7f02f45e2640 1 -- 172.21.15.114:0/2524556544 shutdown_connections 2023-11-04T01:36:57.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:57.938+0000 7f02f45e2640 1 -- 172.21.15.114:0/2524556544 wait complete. 2023-11-04T01:36:57.951 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:36:58.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.051+0000 7f700f561640 1 Processor -- start 2023-11-04T01:36:58.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.052+0000 7f700f561640 1 -- start start 2023-11-04T01:36:58.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.052+0000 7f700f561640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f700815af20 0x7f70080b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.052+0000 7f700f561640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f70080b64c0 0x7f70080cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.052+0000 7f700f561640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70080cd3b0 0x7f70080cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.052+0000 7f700f561640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70080cdd80 con 0x7f70080cd3b0 2023-11-04T01:36:58.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.052+0000 7f700f561640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70080d01f0 con 0x7f70080b64c0 2023-11-04T01:36:58.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.052+0000 7f700f561640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70080b6a40 con 0x7f700815af20 2023-11-04T01:36:58.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.052+0000 7f700dafe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70080cd3b0 0x7f70080cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.053+0000 7f700dafe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70080cd3b0 0x7f70080cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45132/0 (socket says 172.21.15.114:45132) 2023-11-04T01:36:58.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.053+0000 7f700dafe640 1 -- 172.21.15.114:0/1981356583 learned_addr learned my addr 172.21.15.114:0/1981356583 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:58.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.053+0000 7f700d2fd640 1 --2- 172.21.15.114:0/1981356583 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f700815af20 0x7f70080b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.053+0000 7f700cafc640 1 --2- 172.21.15.114:0/1981356583 >> v2:172.21.15.141:3300/0 conn(0x7f70080b64c0 0x7f70080cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.053+0000 7f700dafe640 1 -- 172.21.15.114:0/1981356583 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f700815af20 msgr2=0x7f70080b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:58.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.053+0000 7f700dafe640 1 --2- 172.21.15.114:0/1981356583 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f700815af20 0x7f70080b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.053+0000 7f700dafe640 1 -- 172.21.15.114:0/1981356583 >> v2:172.21.15.141:3300/0 conn(0x7f70080b64c0 msgr2=0x7f70080cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:58.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.053+0000 7f700dafe640 1 --2- 172.21.15.114:0/1981356583 >> v2:172.21.15.141:3300/0 conn(0x7f70080b64c0 0x7f70080cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.053+0000 7f700dafe640 1 -- 172.21.15.114:0/1981356583 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70080d04b0 con 0x7f70080cd3b0 2023-11-04T01:36:58.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.054+0000 7f700dafe640 1 --2- 172.21.15.114:0/1981356583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70080cd3b0 0x7f70080cd840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f700806b120 tx=0x7f700002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effeab71315c29f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.054+0000 7f6ffffff640 1 -- 172.21.15.114:0/1981356583 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000031870 con 0x7f70080cd3b0 2023-11-04T01:36:58.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.054+0000 7f6ffffff640 1 -- 172.21.15.114:0/1981356583 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70000319d0 con 0x7f70080cd3b0 2023-11-04T01:36:58.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.054+0000 7f6ffffff640 1 -- 172.21.15.114:0/1981356583 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000031d60 con 0x7f70080cd3b0 2023-11-04T01:36:58.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.054+0000 7f700f561640 1 -- 172.21.15.114:0/1981356583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70080cd3b0 msgr2=0x7f70080cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.054+0000 7f700f561640 1 --2- 172.21.15.114:0/1981356583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70080cd3b0 0x7f70080cd840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f700806b120 tx=0x7f700002b910 comp rx=0 tx=0).stop 2023-11-04T01:36:58.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.054+0000 7f700f561640 1 -- 172.21.15.114:0/1981356583 shutdown_connections 2023-11-04T01:36:58.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.054+0000 7f700f561640 1 --2- 172.21.15.114:0/1981356583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70080cd3b0 0x7f70080cd840 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.054+0000 7f700f561640 1 --2- 172.21.15.114:0/1981356583 >> v2:172.21.15.141:3300/0 conn(0x7f70080b64c0 0x7f70080cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.054+0000 7f700f561640 1 --2- 172.21.15.114:0/1981356583 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f700815af20 0x7f70080b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.054+0000 7f700f561640 1 -- 172.21.15.114:0/1981356583 >> 172.21.15.114:0/1981356583 conn(0x7f700806ea20 msgr2=0x7f700806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.054+0000 7f700f561640 1 -- 172.21.15.114:0/1981356583 shutdown_connections 2023-11-04T01:36:58.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.054+0000 7f700f561640 1 -- 172.21.15.114:0/1981356583 wait complete. 2023-11-04T01:36:58.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.055+0000 7f700f561640 1 Processor -- start 2023-11-04T01:36:58.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.056+0000 7f700f561640 1 -- start start 2023-11-04T01:36:58.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.056+0000 7f700f561640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70080b64c0 0x7f70081f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.056+0000 7f700f561640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70080cd3b0 0x7f70080c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.056+0000 7f700f561640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f700815af20 0x7f70081f3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.056+0000 7f700f561640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70081f09d0 con 0x7f70080b64c0 2023-11-04T01:36:58.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.056+0000 7f700f561640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70080b08b0 con 0x7f70080cd3b0 2023-11-04T01:36:58.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.056+0000 7f700f561640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70081f4400 con 0x7f700815af20 2023-11-04T01:36:58.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.056+0000 7f700d2fd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70080b64c0 0x7f70081f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.056+0000 7f700d2fd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70080b64c0 0x7f70081f0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45134/0 (socket says 172.21.15.114:45134) 2023-11-04T01:36:58.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.056+0000 7f700d2fd640 1 -- 172.21.15.114:0/2081569977 learned_addr learned my addr 172.21.15.114:0/2081569977 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:58.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.057+0000 7f700d2fd640 1 -- 172.21.15.114:0/2081569977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f700815af20 msgr2=0x7f70081f3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.057+0000 7f700dafe640 1 --2- 172.21.15.114:0/2081569977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f700815af20 0x7f70081f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.057+0000 7f700cafc640 1 --2- 172.21.15.114:0/2081569977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70080cd3b0 0x7f70080c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.057+0000 7f700d2fd640 1 --2- 172.21.15.114:0/2081569977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f700815af20 0x7f70081f3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.057+0000 7f700d2fd640 1 -- 172.21.15.114:0/2081569977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70080cd3b0 msgr2=0x7f70080c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.057+0000 7f700d2fd640 1 --2- 172.21.15.114:0/2081569977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70080cd3b0 0x7f70080c6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.057+0000 7f700d2fd640 1 -- 172.21.15.114:0/2081569977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70000094d0 con 0x7f70080b64c0 2023-11-04T01:36:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.057+0000 7f700dafe640 1 --2- 172.21.15.114:0/2081569977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f700815af20 0x7f70081f3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.057+0000 7f700cafc640 1 --2- 172.21.15.114:0/2081569977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70080cd3b0 0x7f70080c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.057+0000 7f700d2fd640 1 --2- 172.21.15.114:0/2081569977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70080b64c0 0x7f70081f0df0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7004007e40 tx=0x7f700400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.057+0000 7f6ffdffb640 1 -- 172.21.15.114:0/2081569977 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004014620 con 0x7f70080b64c0 2023-11-04T01:36:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.057+0000 7f6ffdffb640 1 -- 172.21.15.114:0/2081569977 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700400ee90 con 0x7f70080b64c0 2023-11-04T01:36:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.057+0000 7f700f561640 1 -- 172.21.15.114:0/2081569977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70081f46e0 con 0x7f70080b64c0 2023-11-04T01:36:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.057+0000 7f6ffdffb640 1 -- 172.21.15.114:0/2081569977 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70040149c0 con 0x7f70080b64c0 2023-11-04T01:36:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.057+0000 7f700f561640 1 -- 172.21.15.114:0/2081569977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70081f02a0 con 0x7f70080b64c0 2023-11-04T01:36:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.058+0000 7f700f561640 1 -- 172.21.15.114:0/2081569977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70080674e0 con 0x7f70080b64c0 2023-11-04T01:36:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.058+0000 7f6ffdffb640 1 -- 172.21.15.114:0/2081569977 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7004014b20 con 0x7f70080b64c0 2023-11-04T01:36:58.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.059+0000 7f6ffdffb640 1 --2- 172.21.15.114:0/2081569977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6fec06ae70 0x7f6fec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.059+0000 7f6ffdffb640 1 -- 172.21.15.114:0/2081569977 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f700408a190 con 0x7f70080b64c0 2023-11-04T01:36:58.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.059+0000 7f700cafc640 1 --2- 172.21.15.114:0/2081569977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6fec06ae70 0x7f6fec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.059+0000 7f700cafc640 1 --2- 172.21.15.114:0/2081569977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6fec06ae70 0x7f6fec06d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f70080ca8a0 tx=0x7f6ff8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.063+0000 7f6ffdffb640 1 -- 172.21.15.114:0/2081569977 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7004054fe0 con 0x7f70080b64c0 2023-11-04T01:36:58.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.230+0000 7f700f561640 1 -- 172.21.15.114:0/2081569977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70080cfb90 con 0x7f70080b64c0 2023-11-04T01:36:58.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.230+0000 7f6ffdffb640 1 -- 172.21.15.114:0/2081569977 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7004058600 con 0x7f70080b64c0 2023-11-04T01:36:58.232 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:36:58.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.232+0000 7f700f561640 1 -- 172.21.15.114:0/2081569977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6fec06ae70 msgr2=0x7f6fec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.232+0000 7f700f561640 1 --2- 172.21.15.114:0/2081569977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6fec06ae70 0x7f6fec06d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f70080ca8a0 tx=0x7f6ff8008040 comp rx=0 tx=0).stop 2023-11-04T01:36:58.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.232+0000 7f700f561640 1 -- 172.21.15.114:0/2081569977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70080b64c0 msgr2=0x7f70081f0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.232+0000 7f700f561640 1 --2- 172.21.15.114:0/2081569977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70080b64c0 0x7f70081f0df0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7004007e40 tx=0x7f700400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.232+0000 7f700f561640 1 -- 172.21.15.114:0/2081569977 shutdown_connections 2023-11-04T01:36:58.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.232+0000 7f700f561640 1 --2- 172.21.15.114:0/2081569977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f700815af20 0x7f70081f3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.232+0000 7f700f561640 1 --2- 172.21.15.114:0/2081569977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6fec06ae70 0x7f6fec06d330 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.232+0000 7f700f561640 1 --2- 172.21.15.114:0/2081569977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70080cd3b0 0x7f70080c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.232+0000 7f700f561640 1 --2- 172.21.15.114:0/2081569977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70080b64c0 0x7f70081f0df0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.232+0000 7f700f561640 1 -- 172.21.15.114:0/2081569977 >> 172.21.15.114:0/2081569977 conn(0x7f700806ea20 msgr2=0x7f7008155830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.232+0000 7f700f561640 1 -- 172.21.15.114:0/2081569977 shutdown_connections 2023-11-04T01:36:58.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.232+0000 7f700f561640 1 -- 172.21.15.114:0/2081569977 wait complete. 2023-11-04T01:36:58.247 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:36:58.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.349+0000 7f68c9365640 1 Processor -- start 2023-11-04T01:36:58.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.349+0000 7f68c9365640 1 -- start start 2023-11-04T01:36:58.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.350+0000 7f68c9365640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f68c40cd6d0 0x7f68c4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.350+0000 7f68c9365640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c40cde60 con 0x7f68c4153e60 2023-11-04T01:36:58.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.350+0000 7f68c9365640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c4160f90 con 0x7f68c40b4880 2023-11-04T01:36:58.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.350+0000 7f68c9365640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c4161960 con 0x7f68c40cd6d0 2023-11-04T01:36:58.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.350+0000 7f68bbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f68c40cd6d0 0x7f68c4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.350+0000 7f68bbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f68c40cd6d0 0x7f68c4161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45140/0 (socket says 172.21.15.114:45140) 2023-11-04T01:36:58.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.350+0000 7f68bbfff640 1 -- 172.21.15.114:0/3690233905 learned_addr learned my addr 172.21.15.114:0/3690233905 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:58.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.350+0000 7f68bbfff640 1 -- 172.21.15.114:0/3690233905 >> v1:172.21.15.141:6789/0 conn(0x7f68c40b4880 legacy=0x7f68c40d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:58.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.350+0000 7f68bbfff640 1 -- 172.21.15.114:0/3690233905 >> v1:172.21.15.114:6789/0 conn(0x7f68c4153e60 legacy=0x7f68c415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.350+0000 7f68bbfff640 1 -- 172.21.15.114:0/3690233905 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c40ce090 con 0x7f68c40cd6d0 2023-11-04T01:36:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.351+0000 7f68bbfff640 1 --2- 172.21.15.114:0/3690233905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68c40cd6d0 0x7f68c4161420 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009870 tx=0x7f68ac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c242075af0dcc768 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.351+0000 7f68c27fc640 1 -- 172.21.15.114:0/3690233905 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac030860 con 0x7f68c40cd6d0 2023-11-04T01:36:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.351+0000 7f68c27fc640 1 -- 172.21.15.114:0/3690233905 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac0309c0 con 0x7f68c40cd6d0 2023-11-04T01:36:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.351+0000 7f68c27fc640 1 -- 172.21.15.114:0/3690233905 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac030d50 con 0x7f68c40cd6d0 2023-11-04T01:36:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.351+0000 7f68c9365640 1 -- 172.21.15.114:0/3690233905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68c40cd6d0 msgr2=0x7f68c4161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.351+0000 7f68c9365640 1 --2- 172.21.15.114:0/3690233905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68c40cd6d0 0x7f68c4161420 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009870 tx=0x7f68ac02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.352+0000 7f68c9365640 1 -- 172.21.15.114:0/3690233905 shutdown_connections 2023-11-04T01:36:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.352+0000 7f68c9365640 1 --2- 172.21.15.114:0/3690233905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68c40cd6d0 0x7f68c4161420 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.352+0000 7f68c9365640 1 -- 172.21.15.114:0/3690233905 >> 172.21.15.114:0/3690233905 conn(0x7f68c40cf880 msgr2=0x7f68c40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.352+0000 7f68c9365640 1 -- 172.21.15.114:0/3690233905 shutdown_connections 2023-11-04T01:36:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.352+0000 7f68c9365640 1 -- 172.21.15.114:0/3690233905 wait complete. 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.353+0000 7f68c9365640 1 Processor -- start 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.353+0000 7f68c9365640 1 -- start start 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.353+0000 7f68c9365640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68c40b4880 0x7f68c41f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.353+0000 7f68c9365640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68c40cd6d0 0x7f68c41f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.353+0000 7f68c9365640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68c4153e60 0x7f68c41f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.353+0000 7f68c9365640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c40c7170 con 0x7f68c40cd6d0 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.353+0000 7f68c9365640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c40c6e90 con 0x7f68c4153e60 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.353+0000 7f68c9365640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c4157c10 con 0x7f68c40b4880 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.353+0000 7f68bbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68c40cd6d0 0x7f68c41f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68bbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68c40cd6d0 0x7f68c41f5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45156/0 (socket says 172.21.15.114:45156) 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68bbfff640 1 -- 172.21.15.114:0/2542805608 learned_addr learned my addr 172.21.15.114:0/2542805608 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68c2ffd640 1 --2- 172.21.15.114:0/2542805608 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68c40b4880 0x7f68c41f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68c37fe640 1 --2- 172.21.15.114:0/2542805608 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68c4153e60 0x7f68c41f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68bbfff640 1 -- 172.21.15.114:0/2542805608 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68c40b4880 msgr2=0x7f68c41f2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68bbfff640 1 --2- 172.21.15.114:0/2542805608 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68c40b4880 0x7f68c41f2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68bbfff640 1 -- 172.21.15.114:0/2542805608 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68c4153e60 msgr2=0x7f68c41f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68bbfff640 1 --2- 172.21.15.114:0/2542805608 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68c4153e60 0x7f68c41f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68bbfff640 1 -- 172.21.15.114:0/2542805608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac0094d0 con 0x7f68c40cd6d0 2023-11-04T01:36:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68c37fe640 1 --2- 172.21.15.114:0/2542805608 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68c4153e60 0x7f68c41f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68c2ffd640 1 --2- 172.21.15.114:0/2542805608 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68c40b4880 0x7f68c41f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:36:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68bbfff640 1 --2- 172.21.15.114:0/2542805608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68c40cd6d0 0x7f68c41f5f70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009870 tx=0x7f68ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68bb7fe640 1 -- 172.21.15.114:0/2542805608 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac030810 con 0x7f68c40cd6d0 2023-11-04T01:36:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68bb7fe640 1 -- 172.21.15.114:0/2542805608 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac043400 con 0x7f68c40cd6d0 2023-11-04T01:36:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68c9365640 1 -- 172.21.15.114:0/2542805608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c4157ef0 con 0x7f68c40cd6d0 2023-11-04T01:36:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68bb7fe640 1 -- 172.21.15.114:0/2542805608 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac0437b0 con 0x7f68c40cd6d0 2023-11-04T01:36:58.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.354+0000 7f68c9365640 1 -- 172.21.15.114:0/2542805608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c40c6b20 con 0x7f68c40cd6d0 2023-11-04T01:36:58.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.355+0000 7f68c9365640 1 -- 172.21.15.114:0/2542805608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c4074290 con 0x7f68c40cd6d0 2023-11-04T01:36:58.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.356+0000 7f68bb7fe640 1 -- 172.21.15.114:0/2542805608 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f68ac043910 con 0x7f68c40cd6d0 2023-11-04T01:36:58.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.356+0000 7f68bb7fe640 1 --2- 172.21.15.114:0/2542805608 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f68a406ae70 0x7f68a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.356+0000 7f68bb7fe640 1 -- 172.21.15.114:0/2542805608 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f68ac03e070 con 0x7f68c40cd6d0 2023-11-04T01:36:58.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.356+0000 7f68c2ffd640 1 --2- 172.21.15.114:0/2542805608 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f68a406ae70 0x7f68a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.356+0000 7f68c2ffd640 1 --2- 172.21.15.114:0/2542805608 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f68a406ae70 0x7f68a406d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f68c4149280 tx=0x7f68b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.360+0000 7f68bb7fe640 1 -- 172.21.15.114:0/2542805608 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f68ac077b20 con 0x7f68c40cd6d0 2023-11-04T01:36:58.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.525+0000 7f68c9365640 1 -- 172.21.15.114:0/2542805608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f68c4155fd0 con 0x7f68c40cd6d0 2023-11-04T01:36:58.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.526+0000 7f68bb7fe640 1 -- 172.21.15.114:0/2542805608 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f68ac0340a0 con 0x7f68c40cd6d0 2023-11-04T01:36:58.528 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:36:58.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.528+0000 7f68c9365640 1 -- 172.21.15.114:0/2542805608 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f68a406ae70 msgr2=0x7f68a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.528+0000 7f68c9365640 1 --2- 172.21.15.114:0/2542805608 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f68a406ae70 0x7f68a406d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f68c4149280 tx=0x7f68b4009040 comp rx=0 tx=0).stop 2023-11-04T01:36:58.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.528+0000 7f68c9365640 1 -- 172.21.15.114:0/2542805608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68c40cd6d0 msgr2=0x7f68c41f5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.528+0000 7f68c9365640 1 --2- 172.21.15.114:0/2542805608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68c40cd6d0 0x7f68c41f5f70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009870 tx=0x7f68ac004730 comp rx=0 tx=0).stop 2023-11-04T01:36:58.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.528+0000 7f68c9365640 1 -- 172.21.15.114:0/2542805608 shutdown_connections 2023-11-04T01:36:58.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.528+0000 7f68c9365640 1 --2- 172.21.15.114:0/2542805608 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f68a406ae70 0x7f68a406d330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.528+0000 7f68c9365640 1 --2- 172.21.15.114:0/2542805608 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68c4153e60 0x7f68c41f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.528+0000 7f68c9365640 1 --2- 172.21.15.114:0/2542805608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68c40cd6d0 0x7f68c41f5f70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.528+0000 7f68c9365640 1 --2- 172.21.15.114:0/2542805608 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68c40b4880 0x7f68c41f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.528+0000 7f68c9365640 1 -- 172.21.15.114:0/2542805608 >> 172.21.15.114:0/2542805608 conn(0x7f68c40cf880 msgr2=0x7f68c40d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.528+0000 7f68c9365640 1 -- 172.21.15.114:0/2542805608 shutdown_connections 2023-11-04T01:36:58.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.528+0000 7f68c9365640 1 -- 172.21.15.114:0/2542805608 wait complete. 2023-11-04T01:36:58.541 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:58.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.640+0000 7fc402a56640 1 Processor -- start 2023-11-04T01:36:58.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.640+0000 7fc402a56640 1 -- start start 2023-11-04T01:36:58.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.641+0000 7fc402a56640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3fc0cda60 0x7fc3fc0ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.641+0000 7fc402a56640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc3fc0b0cd0 0x7fc3fc070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.641+0000 7fc402a56640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3fc0cc990 con 0x7fc3fc0cace0 2023-11-04T01:36:58.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.641+0000 7fc402a56640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3fc0ccc70 con 0x7fc3fc0b0cd0 2023-11-04T01:36:58.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.641+0000 7fc402a56640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc0c9ce0 con 0x7fc3fc0cda60 2023-11-04T01:36:58.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.641+0000 7fc400ff3640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fc3fc0cace0 0x7fc3fc06c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:45162/0 (socket says 172.21.15.114:45162) 2023-11-04T01:36:58.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.641+0000 7fc3fbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3fc0cda60 0x7fc3fc0ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.641+0000 7fc400ff3640 1 -- 172.21.15.114:0/3766282500 learned_addr learned my addr 172.21.15.114:0/3766282500 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:58.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.641+0000 7fc3fb7fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc3fc0b0cd0 0x7fc3fc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.641+0000 7fc3faffd640 1 -- 172.21.15.114:0/3766282500 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705430258 0 0) 0x7fc3fc0cc990 con 0x7fc3fc0cace0 2023-11-04T01:36:58.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.641+0000 7fc3faffd640 1 -- 172.21.15.114:0/3766282500 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3e8003520 con 0x7fc3fc0cace0 2023-11-04T01:36:58.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.641+0000 7fc3fb7fe640 1 -- 172.21.15.114:0/3766282500 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3fc0cda60 msgr2=0x7fc3fc0ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:58.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.641+0000 7fc3fb7fe640 1 --2- 172.21.15.114:0/3766282500 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3fc0cda60 0x7fc3fc0ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.641+0000 7fc3fb7fe640 1 -- 172.21.15.114:0/3766282500 >> v1:172.21.15.141:6789/0 conn(0x7fc3fc0cace0 legacy=0x7fc3fc06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.641+0000 7fc3fb7fe640 1 -- 172.21.15.114:0/3766282500 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc0c9fc0 con 0x7fc3fc0b0cd0 2023-11-04T01:36:58.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.641+0000 7fc3fbfff640 1 --2- 172.21.15.114:0/3766282500 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3fc0cda60 0x7fc3fc0ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:36:58.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.642+0000 7fc3fb7fe640 1 --2- 172.21.15.114:0/3766282500 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3fc0b0cd0 0x7fc3fc070630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40097a0 tx=0x7fc3e402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f2ca15339767965 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.642+0000 7fc3faffd640 1 -- 172.21.15.114:0/3766282500 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e402d040 con 0x7fc3fc0b0cd0 2023-11-04T01:36:58.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.642+0000 7fc3faffd640 1 -- 172.21.15.114:0/3766282500 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e4031810 con 0x7fc3fc0b0cd0 2023-11-04T01:36:58.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.642+0000 7fc3faffd640 1 -- 172.21.15.114:0/3766282500 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4031b80 con 0x7fc3fc0b0cd0 2023-11-04T01:36:58.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.643+0000 7fc402a56640 1 -- 172.21.15.114:0/3766282500 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3fc0b0cd0 msgr2=0x7fc3fc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.643+0000 7fc402a56640 1 --2- 172.21.15.114:0/3766282500 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3fc0b0cd0 0x7fc3fc070630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40097a0 tx=0x7fc3e402b8b0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.643+0000 7fc402a56640 1 -- 172.21.15.114:0/3766282500 shutdown_connections 2023-11-04T01:36:58.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.643+0000 7fc402a56640 1 --2- 172.21.15.114:0/3766282500 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3fc0b0cd0 0x7fc3fc070630 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.643+0000 7fc402a56640 1 --2- 172.21.15.114:0/3766282500 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3fc0cda60 0x7fc3fc0ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.643+0000 7fc402a56640 1 -- 172.21.15.114:0/3766282500 >> 172.21.15.114:0/3766282500 conn(0x7fc3fc0ce950 msgr2=0x7fc3fc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.643+0000 7fc402a56640 1 -- 172.21.15.114:0/3766282500 shutdown_connections 2023-11-04T01:36:58.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.643+0000 7fc402a56640 1 -- 172.21.15.114:0/3766282500 wait complete. 2023-11-04T01:36:58.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.644+0000 7fc402a56640 1 Processor -- start 2023-11-04T01:36:58.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.644+0000 7fc402a56640 1 -- start start 2023-11-04T01:36:58.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.645+0000 7fc402a56640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3fc0b0cd0 0x7fc3fc0ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.645+0000 7fc402a56640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3fc0cace0 0x7fc3fc0c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.645+0000 7fc402a56640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3fc0cda60 0x7fc3fc0aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.645+0000 7fc402a56640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc0ace30 con 0x7fc3fc0cace0 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.645+0000 7fc402a56640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc0ac290 con 0x7fc3fc0b0cd0 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.645+0000 7fc402a56640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc0c4ba0 con 0x7fc3fc0cda60 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.645+0000 7fc3fb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3fc0cace0 0x7fc3fc0c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.645+0000 7fc3fb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3fc0cace0 0x7fc3fc0c4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45164/0 (socket says 172.21.15.114:45164) 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.645+0000 7fc3fb7fe640 1 -- 172.21.15.114:0/3866179402 learned_addr learned my addr 172.21.15.114:0/3866179402 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.645+0000 7fc400ff3640 1 --2- 172.21.15.114:0/3866179402 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3fc0cda60 0x7fc3fc0aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.645+0000 7fc3fbfff640 1 --2- 172.21.15.114:0/3866179402 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3fc0b0cd0 0x7fc3fc0ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.645+0000 7fc3fb7fe640 1 -- 172.21.15.114:0/3866179402 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3fc0cda60 msgr2=0x7fc3fc0aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.645+0000 7fc3fb7fe640 1 --2- 172.21.15.114:0/3866179402 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3fc0cda60 0x7fc3fc0aa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.645+0000 7fc3fb7fe640 1 -- 172.21.15.114:0/3866179402 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3fc0b0cd0 msgr2=0x7fc3fc0ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.645+0000 7fc3fb7fe640 1 --2- 172.21.15.114:0/3866179402 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3fc0b0cd0 0x7fc3fc0ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.645+0000 7fc3fb7fe640 1 -- 172.21.15.114:0/3866179402 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec00a5a0 con 0x7fc3fc0cace0 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.646+0000 7fc3fb7fe640 1 --2- 172.21.15.114:0/3866179402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3fc0cace0 0x7fc3fc0c4660 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40098c0 tx=0x7fc3e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.646+0000 7fc3f8ff9640 1 -- 172.21.15.114:0/3866179402 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4003820 con 0x7fc3fc0cace0 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.646+0000 7fc3f8ff9640 1 -- 172.21.15.114:0/3866179402 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e403f070 con 0x7fc3fc0cace0 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.646+0000 7fc402a56640 1 -- 172.21.15.114:0/3866179402 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e4009400 con 0x7fc3fc0cace0 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.646+0000 7fc3f8ff9640 1 -- 172.21.15.114:0/3866179402 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4003bc0 con 0x7fc3fc0cace0 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.646+0000 7fc402a56640 1 -- 172.21.15.114:0/3866179402 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3fc0ac7e0 con 0x7fc3fc0cace0 2023-11-04T01:36:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.647+0000 7fc402a56640 1 -- 172.21.15.114:0/3866179402 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3fc074290 con 0x7fc3fc0cace0 2023-11-04T01:36:58.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.647+0000 7fc3f8ff9640 1 -- 172.21.15.114:0/3866179402 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc3e4003d20 con 0x7fc3fc0cace0 2023-11-04T01:36:58.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.647+0000 7fc3f8ff9640 1 --2- 172.21.15.114:0/3866179402 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc3dc06aea0 0x7fc3dc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.648+0000 7fc3f8ff9640 1 -- 172.21.15.114:0/3866179402 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc3e4041070 con 0x7fc3fc0cace0 2023-11-04T01:36:58.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.648+0000 7fc3fbfff640 1 --2- 172.21.15.114:0/3866179402 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc3dc06aea0 0x7fc3dc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.648+0000 7fc3fbfff640 1 --2- 172.21.15.114:0/3866179402 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc3dc06aea0 0x7fc3dc06d360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc06d110 tx=0x7fc3ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.652+0000 7fc3f8ff9640 1 -- 172.21.15.114:0/3866179402 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc3e4076870 con 0x7fc3fc0cace0 2023-11-04T01:36:58.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.856+0000 7fc402a56640 1 -- 172.21.15.114:0/3866179402 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3fc0b48d0 con 0x7fc3fc0cace0 2023-11-04T01:36:58.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.856+0000 7fc3f8ff9640 1 -- 172.21.15.114:0/3866179402 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7fc3e404a090 con 0x7fc3fc0cace0 2023-11-04T01:36:58.858 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:58.858 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1590879236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1590879236},{"type":"v1","addr":"172.21.15.141:6834","nonce":1590879236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3079825621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3079825621},{"type":"v1","addr":"172.21.15.114:6835","nonce":3079825621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1526155664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1526155664},{"type":"v1","addr":"172.21.15.114:6837","nonce":1526155664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:36:29.888918+0000","modified":"2023-11-04T01:36:46.975998+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6835/4231924170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4231924170},{"type":"v1","addr":"172.21.15.141:6835","nonce":4231924170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:36:58.859 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2023-11-04T01:36:58.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.858+0000 7fc402a56640 1 -- 172.21.15.114:0/3866179402 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc3dc06aea0 msgr2=0x7fc3dc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.858+0000 7fc402a56640 1 --2- 172.21.15.114:0/3866179402 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc3dc06aea0 0x7fc3dc06d360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc06d110 tx=0x7fc3ec008040 comp rx=0 tx=0).stop 2023-11-04T01:36:58.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.858+0000 7fc402a56640 1 -- 172.21.15.114:0/3866179402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3fc0cace0 msgr2=0x7fc3fc0c4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.858+0000 7fc402a56640 1 --2- 172.21.15.114:0/3866179402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3fc0cace0 0x7fc3fc0c4660 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40098c0 tx=0x7fc3e40046c0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.858+0000 7fc402a56640 1 -- 172.21.15.114:0/3866179402 shutdown_connections 2023-11-04T01:36:58.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.858+0000 7fc402a56640 1 --2- 172.21.15.114:0/3866179402 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3fc0cda60 0x7fc3fc0aa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.858+0000 7fc402a56640 1 --2- 172.21.15.114:0/3866179402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3fc0cace0 0x7fc3fc0c4660 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.858+0000 7fc402a56640 1 --2- 172.21.15.114:0/3866179402 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc3dc06aea0 0x7fc3dc06d360 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.858+0000 7fc402a56640 1 --2- 172.21.15.114:0/3866179402 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3fc0b0cd0 0x7fc3fc0ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.858+0000 7fc402a56640 1 -- 172.21.15.114:0/3866179402 >> 172.21.15.114:0/3866179402 conn(0x7fc3fc0ce950 msgr2=0x7fc3fc0ae700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.858+0000 7fc402a56640 1 -- 172.21.15.114:0/3866179402 shutdown_connections 2023-11-04T01:36:58.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.858+0000 7fc402a56640 1 -- 172.21.15.114:0/3866179402 wait complete. 2023-11-04T01:36:58.870 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:36:58.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.967+0000 7f10a7664640 1 Processor -- start 2023-11-04T01:36:58.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.968+0000 7f10a7664640 1 -- start start 2023-11-04T01:36:58.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.968+0000 7f10a7664640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f10a00cbea0 0x7f10a006eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.968+0000 7f10a7664640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a00cc2b0 con 0x7f10a015ab70 2023-11-04T01:36:58.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.968+0000 7f10a7664640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a006d310 con 0x7f10a006a830 2023-11-04T01:36:58.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.968+0000 7f10a7664640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a00cba70 con 0x7f10a00cbea0 2023-11-04T01:36:58.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.968+0000 7f10a5400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f10a015ab70 0x7f10a006a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59114/0 (socket says 172.21.15.114:59114) 2023-11-04T01:36:58.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.968+0000 7f10a5400640 1 -- 172.21.15.114:0/524551456 learned_addr learned my addr 172.21.15.114:0/524551456 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:58.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.969+0000 7f10a5c01640 1 --2- 172.21.15.114:0/524551456 >> v2:172.21.15.114:3300/0 conn(0x7f10a00cbea0 0x7f10a006eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.969+0000 7f1093fff640 1 -- 172.21.15.114:0/524551456 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669950044 0 0) 0x7f10a00cc2b0 con 0x7f10a015ab70 2023-11-04T01:36:58.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.969+0000 7f1093fff640 1 -- 172.21.15.114:0/524551456 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f108c003520 con 0x7f10a015ab70 2023-11-04T01:36:58.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.969+0000 7f10a5c01640 1 -- 172.21.15.114:0/524551456 >> v1:172.21.15.141:6789/0 conn(0x7f10a006a830 legacy=0x7f10a00ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.969+0000 7f10a5c01640 1 -- 172.21.15.114:0/524551456 >> v1:172.21.15.114:6789/0 conn(0x7f10a015ab70 legacy=0x7f10a006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.969+0000 7f10a5c01640 1 -- 172.21.15.114:0/524551456 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a015d860 con 0x7f10a00cbea0 2023-11-04T01:36:58.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.970+0000 7f10a5c01640 1 --2- 172.21.15.114:0/524551456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10a00cbea0 0x7f10a006eba0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f10980097a0 tx=0x7f109802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a73687833d33fb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.970+0000 7f1093fff640 1 -- 172.21.15.114:0/524551456 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109802e070 con 0x7f10a00cbea0 2023-11-04T01:36:58.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.970+0000 7f1093fff640 1 -- 172.21.15.114:0/524551456 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10980315a0 con 0x7f10a00cbea0 2023-11-04T01:36:58.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.970+0000 7f1093fff640 1 -- 172.21.15.114:0/524551456 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098031910 con 0x7f10a00cbea0 2023-11-04T01:36:58.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.970+0000 7f10a7664640 1 -- 172.21.15.114:0/524551456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10a00cbea0 msgr2=0x7f10a006eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.970+0000 7f10a7664640 1 --2- 172.21.15.114:0/524551456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10a00cbea0 0x7f10a006eba0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f10980097a0 tx=0x7f109802b840 comp rx=0 tx=0).stop 2023-11-04T01:36:58.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.970+0000 7f10a7664640 1 -- 172.21.15.114:0/524551456 shutdown_connections 2023-11-04T01:36:58.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.970+0000 7f10a7664640 1 --2- 172.21.15.114:0/524551456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10a00cbea0 0x7f10a006eba0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.970+0000 7f10a7664640 1 -- 172.21.15.114:0/524551456 >> 172.21.15.114:0/524551456 conn(0x7f10a0098d40 msgr2=0x7f10a00cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:58.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.970+0000 7f10a7664640 1 -- 172.21.15.114:0/524551456 shutdown_connections 2023-11-04T01:36:58.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.971+0000 7f10a7664640 1 -- 172.21.15.114:0/524551456 wait complete. 2023-11-04T01:36:58.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.972+0000 7f10a7664640 1 Processor -- start 2023-11-04T01:36:58.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.972+0000 7f10a7664640 1 -- start start 2023-11-04T01:36:58.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.972+0000 7f10a7664640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10a006a830 0x7f10a014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.972+0000 7f10a7664640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10a00cbea0 0x7f10a015c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.972+0000 7f10a7664640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10a015ab70 0x7f10a015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.972+0000 7f10a7664640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a0161c50 con 0x7f10a00cbea0 2023-11-04T01:36:58.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.972+0000 7f10a7664640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00b35f0 con 0x7f10a006a830 2023-11-04T01:36:58.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.972+0000 7f10a7664640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a01f3700 con 0x7f10a015ab70 2023-11-04T01:36:58.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.972+0000 7f10a4bff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10a00cbea0 0x7f10a015c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.972+0000 7f10a4bff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10a00cbea0 0x7f10a015c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45174/0 (socket says 172.21.15.114:45174) 2023-11-04T01:36:58.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.972+0000 7f10a4bff640 1 -- 172.21.15.114:0/778893564 learned_addr learned my addr 172.21.15.114:0/778893564 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:58.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.973+0000 7f10a5400640 1 --2- 172.21.15.114:0/778893564 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10a006a830 0x7f10a014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.973+0000 7f10a5c01640 1 --2- 172.21.15.114:0/778893564 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10a015ab70 0x7f10a015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.973+0000 7f10a4bff640 1 -- 172.21.15.114:0/778893564 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10a015ab70 msgr2=0x7f10a015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.973+0000 7f10a4bff640 1 --2- 172.21.15.114:0/778893564 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10a015ab70 0x7f10a015c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.973+0000 7f10a4bff640 1 -- 172.21.15.114:0/778893564 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10a006a830 msgr2=0x7f10a014ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:58.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.973+0000 7f10a4bff640 1 --2- 172.21.15.114:0/778893564 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10a006a830 0x7f10a014ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:58.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.973+0000 7f10a4bff640 1 -- 172.21.15.114:0/778893564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1098009400 con 0x7f10a00cbea0 2023-11-04T01:36:58.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.973+0000 7f10a5c01640 1 --2- 172.21.15.114:0/778893564 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10a015ab70 0x7f10a015c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:36:58.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.973+0000 7f10a4bff640 1 --2- 172.21.15.114:0/778893564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10a00cbea0 0x7f10a015c480 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f109400c440 tx=0x7f109400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.973+0000 7f1091ffb640 1 -- 172.21.15.114:0/778893564 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10940052d0 con 0x7f10a00cbea0 2023-11-04T01:36:58.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.973+0000 7f1091ffb640 1 -- 172.21.15.114:0/778893564 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1094005450 con 0x7f10a00cbea0 2023-11-04T01:36:58.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.973+0000 7f10a7664640 1 -- 172.21.15.114:0/778893564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a00b2830 con 0x7f10a00cbea0 2023-11-04T01:36:58.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.973+0000 7f1091ffb640 1 -- 172.21.15.114:0/778893564 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1094003830 con 0x7f10a00cbea0 2023-11-04T01:36:58.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.973+0000 7f10a7664640 1 -- 172.21.15.114:0/778893564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a00b2df0 con 0x7f10a00cbea0 2023-11-04T01:36:58.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.974+0000 7f10a7664640 1 -- 172.21.15.114:0/778893564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a0074290 con 0x7f10a00cbea0 2023-11-04T01:36:58.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.974+0000 7f1091ffb640 1 -- 172.21.15.114:0/778893564 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1094003990 con 0x7f10a00cbea0 2023-11-04T01:36:58.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.975+0000 7f1091ffb640 1 --2- 172.21.15.114:0/778893564 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f108406ae70 0x7f108406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:58.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.975+0000 7f1091ffb640 1 -- 172.21.15.114:0/778893564 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1094088d20 con 0x7f10a00cbea0 2023-11-04T01:36:58.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.975+0000 7f10a5400640 1 --2- 172.21.15.114:0/778893564 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f108406ae70 0x7f108406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:58.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.975+0000 7f10a5400640 1 --2- 172.21.15.114:0/778893564 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f108406ae70 0x7f108406d330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f109c001460 tx=0x7f109c007f60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:58.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:58.979+0000 7f1091ffb640 1 -- 172.21.15.114:0/778893564 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1094053b90 con 0x7f10a00cbea0 2023-11-04T01:36:59.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.148+0000 7f10a7664640 1 -- 172.21.15.114:0/778893564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10a006ae70 con 0x7f10a00cbea0 2023-11-04T01:36:59.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.150+0000 7f1091ffb640 1 -- 172.21.15.114:0/778893564 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18406 (secure 0 0 0) 0x7f1094017090 con 0x7f10a00cbea0 2023-11-04T01:36:59.152 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:59.152 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:36:34.950923+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:36:59.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.152+0000 7f10a7664640 1 -- 172.21.15.114:0/778893564 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f108406ae70 msgr2=0x7f108406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.152+0000 7f10a7664640 1 --2- 172.21.15.114:0/778893564 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f108406ae70 0x7f108406d330 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f109c001460 tx=0x7f109c007f60 comp rx=0 tx=0).stop 2023-11-04T01:36:59.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.152+0000 7f10a7664640 1 -- 172.21.15.114:0/778893564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10a00cbea0 msgr2=0x7f10a015c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.152+0000 7f10a7664640 1 --2- 172.21.15.114:0/778893564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10a00cbea0 0x7f10a015c480 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f109400c440 tx=0x7f109400c900 comp rx=0 tx=0).stop 2023-11-04T01:36:59.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.152+0000 7f10a7664640 1 -- 172.21.15.114:0/778893564 shutdown_connections 2023-11-04T01:36:59.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.152+0000 7f10a7664640 1 --2- 172.21.15.114:0/778893564 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10a015ab70 0x7f10a015c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.152+0000 7f10a7664640 1 --2- 172.21.15.114:0/778893564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10a00cbea0 0x7f10a015c480 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.152+0000 7f10a7664640 1 --2- 172.21.15.114:0/778893564 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f108406ae70 0x7f108406d330 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.152+0000 7f10a7664640 1 --2- 172.21.15.114:0/778893564 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10a006a830 0x7f10a014ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.152+0000 7f10a7664640 1 -- 172.21.15.114:0/778893564 >> 172.21.15.114:0/778893564 conn(0x7f10a0098d40 msgr2=0x7f10a00b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:59.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.152+0000 7f10a7664640 1 -- 172.21.15.114:0/778893564 shutdown_connections 2023-11-04T01:36:59.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.152+0000 7f10a7664640 1 -- 172.21.15.114:0/778893564 wait complete. 2023-11-04T01:36:59.168 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:36:59.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.264+0000 7fb536c7c640 1 Processor -- start 2023-11-04T01:36:59.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.264+0000 7fb536c7c640 1 -- start start 2023-11-04T01:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.265+0000 7fb536c7c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb5300cda30 0x7fb530165ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.265+0000 7fb536c7c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5300cc450 con 0x7fb53015bfb0 2023-11-04T01:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.265+0000 7fb536c7c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53015f400 con 0x7fb53015ae40 2023-11-04T01:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.265+0000 7fb536c7c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb53015b220 con 0x7fb5300cda30 2023-11-04T01:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.265+0000 7fb52ffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb53015bfb0 0x7fb5300cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59120/0 (socket says 172.21.15.114:59120) 2023-11-04T01:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.265+0000 7fb52ffff640 1 -- 172.21.15.114:0/2258468666 learned_addr learned my addr 172.21.15.114:0/2258468666 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb535219640 1 --2- 172.21.15.114:0/2258468666 >> v2:172.21.15.141:3300/0 conn(0x7fb5300cda30 0x7fb530165ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb52f7fe640 1 -- 172.21.15.114:0/2258468666 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740468856 0 0) 0x7fb524001110 con 0x7fb53015bfb0 2023-11-04T01:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb52f7fe640 1 -- 172.21.15.114:0/2258468666 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb518003520 con 0x7fb53015bfb0 2023-11-04T01:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb52f7fe640 1 -- 172.21.15.114:0/2258468666 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1496308189 0 0) 0x7fb518003520 con 0x7fb53015bfb0 2023-11-04T01:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb52f7fe640 1 -- 172.21.15.114:0/2258468666 >> v2:172.21.15.141:3300/0 conn(0x7fb5300cda30 msgr2=0x7fb530165ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:59.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb52f7fe640 1 --2- 172.21.15.114:0/2258468666 >> v2:172.21.15.141:3300/0 conn(0x7fb5300cda30 0x7fb530165ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb52f7fe640 1 -- 172.21.15.114:0/2258468666 >> v1:172.21.15.141:6789/0 conn(0x7fb53015ae40 legacy=0x7fb5300cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb52f7fe640 1 -- 172.21.15.114:0/2258468666 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53015f890 con 0x7fb53015bfb0 2023-11-04T01:36:59.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb52f7fe640 1 -- 172.21.15.114:0/2258468666 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fb524001800 con 0x7fb53015bfb0 2023-11-04T01:36:59.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb52f7fe640 1 -- 172.21.15.114:0/2258468666 >> v1:172.21.15.114:6789/0 conn(0x7fb53015bfb0 legacy=0x7fb5300cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb52f7fe640 1 --2- 172.21.15.114:0/2258468666 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb518003970 0x7fb518003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb52f7fe640 1 --2- 172.21.15.114:0/2258468666 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5180047c0 0x7fb518004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb52f7fe640 1 --2- 172.21.15.114:0/2258468666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb518005180 0x7fb51800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb52f7fe640 1 -- 172.21.15.114:0/2258468666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53015b220 con 0x7fb518005180 2023-11-04T01:36:59.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb52f7fe640 1 -- 172.21.15.114:0/2258468666 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51800c020 con 0x7fb5180047c0 2023-11-04T01:36:59.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb52f7fe640 1 -- 172.21.15.114:0/2258468666 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51800c1e0 con 0x7fb518003970 2023-11-04T01:36:59.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb535219640 1 --2- 172.21.15.114:0/2258468666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb518005180 0x7fb51800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb52ffff640 1 --2- 172.21.15.114:0/2258468666 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5180047c0 0x7fb518004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb534a18640 1 --2- 172.21.15.114:0/2258468666 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb518003970 0x7fb518003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb535219640 1 -- 172.21.15.114:0/2258468666 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb518003970 msgr2=0x7fb518003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:59.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb535219640 1 --2- 172.21.15.114:0/2258468666 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb518003970 0x7fb518003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb535219640 1 -- 172.21.15.114:0/2258468666 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5180047c0 msgr2=0x7fb518004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb535219640 1 --2- 172.21.15.114:0/2258468666 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5180047c0 0x7fb518004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.266+0000 7fb535219640 1 -- 172.21.15.114:0/2258468666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb518003520 con 0x7fb518005180 2023-11-04T01:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.267+0000 7fb535219640 1 -- 172.21.15.114:0/2258468666 reap_dead start 2023-11-04T01:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.267+0000 7fb535219640 1 --2- 172.21.15.114:0/2258468666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb518005180 0x7fb51800b980 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb528009fc0 tx=0x7fb5180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643cc63b13032d1e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.267+0000 7fb52f7fe640 1 -- 172.21.15.114:0/2258468666 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52802cc60 con 0x7fb518005180 2023-11-04T01:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.267+0000 7fb52f7fe640 1 -- 172.21.15.114:0/2258468666 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52800f040 con 0x7fb518005180 2023-11-04T01:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.267+0000 7fb52f7fe640 1 -- 172.21.15.114:0/2258468666 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb528003990 con 0x7fb518005180 2023-11-04T01:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.268+0000 7fb536c7c640 1 -- 172.21.15.114:0/2258468666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb518005180 msgr2=0x7fb51800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.268+0000 7fb536c7c640 1 --2- 172.21.15.114:0/2258468666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb518005180 0x7fb51800b980 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb528009fc0 tx=0x7fb5180057f0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.268+0000 7fb536c7c640 1 -- 172.21.15.114:0/2258468666 shutdown_connections 2023-11-04T01:36:59.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.268+0000 7fb536c7c640 1 --2- 172.21.15.114:0/2258468666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb518005180 0x7fb51800b980 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.268+0000 7fb536c7c640 1 -- 172.21.15.114:0/2258468666 >> 172.21.15.114:0/2258468666 conn(0x7fb53006ea90 msgr2=0x7fb53006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:59.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.268+0000 7fb536c7c640 1 -- 172.21.15.114:0/2258468666 shutdown_connections 2023-11-04T01:36:59.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.268+0000 7fb536c7c640 1 -- 172.21.15.114:0/2258468666 wait complete. 2023-11-04T01:36:59.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.269+0000 7fb536c7c640 1 Processor -- start 2023-11-04T01:36:59.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.269+0000 7fb536c7c640 1 -- start start 2023-11-04T01:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb536c7c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb518005180 0x7fb5300c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb536c7c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb53014fc90 0x7fb53014edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb536c7c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb530152150 0x7fb530152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb536c7c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb530152b40 con 0x7fb530152150 2023-11-04T01:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb536c7c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300c71c0 con 0x7fb518005180 2023-11-04T01:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb536c7c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb530150110 con 0x7fb53014fc90 2023-11-04T01:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb535219640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb530152150 0x7fb530152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb535219640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb530152150 0x7fb530152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45178/0 (socket says 172.21.15.114:45178) 2023-11-04T01:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb535219640 1 -- 172.21.15.114:0/3139282602 learned_addr learned my addr 172.21.15.114:0/3139282602 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb52ffff640 1 --2- 172.21.15.114:0/3139282602 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb53014fc90 0x7fb53014edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb534a18640 1 --2- 172.21.15.114:0/3139282602 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb518005180 0x7fb5300c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb535219640 1 -- 172.21.15.114:0/3139282602 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb53014fc90 msgr2=0x7fb53014edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb535219640 1 --2- 172.21.15.114:0/3139282602 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb53014fc90 0x7fb53014edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb535219640 1 -- 172.21.15.114:0/3139282602 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb518005180 msgr2=0x7fb5300c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb535219640 1 --2- 172.21.15.114:0/3139282602 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb518005180 0x7fb5300c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb535219640 1 -- 172.21.15.114:0/3139282602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5301503e0 con 0x7fb530152150 2023-11-04T01:36:59.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb535219640 1 --2- 172.21.15.114:0/3139282602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb530152150 0x7fb530152600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb52800e200 tx=0x7fb528009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb52d7fa640 1 -- 172.21.15.114:0/3139282602 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb528035df0 con 0x7fb530152150 2023-11-04T01:36:59.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.270+0000 7fb52d7fa640 1 -- 172.21.15.114:0/3139282602 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb528003990 con 0x7fb530152150 2023-11-04T01:36:59.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.271+0000 7fb52d7fa640 1 -- 172.21.15.114:0/3139282602 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb528003d40 con 0x7fb530152150 2023-11-04T01:36:59.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.271+0000 7fb536c7c640 1 -- 172.21.15.114:0/3139282602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5301506c0 con 0x7fb530152150 2023-11-04T01:36:59.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.271+0000 7fb536c7c640 1 -- 172.21.15.114:0/3139282602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb530150c80 con 0x7fb530152150 2023-11-04T01:36:59.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.271+0000 7fb536c7c640 1 -- 172.21.15.114:0/3139282602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5300ce2d0 con 0x7fb530152150 2023-11-04T01:36:59.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.272+0000 7fb52d7fa640 1 -- 172.21.15.114:0/3139282602 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb528004030 con 0x7fb530152150 2023-11-04T01:36:59.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.272+0000 7fb52d7fa640 1 --2- 172.21.15.114:0/3139282602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb51c06aea0 0x7fb51c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:36:59.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.272+0000 7fb52d7fa640 1 -- 172.21.15.114:0/3139282602 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb5280ac510 con 0x7fb530152150 2023-11-04T01:36:59.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.272+0000 7fb534a18640 1 --2- 172.21.15.114:0/3139282602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb51c06aea0 0x7fb51c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:36:59.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.273+0000 7fb534a18640 1 --2- 172.21.15.114:0/3139282602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb51c06aea0 0x7fb51c06d360 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb520000c00 tx=0x7fb520009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:36:59.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.276+0000 7fb52d7fa640 1 -- 172.21.15.114:0/3139282602 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb5280772d0 con 0x7fb530152150 2023-11-04T01:36:59.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.477+0000 7fb536c7c640 1 -- 172.21.15.114:0/3139282602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb53015c700 con 0x7fb530152150 2023-11-04T01:36:59.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.477+0000 7fb52d7fa640 1 -- 172.21.15.114:0/3139282602 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7fb52807a8f0 con 0x7fb530152150 2023-11-04T01:36:59.479 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:36:59.479 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1590879236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1590879236},{"type":"v1","addr":"172.21.15.141:6834","nonce":1590879236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3079825621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3079825621},{"type":"v1","addr":"172.21.15.114:6835","nonce":3079825621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1526155664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1526155664},{"type":"v1","addr":"172.21.15.114:6837","nonce":1526155664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:36:29.888918+0000","modified":"2023-11-04T01:36:46.975998+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6835/4231924170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4231924170},{"type":"v1","addr":"172.21.15.141:6835","nonce":4231924170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:36:59.480 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2023-11-04T01:36:59.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.479+0000 7fb536c7c640 1 -- 172.21.15.114:0/3139282602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb51c06aea0 msgr2=0x7fb51c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.479+0000 7fb536c7c640 1 --2- 172.21.15.114:0/3139282602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb51c06aea0 0x7fb51c06d360 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb520000c00 tx=0x7fb520009040 comp rx=0 tx=0).stop 2023-11-04T01:36:59.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.479+0000 7fb536c7c640 1 -- 172.21.15.114:0/3139282602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb530152150 msgr2=0x7fb530152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:36:59.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.479+0000 7fb536c7c640 1 --2- 172.21.15.114:0/3139282602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb530152150 0x7fb530152600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb52800e200 tx=0x7fb528009750 comp rx=0 tx=0).stop 2023-11-04T01:36:59.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.479+0000 7fb536c7c640 1 -- 172.21.15.114:0/3139282602 shutdown_connections 2023-11-04T01:36:59.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.479+0000 7fb536c7c640 1 --2- 172.21.15.114:0/3139282602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb530152150 0x7fb530152600 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.479+0000 7fb536c7c640 1 --2- 172.21.15.114:0/3139282602 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb53014fc90 0x7fb53014edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.479+0000 7fb536c7c640 1 --2- 172.21.15.114:0/3139282602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb51c06aea0 0x7fb51c06d360 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.479+0000 7fb536c7c640 1 --2- 172.21.15.114:0/3139282602 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb518005180 0x7fb5300c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:36:59.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.479+0000 7fb536c7c640 1 -- 172.21.15.114:0/3139282602 >> 172.21.15.114:0/3139282602 conn(0x7fb53006ea90 msgr2=0x7fb53006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:36:59.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.479+0000 7fb536c7c640 1 -- 172.21.15.114:0/3139282602 shutdown_connections 2023-11-04T01:36:59.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.479+0000 7fb536c7c640 1 -- 172.21.15.114:0/3139282602 wait complete. 2023-11-04T01:36:59.894 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:36:29.888918+0000', 'modified': '2023-11-04T01:36:46.975998+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4305}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4305': {'gid': 4305, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.141:6835/4231924170', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.141:6833', 'nonce': 4231924170}, {'type': 'v1', 'addr': '172.21.15.141:6835', 'nonce': 4231924170}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:36:59.894 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:36:59.895 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:36:59.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.997+0000 7fabac4b4640 1 Processor -- start 2023-11-04T01:36:59.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.997+0000 7fabac4b4640 1 -- start start 2023-11-04T01:37:00.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.998+0000 7fabac4b4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faba4160430 0x7faba40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.998+0000 7fabac4b4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faba40b2b60 0x7faba406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.998+0000 7fabac4b4640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7faba406c1d0 0x7faba4160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.998+0000 7fabac4b4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba40cb580 con 0x7faba40b2b60 2023-11-04T01:37:00.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.998+0000 7fabac4b4640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba40b2fc0 con 0x7faba406c1d0 2023-11-04T01:37:00.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.998+0000 7fabac4b4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba406ca40 con 0x7faba4160430 2023-11-04T01:37:00.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.998+0000 7faba9a4f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faba40b2b60 0x7faba406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.998+0000 7faba9a4f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faba40b2b60 0x7faba406bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45186/0 (socket says 172.21.15.114:45186) 2023-11-04T01:37:00.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.998+0000 7faba9a4f640 1 -- 172.21.15.114:0/1194421929 learned_addr learned my addr 172.21.15.114:0/1194421929 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:00.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.999+0000 7fabaaa51640 1 --2- 172.21.15.114:0/1194421929 >> v2:172.21.15.141:3300/0 conn(0x7faba406c1d0 0x7faba4160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.999+0000 7fabaa250640 1 --2- 172.21.15.114:0/1194421929 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faba4160430 0x7faba40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.999+0000 7faba9a4f640 1 -- 172.21.15.114:0/1194421929 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faba4160430 msgr2=0x7faba40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.999+0000 7faba9a4f640 1 --2- 172.21.15.114:0/1194421929 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faba4160430 0x7faba40b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.999+0000 7faba9a4f640 1 -- 172.21.15.114:0/1194421929 >> v2:172.21.15.141:3300/0 conn(0x7faba406c1d0 msgr2=0x7faba4160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.999+0000 7faba9a4f640 1 --2- 172.21.15.114:0/1194421929 >> v2:172.21.15.141:3300/0 conn(0x7faba406c1d0 0x7faba4160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.999+0000 7faba9a4f640 1 -- 172.21.15.114:0/1194421929 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba406cd20 con 0x7faba40b2b60 2023-11-04T01:37:00.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:36:59.999+0000 7faba9a4f640 1 --2- 172.21.15.114:0/1194421929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faba40b2b60 0x7faba406bc90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faba40ce900 tx=0x7fab9802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea19730ab153f3e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.000+0000 7faba924e640 1 -- 172.21.15.114:0/1194421929 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98031870 con 0x7faba40b2b60 2023-11-04T01:37:00.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.000+0000 7faba924e640 1 -- 172.21.15.114:0/1194421929 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab980319d0 con 0x7faba40b2b60 2023-11-04T01:37:00.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.000+0000 7faba924e640 1 -- 172.21.15.114:0/1194421929 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98031d60 con 0x7faba40b2b60 2023-11-04T01:37:00.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.000+0000 7fabac4b4640 1 -- 172.21.15.114:0/1194421929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faba40b2b60 msgr2=0x7faba406bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.000+0000 7fabac4b4640 1 --2- 172.21.15.114:0/1194421929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faba40b2b60 0x7faba406bc90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faba40ce900 tx=0x7fab9802b910 comp rx=0 tx=0).stop 2023-11-04T01:37:00.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.000+0000 7fabac4b4640 1 -- 172.21.15.114:0/1194421929 shutdown_connections 2023-11-04T01:37:00.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.000+0000 7fabac4b4640 1 --2- 172.21.15.114:0/1194421929 >> v2:172.21.15.141:3300/0 conn(0x7faba406c1d0 0x7faba4160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.000+0000 7fabac4b4640 1 --2- 172.21.15.114:0/1194421929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faba40b2b60 0x7faba406bc90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.000+0000 7fabac4b4640 1 --2- 172.21.15.114:0/1194421929 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faba4160430 0x7faba40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.000+0000 7fabac4b4640 1 -- 172.21.15.114:0/1194421929 >> 172.21.15.114:0/1194421929 conn(0x7faba406ea20 msgr2=0x7faba406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.000+0000 7fabac4b4640 1 -- 172.21.15.114:0/1194421929 shutdown_connections 2023-11-04T01:37:00.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.000+0000 7fabac4b4640 1 -- 172.21.15.114:0/1194421929 wait complete. 2023-11-04T01:37:00.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.001+0000 7fabac4b4640 1 Processor -- start 2023-11-04T01:37:00.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.001+0000 7fabac4b4640 1 -- start start 2023-11-04T01:37:00.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.002+0000 7fabac4b4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faba406c1d0 0x7faba40c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.002+0000 7fabac4b4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faba40b2b60 0x7faba41f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.002+0000 7fabac4b4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faba4160430 0x7faba415c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.002+0000 7fabac4b4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba40c6400 con 0x7faba40b2b60 2023-11-04T01:37:00.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.002+0000 7fabac4b4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba415cea0 con 0x7faba4160430 2023-11-04T01:37:00.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.002+0000 7fabac4b4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba40c5780 con 0x7faba406c1d0 2023-11-04T01:37:00.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.002+0000 7faba9a4f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faba40b2b60 0x7faba41f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.002+0000 7faba9a4f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faba40b2b60 0x7faba41f2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45200/0 (socket says 172.21.15.114:45200) 2023-11-04T01:37:00.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.002+0000 7faba9a4f640 1 -- 172.21.15.114:0/2645790352 learned_addr learned my addr 172.21.15.114:0/2645790352 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:00.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.002+0000 7fabaaa51640 1 --2- 172.21.15.114:0/2645790352 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faba4160430 0x7faba415c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.002+0000 7fabaa250640 1 --2- 172.21.15.114:0/2645790352 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faba406c1d0 0x7faba40c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.002+0000 7faba9a4f640 1 -- 172.21.15.114:0/2645790352 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faba406c1d0 msgr2=0x7faba40c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.002+0000 7faba9a4f640 1 --2- 172.21.15.114:0/2645790352 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faba406c1d0 0x7faba40c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.002+0000 7faba9a4f640 1 -- 172.21.15.114:0/2645790352 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faba4160430 msgr2=0x7faba415c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.002+0000 7faba9a4f640 1 --2- 172.21.15.114:0/2645790352 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faba4160430 0x7faba415c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.002+0000 7faba9a4f640 1 -- 172.21.15.114:0/2645790352 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab980094d0 con 0x7faba40b2b60 2023-11-04T01:37:00.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.003+0000 7faba9a4f640 1 --2- 172.21.15.114:0/2645790352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faba40b2b60 0x7faba41f2fe0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fab9802b950 tx=0x7fab980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.003+0000 7faba2ffd640 1 -- 172.21.15.114:0/2645790352 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9803ad30 con 0x7faba40b2b60 2023-11-04T01:37:00.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.003+0000 7faba2ffd640 1 -- 172.21.15.114:0/2645790352 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab980443f0 con 0x7faba40b2b60 2023-11-04T01:37:00.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.003+0000 7faba2ffd640 1 -- 172.21.15.114:0/2645790352 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab980447a0 con 0x7faba40b2b60 2023-11-04T01:37:00.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.003+0000 7fabac4b4640 1 -- 172.21.15.114:0/2645790352 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba40c5a60 con 0x7faba40b2b60 2023-11-04T01:37:00.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.003+0000 7fabac4b4640 1 -- 172.21.15.114:0/2645790352 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba40c6020 con 0x7faba40b2b60 2023-11-04T01:37:00.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.004+0000 7faba2ffd640 1 -- 172.21.15.114:0/2645790352 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab9804d450 con 0x7faba40b2b60 2023-11-04T01:37:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.004+0000 7faba2ffd640 1 --2- 172.21.15.114:0/2645790352 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab9006ae70 0x7fab9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.005+0000 7faba2ffd640 1 -- 172.21.15.114:0/2645790352 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab9802d040 con 0x7faba40b2b60 2023-11-04T01:37:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.005+0000 7fabaa250640 1 --2- 172.21.15.114:0/2645790352 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab9006ae70 0x7fab9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.005+0000 7fabaa250640 1 --2- 172.21.15.114:0/2645790352 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab9006ae70 0x7fab9006d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fab940099c0 tx=0x7fab94003990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.006+0000 7fabaf046740 1 Processor -- start 2023-11-04T01:37:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.006+0000 7fabaf046740 1 -- start start 2023-11-04T01:37:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7fabaf046740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc11f850 0x5562cc0f2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7fabaf046740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11fc30 0x5562cc1225e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7fabaf046740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc0f2c90 0x5562cc122b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7fabaf046740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cc003740 con 0x5562cc11fc30 2023-11-04T01:37:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7fabaf046740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cc0658d0 con 0x5562cc11f850 2023-11-04T01:37:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7fabaf046740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562cc062fc0 con 0x5562cc0f2c90 2023-11-04T01:37:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7faba9a4f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11fc30 0x5562cc1225e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7faba9a4f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11fc30 0x5562cc1225e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45212/0 (socket says 172.21.15.114:45212) 2023-11-04T01:37:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7faba9a4f640 1 -- 172.21.15.114:0/3759808783 learned_addr learned my addr 172.21.15.114:0/3759808783 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7fabaaa51640 1 --2- 172.21.15.114:0/3759808783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc0f2c90 0x5562cc122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7faba9a4f640 1 -- 172.21.15.114:0/3759808783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc0f2c90 msgr2=0x5562cc122b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7fabaa250640 1 --2- 172.21.15.114:0/3759808783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc11f850 0x5562cc0f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7faba9a4f640 1 --2- 172.21.15.114:0/3759808783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc0f2c90 0x5562cc122b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7faba9a4f640 1 -- 172.21.15.114:0/3759808783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc11f850 msgr2=0x5562cc0f2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7faba9a4f640 1 --2- 172.21.15.114:0/3759808783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc11f850 0x5562cc0f2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7faba9a4f640 1 -- 172.21.15.114:0/3759808783 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562cc021ca0 con 0x5562cc11fc30 2023-11-04T01:37:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7faba9a4f640 1 --2- 172.21.15.114:0/3759808783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11fc30 0x5562cc1225e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fab98076e90 tx=0x7fab9807b150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919cb08945a3c527 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7fab8bfff640 1 -- 172.21.15.114:0/3759808783 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98082c90 con 0x5562cc11fc30 2023-11-04T01:37:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7fab8bfff640 1 -- 172.21.15.114:0/3759808783 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab98078d30 con 0x5562cc11fc30 2023-11-04T01:37:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.007+0000 7fab8bfff640 1 -- 172.21.15.114:0/3759808783 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab980770a0 con 0x5562cc11fc30 2023-11-04T01:37:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.008+0000 7fabaf046740 1 -- 172.21.15.114:0/3759808783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11fc30 msgr2=0x5562cc1225e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.008+0000 7fabaf046740 1 --2- 172.21.15.114:0/3759808783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11fc30 0x5562cc1225e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fab98076e90 tx=0x7fab9807b150 comp rx=0 tx=0).stop 2023-11-04T01:37:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.008+0000 7fabaf046740 1 -- 172.21.15.114:0/3759808783 shutdown_connections 2023-11-04T01:37:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.008+0000 7fabaf046740 1 --2- 172.21.15.114:0/3759808783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc0f2c90 0x5562cc122b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.008+0000 7fabaf046740 1 --2- 172.21.15.114:0/3759808783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11fc30 0x5562cc1225e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.008+0000 7fabaf046740 1 --2- 172.21.15.114:0/3759808783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc11f850 0x5562cc0f2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.008+0000 7fabaf046740 1 -- 172.21.15.114:0/3759808783 >> 172.21.15.114:0/3759808783 conn(0x5562cc0f4a60 msgr2=0x5562cc13d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.008+0000 7fabaf046740 1 -- 172.21.15.114:0/3759808783 shutdown_connections 2023-11-04T01:37:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.008+0000 7fabaf046740 1 -- 172.21.15.114:0/3759808783 wait complete. 2023-11-04T01:37:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.009+0000 7fabaf046740 1 -- start start 2023-11-04T01:37:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.009+0000 7fabaf046740 1 Processor -- start 2023-11-04T01:37:00.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.009+0000 7fabaf046740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11f850 0x5562cc110c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaf046740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc11fc30 0x5562cc137110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaf046740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc1114d0 0x5562cc135520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaf046740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cc05e8b0 con 0x5562cc11f850 2023-11-04T01:37:00.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaf046740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cc018c80 con 0x5562cc1114d0 2023-11-04T01:37:00.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaf046740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562cc018920 con 0x5562cc11fc30 2023-11-04T01:37:00.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaf046740 10 client.0 _ll_register_callbacks cb 0x5562cbd70ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:37:00.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaa250640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11f850 0x5562cc110c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaa250640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11f850 0x5562cc110c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45218/0 (socket says 172.21.15.114:45218) 2023-11-04T01:37:00.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaa250640 1 -- 172.21.15.114:0/2413155687 learned_addr learned my addr 172.21.15.114:0/2413155687 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:00.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaaa51640 1 --2- 172.21.15.114:0/2413155687 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc1114d0 0x5562cc135520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7faba9a4f640 1 --2- 172.21.15.114:0/2413155687 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc11fc30 0x5562cc137110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaa250640 1 -- 172.21.15.114:0/2413155687 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc11fc30 msgr2=0x5562cc137110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaa250640 1 --2- 172.21.15.114:0/2413155687 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc11fc30 0x5562cc137110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaa250640 1 -- 172.21.15.114:0/2413155687 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc1114d0 msgr2=0x5562cc135520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaa250640 1 --2- 172.21.15.114:0/2413155687 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc1114d0 0x5562cc135520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaa250640 1 -- 172.21.15.114:0/2413155687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba40c6020 con 0x5562cc11f850 2023-11-04T01:37:00.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaaa51640 1 --2- 172.21.15.114:0/2413155687 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc1114d0 0x5562cc135520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:00.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7faba9a4f640 1 --2- 172.21.15.114:0/2413155687 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc11fc30 0x5562cc137110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:00.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaa250640 1 --2- 172.21.15.114:0/2413155687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11f850 0x5562cc110c10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fab94003bb0 tx=0x7fab94004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed0602da976dcc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fab897fa640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:37:00.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fab897fa640 1 -- 172.21.15.114:0/2413155687 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94014d60 con 0x5562cc11f850 2023-11-04T01:37:00.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fab897fa640 1 -- 172.21.15.114:0/2413155687 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab94016e30 con 0x5562cc11f850 2023-11-04T01:37:00.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaf046740 1 -- 172.21.15.114:0/2413155687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562cc00abf0 con 0x5562cc11f850 2023-11-04T01:37:00.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fab897fa640 1 -- 172.21.15.114:0/2413155687 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab94021410 con 0x5562cc11f850 2023-11-04T01:37:00.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaf046740 10 client.4887 fetch_fsmap learned FSMap version 9 2023-11-04T01:37:00.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.010+0000 7fabaf046740 1 -- 172.21.15.114:0/2413155687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5562cc05cf30 con 0x5562cc11f850 2023-11-04T01:37:00.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.011+0000 7fab897fa640 1 -- 172.21.15.114:0/2413155687 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5562cc00abf0 con 0x5562cc11f850 2023-11-04T01:37:00.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.011+0000 7fab897fa640 1 -- 172.21.15.114:0/2413155687 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fab94029350 con 0x5562cc11f850 2023-11-04T01:37:00.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.011+0000 7fabaf046740 10 client.4887 fetch_fsmap finished waiting for FSMap version 9 2023-11-04T01:37:00.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.011+0000 7fabaf046740 10 client.4887 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:37:00.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.011+0000 7fabaf046740 20 client.4887 populate_metadata read hostname 'smithi114' 2023-11-04T01:37:00.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.011+0000 7fabaf046740 1 --2- 172.21.15.114:0/2413155687 >> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] conn(0x5562cc111b70 0x5562cc124620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.011+0000 7fabaf046740 4 client.4887 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:37:00.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.011+0000 7fabaf046740 1 -- 172.21.15.114:0/2413155687 --> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562cc057890 con 0x5562cc111b70 2023-11-04T01:37:00.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.011+0000 7faba9a4f640 1 --2- 172.21.15.114:0/2413155687 >> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] conn(0x5562cc111b70 0x5562cc124620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.011+0000 7fab897fa640 10 client.4887 ms_handle_connect on v2:172.21.15.141:6833/4231924170 2023-11-04T01:37:00.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.011+0000 7faba9a4f640 1 --2- 172.21.15.114:0/2413155687 >> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] conn(0x5562cc111b70 0x5562cc124620 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7741da91abe3a6c7 server_cookie=8dda0f0e16bee118 in_seq=0 out_seq=0 2023-11-04T01:37:00.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.012+0000 7fab897fa640 1 -- 172.21.15.114:0/2413155687 <== mds.0 v2:172.21.15.141:6833/4231924170 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5562cc057890 con 0x5562cc111b70 2023-11-04T01:37:00.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.012+0000 7fab897fa640 10 client.4887 handle_command_reply: tid=0 2023-11-04T01:37:00.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.012+0000 7fabaf046740 1 client.4887 shutdown 2023-11-04T01:37:00.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.012+0000 7fabaf046740 1 -- 172.21.15.114:0/2413155687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11f850 msgr2=0x5562cc110c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.012+0000 7fabaf046740 1 --2- 172.21.15.114:0/2413155687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11f850 0x5562cc110c10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fab94003bb0 tx=0x7fab94004ab0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.012+0000 7fabaf046740 1 -- 172.21.15.114:0/2413155687 shutdown_connections 2023-11-04T01:37:00.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.012+0000 7fabaf046740 1 --2- 172.21.15.114:0/2413155687 >> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] conn(0x5562cc111b70 0x5562cc124620 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.012+0000 7fabaf046740 1 --2- 172.21.15.114:0/2413155687 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc1114d0 0x5562cc135520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.012+0000 7fabaf046740 1 --2- 172.21.15.114:0/2413155687 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc11fc30 0x5562cc137110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.012+0000 7fabaf046740 1 --2- 172.21.15.114:0/2413155687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11f850 0x5562cc110c10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.012+0000 7fab897fa640 0 client.4887 ms_handle_reset on v2:172.21.15.141:6833/4231924170 2023-11-04T01:37:00.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.012+0000 7fabaf046740 1 -- 172.21.15.114:0/2413155687 >> 172.21.15.114:0/2413155687 conn(0x5562cc0f2c90 msgr2=0x5562cc0f6700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.012+0000 7fabaf046740 1 -- 172.21.15.114:0/2413155687 shutdown_connections 2023-11-04T01:37:00.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.012+0000 7fabaf046740 1 -- 172.21.15.114:0/2413155687 wait complete. 2023-11-04T01:37:00.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.012+0000 7fabaf046740 20 client.4887 trim_cache size 0 max 16384 2023-11-04T01:37:00.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.028+0000 7fabaf046740 1 Processor -- start 2023-11-04T01:37:00.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.028+0000 7fabaf046740 1 -- start start 2023-11-04T01:37:00.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.028+0000 7fabaf046740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc1114d0 0x5562cc138cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.028+0000 7fabaf046740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11f850 0x5562cc137010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.028+0000 7fabaf046740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc11fc30 0x5562cc14fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.028+0000 7fabaf046740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cbfde280 con 0x5562cc11f850 2023-11-04T01:37:00.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.028+0000 7fabaf046740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cc139a50 con 0x5562cc1114d0 2023-11-04T01:37:00.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.028+0000 7fabaf046740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562cc0f1860 con 0x5562cc11fc30 2023-11-04T01:37:00.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.029+0000 7faba9a4f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11f850 0x5562cc137010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.029+0000 7faba9a4f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11f850 0x5562cc137010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45230/0 (socket says 172.21.15.114:45230) 2023-11-04T01:37:00.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.029+0000 7faba9a4f640 1 -- 172.21.15.114:0/751005089 learned_addr learned my addr 172.21.15.114:0/751005089 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:00.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.029+0000 7fabaa250640 1 --2- 172.21.15.114:0/751005089 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc1114d0 0x5562cc138cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.029+0000 7fabaaa51640 1 --2- 172.21.15.114:0/751005089 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc11fc30 0x5562cc14fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.029+0000 7faba9a4f640 1 -- 172.21.15.114:0/751005089 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc11fc30 msgr2=0x5562cc14fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.029+0000 7faba9a4f640 1 --2- 172.21.15.114:0/751005089 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc11fc30 0x5562cc14fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.029+0000 7faba9a4f640 1 -- 172.21.15.114:0/751005089 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc1114d0 msgr2=0x5562cc138cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.029+0000 7faba9a4f640 1 --2- 172.21.15.114:0/751005089 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc1114d0 0x5562cc138cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.029+0000 7faba9a4f640 1 -- 172.21.15.114:0/751005089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562cbffad10 con 0x5562cc11f850 2023-11-04T01:37:00.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.029+0000 7faba9a4f640 1 --2- 172.21.15.114:0/751005089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11f850 0x5562cc137010 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fab98006f40 tx=0x7fab98090000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72d03b9fbef1171 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.029+0000 7faba0ff9640 1 -- 172.21.15.114:0/751005089 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98082d10 con 0x5562cc11f850 2023-11-04T01:37:00.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.029+0000 7faba0ff9640 1 -- 172.21.15.114:0/751005089 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab98092170 con 0x5562cc11f850 2023-11-04T01:37:00.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.029+0000 7faba0ff9640 1 -- 172.21.15.114:0/751005089 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab980922e0 con 0x5562cc11f850 2023-11-04T01:37:00.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.029+0000 7fabaf046740 1 -- 172.21.15.114:0/751005089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11f850 msgr2=0x5562cc137010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.030+0000 7fabaf046740 1 --2- 172.21.15.114:0/751005089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11f850 0x5562cc137010 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fab98006f40 tx=0x7fab98090000 comp rx=0 tx=0).stop 2023-11-04T01:37:00.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.030+0000 7fabaf046740 1 -- 172.21.15.114:0/751005089 shutdown_connections 2023-11-04T01:37:00.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.030+0000 7fabaf046740 1 --2- 172.21.15.114:0/751005089 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc11fc30 0x5562cc14fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.030+0000 7fabaf046740 1 --2- 172.21.15.114:0/751005089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11f850 0x5562cc137010 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.030+0000 7fabaf046740 1 --2- 172.21.15.114:0/751005089 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc1114d0 0x5562cc138cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.030+0000 7fabaf046740 1 -- 172.21.15.114:0/751005089 >> 172.21.15.114:0/751005089 conn(0x5562cc0f2c90 msgr2=0x5562cc0edc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.030+0000 7fabaf046740 1 -- 172.21.15.114:0/751005089 shutdown_connections 2023-11-04T01:37:00.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.030+0000 7fabaf046740 1 -- 172.21.15.114:0/751005089 wait complete. 2023-11-04T01:37:00.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.030+0000 7fabaf046740 1 -- start start 2023-11-04T01:37:00.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.030+0000 7fabaf046740 1 Processor -- start 2023-11-04T01:37:00.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.031+0000 7fabaf046740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc1114d0 0x5562cc138cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.031+0000 7fabaf046740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc11f850 0x5562cc15ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.031+0000 7fabaf046740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11fc30 0x5562cc0f7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.031+0000 7fabaf046740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cc0ee060 con 0x5562cc11fc30 2023-11-04T01:37:00.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.031+0000 7fabaf046740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cc134de0 con 0x5562cc11f850 2023-11-04T01:37:00.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.031+0000 7fabaf046740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562cc15f710 con 0x5562cc1114d0 2023-11-04T01:37:00.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.031+0000 7fabaf046740 10 client.0 _ll_register_callbacks cb 0x7fab98076d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:37:00.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.031+0000 7fabaaa51640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11fc30 0x5562cc0f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.031+0000 7fabaaa51640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11fc30 0x5562cc0f7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45244/0 (socket says 172.21.15.114:45244) 2023-11-04T01:37:00.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.031+0000 7fabaaa51640 1 -- 172.21.15.114:0/1525406325 learned_addr learned my addr 172.21.15.114:0/1525406325 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:00.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.031+0000 7fabaa250640 1 --2- 172.21.15.114:0/1525406325 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc1114d0 0x5562cc138cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.031+0000 7faba9a4f640 1 --2- 172.21.15.114:0/1525406325 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc11f850 0x5562cc15ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.031+0000 7fabaaa51640 1 -- 172.21.15.114:0/1525406325 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc1114d0 msgr2=0x5562cc138cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.031+0000 7fabaaa51640 1 --2- 172.21.15.114:0/1525406325 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc1114d0 0x5562cc138cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fabaaa51640 1 -- 172.21.15.114:0/1525406325 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc11f850 msgr2=0x5562cc15ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fabaaa51640 1 --2- 172.21.15.114:0/1525406325 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc11f850 0x5562cc15ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fabaaa51640 1 -- 172.21.15.114:0/1525406325 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562cc021ca0 con 0x5562cc11fc30 2023-11-04T01:37:00.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fabaaa51640 1 --2- 172.21.15.114:0/1525406325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11fc30 0x5562cc0f7720 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fab9c011ba0 tx=0x7fab9c0136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de26e5161e8ee8c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fab897fa640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:37:00.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fab897fa640 1 -- 172.21.15.114:0/1525406325 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c013ee0 con 0x5562cc11fc30 2023-11-04T01:37:00.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fab897fa640 1 -- 172.21.15.114:0/1525406325 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab9c004220 con 0x5562cc11fc30 2023-11-04T01:37:00.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fabaf046740 1 -- 172.21.15.114:0/1525406325 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab98078d30 con 0x5562cc11fc30 2023-11-04T01:37:00.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fab897fa640 1 -- 172.21.15.114:0/1525406325 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab9c011ea0 con 0x5562cc11fc30 2023-11-04T01:37:00.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fabaf046740 10 client.4893 fetch_fsmap learned FSMap version 9 2023-11-04T01:37:00.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fabaf046740 1 -- 172.21.15.114:0/1525406325 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5562cc020500 con 0x5562cc11fc30 2023-11-04T01:37:00.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fab897fa640 1 -- 172.21.15.114:0/1525406325 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab98078d30 con 0x5562cc11fc30 2023-11-04T01:37:00.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fab897fa640 1 -- 172.21.15.114:0/1525406325 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fab9c003610 con 0x5562cc11fc30 2023-11-04T01:37:00.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fabaf046740 10 client.4893 fetch_fsmap finished waiting for FSMap version 9 2023-11-04T01:37:00.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fabaf046740 10 client.4893 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:37:00.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fabaf046740 20 client.4893 populate_metadata read hostname 'smithi114' 2023-11-04T01:37:00.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fabaf046740 1 --2- 172.21.15.114:0/1525406325 >> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] conn(0x5562cc0f7c60 0x5562cc132f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fabaf046740 4 client.4893 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:37:00.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fabaf046740 1 -- 172.21.15.114:0/1525406325 --> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5562cc0575b0 con 0x5562cc0f7c60 2023-11-04T01:37:00.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.032+0000 7fabaa250640 1 --2- 172.21.15.114:0/1525406325 >> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] conn(0x5562cc0f7c60 0x5562cc132f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fab897fa640 10 client.4893 ms_handle_connect on v2:172.21.15.141:6833/4231924170 2023-11-04T01:37:00.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fabaa250640 1 --2- 172.21.15.114:0/1525406325 >> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] conn(0x5562cc0f7c60 0x5562cc132f70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce32f4d1ae055d0e server_cookie=bd6d9a36d79b8865 in_seq=0 out_seq=0 2023-11-04T01:37:00.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fab897fa640 1 -- 172.21.15.114:0/1525406325 <== mds.0 v2:172.21.15.141:6833/4231924170 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5562cc0575b0 con 0x5562cc0f7c60 2023-11-04T01:37:00.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fab897fa640 10 client.4893 handle_command_reply: tid=0 2023-11-04T01:37:00.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fabaf046740 1 client.4893 shutdown 2023-11-04T01:37:00.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fabaf046740 1 -- 172.21.15.114:0/1525406325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11fc30 msgr2=0x5562cc0f7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fabaf046740 1 --2- 172.21.15.114:0/1525406325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11fc30 0x5562cc0f7720 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fab9c011ba0 tx=0x7fab9c0136b0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fabaf046740 1 -- 172.21.15.114:0/1525406325 shutdown_connections 2023-11-04T01:37:00.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fabaf046740 1 --2- 172.21.15.114:0/1525406325 >> [v2:172.21.15.141:6833/4231924170,v1:172.21.15.141:6835/4231924170] conn(0x5562cc0f7c60 0x5562cc132f70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fab897fa640 0 client.4893 ms_handle_reset on v2:172.21.15.141:6833/4231924170 2023-11-04T01:37:00.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fabaf046740 1 --2- 172.21.15.114:0/1525406325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562cc11fc30 0x5562cc0f7720 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fabaf046740 1 --2- 172.21.15.114:0/1525406325 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5562cc11f850 0x5562cc15ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fabaf046740 1 --2- 172.21.15.114:0/1525406325 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5562cc1114d0 0x5562cc138cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fabaf046740 1 -- 172.21.15.114:0/1525406325 >> 172.21.15.114:0/1525406325 conn(0x5562cc0f2c90 msgr2=0x5562cc0f6540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fabaf046740 1 -- 172.21.15.114:0/1525406325 shutdown_connections 2023-11-04T01:37:00.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fabaf046740 1 -- 172.21.15.114:0/1525406325 wait complete. 2023-11-04T01:37:00.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.033+0000 7fabaf046740 20 client.4893 trim_cache size 0 max 16384 2023-11-04T01:37:00.043 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:37:00.043 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:37:00.043 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-11-04T01:37:00.043 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4305, 2023-11-04T01:37:00.043 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:37:00.043 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:37:00.043 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:37:00.044 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 29.466093648000001, 2023-11-04T01:37:00.044 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 9, 2023-11-04T01:37:00.044 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 24, 2023-11-04T01:37:00.044 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 24, 2023-11-04T01:37:00.044 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 36.463545617000001 2023-11-04T01:37:00.044 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:37:00.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.034+0000 7fabac4b4640 1 -- 172.21.15.114:0/2645790352 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab9006ae70 msgr2=0x7fab9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.034+0000 7fabac4b4640 1 --2- 172.21.15.114:0/2645790352 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab9006ae70 0x7fab9006d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fab940099c0 tx=0x7fab94003990 comp rx=0 tx=0).stop 2023-11-04T01:37:00.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.034+0000 7fabac4b4640 1 -- 172.21.15.114:0/2645790352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faba40b2b60 msgr2=0x7faba41f2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.034+0000 7fabac4b4640 1 --2- 172.21.15.114:0/2645790352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faba40b2b60 0x7faba41f2fe0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fab9802b950 tx=0x7fab980046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.034+0000 7fabac4b4640 1 -- 172.21.15.114:0/2645790352 shutdown_connections 2023-11-04T01:37:00.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.034+0000 7fabac4b4640 1 --2- 172.21.15.114:0/2645790352 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab9006ae70 0x7fab9006d330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.034+0000 7fabac4b4640 1 --2- 172.21.15.114:0/2645790352 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faba4160430 0x7faba415c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.034+0000 7fabac4b4640 1 --2- 172.21.15.114:0/2645790352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faba40b2b60 0x7faba41f2fe0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.034+0000 7fabac4b4640 1 --2- 172.21.15.114:0/2645790352 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faba406c1d0 0x7faba40c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.034+0000 7fabac4b4640 1 -- 172.21.15.114:0/2645790352 >> 172.21.15.114:0/2645790352 conn(0x7faba406ea20 msgr2=0x7faba40cbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.034+0000 7fabac4b4640 1 -- 172.21.15.114:0/2645790352 shutdown_connections 2023-11-04T01:37:00.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.034+0000 7fabac4b4640 1 -- 172.21.15.114:0/2645790352 wait complete. 2023-11-04T01:37:00.047 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-04T01:37:00.058 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-04T01:37:00.058 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-04T01:37:00.058 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-04T01:37:00.058 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:37:00.058 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:00.058 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-04T01:37:00.058 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:37:00.059 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-04T01:37:00.059 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-04T01:37:00.059 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:37:00.059 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-04T01:37:00.059 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-04T01:37:00.059 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:37:00.059 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-04T01:37:00.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:00.060 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list 2023-11-04T01:37:00.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:00.078 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link delete ceph-brx 2023-11-04T01:37:00.151 INFO:teuthology.orchestra.run.smithi141.stderr:Cannot find device "ceph-brx" 2023-11-04T01:37:00.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:37:00.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:00.153 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-04T01:37:00.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-04T01:37:00.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:00.169 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:37:00.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:00.237 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2023-11-04T01:37:00.333 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-04T01:37:00.334 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:37:00.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.432+0000 7f08f5c61640 1 Processor -- start 2023-11-04T01:37:00.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.432+0000 7f08f5c61640 1 -- start start 2023-11-04T01:37:00.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.432+0000 7f08f5c61640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f08f00cda60 0x7f08f00ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.432+0000 7f08f5c61640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f0070d40 0x7f08f006c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.432+0000 7f08f5c61640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f00cc990 con 0x7f08f00b0cd0 2023-11-04T01:37:00.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.432+0000 7f08f5c61640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f00ccc70 con 0x7f08f00cda60 2023-11-04T01:37:00.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.432+0000 7f08f5c61640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f00c9ce0 con 0x7f08f0070d40 2023-11-04T01:37:00.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.433+0000 7f08ef7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f08f00cda60 0x7f08f00ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.433+0000 7f08ef7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f08f00cda60 0x7f08f00ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45248/0 (socket says 172.21.15.114:45248) 2023-11-04T01:37:00.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.433+0000 7f08ef7fe640 1 -- 172.21.15.114:0/567064329 learned_addr learned my addr 172.21.15.114:0/567064329 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:00.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.433+0000 7f08effff640 1 --2- 172.21.15.114:0/567064329 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f0070d40 0x7f08f006c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.433+0000 7f08ef7fe640 1 -- 172.21.15.114:0/567064329 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f0070d40 msgr2=0x7f08f006c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.433+0000 7f08ef7fe640 1 --2- 172.21.15.114:0/567064329 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f0070d40 0x7f08f006c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.433+0000 7f08ef7fe640 1 -- 172.21.15.114:0/567064329 >> v1:172.21.15.141:6789/0 conn(0x7f08f00b0cd0 legacy=0x7f08f0070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:00.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.433+0000 7f08ef7fe640 1 -- 172.21.15.114:0/567064329 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00c9fc0 con 0x7f08f00cda60 2023-11-04T01:37:00.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.434+0000 7f08ef7fe640 1 --2- 172.21.15.114:0/567064329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f00cda60 0x7f08f00ca7a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f08e000bb00 tx=0x7f08e002dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc51c642c8528fc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.434+0000 7f08eeffd640 1 -- 172.21.15.114:0/567064329 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e002ec50 con 0x7f08f00cda60 2023-11-04T01:37:00.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.434+0000 7f08eeffd640 1 -- 172.21.15.114:0/567064329 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e0032070 con 0x7f08f00cda60 2023-11-04T01:37:00.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.434+0000 7f08eeffd640 1 -- 172.21.15.114:0/567064329 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0038400 con 0x7f08f00cda60 2023-11-04T01:37:00.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.435+0000 7f08f5c61640 1 -- 172.21.15.114:0/567064329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f00cda60 msgr2=0x7f08f00ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.435+0000 7f08f5c61640 1 --2- 172.21.15.114:0/567064329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f00cda60 0x7f08f00ca7a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f08e000bb00 tx=0x7f08e002dea0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.435+0000 7f08f5c61640 1 -- 172.21.15.114:0/567064329 shutdown_connections 2023-11-04T01:37:00.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.435+0000 7f08f5c61640 1 --2- 172.21.15.114:0/567064329 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f0070d40 0x7f08f006c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.435+0000 7f08f5c61640 1 --2- 172.21.15.114:0/567064329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f00cda60 0x7f08f00ca7a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.435+0000 7f08f5c61640 1 -- 172.21.15.114:0/567064329 >> 172.21.15.114:0/567064329 conn(0x7f08f00ce950 msgr2=0x7f08f00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.435+0000 7f08f5c61640 1 -- 172.21.15.114:0/567064329 shutdown_connections 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.435+0000 7f08f5c61640 1 -- 172.21.15.114:0/567064329 wait complete. 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.436+0000 7f08f5c61640 1 Processor -- start 2023-11-04T01:37:00.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.436+0000 7f08f5c61640 1 -- start start 2023-11-04T01:37:00.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08f5c61640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f0070d40 0x7f08f014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08f5c61640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08f00b0cd0 0x7f08f015c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08f5c61640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f00cda60 0x7f08f015c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08f5c61640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f00a7540 con 0x7f08f0070d40 2023-11-04T01:37:00.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08f5c61640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f00b2fb0 con 0x7f08f00b0cd0 2023-11-04T01:37:00.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08f5c61640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f00c6570 con 0x7f08f00cda60 2023-11-04T01:37:00.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08ef7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f0070d40 0x7f08f014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08ef7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f0070d40 0x7f08f014ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45254/0 (socket says 172.21.15.114:45254) 2023-11-04T01:37:00.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08ef7fe640 1 -- 172.21.15.114:0/3763549614 learned_addr learned my addr 172.21.15.114:0/3763549614 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:00.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08e7fff640 1 --2- 172.21.15.114:0/3763549614 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08f00b0cd0 0x7f08f015c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08effff640 1 --2- 172.21.15.114:0/3763549614 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f00cda60 0x7f08f015c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08ef7fe640 1 -- 172.21.15.114:0/3763549614 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f00cda60 msgr2=0x7f08f015c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08ef7fe640 1 --2- 172.21.15.114:0/3763549614 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f00cda60 0x7f08f015c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08ef7fe640 1 -- 172.21.15.114:0/3763549614 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08f00b0cd0 msgr2=0x7f08f015c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08ef7fe640 1 --2- 172.21.15.114:0/3763549614 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08f00b0cd0 0x7f08f015c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08ef7fe640 1 -- 172.21.15.114:0/3763549614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e000b760 con 0x7f08f0070d40 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08ef7fe640 1 --2- 172.21.15.114:0/3763549614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f0070d40 0x7f08f014ae40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f08e000bb00 tx=0x7f08e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08ecff9640 1 -- 172.21.15.114:0/3763549614 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0043470 con 0x7f08f0070d40 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08ecff9640 1 -- 172.21.15.114:0/3763549614 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e00435d0 con 0x7f08f0070d40 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08f5c61640 1 -- 172.21.15.114:0/3763549614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f00c6850 con 0x7f08f0070d40 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08ecff9640 1 -- 172.21.15.114:0/3763549614 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0043980 con 0x7f08f0070d40 2023-11-04T01:37:00.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.437+0000 7f08f5c61640 1 -- 172.21.15.114:0/3763549614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f00c6e10 con 0x7f08f0070d40 2023-11-04T01:37:00.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.438+0000 7f08f5c61640 1 -- 172.21.15.114:0/3763549614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f0074290 con 0x7f08f0070d40 2023-11-04T01:37:00.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.439+0000 7f08ecff9640 1 -- 172.21.15.114:0/3763549614 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08e0043ae0 con 0x7f08f0070d40 2023-11-04T01:37:00.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.439+0000 7f08ecff9640 1 --2- 172.21.15.114:0/3763549614 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08d006ae70 0x7f08d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:00.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.439+0000 7f08ecff9640 1 -- 172.21.15.114:0/3763549614 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f08e00ae7f0 con 0x7f08f0070d40 2023-11-04T01:37:00.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.439+0000 7f08e7fff640 1 --2- 172.21.15.114:0/3763549614 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08d006ae70 0x7f08d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:00.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.440+0000 7f08e7fff640 1 --2- 172.21.15.114:0/3763549614 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08d006ae70 0x7f08d006d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f08f01e2590 tx=0x7f08d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:00.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.443+0000 7f08ecff9640 1 -- 172.21.15.114:0/3763549614 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08e00794a0 con 0x7f08f0070d40 2023-11-04T01:37:00.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.645+0000 7f08f5c61640 1 -- 172.21.15.114:0/3763549614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f08f00b48d0 con 0x7f08f0070d40 2023-11-04T01:37:00.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.645+0000 7f08ecff9640 1 -- 172.21.15.114:0/3763549614 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f08e0047070 con 0x7f08f0070d40 2023-11-04T01:37:00.647 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:37:00.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.647+0000 7f08f5c61640 1 -- 172.21.15.114:0/3763549614 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08d006ae70 msgr2=0x7f08d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.647+0000 7f08f5c61640 1 --2- 172.21.15.114:0/3763549614 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08d006ae70 0x7f08d006d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f08f01e2590 tx=0x7f08d8009040 comp rx=0 tx=0).stop 2023-11-04T01:37:00.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.647+0000 7f08f5c61640 1 -- 172.21.15.114:0/3763549614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f0070d40 msgr2=0x7f08f014ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:00.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.647+0000 7f08f5c61640 1 --2- 172.21.15.114:0/3763549614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f0070d40 0x7f08f014ae40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f08e000bb00 tx=0x7f08e00046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.647+0000 7f08f5c61640 1 -- 172.21.15.114:0/3763549614 shutdown_connections 2023-11-04T01:37:00.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.647+0000 7f08f5c61640 1 --2- 172.21.15.114:0/3763549614 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f00cda60 0x7f08f015c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.647+0000 7f08f5c61640 1 --2- 172.21.15.114:0/3763549614 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08d006ae70 0x7f08d006d330 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.647+0000 7f08f5c61640 1 --2- 172.21.15.114:0/3763549614 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08f00b0cd0 0x7f08f015c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.647+0000 7f08f5c61640 1 --2- 172.21.15.114:0/3763549614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f0070d40 0x7f08f014ae40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:00.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.647+0000 7f08f5c61640 1 -- 172.21.15.114:0/3763549614 >> 172.21.15.114:0/3763549614 conn(0x7f08f00ce950 msgr2=0x7f08f0158d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:00.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.647+0000 7f08f5c61640 1 -- 172.21.15.114:0/3763549614 shutdown_connections 2023-11-04T01:37:00.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:00.647+0000 7f08f5c61640 1 -- 172.21.15.114:0/3763549614 wait complete. 2023-11-04T01:37:00.659 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:37:00.660 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:37:00.660 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-11-04T01:37:00.660 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:37:00.660 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:00.660 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:37:00.660 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:37:00.660 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:37:00.660 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:37:00.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:00.660 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-11-04T01:37:00.675 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:37:00.675 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:37:00.675 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:37:00.676 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:00.676 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-04T01:37:00.676 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:00.676 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:00.676 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-11-04T01:37:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:00.676 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:00.676 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-11-04T01:37:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:00.676 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:37:00.677 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:00.677 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:37:00.677 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42455sec preferred_lft 42455sec 2023-11-04T01:37:00.677 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-11-04T01:37:00.677 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:00.677 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T01:37:00.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:00.677 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:37:00.677 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:37:00.678 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2023-11-04T01:37:00.678 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2023-11-04T01:37:00.678 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2023-11-04T01:37:00.678 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T01:37:00.678 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:37:00.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:00.783 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:37:00.809 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-11-04T01:37:00.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:00.810 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-11-04T01:37:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-11-04T01:37:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:37:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:37:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:37:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:37:00.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:00.868 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:37:00.868 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:37:00.868 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:37:00.868 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:37:00.868 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:37:00.868 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:37:00.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:00.964 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-04T01:37:00.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:00.979 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2023-11-04T01:37:01.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:01.033 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:37:01.033 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:37:01.033 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:01.034 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-04T01:37:01.034 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:37:01.115 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-04T01:37:01.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:01.116 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:37:01.116 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:37:01.116 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-04T01:37:01.116 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T01:37:01.116 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-04T01:37:01.116 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-04T01:37:01.116 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-04T01:37:01.116 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:37:01.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:01.241 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:37:01.241 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:37:01.242 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-11-04T01:37:01.242 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T01:37:01.242 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:37:01.283 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:37:01.283 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:37:01.283 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:01.337 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:37:01.338 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:37:01.338 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:01.392 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:37:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:37:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:37:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:37:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:37:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:37:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:37:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:37:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:37:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:37:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:37:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:37:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:37:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:37:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:37:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:37:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:37:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:37:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:37:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:37:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:01.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:01.450 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:37:01.502 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:37:01.502 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:37:01.545 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:01.559 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:37:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:37:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:37:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:37:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:37:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:37:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:37:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:37:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:37:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:37:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:37:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:37:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:37:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:37:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:37:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:37:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:37:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:37:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:37:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:37:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:01.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:01.562 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:37:01.637 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:37:01.635+0000 7efd1ab87480 -1 init, newargv = 0x55c218b5ce20 newargc=15 2023-11-04T01:37:01.637 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[99023]: starting ceph client 2023-11-04T01:37:01.641 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[99023]: starting fuse 2023-11-04T01:37:02.716 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:02.736 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:37:02.737 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:37:02.737 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:37:02.737 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:37:02.737 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:37:02.737 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:37:02.737 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:37:02.737 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:37:02.737 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:37:02.737 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:37:02.737 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:37:02.737 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:37:02.737 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:02.738 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:37:02.738 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:37:02.738 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:37:02.738 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:37:02.738 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:02.738 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:02.738 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:37:02.738 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:02.738 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:02.738 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:02.738 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:37:02.739 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:37:02.739 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:02.739 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:02.739 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:02.739 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:02.739 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:37:02.739 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:02.739 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:02.739 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:02.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:02.740 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:37:02.794 INFO:teuthology.orchestra.run.smithi114.stdout:41 2023-11-04T01:37:02.794 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:37:02.794 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:37:02.795 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2023-11-04T01:37:02.795 DEBUG:teuthology.orchestra.run.smithi114:> import re 2023-11-04T01:37:02.795 DEBUG:teuthology.orchestra.run.smithi114:> import os 2023-11-04T01:37:02.795 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2023-11-04T01:37:02.795 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:37:02.795 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2023-11-04T01:37:02.795 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:37:02.795 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2023-11-04T01:37:02.795 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:37:02.795 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:37:02.795 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2023-11-04T01:37:02.795 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2023-11-04T01:37:02.796 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2023-11-04T01:37:02.796 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2023-11-04T01:37:02.796 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:37:02.796 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2023-11-04T01:37:02.796 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:37:02.796 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:37:02.796 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:37:02.796 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2023-11-04T01:37:02.796 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2023-11-04T01:37:02.796 DEBUG:teuthology.orchestra.run.smithi114:> return f 2023-11-04T01:37:02.796 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:37:02.796 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:37:02.797 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.0")) 2023-11-04T01:37:02.797 DEBUG:teuthology.orchestra.run.smithi114:> ' 2023-11-04T01:37:02.922 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.0.99023.asok 2023-11-04T01:37:02.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:02.933 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.99023.asok 2023-11-04T01:37:02.933 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:02.933 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.99023.asok status 2023-11-04T01:37:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:03.104 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:37:03.105 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2023-11-04T01:37:03.105 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:37:03.105 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:37:03.105 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "0", 2023-11-04T01:37:03.105 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2023-11-04T01:37:03.105 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:37:03.105 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "99023", 2023-11-04T01:37:03.105 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2023-11-04T01:37:03.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:03.105 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2023-11-04T01:37:03.105 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2023-11-04T01:37:03.106 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4905, 2023-11-04T01:37:03.106 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2023-11-04T01:37:03.106 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2023-11-04T01:37:03.106 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2023-11-04T01:37:03.106 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 4905 2023-11-04T01:37:03.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:03.106 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:37:03.106 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:37:03.106 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:37:03.106 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 1083450616 2023-11-04T01:37:03.106 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:03.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:03.106 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:37:03.107 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:37:03.107 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:37:03.107 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 1083450616 2023-11-04T01:37:03.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:03.107 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.4905 192.168.0.1:0/1083450616", 2023-11-04T01:37:03.107 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "192.168.0.1:0/1083450616", 2023-11-04T01:37:03.107 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2023-11-04T01:37:03.107 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 9, 2023-11-04T01:37:03.107 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 24, 2023-11-04T01:37:03.107 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:37:03.107 INFO:teuthology.orchestra.run.smithi114.stdout: "blocklisted": false, 2023-11-04T01:37:03.107 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2023-11-04T01:37:03.107 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:37:03.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:03.118 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:37:03.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.216+0000 7f8ba5aec640 1 Processor -- start 2023-11-04T01:37:03.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.216+0000 7f8ba5aec640 1 -- start start 2023-11-04T01:37:03.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.217+0000 7f8ba5aec640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ba015ce70 0x7f8ba006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.217+0000 7f8ba5aec640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8ba015d250 0x7f8ba00c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.217+0000 7f8ba5aec640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8ba00c9d70 0x7f8ba00ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.217+0000 7f8ba5aec640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba00cdc10 con 0x7f8ba015d250 2023-11-04T01:37:03.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.217+0000 7f8ba5aec640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba006a120 con 0x7f8ba00c9d70 2023-11-04T01:37:03.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.217+0000 7f8ba5aec640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba006def0 con 0x7f8ba015ce70 2023-11-04T01:37:03.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.217+0000 7f8b9effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8ba015d250 0x7f8ba00c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.217+0000 7f8b9effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8ba015d250 0x7f8ba00c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45264/0 (socket says 172.21.15.114:45264) 2023-11-04T01:37:03.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.217+0000 7f8b9effd640 1 -- 172.21.15.114:0/926027707 learned_addr learned my addr 172.21.15.114:0/926027707 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:03.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.217+0000 7f8b9ffff640 1 --2- 172.21.15.114:0/926027707 >> v2:172.21.15.141:3300/0 conn(0x7f8ba00c9d70 0x7f8ba00ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.217+0000 7f8b9f7fe640 1 --2- 172.21.15.114:0/926027707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ba015ce70 0x7f8ba006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.218+0000 7f8b9effd640 1 -- 172.21.15.114:0/926027707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ba015ce70 msgr2=0x7f8ba006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:03.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.218+0000 7f8b9effd640 1 --2- 172.21.15.114:0/926027707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ba015ce70 0x7f8ba006d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.218+0000 7f8b9effd640 1 -- 172.21.15.114:0/926027707 >> v2:172.21.15.141:3300/0 conn(0x7f8ba00c9d70 msgr2=0x7f8ba00ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:03.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.218+0000 7f8b9effd640 1 --2- 172.21.15.114:0/926027707 >> v2:172.21.15.141:3300/0 conn(0x7f8ba00c9d70 0x7f8ba00ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.218+0000 7f8b9effd640 1 -- 172.21.15.114:0/926027707 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba006a370 con 0x7f8ba015d250 2023-11-04T01:37:03.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.218+0000 7f8b9effd640 1 --2- 172.21.15.114:0/926027707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba015d250 0x7f8ba00c9830 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0066630 tx=0x7f8b9402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed1903925617e63 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:03.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.218+0000 7f8b9e7fc640 1 -- 172.21.15.114:0/926027707 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b94031870 con 0x7f8ba015d250 2023-11-04T01:37:03.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.219+0000 7f8b9e7fc640 1 -- 172.21.15.114:0/926027707 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b940319d0 con 0x7f8ba015d250 2023-11-04T01:37:03.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.219+0000 7f8b9e7fc640 1 -- 172.21.15.114:0/926027707 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b94031d60 con 0x7f8ba015d250 2023-11-04T01:37:03.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.219+0000 7f8ba5aec640 1 -- 172.21.15.114:0/926027707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba015d250 msgr2=0x7f8ba00c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.219+0000 7f8ba5aec640 1 --2- 172.21.15.114:0/926027707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba015d250 0x7f8ba00c9830 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0066630 tx=0x7f8b9402b910 comp rx=0 tx=0).stop 2023-11-04T01:37:03.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.219+0000 7f8ba5aec640 1 -- 172.21.15.114:0/926027707 shutdown_connections 2023-11-04T01:37:03.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.219+0000 7f8ba5aec640 1 --2- 172.21.15.114:0/926027707 >> v2:172.21.15.141:3300/0 conn(0x7f8ba00c9d70 0x7f8ba00ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.219+0000 7f8ba5aec640 1 --2- 172.21.15.114:0/926027707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba015d250 0x7f8ba00c9830 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.219+0000 7f8ba5aec640 1 --2- 172.21.15.114:0/926027707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ba015ce70 0x7f8ba006d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.219+0000 7f8ba5aec640 1 -- 172.21.15.114:0/926027707 >> 172.21.15.114:0/926027707 conn(0x7f8ba00b0cd0 msgr2=0x7f8ba00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:03.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.219+0000 7f8ba5aec640 1 -- 172.21.15.114:0/926027707 shutdown_connections 2023-11-04T01:37:03.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.219+0000 7f8ba5aec640 1 -- 172.21.15.114:0/926027707 wait complete. 2023-11-04T01:37:03.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.220+0000 7f8ba5aec640 1 Processor -- start 2023-11-04T01:37:03.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.220+0000 7f8ba5aec640 1 -- start start 2023-11-04T01:37:03.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.221+0000 7f8ba5aec640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba015ce70 0x7f8ba01f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.221+0000 7f8ba5aec640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ba015d250 0x7f8ba01f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.221+0000 7f8ba5aec640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ba01420f0 0x7f8ba0142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.221+0000 7f8ba5aec640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba01e72f0 con 0x7f8ba015ce70 2023-11-04T01:37:03.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.221+0000 7f8ba5aec640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba01e7780 con 0x7f8ba01420f0 2023-11-04T01:37:03.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.221+0000 7f8ba5aec640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba01e69c0 con 0x7f8ba015d250 2023-11-04T01:37:03.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.221+0000 7f8b9f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba015ce70 0x7f8ba01f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.221+0000 7f8b9f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba015ce70 0x7f8ba01f6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45268/0 (socket says 172.21.15.114:45268) 2023-11-04T01:37:03.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.221+0000 7f8b9f7fe640 1 -- 172.21.15.114:0/3527127787 learned_addr learned my addr 172.21.15.114:0/3527127787 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:03.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.221+0000 7f8b9effd640 1 --2- 172.21.15.114:0/3527127787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ba015d250 0x7f8ba01f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.221+0000 7f8b9ffff640 1 --2- 172.21.15.114:0/3527127787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ba01420f0 0x7f8ba0142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.222+0000 7f8b9f7fe640 1 -- 172.21.15.114:0/3527127787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ba015d250 msgr2=0x7f8ba01f69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.222+0000 7f8b9f7fe640 1 --2- 172.21.15.114:0/3527127787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ba015d250 0x7f8ba01f69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.222+0000 7f8b9f7fe640 1 -- 172.21.15.114:0/3527127787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ba01420f0 msgr2=0x7f8ba0142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.222+0000 7f8b9f7fe640 1 --2- 172.21.15.114:0/3527127787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ba01420f0 0x7f8ba0142580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.222+0000 7f8b9f7fe640 1 -- 172.21.15.114:0/3527127787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b940094d0 con 0x7f8ba015ce70 2023-11-04T01:37:03.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.222+0000 7f8b9ffff640 1 --2- 172.21.15.114:0/3527127787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ba01420f0 0x7f8ba0142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:03.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.222+0000 7f8b9f7fe640 1 --2- 172.21.15.114:0/3527127787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba015ce70 0x7f8ba01f6460 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000d800 tx=0x7f8b9000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:03.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.222+0000 7f8b87fff640 1 -- 172.21.15.114:0/3527127787 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9000b6c0 con 0x7f8ba015ce70 2023-11-04T01:37:03.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.222+0000 7f8b87fff640 1 -- 172.21.15.114:0/3527127787 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9000b820 con 0x7f8ba015ce70 2023-11-04T01:37:03.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.222+0000 7f8ba5aec640 1 -- 172.21.15.114:0/3527127787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba01e6ca0 con 0x7f8ba015ce70 2023-11-04T01:37:03.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.222+0000 7f8b87fff640 1 -- 172.21.15.114:0/3527127787 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9000bbb0 con 0x7f8ba015ce70 2023-11-04T01:37:03.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.222+0000 7f8ba5aec640 1 -- 172.21.15.114:0/3527127787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba01f6ee0 con 0x7f8ba015ce70 2023-11-04T01:37:03.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.223+0000 7f8ba5aec640 1 -- 172.21.15.114:0/3527127787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba0074290 con 0x7f8ba015ce70 2023-11-04T01:37:03.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.223+0000 7f8b87fff640 1 -- 172.21.15.114:0/3527127787 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b9000bd10 con 0x7f8ba015ce70 2023-11-04T01:37:03.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.224+0000 7f8b87fff640 1 --2- 172.21.15.114:0/3527127787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8b8c06ae70 0x7f8b8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:03.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.224+0000 7f8b9effd640 1 --2- 172.21.15.114:0/3527127787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8b8c06ae70 0x7f8b8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:03.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.224+0000 7f8b87fff640 1 -- 172.21.15.114:0/3527127787 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b90089ec0 con 0x7f8ba015ce70 2023-11-04T01:37:03.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.224+0000 7f8b9effd640 1 --2- 172.21.15.114:0/3527127787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8b8c06ae70 0x7f8b8c06d330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8b94036000 tx=0x7f8b9403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:03.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.228+0000 7f8b87fff640 1 -- 172.21.15.114:0/3527127787 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8b90054c80 con 0x7f8ba015ce70 2023-11-04T01:37:03.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.428+0000 7f8ba5aec640 1 -- 172.21.15.114:0/3527127787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8ba00c3310 con 0x7f8ba015ce70 2023-11-04T01:37:03.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.428+0000 7f8b87fff640 1 -- 172.21.15.114:0/3527127787 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8b900582a0 con 0x7f8ba015ce70 2023-11-04T01:37:03.430 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:37:03.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.430+0000 7f8ba5aec640 1 -- 172.21.15.114:0/3527127787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8b8c06ae70 msgr2=0x7f8b8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.430+0000 7f8ba5aec640 1 --2- 172.21.15.114:0/3527127787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8b8c06ae70 0x7f8b8c06d330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8b94036000 tx=0x7f8b9403c040 comp rx=0 tx=0).stop 2023-11-04T01:37:03.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.430+0000 7f8ba5aec640 1 -- 172.21.15.114:0/3527127787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba015ce70 msgr2=0x7f8ba01f6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:03.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.430+0000 7f8ba5aec640 1 --2- 172.21.15.114:0/3527127787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba015ce70 0x7f8ba01f6460 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000d800 tx=0x7f8b9000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.430+0000 7f8ba5aec640 1 -- 172.21.15.114:0/3527127787 shutdown_connections 2023-11-04T01:37:03.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.430+0000 7f8ba5aec640 1 --2- 172.21.15.114:0/3527127787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8b8c06ae70 0x7f8b8c06d330 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.430+0000 7f8ba5aec640 1 --2- 172.21.15.114:0/3527127787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ba01420f0 0x7f8ba0142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.430+0000 7f8ba5aec640 1 --2- 172.21.15.114:0/3527127787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ba015d250 0x7f8ba01f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.430+0000 7f8ba5aec640 1 --2- 172.21.15.114:0/3527127787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ba015ce70 0x7f8ba01f6460 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:03.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.430+0000 7f8ba5aec640 1 -- 172.21.15.114:0/3527127787 >> 172.21.15.114:0/3527127787 conn(0x7f8ba00b0cd0 msgr2=0x7f8ba015c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:03.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.430+0000 7f8ba5aec640 1 -- 172.21.15.114:0/3527127787 shutdown_connections 2023-11-04T01:37:03.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:03.430+0000 7f8ba5aec640 1 -- 172.21.15.114:0/3527127787 wait complete. 2023-11-04T01:37:03.443 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:37:03.443 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:37:03.443 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-11-04T01:37:03.443 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-04T01:37:03.443 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-04T01:37:03.443 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:37:03.443 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:37:03.443 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:37:03.443 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-04T01:37:03.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:03.444 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-11-04T01:37:03.459 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:37:03.459 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:37:03.459 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:37:03.459 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:03.459 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-04T01:37:03.459 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:03.459 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:03.459 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:03.459 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-11-04T01:37:03.460 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:03.460 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:03.460 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-11-04T01:37:03.460 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:03.460 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:03.460 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:37:03.460 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:03.460 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:37:03.460 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42452sec preferred_lft 42452sec 2023-11-04T01:37:03.460 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-11-04T01:37:03.460 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:03.460 INFO:teuthology.orchestra.run.smithi114.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:37:03.460 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether f6:4c:1e:67:08:5a brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:03.461 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:37:03.461 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:03.461 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9c8d:d6ff:fe6f:d555/64 scope link 2023-11-04T01:37:03.461 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:03.461 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:37:03.461 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether f6:4c:1e:67:08:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:03.461 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::f44c:1eff:fe67:85a/64 scope link 2023-11-04T01:37:03.461 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:03.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:03.461 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:37:03.525 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-11-04T01:37:03.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:03.526 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-11-04T01:37:03.584 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-11-04T01:37:03.584 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:37:03.584 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:37:03.584 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:37:03.584 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:37:03.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:03.585 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:37:03.585 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:37:03.585 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:37:03.585 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:37:03.585 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:37:03.585 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:37:03.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:03.680 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-04T01:37:03.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:37:03.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:03.695 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2023-11-04T01:37:03.749 INFO:teuthology.orchestra.run.smithi114.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-04T01:37:03.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:03.750 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:37:03.750 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:37:03.751 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:03.751 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-04T01:37:03.751 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:37:03.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:03.834 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-04T01:37:03.900 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:37:03.900 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:37:03.900 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:37:03.900 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:03.900 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-04T01:37:03.900 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:03.901 INFO:teuthology.orchestra.run.smithi114.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:37:03.901 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 62:2d:c0:53:ae:0e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:37:03.901 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:37:03.901 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:03.901 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::602d:c0ff:fe53:ae0e/64 scope link 2023-11-04T01:37:03.901 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:03.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:03.902 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-04T01:37:03.969 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:37:03.969 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:37:03.969 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:37:03.970 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:03.970 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-04T01:37:03.970 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:03.970 INFO:teuthology.orchestra.run.smithi114.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:37:03.970 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 62:2d:c0:53:ae:0e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:37:03.970 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:37:03.970 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:03.970 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::602d:c0ff:fe53:ae0e/64 scope link 2023-11-04T01:37:03.970 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:03.971 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-04T01:37:03.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:03.972 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:37:03.972 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:37:03.972 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-04T01:37:03.972 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-04T01:37:03.972 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-04T01:37:03.972 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-04T01:37:03.972 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-04T01:37:03.972 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:37:04.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:04.095 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:37:04.096 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:37:04.096 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.1 up 2023-11-04T01:37:04.096 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.1 master ceph-brx 2023-11-04T01:37:04.096 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:37:04.137 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-04T01:37:04.137 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:37:04.137 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-04T01:37:04.192 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-04T01:37:04.192 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:37:04.193 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-04T01:37:04.247 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:04.303 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:37:04.304 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:37:04.304 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:37:04.304 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:37:04.304 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:37:04.304 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:37:04.304 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:37:04.304 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:37:04.304 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:37:04.304 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:37:04.305 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:37:04.305 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:37:04.305 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:04.305 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:37:04.305 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:37:04.305 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:37:04.305 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:37:04.305 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:04.305 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:04.305 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:37:04.305 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:04.305 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:04.306 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:04.306 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:37:04.306 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:37:04.306 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:04.306 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:04.306 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:04.306 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:04.306 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:37:04.306 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:04.306 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:04.306 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:04.306 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:04.306 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:04.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:04.307 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:37:04.358 INFO:teuthology.orchestra.run.smithi114.stdout:41 2023-11-04T01:37:04.358 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-11-04T01:37:04.359 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-04T01:37:04.401 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:04.416 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:37:04.416 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:37:04.416 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:37:04.416 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:37:04.416 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:37:04.416 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:37:04.416 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:37:04.416 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:37:04.416 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:37:04.416 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:37:04.417 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:37:04.417 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:37:04.417 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:04.417 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:37:04.417 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:37:04.417 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:37:04.417 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:37:04.417 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:04.417 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:04.417 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:37:04.417 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:04.417 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:04.417 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:04.418 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:37:04.418 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:37:04.418 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:04.418 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:04.418 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:04.418 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:04.418 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:37:04.418 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:04.418 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:04.418 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:04.418 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:04.418 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:04.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:04.419 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:37:04.470 INFO:teuthology.orchestra.run.smithi114.stdout:41 2023-11-04T01:37:04.491 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi114.stderr:2023-11-04T01:37:04.489+0000 7f6778773480 -1 init, newargv = 0x55c455d0f830 newargc=15 2023-11-04T01:37:04.491 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi114.stderr:ceph-fuse[99516]: starting ceph client 2023-11-04T01:37:04.495 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi114.stderr:ceph-fuse[99516]: starting fuse 2023-11-04T01:37:05.573 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:05.593 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:37:05.593 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:37:05.593 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:37:05.593 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:37:05.593 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:37:05.593 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:37:05.593 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:37:05.593 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:37:05.593 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:37:05.593 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:37:05.594 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:37:05.594 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:37:05.594 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:05.594 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:37:05.594 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:37:05.594 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:37:05.594 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:37:05.594 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:05.594 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:05.594 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:37:05.594 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:05.594 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:05.595 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:05.595 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:37:05.595 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:37:05.595 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:05.595 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:05.595 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:05.595 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:05.595 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:37:05.595 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:05.595 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:05.595 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:05.595 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:05.595 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:05.595 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/mnt.2 2023-11-04T01:37:05.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:05.596 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:37:05.650 INFO:teuthology.orchestra.run.smithi114.stdout:41 2023-11-04T01:37:05.650 INFO:teuthology.orchestra.run.smithi114.stdout:44 2023-11-04T01:37:05.651 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2023-11-04T01:37:05.651 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:37:05.651 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2023-11-04T01:37:05.651 DEBUG:teuthology.orchestra.run.smithi114:> import re 2023-11-04T01:37:05.651 DEBUG:teuthology.orchestra.run.smithi114:> import os 2023-11-04T01:37:05.651 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2023-11-04T01:37:05.651 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:37:05.651 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2023-11-04T01:37:05.651 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-04T01:37:05.652 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2023-11-04T01:37:05.652 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-04T01:37:05.652 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:37:05.652 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2023-11-04T01:37:05.652 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2023-11-04T01:37:05.652 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2023-11-04T01:37:05.652 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2023-11-04T01:37:05.652 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:37:05.652 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2023-11-04T01:37:05.652 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:37:05.652 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:37:05.652 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:37:05.652 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2023-11-04T01:37:05.652 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2023-11-04T01:37:05.653 DEBUG:teuthology.orchestra.run.smithi114:> return f 2023-11-04T01:37:05.653 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:37:05.653 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:37:05.653 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.2")) 2023-11-04T01:37:05.653 DEBUG:teuthology.orchestra.run.smithi114:> ' 2023-11-04T01:37:05.779 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.2.99516.asok 2023-11-04T01:37:05.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:05.790 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.99516.asok 2023-11-04T01:37:05.790 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:05.790 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.2.99516.asok status 2023-11-04T01:37:05.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2023-11-04T01:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:37:05.959 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "2", 2023-11-04T01:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2023-11-04T01:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-04T01:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "99516", 2023-11-04T01:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2023-11-04T01:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2023-11-04T01:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2023-11-04T01:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4917, 2023-11-04T01:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2023-11-04T01:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2023-11-04T01:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2023-11-04T01:37:05.960 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 4917 2023-11-04T01:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 3643570246 2023-11-04T01:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 3643570246 2023-11-04T01:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:05.961 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.4917 192.168.0.2:0/3643570246", 2023-11-04T01:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "192.168.0.2:0/3643570246", 2023-11-04T01:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2023-11-04T01:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 9, 2023-11-04T01:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 24, 2023-11-04T01:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: "blocklisted": false, 2023-11-04T01:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2023-11-04T01:37:05.962 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:37:05.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:05.973 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:37:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.071+0000 7fbe0ed2c640 1 Processor -- start 2023-11-04T01:37:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.071+0000 7fbe0ed2c640 1 -- start start 2023-11-04T01:37:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.072+0000 7fbe0ed2c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbe08159c70 0x7fbe080ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.072+0000 7fbe0ed2c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbe080b0ae0 0x7fbe0815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.072+0000 7fbe0ed2c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe080b4110 con 0x7fbe0806db20 2023-11-04T01:37:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.072+0000 7fbe0ed2c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe080b49b0 con 0x7fbe08159c70 2023-11-04T01:37:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.072+0000 7fbe0ed2c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe080b43f0 con 0x7fbe080b0ae0 2023-11-04T01:37:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.072+0000 7fbe0cac8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbe08159c70 0x7fbe080ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.072+0000 7fbe0cac8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbe08159c70 0x7fbe080ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45284/0 (socket says 172.21.15.114:45284) 2023-11-04T01:37:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.072+0000 7fbe0cac8640 1 -- 172.21.15.114:0/3699093813 learned_addr learned my addr 172.21.15.114:0/3699093813 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:06.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.072+0000 7fbe0d2c9640 1 --2- 172.21.15.114:0/3699093813 >> v2:172.21.15.141:3300/0 conn(0x7fbe080b0ae0 0x7fbe0815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.072+0000 7fbe0cac8640 1 -- 172.21.15.114:0/3699093813 >> v2:172.21.15.141:3300/0 conn(0x7fbe080b0ae0 msgr2=0x7fbe0815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:06.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.072+0000 7fbe0cac8640 1 --2- 172.21.15.114:0/3699093813 >> v2:172.21.15.141:3300/0 conn(0x7fbe080b0ae0 0x7fbe0815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.072+0000 7fbe0cac8640 1 -- 172.21.15.114:0/3699093813 >> v1:172.21.15.141:6789/0 conn(0x7fbe0806db20 legacy=0x7fbe080b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:06.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.072+0000 7fbe0cac8640 1 -- 172.21.15.114:0/3699093813 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe080b46d0 con 0x7fbe08159c70 2023-11-04T01:37:06.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.072+0000 7fbe0d2c9640 1 --2- 172.21.15.114:0/3699093813 >> v2:172.21.15.141:3300/0 conn(0x7fbe080b0ae0 0x7fbe0815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:06.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.073+0000 7fbe0cac8640 1 --2- 172.21.15.114:0/3699093813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe08159c70 0x7fbe080ce370 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbe080c5910 tx=0x7fbdfc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d737809b9e1be8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:06.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.073+0000 7fbe077fe640 1 -- 172.21.15.114:0/3699093813 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc031870 con 0x7fbe08159c70 2023-11-04T01:37:06.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.073+0000 7fbe077fe640 1 -- 172.21.15.114:0/3699093813 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc0319d0 con 0x7fbe08159c70 2023-11-04T01:37:06.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.073+0000 7fbe077fe640 1 -- 172.21.15.114:0/3699093813 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc031d60 con 0x7fbe08159c70 2023-11-04T01:37:06.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.074+0000 7fbe0ed2c640 1 -- 172.21.15.114:0/3699093813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe08159c70 msgr2=0x7fbe080ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.074+0000 7fbe0ed2c640 1 --2- 172.21.15.114:0/3699093813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe08159c70 0x7fbe080ce370 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbe080c5910 tx=0x7fbdfc02b910 comp rx=0 tx=0).stop 2023-11-04T01:37:06.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.074+0000 7fbe0ed2c640 1 -- 172.21.15.114:0/3699093813 shutdown_connections 2023-11-04T01:37:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.074+0000 7fbe0ed2c640 1 --2- 172.21.15.114:0/3699093813 >> v2:172.21.15.141:3300/0 conn(0x7fbe080b0ae0 0x7fbe0815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.074+0000 7fbe0ed2c640 1 --2- 172.21.15.114:0/3699093813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe08159c70 0x7fbe080ce370 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.074+0000 7fbe0ed2c640 1 -- 172.21.15.114:0/3699093813 >> 172.21.15.114:0/3699093813 conn(0x7fbe080ce950 msgr2=0x7fbe080ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.074+0000 7fbe0ed2c640 1 -- 172.21.15.114:0/3699093813 shutdown_connections 2023-11-04T01:37:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.074+0000 7fbe0ed2c640 1 -- 172.21.15.114:0/3699093813 wait complete. 2023-11-04T01:37:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.075+0000 7fbe0ed2c640 1 Processor -- start 2023-11-04T01:37:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.075+0000 7fbe0ed2c640 1 -- start start 2023-11-04T01:37:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe0ed2c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe0806db20 0x7fbe081f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe0ed2c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe080b0ae0 0x7fbe0814ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe0ed2c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe08159c70 0x7fbe081f3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe0ed2c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe081f6be0 con 0x7fbe08159c70 2023-11-04T01:37:06.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe0ed2c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe081f6ec0 con 0x7fbe080b0ae0 2023-11-04T01:37:06.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe0ed2c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe081f71a0 con 0x7fbe0806db20 2023-11-04T01:37:06.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe0d2c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe08159c70 0x7fbe081f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe0d2c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe08159c70 0x7fbe081f3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45292/0 (socket says 172.21.15.114:45292) 2023-11-04T01:37:06.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe0d2c9640 1 -- 172.21.15.114:0/2340457496 learned_addr learned my addr 172.21.15.114:0/2340457496 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:06.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe0cac8640 1 --2- 172.21.15.114:0/2340457496 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe0806db20 0x7fbe081f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe07fff640 1 --2- 172.21.15.114:0/2340457496 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe080b0ae0 0x7fbe0814ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe0d2c9640 1 -- 172.21.15.114:0/2340457496 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe0806db20 msgr2=0x7fbe081f63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe0d2c9640 1 --2- 172.21.15.114:0/2340457496 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe0806db20 0x7fbe081f63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe0d2c9640 1 -- 172.21.15.114:0/2340457496 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe080b0ae0 msgr2=0x7fbe0814ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe0d2c9640 1 --2- 172.21.15.114:0/2340457496 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe080b0ae0 0x7fbe0814ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe0d2c9640 1 -- 172.21.15.114:0/2340457496 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc0094d0 con 0x7fbe08159c70 2023-11-04T01:37:06.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.076+0000 7fbe0d2c9640 1 --2- 172.21.15.114:0/2340457496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe08159c70 0x7fbe081f3630 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000ce80 tx=0x7fbe0000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:06.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.077+0000 7fbe057fa640 1 -- 172.21.15.114:0/2340457496 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0000d840 con 0x7fbe08159c70 2023-11-04T01:37:06.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.077+0000 7fbe057fa640 1 -- 172.21.15.114:0/2340457496 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0000d9e0 con 0x7fbe08159c70 2023-11-04T01:37:06.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.077+0000 7fbe057fa640 1 -- 172.21.15.114:0/2340457496 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0000dd90 con 0x7fbe08159c70 2023-11-04T01:37:06.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.077+0000 7fbe0ed2c640 1 -- 172.21.15.114:0/2340457496 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe081f3110 con 0x7fbe08159c70 2023-11-04T01:37:06.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.077+0000 7fbe0ed2c640 1 -- 172.21.15.114:0/2340457496 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe081f2d60 con 0x7fbe08159c70 2023-11-04T01:37:06.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.078+0000 7fbe0ed2c640 1 -- 172.21.15.114:0/2340457496 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0806df90 con 0x7fbe08159c70 2023-11-04T01:37:06.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.078+0000 7fbe057fa640 1 -- 172.21.15.114:0/2340457496 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe00015440 con 0x7fbe08159c70 2023-11-04T01:37:06.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.078+0000 7fbe057fa640 1 --2- 172.21.15.114:0/2340457496 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbdec06ae70 0x7fbdec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:06.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.079+0000 7fbe0cac8640 1 --2- 172.21.15.114:0/2340457496 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbdec06ae70 0x7fbdec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:06.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.079+0000 7fbe057fa640 1 -- 172.21.15.114:0/2340457496 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbe0008a170 con 0x7fbe08159c70 2023-11-04T01:37:06.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.079+0000 7fbe0cac8640 1 --2- 172.21.15.114:0/2340457496 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbdec06ae70 0x7fbdec06d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc036000 tx=0x7fbdfc03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:06.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.083+0000 7fbe057fa640 1 -- 172.21.15.114:0/2340457496 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe0806df90 con 0x7fbe08159c70 2023-11-04T01:37:06.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.284+0000 7fbe0ed2c640 1 -- 172.21.15.114:0/2340457496 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbe0806df90 con 0x7fbe08159c70 2023-11-04T01:37:06.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.284+0000 7fbe057fa640 1 -- 172.21.15.114:0/2340457496 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbe0806df90 con 0x7fbe08159c70 2023-11-04T01:37:06.287 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:37:06.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.286+0000 7fbe0ed2c640 1 -- 172.21.15.114:0/2340457496 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbdec06ae70 msgr2=0x7fbdec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.286+0000 7fbe0ed2c640 1 --2- 172.21.15.114:0/2340457496 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbdec06ae70 0x7fbdec06d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc036000 tx=0x7fbdfc03c040 comp rx=0 tx=0).stop 2023-11-04T01:37:06.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.286+0000 7fbe0ed2c640 1 -- 172.21.15.114:0/2340457496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe08159c70 msgr2=0x7fbe081f3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:06.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.286+0000 7fbe0ed2c640 1 --2- 172.21.15.114:0/2340457496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe08159c70 0x7fbe081f3630 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000ce80 tx=0x7fbe0000a710 comp rx=0 tx=0).stop 2023-11-04T01:37:06.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.286+0000 7fbe0ed2c640 1 -- 172.21.15.114:0/2340457496 shutdown_connections 2023-11-04T01:37:06.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.286+0000 7fbe0ed2c640 1 --2- 172.21.15.114:0/2340457496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe08159c70 0x7fbe081f3630 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.286+0000 7fbe0ed2c640 1 --2- 172.21.15.114:0/2340457496 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbdec06ae70 0x7fbdec06d330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.286+0000 7fbe0ed2c640 1 --2- 172.21.15.114:0/2340457496 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe080b0ae0 0x7fbe0814ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.286+0000 7fbe0ed2c640 1 --2- 172.21.15.114:0/2340457496 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe0806db20 0x7fbe081f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:06.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.286+0000 7fbe0ed2c640 1 -- 172.21.15.114:0/2340457496 >> 172.21.15.114:0/2340457496 conn(0x7fbe080ce950 msgr2=0x7fbe080b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:06.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.286+0000 7fbe0ed2c640 1 -- 172.21.15.114:0/2340457496 shutdown_connections 2023-11-04T01:37:06.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:06.286+0000 7fbe0ed2c640 1 -- 172.21.15.114:0/2340457496 wait complete. 2023-11-04T01:37:06.299 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:37:06.299 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:37:06.299 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi141.front.sepia.ceph.com 2023-11-04T01:37:06.299 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-04T01:37:06.299 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-04T01:37:06.299 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:37:06.299 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:37:06.299 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:37:06.299 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-04T01:37:06.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:06.300 DEBUG:teuthology.orchestra.run.smithi141:> ip addr 2023-11-04T01:37:06.318 INFO:teuthology.orchestra.run.smithi141.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:37:06.318 INFO:teuthology.orchestra.run.smithi141.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:37:06.318 INFO:teuthology.orchestra.run.smithi141.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:37:06.318 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:06.318 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 ::1/128 scope host 2023-11-04T01:37:06.319 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:06.319 INFO:teuthology.orchestra.run.smithi141.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:06.319 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:d9:3b:26 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:06.319 INFO:teuthology.orchestra.run.smithi141.stdout: altname enp7s0f0 2023-11-04T01:37:06.319 INFO:teuthology.orchestra.run.smithi141.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:06.319 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:d9:3b:27 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:06.319 INFO:teuthology.orchestra.run.smithi141.stdout: altname enp7s0f1 2023-11-04T01:37:06.319 INFO:teuthology.orchestra.run.smithi141.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:06.319 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:88:72:6c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:06.319 INFO:teuthology.orchestra.run.smithi141.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:37:06.319 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:88:72:6d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:06.319 INFO:teuthology.orchestra.run.smithi141.stdout: inet 172.21.15.141/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:37:06.319 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft 41760sec preferred_lft 41760sec 2023-11-04T01:37:06.320 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 fe80::ec4:7aff:fe88:726d/64 scope link 2023-11-04T01:37:06.320 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:06.320 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T01:37:06.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:06.320 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-04T01:37:06.320 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-04T01:37:06.320 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link add name ceph-brx type bridge 2023-11-04T01:37:06.320 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip addr flush dev ceph-brx 2023-11-04T01:37:06.321 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link set ceph-brx up 2023-11-04T01:37:06.321 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T01:37:06.321 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-04T01:37:06.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:06.494 DEBUG:teuthology.orchestra.run.smithi141:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:37:06.521 INFO:teuthology.orchestra.run.smithi141.stdout:1 2023-11-04T01:37:06.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:06.523 DEBUG:teuthology.orchestra.run.smithi141:> route 2023-11-04T01:37:06.591 INFO:teuthology.orchestra.run.smithi141.stdout:Kernel IP routing table 2023-11-04T01:37:06.591 INFO:teuthology.orchestra.run.smithi141.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:37:06.591 INFO:teuthology.orchestra.run.smithi141.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:37:06.591 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:37:06.591 INFO:teuthology.orchestra.run.smithi141.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:37:06.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:06.591 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-04T01:37:06.592 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-04T01:37:06.592 DEBUG:teuthology.orchestra.run.smithi141:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:37:06.592 DEBUG:teuthology.orchestra.run.smithi141:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:37:06.592 DEBUG:teuthology.orchestra.run.smithi141:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:37:06.592 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-04T01:37:06.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:06.882 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list 2023-11-04T01:37:06.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:06.897 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list-id 2023-11-04T01:37:06.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:06.951 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-04T01:37:06.951 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-04T01:37:06.951 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:37:06.952 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-04T01:37:06.952 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-04T01:37:07.036 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-04T01:37:07.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:07.037 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-04T01:37:07.037 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-04T01:37:07.037 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-04T01:37:07.037 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T01:37:07.037 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-04T01:37:07.037 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-04T01:37:07.037 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-04T01:37:07.037 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-04T01:37:07.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:07.173 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-04T01:37:07.173 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-04T01:37:07.173 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link set brx.0 up 2023-11-04T01:37:07.173 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T01:37:07.173 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-04T01:37:07.215 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-04T01:37:07.215 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:37:07.215 DEBUG:teuthology.orchestra.run.smithi141:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-04T01:37:07.270 INFO:teuthology.orchestra.run.smithi141.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-04T01:37:07.270 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:37:07.271 DEBUG:teuthology.orchestra.run.smithi141:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-04T01:37:07.325 DEBUG:teuthology.orchestra.run.smithi141:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:07.382 INFO:teuthology.orchestra.run.smithi141.stdout:/proc 2023-11-04T01:37:07.382 INFO:teuthology.orchestra.run.smithi141.stdout:/sys 2023-11-04T01:37:07.382 INFO:teuthology.orchestra.run.smithi141.stdout:/dev 2023-11-04T01:37:07.382 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/security 2023-11-04T01:37:07.382 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/shm 2023-11-04T01:37:07.383 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/pts 2023-11-04T01:37:07.383 INFO:teuthology.orchestra.run.smithi141.stdout:/run 2023-11-04T01:37:07.383 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/cgroup 2023-11-04T01:37:07.383 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/pstore 2023-11-04T01:37:07.383 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/bpf 2023-11-04T01:37:07.383 INFO:teuthology.orchestra.run.smithi141.stdout:/ 2023-11-04T01:37:07.383 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/selinux 2023-11-04T01:37:07.383 INFO:teuthology.orchestra.run.smithi141.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:07.383 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/hugepages 2023-11-04T01:37:07.383 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/mqueue 2023-11-04T01:37:07.383 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/debug 2023-11-04T01:37:07.384 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/tracing 2023-11-04T01:37:07.384 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:07.384 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/config 2023-11-04T01:37:07.384 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:07.384 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:07.384 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:07.384 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:07.384 INFO:teuthology.orchestra.run.smithi141.stdout:/run/user/1000 2023-11-04T01:37:07.384 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph 2023-11-04T01:37:07.384 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:37:07.385 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:37:07.385 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:37:07.385 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:37:07.385 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns 2023-11-04T01:37:07.385 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:37:07.385 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:37:07.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:07.386 DEBUG:teuthology.orchestra.run.smithi141:> ls /sys/fs/fuse/connections 2023-11-04T01:37:07.437 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:37:07.438 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-04T01:37:07.480 DEBUG:teuthology.orchestra.run.smithi141:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:07.495 INFO:teuthology.orchestra.run.smithi141.stdout:/proc 2023-11-04T01:37:07.495 INFO:teuthology.orchestra.run.smithi141.stdout:/sys 2023-11-04T01:37:07.495 INFO:teuthology.orchestra.run.smithi141.stdout:/dev 2023-11-04T01:37:07.495 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/security 2023-11-04T01:37:07.495 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/shm 2023-11-04T01:37:07.495 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/pts 2023-11-04T01:37:07.495 INFO:teuthology.orchestra.run.smithi141.stdout:/run 2023-11-04T01:37:07.495 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/cgroup 2023-11-04T01:37:07.495 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/pstore 2023-11-04T01:37:07.495 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/bpf 2023-11-04T01:37:07.496 INFO:teuthology.orchestra.run.smithi141.stdout:/ 2023-11-04T01:37:07.496 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/selinux 2023-11-04T01:37:07.496 INFO:teuthology.orchestra.run.smithi141.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:07.496 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/hugepages 2023-11-04T01:37:07.496 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/mqueue 2023-11-04T01:37:07.496 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/debug 2023-11-04T01:37:07.496 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/tracing 2023-11-04T01:37:07.496 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:07.496 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/config 2023-11-04T01:37:07.496 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:07.496 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:07.496 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:07.496 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:07.496 INFO:teuthology.orchestra.run.smithi141.stdout:/run/user/1000 2023-11-04T01:37:07.497 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph 2023-11-04T01:37:07.497 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:37:07.497 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:37:07.497 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:37:07.497 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:37:07.497 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns 2023-11-04T01:37:07.497 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:37:07.497 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:37:07.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:07.497 DEBUG:teuthology.orchestra.run.smithi141:> ls /sys/fs/fuse/connections 2023-11-04T01:37:07.584 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi141.stderr:2023-11-04T01:37:07.583+0000 7fbaa404a480 -1 init, newargv = 0x557752eac060 newargc=15 2023-11-04T01:37:07.585 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi141.stderr:ceph-fuse[125013]: starting ceph client 2023-11-04T01:37:07.590 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi141.stderr:ceph-fuse[125013]: starting fuse 2023-11-04T01:37:08.651 DEBUG:teuthology.orchestra.run.smithi141:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:08.668 INFO:teuthology.orchestra.run.smithi141.stdout:/proc 2023-11-04T01:37:08.668 INFO:teuthology.orchestra.run.smithi141.stdout:/sys 2023-11-04T01:37:08.668 INFO:teuthology.orchestra.run.smithi141.stdout:/dev 2023-11-04T01:37:08.668 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/security 2023-11-04T01:37:08.668 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/shm 2023-11-04T01:37:08.668 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/pts 2023-11-04T01:37:08.668 INFO:teuthology.orchestra.run.smithi141.stdout:/run 2023-11-04T01:37:08.668 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/cgroup 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/pstore 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/bpf 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi141.stdout:/ 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/selinux 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi141.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/hugepages 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/mqueue 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/debug 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/tracing 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/config 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:08.669 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi141.stdout:/run/user/1000 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:37:08.670 INFO:teuthology.orchestra.run.smithi141.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:37:08.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:08.671 DEBUG:teuthology.orchestra.run.smithi141:> ls /sys/fs/fuse/connections 2023-11-04T01:37:08.723 INFO:teuthology.orchestra.run.smithi141.stdout:43 2023-11-04T01:37:08.724 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-04T01:37:08.724 DEBUG:teuthology.orchestra.run.smithi141:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:37:08.724 DEBUG:teuthology.orchestra.run.smithi141:> import glob 2023-11-04T01:37:08.724 DEBUG:teuthology.orchestra.run.smithi141:> import re 2023-11-04T01:37:08.724 DEBUG:teuthology.orchestra.run.smithi141:> import os 2023-11-04T01:37:08.724 DEBUG:teuthology.orchestra.run.smithi141:> import subprocess 2023-11-04T01:37:08.724 DEBUG:teuthology.orchestra.run.smithi141:> 2023-11-04T01:37:08.724 DEBUG:teuthology.orchestra.run.smithi141:> def _find_admin_socket(client_name): 2023-11-04T01:37:08.724 DEBUG:teuthology.orchestra.run.smithi141:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-04T01:37:08.724 DEBUG:teuthology.orchestra.run.smithi141:> files = glob.glob(asok_path) 2023-11-04T01:37:08.725 DEBUG:teuthology.orchestra.run.smithi141:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-04T01:37:08.725 DEBUG:teuthology.orchestra.run.smithi141:> 2023-11-04T01:37:08.725 DEBUG:teuthology.orchestra.run.smithi141:> # Given a non-glob path, it better be there 2023-11-04T01:37:08.725 DEBUG:teuthology.orchestra.run.smithi141:> if "*" not in asok_path: 2023-11-04T01:37:08.725 DEBUG:teuthology.orchestra.run.smithi141:> assert(len(files) == 1) 2023-11-04T01:37:08.725 DEBUG:teuthology.orchestra.run.smithi141:> return files[0] 2023-11-04T01:37:08.725 DEBUG:teuthology.orchestra.run.smithi141:> 2023-11-04T01:37:08.725 DEBUG:teuthology.orchestra.run.smithi141:> for f in files: 2023-11-04T01:37:08.725 DEBUG:teuthology.orchestra.run.smithi141:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:37:08.725 DEBUG:teuthology.orchestra.run.smithi141:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:37:08.725 DEBUG:teuthology.orchestra.run.smithi141:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:37:08.725 DEBUG:teuthology.orchestra.run.smithi141:> contents = proc_f.read() 2023-11-04T01:37:08.725 DEBUG:teuthology.orchestra.run.smithi141:> if mountpoint in contents: 2023-11-04T01:37:08.726 DEBUG:teuthology.orchestra.run.smithi141:> return f 2023-11-04T01:37:08.726 DEBUG:teuthology.orchestra.run.smithi141:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:37:08.726 DEBUG:teuthology.orchestra.run.smithi141:> 2023-11-04T01:37:08.726 DEBUG:teuthology.orchestra.run.smithi141:> print(_find_admin_socket("client.1")) 2023-11-04T01:37:08.726 DEBUG:teuthology.orchestra.run.smithi141:> ' 2023-11-04T01:37:08.844 INFO:teuthology.orchestra.run.smithi141.stdout:/var/run/ceph/ceph-client.1.125013.asok 2023-11-04T01:37:08.846 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:08.854 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.125013.asok 2023-11-04T01:37:08.854 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:08.854 DEBUG:teuthology.orchestra.run.smithi141:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.125013.asok status 2023-11-04T01:37:08.951 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:09.020 INFO:teuthology.orchestra.run.smithi141.stdout:{ 2023-11-04T01:37:09.020 INFO:teuthology.orchestra.run.smithi141.stdout: "metadata": { 2023-11-04T01:37:09.020 INFO:teuthology.orchestra.run.smithi141.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:37:09.020 INFO:teuthology.orchestra.run.smithi141.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:37:09.021 INFO:teuthology.orchestra.run.smithi141.stdout: "entity_id": "1", 2023-11-04T01:37:09.021 INFO:teuthology.orchestra.run.smithi141.stdout: "hostname": "smithi141", 2023-11-04T01:37:09.021 INFO:teuthology.orchestra.run.smithi141.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-04T01:37:09.021 INFO:teuthology.orchestra.run.smithi141.stdout: "pid": "125013", 2023-11-04T01:37:09.021 INFO:teuthology.orchestra.run.smithi141.stdout: "root": "/" 2023-11-04T01:37:09.021 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2023-11-04T01:37:09.021 INFO:teuthology.orchestra.run.smithi141.stdout: "dentry_count": 0, 2023-11-04T01:37:09.021 INFO:teuthology.orchestra.run.smithi141.stdout: "dentry_pinned_count": 0, 2023-11-04T01:37:09.021 INFO:teuthology.orchestra.run.smithi141.stdout: "id": 4568, 2023-11-04T01:37:09.022 INFO:teuthology.orchestra.run.smithi141.stdout: "inst": { 2023-11-04T01:37:09.022 INFO:teuthology.orchestra.run.smithi141.stdout: "name": { 2023-11-04T01:37:09.022 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "client", 2023-11-04T01:37:09.022 INFO:teuthology.orchestra.run.smithi141.stdout: "num": 4568 2023-11-04T01:37:09.022 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2023-11-04T01:37:09.022 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": { 2023-11-04T01:37:09.022 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "v1", 2023-11-04T01:37:09.022 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:37:09.022 INFO:teuthology.orchestra.run.smithi141.stdout: "nonce": 155689592 2023-11-04T01:37:09.022 INFO:teuthology.orchestra.run.smithi141.stdout: } 2023-11-04T01:37:09.023 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2023-11-04T01:37:09.023 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": { 2023-11-04T01:37:09.023 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "v1", 2023-11-04T01:37:09.023 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:37:09.023 INFO:teuthology.orchestra.run.smithi141.stdout: "nonce": 155689592 2023-11-04T01:37:09.023 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2023-11-04T01:37:09.023 INFO:teuthology.orchestra.run.smithi141.stdout: "inst_str": "client.4568 192.168.0.1:0/155689592", 2023-11-04T01:37:09.023 INFO:teuthology.orchestra.run.smithi141.stdout: "addr_str": "192.168.0.1:0/155689592", 2023-11-04T01:37:09.023 INFO:teuthology.orchestra.run.smithi141.stdout: "inode_count": 1, 2023-11-04T01:37:09.023 INFO:teuthology.orchestra.run.smithi141.stdout: "mds_epoch": 9, 2023-11-04T01:37:09.023 INFO:teuthology.orchestra.run.smithi141.stdout: "osd_epoch": 24, 2023-11-04T01:37:09.024 INFO:teuthology.orchestra.run.smithi141.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:37:09.024 INFO:teuthology.orchestra.run.smithi141.stdout: "blocklisted": false, 2023-11-04T01:37:09.024 INFO:teuthology.orchestra.run.smithi141.stdout: "fs_name": "cephfs" 2023-11-04T01:37:09.024 INFO:teuthology.orchestra.run.smithi141.stdout:} 2023-11-04T01:37:09.027 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:09.034 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:37:09.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.143+0000 7ff542690640 1 Processor -- start 2023-11-04T01:37:09.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.143+0000 7ff542690640 1 -- start start 2023-11-04T01:37:09.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.144+0000 7ff542690640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff53c15e1c0 0x7ff53c06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.144+0000 7ff542690640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c0b14a0 0x7ff53c06a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.144+0000 7ff542690640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53c0b1b80 con 0x7ff53c06fe80 2023-11-04T01:37:09.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.144+0000 7ff542690640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53c0b1e60 con 0x7ff53c15e1c0 2023-11-04T01:37:09.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.144+0000 7ff542690640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b2140 con 0x7ff53c0b14a0 2023-11-04T01:37:09.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.144+0000 7ff53bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff53c15e1c0 0x7ff53c06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.144+0000 7ff53bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff53c15e1c0 0x7ff53c06a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56098/0 (socket says 172.21.15.114:56098) 2023-11-04T01:37:09.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.144+0000 7ff53bfff640 1 -- 172.21.15.114:0/4075909246 learned_addr learned my addr 172.21.15.114:0/4075909246 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:09.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.144+0000 7ff53b7fe640 1 --2- 172.21.15.114:0/4075909246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c0b14a0 0x7ff53c06a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.144+0000 7ff53bfff640 1 -- 172.21.15.114:0/4075909246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c0b14a0 msgr2=0x7ff53c06a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:09.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.144+0000 7ff53bfff640 1 --2- 172.21.15.114:0/4075909246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c0b14a0 0x7ff53c06a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.144+0000 7ff53bfff640 1 -- 172.21.15.114:0/4075909246 >> v1:172.21.15.141:6789/0 conn(0x7ff53c06fe80 legacy=0x7ff53c0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.144+0000 7ff53bfff640 1 -- 172.21.15.114:0/4075909246 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0ca990 con 0x7ff53c15e1c0 2023-11-04T01:37:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.145+0000 7ff53bfff640 1 --2- 172.21.15.114:0/4075909246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff53c15e1c0 0x7ff53c06a120 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009870 tx=0x7ff52c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957a6c91daf47d13 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.145+0000 7ff53affd640 1 -- 172.21.15.114:0/4075909246 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c030840 con 0x7ff53c15e1c0 2023-11-04T01:37:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.145+0000 7ff53affd640 1 -- 172.21.15.114:0/4075909246 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c0309a0 con 0x7ff53c15e1c0 2023-11-04T01:37:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.145+0000 7ff53affd640 1 -- 172.21.15.114:0/4075909246 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c030d30 con 0x7ff53c15e1c0 2023-11-04T01:37:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.146+0000 7ff542690640 1 -- 172.21.15.114:0/4075909246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff53c15e1c0 msgr2=0x7ff53c06a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.146+0000 7ff542690640 1 --2- 172.21.15.114:0/4075909246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff53c15e1c0 0x7ff53c06a120 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009870 tx=0x7ff52c02b980 comp rx=0 tx=0).stop 2023-11-04T01:37:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.146+0000 7ff542690640 1 -- 172.21.15.114:0/4075909246 shutdown_connections 2023-11-04T01:37:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.146+0000 7ff542690640 1 --2- 172.21.15.114:0/4075909246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c0b14a0 0x7ff53c06a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.146+0000 7ff542690640 1 --2- 172.21.15.114:0/4075909246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff53c15e1c0 0x7ff53c06a120 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.146+0000 7ff542690640 1 -- 172.21.15.114:0/4075909246 >> 172.21.15.114:0/4075909246 conn(0x7ff53c06d8b0 msgr2=0x7ff53c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.146+0000 7ff542690640 1 -- 172.21.15.114:0/4075909246 shutdown_connections 2023-11-04T01:37:09.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.146+0000 7ff542690640 1 -- 172.21.15.114:0/4075909246 wait complete. 2023-11-04T01:37:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.147+0000 7ff542690640 1 Processor -- start 2023-11-04T01:37:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.147+0000 7ff542690640 1 -- start start 2023-11-04T01:37:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.148+0000 7ff542690640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c06fe80 0x7ff53c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.148+0000 7ff542690640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff53c0b14a0 0x7ff53c0c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.148+0000 7ff542690640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff53c15e1c0 0x7ff53c0c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.148+0000 7ff542690640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0c4b40 con 0x7ff53c0b14a0 2023-11-04T01:37:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.148+0000 7ff542690640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0c3f30 con 0x7ff53c15e1c0 2023-11-04T01:37:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.148+0000 7ff542690640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0c4210 con 0x7ff53c06fe80 2023-11-04T01:37:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.148+0000 7ff53b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff53c0b14a0 0x7ff53c0c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.148+0000 7ff53b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff53c0b14a0 0x7ff53c0c3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56106/0 (socket says 172.21.15.114:56106) 2023-11-04T01:37:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.148+0000 7ff53b7fe640 1 -- 172.21.15.114:0/1658518143 learned_addr learned my addr 172.21.15.114:0/1658518143 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.148+0000 7ff53bfff640 1 --2- 172.21.15.114:0/1658518143 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c06fe80 0x7ff53c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.148+0000 7ff540c2d640 1 --2- 172.21.15.114:0/1658518143 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff53c15e1c0 0x7ff53c0c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.148+0000 7ff53b7fe640 1 -- 172.21.15.114:0/1658518143 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c06fe80 msgr2=0x7ff53c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.148+0000 7ff53b7fe640 1 --2- 172.21.15.114:0/1658518143 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c06fe80 0x7ff53c0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.148+0000 7ff53b7fe640 1 -- 172.21.15.114:0/1658518143 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff53c15e1c0 msgr2=0x7ff53c0c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.148+0000 7ff53b7fe640 1 --2- 172.21.15.114:0/1658518143 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff53c15e1c0 0x7ff53c0c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.148+0000 7ff53b7fe640 1 -- 172.21.15.114:0/1658518143 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c0094d0 con 0x7ff53c0b14a0 2023-11-04T01:37:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.149+0000 7ff53b7fe640 1 --2- 172.21.15.114:0/1658518143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff53c0b14a0 0x7ff53c0c3550 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff53000e9b0 tx=0x7ff53000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.149+0000 7ff538ff9640 1 -- 172.21.15.114:0/1658518143 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530009670 con 0x7ff53c0b14a0 2023-11-04T01:37:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.149+0000 7ff538ff9640 1 -- 172.21.15.114:0/1658518143 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53000c9a0 con 0x7ff53c0b14a0 2023-11-04T01:37:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.149+0000 7ff542690640 1 -- 172.21.15.114:0/1658518143 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53c0c44f0 con 0x7ff53c0b14a0 2023-11-04T01:37:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.149+0000 7ff538ff9640 1 -- 172.21.15.114:0/1658518143 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53000cd50 con 0x7ff53c0b14a0 2023-11-04T01:37:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.149+0000 7ff542690640 1 -- 172.21.15.114:0/1658518143 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53c0c8f00 con 0x7ff53c0b14a0 2023-11-04T01:37:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.150+0000 7ff542690640 1 -- 172.21.15.114:0/1658518143 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c06f860 con 0x7ff53c0b14a0 2023-11-04T01:37:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.150+0000 7ff538ff9640 1 -- 172.21.15.114:0/1658518143 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff530013470 con 0x7ff53c0b14a0 2023-11-04T01:37:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.151+0000 7ff538ff9640 1 --2- 172.21.15.114:0/1658518143 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff52806ae70 0x7ff52806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.151+0000 7ff538ff9640 1 -- 172.21.15.114:0/1658518143 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff530089b00 con 0x7ff53c0b14a0 2023-11-04T01:37:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.151+0000 7ff53bfff640 1 --2- 172.21.15.114:0/1658518143 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff52806ae70 0x7ff52806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.151+0000 7ff53bfff640 1 --2- 172.21.15.114:0/1658518143 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff52806ae70 0x7ff52806d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff52c036000 tx=0x7ff52c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.155+0000 7ff538ff9640 1 -- 172.21.15.114:0/1658518143 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff530054970 con 0x7ff53c0b14a0 2023-11-04T01:37:09.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.358+0000 7ff542690640 1 -- 172.21.15.114:0/1658518143 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff53c0b3780 con 0x7ff53c0b14a0 2023-11-04T01:37:09.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.358+0000 7ff538ff9640 1 -- 172.21.15.114:0/1658518143 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff530021070 con 0x7ff53c0b14a0 2023-11-04T01:37:09.361 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:37:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.360+0000 7ff542690640 1 -- 172.21.15.114:0/1658518143 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff52806ae70 msgr2=0x7ff52806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.360+0000 7ff542690640 1 --2- 172.21.15.114:0/1658518143 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff52806ae70 0x7ff52806d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff52c036000 tx=0x7ff52c008030 comp rx=0 tx=0).stop 2023-11-04T01:37:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.360+0000 7ff542690640 1 -- 172.21.15.114:0/1658518143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff53c0b14a0 msgr2=0x7ff53c0c3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.360+0000 7ff542690640 1 --2- 172.21.15.114:0/1658518143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff53c0b14a0 0x7ff53c0c3550 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff53000e9b0 tx=0x7ff53000ee70 comp rx=0 tx=0).stop 2023-11-04T01:37:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.360+0000 7ff542690640 1 -- 172.21.15.114:0/1658518143 shutdown_connections 2023-11-04T01:37:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.360+0000 7ff542690640 1 --2- 172.21.15.114:0/1658518143 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff52806ae70 0x7ff52806d330 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.360+0000 7ff542690640 1 --2- 172.21.15.114:0/1658518143 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff53c15e1c0 0x7ff53c0c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.360+0000 7ff542690640 1 --2- 172.21.15.114:0/1658518143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff53c0b14a0 0x7ff53c0c3550 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.360+0000 7ff542690640 1 --2- 172.21.15.114:0/1658518143 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff53c06fe80 0x7ff53c0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.360+0000 7ff542690640 1 -- 172.21.15.114:0/1658518143 >> 172.21.15.114:0/1658518143 conn(0x7ff53c06d8b0 msgr2=0x7ff53c0cc180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.360+0000 7ff542690640 1 -- 172.21.15.114:0/1658518143 shutdown_connections 2023-11-04T01:37:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:09.360+0000 7ff542690640 1 -- 172.21.15.114:0/1658518143 wait complete. 2023-11-04T01:37:09.375 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:37:09.376 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:37:09.376 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi141.front.sepia.ceph.com 2023-11-04T01:37:09.376 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-04T01:37:09.376 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-04T01:37:09.376 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:37:09.376 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:37:09.376 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:37:09.376 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-04T01:37:09.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:09.376 DEBUG:teuthology.orchestra.run.smithi141:> ip addr 2023-11-04T01:37:09.392 INFO:teuthology.orchestra.run.smithi141.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:37:09.392 INFO:teuthology.orchestra.run.smithi141.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:37:09.392 INFO:teuthology.orchestra.run.smithi141.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:37:09.392 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:09.393 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 ::1/128 scope host 2023-11-04T01:37:09.393 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:09.393 INFO:teuthology.orchestra.run.smithi141.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:09.393 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:d9:3b:26 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:09.393 INFO:teuthology.orchestra.run.smithi141.stdout: altname enp7s0f0 2023-11-04T01:37:09.393 INFO:teuthology.orchestra.run.smithi141.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:09.393 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:d9:3b:27 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:09.393 INFO:teuthology.orchestra.run.smithi141.stdout: altname enp7s0f1 2023-11-04T01:37:09.393 INFO:teuthology.orchestra.run.smithi141.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:09.393 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:88:72:6c brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:09.393 INFO:teuthology.orchestra.run.smithi141.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:37:09.393 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 0c:c4:7a:88:72:6d brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:09.394 INFO:teuthology.orchestra.run.smithi141.stdout: inet 172.21.15.141/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:37:09.394 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft 41757sec preferred_lft 41757sec 2023-11-04T01:37:09.394 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 fe80::ec4:7aff:fe88:726d/64 scope link 2023-11-04T01:37:09.394 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:09.394 INFO:teuthology.orchestra.run.smithi141.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:37:09.394 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 96:83:c0:2f:1c:ac brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:09.394 INFO:teuthology.orchestra.run.smithi141.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:37:09.394 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:09.394 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 fe80::a838:bff:fe5c:79c8/64 scope link 2023-11-04T01:37:09.394 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:09.394 INFO:teuthology.orchestra.run.smithi141.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:37:09.394 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 96:83:c0:2f:1c:ac brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:37:09.394 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 fe80::9483:c0ff:fe2f:1cac/64 scope link 2023-11-04T01:37:09.395 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:09.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:09.395 DEBUG:teuthology.orchestra.run.smithi141:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:37:09.459 INFO:teuthology.orchestra.run.smithi141.stdout:1 2023-11-04T01:37:09.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:09.460 DEBUG:teuthology.orchestra.run.smithi141:> route 2023-11-04T01:37:09.515 INFO:teuthology.orchestra.run.smithi141.stdout:Kernel IP routing table 2023-11-04T01:37:09.515 INFO:teuthology.orchestra.run.smithi141.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:37:09.515 INFO:teuthology.orchestra.run.smithi141.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:37:09.515 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:37:09.516 INFO:teuthology.orchestra.run.smithi141.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:37:09.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:09.516 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-04T01:37:09.516 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-04T01:37:09.516 DEBUG:teuthology.orchestra.run.smithi141:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:37:09.516 DEBUG:teuthology.orchestra.run.smithi141:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:37:09.516 DEBUG:teuthology.orchestra.run.smithi141:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:37:09.516 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-04T01:37:09.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:09.613 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list 2023-11-04T01:37:09.628 INFO:teuthology.orchestra.run.smithi141.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-04T01:37:09.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:09.629 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list-id 2023-11-04T01:37:09.683 INFO:teuthology.orchestra.run.smithi141.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-04T01:37:09.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:09.683 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-04T01:37:09.683 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-04T01:37:09.683 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:37:09.683 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-04T01:37:09.683 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-04T01:37:09.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:09.765 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-04T01:37:09.831 INFO:teuthology.orchestra.run.smithi141.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:37:09.832 INFO:teuthology.orchestra.run.smithi141.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:37:09.832 INFO:teuthology.orchestra.run.smithi141.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:37:09.832 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:09.832 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 ::1/128 scope host 2023-11-04T01:37:09.832 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:09.832 INFO:teuthology.orchestra.run.smithi141.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:37:09.832 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 66:d8:c4:58:fa:f2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:37:09.832 INFO:teuthology.orchestra.run.smithi141.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:37:09.832 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:09.832 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 fe80::64d8:c4ff:fe58:faf2/64 scope link 2023-11-04T01:37:09.833 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:09.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:09.834 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-04T01:37:09.899 INFO:teuthology.orchestra.run.smithi141.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:37:09.900 INFO:teuthology.orchestra.run.smithi141.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:37:09.900 INFO:teuthology.orchestra.run.smithi141.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:37:09.900 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:09.900 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 ::1/128 scope host 2023-11-04T01:37:09.900 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:09.900 INFO:teuthology.orchestra.run.smithi141.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:37:09.900 INFO:teuthology.orchestra.run.smithi141.stdout: link/ether 66:d8:c4:58:fa:f2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:37:09.900 INFO:teuthology.orchestra.run.smithi141.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:37:09.900 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:09.900 INFO:teuthology.orchestra.run.smithi141.stdout: inet6 fe80::64d8:c4ff:fe58:faf2/64 scope link 2023-11-04T01:37:09.900 INFO:teuthology.orchestra.run.smithi141.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:09.901 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-04T01:37:09.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:09.902 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-04T01:37:09.902 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-04T01:37:09.902 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-04T01:37:09.902 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-04T01:37:09.902 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-04T01:37:09.902 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-04T01:37:09.902 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-04T01:37:09.902 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-04T01:37:10.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:10.026 DEBUG:teuthology.orchestra.run.smithi141:> (cd / && exec bash -c ' 2023-11-04T01:37:10.026 DEBUG:teuthology.orchestra.run.smithi141:> set -e 2023-11-04T01:37:10.026 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link set brx.1 up 2023-11-04T01:37:10.026 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link set dev brx.1 master ceph-brx 2023-11-04T01:37:10.026 DEBUG:teuthology.orchestra.run.smithi141:> ') 2023-11-04T01:37:10.068 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-04T01:37:10.068 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:37:10.068 DEBUG:teuthology.orchestra.run.smithi141:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-04T01:37:10.123 INFO:teuthology.orchestra.run.smithi141.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-04T01:37:10.123 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:37:10.123 DEBUG:teuthology.orchestra.run.smithi141:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-04T01:37:10.177 DEBUG:teuthology.orchestra.run.smithi141:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:10.233 INFO:teuthology.orchestra.run.smithi141.stdout:/proc 2023-11-04T01:37:10.233 INFO:teuthology.orchestra.run.smithi141.stdout:/sys 2023-11-04T01:37:10.233 INFO:teuthology.orchestra.run.smithi141.stdout:/dev 2023-11-04T01:37:10.233 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/security 2023-11-04T01:37:10.233 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/shm 2023-11-04T01:37:10.233 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/pts 2023-11-04T01:37:10.233 INFO:teuthology.orchestra.run.smithi141.stdout:/run 2023-11-04T01:37:10.233 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/cgroup 2023-11-04T01:37:10.233 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/pstore 2023-11-04T01:37:10.234 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/bpf 2023-11-04T01:37:10.234 INFO:teuthology.orchestra.run.smithi141.stdout:/ 2023-11-04T01:37:10.234 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/selinux 2023-11-04T01:37:10.234 INFO:teuthology.orchestra.run.smithi141.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:10.234 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/hugepages 2023-11-04T01:37:10.234 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/mqueue 2023-11-04T01:37:10.234 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/debug 2023-11-04T01:37:10.234 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/tracing 2023-11-04T01:37:10.234 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:10.234 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/config 2023-11-04T01:37:10.234 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:10.235 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:10.235 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:10.235 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:10.235 INFO:teuthology.orchestra.run.smithi141.stdout:/run/user/1000 2023-11-04T01:37:10.235 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph 2023-11-04T01:37:10.235 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:37:10.235 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:37:10.235 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:37:10.235 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:37:10.235 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns 2023-11-04T01:37:10.235 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:37:10.235 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:37:10.236 INFO:teuthology.orchestra.run.smithi141.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:37:10.236 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:37:10.236 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:37:10.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:10.236 DEBUG:teuthology.orchestra.run.smithi141:> ls /sys/fs/fuse/connections 2023-11-04T01:37:10.288 INFO:teuthology.orchestra.run.smithi141.stdout:43 2023-11-04T01:37:10.288 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-04T01:37:10.288 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-04T01:37:10.330 DEBUG:teuthology.orchestra.run.smithi141:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:10.345 INFO:teuthology.orchestra.run.smithi141.stdout:/proc 2023-11-04T01:37:10.345 INFO:teuthology.orchestra.run.smithi141.stdout:/sys 2023-11-04T01:37:10.345 INFO:teuthology.orchestra.run.smithi141.stdout:/dev 2023-11-04T01:37:10.345 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/security 2023-11-04T01:37:10.345 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/shm 2023-11-04T01:37:10.345 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/pts 2023-11-04T01:37:10.346 INFO:teuthology.orchestra.run.smithi141.stdout:/run 2023-11-04T01:37:10.346 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/cgroup 2023-11-04T01:37:10.346 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/pstore 2023-11-04T01:37:10.346 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/bpf 2023-11-04T01:37:10.346 INFO:teuthology.orchestra.run.smithi141.stdout:/ 2023-11-04T01:37:10.346 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/selinux 2023-11-04T01:37:10.346 INFO:teuthology.orchestra.run.smithi141.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:10.346 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/hugepages 2023-11-04T01:37:10.346 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/mqueue 2023-11-04T01:37:10.346 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/debug 2023-11-04T01:37:10.346 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/tracing 2023-11-04T01:37:10.346 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:10.347 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/config 2023-11-04T01:37:10.347 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:10.347 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:10.347 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:10.347 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:10.347 INFO:teuthology.orchestra.run.smithi141.stdout:/run/user/1000 2023-11-04T01:37:10.347 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph 2023-11-04T01:37:10.347 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:37:10.347 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:37:10.347 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:37:10.347 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:37:10.347 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns 2023-11-04T01:37:10.348 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:37:10.348 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:37:10.348 INFO:teuthology.orchestra.run.smithi141.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:37:10.348 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:37:10.348 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:37:10.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:10.348 DEBUG:teuthology.orchestra.run.smithi141:> ls /sys/fs/fuse/connections 2023-11-04T01:37:10.400 INFO:teuthology.orchestra.run.smithi141.stdout:43 2023-11-04T01:37:10.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi141.stderr:2023-11-04T01:37:10.418+0000 7f17c1c73480 -1 init, newargv = 0x55d7a93f0b40 newargc=15 2023-11-04T01:37:10.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi141.stderr:ceph-fuse[125465]: starting ceph client 2023-11-04T01:37:10.424 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi141.stderr:ceph-fuse[125465]: starting fuse 2023-11-04T01:37:11.501 DEBUG:teuthology.orchestra.run.smithi141:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:11.521 INFO:teuthology.orchestra.run.smithi141.stdout:/proc 2023-11-04T01:37:11.521 INFO:teuthology.orchestra.run.smithi141.stdout:/sys 2023-11-04T01:37:11.521 INFO:teuthology.orchestra.run.smithi141.stdout:/dev 2023-11-04T01:37:11.521 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/security 2023-11-04T01:37:11.521 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/shm 2023-11-04T01:37:11.522 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/pts 2023-11-04T01:37:11.522 INFO:teuthology.orchestra.run.smithi141.stdout:/run 2023-11-04T01:37:11.522 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/cgroup 2023-11-04T01:37:11.522 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/pstore 2023-11-04T01:37:11.522 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/bpf 2023-11-04T01:37:11.522 INFO:teuthology.orchestra.run.smithi141.stdout:/ 2023-11-04T01:37:11.522 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/selinux 2023-11-04T01:37:11.522 INFO:teuthology.orchestra.run.smithi141.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:11.522 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/hugepages 2023-11-04T01:37:11.522 INFO:teuthology.orchestra.run.smithi141.stdout:/dev/mqueue 2023-11-04T01:37:11.522 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/debug 2023-11-04T01:37:11.522 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/tracing 2023-11-04T01:37:11.523 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:11.523 INFO:teuthology.orchestra.run.smithi141.stdout:/sys/kernel/config 2023-11-04T01:37:11.523 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:11.523 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:11.523 INFO:teuthology.orchestra.run.smithi141.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:11.523 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:11.523 INFO:teuthology.orchestra.run.smithi141.stdout:/run/user/1000 2023-11-04T01:37:11.523 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph 2023-11-04T01:37:11.523 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:37:11.523 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:37:11.523 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:37:11.523 INFO:teuthology.orchestra.run.smithi141.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:37:11.524 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns 2023-11-04T01:37:11.524 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:37:11.524 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:37:11.524 INFO:teuthology.orchestra.run.smithi141.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:37:11.524 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:37:11.524 INFO:teuthology.orchestra.run.smithi141.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:37:11.524 INFO:teuthology.orchestra.run.smithi141.stdout:/home/ubuntu/cephtest/mnt.3 2023-11-04T01:37:11.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:11.525 DEBUG:teuthology.orchestra.run.smithi141:> ls /sys/fs/fuse/connections 2023-11-04T01:37:11.581 INFO:teuthology.orchestra.run.smithi141.stdout:43 2023-11-04T01:37:11.581 INFO:teuthology.orchestra.run.smithi141.stdout:44 2023-11-04T01:37:11.581 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-04T01:37:11.581 DEBUG:teuthology.orchestra.run.smithi141:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:37:11.581 DEBUG:teuthology.orchestra.run.smithi141:> import glob 2023-11-04T01:37:11.581 DEBUG:teuthology.orchestra.run.smithi141:> import re 2023-11-04T01:37:11.581 DEBUG:teuthology.orchestra.run.smithi141:> import os 2023-11-04T01:37:11.582 DEBUG:teuthology.orchestra.run.smithi141:> import subprocess 2023-11-04T01:37:11.582 DEBUG:teuthology.orchestra.run.smithi141:> 2023-11-04T01:37:11.582 DEBUG:teuthology.orchestra.run.smithi141:> def _find_admin_socket(client_name): 2023-11-04T01:37:11.582 DEBUG:teuthology.orchestra.run.smithi141:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-04T01:37:11.582 DEBUG:teuthology.orchestra.run.smithi141:> files = glob.glob(asok_path) 2023-11-04T01:37:11.582 DEBUG:teuthology.orchestra.run.smithi141:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-04T01:37:11.582 DEBUG:teuthology.orchestra.run.smithi141:> 2023-11-04T01:37:11.582 DEBUG:teuthology.orchestra.run.smithi141:> # Given a non-glob path, it better be there 2023-11-04T01:37:11.582 DEBUG:teuthology.orchestra.run.smithi141:> if "*" not in asok_path: 2023-11-04T01:37:11.582 DEBUG:teuthology.orchestra.run.smithi141:> assert(len(files) == 1) 2023-11-04T01:37:11.582 DEBUG:teuthology.orchestra.run.smithi141:> return files[0] 2023-11-04T01:37:11.582 DEBUG:teuthology.orchestra.run.smithi141:> 2023-11-04T01:37:11.582 DEBUG:teuthology.orchestra.run.smithi141:> for f in files: 2023-11-04T01:37:11.583 DEBUG:teuthology.orchestra.run.smithi141:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:37:11.583 DEBUG:teuthology.orchestra.run.smithi141:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:37:11.583 DEBUG:teuthology.orchestra.run.smithi141:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:37:11.583 DEBUG:teuthology.orchestra.run.smithi141:> contents = proc_f.read() 2023-11-04T01:37:11.583 DEBUG:teuthology.orchestra.run.smithi141:> if mountpoint in contents: 2023-11-04T01:37:11.583 DEBUG:teuthology.orchestra.run.smithi141:> return f 2023-11-04T01:37:11.583 DEBUG:teuthology.orchestra.run.smithi141:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:37:11.583 DEBUG:teuthology.orchestra.run.smithi141:> 2023-11-04T01:37:11.583 DEBUG:teuthology.orchestra.run.smithi141:> print(_find_admin_socket("client.3")) 2023-11-04T01:37:11.583 DEBUG:teuthology.orchestra.run.smithi141:> ' 2023-11-04T01:37:11.709 INFO:teuthology.orchestra.run.smithi141.stdout:/var/run/ceph/ceph-client.3.125465.asok 2023-11-04T01:37:11.712 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:11.720 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.125465.asok 2023-11-04T01:37:11.720 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:11.720 DEBUG:teuthology.orchestra.run.smithi141:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.3.125465.asok status 2023-11-04T01:37:11.819 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:11.888 INFO:teuthology.orchestra.run.smithi141.stdout:{ 2023-11-04T01:37:11.888 INFO:teuthology.orchestra.run.smithi141.stdout: "metadata": { 2023-11-04T01:37:11.889 INFO:teuthology.orchestra.run.smithi141.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:37:11.889 INFO:teuthology.orchestra.run.smithi141.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:37:11.889 INFO:teuthology.orchestra.run.smithi141.stdout: "entity_id": "3", 2023-11-04T01:37:11.889 INFO:teuthology.orchestra.run.smithi141.stdout: "hostname": "smithi141", 2023-11-04T01:37:11.889 INFO:teuthology.orchestra.run.smithi141.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-04T01:37:11.889 INFO:teuthology.orchestra.run.smithi141.stdout: "pid": "125465", 2023-11-04T01:37:11.889 INFO:teuthology.orchestra.run.smithi141.stdout: "root": "/" 2023-11-04T01:37:11.889 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2023-11-04T01:37:11.889 INFO:teuthology.orchestra.run.smithi141.stdout: "dentry_count": 0, 2023-11-04T01:37:11.889 INFO:teuthology.orchestra.run.smithi141.stdout: "dentry_pinned_count": 0, 2023-11-04T01:37:11.890 INFO:teuthology.orchestra.run.smithi141.stdout: "id": 4774, 2023-11-04T01:37:11.890 INFO:teuthology.orchestra.run.smithi141.stdout: "inst": { 2023-11-04T01:37:11.890 INFO:teuthology.orchestra.run.smithi141.stdout: "name": { 2023-11-04T01:37:11.890 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "client", 2023-11-04T01:37:11.890 INFO:teuthology.orchestra.run.smithi141.stdout: "num": 4774 2023-11-04T01:37:11.890 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2023-11-04T01:37:11.890 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": { 2023-11-04T01:37:11.890 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "v1", 2023-11-04T01:37:11.890 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:37:11.890 INFO:teuthology.orchestra.run.smithi141.stdout: "nonce": 4287660418 2023-11-04T01:37:11.890 INFO:teuthology.orchestra.run.smithi141.stdout: } 2023-11-04T01:37:11.891 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2023-11-04T01:37:11.891 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": { 2023-11-04T01:37:11.891 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "v1", 2023-11-04T01:37:11.891 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:37:11.891 INFO:teuthology.orchestra.run.smithi141.stdout: "nonce": 4287660418 2023-11-04T01:37:11.891 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2023-11-04T01:37:11.891 INFO:teuthology.orchestra.run.smithi141.stdout: "inst_str": "client.4774 192.168.0.2:0/4287660418", 2023-11-04T01:37:11.891 INFO:teuthology.orchestra.run.smithi141.stdout: "addr_str": "192.168.0.2:0/4287660418", 2023-11-04T01:37:11.891 INFO:teuthology.orchestra.run.smithi141.stdout: "inode_count": 1, 2023-11-04T01:37:11.891 INFO:teuthology.orchestra.run.smithi141.stdout: "mds_epoch": 9, 2023-11-04T01:37:11.891 INFO:teuthology.orchestra.run.smithi141.stdout: "osd_epoch": 24, 2023-11-04T01:37:11.891 INFO:teuthology.orchestra.run.smithi141.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:37:11.891 INFO:teuthology.orchestra.run.smithi141.stdout: "blocklisted": false, 2023-11-04T01:37:11.892 INFO:teuthology.orchestra.run.smithi141.stdout: "fs_name": "cephfs" 2023-11-04T01:37:11.892 INFO:teuthology.orchestra.run.smithi141.stdout:} 2023-11-04T01:37:11.895 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:11.902 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:11.902 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:37:11.903 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:11.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:11.970 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2023-11-04T01:37:11.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:11.978 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:11.978 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:11.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:12.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:12.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:12.046 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:12.046 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:37:12.046 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-04T01:37:12.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:12.107 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2023-11-04T01:37:12.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:12.114 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-04T01:37:12.114 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:12.114 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-04T01:37:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:12.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:12.181 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:12.181 DEBUG:teuthology.orchestra.run.smithi141:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:37:12.181 DEBUG:teuthology.orchestra.run.smithi141:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-04T01:37:12.239 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:12.240 INFO:teuthology.orchestra.run.smithi141.stdout:fuseblk 2023-11-04T01:37:12.240 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:12.246 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-04T01:37:12.246 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:12.246 DEBUG:teuthology.orchestra.run.smithi141:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-04T01:37:12.304 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:12.304 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:12.311 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:12.311 DEBUG:teuthology.orchestra.run.smithi141:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:37:12.311 DEBUG:teuthology.orchestra.run.smithi141:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-04T01:37:12.369 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:12.369 INFO:teuthology.orchestra.run.smithi141.stdout:fuseblk 2023-11-04T01:37:12.370 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:12.376 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-04T01:37:12.376 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:12.376 DEBUG:teuthology.orchestra.run.smithi141:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-04T01:37:12.434 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:12.434 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:12.443 INFO:teuthology.run_tasks:Running task exec... 2023-11-04T01:37:12.458 INFO:teuthology.task.exec:Executing custom commands... 2023-11-04T01:37:12.458 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:37:12.458 DEBUG:teuthology.orchestra.run.smithi114:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/crash/warn_recent_interval 0' 2023-11-04T01:37:12.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.562+0000 7fec91bd7640 1 Processor -- start 2023-11-04T01:37:12.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.562+0000 7fec91bd7640 1 -- start start 2023-11-04T01:37:12.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.563+0000 7fec91bd7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fec8c0707d0 0x7fec8c0ae790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.563+0000 7fec91bd7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8c0ceb30 con 0x7fec8c0ce750 2023-11-04T01:37:12.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.563+0000 7fec91bd7640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8c15d580 con 0x7fec8c06a0d0 2023-11-04T01:37:12.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.563+0000 7fec91bd7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8c15e2d0 con 0x7fec8c0707d0 2023-11-04T01:37:12.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.563+0000 7fec8affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fec8c0707d0 0x7fec8c0ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.563+0000 7fec8b7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fec8c0ce750 0x7fec8c0700c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41698/0 (socket says 172.21.15.114:41698) 2023-11-04T01:37:12.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.563+0000 7fec8b7fe640 1 -- 172.21.15.114:0/1054733065 learned_addr learned my addr 172.21.15.114:0/1054733065 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:12.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.564+0000 7fec8affd640 1 -- 172.21.15.114:0/1054733065 >> v1:172.21.15.141:6789/0 conn(0x7fec8c06a0d0 legacy=0x7fec8c06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:12.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.564+0000 7fec8affd640 1 -- 172.21.15.114:0/1054733065 >> v1:172.21.15.114:6789/0 conn(0x7fec8c0ce750 legacy=0x7fec8c0700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.564+0000 7fec8a7fc640 1 -- 172.21.15.114:0/1054733065 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129220869 0 0) 0x7fec8c0ceb30 con 0x7fec8c0ce750 2023-11-04T01:37:12.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.564+0000 7fec8affd640 1 -- 172.21.15.114:0/1054733065 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c15d7f0 con 0x7fec8c0707d0 2023-11-04T01:37:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.564+0000 7fec8affd640 1 --2- 172.21.15.114:0/1054733065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec8c0707d0 0x7fec8c0ae790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fec740097a0 tx=0x7fec7402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31275a9f58c08653 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.564+0000 7fec8a7fc640 1 -- 172.21.15.114:0/1054733065 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74031830 con 0x7fec8c0707d0 2023-11-04T01:37:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.564+0000 7fec8a7fc640 1 -- 172.21.15.114:0/1054733065 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec74031990 con 0x7fec8c0707d0 2023-11-04T01:37:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.564+0000 7fec8a7fc640 1 -- 172.21.15.114:0/1054733065 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74031d20 con 0x7fec8c0707d0 2023-11-04T01:37:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.565+0000 7fec91bd7640 1 -- 172.21.15.114:0/1054733065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec8c0707d0 msgr2=0x7fec8c0ae790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.565+0000 7fec91bd7640 1 --2- 172.21.15.114:0/1054733065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec8c0707d0 0x7fec8c0ae790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fec740097a0 tx=0x7fec7402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.565+0000 7fec91bd7640 1 -- 172.21.15.114:0/1054733065 shutdown_connections 2023-11-04T01:37:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.565+0000 7fec91bd7640 1 --2- 172.21.15.114:0/1054733065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec8c0707d0 0x7fec8c0ae790 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.565+0000 7fec91bd7640 1 -- 172.21.15.114:0/1054733065 >> 172.21.15.114:0/1054733065 conn(0x7fec8c06c0f0 msgr2=0x7fec8c06c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.565+0000 7fec91bd7640 1 -- 172.21.15.114:0/1054733065 shutdown_connections 2023-11-04T01:37:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.565+0000 7fec91bd7640 1 -- 172.21.15.114:0/1054733065 wait complete. 2023-11-04T01:37:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.566+0000 7fec91bd7640 1 Processor -- start 2023-11-04T01:37:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.566+0000 7fec91bd7640 1 -- start start 2023-11-04T01:37:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.567+0000 7fec91bd7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec8c06a0d0 0x7fec8c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.567+0000 7fec91bd7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec8c0707d0 0x7fec8c143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.567+0000 7fec91bd7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec8c0ce750 0x7fec8c156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.567+0000 7fec91bd7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c156210 con 0x7fec8c06a0d0 2023-11-04T01:37:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.567+0000 7fec91bd7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c143d00 con 0x7fec8c0ce750 2023-11-04T01:37:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.567+0000 7fec91bd7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c143fe0 con 0x7fec8c0707d0 2023-11-04T01:37:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.567+0000 7fec8b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec8c06a0d0 0x7fec8c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.567+0000 7fec8b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec8c06a0d0 0x7fec8c155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56126/0 (socket says 172.21.15.114:56126) 2023-11-04T01:37:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.567+0000 7fec8b7fe640 1 -- 172.21.15.114:0/2404843823 learned_addr learned my addr 172.21.15.114:0/2404843823 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.567+0000 7fec8b7fe640 1 -- 172.21.15.114:0/2404843823 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec8c0707d0 msgr2=0x7fec8c143400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.567+0000 7fec8b7fe640 1 --2- 172.21.15.114:0/2404843823 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec8c0707d0 0x7fec8c143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.567+0000 7fec8b7fe640 1 -- 172.21.15.114:0/2404843823 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec8c0ce750 msgr2=0x7fec8c156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.567+0000 7fec8b7fe640 1 --2- 172.21.15.114:0/2404843823 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec8c0ce750 0x7fec8c156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.567+0000 7fec8b7fe640 1 -- 172.21.15.114:0/2404843823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec74009400 con 0x7fec8c06a0d0 2023-11-04T01:37:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.568+0000 7fec8b7fe640 1 --2- 172.21.15.114:0/2404843823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec8c06a0d0 0x7fec8c155cd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00c890 tx=0x7fec7c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.568+0000 7fec83fff640 1 -- 172.21.15.114:0/2404843823 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c00a640 con 0x7fec8c06a0d0 2023-11-04T01:37:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.568+0000 7fec83fff640 1 -- 172.21.15.114:0/2404843823 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c00a7c0 con 0x7fec8c06a0d0 2023-11-04T01:37:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.568+0000 7fec83fff640 1 -- 172.21.15.114:0/2404843823 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c00ab70 con 0x7fec8c06a0d0 2023-11-04T01:37:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.568+0000 7fec91bd7640 1 -- 172.21.15.114:0/2404843823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8c1442c0 con 0x7fec8c06a0d0 2023-11-04T01:37:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.568+0000 7fec91bd7640 1 -- 172.21.15.114:0/2404843823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8c0b22f0 con 0x7fec8c06a0d0 2023-11-04T01:37:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.569+0000 7fec91bd7640 1 -- 172.21.15.114:0/2404843823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec8c0b24e0 con 0x7fec8c06a0d0 2023-11-04T01:37:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.569+0000 7fec83fff640 1 -- 172.21.15.114:0/2404843823 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fec7c00acd0 con 0x7fec8c06a0d0 2023-11-04T01:37:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.569+0000 7fec83fff640 1 --2- 172.21.15.114:0/2404843823 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec6c06aea0 0x7fec6c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.569+0000 7fec83fff640 1 -- 172.21.15.114:0/2404843823 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fec7c088e30 con 0x7fec8c06a0d0 2023-11-04T01:37:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.570+0000 7fec8affd640 1 --2- 172.21.15.114:0/2404843823 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec6c06aea0 0x7fec6c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.570+0000 7fec8affd640 1 --2- 172.21.15.114:0/2404843823 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec6c06aea0 0x7fec6c06d360 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fec74036000 tx=0x7fec74030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.574+0000 7fec83fff640 1 -- 172.21.15.114:0/2404843823 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fec7c053bb0 con 0x7fec8c06a0d0 2023-11-04T01:37:12.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.740+0000 7fec91bd7640 1 -- 172.21.15.114:0/2404843823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mgr/crash/warn_recent_interval}] v 0) v1 -- 0x7fec8c04ece0 con 0x7fec8c06a0d0 2023-11-04T01:37:12.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.743+0000 7fec83fff640 1 -- 172.21.15.114:0/2404843823 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/crash/warn_recent_interval}]=0 v10)=0 v10) v1 ==== 128+0+0 (secure 0 0 0) 0x7fec7c018020 con 0x7fec8c06a0d0 2023-11-04T01:37:12.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.745+0000 7fec91bd7640 1 -- 172.21.15.114:0/2404843823 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec6c06aea0 msgr2=0x7fec6c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.745+0000 7fec91bd7640 1 --2- 172.21.15.114:0/2404843823 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec6c06aea0 0x7fec6c06d360 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fec74036000 tx=0x7fec74030000 comp rx=0 tx=0).stop 2023-11-04T01:37:12.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.745+0000 7fec91bd7640 1 -- 172.21.15.114:0/2404843823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec8c06a0d0 msgr2=0x7fec8c155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.745+0000 7fec91bd7640 1 --2- 172.21.15.114:0/2404843823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec8c06a0d0 0x7fec8c155cd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00c890 tx=0x7fec7c00cd50 comp rx=0 tx=0).stop 2023-11-04T01:37:12.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.745+0000 7fec91bd7640 1 -- 172.21.15.114:0/2404843823 shutdown_connections 2023-11-04T01:37:12.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.745+0000 7fec91bd7640 1 --2- 172.21.15.114:0/2404843823 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec6c06aea0 0x7fec6c06d360 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.745+0000 7fec91bd7640 1 --2- 172.21.15.114:0/2404843823 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec8c0ce750 0x7fec8c156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.745+0000 7fec91bd7640 1 --2- 172.21.15.114:0/2404843823 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec8c0707d0 0x7fec8c143400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.745+0000 7fec91bd7640 1 --2- 172.21.15.114:0/2404843823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec8c06a0d0 0x7fec8c155cd0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.745+0000 7fec91bd7640 1 -- 172.21.15.114:0/2404843823 >> 172.21.15.114:0/2404843823 conn(0x7fec8c06c0f0 msgr2=0x7fec8c0700c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:12.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.746+0000 7fec91bd7640 1 -- 172.21.15.114:0/2404843823 shutdown_connections 2023-11-04T01:37:12.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.746+0000 7fec91bd7640 1 -- 172.21.15.114:0/2404843823 wait complete. 2023-11-04T01:37:12.758 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-04T01:37:12.774 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:12.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.871+0000 7fc1bae34640 1 Processor -- start 2023-11-04T01:37:12.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.871+0000 7fc1bae34640 1 -- start start 2023-11-04T01:37:12.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.872+0000 7fc1bae34640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1b415ce60 0x7fc1b406b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.872+0000 7fc1bae34640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b41615d0 con 0x7fc1b40cf160 2023-11-04T01:37:12.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.872+0000 7fc1bae34640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b41618b0 con 0x7fc1b406bd30 2023-11-04T01:37:12.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.872+0000 7fc1bae34640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b40cbde0 con 0x7fc1b415ce60 2023-11-04T01:37:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.872+0000 7fc1b8bd0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1b415ce60 0x7fc1b406b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.872+0000 7fc1b93d1640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc1b40cf160 0x7fc1b40cc200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41710/0 (socket says 172.21.15.114:41710) 2023-11-04T01:37:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.872+0000 7fc1b93d1640 1 -- 172.21.15.114:0/2434097989 learned_addr learned my addr 172.21.15.114:0/2434097989 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.873+0000 7fc1b8bd0640 1 -- 172.21.15.114:0/2434097989 >> v1:172.21.15.141:6789/0 conn(0x7fc1b406bd30 legacy=0x7fc1b4160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.873+0000 7fc1b8bd0640 1 -- 172.21.15.114:0/2434097989 >> v1:172.21.15.114:6789/0 conn(0x7fc1b40cf160 legacy=0x7fc1b40cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.873+0000 7fc1b37fe640 1 -- 172.21.15.114:0/2434097989 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258842985 0 0) 0x7fc1b41615d0 con 0x7fc1b40cf160 2023-11-04T01:37:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.873+0000 7fc1b8bd0640 1 -- 172.21.15.114:0/2434097989 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b40cba00 con 0x7fc1b415ce60 2023-11-04T01:37:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.873+0000 7fc1b8bd0640 1 --2- 172.21.15.114:0/2434097989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1b415ce60 0x7fc1b406b7f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40097a0 tx=0x7fc1a402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a80a637de642fb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.873+0000 7fc1b37fe640 1 -- 172.21.15.114:0/2434097989 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4030610 con 0x7fc1b415ce60 2023-11-04T01:37:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.874+0000 7fc1b37fe640 1 -- 172.21.15.114:0/2434097989 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a4030770 con 0x7fc1b415ce60 2023-11-04T01:37:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.874+0000 7fc1b37fe640 1 -- 172.21.15.114:0/2434097989 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4030b00 con 0x7fc1b415ce60 2023-11-04T01:37:12.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.874+0000 7fc1bae34640 1 -- 172.21.15.114:0/2434097989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1b415ce60 msgr2=0x7fc1b406b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.874+0000 7fc1bae34640 1 --2- 172.21.15.114:0/2434097989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1b415ce60 0x7fc1b406b7f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40097a0 tx=0x7fc1a402b960 comp rx=0 tx=0).stop 2023-11-04T01:37:12.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.874+0000 7fc1bae34640 1 -- 172.21.15.114:0/2434097989 shutdown_connections 2023-11-04T01:37:12.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.874+0000 7fc1bae34640 1 --2- 172.21.15.114:0/2434097989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1b415ce60 0x7fc1b406b7f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.874+0000 7fc1bae34640 1 -- 172.21.15.114:0/2434097989 >> 172.21.15.114:0/2434097989 conn(0x7fc1b406ea90 msgr2=0x7fc1b406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:12.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.874+0000 7fc1bae34640 1 -- 172.21.15.114:0/2434097989 shutdown_connections 2023-11-04T01:37:12.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.874+0000 7fc1bae34640 1 -- 172.21.15.114:0/2434097989 wait complete. 2023-11-04T01:37:12.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.875+0000 7fc1bae34640 1 Processor -- start 2023-11-04T01:37:12.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.875+0000 7fc1bae34640 1 -- start start 2023-11-04T01:37:12.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.876+0000 7fc1bae34640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1b40cf160 0x7fc1b41f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.876+0000 7fc1bae34640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1b415ce60 0x7fc1b40c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.876+0000 7fc1bae34640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1b415fbe0 0x7fc1b415ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.876+0000 7fc1bae34640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b4160090 con 0x7fc1b415ce60 2023-11-04T01:37:12.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.876+0000 7fc1bae34640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b41f3200 con 0x7fc1b40cf160 2023-11-04T01:37:12.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.876+0000 7fc1bae34640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b41f34e0 con 0x7fc1b415fbe0 2023-11-04T01:37:12.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.876+0000 7fc1b3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1b415ce60 0x7fc1b40c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.876+0000 7fc1b8bd0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1b40cf160 0x7fc1b41f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.876+0000 7fc1b3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1b415ce60 0x7fc1b40c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56138/0 (socket says 172.21.15.114:56138) 2023-11-04T01:37:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.876+0000 7fc1b3fff640 1 -- 172.21.15.114:0/2074064361 learned_addr learned my addr 172.21.15.114:0/2074064361 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.876+0000 7fc1b93d1640 1 --2- 172.21.15.114:0/2074064361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1b415fbe0 0x7fc1b415ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.877+0000 7fc1b3fff640 1 -- 172.21.15.114:0/2074064361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1b415fbe0 msgr2=0x7fc1b415ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.877+0000 7fc1b3fff640 1 --2- 172.21.15.114:0/2074064361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1b415fbe0 0x7fc1b415ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.877+0000 7fc1b3fff640 1 -- 172.21.15.114:0/2074064361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1b40cf160 msgr2=0x7fc1b41f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.877+0000 7fc1b3fff640 1 --2- 172.21.15.114:0/2074064361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1b40cf160 0x7fc1b41f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.877+0000 7fc1b3fff640 1 -- 172.21.15.114:0/2074064361 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a4009400 con 0x7fc1b415ce60 2023-11-04T01:37:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.877+0000 7fc1b3fff640 1 --2- 172.21.15.114:0/2074064361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1b415ce60 0x7fc1b40c8d00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800c400 tx=0x7fc1a800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.877+0000 7fc1b17fa640 1 -- 172.21.15.114:0/2074064361 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80052d0 con 0x7fc1b415ce60 2023-11-04T01:37:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.877+0000 7fc1b17fa640 1 -- 172.21.15.114:0/2074064361 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a8005430 con 0x7fc1b415ce60 2023-11-04T01:37:12.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.877+0000 7fc1bae34640 1 -- 172.21.15.114:0/2074064361 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b41f37c0 con 0x7fc1b415ce60 2023-11-04T01:37:12.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.877+0000 7fc1b17fa640 1 -- 172.21.15.114:0/2074064361 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8003830 con 0x7fc1b415ce60 2023-11-04T01:37:12.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.877+0000 7fc1bae34640 1 -- 172.21.15.114:0/2074064361 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b41f3e30 con 0x7fc1b415ce60 2023-11-04T01:37:12.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.878+0000 7fc1bae34640 1 -- 172.21.15.114:0/2074064361 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b4074290 con 0x7fc1b415ce60 2023-11-04T01:37:12.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.878+0000 7fc1b17fa640 1 -- 172.21.15.114:0/2074064361 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1a8003990 con 0x7fc1b415ce60 2023-11-04T01:37:12.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.879+0000 7fc1b17fa640 1 --2- 172.21.15.114:0/2074064361 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc1a006ae70 0x7fc1a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:12.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.879+0000 7fc1b8bd0640 1 --2- 172.21.15.114:0/2074064361 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc1a006ae70 0x7fc1a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:12.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.879+0000 7fc1b17fa640 1 -- 172.21.15.114:0/2074064361 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc1a8088e10 con 0x7fc1b415ce60 2023-11-04T01:37:12.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.879+0000 7fc1b8bd0640 1 --2- 172.21.15.114:0/2074064361 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc1a006ae70 0x7fc1a006d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4036000 tx=0x7fc1a4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:12.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:12.883+0000 7fc1b17fa640 1 -- 172.21.15.114:0/2074064361 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc1a8053c40 con 0x7fc1b415ce60 2023-11-04T01:37:13.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.050+0000 7fc1bae34640 1 -- 172.21.15.114:0/2074064361 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1b406b3e0 con 0x7fc1b415ce60 2023-11-04T01:37:13.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.051+0000 7fc1b17fa640 1 -- 172.21.15.114:0/2074064361 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18796 (secure 0 0 0) 0x7fc1a8017090 con 0x7fc1b415ce60 2023-11-04T01:37:13.053 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:13.053 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:11.562429+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:13.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.053+0000 7fc1bae34640 1 -- 172.21.15.114:0/2074064361 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc1a006ae70 msgr2=0x7fc1a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.053+0000 7fc1bae34640 1 --2- 172.21.15.114:0/2074064361 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc1a006ae70 0x7fc1a006d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4036000 tx=0x7fc1a4008030 comp rx=0 tx=0).stop 2023-11-04T01:37:13.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.053+0000 7fc1bae34640 1 -- 172.21.15.114:0/2074064361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1b415ce60 msgr2=0x7fc1b40c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.053+0000 7fc1bae34640 1 --2- 172.21.15.114:0/2074064361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1b415ce60 0x7fc1b40c8d00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800c400 tx=0x7fc1a800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.053+0000 7fc1bae34640 1 -- 172.21.15.114:0/2074064361 shutdown_connections 2023-11-04T01:37:13.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.053+0000 7fc1bae34640 1 --2- 172.21.15.114:0/2074064361 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1b415fbe0 0x7fc1b415ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.053+0000 7fc1bae34640 1 --2- 172.21.15.114:0/2074064361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1b415ce60 0x7fc1b40c8d00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.053+0000 7fc1bae34640 1 --2- 172.21.15.114:0/2074064361 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc1a006ae70 0x7fc1a006d330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.053+0000 7fc1bae34640 1 --2- 172.21.15.114:0/2074064361 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1b40cf160 0x7fc1b41f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.053+0000 7fc1bae34640 1 -- 172.21.15.114:0/2074064361 >> 172.21.15.114:0/2074064361 conn(0x7fc1b406ea90 msgr2=0x7fc1b40c46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:13.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.053+0000 7fc1bae34640 1 -- 172.21.15.114:0/2074064361 shutdown_connections 2023-11-04T01:37:13.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.053+0000 7fc1bae34640 1 -- 172.21.15.114:0/2074064361 wait complete. 2023-11-04T01:37:13.066 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:13.066 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:13.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.168+0000 7f2f33894640 1 Processor -- start 2023-11-04T01:37:13.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.169+0000 7f2f33894640 1 -- start start 2023-11-04T01:37:13.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.169+0000 7f2f33894640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2f2c0ca0a0 0x7f2f2c0cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.169+0000 7f2f33894640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f2c0cc300 0x7f2f2c0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.169+0000 7f2f33894640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2c0caa20 con 0x7f2f2c15e3f0 2023-11-04T01:37:13.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.169+0000 7f2f33894640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c0b3300 con 0x7f2f2c0ca0a0 2023-11-04T01:37:13.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.169+0000 7f2f33894640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c0cb230 con 0x7f2f2c0cc300 2023-11-04T01:37:13.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.170+0000 7f2f31e31640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f2c0cc300 0x7f2f2c0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.170+0000 7f2f30e2f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2f2c0ca0a0 0x7f2f2c0cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.170+0000 7f2f31630640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f2f2c15e3f0 0x7f2f2c0b2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:38404/0 (socket says 172.21.15.114:38404) 2023-11-04T01:37:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.170+0000 7f2f30e2f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2f2c0ca0a0 0x7f2f2c0cc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:58918/0 (socket says 172.21.15.114:58918) 2023-11-04T01:37:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.170+0000 7f2f31630640 1 -- 172.21.15.114:0/517272760 learned_addr learned my addr 172.21.15.114:0/517272760 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.170+0000 7f2f31e31640 1 -- 172.21.15.114:0/517272760 >> v2:172.21.15.141:3300/0 conn(0x7f2f2c0ca0a0 msgr2=0x7f2f2c0cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.170+0000 7f2f31e31640 1 --2- 172.21.15.114:0/517272760 >> v2:172.21.15.141:3300/0 conn(0x7f2f2c0ca0a0 0x7f2f2c0cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.170+0000 7f2f31e31640 1 -- 172.21.15.114:0/517272760 >> v1:172.21.15.141:6789/0 conn(0x7f2f2c15e3f0 legacy=0x7f2f2c0b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.170+0000 7f2f31e31640 1 -- 172.21.15.114:0/517272760 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c0ca530 con 0x7f2f2c0cc300 2023-11-04T01:37:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.170+0000 7f2f30e2f640 1 --2- 172.21.15.114:0/517272760 >> v2:172.21.15.141:3300/0 conn(0x7f2f2c0ca0a0 0x7f2f2c0cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:13.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.171+0000 7f2f31e31640 1 --2- 172.21.15.114:0/517272760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f2c0cc300 0x7f2f2c0cce60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009d90 tx=0x7f2f2402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c41b98264ed8c6a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.171+0000 7f2f23fff640 1 -- 172.21.15.114:0/517272760 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2402cc50 con 0x7f2f2c0cc300 2023-11-04T01:37:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.171+0000 7f2f23fff640 1 -- 172.21.15.114:0/517272760 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2402cdb0 con 0x7f2f2c0cc300 2023-11-04T01:37:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.171+0000 7f2f23fff640 1 -- 172.21.15.114:0/517272760 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f24034660 con 0x7f2f2c0cc300 2023-11-04T01:37:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.171+0000 7f2f33894640 1 -- 172.21.15.114:0/517272760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f2c0cc300 msgr2=0x7f2f2c0cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.171+0000 7f2f33894640 1 --2- 172.21.15.114:0/517272760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f2c0cc300 0x7f2f2c0cce60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009d90 tx=0x7f2f2402bea0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.171+0000 7f2f33894640 1 -- 172.21.15.114:0/517272760 shutdown_connections 2023-11-04T01:37:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.171+0000 7f2f33894640 1 --2- 172.21.15.114:0/517272760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f2c0cc300 0x7f2f2c0cce60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.171+0000 7f2f33894640 1 --2- 172.21.15.114:0/517272760 >> v2:172.21.15.141:3300/0 conn(0x7f2f2c0ca0a0 0x7f2f2c0cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.171+0000 7f2f33894640 1 -- 172.21.15.114:0/517272760 >> 172.21.15.114:0/517272760 conn(0x7f2f2c071820 msgr2=0x7f2f2c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.171+0000 7f2f33894640 1 -- 172.21.15.114:0/517272760 shutdown_connections 2023-11-04T01:37:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.172+0000 7f2f33894640 1 -- 172.21.15.114:0/517272760 wait complete. 2023-11-04T01:37:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.173+0000 7f2f33894640 1 Processor -- start 2023-11-04T01:37:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.173+0000 7f2f33894640 1 -- start start 2023-11-04T01:37:13.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.173+0000 7f2f33894640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f2c0cc300 0x7f2f2c1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.173+0000 7f2f33894640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f2c15e3f0 0x7f2f2c1598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.173+0000 7f2f33894640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f2c15a220 0x7f2f2c15a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.173+0000 7f2f33894640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c159490 con 0x7f2f2c15e3f0 2023-11-04T01:37:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.173+0000 7f2f33894640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c158b30 con 0x7f2f2c0cc300 2023-11-04T01:37:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.173+0000 7f2f33894640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c15ad90 con 0x7f2f2c15a220 2023-11-04T01:37:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.173+0000 7f2f30e2f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f2c15e3f0 0x7f2f2c1598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.174+0000 7f2f31630640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f2c0cc300 0x7f2f2c1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.174+0000 7f2f31e31640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f2c15a220 0x7f2f2c15a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.174+0000 7f2f30e2f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f2c15e3f0 0x7f2f2c1598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56148/0 (socket says 172.21.15.114:56148) 2023-11-04T01:37:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.174+0000 7f2f30e2f640 1 -- 172.21.15.114:0/3445417116 learned_addr learned my addr 172.21.15.114:0/3445417116 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:13.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.174+0000 7f2f30e2f640 1 -- 172.21.15.114:0/3445417116 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f2c15a220 msgr2=0x7f2f2c15a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.174+0000 7f2f30e2f640 1 --2- 172.21.15.114:0/3445417116 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f2c15a220 0x7f2f2c15a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.174+0000 7f2f30e2f640 1 -- 172.21.15.114:0/3445417116 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f2c0cc300 msgr2=0x7f2f2c1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.174+0000 7f2f30e2f640 1 --2- 172.21.15.114:0/3445417116 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f2c0cc300 0x7f2f2c1548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.174+0000 7f2f30e2f640 1 -- 172.21.15.114:0/3445417116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c009400 con 0x7f2f2c15e3f0 2023-11-04T01:37:13.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.174+0000 7f2f31630640 1 --2- 172.21.15.114:0/3445417116 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f2c0cc300 0x7f2f2c1548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:13.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.174+0000 7f2f30e2f640 1 --2- 172.21.15.114:0/3445417116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f2c15e3f0 0x7f2f2c1598b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00ebe0 tx=0x7f2f1c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.174+0000 7f2f21ffb640 1 -- 172.21.15.114:0/3445417116 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c009760 con 0x7f2f2c15e3f0 2023-11-04T01:37:13.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.174+0000 7f2f33894640 1 -- 172.21.15.114:0/3445417116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f24009a70 con 0x7f2f2c15e3f0 2023-11-04T01:37:13.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.174+0000 7f2f21ffb640 1 -- 172.21.15.114:0/3445417116 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c00cc30 con 0x7f2f2c15e3f0 2023-11-04T01:37:13.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.174+0000 7f2f21ffb640 1 -- 172.21.15.114:0/3445417116 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c00eee0 con 0x7f2f2c15e3f0 2023-11-04T01:37:13.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.174+0000 7f2f33894640 1 -- 172.21.15.114:0/3445417116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c158dd0 con 0x7f2f2c15e3f0 2023-11-04T01:37:13.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.175+0000 7f2f33894640 1 -- 172.21.15.114:0/3445417116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2c1595d0 con 0x7f2f2c15e3f0 2023-11-04T01:37:13.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.176+0000 7f2f21ffb640 1 -- 172.21.15.114:0/3445417116 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f1c013470 con 0x7f2f2c15e3f0 2023-11-04T01:37:13.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.176+0000 7f2f21ffb640 1 --2- 172.21.15.114:0/3445417116 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2f1006ae70 0x7f2f1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.176+0000 7f2f21ffb640 1 -- 172.21.15.114:0/3445417116 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f1c089bf0 con 0x7f2f2c15e3f0 2023-11-04T01:37:13.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.176+0000 7f2f31630640 1 --2- 172.21.15.114:0/3445417116 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2f1006ae70 0x7f2f1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.177+0000 7f2f31630640 1 --2- 172.21.15.114:0/3445417116 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2f1006ae70 0x7f2f1006d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2f28005880 tx=0x7f2f28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.180+0000 7f2f21ffb640 1 -- 172.21.15.114:0/3445417116 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f2c1595d0 con 0x7f2f2c15e3f0 2023-11-04T01:37:13.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.346+0000 7f2f33894640 1 -- 172.21.15.114:0/3445417116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f2c1595d0 con 0x7f2f2c15e3f0 2023-11-04T01:37:13.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.346+0000 7f2f21ffb640 1 -- 172.21.15.114:0/3445417116 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f2c1595d0 con 0x7f2f2c15e3f0 2023-11-04T01:37:13.348 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:37:13.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.348+0000 7f2f33894640 1 -- 172.21.15.114:0/3445417116 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2f1006ae70 msgr2=0x7f2f1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.348+0000 7f2f33894640 1 --2- 172.21.15.114:0/3445417116 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2f1006ae70 0x7f2f1006d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2f28005880 tx=0x7f2f28009040 comp rx=0 tx=0).stop 2023-11-04T01:37:13.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.348+0000 7f2f33894640 1 -- 172.21.15.114:0/3445417116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f2c15e3f0 msgr2=0x7f2f2c1598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.348+0000 7f2f33894640 1 --2- 172.21.15.114:0/3445417116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f2c15e3f0 0x7f2f2c1598b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00ebe0 tx=0x7f2f1c00c520 comp rx=0 tx=0).stop 2023-11-04T01:37:13.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.348+0000 7f2f33894640 1 -- 172.21.15.114:0/3445417116 shutdown_connections 2023-11-04T01:37:13.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.348+0000 7f2f33894640 1 --2- 172.21.15.114:0/3445417116 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f2c15a220 0x7f2f2c15a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.348+0000 7f2f33894640 1 --2- 172.21.15.114:0/3445417116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f2c15e3f0 0x7f2f2c1598b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.348+0000 7f2f33894640 1 --2- 172.21.15.114:0/3445417116 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2f1006ae70 0x7f2f1006d330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.348+0000 7f2f33894640 1 --2- 172.21.15.114:0/3445417116 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f2c0cc300 0x7f2f2c1548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.348+0000 7f2f33894640 1 -- 172.21.15.114:0/3445417116 >> 172.21.15.114:0/3445417116 conn(0x7f2f2c071820 msgr2=0x7f2f2c0b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:13.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.348+0000 7f2f33894640 1 -- 172.21.15.114:0/3445417116 shutdown_connections 2023-11-04T01:37:13.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.348+0000 7f2f33894640 1 -- 172.21.15.114:0/3445417116 wait complete. 2023-11-04T01:37:13.361 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:13.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.461+0000 7f343cbc5640 1 Processor -- start 2023-11-04T01:37:13.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.461+0000 7f343cbc5640 1 -- start start 2023-11-04T01:37:13.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.462+0000 7f343cbc5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34381603d0 0x7f34380b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.462+0000 7f343cbc5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f343806a830 0x7f34380ca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.462+0000 7f343cbc5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34380cdf80 con 0x7f34380722a0 2023-11-04T01:37:13.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.462+0000 7f343cbc5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34380b19d0 con 0x7f343806a830 2023-11-04T01:37:13.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.462+0000 7f343cbc5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34380ce6f0 con 0x7f34381603d0 2023-11-04T01:37:13.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.462+0000 7f3436d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f343806a830 0x7f34380ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.462+0000 7f3435d9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f34380722a0 0x7f343806a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41716/0 (socket says 172.21.15.114:41716) 2023-11-04T01:37:13.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.462+0000 7f3435d9b640 1 -- 172.21.15.114:0/1755182436 learned_addr learned my addr 172.21.15.114:0/1755182436 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:13.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.463+0000 7f343659c640 1 --2- 172.21.15.114:0/1755182436 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34381603d0 0x7f34380b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.463+0000 7f3436d9d640 1 -- 172.21.15.114:0/1755182436 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34381603d0 msgr2=0x7f34380b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:13.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.463+0000 7f3436d9d640 1 --2- 172.21.15.114:0/1755182436 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34381603d0 0x7f34380b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.463+0000 7f3436d9d640 1 -- 172.21.15.114:0/1755182436 >> v1:172.21.15.114:6789/0 conn(0x7f34380722a0 legacy=0x7f343806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.463+0000 7f3436d9d640 1 -- 172.21.15.114:0/1755182436 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3438072700 con 0x7f343806a830 2023-11-04T01:37:13.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.463+0000 7f343559a640 1 -- 172.21.15.114:0/1755182436 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655739499 0 0) 0x7f34380cdf80 con 0x7f34380722a0 2023-11-04T01:37:13.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.463+0000 7f3436d9d640 1 --2- 172.21.15.114:0/1755182436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f343806a830 0x7f34380ca380 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3430009d90 tx=0x7f343002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6439d1ad0f03d20f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.464+0000 7f343559a640 1 -- 172.21.15.114:0/1755182436 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343002cbc0 con 0x7f343806a830 2023-11-04T01:37:13.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.464+0000 7f343559a640 1 -- 172.21.15.114:0/1755182436 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343002cd20 con 0x7f343806a830 2023-11-04T01:37:13.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.464+0000 7f343559a640 1 -- 172.21.15.114:0/1755182436 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430034660 con 0x7f343806a830 2023-11-04T01:37:13.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.464+0000 7f343cbc5640 1 -- 172.21.15.114:0/1755182436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f343806a830 msgr2=0x7f34380ca380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.464+0000 7f343cbc5640 1 --2- 172.21.15.114:0/1755182436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f343806a830 0x7f34380ca380 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3430009d90 tx=0x7f343002be10 comp rx=0 tx=0).stop 2023-11-04T01:37:13.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.464+0000 7f343cbc5640 1 -- 172.21.15.114:0/1755182436 shutdown_connections 2023-11-04T01:37:13.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.464+0000 7f343cbc5640 1 --2- 172.21.15.114:0/1755182436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f343806a830 0x7f34380ca380 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.464+0000 7f343cbc5640 1 --2- 172.21.15.114:0/1755182436 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34381603d0 0x7f34380b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.464+0000 7f343cbc5640 1 -- 172.21.15.114:0/1755182436 >> 172.21.15.114:0/1755182436 conn(0x7f343806d800 msgr2=0x7f343806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:13.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.464+0000 7f343cbc5640 1 -- 172.21.15.114:0/1755182436 shutdown_connections 2023-11-04T01:37:13.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.464+0000 7f343cbc5640 1 -- 172.21.15.114:0/1755182436 wait complete. 2023-11-04T01:37:13.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.466+0000 7f343cbc5640 1 Processor -- start 2023-11-04T01:37:13.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.466+0000 7f343cbc5640 1 -- start start 2023-11-04T01:37:13.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.466+0000 7f343cbc5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f343806a830 0x7f34381513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.466+0000 7f343cbc5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34380722a0 0x7f34380b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.466+0000 7f343cbc5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34381603d0 0x7f34380b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.466+0000 7f343cbc5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3438155fd0 con 0x7f343806a830 2023-11-04T01:37:13.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.466+0000 7f343cbc5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34380b4610 con 0x7f34381603d0 2023-11-04T01:37:13.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.466+0000 7f343cbc5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34380b48f0 con 0x7f34380722a0 2023-11-04T01:37:13.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.466+0000 7f343659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f343806a830 0x7f34381513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.466+0000 7f343659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f343806a830 0x7f34381513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56164/0 (socket says 172.21.15.114:56164) 2023-11-04T01:37:13.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.466+0000 7f343659c640 1 -- 172.21.15.114:0/1140767710 learned_addr learned my addr 172.21.15.114:0/1140767710 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:13.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.466+0000 7f3435d9b640 1 --2- 172.21.15.114:0/1140767710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34380722a0 0x7f34380b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.466+0000 7f3436d9d640 1 --2- 172.21.15.114:0/1140767710 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34381603d0 0x7f34380b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.467+0000 7f343659c640 1 -- 172.21.15.114:0/1140767710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34380722a0 msgr2=0x7f34380b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.467+0000 7f343659c640 1 --2- 172.21.15.114:0/1140767710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34380722a0 0x7f34380b3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.467+0000 7f343659c640 1 -- 172.21.15.114:0/1140767710 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34381603d0 msgr2=0x7f34380b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.467+0000 7f343659c640 1 --2- 172.21.15.114:0/1140767710 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34381603d0 0x7f34380b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.467+0000 7f343659c640 1 -- 172.21.15.114:0/1140767710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3430009a70 con 0x7f343806a830 2023-11-04T01:37:13.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.467+0000 7f3436d9d640 1 --2- 172.21.15.114:0/1140767710 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34381603d0 0x7f34380b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:13.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.467+0000 7f3435d9b640 1 --2- 172.21.15.114:0/1140767710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34380722a0 0x7f34380b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.467+0000 7f343659c640 1 --2- 172.21.15.114:0/1140767710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f343806a830 0x7f34381513f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f342800d5f0 tx=0x7f342800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.467+0000 7f3426ffd640 1 -- 172.21.15.114:0/1140767710 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34280125f0 con 0x7f343806a830 2023-11-04T01:37:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.467+0000 7f3426ffd640 1 -- 172.21.15.114:0/1140767710 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3428012750 con 0x7f343806a830 2023-11-04T01:37:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.467+0000 7f3426ffd640 1 -- 172.21.15.114:0/1140767710 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3428012b00 con 0x7f343806a830 2023-11-04T01:37:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.467+0000 7f343cbc5640 1 -- 172.21.15.114:0/1140767710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3438155bf0 con 0x7f343806a830 2023-11-04T01:37:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.467+0000 7f343cbc5640 1 -- 172.21.15.114:0/1140767710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34381523c0 con 0x7f343806a830 2023-11-04T01:37:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.468+0000 7f343cbc5640 1 -- 172.21.15.114:0/1140767710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34380ce1c0 con 0x7f343806a830 2023-11-04T01:37:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.468+0000 7f3426ffd640 1 -- 172.21.15.114:0/1140767710 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3428012c60 con 0x7f343806a830 2023-11-04T01:37:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.469+0000 7f3426ffd640 1 --2- 172.21.15.114:0/1140767710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f341806ae70 0x7f341806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.469+0000 7f3426ffd640 1 -- 172.21.15.114:0/1140767710 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3428089e10 con 0x7f343806a830 2023-11-04T01:37:13.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.469+0000 7f3435d9b640 1 --2- 172.21.15.114:0/1140767710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f341806ae70 0x7f341806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.469+0000 7f3435d9b640 1 --2- 172.21.15.114:0/1140767710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f341806ae70 0x7f341806d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f343815a8a0 tx=0x7f342c007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.473+0000 7f3426ffd640 1 -- 172.21.15.114:0/1140767710 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3428054b90 con 0x7f343806a830 2023-11-04T01:37:13.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.639+0000 7f343cbc5640 1 -- 172.21.15.114:0/1140767710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34380b5990 con 0x7f343806a830 2023-11-04T01:37:13.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.639+0000 7f3426ffd640 1 -- 172.21.15.114:0/1140767710 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f34280581b0 con 0x7f343806a830 2023-11-04T01:37:13.642 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:13.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.641+0000 7f343cbc5640 1 -- 172.21.15.114:0/1140767710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f341806ae70 msgr2=0x7f341806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.641+0000 7f343cbc5640 1 --2- 172.21.15.114:0/1140767710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f341806ae70 0x7f341806d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f343815a8a0 tx=0x7f342c007c10 comp rx=0 tx=0).stop 2023-11-04T01:37:13.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.641+0000 7f343cbc5640 1 -- 172.21.15.114:0/1140767710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f343806a830 msgr2=0x7f34381513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.641+0000 7f343cbc5640 1 --2- 172.21.15.114:0/1140767710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f343806a830 0x7f34381513f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f342800d5f0 tx=0x7f342800dab0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.641+0000 7f343cbc5640 1 -- 172.21.15.114:0/1140767710 shutdown_connections 2023-11-04T01:37:13.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.641+0000 7f343cbc5640 1 --2- 172.21.15.114:0/1140767710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f341806ae70 0x7f341806d330 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.641+0000 7f343cbc5640 1 --2- 172.21.15.114:0/1140767710 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34381603d0 0x7f34380b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.641+0000 7f343cbc5640 1 --2- 172.21.15.114:0/1140767710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34380722a0 0x7f34380b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.641+0000 7f343cbc5640 1 --2- 172.21.15.114:0/1140767710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f343806a830 0x7f34381513f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.641+0000 7f343cbc5640 1 -- 172.21.15.114:0/1140767710 >> 172.21.15.114:0/1140767710 conn(0x7f343806d800 msgr2=0x7f3438159860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:13.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.641+0000 7f343cbc5640 1 -- 172.21.15.114:0/1140767710 shutdown_connections 2023-11-04T01:37:13.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.641+0000 7f343cbc5640 1 -- 172.21.15.114:0/1140767710 wait complete. 2023-11-04T01:37:13.654 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:13.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.755+0000 7f3233e87640 1 Processor -- start 2023-11-04T01:37:13.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.755+0000 7f3233e87640 1 -- start start 2023-11-04T01:37:13.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3233e87640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f322c15e3f0 0x7f322c0b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3233e87640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322c0caa20 con 0x7f322c0ca0a0 2023-11-04T01:37:13.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3233e87640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322c0cb230 con 0x7f322c0cc300 2023-11-04T01:37:13.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3233e87640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322c0ca530 con 0x7f322c15e3f0 2023-11-04T01:37:13.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3231422640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f322c0ca0a0 0x7f322c0cc920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41720/0 (socket says 172.21.15.114:41720) 2023-11-04T01:37:13.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3231422640 1 -- 172.21.15.114:0/2735927887 learned_addr learned my addr 172.21.15.114:0/2735927887 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:13.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3231c23640 1 --2- 172.21.15.114:0/2735927887 >> v2:172.21.15.141:3300/0 conn(0x7f322c15e3f0 0x7f322c0b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3230c21640 1 -- 172.21.15.114:0/2735927887 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577539190 0 0) 0x7f322c0caa20 con 0x7f322c0ca0a0 2023-11-04T01:37:13.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3230c21640 1 -- 172.21.15.114:0/2735927887 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3218003520 con 0x7f322c0ca0a0 2023-11-04T01:37:13.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3230c21640 1 -- 172.21.15.114:0/2735927887 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1029771331 0 0) 0x7f3218003520 con 0x7f322c0ca0a0 2023-11-04T01:37:13.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3230c21640 1 -- 172.21.15.114:0/2735927887 >> v2:172.21.15.141:3300/0 conn(0x7f322c15e3f0 msgr2=0x7f322c0b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:13.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3230c21640 1 --2- 172.21.15.114:0/2735927887 >> v2:172.21.15.141:3300/0 conn(0x7f322c15e3f0 0x7f322c0b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3230c21640 1 -- 172.21.15.114:0/2735927887 >> v1:172.21.15.141:6789/0 conn(0x7f322c0cc300 legacy=0x7f322c0b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3230c21640 1 -- 172.21.15.114:0/2735927887 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c0cac70 con 0x7f322c0ca0a0 2023-11-04T01:37:13.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3230c21640 1 -- 172.21.15.114:0/2735927887 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f321c001670 con 0x7f322c0ca0a0 2023-11-04T01:37:13.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3230c21640 1 -- 172.21.15.114:0/2735927887 >> v1:172.21.15.114:6789/0 conn(0x7f322c0ca0a0 legacy=0x7f322c0cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3230c21640 1 --2- 172.21.15.114:0/2735927887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3218003970 0x7f3218003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3230c21640 1 --2- 172.21.15.114:0/2735927887 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32180047c0 0x7f3218004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3230c21640 1 --2- 172.21.15.114:0/2735927887 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3218005180 0x7f321800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3230c21640 1 -- 172.21.15.114:0/2735927887 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0ca530 con 0x7f3218003970 2023-11-04T01:37:13.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3230c21640 1 -- 172.21.15.114:0/2735927887 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321800c020 con 0x7f32180047c0 2023-11-04T01:37:13.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.756+0000 7f3230c21640 1 -- 172.21.15.114:0/2735927887 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321800c1e0 con 0x7f3218005180 2023-11-04T01:37:13.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.757+0000 7f3231c23640 1 --2- 172.21.15.114:0/2735927887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3218003970 0x7f3218003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.757+0000 7f3231422640 1 --2- 172.21.15.114:0/2735927887 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32180047c0 0x7f3218004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.757+0000 7f3232424640 1 --2- 172.21.15.114:0/2735927887 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3218005180 0x7f321800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.757+0000 7f3231c23640 1 -- 172.21.15.114:0/2735927887 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3218005180 msgr2=0x7f321800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:13.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.757+0000 7f3231c23640 1 --2- 172.21.15.114:0/2735927887 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3218005180 0x7f321800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.757+0000 7f3231c23640 1 -- 172.21.15.114:0/2735927887 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32180047c0 msgr2=0x7f3218004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:13.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.757+0000 7f3231c23640 1 --2- 172.21.15.114:0/2735927887 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32180047c0 0x7f3218004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.757+0000 7f3231c23640 1 -- 172.21.15.114:0/2735927887 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3218003520 con 0x7f3218003970 2023-11-04T01:37:13.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.757+0000 7f3232424640 1 -- 172.21.15.114:0/2735927887 reap_dead start 2023-11-04T01:37:13.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.757+0000 7f3231422640 1 --2- 172.21.15.114:0/2735927887 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32180047c0 0x7f3218004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:13.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.757+0000 7f3231c23640 1 --2- 172.21.15.114:0/2735927887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3218003970 0x7f3218003d90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3228009ac0 tx=0x7f32180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8480c45831edcfd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.758+0000 7f3230c21640 1 -- 172.21.15.114:0/2735927887 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322802c6d0 con 0x7f3218003970 2023-11-04T01:37:13.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.758+0000 7f3230c21640 1 -- 172.21.15.114:0/2735927887 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322802c830 con 0x7f3218003970 2023-11-04T01:37:13.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.758+0000 7f3230c21640 1 -- 172.21.15.114:0/2735927887 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322802cbc0 con 0x7f3218003970 2023-11-04T01:37:13.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.758+0000 7f3233e87640 1 -- 172.21.15.114:0/2735927887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3218003970 msgr2=0x7f3218003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.758+0000 7f3233e87640 1 --2- 172.21.15.114:0/2735927887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3218003970 0x7f3218003d90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3228009ac0 tx=0x7f32180057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.758+0000 7f3233e87640 1 -- 172.21.15.114:0/2735927887 shutdown_connections 2023-11-04T01:37:13.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.758+0000 7f3233e87640 1 --2- 172.21.15.114:0/2735927887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3218003970 0x7f3218003d90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.758+0000 7f3233e87640 1 -- 172.21.15.114:0/2735927887 >> 172.21.15.114:0/2735927887 conn(0x7f322c071820 msgr2=0x7f322c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:13.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.758+0000 7f3233e87640 1 -- 172.21.15.114:0/2735927887 shutdown_connections 2023-11-04T01:37:13.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.758+0000 7f3233e87640 1 -- 172.21.15.114:0/2735927887 wait complete. 2023-11-04T01:37:13.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.759+0000 7f3233e87640 1 Processor -- start 2023-11-04T01:37:13.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.759+0000 7f3233e87640 1 -- start start 2023-11-04T01:37:13.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.760+0000 7f3233e87640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3218003970 0x7f322c14ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.760+0000 7f3233e87640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f322c1f47b0 0x7f322c1e4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.760+0000 7f3233e87640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f322c1e5050 0x7f322c0b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.760+0000 7f3233e87640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c1f3ac0 con 0x7f322c1f47b0 2023-11-04T01:37:13.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.760+0000 7f3233e87640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c1f4320 con 0x7f322c1e5050 2023-11-04T01:37:13.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.760+0000 7f3233e87640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322c15db30 con 0x7f3218003970 2023-11-04T01:37:13.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.760+0000 7f3231422640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f322c1f47b0 0x7f322c1e4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.760+0000 7f3231422640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f322c1f47b0 0x7f322c1e4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56182/0 (socket says 172.21.15.114:56182) 2023-11-04T01:37:13.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.760+0000 7f3231422640 1 -- 172.21.15.114:0/6352771 learned_addr learned my addr 172.21.15.114:0/6352771 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:13.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.760+0000 7f3231422640 1 -- 172.21.15.114:0/6352771 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3218003970 msgr2=0x7f322c14ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.760+0000 7f3231422640 1 --2- 172.21.15.114:0/6352771 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3218003970 0x7f322c14ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.760+0000 7f3231422640 1 -- 172.21.15.114:0/6352771 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f322c1e5050 msgr2=0x7f322c0b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.760+0000 7f3231422640 1 --2- 172.21.15.114:0/6352771 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f322c1e5050 0x7f322c0b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.760+0000 7f3231422640 1 -- 172.21.15.114:0/6352771 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c1e5680 con 0x7f322c1f47b0 2023-11-04T01:37:13.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.761+0000 7f3231422640 1 --2- 172.21.15.114:0/6352771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f322c1f47b0 0x7f322c1e4b10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f321c001c90 tx=0x7f321c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.761+0000 7f32227fc640 1 -- 172.21.15.114:0/6352771 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c00ee80 con 0x7f322c1f47b0 2023-11-04T01:37:13.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.761+0000 7f32227fc640 1 -- 172.21.15.114:0/6352771 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321c00c870 con 0x7f322c1f47b0 2023-11-04T01:37:13.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.761+0000 7f32227fc640 1 -- 172.21.15.114:0/6352771 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c00cc00 con 0x7f322c1f47b0 2023-11-04T01:37:13.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.761+0000 7f3233e87640 1 -- 172.21.15.114:0/6352771 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322c1f3cd0 con 0x7f322c1f47b0 2023-11-04T01:37:13.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.761+0000 7f3233e87640 1 -- 172.21.15.114:0/6352771 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322c14f320 con 0x7f322c1f47b0 2023-11-04T01:37:13.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.762+0000 7f3233e87640 1 -- 172.21.15.114:0/6352771 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322c074290 con 0x7f322c1f47b0 2023-11-04T01:37:13.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.762+0000 7f32227fc640 1 -- 172.21.15.114:0/6352771 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f321c01d460 con 0x7f322c1f47b0 2023-11-04T01:37:13.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.763+0000 7f32227fc640 1 --2- 172.21.15.114:0/6352771 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f321006ae70 0x7f321006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:13.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.763+0000 7f3231c23640 1 --2- 172.21.15.114:0/6352771 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f321006ae70 0x7f321006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:13.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.763+0000 7f32227fc640 1 -- 172.21.15.114:0/6352771 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f321c0899d0 con 0x7f322c1f47b0 2023-11-04T01:37:13.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.763+0000 7f3231c23640 1 --2- 172.21.15.114:0/6352771 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f321006ae70 0x7f321006d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3228036000 tx=0x7f322802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:13.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.767+0000 7f32227fc640 1 -- 172.21.15.114:0/6352771 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f321c058150 con 0x7f322c1f47b0 2023-11-04T01:37:13.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.934+0000 7f3233e87640 1 -- 172.21.15.114:0/6352771 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f322c1f4460 con 0x7f322c1f47b0 2023-11-04T01:37:13.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.934+0000 7f32227fc640 1 -- 172.21.15.114:0/6352771 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f321c057ce0 con 0x7f322c1f47b0 2023-11-04T01:37:13.936 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:37:13.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.936+0000 7f3233e87640 1 -- 172.21.15.114:0/6352771 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f321006ae70 msgr2=0x7f321006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.936+0000 7f3233e87640 1 --2- 172.21.15.114:0/6352771 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f321006ae70 0x7f321006d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3228036000 tx=0x7f322802e000 comp rx=0 tx=0).stop 2023-11-04T01:37:13.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.936+0000 7f3233e87640 1 -- 172.21.15.114:0/6352771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f322c1f47b0 msgr2=0x7f322c1e4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:13.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.936+0000 7f3233e87640 1 --2- 172.21.15.114:0/6352771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f322c1f47b0 0x7f322c1e4b10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f321c001c90 tx=0x7f321c00ec30 comp rx=0 tx=0).stop 2023-11-04T01:37:13.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.936+0000 7f3233e87640 1 -- 172.21.15.114:0/6352771 shutdown_connections 2023-11-04T01:37:13.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.936+0000 7f3233e87640 1 --2- 172.21.15.114:0/6352771 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f321006ae70 0x7f321006d330 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.936+0000 7f3233e87640 1 --2- 172.21.15.114:0/6352771 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f322c1e5050 0x7f322c0b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.936+0000 7f3233e87640 1 --2- 172.21.15.114:0/6352771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f322c1f47b0 0x7f322c1e4b10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.936+0000 7f3233e87640 1 --2- 172.21.15.114:0/6352771 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3218003970 0x7f322c14ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:13.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.936+0000 7f3233e87640 1 -- 172.21.15.114:0/6352771 >> 172.21.15.114:0/6352771 conn(0x7f322c071820 msgr2=0x7f322c15b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:13.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.936+0000 7f3233e87640 1 -- 172.21.15.114:0/6352771 shutdown_connections 2023-11-04T01:37:13.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:13.936+0000 7f3233e87640 1 -- 172.21.15.114:0/6352771 wait complete. 2023-11-04T01:37:13.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.050+0000 7f2a11494640 1 Processor -- start 2023-11-04T01:37:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.050+0000 7f2a11494640 1 -- start start 2023-11-04T01:37:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.051+0000 7f2a11494640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a0c153e60 0x7f2a0c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.051+0000 7f2a11494640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2a0c0cd6d0 0x7f2a0c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.051+0000 7f2a11494640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0c0cde60 con 0x7f2a0c0b4880 2023-11-04T01:37:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.051+0000 7f2a11494640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0c160f90 con 0x7f2a0c153e60 2023-11-04T01:37:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.051+0000 7f2a11494640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0c15e400 con 0x7f2a0c0cd6d0 2023-11-04T01:37:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.051+0000 7f2a0affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a0c153e60 0x7f2a0c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.051+0000 7f2a0b7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2a0c0b4880 0x7f2a0c06b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41724/0 (socket says 172.21.15.114:41724) 2023-11-04T01:37:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.051+0000 7f2a0b7fe640 1 -- 172.21.15.114:0/2676191184 learned_addr learned my addr 172.21.15.114:0/2676191184 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.051+0000 7f2a0affd640 1 -- 172.21.15.114:0/2676191184 >> v2:172.21.15.141:3300/0 conn(0x7f2a0c0cd6d0 msgr2=0x7f2a0c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.051+0000 7f2a03fff640 1 --2- 172.21.15.114:0/2676191184 >> v2:172.21.15.141:3300/0 conn(0x7f2a0c0cd6d0 0x7f2a0c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.051+0000 7f2a0affd640 1 --2- 172.21.15.114:0/2676191184 >> v2:172.21.15.141:3300/0 conn(0x7f2a0c0cd6d0 0x7f2a0c161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.051+0000 7f2a0affd640 1 -- 172.21.15.114:0/2676191184 >> v1:172.21.15.114:6789/0 conn(0x7f2a0c0b4880 legacy=0x7f2a0c06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.051+0000 7f2a0affd640 1 -- 172.21.15.114:0/2676191184 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c161960 con 0x7f2a0c153e60 2023-11-04T01:37:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.051+0000 7f2a0a7fc640 1 -- 172.21.15.114:0/2676191184 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662389187 0 0) 0x7f2a0c0cde60 con 0x7f2a0c0b4880 2023-11-04T01:37:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.052+0000 7f2a0affd640 1 --2- 172.21.15.114:0/2676191184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a0c153e60 0x7f2a0c15dec0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0c9e80 tx=0x7f29fc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fb5ba92690b278 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.052+0000 7f2a0a7fc640 1 -- 172.21.15.114:0/2676191184 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc031830 con 0x7f2a0c153e60 2023-11-04T01:37:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.052+0000 7f2a0a7fc640 1 -- 172.21.15.114:0/2676191184 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc031990 con 0x7f2a0c153e60 2023-11-04T01:37:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.052+0000 7f2a0a7fc640 1 -- 172.21.15.114:0/2676191184 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc031d20 con 0x7f2a0c153e60 2023-11-04T01:37:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.053+0000 7f2a11494640 1 -- 172.21.15.114:0/2676191184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a0c153e60 msgr2=0x7f2a0c15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.053+0000 7f2a11494640 1 --2- 172.21.15.114:0/2676191184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a0c153e60 0x7f2a0c15dec0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0c9e80 tx=0x7f29fc02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.053+0000 7f2a11494640 1 -- 172.21.15.114:0/2676191184 shutdown_connections 2023-11-04T01:37:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.053+0000 7f2a11494640 1 --2- 172.21.15.114:0/2676191184 >> v2:172.21.15.141:3300/0 conn(0x7f2a0c0cd6d0 0x7f2a0c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.053+0000 7f2a11494640 1 --2- 172.21.15.114:0/2676191184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a0c153e60 0x7f2a0c15dec0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.053+0000 7f2a11494640 1 -- 172.21.15.114:0/2676191184 >> 172.21.15.114:0/2676191184 conn(0x7f2a0c0cf880 msgr2=0x7f2a0c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:14.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.053+0000 7f2a11494640 1 -- 172.21.15.114:0/2676191184 shutdown_connections 2023-11-04T01:37:14.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.053+0000 7f2a11494640 1 -- 172.21.15.114:0/2676191184 wait complete. 2023-11-04T01:37:14.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.054+0000 7f2a11494640 1 Processor -- start 2023-11-04T01:37:14.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.054+0000 7f2a11494640 1 -- start start 2023-11-04T01:37:14.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a11494640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a0c0b4880 0x7f2a0c150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a11494640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a0c0cd6d0 0x7f2a0c15ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a11494640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a0c153e60 0x7f2a0c15ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a11494640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c1f5b30 con 0x7f2a0c0cd6d0 2023-11-04T01:37:14.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a11494640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c1f32c0 con 0x7f2a0c0b4880 2023-11-04T01:37:14.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a11494640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c1f5d40 con 0x7f2a0c153e60 2023-11-04T01:37:14.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a03fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a0c0cd6d0 0x7f2a0c15ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a03fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a0c0cd6d0 0x7f2a0c15ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56200/0 (socket says 172.21.15.114:56200) 2023-11-04T01:37:14.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a03fff640 1 -- 172.21.15.114:0/2713029790 learned_addr learned my addr 172.21.15.114:0/2713029790 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:14.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a03fff640 1 -- 172.21.15.114:0/2713029790 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a0c153e60 msgr2=0x7f2a0c15ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a0affd640 1 --2- 172.21.15.114:0/2713029790 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a0c0b4880 0x7f2a0c150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a03fff640 1 --2- 172.21.15.114:0/2713029790 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a0c153e60 0x7f2a0c15ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a03fff640 1 -- 172.21.15.114:0/2713029790 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a0c0b4880 msgr2=0x7f2a0c150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a03fff640 1 --2- 172.21.15.114:0/2713029790 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a0c0b4880 0x7f2a0c150040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a03fff640 1 -- 172.21.15.114:0/2713029790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc009400 con 0x7f2a0c0cd6d0 2023-11-04T01:37:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a03fff640 1 --2- 172.21.15.114:0/2713029790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a0c0cd6d0 0x7f2a0c15ea10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f29f400c7f0 tx=0x7f29f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a037fe640 1 -- 172.21.15.114:0/2713029790 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4004220 con 0x7f2a0c0cd6d0 2023-11-04T01:37:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a037fe640 1 -- 172.21.15.114:0/2713029790 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f40043a0 con 0x7f2a0c0cd6d0 2023-11-04T01:37:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a11494640 1 -- 172.21.15.114:0/2713029790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0c1f6020 con 0x7f2a0c0cd6d0 2023-11-04T01:37:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a037fe640 1 -- 172.21.15.114:0/2713029790 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4007860 con 0x7f2a0c0cd6d0 2023-11-04T01:37:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.055+0000 7f2a11494640 1 -- 172.21.15.114:0/2713029790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0c150580 con 0x7f2a0c0cd6d0 2023-11-04T01:37:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.056+0000 7f2a11494640 1 -- 172.21.15.114:0/2713029790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a0c1f6540 con 0x7f2a0c0cd6d0 2023-11-04T01:37:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.057+0000 7f2a037fe640 1 -- 172.21.15.114:0/2713029790 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f29f4007bd0 con 0x7f2a0c0cd6d0 2023-11-04T01:37:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.057+0000 7f2a037fe640 1 --2- 172.21.15.114:0/2713029790 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f29ec06aea0 0x7f29ec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.057+0000 7f2a037fe640 1 -- 172.21.15.114:0/2713029790 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f29f40898d0 con 0x7f2a0c0cd6d0 2023-11-04T01:37:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.057+0000 7f2a0affd640 1 --2- 172.21.15.114:0/2713029790 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f29ec06aea0 0x7f29ec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.058+0000 7f2a0affd640 1 --2- 172.21.15.114:0/2713029790 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f29ec06aea0 0x7f29ec06d360 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f29fc036000 tx=0x7f29fc03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.061+0000 7f2a037fe640 1 -- 172.21.15.114:0/2713029790 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2a0c1f6540 con 0x7f2a0c0cd6d0 2023-11-04T01:37:14.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.226+0000 7f2a11494640 1 -- 172.21.15.114:0/2713029790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2a0c1f6540 con 0x7f2a0c0cd6d0 2023-11-04T01:37:14.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.226+0000 7f2a037fe640 1 -- 172.21.15.114:0/2713029790 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2a0c1f6540 con 0x7f2a0c0cd6d0 2023-11-04T01:37:14.228 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.228+0000 7f2a11494640 1 -- 172.21.15.114:0/2713029790 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f29ec06aea0 msgr2=0x7f29ec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.228+0000 7f2a11494640 1 --2- 172.21.15.114:0/2713029790 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f29ec06aea0 0x7f29ec06d360 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f29fc036000 tx=0x7f29fc03c040 comp rx=0 tx=0).stop 2023-11-04T01:37:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.228+0000 7f2a11494640 1 -- 172.21.15.114:0/2713029790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a0c0cd6d0 msgr2=0x7f2a0c15ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.228+0000 7f2a11494640 1 --2- 172.21.15.114:0/2713029790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a0c0cd6d0 0x7f2a0c15ea10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f29f400c7f0 tx=0x7f29f400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.228+0000 7f2a11494640 1 -- 172.21.15.114:0/2713029790 shutdown_connections 2023-11-04T01:37:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.228+0000 7f2a11494640 1 --2- 172.21.15.114:0/2713029790 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a0c153e60 0x7f2a0c15ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.228+0000 7f2a11494640 1 --2- 172.21.15.114:0/2713029790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a0c0cd6d0 0x7f2a0c15ea10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.228+0000 7f2a11494640 1 --2- 172.21.15.114:0/2713029790 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f29ec06aea0 0x7f29ec06d360 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.228+0000 7f2a11494640 1 --2- 172.21.15.114:0/2713029790 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a0c0b4880 0x7f2a0c150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.228+0000 7f2a11494640 1 -- 172.21.15.114:0/2713029790 >> 172.21.15.114:0/2713029790 conn(0x7f2a0c0cf880 msgr2=0x7f2a0c0b4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:14.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.228+0000 7f2a11494640 1 -- 172.21.15.114:0/2713029790 shutdown_connections 2023-11-04T01:37:14.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.228+0000 7f2a11494640 1 -- 172.21.15.114:0/2713029790 wait complete. 2023-11-04T01:37:14.241 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:14.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.339+0000 7f12858d4640 1 Processor -- start 2023-11-04T01:37:14.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.339+0000 7f12858d4640 1 -- start start 2023-11-04T01:37:14.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.339+0000 7f12858d4640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f12800cde60 0x7f128015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.339+0000 7f12858d4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f128015daa0 0x7f1280157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.339+0000 7f12858d4640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128015e000 con 0x7f12800ce240 2023-11-04T01:37:14.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.339+0000 7f12858d4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128015e5c0 con 0x7f128015daa0 2023-11-04T01:37:14.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.339+0000 7f12858d4640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128015e2e0 con 0x7f12800cde60 2023-11-04T01:37:14.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.339+0000 7f127e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f128015daa0 0x7f1280157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.340+0000 7f127e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f128015daa0 0x7f1280157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56208/0 (socket says 172.21.15.114:56208) 2023-11-04T01:37:14.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.340+0000 7f127e7fc640 1 -- 172.21.15.114:0/1425187879 learned_addr learned my addr 172.21.15.114:0/1425187879 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:14.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.340+0000 7f127effd640 1 --2- 172.21.15.114:0/1425187879 >> v2:172.21.15.141:3300/0 conn(0x7f12800cde60 0x7f128015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.340+0000 7f127e7fc640 1 -- 172.21.15.114:0/1425187879 >> v2:172.21.15.141:3300/0 conn(0x7f12800cde60 msgr2=0x7f128015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:14.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.340+0000 7f127e7fc640 1 --2- 172.21.15.114:0/1425187879 >> v2:172.21.15.141:3300/0 conn(0x7f12800cde60 0x7f128015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.340+0000 7f127e7fc640 1 -- 172.21.15.114:0/1425187879 >> v1:172.21.15.141:6789/0 conn(0x7f12800ce240 legacy=0x7f128006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.340+0000 7f127e7fc640 1 -- 172.21.15.114:0/1425187879 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12800d1120 con 0x7f128015daa0 2023-11-04T01:37:14.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.340+0000 7f127e7fc640 1 --2- 172.21.15.114:0/1425187879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f128015daa0 0x7f1280157000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f12800b5550 tx=0x7f127402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2361ce1946e7143 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.341+0000 7f127dffb640 1 -- 172.21.15.114:0/1425187879 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274030860 con 0x7f128015daa0 2023-11-04T01:37:14.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.341+0000 7f127dffb640 1 -- 172.21.15.114:0/1425187879 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12740309c0 con 0x7f128015daa0 2023-11-04T01:37:14.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.341+0000 7f127dffb640 1 -- 172.21.15.114:0/1425187879 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274030d50 con 0x7f128015daa0 2023-11-04T01:37:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.341+0000 7f12858d4640 1 -- 172.21.15.114:0/1425187879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f128015daa0 msgr2=0x7f1280157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.341+0000 7f12858d4640 1 --2- 172.21.15.114:0/1425187879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f128015daa0 0x7f1280157000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f12800b5550 tx=0x7f127402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.341+0000 7f12858d4640 1 -- 172.21.15.114:0/1425187879 shutdown_connections 2023-11-04T01:37:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.341+0000 7f12858d4640 1 --2- 172.21.15.114:0/1425187879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f128015daa0 0x7f1280157000 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.341+0000 7f12858d4640 1 --2- 172.21.15.114:0/1425187879 >> v2:172.21.15.141:3300/0 conn(0x7f12800cde60 0x7f128015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.341+0000 7f12858d4640 1 -- 172.21.15.114:0/1425187879 >> 172.21.15.114:0/1425187879 conn(0x7f1280071f30 msgr2=0x7f12800cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.341+0000 7f12858d4640 1 -- 172.21.15.114:0/1425187879 shutdown_connections 2023-11-04T01:37:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.341+0000 7f12858d4640 1 -- 172.21.15.114:0/1425187879 wait complete. 2023-11-04T01:37:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.342+0000 7f12858d4640 1 Processor -- start 2023-11-04T01:37:14.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.343+0000 7f12858d4640 1 -- start start 2023-11-04T01:37:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.343+0000 7f12858d4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12800cde60 0x7f128014e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.343+0000 7f12858d4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12800ce240 0x7f1280152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.343+0000 7f12858d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f128015daa0 0x7f12801511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.343+0000 7f12858d4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1280153590 con 0x7f12800ce240 2023-11-04T01:37:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.343+0000 7f12858d4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1280153f00 con 0x7f12800cde60 2023-11-04T01:37:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.343+0000 7f12858d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1280152fd0 con 0x7f128015daa0 2023-11-04T01:37:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.343+0000 7f127e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12800ce240 0x7f1280152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.343+0000 7f127e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12800ce240 0x7f1280152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56224/0 (socket says 172.21.15.114:56224) 2023-11-04T01:37:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.343+0000 7f127e7fc640 1 -- 172.21.15.114:0/2648781634 learned_addr learned my addr 172.21.15.114:0/2648781634 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.344+0000 7f127effd640 1 --2- 172.21.15.114:0/2648781634 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12800cde60 0x7f128014e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.344+0000 7f127f7fe640 1 --2- 172.21.15.114:0/2648781634 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f128015daa0 0x7f12801511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.344+0000 7f127e7fc640 1 -- 172.21.15.114:0/2648781634 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f128015daa0 msgr2=0x7f12801511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.344+0000 7f127e7fc640 1 --2- 172.21.15.114:0/2648781634 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f128015daa0 0x7f12801511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.344+0000 7f127e7fc640 1 -- 172.21.15.114:0/2648781634 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12800cde60 msgr2=0x7f128014e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.344+0000 7f127e7fc640 1 --2- 172.21.15.114:0/2648781634 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12800cde60 0x7f128014e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.344+0000 7f127e7fc640 1 -- 172.21.15.114:0/2648781634 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12740094d0 con 0x7f12800ce240 2023-11-04T01:37:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.344+0000 7f127effd640 1 --2- 172.21.15.114:0/2648781634 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12800cde60 0x7f128014e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.344+0000 7f127e7fc640 1 --2- 172.21.15.114:0/2648781634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12800ce240 0x7f1280152580 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1274000c00 tx=0x7f1274004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.344+0000 7f1267fff640 1 -- 172.21.15.114:0/2648781634 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274039a90 con 0x7f12800ce240 2023-11-04T01:37:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.344+0000 7f1267fff640 1 -- 172.21.15.114:0/2648781634 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1274039c10 con 0x7f12800ce240 2023-11-04T01:37:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.344+0000 7f1267fff640 1 -- 172.21.15.114:0/2648781634 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274043410 con 0x7f12800ce240 2023-11-04T01:37:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.344+0000 7f12858d4640 1 -- 172.21.15.114:0/2648781634 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12801532b0 con 0x7f12800ce240 2023-11-04T01:37:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.344+0000 7f12858d4640 1 -- 172.21.15.114:0/2648781634 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128014e740 con 0x7f12800ce240 2023-11-04T01:37:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.345+0000 7f12858d4640 1 -- 172.21.15.114:0/2648781634 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1280153980 con 0x7f12800ce240 2023-11-04T01:37:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.345+0000 7f1267fff640 1 -- 172.21.15.114:0/2648781634 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f127404c3b0 con 0x7f12800ce240 2023-11-04T01:37:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.346+0000 7f1267fff640 1 --2- 172.21.15.114:0/2648781634 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f126c06ae70 0x7f126c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.346+0000 7f1267fff640 1 -- 172.21.15.114:0/2648781634 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f12740abf70 con 0x7f12800ce240 2023-11-04T01:37:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.346+0000 7f127effd640 1 --2- 172.21.15.114:0/2648781634 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f126c06ae70 0x7f126c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.346+0000 7f127effd640 1 --2- 172.21.15.114:0/2648781634 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f126c06ae70 0x7f126c06d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1270007520 tx=0x7f127000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.350+0000 7f1267fff640 1 -- 172.21.15.114:0/2648781634 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f12740deca0 con 0x7f12800ce240 2023-11-04T01:37:14.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.517+0000 7f12858d4640 1 -- 172.21.15.114:0/2648781634 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1280154040 con 0x7f12800ce240 2023-11-04T01:37:14.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.518+0000 7f1267fff640 1 -- 172.21.15.114:0/2648781634 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18796 (secure 0 0 0) 0x7f1280154040 con 0x7f12800ce240 2023-11-04T01:37:14.520 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:14.520 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:11.562429+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:14.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.520+0000 7f12858d4640 1 -- 172.21.15.114:0/2648781634 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f126c06ae70 msgr2=0x7f126c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.520+0000 7f12858d4640 1 --2- 172.21.15.114:0/2648781634 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f126c06ae70 0x7f126c06d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1270007520 tx=0x7f127000b040 comp rx=0 tx=0).stop 2023-11-04T01:37:14.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.520+0000 7f12858d4640 1 -- 172.21.15.114:0/2648781634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12800ce240 msgr2=0x7f1280152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.520+0000 7f12858d4640 1 --2- 172.21.15.114:0/2648781634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12800ce240 0x7f1280152580 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1274000c00 tx=0x7f1274004730 comp rx=0 tx=0).stop 2023-11-04T01:37:14.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.520+0000 7f12858d4640 1 -- 172.21.15.114:0/2648781634 shutdown_connections 2023-11-04T01:37:14.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.520+0000 7f12858d4640 1 --2- 172.21.15.114:0/2648781634 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f128015daa0 0x7f12801511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.520+0000 7f12858d4640 1 --2- 172.21.15.114:0/2648781634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12800ce240 0x7f1280152580 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.520+0000 7f12858d4640 1 --2- 172.21.15.114:0/2648781634 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f126c06ae70 0x7f126c06d330 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.520+0000 7f12858d4640 1 --2- 172.21.15.114:0/2648781634 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12800cde60 0x7f128014e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.520+0000 7f12858d4640 1 -- 172.21.15.114:0/2648781634 >> 172.21.15.114:0/2648781634 conn(0x7f1280071f30 msgr2=0x7f12800c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:14.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.520+0000 7f12858d4640 1 -- 172.21.15.114:0/2648781634 shutdown_connections 2023-11-04T01:37:14.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.520+0000 7f12858d4640 1 -- 172.21.15.114:0/2648781634 wait complete. 2023-11-04T01:37:14.533 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:14.534 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:14.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.636+0000 7f37ee41a640 1 Processor -- start 2023-11-04T01:37:14.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.636+0000 7f37ee41a640 1 -- start start 2023-11-04T01:37:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.636+0000 7f37ee41a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f37e8160430 0x7f37e80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.636+0000 7f37ee41a640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f37e806c3a0 0x7f37e80cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.636+0000 7f37ee41a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e80b2fc0 con 0x7f37e80b2b60 2023-11-04T01:37:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.636+0000 7f37ee41a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e80cb580 con 0x7f37e8160430 2023-11-04T01:37:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.636+0000 7f37ee41a640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e806c7d0 con 0x7f37e806c3a0 2023-11-04T01:37:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.637+0000 7f37e7fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f37e8160430 0x7f37e80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.637+0000 7f37e77fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f37e80b2b60 0x7f37e806bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41740/0 (socket says 172.21.15.114:41740) 2023-11-04T01:37:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.637+0000 7f37e7fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f37e8160430 0x7f37e80b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56232/0 (socket says 172.21.15.114:56232) 2023-11-04T01:37:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.637+0000 7f37e77fe640 1 -- 172.21.15.114:0/2837913544 learned_addr learned my addr 172.21.15.114:0/2837913544 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.637+0000 7f37ec9b7640 1 --2- 172.21.15.114:0/2837913544 >> v2:172.21.15.141:3300/0 conn(0x7f37e806c3a0 0x7f37e80cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.637+0000 7f37e7fff640 1 -- 172.21.15.114:0/2837913544 >> v2:172.21.15.141:3300/0 conn(0x7f37e806c3a0 msgr2=0x7f37e80cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.637+0000 7f37e7fff640 1 --2- 172.21.15.114:0/2837913544 >> v2:172.21.15.141:3300/0 conn(0x7f37e806c3a0 0x7f37e80cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.637+0000 7f37e7fff640 1 -- 172.21.15.114:0/2837913544 >> v1:172.21.15.114:6789/0 conn(0x7f37e80b2b60 legacy=0x7f37e806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.637+0000 7f37e7fff640 1 -- 172.21.15.114:0/2837913544 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e806ca40 con 0x7f37e8160430 2023-11-04T01:37:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.638+0000 7f37e7fff640 1 --2- 172.21.15.114:0/2837913544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e8160430 0x7f37e80b2620 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f37e80c4600 tx=0x7f37d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d3d7f656bff935 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.638+0000 7f37e6ffd640 1 -- 172.21.15.114:0/2837913544 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8031830 con 0x7f37e8160430 2023-11-04T01:37:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.638+0000 7f37e6ffd640 1 -- 172.21.15.114:0/2837913544 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d8031990 con 0x7f37e8160430 2023-11-04T01:37:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.638+0000 7f37e6ffd640 1 -- 172.21.15.114:0/2837913544 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8031d20 con 0x7f37e8160430 2023-11-04T01:37:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.638+0000 7f37ee41a640 1 -- 172.21.15.114:0/2837913544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e8160430 msgr2=0x7f37e80b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.638+0000 7f37ee41a640 1 --2- 172.21.15.114:0/2837913544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e8160430 0x7f37e80b2620 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f37e80c4600 tx=0x7f37d802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.638+0000 7f37ee41a640 1 -- 172.21.15.114:0/2837913544 shutdown_connections 2023-11-04T01:37:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.638+0000 7f37ee41a640 1 --2- 172.21.15.114:0/2837913544 >> v2:172.21.15.141:3300/0 conn(0x7f37e806c3a0 0x7f37e80cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.638+0000 7f37ee41a640 1 --2- 172.21.15.114:0/2837913544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e8160430 0x7f37e80b2620 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.638+0000 7f37ee41a640 1 -- 172.21.15.114:0/2837913544 >> 172.21.15.114:0/2837913544 conn(0x7f37e806ea20 msgr2=0x7f37e806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.638+0000 7f37ee41a640 1 -- 172.21.15.114:0/2837913544 shutdown_connections 2023-11-04T01:37:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.638+0000 7f37ee41a640 1 -- 172.21.15.114:0/2837913544 wait complete. 2023-11-04T01:37:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.639+0000 7f37ee41a640 1 Processor -- start 2023-11-04T01:37:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.640+0000 7f37ee41a640 1 -- start start 2023-11-04T01:37:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.640+0000 7f37ee41a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e806c3a0 0x7f37e80b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.640+0000 7f37ee41a640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37e80b2b60 0x7f37e8152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.640+0000 7f37ee41a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37e8160430 0x7f37e80c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.640+0000 7f37ee41a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e80b37c0 con 0x7f37e806c3a0 2023-11-04T01:37:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.640+0000 7f37ee41a640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e8155e60 con 0x7f37e80b2b60 2023-11-04T01:37:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.640+0000 7f37ee41a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e8154cf0 con 0x7f37e8160430 2023-11-04T01:37:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.640+0000 7f37e7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e806c3a0 0x7f37e80b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.640+0000 7f37e7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e806c3a0 0x7f37e80b61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56244/0 (socket says 172.21.15.114:56244) 2023-11-04T01:37:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.640+0000 7f37e7fff640 1 -- 172.21.15.114:0/996668768 learned_addr learned my addr 172.21.15.114:0/996668768 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.640+0000 7f37e77fe640 1 --2- 172.21.15.114:0/996668768 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37e80b2b60 0x7f37e8152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.641+0000 7f37ec9b7640 1 --2- 172.21.15.114:0/996668768 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37e8160430 0x7f37e80c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.641+0000 7f37e7fff640 1 -- 172.21.15.114:0/996668768 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37e8160430 msgr2=0x7f37e80c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.641+0000 7f37e7fff640 1 --2- 172.21.15.114:0/996668768 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37e8160430 0x7f37e80c69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.641+0000 7f37e7fff640 1 -- 172.21.15.114:0/996668768 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37e80b2b60 msgr2=0x7f37e8152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.641+0000 7f37e7fff640 1 --2- 172.21.15.114:0/996668768 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37e80b2b60 0x7f37e8152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.641+0000 7f37e7fff640 1 -- 172.21.15.114:0/996668768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d8009400 con 0x7f37e806c3a0 2023-11-04T01:37:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.641+0000 7f37e7fff640 1 --2- 172.21.15.114:0/996668768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e806c3a0 0x7f37e80b61b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f37d8000c00 tx=0x7f37d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.641+0000 7f37e4ff9640 1 -- 172.21.15.114:0/996668768 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d803aa60 con 0x7f37e806c3a0 2023-11-04T01:37:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.641+0000 7f37e4ff9640 1 -- 172.21.15.114:0/996668768 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d803abe0 con 0x7f37e806c3a0 2023-11-04T01:37:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.641+0000 7f37ee41a640 1 -- 172.21.15.114:0/996668768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e8154fd0 con 0x7f37e806c3a0 2023-11-04T01:37:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.641+0000 7f37e4ff9640 1 -- 172.21.15.114:0/996668768 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d80443f0 con 0x7f37e806c3a0 2023-11-04T01:37:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.641+0000 7f37ee41a640 1 -- 172.21.15.114:0/996668768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e80b39d0 con 0x7f37e806c3a0 2023-11-04T01:37:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.642+0000 7f37ee41a640 1 -- 172.21.15.114:0/996668768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e80b3bc0 con 0x7f37e806c3a0 2023-11-04T01:37:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.642+0000 7f37e4ff9640 1 -- 172.21.15.114:0/996668768 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f37d804d450 con 0x7f37e806c3a0 2023-11-04T01:37:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.643+0000 7f37e4ff9640 1 --2- 172.21.15.114:0/996668768 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f37d406ae70 0x7f37d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.643+0000 7f37e4ff9640 1 -- 172.21.15.114:0/996668768 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f37d80ab9e0 con 0x7f37e806c3a0 2023-11-04T01:37:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.643+0000 7f37e77fe640 1 --2- 172.21.15.114:0/996668768 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f37d406ae70 0x7f37d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.643+0000 7f37e77fe640 1 --2- 172.21.15.114:0/996668768 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f37d406ae70 0x7f37d406d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f37e80cd4c0 tx=0x7f37dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.647+0000 7f37e4ff9640 1 -- 172.21.15.114:0/996668768 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f37d8076780 con 0x7f37e806c3a0 2023-11-04T01:37:14.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.816+0000 7f37ee41a640 1 -- 172.21.15.114:0/996668768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f37e8074290 con 0x7f37e806c3a0 2023-11-04T01:37:14.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.816+0000 7f37e4ff9640 1 -- 172.21.15.114:0/996668768 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37d8035020 con 0x7f37e806c3a0 2023-11-04T01:37:14.818 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:37:14.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.818+0000 7f37ee41a640 1 -- 172.21.15.114:0/996668768 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f37d406ae70 msgr2=0x7f37d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.818+0000 7f37ee41a640 1 --2- 172.21.15.114:0/996668768 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f37d406ae70 0x7f37d406d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f37e80cd4c0 tx=0x7f37dc009040 comp rx=0 tx=0).stop 2023-11-04T01:37:14.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.818+0000 7f37ee41a640 1 -- 172.21.15.114:0/996668768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e806c3a0 msgr2=0x7f37e80b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.818+0000 7f37ee41a640 1 --2- 172.21.15.114:0/996668768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e806c3a0 0x7f37e80b61b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f37d8000c00 tx=0x7f37d80046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.818+0000 7f37ee41a640 1 -- 172.21.15.114:0/996668768 shutdown_connections 2023-11-04T01:37:14.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.818+0000 7f37ee41a640 1 --2- 172.21.15.114:0/996668768 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37e8160430 0x7f37e80c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.818+0000 7f37ee41a640 1 --2- 172.21.15.114:0/996668768 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f37d406ae70 0x7f37d406d330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.818+0000 7f37ee41a640 1 --2- 172.21.15.114:0/996668768 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37e80b2b60 0x7f37e8152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.818+0000 7f37ee41a640 1 --2- 172.21.15.114:0/996668768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37e806c3a0 0x7f37e80b61b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.818+0000 7f37ee41a640 1 -- 172.21.15.114:0/996668768 >> 172.21.15.114:0/996668768 conn(0x7f37e806ea20 msgr2=0x7f37e80b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:14.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.819+0000 7f37ee41a640 1 -- 172.21.15.114:0/996668768 shutdown_connections 2023-11-04T01:37:14.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.819+0000 7f37ee41a640 1 -- 172.21.15.114:0/996668768 wait complete. 2023-11-04T01:37:14.831 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:14.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.931+0000 7f3a6ead4640 1 Processor -- start 2023-11-04T01:37:14.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.932+0000 7f3a6ead4640 1 -- start start 2023-11-04T01:37:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.932+0000 7f3a6ead4640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3a68153e60 0x7f3a6815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.932+0000 7f3a6ead4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a680cd6d0 0x7f3a68161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.932+0000 7f3a6ead4640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a680cde60 con 0x7f3a680b4880 2023-11-04T01:37:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.932+0000 7f3a6ead4640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a68160f90 con 0x7f3a68153e60 2023-11-04T01:37:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.932+0000 7f3a6ead4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6815e400 con 0x7f3a680cd6d0 2023-11-04T01:37:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.933+0000 7f3a67fff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a680cd6d0 0x7f3a68161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.933+0000 7f3a67fff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a680cd6d0 0x7f3a68161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:40046/0 (socket says 172.21.15.114:40046) 2023-11-04T01:37:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.933+0000 7f3a67fff640 1 -- 172.21.15.114:0/725387270 learned_addr learned my addr 172.21.15.114:0/725387270 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:14.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.933+0000 7f3a6c870640 1 --2- 172.21.15.114:0/725387270 >> v2:172.21.15.141:3300/0 conn(0x7f3a68153e60 0x7f3a6815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.933+0000 7f3a67fff640 1 -- 172.21.15.114:0/725387270 >> v2:172.21.15.141:3300/0 conn(0x7f3a68153e60 msgr2=0x7f3a6815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:14.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.933+0000 7f3a67fff640 1 --2- 172.21.15.114:0/725387270 >> v2:172.21.15.141:3300/0 conn(0x7f3a68153e60 0x7f3a6815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.933+0000 7f3a67fff640 1 -- 172.21.15.114:0/725387270 >> v1:172.21.15.141:6789/0 conn(0x7f3a680b4880 legacy=0x7f3a680b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.933+0000 7f3a67fff640 1 -- 172.21.15.114:0/725387270 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68161960 con 0x7f3a680cd6d0 2023-11-04T01:37:14.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.934+0000 7f3a67fff640 1 --2- 172.21.15.114:0/725387270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a680cd6d0 0x7f3a68161420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009870 tx=0x7f3a5c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71207699d014d2cd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.934+0000 7f3a677fe640 1 -- 172.21.15.114:0/725387270 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c030840 con 0x7f3a680cd6d0 2023-11-04T01:37:14.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.934+0000 7f3a677fe640 1 -- 172.21.15.114:0/725387270 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c0309a0 con 0x7f3a680cd6d0 2023-11-04T01:37:14.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.934+0000 7f3a677fe640 1 -- 172.21.15.114:0/725387270 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c030d30 con 0x7f3a680cd6d0 2023-11-04T01:37:14.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.935+0000 7f3a6ead4640 1 -- 172.21.15.114:0/725387270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a680cd6d0 msgr2=0x7f3a68161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.935+0000 7f3a6ead4640 1 --2- 172.21.15.114:0/725387270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a680cd6d0 0x7f3a68161420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009870 tx=0x7f3a5c02b980 comp rx=0 tx=0).stop 2023-11-04T01:37:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.935+0000 7f3a6ead4640 1 -- 172.21.15.114:0/725387270 shutdown_connections 2023-11-04T01:37:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.935+0000 7f3a6ead4640 1 --2- 172.21.15.114:0/725387270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a680cd6d0 0x7f3a68161420 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.935+0000 7f3a6ead4640 1 --2- 172.21.15.114:0/725387270 >> v2:172.21.15.141:3300/0 conn(0x7f3a68153e60 0x7f3a6815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.935+0000 7f3a6ead4640 1 -- 172.21.15.114:0/725387270 >> 172.21.15.114:0/725387270 conn(0x7f3a680cf880 msgr2=0x7f3a680cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.935+0000 7f3a6ead4640 1 -- 172.21.15.114:0/725387270 shutdown_connections 2023-11-04T01:37:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.935+0000 7f3a6ead4640 1 -- 172.21.15.114:0/725387270 wait complete. 2023-11-04T01:37:14.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.936+0000 7f3a6ead4640 1 Processor -- start 2023-11-04T01:37:14.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.936+0000 7f3a6ead4640 1 -- start start 2023-11-04T01:37:14.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.937+0000 7f3a6ead4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a680b4880 0x7f3a68153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.937+0000 7f3a6ead4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a680cd6d0 0x7f3a68155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.937+0000 7f3a6ead4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3a68153e60 0x7f3a68156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.937+0000 7f3a6ead4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680cb8a0 con 0x7f3a680cd6d0 2023-11-04T01:37:14.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.937+0000 7f3a6ead4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a68157490 con 0x7f3a68153e60 2023-11-04T01:37:14.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.937+0000 7f3a6ead4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680cba10 con 0x7f3a680b4880 2023-11-04T01:37:14.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.937+0000 7f3a67fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a680cd6d0 0x7f3a68155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.937+0000 7f3a67fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a680cd6d0 0x7f3a68155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56248/0 (socket says 172.21.15.114:56248) 2023-11-04T01:37:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.937+0000 7f3a67fff640 1 -- 172.21.15.114:0/3500257899 learned_addr learned my addr 172.21.15.114:0/3500257899 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.937+0000 7f3a6d071640 1 --2- 172.21.15.114:0/3500257899 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3a68153e60 0x7f3a68156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.937+0000 7f3a6c870640 1 --2- 172.21.15.114:0/3500257899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a680b4880 0x7f3a68153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.937+0000 7f3a67fff640 1 -- 172.21.15.114:0/3500257899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a680b4880 msgr2=0x7f3a68153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.937+0000 7f3a67fff640 1 --2- 172.21.15.114:0/3500257899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a680b4880 0x7f3a68153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.937+0000 7f3a67fff640 1 -- 172.21.15.114:0/3500257899 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3a68153e60 msgr2=0x7f3a68156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.937+0000 7f3a67fff640 1 --2- 172.21.15.114:0/3500257899 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3a68153e60 0x7f3a68156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.937+0000 7f3a67fff640 1 -- 172.21.15.114:0/3500257899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c0094d0 con 0x7f3a680cd6d0 2023-11-04T01:37:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.938+0000 7f3a67fff640 1 --2- 172.21.15.114:0/3500257899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a680cd6d0 0x7f3a68155020 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009990 tx=0x7f3a5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.938+0000 7f3a657fa640 1 -- 172.21.15.114:0/3500257899 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c039c90 con 0x7f3a680cd6d0 2023-11-04T01:37:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.938+0000 7f3a657fa640 1 -- 172.21.15.114:0/3500257899 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c039df0 con 0x7f3a680cd6d0 2023-11-04T01:37:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.938+0000 7f3a6ead4640 1 -- 172.21.15.114:0/3500257899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a68155720 con 0x7f3a680cd6d0 2023-11-04T01:37:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.938+0000 7f3a657fa640 1 -- 172.21.15.114:0/3500257899 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0446c0 con 0x7f3a680cd6d0 2023-11-04T01:37:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.938+0000 7f3a6ead4640 1 -- 172.21.15.114:0/3500257899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a68155ce0 con 0x7f3a680cd6d0 2023-11-04T01:37:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.939+0000 7f3a6ead4640 1 -- 172.21.15.114:0/3500257899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a68074290 con 0x7f3a680cd6d0 2023-11-04T01:37:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.939+0000 7f3a657fa640 1 -- 172.21.15.114:0/3500257899 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a5c04d3b0 con 0x7f3a680cd6d0 2023-11-04T01:37:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.940+0000 7f3a657fa640 1 --2- 172.21.15.114:0/3500257899 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a5406ae70 0x7f3a5406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.940+0000 7f3a657fa640 1 -- 172.21.15.114:0/3500257899 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3a5c03e070 con 0x7f3a680cd6d0 2023-11-04T01:37:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.940+0000 7f3a6c870640 1 --2- 172.21.15.114:0/3500257899 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a5406ae70 0x7f3a5406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.940+0000 7f3a6c870640 1 --2- 172.21.15.114:0/3500257899 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a5406ae70 0x7f3a5406d330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009aa0 tx=0x7f3a58009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:14.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:14.944+0000 7f3a657fa640 1 -- 172.21.15.114:0/3500257899 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a5c0771c0 con 0x7f3a680cd6d0 2023-11-04T01:37:15.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.109+0000 7f3a6ead4640 1 -- 172.21.15.114:0/3500257899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a680cbb50 con 0x7f3a680cd6d0 2023-11-04T01:37:15.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.110+0000 7f3a657fa640 1 -- 172.21.15.114:0/3500257899 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a5c07a7e0 con 0x7f3a680cd6d0 2023-11-04T01:37:15.112 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:15.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.111+0000 7f3a6ead4640 1 -- 172.21.15.114:0/3500257899 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a5406ae70 msgr2=0x7f3a5406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.111+0000 7f3a6ead4640 1 --2- 172.21.15.114:0/3500257899 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a5406ae70 0x7f3a5406d330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009aa0 tx=0x7f3a58009190 comp rx=0 tx=0).stop 2023-11-04T01:37:15.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.111+0000 7f3a6ead4640 1 -- 172.21.15.114:0/3500257899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a680cd6d0 msgr2=0x7f3a68155020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.111+0000 7f3a6ead4640 1 --2- 172.21.15.114:0/3500257899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a680cd6d0 0x7f3a68155020 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009990 tx=0x7f3a5c004730 comp rx=0 tx=0).stop 2023-11-04T01:37:15.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.112+0000 7f3a6ead4640 1 -- 172.21.15.114:0/3500257899 shutdown_connections 2023-11-04T01:37:15.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.112+0000 7f3a6ead4640 1 --2- 172.21.15.114:0/3500257899 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a5406ae70 0x7f3a5406d330 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.112+0000 7f3a6ead4640 1 --2- 172.21.15.114:0/3500257899 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3a68153e60 0x7f3a68156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.112+0000 7f3a6ead4640 1 --2- 172.21.15.114:0/3500257899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a680cd6d0 0x7f3a68155020 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.112+0000 7f3a6ead4640 1 --2- 172.21.15.114:0/3500257899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a680b4880 0x7f3a68153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.112+0000 7f3a6ead4640 1 -- 172.21.15.114:0/3500257899 >> 172.21.15.114:0/3500257899 conn(0x7f3a680cf880 msgr2=0x7f3a680d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.112+0000 7f3a6ead4640 1 -- 172.21.15.114:0/3500257899 shutdown_connections 2023-11-04T01:37:15.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.112+0000 7f3a6ead4640 1 -- 172.21.15.114:0/3500257899 wait complete. 2023-11-04T01:37:15.125 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:15.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.225+0000 7fd79ff7c640 1 Processor -- start 2023-11-04T01:37:15.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.226+0000 7fd79ff7c640 1 -- start start 2023-11-04T01:37:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.226+0000 7fd79ff7c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd798070ff0 0x7fd7980cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.226+0000 7fd79ff7c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd79815d1b0 0x7fd7980713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.226+0000 7fd79ff7c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7980c9bf0 con 0x7fd798066000 2023-11-04T01:37:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.226+0000 7fd79ff7c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7980cd890 con 0x7fd79815d1b0 2023-11-04T01:37:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.226+0000 7fd79ff7c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd798071910 con 0x7fd798070ff0 2023-11-04T01:37:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.227+0000 7fd79d517640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd79815d1b0 0x7fd7980713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.227+0000 7fd79d517640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd79815d1b0 0x7fd7980713d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56262/0 (socket says 172.21.15.114:56262) 2023-11-04T01:37:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.227+0000 7fd79d517640 1 -- 172.21.15.114:0/529741143 learned_addr learned my addr 172.21.15.114:0/529741143 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.227+0000 7fd79dd18640 1 --2- 172.21.15.114:0/529741143 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd798070ff0 0x7fd7980cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.227+0000 7fd79d517640 1 -- 172.21.15.114:0/529741143 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd798070ff0 msgr2=0x7fd7980cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:15.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.227+0000 7fd79d517640 1 --2- 172.21.15.114:0/529741143 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd798070ff0 0x7fd7980cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.227+0000 7fd79d517640 1 -- 172.21.15.114:0/529741143 >> v1:172.21.15.141:6789/0 conn(0x7fd798066000 legacy=0x7fd798160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:15.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.227+0000 7fd79d517640 1 -- 172.21.15.114:0/529741143 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7980cdb30 con 0x7fd79815d1b0 2023-11-04T01:37:15.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.228+0000 7fd79d517640 1 --2- 172.21.15.114:0/529741143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd79815d1b0 0x7fd7980713d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd788009870 tx=0x7fd78802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ab34982b6847f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.228+0000 7fd79cd16640 1 -- 172.21.15.114:0/529741143 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788031640 con 0x7fd79815d1b0 2023-11-04T01:37:15.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.228+0000 7fd79cd16640 1 -- 172.21.15.114:0/529741143 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7880317a0 con 0x7fd79815d1b0 2023-11-04T01:37:15.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.228+0000 7fd79cd16640 1 -- 172.21.15.114:0/529741143 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788031b30 con 0x7fd79815d1b0 2023-11-04T01:37:15.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.228+0000 7fd79ff7c640 1 -- 172.21.15.114:0/529741143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd79815d1b0 msgr2=0x7fd7980713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.228+0000 7fd79ff7c640 1 --2- 172.21.15.114:0/529741143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd79815d1b0 0x7fd7980713d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd788009870 tx=0x7fd78802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.228+0000 7fd79ff7c640 1 -- 172.21.15.114:0/529741143 shutdown_connections 2023-11-04T01:37:15.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.228+0000 7fd79ff7c640 1 --2- 172.21.15.114:0/529741143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd79815d1b0 0x7fd7980713d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.228+0000 7fd79ff7c640 1 --2- 172.21.15.114:0/529741143 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd798070ff0 0x7fd7980cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.228+0000 7fd79ff7c640 1 -- 172.21.15.114:0/529741143 >> 172.21.15.114:0/529741143 conn(0x7fd7980cbc90 msgr2=0x7fd7980cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.228+0000 7fd79ff7c640 1 -- 172.21.15.114:0/529741143 shutdown_connections 2023-11-04T01:37:15.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.228+0000 7fd79ff7c640 1 -- 172.21.15.114:0/529741143 wait complete. 2023-11-04T01:37:15.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.229+0000 7fd79ff7c640 1 Processor -- start 2023-11-04T01:37:15.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.230+0000 7fd79ff7c640 1 -- start start 2023-11-04T01:37:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.230+0000 7fd79ff7c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd798066000 0x7fd798158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.230+0000 7fd79ff7c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd798070ff0 0x7fd798143250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.230+0000 7fd79ff7c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd79815d1b0 0x7fd798143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.230+0000 7fd79ff7c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79815f870 con 0x7fd798070ff0 2023-11-04T01:37:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.230+0000 7fd79ff7c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7981603f0 con 0x7fd798066000 2023-11-04T01:37:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.230+0000 7fd79ff7c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79815fac0 con 0x7fd79815d1b0 2023-11-04T01:37:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.230+0000 7fd79d517640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd798070ff0 0x7fd798143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.230+0000 7fd79d517640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd798070ff0 0x7fd798143250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56274/0 (socket says 172.21.15.114:56274) 2023-11-04T01:37:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.230+0000 7fd79d517640 1 -- 172.21.15.114:0/144303980 learned_addr learned my addr 172.21.15.114:0/144303980 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.231+0000 7fd79e519640 1 --2- 172.21.15.114:0/144303980 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd79815d1b0 0x7fd798143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.231+0000 7fd79dd18640 1 --2- 172.21.15.114:0/144303980 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd798066000 0x7fd798158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.231+0000 7fd79d517640 1 -- 172.21.15.114:0/144303980 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd79815d1b0 msgr2=0x7fd798143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.231+0000 7fd79d517640 1 --2- 172.21.15.114:0/144303980 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd79815d1b0 0x7fd798143790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.231+0000 7fd79d517640 1 -- 172.21.15.114:0/144303980 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd798066000 msgr2=0x7fd798158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.231+0000 7fd79d517640 1 --2- 172.21.15.114:0/144303980 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd798066000 0x7fd798158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.231+0000 7fd79d517640 1 -- 172.21.15.114:0/144303980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7880094d0 con 0x7fd798070ff0 2023-11-04T01:37:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.231+0000 7fd79dd18640 1 --2- 172.21.15.114:0/144303980 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd798066000 0x7fd798158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.231+0000 7fd79e519640 1 --2- 172.21.15.114:0/144303980 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd79815d1b0 0x7fd798143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:15.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.231+0000 7fd79d517640 1 --2- 172.21.15.114:0/144303980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd798070ff0 0x7fd798143250 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd7880090b0 tx=0x7fd7880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.231+0000 7fd78e7fc640 1 -- 172.21.15.114:0/144303980 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78803bc70 con 0x7fd798070ff0 2023-11-04T01:37:15.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.231+0000 7fd78e7fc640 1 -- 172.21.15.114:0/144303980 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78803bdd0 con 0x7fd798070ff0 2023-11-04T01:37:15.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.231+0000 7fd79ff7c640 1 -- 172.21.15.114:0/144303980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79815fda0 con 0x7fd798070ff0 2023-11-04T01:37:15.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.231+0000 7fd78e7fc640 1 -- 172.21.15.114:0/144303980 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788045630 con 0x7fd798070ff0 2023-11-04T01:37:15.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.231+0000 7fd79ff7c640 1 -- 172.21.15.114:0/144303980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd798158fa0 con 0x7fd798070ff0 2023-11-04T01:37:15.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.232+0000 7fd79ff7c640 1 -- 172.21.15.114:0/144303980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd798159190 con 0x7fd798070ff0 2023-11-04T01:37:15.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.232+0000 7fd78e7fc640 1 -- 172.21.15.114:0/144303980 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd78802f050 con 0x7fd798070ff0 2023-11-04T01:37:15.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.233+0000 7fd78e7fc640 1 --2- 172.21.15.114:0/144303980 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd77c06ae70 0x7fd77c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.233+0000 7fd79dd18640 1 --2- 172.21.15.114:0/144303980 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd77c06ae70 0x7fd77c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.233+0000 7fd78e7fc640 1 -- 172.21.15.114:0/144303980 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd7880ab870 con 0x7fd798070ff0 2023-11-04T01:37:15.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.233+0000 7fd79dd18640 1 --2- 172.21.15.114:0/144303980 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd77c06ae70 0x7fd77c06d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd794006fd0 tx=0x7fd794008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.237+0000 7fd78e7fc640 1 -- 172.21.15.114:0/144303980 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd7880765f0 con 0x7fd798070ff0 2023-11-04T01:37:15.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.402+0000 7fd79ff7c640 1 -- 172.21.15.114:0/144303980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd7980c62c0 con 0x7fd798070ff0 2023-11-04T01:37:15.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.402+0000 7fd78e7fc640 1 -- 172.21.15.114:0/144303980 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd788079c10 con 0x7fd798070ff0 2023-11-04T01:37:15.404 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:37:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.404+0000 7fd79ff7c640 1 -- 172.21.15.114:0/144303980 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd77c06ae70 msgr2=0x7fd77c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.404+0000 7fd79ff7c640 1 --2- 172.21.15.114:0/144303980 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd77c06ae70 0x7fd77c06d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd794006fd0 tx=0x7fd794008040 comp rx=0 tx=0).stop 2023-11-04T01:37:15.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.404+0000 7fd79ff7c640 1 -- 172.21.15.114:0/144303980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd798070ff0 msgr2=0x7fd798143250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.404+0000 7fd79ff7c640 1 --2- 172.21.15.114:0/144303980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd798070ff0 0x7fd798143250 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd7880090b0 tx=0x7fd7880046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.404+0000 7fd79ff7c640 1 -- 172.21.15.114:0/144303980 shutdown_connections 2023-11-04T01:37:15.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.404+0000 7fd79ff7c640 1 --2- 172.21.15.114:0/144303980 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd79815d1b0 0x7fd798143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.404+0000 7fd79ff7c640 1 --2- 172.21.15.114:0/144303980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd798070ff0 0x7fd798143250 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.404+0000 7fd79ff7c640 1 --2- 172.21.15.114:0/144303980 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd77c06ae70 0x7fd77c06d330 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.404+0000 7fd79ff7c640 1 --2- 172.21.15.114:0/144303980 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd798066000 0x7fd798158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.404+0000 7fd79ff7c640 1 -- 172.21.15.114:0/144303980 >> 172.21.15.114:0/144303980 conn(0x7fd7980cbc90 msgr2=0x7fd79806aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.404+0000 7fd79ff7c640 1 -- 172.21.15.114:0/144303980 shutdown_connections 2023-11-04T01:37:15.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.404+0000 7fd79ff7c640 1 -- 172.21.15.114:0/144303980 wait complete. 2023-11-04T01:37:15.417 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:15.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.517+0000 7f6f96789640 1 Processor -- start 2023-11-04T01:37:15.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.517+0000 7f6f96789640 1 -- start start 2023-11-04T01:37:15.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.518+0000 7f6f96789640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f900cd6d0 0x7f6f90161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.518+0000 7f6f96789640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6f900b4880 0x7f6f900b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.518+0000 7f6f96789640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f900cde60 con 0x7f6f90153e60 2023-11-04T01:37:15.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.518+0000 7f6f96789640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f90160f90 con 0x7f6f900b4880 2023-11-04T01:37:15.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.518+0000 7f6f96789640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900b51e0 con 0x7f6f900cd6d0 2023-11-04T01:37:15.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.518+0000 7f6f8f7fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f900cd6d0 0x7f6f90161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.518+0000 7f6f94d26640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6f900b4880 0x7f6f900b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.518+0000 7f6f8ffff640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f6f90153e60 0x7f6f9015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:38444/0 (socket says 172.21.15.114:38444) 2023-11-04T01:37:15.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.518+0000 7f6f8ffff640 1 -- 172.21.15.114:0/1301614385 learned_addr learned my addr 172.21.15.114:0/1301614385 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:15.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.519+0000 7f6f8f7fe640 1 -- 172.21.15.114:0/1301614385 >> v2:172.21.15.141:3300/0 conn(0x7f6f900b4880 msgr2=0x7f6f900b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:15.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.519+0000 7f6f8f7fe640 1 --2- 172.21.15.114:0/1301614385 >> v2:172.21.15.141:3300/0 conn(0x7f6f900b4880 0x7f6f900b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.519+0000 7f6f8f7fe640 1 -- 172.21.15.114:0/1301614385 >> v1:172.21.15.141:6789/0 conn(0x7f6f90153e60 legacy=0x7f6f9015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.519+0000 7f6f8effd640 1 -- 172.21.15.114:0/1301614385 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108678291 0 0) 0x7f6f900cde60 con 0x7f6f90153e60 2023-11-04T01:37:15.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.519+0000 7f6f8f7fe640 1 -- 172.21.15.114:0/1301614385 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f90161960 con 0x7f6f900cd6d0 2023-11-04T01:37:15.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.520+0000 7f6f8f7fe640 1 --2- 172.21.15.114:0/1301614385 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f900cd6d0 0x7f6f90161420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6f840097a0 tx=0x7f6f8402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cb27f2442a9e425 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.520+0000 7f6f8effd640 1 -- 172.21.15.114:0/1301614385 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84031830 con 0x7f6f900cd6d0 2023-11-04T01:37:15.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.520+0000 7f6f8effd640 1 -- 172.21.15.114:0/1301614385 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f84031990 con 0x7f6f900cd6d0 2023-11-04T01:37:15.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.520+0000 7f6f8effd640 1 -- 172.21.15.114:0/1301614385 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84031d20 con 0x7f6f900cd6d0 2023-11-04T01:37:15.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.520+0000 7f6f96789640 1 -- 172.21.15.114:0/1301614385 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f900cd6d0 msgr2=0x7f6f90161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.520+0000 7f6f96789640 1 --2- 172.21.15.114:0/1301614385 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f900cd6d0 0x7f6f90161420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6f840097a0 tx=0x7f6f8402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.520+0000 7f6f96789640 1 -- 172.21.15.114:0/1301614385 shutdown_connections 2023-11-04T01:37:15.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.520+0000 7f6f96789640 1 --2- 172.21.15.114:0/1301614385 >> v2:172.21.15.141:3300/0 conn(0x7f6f900b4880 0x7f6f900b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.520+0000 7f6f96789640 1 --2- 172.21.15.114:0/1301614385 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f900cd6d0 0x7f6f90161420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.520+0000 7f6f96789640 1 -- 172.21.15.114:0/1301614385 >> 172.21.15.114:0/1301614385 conn(0x7f6f900cf880 msgr2=0x7f6f900cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.520+0000 7f6f96789640 1 -- 172.21.15.114:0/1301614385 shutdown_connections 2023-11-04T01:37:15.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.520+0000 7f6f96789640 1 -- 172.21.15.114:0/1301614385 wait complete. 2023-11-04T01:37:15.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.521+0000 7f6f96789640 1 Processor -- start 2023-11-04T01:37:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.522+0000 7f6f96789640 1 -- start start 2023-11-04T01:37:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.522+0000 7f6f96789640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f900b4880 0x7f6f900cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.522+0000 7f6f96789640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f900cd6d0 0x7f6f901f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.522+0000 7f6f96789640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f90153e60 0x7f6f90154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.522+0000 7f6f96789640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900cb7f0 con 0x7f6f90153e60 2023-11-04T01:37:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.522+0000 7f6f96789640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f901f2670 con 0x7f6f900cd6d0 2023-11-04T01:37:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.522+0000 7f6f96789640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f90158c60 con 0x7f6f900b4880 2023-11-04T01:37:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.522+0000 7f6f94d26640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f90153e60 0x7f6f90154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.522+0000 7f6f94d26640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f90153e60 0x7f6f90154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56276/0 (socket says 172.21.15.114:56276) 2023-11-04T01:37:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.522+0000 7f6f94d26640 1 -- 172.21.15.114:0/1994466501 learned_addr learned my addr 172.21.15.114:0/1994466501 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:15.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.523+0000 7f6f8f7fe640 1 --2- 172.21.15.114:0/1994466501 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f900cd6d0 0x7f6f901f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.523+0000 7f6f8ffff640 1 --2- 172.21.15.114:0/1994466501 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f900b4880 0x7f6f900cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.523+0000 7f6f94d26640 1 -- 172.21.15.114:0/1994466501 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f900b4880 msgr2=0x7f6f900cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.523+0000 7f6f94d26640 1 --2- 172.21.15.114:0/1994466501 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f900b4880 0x7f6f900cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.523+0000 7f6f94d26640 1 -- 172.21.15.114:0/1994466501 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f900cd6d0 msgr2=0x7f6f901f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.523+0000 7f6f94d26640 1 --2- 172.21.15.114:0/1994466501 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f900cd6d0 0x7f6f901f2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.523+0000 7f6f94d26640 1 -- 172.21.15.114:0/1994466501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f84009400 con 0x7f6f90153e60 2023-11-04T01:37:15.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.523+0000 7f6f94d26640 1 --2- 172.21.15.114:0/1994466501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f90153e60 0x7f6f90154c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009dd0 tx=0x7f6f8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.523+0000 7f6f8cff9640 1 -- 172.21.15.114:0/1994466501 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88014480 con 0x7f6f90153e60 2023-11-04T01:37:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.523+0000 7f6f8cff9640 1 -- 172.21.15.114:0/1994466501 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8800f040 con 0x7f6f90153e60 2023-11-04T01:37:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.523+0000 7f6f96789640 1 -- 172.21.15.114:0/1994466501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f90158f40 con 0x7f6f90153e60 2023-11-04T01:37:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.523+0000 7f6f8cff9640 1 -- 172.21.15.114:0/1994466501 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88014840 con 0x7f6f90153e60 2023-11-04T01:37:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.523+0000 7f6f96789640 1 -- 172.21.15.114:0/1994466501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f90159500 con 0x7f6f90153e60 2023-11-04T01:37:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.524+0000 7f6f96789640 1 -- 172.21.15.114:0/1994466501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f901596f0 con 0x7f6f90153e60 2023-11-04T01:37:15.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.525+0000 7f6f8cff9640 1 -- 172.21.15.114:0/1994466501 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f880149a0 con 0x7f6f90153e60 2023-11-04T01:37:15.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.525+0000 7f6f8cff9640 1 --2- 172.21.15.114:0/1994466501 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6f7c06ae70 0x7f6f7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.525+0000 7f6f8ffff640 1 --2- 172.21.15.114:0/1994466501 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6f7c06ae70 0x7f6f7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.525+0000 7f6f8cff9640 1 -- 172.21.15.114:0/1994466501 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6f8808a470 con 0x7f6f90153e60 2023-11-04T01:37:15.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.525+0000 7f6f8ffff640 1 --2- 172.21.15.114:0/1994466501 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6f7c06ae70 0x7f6f7c06d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6f80007fd0 tx=0x7f6f80007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.529+0000 7f6f8cff9640 1 -- 172.21.15.114:0/1994466501 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f88055190 con 0x7f6f90153e60 2023-11-04T01:37:15.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.696+0000 7f6f96789640 1 -- 172.21.15.114:0/1994466501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6f90074290 con 0x7f6f90153e60 2023-11-04T01:37:15.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.697+0000 7f6f8cff9640 1 -- 172.21.15.114:0/1994466501 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6f880587b0 con 0x7f6f90153e60 2023-11-04T01:37:15.699 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:15.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.698+0000 7f6f96789640 1 -- 172.21.15.114:0/1994466501 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6f7c06ae70 msgr2=0x7f6f7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.698+0000 7f6f96789640 1 --2- 172.21.15.114:0/1994466501 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6f7c06ae70 0x7f6f7c06d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6f80007fd0 tx=0x7f6f80007de0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.699+0000 7f6f96789640 1 -- 172.21.15.114:0/1994466501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f90153e60 msgr2=0x7f6f90154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.699+0000 7f6f96789640 1 --2- 172.21.15.114:0/1994466501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f90153e60 0x7f6f90154c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009dd0 tx=0x7f6f8800c490 comp rx=0 tx=0).stop 2023-11-04T01:37:15.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.699+0000 7f6f96789640 1 -- 172.21.15.114:0/1994466501 shutdown_connections 2023-11-04T01:37:15.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.699+0000 7f6f96789640 1 --2- 172.21.15.114:0/1994466501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f90153e60 0x7f6f90154c50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.699+0000 7f6f96789640 1 --2- 172.21.15.114:0/1994466501 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6f7c06ae70 0x7f6f7c06d330 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.699+0000 7f6f96789640 1 --2- 172.21.15.114:0/1994466501 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f900cd6d0 0x7f6f901f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.699+0000 7f6f96789640 1 --2- 172.21.15.114:0/1994466501 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f900b4880 0x7f6f900cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.699+0000 7f6f96789640 1 -- 172.21.15.114:0/1994466501 >> 172.21.15.114:0/1994466501 conn(0x7f6f900cf880 msgr2=0x7f6f900b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.699+0000 7f6f96789640 1 -- 172.21.15.114:0/1994466501 shutdown_connections 2023-11-04T01:37:15.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.699+0000 7f6f96789640 1 -- 172.21.15.114:0/1994466501 wait complete. 2023-11-04T01:37:15.712 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.809+0000 7f04323ce640 1 Processor -- start 2023-11-04T01:37:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.810+0000 7f04323ce640 1 -- start start 2023-11-04T01:37:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.810+0000 7f04323ce640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f042c0cce10 0x7f042c0b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.810+0000 7f04323ce640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f042c06a830 0x7f042c15e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.810+0000 7f04323ce640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042c15e6e0 con 0x7f042c0b18b0 2023-11-04T01:37:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.810+0000 7f04323ce640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042c15dd10 con 0x7f042c0cce10 2023-11-04T01:37:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.810+0000 7f04323ce640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c15d720 con 0x7f042c06a830 2023-11-04T01:37:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.811+0000 7f043096b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f042c06a830 0x7f042c15e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.811+0000 7f042bfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f042c0cce10 0x7f042c0b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.811+0000 7f042b7fe640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f042c0b18b0 0x7f042c06a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:38448/0 (socket says 172.21.15.114:38448) 2023-11-04T01:37:15.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.811+0000 7f042bfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f042c0cce10 0x7f042c0b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:59066/0 (socket says 172.21.15.114:59066) 2023-11-04T01:37:15.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.811+0000 7f042b7fe640 1 -- 172.21.15.114:0/2291310121 learned_addr learned my addr 172.21.15.114:0/2291310121 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:15.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.811+0000 7f042affd640 1 -- 172.21.15.114:0/2291310121 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182979064 0 0) 0x7f0420001110 con 0x7f042c0b18b0 2023-11-04T01:37:15.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.811+0000 7f042affd640 1 -- 172.21.15.114:0/2291310121 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0414003520 con 0x7f042c0b18b0 2023-11-04T01:37:15.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.811+0000 7f043096b640 1 -- 172.21.15.114:0/2291310121 >> v2:172.21.15.141:3300/0 conn(0x7f042c0cce10 msgr2=0x7f042c0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:15.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.811+0000 7f043096b640 1 --2- 172.21.15.114:0/2291310121 >> v2:172.21.15.141:3300/0 conn(0x7f042c0cce10 0x7f042c0b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.811+0000 7f043096b640 1 -- 172.21.15.114:0/2291310121 >> v1:172.21.15.141:6789/0 conn(0x7f042c0b18b0 legacy=0x7f042c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.811+0000 7f043096b640 1 -- 172.21.15.114:0/2291310121 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c06fe00 con 0x7f042c06a830 2023-11-04T01:37:15.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.811+0000 7f042bfff640 1 --2- 172.21.15.114:0/2291310121 >> v2:172.21.15.141:3300/0 conn(0x7f042c0cce10 0x7f042c0b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.812+0000 7f043096b640 1 --2- 172.21.15.114:0/2291310121 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f042c06a830 0x7f042c15e1a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0424009d90 tx=0x7f042402bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b256f92a0ebedff server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.812+0000 7f042affd640 1 -- 172.21.15.114:0/2291310121 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042402cb30 con 0x7f042c06a830 2023-11-04T01:37:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.812+0000 7f042affd640 1 -- 172.21.15.114:0/2291310121 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042402cc90 con 0x7f042c06a830 2023-11-04T01:37:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.812+0000 7f042affd640 1 -- 172.21.15.114:0/2291310121 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424034440 con 0x7f042c06a830 2023-11-04T01:37:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.812+0000 7f04323ce640 1 -- 172.21.15.114:0/2291310121 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f042c06a830 msgr2=0x7f042c15e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.812+0000 7f04323ce640 1 --2- 172.21.15.114:0/2291310121 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f042c06a830 0x7f042c15e1a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0424009d90 tx=0x7f042402bd80 comp rx=0 tx=0).stop 2023-11-04T01:37:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.812+0000 7f04323ce640 1 -- 172.21.15.114:0/2291310121 shutdown_connections 2023-11-04T01:37:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.812+0000 7f04323ce640 1 --2- 172.21.15.114:0/2291310121 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f042c06a830 0x7f042c15e1a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.812+0000 7f04323ce640 1 --2- 172.21.15.114:0/2291310121 >> v2:172.21.15.141:3300/0 conn(0x7f042c0cce10 0x7f042c0b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.812+0000 7f04323ce640 1 -- 172.21.15.114:0/2291310121 >> 172.21.15.114:0/2291310121 conn(0x7f042c06d8b0 msgr2=0x7f042c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.813+0000 7f04323ce640 1 -- 172.21.15.114:0/2291310121 shutdown_connections 2023-11-04T01:37:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.813+0000 7f04323ce640 1 -- 172.21.15.114:0/2291310121 wait complete. 2023-11-04T01:37:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.814+0000 7f04323ce640 1 Processor -- start 2023-11-04T01:37:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.814+0000 7f04323ce640 1 -- start start 2023-11-04T01:37:15.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f04323ce640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f042c06a830 0x7f042c151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f04323ce640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f042c0b18b0 0x7f042c0c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f04323ce640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f042c0cce10 0x7f042c0b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f04323ce640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c0c8860 con 0x7f042c0cce10 2023-11-04T01:37:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f04323ce640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c0acf00 con 0x7f042c06a830 2023-11-04T01:37:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f04323ce640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c0ae760 con 0x7f042c0b18b0 2023-11-04T01:37:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f043096b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f042c0cce10 0x7f042c0b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f043096b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f042c0cce10 0x7f042c0b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56280/0 (socket says 172.21.15.114:56280) 2023-11-04T01:37:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f043096b640 1 -- 172.21.15.114:0/4064898218 learned_addr learned my addr 172.21.15.114:0/4064898218 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f042bfff640 1 --2- 172.21.15.114:0/4064898218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f042c06a830 0x7f042c151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f042b7fe640 1 --2- 172.21.15.114:0/4064898218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f042c0b18b0 0x7f042c0c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f043096b640 1 -- 172.21.15.114:0/4064898218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f042c0b18b0 msgr2=0x7f042c0c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f043096b640 1 --2- 172.21.15.114:0/4064898218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f042c0b18b0 0x7f042c0c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f043096b640 1 -- 172.21.15.114:0/4064898218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f042c06a830 msgr2=0x7f042c151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f043096b640 1 --2- 172.21.15.114:0/4064898218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f042c06a830 0x7f042c151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f043096b640 1 -- 172.21.15.114:0/4064898218 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c009400 con 0x7f042c0cce10 2023-11-04T01:37:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f042b7fe640 1 --2- 172.21.15.114:0/4064898218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f042c0b18b0 0x7f042c0c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f042bfff640 1 --2- 172.21.15.114:0/4064898218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f042c06a830 0x7f042c151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f043096b640 1 --2- 172.21.15.114:0/4064898218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f042c0cce10 0x7f042c0b0c10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0424009eb0 tx=0x7f0424004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f0428ff9640 1 -- 172.21.15.114:0/4064898218 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424009450 con 0x7f042c0cce10 2023-11-04T01:37:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f0428ff9640 1 -- 172.21.15.114:0/4064898218 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042403e410 con 0x7f042c0cce10 2023-11-04T01:37:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f0428ff9640 1 -- 172.21.15.114:0/4064898218 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042403e7c0 con 0x7f042c0cce10 2023-11-04T01:37:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f04323ce640 1 -- 172.21.15.114:0/4064898218 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0424009a70 con 0x7f042c0cce10 2023-11-04T01:37:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.815+0000 7f04323ce640 1 -- 172.21.15.114:0/4064898218 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042c0c81a0 con 0x7f042c0cce10 2023-11-04T01:37:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.816+0000 7f04323ce640 1 -- 172.21.15.114:0/4064898218 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042c0c89a0 con 0x7f042c0cce10 2023-11-04T01:37:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.817+0000 7f0428ff9640 1 -- 172.21.15.114:0/4064898218 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f042403b050 con 0x7f042c0cce10 2023-11-04T01:37:15.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.817+0000 7f0428ff9640 1 --2- 172.21.15.114:0/4064898218 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f041806ae70 0x7f041806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:15.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.817+0000 7f0428ff9640 1 -- 172.21.15.114:0/4064898218 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f04240ab950 con 0x7f042c0cce10 2023-11-04T01:37:15.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.817+0000 7f042bfff640 1 --2- 172.21.15.114:0/4064898218 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f041806ae70 0x7f041806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:15.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.818+0000 7f042bfff640 1 --2- 172.21.15.114:0/4064898218 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f041806ae70 0x7f041806d330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f042c0c6290 tx=0x7f041c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:15.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.821+0000 7f0428ff9640 1 -- 172.21.15.114:0/4064898218 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f042c0c89a0 con 0x7f042c0cce10 2023-11-04T01:37:15.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.988+0000 7f04323ce640 1 -- 172.21.15.114:0/4064898218 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f042c0c89a0 con 0x7f042c0cce10 2023-11-04T01:37:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.989+0000 7f0428ff9640 1 -- 172.21.15.114:0/4064898218 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18796 (secure 0 0 0) 0x7f042c0c89a0 con 0x7f042c0cce10 2023-11-04T01:37:15.991 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:15.991 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:11.562429+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.991+0000 7f04323ce640 1 -- 172.21.15.114:0/4064898218 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f041806ae70 msgr2=0x7f041806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.991+0000 7f04323ce640 1 --2- 172.21.15.114:0/4064898218 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f041806ae70 0x7f041806d330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f042c0c6290 tx=0x7f041c008040 comp rx=0 tx=0).stop 2023-11-04T01:37:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.991+0000 7f04323ce640 1 -- 172.21.15.114:0/4064898218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f042c0cce10 msgr2=0x7f042c0b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.991+0000 7f04323ce640 1 --2- 172.21.15.114:0/4064898218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f042c0cce10 0x7f042c0b0c10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0424009eb0 tx=0x7f0424004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.991+0000 7f04323ce640 1 -- 172.21.15.114:0/4064898218 shutdown_connections 2023-11-04T01:37:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.991+0000 7f04323ce640 1 --2- 172.21.15.114:0/4064898218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f042c0cce10 0x7f042c0b0c10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.991+0000 7f04323ce640 1 --2- 172.21.15.114:0/4064898218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f042c0b18b0 0x7f042c0c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.991+0000 7f04323ce640 1 --2- 172.21.15.114:0/4064898218 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f041806ae70 0x7f041806d330 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.991+0000 7f04323ce640 1 --2- 172.21.15.114:0/4064898218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f042c06a830 0x7f042c151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.991+0000 7f04323ce640 1 -- 172.21.15.114:0/4064898218 >> 172.21.15.114:0/4064898218 conn(0x7f042c06d8b0 msgr2=0x7f042c0cbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.991+0000 7f04323ce640 1 -- 172.21.15.114:0/4064898218 shutdown_connections 2023-11-04T01:37:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:15.991+0000 7f04323ce640 1 -- 172.21.15.114:0/4064898218 wait complete. 2023-11-04T01:37:16.004 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:16.005 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:16.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.104+0000 7fe9d1773640 1 Processor -- start 2023-11-04T01:37:16.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.104+0000 7fe9d1773640 1 -- start start 2023-11-04T01:37:16.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.105+0000 7fe9d1773640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9cc15af20 0x7fe9cc0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.105+0000 7fe9d1773640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9cc0b64c0 0x7fe9cc0cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.105+0000 7fe9d1773640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9cc0d01f0 con 0x7fe9cc0cd3b0 2023-11-04T01:37:16.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.105+0000 7fe9d1773640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9cc0b6a40 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.105+0000 7fe9d1773640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc0d04b0 con 0x7fe9cc15af20 2023-11-04T01:37:16.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.105+0000 7fe9ca7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9cc0b64c0 0x7fe9cc0cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.105+0000 7fe9cb7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe9cc0cd3b0 0x7fe9cc0b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41746/0 (socket says 172.21.15.114:41746) 2023-11-04T01:37:16.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.105+0000 7fe9cb7fe640 1 -- 172.21.15.114:0/539231342 learned_addr learned my addr 172.21.15.114:0/539231342 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:16.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.105+0000 7fe9ca7fc640 1 -- 172.21.15.114:0/539231342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9cc15af20 msgr2=0x7fe9cc0b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.105+0000 7fe9caffd640 1 --2- 172.21.15.114:0/539231342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9cc15af20 0x7fe9cc0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.105+0000 7fe9ca7fc640 1 --2- 172.21.15.114:0/539231342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9cc15af20 0x7fe9cc0b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.105+0000 7fe9ca7fc640 1 -- 172.21.15.114:0/539231342 >> v1:172.21.15.114:6789/0 conn(0x7fe9cc0cd3b0 legacy=0x7fe9cc0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.105+0000 7fe9c9ffb640 1 -- 172.21.15.114:0/539231342 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357618150 0 0) 0x7fe9cc0d01f0 con 0x7fe9cc0cd3b0 2023-11-04T01:37:16.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.105+0000 7fe9ca7fc640 1 -- 172.21.15.114:0/539231342 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc0d0790 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.106+0000 7fe9ca7fc640 1 --2- 172.21.15.114:0/539231342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b64c0 0x7fe9cc0cbc70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00097a0 tx=0x7fe9c002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9cdaf6bf640e60 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.106+0000 7fe9c9ffb640 1 -- 172.21.15.114:0/539231342 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0031830 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.106+0000 7fe9c9ffb640 1 -- 172.21.15.114:0/539231342 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c0031990 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.106+0000 7fe9c9ffb640 1 -- 172.21.15.114:0/539231342 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0031d20 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.107+0000 7fe9d1773640 1 -- 172.21.15.114:0/539231342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b64c0 msgr2=0x7fe9cc0cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.107+0000 7fe9d1773640 1 --2- 172.21.15.114:0/539231342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b64c0 0x7fe9cc0cbc70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00097a0 tx=0x7fe9c002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.107+0000 7fe9d1773640 1 -- 172.21.15.114:0/539231342 shutdown_connections 2023-11-04T01:37:16.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.107+0000 7fe9d1773640 1 --2- 172.21.15.114:0/539231342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b64c0 0x7fe9cc0cbc70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.107+0000 7fe9d1773640 1 --2- 172.21.15.114:0/539231342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9cc15af20 0x7fe9cc0b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.107+0000 7fe9d1773640 1 -- 172.21.15.114:0/539231342 >> 172.21.15.114:0/539231342 conn(0x7fe9cc06ea20 msgr2=0x7fe9cc06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.107+0000 7fe9d1773640 1 -- 172.21.15.114:0/539231342 shutdown_connections 2023-11-04T01:37:16.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.107+0000 7fe9d1773640 1 -- 172.21.15.114:0/539231342 wait complete. 2023-11-04T01:37:16.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.108+0000 7fe9d1773640 1 Processor -- start 2023-11-04T01:37:16.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.108+0000 7fe9d1773640 1 -- start start 2023-11-04T01:37:16.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.109+0000 7fe9d1773640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b64c0 0x7fe9cc0b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.109+0000 7fe9d1773640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9cc0cd3b0 0x7fe9cc1ef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.109+0000 7fe9d1773640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9cc15af20 0x7fe9cc1eff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.109+0000 7fe9d1773640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc154940 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.109+0000 7fe9d1773640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc1f0470 con 0x7fe9cc0cd3b0 2023-11-04T01:37:16.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.109+0000 7fe9d1773640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc153fa0 con 0x7fe9cc15af20 2023-11-04T01:37:16.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.109+0000 7fe9caffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b64c0 0x7fe9cc0b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.109+0000 7fe9caffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b64c0 0x7fe9cc0b05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56300/0 (socket says 172.21.15.114:56300) 2023-11-04T01:37:16.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.109+0000 7fe9caffd640 1 -- 172.21.15.114:0/2478120607 learned_addr learned my addr 172.21.15.114:0/2478120607 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:16.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.109+0000 7fe9caffd640 1 -- 172.21.15.114:0/2478120607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9cc15af20 msgr2=0x7fe9cc1eff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.109+0000 7fe9caffd640 1 --2- 172.21.15.114:0/2478120607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9cc15af20 0x7fe9cc1eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.109+0000 7fe9caffd640 1 -- 172.21.15.114:0/2478120607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9cc0cd3b0 msgr2=0x7fe9cc1ef9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.109+0000 7fe9caffd640 1 --2- 172.21.15.114:0/2478120607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9cc0cd3b0 0x7fe9cc1ef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.109+0000 7fe9caffd640 1 -- 172.21.15.114:0/2478120607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c0009400 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.109+0000 7fe9caffd640 1 --2- 172.21.15.114:0/2478120607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b64c0 0x7fe9cc0b05d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00ccd0 tx=0x7fe9bc00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.109+0000 7fe9b37fe640 1 -- 172.21.15.114:0/2478120607 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc003990 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.110+0000 7fe9b37fe640 1 -- 172.21.15.114:0/2478120607 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc003af0 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.110+0000 7fe9b37fe640 1 -- 172.21.15.114:0/2478120607 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc004020 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.110+0000 7fe9d1773640 1 -- 172.21.15.114:0/2478120607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9cc154280 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.110+0000 7fe9d1773640 1 -- 172.21.15.114:0/2478120607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9cc0b0bb0 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.111+0000 7fe9d1773640 1 -- 172.21.15.114:0/2478120607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9cc0b4d60 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.111+0000 7fe9b37fe640 1 -- 172.21.15.114:0/2478120607 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe9bc004180 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.111+0000 7fe9b37fe640 1 --2- 172.21.15.114:0/2478120607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe9b806ae70 0x7fe9b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.111+0000 7fe9b37fe640 1 -- 172.21.15.114:0/2478120607 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe9bc089e00 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.111+0000 7fe9ca7fc640 1 --2- 172.21.15.114:0/2478120607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe9b806ae70 0x7fe9b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.112+0000 7fe9ca7fc640 1 --2- 172.21.15.114:0/2478120607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe9b806ae70 0x7fe9b806d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0036000 tx=0x7fe9c0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.115+0000 7fe9b37fe640 1 -- 172.21.15.114:0/2478120607 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe9bc054af0 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.280+0000 7fe9d1773640 1 -- 172.21.15.114:0/2478120607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9cc0b0080 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.280+0000 7fe9b37fe640 1 -- 172.21.15.114:0/2478120607 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe9bc01d070 con 0x7fe9cc0b64c0 2023-11-04T01:37:16.282 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:37:16.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.282+0000 7fe9d1773640 1 -- 172.21.15.114:0/2478120607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe9b806ae70 msgr2=0x7fe9b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.282+0000 7fe9d1773640 1 --2- 172.21.15.114:0/2478120607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe9b806ae70 0x7fe9b806d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0036000 tx=0x7fe9c0030000 comp rx=0 tx=0).stop 2023-11-04T01:37:16.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.282+0000 7fe9d1773640 1 -- 172.21.15.114:0/2478120607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b64c0 msgr2=0x7fe9cc0b05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.282+0000 7fe9d1773640 1 --2- 172.21.15.114:0/2478120607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b64c0 0x7fe9cc0b05d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00ccd0 tx=0x7fe9bc00a5c0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.282+0000 7fe9d1773640 1 -- 172.21.15.114:0/2478120607 shutdown_connections 2023-11-04T01:37:16.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.282+0000 7fe9d1773640 1 --2- 172.21.15.114:0/2478120607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9cc15af20 0x7fe9cc1eff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.282+0000 7fe9d1773640 1 --2- 172.21.15.114:0/2478120607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe9b806ae70 0x7fe9b806d330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.282+0000 7fe9d1773640 1 --2- 172.21.15.114:0/2478120607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9cc0cd3b0 0x7fe9cc1ef9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.282+0000 7fe9d1773640 1 --2- 172.21.15.114:0/2478120607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b64c0 0x7fe9cc0b05d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.282+0000 7fe9d1773640 1 -- 172.21.15.114:0/2478120607 >> 172.21.15.114:0/2478120607 conn(0x7fe9cc06ea20 msgr2=0x7fe9cc0b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.282+0000 7fe9d1773640 1 -- 172.21.15.114:0/2478120607 shutdown_connections 2023-11-04T01:37:16.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.282+0000 7fe9d1773640 1 -- 172.21.15.114:0/2478120607 wait complete. 2023-11-04T01:37:16.295 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:16.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.395+0000 7f464a32c640 1 Processor -- start 2023-11-04T01:37:16.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.395+0000 7f464a32c640 1 -- start start 2023-11-04T01:37:16.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f464a32c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4644070e20 0x7f46440adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f464a32c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46440ad730 0x7f464415e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f464a32c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46440c3900 con 0x7f464415ad30 2023-11-04T01:37:16.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f464a32c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46440ae260 con 0x7f4644070e20 2023-11-04T01:37:16.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f464a32c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46440c3be0 con 0x7f46440ad730 2023-11-04T01:37:16.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f4643fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f464415ad30 0x7f4644070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41756/0 (socket says 172.21.15.114:41756) 2023-11-04T01:37:16.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f4643fff640 1 -- 172.21.15.114:0/2607689946 learned_addr learned my addr 172.21.15.114:0/2607689946 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:16.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f4642ffd640 1 -- 172.21.15.114:0/2607689946 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993360010 0 0) 0x7f46440c3900 con 0x7f464415ad30 2023-11-04T01:37:16.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f4642ffd640 1 -- 172.21.15.114:0/2607689946 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f462c003520 con 0x7f464415ad30 2023-11-04T01:37:16.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f46437fe640 1 --2- 172.21.15.114:0/2607689946 >> v2:172.21.15.141:3300/0 conn(0x7f4644070e20 0x7f46440adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f46488c9640 1 --2- 172.21.15.114:0/2607689946 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46440ad730 0x7f464415e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f4642ffd640 1 -- 172.21.15.114:0/2607689946 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1236879314 0 0) 0x7f462c003520 con 0x7f464415ad30 2023-11-04T01:37:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f4642ffd640 1 -- 172.21.15.114:0/2607689946 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46440ad730 msgr2=0x7f464415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f4642ffd640 1 --2- 172.21.15.114:0/2607689946 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46440ad730 0x7f464415e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f4642ffd640 1 -- 172.21.15.114:0/2607689946 >> v2:172.21.15.141:3300/0 conn(0x7f4644070e20 msgr2=0x7f46440adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f4642ffd640 1 --2- 172.21.15.114:0/2607689946 >> v2:172.21.15.141:3300/0 conn(0x7f4644070e20 0x7f46440adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f4642ffd640 1 -- 172.21.15.114:0/2607689946 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46440c3ec0 con 0x7f464415ad30 2023-11-04T01:37:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f4642ffd640 1 -- 172.21.15.114:0/2607689946 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f4634001670 con 0x7f464415ad30 2023-11-04T01:37:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f46437fe640 1 --2- 172.21.15.114:0/2607689946 >> v2:172.21.15.141:3300/0 conn(0x7f4644070e20 0x7f46440adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.396+0000 7f4642ffd640 1 -- 172.21.15.114:0/2607689946 >> v1:172.21.15.114:6789/0 conn(0x7f464415ad30 legacy=0x7f4644070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.397+0000 7f4642ffd640 1 --2- 172.21.15.114:0/2607689946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f462c003970 0x7f462c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.397+0000 7f4642ffd640 1 --2- 172.21.15.114:0/2607689946 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46440ad730 0x7f462c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.397+0000 7f4642ffd640 1 --2- 172.21.15.114:0/2607689946 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f462c004d00 0x7f462c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.397+0000 7f4642ffd640 1 -- 172.21.15.114:0/2607689946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46440ae260 con 0x7f462c003970 2023-11-04T01:37:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.397+0000 7f4642ffd640 1 -- 172.21.15.114:0/2607689946 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46440c3be0 con 0x7f462c004d00 2023-11-04T01:37:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.397+0000 7f4642ffd640 1 -- 172.21.15.114:0/2607689946 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c00ba60 con 0x7f46440ad730 2023-11-04T01:37:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.397+0000 7f4643fff640 1 --2- 172.21.15.114:0/2607689946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f462c003970 0x7f462c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.397+0000 7f46437fe640 1 --2- 172.21.15.114:0/2607689946 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46440ad730 0x7f462c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.397+0000 7f46488c9640 1 --2- 172.21.15.114:0/2607689946 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f462c004d00 0x7f462c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.397+0000 7f4643fff640 1 -- 172.21.15.114:0/2607689946 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46440ad730 msgr2=0x7f462c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.397+0000 7f4643fff640 1 --2- 172.21.15.114:0/2607689946 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46440ad730 0x7f462c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.397+0000 7f4643fff640 1 -- 172.21.15.114:0/2607689946 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f462c004d00 msgr2=0x7f462c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.397+0000 7f4643fff640 1 --2- 172.21.15.114:0/2607689946 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f462c004d00 0x7f462c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.397+0000 7f4643fff640 1 -- 172.21.15.114:0/2607689946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c003520 con 0x7f462c003970 2023-11-04T01:37:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.397+0000 7f46437fe640 1 --2- 172.21.15.114:0/2607689946 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46440ad730 0x7f462c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.397+0000 7f46488c9640 1 --2- 172.21.15.114:0/2607689946 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f462c004d00 0x7f462c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.398+0000 7f4643fff640 1 --2- 172.21.15.114:0/2607689946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f462c003970 0x7f462c003d90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f463400c240 tx=0x7f462c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d744f68c857374 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.398+0000 7f4642ffd640 1 -- 172.21.15.114:0/2607689946 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463402cb00 con 0x7f462c003970 2023-11-04T01:37:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.398+0000 7f4642ffd640 1 -- 172.21.15.114:0/2607689946 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463402cc60 con 0x7f462c003970 2023-11-04T01:37:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.398+0000 7f4642ffd640 1 -- 172.21.15.114:0/2607689946 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634005b10 con 0x7f462c003970 2023-11-04T01:37:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.398+0000 7f464a32c640 1 -- 172.21.15.114:0/2607689946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f462c003970 msgr2=0x7f462c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.398+0000 7f464a32c640 1 --2- 172.21.15.114:0/2607689946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f462c003970 0x7f462c003d90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f463400c240 tx=0x7f462c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.398+0000 7f46488c9640 1 -- 172.21.15.114:0/2607689946 reap_dead start 2023-11-04T01:37:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.398+0000 7f464a32c640 1 -- 172.21.15.114:0/2607689946 shutdown_connections 2023-11-04T01:37:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.398+0000 7f464a32c640 1 -- 172.21.15.114:0/2607689946 >> 172.21.15.114:0/2607689946 conn(0x7f46440ce950 msgr2=0x7f46440ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.398+0000 7f464a32c640 1 -- 172.21.15.114:0/2607689946 shutdown_connections 2023-11-04T01:37:16.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.398+0000 7f464a32c640 1 -- 172.21.15.114:0/2607689946 wait complete. 2023-11-04T01:37:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.399+0000 7f464a32c640 1 Processor -- start 2023-11-04T01:37:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.400+0000 7f464a32c640 1 -- start start 2023-11-04T01:37:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.400+0000 7f464a32c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f462c003970 0x7f46441442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.400+0000 7f464a32c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4644151380 0x7f4644151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.400+0000 7f464a32c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46440b2d10 0x7f46441524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.400+0000 7f464a32c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46440c62d0 con 0x7f462c003970 2023-11-04T01:37:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.400+0000 7f464a32c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46440b32d0 con 0x7f4644151380 2023-11-04T01:37:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.400+0000 7f464a32c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46440b35b0 con 0x7f46440b2d10 2023-11-04T01:37:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.400+0000 7f4643fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f462c003970 0x7f46441442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.400+0000 7f4643fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f462c003970 0x7f46441442a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56328/0 (socket says 172.21.15.114:56328) 2023-11-04T01:37:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.400+0000 7f4643fff640 1 -- 172.21.15.114:0/1117593994 learned_addr learned my addr 172.21.15.114:0/1117593994 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.401+0000 7f46437fe640 1 --2- 172.21.15.114:0/1117593994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4644151380 0x7f4644151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.401+0000 7f46488c9640 1 --2- 172.21.15.114:0/1117593994 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46440b2d10 0x7f46441524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.401+0000 7f4643fff640 1 -- 172.21.15.114:0/1117593994 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46440b2d10 msgr2=0x7f46441524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.401+0000 7f4643fff640 1 --2- 172.21.15.114:0/1117593994 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46440b2d10 0x7f46441524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.401+0000 7f4643fff640 1 -- 172.21.15.114:0/1117593994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4644151380 msgr2=0x7f4644151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.401+0000 7f4643fff640 1 --2- 172.21.15.114:0/1117593994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4644151380 0x7f4644151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.401+0000 7f4643fff640 1 -- 172.21.15.114:0/1117593994 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46440b3890 con 0x7f462c003970 2023-11-04T01:37:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.401+0000 7f46488c9640 1 --2- 172.21.15.114:0/1117593994 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46440b2d10 0x7f46441524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.401+0000 7f46437fe640 1 --2- 172.21.15.114:0/1117593994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4644151380 0x7f4644151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.401+0000 7f4643fff640 1 --2- 172.21.15.114:0/1117593994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f462c003970 0x7f46441442a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f463400c240 tx=0x7f4634001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.401+0000 7f4640ff9640 1 -- 172.21.15.114:0/1117593994 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634005c80 con 0x7f462c003970 2023-11-04T01:37:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.401+0000 7f4640ff9640 1 -- 172.21.15.114:0/1117593994 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4634005de0 con 0x7f462c003970 2023-11-04T01:37:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.401+0000 7f464a32c640 1 -- 172.21.15.114:0/1117593994 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46440b3b70 con 0x7f462c003970 2023-11-04T01:37:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.401+0000 7f4640ff9640 1 -- 172.21.15.114:0/1117593994 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46340072b0 con 0x7f462c003970 2023-11-04T01:37:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.401+0000 7f464a32c640 1 -- 172.21.15.114:0/1117593994 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46441447e0 con 0x7f462c003970 2023-11-04T01:37:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.402+0000 7f464a32c640 1 -- 172.21.15.114:0/1117593994 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4644074290 con 0x7f462c003970 2023-11-04T01:37:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.402+0000 7f4640ff9640 1 -- 172.21.15.114:0/1117593994 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4634032070 con 0x7f462c003970 2023-11-04T01:37:16.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.403+0000 7f4640ff9640 1 --2- 172.21.15.114:0/1117593994 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f463006ae70 0x7f463006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.403+0000 7f4640ff9640 1 -- 172.21.15.114:0/1117593994 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f46340aa9d0 con 0x7f462c003970 2023-11-04T01:37:16.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.403+0000 7f46437fe640 1 --2- 172.21.15.114:0/1117593994 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f463006ae70 0x7f463006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.403+0000 7f46437fe640 1 --2- 172.21.15.114:0/1117593994 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f463006ae70 0x7f463006d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4644151dd0 tx=0x7f4638008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.407+0000 7f4640ff9640 1 -- 172.21.15.114:0/1117593994 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4634075800 con 0x7f462c003970 2023-11-04T01:37:16.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.574+0000 7f464a32c640 1 -- 172.21.15.114:0/1117593994 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4644071970 con 0x7f462c003970 2023-11-04T01:37:16.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.574+0000 7f4640ff9640 1 -- 172.21.15.114:0/1117593994 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4634045020 con 0x7f462c003970 2023-11-04T01:37:16.576 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:16.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.576+0000 7f464a32c640 1 -- 172.21.15.114:0/1117593994 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f463006ae70 msgr2=0x7f463006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.576+0000 7f464a32c640 1 --2- 172.21.15.114:0/1117593994 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f463006ae70 0x7f463006d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4644151dd0 tx=0x7f4638008040 comp rx=0 tx=0).stop 2023-11-04T01:37:16.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.576+0000 7f464a32c640 1 -- 172.21.15.114:0/1117593994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f462c003970 msgr2=0x7f46441442a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.576+0000 7f464a32c640 1 --2- 172.21.15.114:0/1117593994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f462c003970 0x7f46441442a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f463400c240 tx=0x7f4634001a00 comp rx=0 tx=0).stop 2023-11-04T01:37:16.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.576+0000 7f464a32c640 1 -- 172.21.15.114:0/1117593994 shutdown_connections 2023-11-04T01:37:16.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.576+0000 7f464a32c640 1 --2- 172.21.15.114:0/1117593994 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46440b2d10 0x7f46441524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.576+0000 7f464a32c640 1 --2- 172.21.15.114:0/1117593994 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f463006ae70 0x7f463006d330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.576+0000 7f464a32c640 1 --2- 172.21.15.114:0/1117593994 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4644151380 0x7f4644151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.576+0000 7f464a32c640 1 --2- 172.21.15.114:0/1117593994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f462c003970 0x7f46441442a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.576+0000 7f464a32c640 1 -- 172.21.15.114:0/1117593994 >> 172.21.15.114:0/1117593994 conn(0x7f46440ce950 msgr2=0x7f46440c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.576+0000 7f464a32c640 1 -- 172.21.15.114:0/1117593994 shutdown_connections 2023-11-04T01:37:16.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.577+0000 7f464a32c640 1 -- 172.21.15.114:0/1117593994 wait complete. 2023-11-04T01:37:16.589 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:16.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.689+0000 7fa01346f640 1 Processor -- start 2023-11-04T01:37:16.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.690+0000 7fa01346f640 1 -- start start 2023-11-04T01:37:16.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.690+0000 7fa01346f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c15cfd0 0x7fa00c06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.690+0000 7fa01346f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa00c0cf180 0x7fa00c161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.690+0000 7fa01346f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00c0cea20 con 0x7fa00c0cd570 2023-11-04T01:37:16.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.690+0000 7fa01346f640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00c15d3b0 con 0x7fa00c0cf180 2023-11-04T01:37:16.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.690+0000 7fa01346f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c161980 con 0x7fa00c15cfd0 2023-11-04T01:37:16.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.690+0000 7fa011a0c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa00c0cd570 0x7fa00c0cb540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51472/0 (socket says 172.21.15.114:51472) 2023-11-04T01:37:16.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.690+0000 7fa011a0c640 1 -- 172.21.15.114:0/1159892940 learned_addr learned my addr 172.21.15.114:0/1159892940 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:16.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa010a0a640 1 --2- 172.21.15.114:0/1159892940 >> v2:172.21.15.141:3300/0 conn(0x7fa00c0cf180 0x7fa00c161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa01120b640 1 --2- 172.21.15.114:0/1159892940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c15cfd0 0x7fa00c06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa003fff640 1 -- 172.21.15.114:0/1159892940 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634808264 0 0) 0x7fa00c0cea20 con 0x7fa00c0cd570 2023-11-04T01:37:16.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa003fff640 1 -- 172.21.15.114:0/1159892940 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ff8003520 con 0x7fa00c0cd570 2023-11-04T01:37:16.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa003fff640 1 -- 172.21.15.114:0/1159892940 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2152613508 0 0) 0x7f9ff8003520 con 0x7fa00c0cd570 2023-11-04T01:37:16.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa003fff640 1 -- 172.21.15.114:0/1159892940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c15cfd0 msgr2=0x7fa00c06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa003fff640 1 --2- 172.21.15.114:0/1159892940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c15cfd0 0x7fa00c06c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa003fff640 1 -- 172.21.15.114:0/1159892940 >> v2:172.21.15.141:3300/0 conn(0x7fa00c0cf180 msgr2=0x7fa00c161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa003fff640 1 --2- 172.21.15.114:0/1159892940 >> v2:172.21.15.141:3300/0 conn(0x7fa00c0cf180 0x7fa00c161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa003fff640 1 -- 172.21.15.114:0/1159892940 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c0cf610 con 0x7fa00c0cd570 2023-11-04T01:37:16.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa003fff640 1 -- 172.21.15.114:0/1159892940 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fa004001670 con 0x7fa00c0cd570 2023-11-04T01:37:16.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa003fff640 1 -- 172.21.15.114:0/1159892940 >> v1:172.21.15.114:6789/0 conn(0x7fa00c0cd570 legacy=0x7fa00c0cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa003fff640 1 --2- 172.21.15.114:0/1159892940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c15cfd0 0x7f9ff8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa003fff640 1 --2- 172.21.15.114:0/1159892940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff8003ef0 0x7f9ff80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa003fff640 1 --2- 172.21.15.114:0/1159892940 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ff8004d00 0x7f9ff8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa003fff640 1 -- 172.21.15.114:0/1159892940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c15d3b0 con 0x7f9ff8003ef0 2023-11-04T01:37:16.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa003fff640 1 -- 172.21.15.114:0/1159892940 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c161980 con 0x7f9ff8004d00 2023-11-04T01:37:16.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa003fff640 1 -- 172.21.15.114:0/1159892940 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff800b9d0 con 0x7fa00c15cfd0 2023-11-04T01:37:16.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa010a0a640 1 --2- 172.21.15.114:0/1159892940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff8003ef0 0x7f9ff80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa01120b640 1 --2- 172.21.15.114:0/1159892940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c15cfd0 0x7f9ff8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa011a0c640 1 --2- 172.21.15.114:0/1159892940 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ff8004d00 0x7f9ff8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa010a0a640 1 -- 172.21.15.114:0/1159892940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c15cfd0 msgr2=0x7f9ff8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa010a0a640 1 --2- 172.21.15.114:0/1159892940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c15cfd0 0x7f9ff8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa010a0a640 1 -- 172.21.15.114:0/1159892940 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ff8004d00 msgr2=0x7f9ff8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa010a0a640 1 --2- 172.21.15.114:0/1159892940 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ff8004d00 0x7f9ff8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa010a0a640 1 -- 172.21.15.114:0/1159892940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8003520 con 0x7f9ff8003ef0 2023-11-04T01:37:16.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.691+0000 7fa011a0c640 1 --2- 172.21.15.114:0/1159892940 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ff8004d00 0x7f9ff8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:16.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.692+0000 7fa010a0a640 1 --2- 172.21.15.114:0/1159892940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff8003ef0 0x7f9ff80047c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009af0 tx=0x7f9ff80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2875c0e5f3fd29a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.692+0000 7fa003fff640 1 -- 172.21.15.114:0/1159892940 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc02c710 con 0x7f9ff8003ef0 2023-11-04T01:37:16.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.692+0000 7fa003fff640 1 -- 172.21.15.114:0/1159892940 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc02c870 con 0x7f9ff8003ef0 2023-11-04T01:37:16.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.692+0000 7fa003fff640 1 -- 172.21.15.114:0/1159892940 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc02cc00 con 0x7f9ff8003ef0 2023-11-04T01:37:16.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.693+0000 7fa01346f640 1 -- 172.21.15.114:0/1159892940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff8003ef0 msgr2=0x7f9ff80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.693+0000 7fa01346f640 1 --2- 172.21.15.114:0/1159892940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff8003ef0 0x7f9ff80047c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009af0 tx=0x7f9ff80057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.693+0000 7fa011a0c640 1 -- 172.21.15.114:0/1159892940 reap_dead start 2023-11-04T01:37:16.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.693+0000 7fa01346f640 1 -- 172.21.15.114:0/1159892940 shutdown_connections 2023-11-04T01:37:16.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.693+0000 7fa01346f640 1 -- 172.21.15.114:0/1159892940 >> 172.21.15.114:0/1159892940 conn(0x7fa00c06ea20 msgr2=0x7fa00c06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.693+0000 7fa01346f640 1 -- 172.21.15.114:0/1159892940 shutdown_connections 2023-11-04T01:37:16.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.693+0000 7fa01346f640 1 -- 172.21.15.114:0/1159892940 wait complete. 2023-11-04T01:37:16.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.694+0000 7fa01346f640 1 Processor -- start 2023-11-04T01:37:16.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.694+0000 7fa01346f640 1 -- start start 2023-11-04T01:37:16.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa01346f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ff8003ef0 0x7fa00c0b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa01346f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa00c0c8df0 0x7fa00c159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa01346f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa00c0ca280 0x7fa00c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa01346f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0c9f70 con 0x7fa00c0ca280 2023-11-04T01:37:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa01346f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0c9360 con 0x7fa00c0c8df0 2023-11-04T01:37:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa01346f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0c9640 con 0x7f9ff8003ef0 2023-11-04T01:37:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa011a0c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa00c0ca280 0x7fa00c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa011a0c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa00c0ca280 0x7fa00c15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43500/0 (socket says 172.21.15.114:43500) 2023-11-04T01:37:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa011a0c640 1 -- 172.21.15.114:0/277527265 learned_addr learned my addr 172.21.15.114:0/277527265 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa010a0a640 1 --2- 172.21.15.114:0/277527265 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa00c0c8df0 0x7fa00c159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa01120b640 1 --2- 172.21.15.114:0/277527265 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ff8003ef0 0x7fa00c0b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa011a0c640 1 -- 172.21.15.114:0/277527265 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ff8003ef0 msgr2=0x7fa00c0b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa011a0c640 1 --2- 172.21.15.114:0/277527265 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ff8003ef0 0x7fa00c0b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa011a0c640 1 -- 172.21.15.114:0/277527265 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa00c0c8df0 msgr2=0x7fa00c159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa011a0c640 1 --2- 172.21.15.114:0/277527265 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa00c0c8df0 0x7fa00c159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa011a0c640 1 -- 172.21.15.114:0/277527265 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c0c9920 con 0x7fa00c0ca280 2023-11-04T01:37:16.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa011a0c640 1 --2- 172.21.15.114:0/277527265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa00c0ca280 0x7fa00c15a360 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa00c072520 tx=0x7fa00400ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa001ffb640 1 -- 172.21.15.114:0/277527265 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004012590 con 0x7fa00c0ca280 2023-11-04T01:37:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa001ffb640 1 -- 172.21.15.114:0/277527265 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0040126f0 con 0x7fa00c0ca280 2023-11-04T01:37:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa01346f640 1 -- 172.21.15.114:0/277527265 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00c0c9c00 con 0x7fa00c0ca280 2023-11-04T01:37:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.695+0000 7fa001ffb640 1 -- 172.21.15.114:0/277527265 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004012aa0 con 0x7fa00c0ca280 2023-11-04T01:37:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.696+0000 7fa01346f640 1 -- 172.21.15.114:0/277527265 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00c0b58a0 con 0x7fa00c0ca280 2023-11-04T01:37:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.697+0000 7fa01346f640 1 -- 172.21.15.114:0/277527265 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00c06d3c0 con 0x7fa00c0ca280 2023-11-04T01:37:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.697+0000 7fa001ffb640 1 -- 172.21.15.114:0/277527265 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa004012c00 con 0x7fa00c0ca280 2023-11-04T01:37:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.697+0000 7fa001ffb640 1 --2- 172.21.15.114:0/277527265 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ff006ae70 0x7f9ff006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.698+0000 7fa001ffb640 1 -- 172.21.15.114:0/277527265 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa004089670 con 0x7fa00c0ca280 2023-11-04T01:37:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.698+0000 7fa01120b640 1 --2- 172.21.15.114:0/277527265 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ff006ae70 0x7f9ff006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.698+0000 7fa01120b640 1 --2- 172.21.15.114:0/277527265 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ff006ae70 0x7f9ff006d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa0080133c0 tx=0x7fa00800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.702+0000 7fa001ffb640 1 -- 172.21.15.114:0/277527265 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa004057e80 con 0x7fa00c0ca280 2023-11-04T01:37:16.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.868+0000 7fa01346f640 1 -- 172.21.15.114:0/277527265 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa00c06b300 con 0x7fa00c0ca280 2023-11-04T01:37:16.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.869+0000 7fa001ffb640 1 -- 172.21.15.114:0/277527265 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa004057a10 con 0x7fa00c0ca280 2023-11-04T01:37:16.871 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:37:16.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.871+0000 7fa01346f640 1 -- 172.21.15.114:0/277527265 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ff006ae70 msgr2=0x7f9ff006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.871+0000 7fa01346f640 1 --2- 172.21.15.114:0/277527265 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ff006ae70 0x7f9ff006d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa0080133c0 tx=0x7fa00800b040 comp rx=0 tx=0).stop 2023-11-04T01:37:16.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.871+0000 7fa01346f640 1 -- 172.21.15.114:0/277527265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa00c0ca280 msgr2=0x7fa00c15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.871+0000 7fa01346f640 1 --2- 172.21.15.114:0/277527265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa00c0ca280 0x7fa00c15a360 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa00c072520 tx=0x7fa00400ead0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.871+0000 7fa01346f640 1 -- 172.21.15.114:0/277527265 shutdown_connections 2023-11-04T01:37:16.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.871+0000 7fa01346f640 1 --2- 172.21.15.114:0/277527265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa00c0ca280 0x7fa00c15a360 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.871+0000 7fa01346f640 1 --2- 172.21.15.114:0/277527265 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ff006ae70 0x7f9ff006d330 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.871+0000 7fa01346f640 1 --2- 172.21.15.114:0/277527265 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa00c0c8df0 0x7fa00c159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.871+0000 7fa01346f640 1 --2- 172.21.15.114:0/277527265 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9ff8003ef0 0x7fa00c0b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.871+0000 7fa01346f640 1 -- 172.21.15.114:0/277527265 >> 172.21.15.114:0/277527265 conn(0x7fa00c06ea20 msgr2=0x7fa00c15e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.871+0000 7fa01346f640 1 -- 172.21.15.114:0/277527265 shutdown_connections 2023-11-04T01:37:16.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.871+0000 7fa01346f640 1 -- 172.21.15.114:0/277527265 wait complete. 2023-11-04T01:37:16.883 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.984+0000 7fb0a90cf640 1 Processor -- start 2023-11-04T01:37:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.984+0000 7fb0a90cf640 1 -- start start 2023-11-04T01:37:16.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.985+0000 7fb0a90cf640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb0a4153e60 0x7fb0a415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.985+0000 7fb0a90cf640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0a40cd6d0 0x7fb0a4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.985+0000 7fb0a90cf640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0a40b4880 0x7fb0a40b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.985+0000 7fb0a90cf640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a40cde60 con 0x7fb0a40b4880 2023-11-04T01:37:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.985+0000 7fb0a90cf640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a4160f90 con 0x7fb0a4153e60 2023-11-04T01:37:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.985+0000 7fb0a90cf640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40b51e0 con 0x7fb0a40cd6d0 2023-11-04T01:37:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.985+0000 7fb0a359e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0a40b4880 0x7fb0a40b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.985+0000 7fb0a359e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0a40b4880 0x7fb0a40b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43514/0 (socket says 172.21.15.114:43514) 2023-11-04T01:37:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.985+0000 7fb0a359e640 1 -- 172.21.15.114:0/2322720803 learned_addr learned my addr 172.21.15.114:0/2322720803 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.985+0000 7fb0a359e640 1 -- 172.21.15.114:0/2322720803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0a40cd6d0 msgr2=0x7fb0a4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.985+0000 7fb0a359e640 1 --2- 172.21.15.114:0/2322720803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0a40cd6d0 0x7fb0a4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.985+0000 7fb0a359e640 1 -- 172.21.15.114:0/2322720803 >> v2:172.21.15.141:3300/0 conn(0x7fb0a4153e60 msgr2=0x7fb0a415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:16.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.985+0000 7fb0a359e640 1 --2- 172.21.15.114:0/2322720803 >> v2:172.21.15.141:3300/0 conn(0x7fb0a4153e60 0x7fb0a415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.985+0000 7fb0a359e640 1 -- 172.21.15.114:0/2322720803 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a415e400 con 0x7fb0a40b4880 2023-11-04T01:37:16.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.986+0000 7fb0a359e640 1 --2- 172.21.15.114:0/2322720803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a40b4880 0x7fb0a40b4ca0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb0a408abe0 tx=0x7fb09c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d7755bdb5866dd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.986+0000 7fb0a1d9b640 1 -- 172.21.15.114:0/2322720803 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c031870 con 0x7fb0a40b4880 2023-11-04T01:37:16.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.986+0000 7fb0a1d9b640 1 -- 172.21.15.114:0/2322720803 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c0319d0 con 0x7fb0a40b4880 2023-11-04T01:37:16.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.986+0000 7fb0a1d9b640 1 -- 172.21.15.114:0/2322720803 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c031d60 con 0x7fb0a40b4880 2023-11-04T01:37:16.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.987+0000 7fb0a90cf640 1 -- 172.21.15.114:0/2322720803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a40b4880 msgr2=0x7fb0a40b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.987+0000 7fb0a90cf640 1 --2- 172.21.15.114:0/2322720803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a40b4880 0x7fb0a40b4ca0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb0a408abe0 tx=0x7fb09c02b910 comp rx=0 tx=0).stop 2023-11-04T01:37:16.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.987+0000 7fb0a90cf640 1 -- 172.21.15.114:0/2322720803 shutdown_connections 2023-11-04T01:37:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.987+0000 7fb0a90cf640 1 --2- 172.21.15.114:0/2322720803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0a40cd6d0 0x7fb0a4161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.987+0000 7fb0a90cf640 1 --2- 172.21.15.114:0/2322720803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a40b4880 0x7fb0a40b4ca0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.987+0000 7fb0a90cf640 1 --2- 172.21.15.114:0/2322720803 >> v2:172.21.15.141:3300/0 conn(0x7fb0a4153e60 0x7fb0a415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.987+0000 7fb0a90cf640 1 -- 172.21.15.114:0/2322720803 >> 172.21.15.114:0/2322720803 conn(0x7fb0a40cf880 msgr2=0x7fb0a40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.987+0000 7fb0a90cf640 1 -- 172.21.15.114:0/2322720803 shutdown_connections 2023-11-04T01:37:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.987+0000 7fb0a90cf640 1 -- 172.21.15.114:0/2322720803 wait complete. 2023-11-04T01:37:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.988+0000 7fb0a90cf640 1 Processor -- start 2023-11-04T01:37:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.988+0000 7fb0a90cf640 1 -- start start 2023-11-04T01:37:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.989+0000 7fb0a90cf640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0a40b4880 0x7fb0a40c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.989+0000 7fb0a90cf640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0a40cd6d0 0x7fb0a4157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.989+0000 7fb0a90cf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a4153e60 0x7fb0a41580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.989+0000 7fb0a90cf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40cbc70 con 0x7fb0a4153e60 2023-11-04T01:37:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.989+0000 7fb0a90cf640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40cbf50 con 0x7fb0a40cd6d0 2023-11-04T01:37:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.989+0000 7fb0a90cf640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40cc230 con 0x7fb0a40b4880 2023-11-04T01:37:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.989+0000 7fb0a359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a4153e60 0x7fb0a41580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.989+0000 7fb0a359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a4153e60 0x7fb0a41580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43530/0 (socket says 172.21.15.114:43530) 2023-11-04T01:37:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.989+0000 7fb0a359e640 1 -- 172.21.15.114:0/351904023 learned_addr learned my addr 172.21.15.114:0/351904023 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.989+0000 7fb0a259c640 1 --2- 172.21.15.114:0/351904023 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0a40cd6d0 0x7fb0a4157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.989+0000 7fb0a2d9d640 1 --2- 172.21.15.114:0/351904023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0a40b4880 0x7fb0a40c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.989+0000 7fb0a359e640 1 -- 172.21.15.114:0/351904023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0a40b4880 msgr2=0x7fb0a40c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.989+0000 7fb0a359e640 1 --2- 172.21.15.114:0/351904023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0a40b4880 0x7fb0a40c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.989+0000 7fb0a359e640 1 -- 172.21.15.114:0/351904023 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0a40cd6d0 msgr2=0x7fb0a4157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:16.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.989+0000 7fb0a359e640 1 --2- 172.21.15.114:0/351904023 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0a40cd6d0 0x7fb0a4157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:16.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.989+0000 7fb0a359e640 1 -- 172.21.15.114:0/351904023 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c0094d0 con 0x7fb0a4153e60 2023-11-04T01:37:16.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.990+0000 7fb0a359e640 1 --2- 172.21.15.114:0/351904023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a4153e60 0x7fb0a41580b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb09c02b950 tx=0x7fb09c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.990+0000 7fb08b7fe640 1 -- 172.21.15.114:0/351904023 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c0443f0 con 0x7fb0a4153e60 2023-11-04T01:37:16.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.990+0000 7fb08b7fe640 1 -- 172.21.15.114:0/351904023 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c044570 con 0x7fb0a4153e60 2023-11-04T01:37:16.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.990+0000 7fb0a90cf640 1 -- 172.21.15.114:0/351904023 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a40cc510 con 0x7fb0a4153e60 2023-11-04T01:37:16.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.990+0000 7fb08b7fe640 1 -- 172.21.15.114:0/351904023 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c044920 con 0x7fb0a4153e60 2023-11-04T01:37:16.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.990+0000 7fb0a90cf640 1 -- 172.21.15.114:0/351904023 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a40c6570 con 0x7fb0a4153e60 2023-11-04T01:37:16.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.991+0000 7fb0a90cf640 1 -- 172.21.15.114:0/351904023 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a40c70c0 con 0x7fb0a4153e60 2023-11-04T01:37:16.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.991+0000 7fb08b7fe640 1 -- 172.21.15.114:0/351904023 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb09c044a80 con 0x7fb0a4153e60 2023-11-04T01:37:16.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.991+0000 7fb08b7fe640 1 --2- 172.21.15.114:0/351904023 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb09006ae70 0x7fb09006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:16.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.992+0000 7fb08b7fe640 1 -- 172.21.15.114:0/351904023 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb09c02d040 con 0x7fb0a4153e60 2023-11-04T01:37:16.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.992+0000 7fb0a2d9d640 1 --2- 172.21.15.114:0/351904023 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb09006ae70 0x7fb09006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:16.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.992+0000 7fb0a2d9d640 1 --2- 172.21.15.114:0/351904023 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb09006ae70 0x7fb09006d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40ccbd0 tx=0x7fb0940094f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:16.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:16.996+0000 7fb08b7fe640 1 -- 172.21.15.114:0/351904023 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb09c076ef0 con 0x7fb0a4153e60 2023-11-04T01:37:17.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.163+0000 7fb0a90cf640 1 -- 172.21.15.114:0/351904023 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb0a4074290 con 0x7fb0a4153e60 2023-11-04T01:37:17.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.164+0000 7fb08b7fe640 1 -- 172.21.15.114:0/351904023 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb09c07a510 con 0x7fb0a4153e60 2023-11-04T01:37:17.166 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:17.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.166+0000 7fb0a90cf640 1 -- 172.21.15.114:0/351904023 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb09006ae70 msgr2=0x7fb09006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.166+0000 7fb0a90cf640 1 --2- 172.21.15.114:0/351904023 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb09006ae70 0x7fb09006d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40ccbd0 tx=0x7fb0940094f0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.166+0000 7fb0a90cf640 1 -- 172.21.15.114:0/351904023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a4153e60 msgr2=0x7fb0a41580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.166+0000 7fb0a90cf640 1 --2- 172.21.15.114:0/351904023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a4153e60 0x7fb0a41580b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb09c02b950 tx=0x7fb09c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.166+0000 7fb0a90cf640 1 -- 172.21.15.114:0/351904023 shutdown_connections 2023-11-04T01:37:17.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.166+0000 7fb0a90cf640 1 --2- 172.21.15.114:0/351904023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a4153e60 0x7fb0a41580b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.166+0000 7fb0a90cf640 1 --2- 172.21.15.114:0/351904023 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb09006ae70 0x7fb09006d330 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.166+0000 7fb0a90cf640 1 --2- 172.21.15.114:0/351904023 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0a40cd6d0 0x7fb0a4157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.166+0000 7fb0a90cf640 1 --2- 172.21.15.114:0/351904023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0a40b4880 0x7fb0a40c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.166+0000 7fb0a90cf640 1 -- 172.21.15.114:0/351904023 >> 172.21.15.114:0/351904023 conn(0x7fb0a40cf880 msgr2=0x7fb0a40d2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.166+0000 7fb0a90cf640 1 -- 172.21.15.114:0/351904023 shutdown_connections 2023-11-04T01:37:17.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.166+0000 7fb0a90cf640 1 -- 172.21.15.114:0/351904023 wait complete. 2023-11-04T01:37:17.179 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:17.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.276+0000 7f4f1eac9640 1 Processor -- start 2023-11-04T01:37:17.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.276+0000 7f4f1eac9640 1 -- start start 2023-11-04T01:37:17.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.277+0000 7f4f1eac9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f18159c70 0x7f4f180ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.277+0000 7f4f1eac9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f180b0ae0 0x7f4f1815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.277+0000 7f4f1eac9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180b4110 con 0x7f4f1806db20 2023-11-04T01:37:17.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.277+0000 7f4f1eac9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f180b49b0 con 0x7f4f18159c70 2023-11-04T01:37:17.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.277+0000 7f4f1eac9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180b43f0 con 0x7f4f180b0ae0 2023-11-04T01:37:17.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.277+0000 7f4f1c865640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f18159c70 0x7f4f180ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.277+0000 7f4f1c865640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f18159c70 0x7f4f180ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43538/0 (socket says 172.21.15.114:43538) 2023-11-04T01:37:17.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.277+0000 7f4f1c865640 1 -- 172.21.15.114:0/327659636 learned_addr learned my addr 172.21.15.114:0/327659636 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:17.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.277+0000 7f4f1c865640 1 -- 172.21.15.114:0/327659636 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f180b0ae0 msgr2=0x7f4f1815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.277+0000 7f4f1d066640 1 --2- 172.21.15.114:0/327659636 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f180b0ae0 0x7f4f1815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.277+0000 7f4f1c865640 1 --2- 172.21.15.114:0/327659636 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f180b0ae0 0x7f4f1815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.277+0000 7f4f1c865640 1 -- 172.21.15.114:0/327659636 >> v1:172.21.15.141:6789/0 conn(0x7f4f1806db20 legacy=0x7f4f180b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.277+0000 7f4f1c865640 1 -- 172.21.15.114:0/327659636 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180b46d0 con 0x7f4f18159c70 2023-11-04T01:37:17.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.277+0000 7f4f1d066640 1 --2- 172.21.15.114:0/327659636 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f180b0ae0 0x7f4f1815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:17.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.278+0000 7f4f1c865640 1 --2- 172.21.15.114:0/327659636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f18159c70 0x7f4f180ce370 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009870 tx=0x7f4f0802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d32eaa81ecc7e39 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.278+0000 7f4f177fe640 1 -- 172.21.15.114:0/327659636 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08031640 con 0x7f4f18159c70 2023-11-04T01:37:17.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.278+0000 7f4f177fe640 1 -- 172.21.15.114:0/327659636 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f080317a0 con 0x7f4f18159c70 2023-11-04T01:37:17.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.278+0000 7f4f177fe640 1 -- 172.21.15.114:0/327659636 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08031b30 con 0x7f4f18159c70 2023-11-04T01:37:17.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.279+0000 7f4f1eac9640 1 -- 172.21.15.114:0/327659636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f18159c70 msgr2=0x7f4f180ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.279+0000 7f4f1eac9640 1 --2- 172.21.15.114:0/327659636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f18159c70 0x7f4f180ce370 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009870 tx=0x7f4f0802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.279+0000 7f4f1eac9640 1 -- 172.21.15.114:0/327659636 shutdown_connections 2023-11-04T01:37:17.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.279+0000 7f4f1eac9640 1 --2- 172.21.15.114:0/327659636 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f180b0ae0 0x7f4f1815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.279+0000 7f4f1eac9640 1 --2- 172.21.15.114:0/327659636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f18159c70 0x7f4f180ce370 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.279+0000 7f4f1eac9640 1 -- 172.21.15.114:0/327659636 >> 172.21.15.114:0/327659636 conn(0x7f4f180ce950 msgr2=0x7f4f180ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.279+0000 7f4f1eac9640 1 -- 172.21.15.114:0/327659636 shutdown_connections 2023-11-04T01:37:17.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.279+0000 7f4f1eac9640 1 -- 172.21.15.114:0/327659636 wait complete. 2023-11-04T01:37:17.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.280+0000 7f4f1eac9640 1 Processor -- start 2023-11-04T01:37:17.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.280+0000 7f4f1eac9640 1 -- start start 2023-11-04T01:37:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f1eac9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f1806db20 0x7f4f18147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f1eac9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180b0ae0 0x7f4f18156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f1eac9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f18159c70 0x7f4f18156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f1eac9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180c7a90 con 0x7f4f180b0ae0 2023-11-04T01:37:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f1eac9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180c69f0 con 0x7f4f18159c70 2023-11-04T01:37:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f1eac9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180c6cd0 con 0x7f4f1806db20 2023-11-04T01:37:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f17fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180b0ae0 0x7f4f18156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f17fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180b0ae0 0x7f4f18156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43552/0 (socket says 172.21.15.114:43552) 2023-11-04T01:37:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f17fff640 1 -- 172.21.15.114:0/2185413536 learned_addr learned my addr 172.21.15.114:0/2185413536 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:17.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f1c865640 1 --2- 172.21.15.114:0/2185413536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f1806db20 0x7f4f18147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f1d066640 1 --2- 172.21.15.114:0/2185413536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f18159c70 0x7f4f18156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f17fff640 1 -- 172.21.15.114:0/2185413536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f1806db20 msgr2=0x7f4f18147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f17fff640 1 --2- 172.21.15.114:0/2185413536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f1806db20 0x7f4f18147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f17fff640 1 -- 172.21.15.114:0/2185413536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f18159c70 msgr2=0x7f4f18156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f17fff640 1 --2- 172.21.15.114:0/2185413536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f18159c70 0x7f4f18156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f17fff640 1 -- 172.21.15.114:0/2185413536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f080094d0 con 0x7f4f180b0ae0 2023-11-04T01:37:17.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f1c865640 1 --2- 172.21.15.114:0/2185413536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f1806db20 0x7f4f18147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:17.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.281+0000 7f4f1d066640 1 --2- 172.21.15.114:0/2185413536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f18159c70 0x7f4f18156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:17.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.282+0000 7f4f17fff640 1 --2- 172.21.15.114:0/2185413536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180b0ae0 0x7f4f18156220 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00c430 tx=0x7f4f0c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.282+0000 7f4f157fa640 1 -- 172.21.15.114:0/2185413536 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c011790 con 0x7f4f180b0ae0 2023-11-04T01:37:17.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.282+0000 7f4f157fa640 1 -- 172.21.15.114:0/2185413536 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c0118f0 con 0x7f4f180b0ae0 2023-11-04T01:37:17.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.282+0000 7f4f1eac9640 1 -- 172.21.15.114:0/2185413536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f180c6fb0 con 0x7f4f180b0ae0 2023-11-04T01:37:17.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.282+0000 7f4f157fa640 1 -- 172.21.15.114:0/2185413536 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c011ca0 con 0x7f4f180b0ae0 2023-11-04T01:37:17.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.282+0000 7f4f1eac9640 1 -- 172.21.15.114:0/2185413536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f180c7570 con 0x7f4f180b0ae0 2023-11-04T01:37:17.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.283+0000 7f4f1eac9640 1 -- 172.21.15.114:0/2185413536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f18074290 con 0x7f4f180b0ae0 2023-11-04T01:37:17.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.283+0000 7f4f157fa640 1 -- 172.21.15.114:0/2185413536 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f0c01c460 con 0x7f4f180b0ae0 2023-11-04T01:37:17.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.283+0000 7f4f157fa640 1 --2- 172.21.15.114:0/2185413536 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f0406ae70 0x7f4f0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.283+0000 7f4f157fa640 1 -- 172.21.15.114:0/2185413536 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4f0c089920 con 0x7f4f180b0ae0 2023-11-04T01:37:17.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.283+0000 7f4f1c865640 1 --2- 172.21.15.114:0/2185413536 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f0406ae70 0x7f4f0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.284+0000 7f4f1c865640 1 --2- 172.21.15.114:0/2185413536 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f0406ae70 0x7f4f0406d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4f08036000 tx=0x7f4f0803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.287+0000 7f4f157fa640 1 -- 172.21.15.114:0/2185413536 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f0c054610 con 0x7f4f180b0ae0 2023-11-04T01:37:17.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.455+0000 7f4f1eac9640 1 -- 172.21.15.114:0/2185413536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f1806d3f0 con 0x7f4f180b0ae0 2023-11-04T01:37:17.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.457+0000 7f4f157fa640 1 -- 172.21.15.114:0/2185413536 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18796 (secure 0 0 0) 0x7f4f0c057c30 con 0x7f4f180b0ae0 2023-11-04T01:37:17.459 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:17.459 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:11.562429+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:17.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.459+0000 7f4f1eac9640 1 -- 172.21.15.114:0/2185413536 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f0406ae70 msgr2=0x7f4f0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.459+0000 7f4f1eac9640 1 --2- 172.21.15.114:0/2185413536 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f0406ae70 0x7f4f0406d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4f08036000 tx=0x7f4f0803c040 comp rx=0 tx=0).stop 2023-11-04T01:37:17.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.459+0000 7f4f1eac9640 1 -- 172.21.15.114:0/2185413536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180b0ae0 msgr2=0x7f4f18156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.459+0000 7f4f1eac9640 1 --2- 172.21.15.114:0/2185413536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180b0ae0 0x7f4f18156220 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00c430 tx=0x7f4f0c00c8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.459+0000 7f4f1eac9640 1 -- 172.21.15.114:0/2185413536 shutdown_connections 2023-11-04T01:37:17.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.459+0000 7f4f1eac9640 1 --2- 172.21.15.114:0/2185413536 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f0406ae70 0x7f4f0406d330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.459+0000 7f4f1eac9640 1 --2- 172.21.15.114:0/2185413536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f18159c70 0x7f4f18156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.459+0000 7f4f1eac9640 1 --2- 172.21.15.114:0/2185413536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180b0ae0 0x7f4f18156220 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.459+0000 7f4f1eac9640 1 --2- 172.21.15.114:0/2185413536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f1806db20 0x7f4f18147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.459+0000 7f4f1eac9640 1 -- 172.21.15.114:0/2185413536 >> 172.21.15.114:0/2185413536 conn(0x7f4f180ce950 msgr2=0x7f4f18157790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.459+0000 7f4f1eac9640 1 -- 172.21.15.114:0/2185413536 shutdown_connections 2023-11-04T01:37:17.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.459+0000 7f4f1eac9640 1 -- 172.21.15.114:0/2185413536 wait complete. 2023-11-04T01:37:17.472 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:17.472 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:17.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.573+0000 7f2d1837d640 1 Processor -- start 2023-11-04T01:37:17.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.573+0000 7f2d1837d640 1 -- start start 2023-11-04T01:37:17.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.574+0000 7f2d1837d640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2d10071f90 0x7f2d100b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.574+0000 7f2d1837d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2d10072370 0x7f2d100cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.574+0000 7f2d1837d640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d100b1cc0 con 0x7f2d1015add0 2023-11-04T01:37:17.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.574+0000 7f2d1837d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d100b1fa0 con 0x7f2d10072370 2023-11-04T01:37:17.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.574+0000 7f2d1837d640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1015a0e0 con 0x7f2d10071f90 2023-11-04T01:37:17.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.574+0000 7f2d1691a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2d10072370 0x7f2d100cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.574+0000 7f2d1691a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2d10072370 0x7f2d100cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43566/0 (socket says 172.21.15.114:43566) 2023-11-04T01:37:17.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.574+0000 7f2d1691a640 1 -- 172.21.15.114:0/422083193 learned_addr learned my addr 172.21.15.114:0/422083193 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:17.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.575+0000 7f2d16119640 1 --2- 172.21.15.114:0/422083193 >> v2:172.21.15.141:3300/0 conn(0x7f2d10071f90 0x7f2d100b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.575+0000 7f2d1691a640 1 -- 172.21.15.114:0/422083193 >> v2:172.21.15.141:3300/0 conn(0x7f2d10071f90 msgr2=0x7f2d100b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.575+0000 7f2d1691a640 1 --2- 172.21.15.114:0/422083193 >> v2:172.21.15.141:3300/0 conn(0x7f2d10071f90 0x7f2d100b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.575+0000 7f2d1691a640 1 -- 172.21.15.114:0/422083193 >> v1:172.21.15.141:6789/0 conn(0x7f2d1015add0 legacy=0x7f2d100cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.575+0000 7f2d1691a640 1 -- 172.21.15.114:0/422083193 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1015a2f0 con 0x7f2d10072370 2023-11-04T01:37:17.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.575+0000 7f2d1691a640 1 --2- 172.21.15.114:0/422083193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d10072370 0x7f2d100cf3d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2d100cec90 tx=0x7f2d0802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ccdafcd746c4f48 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.576+0000 7f2d15117640 1 -- 172.21.15.114:0/422083193 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08030860 con 0x7f2d10072370 2023-11-04T01:37:17.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.576+0000 7f2d15117640 1 -- 172.21.15.114:0/422083193 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d080309c0 con 0x7f2d10072370 2023-11-04T01:37:17.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.576+0000 7f2d15117640 1 -- 172.21.15.114:0/422083193 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08030d50 con 0x7f2d10072370 2023-11-04T01:37:17.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.576+0000 7f2d1837d640 1 -- 172.21.15.114:0/422083193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d10072370 msgr2=0x7f2d100cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.576+0000 7f2d1837d640 1 --2- 172.21.15.114:0/422083193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d10072370 0x7f2d100cf3d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2d100cec90 tx=0x7f2d0802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.576+0000 7f2d1837d640 1 -- 172.21.15.114:0/422083193 shutdown_connections 2023-11-04T01:37:17.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.576+0000 7f2d1837d640 1 --2- 172.21.15.114:0/422083193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d10072370 0x7f2d100cf3d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.576+0000 7f2d1837d640 1 --2- 172.21.15.114:0/422083193 >> v2:172.21.15.141:3300/0 conn(0x7f2d10071f90 0x7f2d100b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.576+0000 7f2d1837d640 1 -- 172.21.15.114:0/422083193 >> 172.21.15.114:0/422083193 conn(0x7f2d1006d800 msgr2=0x7f2d1006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.576+0000 7f2d1837d640 1 -- 172.21.15.114:0/422083193 shutdown_connections 2023-11-04T01:37:17.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.576+0000 7f2d1837d640 1 -- 172.21.15.114:0/422083193 wait complete. 2023-11-04T01:37:17.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.577+0000 7f2d1837d640 1 Processor -- start 2023-11-04T01:37:17.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.577+0000 7f2d1837d640 1 -- start start 2023-11-04T01:37:17.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d1837d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d10071f90 0x7f2d100c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d1837d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d10072370 0x7f2d10158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d1837d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d1015add0 0x7f2d10158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d1837d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100c9950 con 0x7f2d10072370 2023-11-04T01:37:17.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d1837d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d101f3080 con 0x7f2d1015add0 2023-11-04T01:37:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d1837d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100c9390 con 0x7f2d10071f90 2023-11-04T01:37:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d15918640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d10072370 0x7f2d10158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d15918640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d10072370 0x7f2d10158ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43574/0 (socket says 172.21.15.114:43574) 2023-11-04T01:37:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d15918640 1 -- 172.21.15.114:0/1087145267 learned_addr learned my addr 172.21.15.114:0/1087145267 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d1691a640 1 --2- 172.21.15.114:0/1087145267 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d1015add0 0x7f2d10158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d16119640 1 --2- 172.21.15.114:0/1087145267 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d10071f90 0x7f2d100c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d15918640 1 -- 172.21.15.114:0/1087145267 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d10071f90 msgr2=0x7f2d100c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d15918640 1 --2- 172.21.15.114:0/1087145267 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d10071f90 0x7f2d100c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d15918640 1 -- 172.21.15.114:0/1087145267 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d1015add0 msgr2=0x7f2d10158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d15918640 1 --2- 172.21.15.114:0/1087145267 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d1015add0 0x7f2d10158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d15918640 1 -- 172.21.15.114:0/1087145267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d080094d0 con 0x7f2d10072370 2023-11-04T01:37:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.578+0000 7f2d1691a640 1 --2- 172.21.15.114:0/1087145267 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d1015add0 0x7f2d10158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.579+0000 7f2d15918640 1 --2- 172.21.15.114:0/1087145267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d10072370 0x7f2d10158ab0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000c3c0 tx=0x7f2d0000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.579+0000 7f2d06ffd640 1 -- 172.21.15.114:0/1087145267 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d000052d0 con 0x7f2d10072370 2023-11-04T01:37:17.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.579+0000 7f2d06ffd640 1 -- 172.21.15.114:0/1087145267 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d00005450 con 0x7f2d10072370 2023-11-04T01:37:17.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.579+0000 7f2d1837d640 1 -- 172.21.15.114:0/1087145267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d100c9670 con 0x7f2d10072370 2023-11-04T01:37:17.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.579+0000 7f2d06ffd640 1 -- 172.21.15.114:0/1087145267 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d00003830 con 0x7f2d10072370 2023-11-04T01:37:17.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.579+0000 7f2d1837d640 1 -- 172.21.15.114:0/1087145267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d100b3300 con 0x7f2d10072370 2023-11-04T01:37:17.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.580+0000 7f2d1837d640 1 -- 172.21.15.114:0/1087145267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1015b210 con 0x7f2d10072370 2023-11-04T01:37:17.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.580+0000 7f2d06ffd640 1 -- 172.21.15.114:0/1087145267 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d00003990 con 0x7f2d10072370 2023-11-04T01:37:17.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.580+0000 7f2d06ffd640 1 --2- 172.21.15.114:0/1087145267 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2cf406ae70 0x7f2cf406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.580+0000 7f2d06ffd640 1 -- 172.21.15.114:0/1087145267 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2d00088e80 con 0x7f2d10072370 2023-11-04T01:37:17.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.580+0000 7f2d16119640 1 --2- 172.21.15.114:0/1087145267 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2cf406ae70 0x7f2cf406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.581+0000 7f2d16119640 1 --2- 172.21.15.114:0/1087145267 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2cf406ae70 0x7f2cf406d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009a60 tx=0x7f2d0c003990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.585+0000 7f2d06ffd640 1 -- 172.21.15.114:0/1087145267 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2d00053c00 con 0x7f2d10072370 2023-11-04T01:37:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.750+0000 7f2d1837d640 1 -- 172.21.15.114:0/1087145267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d100cea70 con 0x7f2d10072370 2023-11-04T01:37:17.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.751+0000 7f2d06ffd640 1 -- 172.21.15.114:0/1087145267 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d000170a0 con 0x7f2d10072370 2023-11-04T01:37:17.753 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:37:17.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.753+0000 7f2d1837d640 1 -- 172.21.15.114:0/1087145267 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2cf406ae70 msgr2=0x7f2cf406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.753+0000 7f2d1837d640 1 --2- 172.21.15.114:0/1087145267 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2cf406ae70 0x7f2cf406d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009a60 tx=0x7f2d0c003990 comp rx=0 tx=0).stop 2023-11-04T01:37:17.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.753+0000 7f2d1837d640 1 -- 172.21.15.114:0/1087145267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d10072370 msgr2=0x7f2d10158ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.753+0000 7f2d1837d640 1 --2- 172.21.15.114:0/1087145267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d10072370 0x7f2d10158ab0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000c3c0 tx=0x7f2d0000c880 comp rx=0 tx=0).stop 2023-11-04T01:37:17.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.753+0000 7f2d1837d640 1 -- 172.21.15.114:0/1087145267 shutdown_connections 2023-11-04T01:37:17.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.753+0000 7f2d1837d640 1 --2- 172.21.15.114:0/1087145267 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2cf406ae70 0x7f2cf406d330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.753+0000 7f2d1837d640 1 --2- 172.21.15.114:0/1087145267 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d1015add0 0x7f2d10158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.753+0000 7f2d1837d640 1 --2- 172.21.15.114:0/1087145267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d10072370 0x7f2d10158ab0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.753+0000 7f2d1837d640 1 --2- 172.21.15.114:0/1087145267 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d10071f90 0x7f2d100c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.753+0000 7f2d1837d640 1 -- 172.21.15.114:0/1087145267 >> 172.21.15.114:0/1087145267 conn(0x7f2d1006d800 msgr2=0x7f2d100cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.753+0000 7f2d1837d640 1 -- 172.21.15.114:0/1087145267 shutdown_connections 2023-11-04T01:37:17.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.753+0000 7f2d1837d640 1 -- 172.21.15.114:0/1087145267 wait complete. 2023-11-04T01:37:17.766 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:17.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.866+0000 7f7993bb6640 1 Processor -- start 2023-11-04T01:37:17.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.866+0000 7f7993bb6640 1 -- start start 2023-11-04T01:37:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.867+0000 7f7993bb6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f798c1605b0 0x7f798c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.867+0000 7f7993bb6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f798c06a830 0x7f798c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.867+0000 7f7993bb6640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798c160990 con 0x7f798c0b1a40 2023-11-04T01:37:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.867+0000 7f7993bb6640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798c0cc7c0 con 0x7f798c06a830 2023-11-04T01:37:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.867+0000 7f7993bb6640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798c0cd750 con 0x7f798c1605b0 2023-11-04T01:37:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.867+0000 7f7992153640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f798c06a830 0x7f798c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.867+0000 7f7992153640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f798c06a830 0x7f798c0cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43584/0 (socket says 172.21.15.114:43584) 2023-11-04T01:37:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.867+0000 7f7992153640 1 -- 172.21.15.114:0/1900552142 learned_addr learned my addr 172.21.15.114:0/1900552142 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.867+0000 7f7991952640 1 --2- 172.21.15.114:0/1900552142 >> v2:172.21.15.141:3300/0 conn(0x7f798c1605b0 0x7f798c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.867+0000 7f7992153640 1 -- 172.21.15.114:0/1900552142 >> v2:172.21.15.141:3300/0 conn(0x7f798c1605b0 msgr2=0x7f798c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.867+0000 7f7992153640 1 --2- 172.21.15.114:0/1900552142 >> v2:172.21.15.141:3300/0 conn(0x7f798c1605b0 0x7f798c0ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.867+0000 7f7992153640 1 -- 172.21.15.114:0/1900552142 >> v1:172.21.15.141:6789/0 conn(0x7f798c0b1a40 legacy=0x7f798c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.867+0000 7f7992153640 1 -- 172.21.15.114:0/1900552142 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c0cc4e0 con 0x7f798c06a830 2023-11-04T01:37:17.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.868+0000 7f7992153640 1 --2- 172.21.15.114:0/1900552142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f798c06a830 0x7f798c0cf9f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f798c072900 tx=0x7f798402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d344b0333aa643 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.868+0000 7f7990950640 1 -- 172.21.15.114:0/1900552142 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798402c9f0 con 0x7f798c06a830 2023-11-04T01:37:17.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.868+0000 7f7990950640 1 -- 172.21.15.114:0/1900552142 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798402cb50 con 0x7f798c06a830 2023-11-04T01:37:17.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.868+0000 7f7990950640 1 -- 172.21.15.114:0/1900552142 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79840343f0 con 0x7f798c06a830 2023-11-04T01:37:17.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.868+0000 7f7993bb6640 1 -- 172.21.15.114:0/1900552142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f798c06a830 msgr2=0x7f798c0cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.868+0000 7f7993bb6640 1 --2- 172.21.15.114:0/1900552142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f798c06a830 0x7f798c0cf9f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f798c072900 tx=0x7f798402be50 comp rx=0 tx=0).stop 2023-11-04T01:37:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.869+0000 7f7993bb6640 1 -- 172.21.15.114:0/1900552142 shutdown_connections 2023-11-04T01:37:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.869+0000 7f7993bb6640 1 --2- 172.21.15.114:0/1900552142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f798c06a830 0x7f798c0cf9f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.869+0000 7f7993bb6640 1 --2- 172.21.15.114:0/1900552142 >> v2:172.21.15.141:3300/0 conn(0x7f798c1605b0 0x7f798c0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.869+0000 7f7993bb6640 1 -- 172.21.15.114:0/1900552142 >> 172.21.15.114:0/1900552142 conn(0x7f798c071820 msgr2=0x7f798c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.869+0000 7f7993bb6640 1 -- 172.21.15.114:0/1900552142 shutdown_connections 2023-11-04T01:37:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.869+0000 7f7993bb6640 1 -- 172.21.15.114:0/1900552142 wait complete. 2023-11-04T01:37:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.870+0000 7f7993bb6640 1 Processor -- start 2023-11-04T01:37:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.870+0000 7f7993bb6640 1 -- start start 2023-11-04T01:37:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.870+0000 7f7993bb6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f798c06a830 0x7f798c149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.870+0000 7f7993bb6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f798c1605b0 0x7f798c0b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.870+0000 7f7993bb6640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f798c0b4c00 0x7f798c0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.870+0000 7f7993bb6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c0c3710 con 0x7f798c06a830 2023-11-04T01:37:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.870+0000 7f7993bb6640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c14a2a0 con 0x7f798c0b4c00 2023-11-04T01:37:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.870+0000 7f7993bb6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798c0b5150 con 0x7f798c1605b0 2023-11-04T01:37:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.871+0000 7f7991952640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f798c06a830 0x7f798c149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.871+0000 7f7991952640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f798c06a830 0x7f798c149d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43596/0 (socket says 172.21.15.114:43596) 2023-11-04T01:37:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.871+0000 7f7991952640 1 -- 172.21.15.114:0/724892940 learned_addr learned my addr 172.21.15.114:0/724892940 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.871+0000 7f7992153640 1 --2- 172.21.15.114:0/724892940 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f798c0b4c00 0x7f798c0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.871+0000 7f7991151640 1 --2- 172.21.15.114:0/724892940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f798c1605b0 0x7f798c0b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.871+0000 7f7991952640 1 -- 172.21.15.114:0/724892940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f798c1605b0 msgr2=0x7f798c0b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.871+0000 7f7991952640 1 --2- 172.21.15.114:0/724892940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f798c1605b0 0x7f798c0b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.871+0000 7f7991952640 1 -- 172.21.15.114:0/724892940 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f798c0b4c00 msgr2=0x7f798c0b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.871+0000 7f7991952640 1 --2- 172.21.15.114:0/724892940 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f798c0b4c00 0x7f798c0b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.871+0000 7f7991952640 1 -- 172.21.15.114:0/724892940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7984009b30 con 0x7f798c06a830 2023-11-04T01:37:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.871+0000 7f7991952640 1 --2- 172.21.15.114:0/724892940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f798c06a830 0x7f798c149d60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f798800d5f0 tx=0x7f798800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.871+0000 7f79827fc640 1 -- 172.21.15.114:0/724892940 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79880125f0 con 0x7f798c06a830 2023-11-04T01:37:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.871+0000 7f79827fc640 1 -- 172.21.15.114:0/724892940 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7988012750 con 0x7f798c06a830 2023-11-04T01:37:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.871+0000 7f79827fc640 1 -- 172.21.15.114:0/724892940 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7988012b00 con 0x7f798c06a830 2023-11-04T01:37:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.871+0000 7f7993bb6640 1 -- 172.21.15.114:0/724892940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798c0b5430 con 0x7f798c06a830 2023-11-04T01:37:17.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.871+0000 7f7993bb6640 1 -- 172.21.15.114:0/724892940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798c0c3c00 con 0x7f798c06a830 2023-11-04T01:37:17.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.872+0000 7f7993bb6640 1 -- 172.21.15.114:0/724892940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798c0c3dc0 con 0x7f798c06a830 2023-11-04T01:37:17.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.873+0000 7f79827fc640 1 -- 172.21.15.114:0/724892940 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7988012c60 con 0x7f798c06a830 2023-11-04T01:37:17.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.873+0000 7f79827fc640 1 --2- 172.21.15.114:0/724892940 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f797006ae70 0x7f797006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:17.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.873+0000 7f79827fc640 1 -- 172.21.15.114:0/724892940 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7988089e70 con 0x7f798c06a830 2023-11-04T01:37:17.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.873+0000 7f7991151640 1 --2- 172.21.15.114:0/724892940 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f797006ae70 0x7f797006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:17.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.873+0000 7f7991151640 1 --2- 172.21.15.114:0/724892940 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f797006ae70 0x7f797006d330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f798c0c3680 tx=0x7f797c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:17.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:17.877+0000 7f79827fc640 1 -- 172.21.15.114:0/724892940 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7988054b60 con 0x7f798c06a830 2023-11-04T01:37:18.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.042+0000 7f7993bb6640 1 -- 172.21.15.114:0/724892940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f798c0672a0 con 0x7f798c06a830 2023-11-04T01:37:18.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.042+0000 7f79827fc640 1 -- 172.21.15.114:0/724892940 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7988058180 con 0x7f798c06a830 2023-11-04T01:37:18.044 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:18.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.044+0000 7f7993bb6640 1 -- 172.21.15.114:0/724892940 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f797006ae70 msgr2=0x7f797006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.044+0000 7f7993bb6640 1 --2- 172.21.15.114:0/724892940 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f797006ae70 0x7f797006d330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f798c0c3680 tx=0x7f797c009040 comp rx=0 tx=0).stop 2023-11-04T01:37:18.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.044+0000 7f7993bb6640 1 -- 172.21.15.114:0/724892940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f798c06a830 msgr2=0x7f798c149d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.044+0000 7f7993bb6640 1 --2- 172.21.15.114:0/724892940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f798c06a830 0x7f798c149d60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f798800d5f0 tx=0x7f798800dab0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.044+0000 7f7993bb6640 1 -- 172.21.15.114:0/724892940 shutdown_connections 2023-11-04T01:37:18.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.044+0000 7f7993bb6640 1 --2- 172.21.15.114:0/724892940 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f797006ae70 0x7f797006d330 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.044+0000 7f7993bb6640 1 --2- 172.21.15.114:0/724892940 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f798c0b4c00 0x7f798c0b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.044+0000 7f7993bb6640 1 --2- 172.21.15.114:0/724892940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f798c1605b0 0x7f798c0b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.044+0000 7f7993bb6640 1 --2- 172.21.15.114:0/724892940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f798c06a830 0x7f798c149d60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.044+0000 7f7993bb6640 1 -- 172.21.15.114:0/724892940 >> 172.21.15.114:0/724892940 conn(0x7f798c071820 msgr2=0x7f798c15c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:18.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.044+0000 7f7993bb6640 1 -- 172.21.15.114:0/724892940 shutdown_connections 2023-11-04T01:37:18.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.044+0000 7f7993bb6640 1 -- 172.21.15.114:0/724892940 wait complete. 2023-11-04T01:37:18.057 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:18.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.157+0000 7f516bfc5640 1 Processor -- start 2023-11-04T01:37:18.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.157+0000 7f516bfc5640 1 -- start start 2023-11-04T01:37:18.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.158+0000 7f516bfc5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f51641605b0 0x7f51640ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.158+0000 7f516bfc5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5164160990 con 0x7f516406a830 2023-11-04T01:37:18.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.158+0000 7f516bfc5640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51640cc7c0 con 0x7f51640b1a40 2023-11-04T01:37:18.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.158+0000 7f516bfc5640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51640cd750 con 0x7f51641605b0 2023-11-04T01:37:18.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.158+0000 7f516a562640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f516406a830 0x7f51640cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51484/0 (socket says 172.21.15.114:51484) 2023-11-04T01:37:18.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.158+0000 7f516a562640 1 -- 172.21.15.114:0/3468196400 learned_addr learned my addr 172.21.15.114:0/3468196400 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:18.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5169d61640 1 --2- 172.21.15.114:0/3468196400 >> v2:172.21.15.141:3300/0 conn(0x7f51641605b0 0x7f51640ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 -- 172.21.15.114:0/3468196400 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601716316 0 0) 0x7f5164160990 con 0x7f516406a830 2023-11-04T01:37:18.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 -- 172.21.15.114:0/3468196400 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5150003520 con 0x7f516406a830 2023-11-04T01:37:18.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 -- 172.21.15.114:0/3468196400 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374323800 0 0) 0x7f51640cc7c0 con 0x7f51640b1a40 2023-11-04T01:37:18.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 -- 172.21.15.114:0/3468196400 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5164160990 con 0x7f51640b1a40 2023-11-04T01:37:18.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 -- 172.21.15.114:0/3468196400 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 79251769 0 0) 0x7f5150003520 con 0x7f516406a830 2023-11-04T01:37:18.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 -- 172.21.15.114:0/3468196400 >> v2:172.21.15.141:3300/0 conn(0x7f51641605b0 msgr2=0x7f51640ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:18.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 --2- 172.21.15.114:0/3468196400 >> v2:172.21.15.141:3300/0 conn(0x7f51641605b0 0x7f51640ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 -- 172.21.15.114:0/3468196400 >> v1:172.21.15.141:6789/0 conn(0x7f51640b1a40 legacy=0x7f516406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 -- 172.21.15.114:0/3468196400 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51640cc4e0 con 0x7f516406a830 2023-11-04T01:37:18.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 -- 172.21.15.114:0/3468196400 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f515c0015f0 con 0x7f516406a830 2023-11-04T01:37:18.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 -- 172.21.15.114:0/3468196400 >> v1:172.21.15.114:6789/0 conn(0x7f516406a830 legacy=0x7f51640cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 --2- 172.21.15.114:0/3468196400 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5150003b50 0x7f5150003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 --2- 172.21.15.114:0/3468196400 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51500047c0 0x7f5150004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 --2- 172.21.15.114:0/3468196400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5150005240 0x7f515000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 -- 172.21.15.114:0/3468196400 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51640cd750 con 0x7f5150005240 2023-11-04T01:37:18.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 -- 172.21.15.114:0/3468196400 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515000c180 con 0x7f51500047c0 2023-11-04T01:37:18.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5168d5f640 1 -- 172.21.15.114:0/3468196400 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515000c340 con 0x7f5150003b50 2023-11-04T01:37:18.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f516a562640 1 --2- 172.21.15.114:0/3468196400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5150005240 0x7f515000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5169d61640 1 --2- 172.21.15.114:0/3468196400 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5150003b50 0x7f5150003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5169560640 1 --2- 172.21.15.114:0/3468196400 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51500047c0 0x7f5150004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f516a562640 1 -- 172.21.15.114:0/3468196400 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5150003b50 msgr2=0x7f5150003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:18.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f516a562640 1 --2- 172.21.15.114:0/3468196400 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5150003b50 0x7f5150003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f516a562640 1 -- 172.21.15.114:0/3468196400 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51500047c0 msgr2=0x7f5150004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:18.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f516a562640 1 --2- 172.21.15.114:0/3468196400 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51500047c0 0x7f5150004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f516a562640 1 -- 172.21.15.114:0/3468196400 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5150003520 con 0x7f5150005240 2023-11-04T01:37:18.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.159+0000 7f5169560640 1 --2- 172.21.15.114:0/3468196400 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51500047c0 0x7f5150004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:18.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.160+0000 7f516a562640 1 -- 172.21.15.114:0/3468196400 reap_dead start 2023-11-04T01:37:18.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.160+0000 7f516a562640 1 --2- 172.21.15.114:0/3468196400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5150005240 0x7f515000b980 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f515c007f40 tx=0x7f51500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca77a620409bc56b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.160+0000 7f5168d5f640 1 -- 172.21.15.114:0/3468196400 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c005b90 con 0x7f5150005240 2023-11-04T01:37:18.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.160+0000 7f5168d5f640 1 -- 172.21.15.114:0/3468196400 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c005d30 con 0x7f5150005240 2023-11-04T01:37:18.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.160+0000 7f5168d5f640 1 -- 172.21.15.114:0/3468196400 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c005ea0 con 0x7f5150005240 2023-11-04T01:37:18.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.161+0000 7f516bfc5640 1 -- 172.21.15.114:0/3468196400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5150005240 msgr2=0x7f515000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.161+0000 7f516bfc5640 1 --2- 172.21.15.114:0/3468196400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5150005240 0x7f515000b980 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f515c007f40 tx=0x7f51500057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.161+0000 7f516bfc5640 1 -- 172.21.15.114:0/3468196400 shutdown_connections 2023-11-04T01:37:18.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.161+0000 7f516bfc5640 1 --2- 172.21.15.114:0/3468196400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5150005240 0x7f515000b980 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.161+0000 7f516bfc5640 1 -- 172.21.15.114:0/3468196400 >> 172.21.15.114:0/3468196400 conn(0x7f5164071820 msgr2=0x7f5164071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:18.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.161+0000 7f516bfc5640 1 -- 172.21.15.114:0/3468196400 shutdown_connections 2023-11-04T01:37:18.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.161+0000 7f516bfc5640 1 -- 172.21.15.114:0/3468196400 wait complete. 2023-11-04T01:37:18.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.162+0000 7f516bfc5640 1 Processor -- start 2023-11-04T01:37:18.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.162+0000 7f516bfc5640 1 -- start start 2023-11-04T01:37:18.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f516bfc5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5150005240 0x7f5164152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f516bfc5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51640b5310 0x7f51640c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f516bfc5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51640adab0 0x7f51640adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f516bfc5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51640ae470 con 0x7f51640b5310 2023-11-04T01:37:18.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f516bfc5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5164152770 con 0x7f5150005240 2023-11-04T01:37:18.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f516bfc5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51640c7420 con 0x7f51640adab0 2023-11-04T01:37:18.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f5169560640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51640b5310 0x7f51640c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f5169560640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51640b5310 0x7f51640c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43616/0 (socket says 172.21.15.114:43616) 2023-11-04T01:37:18.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f5169560640 1 -- 172.21.15.114:0/4275292858 learned_addr learned my addr 172.21.15.114:0/4275292858 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:18.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f516a562640 1 --2- 172.21.15.114:0/4275292858 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51640adab0 0x7f51640adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f5169560640 1 -- 172.21.15.114:0/4275292858 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51640adab0 msgr2=0x7f51640adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f5169560640 1 --2- 172.21.15.114:0/4275292858 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51640adab0 0x7f51640adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f5169560640 1 -- 172.21.15.114:0/4275292858 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5150005240 msgr2=0x7f5164152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f5169d61640 1 --2- 172.21.15.114:0/4275292858 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5150005240 0x7f5164152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f5169560640 1 --2- 172.21.15.114:0/4275292858 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5150005240 0x7f5164152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f5169560640 1 -- 172.21.15.114:0/4275292858 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51640c7700 con 0x7f51640b5310 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f5169560640 1 --2- 172.21.15.114:0/4275292858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51640b5310 0x7f51640c6b20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f515400e580 tx=0x7f515400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f515a7fc640 1 -- 172.21.15.114:0/4275292858 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154017070 con 0x7f51640b5310 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f515a7fc640 1 -- 172.21.15.114:0/4275292858 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51540052e0 con 0x7f51640b5310 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f516bfc5640 1 -- 172.21.15.114:0/4275292858 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51640c79e0 con 0x7f51640b5310 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.163+0000 7f515a7fc640 1 -- 172.21.15.114:0/4275292858 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154005450 con 0x7f51640b5310 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.164+0000 7f516bfc5640 1 -- 172.21.15.114:0/4275292858 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51640c7fe0 con 0x7f51640b5310 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.164+0000 7f516bfc5640 1 -- 172.21.15.114:0/4275292858 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51640672a0 con 0x7f51640b5310 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.165+0000 7f515a7fc640 1 -- 172.21.15.114:0/4275292858 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5154007020 con 0x7f51640b5310 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.165+0000 7f515a7fc640 1 --2- 172.21.15.114:0/4275292858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f514806ae70 0x7f514806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.165+0000 7f515a7fc640 1 -- 172.21.15.114:0/4275292858 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5154089170 con 0x7f51640b5310 2023-11-04T01:37:18.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.165+0000 7f5169d61640 1 --2- 172.21.15.114:0/4275292858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f514806ae70 0x7f514806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.166+0000 7f5169d61640 1 --2- 172.21.15.114:0/4275292858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f514806ae70 0x7f514806d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5160007330 tx=0x7f516000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.169+0000 7f515a7fc640 1 -- 172.21.15.114:0/4275292858 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5154057900 con 0x7f51640b5310 2023-11-04T01:37:18.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.338+0000 7f516bfc5640 1 -- 172.21.15.114:0/4275292858 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5164074290 con 0x7f51640b5310 2023-11-04T01:37:18.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.339+0000 7f515a7fc640 1 -- 172.21.15.114:0/4275292858 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5154057490 con 0x7f51640b5310 2023-11-04T01:37:18.342 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:37:18.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.340+0000 7f516bfc5640 1 -- 172.21.15.114:0/4275292858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f514806ae70 msgr2=0x7f514806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.340+0000 7f516bfc5640 1 --2- 172.21.15.114:0/4275292858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f514806ae70 0x7f514806d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5160007330 tx=0x7f516000b040 comp rx=0 tx=0).stop 2023-11-04T01:37:18.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.340+0000 7f516bfc5640 1 -- 172.21.15.114:0/4275292858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51640b5310 msgr2=0x7f51640c6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.340+0000 7f516bfc5640 1 --2- 172.21.15.114:0/4275292858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51640b5310 0x7f51640c6b20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f515400e580 tx=0x7f515400ea40 comp rx=0 tx=0).stop 2023-11-04T01:37:18.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.340+0000 7f516bfc5640 1 -- 172.21.15.114:0/4275292858 shutdown_connections 2023-11-04T01:37:18.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.340+0000 7f516bfc5640 1 --2- 172.21.15.114:0/4275292858 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51640adab0 0x7f51640adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.340+0000 7f516bfc5640 1 --2- 172.21.15.114:0/4275292858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51640b5310 0x7f51640c6b20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.340+0000 7f516bfc5640 1 --2- 172.21.15.114:0/4275292858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f514806ae70 0x7f514806d330 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.340+0000 7f516bfc5640 1 --2- 172.21.15.114:0/4275292858 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5150005240 0x7f5164152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.340+0000 7f516bfc5640 1 -- 172.21.15.114:0/4275292858 >> 172.21.15.114:0/4275292858 conn(0x7f5164071820 msgr2=0x7f51640aeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:18.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.341+0000 7f516bfc5640 1 -- 172.21.15.114:0/4275292858 shutdown_connections 2023-11-04T01:37:18.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.341+0000 7f516bfc5640 1 -- 172.21.15.114:0/4275292858 wait complete. 2023-11-04T01:37:18.353 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:18.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.454+0000 7f4205b41640 1 Processor -- start 2023-11-04T01:37:18.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.454+0000 7f4205b41640 1 -- start start 2023-11-04T01:37:18.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.454+0000 7f4205b41640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420015e1c0 0x7f420006b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.454+0000 7f4205b41640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f420015e5a0 0x7f420015f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.454+0000 7f4205b41640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4200066530 con 0x7f42000c9af0 2023-11-04T01:37:18.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.454+0000 7f4205b41640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420006bc40 con 0x7f420015e5a0 2023-11-04T01:37:18.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.454+0000 7f4205b41640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4200065f70 con 0x7f420015e1c0 2023-11-04T01:37:18.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.455+0000 7f41feffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f420015e5a0 0x7f420015f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.455+0000 7f41fffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f42000c9af0 0x7f4200070ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51486/0 (socket says 172.21.15.114:51486) 2023-11-04T01:37:18.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.455+0000 7f41fffff640 1 -- 172.21.15.114:0/596100528 learned_addr learned my addr 172.21.15.114:0/596100528 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:18.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.455+0000 7f41ff7fe640 1 --2- 172.21.15.114:0/596100528 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420015e1c0 0x7f420006b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.455+0000 7f41feffd640 1 -- 172.21.15.114:0/596100528 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420015e1c0 msgr2=0x7f420006b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:18.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.455+0000 7f41feffd640 1 --2- 172.21.15.114:0/596100528 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420015e1c0 0x7f420006b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.455+0000 7f41feffd640 1 -- 172.21.15.114:0/596100528 >> v1:172.21.15.114:6789/0 conn(0x7f42000c9af0 legacy=0x7f4200070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.455+0000 7f41fe7fc640 1 -- 172.21.15.114:0/596100528 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249549610 0 0) 0x7f4200066530 con 0x7f42000c9af0 2023-11-04T01:37:18.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.455+0000 7f41feffd640 1 -- 172.21.15.114:0/596100528 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4200066250 con 0x7f420015e5a0 2023-11-04T01:37:18.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.455+0000 7f41ff7fe640 1 --2- 172.21.15.114:0/596100528 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420015e1c0 0x7f420006b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:18.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.456+0000 7f41feffd640 1 --2- 172.21.15.114:0/596100528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420015e5a0 0x7f420015f2d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f41f40097a0 tx=0x7f41f402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15f9c1a928761e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.456+0000 7f41fe7fc640 1 -- 172.21.15.114:0/596100528 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f402e070 con 0x7f420015e5a0 2023-11-04T01:37:18.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.456+0000 7f41fe7fc640 1 -- 172.21.15.114:0/596100528 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f40315a0 con 0x7f420015e5a0 2023-11-04T01:37:18.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.456+0000 7f41fe7fc640 1 -- 172.21.15.114:0/596100528 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4031930 con 0x7f420015e5a0 2023-11-04T01:37:18.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.456+0000 7f4205b41640 1 -- 172.21.15.114:0/596100528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420015e5a0 msgr2=0x7f420015f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.456+0000 7f4205b41640 1 --2- 172.21.15.114:0/596100528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420015e5a0 0x7f420015f2d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f41f40097a0 tx=0x7f41f402b840 comp rx=0 tx=0).stop 2023-11-04T01:37:18.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.456+0000 7f4205b41640 1 -- 172.21.15.114:0/596100528 shutdown_connections 2023-11-04T01:37:18.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.456+0000 7f4205b41640 1 --2- 172.21.15.114:0/596100528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420015e5a0 0x7f420015f2d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.456+0000 7f4205b41640 1 --2- 172.21.15.114:0/596100528 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420015e1c0 0x7f420006b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.456+0000 7f4205b41640 1 -- 172.21.15.114:0/596100528 >> 172.21.15.114:0/596100528 conn(0x7f42000cbc90 msgr2=0x7f42000cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:18.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.456+0000 7f4205b41640 1 -- 172.21.15.114:0/596100528 shutdown_connections 2023-11-04T01:37:18.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.456+0000 7f4205b41640 1 -- 172.21.15.114:0/596100528 wait complete. 2023-11-04T01:37:18.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.457+0000 7f4205b41640 1 Processor -- start 2023-11-04T01:37:18.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.458+0000 7f4205b41640 1 -- start start 2023-11-04T01:37:18.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.458+0000 7f4205b41640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42000c9af0 0x7f42000c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.458+0000 7f4205b41640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420015e1c0 0x7f420015cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.458+0000 7f4205b41640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420015e5a0 0x7f42000affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.458+0000 7f4205b41640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42000c4e30 con 0x7f420015e1c0 2023-11-04T01:37:18.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.458+0000 7f4205b41640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42000c52c0 con 0x7f42000c9af0 2023-11-04T01:37:18.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.458+0000 7f4205b41640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42000c4220 con 0x7f420015e5a0 2023-11-04T01:37:18.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.458+0000 7f41feffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420015e1c0 0x7f420015cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.459+0000 7f41feffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420015e1c0 0x7f420015cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43634/0 (socket says 172.21.15.114:43634) 2023-11-04T01:37:18.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.459+0000 7f41feffd640 1 -- 172.21.15.114:0/1011300106 learned_addr learned my addr 172.21.15.114:0/1011300106 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:18.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.459+0000 7f41ff7fe640 1 --2- 172.21.15.114:0/1011300106 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42000c9af0 0x7f42000c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.459+0000 7f41fffff640 1 --2- 172.21.15.114:0/1011300106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420015e5a0 0x7f42000affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.459+0000 7f41feffd640 1 -- 172.21.15.114:0/1011300106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420015e5a0 msgr2=0x7f42000affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.459+0000 7f41feffd640 1 --2- 172.21.15.114:0/1011300106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420015e5a0 0x7f42000affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.459+0000 7f41feffd640 1 -- 172.21.15.114:0/1011300106 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42000c9af0 msgr2=0x7f42000c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.459+0000 7f41feffd640 1 --2- 172.21.15.114:0/1011300106 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42000c9af0 0x7f42000c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.459+0000 7f41feffd640 1 -- 172.21.15.114:0/1011300106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f4009400 con 0x7f420015e1c0 2023-11-04T01:37:18.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.459+0000 7f41fffff640 1 --2- 172.21.15.114:0/1011300106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420015e5a0 0x7f42000affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:18.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.459+0000 7f41feffd640 1 --2- 172.21.15.114:0/1011300106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420015e1c0 0x7f420015cba0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f41f4034040 tx=0x7f41f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.459+0000 7f41e7fff640 1 -- 172.21.15.114:0/1011300106 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4032900 con 0x7f420015e1c0 2023-11-04T01:37:18.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.459+0000 7f41e7fff640 1 -- 172.21.15.114:0/1011300106 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f4032a60 con 0x7f420015e1c0 2023-11-04T01:37:18.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.459+0000 7f4205b41640 1 -- 172.21.15.114:0/1011300106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42000c4500 con 0x7f420015e1c0 2023-11-04T01:37:18.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.459+0000 7f41e7fff640 1 -- 172.21.15.114:0/1011300106 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4032e10 con 0x7f420015e1c0 2023-11-04T01:37:18.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.459+0000 7f4205b41640 1 -- 172.21.15.114:0/1011300106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42000c4ac0 con 0x7f420015e1c0 2023-11-04T01:37:18.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.460+0000 7f4205b41640 1 -- 172.21.15.114:0/1011300106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42000c4fe0 con 0x7f420015e1c0 2023-11-04T01:37:18.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.461+0000 7f41e7fff640 1 -- 172.21.15.114:0/1011300106 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41f404e430 con 0x7f420015e1c0 2023-11-04T01:37:18.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.461+0000 7f41e7fff640 1 --2- 172.21.15.114:0/1011300106 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41ec06ae70 0x7f41ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.461+0000 7f41e7fff640 1 -- 172.21.15.114:0/1011300106 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f41f40abb10 con 0x7f420015e1c0 2023-11-04T01:37:18.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.461+0000 7f41ff7fe640 1 --2- 172.21.15.114:0/1011300106 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41ec06ae70 0x7f41ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.461+0000 7f41ff7fe640 1 --2- 172.21.15.114:0/1011300106 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41ec06ae70 0x7f41ec06d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f41f000ab60 tx=0x7f41f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.465+0000 7f41e7fff640 1 -- 172.21.15.114:0/1011300106 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42000c4fe0 con 0x7f420015e1c0 2023-11-04T01:37:18.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.632+0000 7f4205b41640 1 -- 172.21.15.114:0/1011300106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f42000c4fe0 con 0x7f420015e1c0 2023-11-04T01:37:18.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.632+0000 7f41e7fff640 1 -- 172.21.15.114:0/1011300106 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f42000c4fe0 con 0x7f420015e1c0 2023-11-04T01:37:18.634 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:18.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.634+0000 7f4205b41640 1 -- 172.21.15.114:0/1011300106 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41ec06ae70 msgr2=0x7f41ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.634+0000 7f4205b41640 1 --2- 172.21.15.114:0/1011300106 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41ec06ae70 0x7f41ec06d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f41f000ab60 tx=0x7f41f0008040 comp rx=0 tx=0).stop 2023-11-04T01:37:18.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.634+0000 7f4205b41640 1 -- 172.21.15.114:0/1011300106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420015e1c0 msgr2=0x7f420015cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.634+0000 7f4205b41640 1 --2- 172.21.15.114:0/1011300106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420015e1c0 0x7f420015cba0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f41f4034040 tx=0x7f41f40046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.634+0000 7f4205b41640 1 -- 172.21.15.114:0/1011300106 shutdown_connections 2023-11-04T01:37:18.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.634+0000 7f4205b41640 1 --2- 172.21.15.114:0/1011300106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420015e5a0 0x7f42000affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.634+0000 7f4205b41640 1 --2- 172.21.15.114:0/1011300106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420015e1c0 0x7f420015cba0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.634+0000 7f4205b41640 1 --2- 172.21.15.114:0/1011300106 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41ec06ae70 0x7f41ec06d330 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.634+0000 7f4205b41640 1 --2- 172.21.15.114:0/1011300106 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42000c9af0 0x7f42000c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.634+0000 7f4205b41640 1 -- 172.21.15.114:0/1011300106 >> 172.21.15.114:0/1011300106 conn(0x7f42000cbc90 msgr2=0x7f420006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:18.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.634+0000 7f4205b41640 1 -- 172.21.15.114:0/1011300106 shutdown_connections 2023-11-04T01:37:18.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.634+0000 7f4205b41640 1 -- 172.21.15.114:0/1011300106 wait complete. 2023-11-04T01:37:18.657 INFO:tasks.cephfs_test_runner:Starting test: test_attaching_pools_with_snaps_to_fs_fails (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that attempt to attach pool with snapshots to an fs fails 2023-11-04T01:37:18.657 INFO:tasks.cephfs_test_runner:test_attaching_pools_with_snaps_to_fs_fails (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:37:18.657 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:18.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.755+0000 7f1478125640 1 Processor -- start 2023-11-04T01:37:18.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.755+0000 7f1478125640 1 -- start start 2023-11-04T01:37:18.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.756+0000 7f1478125640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f14700b0cd0 0x7f1470070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.756+0000 7f1478125640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14700cde40 0x7f1470070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.756+0000 7f1478125640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14700cc990 con 0x7f14700cda60 2023-11-04T01:37:18.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.756+0000 7f1478125640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14700ccc70 con 0x7f14700b0cd0 2023-11-04T01:37:18.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.756+0000 7f1478125640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14700c9ce0 con 0x7f14700cde40 2023-11-04T01:37:18.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.756+0000 7f14756c0640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f14700b0cd0 0x7f1470070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.756+0000 7f14766c2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14700cde40 0x7f1470070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.756+0000 7f14756c0640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f14700b0cd0 0x7f1470070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:44654/0 (socket says 172.21.15.114:44654) 2023-11-04T01:37:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.756+0000 7f1475ec1640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f14700cda60 0x7f14700ca7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:37822/0 (socket says 172.21.15.114:37822) 2023-11-04T01:37:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.756+0000 7f14756c0640 1 -- 172.21.15.114:0/632971864 learned_addr learned my addr 172.21.15.114:0/632971864 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.756+0000 7f14766c2640 1 -- 172.21.15.114:0/632971864 >> v2:172.21.15.141:3300/0 conn(0x7f14700b0cd0 msgr2=0x7f1470070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.756+0000 7f14766c2640 1 --2- 172.21.15.114:0/632971864 >> v2:172.21.15.141:3300/0 conn(0x7f14700b0cd0 0x7f1470070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.756+0000 7f14766c2640 1 -- 172.21.15.114:0/632971864 >> v1:172.21.15.141:6789/0 conn(0x7f14700cda60 legacy=0x7f14700ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.756+0000 7f14766c2640 1 -- 172.21.15.114:0/632971864 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14700c9fc0 con 0x7f14700cde40 2023-11-04T01:37:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.756+0000 7f14756c0640 1 --2- 172.21.15.114:0/632971864 >> v2:172.21.15.141:3300/0 conn(0x7f14700b0cd0 0x7f1470070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.757+0000 7f14766c2640 1 --2- 172.21.15.114:0/632971864 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14700cde40 0x7f1470070b70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1468009d90 tx=0x7f146802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=162be7936031c388 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.759+0000 7f1474ebf640 1 -- 172.21.15.114:0/632971864 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146802cc50 con 0x7f14700cde40 2023-11-04T01:37:18.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.759+0000 7f1474ebf640 1 -- 172.21.15.114:0/632971864 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146802cdb0 con 0x7f14700cde40 2023-11-04T01:37:18.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.759+0000 7f1474ebf640 1 -- 172.21.15.114:0/632971864 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468034660 con 0x7f14700cde40 2023-11-04T01:37:18.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.760+0000 7f1478125640 1 -- 172.21.15.114:0/632971864 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14700cde40 msgr2=0x7f1470070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.760+0000 7f1478125640 1 --2- 172.21.15.114:0/632971864 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14700cde40 0x7f1470070b70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1468009d90 tx=0x7f146802bea0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.760+0000 7f1478125640 1 -- 172.21.15.114:0/632971864 shutdown_connections 2023-11-04T01:37:18.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.760+0000 7f1478125640 1 --2- 172.21.15.114:0/632971864 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14700cde40 0x7f1470070b70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.760+0000 7f1478125640 1 --2- 172.21.15.114:0/632971864 >> v2:172.21.15.141:3300/0 conn(0x7f14700b0cd0 0x7f1470070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.760+0000 7f1478125640 1 -- 172.21.15.114:0/632971864 >> 172.21.15.114:0/632971864 conn(0x7f14700ce950 msgr2=0x7f14700ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:18.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.760+0000 7f1478125640 1 -- 172.21.15.114:0/632971864 shutdown_connections 2023-11-04T01:37:18.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.760+0000 7f1478125640 1 -- 172.21.15.114:0/632971864 wait complete. 2023-11-04T01:37:18.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.761+0000 7f1478125640 1 Processor -- start 2023-11-04T01:37:18.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.761+0000 7f1478125640 1 -- start start 2023-11-04T01:37:18.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f1478125640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14700b0cd0 0x7f147014be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f1478125640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14700cda60 0x7f1470158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f1478125640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14700cde40 0x7f147015b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f1478125640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1470157ed0 con 0x7f14700cda60 2023-11-04T01:37:18.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f1478125640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147014c390 con 0x7f14700cde40 2023-11-04T01:37:18.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f1478125640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14701575a0 con 0x7f14700b0cd0 2023-11-04T01:37:18.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f14756c0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14700cda60 0x7f1470158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f14756c0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14700cda60 0x7f1470158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43644/0 (socket says 172.21.15.114:43644) 2023-11-04T01:37:18.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f14756c0640 1 -- 172.21.15.114:0/32725327 learned_addr learned my addr 172.21.15.114:0/32725327 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:18.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f14766c2640 1 --2- 172.21.15.114:0/32725327 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14700cde40 0x7f147015b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f1475ec1640 1 --2- 172.21.15.114:0/32725327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14700b0cd0 0x7f147014be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f14756c0640 1 -- 172.21.15.114:0/32725327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14700b0cd0 msgr2=0x7f147014be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f14756c0640 1 --2- 172.21.15.114:0/32725327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14700b0cd0 0x7f147014be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f14756c0640 1 -- 172.21.15.114:0/32725327 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14700cde40 msgr2=0x7f147015b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f14756c0640 1 --2- 172.21.15.114:0/32725327 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14700cde40 0x7f147015b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f14756c0640 1 -- 172.21.15.114:0/32725327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14600094d0 con 0x7f14700cda60 2023-11-04T01:37:18.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f14756c0640 1 --2- 172.21.15.114:0/32725327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14700cda60 0x7f1470158360 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f146000e9a0 tx=0x7f146000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.762+0000 7f14667fc640 1 -- 172.21.15.114:0/32725327 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146000ca00 con 0x7f14700cda60 2023-11-04T01:37:18.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.763+0000 7f14667fc640 1 -- 172.21.15.114:0/32725327 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146000cb60 con 0x7f14700cda60 2023-11-04T01:37:18.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.763+0000 7f14667fc640 1 -- 172.21.15.114:0/32725327 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460013470 con 0x7f14700cda60 2023-11-04T01:37:18.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.763+0000 7f1478125640 1 -- 172.21.15.114:0/32725327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1468009a70 con 0x7f14700cda60 2023-11-04T01:37:18.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.763+0000 7f1478125640 1 -- 172.21.15.114:0/32725327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1470157b60 con 0x7f14700cda60 2023-11-04T01:37:18.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.764+0000 7f1478125640 1 -- 172.21.15.114:0/32725327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14700cc470 con 0x7f14700cda60 2023-11-04T01:37:18.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.764+0000 7f14667fc640 1 -- 172.21.15.114:0/32725327 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f14600135d0 con 0x7f14700cda60 2023-11-04T01:37:18.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.764+0000 7f14667fc640 1 --2- 172.21.15.114:0/32725327 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f145406ae70 0x7f145406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:18.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.764+0000 7f14667fc640 1 -- 172.21.15.114:0/32725327 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f146008a020 con 0x7f14700cda60 2023-11-04T01:37:18.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.764+0000 7f1475ec1640 1 --2- 172.21.15.114:0/32725327 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f145406ae70 0x7f145406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:18.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.765+0000 7f1475ec1640 1 --2- 172.21.15.114:0/32725327 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f145406ae70 0x7f145406d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f146c000f60 tx=0x7f146c000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:18.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.768+0000 7f14667fc640 1 -- 172.21.15.114:0/32725327 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f14700cc470 con 0x7f14700cda60 2023-11-04T01:37:18.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.937+0000 7f1478125640 1 -- 172.21.15.114:0/32725327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14700cc470 con 0x7f14700cda60 2023-11-04T01:37:18.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.938+0000 7f14667fc640 1 -- 172.21.15.114:0/32725327 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18796 (secure 0 0 0) 0x7f14700cc470 con 0x7f14700cda60 2023-11-04T01:37:18.940 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:18.940 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:11.562429+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:18.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.940+0000 7f1478125640 1 -- 172.21.15.114:0/32725327 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f145406ae70 msgr2=0x7f145406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.940+0000 7f1478125640 1 --2- 172.21.15.114:0/32725327 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f145406ae70 0x7f145406d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f146c000f60 tx=0x7f146c000ed0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.940+0000 7f1478125640 1 -- 172.21.15.114:0/32725327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14700cda60 msgr2=0x7f1470158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:18.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.940+0000 7f1478125640 1 --2- 172.21.15.114:0/32725327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14700cda60 0x7f1470158360 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f146000e9a0 tx=0x7f146000ee60 comp rx=0 tx=0).stop 2023-11-04T01:37:18.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.940+0000 7f1478125640 1 -- 172.21.15.114:0/32725327 shutdown_connections 2023-11-04T01:37:18.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.940+0000 7f1478125640 1 --2- 172.21.15.114:0/32725327 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f145406ae70 0x7f145406d330 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.940+0000 7f1478125640 1 --2- 172.21.15.114:0/32725327 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14700cde40 0x7f147015b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.940+0000 7f1478125640 1 --2- 172.21.15.114:0/32725327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14700cda60 0x7f1470158360 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.940+0000 7f1478125640 1 --2- 172.21.15.114:0/32725327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14700b0cd0 0x7f147014be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:18.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.940+0000 7f1478125640 1 -- 172.21.15.114:0/32725327 >> 172.21.15.114:0/32725327 conn(0x7f14700ce950 msgr2=0x7f14700ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:18.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.940+0000 7f1478125640 1 -- 172.21.15.114:0/32725327 shutdown_connections 2023-11-04T01:37:18.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:18.940+0000 7f1478125640 1 -- 172.21.15.114:0/32725327 wait complete. 2023-11-04T01:37:18.953 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:18.954 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:19.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.053+0000 7f5c37b73640 1 Processor -- start 2023-11-04T01:37:19.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.054+0000 7f5c37b73640 1 -- start start 2023-11-04T01:37:19.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.054+0000 7f5c37b73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c30160600 0x7f5c300cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.054+0000 7f5c37b73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c301609e0 0x7f5c300cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.054+0000 7f5c37b73640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c3006e1a0 con 0x7f5c300ccde0 2023-11-04T01:37:19.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.054+0000 7f5c37b73640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c300ce090 con 0x7f5c30160600 2023-11-04T01:37:19.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.054+0000 7f5c37b73640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300cd330 con 0x7f5c301609e0 2023-11-04T01:37:19.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.055+0000 7f5c3590f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c30160600 0x7f5c300cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.055+0000 7f5c3590f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c30160600 0x7f5c300cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43646/0 (socket says 172.21.15.114:43646) 2023-11-04T01:37:19.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.055+0000 7f5c3590f640 1 -- 172.21.15.114:0/1796792125 learned_addr learned my addr 172.21.15.114:0/1796792125 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:19.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.055+0000 7f5c3510e640 1 --2- 172.21.15.114:0/1796792125 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c301609e0 0x7f5c300cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.055+0000 7f5c3590f640 1 -- 172.21.15.114:0/1796792125 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c301609e0 msgr2=0x7f5c300cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:19.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.055+0000 7f5c3590f640 1 --2- 172.21.15.114:0/1796792125 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c301609e0 0x7f5c300cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.055+0000 7f5c3590f640 1 -- 172.21.15.114:0/1796792125 >> v1:172.21.15.141:6789/0 conn(0x7f5c300ccde0 legacy=0x7f5c300c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:19.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.055+0000 7f5c3590f640 1 -- 172.21.15.114:0/1796792125 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3006db50 con 0x7f5c30160600 2023-11-04T01:37:19.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.055+0000 7f5c3510e640 1 --2- 172.21.15.114:0/1796792125 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c301609e0 0x7f5c300cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:19.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.056+0000 7f5c3590f640 1 --2- 172.21.15.114:0/1796792125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c30160600 0x7f5c300cd610 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009870 tx=0x7f5c2c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4472cca987eb324e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:19.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.056+0000 7f5c3490d640 1 -- 172.21.15.114:0/1796792125 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c030840 con 0x7f5c30160600 2023-11-04T01:37:19.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.056+0000 7f5c3490d640 1 -- 172.21.15.114:0/1796792125 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c0309a0 con 0x7f5c30160600 2023-11-04T01:37:19.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.056+0000 7f5c3490d640 1 -- 172.21.15.114:0/1796792125 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c030d30 con 0x7f5c30160600 2023-11-04T01:37:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.056+0000 7f5c37b73640 1 -- 172.21.15.114:0/1796792125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c30160600 msgr2=0x7f5c300cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.056+0000 7f5c37b73640 1 --2- 172.21.15.114:0/1796792125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c30160600 0x7f5c300cd610 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009870 tx=0x7f5c2c02b980 comp rx=0 tx=0).stop 2023-11-04T01:37:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.056+0000 7f5c37b73640 1 -- 172.21.15.114:0/1796792125 shutdown_connections 2023-11-04T01:37:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.056+0000 7f5c37b73640 1 --2- 172.21.15.114:0/1796792125 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c301609e0 0x7f5c300cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.056+0000 7f5c37b73640 1 --2- 172.21.15.114:0/1796792125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c30160600 0x7f5c300cd610 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.056+0000 7f5c37b73640 1 -- 172.21.15.114:0/1796792125 >> 172.21.15.114:0/1796792125 conn(0x7f5c3006a120 msgr2=0x7f5c3006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.056+0000 7f5c37b73640 1 -- 172.21.15.114:0/1796792125 shutdown_connections 2023-11-04T01:37:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.056+0000 7f5c37b73640 1 -- 172.21.15.114:0/1796792125 wait complete. 2023-11-04T01:37:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.057+0000 7f5c37b73640 1 Processor -- start 2023-11-04T01:37:19.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.057+0000 7f5c37b73640 1 -- start start 2023-11-04T01:37:19.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.058+0000 7f5c37b73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c300ccde0 0x7f5c3014e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.058+0000 7f5c37b73640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c30160600 0x7f5c300b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.058+0000 7f5c37b73640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c301609e0 0x7f5c3014e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.058+0000 7f5c37b73640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300b4730 con 0x7f5c301609e0 2023-11-04T01:37:19.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.058+0000 7f5c37b73640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300c4300 con 0x7f5c30160600 2023-11-04T01:37:19.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.058+0000 7f5c37b73640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300b1bb0 con 0x7f5c300ccde0 2023-11-04T01:37:19.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.058+0000 7f5c36110640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c301609e0 0x7f5c3014e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.058+0000 7f5c36110640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c301609e0 0x7f5c3014e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43656/0 (socket says 172.21.15.114:43656) 2023-11-04T01:37:19.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.058+0000 7f5c36110640 1 -- 172.21.15.114:0/36319911 learned_addr learned my addr 172.21.15.114:0/36319911 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:19.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.058+0000 7f5c36110640 1 -- 172.21.15.114:0/36319911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c300ccde0 msgr2=0x7f5c3014e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.058+0000 7f5c3510e640 1 --2- 172.21.15.114:0/36319911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c30160600 0x7f5c300b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.059+0000 7f5c3590f640 1 --2- 172.21.15.114:0/36319911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c300ccde0 0x7f5c3014e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.059+0000 7f5c36110640 1 --2- 172.21.15.114:0/36319911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c300ccde0 0x7f5c3014e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.059+0000 7f5c36110640 1 -- 172.21.15.114:0/36319911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c30160600 msgr2=0x7f5c300b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.059+0000 7f5c36110640 1 --2- 172.21.15.114:0/36319911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c30160600 0x7f5c300b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.059+0000 7f5c36110640 1 -- 172.21.15.114:0/36319911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c0094d0 con 0x7f5c301609e0 2023-11-04T01:37:19.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.059+0000 7f5c3510e640 1 --2- 172.21.15.114:0/36319911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c30160600 0x7f5c300b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:19.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.059+0000 7f5c3590f640 1 --2- 172.21.15.114:0/36319911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c300ccde0 0x7f5c3014e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:19.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.059+0000 7f5c36110640 1 --2- 172.21.15.114:0/36319911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c301609e0 0x7f5c3014e090 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5c2800b9a0 tx=0x7f5c2800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:19.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.059+0000 7f5c267fc640 1 -- 172.21.15.114:0/36319911 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2800cba0 con 0x7f5c301609e0 2023-11-04T01:37:19.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.059+0000 7f5c267fc640 1 -- 172.21.15.114:0/36319911 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2800cd00 con 0x7f5c301609e0 2023-11-04T01:37:19.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.059+0000 7f5c37b73640 1 -- 172.21.15.114:0/36319911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c300c36f0 con 0x7f5c301609e0 2023-11-04T01:37:19.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.059+0000 7f5c267fc640 1 -- 172.21.15.114:0/36319911 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28014680 con 0x7f5c301609e0 2023-11-04T01:37:19.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.059+0000 7f5c37b73640 1 -- 172.21.15.114:0/36319911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c300c3cb0 con 0x7f5c301609e0 2023-11-04T01:37:19.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.060+0000 7f5c37b73640 1 -- 172.21.15.114:0/36319911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c300c44b0 con 0x7f5c301609e0 2023-11-04T01:37:19.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.060+0000 7f5c267fc640 1 -- 172.21.15.114:0/36319911 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5c2801d3b0 con 0x7f5c301609e0 2023-11-04T01:37:19.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.061+0000 7f5c267fc640 1 --2- 172.21.15.114:0/36319911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c1406ae70 0x7f5c1406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.061+0000 7f5c267fc640 1 -- 172.21.15.114:0/36319911 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5c280897a0 con 0x7f5c301609e0 2023-11-04T01:37:19.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.061+0000 7f5c3590f640 1 --2- 172.21.15.114:0/36319911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c1406ae70 0x7f5c1406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.061+0000 7f5c3590f640 1 --2- 172.21.15.114:0/36319911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c1406ae70 0x7f5c1406d330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c036000 tx=0x7f5c2c03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:19.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.065+0000 7f5c267fc640 1 -- 172.21.15.114:0/36319911 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5c300c44b0 con 0x7f5c301609e0 2023-11-04T01:37:19.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.232+0000 7f5c37b73640 1 -- 172.21.15.114:0/36319911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c300c44b0 con 0x7f5c301609e0 2023-11-04T01:37:19.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.232+0000 7f5c267fc640 1 -- 172.21.15.114:0/36319911 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c300c44b0 con 0x7f5c301609e0 2023-11-04T01:37:19.234 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:37:19.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.234+0000 7f5c37b73640 1 -- 172.21.15.114:0/36319911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c1406ae70 msgr2=0x7f5c1406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.234+0000 7f5c37b73640 1 --2- 172.21.15.114:0/36319911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c1406ae70 0x7f5c1406d330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c036000 tx=0x7f5c2c03b040 comp rx=0 tx=0).stop 2023-11-04T01:37:19.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.234+0000 7f5c37b73640 1 -- 172.21.15.114:0/36319911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c301609e0 msgr2=0x7f5c3014e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.234+0000 7f5c37b73640 1 --2- 172.21.15.114:0/36319911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c301609e0 0x7f5c3014e090 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5c2800b9a0 tx=0x7f5c2800be60 comp rx=0 tx=0).stop 2023-11-04T01:37:19.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.234+0000 7f5c37b73640 1 -- 172.21.15.114:0/36319911 shutdown_connections 2023-11-04T01:37:19.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.234+0000 7f5c37b73640 1 --2- 172.21.15.114:0/36319911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c301609e0 0x7f5c3014e090 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.234+0000 7f5c37b73640 1 --2- 172.21.15.114:0/36319911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c1406ae70 0x7f5c1406d330 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.234+0000 7f5c37b73640 1 --2- 172.21.15.114:0/36319911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c30160600 0x7f5c300b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.234+0000 7f5c37b73640 1 --2- 172.21.15.114:0/36319911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c300ccde0 0x7f5c3014e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.234+0000 7f5c37b73640 1 -- 172.21.15.114:0/36319911 >> 172.21.15.114:0/36319911 conn(0x7f5c3006a120 msgr2=0x7f5c300cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:19.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.234+0000 7f5c37b73640 1 -- 172.21.15.114:0/36319911 shutdown_connections 2023-11-04T01:37:19.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.234+0000 7f5c37b73640 1 -- 172.21.15.114:0/36319911 wait complete. 2023-11-04T01:37:19.247 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:19.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.349+0000 7f5824a6b640 1 Processor -- start 2023-11-04T01:37:19.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.349+0000 7f5824a6b640 1 -- start start 2023-11-04T01:37:19.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.350+0000 7f5824a6b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58200ae1d0 0x7f58200cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.350+0000 7f5824a6b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582015aff0 con 0x7f58200c4ff0 2023-11-04T01:37:19.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.350+0000 7f5824a6b640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582015a3e0 con 0x7f5820159c00 2023-11-04T01:37:19.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.350+0000 7f5824a6b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582015a6c0 con 0x7f58200ae1d0 2023-11-04T01:37:19.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.350+0000 7f5817fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f58200c4ff0 0x7f58200adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51496/0 (socket says 172.21.15.114:51496) 2023-11-04T01:37:19.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.350+0000 7f5817fff640 1 -- 172.21.15.114:0/323952248 learned_addr learned my addr 172.21.15.114:0/323952248 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:19.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.350+0000 7f581ed9d640 1 --2- 172.21.15.114:0/323952248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58200ae1d0 0x7f58200cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.350+0000 7f581dd9b640 1 -- 172.21.15.114:0/323952248 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2332291793 0 0) 0x7f582015aff0 con 0x7f58200c4ff0 2023-11-04T01:37:19.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.350+0000 7f581dd9b640 1 -- 172.21.15.114:0/323952248 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f580c003520 con 0x7f58200c4ff0 2023-11-04T01:37:19.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.350+0000 7f581dd9b640 1 -- 172.21.15.114:0/323952248 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148299981 0 0) 0x7f582015a3e0 con 0x7f5820159c00 2023-11-04T01:37:19.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.350+0000 7f581dd9b640 1 -- 172.21.15.114:0/323952248 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f582015aff0 con 0x7f5820159c00 2023-11-04T01:37:19.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.351+0000 7f581dd9b640 1 -- 172.21.15.114:0/323952248 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1932395093 0 0) 0x7f580c003520 con 0x7f58200c4ff0 2023-11-04T01:37:19.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.351+0000 7f581ed9d640 1 -- 172.21.15.114:0/323952248 >> v1:172.21.15.141:6789/0 conn(0x7f5820159c00 legacy=0x7f58200c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.351+0000 7f581ed9d640 1 -- 172.21.15.114:0/323952248 >> v1:172.21.15.114:6789/0 conn(0x7f58200c4ff0 legacy=0x7f58200adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.351+0000 7f581ed9d640 1 -- 172.21.15.114:0/323952248 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582015a9a0 con 0x7f58200ae1d0 2023-11-04T01:37:19.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.351+0000 7f581ed9d640 1 --2- 172.21.15.114:0/323952248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58200ae1d0 0x7f58200cc890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5818009dc0 tx=0x7f581802bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc22f450652332a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:19.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.351+0000 7f581dd9b640 1 -- 172.21.15.114:0/323952248 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808001670 con 0x7f58200ae1d0 2023-11-04T01:37:19.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.352+0000 7f581dd9b640 1 -- 172.21.15.114:0/323952248 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581802c910 con 0x7f58200ae1d0 2023-11-04T01:37:19.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.352+0000 7f581dd9b640 1 -- 172.21.15.114:0/323952248 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581802cca0 con 0x7f58200ae1d0 2023-11-04T01:37:19.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.352+0000 7f5824a6b640 1 -- 172.21.15.114:0/323952248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58200ae1d0 msgr2=0x7f58200cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.352+0000 7f5824a6b640 1 --2- 172.21.15.114:0/323952248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58200ae1d0 0x7f58200cc890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5818009dc0 tx=0x7f581802bde0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.352+0000 7f5824a6b640 1 -- 172.21.15.114:0/323952248 shutdown_connections 2023-11-04T01:37:19.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.352+0000 7f5824a6b640 1 --2- 172.21.15.114:0/323952248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58200ae1d0 0x7f58200cc890 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.352+0000 7f5824a6b640 1 -- 172.21.15.114:0/323952248 >> 172.21.15.114:0/323952248 conn(0x7f58200ce950 msgr2=0x7f58200ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:19.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.352+0000 7f5824a6b640 1 -- 172.21.15.114:0/323952248 shutdown_connections 2023-11-04T01:37:19.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.352+0000 7f5824a6b640 1 -- 172.21.15.114:0/323952248 wait complete. 2023-11-04T01:37:19.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.353+0000 7f5824a6b640 1 Processor -- start 2023-11-04T01:37:19.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.354+0000 7f5824a6b640 1 -- start start 2023-11-04T01:37:19.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.354+0000 7f5824a6b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58200ae1d0 0x7f5820151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.354+0000 7f5824a6b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58200c4ff0 0x7f58201ee1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.354+0000 7f5824a6b640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5820159c00 0x7f5820153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.354+0000 7f5824a6b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58200c7a40 con 0x7f58200c4ff0 2023-11-04T01:37:19.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.354+0000 7f5824a6b640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58200c6dc0 con 0x7f5820159c00 2023-11-04T01:37:19.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.354+0000 7f5824a6b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58200c70a0 con 0x7f58200ae1d0 2023-11-04T01:37:19.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.354+0000 7f5817fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58200c4ff0 0x7f58201ee1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.354+0000 7f5817fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58200c4ff0 0x7f58201ee1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43660/0 (socket says 172.21.15.114:43660) 2023-11-04T01:37:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.354+0000 7f5817fff640 1 -- 172.21.15.114:0/364625730 learned_addr learned my addr 172.21.15.114:0/364625730 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.355+0000 7f581ed9d640 1 --2- 172.21.15.114:0/364625730 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5820159c00 0x7f5820153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.355+0000 7f581e59c640 1 --2- 172.21.15.114:0/364625730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58200ae1d0 0x7f5820151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.355+0000 7f5817fff640 1 -- 172.21.15.114:0/364625730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58200ae1d0 msgr2=0x7f5820151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.355+0000 7f5817fff640 1 --2- 172.21.15.114:0/364625730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58200ae1d0 0x7f5820151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.355+0000 7f5817fff640 1 -- 172.21.15.114:0/364625730 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5820159c00 msgr2=0x7f5820153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.355+0000 7f5817fff640 1 --2- 172.21.15.114:0/364625730 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5820159c00 0x7f5820153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.355+0000 7f5817fff640 1 -- 172.21.15.114:0/364625730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5818009a70 con 0x7f58200c4ff0 2023-11-04T01:37:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.355+0000 7f581ed9d640 1 --2- 172.21.15.114:0/364625730 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5820159c00 0x7f5820153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.355+0000 7f5817fff640 1 --2- 172.21.15.114:0/364625730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58200c4ff0 0x7f58201ee1c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f580800c730 tx=0x7f580800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.355+0000 7f5816ffd640 1 -- 172.21.15.114:0/364625730 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808005ad0 con 0x7f58200c4ff0 2023-11-04T01:37:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.355+0000 7f5816ffd640 1 -- 172.21.15.114:0/364625730 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5808005c30 con 0x7f58200c4ff0 2023-11-04T01:37:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.355+0000 7f5816ffd640 1 -- 172.21.15.114:0/364625730 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808007070 con 0x7f58200c4ff0 2023-11-04T01:37:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.355+0000 7f5824a6b640 1 -- 172.21.15.114:0/364625730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58200c7380 con 0x7f58200c4ff0 2023-11-04T01:37:19.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.355+0000 7f5824a6b640 1 -- 172.21.15.114:0/364625730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5820151840 con 0x7f58200c4ff0 2023-11-04T01:37:19.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.356+0000 7f5824a6b640 1 -- 172.21.15.114:0/364625730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58200c7b80 con 0x7f58200c4ff0 2023-11-04T01:37:19.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.357+0000 7f5816ffd640 1 -- 172.21.15.114:0/364625730 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f58080071d0 con 0x7f58200c4ff0 2023-11-04T01:37:19.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.357+0000 7f5816ffd640 1 --2- 172.21.15.114:0/364625730 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f580006ae70 0x7f580006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.358+0000 7f5816ffd640 1 -- 172.21.15.114:0/364625730 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5808088f40 con 0x7f58200c4ff0 2023-11-04T01:37:19.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.358+0000 7f581e59c640 1 --2- 172.21.15.114:0/364625730 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f580006ae70 0x7f580006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.358+0000 7f581e59c640 1 --2- 172.21.15.114:0/364625730 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f580006ae70 0x7f580006d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f58100011e0 tx=0x7f5810009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:19.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.362+0000 7f5816ffd640 1 -- 172.21.15.114:0/364625730 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f58200c7b80 con 0x7f58200c4ff0 2023-11-04T01:37:19.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.535+0000 7f5824a6b640 1 -- 172.21.15.114:0/364625730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58200c7b80 con 0x7f58200c4ff0 2023-11-04T01:37:19.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.536+0000 7f5816ffd640 1 -- 172.21.15.114:0/364625730 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5808017020 con 0x7f58200c4ff0 2023-11-04T01:37:19.538 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:19.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.538+0000 7f5824a6b640 1 -- 172.21.15.114:0/364625730 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f580006ae70 msgr2=0x7f580006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.538+0000 7f5824a6b640 1 --2- 172.21.15.114:0/364625730 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f580006ae70 0x7f580006d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f58100011e0 tx=0x7f5810009040 comp rx=0 tx=0).stop 2023-11-04T01:37:19.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.538+0000 7f5824a6b640 1 -- 172.21.15.114:0/364625730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58200c4ff0 msgr2=0x7f58201ee1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.538+0000 7f5824a6b640 1 --2- 172.21.15.114:0/364625730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58200c4ff0 0x7f58201ee1c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f580800c730 tx=0x7f580800cbf0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.538+0000 7f5824a6b640 1 -- 172.21.15.114:0/364625730 shutdown_connections 2023-11-04T01:37:19.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.538+0000 7f5824a6b640 1 --2- 172.21.15.114:0/364625730 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f580006ae70 0x7f580006d330 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.538+0000 7f5824a6b640 1 --2- 172.21.15.114:0/364625730 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5820159c00 0x7f5820153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.538+0000 7f5824a6b640 1 --2- 172.21.15.114:0/364625730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58200c4ff0 0x7f58201ee1c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.538+0000 7f5824a6b640 1 --2- 172.21.15.114:0/364625730 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f58200ae1d0 0x7f5820151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.538+0000 7f5824a6b640 1 -- 172.21.15.114:0/364625730 >> 172.21.15.114:0/364625730 conn(0x7f58200ce950 msgr2=0x7f58200c4350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:19.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.538+0000 7f5824a6b640 1 -- 172.21.15.114:0/364625730 shutdown_connections 2023-11-04T01:37:19.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.538+0000 7f5824a6b640 1 -- 172.21.15.114:0/364625730 wait complete. 2023-11-04T01:37:19.553 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:19.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.657+0000 7f986a705640 1 Processor -- start 2023-11-04T01:37:19.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.657+0000 7f986a705640 1 -- start start 2023-11-04T01:37:19.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.658+0000 7f986a705640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9864153e60 0x7f986415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.658+0000 7f986a705640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98640b4880 0x7f98640b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.658+0000 7f986a705640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98640cde60 con 0x7f98640cd6d0 2023-11-04T01:37:19.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.658+0000 7f986a705640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9864160f90 con 0x7f9864153e60 2023-11-04T01:37:19.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.658+0000 7f986a705640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98640b5200 con 0x7f98640b4880 2023-11-04T01:37:19.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.658+0000 7f9863fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9864153e60 0x7f986415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.658+0000 7f9863fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9864153e60 0x7f986415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43666/0 (socket says 172.21.15.114:43666) 2023-11-04T01:37:19.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.658+0000 7f9863fff640 1 -- 172.21.15.114:0/968209934 learned_addr learned my addr 172.21.15.114:0/968209934 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:19.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.659+0000 7f9868ca2640 1 --2- 172.21.15.114:0/968209934 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98640b4880 0x7f98640b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.659+0000 7f9863fff640 1 -- 172.21.15.114:0/968209934 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98640b4880 msgr2=0x7f98640b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:19.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.659+0000 7f9863fff640 1 --2- 172.21.15.114:0/968209934 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98640b4880 0x7f98640b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.659+0000 7f9863fff640 1 -- 172.21.15.114:0/968209934 >> v1:172.21.15.141:6789/0 conn(0x7f98640cd6d0 legacy=0x7f9864161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.659+0000 7f9863fff640 1 -- 172.21.15.114:0/968209934 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986415e400 con 0x7f9864153e60 2023-11-04T01:37:19.662 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:37:19.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.659+0000 7f9863fff640 1 --2- 172.21.15.114:0/968209934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9864153e60 0x7f986415dec0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9854009870 tx=0x7f985402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93461724701cc0a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:19.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.660+0000 7f9862ffd640 1 -- 172.21.15.114:0/968209934 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854030840 con 0x7f9864153e60 2023-11-04T01:37:19.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.660+0000 7f9862ffd640 1 -- 172.21.15.114:0/968209934 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98540309a0 con 0x7f9864153e60 2023-11-04T01:37:19.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.660+0000 7f9862ffd640 1 -- 172.21.15.114:0/968209934 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854030d30 con 0x7f9864153e60 2023-11-04T01:37:19.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.660+0000 7f986a705640 1 -- 172.21.15.114:0/968209934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9864153e60 msgr2=0x7f986415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.660+0000 7f986a705640 1 --2- 172.21.15.114:0/968209934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9864153e60 0x7f986415dec0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9854009870 tx=0x7f985402b980 comp rx=0 tx=0).stop 2023-11-04T01:37:19.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.660+0000 7f986a705640 1 -- 172.21.15.114:0/968209934 shutdown_connections 2023-11-04T01:37:19.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.660+0000 7f986a705640 1 --2- 172.21.15.114:0/968209934 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98640b4880 0x7f98640b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.660+0000 7f986a705640 1 --2- 172.21.15.114:0/968209934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9864153e60 0x7f986415dec0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.660+0000 7f986a705640 1 -- 172.21.15.114:0/968209934 >> 172.21.15.114:0/968209934 conn(0x7f98640cf880 msgr2=0x7f98640cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:19.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.660+0000 7f986a705640 1 -- 172.21.15.114:0/968209934 shutdown_connections 2023-11-04T01:37:19.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.660+0000 7f986a705640 1 -- 172.21.15.114:0/968209934 wait complete. 2023-11-04T01:37:19.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.662+0000 7f986a705640 1 Processor -- start 2023-11-04T01:37:19.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.662+0000 7f986a705640 1 -- start start 2023-11-04T01:37:19.665 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:37:19.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.662+0000 7f986a705640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98640b4880 0x7f9864156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.662+0000 7f986a705640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98640cd6d0 0x7f98640c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.662+0000 7f986a705640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9864153e60 0x7f9864154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f986a705640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98640c9ed0 con 0x7f9864153e60 2023-11-04T01:37:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f986a705640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98640ca1b0 con 0x7f98640b4880 2023-11-04T01:37:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f986a705640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98640ca490 con 0x7f98640cd6d0 2023-11-04T01:37:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f9868ca2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9864153e60 0x7f9864154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f9868ca2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9864153e60 0x7f9864154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43678/0 (socket says 172.21.15.114:43678) 2023-11-04T01:37:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f9868ca2640 1 -- 172.21.15.114:0/3337248314 learned_addr learned my addr 172.21.15.114:0/3337248314 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f9863fff640 1 --2- 172.21.15.114:0/3337248314 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98640b4880 0x7f9864156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f98637fe640 1 --2- 172.21.15.114:0/3337248314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98640cd6d0 0x7f98640c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f9868ca2640 1 -- 172.21.15.114:0/3337248314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98640cd6d0 msgr2=0x7f98640c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f9868ca2640 1 --2- 172.21.15.114:0/3337248314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98640cd6d0 0x7f98640c8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f9868ca2640 1 -- 172.21.15.114:0/3337248314 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98640b4880 msgr2=0x7f9864156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f9868ca2640 1 --2- 172.21.15.114:0/3337248314 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98640b4880 0x7f9864156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f9868ca2640 1 -- 172.21.15.114:0/3337248314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98540094d0 con 0x7f9864153e60 2023-11-04T01:37:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f9863fff640 1 --2- 172.21.15.114:0/3337248314 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98640b4880 0x7f9864156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f9868ca2640 1 --2- 172.21.15.114:0/3337248314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9864153e60 0x7f9864154c50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f985c00efc0 tx=0x7f985c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f9860ff9640 1 -- 172.21.15.114:0/3337248314 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c014480 con 0x7f9864153e60 2023-11-04T01:37:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f9860ff9640 1 -- 172.21.15.114:0/3337248314 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c00f040 con 0x7f9864153e60 2023-11-04T01:37:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f9860ff9640 1 -- 172.21.15.114:0/3337248314 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c014820 con 0x7f9864153e60 2023-11-04T01:37:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f986a705640 1 -- 172.21.15.114:0/3337248314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98640ca770 con 0x7f9864153e60 2023-11-04T01:37:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.663+0000 7f986a705640 1 -- 172.21.15.114:0/3337248314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9864155190 con 0x7f9864153e60 2023-11-04T01:37:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.665+0000 7f986a705640 1 -- 172.21.15.114:0/3337248314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98640cac90 con 0x7f9864153e60 2023-11-04T01:37:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.665+0000 7f9860ff9640 1 -- 172.21.15.114:0/3337248314 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f985c014980 con 0x7f9864153e60 2023-11-04T01:37:19.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.665+0000 7f9860ff9640 1 --2- 172.21.15.114:0/3337248314 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f985006ae70 0x7f985006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.665+0000 7f9860ff9640 1 -- 172.21.15.114:0/3337248314 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f985c08a620 con 0x7f9864153e60 2023-11-04T01:37:19.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.666+0000 7f9863fff640 1 --2- 172.21.15.114:0/3337248314 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f985006ae70 0x7f985006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.666+0000 7f9863fff640 1 --2- 172.21.15.114:0/3337248314 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f985006ae70 0x7f985006d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9854036000 tx=0x7f985403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:19.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.670+0000 7f9860ff9640 1 -- 172.21.15.114:0/3337248314 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f98640cac90 con 0x7f9864153e60 2023-11-04T01:37:19.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.843+0000 7f986a705640 1 -- 172.21.15.114:0/3337248314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98640cac90 con 0x7f9864153e60 2023-11-04T01:37:19.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.844+0000 7f9860ff9640 1 -- 172.21.15.114:0/3337248314 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f98640cac90 con 0x7f9864153e60 2023-11-04T01:37:19.846 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:37:19.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.846+0000 7f986a705640 1 -- 172.21.15.114:0/3337248314 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f985006ae70 msgr2=0x7f985006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.846+0000 7f986a705640 1 --2- 172.21.15.114:0/3337248314 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f985006ae70 0x7f985006d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9854036000 tx=0x7f985403b040 comp rx=0 tx=0).stop 2023-11-04T01:37:19.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.846+0000 7f986a705640 1 -- 172.21.15.114:0/3337248314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9864153e60 msgr2=0x7f9864154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.846+0000 7f986a705640 1 --2- 172.21.15.114:0/3337248314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9864153e60 0x7f9864154c50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f985c00efc0 tx=0x7f985c00c490 comp rx=0 tx=0).stop 2023-11-04T01:37:19.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.846+0000 7f986a705640 1 -- 172.21.15.114:0/3337248314 shutdown_connections 2023-11-04T01:37:19.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.846+0000 7f986a705640 1 --2- 172.21.15.114:0/3337248314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9864153e60 0x7f9864154c50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.846+0000 7f986a705640 1 --2- 172.21.15.114:0/3337248314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f98640cd6d0 0x7f98640c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.846+0000 7f986a705640 1 --2- 172.21.15.114:0/3337248314 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f985006ae70 0x7f985006d330 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.846+0000 7f986a705640 1 --2- 172.21.15.114:0/3337248314 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f98640b4880 0x7f9864156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.846+0000 7f986a705640 1 -- 172.21.15.114:0/3337248314 >> 172.21.15.114:0/3337248314 conn(0x7f98640cf880 msgr2=0x7f98640cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:19.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.846+0000 7f986a705640 1 -- 172.21.15.114:0/3337248314 shutdown_connections 2023-11-04T01:37:19.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.846+0000 7f986a705640 1 -- 172.21.15.114:0/3337248314 wait complete. 2023-11-04T01:37:19.858 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:19.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.962+0000 7fb413864640 1 Processor -- start 2023-11-04T01:37:19.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.962+0000 7fb413864640 1 -- start start 2023-11-04T01:37:19.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.963+0000 7fb413864640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb40c071f90 0x7fb40c0b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.963+0000 7fb413864640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb40c15add0 0x7fb40c0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.963+0000 7fb413864640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb40c072370 0x7fb40c0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.963+0000 7fb413864640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40c0b1fa0 con 0x7fb40c15add0 2023-11-04T01:37:19.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.963+0000 7fb413864640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40c15a0e0 con 0x7fb40c072370 2023-11-04T01:37:19.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.963+0000 7fb413864640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c0b1cc0 con 0x7fb40c071f90 2023-11-04T01:37:19.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.963+0000 7fb410dff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb40c15add0 0x7fb40c0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.963+0000 7fb410dff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb40c15add0 0x7fb40c0cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43684/0 (socket says 172.21.15.114:43684) 2023-11-04T01:37:19.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.963+0000 7fb410dff640 1 -- 172.21.15.114:0/3864777387 learned_addr learned my addr 172.21.15.114:0/3864777387 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:19.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.963+0000 7fb411600640 1 --2- 172.21.15.114:0/3864777387 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb40c071f90 0x7fb40c0b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.963+0000 7fb411e01640 1 --2- 172.21.15.114:0/3864777387 >> v2:172.21.15.141:3300/0 conn(0x7fb40c072370 0x7fb40c0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.963+0000 7fb410dff640 1 -- 172.21.15.114:0/3864777387 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb40c071f90 msgr2=0x7fb40c0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:19.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.963+0000 7fb410dff640 1 --2- 172.21.15.114:0/3864777387 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb40c071f90 0x7fb40c0b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.963+0000 7fb410dff640 1 -- 172.21.15.114:0/3864777387 >> v2:172.21.15.141:3300/0 conn(0x7fb40c072370 msgr2=0x7fb40c0cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:19.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.963+0000 7fb410dff640 1 --2- 172.21.15.114:0/3864777387 >> v2:172.21.15.141:3300/0 conn(0x7fb40c072370 0x7fb40c0cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.963+0000 7fb410dff640 1 -- 172.21.15.114:0/3864777387 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40c15a2f0 con 0x7fb40c15add0 2023-11-04T01:37:19.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.964+0000 7fb410dff640 1 --2- 172.21.15.114:0/3864777387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb40c15add0 0x7fb40c0cecc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb40c071870 tx=0x7fb40002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23cc44a3e05f31e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:19.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.964+0000 7fb40bfff640 1 -- 172.21.15.114:0/3864777387 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400031870 con 0x7fb40c15add0 2023-11-04T01:37:19.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.964+0000 7fb40bfff640 1 -- 172.21.15.114:0/3864777387 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4000319d0 con 0x7fb40c15add0 2023-11-04T01:37:19.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.964+0000 7fb40bfff640 1 -- 172.21.15.114:0/3864777387 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400031d60 con 0x7fb40c15add0 2023-11-04T01:37:19.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.965+0000 7fb413864640 1 -- 172.21.15.114:0/3864777387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb40c15add0 msgr2=0x7fb40c0cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.965+0000 7fb413864640 1 --2- 172.21.15.114:0/3864777387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb40c15add0 0x7fb40c0cecc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb40c071870 tx=0x7fb40002b910 comp rx=0 tx=0).stop 2023-11-04T01:37:19.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.965+0000 7fb413864640 1 -- 172.21.15.114:0/3864777387 shutdown_connections 2023-11-04T01:37:19.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.965+0000 7fb413864640 1 --2- 172.21.15.114:0/3864777387 >> v2:172.21.15.141:3300/0 conn(0x7fb40c072370 0x7fb40c0cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.965+0000 7fb413864640 1 --2- 172.21.15.114:0/3864777387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb40c15add0 0x7fb40c0cecc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.965+0000 7fb413864640 1 --2- 172.21.15.114:0/3864777387 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb40c071f90 0x7fb40c0b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.965+0000 7fb413864640 1 -- 172.21.15.114:0/3864777387 >> 172.21.15.114:0/3864777387 conn(0x7fb40c06d800 msgr2=0x7fb40c06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:19.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.965+0000 7fb413864640 1 -- 172.21.15.114:0/3864777387 shutdown_connections 2023-11-04T01:37:19.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.965+0000 7fb413864640 1 -- 172.21.15.114:0/3864777387 wait complete. 2023-11-04T01:37:19.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.967+0000 7fb413864640 1 Processor -- start 2023-11-04T01:37:19.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.967+0000 7fb413864640 1 -- start start 2023-11-04T01:37:19.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.968+0000 7fb413864640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb40c071f90 0x7fb40c153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.968+0000 7fb413864640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb40c072370 0x7fb40c149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.968+0000 7fb413864640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb40c15add0 0x7fb40c0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.968+0000 7fb413864640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c0c7a40 con 0x7fb40c071f90 2023-11-04T01:37:19.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.968+0000 7fb413864640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c154420 con 0x7fb40c072370 2023-11-04T01:37:19.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.968+0000 7fb413864640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c0c6ae0 con 0x7fb40c15add0 2023-11-04T01:37:19.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.968+0000 7fb411600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb40c071f90 0x7fb40c153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.968+0000 7fb411600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb40c071f90 0x7fb40c153ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43692/0 (socket says 172.21.15.114:43692) 2023-11-04T01:37:19.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.968+0000 7fb411600640 1 -- 172.21.15.114:0/626646806 learned_addr learned my addr 172.21.15.114:0/626646806 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:19.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.968+0000 7fb411600640 1 -- 172.21.15.114:0/626646806 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb40c15add0 msgr2=0x7fb40c0c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.968+0000 7fb411600640 1 --2- 172.21.15.114:0/626646806 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb40c15add0 0x7fb40c0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.968+0000 7fb411600640 1 -- 172.21.15.114:0/626646806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb40c072370 msgr2=0x7fb40c149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:19.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.968+0000 7fb411600640 1 --2- 172.21.15.114:0/626646806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb40c072370 0x7fb40c149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:19.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.969+0000 7fb411600640 1 -- 172.21.15.114:0/626646806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4000094d0 con 0x7fb40c071f90 2023-11-04T01:37:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.969+0000 7fb411600640 1 --2- 172.21.15.114:0/626646806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb40c071f90 0x7fb40c153ee0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc007e40 tx=0x7fb3fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.969+0000 7fb409ffb640 1 -- 172.21.15.114:0/626646806 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc014620 con 0x7fb40c071f90 2023-11-04T01:37:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.969+0000 7fb409ffb640 1 -- 172.21.15.114:0/626646806 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc00ee90 con 0x7fb40c071f90 2023-11-04T01:37:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.969+0000 7fb409ffb640 1 -- 172.21.15.114:0/626646806 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0149c0 con 0x7fb40c071f90 2023-11-04T01:37:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.969+0000 7fb413864640 1 -- 172.21.15.114:0/626646806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40c0c6dc0 con 0x7fb40c071f90 2023-11-04T01:37:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.969+0000 7fb413864640 1 -- 172.21.15.114:0/626646806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40c0c7380 con 0x7fb40c071f90 2023-11-04T01:37:19.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.970+0000 7fb413864640 1 -- 172.21.15.114:0/626646806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40c0718d0 con 0x7fb40c071f90 2023-11-04T01:37:19.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.970+0000 7fb409ffb640 1 -- 172.21.15.114:0/626646806 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb3fc014b20 con 0x7fb40c071f90 2023-11-04T01:37:19.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.971+0000 7fb409ffb640 1 --2- 172.21.15.114:0/626646806 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb3f806aea0 0x7fb3f806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:19.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.971+0000 7fb409ffb640 1 -- 172.21.15.114:0/626646806 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb3fc08a390 con 0x7fb40c071f90 2023-11-04T01:37:19.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.971+0000 7fb410dff640 1 --2- 172.21.15.114:0/626646806 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb3f806aea0 0x7fb3f806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:19.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.971+0000 7fb410dff640 1 --2- 172.21.15.114:0/626646806 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb3f806aea0 0x7fb3f806d360 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb400036000 tx=0x7fb400030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:19.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:19.975+0000 7fb409ffb640 1 -- 172.21.15.114:0/626646806 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb3fc054ff0 con 0x7fb40c071f90 2023-11-04T01:37:20.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.147+0000 7fb413864640 1 -- 172.21.15.114:0/626646806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb40c0cf230 con 0x7fb40c071f90 2023-11-04T01:37:20.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.147+0000 7fb409ffb640 1 -- 172.21.15.114:0/626646806 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb3fc058610 con 0x7fb40c071f90 2023-11-04T01:37:20.150 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:20.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.149+0000 7fb413864640 1 -- 172.21.15.114:0/626646806 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb3f806aea0 msgr2=0x7fb3f806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.149+0000 7fb413864640 1 --2- 172.21.15.114:0/626646806 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb3f806aea0 0x7fb3f806d360 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb400036000 tx=0x7fb400030000 comp rx=0 tx=0).stop 2023-11-04T01:37:20.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.149+0000 7fb413864640 1 -- 172.21.15.114:0/626646806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb40c071f90 msgr2=0x7fb40c153ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.149+0000 7fb413864640 1 --2- 172.21.15.114:0/626646806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb40c071f90 0x7fb40c153ee0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc007e40 tx=0x7fb3fc00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.149+0000 7fb413864640 1 -- 172.21.15.114:0/626646806 shutdown_connections 2023-11-04T01:37:20.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.149+0000 7fb413864640 1 --2- 172.21.15.114:0/626646806 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb40c15add0 0x7fb40c0c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.149+0000 7fb413864640 1 --2- 172.21.15.114:0/626646806 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb3f806aea0 0x7fb3f806d360 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.149+0000 7fb413864640 1 --2- 172.21.15.114:0/626646806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb40c072370 0x7fb40c149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.149+0000 7fb413864640 1 --2- 172.21.15.114:0/626646806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb40c071f90 0x7fb40c153ee0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.150+0000 7fb413864640 1 -- 172.21.15.114:0/626646806 >> 172.21.15.114:0/626646806 conn(0x7fb40c06d800 msgr2=0x7fb40c15b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:20.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.150+0000 7fb413864640 1 -- 172.21.15.114:0/626646806 shutdown_connections 2023-11-04T01:37:20.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.150+0000 7fb413864640 1 -- 172.21.15.114:0/626646806 wait complete. 2023-11-04T01:37:20.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails' 2023-11-04T01:37:20.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.261+0000 7f9783890640 1 Processor -- start 2023-11-04T01:37:20.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.262+0000 7f9783890640 1 -- start start 2023-11-04T01:37:20.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.262+0000 7f9783890640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f977c0cc870 0x7f977c0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.262+0000 7f9783890640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977c0cd690 con 0x7f977c0cc430 2023-11-04T01:37:20.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.262+0000 7f9783890640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977c0cd970 con 0x7f977c159da0 2023-11-04T01:37:20.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.262+0000 7f9783890640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c0cdc50 con 0x7f977c0cc870 2023-11-04T01:37:20.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9780e2b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f977c0cc430 0x7f977c0ce730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51508/0 (socket says 172.21.15.114:51508) 2023-11-04T01:37:20.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9780e2b640 1 -- 172.21.15.114:0/234166575 learned_addr learned my addr 172.21.15.114:0/234166575 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:20.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9773fff640 1 -- 172.21.15.114:0/234166575 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768639408 0 0) 0x7f977c0cd690 con 0x7f977c0cc430 2023-11-04T01:37:20.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9773fff640 1 -- 172.21.15.114:0/234166575 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9768003520 con 0x7f977c0cc430 2023-11-04T01:37:20.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9781e2d640 1 --2- 172.21.15.114:0/234166575 >> v2:172.21.15.141:3300/0 conn(0x7f977c0cc870 0x7f977c0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9773fff640 1 -- 172.21.15.114:0/234166575 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2256780183 0 0) 0x7f9768003520 con 0x7f977c0cc430 2023-11-04T01:37:20.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9773fff640 1 -- 172.21.15.114:0/234166575 >> v2:172.21.15.141:3300/0 conn(0x7f977c0cc870 msgr2=0x7f977c0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:20.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9773fff640 1 --2- 172.21.15.114:0/234166575 >> v2:172.21.15.141:3300/0 conn(0x7f977c0cc870 0x7f977c0cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9773fff640 1 -- 172.21.15.114:0/234166575 >> v1:172.21.15.141:6789/0 conn(0x7f977c159da0 legacy=0x7f977c0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9773fff640 1 -- 172.21.15.114:0/234166575 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c0cdf30 con 0x7f977c0cc430 2023-11-04T01:37:20.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9773fff640 1 -- 172.21.15.114:0/234166575 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f976c001670 con 0x7f977c0cc430 2023-11-04T01:37:20.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9773fff640 1 -- 172.21.15.114:0/234166575 >> v1:172.21.15.114:6789/0 conn(0x7f977c0cc430 legacy=0x7f977c0ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9773fff640 1 --2- 172.21.15.114:0/234166575 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9768003970 0x7f9768003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9773fff640 1 --2- 172.21.15.114:0/234166575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97680047c0 0x7f9768004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9773fff640 1 --2- 172.21.15.114:0/234166575 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9768005180 0x7f976800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9773fff640 1 -- 172.21.15.114:0/234166575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0cdc50 con 0x7f97680047c0 2023-11-04T01:37:20.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9773fff640 1 -- 172.21.15.114:0/234166575 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976800c020 con 0x7f9768005180 2023-11-04T01:37:20.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9773fff640 1 -- 172.21.15.114:0/234166575 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976800c1e0 con 0x7f9768003970 2023-11-04T01:37:20.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9780e2b640 1 --2- 172.21.15.114:0/234166575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97680047c0 0x7f9768004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f9781e2d640 1 --2- 172.21.15.114:0/234166575 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9768005180 0x7f976800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.263+0000 7f978162c640 1 --2- 172.21.15.114:0/234166575 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9768003970 0x7f9768003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.264+0000 7f9780e2b640 1 -- 172.21.15.114:0/234166575 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9768003970 msgr2=0x7f9768003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:20.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.264+0000 7f9780e2b640 1 --2- 172.21.15.114:0/234166575 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9768003970 0x7f9768003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.264+0000 7f9780e2b640 1 -- 172.21.15.114:0/234166575 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9768005180 msgr2=0x7f976800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:20.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.264+0000 7f9780e2b640 1 --2- 172.21.15.114:0/234166575 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9768005180 0x7f976800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.264+0000 7f9780e2b640 1 -- 172.21.15.114:0/234166575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9768003520 con 0x7f97680047c0 2023-11-04T01:37:20.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.264+0000 7f9781e2d640 1 --2- 172.21.15.114:0/234166575 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9768005180 0x7f976800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:20.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.264+0000 7f9781e2d640 1 -- 172.21.15.114:0/234166575 reap_dead start 2023-11-04T01:37:20.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.264+0000 7f9780e2b640 1 --2- 172.21.15.114:0/234166575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97680047c0 0x7f9768004c40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f976c00c240 tx=0x7f97680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d31049005836e68 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:20.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.264+0000 7f9773fff640 1 -- 172.21.15.114:0/234166575 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c005ad0 con 0x7f97680047c0 2023-11-04T01:37:20.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.264+0000 7f9773fff640 1 -- 172.21.15.114:0/234166575 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c005c30 con 0x7f97680047c0 2023-11-04T01:37:20.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.264+0000 7f9773fff640 1 -- 172.21.15.114:0/234166575 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c02cab0 con 0x7f97680047c0 2023-11-04T01:37:20.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.265+0000 7f9783890640 1 -- 172.21.15.114:0/234166575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97680047c0 msgr2=0x7f9768004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.265+0000 7f9783890640 1 --2- 172.21.15.114:0/234166575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97680047c0 0x7f9768004c40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f976c00c240 tx=0x7f97680057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.265+0000 7f9783890640 1 -- 172.21.15.114:0/234166575 shutdown_connections 2023-11-04T01:37:20.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.265+0000 7f9783890640 1 --2- 172.21.15.114:0/234166575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97680047c0 0x7f9768004c40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.265+0000 7f9783890640 1 -- 172.21.15.114:0/234166575 >> 172.21.15.114:0/234166575 conn(0x7f977c06d8b0 msgr2=0x7f977c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:20.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.265+0000 7f9783890640 1 -- 172.21.15.114:0/234166575 shutdown_connections 2023-11-04T01:37:20.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.265+0000 7f9783890640 1 -- 172.21.15.114:0/234166575 wait complete. 2023-11-04T01:37:20.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.266+0000 7f9783890640 1 Processor -- start 2023-11-04T01:37:20.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.266+0000 7f9783890640 1 -- start start 2023-11-04T01:37:20.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f9783890640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97680047c0 0x7f977c0b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f9783890640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f977c15be40 0x7f977c1536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f9783890640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977c15b0e0 0x7f977c1502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f9783890640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c1522c0 con 0x7f977c15b0e0 2023-11-04T01:37:20.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f9783890640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c151f90 con 0x7f97680047c0 2023-11-04T01:37:20.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f9783890640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0b1ce0 con 0x7f977c15be40 2023-11-04T01:37:20.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f9781e2d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977c15b0e0 0x7f977c1502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f9781e2d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977c15b0e0 0x7f977c1502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43706/0 (socket says 172.21.15.114:43706) 2023-11-04T01:37:20.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f9781e2d640 1 -- 172.21.15.114:0/992383111 learned_addr learned my addr 172.21.15.114:0/992383111 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:20.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f978162c640 1 --2- 172.21.15.114:0/992383111 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97680047c0 0x7f977c0b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f9780e2b640 1 --2- 172.21.15.114:0/992383111 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f977c15be40 0x7f977c1536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f9781e2d640 1 -- 172.21.15.114:0/992383111 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f977c15be40 msgr2=0x7f977c1536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f9781e2d640 1 --2- 172.21.15.114:0/992383111 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f977c15be40 0x7f977c1536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f9781e2d640 1 -- 172.21.15.114:0/992383111 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97680047c0 msgr2=0x7f977c0b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f9781e2d640 1 --2- 172.21.15.114:0/992383111 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97680047c0 0x7f977c0b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f9781e2d640 1 -- 172.21.15.114:0/992383111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c0b1fc0 con 0x7f977c15b0e0 2023-11-04T01:37:20.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f978162c640 1 --2- 172.21.15.114:0/992383111 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97680047c0 0x7f977c0b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:20.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.267+0000 7f9780e2b640 1 --2- 172.21.15.114:0/992383111 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f977c15be40 0x7f977c1536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:20.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.268+0000 7f9781e2d640 1 --2- 172.21.15.114:0/992383111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977c15b0e0 0x7f977c1502a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f977c15d650 tx=0x7f9774010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:20.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.268+0000 7f9771ffb640 1 -- 172.21.15.114:0/992383111 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977401b070 con 0x7f977c15b0e0 2023-11-04T01:37:20.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.268+0000 7f9771ffb640 1 -- 172.21.15.114:0/992383111 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977400f040 con 0x7f977c15b0e0 2023-11-04T01:37:20.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.268+0000 7f9783890640 1 -- 172.21.15.114:0/992383111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c0b22a0 con 0x7f977c15b0e0 2023-11-04T01:37:20.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.268+0000 7f9771ffb640 1 -- 172.21.15.114:0/992383111 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977400e050 con 0x7f977c15b0e0 2023-11-04T01:37:20.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.268+0000 7f9783890640 1 -- 172.21.15.114:0/992383111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c1568a0 con 0x7f977c15b0e0 2023-11-04T01:37:20.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.269+0000 7f9783890640 1 -- 172.21.15.114:0/992383111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c152430 con 0x7f977c15b0e0 2023-11-04T01:37:20.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.269+0000 7f9771ffb640 1 -- 172.21.15.114:0/992383111 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9774015440 con 0x7f977c15b0e0 2023-11-04T01:37:20.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.270+0000 7f9771ffb640 1 --2- 172.21.15.114:0/992383111 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f976006ae70 0x7f976006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.270+0000 7f9771ffb640 1 -- 172.21.15.114:0/992383111 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9774089c20 con 0x7f977c15b0e0 2023-11-04T01:37:20.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.270+0000 7f978162c640 1 --2- 172.21.15.114:0/992383111 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f976006ae70 0x7f976006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.270+0000 7f978162c640 1 --2- 172.21.15.114:0/992383111 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f976006ae70 0x7f976006d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9778000c00 tx=0x7f9778009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:20.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.274+0000 7f9771ffb640 1 -- 172.21.15.114:0/992383111 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9774054910 con 0x7f977c15b0e0 2023-11-04T01:37:20.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.506+0000 7f9783890640 1 -- 172.21.15.114:0/992383111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]} v 0) v1 -- 0x7f977c0b2840 con 0x7f977c15b0e0 2023-11-04T01:37:20.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.765+0000 7f9771ffb640 1 -- 172.21.15.114:0/992383111 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]}]=0 v68) v1 ==== 176+0+0 (secure 0 0 0) 0x7f9774057f30 con 0x7f977c15b0e0 2023-11-04T01:37:20.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.767+0000 7f9783890640 1 -- 172.21.15.114:0/992383111 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f976006ae70 msgr2=0x7f976006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.767+0000 7f9783890640 1 --2- 172.21.15.114:0/992383111 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f976006ae70 0x7f976006d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9778000c00 tx=0x7f9778009040 comp rx=0 tx=0).stop 2023-11-04T01:37:20.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.767+0000 7f9783890640 1 -- 172.21.15.114:0/992383111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977c15b0e0 msgr2=0x7f977c1502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.767+0000 7f9783890640 1 --2- 172.21.15.114:0/992383111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977c15b0e0 0x7f977c1502a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f977c15d650 tx=0x7f9774010590 comp rx=0 tx=0).stop 2023-11-04T01:37:20.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.767+0000 7f9783890640 1 -- 172.21.15.114:0/992383111 shutdown_connections 2023-11-04T01:37:20.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.767+0000 7f9783890640 1 --2- 172.21.15.114:0/992383111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977c15b0e0 0x7f977c1502a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.767+0000 7f9783890640 1 --2- 172.21.15.114:0/992383111 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f977c15be40 0x7f977c1536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.767+0000 7f9783890640 1 --2- 172.21.15.114:0/992383111 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f976006ae70 0x7f976006d330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.767+0000 7f9783890640 1 --2- 172.21.15.114:0/992383111 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97680047c0 0x7f977c0b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.767+0000 7f9783890640 1 -- 172.21.15.114:0/992383111 >> 172.21.15.114:0/992383111 conn(0x7f977c06d8b0 msgr2=0x7f977c158f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:20.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.767+0000 7f9783890640 1 -- 172.21.15.114:0/992383111 shutdown_connections 2023-11-04T01:37:20.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.767+0000 7f9783890640 1 -- 172.21.15.114:0/992383111 wait complete. 2023-11-04T01:37:20.780 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:37:20.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.881+0000 7f749491d640 1 Processor -- start 2023-11-04T01:37:20.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.881+0000 7f749491d640 1 -- start start 2023-11-04T01:37:20.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.882+0000 7f749491d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7490160430 0x7f74900b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.882+0000 7f749491d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74900b2b60 0x7f749006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.882+0000 7f749491d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74900b2fc0 con 0x7f749006c1d0 2023-11-04T01:37:20.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.882+0000 7f749491d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74900cb580 con 0x7f7490160430 2023-11-04T01:37:20.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.882+0000 7f749491d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749006ca40 con 0x7f74900b2b60 2023-11-04T01:37:20.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.882+0000 7f748e59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7490160430 0x7f74900b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.882+0000 7f748e59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7490160430 0x7f74900b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43718/0 (socket says 172.21.15.114:43718) 2023-11-04T01:37:20.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.882+0000 7f748ed9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f749006c1d0 0x7f7490160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51520/0 (socket says 172.21.15.114:51520) 2023-11-04T01:37:20.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.882+0000 7f748e59c640 1 -- 172.21.15.114:0/3817375005 learned_addr learned my addr 172.21.15.114:0/3817375005 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:20.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.883+0000 7f748dd9b640 1 --2- 172.21.15.114:0/3817375005 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74900b2b60 0x7f749006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.883+0000 7f748e59c640 1 -- 172.21.15.114:0/3817375005 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74900b2b60 msgr2=0x7f749006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:20.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.883+0000 7f748e59c640 1 --2- 172.21.15.114:0/3817375005 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74900b2b60 0x7f749006bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.883+0000 7f748e59c640 1 -- 172.21.15.114:0/3817375005 >> v1:172.21.15.114:6789/0 conn(0x7f749006c1d0 legacy=0x7f7490160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.883+0000 7f748e59c640 1 -- 172.21.15.114:0/3817375005 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749006cd20 con 0x7f7490160430 2023-11-04T01:37:20.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.883+0000 7f748d59a640 1 -- 172.21.15.114:0/3817375005 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528151475 0 0) 0x7f74900b2fc0 con 0x7f749006c1d0 2023-11-04T01:37:20.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.883+0000 7f748dd9b640 1 --2- 172.21.15.114:0/3817375005 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74900b2b60 0x7f749006bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:20.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.883+0000 7f748e59c640 1 --2- 172.21.15.114:0/3817375005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7490160430 0x7f74900b2620 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7480009e50 tx=0x7f748002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c66800fe9558e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:20.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.884+0000 7f748d59a640 1 -- 172.21.15.114:0/3817375005 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748002cb00 con 0x7f7490160430 2023-11-04T01:37:20.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.884+0000 7f748d59a640 1 -- 172.21.15.114:0/3817375005 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748002cc60 con 0x7f7490160430 2023-11-04T01:37:20.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.884+0000 7f748d59a640 1 -- 172.21.15.114:0/3817375005 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74800343f0 con 0x7f7490160430 2023-11-04T01:37:20.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.884+0000 7f749491d640 1 -- 172.21.15.114:0/3817375005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7490160430 msgr2=0x7f74900b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.884+0000 7f749491d640 1 --2- 172.21.15.114:0/3817375005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7490160430 0x7f74900b2620 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7480009e50 tx=0x7f748002bf60 comp rx=0 tx=0).stop 2023-11-04T01:37:20.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.884+0000 7f749491d640 1 -- 172.21.15.114:0/3817375005 shutdown_connections 2023-11-04T01:37:20.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.884+0000 7f749491d640 1 --2- 172.21.15.114:0/3817375005 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74900b2b60 0x7f749006bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.884+0000 7f749491d640 1 --2- 172.21.15.114:0/3817375005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7490160430 0x7f74900b2620 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.884+0000 7f749491d640 1 -- 172.21.15.114:0/3817375005 >> 172.21.15.114:0/3817375005 conn(0x7f749006ea20 msgr2=0x7f749006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:20.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.884+0000 7f749491d640 1 -- 172.21.15.114:0/3817375005 shutdown_connections 2023-11-04T01:37:20.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.884+0000 7f749491d640 1 -- 172.21.15.114:0/3817375005 wait complete. 2023-11-04T01:37:20.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.885+0000 7f749491d640 1 Processor -- start 2023-11-04T01:37:20.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.886+0000 7f749491d640 1 -- start start 2023-11-04T01:37:20.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.886+0000 7f749491d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f749006c1d0 0x7f749015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.886+0000 7f749491d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900b2b60 0x7f749014ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.886+0000 7f749491d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7490160430 0x7f74900b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.886+0000 7f749491d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74900c7500 con 0x7f74900b2b60 2023-11-04T01:37:20.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.886+0000 7f749491d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74900b3850 con 0x7f749006c1d0 2023-11-04T01:37:20.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.886+0000 7f749491d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749015e6a0 con 0x7f7490160430 2023-11-04T01:37:20.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.886+0000 7f748dd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900b2b60 0x7f749014ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.886+0000 7f748dd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900b2b60 0x7f749014ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43728/0 (socket says 172.21.15.114:43728) 2023-11-04T01:37:20.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.886+0000 7f748dd9b640 1 -- 172.21.15.114:0/119915203 learned_addr learned my addr 172.21.15.114:0/119915203 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:20.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.887+0000 7f748ed9d640 1 --2- 172.21.15.114:0/119915203 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7490160430 0x7f74900b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.887+0000 7f748e59c640 1 --2- 172.21.15.114:0/119915203 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f749006c1d0 0x7f749015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.887+0000 7f748dd9b640 1 -- 172.21.15.114:0/119915203 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7490160430 msgr2=0x7f74900b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.887+0000 7f748dd9b640 1 --2- 172.21.15.114:0/119915203 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7490160430 0x7f74900b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.887+0000 7f748dd9b640 1 -- 172.21.15.114:0/119915203 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f749006c1d0 msgr2=0x7f749015dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:20.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.887+0000 7f748dd9b640 1 --2- 172.21.15.114:0/119915203 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f749006c1d0 0x7f749015dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:20.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.887+0000 7f748dd9b640 1 -- 172.21.15.114:0/119915203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7480009b30 con 0x7f74900b2b60 2023-11-04T01:37:20.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.887+0000 7f748dd9b640 1 --2- 172.21.15.114:0/119915203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900b2b60 0x7f749014ff00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f748400e7e0 tx=0x7f748400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:20.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.887+0000 7f747effd640 1 -- 172.21.15.114:0/119915203 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484004030 con 0x7f74900b2b60 2023-11-04T01:37:20.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.887+0000 7f747effd640 1 -- 172.21.15.114:0/119915203 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7484004190 con 0x7f74900b2b60 2023-11-04T01:37:20.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.887+0000 7f747effd640 1 -- 172.21.15.114:0/119915203 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484004520 con 0x7f74900b2b60 2023-11-04T01:37:20.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.887+0000 7f749491d640 1 -- 172.21.15.114:0/119915203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749015e980 con 0x7f74900b2b60 2023-11-04T01:37:20.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.887+0000 7f749491d640 1 -- 172.21.15.114:0/119915203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749015ef40 con 0x7f74900b2b60 2023-11-04T01:37:20.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.888+0000 7f749491d640 1 -- 172.21.15.114:0/119915203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7490074290 con 0x7f74900b2b60 2023-11-04T01:37:20.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.889+0000 7f747effd640 1 -- 172.21.15.114:0/119915203 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f748400c6d0 con 0x7f74900b2b60 2023-11-04T01:37:20.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.889+0000 7f747effd640 1 --2- 172.21.15.114:0/119915203 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f747006ae70 0x7f747006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:20.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.889+0000 7f748e59c640 1 --2- 172.21.15.114:0/119915203 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f747006ae70 0x7f747006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:20.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.889+0000 7f747effd640 1 -- 172.21.15.114:0/119915203 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7484089630 con 0x7f74900b2b60 2023-11-04T01:37:20.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.889+0000 7f748e59c640 1 --2- 172.21.15.114:0/119915203 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f747006ae70 0x7f747006d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7480035000 tx=0x7f7480030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:20.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:20.893+0000 7f747effd640 1 -- 172.21.15.114:0/119915203 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74840543d0 con 0x7f74900b2b60 2023-11-04T01:37:21.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.060+0000 7f749491d640 1 -- 172.21.15.114:0/119915203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f74900b6b20 con 0x7f74900b2b60 2023-11-04T01:37:21.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.063+0000 7f747effd640 1 -- 172.21.15.114:0/119915203 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v11)=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f74840579f0 con 0x7f74900b2b60 2023-11-04T01:37:21.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.065+0000 7f749491d640 1 -- 172.21.15.114:0/119915203 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f747006ae70 msgr2=0x7f747006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.065+0000 7f749491d640 1 --2- 172.21.15.114:0/119915203 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f747006ae70 0x7f747006d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7480035000 tx=0x7f7480030000 comp rx=0 tx=0).stop 2023-11-04T01:37:21.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.065+0000 7f749491d640 1 -- 172.21.15.114:0/119915203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900b2b60 msgr2=0x7f749014ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.065+0000 7f749491d640 1 --2- 172.21.15.114:0/119915203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900b2b60 0x7f749014ff00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f748400e7e0 tx=0x7f748400eca0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.065+0000 7f749491d640 1 -- 172.21.15.114:0/119915203 shutdown_connections 2023-11-04T01:37:21.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.065+0000 7f749491d640 1 --2- 172.21.15.114:0/119915203 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7490160430 0x7f74900b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.065+0000 7f749491d640 1 --2- 172.21.15.114:0/119915203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900b2b60 0x7f749014ff00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.065+0000 7f749491d640 1 --2- 172.21.15.114:0/119915203 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f747006ae70 0x7f747006d330 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.065+0000 7f749491d640 1 --2- 172.21.15.114:0/119915203 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f749006c1d0 0x7f749015dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.065+0000 7f749491d640 1 -- 172.21.15.114:0/119915203 >> 172.21.15.114:0/119915203 conn(0x7f749006ea20 msgr2=0x7f74900b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:21.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.065+0000 7f749491d640 1 -- 172.21.15.114:0/119915203 shutdown_connections 2023-11-04T01:37:21.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.065+0000 7f749491d640 1 -- 172.21.15.114:0/119915203 wait complete. 2023-11-04T01:37:21.078 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:37:21.079 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:37:21.117 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:37:21.171 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:37:21.171 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:37:21.171 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:21.187 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:37:21.187 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:21.243 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:21.284 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:37:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:21.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.380+0000 7f3d3ecfc640 1 Processor -- start 2023-11-04T01:37:21.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.380+0000 7f3d3ecfc640 1 -- start start 2023-11-04T01:37:21.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.380+0000 7f3d3ecfc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d3815ab70 0x7f3d380cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.380+0000 7f3d3ecfc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3d3806eba0 0x7f3d3806a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.380+0000 7f3d3ecfc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3d3806a660 0x7f3d380ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.380+0000 7f3d3ecfc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d380cba70 con 0x7f3d3806a660 2023-11-04T01:37:21.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.380+0000 7f3d3ecfc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d3815d650 con 0x7f3d3806eba0 2023-11-04T01:37:21.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.380+0000 7f3d3ecfc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3815e620 con 0x7f3d3815ab70 2023-11-04T01:37:21.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.381+0000 7f3d3d299640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3d3806a660 0x7f3d380ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.381+0000 7f3d3d299640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3d3806a660 0x7f3d380ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43740/0 (socket says 172.21.15.114:43740) 2023-11-04T01:37:21.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.381+0000 7f3d3d299640 1 -- 172.21.15.114:0/3535155018 learned_addr learned my addr 172.21.15.114:0/3535155018 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:21.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.381+0000 7f3d37fff640 1 --2- 172.21.15.114:0/3535155018 >> v2:172.21.15.141:3300/0 conn(0x7f3d3806eba0 0x7f3d3806a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.381+0000 7f3d3ca98640 1 --2- 172.21.15.114:0/3535155018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d3815ab70 0x7f3d380cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.381+0000 7f3d3d299640 1 -- 172.21.15.114:0/3535155018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d3815ab70 msgr2=0x7f3d380cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:21.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.381+0000 7f3d3d299640 1 --2- 172.21.15.114:0/3535155018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d3815ab70 0x7f3d380cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.381+0000 7f3d3d299640 1 -- 172.21.15.114:0/3535155018 >> v2:172.21.15.141:3300/0 conn(0x7f3d3806eba0 msgr2=0x7f3d3806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:21.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.381+0000 7f3d3d299640 1 --2- 172.21.15.114:0/3535155018 >> v2:172.21.15.141:3300/0 conn(0x7f3d3806eba0 0x7f3d3806a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.381+0000 7f3d3d299640 1 -- 172.21.15.114:0/3535155018 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3806aa90 con 0x7f3d3806a660 2023-11-04T01:37:21.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.382+0000 7f3d3d299640 1 --2- 172.21.15.114:0/3535155018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d3806a660 0x7f3d380ae5e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3d38067700 tx=0x7f3d3002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec14b970d913127 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:21.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.382+0000 7f3d377fe640 1 -- 172.21.15.114:0/3535155018 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3002c9e0 con 0x7f3d3806a660 2023-11-04T01:37:21.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.382+0000 7f3d377fe640 1 -- 172.21.15.114:0/3535155018 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3002cb40 con 0x7f3d3806a660 2023-11-04T01:37:21.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.382+0000 7f3d377fe640 1 -- 172.21.15.114:0/3535155018 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d300343f0 con 0x7f3d3806a660 2023-11-04T01:37:21.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.382+0000 7f3d3ecfc640 1 -- 172.21.15.114:0/3535155018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d3806a660 msgr2=0x7f3d380ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.382+0000 7f3d3ecfc640 1 --2- 172.21.15.114:0/3535155018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d3806a660 0x7f3d380ae5e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3d38067700 tx=0x7f3d3002be40 comp rx=0 tx=0).stop 2023-11-04T01:37:21.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.382+0000 7f3d3ecfc640 1 -- 172.21.15.114:0/3535155018 shutdown_connections 2023-11-04T01:37:21.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.382+0000 7f3d3ecfc640 1 --2- 172.21.15.114:0/3535155018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d3806a660 0x7f3d380ae5e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.382+0000 7f3d3ecfc640 1 --2- 172.21.15.114:0/3535155018 >> v2:172.21.15.141:3300/0 conn(0x7f3d3806eba0 0x7f3d3806a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.382+0000 7f3d3ecfc640 1 --2- 172.21.15.114:0/3535155018 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d3815ab70 0x7f3d380cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.382+0000 7f3d3ecfc640 1 -- 172.21.15.114:0/3535155018 >> 172.21.15.114:0/3535155018 conn(0x7f3d38098d40 msgr2=0x7f3d380cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:21.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.382+0000 7f3d3ecfc640 1 -- 172.21.15.114:0/3535155018 shutdown_connections 2023-11-04T01:37:21.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.382+0000 7f3d3ecfc640 1 -- 172.21.15.114:0/3535155018 wait complete. 2023-11-04T01:37:21.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.383+0000 7f3d3ecfc640 1 Processor -- start 2023-11-04T01:37:21.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.384+0000 7f3d3ecfc640 1 -- start start 2023-11-04T01:37:21.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.384+0000 7f3d3ecfc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d3806a660 0x7f3d38158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.384+0000 7f3d3ecfc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3d3806eba0 0x7f3d3815c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.384+0000 7f3d3ecfc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d3815ab70 0x7f3d3815c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.384+0000 7f3d3ecfc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d38158990 con 0x7f3d3815ab70 2023-11-04T01:37:21.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.384+0000 7f3d3ecfc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3809c430 con 0x7f3d3806eba0 2023-11-04T01:37:21.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.384+0000 7f3d3ecfc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3809c710 con 0x7f3d3806a660 2023-11-04T01:37:21.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.384+0000 7f3d3d299640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d3815ab70 0x7f3d3815c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.384+0000 7f3d3ca98640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d3806a660 0x7f3d38158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.385+0000 7f3d37fff640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3d3806eba0 0x7f3d3815c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.385+0000 7f3d3d299640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d3815ab70 0x7f3d3815c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43744/0 (socket says 172.21.15.114:43744) 2023-11-04T01:37:21.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.385+0000 7f3d3ca98640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d3806a660 0x7f3d38158450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:54510/0 (socket says 172.21.15.114:54510) 2023-11-04T01:37:21.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.385+0000 7f3d3d299640 1 -- 172.21.15.114:0/2353730629 learned_addr learned my addr 172.21.15.114:0/2353730629 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:21.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.385+0000 7f3d3d299640 1 -- 172.21.15.114:0/2353730629 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d3806a660 msgr2=0x7f3d38158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.385+0000 7f3d3d299640 1 --2- 172.21.15.114:0/2353730629 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d3806a660 0x7f3d38158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.385+0000 7f3d3d299640 1 -- 172.21.15.114:0/2353730629 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3d3806eba0 msgr2=0x7f3d3815c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.385+0000 7f3d3d299640 1 --2- 172.21.15.114:0/2353730629 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3d3806eba0 0x7f3d3815c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.385+0000 7f3d3d299640 1 -- 172.21.15.114:0/2353730629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d30009b30 con 0x7f3d3815ab70 2023-11-04T01:37:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.385+0000 7f3d3ca98640 1 --2- 172.21.15.114:0/2353730629 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d3806a660 0x7f3d38158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.385+0000 7f3d3d299640 1 --2- 172.21.15.114:0/2353730629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d3815ab70 0x7f3d3815c840 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009e50 tx=0x7f3d30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.385+0000 7f3d357fa640 1 -- 172.21.15.114:0/2353730629 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d30009510 con 0x7f3d3815ab70 2023-11-04T01:37:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.385+0000 7f3d357fa640 1 -- 172.21.15.114:0/2353730629 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3003e450 con 0x7f3d3815ab70 2023-11-04T01:37:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.385+0000 7f3d3ecfc640 1 -- 172.21.15.114:0/2353730629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d3809c9f0 con 0x7f3d3815ab70 2023-11-04T01:37:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.385+0000 7f3d357fa640 1 -- 172.21.15.114:0/2353730629 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3003e800 con 0x7f3d3815ab70 2023-11-04T01:37:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.385+0000 7f3d3ecfc640 1 -- 172.21.15.114:0/2353730629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3809cfb0 con 0x7f3d3815ab70 2023-11-04T01:37:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.386+0000 7f3d3ecfc640 1 -- 172.21.15.114:0/2353730629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d38074290 con 0x7f3d3815ab70 2023-11-04T01:37:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.386+0000 7f3d357fa640 1 -- 172.21.15.114:0/2353730629 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d3003e960 con 0x7f3d3815ab70 2023-11-04T01:37:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.387+0000 7f3d357fa640 1 --2- 172.21.15.114:0/2353730629 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3d1c06ae70 0x7f3d1c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.387+0000 7f3d357fa640 1 -- 172.21.15.114:0/2353730629 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3d300ac490 con 0x7f3d3815ab70 2023-11-04T01:37:21.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.387+0000 7f3d3ca98640 1 --2- 172.21.15.114:0/2353730629 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3d1c06ae70 0x7f3d1c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.387+0000 7f3d3ca98640 1 --2- 172.21.15.114:0/2353730629 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3d1c06ae70 0x7f3d1c06d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009f20 tx=0x7f3d2c009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:21.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.391+0000 7f3d357fa640 1 -- 172.21.15.114:0/2353730629 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d300772c0 con 0x7f3d3815ab70 2023-11-04T01:37:21.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.557+0000 7f3d3ecfc640 1 -- 172.21.15.114:0/2353730629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d3806ae70 con 0x7f3d3815ab70 2023-11-04T01:37:21.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.558+0000 7f3d357fa640 1 -- 172.21.15.114:0/2353730629 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18796 (secure 0 0 0) 0x7f3d3007a8e0 con 0x7f3d3815ab70 2023-11-04T01:37:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:21.561 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:11.562429+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:21.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.561+0000 7f3d3ecfc640 1 -- 172.21.15.114:0/2353730629 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3d1c06ae70 msgr2=0x7f3d1c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.561+0000 7f3d3ecfc640 1 --2- 172.21.15.114:0/2353730629 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3d1c06ae70 0x7f3d1c06d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009f20 tx=0x7f3d2c009110 comp rx=0 tx=0).stop 2023-11-04T01:37:21.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.561+0000 7f3d3ecfc640 1 -- 172.21.15.114:0/2353730629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d3815ab70 msgr2=0x7f3d3815c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.561+0000 7f3d3ecfc640 1 --2- 172.21.15.114:0/2353730629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d3815ab70 0x7f3d3815c840 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009e50 tx=0x7f3d30004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:21.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.561+0000 7f3d3ecfc640 1 -- 172.21.15.114:0/2353730629 shutdown_connections 2023-11-04T01:37:21.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.561+0000 7f3d3ecfc640 1 --2- 172.21.15.114:0/2353730629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d3815ab70 0x7f3d3815c840 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.561+0000 7f3d3ecfc640 1 --2- 172.21.15.114:0/2353730629 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3d1c06ae70 0x7f3d1c06d330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.561+0000 7f3d3ecfc640 1 --2- 172.21.15.114:0/2353730629 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3d3806eba0 0x7f3d3815c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.561+0000 7f3d3ecfc640 1 --2- 172.21.15.114:0/2353730629 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d3806a660 0x7f3d38158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.561+0000 7f3d3ecfc640 1 -- 172.21.15.114:0/2353730629 >> 172.21.15.114:0/2353730629 conn(0x7f3d38098d40 msgr2=0x7f3d3815f920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:21.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.561+0000 7f3d3ecfc640 1 -- 172.21.15.114:0/2353730629 shutdown_connections 2023-11-04T01:37:21.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.561+0000 7f3d3ecfc640 1 -- 172.21.15.114:0/2353730629 wait complete. 2023-11-04T01:37:21.574 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:21.574 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:21.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.675+0000 7f508ac87640 1 Processor -- start 2023-11-04T01:37:21.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.675+0000 7f508ac87640 1 -- start start 2023-11-04T01:37:21.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.676+0000 7f508ac87640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f508415e3f0 0x7f50840b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.676+0000 7f508ac87640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f50840ca0a0 0x7f50840cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.676+0000 7f508ac87640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50840caa20 con 0x7f50840cc300 2023-11-04T01:37:21.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.676+0000 7f508ac87640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50840cb230 con 0x7f50840ca0a0 2023-11-04T01:37:21.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.676+0000 7f508ac87640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50840ca530 con 0x7f508415e3f0 2023-11-04T01:37:21.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.676+0000 7f5083fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f50840ca0a0 0x7f50840cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.676+0000 7f5089224640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f50840cc300 0x7f50840b1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51528/0 (socket says 172.21.15.114:51528) 2023-11-04T01:37:21.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.676+0000 7f5089224640 1 -- 172.21.15.114:0/783447502 learned_addr learned my addr 172.21.15.114:0/783447502 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:21.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.676+0000 7f5088a23640 1 --2- 172.21.15.114:0/783447502 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f508415e3f0 0x7f50840b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.676+0000 7f5083fff640 1 -- 172.21.15.114:0/783447502 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f508415e3f0 msgr2=0x7f50840b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:21.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.676+0000 7f5083fff640 1 --2- 172.21.15.114:0/783447502 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f508415e3f0 0x7f50840b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.676+0000 7f5083fff640 1 -- 172.21.15.114:0/783447502 >> v1:172.21.15.114:6789/0 conn(0x7f50840cc300 legacy=0x7f50840b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.676+0000 7f5083fff640 1 -- 172.21.15.114:0/783447502 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50840cac70 con 0x7f50840ca0a0 2023-11-04T01:37:21.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.676+0000 7f50837fe640 1 -- 172.21.15.114:0/783447502 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452629850 0 0) 0x7f50840caa20 con 0x7f50840cc300 2023-11-04T01:37:21.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.677+0000 7f5083fff640 1 --2- 172.21.15.114:0/783447502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50840ca0a0 0x7f50840cc920 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f50700097a0 tx=0x7f507002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86efaf1727e3b79a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:21.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.677+0000 7f50837fe640 1 -- 172.21.15.114:0/783447502 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070031830 con 0x7f50840ca0a0 2023-11-04T01:37:21.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.677+0000 7f50837fe640 1 -- 172.21.15.114:0/783447502 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5070031990 con 0x7f50840ca0a0 2023-11-04T01:37:21.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.677+0000 7f50837fe640 1 -- 172.21.15.114:0/783447502 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070031d20 con 0x7f50840ca0a0 2023-11-04T01:37:21.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.677+0000 7f508ac87640 1 -- 172.21.15.114:0/783447502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50840ca0a0 msgr2=0x7f50840cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.677+0000 7f508ac87640 1 --2- 172.21.15.114:0/783447502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50840ca0a0 0x7f50840cc920 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f50700097a0 tx=0x7f507002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.677+0000 7f508ac87640 1 -- 172.21.15.114:0/783447502 shutdown_connections 2023-11-04T01:37:21.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.677+0000 7f508ac87640 1 --2- 172.21.15.114:0/783447502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50840ca0a0 0x7f50840cc920 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.677+0000 7f508ac87640 1 --2- 172.21.15.114:0/783447502 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f508415e3f0 0x7f50840b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.677+0000 7f508ac87640 1 -- 172.21.15.114:0/783447502 >> 172.21.15.114:0/783447502 conn(0x7f5084071820 msgr2=0x7f5084071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:21.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.678+0000 7f508ac87640 1 -- 172.21.15.114:0/783447502 shutdown_connections 2023-11-04T01:37:21.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.678+0000 7f508ac87640 1 -- 172.21.15.114:0/783447502 wait complete. 2023-11-04T01:37:21.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.679+0000 7f508ac87640 1 Processor -- start 2023-11-04T01:37:21.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.679+0000 7f508ac87640 1 -- start start 2023-11-04T01:37:21.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.679+0000 7f508ac87640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50840cc300 0x7f50840c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.679+0000 7f508ac87640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f508415e3f0 0x7f50840c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.679+0000 7f508ac87640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f508413f960 0x7f508413fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.679+0000 7f508ac87640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50840c5960 con 0x7f508415e3f0 2023-11-04T01:37:21.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.679+0000 7f508ac87640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5084140420 con 0x7f508413f960 2023-11-04T01:37:21.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f508ac87640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5084140700 con 0x7f50840cc300 2023-11-04T01:37:21.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f5083fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f508415e3f0 0x7f50840c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f5083fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f508415e3f0 0x7f50840c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43760/0 (socket says 172.21.15.114:43760) 2023-11-04T01:37:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f5083fff640 1 -- 172.21.15.114:0/3650084858 learned_addr learned my addr 172.21.15.114:0/3650084858 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f5089224640 1 --2- 172.21.15.114:0/3650084858 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f508413f960 0x7f508413fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f5088a23640 1 --2- 172.21.15.114:0/3650084858 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50840cc300 0x7f50840c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f5083fff640 1 -- 172.21.15.114:0/3650084858 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50840cc300 msgr2=0x7f50840c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f5083fff640 1 --2- 172.21.15.114:0/3650084858 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50840cc300 0x7f50840c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f5083fff640 1 -- 172.21.15.114:0/3650084858 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f508413f960 msgr2=0x7f508413fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f5083fff640 1 --2- 172.21.15.114:0/3650084858 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f508413f960 0x7f508413fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f5083fff640 1 -- 172.21.15.114:0/3650084858 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5070009400 con 0x7f508415e3f0 2023-11-04T01:37:21.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f5083fff640 1 --2- 172.21.15.114:0/3650084858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f508415e3f0 0x7f50840c5df0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5070000c00 tx=0x7f50700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:21.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f50817fa640 1 -- 172.21.15.114:0/3650084858 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070004230 con 0x7f508415e3f0 2023-11-04T01:37:21.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f50817fa640 1 -- 172.21.15.114:0/3650084858 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5070004390 con 0x7f508415e3f0 2023-11-04T01:37:21.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f508ac87640 1 -- 172.21.15.114:0/3650084858 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50840c5310 con 0x7f508415e3f0 2023-11-04T01:37:21.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f50817fa640 1 -- 172.21.15.114:0/3650084858 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507003a8a0 con 0x7f508415e3f0 2023-11-04T01:37:21.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.680+0000 7f508ac87640 1 -- 172.21.15.114:0/3650084858 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50840c9910 con 0x7f508415e3f0 2023-11-04T01:37:21.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.681+0000 7f508ac87640 1 -- 172.21.15.114:0/3650084858 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50840c5ad0 con 0x7f508415e3f0 2023-11-04T01:37:21.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.682+0000 7f50817fa640 1 -- 172.21.15.114:0/3650084858 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f507003aa00 con 0x7f508415e3f0 2023-11-04T01:37:21.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.682+0000 7f50817fa640 1 --2- 172.21.15.114:0/3650084858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f506806aea0 0x7f506806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.682+0000 7f50817fa640 1 -- 172.21.15.114:0/3650084858 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f50700abee0 con 0x7f508415e3f0 2023-11-04T01:37:21.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.682+0000 7f5088a23640 1 --2- 172.21.15.114:0/3650084858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f506806aea0 0x7f506806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.683+0000 7f5088a23640 1 --2- 172.21.15.114:0/3650084858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f506806aea0 0x7f506806d360 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5078009aa0 tx=0x7f5078009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:21.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.686+0000 7f50817fa640 1 -- 172.21.15.114:0/3650084858 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5070076da0 con 0x7f508415e3f0 2023-11-04T01:37:21.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.853+0000 7f508ac87640 1 -- 172.21.15.114:0/3650084858 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5084074290 con 0x7f508415e3f0 2023-11-04T01:37:21.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.853+0000 7f50817fa640 1 -- 172.21.15.114:0/3650084858 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5070035020 con 0x7f508415e3f0 2023-11-04T01:37:21.855 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:37:21.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.855+0000 7f508ac87640 1 -- 172.21.15.114:0/3650084858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f506806aea0 msgr2=0x7f506806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.855+0000 7f508ac87640 1 --2- 172.21.15.114:0/3650084858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f506806aea0 0x7f506806d360 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5078009aa0 tx=0x7f5078009190 comp rx=0 tx=0).stop 2023-11-04T01:37:21.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.855+0000 7f508ac87640 1 -- 172.21.15.114:0/3650084858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f508415e3f0 msgr2=0x7f50840c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.855+0000 7f508ac87640 1 --2- 172.21.15.114:0/3650084858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f508415e3f0 0x7f50840c5df0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5070000c00 tx=0x7f50700046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.855+0000 7f508ac87640 1 -- 172.21.15.114:0/3650084858 shutdown_connections 2023-11-04T01:37:21.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.855+0000 7f508ac87640 1 --2- 172.21.15.114:0/3650084858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f506806aea0 0x7f506806d360 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.855+0000 7f508ac87640 1 --2- 172.21.15.114:0/3650084858 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f508413f960 0x7f508413fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.855+0000 7f508ac87640 1 --2- 172.21.15.114:0/3650084858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f508415e3f0 0x7f50840c5df0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.855+0000 7f508ac87640 1 --2- 172.21.15.114:0/3650084858 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50840cc300 0x7f50840c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.855+0000 7f508ac87640 1 -- 172.21.15.114:0/3650084858 >> 172.21.15.114:0/3650084858 conn(0x7f5084071820 msgr2=0x7f5084159dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:21.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.855+0000 7f508ac87640 1 -- 172.21.15.114:0/3650084858 shutdown_connections 2023-11-04T01:37:21.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.855+0000 7f508ac87640 1 -- 172.21.15.114:0/3650084858 wait complete. 2023-11-04T01:37:21.868 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:21.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.968+0000 7f231a955640 1 Processor -- start 2023-11-04T01:37:21.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.968+0000 7f231a955640 1 -- start start 2023-11-04T01:37:21.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.968+0000 7f231a955640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23140b2d30 0x7f231406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.969+0000 7f231a955640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231406ca40 con 0x7f2314160430 2023-11-04T01:37:21.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.969+0000 7f231a955640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231406cd20 con 0x7f231406c1d0 2023-11-04T01:37:21.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.969+0000 7f231a955640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23140cb580 con 0x7f23140b2d30 2023-11-04T01:37:21.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.969+0000 7f2313fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2314160430 0x7f23140b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51540/0 (socket says 172.21.15.114:51540) 2023-11-04T01:37:21.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.969+0000 7f2313fff640 1 -- 172.21.15.114:0/1797962782 learned_addr learned my addr 172.21.15.114:0/1797962782 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.969+0000 7f23137fe640 1 --2- 172.21.15.114:0/1797962782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23140b2d30 0x7f231406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.969+0000 7f2312ffd640 1 -- 172.21.15.114:0/1797962782 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898048152 0 0) 0x7f231406ca40 con 0x7f2314160430 2023-11-04T01:37:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.969+0000 7f2312ffd640 1 -- 172.21.15.114:0/1797962782 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22fc003520 con 0x7f2314160430 2023-11-04T01:37:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.969+0000 7f2312ffd640 1 -- 172.21.15.114:0/1797962782 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313520000 0 0) 0x7f231406cd20 con 0x7f231406c1d0 2023-11-04T01:37:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.969+0000 7f2312ffd640 1 -- 172.21.15.114:0/1797962782 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f231406ca40 con 0x7f231406c1d0 2023-11-04T01:37:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.969+0000 7f23137fe640 1 -- 172.21.15.114:0/1797962782 >> v1:172.21.15.141:6789/0 conn(0x7f231406c1d0 legacy=0x7f23140cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.969+0000 7f23137fe640 1 -- 172.21.15.114:0/1797962782 >> v1:172.21.15.114:6789/0 conn(0x7f2314160430 legacy=0x7f23140b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.969+0000 7f23137fe640 1 -- 172.21.15.114:0/1797962782 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231406d000 con 0x7f23140b2d30 2023-11-04T01:37:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.970+0000 7f23137fe640 1 --2- 172.21.15.114:0/1797962782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23140b2d30 0x7f231406bc90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23080097d0 tx=0x7f230802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7bb0a30b24a7cc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.970+0000 7f2312ffd640 1 -- 172.21.15.114:0/1797962782 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308031890 con 0x7f23140b2d30 2023-11-04T01:37:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.970+0000 7f2312ffd640 1 -- 172.21.15.114:0/1797962782 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23080319f0 con 0x7f23140b2d30 2023-11-04T01:37:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.970+0000 7f2312ffd640 1 -- 172.21.15.114:0/1797962782 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308031d60 con 0x7f23140b2d30 2023-11-04T01:37:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.971+0000 7f231a955640 1 -- 172.21.15.114:0/1797962782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23140b2d30 msgr2=0x7f231406bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.971+0000 7f231a955640 1 --2- 172.21.15.114:0/1797962782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23140b2d30 0x7f231406bc90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23080097d0 tx=0x7f230802b930 comp rx=0 tx=0).stop 2023-11-04T01:37:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.971+0000 7f231a955640 1 -- 172.21.15.114:0/1797962782 shutdown_connections 2023-11-04T01:37:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.971+0000 7f231a955640 1 --2- 172.21.15.114:0/1797962782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f23140b2d30 0x7f231406bc90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.971+0000 7f231a955640 1 -- 172.21.15.114:0/1797962782 >> 172.21.15.114:0/1797962782 conn(0x7f231406ea20 msgr2=0x7f231406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.971+0000 7f231a955640 1 -- 172.21.15.114:0/1797962782 shutdown_connections 2023-11-04T01:37:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.971+0000 7f231a955640 1 -- 172.21.15.114:0/1797962782 wait complete. 2023-11-04T01:37:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.972+0000 7f231a955640 1 Processor -- start 2023-11-04T01:37:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.972+0000 7f231a955640 1 -- start start 2023-11-04T01:37:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f231a955640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f231406c1d0 0x7f2314152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f231a955640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f23140b2d30 0x7f23140b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f231a955640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2314160430 0x7f23140b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f231a955640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23140b40c0 con 0x7f231406c1d0 2023-11-04T01:37:21.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f231a955640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23140b43a0 con 0x7f23140b2d30 2023-11-04T01:37:21.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f231a955640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23140b4680 con 0x7f2314160430 2023-11-04T01:37:21.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f2313fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f231406c1d0 0x7f2314152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f2313fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f231406c1d0 0x7f2314152050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43772/0 (socket says 172.21.15.114:43772) 2023-11-04T01:37:21.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f2313fff640 1 -- 172.21.15.114:0/3504124378 learned_addr learned my addr 172.21.15.114:0/3504124378 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:21.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f23137fe640 1 --2- 172.21.15.114:0/3504124378 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f23140b2d30 0x7f23140b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f2318ef2640 1 --2- 172.21.15.114:0/3504124378 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2314160430 0x7f23140b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f2313fff640 1 -- 172.21.15.114:0/3504124378 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2314160430 msgr2=0x7f23140b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f2313fff640 1 --2- 172.21.15.114:0/3504124378 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2314160430 0x7f23140b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f2313fff640 1 -- 172.21.15.114:0/3504124378 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f23140b2d30 msgr2=0x7f23140b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:21.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f2313fff640 1 --2- 172.21.15.114:0/3504124378 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f23140b2d30 0x7f23140b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:21.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f2313fff640 1 -- 172.21.15.114:0/3504124378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308009400 con 0x7f231406c1d0 2023-11-04T01:37:21.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f2313fff640 1 --2- 172.21.15.114:0/3504124378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f231406c1d0 0x7f2314152050 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f230400c410 tx=0x7f230400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:21.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f2310ff9640 1 -- 172.21.15.114:0/3504124378 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304005ce0 con 0x7f231406c1d0 2023-11-04T01:37:21.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f2310ff9640 1 -- 172.21.15.114:0/3504124378 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2304005e40 con 0x7f231406c1d0 2023-11-04T01:37:21.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f231a955640 1 -- 172.21.15.114:0/3504124378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23140b4960 con 0x7f231406c1d0 2023-11-04T01:37:21.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.973+0000 7f2310ff9640 1 -- 172.21.15.114:0/3504124378 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23040072d0 con 0x7f231406c1d0 2023-11-04T01:37:21.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.974+0000 7f231a955640 1 -- 172.21.15.114:0/3504124378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2314152590 con 0x7f231406c1d0 2023-11-04T01:37:21.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.974+0000 7f231a955640 1 -- 172.21.15.114:0/3504124378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23140b4e80 con 0x7f231406c1d0 2023-11-04T01:37:21.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.975+0000 7f2310ff9640 1 -- 172.21.15.114:0/3504124378 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2304007430 con 0x7f231406c1d0 2023-11-04T01:37:21.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.975+0000 7f2310ff9640 1 --2- 172.21.15.114:0/3504124378 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f230006ae70 0x7f230006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:21.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.975+0000 7f2310ff9640 1 -- 172.21.15.114:0/3504124378 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2304088e70 con 0x7f231406c1d0 2023-11-04T01:37:21.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.975+0000 7f23137fe640 1 --2- 172.21.15.114:0/3504124378 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f230006ae70 0x7f230006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:21.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.976+0000 7f23137fe640 1 --2- 172.21.15.114:0/3504124378 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f230006ae70 0x7f230006d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2308036000 tx=0x7f230803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:21.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:21.979+0000 7f2310ff9640 1 -- 172.21.15.114:0/3504124378 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f23140b4e80 con 0x7f231406c1d0 2023-11-04T01:37:22.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.142+0000 7f231a955640 1 -- 172.21.15.114:0/3504124378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f23140b4e80 con 0x7f231406c1d0 2023-11-04T01:37:22.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.142+0000 7f2310ff9640 1 -- 172.21.15.114:0/3504124378 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2304017020 con 0x7f231406c1d0 2023-11-04T01:37:22.144 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:22.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.144+0000 7f231a955640 1 -- 172.21.15.114:0/3504124378 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f230006ae70 msgr2=0x7f230006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.144+0000 7f231a955640 1 --2- 172.21.15.114:0/3504124378 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f230006ae70 0x7f230006d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2308036000 tx=0x7f230803c040 comp rx=0 tx=0).stop 2023-11-04T01:37:22.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.144+0000 7f231a955640 1 -- 172.21.15.114:0/3504124378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f231406c1d0 msgr2=0x7f2314152050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.144+0000 7f231a955640 1 --2- 172.21.15.114:0/3504124378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f231406c1d0 0x7f2314152050 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f230400c410 tx=0x7f230400c8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.144+0000 7f231a955640 1 -- 172.21.15.114:0/3504124378 shutdown_connections 2023-11-04T01:37:22.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.144+0000 7f231a955640 1 --2- 172.21.15.114:0/3504124378 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2314160430 0x7f23140b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.144+0000 7f231a955640 1 --2- 172.21.15.114:0/3504124378 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f230006ae70 0x7f230006d330 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.144+0000 7f231a955640 1 --2- 172.21.15.114:0/3504124378 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f23140b2d30 0x7f23140b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.144+0000 7f231a955640 1 --2- 172.21.15.114:0/3504124378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f231406c1d0 0x7f2314152050 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.144+0000 7f231a955640 1 -- 172.21.15.114:0/3504124378 >> 172.21.15.114:0/3504124378 conn(0x7f231406ea20 msgr2=0x7f23140b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:22.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.144+0000 7f231a955640 1 -- 172.21.15.114:0/3504124378 shutdown_connections 2023-11-04T01:37:22.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.145+0000 7f231a955640 1 -- 172.21.15.114:0/3504124378 wait complete. 2023-11-04T01:37:22.157 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:22.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.257+0000 7f7283f39640 1 Processor -- start 2023-11-04T01:37:22.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.257+0000 7f7283f39640 1 -- start start 2023-11-04T01:37:22.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.258+0000 7f7283f39640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f727c15e1c0 0x7f727c06b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.258+0000 7f7283f39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f727c0c9af0 0x7f727c070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.258+0000 7f7283f39640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727c066530 con 0x7f727c15e5a0 2023-11-04T01:37:22.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.258+0000 7f7283f39640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c15f9e0 con 0x7f727c15e1c0 2023-11-04T01:37:22.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.258+0000 7f7283f39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c06bc40 con 0x7f727c0c9af0 2023-11-04T01:37:22.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.258+0000 7f72814d4640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f727c15e5a0 0x7f727c15f2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51550/0 (socket says 172.21.15.114:51550) 2023-11-04T01:37:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.258+0000 7f72814d4640 1 -- 172.21.15.114:0/1138407311 learned_addr learned my addr 172.21.15.114:0/1138407311 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.258+0000 7f7281cd5640 1 --2- 172.21.15.114:0/1138407311 >> v2:172.21.15.141:3300/0 conn(0x7f727c15e1c0 0x7f727c06b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.258+0000 7f72824d6640 1 --2- 172.21.15.114:0/1138407311 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f727c0c9af0 0x7f727c070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.258+0000 7f7280cd3640 1 -- 172.21.15.114:0/1138407311 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342159912 0 0) 0x7f727c066530 con 0x7f727c15e5a0 2023-11-04T01:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.258+0000 7f7280cd3640 1 -- 172.21.15.114:0/1138407311 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7264003520 con 0x7f727c15e5a0 2023-11-04T01:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.258+0000 7f7281cd5640 1 -- 172.21.15.114:0/1138407311 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f727c0c9af0 msgr2=0x7f727c070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.258+0000 7f7281cd5640 1 --2- 172.21.15.114:0/1138407311 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f727c0c9af0 0x7f727c070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.258+0000 7f7281cd5640 1 -- 172.21.15.114:0/1138407311 >> v1:172.21.15.114:6789/0 conn(0x7f727c15e5a0 legacy=0x7f727c15f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.258+0000 7f7281cd5640 1 -- 172.21.15.114:0/1138407311 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c065f70 con 0x7f727c15e1c0 2023-11-04T01:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.258+0000 7f72824d6640 1 --2- 172.21.15.114:0/1138407311 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f727c0c9af0 0x7f727c070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.259+0000 7f7281cd5640 1 --2- 172.21.15.114:0/1138407311 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f727c15e1c0 0x7f727c06b700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f726c009d90 tx=0x7f726c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9413376422e89256 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.259+0000 7f7280cd3640 1 -- 172.21.15.114:0/1138407311 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c02cbc0 con 0x7f727c15e1c0 2023-11-04T01:37:22.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.259+0000 7f7280cd3640 1 -- 172.21.15.114:0/1138407311 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c02cd20 con 0x7f727c15e1c0 2023-11-04T01:37:22.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.259+0000 7f7280cd3640 1 -- 172.21.15.114:0/1138407311 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c034660 con 0x7f727c15e1c0 2023-11-04T01:37:22.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.260+0000 7f7283f39640 1 -- 172.21.15.114:0/1138407311 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f727c15e1c0 msgr2=0x7f727c06b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.260+0000 7f7283f39640 1 --2- 172.21.15.114:0/1138407311 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f727c15e1c0 0x7f727c06b700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f726c009d90 tx=0x7f726c02be10 comp rx=0 tx=0).stop 2023-11-04T01:37:22.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.260+0000 7f7283f39640 1 -- 172.21.15.114:0/1138407311 shutdown_connections 2023-11-04T01:37:22.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.260+0000 7f7283f39640 1 --2- 172.21.15.114:0/1138407311 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f727c0c9af0 0x7f727c070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.260+0000 7f7283f39640 1 --2- 172.21.15.114:0/1138407311 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f727c15e1c0 0x7f727c06b700 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.260+0000 7f7283f39640 1 -- 172.21.15.114:0/1138407311 >> 172.21.15.114:0/1138407311 conn(0x7f727c0cbc90 msgr2=0x7f727c0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:22.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.260+0000 7f7283f39640 1 -- 172.21.15.114:0/1138407311 shutdown_connections 2023-11-04T01:37:22.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.260+0000 7f7283f39640 1 -- 172.21.15.114:0/1138407311 wait complete. 2023-11-04T01:37:22.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.261+0000 7f7283f39640 1 Processor -- start 2023-11-04T01:37:22.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.261+0000 7f7283f39640 1 -- start start 2023-11-04T01:37:22.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.262+0000 7f7283f39640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c0c9af0 0x7f727c0c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.262+0000 7f7283f39640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f727c15e1c0 0x7f727c1558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.262+0000 7f7283f39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f727c15e5a0 0x7f727c1f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.262+0000 7f7283f39640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c1f0ae0 con 0x7f727c0c9af0 2023-11-04T01:37:22.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.262+0000 7f7283f39640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c1f47f0 con 0x7f727c15e1c0 2023-11-04T01:37:22.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.262+0000 7f7283f39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c1f4ad0 con 0x7f727c15e5a0 2023-11-04T01:37:22.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.262+0000 7f7281cd5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c0c9af0 0x7f727c0c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.262+0000 7f7281cd5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c0c9af0 0x7f727c0c6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43778/0 (socket says 172.21.15.114:43778) 2023-11-04T01:37:22.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.262+0000 7f7281cd5640 1 -- 172.21.15.114:0/141200676 learned_addr learned my addr 172.21.15.114:0/141200676 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:22.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.262+0000 7f72814d4640 1 --2- 172.21.15.114:0/141200676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f727c15e1c0 0x7f727c1558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.262+0000 7f72824d6640 1 --2- 172.21.15.114:0/141200676 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f727c15e5a0 0x7f727c1f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.262+0000 7f7281cd5640 1 -- 172.21.15.114:0/141200676 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f727c15e5a0 msgr2=0x7f727c1f3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.262+0000 7f7281cd5640 1 --2- 172.21.15.114:0/141200676 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f727c15e5a0 0x7f727c1f3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.262+0000 7f7281cd5640 1 -- 172.21.15.114:0/141200676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f727c15e1c0 msgr2=0x7f727c1558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.262+0000 7f7281cd5640 1 --2- 172.21.15.114:0/141200676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f727c15e1c0 0x7f727c1558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.262+0000 7f7281cd5640 1 -- 172.21.15.114:0/141200676 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7274009400 con 0x7f727c0c9af0 2023-11-04T01:37:22.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.263+0000 7f7281cd5640 1 --2- 172.21.15.114:0/141200676 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c0c9af0 0x7f727c0c6e10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f726c009eb0 tx=0x7f726c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.263+0000 7f727a7fc640 1 -- 172.21.15.114:0/141200676 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c03e610 con 0x7f727c0c9af0 2023-11-04T01:37:22.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.263+0000 7f727a7fc640 1 -- 172.21.15.114:0/141200676 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c02ce90 con 0x7f727c0c9af0 2023-11-04T01:37:22.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.263+0000 7f727a7fc640 1 -- 172.21.15.114:0/141200676 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c03e9b0 con 0x7f727c0c9af0 2023-11-04T01:37:22.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.263+0000 7f7283f39640 1 -- 172.21.15.114:0/141200676 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726c009a70 con 0x7f727c0c9af0 2023-11-04T01:37:22.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.263+0000 7f7283f39640 1 -- 172.21.15.114:0/141200676 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c1f44e0 con 0x7f727c0c9af0 2023-11-04T01:37:22.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.264+0000 7f7283f39640 1 -- 172.21.15.114:0/141200676 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727c1f0f30 con 0x7f727c0c9af0 2023-11-04T01:37:22.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.264+0000 7f727a7fc640 1 -- 172.21.15.114:0/141200676 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f726c03b050 con 0x7f727c0c9af0 2023-11-04T01:37:22.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.265+0000 7f727a7fc640 1 --2- 172.21.15.114:0/141200676 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f726806ae70 0x7f726806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.265+0000 7f727a7fc640 1 -- 172.21.15.114:0/141200676 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f726c0ab8a0 con 0x7f727c0c9af0 2023-11-04T01:37:22.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.265+0000 7f72814d4640 1 --2- 172.21.15.114:0/141200676 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f726806ae70 0x7f726806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.265+0000 7f72814d4640 1 --2- 172.21.15.114:0/141200676 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f726806ae70 0x7f726806d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f727c0b4aa0 tx=0x7f7270009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.269+0000 7f727a7fc640 1 -- 172.21.15.114:0/141200676 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f726c076640 con 0x7f727c0c9af0 2023-11-04T01:37:22.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.435+0000 7f7283f39640 1 -- 172.21.15.114:0/141200676 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f727c074290 con 0x7f727c0c9af0 2023-11-04T01:37:22.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.436+0000 7f727a7fc640 1 -- 172.21.15.114:0/141200676 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f726c009450 con 0x7f727c0c9af0 2023-11-04T01:37:22.438 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:37:22.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.437+0000 7f7283f39640 1 -- 172.21.15.114:0/141200676 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f726806ae70 msgr2=0x7f726806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.437+0000 7f7283f39640 1 --2- 172.21.15.114:0/141200676 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f726806ae70 0x7f726806d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f727c0b4aa0 tx=0x7f7270009040 comp rx=0 tx=0).stop 2023-11-04T01:37:22.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.437+0000 7f7283f39640 1 -- 172.21.15.114:0/141200676 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c0c9af0 msgr2=0x7f727c0c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.437+0000 7f7283f39640 1 --2- 172.21.15.114:0/141200676 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c0c9af0 0x7f727c0c6e10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f726c009eb0 tx=0x7f726c004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:22.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.437+0000 7f7283f39640 1 -- 172.21.15.114:0/141200676 shutdown_connections 2023-11-04T01:37:22.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.437+0000 7f7283f39640 1 --2- 172.21.15.114:0/141200676 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f727c15e5a0 0x7f727c1f3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.437+0000 7f7283f39640 1 --2- 172.21.15.114:0/141200676 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f726806ae70 0x7f726806d330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.437+0000 7f7283f39640 1 --2- 172.21.15.114:0/141200676 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f727c15e1c0 0x7f727c1558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.437+0000 7f7283f39640 1 --2- 172.21.15.114:0/141200676 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c0c9af0 0x7f727c0c6e10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.437+0000 7f7283f39640 1 -- 172.21.15.114:0/141200676 >> 172.21.15.114:0/141200676 conn(0x7f727c0cbc90 msgr2=0x7f727c0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:22.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.438+0000 7f7283f39640 1 -- 172.21.15.114:0/141200676 shutdown_connections 2023-11-04T01:37:22.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.438+0000 7f7283f39640 1 -- 172.21.15.114:0/141200676 wait complete. 2023-11-04T01:37:22.450 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:22.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.550+0000 7f17d1b76640 1 Processor -- start 2023-11-04T01:37:22.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.550+0000 7f17d1b76640 1 -- start start 2023-11-04T01:37:22.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.550+0000 7f17d1b76640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17cc153e60 0x7f17cc15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.551+0000 7f17d1b76640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17cc0cde60 con 0x7f17cc0cd6d0 2023-11-04T01:37:22.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.551+0000 7f17d1b76640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17cc160f90 con 0x7f17cc0b4880 2023-11-04T01:37:22.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.551+0000 7f17d1b76640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17cc15e400 con 0x7f17cc153e60 2023-11-04T01:37:22.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.551+0000 7f17cb7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17cc153e60 0x7f17cc15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.551+0000 7f17cb7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17cc153e60 0x7f17cc15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43788/0 (socket says 172.21.15.114:43788) 2023-11-04T01:37:22.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.551+0000 7f17cb7fe640 1 -- 172.21.15.114:0/1875336449 learned_addr learned my addr 172.21.15.114:0/1875336449 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:22.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.551+0000 7f17c3fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f17cc0cd6d0 0x7f17cc161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51558/0 (socket says 172.21.15.114:51558) 2023-11-04T01:37:22.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.551+0000 7f17cb7fe640 1 -- 172.21.15.114:0/1875336449 >> v1:172.21.15.141:6789/0 conn(0x7f17cc0b4880 legacy=0x7f17cc0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:22.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.551+0000 7f17cb7fe640 1 -- 172.21.15.114:0/1875336449 >> v1:172.21.15.114:6789/0 conn(0x7f17cc0cd6d0 legacy=0x7f17cc161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.551+0000 7f17cb7fe640 1 -- 172.21.15.114:0/1875336449 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc0ce090 con 0x7f17cc153e60 2023-11-04T01:37:22.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.551+0000 7f17caffd640 1 -- 172.21.15.114:0/1875336449 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633970193 0 0) 0x7f17cc0cde60 con 0x7f17cc0cd6d0 2023-11-04T01:37:22.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.552+0000 7f17cb7fe640 1 --2- 172.21.15.114:0/1875336449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc153e60 0x7f17cc15dec0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009870 tx=0x7f17bc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281f2cb40ce3b47c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.552+0000 7f17caffd640 1 -- 172.21.15.114:0/1875336449 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc030860 con 0x7f17cc153e60 2023-11-04T01:37:22.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.552+0000 7f17caffd640 1 -- 172.21.15.114:0/1875336449 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc0309c0 con 0x7f17cc153e60 2023-11-04T01:37:22.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.552+0000 7f17caffd640 1 -- 172.21.15.114:0/1875336449 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc030d50 con 0x7f17cc153e60 2023-11-04T01:37:22.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.552+0000 7f17d1b76640 1 -- 172.21.15.114:0/1875336449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc153e60 msgr2=0x7f17cc15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.552+0000 7f17d1b76640 1 --2- 172.21.15.114:0/1875336449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc153e60 0x7f17cc15dec0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009870 tx=0x7f17bc02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.552+0000 7f17d1b76640 1 -- 172.21.15.114:0/1875336449 shutdown_connections 2023-11-04T01:37:22.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.552+0000 7f17d1b76640 1 --2- 172.21.15.114:0/1875336449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc153e60 0x7f17cc15dec0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.552+0000 7f17d1b76640 1 -- 172.21.15.114:0/1875336449 >> 172.21.15.114:0/1875336449 conn(0x7f17cc0cf880 msgr2=0x7f17cc0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:22.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.552+0000 7f17d1b76640 1 -- 172.21.15.114:0/1875336449 shutdown_connections 2023-11-04T01:37:22.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.553+0000 7f17d1b76640 1 -- 172.21.15.114:0/1875336449 wait complete. 2023-11-04T01:37:22.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.554+0000 7f17d1b76640 1 Processor -- start 2023-11-04T01:37:22.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.554+0000 7f17d1b76640 1 -- start start 2023-11-04T01:37:22.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.554+0000 7f17d1b76640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17cc0b4880 0x7f17cc0c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.554+0000 7f17d1b76640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0cd6d0 0x7f17cc0b7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.554+0000 7f17d1b76640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17cc153e60 0x7f17cc151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.554+0000 7f17d1b76640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0c6790 con 0x7f17cc0cd6d0 2023-11-04T01:37:22.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.554+0000 7f17d1b76640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0c6560 con 0x7f17cc153e60 2023-11-04T01:37:22.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.554+0000 7f17d1b76640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc1e9480 con 0x7f17cc0b4880 2023-11-04T01:37:22.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.554+0000 7f17c3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0cd6d0 0x7f17cc0b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.555+0000 7f17c3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0cd6d0 0x7f17cc0b7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43804/0 (socket says 172.21.15.114:43804) 2023-11-04T01:37:22.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.555+0000 7f17c3fff640 1 -- 172.21.15.114:0/2656657538 learned_addr learned my addr 172.21.15.114:0/2656657538 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:22.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.555+0000 7f17cbfff640 1 --2- 172.21.15.114:0/2656657538 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17cc153e60 0x7f17cc151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.555+0000 7f17cb7fe640 1 --2- 172.21.15.114:0/2656657538 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17cc0b4880 0x7f17cc0c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.555+0000 7f17c3fff640 1 -- 172.21.15.114:0/2656657538 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17cc0b4880 msgr2=0x7f17cc0c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.555+0000 7f17c3fff640 1 --2- 172.21.15.114:0/2656657538 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17cc0b4880 0x7f17cc0c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.555+0000 7f17c3fff640 1 -- 172.21.15.114:0/2656657538 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17cc153e60 msgr2=0x7f17cc151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.555+0000 7f17c3fff640 1 --2- 172.21.15.114:0/2656657538 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17cc153e60 0x7f17cc151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.555+0000 7f17c3fff640 1 -- 172.21.15.114:0/2656657538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc0094d0 con 0x7f17cc0cd6d0 2023-11-04T01:37:22.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.555+0000 7f17cbfff640 1 --2- 172.21.15.114:0/2656657538 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17cc153e60 0x7f17cc151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:22.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.555+0000 7f17c3fff640 1 --2- 172.21.15.114:0/2656657538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0cd6d0 0x7f17cc0b7570 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f17b400c4b0 tx=0x7f17b400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.555+0000 7f17c8ff9640 1 -- 172.21.15.114:0/2656657538 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b40074e0 con 0x7f17cc0cd6d0 2023-11-04T01:37:22.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.555+0000 7f17c8ff9640 1 -- 172.21.15.114:0/2656657538 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b4007660 con 0x7f17cc0cd6d0 2023-11-04T01:37:22.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.555+0000 7f17c8ff9640 1 -- 172.21.15.114:0/2656657538 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4004a20 con 0x7f17cc0cd6d0 2023-11-04T01:37:22.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.555+0000 7f17d1b76640 1 -- 172.21.15.114:0/2656657538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc1e8b50 con 0x7f17cc0cd6d0 2023-11-04T01:37:22.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.555+0000 7f17d1b76640 1 -- 172.21.15.114:0/2656657538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc1e9110 con 0x7f17cc0cd6d0 2023-11-04T01:37:22.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.556+0000 7f17d1b76640 1 -- 172.21.15.114:0/2656657538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17cc1e9630 con 0x7f17cc0cd6d0 2023-11-04T01:37:22.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.556+0000 7f17c8ff9640 1 -- 172.21.15.114:0/2656657538 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17b4004b80 con 0x7f17cc0cd6d0 2023-11-04T01:37:22.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.557+0000 7f17c8ff9640 1 --2- 172.21.15.114:0/2656657538 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f17ac06ae70 0x7f17ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.557+0000 7f17c8ff9640 1 -- 172.21.15.114:0/2656657538 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f17b4088a80 con 0x7f17cc0cd6d0 2023-11-04T01:37:22.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.557+0000 7f17cb7fe640 1 --2- 172.21.15.114:0/2656657538 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f17ac06ae70 0x7f17ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.557+0000 7f17cb7fe640 1 --2- 172.21.15.114:0/2656657538 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f17ac06ae70 0x7f17ac06d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f17bc036000 tx=0x7f17bc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.561+0000 7f17c8ff9640 1 -- 172.21.15.114:0/2656657538 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f17cc1e9630 con 0x7f17cc0cd6d0 2023-11-04T01:37:22.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.727+0000 7f17d1b76640 1 -- 172.21.15.114:0/2656657538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f17cc1e95f0 con 0x7f17cc0cd6d0 2023-11-04T01:37:22.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.728+0000 7f17c8ff9640 1 -- 172.21.15.114:0/2656657538 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f17b4018020 con 0x7f17cc0cd6d0 2023-11-04T01:37:22.730 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.730+0000 7f17d1b76640 1 -- 172.21.15.114:0/2656657538 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f17ac06ae70 msgr2=0x7f17ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.730+0000 7f17d1b76640 1 --2- 172.21.15.114:0/2656657538 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f17ac06ae70 0x7f17ac06d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f17bc036000 tx=0x7f17bc008030 comp rx=0 tx=0).stop 2023-11-04T01:37:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.730+0000 7f17d1b76640 1 -- 172.21.15.114:0/2656657538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0cd6d0 msgr2=0x7f17cc0b7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.730+0000 7f17d1b76640 1 --2- 172.21.15.114:0/2656657538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0cd6d0 0x7f17cc0b7570 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f17b400c4b0 tx=0x7f17b400c970 comp rx=0 tx=0).stop 2023-11-04T01:37:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.730+0000 7f17d1b76640 1 -- 172.21.15.114:0/2656657538 shutdown_connections 2023-11-04T01:37:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.730+0000 7f17d1b76640 1 --2- 172.21.15.114:0/2656657538 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f17ac06ae70 0x7f17ac06d330 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.730+0000 7f17d1b76640 1 --2- 172.21.15.114:0/2656657538 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17cc153e60 0x7f17cc151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.730+0000 7f17d1b76640 1 --2- 172.21.15.114:0/2656657538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17cc0cd6d0 0x7f17cc0b7570 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.730+0000 7f17d1b76640 1 --2- 172.21.15.114:0/2656657538 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17cc0b4880 0x7f17cc0c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.730+0000 7f17d1b76640 1 -- 172.21.15.114:0/2656657538 >> 172.21.15.114:0/2656657538 conn(0x7f17cc0cf880 msgr2=0x7f17cc0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.730+0000 7f17d1b76640 1 -- 172.21.15.114:0/2656657538 shutdown_connections 2023-11-04T01:37:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.730+0000 7f17d1b76640 1 -- 172.21.15.114:0/2656657538 wait complete. 2023-11-04T01:37:22.743 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:37:22.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.842+0000 7f71bb864640 1 Processor -- start 2023-11-04T01:37:22.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.842+0000 7f71bb864640 1 -- start start 2023-11-04T01:37:22.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.843+0000 7f71bb864640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f71b4159c00 0x7f71b40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.843+0000 7f71bb864640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b40ae1d0 0x7f71b40c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.843+0000 7f71bb864640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b415aff0 con 0x7f71b40c48e0 2023-11-04T01:37:22.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.843+0000 7f71bb864640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b40c52d0 con 0x7f71b4159c00 2023-11-04T01:37:22.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.843+0000 7f71bb864640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b415a3e0 con 0x7f71b40ae1d0 2023-11-04T01:37:22.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.843+0000 7f71b9600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f71b4159c00 0x7f71b40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.843+0000 7f71b9600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f71b4159c00 0x7f71b40cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43808/0 (socket says 172.21.15.114:43808) 2023-11-04T01:37:22.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.843+0000 7f71b9600640 1 -- 172.21.15.114:0/2910175079 learned_addr learned my addr 172.21.15.114:0/2910175079 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:22.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.844+0000 7f71b9e01640 1 --2- 172.21.15.114:0/2910175079 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b40ae1d0 0x7f71b40c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.844+0000 7f71b9600640 1 -- 172.21.15.114:0/2910175079 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b40ae1d0 msgr2=0x7f71b40c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:22.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.844+0000 7f71b9600640 1 --2- 172.21.15.114:0/2910175079 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b40ae1d0 0x7f71b40c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.844+0000 7f71b9600640 1 -- 172.21.15.114:0/2910175079 >> v1:172.21.15.141:6789/0 conn(0x7f71b40c48e0 legacy=0x7f71b40adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.844+0000 7f71b9600640 1 -- 172.21.15.114:0/2910175079 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b415a6c0 con 0x7f71b4159c00 2023-11-04T01:37:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.844+0000 7f71b9600640 1 --2- 172.21.15.114:0/2910175079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b4159c00 0x7f71b40cc890 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009e50 tx=0x7f71b002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72166a927305831e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.845+0000 7f71abfff640 1 -- 172.21.15.114:0/2910175079 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b002ca70 con 0x7f71b4159c00 2023-11-04T01:37:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.845+0000 7f71abfff640 1 -- 172.21.15.114:0/2910175079 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b002cbd0 con 0x7f71b4159c00 2023-11-04T01:37:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.845+0000 7f71abfff640 1 -- 172.21.15.114:0/2910175079 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00343f0 con 0x7f71b4159c00 2023-11-04T01:37:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.845+0000 7f71bb864640 1 -- 172.21.15.114:0/2910175079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b4159c00 msgr2=0x7f71b40cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.845+0000 7f71bb864640 1 --2- 172.21.15.114:0/2910175079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b4159c00 0x7f71b40cc890 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009e50 tx=0x7f71b002bed0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.845+0000 7f71bb864640 1 -- 172.21.15.114:0/2910175079 shutdown_connections 2023-11-04T01:37:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.845+0000 7f71bb864640 1 --2- 172.21.15.114:0/2910175079 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b40ae1d0 0x7f71b40c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.845+0000 7f71bb864640 1 --2- 172.21.15.114:0/2910175079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b4159c00 0x7f71b40cc890 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.845+0000 7f71bb864640 1 -- 172.21.15.114:0/2910175079 >> 172.21.15.114:0/2910175079 conn(0x7f71b40ce950 msgr2=0x7f71b40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:22.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.845+0000 7f71bb864640 1 -- 172.21.15.114:0/2910175079 shutdown_connections 2023-11-04T01:37:22.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.845+0000 7f71bb864640 1 -- 172.21.15.114:0/2910175079 wait complete. 2023-11-04T01:37:22.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.846+0000 7f71bb864640 1 Processor -- start 2023-11-04T01:37:22.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.846+0000 7f71bb864640 1 -- start start 2023-11-04T01:37:22.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.847+0000 7f71bb864640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b40ae1d0 0x7f71b4156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.847+0000 7f71bb864640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71b40c48e0 0x7f71b4158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.847+0000 7f71bb864640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b4159c00 0x7f71b414b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.847+0000 7f71bb864640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40c7480 con 0x7f71b4159c00 2023-11-04T01:37:22.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.847+0000 7f71bb864640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b4155c90 con 0x7f71b40c48e0 2023-11-04T01:37:22.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.847+0000 7f71bb864640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40c7690 con 0x7f71b40ae1d0 2023-11-04T01:37:22.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.847+0000 7f71b9e01640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b4159c00 0x7f71b414b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.847+0000 7f71b9e01640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b4159c00 0x7f71b414b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43816/0 (socket says 172.21.15.114:43816) 2023-11-04T01:37:22.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.847+0000 7f71b9e01640 1 -- 172.21.15.114:0/4128567427 learned_addr learned my addr 172.21.15.114:0/4128567427 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:22.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.847+0000 7f71b8dff640 1 --2- 172.21.15.114:0/4128567427 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71b40c48e0 0x7f71b4158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.847+0000 7f71b9600640 1 --2- 172.21.15.114:0/4128567427 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b40ae1d0 0x7f71b4156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.847+0000 7f71b9e01640 1 -- 172.21.15.114:0/4128567427 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b40ae1d0 msgr2=0x7f71b4156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.847+0000 7f71b9e01640 1 --2- 172.21.15.114:0/4128567427 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b40ae1d0 0x7f71b4156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.848+0000 7f71b9e01640 1 -- 172.21.15.114:0/4128567427 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71b40c48e0 msgr2=0x7f71b4158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.848+0000 7f71b9e01640 1 --2- 172.21.15.114:0/4128567427 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71b40c48e0 0x7f71b4158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.848+0000 7f71b9e01640 1 -- 172.21.15.114:0/4128567427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b0009b30 con 0x7f71b4159c00 2023-11-04T01:37:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.848+0000 7f71b8dff640 1 --2- 172.21.15.114:0/4128567427 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71b40c48e0 0x7f71b4158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.848+0000 7f71b9e01640 1 --2- 172.21.15.114:0/4128567427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b4159c00 0x7f71b414b080 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00d800 tx=0x7f71ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.848+0000 7f71a9ffb640 1 -- 172.21.15.114:0/4128567427 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00b6c0 con 0x7f71b4159c00 2023-11-04T01:37:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.848+0000 7f71a9ffb640 1 -- 172.21.15.114:0/4128567427 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac00b840 con 0x7f71b4159c00 2023-11-04T01:37:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.848+0000 7f71bb864640 1 -- 172.21.15.114:0/4128567427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b40c7970 con 0x7f71b4159c00 2023-11-04T01:37:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.848+0000 7f71a9ffb640 1 -- 172.21.15.114:0/4128567427 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00bbf0 con 0x7f71b4159c00 2023-11-04T01:37:22.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.848+0000 7f71bb864640 1 -- 172.21.15.114:0/4128567427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b4156660 con 0x7f71b4159c00 2023-11-04T01:37:22.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.849+0000 7f71bb864640 1 -- 172.21.15.114:0/4128567427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b40c7e90 con 0x7f71b4159c00 2023-11-04T01:37:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.849+0000 7f71a9ffb640 1 -- 172.21.15.114:0/4128567427 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71ac00bd50 con 0x7f71b4159c00 2023-11-04T01:37:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.849+0000 7f71a9ffb640 1 --2- 172.21.15.114:0/4128567427 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f719806ae70 0x7f719806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.850+0000 7f71a9ffb640 1 -- 172.21.15.114:0/4128567427 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f71ac089ed0 con 0x7f71b4159c00 2023-11-04T01:37:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.850+0000 7f71b9600640 1 --2- 172.21.15.114:0/4128567427 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f719806ae70 0x7f719806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.850+0000 7f71b9600640 1 --2- 172.21.15.114:0/4128567427 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f719806ae70 0x7f719806d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f71b0035000 tx=0x7f71b0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:22.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:22.854+0000 7f71a9ffb640 1 -- 172.21.15.114:0/4128567427 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f71b40c7e90 con 0x7f71b4159c00 2023-11-04T01:37:23.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.032+0000 7f71bb864640 1 -- 172.21.15.114:0/4128567427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f71b40c7e90 con 0x7f71b4159c00 2023-11-04T01:37:23.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.032+0000 7f71a9ffb640 1 -- 172.21.15.114:0/4128567427 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f71b40c7e90 con 0x7f71b4159c00 2023-11-04T01:37:23.034 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-11-04T01:37:23.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.034+0000 7f71bb864640 1 -- 172.21.15.114:0/4128567427 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f719806ae70 msgr2=0x7f719806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.034+0000 7f71bb864640 1 --2- 172.21.15.114:0/4128567427 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f719806ae70 0x7f719806d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f71b0035000 tx=0x7f71b0030000 comp rx=0 tx=0).stop 2023-11-04T01:37:23.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.034+0000 7f71bb864640 1 -- 172.21.15.114:0/4128567427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b4159c00 msgr2=0x7f71b414b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.034+0000 7f71bb864640 1 --2- 172.21.15.114:0/4128567427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b4159c00 0x7f71b414b080 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00d800 tx=0x7f71ac00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.034+0000 7f71bb864640 1 -- 172.21.15.114:0/4128567427 shutdown_connections 2023-11-04T01:37:23.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.034+0000 7f71bb864640 1 --2- 172.21.15.114:0/4128567427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b4159c00 0x7f71b414b080 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.034+0000 7f71bb864640 1 --2- 172.21.15.114:0/4128567427 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f719806ae70 0x7f719806d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.034+0000 7f71bb864640 1 --2- 172.21.15.114:0/4128567427 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71b40c48e0 0x7f71b4158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.034+0000 7f71bb864640 1 --2- 172.21.15.114:0/4128567427 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71b40ae1d0 0x7f71b4156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.034+0000 7f71bb864640 1 -- 172.21.15.114:0/4128567427 >> 172.21.15.114:0/4128567427 conn(0x7f71b40ce950 msgr2=0x7f71b40ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:23.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.034+0000 7f71bb864640 1 -- 172.21.15.114:0/4128567427 shutdown_connections 2023-11-04T01:37:23.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.034+0000 7f71bb864640 1 -- 172.21.15.114:0/4128567427 wait complete. 2023-11-04T01:37:23.047 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:37:23.047 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:23.063 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:23.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.200+0000 7f6981890640 1 Processor -- start 2023-11-04T01:37:23.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.200+0000 7f6981890640 1 -- start start 2023-11-04T01:37:23.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.201+0000 7f6981890640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f697c15ab70 0x7f697c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.201+0000 7f6981890640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697c06d310 con 0x7f697c06a830 2023-11-04T01:37:23.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.201+0000 7f6981890640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697c15d860 con 0x7f697c06eba0 2023-11-04T01:37:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.201+0000 7f6981890640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c0cba70 con 0x7f697c15ab70 2023-11-04T01:37:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.201+0000 7f697affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f697c15ab70 0x7f697c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.201+0000 7f697affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f697c15ab70 0x7f697c0cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43818/0 (socket says 172.21.15.114:43818) 2023-11-04T01:37:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.201+0000 7f697b7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f697c06a830 0x7f697c0ae5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51574/0 (socket says 172.21.15.114:51574) 2023-11-04T01:37:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.201+0000 7f697affd640 1 -- 172.21.15.114:0/372385024 learned_addr learned my addr 172.21.15.114:0/372385024 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.201+0000 7f697affd640 1 -- 172.21.15.114:0/372385024 >> v1:172.21.15.141:6789/0 conn(0x7f697c06eba0 legacy=0x7f697c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.201+0000 7f697affd640 1 -- 172.21.15.114:0/372385024 >> v1:172.21.15.114:6789/0 conn(0x7f697c06a830 legacy=0x7f697c0ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.201+0000 7f697affd640 1 -- 172.21.15.114:0/372385024 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c15db40 con 0x7f697c15ab70 2023-11-04T01:37:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.201+0000 7f6979ffb640 1 -- 172.21.15.114:0/372385024 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022333172 0 0) 0x7f697c06d310 con 0x7f697c06a830 2023-11-04T01:37:23.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.202+0000 7f697affd640 1 --2- 172.21.15.114:0/372385024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f697c15ab70 0x7f697c0cbea0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f696c009ea0 tx=0x7f696c02bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1fc2652daa396b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.202+0000 7f6979ffb640 1 -- 172.21.15.114:0/372385024 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c02cb60 con 0x7f697c15ab70 2023-11-04T01:37:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.202+0000 7f6979ffb640 1 -- 172.21.15.114:0/372385024 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c02ccc0 con 0x7f697c15ab70 2023-11-04T01:37:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.202+0000 7f6979ffb640 1 -- 172.21.15.114:0/372385024 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c034610 con 0x7f697c15ab70 2023-11-04T01:37:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.203+0000 7f6981890640 1 -- 172.21.15.114:0/372385024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f697c15ab70 msgr2=0x7f697c0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.203+0000 7f6981890640 1 --2- 172.21.15.114:0/372385024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f697c15ab70 0x7f697c0cbea0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f696c009ea0 tx=0x7f696c02bfc0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.203+0000 7f6981890640 1 -- 172.21.15.114:0/372385024 shutdown_connections 2023-11-04T01:37:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.203+0000 7f6981890640 1 --2- 172.21.15.114:0/372385024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f697c15ab70 0x7f697c0cbea0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.203+0000 7f6981890640 1 -- 172.21.15.114:0/372385024 >> 172.21.15.114:0/372385024 conn(0x7f697c098d40 msgr2=0x7f697c0cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.203+0000 7f6981890640 1 -- 172.21.15.114:0/372385024 shutdown_connections 2023-11-04T01:37:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.203+0000 7f6981890640 1 -- 172.21.15.114:0/372385024 wait complete. 2023-11-04T01:37:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.204+0000 7f6981890640 1 Processor -- start 2023-11-04T01:37:23.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.204+0000 7f6981890640 1 -- start start 2023-11-04T01:37:23.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.205+0000 7f6981890640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f697c06a830 0x7f697c1f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.205+0000 7f6981890640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f697c06eba0 0x7f697c0c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.205+0000 7f6981890640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f697c15ab70 0x7f697c0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.205+0000 7f6981890640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c161c50 con 0x7f697c06a830 2023-11-04T01:37:23.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.205+0000 7f6981890640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c1f39f0 con 0x7f697c06eba0 2023-11-04T01:37:23.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.205+0000 7f6981890640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c1f2de0 con 0x7f697c15ab70 2023-11-04T01:37:23.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.205+0000 7f697affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f697c06a830 0x7f697c1f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.205+0000 7f697affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f697c06a830 0x7f697c1f67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43824/0 (socket says 172.21.15.114:43824) 2023-11-04T01:37:23.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.205+0000 7f697affd640 1 -- 172.21.15.114:0/562852394 learned_addr learned my addr 172.21.15.114:0/562852394 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:23.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.205+0000 7f697affd640 1 -- 172.21.15.114:0/562852394 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f697c15ab70 msgr2=0x7f697c0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.205+0000 7f697affd640 1 --2- 172.21.15.114:0/562852394 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f697c15ab70 0x7f697c0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.205+0000 7f697affd640 1 -- 172.21.15.114:0/562852394 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f697c06eba0 msgr2=0x7f697c0c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.205+0000 7f697affd640 1 --2- 172.21.15.114:0/562852394 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f697c06eba0 0x7f697c0c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.205+0000 7f697affd640 1 -- 172.21.15.114:0/562852394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c009b30 con 0x7f697c06a830 2023-11-04T01:37:23.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.205+0000 7f697affd640 1 --2- 172.21.15.114:0/562852394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f697c06a830 0x7f697c1f67e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f696c036040 tx=0x7f696c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.206+0000 7f6963fff640 1 -- 172.21.15.114:0/562852394 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c03e450 con 0x7f697c06a830 2023-11-04T01:37:23.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.206+0000 7f6963fff640 1 -- 172.21.15.114:0/562852394 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c03e5f0 con 0x7f697c06a830 2023-11-04T01:37:23.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.206+0000 7f6981890640 1 -- 172.21.15.114:0/562852394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697c1f30c0 con 0x7f697c06a830 2023-11-04T01:37:23.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.206+0000 7f6963fff640 1 -- 172.21.15.114:0/562852394 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c03e9a0 con 0x7f697c06a830 2023-11-04T01:37:23.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.206+0000 7f6981890640 1 -- 172.21.15.114:0/562852394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697c1f3680 con 0x7f697c06a830 2023-11-04T01:37:23.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.207+0000 7f6981890640 1 -- 172.21.15.114:0/562852394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697c074290 con 0x7f697c06a830 2023-11-04T01:37:23.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.207+0000 7f6963fff640 1 -- 172.21.15.114:0/562852394 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f696c03eb00 con 0x7f697c06a830 2023-11-04T01:37:23.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.207+0000 7f6963fff640 1 --2- 172.21.15.114:0/562852394 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f696806ae70 0x7f696806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.207+0000 7f6963fff640 1 -- 172.21.15.114:0/562852394 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f696c0ac870 con 0x7f697c06a830 2023-11-04T01:37:23.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.207+0000 7f697a7fc640 1 --2- 172.21.15.114:0/562852394 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f696806ae70 0x7f696806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.208+0000 7f697a7fc640 1 --2- 172.21.15.114:0/562852394 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f696806ae70 0x7f696806d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f697c0c3400 tx=0x7f6970007930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.212+0000 7f6963fff640 1 -- 172.21.15.114:0/562852394 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f696c0777c0 con 0x7f697c06a830 2023-11-04T01:37:23.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.379+0000 7f6981890640 1 -- 172.21.15.114:0/562852394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f697c06ae70 con 0x7f697c06a830 2023-11-04T01:37:23.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.380+0000 7f6963fff640 1 -- 172.21.15.114:0/562852394 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18796 (secure 0 0 0) 0x7f696c03edb0 con 0x7f697c06a830 2023-11-04T01:37:23.382 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:23.382 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:11.562429+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.382+0000 7f6981890640 1 -- 172.21.15.114:0/562852394 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f696806ae70 msgr2=0x7f696806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.382+0000 7f6981890640 1 --2- 172.21.15.114:0/562852394 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f696806ae70 0x7f696806d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f697c0c3400 tx=0x7f6970007930 comp rx=0 tx=0).stop 2023-11-04T01:37:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.382+0000 7f6981890640 1 -- 172.21.15.114:0/562852394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f697c06a830 msgr2=0x7f697c1f67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.382+0000 7f6981890640 1 --2- 172.21.15.114:0/562852394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f697c06a830 0x7f697c1f67e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f696c036040 tx=0x7f696c004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.382+0000 7f6981890640 1 -- 172.21.15.114:0/562852394 shutdown_connections 2023-11-04T01:37:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.382+0000 7f6981890640 1 --2- 172.21.15.114:0/562852394 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f697c15ab70 0x7f697c0cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.382+0000 7f6981890640 1 --2- 172.21.15.114:0/562852394 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f696806ae70 0x7f696806d330 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.382+0000 7f6981890640 1 --2- 172.21.15.114:0/562852394 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f697c06eba0 0x7f697c0c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.382+0000 7f6981890640 1 --2- 172.21.15.114:0/562852394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f697c06a830 0x7f697c1f67e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.382+0000 7f6981890640 1 -- 172.21.15.114:0/562852394 >> 172.21.15.114:0/562852394 conn(0x7f697c098d40 msgr2=0x7f697c159730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:23.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.382+0000 7f6981890640 1 -- 172.21.15.114:0/562852394 shutdown_connections 2023-11-04T01:37:23.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.382+0000 7f6981890640 1 -- 172.21.15.114:0/562852394 wait complete. 2023-11-04T01:37:23.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:23.395 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:23.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.496+0000 7fc914178640 1 Processor -- start 2023-11-04T01:37:23.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.496+0000 7fc914178640 1 -- start start 2023-11-04T01:37:23.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.497+0000 7fc914178640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc90c15d1b0 0x7fc90c0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.497+0000 7fc914178640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc90c066000 0x7fc90c06a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.497+0000 7fc914178640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90c0c9bf0 con 0x7fc90c070ff0 2023-11-04T01:37:23.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.497+0000 7fc914178640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90c0cd890 con 0x7fc90c066000 2023-11-04T01:37:23.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.497+0000 7fc914178640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90c0cdb30 con 0x7fc90c15d1b0 2023-11-04T01:37:23.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.497+0000 7fc912715640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc90c066000 0x7fc90c06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.497+0000 7fc911f14640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc90c070ff0 0x7fc90c0713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51586/0 (socket says 172.21.15.114:51586) 2023-11-04T01:37:23.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.498+0000 7fc911f14640 1 -- 172.21.15.114:0/680514866 learned_addr learned my addr 172.21.15.114:0/680514866 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:23.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.498+0000 7fc911713640 1 --2- 172.21.15.114:0/680514866 >> v2:172.21.15.141:3300/0 conn(0x7fc90c15d1b0 0x7fc90c0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.498+0000 7fc912715640 1 -- 172.21.15.114:0/680514866 >> v2:172.21.15.141:3300/0 conn(0x7fc90c15d1b0 msgr2=0x7fc90c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:23.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.498+0000 7fc910f12640 1 -- 172.21.15.114:0/680514866 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787390790 0 0) 0x7fc90c0c9bf0 con 0x7fc90c070ff0 2023-11-04T01:37:23.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.498+0000 7fc912715640 1 --2- 172.21.15.114:0/680514866 >> v2:172.21.15.141:3300/0 conn(0x7fc90c15d1b0 0x7fc90c0cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.498+0000 7fc912715640 1 -- 172.21.15.114:0/680514866 >> v1:172.21.15.114:6789/0 conn(0x7fc90c070ff0 legacy=0x7fc90c0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.498+0000 7fc912715640 1 -- 172.21.15.114:0/680514866 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c0cde10 con 0x7fc90c066000 2023-11-04T01:37:23.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.498+0000 7fc911713640 1 --2- 172.21.15.114:0/680514866 >> v2:172.21.15.141:3300/0 conn(0x7fc90c15d1b0 0x7fc90c0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:23.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.499+0000 7fc912715640 1 --2- 172.21.15.114:0/680514866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc90c066000 0x7fc90c06a500 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc90c161b90 tx=0x7fc90402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3f471661aed372 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.499+0000 7fc910f12640 1 -- 172.21.15.114:0/680514866 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904031830 con 0x7fc90c066000 2023-11-04T01:37:23.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.499+0000 7fc910f12640 1 -- 172.21.15.114:0/680514866 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc904031990 con 0x7fc90c066000 2023-11-04T01:37:23.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.499+0000 7fc910f12640 1 -- 172.21.15.114:0/680514866 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904031d20 con 0x7fc90c066000 2023-11-04T01:37:23.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.499+0000 7fc914178640 1 -- 172.21.15.114:0/680514866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc90c066000 msgr2=0x7fc90c06a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.499+0000 7fc914178640 1 --2- 172.21.15.114:0/680514866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc90c066000 0x7fc90c06a500 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc90c161b90 tx=0x7fc90402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.499+0000 7fc914178640 1 -- 172.21.15.114:0/680514866 shutdown_connections 2023-11-04T01:37:23.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.499+0000 7fc914178640 1 --2- 172.21.15.114:0/680514866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc90c066000 0x7fc90c06a500 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.499+0000 7fc914178640 1 --2- 172.21.15.114:0/680514866 >> v2:172.21.15.141:3300/0 conn(0x7fc90c15d1b0 0x7fc90c0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.499+0000 7fc914178640 1 -- 172.21.15.114:0/680514866 >> 172.21.15.114:0/680514866 conn(0x7fc90c0cbc90 msgr2=0x7fc90c0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:23.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.499+0000 7fc914178640 1 -- 172.21.15.114:0/680514866 shutdown_connections 2023-11-04T01:37:23.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.499+0000 7fc914178640 1 -- 172.21.15.114:0/680514866 wait complete. 2023-11-04T01:37:23.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.500+0000 7fc914178640 1 Processor -- start 2023-11-04T01:37:23.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.500+0000 7fc914178640 1 -- start start 2023-11-04T01:37:23.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.501+0000 7fc914178640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc90c066000 0x7fc90c149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.501+0000 7fc914178640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc90c070ff0 0x7fc90c0b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.501+0000 7fc914178640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc90c15d1b0 0x7fc90c06a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.501+0000 7fc914178640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c14af50 con 0x7fc90c066000 2023-11-04T01:37:23.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.501+0000 7fc914178640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c149b70 con 0x7fc90c070ff0 2023-11-04T01:37:23.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.501+0000 7fc914178640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0b20b0 con 0x7fc90c15d1b0 2023-11-04T01:37:23.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.501+0000 7fc911f14640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc90c066000 0x7fc90c149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.501+0000 7fc911f14640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc90c066000 0x7fc90c149630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43836/0 (socket says 172.21.15.114:43836) 2023-11-04T01:37:23.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.501+0000 7fc911f14640 1 -- 172.21.15.114:0/1631165607 learned_addr learned my addr 172.21.15.114:0/1631165607 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:23.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.501+0000 7fc912715640 1 --2- 172.21.15.114:0/1631165607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc90c15d1b0 0x7fc90c06a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.501+0000 7fc911713640 1 --2- 172.21.15.114:0/1631165607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc90c070ff0 0x7fc90c0b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.502+0000 7fc911f14640 1 -- 172.21.15.114:0/1631165607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc90c15d1b0 msgr2=0x7fc90c06a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.502+0000 7fc911f14640 1 --2- 172.21.15.114:0/1631165607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc90c15d1b0 0x7fc90c06a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.502+0000 7fc911f14640 1 -- 172.21.15.114:0/1631165607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc90c070ff0 msgr2=0x7fc90c0b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.502+0000 7fc911f14640 1 --2- 172.21.15.114:0/1631165607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc90c070ff0 0x7fc90c0b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.502+0000 7fc911f14640 1 -- 172.21.15.114:0/1631165607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc904009400 con 0x7fc90c066000 2023-11-04T01:37:23.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.502+0000 7fc912715640 1 --2- 172.21.15.114:0/1631165607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc90c15d1b0 0x7fc90c06a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:23.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.502+0000 7fc911713640 1 --2- 172.21.15.114:0/1631165607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc90c070ff0 0x7fc90c0b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:23.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.502+0000 7fc911f14640 1 --2- 172.21.15.114:0/1631165607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc90c066000 0x7fc90c149630 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc90800c890 tx=0x7fc90800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.502+0000 7fc9027fc640 1 -- 172.21.15.114:0/1631165607 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90800a640 con 0x7fc90c066000 2023-11-04T01:37:23.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.502+0000 7fc9027fc640 1 -- 172.21.15.114:0/1631165607 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90800a7c0 con 0x7fc90c066000 2023-11-04T01:37:23.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.502+0000 7fc914178640 1 -- 172.21.15.114:0/1631165607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90c14a340 con 0x7fc90c066000 2023-11-04T01:37:23.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.502+0000 7fc9027fc640 1 -- 172.21.15.114:0/1631165607 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90800ab70 con 0x7fc90c066000 2023-11-04T01:37:23.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.502+0000 7fc914178640 1 -- 172.21.15.114:0/1631165607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc90c14a900 con 0x7fc90c066000 2023-11-04T01:37:23.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.503+0000 7fc914178640 1 -- 172.21.15.114:0/1631165607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90c074290 con 0x7fc90c066000 2023-11-04T01:37:23.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.503+0000 7fc9027fc640 1 -- 172.21.15.114:0/1631165607 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc90800acd0 con 0x7fc90c066000 2023-11-04T01:37:23.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.503+0000 7fc9027fc640 1 --2- 172.21.15.114:0/1631165607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8f006ae70 0x7fc8f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.504+0000 7fc9027fc640 1 -- 172.21.15.114:0/1631165607 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc908089300 con 0x7fc90c066000 2023-11-04T01:37:23.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.504+0000 7fc911713640 1 --2- 172.21.15.114:0/1631165607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8f006ae70 0x7fc8f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.504+0000 7fc911713640 1 --2- 172.21.15.114:0/1631165607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8f006ae70 0x7fc8f006d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc006fd0 tx=0x7fc8fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.508+0000 7fc9027fc640 1 -- 172.21.15.114:0/1631165607 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc908053ff0 con 0x7fc90c066000 2023-11-04T01:37:23.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.674+0000 7fc914178640 1 -- 172.21.15.114:0/1631165607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc90c0b5190 con 0x7fc90c066000 2023-11-04T01:37:23.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.675+0000 7fc9027fc640 1 -- 172.21.15.114:0/1631165607 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc908057610 con 0x7fc90c066000 2023-11-04T01:37:23.677 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:37:23.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.677+0000 7fc914178640 1 -- 172.21.15.114:0/1631165607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8f006ae70 msgr2=0x7fc8f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.677+0000 7fc914178640 1 --2- 172.21.15.114:0/1631165607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8f006ae70 0x7fc8f006d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc006fd0 tx=0x7fc8fc008040 comp rx=0 tx=0).stop 2023-11-04T01:37:23.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.677+0000 7fc914178640 1 -- 172.21.15.114:0/1631165607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc90c066000 msgr2=0x7fc90c149630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.677+0000 7fc914178640 1 --2- 172.21.15.114:0/1631165607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc90c066000 0x7fc90c149630 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc90800c890 tx=0x7fc90800cd50 comp rx=0 tx=0).stop 2023-11-04T01:37:23.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.677+0000 7fc914178640 1 -- 172.21.15.114:0/1631165607 shutdown_connections 2023-11-04T01:37:23.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.677+0000 7fc914178640 1 --2- 172.21.15.114:0/1631165607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc90c15d1b0 0x7fc90c06a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.677+0000 7fc914178640 1 --2- 172.21.15.114:0/1631165607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8f006ae70 0x7fc8f006d330 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.677+0000 7fc914178640 1 --2- 172.21.15.114:0/1631165607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc90c070ff0 0x7fc90c0b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.677+0000 7fc914178640 1 --2- 172.21.15.114:0/1631165607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc90c066000 0x7fc90c149630 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.677+0000 7fc914178640 1 -- 172.21.15.114:0/1631165607 >> 172.21.15.114:0/1631165607 conn(0x7fc90c0cbc90 msgr2=0x7fc90c0ca910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:23.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.677+0000 7fc914178640 1 -- 172.21.15.114:0/1631165607 shutdown_connections 2023-11-04T01:37:23.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.677+0000 7fc914178640 1 -- 172.21.15.114:0/1631165607 wait complete. 2023-11-04T01:37:23.689 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:23.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.790+0000 7fd164933640 1 Processor -- start 2023-11-04T01:37:23.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.790+0000 7fd164933640 1 -- start start 2023-11-04T01:37:23.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.791+0000 7fd164933640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd16015e430 0x7fd1600cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.791+0000 7fd164933640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd1600cf160 0x7fd1600cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.791+0000 7fd164933640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1600d0280 con 0x7fd1600d0710 2023-11-04T01:37:23.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.791+0000 7fd164933640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1600cf670 con 0x7fd1600cf160 2023-11-04T01:37:23.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.791+0000 7fd164933640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1600cf950 con 0x7fd16015e430 2023-11-04T01:37:23.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.791+0000 7fd15dd9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd1600cf160 0x7fd1600cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.791+0000 7fd15dd9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd1600cf160 0x7fd1600cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43844/0 (socket says 172.21.15.114:43844) 2023-11-04T01:37:23.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.791+0000 7fd15dd9b640 1 -- 172.21.15.114:0/2913205392 learned_addr learned my addr 172.21.15.114:0/2913205392 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:23.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.791+0000 7fd15e59c640 1 --2- 172.21.15.114:0/2913205392 >> v2:172.21.15.141:3300/0 conn(0x7fd16015e430 0x7fd1600cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.791+0000 7fd15dd9b640 1 -- 172.21.15.114:0/2913205392 >> v2:172.21.15.141:3300/0 conn(0x7fd16015e430 msgr2=0x7fd1600cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:23.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.791+0000 7fd15dd9b640 1 --2- 172.21.15.114:0/2913205392 >> v2:172.21.15.141:3300/0 conn(0x7fd16015e430 0x7fd1600cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.791+0000 7fd15dd9b640 1 -- 172.21.15.114:0/2913205392 >> v1:172.21.15.141:6789/0 conn(0x7fd1600d0710 legacy=0x7fd1600b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:23.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.791+0000 7fd15dd9b640 1 -- 172.21.15.114:0/2913205392 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1600cfc30 con 0x7fd1600cf160 2023-11-04T01:37:23.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.792+0000 7fd15dd9b640 1 --2- 172.21.15.114:0/2913205392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1600cf160 0x7fd1600cd510 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd16006e5b0 tx=0x7fd15402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89afc2d23d821f7a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.792+0000 7fd15d59a640 1 -- 172.21.15.114:0/2913205392 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd154031870 con 0x7fd1600cf160 2023-11-04T01:37:23.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.792+0000 7fd15d59a640 1 -- 172.21.15.114:0/2913205392 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1540319d0 con 0x7fd1600cf160 2023-11-04T01:37:23.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.792+0000 7fd15d59a640 1 -- 172.21.15.114:0/2913205392 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd154031d60 con 0x7fd1600cf160 2023-11-04T01:37:23.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.792+0000 7fd164933640 1 -- 172.21.15.114:0/2913205392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1600cf160 msgr2=0x7fd1600cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.792+0000 7fd164933640 1 --2- 172.21.15.114:0/2913205392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1600cf160 0x7fd1600cd510 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd16006e5b0 tx=0x7fd15402b910 comp rx=0 tx=0).stop 2023-11-04T01:37:23.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.793+0000 7fd164933640 1 -- 172.21.15.114:0/2913205392 shutdown_connections 2023-11-04T01:37:23.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.793+0000 7fd164933640 1 --2- 172.21.15.114:0/2913205392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1600cf160 0x7fd1600cd510 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.793+0000 7fd164933640 1 --2- 172.21.15.114:0/2913205392 >> v2:172.21.15.141:3300/0 conn(0x7fd16015e430 0x7fd1600cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.793+0000 7fd164933640 1 -- 172.21.15.114:0/2913205392 >> 172.21.15.114:0/2913205392 conn(0x7fd16006ea20 msgr2=0x7fd16006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:23.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.793+0000 7fd164933640 1 -- 172.21.15.114:0/2913205392 shutdown_connections 2023-11-04T01:37:23.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.793+0000 7fd164933640 1 -- 172.21.15.114:0/2913205392 wait complete. 2023-11-04T01:37:23.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.794+0000 7fd164933640 1 Processor -- start 2023-11-04T01:37:23.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.794+0000 7fd164933640 1 -- start start 2023-11-04T01:37:23.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd164933640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1600cf160 0x7fd1600aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd164933640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1600d0710 0x7fd1600c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd164933640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd16015e430 0x7fd16014e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd164933640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16006c960 con 0x7fd16015e430 2023-11-04T01:37:23.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd164933640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16006bce0 con 0x7fd1600d0710 2023-11-04T01:37:23.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd164933640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16006bfc0 con 0x7fd1600cf160 2023-11-04T01:37:23.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd15ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd16015e430 0x7fd16014e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd15ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd16015e430 0x7fd16014e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43854/0 (socket says 172.21.15.114:43854) 2023-11-04T01:37:23.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd15ed9d640 1 -- 172.21.15.114:0/566921864 learned_addr learned my addr 172.21.15.114:0/566921864 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:23.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd15e59c640 1 --2- 172.21.15.114:0/566921864 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1600cf160 0x7fd1600aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd15dd9b640 1 --2- 172.21.15.114:0/566921864 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1600d0710 0x7fd1600c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd15ed9d640 1 -- 172.21.15.114:0/566921864 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1600cf160 msgr2=0x7fd1600aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd15ed9d640 1 --2- 172.21.15.114:0/566921864 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1600cf160 0x7fd1600aef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd15ed9d640 1 -- 172.21.15.114:0/566921864 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1600d0710 msgr2=0x7fd1600c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd15ed9d640 1 --2- 172.21.15.114:0/566921864 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1600d0710 0x7fd1600c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd15ed9d640 1 -- 172.21.15.114:0/566921864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1540094d0 con 0x7fd16015e430 2023-11-04T01:37:23.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd15dd9b640 1 --2- 172.21.15.114:0/566921864 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1600d0710 0x7fd1600c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:23.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd15e59c640 1 --2- 172.21.15.114:0/566921864 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1600cf160 0x7fd1600aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:23.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd15ed9d640 1 --2- 172.21.15.114:0/566921864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd16015e430 0x7fd16014e8a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd15800c700 tx=0x7fd15800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd14effd640 1 -- 172.21.15.114:0/566921864 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15800aa50 con 0x7fd16015e430 2023-11-04T01:37:23.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd14effd640 1 -- 172.21.15.114:0/566921864 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15800abb0 con 0x7fd16015e430 2023-11-04T01:37:23.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd164933640 1 -- 172.21.15.114:0/566921864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16006c2a0 con 0x7fd16015e430 2023-11-04T01:37:23.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd14effd640 1 -- 172.21.15.114:0/566921864 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15800ce10 con 0x7fd16015e430 2023-11-04T01:37:23.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.795+0000 7fd164933640 1 -- 172.21.15.114:0/566921864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1600af460 con 0x7fd16015e430 2023-11-04T01:37:23.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.796+0000 7fd164933640 1 -- 172.21.15.114:0/566921864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd16006caa0 con 0x7fd16015e430 2023-11-04T01:37:23.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.797+0000 7fd14effd640 1 -- 172.21.15.114:0/566921864 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd158012420 con 0x7fd16015e430 2023-11-04T01:37:23.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.797+0000 7fd14effd640 1 --2- 172.21.15.114:0/566921864 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd14006aea0 0x7fd14006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:23.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.797+0000 7fd14effd640 1 -- 172.21.15.114:0/566921864 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd158089e60 con 0x7fd16015e430 2023-11-04T01:37:23.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.797+0000 7fd15e59c640 1 --2- 172.21.15.114:0/566921864 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd14006aea0 0x7fd14006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:23.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.798+0000 7fd15e59c640 1 --2- 172.21.15.114:0/566921864 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd14006aea0 0x7fd14006d360 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd150006fd0 tx=0x7fd150008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:23.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.801+0000 7fd14effd640 1 -- 172.21.15.114:0/566921864 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd16006caa0 con 0x7fd16015e430 2023-11-04T01:37:23.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.969+0000 7fd164933640 1 -- 172.21.15.114:0/566921864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd16006caa0 con 0x7fd16015e430 2023-11-04T01:37:23.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.969+0000 7fd14effd640 1 -- 172.21.15.114:0/566921864 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd16006caa0 con 0x7fd16015e430 2023-11-04T01:37:23.971 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:23.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.971+0000 7fd164933640 1 -- 172.21.15.114:0/566921864 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd14006aea0 msgr2=0x7fd14006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.971+0000 7fd164933640 1 --2- 172.21.15.114:0/566921864 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd14006aea0 0x7fd14006d360 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd150006fd0 tx=0x7fd150008040 comp rx=0 tx=0).stop 2023-11-04T01:37:23.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.971+0000 7fd164933640 1 -- 172.21.15.114:0/566921864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd16015e430 msgr2=0x7fd16014e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:23.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.971+0000 7fd164933640 1 --2- 172.21.15.114:0/566921864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd16015e430 0x7fd16014e8a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd15800c700 tx=0x7fd15800cbc0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.971+0000 7fd164933640 1 -- 172.21.15.114:0/566921864 shutdown_connections 2023-11-04T01:37:23.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.971+0000 7fd164933640 1 --2- 172.21.15.114:0/566921864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd16015e430 0x7fd16014e8a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.971+0000 7fd164933640 1 --2- 172.21.15.114:0/566921864 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd14006aea0 0x7fd14006d360 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.971+0000 7fd164933640 1 --2- 172.21.15.114:0/566921864 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd1600d0710 0x7fd1600c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.971+0000 7fd164933640 1 --2- 172.21.15.114:0/566921864 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1600cf160 0x7fd1600aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:23.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.971+0000 7fd164933640 1 -- 172.21.15.114:0/566921864 >> 172.21.15.114:0/566921864 conn(0x7fd16006ea20 msgr2=0x7fd16015ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:23.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.971+0000 7fd164933640 1 -- 172.21.15.114:0/566921864 shutdown_connections 2023-11-04T01:37:23.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:23.971+0000 7fd164933640 1 -- 172.21.15.114:0/566921864 wait complete. 2023-11-04T01:37:23.983 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:24.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.083+0000 7f822fb1d640 1 Processor -- start 2023-11-04T01:37:24.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.083+0000 7f822fb1d640 1 -- start start 2023-11-04T01:37:24.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822fb1d640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f82280c4ff0 0x7f82280cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822fb1d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822815aff0 con 0x7f82280adac0 2023-11-04T01:37:24.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822fb1d640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822815a3e0 con 0x7f8228159c00 2023-11-04T01:37:24.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822fb1d640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f822815a6c0 con 0x7f82280c4ff0 2023-11-04T01:37:24.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822e0ba640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f82280adac0 0x7f82280adf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51596/0 (socket says 172.21.15.114:51596) 2023-11-04T01:37:24.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822e0ba640 1 -- 172.21.15.114:0/2719385863 learned_addr learned my addr 172.21.15.114:0/2719385863 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:24.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822d0b8640 1 --2- 172.21.15.114:0/2719385863 >> v2:172.21.15.141:3300/0 conn(0x7f82280c4ff0 0x7f82280cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822c8b7640 1 -- 172.21.15.114:0/2719385863 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428394057 0 0) 0x7f822815aff0 con 0x7f82280adac0 2023-11-04T01:37:24.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822c8b7640 1 -- 172.21.15.114:0/2719385863 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8214003520 con 0x7f82280adac0 2023-11-04T01:37:24.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822c8b7640 1 -- 172.21.15.114:0/2719385863 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899373451 0 0) 0x7f822815a3e0 con 0x7f8228159c00 2023-11-04T01:37:24.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822c8b7640 1 -- 172.21.15.114:0/2719385863 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f822815aff0 con 0x7f8228159c00 2023-11-04T01:37:24.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822c8b7640 1 -- 172.21.15.114:0/2719385863 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1211206491 0 0) 0x7f8214003520 con 0x7f82280adac0 2023-11-04T01:37:24.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822c8b7640 1 -- 172.21.15.114:0/2719385863 >> v2:172.21.15.141:3300/0 conn(0x7f82280c4ff0 msgr2=0x7f82280cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:24.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822c8b7640 1 --2- 172.21.15.114:0/2719385863 >> v2:172.21.15.141:3300/0 conn(0x7f82280c4ff0 0x7f82280cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822c8b7640 1 -- 172.21.15.114:0/2719385863 >> v1:172.21.15.141:6789/0 conn(0x7f8228159c00 legacy=0x7f82280c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822c8b7640 1 -- 172.21.15.114:0/2719385863 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822815a9a0 con 0x7f82280adac0 2023-11-04T01:37:24.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822c8b7640 1 -- 172.21.15.114:0/2719385863 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f82200019f0 con 0x7f82280adac0 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822c8b7640 1 -- 172.21.15.114:0/2719385863 >> v1:172.21.15.114:6789/0 conn(0x7f82280adac0 legacy=0x7f82280adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.084+0000 7f822c8b7640 1 --2- 172.21.15.114:0/2719385863 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8214003b00 0x7f8214003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.085+0000 7f822c8b7640 1 --2- 172.21.15.114:0/2719385863 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82140047c0 0x7f8214004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.085+0000 7f822c8b7640 1 --2- 172.21.15.114:0/2719385863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8214005180 0x7f821400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.085+0000 7f822c8b7640 1 -- 172.21.15.114:0/2719385863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822815a6c0 con 0x7f8214005180 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.085+0000 7f822c8b7640 1 -- 172.21.15.114:0/2719385863 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821400c000 con 0x7f82140047c0 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.085+0000 7f822c8b7640 1 -- 172.21.15.114:0/2719385863 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821400c1c0 con 0x7f8214003b00 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.085+0000 7f822e0ba640 1 --2- 172.21.15.114:0/2719385863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8214005180 0x7f821400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.085+0000 7f822d8b9640 1 --2- 172.21.15.114:0/2719385863 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8214003b00 0x7f8214003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.085+0000 7f822d0b8640 1 --2- 172.21.15.114:0/2719385863 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82140047c0 0x7f8214004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.085+0000 7f822e0ba640 1 -- 172.21.15.114:0/2719385863 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8214003b00 msgr2=0x7f8214003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:24.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.085+0000 7f822e0ba640 1 --2- 172.21.15.114:0/2719385863 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8214003b00 0x7f8214003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.085+0000 7f822e0ba640 1 -- 172.21.15.114:0/2719385863 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82140047c0 msgr2=0x7f8214004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:24.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.085+0000 7f822e0ba640 1 --2- 172.21.15.114:0/2719385863 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82140047c0 0x7f8214004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.085+0000 7f822e0ba640 1 -- 172.21.15.114:0/2719385863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8214003520 con 0x7f8214005180 2023-11-04T01:37:24.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.085+0000 7f822d0b8640 1 --2- 172.21.15.114:0/2719385863 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82140047c0 0x7f8214004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:24.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.086+0000 7f822e0ba640 1 -- 172.21.15.114:0/2719385863 reap_dead start 2023-11-04T01:37:24.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.086+0000 7f822e0ba640 1 --2- 172.21.15.114:0/2719385863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8214005180 0x7f821400b980 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f822000a7a0 tx=0x7f82140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31f622736500f61 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.086+0000 7f822c8b7640 1 -- 172.21.15.114:0/2719385863 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8220034630 con 0x7f8214005180 2023-11-04T01:37:24.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.086+0000 7f822c8b7640 1 -- 172.21.15.114:0/2719385863 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822002f070 con 0x7f8214005180 2023-11-04T01:37:24.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.086+0000 7f822c8b7640 1 -- 172.21.15.114:0/2719385863 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82200349b0 con 0x7f8214005180 2023-11-04T01:37:24.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.086+0000 7f822fb1d640 1 -- 172.21.15.114:0/2719385863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8214005180 msgr2=0x7f821400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.086+0000 7f822fb1d640 1 --2- 172.21.15.114:0/2719385863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8214005180 0x7f821400b980 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f822000a7a0 tx=0x7f82140057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.086+0000 7f822fb1d640 1 -- 172.21.15.114:0/2719385863 shutdown_connections 2023-11-04T01:37:24.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.086+0000 7f822fb1d640 1 --2- 172.21.15.114:0/2719385863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8214005180 0x7f821400b980 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.086+0000 7f822fb1d640 1 -- 172.21.15.114:0/2719385863 >> 172.21.15.114:0/2719385863 conn(0x7f82280ce950 msgr2=0x7f82280ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.086+0000 7f822fb1d640 1 -- 172.21.15.114:0/2719385863 shutdown_connections 2023-11-04T01:37:24.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.086+0000 7f822fb1d640 1 -- 172.21.15.114:0/2719385863 wait complete. 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.087+0000 7f822fb1d640 1 Processor -- start 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.087+0000 7f822fb1d640 1 -- start start 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.088+0000 7f822fb1d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8214005180 0x7f82280c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.088+0000 7f822fb1d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f822814afa0 0x7f822814b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.088+0000 7f822fb1d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8228140270 0x7f82281406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.088+0000 7f822fb1d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82280ad1d0 con 0x7f8228140270 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.088+0000 7f822fb1d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82280c88a0 con 0x7f822814afa0 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.088+0000 7f822fb1d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8228140c30 con 0x7f8214005180 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.088+0000 7f822e0ba640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8228140270 0x7f82281406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.088+0000 7f822e0ba640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8228140270 0x7f82281406f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43866/0 (socket says 172.21.15.114:43866) 2023-11-04T01:37:24.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.088+0000 7f822e0ba640 1 -- 172.21.15.114:0/3643655100 learned_addr learned my addr 172.21.15.114:0/3643655100 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:24.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.088+0000 7f822d0b8640 1 --2- 172.21.15.114:0/3643655100 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f822814afa0 0x7f822814b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.088+0000 7f822d8b9640 1 --2- 172.21.15.114:0/3643655100 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8214005180 0x7f82280c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.089+0000 7f822e0ba640 1 -- 172.21.15.114:0/3643655100 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8214005180 msgr2=0x7f82280c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.089+0000 7f822e0ba640 1 --2- 172.21.15.114:0/3643655100 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8214005180 0x7f82280c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.089+0000 7f822e0ba640 1 -- 172.21.15.114:0/3643655100 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f822814afa0 msgr2=0x7f822814b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.089+0000 7f822e0ba640 1 --2- 172.21.15.114:0/3643655100 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f822814afa0 0x7f822814b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.089+0000 7f822e0ba640 1 -- 172.21.15.114:0/3643655100 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8228141100 con 0x7f8228140270 2023-11-04T01:37:24.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.089+0000 7f822e0ba640 1 --2- 172.21.15.114:0/3643655100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8228140270 0x7f82281406f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f822000a8c0 tx=0x7f8220001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.089+0000 7f821e7fc640 1 -- 172.21.15.114:0/3643655100 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8220004d60 con 0x7f8228140270 2023-11-04T01:37:24.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.089+0000 7f821e7fc640 1 -- 172.21.15.114:0/3643655100 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822003f470 con 0x7f8228140270 2023-11-04T01:37:24.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.089+0000 7f822fb1d640 1 -- 172.21.15.114:0/3643655100 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82280ac2e0 con 0x7f8228140270 2023-11-04T01:37:24.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.089+0000 7f821e7fc640 1 -- 172.21.15.114:0/3643655100 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822003f800 con 0x7f8228140270 2023-11-04T01:37:24.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.089+0000 7f822fb1d640 1 -- 172.21.15.114:0/3643655100 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82280ac8a0 con 0x7f8228140270 2023-11-04T01:37:24.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.090+0000 7f822fb1d640 1 -- 172.21.15.114:0/3643655100 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822813e220 con 0x7f8228140270 2023-11-04T01:37:24.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.090+0000 7f821e7fc640 1 -- 172.21.15.114:0/3643655100 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8220031030 con 0x7f8228140270 2023-11-04T01:37:24.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.091+0000 7f821e7fc640 1 --2- 172.21.15.114:0/3643655100 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f820c06ae90 0x7f820c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.091+0000 7f821e7fc640 1 -- 172.21.15.114:0/3643655100 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f82200ab190 con 0x7f8228140270 2023-11-04T01:37:24.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.091+0000 7f822d8b9640 1 --2- 172.21.15.114:0/3643655100 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f820c06ae90 0x7f820c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.091+0000 7f822d8b9640 1 --2- 172.21.15.114:0/3643655100 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f820c06ae90 0x7f820c06d350 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8224000c00 tx=0x7f8224009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.095+0000 7f821e7fc640 1 -- 172.21.15.114:0/3643655100 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f822813e220 con 0x7f8228140270 2023-11-04T01:37:24.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.260+0000 7f822fb1d640 1 -- 172.21.15.114:0/3643655100 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f822813e220 con 0x7f8228140270 2023-11-04T01:37:24.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.260+0000 7f821e7fc640 1 -- 172.21.15.114:0/3643655100 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f822813e220 con 0x7f8228140270 2023-11-04T01:37:24.262 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:37:24.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.262+0000 7f822fb1d640 1 -- 172.21.15.114:0/3643655100 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f820c06ae90 msgr2=0x7f820c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.262+0000 7f822fb1d640 1 --2- 172.21.15.114:0/3643655100 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f820c06ae90 0x7f820c06d350 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8224000c00 tx=0x7f8224009040 comp rx=0 tx=0).stop 2023-11-04T01:37:24.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.262+0000 7f822fb1d640 1 -- 172.21.15.114:0/3643655100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8228140270 msgr2=0x7f82281406f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.262+0000 7f822fb1d640 1 --2- 172.21.15.114:0/3643655100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8228140270 0x7f82281406f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f822000a8c0 tx=0x7f8220001d00 comp rx=0 tx=0).stop 2023-11-04T01:37:24.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.262+0000 7f822fb1d640 1 -- 172.21.15.114:0/3643655100 shutdown_connections 2023-11-04T01:37:24.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.262+0000 7f822fb1d640 1 --2- 172.21.15.114:0/3643655100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8228140270 0x7f82281406f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.262+0000 7f822fb1d640 1 --2- 172.21.15.114:0/3643655100 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f820c06ae90 0x7f820c06d350 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.262+0000 7f822fb1d640 1 --2- 172.21.15.114:0/3643655100 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f822814afa0 0x7f822814b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.262+0000 7f822fb1d640 1 --2- 172.21.15.114:0/3643655100 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8214005180 0x7f82280c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.262+0000 7f822fb1d640 1 -- 172.21.15.114:0/3643655100 >> 172.21.15.114:0/3643655100 conn(0x7f82280ce950 msgr2=0x7f822806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.262+0000 7f822fb1d640 1 -- 172.21.15.114:0/3643655100 shutdown_connections 2023-11-04T01:37:24.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.262+0000 7f822fb1d640 1 -- 172.21.15.114:0/3643655100 wait complete. 2023-11-04T01:37:24.275 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:24.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.375+0000 7f2eface5640 1 Processor -- start 2023-11-04T01:37:24.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.375+0000 7f2eface5640 1 -- start start 2023-11-04T01:37:24.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.376+0000 7f2eface5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2ef4160430 0x7f2ef40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.376+0000 7f2eface5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ef40b2b60 0x7f2ef406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.376+0000 7f2eface5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef40b2fc0 con 0x7f2ef406c1d0 2023-11-04T01:37:24.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.376+0000 7f2eface5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef40cb580 con 0x7f2ef40b2b60 2023-11-04T01:37:24.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.376+0000 7f2eface5640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef406ca40 con 0x7f2ef4160430 2023-11-04T01:37:24.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.376+0000 7f2ef3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ef40b2b60 0x7f2ef406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.376+0000 7f2ef9282640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2ef406c1d0 0x7f2ef4160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51604/0 (socket says 172.21.15.114:51604) 2023-11-04T01:37:24.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.376+0000 7f2ef9282640 1 -- 172.21.15.114:0/4044862398 learned_addr learned my addr 172.21.15.114:0/4044862398 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:24.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.377+0000 7f2ef8a81640 1 --2- 172.21.15.114:0/4044862398 >> v2:172.21.15.141:3300/0 conn(0x7f2ef4160430 0x7f2ef40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.377+0000 7f2ef3fff640 1 -- 172.21.15.114:0/4044862398 >> v2:172.21.15.141:3300/0 conn(0x7f2ef4160430 msgr2=0x7f2ef40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:24.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.377+0000 7f2ef3fff640 1 --2- 172.21.15.114:0/4044862398 >> v2:172.21.15.141:3300/0 conn(0x7f2ef4160430 0x7f2ef40b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.377+0000 7f2ef3fff640 1 -- 172.21.15.114:0/4044862398 >> v1:172.21.15.114:6789/0 conn(0x7f2ef406c1d0 legacy=0x7f2ef4160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.377+0000 7f2ef3fff640 1 -- 172.21.15.114:0/4044862398 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef406cd20 con 0x7f2ef40b2b60 2023-11-04T01:37:24.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.377+0000 7f2ef37fe640 1 -- 172.21.15.114:0/4044862398 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686719392 0 0) 0x7f2ef40b2fc0 con 0x7f2ef406c1d0 2023-11-04T01:37:24.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.377+0000 7f2ef3fff640 1 --2- 172.21.15.114:0/4044862398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ef40b2b60 0x7f2ef406bc90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2ef406f6d0 tx=0x7f2ee802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9f817f8360b390 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.378+0000 7f2ef37fe640 1 -- 172.21.15.114:0/4044862398 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8031830 con 0x7f2ef40b2b60 2023-11-04T01:37:24.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.378+0000 7f2ef37fe640 1 -- 172.21.15.114:0/4044862398 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee8031990 con 0x7f2ef40b2b60 2023-11-04T01:37:24.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.378+0000 7f2ef37fe640 1 -- 172.21.15.114:0/4044862398 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8031d20 con 0x7f2ef40b2b60 2023-11-04T01:37:24.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.378+0000 7f2eface5640 1 -- 172.21.15.114:0/4044862398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ef40b2b60 msgr2=0x7f2ef406bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.378+0000 7f2eface5640 1 --2- 172.21.15.114:0/4044862398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ef40b2b60 0x7f2ef406bc90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2ef406f6d0 tx=0x7f2ee802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.378+0000 7f2eface5640 1 -- 172.21.15.114:0/4044862398 shutdown_connections 2023-11-04T01:37:24.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.378+0000 7f2eface5640 1 --2- 172.21.15.114:0/4044862398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ef40b2b60 0x7f2ef406bc90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.378+0000 7f2eface5640 1 --2- 172.21.15.114:0/4044862398 >> v2:172.21.15.141:3300/0 conn(0x7f2ef4160430 0x7f2ef40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.378+0000 7f2eface5640 1 -- 172.21.15.114:0/4044862398 >> 172.21.15.114:0/4044862398 conn(0x7f2ef406ea20 msgr2=0x7f2ef406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.378+0000 7f2eface5640 1 -- 172.21.15.114:0/4044862398 shutdown_connections 2023-11-04T01:37:24.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.378+0000 7f2eface5640 1 -- 172.21.15.114:0/4044862398 wait complete. 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.379+0000 7f2eface5640 1 Processor -- start 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.379+0000 7f2eface5640 1 -- start start 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.380+0000 7f2eface5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ef406c1d0 0x7f2ef414f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.380+0000 7f2eface5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ef40b2b60 0x7f2ef40ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.380+0000 7f2eface5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ef4160430 0x7f2ef40b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.380+0000 7f2eface5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40cd850 con 0x7f2ef40b2b60 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.380+0000 7f2eface5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40c8f60 con 0x7f2ef4160430 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.380+0000 7f2eface5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40cd570 con 0x7f2ef406c1d0 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.380+0000 7f2ef3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ef40b2b60 0x7f2ef40ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.380+0000 7f2ef3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ef40b2b60 0x7f2ef40ccc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43886/0 (socket says 172.21.15.114:43886) 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.380+0000 7f2ef3fff640 1 -- 172.21.15.114:0/351556347 learned_addr learned my addr 172.21.15.114:0/351556347 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.380+0000 7f2ef9282640 1 --2- 172.21.15.114:0/351556347 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ef4160430 0x7f2ef40b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.380+0000 7f2ef3fff640 1 -- 172.21.15.114:0/351556347 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ef406c1d0 msgr2=0x7f2ef414f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.380+0000 7f2ef8a81640 1 --2- 172.21.15.114:0/351556347 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ef406c1d0 0x7f2ef414f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.380+0000 7f2ef3fff640 1 --2- 172.21.15.114:0/351556347 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ef406c1d0 0x7f2ef414f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.380+0000 7f2ef3fff640 1 -- 172.21.15.114:0/351556347 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ef4160430 msgr2=0x7f2ef40b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.380+0000 7f2ef3fff640 1 --2- 172.21.15.114:0/351556347 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ef4160430 0x7f2ef40b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.381+0000 7f2ef3fff640 1 -- 172.21.15.114:0/351556347 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee8009400 con 0x7f2ef40b2b60 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.381+0000 7f2ef9282640 1 --2- 172.21.15.114:0/351556347 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ef4160430 0x7f2ef40b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.381+0000 7f2ef8a81640 1 --2- 172.21.15.114:0/351556347 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ef406c1d0 0x7f2ef414f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.381+0000 7f2ef3fff640 1 --2- 172.21.15.114:0/351556347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ef40b2b60 0x7f2ef40ccc00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009890 tx=0x7f2ee80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.381+0000 7f2ef17fa640 1 -- 172.21.15.114:0/351556347 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee803ba70 con 0x7f2ef40b2b60 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.381+0000 7f2ef17fa640 1 -- 172.21.15.114:0/351556347 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee803bbf0 con 0x7f2ef40b2b60 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.381+0000 7f2eface5640 1 -- 172.21.15.114:0/351556347 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef40c9200 con 0x7f2ef40b2b60 2023-11-04T01:37:24.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.381+0000 7f2ef17fa640 1 -- 172.21.15.114:0/351556347 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8045400 con 0x7f2ef40b2b60 2023-11-04T01:37:24.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.381+0000 7f2eface5640 1 -- 172.21.15.114:0/351556347 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef4150230 con 0x7f2ef40b2b60 2023-11-04T01:37:24.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.382+0000 7f2eface5640 1 -- 172.21.15.114:0/351556347 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef40c9720 con 0x7f2ef40b2b60 2023-11-04T01:37:24.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.382+0000 7f2ef17fa640 1 -- 172.21.15.114:0/351556347 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ee804e440 con 0x7f2ef40b2b60 2023-11-04T01:37:24.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.383+0000 7f2ef17fa640 1 --2- 172.21.15.114:0/351556347 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2ee006ae70 0x7f2ee006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.383+0000 7f2ef17fa640 1 -- 172.21.15.114:0/351556347 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2ee80abbd0 con 0x7f2ef40b2b60 2023-11-04T01:37:24.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.383+0000 7f2ef8a81640 1 --2- 172.21.15.114:0/351556347 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2ee006ae70 0x7f2ee006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.383+0000 7f2ef8a81640 1 --2- 172.21.15.114:0/351556347 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2ee006ae70 0x7f2ee006d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4006fd0 tx=0x7f2ee4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.387+0000 7f2ef17fa640 1 -- 172.21.15.114:0/351556347 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ef40c9720 con 0x7f2ef40b2b60 2023-11-04T01:37:24.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.551+0000 7f2eface5640 1 -- 172.21.15.114:0/351556347 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2ef40c9720 con 0x7f2ef40b2b60 2023-11-04T01:37:24.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.551+0000 7f2ef17fa640 1 -- 172.21.15.114:0/351556347 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2ef40c9720 con 0x7f2ef40b2b60 2023-11-04T01:37:24.553 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:24.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.553+0000 7f2eface5640 1 -- 172.21.15.114:0/351556347 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2ee006ae70 msgr2=0x7f2ee006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.553+0000 7f2eface5640 1 --2- 172.21.15.114:0/351556347 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2ee006ae70 0x7f2ee006d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4006fd0 tx=0x7f2ee4008040 comp rx=0 tx=0).stop 2023-11-04T01:37:24.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.553+0000 7f2eface5640 1 -- 172.21.15.114:0/351556347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ef40b2b60 msgr2=0x7f2ef40ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.553+0000 7f2eface5640 1 --2- 172.21.15.114:0/351556347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ef40b2b60 0x7f2ef40ccc00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009890 tx=0x7f2ee80046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.553+0000 7f2eface5640 1 -- 172.21.15.114:0/351556347 shutdown_connections 2023-11-04T01:37:24.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.553+0000 7f2eface5640 1 --2- 172.21.15.114:0/351556347 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2ee006ae70 0x7f2ee006d330 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.553+0000 7f2eface5640 1 --2- 172.21.15.114:0/351556347 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2ef4160430 0x7f2ef40b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.553+0000 7f2eface5640 1 --2- 172.21.15.114:0/351556347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ef40b2b60 0x7f2ef40ccc00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.553+0000 7f2eface5640 1 --2- 172.21.15.114:0/351556347 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2ef406c1d0 0x7f2ef414f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.553+0000 7f2eface5640 1 -- 172.21.15.114:0/351556347 >> 172.21.15.114:0/351556347 conn(0x7f2ef406ea20 msgr2=0x7f2ef40b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.553+0000 7f2eface5640 1 -- 172.21.15.114:0/351556347 shutdown_connections 2023-11-04T01:37:24.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.553+0000 7f2eface5640 1 -- 172.21.15.114:0/351556347 wait complete. 2023-11-04T01:37:24.566 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:37:24.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.664+0000 7f80d6a32640 1 Processor -- start 2023-11-04T01:37:24.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.664+0000 7f80d6a32640 1 -- start start 2023-11-04T01:37:24.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80d6a32640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f80d015ad30 0x7f80d00adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80d6a32640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f80d00ad730 0x7f80d0070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80d6a32640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80d0070c50 0x7f80d00c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80d6a32640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d00ae260 con 0x7f80d00ad730 2023-11-04T01:37:24.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80d6a32640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d00710e0 con 0x7f80d015ad30 2023-11-04T01:37:24.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80d6a32640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d00c3900 con 0x7f80d0070c50 2023-11-04T01:37:24.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80cf7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f80d00ad730 0x7f80d0070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80cf7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f80d00ad730 0x7f80d0070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43902/0 (socket says 172.21.15.114:43902) 2023-11-04T01:37:24.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80cf7fe640 1 -- 172.21.15.114:0/2782639954 learned_addr learned my addr 172.21.15.114:0/2782639954 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:24.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80cffff640 1 --2- 172.21.15.114:0/2782639954 >> v2:172.21.15.141:3300/0 conn(0x7f80d015ad30 0x7f80d00adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80d4fcf640 1 --2- 172.21.15.114:0/2782639954 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80d0070c50 0x7f80d00c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80cf7fe640 1 -- 172.21.15.114:0/2782639954 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80d0070c50 msgr2=0x7f80d00c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:24.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80cf7fe640 1 --2- 172.21.15.114:0/2782639954 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80d0070c50 0x7f80d00c8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80cf7fe640 1 -- 172.21.15.114:0/2782639954 >> v2:172.21.15.141:3300/0 conn(0x7f80d015ad30 msgr2=0x7f80d00adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:24.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80cf7fe640 1 --2- 172.21.15.114:0/2782639954 >> v2:172.21.15.141:3300/0 conn(0x7f80d015ad30 0x7f80d00adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80cf7fe640 1 -- 172.21.15.114:0/2782639954 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d00c3be0 con 0x7f80d00ad730 2023-11-04T01:37:24.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.665+0000 7f80cffff640 1 --2- 172.21.15.114:0/2782639954 >> v2:172.21.15.141:3300/0 conn(0x7f80d015ad30 0x7f80d00adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:24.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.666+0000 7f80cf7fe640 1 --2- 172.21.15.114:0/2782639954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80d00ad730 0x7f80d0070710 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f80d006bb00 tx=0x7f80c402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9fc02f998992b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.666+0000 7f80ceffd640 1 -- 172.21.15.114:0/2782639954 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c40317c0 con 0x7f80d00ad730 2023-11-04T01:37:24.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.666+0000 7f80ceffd640 1 -- 172.21.15.114:0/2782639954 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c4031920 con 0x7f80d00ad730 2023-11-04T01:37:24.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.666+0000 7f80ceffd640 1 -- 172.21.15.114:0/2782639954 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4031cb0 con 0x7f80d00ad730 2023-11-04T01:37:24.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.667+0000 7f80d6a32640 1 -- 172.21.15.114:0/2782639954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80d00ad730 msgr2=0x7f80d0070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.667+0000 7f80d6a32640 1 --2- 172.21.15.114:0/2782639954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80d00ad730 0x7f80d0070710 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f80d006bb00 tx=0x7f80c402b860 comp rx=0 tx=0).stop 2023-11-04T01:37:24.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.667+0000 7f80d6a32640 1 -- 172.21.15.114:0/2782639954 shutdown_connections 2023-11-04T01:37:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.667+0000 7f80d6a32640 1 --2- 172.21.15.114:0/2782639954 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80d0070c50 0x7f80d00c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.667+0000 7f80d6a32640 1 --2- 172.21.15.114:0/2782639954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80d00ad730 0x7f80d0070710 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.667+0000 7f80d6a32640 1 --2- 172.21.15.114:0/2782639954 >> v2:172.21.15.141:3300/0 conn(0x7f80d015ad30 0x7f80d00adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.667+0000 7f80d6a32640 1 -- 172.21.15.114:0/2782639954 >> 172.21.15.114:0/2782639954 conn(0x7f80d00ce950 msgr2=0x7f80d00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.667+0000 7f80d6a32640 1 -- 172.21.15.114:0/2782639954 shutdown_connections 2023-11-04T01:37:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.667+0000 7f80d6a32640 1 -- 172.21.15.114:0/2782639954 wait complete. 2023-11-04T01:37:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.668+0000 7f80d6a32640 1 Processor -- start 2023-11-04T01:37:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.668+0000 7f80d6a32640 1 -- start start 2023-11-04T01:37:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.669+0000 7f80d6a32640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80d0070c50 0x7f80d0153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.669+0000 7f80d6a32640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f80d00ad730 0x7f80d015b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.669+0000 7f80d6a32640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80d015ad30 0x7f80d015b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.669+0000 7f80d6a32640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d00ac950 con 0x7f80d0070c50 2023-11-04T01:37:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.669+0000 7f80d6a32640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d00abd40 con 0x7f80d00ad730 2023-11-04T01:37:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.669+0000 7f80d6a32640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d00ac020 con 0x7f80d015ad30 2023-11-04T01:37:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.669+0000 7f80cffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80d0070c50 0x7f80d0153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.669+0000 7f80cffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80d0070c50 0x7f80d0153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43916/0 (socket says 172.21.15.114:43916) 2023-11-04T01:37:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.669+0000 7f80cffff640 1 -- 172.21.15.114:0/942507425 learned_addr learned my addr 172.21.15.114:0/942507425 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.669+0000 7f80cf7fe640 1 --2- 172.21.15.114:0/942507425 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f80d00ad730 0x7f80d015b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.669+0000 7f80d4fcf640 1 --2- 172.21.15.114:0/942507425 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80d015ad30 0x7f80d015b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.669+0000 7f80cffff640 1 -- 172.21.15.114:0/942507425 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80d015ad30 msgr2=0x7f80d015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.669+0000 7f80cffff640 1 --2- 172.21.15.114:0/942507425 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80d015ad30 0x7f80d015b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.669+0000 7f80cffff640 1 -- 172.21.15.114:0/942507425 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f80d00ad730 msgr2=0x7f80d015b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.669+0000 7f80cffff640 1 --2- 172.21.15.114:0/942507425 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f80d00ad730 0x7f80d015b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.669+0000 7f80cffff640 1 -- 172.21.15.114:0/942507425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c40094d0 con 0x7f80d0070c50 2023-11-04T01:37:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.670+0000 7f80cffff640 1 --2- 172.21.15.114:0/942507425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80d0070c50 0x7f80d0153640 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f80c000c7f0 tx=0x7f80c000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.670+0000 7f80ccff9640 1 -- 172.21.15.114:0/942507425 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c0007820 con 0x7f80d0070c50 2023-11-04T01:37:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.670+0000 7f80ccff9640 1 -- 172.21.15.114:0/942507425 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c0007980 con 0x7f80d0070c50 2023-11-04T01:37:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.670+0000 7f80d6a32640 1 -- 172.21.15.114:0/942507425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d00ac300 con 0x7f80d0070c50 2023-11-04T01:37:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.670+0000 7f80ccff9640 1 -- 172.21.15.114:0/942507425 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c0007cf0 con 0x7f80d0070c50 2023-11-04T01:37:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.670+0000 7f80d6a32640 1 -- 172.21.15.114:0/942507425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d0153b80 con 0x7f80d0070c50 2023-11-04T01:37:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.671+0000 7f80d6a32640 1 -- 172.21.15.114:0/942507425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d0153d70 con 0x7f80d0070c50 2023-11-04T01:37:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.671+0000 7f80ccff9640 1 -- 172.21.15.114:0/942507425 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f80c00113f0 con 0x7f80d0070c50 2023-11-04T01:37:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.672+0000 7f80ccff9640 1 --2- 172.21.15.114:0/942507425 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f80bc06ae70 0x7f80bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:24.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.672+0000 7f80ccff9640 1 -- 172.21.15.114:0/942507425 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f80c0089d60 con 0x7f80d0070c50 2023-11-04T01:37:24.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.672+0000 7f80cf7fe640 1 --2- 172.21.15.114:0/942507425 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f80bc06ae70 0x7f80bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:24.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.672+0000 7f80cf7fe640 1 --2- 172.21.15.114:0/942507425 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f80bc06ae70 0x7f80bc06d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f80c4036000 tx=0x7f80c403d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:24.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.676+0000 7f80ccff9640 1 -- 172.21.15.114:0/942507425 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f80c00549d0 con 0x7f80d0070c50 2023-11-04T01:37:24.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.856+0000 7f80d6a32640 1 -- 172.21.15.114:0/942507425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f80d0074290 con 0x7f80d0070c50 2023-11-04T01:37:24.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.856+0000 7f80ccff9640 1 -- 172.21.15.114:0/942507425 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f80c0057ff0 con 0x7f80d0070c50 2023-11-04T01:37:24.858 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-11-04T01:37:24.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.858+0000 7f80d6a32640 1 -- 172.21.15.114:0/942507425 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f80bc06ae70 msgr2=0x7f80bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.858+0000 7f80d6a32640 1 --2- 172.21.15.114:0/942507425 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f80bc06ae70 0x7f80bc06d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f80c4036000 tx=0x7f80c403d040 comp rx=0 tx=0).stop 2023-11-04T01:37:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.858+0000 7f80d6a32640 1 -- 172.21.15.114:0/942507425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80d0070c50 msgr2=0x7f80d0153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.858+0000 7f80d6a32640 1 --2- 172.21.15.114:0/942507425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80d0070c50 0x7f80d0153640 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f80c000c7f0 tx=0x7f80c000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.858+0000 7f80d6a32640 1 -- 172.21.15.114:0/942507425 shutdown_connections 2023-11-04T01:37:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.858+0000 7f80d6a32640 1 --2- 172.21.15.114:0/942507425 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f80d015ad30 0x7f80d015b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.858+0000 7f80d6a32640 1 --2- 172.21.15.114:0/942507425 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f80bc06ae70 0x7f80bc06d330 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.858+0000 7f80d6a32640 1 --2- 172.21.15.114:0/942507425 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f80d00ad730 0x7f80d015b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.858+0000 7f80d6a32640 1 --2- 172.21.15.114:0/942507425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80d0070c50 0x7f80d0153640 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:24.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.858+0000 7f80d6a32640 1 -- 172.21.15.114:0/942507425 >> 172.21.15.114:0/942507425 conn(0x7f80d00ce950 msgr2=0x7f80d00c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:24.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.858+0000 7f80d6a32640 1 -- 172.21.15.114:0/942507425 shutdown_connections 2023-11-04T01:37:24.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24.858+0000 7f80d6a32640 1 -- 172.21.15.114:0/942507425 wait complete. 2023-11-04T01:37:24.871 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi114.front.sepia.ceph.com... 2023-11-04T01:37:24.871 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:24.871 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:24.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:24.930 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[99023]: fuse finished with error 0 and tester_r 0 2023-11-04T01:37:24.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:24.935 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:37:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:24.937 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:24.943 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:37:24.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:24.943 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:37:24.999 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:37:24.999 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:25.019 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:37:25.019 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:25.077 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:25.119 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi141.stderr:2023-11-04T01:37:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:25.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.174+0000 7f9c34fb6640 1 Processor -- start 2023-11-04T01:37:25.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.174+0000 7f9c34fb6640 1 -- start start 2023-11-04T01:37:25.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.175+0000 7f9c34fb6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9c3015ce60 0x7f9c3006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.175+0000 7f9c34fb6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9c300cf160 0x7f9c300cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.175+0000 7f9c34fb6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c301615d0 con 0x7f9c3006bd30 2023-11-04T01:37:25.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.175+0000 7f9c34fb6640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c300cbde0 con 0x7f9c300cf160 2023-11-04T01:37:25.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.175+0000 7f9c34fb6640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c300cfb30 con 0x7f9c3015ce60 2023-11-04T01:37:25.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.176+0000 7f9c2ed9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9c300cf160 0x7f9c300cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.176+0000 7f9c2dd9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9c3006bd30 0x7f9c30160b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51616/0 (socket says 172.21.15.114:51616) 2023-11-04T01:37:25.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.176+0000 7f9c2ed9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9c300cf160 0x7f9c300cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43920/0 (socket says 172.21.15.114:43920) 2023-11-04T01:37:25.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.176+0000 7f9c2dd9b640 1 -- 172.21.15.114:0/3627499361 learned_addr learned my addr 172.21.15.114:0/3627499361 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:25.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.176+0000 7f9c2e59c640 1 --2- 172.21.15.114:0/3627499361 >> v2:172.21.15.141:3300/0 conn(0x7f9c3015ce60 0x7f9c3006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.176+0000 7f9c2ed9d640 1 -- 172.21.15.114:0/3627499361 >> v2:172.21.15.141:3300/0 conn(0x7f9c3015ce60 msgr2=0x7f9c3006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:25.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.176+0000 7f9c2ed9d640 1 --2- 172.21.15.114:0/3627499361 >> v2:172.21.15.141:3300/0 conn(0x7f9c3015ce60 0x7f9c3006b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.176+0000 7f9c2ed9d640 1 -- 172.21.15.114:0/3627499361 >> v1:172.21.15.114:6789/0 conn(0x7f9c3006bd30 legacy=0x7f9c30160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.176+0000 7f9c2ed9d640 1 -- 172.21.15.114:0/3627499361 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c301618b0 con 0x7f9c300cf160 2023-11-04T01:37:25.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.176+0000 7f9c2e59c640 1 --2- 172.21.15.114:0/3627499361 >> v2:172.21.15.141:3300/0 conn(0x7f9c3015ce60 0x7f9c3006b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:25.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.177+0000 7f9c2ed9d640 1 --2- 172.21.15.114:0/3627499361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c300cf160 0x7f9c300cf5f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9c3006e960 tx=0x7f9c2002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91f9d2bf09461ec server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.177+0000 7f9c2d59a640 1 -- 172.21.15.114:0/3627499361 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c20031830 con 0x7f9c300cf160 2023-11-04T01:37:25.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.177+0000 7f9c2d59a640 1 -- 172.21.15.114:0/3627499361 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c20031990 con 0x7f9c300cf160 2023-11-04T01:37:25.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.177+0000 7f9c2d59a640 1 -- 172.21.15.114:0/3627499361 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c20031d20 con 0x7f9c300cf160 2023-11-04T01:37:25.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.177+0000 7f9c34fb6640 1 -- 172.21.15.114:0/3627499361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c300cf160 msgr2=0x7f9c300cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.177+0000 7f9c34fb6640 1 --2- 172.21.15.114:0/3627499361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c300cf160 0x7f9c300cf5f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9c3006e960 tx=0x7f9c2002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.177+0000 7f9c34fb6640 1 -- 172.21.15.114:0/3627499361 shutdown_connections 2023-11-04T01:37:25.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.177+0000 7f9c34fb6640 1 --2- 172.21.15.114:0/3627499361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c300cf160 0x7f9c300cf5f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.177+0000 7f9c34fb6640 1 --2- 172.21.15.114:0/3627499361 >> v2:172.21.15.141:3300/0 conn(0x7f9c3015ce60 0x7f9c3006b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.177+0000 7f9c34fb6640 1 -- 172.21.15.114:0/3627499361 >> 172.21.15.114:0/3627499361 conn(0x7f9c3006ea90 msgr2=0x7f9c3006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:25.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.177+0000 7f9c34fb6640 1 -- 172.21.15.114:0/3627499361 shutdown_connections 2023-11-04T01:37:25.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.177+0000 7f9c34fb6640 1 -- 172.21.15.114:0/3627499361 wait complete. 2023-11-04T01:37:25.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.179+0000 7f9c34fb6640 1 Processor -- start 2023-11-04T01:37:25.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.179+0000 7f9c34fb6640 1 -- start start 2023-11-04T01:37:25.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.179+0000 7f9c34fb6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9c300cf160 0x7f9c30150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.179+0000 7f9c34fb6640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9c3015ce60 0x7f9c300c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.179+0000 7f9c34fb6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c3015e8a0 0x7f9c300c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.179+0000 7f9c34fb6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c30150c60 con 0x7f9c3015e8a0 2023-11-04T01:37:25.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.179+0000 7f9c34fb6640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3015d800 con 0x7f9c3015ce60 2023-11-04T01:37:25.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.179+0000 7f9c34fb6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3015dae0 con 0x7f9c300cf160 2023-11-04T01:37:25.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.179+0000 7f9c2ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c3015e8a0 0x7f9c300c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.179+0000 7f9c2ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c3015e8a0 0x7f9c300c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43930/0 (socket says 172.21.15.114:43930) 2023-11-04T01:37:25.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.179+0000 7f9c2ed9d640 1 -- 172.21.15.114:0/2499383609 learned_addr learned my addr 172.21.15.114:0/2499383609 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:25.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.180+0000 7f9c2dd9b640 1 --2- 172.21.15.114:0/2499383609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9c3015ce60 0x7f9c300c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.180+0000 7f9c2e59c640 1 --2- 172.21.15.114:0/2499383609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9c300cf160 0x7f9c30150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.180+0000 7f9c2ed9d640 1 -- 172.21.15.114:0/2499383609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9c300cf160 msgr2=0x7f9c30150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.180+0000 7f9c2ed9d640 1 --2- 172.21.15.114:0/2499383609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9c300cf160 0x7f9c30150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.180+0000 7f9c2ed9d640 1 -- 172.21.15.114:0/2499383609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9c3015ce60 msgr2=0x7f9c300c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.180+0000 7f9c2ed9d640 1 --2- 172.21.15.114:0/2499383609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9c3015ce60 0x7f9c300c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.180+0000 7f9c2ed9d640 1 -- 172.21.15.114:0/2499383609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c20009400 con 0x7f9c3015e8a0 2023-11-04T01:37:25.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.180+0000 7f9c2e59c640 1 --2- 172.21.15.114:0/2499383609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9c300cf160 0x7f9c30150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:25.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.180+0000 7f9c2ed9d640 1 --2- 172.21.15.114:0/2499383609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c3015e8a0 0x7f9c300c81b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9c2002bee0 tx=0x7f9c200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.180+0000 7f9c26ffd640 1 -- 172.21.15.114:0/2499383609 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2003b9f0 con 0x7f9c3015e8a0 2023-11-04T01:37:25.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.180+0000 7f9c26ffd640 1 -- 172.21.15.114:0/2499383609 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2003bb70 con 0x7f9c3015e8a0 2023-11-04T01:37:25.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.180+0000 7f9c34fb6640 1 -- 172.21.15.114:0/2499383609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3015ddc0 con 0x7f9c3015e8a0 2023-11-04T01:37:25.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.180+0000 7f9c26ffd640 1 -- 172.21.15.114:0/2499383609 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c20045400 con 0x7f9c3015e8a0 2023-11-04T01:37:25.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.180+0000 7f9c34fb6640 1 -- 172.21.15.114:0/2499383609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3015e380 con 0x7f9c3015e8a0 2023-11-04T01:37:25.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.181+0000 7f9c34fb6640 1 -- 172.21.15.114:0/2499383609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3015e5a0 con 0x7f9c3015e8a0 2023-11-04T01:37:25.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.181+0000 7f9c26ffd640 1 -- 172.21.15.114:0/2499383609 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c2004e440 con 0x7f9c3015e8a0 2023-11-04T01:37:25.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.182+0000 7f9c26ffd640 1 --2- 172.21.15.114:0/2499383609 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9c1006ae70 0x7f9c1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.182+0000 7f9c26ffd640 1 -- 172.21.15.114:0/2499383609 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9c200abcc0 con 0x7f9c3015e8a0 2023-11-04T01:37:25.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.182+0000 7f9c2e59c640 1 --2- 172.21.15.114:0/2499383609 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9c1006ae70 0x7f9c1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.182+0000 7f9c2e59c640 1 --2- 172.21.15.114:0/2499383609 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9c1006ae70 0x7f9c1006d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9c300b5ba0 tx=0x7f9c28007550 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.186+0000 7f9c26ffd640 1 -- 172.21.15.114:0/2499383609 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9c20076a40 con 0x7f9c3015e8a0 2023-11-04T01:37:25.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.355+0000 7f9c34fb6640 1 -- 172.21.15.114:0/2499383609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c300ce4a0 con 0x7f9c3015e8a0 2023-11-04T01:37:25.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.356+0000 7f9c26ffd640 1 -- 172.21.15.114:0/2499383609 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18796 (secure 0 0 0) 0x7f9c2007a060 con 0x7f9c3015e8a0 2023-11-04T01:37:25.358 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:25.358 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:11.562429+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:25.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.358+0000 7f9c34fb6640 1 -- 172.21.15.114:0/2499383609 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9c1006ae70 msgr2=0x7f9c1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.358+0000 7f9c34fb6640 1 --2- 172.21.15.114:0/2499383609 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9c1006ae70 0x7f9c1006d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9c300b5ba0 tx=0x7f9c28007550 comp rx=0 tx=0).stop 2023-11-04T01:37:25.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.358+0000 7f9c34fb6640 1 -- 172.21.15.114:0/2499383609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c3015e8a0 msgr2=0x7f9c300c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.358+0000 7f9c34fb6640 1 --2- 172.21.15.114:0/2499383609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c3015e8a0 0x7f9c300c81b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9c2002bee0 tx=0x7f9c200046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.358+0000 7f9c34fb6640 1 -- 172.21.15.114:0/2499383609 shutdown_connections 2023-11-04T01:37:25.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.358+0000 7f9c34fb6640 1 --2- 172.21.15.114:0/2499383609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c3015e8a0 0x7f9c300c81b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.358+0000 7f9c34fb6640 1 --2- 172.21.15.114:0/2499383609 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9c1006ae70 0x7f9c1006d330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.358+0000 7f9c34fb6640 1 --2- 172.21.15.114:0/2499383609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9c3015ce60 0x7f9c300c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.358+0000 7f9c34fb6640 1 --2- 172.21.15.114:0/2499383609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9c300cf160 0x7f9c30150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.358+0000 7f9c34fb6640 1 -- 172.21.15.114:0/2499383609 >> 172.21.15.114:0/2499383609 conn(0x7f9c3006ea90 msgr2=0x7f9c301608e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:25.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.358+0000 7f9c34fb6640 1 -- 172.21.15.114:0/2499383609 shutdown_connections 2023-11-04T01:37:25.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.358+0000 7f9c34fb6640 1 -- 172.21.15.114:0/2499383609 wait complete. 2023-11-04T01:37:25.371 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:25.371 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:25.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.473+0000 7fcdb8925640 1 Processor -- start 2023-11-04T01:37:25.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.473+0000 7fcdb8925640 1 -- start start 2023-11-04T01:37:25.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb8925640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcdb40cd6d0 0x7fcdb4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb8925640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb40cde60 con 0x7fcdb4153e60 2023-11-04T01:37:25.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb8925640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb4160f90 con 0x7fcdb40b4880 2023-11-04T01:37:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb8925640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4161960 con 0x7fcdb40cd6d0 2023-11-04T01:37:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb259c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcdb4153e60 0x7fcdb415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51628/0 (socket says 172.21.15.114:51628) 2023-11-04T01:37:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb259c640 1 -- 172.21.15.114:0/2963464022 learned_addr learned my addr 172.21.15.114:0/2963464022 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb1d9b640 1 --2- 172.21.15.114:0/2963464022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcdb40cd6d0 0x7fcdb4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb159a640 1 -- 172.21.15.114:0/2963464022 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501394924 0 0) 0x7fcdb40cde60 con 0x7fcdb4153e60 2023-11-04T01:37:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb159a640 1 -- 172.21.15.114:0/2963464022 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd9c003520 con 0x7fcdb4153e60 2023-11-04T01:37:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb159a640 1 -- 172.21.15.114:0/2963464022 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2018974560 0 0) 0x7fcd9c003520 con 0x7fcdb4153e60 2023-11-04T01:37:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb159a640 1 -- 172.21.15.114:0/2963464022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcdb40cd6d0 msgr2=0x7fcdb4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb159a640 1 --2- 172.21.15.114:0/2963464022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcdb40cd6d0 0x7fcdb4161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb159a640 1 -- 172.21.15.114:0/2963464022 >> v1:172.21.15.141:6789/0 conn(0x7fcdb40b4880 legacy=0x7fcdb40b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb159a640 1 -- 172.21.15.114:0/2963464022 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb40ce090 con 0x7fcdb4153e60 2023-11-04T01:37:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb159a640 1 -- 172.21.15.114:0/2963464022 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fcda4001670 con 0x7fcdb4153e60 2023-11-04T01:37:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb159a640 1 -- 172.21.15.114:0/2963464022 >> v1:172.21.15.114:6789/0 conn(0x7fcdb4153e60 legacy=0x7fcdb415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb159a640 1 --2- 172.21.15.114:0/2963464022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd9c0039a0 0x7fcd9c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb159a640 1 --2- 172.21.15.114:0/2963464022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcdb40cd6d0 0x7fcd9c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb159a640 1 --2- 172.21.15.114:0/2963464022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd9c004d00 0x7fcd9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb159a640 1 -- 172.21.15.114:0/2963464022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4161960 con 0x7fcd9c004d00 2023-11-04T01:37:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb159a640 1 -- 172.21.15.114:0/2963464022 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c00ba60 con 0x7fcd9c0039a0 2023-11-04T01:37:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.474+0000 7fcdb159a640 1 -- 172.21.15.114:0/2963464022 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c00bc20 con 0x7fcdb40cd6d0 2023-11-04T01:37:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.475+0000 7fcdb2d9d640 1 --2- 172.21.15.114:0/2963464022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd9c004d00 0x7fcd9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.475+0000 7fcdb259c640 1 --2- 172.21.15.114:0/2963464022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd9c0039a0 0x7fcd9c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.475+0000 7fcdb1d9b640 1 --2- 172.21.15.114:0/2963464022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcdb40cd6d0 0x7fcd9c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.475+0000 7fcdb2d9d640 1 -- 172.21.15.114:0/2963464022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcdb40cd6d0 msgr2=0x7fcd9c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.475+0000 7fcdb2d9d640 1 --2- 172.21.15.114:0/2963464022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcdb40cd6d0 0x7fcd9c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.475+0000 7fcdb2d9d640 1 -- 172.21.15.114:0/2963464022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd9c0039a0 msgr2=0x7fcd9c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.475+0000 7fcdb2d9d640 1 --2- 172.21.15.114:0/2963464022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcd9c0039a0 0x7fcd9c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.475+0000 7fcdb2d9d640 1 -- 172.21.15.114:0/2963464022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c003520 con 0x7fcd9c004d00 2023-11-04T01:37:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.476+0000 7fcdb2d9d640 1 --2- 172.21.15.114:0/2963464022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd9c004d00 0x7fcd9c005180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcdac001e20 tx=0x7fcd9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cb40c946ea4840 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.476+0000 7fcdb159a640 1 -- 172.21.15.114:0/2963464022 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac003b70 con 0x7fcd9c004d00 2023-11-04T01:37:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.476+0000 7fcdb159a640 1 -- 172.21.15.114:0/2963464022 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac003cd0 con 0x7fcd9c004d00 2023-11-04T01:37:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.476+0000 7fcdb159a640 1 -- 172.21.15.114:0/2963464022 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac005310 con 0x7fcd9c004d00 2023-11-04T01:37:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.476+0000 7fcdb8925640 1 -- 172.21.15.114:0/2963464022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd9c004d00 msgr2=0x7fcd9c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.476+0000 7fcdb8925640 1 --2- 172.21.15.114:0/2963464022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd9c004d00 0x7fcd9c005180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcdac001e20 tx=0x7fcd9c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.476+0000 7fcdb2d9d640 1 -- 172.21.15.114:0/2963464022 reap_dead start 2023-11-04T01:37:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.476+0000 7fcdb8925640 1 -- 172.21.15.114:0/2963464022 shutdown_connections 2023-11-04T01:37:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.476+0000 7fcdb8925640 1 -- 172.21.15.114:0/2963464022 >> 172.21.15.114:0/2963464022 conn(0x7fcdb40cf880 msgr2=0x7fcdb40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.476+0000 7fcdb8925640 1 -- 172.21.15.114:0/2963464022 shutdown_connections 2023-11-04T01:37:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.476+0000 7fcdb8925640 1 -- 172.21.15.114:0/2963464022 wait complete. 2023-11-04T01:37:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.478+0000 7fcdb8925640 1 Processor -- start 2023-11-04T01:37:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.478+0000 7fcdb8925640 1 -- start start 2023-11-04T01:37:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.478+0000 7fcdb8925640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd9c004d00 0x7fcdb40ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.478+0000 7fcdb8925640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcdb4150de0 0x7fcdb41f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.478+0000 7fcdb8925640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb4151240 0x7fcdb41f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.478+0000 7fcdb8925640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4152420 con 0x7fcdb4151240 2023-11-04T01:37:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.478+0000 7fcdb8925640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb41517a0 con 0x7fcdb4150de0 2023-11-04T01:37:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.478+0000 7fcdb8925640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4151a80 con 0x7fcd9c004d00 2023-11-04T01:37:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.478+0000 7fcdb2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb4151240 0x7fcdb41f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.479+0000 7fcdb2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb4151240 0x7fcdb41f1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43948/0 (socket says 172.21.15.114:43948) 2023-11-04T01:37:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.479+0000 7fcdb2d9d640 1 -- 172.21.15.114:0/3914044948 learned_addr learned my addr 172.21.15.114:0/3914044948 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:25.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.479+0000 7fcdb1d9b640 1 --2- 172.21.15.114:0/3914044948 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcdb4150de0 0x7fcdb41f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.479+0000 7fcdb259c640 1 --2- 172.21.15.114:0/3914044948 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd9c004d00 0x7fcdb40ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.479+0000 7fcdb2d9d640 1 -- 172.21.15.114:0/3914044948 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd9c004d00 msgr2=0x7fcdb40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.479+0000 7fcdb2d9d640 1 --2- 172.21.15.114:0/3914044948 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd9c004d00 0x7fcdb40ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.479+0000 7fcdb2d9d640 1 -- 172.21.15.114:0/3914044948 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcdb4150de0 msgr2=0x7fcdb41f1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.479+0000 7fcdb2d9d640 1 --2- 172.21.15.114:0/3914044948 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcdb4150de0 0x7fcdb41f1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.479+0000 7fcdb2d9d640 1 -- 172.21.15.114:0/3914044948 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb4151d60 con 0x7fcdb4151240 2023-11-04T01:37:25.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.479+0000 7fcdb2d9d640 1 --2- 172.21.15.114:0/3914044948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb4151240 0x7fcdb41f1f40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcdac001f40 tx=0x7fcdac0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.479+0000 7fcda2ffd640 1 -- 172.21.15.114:0/3914044948 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac03e070 con 0x7fcdb4151240 2023-11-04T01:37:25.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.479+0000 7fcda2ffd640 1 -- 172.21.15.114:0/3914044948 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac007db0 con 0x7fcdb4151240 2023-11-04T01:37:25.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.479+0000 7fcdb8925640 1 -- 172.21.15.114:0/3914044948 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb4152040 con 0x7fcdb4151240 2023-11-04T01:37:25.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.479+0000 7fcda2ffd640 1 -- 172.21.15.114:0/3914044948 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac006d90 con 0x7fcdb4151240 2023-11-04T01:37:25.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.479+0000 7fcdb8925640 1 -- 172.21.15.114:0/3914044948 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb4145f10 con 0x7fcdb4151240 2023-11-04T01:37:25.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.480+0000 7fcdb8925640 1 -- 172.21.15.114:0/3914044948 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb41521d0 con 0x7fcdb4151240 2023-11-04T01:37:25.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.481+0000 7fcda2ffd640 1 -- 172.21.15.114:0/3914044948 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcdac007030 con 0x7fcdb4151240 2023-11-04T01:37:25.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.481+0000 7fcda2ffd640 1 --2- 172.21.15.114:0/3914044948 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcd9406ae70 0x7fcd9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.481+0000 7fcda2ffd640 1 -- 172.21.15.114:0/3914044948 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcdac0aad60 con 0x7fcdb4151240 2023-11-04T01:37:25.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.481+0000 7fcdb259c640 1 --2- 172.21.15.114:0/3914044948 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcd9406ae70 0x7fcd9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.481+0000 7fcdb259c640 1 --2- 172.21.15.114:0/3914044948 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcd9406ae70 0x7fcd9406d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcda4001b40 tx=0x7fcda40016d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.485+0000 7fcda2ffd640 1 -- 172.21.15.114:0/3914044948 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcdac075b00 con 0x7fcdb4151240 2023-11-04T01:37:25.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.654+0000 7fcdb8925640 1 -- 172.21.15.114:0/3914044948 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcdb4074290 con 0x7fcdb4151240 2023-11-04T01:37:25.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.654+0000 7fcda2ffd640 1 -- 172.21.15.114:0/3914044948 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcdac0480a0 con 0x7fcdb4151240 2023-11-04T01:37:25.656 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:37:25.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.656+0000 7fcdb8925640 1 -- 172.21.15.114:0/3914044948 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcd9406ae70 msgr2=0x7fcd9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.656+0000 7fcdb8925640 1 --2- 172.21.15.114:0/3914044948 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcd9406ae70 0x7fcd9406d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcda4001b40 tx=0x7fcda40016d0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.656+0000 7fcdb8925640 1 -- 172.21.15.114:0/3914044948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb4151240 msgr2=0x7fcdb41f1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.656+0000 7fcdb8925640 1 --2- 172.21.15.114:0/3914044948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb4151240 0x7fcdb41f1f40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcdac001f40 tx=0x7fcdac0014a0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.656+0000 7fcdb8925640 1 -- 172.21.15.114:0/3914044948 shutdown_connections 2023-11-04T01:37:25.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.656+0000 7fcdb8925640 1 --2- 172.21.15.114:0/3914044948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb4151240 0x7fcdb41f1f40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.656+0000 7fcdb8925640 1 --2- 172.21.15.114:0/3914044948 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcd9406ae70 0x7fcd9406d330 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.656+0000 7fcdb8925640 1 --2- 172.21.15.114:0/3914044948 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcdb4150de0 0x7fcdb41f1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.656+0000 7fcdb8925640 1 --2- 172.21.15.114:0/3914044948 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcd9c004d00 0x7fcdb40ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.656+0000 7fcdb8925640 1 -- 172.21.15.114:0/3914044948 >> 172.21.15.114:0/3914044948 conn(0x7fcdb40cf880 msgr2=0x7fcdb40d2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:25.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.657+0000 7fcdb8925640 1 -- 172.21.15.114:0/3914044948 shutdown_connections 2023-11-04T01:37:25.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.657+0000 7fcdb8925640 1 -- 172.21.15.114:0/3914044948 wait complete. 2023-11-04T01:37:25.669 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.768+0000 7f095fd33640 1 Processor -- start 2023-11-04T01:37:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.769+0000 7f095fd33640 1 -- start start 2023-11-04T01:37:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.769+0000 7f095fd33640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0958071f90 0x7f09580b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.769+0000 7f095fd33640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f095815add0 0x7f09580cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.769+0000 7f095fd33640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09580b1cc0 con 0x7f0958072370 2023-11-04T01:37:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.769+0000 7f095fd33640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09580b1fa0 con 0x7f0958071f90 2023-11-04T01:37:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.769+0000 7f095fd33640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095815a0e0 con 0x7f095815add0 2023-11-04T01:37:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.770+0000 7f095dacf640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0958071f90 0x7f09580b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.770+0000 7f095dacf640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0958071f90 0x7f09580b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43956/0 (socket says 172.21.15.114:43956) 2023-11-04T01:37:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.770+0000 7f095dacf640 1 -- 172.21.15.114:0/3816961031 learned_addr learned my addr 172.21.15.114:0/3816961031 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.770+0000 7f095d2ce640 1 --2- 172.21.15.114:0/3816961031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f095815add0 0x7f09580cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.770+0000 7f095dacf640 1 -- 172.21.15.114:0/3816961031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f095815add0 msgr2=0x7f09580cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:25.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.770+0000 7f095dacf640 1 --2- 172.21.15.114:0/3816961031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f095815add0 0x7f09580cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.770+0000 7f095dacf640 1 -- 172.21.15.114:0/3816961031 >> v1:172.21.15.141:6789/0 conn(0x7f0958072370 legacy=0x7f09580cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:25.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.770+0000 7f095dacf640 1 -- 172.21.15.114:0/3816961031 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095815a2f0 con 0x7f0958071f90 2023-11-04T01:37:25.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.771+0000 7f095dacf640 1 --2- 172.21.15.114:0/3816961031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0958071f90 0x7f09580b1490 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f095000d150 tx=0x7f095002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43fb74dd537eae9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.771+0000 7f095cacd640 1 -- 172.21.15.114:0/3816961031 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095002ea80 con 0x7f0958071f90 2023-11-04T01:37:25.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.771+0000 7f095cacd640 1 -- 172.21.15.114:0/3816961031 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095002ebe0 con 0x7f0958071f90 2023-11-04T01:37:25.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.771+0000 7f095cacd640 1 -- 172.21.15.114:0/3816961031 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0950009600 con 0x7f0958071f90 2023-11-04T01:37:25.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.771+0000 7f095fd33640 1 -- 172.21.15.114:0/3816961031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0958071f90 msgr2=0x7f09580b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.771+0000 7f095fd33640 1 --2- 172.21.15.114:0/3816961031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0958071f90 0x7f09580b1490 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f095000d150 tx=0x7f095002e0e0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.771+0000 7f095fd33640 1 -- 172.21.15.114:0/3816961031 shutdown_connections 2023-11-04T01:37:25.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.771+0000 7f095fd33640 1 --2- 172.21.15.114:0/3816961031 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f095815add0 0x7f09580cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.771+0000 7f095fd33640 1 --2- 172.21.15.114:0/3816961031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0958071f90 0x7f09580b1490 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.771+0000 7f095fd33640 1 -- 172.21.15.114:0/3816961031 >> 172.21.15.114:0/3816961031 conn(0x7f095806d800 msgr2=0x7f095806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:25.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.771+0000 7f095fd33640 1 -- 172.21.15.114:0/3816961031 shutdown_connections 2023-11-04T01:37:25.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.771+0000 7f095fd33640 1 -- 172.21.15.114:0/3816961031 wait complete. 2023-11-04T01:37:25.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.773+0000 7f095fd33640 1 Processor -- start 2023-11-04T01:37:25.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.773+0000 7f095fd33640 1 -- start start 2023-11-04T01:37:25.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.773+0000 7f095fd33640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0958071f90 0x7f09581f6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.773+0000 7f095fd33640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0958072370 0x7f09580cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.773+0000 7f095fd33640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f095815add0 0x7f09581f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.773+0000 7f095fd33640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09581f62d0 con 0x7f095815add0 2023-11-04T01:37:25.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.773+0000 7f095fd33640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09581f7220 con 0x7f0958072370 2023-11-04T01:37:25.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.773+0000 7f095fd33640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09581f3810 con 0x7f0958071f90 2023-11-04T01:37:25.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.773+0000 7f095e2d0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f095815add0 0x7f09581f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.773+0000 7f095e2d0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f095815add0 0x7f09581f2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43962/0 (socket says 172.21.15.114:43962) 2023-11-04T01:37:25.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.773+0000 7f095e2d0640 1 -- 172.21.15.114:0/789898709 learned_addr learned my addr 172.21.15.114:0/789898709 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:25.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.774+0000 7f095d2ce640 1 --2- 172.21.15.114:0/789898709 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0958072370 0x7f09580cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.774+0000 7f095dacf640 1 --2- 172.21.15.114:0/789898709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0958071f90 0x7f09581f6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.774+0000 7f095e2d0640 1 -- 172.21.15.114:0/789898709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0958071f90 msgr2=0x7f09581f6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.774+0000 7f095e2d0640 1 --2- 172.21.15.114:0/789898709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0958071f90 0x7f09581f6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.774+0000 7f095e2d0640 1 -- 172.21.15.114:0/789898709 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0958072370 msgr2=0x7f09580cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.774+0000 7f095e2d0640 1 --2- 172.21.15.114:0/789898709 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0958072370 0x7f09580cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.774+0000 7f095e2d0640 1 -- 172.21.15.114:0/789898709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095000bd40 con 0x7f095815add0 2023-11-04T01:37:25.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.774+0000 7f095e2d0640 1 --2- 172.21.15.114:0/789898709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f095815add0 0x7f09581f2ca0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f095400c410 tx=0x7f095400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.774+0000 7f094e7fc640 1 -- 172.21.15.114:0/789898709 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954011790 con 0x7f095815add0 2023-11-04T01:37:25.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.774+0000 7f094e7fc640 1 -- 172.21.15.114:0/789898709 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09540118f0 con 0x7f095815add0 2023-11-04T01:37:25.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.774+0000 7f095fd33640 1 -- 172.21.15.114:0/789898709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09581f3af0 con 0x7f095815add0 2023-11-04T01:37:25.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.774+0000 7f094e7fc640 1 -- 172.21.15.114:0/789898709 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954011ce0 con 0x7f095815add0 2023-11-04T01:37:25.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.774+0000 7f095fd33640 1 -- 172.21.15.114:0/789898709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09581f67c0 con 0x7f095815add0 2023-11-04T01:37:25.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.775+0000 7f095fd33640 1 -- 172.21.15.114:0/789898709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09580718d0 con 0x7f095815add0 2023-11-04T01:37:25.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.775+0000 7f094e7fc640 1 -- 172.21.15.114:0/789898709 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f095401c460 con 0x7f095815add0 2023-11-04T01:37:25.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.776+0000 7f094e7fc640 1 --2- 172.21.15.114:0/789898709 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f093c06ae70 0x7f093c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:25.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.776+0000 7f095dacf640 1 --2- 172.21.15.114:0/789898709 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f093c06ae70 0x7f093c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:25.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.776+0000 7f094e7fc640 1 -- 172.21.15.114:0/789898709 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0954089670 con 0x7f095815add0 2023-11-04T01:37:25.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.776+0000 7f095dacf640 1 --2- 172.21.15.114:0/789898709 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f093c06ae70 0x7f093c06d330 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0950037000 tx=0x7f0950032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:25.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.780+0000 7f094e7fc640 1 -- 172.21.15.114:0/789898709 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0954054360 con 0x7f095815add0 2023-11-04T01:37:25.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.946+0000 7f095fd33640 1 -- 172.21.15.114:0/789898709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f09580cfbf0 con 0x7f095815add0 2023-11-04T01:37:25.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.946+0000 7f094e7fc640 1 -- 172.21.15.114:0/789898709 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0954057980 con 0x7f095815add0 2023-11-04T01:37:25.949 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:25.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.948+0000 7f095fd33640 1 -- 172.21.15.114:0/789898709 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f093c06ae70 msgr2=0x7f093c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.948+0000 7f095fd33640 1 --2- 172.21.15.114:0/789898709 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f093c06ae70 0x7f093c06d330 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0950037000 tx=0x7f0950032000 comp rx=0 tx=0).stop 2023-11-04T01:37:25.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.948+0000 7f095fd33640 1 -- 172.21.15.114:0/789898709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f095815add0 msgr2=0x7f09581f2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:25.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.948+0000 7f095fd33640 1 --2- 172.21.15.114:0/789898709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f095815add0 0x7f09581f2ca0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f095400c410 tx=0x7f095400c8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.948+0000 7f095fd33640 1 -- 172.21.15.114:0/789898709 shutdown_connections 2023-11-04T01:37:25.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.948+0000 7f095fd33640 1 --2- 172.21.15.114:0/789898709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f095815add0 0x7f09581f2ca0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.948+0000 7f095fd33640 1 --2- 172.21.15.114:0/789898709 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f093c06ae70 0x7f093c06d330 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.948+0000 7f095fd33640 1 --2- 172.21.15.114:0/789898709 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0958072370 0x7f09580cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.948+0000 7f095fd33640 1 --2- 172.21.15.114:0/789898709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0958071f90 0x7f09581f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.948+0000 7f095fd33640 1 -- 172.21.15.114:0/789898709 >> 172.21.15.114:0/789898709 conn(0x7f095806d800 msgr2=0x7f09581594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.948+0000 7f095fd33640 1 -- 172.21.15.114:0/789898709 shutdown_connections 2023-11-04T01:37:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:25.948+0000 7f095fd33640 1 -- 172.21.15.114:0/789898709 wait complete. 2023-11-04T01:37:25.961 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:26.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.062+0000 7f7ee450f640 1 Processor -- start 2023-11-04T01:37:26.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.062+0000 7f7ee450f640 1 -- start start 2023-11-04T01:37:26.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.063+0000 7f7ee450f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7edc0b1a40 0x7f7edc0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.063+0000 7f7ee450f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7edc06a830 0x7f7edc0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.063+0000 7f7ee450f640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7edc160990 con 0x7f7edc1605b0 2023-11-04T01:37:26.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.063+0000 7f7ee450f640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc0cc7c0 con 0x7f7edc06a830 2023-11-04T01:37:26.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.063+0000 7f7ee450f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0cd750 con 0x7f7edc0b1a40 2023-11-04T01:37:26.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.063+0000 7f7ee2aac640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7edc06a830 0x7f7edc0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.063+0000 7f7ee1aaa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7edc0b1a40 0x7f7edc0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.063+0000 7f7ee22ab640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f7edc1605b0 0x7f7edc06a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:37916/0 (socket says 172.21.15.114:37916) 2023-11-04T01:37:26.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.063+0000 7f7ee22ab640 1 -- 172.21.15.114:0/3023796812 learned_addr learned my addr 172.21.15.114:0/3023796812 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:26.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.063+0000 7f7ee1aaa640 1 -- 172.21.15.114:0/3023796812 >> v2:172.21.15.141:3300/0 conn(0x7f7edc06a830 msgr2=0x7f7edc0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:26.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.063+0000 7f7ee1aaa640 1 --2- 172.21.15.114:0/3023796812 >> v2:172.21.15.141:3300/0 conn(0x7f7edc06a830 0x7f7edc0cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.063+0000 7f7ee1aaa640 1 -- 172.21.15.114:0/3023796812 >> v1:172.21.15.141:6789/0 conn(0x7f7edc1605b0 legacy=0x7f7edc06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.063+0000 7f7ee1aaa640 1 -- 172.21.15.114:0/3023796812 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc0cc4e0 con 0x7f7edc0b1a40 2023-11-04T01:37:26.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.063+0000 7f7ee2aac640 1 --2- 172.21.15.114:0/3023796812 >> v2:172.21.15.141:3300/0 conn(0x7f7edc06a830 0x7f7edc0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:26.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.064+0000 7f7ee1aaa640 1 --2- 172.21.15.114:0/3023796812 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7edc0b1a40 0x7f7edc0ccbc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc0097a0 tx=0x7f7ecc02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97750754aa96c2e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.064+0000 7f7ee12a9640 1 -- 172.21.15.114:0/3023796812 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc02f050 con 0x7f7edc0b1a40 2023-11-04T01:37:26.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.064+0000 7f7ee12a9640 1 -- 172.21.15.114:0/3023796812 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc031700 con 0x7f7edc0b1a40 2023-11-04T01:37:26.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.064+0000 7f7ee12a9640 1 -- 172.21.15.114:0/3023796812 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc031a90 con 0x7f7edc0b1a40 2023-11-04T01:37:26.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.065+0000 7f7ee450f640 1 -- 172.21.15.114:0/3023796812 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7edc0b1a40 msgr2=0x7f7edc0ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.065+0000 7f7ee450f640 1 --2- 172.21.15.114:0/3023796812 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7edc0b1a40 0x7f7edc0ccbc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc0097a0 tx=0x7f7ecc02b7a0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.065+0000 7f7ee450f640 1 -- 172.21.15.114:0/3023796812 shutdown_connections 2023-11-04T01:37:26.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.065+0000 7f7ee450f640 1 --2- 172.21.15.114:0/3023796812 >> v2:172.21.15.141:3300/0 conn(0x7f7edc06a830 0x7f7edc0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.065+0000 7f7ee450f640 1 --2- 172.21.15.114:0/3023796812 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7edc0b1a40 0x7f7edc0ccbc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.065+0000 7f7ee450f640 1 -- 172.21.15.114:0/3023796812 >> 172.21.15.114:0/3023796812 conn(0x7f7edc071820 msgr2=0x7f7edc071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.065+0000 7f7ee450f640 1 -- 172.21.15.114:0/3023796812 shutdown_connections 2023-11-04T01:37:26.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.065+0000 7f7ee450f640 1 -- 172.21.15.114:0/3023796812 wait complete. 2023-11-04T01:37:26.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.066+0000 7f7ee450f640 1 Processor -- start 2023-11-04T01:37:26.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.066+0000 7f7ee450f640 1 -- start start 2023-11-04T01:37:26.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee450f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7edc06a830 0x7f7edc0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee450f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7edc1605b0 0x7f7edc0c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee450f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7edc0c8a60 0x7f7edc0c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee450f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0c8ee0 con 0x7f7edc1605b0 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee450f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc15bb50 con 0x7f7edc0c8a60 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee450f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0c99a0 con 0x7f7edc06a830 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee1aaa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7edc1605b0 0x7f7edc0c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee1aaa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7edc1605b0 0x7f7edc0c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43970/0 (socket says 172.21.15.114:43970) 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee1aaa640 1 -- 172.21.15.114:0/4020870378 learned_addr learned my addr 172.21.15.114:0/4020870378 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee22ab640 1 --2- 172.21.15.114:0/4020870378 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7edc06a830 0x7f7edc0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee2aac640 1 --2- 172.21.15.114:0/4020870378 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7edc0c8a60 0x7f7edc0c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee1aaa640 1 -- 172.21.15.114:0/4020870378 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7edc06a830 msgr2=0x7f7edc0b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee1aaa640 1 --2- 172.21.15.114:0/4020870378 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7edc06a830 0x7f7edc0b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee1aaa640 1 -- 172.21.15.114:0/4020870378 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7edc0c8a60 msgr2=0x7f7edc0c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee1aaa640 1 --2- 172.21.15.114:0/4020870378 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7edc0c8a60 0x7f7edc0c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee1aaa640 1 -- 172.21.15.114:0/4020870378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4009a70 con 0x7f7edc1605b0 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee22ab640 1 --2- 172.21.15.114:0/4020870378 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7edc06a830 0x7f7edc0b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee2aac640 1 --2- 172.21.15.114:0/4020870378 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7edc0c8a60 0x7f7edc0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.067+0000 7f7ee1aaa640 1 --2- 172.21.15.114:0/4020870378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7edc1605b0 0x7f7edc0c8520 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc036040 tx=0x7f7ecc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.068+0000 7f7ed2ffd640 1 -- 172.21.15.114:0/4020870378 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc033930 con 0x7f7edc1605b0 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.068+0000 7f7ed2ffd640 1 -- 172.21.15.114:0/4020870378 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc033ab0 con 0x7f7edc1605b0 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.068+0000 7f7ed2ffd640 1 -- 172.21.15.114:0/4020870378 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc033e60 con 0x7f7edc1605b0 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.068+0000 7f7ee450f640 1 -- 172.21.15.114:0/4020870378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ecc009400 con 0x7f7edc1605b0 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.068+0000 7f7ee450f640 1 -- 172.21.15.114:0/4020870378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc14c960 con 0x7f7edc1605b0 2023-11-04T01:37:26.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.069+0000 7f7ee450f640 1 -- 172.21.15.114:0/4020870378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7edc0672a0 con 0x7f7edc1605b0 2023-11-04T01:37:26.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.069+0000 7f7ed2ffd640 1 -- 172.21.15.114:0/4020870378 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ecc03a040 con 0x7f7edc1605b0 2023-11-04T01:37:26.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.069+0000 7f7ed2ffd640 1 --2- 172.21.15.114:0/4020870378 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7ec006ae70 0x7f7ec006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.069+0000 7f7ed2ffd640 1 -- 172.21.15.114:0/4020870378 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7ecc0aabe0 con 0x7f7edc1605b0 2023-11-04T01:37:26.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.070+0000 7f7ee22ab640 1 --2- 172.21.15.114:0/4020870378 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7ec006ae70 0x7f7ec006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.070+0000 7f7ee22ab640 1 --2- 172.21.15.114:0/4020870378 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7ec006ae70 0x7f7ec006d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8005880 tx=0x7f7ed8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.074+0000 7f7ed2ffd640 1 -- 172.21.15.114:0/4020870378 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7ecc075850 con 0x7f7edc1605b0 2023-11-04T01:37:26.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.238+0000 7f7ee450f640 1 -- 172.21.15.114:0/4020870378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7edc074290 con 0x7f7edc1605b0 2023-11-04T01:37:26.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.239+0000 7f7ed2ffd640 1 -- 172.21.15.114:0/4020870378 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7ecc038020 con 0x7f7edc1605b0 2023-11-04T01:37:26.241 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:37:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.241+0000 7f7ee450f640 1 -- 172.21.15.114:0/4020870378 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7ec006ae70 msgr2=0x7f7ec006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.241+0000 7f7ee450f640 1 --2- 172.21.15.114:0/4020870378 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7ec006ae70 0x7f7ec006d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8005880 tx=0x7f7ed8009040 comp rx=0 tx=0).stop 2023-11-04T01:37:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.241+0000 7f7ee450f640 1 -- 172.21.15.114:0/4020870378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7edc1605b0 msgr2=0x7f7edc0c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.241+0000 7f7ee450f640 1 --2- 172.21.15.114:0/4020870378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7edc1605b0 0x7f7edc0c8520 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc036040 tx=0x7f7ecc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.241+0000 7f7ee450f640 1 -- 172.21.15.114:0/4020870378 shutdown_connections 2023-11-04T01:37:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.241+0000 7f7ee450f640 1 --2- 172.21.15.114:0/4020870378 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7ec006ae70 0x7f7ec006d330 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.241+0000 7f7ee450f640 1 --2- 172.21.15.114:0/4020870378 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7edc0c8a60 0x7f7edc0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.241+0000 7f7ee450f640 1 --2- 172.21.15.114:0/4020870378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7edc1605b0 0x7f7edc0c8520 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.241+0000 7f7ee450f640 1 --2- 172.21.15.114:0/4020870378 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7edc06a830 0x7f7edc0b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.241+0000 7f7ee450f640 1 -- 172.21.15.114:0/4020870378 >> 172.21.15.114:0/4020870378 conn(0x7f7edc071820 msgr2=0x7f7edc0afd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.241+0000 7f7ee450f640 1 -- 172.21.15.114:0/4020870378 shutdown_connections 2023-11-04T01:37:26.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.241+0000 7f7ee450f640 1 -- 172.21.15.114:0/4020870378 wait complete. 2023-11-04T01:37:26.253 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:26.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.354+0000 7f86dcab4640 1 Processor -- start 2023-11-04T01:37:26.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.354+0000 7f86dcab4640 1 -- start start 2023-11-04T01:37:26.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.355+0000 7f86dcab4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86d815ad30 0x7f86d80adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.355+0000 7f86dcab4640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f86d80ad730 0x7f86d8070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.355+0000 7f86dcab4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d80c3900 con 0x7f86d8070c50 2023-11-04T01:37:26.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.355+0000 7f86dcab4640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d80ae260 con 0x7f86d80ad730 2023-11-04T01:37:26.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.355+0000 7f86dcab4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d815f750 con 0x7f86d815ad30 2023-11-04T01:37:26.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.355+0000 7f86d6d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f86d8070c50 0x7f86d80c8fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51632/0 (socket says 172.21.15.114:51632) 2023-11-04T01:37:26.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.355+0000 7f86d6d9d640 1 -- 172.21.15.114:0/2597858206 learned_addr learned my addr 172.21.15.114:0/2597858206 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:26.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.355+0000 7f86d5d9b640 1 --2- 172.21.15.114:0/2597858206 >> v2:172.21.15.141:3300/0 conn(0x7f86d80ad730 0x7f86d8070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.355+0000 7f86d659c640 1 --2- 172.21.15.114:0/2597858206 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86d815ad30 0x7f86d80adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.355+0000 7f86d559a640 1 -- 172.21.15.114:0/2597858206 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830387553 0 0) 0x7f86d80c3900 con 0x7f86d8070c50 2023-11-04T01:37:26.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.355+0000 7f86d559a640 1 -- 172.21.15.114:0/2597858206 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c0003520 con 0x7f86d8070c50 2023-11-04T01:37:26.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.355+0000 7f86d559a640 1 -- 172.21.15.114:0/2597858206 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2202479416 0 0) 0x7f86c0003520 con 0x7f86d8070c50 2023-11-04T01:37:26.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.355+0000 7f86d659c640 1 -- 172.21.15.114:0/2597858206 >> v2:172.21.15.141:3300/0 conn(0x7f86d80ad730 msgr2=0x7f86d8070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:26.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.355+0000 7f86d659c640 1 --2- 172.21.15.114:0/2597858206 >> v2:172.21.15.141:3300/0 conn(0x7f86d80ad730 0x7f86d8070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.355+0000 7f86d659c640 1 -- 172.21.15.114:0/2597858206 >> v1:172.21.15.114:6789/0 conn(0x7f86d8070c50 legacy=0x7f86d80c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.355+0000 7f86d659c640 1 -- 172.21.15.114:0/2597858206 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d80c3be0 con 0x7f86d815ad30 2023-11-04T01:37:26.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.356+0000 7f86d659c640 1 --2- 172.21.15.114:0/2597858206 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86d815ad30 0x7f86d80adc80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f86c80097d0 tx=0x7f86c802b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f7fc65b3d72faa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.356+0000 7f86d559a640 1 -- 172.21.15.114:0/2597858206 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d00019f0 con 0x7f86d815ad30 2023-11-04T01:37:26.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.356+0000 7f86d559a640 1 -- 172.21.15.114:0/2597858206 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c802e050 con 0x7f86d815ad30 2023-11-04T01:37:26.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.356+0000 7f86d559a640 1 -- 172.21.15.114:0/2597858206 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8030730 con 0x7f86d815ad30 2023-11-04T01:37:26.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.357+0000 7f86dcab4640 1 -- 172.21.15.114:0/2597858206 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86d815ad30 msgr2=0x7f86d80adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.357+0000 7f86dcab4640 1 --2- 172.21.15.114:0/2597858206 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86d815ad30 0x7f86d80adc80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f86c80097d0 tx=0x7f86c802b6e0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.357+0000 7f86dcab4640 1 -- 172.21.15.114:0/2597858206 shutdown_connections 2023-11-04T01:37:26.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.357+0000 7f86dcab4640 1 --2- 172.21.15.114:0/2597858206 >> v2:172.21.15.141:3300/0 conn(0x7f86d80ad730 0x7f86d8070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.357+0000 7f86dcab4640 1 --2- 172.21.15.114:0/2597858206 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86d815ad30 0x7f86d80adc80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.357+0000 7f86dcab4640 1 -- 172.21.15.114:0/2597858206 >> 172.21.15.114:0/2597858206 conn(0x7f86d80ce950 msgr2=0x7f86d80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.357+0000 7f86dcab4640 1 -- 172.21.15.114:0/2597858206 shutdown_connections 2023-11-04T01:37:26.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.357+0000 7f86dcab4640 1 -- 172.21.15.114:0/2597858206 wait complete. 2023-11-04T01:37:26.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.358+0000 7f86dcab4640 1 Processor -- start 2023-11-04T01:37:26.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.358+0000 7f86dcab4640 1 -- start start 2023-11-04T01:37:26.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.359+0000 7f86dcab4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86d8070c50 0x7f86d80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.359+0000 7f86dcab4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86d80ad730 0x7f86d8151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.359+0000 7f86dcab4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86d815ad30 0x7f86d80c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.359+0000 7f86dcab4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d81f5a50 con 0x7f86d8070c50 2023-11-04T01:37:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.359+0000 7f86dcab4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d80abe20 con 0x7f86d815ad30 2023-11-04T01:37:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.359+0000 7f86dcab4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d80ac100 con 0x7f86d80ad730 2023-11-04T01:37:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.359+0000 7f86d659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86d8070c50 0x7f86d80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.359+0000 7f86d659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86d8070c50 0x7f86d80ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43974/0 (socket says 172.21.15.114:43974) 2023-11-04T01:37:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.359+0000 7f86d659c640 1 -- 172.21.15.114:0/2637129396 learned_addr learned my addr 172.21.15.114:0/2637129396 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.359+0000 7f86d6d9d640 1 --2- 172.21.15.114:0/2637129396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86d815ad30 0x7f86d80c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.359+0000 7f86d659c640 1 -- 172.21.15.114:0/2637129396 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86d80ad730 msgr2=0x7f86d8151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.359+0000 7f86d659c640 1 --2- 172.21.15.114:0/2637129396 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86d80ad730 0x7f86d8151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.359+0000 7f86d659c640 1 -- 172.21.15.114:0/2637129396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86d815ad30 msgr2=0x7f86d80c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.359+0000 7f86d659c640 1 --2- 172.21.15.114:0/2637129396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86d815ad30 0x7f86d80c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.359+0000 7f86d659c640 1 -- 172.21.15.114:0/2637129396 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c8009400 con 0x7f86d8070c50 2023-11-04T01:37:26.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.359+0000 7f86d6d9d640 1 --2- 172.21.15.114:0/2637129396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86d815ad30 0x7f86d80c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:26.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.360+0000 7f86d659c640 1 --2- 172.21.15.114:0/2637129396 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86d8070c50 0x7f86d80ccff0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f86c8035040 tx=0x7f86c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.360+0000 7f86c6ffd640 1 -- 172.21.15.114:0/2637129396 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c803c620 con 0x7f86d8070c50 2023-11-04T01:37:26.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.360+0000 7f86c6ffd640 1 -- 172.21.15.114:0/2637129396 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c803c7c0 con 0x7f86d8070c50 2023-11-04T01:37:26.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.360+0000 7f86dcab4640 1 -- 172.21.15.114:0/2637129396 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d80ac3e0 con 0x7f86d8070c50 2023-11-04T01:37:26.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.360+0000 7f86c6ffd640 1 -- 172.21.15.114:0/2637129396 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c803cb70 con 0x7f86d8070c50 2023-11-04T01:37:26.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.360+0000 7f86dcab4640 1 -- 172.21.15.114:0/2637129396 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d80cd530 con 0x7f86d8070c50 2023-11-04T01:37:26.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.361+0000 7f86dcab4640 1 -- 172.21.15.114:0/2637129396 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d81f5c70 con 0x7f86d8070c50 2023-11-04T01:37:26.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.361+0000 7f86c6ffd640 1 -- 172.21.15.114:0/2637129396 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f86c8039070 con 0x7f86d8070c50 2023-11-04T01:37:26.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.361+0000 7f86c6ffd640 1 --2- 172.21.15.114:0/2637129396 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f86b806ae70 0x7f86b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.361+0000 7f86c6ffd640 1 -- 172.21.15.114:0/2637129396 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f86c80aafb0 con 0x7f86d8070c50 2023-11-04T01:37:26.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.362+0000 7f86d5d9b640 1 --2- 172.21.15.114:0/2637129396 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f86b806ae70 0x7f86b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.362+0000 7f86d5d9b640 1 --2- 172.21.15.114:0/2637129396 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f86b806ae70 0x7f86b806d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f86cc006a90 tx=0x7f86cc006a20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.366+0000 7f86c6ffd640 1 -- 172.21.15.114:0/2637129396 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f86c80ddca0 con 0x7f86d8070c50 2023-11-04T01:37:26.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.530+0000 7f86dcab4640 1 -- 172.21.15.114:0/2637129396 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f86d8074290 con 0x7f86d8070c50 2023-11-04T01:37:26.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.531+0000 7f86c6ffd640 1 -- 172.21.15.114:0/2637129396 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f86c804a0a0 con 0x7f86d8070c50 2023-11-04T01:37:26.533 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:26.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.533+0000 7f86dcab4640 1 -- 172.21.15.114:0/2637129396 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f86b806ae70 msgr2=0x7f86b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.533+0000 7f86dcab4640 1 --2- 172.21.15.114:0/2637129396 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f86b806ae70 0x7f86b806d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f86cc006a90 tx=0x7f86cc006a20 comp rx=0 tx=0).stop 2023-11-04T01:37:26.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.533+0000 7f86dcab4640 1 -- 172.21.15.114:0/2637129396 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86d8070c50 msgr2=0x7f86d80ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.533+0000 7f86dcab4640 1 --2- 172.21.15.114:0/2637129396 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86d8070c50 0x7f86d80ccff0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f86c8035040 tx=0x7f86c80046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.533+0000 7f86dcab4640 1 -- 172.21.15.114:0/2637129396 shutdown_connections 2023-11-04T01:37:26.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.533+0000 7f86dcab4640 1 --2- 172.21.15.114:0/2637129396 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f86b806ae70 0x7f86b806d330 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.533+0000 7f86dcab4640 1 --2- 172.21.15.114:0/2637129396 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f86d815ad30 0x7f86d80c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.533+0000 7f86dcab4640 1 --2- 172.21.15.114:0/2637129396 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f86d80ad730 0x7f86d8151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.533+0000 7f86dcab4640 1 --2- 172.21.15.114:0/2637129396 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86d8070c50 0x7f86d80ccff0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.533+0000 7f86dcab4640 1 -- 172.21.15.114:0/2637129396 >> 172.21.15.114:0/2637129396 conn(0x7f86d80ce950 msgr2=0x7f86d806dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.533+0000 7f86dcab4640 1 -- 172.21.15.114:0/2637129396 shutdown_connections 2023-11-04T01:37:26.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.533+0000 7f86dcab4640 1 -- 172.21.15.114:0/2637129396 wait complete. 2023-11-04T01:37:26.545 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:37:26.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.644+0000 7fa3ec864640 1 Processor -- start 2023-11-04T01:37:26.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.644+0000 7fa3ec864640 1 -- start start 2023-11-04T01:37:26.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.645+0000 7fa3ec864640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa3e8070ff0 0x7fa3e80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.645+0000 7fa3ec864640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e80c9bf0 con 0x7fa3e8066000 2023-11-04T01:37:26.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.645+0000 7fa3ec864640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e80cd890 con 0x7fa3e815d1b0 2023-11-04T01:37:26.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.645+0000 7fa3ec864640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e80cdb30 con 0x7fa3e8070ff0 2023-11-04T01:37:26.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.645+0000 7fa3e6d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa3e8066000 0x7fa3e806a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52394/0 (socket says 172.21.15.114:52394) 2023-11-04T01:37:26.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.645+0000 7fa3e6d9d640 1 -- 172.21.15.114:0/3465345423 learned_addr learned my addr 172.21.15.114:0/3465345423 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:26.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.645+0000 7fa3e559a640 1 -- 172.21.15.114:0/3465345423 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354267964 0 0) 0x7fa3e80c9bf0 con 0x7fa3e8066000 2023-11-04T01:37:26.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.645+0000 7fa3e659c640 1 --2- 172.21.15.114:0/3465345423 >> v2:172.21.15.141:3300/0 conn(0x7fa3e8070ff0 0x7fa3e80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.645+0000 7fa3e559a640 1 -- 172.21.15.114:0/3465345423 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d0003520 con 0x7fa3e8066000 2023-11-04T01:37:26.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e559a640 1 -- 172.21.15.114:0/3465345423 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1406356591 0 0) 0x7fa3d0003520 con 0x7fa3e8066000 2023-11-04T01:37:26.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e559a640 1 -- 172.21.15.114:0/3465345423 >> v2:172.21.15.141:3300/0 conn(0x7fa3e8070ff0 msgr2=0x7fa3e80cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:26.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e559a640 1 --2- 172.21.15.114:0/3465345423 >> v2:172.21.15.141:3300/0 conn(0x7fa3e8070ff0 0x7fa3e80cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e559a640 1 -- 172.21.15.114:0/3465345423 >> v1:172.21.15.141:6789/0 conn(0x7fa3e815d1b0 legacy=0x7fa3e80713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e559a640 1 -- 172.21.15.114:0/3465345423 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e80cde10 con 0x7fa3e8066000 2023-11-04T01:37:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e559a640 1 -- 172.21.15.114:0/3465345423 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fa3e0001670 con 0x7fa3e8066000 2023-11-04T01:37:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e559a640 1 -- 172.21.15.114:0/3465345423 >> v1:172.21.15.114:6789/0 conn(0x7fa3e8066000 legacy=0x7fa3e806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e559a640 1 --2- 172.21.15.114:0/3465345423 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3d0003970 0x7fa3d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e559a640 1 --2- 172.21.15.114:0/3465345423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3d00047c0 0x7fa3d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e559a640 1 --2- 172.21.15.114:0/3465345423 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3d0005180 0x7fa3d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e559a640 1 -- 172.21.15.114:0/3465345423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80cdb30 con 0x7fa3d00047c0 2023-11-04T01:37:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e559a640 1 -- 172.21.15.114:0/3465345423 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d000c020 con 0x7fa3d0005180 2023-11-04T01:37:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e559a640 1 -- 172.21.15.114:0/3465345423 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d000c1e0 con 0x7fa3d0003970 2023-11-04T01:37:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e5d9b640 1 --2- 172.21.15.114:0/3465345423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3d00047c0 0x7fa3d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e659c640 1 --2- 172.21.15.114:0/3465345423 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3d0003970 0x7fa3d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e6d9d640 1 --2- 172.21.15.114:0/3465345423 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3d0005180 0x7fa3d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e5d9b640 1 -- 172.21.15.114:0/3465345423 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3d0003970 msgr2=0x7fa3d0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e5d9b640 1 --2- 172.21.15.114:0/3465345423 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3d0003970 0x7fa3d0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e5d9b640 1 -- 172.21.15.114:0/3465345423 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3d0005180 msgr2=0x7fa3d000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e5d9b640 1 --2- 172.21.15.114:0/3465345423 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3d0005180 0x7fa3d000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e5d9b640 1 -- 172.21.15.114:0/3465345423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d0003520 con 0x7fa3d00047c0 2023-11-04T01:37:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e6d9d640 1 --2- 172.21.15.114:0/3465345423 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3d0005180 0x7fa3d000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.646+0000 7fa3e6d9d640 1 -- 172.21.15.114:0/3465345423 reap_dead start 2023-11-04T01:37:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.647+0000 7fa3e5d9b640 1 --2- 172.21.15.114:0/3465345423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3d00047c0 0x7fa3d0004c40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc001720 tx=0x7fa3d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5176116377084b6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.647+0000 7fa3e559a640 1 -- 172.21.15.114:0/3465345423 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0052d0 con 0x7fa3d00047c0 2023-11-04T01:37:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.647+0000 7fa3e559a640 1 -- 172.21.15.114:0/3465345423 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc02e050 con 0x7fa3d00047c0 2023-11-04T01:37:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.647+0000 7fa3e559a640 1 -- 172.21.15.114:0/3465345423 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc003830 con 0x7fa3d00047c0 2023-11-04T01:37:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.648+0000 7fa3ec864640 1 -- 172.21.15.114:0/3465345423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3d00047c0 msgr2=0x7fa3d0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.648+0000 7fa3ec864640 1 --2- 172.21.15.114:0/3465345423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3d00047c0 0x7fa3d0004c40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc001720 tx=0x7fa3d00057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.648+0000 7fa3ec864640 1 -- 172.21.15.114:0/3465345423 shutdown_connections 2023-11-04T01:37:26.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.648+0000 7fa3ec864640 1 --2- 172.21.15.114:0/3465345423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3d00047c0 0x7fa3d0004c40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.648+0000 7fa3ec864640 1 -- 172.21.15.114:0/3465345423 >> 172.21.15.114:0/3465345423 conn(0x7fa3e80cbc90 msgr2=0x7fa3e80cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.648+0000 7fa3ec864640 1 -- 172.21.15.114:0/3465345423 shutdown_connections 2023-11-04T01:37:26.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.648+0000 7fa3ec864640 1 -- 172.21.15.114:0/3465345423 wait complete. 2023-11-04T01:37:26.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.649+0000 7fa3ec864640 1 Processor -- start 2023-11-04T01:37:26.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.649+0000 7fa3ec864640 1 -- start start 2023-11-04T01:37:26.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3ec864640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3d00047c0 0x7fa3e80b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3ec864640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e80c62e0 0x7fa3e80c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3ec864640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3e81f34b0 0x7fa3e80c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3ec864640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80b4d00 con 0x7fa3e80c62e0 2023-11-04T01:37:26.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3ec864640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80c79e0 con 0x7fa3d00047c0 2023-11-04T01:37:26.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3ec864640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80b1fd0 con 0x7fa3e81f34b0 2023-11-04T01:37:26.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3e5d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e80c62e0 0x7fa3e80c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3e5d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e80c62e0 0x7fa3e80c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44972/0 (socket says 172.21.15.114:44972) 2023-11-04T01:37:26.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3e5d9b640 1 -- 172.21.15.114:0/1660678214 learned_addr learned my addr 172.21.15.114:0/1660678214 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:26.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3e659c640 1 --2- 172.21.15.114:0/1660678214 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3d00047c0 0x7fa3e80b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3e6d9d640 1 --2- 172.21.15.114:0/1660678214 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3e81f34b0 0x7fa3e80c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3e5d9b640 1 -- 172.21.15.114:0/1660678214 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3e81f34b0 msgr2=0x7fa3e80c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3e5d9b640 1 --2- 172.21.15.114:0/1660678214 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3e81f34b0 0x7fa3e80c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3e5d9b640 1 -- 172.21.15.114:0/1660678214 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3d00047c0 msgr2=0x7fa3e80b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3e5d9b640 1 --2- 172.21.15.114:0/1660678214 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3d00047c0 0x7fa3e80b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3e5d9b640 1 -- 172.21.15.114:0/1660678214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e80b22b0 con 0x7fa3e80c62e0 2023-11-04T01:37:26.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3e6d9d640 1 --2- 172.21.15.114:0/1660678214 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3e81f34b0 0x7fa3e80c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:26.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.650+0000 7fa3e5d9b640 1 --2- 172.21.15.114:0/1660678214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e80c62e0 0x7fa3e80c71c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc02bbc0 tx=0x7fa3dc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.651+0000 7fa3d6ffd640 1 -- 172.21.15.114:0/1660678214 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0076c0 con 0x7fa3e80c62e0 2023-11-04T01:37:26.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.651+0000 7fa3d6ffd640 1 -- 172.21.15.114:0/1660678214 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc007a30 con 0x7fa3e80c62e0 2023-11-04T01:37:26.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.651+0000 7fa3ec864640 1 -- 172.21.15.114:0/1660678214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e80b2590 con 0x7fa3e80c62e0 2023-11-04T01:37:26.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.651+0000 7fa3d6ffd640 1 -- 172.21.15.114:0/1660678214 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc006be0 con 0x7fa3e80c62e0 2023-11-04T01:37:26.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.651+0000 7fa3ec864640 1 -- 172.21.15.114:0/1660678214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e80c7700 con 0x7fa3e80c62e0 2023-11-04T01:37:26.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.652+0000 7fa3ec864640 1 -- 172.21.15.114:0/1660678214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e80b2110 con 0x7fa3e80c62e0 2023-11-04T01:37:26.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.652+0000 7fa3d6ffd640 1 -- 172.21.15.114:0/1660678214 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa3dc006d40 con 0x7fa3e80c62e0 2023-11-04T01:37:26.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.652+0000 7fa3d6ffd640 1 --2- 172.21.15.114:0/1660678214 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa3c806aea0 0x7fa3c806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.653+0000 7fa3d6ffd640 1 -- 172.21.15.114:0/1660678214 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa3dc0ab5e0 con 0x7fa3e80c62e0 2023-11-04T01:37:26.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.653+0000 7fa3e659c640 1 --2- 172.21.15.114:0/1660678214 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa3c806aea0 0x7fa3c806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.653+0000 7fa3e659c640 1 --2- 172.21.15.114:0/1660678214 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa3c806aea0 0x7fa3c806d360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8014510 tx=0x7fa3d800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.657+0000 7fa3d6ffd640 1 -- 172.21.15.114:0/1660678214 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3e80b2110 con 0x7fa3e80c62e0 2023-11-04T01:37:26.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.835+0000 7fa3ec864640 1 -- 172.21.15.114:0/1660678214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa3e80b2110 con 0x7fa3e80c62e0 2023-11-04T01:37:26.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.835+0000 7fa3d6ffd640 1 -- 172.21.15.114:0/1660678214 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa3e80b2110 con 0x7fa3e80c62e0 2023-11-04T01:37:26.837 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-11-04T01:37:26.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.837+0000 7fa3ec864640 1 -- 172.21.15.114:0/1660678214 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa3c806aea0 msgr2=0x7fa3c806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.837+0000 7fa3ec864640 1 --2- 172.21.15.114:0/1660678214 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa3c806aea0 0x7fa3c806d360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8014510 tx=0x7fa3d800b040 comp rx=0 tx=0).stop 2023-11-04T01:37:26.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.837+0000 7fa3ec864640 1 -- 172.21.15.114:0/1660678214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e80c62e0 msgr2=0x7fa3e80c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.837+0000 7fa3ec864640 1 --2- 172.21.15.114:0/1660678214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e80c62e0 0x7fa3e80c71c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc02bbc0 tx=0x7fa3dc001120 comp rx=0 tx=0).stop 2023-11-04T01:37:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.837+0000 7fa3ec864640 1 -- 172.21.15.114:0/1660678214 shutdown_connections 2023-11-04T01:37:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.837+0000 7fa3ec864640 1 --2- 172.21.15.114:0/1660678214 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa3e81f34b0 0x7fa3e80c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.837+0000 7fa3ec864640 1 --2- 172.21.15.114:0/1660678214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3e80c62e0 0x7fa3e80c71c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.837+0000 7fa3ec864640 1 --2- 172.21.15.114:0/1660678214 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa3c806aea0 0x7fa3c806d360 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.837+0000 7fa3ec864640 1 --2- 172.21.15.114:0/1660678214 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa3d00047c0 0x7fa3e80b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.837+0000 7fa3ec864640 1 -- 172.21.15.114:0/1660678214 >> 172.21.15.114:0/1660678214 conn(0x7fa3e80cbc90 msgr2=0x7fa3e80c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.837+0000 7fa3ec864640 1 -- 172.21.15.114:0/1660678214 shutdown_connections 2023-11-04T01:37:26.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.837+0000 7fa3ec864640 1 -- 172.21.15.114:0/1660678214 wait complete. 2023-11-04T01:37:26.850 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:37:26.850 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:26.869 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:26.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.966+0000 7fdeca7ee640 1 Processor -- start 2023-11-04T01:37:26.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.966+0000 7fdeca7ee640 1 -- start start 2023-11-04T01:37:26.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.967+0000 7fdeca7ee640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fdec4159c70 0x7fdec40ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.967+0000 7fdeca7ee640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdec406db20 0x7fdec40b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.967+0000 7fdeca7ee640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec40b4110 con 0x7fdec40b0910 2023-11-04T01:37:26.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.967+0000 7fdeca7ee640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec40b49b0 con 0x7fdec406db20 2023-11-04T01:37:26.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.967+0000 7fdeca7ee640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec40b0da0 con 0x7fdec4159c70 2023-11-04T01:37:26.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.967+0000 7fdec37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdec406db20 0x7fdec40b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.967+0000 7fdec37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdec406db20 0x7fdec40b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44984/0 (socket says 172.21.15.114:44984) 2023-11-04T01:37:26.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.967+0000 7fdec37fe640 1 -- 172.21.15.114:0/2186576832 learned_addr learned my addr 172.21.15.114:0/2186576832 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:26.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.967+0000 7fdec37fe640 1 -- 172.21.15.114:0/2186576832 >> v2:172.21.15.141:3300/0 conn(0x7fdec4159c70 msgr2=0x7fdec40ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:26.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.967+0000 7fdec37fe640 1 --2- 172.21.15.114:0/2186576832 >> v2:172.21.15.141:3300/0 conn(0x7fdec4159c70 0x7fdec40ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.967+0000 7fdec37fe640 1 -- 172.21.15.114:0/2186576832 >> v1:172.21.15.141:6789/0 conn(0x7fdec40b0910 legacy=0x7fdec415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:26.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.967+0000 7fdec37fe640 1 -- 172.21.15.114:0/2186576832 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec40b43f0 con 0x7fdec406db20 2023-11-04T01:37:26.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.968+0000 7fdec37fe640 1 --2- 172.21.15.114:0/2186576832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec406db20 0x7fdec40b03d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdec40cc440 tx=0x7fdeb802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ffbf6ea0e317ce0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.968+0000 7fdec2ffd640 1 -- 172.21.15.114:0/2186576832 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8031870 con 0x7fdec406db20 2023-11-04T01:37:26.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.968+0000 7fdec2ffd640 1 -- 172.21.15.114:0/2186576832 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb80319d0 con 0x7fdec406db20 2023-11-04T01:37:26.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.968+0000 7fdec2ffd640 1 -- 172.21.15.114:0/2186576832 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8031d60 con 0x7fdec406db20 2023-11-04T01:37:26.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.968+0000 7fdeca7ee640 1 -- 172.21.15.114:0/2186576832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec406db20 msgr2=0x7fdec40b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.968+0000 7fdeca7ee640 1 --2- 172.21.15.114:0/2186576832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec406db20 0x7fdec40b03d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdec40cc440 tx=0x7fdeb802b910 comp rx=0 tx=0).stop 2023-11-04T01:37:26.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.969+0000 7fdeca7ee640 1 -- 172.21.15.114:0/2186576832 shutdown_connections 2023-11-04T01:37:26.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.969+0000 7fdeca7ee640 1 --2- 172.21.15.114:0/2186576832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec406db20 0x7fdec40b03d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.969+0000 7fdeca7ee640 1 --2- 172.21.15.114:0/2186576832 >> v2:172.21.15.141:3300/0 conn(0x7fdec4159c70 0x7fdec40ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.969+0000 7fdeca7ee640 1 -- 172.21.15.114:0/2186576832 >> 172.21.15.114:0/2186576832 conn(0x7fdec40ce950 msgr2=0x7fdec40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:26.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.969+0000 7fdeca7ee640 1 -- 172.21.15.114:0/2186576832 shutdown_connections 2023-11-04T01:37:26.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.969+0000 7fdeca7ee640 1 -- 172.21.15.114:0/2186576832 wait complete. 2023-11-04T01:37:26.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.970+0000 7fdeca7ee640 1 Processor -- start 2023-11-04T01:37:26.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.970+0000 7fdeca7ee640 1 -- start start 2023-11-04T01:37:26.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdeca7ee640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdec406db20 0x7fdec4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdeca7ee640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec40b0910 0x7fdec4070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdeca7ee640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdec4159c70 0x7fdec414d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdeca7ee640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec414ee60 con 0x7fdec40b0910 2023-11-04T01:37:26.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdeca7ee640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec414e2e0 con 0x7fdec4159c70 2023-11-04T01:37:26.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdeca7ee640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec414e5c0 con 0x7fdec406db20 2023-11-04T01:37:26.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdec37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec40b0910 0x7fdec4070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdec37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec40b0910 0x7fdec4070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44990/0 (socket says 172.21.15.114:44990) 2023-11-04T01:37:26.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdec37fe640 1 -- 172.21.15.114:0/244648010 learned_addr learned my addr 172.21.15.114:0/244648010 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:26.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdec3fff640 1 --2- 172.21.15.114:0/244648010 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdec406db20 0x7fdec4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdec8d8b640 1 --2- 172.21.15.114:0/244648010 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdec4159c70 0x7fdec414d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdec37fe640 1 -- 172.21.15.114:0/244648010 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdec406db20 msgr2=0x7fdec4070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdec37fe640 1 --2- 172.21.15.114:0/244648010 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdec406db20 0x7fdec4070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdec37fe640 1 -- 172.21.15.114:0/244648010 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdec4159c70 msgr2=0x7fdec414d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:26.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdec37fe640 1 --2- 172.21.15.114:0/244648010 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdec4159c70 0x7fdec414d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:26.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdec37fe640 1 -- 172.21.15.114:0/244648010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb80094d0 con 0x7fdec40b0910 2023-11-04T01:37:26.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdec37fe640 1 --2- 172.21.15.114:0/244648010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec40b0910 0x7fdec4070b70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8000c00 tx=0x7fdeb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdec0ff9640 1 -- 172.21.15.114:0/244648010 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb803ad10 con 0x7fdec40b0910 2023-11-04T01:37:26.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdec0ff9640 1 -- 172.21.15.114:0/244648010 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb803ae70 con 0x7fdec40b0910 2023-11-04T01:37:26.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdeca7ee640 1 -- 172.21.15.114:0/244648010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec414e8a0 con 0x7fdec40b0910 2023-11-04T01:37:26.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdec0ff9640 1 -- 172.21.15.114:0/244648010 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8044610 con 0x7fdec40b0910 2023-11-04T01:37:26.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.971+0000 7fdeca7ee640 1 -- 172.21.15.114:0/244648010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec4153dc0 con 0x7fdec40b0910 2023-11-04T01:37:26.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.972+0000 7fdeca7ee640 1 -- 172.21.15.114:0/244648010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec4074290 con 0x7fdec40b0910 2023-11-04T01:37:26.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.973+0000 7fdec0ff9640 1 -- 172.21.15.114:0/244648010 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdeb804d450 con 0x7fdec40b0910 2023-11-04T01:37:26.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.973+0000 7fdec0ff9640 1 --2- 172.21.15.114:0/244648010 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdeb006aea0 0x7fdeb006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:26.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.973+0000 7fdec3fff640 1 --2- 172.21.15.114:0/244648010 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdeb006aea0 0x7fdeb006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:26.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.973+0000 7fdec0ff9640 1 -- 172.21.15.114:0/244648010 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdeb802d040 con 0x7fdec40b0910 2023-11-04T01:37:26.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.974+0000 7fdec3fff640 1 --2- 172.21.15.114:0/244648010 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdeb006aea0 0x7fdeb006d360 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdec40b1970 tx=0x7fdeb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:26.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:26.977+0000 7fdec0ff9640 1 -- 172.21.15.114:0/244648010 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdeb8076d60 con 0x7fdec40b0910 2023-11-04T01:37:27.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.145+0000 7fdeca7ee640 1 -- 172.21.15.114:0/244648010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdec406d3f0 con 0x7fdec40b0910 2023-11-04T01:37:27.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.146+0000 7fdec0ff9640 1 -- 172.21.15.114:0/244648010 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18796 (secure 0 0 0) 0x7fdeb807a380 con 0x7fdec40b0910 2023-11-04T01:37:27.148 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:27.148 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:11.562429+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:27.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.148+0000 7fdeca7ee640 1 -- 172.21.15.114:0/244648010 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdeb006aea0 msgr2=0x7fdeb006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.148+0000 7fdeca7ee640 1 --2- 172.21.15.114:0/244648010 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdeb006aea0 0x7fdeb006d360 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdec40b1970 tx=0x7fdeb4008040 comp rx=0 tx=0).stop 2023-11-04T01:37:27.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.148+0000 7fdeca7ee640 1 -- 172.21.15.114:0/244648010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec40b0910 msgr2=0x7fdec4070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.148+0000 7fdeca7ee640 1 --2- 172.21.15.114:0/244648010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec40b0910 0x7fdec4070b70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8000c00 tx=0x7fdeb80046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.148+0000 7fdeca7ee640 1 -- 172.21.15.114:0/244648010 shutdown_connections 2023-11-04T01:37:27.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.148+0000 7fdeca7ee640 1 --2- 172.21.15.114:0/244648010 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdeb006aea0 0x7fdeb006d360 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.148+0000 7fdeca7ee640 1 --2- 172.21.15.114:0/244648010 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdec4159c70 0x7fdec414d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.148+0000 7fdeca7ee640 1 --2- 172.21.15.114:0/244648010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec40b0910 0x7fdec4070b70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.148+0000 7fdeca7ee640 1 --2- 172.21.15.114:0/244648010 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdec406db20 0x7fdec4070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.148+0000 7fdeca7ee640 1 -- 172.21.15.114:0/244648010 >> 172.21.15.114:0/244648010 conn(0x7fdec40ce950 msgr2=0x7fdec40c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:27.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.149+0000 7fdeca7ee640 1 -- 172.21.15.114:0/244648010 shutdown_connections 2023-11-04T01:37:27.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.149+0000 7fdeca7ee640 1 -- 172.21.15.114:0/244648010 wait complete. 2023-11-04T01:37:27.161 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:27.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:27.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.261+0000 7feefca1a640 1 Processor -- start 2023-11-04T01:37:27.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.261+0000 7feefca1a640 1 -- start start 2023-11-04T01:37:27.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.262+0000 7feefca1a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feef80b2d30 0x7feef806bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.262+0000 7feefca1a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feef806c1d0 0x7feef80cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.262+0000 7feefca1a640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef806ca40 con 0x7feef8160430 2023-11-04T01:37:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.262+0000 7feefca1a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef80cb580 con 0x7feef806c1d0 2023-11-04T01:37:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.262+0000 7feefca1a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef806cd20 con 0x7feef80b2d30 2023-11-04T01:37:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.262+0000 7feef6d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feef806c1d0 0x7feef80cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.262+0000 7feef6d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feef806c1d0 0x7feef80cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44998/0 (socket says 172.21.15.114:44998) 2023-11-04T01:37:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.262+0000 7feef6d9d640 1 -- 172.21.15.114:0/3488154939 learned_addr learned my addr 172.21.15.114:0/3488154939 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.263+0000 7feef5d9b640 1 --2- 172.21.15.114:0/3488154939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feef80b2d30 0x7feef806bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.263+0000 7feef6d9d640 1 -- 172.21.15.114:0/3488154939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feef80b2d30 msgr2=0x7feef806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.263+0000 7feef6d9d640 1 --2- 172.21.15.114:0/3488154939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feef80b2d30 0x7feef806bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.263+0000 7feef6d9d640 1 -- 172.21.15.114:0/3488154939 >> v1:172.21.15.141:6789/0 conn(0x7feef8160430 legacy=0x7feef80b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.263+0000 7feef6d9d640 1 -- 172.21.15.114:0/3488154939 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef806d000 con 0x7feef806c1d0 2023-11-04T01:37:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.263+0000 7feef6d9d640 1 --2- 172.21.15.114:0/3488154939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feef806c1d0 0x7feef80cbcb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7feef0009870 tx=0x7feef002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c803ac23b4ce09 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.264+0000 7feef559a640 1 -- 172.21.15.114:0/3488154939 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0031640 con 0x7feef806c1d0 2023-11-04T01:37:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.264+0000 7feef559a640 1 -- 172.21.15.114:0/3488154939 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef00317a0 con 0x7feef806c1d0 2023-11-04T01:37:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.264+0000 7feef559a640 1 -- 172.21.15.114:0/3488154939 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0031b30 con 0x7feef806c1d0 2023-11-04T01:37:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.264+0000 7feefca1a640 1 -- 172.21.15.114:0/3488154939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feef806c1d0 msgr2=0x7feef80cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.264+0000 7feefca1a640 1 --2- 172.21.15.114:0/3488154939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feef806c1d0 0x7feef80cbcb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7feef0009870 tx=0x7feef002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.264+0000 7feefca1a640 1 -- 172.21.15.114:0/3488154939 shutdown_connections 2023-11-04T01:37:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.264+0000 7feefca1a640 1 --2- 172.21.15.114:0/3488154939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feef806c1d0 0x7feef80cbcb0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.264+0000 7feefca1a640 1 --2- 172.21.15.114:0/3488154939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feef80b2d30 0x7feef806bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.264+0000 7feefca1a640 1 -- 172.21.15.114:0/3488154939 >> 172.21.15.114:0/3488154939 conn(0x7feef806ea20 msgr2=0x7feef806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.264+0000 7feefca1a640 1 -- 172.21.15.114:0/3488154939 shutdown_connections 2023-11-04T01:37:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.264+0000 7feefca1a640 1 -- 172.21.15.114:0/3488154939 wait complete. 2023-11-04T01:37:27.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.265+0000 7feefca1a640 1 Processor -- start 2023-11-04T01:37:27.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.266+0000 7feefca1a640 1 -- start start 2023-11-04T01:37:27.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.266+0000 7feefca1a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feef806c1d0 0x7feef8152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.266+0000 7feefca1a640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feef80b2d30 0x7feef81f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.266+0000 7feefca1a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feef8160430 0x7feef80b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.266+0000 7feefca1a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef8156700 con 0x7feef806c1d0 2023-11-04T01:37:27.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.266+0000 7feefca1a640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef81f6670 con 0x7feef80b2d30 2023-11-04T01:37:27.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.266+0000 7feefca1a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef81f6950 con 0x7feef8160430 2023-11-04T01:37:27.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.266+0000 7feef659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feef806c1d0 0x7feef8152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.266+0000 7feef659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feef806c1d0 0x7feef8152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45014/0 (socket says 172.21.15.114:45014) 2023-11-04T01:37:27.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.266+0000 7feef659c640 1 -- 172.21.15.114:0/1131445107 learned_addr learned my addr 172.21.15.114:0/1131445107 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:27.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.266+0000 7feef5d9b640 1 --2- 172.21.15.114:0/1131445107 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feef80b2d30 0x7feef81f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.267+0000 7feef6d9d640 1 --2- 172.21.15.114:0/1131445107 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feef8160430 0x7feef80b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.267+0000 7feef659c640 1 -- 172.21.15.114:0/1131445107 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feef8160430 msgr2=0x7feef80b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.267+0000 7feef659c640 1 --2- 172.21.15.114:0/1131445107 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feef8160430 0x7feef80b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.267+0000 7feef659c640 1 -- 172.21.15.114:0/1131445107 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feef80b2d30 msgr2=0x7feef81f5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.267+0000 7feef659c640 1 --2- 172.21.15.114:0/1131445107 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feef80b2d30 0x7feef81f5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.267+0000 7feef659c640 1 -- 172.21.15.114:0/1131445107 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef00094d0 con 0x7feef806c1d0 2023-11-04T01:37:27.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.267+0000 7feef659c640 1 --2- 172.21.15.114:0/1131445107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feef806c1d0 0x7feef8152610 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7feee800c780 tx=0x7feee800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.267+0000 7feee6ffd640 1 -- 172.21.15.114:0/1131445107 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee800aa50 con 0x7feef806c1d0 2023-11-04T01:37:27.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.267+0000 7feee6ffd640 1 -- 172.21.15.114:0/1131445107 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee800ce90 con 0x7feef806c1d0 2023-11-04T01:37:27.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.267+0000 7feee6ffd640 1 -- 172.21.15.114:0/1131445107 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee800ae30 con 0x7feef806c1d0 2023-11-04T01:37:27.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.267+0000 7feefca1a640 1 -- 172.21.15.114:0/1131445107 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef81f6c30 con 0x7feef806c1d0 2023-11-04T01:37:27.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.267+0000 7feefca1a640 1 -- 172.21.15.114:0/1131445107 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef8156ae0 con 0x7feef806c1d0 2023-11-04T01:37:27.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.268+0000 7feefca1a640 1 -- 172.21.15.114:0/1131445107 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef81f6e70 con 0x7feef806c1d0 2023-11-04T01:37:27.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.268+0000 7feee6ffd640 1 -- 172.21.15.114:0/1131445107 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feee8005080 con 0x7feef806c1d0 2023-11-04T01:37:27.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.269+0000 7feee6ffd640 1 --2- 172.21.15.114:0/1131445107 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feed806ae70 0x7feed806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.269+0000 7feee6ffd640 1 -- 172.21.15.114:0/1131445107 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feee80898a0 con 0x7feef806c1d0 2023-11-04T01:37:27.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.269+0000 7feef5d9b640 1 --2- 172.21.15.114:0/1131445107 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feed806ae70 0x7feed806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.269+0000 7feef5d9b640 1 --2- 172.21.15.114:0/1131445107 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feed806ae70 0x7feed806d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7feef80c6ef0 tx=0x7feeec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.273+0000 7feee6ffd640 1 -- 172.21.15.114:0/1131445107 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feef81f6e70 con 0x7feef806c1d0 2023-11-04T01:37:27.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.438+0000 7feefca1a640 1 -- 172.21.15.114:0/1131445107 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feef80c9190 con 0x7feef806c1d0 2023-11-04T01:37:27.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.439+0000 7feee6ffd640 1 -- 172.21.15.114:0/1131445107 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7feef80c9190 con 0x7feef806c1d0 2023-11-04T01:37:27.441 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:37:27.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.440+0000 7feefca1a640 1 -- 172.21.15.114:0/1131445107 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feed806ae70 msgr2=0x7feed806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.440+0000 7feefca1a640 1 --2- 172.21.15.114:0/1131445107 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feed806ae70 0x7feed806d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7feef80c6ef0 tx=0x7feeec008040 comp rx=0 tx=0).stop 2023-11-04T01:37:27.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.440+0000 7feefca1a640 1 -- 172.21.15.114:0/1131445107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feef806c1d0 msgr2=0x7feef8152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.440+0000 7feefca1a640 1 --2- 172.21.15.114:0/1131445107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feef806c1d0 0x7feef8152610 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7feee800c780 tx=0x7feee800cc40 comp rx=0 tx=0).stop 2023-11-04T01:37:27.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.440+0000 7feefca1a640 1 -- 172.21.15.114:0/1131445107 shutdown_connections 2023-11-04T01:37:27.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.440+0000 7feefca1a640 1 --2- 172.21.15.114:0/1131445107 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feef8160430 0x7feef80b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.440+0000 7feefca1a640 1 --2- 172.21.15.114:0/1131445107 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feed806ae70 0x7feed806d330 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.440+0000 7feefca1a640 1 --2- 172.21.15.114:0/1131445107 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feef80b2d30 0x7feef81f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.441+0000 7feefca1a640 1 --2- 172.21.15.114:0/1131445107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feef806c1d0 0x7feef8152610 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.441+0000 7feefca1a640 1 -- 172.21.15.114:0/1131445107 >> 172.21.15.114:0/1131445107 conn(0x7feef806ea20 msgr2=0x7feef80cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:27.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.441+0000 7feefca1a640 1 -- 172.21.15.114:0/1131445107 shutdown_connections 2023-11-04T01:37:27.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.441+0000 7feefca1a640 1 -- 172.21.15.114:0/1131445107 wait complete. 2023-11-04T01:37:27.453 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:27.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.555+0000 7fd455b65640 1 Processor -- start 2023-11-04T01:37:27.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.555+0000 7fd455b65640 1 -- start start 2023-11-04T01:37:27.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.555+0000 7fd455b65640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd4500b1a40 0x7fd4500ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.555+0000 7fd455b65640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd45006a830 0x7fd4500cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.555+0000 7fd455b65640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd450160990 con 0x7fd4501605b0 2023-11-04T01:37:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.555+0000 7fd455b65640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4500cc7c0 con 0x7fd4500b1a40 2023-11-04T01:37:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.555+0000 7fd455b65640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4500cd750 con 0x7fd45006a830 2023-11-04T01:37:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.556+0000 7fd44effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd4500b1a40 0x7fd4500ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.556+0000 7fd44f7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd4501605b0 0x7fd45006a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52400/0 (socket says 172.21.15.114:52400) 2023-11-04T01:37:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.556+0000 7fd44f7fe640 1 -- 172.21.15.114:0/1488785619 learned_addr learned my addr 172.21.15.114:0/1488785619 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.556+0000 7fd44ffff640 1 --2- 172.21.15.114:0/1488785619 >> v2:172.21.15.141:3300/0 conn(0x7fd45006a830 0x7fd4500cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.556+0000 7fd44effd640 1 -- 172.21.15.114:0/1488785619 >> v2:172.21.15.141:3300/0 conn(0x7fd45006a830 msgr2=0x7fd4500cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.556+0000 7fd44effd640 1 --2- 172.21.15.114:0/1488785619 >> v2:172.21.15.141:3300/0 conn(0x7fd45006a830 0x7fd4500cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.556+0000 7fd44effd640 1 -- 172.21.15.114:0/1488785619 >> v1:172.21.15.114:6789/0 conn(0x7fd4501605b0 legacy=0x7fd45006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.556+0000 7fd44effd640 1 -- 172.21.15.114:0/1488785619 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4500cc4e0 con 0x7fd4500b1a40 2023-11-04T01:37:27.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.556+0000 7fd44e7fc640 1 -- 172.21.15.114:0/1488785619 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253813526 0 0) 0x7fd450160990 con 0x7fd4501605b0 2023-11-04T01:37:27.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.557+0000 7fd44effd640 1 --2- 172.21.15.114:0/1488785619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4500b1a40 0x7fd4500ccbc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd4500c6aa0 tx=0x7fd44402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf50ce3c46e7f822 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.557+0000 7fd44e7fc640 1 -- 172.21.15.114:0/1488785619 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd444031710 con 0x7fd4500b1a40 2023-11-04T01:37:27.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.557+0000 7fd44e7fc640 1 -- 172.21.15.114:0/1488785619 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44402f050 con 0x7fd4500b1a40 2023-11-04T01:37:27.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.557+0000 7fd44e7fc640 1 -- 172.21.15.114:0/1488785619 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd444031a90 con 0x7fd4500b1a40 2023-11-04T01:37:27.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.557+0000 7fd455b65640 1 -- 172.21.15.114:0/1488785619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4500b1a40 msgr2=0x7fd4500ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.557+0000 7fd455b65640 1 --2- 172.21.15.114:0/1488785619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4500b1a40 0x7fd4500ccbc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd4500c6aa0 tx=0x7fd44402b7b0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.557+0000 7fd455b65640 1 -- 172.21.15.114:0/1488785619 shutdown_connections 2023-11-04T01:37:27.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.557+0000 7fd455b65640 1 --2- 172.21.15.114:0/1488785619 >> v2:172.21.15.141:3300/0 conn(0x7fd45006a830 0x7fd4500cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.557+0000 7fd455b65640 1 --2- 172.21.15.114:0/1488785619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4500b1a40 0x7fd4500ccbc0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.557+0000 7fd455b65640 1 -- 172.21.15.114:0/1488785619 >> 172.21.15.114:0/1488785619 conn(0x7fd450071820 msgr2=0x7fd450071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:27.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.557+0000 7fd455b65640 1 -- 172.21.15.114:0/1488785619 shutdown_connections 2023-11-04T01:37:27.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.557+0000 7fd455b65640 1 -- 172.21.15.114:0/1488785619 wait complete. 2023-11-04T01:37:27.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.558+0000 7fd455b65640 1 Processor -- start 2023-11-04T01:37:27.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.559+0000 7fd455b65640 1 -- start start 2023-11-04T01:37:27.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.559+0000 7fd455b65640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd45006a830 0x7fd45015ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.559+0000 7fd455b65640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4501605b0 0x7fd4501f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.559+0000 7fd455b65640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4500c9400 0x7fd45014dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.559+0000 7fd455b65640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd450151a50 con 0x7fd4500c9400 2023-11-04T01:37:27.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.559+0000 7fd455b65640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45014d630 con 0x7fd4501605b0 2023-11-04T01:37:27.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.559+0000 7fd455b65640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45014d8a0 con 0x7fd45006a830 2023-11-04T01:37:27.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.559+0000 7fd44ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4500c9400 0x7fd45014dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.559+0000 7fd44ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4500c9400 0x7fd45014dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45040/0 (socket says 172.21.15.114:45040) 2023-11-04T01:37:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.559+0000 7fd44ffff640 1 -- 172.21.15.114:0/1600632254 learned_addr learned my addr 172.21.15.114:0/1600632254 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.560+0000 7fd44f7fe640 1 --2- 172.21.15.114:0/1600632254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd45006a830 0x7fd45015ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.560+0000 7fd44effd640 1 --2- 172.21.15.114:0/1600632254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4501605b0 0x7fd4501f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.560+0000 7fd44ffff640 1 -- 172.21.15.114:0/1600632254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd45006a830 msgr2=0x7fd45015ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.560+0000 7fd44ffff640 1 --2- 172.21.15.114:0/1600632254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd45006a830 0x7fd45015ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.560+0000 7fd44ffff640 1 -- 172.21.15.114:0/1600632254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4501605b0 msgr2=0x7fd4501f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.560+0000 7fd44ffff640 1 --2- 172.21.15.114:0/1600632254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4501605b0 0x7fd4501f6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.560+0000 7fd44ffff640 1 -- 172.21.15.114:0/1600632254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd444009400 con 0x7fd4500c9400 2023-11-04T01:37:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.560+0000 7fd44f7fe640 1 --2- 172.21.15.114:0/1600632254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd45006a830 0x7fd45015ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.560+0000 7fd44ffff640 1 --2- 172.21.15.114:0/1600632254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4500c9400 0x7fd45014dd30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd448007e90 tx=0x7fd44800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.560+0000 7fd437fff640 1 -- 172.21.15.114:0/1600632254 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448014420 con 0x7fd4500c9400 2023-11-04T01:37:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.560+0000 7fd437fff640 1 -- 172.21.15.114:0/1600632254 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd448014580 con 0x7fd4500c9400 2023-11-04T01:37:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.560+0000 7fd437fff640 1 -- 172.21.15.114:0/1600632254 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448014930 con 0x7fd4500c9400 2023-11-04T01:37:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.560+0000 7fd455b65640 1 -- 172.21.15.114:0/1600632254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4501f6f40 con 0x7fd4500c9400 2023-11-04T01:37:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.560+0000 7fd455b65640 1 -- 172.21.15.114:0/1600632254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4501f7500 con 0x7fd4500c9400 2023-11-04T01:37:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.561+0000 7fd455b65640 1 -- 172.21.15.114:0/1600632254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4500672a0 con 0x7fd4500c9400 2023-11-04T01:37:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.561+0000 7fd437fff640 1 -- 172.21.15.114:0/1600632254 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd448014a90 con 0x7fd4500c9400 2023-11-04T01:37:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.562+0000 7fd437fff640 1 --2- 172.21.15.114:0/1600632254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd43c06aea0 0x7fd43c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.562+0000 7fd437fff640 1 -- 172.21.15.114:0/1600632254 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd44808a1f0 con 0x7fd4500c9400 2023-11-04T01:37:27.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.562+0000 7fd44f7fe640 1 --2- 172.21.15.114:0/1600632254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd43c06aea0 0x7fd43c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.562+0000 7fd44f7fe640 1 --2- 172.21.15.114:0/1600632254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd43c06aea0 0x7fd43c06d360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd440000f60 tx=0x7fd440007ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.566+0000 7fd437fff640 1 -- 172.21.15.114:0/1600632254 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd448054ee0 con 0x7fd4500c9400 2023-11-04T01:37:27.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.732+0000 7fd455b65640 1 -- 172.21.15.114:0/1600632254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4500af4e0 con 0x7fd4500c9400 2023-11-04T01:37:27.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.732+0000 7fd437fff640 1 -- 172.21.15.114:0/1600632254 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd448058500 con 0x7fd4500c9400 2023-11-04T01:37:27.735 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:27.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.734+0000 7fd455b65640 1 -- 172.21.15.114:0/1600632254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd43c06aea0 msgr2=0x7fd43c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.734+0000 7fd455b65640 1 --2- 172.21.15.114:0/1600632254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd43c06aea0 0x7fd43c06d360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd440000f60 tx=0x7fd440007ca0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.734+0000 7fd455b65640 1 -- 172.21.15.114:0/1600632254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4500c9400 msgr2=0x7fd45014dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.734+0000 7fd455b65640 1 --2- 172.21.15.114:0/1600632254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4500c9400 0x7fd45014dd30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd448007e90 tx=0x7fd44800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.734+0000 7fd455b65640 1 -- 172.21.15.114:0/1600632254 shutdown_connections 2023-11-04T01:37:27.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.734+0000 7fd455b65640 1 --2- 172.21.15.114:0/1600632254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4500c9400 0x7fd45014dd30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.734+0000 7fd455b65640 1 --2- 172.21.15.114:0/1600632254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd43c06aea0 0x7fd43c06d360 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.734+0000 7fd455b65640 1 --2- 172.21.15.114:0/1600632254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4501605b0 0x7fd4501f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.734+0000 7fd455b65640 1 --2- 172.21.15.114:0/1600632254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd45006a830 0x7fd45015ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.734+0000 7fd455b65640 1 -- 172.21.15.114:0/1600632254 >> 172.21.15.114:0/1600632254 conn(0x7fd450071820 msgr2=0x7fd4500af700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:27.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.735+0000 7fd455b65640 1 -- 172.21.15.114:0/1600632254 shutdown_connections 2023-11-04T01:37:27.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.735+0000 7fd455b65640 1 -- 172.21.15.114:0/1600632254 wait complete. 2023-11-04T01:37:27.747 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:27.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.849+0000 7faef0df5640 1 Processor -- start 2023-11-04T01:37:27.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.849+0000 7faef0df5640 1 -- start start 2023-11-04T01:37:27.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.849+0000 7faef0df5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7faeec1603d0 0x7faeec0b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.849+0000 7faef0df5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faeec06a830 0x7faeec0ca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.849+0000 7faef0df5640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeec0cdf80 con 0x7faeec0722a0 2023-11-04T01:37:27.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.849+0000 7faef0df5640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeec0b19d0 con 0x7faeec1603d0 2023-11-04T01:37:27.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.849+0000 7faef0df5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0ce6f0 con 0x7faeec06a830 2023-11-04T01:37:27.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.850+0000 7faeead9d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faeec06a830 0x7faeec0ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.850+0000 7faeea59c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7faeec1603d0 0x7faeec0b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.850+0000 7faee3fff640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7faeec0722a0 0x7faeec06a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:52082/0 (socket says 172.21.15.114:52082) 2023-11-04T01:37:27.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.850+0000 7faeead9d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faeec06a830 0x7faeec0ca380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:35576/0 (socket says 172.21.15.114:35576) 2023-11-04T01:37:27.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.850+0000 7faee3fff640 1 -- 172.21.15.114:0/414038207 learned_addr learned my addr 172.21.15.114:0/414038207 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:27.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.850+0000 7faeead9d640 1 -- 172.21.15.114:0/414038207 >> v2:172.21.15.141:3300/0 conn(0x7faeec1603d0 msgr2=0x7faeec0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:27.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.850+0000 7faeead9d640 1 --2- 172.21.15.114:0/414038207 >> v2:172.21.15.141:3300/0 conn(0x7faeec1603d0 0x7faeec0b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.850+0000 7faeead9d640 1 -- 172.21.15.114:0/414038207 >> v1:172.21.15.141:6789/0 conn(0x7faeec0722a0 legacy=0x7faeec06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.850+0000 7faeead9d640 1 -- 172.21.15.114:0/414038207 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec072700 con 0x7faeec06a830 2023-11-04T01:37:27.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.851+0000 7faeead9d640 1 --2- 172.21.15.114:0/414038207 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faeec06a830 0x7faeec0ca380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faee4009d90 tx=0x7faee402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f013f3799b5f5604 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.851+0000 7faee9d9b640 1 -- 172.21.15.114:0/414038207 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee402cbc0 con 0x7faeec06a830 2023-11-04T01:37:27.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.851+0000 7faee9d9b640 1 -- 172.21.15.114:0/414038207 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee402cd20 con 0x7faeec06a830 2023-11-04T01:37:27.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.851+0000 7faee9d9b640 1 -- 172.21.15.114:0/414038207 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4034660 con 0x7faeec06a830 2023-11-04T01:37:27.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.851+0000 7faef0df5640 1 -- 172.21.15.114:0/414038207 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faeec06a830 msgr2=0x7faeec0ca380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.851+0000 7faef0df5640 1 --2- 172.21.15.114:0/414038207 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faeec06a830 0x7faeec0ca380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faee4009d90 tx=0x7faee402be10 comp rx=0 tx=0).stop 2023-11-04T01:37:27.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.851+0000 7faef0df5640 1 -- 172.21.15.114:0/414038207 shutdown_connections 2023-11-04T01:37:27.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.851+0000 7faef0df5640 1 --2- 172.21.15.114:0/414038207 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faeec06a830 0x7faeec0ca380 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.851+0000 7faef0df5640 1 --2- 172.21.15.114:0/414038207 >> v2:172.21.15.141:3300/0 conn(0x7faeec1603d0 0x7faeec0b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.852+0000 7faef0df5640 1 -- 172.21.15.114:0/414038207 >> 172.21.15.114:0/414038207 conn(0x7faeec06d800 msgr2=0x7faeec06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:27.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.852+0000 7faef0df5640 1 -- 172.21.15.114:0/414038207 shutdown_connections 2023-11-04T01:37:27.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.852+0000 7faef0df5640 1 -- 172.21.15.114:0/414038207 wait complete. 2023-11-04T01:37:27.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.853+0000 7faef0df5640 1 Processor -- start 2023-11-04T01:37:27.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.853+0000 7faef0df5640 1 -- start start 2023-11-04T01:37:27.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.853+0000 7faef0df5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeec06a830 0x7faeec1f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.853+0000 7faef0df5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faeec0722a0 0x7faeec0b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.853+0000 7faef0df5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faeec1603d0 0x7faeec1f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faef0df5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0b5420 con 0x7faeec06a830 2023-11-04T01:37:27.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faef0df5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec1f3560 con 0x7faeec1603d0 2023-11-04T01:37:27.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faef0df5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec1f3840 con 0x7faeec0722a0 2023-11-04T01:37:27.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faeea59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeec06a830 0x7faeec1f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faeea59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeec06a830 0x7faeec1f2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45046/0 (socket says 172.21.15.114:45046) 2023-11-04T01:37:27.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faeea59c640 1 -- 172.21.15.114:0/478490186 learned_addr learned my addr 172.21.15.114:0/478490186 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:27.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faeead9d640 1 --2- 172.21.15.114:0/478490186 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faeec1603d0 0x7faeec1f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faee3fff640 1 --2- 172.21.15.114:0/478490186 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faeec0722a0 0x7faeec0b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faeea59c640 1 -- 172.21.15.114:0/478490186 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faeec0722a0 msgr2=0x7faeec0b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faeea59c640 1 --2- 172.21.15.114:0/478490186 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faeec0722a0 0x7faeec0b4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faeea59c640 1 -- 172.21.15.114:0/478490186 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faeec1603d0 msgr2=0x7faeec1f40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:27.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faeea59c640 1 --2- 172.21.15.114:0/478490186 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faeec1603d0 0x7faeec1f40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:27.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faeea59c640 1 -- 172.21.15.114:0/478490186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee4009a70 con 0x7faeec06a830 2023-11-04T01:37:27.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faeea59c640 1 --2- 172.21.15.114:0/478490186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeec06a830 0x7faeec1f2ed0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7faedc00e870 tx=0x7faedc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faee2ffd640 1 -- 172.21.15.114:0/478490186 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc0094f0 con 0x7faeec06a830 2023-11-04T01:37:27.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faee2ffd640 1 -- 172.21.15.114:0/478490186 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc00c940 con 0x7faeec06a830 2023-11-04T01:37:27.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faef0df5640 1 -- 172.21.15.114:0/478490186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeec1f3b20 con 0x7faeec06a830 2023-11-04T01:37:27.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faee2ffd640 1 -- 172.21.15.114:0/478490186 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc00ccf0 con 0x7faeec06a830 2023-11-04T01:37:27.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.854+0000 7faef0df5640 1 -- 172.21.15.114:0/478490186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec0c35c0 con 0x7faeec06a830 2023-11-04T01:37:27.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.855+0000 7faef0df5640 1 -- 172.21.15.114:0/478490186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeec1f45f0 con 0x7faeec06a830 2023-11-04T01:37:27.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.856+0000 7faee2ffd640 1 -- 172.21.15.114:0/478490186 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faedc013470 con 0x7faeec06a830 2023-11-04T01:37:27.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.856+0000 7faee2ffd640 1 --2- 172.21.15.114:0/478490186 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faecc06ae70 0x7faecc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:27.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.856+0000 7faee2ffd640 1 -- 172.21.15.114:0/478490186 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faedc089b70 con 0x7faeec06a830 2023-11-04T01:37:27.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.856+0000 7faee3fff640 1 --2- 172.21.15.114:0/478490186 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faecc06ae70 0x7faecc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:27.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.856+0000 7faee3fff640 1 --2- 172.21.15.114:0/478490186 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faecc06ae70 0x7faecc06d330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faeec159840 tx=0x7faed4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:27.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:27.860+0000 7faee2ffd640 1 -- 172.21.15.114:0/478490186 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faedc0547e0 con 0x7faeec06a830 2023-11-04T01:37:28.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.026+0000 7faef0df5640 1 -- 172.21.15.114:0/478490186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faeec0ce130 con 0x7faeec06a830 2023-11-04T01:37:28.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.027+0000 7faee2ffd640 1 -- 172.21.15.114:0/478490186 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7faedc057e00 con 0x7faeec06a830 2023-11-04T01:37:28.029 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:37:28.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.029+0000 7faef0df5640 1 -- 172.21.15.114:0/478490186 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faecc06ae70 msgr2=0x7faecc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.029+0000 7faef0df5640 1 --2- 172.21.15.114:0/478490186 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faecc06ae70 0x7faecc06d330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faeec159840 tx=0x7faed4009040 comp rx=0 tx=0).stop 2023-11-04T01:37:28.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.029+0000 7faef0df5640 1 -- 172.21.15.114:0/478490186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeec06a830 msgr2=0x7faeec1f2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.029+0000 7faef0df5640 1 --2- 172.21.15.114:0/478490186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeec06a830 0x7faeec1f2ed0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7faedc00e870 tx=0x7faedc00ed30 comp rx=0 tx=0).stop 2023-11-04T01:37:28.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.029+0000 7faef0df5640 1 -- 172.21.15.114:0/478490186 shutdown_connections 2023-11-04T01:37:28.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.029+0000 7faef0df5640 1 --2- 172.21.15.114:0/478490186 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faecc06ae70 0x7faecc06d330 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.029+0000 7faef0df5640 1 --2- 172.21.15.114:0/478490186 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faeec1603d0 0x7faeec1f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.029+0000 7faef0df5640 1 --2- 172.21.15.114:0/478490186 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faeec0722a0 0x7faeec0b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.029+0000 7faef0df5640 1 --2- 172.21.15.114:0/478490186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeec06a830 0x7faeec1f2ed0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.029+0000 7faef0df5640 1 -- 172.21.15.114:0/478490186 >> 172.21.15.114:0/478490186 conn(0x7faeec06d800 msgr2=0x7faeec0717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:28.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.029+0000 7faef0df5640 1 -- 172.21.15.114:0/478490186 shutdown_connections 2023-11-04T01:37:28.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.029+0000 7faef0df5640 1 -- 172.21.15.114:0/478490186 wait complete. 2023-11-04T01:37:28.041 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:28.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.142+0000 7fbd89178640 1 Processor -- start 2023-11-04T01:37:28.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.142+0000 7fbd89178640 1 -- start start 2023-11-04T01:37:28.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd89178640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd840ae1d0 0x7fbd840cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd89178640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8415aff0 con 0x7fbd840c4ff0 2023-11-04T01:37:28.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd89178640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8415a3e0 con 0x7fbd84159c00 2023-11-04T01:37:28.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd89178640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8415a6c0 con 0x7fbd840ae1d0 2023-11-04T01:37:28.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd7bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbd840c4ff0 0x7fbd840adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52416/0 (socket says 172.21.15.114:52416) 2023-11-04T01:37:28.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd7bfff640 1 -- 172.21.15.114:0/3708431921 learned_addr learned my addr 172.21.15.114:0/3708431921 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:28.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd8359e640 1 --2- 172.21.15.114:0/3708431921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd840ae1d0 0x7fbd840cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd8259c640 1 -- 172.21.15.114:0/3708431921 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288808232 0 0) 0x7fbd8415aff0 con 0x7fbd840c4ff0 2023-11-04T01:37:28.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd8259c640 1 -- 172.21.15.114:0/3708431921 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd70003520 con 0x7fbd840c4ff0 2023-11-04T01:37:28.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd8259c640 1 -- 172.21.15.114:0/3708431921 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3526180113 0 0) 0x7fbd70003520 con 0x7fbd840c4ff0 2023-11-04T01:37:28.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd8259c640 1 -- 172.21.15.114:0/3708431921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd840ae1d0 msgr2=0x7fbd840cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:28.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd8259c640 1 --2- 172.21.15.114:0/3708431921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd840ae1d0 0x7fbd840cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd8259c640 1 -- 172.21.15.114:0/3708431921 >> v1:172.21.15.141:6789/0 conn(0x7fbd84159c00 legacy=0x7fbd840c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd8259c640 1 -- 172.21.15.114:0/3708431921 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8415a9a0 con 0x7fbd840c4ff0 2023-11-04T01:37:28.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd8259c640 1 -- 172.21.15.114:0/3708431921 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fbd6c001670 con 0x7fbd840c4ff0 2023-11-04T01:37:28.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd8259c640 1 -- 172.21.15.114:0/3708431921 >> v1:172.21.15.114:6789/0 conn(0x7fbd840c4ff0 legacy=0x7fbd840adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.143+0000 7fbd8259c640 1 --2- 172.21.15.114:0/3708431921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd840ae1d0 0x7fbd700039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.144+0000 7fbd8259c640 1 --2- 172.21.15.114:0/3708431921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd70003ee0 0x7fbd700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.144+0000 7fbd8259c640 1 --2- 172.21.15.114:0/3708431921 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd70004d00 0x7fbd70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.144+0000 7fbd8259c640 1 -- 172.21.15.114:0/3708431921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8415a6c0 con 0x7fbd70003ee0 2023-11-04T01:37:28.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.144+0000 7fbd8259c640 1 -- 172.21.15.114:0/3708431921 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7000b9e0 con 0x7fbd70004d00 2023-11-04T01:37:28.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.144+0000 7fbd8259c640 1 -- 172.21.15.114:0/3708431921 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7000bba0 con 0x7fbd840ae1d0 2023-11-04T01:37:28.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.144+0000 7fbd7bfff640 1 --2- 172.21.15.114:0/3708431921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd70003ee0 0x7fbd700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.144+0000 7fbd82d9d640 1 --2- 172.21.15.114:0/3708431921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd840ae1d0 0x7fbd700039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.144+0000 7fbd8359e640 1 --2- 172.21.15.114:0/3708431921 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd70004d00 0x7fbd70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.144+0000 7fbd7bfff640 1 -- 172.21.15.114:0/3708431921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd840ae1d0 msgr2=0x7fbd700039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:28.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.144+0000 7fbd7bfff640 1 --2- 172.21.15.114:0/3708431921 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd840ae1d0 0x7fbd700039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.144+0000 7fbd7bfff640 1 -- 172.21.15.114:0/3708431921 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd70004d00 msgr2=0x7fbd70005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:28.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.144+0000 7fbd7bfff640 1 --2- 172.21.15.114:0/3708431921 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd70004d00 0x7fbd70005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.144+0000 7fbd7bfff640 1 -- 172.21.15.114:0/3708431921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd70003520 con 0x7fbd70003ee0 2023-11-04T01:37:28.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.144+0000 7fbd8359e640 1 --2- 172.21.15.114:0/3708431921 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd70004d00 0x7fbd70005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:28.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.145+0000 7fbd7bfff640 1 --2- 172.21.15.114:0/3708431921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd70003ee0 0x7fbd700047c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbd840b4a60 tx=0x7fbd700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a341f59ff3746d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:28.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.145+0000 7fbd8259c640 1 -- 172.21.15.114:0/3708431921 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c005ad0 con 0x7fbd70003ee0 2023-11-04T01:37:28.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.145+0000 7fbd8259c640 1 -- 172.21.15.114:0/3708431921 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c005c30 con 0x7fbd70003ee0 2023-11-04T01:37:28.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.145+0000 7fbd8259c640 1 -- 172.21.15.114:0/3708431921 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c02c790 con 0x7fbd70003ee0 2023-11-04T01:37:28.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.145+0000 7fbd89178640 1 -- 172.21.15.114:0/3708431921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd70003ee0 msgr2=0x7fbd700047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.145+0000 7fbd89178640 1 --2- 172.21.15.114:0/3708431921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd70003ee0 0x7fbd700047c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbd840b4a60 tx=0x7fbd700057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.145+0000 7fbd8359e640 1 -- 172.21.15.114:0/3708431921 reap_dead start 2023-11-04T01:37:28.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.145+0000 7fbd89178640 1 -- 172.21.15.114:0/3708431921 shutdown_connections 2023-11-04T01:37:28.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.145+0000 7fbd89178640 1 -- 172.21.15.114:0/3708431921 >> 172.21.15.114:0/3708431921 conn(0x7fbd840ce950 msgr2=0x7fbd840ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:28.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.145+0000 7fbd89178640 1 -- 172.21.15.114:0/3708431921 shutdown_connections 2023-11-04T01:37:28.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.145+0000 7fbd89178640 1 -- 172.21.15.114:0/3708431921 wait complete. 2023-11-04T01:37:28.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.147+0000 7fbd89178640 1 Processor -- start 2023-11-04T01:37:28.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.147+0000 7fbd89178640 1 -- start start 2023-11-04T01:37:28.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.147+0000 7fbd89178640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd70003ee0 0x7fbd840b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.147+0000 7fbd89178640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd840c7c30 0x7fbd840c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.147+0000 7fbd89178640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd841f4080 0x7fbd841f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.147+0000 7fbd89178640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd84144ea0 con 0x7fbd840c7c30 2023-11-04T01:37:28.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.147+0000 7fbd89178640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd840c85d0 con 0x7fbd70003ee0 2023-11-04T01:37:28.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.147+0000 7fbd89178640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd84144230 con 0x7fbd841f4080 2023-11-04T01:37:28.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.147+0000 7fbd7bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd840c7c30 0x7fbd840c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.147+0000 7fbd7bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd840c7c30 0x7fbd840c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45064/0 (socket says 172.21.15.114:45064) 2023-11-04T01:37:28.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.147+0000 7fbd7bfff640 1 -- 172.21.15.114:0/416380899 learned_addr learned my addr 172.21.15.114:0/416380899 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:28.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.148+0000 7fbd82d9d640 1 --2- 172.21.15.114:0/416380899 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd70003ee0 0x7fbd840b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.148+0000 7fbd8359e640 1 --2- 172.21.15.114:0/416380899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd841f4080 0x7fbd841f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.148+0000 7fbd7bfff640 1 -- 172.21.15.114:0/416380899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd841f4080 msgr2=0x7fbd841f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.148+0000 7fbd7bfff640 1 --2- 172.21.15.114:0/416380899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd841f4080 0x7fbd841f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.148+0000 7fbd7bfff640 1 -- 172.21.15.114:0/416380899 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd70003ee0 msgr2=0x7fbd840b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.148+0000 7fbd7bfff640 1 --2- 172.21.15.114:0/416380899 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd70003ee0 0x7fbd840b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.148+0000 7fbd7bfff640 1 -- 172.21.15.114:0/416380899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd84144500 con 0x7fbd840c7c30 2023-11-04T01:37:28.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.148+0000 7fbd7bfff640 1 --2- 172.21.15.114:0/416380899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd840c7c30 0x7fbd840c8090 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbd840cfa50 tx=0x7fbd6c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:28.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.148+0000 7fbd7b7fe640 1 -- 172.21.15.114:0/416380899 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c02cba0 con 0x7fbd840c7c30 2023-11-04T01:37:28.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.148+0000 7fbd7b7fe640 1 -- 172.21.15.114:0/416380899 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c02cd00 con 0x7fbd840c7c30 2023-11-04T01:37:28.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.148+0000 7fbd89178640 1 -- 172.21.15.114:0/416380899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd841447e0 con 0x7fbd840c7c30 2023-11-04T01:37:28.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.148+0000 7fbd7b7fe640 1 -- 172.21.15.114:0/416380899 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c0072b0 con 0x7fbd840c7c30 2023-11-04T01:37:28.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.148+0000 7fbd89178640 1 -- 172.21.15.114:0/416380899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd841f4a40 con 0x7fbd840c7c30 2023-11-04T01:37:28.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.149+0000 7fbd89178640 1 -- 172.21.15.114:0/416380899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd84074290 con 0x7fbd840c7c30 2023-11-04T01:37:28.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.150+0000 7fbd7b7fe640 1 -- 172.21.15.114:0/416380899 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd6c032070 con 0x7fbd840c7c30 2023-11-04T01:37:28.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.150+0000 7fbd7b7fe640 1 --2- 172.21.15.114:0/416380899 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd6406ae70 0x7fbd6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.150+0000 7fbd7b7fe640 1 -- 172.21.15.114:0/416380899 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbd6c0aac60 con 0x7fbd840c7c30 2023-11-04T01:37:28.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.150+0000 7fbd82d9d640 1 --2- 172.21.15.114:0/416380899 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd6406ae70 0x7fbd6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.150+0000 7fbd82d9d640 1 --2- 172.21.15.114:0/416380899 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd6406ae70 0x7fbd6406d330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbd740018a0 tx=0x7fbd74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:28.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.154+0000 7fbd7b7fe640 1 -- 172.21.15.114:0/416380899 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd6c075a00 con 0x7fbd840c7c30 2023-11-04T01:37:28.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.318+0000 7fbd89178640 1 -- 172.21.15.114:0/416380899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbd8406cfb0 con 0x7fbd840c7c30 2023-11-04T01:37:28.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.319+0000 7fbd7b7fe640 1 -- 172.21.15.114:0/416380899 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbd6c045020 con 0x7fbd840c7c30 2023-11-04T01:37:28.321 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:28.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.320+0000 7fbd89178640 1 -- 172.21.15.114:0/416380899 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd6406ae70 msgr2=0x7fbd6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.320+0000 7fbd89178640 1 --2- 172.21.15.114:0/416380899 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd6406ae70 0x7fbd6406d330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbd740018a0 tx=0x7fbd74009040 comp rx=0 tx=0).stop 2023-11-04T01:37:28.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.320+0000 7fbd89178640 1 -- 172.21.15.114:0/416380899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd840c7c30 msgr2=0x7fbd840c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.320+0000 7fbd89178640 1 --2- 172.21.15.114:0/416380899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd840c7c30 0x7fbd840c8090 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbd840cfa50 tx=0x7fbd6c001a00 comp rx=0 tx=0).stop 2023-11-04T01:37:28.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.320+0000 7fbd89178640 1 -- 172.21.15.114:0/416380899 shutdown_connections 2023-11-04T01:37:28.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.320+0000 7fbd89178640 1 --2- 172.21.15.114:0/416380899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd841f4080 0x7fbd841f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.320+0000 7fbd89178640 1 --2- 172.21.15.114:0/416380899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd840c7c30 0x7fbd840c8090 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.320+0000 7fbd89178640 1 --2- 172.21.15.114:0/416380899 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd6406ae70 0x7fbd6406d330 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.321+0000 7fbd89178640 1 --2- 172.21.15.114:0/416380899 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd70003ee0 0x7fbd840b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.321+0000 7fbd89178640 1 -- 172.21.15.114:0/416380899 >> 172.21.15.114:0/416380899 conn(0x7fbd840ce950 msgr2=0x7fbd8415b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:28.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.321+0000 7fbd89178640 1 -- 172.21.15.114:0/416380899 shutdown_connections 2023-11-04T01:37:28.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.321+0000 7fbd89178640 1 -- 172.21.15.114:0/416380899 wait complete. 2023-11-04T01:37:28.334 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:37:28.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.432+0000 7fb3709b6640 1 Processor -- start 2023-11-04T01:37:28.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.432+0000 7fb3709b6640 1 -- start start 2023-11-04T01:37:28.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.432+0000 7fb3709b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb36c153850 0x7fb36c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.432+0000 7fb3709b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb36c0cc520 0x7fb36c070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.433+0000 7fb3709b6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36c0c3860 con 0x7fb36c0cc9d0 2023-11-04T01:37:28.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.433+0000 7fb3709b6640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36c0c9250 con 0x7fb36c153850 2023-11-04T01:37:28.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.433+0000 7fb3709b6640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36c153c30 con 0x7fb36c0cc520 2023-11-04T01:37:28.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.433+0000 7fb36a59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb36c153850 0x7fb36c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.433+0000 7fb36a59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb36c153850 0x7fb36c15a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45074/0 (socket says 172.21.15.114:45074) 2023-11-04T01:37:28.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.433+0000 7fb36ad9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb36c0cc9d0 0x7fb36c0c3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52422/0 (socket says 172.21.15.114:52422) 2023-11-04T01:37:28.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.433+0000 7fb36a59c640 1 -- 172.21.15.114:0/3408952142 learned_addr learned my addr 172.21.15.114:0/3408952142 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:28.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.433+0000 7fb361d9b640 1 --2- 172.21.15.114:0/3408952142 >> v2:172.21.15.141:3300/0 conn(0x7fb36c0cc520 0x7fb36c070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.433+0000 7fb36a59c640 1 -- 172.21.15.114:0/3408952142 >> v2:172.21.15.141:3300/0 conn(0x7fb36c0cc520 msgr2=0x7fb36c070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:28.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.433+0000 7fb36a59c640 1 --2- 172.21.15.114:0/3408952142 >> v2:172.21.15.141:3300/0 conn(0x7fb36c0cc520 0x7fb36c070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.433+0000 7fb36a59c640 1 -- 172.21.15.114:0/3408952142 >> v1:172.21.15.114:6789/0 conn(0x7fb36c0cc9d0 legacy=0x7fb36c0c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.433+0000 7fb36a59c640 1 -- 172.21.15.114:0/3408952142 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c15a700 con 0x7fb36c153850 2023-11-04T01:37:28.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.433+0000 7fb369d9b640 1 -- 172.21.15.114:0/3408952142 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690761722 0 0) 0x7fb36c0c3860 con 0x7fb36c0cc9d0 2023-11-04T01:37:28.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.434+0000 7fb36a59c640 1 --2- 172.21.15.114:0/3408952142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb36c153850 0x7fb36c15a1c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb36c070560 tx=0x7fb35c02ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1ae3412c13a8b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:28.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.434+0000 7fb369d9b640 1 -- 172.21.15.114:0/3408952142 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c02da80 con 0x7fb36c153850 2023-11-04T01:37:28.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.434+0000 7fb369d9b640 1 -- 172.21.15.114:0/3408952142 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35c02dbe0 con 0x7fb36c153850 2023-11-04T01:37:28.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.434+0000 7fb369d9b640 1 -- 172.21.15.114:0/3408952142 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c035440 con 0x7fb36c153850 2023-11-04T01:37:28.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.434+0000 7fb3709b6640 1 -- 172.21.15.114:0/3408952142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb36c153850 msgr2=0x7fb36c15a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.434+0000 7fb3709b6640 1 --2- 172.21.15.114:0/3408952142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb36c153850 0x7fb36c15a1c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb36c070560 tx=0x7fb35c02ccd0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.434+0000 7fb3709b6640 1 -- 172.21.15.114:0/3408952142 shutdown_connections 2023-11-04T01:37:28.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.434+0000 7fb3709b6640 1 --2- 172.21.15.114:0/3408952142 >> v2:172.21.15.141:3300/0 conn(0x7fb36c0cc520 0x7fb36c070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.434+0000 7fb3709b6640 1 --2- 172.21.15.114:0/3408952142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb36c153850 0x7fb36c15a1c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.434+0000 7fb3709b6640 1 -- 172.21.15.114:0/3408952142 >> 172.21.15.114:0/3408952142 conn(0x7fb36c0ce950 msgr2=0x7fb36c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:28.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.434+0000 7fb3709b6640 1 -- 172.21.15.114:0/3408952142 shutdown_connections 2023-11-04T01:37:28.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.434+0000 7fb3709b6640 1 -- 172.21.15.114:0/3408952142 wait complete. 2023-11-04T01:37:28.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.436+0000 7fb3709b6640 1 Processor -- start 2023-11-04T01:37:28.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.436+0000 7fb3709b6640 1 -- start start 2023-11-04T01:37:28.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.436+0000 7fb3709b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb36c0cc520 0x7fb36c14a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb3709b6640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb36c0cc9d0 0x7fb36c14a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb3709b6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb36c153850 0x7fb36c151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb3709b6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c152f80 con 0x7fb36c153850 2023-11-04T01:37:28.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb3709b6640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c14cfa0 con 0x7fb36c0cc9d0 2023-11-04T01:37:28.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb3709b6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c1526e0 con 0x7fb36c0cc520 2023-11-04T01:37:28.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb36ad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb36c153850 0x7fb36c151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb36ad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb36c153850 0x7fb36c151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45084/0 (socket says 172.21.15.114:45084) 2023-11-04T01:37:28.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb36ad9d640 1 -- 172.21.15.114:0/3346887810 learned_addr learned my addr 172.21.15.114:0/3346887810 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:28.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb361d9b640 1 --2- 172.21.15.114:0/3346887810 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb36c0cc9d0 0x7fb36c14a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb36a59c640 1 --2- 172.21.15.114:0/3346887810 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb36c0cc520 0x7fb36c14a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb36ad9d640 1 -- 172.21.15.114:0/3346887810 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb36c0cc520 msgr2=0x7fb36c14a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb36ad9d640 1 --2- 172.21.15.114:0/3346887810 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb36c0cc520 0x7fb36c14a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb36ad9d640 1 -- 172.21.15.114:0/3346887810 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb36c0cc9d0 msgr2=0x7fb36c14a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb36ad9d640 1 --2- 172.21.15.114:0/3346887810 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb36c0cc9d0 0x7fb36c14a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb36ad9d640 1 -- 172.21.15.114:0/3346887810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c0094d0 con 0x7fb36c153850 2023-11-04T01:37:28.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb36ad9d640 1 --2- 172.21.15.114:0/3346887810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb36c153850 0x7fb36c151b60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb36400c7e0 tx=0x7fb36400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:28.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb3637fe640 1 -- 172.21.15.114:0/3346887810 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36400a640 con 0x7fb36c153850 2023-11-04T01:37:28.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb3637fe640 1 -- 172.21.15.114:0/3346887810 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36400a7c0 con 0x7fb36c153850 2023-11-04T01:37:28.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb3709b6640 1 -- 172.21.15.114:0/3346887810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb36c1529c0 con 0x7fb36c153850 2023-11-04T01:37:28.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb3637fe640 1 -- 172.21.15.114:0/3346887810 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36400ab70 con 0x7fb36c153850 2023-11-04T01:37:28.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.437+0000 7fb3709b6640 1 -- 172.21.15.114:0/3346887810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36c150540 con 0x7fb36c153850 2023-11-04T01:37:28.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.438+0000 7fb3709b6640 1 -- 172.21.15.114:0/3346887810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36c074290 con 0x7fb36c153850 2023-11-04T01:37:28.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.439+0000 7fb3637fe640 1 -- 172.21.15.114:0/3346887810 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb36400acd0 con 0x7fb36c153850 2023-11-04T01:37:28.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.439+0000 7fb3637fe640 1 --2- 172.21.15.114:0/3346887810 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb34c06ae70 0x7fb34c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:28.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.439+0000 7fb3637fe640 1 -- 172.21.15.114:0/3346887810 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb364089170 con 0x7fb36c153850 2023-11-04T01:37:28.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.439+0000 7fb36a59c640 1 --2- 172.21.15.114:0/3346887810 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb34c06ae70 0x7fb34c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:28.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.439+0000 7fb36a59c640 1 --2- 172.21.15.114:0/3346887810 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb34c06ae70 0x7fb34c06d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb35c037000 tx=0x7fb35c031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:28.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.443+0000 7fb3637fe640 1 -- 172.21.15.114:0/3346887810 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb364053f10 con 0x7fb36c153850 2023-11-04T01:37:28.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.619+0000 7fb3709b6640 1 -- 172.21.15.114:0/3346887810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb36c14d0e0 con 0x7fb36c153850 2023-11-04T01:37:28.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.620+0000 7fb3637fe640 1 -- 172.21.15.114:0/3346887810 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb364057530 con 0x7fb36c153850 2023-11-04T01:37:28.622 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-11-04T01:37:28.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.622+0000 7fb3709b6640 1 -- 172.21.15.114:0/3346887810 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb34c06ae70 msgr2=0x7fb34c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.622+0000 7fb3709b6640 1 --2- 172.21.15.114:0/3346887810 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb34c06ae70 0x7fb34c06d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb35c037000 tx=0x7fb35c031000 comp rx=0 tx=0).stop 2023-11-04T01:37:28.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.622+0000 7fb3709b6640 1 -- 172.21.15.114:0/3346887810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb36c153850 msgr2=0x7fb36c151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:28.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.622+0000 7fb3709b6640 1 --2- 172.21.15.114:0/3346887810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb36c153850 0x7fb36c151b60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb36400c7e0 tx=0x7fb36400cca0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.622+0000 7fb3709b6640 1 -- 172.21.15.114:0/3346887810 shutdown_connections 2023-11-04T01:37:28.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.622+0000 7fb3709b6640 1 --2- 172.21.15.114:0/3346887810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb36c153850 0x7fb36c151b60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.622+0000 7fb3709b6640 1 --2- 172.21.15.114:0/3346887810 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb34c06ae70 0x7fb34c06d330 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.622+0000 7fb3709b6640 1 --2- 172.21.15.114:0/3346887810 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb36c0cc9d0 0x7fb36c14a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.622+0000 7fb3709b6640 1 --2- 172.21.15.114:0/3346887810 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb36c0cc520 0x7fb36c14a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:28.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.622+0000 7fb3709b6640 1 -- 172.21.15.114:0/3346887810 >> 172.21.15.114:0/3346887810 conn(0x7fb36c0ce950 msgr2=0x7fb36c070610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:28.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.622+0000 7fb3709b6640 1 -- 172.21.15.114:0/3346887810 shutdown_connections 2023-11-04T01:37:28.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.622+0000 7fb3709b6640 1 -- 172.21.15.114:0/3346887810 wait complete. 2023-11-04T01:37:28.635 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi141.front.sepia.ceph.com... 2023-11-04T01:37:28.635 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:28.635 DEBUG:teuthology.orchestra.run.smithi141:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-04T01:37:28.704 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:28.704 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi141.stderr:ceph-fuse[125013]: fuse finished with error 0 and tester_r 0 2023-11-04T01:37:28.704 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:28.710 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi141.stderr:2023-11-04T01:37:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:28.712 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:28.719 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:37:28.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:28.720 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:37:28.792 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:37:28.792 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:28.807 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:37:28.808 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:28.863 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:28.904 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi114.stderr:2023-11-04T01:37:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:29.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.999+0000 7f4f49232640 1 Processor -- start 2023-11-04T01:37:29.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.999+0000 7f4f49232640 1 -- start start 2023-11-04T01:37:29.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.999+0000 7f4f49232640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4f440b0ae0 0x7f4f440ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.999+0000 7f4f49232640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f440b4110 con 0x7f4f4406db20 2023-11-04T01:37:29.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.999+0000 7f4f49232640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f440b43f0 con 0x7f4f44159c70 2023-11-04T01:37:29.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:28.999+0000 7f4f49232640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f440b49b0 con 0x7f4f440b0ae0 2023-11-04T01:37:29.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.000+0000 7f4f4359e640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4f4406db20 0x7f4f4415d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52438/0 (socket says 172.21.15.114:52438) 2023-11-04T01:37:29.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.000+0000 7f4f4359e640 1 -- 172.21.15.114:0/1488803919 learned_addr learned my addr 172.21.15.114:0/1488803919 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:29.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.000+0000 7f4f3bfff640 1 --2- 172.21.15.114:0/1488803919 >> v2:172.21.15.141:3300/0 conn(0x7f4f440b0ae0 0x7f4f440ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.000+0000 7f4f4259c640 1 -- 172.21.15.114:0/1488803919 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104079828 0 0) 0x7f4f440b4110 con 0x7f4f4406db20 2023-11-04T01:37:29.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.000+0000 7f4f4259c640 1 -- 172.21.15.114:0/1488803919 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f30003520 con 0x7f4f4406db20 2023-11-04T01:37:29.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.000+0000 7f4f3bfff640 1 -- 172.21.15.114:0/1488803919 >> v1:172.21.15.141:6789/0 conn(0x7f4f44159c70 legacy=0x7f4f440b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.000+0000 7f4f3bfff640 1 -- 172.21.15.114:0/1488803919 >> v1:172.21.15.114:6789/0 conn(0x7f4f4406db20 legacy=0x7f4f4415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.000+0000 7f4f3bfff640 1 -- 172.21.15.114:0/1488803919 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f440b46d0 con 0x7f4f440b0ae0 2023-11-04T01:37:29.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.001+0000 7f4f3bfff640 1 --2- 172.21.15.114:0/1488803919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f440b0ae0 0x7f4f440ce370 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0097a0 tx=0x7f4f2c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d15e98eeed9de956 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.001+0000 7f4f4259c640 1 -- 172.21.15.114:0/1488803919 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c030610 con 0x7f4f440b0ae0 2023-11-04T01:37:29.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.001+0000 7f4f4259c640 1 -- 172.21.15.114:0/1488803919 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c030770 con 0x7f4f440b0ae0 2023-11-04T01:37:29.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.001+0000 7f4f4259c640 1 -- 172.21.15.114:0/1488803919 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c030b00 con 0x7f4f440b0ae0 2023-11-04T01:37:29.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.002+0000 7f4f49232640 1 -- 172.21.15.114:0/1488803919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f440b0ae0 msgr2=0x7f4f440ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.002+0000 7f4f49232640 1 --2- 172.21.15.114:0/1488803919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f440b0ae0 0x7f4f440ce370 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0097a0 tx=0x7f4f2c02b960 comp rx=0 tx=0).stop 2023-11-04T01:37:29.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.002+0000 7f4f49232640 1 -- 172.21.15.114:0/1488803919 shutdown_connections 2023-11-04T01:37:29.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.002+0000 7f4f49232640 1 --2- 172.21.15.114:0/1488803919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f440b0ae0 0x7f4f440ce370 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.002+0000 7f4f49232640 1 -- 172.21.15.114:0/1488803919 >> 172.21.15.114:0/1488803919 conn(0x7f4f440ce950 msgr2=0x7f4f440ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:29.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.002+0000 7f4f49232640 1 -- 172.21.15.114:0/1488803919 shutdown_connections 2023-11-04T01:37:29.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.002+0000 7f4f49232640 1 -- 172.21.15.114:0/1488803919 wait complete. 2023-11-04T01:37:29.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.003+0000 7f4f49232640 1 Processor -- start 2023-11-04T01:37:29.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.003+0000 7f4f49232640 1 -- start start 2023-11-04T01:37:29.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f49232640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f4406db20 0x7f4f441f13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f49232640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f440b0ae0 0x7f4f44155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f49232640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f44159c70 0x7f4f441558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f49232640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f440ad7c0 con 0x7f4f440b0ae0 2023-11-04T01:37:29.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f49232640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f440adaa0 con 0x7f4f44159c70 2023-11-04T01:37:29.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f49232640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f440add80 con 0x7f4f4406db20 2023-11-04T01:37:29.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f3bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f440b0ae0 0x7f4f44155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f3bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f440b0ae0 0x7f4f44155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45100/0 (socket says 172.21.15.114:45100) 2023-11-04T01:37:29.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f3bfff640 1 -- 172.21.15.114:0/741246784 learned_addr learned my addr 172.21.15.114:0/741246784 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:29.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f4359e640 1 --2- 172.21.15.114:0/741246784 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f44159c70 0x7f4f441558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f42d9d640 1 --2- 172.21.15.114:0/741246784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f4406db20 0x7f4f441f13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f3bfff640 1 -- 172.21.15.114:0/741246784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f4406db20 msgr2=0x7f4f441f13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f3bfff640 1 --2- 172.21.15.114:0/741246784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f4406db20 0x7f4f441f13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f3bfff640 1 -- 172.21.15.114:0/741246784 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f44159c70 msgr2=0x7f4f441558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f3bfff640 1 --2- 172.21.15.114:0/741246784 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f44159c70 0x7f4f441558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f3bfff640 1 -- 172.21.15.114:0/741246784 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c009400 con 0x7f4f440b0ae0 2023-11-04T01:37:29.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f42d9d640 1 --2- 172.21.15.114:0/741246784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f4406db20 0x7f4f441f13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:29.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f3bfff640 1 --2- 172.21.15.114:0/741246784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f440b0ae0 0x7f4f44155370 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c02bf70 tx=0x7f4f2c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f3b7fe640 1 -- 172.21.15.114:0/741246784 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c03e040 con 0x7f4f440b0ae0 2023-11-04T01:37:29.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f3b7fe640 1 -- 172.21.15.114:0/741246784 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c039cb0 con 0x7f4f440b0ae0 2023-11-04T01:37:29.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f49232640 1 -- 172.21.15.114:0/741246784 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f440ae060 con 0x7f4f440b0ae0 2023-11-04T01:37:29.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f3b7fe640 1 -- 172.21.15.114:0/741246784 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c044630 con 0x7f4f440b0ae0 2023-11-04T01:37:29.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.004+0000 7f4f49232640 1 -- 172.21.15.114:0/741246784 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f440ae620 con 0x7f4f440b0ae0 2023-11-04T01:37:29.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.005+0000 7f4f49232640 1 -- 172.21.15.114:0/741246784 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f440ae810 con 0x7f4f440b0ae0 2023-11-04T01:37:29.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.006+0000 7f4f3b7fe640 1 -- 172.21.15.114:0/741246784 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f2c04d3b0 con 0x7f4f440b0ae0 2023-11-04T01:37:29.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.006+0000 7f4f3b7fe640 1 --2- 172.21.15.114:0/741246784 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f2406aea0 0x7f4f2406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.006+0000 7f4f3b7fe640 1 -- 172.21.15.114:0/741246784 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4f2c0abcb0 con 0x7f4f440b0ae0 2023-11-04T01:37:29.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.006+0000 7f4f42d9d640 1 --2- 172.21.15.114:0/741246784 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f2406aea0 0x7f4f2406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.007+0000 7f4f42d9d640 1 --2- 172.21.15.114:0/741246784 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f2406aea0 0x7f4f2406d360 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4f34007fd0 tx=0x7f4f34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.010+0000 7f4f3b7fe640 1 -- 172.21.15.114:0/741246784 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f2c076ae0 con 0x7f4f440b0ae0 2023-11-04T01:37:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.178+0000 7f4f49232640 1 -- 172.21.15.114:0/741246784 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f4406b100 con 0x7f4f440b0ae0 2023-11-04T01:37:29.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.179+0000 7f4f3b7fe640 1 -- 172.21.15.114:0/741246784 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18796 (secure 0 0 0) 0x7f4f2c07a100 con 0x7f4f440b0ae0 2023-11-04T01:37:29.181 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:29.181 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:11.562429+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:29.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.181+0000 7f4f49232640 1 -- 172.21.15.114:0/741246784 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f2406aea0 msgr2=0x7f4f2406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.181+0000 7f4f49232640 1 --2- 172.21.15.114:0/741246784 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f2406aea0 0x7f4f2406d360 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4f34007fd0 tx=0x7f4f34009040 comp rx=0 tx=0).stop 2023-11-04T01:37:29.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.181+0000 7f4f49232640 1 -- 172.21.15.114:0/741246784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f440b0ae0 msgr2=0x7f4f44155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.181+0000 7f4f49232640 1 --2- 172.21.15.114:0/741246784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f440b0ae0 0x7f4f44155370 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c02bf70 tx=0x7f4f2c004730 comp rx=0 tx=0).stop 2023-11-04T01:37:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.181+0000 7f4f49232640 1 -- 172.21.15.114:0/741246784 shutdown_connections 2023-11-04T01:37:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.181+0000 7f4f49232640 1 --2- 172.21.15.114:0/741246784 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f2406aea0 0x7f4f2406d360 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.181+0000 7f4f49232640 1 --2- 172.21.15.114:0/741246784 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f44159c70 0x7f4f441558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.181+0000 7f4f49232640 1 --2- 172.21.15.114:0/741246784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f440b0ae0 0x7f4f44155370 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.181+0000 7f4f49232640 1 --2- 172.21.15.114:0/741246784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f4406db20 0x7f4f441f13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.181+0000 7f4f49232640 1 -- 172.21.15.114:0/741246784 >> 172.21.15.114:0/741246784 conn(0x7f4f440ce950 msgr2=0x7f4f440b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.181+0000 7f4f49232640 1 -- 172.21.15.114:0/741246784 shutdown_connections 2023-11-04T01:37:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.181+0000 7f4f49232640 1 -- 172.21.15.114:0/741246784 wait complete. 2023-11-04T01:37:29.194 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:29.195 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:29.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.295+0000 7f667b59e640 1 Processor -- start 2023-11-04T01:37:29.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.295+0000 7f667b59e640 1 -- start start 2023-11-04T01:37:29.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.296+0000 7f667b59e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f667c0aec00 0x7f667c0cb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.296+0000 7f667b59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f667c06f090 0x7f667c06f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.296+0000 7f667b59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c15a080 con 0x7f667c159b90 2023-11-04T01:37:29.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.296+0000 7f667b59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c06fa80 con 0x7f667c06f090 2023-11-04T01:37:29.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.296+0000 7f667b59e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c15dc70 con 0x7f667c0aec00 2023-11-04T01:37:29.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.296+0000 7f667ad9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f667c06f090 0x7f667c06f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.296+0000 7f667a59c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f667c159b90 0x7f667c15d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52440/0 (socket says 172.21.15.114:52440) 2023-11-04T01:37:29.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.296+0000 7f667ad9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f667c06f090 0x7f667c06f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45112/0 (socket says 172.21.15.114:45112) 2023-11-04T01:37:29.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.296+0000 7f667a59c640 1 -- 172.21.15.114:0/3149131351 learned_addr learned my addr 172.21.15.114:0/3149131351 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:29.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.297+0000 7f6679d9b640 1 --2- 172.21.15.114:0/3149131351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f667c0aec00 0x7f667c0cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.297+0000 7f667ad9d640 1 -- 172.21.15.114:0/3149131351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f667c0aec00 msgr2=0x7f667c0cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.297+0000 7f667ad9d640 1 --2- 172.21.15.114:0/3149131351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f667c0aec00 0x7f667c0cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.297+0000 7f667ad9d640 1 -- 172.21.15.114:0/3149131351 >> v1:172.21.15.114:6789/0 conn(0x7f667c159b90 legacy=0x7f667c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.297+0000 7f667ad9d640 1 -- 172.21.15.114:0/3149131351 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0cb740 con 0x7f667c06f090 2023-11-04T01:37:29.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.297+0000 7f667959a640 1 -- 172.21.15.114:0/3149131351 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936292906 0 0) 0x7f667c15a080 con 0x7f667c159b90 2023-11-04T01:37:29.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.297+0000 7f667ad9d640 1 --2- 172.21.15.114:0/3149131351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f667c06f090 0x7f667c06f540 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f66740097a0 tx=0x7f667402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce2964c4c6c0aad server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.297+0000 7f667959a640 1 -- 172.21.15.114:0/3149131351 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667402e070 con 0x7f667c06f090 2023-11-04T01:37:29.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.298+0000 7f667959a640 1 -- 172.21.15.114:0/3149131351 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66740315a0 con 0x7f667c06f090 2023-11-04T01:37:29.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.298+0000 7f667959a640 1 -- 172.21.15.114:0/3149131351 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674031930 con 0x7f667c06f090 2023-11-04T01:37:29.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.298+0000 7f667b59e640 1 -- 172.21.15.114:0/3149131351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f667c06f090 msgr2=0x7f667c06f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.298+0000 7f667b59e640 1 --2- 172.21.15.114:0/3149131351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f667c06f090 0x7f667c06f540 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f66740097a0 tx=0x7f667402b840 comp rx=0 tx=0).stop 2023-11-04T01:37:29.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.298+0000 7f667b59e640 1 -- 172.21.15.114:0/3149131351 shutdown_connections 2023-11-04T01:37:29.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.298+0000 7f667b59e640 1 --2- 172.21.15.114:0/3149131351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f667c06f090 0x7f667c06f540 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.298+0000 7f667b59e640 1 --2- 172.21.15.114:0/3149131351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f667c0aec00 0x7f667c0cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.298+0000 7f667b59e640 1 -- 172.21.15.114:0/3149131351 >> 172.21.15.114:0/3149131351 conn(0x7f667c0cf810 msgr2=0x7f667c0cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:29.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.298+0000 7f667b59e640 1 -- 172.21.15.114:0/3149131351 shutdown_connections 2023-11-04T01:37:29.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.298+0000 7f667b59e640 1 -- 172.21.15.114:0/3149131351 wait complete. 2023-11-04T01:37:29.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.299+0000 7f667b59e640 1 Processor -- start 2023-11-04T01:37:29.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.299+0000 7f667b59e640 1 -- start start 2023-11-04T01:37:29.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.300+0000 7f667b59e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f667c06f090 0x7f667c0c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.300+0000 7f667b59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f667c0aec00 0x7f667c0c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.300+0000 7f667b59e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f667c159b90 0x7f667c0c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.300+0000 7f667b59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c1533d0 con 0x7f667c0aec00 2023-11-04T01:37:29.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.300+0000 7f667b59e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0af240 con 0x7f667c06f090 2023-11-04T01:37:29.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.300+0000 7f667b59e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0af520 con 0x7f667c159b90 2023-11-04T01:37:29.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.300+0000 7f6679d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f667c0aec00 0x7f667c0c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.300+0000 7f6679d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f667c0aec00 0x7f667c0c8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45118/0 (socket says 172.21.15.114:45118) 2023-11-04T01:37:29.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.300+0000 7f6679d9b640 1 -- 172.21.15.114:0/3903262024 learned_addr learned my addr 172.21.15.114:0/3903262024 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:29.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.300+0000 7f667a59c640 1 --2- 172.21.15.114:0/3903262024 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f667c06f090 0x7f667c0c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.300+0000 7f667ad9d640 1 --2- 172.21.15.114:0/3903262024 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f667c159b90 0x7f667c0c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.301+0000 7f6679d9b640 1 -- 172.21.15.114:0/3903262024 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f667c159b90 msgr2=0x7f667c0c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.301+0000 7f6679d9b640 1 --2- 172.21.15.114:0/3903262024 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f667c159b90 0x7f667c0c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.301+0000 7f6679d9b640 1 -- 172.21.15.114:0/3903262024 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f667c06f090 msgr2=0x7f667c0c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.301+0000 7f6679d9b640 1 --2- 172.21.15.114:0/3903262024 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f667c06f090 0x7f667c0c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.301+0000 7f6679d9b640 1 -- 172.21.15.114:0/3903262024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6674009400 con 0x7f667c0aec00 2023-11-04T01:37:29.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.301+0000 7f6679d9b640 1 --2- 172.21.15.114:0/3903262024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f667c0aec00 0x7f667c0c8340 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f666400c7f0 tx=0x7f666400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.301+0000 7f6672ffd640 1 -- 172.21.15.114:0/3903262024 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6664004220 con 0x7f667c0aec00 2023-11-04T01:37:29.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.301+0000 7f6672ffd640 1 -- 172.21.15.114:0/3903262024 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6664004380 con 0x7f667c0aec00 2023-11-04T01:37:29.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.301+0000 7f667b59e640 1 -- 172.21.15.114:0/3903262024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c0af800 con 0x7f667c0aec00 2023-11-04T01:37:29.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.301+0000 7f6672ffd640 1 -- 172.21.15.114:0/3903262024 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6664007840 con 0x7f667c0aec00 2023-11-04T01:37:29.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.301+0000 7f667b59e640 1 -- 172.21.15.114:0/3903262024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c0afdc0 con 0x7f667c0aec00 2023-11-04T01:37:29.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.302+0000 7f667b59e640 1 -- 172.21.15.114:0/3903262024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667c0affe0 con 0x7f667c0aec00 2023-11-04T01:37:29.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.302+0000 7f6672ffd640 1 -- 172.21.15.114:0/3903262024 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6664007bb0 con 0x7f667c0aec00 2023-11-04T01:37:29.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.303+0000 7f6672ffd640 1 --2- 172.21.15.114:0/3903262024 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f665c06aea0 0x7f665c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.303+0000 7f667a59c640 1 --2- 172.21.15.114:0/3903262024 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f665c06aea0 0x7f665c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.303+0000 7f6672ffd640 1 -- 172.21.15.114:0/3903262024 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f66640898f0 con 0x7f667c0aec00 2023-11-04T01:37:29.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.303+0000 7f667a59c640 1 --2- 172.21.15.114:0/3903262024 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f665c06aea0 0x7f665c06d360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f666c0012e0 tx=0x7f666c005eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.307+0000 7f6672ffd640 1 -- 172.21.15.114:0/3903262024 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f66640545e0 con 0x7f667c0aec00 2023-11-04T01:37:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.471+0000 7f667b59e640 1 -- 172.21.15.114:0/3903262024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f667c04ece0 con 0x7f667c0aec00 2023-11-04T01:37:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.471+0000 7f6672ffd640 1 -- 172.21.15.114:0/3903262024 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f666401e0a0 con 0x7f667c0aec00 2023-11-04T01:37:29.473 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:37:29.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.473+0000 7f667b59e640 1 -- 172.21.15.114:0/3903262024 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f665c06aea0 msgr2=0x7f665c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.473+0000 7f667b59e640 1 --2- 172.21.15.114:0/3903262024 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f665c06aea0 0x7f665c06d360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f666c0012e0 tx=0x7f666c005eb0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.473+0000 7f667b59e640 1 -- 172.21.15.114:0/3903262024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f667c0aec00 msgr2=0x7f667c0c8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.473+0000 7f667b59e640 1 --2- 172.21.15.114:0/3903262024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f667c0aec00 0x7f667c0c8340 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f666400c7f0 tx=0x7f666400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.473+0000 7f667b59e640 1 -- 172.21.15.114:0/3903262024 shutdown_connections 2023-11-04T01:37:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.473+0000 7f667b59e640 1 --2- 172.21.15.114:0/3903262024 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f667c159b90 0x7f667c0c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.473+0000 7f667b59e640 1 --2- 172.21.15.114:0/3903262024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f667c0aec00 0x7f667c0c8340 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.473+0000 7f667b59e640 1 --2- 172.21.15.114:0/3903262024 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f665c06aea0 0x7f665c06d360 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.473+0000 7f667b59e640 1 --2- 172.21.15.114:0/3903262024 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f667c06f090 0x7f667c0c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.473+0000 7f667b59e640 1 -- 172.21.15.114:0/3903262024 >> 172.21.15.114:0/3903262024 conn(0x7f667c0cf810 msgr2=0x7f667c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:29.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.473+0000 7f667b59e640 1 -- 172.21.15.114:0/3903262024 shutdown_connections 2023-11-04T01:37:29.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.473+0000 7f667b59e640 1 -- 172.21.15.114:0/3903262024 wait complete. 2023-11-04T01:37:29.487 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:29.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.587+0000 7f0ad2965640 1 Processor -- start 2023-11-04T01:37:29.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.587+0000 7f0ad2965640 1 -- start start 2023-11-04T01:37:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.588+0000 7f0ad2965640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0acc0c4ff0 0x7f0acc0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.588+0000 7f0ad2965640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc15aff0 con 0x7f0acc159c00 2023-11-04T01:37:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.588+0000 7f0ad2965640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc15a3e0 con 0x7f0acc0adac0 2023-11-04T01:37:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.588+0000 7f0ad2965640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0acc15a6c0 con 0x7f0acc0c4ff0 2023-11-04T01:37:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.588+0000 7f0acbfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0acc159c00 0x7f0acc0c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52446/0 (socket says 172.21.15.114:52446) 2023-11-04T01:37:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.588+0000 7f0acbfff640 1 -- 172.21.15.114:0/2534895834 learned_addr learned my addr 172.21.15.114:0/2534895834 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.588+0000 7f0acaffd640 1 -- 172.21.15.114:0/2534895834 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200991453 0 0) 0x7f0acc15aff0 con 0x7f0acc159c00 2023-11-04T01:37:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.588+0000 7f0acb7fe640 1 --2- 172.21.15.114:0/2534895834 >> v2:172.21.15.141:3300/0 conn(0x7f0acc0c4ff0 0x7f0acc0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.588+0000 7f0acaffd640 1 -- 172.21.15.114:0/2534895834 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ab4003520 con 0x7f0acc159c00 2023-11-04T01:37:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acaffd640 1 -- 172.21.15.114:0/2534895834 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1955421846 0 0) 0x7f0ab4003520 con 0x7f0acc159c00 2023-11-04T01:37:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acaffd640 1 -- 172.21.15.114:0/2534895834 >> v2:172.21.15.141:3300/0 conn(0x7f0acc0c4ff0 msgr2=0x7f0acc0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acaffd640 1 --2- 172.21.15.114:0/2534895834 >> v2:172.21.15.141:3300/0 conn(0x7f0acc0c4ff0 0x7f0acc0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acaffd640 1 -- 172.21.15.114:0/2534895834 >> v1:172.21.15.141:6789/0 conn(0x7f0acc0adac0 legacy=0x7f0acc0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acaffd640 1 -- 172.21.15.114:0/2534895834 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc15a9a0 con 0x7f0acc159c00 2023-11-04T01:37:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acaffd640 1 -- 172.21.15.114:0/2534895834 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f0abc001670 con 0x7f0acc159c00 2023-11-04T01:37:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acaffd640 1 -- 172.21.15.114:0/2534895834 >> v1:172.21.15.114:6789/0 conn(0x7f0acc159c00 legacy=0x7f0acc0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acaffd640 1 --2- 172.21.15.114:0/2534895834 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ab4003970 0x7f0ab4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acaffd640 1 --2- 172.21.15.114:0/2534895834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ab40047c0 0x7f0ab4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acaffd640 1 --2- 172.21.15.114:0/2534895834 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ab4005180 0x7f0ab400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acaffd640 1 -- 172.21.15.114:0/2534895834 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc15a6c0 con 0x7f0ab40047c0 2023-11-04T01:37:29.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acaffd640 1 -- 172.21.15.114:0/2534895834 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab400c020 con 0x7f0ab4005180 2023-11-04T01:37:29.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acaffd640 1 -- 172.21.15.114:0/2534895834 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab400c1e0 con 0x7f0ab4003970 2023-11-04T01:37:29.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acb7fe640 1 --2- 172.21.15.114:0/2534895834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ab40047c0 0x7f0ab4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acbfff640 1 --2- 172.21.15.114:0/2534895834 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ab4003970 0x7f0ab4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0ad0f02640 1 --2- 172.21.15.114:0/2534895834 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ab4005180 0x7f0ab400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acb7fe640 1 -- 172.21.15.114:0/2534895834 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ab4003970 msgr2=0x7f0ab4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acb7fe640 1 --2- 172.21.15.114:0/2534895834 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ab4003970 0x7f0ab4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acb7fe640 1 -- 172.21.15.114:0/2534895834 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ab4005180 msgr2=0x7f0ab400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acb7fe640 1 --2- 172.21.15.114:0/2534895834 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ab4005180 0x7f0ab400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acb7fe640 1 -- 172.21.15.114:0/2534895834 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab4003520 con 0x7f0ab40047c0 2023-11-04T01:37:29.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0ad0f02640 1 --2- 172.21.15.114:0/2534895834 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ab4005180 0x7f0ab400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:29.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0acbfff640 1 --2- 172.21.15.114:0/2534895834 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ab4003970 0x7f0ab4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:29.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.589+0000 7f0ad0f02640 1 -- 172.21.15.114:0/2534895834 reap_dead start 2023-11-04T01:37:29.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.590+0000 7f0acb7fe640 1 --2- 172.21.15.114:0/2534895834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ab40047c0 0x7f0ab4004c40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0cfa50 tx=0x7f0ab40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccf4955e675a7d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.590+0000 7f0acaffd640 1 -- 172.21.15.114:0/2534895834 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac002c630 con 0x7f0ab40047c0 2023-11-04T01:37:29.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.590+0000 7f0acaffd640 1 -- 172.21.15.114:0/2534895834 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac002c790 con 0x7f0ab40047c0 2023-11-04T01:37:29.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.590+0000 7f0acaffd640 1 -- 172.21.15.114:0/2534895834 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac002cb40 con 0x7f0ab40047c0 2023-11-04T01:37:29.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.591+0000 7f0ad2965640 1 -- 172.21.15.114:0/2534895834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ab40047c0 msgr2=0x7f0ab4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.591+0000 7f0ad2965640 1 --2- 172.21.15.114:0/2534895834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ab40047c0 0x7f0ab4004c40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0cfa50 tx=0x7f0ab40057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.591+0000 7f0ad2965640 1 -- 172.21.15.114:0/2534895834 shutdown_connections 2023-11-04T01:37:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.591+0000 7f0ad2965640 1 --2- 172.21.15.114:0/2534895834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ab40047c0 0x7f0ab4004c40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.591+0000 7f0ad2965640 1 -- 172.21.15.114:0/2534895834 >> 172.21.15.114:0/2534895834 conn(0x7f0acc0ce950 msgr2=0x7f0acc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.591+0000 7f0ad2965640 1 -- 172.21.15.114:0/2534895834 shutdown_connections 2023-11-04T01:37:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.591+0000 7f0ad2965640 1 -- 172.21.15.114:0/2534895834 wait complete. 2023-11-04T01:37:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.592+0000 7f0ad2965640 1 Processor -- start 2023-11-04T01:37:29.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.592+0000 7f0ad2965640 1 -- start start 2023-11-04T01:37:29.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0ad2965640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ab40047c0 0x7f0acc14c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0ad2965640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0acc1562f0 0x7f0acc14fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0ad2965640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0acc156750 0x7f0acc150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0ad2965640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc14df70 con 0x7f0acc1562f0 2023-11-04T01:37:29.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0ad2965640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc14d640 con 0x7f0ab40047c0 2023-11-04T01:37:29.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0ad2965640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc14d920 con 0x7f0acc156750 2023-11-04T01:37:29.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0acb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0acc1562f0 0x7f0acc14fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0acb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0acc1562f0 0x7f0acc14fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45142/0 (socket says 172.21.15.114:45142) 2023-11-04T01:37:29.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0acb7fe640 1 -- 172.21.15.114:0/2343291655 learned_addr learned my addr 172.21.15.114:0/2343291655 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:29.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0acbfff640 1 --2- 172.21.15.114:0/2343291655 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ab40047c0 0x7f0acc14c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0ad0f02640 1 --2- 172.21.15.114:0/2343291655 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0acc156750 0x7f0acc150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0acb7fe640 1 -- 172.21.15.114:0/2343291655 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0acc156750 msgr2=0x7f0acc150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0acb7fe640 1 --2- 172.21.15.114:0/2343291655 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0acc156750 0x7f0acc150060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0acb7fe640 1 -- 172.21.15.114:0/2343291655 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ab40047c0 msgr2=0x7f0acc14c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0acb7fe640 1 --2- 172.21.15.114:0/2343291655 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ab40047c0 0x7f0acc14c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0acb7fe640 1 -- 172.21.15.114:0/2343291655 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc14dc00 con 0x7f0acc1562f0 2023-11-04T01:37:29.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0acbfff640 1 --2- 172.21.15.114:0/2343291655 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ab40047c0 0x7f0acc14c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:29.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0acb7fe640 1 --2- 172.21.15.114:0/2343291655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0acc1562f0 0x7f0acc14fb20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009b50 tx=0x7f0ac0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0ac8ff9640 1 -- 172.21.15.114:0/2343291655 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0034a90 con 0x7f0acc1562f0 2023-11-04T01:37:29.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0ac8ff9640 1 -- 172.21.15.114:0/2343291655 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac0034bf0 con 0x7f0acc1562f0 2023-11-04T01:37:29.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0ac8ff9640 1 -- 172.21.15.114:0/2343291655 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac003e400 con 0x7f0acc1562f0 2023-11-04T01:37:29.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0ad2965640 1 -- 172.21.15.114:0/2343291655 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0acc153340 con 0x7f0acc1562f0 2023-11-04T01:37:29.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.593+0000 7f0ad2965640 1 -- 172.21.15.114:0/2343291655 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0acc152650 con 0x7f0acc1562f0 2023-11-04T01:37:29.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.594+0000 7f0ad2965640 1 -- 172.21.15.114:0/2343291655 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0acc14e0e0 con 0x7f0acc1562f0 2023-11-04T01:37:29.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.595+0000 7f0ac8ff9640 1 -- 172.21.15.114:0/2343291655 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ac003e560 con 0x7f0acc1562f0 2023-11-04T01:37:29.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.595+0000 7f0ac8ff9640 1 --2- 172.21.15.114:0/2343291655 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ab806aea0 0x7f0ab806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.595+0000 7f0ac8ff9640 1 -- 172.21.15.114:0/2343291655 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0ac00ab840 con 0x7f0acc1562f0 2023-11-04T01:37:29.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.595+0000 7f0acbfff640 1 --2- 172.21.15.114:0/2343291655 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ab806aea0 0x7f0ab806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.596+0000 7f0acbfff640 1 --2- 172.21.15.114:0/2343291655 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ab806aea0 0x7f0ab806d360 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0687c0 tx=0x7f0abc001580 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.599+0000 7f0ac8ff9640 1 -- 172.21.15.114:0/2343291655 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0ac0076790 con 0x7f0acc1562f0 2023-11-04T01:37:29.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.764+0000 7f0ad2965640 1 -- 172.21.15.114:0/2343291655 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0acc074290 con 0x7f0acc1562f0 2023-11-04T01:37:29.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.765+0000 7f0ac8ff9640 1 -- 172.21.15.114:0/2343291655 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ac0079db0 con 0x7f0acc1562f0 2023-11-04T01:37:29.767 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:29.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.767+0000 7f0ad2965640 1 -- 172.21.15.114:0/2343291655 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ab806aea0 msgr2=0x7f0ab806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.767+0000 7f0ad2965640 1 --2- 172.21.15.114:0/2343291655 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ab806aea0 0x7f0ab806d360 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0687c0 tx=0x7f0abc001580 comp rx=0 tx=0).stop 2023-11-04T01:37:29.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.767+0000 7f0ad2965640 1 -- 172.21.15.114:0/2343291655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0acc1562f0 msgr2=0x7f0acc14fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.767+0000 7f0ad2965640 1 --2- 172.21.15.114:0/2343291655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0acc1562f0 0x7f0acc14fb20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009b50 tx=0x7f0ac0004730 comp rx=0 tx=0).stop 2023-11-04T01:37:29.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.767+0000 7f0ad2965640 1 -- 172.21.15.114:0/2343291655 shutdown_connections 2023-11-04T01:37:29.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.767+0000 7f0ad2965640 1 --2- 172.21.15.114:0/2343291655 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0acc156750 0x7f0acc150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.767+0000 7f0ad2965640 1 --2- 172.21.15.114:0/2343291655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0acc1562f0 0x7f0acc14fb20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.767+0000 7f0ad2965640 1 --2- 172.21.15.114:0/2343291655 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ab806aea0 0x7f0ab806d360 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.767+0000 7f0ad2965640 1 --2- 172.21.15.114:0/2343291655 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ab40047c0 0x7f0acc14c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.767+0000 7f0ad2965640 1 -- 172.21.15.114:0/2343291655 >> 172.21.15.114:0/2343291655 conn(0x7f0acc0ce950 msgr2=0x7f0acc0709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:29.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.767+0000 7f0ad2965640 1 -- 172.21.15.114:0/2343291655 shutdown_connections 2023-11-04T01:37:29.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.767+0000 7f0ad2965640 1 -- 172.21.15.114:0/2343291655 wait complete. 2023-11-04T01:37:29.779 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:29.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.880+0000 7fb338e0e640 1 Processor -- start 2023-11-04T01:37:29.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.880+0000 7fb338e0e640 1 -- start start 2023-11-04T01:37:29.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.881+0000 7fb338e0e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb33415ad40 0x7fb33406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.881+0000 7fb338e0e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb3340c9b60 0x7fb334070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.881+0000 7fb338e0e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb334065df0 con 0x7fb33415b120 2023-11-04T01:37:29.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.881+0000 7fb338e0e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb33406bc40 con 0x7fb3340c9b60 2023-11-04T01:37:29.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.881+0000 7fb338e0e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb334066040 con 0x7fb33415ad40 2023-11-04T01:37:29.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.881+0000 7fb332d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb3340c9b60 0x7fb334070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.881+0000 7fb32bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb33415b120 0x7fb33415f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52460/0 (socket says 172.21.15.114:52460) 2023-11-04T01:37:29.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.881+0000 7fb32bfff640 1 -- 172.21.15.114:0/393756855 learned_addr learned my addr 172.21.15.114:0/393756855 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:29.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.881+0000 7fb332d9d640 1 --2- 172.21.15.114:0/393756855 >> v2:172.21.15.114:3300/0 conn(0x7fb3340c9b60 0x7fb334070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45148/0 (socket says 172.21.15.114:45148) 2023-11-04T01:37:29.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.881+0000 7fb332d9d640 1 -- 172.21.15.114:0/393756855 >> v2:172.21.15.141:3300/0 conn(0x7fb33415ad40 msgr2=0x7fb33406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:29.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.881+0000 7fb332d9d640 1 --2- 172.21.15.114:0/393756855 >> v2:172.21.15.141:3300/0 conn(0x7fb33415ad40 0x7fb33406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.881+0000 7fb332d9d640 1 -- 172.21.15.114:0/393756855 >> v1:172.21.15.114:6789/0 conn(0x7fb33415b120 legacy=0x7fb33415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.881+0000 7fb332d9d640 1 -- 172.21.15.114:0/393756855 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb334066320 con 0x7fb3340c9b60 2023-11-04T01:37:29.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.881+0000 7fb331d9b640 1 -- 172.21.15.114:0/393756855 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062041289 0 0) 0x7fb334065df0 con 0x7fb33415b120 2023-11-04T01:37:29.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.882+0000 7fb332d9d640 1 --2- 172.21.15.114:0/393756855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3340c9b60 0x7fb334070ff0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb33406e030 tx=0x7fb32c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a43bdea01c462b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.882+0000 7fb331d9b640 1 -- 172.21.15.114:0/393756855 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c02cc80 con 0x7fb3340c9b60 2023-11-04T01:37:29.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.882+0000 7fb331d9b640 1 -- 172.21.15.114:0/393756855 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c02cde0 con 0x7fb3340c9b60 2023-11-04T01:37:29.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.882+0000 7fb331d9b640 1 -- 172.21.15.114:0/393756855 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c034660 con 0x7fb3340c9b60 2023-11-04T01:37:29.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.883+0000 7fb338e0e640 1 -- 172.21.15.114:0/393756855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3340c9b60 msgr2=0x7fb334070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.883+0000 7fb338e0e640 1 --2- 172.21.15.114:0/393756855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3340c9b60 0x7fb334070ff0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb33406e030 tx=0x7fb32c02bed0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.883+0000 7fb338e0e640 1 -- 172.21.15.114:0/393756855 shutdown_connections 2023-11-04T01:37:29.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.883+0000 7fb338e0e640 1 --2- 172.21.15.114:0/393756855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3340c9b60 0x7fb334070ff0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.883+0000 7fb338e0e640 1 --2- 172.21.15.114:0/393756855 >> v2:172.21.15.141:3300/0 conn(0x7fb33415ad40 0x7fb33406b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.883+0000 7fb338e0e640 1 -- 172.21.15.114:0/393756855 >> 172.21.15.114:0/393756855 conn(0x7fb3340cbc90 msgr2=0x7fb3340cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:29.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.883+0000 7fb338e0e640 1 -- 172.21.15.114:0/393756855 shutdown_connections 2023-11-04T01:37:29.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.883+0000 7fb338e0e640 1 -- 172.21.15.114:0/393756855 wait complete. 2023-11-04T01:37:29.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.884+0000 7fb338e0e640 1 Processor -- start 2023-11-04T01:37:29.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.884+0000 7fb338e0e640 1 -- start start 2023-11-04T01:37:29.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb338e0e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3340c9b60 0x7fb33415d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb338e0e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb33415ad40 0x7fb334153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb338e0e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb33415b120 0x7fb33415b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb338e0e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33415e0e0 con 0x7fb33415b120 2023-11-04T01:37:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb338e0e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33415e3c0 con 0x7fb3340c9b60 2023-11-04T01:37:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb338e0e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3340c6c70 con 0x7fb33415ad40 2023-11-04T01:37:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb332d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb33415b120 0x7fb33415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb332d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb33415b120 0x7fb33415b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45150/0 (socket says 172.21.15.114:45150) 2023-11-04T01:37:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb332d9d640 1 -- 172.21.15.114:0/3769147442 learned_addr learned my addr 172.21.15.114:0/3769147442 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb332d9d640 1 -- 172.21.15.114:0/3769147442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb33415ad40 msgr2=0x7fb334153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb32bfff640 1 --2- 172.21.15.114:0/3769147442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb33415ad40 0x7fb334153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb33259c640 1 --2- 172.21.15.114:0/3769147442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3340c9b60 0x7fb33415d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb332d9d640 1 --2- 172.21.15.114:0/3769147442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb33415ad40 0x7fb334153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb332d9d640 1 -- 172.21.15.114:0/3769147442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3340c9b60 msgr2=0x7fb33415d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:29.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb332d9d640 1 --2- 172.21.15.114:0/3769147442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3340c9b60 0x7fb33415d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:29.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb332d9d640 1 -- 172.21.15.114:0/3769147442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c009a70 con 0x7fb33415b120 2023-11-04T01:37:29.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb33259c640 1 --2- 172.21.15.114:0/3769147442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3340c9b60 0x7fb33415d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:29.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb32bfff640 1 --2- 172.21.15.114:0/3769147442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb33415ad40 0x7fb334153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:29.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb332d9d640 1 --2- 172.21.15.114:0/3769147442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb33415b120 0x7fb33415b530 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb32c037040 tx=0x7fb32c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb32affd640 1 -- 172.21.15.114:0/3769147442 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c03e610 con 0x7fb33415b120 2023-11-04T01:37:29.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb32affd640 1 -- 172.21.15.114:0/3769147442 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c03e770 con 0x7fb33415b120 2023-11-04T01:37:29.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb32affd640 1 -- 172.21.15.114:0/3769147442 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c03eb20 con 0x7fb33415b120 2023-11-04T01:37:29.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.885+0000 7fb338e0e640 1 -- 172.21.15.114:0/3769147442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3340c6f50 con 0x7fb33415b120 2023-11-04T01:37:29.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.886+0000 7fb338e0e640 1 -- 172.21.15.114:0/3769147442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33415de00 con 0x7fb33415b120 2023-11-04T01:37:29.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.887+0000 7fb338e0e640 1 -- 172.21.15.114:0/3769147442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3340c6ad0 con 0x7fb33415b120 2023-11-04T01:37:29.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.887+0000 7fb32affd640 1 -- 172.21.15.114:0/3769147442 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb32c03b050 con 0x7fb33415b120 2023-11-04T01:37:29.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.887+0000 7fb32affd640 1 --2- 172.21.15.114:0/3769147442 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb31406ae70 0x7fb31406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:29.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.887+0000 7fb32affd640 1 -- 172.21.15.114:0/3769147442 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb32c0ac3a0 con 0x7fb33415b120 2023-11-04T01:37:29.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.887+0000 7fb33259c640 1 --2- 172.21.15.114:0/3769147442 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb31406ae70 0x7fb31406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:29.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.888+0000 7fb33259c640 1 --2- 172.21.15.114:0/3769147442 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb31406ae70 0x7fb31406d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb324006fd0 tx=0x7fb324008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:29.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:29.892+0000 7fb32affd640 1 -- 172.21.15.114:0/3769147442 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb3340c6ad0 con 0x7fb33415b120 2023-11-04T01:37:30.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.066+0000 7fb338e0e640 1 -- 172.21.15.114:0/3769147442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3340c6ad0 con 0x7fb33415b120 2023-11-04T01:37:30.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.066+0000 7fb32affd640 1 -- 172.21.15.114:0/3769147442 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb3340c6ad0 con 0x7fb33415b120 2023-11-04T01:37:30.068 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:37:30.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.068+0000 7fb338e0e640 1 -- 172.21.15.114:0/3769147442 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb31406ae70 msgr2=0x7fb31406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.068+0000 7fb338e0e640 1 --2- 172.21.15.114:0/3769147442 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb31406ae70 0x7fb31406d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb324006fd0 tx=0x7fb324008040 comp rx=0 tx=0).stop 2023-11-04T01:37:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.068+0000 7fb338e0e640 1 -- 172.21.15.114:0/3769147442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb33415b120 msgr2=0x7fb33415b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.068+0000 7fb338e0e640 1 --2- 172.21.15.114:0/3769147442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb33415b120 0x7fb33415b530 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb32c037040 tx=0x7fb32c004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.068+0000 7fb338e0e640 1 -- 172.21.15.114:0/3769147442 shutdown_connections 2023-11-04T01:37:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.068+0000 7fb338e0e640 1 --2- 172.21.15.114:0/3769147442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb33415b120 0x7fb33415b530 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.068+0000 7fb338e0e640 1 --2- 172.21.15.114:0/3769147442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb33415ad40 0x7fb334153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.068+0000 7fb338e0e640 1 --2- 172.21.15.114:0/3769147442 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb31406ae70 0x7fb31406d330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.068+0000 7fb338e0e640 1 --2- 172.21.15.114:0/3769147442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb3340c9b60 0x7fb33415d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.068+0000 7fb338e0e640 1 -- 172.21.15.114:0/3769147442 >> 172.21.15.114:0/3769147442 conn(0x7fb3340cbc90 msgr2=0x7fb33406d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.069+0000 7fb338e0e640 1 -- 172.21.15.114:0/3769147442 shutdown_connections 2023-11-04T01:37:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.069+0000 7fb338e0e640 1 -- 172.21.15.114:0/3769147442 wait complete. 2023-11-04T01:37:30.081 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:30.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.181+0000 7f81470c2640 1 Processor -- start 2023-11-04T01:37:30.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.181+0000 7f81470c2640 1 -- start start 2023-11-04T01:37:30.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.182+0000 7f81470c2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f81400d0710 0x7f81400cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.182+0000 7f81470c2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f81400cda50 0x7f81400b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.182+0000 7f81470c2640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81400d0280 con 0x7f814015e430 2023-11-04T01:37:30.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.182+0000 7f81470c2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81400cf670 con 0x7f81400d0710 2023-11-04T01:37:30.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.182+0000 7f81470c2640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81400cf950 con 0x7f81400cda50 2023-11-04T01:37:30.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.182+0000 7f8137fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f81400d0710 0x7f81400cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.182+0000 7f8137fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f81400d0710 0x7f81400cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45162/0 (socket says 172.21.15.114:45162) 2023-11-04T01:37:30.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.182+0000 7f8137fff640 1 -- 172.21.15.114:0/1495929114 learned_addr learned my addr 172.21.15.114:0/1495929114 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:30.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.182+0000 7f814565f640 1 --2- 172.21.15.114:0/1495929114 >> v2:172.21.15.141:3300/0 conn(0x7f81400cda50 0x7f81400b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.182+0000 7f8137fff640 1 -- 172.21.15.114:0/1495929114 >> v2:172.21.15.141:3300/0 conn(0x7f81400cda50 msgr2=0x7f81400b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:30.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.182+0000 7f8137fff640 1 --2- 172.21.15.114:0/1495929114 >> v2:172.21.15.141:3300/0 conn(0x7f81400cda50 0x7f81400b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.182+0000 7f8137fff640 1 -- 172.21.15.114:0/1495929114 >> v1:172.21.15.141:6789/0 conn(0x7f814015e430 legacy=0x7f81400cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.182+0000 7f8137fff640 1 -- 172.21.15.114:0/1495929114 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81400cfc30 con 0x7f81400d0710 2023-11-04T01:37:30.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.183+0000 7f8137fff640 1 --2- 172.21.15.114:0/1495929114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81400d0710 0x7f81400cd510 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f81400b6250 tx=0x7f813002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90df434d1ffc3b67 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:30.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.183+0000 7f81377fe640 1 -- 172.21.15.114:0/1495929114 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130030860 con 0x7f81400d0710 2023-11-04T01:37:30.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.183+0000 7f81377fe640 1 -- 172.21.15.114:0/1495929114 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81300309c0 con 0x7f81400d0710 2023-11-04T01:37:30.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.183+0000 7f81377fe640 1 -- 172.21.15.114:0/1495929114 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130030d50 con 0x7f81400d0710 2023-11-04T01:37:30.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.183+0000 7f81470c2640 1 -- 172.21.15.114:0/1495929114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81400d0710 msgr2=0x7f81400cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.184+0000 7f81470c2640 1 --2- 172.21.15.114:0/1495929114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81400d0710 0x7f81400cd510 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f81400b6250 tx=0x7f813002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.184+0000 7f81470c2640 1 -- 172.21.15.114:0/1495929114 shutdown_connections 2023-11-04T01:37:30.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.184+0000 7f81470c2640 1 --2- 172.21.15.114:0/1495929114 >> v2:172.21.15.141:3300/0 conn(0x7f81400cda50 0x7f81400b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.184+0000 7f81470c2640 1 --2- 172.21.15.114:0/1495929114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81400d0710 0x7f81400cd510 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.184+0000 7f81470c2640 1 -- 172.21.15.114:0/1495929114 >> 172.21.15.114:0/1495929114 conn(0x7f814006ea20 msgr2=0x7f814006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:30.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.184+0000 7f81470c2640 1 -- 172.21.15.114:0/1495929114 shutdown_connections 2023-11-04T01:37:30.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.184+0000 7f81470c2640 1 -- 172.21.15.114:0/1495929114 wait complete. 2023-11-04T01:37:30.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.185+0000 7f81470c2640 1 Processor -- start 2023-11-04T01:37:30.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.185+0000 7f81470c2640 1 -- start start 2023-11-04T01:37:30.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f81470c2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81400cda50 0x7f81401582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f81470c2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81400d0710 0x7f81400af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f81470c2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f814015e430 0x7f81400c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f81470c2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81400c8eb0 con 0x7f81400d0710 2023-11-04T01:37:30.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f81470c2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81401f1170 con 0x7f81400cda50 2023-11-04T01:37:30.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f81470c2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81400c8230 con 0x7f814015e430 2023-11-04T01:37:30.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f8137fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81400d0710 0x7f81400af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f8137fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81400d0710 0x7f81400af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45180/0 (socket says 172.21.15.114:45180) 2023-11-04T01:37:30.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f8137fff640 1 -- 172.21.15.114:0/3551272128 learned_addr learned my addr 172.21.15.114:0/3551272128 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:30.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f8144e5e640 1 --2- 172.21.15.114:0/3551272128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81400cda50 0x7f81401582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f814565f640 1 --2- 172.21.15.114:0/3551272128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f814015e430 0x7f81400c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f8137fff640 1 -- 172.21.15.114:0/3551272128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f814015e430 msgr2=0x7f81400c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f8137fff640 1 --2- 172.21.15.114:0/3551272128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f814015e430 0x7f81400c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f8137fff640 1 -- 172.21.15.114:0/3551272128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81400cda50 msgr2=0x7f81401582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f8137fff640 1 --2- 172.21.15.114:0/3551272128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81400cda50 0x7f81401582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f8137fff640 1 -- 172.21.15.114:0/3551272128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81300094d0 con 0x7f81400d0710 2023-11-04T01:37:30.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f8144e5e640 1 --2- 172.21.15.114:0/3551272128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81400cda50 0x7f81401582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:30.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f814565f640 1 --2- 172.21.15.114:0/3551272128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f814015e430 0x7f81400c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:30.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f8137fff640 1 --2- 172.21.15.114:0/3551272128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81400d0710 0x7f81400af080 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f813002b9e0 tx=0x7f8130004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:30.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f81357fa640 1 -- 172.21.15.114:0/3551272128 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130039c90 con 0x7f81400d0710 2023-11-04T01:37:30.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f81357fa640 1 -- 172.21.15.114:0/3551272128 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8130039e10 con 0x7f81400d0710 2023-11-04T01:37:30.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f81357fa640 1 -- 172.21.15.114:0/3551272128 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130043640 con 0x7f81400d0710 2023-11-04T01:37:30.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f81470c2640 1 -- 172.21.15.114:0/3551272128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81400c8510 con 0x7f81400d0710 2023-11-04T01:37:30.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.186+0000 7f81470c2640 1 -- 172.21.15.114:0/3551272128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81400c8ad0 con 0x7f81400d0710 2023-11-04T01:37:30.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.187+0000 7f81470c2640 1 -- 172.21.15.114:0/3551272128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81400c8ff0 con 0x7f81400d0710 2023-11-04T01:37:30.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.188+0000 7f81357fa640 1 -- 172.21.15.114:0/3551272128 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81300437a0 con 0x7f81400d0710 2023-11-04T01:37:30.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.188+0000 7f81357fa640 1 --2- 172.21.15.114:0/3551272128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f812c06ae70 0x7f812c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.188+0000 7f8144e5e640 1 --2- 172.21.15.114:0/3551272128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f812c06ae70 0x7f812c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.188+0000 7f81357fa640 1 -- 172.21.15.114:0/3551272128 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f813003e070 con 0x7f81400d0710 2023-11-04T01:37:30.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.189+0000 7f8144e5e640 1 --2- 172.21.15.114:0/3551272128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f812c06ae70 0x7f812c06d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f813c000f60 tx=0x7f813c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:30.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.192+0000 7f81357fa640 1 -- 172.21.15.114:0/3551272128 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81400c8ff0 con 0x7f81400d0710 2023-11-04T01:37:30.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.359+0000 7f81470c2640 1 -- 172.21.15.114:0/3551272128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f81400c8ff0 con 0x7f81400d0710 2023-11-04T01:37:30.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.359+0000 7f81357fa640 1 -- 172.21.15.114:0/3551272128 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f81400c8ff0 con 0x7f81400d0710 2023-11-04T01:37:30.361 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:30.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.361+0000 7f81470c2640 1 -- 172.21.15.114:0/3551272128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f812c06ae70 msgr2=0x7f812c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.361+0000 7f81470c2640 1 --2- 172.21.15.114:0/3551272128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f812c06ae70 0x7f812c06d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f813c000f60 tx=0x7f813c009040 comp rx=0 tx=0).stop 2023-11-04T01:37:30.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.361+0000 7f81470c2640 1 -- 172.21.15.114:0/3551272128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81400d0710 msgr2=0x7f81400af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.361+0000 7f81470c2640 1 --2- 172.21.15.114:0/3551272128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81400d0710 0x7f81400af080 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f813002b9e0 tx=0x7f8130004730 comp rx=0 tx=0).stop 2023-11-04T01:37:30.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.361+0000 7f81470c2640 1 -- 172.21.15.114:0/3551272128 shutdown_connections 2023-11-04T01:37:30.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.361+0000 7f81470c2640 1 --2- 172.21.15.114:0/3551272128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f814015e430 0x7f81400c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.361+0000 7f81470c2640 1 --2- 172.21.15.114:0/3551272128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81400d0710 0x7f81400af080 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.361+0000 7f81470c2640 1 --2- 172.21.15.114:0/3551272128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f812c06ae70 0x7f812c06d330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.361+0000 7f81470c2640 1 --2- 172.21.15.114:0/3551272128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81400cda50 0x7f81401582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.361+0000 7f81470c2640 1 -- 172.21.15.114:0/3551272128 >> 172.21.15.114:0/3551272128 conn(0x7f814006ea20 msgr2=0x7f81400b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:30.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.361+0000 7f81470c2640 1 -- 172.21.15.114:0/3551272128 shutdown_connections 2023-11-04T01:37:30.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.361+0000 7f81470c2640 1 -- 172.21.15.114:0/3551272128 wait complete. 2023-11-04T01:37:30.374 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:37:30.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.472+0000 7f082b997640 1 Processor -- start 2023-11-04T01:37:30.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.472+0000 7f082b997640 1 -- start start 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.473+0000 7f082b997640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0824071f90 0x7f08240b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.473+0000 7f082b997640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0824072370 0x7f08240cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.473+0000 7f082b997640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08240b1cc0 con 0x7f082415add0 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.473+0000 7f082b997640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08240b1fa0 con 0x7f0824072370 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.473+0000 7f082b997640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f082415a0e0 con 0x7f0824071f90 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.473+0000 7f0829f34640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0824072370 0x7f08240cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.473+0000 7f0829f34640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0824072370 0x7f08240cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45192/0 (socket says 172.21.15.114:45192) 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.473+0000 7f0829f34640 1 -- 172.21.15.114:0/1500102223 learned_addr learned my addr 172.21.15.114:0/1500102223 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:30.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.473+0000 7f0828f32640 1 --1- 172.21.15.114:0/1500102223 >> v1:172.21.15.114:6789/0 conn(0x7f082415add0 0x7f08240cecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52462/0 (socket says 172.21.15.114:52462) 2023-11-04T01:37:30.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.473+0000 7f0829733640 1 --2- 172.21.15.114:0/1500102223 >> v2:172.21.15.141:3300/0 conn(0x7f0824071f90 0x7f08240b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.473+0000 7f0829f34640 1 -- 172.21.15.114:0/1500102223 >> v2:172.21.15.141:3300/0 conn(0x7f0824071f90 msgr2=0x7f08240b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:30.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.473+0000 7f0829f34640 1 --2- 172.21.15.114:0/1500102223 >> v2:172.21.15.141:3300/0 conn(0x7f0824071f90 0x7f08240b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.473+0000 7f0829f34640 1 -- 172.21.15.114:0/1500102223 >> v1:172.21.15.114:6789/0 conn(0x7f082415add0 legacy=0x7f08240cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.473+0000 7f0829f34640 1 -- 172.21.15.114:0/1500102223 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082415a2f0 con 0x7f0824072370 2023-11-04T01:37:30.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.473+0000 7f081bfff640 1 -- 172.21.15.114:0/1500102223 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207184494 0 0) 0x7f08240b1cc0 con 0x7f082415add0 2023-11-04T01:37:30.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.474+0000 7f0829f34640 1 --2- 172.21.15.114:0/1500102223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0824072370 0x7f08240cf3d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f08240cec90 tx=0x7f081c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf89414c9a4ff32 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:30.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.474+0000 7f081bfff640 1 -- 172.21.15.114:0/1500102223 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c02cb20 con 0x7f0824072370 2023-11-04T01:37:30.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.474+0000 7f081bfff640 1 -- 172.21.15.114:0/1500102223 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c02cc80 con 0x7f0824072370 2023-11-04T01:37:30.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.474+0000 7f081bfff640 1 -- 172.21.15.114:0/1500102223 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c0343f0 con 0x7f0824072370 2023-11-04T01:37:30.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.475+0000 7f082b997640 1 -- 172.21.15.114:0/1500102223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0824072370 msgr2=0x7f08240cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.475+0000 7f082b997640 1 --2- 172.21.15.114:0/1500102223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0824072370 0x7f08240cf3d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f08240cec90 tx=0x7f081c02bf80 comp rx=0 tx=0).stop 2023-11-04T01:37:30.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.475+0000 7f082b997640 1 -- 172.21.15.114:0/1500102223 shutdown_connections 2023-11-04T01:37:30.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.475+0000 7f082b997640 1 --2- 172.21.15.114:0/1500102223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0824072370 0x7f08240cf3d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.475+0000 7f082b997640 1 --2- 172.21.15.114:0/1500102223 >> v2:172.21.15.141:3300/0 conn(0x7f0824071f90 0x7f08240b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.475+0000 7f082b997640 1 -- 172.21.15.114:0/1500102223 >> 172.21.15.114:0/1500102223 conn(0x7f082406d800 msgr2=0x7f082406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:30.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.475+0000 7f082b997640 1 -- 172.21.15.114:0/1500102223 shutdown_connections 2023-11-04T01:37:30.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.475+0000 7f082b997640 1 -- 172.21.15.114:0/1500102223 wait complete. 2023-11-04T01:37:30.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.476+0000 7f082b997640 1 Processor -- start 2023-11-04T01:37:30.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.476+0000 7f082b997640 1 -- start start 2023-11-04T01:37:30.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f082b997640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0824071f90 0x7f08241f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f082b997640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0824072370 0x7f082406a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f082b997640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f082415add0 0x7f08241ef870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f082b997640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0824147db0 con 0x7f0824071f90 2023-11-04T01:37:30.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f082b997640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08241f48e0 con 0x7f0824072370 2023-11-04T01:37:30.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f082b997640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0824144670 con 0x7f082415add0 2023-11-04T01:37:30.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f0829733640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0824071f90 0x7f08241f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f0829733640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0824071f90 0x7f08241f43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45202/0 (socket says 172.21.15.114:45202) 2023-11-04T01:37:30.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f0829733640 1 -- 172.21.15.114:0/253466088 learned_addr learned my addr 172.21.15.114:0/253466088 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:30.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f0828f32640 1 --2- 172.21.15.114:0/253466088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0824072370 0x7f082406a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f0829f34640 1 --2- 172.21.15.114:0/253466088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f082415add0 0x7f08241ef870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f0829733640 1 -- 172.21.15.114:0/253466088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f082415add0 msgr2=0x7f08241ef870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f0829733640 1 --2- 172.21.15.114:0/253466088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f082415add0 0x7f08241ef870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f0829733640 1 -- 172.21.15.114:0/253466088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0824072370 msgr2=0x7f082406a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f0829733640 1 --2- 172.21.15.114:0/253466088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0824072370 0x7f082406a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f0829733640 1 -- 172.21.15.114:0/253466088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081c009b30 con 0x7f0824071f90 2023-11-04T01:37:30.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.477+0000 7f0829f34640 1 --2- 172.21.15.114:0/253466088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f082415add0 0x7f08241ef870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:30.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.478+0000 7f0829733640 1 --2- 172.21.15.114:0/253466088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0824071f90 0x7f08241f43a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f081400e9b0 tx=0x7f081400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:30.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.478+0000 7f0819ffb640 1 -- 172.21.15.114:0/253466088 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0814009670 con 0x7f0824071f90 2023-11-04T01:37:30.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.478+0000 7f0819ffb640 1 -- 172.21.15.114:0/253466088 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081400c9a0 con 0x7f0824071f90 2023-11-04T01:37:30.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.478+0000 7f082b997640 1 -- 172.21.15.114:0/253466088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0824143ac0 con 0x7f0824071f90 2023-11-04T01:37:30.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.478+0000 7f0819ffb640 1 -- 172.21.15.114:0/253466088 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081400cd50 con 0x7f0824071f90 2023-11-04T01:37:30.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.478+0000 7f082b997640 1 -- 172.21.15.114:0/253466088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0824144300 con 0x7f0824071f90 2023-11-04T01:37:30.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.479+0000 7f082b997640 1 -- 172.21.15.114:0/253466088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08240cea70 con 0x7f0824071f90 2023-11-04T01:37:30.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.479+0000 7f0819ffb640 1 -- 172.21.15.114:0/253466088 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0814013470 con 0x7f0824071f90 2023-11-04T01:37:30.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.480+0000 7f0819ffb640 1 --2- 172.21.15.114:0/253466088 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f080806ae70 0x7f080806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.480+0000 7f0828f32640 1 --2- 172.21.15.114:0/253466088 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f080806ae70 0x7f080806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.480+0000 7f0819ffb640 1 -- 172.21.15.114:0/253466088 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0814089cc0 con 0x7f0824071f90 2023-11-04T01:37:30.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.480+0000 7f0828f32640 1 --2- 172.21.15.114:0/253466088 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f080806ae70 0x7f080806d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f08240aeee0 tx=0x7f0820007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:30.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.484+0000 7f0819ffb640 1 -- 172.21.15.114:0/253466088 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0814090080 con 0x7f0824071f90 2023-11-04T01:37:30.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.670+0000 7f082b997640 1 -- 172.21.15.114:0/253466088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f08240718d0 con 0x7f0824071f90 2023-11-04T01:37:30.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.671+0000 7f0819ffb640 1 -- 172.21.15.114:0/253466088 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0814017080 con 0x7f0824071f90 2023-11-04T01:37:30.672 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-11-04T01:37:30.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.672+0000 7f082b997640 1 -- 172.21.15.114:0/253466088 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f080806ae70 msgr2=0x7f080806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.672+0000 7f082b997640 1 --2- 172.21.15.114:0/253466088 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f080806ae70 0x7f080806d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f08240aeee0 tx=0x7f0820007c00 comp rx=0 tx=0).stop 2023-11-04T01:37:30.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.672+0000 7f082b997640 1 -- 172.21.15.114:0/253466088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0824071f90 msgr2=0x7f08241f43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.672+0000 7f082b997640 1 --2- 172.21.15.114:0/253466088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0824071f90 0x7f08241f43a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f081400e9b0 tx=0x7f081400ee70 comp rx=0 tx=0).stop 2023-11-04T01:37:30.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.672+0000 7f082b997640 1 -- 172.21.15.114:0/253466088 shutdown_connections 2023-11-04T01:37:30.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.672+0000 7f082b997640 1 --2- 172.21.15.114:0/253466088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f082415add0 0x7f08241ef870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.672+0000 7f082b997640 1 --2- 172.21.15.114:0/253466088 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f080806ae70 0x7f080806d330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.672+0000 7f082b997640 1 --2- 172.21.15.114:0/253466088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0824072370 0x7f082406a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.672+0000 7f082b997640 1 --2- 172.21.15.114:0/253466088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0824071f90 0x7f08241f43a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.673+0000 7f082b997640 1 -- 172.21.15.114:0/253466088 >> 172.21.15.114:0/253466088 conn(0x7f082406d800 msgr2=0x7f08240cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:30.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.673+0000 7f082b997640 1 -- 172.21.15.114:0/253466088 shutdown_connections 2023-11-04T01:37:30.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.673+0000 7f082b997640 1 -- 172.21.15.114:0/253466088 wait complete. 2023-11-04T01:37:30.685 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:37:30.685 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:30.701 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:30.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.840+0000 7ff70beb4640 1 Processor -- start 2023-11-04T01:37:30.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.841+0000 7ff70beb4640 1 -- start start 2023-11-04T01:37:30.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.841+0000 7ff70beb4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff70415ad80 0x7ff70406c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.841+0000 7ff70beb4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70406cd00 con 0x7ff7040c9e10 2023-11-04T01:37:30.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.841+0000 7ff70beb4640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70406cfa0 con 0x7ff7040b42c0 2023-11-04T01:37:30.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.841+0000 7ff70beb4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70406d280 con 0x7ff70415ad80 2023-11-04T01:37:30.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.841+0000 7ff70a451640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff7040c9e10 0x7ff7040b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52466/0 (socket says 172.21.15.114:52466) 2023-11-04T01:37:30.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.841+0000 7ff70a451640 1 -- 172.21.15.114:0/581392965 learned_addr learned my addr 172.21.15.114:0/581392965 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:30.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff709c50640 1 --2- 172.21.15.114:0/581392965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff70415ad80 0x7ff70406c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff708c4e640 1 -- 172.21.15.114:0/581392965 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781572018 0 0) 0x7ff70406cd00 con 0x7ff7040c9e10 2023-11-04T01:37:30.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff708c4e640 1 -- 172.21.15.114:0/581392965 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6ec003520 con 0x7ff7040c9e10 2023-11-04T01:37:30.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff708c4e640 1 -- 172.21.15.114:0/581392965 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 489441023 0 0) 0x7ff6ec003520 con 0x7ff7040c9e10 2023-11-04T01:37:30.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff708c4e640 1 -- 172.21.15.114:0/581392965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff70415ad80 msgr2=0x7ff70406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:30.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff708c4e640 1 --2- 172.21.15.114:0/581392965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff70415ad80 0x7ff70406c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff708c4e640 1 -- 172.21.15.114:0/581392965 >> v1:172.21.15.141:6789/0 conn(0x7ff7040b42c0 legacy=0x7ff7040c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff708c4e640 1 -- 172.21.15.114:0/581392965 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70406d560 con 0x7ff7040c9e10 2023-11-04T01:37:30.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff708c4e640 1 -- 172.21.15.114:0/581392965 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7ff6f4001690 con 0x7ff7040c9e10 2023-11-04T01:37:30.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff708c4e640 1 -- 172.21.15.114:0/581392965 >> v1:172.21.15.114:6789/0 conn(0x7ff7040c9e10 legacy=0x7ff7040b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff708c4e640 1 --2- 172.21.15.114:0/581392965 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6ec0039a0 0x7ff6ec003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff708c4e640 1 --2- 172.21.15.114:0/581392965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6ec004350 0x7ff6ec004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff708c4e640 1 --2- 172.21.15.114:0/581392965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff70415ad80 0x7ff6ec005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff708c4e640 1 -- 172.21.15.114:0/581392965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70406d280 con 0x7ff6ec004350 2023-11-04T01:37:30.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff708c4e640 1 -- 172.21.15.114:0/581392965 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec00b980 con 0x7ff6ec0039a0 2023-11-04T01:37:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff708c4e640 1 -- 172.21.15.114:0/581392965 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec00bb40 con 0x7ff70415ad80 2023-11-04T01:37:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff70944f640 1 --2- 172.21.15.114:0/581392965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6ec004350 0x7ff6ec004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff709c50640 1 --2- 172.21.15.114:0/581392965 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6ec0039a0 0x7ff6ec003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff70a451640 1 --2- 172.21.15.114:0/581392965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff70415ad80 0x7ff6ec005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff70944f640 1 -- 172.21.15.114:0/581392965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff70415ad80 msgr2=0x7ff6ec005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff70944f640 1 --2- 172.21.15.114:0/581392965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff70415ad80 0x7ff6ec005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff70944f640 1 -- 172.21.15.114:0/581392965 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6ec0039a0 msgr2=0x7ff6ec003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff70944f640 1 --2- 172.21.15.114:0/581392965 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6ec0039a0 0x7ff6ec003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.842+0000 7ff70944f640 1 -- 172.21.15.114:0/581392965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec003520 con 0x7ff6ec004350 2023-11-04T01:37:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.843+0000 7ff70a451640 1 --2- 172.21.15.114:0/581392965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff70415ad80 0x7ff6ec005080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.843+0000 7ff70944f640 1 --2- 172.21.15.114:0/581392965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6ec004350 0x7ff6ec004820 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8001860 tx=0x7ff6ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd7c572aa6babd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.843+0000 7ff708c4e640 1 -- 172.21.15.114:0/581392965 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8033410 con 0x7ff6ec004350 2023-11-04T01:37:30.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.843+0000 7ff708c4e640 1 -- 172.21.15.114:0/581392965 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f8033590 con 0x7ff6ec004350 2023-11-04T01:37:30.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.843+0000 7ff708c4e640 1 -- 172.21.15.114:0/581392965 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8033940 con 0x7ff6ec004350 2023-11-04T01:37:30.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.844+0000 7ff70beb4640 1 -- 172.21.15.114:0/581392965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6ec004350 msgr2=0x7ff6ec004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.844+0000 7ff70beb4640 1 --2- 172.21.15.114:0/581392965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6ec004350 0x7ff6ec004820 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8001860 tx=0x7ff6ec0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.844+0000 7ff70a451640 1 -- 172.21.15.114:0/581392965 reap_dead start 2023-11-04T01:37:30.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.844+0000 7ff70beb4640 1 -- 172.21.15.114:0/581392965 shutdown_connections 2023-11-04T01:37:30.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.844+0000 7ff70beb4640 1 -- 172.21.15.114:0/581392965 >> 172.21.15.114:0/581392965 conn(0x7ff7040ce950 msgr2=0x7ff7040ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:30.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.844+0000 7ff70beb4640 1 -- 172.21.15.114:0/581392965 shutdown_connections 2023-11-04T01:37:30.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.844+0000 7ff70beb4640 1 -- 172.21.15.114:0/581392965 wait complete. 2023-11-04T01:37:30.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.845+0000 7ff70beb4640 1 Processor -- start 2023-11-04T01:37:30.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.845+0000 7ff70beb4640 1 -- start start 2023-11-04T01:37:30.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff70beb4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6ec004350 0x7ff7040acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff70beb4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7041494b0 0x7ff7040b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff70beb4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff704149930 0x7ff7040b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff70beb4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040ac230 con 0x7ff7041494b0 2023-11-04T01:37:30.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff70beb4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040ac510 con 0x7ff6ec004350 2023-11-04T01:37:30.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff70beb4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040ac7f0 con 0x7ff704149930 2023-11-04T01:37:30.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff70944f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7041494b0 0x7ff7040b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff70944f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7041494b0 0x7ff7040b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45232/0 (socket says 172.21.15.114:45232) 2023-11-04T01:37:30.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff70944f640 1 -- 172.21.15.114:0/133737057 learned_addr learned my addr 172.21.15.114:0/133737057 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:30.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff70a451640 1 --2- 172.21.15.114:0/133737057 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff704149930 0x7ff7040b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff709c50640 1 --2- 172.21.15.114:0/133737057 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6ec004350 0x7ff7040acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff70944f640 1 -- 172.21.15.114:0/133737057 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff704149930 msgr2=0x7ff7040b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff70944f640 1 --2- 172.21.15.114:0/133737057 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff704149930 0x7ff7040b0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff70944f640 1 -- 172.21.15.114:0/133737057 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6ec004350 msgr2=0x7ff7040acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:30.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff70944f640 1 --2- 172.21.15.114:0/133737057 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6ec004350 0x7ff7040acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:30.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff70944f640 1 -- 172.21.15.114:0/133737057 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7040acad0 con 0x7ff7041494b0 2023-11-04T01:37:30.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff709c50640 1 --2- 172.21.15.114:0/133737057 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6ec004350 0x7ff7040acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:30.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff70944f640 1 --2- 172.21.15.114:0/133737057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7041494b0 0x7ff7040b0900 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8001980 tx=0x7ff6f8001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:30.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.846+0000 7ff7027fc640 1 -- 172.21.15.114:0/133737057 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8033410 con 0x7ff7041494b0 2023-11-04T01:37:30.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.847+0000 7ff7027fc640 1 -- 172.21.15.114:0/133737057 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f8005070 con 0x7ff7041494b0 2023-11-04T01:37:30.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.847+0000 7ff70beb4640 1 -- 172.21.15.114:0/133737057 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7040ad530 con 0x7ff7041494b0 2023-11-04T01:37:30.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.847+0000 7ff7027fc640 1 -- 172.21.15.114:0/133737057 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8005440 con 0x7ff7041494b0 2023-11-04T01:37:30.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.847+0000 7ff70beb4640 1 -- 172.21.15.114:0/133737057 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70414c1f0 con 0x7ff7041494b0 2023-11-04T01:37:30.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.848+0000 7ff70beb4640 1 -- 172.21.15.114:0/133737057 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7040acc60 con 0x7ff7041494b0 2023-11-04T01:37:30.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.848+0000 7ff7027fc640 1 -- 172.21.15.114:0/133737057 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6f803a050 con 0x7ff7041494b0 2023-11-04T01:37:30.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.848+0000 7ff7027fc640 1 --2- 172.21.15.114:0/133737057 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff6f006ae70 0x7ff6f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:30.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.848+0000 7ff7027fc640 1 -- 172.21.15.114:0/133737057 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff6f80ab270 con 0x7ff7041494b0 2023-11-04T01:37:30.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.848+0000 7ff709c50640 1 --2- 172.21.15.114:0/133737057 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff6f006ae70 0x7ff6f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:30.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.849+0000 7ff709c50640 1 --2- 172.21.15.114:0/133737057 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff6f006ae70 0x7ff6f006d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc007440 tx=0x7ff6fc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:30.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:30.853+0000 7ff7027fc640 1 -- 172.21.15.114:0/133737057 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff6f8076130 con 0x7ff7041494b0 2023-11-04T01:37:31.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.021+0000 7ff70beb4640 1 -- 172.21.15.114:0/133737057 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff704074290 con 0x7ff7041494b0 2023-11-04T01:37:31.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.022+0000 7ff7027fc640 1 -- 172.21.15.114:0/133737057 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18796 (secure 0 0 0) 0x7ff6f8079750 con 0x7ff7041494b0 2023-11-04T01:37:31.051 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:31.051 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:11.562429+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:31.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.024+0000 7ff70beb4640 1 -- 172.21.15.114:0/133737057 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff6f006ae70 msgr2=0x7ff6f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.024+0000 7ff70beb4640 1 --2- 172.21.15.114:0/133737057 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff6f006ae70 0x7ff6f006d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc007440 tx=0x7ff6fc00b040 comp rx=0 tx=0).stop 2023-11-04T01:37:31.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.024+0000 7ff70beb4640 1 -- 172.21.15.114:0/133737057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7041494b0 msgr2=0x7ff7040b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.024+0000 7ff70beb4640 1 --2- 172.21.15.114:0/133737057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7041494b0 0x7ff7040b0900 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8001980 tx=0x7ff6f8001230 comp rx=0 tx=0).stop 2023-11-04T01:37:31.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.024+0000 7ff70beb4640 1 -- 172.21.15.114:0/133737057 shutdown_connections 2023-11-04T01:37:31.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.024+0000 7ff70beb4640 1 --2- 172.21.15.114:0/133737057 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff704149930 0x7ff7040b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.024+0000 7ff70beb4640 1 --2- 172.21.15.114:0/133737057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7041494b0 0x7ff7040b0900 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.024+0000 7ff70beb4640 1 --2- 172.21.15.114:0/133737057 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff6f006ae70 0x7ff6f006d330 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.024+0000 7ff70beb4640 1 --2- 172.21.15.114:0/133737057 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6ec004350 0x7ff7040acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.025+0000 7ff70beb4640 1 -- 172.21.15.114:0/133737057 >> 172.21.15.114:0/133737057 conn(0x7ff7040ce950 msgr2=0x7ff7040aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.025+0000 7ff70beb4640 1 -- 172.21.15.114:0/133737057 shutdown_connections 2023-11-04T01:37:31.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.025+0000 7ff70beb4640 1 -- 172.21.15.114:0/133737057 wait complete. 2023-11-04T01:37:31.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:31.054 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:31.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.155+0000 7fcf558b4640 1 Processor -- start 2023-11-04T01:37:31.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.155+0000 7fcf558b4640 1 -- start start 2023-11-04T01:37:31.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.156+0000 7fcf558b4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcf50153e60 0x7fcf5015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.156+0000 7fcf558b4640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fcf500b4880 0x7fcf500b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.156+0000 7fcf558b4640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf500cde60 con 0x7fcf500cd6d0 2023-11-04T01:37:31.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.156+0000 7fcf558b4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf50160f90 con 0x7fcf50153e60 2023-11-04T01:37:31.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.156+0000 7fcf558b4640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf500b5200 con 0x7fcf500b4880 2023-11-04T01:37:31.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.156+0000 7fcf4effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcf50153e60 0x7fcf5015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.156+0000 7fcf4effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcf50153e60 0x7fcf5015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45242/0 (socket says 172.21.15.114:45242) 2023-11-04T01:37:31.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.156+0000 7fcf4effd640 1 -- 172.21.15.114:0/1520092177 learned_addr learned my addr 172.21.15.114:0/1520092177 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:31.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.156+0000 7fcf4f7fe640 1 --2- 172.21.15.114:0/1520092177 >> v2:172.21.15.141:3300/0 conn(0x7fcf500b4880 0x7fcf500b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.156+0000 7fcf4effd640 1 -- 172.21.15.114:0/1520092177 >> v2:172.21.15.141:3300/0 conn(0x7fcf500b4880 msgr2=0x7fcf500b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.156+0000 7fcf4effd640 1 --2- 172.21.15.114:0/1520092177 >> v2:172.21.15.141:3300/0 conn(0x7fcf500b4880 0x7fcf500b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.156+0000 7fcf4effd640 1 -- 172.21.15.114:0/1520092177 >> v1:172.21.15.141:6789/0 conn(0x7fcf500cd6d0 legacy=0x7fcf50161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.156+0000 7fcf4effd640 1 -- 172.21.15.114:0/1520092177 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5015e400 con 0x7fcf50153e60 2023-11-04T01:37:31.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.157+0000 7fcf4effd640 1 --2- 172.21.15.114:0/1520092177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf50153e60 0x7fcf5015dec0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcf500b8f40 tx=0x7fcf4002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee780e3e5e04f42 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.157+0000 7fcf4e7fc640 1 -- 172.21.15.114:0/1520092177 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40031870 con 0x7fcf50153e60 2023-11-04T01:37:31.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.157+0000 7fcf4e7fc640 1 -- 172.21.15.114:0/1520092177 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf400319d0 con 0x7fcf50153e60 2023-11-04T01:37:31.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.157+0000 7fcf4e7fc640 1 -- 172.21.15.114:0/1520092177 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40031d60 con 0x7fcf50153e60 2023-11-04T01:37:31.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.158+0000 7fcf558b4640 1 -- 172.21.15.114:0/1520092177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf50153e60 msgr2=0x7fcf5015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.158+0000 7fcf558b4640 1 --2- 172.21.15.114:0/1520092177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf50153e60 0x7fcf5015dec0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcf500b8f40 tx=0x7fcf4002b910 comp rx=0 tx=0).stop 2023-11-04T01:37:31.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.158+0000 7fcf558b4640 1 -- 172.21.15.114:0/1520092177 shutdown_connections 2023-11-04T01:37:31.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.158+0000 7fcf558b4640 1 --2- 172.21.15.114:0/1520092177 >> v2:172.21.15.141:3300/0 conn(0x7fcf500b4880 0x7fcf500b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.158+0000 7fcf558b4640 1 --2- 172.21.15.114:0/1520092177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf50153e60 0x7fcf5015dec0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.158+0000 7fcf558b4640 1 -- 172.21.15.114:0/1520092177 >> 172.21.15.114:0/1520092177 conn(0x7fcf500cf880 msgr2=0x7fcf500cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.158+0000 7fcf558b4640 1 -- 172.21.15.114:0/1520092177 shutdown_connections 2023-11-04T01:37:31.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.158+0000 7fcf558b4640 1 -- 172.21.15.114:0/1520092177 wait complete. 2023-11-04T01:37:31.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.159+0000 7fcf558b4640 1 Processor -- start 2023-11-04T01:37:31.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.159+0000 7fcf558b4640 1 -- start start 2023-11-04T01:37:31.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf558b4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf500b4880 0x7fcf500cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf558b4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf500cd6d0 0x7fcf50157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf558b4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf50153e60 0x7fcf501f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf558b4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500cc6e0 con 0x7fcf500b4880 2023-11-04T01:37:31.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf558b4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5014f320 con 0x7fcf50153e60 2023-11-04T01:37:31.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf558b4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf501f2dd0 con 0x7fcf500cd6d0 2023-11-04T01:37:31.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf4effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf500b4880 0x7fcf500cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf4effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf500b4880 0x7fcf500cb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45246/0 (socket says 172.21.15.114:45246) 2023-11-04T01:37:31.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf4effd640 1 -- 172.21.15.114:0/2937299323 learned_addr learned my addr 172.21.15.114:0/2937299323 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:31.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf47fff640 1 --2- 172.21.15.114:0/2937299323 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf500cd6d0 0x7fcf50157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf4f7fe640 1 --2- 172.21.15.114:0/2937299323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf50153e60 0x7fcf501f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf4effd640 1 -- 172.21.15.114:0/2937299323 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf500cd6d0 msgr2=0x7fcf50157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf4effd640 1 --2- 172.21.15.114:0/2937299323 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf500cd6d0 0x7fcf50157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf4effd640 1 -- 172.21.15.114:0/2937299323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf50153e60 msgr2=0x7fcf501f2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf4effd640 1 --2- 172.21.15.114:0/2937299323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf50153e60 0x7fcf501f2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf4effd640 1 -- 172.21.15.114:0/2937299323 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf400094d0 con 0x7fcf500b4880 2023-11-04T01:37:31.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf4f7fe640 1 --2- 172.21.15.114:0/2937299323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf50153e60 0x7fcf501f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:31.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf4effd640 1 --2- 172.21.15.114:0/2937299323 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf500b4880 0x7fcf500cb930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcf40000c00 tx=0x7fcf400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf4cff9640 1 -- 172.21.15.114:0/2937299323 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4003abe0 con 0x7fcf500b4880 2023-11-04T01:37:31.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf4cff9640 1 -- 172.21.15.114:0/2937299323 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4003ad40 con 0x7fcf500b4880 2023-11-04T01:37:31.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf558b4640 1 -- 172.21.15.114:0/2937299323 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf501f30b0 con 0x7fcf500b4880 2023-11-04T01:37:31.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf4cff9640 1 -- 172.21.15.114:0/2937299323 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40044610 con 0x7fcf500b4880 2023-11-04T01:37:31.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.160+0000 7fcf558b4640 1 -- 172.21.15.114:0/2937299323 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf501f3670 con 0x7fcf500b4880 2023-11-04T01:37:31.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.161+0000 7fcf558b4640 1 -- 172.21.15.114:0/2937299323 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf50074290 con 0x7fcf500b4880 2023-11-04T01:37:31.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.162+0000 7fcf4cff9640 1 -- 172.21.15.114:0/2937299323 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcf40044770 con 0x7fcf500b4880 2023-11-04T01:37:31.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.162+0000 7fcf4cff9640 1 --2- 172.21.15.114:0/2937299323 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcf3006ae70 0x7fcf3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.162+0000 7fcf4cff9640 1 -- 172.21.15.114:0/2937299323 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcf4002d040 con 0x7fcf500b4880 2023-11-04T01:37:31.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.162+0000 7fcf47fff640 1 --2- 172.21.15.114:0/2937299323 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcf3006ae70 0x7fcf3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.163+0000 7fcf47fff640 1 --2- 172.21.15.114:0/2937299323 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcf3006ae70 0x7fcf3006d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcf500c93b0 tx=0x7fcf38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.166+0000 7fcf4cff9640 1 -- 172.21.15.114:0/2937299323 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf40076cc0 con 0x7fcf500b4880 2023-11-04T01:37:31.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.330+0000 7fcf558b4640 1 -- 172.21.15.114:0/2937299323 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf500d0b80 con 0x7fcf500b4880 2023-11-04T01:37:31.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.331+0000 7fcf4cff9640 1 -- 172.21.15.114:0/2937299323 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf40035020 con 0x7fcf500b4880 2023-11-04T01:37:31.333 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:37:31.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.333+0000 7fcf558b4640 1 -- 172.21.15.114:0/2937299323 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcf3006ae70 msgr2=0x7fcf3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.333+0000 7fcf558b4640 1 --2- 172.21.15.114:0/2937299323 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcf3006ae70 0x7fcf3006d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcf500c93b0 tx=0x7fcf38009040 comp rx=0 tx=0).stop 2023-11-04T01:37:31.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.333+0000 7fcf558b4640 1 -- 172.21.15.114:0/2937299323 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf500b4880 msgr2=0x7fcf500cb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.333+0000 7fcf558b4640 1 --2- 172.21.15.114:0/2937299323 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf500b4880 0x7fcf500cb930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcf40000c00 tx=0x7fcf400046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.333+0000 7fcf558b4640 1 -- 172.21.15.114:0/2937299323 shutdown_connections 2023-11-04T01:37:31.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.333+0000 7fcf558b4640 1 --2- 172.21.15.114:0/2937299323 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcf3006ae70 0x7fcf3006d330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.333+0000 7fcf558b4640 1 --2- 172.21.15.114:0/2937299323 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcf50153e60 0x7fcf501f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.333+0000 7fcf558b4640 1 --2- 172.21.15.114:0/2937299323 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcf500cd6d0 0x7fcf50157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.333+0000 7fcf558b4640 1 --2- 172.21.15.114:0/2937299323 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf500b4880 0x7fcf500cb930 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.333+0000 7fcf558b4640 1 -- 172.21.15.114:0/2937299323 >> 172.21.15.114:0/2937299323 conn(0x7fcf500cf880 msgr2=0x7fcf500d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.333+0000 7fcf558b4640 1 -- 172.21.15.114:0/2937299323 shutdown_connections 2023-11-04T01:37:31.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.333+0000 7fcf558b4640 1 -- 172.21.15.114:0/2937299323 wait complete. 2023-11-04T01:37:31.345 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:31.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.446+0000 7f34cbd39640 1 Processor -- start 2023-11-04T01:37:31.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.446+0000 7f34cbd39640 1 -- start start 2023-11-04T01:37:31.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34cbd39640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f34c4071f90 0x7f34c40b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34cbd39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34c415add0 0x7f34c40cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34cbd39640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34c4072370 0x7f34c40cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34cbd39640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c40b1fa0 con 0x7f34c4072370 2023-11-04T01:37:31.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34cbd39640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c415a0e0 con 0x7f34c4071f90 2023-11-04T01:37:31.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34cbd39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c40b1cc0 con 0x7f34c415add0 2023-11-04T01:37:31.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34ca2d6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34c4072370 0x7f34c40cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34ca2d6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34c4072370 0x7f34c40cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45250/0 (socket says 172.21.15.114:45250) 2023-11-04T01:37:31.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34ca2d6640 1 -- 172.21.15.114:0/4133599041 learned_addr learned my addr 172.21.15.114:0/4133599041 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:31.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34c9ad5640 1 --2- 172.21.15.114:0/4133599041 >> v2:172.21.15.141:3300/0 conn(0x7f34c4071f90 0x7f34c40b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34c92d4640 1 --2- 172.21.15.114:0/4133599041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34c415add0 0x7f34c40cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34ca2d6640 1 -- 172.21.15.114:0/4133599041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34c415add0 msgr2=0x7f34c40cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34ca2d6640 1 --2- 172.21.15.114:0/4133599041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34c415add0 0x7f34c40cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34ca2d6640 1 -- 172.21.15.114:0/4133599041 >> v2:172.21.15.141:3300/0 conn(0x7f34c4071f90 msgr2=0x7f34c40b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:31.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34ca2d6640 1 --2- 172.21.15.114:0/4133599041 >> v2:172.21.15.141:3300/0 conn(0x7f34c4071f90 0x7f34c40b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34ca2d6640 1 -- 172.21.15.114:0/4133599041 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c415a2f0 con 0x7f34c4072370 2023-11-04T01:37:31.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.447+0000 7f34c9ad5640 1 --2- 172.21.15.114:0/4133599041 >> v2:172.21.15.141:3300/0 conn(0x7f34c4071f90 0x7f34c40b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:31.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.448+0000 7f34ca2d6640 1 --2- 172.21.15.114:0/4133599041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c4072370 0x7f34c40cf200 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f34c40cec90 tx=0x7f34bc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3680c77da74fdfa1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.448+0000 7f34c8ad3640 1 -- 172.21.15.114:0/4133599041 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc02ca70 con 0x7f34c4072370 2023-11-04T01:37:31.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.448+0000 7f34c8ad3640 1 -- 172.21.15.114:0/4133599041 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34bc02cbd0 con 0x7f34c4072370 2023-11-04T01:37:31.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.448+0000 7f34c8ad3640 1 -- 172.21.15.114:0/4133599041 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc0343f0 con 0x7f34c4072370 2023-11-04T01:37:31.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.448+0000 7f34cbd39640 1 -- 172.21.15.114:0/4133599041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c4072370 msgr2=0x7f34c40cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.448+0000 7f34cbd39640 1 --2- 172.21.15.114:0/4133599041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c4072370 0x7f34c40cf200 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f34c40cec90 tx=0x7f34bc02bed0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.449+0000 7f34cbd39640 1 -- 172.21.15.114:0/4133599041 shutdown_connections 2023-11-04T01:37:31.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.449+0000 7f34cbd39640 1 --2- 172.21.15.114:0/4133599041 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34c415add0 0x7f34c40cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.449+0000 7f34cbd39640 1 --2- 172.21.15.114:0/4133599041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c4072370 0x7f34c40cf200 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.449+0000 7f34cbd39640 1 --2- 172.21.15.114:0/4133599041 >> v2:172.21.15.141:3300/0 conn(0x7f34c4071f90 0x7f34c40b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.449+0000 7f34cbd39640 1 -- 172.21.15.114:0/4133599041 >> 172.21.15.114:0/4133599041 conn(0x7f34c406d800 msgr2=0x7f34c406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.449+0000 7f34cbd39640 1 -- 172.21.15.114:0/4133599041 shutdown_connections 2023-11-04T01:37:31.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.449+0000 7f34cbd39640 1 -- 172.21.15.114:0/4133599041 wait complete. 2023-11-04T01:37:31.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.450+0000 7f34cbd39640 1 Processor -- start 2023-11-04T01:37:31.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.450+0000 7f34cbd39640 1 -- start start 2023-11-04T01:37:31.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.450+0000 7f34cbd39640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34c4071f90 0x7f34c4149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.450+0000 7f34cbd39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34c4072370 0x7f34c40a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.450+0000 7f34cbd39640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c415add0 0x7f34c414a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.450+0000 7f34cbd39640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c40c83c0 con 0x7f34c415add0 2023-11-04T01:37:31.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.450+0000 7f34cbd39640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c40c77b0 con 0x7f34c4071f90 2023-11-04T01:37:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.450+0000 7f34cbd39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c40c7a90 con 0x7f34c4072370 2023-11-04T01:37:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34ca2d6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c415add0 0x7f34c414a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34ca2d6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c415add0 0x7f34c414a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45262/0 (socket says 172.21.15.114:45262) 2023-11-04T01:37:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34ca2d6640 1 -- 172.21.15.114:0/1907452574 learned_addr learned my addr 172.21.15.114:0/1907452574 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34c9ad5640 1 --2- 172.21.15.114:0/1907452574 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34c4071f90 0x7f34c4149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34c92d4640 1 --2- 172.21.15.114:0/1907452574 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34c4072370 0x7f34c40a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34ca2d6640 1 -- 172.21.15.114:0/1907452574 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34c4072370 msgr2=0x7f34c40a74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34ca2d6640 1 --2- 172.21.15.114:0/1907452574 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34c4072370 0x7f34c40a74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34ca2d6640 1 -- 172.21.15.114:0/1907452574 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34c4071f90 msgr2=0x7f34c4149e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34ca2d6640 1 --2- 172.21.15.114:0/1907452574 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34c4071f90 0x7f34c4149e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34ca2d6640 1 -- 172.21.15.114:0/1907452574 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc009b30 con 0x7f34c415add0 2023-11-04T01:37:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34c9ad5640 1 --2- 172.21.15.114:0/1907452574 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34c4071f90 0x7f34c4149e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34ca2d6640 1 --2- 172.21.15.114:0/1907452574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c415add0 0x7f34c414a930 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f34bc036040 tx=0x7f34bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34ba7fc640 1 -- 172.21.15.114:0/1907452574 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc009510 con 0x7f34c415add0 2023-11-04T01:37:31.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34ba7fc640 1 -- 172.21.15.114:0/1907452574 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34bc03e450 con 0x7f34c415add0 2023-11-04T01:37:31.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34cbd39640 1 -- 172.21.15.114:0/1907452574 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c40c7d70 con 0x7f34c415add0 2023-11-04T01:37:31.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34ba7fc640 1 -- 172.21.15.114:0/1907452574 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc03e800 con 0x7f34c415add0 2023-11-04T01:37:31.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.451+0000 7f34cbd39640 1 -- 172.21.15.114:0/1907452574 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c414a390 con 0x7f34c415add0 2023-11-04T01:37:31.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.452+0000 7f34cbd39640 1 -- 172.21.15.114:0/1907452574 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c40c8570 con 0x7f34c415add0 2023-11-04T01:37:31.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.453+0000 7f34ba7fc640 1 -- 172.21.15.114:0/1907452574 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34bc03e960 con 0x7f34c415add0 2023-11-04T01:37:31.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.453+0000 7f34ba7fc640 1 --2- 172.21.15.114:0/1907452574 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f34a806ae70 0x7f34a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.453+0000 7f34c9ad5640 1 --2- 172.21.15.114:0/1907452574 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f34a806ae70 0x7f34a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.453+0000 7f34ba7fc640 1 -- 172.21.15.114:0/1907452574 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f34bc0ac780 con 0x7f34c415add0 2023-11-04T01:37:31.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.454+0000 7f34c9ad5640 1 --2- 172.21.15.114:0/1907452574 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f34a806ae70 0x7f34a806d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f34c0006fd0 tx=0x7f34c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.457+0000 7f34ba7fc640 1 -- 172.21.15.114:0/1907452574 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f34c40c8570 con 0x7f34c415add0 2023-11-04T01:37:31.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.623+0000 7f34cbd39640 1 -- 172.21.15.114:0/1907452574 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34c40ca810 con 0x7f34c415add0 2023-11-04T01:37:31.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.624+0000 7f34ba7fc640 1 -- 172.21.15.114:0/1907452574 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f34bc077470 con 0x7f34c415add0 2023-11-04T01:37:31.626 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:31.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.626+0000 7f34cbd39640 1 -- 172.21.15.114:0/1907452574 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f34a806ae70 msgr2=0x7f34a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.626+0000 7f34cbd39640 1 --2- 172.21.15.114:0/1907452574 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f34a806ae70 0x7f34a806d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f34c0006fd0 tx=0x7f34c0008040 comp rx=0 tx=0).stop 2023-11-04T01:37:31.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.626+0000 7f34cbd39640 1 -- 172.21.15.114:0/1907452574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c415add0 msgr2=0x7f34c414a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.626+0000 7f34cbd39640 1 --2- 172.21.15.114:0/1907452574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c415add0 0x7f34c414a930 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f34bc036040 tx=0x7f34bc004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:31.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.626+0000 7f34cbd39640 1 -- 172.21.15.114:0/1907452574 shutdown_connections 2023-11-04T01:37:31.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.626+0000 7f34cbd39640 1 --2- 172.21.15.114:0/1907452574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34c415add0 0x7f34c414a930 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.626+0000 7f34cbd39640 1 --2- 172.21.15.114:0/1907452574 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34c4072370 0x7f34c40a74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.626+0000 7f34cbd39640 1 --2- 172.21.15.114:0/1907452574 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f34a806ae70 0x7f34a806d330 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.626+0000 7f34cbd39640 1 --2- 172.21.15.114:0/1907452574 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34c4071f90 0x7f34c4149e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.626+0000 7f34cbd39640 1 -- 172.21.15.114:0/1907452574 >> 172.21.15.114:0/1907452574 conn(0x7f34c406d800 msgr2=0x7f34c40cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.626+0000 7f34cbd39640 1 -- 172.21.15.114:0/1907452574 shutdown_connections 2023-11-04T01:37:31.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.626+0000 7f34cbd39640 1 -- 172.21.15.114:0/1907452574 wait complete. 2023-11-04T01:37:31.639 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:31.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.738+0000 7fc6ab064640 1 Processor -- start 2023-11-04T01:37:31.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.739+0000 7fc6ab064640 1 -- start start 2023-11-04T01:37:31.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.739+0000 7fc6ab064640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc6a40b4880 0x7fc6a40b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.739+0000 7fc6ab064640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a40cde60 con 0x7fc6a4153e60 2023-11-04T01:37:31.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.739+0000 7fc6ab064640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a4160f90 con 0x7fc6a40cd6d0 2023-11-04T01:37:31.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.739+0000 7fc6ab064640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a40b5200 con 0x7fc6a40b4880 2023-11-04T01:37:31.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.739+0000 7fc6a8e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc6a4153e60 0x7fc6a415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52470/0 (socket says 172.21.15.114:52470) 2023-11-04T01:37:31.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.739+0000 7fc6a8e00640 1 -- 172.21.15.114:0/3865136379 learned_addr learned my addr 172.21.15.114:0/3865136379 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:31.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.740+0000 7fc6a9601640 1 --2- 172.21.15.114:0/3865136379 >> v2:172.21.15.141:3300/0 conn(0x7fc6a40b4880 0x7fc6a40b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.740+0000 7fc6a37fe640 1 -- 172.21.15.114:0/3865136379 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045809858 0 0) 0x7fc6a40cde60 con 0x7fc6a4153e60 2023-11-04T01:37:31.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.740+0000 7fc6a37fe640 1 -- 172.21.15.114:0/3865136379 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc68c003520 con 0x7fc6a4153e60 2023-11-04T01:37:31.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.740+0000 7fc6a37fe640 1 -- 172.21.15.114:0/3865136379 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223846025 0 0) 0x7fc6a4160f90 con 0x7fc6a40cd6d0 2023-11-04T01:37:31.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.740+0000 7fc6a37fe640 1 -- 172.21.15.114:0/3865136379 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a40cde60 con 0x7fc6a40cd6d0 2023-11-04T01:37:31.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.740+0000 7fc6a9601640 1 -- 172.21.15.114:0/3865136379 >> v1:172.21.15.141:6789/0 conn(0x7fc6a40cd6d0 legacy=0x7fc6a4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.740+0000 7fc6a9601640 1 -- 172.21.15.114:0/3865136379 >> v1:172.21.15.114:6789/0 conn(0x7fc6a4153e60 legacy=0x7fc6a415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.740+0000 7fc6a37fe640 1 -- 172.21.15.114:0/3865136379 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3095715529 0 0) 0x7fc68c003520 con 0x7fc6a4153e60 2023-11-04T01:37:31.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.740+0000 7fc6a9601640 1 -- 172.21.15.114:0/3865136379 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40ce090 con 0x7fc6a40b4880 2023-11-04T01:37:31.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.741+0000 7fc6a9601640 1 --2- 172.21.15.114:0/3865136379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40b4880 0x7fc6a40b4cc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0097a0 tx=0x7fc69c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c133afaccbd96407 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.741+0000 7fc6a37fe640 1 -- 172.21.15.114:0/3865136379 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c02f050 con 0x7fc6a40b4880 2023-11-04T01:37:31.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.741+0000 7fc6a37fe640 1 -- 172.21.15.114:0/3865136379 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c031500 con 0x7fc6a40b4880 2023-11-04T01:37:31.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.741+0000 7fc6a37fe640 1 -- 172.21.15.114:0/3865136379 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6940019f0 con 0x7fc6a40b4880 2023-11-04T01:37:31.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.742+0000 7fc6ab064640 1 -- 172.21.15.114:0/3865136379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40b4880 msgr2=0x7fc6a40b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.742+0000 7fc6ab064640 1 --2- 172.21.15.114:0/3865136379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40b4880 0x7fc6a40b4cc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0097a0 tx=0x7fc69c02b820 comp rx=0 tx=0).stop 2023-11-04T01:37:31.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.742+0000 7fc6ab064640 1 -- 172.21.15.114:0/3865136379 shutdown_connections 2023-11-04T01:37:31.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.742+0000 7fc6ab064640 1 --2- 172.21.15.114:0/3865136379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40b4880 0x7fc6a40b4cc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.742+0000 7fc6ab064640 1 -- 172.21.15.114:0/3865136379 >> 172.21.15.114:0/3865136379 conn(0x7fc6a40cf880 msgr2=0x7fc6a40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.742+0000 7fc6ab064640 1 -- 172.21.15.114:0/3865136379 shutdown_connections 2023-11-04T01:37:31.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.742+0000 7fc6ab064640 1 -- 172.21.15.114:0/3865136379 wait complete. 2023-11-04T01:37:31.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.743+0000 7fc6ab064640 1 Processor -- start 2023-11-04T01:37:31.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.743+0000 7fc6ab064640 1 -- start start 2023-11-04T01:37:31.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6ab064640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a40b4880 0x7fc6a41570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6ab064640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40cd6d0 0x7fc6a40c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6ab064640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a4153e60 0x7fc6a40c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6ab064640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a4156cb0 con 0x7fc6a4153e60 2023-11-04T01:37:31.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6ab064640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a4156030 con 0x7fc6a40cd6d0 2023-11-04T01:37:31.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6ab064640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a4156310 con 0x7fc6a40b4880 2023-11-04T01:37:31.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6a9601640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a4153e60 0x7fc6a40c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6a9601640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a4153e60 0x7fc6a40c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45270/0 (socket says 172.21.15.114:45270) 2023-11-04T01:37:31.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6a9601640 1 -- 172.21.15.114:0/2012614121 learned_addr learned my addr 172.21.15.114:0/2012614121 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:31.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6a9601640 1 -- 172.21.15.114:0/2012614121 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a40b4880 msgr2=0x7fc6a41570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6a9601640 1 --2- 172.21.15.114:0/2012614121 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a40b4880 0x7fc6a41570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6a9601640 1 -- 172.21.15.114:0/2012614121 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40cd6d0 msgr2=0x7fc6a40c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6a9601640 1 --2- 172.21.15.114:0/2012614121 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40cd6d0 0x7fc6a40c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6a9601640 1 -- 172.21.15.114:0/2012614121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c009400 con 0x7fc6a4153e60 2023-11-04T01:37:31.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6a9601640 1 --2- 172.21.15.114:0/2012614121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a4153e60 0x7fc6a40c8d50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc69c02b860 tx=0x7fc69c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6a17fa640 1 -- 172.21.15.114:0/2012614121 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c003ea0 con 0x7fc6a4153e60 2023-11-04T01:37:31.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6a17fa640 1 -- 172.21.15.114:0/2012614121 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c0044c0 con 0x7fc6a4153e60 2023-11-04T01:37:31.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6ab064640 1 -- 172.21.15.114:0/2012614121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a41565f0 con 0x7fc6a4153e60 2023-11-04T01:37:31.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6a17fa640 1 -- 172.21.15.114:0/2012614121 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c0318b0 con 0x7fc6a4153e60 2023-11-04T01:37:31.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.744+0000 7fc6ab064640 1 -- 172.21.15.114:0/2012614121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a40c80e0 con 0x7fc6a4153e60 2023-11-04T01:37:31.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.746+0000 7fc6ab064640 1 -- 172.21.15.114:0/2012614121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a40d0700 con 0x7fc6a4153e60 2023-11-04T01:37:31.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.746+0000 7fc6a17fa640 1 -- 172.21.15.114:0/2012614121 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc69c031a10 con 0x7fc6a4153e60 2023-11-04T01:37:31.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.746+0000 7fc6a17fa640 1 --2- 172.21.15.114:0/2012614121 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc69006ae70 0x7fc69006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:31.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.746+0000 7fc6a17fa640 1 -- 172.21.15.114:0/2012614121 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc69c0ab600 con 0x7fc6a4153e60 2023-11-04T01:37:31.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.746+0000 7fc6a8e00640 1 --2- 172.21.15.114:0/2012614121 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc69006ae70 0x7fc69006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:31.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.747+0000 7fc6a8e00640 1 --2- 172.21.15.114:0/2012614121 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc69006ae70 0x7fc69006d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc694005c00 tx=0x7fc6940015b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:31.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.750+0000 7fc6a17fa640 1 -- 172.21.15.114:0/2012614121 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc69c0764a0 con 0x7fc6a4153e60 2023-11-04T01:37:31.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.917+0000 7fc6ab064640 1 -- 172.21.15.114:0/2012614121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6a4156df0 con 0x7fc6a4153e60 2023-11-04T01:37:31.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.918+0000 7fc6a17fa640 1 -- 172.21.15.114:0/2012614121 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc69c0420a0 con 0x7fc6a4153e60 2023-11-04T01:37:31.919 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:37:31.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.919+0000 7fc6ab064640 1 -- 172.21.15.114:0/2012614121 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc69006ae70 msgr2=0x7fc69006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.919+0000 7fc6ab064640 1 --2- 172.21.15.114:0/2012614121 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc69006ae70 0x7fc69006d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc694005c00 tx=0x7fc6940015b0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.919+0000 7fc6ab064640 1 -- 172.21.15.114:0/2012614121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a4153e60 msgr2=0x7fc6a40c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:31.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.919+0000 7fc6ab064640 1 --2- 172.21.15.114:0/2012614121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a4153e60 0x7fc6a40c8d50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc69c02b860 tx=0x7fc69c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.919+0000 7fc6ab064640 1 -- 172.21.15.114:0/2012614121 shutdown_connections 2023-11-04T01:37:31.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.919+0000 7fc6ab064640 1 --2- 172.21.15.114:0/2012614121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a4153e60 0x7fc6a40c8d50 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.919+0000 7fc6ab064640 1 --2- 172.21.15.114:0/2012614121 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc69006ae70 0x7fc69006d330 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.919+0000 7fc6ab064640 1 --2- 172.21.15.114:0/2012614121 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40cd6d0 0x7fc6a40c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.919+0000 7fc6ab064640 1 --2- 172.21.15.114:0/2012614121 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a40b4880 0x7fc6a41570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:31.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.919+0000 7fc6ab064640 1 -- 172.21.15.114:0/2012614121 >> 172.21.15.114:0/2012614121 conn(0x7fc6a40cf880 msgr2=0x7fc6a415fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:31.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.919+0000 7fc6ab064640 1 -- 172.21.15.114:0/2012614121 shutdown_connections 2023-11-04T01:37:31.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:31.919+0000 7fc6ab064640 1 -- 172.21.15.114:0/2012614121 wait complete. 2023-11-04T01:37:31.932 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:32.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.033+0000 7f60108fc640 1 Processor -- start 2023-11-04T01:37:32.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.033+0000 7f60108fc640 1 -- start start 2023-11-04T01:37:32.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.033+0000 7f60108fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f600c066000 0x7f600c0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.034+0000 7f60108fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600c0c9bf0 con 0x7f600c070ff0 2023-11-04T01:37:32.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.034+0000 7f60108fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600c0cd890 con 0x7f600c15d1b0 2023-11-04T01:37:32.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.034+0000 7f60108fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600c0cdb30 con 0x7f600c066000 2023-11-04T01:37:32.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.034+0000 7f600a59c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f600c070ff0 0x7f600c0713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52476/0 (socket says 172.21.15.114:52476) 2023-11-04T01:37:32.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.034+0000 7f600a59c640 1 -- 172.21.15.114:0/3219710112 learned_addr learned my addr 172.21.15.114:0/3219710112 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:32.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.034+0000 7f600ad9d640 1 --2- 172.21.15.114:0/3219710112 >> v2:172.21.15.114:3300/0 conn(0x7f600c066000 0x7f600c0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.034+0000 7f600ad9d640 1 -- 172.21.15.114:0/3219710112 >> v1:172.21.15.141:6789/0 conn(0x7f600c15d1b0 legacy=0x7f600c06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:32.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.034+0000 7f600ad9d640 1 -- 172.21.15.114:0/3219710112 >> v1:172.21.15.114:6789/0 conn(0x7f600c070ff0 legacy=0x7f600c0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.034+0000 7f600ad9d640 1 -- 172.21.15.114:0/3219710112 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c0cde10 con 0x7f600c066000 2023-11-04T01:37:32.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.034+0000 7f6009d9b640 1 -- 172.21.15.114:0/3219710112 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690361533 0 0) 0x7f600c0c9bf0 con 0x7f600c070ff0 2023-11-04T01:37:32.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.035+0000 7f600ad9d640 1 --2- 172.21.15.114:0/3219710112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c066000 0x7f600c0cb4e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6004009d90 tx=0x7f600402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87da2bb8697263ba server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:32.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.035+0000 7f6009d9b640 1 -- 172.21.15.114:0/3219710112 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600402cc60 con 0x7f600c066000 2023-11-04T01:37:32.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.035+0000 7f6009d9b640 1 -- 172.21.15.114:0/3219710112 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600402cdc0 con 0x7f600c066000 2023-11-04T01:37:32.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.035+0000 7f6009d9b640 1 -- 172.21.15.114:0/3219710112 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004034660 con 0x7f600c066000 2023-11-04T01:37:32.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.035+0000 7f60108fc640 1 -- 172.21.15.114:0/3219710112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c066000 msgr2=0x7f600c0cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.035+0000 7f60108fc640 1 --2- 172.21.15.114:0/3219710112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c066000 0x7f600c0cb4e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6004009d90 tx=0x7f600402beb0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.035+0000 7f60108fc640 1 -- 172.21.15.114:0/3219710112 shutdown_connections 2023-11-04T01:37:32.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.035+0000 7f60108fc640 1 --2- 172.21.15.114:0/3219710112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c066000 0x7f600c0cb4e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.035+0000 7f60108fc640 1 -- 172.21.15.114:0/3219710112 >> 172.21.15.114:0/3219710112 conn(0x7f600c0cbc90 msgr2=0x7f600c0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:32.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.035+0000 7f60108fc640 1 -- 172.21.15.114:0/3219710112 shutdown_connections 2023-11-04T01:37:32.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.035+0000 7f60108fc640 1 -- 172.21.15.114:0/3219710112 wait complete. 2023-11-04T01:37:32.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.037+0000 7f60108fc640 1 Processor -- start 2023-11-04T01:37:32.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.037+0000 7f60108fc640 1 -- start start 2023-11-04T01:37:32.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.037+0000 7f60108fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f600c066000 0x7f600c1535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.037+0000 7f60108fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c070ff0 0x7f600c0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.037+0000 7f60108fc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f600c15d1b0 0x7f600c0b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.037+0000 7f60108fc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c15d5f0 con 0x7f600c070ff0 2023-11-04T01:37:32.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.037+0000 7f60108fc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c15e450 con 0x7f600c15d1b0 2023-11-04T01:37:32.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.037+0000 7f60108fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c155ca0 con 0x7f600c066000 2023-11-04T01:37:32.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.037+0000 7f6003fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c070ff0 0x7f600c0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.038+0000 7f6003fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c070ff0 0x7f600c0b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45286/0 (socket says 172.21.15.114:45286) 2023-11-04T01:37:32.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.038+0000 7f6003fff640 1 -- 172.21.15.114:0/1089899372 learned_addr learned my addr 172.21.15.114:0/1089899372 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.038+0000 7f600ad9d640 1 --2- 172.21.15.114:0/1089899372 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f600c15d1b0 0x7f600c0b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.038+0000 7f600a59c640 1 --2- 172.21.15.114:0/1089899372 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f600c066000 0x7f600c1535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.038+0000 7f6003fff640 1 -- 172.21.15.114:0/1089899372 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f600c066000 msgr2=0x7f600c1535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.038+0000 7f6003fff640 1 --2- 172.21.15.114:0/1089899372 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f600c066000 0x7f600c1535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.038+0000 7f6003fff640 1 -- 172.21.15.114:0/1089899372 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f600c15d1b0 msgr2=0x7f600c0b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.038+0000 7f6003fff640 1 --2- 172.21.15.114:0/1089899372 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f600c15d1b0 0x7f600c0b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.038+0000 7f6003fff640 1 -- 172.21.15.114:0/1089899372 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6004009a70 con 0x7f600c070ff0 2023-11-04T01:37:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.038+0000 7f600a59c640 1 --2- 172.21.15.114:0/1089899372 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f600c066000 0x7f600c1535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.038+0000 7f6003fff640 1 --2- 172.21.15.114:0/1089899372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c070ff0 0x7f600c0b2e80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c400 tx=0x7f5ff400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.038+0000 7f6002ffd640 1 -- 172.21.15.114:0/1089899372 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff40035f0 con 0x7f600c070ff0 2023-11-04T01:37:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.038+0000 7f6002ffd640 1 -- 172.21.15.114:0/1089899372 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff4003750 con 0x7f600c070ff0 2023-11-04T01:37:32.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.038+0000 7f60108fc640 1 -- 172.21.15.114:0/1089899372 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600c15d840 con 0x7f600c070ff0 2023-11-04T01:37:32.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.038+0000 7f6002ffd640 1 -- 172.21.15.114:0/1089899372 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4003b40 con 0x7f600c070ff0 2023-11-04T01:37:32.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.038+0000 7f60108fc640 1 -- 172.21.15.114:0/1089899372 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600c15de00 con 0x7f600c070ff0 2023-11-04T01:37:32.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.039+0000 7f60108fc640 1 -- 172.21.15.114:0/1089899372 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600c074290 con 0x7f600c070ff0 2023-11-04T01:37:32.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.040+0000 7f6002ffd640 1 -- 172.21.15.114:0/1089899372 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ff4003ca0 con 0x7f600c070ff0 2023-11-04T01:37:32.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.040+0000 7f6002ffd640 1 --2- 172.21.15.114:0/1089899372 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5fec06ae70 0x7f5fec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.040+0000 7f6002ffd640 1 -- 172.21.15.114:0/1089899372 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5ff4088eb0 con 0x7f600c070ff0 2023-11-04T01:37:32.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.040+0000 7f600a59c640 1 --2- 172.21.15.114:0/1089899372 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5fec06ae70 0x7f5fec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.040+0000 7f600a59c640 1 --2- 172.21.15.114:0/1089899372 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5fec06ae70 0x7f5fec06d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc000f60 tx=0x7f5ffc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:32.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.044+0000 7f6002ffd640 1 -- 172.21.15.114:0/1089899372 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5ff4053ce0 con 0x7f600c070ff0 2023-11-04T01:37:32.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.211+0000 7f60108fc640 1 -- 172.21.15.114:0/1089899372 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f600c06d910 con 0x7f600c070ff0 2023-11-04T01:37:32.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.211+0000 7f6002ffd640 1 -- 172.21.15.114:0/1089899372 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5ff4017020 con 0x7f600c070ff0 2023-11-04T01:37:32.213 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:32.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.213+0000 7f60108fc640 1 -- 172.21.15.114:0/1089899372 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5fec06ae70 msgr2=0x7f5fec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.213+0000 7f60108fc640 1 --2- 172.21.15.114:0/1089899372 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5fec06ae70 0x7f5fec06d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc000f60 tx=0x7f5ffc009040 comp rx=0 tx=0).stop 2023-11-04T01:37:32.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.213+0000 7f60108fc640 1 -- 172.21.15.114:0/1089899372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c070ff0 msgr2=0x7f600c0b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.213+0000 7f60108fc640 1 --2- 172.21.15.114:0/1089899372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c070ff0 0x7f600c0b2e80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c400 tx=0x7f5ff400c8c0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.213+0000 7f60108fc640 1 -- 172.21.15.114:0/1089899372 shutdown_connections 2023-11-04T01:37:32.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.213+0000 7f60108fc640 1 --2- 172.21.15.114:0/1089899372 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5fec06ae70 0x7f5fec06d330 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.213+0000 7f60108fc640 1 --2- 172.21.15.114:0/1089899372 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f600c15d1b0 0x7f600c0b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.213+0000 7f60108fc640 1 --2- 172.21.15.114:0/1089899372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f600c070ff0 0x7f600c0b2e80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.213+0000 7f60108fc640 1 --2- 172.21.15.114:0/1089899372 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f600c066000 0x7f600c1535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.213+0000 7f60108fc640 1 -- 172.21.15.114:0/1089899372 >> 172.21.15.114:0/1089899372 conn(0x7f600c0cbc90 msgr2=0x7f600c06b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:32.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.213+0000 7f60108fc640 1 -- 172.21.15.114:0/1089899372 shutdown_connections 2023-11-04T01:37:32.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.213+0000 7f60108fc640 1 -- 172.21.15.114:0/1089899372 wait complete. 2023-11-04T01:37:32.226 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:37:32.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.324+0000 7fd12f24b640 1 Processor -- start 2023-11-04T01:37:32.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.324+0000 7fd12f24b640 1 -- start start 2023-11-04T01:37:32.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.325+0000 7fd12f24b640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd12815d060 0x7fd1280b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.325+0000 7fd12f24b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1280b7160 0x7fd1280cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.325+0000 7fd12f24b640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1280ce4c0 con 0x7fd1280cdb20 2023-11-04T01:37:32.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.325+0000 7fd12f24b640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12815d440 con 0x7fd12815d060 2023-11-04T01:37:32.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.325+0000 7fd12f24b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280d1930 con 0x7fd1280b7160 2023-11-04T01:37:32.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.326+0000 7fd12d7e8640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1280b7160 0x7fd1280cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.326+0000 7fd12cfe7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd12815d060 0x7fd1280b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.326+0000 7fd127fff640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fd1280cdb20 0x7fd12806b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:52156/0 (socket says 172.21.15.114:52156) 2023-11-04T01:37:32.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.326+0000 7fd127fff640 1 -- 172.21.15.114:0/1523321782 learned_addr learned my addr 172.21.15.114:0/1523321782 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.326+0000 7fd12d7e8640 1 -- 172.21.15.114:0/1523321782 >> v2:172.21.15.141:3300/0 conn(0x7fd12815d060 msgr2=0x7fd1280b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.326+0000 7fd12d7e8640 1 --2- 172.21.15.114:0/1523321782 >> v2:172.21.15.141:3300/0 conn(0x7fd12815d060 0x7fd1280b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.326+0000 7fd12d7e8640 1 -- 172.21.15.114:0/1523321782 >> v1:172.21.15.141:6789/0 conn(0x7fd1280cdb20 legacy=0x7fd12806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.326+0000 7fd12d7e8640 1 -- 172.21.15.114:0/1523321782 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1280d0d20 con 0x7fd1280b7160 2023-11-04T01:37:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.326+0000 7fd12cfe7640 1 --2- 172.21.15.114:0/1523321782 >> v2:172.21.15.141:3300/0 conn(0x7fd12815d060 0x7fd1280b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.327+0000 7fd12d7e8640 1 --2- 172.21.15.114:0/1523321782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1280b7160 0x7fd1280cdf80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd120009d90 tx=0x7fd12002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63bc608339d89d6a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.327+0000 7fd1277fe640 1 -- 172.21.15.114:0/1523321782 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12002cc50 con 0x7fd1280b7160 2023-11-04T01:37:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.327+0000 7fd1277fe640 1 -- 172.21.15.114:0/1523321782 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12002cdb0 con 0x7fd1280b7160 2023-11-04T01:37:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.327+0000 7fd1277fe640 1 -- 172.21.15.114:0/1523321782 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd120034660 con 0x7fd1280b7160 2023-11-04T01:37:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.328+0000 7fd12f24b640 1 -- 172.21.15.114:0/1523321782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1280b7160 msgr2=0x7fd1280cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.328+0000 7fd12f24b640 1 --2- 172.21.15.114:0/1523321782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1280b7160 0x7fd1280cdf80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd120009d90 tx=0x7fd12002bea0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.328+0000 7fd12f24b640 1 -- 172.21.15.114:0/1523321782 shutdown_connections 2023-11-04T01:37:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.328+0000 7fd12f24b640 1 --2- 172.21.15.114:0/1523321782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1280b7160 0x7fd1280cdf80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.328+0000 7fd12f24b640 1 --2- 172.21.15.114:0/1523321782 >> v2:172.21.15.141:3300/0 conn(0x7fd12815d060 0x7fd1280b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.328+0000 7fd12f24b640 1 -- 172.21.15.114:0/1523321782 >> 172.21.15.114:0/1523321782 conn(0x7fd1280cf760 msgr2=0x7fd1280cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.328+0000 7fd12f24b640 1 -- 172.21.15.114:0/1523321782 shutdown_connections 2023-11-04T01:37:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.328+0000 7fd12f24b640 1 -- 172.21.15.114:0/1523321782 wait complete. 2023-11-04T01:37:32.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.329+0000 7fd12f24b640 1 Processor -- start 2023-11-04T01:37:32.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.329+0000 7fd12f24b640 1 -- start start 2023-11-04T01:37:32.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd12f24b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1280b7160 0x7fd12814c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd12f24b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1280cdb20 0x7fd1280c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd12f24b640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd12815d060 0x7fd1280aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd12f24b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12815e570 con 0x7fd1280cdb20 2023-11-04T01:37:32.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd12f24b640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12815f370 con 0x7fd12815d060 2023-11-04T01:37:32.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd12f24b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12815e290 con 0x7fd1280b7160 2023-11-04T01:37:32.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd127fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1280cdb20 0x7fd1280c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd127fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1280cdb20 0x7fd1280c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45300/0 (socket says 172.21.15.114:45300) 2023-11-04T01:37:32.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd127fff640 1 -- 172.21.15.114:0/3351668644 learned_addr learned my addr 172.21.15.114:0/3351668644 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:32.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd12d7e8640 1 --2- 172.21.15.114:0/3351668644 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd12815d060 0x7fd1280aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd12cfe7640 1 --2- 172.21.15.114:0/3351668644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1280b7160 0x7fd12814c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd127fff640 1 -- 172.21.15.114:0/3351668644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1280b7160 msgr2=0x7fd12814c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd127fff640 1 --2- 172.21.15.114:0/3351668644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1280b7160 0x7fd12814c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd127fff640 1 -- 172.21.15.114:0/3351668644 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd12815d060 msgr2=0x7fd1280aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd127fff640 1 --2- 172.21.15.114:0/3351668644 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd12815d060 0x7fd1280aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd127fff640 1 -- 172.21.15.114:0/3351668644 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd118009400 con 0x7fd1280cdb20 2023-11-04T01:37:32.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd12d7e8640 1 --2- 172.21.15.114:0/3351668644 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd12815d060 0x7fd1280aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:32.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.330+0000 7fd127fff640 1 --2- 172.21.15.114:0/3351668644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1280cdb20 0x7fd1280c8840 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd11c00c4a0 tx=0x7fd11c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:32.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.331+0000 7fd1257fa640 1 -- 172.21.15.114:0/3351668644 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c005ce0 con 0x7fd1280cdb20 2023-11-04T01:37:32.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.331+0000 7fd1257fa640 1 -- 172.21.15.114:0/3351668644 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c005e40 con 0x7fd1280cdb20 2023-11-04T01:37:32.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.331+0000 7fd12f24b640 1 -- 172.21.15.114:0/3351668644 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd120009a70 con 0x7fd1280cdb20 2023-11-04T01:37:32.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.331+0000 7fd1257fa640 1 -- 172.21.15.114:0/3351668644 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c007270 con 0x7fd1280cdb20 2023-11-04T01:37:32.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.331+0000 7fd12f24b640 1 -- 172.21.15.114:0/3351668644 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12815f000 con 0x7fd1280cdb20 2023-11-04T01:37:32.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.332+0000 7fd12f24b640 1 -- 172.21.15.114:0/3351668644 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd128074290 con 0x7fd1280cdb20 2023-11-04T01:37:32.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.332+0000 7fd1257fa640 1 -- 172.21.15.114:0/3351668644 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd11c0073d0 con 0x7fd1280cdb20 2023-11-04T01:37:32.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.332+0000 7fd1257fa640 1 --2- 172.21.15.114:0/3351668644 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd11406ae70 0x7fd11406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.332+0000 7fd1257fa640 1 -- 172.21.15.114:0/3351668644 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd11c088ef0 con 0x7fd1280cdb20 2023-11-04T01:37:32.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.332+0000 7fd12cfe7640 1 --2- 172.21.15.114:0/3351668644 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd11406ae70 0x7fd11406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.333+0000 7fd12cfe7640 1 --2- 172.21.15.114:0/3351668644 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd11406ae70 0x7fd11406d330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd118009cd0 tx=0x7fd118009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:32.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.337+0000 7fd1257fa640 1 -- 172.21.15.114:0/3351668644 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd11c053b80 con 0x7fd1280cdb20 2023-11-04T01:37:32.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.514+0000 7fd12f24b640 1 -- 172.21.15.114:0/3351668644 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd12814ce70 con 0x7fd1280cdb20 2023-11-04T01:37:32.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.515+0000 7fd1257fa640 1 -- 172.21.15.114:0/3351668644 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd11c017080 con 0x7fd1280cdb20 2023-11-04T01:37:32.517 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-11-04T01:37:32.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.516+0000 7fd12f24b640 1 -- 172.21.15.114:0/3351668644 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd11406ae70 msgr2=0x7fd11406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.516+0000 7fd12f24b640 1 --2- 172.21.15.114:0/3351668644 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd11406ae70 0x7fd11406d330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd118009cd0 tx=0x7fd118009190 comp rx=0 tx=0).stop 2023-11-04T01:37:32.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.516+0000 7fd12f24b640 1 -- 172.21.15.114:0/3351668644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1280cdb20 msgr2=0x7fd1280c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.516+0000 7fd12f24b640 1 --2- 172.21.15.114:0/3351668644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1280cdb20 0x7fd1280c8840 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd11c00c4a0 tx=0x7fd11c00c960 comp rx=0 tx=0).stop 2023-11-04T01:37:32.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.517+0000 7fd12f24b640 1 -- 172.21.15.114:0/3351668644 shutdown_connections 2023-11-04T01:37:32.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.517+0000 7fd12f24b640 1 --2- 172.21.15.114:0/3351668644 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd11406ae70 0x7fd11406d330 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.517+0000 7fd12f24b640 1 --2- 172.21.15.114:0/3351668644 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd12815d060 0x7fd1280aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.517+0000 7fd12f24b640 1 --2- 172.21.15.114:0/3351668644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1280cdb20 0x7fd1280c8840 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.517+0000 7fd12f24b640 1 --2- 172.21.15.114:0/3351668644 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd1280b7160 0x7fd12814c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.517+0000 7fd12f24b640 1 -- 172.21.15.114:0/3351668644 >> 172.21.15.114:0/3351668644 conn(0x7fd1280cf760 msgr2=0x7fd12815a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:32.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.517+0000 7fd12f24b640 1 -- 172.21.15.114:0/3351668644 shutdown_connections 2023-11-04T01:37:32.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.517+0000 7fd12f24b640 1 -- 172.21.15.114:0/3351668644 wait complete. 2023-11-04T01:37:32.529 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi114.front.sepia.ceph.com... 2023-11-04T01:37:32.529 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:32.529 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-04T01:37:32.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:32.588 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi114.stderr:ceph-fuse[99516]: fuse finished with error 0 and tester_r 0 2023-11-04T01:37:32.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:32.593 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi114.stderr:2023-11-04T01:37:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:32.595 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:32.601 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:37:32.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:32.601 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:37:32.656 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:37:32.657 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:32.673 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:37:32.673 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:32.730 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:32.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi141.stderr:2023-11-04T01:37:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:32.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.829+0000 7f304e5a9640 1 Processor -- start 2023-11-04T01:37:32.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.829+0000 7f304e5a9640 1 -- start start 2023-11-04T01:37:32.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.830+0000 7f304e5a9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f30480cc430 0x7f30480cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.830+0000 7f304e5a9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f30480ce730 0x7f30480ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.830+0000 7f304e5a9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30480ccdb0 con 0x7f3048159da0 2023-11-04T01:37:32.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.830+0000 7f304e5a9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30480cd690 con 0x7f30480cc430 2023-11-04T01:37:32.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.830+0000 7f304e5a9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30480cd970 con 0x7f30480ce730 2023-11-04T01:37:32.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.830+0000 7f30477fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f30480cc430 0x7f30480cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.830+0000 7f30477fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f30480cc430 0x7f30480cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45314/0 (socket says 172.21.15.114:45314) 2023-11-04T01:37:32.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.830+0000 7f30477fe640 1 -- 172.21.15.114:0/2263737204 learned_addr learned my addr 172.21.15.114:0/2263737204 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:32.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.830+0000 7f30477fe640 1 -- 172.21.15.114:0/2263737204 >> v2:172.21.15.141:3300/0 conn(0x7f30480ce730 msgr2=0x7f30480ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:32.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.830+0000 7f30477fe640 1 --2- 172.21.15.114:0/2263737204 >> v2:172.21.15.141:3300/0 conn(0x7f30480ce730 0x7f30480ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.830+0000 7f30477fe640 1 -- 172.21.15.114:0/2263737204 >> v1:172.21.15.114:6789/0 conn(0x7f3048159da0 legacy=0x7f30480b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.830+0000 7f30477fe640 1 -- 172.21.15.114:0/2263737204 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30480cdc50 con 0x7f30480cc430 2023-11-04T01:37:32.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.831+0000 7f30477fe640 1 --2- 172.21.15.114:0/2263737204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30480cc430 0x7f30480cc870 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f304806f0e0 tx=0x7f303c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a3379aaea52f6a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:32.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.831+0000 7f3046ffd640 1 -- 172.21.15.114:0/2263737204 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c030860 con 0x7f30480cc430 2023-11-04T01:37:32.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.831+0000 7f3046ffd640 1 -- 172.21.15.114:0/2263737204 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c0309c0 con 0x7f30480cc430 2023-11-04T01:37:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.831+0000 7f3046ffd640 1 -- 172.21.15.114:0/2263737204 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c030d50 con 0x7f30480cc430 2023-11-04T01:37:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.832+0000 7f304e5a9640 1 -- 172.21.15.114:0/2263737204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30480cc430 msgr2=0x7f30480cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.832+0000 7f304e5a9640 1 --2- 172.21.15.114:0/2263737204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30480cc430 0x7f30480cc870 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f304806f0e0 tx=0x7f303c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.832+0000 7f304e5a9640 1 -- 172.21.15.114:0/2263737204 shutdown_connections 2023-11-04T01:37:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.832+0000 7f304e5a9640 1 --2- 172.21.15.114:0/2263737204 >> v2:172.21.15.141:3300/0 conn(0x7f30480ce730 0x7f30480ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.832+0000 7f304e5a9640 1 --2- 172.21.15.114:0/2263737204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30480cc430 0x7f30480cc870 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.832+0000 7f304e5a9640 1 -- 172.21.15.114:0/2263737204 >> 172.21.15.114:0/2263737204 conn(0x7f304806d8b0 msgr2=0x7f304806dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.832+0000 7f304e5a9640 1 -- 172.21.15.114:0/2263737204 shutdown_connections 2023-11-04T01:37:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.832+0000 7f304e5a9640 1 -- 172.21.15.114:0/2263737204 wait complete. 2023-11-04T01:37:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.833+0000 7f304e5a9640 1 Processor -- start 2023-11-04T01:37:32.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.833+0000 7f304e5a9640 1 -- start start 2023-11-04T01:37:32.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f304e5a9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30480cc430 0x7f30480c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f304e5a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30480ce730 0x7f30480b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f304e5a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3048159da0 0x7f30481576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f304e5a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30480b1230 con 0x7f30480ce730 2023-11-04T01:37:32.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f304e5a9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30480c9580 con 0x7f30480cc430 2023-11-04T01:37:32.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f304e5a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30480c9a40 con 0x7f3048159da0 2023-11-04T01:37:32.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f30477fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30480ce730 0x7f30480b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f30477fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30480ce730 0x7f30480b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45324/0 (socket says 172.21.15.114:45324) 2023-11-04T01:37:32.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f30477fe640 1 -- 172.21.15.114:0/1749832281 learned_addr learned my addr 172.21.15.114:0/1749832281 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:32.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f304cb46640 1 --2- 172.21.15.114:0/1749832281 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3048159da0 0x7f30481576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f3047fff640 1 --2- 172.21.15.114:0/1749832281 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30480cc430 0x7f30480c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f30477fe640 1 -- 172.21.15.114:0/1749832281 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3048159da0 msgr2=0x7f30481576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f30477fe640 1 --2- 172.21.15.114:0/1749832281 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3048159da0 0x7f30481576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f30477fe640 1 -- 172.21.15.114:0/1749832281 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30480cc430 msgr2=0x7f30480c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f30477fe640 1 --2- 172.21.15.114:0/1749832281 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30480cc430 0x7f30480c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f30477fe640 1 -- 172.21.15.114:0/1749832281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0094d0 con 0x7f30480ce730 2023-11-04T01:37:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f304cb46640 1 --2- 172.21.15.114:0/1749832281 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3048159da0 0x7f30481576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f3047fff640 1 --2- 172.21.15.114:0/1749832281 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30480cc430 0x7f30480c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f30477fe640 1 --2- 172.21.15.114:0/1749832281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30480ce730 0x7f30480b3fd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f303c000c00 tx=0x7f303c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.834+0000 7f3044ff9640 1 -- 172.21.15.114:0/1749832281 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c030830 con 0x7f30480ce730 2023-11-04T01:37:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.835+0000 7f3044ff9640 1 -- 172.21.15.114:0/1749832281 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c043400 con 0x7f30480ce730 2023-11-04T01:37:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.835+0000 7f304e5a9640 1 -- 172.21.15.114:0/1749832281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30480b1f00 con 0x7f30480ce730 2023-11-04T01:37:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.835+0000 7f3044ff9640 1 -- 172.21.15.114:0/1749832281 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c0437b0 con 0x7f30480ce730 2023-11-04T01:37:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.835+0000 7f304e5a9640 1 -- 172.21.15.114:0/1749832281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30480b1700 con 0x7f30480ce730 2023-11-04T01:37:32.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.836+0000 7f304e5a9640 1 -- 172.21.15.114:0/1749832281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30480008d0 con 0x7f30480ce730 2023-11-04T01:37:32.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.836+0000 7f3044ff9640 1 -- 172.21.15.114:0/1749832281 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f303c043910 con 0x7f30480ce730 2023-11-04T01:37:32.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.836+0000 7f3044ff9640 1 --2- 172.21.15.114:0/1749832281 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f303406ae70 0x7f303406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:32.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.836+0000 7f3044ff9640 1 -- 172.21.15.114:0/1749832281 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f303c03e070 con 0x7f30480ce730 2023-11-04T01:37:32.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.836+0000 7f3047fff640 1 --2- 172.21.15.114:0/1749832281 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f303406ae70 0x7f303406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:32.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.837+0000 7f3047fff640 1 --2- 172.21.15.114:0/1749832281 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f303406ae70 0x7f303406d330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f30480b24d0 tx=0x7f3038009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:32.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:32.841+0000 7f3044ff9640 1 -- 172.21.15.114:0/1749832281 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f303c077b50 con 0x7f30480ce730 2023-11-04T01:37:33.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.007+0000 7f304e5a9640 1 -- 172.21.15.114:0/1749832281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f304806c920 con 0x7f30480ce730 2023-11-04T01:37:33.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.008+0000 7f3044ff9640 1 -- 172.21.15.114:0/1749832281 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18796 (secure 0 0 0) 0x7f303c07b170 con 0x7f30480ce730 2023-11-04T01:37:33.010 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:33.010 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:11.562429+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:33.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.010+0000 7f304e5a9640 1 -- 172.21.15.114:0/1749832281 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f303406ae70 msgr2=0x7f303406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.010+0000 7f304e5a9640 1 --2- 172.21.15.114:0/1749832281 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f303406ae70 0x7f303406d330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f30480b24d0 tx=0x7f3038009040 comp rx=0 tx=0).stop 2023-11-04T01:37:33.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.010+0000 7f304e5a9640 1 -- 172.21.15.114:0/1749832281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30480ce730 msgr2=0x7f30480b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.010+0000 7f304e5a9640 1 --2- 172.21.15.114:0/1749832281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30480ce730 0x7f30480b3fd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f303c000c00 tx=0x7f303c004730 comp rx=0 tx=0).stop 2023-11-04T01:37:33.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.010+0000 7f304e5a9640 1 -- 172.21.15.114:0/1749832281 shutdown_connections 2023-11-04T01:37:33.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.010+0000 7f304e5a9640 1 --2- 172.21.15.114:0/1749832281 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3048159da0 0x7f30481576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.010+0000 7f304e5a9640 1 --2- 172.21.15.114:0/1749832281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30480ce730 0x7f30480b3fd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.010+0000 7f304e5a9640 1 --2- 172.21.15.114:0/1749832281 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f303406ae70 0x7f303406d330 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.010+0000 7f304e5a9640 1 --2- 172.21.15.114:0/1749832281 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f30480cc430 0x7f30480c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.010+0000 7f304e5a9640 1 -- 172.21.15.114:0/1749832281 >> 172.21.15.114:0/1749832281 conn(0x7f304806d8b0 msgr2=0x7f3048159070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:33.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.010+0000 7f304e5a9640 1 -- 172.21.15.114:0/1749832281 shutdown_connections 2023-11-04T01:37:33.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.010+0000 7f304e5a9640 1 -- 172.21.15.114:0/1749832281 wait complete. 2023-11-04T01:37:33.023 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:33.024 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:33.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.124+0000 7faa6ad6c640 1 Processor -- start 2023-11-04T01:37:33.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.124+0000 7faa6ad6c640 1 -- start start 2023-11-04T01:37:33.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.124+0000 7faa6ad6c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7faa64153850 0x7faa6415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.124+0000 7faa6ad6c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa640cc9d0 0x7faa640c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.124+0000 7faa6ad6c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa640c3860 con 0x7faa640cc520 2023-11-04T01:37:33.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.124+0000 7faa6ad6c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa640c9250 con 0x7faa64153850 2023-11-04T01:37:33.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.124+0000 7faa6ad6c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa64153c30 con 0x7faa640cc9d0 2023-11-04T01:37:33.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.125+0000 7faa68b08640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7faa64153850 0x7faa6415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.125+0000 7faa69309640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa640cc9d0 0x7faa640c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.125+0000 7faa68b08640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7faa64153850 0x7faa6415a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:54506/0 (socket says 172.21.15.114:54506) 2023-11-04T01:37:33.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.125+0000 7faa63fff640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7faa640cc520 0x7faa64070fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:52162/0 (socket says 172.21.15.114:52162) 2023-11-04T01:37:33.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.125+0000 7faa68b08640 1 -- 172.21.15.114:0/957476914 learned_addr learned my addr 172.21.15.114:0/957476914 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:33.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.125+0000 7faa68b08640 1 -- 172.21.15.114:0/957476914 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa640cc9d0 msgr2=0x7faa640c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:33.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.125+0000 7faa68b08640 1 --2- 172.21.15.114:0/957476914 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa640cc9d0 0x7faa640c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.125+0000 7faa68b08640 1 -- 172.21.15.114:0/957476914 >> v1:172.21.15.141:6789/0 conn(0x7faa640cc520 legacy=0x7faa64070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.125+0000 7faa68b08640 1 -- 172.21.15.114:0/957476914 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6415a700 con 0x7faa64153850 2023-11-04T01:37:33.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.126+0000 7faa68b08640 1 --2- 172.21.15.114:0/957476914 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa64153850 0x7faa6415a1c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faa58009870 tx=0x7faa5802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=746e2454846f7d99 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.126+0000 7faa637fe640 1 -- 172.21.15.114:0/957476914 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58030840 con 0x7faa64153850 2023-11-04T01:37:33.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.126+0000 7faa637fe640 1 -- 172.21.15.114:0/957476914 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa580309a0 con 0x7faa64153850 2023-11-04T01:37:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.126+0000 7faa637fe640 1 -- 172.21.15.114:0/957476914 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58030d30 con 0x7faa64153850 2023-11-04T01:37:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.126+0000 7faa6ad6c640 1 -- 172.21.15.114:0/957476914 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa64153850 msgr2=0x7faa6415a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.127+0000 7faa6ad6c640 1 --2- 172.21.15.114:0/957476914 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa64153850 0x7faa6415a1c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faa58009870 tx=0x7faa5802b980 comp rx=0 tx=0).stop 2023-11-04T01:37:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.127+0000 7faa6ad6c640 1 -- 172.21.15.114:0/957476914 shutdown_connections 2023-11-04T01:37:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.127+0000 7faa6ad6c640 1 --2- 172.21.15.114:0/957476914 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa640cc9d0 0x7faa640c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.127+0000 7faa6ad6c640 1 --2- 172.21.15.114:0/957476914 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa64153850 0x7faa6415a1c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.127+0000 7faa6ad6c640 1 -- 172.21.15.114:0/957476914 >> 172.21.15.114:0/957476914 conn(0x7faa640ce950 msgr2=0x7faa640ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.127+0000 7faa6ad6c640 1 -- 172.21.15.114:0/957476914 shutdown_connections 2023-11-04T01:37:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.127+0000 7faa6ad6c640 1 -- 172.21.15.114:0/957476914 wait complete. 2023-11-04T01:37:33.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.128+0000 7faa6ad6c640 1 Processor -- start 2023-11-04T01:37:33.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.128+0000 7faa6ad6c640 1 -- start start 2023-11-04T01:37:33.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa6ad6c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa640cc520 0x7faa6414c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa6ad6c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa640cc9d0 0x7faa6414b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa6ad6c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa64153850 0x7faa64149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa6ad6c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6414b670 con 0x7faa640cc520 2023-11-04T01:37:33.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa6ad6c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64147de0 con 0x7faa64153850 2023-11-04T01:37:33.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa6ad6c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6414b8a0 con 0x7faa640cc9d0 2023-11-04T01:37:33.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa68b08640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa640cc520 0x7faa6414c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa68b08640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa640cc520 0x7faa6414c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45330/0 (socket says 172.21.15.114:45330) 2023-11-04T01:37:33.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa68b08640 1 -- 172.21.15.114:0/2736768050 learned_addr learned my addr 172.21.15.114:0/2736768050 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:33.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa63fff640 1 --2- 172.21.15.114:0/2736768050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa640cc9d0 0x7faa6414b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa69309640 1 --2- 172.21.15.114:0/2736768050 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa64153850 0x7faa64149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa68b08640 1 -- 172.21.15.114:0/2736768050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa640cc9d0 msgr2=0x7faa6414b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa68b08640 1 --2- 172.21.15.114:0/2736768050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa640cc9d0 0x7faa6414b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa68b08640 1 -- 172.21.15.114:0/2736768050 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa64153850 msgr2=0x7faa64149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa68b08640 1 --2- 172.21.15.114:0/2736768050 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa64153850 0x7faa64149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa68b08640 1 -- 172.21.15.114:0/2736768050 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa580094d0 con 0x7faa640cc520 2023-11-04T01:37:33.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa63fff640 1 --2- 172.21.15.114:0/2736768050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa640cc9d0 0x7faa6414b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:33.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa68b08640 1 --2- 172.21.15.114:0/2736768050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa640cc520 0x7faa6414c790 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7faa58000c00 tx=0x7faa58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa617fa640 1 -- 172.21.15.114:0/2736768050 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58039a90 con 0x7faa640cc520 2023-11-04T01:37:33.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa617fa640 1 -- 172.21.15.114:0/2736768050 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa58039bf0 con 0x7faa640cc520 2023-11-04T01:37:33.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa6ad6c640 1 -- 172.21.15.114:0/2736768050 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6414bb80 con 0x7faa640cc520 2023-11-04T01:37:33.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa617fa640 1 -- 172.21.15.114:0/2736768050 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58043410 con 0x7faa640cc520 2023-11-04T01:37:33.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.129+0000 7faa6ad6c640 1 -- 172.21.15.114:0/2736768050 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa64149d40 con 0x7faa640cc520 2023-11-04T01:37:33.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.130+0000 7faa6ad6c640 1 -- 172.21.15.114:0/2736768050 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6414c0a0 con 0x7faa640cc520 2023-11-04T01:37:33.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.131+0000 7faa617fa640 1 -- 172.21.15.114:0/2736768050 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa5804c3b0 con 0x7faa640cc520 2023-11-04T01:37:33.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.131+0000 7faa617fa640 1 --2- 172.21.15.114:0/2736768050 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faa4806ae70 0x7faa4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.131+0000 7faa617fa640 1 -- 172.21.15.114:0/2736768050 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faa580abd30 con 0x7faa640cc520 2023-11-04T01:37:33.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.131+0000 7faa63fff640 1 --2- 172.21.15.114:0/2736768050 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faa4806ae70 0x7faa4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.132+0000 7faa63fff640 1 --2- 172.21.15.114:0/2736768050 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faa4806ae70 0x7faa4806d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faa50007fd0 tx=0x7faa50007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.135+0000 7faa617fa640 1 -- 172.21.15.114:0/2736768050 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faa6414c0a0 con 0x7faa640cc520 2023-11-04T01:37:33.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.300+0000 7faa6ad6c640 1 -- 172.21.15.114:0/2736768050 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa6414c0a0 con 0x7faa640cc520 2023-11-04T01:37:33.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.301+0000 7faa617fa640 1 -- 172.21.15.114:0/2736768050 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa6414c0a0 con 0x7faa640cc520 2023-11-04T01:37:33.303 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:37:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.302+0000 7faa6ad6c640 1 -- 172.21.15.114:0/2736768050 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faa4806ae70 msgr2=0x7faa4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.302+0000 7faa6ad6c640 1 --2- 172.21.15.114:0/2736768050 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faa4806ae70 0x7faa4806d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faa50007fd0 tx=0x7faa50007d40 comp rx=0 tx=0).stop 2023-11-04T01:37:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.302+0000 7faa6ad6c640 1 -- 172.21.15.114:0/2736768050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa640cc520 msgr2=0x7faa6414c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.302+0000 7faa6ad6c640 1 --2- 172.21.15.114:0/2736768050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa640cc520 0x7faa6414c790 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7faa58000c00 tx=0x7faa58004730 comp rx=0 tx=0).stop 2023-11-04T01:37:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.303+0000 7faa6ad6c640 1 -- 172.21.15.114:0/2736768050 shutdown_connections 2023-11-04T01:37:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.303+0000 7faa6ad6c640 1 --2- 172.21.15.114:0/2736768050 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faa4806ae70 0x7faa4806d330 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.303+0000 7faa6ad6c640 1 --2- 172.21.15.114:0/2736768050 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faa64153850 0x7faa64149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.303+0000 7faa6ad6c640 1 --2- 172.21.15.114:0/2736768050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faa640cc9d0 0x7faa6414b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.303+0000 7faa6ad6c640 1 --2- 172.21.15.114:0/2736768050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa640cc520 0x7faa6414c790 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.303+0000 7faa6ad6c640 1 -- 172.21.15.114:0/2736768050 >> 172.21.15.114:0/2736768050 conn(0x7faa640ce950 msgr2=0x7faa64070610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.303+0000 7faa6ad6c640 1 -- 172.21.15.114:0/2736768050 shutdown_connections 2023-11-04T01:37:33.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.303+0000 7faa6ad6c640 1 -- 172.21.15.114:0/2736768050 wait complete. 2023-11-04T01:37:33.315 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:33.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.415+0000 7f5fd454c640 1 Processor -- start 2023-11-04T01:37:33.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.415+0000 7f5fd454c640 1 -- start start 2023-11-04T01:37:33.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.416+0000 7f5fd454c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5fcc0ca0a0 0x7f5fcc0cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.416+0000 7f5fd454c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5fcc0cc300 0x7f5fcc0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.416+0000 7f5fd454c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fcc0caa20 con 0x7f5fcc15e3f0 2023-11-04T01:37:33.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.416+0000 7f5fd454c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fcc0b3300 con 0x7f5fcc0ca0a0 2023-11-04T01:37:33.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.416+0000 7f5fd454c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fcc0cb230 con 0x7f5fcc0cc300 2023-11-04T01:37:33.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.417+0000 7f5fd1ae7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5fcc0ca0a0 0x7f5fcc0cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.417+0000 7f5fd1ae7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5fcc0ca0a0 0x7f5fcc0cc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45336/0 (socket says 172.21.15.114:45336) 2023-11-04T01:37:33.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.417+0000 7f5fd1ae7640 1 -- 172.21.15.114:0/2596679278 learned_addr learned my addr 172.21.15.114:0/2596679278 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:33.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.417+0000 7f5fd2ae9640 1 --2- 172.21.15.114:0/2596679278 >> v2:172.21.15.141:3300/0 conn(0x7f5fcc0cc300 0x7f5fcc0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.417+0000 7f5fd1ae7640 1 -- 172.21.15.114:0/2596679278 >> v2:172.21.15.141:3300/0 conn(0x7f5fcc0cc300 msgr2=0x7f5fcc0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:33.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.417+0000 7f5fd1ae7640 1 --2- 172.21.15.114:0/2596679278 >> v2:172.21.15.141:3300/0 conn(0x7f5fcc0cc300 0x7f5fcc0cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.417+0000 7f5fd1ae7640 1 -- 172.21.15.114:0/2596679278 >> v1:172.21.15.141:6789/0 conn(0x7f5fcc15e3f0 legacy=0x7f5fcc0b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.417+0000 7f5fd1ae7640 1 -- 172.21.15.114:0/2596679278 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc0ca530 con 0x7f5fcc0ca0a0 2023-11-04T01:37:33.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.418+0000 7f5fd1ae7640 1 --2- 172.21.15.114:0/2596679278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fcc0ca0a0 0x7f5fcc0cc920 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0af430 tx=0x7f5fbc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc912ddacc9dbfc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.418+0000 7f5fd12e6640 1 -- 172.21.15.114:0/2596679278 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc030860 con 0x7f5fcc0ca0a0 2023-11-04T01:37:33.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.418+0000 7f5fd12e6640 1 -- 172.21.15.114:0/2596679278 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc0309c0 con 0x7f5fcc0ca0a0 2023-11-04T01:37:33.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.418+0000 7f5fd12e6640 1 -- 172.21.15.114:0/2596679278 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc030d50 con 0x7f5fcc0ca0a0 2023-11-04T01:37:33.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.418+0000 7f5fd454c640 1 -- 172.21.15.114:0/2596679278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fcc0ca0a0 msgr2=0x7f5fcc0cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.418+0000 7f5fd454c640 1 --2- 172.21.15.114:0/2596679278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fcc0ca0a0 0x7f5fcc0cc920 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0af430 tx=0x7f5fbc02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.418+0000 7f5fd454c640 1 -- 172.21.15.114:0/2596679278 shutdown_connections 2023-11-04T01:37:33.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.418+0000 7f5fd454c640 1 --2- 172.21.15.114:0/2596679278 >> v2:172.21.15.141:3300/0 conn(0x7f5fcc0cc300 0x7f5fcc0cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.418+0000 7f5fd454c640 1 --2- 172.21.15.114:0/2596679278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fcc0ca0a0 0x7f5fcc0cc920 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.418+0000 7f5fd454c640 1 -- 172.21.15.114:0/2596679278 >> 172.21.15.114:0/2596679278 conn(0x7f5fcc071820 msgr2=0x7f5fcc071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:33.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.418+0000 7f5fd454c640 1 -- 172.21.15.114:0/2596679278 shutdown_connections 2023-11-04T01:37:33.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.418+0000 7f5fd454c640 1 -- 172.21.15.114:0/2596679278 wait complete. 2023-11-04T01:37:33.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.420+0000 7f5fd454c640 1 Processor -- start 2023-11-04T01:37:33.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.420+0000 7f5fd454c640 1 -- start start 2023-11-04T01:37:33.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.420+0000 7f5fd454c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5fcc0cc300 0x7f5fcc1f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.420+0000 7f5fd454c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5fcc15e3f0 0x7f5fcc0c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.420+0000 7f5fd454c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fcc14fe70 0x7f5fcc0c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.420+0000 7f5fd454c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc14ee90 con 0x7f5fcc14fe70 2023-11-04T01:37:33.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.420+0000 7f5fd454c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc14f170 con 0x7f5fcc15e3f0 2023-11-04T01:37:33.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.420+0000 7f5fd454c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc14f450 con 0x7f5fcc0cc300 2023-11-04T01:37:33.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.420+0000 7f5fd2ae9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fcc14fe70 0x7f5fcc0c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.420+0000 7f5fd2ae9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fcc14fe70 0x7f5fcc0c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45346/0 (socket says 172.21.15.114:45346) 2023-11-04T01:37:33.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.420+0000 7f5fd2ae9640 1 -- 172.21.15.114:0/3556480961 learned_addr learned my addr 172.21.15.114:0/3556480961 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:33.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.420+0000 7f5fd1ae7640 1 --2- 172.21.15.114:0/3556480961 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5fcc15e3f0 0x7f5fcc0c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.421+0000 7f5fd22e8640 1 --2- 172.21.15.114:0/3556480961 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5fcc0cc300 0x7f5fcc1f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.421+0000 7f5fd2ae9640 1 -- 172.21.15.114:0/3556480961 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5fcc0cc300 msgr2=0x7f5fcc1f00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.421+0000 7f5fd2ae9640 1 --2- 172.21.15.114:0/3556480961 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5fcc0cc300 0x7f5fcc1f00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.421+0000 7f5fd2ae9640 1 -- 172.21.15.114:0/3556480961 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5fcc15e3f0 msgr2=0x7f5fcc0c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.421+0000 7f5fd2ae9640 1 --2- 172.21.15.114:0/3556480961 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5fcc15e3f0 0x7f5fcc0c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.421+0000 7f5fd2ae9640 1 -- 172.21.15.114:0/3556480961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc0094d0 con 0x7f5fcc14fe70 2023-11-04T01:37:33.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.421+0000 7f5fd1ae7640 1 --2- 172.21.15.114:0/3556480961 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5fcc15e3f0 0x7f5fcc0c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:33.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.421+0000 7f5fd2ae9640 1 --2- 172.21.15.114:0/3556480961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fcc14fe70 0x7f5fcc0c9230 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400efc0 tx=0x7f5fc400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.421+0000 7f5fc2ffd640 1 -- 172.21.15.114:0/3556480961 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4014480 con 0x7f5fcc14fe70 2023-11-04T01:37:33.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.421+0000 7f5fc2ffd640 1 -- 172.21.15.114:0/3556480961 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc400f040 con 0x7f5fcc14fe70 2023-11-04T01:37:33.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.421+0000 7f5fd454c640 1 -- 172.21.15.114:0/3556480961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fcc14f730 con 0x7f5fcc14fe70 2023-11-04T01:37:33.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.421+0000 7f5fc2ffd640 1 -- 172.21.15.114:0/3556480961 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4014820 con 0x7f5fcc14fe70 2023-11-04T01:37:33.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.421+0000 7f5fd454c640 1 -- 172.21.15.114:0/3556480961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fcc150680 con 0x7f5fcc14fe70 2023-11-04T01:37:33.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.422+0000 7f5fd454c640 1 -- 172.21.15.114:0/3556480961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fcc14fc50 con 0x7f5fcc14fe70 2023-11-04T01:37:33.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.422+0000 7f5fc2ffd640 1 -- 172.21.15.114:0/3556480961 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5fc4014980 con 0x7f5fcc14fe70 2023-11-04T01:37:33.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.423+0000 7f5fc2ffd640 1 --2- 172.21.15.114:0/3556480961 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5fb006aea0 0x7f5fb006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.423+0000 7f5fc2ffd640 1 -- 172.21.15.114:0/3556480961 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5fc408a5d0 con 0x7f5fcc14fe70 2023-11-04T01:37:33.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.423+0000 7f5fd22e8640 1 --2- 172.21.15.114:0/3556480961 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5fb006aea0 0x7f5fb006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.423+0000 7f5fd22e8640 1 --2- 172.21.15.114:0/3556480961 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5fb006aea0 0x7f5fb006d360 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8000f60 tx=0x7f5fc8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.427+0000 7f5fc2ffd640 1 -- 172.21.15.114:0/3556480961 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5fcc14fc50 con 0x7f5fcc14fe70 2023-11-04T01:37:33.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.594+0000 7f5fd454c640 1 -- 172.21.15.114:0/3556480961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5fcc14fc50 con 0x7f5fcc14fe70 2023-11-04T01:37:33.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.594+0000 7f5fc2ffd640 1 -- 172.21.15.114:0/3556480961 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5fc4055220 con 0x7f5fcc14fe70 2023-11-04T01:37:33.596 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:33.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.596+0000 7f5fd454c640 1 -- 172.21.15.114:0/3556480961 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5fb006aea0 msgr2=0x7f5fb006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.596+0000 7f5fd454c640 1 --2- 172.21.15.114:0/3556480961 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5fb006aea0 0x7f5fb006d360 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8000f60 tx=0x7f5fc8009040 comp rx=0 tx=0).stop 2023-11-04T01:37:33.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.596+0000 7f5fd454c640 1 -- 172.21.15.114:0/3556480961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fcc14fe70 msgr2=0x7f5fcc0c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.596+0000 7f5fd454c640 1 --2- 172.21.15.114:0/3556480961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fcc14fe70 0x7f5fcc0c9230 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400efc0 tx=0x7f5fc400c490 comp rx=0 tx=0).stop 2023-11-04T01:37:33.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.596+0000 7f5fd454c640 1 -- 172.21.15.114:0/3556480961 shutdown_connections 2023-11-04T01:37:33.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.596+0000 7f5fd454c640 1 --2- 172.21.15.114:0/3556480961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fcc14fe70 0x7f5fcc0c9230 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.596+0000 7f5fd454c640 1 --2- 172.21.15.114:0/3556480961 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5fb006aea0 0x7f5fb006d360 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.596+0000 7f5fd454c640 1 --2- 172.21.15.114:0/3556480961 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5fcc15e3f0 0x7f5fcc0c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.596+0000 7f5fd454c640 1 --2- 172.21.15.114:0/3556480961 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5fcc0cc300 0x7f5fcc1f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.596+0000 7f5fd454c640 1 -- 172.21.15.114:0/3556480961 >> 172.21.15.114:0/3556480961 conn(0x7f5fcc071820 msgr2=0x7f5fcc0b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.596+0000 7f5fd454c640 1 -- 172.21.15.114:0/3556480961 shutdown_connections 2023-11-04T01:37:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.596+0000 7f5fd454c640 1 -- 172.21.15.114:0/3556480961 wait complete. 2023-11-04T01:37:33.609 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:33.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.709+0000 7f78abfd7640 1 Processor -- start 2023-11-04T01:37:33.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.710+0000 7f78abfd7640 1 -- start start 2023-11-04T01:37:33.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.710+0000 7f78abfd7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f78a40cd6d0 0x7f78a4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.710+0000 7f78abfd7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f78a40b4880 0x7f78a40b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.710+0000 7f78abfd7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a40cde60 con 0x7f78a4153e60 2023-11-04T01:37:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.710+0000 7f78abfd7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a4160f90 con 0x7f78a40cd6d0 2023-11-04T01:37:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.710+0000 7f78abfd7640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a4161960 con 0x7f78a40b4880 2023-11-04T01:37:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.710+0000 7f78a9572640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f78a40cd6d0 0x7f78a4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.710+0000 7f78a9572640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f78a40cd6d0 0x7f78a4161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45348/0 (socket says 172.21.15.114:45348) 2023-11-04T01:37:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.710+0000 7f78a9572640 1 -- 172.21.15.114:0/4279515221 learned_addr learned my addr 172.21.15.114:0/4279515221 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.711+0000 7f78aa574640 1 --2- 172.21.15.114:0/4279515221 >> v2:172.21.15.141:3300/0 conn(0x7f78a40b4880 0x7f78a40b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.711+0000 7f78a9572640 1 -- 172.21.15.114:0/4279515221 >> v2:172.21.15.141:3300/0 conn(0x7f78a40b4880 msgr2=0x7f78a40b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.711+0000 7f78a9572640 1 --2- 172.21.15.114:0/4279515221 >> v2:172.21.15.141:3300/0 conn(0x7f78a40b4880 0x7f78a40b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.711+0000 7f78a9572640 1 -- 172.21.15.114:0/4279515221 >> v1:172.21.15.114:6789/0 conn(0x7f78a4153e60 legacy=0x7f78a415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.711+0000 7f78a9572640 1 -- 172.21.15.114:0/4279515221 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a40b5220 con 0x7f78a40cd6d0 2023-11-04T01:37:33.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.711+0000 7f78a9572640 1 --2- 172.21.15.114:0/4279515221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78a40cd6d0 0x7f78a4161420 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f78a40b8f40 tx=0x7f789402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c080f959a64e0d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.712+0000 7f78a8d71640 1 -- 172.21.15.114:0/4279515221 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7894030860 con 0x7f78a40cd6d0 2023-11-04T01:37:33.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.712+0000 7f78a8d71640 1 -- 172.21.15.114:0/4279515221 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78940309c0 con 0x7f78a40cd6d0 2023-11-04T01:37:33.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.712+0000 7f78a8d71640 1 -- 172.21.15.114:0/4279515221 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7894030d50 con 0x7f78a40cd6d0 2023-11-04T01:37:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.712+0000 7f78abfd7640 1 -- 172.21.15.114:0/4279515221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78a40cd6d0 msgr2=0x7f78a4161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.712+0000 7f78abfd7640 1 --2- 172.21.15.114:0/4279515221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78a40cd6d0 0x7f78a4161420 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f78a40b8f40 tx=0x7f789402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.712+0000 7f78abfd7640 1 -- 172.21.15.114:0/4279515221 shutdown_connections 2023-11-04T01:37:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.712+0000 7f78abfd7640 1 --2- 172.21.15.114:0/4279515221 >> v2:172.21.15.141:3300/0 conn(0x7f78a40b4880 0x7f78a40b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.712+0000 7f78abfd7640 1 --2- 172.21.15.114:0/4279515221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78a40cd6d0 0x7f78a4161420 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.712+0000 7f78abfd7640 1 -- 172.21.15.114:0/4279515221 >> 172.21.15.114:0/4279515221 conn(0x7f78a40cf880 msgr2=0x7f78a40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.712+0000 7f78abfd7640 1 -- 172.21.15.114:0/4279515221 shutdown_connections 2023-11-04T01:37:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.712+0000 7f78abfd7640 1 -- 172.21.15.114:0/4279515221 wait complete. 2023-11-04T01:37:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.713+0000 7f78abfd7640 1 Processor -- start 2023-11-04T01:37:33.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.713+0000 7f78abfd7640 1 -- start start 2023-11-04T01:37:33.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.714+0000 7f78abfd7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78a40b4880 0x7f78a4145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.714+0000 7f78abfd7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78a40cd6d0 0x7f78a40c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.714+0000 7f78abfd7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78a4153e60 0x7f78a4158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.714+0000 7f78abfd7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a4159fe0 con 0x7f78a40b4880 2023-11-04T01:37:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.714+0000 7f78abfd7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40c65c0 con 0x7f78a4153e60 2023-11-04T01:37:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.714+0000 7f78abfd7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a4159100 con 0x7f78a40cd6d0 2023-11-04T01:37:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.714+0000 7f78a9d73640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78a40b4880 0x7f78a4145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.714+0000 7f78a9d73640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78a40b4880 0x7f78a4145a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45354/0 (socket says 172.21.15.114:45354) 2023-11-04T01:37:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.714+0000 7f78a9d73640 1 -- 172.21.15.114:0/2915018470 learned_addr learned my addr 172.21.15.114:0/2915018470 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.715+0000 7f78a9d73640 1 -- 172.21.15.114:0/2915018470 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78a40cd6d0 msgr2=0x7f78a40c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.715+0000 7f78aa574640 1 --2- 172.21.15.114:0/2915018470 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78a4153e60 0x7f78a4158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.715+0000 7f78a9d73640 1 --2- 172.21.15.114:0/2915018470 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78a40cd6d0 0x7f78a40c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.715+0000 7f78a9d73640 1 -- 172.21.15.114:0/2915018470 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78a4153e60 msgr2=0x7f78a4158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.715+0000 7f78a9d73640 1 --2- 172.21.15.114:0/2915018470 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78a4153e60 0x7f78a4158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.715+0000 7f78a9d73640 1 -- 172.21.15.114:0/2915018470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78940094d0 con 0x7f78a40b4880 2023-11-04T01:37:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.715+0000 7f78a9d73640 1 --2- 172.21.15.114:0/2915018470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78a40b4880 0x7f78a4145a80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f78a000c400 tx=0x7f78a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.715+0000 7f789a7fc640 1 -- 172.21.15.114:0/2915018470 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a00052d0 con 0x7f78a40b4880 2023-11-04T01:37:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.715+0000 7f789a7fc640 1 -- 172.21.15.114:0/2915018470 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a0005430 con 0x7f78a40b4880 2023-11-04T01:37:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.715+0000 7f78abfd7640 1 -- 172.21.15.114:0/2915018470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a4159360 con 0x7f78a40b4880 2023-11-04T01:37:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.715+0000 7f789a7fc640 1 -- 172.21.15.114:0/2915018470 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0003830 con 0x7f78a40b4880 2023-11-04T01:37:33.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.715+0000 7f78abfd7640 1 -- 172.21.15.114:0/2915018470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a4159920 con 0x7f78a40b4880 2023-11-04T01:37:33.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.716+0000 7f78abfd7640 1 -- 172.21.15.114:0/2915018470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a415a120 con 0x7f78a40b4880 2023-11-04T01:37:33.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.716+0000 7f789a7fc640 1 -- 172.21.15.114:0/2915018470 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f78a0003990 con 0x7f78a40b4880 2023-11-04T01:37:33.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.717+0000 7f789a7fc640 1 --2- 172.21.15.114:0/2915018470 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f788806ae70 0x7f788806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:33.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.717+0000 7f78a9572640 1 --2- 172.21.15.114:0/2915018470 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f788806ae70 0x7f788806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:33.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.717+0000 7f789a7fc640 1 -- 172.21.15.114:0/2915018470 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f78a0088e50 con 0x7f78a40b4880 2023-11-04T01:37:33.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.717+0000 7f78a9572640 1 --2- 172.21.15.114:0/2915018470 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f788806ae70 0x7f788806d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7894036000 tx=0x7f789403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:33.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.721+0000 7f789a7fc640 1 -- 172.21.15.114:0/2915018470 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78a415a120 con 0x7f78a40b4880 2023-11-04T01:37:33.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.889+0000 7f78abfd7640 1 -- 172.21.15.114:0/2915018470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f78a415a120 con 0x7f78a40b4880 2023-11-04T01:37:33.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.890+0000 7f789a7fc640 1 -- 172.21.15.114:0/2915018470 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f78a415a120 con 0x7f78a40b4880 2023-11-04T01:37:33.892 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:37:33.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.892+0000 7f78abfd7640 1 -- 172.21.15.114:0/2915018470 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f788806ae70 msgr2=0x7f788806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.892+0000 7f78abfd7640 1 --2- 172.21.15.114:0/2915018470 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f788806ae70 0x7f788806d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7894036000 tx=0x7f789403b040 comp rx=0 tx=0).stop 2023-11-04T01:37:33.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.892+0000 7f78abfd7640 1 -- 172.21.15.114:0/2915018470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78a40b4880 msgr2=0x7f78a4145a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:33.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.892+0000 7f78abfd7640 1 --2- 172.21.15.114:0/2915018470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78a40b4880 0x7f78a4145a80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f78a000c400 tx=0x7f78a000c8c0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.892+0000 7f78abfd7640 1 -- 172.21.15.114:0/2915018470 shutdown_connections 2023-11-04T01:37:33.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.892+0000 7f78abfd7640 1 --2- 172.21.15.114:0/2915018470 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f788806ae70 0x7f788806d330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.892+0000 7f78abfd7640 1 --2- 172.21.15.114:0/2915018470 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78a4153e60 0x7f78a4158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.892+0000 7f78abfd7640 1 --2- 172.21.15.114:0/2915018470 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78a40cd6d0 0x7f78a40c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.892+0000 7f78abfd7640 1 --2- 172.21.15.114:0/2915018470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78a40b4880 0x7f78a4145a80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:33.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.892+0000 7f78abfd7640 1 -- 172.21.15.114:0/2915018470 >> 172.21.15.114:0/2915018470 conn(0x7f78a40cf880 msgr2=0x7f78a415fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:33.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.892+0000 7f78abfd7640 1 -- 172.21.15.114:0/2915018470 shutdown_connections 2023-11-04T01:37:33.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:33.892+0000 7f78abfd7640 1 -- 172.21.15.114:0/2915018470 wait complete. 2023-11-04T01:37:33.904 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:34.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.004+0000 7f44ed075640 1 Processor -- start 2023-11-04T01:37:34.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.004+0000 7f44ed075640 1 -- start start 2023-11-04T01:37:34.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.005+0000 7f44ed075640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f44e8153e60 0x7f44e815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.005+0000 7f44ed075640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e80cd6d0 0x7f44e8161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.005+0000 7f44ed075640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e80cde60 con 0x7f44e80b4880 2023-11-04T01:37:34.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.005+0000 7f44ed075640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e8160f90 con 0x7f44e8153e60 2023-11-04T01:37:34.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.005+0000 7f44ed075640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e815e400 con 0x7f44e80cd6d0 2023-11-04T01:37:34.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.005+0000 7f44e759e640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f44e80b4880 0x7f44e80b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52484/0 (socket says 172.21.15.114:52484) 2023-11-04T01:37:34.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.005+0000 7f44e759e640 1 -- 172.21.15.114:0/1948204777 learned_addr learned my addr 172.21.15.114:0/1948204777 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:34.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e6d9d640 1 --2- 172.21.15.114:0/1948204777 >> v2:172.21.15.141:3300/0 conn(0x7f44e8153e60 0x7f44e815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e5d9b640 1 -- 172.21.15.114:0/1948204777 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335776152 0 0) 0x7f44e80cde60 con 0x7f44e80b4880 2023-11-04T01:37:34.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e659c640 1 --2- 172.21.15.114:0/1948204777 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e80cd6d0 0x7f44e8161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e5d9b640 1 -- 172.21.15.114:0/1948204777 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44d4003520 con 0x7f44e80b4880 2023-11-04T01:37:34.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e5d9b640 1 -- 172.21.15.114:0/1948204777 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1694361397 0 0) 0x7f44d4003520 con 0x7f44e80b4880 2023-11-04T01:37:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e5d9b640 1 -- 172.21.15.114:0/1948204777 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e80cd6d0 msgr2=0x7f44e8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e5d9b640 1 --2- 172.21.15.114:0/1948204777 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e80cd6d0 0x7f44e8161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e5d9b640 1 -- 172.21.15.114:0/1948204777 >> v2:172.21.15.141:3300/0 conn(0x7f44e8153e60 msgr2=0x7f44e815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e5d9b640 1 --2- 172.21.15.114:0/1948204777 >> v2:172.21.15.141:3300/0 conn(0x7f44e8153e60 0x7f44e815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e5d9b640 1 -- 172.21.15.114:0/1948204777 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e8161960 con 0x7f44e80b4880 2023-11-04T01:37:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e5d9b640 1 -- 172.21.15.114:0/1948204777 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f44d8001670 con 0x7f44e80b4880 2023-11-04T01:37:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e5d9b640 1 -- 172.21.15.114:0/1948204777 >> v1:172.21.15.114:6789/0 conn(0x7f44e80b4880 legacy=0x7f44e80b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e5d9b640 1 --2- 172.21.15.114:0/1948204777 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e80cd6d0 0x7f44d4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e5d9b640 1 --2- 172.21.15.114:0/1948204777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44d4003ef0 0x7f44d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e5d9b640 1 --2- 172.21.15.114:0/1948204777 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44d4004d00 0x7f44d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e5d9b640 1 -- 172.21.15.114:0/1948204777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e8160f90 con 0x7f44d4003ef0 2023-11-04T01:37:34.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e5d9b640 1 -- 172.21.15.114:0/1948204777 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e815e400 con 0x7f44d4004d00 2023-11-04T01:37:34.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e5d9b640 1 -- 172.21.15.114:0/1948204777 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d400b980 con 0x7f44e80cd6d0 2023-11-04T01:37:34.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e659c640 1 --2- 172.21.15.114:0/1948204777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44d4003ef0 0x7f44d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e6d9d640 1 --2- 172.21.15.114:0/1948204777 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e80cd6d0 0x7f44d4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e759e640 1 --2- 172.21.15.114:0/1948204777 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44d4004d00 0x7f44d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e659c640 1 -- 172.21.15.114:0/1948204777 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e80cd6d0 msgr2=0x7f44d4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e659c640 1 --2- 172.21.15.114:0/1948204777 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e80cd6d0 0x7f44d4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e659c640 1 -- 172.21.15.114:0/1948204777 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44d4004d00 msgr2=0x7f44d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e659c640 1 --2- 172.21.15.114:0/1948204777 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44d4004d00 0x7f44d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e659c640 1 -- 172.21.15.114:0/1948204777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d4003520 con 0x7f44d4003ef0 2023-11-04T01:37:34.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.006+0000 7f44e6d9d640 1 --2- 172.21.15.114:0/1948204777 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e80cd6d0 0x7f44d4003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:34.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.007+0000 7f44e659c640 1 --2- 172.21.15.114:0/1948204777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44d4003ef0 0x7f44d40047c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009ac0 tx=0x7f44d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894f1e1b2d49a23 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.007+0000 7f44e5d9b640 1 -- 172.21.15.114:0/1948204777 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d002c6b0 con 0x7f44d4003ef0 2023-11-04T01:37:34.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.007+0000 7f44e5d9b640 1 -- 172.21.15.114:0/1948204777 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d002c810 con 0x7f44d4003ef0 2023-11-04T01:37:34.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.007+0000 7f44e5d9b640 1 -- 172.21.15.114:0/1948204777 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d002cba0 con 0x7f44d4003ef0 2023-11-04T01:37:34.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.008+0000 7f44ed075640 1 -- 172.21.15.114:0/1948204777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44d4003ef0 msgr2=0x7f44d40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.008+0000 7f44ed075640 1 --2- 172.21.15.114:0/1948204777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44d4003ef0 0x7f44d40047c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009ac0 tx=0x7f44d40057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.008+0000 7f44e759e640 1 -- 172.21.15.114:0/1948204777 reap_dead start 2023-11-04T01:37:34.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.008+0000 7f44ed075640 1 -- 172.21.15.114:0/1948204777 shutdown_connections 2023-11-04T01:37:34.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.008+0000 7f44ed075640 1 -- 172.21.15.114:0/1948204777 >> 172.21.15.114:0/1948204777 conn(0x7f44e80cf880 msgr2=0x7f44e80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:34.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.008+0000 7f44ed075640 1 -- 172.21.15.114:0/1948204777 shutdown_connections 2023-11-04T01:37:34.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.008+0000 7f44ed075640 1 -- 172.21.15.114:0/1948204777 wait complete. 2023-11-04T01:37:34.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.009+0000 7f44ed075640 1 Processor -- start 2023-11-04T01:37:34.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.009+0000 7f44ed075640 1 -- start start 2023-11-04T01:37:34.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.010+0000 7f44ed075640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44d4003ef0 0x7f44e81502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.010+0000 7f44ed075640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44e80c94f0 0x7f44e815ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.010+0000 7f44ed075640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e815f160 0x7f44e81f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.010+0000 7f44ed075640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80c87c0 con 0x7f44d4003ef0 2023-11-04T01:37:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.010+0000 7f44ed075640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80c9060 con 0x7f44e80c94f0 2023-11-04T01:37:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.010+0000 7f44ed075640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e8150820 con 0x7f44e815f160 2023-11-04T01:37:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.010+0000 7f44e6d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44d4003ef0 0x7f44e81502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.010+0000 7f44e6d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44d4003ef0 0x7f44e81502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45368/0 (socket says 172.21.15.114:45368) 2023-11-04T01:37:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.010+0000 7f44e6d9d640 1 -- 172.21.15.114:0/1917505391 learned_addr learned my addr 172.21.15.114:0/1917505391 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.010+0000 7f44e659c640 1 --2- 172.21.15.114:0/1917505391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44e80c94f0 0x7f44e815ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.010+0000 7f44e759e640 1 --2- 172.21.15.114:0/1917505391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e815f160 0x7f44e81f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.010+0000 7f44e6d9d640 1 -- 172.21.15.114:0/1917505391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e815f160 msgr2=0x7f44e81f26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.010+0000 7f44e6d9d640 1 --2- 172.21.15.114:0/1917505391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e815f160 0x7f44e81f26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.010+0000 7f44e6d9d640 1 -- 172.21.15.114:0/1917505391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44e80c94f0 msgr2=0x7f44e815ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.010+0000 7f44e6d9d640 1 --2- 172.21.15.114:0/1917505391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44e80c94f0 0x7f44e815ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.010+0000 7f44e6d9d640 1 -- 172.21.15.114:0/1917505391 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e815f5e0 con 0x7f44d4003ef0 2023-11-04T01:37:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.011+0000 7f44e6d9d640 1 --2- 172.21.15.114:0/1917505391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44d4003ef0 0x7f44e81502e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f44e00101c0 tx=0x7f44e0010680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.011+0000 7f44df7fe640 1 -- 172.21.15.114:0/1917505391 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e000e050 con 0x7f44d4003ef0 2023-11-04T01:37:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.011+0000 7f44df7fe640 1 -- 172.21.15.114:0/1917505391 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e000f040 con 0x7f44d4003ef0 2023-11-04T01:37:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.011+0000 7f44ed075640 1 -- 172.21.15.114:0/1917505391 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e81f3420 con 0x7f44d4003ef0 2023-11-04T01:37:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.011+0000 7f44df7fe640 1 -- 172.21.15.114:0/1917505391 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0003bb0 con 0x7f44d4003ef0 2023-11-04T01:37:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.011+0000 7f44ed075640 1 -- 172.21.15.114:0/1917505391 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e80c8cf0 con 0x7f44d4003ef0 2023-11-04T01:37:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.012+0000 7f44ed075640 1 -- 172.21.15.114:0/1917505391 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e8074290 con 0x7f44d4003ef0 2023-11-04T01:37:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.012+0000 7f44df7fe640 1 -- 172.21.15.114:0/1917505391 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44e0003d10 con 0x7f44d4003ef0 2023-11-04T01:37:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.012+0000 7f44df7fe640 1 --2- 172.21.15.114:0/1917505391 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44c806aea0 0x7f44c806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.013+0000 7f44df7fe640 1 -- 172.21.15.114:0/1917505391 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f44e008a750 con 0x7f44d4003ef0 2023-11-04T01:37:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.013+0000 7f44e659c640 1 --2- 172.21.15.114:0/1917505391 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44c806aea0 0x7f44c806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.013+0000 7f44e659c640 1 --2- 172.21.15.114:0/1917505391 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44c806aea0 0x7f44c806d360 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f44d0036000 tx=0x7f44d0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.017+0000 7f44df7fe640 1 -- 172.21.15.114:0/1917505391 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f44e00554d0 con 0x7f44d4003ef0 2023-11-04T01:37:34.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.183+0000 7f44ed075640 1 -- 172.21.15.114:0/1917505391 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f44e80d0b80 con 0x7f44d4003ef0 2023-11-04T01:37:34.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.183+0000 7f44df7fe640 1 -- 172.21.15.114:0/1917505391 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f44e0058af0 con 0x7f44d4003ef0 2023-11-04T01:37:34.185 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:34.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.185+0000 7f44ed075640 1 -- 172.21.15.114:0/1917505391 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44c806aea0 msgr2=0x7f44c806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.185+0000 7f44ed075640 1 --2- 172.21.15.114:0/1917505391 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44c806aea0 0x7f44c806d360 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f44d0036000 tx=0x7f44d0030000 comp rx=0 tx=0).stop 2023-11-04T01:37:34.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.185+0000 7f44ed075640 1 -- 172.21.15.114:0/1917505391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44d4003ef0 msgr2=0x7f44e81502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.185+0000 7f44ed075640 1 --2- 172.21.15.114:0/1917505391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44d4003ef0 0x7f44e81502e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f44e00101c0 tx=0x7f44e0010680 comp rx=0 tx=0).stop 2023-11-04T01:37:34.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.185+0000 7f44ed075640 1 -- 172.21.15.114:0/1917505391 shutdown_connections 2023-11-04T01:37:34.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.185+0000 7f44ed075640 1 --2- 172.21.15.114:0/1917505391 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e815f160 0x7f44e81f26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.185+0000 7f44ed075640 1 --2- 172.21.15.114:0/1917505391 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44c806aea0 0x7f44c806d360 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.185+0000 7f44ed075640 1 --2- 172.21.15.114:0/1917505391 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44e80c94f0 0x7f44e815ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.185+0000 7f44ed075640 1 --2- 172.21.15.114:0/1917505391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44d4003ef0 0x7f44e81502e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.185+0000 7f44ed075640 1 -- 172.21.15.114:0/1917505391 >> 172.21.15.114:0/1917505391 conn(0x7f44e80cf880 msgr2=0x7f44e815fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:34.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.185+0000 7f44ed075640 1 -- 172.21.15.114:0/1917505391 shutdown_connections 2023-11-04T01:37:34.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.185+0000 7f44ed075640 1 -- 172.21.15.114:0/1917505391 wait complete. 2023-11-04T01:37:34.198 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:37:34.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.296+0000 7f73a4b8a640 1 Processor -- start 2023-11-04T01:37:34.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.296+0000 7f73a4b8a640 1 -- start start 2023-11-04T01:37:34.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.297+0000 7f73a4b8a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73a00c4ff0 0x7f73a00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.297+0000 7f73a4b8a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a015aff0 con 0x7f73a00adac0 2023-11-04T01:37:34.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.297+0000 7f73a4b8a640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a015a3e0 con 0x7f73a0159c00 2023-11-04T01:37:34.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.297+0000 7f73a4b8a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a015a6c0 con 0x7f73a00c4ff0 2023-11-04T01:37:34.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.297+0000 7f739ed9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f73a00adac0 0x7f73a00adf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52500/0 (socket says 172.21.15.114:52500) 2023-11-04T01:37:34.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.297+0000 7f739ed9d640 1 -- 172.21.15.114:0/1646444184 learned_addr learned my addr 172.21.15.114:0/1646444184 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.297+0000 7f739dd9b640 1 --2- 172.21.15.114:0/1646444184 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73a00c4ff0 0x7f73a00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.297+0000 7f739d59a640 1 -- 172.21.15.114:0/1646444184 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302289028 0 0) 0x7f73a015aff0 con 0x7f73a00adac0 2023-11-04T01:37:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.297+0000 7f739d59a640 1 -- 172.21.15.114:0/1646444184 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7388003520 con 0x7f73a00adac0 2023-11-04T01:37:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739d59a640 1 -- 172.21.15.114:0/1646444184 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4131581335 0 0) 0x7f7388003520 con 0x7f73a00adac0 2023-11-04T01:37:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739d59a640 1 -- 172.21.15.114:0/1646444184 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73a00c4ff0 msgr2=0x7f73a00cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739d59a640 1 --2- 172.21.15.114:0/1646444184 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73a00c4ff0 0x7f73a00cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739d59a640 1 -- 172.21.15.114:0/1646444184 >> v1:172.21.15.141:6789/0 conn(0x7f73a0159c00 legacy=0x7f73a00c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739d59a640 1 -- 172.21.15.114:0/1646444184 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a015a9a0 con 0x7f73a00adac0 2023-11-04T01:37:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739d59a640 1 -- 172.21.15.114:0/1646444184 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f7398001670 con 0x7f73a00adac0 2023-11-04T01:37:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739d59a640 1 -- 172.21.15.114:0/1646444184 >> v1:172.21.15.114:6789/0 conn(0x7f73a00adac0 legacy=0x7f73a00adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739d59a640 1 --2- 172.21.15.114:0/1646444184 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f73880039a0 0x7f7388003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739d59a640 1 --2- 172.21.15.114:0/1646444184 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73a00c4ff0 0x7f73880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739d59a640 1 --2- 172.21.15.114:0/1646444184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7388004d00 0x7f7388005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739d59a640 1 -- 172.21.15.114:0/1646444184 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a015a6c0 con 0x7f7388004d00 2023-11-04T01:37:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739d59a640 1 -- 172.21.15.114:0/1646444184 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738800b9e0 con 0x7f73880039a0 2023-11-04T01:37:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739d59a640 1 -- 172.21.15.114:0/1646444184 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738800ddb0 con 0x7f73a00c4ff0 2023-11-04T01:37:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739ed9d640 1 --2- 172.21.15.114:0/1646444184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7388004d00 0x7f7388005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739e59c640 1 --2- 172.21.15.114:0/1646444184 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f73880039a0 0x7f7388003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739dd9b640 1 --2- 172.21.15.114:0/1646444184 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73a00c4ff0 0x7f73880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739ed9d640 1 -- 172.21.15.114:0/1646444184 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73a00c4ff0 msgr2=0x7f73880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739ed9d640 1 --2- 172.21.15.114:0/1646444184 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73a00c4ff0 0x7f73880047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739ed9d640 1 -- 172.21.15.114:0/1646444184 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f73880039a0 msgr2=0x7f7388003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739ed9d640 1 --2- 172.21.15.114:0/1646444184 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f73880039a0 0x7f7388003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.298+0000 7f739ed9d640 1 -- 172.21.15.114:0/1646444184 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7388003520 con 0x7f7388004d00 2023-11-04T01:37:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.299+0000 7f739ed9d640 1 --2- 172.21.15.114:0/1646444184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7388004d00 0x7f7388005180 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f739800c240 tx=0x7f73880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2666e9afc380dfd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.299+0000 7f739d59a640 1 -- 172.21.15.114:0/1646444184 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398005ad0 con 0x7f7388004d00 2023-11-04T01:37:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.299+0000 7f739d59a640 1 -- 172.21.15.114:0/1646444184 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7398005c30 con 0x7f7388004d00 2023-11-04T01:37:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.299+0000 7f739d59a640 1 -- 172.21.15.114:0/1646444184 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739802c8a0 con 0x7f7388004d00 2023-11-04T01:37:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.299+0000 7f73a4b8a640 1 -- 172.21.15.114:0/1646444184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7388004d00 msgr2=0x7f7388005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.299+0000 7f73a4b8a640 1 --2- 172.21.15.114:0/1646444184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7388004d00 0x7f7388005180 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f739800c240 tx=0x7f73880057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.299+0000 7f739ed9d640 1 -- 172.21.15.114:0/1646444184 reap_dead start 2023-11-04T01:37:34.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.300+0000 7f73a4b8a640 1 -- 172.21.15.114:0/1646444184 shutdown_connections 2023-11-04T01:37:34.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.300+0000 7f73a4b8a640 1 -- 172.21.15.114:0/1646444184 >> 172.21.15.114:0/1646444184 conn(0x7f73a00ce950 msgr2=0x7f73a00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:34.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.300+0000 7f73a4b8a640 1 -- 172.21.15.114:0/1646444184 shutdown_connections 2023-11-04T01:37:34.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.300+0000 7f73a4b8a640 1 -- 172.21.15.114:0/1646444184 wait complete. 2023-11-04T01:37:34.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.301+0000 7f73a4b8a640 1 Processor -- start 2023-11-04T01:37:34.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.301+0000 7f73a4b8a640 1 -- start start 2023-11-04T01:37:34.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f73a4b8a640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7388004d00 0x7f73a01ef450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f73a4b8a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73a01ef990 0x7f73a00c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f73a4b8a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73a00c69b0 0x7f73a0152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f73a4b8a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a00c6e60 con 0x7f73a01ef990 2023-11-04T01:37:34.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f73a4b8a640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a00c5a20 con 0x7f7388004d00 2023-11-04T01:37:34.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f73a4b8a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a01eede0 con 0x7f73a00c69b0 2023-11-04T01:37:34.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f739dd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73a01ef990 0x7f73a00c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f739dd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73a01ef990 0x7f73a00c6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45390/0 (socket says 172.21.15.114:45390) 2023-11-04T01:37:34.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f739dd9b640 1 -- 172.21.15.114:0/3566462568 learned_addr learned my addr 172.21.15.114:0/3566462568 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:34.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f739e59c640 1 --2- 172.21.15.114:0/3566462568 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7388004d00 0x7f73a01ef450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f739ed9d640 1 --2- 172.21.15.114:0/3566462568 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73a00c69b0 0x7f73a0152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f739dd9b640 1 -- 172.21.15.114:0/3566462568 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73a00c69b0 msgr2=0x7f73a0152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f739dd9b640 1 --2- 172.21.15.114:0/3566462568 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73a00c69b0 0x7f73a0152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f739dd9b640 1 -- 172.21.15.114:0/3566462568 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7388004d00 msgr2=0x7f73a01ef450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f739dd9b640 1 --2- 172.21.15.114:0/3566462568 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7388004d00 0x7f73a01ef450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f739dd9b640 1 -- 172.21.15.114:0/3566462568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a01ef0c0 con 0x7f73a01ef990 2023-11-04T01:37:34.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f739dd9b640 1 --2- 172.21.15.114:0/3566462568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73a01ef990 0x7f73a00c6470 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7394011940 tx=0x7f7394011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f738effd640 1 -- 172.21.15.114:0/3566462568 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739400fa90 con 0x7f73a01ef990 2023-11-04T01:37:34.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f738effd640 1 -- 172.21.15.114:0/3566462568 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739400fbf0 con 0x7f73a01ef990 2023-11-04T01:37:34.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f73a4b8a640 1 -- 172.21.15.114:0/3566462568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a00c5c70 con 0x7f73a01ef990 2023-11-04T01:37:34.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f738effd640 1 -- 172.21.15.114:0/3566462568 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7394014440 con 0x7f73a01ef990 2023-11-04T01:37:34.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.302+0000 7f73a4b8a640 1 -- 172.21.15.114:0/3566462568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a0149b80 con 0x7f73a01ef990 2023-11-04T01:37:34.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.303+0000 7f73a4b8a640 1 -- 172.21.15.114:0/3566462568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a0074290 con 0x7f73a01ef990 2023-11-04T01:37:34.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.304+0000 7f738effd640 1 -- 172.21.15.114:0/3566462568 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f73940145a0 con 0x7f73a01ef990 2023-11-04T01:37:34.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.304+0000 7f738effd640 1 --2- 172.21.15.114:0/3566462568 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f738006aea0 0x7f738006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.304+0000 7f738effd640 1 -- 172.21.15.114:0/3566462568 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f739408a1e0 con 0x7f73a01ef990 2023-11-04T01:37:34.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.304+0000 7f739e59c640 1 --2- 172.21.15.114:0/3566462568 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f738006aea0 0x7f738006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.305+0000 7f739e59c640 1 --2- 172.21.15.114:0/3566462568 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f738006aea0 0x7f738006d360 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f73a01498c0 tx=0x7f7390009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.308+0000 7f738effd640 1 -- 172.21.15.114:0/3566462568 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7394055010 con 0x7f73a01ef990 2023-11-04T01:37:34.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.486+0000 7f73a4b8a640 1 -- 172.21.15.114:0/3566462568 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f73a00c46b0 con 0x7f73a01ef990 2023-11-04T01:37:34.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.487+0000 7f738effd640 1 -- 172.21.15.114:0/3566462568 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7394058630 con 0x7f73a01ef990 2023-11-04T01:37:34.489 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-11-04T01:37:34.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.488+0000 7f73a4b8a640 1 -- 172.21.15.114:0/3566462568 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f738006aea0 msgr2=0x7f738006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.488+0000 7f73a4b8a640 1 --2- 172.21.15.114:0/3566462568 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f738006aea0 0x7f738006d360 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f73a01498c0 tx=0x7f7390009040 comp rx=0 tx=0).stop 2023-11-04T01:37:34.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.489+0000 7f73a4b8a640 1 -- 172.21.15.114:0/3566462568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73a01ef990 msgr2=0x7f73a00c6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.489+0000 7f73a4b8a640 1 --2- 172.21.15.114:0/3566462568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73a01ef990 0x7f73a00c6470 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7394011940 tx=0x7f7394011e00 comp rx=0 tx=0).stop 2023-11-04T01:37:34.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.489+0000 7f73a4b8a640 1 -- 172.21.15.114:0/3566462568 shutdown_connections 2023-11-04T01:37:34.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.489+0000 7f73a4b8a640 1 --2- 172.21.15.114:0/3566462568 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73a00c69b0 0x7f73a0152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.489+0000 7f73a4b8a640 1 --2- 172.21.15.114:0/3566462568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73a01ef990 0x7f73a00c6470 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.489+0000 7f73a4b8a640 1 --2- 172.21.15.114:0/3566462568 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f738006aea0 0x7f738006d360 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.489+0000 7f73a4b8a640 1 --2- 172.21.15.114:0/3566462568 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7388004d00 0x7f73a01ef450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.489+0000 7f73a4b8a640 1 -- 172.21.15.114:0/3566462568 >> 172.21.15.114:0/3566462568 conn(0x7f73a00ce950 msgr2=0x7f73a00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:34.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.489+0000 7f73a4b8a640 1 -- 172.21.15.114:0/3566462568 shutdown_connections 2023-11-04T01:37:34.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.489+0000 7f73a4b8a640 1 -- 172.21.15.114:0/3566462568 wait complete. 2023-11-04T01:37:34.501 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:37:34.501 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:37:34.520 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:34.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.620+0000 7fe7877f5640 1 Processor -- start 2023-11-04T01:37:34.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.620+0000 7fe7877f5640 1 -- start start 2023-11-04T01:37:34.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.621+0000 7fe7877f5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe780160b10 0x7fe780160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.621+0000 7fe7877f5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78006bf00 con 0x7fe7800cf160 2023-11-04T01:37:34.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.621+0000 7fe7877f5640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7801615d0 con 0x7fe78015ce60 2023-11-04T01:37:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.621+0000 7fe7877f5640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7800cbde0 con 0x7fe780160b10 2023-11-04T01:37:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.621+0000 7fe785d92640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe7800cf160 0x7fe7800cc200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52516/0 (socket says 172.21.15.114:52516) 2023-11-04T01:37:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.621+0000 7fe785d92640 1 -- 172.21.15.114:0/3617758358 learned_addr learned my addr 172.21.15.114:0/3617758358 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.621+0000 7fe777fff640 1 -- 172.21.15.114:0/3617758358 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770825434 0 0) 0x7fe78006bf00 con 0x7fe7800cf160 2023-11-04T01:37:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.621+0000 7fe777fff640 1 -- 172.21.15.114:0/3617758358 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe76c003520 con 0x7fe7800cf160 2023-11-04T01:37:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.621+0000 7fe784d90640 1 --2- 172.21.15.114:0/3617758358 >> v2:172.21.15.141:3300/0 conn(0x7fe780160b10 0x7fe780160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe777fff640 1 -- 172.21.15.114:0/3617758358 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4078970105 0 0) 0x7fe76c003520 con 0x7fe7800cf160 2023-11-04T01:37:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe777fff640 1 -- 172.21.15.114:0/3617758358 >> v2:172.21.15.141:3300/0 conn(0x7fe780160b10 msgr2=0x7fe780160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe777fff640 1 --2- 172.21.15.114:0/3617758358 >> v2:172.21.15.141:3300/0 conn(0x7fe780160b10 0x7fe780160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe777fff640 1 -- 172.21.15.114:0/3617758358 >> v1:172.21.15.141:6789/0 conn(0x7fe78015ce60 legacy=0x7fe78006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe777fff640 1 -- 172.21.15.114:0/3617758358 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7801618b0 con 0x7fe7800cf160 2023-11-04T01:37:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe777fff640 1 -- 172.21.15.114:0/3617758358 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fe7780019f0 con 0x7fe7800cf160 2023-11-04T01:37:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe777fff640 1 -- 172.21.15.114:0/3617758358 >> v1:172.21.15.114:6789/0 conn(0x7fe7800cf160 legacy=0x7fe7800cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe777fff640 1 --2- 172.21.15.114:0/3617758358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe76c003970 0x7fe76c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe777fff640 1 --2- 172.21.15.114:0/3617758358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe76c0047c0 0x7fe76c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe777fff640 1 --2- 172.21.15.114:0/3617758358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe76c005180 0x7fe76c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe777fff640 1 -- 172.21.15.114:0/3617758358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800cbde0 con 0x7fe76c003970 2023-11-04T01:37:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe777fff640 1 -- 172.21.15.114:0/3617758358 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c00c020 con 0x7fe76c0047c0 2023-11-04T01:37:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe777fff640 1 -- 172.21.15.114:0/3617758358 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c00c1e0 con 0x7fe76c005180 2023-11-04T01:37:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe785591640 1 --2- 172.21.15.114:0/3617758358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe76c003970 0x7fe76c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe784d90640 1 --2- 172.21.15.114:0/3617758358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe76c0047c0 0x7fe76c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe785d92640 1 --2- 172.21.15.114:0/3617758358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe76c005180 0x7fe76c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe785591640 1 -- 172.21.15.114:0/3617758358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe76c005180 msgr2=0x7fe76c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe785591640 1 --2- 172.21.15.114:0/3617758358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe76c005180 0x7fe76c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe785591640 1 -- 172.21.15.114:0/3617758358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe76c0047c0 msgr2=0x7fe76c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe785591640 1 --2- 172.21.15.114:0/3617758358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe76c0047c0 0x7fe76c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe785591640 1 -- 172.21.15.114:0/3617758358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c003520 con 0x7fe76c003970 2023-11-04T01:37:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe785d92640 1 --2- 172.21.15.114:0/3617758358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe76c005180 0x7fe76c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.622+0000 7fe785d92640 1 -- 172.21.15.114:0/3617758358 reap_dead start 2023-11-04T01:37:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.623+0000 7fe785591640 1 --2- 172.21.15.114:0/3617758358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe76c003970 0x7fe76c003d90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe77c001750 tx=0x7fe76c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f80ab1752d55df server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.623+0000 7fe777fff640 1 -- 172.21.15.114:0/3617758358 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c0052d0 con 0x7fe76c003970 2023-11-04T01:37:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.623+0000 7fe777fff640 1 -- 172.21.15.114:0/3617758358 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c02e050 con 0x7fe76c003970 2023-11-04T01:37:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.623+0000 7fe777fff640 1 -- 172.21.15.114:0/3617758358 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c003830 con 0x7fe76c003970 2023-11-04T01:37:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.623+0000 7fe7877f5640 1 -- 172.21.15.114:0/3617758358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe76c003970 msgr2=0x7fe76c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.623+0000 7fe7877f5640 1 --2- 172.21.15.114:0/3617758358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe76c003970 0x7fe76c003d90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe77c001750 tx=0x7fe76c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.623+0000 7fe7877f5640 1 -- 172.21.15.114:0/3617758358 shutdown_connections 2023-11-04T01:37:34.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.623+0000 7fe7877f5640 1 --2- 172.21.15.114:0/3617758358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe76c003970 0x7fe76c003d90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.623+0000 7fe7877f5640 1 -- 172.21.15.114:0/3617758358 >> 172.21.15.114:0/3617758358 conn(0x7fe78006ea90 msgr2=0x7fe78006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:34.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.623+0000 7fe7877f5640 1 -- 172.21.15.114:0/3617758358 shutdown_connections 2023-11-04T01:37:34.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.624+0000 7fe7877f5640 1 -- 172.21.15.114:0/3617758358 wait complete. 2023-11-04T01:37:34.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.625+0000 7fe7877f5640 1 Processor -- start 2023-11-04T01:37:34.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.625+0000 7fe7877f5640 1 -- start start 2023-11-04T01:37:34.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.625+0000 7fe7877f5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe76c003970 0x7fe7801f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.625+0000 7fe7877f5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7800c9e80 0x7fe7800c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.625+0000 7fe7877f5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7800abbf0 0x7fe7800ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.625+0000 7fe7877f5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800ca300 con 0x7fe76c003970 2023-11-04T01:37:34.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.625+0000 7fe7877f5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800b4c60 con 0x7fe7800abbf0 2023-11-04T01:37:34.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.625+0000 7fe7877f5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800ac5b0 con 0x7fe7800c9e80 2023-11-04T01:37:34.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.625+0000 7fe785591640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe76c003970 0x7fe7801f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.625+0000 7fe785591640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe76c003970 0x7fe7801f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45408/0 (socket says 172.21.15.114:45408) 2023-11-04T01:37:34.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.626+0000 7fe785591640 1 -- 172.21.15.114:0/2596637854 learned_addr learned my addr 172.21.15.114:0/2596637854 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:34.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.626+0000 7fe784d90640 1 --2- 172.21.15.114:0/2596637854 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7800c9e80 0x7fe7800c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.626+0000 7fe785d92640 1 --2- 172.21.15.114:0/2596637854 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7800abbf0 0x7fe7800ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.626+0000 7fe785591640 1 -- 172.21.15.114:0/2596637854 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7800c9e80 msgr2=0x7fe7800c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.626+0000 7fe785591640 1 --2- 172.21.15.114:0/2596637854 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7800c9e80 0x7fe7800c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.626+0000 7fe785591640 1 -- 172.21.15.114:0/2596637854 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7800abbf0 msgr2=0x7fe7800ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.626+0000 7fe785591640 1 --2- 172.21.15.114:0/2596637854 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7800abbf0 0x7fe7800ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.626+0000 7fe785591640 1 -- 172.21.15.114:0/2596637854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7800c91b0 con 0x7fe76c003970 2023-11-04T01:37:34.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.626+0000 7fe785591640 1 --2- 172.21.15.114:0/2596637854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe76c003970 0x7fe7801f22d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe77c02bc00 tx=0x7fe77c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.626+0000 7fe775ffb640 1 -- 172.21.15.114:0/2596637854 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c0076c0 con 0x7fe76c003970 2023-11-04T01:37:34.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.626+0000 7fe775ffb640 1 -- 172.21.15.114:0/2596637854 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c007a30 con 0x7fe76c003970 2023-11-04T01:37:34.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.626+0000 7fe775ffb640 1 -- 172.21.15.114:0/2596637854 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c006be0 con 0x7fe76c003970 2023-11-04T01:37:34.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.626+0000 7fe7877f5640 1 -- 172.21.15.114:0/2596637854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7800cad90 con 0x7fe76c003970 2023-11-04T01:37:34.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.626+0000 7fe7877f5640 1 -- 172.21.15.114:0/2596637854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7800ca7d0 con 0x7fe76c003970 2023-11-04T01:37:34.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.627+0000 7fe7877f5640 1 -- 172.21.15.114:0/2596637854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7800ce950 con 0x7fe76c003970 2023-11-04T01:37:34.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.628+0000 7fe775ffb640 1 -- 172.21.15.114:0/2596637854 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe77c006d40 con 0x7fe76c003970 2023-11-04T01:37:34.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.628+0000 7fe775ffb640 1 --2- 172.21.15.114:0/2596637854 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe76406ae70 0x7fe76406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.628+0000 7fe775ffb640 1 -- 172.21.15.114:0/2596637854 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe77c0ab380 con 0x7fe76c003970 2023-11-04T01:37:34.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.628+0000 7fe784d90640 1 --2- 172.21.15.114:0/2596637854 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe76406ae70 0x7fe76406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.629+0000 7fe784d90640 1 --2- 172.21.15.114:0/2596637854 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe76406ae70 0x7fe76406d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe780151d10 tx=0x7fe770008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.632+0000 7fe775ffb640 1 -- 172.21.15.114:0/2596637854 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7800ce950 con 0x7fe76c003970 2023-11-04T01:37:34.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.800+0000 7fe7877f5640 1 -- 172.21.15.114:0/2596637854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7800ce950 con 0x7fe76c003970 2023-11-04T01:37:34.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.801+0000 7fe775ffb640 1 -- 172.21.15.114:0/2596637854 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18796 (secure 0 0 0) 0x7fe7800ce950 con 0x7fe76c003970 2023-11-04T01:37:34.803 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:34.803 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:11.562429+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:34.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.803+0000 7fe7877f5640 1 -- 172.21.15.114:0/2596637854 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe76406ae70 msgr2=0x7fe76406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.803+0000 7fe7877f5640 1 --2- 172.21.15.114:0/2596637854 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe76406ae70 0x7fe76406d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe780151d10 tx=0x7fe770008040 comp rx=0 tx=0).stop 2023-11-04T01:37:34.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.803+0000 7fe7877f5640 1 -- 172.21.15.114:0/2596637854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe76c003970 msgr2=0x7fe7801f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.803+0000 7fe7877f5640 1 --2- 172.21.15.114:0/2596637854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe76c003970 0x7fe7801f22d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe77c02bc00 tx=0x7fe77c001120 comp rx=0 tx=0).stop 2023-11-04T01:37:34.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.803+0000 7fe7877f5640 1 -- 172.21.15.114:0/2596637854 shutdown_connections 2023-11-04T01:37:34.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.803+0000 7fe7877f5640 1 --2- 172.21.15.114:0/2596637854 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe76406ae70 0x7fe76406d330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.803+0000 7fe7877f5640 1 --2- 172.21.15.114:0/2596637854 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7800abbf0 0x7fe7800ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.803+0000 7fe7877f5640 1 --2- 172.21.15.114:0/2596637854 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7800c9e80 0x7fe7800c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.803+0000 7fe7877f5640 1 --2- 172.21.15.114:0/2596637854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe76c003970 0x7fe7801f22d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.803+0000 7fe7877f5640 1 -- 172.21.15.114:0/2596637854 >> 172.21.15.114:0/2596637854 conn(0x7fe78006ea90 msgr2=0x7fe78006c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:34.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.803+0000 7fe7877f5640 1 -- 172.21.15.114:0/2596637854 shutdown_connections 2023-11-04T01:37:34.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.803+0000 7fe7877f5640 1 -- 172.21.15.114:0/2596637854 wait complete. 2023-11-04T01:37:34.816 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:34.816 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:34.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.917+0000 7f1ba242b640 1 Processor -- start 2023-11-04T01:37:34.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.917+0000 7f1ba242b640 1 -- start start 2023-11-04T01:37:34.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.918+0000 7f1ba242b640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1b9c15ad30 0x7f1b9c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.918+0000 7f1ba242b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9c0c3900 con 0x7f1b9c0ad730 2023-11-04T01:37:34.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.918+0000 7f1ba242b640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9c0c3be0 con 0x7f1b9c070e20 2023-11-04T01:37:34.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.918+0000 7f1ba242b640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9c0ae260 con 0x7f1b9c15ad30 2023-11-04T01:37:34.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.918+0000 7f1b9b7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1b9c0ad730 0x7f1b9c070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52532/0 (socket says 172.21.15.114:52532) 2023-11-04T01:37:34.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.918+0000 7f1b9b7fe640 1 -- 172.21.15.114:0/4104148441 learned_addr learned my addr 172.21.15.114:0/4104148441 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:34.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.918+0000 7f1b9bfff640 1 --2- 172.21.15.114:0/4104148441 >> v2:172.21.15.141:3300/0 conn(0x7f1b9c15ad30 0x7f1b9c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.918+0000 7f1b9affd640 1 -- 172.21.15.114:0/4104148441 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691463462 0 0) 0x7f1b9c0c3900 con 0x7f1b9c0ad730 2023-11-04T01:37:34.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.918+0000 7f1b9affd640 1 -- 172.21.15.114:0/4104148441 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b84003520 con 0x7f1b9c0ad730 2023-11-04T01:37:34.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.918+0000 7f1b9affd640 1 -- 172.21.15.114:0/4104148441 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 398371271 0 0) 0x7f1b84003520 con 0x7f1b9c0ad730 2023-11-04T01:37:34.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.918+0000 7f1b9bfff640 1 -- 172.21.15.114:0/4104148441 >> v1:172.21.15.141:6789/0 conn(0x7f1b9c070e20 legacy=0x7f1b9c15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.918+0000 7f1b9bfff640 1 -- 172.21.15.114:0/4104148441 >> v1:172.21.15.114:6789/0 conn(0x7f1b9c0ad730 legacy=0x7f1b9c070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.918+0000 7f1b9bfff640 1 -- 172.21.15.114:0/4104148441 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c0c3ec0 con 0x7f1b9c15ad30 2023-11-04T01:37:34.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.919+0000 7f1b9bfff640 1 --2- 172.21.15.114:0/4104148441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b9c15ad30 0x7f1b9c0adc80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0097a0 tx=0x7f1b8c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5beb43f5f5c9ebfe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.919+0000 7f1b9affd640 1 -- 172.21.15.114:0/4104148441 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90001670 con 0x7f1b9c15ad30 2023-11-04T01:37:34.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.919+0000 7f1b9affd640 1 -- 172.21.15.114:0/4104148441 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c02e050 con 0x7f1b9c15ad30 2023-11-04T01:37:34.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.919+0000 7f1b9affd640 1 -- 172.21.15.114:0/4104148441 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c030730 con 0x7f1b9c15ad30 2023-11-04T01:37:34.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.920+0000 7f1ba242b640 1 -- 172.21.15.114:0/4104148441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b9c15ad30 msgr2=0x7f1b9c0adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.920+0000 7f1ba242b640 1 --2- 172.21.15.114:0/4104148441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b9c15ad30 0x7f1b9c0adc80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0097a0 tx=0x7f1b8c02b790 comp rx=0 tx=0).stop 2023-11-04T01:37:34.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.920+0000 7f1ba242b640 1 -- 172.21.15.114:0/4104148441 shutdown_connections 2023-11-04T01:37:34.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.920+0000 7f1ba242b640 1 --2- 172.21.15.114:0/4104148441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b9c15ad30 0x7f1b9c0adc80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.920+0000 7f1ba242b640 1 -- 172.21.15.114:0/4104148441 >> 172.21.15.114:0/4104148441 conn(0x7f1b9c0ce950 msgr2=0x7f1b9c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:34.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.920+0000 7f1ba242b640 1 -- 172.21.15.114:0/4104148441 shutdown_connections 2023-11-04T01:37:34.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.920+0000 7f1ba242b640 1 -- 172.21.15.114:0/4104148441 wait complete. 2023-11-04T01:37:34.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.921+0000 7f1ba242b640 1 Processor -- start 2023-11-04T01:37:34.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.921+0000 7f1ba242b640 1 -- start start 2023-11-04T01:37:34.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1ba242b640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b9c070e20 0x7f1b9c15c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1ba242b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b9c0ad730 0x7f1b9c1462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1ba242b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b9c15ad30 0x7f1b9c15d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1ba242b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c15c1b0 con 0x7f1b9c15ad30 2023-11-04T01:37:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1ba242b640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c146800 con 0x7f1b9c070e20 2023-11-04T01:37:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1ba242b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c15b5a0 con 0x7f1b9c0ad730 2023-11-04T01:37:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1ba09c8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b9c15ad30 0x7f1b9c15d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1ba09c8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b9c15ad30 0x7f1b9c15d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45420/0 (socket says 172.21.15.114:45420) 2023-11-04T01:37:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1ba09c8640 1 -- 172.21.15.114:0/2261742105 learned_addr learned my addr 172.21.15.114:0/2261742105 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1b9bfff640 1 --2- 172.21.15.114:0/2261742105 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b9c070e20 0x7f1b9c15c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1b9b7fe640 1 --2- 172.21.15.114:0/2261742105 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b9c0ad730 0x7f1b9c1462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1ba09c8640 1 -- 172.21.15.114:0/2261742105 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b9c0ad730 msgr2=0x7f1b9c1462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1ba09c8640 1 --2- 172.21.15.114:0/2261742105 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b9c0ad730 0x7f1b9c1462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1ba09c8640 1 -- 172.21.15.114:0/2261742105 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b9c070e20 msgr2=0x7f1b9c15c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:34.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1ba09c8640 1 --2- 172.21.15.114:0/2261742105 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b9c070e20 0x7f1b9c15c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:34.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1ba09c8640 1 -- 172.21.15.114:0/2261742105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c009400 con 0x7f1b9c15ad30 2023-11-04T01:37:34.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1b9bfff640 1 --2- 172.21.15.114:0/2261742105 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b9c070e20 0x7f1b9c15c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:34.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1ba09c8640 1 --2- 172.21.15.114:0/2261742105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b9c15ad30 0x7f1b9c15d3f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1b9400c7a0 tx=0x7f1b9400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1b98ff9640 1 -- 172.21.15.114:0/2261742105 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94003b70 con 0x7f1b9c15ad30 2023-11-04T01:37:34.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1b98ff9640 1 -- 172.21.15.114:0/2261742105 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b94003cf0 con 0x7f1b9c15ad30 2023-11-04T01:37:34.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1b98ff9640 1 -- 172.21.15.114:0/2261742105 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94003ea0 con 0x7f1b9c15ad30 2023-11-04T01:37:34.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.922+0000 7f1ba242b640 1 -- 172.21.15.114:0/2261742105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9c15b880 con 0x7f1b9c15ad30 2023-11-04T01:37:34.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.923+0000 7f1ba242b640 1 -- 172.21.15.114:0/2261742105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c15be40 con 0x7f1b9c15ad30 2023-11-04T01:37:34.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.924+0000 7f1ba242b640 1 -- 172.21.15.114:0/2261742105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c074290 con 0x7f1b9c15ad30 2023-11-04T01:37:34.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.924+0000 7f1b98ff9640 1 -- 172.21.15.114:0/2261742105 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b9400aa90 con 0x7f1b9c15ad30 2023-11-04T01:37:34.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.924+0000 7f1b98ff9640 1 --2- 172.21.15.114:0/2261742105 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1b8806ae70 0x7f1b8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:34.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.925+0000 7f1b9bfff640 1 --2- 172.21.15.114:0/2261742105 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1b8806ae70 0x7f1b8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:34.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.925+0000 7f1b98ff9640 1 -- 172.21.15.114:0/2261742105 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1b94089900 con 0x7f1b9c15ad30 2023-11-04T01:37:34.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.925+0000 7f1b9bfff640 1 --2- 172.21.15.114:0/2261742105 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1b8806ae70 0x7f1b8806d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c034000 tx=0x7f1b8c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:34.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:34.929+0000 7f1b98ff9640 1 -- 172.21.15.114:0/2261742105 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1b94054560 con 0x7f1b9c15ad30 2023-11-04T01:37:35.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.093+0000 7f1ba242b640 1 -- 172.21.15.114:0/2261742105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b9c15c2f0 con 0x7f1b9c15ad30 2023-11-04T01:37:35.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.094+0000 7f1b98ff9640 1 -- 172.21.15.114:0/2261742105 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b94057b80 con 0x7f1b9c15ad30 2023-11-04T01:37:35.098 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:37:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.096+0000 7f1ba242b640 1 -- 172.21.15.114:0/2261742105 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1b8806ae70 msgr2=0x7f1b8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.096+0000 7f1ba242b640 1 --2- 172.21.15.114:0/2261742105 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1b8806ae70 0x7f1b8806d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c034000 tx=0x7f1b8c02f000 comp rx=0 tx=0).stop 2023-11-04T01:37:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.096+0000 7f1ba242b640 1 -- 172.21.15.114:0/2261742105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b9c15ad30 msgr2=0x7f1b9c15d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.096+0000 7f1ba242b640 1 --2- 172.21.15.114:0/2261742105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b9c15ad30 0x7f1b9c15d3f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1b9400c7a0 tx=0x7f1b9400cc60 comp rx=0 tx=0).stop 2023-11-04T01:37:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.096+0000 7f1ba242b640 1 -- 172.21.15.114:0/2261742105 shutdown_connections 2023-11-04T01:37:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.096+0000 7f1ba242b640 1 --2- 172.21.15.114:0/2261742105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b9c15ad30 0x7f1b9c15d3f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.096+0000 7f1ba242b640 1 --2- 172.21.15.114:0/2261742105 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1b9c0ad730 0x7f1b9c1462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.096+0000 7f1ba242b640 1 --2- 172.21.15.114:0/2261742105 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1b8806ae70 0x7f1b8806d330 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.096+0000 7f1ba242b640 1 --2- 172.21.15.114:0/2261742105 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1b9c070e20 0x7f1b9c15c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.096+0000 7f1ba242b640 1 -- 172.21.15.114:0/2261742105 >> 172.21.15.114:0/2261742105 conn(0x7f1b9c0ce950 msgr2=0x7f1b9c159da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:35.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.096+0000 7f1ba242b640 1 -- 172.21.15.114:0/2261742105 shutdown_connections 2023-11-04T01:37:35.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.096+0000 7f1ba242b640 1 -- 172.21.15.114:0/2261742105 wait complete. 2023-11-04T01:37:35.109 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:35.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.209+0000 7f39c0232640 1 Processor -- start 2023-11-04T01:37:35.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.209+0000 7f39c0232640 1 -- start start 2023-11-04T01:37:35.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.210+0000 7f39c0232640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b80c4ff0 0x7f39b80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.210+0000 7f39c0232640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f39b80adac0 0x7f39b80adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.210+0000 7f39c0232640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b815aff0 con 0x7f39b8159c00 2023-11-04T01:37:35.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.210+0000 7f39c0232640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b80ae450 con 0x7f39b80adac0 2023-11-04T01:37:35.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.210+0000 7f39c0232640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b815a3e0 con 0x7f39b80c4ff0 2023-11-04T01:37:35.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.210+0000 7f39bd7cd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b80c4ff0 0x7f39b80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.210+0000 7f39be7cf640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f39b80adac0 0x7f39b80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.210+0000 7f39bdfce640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f39b8159c00 0x7f39b80c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:52214/0 (socket says 172.21.15.114:52214) 2023-11-04T01:37:35.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.210+0000 7f39bdfce640 1 -- 172.21.15.114:0/3490145024 learned_addr learned my addr 172.21.15.114:0/3490145024 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:35.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.210+0000 7f39be7cf640 1 -- 172.21.15.114:0/3490145024 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b80c4ff0 msgr2=0x7f39b80cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:35.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.210+0000 7f39be7cf640 1 --2- 172.21.15.114:0/3490145024 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b80c4ff0 0x7f39b80cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.210+0000 7f39be7cf640 1 -- 172.21.15.114:0/3490145024 >> v1:172.21.15.141:6789/0 conn(0x7f39b8159c00 legacy=0x7f39b80c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.210+0000 7f39be7cf640 1 -- 172.21.15.114:0/3490145024 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b815a6c0 con 0x7f39b80adac0 2023-11-04T01:37:35.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.210+0000 7f39bd7cd640 1 --2- 172.21.15.114:0/3490145024 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b80c4ff0 0x7f39b80cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:35.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.211+0000 7f39be7cf640 1 --2- 172.21.15.114:0/3490145024 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39b80adac0 0x7f39b80adf10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009d90 tx=0x7f39b002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7b7307458c36f68 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.211+0000 7f39bcfcc640 1 -- 172.21.15.114:0/3490145024 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b002cc50 con 0x7f39b80adac0 2023-11-04T01:37:35.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.211+0000 7f39bcfcc640 1 -- 172.21.15.114:0/3490145024 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b002cdb0 con 0x7f39b80adac0 2023-11-04T01:37:35.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.211+0000 7f39bcfcc640 1 -- 172.21.15.114:0/3490145024 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0034660 con 0x7f39b80adac0 2023-11-04T01:37:35.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.212+0000 7f39c0232640 1 -- 172.21.15.114:0/3490145024 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39b80adac0 msgr2=0x7f39b80adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.212+0000 7f39c0232640 1 --2- 172.21.15.114:0/3490145024 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39b80adac0 0x7f39b80adf10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009d90 tx=0x7f39b002bea0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.212+0000 7f39c0232640 1 -- 172.21.15.114:0/3490145024 shutdown_connections 2023-11-04T01:37:35.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.212+0000 7f39c0232640 1 --2- 172.21.15.114:0/3490145024 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39b80adac0 0x7f39b80adf10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.212+0000 7f39c0232640 1 --2- 172.21.15.114:0/3490145024 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b80c4ff0 0x7f39b80cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.212+0000 7f39c0232640 1 -- 172.21.15.114:0/3490145024 >> 172.21.15.114:0/3490145024 conn(0x7f39b80ce950 msgr2=0x7f39b80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:35.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.212+0000 7f39c0232640 1 -- 172.21.15.114:0/3490145024 shutdown_connections 2023-11-04T01:37:35.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.212+0000 7f39c0232640 1 -- 172.21.15.114:0/3490145024 wait complete. 2023-11-04T01:37:35.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.213+0000 7f39c0232640 1 Processor -- start 2023-11-04T01:37:35.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.213+0000 7f39c0232640 1 -- start start 2023-11-04T01:37:35.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39c0232640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b80adac0 0x7f39b81f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39c0232640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39b80c4ff0 0x7f39b81f0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39c0232640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b8159c00 0x7f39b80acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39c0232640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8150fe0 con 0x7f39b80adac0 2023-11-04T01:37:35.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39c0232640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b81f0ca0 con 0x7f39b80c4ff0 2023-11-04T01:37:35.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39c0232640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b81f0f70 con 0x7f39b8159c00 2023-11-04T01:37:35.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39bdfce640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b80adac0 0x7f39b81f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39bdfce640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b80adac0 0x7f39b81f4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45426/0 (socket says 172.21.15.114:45426) 2023-11-04T01:37:35.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39bdfce640 1 -- 172.21.15.114:0/2887271778 learned_addr learned my addr 172.21.15.114:0/2887271778 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:35.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39bd7cd640 1 --2- 172.21.15.114:0/2887271778 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39b80c4ff0 0x7f39b81f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39bdfce640 1 -- 172.21.15.114:0/2887271778 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b8159c00 msgr2=0x7f39b80acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39be7cf640 1 --2- 172.21.15.114:0/2887271778 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b8159c00 0x7f39b80acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39bdfce640 1 --2- 172.21.15.114:0/2887271778 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b8159c00 0x7f39b80acf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39bdfce640 1 -- 172.21.15.114:0/2887271778 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39b80c4ff0 msgr2=0x7f39b81f0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39bdfce640 1 --2- 172.21.15.114:0/2887271778 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39b80c4ff0 0x7f39b81f0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39bdfce640 1 -- 172.21.15.114:0/2887271778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a8009400 con 0x7f39b80adac0 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.214+0000 7f39bd7cd640 1 --2- 172.21.15.114:0/2887271778 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39b80c4ff0 0x7f39b81f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.215+0000 7f39bdfce640 1 --2- 172.21.15.114:0/2887271778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b80adac0 0x7f39b81f4860 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c480 tx=0x7f39b400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.215+0000 7f39ae7fc640 1 -- 172.21.15.114:0/2887271778 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4005ce0 con 0x7f39b80adac0 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.215+0000 7f39ae7fc640 1 -- 172.21.15.114:0/2887271778 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b4005e40 con 0x7f39b80adac0 2023-11-04T01:37:35.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.215+0000 7f39c0232640 1 -- 172.21.15.114:0/2887271778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b0009a70 con 0x7f39b80adac0 2023-11-04T01:37:35.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.215+0000 7f39ae7fc640 1 -- 172.21.15.114:0/2887271778 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b40072f0 con 0x7f39b80adac0 2023-11-04T01:37:35.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.215+0000 7f39c0232640 1 -- 172.21.15.114:0/2887271778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b81f1530 con 0x7f39b80adac0 2023-11-04T01:37:35.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.216+0000 7f39c0232640 1 -- 172.21.15.114:0/2887271778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b8074290 con 0x7f39b80adac0 2023-11-04T01:37:35.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.216+0000 7f39ae7fc640 1 -- 172.21.15.114:0/2887271778 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f39b4007510 con 0x7f39b80adac0 2023-11-04T01:37:35.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.216+0000 7f39ae7fc640 1 --2- 172.21.15.114:0/2887271778 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f399c06ae70 0x7f399c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.217+0000 7f39ae7fc640 1 -- 172.21.15.114:0/2887271778 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f39b4088e00 con 0x7f39b80adac0 2023-11-04T01:37:35.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.217+0000 7f39bd7cd640 1 --2- 172.21.15.114:0/2887271778 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f399c06ae70 0x7f399c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.217+0000 7f39bd7cd640 1 --2- 172.21.15.114:0/2887271778 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f399c06ae70 0x7f399c06d330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f39b8156e30 tx=0x7f39a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.221+0000 7f39ae7fc640 1 -- 172.21.15.114:0/2887271778 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39b4053c30 con 0x7f39b80adac0 2023-11-04T01:37:35.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.385+0000 7f39c0232640 1 -- 172.21.15.114:0/2887271778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39b80cda00 con 0x7f39b80adac0 2023-11-04T01:37:35.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.386+0000 7f39ae7fc640 1 -- 172.21.15.114:0/2887271778 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f39b4057250 con 0x7f39b80adac0 2023-11-04T01:37:35.388 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:35.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.387+0000 7f39c0232640 1 -- 172.21.15.114:0/2887271778 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f399c06ae70 msgr2=0x7f399c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.387+0000 7f39c0232640 1 --2- 172.21.15.114:0/2887271778 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f399c06ae70 0x7f399c06d330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f39b8156e30 tx=0x7f39a8008040 comp rx=0 tx=0).stop 2023-11-04T01:37:35.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.387+0000 7f39c0232640 1 -- 172.21.15.114:0/2887271778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b80adac0 msgr2=0x7f39b81f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.387+0000 7f39c0232640 1 --2- 172.21.15.114:0/2887271778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b80adac0 0x7f39b81f4860 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c480 tx=0x7f39b400c940 comp rx=0 tx=0).stop 2023-11-04T01:37:35.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.388+0000 7f39c0232640 1 -- 172.21.15.114:0/2887271778 shutdown_connections 2023-11-04T01:37:35.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.388+0000 7f39c0232640 1 --2- 172.21.15.114:0/2887271778 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b8159c00 0x7f39b80acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.388+0000 7f39c0232640 1 --2- 172.21.15.114:0/2887271778 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f399c06ae70 0x7f399c06d330 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.388+0000 7f39c0232640 1 --2- 172.21.15.114:0/2887271778 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39b80c4ff0 0x7f39b81f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.388+0000 7f39c0232640 1 --2- 172.21.15.114:0/2887271778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b80adac0 0x7f39b81f4860 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.388+0000 7f39c0232640 1 -- 172.21.15.114:0/2887271778 >> 172.21.15.114:0/2887271778 conn(0x7f39b80ce950 msgr2=0x7f39b80c45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:35.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.388+0000 7f39c0232640 1 -- 172.21.15.114:0/2887271778 shutdown_connections 2023-11-04T01:37:35.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.388+0000 7f39c0232640 1 -- 172.21.15.114:0/2887271778 wait complete. 2023-11-04T01:37:35.400 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:35.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.500+0000 7fe529b89640 1 Processor -- start 2023-11-04T01:37:35.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.500+0000 7fe529b89640 1 -- start start 2023-11-04T01:37:35.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.501+0000 7fe529b89640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe524153e60 0x7fe52415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.501+0000 7fe529b89640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe5240cd6d0 0x7fe524161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.501+0000 7fe529b89640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5240cde60 con 0x7fe5240b4880 2023-11-04T01:37:35.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.501+0000 7fe529b89640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe524160f90 con 0x7fe5240cd6d0 2023-11-04T01:37:35.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.501+0000 7fe529b89640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52415e400 con 0x7fe524153e60 2023-11-04T01:37:35.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.502+0000 7fe5237fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe524153e60 0x7fe52415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.502+0000 7fe522ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe5240cd6d0 0x7fe524161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.502+0000 7fe5237fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe524153e60 0x7fe52415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:35946/0 (socket says 172.21.15.114:35946) 2023-11-04T01:37:35.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.502+0000 7fe522ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe5240cd6d0 0x7fe524161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:54678/0 (socket says 172.21.15.114:54678) 2023-11-04T01:37:35.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.502+0000 7fe5237fe640 1 -- 172.21.15.114:0/3000435043 learned_addr learned my addr 172.21.15.114:0/3000435043 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:35.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.502+0000 7fe523fff640 1 --1- 172.21.15.114:0/3000435043 >> v1:172.21.15.141:6789/0 conn(0x7fe5240b4880 0x7fe52406b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:52220/0 (socket says 172.21.15.114:52220) 2023-11-04T01:37:35.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.502+0000 7fe5237fe640 1 -- 172.21.15.114:0/3000435043 >> v2:172.21.15.141:3300/0 conn(0x7fe5240cd6d0 msgr2=0x7fe524161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:35.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.502+0000 7fe5237fe640 1 --2- 172.21.15.114:0/3000435043 >> v2:172.21.15.141:3300/0 conn(0x7fe5240cd6d0 0x7fe524161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.502+0000 7fe5237fe640 1 -- 172.21.15.114:0/3000435043 >> v1:172.21.15.141:6789/0 conn(0x7fe5240b4880 legacy=0x7fe52406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.502+0000 7fe5237fe640 1 -- 172.21.15.114:0/3000435043 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe524161960 con 0x7fe524153e60 2023-11-04T01:37:35.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.503+0000 7fe5237fe640 1 --2- 172.21.15.114:0/3000435043 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe524153e60 0x7fe52415dec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe514009870 tx=0x7fe51402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2efd85f6d0d6d1e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.503+0000 7fe5227fc640 1 -- 172.21.15.114:0/3000435043 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe514030840 con 0x7fe524153e60 2023-11-04T01:37:35.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.503+0000 7fe5227fc640 1 -- 172.21.15.114:0/3000435043 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5140309a0 con 0x7fe524153e60 2023-11-04T01:37:35.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.503+0000 7fe5227fc640 1 -- 172.21.15.114:0/3000435043 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe514030d30 con 0x7fe524153e60 2023-11-04T01:37:35.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.503+0000 7fe529b89640 1 -- 172.21.15.114:0/3000435043 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe524153e60 msgr2=0x7fe52415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.503+0000 7fe529b89640 1 --2- 172.21.15.114:0/3000435043 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe524153e60 0x7fe52415dec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe514009870 tx=0x7fe51402b980 comp rx=0 tx=0).stop 2023-11-04T01:37:35.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.503+0000 7fe529b89640 1 -- 172.21.15.114:0/3000435043 shutdown_connections 2023-11-04T01:37:35.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.503+0000 7fe529b89640 1 --2- 172.21.15.114:0/3000435043 >> v2:172.21.15.141:3300/0 conn(0x7fe5240cd6d0 0x7fe524161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.503+0000 7fe529b89640 1 --2- 172.21.15.114:0/3000435043 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe524153e60 0x7fe52415dec0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.503+0000 7fe529b89640 1 -- 172.21.15.114:0/3000435043 >> 172.21.15.114:0/3000435043 conn(0x7fe5240cf880 msgr2=0x7fe5240cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:35.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.503+0000 7fe529b89640 1 -- 172.21.15.114:0/3000435043 shutdown_connections 2023-11-04T01:37:35.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.503+0000 7fe529b89640 1 -- 172.21.15.114:0/3000435043 wait complete. 2023-11-04T01:37:35.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.504+0000 7fe529b89640 1 Processor -- start 2023-11-04T01:37:35.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.505+0000 7fe529b89640 1 -- start start 2023-11-04T01:37:35.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.505+0000 7fe529b89640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe5240b4880 0x7fe524145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.505+0000 7fe529b89640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5240cd6d0 0x7fe52415a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.505+0000 7fe529b89640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe524153e60 0x7fe524154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.505+0000 7fe529b89640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52415bb30 con 0x7fe524153e60 2023-11-04T01:37:35.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.505+0000 7fe529b89640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52415aca0 con 0x7fe5240cd6d0 2023-11-04T01:37:35.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.505+0000 7fe529b89640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe524155220 con 0x7fe5240b4880 2023-11-04T01:37:35.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.506+0000 7fe523fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe524153e60 0x7fe524154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.506+0000 7fe5237fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe5240b4880 0x7fe524145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.506+0000 7fe522ffd640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5240cd6d0 0x7fe52415a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.506+0000 7fe523fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe524153e60 0x7fe524154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45434/0 (socket says 172.21.15.114:45434) 2023-11-04T01:37:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.506+0000 7fe523fff640 1 -- 172.21.15.114:0/3941126754 learned_addr learned my addr 172.21.15.114:0/3941126754 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.506+0000 7fe523fff640 1 -- 172.21.15.114:0/3941126754 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe5240b4880 msgr2=0x7fe524145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.506+0000 7fe523fff640 1 --2- 172.21.15.114:0/3941126754 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe5240b4880 0x7fe524145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.506+0000 7fe523fff640 1 -- 172.21.15.114:0/3941126754 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5240cd6d0 msgr2=0x7fe52415a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.506+0000 7fe523fff640 1 --2- 172.21.15.114:0/3941126754 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5240cd6d0 0x7fe52415a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.506+0000 7fe523fff640 1 -- 172.21.15.114:0/3941126754 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5140094d0 con 0x7fe524153e60 2023-11-04T01:37:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.506+0000 7fe523fff640 1 --2- 172.21.15.114:0/3941126754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe524153e60 0x7fe524154ce0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00c780 tx=0x7fe51c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.506+0000 7fe50bfff640 1 -- 172.21.15.114:0/3941126754 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c00ce90 con 0x7fe524153e60 2023-11-04T01:37:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.506+0000 7fe50bfff640 1 -- 172.21.15.114:0/3941126754 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c00a640 con 0x7fe524153e60 2023-11-04T01:37:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.506+0000 7fe529b89640 1 -- 172.21.15.114:0/3941126754 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52415aeb0 con 0x7fe524153e60 2023-11-04T01:37:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.506+0000 7fe50bfff640 1 -- 172.21.15.114:0/3941126754 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c00a9f0 con 0x7fe524153e60 2023-11-04T01:37:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.506+0000 7fe529b89640 1 -- 172.21.15.114:0/3941126754 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52415b470 con 0x7fe524153e60 2023-11-04T01:37:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.507+0000 7fe529b89640 1 -- 172.21.15.114:0/3941126754 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52415bc70 con 0x7fe524153e60 2023-11-04T01:37:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.508+0000 7fe50bfff640 1 -- 172.21.15.114:0/3941126754 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe51c00ab50 con 0x7fe524153e60 2023-11-04T01:37:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.508+0000 7fe50bfff640 1 --2- 172.21.15.114:0/3941126754 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe51006ae70 0x7fe51006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.508+0000 7fe50bfff640 1 -- 172.21.15.114:0/3941126754 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe51c089130 con 0x7fe524153e60 2023-11-04T01:37:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.508+0000 7fe5237fe640 1 --2- 172.21.15.114:0/3941126754 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe51006ae70 0x7fe51006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.508+0000 7fe5237fe640 1 --2- 172.21.15.114:0/3941126754 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe51006ae70 0x7fe51006d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe514036000 tx=0x7fe514008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.512+0000 7fe50bfff640 1 -- 172.21.15.114:0/3941126754 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe52415bc70 con 0x7fe524153e60 2023-11-04T01:37:35.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.680+0000 7fe529b89640 1 -- 172.21.15.114:0/3941126754 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe52415bc70 con 0x7fe524153e60 2023-11-04T01:37:35.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.680+0000 7fe50bfff640 1 -- 172.21.15.114:0/3941126754 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe52415bc70 con 0x7fe524153e60 2023-11-04T01:37:35.682 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:37:35.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.682+0000 7fe529b89640 1 -- 172.21.15.114:0/3941126754 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe51006ae70 msgr2=0x7fe51006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.682+0000 7fe529b89640 1 --2- 172.21.15.114:0/3941126754 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe51006ae70 0x7fe51006d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe514036000 tx=0x7fe514008030 comp rx=0 tx=0).stop 2023-11-04T01:37:35.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.682+0000 7fe529b89640 1 -- 172.21.15.114:0/3941126754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe524153e60 msgr2=0x7fe524154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.682+0000 7fe529b89640 1 --2- 172.21.15.114:0/3941126754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe524153e60 0x7fe524154ce0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00c780 tx=0x7fe51c00cc40 comp rx=0 tx=0).stop 2023-11-04T01:37:35.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.682+0000 7fe529b89640 1 -- 172.21.15.114:0/3941126754 shutdown_connections 2023-11-04T01:37:35.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.682+0000 7fe529b89640 1 --2- 172.21.15.114:0/3941126754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe524153e60 0x7fe524154ce0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.682+0000 7fe529b89640 1 --2- 172.21.15.114:0/3941126754 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe51006ae70 0x7fe51006d330 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.682+0000 7fe529b89640 1 --2- 172.21.15.114:0/3941126754 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5240cd6d0 0x7fe52415a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.682+0000 7fe529b89640 1 --2- 172.21.15.114:0/3941126754 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe5240b4880 0x7fe524145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.682+0000 7fe529b89640 1 -- 172.21.15.114:0/3941126754 >> 172.21.15.114:0/3941126754 conn(0x7fe5240cf880 msgr2=0x7fe52415ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:35.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.682+0000 7fe529b89640 1 -- 172.21.15.114:0/3941126754 shutdown_connections 2023-11-04T01:37:35.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.682+0000 7fe529b89640 1 -- 172.21.15.114:0/3941126754 wait complete. 2023-11-04T01:37:35.695 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:35.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.794+0000 7fa9bd5ee640 1 Processor -- start 2023-11-04T01:37:35.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.794+0000 7fa9bd5ee640 1 -- start start 2023-11-04T01:37:35.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.795+0000 7fa9bd5ee640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa9b81603d0 0x7fa9b80b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.795+0000 7fa9bd5ee640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9b80722a0 0x7fa9b806a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.795+0000 7fa9bd5ee640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa9b806a660 0x7fa9b8160b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.795+0000 7fa9bd5ee640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b80b19d0 con 0x7fa9b806a660 2023-11-04T01:37:35.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.795+0000 7fa9bd5ee640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b806aaf0 con 0x7fa9b81603d0 2023-11-04T01:37:35.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.795+0000 7fa9bd5ee640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80cdf80 con 0x7fa9b80722a0 2023-11-04T01:37:35.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.795+0000 7fa9b77fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa9b806a660 0x7fa9b8160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.795+0000 7fa9b77fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa9b806a660 0x7fa9b8160b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45448/0 (socket says 172.21.15.114:45448) 2023-11-04T01:37:35.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.795+0000 7fa9b77fe640 1 -- 172.21.15.114:0/3498444234 learned_addr learned my addr 172.21.15.114:0/3498444234 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:35.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.795+0000 7fa9b6ffd640 1 --2- 172.21.15.114:0/3498444234 >> v2:172.21.15.141:3300/0 conn(0x7fa9b81603d0 0x7fa9b80b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.796+0000 7fa9b67fc640 1 --2- 172.21.15.114:0/3498444234 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9b80722a0 0x7fa9b806a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.796+0000 7fa9b77fe640 1 -- 172.21.15.114:0/3498444234 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9b80722a0 msgr2=0x7fa9b806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:35.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.796+0000 7fa9b77fe640 1 --2- 172.21.15.114:0/3498444234 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9b80722a0 0x7fa9b806a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.796+0000 7fa9b77fe640 1 -- 172.21.15.114:0/3498444234 >> v2:172.21.15.141:3300/0 conn(0x7fa9b81603d0 msgr2=0x7fa9b80b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:35.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.796+0000 7fa9b77fe640 1 --2- 172.21.15.114:0/3498444234 >> v2:172.21.15.141:3300/0 conn(0x7fa9b81603d0 0x7fa9b80b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.796+0000 7fa9b77fe640 1 -- 172.21.15.114:0/3498444234 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b80ce6f0 con 0x7fa9b806a660 2023-11-04T01:37:35.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.796+0000 7fa9b67fc640 1 --2- 172.21.15.114:0/3498444234 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9b80722a0 0x7fa9b806a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:35.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.796+0000 7fa9b77fe640 1 --2- 172.21.15.114:0/3498444234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b806a660 0x7fa9b8160b30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80cd530 tx=0x7fa9b002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a910702948282175 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.796+0000 7fa9b5ffb640 1 -- 172.21.15.114:0/3498444234 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00317e0 con 0x7fa9b806a660 2023-11-04T01:37:35.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.796+0000 7fa9b5ffb640 1 -- 172.21.15.114:0/3498444234 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b0031940 con 0x7fa9b806a660 2023-11-04T01:37:35.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.796+0000 7fa9b5ffb640 1 -- 172.21.15.114:0/3498444234 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0031cd0 con 0x7fa9b806a660 2023-11-04T01:37:35.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.797+0000 7fa9bd5ee640 1 -- 172.21.15.114:0/3498444234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b806a660 msgr2=0x7fa9b8160b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.797+0000 7fa9bd5ee640 1 --2- 172.21.15.114:0/3498444234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b806a660 0x7fa9b8160b30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80cd530 tx=0x7fa9b002b880 comp rx=0 tx=0).stop 2023-11-04T01:37:35.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.797+0000 7fa9bd5ee640 1 -- 172.21.15.114:0/3498444234 shutdown_connections 2023-11-04T01:37:35.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.797+0000 7fa9bd5ee640 1 --2- 172.21.15.114:0/3498444234 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9b80722a0 0x7fa9b806a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.797+0000 7fa9bd5ee640 1 --2- 172.21.15.114:0/3498444234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b806a660 0x7fa9b8160b30 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.797+0000 7fa9bd5ee640 1 --2- 172.21.15.114:0/3498444234 >> v2:172.21.15.141:3300/0 conn(0x7fa9b81603d0 0x7fa9b80b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.797+0000 7fa9bd5ee640 1 -- 172.21.15.114:0/3498444234 >> 172.21.15.114:0/3498444234 conn(0x7fa9b806d800 msgr2=0x7fa9b806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:35.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.797+0000 7fa9bd5ee640 1 -- 172.21.15.114:0/3498444234 shutdown_connections 2023-11-04T01:37:35.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.797+0000 7fa9bd5ee640 1 -- 172.21.15.114:0/3498444234 wait complete. 2023-11-04T01:37:35.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.798+0000 7fa9bd5ee640 1 Processor -- start 2023-11-04T01:37:35.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.798+0000 7fa9bd5ee640 1 -- start start 2023-11-04T01:37:35.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.799+0000 7fa9bd5ee640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9b806a660 0x7fa9b81521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.799+0000 7fa9bd5ee640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9b80722a0 0x7fa9b80b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.799+0000 7fa9bd5ee640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b81603d0 0x7fa9b8153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.799+0000 7fa9bd5ee640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b815f270 con 0x7fa9b81603d0 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.799+0000 7fa9bd5ee640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80b3560 con 0x7fa9b80722a0 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.799+0000 7fa9bd5ee640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80b3f30 con 0x7fa9b806a660 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.799+0000 7fa9b77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b81603d0 0x7fa9b8153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.799+0000 7fa9b77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b81603d0 0x7fa9b8153800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45454/0 (socket says 172.21.15.114:45454) 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.799+0000 7fa9b77fe640 1 -- 172.21.15.114:0/2842600403 learned_addr learned my addr 172.21.15.114:0/2842600403 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.799+0000 7fa9b67fc640 1 --2- 172.21.15.114:0/2842600403 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9b80722a0 0x7fa9b80b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.799+0000 7fa9b77fe640 1 -- 172.21.15.114:0/2842600403 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9b806a660 msgr2=0x7fa9b81521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.799+0000 7fa9b77fe640 1 --2- 172.21.15.114:0/2842600403 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9b806a660 0x7fa9b81521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.799+0000 7fa9b77fe640 1 -- 172.21.15.114:0/2842600403 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9b80722a0 msgr2=0x7fa9b80b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.799+0000 7fa9b77fe640 1 --2- 172.21.15.114:0/2842600403 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9b80722a0 0x7fa9b80b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.799+0000 7fa9b77fe640 1 -- 172.21.15.114:0/2842600403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b00094d0 con 0x7fa9b81603d0 2023-11-04T01:37:35.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.799+0000 7fa9b67fc640 1 --2- 172.21.15.114:0/2842600403 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9b80722a0 0x7fa9b80b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:35.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.800+0000 7fa9b77fe640 1 --2- 172.21.15.114:0/2842600403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b81603d0 0x7fa9b8153800 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00090b0 tx=0x7fa9b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.800+0000 7fa99f7fe640 1 -- 172.21.15.114:0/2842600403 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0032880 con 0x7fa9b81603d0 2023-11-04T01:37:35.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.800+0000 7fa99f7fe640 1 -- 172.21.15.114:0/2842600403 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b0032a00 con 0x7fa9b81603d0 2023-11-04T01:37:35.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.800+0000 7fa9bd5ee640 1 -- 172.21.15.114:0/2842600403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b80b2950 con 0x7fa9b81603d0 2023-11-04T01:37:35.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.800+0000 7fa99f7fe640 1 -- 172.21.15.114:0/2842600403 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0032db0 con 0x7fa9b81603d0 2023-11-04T01:37:35.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.800+0000 7fa9bd5ee640 1 -- 172.21.15.114:0/2842600403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b80b2f10 con 0x7fa9b81603d0 2023-11-04T01:37:35.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.801+0000 7fa9bd5ee640 1 -- 172.21.15.114:0/2842600403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b80b5990 con 0x7fa9b81603d0 2023-11-04T01:37:35.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.801+0000 7fa99f7fe640 1 -- 172.21.15.114:0/2842600403 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa9b004e450 con 0x7fa9b81603d0 2023-11-04T01:37:35.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.801+0000 7fa99f7fe640 1 --2- 172.21.15.114:0/2842600403 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa9a406ae70 0x7fa9a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:35.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.802+0000 7fa99f7fe640 1 -- 172.21.15.114:0/2842600403 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa9b00abb20 con 0x7fa9b81603d0 2023-11-04T01:37:35.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.802+0000 7fa9b6ffd640 1 --2- 172.21.15.114:0/2842600403 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa9a406ae70 0x7fa9a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:35.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.802+0000 7fa9b6ffd640 1 --2- 172.21.15.114:0/2842600403 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa9a406ae70 0x7fa9a406d330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80cdd00 tx=0x7fa9a8009450 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:35.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.806+0000 7fa99f7fe640 1 -- 172.21.15.114:0/2842600403 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa9b0076810 con 0x7fa9b81603d0 2023-11-04T01:37:35.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.975+0000 7fa9bd5ee640 1 -- 172.21.15.114:0/2842600403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa9b80b36f0 con 0x7fa9b81603d0 2023-11-04T01:37:35.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.976+0000 7fa99f7fe640 1 -- 172.21.15.114:0/2842600403 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa9b0079e30 con 0x7fa9b81603d0 2023-11-04T01:37:35.978 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:35.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.978+0000 7fa9bd5ee640 1 -- 172.21.15.114:0/2842600403 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa9a406ae70 msgr2=0x7fa9a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.978+0000 7fa9bd5ee640 1 --2- 172.21.15.114:0/2842600403 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa9a406ae70 0x7fa9a406d330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80cdd00 tx=0x7fa9a8009450 comp rx=0 tx=0).stop 2023-11-04T01:37:35.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.978+0000 7fa9bd5ee640 1 -- 172.21.15.114:0/2842600403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b81603d0 msgr2=0x7fa9b8153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:35.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.978+0000 7fa9bd5ee640 1 --2- 172.21.15.114:0/2842600403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b81603d0 0x7fa9b8153800 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00090b0 tx=0x7fa9b00046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.978+0000 7fa9bd5ee640 1 -- 172.21.15.114:0/2842600403 shutdown_connections 2023-11-04T01:37:35.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.978+0000 7fa9bd5ee640 1 --2- 172.21.15.114:0/2842600403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b81603d0 0x7fa9b8153800 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.978+0000 7fa9bd5ee640 1 --2- 172.21.15.114:0/2842600403 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa9a406ae70 0x7fa9a406d330 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.978+0000 7fa9bd5ee640 1 --2- 172.21.15.114:0/2842600403 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9b80722a0 0x7fa9b80b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.978+0000 7fa9bd5ee640 1 --2- 172.21.15.114:0/2842600403 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9b806a660 0x7fa9b81521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:35.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.978+0000 7fa9bd5ee640 1 -- 172.21.15.114:0/2842600403 >> 172.21.15.114:0/2842600403 conn(0x7fa9b806d800 msgr2=0x7fa9b80cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:35.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.978+0000 7fa9bd5ee640 1 -- 172.21.15.114:0/2842600403 shutdown_connections 2023-11-04T01:37:35.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:35.978+0000 7fa9bd5ee640 1 -- 172.21.15.114:0/2842600403 wait complete. 2023-11-04T01:37:35.991 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:37:36.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.090+0000 7fbd4eca2640 1 Processor -- start 2023-11-04T01:37:36.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.090+0000 7fbd4eca2640 1 -- start start 2023-11-04T01:37:36.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.091+0000 7fbd4eca2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbd4815e430 0x7fbd480cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.091+0000 7fbd4eca2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd480cf160 0x7fbd480cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.091+0000 7fbd4eca2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd480d0710 0x7fbd480cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.091+0000 7fbd4eca2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd480cdf90 con 0x7fbd480d0710 2023-11-04T01:37:36.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.091+0000 7fbd4eca2640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd480d0280 con 0x7fbd4815e430 2023-11-04T01:37:36.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.091+0000 7fbd4eca2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd480cf670 con 0x7fbd480cf160 2023-11-04T01:37:36.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.091+0000 7fbd4d23f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd480d0710 0x7fbd480cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.091+0000 7fbd4d23f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd480d0710 0x7fbd480cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45466/0 (socket says 172.21.15.114:45466) 2023-11-04T01:37:36.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.091+0000 7fbd4d23f640 1 -- 172.21.15.114:0/3869291656 learned_addr learned my addr 172.21.15.114:0/3869291656 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:36.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.091+0000 7fbd4ca3e640 1 --2- 172.21.15.114:0/3869291656 >> v2:172.21.15.141:3300/0 conn(0x7fbd4815e430 0x7fbd480cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.091+0000 7fbd4d23f640 1 -- 172.21.15.114:0/3869291656 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd480cf160 msgr2=0x7fbd480cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.091+0000 7fbd4d23f640 1 --2- 172.21.15.114:0/3869291656 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd480cf160 0x7fbd480cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.091+0000 7fbd4d23f640 1 -- 172.21.15.114:0/3869291656 >> v2:172.21.15.141:3300/0 conn(0x7fbd4815e430 msgr2=0x7fbd480cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.091+0000 7fbd4d23f640 1 --2- 172.21.15.114:0/3869291656 >> v2:172.21.15.141:3300/0 conn(0x7fbd4815e430 0x7fbd480cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.091+0000 7fbd4d23f640 1 -- 172.21.15.114:0/3869291656 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd480cf950 con 0x7fbd480d0710 2023-11-04T01:37:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.091+0000 7fbd4ca3e640 1 --2- 172.21.15.114:0/3869291656 >> v2:172.21.15.141:3300/0 conn(0x7fbd4815e430 0x7fbd480cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.092+0000 7fbd4d23f640 1 --2- 172.21.15.114:0/3869291656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd480d0710 0x7fbd480cda50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbd4806e5b0 tx=0x7fbd4002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490763a7e4231812 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.092+0000 7fbd477fe640 1 -- 172.21.15.114:0/3869291656 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4002ca70 con 0x7fbd480d0710 2023-11-04T01:37:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.092+0000 7fbd477fe640 1 -- 172.21.15.114:0/3869291656 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4002cbd0 con 0x7fbd480d0710 2023-11-04T01:37:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.092+0000 7fbd477fe640 1 -- 172.21.15.114:0/3869291656 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd400343f0 con 0x7fbd480d0710 2023-11-04T01:37:36.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.093+0000 7fbd4eca2640 1 -- 172.21.15.114:0/3869291656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd480d0710 msgr2=0x7fbd480cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.093+0000 7fbd4eca2640 1 --2- 172.21.15.114:0/3869291656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd480d0710 0x7fbd480cda50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbd4806e5b0 tx=0x7fbd4002bed0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.093+0000 7fbd4eca2640 1 -- 172.21.15.114:0/3869291656 shutdown_connections 2023-11-04T01:37:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.093+0000 7fbd4eca2640 1 --2- 172.21.15.114:0/3869291656 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd480cf160 0x7fbd480cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.093+0000 7fbd4eca2640 1 --2- 172.21.15.114:0/3869291656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd480d0710 0x7fbd480cda50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.093+0000 7fbd4eca2640 1 --2- 172.21.15.114:0/3869291656 >> v2:172.21.15.141:3300/0 conn(0x7fbd4815e430 0x7fbd480cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.093+0000 7fbd4eca2640 1 -- 172.21.15.114:0/3869291656 >> 172.21.15.114:0/3869291656 conn(0x7fbd4806ea20 msgr2=0x7fbd4806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.093+0000 7fbd4eca2640 1 -- 172.21.15.114:0/3869291656 shutdown_connections 2023-11-04T01:37:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.093+0000 7fbd4eca2640 1 -- 172.21.15.114:0/3869291656 wait complete. 2023-11-04T01:37:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.094+0000 7fbd4eca2640 1 Processor -- start 2023-11-04T01:37:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.094+0000 7fbd4eca2640 1 -- start start 2023-11-04T01:37:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4eca2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd480cf160 0x7fbd48149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4eca2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd480d0710 0x7fbd4814cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4eca2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd4815e430 0x7fbd480c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4eca2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4814b3a0 con 0x7fbd480cf160 2023-11-04T01:37:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4eca2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4814a0c0 con 0x7fbd480d0710 2023-11-04T01:37:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4eca2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4814a790 con 0x7fbd4815e430 2023-11-04T01:37:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4ca3e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd480cf160 0x7fbd48149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4ca3e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd480cf160 0x7fbd48149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45480/0 (socket says 172.21.15.114:45480) 2023-11-04T01:37:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4ca3e640 1 -- 172.21.15.114:0/1685348615 learned_addr learned my addr 172.21.15.114:0/1685348615 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd47fff640 1 --2- 172.21.15.114:0/1685348615 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd480d0710 0x7fbd4814cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4d23f640 1 --2- 172.21.15.114:0/1685348615 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd4815e430 0x7fbd480c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4ca3e640 1 -- 172.21.15.114:0/1685348615 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd4815e430 msgr2=0x7fbd480c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4ca3e640 1 --2- 172.21.15.114:0/1685348615 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd4815e430 0x7fbd480c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4ca3e640 1 -- 172.21.15.114:0/1685348615 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd480d0710 msgr2=0x7fbd4814cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4ca3e640 1 --2- 172.21.15.114:0/1685348615 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd480d0710 0x7fbd4814cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4ca3e640 1 -- 172.21.15.114:0/1685348615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd40009b30 con 0x7fbd480cf160 2023-11-04T01:37:36.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4ca3e640 1 --2- 172.21.15.114:0/1685348615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd480cf160 0x7fbd48149b80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00c7f0 tx=0x7fbd3c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd457fa640 1 -- 172.21.15.114:0/1685348615 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c007a30 con 0x7fbd480cf160 2023-11-04T01:37:36.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd457fa640 1 -- 172.21.15.114:0/1685348615 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c007b90 con 0x7fbd480cf160 2023-11-04T01:37:36.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd457fa640 1 -- 172.21.15.114:0/1685348615 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c00ce40 con 0x7fbd480cf160 2023-11-04T01:37:36.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4eca2640 1 -- 172.21.15.114:0/1685348615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4814aa70 con 0x7fbd480cf160 2023-11-04T01:37:36.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.095+0000 7fbd4eca2640 1 -- 172.21.15.114:0/1685348615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4814b030 con 0x7fbd480cf160 2023-11-04T01:37:36.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.096+0000 7fbd4eca2640 1 -- 172.21.15.114:0/1685348615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd48074290 con 0x7fbd480cf160 2023-11-04T01:37:36.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.097+0000 7fbd457fa640 1 -- 172.21.15.114:0/1685348615 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd3c0113f0 con 0x7fbd480cf160 2023-11-04T01:37:36.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.097+0000 7fbd457fa640 1 --2- 172.21.15.114:0/1685348615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd2c06ae70 0x7fbd2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.097+0000 7fbd47fff640 1 --2- 172.21.15.114:0/1685348615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd2c06ae70 0x7fbd2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.097+0000 7fbd457fa640 1 -- 172.21.15.114:0/1685348615 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbd3c089bc0 con 0x7fbd480cf160 2023-11-04T01:37:36.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.098+0000 7fbd47fff640 1 --2- 172.21.15.114:0/1685348615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd2c06ae70 0x7fbd2c06d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbd480c76c0 tx=0x7fbd34008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.101+0000 7fbd457fa640 1 -- 172.21.15.114:0/1685348615 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd3c0548b0 con 0x7fbd480cf160 2023-11-04T01:37:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.281+0000 7fbd4eca2640 1 -- 172.21.15.114:0/1685348615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbd480caeb0 con 0x7fbd480cf160 2023-11-04T01:37:36.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.282+0000 7fbd457fa640 1 -- 172.21.15.114:0/1685348615 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbd3c01f080 con 0x7fbd480cf160 2023-11-04T01:37:36.284 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-11-04T01:37:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.283+0000 7fbd4eca2640 1 -- 172.21.15.114:0/1685348615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd2c06ae70 msgr2=0x7fbd2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.283+0000 7fbd4eca2640 1 --2- 172.21.15.114:0/1685348615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd2c06ae70 0x7fbd2c06d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbd480c76c0 tx=0x7fbd34008040 comp rx=0 tx=0).stop 2023-11-04T01:37:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.283+0000 7fbd4eca2640 1 -- 172.21.15.114:0/1685348615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd480cf160 msgr2=0x7fbd48149b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.283+0000 7fbd4eca2640 1 --2- 172.21.15.114:0/1685348615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd480cf160 0x7fbd48149b80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00c7f0 tx=0x7fbd3c00cbf0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.283+0000 7fbd4eca2640 1 -- 172.21.15.114:0/1685348615 shutdown_connections 2023-11-04T01:37:36.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.283+0000 7fbd4eca2640 1 --2- 172.21.15.114:0/1685348615 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd4815e430 0x7fbd480c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.283+0000 7fbd4eca2640 1 --2- 172.21.15.114:0/1685348615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd2c06ae70 0x7fbd2c06d330 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.283+0000 7fbd4eca2640 1 --2- 172.21.15.114:0/1685348615 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd480d0710 0x7fbd4814cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.283+0000 7fbd4eca2640 1 --2- 172.21.15.114:0/1685348615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd480cf160 0x7fbd48149b80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.283+0000 7fbd4eca2640 1 -- 172.21.15.114:0/1685348615 >> 172.21.15.114:0/1685348615 conn(0x7fbd4806ea20 msgr2=0x7fbd480c9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:36.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.284+0000 7fbd4eca2640 1 -- 172.21.15.114:0/1685348615 shutdown_connections 2023-11-04T01:37:36.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.284+0000 7fbd4eca2640 1 -- 172.21.15.114:0/1685348615 wait complete. 2023-11-04T01:37:36.296 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi141.front.sepia.ceph.com... 2023-11-04T01:37:36.297 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:36.297 DEBUG:teuthology.orchestra.run.smithi141:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-04T01:37:36.364 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:36.365 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi141.stderr:ceph-fuse[125465]: fuse finished with error 0 and tester_r 0 2023-11-04T01:37:36.365 INFO:teuthology.orchestra.run.smithi141.stderr:2023-11-04T01:37:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:36.369 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi141.stderr:2023-11-04T01:37:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:36.372 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:36.379 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:37:36.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:36.380 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:37:36.435 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:37:36.436 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:36.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.533+0000 7f1ff9864640 1 Processor -- start 2023-11-04T01:37:36.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.533+0000 7f1ff9864640 1 -- start start 2023-11-04T01:37:36.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.534+0000 7f1ff9864640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1ff40ce240 0x7f1ff4157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.534+0000 7f1ff9864640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1ff4157540 0x7f1ff40d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.534+0000 7f1ff9864640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff415e000 con 0x7f1ff40cde60 2023-11-04T01:37:36.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.534+0000 7f1ff9864640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff415e5c0 con 0x7f1ff40ce240 2023-11-04T01:37:36.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.534+0000 7f1ff9864640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff415e2e0 con 0x7f1ff4157540 2023-11-04T01:37:36.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.534+0000 7f1ff27fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1ff40ce240 0x7f1ff4157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.534+0000 7f1ff27fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1ff40ce240 0x7f1ff4157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37592/0 (socket says 172.21.15.114:37592) 2023-11-04T01:37:36.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.534+0000 7f1ff27fc640 1 -- 172.21.15.114:0/1787796889 learned_addr learned my addr 172.21.15.114:0/1787796889 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:36.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.534+0000 7f1ff27fc640 1 -- 172.21.15.114:0/1787796889 >> v2:172.21.15.141:3300/0 conn(0x7f1ff4157540 msgr2=0x7f1ff40d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:36.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.534+0000 7f1ff27fc640 1 --2- 172.21.15.114:0/1787796889 >> v2:172.21.15.141:3300/0 conn(0x7f1ff4157540 0x7f1ff40d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.534+0000 7f1ff27fc640 1 -- 172.21.15.114:0/1787796889 >> v1:172.21.15.114:6789/0 conn(0x7f1ff40cde60 legacy=0x7f1ff415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.534+0000 7f1ff27fc640 1 -- 172.21.15.114:0/1787796889 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff40d1120 con 0x7f1ff40ce240 2023-11-04T01:37:36.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.535+0000 7f1ff27fc640 1 --2- 172.21.15.114:0/1787796889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ff40ce240 0x7f1ff4157000 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1ff40cf2e0 tx=0x7f1fe802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da79d7088044f28c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.535+0000 7f1ff1ffb640 1 -- 172.21.15.114:0/1787796889 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8030860 con 0x7f1ff40ce240 2023-11-04T01:37:36.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.535+0000 7f1ff1ffb640 1 -- 172.21.15.114:0/1787796889 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe80309c0 con 0x7f1ff40ce240 2023-11-04T01:37:36.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.535+0000 7f1ff1ffb640 1 -- 172.21.15.114:0/1787796889 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8030d50 con 0x7f1ff40ce240 2023-11-04T01:37:36.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.535+0000 7f1ff9864640 1 -- 172.21.15.114:0/1787796889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ff40ce240 msgr2=0x7f1ff4157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.535+0000 7f1ff9864640 1 --2- 172.21.15.114:0/1787796889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ff40ce240 0x7f1ff4157000 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1ff40cf2e0 tx=0x7f1fe802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.535+0000 7f1ff9864640 1 -- 172.21.15.114:0/1787796889 shutdown_connections 2023-11-04T01:37:36.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.535+0000 7f1ff9864640 1 --2- 172.21.15.114:0/1787796889 >> v2:172.21.15.141:3300/0 conn(0x7f1ff4157540 0x7f1ff40d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.535+0000 7f1ff9864640 1 --2- 172.21.15.114:0/1787796889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ff40ce240 0x7f1ff4157000 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.535+0000 7f1ff9864640 1 -- 172.21.15.114:0/1787796889 >> 172.21.15.114:0/1787796889 conn(0x7f1ff4071f30 msgr2=0x7f1ff40cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:36.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.535+0000 7f1ff9864640 1 -- 172.21.15.114:0/1787796889 shutdown_connections 2023-11-04T01:37:36.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.535+0000 7f1ff9864640 1 -- 172.21.15.114:0/1787796889 wait complete. 2023-11-04T01:37:36.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.537+0000 7f1ff9864640 1 Processor -- start 2023-11-04T01:37:36.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.537+0000 7f1ff9864640 1 -- start start 2023-11-04T01:37:36.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.537+0000 7f1ff9864640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ff40cde60 0x7f1ff40cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.537+0000 7f1ff9864640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ff40ce240 0x7f1ff41443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.537+0000 7f1ff9864640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ff4157540 0x7f1ff41448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.537+0000 7f1ff9864640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff4145ef0 con 0x7f1ff4157540 2023-11-04T01:37:36.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.537+0000 7f1ff9864640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff4156200 con 0x7f1ff40ce240 2023-11-04T01:37:36.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.537+0000 7f1ff9864640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff4144f40 con 0x7f1ff40cde60 2023-11-04T01:37:36.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.538+0000 7f1ff37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ff4157540 0x7f1ff41448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.538+0000 7f1ff37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ff4157540 0x7f1ff41448e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37608/0 (socket says 172.21.15.114:37608) 2023-11-04T01:37:36.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.538+0000 7f1ff2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ff40cde60 0x7f1ff40cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.538+0000 7f1ff37fe640 1 -- 172.21.15.114:0/92096563 learned_addr learned my addr 172.21.15.114:0/92096563 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:36.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.538+0000 7f1ff27fc640 1 --2- 172.21.15.114:0/92096563 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ff40ce240 0x7f1ff41443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.538+0000 7f1ff37fe640 1 -- 172.21.15.114:0/92096563 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ff40cde60 msgr2=0x7f1ff40cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.538+0000 7f1ff37fe640 1 --2- 172.21.15.114:0/92096563 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ff40cde60 0x7f1ff40cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.538+0000 7f1ff37fe640 1 -- 172.21.15.114:0/92096563 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ff40ce240 msgr2=0x7f1ff41443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.538+0000 7f1ff37fe640 1 --2- 172.21.15.114:0/92096563 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ff40ce240 0x7f1ff41443a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.538+0000 7f1ff37fe640 1 -- 172.21.15.114:0/92096563 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe80094d0 con 0x7f1ff4157540 2023-11-04T01:37:36.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.538+0000 7f1ff37fe640 1 --2- 172.21.15.114:0/92096563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ff4157540 0x7f1ff41448e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00b970 tx=0x7f1fec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.538+0000 7f1fdbfff640 1 -- 172.21.15.114:0/92096563 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00cb40 con 0x7f1ff4157540 2023-11-04T01:37:36.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.538+0000 7f1fdbfff640 1 -- 172.21.15.114:0/92096563 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec00ccc0 con 0x7f1ff4157540 2023-11-04T01:37:36.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.538+0000 7f1ff9864640 1 -- 172.21.15.114:0/92096563 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff4145220 con 0x7f1ff4157540 2023-11-04T01:37:36.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.538+0000 7f1fdbfff640 1 -- 172.21.15.114:0/92096563 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec014680 con 0x7f1ff4157540 2023-11-04T01:37:36.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.538+0000 7f1ff9864640 1 -- 172.21.15.114:0/92096563 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff41457e0 con 0x7f1ff4157540 2023-11-04T01:37:36.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.539+0000 7f1ff9864640 1 -- 172.21.15.114:0/92096563 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff4146030 con 0x7f1ff4157540 2023-11-04T01:37:36.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.540+0000 7f1fdbfff640 1 -- 172.21.15.114:0/92096563 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1fec01d3b0 con 0x7f1ff4157540 2023-11-04T01:37:36.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.540+0000 7f1fdbfff640 1 --2- 172.21.15.114:0/92096563 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1fe006ae70 0x7f1fe006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.540+0000 7f1ff2ffd640 1 --2- 172.21.15.114:0/92096563 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1fe006ae70 0x7f1fe006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.540+0000 7f1fdbfff640 1 -- 172.21.15.114:0/92096563 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1fec0898c0 con 0x7f1ff4157540 2023-11-04T01:37:36.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.540+0000 7f1ff2ffd640 1 --2- 172.21.15.114:0/92096563 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1fe006ae70 0x7f1fe006d330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4000f60 tx=0x7f1fe4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.544+0000 7f1fdbfff640 1 -- 172.21.15.114:0/92096563 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ff4146030 con 0x7f1ff4157540 2023-11-04T01:37:36.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.744+0000 7f1ff9864640 1 -- 172.21.15.114:0/92096563 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ff4146030 con 0x7f1ff4157540 2023-11-04T01:37:36.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.744+0000 7f1fdbfff640 1 -- 172.21.15.114:0/92096563 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f1ff4146030 con 0x7f1ff4157540 2023-11-04T01:37:36.747 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:36.747 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1590879236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1590879236},{"type":"v1","addr":"172.21.15.141:6834","nonce":1590879236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3079825621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3079825621},{"type":"v1","addr":"172.21.15.114:6835","nonce":3079825621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1526155664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1526155664},{"type":"v1","addr":"172.21.15.114:6837","nonce":1526155664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:36:29.888918+0000","modified":"2023-11-04T01:36:46.975998+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6835/4231924170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4231924170},{"type":"v1","addr":"172.21.15.141:6835","nonce":4231924170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:37:36.747 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2023-11-04T01:37:36.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.746+0000 7f1ff9864640 1 -- 172.21.15.114:0/92096563 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1fe006ae70 msgr2=0x7f1fe006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.746+0000 7f1ff9864640 1 --2- 172.21.15.114:0/92096563 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1fe006ae70 0x7f1fe006d330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4000f60 tx=0x7f1fe4009040 comp rx=0 tx=0).stop 2023-11-04T01:37:36.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.746+0000 7f1ff9864640 1 -- 172.21.15.114:0/92096563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ff4157540 msgr2=0x7f1ff41448e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.746+0000 7f1ff9864640 1 --2- 172.21.15.114:0/92096563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ff4157540 0x7f1ff41448e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00b970 tx=0x7f1fec00be30 comp rx=0 tx=0).stop 2023-11-04T01:37:36.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.746+0000 7f1ff9864640 1 -- 172.21.15.114:0/92096563 shutdown_connections 2023-11-04T01:37:36.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.746+0000 7f1ff9864640 1 --2- 172.21.15.114:0/92096563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ff4157540 0x7f1ff41448e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.746+0000 7f1ff9864640 1 --2- 172.21.15.114:0/92096563 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1fe006ae70 0x7f1fe006d330 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.746+0000 7f1ff9864640 1 --2- 172.21.15.114:0/92096563 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1ff40ce240 0x7f1ff41443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.746+0000 7f1ff9864640 1 --2- 172.21.15.114:0/92096563 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1ff40cde60 0x7f1ff40cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.746+0000 7f1ff9864640 1 -- 172.21.15.114:0/92096563 >> 172.21.15.114:0/92096563 conn(0x7f1ff4071f30 msgr2=0x7f1ff40b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:36.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.746+0000 7f1ff9864640 1 -- 172.21.15.114:0/92096563 shutdown_connections 2023-11-04T01:37:36.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.746+0000 7f1ff9864640 1 -- 172.21.15.114:0/92096563 wait complete. 2023-11-04T01:37:36.760 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:36.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.859+0000 7f244673c640 1 Processor -- start 2023-11-04T01:37:36.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.859+0000 7f244673c640 1 -- start start 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.859+0000 7f244673c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f24400cde60 0x7f244015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.859+0000 7f244673c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f244015e000 con 0x7f24400ce240 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.859+0000 7f244673c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f244015e2e0 con 0x7f244015daa0 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.859+0000 7f244673c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244015e5c0 con 0x7f24400cde60 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.860+0000 7f243ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f24400cde60 0x7f244015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.860+0000 7f243ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f24400cde60 0x7f244015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37610/0 (socket says 172.21.15.114:37610) 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.860+0000 7f243ffff640 1 -- 172.21.15.114:0/316680679 learned_addr learned my addr 172.21.15.114:0/316680679 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.860+0000 7f243ffff640 1 -- 172.21.15.114:0/316680679 >> v1:172.21.15.141:6789/0 conn(0x7f244015daa0 legacy=0x7f2440157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.860+0000 7f243ffff640 1 -- 172.21.15.114:0/316680679 >> v1:172.21.15.114:6789/0 conn(0x7f24400ce240 legacy=0x7f24400d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.860+0000 7f243ffff640 1 -- 172.21.15.114:0/316680679 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24400d1120 con 0x7f24400cde60 2023-11-04T01:37:36.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.861+0000 7f243ffff640 1 --2- 172.21.15.114:0/316680679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24400cde60 0x7f244015d560 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2430009870 tx=0x7f243002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5427573cf504cb8d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.861+0000 7f243effd640 1 -- 172.21.15.114:0/316680679 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243002f840 con 0x7f24400cde60 2023-11-04T01:37:36.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.861+0000 7f243effd640 1 -- 172.21.15.114:0/316680679 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243002f9a0 con 0x7f24400cde60 2023-11-04T01:37:36.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.861+0000 7f243effd640 1 -- 172.21.15.114:0/316680679 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243002fd30 con 0x7f24400cde60 2023-11-04T01:37:36.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.861+0000 7f244673c640 1 -- 172.21.15.114:0/316680679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24400cde60 msgr2=0x7f244015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.861+0000 7f244673c640 1 --2- 172.21.15.114:0/316680679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24400cde60 0x7f244015d560 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2430009870 tx=0x7f243002ba20 comp rx=0 tx=0).stop 2023-11-04T01:37:36.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.861+0000 7f244673c640 1 -- 172.21.15.114:0/316680679 shutdown_connections 2023-11-04T01:37:36.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.861+0000 7f244673c640 1 --2- 172.21.15.114:0/316680679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24400cde60 0x7f244015d560 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.861+0000 7f244673c640 1 -- 172.21.15.114:0/316680679 >> 172.21.15.114:0/316680679 conn(0x7f2440071f30 msgr2=0x7f24400cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:36.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.861+0000 7f244673c640 1 -- 172.21.15.114:0/316680679 shutdown_connections 2023-11-04T01:37:36.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.861+0000 7f244673c640 1 -- 172.21.15.114:0/316680679 wait complete. 2023-11-04T01:37:36.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.862+0000 7f244673c640 1 Processor -- start 2023-11-04T01:37:36.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.863+0000 7f244673c640 1 -- start start 2023-11-04T01:37:36.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.863+0000 7f244673c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24400cde60 0x7f244014f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.863+0000 7f244673c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24400ce240 0x7f24400d1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.863+0000 7f244673c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f244015daa0 0x7f24400d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.863+0000 7f244673c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24400c9ef0 con 0x7f24400ce240 2023-11-04T01:37:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.863+0000 7f244673c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24400cad50 con 0x7f24400cde60 2023-11-04T01:37:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.863+0000 7f244673c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244014fb50 con 0x7f244015daa0 2023-11-04T01:37:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.863+0000 7f243f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24400ce240 0x7f24400d1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.863+0000 7f243f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24400ce240 0x7f24400d1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37616/0 (socket says 172.21.15.114:37616) 2023-11-04T01:37:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.863+0000 7f243f7fe640 1 -- 172.21.15.114:0/3673722371 learned_addr learned my addr 172.21.15.114:0/3673722371 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:36.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.864+0000 7f2444cd9640 1 --2- 172.21.15.114:0/3673722371 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f244015daa0 0x7f24400d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.864+0000 7f243ffff640 1 --2- 172.21.15.114:0/3673722371 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24400cde60 0x7f244014f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.864+0000 7f243f7fe640 1 -- 172.21.15.114:0/3673722371 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f244015daa0 msgr2=0x7f24400d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.864+0000 7f243f7fe640 1 --2- 172.21.15.114:0/3673722371 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f244015daa0 0x7f24400d1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.864+0000 7f243f7fe640 1 -- 172.21.15.114:0/3673722371 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24400cde60 msgr2=0x7f244014f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:36.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.864+0000 7f243f7fe640 1 --2- 172.21.15.114:0/3673722371 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24400cde60 0x7f244014f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:36.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.864+0000 7f243f7fe640 1 -- 172.21.15.114:0/3673722371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24300094d0 con 0x7f24400ce240 2023-11-04T01:37:36.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.864+0000 7f243f7fe640 1 --2- 172.21.15.114:0/3673722371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24400ce240 0x7f24400d1770 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f243400c3c0 tx=0x7f243400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.864+0000 7f243cff9640 1 -- 172.21.15.114:0/3673722371 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24340052d0 con 0x7f24400ce240 2023-11-04T01:37:36.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.864+0000 7f243cff9640 1 -- 172.21.15.114:0/3673722371 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2434005450 con 0x7f24400ce240 2023-11-04T01:37:36.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.864+0000 7f244673c640 1 -- 172.21.15.114:0/3673722371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24400ca0d0 con 0x7f24400ce240 2023-11-04T01:37:36.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.864+0000 7f243cff9640 1 -- 172.21.15.114:0/3673722371 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434003830 con 0x7f24400ce240 2023-11-04T01:37:36.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.864+0000 7f244673c640 1 -- 172.21.15.114:0/3673722371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24400ca690 con 0x7f24400ce240 2023-11-04T01:37:36.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.865+0000 7f244673c640 1 -- 172.21.15.114:0/3673722371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24400cae90 con 0x7f24400ce240 2023-11-04T01:37:36.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.865+0000 7f243cff9640 1 -- 172.21.15.114:0/3673722371 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2434003990 con 0x7f24400ce240 2023-11-04T01:37:36.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.866+0000 7f243cff9640 1 --2- 172.21.15.114:0/3673722371 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f242c06aea0 0x7f242c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:36.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.866+0000 7f243cff9640 1 -- 172.21.15.114:0/3673722371 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2434088e80 con 0x7f24400ce240 2023-11-04T01:37:36.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.866+0000 7f243ffff640 1 --2- 172.21.15.114:0/3673722371 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f242c06aea0 0x7f242c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:36.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.866+0000 7f243ffff640 1 --2- 172.21.15.114:0/3673722371 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f242c06aea0 0x7f242c06d360 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2430036000 tx=0x7f2430008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:36.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:36.870+0000 7f243cff9640 1 -- 172.21.15.114:0/3673722371 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2434053b80 con 0x7f24400ce240 2023-11-04T01:37:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.036+0000 7f244673c640 1 -- 172.21.15.114:0/3673722371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2440074290 con 0x7f24400ce240 2023-11-04T01:37:37.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.037+0000 7f243cff9640 1 -- 172.21.15.114:0/3673722371 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18796 (secure 0 0 0) 0x7f24340571a0 con 0x7f24400ce240 2023-11-04T01:37:37.040 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:37.041 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:11.562429+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.039+0000 7f244673c640 1 -- 172.21.15.114:0/3673722371 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f242c06aea0 msgr2=0x7f242c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.039+0000 7f244673c640 1 --2- 172.21.15.114:0/3673722371 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f242c06aea0 0x7f242c06d360 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2430036000 tx=0x7f2430008030 comp rx=0 tx=0).stop 2023-11-04T01:37:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.039+0000 7f244673c640 1 -- 172.21.15.114:0/3673722371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24400ce240 msgr2=0x7f24400d1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.039+0000 7f244673c640 1 --2- 172.21.15.114:0/3673722371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24400ce240 0x7f24400d1770 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f243400c3c0 tx=0x7f243400c880 comp rx=0 tx=0).stop 2023-11-04T01:37:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.039+0000 7f244673c640 1 -- 172.21.15.114:0/3673722371 shutdown_connections 2023-11-04T01:37:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.039+0000 7f244673c640 1 --2- 172.21.15.114:0/3673722371 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f244015daa0 0x7f24400d1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.039+0000 7f244673c640 1 --2- 172.21.15.114:0/3673722371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24400ce240 0x7f24400d1770 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.039+0000 7f244673c640 1 --2- 172.21.15.114:0/3673722371 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f242c06aea0 0x7f242c06d360 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.039+0000 7f244673c640 1 --2- 172.21.15.114:0/3673722371 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24400cde60 0x7f244014f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.039+0000 7f244673c640 1 -- 172.21.15.114:0/3673722371 >> 172.21.15.114:0/3673722371 conn(0x7f2440071f30 msgr2=0x7f24400d3690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:37.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.040+0000 7f244673c640 1 -- 172.21.15.114:0/3673722371 shutdown_connections 2023-11-04T01:37:37.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.040+0000 7f244673c640 1 -- 172.21.15.114:0/3673722371 wait complete. 2023-11-04T01:37:37.055 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:36:27.911769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:36:28.871185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:36:32.598984+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:37:37.056 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:37.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.155+0000 7f51063e7640 1 Processor -- start 2023-11-04T01:37:37.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.155+0000 7f51063e7640 1 -- start start 2023-11-04T01:37:37.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.156+0000 7f51063e7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f51000b4880 0x7f51000b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.156+0000 7f51063e7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51000cde60 con 0x7f5100153e60 2023-11-04T01:37:37.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.156+0000 7f51063e7640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5100160f90 con 0x7f51000cd6d0 2023-11-04T01:37:37.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.156+0000 7f51063e7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51000b5200 con 0x7f51000b4880 2023-11-04T01:37:37.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.156+0000 7f5104984640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f51000b4880 0x7f51000b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.156+0000 7f5104984640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f51000b4880 0x7f51000b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37632/0 (socket says 172.21.15.114:37632) 2023-11-04T01:37:37.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.156+0000 7f5104984640 1 -- 172.21.15.114:0/570833976 learned_addr learned my addr 172.21.15.114:0/570833976 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:37.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.157+0000 7f5104984640 1 -- 172.21.15.114:0/570833976 >> v1:172.21.15.141:6789/0 conn(0x7f51000cd6d0 legacy=0x7f5100161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:37.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.157+0000 7f5104984640 1 -- 172.21.15.114:0/570833976 >> v1:172.21.15.114:6789/0 conn(0x7f5100153e60 legacy=0x7f510015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.157+0000 7f5104984640 1 -- 172.21.15.114:0/570833976 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51000ce090 con 0x7f51000b4880 2023-11-04T01:37:37.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.157+0000 7f5104984640 1 --2- 172.21.15.114:0/570833976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51000b4880 0x7f51000b4cc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009e50 tx=0x7f50f802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7d2b63296595dc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.157+0000 7f50feffd640 1 -- 172.21.15.114:0/570833976 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f802cb20 con 0x7f51000b4880 2023-11-04T01:37:37.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.157+0000 7f50feffd640 1 -- 172.21.15.114:0/570833976 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f802cc80 con 0x7f51000b4880 2023-11-04T01:37:37.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.157+0000 7f50feffd640 1 -- 172.21.15.114:0/570833976 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f80343f0 con 0x7f51000b4880 2023-11-04T01:37:37.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.158+0000 7f51063e7640 1 -- 172.21.15.114:0/570833976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51000b4880 msgr2=0x7f51000b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.158+0000 7f51063e7640 1 --2- 172.21.15.114:0/570833976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51000b4880 0x7f51000b4cc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009e50 tx=0x7f50f802bf80 comp rx=0 tx=0).stop 2023-11-04T01:37:37.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.158+0000 7f51063e7640 1 -- 172.21.15.114:0/570833976 shutdown_connections 2023-11-04T01:37:37.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.158+0000 7f51063e7640 1 --2- 172.21.15.114:0/570833976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51000b4880 0x7f51000b4cc0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.158+0000 7f51063e7640 1 -- 172.21.15.114:0/570833976 >> 172.21.15.114:0/570833976 conn(0x7f51000cf880 msgr2=0x7f51000cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:37.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.158+0000 7f51063e7640 1 -- 172.21.15.114:0/570833976 shutdown_connections 2023-11-04T01:37:37.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.158+0000 7f51063e7640 1 -- 172.21.15.114:0/570833976 wait complete. 2023-11-04T01:37:37.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.159+0000 7f51063e7640 1 Processor -- start 2023-11-04T01:37:37.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.159+0000 7f51063e7640 1 -- start start 2023-11-04T01:37:37.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.160+0000 7f51063e7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51000b4880 0x7f5100152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.160+0000 7f51063e7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51000cd6d0 0x7f5100154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.160+0000 7f51063e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5100153e60 0x7f5100156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.160+0000 7f51063e7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5100157870 con 0x7f5100153e60 2023-11-04T01:37:37.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.160+0000 7f51063e7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51001572b0 con 0x7f51000cd6d0 2023-11-04T01:37:37.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.160+0000 7f51063e7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5100157590 con 0x7f51000b4880 2023-11-04T01:37:37.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.160+0000 7f5104984640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5100153e60 0x7f5100156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.160+0000 7f5104984640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5100153e60 0x7f5100156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37638/0 (socket says 172.21.15.114:37638) 2023-11-04T01:37:37.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.160+0000 7f5104984640 1 -- 172.21.15.114:0/1287945895 learned_addr learned my addr 172.21.15.114:0/1287945895 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:37.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.160+0000 7f5104984640 1 -- 172.21.15.114:0/1287945895 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51000b4880 msgr2=0x7f5100152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.160+0000 7f5104984640 1 --2- 172.21.15.114:0/1287945895 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51000b4880 0x7f5100152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.160+0000 7f5104984640 1 -- 172.21.15.114:0/1287945895 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51000cd6d0 msgr2=0x7f5100154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.160+0000 7f5104984640 1 --2- 172.21.15.114:0/1287945895 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51000cd6d0 0x7f5100154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.160+0000 7f5104984640 1 -- 172.21.15.114:0/1287945895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f8009b30 con 0x7f5100153e60 2023-11-04T01:37:37.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.161+0000 7f5104984640 1 --2- 172.21.15.114:0/1287945895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5100153e60 0x7f5100156a50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f50f8036040 tx=0x7f50f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.161+0000 7f50fcff9640 1 -- 172.21.15.114:0/1287945895 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8009510 con 0x7f5100153e60 2023-11-04T01:37:37.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.161+0000 7f50fcff9640 1 -- 172.21.15.114:0/1287945895 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f8007e50 con 0x7f5100153e60 2023-11-04T01:37:37.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.161+0000 7f51063e7640 1 -- 172.21.15.114:0/1287945895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51000c6b50 con 0x7f5100153e60 2023-11-04T01:37:37.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.161+0000 7f50fcff9640 1 -- 172.21.15.114:0/1287945895 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f803e690 con 0x7f5100153e60 2023-11-04T01:37:37.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.161+0000 7f51063e7640 1 -- 172.21.15.114:0/1287945895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5100156f90 con 0x7f5100153e60 2023-11-04T01:37:37.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.162+0000 7f51063e7640 1 -- 172.21.15.114:0/1287945895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51000c69b0 con 0x7f5100153e60 2023-11-04T01:37:37.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.162+0000 7f50fcff9640 1 -- 172.21.15.114:0/1287945895 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f50f803e7f0 con 0x7f5100153e60 2023-11-04T01:37:37.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.162+0000 7f50fcff9640 1 --2- 172.21.15.114:0/1287945895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f50ec06ae70 0x7f50ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.163+0000 7f50fcff9640 1 -- 172.21.15.114:0/1287945895 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f50f80ac680 con 0x7f5100153e60 2023-11-04T01:37:37.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.163+0000 7f50fffff640 1 --2- 172.21.15.114:0/1287945895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f50ec06ae70 0x7f50ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.163+0000 7f50fffff640 1 --2- 172.21.15.114:0/1287945895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f50ec06ae70 0x7f50ec06d330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f50f0000f60 tx=0x7f50f00079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.167+0000 7f50fcff9640 1 -- 172.21.15.114:0/1287945895 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51000c69b0 con 0x7f5100153e60 2023-11-04T01:37:37.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.333+0000 7f51063e7640 1 -- 172.21.15.114:0/1287945895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51000c7070 con 0x7f5100153e60 2023-11-04T01:37:37.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.333+0000 7f50fcff9640 1 -- 172.21.15.114:0/1287945895 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51000c7070 con 0x7f5100153e60 2023-11-04T01:37:37.336 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:37:37.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.335+0000 7f51063e7640 1 -- 172.21.15.114:0/1287945895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f50ec06ae70 msgr2=0x7f50ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.335+0000 7f51063e7640 1 --2- 172.21.15.114:0/1287945895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f50ec06ae70 0x7f50ec06d330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f50f0000f60 tx=0x7f50f00079b0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.335+0000 7f51063e7640 1 -- 172.21.15.114:0/1287945895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5100153e60 msgr2=0x7f5100156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.335+0000 7f51063e7640 1 --2- 172.21.15.114:0/1287945895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5100153e60 0x7f5100156a50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f50f8036040 tx=0x7f50f8004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.335+0000 7f51063e7640 1 -- 172.21.15.114:0/1287945895 shutdown_connections 2023-11-04T01:37:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.335+0000 7f51063e7640 1 --2- 172.21.15.114:0/1287945895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5100153e60 0x7f5100156a50 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.335+0000 7f51063e7640 1 --2- 172.21.15.114:0/1287945895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f50ec06ae70 0x7f50ec06d330 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.335+0000 7f51063e7640 1 --2- 172.21.15.114:0/1287945895 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51000cd6d0 0x7f5100154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.335+0000 7f51063e7640 1 --2- 172.21.15.114:0/1287945895 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51000b4880 0x7f5100152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.335+0000 7f51063e7640 1 -- 172.21.15.114:0/1287945895 >> 172.21.15.114:0/1287945895 conn(0x7f51000cf880 msgr2=0x7f510015bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.335+0000 7f51063e7640 1 -- 172.21.15.114:0/1287945895 shutdown_connections 2023-11-04T01:37:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.335+0000 7f51063e7640 1 -- 172.21.15.114:0/1287945895 wait complete. 2023-11-04T01:37:37.349 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:37:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.448+0000 7fb576316640 1 Processor -- start 2023-11-04T01:37:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.448+0000 7fb576316640 1 -- start start 2023-11-04T01:37:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.449+0000 7fb576316640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb5701605b0 0x7fb5700ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.449+0000 7fb576316640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb5700b1a40 0x7fb57006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.449+0000 7fb576316640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb570160990 con 0x7fb5700ca560 2023-11-04T01:37:37.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.449+0000 7fb576316640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5700cc7c0 con 0x7fb5700b1a40 2023-11-04T01:37:37.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.449+0000 7fb576316640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5700cd750 con 0x7fb5701605b0 2023-11-04T01:37:37.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.449+0000 7fb56f7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb5700b1a40 0x7fb57006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.449+0000 7fb56f7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb5700b1a40 0x7fb57006a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37654/0 (socket says 172.21.15.114:37654) 2023-11-04T01:37:37.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.449+0000 7fb56f7fe640 1 -- 172.21.15.114:0/915205834 learned_addr learned my addr 172.21.15.114:0/915205834 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:37.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.449+0000 7fb56ffff640 1 --2- 172.21.15.114:0/915205834 >> v2:172.21.15.141:3300/0 conn(0x7fb5701605b0 0x7fb5700ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.449+0000 7fb56f7fe640 1 -- 172.21.15.114:0/915205834 >> v2:172.21.15.141:3300/0 conn(0x7fb5701605b0 msgr2=0x7fb5700ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:37.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.449+0000 7fb56f7fe640 1 --2- 172.21.15.114:0/915205834 >> v2:172.21.15.141:3300/0 conn(0x7fb5701605b0 0x7fb5700ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.450+0000 7fb56f7fe640 1 -- 172.21.15.114:0/915205834 >> v1:172.21.15.141:6789/0 conn(0x7fb5700ca560 legacy=0x7fb570160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.450+0000 7fb56f7fe640 1 -- 172.21.15.114:0/915205834 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5700cc4e0 con 0x7fb5700b1a40 2023-11-04T01:37:37.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.450+0000 7fb56f7fe640 1 --2- 172.21.15.114:0/915205834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5700b1a40 0x7fb57006a120 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb570072900 tx=0x7fb56402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cca03c9b25fd5e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.450+0000 7fb56effd640 1 -- 172.21.15.114:0/915205834 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5640317e0 con 0x7fb5700b1a40 2023-11-04T01:37:37.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.450+0000 7fb56effd640 1 -- 172.21.15.114:0/915205834 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb564031940 con 0x7fb5700b1a40 2023-11-04T01:37:37.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.450+0000 7fb56effd640 1 -- 172.21.15.114:0/915205834 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564031cd0 con 0x7fb5700b1a40 2023-11-04T01:37:37.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.451+0000 7fb576316640 1 -- 172.21.15.114:0/915205834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5700b1a40 msgr2=0x7fb57006a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.451+0000 7fb576316640 1 --2- 172.21.15.114:0/915205834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5700b1a40 0x7fb57006a120 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb570072900 tx=0x7fb56402b880 comp rx=0 tx=0).stop 2023-11-04T01:37:37.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.451+0000 7fb576316640 1 -- 172.21.15.114:0/915205834 shutdown_connections 2023-11-04T01:37:37.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.451+0000 7fb576316640 1 --2- 172.21.15.114:0/915205834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5700b1a40 0x7fb57006a120 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.451+0000 7fb576316640 1 --2- 172.21.15.114:0/915205834 >> v2:172.21.15.141:3300/0 conn(0x7fb5701605b0 0x7fb5700ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.451+0000 7fb576316640 1 -- 172.21.15.114:0/915205834 >> 172.21.15.114:0/915205834 conn(0x7fb570071820 msgr2=0x7fb570071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:37.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.451+0000 7fb576316640 1 -- 172.21.15.114:0/915205834 shutdown_connections 2023-11-04T01:37:37.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.451+0000 7fb576316640 1 -- 172.21.15.114:0/915205834 wait complete. 2023-11-04T01:37:37.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.452+0000 7fb576316640 1 Processor -- start 2023-11-04T01:37:37.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.452+0000 7fb576316640 1 -- start start 2023-11-04T01:37:37.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.453+0000 7fb576316640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5700ca560 0x7fb5701f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.453+0000 7fb576316640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5701605b0 0x7fb5700b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.453+0000 7fb576316640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5700c6b20 0x7fb5700c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.453+0000 7fb576316640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700c7c30 con 0x7fb5700ca560 2023-11-04T01:37:37.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.453+0000 7fb576316640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5701f2580 con 0x7fb5701605b0 2023-11-04T01:37:37.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.453+0000 7fb576316640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700c7020 con 0x7fb5700c6b20 2023-11-04T01:37:37.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.453+0000 7fb56ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5700ca560 0x7fb5701f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.453+0000 7fb56ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5700ca560 0x7fb5701f2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37660/0 (socket says 172.21.15.114:37660) 2023-11-04T01:37:37.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.453+0000 7fb56ffff640 1 -- 172.21.15.114:0/1064871838 learned_addr learned my addr 172.21.15.114:0/1064871838 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:37.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.453+0000 7fb56ffff640 1 -- 172.21.15.114:0/1064871838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5700c6b20 msgr2=0x7fb5700c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.453+0000 7fb56ffff640 1 --2- 172.21.15.114:0/1064871838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5700c6b20 0x7fb5700c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.453+0000 7fb56ffff640 1 -- 172.21.15.114:0/1064871838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5701605b0 msgr2=0x7fb5700b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.453+0000 7fb56ffff640 1 --2- 172.21.15.114:0/1064871838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5701605b0 0x7fb5700b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.453+0000 7fb56ffff640 1 -- 172.21.15.114:0/1064871838 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640094d0 con 0x7fb5700ca560 2023-11-04T01:37:37.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.454+0000 7fb56ffff640 1 --2- 172.21.15.114:0/1064871838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5700ca560 0x7fb5701f2040 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb56000d800 tx=0x7fb56000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.454+0000 7fb56cff9640 1 -- 172.21.15.114:0/1064871838 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56000b6c0 con 0x7fb5700ca560 2023-11-04T01:37:37.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.454+0000 7fb56cff9640 1 -- 172.21.15.114:0/1064871838 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56000b820 con 0x7fb5700ca560 2023-11-04T01:37:37.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.454+0000 7fb576316640 1 -- 172.21.15.114:0/1064871838 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5700c7300 con 0x7fb5700ca560 2023-11-04T01:37:37.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.454+0000 7fb56cff9640 1 -- 172.21.15.114:0/1064871838 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56000bb90 con 0x7fb5700ca560 2023-11-04T01:37:37.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.454+0000 7fb576316640 1 -- 172.21.15.114:0/1064871838 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5700c78c0 con 0x7fb5700ca560 2023-11-04T01:37:37.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.455+0000 7fb576316640 1 -- 172.21.15.114:0/1064871838 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5700672a0 con 0x7fb5700ca560 2023-11-04T01:37:37.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.455+0000 7fb56cff9640 1 -- 172.21.15.114:0/1064871838 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb56000bcf0 con 0x7fb5700ca560 2023-11-04T01:37:37.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.456+0000 7fb56cff9640 1 --2- 172.21.15.114:0/1064871838 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb55c06ae70 0x7fb55c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.456+0000 7fb56cff9640 1 -- 172.21.15.114:0/1064871838 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb560089f90 con 0x7fb5700ca560 2023-11-04T01:37:37.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.456+0000 7fb56f7fe640 1 --2- 172.21.15.114:0/1064871838 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb55c06ae70 0x7fb55c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.456+0000 7fb56f7fe640 1 --2- 172.21.15.114:0/1064871838 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb55c06ae70 0x7fb55c06d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb564036000 tx=0x7fb564030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.460+0000 7fb56cff9640 1 -- 172.21.15.114:0/1064871838 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb5600bcca0 con 0x7fb5700ca560 2023-11-04T01:37:37.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.625+0000 7fb576316640 1 -- 172.21.15.114:0/1064871838 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb570074290 con 0x7fb5700ca560 2023-11-04T01:37:37.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.626+0000 7fb56cff9640 1 -- 172.21.15.114:0/1064871838 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb560058710 con 0x7fb5700ca560 2023-11-04T01:37:37.629 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:37.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.628+0000 7fb576316640 1 -- 172.21.15.114:0/1064871838 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb55c06ae70 msgr2=0x7fb55c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.628+0000 7fb576316640 1 --2- 172.21.15.114:0/1064871838 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb55c06ae70 0x7fb55c06d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb564036000 tx=0x7fb564030000 comp rx=0 tx=0).stop 2023-11-04T01:37:37.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.628+0000 7fb576316640 1 -- 172.21.15.114:0/1064871838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5700ca560 msgr2=0x7fb5701f2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.628+0000 7fb576316640 1 --2- 172.21.15.114:0/1064871838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5700ca560 0x7fb5701f2040 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb56000d800 tx=0x7fb56000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.628+0000 7fb576316640 1 -- 172.21.15.114:0/1064871838 shutdown_connections 2023-11-04T01:37:37.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.628+0000 7fb576316640 1 --2- 172.21.15.114:0/1064871838 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5700c6b20 0x7fb5700c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.628+0000 7fb576316640 1 --2- 172.21.15.114:0/1064871838 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb55c06ae70 0x7fb55c06d330 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.628+0000 7fb576316640 1 --2- 172.21.15.114:0/1064871838 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5701605b0 0x7fb5700b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.628+0000 7fb576316640 1 --2- 172.21.15.114:0/1064871838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5700ca560 0x7fb5701f2040 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.628+0000 7fb576316640 1 -- 172.21.15.114:0/1064871838 >> 172.21.15.114:0/1064871838 conn(0x7fb570071820 msgr2=0x7fb5700afc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:37.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.628+0000 7fb576316640 1 -- 172.21.15.114:0/1064871838 shutdown_connections 2023-11-04T01:37:37.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.628+0000 7fb576316640 1 -- 172.21.15.114:0/1064871838 wait complete. 2023-11-04T01:37:37.642 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:37:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.741+0000 7f4d14d25640 1 Processor -- start 2023-11-04T01:37:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.741+0000 7f4d14d25640 1 -- start start 2023-11-04T01:37:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.742+0000 7f4d14d25640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d10160600 0x7f4d100cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.742+0000 7f4d14d25640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4d101609e0 0x7f4d100cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.742+0000 7f4d14d25640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1006e1a0 con 0x7f4d100ccde0 2023-11-04T01:37:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.742+0000 7f4d14d25640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d100ce090 con 0x7f4d101609e0 2023-11-04T01:37:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.742+0000 7f4d14d25640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100cd330 con 0x7f4d10160600 2023-11-04T01:37:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.742+0000 7f4d07fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4d101609e0 0x7f4d100cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.742+0000 7f4d07fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4d101609e0 0x7f4d100cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37672/0 (socket says 172.21.15.114:37672) 2023-11-04T01:37:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.742+0000 7f4d07fff640 1 -- 172.21.15.114:0/2591765420 learned_addr learned my addr 172.21.15.114:0/2591765420 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.742+0000 7f4d0e59c640 1 --2- 172.21.15.114:0/2591765420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d10160600 0x7f4d100cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.742+0000 7f4d07fff640 1 -- 172.21.15.114:0/2591765420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d10160600 msgr2=0x7f4d100cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.742+0000 7f4d07fff640 1 --2- 172.21.15.114:0/2591765420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d10160600 0x7f4d100cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.742+0000 7f4d07fff640 1 -- 172.21.15.114:0/2591765420 >> v1:172.21.15.141:6789/0 conn(0x7f4d100ccde0 legacy=0x7f4d100c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.742+0000 7f4d07fff640 1 -- 172.21.15.114:0/2591765420 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1006db50 con 0x7f4d101609e0 2023-11-04T01:37:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.742+0000 7f4d0e59c640 1 --2- 172.21.15.114:0/2591765420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d10160600 0x7f4d100cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.743+0000 7f4d07fff640 1 --2- 172.21.15.114:0/2591765420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d101609e0 0x7f4d100cdb50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009870 tx=0x7f4cf802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198d4ee4b238590f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.743+0000 7f4d0dd9b640 1 -- 172.21.15.114:0/2591765420 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf802f840 con 0x7f4d101609e0 2023-11-04T01:37:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.743+0000 7f4d0dd9b640 1 -- 172.21.15.114:0/2591765420 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf802f9a0 con 0x7f4d101609e0 2023-11-04T01:37:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.743+0000 7f4d0dd9b640 1 -- 172.21.15.114:0/2591765420 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf802fd30 con 0x7f4d101609e0 2023-11-04T01:37:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.744+0000 7f4d14d25640 1 -- 172.21.15.114:0/2591765420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d101609e0 msgr2=0x7f4d100cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.744+0000 7f4d14d25640 1 --2- 172.21.15.114:0/2591765420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d101609e0 0x7f4d100cdb50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009870 tx=0x7f4cf802ba20 comp rx=0 tx=0).stop 2023-11-04T01:37:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.744+0000 7f4d14d25640 1 -- 172.21.15.114:0/2591765420 shutdown_connections 2023-11-04T01:37:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.744+0000 7f4d14d25640 1 --2- 172.21.15.114:0/2591765420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d101609e0 0x7f4d100cdb50 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.744+0000 7f4d14d25640 1 --2- 172.21.15.114:0/2591765420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d10160600 0x7f4d100cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.744+0000 7f4d14d25640 1 -- 172.21.15.114:0/2591765420 >> 172.21.15.114:0/2591765420 conn(0x7f4d1006a120 msgr2=0x7f4d1006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.744+0000 7f4d14d25640 1 -- 172.21.15.114:0/2591765420 shutdown_connections 2023-11-04T01:37:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.744+0000 7f4d14d25640 1 -- 172.21.15.114:0/2591765420 wait complete. 2023-11-04T01:37:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.745+0000 7f4d14d25640 1 Processor -- start 2023-11-04T01:37:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.745+0000 7f4d14d25640 1 -- start start 2023-11-04T01:37:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d14d25640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d100ccde0 0x7f4d10149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d14d25640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d10160600 0x7f4d10149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d14d25640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d101609e0 0x7f4d100c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d14d25640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100c82e0 con 0x7f4d10160600 2023-11-04T01:37:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d14d25640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100c7710 con 0x7f4d100ccde0 2023-11-04T01:37:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d14d25640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d10149a60 con 0x7f4d101609e0 2023-11-04T01:37:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d07fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d10160600 0x7f4d10149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d07fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d10160600 0x7f4d10149d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37680/0 (socket says 172.21.15.114:37680) 2023-11-04T01:37:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d07fff640 1 -- 172.21.15.114:0/1978663680 learned_addr learned my addr 172.21.15.114:0/1978663680 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d0e59c640 1 --2- 172.21.15.114:0/1978663680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d100ccde0 0x7f4d10149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d0ed9d640 1 --2- 172.21.15.114:0/1978663680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d101609e0 0x7f4d100c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d07fff640 1 -- 172.21.15.114:0/1978663680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d101609e0 msgr2=0x7f4d100c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d07fff640 1 --2- 172.21.15.114:0/1978663680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d101609e0 0x7f4d100c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d07fff640 1 -- 172.21.15.114:0/1978663680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d100ccde0 msgr2=0x7f4d10149520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d07fff640 1 --2- 172.21.15.114:0/1978663680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d100ccde0 0x7f4d10149520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d07fff640 1 -- 172.21.15.114:0/1978663680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf80094d0 con 0x7f4d10160600 2023-11-04T01:37:37.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d07fff640 1 --2- 172.21.15.114:0/1978663680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d10160600 0x7f4d10149d90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009870 tx=0x7f4cf8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d06ffd640 1 -- 172.21.15.114:0/1978663680 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8037c40 con 0x7f4d10160600 2023-11-04T01:37:37.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d06ffd640 1 -- 172.21.15.114:0/1978663680 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf8037da0 con 0x7f4d10160600 2023-11-04T01:37:37.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d06ffd640 1 -- 172.21.15.114:0/1978663680 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8041640 con 0x7f4d10160600 2023-11-04T01:37:37.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.746+0000 7f4d14d25640 1 -- 172.21.15.114:0/1978663680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d100c79b0 con 0x7f4d10160600 2023-11-04T01:37:37.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.747+0000 7f4d14d25640 1 -- 172.21.15.114:0/1978663680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d100c7f70 con 0x7f4d10160600 2023-11-04T01:37:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.747+0000 7f4d14d25640 1 -- 172.21.15.114:0/1978663680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d100c8490 con 0x7f4d10160600 2023-11-04T01:37:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.748+0000 7f4d06ffd640 1 -- 172.21.15.114:0/1978663680 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4cf80417a0 con 0x7f4d10160600 2023-11-04T01:37:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.748+0000 7f4d06ffd640 1 --2- 172.21.15.114:0/1978663680 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4cf006aea0 0x7f4cf006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.748+0000 7f4d06ffd640 1 -- 172.21.15.114:0/1978663680 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4cf803c070 con 0x7f4d10160600 2023-11-04T01:37:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.748+0000 7f4d0e59c640 1 --2- 172.21.15.114:0/1978663680 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4cf006aea0 0x7f4cf006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.749+0000 7f4d0e59c640 1 --2- 172.21.15.114:0/1978663680 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4cf006aea0 0x7f4cf006d360 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4d00006fd0 tx=0x7f4d00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:37.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.752+0000 7f4d06ffd640 1 -- 172.21.15.114:0/1978663680 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d100c8490 con 0x7f4d10160600 2023-11-04T01:37:37.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.922+0000 7f4d14d25640 1 -- 172.21.15.114:0/1978663680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d10074290 con 0x7f4d10160600 2023-11-04T01:37:37.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.922+0000 7f4d06ffd640 1 -- 172.21.15.114:0/1978663680 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4cf80774c0 con 0x7f4d10160600 2023-11-04T01:37:37.925 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:37:37.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.924+0000 7f4d14d25640 1 -- 172.21.15.114:0/1978663680 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4cf006aea0 msgr2=0x7f4cf006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.924+0000 7f4d14d25640 1 --2- 172.21.15.114:0/1978663680 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4cf006aea0 0x7f4cf006d360 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4d00006fd0 tx=0x7f4d00008040 comp rx=0 tx=0).stop 2023-11-04T01:37:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.924+0000 7f4d14d25640 1 -- 172.21.15.114:0/1978663680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d10160600 msgr2=0x7f4d10149d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.924+0000 7f4d14d25640 1 --2- 172.21.15.114:0/1978663680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d10160600 0x7f4d10149d90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009870 tx=0x7f4cf8004730 comp rx=0 tx=0).stop 2023-11-04T01:37:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.924+0000 7f4d14d25640 1 -- 172.21.15.114:0/1978663680 shutdown_connections 2023-11-04T01:37:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.924+0000 7f4d14d25640 1 --2- 172.21.15.114:0/1978663680 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4d101609e0 0x7f4d100c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.924+0000 7f4d14d25640 1 --2- 172.21.15.114:0/1978663680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d10160600 0x7f4d10149d90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.924+0000 7f4d14d25640 1 --2- 172.21.15.114:0/1978663680 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4cf006aea0 0x7f4cf006d360 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.924+0000 7f4d14d25640 1 --2- 172.21.15.114:0/1978663680 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4d100ccde0 0x7f4d10149520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.924+0000 7f4d14d25640 1 -- 172.21.15.114:0/1978663680 >> 172.21.15.114:0/1978663680 conn(0x7f4d1006a120 msgr2=0x7f4d1015d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.924+0000 7f4d14d25640 1 -- 172.21.15.114:0/1978663680 shutdown_connections 2023-11-04T01:37:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:37.924+0000 7f4d14d25640 1 -- 172.21.15.114:0/1978663680 wait complete. 2023-11-04T01:37:37.938 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:37:38.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.037+0000 7ff058821640 1 Processor -- start 2023-11-04T01:37:38.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.037+0000 7ff058821640 1 -- start start 2023-11-04T01:37:38.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff058821640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff0540ca0a0 0x7ff0540cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff058821640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0540cc300 0x7ff0540cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff058821640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0540caa20 con 0x7ff05415e3f0 2023-11-04T01:37:38.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff058821640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0540b3300 con 0x7ff0540ca0a0 2023-11-04T01:37:38.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff058821640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0540cb230 con 0x7ff0540cc300 2023-11-04T01:37:38.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff05259c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff05415e3f0 0x7ff0540b2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56800/0 (socket says 172.21.15.114:56800) 2023-11-04T01:37:38.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff05259c640 1 -- 172.21.15.114:0/3936853891 learned_addr learned my addr 172.21.15.114:0/3936853891 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:38.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff051d9b640 1 -- 172.21.15.114:0/3936853891 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159031052 0 0) 0x7ff0540caa20 con 0x7ff05415e3f0 2023-11-04T01:37:38.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff051d9b640 1 -- 172.21.15.114:0/3936853891 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff040003520 con 0x7ff05415e3f0 2023-11-04T01:37:38.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff049d9b640 1 --2- 172.21.15.114:0/3936853891 >> v2:172.21.15.141:3300/0 conn(0x7ff0540ca0a0 0x7ff0540cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff052d9d640 1 --2- 172.21.15.114:0/3936853891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0540cc300 0x7ff0540cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff051d9b640 1 -- 172.21.15.114:0/3936853891 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4210530615 0 0) 0x7ff040003520 con 0x7ff05415e3f0 2023-11-04T01:37:38.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff051d9b640 1 -- 172.21.15.114:0/3936853891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0540cc300 msgr2=0x7ff0540cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff051d9b640 1 --2- 172.21.15.114:0/3936853891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0540cc300 0x7ff0540cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff051d9b640 1 -- 172.21.15.114:0/3936853891 >> v2:172.21.15.141:3300/0 conn(0x7ff0540ca0a0 msgr2=0x7ff0540cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff051d9b640 1 --2- 172.21.15.114:0/3936853891 >> v2:172.21.15.141:3300/0 conn(0x7ff0540ca0a0 0x7ff0540cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff051d9b640 1 -- 172.21.15.114:0/3936853891 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0540ca530 con 0x7ff05415e3f0 2023-11-04T01:37:38.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff051d9b640 1 -- 172.21.15.114:0/3936853891 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7ff044001670 con 0x7ff05415e3f0 2023-11-04T01:37:38.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff051d9b640 1 -- 172.21.15.114:0/3936853891 >> v1:172.21.15.114:6789/0 conn(0x7ff05415e3f0 legacy=0x7ff0540b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff051d9b640 1 --2- 172.21.15.114:0/3936853891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff040003970 0x7ff040003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff051d9b640 1 --2- 172.21.15.114:0/3936853891 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0400047c0 0x7ff040004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff051d9b640 1 --2- 172.21.15.114:0/3936853891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0540cc300 0x7ff040005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff051d9b640 1 -- 172.21.15.114:0/3936853891 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0540b3300 con 0x7ff040003970 2023-11-04T01:37:38.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff051d9b640 1 -- 172.21.15.114:0/3936853891 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0540cb230 con 0x7ff0400047c0 2023-11-04T01:37:38.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff051d9b640 1 -- 172.21.15.114:0/3936853891 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04000ba30 con 0x7ff0540cc300 2023-11-04T01:37:38.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.038+0000 7ff05259c640 1 --2- 172.21.15.114:0/3936853891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff040003970 0x7ff040003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.039+0000 7ff049d9b640 1 --2- 172.21.15.114:0/3936853891 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0400047c0 0x7ff040004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.039+0000 7ff052d9d640 1 --2- 172.21.15.114:0/3936853891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0540cc300 0x7ff040005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.039+0000 7ff05259c640 1 -- 172.21.15.114:0/3936853891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0540cc300 msgr2=0x7ff040005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.039+0000 7ff05259c640 1 --2- 172.21.15.114:0/3936853891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0540cc300 0x7ff040005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.039+0000 7ff05259c640 1 -- 172.21.15.114:0/3936853891 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0400047c0 msgr2=0x7ff040004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.039+0000 7ff05259c640 1 --2- 172.21.15.114:0/3936853891 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0400047c0 0x7ff040004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.039+0000 7ff05259c640 1 -- 172.21.15.114:0/3936853891 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff040003520 con 0x7ff040003970 2023-11-04T01:37:38.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.039+0000 7ff05259c640 1 --2- 172.21.15.114:0/3936853891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff040003970 0x7ff040003d90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff04400c210 tx=0x7ff0400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77b5671a6e722f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.040+0000 7ff051d9b640 1 -- 172.21.15.114:0/3936853891 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044005ad0 con 0x7ff040003970 2023-11-04T01:37:38.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.040+0000 7ff051d9b640 1 -- 172.21.15.114:0/3936853891 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff044005c30 con 0x7ff040003970 2023-11-04T01:37:38.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.040+0000 7ff051d9b640 1 -- 172.21.15.114:0/3936853891 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04402c8a0 con 0x7ff040003970 2023-11-04T01:37:38.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.040+0000 7ff058821640 1 -- 172.21.15.114:0/3936853891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff040003970 msgr2=0x7ff040003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.040+0000 7ff058821640 1 --2- 172.21.15.114:0/3936853891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff040003970 0x7ff040003d90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff04400c210 tx=0x7ff0400057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.040+0000 7ff052d9d640 1 -- 172.21.15.114:0/3936853891 reap_dead start 2023-11-04T01:37:38.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.040+0000 7ff058821640 1 -- 172.21.15.114:0/3936853891 shutdown_connections 2023-11-04T01:37:38.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.040+0000 7ff058821640 1 -- 172.21.15.114:0/3936853891 >> 172.21.15.114:0/3936853891 conn(0x7ff054071820 msgr2=0x7ff054071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.040+0000 7ff058821640 1 -- 172.21.15.114:0/3936853891 shutdown_connections 2023-11-04T01:37:38.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.040+0000 7ff058821640 1 -- 172.21.15.114:0/3936853891 wait complete. 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.042+0000 7ff058821640 1 Processor -- start 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.042+0000 7ff058821640 1 -- start start 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.042+0000 7ff058821640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff040003970 0x7ff054157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.042+0000 7ff058821640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff05414fb00 0x7ff0540c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.042+0000 7ff058821640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0541efd60 0x7ff0540c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.042+0000 7ff058821640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05415bad0 con 0x7ff040003970 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.042+0000 7ff058821640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff054150010 con 0x7ff05414fb00 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.042+0000 7ff058821640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0541502f0 con 0x7ff0541efd60 2023-11-04T01:37:38.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.042+0000 7ff05259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff040003970 0x7ff054157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.042+0000 7ff05259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff040003970 0x7ff054157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37700/0 (socket says 172.21.15.114:37700) 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.042+0000 7ff05259c640 1 -- 172.21.15.114:0/2598870299 learned_addr learned my addr 172.21.15.114:0/2598870299 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.042+0000 7ff052d9d640 1 --2- 172.21.15.114:0/2598870299 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0541efd60 0x7ff0540c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.042+0000 7ff049d9b640 1 --2- 172.21.15.114:0/2598870299 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff05414fb00 0x7ff0540c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.043+0000 7ff05259c640 1 -- 172.21.15.114:0/2598870299 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0541efd60 msgr2=0x7ff0540c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.043+0000 7ff05259c640 1 --2- 172.21.15.114:0/2598870299 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0541efd60 0x7ff0540c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.043+0000 7ff05259c640 1 -- 172.21.15.114:0/2598870299 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff05414fb00 msgr2=0x7ff0540c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.043+0000 7ff05259c640 1 --2- 172.21.15.114:0/2598870299 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff05414fb00 0x7ff0540c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.043+0000 7ff05259c640 1 -- 172.21.15.114:0/2598870299 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05415bd20 con 0x7ff040003970 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.043+0000 7ff05259c640 1 --2- 172.21.15.114:0/2598870299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff040003970 0x7ff054157430 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff04402c440 tx=0x7ff044001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.043+0000 7ff04b7fe640 1 -- 172.21.15.114:0/2598870299 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044039070 con 0x7ff040003970 2023-11-04T01:37:38.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.043+0000 7ff04b7fe640 1 -- 172.21.15.114:0/2598870299 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04402ccb0 con 0x7ff040003970 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.043+0000 7ff04b7fe640 1 -- 172.21.15.114:0/2598870299 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04403c040 con 0x7ff040003970 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.043+0000 7ff058821640 1 -- 172.21.15.114:0/2598870299 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05415c000 con 0x7ff040003970 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.043+0000 7ff058821640 1 -- 172.21.15.114:0/2598870299 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05415dc50 con 0x7ff040003970 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.044+0000 7ff058821640 1 -- 172.21.15.114:0/2598870299 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff054074290 con 0x7ff040003970 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.045+0000 7ff04b7fe640 1 -- 172.21.15.114:0/2598870299 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff044032070 con 0x7ff040003970 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.045+0000 7ff04b7fe640 1 --2- 172.21.15.114:0/2598870299 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff03406ae70 0x7ff03406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.045+0000 7ff04b7fe640 1 -- 172.21.15.114:0/2598870299 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff0440aaaa0 con 0x7ff040003970 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.045+0000 7ff049d9b640 1 --2- 172.21.15.114:0/2598870299 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff03406ae70 0x7ff03406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.045+0000 7ff049d9b640 1 --2- 172.21.15.114:0/2598870299 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff03406ae70 0x7ff03406d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff05414ff40 tx=0x7ff03c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.050+0000 7ff04b7fe640 1 -- 172.21.15.114:0/2598870299 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff0440758d0 con 0x7ff040003970 2023-11-04T01:37:38.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.213+0000 7ff058821640 1 -- 172.21.15.114:0/2598870299 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff0540cce20 con 0x7ff040003970 2023-11-04T01:37:38.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.213+0000 7ff04b7fe640 1 -- 172.21.15.114:0/2598870299 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff044078ef0 con 0x7ff040003970 2023-11-04T01:37:38.216 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:37:38.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.215+0000 7ff058821640 1 -- 172.21.15.114:0/2598870299 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff03406ae70 msgr2=0x7ff03406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.215+0000 7ff058821640 1 --2- 172.21.15.114:0/2598870299 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff03406ae70 0x7ff03406d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff05414ff40 tx=0x7ff03c008040 comp rx=0 tx=0).stop 2023-11-04T01:37:38.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.215+0000 7ff058821640 1 -- 172.21.15.114:0/2598870299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff040003970 msgr2=0x7ff054157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.215+0000 7ff058821640 1 --2- 172.21.15.114:0/2598870299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff040003970 0x7ff054157430 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff04402c440 tx=0x7ff044001a00 comp rx=0 tx=0).stop 2023-11-04T01:37:38.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.215+0000 7ff058821640 1 -- 172.21.15.114:0/2598870299 shutdown_connections 2023-11-04T01:37:38.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.215+0000 7ff058821640 1 --2- 172.21.15.114:0/2598870299 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff0541efd60 0x7ff0540c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.215+0000 7ff058821640 1 --2- 172.21.15.114:0/2598870299 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff03406ae70 0x7ff03406d330 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.215+0000 7ff058821640 1 --2- 172.21.15.114:0/2598870299 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff05414fb00 0x7ff0540c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.215+0000 7ff058821640 1 --2- 172.21.15.114:0/2598870299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff040003970 0x7ff054157430 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.215+0000 7ff058821640 1 -- 172.21.15.114:0/2598870299 >> 172.21.15.114:0/2598870299 conn(0x7ff054071820 msgr2=0x7ff05415af00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.215+0000 7ff058821640 1 -- 172.21.15.114:0/2598870299 shutdown_connections 2023-11-04T01:37:38.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.215+0000 7ff058821640 1 -- 172.21.15.114:0/2598870299 wait complete. 2023-11-04T01:37:38.230 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:38.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.327+0000 7f6aecb1d640 1 Processor -- start 2023-11-04T01:37:38.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.327+0000 7f6aecb1d640 1 -- start start 2023-11-04T01:37:38.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.327+0000 7f6aecb1d640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6ae80cde60 0x7f6ae815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.327+0000 7f6aecb1d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ae815daa0 0x7f6ae8157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.327+0000 7f6aecb1d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae815e000 con 0x7f6ae80ce240 2023-11-04T01:37:38.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.327+0000 7f6aecb1d640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae815e5c0 con 0x7f6ae80cde60 2023-11-04T01:37:38.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.327+0000 7f6aecb1d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae815e2e0 con 0x7f6ae815daa0 2023-11-04T01:37:38.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae6d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6ae80ce240 0x7f6ae806b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56806/0 (socket says 172.21.15.114:56806) 2023-11-04T01:37:38.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae6d9d640 1 -- 172.21.15.114:0/1854831159 learned_addr learned my addr 172.21.15.114:0/1854831159 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:38.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae5d9b640 1 --2- 172.21.15.114:0/1854831159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ae815daa0 0x7f6ae8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae659c640 1 --2- 172.21.15.114:0/1854831159 >> v2:172.21.15.141:3300/0 conn(0x7f6ae80cde60 0x7f6ae815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae559a640 1 -- 172.21.15.114:0/1854831159 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344676757 0 0) 0x7f6ae815e000 con 0x7f6ae80ce240 2023-11-04T01:37:38.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae559a640 1 -- 172.21.15.114:0/1854831159 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ad0003520 con 0x7f6ae80ce240 2023-11-04T01:37:38.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae559a640 1 -- 172.21.15.114:0/1854831159 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 412096121 0 0) 0x7f6ad0003520 con 0x7f6ae80ce240 2023-11-04T01:37:38.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae559a640 1 -- 172.21.15.114:0/1854831159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ae815daa0 msgr2=0x7f6ae8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae559a640 1 --2- 172.21.15.114:0/1854831159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ae815daa0 0x7f6ae8157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae559a640 1 -- 172.21.15.114:0/1854831159 >> v2:172.21.15.141:3300/0 conn(0x7f6ae80cde60 msgr2=0x7f6ae815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae559a640 1 --2- 172.21.15.114:0/1854831159 >> v2:172.21.15.141:3300/0 conn(0x7f6ae80cde60 0x7f6ae815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae559a640 1 -- 172.21.15.114:0/1854831159 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae80d1120 con 0x7f6ae80ce240 2023-11-04T01:37:38.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae559a640 1 -- 172.21.15.114:0/1854831159 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f6ae00019f0 con 0x7f6ae80ce240 2023-11-04T01:37:38.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae559a640 1 -- 172.21.15.114:0/1854831159 >> v1:172.21.15.114:6789/0 conn(0x7f6ae80ce240 legacy=0x7f6ae806b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae559a640 1 --2- 172.21.15.114:0/1854831159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad0003970 0x7f6ad0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae559a640 1 --2- 172.21.15.114:0/1854831159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ae815daa0 0x7f6ad00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae559a640 1 --2- 172.21.15.114:0/1854831159 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ad0004d00 0x7f6ad0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae559a640 1 -- 172.21.15.114:0/1854831159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae815e5c0 con 0x7f6ad0003970 2023-11-04T01:37:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae559a640 1 -- 172.21.15.114:0/1854831159 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae815e2e0 con 0x7f6ad0004d00 2023-11-04T01:37:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae559a640 1 -- 172.21.15.114:0/1854831159 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad000b980 con 0x7f6ae815daa0 2023-11-04T01:37:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae659c640 1 --2- 172.21.15.114:0/1854831159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad0003970 0x7f6ad0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae5d9b640 1 --2- 172.21.15.114:0/1854831159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ae815daa0 0x7f6ad00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae6d9d640 1 --2- 172.21.15.114:0/1854831159 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ad0004d00 0x7f6ad0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae659c640 1 -- 172.21.15.114:0/1854831159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ae815daa0 msgr2=0x7f6ad00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae659c640 1 --2- 172.21.15.114:0/1854831159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ae815daa0 0x7f6ad00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae659c640 1 -- 172.21.15.114:0/1854831159 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ad0004d00 msgr2=0x7f6ad0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae659c640 1 --2- 172.21.15.114:0/1854831159 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ad0004d00 0x7f6ad0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae659c640 1 -- 172.21.15.114:0/1854831159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad0003520 con 0x7f6ad0003970 2023-11-04T01:37:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.328+0000 7f6ae5d9b640 1 --2- 172.21.15.114:0/1854831159 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ae815daa0 0x7f6ad00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.329+0000 7f6ae659c640 1 --2- 172.21.15.114:0/1854831159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad0003970 0x7f6ad0003d90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009af0 tx=0x7f6ad00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61bf8a8ec546a533 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.329+0000 7f6ae559a640 1 -- 172.21.15.114:0/1854831159 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc02c710 con 0x7f6ad0003970 2023-11-04T01:37:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.329+0000 7f6ae559a640 1 -- 172.21.15.114:0/1854831159 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6adc02c870 con 0x7f6ad0003970 2023-11-04T01:37:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.329+0000 7f6ae559a640 1 -- 172.21.15.114:0/1854831159 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc02cc00 con 0x7f6ad0003970 2023-11-04T01:37:38.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.330+0000 7f6aecb1d640 1 -- 172.21.15.114:0/1854831159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad0003970 msgr2=0x7f6ad0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.330+0000 7f6aecb1d640 1 --2- 172.21.15.114:0/1854831159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad0003970 0x7f6ad0003d90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009af0 tx=0x7f6ad00057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.330+0000 7f6ae6d9d640 1 -- 172.21.15.114:0/1854831159 reap_dead start 2023-11-04T01:37:38.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.330+0000 7f6aecb1d640 1 -- 172.21.15.114:0/1854831159 shutdown_connections 2023-11-04T01:37:38.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.330+0000 7f6aecb1d640 1 -- 172.21.15.114:0/1854831159 >> 172.21.15.114:0/1854831159 conn(0x7f6ae8071f30 msgr2=0x7f6ae80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.330+0000 7f6aecb1d640 1 -- 172.21.15.114:0/1854831159 shutdown_connections 2023-11-04T01:37:38.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.330+0000 7f6aecb1d640 1 -- 172.21.15.114:0/1854831159 wait complete. 2023-11-04T01:37:38.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.331+0000 7f6aecb1d640 1 Processor -- start 2023-11-04T01:37:38.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.331+0000 7f6aecb1d640 1 -- start start 2023-11-04T01:37:38.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.332+0000 7f6aecb1d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad0003970 0x7f6ae81506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.332+0000 7f6aecb1d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ae81523d0 0x7f6ae8153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.332+0000 7f6aecb1d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ae8153540 0x7f6ae814afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.332+0000 7f6aecb1d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae814d910 con 0x7f6ad0003970 2023-11-04T01:37:38.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.332+0000 7f6aecb1d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae814cd90 con 0x7f6ae81523d0 2023-11-04T01:37:38.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.332+0000 7f6aecb1d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae814d070 con 0x7f6ae8153540 2023-11-04T01:37:38.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.332+0000 7f6ae659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad0003970 0x7f6ae81506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.332+0000 7f6ae659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad0003970 0x7f6ae81506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37712/0 (socket says 172.21.15.114:37712) 2023-11-04T01:37:38.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.332+0000 7f6ae659c640 1 -- 172.21.15.114:0/2008127840 learned_addr learned my addr 172.21.15.114:0/2008127840 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:38.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.332+0000 7f6ae659c640 1 -- 172.21.15.114:0/2008127840 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ae8153540 msgr2=0x7f6ae814afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.332+0000 7f6ae659c640 1 --2- 172.21.15.114:0/2008127840 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ae8153540 0x7f6ae814afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.332+0000 7f6ae659c640 1 -- 172.21.15.114:0/2008127840 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ae81523d0 msgr2=0x7f6ae8153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.332+0000 7f6ae659c640 1 --2- 172.21.15.114:0/2008127840 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ae81523d0 0x7f6ae8153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.332+0000 7f6ae659c640 1 -- 172.21.15.114:0/2008127840 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae814d350 con 0x7f6ad0003970 2023-11-04T01:37:38.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.332+0000 7f6ae659c640 1 --2- 172.21.15.114:0/2008127840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad0003970 0x7f6ae81506a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6adc02c2b0 tx=0x7f6adc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.333+0000 7f6ad6ffd640 1 -- 172.21.15.114:0/2008127840 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc003810 con 0x7f6ad0003970 2023-11-04T01:37:38.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.333+0000 7f6ad6ffd640 1 -- 172.21.15.114:0/2008127840 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6adc02de90 con 0x7f6ad0003970 2023-11-04T01:37:38.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.333+0000 7f6aecb1d640 1 -- 172.21.15.114:0/2008127840 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae814d630 con 0x7f6ad0003970 2023-11-04T01:37:38.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.333+0000 7f6ad6ffd640 1 -- 172.21.15.114:0/2008127840 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc003b70 con 0x7f6ad0003970 2023-11-04T01:37:38.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.333+0000 7f6aecb1d640 1 -- 172.21.15.114:0/2008127840 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae8150390 con 0x7f6ad0003970 2023-11-04T01:37:38.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.334+0000 7f6aecb1d640 1 -- 172.21.15.114:0/2008127840 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae8074290 con 0x7f6ad0003970 2023-11-04T01:37:38.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.334+0000 7f6ad6ffd640 1 -- 172.21.15.114:0/2008127840 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6adc003cd0 con 0x7f6ad0003970 2023-11-04T01:37:38.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.334+0000 7f6ad6ffd640 1 --2- 172.21.15.114:0/2008127840 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ac806ae70 0x7f6ac806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.335+0000 7f6ad6ffd640 1 -- 172.21.15.114:0/2008127840 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6adc0ab750 con 0x7f6ad0003970 2023-11-04T01:37:38.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.335+0000 7f6ae5d9b640 1 --2- 172.21.15.114:0/2008127840 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ac806ae70 0x7f6ac806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.335+0000 7f6ae5d9b640 1 --2- 172.21.15.114:0/2008127840 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ac806ae70 0x7f6ac806d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8155c20 tx=0x7f6ad8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.339+0000 7f6ad6ffd640 1 -- 172.21.15.114:0/2008127840 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6adc0764d0 con 0x7f6ad0003970 2023-11-04T01:37:38.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.538+0000 7f6aecb1d640 1 -- 172.21.15.114:0/2008127840 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ae81f5bf0 con 0x7f6ad0003970 2023-11-04T01:37:38.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.539+0000 7f6ad6ffd640 1 -- 172.21.15.114:0/2008127840 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f6adc079af0 con 0x7f6ad0003970 2023-11-04T01:37:38.542 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:38.542 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1590879236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1590879236},{"type":"v1","addr":"172.21.15.141:6834","nonce":1590879236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3079825621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3079825621},{"type":"v1","addr":"172.21.15.114:6835","nonce":3079825621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1526155664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1526155664},{"type":"v1","addr":"172.21.15.114:6837","nonce":1526155664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:36:29.888918+0000","modified":"2023-11-04T01:36:46.975998+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6835/4231924170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4231924170},{"type":"v1","addr":"172.21.15.141:6835","nonce":4231924170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:37:38.542 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2023-11-04T01:37:38.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.540+0000 7f6aecb1d640 1 -- 172.21.15.114:0/2008127840 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ac806ae70 msgr2=0x7f6ac806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.540+0000 7f6aecb1d640 1 --2- 172.21.15.114:0/2008127840 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ac806ae70 0x7f6ac806d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8155c20 tx=0x7f6ad8008040 comp rx=0 tx=0).stop 2023-11-04T01:37:38.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.540+0000 7f6aecb1d640 1 -- 172.21.15.114:0/2008127840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad0003970 msgr2=0x7f6ae81506a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.540+0000 7f6aecb1d640 1 --2- 172.21.15.114:0/2008127840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad0003970 0x7f6ae81506a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6adc02c2b0 tx=0x7f6adc004730 comp rx=0 tx=0).stop 2023-11-04T01:37:38.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.541+0000 7f6aecb1d640 1 -- 172.21.15.114:0/2008127840 shutdown_connections 2023-11-04T01:37:38.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.541+0000 7f6aecb1d640 1 --2- 172.21.15.114:0/2008127840 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ae8153540 0x7f6ae814afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.541+0000 7f6aecb1d640 1 --2- 172.21.15.114:0/2008127840 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ac806ae70 0x7f6ac806d330 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.541+0000 7f6aecb1d640 1 --2- 172.21.15.114:0/2008127840 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ae81523d0 0x7f6ae8153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.541+0000 7f6aecb1d640 1 --2- 172.21.15.114:0/2008127840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad0003970 0x7f6ae81506a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.541+0000 7f6aecb1d640 1 -- 172.21.15.114:0/2008127840 >> 172.21.15.114:0/2008127840 conn(0x7f6ae8071f30 msgr2=0x7f6ae80d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.541+0000 7f6aecb1d640 1 -- 172.21.15.114:0/2008127840 shutdown_connections 2023-11-04T01:37:38.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.541+0000 7f6aecb1d640 1 -- 172.21.15.114:0/2008127840 wait complete. 2023-11-04T01:37:38.555 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:38.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.653+0000 7f1002664640 1 Processor -- start 2023-11-04T01:37:38.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.653+0000 7f1002664640 1 -- start start 2023-11-04T01:37:38.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.653+0000 7f1002664640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ffc0b0ae0 0x7f0ffc0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.653+0000 7f1002664640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0ffc06db20 0x7f0ffc15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.653+0000 7f1002664640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ffc0b4110 con 0x7f0ffc159c70 2023-11-04T01:37:38.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.653+0000 7f1002664640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ffc0b49b0 con 0x7f0ffc06db20 2023-11-04T01:37:38.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.653+0000 7f1002664640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0b43f0 con 0x7f0ffc0b0ae0 2023-11-04T01:37:38.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffbfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0ffc159c70 0x7f0ffc0b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56818/0 (socket says 172.21.15.114:56818) 2023-11-04T01:37:38.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffbfff640 1 -- 172.21.15.114:0/611045709 learned_addr learned my addr 172.21.15.114:0/611045709 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:38.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f1000c01640 1 --2- 172.21.15.114:0/611045709 >> v2:172.21.15.141:3300/0 conn(0x7f0ffc06db20 0x7f0ffc15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffb7fe640 1 --2- 172.21.15.114:0/611045709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ffc0b0ae0 0x7f0ffc0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffaffd640 1 -- 172.21.15.114:0/611045709 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871081486 0 0) 0x7f0ffc0b4110 con 0x7f0ffc159c70 2023-11-04T01:37:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffaffd640 1 -- 172.21.15.114:0/611045709 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fe4003520 con 0x7f0ffc159c70 2023-11-04T01:37:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffaffd640 1 -- 172.21.15.114:0/611045709 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1824837068 0 0) 0x7f0fe4003520 con 0x7f0ffc159c70 2023-11-04T01:37:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffaffd640 1 -- 172.21.15.114:0/611045709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ffc0b0ae0 msgr2=0x7f0ffc0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffaffd640 1 --2- 172.21.15.114:0/611045709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ffc0b0ae0 0x7f0ffc0ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffaffd640 1 -- 172.21.15.114:0/611045709 >> v2:172.21.15.141:3300/0 conn(0x7f0ffc06db20 msgr2=0x7f0ffc15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffaffd640 1 --2- 172.21.15.114:0/611045709 >> v2:172.21.15.141:3300/0 conn(0x7f0ffc06db20 0x7f0ffc15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffaffd640 1 -- 172.21.15.114:0/611045709 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc0b46d0 con 0x7f0ffc159c70 2023-11-04T01:37:38.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffaffd640 1 -- 172.21.15.114:0/611045709 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f0fec001670 con 0x7f0ffc159c70 2023-11-04T01:37:38.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffaffd640 1 -- 172.21.15.114:0/611045709 >> v1:172.21.15.114:6789/0 conn(0x7f0ffc159c70 legacy=0x7f0ffc0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffaffd640 1 --2- 172.21.15.114:0/611045709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ffc0b0ae0 0x7f0fe4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffaffd640 1 --2- 172.21.15.114:0/611045709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fe4003ef0 0x7f0fe40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffaffd640 1 --2- 172.21.15.114:0/611045709 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fe4004d00 0x7f0fe4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffaffd640 1 -- 172.21.15.114:0/611045709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0b49b0 con 0x7f0fe4003ef0 2023-11-04T01:37:38.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffaffd640 1 -- 172.21.15.114:0/611045709 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0b43f0 con 0x7f0fe4004d00 2023-11-04T01:37:38.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffaffd640 1 -- 172.21.15.114:0/611045709 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe400b980 con 0x7f0ffc0b0ae0 2023-11-04T01:37:38.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.654+0000 7f0ffb7fe640 1 --2- 172.21.15.114:0/611045709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fe4003ef0 0x7f0fe40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.655+0000 7f0ffbfff640 1 --2- 172.21.15.114:0/611045709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ffc0b0ae0 0x7f0fe4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.655+0000 7f1000c01640 1 --2- 172.21.15.114:0/611045709 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fe4004d00 0x7f0fe4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.655+0000 7f0ffb7fe640 1 -- 172.21.15.114:0/611045709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ffc0b0ae0 msgr2=0x7f0fe4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.655+0000 7f0ffb7fe640 1 --2- 172.21.15.114:0/611045709 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ffc0b0ae0 0x7f0fe4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.655+0000 7f0ffb7fe640 1 -- 172.21.15.114:0/611045709 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fe4004d00 msgr2=0x7f0fe4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.655+0000 7f0ffb7fe640 1 --2- 172.21.15.114:0/611045709 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fe4004d00 0x7f0fe4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.655+0000 7f0ffb7fe640 1 -- 172.21.15.114:0/611045709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe4003520 con 0x7f0fe4003ef0 2023-11-04T01:37:38.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.655+0000 7f1000c01640 1 --2- 172.21.15.114:0/611045709 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fe4004d00 0x7f0fe4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:38.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.655+0000 7f0ffb7fe640 1 --2- 172.21.15.114:0/611045709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fe4003ef0 0x7f0fe40047c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009ac0 tx=0x7f0fe40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac514a95e8ad0f4e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.656+0000 7f0ffaffd640 1 -- 172.21.15.114:0/611045709 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff002c6b0 con 0x7f0fe4003ef0 2023-11-04T01:37:38.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.656+0000 7f0ffaffd640 1 -- 172.21.15.114:0/611045709 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff002c810 con 0x7f0fe4003ef0 2023-11-04T01:37:38.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.656+0000 7f0ffaffd640 1 -- 172.21.15.114:0/611045709 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff002cba0 con 0x7f0fe4003ef0 2023-11-04T01:37:38.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.656+0000 7f1002664640 1 -- 172.21.15.114:0/611045709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fe4003ef0 msgr2=0x7f0fe40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.656+0000 7f1002664640 1 --2- 172.21.15.114:0/611045709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fe4003ef0 0x7f0fe40047c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009ac0 tx=0x7f0fe40057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.656+0000 7f1000c01640 1 -- 172.21.15.114:0/611045709 reap_dead start 2023-11-04T01:37:38.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.656+0000 7f1002664640 1 -- 172.21.15.114:0/611045709 shutdown_connections 2023-11-04T01:37:38.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.656+0000 7f1002664640 1 -- 172.21.15.114:0/611045709 >> 172.21.15.114:0/611045709 conn(0x7f0ffc0ce950 msgr2=0x7f0ffc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.656+0000 7f1002664640 1 -- 172.21.15.114:0/611045709 shutdown_connections 2023-11-04T01:37:38.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.656+0000 7f1002664640 1 -- 172.21.15.114:0/611045709 wait complete. 2023-11-04T01:37:38.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.657+0000 7f1002664640 1 Processor -- start 2023-11-04T01:37:38.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.658+0000 7f1002664640 1 -- start start 2023-11-04T01:37:38.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.658+0000 7f1002664640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fe4003ef0 0x7f0ffc146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.658+0000 7f1002664640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc0c7b80 0x7f0ffc0c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.658+0000 7f1002664640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ffc157ac0 0x7f0ffc157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.658+0000 7f1002664640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc158480 con 0x7f0ffc0c7b80 2023-11-04T01:37:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.658+0000 7f1002664640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0c8f00 con 0x7f0fe4003ef0 2023-11-04T01:37:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.658+0000 7f1002664640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc1f0870 con 0x7f0ffc157ac0 2023-11-04T01:37:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.658+0000 7f0ffb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc0c7b80 0x7f0ffc0c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.658+0000 7f0ffb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc0c7b80 0x7f0ffc0c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37734/0 (socket says 172.21.15.114:37734) 2023-11-04T01:37:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.658+0000 7f0ffb7fe640 1 -- 172.21.15.114:0/1053894110 learned_addr learned my addr 172.21.15.114:0/1053894110 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.658+0000 7f1000c01640 1 --2- 172.21.15.114:0/1053894110 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ffc157ac0 0x7f0ffc157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.658+0000 7f0ffbfff640 1 --2- 172.21.15.114:0/1053894110 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fe4003ef0 0x7f0ffc146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.659+0000 7f0ffb7fe640 1 -- 172.21.15.114:0/1053894110 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ffc157ac0 msgr2=0x7f0ffc157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.659+0000 7f0ffb7fe640 1 --2- 172.21.15.114:0/1053894110 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ffc157ac0 0x7f0ffc157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.659+0000 7f0ffb7fe640 1 -- 172.21.15.114:0/1053894110 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fe4003ef0 msgr2=0x7f0ffc146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.659+0000 7f0ffb7fe640 1 --2- 172.21.15.114:0/1053894110 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fe4003ef0 0x7f0ffc146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.659+0000 7f0ffb7fe640 1 -- 172.21.15.114:0/1053894110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc0c8660 con 0x7f0ffc0c7b80 2023-11-04T01:37:38.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.659+0000 7f0ffb7fe640 1 --2- 172.21.15.114:0/1053894110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc0c7b80 0x7f0ffc0c7fe0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0000c00 tx=0x7f0ff0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.659+0000 7f0ff8ff9640 1 -- 172.21.15.114:0/1053894110 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0003810 con 0x7f0ffc0c7b80 2023-11-04T01:37:38.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.659+0000 7f0ff8ff9640 1 -- 172.21.15.114:0/1053894110 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff0003970 con 0x7f0ffc0c7b80 2023-11-04T01:37:38.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.659+0000 7f1002664640 1 -- 172.21.15.114:0/1053894110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ffc0c8940 con 0x7f0ffc0c7b80 2023-11-04T01:37:38.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.659+0000 7f0ff8ff9640 1 -- 172.21.15.114:0/1053894110 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0003d20 con 0x7f0ffc0c7b80 2023-11-04T01:37:38.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.659+0000 7f1002664640 1 -- 172.21.15.114:0/1053894110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ffc150be0 con 0x7f0ffc0c7b80 2023-11-04T01:37:38.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.660+0000 7f1002664640 1 -- 172.21.15.114:0/1053894110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ffc158480 con 0x7f0ffc0c7b80 2023-11-04T01:37:38.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.660+0000 7f0ff8ff9640 1 -- 172.21.15.114:0/1053894110 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ff0047450 con 0x7f0ffc0c7b80 2023-11-04T01:37:38.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.661+0000 7f0ff8ff9640 1 --2- 172.21.15.114:0/1053894110 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0fe806ae70 0x7f0fe806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.661+0000 7f0ff8ff9640 1 -- 172.21.15.114:0/1053894110 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0ff00abc30 con 0x7f0ffc0c7b80 2023-11-04T01:37:38.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.661+0000 7f0ffbfff640 1 --2- 172.21.15.114:0/1053894110 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0fe806ae70 0x7f0fe806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.661+0000 7f0ffbfff640 1 --2- 172.21.15.114:0/1053894110 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0fe806ae70 0x7f0fe806d330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0fec001050 tx=0x7f0fec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.666+0000 7f0ff8ff9640 1 -- 172.21.15.114:0/1053894110 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0ff00769d0 con 0x7f0ffc0c7b80 2023-11-04T01:37:38.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.834+0000 7f1002664640 1 -- 172.21.15.114:0/1053894110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ffc074290 con 0x7f0ffc0c7b80 2023-11-04T01:37:38.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.835+0000 7f0ff8ff9640 1 -- 172.21.15.114:0/1053894110 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18796 (secure 0 0 0) 0x7f0ff00044e0 con 0x7f0ffc0c7b80 2023-11-04T01:37:38.838 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:38.839 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:11.562429+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:38.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.837+0000 7f1002664640 1 -- 172.21.15.114:0/1053894110 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0fe806ae70 msgr2=0x7f0fe806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.837+0000 7f1002664640 1 --2- 172.21.15.114:0/1053894110 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0fe806ae70 0x7f0fe806d330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0fec001050 tx=0x7f0fec009040 comp rx=0 tx=0).stop 2023-11-04T01:37:38.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.837+0000 7f1002664640 1 -- 172.21.15.114:0/1053894110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc0c7b80 msgr2=0x7f0ffc0c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.837+0000 7f1002664640 1 --2- 172.21.15.114:0/1053894110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc0c7b80 0x7f0ffc0c7fe0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0000c00 tx=0x7f0ff0004730 comp rx=0 tx=0).stop 2023-11-04T01:37:38.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.838+0000 7f1002664640 1 -- 172.21.15.114:0/1053894110 shutdown_connections 2023-11-04T01:37:38.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.838+0000 7f1002664640 1 --2- 172.21.15.114:0/1053894110 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ffc157ac0 0x7f0ffc157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.838+0000 7f1002664640 1 --2- 172.21.15.114:0/1053894110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc0c7b80 0x7f0ffc0c7fe0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.838+0000 7f1002664640 1 --2- 172.21.15.114:0/1053894110 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0fe806ae70 0x7f0fe806d330 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.838+0000 7f1002664640 1 --2- 172.21.15.114:0/1053894110 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fe4003ef0 0x7f0ffc146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.838+0000 7f1002664640 1 -- 172.21.15.114:0/1053894110 >> 172.21.15.114:0/1053894110 conn(0x7f0ffc0ce950 msgr2=0x7f0ffc15a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.838+0000 7f1002664640 1 -- 172.21.15.114:0/1053894110 shutdown_connections 2023-11-04T01:37:38.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.838+0000 7f1002664640 1 -- 172.21.15.114:0/1053894110 wait complete. 2023-11-04T01:37:38.852 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:37:38.852 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:38.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.949+0000 7fe95460e640 1 Processor -- start 2023-11-04T01:37:38.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.949+0000 7fe95460e640 1 -- start start 2023-11-04T01:37:38.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.950+0000 7fe95460e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe94c0b2c50 0x7fe94c06ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.950+0000 7fe95460e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c06c050 con 0x7fe94c0b2870 2023-11-04T01:37:38.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.950+0000 7fe95460e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c06c330 con 0x7fe94c0cd170 2023-11-04T01:37:38.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.950+0000 7fe95460e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe94c06ccd0 con 0x7fe94c0b2c50 2023-11-04T01:37:38.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.950+0000 7fe952bab640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe94c0b2c50 0x7fe94c06ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.950+0000 7fe952bab640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe94c0b2c50 0x7fe94c06ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37736/0 (socket says 172.21.15.114:37736) 2023-11-04T01:37:38.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.950+0000 7fe952bab640 1 -- 172.21.15.114:0/581490981 learned_addr learned my addr 172.21.15.114:0/581490981 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:38.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.951+0000 7fe952bab640 1 -- 172.21.15.114:0/581490981 >> v1:172.21.15.141:6789/0 conn(0x7fe94c0cd170 legacy=0x7fe94c15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:38.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.951+0000 7fe952bab640 1 -- 172.21.15.114:0/581490981 >> v1:172.21.15.114:6789/0 conn(0x7fe94c0b2870 legacy=0x7fe94c0cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.951+0000 7fe952bab640 1 -- 172.21.15.114:0/581490981 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c06c610 con 0x7fe94c0b2c50 2023-11-04T01:37:38.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.951+0000 7fe952bab640 1 --2- 172.21.15.114:0/581490981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe94c0b2c50 0x7fe94c06ba00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe944009870 tx=0x7fe94402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d697673d858bcd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.951+0000 7fe9513a8640 1 -- 172.21.15.114:0/581490981 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9440317e0 con 0x7fe94c0b2c50 2023-11-04T01:37:38.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.952+0000 7fe9513a8640 1 -- 172.21.15.114:0/581490981 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe944031940 con 0x7fe94c0b2c50 2023-11-04T01:37:38.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.952+0000 7fe9513a8640 1 -- 172.21.15.114:0/581490981 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944031cd0 con 0x7fe94c0b2c50 2023-11-04T01:37:38.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.952+0000 7fe95460e640 1 -- 172.21.15.114:0/581490981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe94c0b2c50 msgr2=0x7fe94c06ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.952+0000 7fe95460e640 1 --2- 172.21.15.114:0/581490981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe94c0b2c50 0x7fe94c06ba00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe944009870 tx=0x7fe94402b880 comp rx=0 tx=0).stop 2023-11-04T01:37:38.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.952+0000 7fe95460e640 1 -- 172.21.15.114:0/581490981 shutdown_connections 2023-11-04T01:37:38.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.952+0000 7fe95460e640 1 --2- 172.21.15.114:0/581490981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe94c0b2c50 0x7fe94c06ba00 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.952+0000 7fe95460e640 1 -- 172.21.15.114:0/581490981 >> 172.21.15.114:0/581490981 conn(0x7fe94c0cd600 msgr2=0x7fe94c0cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:38.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.952+0000 7fe95460e640 1 -- 172.21.15.114:0/581490981 shutdown_connections 2023-11-04T01:37:38.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.952+0000 7fe95460e640 1 -- 172.21.15.114:0/581490981 wait complete. 2023-11-04T01:37:38.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.953+0000 7fe95460e640 1 Processor -- start 2023-11-04T01:37:38.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.953+0000 7fe95460e640 1 -- start start 2023-11-04T01:37:38.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe95460e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe94c0b2870 0x7fe94c0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe95460e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe94c0b2c50 0x7fe94c0ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe95460e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe94c0cd170 0x7fe94c14c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe95460e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c0cac00 con 0x7fe94c0cd170 2023-11-04T01:37:38.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe95460e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c14cea0 con 0x7fe94c0b2c50 2023-11-04T01:37:38.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe95460e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c0b4890 con 0x7fe94c0b2870 2023-11-04T01:37:38.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe952bab640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe94c0cd170 0x7fe94c14c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe952bab640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe94c0cd170 0x7fe94c14c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37744/0 (socket says 172.21.15.114:37744) 2023-11-04T01:37:38.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe952bab640 1 -- 172.21.15.114:0/2857997432 learned_addr learned my addr 172.21.15.114:0/2857997432 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:38.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe9523aa640 1 --2- 172.21.15.114:0/2857997432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe94c0b2870 0x7fe94c0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe951ba9640 1 --2- 172.21.15.114:0/2857997432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe94c0b2c50 0x7fe94c0ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe952bab640 1 -- 172.21.15.114:0/2857997432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe94c0b2870 msgr2=0x7fe94c0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe952bab640 1 --2- 172.21.15.114:0/2857997432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe94c0b2870 0x7fe94c0b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe952bab640 1 -- 172.21.15.114:0/2857997432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe94c0b2c50 msgr2=0x7fe94c0ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:38.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe952bab640 1 --2- 172.21.15.114:0/2857997432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe94c0b2c50 0x7fe94c0ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:38.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe952bab640 1 -- 172.21.15.114:0/2857997432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9440094d0 con 0x7fe94c0cd170 2023-11-04T01:37:38.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe9523aa640 1 --2- 172.21.15.114:0/2857997432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe94c0b2870 0x7fe94c0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:38.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe951ba9640 1 --2- 172.21.15.114:0/2857997432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe94c0b2c50 0x7fe94c0ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:38.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.954+0000 7fe952bab640 1 --2- 172.21.15.114:0/2857997432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe94c0cd170 0x7fe94c14c960 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe944009870 tx=0x7fe9440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.955+0000 7fe942ffd640 1 -- 172.21.15.114:0/2857997432 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944032940 con 0x7fe94c0cd170 2023-11-04T01:37:38.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.955+0000 7fe942ffd640 1 -- 172.21.15.114:0/2857997432 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe944032aa0 con 0x7fe94c0cd170 2023-11-04T01:37:38.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.955+0000 7fe95460e640 1 -- 172.21.15.114:0/2857997432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe94c0b4b70 con 0x7fe94c0cd170 2023-11-04T01:37:38.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.955+0000 7fe942ffd640 1 -- 172.21.15.114:0/2857997432 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944032e50 con 0x7fe94c0cd170 2023-11-04T01:37:38.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.955+0000 7fe95460e640 1 -- 172.21.15.114:0/2857997432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94c0c80b0 con 0x7fe94c0cd170 2023-11-04T01:37:38.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.956+0000 7fe95460e640 1 -- 172.21.15.114:0/2857997432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94c0c82a0 con 0x7fe94c0cd170 2023-11-04T01:37:38.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.956+0000 7fe942ffd640 1 -- 172.21.15.114:0/2857997432 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe9440453f0 con 0x7fe94c0cd170 2023-11-04T01:37:38.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.956+0000 7fe942ffd640 1 --2- 172.21.15.114:0/2857997432 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe93006ae70 0x7fe93006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:38.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.956+0000 7fe942ffd640 1 -- 172.21.15.114:0/2857997432 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe9440abc10 con 0x7fe94c0cd170 2023-11-04T01:37:38.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.956+0000 7fe9523aa640 1 --2- 172.21.15.114:0/2857997432 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe93006ae70 0x7fe93006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:38.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.957+0000 7fe9523aa640 1 --2- 172.21.15.114:0/2857997432 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe93006ae70 0x7fe93006d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe948001350 tx=0x7fe948009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:38.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:38.961+0000 7fe942ffd640 1 -- 172.21.15.114:0/2857997432 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe944076ab0 con 0x7fe94c0cd170 2023-11-04T01:37:39.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.161+0000 7fe95460e640 1 -- 172.21.15.114:0/2857997432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe94c06b300 con 0x7fe94c0cd170 2023-11-04T01:37:39.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.162+0000 7fe942ffd640 1 -- 172.21.15.114:0/2857997432 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7fe94407a0d0 con 0x7fe94c0cd170 2023-11-04T01:37:39.163 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:39.164 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1590879236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1590879236},{"type":"v1","addr":"172.21.15.141:6834","nonce":1590879236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3079825621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3079825621},{"type":"v1","addr":"172.21.15.114:6835","nonce":3079825621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1526155664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1526155664},{"type":"v1","addr":"172.21.15.114:6837","nonce":1526155664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:36:29.888918+0000","modified":"2023-11-04T01:36:46.975998+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6835/4231924170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4231924170},{"type":"v1","addr":"172.21.15.141:6835","nonce":4231924170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:37:39.164 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2023-11-04T01:37:39.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.163+0000 7fe95460e640 1 -- 172.21.15.114:0/2857997432 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe93006ae70 msgr2=0x7fe93006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.163+0000 7fe95460e640 1 --2- 172.21.15.114:0/2857997432 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe93006ae70 0x7fe93006d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe948001350 tx=0x7fe948009040 comp rx=0 tx=0).stop 2023-11-04T01:37:39.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.163+0000 7fe95460e640 1 -- 172.21.15.114:0/2857997432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe94c0cd170 msgr2=0x7fe94c14c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.163+0000 7fe95460e640 1 --2- 172.21.15.114:0/2857997432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe94c0cd170 0x7fe94c14c960 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe944009870 tx=0x7fe9440046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.163+0000 7fe95460e640 1 -- 172.21.15.114:0/2857997432 shutdown_connections 2023-11-04T01:37:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.163+0000 7fe95460e640 1 --2- 172.21.15.114:0/2857997432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe94c0cd170 0x7fe94c14c960 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.163+0000 7fe95460e640 1 --2- 172.21.15.114:0/2857997432 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe93006ae70 0x7fe93006d330 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.163+0000 7fe95460e640 1 --2- 172.21.15.114:0/2857997432 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe94c0b2c50 0x7fe94c0ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.163+0000 7fe95460e640 1 --2- 172.21.15.114:0/2857997432 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe94c0b2870 0x7fe94c0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.163+0000 7fe95460e640 1 -- 172.21.15.114:0/2857997432 >> 172.21.15.114:0/2857997432 conn(0x7fe94c0cd600 msgr2=0x7fe94c0c6730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.164+0000 7fe95460e640 1 -- 172.21.15.114:0/2857997432 shutdown_connections 2023-11-04T01:37:39.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.164+0000 7fe95460e640 1 -- 172.21.15.114:0/2857997432 wait complete. 2023-11-04T01:37:39.176 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:39.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.273+0000 7fa65f07c640 1 Processor -- start 2023-11-04T01:37:39.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.273+0000 7fa65f07c640 1 -- start start 2023-11-04T01:37:39.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.274+0000 7fa65f07c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa6580ce240 0x7fa658157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.274+0000 7fa65f07c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa658157540 0x7fa6580d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.274+0000 7fa65f07c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65815e000 con 0x7fa6580cde60 2023-11-04T01:37:39.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.274+0000 7fa65f07c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65815e5c0 con 0x7fa658157540 2023-11-04T01:37:39.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.274+0000 7fa65f07c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65815e2e0 con 0x7fa6580ce240 2023-11-04T01:37:39.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.274+0000 7fa65d619640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa658157540 0x7fa6580d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.274+0000 7fa65d619640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa658157540 0x7fa6580d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37748/0 (socket says 172.21.15.114:37748) 2023-11-04T01:37:39.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.274+0000 7fa65d619640 1 -- 172.21.15.114:0/664812835 learned_addr learned my addr 172.21.15.114:0/664812835 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:39.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.275+0000 7fa657fff640 1 --2- 172.21.15.114:0/664812835 >> v2:172.21.15.141:3300/0 conn(0x7fa6580ce240 0x7fa658157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.275+0000 7fa65d619640 1 -- 172.21.15.114:0/664812835 >> v2:172.21.15.141:3300/0 conn(0x7fa6580ce240 msgr2=0x7fa658157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.275+0000 7fa65d619640 1 --2- 172.21.15.114:0/664812835 >> v2:172.21.15.141:3300/0 conn(0x7fa6580ce240 0x7fa658157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.275+0000 7fa65d619640 1 -- 172.21.15.114:0/664812835 >> v1:172.21.15.114:6789/0 conn(0x7fa6580cde60 legacy=0x7fa65815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.275+0000 7fa65d619640 1 -- 172.21.15.114:0/664812835 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6580d1120 con 0x7fa658157540 2023-11-04T01:37:39.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.275+0000 7fa65d619640 1 --2- 172.21.15.114:0/664812835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa658157540 0x7fa6580d1920 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa6580cf5f0 tx=0x7fa65002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e61c90a322591e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.275+0000 7fa6577fe640 1 -- 172.21.15.114:0/664812835 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65002cb20 con 0x7fa658157540 2023-11-04T01:37:39.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.275+0000 7fa6577fe640 1 -- 172.21.15.114:0/664812835 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65002cc80 con 0x7fa658157540 2023-11-04T01:37:39.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.275+0000 7fa6577fe640 1 -- 172.21.15.114:0/664812835 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6500343f0 con 0x7fa658157540 2023-11-04T01:37:39.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.276+0000 7fa65f07c640 1 -- 172.21.15.114:0/664812835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa658157540 msgr2=0x7fa6580d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.276+0000 7fa65f07c640 1 --2- 172.21.15.114:0/664812835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa658157540 0x7fa6580d1920 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa6580cf5f0 tx=0x7fa65002bf80 comp rx=0 tx=0).stop 2023-11-04T01:37:39.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.276+0000 7fa65f07c640 1 -- 172.21.15.114:0/664812835 shutdown_connections 2023-11-04T01:37:39.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.276+0000 7fa65f07c640 1 --2- 172.21.15.114:0/664812835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa658157540 0x7fa6580d1920 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.276+0000 7fa65f07c640 1 --2- 172.21.15.114:0/664812835 >> v2:172.21.15.141:3300/0 conn(0x7fa6580ce240 0x7fa658157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.276+0000 7fa65f07c640 1 -- 172.21.15.114:0/664812835 >> 172.21.15.114:0/664812835 conn(0x7fa658071f30 msgr2=0x7fa6580cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.276+0000 7fa65f07c640 1 -- 172.21.15.114:0/664812835 shutdown_connections 2023-11-04T01:37:39.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.276+0000 7fa65f07c640 1 -- 172.21.15.114:0/664812835 wait complete. 2023-11-04T01:37:39.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.277+0000 7fa65f07c640 1 Processor -- start 2023-11-04T01:37:39.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.277+0000 7fa65f07c640 1 -- start start 2023-11-04T01:37:39.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.278+0000 7fa65f07c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6580cde60 0x7fa6581595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.278+0000 7fa65f07c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6580ce240 0x7fa658147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.278+0000 7fa65f07c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa658157540 0x7fa6580c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.278+0000 7fa65f07c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa658148400 con 0x7fa6580ce240 2023-11-04T01:37:39.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.278+0000 7fa65f07c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa658148710 con 0x7fa6580cde60 2023-11-04T01:37:39.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.278+0000 7fa65f07c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6581489d0 con 0x7fa658157540 2023-11-04T01:37:39.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.278+0000 7fa657fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6580ce240 0x7fa658147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.278+0000 7fa657fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6580ce240 0x7fa658147ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37756/0 (socket says 172.21.15.114:37756) 2023-11-04T01:37:39.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.278+0000 7fa657fff640 1 -- 172.21.15.114:0/3937444011 learned_addr learned my addr 172.21.15.114:0/3937444011 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:39.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.278+0000 7fa657fff640 1 -- 172.21.15.114:0/3937444011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa658157540 msgr2=0x7fa6580c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.278+0000 7fa657fff640 1 --2- 172.21.15.114:0/3937444011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa658157540 0x7fa6580c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.278+0000 7fa657fff640 1 -- 172.21.15.114:0/3937444011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6580cde60 msgr2=0x7fa6581595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.278+0000 7fa657fff640 1 --2- 172.21.15.114:0/3937444011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6580cde60 0x7fa6581595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.278+0000 7fa657fff640 1 -- 172.21.15.114:0/3937444011 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa650009b30 con 0x7fa6580ce240 2023-11-04T01:37:39.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.279+0000 7fa657fff640 1 --2- 172.21.15.114:0/3937444011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6580ce240 0x7fa658147ec0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00c7f0 tx=0x7fa64c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.279+0000 7fa6557fa640 1 -- 172.21.15.114:0/3937444011 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c004220 con 0x7fa6580ce240 2023-11-04T01:37:39.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.279+0000 7fa6557fa640 1 -- 172.21.15.114:0/3937444011 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c0043a0 con 0x7fa6580ce240 2023-11-04T01:37:39.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.279+0000 7fa65f07c640 1 -- 172.21.15.114:0/3937444011 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa658148cb0 con 0x7fa6580ce240 2023-11-04T01:37:39.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.279+0000 7fa6557fa640 1 -- 172.21.15.114:0/3937444011 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c007860 con 0x7fa6580ce240 2023-11-04T01:37:39.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.279+0000 7fa65f07c640 1 -- 172.21.15.114:0/3937444011 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa658149270 con 0x7fa6580ce240 2023-11-04T01:37:39.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.280+0000 7fa65f07c640 1 -- 172.21.15.114:0/3937444011 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa658149490 con 0x7fa6580ce240 2023-11-04T01:37:39.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.280+0000 7fa6557fa640 1 -- 172.21.15.114:0/3937444011 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa64c007bd0 con 0x7fa6580ce240 2023-11-04T01:37:39.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.280+0000 7fa6557fa640 1 --2- 172.21.15.114:0/3937444011 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa64406aea0 0x7fa64406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.281+0000 7fa6557fa640 1 -- 172.21.15.114:0/3937444011 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa64c0898f0 con 0x7fa6580ce240 2023-11-04T01:37:39.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.281+0000 7fa65ce18640 1 --2- 172.21.15.114:0/3937444011 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa64406aea0 0x7fa64406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.281+0000 7fa65ce18640 1 --2- 172.21.15.114:0/3937444011 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa64406aea0 0x7fa64406d360 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa648000f60 tx=0x7fa6480079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.285+0000 7fa6557fa640 1 -- 172.21.15.114:0/3937444011 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa64c0545e0 con 0x7fa6580ce240 2023-11-04T01:37:39.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.484+0000 7fa65f07c640 1 -- 172.21.15.114:0/3937444011 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa658074290 con 0x7fa6580ce240 2023-11-04T01:37:39.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.485+0000 7fa6557fa640 1 -- 172.21.15.114:0/3937444011 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7fa64c01e090 con 0x7fa6580ce240 2023-11-04T01:37:39.487 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:39.487 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1590879236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1590879236},{"type":"v1","addr":"172.21.15.141:6834","nonce":1590879236}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3079825621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3079825621},{"type":"v1","addr":"172.21.15.114:6835","nonce":3079825621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1526155664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1526155664},{"type":"v1","addr":"172.21.15.114:6837","nonce":1526155664}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:36:29.888918+0000","modified":"2023-11-04T01:36:46.975998+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6835/4231924170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4231924170},{"type":"v1","addr":"172.21.15.141:6835","nonce":4231924170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:37:39.487 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2023-11-04T01:37:39.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.487+0000 7fa65f07c640 1 -- 172.21.15.114:0/3937444011 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa64406aea0 msgr2=0x7fa64406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.487+0000 7fa65f07c640 1 --2- 172.21.15.114:0/3937444011 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa64406aea0 0x7fa64406d360 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa648000f60 tx=0x7fa6480079b0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.487+0000 7fa65f07c640 1 -- 172.21.15.114:0/3937444011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6580ce240 msgr2=0x7fa658147ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.487+0000 7fa65f07c640 1 --2- 172.21.15.114:0/3937444011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6580ce240 0x7fa658147ec0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00c7f0 tx=0x7fa64c00ccb0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.487+0000 7fa65f07c640 1 -- 172.21.15.114:0/3937444011 shutdown_connections 2023-11-04T01:37:39.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.487+0000 7fa65f07c640 1 --2- 172.21.15.114:0/3937444011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa658157540 0x7fa6580c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.487+0000 7fa65f07c640 1 --2- 172.21.15.114:0/3937444011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6580ce240 0x7fa658147ec0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.487+0000 7fa65f07c640 1 --2- 172.21.15.114:0/3937444011 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa64406aea0 0x7fa64406d360 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.487+0000 7fa65f07c640 1 --2- 172.21.15.114:0/3937444011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa6580cde60 0x7fa6581595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.487+0000 7fa65f07c640 1 -- 172.21.15.114:0/3937444011 >> 172.21.15.114:0/3937444011 conn(0x7fa658071f30 msgr2=0x7fa6580d2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.487+0000 7fa65f07c640 1 -- 172.21.15.114:0/3937444011 shutdown_connections 2023-11-04T01:37:39.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.487+0000 7fa65f07c640 1 -- 172.21.15.114:0/3937444011 wait complete. 2023-11-04T01:37:39.499 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.597+0000 7fba88533640 1 Processor -- start 2023-11-04T01:37:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.597+0000 7fba88533640 1 -- start start 2023-11-04T01:37:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.598+0000 7fba88533640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba80160b10 0x7fba80160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.598+0000 7fba88533640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8006bf00 con 0x7fba8015ce60 2023-11-04T01:37:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.598+0000 7fba88533640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba801615d0 con 0x7fba800cf160 2023-11-04T01:37:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.598+0000 7fba88533640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba800cbde0 con 0x7fba80160b10 2023-11-04T01:37:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.598+0000 7fba862cf640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fba8015ce60 0x7fba8006b7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56844/0 (socket says 172.21.15.114:56844) 2023-11-04T01:37:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.598+0000 7fba862cf640 1 -- 172.21.15.114:0/1831773825 learned_addr learned my addr 172.21.15.114:0/1831773825 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.598+0000 7fba85ace640 1 --2- 172.21.15.114:0/1831773825 >> v2:172.21.15.114:3300/0 conn(0x7fba80160b10 0x7fba80160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.598+0000 7fba85ace640 1 -- 172.21.15.114:0/1831773825 >> v1:172.21.15.141:6789/0 conn(0x7fba800cf160 legacy=0x7fba800cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.598+0000 7fba85ace640 1 -- 172.21.15.114:0/1831773825 >> v1:172.21.15.114:6789/0 conn(0x7fba8015ce60 legacy=0x7fba8006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.598+0000 7fba85ace640 1 -- 172.21.15.114:0/1831773825 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba801618b0 con 0x7fba80160b10 2023-11-04T01:37:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.599+0000 7fba85ace640 1 --2- 172.21.15.114:0/1831773825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba80160b10 0x7fba80160f90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fba700097a0 tx=0x7fba7002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41f5a9e1c71d19f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.599+0000 7fba852cd640 1 -- 172.21.15.114:0/1831773825 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba70031830 con 0x7fba80160b10 2023-11-04T01:37:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.599+0000 7fba852cd640 1 -- 172.21.15.114:0/1831773825 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba70031990 con 0x7fba80160b10 2023-11-04T01:37:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.599+0000 7fba852cd640 1 -- 172.21.15.114:0/1831773825 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba70031d20 con 0x7fba80160b10 2023-11-04T01:37:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.600+0000 7fba88533640 1 -- 172.21.15.114:0/1831773825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba80160b10 msgr2=0x7fba80160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.600+0000 7fba88533640 1 --2- 172.21.15.114:0/1831773825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba80160b10 0x7fba80160f90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fba700097a0 tx=0x7fba7002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.600+0000 7fba88533640 1 -- 172.21.15.114:0/1831773825 shutdown_connections 2023-11-04T01:37:39.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.600+0000 7fba88533640 1 --2- 172.21.15.114:0/1831773825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba80160b10 0x7fba80160f90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.600+0000 7fba88533640 1 -- 172.21.15.114:0/1831773825 >> 172.21.15.114:0/1831773825 conn(0x7fba8006ea90 msgr2=0x7fba8006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.600+0000 7fba88533640 1 -- 172.21.15.114:0/1831773825 shutdown_connections 2023-11-04T01:37:39.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.600+0000 7fba88533640 1 -- 172.21.15.114:0/1831773825 wait complete. 2023-11-04T01:37:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.601+0000 7fba88533640 1 Processor -- start 2023-11-04T01:37:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.601+0000 7fba88533640 1 -- start start 2023-11-04T01:37:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.602+0000 7fba88533640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fba800cf160 0x7fba801f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.602+0000 7fba88533640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8015ce60 0x7fba800b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.602+0000 7fba88533640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fba80160b10 0x7fba800b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.602+0000 7fba88533640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba801e6fe0 con 0x7fba8015ce60 2023-11-04T01:37:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.602+0000 7fba88533640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba800b5e40 con 0x7fba800cf160 2023-11-04T01:37:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.602+0000 7fba88533640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba801e6990 con 0x7fba80160b10 2023-11-04T01:37:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.602+0000 7fba85ace640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8015ce60 0x7fba800b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.602+0000 7fba85ace640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8015ce60 0x7fba800b53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37770/0 (socket says 172.21.15.114:37770) 2023-11-04T01:37:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.602+0000 7fba85ace640 1 -- 172.21.15.114:0/4162502254 learned_addr learned my addr 172.21.15.114:0/4162502254 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.602+0000 7fba85ace640 1 -- 172.21.15.114:0/4162502254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fba80160b10 msgr2=0x7fba800b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.602+0000 7fba85ace640 1 --2- 172.21.15.114:0/4162502254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fba80160b10 0x7fba800b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.602+0000 7fba85ace640 1 -- 172.21.15.114:0/4162502254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fba800cf160 msgr2=0x7fba801f2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.602+0000 7fba85ace640 1 --2- 172.21.15.114:0/4162502254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fba800cf160 0x7fba801f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.602+0000 7fba85ace640 1 -- 172.21.15.114:0/4162502254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba70009400 con 0x7fba8015ce60 2023-11-04T01:37:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.602+0000 7fba85ace640 1 --2- 172.21.15.114:0/4162502254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8015ce60 0x7fba800b53a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fba700098c0 tx=0x7fba700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.602+0000 7fba76ffd640 1 -- 172.21.15.114:0/4162502254 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7003ba70 con 0x7fba8015ce60 2023-11-04T01:37:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.603+0000 7fba76ffd640 1 -- 172.21.15.114:0/4162502254 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7003bbf0 con 0x7fba8015ce60 2023-11-04T01:37:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.603+0000 7fba76ffd640 1 -- 172.21.15.114:0/4162502254 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba700453f0 con 0x7fba8015ce60 2023-11-04T01:37:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.603+0000 7fba88533640 1 -- 172.21.15.114:0/4162502254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba801e6c70 con 0x7fba8015ce60 2023-11-04T01:37:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.603+0000 7fba88533640 1 -- 172.21.15.114:0/4162502254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba800b6120 con 0x7fba8015ce60 2023-11-04T01:37:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.603+0000 7fba88533640 1 -- 172.21.15.114:0/4162502254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba80074290 con 0x7fba8015ce60 2023-11-04T01:37:39.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.604+0000 7fba76ffd640 1 -- 172.21.15.114:0/4162502254 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba7004e450 con 0x7fba8015ce60 2023-11-04T01:37:39.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.604+0000 7fba76ffd640 1 --2- 172.21.15.114:0/4162502254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fba6406ae70 0x7fba6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.604+0000 7fba76ffd640 1 -- 172.21.15.114:0/4162502254 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fba700abd00 con 0x7fba8015ce60 2023-11-04T01:37:39.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.604+0000 7fba862cf640 1 --2- 172.21.15.114:0/4162502254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fba6406ae70 0x7fba6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.605+0000 7fba862cf640 1 --2- 172.21.15.114:0/4162502254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fba6406ae70 0x7fba6406d330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fba7c001550 tx=0x7fba7c007a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.608+0000 7fba76ffd640 1 -- 172.21.15.114:0/4162502254 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fba70076960 con 0x7fba8015ce60 2023-11-04T01:37:39.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.775+0000 7fba88533640 1 -- 172.21.15.114:0/4162502254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba8006b3e0 con 0x7fba8015ce60 2023-11-04T01:37:39.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.776+0000 7fba76ffd640 1 -- 172.21.15.114:0/4162502254 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18796 (secure 0 0 0) 0x7fba70035070 con 0x7fba8015ce60 2023-11-04T01:37:39.779 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:39.779 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:11.562429+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:36:27.911769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:36:28.871185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:36:32.598984+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:39.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.778+0000 7fba88533640 1 -- 172.21.15.114:0/4162502254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fba6406ae70 msgr2=0x7fba6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.778+0000 7fba88533640 1 --2- 172.21.15.114:0/4162502254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fba6406ae70 0x7fba6406d330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fba7c001550 tx=0x7fba7c007a40 comp rx=0 tx=0).stop 2023-11-04T01:37:39.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.778+0000 7fba88533640 1 -- 172.21.15.114:0/4162502254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8015ce60 msgr2=0x7fba800b53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.778+0000 7fba88533640 1 --2- 172.21.15.114:0/4162502254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8015ce60 0x7fba800b53a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fba700098c0 tx=0x7fba700046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.778+0000 7fba88533640 1 -- 172.21.15.114:0/4162502254 shutdown_connections 2023-11-04T01:37:39.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.778+0000 7fba88533640 1 --2- 172.21.15.114:0/4162502254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fba80160b10 0x7fba800b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.778+0000 7fba88533640 1 --2- 172.21.15.114:0/4162502254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8015ce60 0x7fba800b53a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.778+0000 7fba88533640 1 --2- 172.21.15.114:0/4162502254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fba6406ae70 0x7fba6406d330 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.778+0000 7fba88533640 1 --2- 172.21.15.114:0/4162502254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fba800cf160 0x7fba801f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.778+0000 7fba88533640 1 -- 172.21.15.114:0/4162502254 >> 172.21.15.114:0/4162502254 conn(0x7fba8006ea90 msgr2=0x7fba800c5690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.778+0000 7fba88533640 1 -- 172.21.15.114:0/4162502254 shutdown_connections 2023-11-04T01:37:39.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.778+0000 7fba88533640 1 -- 172.21.15.114:0/4162502254 wait complete. 2023-11-04T01:37:39.791 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:37:39.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.891+0000 7faf5e9d0640 1 Processor -- start 2023-11-04T01:37:39.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.891+0000 7faf5e9d0640 1 -- start start 2023-11-04T01:37:39.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.891+0000 7faf5e9d0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf5815ad30 0x7faf580adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.891+0000 7faf5e9d0640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7faf580ad730 0x7faf58070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.891+0000 7faf5e9d0640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf580c3900 con 0x7faf58070c50 2023-11-04T01:37:39.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.891+0000 7faf5e9d0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf580ae260 con 0x7faf5815ad30 2023-11-04T01:37:39.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.891+0000 7faf5e9d0640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5815f750 con 0x7faf580ad730 2023-11-04T01:37:39.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.892+0000 7faf57fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf5815ad30 0x7faf580adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.892+0000 7faf57fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf5815ad30 0x7faf580adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37778/0 (socket says 172.21.15.114:37778) 2023-11-04T01:37:39.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.892+0000 7faf57fff640 1 -- 172.21.15.114:0/3233628581 learned_addr learned my addr 172.21.15.114:0/3233628581 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:39.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.892+0000 7faf577fe640 1 --2- 172.21.15.114:0/3233628581 >> v2:172.21.15.141:3300/0 conn(0x7faf580ad730 0x7faf58070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.892+0000 7faf57fff640 1 -- 172.21.15.114:0/3233628581 >> v2:172.21.15.141:3300/0 conn(0x7faf580ad730 msgr2=0x7faf58070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.892+0000 7faf57fff640 1 --2- 172.21.15.114:0/3233628581 >> v2:172.21.15.141:3300/0 conn(0x7faf580ad730 0x7faf58070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.892+0000 7faf57fff640 1 -- 172.21.15.114:0/3233628581 >> v1:172.21.15.141:6789/0 conn(0x7faf58070c50 legacy=0x7faf580c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:39.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.892+0000 7faf57fff640 1 -- 172.21.15.114:0/3233628581 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf580c3be0 con 0x7faf5815ad30 2023-11-04T01:37:39.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.892+0000 7faf577fe640 1 --2- 172.21.15.114:0/3233628581 >> v2:172.21.15.141:3300/0 conn(0x7faf580ad730 0x7faf58070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:39.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.893+0000 7faf57fff640 1 --2- 172.21.15.114:0/3233628581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5815ad30 0x7faf580adc80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7faf580ce7f0 tx=0x7faf4802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1283531a8db6de6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.893+0000 7faf56ffd640 1 -- 172.21.15.114:0/3233628581 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf480317e0 con 0x7faf5815ad30 2023-11-04T01:37:39.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.893+0000 7faf56ffd640 1 -- 172.21.15.114:0/3233628581 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf48031940 con 0x7faf5815ad30 2023-11-04T01:37:39.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.893+0000 7faf56ffd640 1 -- 172.21.15.114:0/3233628581 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48031cd0 con 0x7faf5815ad30 2023-11-04T01:37:39.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.893+0000 7faf5e9d0640 1 -- 172.21.15.114:0/3233628581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5815ad30 msgr2=0x7faf580adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.893+0000 7faf5e9d0640 1 --2- 172.21.15.114:0/3233628581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5815ad30 0x7faf580adc80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7faf580ce7f0 tx=0x7faf4802b880 comp rx=0 tx=0).stop 2023-11-04T01:37:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.893+0000 7faf5e9d0640 1 -- 172.21.15.114:0/3233628581 shutdown_connections 2023-11-04T01:37:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.893+0000 7faf5e9d0640 1 --2- 172.21.15.114:0/3233628581 >> v2:172.21.15.141:3300/0 conn(0x7faf580ad730 0x7faf58070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.893+0000 7faf5e9d0640 1 --2- 172.21.15.114:0/3233628581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5815ad30 0x7faf580adc80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.893+0000 7faf5e9d0640 1 -- 172.21.15.114:0/3233628581 >> 172.21.15.114:0/3233628581 conn(0x7faf580ce950 msgr2=0x7faf580ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.893+0000 7faf5e9d0640 1 -- 172.21.15.114:0/3233628581 shutdown_connections 2023-11-04T01:37:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.893+0000 7faf5e9d0640 1 -- 172.21.15.114:0/3233628581 wait complete. 2023-11-04T01:37:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.894+0000 7faf5e9d0640 1 Processor -- start 2023-11-04T01:37:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.895+0000 7faf5e9d0640 1 -- start start 2023-11-04T01:37:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.895+0000 7faf5e9d0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faf58070c50 0x7faf58152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.895+0000 7faf5e9d0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf580ad730 0x7faf580c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.895+0000 7faf5e9d0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5815ad30 0x7faf580c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.895+0000 7faf5e9d0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf58152900 con 0x7faf5815ad30 2023-11-04T01:37:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.895+0000 7faf5e9d0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf580c7170 con 0x7faf580ad730 2023-11-04T01:37:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.895+0000 7faf5e9d0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf580c7450 con 0x7faf58070c50 2023-11-04T01:37:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.895+0000 7faf5cf6d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5815ad30 0x7faf580c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.895+0000 7faf5cf6d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5815ad30 0x7faf580c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37782/0 (socket says 172.21.15.114:37782) 2023-11-04T01:37:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.895+0000 7faf5cf6d640 1 -- 172.21.15.114:0/3208157093 learned_addr learned my addr 172.21.15.114:0/3208157093 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.896+0000 7faf57fff640 1 --2- 172.21.15.114:0/3208157093 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faf58070c50 0x7faf58152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.896+0000 7faf577fe640 1 --2- 172.21.15.114:0/3208157093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf580ad730 0x7faf580c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.896+0000 7faf5cf6d640 1 -- 172.21.15.114:0/3208157093 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faf58070c50 msgr2=0x7faf58152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.896+0000 7faf5cf6d640 1 --2- 172.21.15.114:0/3208157093 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faf58070c50 0x7faf58152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.896+0000 7faf5cf6d640 1 -- 172.21.15.114:0/3208157093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf580ad730 msgr2=0x7faf580c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.896+0000 7faf5cf6d640 1 --2- 172.21.15.114:0/3208157093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf580ad730 0x7faf580c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.896+0000 7faf5cf6d640 1 -- 172.21.15.114:0/3208157093 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf480094d0 con 0x7faf5815ad30 2023-11-04T01:37:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.896+0000 7faf5cf6d640 1 --2- 172.21.15.114:0/3208157093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5815ad30 0x7faf580c8210 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faf5000b970 tx=0x7faf5000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.896+0000 7faf54ff9640 1 -- 172.21.15.114:0/3208157093 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5000cb40 con 0x7faf5815ad30 2023-11-04T01:37:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.896+0000 7faf54ff9640 1 -- 172.21.15.114:0/3208157093 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5000cca0 con 0x7faf5815ad30 2023-11-04T01:37:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.896+0000 7faf5e9d0640 1 -- 172.21.15.114:0/3208157093 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf580c7730 con 0x7faf5815ad30 2023-11-04T01:37:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.896+0000 7faf54ff9640 1 -- 172.21.15.114:0/3208157093 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf50014680 con 0x7faf5815ad30 2023-11-04T01:37:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.896+0000 7faf5e9d0640 1 -- 172.21.15.114:0/3208157093 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf580c7cf0 con 0x7faf5815ad30 2023-11-04T01:37:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.897+0000 7faf5e9d0640 1 -- 172.21.15.114:0/3208157093 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf580c7f10 con 0x7faf5815ad30 2023-11-04T01:37:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.897+0000 7faf54ff9640 1 -- 172.21.15.114:0/3208157093 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf5001d3b0 con 0x7faf5815ad30 2023-11-04T01:37:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.898+0000 7faf54ff9640 1 --2- 172.21.15.114:0/3208157093 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faf4406ae70 0x7faf4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.898+0000 7faf57fff640 1 --2- 172.21.15.114:0/3208157093 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faf4406ae70 0x7faf4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.898+0000 7faf54ff9640 1 -- 172.21.15.114:0/3208157093 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faf50089750 con 0x7faf5815ad30 2023-11-04T01:37:39.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.898+0000 7faf57fff640 1 --2- 172.21.15.114:0/3208157093 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faf4406ae70 0x7faf4406d330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf48036000 tx=0x7faf4803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:39.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:39.902+0000 7faf54ff9640 1 -- 172.21.15.114:0/3208157093 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf500544f0 con 0x7faf5815ad30 2023-11-04T01:37:40.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.101+0000 7faf5e9d0640 1 -- 172.21.15.114:0/3208157093 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faf58074290 con 0x7faf5815ad30 2023-11-04T01:37:40.103 INFO:tasks.ceph.mon.a.smithi114.stderr:2023-11-04T01:37:40.101+0000 7f5b24eb8640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:37:40.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.103+0000 7faf54ff9640 1 -- 172.21.15.114:0/3208157093 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7faf50057b10 con 0x7faf5815ad30 2023-11-04T01:37:40.105 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:37:40.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.105+0000 7faf5e9d0640 1 -- 172.21.15.114:0/3208157093 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faf4406ae70 msgr2=0x7faf4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.105+0000 7faf5e9d0640 1 --2- 172.21.15.114:0/3208157093 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faf4406ae70 0x7faf4406d330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf48036000 tx=0x7faf4803d040 comp rx=0 tx=0).stop 2023-11-04T01:37:40.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.105+0000 7faf5e9d0640 1 -- 172.21.15.114:0/3208157093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5815ad30 msgr2=0x7faf580c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.105+0000 7faf5e9d0640 1 --2- 172.21.15.114:0/3208157093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5815ad30 0x7faf580c8210 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faf5000b970 tx=0x7faf5000be30 comp rx=0 tx=0).stop 2023-11-04T01:37:40.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.105+0000 7faf5e9d0640 1 -- 172.21.15.114:0/3208157093 shutdown_connections 2023-11-04T01:37:40.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.105+0000 7faf5e9d0640 1 --2- 172.21.15.114:0/3208157093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf5815ad30 0x7faf580c8210 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.105+0000 7faf5e9d0640 1 --2- 172.21.15.114:0/3208157093 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faf4406ae70 0x7faf4406d330 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.105+0000 7faf5e9d0640 1 --2- 172.21.15.114:0/3208157093 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf580ad730 0x7faf580c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.105+0000 7faf5e9d0640 1 --2- 172.21.15.114:0/3208157093 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faf58070c50 0x7faf58152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.105+0000 7faf5e9d0640 1 -- 172.21.15.114:0/3208157093 >> 172.21.15.114:0/3208157093 conn(0x7faf580ce950 msgr2=0x7faf5806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:40.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.105+0000 7faf5e9d0640 1 -- 172.21.15.114:0/3208157093 shutdown_connections 2023-11-04T01:37:40.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.105+0000 7faf5e9d0640 1 -- 172.21.15.114:0/3208157093 wait complete. 2023-11-04T01:37:40.111 INFO:tasks.ceph.mds.b.smithi141.stderr: -4554> 2023-11-04T01:36:34.580+0000 7fd9255a8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:37:40.118 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:37:40.144 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-04T01:37:40.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.217+0000 7f414fc1a640 1 Processor -- start 2023-11-04T01:37:40.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.217+0000 7f414fc1a640 1 -- start start 2023-11-04T01:37:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.218+0000 7f414fc1a640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f414815e3f0 0x7f41480b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.218+0000 7f414fc1a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f41480ca0a0 0x7f41480cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.218+0000 7f414fc1a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41480caa20 con 0x7f41480cc300 2023-11-04T01:37:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.218+0000 7f414fc1a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41480cb230 con 0x7f41480ca0a0 2023-11-04T01:37:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.218+0000 7f414fc1a640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41480ca530 con 0x7f414815e3f0 2023-11-04T01:37:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.218+0000 7f414d1b5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f41480ca0a0 0x7f41480cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.218+0000 7f414e1b7640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f41480cc300 0x7f41480b1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56848/0 (socket says 172.21.15.114:56848) 2023-11-04T01:37:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.218+0000 7f414e1b7640 1 -- 172.21.15.114:0/1798398635 learned_addr learned my addr 172.21.15.114:0/1798398635 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.218+0000 7f414d1b5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f41480ca0a0 0x7f41480cc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37786/0 (socket says 172.21.15.114:37786) 2023-11-04T01:37:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.219+0000 7f414d1b5640 1 -- 172.21.15.114:0/1798398635 >> v2:172.21.15.141:3300/0 conn(0x7f414815e3f0 msgr2=0x7f41480b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.219+0000 7f414d9b6640 1 --2- 172.21.15.114:0/1798398635 >> v2:172.21.15.141:3300/0 conn(0x7f414815e3f0 0x7f41480b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.219+0000 7f414d1b5640 1 --2- 172.21.15.114:0/1798398635 >> v2:172.21.15.141:3300/0 conn(0x7f414815e3f0 0x7f41480b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.219+0000 7f414d1b5640 1 -- 172.21.15.114:0/1798398635 >> v1:172.21.15.114:6789/0 conn(0x7f41480cc300 legacy=0x7f41480b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.219+0000 7f414d1b5640 1 -- 172.21.15.114:0/1798398635 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41480cac70 con 0x7f41480ca0a0 2023-11-04T01:37:40.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.219+0000 7f414c9b4640 1 -- 172.21.15.114:0/1798398635 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 981564936 0 0) 0x7f41480caa20 con 0x7f41480cc300 2023-11-04T01:37:40.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.219+0000 7f414d9b6640 1 --2- 172.21.15.114:0/1798398635 >> v2:172.21.15.141:3300/0 conn(0x7f414815e3f0 0x7f41480b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:40.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.219+0000 7f414d1b5640 1 --2- 172.21.15.114:0/1798398635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41480ca0a0 0x7f41480cc920 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f41480b5bc0 tx=0x7f413802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4573e34a60cfdf3a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.220+0000 7f414c9b4640 1 -- 172.21.15.114:0/1798398635 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138031830 con 0x7f41480ca0a0 2023-11-04T01:37:40.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.220+0000 7f414c9b4640 1 -- 172.21.15.114:0/1798398635 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4138031990 con 0x7f41480ca0a0 2023-11-04T01:37:40.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.220+0000 7f414c9b4640 1 -- 172.21.15.114:0/1798398635 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138031d20 con 0x7f41480ca0a0 2023-11-04T01:37:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.220+0000 7f414fc1a640 1 -- 172.21.15.114:0/1798398635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41480ca0a0 msgr2=0x7f41480cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.220+0000 7f414fc1a640 1 --2- 172.21.15.114:0/1798398635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41480ca0a0 0x7f41480cc920 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f41480b5bc0 tx=0x7f413802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.220+0000 7f414fc1a640 1 -- 172.21.15.114:0/1798398635 shutdown_connections 2023-11-04T01:37:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.220+0000 7f414fc1a640 1 --2- 172.21.15.114:0/1798398635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41480ca0a0 0x7f41480cc920 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.220+0000 7f414fc1a640 1 --2- 172.21.15.114:0/1798398635 >> v2:172.21.15.141:3300/0 conn(0x7f414815e3f0 0x7f41480b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.220+0000 7f414fc1a640 1 -- 172.21.15.114:0/1798398635 >> 172.21.15.114:0/1798398635 conn(0x7f4148071820 msgr2=0x7f4148071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.220+0000 7f414fc1a640 1 -- 172.21.15.114:0/1798398635 shutdown_connections 2023-11-04T01:37:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.220+0000 7f414fc1a640 1 -- 172.21.15.114:0/1798398635 wait complete. 2023-11-04T01:37:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.221+0000 7f414fc1a640 1 Processor -- start 2023-11-04T01:37:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.221+0000 7f414fc1a640 1 -- start start 2023-11-04T01:37:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.222+0000 7f414fc1a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41480cc300 0x7f41480ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.222+0000 7f414fc1a640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f414815e3f0 0x7f414814ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.222+0000 7f414fc1a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41480ac2a0 0x7f414806a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.222+0000 7f414fc1a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41480ad710 con 0x7f41480cc300 2023-11-04T01:37:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.222+0000 7f414fc1a640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41480cf670 con 0x7f414815e3f0 2023-11-04T01:37:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.222+0000 7f414fc1a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41480ad3c0 con 0x7f41480ac2a0 2023-11-04T01:37:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.222+0000 7f414d9b6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41480cc300 0x7f41480ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.222+0000 7f414d9b6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41480cc300 0x7f41480ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37800/0 (socket says 172.21.15.114:37800) 2023-11-04T01:37:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.222+0000 7f414d9b6640 1 -- 172.21.15.114:0/1026990543 learned_addr learned my addr 172.21.15.114:0/1026990543 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.222+0000 7f414d9b6640 1 -- 172.21.15.114:0/1026990543 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41480ac2a0 msgr2=0x7f414806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.222+0000 7f414d9b6640 1 --2- 172.21.15.114:0/1026990543 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41480ac2a0 0x7f414806a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.222+0000 7f414d9b6640 1 -- 172.21.15.114:0/1026990543 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f414815e3f0 msgr2=0x7f414814ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:40.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.222+0000 7f414d9b6640 1 --2- 172.21.15.114:0/1026990543 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f414815e3f0 0x7f414814ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:40.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.222+0000 7f414d9b6640 1 -- 172.21.15.114:0/1026990543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4138009400 con 0x7f41480cc300 2023-11-04T01:37:40.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.222+0000 7f414d9b6640 1 --2- 172.21.15.114:0/1026990543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41480cc300 0x7f41480ce220 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f414400ce00 tx=0x7f414400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.223+0000 7f413e7fc640 1 -- 172.21.15.114:0/1026990543 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414400f890 con 0x7f41480cc300 2023-11-04T01:37:40.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.223+0000 7f413e7fc640 1 -- 172.21.15.114:0/1026990543 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414400f9f0 con 0x7f41480cc300 2023-11-04T01:37:40.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.223+0000 7f414fc1a640 1 -- 172.21.15.114:0/1026990543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41480ac7b0 con 0x7f41480cc300 2023-11-04T01:37:40.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.223+0000 7f413e7fc640 1 -- 172.21.15.114:0/1026990543 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414400fd80 con 0x7f41480cc300 2023-11-04T01:37:40.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.223+0000 7f414fc1a640 1 -- 172.21.15.114:0/1026990543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41480acb40 con 0x7f41480cc300 2023-11-04T01:37:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.223+0000 7f414fc1a640 1 -- 172.21.15.114:0/1026990543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4148074290 con 0x7f41480cc300 2023-11-04T01:37:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.224+0000 7f413e7fc640 1 -- 172.21.15.114:0/1026990543 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f414400b040 con 0x7f41480cc300 2023-11-04T01:37:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.224+0000 7f413e7fc640 1 --2- 172.21.15.114:0/1026990543 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f412c06aea0 0x7f412c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.224+0000 7f413e7fc640 1 -- 172.21.15.114:0/1026990543 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f414408a440 con 0x7f41480cc300 2023-11-04T01:37:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.224+0000 7f414d1b5640 1 --2- 172.21.15.114:0/1026990543 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f412c06aea0 0x7f412c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.225+0000 7f414d1b5640 1 --2- 172.21.15.114:0/1026990543 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f412c06aea0 0x7f412c06d360 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4138036000 tx=0x7f4138030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:40.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.228+0000 7f413e7fc640 1 -- 172.21.15.114:0/1026990543 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4144055190 con 0x7f41480cc300 2023-11-04T01:37:40.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:40.429+0000 7f414fc1a640 1 -- 172.21.15.114:0/1026990543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f41480b3650 con 0x7f41480cc300 2023-11-04T01:37:41.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.104+0000 7f413e7fc640 1 -- 172.21.15.114:0/1026990543 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f41440587b0 con 0x7f41480cc300 2023-11-04T01:37:41.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.107+0000 7f414fc1a640 1 -- 172.21.15.114:0/1026990543 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f412c06aea0 msgr2=0x7f412c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.107+0000 7f414fc1a640 1 --2- 172.21.15.114:0/1026990543 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f412c06aea0 0x7f412c06d360 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4138036000 tx=0x7f4138030000 comp rx=0 tx=0).stop 2023-11-04T01:37:41.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.107+0000 7f414fc1a640 1 -- 172.21.15.114:0/1026990543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41480cc300 msgr2=0x7f41480ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.107+0000 7f414fc1a640 1 --2- 172.21.15.114:0/1026990543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41480cc300 0x7f41480ce220 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f414400ce00 tx=0x7f414400a650 comp rx=0 tx=0).stop 2023-11-04T01:37:41.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.107+0000 7f414fc1a640 1 -- 172.21.15.114:0/1026990543 shutdown_connections 2023-11-04T01:37:41.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.107+0000 7f414fc1a640 1 --2- 172.21.15.114:0/1026990543 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41480ac2a0 0x7f414806a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.107+0000 7f414fc1a640 1 --2- 172.21.15.114:0/1026990543 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f412c06aea0 0x7f412c06d360 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.107+0000 7f414fc1a640 1 --2- 172.21.15.114:0/1026990543 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f414815e3f0 0x7f414814ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.107+0000 7f414fc1a640 1 --2- 172.21.15.114:0/1026990543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41480cc300 0x7f41480ce220 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.107+0000 7f414fc1a640 1 -- 172.21.15.114:0/1026990543 >> 172.21.15.114:0/1026990543 conn(0x7f4148071820 msgr2=0x7f41480b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:41.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.107+0000 7f414fc1a640 1 -- 172.21.15.114:0/1026990543 shutdown_connections 2023-11-04T01:37:41.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.107+0000 7f414fc1a640 1 -- 172.21.15.114:0/1026990543 wait complete. 2023-11-04T01:37:41.123 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:37:41.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.230+0000 7f0d8fec2640 1 Processor -- start 2023-11-04T01:37:41.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.230+0000 7f0d8fec2640 1 -- start start 2023-11-04T01:37:41.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.231+0000 7f0d8fec2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0d8806f4a0 0x7f0d880b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.231+0000 7f0d8fec2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0d880cd740 0x7f0d880b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.231+0000 7f0d8fec2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8806ed30 con 0x7f0d880cd360 2023-11-04T01:37:41.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.231+0000 7f0d8fec2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d880b5250 con 0x7f0d880cd740 2023-11-04T01:37:41.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.231+0000 7f0d8fec2640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8806f260 con 0x7f0d8806f4a0 2023-11-04T01:37:41.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.231+0000 7f0d8dc5e640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0d880cd360 0x7f0d8806ad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56862/0 (socket says 172.21.15.114:56862) 2023-11-04T01:37:41.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.231+0000 7f0d8e45f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0d880cd740 0x7f0d880b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.231+0000 7f0d8dc5e640 1 -- 172.21.15.114:0/1811655585 learned_addr learned my addr 172.21.15.114:0/1811655585 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:41.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.232+0000 7f0d8e45f640 1 -- 172.21.15.114:0/1811655585 >> v2:172.21.15.141:3300/0 conn(0x7f0d8806f4a0 msgr2=0x7f0d880b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:41.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.232+0000 7f0d8d45d640 1 --2- 172.21.15.114:0/1811655585 >> v2:172.21.15.141:3300/0 conn(0x7f0d8806f4a0 0x7f0d880b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.232+0000 7f0d8e45f640 1 --2- 172.21.15.114:0/1811655585 >> v2:172.21.15.141:3300/0 conn(0x7f0d8806f4a0 0x7f0d880b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.232+0000 7f0d8cc5c640 1 -- 172.21.15.114:0/1811655585 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555204267 0 0) 0x7f0d8806ed30 con 0x7f0d880cd360 2023-11-04T01:37:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.232+0000 7f0d8e45f640 1 -- 172.21.15.114:0/1811655585 >> v1:172.21.15.114:6789/0 conn(0x7f0d880cd360 legacy=0x7f0d8806ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.232+0000 7f0d8e45f640 1 -- 172.21.15.114:0/1811655585 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8806a8a0 con 0x7f0d880cd740 2023-11-04T01:37:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.232+0000 7f0d8d45d640 1 --2- 172.21.15.114:0/1811655585 >> v2:172.21.15.141:3300/0 conn(0x7f0d8806f4a0 0x7f0d880b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.232+0000 7f0d8e45f640 1 --2- 172.21.15.114:0/1811655585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d880cd740 0x7f0d880b4d10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0d88070ce0 tx=0x7f0d8002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94eb3fcd6da8fe33 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.232+0000 7f0d8cc5c640 1 -- 172.21.15.114:0/1811655585 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8002cc80 con 0x7f0d880cd740 2023-11-04T01:37:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.233+0000 7f0d8cc5c640 1 -- 172.21.15.114:0/1811655585 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8002cde0 con 0x7f0d880cd740 2023-11-04T01:37:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.233+0000 7f0d8cc5c640 1 -- 172.21.15.114:0/1811655585 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d80034660 con 0x7f0d880cd740 2023-11-04T01:37:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.233+0000 7f0d8fec2640 1 -- 172.21.15.114:0/1811655585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d880cd740 msgr2=0x7f0d880b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.233+0000 7f0d8fec2640 1 --2- 172.21.15.114:0/1811655585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d880cd740 0x7f0d880b4d10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0d88070ce0 tx=0x7f0d8002bed0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.233+0000 7f0d8fec2640 1 -- 172.21.15.114:0/1811655585 shutdown_connections 2023-11-04T01:37:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.233+0000 7f0d8fec2640 1 --2- 172.21.15.114:0/1811655585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d880cd740 0x7f0d880b4d10 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.233+0000 7f0d8fec2640 1 --2- 172.21.15.114:0/1811655585 >> v2:172.21.15.141:3300/0 conn(0x7f0d8806f4a0 0x7f0d880b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.233+0000 7f0d8fec2640 1 -- 172.21.15.114:0/1811655585 >> 172.21.15.114:0/1811655585 conn(0x7f0d880b0ce0 msgr2=0x7f0d880b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:41.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.233+0000 7f0d8fec2640 1 -- 172.21.15.114:0/1811655585 shutdown_connections 2023-11-04T01:37:41.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.233+0000 7f0d8fec2640 1 -- 172.21.15.114:0/1811655585 wait complete. 2023-11-04T01:37:41.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.234+0000 7f0d8fec2640 1 Processor -- start 2023-11-04T01:37:41.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.234+0000 7f0d8fec2640 1 -- start start 2023-11-04T01:37:41.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.235+0000 7f0d8fec2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d8806f4a0 0x7f0d8815a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.235+0000 7f0d8fec2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d880cd360 0x7f0d881583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.235+0000 7f0d8fec2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d880cd740 0x7f0d8815d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.235+0000 7f0d8fec2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d88149040 con 0x7f0d8806f4a0 2023-11-04T01:37:41.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.235+0000 7f0d8fec2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8815c360 con 0x7f0d880cd360 2023-11-04T01:37:41.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.235+0000 7f0d8fec2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8815c600 con 0x7f0d880cd740 2023-11-04T01:37:41.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.235+0000 7f0d8dc5e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d8806f4a0 0x7f0d8815a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.235+0000 7f0d8dc5e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d8806f4a0 0x7f0d8815a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37822/0 (socket says 172.21.15.114:37822) 2023-11-04T01:37:41.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.235+0000 7f0d8dc5e640 1 -- 172.21.15.114:0/1071907369 learned_addr learned my addr 172.21.15.114:0/1071907369 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:41.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.235+0000 7f0d8dc5e640 1 -- 172.21.15.114:0/1071907369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d880cd740 msgr2=0x7f0d8815d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.235+0000 7f0d8dc5e640 1 --2- 172.21.15.114:0/1071907369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d880cd740 0x7f0d8815d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.235+0000 7f0d8dc5e640 1 -- 172.21.15.114:0/1071907369 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d880cd360 msgr2=0x7f0d881583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:41.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.235+0000 7f0d8dc5e640 1 --2- 172.21.15.114:0/1071907369 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d880cd360 0x7f0d881583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:41.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.235+0000 7f0d8dc5e640 1 -- 172.21.15.114:0/1071907369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d80009a70 con 0x7f0d8806f4a0 2023-11-04T01:37:41.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.235+0000 7f0d8dc5e640 1 --2- 172.21.15.114:0/1071907369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d8806f4a0 0x7f0d8815a8e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400c430 tx=0x7f0d8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:41.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.236+0000 7f0d7e7fc640 1 -- 172.21.15.114:0/1071907369 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d840074e0 con 0x7f0d8806f4a0 2023-11-04T01:37:41.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.236+0000 7f0d7e7fc640 1 -- 172.21.15.114:0/1071907369 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d84007660 con 0x7f0d8806f4a0 2023-11-04T01:37:41.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.236+0000 7f0d8fec2640 1 -- 172.21.15.114:0/1071907369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8815aec0 con 0x7f0d8806f4a0 2023-11-04T01:37:41.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.236+0000 7f0d7e7fc640 1 -- 172.21.15.114:0/1071907369 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d84004a20 con 0x7f0d8806f4a0 2023-11-04T01:37:41.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.236+0000 7f0d8fec2640 1 -- 172.21.15.114:0/1071907369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8815cb80 con 0x7f0d8806f4a0 2023-11-04T01:37:41.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.237+0000 7f0d8fec2640 1 -- 172.21.15.114:0/1071907369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8804e490 con 0x7f0d8806f4a0 2023-11-04T01:37:41.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.237+0000 7f0d7e7fc640 1 -- 172.21.15.114:0/1071907369 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d84004b80 con 0x7f0d8806f4a0 2023-11-04T01:37:41.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.237+0000 7f0d7e7fc640 1 --2- 172.21.15.114:0/1071907369 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d6c06ae70 0x7f0d6c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:41.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.237+0000 7f0d7e7fc640 1 -- 172.21.15.114:0/1071907369 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f0d840897c0 con 0x7f0d8806f4a0 2023-11-04T01:37:41.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.237+0000 7f0d8d45d640 1 --2- 172.21.15.114:0/1071907369 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d6c06ae70 0x7f0d6c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:41.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.238+0000 7f0d8d45d640 1 --2- 172.21.15.114:0/1071907369 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d6c06ae70 0x7f0d6c06d330 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0d78006fd0 tx=0x7f0d78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:41.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.242+0000 7f0d7e7fc640 1 -- 172.21.15.114:0/1071907369 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d840544f0 con 0x7f0d8806f4a0 2023-11-04T01:37:41.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:41.409+0000 7f0d8fec2640 1 -- 172.21.15.114:0/1071907369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0d880723f0 con 0x7f0d8806f4a0 2023-11-04T01:37:42.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.106+0000 7f0d7e7fc640 1 -- 172.21.15.114:0/1071907369 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0d84057b10 con 0x7f0d8806f4a0 2023-11-04T01:37:42.108 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:37:42.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.108+0000 7f0d8fec2640 1 -- 172.21.15.114:0/1071907369 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d6c06ae70 msgr2=0x7f0d6c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.108+0000 7f0d8fec2640 1 --2- 172.21.15.114:0/1071907369 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d6c06ae70 0x7f0d6c06d330 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0d78006fd0 tx=0x7f0d78008040 comp rx=0 tx=0).stop 2023-11-04T01:37:42.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.108+0000 7f0d8fec2640 1 -- 172.21.15.114:0/1071907369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d8806f4a0 msgr2=0x7f0d8815a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.108+0000 7f0d8fec2640 1 --2- 172.21.15.114:0/1071907369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d8806f4a0 0x7f0d8815a8e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400c430 tx=0x7f0d8400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.108+0000 7f0d8fec2640 1 -- 172.21.15.114:0/1071907369 shutdown_connections 2023-11-04T01:37:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.108+0000 7f0d8fec2640 1 --2- 172.21.15.114:0/1071907369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0d880cd740 0x7f0d8815d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.108+0000 7f0d8fec2640 1 --2- 172.21.15.114:0/1071907369 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d6c06ae70 0x7f0d6c06d330 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.108+0000 7f0d8fec2640 1 --2- 172.21.15.114:0/1071907369 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0d880cd360 0x7f0d881583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.108+0000 7f0d8fec2640 1 --2- 172.21.15.114:0/1071907369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d8806f4a0 0x7f0d8815a8e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.108+0000 7f0d8fec2640 1 -- 172.21.15.114:0/1071907369 >> 172.21.15.114:0/1071907369 conn(0x7f0d880b0ce0 msgr2=0x7f0d88156140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.108+0000 7f0d8fec2640 1 -- 172.21.15.114:0/1071907369 shutdown_connections 2023-11-04T01:37:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.108+0000 7f0d8fec2640 1 -- 172.21.15.114:0/1071907369 wait complete. 2023-11-04T01:37:42.123 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:37:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.233+0000 7f935fbe2640 1 Processor -- start 2023-11-04T01:37:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.233+0000 7f935fbe2640 1 -- start start 2023-11-04T01:37:42.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.234+0000 7f935fbe2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93580cb680 0x7f93580cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.234+0000 7f935fbe2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f93580cda80 0x7f935815d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.234+0000 7f935fbe2640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9358161870 con 0x7f935815d1b0 2023-11-04T01:37:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.234+0000 7f935fbe2640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93580cdf10 con 0x7f93580cda80 2023-11-04T01:37:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.234+0000 7f935fbe2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9358160c60 con 0x7f93580cb680 2023-11-04T01:37:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.234+0000 7f935d17d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93580cb680 0x7f93580cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.234+0000 7f935e17f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f93580cda80 0x7f935815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.234+0000 7f935d97e640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f935815d1b0 0x7f93580ce7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:60018/0 (socket says 172.21.15.114:60018) 2023-11-04T01:37:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.234+0000 7f935d97e640 1 -- 172.21.15.114:0/1333041933 learned_addr learned my addr 172.21.15.114:0/1333041933 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.234+0000 7f935c97c640 1 -- 172.21.15.114:0/1333041933 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570652258 0 0) 0x7f9358161870 con 0x7f935815d1b0 2023-11-04T01:37:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.234+0000 7f935c97c640 1 -- 172.21.15.114:0/1333041933 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9344003520 con 0x7f935815d1b0 2023-11-04T01:37:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.234+0000 7f935d17d640 1 -- 172.21.15.114:0/1333041933 >> v2:172.21.15.141:3300/0 conn(0x7f93580cda80 msgr2=0x7f935815d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:42.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.234+0000 7f935d17d640 1 --2- 172.21.15.114:0/1333041933 >> v2:172.21.15.141:3300/0 conn(0x7f93580cda80 0x7f935815d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.234+0000 7f935d17d640 1 -- 172.21.15.114:0/1333041933 >> v1:172.21.15.141:6789/0 conn(0x7f935815d1b0 legacy=0x7f93580ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.234+0000 7f935d17d640 1 -- 172.21.15.114:0/1333041933 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9358160f40 con 0x7f93580cb680 2023-11-04T01:37:42.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.234+0000 7f935e17f640 1 --2- 172.21.15.114:0/1333041933 >> v2:172.21.15.141:3300/0 conn(0x7f93580cda80 0x7f935815d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:42.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.235+0000 7f935d17d640 1 --2- 172.21.15.114:0/1333041933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93580cb680 0x7f93580cd540 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f93480097a0 tx=0x7f934802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e6f5963c6f02f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.235+0000 7f935c97c640 1 -- 172.21.15.114:0/1333041933 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348031830 con 0x7f93580cb680 2023-11-04T01:37:42.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.235+0000 7f935c97c640 1 -- 172.21.15.114:0/1333041933 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9348031990 con 0x7f93580cb680 2023-11-04T01:37:42.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.235+0000 7f935c97c640 1 -- 172.21.15.114:0/1333041933 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348031d00 con 0x7f93580cb680 2023-11-04T01:37:42.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.236+0000 7f935fbe2640 1 -- 172.21.15.114:0/1333041933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93580cb680 msgr2=0x7f93580cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.236+0000 7f935fbe2640 1 --2- 172.21.15.114:0/1333041933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93580cb680 0x7f93580cd540 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f93480097a0 tx=0x7f934802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.236+0000 7f935fbe2640 1 -- 172.21.15.114:0/1333041933 shutdown_connections 2023-11-04T01:37:42.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.236+0000 7f935fbe2640 1 --2- 172.21.15.114:0/1333041933 >> v2:172.21.15.141:3300/0 conn(0x7f93580cda80 0x7f935815d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.236+0000 7f935fbe2640 1 --2- 172.21.15.114:0/1333041933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93580cb680 0x7f93580cd540 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.236+0000 7f935fbe2640 1 -- 172.21.15.114:0/1333041933 >> 172.21.15.114:0/1333041933 conn(0x7f935806ea20 msgr2=0x7f935806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:42.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.236+0000 7f935fbe2640 1 -- 172.21.15.114:0/1333041933 shutdown_connections 2023-11-04T01:37:42.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.236+0000 7f935fbe2640 1 -- 172.21.15.114:0/1333041933 wait complete. 2023-11-04T01:37:42.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.237+0000 7f935fbe2640 1 Processor -- start 2023-11-04T01:37:42.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.237+0000 7f935fbe2640 1 -- start start 2023-11-04T01:37:42.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935fbe2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93580cb680 0x7f93581f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935fbe2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93580cda80 0x7f93580b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935fbe2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f935815d1b0 0x7f93580cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935fbe2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93580b4010 con 0x7f935815d1b0 2023-11-04T01:37:42.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935fbe2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93581f60f0 con 0x7f93580cda80 2023-11-04T01:37:42.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935fbe2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93580b3d40 con 0x7f93580cb680 2023-11-04T01:37:42.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935e17f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f935815d1b0 0x7f93580cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935e17f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f935815d1b0 0x7f93580cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37830/0 (socket says 172.21.15.114:37830) 2023-11-04T01:37:42.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935e17f640 1 -- 172.21.15.114:0/4152059787 learned_addr learned my addr 172.21.15.114:0/4152059787 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:42.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935d17d640 1 --2- 172.21.15.114:0/4152059787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93580cda80 0x7f93580b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935d97e640 1 --2- 172.21.15.114:0/4152059787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93580cb680 0x7f93581f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935e17f640 1 -- 172.21.15.114:0/4152059787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93580cb680 msgr2=0x7f93581f36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935e17f640 1 --2- 172.21.15.114:0/4152059787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93580cb680 0x7f93581f36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935e17f640 1 -- 172.21.15.114:0/4152059787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93580cda80 msgr2=0x7f93580b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935e17f640 1 --2- 172.21.15.114:0/4152059787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93580cda80 0x7f93580b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935e17f640 1 -- 172.21.15.114:0/4152059787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9350009a70 con 0x7f935815d1b0 2023-11-04T01:37:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.238+0000 7f935d97e640 1 --2- 172.21.15.114:0/4152059787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93580cb680 0x7f93581f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.239+0000 7f935e17f640 1 --2- 172.21.15.114:0/4152059787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f935815d1b0 0x7f93580cbe00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f935000efc0 tx=0x7f9350009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.239+0000 7f934e7fc640 1 -- 172.21.15.114:0/4152059787 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350009d70 con 0x7f935815d1b0 2023-11-04T01:37:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.239+0000 7f934e7fc640 1 -- 172.21.15.114:0/4152059787 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935000f040 con 0x7f935815d1b0 2023-11-04T01:37:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.239+0000 7f935fbe2640 1 -- 172.21.15.114:0/4152059787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9348009400 con 0x7f935815d1b0 2023-11-04T01:37:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.239+0000 7f934e7fc640 1 -- 172.21.15.114:0/4152059787 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350003990 con 0x7f935815d1b0 2023-11-04T01:37:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.239+0000 7f935fbe2640 1 -- 172.21.15.114:0/4152059787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93581f65e0 con 0x7f935815d1b0 2023-11-04T01:37:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.240+0000 7f935fbe2640 1 -- 172.21.15.114:0/4152059787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935804e490 con 0x7f935815d1b0 2023-11-04T01:37:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.240+0000 7f934e7fc640 1 -- 172.21.15.114:0/4152059787 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f93500144a0 con 0x7f935815d1b0 2023-11-04T01:37:42.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.240+0000 7f934e7fc640 1 --2- 172.21.15.114:0/4152059787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f933c06ae70 0x7f933c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:42.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.240+0000 7f934e7fc640 1 -- 172.21.15.114:0/4152059787 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f935008a590 con 0x7f935815d1b0 2023-11-04T01:37:42.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.241+0000 7f935d97e640 1 --2- 172.21.15.114:0/4152059787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f933c06ae70 0x7f933c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:42.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.241+0000 7f935d97e640 1 --2- 172.21.15.114:0/4152059787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f933c06ae70 0x7f933c06d330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9354005880 tx=0x7f9354009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:42.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.245+0000 7f934e7fc640 1 -- 172.21.15.114:0/4152059787 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f93500553e0 con 0x7f935815d1b0 2023-11-04T01:37:42.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:42.410+0000 7f935fbe2640 1 -- 172.21.15.114:0/4152059787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f935806b370 con 0x7f935815d1b0 2023-11-04T01:37:43.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.107+0000 7f934e7fc640 1 -- 172.21.15.114:0/4152059787 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9350058a00 con 0x7f935815d1b0 2023-11-04T01:37:43.109 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2023-11-04T01:37:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.111+0000 7f935fbe2640 1 -- 172.21.15.114:0/4152059787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f933c06ae70 msgr2=0x7f933c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.111+0000 7f935fbe2640 1 --2- 172.21.15.114:0/4152059787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f933c06ae70 0x7f933c06d330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9354005880 tx=0x7f9354009040 comp rx=0 tx=0).stop 2023-11-04T01:37:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.111+0000 7f935fbe2640 1 -- 172.21.15.114:0/4152059787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f935815d1b0 msgr2=0x7f93580cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.111+0000 7f935fbe2640 1 --2- 172.21.15.114:0/4152059787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f935815d1b0 0x7f93580cbe00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f935000efc0 tx=0x7f9350009f90 comp rx=0 tx=0).stop 2023-11-04T01:37:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.111+0000 7f935fbe2640 1 -- 172.21.15.114:0/4152059787 shutdown_connections 2023-11-04T01:37:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.111+0000 7f935fbe2640 1 --2- 172.21.15.114:0/4152059787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f935815d1b0 0x7f93580cbe00 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.111+0000 7f935fbe2640 1 --2- 172.21.15.114:0/4152059787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f933c06ae70 0x7f933c06d330 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.111+0000 7f935fbe2640 1 --2- 172.21.15.114:0/4152059787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f93580cda80 0x7f93580b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.111+0000 7f935fbe2640 1 --2- 172.21.15.114:0/4152059787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f93580cb680 0x7f93581f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.111+0000 7f935fbe2640 1 -- 172.21.15.114:0/4152059787 >> 172.21.15.114:0/4152059787 conn(0x7f935806ea20 msgr2=0x7f93580c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:43.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.111+0000 7f935fbe2640 1 -- 172.21.15.114:0/4152059787 shutdown_connections 2023-11-04T01:37:43.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.111+0000 7f935fbe2640 1 -- 172.21.15.114:0/4152059787 wait complete. 2023-11-04T01:37:43.130 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-04T01:37:43.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.238+0000 7f9a557c0640 1 Processor -- start 2023-11-04T01:37:43.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.238+0000 7f9a557c0640 1 -- start start 2023-11-04T01:37:43.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.239+0000 7f9a557c0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9a5015d4b0 0x7f9a5015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:43.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.239+0000 7f9a557c0640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9a500d17b0 0x7f9a500d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:43.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.239+0000 7f9a557c0640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a500d1320 con 0x7f9a500cd9f0 2023-11-04T01:37:43.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.239+0000 7f9a557c0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5015e4d0 con 0x7f9a5015d4b0 2023-11-04T01:37:43.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.239+0000 7f9a557c0640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5015df10 con 0x7f9a500d17b0 2023-11-04T01:37:43.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.239+0000 7f9a4e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9a5015d4b0 0x7f9a5015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:43.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.239+0000 7f9a4e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9a5015d4b0 0x7f9a5015d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37842/0 (socket says 172.21.15.114:37842) 2023-11-04T01:37:43.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.239+0000 7f9a4e7fc640 1 -- 172.21.15.114:0/3068560897 learned_addr learned my addr 172.21.15.114:0/3068560897 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:43.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.239+0000 7f9a4f7fe640 1 --2- 172.21.15.114:0/3068560897 >> v2:172.21.15.141:3300/0 conn(0x7f9a500d17b0 0x7f9a500d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:43.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.240+0000 7f9a4e7fc640 1 -- 172.21.15.114:0/3068560897 >> v2:172.21.15.141:3300/0 conn(0x7f9a500d17b0 msgr2=0x7f9a500d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:43.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.240+0000 7f9a4e7fc640 1 --2- 172.21.15.114:0/3068560897 >> v2:172.21.15.141:3300/0 conn(0x7f9a500d17b0 0x7f9a500d1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.240+0000 7f9a4e7fc640 1 -- 172.21.15.114:0/3068560897 >> v1:172.21.15.141:6789/0 conn(0x7f9a500cd9f0 legacy=0x7f9a500cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:43.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.240+0000 7f9a4e7fc640 1 -- 172.21.15.114:0/3068560897 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5015e1f0 con 0x7f9a5015d4b0 2023-11-04T01:37:43.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.240+0000 7f9a4e7fc640 1 --2- 172.21.15.114:0/3068560897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a5015d4b0 0x7f9a5015d910 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9a44009870 tx=0x7f9a4402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84255152cb690c70 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:43.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.240+0000 7f9a4dffb640 1 -- 172.21.15.114:0/3068560897 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4402f840 con 0x7f9a5015d4b0 2023-11-04T01:37:43.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.241+0000 7f9a4dffb640 1 -- 172.21.15.114:0/3068560897 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4402f9a0 con 0x7f9a5015d4b0 2023-11-04T01:37:43.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.241+0000 7f9a4dffb640 1 -- 172.21.15.114:0/3068560897 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4402fd30 con 0x7f9a5015d4b0 2023-11-04T01:37:43.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.241+0000 7f9a557c0640 1 -- 172.21.15.114:0/3068560897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a5015d4b0 msgr2=0x7f9a5015d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:43.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.241+0000 7f9a557c0640 1 --2- 172.21.15.114:0/3068560897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a5015d4b0 0x7f9a5015d910 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9a44009870 tx=0x7f9a4402ba20 comp rx=0 tx=0).stop 2023-11-04T01:37:43.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.241+0000 7f9a557c0640 1 -- 172.21.15.114:0/3068560897 shutdown_connections 2023-11-04T01:37:43.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.241+0000 7f9a557c0640 1 --2- 172.21.15.114:0/3068560897 >> v2:172.21.15.141:3300/0 conn(0x7f9a500d17b0 0x7f9a500d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.241+0000 7f9a557c0640 1 --2- 172.21.15.114:0/3068560897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a5015d4b0 0x7f9a5015d910 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.241+0000 7f9a557c0640 1 -- 172.21.15.114:0/3068560897 >> 172.21.15.114:0/3068560897 conn(0x7f9a50071c40 msgr2=0x7f9a50072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:43.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.241+0000 7f9a557c0640 1 -- 172.21.15.114:0/3068560897 shutdown_connections 2023-11-04T01:37:43.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.241+0000 7f9a557c0640 1 -- 172.21.15.114:0/3068560897 wait complete. 2023-11-04T01:37:43.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.242+0000 7f9a557c0640 1 Processor -- start 2023-11-04T01:37:43.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.242+0000 7f9a557c0640 1 -- start start 2023-11-04T01:37:43.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.243+0000 7f9a557c0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a500cd9f0 0x7f9a501f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.243+0000 7f9a557c0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a500d17b0 0x7f9a500cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.243+0000 7f9a557c0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a5015d4b0 0x7f9a500ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.243+0000 7f9a557c0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a500ca110 con 0x7f9a500cd9f0 2023-11-04T01:37:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.243+0000 7f9a557c0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a501f68c0 con 0x7f9a500d17b0 2023-11-04T01:37:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.243+0000 7f9a557c0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a501f6ba0 con 0x7f9a5015d4b0 2023-11-04T01:37:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.243+0000 7f9a4effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a500cd9f0 0x7f9a501f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.243+0000 7f9a4effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a500cd9f0 0x7f9a501f6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37852/0 (socket says 172.21.15.114:37852) 2023-11-04T01:37:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.243+0000 7f9a4effd640 1 -- 172.21.15.114:0/4264793442 learned_addr learned my addr 172.21.15.114:0/4264793442 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.243+0000 7f9a4e7fc640 1 --2- 172.21.15.114:0/4264793442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a500d17b0 0x7f9a500cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.243+0000 7f9a4f7fe640 1 --2- 172.21.15.114:0/4264793442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a5015d4b0 0x7f9a500ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.244+0000 7f9a4effd640 1 -- 172.21.15.114:0/4264793442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a5015d4b0 msgr2=0x7f9a500ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.244+0000 7f9a4effd640 1 --2- 172.21.15.114:0/4264793442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a5015d4b0 0x7f9a500ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.244+0000 7f9a4effd640 1 -- 172.21.15.114:0/4264793442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a500d17b0 msgr2=0x7f9a500cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:43.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.244+0000 7f9a4effd640 1 --2- 172.21.15.114:0/4264793442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a500d17b0 0x7f9a500cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:43.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.244+0000 7f9a4effd640 1 -- 172.21.15.114:0/4264793442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a440094d0 con 0x7f9a500cd9f0 2023-11-04T01:37:43.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.244+0000 7f9a4f7fe640 1 --2- 172.21.15.114:0/4264793442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a5015d4b0 0x7f9a500ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:43.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.244+0000 7f9a4effd640 1 --2- 172.21.15.114:0/4264793442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a500cd9f0 0x7f9a501f6090 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000c870 tx=0x7f9a4000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:43.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.244+0000 7f9a377fe640 1 -- 172.21.15.114:0/4264793442 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a40003b70 con 0x7f9a500cd9f0 2023-11-04T01:37:43.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.244+0000 7f9a377fe640 1 -- 172.21.15.114:0/4264793442 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a40003cf0 con 0x7f9a500cd9f0 2023-11-04T01:37:43.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.244+0000 7f9a557c0640 1 -- 172.21.15.114:0/4264793442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a501f6e80 con 0x7f9a500cd9f0 2023-11-04T01:37:43.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.244+0000 7f9a377fe640 1 -- 172.21.15.114:0/4264793442 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4000aa90 con 0x7f9a500cd9f0 2023-11-04T01:37:43.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.244+0000 7f9a557c0640 1 -- 172.21.15.114:0/4264793442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a501f65d0 con 0x7f9a500cd9f0 2023-11-04T01:37:43.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.245+0000 7f9a557c0640 1 -- 172.21.15.114:0/4264793442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5004e490 con 0x7f9a500cd9f0 2023-11-04T01:37:43.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.245+0000 7f9a377fe640 1 -- 172.21.15.114:0/4264793442 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a4000abf0 con 0x7f9a500cd9f0 2023-11-04T01:37:43.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.246+0000 7f9a377fe640 1 --2- 172.21.15.114:0/4264793442 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9a3c06ae70 0x7f9a3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:43.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.246+0000 7f9a377fe640 1 -- 172.21.15.114:0/4264793442 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f9a40089450 con 0x7f9a500cd9f0 2023-11-04T01:37:43.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.246+0000 7f9a4e7fc640 1 --2- 172.21.15.114:0/4264793442 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9a3c06ae70 0x7f9a3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:43.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.246+0000 7f9a4e7fc640 1 --2- 172.21.15.114:0/4264793442 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9a3c06ae70 0x7f9a3c06d330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9a44036000 tx=0x7f9a44008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:43.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.250+0000 7f9a377fe640 1 -- 172.21.15.114:0/4264793442 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9a400544b0 con 0x7f9a500cd9f0 2023-11-04T01:37:43.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:43.415+0000 7f9a557c0640 1 -- 172.21.15.114:0/4264793442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9a5015bc40 con 0x7f9a500cd9f0 2023-11-04T01:37:44.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.117+0000 7f9a377fe640 1 -- 172.21.15.114:0/4264793442 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f9a40057ad0 con 0x7f9a500cd9f0 2023-11-04T01:37:44.119 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data_ec' removed 2023-11-04T01:37:44.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.120+0000 7f9a557c0640 1 -- 172.21.15.114:0/4264793442 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9a3c06ae70 msgr2=0x7f9a3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.120+0000 7f9a557c0640 1 --2- 172.21.15.114:0/4264793442 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9a3c06ae70 0x7f9a3c06d330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9a44036000 tx=0x7f9a44008030 comp rx=0 tx=0).stop 2023-11-04T01:37:44.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.120+0000 7f9a557c0640 1 -- 172.21.15.114:0/4264793442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a500cd9f0 msgr2=0x7f9a501f6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.120+0000 7f9a557c0640 1 --2- 172.21.15.114:0/4264793442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a500cd9f0 0x7f9a501f6090 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000c870 tx=0x7f9a4000cd30 comp rx=0 tx=0).stop 2023-11-04T01:37:44.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.120+0000 7f9a557c0640 1 -- 172.21.15.114:0/4264793442 shutdown_connections 2023-11-04T01:37:44.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.120+0000 7f9a557c0640 1 --2- 172.21.15.114:0/4264793442 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a5015d4b0 0x7f9a500ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.120+0000 7f9a557c0640 1 --2- 172.21.15.114:0/4264793442 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9a3c06ae70 0x7f9a3c06d330 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.120+0000 7f9a557c0640 1 --2- 172.21.15.114:0/4264793442 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a500d17b0 0x7f9a500cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.120+0000 7f9a557c0640 1 --2- 172.21.15.114:0/4264793442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a500cd9f0 0x7f9a501f6090 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.120+0000 7f9a557c0640 1 -- 172.21.15.114:0/4264793442 >> 172.21.15.114:0/4264793442 conn(0x7f9a50071c40 msgr2=0x7f9a5015f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:44.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.120+0000 7f9a557c0640 1 -- 172.21.15.114:0/4264793442 shutdown_connections 2023-11-04T01:37:44.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.120+0000 7f9a557c0640 1 -- 172.21.15.114:0/4264793442 wait complete. 2023-11-04T01:37:44.133 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:37:44.133 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:37:44.135 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:37:44.135 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:44.135 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:37:44.135 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:37:44.135 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:37:44.136 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:44.136 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:37:44.136 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:37:44.136 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:37:44.136 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:44.136 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:37:44.137 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:37:44.137 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:37:44.137 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:37:44.147 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:37:44.147 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:37:44.148 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:37:44.148 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:37:44.149 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:37:44.149 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:37:44.150 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:37:44.150 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:37:44.190 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:37:44.194 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:44.195 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:37:44.196 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:44.196 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:37:44.196 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:44.197 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:37:44.197 DEBUG:teuthology.parallel:result is None 2023-11-04T01:37:44.197 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:37:44.265 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2023-11-04T01:37:44.266 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2023-11-04T01:37:44.279 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-04T01:37:44.280 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-04T01:37:44.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.301+0000 7f966b37d640 1 Processor -- start 2023-11-04T01:37:44.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.301+0000 7f966b37d640 1 -- start start 2023-11-04T01:37:44.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f966b37d640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f966406a830 0x7f96640ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f966b37d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f966415e590 0x7f96640722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f966b37d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96640ca620 con 0x7f966415e1b0 2023-11-04T01:37:44.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f966b37d640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966406e7e0 con 0x7f966406a830 2023-11-04T01:37:44.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f966b37d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96640cb060 con 0x7f966415e590 2023-11-04T01:37:44.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f9669119640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f966415e1b0 0x7f966406a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56892/0 (socket says 172.21.15.114:56892) 2023-11-04T01:37:44.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f9669119640 1 -- 172.21.15.114:0/1880356576 learned_addr learned my addr 172.21.15.114:0/1880356576 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:44.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f965bfff640 1 -- 172.21.15.114:0/1880356576 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225655873 0 0) 0x7f96640ca620 con 0x7f966415e1b0 2023-11-04T01:37:44.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f965bfff640 1 -- 172.21.15.114:0/1880356576 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9650003520 con 0x7f966415e1b0 2023-11-04T01:37:44.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f9668918640 1 --2- 172.21.15.114:0/1880356576 >> v2:172.21.15.141:3300/0 conn(0x7f966406a830 0x7f96640ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f966991a640 1 --2- 172.21.15.114:0/1880356576 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f966415e590 0x7f96640722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f965bfff640 1 -- 172.21.15.114:0/1880356576 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 570828125 0 0) 0x7f9650003520 con 0x7f966415e1b0 2023-11-04T01:37:44.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f965bfff640 1 -- 172.21.15.114:0/1880356576 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f966415e590 msgr2=0x7f96640722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:44.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f965bfff640 1 --2- 172.21.15.114:0/1880356576 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f966415e590 0x7f96640722d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f965bfff640 1 -- 172.21.15.114:0/1880356576 >> v2:172.21.15.141:3300/0 conn(0x7f966406a830 msgr2=0x7f96640ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:44.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f965bfff640 1 --2- 172.21.15.114:0/1880356576 >> v2:172.21.15.141:3300/0 conn(0x7f966406a830 0x7f96640ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f965bfff640 1 -- 172.21.15.114:0/1880356576 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96640ca060 con 0x7f966415e1b0 2023-11-04T01:37:44.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f965bfff640 1 -- 172.21.15.114:0/1880356576 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f9660001670 con 0x7f966415e1b0 2023-11-04T01:37:44.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f9668918640 1 --2- 172.21.15.114:0/1880356576 >> v2:172.21.15.141:3300/0 conn(0x7f966406a830 0x7f96640ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:44.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f965bfff640 1 -- 172.21.15.114:0/1880356576 >> v1:172.21.15.114:6789/0 conn(0x7f966415e1b0 legacy=0x7f966406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f965bfff640 1 --2- 172.21.15.114:0/1880356576 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f966415e590 0x7f9650003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f965bfff640 1 --2- 172.21.15.114:0/1880356576 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9650003fa0 0x7f96500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f965bfff640 1 --2- 172.21.15.114:0/1880356576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9650004d00 0x7f9650005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f965bfff640 1 -- 172.21.15.114:0/1880356576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966406e7e0 con 0x7f9650004d00 2023-11-04T01:37:44.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f965bfff640 1 -- 172.21.15.114:0/1880356576 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96640cb060 con 0x7f9650003fa0 2023-11-04T01:37:44.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f965bfff640 1 -- 172.21.15.114:0/1880356576 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965000bb40 con 0x7f966415e590 2023-11-04T01:37:44.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f966991a640 1 --2- 172.21.15.114:0/1880356576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9650004d00 0x7f9650005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.302+0000 7f9669119640 1 --2- 172.21.15.114:0/1880356576 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f966415e590 0x7f9650003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.303+0000 7f9668918640 1 --2- 172.21.15.114:0/1880356576 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9650003fa0 0x7f96500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.303+0000 7f966991a640 1 -- 172.21.15.114:0/1880356576 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f966415e590 msgr2=0x7f9650003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:44.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.303+0000 7f966991a640 1 --2- 172.21.15.114:0/1880356576 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f966415e590 0x7f9650003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.303+0000 7f966991a640 1 -- 172.21.15.114:0/1880356576 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9650003fa0 msgr2=0x7f96500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:44.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.303+0000 7f966991a640 1 --2- 172.21.15.114:0/1880356576 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9650003fa0 0x7f96500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.303+0000 7f966991a640 1 -- 172.21.15.114:0/1880356576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9650003520 con 0x7f9650004d00 2023-11-04T01:37:44.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.303+0000 7f966991a640 1 --2- 172.21.15.114:0/1880356576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9650004d00 0x7f9650005180 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f965c007330 tx=0x7f96500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e82aabacf52287 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:44.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.304+0000 7f965bfff640 1 -- 172.21.15.114:0/1880356576 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c02cca0 con 0x7f9650004d00 2023-11-04T01:37:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.304+0000 7f965bfff640 1 -- 172.21.15.114:0/1880356576 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c02ce00 con 0x7f9650004d00 2023-11-04T01:37:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.304+0000 7f965bfff640 1 -- 172.21.15.114:0/1880356576 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c034680 con 0x7f9650004d00 2023-11-04T01:37:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.304+0000 7f966b37d640 1 -- 172.21.15.114:0/1880356576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9650004d00 msgr2=0x7f9650005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.304+0000 7f966b37d640 1 --2- 172.21.15.114:0/1880356576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9650004d00 0x7f9650005180 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f965c007330 tx=0x7f96500057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.304+0000 7f966991a640 1 -- 172.21.15.114:0/1880356576 reap_dead start 2023-11-04T01:37:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.304+0000 7f966b37d640 1 -- 172.21.15.114:0/1880356576 shutdown_connections 2023-11-04T01:37:44.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.304+0000 7f966b37d640 1 -- 172.21.15.114:0/1880356576 >> 172.21.15.114:0/1880356576 conn(0x7f966406d800 msgr2=0x7f966406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:44.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.304+0000 7f966b37d640 1 -- 172.21.15.114:0/1880356576 shutdown_connections 2023-11-04T01:37:44.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.304+0000 7f966b37d640 1 -- 172.21.15.114:0/1880356576 wait complete. 2023-11-04T01:37:44.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.305+0000 7f966b37d640 1 Processor -- start 2023-11-04T01:37:44.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.305+0000 7f966b37d640 1 -- start start 2023-11-04T01:37:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.306+0000 7f966b37d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96640c8a80 0x7f96641f79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.306+0000 7f966b37d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96640c50a0 0x7f96640c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.306+0000 7f966b37d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96640c7c80 0x7f96640c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.306+0000 7f966b37d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96641f7ee0 con 0x7f96640c50a0 2023-11-04T01:37:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.306+0000 7f966b37d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966415a890 con 0x7f96640c7c80 2023-11-04T01:37:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.306+0000 7f966b37d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96640c93a0 con 0x7f96640c8a80 2023-11-04T01:37:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.306+0000 7f9668918640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96640c50a0 0x7f96640c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.306+0000 7f9668918640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96640c50a0 0x7f96640c8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37874/0 (socket says 172.21.15.114:37874) 2023-11-04T01:37:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.306+0000 7f9668918640 1 -- 172.21.15.114:0/1730185898 learned_addr learned my addr 172.21.15.114:0/1730185898 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.306+0000 7f9669119640 1 --2- 172.21.15.114:0/1730185898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96640c8a80 0x7f96641f79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.306+0000 7f966991a640 1 --2- 172.21.15.114:0/1730185898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96640c7c80 0x7f96640c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.307+0000 7f9668918640 1 -- 172.21.15.114:0/1730185898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96640c8a80 msgr2=0x7f96641f79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.307+0000 7f9668918640 1 --2- 172.21.15.114:0/1730185898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96640c8a80 0x7f96641f79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.307+0000 7f9668918640 1 -- 172.21.15.114:0/1730185898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96640c7c80 msgr2=0x7f96640c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:44.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.307+0000 7f9668918640 1 --2- 172.21.15.114:0/1730185898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96640c7c80 0x7f96640c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:44.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.307+0000 7f9668918640 1 -- 172.21.15.114:0/1730185898 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96640c8640 con 0x7f96640c50a0 2023-11-04T01:37:44.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.307+0000 7f9668918640 1 --2- 172.21.15.114:0/1730185898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96640c50a0 0x7f96640c8e60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9654011600 tx=0x7f9654011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:44.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.307+0000 7f9659ffb640 1 -- 172.21.15.114:0/1730185898 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965400c070 con 0x7f96640c50a0 2023-11-04T01:37:44.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.307+0000 7f9659ffb640 1 -- 172.21.15.114:0/1730185898 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9654015930 con 0x7f96640c50a0 2023-11-04T01:37:44.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.307+0000 7f966b37d640 1 -- 172.21.15.114:0/1730185898 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96640c55f0 con 0x7f96640c50a0 2023-11-04T01:37:44.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.307+0000 7f9659ffb640 1 -- 172.21.15.114:0/1730185898 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9654015ca0 con 0x7f96640c50a0 2023-11-04T01:37:44.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.307+0000 7f966b37d640 1 -- 172.21.15.114:0/1730185898 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96640c5bb0 con 0x7f96640c50a0 2023-11-04T01:37:44.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.308+0000 7f966b37d640 1 -- 172.21.15.114:0/1730185898 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966406e340 con 0x7f96640c50a0 2023-11-04T01:37:44.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.308+0000 7f9659ffb640 1 -- 172.21.15.114:0/1730185898 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f965400f460 con 0x7f96640c50a0 2023-11-04T01:37:44.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.309+0000 7f9659ffb640 1 --2- 172.21.15.114:0/1730185898 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f964806ae70 0x7f964806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:44.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.309+0000 7f9669119640 1 --2- 172.21.15.114:0/1730185898 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f964806ae70 0x7f964806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:44.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.309+0000 7f9659ffb640 1 -- 172.21.15.114:0/1730185898 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f9654089680 con 0x7f96640c50a0 2023-11-04T01:37:44.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.309+0000 7f9669119640 1 --2- 172.21.15.114:0/1730185898 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f964806ae70 0x7f964806d330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9660001050 tx=0x7f9660007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:44.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.313+0000 7f9659ffb640 1 -- 172.21.15.114:0/1730185898 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f96540549a0 con 0x7f96640c50a0 2023-11-04T01:37:44.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:44.492+0000 7f966b37d640 1 -- 172.21.15.114:0/1730185898 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f96640726f0 con 0x7f96640c50a0 2023-11-04T01:37:45.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.129+0000 7f9659ffb640 1 -- 172.21.15.114:0/1730185898 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9654057fc0 con 0x7f96640c50a0 2023-11-04T01:37:45.131 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2023-11-04T01:37:45.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.132+0000 7f966b37d640 1 -- 172.21.15.114:0/1730185898 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f964806ae70 msgr2=0x7f964806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.132+0000 7f966b37d640 1 --2- 172.21.15.114:0/1730185898 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f964806ae70 0x7f964806d330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9660001050 tx=0x7f9660007040 comp rx=0 tx=0).stop 2023-11-04T01:37:45.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.132+0000 7f966b37d640 1 -- 172.21.15.114:0/1730185898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96640c50a0 msgr2=0x7f96640c8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.132+0000 7f966b37d640 1 --2- 172.21.15.114:0/1730185898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96640c50a0 0x7f96640c8e60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9654011600 tx=0x7f9654011a00 comp rx=0 tx=0).stop 2023-11-04T01:37:45.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.132+0000 7f966b37d640 1 -- 172.21.15.114:0/1730185898 shutdown_connections 2023-11-04T01:37:45.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.132+0000 7f966b37d640 1 --2- 172.21.15.114:0/1730185898 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f964806ae70 0x7f964806d330 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.132+0000 7f966b37d640 1 --2- 172.21.15.114:0/1730185898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96640c7c80 0x7f96640c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.132+0000 7f966b37d640 1 --2- 172.21.15.114:0/1730185898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96640c50a0 0x7f96640c8e60 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.132+0000 7f966b37d640 1 --2- 172.21.15.114:0/1730185898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96640c8a80 0x7f96641f79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.132+0000 7f966b37d640 1 -- 172.21.15.114:0/1730185898 >> 172.21.15.114:0/1730185898 conn(0x7f966406d800 msgr2=0x7f966415c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:45.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.132+0000 7f966b37d640 1 -- 172.21.15.114:0/1730185898 shutdown_connections 2023-11-04T01:37:45.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.132+0000 7f966b37d640 1 -- 172.21.15.114:0/1730185898 wait complete. 2023-11-04T01:37:45.148 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:37:45.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.247+0000 7fa26576c640 1 Processor -- start 2023-11-04T01:37:45.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.247+0000 7fa26576c640 1 -- start start 2023-11-04T01:37:45.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.248+0000 7fa26576c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa2600b18b0 0x7fa2600b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.248+0000 7fa26576c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26015dd10 con 0x7fa2600cce10 2023-11-04T01:37:45.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.248+0000 7fa26576c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26015d720 con 0x7fa26006a830 2023-11-04T01:37:45.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.248+0000 7fa26576c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26006fe00 con 0x7fa2600b18b0 2023-11-04T01:37:45.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.248+0000 7fa25effd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa2600cce10 0x7fa26006a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56908/0 (socket says 172.21.15.114:56908) 2023-11-04T01:37:45.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.248+0000 7fa25effd640 1 -- 172.21.15.114:0/1268100903 learned_addr learned my addr 172.21.15.114:0/1268100903 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:45.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.248+0000 7fa25f7fe640 1 --2- 172.21.15.114:0/1268100903 >> v2:172.21.15.114:3300/0 conn(0x7fa2600b18b0 0x7fa2600b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.249+0000 7fa25f7fe640 1 -- 172.21.15.114:0/1268100903 >> v1:172.21.15.141:6789/0 conn(0x7fa26006a830 legacy=0x7fa26015ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:45.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.249+0000 7fa25f7fe640 1 -- 172.21.15.114:0/1268100903 >> v1:172.21.15.114:6789/0 conn(0x7fa2600cce10 legacy=0x7fa26006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.249+0000 7fa25dffb640 1 -- 172.21.15.114:0/1268100903 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445150416 0 0) 0x7fa26015dd10 con 0x7fa2600cce10 2023-11-04T01:37:45.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.249+0000 7fa25f7fe640 1 -- 172.21.15.114:0/1268100903 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2600700e0 con 0x7fa2600b18b0 2023-11-04T01:37:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.249+0000 7fa25f7fe640 1 --2- 172.21.15.114:0/1268100903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2600b18b0 0x7fa2600b1fc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa2580097a0 tx=0x7fa25802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833f8625f2044982 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.250+0000 7fa25dffb640 1 -- 172.21.15.114:0/1268100903 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25802f050 con 0x7fa2600b18b0 2023-11-04T01:37:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.250+0000 7fa25dffb640 1 -- 172.21.15.114:0/1268100903 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa258031700 con 0x7fa2600b18b0 2023-11-04T01:37:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.250+0000 7fa25dffb640 1 -- 172.21.15.114:0/1268100903 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258031a90 con 0x7fa2600b18b0 2023-11-04T01:37:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.250+0000 7fa26576c640 1 -- 172.21.15.114:0/1268100903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2600b18b0 msgr2=0x7fa2600b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.250+0000 7fa26576c640 1 --2- 172.21.15.114:0/1268100903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2600b18b0 0x7fa2600b1fc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa2580097a0 tx=0x7fa25802b7a0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.250+0000 7fa26576c640 1 -- 172.21.15.114:0/1268100903 shutdown_connections 2023-11-04T01:37:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.250+0000 7fa26576c640 1 --2- 172.21.15.114:0/1268100903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2600b18b0 0x7fa2600b1fc0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.250+0000 7fa26576c640 1 -- 172.21.15.114:0/1268100903 >> 172.21.15.114:0/1268100903 conn(0x7fa26006d8b0 msgr2=0x7fa26006dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.250+0000 7fa26576c640 1 -- 172.21.15.114:0/1268100903 shutdown_connections 2023-11-04T01:37:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.250+0000 7fa26576c640 1 -- 172.21.15.114:0/1268100903 wait complete. 2023-11-04T01:37:45.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.251+0000 7fa26576c640 1 Processor -- start 2023-11-04T01:37:45.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.252+0000 7fa26576c640 1 -- start start 2023-11-04T01:37:45.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.252+0000 7fa26576c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa26006a830 0x7fa2600c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.252+0000 7fa26576c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2600b18b0 0x7fa260151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.252+0000 7fa26576c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2600cce10 0x7fa2600c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.252+0000 7fa26576c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600c3a10 con 0x7fa2600b18b0 2023-11-04T01:37:45.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.252+0000 7fa26576c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2601f3910 con 0x7fa2600cce10 2023-11-04T01:37:45.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.252+0000 7fa26576c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2601524b0 con 0x7fa26006a830 2023-11-04T01:37:45.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.252+0000 7fa25e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2600b18b0 0x7fa260151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.252+0000 7fa25e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2600b18b0 0x7fa260151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37898/0 (socket says 172.21.15.114:37898) 2023-11-04T01:37:45.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.252+0000 7fa25e7fc640 1 -- 172.21.15.114:0/2690551046 learned_addr learned my addr 172.21.15.114:0/2690551046 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:45.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.253+0000 7fa25effd640 1 --2- 172.21.15.114:0/2690551046 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa26006a830 0x7fa2600c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.253+0000 7fa25e7fc640 1 -- 172.21.15.114:0/2690551046 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa26006a830 msgr2=0x7fa2600c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.253+0000 7fa25f7fe640 1 --2- 172.21.15.114:0/2690551046 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2600cce10 0x7fa2600c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.253+0000 7fa25e7fc640 1 --2- 172.21.15.114:0/2690551046 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa26006a830 0x7fa2600c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.253+0000 7fa25e7fc640 1 -- 172.21.15.114:0/2690551046 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2600cce10 msgr2=0x7fa2600c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.253+0000 7fa25e7fc640 1 --2- 172.21.15.114:0/2690551046 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2600cce10 0x7fa2600c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.253+0000 7fa25e7fc640 1 -- 172.21.15.114:0/2690551046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa258009400 con 0x7fa2600b18b0 2023-11-04T01:37:45.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.253+0000 7fa25effd640 1 --2- 172.21.15.114:0/2690551046 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa26006a830 0x7fa2600c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:45.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.253+0000 7fa25f7fe640 1 --2- 172.21.15.114:0/2690551046 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2600cce10 0x7fa2600c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:45.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.253+0000 7fa25e7fc640 1 --2- 172.21.15.114:0/2690551046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2600b18b0 0x7fa260151f70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c430 tx=0x7fa25400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.253+0000 7fa2477fe640 1 -- 172.21.15.114:0/2690551046 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254011790 con 0x7fa2600b18b0 2023-11-04T01:37:45.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.253+0000 7fa2477fe640 1 -- 172.21.15.114:0/2690551046 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2540118f0 con 0x7fa2600b18b0 2023-11-04T01:37:45.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.253+0000 7fa26576c640 1 -- 172.21.15.114:0/2690551046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2601f2d90 con 0x7fa2600b18b0 2023-11-04T01:37:45.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.253+0000 7fa2477fe640 1 -- 172.21.15.114:0/2690551046 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254011ce0 con 0x7fa2600b18b0 2023-11-04T01:37:45.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.253+0000 7fa26576c640 1 -- 172.21.15.114:0/2690551046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2601f3350 con 0x7fa2600b18b0 2023-11-04T01:37:45.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.254+0000 7fa26576c640 1 -- 172.21.15.114:0/2690551046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2600ad370 con 0x7fa2600b18b0 2023-11-04T01:37:45.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.254+0000 7fa2477fe640 1 -- 172.21.15.114:0/2690551046 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa25401c460 con 0x7fa2600b18b0 2023-11-04T01:37:45.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.255+0000 7fa2477fe640 1 --2- 172.21.15.114:0/2690551046 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa24c06ae70 0x7fa24c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.255+0000 7fa25effd640 1 --2- 172.21.15.114:0/2690551046 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa24c06ae70 0x7fa24c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.255+0000 7fa2477fe640 1 -- 172.21.15.114:0/2690551046 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa2540892c0 con 0x7fa2600b18b0 2023-11-04T01:37:45.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.255+0000 7fa25effd640 1 --2- 172.21.15.114:0/2690551046 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa24c06ae70 0x7fa24c06d330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa250007fd0 tx=0x7fa250009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.259+0000 7fa2477fe640 1 -- 172.21.15.114:0/2690551046 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa254054610 con 0x7fa2600b18b0 2023-11-04T01:37:45.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.487+0000 7fa26576c640 1 -- 172.21.15.114:0/2690551046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa26015c510 con 0x7fa2600b18b0 2023-11-04T01:37:45.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.488+0000 7fa2477fe640 1 -- 172.21.15.114:0/2690551046 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fa254057c30 con 0x7fa2600b18b0 2023-11-04T01:37:45.490 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:45.490 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:37:45.490 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2023-11-04T01:37:45.490 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.490 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2023-11-04T01:37:45.490 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0VlswblMRAAotQqAxFKxonbXL/aDdoEPw==", 2023-11-04T01:37:45.491 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.491 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:37:45.491 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:37:45.491 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:37:45.491 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:37:45.491 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.491 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.491 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.491 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2023-11-04T01:37:45.491 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VluZGwAhAAZPVNOe2pR5yFwajeNFbXzw==", 2023-11-04T01:37:45.492 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.492 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:37:45.492 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:37:45.492 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:37:45.492 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:37:45.492 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.492 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.492 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.492 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2023-11-04T01:37:45.492 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0VlUsc9ORAAmZhkDVK2hR4wbky+cLfo+A==", 2023-11-04T01:37:45.492 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.492 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:37:45.493 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:37:45.493 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:37:45.493 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:37:45.493 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.493 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.493 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.493 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2023-11-04T01:37:45.493 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VlfxP9CRAAQppp4Lmc1v2xMGYc/AD7pA==", 2023-11-04T01:37:45.493 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.493 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:37:45.494 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:37:45.494 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:37:45.494 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:37:45.494 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.494 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.494 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.494 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2023-11-04T01:37:45.494 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDdn0Vl/xmgMBAANQCw5RUd/IlxHaDvCz2Gbg==", 2023-11-04T01:37:45.494 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.494 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:45.494 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:37:45.494 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:37:45.495 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.495 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.495 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.495 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2023-11-04T01:37:45.495 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDgn0VlTpuDLxAAf5vdQMiWBcLfx0Vf8Petyg==", 2023-11-04T01:37:45.495 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.495 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:45.495 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:37:45.495 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:37:45.495 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.495 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.495 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.496 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2023-11-04T01:37:45.496 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDjn0VlZonFLRAAHJMf/0DasOCeOrz4u8uV2w==", 2023-11-04T01:37:45.496 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.496 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:45.496 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:37:45.496 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:37:45.496 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.496 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.496 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.496 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2023-11-04T01:37:45.497 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDmn0VlLKK7KxAAKJzogyZTtMzEtAL+LL1V0w==", 2023-11-04T01:37:45.497 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.497 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:45.497 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:37:45.497 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:37:45.497 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.497 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.497 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.497 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2023-11-04T01:37:45.497 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDsn0VlLitpMhAA6ow9uVmS5YtOnqSWSB66ww==", 2023-11-04T01:37:45.497 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.497 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:45.497 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:37:45.498 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:37:45.498 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.498 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.498 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.498 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2023-11-04T01:37:45.499 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDvn0VlfkL/MBAA/LYWJLF7F12XMEICf18BwA==", 2023-11-04T01:37:45.499 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.499 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:45.499 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:37:45.499 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:37:45.499 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.499 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.500 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.500 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2023-11-04T01:37:45.500 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDyn0Vl8ZrhLxAAKDbE5KvbWhguLsNNi+3duA==", 2023-11-04T01:37:45.500 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.500 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:45.500 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:37:45.500 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:37:45.500 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.500 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.500 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.500 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2023-11-04T01:37:45.500 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD1n0Vlues1LhAARQs1LLq8y63wl8nAs8GbGQ==", 2023-11-04T01:37:45.500 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.501 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:37:45.501 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:37:45.501 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:37:45.501 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.501 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.501 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.501 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2023-11-04T01:37:45.501 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0Vl3QHODhAA6LWlhd+avWYsoYsWMbOiVA==", 2023-11-04T01:37:45.501 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.501 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:37:45.502 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-11-04T01:37:45.502 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-11-04T01:37:45.502 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-11-04T01:37:45.502 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.502 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.502 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.502 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2023-11-04T01:37:45.502 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VlRvgLGBAAAAhF9alG2eD5A/xjWXcVWA==", 2023-11-04T01:37:45.502 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.502 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:37:45.502 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-11-04T01:37:45.502 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-11-04T01:37:45.502 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-11-04T01:37:45.503 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.503 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.503 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.503 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2023-11-04T01:37:45.503 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VlgV6sFBAAxheFKb52kyZly4byr78vfw==", 2023-11-04T01:37:45.503 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.503 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:37:45.503 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-11-04T01:37:45.503 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-11-04T01:37:45.503 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-11-04T01:37:45.503 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.503 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.503 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.504 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2023-11-04T01:37:45.504 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VltiLUHRAAY0QtK328vB9H/l8FWCNB4g==", 2023-11-04T01:37:45.504 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.504 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:37:45.504 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-11-04T01:37:45.504 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-11-04T01:37:45.504 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-11-04T01:37:45.504 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.504 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.504 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.504 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2023-11-04T01:37:45.504 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0Vl3O6UFBAAZpdiB/7sBN6IpvNpe/LoIA==", 2023-11-04T01:37:45.504 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.505 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-11-04T01:37:45.505 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:37:45.505 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:37:45.505 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:37:45.505 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.505 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.505 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.505 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-mds", 2023-11-04T01:37:45.506 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAFoEVlkcIEMRAAAkSb9f/3OkinueVgAQVfWg==", 2023-11-04T01:37:45.506 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.506 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-mds" 2023-11-04T01:37:45.506 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.506 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.506 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.506 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-mgr", 2023-11-04T01:37:45.506 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAFoEVlEMwEMRAA/XTJxSVXloHioULzK95Juw==", 2023-11-04T01:37:45.507 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.507 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-04T01:37:45.507 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.507 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.507 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-osd", 2023-11-04T01:37:45.507 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAFoEVlWtMEMRAAu2x9WSyev9lbOXTHN/f0Og==", 2023-11-04T01:37:45.507 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.507 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-osd" 2023-11-04T01:37:45.507 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.508 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.508 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rbd", 2023-11-04T01:37:45.508 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAFoEVltNoEMRAAP2je9wdWzXCi3cX+7sbj1Q==", 2023-11-04T01:37:45.508 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.508 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-04T01:37:45.508 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.508 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.508 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.508 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-04T01:37:45.509 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAFoEVlb+EEMRAAjf7SFXIBcZxMIrLPuoSeyg==", 2023-11-04T01:37:45.509 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.509 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-04T01:37:45.509 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.509 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.511 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.511 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rgw", 2023-11-04T01:37:45.511 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAFoEVliegEMRAAjR+A5A6o1rku6MTdv0XH1w==", 2023-11-04T01:37:45.511 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.511 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-04T01:37:45.511 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.511 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.512 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.512 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2023-11-04T01:37:45.512 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0Vlb1WELhAAcUQ6WxKBsUeJfXvaE+h0GQ==", 2023-11-04T01:37:45.512 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.512 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-11-04T01:37:45.512 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2023-11-04T01:37:45.512 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:37:45.512 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.512 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:45.512 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:45.512 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2023-11-04T01:37:45.512 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0VluGn6KRAAHsThhoAbKIz+kqF2DYyvkg==", 2023-11-04T01:37:45.512 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:37:45.513 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-11-04T01:37:45.513 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2023-11-04T01:37:45.513 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:37:45.513 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.513 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:45.513 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-11-04T01:37:45.513 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:37:45.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.490+0000 7fa26576c640 1 -- 172.21.15.114:0/2690551046 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa24c06ae70 msgr2=0x7fa24c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.490+0000 7fa26576c640 1 --2- 172.21.15.114:0/2690551046 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa24c06ae70 0x7fa24c06d330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa250007fd0 tx=0x7fa250009040 comp rx=0 tx=0).stop 2023-11-04T01:37:45.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.490+0000 7fa26576c640 1 -- 172.21.15.114:0/2690551046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2600b18b0 msgr2=0x7fa260151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.490+0000 7fa26576c640 1 --2- 172.21.15.114:0/2690551046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2600b18b0 0x7fa260151f70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c430 tx=0x7fa25400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.490+0000 7fa26576c640 1 -- 172.21.15.114:0/2690551046 shutdown_connections 2023-11-04T01:37:45.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.490+0000 7fa26576c640 1 --2- 172.21.15.114:0/2690551046 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa24c06ae70 0x7fa24c06d330 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.490+0000 7fa26576c640 1 --2- 172.21.15.114:0/2690551046 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2600cce10 0x7fa2600c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.490+0000 7fa26576c640 1 --2- 172.21.15.114:0/2690551046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2600b18b0 0x7fa260151f70 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.490+0000 7fa26576c640 1 --2- 172.21.15.114:0/2690551046 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa26006a830 0x7fa2600c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.490+0000 7fa26576c640 1 -- 172.21.15.114:0/2690551046 >> 172.21.15.114:0/2690551046 conn(0x7fa26006d8b0 msgr2=0x7fa2600b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:45.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.490+0000 7fa26576c640 1 -- 172.21.15.114:0/2690551046 shutdown_connections 2023-11-04T01:37:45.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.490+0000 7fa26576c640 1 -- 172.21.15.114:0/2690551046 wait complete. 2023-11-04T01:37:45.516 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-04T01:37:45.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.615+0000 7f2722f33640 1 Processor -- start 2023-11-04T01:37:45.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.615+0000 7f2722f33640 1 -- start start 2023-11-04T01:37:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.616+0000 7f2722f33640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f271c0d0710 0x7f271c0cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.616+0000 7f2722f33640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f271c0cda50 0x7f271c0b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.616+0000 7f2722f33640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271c0d0280 con 0x7f271c15e430 2023-11-04T01:37:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.616+0000 7f2722f33640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271c0cf670 con 0x7f271c0cda50 2023-11-04T01:37:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.616+0000 7f2722f33640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271c0cf950 con 0x7f271c0d0710 2023-11-04T01:37:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.616+0000 7f27214d0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f271c0cda50 0x7f271c0b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.616+0000 7f27214d0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f271c0cda50 0x7f271c0b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37914/0 (socket says 172.21.15.114:37914) 2023-11-04T01:37:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.616+0000 7f27214d0640 1 -- 172.21.15.114:0/1599303182 learned_addr learned my addr 172.21.15.114:0/1599303182 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.616+0000 7f2720ccf640 1 --1- 172.21.15.114:0/1599303182 >> v1:172.21.15.114:6789/0 conn(0x7f271c15e430 0x7f271c0cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56916/0 (socket says 172.21.15.114:56916) 2023-11-04T01:37:45.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.616+0000 7f271bfff640 1 --2- 172.21.15.114:0/1599303182 >> v2:172.21.15.141:3300/0 conn(0x7f271c0d0710 0x7f271c0cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.616+0000 7f27214d0640 1 -- 172.21.15.114:0/1599303182 >> v2:172.21.15.141:3300/0 conn(0x7f271c0d0710 msgr2=0x7f271c0cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:45.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.616+0000 7f27214d0640 1 --2- 172.21.15.114:0/1599303182 >> v2:172.21.15.141:3300/0 conn(0x7f271c0d0710 0x7f271c0cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.616+0000 7f27214d0640 1 -- 172.21.15.114:0/1599303182 >> v1:172.21.15.114:6789/0 conn(0x7f271c15e430 legacy=0x7f271c0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.616+0000 7f27214d0640 1 -- 172.21.15.114:0/1599303182 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c0cfc30 con 0x7f271c0cda50 2023-11-04T01:37:45.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.616+0000 7f271b7fe640 1 -- 172.21.15.114:0/1599303182 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807517332 0 0) 0x7f271c0d0280 con 0x7f271c15e430 2023-11-04T01:37:45.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.617+0000 7f27214d0640 1 --2- 172.21.15.114:0/1599303182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f271c0cda50 0x7f271c0b3d40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f271c0cb3c0 tx=0x7f271402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e33bdba750d111b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.617+0000 7f271b7fe640 1 -- 172.21.15.114:0/1599303182 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271402cb20 con 0x7f271c0cda50 2023-11-04T01:37:45.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.617+0000 7f271b7fe640 1 -- 172.21.15.114:0/1599303182 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271402cc80 con 0x7f271c0cda50 2023-11-04T01:37:45.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.617+0000 7f271b7fe640 1 -- 172.21.15.114:0/1599303182 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27140343f0 con 0x7f271c0cda50 2023-11-04T01:37:45.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.617+0000 7f2722f33640 1 -- 172.21.15.114:0/1599303182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f271c0cda50 msgr2=0x7f271c0b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.617+0000 7f2722f33640 1 --2- 172.21.15.114:0/1599303182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f271c0cda50 0x7f271c0b3d40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f271c0cb3c0 tx=0x7f271402bf80 comp rx=0 tx=0).stop 2023-11-04T01:37:45.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.618+0000 7f2722f33640 1 -- 172.21.15.114:0/1599303182 shutdown_connections 2023-11-04T01:37:45.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.618+0000 7f2722f33640 1 --2- 172.21.15.114:0/1599303182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f271c0cda50 0x7f271c0b3d40 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.618+0000 7f2722f33640 1 --2- 172.21.15.114:0/1599303182 >> v2:172.21.15.141:3300/0 conn(0x7f271c0d0710 0x7f271c0cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.618+0000 7f2722f33640 1 -- 172.21.15.114:0/1599303182 >> 172.21.15.114:0/1599303182 conn(0x7f271c06ea20 msgr2=0x7f271c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:45.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.618+0000 7f2722f33640 1 -- 172.21.15.114:0/1599303182 shutdown_connections 2023-11-04T01:37:45.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.618+0000 7f2722f33640 1 -- 172.21.15.114:0/1599303182 wait complete. 2023-11-04T01:37:45.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.619+0000 7f2722f33640 1 Processor -- start 2023-11-04T01:37:45.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.619+0000 7f2722f33640 1 -- start start 2023-11-04T01:37:45.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2722f33640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f271c0cda50 0x7f271c1f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2722f33640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f271c0d0710 0x7f271c0c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2722f33640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f271c15e430 0x7f271c0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2722f33640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c152bc0 con 0x7f271c0cda50 2023-11-04T01:37:45.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2722f33640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c0c8650 con 0x7f271c0d0710 2023-11-04T01:37:45.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2722f33640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271c0c8930 con 0x7f271c15e430 2023-11-04T01:37:45.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2720ccf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f271c0cda50 0x7f271c1f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2720ccf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f271c0cda50 0x7f271c1f2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37928/0 (socket says 172.21.15.114:37928) 2023-11-04T01:37:45.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2720ccf640 1 -- 172.21.15.114:0/3756317906 learned_addr learned my addr 172.21.15.114:0/3756317906 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:45.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f271bfff640 1 --2- 172.21.15.114:0/3756317906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f271c0d0710 0x7f271c0c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f27214d0640 1 --2- 172.21.15.114:0/3756317906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f271c15e430 0x7f271c0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2720ccf640 1 -- 172.21.15.114:0/3756317906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f271c15e430 msgr2=0x7f271c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2720ccf640 1 --2- 172.21.15.114:0/3756317906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f271c15e430 0x7f271c0c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2720ccf640 1 -- 172.21.15.114:0/3756317906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f271c0d0710 msgr2=0x7f271c0c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2720ccf640 1 --2- 172.21.15.114:0/3756317906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f271c0d0710 0x7f271c0c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2720ccf640 1 -- 172.21.15.114:0/3756317906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714009b30 con 0x7f271c0cda50 2023-11-04T01:37:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f27214d0640 1 --2- 172.21.15.114:0/3756317906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f271c15e430 0x7f271c0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2720ccf640 1 --2- 172.21.15.114:0/3756317906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f271c0cda50 0x7f271c1f2080 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f271000c4d0 tx=0x7f271000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f27197fa640 1 -- 172.21.15.114:0/3756317906 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100074e0 con 0x7f271c0cda50 2023-11-04T01:37:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f27197fa640 1 -- 172.21.15.114:0/3756317906 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2710007660 con 0x7f271c0cda50 2023-11-04T01:37:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2722f33640 1 -- 172.21.15.114:0/3756317906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271c0c8c10 con 0x7f271c0cda50 2023-11-04T01:37:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f27197fa640 1 -- 172.21.15.114:0/3756317906 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710004a20 con 0x7f271c0cda50 2023-11-04T01:37:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.620+0000 7f2722f33640 1 -- 172.21.15.114:0/3756317906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271c0b06e0 con 0x7f271c0cda50 2023-11-04T01:37:45.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.621+0000 7f2722f33640 1 -- 172.21.15.114:0/3756317906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271c0b0900 con 0x7f271c0cda50 2023-11-04T01:37:45.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.622+0000 7f27197fa640 1 -- 172.21.15.114:0/3756317906 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2710004b80 con 0x7f271c0cda50 2023-11-04T01:37:45.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.622+0000 7f27197fa640 1 --2- 172.21.15.114:0/3756317906 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f270006ae70 0x7f270006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.622+0000 7f27197fa640 1 -- 172.21.15.114:0/3756317906 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f27100888a0 con 0x7f271c0cda50 2023-11-04T01:37:45.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.622+0000 7f271bfff640 1 --2- 172.21.15.114:0/3756317906 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f270006ae70 0x7f270006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.622+0000 7f271bfff640 1 --2- 172.21.15.114:0/3756317906 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f270006ae70 0x7f270006d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f271c0b3670 tx=0x7f2708008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.626+0000 7f27197fa640 1 -- 172.21.15.114:0/3756317906 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2710053bf0 con 0x7f271c0cda50 2023-11-04T01:37:45.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.856+0000 7f2722f33640 1 -- 172.21.15.114:0/3756317906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f271c0cc150 con 0x7f271c0cda50 2023-11-04T01:37:45.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.858+0000 7f27197fa640 1 -- 172.21.15.114:0/3756317906 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2710018020 con 0x7f271c0cda50 2023-11-04T01:37:45.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.860+0000 7f2722f33640 1 -- 172.21.15.114:0/3756317906 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f270006ae70 msgr2=0x7f270006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.860+0000 7f2722f33640 1 --2- 172.21.15.114:0/3756317906 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f270006ae70 0x7f270006d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f271c0b3670 tx=0x7f2708008040 comp rx=0 tx=0).stop 2023-11-04T01:37:45.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.860+0000 7f2722f33640 1 -- 172.21.15.114:0/3756317906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f271c0cda50 msgr2=0x7f271c1f2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.860+0000 7f2722f33640 1 --2- 172.21.15.114:0/3756317906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f271c0cda50 0x7f271c1f2080 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f271000c4d0 tx=0x7f271000c990 comp rx=0 tx=0).stop 2023-11-04T01:37:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.860+0000 7f2722f33640 1 -- 172.21.15.114:0/3756317906 shutdown_connections 2023-11-04T01:37:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.860+0000 7f2722f33640 1 --2- 172.21.15.114:0/3756317906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f271c15e430 0x7f271c0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.860+0000 7f2722f33640 1 --2- 172.21.15.114:0/3756317906 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f270006ae70 0x7f270006d330 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.860+0000 7f2722f33640 1 --2- 172.21.15.114:0/3756317906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f271c0d0710 0x7f271c0c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.860+0000 7f2722f33640 1 --2- 172.21.15.114:0/3756317906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f271c0cda50 0x7f271c1f2080 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.860+0000 7f2722f33640 1 -- 172.21.15.114:0/3756317906 >> 172.21.15.114:0/3756317906 conn(0x7f271c06ea20 msgr2=0x7f271c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.860+0000 7f2722f33640 1 -- 172.21.15.114:0/3756317906 shutdown_connections 2023-11-04T01:37:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.860+0000 7f2722f33640 1 -- 172.21.15.114:0/3756317906 wait complete. 2023-11-04T01:37:45.873 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-04T01:37:45.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.972+0000 7f6112b4c640 1 Processor -- start 2023-11-04T01:37:45.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.972+0000 7f6112b4c640 1 -- start start 2023-11-04T01:37:45.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.972+0000 7f6112b4c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f610c159c00 0x7f610c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.972+0000 7f6112b4c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f610c0ae1d0 0x7f610c0c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.972+0000 7f6112b4c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c15aff0 con 0x7f610c0c48e0 2023-11-04T01:37:45.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.972+0000 7f6112b4c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f610c0c52d0 con 0x7f610c159c00 2023-11-04T01:37:45.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.972+0000 7f6112b4c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c15a3e0 con 0x7f610c0ae1d0 2023-11-04T01:37:45.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.973+0000 7f61108e8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f610c159c00 0x7f610c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.973+0000 7f610bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f610c0c48e0 0x7f610c0adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56922/0 (socket says 172.21.15.114:56922) 2023-11-04T01:37:45.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.973+0000 7f610bfff640 1 -- 172.21.15.114:0/2718206236 learned_addr learned my addr 172.21.15.114:0/2718206236 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:45.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.973+0000 7f61108e8640 1 -- 172.21.15.114:0/2718206236 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f610c0ae1d0 msgr2=0x7f610c0c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:45.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.973+0000 7f61110e9640 1 --2- 172.21.15.114:0/2718206236 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f610c0ae1d0 0x7f610c0c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.973+0000 7f61108e8640 1 --2- 172.21.15.114:0/2718206236 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f610c0ae1d0 0x7f610c0c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.973+0000 7f610b7fe640 1 -- 172.21.15.114:0/2718206236 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922180341 0 0) 0x7f610c15aff0 con 0x7f610c0c48e0 2023-11-04T01:37:45.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.973+0000 7f61108e8640 1 -- 172.21.15.114:0/2718206236 >> v1:172.21.15.114:6789/0 conn(0x7f610c0c48e0 legacy=0x7f610c0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.973+0000 7f61108e8640 1 -- 172.21.15.114:0/2718206236 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c15a6c0 con 0x7f610c159c00 2023-11-04T01:37:45.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.974+0000 7f61108e8640 1 --2- 172.21.15.114:0/2718206236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f610c159c00 0x7f610c0cc890 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f61000097a0 tx=0x7f610002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864ef45739dd7b75 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.974+0000 7f610b7fe640 1 -- 172.21.15.114:0/2718206236 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610002e070 con 0x7f610c159c00 2023-11-04T01:37:45.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.974+0000 7f610b7fe640 1 -- 172.21.15.114:0/2718206236 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61000315a0 con 0x7f610c159c00 2023-11-04T01:37:45.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.974+0000 7f610b7fe640 1 -- 172.21.15.114:0/2718206236 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100031930 con 0x7f610c159c00 2023-11-04T01:37:45.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.974+0000 7f6112b4c640 1 -- 172.21.15.114:0/2718206236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f610c159c00 msgr2=0x7f610c0cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.974+0000 7f6112b4c640 1 --2- 172.21.15.114:0/2718206236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f610c159c00 0x7f610c0cc890 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f61000097a0 tx=0x7f610002b840 comp rx=0 tx=0).stop 2023-11-04T01:37:45.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.974+0000 7f6112b4c640 1 -- 172.21.15.114:0/2718206236 shutdown_connections 2023-11-04T01:37:45.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.974+0000 7f6112b4c640 1 --2- 172.21.15.114:0/2718206236 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f610c0ae1d0 0x7f610c0c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.974+0000 7f6112b4c640 1 --2- 172.21.15.114:0/2718206236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f610c159c00 0x7f610c0cc890 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.974+0000 7f6112b4c640 1 -- 172.21.15.114:0/2718206236 >> 172.21.15.114:0/2718206236 conn(0x7f610c0ce950 msgr2=0x7f610c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:45.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.974+0000 7f6112b4c640 1 -- 172.21.15.114:0/2718206236 shutdown_connections 2023-11-04T01:37:45.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.974+0000 7f6112b4c640 1 -- 172.21.15.114:0/2718206236 wait complete. 2023-11-04T01:37:45.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.976+0000 7f6112b4c640 1 Processor -- start 2023-11-04T01:37:45.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.976+0000 7f6112b4c640 1 -- start start 2023-11-04T01:37:45.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.976+0000 7f6112b4c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f610c0ae1d0 0x7f610c158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.976+0000 7f6112b4c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f610c0c48e0 0x7f610c1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.976+0000 7f6112b4c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f610c159c00 0x7f610c1566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.976+0000 7f6112b4c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c15cb70 con 0x7f610c0c48e0 2023-11-04T01:37:45.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.976+0000 7f6112b4c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0c7840 con 0x7f610c159c00 2023-11-04T01:37:45.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.976+0000 7f6112b4c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c15bef0 con 0x7f610c0ae1d0 2023-11-04T01:37:45.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.976+0000 7f610bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f610c0c48e0 0x7f610c1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.977+0000 7f610bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f610c0c48e0 0x7f610c1561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37948/0 (socket says 172.21.15.114:37948) 2023-11-04T01:37:45.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.977+0000 7f610bfff640 1 -- 172.21.15.114:0/2553949282 learned_addr learned my addr 172.21.15.114:0/2553949282 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:45.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.977+0000 7f61108e8640 1 --2- 172.21.15.114:0/2553949282 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f610c0ae1d0 0x7f610c158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.977+0000 7f61110e9640 1 --2- 172.21.15.114:0/2553949282 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f610c159c00 0x7f610c1566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.977+0000 7f610bfff640 1 -- 172.21.15.114:0/2553949282 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f610c0ae1d0 msgr2=0x7f610c158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.977+0000 7f610bfff640 1 --2- 172.21.15.114:0/2553949282 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f610c0ae1d0 0x7f610c158510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.977+0000 7f610bfff640 1 -- 172.21.15.114:0/2553949282 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f610c159c00 msgr2=0x7f610c1566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:45.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.977+0000 7f610bfff640 1 --2- 172.21.15.114:0/2553949282 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f610c159c00 0x7f610c1566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:45.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.977+0000 7f610bfff640 1 -- 172.21.15.114:0/2553949282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6100009400 con 0x7f610c0c48e0 2023-11-04T01:37:45.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.977+0000 7f610bfff640 1 --2- 172.21.15.114:0/2553949282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f610c0c48e0 0x7f610c1561a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f60f800c4d0 tx=0x7f60f800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.977+0000 7f61097fa640 1 -- 172.21.15.114:0/2553949282 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f80074e0 con 0x7f610c0c48e0 2023-11-04T01:37:45.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.977+0000 7f61097fa640 1 -- 172.21.15.114:0/2553949282 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f8007660 con 0x7f610c0c48e0 2023-11-04T01:37:45.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.977+0000 7f6112b4c640 1 -- 172.21.15.114:0/2553949282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610c15c1d0 con 0x7f610c0c48e0 2023-11-04T01:37:45.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.977+0000 7f61097fa640 1 -- 172.21.15.114:0/2553949282 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f8004a20 con 0x7f610c0c48e0 2023-11-04T01:37:45.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.977+0000 7f6112b4c640 1 -- 172.21.15.114:0/2553949282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610c15c790 con 0x7f610c0c48e0 2023-11-04T01:37:45.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.978+0000 7f6112b4c640 1 -- 172.21.15.114:0/2553949282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610c15ccb0 con 0x7f610c0c48e0 2023-11-04T01:37:45.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.979+0000 7f61097fa640 1 -- 172.21.15.114:0/2553949282 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60f8004b80 con 0x7f610c0c48e0 2023-11-04T01:37:45.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.979+0000 7f61097fa640 1 --2- 172.21.15.114:0/2553949282 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60f006ae70 0x7f60f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:45.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.979+0000 7f61097fa640 1 -- 172.21.15.114:0/2553949282 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f60f8088930 con 0x7f610c0c48e0 2023-11-04T01:37:45.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.979+0000 7f61108e8640 1 --2- 172.21.15.114:0/2553949282 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60f006ae70 0x7f60f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:45.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.979+0000 7f61108e8640 1 --2- 172.21.15.114:0/2553949282 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60f006ae70 0x7f60f006d330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6100036000 tx=0x7f610003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:45.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:45.983+0000 7f61097fa640 1 -- 172.21.15.114:0/2553949282 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f610c15ccb0 con 0x7f610c0c48e0 2023-11-04T01:37:46.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.215+0000 7f6112b4c640 1 -- 172.21.15.114:0/2553949282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f610c15ccb0 con 0x7f610c0c48e0 2023-11-04T01:37:46.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.217+0000 7f61097fa640 1 -- 172.21.15.114:0/2553949282 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f610c15ccb0 con 0x7f610c0c48e0 2023-11-04T01:37:46.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.219+0000 7f6112b4c640 1 -- 172.21.15.114:0/2553949282 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60f006ae70 msgr2=0x7f60f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.219+0000 7f6112b4c640 1 --2- 172.21.15.114:0/2553949282 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60f006ae70 0x7f60f006d330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6100036000 tx=0x7f610003d040 comp rx=0 tx=0).stop 2023-11-04T01:37:46.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.219+0000 7f6112b4c640 1 -- 172.21.15.114:0/2553949282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f610c0c48e0 msgr2=0x7f610c1561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.219+0000 7f6112b4c640 1 --2- 172.21.15.114:0/2553949282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f610c0c48e0 0x7f610c1561a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f60f800c4d0 tx=0x7f60f800c990 comp rx=0 tx=0).stop 2023-11-04T01:37:46.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.219+0000 7f6112b4c640 1 -- 172.21.15.114:0/2553949282 shutdown_connections 2023-11-04T01:37:46.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.219+0000 7f6112b4c640 1 --2- 172.21.15.114:0/2553949282 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60f006ae70 0x7f60f006d330 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.219+0000 7f6112b4c640 1 --2- 172.21.15.114:0/2553949282 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f610c159c00 0x7f610c1566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.219+0000 7f6112b4c640 1 --2- 172.21.15.114:0/2553949282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f610c0c48e0 0x7f610c1561a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.219+0000 7f6112b4c640 1 --2- 172.21.15.114:0/2553949282 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f610c0ae1d0 0x7f610c158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.219+0000 7f6112b4c640 1 -- 172.21.15.114:0/2553949282 >> 172.21.15.114:0/2553949282 conn(0x7f610c0ce950 msgr2=0x7f610c14ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:46.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.220+0000 7f6112b4c640 1 -- 172.21.15.114:0/2553949282 shutdown_connections 2023-11-04T01:37:46.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.220+0000 7f6112b4c640 1 -- 172.21.15.114:0/2553949282 wait complete. 2023-11-04T01:37:46.232 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-04T01:37:46.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.330+0000 7f7fc4d1d640 1 Processor -- start 2023-11-04T01:37:46.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.330+0000 7f7fc4d1d640 1 -- start start 2023-11-04T01:37:46.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.331+0000 7f7fc4d1d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fc00c4ff0 0x7f7fc00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.331+0000 7f7fc4d1d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7fc00adac0 0x7f7fc00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.331+0000 7f7fc4d1d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc015aff0 con 0x7f7fc0159c00 2023-11-04T01:37:46.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.331+0000 7f7fc4d1d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc00ae450 con 0x7f7fc00adac0 2023-11-04T01:37:46.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.331+0000 7f7fc4d1d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc015a3e0 con 0x7f7fc00c4ff0 2023-11-04T01:37:46.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.331+0000 7f7fbed9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7fc00adac0 0x7f7fc00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.331+0000 7f7fbed9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7fc00adac0 0x7f7fc00adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37962/0 (socket says 172.21.15.114:37962) 2023-11-04T01:37:46.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.331+0000 7f7fbe59c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7fc0159c00 0x7f7fc00c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56932/0 (socket says 172.21.15.114:56932) 2023-11-04T01:37:46.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.331+0000 7f7fbed9d640 1 -- 172.21.15.114:0/1336014791 learned_addr learned my addr 172.21.15.114:0/1336014791 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:46.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.331+0000 7f7fbed9d640 1 -- 172.21.15.114:0/1336014791 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fc00c4ff0 msgr2=0x7f7fc00cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:46.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.331+0000 7f7fbed9d640 1 --2- 172.21.15.114:0/1336014791 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fc00c4ff0 0x7f7fc00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.331+0000 7f7fbed9d640 1 -- 172.21.15.114:0/1336014791 >> v1:172.21.15.114:6789/0 conn(0x7f7fc0159c00 legacy=0x7f7fc00c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.331+0000 7f7fbdd9b640 1 -- 172.21.15.114:0/1336014791 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293879565 0 0) 0x7f7fc015aff0 con 0x7f7fc0159c00 2023-11-04T01:37:46.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.331+0000 7f7fbed9d640 1 -- 172.21.15.114:0/1336014791 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc015a6c0 con 0x7f7fc00adac0 2023-11-04T01:37:46.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.332+0000 7f7fbed9d640 1 --2- 172.21.15.114:0/1336014791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fc00adac0 0x7f7fc00adf10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800d150 tx=0x7f7fb802e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb6e7f66394f22f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:46.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.332+0000 7f7fbdd9b640 1 -- 172.21.15.114:0/1336014791 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb800b0d0 con 0x7f7fc00adac0 2023-11-04T01:37:46.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.332+0000 7f7fbdd9b640 1 -- 172.21.15.114:0/1336014791 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb800b230 con 0x7f7fc00adac0 2023-11-04T01:37:46.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.332+0000 7f7fbdd9b640 1 -- 172.21.15.114:0/1336014791 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8009600 con 0x7f7fc00adac0 2023-11-04T01:37:46.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.332+0000 7f7fc4d1d640 1 -- 172.21.15.114:0/1336014791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fc00adac0 msgr2=0x7f7fc00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.332+0000 7f7fc4d1d640 1 --2- 172.21.15.114:0/1336014791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fc00adac0 0x7f7fc00adf10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800d150 tx=0x7f7fb802e160 comp rx=0 tx=0).stop 2023-11-04T01:37:46.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.332+0000 7f7fc4d1d640 1 -- 172.21.15.114:0/1336014791 shutdown_connections 2023-11-04T01:37:46.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.332+0000 7f7fc4d1d640 1 --2- 172.21.15.114:0/1336014791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fc00adac0 0x7f7fc00adf10 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.332+0000 7f7fc4d1d640 1 --2- 172.21.15.114:0/1336014791 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fc00c4ff0 0x7f7fc00cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.332+0000 7f7fc4d1d640 1 -- 172.21.15.114:0/1336014791 >> 172.21.15.114:0/1336014791 conn(0x7f7fc00ce950 msgr2=0x7f7fc00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:46.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.333+0000 7f7fc4d1d640 1 -- 172.21.15.114:0/1336014791 shutdown_connections 2023-11-04T01:37:46.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.333+0000 7f7fc4d1d640 1 -- 172.21.15.114:0/1336014791 wait complete. 2023-11-04T01:37:46.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.334+0000 7f7fc4d1d640 1 Processor -- start 2023-11-04T01:37:46.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.334+0000 7f7fc4d1d640 1 -- start start 2023-11-04T01:37:46.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.334+0000 7f7fc4d1d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fc00adac0 0x7f7fc0144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fc4d1d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fc00c4ff0 0x7f7fc0157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fc4d1d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fc0159c00 0x7f7fc01581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fc4d1d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc01452a0 con 0x7f7fc0159c00 2023-11-04T01:37:46.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fc4d1d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc0159410 con 0x7f7fc00c4ff0 2023-11-04T01:37:46.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fc4d1d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc0158800 con 0x7f7fc00adac0 2023-11-04T01:37:46.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fbed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fc0159c00 0x7f7fc01581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fbed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fc0159c00 0x7f7fc01581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37972/0 (socket says 172.21.15.114:37972) 2023-11-04T01:37:46.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fbed9d640 1 -- 172.21.15.114:0/738882578 learned_addr learned my addr 172.21.15.114:0/738882578 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:46.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fbe59c640 1 --2- 172.21.15.114:0/738882578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fc00adac0 0x7f7fc0144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fb7fff640 1 --2- 172.21.15.114:0/738882578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fc00c4ff0 0x7f7fc0157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fbed9d640 1 -- 172.21.15.114:0/738882578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fc00adac0 msgr2=0x7f7fc0144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fbed9d640 1 --2- 172.21.15.114:0/738882578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fc00adac0 0x7f7fc0144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fbed9d640 1 -- 172.21.15.114:0/738882578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fc00c4ff0 msgr2=0x7f7fc0157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fbed9d640 1 --2- 172.21.15.114:0/738882578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fc00c4ff0 0x7f7fc0157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fbed9d640 1 -- 172.21.15.114:0/738882578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb800bd40 con 0x7f7fc0159c00 2023-11-04T01:37:46.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fbe59c640 1 --2- 172.21.15.114:0/738882578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fc00adac0 0x7f7fc0144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:46.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fbed9d640 1 --2- 172.21.15.114:0/738882578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fc0159c00 0x7f7fc01581c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800d150 tx=0x7f7fb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:46.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fb6ffd640 1 -- 172.21.15.114:0/738882578 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8036800 con 0x7f7fc0159c00 2023-11-04T01:37:46.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fb6ffd640 1 -- 172.21.15.114:0/738882578 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb8036960 con 0x7f7fc0159c00 2023-11-04T01:37:46.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fc4d1d640 1 -- 172.21.15.114:0/738882578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc0158ae0 con 0x7f7fc0159c00 2023-11-04T01:37:46.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fb6ffd640 1 -- 172.21.15.114:0/738882578 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8036d10 con 0x7f7fc0159c00 2023-11-04T01:37:46.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.335+0000 7f7fc4d1d640 1 -- 172.21.15.114:0/738882578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc01590a0 con 0x7f7fc0159c00 2023-11-04T01:37:46.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.336+0000 7f7fc4d1d640 1 -- 172.21.15.114:0/738882578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc00ab8d0 con 0x7f7fc0159c00 2023-11-04T01:37:46.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.337+0000 7f7fb6ffd640 1 -- 172.21.15.114:0/738882578 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7fb804a460 con 0x7f7fc0159c00 2023-11-04T01:37:46.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.337+0000 7f7fb6ffd640 1 --2- 172.21.15.114:0/738882578 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7fa006ae70 0x7f7fa006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.337+0000 7f7fb6ffd640 1 -- 172.21.15.114:0/738882578 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7fb80ac8d0 con 0x7f7fc0159c00 2023-11-04T01:37:46.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.337+0000 7f7fbe59c640 1 --2- 172.21.15.114:0/738882578 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7fa006ae70 0x7f7fa006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.338+0000 7f7fbe59c640 1 --2- 172.21.15.114:0/738882578 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7fa006ae70 0x7f7fa006d330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0000f60 tx=0x7f7fb0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:46.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.341+0000 7f7fb6ffd640 1 -- 172.21.15.114:0/738882578 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7fc00ab8d0 con 0x7f7fc0159c00 2023-11-04T01:37:46.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.571+0000 7f7fc4d1d640 1 -- 172.21.15.114:0/738882578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f7fc00ab8d0 con 0x7f7fc0159c00 2023-11-04T01:37:46.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.573+0000 7f7fb6ffd640 1 -- 172.21.15.114:0/738882578 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7fc00ab8d0 con 0x7f7fc0159c00 2023-11-04T01:37:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.575+0000 7f7fc4d1d640 1 -- 172.21.15.114:0/738882578 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7fa006ae70 msgr2=0x7f7fa006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.575+0000 7f7fc4d1d640 1 --2- 172.21.15.114:0/738882578 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7fa006ae70 0x7f7fa006d330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0000f60 tx=0x7f7fb0009040 comp rx=0 tx=0).stop 2023-11-04T01:37:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.575+0000 7f7fc4d1d640 1 -- 172.21.15.114:0/738882578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fc0159c00 msgr2=0x7f7fc01581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.575+0000 7f7fc4d1d640 1 --2- 172.21.15.114:0/738882578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fc0159c00 0x7f7fc01581c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800d150 tx=0x7f7fb8004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.575+0000 7f7fc4d1d640 1 -- 172.21.15.114:0/738882578 shutdown_connections 2023-11-04T01:37:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.575+0000 7f7fc4d1d640 1 --2- 172.21.15.114:0/738882578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fc0159c00 0x7f7fc01581c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.575+0000 7f7fc4d1d640 1 --2- 172.21.15.114:0/738882578 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7fa006ae70 0x7f7fa006d330 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.575+0000 7f7fc4d1d640 1 --2- 172.21.15.114:0/738882578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fc00c4ff0 0x7f7fc0157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.575+0000 7f7fc4d1d640 1 --2- 172.21.15.114:0/738882578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fc00adac0 0x7f7fc0144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.575+0000 7f7fc4d1d640 1 -- 172.21.15.114:0/738882578 >> 172.21.15.114:0/738882578 conn(0x7f7fc00ce950 msgr2=0x7f7fc006d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.575+0000 7f7fc4d1d640 1 -- 172.21.15.114:0/738882578 shutdown_connections 2023-11-04T01:37:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.575+0000 7f7fc4d1d640 1 -- 172.21.15.114:0/738882578 wait complete. 2023-11-04T01:37:46.588 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-04T01:37:46.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.686+0000 7f21e46c9640 1 Processor -- start 2023-11-04T01:37:46.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.686+0000 7f21e46c9640 1 -- start start 2023-11-04T01:37:46.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.687+0000 7f21e46c9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f21dc15ad40 0x7f21dc06b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.687+0000 7f21e46c9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f21dc15b120 0x7f21dc15f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.687+0000 7f21e46c9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21dc065df0 con 0x7f21dc0c9b60 2023-11-04T01:37:46.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.687+0000 7f21e46c9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21dc06bc40 con 0x7f21dc15ad40 2023-11-04T01:37:46.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.687+0000 7f21e46c9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21dc15f910 con 0x7f21dc15b120 2023-11-04T01:37:46.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.687+0000 7f21e2465640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f21dc15ad40 0x7f21dc06b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.687+0000 7f21e2465640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f21dc15ad40 0x7f21dc06b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51004/0 (socket says 172.21.15.114:51004) 2023-11-04T01:37:46.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.687+0000 7f21e2465640 1 -- 172.21.15.114:0/4201248017 learned_addr learned my addr 172.21.15.114:0/4201248017 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:46.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.687+0000 7f21e1c64640 1 --2- 172.21.15.114:0/4201248017 >> v2:172.21.15.141:3300/0 conn(0x7f21dc15b120 0x7f21dc15f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.687+0000 7f21e2465640 1 -- 172.21.15.114:0/4201248017 >> v2:172.21.15.141:3300/0 conn(0x7f21dc15b120 msgr2=0x7f21dc15f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:46.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.687+0000 7f21e2465640 1 --2- 172.21.15.114:0/4201248017 >> v2:172.21.15.141:3300/0 conn(0x7f21dc15b120 0x7f21dc15f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.687+0000 7f21e2465640 1 -- 172.21.15.114:0/4201248017 >> v1:172.21.15.141:6789/0 conn(0x7f21dc0c9b60 legacy=0x7f21dc070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:46.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.687+0000 7f21e2465640 1 -- 172.21.15.114:0/4201248017 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc066040 con 0x7f21dc15ad40 2023-11-04T01:37:46.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.688+0000 7f21e2465640 1 --2- 172.21.15.114:0/4201248017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21dc15ad40 0x7f21dc06b700 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0cf060 tx=0x7f21d802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ea1ed9b178978f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:46.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.688+0000 7f21e1463640 1 -- 172.21.15.114:0/4201248017 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8031870 con 0x7f21dc15ad40 2023-11-04T01:37:46.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.688+0000 7f21e1463640 1 -- 172.21.15.114:0/4201248017 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d80319d0 con 0x7f21dc15ad40 2023-11-04T01:37:46.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.688+0000 7f21e1463640 1 -- 172.21.15.114:0/4201248017 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8031d60 con 0x7f21dc15ad40 2023-11-04T01:37:46.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.688+0000 7f21e46c9640 1 -- 172.21.15.114:0/4201248017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21dc15ad40 msgr2=0x7f21dc06b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.688+0000 7f21e46c9640 1 --2- 172.21.15.114:0/4201248017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21dc15ad40 0x7f21dc06b700 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0cf060 tx=0x7f21d802b910 comp rx=0 tx=0).stop 2023-11-04T01:37:46.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.689+0000 7f21e46c9640 1 -- 172.21.15.114:0/4201248017 shutdown_connections 2023-11-04T01:37:46.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.689+0000 7f21e46c9640 1 --2- 172.21.15.114:0/4201248017 >> v2:172.21.15.141:3300/0 conn(0x7f21dc15b120 0x7f21dc15f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.689+0000 7f21e46c9640 1 --2- 172.21.15.114:0/4201248017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21dc15ad40 0x7f21dc06b700 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.689+0000 7f21e46c9640 1 -- 172.21.15.114:0/4201248017 >> 172.21.15.114:0/4201248017 conn(0x7f21dc0cbc90 msgr2=0x7f21dc0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:46.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.689+0000 7f21e46c9640 1 -- 172.21.15.114:0/4201248017 shutdown_connections 2023-11-04T01:37:46.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.689+0000 7f21e46c9640 1 -- 172.21.15.114:0/4201248017 wait complete. 2023-11-04T01:37:46.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.690+0000 7f21e46c9640 1 Processor -- start 2023-11-04T01:37:46.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.690+0000 7f21e46c9640 1 -- start start 2023-11-04T01:37:46.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.690+0000 7f21e46c9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f21dc0c9b60 0x7f21dc14b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.690+0000 7f21e46c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21dc15ad40 0x7f21dc151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.690+0000 7f21e46c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21dc15b120 0x7f21dc14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.690+0000 7f21e46c9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc151c90 con 0x7f21dc15ad40 2023-11-04T01:37:46.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.690+0000 7f21e46c9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc151f70 con 0x7f21dc0c9b60 2023-11-04T01:37:46.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21e46c9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc152250 con 0x7f21dc15b120 2023-11-04T01:37:46.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21e1c64640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21dc15ad40 0x7f21dc151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21e1c64640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21dc15ad40 0x7f21dc151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51014/0 (socket says 172.21.15.114:51014) 2023-11-04T01:37:46.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21e1c64640 1 -- 172.21.15.114:0/2525802306 learned_addr learned my addr 172.21.15.114:0/2525802306 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:46.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21e2c66640 1 --2- 172.21.15.114:0/2525802306 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21dc15b120 0x7f21dc14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21e2465640 1 --2- 172.21.15.114:0/2525802306 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f21dc0c9b60 0x7f21dc14b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21e1c64640 1 -- 172.21.15.114:0/2525802306 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21dc15b120 msgr2=0x7f21dc14e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21e1c64640 1 --2- 172.21.15.114:0/2525802306 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21dc15b120 0x7f21dc14e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21e1c64640 1 -- 172.21.15.114:0/2525802306 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f21dc0c9b60 msgr2=0x7f21dc14b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21e1c64640 1 --2- 172.21.15.114:0/2525802306 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f21dc0c9b60 0x7f21dc14b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21e1c64640 1 -- 172.21.15.114:0/2525802306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d80094d0 con 0x7f21dc15ad40 2023-11-04T01:37:46.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21e2c66640 1 --2- 172.21.15.114:0/2525802306 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21dc15b120 0x7f21dc14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:46.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21e1c64640 1 --2- 172.21.15.114:0/2525802306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21dc15ad40 0x7f21dc151360 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00c7c0 tx=0x7f21cc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:46.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21d2ffd640 1 -- 172.21.15.114:0/2525802306 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc007820 con 0x7f21dc15ad40 2023-11-04T01:37:46.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21d2ffd640 1 -- 172.21.15.114:0/2525802306 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21cc007980 con 0x7f21dc15ad40 2023-11-04T01:37:46.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21e46c9640 1 -- 172.21.15.114:0/2525802306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21dc152530 con 0x7f21dc15ad40 2023-11-04T01:37:46.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21d2ffd640 1 -- 172.21.15.114:0/2525802306 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc007cf0 con 0x7f21dc15ad40 2023-11-04T01:37:46.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.691+0000 7f21e46c9640 1 -- 172.21.15.114:0/2525802306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21dc14bb20 con 0x7f21dc15ad40 2023-11-04T01:37:46.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.692+0000 7f21e46c9640 1 -- 172.21.15.114:0/2525802306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21dc074290 con 0x7f21dc15ad40 2023-11-04T01:37:46.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.693+0000 7f21d2ffd640 1 -- 172.21.15.114:0/2525802306 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21cc0113f0 con 0x7f21dc15ad40 2023-11-04T01:37:46.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.693+0000 7f21d2ffd640 1 --2- 172.21.15.114:0/2525802306 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f21c006aea0 0x7f21c006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:46.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.693+0000 7f21d2ffd640 1 -- 172.21.15.114:0/2525802306 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f21cc089060 con 0x7f21dc15ad40 2023-11-04T01:37:46.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.693+0000 7f21e2465640 1 --2- 172.21.15.114:0/2525802306 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f21c006aea0 0x7f21c006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:46.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.694+0000 7f21e2465640 1 --2- 172.21.15.114:0/2525802306 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f21c006aea0 0x7f21c006d360 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f21d8036000 tx=0x7f21d803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:46.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.697+0000 7f21d2ffd640 1 -- 172.21.15.114:0/2525802306 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f21cc054320 con 0x7f21dc15ad40 2023-11-04T01:37:46.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.928+0000 7f21e46c9640 1 -- 172.21.15.114:0/2525802306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f21dc0ccac0 con 0x7f21dc15ad40 2023-11-04T01:37:46.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.930+0000 7f21d2ffd640 1 -- 172.21.15.114:0/2525802306 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f21cc057940 con 0x7f21dc15ad40 2023-11-04T01:37:46.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.932+0000 7f21e46c9640 1 -- 172.21.15.114:0/2525802306 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f21c006aea0 msgr2=0x7f21c006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.932+0000 7f21e46c9640 1 --2- 172.21.15.114:0/2525802306 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f21c006aea0 0x7f21c006d360 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f21d8036000 tx=0x7f21d803c040 comp rx=0 tx=0).stop 2023-11-04T01:37:46.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.932+0000 7f21e46c9640 1 -- 172.21.15.114:0/2525802306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21dc15ad40 msgr2=0x7f21dc151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:46.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.932+0000 7f21e46c9640 1 --2- 172.21.15.114:0/2525802306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21dc15ad40 0x7f21dc151360 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00c7c0 tx=0x7f21cc00cc80 comp rx=0 tx=0).stop 2023-11-04T01:37:46.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.933+0000 7f21e46c9640 1 -- 172.21.15.114:0/2525802306 shutdown_connections 2023-11-04T01:37:46.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.933+0000 7f21e46c9640 1 --2- 172.21.15.114:0/2525802306 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f21dc15b120 0x7f21dc14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.933+0000 7f21e46c9640 1 --2- 172.21.15.114:0/2525802306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21dc15ad40 0x7f21dc151360 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.933+0000 7f21e46c9640 1 --2- 172.21.15.114:0/2525802306 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f21c006aea0 0x7f21c006d360 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.933+0000 7f21e46c9640 1 --2- 172.21.15.114:0/2525802306 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f21dc0c9b60 0x7f21dc14b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:46.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.933+0000 7f21e46c9640 1 -- 172.21.15.114:0/2525802306 >> 172.21.15.114:0/2525802306 conn(0x7f21dc0cbc90 msgr2=0x7f21dc15dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.933+0000 7f21e46c9640 1 -- 172.21.15.114:0/2525802306 shutdown_connections 2023-11-04T01:37:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:46.933+0000 7f21e46c9640 1 -- 172.21.15.114:0/2525802306 wait complete. 2023-11-04T01:37:46.945 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-04T01:37:47.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.043+0000 7f60a414c640 1 Processor -- start 2023-11-04T01:37:47.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.043+0000 7f60a414c640 1 -- start start 2023-11-04T01:37:47.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.044+0000 7f60a414c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f609c160430 0x7f609c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.044+0000 7f60a414c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f609c0b2b60 0x7f609c06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.044+0000 7f60a414c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c0b2fc0 con 0x7f609c06c1d0 2023-11-04T01:37:47.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.044+0000 7f60a414c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c0cb580 con 0x7f609c0b2b60 2023-11-04T01:37:47.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.044+0000 7f60a414c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c06ca40 con 0x7f609c160430 2023-11-04T01:37:47.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.044+0000 7f60a16e7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f609c0b2b60 0x7f609c06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.044+0000 7f60a26e9640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f609c06c1d0 0x7f609c160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60548/0 (socket says 172.21.15.114:60548) 2023-11-04T01:37:47.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.044+0000 7f60a26e9640 1 -- 172.21.15.114:0/3342686097 learned_addr learned my addr 172.21.15.114:0/3342686097 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:47.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.044+0000 7f60a16e7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f609c0b2b60 0x7f609c06bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51022/0 (socket says 172.21.15.114:51022) 2023-11-04T01:37:47.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.045+0000 7f60a16e7640 1 -- 172.21.15.114:0/3342686097 >> v2:172.21.15.141:3300/0 conn(0x7f609c160430 msgr2=0x7f609c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:47.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.045+0000 7f60a16e7640 1 --2- 172.21.15.114:0/3342686097 >> v2:172.21.15.141:3300/0 conn(0x7f609c160430 0x7f609c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.045+0000 7f60a16e7640 1 -- 172.21.15.114:0/3342686097 >> v1:172.21.15.114:6789/0 conn(0x7f609c06c1d0 legacy=0x7f609c160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.045+0000 7f60a16e7640 1 -- 172.21.15.114:0/3342686097 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c06cd20 con 0x7f609c0b2b60 2023-11-04T01:37:47.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.045+0000 7f60a0ee6640 1 -- 172.21.15.114:0/3342686097 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241458128 0 0) 0x7f609c0b2fc0 con 0x7f609c06c1d0 2023-11-04T01:37:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.045+0000 7f60a16e7640 1 --2- 172.21.15.114:0/3342686097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f609c0b2b60 0x7f609c06bc90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f609c06f6d0 tx=0x7f608c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30e7617089fa2b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.045+0000 7f60a0ee6640 1 -- 172.21.15.114:0/3342686097 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c031830 con 0x7f609c0b2b60 2023-11-04T01:37:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.046+0000 7f60a0ee6640 1 -- 172.21.15.114:0/3342686097 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c031990 con 0x7f609c0b2b60 2023-11-04T01:37:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.046+0000 7f60a0ee6640 1 -- 172.21.15.114:0/3342686097 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c031d20 con 0x7f609c0b2b60 2023-11-04T01:37:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.046+0000 7f60a414c640 1 -- 172.21.15.114:0/3342686097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f609c0b2b60 msgr2=0x7f609c06bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.046+0000 7f60a414c640 1 --2- 172.21.15.114:0/3342686097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f609c0b2b60 0x7f609c06bc90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f609c06f6d0 tx=0x7f608c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.046+0000 7f60a414c640 1 -- 172.21.15.114:0/3342686097 shutdown_connections 2023-11-04T01:37:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.046+0000 7f60a414c640 1 --2- 172.21.15.114:0/3342686097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f609c0b2b60 0x7f609c06bc90 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.046+0000 7f60a414c640 1 --2- 172.21.15.114:0/3342686097 >> v2:172.21.15.141:3300/0 conn(0x7f609c160430 0x7f609c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.046+0000 7f60a414c640 1 -- 172.21.15.114:0/3342686097 >> 172.21.15.114:0/3342686097 conn(0x7f609c06ea20 msgr2=0x7f609c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.046+0000 7f60a414c640 1 -- 172.21.15.114:0/3342686097 shutdown_connections 2023-11-04T01:37:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.046+0000 7f60a414c640 1 -- 172.21.15.114:0/3342686097 wait complete. 2023-11-04T01:37:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.047+0000 7f60a414c640 1 Processor -- start 2023-11-04T01:37:47.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.047+0000 7f60a414c640 1 -- start start 2023-11-04T01:37:47.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.048+0000 7f60a414c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f609c06c1d0 0x7f609c0b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.048+0000 7f60a414c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f609c0b2b60 0x7f609c152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.048+0000 7f60a414c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f609c160430 0x7f609c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.048+0000 7f60a414c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0c6550 con 0x7f609c06c1d0 2023-11-04T01:37:47.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.048+0000 7f60a414c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c1f6f30 con 0x7f609c0b2b60 2023-11-04T01:37:47.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.048+0000 7f60a414c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c152670 con 0x7f609c160430 2023-11-04T01:37:47.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.048+0000 7f60a1ee8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f609c06c1d0 0x7f609c0b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.048+0000 7f60a1ee8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f609c06c1d0 0x7f609c0b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51030/0 (socket says 172.21.15.114:51030) 2023-11-04T01:37:47.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.048+0000 7f60a1ee8640 1 -- 172.21.15.114:0/495763647 learned_addr learned my addr 172.21.15.114:0/495763647 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:47.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.048+0000 7f60a1ee8640 1 -- 172.21.15.114:0/495763647 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f609c160430 msgr2=0x7f609c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.048+0000 7f60a1ee8640 1 --2- 172.21.15.114:0/495763647 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f609c160430 0x7f609c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.048+0000 7f60a1ee8640 1 -- 172.21.15.114:0/495763647 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f609c0b2b60 msgr2=0x7f609c152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.048+0000 7f60a1ee8640 1 --2- 172.21.15.114:0/495763647 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f609c0b2b60 0x7f609c152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.048+0000 7f60a1ee8640 1 -- 172.21.15.114:0/495763647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c009400 con 0x7f609c06c1d0 2023-11-04T01:37:47.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.049+0000 7f60a1ee8640 1 --2- 172.21.15.114:0/495763647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f609c06c1d0 0x7f609c0b37c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f609800ba50 tx=0x7f609800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:47.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.049+0000 7f60927fc640 1 -- 172.21.15.114:0/495763647 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609800cbe0 con 0x7f609c06c1d0 2023-11-04T01:37:47.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.049+0000 7f60927fc640 1 -- 172.21.15.114:0/495763647 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609800cd60 con 0x7f609c06c1d0 2023-11-04T01:37:47.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.049+0000 7f60a414c640 1 -- 172.21.15.114:0/495763647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c0c5bb0 con 0x7f609c06c1d0 2023-11-04T01:37:47.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.049+0000 7f60927fc640 1 -- 172.21.15.114:0/495763647 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098014680 con 0x7f609c06c1d0 2023-11-04T01:37:47.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.049+0000 7f60a414c640 1 -- 172.21.15.114:0/495763647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c0c6170 con 0x7f609c06c1d0 2023-11-04T01:37:47.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.050+0000 7f60a414c640 1 -- 172.21.15.114:0/495763647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c0c6690 con 0x7f609c06c1d0 2023-11-04T01:37:47.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.050+0000 7f60927fc640 1 -- 172.21.15.114:0/495763647 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f609801d3b0 con 0x7f609c06c1d0 2023-11-04T01:37:47.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.051+0000 7f60927fc640 1 --2- 172.21.15.114:0/495763647 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f608006ae70 0x7f608006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.051+0000 7f60a16e7640 1 --2- 172.21.15.114:0/495763647 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f608006ae70 0x7f608006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.051+0000 7f60927fc640 1 -- 172.21.15.114:0/495763647 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6098089360 con 0x7f609c06c1d0 2023-11-04T01:37:47.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.051+0000 7f60a16e7640 1 --2- 172.21.15.114:0/495763647 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f608006ae70 0x7f608006d330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f608c036000 tx=0x7f608c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:47.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.055+0000 7f60927fc640 1 -- 172.21.15.114:0/495763647 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f609c0c6690 con 0x7f609c06c1d0 2023-11-04T01:37:47.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.285+0000 7f60a414c640 1 -- 172.21.15.114:0/495763647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f609c074290 con 0x7f609c06c1d0 2023-11-04T01:37:47.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.287+0000 7f60927fc640 1 -- 172.21.15.114:0/495763647 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f60980546b0 con 0x7f609c06c1d0 2023-11-04T01:37:47.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.289+0000 7f60a414c640 1 -- 172.21.15.114:0/495763647 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f608006ae70 msgr2=0x7f608006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.289+0000 7f60a414c640 1 --2- 172.21.15.114:0/495763647 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f608006ae70 0x7f608006d330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f608c036000 tx=0x7f608c030000 comp rx=0 tx=0).stop 2023-11-04T01:37:47.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.289+0000 7f60a414c640 1 -- 172.21.15.114:0/495763647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f609c06c1d0 msgr2=0x7f609c0b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.289+0000 7f60a414c640 1 --2- 172.21.15.114:0/495763647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f609c06c1d0 0x7f609c0b37c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f609800ba50 tx=0x7f609800bf10 comp rx=0 tx=0).stop 2023-11-04T01:37:47.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.289+0000 7f60a414c640 1 -- 172.21.15.114:0/495763647 shutdown_connections 2023-11-04T01:37:47.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.289+0000 7f60a414c640 1 --2- 172.21.15.114:0/495763647 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f609c160430 0x7f609c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.289+0000 7f60a414c640 1 --2- 172.21.15.114:0/495763647 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f608006ae70 0x7f608006d330 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.289+0000 7f60a414c640 1 --2- 172.21.15.114:0/495763647 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f609c0b2b60 0x7f609c152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.289+0000 7f60a414c640 1 --2- 172.21.15.114:0/495763647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f609c06c1d0 0x7f609c0b37c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.289+0000 7f60a414c640 1 -- 172.21.15.114:0/495763647 >> 172.21.15.114:0/495763647 conn(0x7f609c06ea20 msgr2=0x7f609c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:47.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.289+0000 7f60a414c640 1 -- 172.21.15.114:0/495763647 shutdown_connections 2023-11-04T01:37:47.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.289+0000 7f60a414c640 1 -- 172.21.15.114:0/495763647 wait complete. 2023-11-04T01:37:47.302 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-04T01:37:47.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.400+0000 7f846a705640 1 Processor -- start 2023-11-04T01:37:47.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.400+0000 7f846a705640 1 -- start start 2023-11-04T01:37:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.401+0000 7f846a705640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f846415e3f0 0x7f84640b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.401+0000 7f846a705640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f84640ca0a0 0x7f84640cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.401+0000 7f846a705640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84640caa20 con 0x7f84640cc300 2023-11-04T01:37:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.401+0000 7f846a705640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84640cb230 con 0x7f84640ca0a0 2023-11-04T01:37:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.401+0000 7f846a705640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84640ca530 con 0x7f846415e3f0 2023-11-04T01:37:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.401+0000 7f84637fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f84640ca0a0 0x7f84640cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.401+0000 7f84637fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f84640ca0a0 0x7f84640cc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51040/0 (socket says 172.21.15.114:51040) 2023-11-04T01:37:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.401+0000 7f84637fe640 1 -- 172.21.15.114:0/1593856133 learned_addr learned my addr 172.21.15.114:0/1593856133 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.401+0000 7f8463fff640 1 --2- 172.21.15.114:0/1593856133 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f846415e3f0 0x7f84640b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.401+0000 7f84637fe640 1 -- 172.21.15.114:0/1593856133 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f846415e3f0 msgr2=0x7f84640b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.401+0000 7f84637fe640 1 --2- 172.21.15.114:0/1593856133 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f846415e3f0 0x7f84640b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.401+0000 7f84637fe640 1 -- 172.21.15.114:0/1593856133 >> v1:172.21.15.141:6789/0 conn(0x7f84640cc300 legacy=0x7f84640b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.401+0000 7f84637fe640 1 -- 172.21.15.114:0/1593856133 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84640cac70 con 0x7f84640ca0a0 2023-11-04T01:37:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.402+0000 7f84637fe640 1 --2- 172.21.15.114:0/1593856133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84640ca0a0 0x7f84640cc920 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8454009870 tx=0x7f845402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2fe0361994cf00 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.402+0000 7f8462ffd640 1 -- 172.21.15.114:0/1593856133 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454030840 con 0x7f84640ca0a0 2023-11-04T01:37:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.402+0000 7f8462ffd640 1 -- 172.21.15.114:0/1593856133 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84540309a0 con 0x7f84640ca0a0 2023-11-04T01:37:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.402+0000 7f8462ffd640 1 -- 172.21.15.114:0/1593856133 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454030d30 con 0x7f84640ca0a0 2023-11-04T01:37:47.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.403+0000 7f846a705640 1 -- 172.21.15.114:0/1593856133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84640ca0a0 msgr2=0x7f84640cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.403+0000 7f846a705640 1 --2- 172.21.15.114:0/1593856133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84640ca0a0 0x7f84640cc920 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8454009870 tx=0x7f845402b980 comp rx=0 tx=0).stop 2023-11-04T01:37:47.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.403+0000 7f846a705640 1 -- 172.21.15.114:0/1593856133 shutdown_connections 2023-11-04T01:37:47.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.403+0000 7f846a705640 1 --2- 172.21.15.114:0/1593856133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84640ca0a0 0x7f84640cc920 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.403+0000 7f846a705640 1 --2- 172.21.15.114:0/1593856133 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f846415e3f0 0x7f84640b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.403+0000 7f846a705640 1 -- 172.21.15.114:0/1593856133 >> 172.21.15.114:0/1593856133 conn(0x7f8464071820 msgr2=0x7f8464071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:47.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.403+0000 7f846a705640 1 -- 172.21.15.114:0/1593856133 shutdown_connections 2023-11-04T01:37:47.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.403+0000 7f846a705640 1 -- 172.21.15.114:0/1593856133 wait complete. 2023-11-04T01:37:47.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.404+0000 7f846a705640 1 Processor -- start 2023-11-04T01:37:47.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.404+0000 7f846a705640 1 -- start start 2023-11-04T01:37:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f846a705640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84640cc300 0x7f84641f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f846a705640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f846415e3f0 0x7f8464152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f846a705640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84641f1800 0x7f8464152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f846a705640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84640c7960 con 0x7f84641f1800 2023-11-04T01:37:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f846a705640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84641f3a50 con 0x7f846415e3f0 2023-11-04T01:37:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f846a705640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84641f1450 con 0x7f84640cc300 2023-11-04T01:37:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f8468ca2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84641f1800 0x7f8464152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f8468ca2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84641f1800 0x7f8464152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51044/0 (socket says 172.21.15.114:51044) 2023-11-04T01:37:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f8468ca2640 1 -- 172.21.15.114:0/2903272298 learned_addr learned my addr 172.21.15.114:0/2903272298 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f8463fff640 1 --2- 172.21.15.114:0/2903272298 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84640cc300 0x7f84641f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f84637fe640 1 --2- 172.21.15.114:0/2903272298 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f846415e3f0 0x7f8464152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f8468ca2640 1 -- 172.21.15.114:0/2903272298 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84640cc300 msgr2=0x7f84641f3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f8468ca2640 1 --2- 172.21.15.114:0/2903272298 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84640cc300 0x7f84641f3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f8468ca2640 1 -- 172.21.15.114:0/2903272298 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f846415e3f0 msgr2=0x7f8464152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f8468ca2640 1 --2- 172.21.15.114:0/2903272298 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f846415e3f0 0x7f8464152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f8468ca2640 1 -- 172.21.15.114:0/2903272298 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84540094d0 con 0x7f84641f1800 2023-11-04T01:37:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f8468ca2640 1 --2- 172.21.15.114:0/2903272298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84641f1800 0x7f8464152890 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f845c00c730 tx=0x7f845c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f8460ff9640 1 -- 172.21.15.114:0/2903272298 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c003b70 con 0x7f84641f1800 2023-11-04T01:37:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f8460ff9640 1 -- 172.21.15.114:0/2903272298 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c003cd0 con 0x7f84641f1800 2023-11-04T01:37:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f846a705640 1 -- 172.21.15.114:0/2903272298 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84640c7b70 con 0x7f84641f1800 2023-11-04T01:37:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f8460ff9640 1 -- 172.21.15.114:0/2903272298 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c00aa90 con 0x7f84641f1800 2023-11-04T01:37:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.405+0000 7f846a705640 1 -- 172.21.15.114:0/2903272298 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84640c8130 con 0x7f84641f1800 2023-11-04T01:37:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.406+0000 7f846a705640 1 -- 172.21.15.114:0/2903272298 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8464074290 con 0x7f84641f1800 2023-11-04T01:37:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.407+0000 7f8460ff9640 1 -- 172.21.15.114:0/2903272298 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f845c00abf0 con 0x7f84641f1800 2023-11-04T01:37:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.407+0000 7f8460ff9640 1 --2- 172.21.15.114:0/2903272298 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f845006ae70 0x7f845006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.407+0000 7f8460ff9640 1 -- 172.21.15.114:0/2903272298 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f845c0891e0 con 0x7f84641f1800 2023-11-04T01:37:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.407+0000 7f8463fff640 1 --2- 172.21.15.114:0/2903272298 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f845006ae70 0x7f845006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.408+0000 7f8463fff640 1 --2- 172.21.15.114:0/2903272298 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f845006ae70 0x7f845006d330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8458006fd0 tx=0x7f8458008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:47.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.411+0000 7f8460ff9640 1 -- 172.21.15.114:0/2903272298 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f845c0544a0 con 0x7f84641f1800 2023-11-04T01:37:47.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.639+0000 7f846a705640 1 -- 172.21.15.114:0/2903272298 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f84640cd2a0 con 0x7f84641f1800 2023-11-04T01:37:47.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.641+0000 7f8460ff9640 1 -- 172.21.15.114:0/2903272298 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f845c057ac0 con 0x7f84641f1800 2023-11-04T01:37:47.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.643+0000 7f846a705640 1 -- 172.21.15.114:0/2903272298 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f845006ae70 msgr2=0x7f845006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.643+0000 7f846a705640 1 --2- 172.21.15.114:0/2903272298 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f845006ae70 0x7f845006d330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8458006fd0 tx=0x7f8458008040 comp rx=0 tx=0).stop 2023-11-04T01:37:47.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.643+0000 7f846a705640 1 -- 172.21.15.114:0/2903272298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84641f1800 msgr2=0x7f8464152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.643+0000 7f846a705640 1 --2- 172.21.15.114:0/2903272298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84641f1800 0x7f8464152890 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f845c00c730 tx=0x7f845c00cbf0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.643+0000 7f846a705640 1 -- 172.21.15.114:0/2903272298 shutdown_connections 2023-11-04T01:37:47.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.643+0000 7f846a705640 1 --2- 172.21.15.114:0/2903272298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84641f1800 0x7f8464152890 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.643+0000 7f846a705640 1 --2- 172.21.15.114:0/2903272298 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f845006ae70 0x7f845006d330 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.643+0000 7f846a705640 1 --2- 172.21.15.114:0/2903272298 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f846415e3f0 0x7f8464152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.643+0000 7f846a705640 1 --2- 172.21.15.114:0/2903272298 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84640cc300 0x7f84641f3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.643+0000 7f846a705640 1 -- 172.21.15.114:0/2903272298 >> 172.21.15.114:0/2903272298 conn(0x7f8464071820 msgr2=0x7f84640cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:47.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.644+0000 7f846a705640 1 -- 172.21.15.114:0/2903272298 shutdown_connections 2023-11-04T01:37:47.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.644+0000 7f846a705640 1 -- 172.21.15.114:0/2903272298 wait complete. 2023-11-04T01:37:47.656 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:47.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.753+0000 7fc4d7ce7640 1 Processor -- start 2023-11-04T01:37:47.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.753+0000 7fc4d7ce7640 1 -- start start 2023-11-04T01:37:47.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.754+0000 7fc4d7ce7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc4d00ce370 0x7fc4d006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.754+0000 7fc4d7ce7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d006e060 con 0x7fc4d0159c70 2023-11-04T01:37:47.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.754+0000 7fc4d7ce7640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d00b4110 con 0x7fc4d00b0ae0 2023-11-04T01:37:47.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.754+0000 7fc4d7ce7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d00b49b0 con 0x7fc4d00ce370 2023-11-04T01:37:47.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.754+0000 7fc4d6284640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc4d00ce370 0x7fc4d006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.754+0000 7fc4d5a83640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc4d0159c70 0x7fc4d00b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60550/0 (socket says 172.21.15.114:60550) 2023-11-04T01:37:47.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.754+0000 7fc4d5a83640 1 -- 172.21.15.114:0/3661377871 learned_addr learned my addr 172.21.15.114:0/3661377871 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:47.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.754+0000 7fc4d6284640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc4d00ce370 0x7fc4d006db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51046/0 (socket says 172.21.15.114:51046) 2023-11-04T01:37:47.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.754+0000 7fc4d6284640 1 -- 172.21.15.114:0/3661377871 >> v1:172.21.15.141:6789/0 conn(0x7fc4d00b0ae0 legacy=0x7fc4d015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:47.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.754+0000 7fc4d6284640 1 -- 172.21.15.114:0/3661377871 >> v1:172.21.15.114:6789/0 conn(0x7fc4d0159c70 legacy=0x7fc4d00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.754+0000 7fc4d6284640 1 -- 172.21.15.114:0/3661377871 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d00b43f0 con 0x7fc4d00ce370 2023-11-04T01:37:47.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.754+0000 7fc4d4a81640 1 -- 172.21.15.114:0/3661377871 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788705338 0 0) 0x7fc4d006e060 con 0x7fc4d0159c70 2023-11-04T01:37:47.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.755+0000 7fc4d6284640 1 --2- 172.21.15.114:0/3661377871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4d00ce370 0x7fc4d006db20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc4d006e1f0 tx=0x7fc4c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad93ef26e05ba92 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:47.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.755+0000 7fc4d4a81640 1 -- 172.21.15.114:0/3661377871 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8031830 con 0x7fc4d00ce370 2023-11-04T01:37:47.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.755+0000 7fc4d4a81640 1 -- 172.21.15.114:0/3661377871 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c8031990 con 0x7fc4d00ce370 2023-11-04T01:37:47.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.755+0000 7fc4d4a81640 1 -- 172.21.15.114:0/3661377871 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8031d20 con 0x7fc4d00ce370 2023-11-04T01:37:47.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.756+0000 7fc4d7ce7640 1 -- 172.21.15.114:0/3661377871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4d00ce370 msgr2=0x7fc4d006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.756+0000 7fc4d7ce7640 1 --2- 172.21.15.114:0/3661377871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4d00ce370 0x7fc4d006db20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc4d006e1f0 tx=0x7fc4c802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.756+0000 7fc4d7ce7640 1 -- 172.21.15.114:0/3661377871 shutdown_connections 2023-11-04T01:37:47.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.756+0000 7fc4d7ce7640 1 --2- 172.21.15.114:0/3661377871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4d00ce370 0x7fc4d006db20 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.756+0000 7fc4d7ce7640 1 -- 172.21.15.114:0/3661377871 >> 172.21.15.114:0/3661377871 conn(0x7fc4d00ce950 msgr2=0x7fc4d00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:47.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.756+0000 7fc4d7ce7640 1 -- 172.21.15.114:0/3661377871 shutdown_connections 2023-11-04T01:37:47.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.756+0000 7fc4d7ce7640 1 -- 172.21.15.114:0/3661377871 wait complete. 2023-11-04T01:37:47.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.757+0000 7fc4d7ce7640 1 Processor -- start 2023-11-04T01:37:47.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.757+0000 7fc4d7ce7640 1 -- start start 2023-11-04T01:37:47.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d7ce7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4d00b0ae0 0x7fc4d00ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d7ce7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4d00ce370 0x7fc4d014c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d7ce7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4d0159c70 0x7fc4d015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d7ce7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00ce7e0 con 0x7fc4d0159c70 2023-11-04T01:37:47.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d7ce7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d014f4a0 con 0x7fc4d00b0ae0 2023-11-04T01:37:47.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d7ce7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d014cec0 con 0x7fc4d00ce370 2023-11-04T01:37:47.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d6284640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4d0159c70 0x7fc4d015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d6284640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4d0159c70 0x7fc4d015cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51054/0 (socket says 172.21.15.114:51054) 2023-11-04T01:37:47.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d6284640 1 -- 172.21.15.114:0/1728798754 learned_addr learned my addr 172.21.15.114:0/1728798754 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:47.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d5a83640 1 --2- 172.21.15.114:0/1728798754 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4d00b0ae0 0x7fc4d00ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d5282640 1 --2- 172.21.15.114:0/1728798754 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4d00ce370 0x7fc4d014c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d6284640 1 -- 172.21.15.114:0/1728798754 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4d00ce370 msgr2=0x7fc4d014c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d6284640 1 --2- 172.21.15.114:0/1728798754 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4d00ce370 0x7fc4d014c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d6284640 1 -- 172.21.15.114:0/1728798754 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4d00b0ae0 msgr2=0x7fc4d00ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d6284640 1 --2- 172.21.15.114:0/1728798754 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4d00b0ae0 0x7fc4d00ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d6284640 1 -- 172.21.15.114:0/1728798754 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c8009400 con 0x7fc4d0159c70 2023-11-04T01:37:47.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d6284640 1 --2- 172.21.15.114:0/1728798754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4d0159c70 0x7fc4d015cb40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009890 tx=0x7fc4c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:47.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4c67fc640 1 -- 172.21.15.114:0/1728798754 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c803b9f0 con 0x7fc4d0159c70 2023-11-04T01:37:47.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4c67fc640 1 -- 172.21.15.114:0/1728798754 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c803bb50 con 0x7fc4d0159c70 2023-11-04T01:37:47.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d7ce7640 1 -- 172.21.15.114:0/1728798754 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d00aed00 con 0x7fc4d0159c70 2023-11-04T01:37:47.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4c67fc640 1 -- 172.21.15.114:0/1728798754 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80453f0 con 0x7fc4d0159c70 2023-11-04T01:37:47.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.758+0000 7fc4d7ce7640 1 -- 172.21.15.114:0/1728798754 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d00af2c0 con 0x7fc4d0159c70 2023-11-04T01:37:47.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.759+0000 7fc4d7ce7640 1 -- 172.21.15.114:0/1728798754 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d0074290 con 0x7fc4d0159c70 2023-11-04T01:37:47.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.760+0000 7fc4c67fc640 1 -- 172.21.15.114:0/1728798754 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc4c8045550 con 0x7fc4d0159c70 2023-11-04T01:37:47.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.760+0000 7fc4c67fc640 1 --2- 172.21.15.114:0/1728798754 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc4b406ae70 0x7fc4b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:47.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.760+0000 7fc4d5a83640 1 --2- 172.21.15.114:0/1728798754 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc4b406ae70 0x7fc4b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:47.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.760+0000 7fc4c67fc640 1 -- 172.21.15.114:0/1728798754 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc4c80ab870 con 0x7fc4d0159c70 2023-11-04T01:37:47.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.761+0000 7fc4d5a83640 1 --2- 172.21.15.114:0/1728798754 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc4b406ae70 0x7fc4b406d330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc007ed0 tx=0x7fc4cc007e60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:47.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.764+0000 7fc4c67fc640 1 -- 172.21.15.114:0/1728798754 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4c8076c50 con 0x7fc4d0159c70 2023-11-04T01:37:47.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.933+0000 7fc4d7ce7640 1 -- 172.21.15.114:0/1728798754 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4d015d7d0 con 0x7fc4d0159c70 2023-11-04T01:37:47.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.934+0000 7fc4c67fc640 1 -- 172.21.15.114:0/1728798754 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13122 (secure 0 0 0) 0x7fc4c807a270 con 0x7fc4d0159c70 2023-11-04T01:37:47.936 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:47.936 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":34,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:45.141406+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:47.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.936+0000 7fc4d7ce7640 1 -- 172.21.15.114:0/1728798754 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc4b406ae70 msgr2=0x7fc4b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.936+0000 7fc4d7ce7640 1 --2- 172.21.15.114:0/1728798754 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc4b406ae70 0x7fc4b406d330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc007ed0 tx=0x7fc4cc007e60 comp rx=0 tx=0).stop 2023-11-04T01:37:47.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.936+0000 7fc4d7ce7640 1 -- 172.21.15.114:0/1728798754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4d0159c70 msgr2=0x7fc4d015cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:47.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.936+0000 7fc4d7ce7640 1 --2- 172.21.15.114:0/1728798754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4d0159c70 0x7fc4d015cb40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009890 tx=0x7fc4c80046c0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.936+0000 7fc4d7ce7640 1 -- 172.21.15.114:0/1728798754 shutdown_connections 2023-11-04T01:37:47.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.936+0000 7fc4d7ce7640 1 --2- 172.21.15.114:0/1728798754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4d0159c70 0x7fc4d015cb40 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.936+0000 7fc4d7ce7640 1 --2- 172.21.15.114:0/1728798754 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc4d00ce370 0x7fc4d014c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.936+0000 7fc4d7ce7640 1 --2- 172.21.15.114:0/1728798754 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc4b406ae70 0x7fc4b406d330 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.936+0000 7fc4d7ce7640 1 --2- 172.21.15.114:0/1728798754 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4d00b0ae0 0x7fc4d00ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:47.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.936+0000 7fc4d7ce7640 1 -- 172.21.15.114:0/1728798754 >> 172.21.15.114:0/1728798754 conn(0x7fc4d00ce950 msgr2=0x7fc4d0151a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:47.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.936+0000 7fc4d7ce7640 1 -- 172.21.15.114:0/1728798754 shutdown_connections 2023-11-04T01:37:47.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:47.936+0000 7fc4d7ce7640 1 -- 172.21.15.114:0/1728798754 wait complete. 2023-11-04T01:37:47.948 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:37:47.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:37:48.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.049+0000 7fbee9f5e640 1 Processor -- start 2023-11-04T01:37:48.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.049+0000 7fbee9f5e640 1 -- start start 2023-11-04T01:37:48.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.050+0000 7fbee9f5e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbee406cbd0 0x7fbee406e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.050+0000 7fbee9f5e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbee4067090 0x7fbee40b2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.050+0000 7fbee9f5e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee40b24f0 con 0x7fbee415b140 2023-11-04T01:37:48.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.050+0000 7fbee9f5e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee40ce220 con 0x7fbee4067090 2023-11-04T01:37:48.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.050+0000 7fbee9f5e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee40cdc60 con 0x7fbee406cbd0 2023-11-04T01:37:48.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.050+0000 7fbee3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbee4067090 0x7fbee40b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.050+0000 7fbee3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbee4067090 0x7fbee40b2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51058/0 (socket says 172.21.15.114:51058) 2023-11-04T01:37:48.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.050+0000 7fbee3fff640 1 -- 172.21.15.114:0/3895189474 learned_addr learned my addr 172.21.15.114:0/3895189474 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:48.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.050+0000 7fbee3fff640 1 -- 172.21.15.114:0/3895189474 >> v2:172.21.15.141:3300/0 conn(0x7fbee406cbd0 msgr2=0x7fbee406e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:48.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.050+0000 7fbee3fff640 1 --2- 172.21.15.114:0/3895189474 >> v2:172.21.15.141:3300/0 conn(0x7fbee406cbd0 0x7fbee406e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.050+0000 7fbee3fff640 1 -- 172.21.15.114:0/3895189474 >> v1:172.21.15.141:6789/0 conn(0x7fbee415b140 legacy=0x7fbee406cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:48.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.051+0000 7fbee3fff640 1 -- 172.21.15.114:0/3895189474 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee40cdf40 con 0x7fbee4067090 2023-11-04T01:37:48.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.051+0000 7fbee3fff640 1 --2- 172.21.15.114:0/3895189474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbee4067090 0x7fbee40b2980 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbee40707f0 tx=0x7fbedc02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ab6f493582d6a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:48.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.051+0000 7fbee27fc640 1 -- 172.21.15.114:0/3895189474 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc02c9f0 con 0x7fbee4067090 2023-11-04T01:37:48.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.051+0000 7fbee27fc640 1 -- 172.21.15.114:0/3895189474 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbedc02cb50 con 0x7fbee4067090 2023-11-04T01:37:48.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.051+0000 7fbee27fc640 1 -- 172.21.15.114:0/3895189474 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc0343f0 con 0x7fbee4067090 2023-11-04T01:37:48.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.052+0000 7fbee9f5e640 1 -- 172.21.15.114:0/3895189474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbee4067090 msgr2=0x7fbee40b2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.052+0000 7fbee9f5e640 1 --2- 172.21.15.114:0/3895189474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbee4067090 0x7fbee40b2980 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbee40707f0 tx=0x7fbedc02be50 comp rx=0 tx=0).stop 2023-11-04T01:37:48.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.052+0000 7fbee9f5e640 1 -- 172.21.15.114:0/3895189474 shutdown_connections 2023-11-04T01:37:48.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.052+0000 7fbee9f5e640 1 --2- 172.21.15.114:0/3895189474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbee4067090 0x7fbee40b2980 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.052+0000 7fbee9f5e640 1 --2- 172.21.15.114:0/3895189474 >> v2:172.21.15.141:3300/0 conn(0x7fbee406cbd0 0x7fbee406e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.052+0000 7fbee9f5e640 1 -- 172.21.15.114:0/3895189474 >> 172.21.15.114:0/3895189474 conn(0x7fbee406a120 msgr2=0x7fbee406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:48.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.052+0000 7fbee9f5e640 1 -- 172.21.15.114:0/3895189474 shutdown_connections 2023-11-04T01:37:48.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.052+0000 7fbee9f5e640 1 -- 172.21.15.114:0/3895189474 wait complete. 2023-11-04T01:37:48.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.053+0000 7fbee9f5e640 1 Processor -- start 2023-11-04T01:37:48.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.053+0000 7fbee9f5e640 1 -- start start 2023-11-04T01:37:48.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.054+0000 7fbee9f5e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbee4067090 0x7fbee415b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.054+0000 7fbee9f5e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbee406cbd0 0x7fbee40c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.054+0000 7fbee9f5e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbee415b140 0x7fbee41f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.054+0000 7fbee9f5e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee40c7820 con 0x7fbee406cbd0 2023-11-04T01:37:48.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.054+0000 7fbee9f5e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee40c8d50 con 0x7fbee4067090 2023-11-04T01:37:48.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.054+0000 7fbee9f5e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee415d8a0 con 0x7fbee415b140 2023-11-04T01:37:48.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.054+0000 7fbee2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbee406cbd0 0x7fbee40c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.054+0000 7fbee2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbee406cbd0 0x7fbee40c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51062/0 (socket says 172.21.15.114:51062) 2023-11-04T01:37:48.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.054+0000 7fbee2ffd640 1 -- 172.21.15.114:0/3151710202 learned_addr learned my addr 172.21.15.114:0/3151710202 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:48.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.054+0000 7fbee2ffd640 1 -- 172.21.15.114:0/3151710202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbee415b140 msgr2=0x7fbee41f0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.054+0000 7fbee2ffd640 1 --2- 172.21.15.114:0/3151710202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbee415b140 0x7fbee41f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.054+0000 7fbee2ffd640 1 -- 172.21.15.114:0/3151710202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbee4067090 msgr2=0x7fbee415b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.054+0000 7fbee37fe640 1 --2- 172.21.15.114:0/3151710202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbee4067090 0x7fbee415b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.054+0000 7fbee2ffd640 1 --2- 172.21.15.114:0/3151710202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbee4067090 0x7fbee415b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.054+0000 7fbee2ffd640 1 -- 172.21.15.114:0/3151710202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc009b30 con 0x7fbee406cbd0 2023-11-04T01:37:48.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.054+0000 7fbee37fe640 1 --2- 172.21.15.114:0/3151710202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbee4067090 0x7fbee415b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:48.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.055+0000 7fbee2ffd640 1 --2- 172.21.15.114:0/3151710202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbee406cbd0 0x7fbee40c8810 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbed800b410 tx=0x7fbed800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:48.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.055+0000 7fbecbfff640 1 -- 172.21.15.114:0/3151710202 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed8011830 con 0x7fbee406cbd0 2023-11-04T01:37:48.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.055+0000 7fbecbfff640 1 -- 172.21.15.114:0/3151710202 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed8011990 con 0x7fbee406cbd0 2023-11-04T01:37:48.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.055+0000 7fbee9f5e640 1 -- 172.21.15.114:0/3151710202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee415db80 con 0x7fbee406cbd0 2023-11-04T01:37:48.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.055+0000 7fbecbfff640 1 -- 172.21.15.114:0/3151710202 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed8011d40 con 0x7fbee406cbd0 2023-11-04T01:37:48.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.055+0000 7fbee9f5e640 1 -- 172.21.15.114:0/3151710202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee415e140 con 0x7fbee406cbd0 2023-11-04T01:37:48.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.056+0000 7fbee9f5e640 1 -- 172.21.15.114:0/3151710202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee415e330 con 0x7fbee406cbd0 2023-11-04T01:37:48.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.056+0000 7fbecbfff640 1 -- 172.21.15.114:0/3151710202 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbed801a400 con 0x7fbee406cbd0 2023-11-04T01:37:48.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.057+0000 7fbecbfff640 1 --2- 172.21.15.114:0/3151710202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbed006ae70 0x7fbed006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.057+0000 7fbecbfff640 1 -- 172.21.15.114:0/3151710202 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fbed80894c0 con 0x7fbee406cbd0 2023-11-04T01:37:48.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.057+0000 7fbee37fe640 1 --2- 172.21.15.114:0/3151710202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbed006ae70 0x7fbed006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.057+0000 7fbee37fe640 1 --2- 172.21.15.114:0/3151710202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbed006ae70 0x7fbed006d330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbed4006fd0 tx=0x7fbed4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:48.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.061+0000 7fbecbfff640 1 -- 172.21.15.114:0/3151710202 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbed8054810 con 0x7fbee406cbd0 2023-11-04T01:37:48.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.227+0000 7fbee9f5e640 1 -- 172.21.15.114:0/3151710202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbee4074290 con 0x7fbee406cbd0 2023-11-04T01:37:48.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.227+0000 7fbecbfff640 1 -- 172.21.15.114:0/3151710202 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbed80150a0 con 0x7fbee406cbd0 2023-11-04T01:37:48.229 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:37:48.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.229+0000 7fbee9f5e640 1 -- 172.21.15.114:0/3151710202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbed006ae70 msgr2=0x7fbed006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.229+0000 7fbee9f5e640 1 --2- 172.21.15.114:0/3151710202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbed006ae70 0x7fbed006d330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbed4006fd0 tx=0x7fbed4008040 comp rx=0 tx=0).stop 2023-11-04T01:37:48.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.229+0000 7fbee9f5e640 1 -- 172.21.15.114:0/3151710202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbee406cbd0 msgr2=0x7fbee40c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.229+0000 7fbee9f5e640 1 --2- 172.21.15.114:0/3151710202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbee406cbd0 0x7fbee40c8810 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbed800b410 tx=0x7fbed800b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.229+0000 7fbee9f5e640 1 -- 172.21.15.114:0/3151710202 shutdown_connections 2023-11-04T01:37:48.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.229+0000 7fbee9f5e640 1 --2- 172.21.15.114:0/3151710202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbee415b140 0x7fbee41f0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.229+0000 7fbee9f5e640 1 --2- 172.21.15.114:0/3151710202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbee406cbd0 0x7fbee40c8810 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.229+0000 7fbee9f5e640 1 --2- 172.21.15.114:0/3151710202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbed006ae70 0x7fbed006d330 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.229+0000 7fbee9f5e640 1 --2- 172.21.15.114:0/3151710202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbee4067090 0x7fbee415b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.229+0000 7fbee9f5e640 1 -- 172.21.15.114:0/3151710202 >> 172.21.15.114:0/3151710202 conn(0x7fbee406a120 msgr2=0x7fbee406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:48.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.229+0000 7fbee9f5e640 1 -- 172.21.15.114:0/3151710202 shutdown_connections 2023-11-04T01:37:48.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.229+0000 7fbee9f5e640 1 -- 172.21.15.114:0/3151710202 wait complete. 2023-11-04T01:37:48.242 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:37:48.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.339+0000 7fbb7387c640 1 Processor -- start 2023-11-04T01:37:48.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.339+0000 7fbb7387c640 1 -- start start 2023-11-04T01:37:48.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.340+0000 7fbb7387c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbb6c15aa30 0x7fbb6c0c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.340+0000 7fbb7387c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbb6c06ce00 0x7fbb6c0b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.340+0000 7fbb7387c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6c15bc30 con 0x7fbb6c0ca280 2023-11-04T01:37:48.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.340+0000 7fbb7387c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6c15bf10 con 0x7fbb6c06ce00 2023-11-04T01:37:48.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.340+0000 7fbb7387c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6c0c9540 con 0x7fbb6c15aa30 2023-11-04T01:37:48.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.340+0000 7fbb71e19640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbb6c06ce00 0x7fbb6c0b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.340+0000 7fbb71e19640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbb6c06ce00 0x7fbb6c0b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51078/0 (socket says 172.21.15.114:51078) 2023-11-04T01:37:48.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.340+0000 7fbb71e19640 1 -- 172.21.15.114:0/217262641 learned_addr learned my addr 172.21.15.114:0/217262641 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:48.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.340+0000 7fbb70e17640 1 --1- 172.21.15.114:0/217262641 >> v1:172.21.15.114:6789/0 conn(0x7fbb6c0ca280 0x7fbb6c06c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60566/0 (socket says 172.21.15.114:60566) 2023-11-04T01:37:48.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.340+0000 7fbb71618640 1 --2- 172.21.15.114:0/217262641 >> v2:172.21.15.141:3300/0 conn(0x7fbb6c15aa30 0x7fbb6c0c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.340+0000 7fbb71e19640 1 -- 172.21.15.114:0/217262641 >> v2:172.21.15.141:3300/0 conn(0x7fbb6c15aa30 msgr2=0x7fbb6c0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:48.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.340+0000 7fbb71e19640 1 --2- 172.21.15.114:0/217262641 >> v2:172.21.15.141:3300/0 conn(0x7fbb6c15aa30 0x7fbb6c0c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.340+0000 7fbb71e19640 1 -- 172.21.15.114:0/217262641 >> v1:172.21.15.114:6789/0 conn(0x7fbb6c0ca280 legacy=0x7fbb6c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.340+0000 7fbb63fff640 1 -- 172.21.15.114:0/217262641 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 687313974 0 0) 0x7fbb6c15bc30 con 0x7fbb6c0ca280 2023-11-04T01:37:48.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.340+0000 7fbb71e19640 1 -- 172.21.15.114:0/217262641 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6c0c9820 con 0x7fbb6c06ce00 2023-11-04T01:37:48.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.340+0000 7fbb71618640 1 --2- 172.21.15.114:0/217262641 >> v2:172.21.15.141:3300/0 conn(0x7fbb6c15aa30 0x7fbb6c0c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:48.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.341+0000 7fbb71e19640 1 --2- 172.21.15.114:0/217262641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c06ce00 0x7fbb6c0b07f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0cc780 tx=0x7fbb6402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da25a9e654e0fd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:48.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.341+0000 7fbb63fff640 1 -- 172.21.15.114:0/217262641 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6402cb20 con 0x7fbb6c06ce00 2023-11-04T01:37:48.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.341+0000 7fbb63fff640 1 -- 172.21.15.114:0/217262641 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6402cc80 con 0x7fbb6c06ce00 2023-11-04T01:37:48.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.341+0000 7fbb63fff640 1 -- 172.21.15.114:0/217262641 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb640343f0 con 0x7fbb6c06ce00 2023-11-04T01:37:48.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.341+0000 7fbb7387c640 1 -- 172.21.15.114:0/217262641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c06ce00 msgr2=0x7fbb6c0b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.341+0000 7fbb7387c640 1 --2- 172.21.15.114:0/217262641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c06ce00 0x7fbb6c0b07f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0cc780 tx=0x7fbb6402bf80 comp rx=0 tx=0).stop 2023-11-04T01:37:48.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.341+0000 7fbb7387c640 1 -- 172.21.15.114:0/217262641 shutdown_connections 2023-11-04T01:37:48.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.341+0000 7fbb7387c640 1 --2- 172.21.15.114:0/217262641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c06ce00 0x7fbb6c0b07f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.341+0000 7fbb7387c640 1 --2- 172.21.15.114:0/217262641 >> v2:172.21.15.141:3300/0 conn(0x7fbb6c15aa30 0x7fbb6c0c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.342+0000 7fbb7387c640 1 -- 172.21.15.114:0/217262641 >> 172.21.15.114:0/217262641 conn(0x7fbb6c0cb7f0 msgr2=0x7fbb6c0cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:48.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.342+0000 7fbb7387c640 1 -- 172.21.15.114:0/217262641 shutdown_connections 2023-11-04T01:37:48.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.342+0000 7fbb7387c640 1 -- 172.21.15.114:0/217262641 wait complete. 2023-11-04T01:37:48.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.343+0000 7fbb7387c640 1 Processor -- start 2023-11-04T01:37:48.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.343+0000 7fbb7387c640 1 -- start start 2023-11-04T01:37:48.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.343+0000 7fbb7387c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c15aa30 0x7fbb6c158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.343+0000 7fbb7387c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb6c06dad0 0x7fbb6c156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.343+0000 7fbb7387c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb6c06df30 0x7fbb6c1f1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.343+0000 7fbb7387c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c152920 con 0x7fbb6c15aa30 2023-11-04T01:37:48.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.343+0000 7fbb7387c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c158560 con 0x7fbb6c06df30 2023-11-04T01:37:48.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.343+0000 7fbb7387c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c0cd940 con 0x7fbb6c06dad0 2023-11-04T01:37:48.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.343+0000 7fbb71618640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c15aa30 0x7fbb6c158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.344+0000 7fbb71618640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c15aa30 0x7fbb6c158020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51092/0 (socket says 172.21.15.114:51092) 2023-11-04T01:37:48.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.344+0000 7fbb71618640 1 -- 172.21.15.114:0/3166623061 learned_addr learned my addr 172.21.15.114:0/3166623061 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:48.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.344+0000 7fbb70e17640 1 --2- 172.21.15.114:0/3166623061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb6c06dad0 0x7fbb6c156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.344+0000 7fbb71e19640 1 --2- 172.21.15.114:0/3166623061 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb6c06df30 0x7fbb6c1f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.344+0000 7fbb71618640 1 -- 172.21.15.114:0/3166623061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb6c06dad0 msgr2=0x7fbb6c156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.344+0000 7fbb71618640 1 --2- 172.21.15.114:0/3166623061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb6c06dad0 0x7fbb6c156600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.344+0000 7fbb71618640 1 -- 172.21.15.114:0/3166623061 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb6c06df30 msgr2=0x7fbb6c1f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.344+0000 7fbb71618640 1 --2- 172.21.15.114:0/3166623061 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb6c06df30 0x7fbb6c1f1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.344+0000 7fbb71618640 1 -- 172.21.15.114:0/3166623061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb64009b30 con 0x7fbb6c15aa30 2023-11-04T01:37:48.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.344+0000 7fbb71618640 1 --2- 172.21.15.114:0/3166623061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c15aa30 0x7fbb6c158020 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800c820 tx=0x7fbb6800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:48.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.344+0000 7fbb61ffb640 1 -- 172.21.15.114:0/3166623061 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb68007a30 con 0x7fbb6c15aa30 2023-11-04T01:37:48.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.344+0000 7fbb61ffb640 1 -- 172.21.15.114:0/3166623061 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb68007b90 con 0x7fbb6c15aa30 2023-11-04T01:37:48.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.344+0000 7fbb61ffb640 1 -- 172.21.15.114:0/3166623061 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6800ce10 con 0x7fbb6c15aa30 2023-11-04T01:37:48.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.344+0000 7fbb7387c640 1 -- 172.21.15.114:0/3166623061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6c1519c0 con 0x7fbb6c15aa30 2023-11-04T01:37:48.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.344+0000 7fbb7387c640 1 -- 172.21.15.114:0/3166623061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6c151f80 con 0x7fbb6c15aa30 2023-11-04T01:37:48.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.345+0000 7fbb7387c640 1 -- 172.21.15.114:0/3166623061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6c074290 con 0x7fbb6c15aa30 2023-11-04T01:37:48.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.346+0000 7fbb61ffb640 1 -- 172.21.15.114:0/3166623061 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbb680113f0 con 0x7fbb6c15aa30 2023-11-04T01:37:48.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.346+0000 7fbb61ffb640 1 --2- 172.21.15.114:0/3166623061 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbb5006ae70 0x7fbb5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.346+0000 7fbb61ffb640 1 -- 172.21.15.114:0/3166623061 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fbb68089520 con 0x7fbb6c15aa30 2023-11-04T01:37:48.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.346+0000 7fbb70e17640 1 --2- 172.21.15.114:0/3166623061 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbb5006ae70 0x7fbb5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.347+0000 7fbb70e17640 1 --2- 172.21.15.114:0/3166623061 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbb5006ae70 0x7fbb5006d330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c000f60 tx=0x7fbb5c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:48.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.350+0000 7fbb61ffb640 1 -- 172.21.15.114:0/3166623061 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbb680547e0 con 0x7fbb6c15aa30 2023-11-04T01:37:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.518+0000 7fbb7387c640 1 -- 172.21.15.114:0/3166623061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbb6c0ca760 con 0x7fbb6c15aa30 2023-11-04T01:37:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.518+0000 7fbb61ffb640 1 -- 172.21.15.114:0/3166623061 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+65 (secure 0 0 0) 0x7fbb68057e00 con 0x7fbb6c15aa30 2023-11-04T01:37:48.521 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:48.521 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2023-11-04T01:37:48.521 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:37:48.521 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2023-11-04T01:37:48.521 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2023-11-04T01:37:48.521 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:48.522 INFO:teuthology.orchestra.run.smithi114.stdout:] 2023-11-04T01:37:48.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.520+0000 7fbb7387c640 1 -- 172.21.15.114:0/3166623061 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbb5006ae70 msgr2=0x7fbb5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.520+0000 7fbb7387c640 1 --2- 172.21.15.114:0/3166623061 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbb5006ae70 0x7fbb5006d330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c000f60 tx=0x7fbb5c009040 comp rx=0 tx=0).stop 2023-11-04T01:37:48.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.520+0000 7fbb7387c640 1 -- 172.21.15.114:0/3166623061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c15aa30 msgr2=0x7fbb6c158020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.520+0000 7fbb7387c640 1 --2- 172.21.15.114:0/3166623061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c15aa30 0x7fbb6c158020 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800c820 tx=0x7fbb6800cce0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.520+0000 7fbb7387c640 1 -- 172.21.15.114:0/3166623061 shutdown_connections 2023-11-04T01:37:48.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.520+0000 7fbb7387c640 1 --2- 172.21.15.114:0/3166623061 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbb5006ae70 0x7fbb5006d330 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.520+0000 7fbb7387c640 1 --2- 172.21.15.114:0/3166623061 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbb6c06df30 0x7fbb6c1f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.520+0000 7fbb7387c640 1 --2- 172.21.15.114:0/3166623061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbb6c06dad0 0x7fbb6c156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.520+0000 7fbb7387c640 1 --2- 172.21.15.114:0/3166623061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb6c15aa30 0x7fbb6c158020 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.520+0000 7fbb7387c640 1 -- 172.21.15.114:0/3166623061 >> 172.21.15.114:0/3166623061 conn(0x7fbb6c0cb7f0 msgr2=0x7fbb6c0cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:48.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.520+0000 7fbb7387c640 1 -- 172.21.15.114:0/3166623061 shutdown_connections 2023-11-04T01:37:48.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.520+0000 7fbb7387c640 1 -- 172.21.15.114:0/3166623061 wait complete. 2023-11-04T01:37:48.534 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:37:48.534 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:37:48.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.636+0000 7f637ea4f640 1 Processor -- start 2023-11-04T01:37:48.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.636+0000 7f637ea4f640 1 -- start start 2023-11-04T01:37:48.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.637+0000 7f637ea4f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f637806dd50 0x7f6378165bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.637+0000 7f637ea4f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637815c0d0 con 0x7f637815f510 2023-11-04T01:37:48.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.637+0000 7f637ea4f640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637806cf90 con 0x7f6378151ea0 2023-11-04T01:37:48.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.637+0000 7f637ea4f640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637806d270 con 0x7f637806dd50 2023-11-04T01:37:48.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.637+0000 7f63777fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f637815f510 0x7f63780cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60582/0 (socket says 172.21.15.114:60582) 2023-11-04T01:37:48.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.637+0000 7f63777fe640 1 -- 172.21.15.114:0/3153761003 learned_addr learned my addr 172.21.15.114:0/3153761003 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:48.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.637+0000 7f637cfec640 1 --2- 172.21.15.114:0/3153761003 >> v2:172.21.15.141:3300/0 conn(0x7f637806dd50 0x7f6378165bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6376ffd640 1 -- 172.21.15.114:0/3153761003 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991901124 0 0) 0x7f637815c0d0 con 0x7f637815f510 2023-11-04T01:37:48.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6376ffd640 1 -- 172.21.15.114:0/3153761003 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6360003520 con 0x7f637815f510 2023-11-04T01:37:48.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6376ffd640 1 -- 172.21.15.114:0/3153761003 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3309827931 0 0) 0x7f6360003520 con 0x7f637815f510 2023-11-04T01:37:48.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6376ffd640 1 -- 172.21.15.114:0/3153761003 >> v2:172.21.15.141:3300/0 conn(0x7f637806dd50 msgr2=0x7f6378165bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:48.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6376ffd640 1 --2- 172.21.15.114:0/3153761003 >> v2:172.21.15.141:3300/0 conn(0x7f637806dd50 0x7f6378165bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6376ffd640 1 -- 172.21.15.114:0/3153761003 >> v1:172.21.15.141:6789/0 conn(0x7f6378151ea0 legacy=0x7f637815b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6376ffd640 1 -- 172.21.15.114:0/3153761003 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637806d550 con 0x7f637815f510 2023-11-04T01:37:48.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6376ffd640 1 -- 172.21.15.114:0/3153761003 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f636c001670 con 0x7f637815f510 2023-11-04T01:37:48.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6376ffd640 1 -- 172.21.15.114:0/3153761003 >> v1:172.21.15.114:6789/0 conn(0x7f637815f510 legacy=0x7f63780cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6376ffd640 1 --2- 172.21.15.114:0/3153761003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6360003970 0x7f6360003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6376ffd640 1 --2- 172.21.15.114:0/3153761003 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63600047c0 0x7f6360004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6376ffd640 1 --2- 172.21.15.114:0/3153761003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6360005180 0x7f636000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6376ffd640 1 -- 172.21.15.114:0/3153761003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637806d270 con 0x7f6360003970 2023-11-04T01:37:48.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6376ffd640 1 -- 172.21.15.114:0/3153761003 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636000c020 con 0x7f63600047c0 2023-11-04T01:37:48.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6376ffd640 1 -- 172.21.15.114:0/3153761003 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636000c1e0 con 0x7f6360005180 2023-11-04T01:37:48.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6377fff640 1 --2- 172.21.15.114:0/3153761003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6360003970 0x7f6360003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f63777fe640 1 --2- 172.21.15.114:0/3153761003 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63600047c0 0x7f6360004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f637cfec640 1 --2- 172.21.15.114:0/3153761003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6360005180 0x7f636000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6377fff640 1 -- 172.21.15.114:0/3153761003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6360005180 msgr2=0x7f636000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:48.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6377fff640 1 --2- 172.21.15.114:0/3153761003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6360005180 0x7f636000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6377fff640 1 -- 172.21.15.114:0/3153761003 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63600047c0 msgr2=0x7f6360004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:48.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6377fff640 1 --2- 172.21.15.114:0/3153761003 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63600047c0 0x7f6360004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f6377fff640 1 -- 172.21.15.114:0/3153761003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6360003520 con 0x7f6360003970 2023-11-04T01:37:48.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f637cfec640 1 --2- 172.21.15.114:0/3153761003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6360005180 0x7f636000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:48.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f63777fe640 1 --2- 172.21.15.114:0/3153761003 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63600047c0 0x7f6360004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:48.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.638+0000 7f637cfec640 1 -- 172.21.15.114:0/3153761003 reap_dead start 2023-11-04T01:37:48.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.639+0000 7f6377fff640 1 --2- 172.21.15.114:0/3153761003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6360003970 0x7f6360003d90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6368001750 tx=0x7f63600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636c0f0208ec0ace server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:48.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.639+0000 7f6376ffd640 1 -- 172.21.15.114:0/3153761003 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63680052d0 con 0x7f6360003970 2023-11-04T01:37:48.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.639+0000 7f6376ffd640 1 -- 172.21.15.114:0/3153761003 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636802e050 con 0x7f6360003970 2023-11-04T01:37:48.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.639+0000 7f6376ffd640 1 -- 172.21.15.114:0/3153761003 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6368003830 con 0x7f6360003970 2023-11-04T01:37:48.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.640+0000 7f637ea4f640 1 -- 172.21.15.114:0/3153761003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6360003970 msgr2=0x7f6360003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.640+0000 7f637ea4f640 1 --2- 172.21.15.114:0/3153761003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6360003970 0x7f6360003d90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6368001750 tx=0x7f63600057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.640+0000 7f637ea4f640 1 -- 172.21.15.114:0/3153761003 shutdown_connections 2023-11-04T01:37:48.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.640+0000 7f637ea4f640 1 --2- 172.21.15.114:0/3153761003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6360003970 0x7f6360003d90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.640+0000 7f637ea4f640 1 -- 172.21.15.114:0/3153761003 >> 172.21.15.114:0/3153761003 conn(0x7f63780b05d0 msgr2=0x7f63780b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:48.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.640+0000 7f637ea4f640 1 -- 172.21.15.114:0/3153761003 shutdown_connections 2023-11-04T01:37:48.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.640+0000 7f637ea4f640 1 -- 172.21.15.114:0/3153761003 wait complete. 2023-11-04T01:37:48.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.641+0000 7f637ea4f640 1 Processor -- start 2023-11-04T01:37:48.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.641+0000 7f637ea4f640 1 -- start start 2023-11-04T01:37:48.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f637ea4f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6360003970 0x7f63780c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f637ea4f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63781f3f10 0x7f63781f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f637ea4f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6378138220 0x7f63781386a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f637ea4f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63781f48b0 con 0x7f6378138220 2023-11-04T01:37:48.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f637ea4f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63780c6ad0 con 0x7f63781f3f10 2023-11-04T01:37:48.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f637ea4f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63780c5ec0 con 0x7f6360003970 2023-11-04T01:37:48.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f637cfec640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6378138220 0x7f63781386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f637cfec640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6378138220 0x7f63781386a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51114/0 (socket says 172.21.15.114:51114) 2023-11-04T01:37:48.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f637cfec640 1 -- 172.21.15.114:0/356702014 learned_addr learned my addr 172.21.15.114:0/356702014 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:48.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f6377fff640 1 --2- 172.21.15.114:0/356702014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6360003970 0x7f63780c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f63777fe640 1 --2- 172.21.15.114:0/356702014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63781f3f10 0x7f63781f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f637cfec640 1 -- 172.21.15.114:0/356702014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6360003970 msgr2=0x7f63780c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f637cfec640 1 --2- 172.21.15.114:0/356702014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6360003970 0x7f63780c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f637cfec640 1 -- 172.21.15.114:0/356702014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63781f3f10 msgr2=0x7f63781f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:48.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f637cfec640 1 --2- 172.21.15.114:0/356702014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63781f3f10 0x7f63781f4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:48.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f637cfec640 1 -- 172.21.15.114:0/356702014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63780c61a0 con 0x7f6378138220 2023-11-04T01:37:48.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f63777fe640 1 --2- 172.21.15.114:0/356702014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63781f3f10 0x7f63781f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:48.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f6377fff640 1 --2- 172.21.15.114:0/356702014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6360003970 0x7f63780c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:48.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f637cfec640 1 --2- 172.21.15.114:0/356702014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6378138220 0x7f63781386a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f63780cc8e0 tx=0x7f637000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:48.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f6374ff9640 1 -- 172.21.15.114:0/356702014 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6370016620 con 0x7f6378138220 2023-11-04T01:37:48.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f6374ff9640 1 -- 172.21.15.114:0/356702014 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6370016780 con 0x7f6378138220 2023-11-04T01:37:48.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f637ea4f640 1 -- 172.21.15.114:0/356702014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63780c6480 con 0x7f6378138220 2023-11-04T01:37:48.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.642+0000 7f6374ff9640 1 -- 172.21.15.114:0/356702014 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6370016af0 con 0x7f6378138220 2023-11-04T01:37:48.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.643+0000 7f637ea4f640 1 -- 172.21.15.114:0/356702014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63781f4d60 con 0x7f6378138220 2023-11-04T01:37:48.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.643+0000 7f637ea4f640 1 -- 172.21.15.114:0/356702014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f637804e490 con 0x7f6378138220 2023-11-04T01:37:48.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.645+0000 7f6374ff9640 1 -- 172.21.15.114:0/356702014 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6370016c50 con 0x7f6378138220 2023-11-04T01:37:48.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.646+0000 7f6374ff9640 1 --2- 172.21.15.114:0/356702014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f636406ae70 0x7f636406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:48.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.646+0000 7f6374ff9640 1 -- 172.21.15.114:0/356702014 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f637008ac20 con 0x7f6378138220 2023-11-04T01:37:48.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.646+0000 7f6377fff640 1 --2- 172.21.15.114:0/356702014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f636406ae70 0x7f636406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:48.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.646+0000 7f6377fff640 1 --2- 172.21.15.114:0/356702014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f636406ae70 0x7f636406d330 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6368033000 tx=0x7f6368009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:48.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.649+0000 7f6374ff9640 1 -- 172.21.15.114:0/356702014 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6370055ec0 con 0x7f6378138220 2023-11-04T01:37:48.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:48.814+0000 7f637ea4f640 1 -- 172.21.15.114:0/356702014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f63780cc910 con 0x7f6378138220 2023-11-04T01:37:49.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.644+0000 7f6374ff9640 1 -- 172.21.15.114:0/356702014 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f63700594e0 con 0x7f6378138220 2023-11-04T01:37:49.647 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2023-11-04T01:37:49.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.647+0000 7f637ea4f640 1 -- 172.21.15.114:0/356702014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f636406ae70 msgr2=0x7f636406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.647+0000 7f637ea4f640 1 --2- 172.21.15.114:0/356702014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f636406ae70 0x7f636406d330 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6368033000 tx=0x7f6368009030 comp rx=0 tx=0).stop 2023-11-04T01:37:49.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.647+0000 7f637ea4f640 1 -- 172.21.15.114:0/356702014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6378138220 msgr2=0x7f63781386a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.647+0000 7f637ea4f640 1 --2- 172.21.15.114:0/356702014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6378138220 0x7f63781386a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f63780cc8e0 tx=0x7f637000f520 comp rx=0 tx=0).stop 2023-11-04T01:37:49.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.647+0000 7f637ea4f640 1 -- 172.21.15.114:0/356702014 shutdown_connections 2023-11-04T01:37:49.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.647+0000 7f637ea4f640 1 --2- 172.21.15.114:0/356702014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6378138220 0x7f63781386a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.647+0000 7f637ea4f640 1 --2- 172.21.15.114:0/356702014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f636406ae70 0x7f636406d330 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.647+0000 7f637ea4f640 1 --2- 172.21.15.114:0/356702014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63781f3f10 0x7f63781f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.647+0000 7f637ea4f640 1 --2- 172.21.15.114:0/356702014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6360003970 0x7f63780c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.647+0000 7f637ea4f640 1 -- 172.21.15.114:0/356702014 >> 172.21.15.114:0/356702014 conn(0x7f63780b05d0 msgr2=0x7f63780b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:49.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.648+0000 7f637ea4f640 1 -- 172.21.15.114:0/356702014 shutdown_connections 2023-11-04T01:37:49.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.648+0000 7f637ea4f640 1 -- 172.21.15.114:0/356702014 wait complete. 2023-11-04T01:37:49.665 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:37:49.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.772+0000 7f8cad3b6640 1 Processor -- start 2023-11-04T01:37:49.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.772+0000 7f8cad3b6640 1 -- start start 2023-11-04T01:37:49.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.773+0000 7f8cad3b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ca8153e60 0x7f8ca815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.773+0000 7f8cad3b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8ca80cd6d0 0x7f8ca8161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.773+0000 7f8cad3b6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca80cde60 con 0x7f8ca80b4880 2023-11-04T01:37:49.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.773+0000 7f8cad3b6640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca8160f90 con 0x7f8ca80cd6d0 2023-11-04T01:37:49.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.773+0000 7f8cad3b6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca815e400 con 0x7f8ca8153e60 2023-11-04T01:37:49.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.773+0000 7f8c9ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8ca80cd6d0 0x7f8ca8161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.773+0000 7f8ca77fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8ca80b4880 0x7f8ca806b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60592/0 (socket says 172.21.15.114:60592) 2023-11-04T01:37:49.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.773+0000 7f8ca77fe640 1 -- 172.21.15.114:0/386034562 learned_addr learned my addr 172.21.15.114:0/386034562 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:49.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.773+0000 7f8ca6ffd640 1 --2- 172.21.15.114:0/386034562 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ca8153e60 0x7f8ca815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.773+0000 7f8c9ffff640 1 -- 172.21.15.114:0/386034562 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ca8153e60 msgr2=0x7f8ca815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:49.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.773+0000 7f8c9ffff640 1 --2- 172.21.15.114:0/386034562 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ca8153e60 0x7f8ca815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.773+0000 7f8c9ffff640 1 -- 172.21.15.114:0/386034562 >> v1:172.21.15.114:6789/0 conn(0x7f8ca80b4880 legacy=0x7f8ca806b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.773+0000 7f8ca67fc640 1 -- 172.21.15.114:0/386034562 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428437112 0 0) 0x7f8ca80cde60 con 0x7f8ca80b4880 2023-11-04T01:37:49.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.773+0000 7f8c9ffff640 1 -- 172.21.15.114:0/386034562 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca8161960 con 0x7f8ca80cd6d0 2023-11-04T01:37:49.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.774+0000 7f8c9ffff640 1 --2- 172.21.15.114:0/386034562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca80cd6d0 0x7f8ca8161420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8c900097a0 tx=0x7f8c9002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91daf1c933062041 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:49.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.774+0000 7f8ca67fc640 1 -- 172.21.15.114:0/386034562 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90031830 con 0x7f8ca80cd6d0 2023-11-04T01:37:49.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.774+0000 7f8ca67fc640 1 -- 172.21.15.114:0/386034562 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c90031990 con 0x7f8ca80cd6d0 2023-11-04T01:37:49.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.774+0000 7f8ca67fc640 1 -- 172.21.15.114:0/386034562 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90031d20 con 0x7f8ca80cd6d0 2023-11-04T01:37:49.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.775+0000 7f8cad3b6640 1 -- 172.21.15.114:0/386034562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca80cd6d0 msgr2=0x7f8ca8161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.775+0000 7f8cad3b6640 1 --2- 172.21.15.114:0/386034562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca80cd6d0 0x7f8ca8161420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8c900097a0 tx=0x7f8c9002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.775+0000 7f8cad3b6640 1 -- 172.21.15.114:0/386034562 shutdown_connections 2023-11-04T01:37:49.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.775+0000 7f8cad3b6640 1 --2- 172.21.15.114:0/386034562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca80cd6d0 0x7f8ca8161420 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.775+0000 7f8cad3b6640 1 --2- 172.21.15.114:0/386034562 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ca8153e60 0x7f8ca815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.775+0000 7f8cad3b6640 1 -- 172.21.15.114:0/386034562 >> 172.21.15.114:0/386034562 conn(0x7f8ca80cf880 msgr2=0x7f8ca80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:49.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.775+0000 7f8cad3b6640 1 -- 172.21.15.114:0/386034562 shutdown_connections 2023-11-04T01:37:49.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.775+0000 7f8cad3b6640 1 -- 172.21.15.114:0/386034562 wait complete. 2023-11-04T01:37:49.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.776+0000 7f8cad3b6640 1 Processor -- start 2023-11-04T01:37:49.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.776+0000 7f8cad3b6640 1 -- start start 2023-11-04T01:37:49.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8cad3b6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca80b4880 0x7f8ca8148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8cad3b6640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ca80cd6d0 0x7f8ca8155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8cad3b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ca8153e60 0x7f8ca8156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8cad3b6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca81487a0 con 0x7f8ca80b4880 2023-11-04T01:37:49.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8cad3b6640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca8154240 con 0x7f8ca80cd6d0 2023-11-04T01:37:49.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8cad3b6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca8154490 con 0x7f8ca8153e60 2023-11-04T01:37:49.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8ca6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca80b4880 0x7f8ca8148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8ca6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca80b4880 0x7f8ca8148260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51132/0 (socket says 172.21.15.114:51132) 2023-11-04T01:37:49.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8ca6ffd640 1 -- 172.21.15.114:0/3957432720 learned_addr learned my addr 172.21.15.114:0/3957432720 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:49.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8ca6ffd640 1 -- 172.21.15.114:0/3957432720 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ca8153e60 msgr2=0x7f8ca8156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8ca6ffd640 1 --2- 172.21.15.114:0/3957432720 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ca8153e60 0x7f8ca8156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8ca6ffd640 1 -- 172.21.15.114:0/3957432720 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ca80cd6d0 msgr2=0x7f8ca8155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:49.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8c9ffff640 1 --2- 172.21.15.114:0/3957432720 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ca80cd6d0 0x7f8ca8155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8ca6ffd640 1 --2- 172.21.15.114:0/3957432720 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ca80cd6d0 0x7f8ca8155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:49.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8ca6ffd640 1 -- 172.21.15.114:0/3957432720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c90009400 con 0x7f8ca80b4880 2023-11-04T01:37:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8c9ffff640 1 --2- 172.21.15.114:0/3957432720 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ca80cd6d0 0x7f8ca8155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8ca6ffd640 1 --2- 172.21.15.114:0/3957432720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca80b4880 0x7f8ca8148260 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800d5f0 tx=0x7f8c9800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8c9f7fe640 1 -- 172.21.15.114:0/3957432720 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c980125f0 con 0x7f8ca80b4880 2023-11-04T01:37:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8c9f7fe640 1 -- 172.21.15.114:0/3957432720 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c98012750 con 0x7f8ca80b4880 2023-11-04T01:37:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8cad3b6640 1 -- 172.21.15.114:0/3957432720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca8154770 con 0x7f8ca80b4880 2023-11-04T01:37:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8c9f7fe640 1 -- 172.21.15.114:0/3957432720 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c98012b00 con 0x7f8ca80b4880 2023-11-04T01:37:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.777+0000 7f8cad3b6640 1 -- 172.21.15.114:0/3957432720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca8154d30 con 0x7f8ca80b4880 2023-11-04T01:37:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.778+0000 7f8cad3b6640 1 -- 172.21.15.114:0/3957432720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca8074290 con 0x7f8ca80b4880 2023-11-04T01:37:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.779+0000 7f8c9f7fe640 1 -- 172.21.15.114:0/3957432720 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c98012c60 con 0x7f8ca80b4880 2023-11-04T01:37:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.779+0000 7f8c9f7fe640 1 --2- 172.21.15.114:0/3957432720 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c8806ae70 0x7f8c8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.779+0000 7f8c9ffff640 1 --2- 172.21.15.114:0/3957432720 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c8806ae70 0x7f8c8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:49.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.779+0000 7f8c9f7fe640 1 -- 172.21.15.114:0/3957432720 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f8c980899e0 con 0x7f8ca80b4880 2023-11-04T01:37:49.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.780+0000 7f8c9ffff640 1 --2- 172.21.15.114:0/3957432720 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c8806ae70 0x7f8c8806d330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8c90036000 tx=0x7f8c90008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:49.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.784+0000 7f8c9f7fe640 1 -- 172.21.15.114:0/3957432720 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8c98054bc0 con 0x7f8ca80b4880 2023-11-04T01:37:49.821 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:37:49.823 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:37:49.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:49.956+0000 7f8cad3b6640 1 -- 172.21.15.114:0/3957432720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8ca80d0b80 con 0x7f8ca80b4880 2023-11-04T01:37:50.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.650+0000 7f8c9f7fe640 1 -- 172.21.15.114:0/3957432720 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8c980581e0 con 0x7f8ca80b4880 2023-11-04T01:37:50.652 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2023-11-04T01:37:50.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.652+0000 7f8cad3b6640 1 -- 172.21.15.114:0/3957432720 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c8806ae70 msgr2=0x7f8c8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.652+0000 7f8cad3b6640 1 --2- 172.21.15.114:0/3957432720 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c8806ae70 0x7f8c8806d330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8c90036000 tx=0x7f8c90008030 comp rx=0 tx=0).stop 2023-11-04T01:37:50.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.653+0000 7f8cad3b6640 1 -- 172.21.15.114:0/3957432720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca80b4880 msgr2=0x7f8ca8148260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.653+0000 7f8cad3b6640 1 --2- 172.21.15.114:0/3957432720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca80b4880 0x7f8ca8148260 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800d5f0 tx=0x7f8c9800dab0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.653+0000 7f8cad3b6640 1 -- 172.21.15.114:0/3957432720 shutdown_connections 2023-11-04T01:37:50.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.653+0000 7f8cad3b6640 1 --2- 172.21.15.114:0/3957432720 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8ca8153e60 0x7f8ca8156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.653+0000 7f8cad3b6640 1 --2- 172.21.15.114:0/3957432720 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c8806ae70 0x7f8c8806d330 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.653+0000 7f8cad3b6640 1 --2- 172.21.15.114:0/3957432720 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8ca80cd6d0 0x7f8ca8155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.653+0000 7f8cad3b6640 1 --2- 172.21.15.114:0/3957432720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca80b4880 0x7f8ca8148260 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.653+0000 7f8cad3b6640 1 -- 172.21.15.114:0/3957432720 >> 172.21.15.114:0/3957432720 conn(0x7f8ca80cf880 msgr2=0x7f8ca815fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:50.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.653+0000 7f8cad3b6640 1 -- 172.21.15.114:0/3957432720 shutdown_connections 2023-11-04T01:37:50.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.653+0000 7f8cad3b6640 1 -- 172.21.15.114:0/3957432720 wait complete. 2023-11-04T01:37:50.675 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:37:50.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.777+0000 7f9e7180e640 1 Processor -- start 2023-11-04T01:37:50.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.777+0000 7f9e7180e640 1 -- start start 2023-11-04T01:37:50.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.778+0000 7f9e7180e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e6c0cd6d0 0x7f9e6c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.778+0000 7f9e7180e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9e6c0b4880 0x7f9e6c0b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.778+0000 7f9e7180e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6c0cde60 con 0x7f9e6c153e60 2023-11-04T01:37:50.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.778+0000 7f9e7180e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6c160f90 con 0x7f9e6c0b4880 2023-11-04T01:37:50.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.778+0000 7f9e7180e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c0b51e0 con 0x7f9e6c0cd6d0 2023-11-04T01:37:50.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.778+0000 7f9e6b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9e6c0b4880 0x7f9e6c0b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.778+0000 7f9e6b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9e6c0b4880 0x7f9e6c0b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51140/0 (socket says 172.21.15.114:51140) 2023-11-04T01:37:50.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.778+0000 7f9e6b7fe640 1 -- 172.21.15.114:0/1201831200 learned_addr learned my addr 172.21.15.114:0/1201831200 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:50.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.778+0000 7f9e6a7fc640 1 --2- 172.21.15.114:0/1201831200 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e6c0cd6d0 0x7f9e6c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.779+0000 7f9e6b7fe640 1 -- 172.21.15.114:0/1201831200 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e6c0cd6d0 msgr2=0x7f9e6c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:50.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.779+0000 7f9e6b7fe640 1 --2- 172.21.15.114:0/1201831200 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e6c0cd6d0 0x7f9e6c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.779+0000 7f9e6b7fe640 1 -- 172.21.15.114:0/1201831200 >> v1:172.21.15.141:6789/0 conn(0x7f9e6c153e60 legacy=0x7f9e6c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.779+0000 7f9e6b7fe640 1 -- 172.21.15.114:0/1201831200 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c161960 con 0x7f9e6c0b4880 2023-11-04T01:37:50.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.779+0000 7f9e6b7fe640 1 --2- 172.21.15.114:0/1201831200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e6c0b4880 0x7f9e6c0b4ca0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009870 tx=0x7f9e6402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64247b721db8b3eb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:50.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.779+0000 7f9e69ffb640 1 -- 172.21.15.114:0/1201831200 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e64030840 con 0x7f9e6c0b4880 2023-11-04T01:37:50.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.780+0000 7f9e69ffb640 1 -- 172.21.15.114:0/1201831200 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e640309a0 con 0x7f9e6c0b4880 2023-11-04T01:37:50.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.780+0000 7f9e69ffb640 1 -- 172.21.15.114:0/1201831200 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e64030d30 con 0x7f9e6c0b4880 2023-11-04T01:37:50.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.780+0000 7f9e7180e640 1 -- 172.21.15.114:0/1201831200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e6c0b4880 msgr2=0x7f9e6c0b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.780+0000 7f9e7180e640 1 --2- 172.21.15.114:0/1201831200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e6c0b4880 0x7f9e6c0b4ca0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009870 tx=0x7f9e6402b980 comp rx=0 tx=0).stop 2023-11-04T01:37:50.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.780+0000 7f9e7180e640 1 -- 172.21.15.114:0/1201831200 shutdown_connections 2023-11-04T01:37:50.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.780+0000 7f9e7180e640 1 --2- 172.21.15.114:0/1201831200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e6c0b4880 0x7f9e6c0b4ca0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.780+0000 7f9e7180e640 1 --2- 172.21.15.114:0/1201831200 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e6c0cd6d0 0x7f9e6c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.780+0000 7f9e7180e640 1 -- 172.21.15.114:0/1201831200 >> 172.21.15.114:0/1201831200 conn(0x7f9e6c0cf880 msgr2=0x7f9e6c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:50.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.780+0000 7f9e7180e640 1 -- 172.21.15.114:0/1201831200 shutdown_connections 2023-11-04T01:37:50.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.780+0000 7f9e7180e640 1 -- 172.21.15.114:0/1201831200 wait complete. 2023-11-04T01:37:50.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.781+0000 7f9e7180e640 1 Processor -- start 2023-11-04T01:37:50.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.781+0000 7f9e7180e640 1 -- start start 2023-11-04T01:37:50.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.782+0000 7f9e7180e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9e6c0b4880 0x7f9e6c0cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.782+0000 7f9e7180e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e6c0cd6d0 0x7f9e6c0cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.782+0000 7f9e7180e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e6c153e60 0x7f9e6c144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.782+0000 7f9e7180e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c0c6200 con 0x7f9e6c0cd6d0 2023-11-04T01:37:50.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.782+0000 7f9e7180e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c0cc2e0 con 0x7f9e6c0b4880 2023-11-04T01:37:50.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.782+0000 7f9e7180e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c0cd0e0 con 0x7f9e6c153e60 2023-11-04T01:37:50.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.782+0000 7f9e6a7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e6c0cd6d0 0x7f9e6c0cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.782+0000 7f9e6a7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e6c0cd6d0 0x7f9e6c0cbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51154/0 (socket says 172.21.15.114:51154) 2023-11-04T01:37:50.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.782+0000 7f9e6a7fc640 1 -- 172.21.15.114:0/1216359401 learned_addr learned my addr 172.21.15.114:0/1216359401 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:50.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.782+0000 7f9e6b7fe640 1 --2- 172.21.15.114:0/1216359401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e6c153e60 0x7f9e6c144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.782+0000 7f9e6affd640 1 --2- 172.21.15.114:0/1216359401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9e6c0b4880 0x7f9e6c0cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.783+0000 7f9e6a7fc640 1 -- 172.21.15.114:0/1216359401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e6c153e60 msgr2=0x7f9e6c144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.783+0000 7f9e6a7fc640 1 --2- 172.21.15.114:0/1216359401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e6c153e60 0x7f9e6c144a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.783+0000 7f9e6a7fc640 1 -- 172.21.15.114:0/1216359401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9e6c0b4880 msgr2=0x7f9e6c0cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:50.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.783+0000 7f9e6a7fc640 1 --2- 172.21.15.114:0/1216359401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9e6c0b4880 0x7f9e6c0cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:50.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.783+0000 7f9e6a7fc640 1 -- 172.21.15.114:0/1216359401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e640094d0 con 0x7f9e6c0cd6d0 2023-11-04T01:37:50.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.783+0000 7f9e6a7fc640 1 --2- 172.21.15.114:0/1216359401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e6c0cd6d0 0x7f9e6c0cbda0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000d800 tx=0x7f9e6000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:50.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.783+0000 7f9e53fff640 1 -- 172.21.15.114:0/1216359401 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6000b6c0 con 0x7f9e6c0cd6d0 2023-11-04T01:37:50.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.783+0000 7f9e53fff640 1 -- 172.21.15.114:0/1216359401 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6000b840 con 0x7f9e6c0cd6d0 2023-11-04T01:37:50.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.783+0000 7f9e7180e640 1 -- 172.21.15.114:0/1216359401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6c0c9790 con 0x7f9e6c0cd6d0 2023-11-04T01:37:50.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.783+0000 7f9e53fff640 1 -- 172.21.15.114:0/1216359401 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6000bbf0 con 0x7f9e6c0cd6d0 2023-11-04T01:37:50.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.783+0000 7f9e7180e640 1 -- 172.21.15.114:0/1216359401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6c0cca90 con 0x7f9e6c0cd6d0 2023-11-04T01:37:50.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.784+0000 7f9e7180e640 1 -- 172.21.15.114:0/1216359401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e6c074290 con 0x7f9e6c0cd6d0 2023-11-04T01:37:50.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.784+0000 7f9e53fff640 1 -- 172.21.15.114:0/1216359401 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e6000bd50 con 0x7f9e6c0cd6d0 2023-11-04T01:37:50.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.785+0000 7f9e53fff640 1 --2- 172.21.15.114:0/1216359401 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9e5806ae70 0x7f9e5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:50.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.785+0000 7f9e6affd640 1 --2- 172.21.15.114:0/1216359401 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9e5806ae70 0x7f9e5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:50.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.785+0000 7f9e53fff640 1 -- 172.21.15.114:0/1216359401 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f9e60089b70 con 0x7f9e6c0cd6d0 2023-11-04T01:37:50.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.785+0000 7f9e6affd640 1 --2- 172.21.15.114:0/1216359401 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9e5806ae70 0x7f9e5806d330 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c161160 tx=0x7f9e5c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:50.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.789+0000 7f9e53fff640 1 -- 172.21.15.114:0/1216359401 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9e60054bf0 con 0x7f9e6c0cd6d0 2023-11-04T01:37:50.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:50.992+0000 7f9e7180e640 1 -- 172.21.15.114:0/1216359401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9e6c0cd220 con 0x7f9e6c0cd6d0 2023-11-04T01:37:51.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.667+0000 7f9e53fff640 1 -- 172.21.15.114:0/1216359401 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9e60058210 con 0x7f9e6c0cd6d0 2023-11-04T01:37:51.669 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 5 and data pool 6 2023-11-04T01:37:51.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.674+0000 7f9e7180e640 1 -- 172.21.15.114:0/1216359401 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9e5806ae70 msgr2=0x7f9e5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.674+0000 7f9e7180e640 1 --2- 172.21.15.114:0/1216359401 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9e5806ae70 0x7f9e5806d330 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c161160 tx=0x7f9e5c009040 comp rx=0 tx=0).stop 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.674+0000 7f9e7180e640 1 -- 172.21.15.114:0/1216359401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e6c0cd6d0 msgr2=0x7f9e6c0cbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.674+0000 7f9e7180e640 1 --2- 172.21.15.114:0/1216359401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e6c0cd6d0 0x7f9e6c0cbda0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000d800 tx=0x7f9e6000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.675+0000 7f9e7180e640 1 -- 172.21.15.114:0/1216359401 shutdown_connections 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.675+0000 7f9e7180e640 1 --2- 172.21.15.114:0/1216359401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9e6c153e60 0x7f9e6c144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.675+0000 7f9e7180e640 1 --2- 172.21.15.114:0/1216359401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e6c0cd6d0 0x7f9e6c0cbda0 secure :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000d800 tx=0x7f9e6000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.675+0000 7f9e7180e640 1 --2- 172.21.15.114:0/1216359401 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9e5806ae70 0x7f9e5806d330 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.675+0000 7f9e7180e640 1 --2- 172.21.15.114:0/1216359401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9e6c0b4880 0x7f9e6c0cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.675+0000 7f9e7180e640 1 -- 172.21.15.114:0/1216359401 >> 172.21.15.114:0/1216359401 conn(0x7f9e6c0cf880 msgr2=0x7f9e6c0b5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:51.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.675+0000 7f9e7180e640 1 -- 172.21.15.114:0/1216359401 shutdown_connections 2023-11-04T01:37:51.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.675+0000 7f9e7180e640 1 -- 172.21.15.114:0/1216359401 wait complete. 2023-11-04T01:37:51.694 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:51.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.795+0000 7f521200e640 1 Processor -- start 2023-11-04T01:37:51.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.795+0000 7f521200e640 1 -- start start 2023-11-04T01:37:51.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.796+0000 7f521200e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f520c0aec80 0x7f520c0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.796+0000 7f521200e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f520c0af060 0x7f520c06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.796+0000 7f521200e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c0b1590 con 0x7f520c06ef40 2023-11-04T01:37:51.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.796+0000 7f521200e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c155a40 con 0x7f520c0aec80 2023-11-04T01:37:51.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.796+0000 7f521200e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c06a660 con 0x7f520c0af060 2023-11-04T01:37:51.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.796+0000 7f520affd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f520c0af060 0x7f520c06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.796+0000 7f520b7fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f520c0aec80 0x7f520c0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.796+0000 7f520b7fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f520c0aec80 0x7f520c0b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:37282/0 (socket says 172.21.15.114:37282) 2023-11-04T01:37:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.796+0000 7f520b7fe640 1 -- 172.21.15.114:0/4264114807 learned_addr learned my addr 172.21.15.114:0/4264114807 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.796+0000 7f520bfff640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f520c06ef40 0x7f520c0cb7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:48168/0 (socket says 172.21.15.114:48168) 2023-11-04T01:37:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.796+0000 7f520affd640 1 -- 172.21.15.114:0/4264114807 >> v2:172.21.15.141:3300/0 conn(0x7f520c0aec80 msgr2=0x7f520c0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.796+0000 7f520affd640 1 --2- 172.21.15.114:0/4264114807 >> v2:172.21.15.141:3300/0 conn(0x7f520c0aec80 0x7f520c0b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.796+0000 7f520affd640 1 -- 172.21.15.114:0/4264114807 >> v1:172.21.15.141:6789/0 conn(0x7f520c06ef40 legacy=0x7f520c0cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.796+0000 7f520affd640 1 -- 172.21.15.114:0/4264114807 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c06a8e0 con 0x7f520c0af060 2023-11-04T01:37:51.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.796+0000 7f520a7fc640 1 -- 172.21.15.114:0/4264114807 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607131291 0 0) 0x7f520c0b1590 con 0x7f520c06ef40 2023-11-04T01:37:51.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.796+0000 7f520b7fe640 1 --2- 172.21.15.114:0/4264114807 >> v2:172.21.15.141:3300/0 conn(0x7f520c0aec80 0x7f520c0b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:37:51.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.797+0000 7f520affd640 1 --2- 172.21.15.114:0/4264114807 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f520c0af060 0x7f520c06a120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5200009790 tx=0x7f520002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf56ccd859ed6540 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:51.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.797+0000 7f520a7fc640 1 -- 172.21.15.114:0/4264114807 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520002d040 con 0x7f520c0af060 2023-11-04T01:37:51.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.797+0000 7f520a7fc640 1 -- 172.21.15.114:0/4264114807 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5200031810 con 0x7f520c0af060 2023-11-04T01:37:51.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.797+0000 7f520a7fc640 1 -- 172.21.15.114:0/4264114807 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5200031ba0 con 0x7f520c0af060 2023-11-04T01:37:51.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.798+0000 7f521200e640 1 -- 172.21.15.114:0/4264114807 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f520c0af060 msgr2=0x7f520c06a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.798+0000 7f521200e640 1 --2- 172.21.15.114:0/4264114807 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f520c0af060 0x7f520c06a120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5200009790 tx=0x7f520002b8b0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.798+0000 7f521200e640 1 -- 172.21.15.114:0/4264114807 shutdown_connections 2023-11-04T01:37:51.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.798+0000 7f521200e640 1 --2- 172.21.15.114:0/4264114807 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f520c0af060 0x7f520c06a120 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.798+0000 7f521200e640 1 --2- 172.21.15.114:0/4264114807 >> v2:172.21.15.141:3300/0 conn(0x7f520c0aec80 0x7f520c0b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.798+0000 7f521200e640 1 -- 172.21.15.114:0/4264114807 >> 172.21.15.114:0/4264114807 conn(0x7f520c098d40 msgr2=0x7f520c0cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:51.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.798+0000 7f521200e640 1 -- 172.21.15.114:0/4264114807 shutdown_connections 2023-11-04T01:37:51.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.798+0000 7f521200e640 1 -- 172.21.15.114:0/4264114807 wait complete. 2023-11-04T01:37:51.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.799+0000 7f521200e640 1 Processor -- start 2023-11-04T01:37:51.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.799+0000 7f521200e640 1 -- start start 2023-11-04T01:37:51.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.800+0000 7f521200e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f520c06ef40 0x7f520c1f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.800+0000 7f521200e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f520c0aec80 0x7f520c1f0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.800+0000 7f521200e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f520c0af060 0x7f520c0c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.800+0000 7f521200e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c14c5c0 con 0x7f520c06ef40 2023-11-04T01:37:51.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.800+0000 7f521200e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0b2630 con 0x7f520c0aec80 2023-11-04T01:37:51.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.800+0000 7f521200e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c1f4d80 con 0x7f520c0af060 2023-11-04T01:37:51.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.800+0000 7f520b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f520c06ef40 0x7f520c1f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.800+0000 7f520b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f520c06ef40 0x7f520c1f4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51164/0 (socket says 172.21.15.114:51164) 2023-11-04T01:37:51.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.800+0000 7f520b7fe640 1 -- 172.21.15.114:0/1138513747 learned_addr learned my addr 172.21.15.114:0/1138513747 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:51.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.800+0000 7f520bfff640 1 --2- 172.21.15.114:0/1138513747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f520c0af060 0x7f520c0c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.800+0000 7f520affd640 1 --2- 172.21.15.114:0/1138513747 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f520c0aec80 0x7f520c1f0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.800+0000 7f520b7fe640 1 -- 172.21.15.114:0/1138513747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f520c0af060 msgr2=0x7f520c0c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.800+0000 7f520b7fe640 1 --2- 172.21.15.114:0/1138513747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f520c0af060 0x7f520c0c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.800+0000 7f520b7fe640 1 -- 172.21.15.114:0/1138513747 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f520c0aec80 msgr2=0x7f520c1f0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.800+0000 7f520b7fe640 1 --2- 172.21.15.114:0/1138513747 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f520c0aec80 0x7f520c1f0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.800+0000 7f520b7fe640 1 -- 172.21.15.114:0/1138513747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc009460 con 0x7f520c06ef40 2023-11-04T01:37:51.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.801+0000 7f520b7fe640 1 --2- 172.21.15.114:0/1138513747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f520c06ef40 0x7f520c1f4840 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00e9b0 tx=0x7f51fc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:51.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.801+0000 7f51f3fff640 1 -- 172.21.15.114:0/1138513747 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc00c9a0 con 0x7f520c06ef40 2023-11-04T01:37:51.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.801+0000 7f51f3fff640 1 -- 172.21.15.114:0/1138513747 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc00cb00 con 0x7f520c06ef40 2023-11-04T01:37:51.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.801+0000 7f521200e640 1 -- 172.21.15.114:0/1138513747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52000093a0 con 0x7f520c06ef40 2023-11-04T01:37:51.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.801+0000 7f51f3fff640 1 -- 172.21.15.114:0/1138513747 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc00ce70 con 0x7f520c06ef40 2023-11-04T01:37:51.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.801+0000 7f521200e640 1 -- 172.21.15.114:0/1138513747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c14b4f0 con 0x7f520c06ef40 2023-11-04T01:37:51.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.802+0000 7f521200e640 1 -- 172.21.15.114:0/1138513747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c14b350 con 0x7f520c06ef40 2023-11-04T01:37:51.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.802+0000 7f51f3fff640 1 -- 172.21.15.114:0/1138513747 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51fc005990 con 0x7f520c06ef40 2023-11-04T01:37:51.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.803+0000 7f51f3fff640 1 --2- 172.21.15.114:0/1138513747 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51f806ae70 0x7f51f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:51.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.803+0000 7f51f3fff640 1 -- 172.21.15.114:0/1138513747 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f51fc089b50 con 0x7f520c06ef40 2023-11-04T01:37:51.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.803+0000 7f520affd640 1 --2- 172.21.15.114:0/1138513747 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51f806ae70 0x7f51f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:51.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.803+0000 7f520affd640 1 --2- 172.21.15.114:0/1138513747 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51f806ae70 0x7f51f806d330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5200036000 tx=0x7f5200008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:51.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.807+0000 7f51f3fff640 1 -- 172.21.15.114:0/1138513747 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f520c14b350 con 0x7f520c06ef40 2023-11-04T01:37:51.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.974+0000 7f521200e640 1 -- 172.21.15.114:0/1138513747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f520c14b350 con 0x7f520c06ef40 2023-11-04T01:37:51.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.975+0000 7f51f3fff640 1 -- 172.21.15.114:0/1138513747 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16847 (secure 0 0 0) 0x7f51fc081e60 con 0x7f520c06ef40 2023-11-04T01:37:51.977 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:51.977 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:50.993468+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:48.832988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:49.974993+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:51.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.977+0000 7f521200e640 1 -- 172.21.15.114:0/1138513747 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51f806ae70 msgr2=0x7f51f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.977+0000 7f521200e640 1 --2- 172.21.15.114:0/1138513747 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51f806ae70 0x7f51f806d330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5200036000 tx=0x7f5200008030 comp rx=0 tx=0).stop 2023-11-04T01:37:51.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.977+0000 7f521200e640 1 -- 172.21.15.114:0/1138513747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f520c06ef40 msgr2=0x7f520c1f4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:51.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.977+0000 7f521200e640 1 --2- 172.21.15.114:0/1138513747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f520c06ef40 0x7f520c1f4840 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00e9b0 tx=0x7f51fc00ee70 comp rx=0 tx=0).stop 2023-11-04T01:37:51.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.977+0000 7f521200e640 1 -- 172.21.15.114:0/1138513747 shutdown_connections 2023-11-04T01:37:51.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.977+0000 7f521200e640 1 --2- 172.21.15.114:0/1138513747 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f520c0af060 0x7f520c0c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.977+0000 7f521200e640 1 --2- 172.21.15.114:0/1138513747 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51f806ae70 0x7f51f806d330 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.977+0000 7f521200e640 1 --2- 172.21.15.114:0/1138513747 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f520c0aec80 0x7f520c1f0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.977+0000 7f521200e640 1 --2- 172.21.15.114:0/1138513747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f520c06ef40 0x7f520c1f4840 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:51.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.977+0000 7f521200e640 1 -- 172.21.15.114:0/1138513747 >> 172.21.15.114:0/1138513747 conn(0x7f520c098d40 msgr2=0x7f520c0af460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:51.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.977+0000 7f521200e640 1 -- 172.21.15.114:0/1138513747 shutdown_connections 2023-11-04T01:37:51.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:51.977+0000 7f521200e640 1 -- 172.21.15.114:0/1138513747 wait complete. 2023-11-04T01:37:51.990 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:52.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.087+0000 7f832d27c640 1 Processor -- start 2023-11-04T01:37:52.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.087+0000 7f832d27c640 1 -- start start 2023-11-04T01:37:52.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.088+0000 7f832d27c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f832815cdf0 0x7f83280b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.088+0000 7f832d27c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f83280b4f20 0x7f83280b7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.088+0000 7f832d27c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83280b62c0 con 0x7f83280b8b10 2023-11-04T01:37:52.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.088+0000 7f832d27c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83280b65a0 con 0x7f83280b4f20 2023-11-04T01:37:52.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.088+0000 7f832d27c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83280b6880 con 0x7f832815cdf0 2023-11-04T01:37:52.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.088+0000 7f83277fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f83280b4f20 0x7f83280b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.088+0000 7f83277fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f83280b4f20 0x7f83280b7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51180/0 (socket says 172.21.15.114:51180) 2023-11-04T01:37:52.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.088+0000 7f83277fe640 1 -- 172.21.15.114:0/1868680686 learned_addr learned my addr 172.21.15.114:0/1868680686 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:52.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.089+0000 7f8326ffd640 1 --2- 172.21.15.114:0/1868680686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f832815cdf0 0x7f83280b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.089+0000 7f83277fe640 1 -- 172.21.15.114:0/1868680686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f832815cdf0 msgr2=0x7f83280b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:52.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.089+0000 7f83277fe640 1 --2- 172.21.15.114:0/1868680686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f832815cdf0 0x7f83280b85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.089+0000 7f83277fe640 1 -- 172.21.15.114:0/1868680686 >> v1:172.21.15.141:6789/0 conn(0x7f83280b8b10 legacy=0x7f83280b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:52.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.089+0000 7f83277fe640 1 -- 172.21.15.114:0/1868680686 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83280b6b60 con 0x7f83280b4f20 2023-11-04T01:37:52.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.089+0000 7f83277fe640 1 --2- 172.21.15.114:0/1868680686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83280b4f20 0x7f83280b7360 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8320009870 tx=0x7f832002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc841ae0b82dbb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.089+0000 7f8325ffb640 1 -- 172.21.15.114:0/1868680686 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320030840 con 0x7f83280b4f20 2023-11-04T01:37:52.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.090+0000 7f8325ffb640 1 -- 172.21.15.114:0/1868680686 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83200309a0 con 0x7f83280b4f20 2023-11-04T01:37:52.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.090+0000 7f8325ffb640 1 -- 172.21.15.114:0/1868680686 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320030d30 con 0x7f83280b4f20 2023-11-04T01:37:52.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.090+0000 7f832d27c640 1 -- 172.21.15.114:0/1868680686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83280b4f20 msgr2=0x7f83280b7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.090+0000 7f832d27c640 1 --2- 172.21.15.114:0/1868680686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83280b4f20 0x7f83280b7360 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8320009870 tx=0x7f832002b980 comp rx=0 tx=0).stop 2023-11-04T01:37:52.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.090+0000 7f832d27c640 1 -- 172.21.15.114:0/1868680686 shutdown_connections 2023-11-04T01:37:52.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.090+0000 7f832d27c640 1 --2- 172.21.15.114:0/1868680686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83280b4f20 0x7f83280b7360 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.090+0000 7f832d27c640 1 --2- 172.21.15.114:0/1868680686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f832815cdf0 0x7f83280b85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.090+0000 7f832d27c640 1 -- 172.21.15.114:0/1868680686 >> 172.21.15.114:0/1868680686 conn(0x7f8328071c70 msgr2=0x7f8328072080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:52.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.090+0000 7f832d27c640 1 -- 172.21.15.114:0/1868680686 shutdown_connections 2023-11-04T01:37:52.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.090+0000 7f832d27c640 1 -- 172.21.15.114:0/1868680686 wait complete. 2023-11-04T01:37:52.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.091+0000 7f832d27c640 1 Processor -- start 2023-11-04T01:37:52.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.091+0000 7f832d27c640 1 -- start start 2023-11-04T01:37:52.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.092+0000 7f832d27c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f83280b4f20 0x7f8328149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.092+0000 7f832d27c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f83280b8b10 0x7f83281f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.092+0000 7f832d27c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f832815cdf0 0x7f83281588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.092+0000 7f832d27c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83280c8270 con 0x7f832815cdf0 2023-11-04T01:37:52.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.092+0000 7f832d27c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83280c7f60 con 0x7f83280b4f20 2023-11-04T01:37:52.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.092+0000 7f832d27c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83281496d0 con 0x7f83280b8b10 2023-11-04T01:37:52.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.092+0000 7f83277fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f832815cdf0 0x7f83281588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.092+0000 7f83277fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f832815cdf0 0x7f83281588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51186/0 (socket says 172.21.15.114:51186) 2023-11-04T01:37:52.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.092+0000 7f83277fe640 1 -- 172.21.15.114:0/1053525173 learned_addr learned my addr 172.21.15.114:0/1053525173 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:52.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.092+0000 7f8326ffd640 1 --2- 172.21.15.114:0/1053525173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f83280b4f20 0x7f8328149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.092+0000 7f83267fc640 1 --2- 172.21.15.114:0/1053525173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f83280b8b10 0x7f83281f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.092+0000 7f83277fe640 1 -- 172.21.15.114:0/1053525173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f83280b8b10 msgr2=0x7f83281f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.093+0000 7f83277fe640 1 --2- 172.21.15.114:0/1053525173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f83280b8b10 0x7f83281f31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.093+0000 7f83277fe640 1 -- 172.21.15.114:0/1053525173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f83280b4f20 msgr2=0x7f8328149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.093+0000 7f83277fe640 1 --2- 172.21.15.114:0/1053525173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f83280b4f20 0x7f8328149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.093+0000 7f83277fe640 1 -- 172.21.15.114:0/1053525173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83200094d0 con 0x7f832815cdf0 2023-11-04T01:37:52.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.093+0000 7f8326ffd640 1 --2- 172.21.15.114:0/1053525173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f83280b4f20 0x7f8328149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:52.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.093+0000 7f83277fe640 1 --2- 172.21.15.114:0/1053525173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f832815cdf0 0x7f83281588c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8320009870 tx=0x7f8320004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.093+0000 7f830f7fe640 1 -- 172.21.15.114:0/1053525173 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320043400 con 0x7f832815cdf0 2023-11-04T01:37:52.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.093+0000 7f830f7fe640 1 -- 172.21.15.114:0/1053525173 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8320043580 con 0x7f832815cdf0 2023-11-04T01:37:52.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.093+0000 7f832d27c640 1 -- 172.21.15.114:0/1053525173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832815fe20 con 0x7f832815cdf0 2023-11-04T01:37:52.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.093+0000 7f830f7fe640 1 -- 172.21.15.114:0/1053525173 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320043930 con 0x7f832815cdf0 2023-11-04T01:37:52.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.093+0000 7f832d27c640 1 -- 172.21.15.114:0/1053525173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83280c6980 con 0x7f832815cdf0 2023-11-04T01:37:52.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.094+0000 7f832d27c640 1 -- 172.21.15.114:0/1053525173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8328067c50 con 0x7f832815cdf0 2023-11-04T01:37:52.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.094+0000 7f830f7fe640 1 -- 172.21.15.114:0/1053525173 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8320043a90 con 0x7f832815cdf0 2023-11-04T01:37:52.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.095+0000 7f830f7fe640 1 --2- 172.21.15.114:0/1053525173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f831406ae70 0x7f831406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.095+0000 7f830f7fe640 1 -- 172.21.15.114:0/1053525173 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f832003e070 con 0x7f832815cdf0 2023-11-04T01:37:52.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.095+0000 7f8326ffd640 1 --2- 172.21.15.114:0/1053525173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f831406ae70 0x7f831406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.095+0000 7f8326ffd640 1 --2- 172.21.15.114:0/1053525173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f831406ae70 0x7f831406d330 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8318007fc0 tx=0x7f83180075b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.099+0000 7f830f7fe640 1 -- 172.21.15.114:0/1053525173 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8320077b60 con 0x7f832815cdf0 2023-11-04T01:37:52.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.265+0000 7f832d27c640 1 -- 172.21.15.114:0/1053525173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83280c8420 con 0x7f832815cdf0 2023-11-04T01:37:52.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.267+0000 7f830f7fe640 1 -- 172.21.15.114:0/1053525173 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16847 (secure 0 0 0) 0x7f8320034090 con 0x7f832815cdf0 2023-11-04T01:37:52.269 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:52.269 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:50.993468+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:48.832988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:49.974993+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:52.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.269+0000 7f832d27c640 1 -- 172.21.15.114:0/1053525173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f831406ae70 msgr2=0x7f831406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.269+0000 7f832d27c640 1 --2- 172.21.15.114:0/1053525173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f831406ae70 0x7f831406d330 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8318007fc0 tx=0x7f83180075b0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.269+0000 7f832d27c640 1 -- 172.21.15.114:0/1053525173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f832815cdf0 msgr2=0x7f83281588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.269+0000 7f832d27c640 1 --2- 172.21.15.114:0/1053525173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f832815cdf0 0x7f83281588c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8320009870 tx=0x7f8320004730 comp rx=0 tx=0).stop 2023-11-04T01:37:52.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.269+0000 7f832d27c640 1 -- 172.21.15.114:0/1053525173 shutdown_connections 2023-11-04T01:37:52.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.269+0000 7f832d27c640 1 --2- 172.21.15.114:0/1053525173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f832815cdf0 0x7f83281588c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.269+0000 7f832d27c640 1 --2- 172.21.15.114:0/1053525173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f83280b8b10 0x7f83281f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.269+0000 7f832d27c640 1 --2- 172.21.15.114:0/1053525173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f831406ae70 0x7f831406d330 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.269+0000 7f832d27c640 1 --2- 172.21.15.114:0/1053525173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f83280b4f20 0x7f8328149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.269+0000 7f832d27c640 1 -- 172.21.15.114:0/1053525173 >> 172.21.15.114:0/1053525173 conn(0x7f8328071c70 msgr2=0x7f83280b83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:52.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.269+0000 7f832d27c640 1 -- 172.21.15.114:0/1053525173 shutdown_connections 2023-11-04T01:37:52.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.269+0000 7f832d27c640 1 -- 172.21.15.114:0/1053525173 wait complete. 2023-11-04T01:37:52.282 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:37:52.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.382+0000 7f7500e1a640 1 Processor -- start 2023-11-04T01:37:52.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.382+0000 7f7500e1a640 1 -- start start 2023-11-04T01:37:52.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.383+0000 7f7500e1a640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f74fc0ae1d0 0x7f74fc0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.383+0000 7f7500e1a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc15aff0 con 0x7f74fc0c4ff0 2023-11-04T01:37:52.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.383+0000 7f7500e1a640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc15a3e0 con 0x7f74fc159c00 2023-11-04T01:37:52.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.383+0000 7f7500e1a640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74fc15a6c0 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.383+0000 7f74f9d9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f74fc0c4ff0 0x7f74fc0adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60602/0 (socket says 172.21.15.114:60602) 2023-11-04T01:37:52.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.383+0000 7f74f9d9b640 1 -- 172.21.15.114:0/846297661 learned_addr learned my addr 172.21.15.114:0/846297661 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:52.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.383+0000 7f74fad9d640 1 --2- 172.21.15.114:0/846297661 >> v2:172.21.15.141:3300/0 conn(0x7f74fc0ae1d0 0x7f74fc0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.383+0000 7f74f959a640 1 -- 172.21.15.114:0/846297661 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132711943 0 0) 0x7f74fc15aff0 con 0x7f74fc0c4ff0 2023-11-04T01:37:52.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.383+0000 7f74f959a640 1 -- 172.21.15.114:0/846297661 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74e4003520 con 0x7f74fc0c4ff0 2023-11-04T01:37:52.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.383+0000 7f74f959a640 1 -- 172.21.15.114:0/846297661 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2809342734 0 0) 0x7f74e4003520 con 0x7f74fc0c4ff0 2023-11-04T01:37:52.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.383+0000 7f74fad9d640 1 -- 172.21.15.114:0/846297661 >> v1:172.21.15.141:6789/0 conn(0x7f74fc159c00 legacy=0x7f74fc0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.383+0000 7f74fad9d640 1 -- 172.21.15.114:0/846297661 >> v1:172.21.15.114:6789/0 conn(0x7f74fc0c4ff0 legacy=0x7f74fc0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.383+0000 7f74fad9d640 1 -- 172.21.15.114:0/846297661 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc15a9a0 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.384+0000 7f74fad9d640 1 --2- 172.21.15.114:0/846297661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74fc0ae1d0 0x7f74fc0cc890 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009d90 tx=0x7f74f402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=942d63a78f1fe874 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.384+0000 7f74f959a640 1 -- 172.21.15.114:0/846297661 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0001670 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.384+0000 7f74f959a640 1 -- 172.21.15.114:0/846297661 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f402c940 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.384+0000 7f74f959a640 1 -- 172.21.15.114:0/846297661 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f402ccb0 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.385+0000 7f7500e1a640 1 -- 172.21.15.114:0/846297661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74fc0ae1d0 msgr2=0x7f74fc0cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.385+0000 7f7500e1a640 1 --2- 172.21.15.114:0/846297661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74fc0ae1d0 0x7f74fc0cc890 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009d90 tx=0x7f74f402be10 comp rx=0 tx=0).stop 2023-11-04T01:37:52.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.385+0000 7f7500e1a640 1 -- 172.21.15.114:0/846297661 shutdown_connections 2023-11-04T01:37:52.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.385+0000 7f7500e1a640 1 --2- 172.21.15.114:0/846297661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74fc0ae1d0 0x7f74fc0cc890 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.385+0000 7f7500e1a640 1 -- 172.21.15.114:0/846297661 >> 172.21.15.114:0/846297661 conn(0x7f74fc0ce950 msgr2=0x7f74fc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:52.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.385+0000 7f7500e1a640 1 -- 172.21.15.114:0/846297661 shutdown_connections 2023-11-04T01:37:52.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.385+0000 7f7500e1a640 1 -- 172.21.15.114:0/846297661 wait complete. 2023-11-04T01:37:52.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.386+0000 7f7500e1a640 1 Processor -- start 2023-11-04T01:37:52.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.386+0000 7f7500e1a640 1 -- start start 2023-11-04T01:37:52.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.387+0000 7f7500e1a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74fc0ae1d0 0x7f74fc150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.387+0000 7f7500e1a640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74fc0c4ff0 0x7f74fc157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.387+0000 7f7500e1a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74fc159c00 0x7f74fc0c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.387+0000 7f7500e1a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc157810 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.387+0000 7f7500e1a640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc158a50 con 0x7f74fc0c4ff0 2023-11-04T01:37:52.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.387+0000 7f7500e1a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc156ee0 con 0x7f74fc159c00 2023-11-04T01:37:52.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.387+0000 7f74fa59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74fc0ae1d0 0x7f74fc150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.387+0000 7f74fa59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74fc0ae1d0 0x7f74fc150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51196/0 (socket says 172.21.15.114:51196) 2023-11-04T01:37:52.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.387+0000 7f74fa59c640 1 -- 172.21.15.114:0/74692483 learned_addr learned my addr 172.21.15.114:0/74692483 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:52.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.387+0000 7f74f9d9b640 1 --2- 172.21.15.114:0/74692483 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74fc0c4ff0 0x7f74fc157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.387+0000 7f74fa59c640 1 -- 172.21.15.114:0/74692483 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74fc159c00 msgr2=0x7f74fc0c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.387+0000 7f74fa59c640 1 --2- 172.21.15.114:0/74692483 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74fc159c00 0x7f74fc0c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.387+0000 7f74fa59c640 1 -- 172.21.15.114:0/74692483 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74fc0c4ff0 msgr2=0x7f74fc157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.387+0000 7f74fa59c640 1 --2- 172.21.15.114:0/74692483 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74fc0c4ff0 0x7f74fc157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.387+0000 7f74fa59c640 1 -- 172.21.15.114:0/74692483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f4009a70 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.388+0000 7f74fa59c640 1 --2- 172.21.15.114:0/74692483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74fc0ae1d0 0x7f74fc150420 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f74ec00c400 tx=0x7f74ec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.388+0000 7f74eaffd640 1 -- 172.21.15.114:0/74692483 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec0052d0 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.388+0000 7f74eaffd640 1 -- 172.21.15.114:0/74692483 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec005430 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.388+0000 7f7500e1a640 1 -- 172.21.15.114:0/74692483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74fc1571c0 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.388+0000 7f74eaffd640 1 -- 172.21.15.114:0/74692483 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec003830 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.388+0000 7f7500e1a640 1 -- 172.21.15.114:0/74692483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74fc0c81e0 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.389+0000 7f7500e1a640 1 -- 172.21.15.114:0/74692483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74fc074290 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.389+0000 7f74eaffd640 1 -- 172.21.15.114:0/74692483 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f74ec003990 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.390+0000 7f74eaffd640 1 --2- 172.21.15.114:0/74692483 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f74dc06ae70 0x7f74dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.390+0000 7f74eaffd640 1 -- 172.21.15.114:0/74692483 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f74ec088cd0 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.390+0000 7f74f9d9b640 1 --2- 172.21.15.114:0/74692483 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f74dc06ae70 0x7f74dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.390+0000 7f74f9d9b640 1 --2- 172.21.15.114:0/74692483 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f74dc06ae70 0x7f74dc06d330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0cd350 tx=0x7f74f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.394+0000 7f74eaffd640 1 -- 172.21.15.114:0/74692483 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74ec053c40 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.595+0000 7f7500e1a640 1 -- 172.21.15.114:0/74692483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f74fc150a00 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.671+0000 7f74eaffd640 1 -- 172.21.15.114:0/74692483 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f74ec0170b0 con 0x7f74fc0ae1d0 2023-11-04T01:37:52.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.673+0000 7f7500e1a640 1 -- 172.21.15.114:0/74692483 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f74dc06ae70 msgr2=0x7f74dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.673+0000 7f7500e1a640 1 --2- 172.21.15.114:0/74692483 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f74dc06ae70 0x7f74dc06d330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0cd350 tx=0x7f74f0009040 comp rx=0 tx=0).stop 2023-11-04T01:37:52.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.673+0000 7f7500e1a640 1 -- 172.21.15.114:0/74692483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74fc0ae1d0 msgr2=0x7f74fc150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.673+0000 7f7500e1a640 1 --2- 172.21.15.114:0/74692483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74fc0ae1d0 0x7f74fc150420 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f74ec00c400 tx=0x7f74ec00c8c0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.673+0000 7f7500e1a640 1 -- 172.21.15.114:0/74692483 shutdown_connections 2023-11-04T01:37:52.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.673+0000 7f7500e1a640 1 --2- 172.21.15.114:0/74692483 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74fc159c00 0x7f74fc0c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.673+0000 7f7500e1a640 1 --2- 172.21.15.114:0/74692483 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f74dc06ae70 0x7f74dc06d330 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.673+0000 7f7500e1a640 1 --2- 172.21.15.114:0/74692483 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74fc0c4ff0 0x7f74fc157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.673+0000 7f7500e1a640 1 --2- 172.21.15.114:0/74692483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74fc0ae1d0 0x7f74fc150420 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.673+0000 7f7500e1a640 1 -- 172.21.15.114:0/74692483 >> 172.21.15.114:0/74692483 conn(0x7f74fc0ce950 msgr2=0x7f74fc154710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:52.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.673+0000 7f7500e1a640 1 -- 172.21.15.114:0/74692483 shutdown_connections 2023-11-04T01:37:52.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.673+0000 7f7500e1a640 1 -- 172.21.15.114:0/74692483 wait complete. 2023-11-04T01:37:52.686 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:37:52.686 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:37:52.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.786+0000 7fd7e83a5640 1 Processor -- start 2023-11-04T01:37:52.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.786+0000 7fd7e83a5640 1 -- start start 2023-11-04T01:37:52.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.787+0000 7fd7e83a5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd7e00cdac0 0x7fd7e00b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.787+0000 7fd7e83a5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e00d01f0 con 0x7fd7e015af20 2023-11-04T01:37:52.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.787+0000 7fd7e83a5640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e00b6a40 con 0x7fd7e00b64c0 2023-11-04T01:37:52.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.787+0000 7fd7e83a5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e00cc380 con 0x7fd7e00cdac0 2023-11-04T01:37:52.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.787+0000 7fd7e6942640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd7e00cdac0 0x7fd7e00b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.787+0000 7fd7e6141640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd7e015af20 0x7fd7e00cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60616/0 (socket says 172.21.15.114:60616) 2023-11-04T01:37:52.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.787+0000 7fd7e6141640 1 -- 172.21.15.114:0/3317351655 learned_addr learned my addr 172.21.15.114:0/3317351655 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:52.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.788+0000 7fd7e6942640 1 -- 172.21.15.114:0/3317351655 >> v1:172.21.15.141:6789/0 conn(0x7fd7e00b64c0 legacy=0x7fd7e00cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:52.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.788+0000 7fd7e6942640 1 -- 172.21.15.114:0/3317351655 >> v1:172.21.15.114:6789/0 conn(0x7fd7e015af20 legacy=0x7fd7e00cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.788+0000 7fd7e6942640 1 -- 172.21.15.114:0/3317351655 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e00d04b0 con 0x7fd7e00cdac0 2023-11-04T01:37:52.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.788+0000 7fd7e513f640 1 -- 172.21.15.114:0/3317351655 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244492067 0 0) 0x7fd7e00d01f0 con 0x7fd7e015af20 2023-11-04T01:37:52.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.788+0000 7fd7e6942640 1 --2- 172.21.15.114:0/3317351655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e00cdac0 0x7fd7e00b3cd0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd7d80097a0 tx=0x7fd7d802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe7e9a0c59a514a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.788+0000 7fd7e513f640 1 -- 172.21.15.114:0/3317351655 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8030610 con 0x7fd7e00cdac0 2023-11-04T01:37:52.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.789+0000 7fd7e513f640 1 -- 172.21.15.114:0/3317351655 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d8030770 con 0x7fd7e00cdac0 2023-11-04T01:37:52.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.789+0000 7fd7e513f640 1 -- 172.21.15.114:0/3317351655 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8030b00 con 0x7fd7e00cdac0 2023-11-04T01:37:52.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.789+0000 7fd7e83a5640 1 -- 172.21.15.114:0/3317351655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e00cdac0 msgr2=0x7fd7e00b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.789+0000 7fd7e83a5640 1 --2- 172.21.15.114:0/3317351655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e00cdac0 0x7fd7e00b3cd0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd7d80097a0 tx=0x7fd7d802b960 comp rx=0 tx=0).stop 2023-11-04T01:37:52.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.789+0000 7fd7e83a5640 1 -- 172.21.15.114:0/3317351655 shutdown_connections 2023-11-04T01:37:52.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.789+0000 7fd7e83a5640 1 --2- 172.21.15.114:0/3317351655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e00cdac0 0x7fd7e00b3cd0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.789+0000 7fd7e83a5640 1 -- 172.21.15.114:0/3317351655 >> 172.21.15.114:0/3317351655 conn(0x7fd7e006ea20 msgr2=0x7fd7e006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:52.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.789+0000 7fd7e83a5640 1 -- 172.21.15.114:0/3317351655 shutdown_connections 2023-11-04T01:37:52.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.789+0000 7fd7e83a5640 1 -- 172.21.15.114:0/3317351655 wait complete. 2023-11-04T01:37:52.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.790+0000 7fd7e83a5640 1 Processor -- start 2023-11-04T01:37:52.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.790+0000 7fd7e83a5640 1 -- start start 2023-11-04T01:37:52.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.791+0000 7fd7e83a5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7e00b64c0 0x7fd7e00c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.791+0000 7fd7e83a5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e00cdac0 0x7fd7e014fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.791+0000 7fd7e83a5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7e015af20 0x7fd7e0150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.791+0000 7fd7e83a5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e015d3f0 con 0x7fd7e00cdac0 2023-11-04T01:37:52.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.791+0000 7fd7e83a5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e015c7e0 con 0x7fd7e015af20 2023-11-04T01:37:52.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.791+0000 7fd7e83a5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e015cac0 con 0x7fd7e00b64c0 2023-11-04T01:37:52.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.791+0000 7fd7e5940640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e00cdac0 0x7fd7e014fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.791+0000 7fd7e5940640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e00cdac0 0x7fd7e014fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51212/0 (socket says 172.21.15.114:51212) 2023-11-04T01:37:52.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.791+0000 7fd7e5940640 1 -- 172.21.15.114:0/1667353296 learned_addr learned my addr 172.21.15.114:0/1667353296 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:52.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.791+0000 7fd7e6141640 1 --2- 172.21.15.114:0/1667353296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7e00b64c0 0x7fd7e00c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.791+0000 7fd7e6942640 1 --2- 172.21.15.114:0/1667353296 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7e015af20 0x7fd7e0150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.791+0000 7fd7e5940640 1 -- 172.21.15.114:0/1667353296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7e00b64c0 msgr2=0x7fd7e00c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.791+0000 7fd7e5940640 1 --2- 172.21.15.114:0/1667353296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7e00b64c0 0x7fd7e00c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.791+0000 7fd7e5940640 1 -- 172.21.15.114:0/1667353296 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7e015af20 msgr2=0x7fd7e0150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:52.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.791+0000 7fd7e5940640 1 --2- 172.21.15.114:0/1667353296 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7e015af20 0x7fd7e0150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:52.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.791+0000 7fd7e5940640 1 -- 172.21.15.114:0/1667353296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d8009400 con 0x7fd7e00cdac0 2023-11-04T01:37:52.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.792+0000 7fd7e5940640 1 --2- 172.21.15.114:0/1667353296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e00cdac0 0x7fd7e014fb10 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000c450 tx=0x7fd7d000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.792+0000 7fd7d6ffd640 1 -- 172.21.15.114:0/1667353296 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d00052d0 con 0x7fd7e00cdac0 2023-11-04T01:37:52.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.792+0000 7fd7d6ffd640 1 -- 172.21.15.114:0/1667353296 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d0005430 con 0x7fd7e00cdac0 2023-11-04T01:37:52.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.792+0000 7fd7e83a5640 1 -- 172.21.15.114:0/1667353296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e015cda0 con 0x7fd7e00cdac0 2023-11-04T01:37:52.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.792+0000 7fd7d6ffd640 1 -- 172.21.15.114:0/1667353296 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0012870 con 0x7fd7e00cdac0 2023-11-04T01:37:52.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.792+0000 7fd7e83a5640 1 -- 172.21.15.114:0/1667353296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e015c350 con 0x7fd7e00cdac0 2023-11-04T01:37:52.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.793+0000 7fd7e83a5640 1 -- 172.21.15.114:0/1667353296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e015d5a0 con 0x7fd7e00cdac0 2023-11-04T01:37:52.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.793+0000 7fd7d6ffd640 1 -- 172.21.15.114:0/1667353296 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd7d00129d0 con 0x7fd7e00cdac0 2023-11-04T01:37:52.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.794+0000 7fd7d6ffd640 1 --2- 172.21.15.114:0/1667353296 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd7c406ae70 0x7fd7c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:52.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.794+0000 7fd7d6ffd640 1 -- 172.21.15.114:0/1667353296 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd7d0089140 con 0x7fd7e00cdac0 2023-11-04T01:37:52.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.794+0000 7fd7e6141640 1 --2- 172.21.15.114:0/1667353296 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd7c406ae70 0x7fd7c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:52.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.794+0000 7fd7e6141640 1 --2- 172.21.15.114:0/1667353296 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd7c406ae70 0x7fd7c406d330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc007f30 tx=0x7fd7dc007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:52.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:52.798+0000 7fd7d6ffd640 1 -- 172.21.15.114:0/1667353296 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd7e015d5a0 con 0x7fd7e00cdac0 2023-11-04T01:37:53.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.000+0000 7fd7e83a5640 1 -- 172.21.15.114:0/1667353296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd7e015c570 con 0x7fd7e00cdac0 2023-11-04T01:37:53.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.672+0000 7fd7d6ffd640 1 -- 172.21.15.114:0/1667353296 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd7d0054160 con 0x7fd7e00cdac0 2023-11-04T01:37:53.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.675+0000 7fd7e83a5640 1 -- 172.21.15.114:0/1667353296 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd7c406ae70 msgr2=0x7fd7c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.675+0000 7fd7e83a5640 1 --2- 172.21.15.114:0/1667353296 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd7c406ae70 0x7fd7c406d330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc007f30 tx=0x7fd7dc007e80 comp rx=0 tx=0).stop 2023-11-04T01:37:53.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.675+0000 7fd7e83a5640 1 -- 172.21.15.114:0/1667353296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e00cdac0 msgr2=0x7fd7e014fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.675+0000 7fd7e83a5640 1 --2- 172.21.15.114:0/1667353296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e00cdac0 0x7fd7e014fb10 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000c450 tx=0x7fd7d000c910 comp rx=0 tx=0).stop 2023-11-04T01:37:53.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.675+0000 7fd7e83a5640 1 -- 172.21.15.114:0/1667353296 shutdown_connections 2023-11-04T01:37:53.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.675+0000 7fd7e83a5640 1 --2- 172.21.15.114:0/1667353296 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd7c406ae70 0x7fd7c406d330 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.675+0000 7fd7e83a5640 1 --2- 172.21.15.114:0/1667353296 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd7e015af20 0x7fd7e0150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.675+0000 7fd7e83a5640 1 --2- 172.21.15.114:0/1667353296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7e00cdac0 0x7fd7e014fb10 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.675+0000 7fd7e83a5640 1 --2- 172.21.15.114:0/1667353296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd7e00b64c0 0x7fd7e00c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.675+0000 7fd7e83a5640 1 -- 172.21.15.114:0/1667353296 >> 172.21.15.114:0/1667353296 conn(0x7fd7e006ea20 msgr2=0x7fd7e006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:53.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.675+0000 7fd7e83a5640 1 -- 172.21.15.114:0/1667353296 shutdown_connections 2023-11-04T01:37:53.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.675+0000 7fd7e83a5640 1 -- 172.21.15.114:0/1667353296 wait complete. 2023-11-04T01:37:53.688 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:37:53.689 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:53.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.789+0000 7f1e1fcc9640 1 Processor -- start 2023-11-04T01:37:53.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.789+0000 7f1e1fcc9640 1 -- start start 2023-11-04T01:37:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.790+0000 7f1e1fcc9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1e180cde60 0x7f1e1815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.790+0000 7f1e1fcc9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1e180ce240 0x7f1e180d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.790+0000 7f1e1fcc9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1815e000 con 0x7f1e1815daa0 2023-11-04T01:37:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.790+0000 7f1e1fcc9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1815e5c0 con 0x7f1e180ce240 2023-11-04T01:37:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.790+0000 7f1e1fcc9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1815e2e0 con 0x7f1e180cde60 2023-11-04T01:37:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.790+0000 7f1e1e266640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1e180ce240 0x7f1e180d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.790+0000 7f1e1e266640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1e180ce240 0x7f1e180d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51220/0 (socket says 172.21.15.114:51220) 2023-11-04T01:37:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.790+0000 7f1e1e266640 1 -- 172.21.15.114:0/3422100158 learned_addr learned my addr 172.21.15.114:0/3422100158 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:53.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.790+0000 7f1e1d264640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1e1815daa0 0x7f1e18157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60620/0 (socket says 172.21.15.114:60620) 2023-11-04T01:37:53.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.791+0000 7f1e1da65640 1 --2- 172.21.15.114:0/3422100158 >> v2:172.21.15.141:3300/0 conn(0x7f1e180cde60 0x7f1e1815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.791+0000 7f1e1e266640 1 -- 172.21.15.114:0/3422100158 >> v2:172.21.15.141:3300/0 conn(0x7f1e180cde60 msgr2=0x7f1e1815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:53.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.791+0000 7f1e1e266640 1 --2- 172.21.15.114:0/3422100158 >> v2:172.21.15.141:3300/0 conn(0x7f1e180cde60 0x7f1e1815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.791+0000 7f1e1e266640 1 -- 172.21.15.114:0/3422100158 >> v1:172.21.15.114:6789/0 conn(0x7f1e1815daa0 legacy=0x7f1e18157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.791+0000 7f1e1ca63640 1 -- 172.21.15.114:0/3422100158 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835759697 0 0) 0x7f1e1815e000 con 0x7f1e1815daa0 2023-11-04T01:37:53.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.791+0000 7f1e1e266640 1 -- 172.21.15.114:0/3422100158 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e180d1120 con 0x7f1e180ce240 2023-11-04T01:37:53.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.791+0000 7f1e1da65640 1 --2- 172.21.15.114:0/3422100158 >> v2:172.21.15.141:3300/0 conn(0x7f1e180cde60 0x7f1e1815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:53.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.792+0000 7f1e1e266640 1 --2- 172.21.15.114:0/3422100158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e180ce240 0x7f1e180d1920 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1e180b5550 tx=0x7f1e0802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441486312e9b2998 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.792+0000 7f1e1ca63640 1 -- 172.21.15.114:0/3422100158 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e08030860 con 0x7f1e180ce240 2023-11-04T01:37:53.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.792+0000 7f1e1ca63640 1 -- 172.21.15.114:0/3422100158 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e080309c0 con 0x7f1e180ce240 2023-11-04T01:37:53.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.792+0000 7f1e1ca63640 1 -- 172.21.15.114:0/3422100158 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e08030d50 con 0x7f1e180ce240 2023-11-04T01:37:53.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.792+0000 7f1e1fcc9640 1 -- 172.21.15.114:0/3422100158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e180ce240 msgr2=0x7f1e180d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.792+0000 7f1e1fcc9640 1 --2- 172.21.15.114:0/3422100158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e180ce240 0x7f1e180d1920 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1e180b5550 tx=0x7f1e0802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.792+0000 7f1e1fcc9640 1 -- 172.21.15.114:0/3422100158 shutdown_connections 2023-11-04T01:37:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.792+0000 7f1e1fcc9640 1 --2- 172.21.15.114:0/3422100158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e180ce240 0x7f1e180d1920 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.792+0000 7f1e1fcc9640 1 --2- 172.21.15.114:0/3422100158 >> v2:172.21.15.141:3300/0 conn(0x7f1e180cde60 0x7f1e1815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.792+0000 7f1e1fcc9640 1 -- 172.21.15.114:0/3422100158 >> 172.21.15.114:0/3422100158 conn(0x7f1e18071f30 msgr2=0x7f1e180cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.792+0000 7f1e1fcc9640 1 -- 172.21.15.114:0/3422100158 shutdown_connections 2023-11-04T01:37:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.792+0000 7f1e1fcc9640 1 -- 172.21.15.114:0/3422100158 wait complete. 2023-11-04T01:37:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.793+0000 7f1e1fcc9640 1 Processor -- start 2023-11-04T01:37:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.794+0000 7f1e1fcc9640 1 -- start start 2023-11-04T01:37:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.794+0000 7f1e1fcc9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e180cde60 0x7f1e18151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.794+0000 7f1e1fcc9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e180ce240 0x7f1e1814b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.794+0000 7f1e1fcc9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e1815daa0 0x7f1e180cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.794+0000 7f1e1fcc9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1814f3e0 con 0x7f1e180ce240 2023-11-04T01:37:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.794+0000 7f1e1fcc9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e181f2960 con 0x7f1e180cde60 2023-11-04T01:37:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.794+0000 7f1e1fcc9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e181f3970 con 0x7f1e1815daa0 2023-11-04T01:37:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.794+0000 7f1e1d264640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e180ce240 0x7f1e1814b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.794+0000 7f1e1d264640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e180ce240 0x7f1e1814b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51236/0 (socket says 172.21.15.114:51236) 2023-11-04T01:37:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.794+0000 7f1e1d264640 1 -- 172.21.15.114:0/3708932088 learned_addr learned my addr 172.21.15.114:0/3708932088 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.794+0000 7f1e1da65640 1 --2- 172.21.15.114:0/3708932088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e180cde60 0x7f1e18151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.794+0000 7f1e1e266640 1 --2- 172.21.15.114:0/3708932088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e1815daa0 0x7f1e180cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.795+0000 7f1e1d264640 1 -- 172.21.15.114:0/3708932088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e1815daa0 msgr2=0x7f1e180cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.795+0000 7f1e1d264640 1 --2- 172.21.15.114:0/3708932088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e1815daa0 0x7f1e180cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.795+0000 7f1e1d264640 1 -- 172.21.15.114:0/3708932088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e180cde60 msgr2=0x7f1e18151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:53.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.795+0000 7f1e1d264640 1 --2- 172.21.15.114:0/3708932088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e180cde60 0x7f1e18151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:53.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.795+0000 7f1e1d264640 1 -- 172.21.15.114:0/3708932088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e080094d0 con 0x7f1e180ce240 2023-11-04T01:37:53.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.795+0000 7f1e1d264640 1 --2- 172.21.15.114:0/3708932088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e180ce240 0x7f1e1814b460 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00c410 tx=0x7f1e0c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.795+0000 7f1e167fc640 1 -- 172.21.15.114:0/3708932088 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c0074e0 con 0x7f1e180ce240 2023-11-04T01:37:53.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.795+0000 7f1e167fc640 1 -- 172.21.15.114:0/3708932088 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c007660 con 0x7f1e180ce240 2023-11-04T01:37:53.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.795+0000 7f1e1fcc9640 1 -- 172.21.15.114:0/3708932088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1814b9a0 con 0x7f1e180ce240 2023-11-04T01:37:53.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.795+0000 7f1e167fc640 1 -- 172.21.15.114:0/3708932088 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c004a20 con 0x7f1e180ce240 2023-11-04T01:37:53.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.795+0000 7f1e1fcc9640 1 -- 172.21.15.114:0/3708932088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e181f2c60 con 0x7f1e180ce240 2023-11-04T01:37:53.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.796+0000 7f1e1fcc9640 1 -- 172.21.15.114:0/3708932088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e18074290 con 0x7f1e180ce240 2023-11-04T01:37:53.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.796+0000 7f1e167fc640 1 -- 172.21.15.114:0/3708932088 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e0c004b80 con 0x7f1e180ce240 2023-11-04T01:37:53.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.797+0000 7f1e167fc640 1 --2- 172.21.15.114:0/3708932088 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e0406aea0 0x7f1e0406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:53.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.797+0000 7f1e167fc640 1 -- 172.21.15.114:0/3708932088 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1e0c089520 con 0x7f1e180ce240 2023-11-04T01:37:53.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.797+0000 7f1e1da65640 1 --2- 172.21.15.114:0/3708932088 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e0406aea0 0x7f1e0406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:53.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.797+0000 7f1e1da65640 1 --2- 172.21.15.114:0/3708932088 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e0406aea0 0x7f1e0406d360 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1e100075b0 tx=0x7f1e10007540 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:53.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:53.801+0000 7f1e167fc640 1 -- 172.21.15.114:0/3708932088 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1e0c057fb0 con 0x7f1e180ce240 2023-11-04T01:37:54.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.003+0000 7f1e1fcc9640 1 -- 172.21.15.114:0/3708932088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e180b4b20 con 0x7f1e180ce240 2023-11-04T01:37:54.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.004+0000 7f1e167fc640 1 -- 172.21.15.114:0/3708932088 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f1e0c057b40 con 0x7f1e180ce240 2023-11-04T01:37:54.006 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:54.006 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5218,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/3821610653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":3821610653},{"type":"v1","addr":"172.21.15.141:6834","nonce":3821610653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2452742541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2452742541},{"type":"v1","addr":"172.21.15.114:6835","nonce":2452742541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3407147888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3407147888},{"type":"v1","addr":"172.21.15.114:6837","nonce":3407147888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:50.993779+0000","modified":"2023-11-04T01:37:53.001589+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5565":{"gid":5565,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6835/3122131633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3122131633},{"type":"v1","addr":"172.21.15.141:6835","nonce":3122131633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:37:54.006 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 16 2023-11-04T01:37:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.006+0000 7f1e1fcc9640 1 -- 172.21.15.114:0/3708932088 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e0406aea0 msgr2=0x7f1e0406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.006+0000 7f1e1fcc9640 1 --2- 172.21.15.114:0/3708932088 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e0406aea0 0x7f1e0406d360 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1e100075b0 tx=0x7f1e10007540 comp rx=0 tx=0).stop 2023-11-04T01:37:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.006+0000 7f1e1fcc9640 1 -- 172.21.15.114:0/3708932088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e180ce240 msgr2=0x7f1e1814b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.006+0000 7f1e1fcc9640 1 --2- 172.21.15.114:0/3708932088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e180ce240 0x7f1e1814b460 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00c410 tx=0x7f1e0c00c8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.006+0000 7f1e1fcc9640 1 -- 172.21.15.114:0/3708932088 shutdown_connections 2023-11-04T01:37:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.006+0000 7f1e1fcc9640 1 --2- 172.21.15.114:0/3708932088 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e1815daa0 0x7f1e180cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.006+0000 7f1e1fcc9640 1 --2- 172.21.15.114:0/3708932088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e180ce240 0x7f1e1814b460 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.006+0000 7f1e1fcc9640 1 --2- 172.21.15.114:0/3708932088 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e0406aea0 0x7f1e0406d360 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.006+0000 7f1e1fcc9640 1 --2- 172.21.15.114:0/3708932088 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e180cde60 0x7f1e18151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.006+0000 7f1e1fcc9640 1 -- 172.21.15.114:0/3708932088 >> 172.21.15.114:0/3708932088 conn(0x7f1e18071f30 msgr2=0x7f1e180b7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.006+0000 7f1e1fcc9640 1 -- 172.21.15.114:0/3708932088 shutdown_connections 2023-11-04T01:37:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.006+0000 7f1e1fcc9640 1 -- 172.21.15.114:0/3708932088 wait complete. 2023-11-04T01:37:54.018 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:37:54.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.116+0000 7f13077ce640 1 Processor -- start 2023-11-04T01:37:54.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.116+0000 7f13077ce640 1 -- start start 2023-11-04T01:37:54.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.116+0000 7f13077ce640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f130015ad80 0x7f130006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f13077ce640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f13000b42c0 0x7f13000c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f13077ce640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13000ca070 con 0x7f13000c9c40 2023-11-04T01:37:54.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f13077ce640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130006cd00 con 0x7f13000b42c0 2023-11-04T01:37:54.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f13077ce640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130006cfa0 con 0x7f130015ad80 2023-11-04T01:37:54.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f1305d6b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f13000c9c40 0x7f1300070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60636/0 (socket says 172.21.15.114:60636) 2023-11-04T01:37:54.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f1305d6b640 1 -- 172.21.15.114:0/3835920527 learned_addr learned my addr 172.21.15.114:0/3835920527 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:54.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f12f7fff640 1 -- 172.21.15.114:0/3835920527 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727884175 0 0) 0x7f13000ca070 con 0x7f13000c9c40 2023-11-04T01:37:54.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f130556a640 1 --2- 172.21.15.114:0/3835920527 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f130015ad80 0x7f130006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f12f7fff640 1 -- 172.21.15.114:0/3835920527 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12ec003520 con 0x7f13000c9c40 2023-11-04T01:37:54.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f1304d69640 1 --2- 172.21.15.114:0/3835920527 >> v2:172.21.15.141:3300/0 conn(0x7f13000b42c0 0x7f13000c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f12f7fff640 1 -- 172.21.15.114:0/3835920527 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3108519092 0 0) 0x7f12ec003520 con 0x7f13000c9c40 2023-11-04T01:37:54.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f12f7fff640 1 -- 172.21.15.114:0/3835920527 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f130015ad80 msgr2=0x7f130006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f12f7fff640 1 --2- 172.21.15.114:0/3835920527 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f130015ad80 0x7f130006c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f12f7fff640 1 -- 172.21.15.114:0/3835920527 >> v2:172.21.15.141:3300/0 conn(0x7f13000b42c0 msgr2=0x7f13000c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f12f7fff640 1 --2- 172.21.15.114:0/3835920527 >> v2:172.21.15.141:3300/0 conn(0x7f13000b42c0 0x7f13000c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f12f7fff640 1 -- 172.21.15.114:0/3835920527 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130006d280 con 0x7f13000c9c40 2023-11-04T01:37:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f12f7fff640 1 -- 172.21.15.114:0/3835920527 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f12f8001a10 con 0x7f13000c9c40 2023-11-04T01:37:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f12f7fff640 1 -- 172.21.15.114:0/3835920527 >> v1:172.21.15.114:6789/0 conn(0x7f13000c9c40 legacy=0x7f1300070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f12f7fff640 1 --2- 172.21.15.114:0/3835920527 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f130015ad80 0x7f12ec003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f12f7fff640 1 --2- 172.21.15.114:0/3835920527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12ec003ef0 0x7f12ec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f12f7fff640 1 --2- 172.21.15.114:0/3835920527 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12ec004d00 0x7f12ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f12f7fff640 1 -- 172.21.15.114:0/3835920527 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130006cd00 con 0x7f12ec003ef0 2023-11-04T01:37:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f12f7fff640 1 -- 172.21.15.114:0/3835920527 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130006cfa0 con 0x7f12ec004d00 2023-11-04T01:37:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f12f7fff640 1 -- 172.21.15.114:0/3835920527 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec00b9b0 con 0x7f130015ad80 2023-11-04T01:37:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f1304d69640 1 --2- 172.21.15.114:0/3835920527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12ec003ef0 0x7f12ec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.117+0000 7f130556a640 1 --2- 172.21.15.114:0/3835920527 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f130015ad80 0x7f12ec003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.118+0000 7f1305d6b640 1 --2- 172.21.15.114:0/3835920527 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12ec004d00 0x7f12ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.118+0000 7f1304d69640 1 -- 172.21.15.114:0/3835920527 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f130015ad80 msgr2=0x7f12ec003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.118+0000 7f1304d69640 1 --2- 172.21.15.114:0/3835920527 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f130015ad80 0x7f12ec003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.118+0000 7f1304d69640 1 -- 172.21.15.114:0/3835920527 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12ec004d00 msgr2=0x7f12ec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.118+0000 7f1304d69640 1 --2- 172.21.15.114:0/3835920527 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12ec004d00 0x7f12ec005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.118+0000 7f1304d69640 1 -- 172.21.15.114:0/3835920527 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec003520 con 0x7f12ec003ef0 2023-11-04T01:37:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.118+0000 7f1304d69640 1 --2- 172.21.15.114:0/3835920527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12ec003ef0 0x7f12ec0047c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009ac0 tx=0x7f12ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209740fc51fa6192 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.118+0000 7f12f7fff640 1 -- 172.21.15.114:0/3835920527 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f002c710 con 0x7f12ec003ef0 2023-11-04T01:37:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.118+0000 7f12f7fff640 1 -- 172.21.15.114:0/3835920527 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f002c870 con 0x7f12ec003ef0 2023-11-04T01:37:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.118+0000 7f12f7fff640 1 -- 172.21.15.114:0/3835920527 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f002cc00 con 0x7f12ec003ef0 2023-11-04T01:37:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.119+0000 7f13077ce640 1 -- 172.21.15.114:0/3835920527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12ec003ef0 msgr2=0x7f12ec0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.119+0000 7f13077ce640 1 --2- 172.21.15.114:0/3835920527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12ec003ef0 0x7f12ec0047c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009ac0 tx=0x7f12ec0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.119+0000 7f1305d6b640 1 -- 172.21.15.114:0/3835920527 reap_dead start 2023-11-04T01:37:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.119+0000 7f13077ce640 1 -- 172.21.15.114:0/3835920527 shutdown_connections 2023-11-04T01:37:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.119+0000 7f13077ce640 1 -- 172.21.15.114:0/3835920527 >> 172.21.15.114:0/3835920527 conn(0x7f13000ce950 msgr2=0x7f13000ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.119+0000 7f13077ce640 1 -- 172.21.15.114:0/3835920527 shutdown_connections 2023-11-04T01:37:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.119+0000 7f13077ce640 1 -- 172.21.15.114:0/3835920527 wait complete. 2023-11-04T01:37:54.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.120+0000 7f13077ce640 1 Processor -- start 2023-11-04T01:37:54.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.120+0000 7f13077ce640 1 -- start start 2023-11-04T01:37:54.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f13077ce640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12ec003ef0 0x7f1300146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f13077ce640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13000c67e0 0x7f13000a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f13077ce640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13000a7a10 0x7f130015d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f13077ce640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1300148160 con 0x7f13000a7a10 2023-11-04T01:37:54.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f13077ce640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000a7ec0 con 0x7f12ec003ef0 2023-11-04T01:37:54.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f13077ce640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130015dee0 con 0x7f13000c67e0 2023-11-04T01:37:54.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f1305d6b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13000a7a10 0x7f130015d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f1305d6b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13000a7a10 0x7f130015d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51252/0 (socket says 172.21.15.114:51252) 2023-11-04T01:37:54.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f1305d6b640 1 -- 172.21.15.114:0/2972754788 learned_addr learned my addr 172.21.15.114:0/2972754788 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:54.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f1304d69640 1 --2- 172.21.15.114:0/2972754788 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13000c67e0 0x7f13000a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f130556a640 1 --2- 172.21.15.114:0/2972754788 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12ec003ef0 0x7f1300146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f1305d6b640 1 -- 172.21.15.114:0/2972754788 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13000c67e0 msgr2=0x7f13000a74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f1305d6b640 1 --2- 172.21.15.114:0/2972754788 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13000c67e0 0x7f13000a74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f1305d6b640 1 -- 172.21.15.114:0/2972754788 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12ec003ef0 msgr2=0x7f1300146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f1305d6b640 1 --2- 172.21.15.114:0/2972754788 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12ec003ef0 0x7f1300146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f1305d6b640 1 -- 172.21.15.114:0/2972754788 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13001477c0 con 0x7f13000a7a10 2023-11-04T01:37:54.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f1304d69640 1 --2- 172.21.15.114:0/2972754788 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13000c67e0 0x7f13000a74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:54.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.121+0000 7f130556a640 1 --2- 172.21.15.114:0/2972754788 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12ec003ef0 0x7f1300146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:54.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.122+0000 7f1305d6b640 1 --2- 172.21.15.114:0/2972754788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13000a7a10 0x7f130015d1b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f12f8000f80 tx=0x7f12f800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.122+0000 7f12f5ffb640 1 -- 172.21.15.114:0/2972754788 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8007ae0 con 0x7f13000a7a10 2023-11-04T01:37:54.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.122+0000 7f12f5ffb640 1 -- 172.21.15.114:0/2972754788 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f800edc0 con 0x7f13000a7a10 2023-11-04T01:37:54.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.122+0000 7f12f5ffb640 1 -- 172.21.15.114:0/2972754788 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8013660 con 0x7f13000a7a10 2023-11-04T01:37:54.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.122+0000 7f13077ce640 1 -- 172.21.15.114:0/2972754788 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1300147aa0 con 0x7f13000a7a10 2023-11-04T01:37:54.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.122+0000 7f13077ce640 1 -- 172.21.15.114:0/2972754788 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13001472b0 con 0x7f13000a7a10 2023-11-04T01:37:54.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.123+0000 7f13077ce640 1 -- 172.21.15.114:0/2972754788 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13001482a0 con 0x7f13000a7a10 2023-11-04T01:37:54.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.123+0000 7f12f5ffb640 1 -- 172.21.15.114:0/2972754788 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f12f80137c0 con 0x7f13000a7a10 2023-11-04T01:37:54.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.124+0000 7f12f5ffb640 1 --2- 172.21.15.114:0/2972754788 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f12e406aea0 0x7f12e406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.124+0000 7f12f5ffb640 1 -- 172.21.15.114:0/2972754788 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f12f8089b40 con 0x7f13000a7a10 2023-11-04T01:37:54.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.124+0000 7f130556a640 1 --2- 172.21.15.114:0/2972754788 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f12e406aea0 0x7f12e406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.124+0000 7f130556a640 1 --2- 172.21.15.114:0/2972754788 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f12e406aea0 0x7f12e406d360 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0099e0 tx=0x7f12fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.128+0000 7f12f5ffb640 1 -- 172.21.15.114:0/2972754788 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f13001482a0 con 0x7f13000a7a10 2023-11-04T01:37:54.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.295+0000 7f13077ce640 1 -- 172.21.15.114:0/2972754788 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13001482a0 con 0x7f13000a7a10 2023-11-04T01:37:54.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.297+0000 7f12f5ffb640 1 -- 172.21.15.114:0/2972754788 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16834 (secure 0 0 0) 0x7f13001482a0 con 0x7f13000a7a10 2023-11-04T01:37:54.299 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:54.299 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":38,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:37:52.653041+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:48.832988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:49.974993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.299+0000 7f13077ce640 1 -- 172.21.15.114:0/2972754788 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f12e406aea0 msgr2=0x7f12e406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.299+0000 7f13077ce640 1 --2- 172.21.15.114:0/2972754788 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f12e406aea0 0x7f12e406d360 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0099e0 tx=0x7f12fc008040 comp rx=0 tx=0).stop 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.299+0000 7f13077ce640 1 -- 172.21.15.114:0/2972754788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13000a7a10 msgr2=0x7f130015d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.299+0000 7f13077ce640 1 --2- 172.21.15.114:0/2972754788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13000a7a10 0x7f130015d1b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f12f8000f80 tx=0x7f12f800e530 comp rx=0 tx=0).stop 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.299+0000 7f13077ce640 1 -- 172.21.15.114:0/2972754788 shutdown_connections 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.299+0000 7f13077ce640 1 --2- 172.21.15.114:0/2972754788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13000a7a10 0x7f130015d1b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.299+0000 7f13077ce640 1 --2- 172.21.15.114:0/2972754788 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13000c67e0 0x7f13000a74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.299+0000 7f13077ce640 1 --2- 172.21.15.114:0/2972754788 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f12e406aea0 0x7f12e406d360 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.299+0000 7f13077ce640 1 --2- 172.21.15.114:0/2972754788 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12ec003ef0 0x7f1300146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.299+0000 7f13077ce640 1 -- 172.21.15.114:0/2972754788 >> 172.21.15.114:0/2972754788 conn(0x7f13000ce950 msgr2=0x7f13000ae450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:54.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.299+0000 7f13077ce640 1 -- 172.21.15.114:0/2972754788 shutdown_connections 2023-11-04T01:37:54.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.299+0000 7f13077ce640 1 -- 172.21.15.114:0/2972754788 wait complete. 2023-11-04T01:37:54.311 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:37:54.312 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:37:54.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.409+0000 7f9e00a44640 1 Processor -- start 2023-11-04T01:37:54.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.409+0000 7f9e00a44640 1 -- start start 2023-11-04T01:37:54.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.410+0000 7f9e00a44640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9dfc0cde60 0x7f9dfc15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.410+0000 7f9e00a44640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dfc15e000 con 0x7f9dfc15daa0 2023-11-04T01:37:54.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.410+0000 7f9e00a44640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dfc15e2e0 con 0x7f9dfc0ce240 2023-11-04T01:37:54.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.410+0000 7f9e00a44640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc15e5c0 con 0x7f9dfc0cde60 2023-11-04T01:37:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.410+0000 7f9df3fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9dfc15daa0 0x7f9dfc157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60640/0 (socket says 172.21.15.114:60640) 2023-11-04T01:37:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.410+0000 7f9df3fff640 1 -- 172.21.15.114:0/4125292697 learned_addr learned my addr 172.21.15.114:0/4125292697 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.410+0000 7f9dfa59c640 1 --2- 172.21.15.114:0/4125292697 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9dfc0cde60 0x7f9dfc15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.410+0000 7f9df9d9b640 1 -- 172.21.15.114:0/4125292697 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972216009 0 0) 0x7f9dfc15e000 con 0x7f9dfc15daa0 2023-11-04T01:37:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9df9d9b640 1 -- 172.21.15.114:0/4125292697 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9de8003520 con 0x7f9dfc15daa0 2023-11-04T01:37:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9df9d9b640 1 -- 172.21.15.114:0/4125292697 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3770380218 0 0) 0x7f9de8003520 con 0x7f9dfc15daa0 2023-11-04T01:37:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9df9d9b640 1 -- 172.21.15.114:0/4125292697 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9dfc0cde60 msgr2=0x7f9dfc15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9df9d9b640 1 --2- 172.21.15.114:0/4125292697 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9dfc0cde60 0x7f9dfc15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9df9d9b640 1 -- 172.21.15.114:0/4125292697 >> v1:172.21.15.141:6789/0 conn(0x7f9dfc0ce240 legacy=0x7f9dfc0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9df9d9b640 1 -- 172.21.15.114:0/4125292697 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc0d1120 con 0x7f9dfc15daa0 2023-11-04T01:37:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9df9d9b640 1 -- 172.21.15.114:0/4125292697 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f9de4001670 con 0x7f9dfc15daa0 2023-11-04T01:37:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9df9d9b640 1 -- 172.21.15.114:0/4125292697 >> v1:172.21.15.114:6789/0 conn(0x7f9dfc15daa0 legacy=0x7f9dfc157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9df9d9b640 1 --2- 172.21.15.114:0/4125292697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9de80039a0 0x7f9de8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9df9d9b640 1 --2- 172.21.15.114:0/4125292697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9de8004350 0x7f9de8004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9df9d9b640 1 --2- 172.21.15.114:0/4125292697 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9dfc0cde60 0x7f9de8005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9df9d9b640 1 -- 172.21.15.114:0/4125292697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc15e5c0 con 0x7f9de80039a0 2023-11-04T01:37:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9df9d9b640 1 -- 172.21.15.114:0/4125292697 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de800b980 con 0x7f9de8004350 2023-11-04T01:37:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9df9d9b640 1 -- 172.21.15.114:0/4125292697 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de800bb40 con 0x7f9dfc0cde60 2023-11-04T01:37:54.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9dfa59c640 1 --2- 172.21.15.114:0/4125292697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9de80039a0 0x7f9de8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9df3fff640 1 --2- 172.21.15.114:0/4125292697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9de8004350 0x7f9de8004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9dfad9d640 1 --2- 172.21.15.114:0/4125292697 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9dfc0cde60 0x7f9de8005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9dfa59c640 1 -- 172.21.15.114:0/4125292697 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9dfc0cde60 msgr2=0x7f9de8005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:54.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9dfa59c640 1 --2- 172.21.15.114:0/4125292697 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9dfc0cde60 0x7f9de8005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9dfa59c640 1 -- 172.21.15.114:0/4125292697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9de8004350 msgr2=0x7f9de8004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:54.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9dfa59c640 1 --2- 172.21.15.114:0/4125292697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9de8004350 0x7f9de8004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9dfa59c640 1 -- 172.21.15.114:0/4125292697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de8003520 con 0x7f9de80039a0 2023-11-04T01:37:54.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.411+0000 7f9df3fff640 1 --2- 172.21.15.114:0/4125292697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9de8004350 0x7f9de8004820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:54.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.412+0000 7f9dfa59c640 1 --2- 172.21.15.114:0/4125292697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9de80039a0 0x7f9de8003d80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009ac0 tx=0x7f9de80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78faec2e5f65d548 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.412+0000 7f9df9d9b640 1 -- 172.21.15.114:0/4125292697 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec02c6b0 con 0x7f9de80039a0 2023-11-04T01:37:54.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.412+0000 7f9df9d9b640 1 -- 172.21.15.114:0/4125292697 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec02c810 con 0x7f9de80039a0 2023-11-04T01:37:54.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.412+0000 7f9df9d9b640 1 -- 172.21.15.114:0/4125292697 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec02cba0 con 0x7f9de80039a0 2023-11-04T01:37:54.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.413+0000 7f9e00a44640 1 -- 172.21.15.114:0/4125292697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9de80039a0 msgr2=0x7f9de8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.413+0000 7f9e00a44640 1 --2- 172.21.15.114:0/4125292697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9de80039a0 0x7f9de8003d80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009ac0 tx=0x7f9de80057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.413+0000 7f9dfad9d640 1 -- 172.21.15.114:0/4125292697 reap_dead start 2023-11-04T01:37:54.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.413+0000 7f9e00a44640 1 -- 172.21.15.114:0/4125292697 shutdown_connections 2023-11-04T01:37:54.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.413+0000 7f9e00a44640 1 -- 172.21.15.114:0/4125292697 >> 172.21.15.114:0/4125292697 conn(0x7f9dfc071f30 msgr2=0x7f9dfc0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:54.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.413+0000 7f9e00a44640 1 -- 172.21.15.114:0/4125292697 shutdown_connections 2023-11-04T01:37:54.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.413+0000 7f9e00a44640 1 -- 172.21.15.114:0/4125292697 wait complete. 2023-11-04T01:37:54.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.414+0000 7f9e00a44640 1 Processor -- start 2023-11-04T01:37:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.414+0000 7f9e00a44640 1 -- start start 2023-11-04T01:37:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9e00a44640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9de80039a0 0x7f9dfc14e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9e00a44640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dfc154b40 0x7f9dfc14ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9e00a44640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9dfc0d1820 0x7f9dfc0d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9e00a44640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc150560 con 0x7f9dfc154b40 2023-11-04T01:37:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9e00a44640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0d21f0 con 0x7f9de80039a0 2023-11-04T01:37:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9e00a44640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc14ff60 con 0x7f9dfc0d1820 2023-11-04T01:37:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9df3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dfc154b40 0x7f9dfc14ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9df3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dfc154b40 0x7f9dfc14ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51270/0 (socket says 172.21.15.114:51270) 2023-11-04T01:37:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9df3fff640 1 -- 172.21.15.114:0/2429711862 learned_addr learned my addr 172.21.15.114:0/2429711862 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9df3fff640 1 -- 172.21.15.114:0/2429711862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9dfc0d1820 msgr2=0x7f9dfc0d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9df3fff640 1 --2- 172.21.15.114:0/2429711862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9dfc0d1820 0x7f9dfc0d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9df3fff640 1 -- 172.21.15.114:0/2429711862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9de80039a0 msgr2=0x7f9dfc14e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9df3fff640 1 --2- 172.21.15.114:0/2429711862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9de80039a0 0x7f9dfc14e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9df3fff640 1 -- 172.21.15.114:0/2429711862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc14f6c0 con 0x7f9dfc154b40 2023-11-04T01:37:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9df3fff640 1 --2- 172.21.15.114:0/2429711862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dfc154b40 0x7f9dfc14ee70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9de400e8c0 tx=0x7f9de400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9df2ffd640 1 -- 172.21.15.114:0/2429711862 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4005240 con 0x7f9dfc154b40 2023-11-04T01:37:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9df2ffd640 1 -- 172.21.15.114:0/2429711862 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de40053a0 con 0x7f9dfc154b40 2023-11-04T01:37:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9e00a44640 1 -- 172.21.15.114:0/2429711862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc14f9a0 con 0x7f9dfc154b40 2023-11-04T01:37:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9df2ffd640 1 -- 172.21.15.114:0/2429711862 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de40047e0 con 0x7f9dfc154b40 2023-11-04T01:37:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.415+0000 7f9e00a44640 1 -- 172.21.15.114:0/2429711862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc14f3b0 con 0x7f9dfc154b40 2023-11-04T01:37:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.416+0000 7f9e00a44640 1 -- 172.21.15.114:0/2429711862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc1506a0 con 0x7f9dfc154b40 2023-11-04T01:37:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.417+0000 7f9df2ffd640 1 -- 172.21.15.114:0/2429711862 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9de4004940 con 0x7f9dfc154b40 2023-11-04T01:37:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.417+0000 7f9df2ffd640 1 --2- 172.21.15.114:0/2429711862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ddc06ae70 0x7f9ddc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.417+0000 7f9df2ffd640 1 -- 172.21.15.114:0/2429711862 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9de4089130 con 0x7f9dfc154b40 2023-11-04T01:37:54.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.417+0000 7f9dfa59c640 1 --2- 172.21.15.114:0/2429711862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ddc06ae70 0x7f9ddc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.418+0000 7f9dfa59c640 1 --2- 172.21.15.114:0/2429711862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ddc06ae70 0x7f9ddc06d330 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009ac0 tx=0x7f9dec02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.421+0000 7f9df2ffd640 1 -- 172.21.15.114:0/2429711862 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9dfc1506a0 con 0x7f9dfc154b40 2023-11-04T01:37:54.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.584+0000 7f9e00a44640 1 -- 172.21.15.114:0/2429711862 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9dfc0d1400 con 0x7f9ddc06ae70 2023-11-04T01:37:54.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.591+0000 7f9df2ffd640 1 -- 172.21.15.114:0/2429711862 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289243 (secure 0 0 0) 0x7f9dec02c980 con 0x7f9ddc06ae70 2023-11-04T01:37:54.596 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:54.597 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:37:54.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.594+0000 7f9e00a44640 1 -- 172.21.15.114:0/2429711862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ddc06ae70 msgr2=0x7f9ddc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.594+0000 7f9e00a44640 1 --2- 172.21.15.114:0/2429711862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ddc06ae70 0x7f9ddc06d330 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009ac0 tx=0x7f9dec02e000 comp rx=0 tx=0).stop 2023-11-04T01:37:54.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.594+0000 7f9e00a44640 1 -- 172.21.15.114:0/2429711862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dfc154b40 msgr2=0x7f9dfc14ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.594+0000 7f9e00a44640 1 --2- 172.21.15.114:0/2429711862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dfc154b40 0x7f9dfc14ee70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9de400e8c0 tx=0x7f9de400ed80 comp rx=0 tx=0).stop 2023-11-04T01:37:54.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.594+0000 7f9e00a44640 1 -- 172.21.15.114:0/2429711862 shutdown_connections 2023-11-04T01:37:54.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.594+0000 7f9e00a44640 1 --2- 172.21.15.114:0/2429711862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9dfc0d1820 0x7f9dfc0d1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.594+0000 7f9e00a44640 1 --2- 172.21.15.114:0/2429711862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9dfc154b40 0x7f9dfc14ee70 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.594+0000 7f9e00a44640 1 --2- 172.21.15.114:0/2429711862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ddc06ae70 0x7f9ddc06d330 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.594+0000 7f9e00a44640 1 --2- 172.21.15.114:0/2429711862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9de80039a0 0x7f9dfc14e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.594+0000 7f9e00a44640 1 -- 172.21.15.114:0/2429711862 >> 172.21.15.114:0/2429711862 conn(0x7f9dfc071f30 msgr2=0x7f9dfc0b8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:54.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.594+0000 7f9e00a44640 1 -- 172.21.15.114:0/2429711862 shutdown_connections 2023-11-04T01:37:54.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.594+0000 7f9e00a44640 1 -- 172.21.15.114:0/2429711862 wait complete. 2023-11-04T01:37:54.607 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-11-04T01:37:53.875469+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220716,"kb_used_data":4552,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754004,"statfs":{"total":773094113280,"available":772868100096,"internally_reserved":0,"allocated":4661248,"data_stored":2640468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.229250"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.673333+0000","last_change":"2023-11-04T01:37:51.669686+0000","last_active":"2023-11-04T01:37:51.673333+0000","last_peered":"2023-11-04T01:37:51.673333+0000","last_clean":"2023-11-04T01:37:51.673333+0000","last_became_active":"2023-11-04T01:37:51.669390+0000","last_became_peered":"2023-11-04T01:37:51.669390+0000","last_unstale":"2023-11-04T01:37:51.673333+0000","last_undegraded":"2023-11-04T01:37:51.673333+0000","last_fullsized":"2023-11-04T01:37:51.673333+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:57.022471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.675305+0000","last_change":"2023-11-04T01:37:51.669986+0000","last_active":"2023-11-04T01:37:51.675305+0000","last_peered":"2023-11-04T01:37:51.675305+0000","last_clean":"2023-11-04T01:37:51.675305+0000","last_became_active":"2023-11-04T01:37:51.668972+0000","last_became_peered":"2023-11-04T01:37:51.668972+0000","last_unstale":"2023-11-04T01:37:51.675305+0000","last_undegraded":"2023-11-04T01:37:51.675305+0000","last_fullsized":"2023-11-04T01:37:51.675305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:50.350752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.692824+0000","last_change":"2023-11-04T01:37:51.688534+0000","last_active":"2023-11-04T01:37:51.692824+0000","last_peered":"2023-11-04T01:37:51.692824+0000","last_clean":"2023-11-04T01:37:51.692824+0000","last_became_active":"2023-11-04T01:37:51.688254+0000","last_became_peered":"2023-11-04T01:37:51.688254+0000","last_unstale":"2023-11-04T01:37:51.692824+0000","last_undegraded":"2023-11-04T01:37:51.692824+0000","last_fullsized":"2023-11-04T01:37:51.692824+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:06.097394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.669222+0000","last_change":"2023-11-04T01:37:51.667977+0000","last_active":"2023-11-04T01:37:51.669222+0000","last_peered":"2023-11-04T01:37:51.669222+0000","last_clean":"2023-11-04T01:37:51.669222+0000","last_became_active":"2023-11-04T01:37:51.667713+0000","last_became_peered":"2023-11-04T01:37:51.667713+0000","last_unstale":"2023-11-04T01:37:51.669222+0000","last_undegraded":"2023-11-04T01:37:51.669222+0000","last_fullsized":"2023-11-04T01:37:51.669222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:09:37.542747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.672033+0000","last_change":"2023-11-04T01:37:51.666767+0000","last_active":"2023-11-04T01:37:51.672033+0000","last_peered":"2023-11-04T01:37:51.672033+0000","last_clean":"2023-11-04T01:37:51.672033+0000","last_became_active":"2023-11-04T01:37:51.666519+0000","last_became_peered":"2023-11-04T01:37:51.666519+0000","last_unstale":"2023-11-04T01:37:51.672033+0000","last_undegraded":"2023-11-04T01:37:51.672033+0000","last_fullsized":"2023-11-04T01:37:51.672033+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:52.510081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.670814+0000","last_change":"2023-11-04T01:37:51.669480+0000","last_active":"2023-11-04T01:37:51.670814+0000","last_peered":"2023-11-04T01:37:51.670814+0000","last_clean":"2023-11-04T01:37:51.670814+0000","last_became_active":"2023-11-04T01:37:51.669133+0000","last_became_peered":"2023-11-04T01:37:51.669133+0000","last_unstale":"2023-11-04T01:37:51.670814+0000","last_undegraded":"2023-11-04T01:37:51.670814+0000","last_fullsized":"2023-11-04T01:37:51.670814+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:33:43.729417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.686804+0000","last_change":"2023-11-04T01:37:51.684208+0000","last_active":"2023-11-04T01:37:51.686804+0000","last_peered":"2023-11-04T01:37:51.686804+0000","last_clean":"2023-11-04T01:37:51.686804+0000","last_became_active":"2023-11-04T01:37:51.683892+0000","last_became_peered":"2023-11-04T01:37:51.683892+0000","last_unstale":"2023-11-04T01:37:51.686804+0000","last_undegraded":"2023-11-04T01:37:51.686804+0000","last_fullsized":"2023-11-04T01:37:51.686804+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:58:46.698096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.692705+0000","last_change":"2023-11-04T01:37:51.688317+0000","last_active":"2023-11-04T01:37:51.692705+0000","last_peered":"2023-11-04T01:37:51.692705+0000","last_clean":"2023-11-04T01:37:51.692705+0000","last_became_active":"2023-11-04T01:37:51.688044+0000","last_became_peered":"2023-11-04T01:37:51.688044+0000","last_unstale":"2023-11-04T01:37:51.692705+0000","last_undegraded":"2023-11-04T01:37:51.692705+0000","last_fullsized":"2023-11-04T01:37:51.692705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:57.911928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.687264+0000","last_change":"2023-11-04T01:37:51.684166+0000","last_active":"2023-11-04T01:37:51.687264+0000","last_peered":"2023-11-04T01:37:51.687264+0000","last_clean":"2023-11-04T01:37:51.687264+0000","last_became_active":"2023-11-04T01:37:51.683787+0000","last_became_peered":"2023-11-04T01:37:51.683787+0000","last_unstale":"2023-11-04T01:37:51.687264+0000","last_undegraded":"2023-11-04T01:37:51.687264+0000","last_fullsized":"2023-11-04T01:37:51.687264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:53.910104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.691064+0000","last_change":"2023-11-04T01:37:51.689875+0000","last_active":"2023-11-04T01:37:51.691064+0000","last_peered":"2023-11-04T01:37:51.691064+0000","last_clean":"2023-11-04T01:37:51.691064+0000","last_became_active":"2023-11-04T01:37:51.689608+0000","last_became_peered":"2023-11-04T01:37:51.689608+0000","last_unstale":"2023-11-04T01:37:51.691064+0000","last_undegraded":"2023-11-04T01:37:51.691064+0000","last_fullsized":"2023-11-04T01:37:51.691064+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:26.753300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.690093+0000","last_change":"2023-11-04T01:37:51.687955+0000","last_active":"2023-11-04T01:37:51.690093+0000","last_peered":"2023-11-04T01:37:51.690093+0000","last_clean":"2023-11-04T01:37:51.690093+0000","last_became_active":"2023-11-04T01:37:51.687668+0000","last_became_peered":"2023-11-04T01:37:51.687668+0000","last_unstale":"2023-11-04T01:37:51.690093+0000","last_undegraded":"2023-11-04T01:37:51.690093+0000","last_fullsized":"2023-11-04T01:37:51.690093+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:11:44.446974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.668823+0000","last_change":"2023-11-04T01:37:51.665741+0000","last_active":"2023-11-04T01:37:51.668823+0000","last_peered":"2023-11-04T01:37:51.668823+0000","last_clean":"2023-11-04T01:37:51.668823+0000","last_became_active":"2023-11-04T01:37:51.665482+0000","last_became_peered":"2023-11-04T01:37:51.665482+0000","last_unstale":"2023-11-04T01:37:51.668823+0000","last_undegraded":"2023-11-04T01:37:51.668823+0000","last_fullsized":"2023-11-04T01:37:51.668823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:22:21.689351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.690015+0000","last_change":"2023-11-04T01:37:51.686971+0000","last_active":"2023-11-04T01:37:51.690015+0000","last_peered":"2023-11-04T01:37:51.690015+0000","last_clean":"2023-11-04T01:37:51.690015+0000","last_became_active":"2023-11-04T01:37:51.684583+0000","last_became_peered":"2023-11-04T01:37:51.684583+0000","last_unstale":"2023-11-04T01:37:51.690015+0000","last_undegraded":"2023-11-04T01:37:51.690015+0000","last_fullsized":"2023-11-04T01:37:51.690015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:05.716469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659487+0000","last_change":"2023-11-04T01:37:51.675081+0000","last_active":"2023-11-04T01:37:52.659487+0000","last_peered":"2023-11-04T01:37:52.659487+0000","last_clean":"2023-11-04T01:37:52.659487+0000","last_became_active":"2023-11-04T01:37:51.674775+0000","last_became_peered":"2023-11-04T01:37:51.674775+0000","last_unstale":"2023-11-04T01:37:52.659487+0000","last_undegraded":"2023-11-04T01:37:52.659487+0000","last_fullsized":"2023-11-04T01:37:52.659487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:11:44.446974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.689992+0000","last_change":"2023-11-04T01:37:51.686054+0000","last_active":"2023-11-04T01:37:51.689992+0000","last_peered":"2023-11-04T01:37:51.689992+0000","last_clean":"2023-11-04T01:37:51.689992+0000","last_became_active":"2023-11-04T01:37:51.685776+0000","last_became_peered":"2023-11-04T01:37:51.685776+0000","last_unstale":"2023-11-04T01:37:51.689992+0000","last_undegraded":"2023-11-04T01:37:51.689992+0000","last_fullsized":"2023-11-04T01:37:51.689992+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:18:50.143680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659413+0000","last_change":"2023-11-04T01:37:51.681061+0000","last_active":"2023-11-04T01:37:52.659413+0000","last_peered":"2023-11-04T01:37:52.659413+0000","last_clean":"2023-11-04T01:37:52.659413+0000","last_became_active":"2023-11-04T01:37:51.680540+0000","last_became_peered":"2023-11-04T01:37:51.680540+0000","last_unstale":"2023-11-04T01:37:52.659413+0000","last_undegraded":"2023-11-04T01:37:52.659413+0000","last_fullsized":"2023-11-04T01:37:52.659413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:37.935830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660876+0000","last_change":"2023-11-04T01:37:51.686787+0000","last_active":"2023-11-04T01:37:52.660876+0000","last_peered":"2023-11-04T01:37:52.660876+0000","last_clean":"2023-11-04T01:37:52.660876+0000","last_became_active":"2023-11-04T01:37:51.686510+0000","last_became_peered":"2023-11-04T01:37:51.686510+0000","last_unstale":"2023-11-04T01:37:52.660876+0000","last_undegraded":"2023-11-04T01:37:52.660876+0000","last_fullsized":"2023-11-04T01:37:52.660876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:42.624679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659722+0000","last_change":"2023-11-04T01:37:51.673023+0000","last_active":"2023-11-04T01:37:52.659722+0000","last_peered":"2023-11-04T01:37:52.659722+0000","last_clean":"2023-11-04T01:37:52.659722+0000","last_became_active":"2023-11-04T01:37:51.672776+0000","last_became_peered":"2023-11-04T01:37:51.672776+0000","last_unstale":"2023-11-04T01:37:52.659722+0000","last_undegraded":"2023-11-04T01:37:52.659722+0000","last_fullsized":"2023-11-04T01:37:52.659722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:02.664258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.672756+0000","last_change":"2023-11-04T01:37:51.671494+0000","last_active":"2023-11-04T01:37:51.672756+0000","last_peered":"2023-11-04T01:37:51.672756+0000","last_clean":"2023-11-04T01:37:51.672756+0000","last_became_active":"2023-11-04T01:37:51.671168+0000","last_became_peered":"2023-11-04T01:37:51.671168+0000","last_unstale":"2023-11-04T01:37:51.672756+0000","last_undegraded":"2023-11-04T01:37:51.672756+0000","last_fullsized":"2023-11-04T01:37:51.672756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:15.558683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659893+0000","last_change":"2023-11-04T01:37:51.673693+0000","last_active":"2023-11-04T01:37:52.659893+0000","last_peered":"2023-11-04T01:37:52.659893+0000","last_clean":"2023-11-04T01:37:52.659893+0000","last_became_active":"2023-11-04T01:37:51.673450+0000","last_became_peered":"2023-11-04T01:37:51.673450+0000","last_unstale":"2023-11-04T01:37:52.659893+0000","last_undegraded":"2023-11-04T01:37:52.659893+0000","last_fullsized":"2023-11-04T01:37:52.659893+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:06.097394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.686695+0000","last_change":"2023-11-04T01:37:51.678495+0000","last_active":"2023-11-04T01:37:51.686695+0000","last_peered":"2023-11-04T01:37:51.686695+0000","last_clean":"2023-11-04T01:37:51.686695+0000","last_became_active":"2023-11-04T01:37:51.677859+0000","last_became_peered":"2023-11-04T01:37:51.677859+0000","last_unstale":"2023-11-04T01:37:51.686695+0000","last_undegraded":"2023-11-04T01:37:51.686695+0000","last_fullsized":"2023-11-04T01:37:51.686695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:57.911928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659959+0000","last_change":"2023-11-04T01:37:51.669930+0000","last_active":"2023-11-04T01:37:52.659959+0000","last_peered":"2023-11-04T01:37:52.659959+0000","last_clean":"2023-11-04T01:37:52.659959+0000","last_became_active":"2023-11-04T01:37:51.669630+0000","last_became_peered":"2023-11-04T01:37:51.669630+0000","last_unstale":"2023-11-04T01:37:52.659959+0000","last_undegraded":"2023-11-04T01:37:52.659959+0000","last_fullsized":"2023-11-04T01:37:52.659959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:13:41.359983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660610+0000","last_change":"2023-11-04T01:37:51.676781+0000","last_active":"2023-11-04T01:37:52.660610+0000","last_peered":"2023-11-04T01:37:52.660610+0000","last_clean":"2023-11-04T01:37:52.660610+0000","last_became_active":"2023-11-04T01:37:51.676095+0000","last_became_peered":"2023-11-04T01:37:51.676095+0000","last_unstale":"2023-11-04T01:37:52.660610+0000","last_undegraded":"2023-11-04T01:37:52.660610+0000","last_fullsized":"2023-11-04T01:37:52.660610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:40.118759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.668571+0000","last_change":"2023-11-04T01:37:51.665733+0000","last_active":"2023-11-04T01:37:51.668571+0000","last_peered":"2023-11-04T01:37:51.668571+0000","last_clean":"2023-11-04T01:37:51.668571+0000","last_became_active":"2023-11-04T01:37:51.664841+0000","last_became_peered":"2023-11-04T01:37:51.664841+0000","last_unstale":"2023-11-04T01:37:51.668571+0000","last_undegraded":"2023-11-04T01:37:51.668571+0000","last_fullsized":"2023-11-04T01:37:51.668571+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:18:30.107659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660259+0000","last_change":"2023-11-04T01:37:51.672401+0000","last_active":"2023-11-04T01:37:52.660259+0000","last_peered":"2023-11-04T01:37:52.660259+0000","last_clean":"2023-11-04T01:37:52.660259+0000","last_became_active":"2023-11-04T01:37:51.671284+0000","last_became_peered":"2023-11-04T01:37:51.671284+0000","last_unstale":"2023-11-04T01:37:52.660259+0000","last_undegraded":"2023-11-04T01:37:52.660259+0000","last_fullsized":"2023-11-04T01:37:52.660259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:57.911928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.692492+0000","last_change":"2023-11-04T01:37:51.687747+0000","last_active":"2023-11-04T01:37:51.692492+0000","last_peered":"2023-11-04T01:37:51.692492+0000","last_clean":"2023-11-04T01:37:51.692492+0000","last_became_active":"2023-11-04T01:37:51.687462+0000","last_became_peered":"2023-11-04T01:37:51.687462+0000","last_unstale":"2023-11-04T01:37:51.692492+0000","last_undegraded":"2023-11-04T01:37:51.692492+0000","last_fullsized":"2023-11-04T01:37:51.692492+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:53.910104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660026+0000","last_change":"2023-11-04T01:37:51.674294+0000","last_active":"2023-11-04T01:37:52.660026+0000","last_peered":"2023-11-04T01:37:52.660026+0000","last_clean":"2023-11-04T01:37:52.660026+0000","last_became_active":"2023-11-04T01:37:51.674034+0000","last_became_peered":"2023-11-04T01:37:51.674034+0000","last_unstale":"2023-11-04T01:37:52.660026+0000","last_undegraded":"2023-11-04T01:37:52.660026+0000","last_fullsized":"2023-11-04T01:37:52.660026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:39.631497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.690086+0000","last_change":"2023-11-04T01:37:51.687075+0000","last_active":"2023-11-04T01:37:51.690086+0000","last_peered":"2023-11-04T01:37:51.690086+0000","last_clean":"2023-11-04T01:37:51.690086+0000","last_became_active":"2023-11-04T01:37:51.686827+0000","last_became_peered":"2023-11-04T01:37:51.686827+0000","last_unstale":"2023-11-04T01:37:51.690086+0000","last_undegraded":"2023-11-04T01:37:51.690086+0000","last_fullsized":"2023-11-04T01:37:51.690086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:57.022471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660268+0000","last_change":"2023-11-04T01:37:51.671479+0000","last_active":"2023-11-04T01:37:52.660268+0000","last_peered":"2023-11-04T01:37:52.660268+0000","last_clean":"2023-11-04T01:37:52.660268+0000","last_became_active":"2023-11-04T01:37:51.671214+0000","last_became_peered":"2023-11-04T01:37:51.671214+0000","last_unstale":"2023-11-04T01:37:52.660268+0000","last_undegraded":"2023-11-04T01:37:52.660268+0000","last_fullsized":"2023-11-04T01:37:52.660268+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:24.938168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660035+0000","last_change":"2023-11-04T01:37:51.672117+0000","last_active":"2023-11-04T01:37:52.660035+0000","last_peered":"2023-11-04T01:37:52.660035+0000","last_clean":"2023-11-04T01:37:52.660035+0000","last_became_active":"2023-11-04T01:37:51.671839+0000","last_became_peered":"2023-11-04T01:37:51.671839+0000","last_unstale":"2023-11-04T01:37:52.660035+0000","last_undegraded":"2023-11-04T01:37:52.660035+0000","last_fullsized":"2023-11-04T01:37:52.660035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:31:33.046618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.661042+0000","last_change":"2023-11-04T01:37:51.677044+0000","last_active":"2023-11-04T01:37:52.661042+0000","last_peered":"2023-11-04T01:37:52.661042+0000","last_clean":"2023-11-04T01:37:52.661042+0000","last_became_active":"2023-11-04T01:37:51.676614+0000","last_became_peered":"2023-11-04T01:37:51.676614+0000","last_unstale":"2023-11-04T01:37:52.661042+0000","last_undegraded":"2023-11-04T01:37:52.661042+0000","last_fullsized":"2023-11-04T01:37:52.661042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:28.686720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.666512+0000","last_change":"2023-11-04T01:37:51.663160+0000","last_active":"2023-11-04T01:37:51.666512+0000","last_peered":"2023-11-04T01:37:51.666512+0000","last_clean":"2023-11-04T01:37:51.666512+0000","last_became_active":"2023-11-04T01:37:51.662862+0000","last_became_peered":"2023-11-04T01:37:51.662862+0000","last_unstale":"2023-11-04T01:37:51.666512+0000","last_undegraded":"2023-11-04T01:37:51.666512+0000","last_fullsized":"2023-11-04T01:37:51.666512+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:04:33.686040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660973+0000","last_change":"2023-11-04T01:37:51.690598+0000","last_active":"2023-11-04T01:37:52.660973+0000","last_peered":"2023-11-04T01:37:52.660973+0000","last_clean":"2023-11-04T01:37:52.660973+0000","last_became_active":"2023-11-04T01:37:51.690318+0000","last_became_peered":"2023-11-04T01:37:51.690318+0000","last_unstale":"2023-11-04T01:37:52.660973+0000","last_undegraded":"2023-11-04T01:37:52.660973+0000","last_fullsized":"2023-11-04T01:37:52.660973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:31.962004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660353+0000","last_change":"2023-11-04T01:37:50.663198+0000","last_active":"2023-11-04T01:37:52.660353+0000","last_peered":"2023-11-04T01:37:52.660353+0000","last_clean":"2023-11-04T01:37:52.660353+0000","last_became_active":"2023-11-04T01:37:50.662937+0000","last_became_peered":"2023-11-04T01:37:50.662937+0000","last_unstale":"2023-11-04T01:37:52.660353+0000","last_undegraded":"2023-11-04T01:37:52.660353+0000","last_fullsized":"2023-11-04T01:37:52.660353+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:22:20.687375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.692565+0000","last_change":"2023-11-04T01:37:51.688398+0000","last_active":"2023-11-04T01:37:51.692565+0000","last_peered":"2023-11-04T01:37:51.692565+0000","last_clean":"2023-11-04T01:37:51.692565+0000","last_became_active":"2023-11-04T01:37:51.688129+0000","last_became_peered":"2023-11-04T01:37:51.688129+0000","last_unstale":"2023-11-04T01:37:51.692565+0000","last_undegraded":"2023-11-04T01:37:51.692565+0000","last_fullsized":"2023-11-04T01:37:51.692565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:02.664258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.688886+0000","last_change":"2023-11-04T01:37:50.666934+0000","last_active":"2023-11-04T01:37:51.688886+0000","last_peered":"2023-11-04T01:37:51.688886+0000","last_clean":"2023-11-04T01:37:51.688886+0000","last_became_active":"2023-11-04T01:37:50.666689+0000","last_became_peered":"2023-11-04T01:37:50.666689+0000","last_unstale":"2023-11-04T01:37:51.688886+0000","last_undegraded":"2023-11-04T01:37:51.688886+0000","last_fullsized":"2023-11-04T01:37:51.688886+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:11:43.444999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660210+0000","last_change":"2023-11-04T01:37:51.675916+0000","last_active":"2023-11-04T01:37:52.660210+0000","last_peered":"2023-11-04T01:37:52.660210+0000","last_clean":"2023-11-04T01:37:52.660210+0000","last_became_active":"2023-11-04T01:37:51.675555+0000","last_became_peered":"2023-11-04T01:37:51.675555+0000","last_unstale":"2023-11-04T01:37:52.660210+0000","last_undegraded":"2023-11-04T01:37:52.660210+0000","last_fullsized":"2023-11-04T01:37:52.660210+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:57.022471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.688991+0000","last_change":"2023-11-04T01:37:50.666093+0000","last_active":"2023-11-04T01:37:51.688991+0000","last_peered":"2023-11-04T01:37:51.688991+0000","last_clean":"2023-11-04T01:37:51.688991+0000","last_became_active":"2023-11-04T01:37:50.665831+0000","last_became_peered":"2023-11-04T01:37:50.665831+0000","last_unstale":"2023-11-04T01:37:51.688991+0000","last_undegraded":"2023-11-04T01:37:51.688991+0000","last_fullsized":"2023-11-04T01:37:51.688991+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:56.909953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.677805+0000","last_change":"2023-11-04T01:37:51.675119+0000","last_active":"2023-11-04T01:37:51.677805+0000","last_peered":"2023-11-04T01:37:51.677805+0000","last_clean":"2023-11-04T01:37:51.677805+0000","last_became_active":"2023-11-04T01:37:51.674303+0000","last_became_peered":"2023-11-04T01:37:51.674303+0000","last_unstale":"2023-11-04T01:37:51.677805+0000","last_undegraded":"2023-11-04T01:37:51.677805+0000","last_fullsized":"2023-11-04T01:37:51.677805+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:05.716469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660487+0000","last_change":"2023-11-04T01:37:50.673293+0000","last_active":"2023-11-04T01:37:52.660487+0000","last_peered":"2023-11-04T01:37:52.660487+0000","last_clean":"2023-11-04T01:37:52.660487+0000","last_became_active":"2023-11-04T01:37:50.672998+0000","last_became_peered":"2023-11-04T01:37:50.672998+0000","last_unstale":"2023-11-04T01:37:52.660487+0000","last_undegraded":"2023-11-04T01:37:52.660487+0000","last_fullsized":"2023-11-04T01:37:52.660487+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:56.909953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.673191+0000","last_change":"2023-11-04T01:37:51.668218+0000","last_active":"2023-11-04T01:37:51.673191+0000","last_peered":"2023-11-04T01:37:51.673191+0000","last_clean":"2023-11-04T01:37:51.673191+0000","last_became_active":"2023-11-04T01:37:51.667895+0000","last_became_peered":"2023-11-04T01:37:51.667895+0000","last_unstale":"2023-11-04T01:37:51.673191+0000","last_undegraded":"2023-11-04T01:37:51.673191+0000","last_fullsized":"2023-11-04T01:37:51.673191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:24.938168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.690101+0000","last_change":"2023-11-04T01:37:50.672640+0000","last_active":"2023-11-04T01:37:51.690101+0000","last_peered":"2023-11-04T01:37:51.690101+0000","last_clean":"2023-11-04T01:37:51.690101+0000","last_became_active":"2023-11-04T01:37:50.672200+0000","last_became_peered":"2023-11-04T01:37:50.672200+0000","last_unstale":"2023-11-04T01:37:51.690101+0000","last_undegraded":"2023-11-04T01:37:51.690101+0000","last_fullsized":"2023-11-04T01:37:51.690101+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:54:19.819631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.686787+0000","last_change":"2023-11-04T01:37:51.679310+0000","last_active":"2023-11-04T01:37:51.686787+0000","last_peered":"2023-11-04T01:37:51.686787+0000","last_clean":"2023-11-04T01:37:51.686787+0000","last_became_active":"2023-11-04T01:37:51.679065+0000","last_became_peered":"2023-11-04T01:37:51.679065+0000","last_unstale":"2023-11-04T01:37:51.686787+0000","last_undegraded":"2023-11-04T01:37:51.686787+0000","last_fullsized":"2023-11-04T01:37:51.686787+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:24.938168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660745+0000","last_change":"2023-11-04T01:37:50.662404+0000","last_active":"2023-11-04T01:37:52.660745+0000","last_peered":"2023-11-04T01:37:52.660745+0000","last_clean":"2023-11-04T01:37:52.660745+0000","last_became_active":"2023-11-04T01:37:50.662138+0000","last_became_peered":"2023-11-04T01:37:50.662138+0000","last_unstale":"2023-11-04T01:37:52.660745+0000","last_undegraded":"2023-11-04T01:37:52.660745+0000","last_fullsized":"2023-11-04T01:37:52.660745+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:58:45.696121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659822+0000","last_change":"2023-11-04T01:37:51.681291+0000","last_active":"2023-11-04T01:37:52.659822+0000","last_peered":"2023-11-04T01:37:52.659822+0000","last_clean":"2023-11-04T01:37:52.659822+0000","last_became_active":"2023-11-04T01:37:51.681016+0000","last_became_peered":"2023-11-04T01:37:51.681016+0000","last_unstale":"2023-11-04T01:37:52.659822+0000","last_undegraded":"2023-11-04T01:37:52.659822+0000","last_fullsized":"2023-11-04T01:37:52.659822+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:58:46.698096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.660533+0000","last_change":"2023-11-04T01:37:50.669986+0000","last_active":"2023-11-04T01:37:51.660533+0000","last_peered":"2023-11-04T01:37:51.660533+0000","last_clean":"2023-11-04T01:37:51.660533+0000","last_became_active":"2023-11-04T01:37:50.669699+0000","last_became_peered":"2023-11-04T01:37:50.669699+0000","last_unstale":"2023-11-04T01:37:51.660533+0000","last_undegraded":"2023-11-04T01:37:51.660533+0000","last_fullsized":"2023-11-04T01:37:51.660533+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:31:32.044643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.672998+0000","last_change":"2023-11-04T01:37:51.668016+0000","last_active":"2023-11-04T01:37:51.672998+0000","last_peered":"2023-11-04T01:37:51.672998+0000","last_clean":"2023-11-04T01:37:51.672998+0000","last_became_active":"2023-11-04T01:37:51.667592+0000","last_became_peered":"2023-11-04T01:37:51.667592+0000","last_unstale":"2023-11-04T01:37:51.672998+0000","last_undegraded":"2023-11-04T01:37:51.672998+0000","last_fullsized":"2023-11-04T01:37:51.672998+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:13:41.359983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659785+0000","last_change":"2023-11-04T01:37:50.662747+0000","last_active":"2023-11-04T01:37:52.659785+0000","last_peered":"2023-11-04T01:37:52.659785+0000","last_clean":"2023-11-04T01:37:52.659785+0000","last_became_active":"2023-11-04T01:37:50.662415+0000","last_became_peered":"2023-11-04T01:37:50.662415+0000","last_unstale":"2023-11-04T01:37:52.659785+0000","last_undegraded":"2023-11-04T01:37:52.659785+0000","last_fullsized":"2023-11-04T01:37:52.659785+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:15.015202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.669201+0000","last_change":"2023-11-04T01:37:51.667404+0000","last_active":"2023-11-04T01:37:51.669201+0000","last_peered":"2023-11-04T01:37:51.669201+0000","last_clean":"2023-11-04T01:37:51.669201+0000","last_became_active":"2023-11-04T01:37:51.667156+0000","last_became_peered":"2023-11-04T01:37:51.667156+0000","last_unstale":"2023-11-04T01:37:51.669201+0000","last_undegraded":"2023-11-04T01:37:51.669201+0000","last_fullsized":"2023-11-04T01:37:51.669201+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:06:59.964540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.661917+0000","last_change":"2023-11-04T01:37:50.669118+0000","last_active":"2023-11-04T01:37:51.661917+0000","last_peered":"2023-11-04T01:37:51.661917+0000","last_clean":"2023-11-04T01:37:51.661917+0000","last_became_active":"2023-11-04T01:37:50.668796+0000","last_became_peered":"2023-11-04T01:37:50.668796+0000","last_unstale":"2023-11-04T01:37:51.661917+0000","last_undegraded":"2023-11-04T01:37:51.661917+0000","last_fullsized":"2023-11-04T01:37:51.661917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:06.716343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660937+0000","last_change":"2023-11-04T01:37:51.677914+0000","last_active":"2023-11-04T01:37:52.660937+0000","last_peered":"2023-11-04T01:37:52.660937+0000","last_clean":"2023-11-04T01:37:52.660937+0000","last_became_active":"2023-11-04T01:37:51.677613+0000","last_became_peered":"2023-11-04T01:37:51.677613+0000","last_unstale":"2023-11-04T01:37:52.660937+0000","last_undegraded":"2023-11-04T01:37:52.660937+0000","last_fullsized":"2023-11-04T01:37:52.660937+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:12:36.905648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.679888+0000","last_change":"2023-11-04T01:37:50.671899+0000","last_active":"2023-11-04T01:37:51.679888+0000","last_peered":"2023-11-04T01:37:51.679888+0000","last_clean":"2023-11-04T01:37:51.679888+0000","last_became_active":"2023-11-04T01:37:50.671561+0000","last_became_peered":"2023-11-04T01:37:50.671561+0000","last_unstale":"2023-11-04T01:37:51.679888+0000","last_undegraded":"2023-11-04T01:37:51.679888+0000","last_fullsized":"2023-11-04T01:37:51.679888+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:27.615370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.670222+0000","last_change":"2023-11-04T01:37:51.666822+0000","last_active":"2023-11-04T01:37:51.670222+0000","last_peered":"2023-11-04T01:37:51.670222+0000","last_clean":"2023-11-04T01:37:51.670222+0000","last_became_active":"2023-11-04T01:37:51.666552+0000","last_became_peered":"2023-11-04T01:37:51.666552+0000","last_unstale":"2023-11-04T01:37:51.670222+0000","last_undegraded":"2023-11-04T01:37:51.670222+0000","last_fullsized":"2023-11-04T01:37:51.670222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:02.664258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.692988+0000","last_change":"2023-11-04T01:37:50.672423+0000","last_active":"2023-11-04T01:37:51.692988+0000","last_peered":"2023-11-04T01:37:51.692988+0000","last_clean":"2023-11-04T01:37:51.692988+0000","last_became_active":"2023-11-04T01:37:50.672100+0000","last_became_peered":"2023-11-04T01:37:50.672100+0000","last_unstale":"2023-11-04T01:37:51.692988+0000","last_undegraded":"2023-11-04T01:37:51.692988+0000","last_fullsized":"2023-11-04T01:37:51.692988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:49.348776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659562+0000","last_change":"2023-11-04T01:37:51.672996+0000","last_active":"2023-11-04T01:37:52.659562+0000","last_peered":"2023-11-04T01:37:52.659562+0000","last_clean":"2023-11-04T01:37:52.659562+0000","last_became_active":"2023-11-04T01:37:51.672699+0000","last_became_peered":"2023-11-04T01:37:51.672699+0000","last_unstale":"2023-11-04T01:37:52.659562+0000","last_undegraded":"2023-11-04T01:37:52.659562+0000","last_fullsized":"2023-11-04T01:37:52.659562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:18:50.143680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.695161+0000","last_change":"2023-11-04T01:37:50.669649+0000","last_active":"2023-11-04T01:37:51.695161+0000","last_peered":"2023-11-04T01:37:51.695161+0000","last_clean":"2023-11-04T01:37:51.695161+0000","last_became_active":"2023-11-04T01:37:50.669342+0000","last_became_peered":"2023-11-04T01:37:50.669342+0000","last_unstale":"2023-11-04T01:37:51.695161+0000","last_undegraded":"2023-11-04T01:37:51.695161+0000","last_fullsized":"2023-11-04T01:37:51.695161+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:27.615370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.692800+0000","last_change":"2023-11-04T01:37:51.688039+0000","last_active":"2023-11-04T01:37:51.692800+0000","last_peered":"2023-11-04T01:37:51.692800+0000","last_clean":"2023-11-04T01:37:51.692800+0000","last_became_active":"2023-11-04T01:37:51.687716+0000","last_became_peered":"2023-11-04T01:37:51.687716+0000","last_unstale":"2023-11-04T01:37:51.692800+0000","last_undegraded":"2023-11-04T01:37:51.692800+0000","last_fullsized":"2023-11-04T01:37:51.692800+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:33:43.729417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.682144+0000","last_change":"2023-11-04T01:37:50.672093+0000","last_active":"2023-11-04T01:37:51.682144+0000","last_peered":"2023-11-04T01:37:51.682144+0000","last_clean":"2023-11-04T01:37:51.682144+0000","last_became_active":"2023-11-04T01:37:50.671840+0000","last_became_peered":"2023-11-04T01:37:50.671840+0000","last_unstale":"2023-11-04T01:37:51.682144+0000","last_undegraded":"2023-11-04T01:37:51.682144+0000","last_fullsized":"2023-11-04T01:37:51.682144+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:54:19.819631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.673304+0000","last_change":"2023-11-04T01:37:51.669534+0000","last_active":"2023-11-04T01:37:51.673304+0000","last_peered":"2023-11-04T01:37:51.673304+0000","last_clean":"2023-11-04T01:37:51.673304+0000","last_became_active":"2023-11-04T01:37:51.669186+0000","last_became_peered":"2023-11-04T01:37:51.669186+0000","last_unstale":"2023-11-04T01:37:51.673304+0000","last_undegraded":"2023-11-04T01:37:51.673304+0000","last_fullsized":"2023-11-04T01:37:51.673304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:24.938168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.660457+0000","last_change":"2023-11-04T01:37:50.672804+0000","last_active":"2023-11-04T01:37:51.660457+0000","last_peered":"2023-11-04T01:37:51.660457+0000","last_clean":"2023-11-04T01:37:51.660457+0000","last_became_active":"2023-11-04T01:37:50.672527+0000","last_became_peered":"2023-11-04T01:37:50.672527+0000","last_unstale":"2023-11-04T01:37:51.660457+0000","last_undegraded":"2023-11-04T01:37:51.660457+0000","last_fullsized":"2023-11-04T01:37:51.660457+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:05.095419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660875+0000","last_change":"2023-11-04T01:37:51.669467+0000","last_active":"2023-11-04T01:37:52.660875+0000","last_peered":"2023-11-04T01:37:52.660875+0000","last_clean":"2023-11-04T01:37:52.660875+0000","last_became_active":"2023-11-04T01:37:51.668973+0000","last_became_peered":"2023-11-04T01:37:51.668973+0000","last_unstale":"2023-11-04T01:37:52.660875+0000","last_undegraded":"2023-11-04T01:37:52.660875+0000","last_fullsized":"2023-11-04T01:37:52.660875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:39.893222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659625+0000","last_change":"2023-11-04T01:37:50.664216+0000","last_active":"2023-11-04T01:37:52.659625+0000","last_peered":"2023-11-04T01:37:52.659625+0000","last_clean":"2023-11-04T01:37:52.659625+0000","last_became_active":"2023-11-04T01:37:50.663916+0000","last_became_peered":"2023-11-04T01:37:50.663916+0000","last_unstale":"2023-11-04T01:37:52.659625+0000","last_undegraded":"2023-11-04T01:37:52.659625+0000","last_fullsized":"2023-11-04T01:37:52.659625+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:50:38.981365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.675781+0000","last_change":"2023-11-04T01:37:51.670660+0000","last_active":"2023-11-04T01:37:51.675781+0000","last_peered":"2023-11-04T01:37:51.675781+0000","last_clean":"2023-11-04T01:37:51.675781+0000","last_became_active":"2023-11-04T01:37:51.670365+0000","last_became_peered":"2023-11-04T01:37:51.670365+0000","last_unstale":"2023-11-04T01:37:51.675781+0000","last_undegraded":"2023-11-04T01:37:51.675781+0000","last_fullsized":"2023-11-04T01:37:51.675781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:18:50.143680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659416+0000","last_change":"2023-11-04T01:37:50.663036+0000","last_active":"2023-11-04T01:37:52.659416+0000","last_peered":"2023-11-04T01:37:52.659416+0000","last_clean":"2023-11-04T01:37:52.659416+0000","last_became_active":"2023-11-04T01:37:50.662784+0000","last_became_peered":"2023-11-04T01:37:50.662784+0000","last_unstale":"2023-11-04T01:37:52.659416+0000","last_undegraded":"2023-11-04T01:37:52.659416+0000","last_fullsized":"2023-11-04T01:37:52.659416+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:56.909953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.681561+0000","last_change":"2023-11-04T01:37:51.676162+0000","last_active":"2023-11-04T01:37:51.681561+0000","last_peered":"2023-11-04T01:37:51.681561+0000","last_clean":"2023-11-04T01:37:51.681561+0000","last_became_active":"2023-11-04T01:37:51.675848+0000","last_became_peered":"2023-11-04T01:37:51.675848+0000","last_unstale":"2023-11-04T01:37:51.681561+0000","last_undegraded":"2023-11-04T01:37:51.681561+0000","last_fullsized":"2023-11-04T01:37:51.681561+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:26.753300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.690139+0000","last_change":"2023-11-04T01:37:50.672270+0000","last_active":"2023-11-04T01:37:51.690139+0000","last_peered":"2023-11-04T01:37:51.690139+0000","last_clean":"2023-11-04T01:37:51.690139+0000","last_became_active":"2023-11-04T01:37:50.671943+0000","last_became_peered":"2023-11-04T01:37:50.671943+0000","last_unstale":"2023-11-04T01:37:51.690139+0000","last_undegraded":"2023-11-04T01:37:51.690139+0000","last_fullsized":"2023-11-04T01:37:51.690139+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:06.716343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.687474+0000","last_change":"2023-11-04T01:37:51.683061+0000","last_active":"2023-11-04T01:37:51.687474+0000","last_peered":"2023-11-04T01:37:51.687474+0000","last_clean":"2023-11-04T01:37:51.687474+0000","last_became_active":"2023-11-04T01:37:51.681312+0000","last_became_peered":"2023-11-04T01:37:51.681312+0000","last_unstale":"2023-11-04T01:37:51.687474+0000","last_undegraded":"2023-11-04T01:37:51.687474+0000","last_fullsized":"2023-11-04T01:37:51.687474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:39.631497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660293+0000","last_change":"2023-11-04T01:37:50.671915+0000","last_active":"2023-11-04T01:37:52.660293+0000","last_peered":"2023-11-04T01:37:52.660293+0000","last_clean":"2023-11-04T01:37:52.660293+0000","last_became_active":"2023-11-04T01:37:50.671602+0000","last_became_peered":"2023-11-04T01:37:50.671602+0000","last_unstale":"2023-11-04T01:37:52.660293+0000","last_undegraded":"2023-11-04T01:37:52.660293+0000","last_fullsized":"2023-11-04T01:37:52.660293+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:23.936193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660196+0000","last_change":"2023-11-04T01:37:51.667378+0000","last_active":"2023-11-04T01:37:52.660196+0000","last_peered":"2023-11-04T01:37:52.660196+0000","last_clean":"2023-11-04T01:37:52.660196+0000","last_became_active":"2023-11-04T01:37:51.667070+0000","last_became_peered":"2023-11-04T01:37:51.667070+0000","last_unstale":"2023-11-04T01:37:52.660196+0000","last_undegraded":"2023-11-04T01:37:52.660196+0000","last_fullsized":"2023-11-04T01:37:52.660196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:26.753300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.689035+0000","last_change":"2023-11-04T01:37:50.666413+0000","last_active":"2023-11-04T01:37:51.689035+0000","last_peered":"2023-11-04T01:37:51.689035+0000","last_clean":"2023-11-04T01:37:51.689035+0000","last_became_active":"2023-11-04T01:37:50.666159+0000","last_became_peered":"2023-11-04T01:37:50.666159+0000","last_unstale":"2023-11-04T01:37:51.689035+0000","last_undegraded":"2023-11-04T01:37:51.689035+0000","last_fullsized":"2023-11-04T01:37:51.689035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:38:22.044501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.672742+0000","last_change":"2023-11-04T01:37:51.671468+0000","last_active":"2023-11-04T01:37:51.672742+0000","last_peered":"2023-11-04T01:37:51.672742+0000","last_clean":"2023-11-04T01:37:51.672742+0000","last_became_active":"2023-11-04T01:37:51.671151+0000","last_became_peered":"2023-11-04T01:37:51.671151+0000","last_unstale":"2023-11-04T01:37:51.672742+0000","last_undegraded":"2023-11-04T01:37:51.672742+0000","last_fullsized":"2023-11-04T01:37:51.672742+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:56:55.334905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.660491+0000","last_change":"2023-11-04T01:37:50.662985+0000","last_active":"2023-11-04T01:37:51.660491+0000","last_peered":"2023-11-04T01:37:51.660491+0000","last_clean":"2023-11-04T01:37:51.660491+0000","last_became_active":"2023-11-04T01:37:50.662708+0000","last_became_peered":"2023-11-04T01:37:50.662708+0000","last_unstale":"2023-11-04T01:37:51.660491+0000","last_undegraded":"2023-11-04T01:37:51.660491+0000","last_fullsized":"2023-11-04T01:37:51.660491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:38.629522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659556+0000","last_change":"2023-11-04T01:37:51.676280+0000","last_active":"2023-11-04T01:37:52.659556+0000","last_peered":"2023-11-04T01:37:52.659556+0000","last_clean":"2023-11-04T01:37:52.659556+0000","last_became_active":"2023-11-04T01:37:51.676003+0000","last_became_peered":"2023-11-04T01:37:51.676003+0000","last_unstale":"2023-11-04T01:37:52.659556+0000","last_undegraded":"2023-11-04T01:37:52.659556+0000","last_fullsized":"2023-11-04T01:37:52.659556+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.263400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.687482+0000","last_change":"2023-11-04T01:37:50.667387+0000","last_active":"2023-11-04T01:37:51.687482+0000","last_peered":"2023-11-04T01:37:51.687482+0000","last_clean":"2023-11-04T01:37:51.687482+0000","last_became_active":"2023-11-04T01:37:50.667089+0000","last_became_peered":"2023-11-04T01:37:50.667089+0000","last_unstale":"2023-11-04T01:37:51.687482+0000","last_undegraded":"2023-11-04T01:37:51.687482+0000","last_fullsized":"2023-11-04T01:37:51.687482+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:59.968455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.668754+0000","last_change":"2023-11-04T01:37:51.664974+0000","last_active":"2023-11-04T01:37:51.668754+0000","last_peered":"2023-11-04T01:37:51.668754+0000","last_clean":"2023-11-04T01:37:51.668754+0000","last_became_active":"2023-11-04T01:37:51.664710+0000","last_became_peered":"2023-11-04T01:37:51.664710+0000","last_unstale":"2023-11-04T01:37:51.668754+0000","last_undegraded":"2023-11-04T01:37:51.668754+0000","last_fullsized":"2023-11-04T01:37:51.668754+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:04:33.686040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.655472+0000","last_change":"2023-11-04T01:37:50.670586+0000","last_active":"2023-11-04T01:37:51.655472+0000","last_peered":"2023-11-04T01:37:51.655472+0000","last_clean":"2023-11-04T01:37:51.655472+0000","last_became_active":"2023-11-04T01:37:50.670351+0000","last_became_peered":"2023-11-04T01:37:50.670351+0000","last_unstale":"2023-11-04T01:37:51.655472+0000","last_undegraded":"2023-11-04T01:37:51.655472+0000","last_fullsized":"2023-11-04T01:37:51.655472+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:46:10.680910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.686591+0000","last_change":"2023-11-04T01:37:51.680530+0000","last_active":"2023-11-04T01:37:51.686591+0000","last_peered":"2023-11-04T01:37:51.686591+0000","last_clean":"2023-11-04T01:37:51.686591+0000","last_became_active":"2023-11-04T01:37:51.680289+0000","last_became_peered":"2023-11-04T01:37:51.680289+0000","last_unstale":"2023-11-04T01:37:51.686591+0000","last_undegraded":"2023-11-04T01:37:51.686591+0000","last_fullsized":"2023-11-04T01:37:51.686591+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:31:33.046618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660836+0000","last_change":"2023-11-04T01:37:50.666156+0000","last_active":"2023-11-04T01:37:52.660836+0000","last_peered":"2023-11-04T01:37:52.660836+0000","last_clean":"2023-11-04T01:37:52.660836+0000","last_became_active":"2023-11-04T01:37:50.665875+0000","last_became_peered":"2023-11-04T01:37:50.665875+0000","last_unstale":"2023-11-04T01:37:52.660836+0000","last_undegraded":"2023-11-04T01:37:52.660836+0000","last_fullsized":"2023-11-04T01:37:52.660836+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:27.615370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.670546+0000","last_change":"2023-11-04T01:37:51.667847+0000","last_active":"2023-11-04T01:37:51.670546+0000","last_peered":"2023-11-04T01:37:51.670546+0000","last_clean":"2023-11-04T01:37:51.670546+0000","last_became_active":"2023-11-04T01:37:51.667245+0000","last_became_peered":"2023-11-04T01:37:51.667245+0000","last_unstale":"2023-11-04T01:37:51.670546+0000","last_undegraded":"2023-11-04T01:37:51.670546+0000","last_fullsized":"2023-11-04T01:37:51.670546+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:58:46.698096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.655467+0000","last_change":"2023-11-04T01:37:50.667562+0000","last_active":"2023-11-04T01:37:51.655467+0000","last_peered":"2023-11-04T01:37:51.655467+0000","last_clean":"2023-11-04T01:37:51.655467+0000","last_became_active":"2023-11-04T01:37:50.667299+0000","last_became_peered":"2023-11-04T01:37:50.667299+0000","last_unstale":"2023-11-04T01:37:51.655467+0000","last_undegraded":"2023-11-04T01:37:51.655467+0000","last_fullsized":"2023-11-04T01:37:51.655467+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:32:40.860363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.692543+0000","last_change":"2023-11-04T01:37:51.688681+0000","last_active":"2023-11-04T01:37:51.692543+0000","last_peered":"2023-11-04T01:37:51.692543+0000","last_clean":"2023-11-04T01:37:51.692543+0000","last_became_active":"2023-11-04T01:37:51.688402+0000","last_became_peered":"2023-11-04T01:37:51.688402+0000","last_unstale":"2023-11-04T01:37:51.692543+0000","last_undegraded":"2023-11-04T01:37:51.692543+0000","last_fullsized":"2023-11-04T01:37:51.692543+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:22:21.689351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.692841+0000","last_change":"2023-11-04T01:37:50.672641+0000","last_active":"2023-11-04T01:37:51.692841+0000","last_peered":"2023-11-04T01:37:51.692841+0000","last_clean":"2023-11-04T01:37:51.692841+0000","last_became_active":"2023-11-04T01:37:50.672340+0000","last_became_peered":"2023-11-04T01:37:50.672340+0000","last_unstale":"2023-11-04T01:37:51.692841+0000","last_undegraded":"2023-11-04T01:37:51.692841+0000","last_fullsized":"2023-11-04T01:37:51.692841+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:36.933854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.661115+0000","last_change":"2023-11-04T01:37:51.675578+0000","last_active":"2023-11-04T01:37:52.661115+0000","last_peered":"2023-11-04T01:37:52.661115+0000","last_clean":"2023-11-04T01:37:52.661115+0000","last_became_active":"2023-11-04T01:37:51.675281+0000","last_became_peered":"2023-11-04T01:37:51.675281+0000","last_unstale":"2023-11-04T01:37:52.661115+0000","last_undegraded":"2023-11-04T01:37:52.661115+0000","last_fullsized":"2023-11-04T01:37:52.661115+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:44:57.333146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.655809+0000","last_change":"2023-11-04T01:37:50.671913+0000","last_active":"2023-11-04T01:37:51.655809+0000","last_peered":"2023-11-04T01:37:51.655809+0000","last_clean":"2023-11-04T01:37:51.655809+0000","last_became_active":"2023-11-04T01:37:50.671640+0000","last_became_peered":"2023-11-04T01:37:50.671640+0000","last_unstale":"2023-11-04T01:37:51.655809+0000","last_undegraded":"2023-11-04T01:37:51.655809+0000","last_fullsized":"2023-11-04T01:37:51.655809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:42.972341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.673335+0000","last_change":"2023-11-04T01:37:51.669795+0000","last_active":"2023-11-04T01:37:51.673335+0000","last_peered":"2023-11-04T01:37:51.673335+0000","last_clean":"2023-11-04T01:37:51.673335+0000","last_became_active":"2023-11-04T01:37:51.669381+0000","last_became_peered":"2023-11-04T01:37:51.669381+0000","last_unstale":"2023-11-04T01:37:51.673335+0000","last_undegraded":"2023-11-04T01:37:51.673335+0000","last_fullsized":"2023-11-04T01:37:51.673335+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:37.935830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.661003+0000","last_change":"2023-11-04T01:37:50.670433+0000","last_active":"2023-11-04T01:37:51.661003+0000","last_peered":"2023-11-04T01:37:51.661003+0000","last_clean":"2023-11-04T01:37:51.661003+0000","last_became_active":"2023-11-04T01:37:50.670193+0000","last_became_peered":"2023-11-04T01:37:50.670193+0000","last_unstale":"2023-11-04T01:37:51.661003+0000","last_undegraded":"2023-11-04T01:37:51.661003+0000","last_fullsized":"2023-11-04T01:37:51.661003+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:56.909953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.673246+0000","last_change":"2023-11-04T01:37:51.669582+0000","last_active":"2023-11-04T01:37:51.673246+0000","last_peered":"2023-11-04T01:37:51.673246+0000","last_clean":"2023-11-04T01:37:51.673246+0000","last_became_active":"2023-11-04T01:37:51.669316+0000","last_became_peered":"2023-11-04T01:37:51.669316+0000","last_unstale":"2023-11-04T01:37:51.673246+0000","last_undegraded":"2023-11-04T01:37:51.673246+0000","last_fullsized":"2023-11-04T01:37:51.673246+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:31:33.046618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.659040+0000","last_change":"2023-11-04T01:37:50.669272+0000","last_active":"2023-11-04T01:37:51.659040+0000","last_peered":"2023-11-04T01:37:51.659040+0000","last_clean":"2023-11-04T01:37:51.659040+0000","last_became_active":"2023-11-04T01:37:50.668929+0000","last_became_peered":"2023-11-04T01:37:50.668929+0000","last_unstale":"2023-11-04T01:37:51.659040+0000","last_undegraded":"2023-11-04T01:37:51.659040+0000","last_fullsized":"2023-11-04T01:37:51.659040+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:38.629522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.675648+0000","last_change":"2023-11-04T01:37:51.674211+0000","last_active":"2023-11-04T01:37:51.675648+0000","last_peered":"2023-11-04T01:37:51.675648+0000","last_clean":"2023-11-04T01:37:51.675648+0000","last_became_active":"2023-11-04T01:37:51.673918+0000","last_became_peered":"2023-11-04T01:37:51.673918+0000","last_unstale":"2023-11-04T01:37:51.675648+0000","last_undegraded":"2023-11-04T01:37:51.675648+0000","last_fullsized":"2023-11-04T01:37:51.675648+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:16.017178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660122+0000","last_change":"2023-11-04T01:37:50.671957+0000","last_active":"2023-11-04T01:37:52.660122+0000","last_peered":"2023-11-04T01:37:52.660122+0000","last_clean":"2023-11-04T01:37:52.660122+0000","last_became_active":"2023-11-04T01:37:50.671658+0000","last_became_peered":"2023-11-04T01:37:50.671658+0000","last_unstale":"2023-11-04T01:37:52.660122+0000","last_undegraded":"2023-11-04T01:37:52.660122+0000","last_fullsized":"2023-11-04T01:37:52.660122+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:52.908128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659615+0000","last_change":"2023-11-04T01:37:51.670195+0000","last_active":"2023-11-04T01:37:52.659615+0000","last_peered":"2023-11-04T01:37:52.659615+0000","last_clean":"2023-11-04T01:37:52.659615+0000","last_became_active":"2023-11-04T01:37:51.669904+0000","last_became_peered":"2023-11-04T01:37:51.669904+0000","last_unstale":"2023-11-04T01:37:52.659615+0000","last_undegraded":"2023-11-04T01:37:52.659615+0000","last_fullsized":"2023-11-04T01:37:52.659615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:05.716469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659995+0000","last_change":"2023-11-04T01:37:50.669425+0000","last_active":"2023-11-04T01:37:52.659995+0000","last_peered":"2023-11-04T01:37:52.659995+0000","last_clean":"2023-11-04T01:37:52.659995+0000","last_became_active":"2023-11-04T01:37:50.668934+0000","last_became_peered":"2023-11-04T01:37:50.668934+0000","last_unstale":"2023-11-04T01:37:52.659995+0000","last_undegraded":"2023-11-04T01:37:52.659995+0000","last_fullsized":"2023-11-04T01:37:52.659995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:31:32.044643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660990+0000","last_change":"2023-11-04T01:37:51.677319+0000","last_active":"2023-11-04T01:37:52.660990+0000","last_peered":"2023-11-04T01:37:52.660990+0000","last_clean":"2023-11-04T01:37:52.660990+0000","last_became_active":"2023-11-04T01:37:51.676461+0000","last_became_peered":"2023-11-04T01:37:51.676461+0000","last_unstale":"2023-11-04T01:37:52.660990+0000","last_undegraded":"2023-11-04T01:37:52.660990+0000","last_fullsized":"2023-11-04T01:37:52.660990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:25.288162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.660765+0000","last_change":"2023-11-04T01:37:50.669691+0000","last_active":"2023-11-04T01:37:51.660765+0000","last_peered":"2023-11-04T01:37:51.660765+0000","last_clean":"2023-11-04T01:37:51.660765+0000","last_became_active":"2023-11-04T01:37:50.669461+0000","last_became_peered":"2023-11-04T01:37:50.669461+0000","last_unstale":"2023-11-04T01:37:51.660765+0000","last_undegraded":"2023-11-04T01:37:51.660765+0000","last_fullsized":"2023-11-04T01:37:51.660765+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:11:43.444999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.686583+0000","last_change":"2023-11-04T01:37:51.684049+0000","last_active":"2023-11-04T01:37:51.686583+0000","last_peered":"2023-11-04T01:37:51.686583+0000","last_clean":"2023-11-04T01:37:51.686583+0000","last_became_active":"2023-11-04T01:37:51.683705+0000","last_became_peered":"2023-11-04T01:37:51.683705+0000","last_unstale":"2023-11-04T01:37:51.686583+0000","last_undegraded":"2023-11-04T01:37:51.686583+0000","last_fullsized":"2023-11-04T01:37:51.686583+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:13:41.359983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.661032+0000","last_change":"2023-11-04T01:37:50.671517+0000","last_active":"2023-11-04T01:37:52.661032+0000","last_peered":"2023-11-04T01:37:52.661032+0000","last_clean":"2023-11-04T01:37:52.661032+0000","last_became_active":"2023-11-04T01:37:50.671165+0000","last_became_peered":"2023-11-04T01:37:50.671165+0000","last_unstale":"2023-11-04T01:37:52.661032+0000","last_undegraded":"2023-11-04T01:37:52.661032+0000","last_fullsized":"2023-11-04T01:37:52.661032+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:18:49.141704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.662185+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:37:51.662185+0000","last_peered":"2023-11-04T01:37:51.662185+0000","last_clean":"2023-11-04T01:37:51.662185+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:37:51.662185+0000","last_undegraded":"2023-11-04T01:37:51.662185+0000","last_fullsized":"2023-11-04T01:37:51.662185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":773914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.61799999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.66800000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.629},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.64000000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.58399999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.42399999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.60199999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.55500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":182446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.46999999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.56100000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.626}]},{"osd":3,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.70099999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.71499999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.69199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":181976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.377},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47999999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.40999999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.505}]},{"osd":4,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.46500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.36199999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.44800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":182468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.55900000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.623}]},{"osd":2,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.59799999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.33600000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.41299999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.439},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.48799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":183510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.30599999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.38100000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.32800000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.47899999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.57899999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.50900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":181934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.252},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.27000000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.32600000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.307}]},{"osd":4,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.85199999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.877}]},{"osd":6,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71999999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.76200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":181954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.254},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.41599999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.33600000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.59399999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.627},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.63800000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.65200000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":772266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.26400000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.29799999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.313},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.61499999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.753}]},{"osd":7,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:37:54.612 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:37:54.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.745+0000 7f786f2c2640 1 Processor -- start 2023-11-04T01:37:54.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.745+0000 7f786f2c2640 1 -- start start 2023-11-04T01:37:54.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.746+0000 7f786f2c2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7868159c70 0x7f78680ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.746+0000 7f786f2c2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f786806db20 0x7f78680b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.746+0000 7f786f2c2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78680b4110 con 0x7f78680b0910 2023-11-04T01:37:54.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.746+0000 7f786f2c2640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78680b49b0 con 0x7f786806db20 2023-11-04T01:37:54.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.746+0000 7f786f2c2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78680b0da0 con 0x7f7868159c70 2023-11-04T01:37:54.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.746+0000 7f786d85f640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f78680b0910 0x7f786815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60654/0 (socket says 172.21.15.114:60654) 2023-11-04T01:37:54.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.746+0000 7f786d85f640 1 -- 172.21.15.114:0/1874835584 learned_addr learned my addr 172.21.15.114:0/1874835584 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:54.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.747+0000 7f786c85d640 1 --2- 172.21.15.114:0/1874835584 >> v2:172.21.15.141:3300/0 conn(0x7f786806db20 0x7f78680b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.747+0000 7f786d05e640 1 --2- 172.21.15.114:0/1874835584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7868159c70 0x7f78680ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.747+0000 7f785ffff640 1 -- 172.21.15.114:0/1874835584 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518007052 0 0) 0x7f78680b4110 con 0x7f78680b0910 2023-11-04T01:37:54.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.747+0000 7f785ffff640 1 -- 172.21.15.114:0/1874835584 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7854003520 con 0x7f78680b0910 2023-11-04T01:37:54.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.747+0000 7f785ffff640 1 -- 172.21.15.114:0/1874835584 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2639786046 0 0) 0x7f7854003520 con 0x7f78680b0910 2023-11-04T01:37:54.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.747+0000 7f786d05e640 1 -- 172.21.15.114:0/1874835584 >> v2:172.21.15.141:3300/0 conn(0x7f786806db20 msgr2=0x7f78680b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:54.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.747+0000 7f786d05e640 1 --2- 172.21.15.114:0/1874835584 >> v2:172.21.15.141:3300/0 conn(0x7f786806db20 0x7f78680b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.747+0000 7f786d05e640 1 -- 172.21.15.114:0/1874835584 >> v1:172.21.15.114:6789/0 conn(0x7f78680b0910 legacy=0x7f786815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.747+0000 7f786d05e640 1 -- 172.21.15.114:0/1874835584 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78680b43f0 con 0x7f7868159c70 2023-11-04T01:37:54.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.748+0000 7f786d05e640 1 --2- 172.21.15.114:0/1874835584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7868159c70 0x7f78680ce370 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7864009d90 tx=0x7f786402bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=224f594985a1123d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.748+0000 7f785ffff640 1 -- 172.21.15.114:0/1874835584 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860001670 con 0x7f7868159c70 2023-11-04T01:37:54.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.748+0000 7f785ffff640 1 -- 172.21.15.114:0/1874835584 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786402c8a0 con 0x7f7868159c70 2023-11-04T01:37:54.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.748+0000 7f785ffff640 1 -- 172.21.15.114:0/1874835584 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786402cc10 con 0x7f7868159c70 2023-11-04T01:37:54.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.748+0000 7f786f2c2640 1 -- 172.21.15.114:0/1874835584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7868159c70 msgr2=0x7f78680ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.748+0000 7f786f2c2640 1 --2- 172.21.15.114:0/1874835584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7868159c70 0x7f78680ce370 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7864009d90 tx=0x7f786402bd70 comp rx=0 tx=0).stop 2023-11-04T01:37:54.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.748+0000 7f786f2c2640 1 -- 172.21.15.114:0/1874835584 shutdown_connections 2023-11-04T01:37:54.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.748+0000 7f786f2c2640 1 --2- 172.21.15.114:0/1874835584 >> v2:172.21.15.141:3300/0 conn(0x7f786806db20 0x7f78680b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.748+0000 7f786f2c2640 1 --2- 172.21.15.114:0/1874835584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7868159c70 0x7f78680ce370 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.748+0000 7f786f2c2640 1 -- 172.21.15.114:0/1874835584 >> 172.21.15.114:0/1874835584 conn(0x7f78680ce950 msgr2=0x7f78680ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:54.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.749+0000 7f786f2c2640 1 -- 172.21.15.114:0/1874835584 shutdown_connections 2023-11-04T01:37:54.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.749+0000 7f786f2c2640 1 -- 172.21.15.114:0/1874835584 wait complete. 2023-11-04T01:37:54.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.750+0000 7f786f2c2640 1 Processor -- start 2023-11-04T01:37:54.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.750+0000 7f786f2c2640 1 -- start start 2023-11-04T01:37:54.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.750+0000 7f786f2c2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786806db20 0x7f78680c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.750+0000 7f786f2c2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78680b0910 0x7f78681e2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.750+0000 7f786f2c2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7868159c70 0x7f7868152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.750+0000 7f786f2c2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78680c7ee0 con 0x7f786806db20 2023-11-04T01:37:54.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.750+0000 7f786f2c2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78681e2760 con 0x7f78680b0910 2023-11-04T01:37:54.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.750+0000 7f786f2c2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78680c8ee0 con 0x7f7868159c70 2023-11-04T01:37:54.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.750+0000 7f786d05e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786806db20 0x7f78680c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.750+0000 7f786d05e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786806db20 0x7f78680c79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51282/0 (socket says 172.21.15.114:51282) 2023-11-04T01:37:54.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.750+0000 7f786d05e640 1 -- 172.21.15.114:0/2527488297 learned_addr learned my addr 172.21.15.114:0/2527488297 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:54.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.751+0000 7f786c85d640 1 --2- 172.21.15.114:0/2527488297 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78680b0910 0x7f78681e2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.751+0000 7f786d85f640 1 --2- 172.21.15.114:0/2527488297 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7868159c70 0x7f7868152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.751+0000 7f786d05e640 1 -- 172.21.15.114:0/2527488297 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7868159c70 msgr2=0x7f7868152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.751+0000 7f786d05e640 1 --2- 172.21.15.114:0/2527488297 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7868159c70 0x7f7868152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.751+0000 7f786d05e640 1 -- 172.21.15.114:0/2527488297 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78680b0910 msgr2=0x7f78681e2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.751+0000 7f786d05e640 1 --2- 172.21.15.114:0/2527488297 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78680b0910 0x7f78681e2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.751+0000 7f786d05e640 1 -- 172.21.15.114:0/2527488297 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7864009a70 con 0x7f786806db20 2023-11-04T01:37:54.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.751+0000 7f786d05e640 1 --2- 172.21.15.114:0/2527488297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786806db20 0x7f78680c79a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7864009eb0 tx=0x7f7864004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.751+0000 7f785dffb640 1 -- 172.21.15.114:0/2527488297 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786402ce90 con 0x7f786806db20 2023-11-04T01:37:54.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.751+0000 7f785dffb640 1 -- 172.21.15.114:0/2527488297 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7864009450 con 0x7f786806db20 2023-11-04T01:37:54.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.751+0000 7f786f2c2640 1 -- 172.21.15.114:0/2527488297 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78680c6be0 con 0x7f786806db20 2023-11-04T01:37:54.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.751+0000 7f785dffb640 1 -- 172.21.15.114:0/2527488297 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786403e630 con 0x7f786806db20 2023-11-04T01:37:54.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.751+0000 7f786f2c2640 1 -- 172.21.15.114:0/2527488297 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78680c71a0 con 0x7f786806db20 2023-11-04T01:37:54.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.752+0000 7f786f2c2640 1 -- 172.21.15.114:0/2527488297 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7868074290 con 0x7f786806db20 2023-11-04T01:37:54.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.753+0000 7f785dffb640 1 -- 172.21.15.114:0/2527488297 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f786403b050 con 0x7f786806db20 2023-11-04T01:37:54.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.753+0000 7f785dffb640 1 --2- 172.21.15.114:0/2527488297 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f784c06ae70 0x7f784c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:54.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.753+0000 7f785dffb640 1 -- 172.21.15.114:0/2527488297 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f78640ab500 con 0x7f786806db20 2023-11-04T01:37:54.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.753+0000 7f786c85d640 1 --2- 172.21.15.114:0/2527488297 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f784c06ae70 0x7f784c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:54.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.754+0000 7f786c85d640 1 --2- 172.21.15.114:0/2527488297 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f784c06ae70 0x7f784c06d330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f78681f2cc0 tx=0x7f7858009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.757+0000 7f785dffb640 1 -- 172.21.15.114:0/2527488297 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78640765b0 con 0x7f786806db20 2023-11-04T01:37:54.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.923+0000 7f786f2c2640 1 -- 172.21.15.114:0/2527488297 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f78680b46d0 con 0x7f784c06ae70 2023-11-04T01:37:54.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.930+0000 7f785dffb640 1 -- 172.21.15.114:0/2527488297 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289243 (secure 0 0 0) 0x7f7858011a30 con 0x7f784c06ae70 2023-11-04T01:37:54.934 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:54.935 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:37:54.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.933+0000 7f786f2c2640 1 -- 172.21.15.114:0/2527488297 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f784c06ae70 msgr2=0x7f784c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.933+0000 7f786f2c2640 1 --2- 172.21.15.114:0/2527488297 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f784c06ae70 0x7f784c06d330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f78681f2cc0 tx=0x7f7858009190 comp rx=0 tx=0).stop 2023-11-04T01:37:54.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.933+0000 7f786f2c2640 1 -- 172.21.15.114:0/2527488297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786806db20 msgr2=0x7f78680c79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:54.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.933+0000 7f786f2c2640 1 --2- 172.21.15.114:0/2527488297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786806db20 0x7f78680c79a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7864009eb0 tx=0x7f7864004a40 comp rx=0 tx=0).stop 2023-11-04T01:37:54.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.933+0000 7f786f2c2640 1 -- 172.21.15.114:0/2527488297 shutdown_connections 2023-11-04T01:37:54.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.933+0000 7f786f2c2640 1 --2- 172.21.15.114:0/2527488297 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7868159c70 0x7f7868152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.933+0000 7f786f2c2640 1 --2- 172.21.15.114:0/2527488297 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f784c06ae70 0x7f784c06d330 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.933+0000 7f786f2c2640 1 --2- 172.21.15.114:0/2527488297 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78680b0910 0x7f78681e2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.933+0000 7f786f2c2640 1 --2- 172.21.15.114:0/2527488297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786806db20 0x7f78680c79a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:54.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.933+0000 7f786f2c2640 1 -- 172.21.15.114:0/2527488297 >> 172.21.15.114:0/2527488297 conn(0x7f78680ce950 msgr2=0x7f7868158f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:54.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.933+0000 7f786f2c2640 1 -- 172.21.15.114:0/2527488297 shutdown_connections 2023-11-04T01:37:54.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:54.933+0000 7f786f2c2640 1 -- 172.21.15.114:0/2527488297 wait complete. 2023-11-04T01:37:54.946 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-11-04T01:37:53.875469+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220716,"kb_used_data":4552,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754004,"statfs":{"total":773094113280,"available":772868100096,"internally_reserved":0,"allocated":4661248,"data_stored":2640468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.229250"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.673333+0000","last_change":"2023-11-04T01:37:51.669686+0000","last_active":"2023-11-04T01:37:51.673333+0000","last_peered":"2023-11-04T01:37:51.673333+0000","last_clean":"2023-11-04T01:37:51.673333+0000","last_became_active":"2023-11-04T01:37:51.669390+0000","last_became_peered":"2023-11-04T01:37:51.669390+0000","last_unstale":"2023-11-04T01:37:51.673333+0000","last_undegraded":"2023-11-04T01:37:51.673333+0000","last_fullsized":"2023-11-04T01:37:51.673333+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:57.022471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.675305+0000","last_change":"2023-11-04T01:37:51.669986+0000","last_active":"2023-11-04T01:37:51.675305+0000","last_peered":"2023-11-04T01:37:51.675305+0000","last_clean":"2023-11-04T01:37:51.675305+0000","last_became_active":"2023-11-04T01:37:51.668972+0000","last_became_peered":"2023-11-04T01:37:51.668972+0000","last_unstale":"2023-11-04T01:37:51.675305+0000","last_undegraded":"2023-11-04T01:37:51.675305+0000","last_fullsized":"2023-11-04T01:37:51.675305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:50.350752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.692824+0000","last_change":"2023-11-04T01:37:51.688534+0000","last_active":"2023-11-04T01:37:51.692824+0000","last_peered":"2023-11-04T01:37:51.692824+0000","last_clean":"2023-11-04T01:37:51.692824+0000","last_became_active":"2023-11-04T01:37:51.688254+0000","last_became_peered":"2023-11-04T01:37:51.688254+0000","last_unstale":"2023-11-04T01:37:51.692824+0000","last_undegraded":"2023-11-04T01:37:51.692824+0000","last_fullsized":"2023-11-04T01:37:51.692824+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:06.097394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.669222+0000","last_change":"2023-11-04T01:37:51.667977+0000","last_active":"2023-11-04T01:37:51.669222+0000","last_peered":"2023-11-04T01:37:51.669222+0000","last_clean":"2023-11-04T01:37:51.669222+0000","last_became_active":"2023-11-04T01:37:51.667713+0000","last_became_peered":"2023-11-04T01:37:51.667713+0000","last_unstale":"2023-11-04T01:37:51.669222+0000","last_undegraded":"2023-11-04T01:37:51.669222+0000","last_fullsized":"2023-11-04T01:37:51.669222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:09:37.542747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.672033+0000","last_change":"2023-11-04T01:37:51.666767+0000","last_active":"2023-11-04T01:37:51.672033+0000","last_peered":"2023-11-04T01:37:51.672033+0000","last_clean":"2023-11-04T01:37:51.672033+0000","last_became_active":"2023-11-04T01:37:51.666519+0000","last_became_peered":"2023-11-04T01:37:51.666519+0000","last_unstale":"2023-11-04T01:37:51.672033+0000","last_undegraded":"2023-11-04T01:37:51.672033+0000","last_fullsized":"2023-11-04T01:37:51.672033+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:52.510081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.670814+0000","last_change":"2023-11-04T01:37:51.669480+0000","last_active":"2023-11-04T01:37:51.670814+0000","last_peered":"2023-11-04T01:37:51.670814+0000","last_clean":"2023-11-04T01:37:51.670814+0000","last_became_active":"2023-11-04T01:37:51.669133+0000","last_became_peered":"2023-11-04T01:37:51.669133+0000","last_unstale":"2023-11-04T01:37:51.670814+0000","last_undegraded":"2023-11-04T01:37:51.670814+0000","last_fullsized":"2023-11-04T01:37:51.670814+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:33:43.729417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.686804+0000","last_change":"2023-11-04T01:37:51.684208+0000","last_active":"2023-11-04T01:37:51.686804+0000","last_peered":"2023-11-04T01:37:51.686804+0000","last_clean":"2023-11-04T01:37:51.686804+0000","last_became_active":"2023-11-04T01:37:51.683892+0000","last_became_peered":"2023-11-04T01:37:51.683892+0000","last_unstale":"2023-11-04T01:37:51.686804+0000","last_undegraded":"2023-11-04T01:37:51.686804+0000","last_fullsized":"2023-11-04T01:37:51.686804+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:58:46.698096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.692705+0000","last_change":"2023-11-04T01:37:51.688317+0000","last_active":"2023-11-04T01:37:51.692705+0000","last_peered":"2023-11-04T01:37:51.692705+0000","last_clean":"2023-11-04T01:37:51.692705+0000","last_became_active":"2023-11-04T01:37:51.688044+0000","last_became_peered":"2023-11-04T01:37:51.688044+0000","last_unstale":"2023-11-04T01:37:51.692705+0000","last_undegraded":"2023-11-04T01:37:51.692705+0000","last_fullsized":"2023-11-04T01:37:51.692705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:57.911928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.687264+0000","last_change":"2023-11-04T01:37:51.684166+0000","last_active":"2023-11-04T01:37:51.687264+0000","last_peered":"2023-11-04T01:37:51.687264+0000","last_clean":"2023-11-04T01:37:51.687264+0000","last_became_active":"2023-11-04T01:37:51.683787+0000","last_became_peered":"2023-11-04T01:37:51.683787+0000","last_unstale":"2023-11-04T01:37:51.687264+0000","last_undegraded":"2023-11-04T01:37:51.687264+0000","last_fullsized":"2023-11-04T01:37:51.687264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:53.910104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.691064+0000","last_change":"2023-11-04T01:37:51.689875+0000","last_active":"2023-11-04T01:37:51.691064+0000","last_peered":"2023-11-04T01:37:51.691064+0000","last_clean":"2023-11-04T01:37:51.691064+0000","last_became_active":"2023-11-04T01:37:51.689608+0000","last_became_peered":"2023-11-04T01:37:51.689608+0000","last_unstale":"2023-11-04T01:37:51.691064+0000","last_undegraded":"2023-11-04T01:37:51.691064+0000","last_fullsized":"2023-11-04T01:37:51.691064+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:26.753300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.690093+0000","last_change":"2023-11-04T01:37:51.687955+0000","last_active":"2023-11-04T01:37:51.690093+0000","last_peered":"2023-11-04T01:37:51.690093+0000","last_clean":"2023-11-04T01:37:51.690093+0000","last_became_active":"2023-11-04T01:37:51.687668+0000","last_became_peered":"2023-11-04T01:37:51.687668+0000","last_unstale":"2023-11-04T01:37:51.690093+0000","last_undegraded":"2023-11-04T01:37:51.690093+0000","last_fullsized":"2023-11-04T01:37:51.690093+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:11:44.446974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.668823+0000","last_change":"2023-11-04T01:37:51.665741+0000","last_active":"2023-11-04T01:37:51.668823+0000","last_peered":"2023-11-04T01:37:51.668823+0000","last_clean":"2023-11-04T01:37:51.668823+0000","last_became_active":"2023-11-04T01:37:51.665482+0000","last_became_peered":"2023-11-04T01:37:51.665482+0000","last_unstale":"2023-11-04T01:37:51.668823+0000","last_undegraded":"2023-11-04T01:37:51.668823+0000","last_fullsized":"2023-11-04T01:37:51.668823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:22:21.689351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.690015+0000","last_change":"2023-11-04T01:37:51.686971+0000","last_active":"2023-11-04T01:37:51.690015+0000","last_peered":"2023-11-04T01:37:51.690015+0000","last_clean":"2023-11-04T01:37:51.690015+0000","last_became_active":"2023-11-04T01:37:51.684583+0000","last_became_peered":"2023-11-04T01:37:51.684583+0000","last_unstale":"2023-11-04T01:37:51.690015+0000","last_undegraded":"2023-11-04T01:37:51.690015+0000","last_fullsized":"2023-11-04T01:37:51.690015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:05.716469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659487+0000","last_change":"2023-11-04T01:37:51.675081+0000","last_active":"2023-11-04T01:37:52.659487+0000","last_peered":"2023-11-04T01:37:52.659487+0000","last_clean":"2023-11-04T01:37:52.659487+0000","last_became_active":"2023-11-04T01:37:51.674775+0000","last_became_peered":"2023-11-04T01:37:51.674775+0000","last_unstale":"2023-11-04T01:37:52.659487+0000","last_undegraded":"2023-11-04T01:37:52.659487+0000","last_fullsized":"2023-11-04T01:37:52.659487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:11:44.446974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.689992+0000","last_change":"2023-11-04T01:37:51.686054+0000","last_active":"2023-11-04T01:37:51.689992+0000","last_peered":"2023-11-04T01:37:51.689992+0000","last_clean":"2023-11-04T01:37:51.689992+0000","last_became_active":"2023-11-04T01:37:51.685776+0000","last_became_peered":"2023-11-04T01:37:51.685776+0000","last_unstale":"2023-11-04T01:37:51.689992+0000","last_undegraded":"2023-11-04T01:37:51.689992+0000","last_fullsized":"2023-11-04T01:37:51.689992+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:18:50.143680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659413+0000","last_change":"2023-11-04T01:37:51.681061+0000","last_active":"2023-11-04T01:37:52.659413+0000","last_peered":"2023-11-04T01:37:52.659413+0000","last_clean":"2023-11-04T01:37:52.659413+0000","last_became_active":"2023-11-04T01:37:51.680540+0000","last_became_peered":"2023-11-04T01:37:51.680540+0000","last_unstale":"2023-11-04T01:37:52.659413+0000","last_undegraded":"2023-11-04T01:37:52.659413+0000","last_fullsized":"2023-11-04T01:37:52.659413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:37.935830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660876+0000","last_change":"2023-11-04T01:37:51.686787+0000","last_active":"2023-11-04T01:37:52.660876+0000","last_peered":"2023-11-04T01:37:52.660876+0000","last_clean":"2023-11-04T01:37:52.660876+0000","last_became_active":"2023-11-04T01:37:51.686510+0000","last_became_peered":"2023-11-04T01:37:51.686510+0000","last_unstale":"2023-11-04T01:37:52.660876+0000","last_undegraded":"2023-11-04T01:37:52.660876+0000","last_fullsized":"2023-11-04T01:37:52.660876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:42.624679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659722+0000","last_change":"2023-11-04T01:37:51.673023+0000","last_active":"2023-11-04T01:37:52.659722+0000","last_peered":"2023-11-04T01:37:52.659722+0000","last_clean":"2023-11-04T01:37:52.659722+0000","last_became_active":"2023-11-04T01:37:51.672776+0000","last_became_peered":"2023-11-04T01:37:51.672776+0000","last_unstale":"2023-11-04T01:37:52.659722+0000","last_undegraded":"2023-11-04T01:37:52.659722+0000","last_fullsized":"2023-11-04T01:37:52.659722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:02.664258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.672756+0000","last_change":"2023-11-04T01:37:51.671494+0000","last_active":"2023-11-04T01:37:51.672756+0000","last_peered":"2023-11-04T01:37:51.672756+0000","last_clean":"2023-11-04T01:37:51.672756+0000","last_became_active":"2023-11-04T01:37:51.671168+0000","last_became_peered":"2023-11-04T01:37:51.671168+0000","last_unstale":"2023-11-04T01:37:51.672756+0000","last_undegraded":"2023-11-04T01:37:51.672756+0000","last_fullsized":"2023-11-04T01:37:51.672756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:15.558683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659893+0000","last_change":"2023-11-04T01:37:51.673693+0000","last_active":"2023-11-04T01:37:52.659893+0000","last_peered":"2023-11-04T01:37:52.659893+0000","last_clean":"2023-11-04T01:37:52.659893+0000","last_became_active":"2023-11-04T01:37:51.673450+0000","last_became_peered":"2023-11-04T01:37:51.673450+0000","last_unstale":"2023-11-04T01:37:52.659893+0000","last_undegraded":"2023-11-04T01:37:52.659893+0000","last_fullsized":"2023-11-04T01:37:52.659893+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:06.097394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.686695+0000","last_change":"2023-11-04T01:37:51.678495+0000","last_active":"2023-11-04T01:37:51.686695+0000","last_peered":"2023-11-04T01:37:51.686695+0000","last_clean":"2023-11-04T01:37:51.686695+0000","last_became_active":"2023-11-04T01:37:51.677859+0000","last_became_peered":"2023-11-04T01:37:51.677859+0000","last_unstale":"2023-11-04T01:37:51.686695+0000","last_undegraded":"2023-11-04T01:37:51.686695+0000","last_fullsized":"2023-11-04T01:37:51.686695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:57.911928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659959+0000","last_change":"2023-11-04T01:37:51.669930+0000","last_active":"2023-11-04T01:37:52.659959+0000","last_peered":"2023-11-04T01:37:52.659959+0000","last_clean":"2023-11-04T01:37:52.659959+0000","last_became_active":"2023-11-04T01:37:51.669630+0000","last_became_peered":"2023-11-04T01:37:51.669630+0000","last_unstale":"2023-11-04T01:37:52.659959+0000","last_undegraded":"2023-11-04T01:37:52.659959+0000","last_fullsized":"2023-11-04T01:37:52.659959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:13:41.359983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660610+0000","last_change":"2023-11-04T01:37:51.676781+0000","last_active":"2023-11-04T01:37:52.660610+0000","last_peered":"2023-11-04T01:37:52.660610+0000","last_clean":"2023-11-04T01:37:52.660610+0000","last_became_active":"2023-11-04T01:37:51.676095+0000","last_became_peered":"2023-11-04T01:37:51.676095+0000","last_unstale":"2023-11-04T01:37:52.660610+0000","last_undegraded":"2023-11-04T01:37:52.660610+0000","last_fullsized":"2023-11-04T01:37:52.660610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:40.118759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.668571+0000","last_change":"2023-11-04T01:37:51.665733+0000","last_active":"2023-11-04T01:37:51.668571+0000","last_peered":"2023-11-04T01:37:51.668571+0000","last_clean":"2023-11-04T01:37:51.668571+0000","last_became_active":"2023-11-04T01:37:51.664841+0000","last_became_peered":"2023-11-04T01:37:51.664841+0000","last_unstale":"2023-11-04T01:37:51.668571+0000","last_undegraded":"2023-11-04T01:37:51.668571+0000","last_fullsized":"2023-11-04T01:37:51.668571+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:18:30.107659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660259+0000","last_change":"2023-11-04T01:37:51.672401+0000","last_active":"2023-11-04T01:37:52.660259+0000","last_peered":"2023-11-04T01:37:52.660259+0000","last_clean":"2023-11-04T01:37:52.660259+0000","last_became_active":"2023-11-04T01:37:51.671284+0000","last_became_peered":"2023-11-04T01:37:51.671284+0000","last_unstale":"2023-11-04T01:37:52.660259+0000","last_undegraded":"2023-11-04T01:37:52.660259+0000","last_fullsized":"2023-11-04T01:37:52.660259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:57.911928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.692492+0000","last_change":"2023-11-04T01:37:51.687747+0000","last_active":"2023-11-04T01:37:51.692492+0000","last_peered":"2023-11-04T01:37:51.692492+0000","last_clean":"2023-11-04T01:37:51.692492+0000","last_became_active":"2023-11-04T01:37:51.687462+0000","last_became_peered":"2023-11-04T01:37:51.687462+0000","last_unstale":"2023-11-04T01:37:51.692492+0000","last_undegraded":"2023-11-04T01:37:51.692492+0000","last_fullsized":"2023-11-04T01:37:51.692492+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:53.910104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660026+0000","last_change":"2023-11-04T01:37:51.674294+0000","last_active":"2023-11-04T01:37:52.660026+0000","last_peered":"2023-11-04T01:37:52.660026+0000","last_clean":"2023-11-04T01:37:52.660026+0000","last_became_active":"2023-11-04T01:37:51.674034+0000","last_became_peered":"2023-11-04T01:37:51.674034+0000","last_unstale":"2023-11-04T01:37:52.660026+0000","last_undegraded":"2023-11-04T01:37:52.660026+0000","last_fullsized":"2023-11-04T01:37:52.660026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:39.631497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.690086+0000","last_change":"2023-11-04T01:37:51.687075+0000","last_active":"2023-11-04T01:37:51.690086+0000","last_peered":"2023-11-04T01:37:51.690086+0000","last_clean":"2023-11-04T01:37:51.690086+0000","last_became_active":"2023-11-04T01:37:51.686827+0000","last_became_peered":"2023-11-04T01:37:51.686827+0000","last_unstale":"2023-11-04T01:37:51.690086+0000","last_undegraded":"2023-11-04T01:37:51.690086+0000","last_fullsized":"2023-11-04T01:37:51.690086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:57.022471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660268+0000","last_change":"2023-11-04T01:37:51.671479+0000","last_active":"2023-11-04T01:37:52.660268+0000","last_peered":"2023-11-04T01:37:52.660268+0000","last_clean":"2023-11-04T01:37:52.660268+0000","last_became_active":"2023-11-04T01:37:51.671214+0000","last_became_peered":"2023-11-04T01:37:51.671214+0000","last_unstale":"2023-11-04T01:37:52.660268+0000","last_undegraded":"2023-11-04T01:37:52.660268+0000","last_fullsized":"2023-11-04T01:37:52.660268+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:24.938168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660035+0000","last_change":"2023-11-04T01:37:51.672117+0000","last_active":"2023-11-04T01:37:52.660035+0000","last_peered":"2023-11-04T01:37:52.660035+0000","last_clean":"2023-11-04T01:37:52.660035+0000","last_became_active":"2023-11-04T01:37:51.671839+0000","last_became_peered":"2023-11-04T01:37:51.671839+0000","last_unstale":"2023-11-04T01:37:52.660035+0000","last_undegraded":"2023-11-04T01:37:52.660035+0000","last_fullsized":"2023-11-04T01:37:52.660035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:31:33.046618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.661042+0000","last_change":"2023-11-04T01:37:51.677044+0000","last_active":"2023-11-04T01:37:52.661042+0000","last_peered":"2023-11-04T01:37:52.661042+0000","last_clean":"2023-11-04T01:37:52.661042+0000","last_became_active":"2023-11-04T01:37:51.676614+0000","last_became_peered":"2023-11-04T01:37:51.676614+0000","last_unstale":"2023-11-04T01:37:52.661042+0000","last_undegraded":"2023-11-04T01:37:52.661042+0000","last_fullsized":"2023-11-04T01:37:52.661042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:28.686720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.666512+0000","last_change":"2023-11-04T01:37:51.663160+0000","last_active":"2023-11-04T01:37:51.666512+0000","last_peered":"2023-11-04T01:37:51.666512+0000","last_clean":"2023-11-04T01:37:51.666512+0000","last_became_active":"2023-11-04T01:37:51.662862+0000","last_became_peered":"2023-11-04T01:37:51.662862+0000","last_unstale":"2023-11-04T01:37:51.666512+0000","last_undegraded":"2023-11-04T01:37:51.666512+0000","last_fullsized":"2023-11-04T01:37:51.666512+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:04:33.686040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660973+0000","last_change":"2023-11-04T01:37:51.690598+0000","last_active":"2023-11-04T01:37:52.660973+0000","last_peered":"2023-11-04T01:37:52.660973+0000","last_clean":"2023-11-04T01:37:52.660973+0000","last_became_active":"2023-11-04T01:37:51.690318+0000","last_became_peered":"2023-11-04T01:37:51.690318+0000","last_unstale":"2023-11-04T01:37:52.660973+0000","last_undegraded":"2023-11-04T01:37:52.660973+0000","last_fullsized":"2023-11-04T01:37:52.660973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:34:31.962004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660353+0000","last_change":"2023-11-04T01:37:50.663198+0000","last_active":"2023-11-04T01:37:52.660353+0000","last_peered":"2023-11-04T01:37:52.660353+0000","last_clean":"2023-11-04T01:37:52.660353+0000","last_became_active":"2023-11-04T01:37:50.662937+0000","last_became_peered":"2023-11-04T01:37:50.662937+0000","last_unstale":"2023-11-04T01:37:52.660353+0000","last_undegraded":"2023-11-04T01:37:52.660353+0000","last_fullsized":"2023-11-04T01:37:52.660353+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:22:20.687375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.692565+0000","last_change":"2023-11-04T01:37:51.688398+0000","last_active":"2023-11-04T01:37:51.692565+0000","last_peered":"2023-11-04T01:37:51.692565+0000","last_clean":"2023-11-04T01:37:51.692565+0000","last_became_active":"2023-11-04T01:37:51.688129+0000","last_became_peered":"2023-11-04T01:37:51.688129+0000","last_unstale":"2023-11-04T01:37:51.692565+0000","last_undegraded":"2023-11-04T01:37:51.692565+0000","last_fullsized":"2023-11-04T01:37:51.692565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:02.664258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.688886+0000","last_change":"2023-11-04T01:37:50.666934+0000","last_active":"2023-11-04T01:37:51.688886+0000","last_peered":"2023-11-04T01:37:51.688886+0000","last_clean":"2023-11-04T01:37:51.688886+0000","last_became_active":"2023-11-04T01:37:50.666689+0000","last_became_peered":"2023-11-04T01:37:50.666689+0000","last_unstale":"2023-11-04T01:37:51.688886+0000","last_undegraded":"2023-11-04T01:37:51.688886+0000","last_fullsized":"2023-11-04T01:37:51.688886+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:11:43.444999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660210+0000","last_change":"2023-11-04T01:37:51.675916+0000","last_active":"2023-11-04T01:37:52.660210+0000","last_peered":"2023-11-04T01:37:52.660210+0000","last_clean":"2023-11-04T01:37:52.660210+0000","last_became_active":"2023-11-04T01:37:51.675555+0000","last_became_peered":"2023-11-04T01:37:51.675555+0000","last_unstale":"2023-11-04T01:37:52.660210+0000","last_undegraded":"2023-11-04T01:37:52.660210+0000","last_fullsized":"2023-11-04T01:37:52.660210+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:04:57.022471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.688991+0000","last_change":"2023-11-04T01:37:50.666093+0000","last_active":"2023-11-04T01:37:51.688991+0000","last_peered":"2023-11-04T01:37:51.688991+0000","last_clean":"2023-11-04T01:37:51.688991+0000","last_became_active":"2023-11-04T01:37:50.665831+0000","last_became_peered":"2023-11-04T01:37:50.665831+0000","last_unstale":"2023-11-04T01:37:51.688991+0000","last_undegraded":"2023-11-04T01:37:51.688991+0000","last_fullsized":"2023-11-04T01:37:51.688991+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:56.909953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.677805+0000","last_change":"2023-11-04T01:37:51.675119+0000","last_active":"2023-11-04T01:37:51.677805+0000","last_peered":"2023-11-04T01:37:51.677805+0000","last_clean":"2023-11-04T01:37:51.677805+0000","last_became_active":"2023-11-04T01:37:51.674303+0000","last_became_peered":"2023-11-04T01:37:51.674303+0000","last_unstale":"2023-11-04T01:37:51.677805+0000","last_undegraded":"2023-11-04T01:37:51.677805+0000","last_fullsized":"2023-11-04T01:37:51.677805+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:05.716469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660487+0000","last_change":"2023-11-04T01:37:50.673293+0000","last_active":"2023-11-04T01:37:52.660487+0000","last_peered":"2023-11-04T01:37:52.660487+0000","last_clean":"2023-11-04T01:37:52.660487+0000","last_became_active":"2023-11-04T01:37:50.672998+0000","last_became_peered":"2023-11-04T01:37:50.672998+0000","last_unstale":"2023-11-04T01:37:52.660487+0000","last_undegraded":"2023-11-04T01:37:52.660487+0000","last_fullsized":"2023-11-04T01:37:52.660487+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:56.909953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.673191+0000","last_change":"2023-11-04T01:37:51.668218+0000","last_active":"2023-11-04T01:37:51.673191+0000","last_peered":"2023-11-04T01:37:51.673191+0000","last_clean":"2023-11-04T01:37:51.673191+0000","last_became_active":"2023-11-04T01:37:51.667895+0000","last_became_peered":"2023-11-04T01:37:51.667895+0000","last_unstale":"2023-11-04T01:37:51.673191+0000","last_undegraded":"2023-11-04T01:37:51.673191+0000","last_fullsized":"2023-11-04T01:37:51.673191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:24.938168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.690101+0000","last_change":"2023-11-04T01:37:50.672640+0000","last_active":"2023-11-04T01:37:51.690101+0000","last_peered":"2023-11-04T01:37:51.690101+0000","last_clean":"2023-11-04T01:37:51.690101+0000","last_became_active":"2023-11-04T01:37:50.672200+0000","last_became_peered":"2023-11-04T01:37:50.672200+0000","last_unstale":"2023-11-04T01:37:51.690101+0000","last_undegraded":"2023-11-04T01:37:51.690101+0000","last_fullsized":"2023-11-04T01:37:51.690101+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:54:19.819631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.686787+0000","last_change":"2023-11-04T01:37:51.679310+0000","last_active":"2023-11-04T01:37:51.686787+0000","last_peered":"2023-11-04T01:37:51.686787+0000","last_clean":"2023-11-04T01:37:51.686787+0000","last_became_active":"2023-11-04T01:37:51.679065+0000","last_became_peered":"2023-11-04T01:37:51.679065+0000","last_unstale":"2023-11-04T01:37:51.686787+0000","last_undegraded":"2023-11-04T01:37:51.686787+0000","last_fullsized":"2023-11-04T01:37:51.686787+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:24.938168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660745+0000","last_change":"2023-11-04T01:37:50.662404+0000","last_active":"2023-11-04T01:37:52.660745+0000","last_peered":"2023-11-04T01:37:52.660745+0000","last_clean":"2023-11-04T01:37:52.660745+0000","last_became_active":"2023-11-04T01:37:50.662138+0000","last_became_peered":"2023-11-04T01:37:50.662138+0000","last_unstale":"2023-11-04T01:37:52.660745+0000","last_undegraded":"2023-11-04T01:37:52.660745+0000","last_fullsized":"2023-11-04T01:37:52.660745+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:58:45.696121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659822+0000","last_change":"2023-11-04T01:37:51.681291+0000","last_active":"2023-11-04T01:37:52.659822+0000","last_peered":"2023-11-04T01:37:52.659822+0000","last_clean":"2023-11-04T01:37:52.659822+0000","last_became_active":"2023-11-04T01:37:51.681016+0000","last_became_peered":"2023-11-04T01:37:51.681016+0000","last_unstale":"2023-11-04T01:37:52.659822+0000","last_undegraded":"2023-11-04T01:37:52.659822+0000","last_fullsized":"2023-11-04T01:37:52.659822+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:58:46.698096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.660533+0000","last_change":"2023-11-04T01:37:50.669986+0000","last_active":"2023-11-04T01:37:51.660533+0000","last_peered":"2023-11-04T01:37:51.660533+0000","last_clean":"2023-11-04T01:37:51.660533+0000","last_became_active":"2023-11-04T01:37:50.669699+0000","last_became_peered":"2023-11-04T01:37:50.669699+0000","last_unstale":"2023-11-04T01:37:51.660533+0000","last_undegraded":"2023-11-04T01:37:51.660533+0000","last_fullsized":"2023-11-04T01:37:51.660533+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:31:32.044643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.672998+0000","last_change":"2023-11-04T01:37:51.668016+0000","last_active":"2023-11-04T01:37:51.672998+0000","last_peered":"2023-11-04T01:37:51.672998+0000","last_clean":"2023-11-04T01:37:51.672998+0000","last_became_active":"2023-11-04T01:37:51.667592+0000","last_became_peered":"2023-11-04T01:37:51.667592+0000","last_unstale":"2023-11-04T01:37:51.672998+0000","last_undegraded":"2023-11-04T01:37:51.672998+0000","last_fullsized":"2023-11-04T01:37:51.672998+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:13:41.359983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659785+0000","last_change":"2023-11-04T01:37:50.662747+0000","last_active":"2023-11-04T01:37:52.659785+0000","last_peered":"2023-11-04T01:37:52.659785+0000","last_clean":"2023-11-04T01:37:52.659785+0000","last_became_active":"2023-11-04T01:37:50.662415+0000","last_became_peered":"2023-11-04T01:37:50.662415+0000","last_unstale":"2023-11-04T01:37:52.659785+0000","last_undegraded":"2023-11-04T01:37:52.659785+0000","last_fullsized":"2023-11-04T01:37:52.659785+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:15.015202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.669201+0000","last_change":"2023-11-04T01:37:51.667404+0000","last_active":"2023-11-04T01:37:51.669201+0000","last_peered":"2023-11-04T01:37:51.669201+0000","last_clean":"2023-11-04T01:37:51.669201+0000","last_became_active":"2023-11-04T01:37:51.667156+0000","last_became_peered":"2023-11-04T01:37:51.667156+0000","last_unstale":"2023-11-04T01:37:51.669201+0000","last_undegraded":"2023-11-04T01:37:51.669201+0000","last_fullsized":"2023-11-04T01:37:51.669201+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:06:59.964540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.661917+0000","last_change":"2023-11-04T01:37:50.669118+0000","last_active":"2023-11-04T01:37:51.661917+0000","last_peered":"2023-11-04T01:37:51.661917+0000","last_clean":"2023-11-04T01:37:51.661917+0000","last_became_active":"2023-11-04T01:37:50.668796+0000","last_became_peered":"2023-11-04T01:37:50.668796+0000","last_unstale":"2023-11-04T01:37:51.661917+0000","last_undegraded":"2023-11-04T01:37:51.661917+0000","last_fullsized":"2023-11-04T01:37:51.661917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:06.716343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660937+0000","last_change":"2023-11-04T01:37:51.677914+0000","last_active":"2023-11-04T01:37:52.660937+0000","last_peered":"2023-11-04T01:37:52.660937+0000","last_clean":"2023-11-04T01:37:52.660937+0000","last_became_active":"2023-11-04T01:37:51.677613+0000","last_became_peered":"2023-11-04T01:37:51.677613+0000","last_unstale":"2023-11-04T01:37:52.660937+0000","last_undegraded":"2023-11-04T01:37:52.660937+0000","last_fullsized":"2023-11-04T01:37:52.660937+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:12:36.905648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.679888+0000","last_change":"2023-11-04T01:37:50.671899+0000","last_active":"2023-11-04T01:37:51.679888+0000","last_peered":"2023-11-04T01:37:51.679888+0000","last_clean":"2023-11-04T01:37:51.679888+0000","last_became_active":"2023-11-04T01:37:50.671561+0000","last_became_peered":"2023-11-04T01:37:50.671561+0000","last_unstale":"2023-11-04T01:37:51.679888+0000","last_undegraded":"2023-11-04T01:37:51.679888+0000","last_fullsized":"2023-11-04T01:37:51.679888+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:27.615370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.670222+0000","last_change":"2023-11-04T01:37:51.666822+0000","last_active":"2023-11-04T01:37:51.670222+0000","last_peered":"2023-11-04T01:37:51.670222+0000","last_clean":"2023-11-04T01:37:51.670222+0000","last_became_active":"2023-11-04T01:37:51.666552+0000","last_became_peered":"2023-11-04T01:37:51.666552+0000","last_unstale":"2023-11-04T01:37:51.670222+0000","last_undegraded":"2023-11-04T01:37:51.670222+0000","last_fullsized":"2023-11-04T01:37:51.670222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:02.664258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.692988+0000","last_change":"2023-11-04T01:37:50.672423+0000","last_active":"2023-11-04T01:37:51.692988+0000","last_peered":"2023-11-04T01:37:51.692988+0000","last_clean":"2023-11-04T01:37:51.692988+0000","last_became_active":"2023-11-04T01:37:50.672100+0000","last_became_peered":"2023-11-04T01:37:50.672100+0000","last_unstale":"2023-11-04T01:37:51.692988+0000","last_undegraded":"2023-11-04T01:37:51.692988+0000","last_fullsized":"2023-11-04T01:37:51.692988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:49.348776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659562+0000","last_change":"2023-11-04T01:37:51.672996+0000","last_active":"2023-11-04T01:37:52.659562+0000","last_peered":"2023-11-04T01:37:52.659562+0000","last_clean":"2023-11-04T01:37:52.659562+0000","last_became_active":"2023-11-04T01:37:51.672699+0000","last_became_peered":"2023-11-04T01:37:51.672699+0000","last_unstale":"2023-11-04T01:37:52.659562+0000","last_undegraded":"2023-11-04T01:37:52.659562+0000","last_fullsized":"2023-11-04T01:37:52.659562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:18:50.143680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.695161+0000","last_change":"2023-11-04T01:37:50.669649+0000","last_active":"2023-11-04T01:37:51.695161+0000","last_peered":"2023-11-04T01:37:51.695161+0000","last_clean":"2023-11-04T01:37:51.695161+0000","last_became_active":"2023-11-04T01:37:50.669342+0000","last_became_peered":"2023-11-04T01:37:50.669342+0000","last_unstale":"2023-11-04T01:37:51.695161+0000","last_undegraded":"2023-11-04T01:37:51.695161+0000","last_fullsized":"2023-11-04T01:37:51.695161+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:27.615370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.692800+0000","last_change":"2023-11-04T01:37:51.688039+0000","last_active":"2023-11-04T01:37:51.692800+0000","last_peered":"2023-11-04T01:37:51.692800+0000","last_clean":"2023-11-04T01:37:51.692800+0000","last_became_active":"2023-11-04T01:37:51.687716+0000","last_became_peered":"2023-11-04T01:37:51.687716+0000","last_unstale":"2023-11-04T01:37:51.692800+0000","last_undegraded":"2023-11-04T01:37:51.692800+0000","last_fullsized":"2023-11-04T01:37:51.692800+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:33:43.729417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.682144+0000","last_change":"2023-11-04T01:37:50.672093+0000","last_active":"2023-11-04T01:37:51.682144+0000","last_peered":"2023-11-04T01:37:51.682144+0000","last_clean":"2023-11-04T01:37:51.682144+0000","last_became_active":"2023-11-04T01:37:50.671840+0000","last_became_peered":"2023-11-04T01:37:50.671840+0000","last_unstale":"2023-11-04T01:37:51.682144+0000","last_undegraded":"2023-11-04T01:37:51.682144+0000","last_fullsized":"2023-11-04T01:37:51.682144+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:54:19.819631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.673304+0000","last_change":"2023-11-04T01:37:51.669534+0000","last_active":"2023-11-04T01:37:51.673304+0000","last_peered":"2023-11-04T01:37:51.673304+0000","last_clean":"2023-11-04T01:37:51.673304+0000","last_became_active":"2023-11-04T01:37:51.669186+0000","last_became_peered":"2023-11-04T01:37:51.669186+0000","last_unstale":"2023-11-04T01:37:51.673304+0000","last_undegraded":"2023-11-04T01:37:51.673304+0000","last_fullsized":"2023-11-04T01:37:51.673304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:24.938168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.660457+0000","last_change":"2023-11-04T01:37:50.672804+0000","last_active":"2023-11-04T01:37:51.660457+0000","last_peered":"2023-11-04T01:37:51.660457+0000","last_clean":"2023-11-04T01:37:51.660457+0000","last_became_active":"2023-11-04T01:37:50.672527+0000","last_became_peered":"2023-11-04T01:37:50.672527+0000","last_unstale":"2023-11-04T01:37:51.660457+0000","last_undegraded":"2023-11-04T01:37:51.660457+0000","last_fullsized":"2023-11-04T01:37:51.660457+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:05.095419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660875+0000","last_change":"2023-11-04T01:37:51.669467+0000","last_active":"2023-11-04T01:37:52.660875+0000","last_peered":"2023-11-04T01:37:52.660875+0000","last_clean":"2023-11-04T01:37:52.660875+0000","last_became_active":"2023-11-04T01:37:51.668973+0000","last_became_peered":"2023-11-04T01:37:51.668973+0000","last_unstale":"2023-11-04T01:37:52.660875+0000","last_undegraded":"2023-11-04T01:37:52.660875+0000","last_fullsized":"2023-11-04T01:37:52.660875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:39.893222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659625+0000","last_change":"2023-11-04T01:37:50.664216+0000","last_active":"2023-11-04T01:37:52.659625+0000","last_peered":"2023-11-04T01:37:52.659625+0000","last_clean":"2023-11-04T01:37:52.659625+0000","last_became_active":"2023-11-04T01:37:50.663916+0000","last_became_peered":"2023-11-04T01:37:50.663916+0000","last_unstale":"2023-11-04T01:37:52.659625+0000","last_undegraded":"2023-11-04T01:37:52.659625+0000","last_fullsized":"2023-11-04T01:37:52.659625+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:50:38.981365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.675781+0000","last_change":"2023-11-04T01:37:51.670660+0000","last_active":"2023-11-04T01:37:51.675781+0000","last_peered":"2023-11-04T01:37:51.675781+0000","last_clean":"2023-11-04T01:37:51.675781+0000","last_became_active":"2023-11-04T01:37:51.670365+0000","last_became_peered":"2023-11-04T01:37:51.670365+0000","last_unstale":"2023-11-04T01:37:51.675781+0000","last_undegraded":"2023-11-04T01:37:51.675781+0000","last_fullsized":"2023-11-04T01:37:51.675781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:18:50.143680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659416+0000","last_change":"2023-11-04T01:37:50.663036+0000","last_active":"2023-11-04T01:37:52.659416+0000","last_peered":"2023-11-04T01:37:52.659416+0000","last_clean":"2023-11-04T01:37:52.659416+0000","last_became_active":"2023-11-04T01:37:50.662784+0000","last_became_peered":"2023-11-04T01:37:50.662784+0000","last_unstale":"2023-11-04T01:37:52.659416+0000","last_undegraded":"2023-11-04T01:37:52.659416+0000","last_fullsized":"2023-11-04T01:37:52.659416+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:56.909953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.681561+0000","last_change":"2023-11-04T01:37:51.676162+0000","last_active":"2023-11-04T01:37:51.681561+0000","last_peered":"2023-11-04T01:37:51.681561+0000","last_clean":"2023-11-04T01:37:51.681561+0000","last_became_active":"2023-11-04T01:37:51.675848+0000","last_became_peered":"2023-11-04T01:37:51.675848+0000","last_unstale":"2023-11-04T01:37:51.681561+0000","last_undegraded":"2023-11-04T01:37:51.681561+0000","last_fullsized":"2023-11-04T01:37:51.681561+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:26.753300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.690139+0000","last_change":"2023-11-04T01:37:50.672270+0000","last_active":"2023-11-04T01:37:51.690139+0000","last_peered":"2023-11-04T01:37:51.690139+0000","last_clean":"2023-11-04T01:37:51.690139+0000","last_became_active":"2023-11-04T01:37:50.671943+0000","last_became_peered":"2023-11-04T01:37:50.671943+0000","last_unstale":"2023-11-04T01:37:51.690139+0000","last_undegraded":"2023-11-04T01:37:51.690139+0000","last_fullsized":"2023-11-04T01:37:51.690139+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:06.716343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.687474+0000","last_change":"2023-11-04T01:37:51.683061+0000","last_active":"2023-11-04T01:37:51.687474+0000","last_peered":"2023-11-04T01:37:51.687474+0000","last_clean":"2023-11-04T01:37:51.687474+0000","last_became_active":"2023-11-04T01:37:51.681312+0000","last_became_peered":"2023-11-04T01:37:51.681312+0000","last_unstale":"2023-11-04T01:37:51.687474+0000","last_undegraded":"2023-11-04T01:37:51.687474+0000","last_fullsized":"2023-11-04T01:37:51.687474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:39.631497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660293+0000","last_change":"2023-11-04T01:37:50.671915+0000","last_active":"2023-11-04T01:37:52.660293+0000","last_peered":"2023-11-04T01:37:52.660293+0000","last_clean":"2023-11-04T01:37:52.660293+0000","last_became_active":"2023-11-04T01:37:50.671602+0000","last_became_peered":"2023-11-04T01:37:50.671602+0000","last_unstale":"2023-11-04T01:37:52.660293+0000","last_undegraded":"2023-11-04T01:37:52.660293+0000","last_fullsized":"2023-11-04T01:37:52.660293+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:23.936193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660196+0000","last_change":"2023-11-04T01:37:51.667378+0000","last_active":"2023-11-04T01:37:52.660196+0000","last_peered":"2023-11-04T01:37:52.660196+0000","last_clean":"2023-11-04T01:37:52.660196+0000","last_became_active":"2023-11-04T01:37:51.667070+0000","last_became_peered":"2023-11-04T01:37:51.667070+0000","last_unstale":"2023-11-04T01:37:52.660196+0000","last_undegraded":"2023-11-04T01:37:52.660196+0000","last_fullsized":"2023-11-04T01:37:52.660196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:26.753300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.689035+0000","last_change":"2023-11-04T01:37:50.666413+0000","last_active":"2023-11-04T01:37:51.689035+0000","last_peered":"2023-11-04T01:37:51.689035+0000","last_clean":"2023-11-04T01:37:51.689035+0000","last_became_active":"2023-11-04T01:37:50.666159+0000","last_became_peered":"2023-11-04T01:37:50.666159+0000","last_unstale":"2023-11-04T01:37:51.689035+0000","last_undegraded":"2023-11-04T01:37:51.689035+0000","last_fullsized":"2023-11-04T01:37:51.689035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:38:22.044501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.672742+0000","last_change":"2023-11-04T01:37:51.671468+0000","last_active":"2023-11-04T01:37:51.672742+0000","last_peered":"2023-11-04T01:37:51.672742+0000","last_clean":"2023-11-04T01:37:51.672742+0000","last_became_active":"2023-11-04T01:37:51.671151+0000","last_became_peered":"2023-11-04T01:37:51.671151+0000","last_unstale":"2023-11-04T01:37:51.672742+0000","last_undegraded":"2023-11-04T01:37:51.672742+0000","last_fullsized":"2023-11-04T01:37:51.672742+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:56:55.334905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.660491+0000","last_change":"2023-11-04T01:37:50.662985+0000","last_active":"2023-11-04T01:37:51.660491+0000","last_peered":"2023-11-04T01:37:51.660491+0000","last_clean":"2023-11-04T01:37:51.660491+0000","last_became_active":"2023-11-04T01:37:50.662708+0000","last_became_peered":"2023-11-04T01:37:50.662708+0000","last_unstale":"2023-11-04T01:37:51.660491+0000","last_undegraded":"2023-11-04T01:37:51.660491+0000","last_fullsized":"2023-11-04T01:37:51.660491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:38.629522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659556+0000","last_change":"2023-11-04T01:37:51.676280+0000","last_active":"2023-11-04T01:37:52.659556+0000","last_peered":"2023-11-04T01:37:52.659556+0000","last_clean":"2023-11-04T01:37:52.659556+0000","last_became_active":"2023-11-04T01:37:51.676003+0000","last_became_peered":"2023-11-04T01:37:51.676003+0000","last_unstale":"2023-11-04T01:37:52.659556+0000","last_undegraded":"2023-11-04T01:37:52.659556+0000","last_fullsized":"2023-11-04T01:37:52.659556+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:15.263400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.687482+0000","last_change":"2023-11-04T01:37:50.667387+0000","last_active":"2023-11-04T01:37:51.687482+0000","last_peered":"2023-11-04T01:37:51.687482+0000","last_clean":"2023-11-04T01:37:51.687482+0000","last_became_active":"2023-11-04T01:37:50.667089+0000","last_became_peered":"2023-11-04T01:37:50.667089+0000","last_unstale":"2023-11-04T01:37:51.687482+0000","last_undegraded":"2023-11-04T01:37:51.687482+0000","last_fullsized":"2023-11-04T01:37:51.687482+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:59.968455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.668754+0000","last_change":"2023-11-04T01:37:51.664974+0000","last_active":"2023-11-04T01:37:51.668754+0000","last_peered":"2023-11-04T01:37:51.668754+0000","last_clean":"2023-11-04T01:37:51.668754+0000","last_became_active":"2023-11-04T01:37:51.664710+0000","last_became_peered":"2023-11-04T01:37:51.664710+0000","last_unstale":"2023-11-04T01:37:51.668754+0000","last_undegraded":"2023-11-04T01:37:51.668754+0000","last_fullsized":"2023-11-04T01:37:51.668754+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:04:33.686040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.655472+0000","last_change":"2023-11-04T01:37:50.670586+0000","last_active":"2023-11-04T01:37:51.655472+0000","last_peered":"2023-11-04T01:37:51.655472+0000","last_clean":"2023-11-04T01:37:51.655472+0000","last_became_active":"2023-11-04T01:37:50.670351+0000","last_became_peered":"2023-11-04T01:37:50.670351+0000","last_unstale":"2023-11-04T01:37:51.655472+0000","last_undegraded":"2023-11-04T01:37:51.655472+0000","last_fullsized":"2023-11-04T01:37:51.655472+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:46:10.680910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.686591+0000","last_change":"2023-11-04T01:37:51.680530+0000","last_active":"2023-11-04T01:37:51.686591+0000","last_peered":"2023-11-04T01:37:51.686591+0000","last_clean":"2023-11-04T01:37:51.686591+0000","last_became_active":"2023-11-04T01:37:51.680289+0000","last_became_peered":"2023-11-04T01:37:51.680289+0000","last_unstale":"2023-11-04T01:37:51.686591+0000","last_undegraded":"2023-11-04T01:37:51.686591+0000","last_fullsized":"2023-11-04T01:37:51.686591+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:31:33.046618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660836+0000","last_change":"2023-11-04T01:37:50.666156+0000","last_active":"2023-11-04T01:37:52.660836+0000","last_peered":"2023-11-04T01:37:52.660836+0000","last_clean":"2023-11-04T01:37:52.660836+0000","last_became_active":"2023-11-04T01:37:50.665875+0000","last_became_peered":"2023-11-04T01:37:50.665875+0000","last_unstale":"2023-11-04T01:37:52.660836+0000","last_undegraded":"2023-11-04T01:37:52.660836+0000","last_fullsized":"2023-11-04T01:37:52.660836+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:27.615370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.670546+0000","last_change":"2023-11-04T01:37:51.667847+0000","last_active":"2023-11-04T01:37:51.670546+0000","last_peered":"2023-11-04T01:37:51.670546+0000","last_clean":"2023-11-04T01:37:51.670546+0000","last_became_active":"2023-11-04T01:37:51.667245+0000","last_became_peered":"2023-11-04T01:37:51.667245+0000","last_unstale":"2023-11-04T01:37:51.670546+0000","last_undegraded":"2023-11-04T01:37:51.670546+0000","last_fullsized":"2023-11-04T01:37:51.670546+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:58:46.698096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.655467+0000","last_change":"2023-11-04T01:37:50.667562+0000","last_active":"2023-11-04T01:37:51.655467+0000","last_peered":"2023-11-04T01:37:51.655467+0000","last_clean":"2023-11-04T01:37:51.655467+0000","last_became_active":"2023-11-04T01:37:50.667299+0000","last_became_peered":"2023-11-04T01:37:50.667299+0000","last_unstale":"2023-11-04T01:37:51.655467+0000","last_undegraded":"2023-11-04T01:37:51.655467+0000","last_fullsized":"2023-11-04T01:37:51.655467+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:32:40.860363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.692543+0000","last_change":"2023-11-04T01:37:51.688681+0000","last_active":"2023-11-04T01:37:51.692543+0000","last_peered":"2023-11-04T01:37:51.692543+0000","last_clean":"2023-11-04T01:37:51.692543+0000","last_became_active":"2023-11-04T01:37:51.688402+0000","last_became_peered":"2023-11-04T01:37:51.688402+0000","last_unstale":"2023-11-04T01:37:51.692543+0000","last_undegraded":"2023-11-04T01:37:51.692543+0000","last_fullsized":"2023-11-04T01:37:51.692543+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:22:21.689351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.692841+0000","last_change":"2023-11-04T01:37:50.672641+0000","last_active":"2023-11-04T01:37:51.692841+0000","last_peered":"2023-11-04T01:37:51.692841+0000","last_clean":"2023-11-04T01:37:51.692841+0000","last_became_active":"2023-11-04T01:37:50.672340+0000","last_became_peered":"2023-11-04T01:37:50.672340+0000","last_unstale":"2023-11-04T01:37:51.692841+0000","last_undegraded":"2023-11-04T01:37:51.692841+0000","last_fullsized":"2023-11-04T01:37:51.692841+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:36.933854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.661115+0000","last_change":"2023-11-04T01:37:51.675578+0000","last_active":"2023-11-04T01:37:52.661115+0000","last_peered":"2023-11-04T01:37:52.661115+0000","last_clean":"2023-11-04T01:37:52.661115+0000","last_became_active":"2023-11-04T01:37:51.675281+0000","last_became_peered":"2023-11-04T01:37:51.675281+0000","last_unstale":"2023-11-04T01:37:52.661115+0000","last_undegraded":"2023-11-04T01:37:52.661115+0000","last_fullsized":"2023-11-04T01:37:52.661115+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:44:57.333146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.655809+0000","last_change":"2023-11-04T01:37:50.671913+0000","last_active":"2023-11-04T01:37:51.655809+0000","last_peered":"2023-11-04T01:37:51.655809+0000","last_clean":"2023-11-04T01:37:51.655809+0000","last_became_active":"2023-11-04T01:37:50.671640+0000","last_became_peered":"2023-11-04T01:37:50.671640+0000","last_unstale":"2023-11-04T01:37:51.655809+0000","last_undegraded":"2023-11-04T01:37:51.655809+0000","last_fullsized":"2023-11-04T01:37:51.655809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:42.972341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.673335+0000","last_change":"2023-11-04T01:37:51.669795+0000","last_active":"2023-11-04T01:37:51.673335+0000","last_peered":"2023-11-04T01:37:51.673335+0000","last_clean":"2023-11-04T01:37:51.673335+0000","last_became_active":"2023-11-04T01:37:51.669381+0000","last_became_peered":"2023-11-04T01:37:51.669381+0000","last_unstale":"2023-11-04T01:37:51.673335+0000","last_undegraded":"2023-11-04T01:37:51.673335+0000","last_fullsized":"2023-11-04T01:37:51.673335+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:37.935830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.661003+0000","last_change":"2023-11-04T01:37:50.670433+0000","last_active":"2023-11-04T01:37:51.661003+0000","last_peered":"2023-11-04T01:37:51.661003+0000","last_clean":"2023-11-04T01:37:51.661003+0000","last_became_active":"2023-11-04T01:37:50.670193+0000","last_became_peered":"2023-11-04T01:37:50.670193+0000","last_unstale":"2023-11-04T01:37:51.661003+0000","last_undegraded":"2023-11-04T01:37:51.661003+0000","last_fullsized":"2023-11-04T01:37:51.661003+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:56.909953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.673246+0000","last_change":"2023-11-04T01:37:51.669582+0000","last_active":"2023-11-04T01:37:51.673246+0000","last_peered":"2023-11-04T01:37:51.673246+0000","last_clean":"2023-11-04T01:37:51.673246+0000","last_became_active":"2023-11-04T01:37:51.669316+0000","last_became_peered":"2023-11-04T01:37:51.669316+0000","last_unstale":"2023-11-04T01:37:51.673246+0000","last_undegraded":"2023-11-04T01:37:51.673246+0000","last_fullsized":"2023-11-04T01:37:51.673246+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:31:33.046618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.659040+0000","last_change":"2023-11-04T01:37:50.669272+0000","last_active":"2023-11-04T01:37:51.659040+0000","last_peered":"2023-11-04T01:37:51.659040+0000","last_clean":"2023-11-04T01:37:51.659040+0000","last_became_active":"2023-11-04T01:37:50.668929+0000","last_became_peered":"2023-11-04T01:37:50.668929+0000","last_unstale":"2023-11-04T01:37:51.659040+0000","last_undegraded":"2023-11-04T01:37:51.659040+0000","last_fullsized":"2023-11-04T01:37:51.659040+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:38.629522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.675648+0000","last_change":"2023-11-04T01:37:51.674211+0000","last_active":"2023-11-04T01:37:51.675648+0000","last_peered":"2023-11-04T01:37:51.675648+0000","last_clean":"2023-11-04T01:37:51.675648+0000","last_became_active":"2023-11-04T01:37:51.673918+0000","last_became_peered":"2023-11-04T01:37:51.673918+0000","last_unstale":"2023-11-04T01:37:51.675648+0000","last_undegraded":"2023-11-04T01:37:51.675648+0000","last_fullsized":"2023-11-04T01:37:51.675648+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:16.017178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660122+0000","last_change":"2023-11-04T01:37:50.671957+0000","last_active":"2023-11-04T01:37:52.660122+0000","last_peered":"2023-11-04T01:37:52.660122+0000","last_clean":"2023-11-04T01:37:52.660122+0000","last_became_active":"2023-11-04T01:37:50.671658+0000","last_became_peered":"2023-11-04T01:37:50.671658+0000","last_unstale":"2023-11-04T01:37:52.660122+0000","last_undegraded":"2023-11-04T01:37:52.660122+0000","last_fullsized":"2023-11-04T01:37:52.660122+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:52.908128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659615+0000","last_change":"2023-11-04T01:37:51.670195+0000","last_active":"2023-11-04T01:37:52.659615+0000","last_peered":"2023-11-04T01:37:52.659615+0000","last_clean":"2023-11-04T01:37:52.659615+0000","last_became_active":"2023-11-04T01:37:51.669904+0000","last_became_peered":"2023-11-04T01:37:51.669904+0000","last_unstale":"2023-11-04T01:37:52.659615+0000","last_undegraded":"2023-11-04T01:37:52.659615+0000","last_fullsized":"2023-11-04T01:37:52.659615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:05.716469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.659995+0000","last_change":"2023-11-04T01:37:50.669425+0000","last_active":"2023-11-04T01:37:52.659995+0000","last_peered":"2023-11-04T01:37:52.659995+0000","last_clean":"2023-11-04T01:37:52.659995+0000","last_became_active":"2023-11-04T01:37:50.668934+0000","last_became_peered":"2023-11-04T01:37:50.668934+0000","last_unstale":"2023-11-04T01:37:52.659995+0000","last_undegraded":"2023-11-04T01:37:52.659995+0000","last_fullsized":"2023-11-04T01:37:52.659995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:31:32.044643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.660990+0000","last_change":"2023-11-04T01:37:51.677319+0000","last_active":"2023-11-04T01:37:52.660990+0000","last_peered":"2023-11-04T01:37:52.660990+0000","last_clean":"2023-11-04T01:37:52.660990+0000","last_became_active":"2023-11-04T01:37:51.676461+0000","last_became_peered":"2023-11-04T01:37:51.676461+0000","last_unstale":"2023-11-04T01:37:52.660990+0000","last_undegraded":"2023-11-04T01:37:52.660990+0000","last_fullsized":"2023-11-04T01:37:52.660990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:25.288162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.660765+0000","last_change":"2023-11-04T01:37:50.669691+0000","last_active":"2023-11-04T01:37:51.660765+0000","last_peered":"2023-11-04T01:37:51.660765+0000","last_clean":"2023-11-04T01:37:51.660765+0000","last_became_active":"2023-11-04T01:37:50.669461+0000","last_became_peered":"2023-11-04T01:37:50.669461+0000","last_unstale":"2023-11-04T01:37:51.660765+0000","last_undegraded":"2023-11-04T01:37:51.660765+0000","last_fullsized":"2023-11-04T01:37:51.660765+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:11:43.444999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.686583+0000","last_change":"2023-11-04T01:37:51.684049+0000","last_active":"2023-11-04T01:37:51.686583+0000","last_peered":"2023-11-04T01:37:51.686583+0000","last_clean":"2023-11-04T01:37:51.686583+0000","last_became_active":"2023-11-04T01:37:51.683705+0000","last_became_peered":"2023-11-04T01:37:51.683705+0000","last_unstale":"2023-11-04T01:37:51.686583+0000","last_undegraded":"2023-11-04T01:37:51.686583+0000","last_fullsized":"2023-11-04T01:37:51.686583+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:50.646035+0000","last_clean_scrub_stamp":"2023-11-04T01:37:50.646035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:13:41.359983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:37:52.661032+0000","last_change":"2023-11-04T01:37:50.671517+0000","last_active":"2023-11-04T01:37:52.661032+0000","last_peered":"2023-11-04T01:37:52.661032+0000","last_clean":"2023-11-04T01:37:52.661032+0000","last_became_active":"2023-11-04T01:37:50.671165+0000","last_became_peered":"2023-11-04T01:37:50.671165+0000","last_unstale":"2023-11-04T01:37:52.661032+0000","last_undegraded":"2023-11-04T01:37:52.661032+0000","last_fullsized":"2023-11-04T01:37:52.661032+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:49.644060+0000","last_clean_scrub_stamp":"2023-11-04T01:37:49.644060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:18:49.141704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:37:51.662185+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:37:51.662185+0000","last_peered":"2023-11-04T01:37:51.662185+0000","last_clean":"2023-11-04T01:37:51.662185+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:37:51.662185+0000","last_undegraded":"2023-11-04T01:37:51.662185+0000","last_fullsized":"2023-11-04T01:37:51.662185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":773914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.61799999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.66800000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.629},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.64000000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.58399999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.42399999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.60199999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.55500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":182446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.46999999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.56100000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.626}]},{"osd":3,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.70099999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.71499999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.69199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":181976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.377},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47999999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.40999999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.505}]},{"osd":4,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.46500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.36199999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.44800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":182468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.55900000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.623}]},{"osd":2,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.59799999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.33600000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.41299999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.439},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.48799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":183510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.30599999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.38100000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.32800000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.47899999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.57899999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.50900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":181934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.252},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.27000000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.32600000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.307}]},{"osd":4,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.85199999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.877}]},{"osd":6,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71999999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.76200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":181954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.254},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.41599999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.33600000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.59399999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.627},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.63800000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.65200000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":772266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.26400000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.29799999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.313},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.61499999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.753}]},{"osd":7,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:37:54.950 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:37:54.951 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:37:55.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.091+0000 7f5e2a3d7640 1 Processor -- start 2023-11-04T01:37:55.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.091+0000 7f5e2a3d7640 1 -- start start 2023-11-04T01:37:55.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.092+0000 7f5e2a3d7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e24153e60 0x7f5e2415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.092+0000 7f5e2a3d7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5e240cd6d0 0x7f5e24161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.092+0000 7f5e2a3d7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5e240b4880 0x7f5e240b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.092+0000 7f5e2a3d7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e240cde60 con 0x7f5e240b4880 2023-11-04T01:37:55.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.092+0000 7f5e2a3d7640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e24160f90 con 0x7f5e240cd6d0 2023-11-04T01:37:55.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.092+0000 7f5e2a3d7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e240b5200 con 0x7f5e24153e60 2023-11-04T01:37:55.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.092+0000 7f5e28974640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5e240b4880 0x7f5e240b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.093+0000 7f5e28974640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5e240b4880 0x7f5e240b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51288/0 (socket says 172.21.15.114:51288) 2023-11-04T01:37:55.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.093+0000 7f5e28974640 1 -- 172.21.15.114:0/3516492106 learned_addr learned my addr 172.21.15.114:0/3516492106 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:55.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.093+0000 7f5e23fff640 1 --2- 172.21.15.114:0/3516492106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e24153e60 0x7f5e2415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.093+0000 7f5e237fe640 1 --2- 172.21.15.114:0/3516492106 >> v2:172.21.15.141:3300/0 conn(0x7f5e240cd6d0 0x7f5e24161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.093+0000 7f5e28974640 1 -- 172.21.15.114:0/3516492106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e24153e60 msgr2=0x7f5e2415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:55.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.093+0000 7f5e28974640 1 --2- 172.21.15.114:0/3516492106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e24153e60 0x7f5e2415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.093+0000 7f5e28974640 1 -- 172.21.15.114:0/3516492106 >> v2:172.21.15.141:3300/0 conn(0x7f5e240cd6d0 msgr2=0x7f5e24161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:55.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.093+0000 7f5e28974640 1 --2- 172.21.15.114:0/3516492106 >> v2:172.21.15.141:3300/0 conn(0x7f5e240cd6d0 0x7f5e24161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.093+0000 7f5e28974640 1 -- 172.21.15.114:0/3516492106 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2415e400 con 0x7f5e240b4880 2023-11-04T01:37:55.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.093+0000 7f5e23fff640 1 --2- 172.21.15.114:0/3516492106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e24153e60 0x7f5e2415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:55.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.093+0000 7f5e28974640 1 --2- 172.21.15.114:0/3516492106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e240b4880 0x7f5e240b4cc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5e2406c930 tx=0x7f5e1c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a9097dccb8f3ca server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.094+0000 7f5e22ffd640 1 -- 172.21.15.114:0/3516492106 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c02ca70 con 0x7f5e240b4880 2023-11-04T01:37:55.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.094+0000 7f5e22ffd640 1 -- 172.21.15.114:0/3516492106 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1c02cbd0 con 0x7f5e240b4880 2023-11-04T01:37:55.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.094+0000 7f5e22ffd640 1 -- 172.21.15.114:0/3516492106 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c0343f0 con 0x7f5e240b4880 2023-11-04T01:37:55.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.094+0000 7f5e2a3d7640 1 -- 172.21.15.114:0/3516492106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e240b4880 msgr2=0x7f5e240b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.094+0000 7f5e2a3d7640 1 --2- 172.21.15.114:0/3516492106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e240b4880 0x7f5e240b4cc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5e2406c930 tx=0x7f5e1c02bed0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.094+0000 7f5e2a3d7640 1 -- 172.21.15.114:0/3516492106 shutdown_connections 2023-11-04T01:37:55.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.094+0000 7f5e2a3d7640 1 --2- 172.21.15.114:0/3516492106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e240b4880 0x7f5e240b4cc0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.094+0000 7f5e2a3d7640 1 --2- 172.21.15.114:0/3516492106 >> v2:172.21.15.141:3300/0 conn(0x7f5e240cd6d0 0x7f5e24161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.094+0000 7f5e2a3d7640 1 --2- 172.21.15.114:0/3516492106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e24153e60 0x7f5e2415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.094+0000 7f5e2a3d7640 1 -- 172.21.15.114:0/3516492106 >> 172.21.15.114:0/3516492106 conn(0x7f5e240cf880 msgr2=0x7f5e240cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:55.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.094+0000 7f5e2a3d7640 1 -- 172.21.15.114:0/3516492106 shutdown_connections 2023-11-04T01:37:55.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.094+0000 7f5e2a3d7640 1 -- 172.21.15.114:0/3516492106 wait complete. 2023-11-04T01:37:55.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.095+0000 7f5e2a3d7640 1 Processor -- start 2023-11-04T01:37:55.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.096+0000 7f5e2a3d7640 1 -- start start 2023-11-04T01:37:55.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.096+0000 7f5e2a3d7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e240b4880 0x7f5e240cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.096+0000 7f5e2a3d7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e240cd6d0 0x7f5e240c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.096+0000 7f5e2a3d7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e24153e60 0x7f5e241f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.096+0000 7f5e2a3d7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e241f3e50 con 0x7f5e240b4880 2023-11-04T01:37:55.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.096+0000 7f5e2a3d7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e241f4130 con 0x7f5e24153e60 2023-11-04T01:37:55.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.096+0000 7f5e2a3d7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e241f4410 con 0x7f5e240cd6d0 2023-11-04T01:37:55.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.096+0000 7f5e23fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e240b4880 0x7f5e240cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.096+0000 7f5e23fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e240b4880 0x7f5e240cbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51300/0 (socket says 172.21.15.114:51300) 2023-11-04T01:37:55.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.096+0000 7f5e23fff640 1 -- 172.21.15.114:0/3089718715 learned_addr learned my addr 172.21.15.114:0/3089718715 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:55.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.096+0000 7f5e28974640 1 --2- 172.21.15.114:0/3089718715 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e24153e60 0x7f5e241f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.096+0000 7f5e237fe640 1 --2- 172.21.15.114:0/3089718715 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e240cd6d0 0x7f5e240c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.097+0000 7f5e23fff640 1 -- 172.21.15.114:0/3089718715 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e240cd6d0 msgr2=0x7f5e240c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.097+0000 7f5e23fff640 1 --2- 172.21.15.114:0/3089718715 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e240cd6d0 0x7f5e240c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.097+0000 7f5e23fff640 1 -- 172.21.15.114:0/3089718715 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e24153e60 msgr2=0x7f5e241f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.097+0000 7f5e23fff640 1 --2- 172.21.15.114:0/3089718715 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e24153e60 0x7f5e241f3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.097+0000 7f5e23fff640 1 -- 172.21.15.114:0/3089718715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1c009b30 con 0x7f5e240b4880 2023-11-04T01:37:55.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.097+0000 7f5e237fe640 1 --2- 172.21.15.114:0/3089718715 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e240cd6d0 0x7f5e240c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:55.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.097+0000 7f5e28974640 1 --2- 172.21.15.114:0/3089718715 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e24153e60 0x7f5e241f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:55.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.097+0000 7f5e23fff640 1 --2- 172.21.15.114:0/3089718715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e240b4880 0x7f5e240cbb80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400d7d0 tx=0x7f5e1400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.097+0000 7f5e20ff9640 1 -- 172.21.15.114:0/3089718715 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14004030 con 0x7f5e240b4880 2023-11-04T01:37:55.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.097+0000 7f5e20ff9640 1 -- 172.21.15.114:0/3089718715 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e14004190 con 0x7f5e240b4880 2023-11-04T01:37:55.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.097+0000 7f5e20ff9640 1 -- 172.21.15.114:0/3089718715 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14004520 con 0x7f5e240b4880 2023-11-04T01:37:55.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.097+0000 7f5e2a3d7640 1 -- 172.21.15.114:0/3089718715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e241f46f0 con 0x7f5e240b4880 2023-11-04T01:37:55.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.097+0000 7f5e2a3d7640 1 -- 172.21.15.114:0/3089718715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e241f3b60 con 0x7f5e240b4880 2023-11-04T01:37:55.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.098+0000 7f5e2a3d7640 1 -- 172.21.15.114:0/3089718715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e24074290 con 0x7f5e240b4880 2023-11-04T01:37:55.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.098+0000 7f5e20ff9640 1 -- 172.21.15.114:0/3089718715 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e140096a0 con 0x7f5e240b4880 2023-11-04T01:37:55.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.099+0000 7f5e20ff9640 1 --2- 172.21.15.114:0/3089718715 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5e1006ae70 0x7f5e1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.099+0000 7f5e237fe640 1 --2- 172.21.15.114:0/3089718715 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5e1006ae70 0x7f5e1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.099+0000 7f5e20ff9640 1 -- 172.21.15.114:0/3089718715 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5e14089950 con 0x7f5e240b4880 2023-11-04T01:37:55.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.099+0000 7f5e237fe640 1 --2- 172.21.15.114:0/3089718715 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5e1006ae70 0x7f5e1006d330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5e240cc0c0 tx=0x7f5e18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.103+0000 7f5e20ff9640 1 -- 172.21.15.114:0/3089718715 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5e140548c0 con 0x7f5e240b4880 2023-11-04T01:37:55.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.334+0000 7f5e2a3d7640 1 -- 172.21.15.114:0/3089718715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5e240d0b80 con 0x7f5e240b4880 2023-11-04T01:37:55.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.336+0000 7f5e20ff9640 1 -- 172.21.15.114:0/3089718715 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f5e14057ee0 con 0x7f5e240b4880 2023-11-04T01:37:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2023-11-04T01:37:55.338 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDan0Vl3QHODhAA6LWlhd+avWYsoYsWMbOiVA== 2023-11-04T01:37:55.338 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2023-11-04T01:37:55.338 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2023-11-04T01:37:55.338 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:37:55.338 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2023-11-04T01:37:55.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.338+0000 7f5e2a3d7640 1 -- 172.21.15.114:0/3089718715 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5e1006ae70 msgr2=0x7f5e1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.338+0000 7f5e2a3d7640 1 --2- 172.21.15.114:0/3089718715 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5e1006ae70 0x7f5e1006d330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5e240cc0c0 tx=0x7f5e18008040 comp rx=0 tx=0).stop 2023-11-04T01:37:55.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.338+0000 7f5e2a3d7640 1 -- 172.21.15.114:0/3089718715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e240b4880 msgr2=0x7f5e240cbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.338+0000 7f5e2a3d7640 1 --2- 172.21.15.114:0/3089718715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e240b4880 0x7f5e240cbb80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400d7d0 tx=0x7f5e1400dc90 comp rx=0 tx=0).stop 2023-11-04T01:37:55.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.338+0000 7f5e2a3d7640 1 -- 172.21.15.114:0/3089718715 shutdown_connections 2023-11-04T01:37:55.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.338+0000 7f5e2a3d7640 1 --2- 172.21.15.114:0/3089718715 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5e1006ae70 0x7f5e1006d330 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.338+0000 7f5e2a3d7640 1 --2- 172.21.15.114:0/3089718715 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5e24153e60 0x7f5e241f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.338+0000 7f5e2a3d7640 1 --2- 172.21.15.114:0/3089718715 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5e240cd6d0 0x7f5e240c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.338+0000 7f5e2a3d7640 1 --2- 172.21.15.114:0/3089718715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e240b4880 0x7f5e240cbb80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.338+0000 7f5e2a3d7640 1 -- 172.21.15.114:0/3089718715 >> 172.21.15.114:0/3089718715 conn(0x7f5e240cf880 msgr2=0x7f5e240cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:55.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.338+0000 7f5e2a3d7640 1 -- 172.21.15.114:0/3089718715 shutdown_connections 2023-11-04T01:37:55.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.338+0000 7f5e2a3d7640 1 -- 172.21.15.114:0/3089718715 wait complete. 2023-11-04T01:37:55.351 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:37:55.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.448+0000 7f9cd4875640 1 Processor -- start 2023-11-04T01:37:55.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.448+0000 7f9cd4875640 1 -- start start 2023-11-04T01:37:55.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9cd4875640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cd00cde60 0x7f9cd015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9cd4875640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd015e000 con 0x7f9cd00ce240 2023-11-04T01:37:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9cd4875640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd015e2e0 con 0x7f9cd015daa0 2023-11-04T01:37:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9cd4875640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd015e5c0 con 0x7f9cd00cde60 2023-11-04T01:37:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9cced9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9cd00ce240 0x7f9cd00d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60666/0 (socket says 172.21.15.114:60666) 2023-11-04T01:37:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9cced9d640 1 -- 172.21.15.114:0/268471479 learned_addr learned my addr 172.21.15.114:0/268471479 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9cce59c640 1 --2- 172.21.15.114:0/268471479 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cd00cde60 0x7f9cd015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9ccdd9b640 1 -- 172.21.15.114:0/268471479 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3319335412 0 0) 0x7f9cd015e000 con 0x7f9cd00ce240 2023-11-04T01:37:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9ccdd9b640 1 -- 172.21.15.114:0/268471479 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cbc003520 con 0x7f9cd00ce240 2023-11-04T01:37:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9ccdd9b640 1 -- 172.21.15.114:0/268471479 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3354034675 0 0) 0x7f9cbc003520 con 0x7f9cd00ce240 2023-11-04T01:37:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9ccdd9b640 1 -- 172.21.15.114:0/268471479 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cd00cde60 msgr2=0x7f9cd015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9ccdd9b640 1 --2- 172.21.15.114:0/268471479 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cd00cde60 0x7f9cd015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9ccdd9b640 1 -- 172.21.15.114:0/268471479 >> v1:172.21.15.141:6789/0 conn(0x7f9cd015daa0 legacy=0x7f9cd0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9ccdd9b640 1 -- 172.21.15.114:0/268471479 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd00d1120 con 0x7f9cd00ce240 2023-11-04T01:37:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9ccdd9b640 1 -- 172.21.15.114:0/268471479 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f9cc80019f0 con 0x7f9cd00ce240 2023-11-04T01:37:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9ccdd9b640 1 -- 172.21.15.114:0/268471479 >> v1:172.21.15.114:6789/0 conn(0x7f9cd00ce240 legacy=0x7f9cd00d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9ccdd9b640 1 --2- 172.21.15.114:0/268471479 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cbc0039a0 0x7f9cbc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9ccdd9b640 1 --2- 172.21.15.114:0/268471479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cbc0047c0 0x7f9cbc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.449+0000 7f9ccdd9b640 1 --2- 172.21.15.114:0/268471479 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cd00cde60 0x7f9cbc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.450+0000 7f9ccdd9b640 1 -- 172.21.15.114:0/268471479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd015e5c0 con 0x7f9cbc0047c0 2023-11-04T01:37:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.450+0000 7f9ccdd9b640 1 -- 172.21.15.114:0/268471479 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc00ba30 con 0x7f9cbc0039a0 2023-11-04T01:37:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.450+0000 7f9ccdd9b640 1 -- 172.21.15.114:0/268471479 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc00bbf0 con 0x7f9cd00cde60 2023-11-04T01:37:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.450+0000 7f9cc7fff640 1 --2- 172.21.15.114:0/268471479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cbc0047c0 0x7f9cbc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.450+0000 7f9cce59c640 1 --2- 172.21.15.114:0/268471479 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cbc0039a0 0x7f9cbc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.450+0000 7f9cced9d640 1 --2- 172.21.15.114:0/268471479 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cd00cde60 0x7f9cbc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.450+0000 7f9cc7fff640 1 -- 172.21.15.114:0/268471479 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cd00cde60 msgr2=0x7f9cbc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:55.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.450+0000 7f9cc7fff640 1 --2- 172.21.15.114:0/268471479 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cd00cde60 0x7f9cbc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.450+0000 7f9cc7fff640 1 -- 172.21.15.114:0/268471479 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cbc0039a0 msgr2=0x7f9cbc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:55.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.450+0000 7f9cc7fff640 1 --2- 172.21.15.114:0/268471479 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cbc0039a0 0x7f9cbc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.450+0000 7f9cc7fff640 1 -- 172.21.15.114:0/268471479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc003520 con 0x7f9cbc0047c0 2023-11-04T01:37:55.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.451+0000 7f9cc7fff640 1 --2- 172.21.15.114:0/268471479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cbc0047c0 0x7f9cbc004c40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8001720 tx=0x7f9cbc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e578bed51e9be66 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.451+0000 7f9ccdd9b640 1 -- 172.21.15.114:0/268471479 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80052d0 con 0x7f9cbc0047c0 2023-11-04T01:37:55.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.451+0000 7f9ccdd9b640 1 -- 172.21.15.114:0/268471479 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb802e050 con 0x7f9cbc0047c0 2023-11-04T01:37:55.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.451+0000 7f9ccdd9b640 1 -- 172.21.15.114:0/268471479 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80035f0 con 0x7f9cbc0047c0 2023-11-04T01:37:55.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.451+0000 7f9cd4875640 1 -- 172.21.15.114:0/268471479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cbc0047c0 msgr2=0x7f9cbc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.451+0000 7f9cd4875640 1 --2- 172.21.15.114:0/268471479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cbc0047c0 0x7f9cbc004c40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8001720 tx=0x7f9cbc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.451+0000 7f9cced9d640 1 -- 172.21.15.114:0/268471479 reap_dead start 2023-11-04T01:37:55.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.451+0000 7f9cd4875640 1 -- 172.21.15.114:0/268471479 shutdown_connections 2023-11-04T01:37:55.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.451+0000 7f9cd4875640 1 -- 172.21.15.114:0/268471479 >> 172.21.15.114:0/268471479 conn(0x7f9cd0071f30 msgr2=0x7f9cd00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:55.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.451+0000 7f9cd4875640 1 -- 172.21.15.114:0/268471479 shutdown_connections 2023-11-04T01:37:55.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.451+0000 7f9cd4875640 1 -- 172.21.15.114:0/268471479 wait complete. 2023-11-04T01:37:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.453+0000 7f9cd4875640 1 Processor -- start 2023-11-04T01:37:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.453+0000 7f9cd4875640 1 -- start start 2023-11-04T01:37:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.453+0000 7f9cd4875640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cbc0047c0 0x7f9cd01f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.453+0000 7f9cd4875640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cd01f3110 0x7f9cd0150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.453+0000 7f9cd4875640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cd0156dd0 0x7f9cd0157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.453+0000 7f9cd4875640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd01577c0 con 0x7f9cbc0047c0 2023-11-04T01:37:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.453+0000 7f9cd4875640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd0150e30 con 0x7f9cd0156dd0 2023-11-04T01:37:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.453+0000 7f9cd4875640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd0151110 con 0x7f9cd01f3110 2023-11-04T01:37:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.453+0000 7f9cce59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cbc0047c0 0x7f9cd01f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.453+0000 7f9cce59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cbc0047c0 0x7f9cd01f1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51328/0 (socket says 172.21.15.114:51328) 2023-11-04T01:37:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.453+0000 7f9cce59c640 1 -- 172.21.15.114:0/3938310809 learned_addr learned my addr 172.21.15.114:0/3938310809 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.454+0000 7f9cced9d640 1 --2- 172.21.15.114:0/3938310809 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cd0156dd0 0x7f9cd0157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.454+0000 7f9cc7fff640 1 --2- 172.21.15.114:0/3938310809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cd01f3110 0x7f9cd0150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.454+0000 7f9cce59c640 1 -- 172.21.15.114:0/3938310809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cd01f3110 msgr2=0x7f9cd0150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.454+0000 7f9cce59c640 1 --2- 172.21.15.114:0/3938310809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cd01f3110 0x7f9cd0150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.454+0000 7f9cce59c640 1 -- 172.21.15.114:0/3938310809 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cd0156dd0 msgr2=0x7f9cd0157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.454+0000 7f9cce59c640 1 --2- 172.21.15.114:0/3938310809 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cd0156dd0 0x7f9cd0157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.454+0000 7f9cce59c640 1 -- 172.21.15.114:0/3938310809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd01513f0 con 0x7f9cbc0047c0 2023-11-04T01:37:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.454+0000 7f9cc7fff640 1 --2- 172.21.15.114:0/3938310809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cd01f3110 0x7f9cd0150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.454+0000 7f9cced9d640 1 --2- 172.21.15.114:0/3938310809 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cd0156dd0 0x7f9cd0157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.454+0000 7f9cce59c640 1 --2- 172.21.15.114:0/3938310809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cbc0047c0 0x7f9cd01f1cb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9cc00118e0 tx=0x7f9cc0011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.454+0000 7f9cc6ffd640 1 -- 172.21.15.114:0/3938310809 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc000faf0 con 0x7f9cbc0047c0 2023-11-04T01:37:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.454+0000 7f9cc6ffd640 1 -- 172.21.15.114:0/3938310809 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc000fc50 con 0x7f9cbc0047c0 2023-11-04T01:37:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.454+0000 7f9cd4875640 1 -- 172.21.15.114:0/3938310809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd01f3770 con 0x7f9cbc0047c0 2023-11-04T01:37:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.454+0000 7f9cc6ffd640 1 -- 172.21.15.114:0/3938310809 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0014440 con 0x7f9cbc0047c0 2023-11-04T01:37:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.454+0000 7f9cd4875640 1 -- 172.21.15.114:0/3938310809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd0150ad0 con 0x7f9cbc0047c0 2023-11-04T01:37:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.455+0000 7f9cd4875640 1 -- 172.21.15.114:0/3938310809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd01f35d0 con 0x7f9cbc0047c0 2023-11-04T01:37:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.455+0000 7f9cc6ffd640 1 -- 172.21.15.114:0/3938310809 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9cc00145a0 con 0x7f9cbc0047c0 2023-11-04T01:37:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.456+0000 7f9cc6ffd640 1 --2- 172.21.15.114:0/3938310809 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9cb006aea0 0x7f9cb006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.456+0000 7f9cc7fff640 1 --2- 172.21.15.114:0/3938310809 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9cb006aea0 0x7f9cb006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.456+0000 7f9cc6ffd640 1 -- 172.21.15.114:0/3938310809 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9cc008a020 con 0x7f9cbc0047c0 2023-11-04T01:37:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.456+0000 7f9cc7fff640 1 --2- 172.21.15.114:0/3938310809 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9cb006aea0 0x7f9cb006d360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8033000 tx=0x7f9cb8009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:55.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.460+0000 7f9cc6ffd640 1 -- 172.21.15.114:0/3938310809 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9cd01f35d0 con 0x7f9cbc0047c0 2023-11-04T01:37:55.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.663+0000 7f9cd4875640 1 -- 172.21.15.114:0/3938310809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cd01f35d0 con 0x7f9cbc0047c0 2023-11-04T01:37:55.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.664+0000 7f9cc6ffd640 1 -- 172.21.15.114:0/3938310809 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f9cd01f35d0 con 0x7f9cbc0047c0 2023-11-04T01:37:55.666 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:37:55.667 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5218,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/3821610653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":3821610653},{"type":"v1","addr":"172.21.15.141:6834","nonce":3821610653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2452742541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2452742541},{"type":"v1","addr":"172.21.15.114:6835","nonce":2452742541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3407147888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3407147888},{"type":"v1","addr":"172.21.15.114:6837","nonce":3407147888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:50.993779+0000","modified":"2023-11-04T01:37:53.001589+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5565":{"gid":5565,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6835/3122131633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3122131633},{"type":"v1","addr":"172.21.15.141:6835","nonce":3122131633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:37:55.667 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 16 2023-11-04T01:37:55.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.666+0000 7f9cd4875640 1 -- 172.21.15.114:0/3938310809 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9cb006aea0 msgr2=0x7f9cb006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.666+0000 7f9cd4875640 1 --2- 172.21.15.114:0/3938310809 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9cb006aea0 0x7f9cb006d360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8033000 tx=0x7f9cb8009030 comp rx=0 tx=0).stop 2023-11-04T01:37:55.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.666+0000 7f9cd4875640 1 -- 172.21.15.114:0/3938310809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cbc0047c0 msgr2=0x7f9cd01f1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:55.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.666+0000 7f9cd4875640 1 --2- 172.21.15.114:0/3938310809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cbc0047c0 0x7f9cd01f1cb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9cc00118e0 tx=0x7f9cc0011da0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.666+0000 7f9cd4875640 1 -- 172.21.15.114:0/3938310809 shutdown_connections 2023-11-04T01:37:55.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.666+0000 7f9cd4875640 1 --2- 172.21.15.114:0/3938310809 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9cb006aea0 0x7f9cb006d360 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.666+0000 7f9cd4875640 1 --2- 172.21.15.114:0/3938310809 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cd0156dd0 0x7f9cd0157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.666+0000 7f9cd4875640 1 --2- 172.21.15.114:0/3938310809 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cd01f3110 0x7f9cd0150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.666+0000 7f9cd4875640 1 --2- 172.21.15.114:0/3938310809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cbc0047c0 0x7f9cd01f1cb0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:55.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.666+0000 7f9cd4875640 1 -- 172.21.15.114:0/3938310809 >> 172.21.15.114:0/3938310809 conn(0x7f9cd0071f30 msgr2=0x7f9cd00cd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:55.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.666+0000 7f9cd4875640 1 -- 172.21.15.114:0/3938310809 shutdown_connections 2023-11-04T01:37:55.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:55.666+0000 7f9cd4875640 1 -- 172.21.15.114:0/3938310809 wait complete. 2023-11-04T01:37:56.082 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:37:50.993779+0000', 'modified': '2023-11-04T01:37:53.001589+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5565}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5565': {'gid': 5565, 'name': 'd', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.141:6835/3122131633', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.141:6833', 'nonce': 3122131633}, {'type': 'v1', 'addr': '172.21.15.141:6835', 'nonce': 3122131633}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:37:56.082 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:37:56.082 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:37:56.136 INFO:tasks.ceph.mds.d.smithi141.stderr:2023-11-04T01:37:56.135+0000 7faaa5f7d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:37:56.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.182+0000 7fb302f05640 1 Processor -- start 2023-11-04T01:37:56.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.182+0000 7fb302f05640 1 -- start start 2023-11-04T01:37:56.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.183+0000 7fb302f05640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2fc15ad30 0x7fb2fc0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.183+0000 7fb302f05640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb2fc0ad730 0x7fb2fc070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.183+0000 7fb302f05640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2fc070c50 0x7fb2fc0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.183+0000 7fb302f05640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2fc0ae260 con 0x7fb2fc15ad30 2023-11-04T01:37:56.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.183+0000 7fb302f05640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2fc0710e0 con 0x7fb2fc0ad730 2023-11-04T01:37:56.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.183+0000 7fb302f05640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0c3900 con 0x7fb2fc070c50 2023-11-04T01:37:56.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.183+0000 7fb300ca1640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2fc15ad30 0x7fb2fc0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.183+0000 7fb300ca1640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2fc15ad30 0x7fb2fc0adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51334/0 (socket says 172.21.15.114:51334) 2023-11-04T01:37:56.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.183+0000 7fb300ca1640 1 -- 172.21.15.114:0/568768300 learned_addr learned my addr 172.21.15.114:0/568768300 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:56.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.183+0000 7fb3014a2640 1 --2- 172.21.15.114:0/568768300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2fc070c50 0x7fb2fc0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.183+0000 7fb2fbfff640 1 --2- 172.21.15.114:0/568768300 >> v2:172.21.15.141:3300/0 conn(0x7fb2fc0ad730 0x7fb2fc070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.183+0000 7fb300ca1640 1 -- 172.21.15.114:0/568768300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2fc070c50 msgr2=0x7fb2fc0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.183+0000 7fb300ca1640 1 --2- 172.21.15.114:0/568768300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2fc070c50 0x7fb2fc0c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.183+0000 7fb300ca1640 1 -- 172.21.15.114:0/568768300 >> v2:172.21.15.141:3300/0 conn(0x7fb2fc0ad730 msgr2=0x7fb2fc070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.183+0000 7fb300ca1640 1 --2- 172.21.15.114:0/568768300 >> v2:172.21.15.141:3300/0 conn(0x7fb2fc0ad730 0x7fb2fc070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.183+0000 7fb300ca1640 1 -- 172.21.15.114:0/568768300 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc0c3be0 con 0x7fb2fc15ad30 2023-11-04T01:37:56.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.184+0000 7fb300ca1640 1 --2- 172.21.15.114:0/568768300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2fc15ad30 0x7fb2fc0adc80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0ce7f0 tx=0x7fb2f002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33223e674e01921 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.184+0000 7fb2fb7fe640 1 -- 172.21.15.114:0/568768300 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f00317c0 con 0x7fb2fc15ad30 2023-11-04T01:37:56.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.184+0000 7fb2fb7fe640 1 -- 172.21.15.114:0/568768300 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f0031920 con 0x7fb2fc15ad30 2023-11-04T01:37:56.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.184+0000 7fb2fb7fe640 1 -- 172.21.15.114:0/568768300 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0031cb0 con 0x7fb2fc15ad30 2023-11-04T01:37:56.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.184+0000 7fb302f05640 1 -- 172.21.15.114:0/568768300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2fc15ad30 msgr2=0x7fb2fc0adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.184+0000 7fb302f05640 1 --2- 172.21.15.114:0/568768300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2fc15ad30 0x7fb2fc0adc80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0ce7f0 tx=0x7fb2f002b860 comp rx=0 tx=0).stop 2023-11-04T01:37:56.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.184+0000 7fb302f05640 1 -- 172.21.15.114:0/568768300 shutdown_connections 2023-11-04T01:37:56.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.184+0000 7fb302f05640 1 --2- 172.21.15.114:0/568768300 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2fc070c50 0x7fb2fc0c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.184+0000 7fb302f05640 1 --2- 172.21.15.114:0/568768300 >> v2:172.21.15.141:3300/0 conn(0x7fb2fc0ad730 0x7fb2fc070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.184+0000 7fb302f05640 1 --2- 172.21.15.114:0/568768300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2fc15ad30 0x7fb2fc0adc80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.184+0000 7fb302f05640 1 -- 172.21.15.114:0/568768300 >> 172.21.15.114:0/568768300 conn(0x7fb2fc0ce950 msgr2=0x7fb2fc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:56.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.184+0000 7fb302f05640 1 -- 172.21.15.114:0/568768300 shutdown_connections 2023-11-04T01:37:56.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.184+0000 7fb302f05640 1 -- 172.21.15.114:0/568768300 wait complete. 2023-11-04T01:37:56.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.186+0000 7fb302f05640 1 Processor -- start 2023-11-04T01:37:56.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.186+0000 7fb302f05640 1 -- start start 2023-11-04T01:37:56.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.186+0000 7fb302f05640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2fc070c50 0x7fb2fc153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.186+0000 7fb302f05640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2fc0ad730 0x7fb2fc1463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.186+0000 7fb302f05640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2fc15ad30 0x7fb2fc15d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.186+0000 7fb302f05640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc15c730 con 0x7fb2fc0ad730 2023-11-04T01:37:56.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.186+0000 7fb302f05640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc146930 con 0x7fb2fc15ad30 2023-11-04T01:37:56.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.186+0000 7fb302f05640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc15df20 con 0x7fb2fc070c50 2023-11-04T01:37:56.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb2fbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2fc0ad730 0x7fb2fc1463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb2fbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2fc0ad730 0x7fb2fc1463f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51340/0 (socket says 172.21.15.114:51340) 2023-11-04T01:37:56.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb2fbfff640 1 -- 172.21.15.114:0/90601019 learned_addr learned my addr 172.21.15.114:0/90601019 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:56.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb300ca1640 1 --2- 172.21.15.114:0/90601019 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2fc070c50 0x7fb2fc153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb3014a2640 1 --2- 172.21.15.114:0/90601019 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2fc15ad30 0x7fb2fc15d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb2fbfff640 1 -- 172.21.15.114:0/90601019 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2fc070c50 msgr2=0x7fb2fc153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb2fbfff640 1 --2- 172.21.15.114:0/90601019 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2fc070c50 0x7fb2fc153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb2fbfff640 1 -- 172.21.15.114:0/90601019 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2fc15ad30 msgr2=0x7fb2fc15d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb2fbfff640 1 --2- 172.21.15.114:0/90601019 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2fc15ad30 0x7fb2fc15d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb2fbfff640 1 -- 172.21.15.114:0/90601019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f00094d0 con 0x7fb2fc0ad730 2023-11-04T01:37:56.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb3014a2640 1 --2- 172.21.15.114:0/90601019 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2fc15ad30 0x7fb2fc15d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:56.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb2fbfff640 1 --2- 172.21.15.114:0/90601019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2fc0ad730 0x7fb2fc1463f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800d800 tx=0x7fb2e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb2f97fa640 1 -- 172.21.15.114:0/90601019 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800b6c0 con 0x7fb2fc0ad730 2023-11-04T01:37:56.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb2f97fa640 1 -- 172.21.15.114:0/90601019 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e800b820 con 0x7fb2fc0ad730 2023-11-04T01:37:56.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb302f05640 1 -- 172.21.15.114:0/90601019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2fc15bb20 con 0x7fb2fc0ad730 2023-11-04T01:37:56.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb2f97fa640 1 -- 172.21.15.114:0/90601019 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800bbb0 con 0x7fb2fc0ad730 2023-11-04T01:37:56.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.187+0000 7fb302f05640 1 -- 172.21.15.114:0/90601019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2fc15c0e0 con 0x7fb2fc0ad730 2023-11-04T01:37:56.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.189+0000 7fb2f97fa640 1 -- 172.21.15.114:0/90601019 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb2e800bd10 con 0x7fb2fc0ad730 2023-11-04T01:37:56.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.189+0000 7fb2f97fa640 1 --2- 172.21.15.114:0/90601019 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2e006ae70 0x7fb2e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.189+0000 7fb2f97fa640 1 -- 172.21.15.114:0/90601019 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb2e8089c30 con 0x7fb2fc0ad730 2023-11-04T01:37:56.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.189+0000 7fb300ca1640 1 --2- 172.21.15.114:0/90601019 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2e006ae70 0x7fb2e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.190+0000 7fb300ca1640 1 --2- 172.21.15.114:0/90601019 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2e006ae70 0x7fb2e006d330 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0036000 tx=0x7fb2f003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.190+0000 7fb305b71740 1 Processor -- start 2023-11-04T01:37:56.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.190+0000 7fb305b71740 1 -- start start 2023-11-04T01:37:56.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb305b71740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d22f850 0x564c7d202750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb305b71740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d22fc30 0x564c7d2325e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb305b71740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d202c90 0x564c7d232b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb305b71740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c7d113740 con 0x564c7d202c90 2023-11-04T01:37:56.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb305b71740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c7d1758d0 con 0x564c7d22f850 2023-11-04T01:37:56.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb305b71740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c7d172fc0 con 0x564c7d22fc30 2023-11-04T01:37:56.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb3014a2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d202c90 0x564c7d232b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb3014a2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d202c90 0x564c7d232b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51346/0 (socket says 172.21.15.114:51346) 2023-11-04T01:37:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb3014a2640 1 -- 172.21.15.114:0/323241415 learned_addr learned my addr 172.21.15.114:0/323241415 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb300ca1640 1 --2- 172.21.15.114:0/323241415 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d22f850 0x564c7d202750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb2fbfff640 1 --2- 172.21.15.114:0/323241415 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d22fc30 0x564c7d2325e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb3014a2640 1 -- 172.21.15.114:0/323241415 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d22fc30 msgr2=0x564c7d2325e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb3014a2640 1 --2- 172.21.15.114:0/323241415 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d22fc30 0x564c7d2325e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb3014a2640 1 -- 172.21.15.114:0/323241415 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d22f850 msgr2=0x564c7d202750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb3014a2640 1 --2- 172.21.15.114:0/323241415 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d22f850 0x564c7d202750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb3014a2640 1 -- 172.21.15.114:0/323241415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c7d131ca0 con 0x564c7d202c90 2023-11-04T01:37:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.191+0000 7fb3014a2640 1 --2- 172.21.15.114:0/323241415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d202c90 0x564c7d232b20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4007460 tx=0x7fb2f4007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c83d6ae350f0ee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.192+0000 7fb2e67fc640 1 -- 172.21.15.114:0/323241415 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40147e0 con 0x564c7d202c90 2023-11-04T01:37:56.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.192+0000 7fb2e67fc640 1 -- 172.21.15.114:0/323241415 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f4014940 con 0x564c7d202c90 2023-11-04T01:37:56.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.192+0000 7fb2e67fc640 1 -- 172.21.15.114:0/323241415 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4014cf0 con 0x564c7d202c90 2023-11-04T01:37:56.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.192+0000 7fb305b71740 1 -- 172.21.15.114:0/323241415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d202c90 msgr2=0x564c7d232b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.192+0000 7fb305b71740 1 --2- 172.21.15.114:0/323241415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d202c90 0x564c7d232b20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4007460 tx=0x7fb2f4007920 comp rx=0 tx=0).stop 2023-11-04T01:37:56.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.192+0000 7fb305b71740 1 -- 172.21.15.114:0/323241415 shutdown_connections 2023-11-04T01:37:56.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.192+0000 7fb305b71740 1 --2- 172.21.15.114:0/323241415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d202c90 0x564c7d232b20 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.192+0000 7fb305b71740 1 --2- 172.21.15.114:0/323241415 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d22fc30 0x564c7d2325e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.192+0000 7fb305b71740 1 --2- 172.21.15.114:0/323241415 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d22f850 0x564c7d202750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.192+0000 7fb305b71740 1 -- 172.21.15.114:0/323241415 >> 172.21.15.114:0/323241415 conn(0x564c7d204a60 msgr2=0x564c7d24d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:56.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.192+0000 7fb305b71740 1 -- 172.21.15.114:0/323241415 shutdown_connections 2023-11-04T01:37:56.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.192+0000 7fb305b71740 1 -- 172.21.15.114:0/323241415 wait complete. 2023-11-04T01:37:56.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.193+0000 7fb305b71740 1 -- start start 2023-11-04T01:37:56.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.193+0000 7fb305b71740 1 Processor -- start 2023-11-04T01:37:56.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb305b71740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d22f850 0x564c7d2167b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb305b71740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d22fc30 0x564c7d230840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb305b71740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d230d80 0x564c7d228660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb305b71740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c7d16e8b0 con 0x564c7d230d80 2023-11-04T01:37:56.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb305b71740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c7d128c80 con 0x564c7d22fc30 2023-11-04T01:37:56.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb305b71740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c7d128920 con 0x564c7d22f850 2023-11-04T01:37:56.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb305b71740 10 client.0 _ll_register_callbacks cb 0x564c7ce80ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:37:56.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb3014a2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d230d80 0x564c7d228660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb3014a2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d230d80 0x564c7d228660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51356/0 (socket says 172.21.15.114:51356) 2023-11-04T01:37:56.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb3014a2640 1 -- 172.21.15.114:0/4186259401 learned_addr learned my addr 172.21.15.114:0/4186259401 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:56.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb2fbfff640 1 --2- 172.21.15.114:0/4186259401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d22fc30 0x564c7d230840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb3014a2640 1 -- 172.21.15.114:0/4186259401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d22f850 msgr2=0x564c7d2167b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb300ca1640 1 --2- 172.21.15.114:0/4186259401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d22f850 0x564c7d2167b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb3014a2640 1 --2- 172.21.15.114:0/4186259401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d22f850 0x564c7d2167b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb3014a2640 1 -- 172.21.15.114:0/4186259401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d22fc30 msgr2=0x564c7d230840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb3014a2640 1 --2- 172.21.15.114:0/4186259401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d22fc30 0x564c7d230840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb3014a2640 1 -- 172.21.15.114:0/4186259401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f4009cf0 con 0x564c7d230d80 2023-11-04T01:37:56.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb2fbfff640 1 --2- 172.21.15.114:0/4186259401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d22fc30 0x564c7d230840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:56.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb300ca1640 1 --2- 172.21.15.114:0/4186259401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d22f850 0x564c7d2167b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:56.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb3014a2640 1 --2- 172.21.15.114:0/4186259401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d230d80 0x564c7d228660 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4007430 tx=0x7fb2f4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6226c2dc34ec9484 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb2db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:37:56.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb2db7fe640 1 -- 172.21.15.114:0/4186259401 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4016420 con 0x564c7d230d80 2023-11-04T01:37:56.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb2db7fe640 1 -- 172.21.15.114:0/4186259401 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb2f4016580 con 0x564c7d230d80 2023-11-04T01:37:56.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb305b71740 1 -- 172.21.15.114:0/4186259401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c7d11abf0 con 0x564c7d230d80 2023-11-04T01:37:56.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb2db7fe640 1 -- 172.21.15.114:0/4186259401 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2f4016740 con 0x564c7d230d80 2023-11-04T01:37:56.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.194+0000 7fb305b71740 10 client.5748 fetch_fsmap learned FSMap version 16 2023-11-04T01:37:56.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.195+0000 7fb305b71740 1 -- 172.21.15.114:0/4186259401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564c7d16cf30 con 0x564c7d230d80 2023-11-04T01:37:56.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.195+0000 7fb2db7fe640 1 -- 172.21.15.114:0/4186259401 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564c7d11abf0 con 0x564c7d230d80 2023-11-04T01:37:56.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.195+0000 7fb2db7fe640 1 -- 172.21.15.114:0/4186259401 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb2f4027030 con 0x564c7d230d80 2023-11-04T01:37:56.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.195+0000 7fb305b71740 10 client.5748 fetch_fsmap finished waiting for FSMap version 16 2023-11-04T01:37:56.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.195+0000 7fb305b71740 10 client.5748 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:37:56.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.195+0000 7fb305b71740 20 client.5748 populate_metadata read hostname 'smithi114' 2023-11-04T01:37:56.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.195+0000 7fb305b71740 1 --2- 172.21.15.114:0/4186259401 >> [v2:172.21.15.141:6833/3122131633,v1:172.21.15.141:6835/3122131633] conn(0x564c7d268c70 0x564c7d26b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.195+0000 7fb305b71740 4 client.5748 mds_command: new command op to 5565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:37:56.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.195+0000 7fb305b71740 1 -- 172.21.15.114:0/4186259401 --> [v2:172.21.15.141:6833/3122131633,v1:172.21.15.141:6835/3122131633] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c7d167890 con 0x564c7d268c70 2023-11-04T01:37:56.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.195+0000 7fb300ca1640 1 --2- 172.21.15.114:0/4186259401 >> [v2:172.21.15.141:6833/3122131633,v1:172.21.15.141:6835/3122131633] conn(0x564c7d268c70 0x564c7d26b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.195+0000 7fb2db7fe640 10 client.5748 ms_handle_connect on v2:172.21.15.141:6833/3122131633 2023-11-04T01:37:56.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.195+0000 7fb300ca1640 1 --2- 172.21.15.114:0/4186259401 >> [v2:172.21.15.141:6833/3122131633,v1:172.21.15.141:6835/3122131633] conn(0x564c7d268c70 0x564c7d26b060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=967d50ae2084c234 server_cookie=965be90afed463f4 in_seq=0 out_seq=0 2023-11-04T01:37:56.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.196+0000 7fb2db7fe640 1 -- 172.21.15.114:0/4186259401 <== mds.0 v2:172.21.15.141:6833/3122131633 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564c7d167890 con 0x564c7d268c70 2023-11-04T01:37:56.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.196+0000 7fb2db7fe640 10 client.5748 handle_command_reply: tid=0 2023-11-04T01:37:56.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.196+0000 7fb305b71740 1 client.5748 shutdown 2023-11-04T01:37:56.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.196+0000 7fb305b71740 1 -- 172.21.15.114:0/4186259401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d230d80 msgr2=0x564c7d228660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.196+0000 7fb305b71740 1 --2- 172.21.15.114:0/4186259401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d230d80 0x564c7d228660 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4007430 tx=0x7fb2f4004ab0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.196+0000 7fb305b71740 1 -- 172.21.15.114:0/4186259401 shutdown_connections 2023-11-04T01:37:56.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.196+0000 7fb305b71740 1 --2- 172.21.15.114:0/4186259401 >> [v2:172.21.15.141:6833/3122131633,v1:172.21.15.141:6835/3122131633] conn(0x564c7d268c70 0x564c7d26b060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.196+0000 7fb305b71740 1 --2- 172.21.15.114:0/4186259401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d230d80 0x564c7d228660 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.196+0000 7fb305b71740 1 --2- 172.21.15.114:0/4186259401 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d22fc30 0x564c7d230840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.196+0000 7fb305b71740 1 --2- 172.21.15.114:0/4186259401 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d22f850 0x564c7d2167b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.196+0000 7fb2db7fe640 0 client.5748 ms_handle_reset on v2:172.21.15.141:6833/3122131633 2023-11-04T01:37:56.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.196+0000 7fb305b71740 1 -- 172.21.15.114:0/4186259401 >> 172.21.15.114:0/4186259401 conn(0x564c7d202c90 msgr2=0x564c7d206600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:56.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.196+0000 7fb305b71740 1 -- 172.21.15.114:0/4186259401 shutdown_connections 2023-11-04T01:37:56.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.196+0000 7fb305b71740 1 -- 172.21.15.114:0/4186259401 wait complete. 2023-11-04T01:37:56.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.197+0000 7fb305b71740 20 client.5748 trim_cache size 0 max 16384 2023-11-04T01:37:56.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.212+0000 7fb305b71740 1 Processor -- start 2023-11-04T01:37:56.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.212+0000 7fb305b71740 1 -- start start 2023-11-04T01:37:56.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.212+0000 7fb305b71740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d22f850 0x564c7d215a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb305b71740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d22fc30 0x564c7d2300d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb305b71740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d230d80 0x564c7d230610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb305b71740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c7d0ee280 con 0x564c7d22f850 2023-11-04T01:37:56.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb305b71740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c7d16da50 con 0x564c7d22fc30 2023-11-04T01:37:56.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb305b71740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c7d227f60 con 0x564c7d230d80 2023-11-04T01:37:56.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb300ca1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d22f850 0x564c7d215a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb300ca1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d22f850 0x564c7d215a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51372/0 (socket says 172.21.15.114:51372) 2023-11-04T01:37:56.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb300ca1640 1 -- 172.21.15.114:0/2470705643 learned_addr learned my addr 172.21.15.114:0/2470705643 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:56.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb300ca1640 1 -- 172.21.15.114:0/2470705643 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d230d80 msgr2=0x564c7d230610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb300ca1640 1 --2- 172.21.15.114:0/2470705643 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d230d80 0x564c7d230610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb300ca1640 1 -- 172.21.15.114:0/2470705643 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d22fc30 msgr2=0x564c7d2300d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb300ca1640 1 --2- 172.21.15.114:0/2470705643 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d22fc30 0x564c7d2300d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb300ca1640 1 -- 172.21.15.114:0/2470705643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c7d10ad10 con 0x564c7d22f850 2023-11-04T01:37:56.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb300ca1640 1 --2- 172.21.15.114:0/2470705643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d22f850 0x564c7d215a60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009990 tx=0x7fb2f0030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7baaa63a12a3d27 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb2e6ffd640 1 -- 172.21.15.114:0/2470705643 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f004a040 con 0x564c7d22f850 2023-11-04T01:37:56.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb2e6ffd640 1 -- 172.21.15.114:0/2470705643 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f00530d0 con 0x564c7d22f850 2023-11-04T01:37:56.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.213+0000 7fb2e6ffd640 1 -- 172.21.15.114:0/2470705643 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0053460 con 0x564c7d22f850 2023-11-04T01:37:56.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.214+0000 7fb305b71740 1 -- 172.21.15.114:0/2470705643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d22f850 msgr2=0x564c7d215a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.214+0000 7fb305b71740 1 --2- 172.21.15.114:0/2470705643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d22f850 0x564c7d215a60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009990 tx=0x7fb2f0030000 comp rx=0 tx=0).stop 2023-11-04T01:37:56.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.214+0000 7fb305b71740 1 -- 172.21.15.114:0/2470705643 shutdown_connections 2023-11-04T01:37:56.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.214+0000 7fb305b71740 1 --2- 172.21.15.114:0/2470705643 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d230d80 0x564c7d230610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.214+0000 7fb305b71740 1 --2- 172.21.15.114:0/2470705643 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d22fc30 0x564c7d2300d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.214+0000 7fb305b71740 1 --2- 172.21.15.114:0/2470705643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d22f850 0x564c7d215a60 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.214+0000 7fb305b71740 1 -- 172.21.15.114:0/2470705643 >> 172.21.15.114:0/2470705643 conn(0x564c7d202c90 msgr2=0x564c7d1fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:56.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.214+0000 7fb305b71740 1 -- 172.21.15.114:0/2470705643 shutdown_connections 2023-11-04T01:37:56.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.214+0000 7fb305b71740 1 -- 172.21.15.114:0/2470705643 wait complete. 2023-11-04T01:37:56.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.214+0000 7fb305b71740 1 -- start start 2023-11-04T01:37:56.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.215+0000 7fb305b71740 1 Processor -- start 2023-11-04T01:37:56.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.215+0000 7fb305b71740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d22f850 0x564c7d231560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.215+0000 7fb305b71740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d22fc30 0x564c7d2300d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.215+0000 7fb305b71740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d230d80 0x564c7d230610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.215+0000 7fb305b71740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c7d22dac0 con 0x564c7d22fc30 2023-11-04T01:37:56.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.215+0000 7fb305b71740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c7d22ae00 con 0x564c7d230d80 2023-11-04T01:37:56.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.215+0000 7fb305b71740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c7d22b610 con 0x564c7d22f850 2023-11-04T01:37:56.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.215+0000 7fb305b71740 10 client.0 _ll_register_callbacks cb 0x7fb2f4009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:37:56.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.215+0000 7fb2fbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d22fc30 0x564c7d2300d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.215+0000 7fb2fbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d22fc30 0x564c7d2300d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51386/0 (socket says 172.21.15.114:51386) 2023-11-04T01:37:56.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.215+0000 7fb2fbfff640 1 -- 172.21.15.114:0/1748551490 learned_addr learned my addr 172.21.15.114:0/1748551490 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:56.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.215+0000 7fb300ca1640 1 --2- 172.21.15.114:0/1748551490 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d22f850 0x564c7d231560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.215+0000 7fb3014a2640 1 --2- 172.21.15.114:0/1748551490 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d230d80 0x564c7d230610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb2fbfff640 1 -- 172.21.15.114:0/1748551490 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d22f850 msgr2=0x564c7d231560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb2fbfff640 1 --2- 172.21.15.114:0/1748551490 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d22f850 0x564c7d231560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb2fbfff640 1 -- 172.21.15.114:0/1748551490 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d230d80 msgr2=0x564c7d230610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb2fbfff640 1 --2- 172.21.15.114:0/1748551490 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d230d80 0x564c7d230610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb2fbfff640 1 -- 172.21.15.114:0/1748551490 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2fc0c3be0 con 0x564c7d22fc30 2023-11-04T01:37:56.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb2fbfff640 1 --2- 172.21.15.114:0/1748551490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d22fc30 0x564c7d2300d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8004790 tx=0x7fb2e8059020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fc692f24cb2571 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb2db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:37:56.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb2db7fe640 1 -- 172.21.15.114:0/1748551490 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8060b60 con 0x564c7d22fc30 2023-11-04T01:37:56.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb2db7fe640 1 -- 172.21.15.114:0/1748551490 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb2e80606d0 con 0x564c7d22fc30 2023-11-04T01:37:56.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb305b71740 1 -- 172.21.15.114:0/1748551490 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb2f4014940 con 0x564c7d22fc30 2023-11-04T01:37:56.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb2db7fe640 1 -- 172.21.15.114:0/1748551490 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2e8060890 con 0x564c7d22fc30 2023-11-04T01:37:56.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb305b71740 10 client.5754 fetch_fsmap learned FSMap version 16 2023-11-04T01:37:56.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb305b71740 1 -- 172.21.15.114:0/1748551490 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564c7d130500 con 0x564c7d22fc30 2023-11-04T01:37:56.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb2db7fe640 1 -- 172.21.15.114:0/1748551490 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f4014940 con 0x564c7d22fc30 2023-11-04T01:37:56.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb2db7fe640 1 -- 172.21.15.114:0/1748551490 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb2e8059b90 con 0x564c7d22fc30 2023-11-04T01:37:56.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb305b71740 10 client.5754 fetch_fsmap finished waiting for FSMap version 16 2023-11-04T01:37:56.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb305b71740 10 client.5754 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:37:56.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb305b71740 20 client.5754 populate_metadata read hostname 'smithi114' 2023-11-04T01:37:56.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb305b71740 1 --2- 172.21.15.114:0/1748551490 >> [v2:172.21.15.141:6833/3122131633,v1:172.21.15.141:6835/3122131633] conn(0x564c7d25fd10 0x564c7d2600f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb305b71740 4 client.5754 mds_command: new command op to 5565 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:37:56.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.216+0000 7fb305b71740 1 -- 172.21.15.114:0/1748551490 --> [v2:172.21.15.141:6833/3122131633,v1:172.21.15.141:6835/3122131633] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564c7d1675b0 con 0x564c7d25fd10 2023-11-04T01:37:56.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb300ca1640 1 --2- 172.21.15.114:0/1748551490 >> [v2:172.21.15.141:6833/3122131633,v1:172.21.15.141:6835/3122131633] conn(0x564c7d25fd10 0x564c7d2600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb2db7fe640 10 client.5754 ms_handle_connect on v2:172.21.15.141:6833/3122131633 2023-11-04T01:37:56.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb300ca1640 1 --2- 172.21.15.114:0/1748551490 >> [v2:172.21.15.141:6833/3122131633,v1:172.21.15.141:6835/3122131633] conn(0x564c7d25fd10 0x564c7d2600f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdaa12dadad2540b server_cookie=ef787c80608d866b in_seq=0 out_seq=0 2023-11-04T01:37:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb2db7fe640 1 -- 172.21.15.114:0/1748551490 <== mds.0 v2:172.21.15.141:6833/3122131633 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x564c7d1675b0 con 0x564c7d25fd10 2023-11-04T01:37:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb2db7fe640 10 client.5754 handle_command_reply: tid=0 2023-11-04T01:37:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb305b71740 1 client.5754 shutdown 2023-11-04T01:37:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb305b71740 1 -- 172.21.15.114:0/1748551490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d22fc30 msgr2=0x564c7d2300d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb305b71740 1 --2- 172.21.15.114:0/1748551490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d22fc30 0x564c7d2300d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8004790 tx=0x7fb2e8059020 comp rx=0 tx=0).stop 2023-11-04T01:37:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb305b71740 1 -- 172.21.15.114:0/1748551490 shutdown_connections 2023-11-04T01:37:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb305b71740 1 --2- 172.21.15.114:0/1748551490 >> [v2:172.21.15.141:6833/3122131633,v1:172.21.15.141:6835/3122131633] conn(0x564c7d25fd10 0x564c7d2600f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb305b71740 1 --2- 172.21.15.114:0/1748551490 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x564c7d230d80 0x564c7d230610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb305b71740 1 --2- 172.21.15.114:0/1748551490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x564c7d22fc30 0x564c7d2300d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb2db7fe640 0 client.5754 ms_handle_reset on v2:172.21.15.141:6833/3122131633 2023-11-04T01:37:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb305b71740 1 --2- 172.21.15.114:0/1748551490 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x564c7d22f850 0x564c7d231560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb305b71740 1 -- 172.21.15.114:0/1748551490 >> 172.21.15.114:0/1748551490 conn(0x564c7d202c90 msgr2=0x564c7d2185f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:56.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb305b71740 1 -- 172.21.15.114:0/1748551490 shutdown_connections 2023-11-04T01:37:56.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.217+0000 7fb305b71740 1 -- 172.21.15.114:0/1748551490 wait complete. 2023-11-04T01:37:56.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.218+0000 7fb305b71740 20 client.5754 trim_cache size 0 max 16384 2023-11-04T01:37:56.227 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:37:56.227 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:37:56.227 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-11-04T01:37:56.227 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 5565, 2023-11-04T01:37:56.227 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:37:56.227 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:37:56.227 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:37:56.228 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 4.5517183609999998, 2023-11-04T01:37:56.228 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 16, 2023-11-04T01:37:56.228 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 38, 2023-11-04T01:37:56.228 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 38, 2023-11-04T01:37:56.228 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 11.938152249 2023-11-04T01:37:56.228 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:37:56.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.218+0000 7fb302f05640 1 -- 172.21.15.114:0/90601019 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2e006ae70 msgr2=0x7fb2e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.218+0000 7fb302f05640 1 --2- 172.21.15.114:0/90601019 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2e006ae70 0x7fb2e006d330 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0036000 tx=0x7fb2f003d040 comp rx=0 tx=0).stop 2023-11-04T01:37:56.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.218+0000 7fb302f05640 1 -- 172.21.15.114:0/90601019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2fc0ad730 msgr2=0x7fb2fc1463f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.218+0000 7fb302f05640 1 --2- 172.21.15.114:0/90601019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2fc0ad730 0x7fb2fc1463f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800d800 tx=0x7fb2e800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.218+0000 7fb302f05640 1 -- 172.21.15.114:0/90601019 shutdown_connections 2023-11-04T01:37:56.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.218+0000 7fb302f05640 1 --2- 172.21.15.114:0/90601019 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2e006ae70 0x7fb2e006d330 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.218+0000 7fb302f05640 1 --2- 172.21.15.114:0/90601019 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2fc15ad30 0x7fb2fc15d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.218+0000 7fb302f05640 1 --2- 172.21.15.114:0/90601019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2fc0ad730 0x7fb2fc1463f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.218+0000 7fb302f05640 1 --2- 172.21.15.114:0/90601019 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2fc070c50 0x7fb2fc153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.218+0000 7fb302f05640 1 -- 172.21.15.114:0/90601019 >> 172.21.15.114:0/90601019 conn(0x7fb2fc0ce950 msgr2=0x7fb2fc06d780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:56.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.218+0000 7fb302f05640 1 -- 172.21.15.114:0/90601019 shutdown_connections 2023-11-04T01:37:56.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.218+0000 7fb302f05640 1 -- 172.21.15.114:0/90601019 wait complete. 2023-11-04T01:37:56.231 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:37:56.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.328+0000 7fe3a751d640 1 Processor -- start 2023-11-04T01:37:56.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.329+0000 7fe3a751d640 1 -- start start 2023-11-04T01:37:56.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.329+0000 7fe3a751d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3a0159c70 0x7fe3a00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.329+0000 7fe3a751d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe3a00b0ae0 0x7fe3a015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.329+0000 7fe3a751d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a00b4110 con 0x7fe3a006db20 2023-11-04T01:37:56.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.329+0000 7fe3a751d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a00b49b0 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.329+0000 7fe3a751d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00b43f0 con 0x7fe3a0159c70 2023-11-04T01:37:56.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.330+0000 7fe3a5aba640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe3a00b0ae0 0x7fe3a015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.330+0000 7fe3a5aba640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe3a00b0ae0 0x7fe3a015d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51398/0 (socket says 172.21.15.114:51398) 2023-11-04T01:37:56.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.330+0000 7fe3a5aba640 1 -- 172.21.15.114:0/448079870 learned_addr learned my addr 172.21.15.114:0/448079870 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:56.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.330+0000 7fe3a4ab8640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe3a006db20 0x7fe3a00b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60680/0 (socket says 172.21.15.114:60680) 2023-11-04T01:37:56.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.330+0000 7fe3a52b9640 1 --2- 172.21.15.114:0/448079870 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3a0159c70 0x7fe3a00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.330+0000 7fe3a5aba640 1 -- 172.21.15.114:0/448079870 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3a0159c70 msgr2=0x7fe3a00ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:56.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.330+0000 7fe3a5aba640 1 --2- 172.21.15.114:0/448079870 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3a0159c70 0x7fe3a00ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.330+0000 7fe3a5aba640 1 -- 172.21.15.114:0/448079870 >> v1:172.21.15.114:6789/0 conn(0x7fe3a006db20 legacy=0x7fe3a00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.330+0000 7fe3a5aba640 1 -- 172.21.15.114:0/448079870 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a00b46d0 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.330+0000 7fe3a52b9640 1 --2- 172.21.15.114:0/448079870 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3a0159c70 0x7fe3a00ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:56.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.331+0000 7fe3a5aba640 1 --2- 172.21.15.114:0/448079870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a00b0ae0 0x7fe3a015d7d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe390009870 tx=0x7fe39002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4952190d348e3690 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.331+0000 7fe39ffff640 1 -- 172.21.15.114:0/448079870 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390030840 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.331+0000 7fe39ffff640 1 -- 172.21.15.114:0/448079870 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3900309a0 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.331+0000 7fe39ffff640 1 -- 172.21.15.114:0/448079870 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390030d30 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.331+0000 7fe3a751d640 1 -- 172.21.15.114:0/448079870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a00b0ae0 msgr2=0x7fe3a015d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.331+0000 7fe3a751d640 1 --2- 172.21.15.114:0/448079870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a00b0ae0 0x7fe3a015d7d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe390009870 tx=0x7fe39002b980 comp rx=0 tx=0).stop 2023-11-04T01:37:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.331+0000 7fe3a751d640 1 -- 172.21.15.114:0/448079870 shutdown_connections 2023-11-04T01:37:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.331+0000 7fe3a751d640 1 --2- 172.21.15.114:0/448079870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a00b0ae0 0x7fe3a015d7d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.331+0000 7fe3a751d640 1 --2- 172.21.15.114:0/448079870 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3a0159c70 0x7fe3a00ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.331+0000 7fe3a751d640 1 -- 172.21.15.114:0/448079870 >> 172.21.15.114:0/448079870 conn(0x7fe3a00ce950 msgr2=0x7fe3a00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.331+0000 7fe3a751d640 1 -- 172.21.15.114:0/448079870 shutdown_connections 2023-11-04T01:37:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.331+0000 7fe3a751d640 1 -- 172.21.15.114:0/448079870 wait complete. 2023-11-04T01:37:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.332+0000 7fe3a751d640 1 Processor -- start 2023-11-04T01:37:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.333+0000 7fe3a751d640 1 -- start start 2023-11-04T01:37:56.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.333+0000 7fe3a751d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3a006db20 0x7fe3a00c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.333+0000 7fe3a751d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a00b0ae0 0x7fe3a00c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.333+0000 7fe3a751d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3a0159c70 0x7fe3a00c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.333+0000 7fe3a751d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a01f4e20 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.333+0000 7fe3a751d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00c4e30 con 0x7fe3a0159c70 2023-11-04T01:37:56.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.333+0000 7fe3a751d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a014e690 con 0x7fe3a006db20 2023-11-04T01:37:56.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.333+0000 7fe3a4ab8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a00b0ae0 0x7fe3a00c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.333+0000 7fe3a4ab8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a00b0ae0 0x7fe3a00c7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51402/0 (socket says 172.21.15.114:51402) 2023-11-04T01:37:56.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.333+0000 7fe3a4ab8640 1 -- 172.21.15.114:0/3832943248 learned_addr learned my addr 172.21.15.114:0/3832943248 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:56.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.334+0000 7fe3a52b9640 1 --2- 172.21.15.114:0/3832943248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3a006db20 0x7fe3a00c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.334+0000 7fe3a5aba640 1 --2- 172.21.15.114:0/3832943248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3a0159c70 0x7fe3a00c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.334+0000 7fe3a4ab8640 1 -- 172.21.15.114:0/3832943248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3a006db20 msgr2=0x7fe3a00c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.334+0000 7fe3a4ab8640 1 --2- 172.21.15.114:0/3832943248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3a006db20 0x7fe3a00c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.334+0000 7fe3a4ab8640 1 -- 172.21.15.114:0/3832943248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3a0159c70 msgr2=0x7fe3a00c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.334+0000 7fe3a4ab8640 1 --2- 172.21.15.114:0/3832943248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3a0159c70 0x7fe3a00c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.334+0000 7fe3a4ab8640 1 -- 172.21.15.114:0/3832943248 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3900094d0 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.334+0000 7fe3a52b9640 1 --2- 172.21.15.114:0/3832943248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3a006db20 0x7fe3a00c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:56.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.334+0000 7fe3a5aba640 1 --2- 172.21.15.114:0/3832943248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3a0159c70 0x7fe3a00c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:37:56.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.334+0000 7fe3a4ab8640 1 --2- 172.21.15.114:0/3832943248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a00b0ae0 0x7fe3a00c7ba0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe39400c7d0 tx=0x7fe39400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.334+0000 7fe39dffb640 1 -- 172.21.15.114:0/3832943248 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39400a640 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.334+0000 7fe39dffb640 1 -- 172.21.15.114:0/3832943248 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39400a7a0 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.334+0000 7fe3a751d640 1 -- 172.21.15.114:0/3832943248 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a014e080 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.334+0000 7fe39dffb640 1 -- 172.21.15.114:0/3832943248 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39400ab10 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.334+0000 7fe3a751d640 1 -- 172.21.15.114:0/3832943248 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a01f4480 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.335+0000 7fe3a751d640 1 -- 172.21.15.114:0/3832943248 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a01f4f60 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.335+0000 7fe39dffb640 1 -- 172.21.15.114:0/3832943248 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe39400ac70 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.336+0000 7fe39dffb640 1 --2- 172.21.15.114:0/3832943248 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe38c06ae70 0x7fe38c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:56.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.336+0000 7fe39dffb640 1 -- 172.21.15.114:0/3832943248 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe394088ce0 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.336+0000 7fe3a52b9640 1 --2- 172.21.15.114:0/3832943248 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe38c06ae70 0x7fe38c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:56.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.336+0000 7fe3a52b9640 1 --2- 172.21.15.114:0/3832943248 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe38c06ae70 0x7fe38c06d330 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe398006fd0 tx=0x7fe398008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:56.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.340+0000 7fe39dffb640 1 -- 172.21.15.114:0/3832943248 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe3a01f4f60 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.541+0000 7fe3a751d640 1 -- 172.21.15.114:0/3832943248 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe3a014e080 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.541+0000 7fe39dffb640 1 -- 172.21.15.114:0/3832943248 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe3a014e080 con 0x7fe3a00b0ae0 2023-11-04T01:37:56.543 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:37:56.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.543+0000 7fe3a751d640 1 -- 172.21.15.114:0/3832943248 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe38c06ae70 msgr2=0x7fe38c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.543+0000 7fe3a751d640 1 --2- 172.21.15.114:0/3832943248 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe38c06ae70 0x7fe38c06d330 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe398006fd0 tx=0x7fe398008040 comp rx=0 tx=0).stop 2023-11-04T01:37:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.543+0000 7fe3a751d640 1 -- 172.21.15.114:0/3832943248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a00b0ae0 msgr2=0x7fe3a00c7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.543+0000 7fe3a751d640 1 --2- 172.21.15.114:0/3832943248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a00b0ae0 0x7fe3a00c7ba0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe39400c7d0 tx=0x7fe39400cc90 comp rx=0 tx=0).stop 2023-11-04T01:37:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.543+0000 7fe3a751d640 1 -- 172.21.15.114:0/3832943248 shutdown_connections 2023-11-04T01:37:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.543+0000 7fe3a751d640 1 --2- 172.21.15.114:0/3832943248 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe38c06ae70 0x7fe38c06d330 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.543+0000 7fe3a751d640 1 --2- 172.21.15.114:0/3832943248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3a0159c70 0x7fe3a00c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.543+0000 7fe3a751d640 1 --2- 172.21.15.114:0/3832943248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3a00b0ae0 0x7fe3a00c7ba0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.543+0000 7fe3a751d640 1 --2- 172.21.15.114:0/3832943248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3a006db20 0x7fe3a00c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.543+0000 7fe3a751d640 1 -- 172.21.15.114:0/3832943248 >> 172.21.15.114:0/3832943248 conn(0x7fe3a00ce950 msgr2=0x7fe3a00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.543+0000 7fe3a751d640 1 -- 172.21.15.114:0/3832943248 shutdown_connections 2023-11-04T01:37:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:56.543+0000 7fe3a751d640 1 -- 172.21.15.114:0/3832943248 wait complete. 2023-11-04T01:37:56.555 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:37:56.556 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:37:56.556 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-11-04T01:37:56.556 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:37:56.556 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:56.556 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:37:56.556 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:37:56.556 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:37:56.556 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:37:56.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:56.556 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-11-04T01:37:56.571 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:37:56.571 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:37:56.571 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:37:56.572 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:56.572 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-04T01:37:56.572 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:56.572 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:56.572 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:56.572 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-11-04T01:37:56.572 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:56.572 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:56.572 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-11-04T01:37:56.572 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:37:56.572 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:56.572 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:37:56.573 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:56.573 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:37:56.573 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42399sec preferred_lft 42399sec 2023-11-04T01:37:56.573 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-11-04T01:37:56.573 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:56.573 INFO:teuthology.orchestra.run.smithi114.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:37:56.573 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 7e:72:41:ca:70:95 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:37:56.573 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:37:56.573 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:56.573 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9c8d:d6ff:fe6f:d555/64 scope link 2023-11-04T01:37:56.573 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:56.573 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:37:56.574 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether f6:4c:1e:67:08:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:56.574 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::f44c:1eff:fe67:85a/64 scope link 2023-11-04T01:37:56.574 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:56.574 INFO:teuthology.orchestra.run.smithi114.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:37:56.574 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 7e:72:41:ca:70:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:56.574 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::7c72:41ff:feca:7095/64 scope link 2023-11-04T01:37:56.574 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:37:56.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:56.574 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:37:56.637 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-11-04T01:37:56.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:56.639 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-11-04T01:37:56.695 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-11-04T01:37:56.695 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:37:56.695 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:37:56.695 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:37:56.695 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:37:56.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:56.696 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:37:56.696 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:37:56.696 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:37:56.696 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:37:56.696 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:37:56.696 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:37:56.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:56.791 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-04T01:37:56.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:37:56.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:37:56.806 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:37:56.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:56.806 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-11-04T01:37:56.873 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:37:56.873 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:37:56.873 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:56.927 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:37:56.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:37:56.928 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:56.982 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:57.038 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:37:57.038 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:37:57.038 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:37:57.038 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:37:57.038 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:37:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:37:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:37:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:37:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:37:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:37:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:37:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:37:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:37:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:37:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:37:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:37:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:37:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:37:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:37:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:37:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:57.041 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:57.041 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:57.041 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:57.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:57.041 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:37:57.093 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:37:57.093 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:37:57.136 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:37:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:37:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:37:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:37:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:37:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:37:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:37:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:37:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:37:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:37:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:37:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:37:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:37:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:37:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:37:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:37:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:37:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:37:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:37:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:37:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:57.154 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:57.154 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:57.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:57.154 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:37:57.225 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:37:57.223+0000 7f454c23d480 -1 init, newargv = 0x556dd2325cc0 newargc=15 2023-11-04T01:37:57.226 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[105313]: starting ceph client 2023-11-04T01:37:57.230 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[105313]: starting fuse 2023-11-04T01:37:58.308 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:37:58.327 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:37:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:37:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:37:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:37:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:37:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:37:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:37:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:37:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:37:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:37:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:37:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:37:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:37:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:37:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:37:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:37:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:37:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:37:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:37:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:37:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:37:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:37:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:37:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:37:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:37:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:37:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:37:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:37:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:37:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:37:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:37:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:37:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:58.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:37:58.331 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:37:58.386 INFO:teuthology.orchestra.run.smithi114.stdout:41 2023-11-04T01:37:58.387 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:37:58.387 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:37:58.387 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2023-11-04T01:37:58.387 DEBUG:teuthology.orchestra.run.smithi114:> import re 2023-11-04T01:37:58.387 DEBUG:teuthology.orchestra.run.smithi114:> import os 2023-11-04T01:37:58.387 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2023-11-04T01:37:58.387 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:37:58.387 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2023-11-04T01:37:58.387 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:37:58.387 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2023-11-04T01:37:58.387 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:37:58.388 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:37:58.388 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2023-11-04T01:37:58.388 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2023-11-04T01:37:58.388 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2023-11-04T01:37:58.388 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2023-11-04T01:37:58.388 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:37:58.388 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2023-11-04T01:37:58.388 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:37:58.388 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:37:58.388 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:37:58.388 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2023-11-04T01:37:58.388 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2023-11-04T01:37:58.388 DEBUG:teuthology.orchestra.run.smithi114:> return f 2023-11-04T01:37:58.388 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:37:58.389 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:37:58.389 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.0")) 2023-11-04T01:37:58.389 DEBUG:teuthology.orchestra.run.smithi114:> ' 2023-11-04T01:37:58.513 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.0.105313.asok 2023-11-04T01:37:58.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:58.524 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.105313.asok 2023-11-04T01:37:58.525 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:58.525 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.105313.asok status 2023-11-04T01:37:58.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:37:58.695 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2023-11-04T01:37:58.695 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:37:58.695 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:37:58.695 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "0", 2023-11-04T01:37:58.695 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2023-11-04T01:37:58.696 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:37:58.696 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "105313", 2023-11-04T01:37:58.696 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2023-11-04T01:37:58.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:58.696 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2023-11-04T01:37:58.696 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2023-11-04T01:37:58.696 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 5772, 2023-11-04T01:37:58.696 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2023-11-04T01:37:58.696 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2023-11-04T01:37:58.696 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2023-11-04T01:37:58.696 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 5772 2023-11-04T01:37:58.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:58.697 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:37:58.697 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:37:58.697 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:37:58.697 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 279019916 2023-11-04T01:37:58.697 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:37:58.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:58.697 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:37:58.697 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:37:58.697 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:37:58.697 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 279019916 2023-11-04T01:37:58.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:37:58.698 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.5772 192.168.0.1:0/279019916", 2023-11-04T01:37:58.698 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "192.168.0.1:0/279019916", 2023-11-04T01:37:58.698 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2023-11-04T01:37:58.698 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 16, 2023-11-04T01:37:58.698 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 38, 2023-11-04T01:37:58.698 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:37:58.698 INFO:teuthology.orchestra.run.smithi114.stdout: "blocklisted": false, 2023-11-04T01:37:58.698 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2023-11-04T01:37:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:37:58.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:58.709 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:58.709 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:37:58.709 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:58.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2023-11-04T01:37:58.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:58.775 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:58.775 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:37:58.775 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:37:58.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:37:58.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:37:58.843 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create snap-test-pool 2023-11-04T01:37:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.942+0000 7f1a5d276640 1 Processor -- start 2023-11-04T01:37:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.942+0000 7f1a5d276640 1 -- start start 2023-11-04T01:37:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.943+0000 7f1a5d276640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1a58153e60 0x7f1a5815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.943+0000 7f1a5d276640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1a580b4880 0x7f1a580b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.943+0000 7f1a5d276640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a580cde60 con 0x7f1a580cd6d0 2023-11-04T01:37:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.943+0000 7f1a5d276640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a580b5230 con 0x7f1a580b4880 2023-11-04T01:37:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.943+0000 7f1a5d276640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a58160f90 con 0x7f1a58153e60 2023-11-04T01:37:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.943+0000 7f1a577fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1a580b4880 0x7f1a580b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.943+0000 7f1a567fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1a580cd6d0 0x7f1a58161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60572/0 (socket says 172.21.15.114:60572) 2023-11-04T01:37:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.943+0000 7f1a577fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1a580b4880 0x7f1a580b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42876/0 (socket says 172.21.15.114:42876) 2023-11-04T01:37:58.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.943+0000 7f1a567fc640 1 -- 172.21.15.114:0/822589192 learned_addr learned my addr 172.21.15.114:0/822589192 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:37:58.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.944+0000 7f1a577fe640 1 -- 172.21.15.114:0/822589192 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1a58153e60 msgr2=0x7f1a5815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:58.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.944+0000 7f1a56ffd640 1 --2- 172.21.15.114:0/822589192 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1a58153e60 0x7f1a5815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.944+0000 7f1a577fe640 1 --2- 172.21.15.114:0/822589192 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1a58153e60 0x7f1a5815dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.944+0000 7f1a577fe640 1 -- 172.21.15.114:0/822589192 >> v1:172.21.15.114:6789/0 conn(0x7f1a580cd6d0 legacy=0x7f1a58161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.944+0000 7f1a577fe640 1 -- 172.21.15.114:0/822589192 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5815e400 con 0x7f1a580b4880 2023-11-04T01:37:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.944+0000 7f1a55ffb640 1 -- 172.21.15.114:0/822589192 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843767030 0 0) 0x7f1a580cde60 con 0x7f1a580cd6d0 2023-11-04T01:37:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.944+0000 7f1a577fe640 1 --2- 172.21.15.114:0/822589192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a580b4880 0x7f1a580b4cf0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1a500097a0 tx=0x7f1a5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81b3bfbe794b901 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.944+0000 7f1a55ffb640 1 -- 172.21.15.114:0/822589192 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50031830 con 0x7f1a580b4880 2023-11-04T01:37:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.945+0000 7f1a55ffb640 1 -- 172.21.15.114:0/822589192 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a50031990 con 0x7f1a580b4880 2023-11-04T01:37:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.945+0000 7f1a55ffb640 1 -- 172.21.15.114:0/822589192 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50031d20 con 0x7f1a580b4880 2023-11-04T01:37:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.945+0000 7f1a5d276640 1 -- 172.21.15.114:0/822589192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a580b4880 msgr2=0x7f1a580b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.945+0000 7f1a5d276640 1 --2- 172.21.15.114:0/822589192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a580b4880 0x7f1a580b4cf0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1a500097a0 tx=0x7f1a5002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.945+0000 7f1a5d276640 1 -- 172.21.15.114:0/822589192 shutdown_connections 2023-11-04T01:37:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.945+0000 7f1a5d276640 1 --2- 172.21.15.114:0/822589192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a580b4880 0x7f1a580b4cf0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.945+0000 7f1a5d276640 1 --2- 172.21.15.114:0/822589192 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1a58153e60 0x7f1a5815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.945+0000 7f1a5d276640 1 -- 172.21.15.114:0/822589192 >> 172.21.15.114:0/822589192 conn(0x7f1a580cf880 msgr2=0x7f1a580cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.945+0000 7f1a5d276640 1 -- 172.21.15.114:0/822589192 shutdown_connections 2023-11-04T01:37:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.945+0000 7f1a5d276640 1 -- 172.21.15.114:0/822589192 wait complete. 2023-11-04T01:37:58.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.946+0000 7f1a5d276640 1 Processor -- start 2023-11-04T01:37:58.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.946+0000 7f1a5d276640 1 -- start start 2023-11-04T01:37:58.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.947+0000 7f1a5d276640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a580b4880 0x7f1a5815f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.947+0000 7f1a5d276640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1a580cd6d0 0x7f1a5815fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.947+0000 7f1a5d276640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1a58153e60 0x7f1a58155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.947+0000 7f1a5d276640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a580c9800 con 0x7f1a580b4880 2023-11-04T01:37:58.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.947+0000 7f1a5d276640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a581568a0 con 0x7f1a58153e60 2023-11-04T01:37:58.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.947+0000 7f1a5d276640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a581543e0 con 0x7f1a580cd6d0 2023-11-04T01:37:58.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.947+0000 7f1a56ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a580b4880 0x7f1a5815f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.947+0000 7f1a56ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a580b4880 0x7f1a5815f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42878/0 (socket says 172.21.15.114:42878) 2023-11-04T01:37:58.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.947+0000 7f1a56ffd640 1 -- 172.21.15.114:0/3505644358 learned_addr learned my addr 172.21.15.114:0/3505644358 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:58.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.947+0000 7f1a567fc640 1 --2- 172.21.15.114:0/3505644358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1a580cd6d0 0x7f1a5815fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.947+0000 7f1a577fe640 1 --2- 172.21.15.114:0/3505644358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1a58153e60 0x7f1a58155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.947+0000 7f1a56ffd640 1 -- 172.21.15.114:0/3505644358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1a580cd6d0 msgr2=0x7f1a5815fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.947+0000 7f1a56ffd640 1 --2- 172.21.15.114:0/3505644358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1a580cd6d0 0x7f1a5815fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.948+0000 7f1a56ffd640 1 -- 172.21.15.114:0/3505644358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1a58153e60 msgr2=0x7f1a58155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:58.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.948+0000 7f1a56ffd640 1 --2- 172.21.15.114:0/3505644358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1a58153e60 0x7f1a58155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:58.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.948+0000 7f1a56ffd640 1 -- 172.21.15.114:0/3505644358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a50009400 con 0x7f1a580b4880 2023-11-04T01:37:58.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.948+0000 7f1a56ffd640 1 --2- 172.21.15.114:0/3505644358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a580b4880 0x7f1a5815f8d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800ccd0 tx=0x7f1a4800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.948+0000 7f1a3f7fe640 1 -- 172.21.15.114:0/3505644358 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48003990 con 0x7f1a580b4880 2023-11-04T01:37:58.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.948+0000 7f1a3f7fe640 1 -- 172.21.15.114:0/3505644358 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a48003af0 con 0x7f1a580b4880 2023-11-04T01:37:58.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.948+0000 7f1a5d276640 1 -- 172.21.15.114:0/3505644358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a581546c0 con 0x7f1a580b4880 2023-11-04T01:37:58.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.948+0000 7f1a3f7fe640 1 -- 172.21.15.114:0/3505644358 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48003e80 con 0x7f1a580b4880 2023-11-04T01:37:58.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.948+0000 7f1a5d276640 1 -- 172.21.15.114:0/3505644358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a58154c80 con 0x7f1a580b4880 2023-11-04T01:37:58.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.949+0000 7f1a5d276640 1 -- 172.21.15.114:0/3505644358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a58074290 con 0x7f1a580b4880 2023-11-04T01:37:58.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.949+0000 7f1a3f7fe640 1 -- 172.21.15.114:0/3505644358 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a48004020 con 0x7f1a580b4880 2023-11-04T01:37:58.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.950+0000 7f1a3f7fe640 1 --2- 172.21.15.114:0/3505644358 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1a4406ae70 0x7f1a4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:58.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.950+0000 7f1a3f7fe640 1 -- 172.21.15.114:0/3505644358 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1a48089b50 con 0x7f1a580b4880 2023-11-04T01:37:58.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.950+0000 7f1a567fc640 1 --2- 172.21.15.114:0/3505644358 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1a4406ae70 0x7f1a4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:58.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.950+0000 7f1a567fc640 1 --2- 172.21.15.114:0/3505644358 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1a4406ae70 0x7f1a4406d330 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1a58158130 tx=0x7f1a4c007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:58.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:58.954+0000 7f1a3f7fe640 1 -- 172.21.15.114:0/3505644358 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a48054ac0 con 0x7f1a580b4880 2023-11-04T01:37:59.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.121+0000 7f1a5d276640 1 -- 172.21.15.114:0/3505644358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "snap-test-pool"} v 0) v1 -- 0x7f1a580d1340 con 0x7f1a580b4880 2023-11-04T01:37:59.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.687+0000 7f1a3f7fe640 1 -- 172.21.15.114:0/3505644358 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "snap-test-pool"}]=0 pool 'snap-test-pool' created v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1a4801d070 con 0x7f1a580b4880 2023-11-04T01:37:59.689 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'snap-test-pool' created 2023-11-04T01:37:59.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.690+0000 7f1a5d276640 1 -- 172.21.15.114:0/3505644358 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1a4406ae70 msgr2=0x7f1a4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.690+0000 7f1a5d276640 1 --2- 172.21.15.114:0/3505644358 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1a4406ae70 0x7f1a4406d330 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1a58158130 tx=0x7f1a4c007b50 comp rx=0 tx=0).stop 2023-11-04T01:37:59.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.690+0000 7f1a5d276640 1 -- 172.21.15.114:0/3505644358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a580b4880 msgr2=0x7f1a5815f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.690+0000 7f1a5d276640 1 --2- 172.21.15.114:0/3505644358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a580b4880 0x7f1a5815f8d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800ccd0 tx=0x7f1a4800a5c0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.690+0000 7f1a5d276640 1 -- 172.21.15.114:0/3505644358 shutdown_connections 2023-11-04T01:37:59.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.690+0000 7f1a5d276640 1 --2- 172.21.15.114:0/3505644358 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1a4406ae70 0x7f1a4406d330 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.690+0000 7f1a5d276640 1 --2- 172.21.15.114:0/3505644358 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1a58153e60 0x7f1a58155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.690+0000 7f1a5d276640 1 --2- 172.21.15.114:0/3505644358 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1a580cd6d0 0x7f1a5815fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.690+0000 7f1a5d276640 1 --2- 172.21.15.114:0/3505644358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a580b4880 0x7f1a5815f8d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.690+0000 7f1a5d276640 1 -- 172.21.15.114:0/3505644358 >> 172.21.15.114:0/3505644358 conn(0x7f1a580cf880 msgr2=0x7f1a5815ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:59.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.690+0000 7f1a5d276640 1 -- 172.21.15.114:0/3505644358 shutdown_connections 2023-11-04T01:37:59.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.690+0000 7f1a5d276640 1 -- 172.21.15.114:0/3505644358 wait complete. 2023-11-04T01:37:59.708 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool snap-test-pool mksnap snap3 2023-11-04T01:37:59.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.747+0000 7fc3b1cb8f40 1 Processor -- start 2023-11-04T01:37:59.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.747+0000 7fc3b1cb8f40 1 -- start start 2023-11-04T01:37:59.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.747+0000 7fc3b1cb8f40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562db4192930 0x562db41a75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.747+0000 7fc3b1cb8f40 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562db4192d10 0x562db423e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.747+0000 7fc3b1cb8f40 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562db423e7d0 0x562db42c5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.747+0000 7fc3b1cb8f40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db41133b0 con 0x562db4192930 2023-11-04T01:37:59.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.747+0000 7fc3b1cb8f40 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db40ad650 con 0x562db423e7d0 2023-11-04T01:37:59.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.747+0000 7fc3b1cb8f40 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x562db40ad2f0 con 0x562db4192d10 2023-11-04T01:37:59.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.747+0000 7fc3af7ba640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562db4192930 0x562db41a75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.747+0000 7fc3af7ba640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562db4192930 0x562db41a75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42900/0 (socket says 172.21.15.114:42900) 2023-11-04T01:37:59.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.747+0000 7fc3af7ba640 1 -- 172.21.15.114:0/3713718802 learned_addr learned my addr 172.21.15.114:0/3713718802 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:59.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3a6fb9640 1 --2- 172.21.15.114:0/3713718802 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562db4192d10 0x562db423e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3affbb640 1 --2- 172.21.15.114:0/3713718802 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562db423e7d0 0x562db42c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3af7ba640 1 -- 172.21.15.114:0/3713718802 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562db4192d10 msgr2=0x562db423e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:59.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3af7ba640 1 --2- 172.21.15.114:0/3713718802 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562db4192d10 0x562db423e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3af7ba640 1 -- 172.21.15.114:0/3713718802 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562db423e7d0 msgr2=0x562db42c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:37:59.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3af7ba640 1 --2- 172.21.15.114:0/3713718802 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562db423e7d0 0x562db42c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3af7ba640 1 -- 172.21.15.114:0/3713718802 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562db40b9780 con 0x562db4192930 2023-11-04T01:37:59.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3a6fb9640 1 --2- 172.21.15.114:0/3713718802 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562db4192d10 0x562db423e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:59.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3af7ba640 1 --2- 172.21.15.114:0/3713718802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562db4192930 0x562db41a75c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009790 tx=0x7fc3a0005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782db1e21f3dd4d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3ae7b8640 1 -- 172.21.15.114:0/3713718802 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a000f040 con 0x562db4192930 2023-11-04T01:37:59.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3ae7b8640 1 -- 172.21.15.114:0/3713718802 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a00078f0 con 0x562db4192930 2023-11-04T01:37:59.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3ae7b8640 1 -- 172.21.15.114:0/3713718802 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0007c60 con 0x562db4192930 2023-11-04T01:37:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3b1cb8f40 1 -- 172.21.15.114:0/3713718802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562db4192930 msgr2=0x562db41a75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3b1cb8f40 1 --2- 172.21.15.114:0/3713718802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562db4192930 0x562db41a75c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009790 tx=0x7fc3a0005a00 comp rx=0 tx=0).stop 2023-11-04T01:37:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3b1cb8f40 1 -- 172.21.15.114:0/3713718802 shutdown_connections 2023-11-04T01:37:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3b1cb8f40 1 --2- 172.21.15.114:0/3713718802 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562db423e7d0 0x562db42c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3b1cb8f40 1 --2- 172.21.15.114:0/3713718802 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562db4192d10 0x562db423e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3b1cb8f40 1 --2- 172.21.15.114:0/3713718802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562db4192930 0x562db41a75c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3b1cb8f40 1 -- 172.21.15.114:0/3713718802 >> 172.21.15.114:0/3713718802 conn(0x562db418ff40 msgr2=0x562db418f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:37:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3b1cb8f40 1 -- 172.21.15.114:0/3713718802 shutdown_connections 2023-11-04T01:37:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.748+0000 7fc3b1cb8f40 1 -- 172.21.15.114:0/3713718802 wait complete. 2023-11-04T01:37:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.749+0000 7fc3b1cb8f40 1 Processor -- start 2023-11-04T01:37:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.749+0000 7fc3b1cb8f40 1 -- start start 2023-11-04T01:37:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3b1cb8f40 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562db4192930 0x562db418ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3b1cb8f40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562db4192d10 0x562db422eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3b1cb8f40 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562db423e7d0 0x562db4231b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3b1cb8f40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db408d4f0 con 0x562db4192d10 2023-11-04T01:37:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3b1cb8f40 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db41a9b00 con 0x562db4192930 2023-11-04T01:37:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3b1cb8f40 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x562db41a8ba0 con 0x562db423e7d0 2023-11-04T01:37:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3a6fb9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562db4192d10 0x562db422eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3a6fb9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562db4192d10 0x562db422eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42908/0 (socket says 172.21.15.114:42908) 2023-11-04T01:37:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3a6fb9640 1 -- 172.21.15.114:0/3468839497 learned_addr learned my addr 172.21.15.114:0/3468839497 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:37:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3affbb640 1 --2- 172.21.15.114:0/3468839497 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562db423e7d0 0x562db4231b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3af7ba640 1 --2- 172.21.15.114:0/3468839497 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562db4192930 0x562db418ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3a6fb9640 1 -- 172.21.15.114:0/3468839497 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562db423e7d0 msgr2=0x562db4231b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3a6fb9640 1 --2- 172.21.15.114:0/3468839497 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562db423e7d0 0x562db4231b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3a6fb9640 1 -- 172.21.15.114:0/3468839497 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562db4192930 msgr2=0x562db418ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:37:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3a6fb9640 1 --2- 172.21.15.114:0/3468839497 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562db4192930 0x562db418ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:37:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3a6fb9640 1 -- 172.21.15.114:0/3468839497 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a0009410 con 0x562db4192d10 2023-11-04T01:37:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3af7ba640 1 --2- 172.21.15.114:0/3468839497 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562db4192930 0x562db418ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:37:59.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3a6fb9640 1 --2- 172.21.15.114:0/3468839497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562db4192d10 0x562db422eab0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc398009ef0 tx=0x7fc398008400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:37:59.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3ad7b6640 1 -- 172.21.15.114:0/3468839497 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39800f040 con 0x562db4192d10 2023-11-04T01:37:59.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.750+0000 7fc3ad7b6640 1 -- 172.21.15.114:0/3468839497 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc398016610 con 0x562db4192d10 2023-11-04T01:37:59.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.751+0000 7fc3b1cb8f40 1 -- 172.21.15.114:0/3468839497 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562db40ac930 con 0x562db4192d10 2023-11-04T01:37:59.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.751+0000 7fc3ad7b6640 1 -- 172.21.15.114:0/3468839497 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398016980 con 0x562db4192d10 2023-11-04T01:37:59.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.751+0000 7fc3b1cb8f40 1 -- 172.21.15.114:0/3468839497 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562db40ac390 con 0x562db4192d10 2023-11-04T01:37:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.752+0000 7fc3ad7b6640 1 -- 172.21.15.114:0/3468839497 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc398016ae0 con 0x562db4192d10 2023-11-04T01:37:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.752+0000 7fc3ad7b6640 1 --2- 172.21.15.114:0/3468839497 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc390069820 0x7fc39006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:37:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.752+0000 7fc3ad7b6640 1 -- 172.21.15.114:0/3468839497 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc398088cb0 con 0x562db4192d10 2023-11-04T01:37:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.752+0000 7fc3af7ba640 1 --2- 172.21.15.114:0/3468839497 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc390069820 0x7fc39006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:37:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.753+0000 7fc3b1cb8f40 1 -- 172.21.15.114:0/3468839497 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- pool_op(create snap pool 7 tid 1 name snap3 v0) v4 -- 0x562db411d330 con 0x562db4192d10 2023-11-04T01:37:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:37:59.753+0000 7fc3af7ba640 1 --2- 172.21.15.114:0/3468839497 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc390069820 0x7fc39006bce0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0000c00 tx=0x7fc3a0017040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.696+0000 7fc3ad7b6640 1 -- 172.21.15.114:0/3468839497 <== mon.0 v2:172.21.15.114:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v40) v1 ==== 43+0+0 (secure 0 0 0) 0x7fc398024080 con 0x562db4192d10 2023-11-04T01:38:00.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.696+0000 7fc3ad7b6640 1 -- 172.21.15.114:0/3468839497 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=40}) v3 -- 0x7fc390072510 con 0x562db4192d10 2023-11-04T01:38:00.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.697+0000 7fc3ad7b6640 1 -- 172.21.15.114:0/3468839497 <== mon.0 v2:172.21.15.114:3300/0 7 ==== osd_map(40..40 src has 1..40) v4 ==== 718+0+0 (secure 0 0 0) 0x7fc398008e40 con 0x562db4192d10 2023-11-04T01:38:00.699 INFO:teuthology.orchestra.run.smithi114.stdout:created pool snap-test-pool snap snap3 2023-11-04T01:38:00.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.698+0000 7fc3b1cb8f40 1 -- 172.21.15.114:0/3468839497 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc390069820 msgr2=0x7fc39006bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.698+0000 7fc3b1cb8f40 1 --2- 172.21.15.114:0/3468839497 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc390069820 0x7fc39006bce0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0000c00 tx=0x7fc3a0017040 comp rx=0 tx=0).stop 2023-11-04T01:38:00.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.698+0000 7fc3b1cb8f40 1 -- 172.21.15.114:0/3468839497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562db4192d10 msgr2=0x562db422eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.698+0000 7fc3b1cb8f40 1 --2- 172.21.15.114:0/3468839497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562db4192d10 0x562db422eab0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc398009ef0 tx=0x7fc398008400 comp rx=0 tx=0).stop 2023-11-04T01:38:00.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.699+0000 7fc3b1cb8f40 1 -- 172.21.15.114:0/3468839497 shutdown_connections 2023-11-04T01:38:00.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.699+0000 7fc3b1cb8f40 1 --2- 172.21.15.114:0/3468839497 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562db423e7d0 0x562db4231b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.699+0000 7fc3b1cb8f40 1 --2- 172.21.15.114:0/3468839497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562db4192d10 0x562db422eab0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.700+0000 7fc3b1cb8f40 1 --2- 172.21.15.114:0/3468839497 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc390069820 0x7fc39006bce0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.700+0000 7fc3b1cb8f40 1 --2- 172.21.15.114:0/3468839497 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562db4192930 0x562db418ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.700+0000 7fc3b1cb8f40 1 -- 172.21.15.114:0/3468839497 >> 172.21.15.114:0/3468839497 conn(0x562db418ff40 msgr2=0x562db423ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.700+0000 7fc3b1cb8f40 1 -- 172.21.15.114:0/3468839497 shutdown_connections 2023-11-04T01:38:00.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.700+0000 7fc3b1cb8f40 1 -- 172.21.15.114:0/3468839497 wait complete. 2023-11-04T01:38:00.710 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs snap-test-pool 2023-11-04T01:38:00.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.854+0000 7fcab3a1f640 1 Processor -- start 2023-11-04T01:38:00.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.855+0000 7fcab3a1f640 1 -- start start 2023-11-04T01:38:00.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.855+0000 7fcab3a1f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fcaac070e20 0x7fcaac0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.855+0000 7fcab3a1f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcaac0ad730 0x7fcaac15e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.855+0000 7fcab3a1f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac0c3900 con 0x7fcaac15ad30 2023-11-04T01:38:00.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.855+0000 7fcab3a1f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac0ae260 con 0x7fcaac0ad730 2023-11-04T01:38:00.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.855+0000 7fcab3a1f640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac0c3be0 con 0x7fcaac070e20 2023-11-04T01:38:00.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.856+0000 7fcab1fbc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcaac0ad730 0x7fcaac15e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.856+0000 7fcab17bb640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcaac15ad30 0x7fcaac070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60590/0 (socket says 172.21.15.114:60590) 2023-11-04T01:38:00.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.856+0000 7fcab17bb640 1 -- 172.21.15.114:0/1487747994 learned_addr learned my addr 172.21.15.114:0/1487747994 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:00.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.856+0000 7fcab1fbc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcaac0ad730 0x7fcaac15e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42918/0 (socket says 172.21.15.114:42918) 2023-11-04T01:38:00.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.856+0000 7fcab1fbc640 1 -- 172.21.15.114:0/1487747994 >> v2:172.21.15.141:3300/0 conn(0x7fcaac070e20 msgr2=0x7fcaac0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:00.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.856+0000 7fcab0fba640 1 --2- 172.21.15.114:0/1487747994 >> v2:172.21.15.141:3300/0 conn(0x7fcaac070e20 0x7fcaac0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.856+0000 7fcab1fbc640 1 --2- 172.21.15.114:0/1487747994 >> v2:172.21.15.141:3300/0 conn(0x7fcaac070e20 0x7fcaac0adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.856+0000 7fcaa3fff640 1 -- 172.21.15.114:0/1487747994 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746879016 0 0) 0x7fcaac0c3900 con 0x7fcaac15ad30 2023-11-04T01:38:00.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.856+0000 7fcab1fbc640 1 -- 172.21.15.114:0/1487747994 >> v1:172.21.15.114:6789/0 conn(0x7fcaac15ad30 legacy=0x7fcaac070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.856+0000 7fcab1fbc640 1 -- 172.21.15.114:0/1487747994 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac0c3ec0 con 0x7fcaac0ad730 2023-11-04T01:38:00.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.857+0000 7fcab1fbc640 1 --2- 172.21.15.114:0/1487747994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaac0ad730 0x7fcaac15e740 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0ce7f0 tx=0x7fcaa402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5dd77cae69151c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.857+0000 7fcaa3fff640 1 -- 172.21.15.114:0/1487747994 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa402cbf0 con 0x7fcaac0ad730 2023-11-04T01:38:00.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.857+0000 7fcaa3fff640 1 -- 172.21.15.114:0/1487747994 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa402cd50 con 0x7fcaac0ad730 2023-11-04T01:38:00.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.857+0000 7fcaa3fff640 1 -- 172.21.15.114:0/1487747994 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4034660 con 0x7fcaac0ad730 2023-11-04T01:38:00.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.857+0000 7fcab3a1f640 1 -- 172.21.15.114:0/1487747994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaac0ad730 msgr2=0x7fcaac15e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.857+0000 7fcab3a1f640 1 --2- 172.21.15.114:0/1487747994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaac0ad730 0x7fcaac15e740 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0ce7f0 tx=0x7fcaa402be40 comp rx=0 tx=0).stop 2023-11-04T01:38:00.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.857+0000 7fcab3a1f640 1 -- 172.21.15.114:0/1487747994 shutdown_connections 2023-11-04T01:38:00.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.857+0000 7fcab3a1f640 1 --2- 172.21.15.114:0/1487747994 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaac0ad730 0x7fcaac15e740 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.857+0000 7fcab3a1f640 1 --2- 172.21.15.114:0/1487747994 >> v2:172.21.15.141:3300/0 conn(0x7fcaac070e20 0x7fcaac0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.857+0000 7fcab3a1f640 1 -- 172.21.15.114:0/1487747994 >> 172.21.15.114:0/1487747994 conn(0x7fcaac0ce950 msgr2=0x7fcaac0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:00.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.857+0000 7fcab3a1f640 1 -- 172.21.15.114:0/1487747994 shutdown_connections 2023-11-04T01:38:00.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.857+0000 7fcab3a1f640 1 -- 172.21.15.114:0/1487747994 wait complete. 2023-11-04T01:38:00.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.859+0000 7fcab3a1f640 1 Processor -- start 2023-11-04T01:38:00.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.859+0000 7fcab3a1f640 1 -- start start 2023-11-04T01:38:00.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.859+0000 7fcab3a1f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaac070e20 0x7fcaac15b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.859+0000 7fcab3a1f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcaac0ad730 0x7fcaac154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.859+0000 7fcab3a1f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaac15ad30 0x7fcaac155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.859+0000 7fcab3a1f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac153400 con 0x7fcaac15ad30 2023-11-04T01:38:00.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.859+0000 7fcab3a1f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac140bc0 con 0x7fcaac0ad730 2023-11-04T01:38:00.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.859+0000 7fcab3a1f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac140ea0 con 0x7fcaac070e20 2023-11-04T01:38:00.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.859+0000 7fcab1fbc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaac15ad30 0x7fcaac155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.859+0000 7fcab1fbc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaac15ad30 0x7fcaac155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42934/0 (socket says 172.21.15.114:42934) 2023-11-04T01:38:00.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.859+0000 7fcab1fbc640 1 -- 172.21.15.114:0/2232794190 learned_addr learned my addr 172.21.15.114:0/2232794190 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:00.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.860+0000 7fcab0fba640 1 --2- 172.21.15.114:0/2232794190 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcaac0ad730 0x7fcaac154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.860+0000 7fcab17bb640 1 --2- 172.21.15.114:0/2232794190 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaac070e20 0x7fcaac15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.860+0000 7fcab1fbc640 1 -- 172.21.15.114:0/2232794190 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaac070e20 msgr2=0x7fcaac15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.860+0000 7fcab1fbc640 1 --2- 172.21.15.114:0/2232794190 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaac070e20 0x7fcaac15b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.860+0000 7fcab1fbc640 1 -- 172.21.15.114:0/2232794190 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcaac0ad730 msgr2=0x7fcaac154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:00.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.860+0000 7fcab1fbc640 1 --2- 172.21.15.114:0/2232794190 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcaac0ad730 0x7fcaac154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:00.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.860+0000 7fcab1fbc640 1 -- 172.21.15.114:0/2232794190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa4009a70 con 0x7fcaac15ad30 2023-11-04T01:38:00.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.860+0000 7fcab0fba640 1 --2- 172.21.15.114:0/2232794190 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcaac0ad730 0x7fcaac154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:00.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.860+0000 7fcab17bb640 1 --2- 172.21.15.114:0/2232794190 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcaac070e20 0x7fcaac15b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:00.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.860+0000 7fcab1fbc640 1 --2- 172.21.15.114:0/2232794190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaac15ad30 0x7fcaac155420 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4009e80 tx=0x7fcaa4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.860+0000 7fcaa1ffb640 1 -- 172.21.15.114:0/2232794190 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa403e610 con 0x7fcaac15ad30 2023-11-04T01:38:00.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.860+0000 7fcaa1ffb640 1 -- 172.21.15.114:0/2232794190 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa403e790 con 0x7fcaac15ad30 2023-11-04T01:38:00.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.860+0000 7fcab3a1f640 1 -- 172.21.15.114:0/2232794190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac141180 con 0x7fcaac15ad30 2023-11-04T01:38:00.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.860+0000 7fcaa1ffb640 1 -- 172.21.15.114:0/2232794190 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa403eb40 con 0x7fcaac15ad30 2023-11-04T01:38:00.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.860+0000 7fcab3a1f640 1 -- 172.21.15.114:0/2232794190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac141980 con 0x7fcaac15ad30 2023-11-04T01:38:00.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.861+0000 7fcab3a1f640 1 -- 172.21.15.114:0/2232794190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac1416a0 con 0x7fcaac15ad30 2023-11-04T01:38:00.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.862+0000 7fcaa1ffb640 1 -- 172.21.15.114:0/2232794190 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcaa403b050 con 0x7fcaac15ad30 2023-11-04T01:38:00.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.862+0000 7fcaa1ffb640 1 --2- 172.21.15.114:0/2232794190 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fca9006ae70 0x7fca9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:00.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.862+0000 7fcaa1ffb640 1 -- 172.21.15.114:0/2232794190 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6421+0+0 (secure 0 0 0) 0x7fcaa40ac3b0 con 0x7fcaac15ad30 2023-11-04T01:38:00.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.862+0000 7fcab17bb640 1 --2- 172.21.15.114:0/2232794190 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fca9006ae70 0x7fca9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:00.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.863+0000 7fcab17bb640 1 --2- 172.21.15.114:0/2232794190 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fca9006ae70 0x7fca9006d330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fca9c000f60 tx=0x7fca9c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:00.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:00.867+0000 7fcaa1ffb640 1 -- 172.21.15.114:0/2232794190 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcaac1416a0 con 0x7fcaac15ad30 2023-11-04T01:38:01.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.068+0000 7fcab3a1f640 1 -- 172.21.15.114:0/2232794190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "snap-test-pool"} v 0) v1 -- 0x7fcaac1416a0 con 0x7fcaac15ad30 2023-11-04T01:38:01.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.068+0000 7fcaa1ffb640 1 -- 172.21.15.114:0/2232794190 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "snap-test-pool"}]=-95 pool(7) already has mon-managed snaps; can't attach pool to fs v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7fcaac1416a0 con 0x7fcaac15ad30 2023-11-04T01:38:01.070 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOTSUP: pool(7) already has mon-managed snaps; can't attach pool to fs 2023-11-04T01:38:01.075 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:38:01.076 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool snap-test-pool rmsnap snap3 2023-11-04T01:38:01.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.115+0000 7f0cd2bdaf40 1 Processor -- start 2023-11-04T01:38:01.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.115+0000 7f0cd2bdaf40 1 -- start start 2023-11-04T01:38:01.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0cd2bdaf40 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0cb80030b0 0x55f0aee96500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0cd2bdaf40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0aee8c3e0 0x55f0aee96a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0cd2bdaf40 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f0aee95ab0 0x55f0aedecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0cd2bdaf40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0aed75ac0 con 0x55f0aee8c3e0 2023-11-04T01:38:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0cd2bdaf40 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0aed713b0 con 0x7f0cb80030b0 2023-11-04T01:38:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0cd2bdaf40 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0aed0b650 con 0x55f0aee95ab0 2023-11-04T01:38:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0ccfedd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0aee8c3e0 0x55f0aee96a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0ccfedd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0aee8c3e0 0x55f0aee96a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42962/0 (socket says 172.21.15.114:42962) 2023-11-04T01:38:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0ccfedd640 1 -- 172.21.15.114:0/3394056438 learned_addr learned my addr 172.21.15.114:0/3394056438 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0cd06de640 1 --2- 172.21.15.114:0/3394056438 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0cb80030b0 0x55f0aee96500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0cd0edf640 1 --2- 172.21.15.114:0/3394056438 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f0aee95ab0 0x55f0aedecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0ccfedd640 1 -- 172.21.15.114:0/3394056438 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f0aee95ab0 msgr2=0x55f0aedecdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0ccfedd640 1 --2- 172.21.15.114:0/3394056438 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f0aee95ab0 0x55f0aedecdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0ccfedd640 1 -- 172.21.15.114:0/3394056438 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0cb80030b0 msgr2=0x55f0aee96500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0ccfedd640 1 --2- 172.21.15.114:0/3394056438 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0cb80030b0 0x55f0aee96500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0ccfedd640 1 -- 172.21.15.114:0/3394056438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0aed0a930 con 0x55f0aee8c3e0 2023-11-04T01:38:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0ccfedd640 1 --2- 172.21.15.114:0/3394056438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0aee8c3e0 0x55f0aee96a40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4009840 tx=0x7f0cc4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c163b233eb05343e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0cceedb640 1 -- 172.21.15.114:0/3394056438 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4053980 con 0x55f0aee8c3e0 2023-11-04T01:38:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0cceedb640 1 -- 172.21.15.114:0/3394056438 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc4053ae0 con 0x55f0aee8c3e0 2023-11-04T01:38:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.116+0000 7f0cceedb640 1 -- 172.21.15.114:0/3394056438 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4053e50 con 0x55f0aee8c3e0 2023-11-04T01:38:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.117+0000 7f0cd2bdaf40 1 -- 172.21.15.114:0/3394056438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0aee8c3e0 msgr2=0x55f0aee96a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.117+0000 7f0cd2bdaf40 1 --2- 172.21.15.114:0/3394056438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0aee8c3e0 0x55f0aee96a40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4009840 tx=0x7f0cc4002fb0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.117+0000 7f0cd2bdaf40 1 -- 172.21.15.114:0/3394056438 shutdown_connections 2023-11-04T01:38:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.117+0000 7f0cd2bdaf40 1 --2- 172.21.15.114:0/3394056438 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f0aee95ab0 0x55f0aedecdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.117+0000 7f0cd2bdaf40 1 --2- 172.21.15.114:0/3394056438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0aee8c3e0 0x55f0aee96a40 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.117+0000 7f0cd2bdaf40 1 --2- 172.21.15.114:0/3394056438 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0cb80030b0 0x55f0aee96500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.117+0000 7f0cd2bdaf40 1 -- 172.21.15.114:0/3394056438 >> 172.21.15.114:0/3394056438 conn(0x55f0aee09530 msgr2=0x55f0aee90fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.117+0000 7f0cd2bdaf40 1 -- 172.21.15.114:0/3394056438 shutdown_connections 2023-11-04T01:38:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.117+0000 7f0cd2bdaf40 1 -- 172.21.15.114:0/3394056438 wait complete. 2023-11-04T01:38:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.117+0000 7f0cd2bdaf40 1 Processor -- start 2023-11-04T01:38:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.117+0000 7f0cd2bdaf40 1 -- start start 2023-11-04T01:38:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.118+0000 7f0cd2bdaf40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0aee8c3e0 0x55f0aee896b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.118+0000 7f0cd2bdaf40 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f0aee95ab0 0x55f0aee9c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.118+0000 7f0cd2bdaf40 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0cb80030b0 0x55f0aee99c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.118+0000 7f0cd2bdaf40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0aed0b2f0 con 0x55f0aee8c3e0 2023-11-04T01:38:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.118+0000 7f0cd2bdaf40 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0aeceb4f0 con 0x55f0aee95ab0 2023-11-04T01:38:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.118+0000 7f0cd2bdaf40 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0aedf21e0 con 0x7f0cb80030b0 2023-11-04T01:38:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.118+0000 7f0cd06de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0aee8c3e0 0x55f0aee896b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.118+0000 7f0cd06de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0aee8c3e0 0x55f0aee896b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42976/0 (socket says 172.21.15.114:42976) 2023-11-04T01:38:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.118+0000 7f0cd06de640 1 -- 172.21.15.114:0/1776105554 learned_addr learned my addr 172.21.15.114:0/1776105554 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.118+0000 7f0ccfedd640 1 --2- 172.21.15.114:0/1776105554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f0aee95ab0 0x55f0aee9c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.118+0000 7f0cd0edf640 1 --2- 172.21.15.114:0/1776105554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0cb80030b0 0x55f0aee99c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.118+0000 7f0cd06de640 1 -- 172.21.15.114:0/1776105554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0cb80030b0 msgr2=0x55f0aee99c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.118+0000 7f0cd06de640 1 --2- 172.21.15.114:0/1776105554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0cb80030b0 0x55f0aee99c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.118+0000 7f0cd06de640 1 -- 172.21.15.114:0/1776105554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f0aee95ab0 msgr2=0x55f0aee9c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.118+0000 7f0cd06de640 1 --2- 172.21.15.114:0/1776105554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f0aee95ab0 0x55f0aee9c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.118+0000 7f0cd06de640 1 -- 172.21.15.114:0/1776105554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb8001e10 con 0x55f0aee8c3e0 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.119+0000 7f0cd06de640 1 --2- 172.21.15.114:0/1776105554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0aee8c3e0 0x55f0aee896b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000f6b0 tx=0x7f0cc000fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.119+0000 7f0ccded9640 1 -- 172.21.15.114:0/1776105554 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0014070 con 0x55f0aee8c3e0 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.119+0000 7f0ccded9640 1 -- 172.21.15.114:0/1776105554 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc0005040 con 0x55f0aee8c3e0 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.119+0000 7f0cd2bdaf40 1 -- 172.21.15.114:0/1776105554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0aed0a390 con 0x55f0aee8c3e0 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.119+0000 7f0ccded9640 1 -- 172.21.15.114:0/1776105554 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc000ed50 con 0x55f0aee8c3e0 2023-11-04T01:38:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.119+0000 7f0cd2bdaf40 1 -- 172.21.15.114:0/1776105554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0aee8b860 con 0x55f0aee8c3e0 2023-11-04T01:38:01.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.120+0000 7f0ccded9640 1 -- 172.21.15.114:0/1776105554 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0cc00233f0 con 0x55f0aee8c3e0 2023-11-04T01:38:01.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.120+0000 7f0ccded9640 1 --2- 172.21.15.114:0/1776105554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0cbc069820 0x7f0cbc06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.121+0000 7f0ccded9640 1 -- 172.21.15.114:0/1776105554 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f0cc00893a0 con 0x55f0aee8c3e0 2023-11-04T01:38:01.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.121+0000 7f0ccfedd640 1 --2- 172.21.15.114:0/1776105554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0cbc069820 0x7f0cbc06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.121+0000 7f0cd2bdaf40 1 -- 172.21.15.114:0/1776105554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- pool_op(delete snap pool 7 tid 1 name snap3 v0) v4 -- 0x55f0aed7b330 con 0x55f0aee8c3e0 2023-11-04T01:38:01.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.121+0000 7f0ccfedd640 1 --2- 172.21.15.114:0/1776105554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0cbc069820 0x7f0cbc06bce0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0cc405c000 tx=0x7f0cc404c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:01.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.695+0000 7f0ccded9640 1 -- 172.21.15.114:0/1776105554 <== mon.0 v2:172.21.15.114:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v41) v1 ==== 43+0+0 (secure 0 0 0) 0x7f0cc0054210 con 0x55f0aee8c3e0 2023-11-04T01:38:01.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.695+0000 7f0ccded9640 1 -- 172.21.15.114:0/1776105554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=41}) v3 -- 0x7f0cbc072570 con 0x55f0aee8c3e0 2023-11-04T01:38:01.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.695+0000 7f0ccded9640 1 -- 172.21.15.114:0/1776105554 <== mon.0 v2:172.21.15.114:3300/0 7 ==== osd_map(41..41 src has 1..41) v4 ==== 643+0+0 (secure 0 0 0) 0x7f0cc00585d0 con 0x55f0aee8c3e0 2023-11-04T01:38:01.697 INFO:teuthology.orchestra.run.smithi114.stdout:removed pool snap-test-pool snap snap3 2023-11-04T01:38:01.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.695+0000 7f0cd2bdaf40 1 -- 172.21.15.114:0/1776105554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0cbc069820 msgr2=0x7f0cbc06bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.695+0000 7f0cd2bdaf40 1 --2- 172.21.15.114:0/1776105554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0cbc069820 0x7f0cbc06bce0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0cc405c000 tx=0x7f0cc404c000 comp rx=0 tx=0).stop 2023-11-04T01:38:01.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.695+0000 7f0cd2bdaf40 1 -- 172.21.15.114:0/1776105554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0aee8c3e0 msgr2=0x55f0aee896b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.695+0000 7f0cd2bdaf40 1 --2- 172.21.15.114:0/1776105554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0aee8c3e0 0x55f0aee896b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000f6b0 tx=0x7f0cc000fb70 comp rx=0 tx=0).stop 2023-11-04T01:38:01.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.695+0000 7f0cd2bdaf40 1 -- 172.21.15.114:0/1776105554 shutdown_connections 2023-11-04T01:38:01.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.695+0000 7f0cd2bdaf40 1 --2- 172.21.15.114:0/1776105554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0cb80030b0 0x55f0aee99c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.695+0000 7f0cd2bdaf40 1 --2- 172.21.15.114:0/1776105554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0cbc069820 0x7f0cbc06bce0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.695+0000 7f0cd2bdaf40 1 --2- 172.21.15.114:0/1776105554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f0aee95ab0 0x55f0aee9c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.695+0000 7f0cd2bdaf40 1 --2- 172.21.15.114:0/1776105554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0aee8c3e0 0x55f0aee896b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.695+0000 7f0cd2bdaf40 1 -- 172.21.15.114:0/1776105554 >> 172.21.15.114:0/1776105554 conn(0x55f0aee09530 msgr2=0x55f0aee90750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:01.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.695+0000 7f0cd2bdaf40 1 -- 172.21.15.114:0/1776105554 shutdown_connections 2023-11-04T01:38:01.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.695+0000 7f0cd2bdaf40 1 -- 172.21.15.114:0/1776105554 wait complete. 2023-11-04T01:38:01.700 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete snap-test-pool 2023-11-04T01:38:01.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.846+0000 7faf1294c640 1 Processor -- start 2023-11-04T01:38:01.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.846+0000 7faf1294c640 1 -- start start 2023-11-04T01:38:01.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.847+0000 7faf1294c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7faf0c15d1b0 0x7faf0c0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.847+0000 7faf1294c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf0c066000 0x7faf0c06a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.847+0000 7faf1294c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0c0c9bf0 con 0x7faf0c070ff0 2023-11-04T01:38:01.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.847+0000 7faf1294c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0c0cd890 con 0x7faf0c066000 2023-11-04T01:38:01.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.847+0000 7faf1294c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0c0cdb30 con 0x7faf0c15d1b0 2023-11-04T01:38:01.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.847+0000 7faf10ee9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf0c066000 0x7faf0c06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.847+0000 7faf10ee9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf0c066000 0x7faf0c06a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42992/0 (socket says 172.21.15.114:42992) 2023-11-04T01:38:01.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.847+0000 7faf10ee9640 1 -- 172.21.15.114:0/2171601480 learned_addr learned my addr 172.21.15.114:0/2171601480 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:01.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.847+0000 7faf0b7fe640 1 --2- 172.21.15.114:0/2171601480 >> v2:172.21.15.141:3300/0 conn(0x7faf0c15d1b0 0x7faf0c0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.848+0000 7faf10ee9640 1 -- 172.21.15.114:0/2171601480 >> v2:172.21.15.141:3300/0 conn(0x7faf0c15d1b0 msgr2=0x7faf0c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:01.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.848+0000 7faf10ee9640 1 --2- 172.21.15.114:0/2171601480 >> v2:172.21.15.141:3300/0 conn(0x7faf0c15d1b0 0x7faf0c0cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.848+0000 7faf10ee9640 1 -- 172.21.15.114:0/2171601480 >> v1:172.21.15.141:6789/0 conn(0x7faf0c070ff0 legacy=0x7faf0c0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.848+0000 7faf10ee9640 1 -- 172.21.15.114:0/2171601480 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c0cde10 con 0x7faf0c066000 2023-11-04T01:38:01.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.848+0000 7faf10ee9640 1 --2- 172.21.15.114:0/2171601480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0c066000 0x7faf0c06a500 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7faf0c161b90 tx=0x7faf0402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43826ca5c14d642f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:01.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.848+0000 7faf0affd640 1 -- 172.21.15.114:0/2171601480 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0402cb20 con 0x7faf0c066000 2023-11-04T01:38:01.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.849+0000 7faf0affd640 1 -- 172.21.15.114:0/2171601480 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0402cc80 con 0x7faf0c066000 2023-11-04T01:38:01.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.849+0000 7faf0affd640 1 -- 172.21.15.114:0/2171601480 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf040343f0 con 0x7faf0c066000 2023-11-04T01:38:01.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.849+0000 7faf1294c640 1 -- 172.21.15.114:0/2171601480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0c066000 msgr2=0x7faf0c06a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.849+0000 7faf1294c640 1 --2- 172.21.15.114:0/2171601480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0c066000 0x7faf0c06a500 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7faf0c161b90 tx=0x7faf0402bf80 comp rx=0 tx=0).stop 2023-11-04T01:38:01.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.849+0000 7faf1294c640 1 -- 172.21.15.114:0/2171601480 shutdown_connections 2023-11-04T01:38:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.849+0000 7faf1294c640 1 --2- 172.21.15.114:0/2171601480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0c066000 0x7faf0c06a500 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.849+0000 7faf1294c640 1 --2- 172.21.15.114:0/2171601480 >> v2:172.21.15.141:3300/0 conn(0x7faf0c15d1b0 0x7faf0c0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.849+0000 7faf1294c640 1 -- 172.21.15.114:0/2171601480 >> 172.21.15.114:0/2171601480 conn(0x7faf0c0cbc90 msgr2=0x7faf0c0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.849+0000 7faf1294c640 1 -- 172.21.15.114:0/2171601480 shutdown_connections 2023-11-04T01:38:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.849+0000 7faf1294c640 1 -- 172.21.15.114:0/2171601480 wait complete. 2023-11-04T01:38:01.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.850+0000 7faf1294c640 1 Processor -- start 2023-11-04T01:38:01.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.850+0000 7faf1294c640 1 -- start start 2023-11-04T01:38:01.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.851+0000 7faf1294c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0c066000 0x7faf0c0c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.851+0000 7faf1294c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf0c070ff0 0x7faf0c14b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.851+0000 7faf1294c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faf0c15d1b0 0x7faf0c0c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.851+0000 7faf1294c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c0c5870 con 0x7faf0c066000 2023-11-04T01:38:01.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.851+0000 7faf1294c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c0c5b50 con 0x7faf0c070ff0 2023-11-04T01:38:01.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.851+0000 7faf1294c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c0c6430 con 0x7faf0c15d1b0 2023-11-04T01:38:01.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.851+0000 7faf0bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0c066000 0x7faf0c0c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.851+0000 7faf0bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0c066000 0x7faf0c0c51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42994/0 (socket says 172.21.15.114:42994) 2023-11-04T01:38:01.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.851+0000 7faf0bfff640 1 -- 172.21.15.114:0/850696653 learned_addr learned my addr 172.21.15.114:0/850696653 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.851+0000 7faf0b7fe640 1 --2- 172.21.15.114:0/850696653 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf0c070ff0 0x7faf0c14b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.851+0000 7faf10ee9640 1 --2- 172.21.15.114:0/850696653 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faf0c15d1b0 0x7faf0c0c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.851+0000 7faf0bfff640 1 -- 172.21.15.114:0/850696653 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faf0c15d1b0 msgr2=0x7faf0c0c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.851+0000 7faf0bfff640 1 --2- 172.21.15.114:0/850696653 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faf0c15d1b0 0x7faf0c0c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.851+0000 7faf0bfff640 1 -- 172.21.15.114:0/850696653 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf0c070ff0 msgr2=0x7faf0c14b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.851+0000 7faf0bfff640 1 --2- 172.21.15.114:0/850696653 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf0c070ff0 0x7faf0c14b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.852+0000 7faf0bfff640 1 -- 172.21.15.114:0/850696653 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf04009b30 con 0x7faf0c066000 2023-11-04T01:38:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.852+0000 7faf0bfff640 1 --2- 172.21.15.114:0/850696653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0c066000 0x7faf0c0c51e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7faefc00c450 tx=0x7faefc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:01.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.852+0000 7faf08ff9640 1 -- 172.21.15.114:0/850696653 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0052d0 con 0x7faf0c066000 2023-11-04T01:38:01.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.852+0000 7faf08ff9640 1 -- 172.21.15.114:0/850696653 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc005430 con 0x7faf0c066000 2023-11-04T01:38:01.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.852+0000 7faf1294c640 1 -- 172.21.15.114:0/850696653 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0c0c6710 con 0x7faf0c066000 2023-11-04T01:38:01.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.852+0000 7faf08ff9640 1 -- 172.21.15.114:0/850696653 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc012870 con 0x7faf0c066000 2023-11-04T01:38:01.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.852+0000 7faf1294c640 1 -- 172.21.15.114:0/850696653 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c157220 con 0x7faf0c066000 2023-11-04T01:38:01.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.853+0000 7faf1294c640 1 -- 172.21.15.114:0/850696653 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0c074290 con 0x7faf0c066000 2023-11-04T01:38:01.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.853+0000 7faf08ff9640 1 -- 172.21.15.114:0/850696653 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faefc0129d0 con 0x7faf0c066000 2023-11-04T01:38:01.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.854+0000 7faf08ff9640 1 --2- 172.21.15.114:0/850696653 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faeec06ae70 0x7faeec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:01.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.854+0000 7faf08ff9640 1 -- 172.21.15.114:0/850696653 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7faefc089430 con 0x7faf0c066000 2023-11-04T01:38:01.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.854+0000 7faf0b7fe640 1 --2- 172.21.15.114:0/850696653 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faeec06ae70 0x7faeec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:01.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.854+0000 7faf0b7fe640 1 --2- 172.21.15.114:0/850696653 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faeec06ae70 0x7faeec06d330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faf0c1f5ed0 tx=0x7faef4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:01.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:01.858+0000 7faf08ff9640 1 -- 172.21.15.114:0/850696653 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faefc054200 con 0x7faf0c066000 2023-11-04T01:38:02.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.029+0000 7faf1294c640 1 -- 172.21.15.114:0/850696653 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "snap-test-pool"} v 0) v1 -- 0x7faf0c06b660 con 0x7faf0c066000 2023-11-04T01:38:02.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.030+0000 7faf08ff9640 1 -- 172.21.15.114:0/850696653 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "snap-test-pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool snap-test-pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v41) v1 ==== 296+0+0 (secure 0 0 0) 0x7faefc057820 con 0x7faf0c066000 2023-11-04T01:38:02.032 INFO:teuthology.orchestra.run.smithi114.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool snap-test-pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:38:02.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:02.037 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:38:02.037 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:02.080 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:02.135 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:38:02.135 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:38:02.135 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:02.151 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:02.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.289+0000 7f6701d41640 1 Processor -- start 2023-11-04T01:38:02.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.289+0000 7f6701d41640 1 -- start start 2023-11-04T01:38:02.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.289+0000 7f6701d41640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66fc0ce240 0x7f66fc157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.289+0000 7f6701d41640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f66fc157540 0x7f66fc0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.289+0000 7f6701d41640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66fc15e000 con 0x7f66fc0cde60 2023-11-04T01:38:02.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.289+0000 7f6701d41640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc15e5c0 con 0x7f66fc157540 2023-11-04T01:38:02.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.289+0000 7f6701d41640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc15e2e0 con 0x7f66fc0ce240 2023-11-04T01:38:02.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.290+0000 7f66fbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f66fc157540 0x7f66fc0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.290+0000 7f66fb7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f66fc0cde60 0x7f66fc15d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60598/0 (socket says 172.21.15.114:60598) 2023-11-04T01:38:02.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.290+0000 7f66fb7fe640 1 -- 172.21.15.114:0/4222282686 learned_addr learned my addr 172.21.15.114:0/4222282686 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:02.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.290+0000 7f66faffd640 1 --2- 172.21.15.114:0/4222282686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66fc0ce240 0x7f66fc157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.290+0000 7f66fbfff640 1 -- 172.21.15.114:0/4222282686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66fc0ce240 msgr2=0x7f66fc157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:02.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.290+0000 7f66fbfff640 1 --2- 172.21.15.114:0/4222282686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66fc0ce240 0x7f66fc157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.290+0000 7f66fbfff640 1 -- 172.21.15.114:0/4222282686 >> v1:172.21.15.114:6789/0 conn(0x7f66fc0cde60 legacy=0x7f66fc15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.290+0000 7f66fa7fc640 1 -- 172.21.15.114:0/4222282686 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435384566 0 0) 0x7f66fc15e000 con 0x7f66fc0cde60 2023-11-04T01:38:02.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.290+0000 7f66fbfff640 1 -- 172.21.15.114:0/4222282686 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc0d1120 con 0x7f66fc157540 2023-11-04T01:38:02.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.290+0000 7f66faffd640 1 --2- 172.21.15.114:0/4222282686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66fc0ce240 0x7f66fc157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:02.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.291+0000 7f66fbfff640 1 --2- 172.21.15.114:0/4222282686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66fc157540 0x7f66fc0d1920 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009d90 tx=0x7f66f402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ed820794352cb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:02.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.291+0000 7f66fa7fc640 1 -- 172.21.15.114:0/4222282686 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f402cc50 con 0x7f66fc157540 2023-11-04T01:38:02.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.291+0000 7f66fa7fc640 1 -- 172.21.15.114:0/4222282686 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f402cdb0 con 0x7f66fc157540 2023-11-04T01:38:02.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.291+0000 7f66fa7fc640 1 -- 172.21.15.114:0/4222282686 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4034660 con 0x7f66fc157540 2023-11-04T01:38:02.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.291+0000 7f6701d41640 1 -- 172.21.15.114:0/4222282686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66fc157540 msgr2=0x7f66fc0d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.291+0000 7f6701d41640 1 --2- 172.21.15.114:0/4222282686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66fc157540 0x7f66fc0d1920 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009d90 tx=0x7f66f402bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.291+0000 7f6701d41640 1 -- 172.21.15.114:0/4222282686 shutdown_connections 2023-11-04T01:38:02.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.291+0000 7f6701d41640 1 --2- 172.21.15.114:0/4222282686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66fc157540 0x7f66fc0d1920 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.291+0000 7f6701d41640 1 --2- 172.21.15.114:0/4222282686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66fc0ce240 0x7f66fc157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.291+0000 7f6701d41640 1 -- 172.21.15.114:0/4222282686 >> 172.21.15.114:0/4222282686 conn(0x7f66fc071f30 msgr2=0x7f66fc0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:02.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.291+0000 7f6701d41640 1 -- 172.21.15.114:0/4222282686 shutdown_connections 2023-11-04T01:38:02.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.291+0000 7f6701d41640 1 -- 172.21.15.114:0/4222282686 wait complete. 2023-11-04T01:38:02.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.292+0000 7f6701d41640 1 Processor -- start 2023-11-04T01:38:02.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.293+0000 7f6701d41640 1 -- start start 2023-11-04T01:38:02.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.293+0000 7f6701d41640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66fc0cde60 0x7f66fc14e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.293+0000 7f6701d41640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66fc0ce240 0x7f66fc0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.293+0000 7f6701d41640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66fc157540 0x7f66fc0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.293+0000 7f6701d41640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc14e680 con 0x7f66fc0cde60 2023-11-04T01:38:02.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.293+0000 7f6701d41640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc159940 con 0x7f66fc0ce240 2023-11-04T01:38:02.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.293+0000 7f6701d41640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc159c20 con 0x7f66fc157540 2023-11-04T01:38:02.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.293+0000 7f66fb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66fc0cde60 0x7f66fc14e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.293+0000 7f66fb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66fc0cde60 0x7f66fc14e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43010/0 (socket says 172.21.15.114:43010) 2023-11-04T01:38:02.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.293+0000 7f66fb7fe640 1 -- 172.21.15.114:0/614773995 learned_addr learned my addr 172.21.15.114:0/614773995 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:02.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.294+0000 7f66fbfff640 1 --2- 172.21.15.114:0/614773995 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66fc157540 0x7f66fc0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.294+0000 7f66faffd640 1 --2- 172.21.15.114:0/614773995 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66fc0ce240 0x7f66fc0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.294+0000 7f66fb7fe640 1 -- 172.21.15.114:0/614773995 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66fc157540 msgr2=0x7f66fc0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.294+0000 7f66fb7fe640 1 --2- 172.21.15.114:0/614773995 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66fc157540 0x7f66fc0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.294+0000 7f66fb7fe640 1 -- 172.21.15.114:0/614773995 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66fc0ce240 msgr2=0x7f66fc0cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.294+0000 7f66fb7fe640 1 --2- 172.21.15.114:0/614773995 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66fc0ce240 0x7f66fc0cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.294+0000 7f66fb7fe640 1 -- 172.21.15.114:0/614773995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f4009a70 con 0x7f66fc0cde60 2023-11-04T01:38:02.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.294+0000 7f66faffd640 1 --2- 172.21.15.114:0/614773995 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66fc0ce240 0x7f66fc0cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:02.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.294+0000 7f66fb7fe640 1 --2- 172.21.15.114:0/614773995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66fc0cde60 0x7f66fc14e140 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f66f000c4d0 tx=0x7f66f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:02.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.294+0000 7f66e3fff640 1 -- 172.21.15.114:0/614773995 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f00074e0 con 0x7f66fc0cde60 2023-11-04T01:38:02.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.294+0000 7f66e3fff640 1 -- 172.21.15.114:0/614773995 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f0007660 con 0x7f66fc0cde60 2023-11-04T01:38:02.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.294+0000 7f6701d41640 1 -- 172.21.15.114:0/614773995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66fc159f00 con 0x7f66fc0cde60 2023-11-04T01:38:02.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.294+0000 7f66e3fff640 1 -- 172.21.15.114:0/614773995 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0004a20 con 0x7f66fc0cde60 2023-11-04T01:38:02.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.294+0000 7f6701d41640 1 -- 172.21.15.114:0/614773995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc15a4c0 con 0x7f66fc0cde60 2023-11-04T01:38:02.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.295+0000 7f6701d41640 1 -- 172.21.15.114:0/614773995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66fc15a6e0 con 0x7f66fc0cde60 2023-11-04T01:38:02.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.295+0000 7f66e3fff640 1 -- 172.21.15.114:0/614773995 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f66f0004b80 con 0x7f66fc0cde60 2023-11-04T01:38:02.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.296+0000 7f66e3fff640 1 --2- 172.21.15.114:0/614773995 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f66e806ae70 0x7f66e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.296+0000 7f66faffd640 1 --2- 172.21.15.114:0/614773995 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f66e806ae70 0x7f66e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.296+0000 7f66e3fff640 1 -- 172.21.15.114:0/614773995 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f66f0088e20 con 0x7f66fc0cde60 2023-11-04T01:38:02.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.296+0000 7f66faffd640 1 --2- 172.21.15.114:0/614773995 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f66e806ae70 0x7f66e806d330 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f66ec006fd0 tx=0x7f66ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:02.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.300+0000 7f66e3fff640 1 -- 172.21.15.114:0/614773995 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f66f0053bf0 con 0x7f66fc0cde60 2023-11-04T01:38:02.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.470+0000 7f6701d41640 1 -- 172.21.15.114:0/614773995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66fc074290 con 0x7f66fc0cde60 2023-11-04T01:38:02.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.471+0000 7f66e3fff640 1 -- 172.21.15.114:0/614773995 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18673 (secure 0 0 0) 0x7f66f0018020 con 0x7f66fc0cde60 2023-11-04T01:38:02.473 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:02.474 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":41,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:01.692133+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:48.832988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:49.974993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.473+0000 7f6701d41640 1 -- 172.21.15.114:0/614773995 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f66e806ae70 msgr2=0x7f66e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.473+0000 7f6701d41640 1 --2- 172.21.15.114:0/614773995 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f66e806ae70 0x7f66e806d330 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f66ec006fd0 tx=0x7f66ec008040 comp rx=0 tx=0).stop 2023-11-04T01:38:02.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.473+0000 7f6701d41640 1 -- 172.21.15.114:0/614773995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66fc0cde60 msgr2=0x7f66fc14e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.473+0000 7f6701d41640 1 --2- 172.21.15.114:0/614773995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66fc0cde60 0x7f66fc14e140 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f66f000c4d0 tx=0x7f66f000c990 comp rx=0 tx=0).stop 2023-11-04T01:38:02.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.473+0000 7f6701d41640 1 -- 172.21.15.114:0/614773995 shutdown_connections 2023-11-04T01:38:02.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.473+0000 7f6701d41640 1 --2- 172.21.15.114:0/614773995 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66fc157540 0x7f66fc0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.473+0000 7f6701d41640 1 --2- 172.21.15.114:0/614773995 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f66e806ae70 0x7f66e806d330 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.473+0000 7f6701d41640 1 --2- 172.21.15.114:0/614773995 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66fc0ce240 0x7f66fc0cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.473+0000 7f6701d41640 1 --2- 172.21.15.114:0/614773995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66fc0cde60 0x7f66fc14e140 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.473+0000 7f6701d41640 1 -- 172.21.15.114:0/614773995 >> 172.21.15.114:0/614773995 conn(0x7f66fc071f30 msgr2=0x7f66fc0cd130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:02.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.473+0000 7f6701d41640 1 -- 172.21.15.114:0/614773995 shutdown_connections 2023-11-04T01:38:02.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.474+0000 7f6701d41640 1 -- 172.21.15.114:0/614773995 wait complete. 2023-11-04T01:38:02.486 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:37:48.832988+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:37:49.974993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:02.487 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:02.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.587+0000 7f7a1e533640 1 Processor -- start 2023-11-04T01:38:02.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.587+0000 7f7a1e533640 1 -- start start 2023-11-04T01:38:02.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.588+0000 7f7a1e533640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a1806cbd0 0x7f7a1806e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.588+0000 7f7a1e533640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a18067090 0x7f7a180b2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.588+0000 7f7a1e533640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a180b24f0 con 0x7f7a1815b140 2023-11-04T01:38:02.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.588+0000 7f7a1e533640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a180ce220 con 0x7f7a1806cbd0 2023-11-04T01:38:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.588+0000 7f7a1e533640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a180cdc60 con 0x7f7a18067090 2023-11-04T01:38:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.588+0000 7f7a17fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a1806cbd0 0x7f7a1806e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.588+0000 7f7a17fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a1806cbd0 0x7f7a1806e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43022/0 (socket says 172.21.15.114:43022) 2023-11-04T01:38:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.588+0000 7f7a17fff640 1 -- 172.21.15.114:0/2999793011 learned_addr learned my addr 172.21.15.114:0/2999793011 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.588+0000 7f7a17fff640 1 -- 172.21.15.114:0/2999793011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a18067090 msgr2=0x7f7a180b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.588+0000 7f7a17fff640 1 --2- 172.21.15.114:0/2999793011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a18067090 0x7f7a180b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.588+0000 7f7a17fff640 1 -- 172.21.15.114:0/2999793011 >> v1:172.21.15.141:6789/0 conn(0x7f7a1815b140 legacy=0x7f7a1806cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.588+0000 7f7a17fff640 1 -- 172.21.15.114:0/2999793011 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a180cdf40 con 0x7f7a1806cbd0 2023-11-04T01:38:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.589+0000 7f7a17fff640 1 --2- 172.21.15.114:0/2999793011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a1806cbd0 0x7f7a1806e180 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009870 tx=0x7f7a0802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cbe152ef406420 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.589+0000 7f7a16ffd640 1 -- 172.21.15.114:0/2999793011 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a080317c0 con 0x7f7a1806cbd0 2023-11-04T01:38:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.589+0000 7f7a16ffd640 1 -- 172.21.15.114:0/2999793011 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a08031920 con 0x7f7a1806cbd0 2023-11-04T01:38:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.589+0000 7f7a16ffd640 1 -- 172.21.15.114:0/2999793011 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a08031cb0 con 0x7f7a1806cbd0 2023-11-04T01:38:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.590+0000 7f7a1e533640 1 -- 172.21.15.114:0/2999793011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a1806cbd0 msgr2=0x7f7a1806e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.590+0000 7f7a1e533640 1 --2- 172.21.15.114:0/2999793011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a1806cbd0 0x7f7a1806e180 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009870 tx=0x7f7a0802b860 comp rx=0 tx=0).stop 2023-11-04T01:38:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.590+0000 7f7a1e533640 1 -- 172.21.15.114:0/2999793011 shutdown_connections 2023-11-04T01:38:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.590+0000 7f7a1e533640 1 --2- 172.21.15.114:0/2999793011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a18067090 0x7f7a180b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.590+0000 7f7a1e533640 1 --2- 172.21.15.114:0/2999793011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a1806cbd0 0x7f7a1806e180 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.590+0000 7f7a1e533640 1 -- 172.21.15.114:0/2999793011 >> 172.21.15.114:0/2999793011 conn(0x7f7a1806a120 msgr2=0x7f7a1806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.590+0000 7f7a1e533640 1 -- 172.21.15.114:0/2999793011 shutdown_connections 2023-11-04T01:38:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.590+0000 7f7a1e533640 1 -- 172.21.15.114:0/2999793011 wait complete. 2023-11-04T01:38:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.591+0000 7f7a1e533640 1 Processor -- start 2023-11-04T01:38:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.591+0000 7f7a1e533640 1 -- start start 2023-11-04T01:38:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.592+0000 7f7a1e533640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a18067090 0x7f7a1815c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.592+0000 7f7a1e533640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7a1806cbd0 0x7f7a181481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.592+0000 7f7a1e533640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a1815b140 0x7f7a180c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.592+0000 7f7a1e533640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1815c790 con 0x7f7a1815b140 2023-11-04T01:38:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.592+0000 7f7a1e533640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1815b520 con 0x7f7a1806cbd0 2023-11-04T01:38:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.592+0000 7f7a1e533640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a18148730 con 0x7f7a18067090 2023-11-04T01:38:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.592+0000 7f7a1cad0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a1815b140 0x7f7a180c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.592+0000 7f7a1cad0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a1815b140 0x7f7a180c42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43034/0 (socket says 172.21.15.114:43034) 2023-11-04T01:38:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.592+0000 7f7a1cad0640 1 -- 172.21.15.114:0/704906984 learned_addr learned my addr 172.21.15.114:0/704906984 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.592+0000 7f7a177fe640 1 --2- 172.21.15.114:0/704906984 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7a1806cbd0 0x7f7a181481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.592+0000 7f7a17fff640 1 --2- 172.21.15.114:0/704906984 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a18067090 0x7f7a1815c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.592+0000 7f7a1cad0640 1 -- 172.21.15.114:0/704906984 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a18067090 msgr2=0x7f7a1815c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.592+0000 7f7a1cad0640 1 --2- 172.21.15.114:0/704906984 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a18067090 0x7f7a1815c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.592+0000 7f7a1cad0640 1 -- 172.21.15.114:0/704906984 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7a1806cbd0 msgr2=0x7f7a181481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.592+0000 7f7a1cad0640 1 --2- 172.21.15.114:0/704906984 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7a1806cbd0 0x7f7a181481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.592+0000 7f7a1cad0640 1 -- 172.21.15.114:0/704906984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a080094d0 con 0x7f7a1815b140 2023-11-04T01:38:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.593+0000 7f7a1cad0640 1 --2- 172.21.15.114:0/704906984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a1815b140 0x7f7a180c42f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000b9e0 tx=0x7f7a1000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.593+0000 7f7a14ff9640 1 -- 172.21.15.114:0/704906984 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1000cb20 con 0x7f7a1815b140 2023-11-04T01:38:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.593+0000 7f7a14ff9640 1 -- 172.21.15.114:0/704906984 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1000cc80 con 0x7f7a1815b140 2023-11-04T01:38:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.593+0000 7f7a14ff9640 1 -- 172.21.15.114:0/704906984 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a10014440 con 0x7f7a1815b140 2023-11-04T01:38:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.593+0000 7f7a1e533640 1 -- 172.21.15.114:0/704906984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a180c4db0 con 0x7f7a1815b140 2023-11-04T01:38:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.593+0000 7f7a1e533640 1 -- 172.21.15.114:0/704906984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1815ba50 con 0x7f7a1815b140 2023-11-04T01:38:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.594+0000 7f7a1e533640 1 -- 172.21.15.114:0/704906984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a18074290 con 0x7f7a1815b140 2023-11-04T01:38:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.594+0000 7f7a14ff9640 1 -- 172.21.15.114:0/704906984 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a1001d3b0 con 0x7f7a1815b140 2023-11-04T01:38:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.595+0000 7f7a14ff9640 1 --2- 172.21.15.114:0/704906984 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a0406ae70 0x7f7a0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.595+0000 7f7a17fff640 1 --2- 172.21.15.114:0/704906984 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a0406ae70 0x7f7a0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.595+0000 7f7a14ff9640 1 -- 172.21.15.114:0/704906984 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f7a10089800 con 0x7f7a1815b140 2023-11-04T01:38:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.595+0000 7f7a17fff640 1 --2- 172.21.15.114:0/704906984 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a0406ae70 0x7f7a0406d330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7a08036000 tx=0x7f7a0803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.599+0000 7f7a14ff9640 1 -- 172.21.15.114:0/704906984 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a100545d0 con 0x7f7a1815b140 2023-11-04T01:38:02.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.765+0000 7f7a1e533640 1 -- 172.21.15.114:0/704906984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a180b4bb0 con 0x7f7a1815b140 2023-11-04T01:38:02.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.765+0000 7f7a14ff9640 1 -- 172.21.15.114:0/704906984 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a100190a0 con 0x7f7a1815b140 2023-11-04T01:38:02.767 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:38:02.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.767+0000 7f7a1e533640 1 -- 172.21.15.114:0/704906984 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a0406ae70 msgr2=0x7f7a0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.767+0000 7f7a1e533640 1 --2- 172.21.15.114:0/704906984 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a0406ae70 0x7f7a0406d330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7a08036000 tx=0x7f7a0803d040 comp rx=0 tx=0).stop 2023-11-04T01:38:02.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.767+0000 7f7a1e533640 1 -- 172.21.15.114:0/704906984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a1815b140 msgr2=0x7f7a180c42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.767+0000 7f7a1e533640 1 --2- 172.21.15.114:0/704906984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a1815b140 0x7f7a180c42f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000b9e0 tx=0x7f7a1000bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.767+0000 7f7a1e533640 1 -- 172.21.15.114:0/704906984 shutdown_connections 2023-11-04T01:38:02.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.767+0000 7f7a1e533640 1 --2- 172.21.15.114:0/704906984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a1815b140 0x7f7a180c42f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.767+0000 7f7a1e533640 1 --2- 172.21.15.114:0/704906984 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a0406ae70 0x7f7a0406d330 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.767+0000 7f7a1e533640 1 --2- 172.21.15.114:0/704906984 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7a1806cbd0 0x7f7a181481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.767+0000 7f7a1e533640 1 --2- 172.21.15.114:0/704906984 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a18067090 0x7f7a1815c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.767+0000 7f7a1e533640 1 -- 172.21.15.114:0/704906984 >> 172.21.15.114:0/704906984 conn(0x7f7a1806a120 msgr2=0x7f7a18157ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:02.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.767+0000 7f7a1e533640 1 -- 172.21.15.114:0/704906984 shutdown_connections 2023-11-04T01:38:02.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.767+0000 7f7a1e533640 1 -- 172.21.15.114:0/704906984 wait complete. 2023-11-04T01:38:02.780 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:38:02.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.881+0000 7f7060c26640 1 Processor -- start 2023-11-04T01:38:02.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.881+0000 7f7060c26640 1 -- start start 2023-11-04T01:38:02.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f7060c26640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f705c070e20 0x7f705c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f7060c26640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f705c0ad730 0x7f705c15e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f7060c26640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705c0c3900 con 0x7f705c15ad30 2023-11-04T01:38:02.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f7060c26640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c0ae260 con 0x7f705c0ad730 2023-11-04T01:38:02.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f7060c26640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0c3be0 con 0x7f705c070e20 2023-11-04T01:38:02.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f705a59c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f705c15ad30 0x7f705c070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60604/0 (socket says 172.21.15.114:60604) 2023-11-04T01:38:02.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f705a59c640 1 -- 172.21.15.114:0/2894028246 learned_addr learned my addr 172.21.15.114:0/2894028246 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:02.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f705ad9d640 1 --2- 172.21.15.114:0/2894028246 >> v2:172.21.15.141:3300/0 conn(0x7f705c0ad730 0x7f705c15e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f7059d9b640 1 --2- 172.21.15.114:0/2894028246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f705c070e20 0x7f705c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f705959a640 1 -- 172.21.15.114:0/2894028246 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206904645 0 0) 0x7f705c0c3900 con 0x7f705c15ad30 2023-11-04T01:38:02.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f705959a640 1 -- 172.21.15.114:0/2894028246 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7044003520 con 0x7f705c15ad30 2023-11-04T01:38:02.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f705959a640 1 -- 172.21.15.114:0/2894028246 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 339479576 0 0) 0x7f7044003520 con 0x7f705c15ad30 2023-11-04T01:38:02.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f705959a640 1 -- 172.21.15.114:0/2894028246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f705c070e20 msgr2=0x7f705c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:02.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f705959a640 1 --2- 172.21.15.114:0/2894028246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f705c070e20 0x7f705c0adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f705959a640 1 -- 172.21.15.114:0/2894028246 >> v2:172.21.15.141:3300/0 conn(0x7f705c0ad730 msgr2=0x7f705c15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:02.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f705959a640 1 --2- 172.21.15.114:0/2894028246 >> v2:172.21.15.141:3300/0 conn(0x7f705c0ad730 0x7f705c15e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f705959a640 1 -- 172.21.15.114:0/2894028246 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0c3ec0 con 0x7f705c15ad30 2023-11-04T01:38:02.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f705959a640 1 -- 172.21.15.114:0/2894028246 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f704c001670 con 0x7f705c15ad30 2023-11-04T01:38:02.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f7059d9b640 1 --2- 172.21.15.114:0/2894028246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f705c070e20 0x7f705c0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:02.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f705959a640 1 -- 172.21.15.114:0/2894028246 >> v1:172.21.15.114:6789/0 conn(0x7f705c15ad30 legacy=0x7f705c070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f705959a640 1 --2- 172.21.15.114:0/2894028246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7044003970 0x7f7044003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.882+0000 7f705959a640 1 --2- 172.21.15.114:0/2894028246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f705c070e20 0x7f70440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.883+0000 7f705959a640 1 --2- 172.21.15.114:0/2894028246 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7044004d00 0x7f7044005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.883+0000 7f705959a640 1 -- 172.21.15.114:0/2894028246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0ae260 con 0x7f7044003970 2023-11-04T01:38:02.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.883+0000 7f705959a640 1 -- 172.21.15.114:0/2894028246 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0c3be0 con 0x7f7044004d00 2023-11-04T01:38:02.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.883+0000 7f705959a640 1 -- 172.21.15.114:0/2894028246 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704400b980 con 0x7f705c070e20 2023-11-04T01:38:02.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.883+0000 7f705a59c640 1 --2- 172.21.15.114:0/2894028246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7044003970 0x7f7044003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.883+0000 7f7059d9b640 1 --2- 172.21.15.114:0/2894028246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f705c070e20 0x7f70440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.883+0000 7f705ad9d640 1 --2- 172.21.15.114:0/2894028246 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7044004d00 0x7f7044005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.883+0000 7f705a59c640 1 -- 172.21.15.114:0/2894028246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f705c070e20 msgr2=0x7f70440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:02.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.883+0000 7f705a59c640 1 --2- 172.21.15.114:0/2894028246 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f705c070e20 0x7f70440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.883+0000 7f705a59c640 1 -- 172.21.15.114:0/2894028246 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7044004d00 msgr2=0x7f7044005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:02.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.883+0000 7f705a59c640 1 --2- 172.21.15.114:0/2894028246 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7044004d00 0x7f7044005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.883+0000 7f705a59c640 1 -- 172.21.15.114:0/2894028246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0c3ec0 con 0x7f7044003970 2023-11-04T01:38:02.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.883+0000 7f705ad9d640 1 --2- 172.21.15.114:0/2894028246 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7044004d00 0x7f7044005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:02.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.884+0000 7f705a59c640 1 --2- 172.21.15.114:0/2894028246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7044003970 0x7f7044003d90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f704c00c340 tx=0x7f70440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a8392dd7e67cf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:02.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.884+0000 7f705959a640 1 -- 172.21.15.114:0/2894028246 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c02cbb0 con 0x7f7044003970 2023-11-04T01:38:02.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.884+0000 7f705959a640 1 -- 172.21.15.114:0/2894028246 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c02cd30 con 0x7f7044003970 2023-11-04T01:38:02.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.884+0000 7f705959a640 1 -- 172.21.15.114:0/2894028246 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c02cea0 con 0x7f7044003970 2023-11-04T01:38:02.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.884+0000 7f7060c26640 1 -- 172.21.15.114:0/2894028246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7044003970 msgr2=0x7f7044003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.884+0000 7f7060c26640 1 --2- 172.21.15.114:0/2894028246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7044003970 0x7f7044003d90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f704c00c340 tx=0x7f70440057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.884+0000 7f705ad9d640 1 -- 172.21.15.114:0/2894028246 reap_dead start 2023-11-04T01:38:02.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.885+0000 7f7060c26640 1 -- 172.21.15.114:0/2894028246 shutdown_connections 2023-11-04T01:38:02.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.885+0000 7f7060c26640 1 -- 172.21.15.114:0/2894028246 >> 172.21.15.114:0/2894028246 conn(0x7f705c0ce950 msgr2=0x7f705c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:02.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.885+0000 7f7060c26640 1 -- 172.21.15.114:0/2894028246 shutdown_connections 2023-11-04T01:38:02.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.885+0000 7f7060c26640 1 -- 172.21.15.114:0/2894028246 wait complete. 2023-11-04T01:38:02.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.886+0000 7f7060c26640 1 Processor -- start 2023-11-04T01:38:02.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.886+0000 7f7060c26640 1 -- start start 2023-11-04T01:38:02.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f7060c26640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7044003970 0x7f705c15b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f7060c26640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f705c153860 0x7f705c15d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f7060c26640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f705c15d570 0x7f705c142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f7060c26640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c15dfe0 con 0x7f7044003970 2023-11-04T01:38:02.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f7060c26640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c15da20 con 0x7f705c153860 2023-11-04T01:38:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f7060c26640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c15dd00 con 0x7f705c15d570 2023-11-04T01:38:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f705a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7044003970 0x7f705c15b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f705a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7044003970 0x7f705c15b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43054/0 (socket says 172.21.15.114:43054) 2023-11-04T01:38:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f705a59c640 1 -- 172.21.15.114:0/1900168713 learned_addr learned my addr 172.21.15.114:0/1900168713 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f7059d9b640 1 --2- 172.21.15.114:0/1900168713 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f705c153860 0x7f705c15d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f705ad9d640 1 --2- 172.21.15.114:0/1900168713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f705c15d570 0x7f705c142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f705a59c640 1 -- 172.21.15.114:0/1900168713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f705c15d570 msgr2=0x7f705c142f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f705a59c640 1 --2- 172.21.15.114:0/1900168713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f705c15d570 0x7f705c142f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f705a59c640 1 -- 172.21.15.114:0/1900168713 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f705c153860 msgr2=0x7f705c15d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f705a59c640 1 --2- 172.21.15.114:0/1900168713 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f705c153860 0x7f705c15d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f705a59c640 1 -- 172.21.15.114:0/1900168713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0b14e0 con 0x7f7044003970 2023-11-04T01:38:02.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f705a59c640 1 --2- 172.21.15.114:0/1900168713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7044003970 0x7f705c15b1a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f704c00c460 tx=0x7f704c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f704affd640 1 -- 172.21.15.114:0/1900168713 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c02cea0 con 0x7f7044003970 2023-11-04T01:38:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f704affd640 1 -- 172.21.15.114:0/1900168713 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c007270 con 0x7f7044003970 2023-11-04T01:38:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f7060c26640 1 -- 172.21.15.114:0/1900168713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f705c0b17c0 con 0x7f7044003970 2023-11-04T01:38:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.887+0000 7f704affd640 1 -- 172.21.15.114:0/1900168713 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c0075e0 con 0x7f7044003970 2023-11-04T01:38:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.888+0000 7f7060c26640 1 -- 172.21.15.114:0/1900168713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705c1434d0 con 0x7f7044003970 2023-11-04T01:38:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.888+0000 7f7060c26640 1 -- 172.21.15.114:0/1900168713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705c074290 con 0x7f7044003970 2023-11-04T01:38:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.889+0000 7f704affd640 1 -- 172.21.15.114:0/1900168713 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f704c032070 con 0x7f7044003970 2023-11-04T01:38:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.889+0000 7f704affd640 1 --2- 172.21.15.114:0/1900168713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f703c06ae70 0x7f703c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.889+0000 7f7059d9b640 1 --2- 172.21.15.114:0/1900168713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f703c06ae70 0x7f703c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.889+0000 7f704affd640 1 -- 172.21.15.114:0/1900168713 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f704c03c040 con 0x7f7044003970 2023-11-04T01:38:02.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.890+0000 7f7059d9b640 1 --2- 172.21.15.114:0/1900168713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f703c06ae70 0x7f703c06d330 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f705c1e5cf0 tx=0x7f7050008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:02.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:02.893+0000 7f704affd640 1 -- 172.21.15.114:0/1900168713 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f704c075a70 con 0x7f7044003970 2023-11-04T01:38:03.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.059+0000 7f7060c26640 1 -- 172.21.15.114:0/1900168713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f705c06e510 con 0x7f7044003970 2023-11-04T01:38:03.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.059+0000 7f704affd640 1 -- 172.21.15.114:0/1900168713 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f704c0aae60 con 0x7f7044003970 2023-11-04T01:38:03.061 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:38:03.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.061+0000 7f7060c26640 1 -- 172.21.15.114:0/1900168713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f703c06ae70 msgr2=0x7f703c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.061+0000 7f7060c26640 1 --2- 172.21.15.114:0/1900168713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f703c06ae70 0x7f703c06d330 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f705c1e5cf0 tx=0x7f7050008040 comp rx=0 tx=0).stop 2023-11-04T01:38:03.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.061+0000 7f7060c26640 1 -- 172.21.15.114:0/1900168713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7044003970 msgr2=0x7f705c15b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.061+0000 7f7060c26640 1 --2- 172.21.15.114:0/1900168713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7044003970 0x7f705c15b1a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f704c00c460 tx=0x7f704c000fe0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.061+0000 7f7060c26640 1 -- 172.21.15.114:0/1900168713 shutdown_connections 2023-11-04T01:38:03.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.061+0000 7f7060c26640 1 --2- 172.21.15.114:0/1900168713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f705c15d570 0x7f705c142f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.061+0000 7f7060c26640 1 --2- 172.21.15.114:0/1900168713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f703c06ae70 0x7f703c06d330 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.061+0000 7f7060c26640 1 --2- 172.21.15.114:0/1900168713 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f705c153860 0x7f705c15d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.061+0000 7f7060c26640 1 --2- 172.21.15.114:0/1900168713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7044003970 0x7f705c15b1a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.061+0000 7f7060c26640 1 -- 172.21.15.114:0/1900168713 >> 172.21.15.114:0/1900168713 conn(0x7f705c0ce950 msgr2=0x7f705c0ca610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:03.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.061+0000 7f7060c26640 1 -- 172.21.15.114:0/1900168713 shutdown_connections 2023-11-04T01:38:03.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.061+0000 7f7060c26640 1 -- 172.21.15.114:0/1900168713 wait complete. 2023-11-04T01:38:03.074 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:38:03.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.174+0000 7f1bd6bb6640 1 Processor -- start 2023-11-04T01:38:03.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.174+0000 7f1bd6bb6640 1 -- start start 2023-11-04T01:38:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.175+0000 7f1bd6bb6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1bd0153e60 0x7f1bd015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.175+0000 7f1bd6bb6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1bd00b4880 0x7f1bd00b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.175+0000 7f1bd6bb6640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd00cde60 con 0x7f1bd00cd6d0 2023-11-04T01:38:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.175+0000 7f1bd6bb6640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd0160f90 con 0x7f1bd0153e60 2023-11-04T01:38:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.175+0000 7f1bd6bb6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00b5200 con 0x7f1bd00b4880 2023-11-04T01:38:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.175+0000 7f1bd4952640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1bd0153e60 0x7f1bd015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.176+0000 7f1bd5153640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1bd00b4880 0x7f1bd00b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.176+0000 7f1bcffff640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f1bd00cd6d0 0x7f1bd0161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:51748/0 (socket says 172.21.15.114:51748) 2023-11-04T01:38:03.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.176+0000 7f1bd4952640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1bd0153e60 0x7f1bd015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:57164/0 (socket says 172.21.15.114:57164) 2023-11-04T01:38:03.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.176+0000 7f1bcffff640 1 -- 172.21.15.114:0/413128448 learned_addr learned my addr 172.21.15.114:0/413128448 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:03.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.176+0000 7f1bd5153640 1 -- 172.21.15.114:0/413128448 >> v2:172.21.15.141:3300/0 conn(0x7f1bd0153e60 msgr2=0x7f1bd015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.176+0000 7f1bd5153640 1 --2- 172.21.15.114:0/413128448 >> v2:172.21.15.141:3300/0 conn(0x7f1bd0153e60 0x7f1bd015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.176+0000 7f1bd5153640 1 -- 172.21.15.114:0/413128448 >> v1:172.21.15.141:6789/0 conn(0x7f1bd00cd6d0 legacy=0x7f1bd0161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.176+0000 7f1bd5153640 1 -- 172.21.15.114:0/413128448 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd015e400 con 0x7f1bd00b4880 2023-11-04T01:38:03.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.176+0000 7f1bd4952640 1 --2- 172.21.15.114:0/413128448 >> v2:172.21.15.141:3300/0 conn(0x7f1bd0153e60 0x7f1bd015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:03.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.177+0000 7f1bd5153640 1 --2- 172.21.15.114:0/413128448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1bd00b4880 0x7f1bd00b4cc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009d90 tx=0x7f1bc802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f28eef0941ad6b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.177+0000 7f1bcf7fe640 1 -- 172.21.15.114:0/413128448 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc802cc50 con 0x7f1bd00b4880 2023-11-04T01:38:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.177+0000 7f1bcf7fe640 1 -- 172.21.15.114:0/413128448 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc802cdb0 con 0x7f1bd00b4880 2023-11-04T01:38:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.177+0000 7f1bcf7fe640 1 -- 172.21.15.114:0/413128448 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8034660 con 0x7f1bd00b4880 2023-11-04T01:38:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.177+0000 7f1bd6bb6640 1 -- 172.21.15.114:0/413128448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1bd00b4880 msgr2=0x7f1bd00b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.177+0000 7f1bd6bb6640 1 --2- 172.21.15.114:0/413128448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1bd00b4880 0x7f1bd00b4cc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009d90 tx=0x7f1bc802bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.177+0000 7f1bd6bb6640 1 -- 172.21.15.114:0/413128448 shutdown_connections 2023-11-04T01:38:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.177+0000 7f1bd6bb6640 1 --2- 172.21.15.114:0/413128448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1bd00b4880 0x7f1bd00b4cc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.177+0000 7f1bd6bb6640 1 --2- 172.21.15.114:0/413128448 >> v2:172.21.15.141:3300/0 conn(0x7f1bd0153e60 0x7f1bd015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.177+0000 7f1bd6bb6640 1 -- 172.21.15.114:0/413128448 >> 172.21.15.114:0/413128448 conn(0x7f1bd00cf880 msgr2=0x7f1bd00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:03.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.177+0000 7f1bd6bb6640 1 -- 172.21.15.114:0/413128448 shutdown_connections 2023-11-04T01:38:03.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.177+0000 7f1bd6bb6640 1 -- 172.21.15.114:0/413128448 wait complete. 2023-11-04T01:38:03.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.179+0000 7f1bd6bb6640 1 Processor -- start 2023-11-04T01:38:03.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.179+0000 7f1bd6bb6640 1 -- start start 2023-11-04T01:38:03.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.179+0000 7f1bd6bb6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd00b4880 0x7f1bd015a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.179+0000 7f1bd6bb6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1bd00cd6d0 0x7f1bd00c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.179+0000 7f1bd6bb6640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1bd0153e60 0x7f1bd00b7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.179+0000 7f1bd6bb6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00ca640 con 0x7f1bd00b4880 2023-11-04T01:38:03.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.179+0000 7f1bd6bb6640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd0156770 con 0x7f1bd0153e60 2023-11-04T01:38:03.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.179+0000 7f1bd6bb6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd015a990 con 0x7f1bd00cd6d0 2023-11-04T01:38:03.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.180+0000 7f1bd4952640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd00b4880 0x7f1bd015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.180+0000 7f1bd4952640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd00b4880 0x7f1bd015a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43060/0 (socket says 172.21.15.114:43060) 2023-11-04T01:38:03.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.180+0000 7f1bd4952640 1 -- 172.21.15.114:0/1080014213 learned_addr learned my addr 172.21.15.114:0/1080014213 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:03.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.180+0000 7f1bd5153640 1 --2- 172.21.15.114:0/1080014213 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1bd0153e60 0x7f1bd00b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.180+0000 7f1bcffff640 1 --2- 172.21.15.114:0/1080014213 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1bd00cd6d0 0x7f1bd00c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.180+0000 7f1bd4952640 1 -- 172.21.15.114:0/1080014213 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1bd00cd6d0 msgr2=0x7f1bd00c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.180+0000 7f1bd4952640 1 --2- 172.21.15.114:0/1080014213 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1bd00cd6d0 0x7f1bd00c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.180+0000 7f1bd4952640 1 -- 172.21.15.114:0/1080014213 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1bd0153e60 msgr2=0x7f1bd00b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.180+0000 7f1bd4952640 1 --2- 172.21.15.114:0/1080014213 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1bd0153e60 0x7f1bd00b7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.180+0000 7f1bd4952640 1 -- 172.21.15.114:0/1080014213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc0009400 con 0x7f1bd00b4880 2023-11-04T01:38:03.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.180+0000 7f1bd4952640 1 --2- 172.21.15.114:0/1080014213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd00b4880 0x7f1bd015a450 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000e990 tx=0x7f1bc000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.180+0000 7f1bcd7fa640 1 -- 172.21.15.114:0/1080014213 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc000c9e0 con 0x7f1bd00b4880 2023-11-04T01:38:03.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.180+0000 7f1bcd7fa640 1 -- 172.21.15.114:0/1080014213 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc000cb40 con 0x7f1bd00b4880 2023-11-04T01:38:03.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.180+0000 7f1bcd7fa640 1 -- 172.21.15.114:0/1080014213 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc000ced0 con 0x7f1bd00b4880 2023-11-04T01:38:03.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.180+0000 7f1bd6bb6640 1 -- 172.21.15.114:0/1080014213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc8009a70 con 0x7f1bd00b4880 2023-11-04T01:38:03.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.180+0000 7f1bd6bb6640 1 -- 172.21.15.114:0/1080014213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd01561b0 con 0x7f1bd00b4880 2023-11-04T01:38:03.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.181+0000 7f1bd6bb6640 1 -- 172.21.15.114:0/1080014213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd0074290 con 0x7f1bd00b4880 2023-11-04T01:38:03.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.182+0000 7f1bcd7fa640 1 -- 172.21.15.114:0/1080014213 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1bc0013470 con 0x7f1bd00b4880 2023-11-04T01:38:03.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.182+0000 7f1bcd7fa640 1 --2- 172.21.15.114:0/1080014213 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1bbc06ae70 0x7f1bbc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.182+0000 7f1bcd7fa640 1 -- 172.21.15.114:0/1080014213 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f1bc0089a70 con 0x7f1bd00b4880 2023-11-04T01:38:03.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.182+0000 7f1bcffff640 1 --2- 172.21.15.114:0/1080014213 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1bbc06ae70 0x7f1bbc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.182+0000 7f1bcffff640 1 --2- 172.21.15.114:0/1080014213 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1bbc06ae70 0x7f1bbc06d330 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00b8500 tx=0x7f1bc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.186+0000 7f1bcd7fa640 1 -- 172.21.15.114:0/1080014213 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1bc00548d0 con 0x7f1bd00b4880 2023-11-04T01:38:03.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.352+0000 7f1bd6bb6640 1 -- 172.21.15.114:0/1080014213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1bd00d0b80 con 0x7f1bd00b4880 2023-11-04T01:38:03.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.353+0000 7f1bcd7fa640 1 -- 172.21.15.114:0/1080014213 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1bc00170a0 con 0x7f1bd00b4880 2023-11-04T01:38:03.355 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:38:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.354+0000 7f1bd6bb6640 1 -- 172.21.15.114:0/1080014213 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1bbc06ae70 msgr2=0x7f1bbc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.354+0000 7f1bd6bb6640 1 --2- 172.21.15.114:0/1080014213 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1bbc06ae70 0x7f1bbc06d330 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00b8500 tx=0x7f1bc4009040 comp rx=0 tx=0).stop 2023-11-04T01:38:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.354+0000 7f1bd6bb6640 1 -- 172.21.15.114:0/1080014213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd00b4880 msgr2=0x7f1bd015a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.354+0000 7f1bd6bb6640 1 --2- 172.21.15.114:0/1080014213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd00b4880 0x7f1bd015a450 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000e990 tx=0x7f1bc000ee50 comp rx=0 tx=0).stop 2023-11-04T01:38:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.354+0000 7f1bd6bb6640 1 -- 172.21.15.114:0/1080014213 shutdown_connections 2023-11-04T01:38:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.354+0000 7f1bd6bb6640 1 --2- 172.21.15.114:0/1080014213 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1bbc06ae70 0x7f1bbc06d330 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.354+0000 7f1bd6bb6640 1 --2- 172.21.15.114:0/1080014213 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1bd0153e60 0x7f1bd00b7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.354+0000 7f1bd6bb6640 1 --2- 172.21.15.114:0/1080014213 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1bd00cd6d0 0x7f1bd00c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.354+0000 7f1bd6bb6640 1 --2- 172.21.15.114:0/1080014213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bd00b4880 0x7f1bd015a450 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.354+0000 7f1bd6bb6640 1 -- 172.21.15.114:0/1080014213 >> 172.21.15.114:0/1080014213 conn(0x7f1bd00cf880 msgr2=0x7f1bd00d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.354+0000 7f1bd6bb6640 1 -- 172.21.15.114:0/1080014213 shutdown_connections 2023-11-04T01:38:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.354+0000 7f1bd6bb6640 1 -- 172.21.15.114:0/1080014213 wait complete. 2023-11-04T01:38:03.367 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:03.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.468+0000 7f99d2d6c640 1 Processor -- start 2023-11-04T01:38:03.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.468+0000 7f99d2d6c640 1 -- start start 2023-11-04T01:38:03.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.468+0000 7f99d2d6c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99cc153e60 0x7f99cc15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.468+0000 7f99d2d6c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99cc0cd6d0 0x7f99cc161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.468+0000 7f99d2d6c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99cc0cde60 con 0x7f99cc0b4880 2023-11-04T01:38:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.469+0000 7f99d2d6c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99cc160f90 con 0x7f99cc153e60 2023-11-04T01:38:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.469+0000 7f99d2d6c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc15e400 con 0x7f99cc0cd6d0 2023-11-04T01:38:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.469+0000 7f99d0b08640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99cc153e60 0x7f99cc15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.469+0000 7f99d0b08640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99cc153e60 0x7f99cc15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43074/0 (socket says 172.21.15.114:43074) 2023-11-04T01:38:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.469+0000 7f99d0b08640 1 -- 172.21.15.114:0/3849604167 learned_addr learned my addr 172.21.15.114:0/3849604167 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.469+0000 7f99d0b08640 1 -- 172.21.15.114:0/3849604167 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99cc0cd6d0 msgr2=0x7f99cc161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.469+0000 7f99d0b08640 1 --2- 172.21.15.114:0/3849604167 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99cc0cd6d0 0x7f99cc161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.469+0000 7f99d0b08640 1 -- 172.21.15.114:0/3849604167 >> v1:172.21.15.141:6789/0 conn(0x7f99cc0b4880 legacy=0x7f99cc0b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.469+0000 7f99d0b08640 1 -- 172.21.15.114:0/3849604167 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc161960 con 0x7f99cc153e60 2023-11-04T01:38:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.470+0000 7f99d0b08640 1 --2- 172.21.15.114:0/3849604167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99cc153e60 0x7f99cc15dec0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009870 tx=0x7f99c002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecfd02137936595d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.470+0000 7f99cb7fe640 1 -- 172.21.15.114:0/3849604167 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0031640 con 0x7f99cc153e60 2023-11-04T01:38:03.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.470+0000 7f99cb7fe640 1 -- 172.21.15.114:0/3849604167 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c00317a0 con 0x7f99cc153e60 2023-11-04T01:38:03.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.470+0000 7f99cb7fe640 1 -- 172.21.15.114:0/3849604167 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0031b30 con 0x7f99cc153e60 2023-11-04T01:38:03.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.470+0000 7f99d2d6c640 1 -- 172.21.15.114:0/3849604167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99cc153e60 msgr2=0x7f99cc15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.470+0000 7f99d2d6c640 1 --2- 172.21.15.114:0/3849604167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99cc153e60 0x7f99cc15dec0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009870 tx=0x7f99c002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.470+0000 7f99d2d6c640 1 -- 172.21.15.114:0/3849604167 shutdown_connections 2023-11-04T01:38:03.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.470+0000 7f99d2d6c640 1 --2- 172.21.15.114:0/3849604167 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99cc0cd6d0 0x7f99cc161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.470+0000 7f99d2d6c640 1 --2- 172.21.15.114:0/3849604167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99cc153e60 0x7f99cc15dec0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.470+0000 7f99d2d6c640 1 -- 172.21.15.114:0/3849604167 >> 172.21.15.114:0/3849604167 conn(0x7f99cc0cf880 msgr2=0x7f99cc0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:03.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.470+0000 7f99d2d6c640 1 -- 172.21.15.114:0/3849604167 shutdown_connections 2023-11-04T01:38:03.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.470+0000 7f99d2d6c640 1 -- 172.21.15.114:0/3849604167 wait complete. 2023-11-04T01:38:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.471+0000 7f99d2d6c640 1 Processor -- start 2023-11-04T01:38:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.472+0000 7f99d2d6c640 1 -- start start 2023-11-04T01:38:03.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.472+0000 7f99d2d6c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99cc0b4880 0x7f99cc156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.472+0000 7f99d2d6c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99cc0cd6d0 0x7f99cc0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.472+0000 7f99d2d6c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99cc153e60 0x7f99cc0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.472+0000 7f99d2d6c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc154240 con 0x7f99cc0cd6d0 2023-11-04T01:38:03.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.472+0000 7f99d2d6c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc154450 con 0x7f99cc0b4880 2023-11-04T01:38:03.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.472+0000 7f99d2d6c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc154730 con 0x7f99cc153e60 2023-11-04T01:38:03.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.472+0000 7f99cbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99cc0cd6d0 0x7f99cc0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99cbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99cc0cd6d0 0x7f99cc0c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43090/0 (socket says 172.21.15.114:43090) 2023-11-04T01:38:03.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99cbfff640 1 -- 172.21.15.114:0/3474025014 learned_addr learned my addr 172.21.15.114:0/3474025014 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:03.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99d0b08640 1 --2- 172.21.15.114:0/3474025014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99cc0b4880 0x7f99cc156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99cbfff640 1 -- 172.21.15.114:0/3474025014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99cc153e60 msgr2=0x7f99cc0ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99d1309640 1 --2- 172.21.15.114:0/3474025014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99cc153e60 0x7f99cc0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99cbfff640 1 --2- 172.21.15.114:0/3474025014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99cc153e60 0x7f99cc0ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99cbfff640 1 -- 172.21.15.114:0/3474025014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99cc0b4880 msgr2=0x7f99cc156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99cbfff640 1 --2- 172.21.15.114:0/3474025014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99cc0b4880 0x7f99cc156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99cbfff640 1 -- 172.21.15.114:0/3474025014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c00094d0 con 0x7f99cc0cd6d0 2023-11-04T01:38:03.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99d0b08640 1 --2- 172.21.15.114:0/3474025014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99cc0b4880 0x7f99cc156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:03.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99d1309640 1 --2- 172.21.15.114:0/3474025014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99cc153e60 0x7f99cc0ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:03.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99cbfff640 1 --2- 172.21.15.114:0/3474025014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99cc0cd6d0 0x7f99cc0c9ed0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f99b800b4a0 tx=0x7f99b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99c97fa640 1 -- 172.21.15.114:0/3474025014 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b8010610 con 0x7f99cc0cd6d0 2023-11-04T01:38:03.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99c97fa640 1 -- 172.21.15.114:0/3474025014 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b8010770 con 0x7f99cc0cd6d0 2023-11-04T01:38:03.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99d2d6c640 1 -- 172.21.15.114:0/3474025014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99cc154a10 con 0x7f99cc0cd6d0 2023-11-04T01:38:03.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99c97fa640 1 -- 172.21.15.114:0/3474025014 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b8010b20 con 0x7f99cc0cd6d0 2023-11-04T01:38:03.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.473+0000 7f99d2d6c640 1 -- 172.21.15.114:0/3474025014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc156f80 con 0x7f99cc0cd6d0 2023-11-04T01:38:03.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.474+0000 7f99d2d6c640 1 -- 172.21.15.114:0/3474025014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99cc157140 con 0x7f99cc0cd6d0 2023-11-04T01:38:03.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.475+0000 7f99c97fa640 1 -- 172.21.15.114:0/3474025014 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f99b8010c80 con 0x7f99cc0cd6d0 2023-11-04T01:38:03.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.475+0000 7f99c97fa640 1 --2- 172.21.15.114:0/3474025014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f99b006ae70 0x7f99b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.475+0000 7f99c97fa640 1 -- 172.21.15.114:0/3474025014 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f99b8089510 con 0x7f99cc0cd6d0 2023-11-04T01:38:03.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.475+0000 7f99d0b08640 1 --2- 172.21.15.114:0/3474025014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f99b006ae70 0x7f99b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.475+0000 7f99d0b08640 1 --2- 172.21.15.114:0/3474025014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f99b006ae70 0x7f99b006d330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f99c0036000 tx=0x7f99c003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.479+0000 7f99c97fa640 1 -- 172.21.15.114:0/3474025014 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f99b80542e0 con 0x7f99cc0cd6d0 2023-11-04T01:38:03.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.643+0000 7f99d2d6c640 1 -- 172.21.15.114:0/3474025014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f99cc074290 con 0x7f99cc0cd6d0 2023-11-04T01:38:03.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.644+0000 7f99c97fa640 1 -- 172.21.15.114:0/3474025014 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v41) v1 ==== 103+0+11 (secure 0 0 0) 0x7f99b8057900 con 0x7f99cc0cd6d0 2023-11-04T01:38:03.646 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:38:03.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.646+0000 7f99d2d6c640 1 -- 172.21.15.114:0/3474025014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f99b006ae70 msgr2=0x7f99b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.646+0000 7f99d2d6c640 1 --2- 172.21.15.114:0/3474025014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f99b006ae70 0x7f99b006d330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f99c0036000 tx=0x7f99c003c040 comp rx=0 tx=0).stop 2023-11-04T01:38:03.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.646+0000 7f99d2d6c640 1 -- 172.21.15.114:0/3474025014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99cc0cd6d0 msgr2=0x7f99cc0c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.646+0000 7f99d2d6c640 1 --2- 172.21.15.114:0/3474025014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99cc0cd6d0 0x7f99cc0c9ed0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f99b800b4a0 tx=0x7f99b800b960 comp rx=0 tx=0).stop 2023-11-04T01:38:03.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.646+0000 7f99d2d6c640 1 -- 172.21.15.114:0/3474025014 shutdown_connections 2023-11-04T01:38:03.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.646+0000 7f99d2d6c640 1 --2- 172.21.15.114:0/3474025014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99cc153e60 0x7f99cc0ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.646+0000 7f99d2d6c640 1 --2- 172.21.15.114:0/3474025014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99cc0cd6d0 0x7f99cc0c9ed0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.646+0000 7f99d2d6c640 1 --2- 172.21.15.114:0/3474025014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f99b006ae70 0x7f99b006d330 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.646+0000 7f99d2d6c640 1 --2- 172.21.15.114:0/3474025014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f99cc0b4880 0x7f99cc156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.646+0000 7f99d2d6c640 1 -- 172.21.15.114:0/3474025014 >> 172.21.15.114:0/3474025014 conn(0x7f99cc0cf880 msgr2=0x7f99cc15fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:03.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.646+0000 7f99d2d6c640 1 -- 172.21.15.114:0/3474025014 shutdown_connections 2023-11-04T01:38:03.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.646+0000 7f99d2d6c640 1 -- 172.21.15.114:0/3474025014 wait complete. 2023-11-04T01:38:03.661 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:38:03.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.761+0000 7f44f00af640 1 Processor -- start 2023-11-04T01:38:03.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.761+0000 7f44f00af640 1 -- start start 2023-11-04T01:38:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.762+0000 7f44f00af640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f44e80c4ff0 0x7f44e80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.762+0000 7f44f00af640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f44e80adac0 0x7f44e80adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.762+0000 7f44f00af640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e815aff0 con 0x7f44e8159c00 2023-11-04T01:38:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.762+0000 7f44f00af640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e80ae460 con 0x7f44e80adac0 2023-11-04T01:38:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.762+0000 7f44f00af640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e815a3e0 con 0x7f44e80c4ff0 2023-11-04T01:38:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.762+0000 7f44ee64c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f44e80adac0 0x7f44e80adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.762+0000 7f44ee64c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f44e80adac0 0x7f44e80adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43100/0 (socket says 172.21.15.114:43100) 2023-11-04T01:38:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.762+0000 7f44ee64c640 1 -- 172.21.15.114:0/567961757 learned_addr learned my addr 172.21.15.114:0/567961757 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:03.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.762+0000 7f44ee64c640 1 -- 172.21.15.114:0/567961757 >> v2:172.21.15.141:3300/0 conn(0x7f44e80c4ff0 msgr2=0x7f44e80cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.762+0000 7f44ee64c640 1 --2- 172.21.15.114:0/567961757 >> v2:172.21.15.141:3300/0 conn(0x7f44e80c4ff0 0x7f44e80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.762+0000 7f44ee64c640 1 -- 172.21.15.114:0/567961757 >> v1:172.21.15.141:6789/0 conn(0x7f44e8159c00 legacy=0x7f44e80c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:03.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.762+0000 7f44ee64c640 1 -- 172.21.15.114:0/567961757 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e815a6c0 con 0x7f44e80adac0 2023-11-04T01:38:03.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.763+0000 7f44ee64c640 1 --2- 172.21.15.114:0/567961757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e80adac0 0x7f44e80adf20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f44e80cde50 tx=0x7f44e002bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4176f398cb3590a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.763+0000 7f44ece49640 1 -- 172.21.15.114:0/567961757 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e002caa0 con 0x7f44e80adac0 2023-11-04T01:38:03.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.763+0000 7f44ece49640 1 -- 172.21.15.114:0/567961757 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e002cc00 con 0x7f44e80adac0 2023-11-04T01:38:03.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.763+0000 7f44ece49640 1 -- 172.21.15.114:0/567961757 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e00343f0 con 0x7f44e80adac0 2023-11-04T01:38:03.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.764+0000 7f44f00af640 1 -- 172.21.15.114:0/567961757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e80adac0 msgr2=0x7f44e80adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.764+0000 7f44f00af640 1 --2- 172.21.15.114:0/567961757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e80adac0 0x7f44e80adf20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f44e80cde50 tx=0x7f44e002bf00 comp rx=0 tx=0).stop 2023-11-04T01:38:03.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.764+0000 7f44f00af640 1 -- 172.21.15.114:0/567961757 shutdown_connections 2023-11-04T01:38:03.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.764+0000 7f44f00af640 1 --2- 172.21.15.114:0/567961757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e80adac0 0x7f44e80adf20 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.764+0000 7f44f00af640 1 --2- 172.21.15.114:0/567961757 >> v2:172.21.15.141:3300/0 conn(0x7f44e80c4ff0 0x7f44e80cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.764+0000 7f44f00af640 1 -- 172.21.15.114:0/567961757 >> 172.21.15.114:0/567961757 conn(0x7f44e80ce950 msgr2=0x7f44e80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:03.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.764+0000 7f44f00af640 1 -- 172.21.15.114:0/567961757 shutdown_connections 2023-11-04T01:38:03.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.764+0000 7f44f00af640 1 -- 172.21.15.114:0/567961757 wait complete. 2023-11-04T01:38:03.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.765+0000 7f44f00af640 1 Processor -- start 2023-11-04T01:38:03.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.765+0000 7f44f00af640 1 -- start start 2023-11-04T01:38:03.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.765+0000 7f44f00af640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e80adac0 0x7f44e8156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.765+0000 7f44f00af640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e80c4ff0 0x7f44e80b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44f00af640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44e8159c00 0x7f44e81f1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44f00af640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e81566d0 con 0x7f44e80adac0 2023-11-04T01:38:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44f00af640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e81574b0 con 0x7f44e8159c00 2023-11-04T01:38:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44f00af640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e8156930 con 0x7f44e80c4ff0 2023-11-04T01:38:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44ede4b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e80adac0 0x7f44e8156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44ede4b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e80adac0 0x7f44e8156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43114/0 (socket says 172.21.15.114:43114) 2023-11-04T01:38:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44ede4b640 1 -- 172.21.15.114:0/2806068955 learned_addr learned my addr 172.21.15.114:0/2806068955 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44ee64c640 1 --2- 172.21.15.114:0/2806068955 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44e8159c00 0x7f44e81f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44ed64a640 1 --2- 172.21.15.114:0/2806068955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e80c4ff0 0x7f44e80b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44ede4b640 1 -- 172.21.15.114:0/2806068955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e80c4ff0 msgr2=0x7f44e80b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44ede4b640 1 --2- 172.21.15.114:0/2806068955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e80c4ff0 0x7f44e80b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44ede4b640 1 -- 172.21.15.114:0/2806068955 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44e8159c00 msgr2=0x7f44e81f1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44ede4b640 1 --2- 172.21.15.114:0/2806068955 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44e8159c00 0x7f44e81f1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44ede4b640 1 -- 172.21.15.114:0/2806068955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e0009b30 con 0x7f44e80adac0 2023-11-04T01:38:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44ede4b640 1 --2- 172.21.15.114:0/2806068955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e80adac0 0x7f44e8156190 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f44e400c410 tx=0x7f44e400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44de7fc640 1 -- 172.21.15.114:0/2806068955 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e40035f0 con 0x7f44e80adac0 2023-11-04T01:38:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44de7fc640 1 -- 172.21.15.114:0/2806068955 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e4003750 con 0x7f44e80adac0 2023-11-04T01:38:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44f00af640 1 -- 172.21.15.114:0/2806068955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e8156c10 con 0x7f44e80adac0 2023-11-04T01:38:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44de7fc640 1 -- 172.21.15.114:0/2806068955 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4003b40 con 0x7f44e80adac0 2023-11-04T01:38:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.766+0000 7f44f00af640 1 -- 172.21.15.114:0/2806068955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e81571d0 con 0x7f44e80adac0 2023-11-04T01:38:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.767+0000 7f44f00af640 1 -- 172.21.15.114:0/2806068955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e8074290 con 0x7f44e80adac0 2023-11-04T01:38:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.768+0000 7f44de7fc640 1 -- 172.21.15.114:0/2806068955 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44e4003ca0 con 0x7f44e80adac0 2023-11-04T01:38:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.768+0000 7f44de7fc640 1 --2- 172.21.15.114:0/2806068955 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44cc06ae70 0x7f44cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.768+0000 7f44ed64a640 1 --2- 172.21.15.114:0/2806068955 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44cc06ae70 0x7f44cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:03.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.768+0000 7f44de7fc640 1 -- 172.21.15.114:0/2806068955 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f44e4088b00 con 0x7f44e80adac0 2023-11-04T01:38:03.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.769+0000 7f44ed64a640 1 --2- 172.21.15.114:0/2806068955 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44cc06ae70 0x7f44cc06d330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f44e806d0b0 tx=0x7f44d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:03.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.773+0000 7f44de7fc640 1 -- 172.21.15.114:0/2806068955 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f44e40538d0 con 0x7f44e80adac0 2023-11-04T01:38:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.951+0000 7f44f00af640 1 -- 172.21.15.114:0/2806068955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f44e80cac00 con 0x7f44e80adac0 2023-11-04T01:38:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.951+0000 7f44de7fc640 1 -- 172.21.15.114:0/2806068955 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) v1 ==== 80+0+0 (secure 0 0 0) 0x7f44e4088020 con 0x7f44e80adac0 2023-11-04T01:38:03.953 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-11-04T01:38:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.953+0000 7f44f00af640 1 -- 172.21.15.114:0/2806068955 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44cc06ae70 msgr2=0x7f44cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.953+0000 7f44f00af640 1 --2- 172.21.15.114:0/2806068955 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44cc06ae70 0x7f44cc06d330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f44e806d0b0 tx=0x7f44d8008040 comp rx=0 tx=0).stop 2023-11-04T01:38:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.953+0000 7f44f00af640 1 -- 172.21.15.114:0/2806068955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e80adac0 msgr2=0x7f44e8156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.953+0000 7f44f00af640 1 --2- 172.21.15.114:0/2806068955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e80adac0 0x7f44e8156190 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f44e400c410 tx=0x7f44e400c8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.953+0000 7f44f00af640 1 -- 172.21.15.114:0/2806068955 shutdown_connections 2023-11-04T01:38:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.953+0000 7f44f00af640 1 --2- 172.21.15.114:0/2806068955 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44cc06ae70 0x7f44cc06d330 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.953+0000 7f44f00af640 1 --2- 172.21.15.114:0/2806068955 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44e8159c00 0x7f44e81f1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.953+0000 7f44f00af640 1 --2- 172.21.15.114:0/2806068955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44e80c4ff0 0x7f44e80b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.953+0000 7f44f00af640 1 --2- 172.21.15.114:0/2806068955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44e80adac0 0x7f44e8156190 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:03.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.953+0000 7f44f00af640 1 -- 172.21.15.114:0/2806068955 >> 172.21.15.114:0/2806068955 conn(0x7f44e80ce950 msgr2=0x7f44e80c97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:03.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.953+0000 7f44f00af640 1 -- 172.21.15.114:0/2806068955 shutdown_connections 2023-11-04T01:38:03.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:03.953+0000 7f44f00af640 1 -- 172.21.15.114:0/2806068955 wait complete. 2023-11-04T01:38:03.965 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi114.front.sepia.ceph.com... 2023-11-04T01:38:03.966 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:03.966 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:04.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:04.024 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[105313]: fuse finished with error 0 and tester_r 0 2023-11-04T01:38:04.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:04.030 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:38:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:04.036 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:38:04.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:04.036 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:38:04.050 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:38:04.051 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:04.070 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:04.070 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:38:04.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:04.071 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:38:04.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:04.129 INFO:teuthology.orchestra.run.smithi141.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:38:04.129 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:38:04.129 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:04.146 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:04.146 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:38:04.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:04.147 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:38:04.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:04.202 INFO:teuthology.orchestra.run.smithi114.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:38:04.203 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:38:04.203 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:04.222 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:04.222 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:38:04.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:04.222 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:38:04.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:04.282 INFO:teuthology.orchestra.run.smithi141.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:38:04.283 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:04.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.380+0000 7f6cec95e640 1 Processor -- start 2023-11-04T01:38:04.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.380+0000 7f6cec95e640 1 -- start start 2023-11-04T01:38:04.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.381+0000 7f6cec95e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6ce80cec10 0x7f6ce80b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.381+0000 7f6cec95e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce80b3c10 con 0x7f6ce80b2b40 2023-11-04T01:38:04.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.381+0000 7f6cec95e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce80b2fa0 con 0x7f6ce815ac70 2023-11-04T01:38:04.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.381+0000 7f6cec95e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce80cf180 con 0x7f6ce80cec10 2023-11-04T01:38:04.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.381+0000 7f6ce5d9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6ce80cec10 0x7f6ce80b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.382+0000 7f6ce6d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6ce80b2b40 0x7f6ce80b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60610/0 (socket says 172.21.15.114:60610) 2023-11-04T01:38:04.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.382+0000 7f6ce5d9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6ce80cec10 0x7f6ce80b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43126/0 (socket says 172.21.15.114:43126) 2023-11-04T01:38:04.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.382+0000 7f6ce6d9d640 1 -- 172.21.15.114:0/3836982377 learned_addr learned my addr 172.21.15.114:0/3836982377 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:04.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.382+0000 7f6ce5d9b640 1 -- 172.21.15.114:0/3836982377 >> v1:172.21.15.141:6789/0 conn(0x7f6ce815ac70 legacy=0x7f6ce80d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.382+0000 7f6ce5d9b640 1 -- 172.21.15.114:0/3836982377 >> v1:172.21.15.114:6789/0 conn(0x7f6ce80b2b40 legacy=0x7f6ce80b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.382+0000 7f6ce5d9b640 1 -- 172.21.15.114:0/3836982377 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce80cf460 con 0x7f6ce80cec10 2023-11-04T01:38:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.382+0000 7f6ce559a640 1 -- 172.21.15.114:0/3836982377 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243323085 0 0) 0x7f6ce80b3c10 con 0x7f6ce80b2b40 2023-11-04T01:38:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.382+0000 7f6ce5d9b640 1 --2- 172.21.15.114:0/3836982377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce80cec10 0x7f6ce80b2600 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00097a0 tx=0x7f6cd002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4836bb42e1dea27 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.383+0000 7f6ce559a640 1 -- 172.21.15.114:0/3836982377 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0031830 con 0x7f6ce80cec10 2023-11-04T01:38:04.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.383+0000 7f6ce559a640 1 -- 172.21.15.114:0/3836982377 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd0031990 con 0x7f6ce80cec10 2023-11-04T01:38:04.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.383+0000 7f6ce559a640 1 -- 172.21.15.114:0/3836982377 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0031d20 con 0x7f6ce80cec10 2023-11-04T01:38:04.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.383+0000 7f6cec95e640 1 -- 172.21.15.114:0/3836982377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce80cec10 msgr2=0x7f6ce80b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.383+0000 7f6cec95e640 1 --2- 172.21.15.114:0/3836982377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce80cec10 0x7f6ce80b2600 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00097a0 tx=0x7f6cd002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.383+0000 7f6cec95e640 1 -- 172.21.15.114:0/3836982377 shutdown_connections 2023-11-04T01:38:04.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.383+0000 7f6cec95e640 1 --2- 172.21.15.114:0/3836982377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce80cec10 0x7f6ce80b2600 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.383+0000 7f6cec95e640 1 -- 172.21.15.114:0/3836982377 >> 172.21.15.114:0/3836982377 conn(0x7f6ce80cd600 msgr2=0x7f6ce80cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:04.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.383+0000 7f6cec95e640 1 -- 172.21.15.114:0/3836982377 shutdown_connections 2023-11-04T01:38:04.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.383+0000 7f6cec95e640 1 -- 172.21.15.114:0/3836982377 wait complete. 2023-11-04T01:38:04.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.385+0000 7f6cec95e640 1 Processor -- start 2023-11-04T01:38:04.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.385+0000 7f6cec95e640 1 -- start start 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.385+0000 7f6cec95e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ce80b2b40 0x7f6ce806c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.385+0000 7f6cec95e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce80cec10 0x7f6ce80b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.385+0000 7f6cec95e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ce815ac70 0x7f6ce806b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.385+0000 7f6cec95e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce806d2e0 con 0x7f6ce80cec10 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.385+0000 7f6cec95e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80b26c0 con 0x7f6ce815ac70 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.385+0000 7f6cec95e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce806b460 con 0x7f6ce80b2b40 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.385+0000 7f6ce5d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce80cec10 0x7f6ce80b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.385+0000 7f6ce5d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce80cec10 0x7f6ce80b2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43140/0 (socket says 172.21.15.114:43140) 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.385+0000 7f6ce5d9b640 1 -- 172.21.15.114:0/4119068868 learned_addr learned my addr 172.21.15.114:0/4119068868 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:04.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.386+0000 7f6ce6d9d640 1 --2- 172.21.15.114:0/4119068868 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ce815ac70 0x7f6ce806b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.386+0000 7f6ce659c640 1 --2- 172.21.15.114:0/4119068868 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ce80b2b40 0x7f6ce806c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.386+0000 7f6ce5d9b640 1 -- 172.21.15.114:0/4119068868 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ce80b2b40 msgr2=0x7f6ce806c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.386+0000 7f6ce5d9b640 1 --2- 172.21.15.114:0/4119068868 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ce80b2b40 0x7f6ce806c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.386+0000 7f6ce5d9b640 1 -- 172.21.15.114:0/4119068868 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ce815ac70 msgr2=0x7f6ce806b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.386+0000 7f6ce5d9b640 1 --2- 172.21.15.114:0/4119068868 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ce815ac70 0x7f6ce806b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.386+0000 7f6ce5d9b640 1 -- 172.21.15.114:0/4119068868 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd0009400 con 0x7f6ce80cec10 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.386+0000 7f6ce5d9b640 1 --2- 172.21.15.114:0/4119068868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce80cec10 0x7f6ce80b2180 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00098c0 tx=0x7f6cd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.386+0000 7f6cdeffd640 1 -- 172.21.15.114:0/4119068868 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd003ba70 con 0x7f6ce80cec10 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.386+0000 7f6cdeffd640 1 -- 172.21.15.114:0/4119068868 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd003bbd0 con 0x7f6ce80cec10 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.386+0000 7f6cec95e640 1 -- 172.21.15.114:0/4119068868 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce81571e0 con 0x7f6ce80cec10 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.386+0000 7f6cdeffd640 1 -- 172.21.15.114:0/4119068868 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00453f0 con 0x7f6ce80cec10 2023-11-04T01:38:04.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.386+0000 7f6cec95e640 1 -- 172.21.15.114:0/4119068868 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce806cd20 con 0x7f6ce80cec10 2023-11-04T01:38:04.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.387+0000 7f6cec95e640 1 -- 172.21.15.114:0/4119068868 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce806b230 con 0x7f6ce80cec10 2023-11-04T01:38:04.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.387+0000 7f6cdeffd640 1 -- 172.21.15.114:0/4119068868 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6cd004e450 con 0x7f6ce80cec10 2023-11-04T01:38:04.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.388+0000 7f6cdeffd640 1 --2- 172.21.15.114:0/4119068868 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6cc806ae70 0x7f6cc806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.388+0000 7f6cdeffd640 1 -- 172.21.15.114:0/4119068868 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f6cd00abb10 con 0x7f6ce80cec10 2023-11-04T01:38:04.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.388+0000 7f6ce659c640 1 --2- 172.21.15.114:0/4119068868 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6cc806ae70 0x7f6cc806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.388+0000 7f6ce659c640 1 --2- 172.21.15.114:0/4119068868 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6cc806ae70 0x7f6cc806d330 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0009f60 tx=0x7f6ce00094f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.392+0000 7f6cdeffd640 1 -- 172.21.15.114:0/4119068868 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6cd00768e0 con 0x7f6ce80cec10 2023-11-04T01:38:04.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.591+0000 7f6cec95e640 1 -- 172.21.15.114:0/4119068868 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ce80b6b00 con 0x7f6ce80cec10 2023-11-04T01:38:04.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.592+0000 7f6cdeffd640 1 -- 172.21.15.114:0/4119068868 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f6cd0079f00 con 0x7f6ce80cec10 2023-11-04T01:38:04.594 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:04.594 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5218,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/3821610653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":3821610653},{"type":"v1","addr":"172.21.15.141:6834","nonce":3821610653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2452742541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2452742541},{"type":"v1","addr":"172.21.15.114:6835","nonce":2452742541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3407147888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3407147888},{"type":"v1","addr":"172.21.15.114:6837","nonce":3407147888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:50.993779+0000","modified":"2023-11-04T01:37:53.001589+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5565":{"gid":5565,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6835/3122131633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3122131633},{"type":"v1","addr":"172.21.15.141:6835","nonce":3122131633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:38:04.594 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 16 2023-11-04T01:38:04.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.594+0000 7f6cec95e640 1 -- 172.21.15.114:0/4119068868 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6cc806ae70 msgr2=0x7f6cc806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.594+0000 7f6cec95e640 1 --2- 172.21.15.114:0/4119068868 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6cc806ae70 0x7f6cc806d330 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0009f60 tx=0x7f6ce00094f0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.594+0000 7f6cec95e640 1 -- 172.21.15.114:0/4119068868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce80cec10 msgr2=0x7f6ce80b2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.594+0000 7f6cec95e640 1 --2- 172.21.15.114:0/4119068868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce80cec10 0x7f6ce80b2180 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00098c0 tx=0x7f6cd00046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.594+0000 7f6cec95e640 1 -- 172.21.15.114:0/4119068868 shutdown_connections 2023-11-04T01:38:04.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.594+0000 7f6cec95e640 1 --2- 172.21.15.114:0/4119068868 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6cc806ae70 0x7f6cc806d330 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.594+0000 7f6cec95e640 1 --2- 172.21.15.114:0/4119068868 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ce815ac70 0x7f6ce806b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.594+0000 7f6cec95e640 1 --2- 172.21.15.114:0/4119068868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce80cec10 0x7f6ce80b2180 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.594+0000 7f6cec95e640 1 --2- 172.21.15.114:0/4119068868 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6ce80b2b40 0x7f6ce806c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.594+0000 7f6cec95e640 1 -- 172.21.15.114:0/4119068868 >> 172.21.15.114:0/4119068868 conn(0x7f6ce80cd600 msgr2=0x7f6ce80c8520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:04.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.594+0000 7f6cec95e640 1 -- 172.21.15.114:0/4119068868 shutdown_connections 2023-11-04T01:38:04.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.594+0000 7f6cec95e640 1 -- 172.21.15.114:0/4119068868 wait complete. 2023-11-04T01:38:04.607 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:04.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.704+0000 7fed41e64640 1 Processor -- start 2023-11-04T01:38:04.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.704+0000 7fed41e64640 1 -- start start 2023-11-04T01:38:04.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.705+0000 7fed41e64640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed3c159c70 0x7fed3c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.705+0000 7fed41e64640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fed3c0b0ae0 0x7fed3c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.705+0000 7fed41e64640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3c0b4110 con 0x7fed3c06db20 2023-11-04T01:38:04.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.705+0000 7fed41e64640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed3c0b49b0 con 0x7fed3c0b0ae0 2023-11-04T01:38:04.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.705+0000 7fed41e64640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c0b43f0 con 0x7fed3c159c70 2023-11-04T01:38:04.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.705+0000 7fed3bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fed3c0b0ae0 0x7fed3c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.705+0000 7fed3bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fed3c0b0ae0 0x7fed3c15d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43150/0 (socket says 172.21.15.114:43150) 2023-11-04T01:38:04.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.705+0000 7fed3bfff640 1 -- 172.21.15.114:0/3437234514 learned_addr learned my addr 172.21.15.114:0/3437234514 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:04.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.705+0000 7fed3b7fe640 1 --2- 172.21.15.114:0/3437234514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed3c159c70 0x7fed3c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.706+0000 7fed3bfff640 1 -- 172.21.15.114:0/3437234514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed3c159c70 msgr2=0x7fed3c0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:04.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.706+0000 7fed3bfff640 1 --2- 172.21.15.114:0/3437234514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed3c159c70 0x7fed3c0ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.706+0000 7fed3bfff640 1 -- 172.21.15.114:0/3437234514 >> v1:172.21.15.141:6789/0 conn(0x7fed3c06db20 legacy=0x7fed3c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.706+0000 7fed3bfff640 1 -- 172.21.15.114:0/3437234514 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c0b46d0 con 0x7fed3c0b0ae0 2023-11-04T01:38:04.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.706+0000 7fed3bfff640 1 --2- 172.21.15.114:0/3437234514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed3c0b0ae0 0x7fed3c15d7d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fed3400d150 tx=0x7fed3402e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f837adfe3e38d52 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.707+0000 7fed3a7fc640 1 -- 172.21.15.114:0/3437234514 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3400b0d0 con 0x7fed3c0b0ae0 2023-11-04T01:38:04.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.707+0000 7fed3a7fc640 1 -- 172.21.15.114:0/3437234514 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3400b230 con 0x7fed3c0b0ae0 2023-11-04T01:38:04.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.707+0000 7fed3a7fc640 1 -- 172.21.15.114:0/3437234514 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed34009600 con 0x7fed3c0b0ae0 2023-11-04T01:38:04.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.707+0000 7fed41e64640 1 -- 172.21.15.114:0/3437234514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed3c0b0ae0 msgr2=0x7fed3c15d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.707+0000 7fed41e64640 1 --2- 172.21.15.114:0/3437234514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed3c0b0ae0 0x7fed3c15d7d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fed3400d150 tx=0x7fed3402e160 comp rx=0 tx=0).stop 2023-11-04T01:38:04.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.707+0000 7fed41e64640 1 -- 172.21.15.114:0/3437234514 shutdown_connections 2023-11-04T01:38:04.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.707+0000 7fed41e64640 1 --2- 172.21.15.114:0/3437234514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed3c0b0ae0 0x7fed3c15d7d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.707+0000 7fed41e64640 1 --2- 172.21.15.114:0/3437234514 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed3c159c70 0x7fed3c0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.707+0000 7fed41e64640 1 -- 172.21.15.114:0/3437234514 >> 172.21.15.114:0/3437234514 conn(0x7fed3c0ce950 msgr2=0x7fed3c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:04.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.707+0000 7fed41e64640 1 -- 172.21.15.114:0/3437234514 shutdown_connections 2023-11-04T01:38:04.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.707+0000 7fed41e64640 1 -- 172.21.15.114:0/3437234514 wait complete. 2023-11-04T01:38:04.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.708+0000 7fed41e64640 1 Processor -- start 2023-11-04T01:38:04.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.709+0000 7fed41e64640 1 -- start start 2023-11-04T01:38:04.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.709+0000 7fed41e64640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed3c06db20 0x7fed3c154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.709+0000 7fed41e64640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed3c0b0ae0 0x7fed3c15b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.709+0000 7fed41e64640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed3c159c70 0x7fed3c0c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.709+0000 7fed41e64640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c153f60 con 0x7fed3c06db20 2023-11-04T01:38:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.709+0000 7fed41e64640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c15b9d0 con 0x7fed3c159c70 2023-11-04T01:38:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.709+0000 7fed41e64640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c1535c0 con 0x7fed3c0b0ae0 2023-11-04T01:38:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.709+0000 7fed3b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed3c06db20 0x7fed3c154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.709+0000 7fed3b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed3c06db20 0x7fed3c154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43158/0 (socket says 172.21.15.114:43158) 2023-11-04T01:38:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.709+0000 7fed3b7fe640 1 -- 172.21.15.114:0/3223588735 learned_addr learned my addr 172.21.15.114:0/3223588735 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.710+0000 7fed3b7fe640 1 -- 172.21.15.114:0/3223588735 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed3c0b0ae0 msgr2=0x7fed3c15b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.710+0000 7fed3affd640 1 --2- 172.21.15.114:0/3223588735 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed3c0b0ae0 0x7fed3c15b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.710+0000 7fed3bfff640 1 --2- 172.21.15.114:0/3223588735 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed3c159c70 0x7fed3c0c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.710+0000 7fed3b7fe640 1 --2- 172.21.15.114:0/3223588735 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed3c0b0ae0 0x7fed3c15b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.710+0000 7fed3b7fe640 1 -- 172.21.15.114:0/3223588735 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed3c159c70 msgr2=0x7fed3c0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.710+0000 7fed3b7fe640 1 --2- 172.21.15.114:0/3223588735 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed3c159c70 0x7fed3c0c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.710+0000 7fed3b7fe640 1 -- 172.21.15.114:0/3223588735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3400bd40 con 0x7fed3c06db20 2023-11-04T01:38:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.710+0000 7fed3b7fe640 1 --2- 172.21.15.114:0/3223588735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed3c06db20 0x7fed3c154380 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00e870 tx=0x7fed2c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.710+0000 7fed23fff640 1 -- 172.21.15.114:0/3223588735 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0094f0 con 0x7fed3c06db20 2023-11-04T01:38:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.710+0000 7fed23fff640 1 -- 172.21.15.114:0/3223588735 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2c00c940 con 0x7fed3c06db20 2023-11-04T01:38:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.710+0000 7fed41e64640 1 -- 172.21.15.114:0/3223588735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3c1538a0 con 0x7fed3c06db20 2023-11-04T01:38:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.710+0000 7fed23fff640 1 -- 172.21.15.114:0/3223588735 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c00ccf0 con 0x7fed3c06db20 2023-11-04T01:38:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.710+0000 7fed41e64640 1 -- 172.21.15.114:0/3223588735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3c15bc70 con 0x7fed3c06db20 2023-11-04T01:38:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.711+0000 7fed41e64640 1 -- 172.21.15.114:0/3223588735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3c074290 con 0x7fed3c06db20 2023-11-04T01:38:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.711+0000 7fed23fff640 1 -- 172.21.15.114:0/3223588735 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed2c013470 con 0x7fed3c06db20 2023-11-04T01:38:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.712+0000 7fed23fff640 1 --2- 172.21.15.114:0/3223588735 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed2806aea0 0x7fed2806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:04.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.712+0000 7fed23fff640 1 -- 172.21.15.114:0/3223588735 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fed2c089980 con 0x7fed3c06db20 2023-11-04T01:38:04.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.712+0000 7fed3affd640 1 --2- 172.21.15.114:0/3223588735 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed2806aea0 0x7fed2806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:04.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.712+0000 7fed3affd640 1 --2- 172.21.15.114:0/3223588735 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed2806aea0 0x7fed2806d360 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0b3020 tx=0x7fed30009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:04.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.716+0000 7fed23fff640 1 -- 172.21.15.114:0/3223588735 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fed2c0547e0 con 0x7fed3c06db20 2023-11-04T01:38:04.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.885+0000 7fed41e64640 1 -- 172.21.15.114:0/3223588735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed3c0b0780 con 0x7fed3c06db20 2023-11-04T01:38:04.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.886+0000 7fed23fff640 1 -- 172.21.15.114:0/3223588735 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18673 (secure 0 0 0) 0x7fed2c021090 con 0x7fed3c06db20 2023-11-04T01:38:04.889 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:04.889 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":41,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:01.692133+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:48.832988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:49.974993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.888+0000 7fed41e64640 1 -- 172.21.15.114:0/3223588735 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed2806aea0 msgr2=0x7fed2806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.888+0000 7fed41e64640 1 --2- 172.21.15.114:0/3223588735 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed2806aea0 0x7fed2806d360 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0b3020 tx=0x7fed30009040 comp rx=0 tx=0).stop 2023-11-04T01:38:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.888+0000 7fed41e64640 1 -- 172.21.15.114:0/3223588735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed3c06db20 msgr2=0x7fed3c154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.888+0000 7fed41e64640 1 --2- 172.21.15.114:0/3223588735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed3c06db20 0x7fed3c154380 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00e870 tx=0x7fed2c00ed30 comp rx=0 tx=0).stop 2023-11-04T01:38:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.888+0000 7fed41e64640 1 -- 172.21.15.114:0/3223588735 shutdown_connections 2023-11-04T01:38:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.888+0000 7fed41e64640 1 --2- 172.21.15.114:0/3223588735 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed2806aea0 0x7fed2806d360 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.888+0000 7fed41e64640 1 --2- 172.21.15.114:0/3223588735 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed3c159c70 0x7fed3c0c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.888+0000 7fed41e64640 1 --2- 172.21.15.114:0/3223588735 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed3c0b0ae0 0x7fed3c15b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.888+0000 7fed41e64640 1 --2- 172.21.15.114:0/3223588735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed3c06db20 0x7fed3c154380 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.888+0000 7fed41e64640 1 -- 172.21.15.114:0/3223588735 >> 172.21.15.114:0/3223588735 conn(0x7fed3c0ce950 msgr2=0x7fed3c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.889+0000 7fed41e64640 1 -- 172.21.15.114:0/3223588735 shutdown_connections 2023-11-04T01:38:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:04.889+0000 7fed41e64640 1 -- 172.21.15.114:0/3223588735 wait complete. 2023-11-04T01:38:04.901 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:37:48.832988+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:37:49.974993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:04.902 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:05.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.002+0000 7fa8b8ae7640 1 Processor -- start 2023-11-04T01:38:05.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.002+0000 7fa8b8ae7640 1 -- start start 2023-11-04T01:38:05.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.003+0000 7fa8b8ae7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b41605b0 0x7fa8b40ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.003+0000 7fa8b8ae7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa8b40b1a40 0x7fa8b406a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.003+0000 7fa8b8ae7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b4160990 con 0x7fa8b40ca560 2023-11-04T01:38:05.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.003+0000 7fa8b8ae7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b40cc7c0 con 0x7fa8b40b1a40 2023-11-04T01:38:05.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.003+0000 7fa8b8ae7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40cd750 con 0x7fa8b41605b0 2023-11-04T01:38:05.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.003+0000 7fa8b1d9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa8b40b1a40 0x7fa8b406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.003+0000 7fa8b2d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa8b40ca560 0x7fa8b4160be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60622/0 (socket says 172.21.15.114:60622) 2023-11-04T01:38:05.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.003+0000 7fa8b2d9d640 1 -- 172.21.15.114:0/1701542034 learned_addr learned my addr 172.21.15.114:0/1701542034 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:05.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.003+0000 7fa8b1d9b640 1 -- 172.21.15.114:0/1701542034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b41605b0 msgr2=0x7fa8b40ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:05.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.003+0000 7fa8b1d9b640 1 --2- 172.21.15.114:0/1701542034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b41605b0 0x7fa8b40ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.003+0000 7fa8b1d9b640 1 -- 172.21.15.114:0/1701542034 >> v1:172.21.15.114:6789/0 conn(0x7fa8b40ca560 legacy=0x7fa8b4160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.003+0000 7fa8b1d9b640 1 -- 172.21.15.114:0/1701542034 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b40cc4e0 con 0x7fa8b40b1a40 2023-11-04T01:38:05.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.003+0000 7fa8b159a640 1 -- 172.21.15.114:0/1701542034 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890716764 0 0) 0x7fa8b4160990 con 0x7fa8b40ca560 2023-11-04T01:38:05.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.004+0000 7fa8b1d9b640 1 --2- 172.21.15.114:0/1701542034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b40b1a40 0x7fa8b406a120 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80097a0 tx=0x7fa8a802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e3c05b8b483941 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.004+0000 7fa8b159a640 1 -- 172.21.15.114:0/1701542034 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a802f050 con 0x7fa8b40b1a40 2023-11-04T01:38:05.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.004+0000 7fa8b159a640 1 -- 172.21.15.114:0/1701542034 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a8031700 con 0x7fa8b40b1a40 2023-11-04T01:38:05.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.004+0000 7fa8b159a640 1 -- 172.21.15.114:0/1701542034 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8031a90 con 0x7fa8b40b1a40 2023-11-04T01:38:05.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.004+0000 7fa8b8ae7640 1 -- 172.21.15.114:0/1701542034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b40b1a40 msgr2=0x7fa8b406a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.004+0000 7fa8b8ae7640 1 --2- 172.21.15.114:0/1701542034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b40b1a40 0x7fa8b406a120 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80097a0 tx=0x7fa8a802b7a0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.004+0000 7fa8b8ae7640 1 -- 172.21.15.114:0/1701542034 shutdown_connections 2023-11-04T01:38:05.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.004+0000 7fa8b8ae7640 1 --2- 172.21.15.114:0/1701542034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b40b1a40 0x7fa8b406a120 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.004+0000 7fa8b8ae7640 1 --2- 172.21.15.114:0/1701542034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b41605b0 0x7fa8b40ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.004+0000 7fa8b8ae7640 1 -- 172.21.15.114:0/1701542034 >> 172.21.15.114:0/1701542034 conn(0x7fa8b4071820 msgr2=0x7fa8b4071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:05.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.004+0000 7fa8b8ae7640 1 -- 172.21.15.114:0/1701542034 shutdown_connections 2023-11-04T01:38:05.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.004+0000 7fa8b8ae7640 1 -- 172.21.15.114:0/1701542034 wait complete. 2023-11-04T01:38:05.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.006+0000 7fa8b8ae7640 1 Processor -- start 2023-11-04T01:38:05.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.006+0000 7fa8b8ae7640 1 -- start start 2023-11-04T01:38:05.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.006+0000 7fa8b8ae7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b40ca560 0x7fa8b40c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b8ae7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b41605b0 0x7fa8b4152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b8ae7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa8b41f74f0 0x7fa8b415e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b8ae7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b4152d70 con 0x7fa8b41605b0 2023-11-04T01:38:05.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b8ae7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40b4070 con 0x7fa8b41f74f0 2023-11-04T01:38:05.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b8ae7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b414f790 con 0x7fa8b40ca560 2023-11-04T01:38:05.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b41605b0 0x7fa8b4152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b41605b0 0x7fa8b4152830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43172/0 (socket says 172.21.15.114:43172) 2023-11-04T01:38:05.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b1d9b640 1 -- 172.21.15.114:0/2288128052 learned_addr learned my addr 172.21.15.114:0/2288128052 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:05.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b259c640 1 --2- 172.21.15.114:0/2288128052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b40ca560 0x7fa8b40c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b1d9b640 1 -- 172.21.15.114:0/2288128052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b40ca560 msgr2=0x7fa8b40c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b2d9d640 1 --2- 172.21.15.114:0/2288128052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa8b41f74f0 0x7fa8b415e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b1d9b640 1 --2- 172.21.15.114:0/2288128052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b40ca560 0x7fa8b40c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b1d9b640 1 -- 172.21.15.114:0/2288128052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa8b41f74f0 msgr2=0x7fa8b415e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b1d9b640 1 --2- 172.21.15.114:0/2288128052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa8b41f74f0 0x7fa8b415e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b1d9b640 1 -- 172.21.15.114:0/2288128052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a8009400 con 0x7fa8b41605b0 2023-11-04T01:38:05.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b1d9b640 1 --2- 172.21.15.114:0/2288128052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b41605b0 0x7fa8b4152830 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80097a0 tx=0x7fa8a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8a2ffd640 1 -- 172.21.15.114:0/2288128052 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8033c30 con 0x7fa8b41605b0 2023-11-04T01:38:05.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8a2ffd640 1 -- 172.21.15.114:0/2288128052 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a8033d90 con 0x7fa8b41605b0 2023-11-04T01:38:05.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8a2ffd640 1 -- 172.21.15.114:0/2288128052 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a803d6b0 con 0x7fa8b41605b0 2023-11-04T01:38:05.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b8ae7640 1 -- 172.21.15.114:0/2288128052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b40c7100 con 0x7fa8b41605b0 2023-11-04T01:38:05.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.007+0000 7fa8b8ae7640 1 -- 172.21.15.114:0/2288128052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b40c76c0 con 0x7fa8b41605b0 2023-11-04T01:38:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.009+0000 7fa8b8ae7640 1 -- 172.21.15.114:0/2288128052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b40672a0 con 0x7fa8b41605b0 2023-11-04T01:38:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.009+0000 7fa8a2ffd640 1 -- 172.21.15.114:0/2288128052 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa8a803a040 con 0x7fa8b41605b0 2023-11-04T01:38:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.009+0000 7fa8a2ffd640 1 --2- 172.21.15.114:0/2288128052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa89406ae70 0x7fa89406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.009+0000 7fa8a2ffd640 1 -- 172.21.15.114:0/2288128052 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fa8a80ab780 con 0x7fa8b41605b0 2023-11-04T01:38:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.009+0000 7fa8b259c640 1 --2- 172.21.15.114:0/2288128052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa89406ae70 0x7fa89406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.010+0000 7fa8b259c640 1 --2- 172.21.15.114:0/2288128052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa89406ae70 0x7fa89406d330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40cbb50 tx=0x7fa8a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.013+0000 7fa8a2ffd640 1 -- 172.21.15.114:0/2288128052 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa8a80765e0 con 0x7fa8b41605b0 2023-11-04T01:38:05.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.179+0000 7fa8b8ae7640 1 -- 172.21.15.114:0/2288128052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8b40b41e0 con 0x7fa8b41605b0 2023-11-04T01:38:05.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.180+0000 7fa8a2ffd640 1 -- 172.21.15.114:0/2288128052 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8b40b41e0 con 0x7fa8b41605b0 2023-11-04T01:38:05.182 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:38:05.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.181+0000 7fa8b8ae7640 1 -- 172.21.15.114:0/2288128052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa89406ae70 msgr2=0x7fa89406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.181+0000 7fa8b8ae7640 1 --2- 172.21.15.114:0/2288128052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa89406ae70 0x7fa89406d330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40cbb50 tx=0x7fa8a4008040 comp rx=0 tx=0).stop 2023-11-04T01:38:05.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.181+0000 7fa8b8ae7640 1 -- 172.21.15.114:0/2288128052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b41605b0 msgr2=0x7fa8b4152830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.181+0000 7fa8b8ae7640 1 --2- 172.21.15.114:0/2288128052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b41605b0 0x7fa8b4152830 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80097a0 tx=0x7fa8a80046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.182+0000 7fa8b8ae7640 1 -- 172.21.15.114:0/2288128052 shutdown_connections 2023-11-04T01:38:05.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.182+0000 7fa8b8ae7640 1 --2- 172.21.15.114:0/2288128052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa89406ae70 0x7fa89406d330 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.182+0000 7fa8b8ae7640 1 --2- 172.21.15.114:0/2288128052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa8b41f74f0 0x7fa8b415e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.182+0000 7fa8b8ae7640 1 --2- 172.21.15.114:0/2288128052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b41605b0 0x7fa8b4152830 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.182+0000 7fa8b8ae7640 1 --2- 172.21.15.114:0/2288128052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa8b40ca560 0x7fa8b40c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.182+0000 7fa8b8ae7640 1 -- 172.21.15.114:0/2288128052 >> 172.21.15.114:0/2288128052 conn(0x7fa8b4071820 msgr2=0x7fa8b406a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:05.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.182+0000 7fa8b8ae7640 1 -- 172.21.15.114:0/2288128052 shutdown_connections 2023-11-04T01:38:05.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.182+0000 7fa8b8ae7640 1 -- 172.21.15.114:0/2288128052 wait complete. 2023-11-04T01:38:05.194 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:38:05.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.295+0000 7fb45c99e640 1 Processor -- start 2023-11-04T01:38:05.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.295+0000 7fb45c99e640 1 -- start start 2023-11-04T01:38:05.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.296+0000 7fb45c99e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb458153e60 0x7fb45815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.296+0000 7fb45c99e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb4580cd6d0 0x7fb458161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.296+0000 7fb45c99e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4580cde60 con 0x7fb4580b4880 2023-11-04T01:38:05.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.296+0000 7fb45c99e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb458160f90 con 0x7fb458153e60 2023-11-04T01:38:05.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.296+0000 7fb45c99e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45815e400 con 0x7fb4580cd6d0 2023-11-04T01:38:05.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.296+0000 7fb45659c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb458153e60 0x7fb45815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.296+0000 7fb456d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb4580b4880 0x7fb45806b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60638/0 (socket says 172.21.15.114:60638) 2023-11-04T01:38:05.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.296+0000 7fb456d9d640 1 -- 172.21.15.114:0/4294203593 learned_addr learned my addr 172.21.15.114:0/4294203593 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:05.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.297+0000 7fb455d9b640 1 --2- 172.21.15.114:0/4294203593 >> v2:172.21.15.141:3300/0 conn(0x7fb4580cd6d0 0x7fb458161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.297+0000 7fb45659c640 1 -- 172.21.15.114:0/4294203593 >> v2:172.21.15.141:3300/0 conn(0x7fb4580cd6d0 msgr2=0x7fb458161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:05.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.297+0000 7fb45659c640 1 --2- 172.21.15.114:0/4294203593 >> v2:172.21.15.141:3300/0 conn(0x7fb4580cd6d0 0x7fb458161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.297+0000 7fb45659c640 1 -- 172.21.15.114:0/4294203593 >> v1:172.21.15.114:6789/0 conn(0x7fb4580b4880 legacy=0x7fb45806b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.297+0000 7fb45559a640 1 -- 172.21.15.114:0/4294203593 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041668479 0 0) 0x7fb4580cde60 con 0x7fb4580b4880 2023-11-04T01:38:05.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.297+0000 7fb45659c640 1 -- 172.21.15.114:0/4294203593 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb458161960 con 0x7fb458153e60 2023-11-04T01:38:05.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.297+0000 7fb45659c640 1 --2- 172.21.15.114:0/4294203593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb458153e60 0x7fb45815dec0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb4580c9e80 tx=0x7fb44802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f3e4106836d0f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.297+0000 7fb45559a640 1 -- 172.21.15.114:0/4294203593 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44802cc80 con 0x7fb458153e60 2023-11-04T01:38:05.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.298+0000 7fb45559a640 1 -- 172.21.15.114:0/4294203593 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44802cde0 con 0x7fb458153e60 2023-11-04T01:38:05.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.298+0000 7fb45559a640 1 -- 172.21.15.114:0/4294203593 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448034660 con 0x7fb458153e60 2023-11-04T01:38:05.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.298+0000 7fb45c99e640 1 -- 172.21.15.114:0/4294203593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb458153e60 msgr2=0x7fb45815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.298+0000 7fb45c99e640 1 --2- 172.21.15.114:0/4294203593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb458153e60 0x7fb45815dec0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb4580c9e80 tx=0x7fb44802bed0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.298+0000 7fb45c99e640 1 -- 172.21.15.114:0/4294203593 shutdown_connections 2023-11-04T01:38:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.298+0000 7fb45c99e640 1 --2- 172.21.15.114:0/4294203593 >> v2:172.21.15.141:3300/0 conn(0x7fb4580cd6d0 0x7fb458161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.298+0000 7fb45c99e640 1 --2- 172.21.15.114:0/4294203593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb458153e60 0x7fb45815dec0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.298+0000 7fb45c99e640 1 -- 172.21.15.114:0/4294203593 >> 172.21.15.114:0/4294203593 conn(0x7fb4580cf880 msgr2=0x7fb4580cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.298+0000 7fb45c99e640 1 -- 172.21.15.114:0/4294203593 shutdown_connections 2023-11-04T01:38:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.298+0000 7fb45c99e640 1 -- 172.21.15.114:0/4294203593 wait complete. 2023-11-04T01:38:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.299+0000 7fb45c99e640 1 Processor -- start 2023-11-04T01:38:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.299+0000 7fb45c99e640 1 -- start start 2023-11-04T01:38:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.300+0000 7fb45c99e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4580b4880 0x7fb4580c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.300+0000 7fb45c99e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4580cd6d0 0x7fb45814ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.300+0000 7fb45c99e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb458153e60 0x7fb4580cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.300+0000 7fb45c99e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580c8f00 con 0x7fb4580b4880 2023-11-04T01:38:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.300+0000 7fb45c99e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45814dbb0 con 0x7fb4580cd6d0 2023-11-04T01:38:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.300+0000 7fb45c99e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45814de50 con 0x7fb458153e60 2023-11-04T01:38:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.300+0000 7fb45659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4580b4880 0x7fb4580c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.300+0000 7fb45659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4580b4880 0x7fb4580c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43196/0 (socket says 172.21.15.114:43196) 2023-11-04T01:38:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.300+0000 7fb45659c640 1 -- 172.21.15.114:0/2465688733 learned_addr learned my addr 172.21.15.114:0/2465688733 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.300+0000 7fb455d9b640 1 --2- 172.21.15.114:0/2465688733 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4580cd6d0 0x7fb45814ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.300+0000 7fb456d9d640 1 --2- 172.21.15.114:0/2465688733 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb458153e60 0x7fb4580cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.301+0000 7fb45659c640 1 -- 172.21.15.114:0/2465688733 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb458153e60 msgr2=0x7fb4580cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.301+0000 7fb45659c640 1 --2- 172.21.15.114:0/2465688733 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb458153e60 0x7fb4580cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.301+0000 7fb45659c640 1 -- 172.21.15.114:0/2465688733 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4580cd6d0 msgr2=0x7fb45814ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.301+0000 7fb45659c640 1 --2- 172.21.15.114:0/2465688733 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4580cd6d0 0x7fb45814ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.301+0000 7fb45659c640 1 -- 172.21.15.114:0/2465688733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb448009a70 con 0x7fb4580b4880 2023-11-04T01:38:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.301+0000 7fb456d9d640 1 --2- 172.21.15.114:0/2465688733 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb458153e60 0x7fb4580cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.301+0000 7fb455d9b640 1 --2- 172.21.15.114:0/2465688733 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4580cd6d0 0x7fb45814ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.301+0000 7fb45659c640 1 --2- 172.21.15.114:0/2465688733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4580b4880 0x7fb4580c89c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb448037040 tx=0x7fb448004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.301+0000 7fb446ffd640 1 -- 172.21.15.114:0/2465688733 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448040650 con 0x7fb4580b4880 2023-11-04T01:38:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.301+0000 7fb446ffd640 1 -- 172.21.15.114:0/2465688733 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4480407b0 con 0x7fb4580b4880 2023-11-04T01:38:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.301+0000 7fb45c99e640 1 -- 172.21.15.114:0/2465688733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45814e130 con 0x7fb4580b4880 2023-11-04T01:38:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.301+0000 7fb446ffd640 1 -- 172.21.15.114:0/2465688733 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448040b60 con 0x7fb4580b4880 2023-11-04T01:38:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.301+0000 7fb45c99e640 1 -- 172.21.15.114:0/2465688733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45814e6f0 con 0x7fb4580b4880 2023-11-04T01:38:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.302+0000 7fb45c99e640 1 -- 172.21.15.114:0/2465688733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4580c9c40 con 0x7fb4580b4880 2023-11-04T01:38:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.302+0000 7fb446ffd640 1 -- 172.21.15.114:0/2465688733 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb448040cc0 con 0x7fb4580b4880 2023-11-04T01:38:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.303+0000 7fb446ffd640 1 --2- 172.21.15.114:0/2465688733 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb43806ae70 0x7fb43806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.303+0000 7fb446ffd640 1 -- 172.21.15.114:0/2465688733 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fb4480ac690 con 0x7fb4580b4880 2023-11-04T01:38:05.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.303+0000 7fb455d9b640 1 --2- 172.21.15.114:0/2465688733 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb43806ae70 0x7fb43806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.303+0000 7fb455d9b640 1 --2- 172.21.15.114:0/2465688733 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb43806ae70 0x7fb43806d330 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb4580c92f0 tx=0x7fb44c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.307+0000 7fb446ffd640 1 -- 172.21.15.114:0/2465688733 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb4480774f0 con 0x7fb4580b4880 2023-11-04T01:38:05.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.472+0000 7fb45c99e640 1 -- 172.21.15.114:0/2465688733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb45814e910 con 0x7fb4580b4880 2023-11-04T01:38:05.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.472+0000 7fb446ffd640 1 -- 172.21.15.114:0/2465688733 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb44807ab10 con 0x7fb4580b4880 2023-11-04T01:38:05.475 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:38:05.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.475+0000 7fb45c99e640 1 -- 172.21.15.114:0/2465688733 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb43806ae70 msgr2=0x7fb43806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.475+0000 7fb45c99e640 1 --2- 172.21.15.114:0/2465688733 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb43806ae70 0x7fb43806d330 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb4580c92f0 tx=0x7fb44c008040 comp rx=0 tx=0).stop 2023-11-04T01:38:05.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.475+0000 7fb45c99e640 1 -- 172.21.15.114:0/2465688733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4580b4880 msgr2=0x7fb4580c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.475+0000 7fb45c99e640 1 --2- 172.21.15.114:0/2465688733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4580b4880 0x7fb4580c89c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb448037040 tx=0x7fb448004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:05.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.475+0000 7fb45c99e640 1 -- 172.21.15.114:0/2465688733 shutdown_connections 2023-11-04T01:38:05.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.475+0000 7fb45c99e640 1 --2- 172.21.15.114:0/2465688733 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb458153e60 0x7fb4580cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.475+0000 7fb45c99e640 1 --2- 172.21.15.114:0/2465688733 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb43806ae70 0x7fb43806d330 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.475+0000 7fb45c99e640 1 --2- 172.21.15.114:0/2465688733 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4580cd6d0 0x7fb45814ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.475+0000 7fb45c99e640 1 --2- 172.21.15.114:0/2465688733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4580b4880 0x7fb4580c89c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.475+0000 7fb45c99e640 1 -- 172.21.15.114:0/2465688733 >> 172.21.15.114:0/2465688733 conn(0x7fb4580cf880 msgr2=0x7fb45815fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:05.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.475+0000 7fb45c99e640 1 -- 172.21.15.114:0/2465688733 shutdown_connections 2023-11-04T01:38:05.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.475+0000 7fb45c99e640 1 -- 172.21.15.114:0/2465688733 wait complete. 2023-11-04T01:38:05.487 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:38:05.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.590+0000 7f00b993c640 1 Processor -- start 2023-11-04T01:38:05.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.590+0000 7f00b993c640 1 -- start start 2023-11-04T01:38:05.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.591+0000 7f00b993c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00b40b64c0 0x7f00b40b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.591+0000 7f00b993c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00b40cd3b0 0x7f00b40cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.591+0000 7f00b993c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b40d01f0 con 0x7f00b415af20 2023-11-04T01:38:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.591+0000 7f00b993c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b40cc380 con 0x7f00b40cd3b0 2023-11-04T01:38:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.591+0000 7f00b993c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40cdd80 con 0x7f00b40b64c0 2023-11-04T01:38:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.591+0000 7f00b37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00b40cd3b0 0x7f00b40cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.591+0000 7f00b37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00b40cd3b0 0x7f00b40cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43206/0 (socket says 172.21.15.114:43206) 2023-11-04T01:38:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.591+0000 7f00b37fe640 1 -- 172.21.15.114:0/2385096609 learned_addr learned my addr 172.21.15.114:0/2385096609 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.591+0000 7f00b27fc640 1 --2- 172.21.15.114:0/2385096609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00b40b64c0 0x7f00b40b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.591+0000 7f00b37fe640 1 -- 172.21.15.114:0/2385096609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00b40b64c0 msgr2=0x7f00b40b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.591+0000 7f00b37fe640 1 --2- 172.21.15.114:0/2385096609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00b40b64c0 0x7f00b40b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.591+0000 7f00b37fe640 1 -- 172.21.15.114:0/2385096609 >> v1:172.21.15.141:6789/0 conn(0x7f00b415af20 legacy=0x7f00b40cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.592+0000 7f00b37fe640 1 -- 172.21.15.114:0/2385096609 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b40b6a40 con 0x7f00b40cd3b0 2023-11-04T01:38:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.592+0000 7f00b37fe640 1 --2- 172.21.15.114:0/2385096609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b40cd3b0 0x7f00b40cd840 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009e80 tx=0x7f00ac02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86097f239afcdea server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.592+0000 7f00b1ffb640 1 -- 172.21.15.114:0/2385096609 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac02caf0 con 0x7f00b40cd3b0 2023-11-04T01:38:05.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.592+0000 7f00b1ffb640 1 -- 172.21.15.114:0/2385096609 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ac02cc50 con 0x7f00b40cd3b0 2023-11-04T01:38:05.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.592+0000 7f00b1ffb640 1 -- 172.21.15.114:0/2385096609 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0343f0 con 0x7f00b40cd3b0 2023-11-04T01:38:05.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.593+0000 7f00b993c640 1 -- 172.21.15.114:0/2385096609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b40cd3b0 msgr2=0x7f00b40cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.593+0000 7f00b993c640 1 --2- 172.21.15.114:0/2385096609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b40cd3b0 0x7f00b40cd840 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009e80 tx=0x7f00ac02bf50 comp rx=0 tx=0).stop 2023-11-04T01:38:05.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.593+0000 7f00b993c640 1 -- 172.21.15.114:0/2385096609 shutdown_connections 2023-11-04T01:38:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.593+0000 7f00b993c640 1 --2- 172.21.15.114:0/2385096609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b40cd3b0 0x7f00b40cd840 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.593+0000 7f00b993c640 1 --2- 172.21.15.114:0/2385096609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00b40b64c0 0x7f00b40b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.593+0000 7f00b993c640 1 -- 172.21.15.114:0/2385096609 >> 172.21.15.114:0/2385096609 conn(0x7f00b406ea20 msgr2=0x7f00b406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.593+0000 7f00b993c640 1 -- 172.21.15.114:0/2385096609 shutdown_connections 2023-11-04T01:38:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.593+0000 7f00b993c640 1 -- 172.21.15.114:0/2385096609 wait complete. 2023-11-04T01:38:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.594+0000 7f00b993c640 1 Processor -- start 2023-11-04T01:38:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.594+0000 7f00b993c640 1 -- start start 2023-11-04T01:38:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.595+0000 7f00b993c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00b40b64c0 0x7f00b4156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.595+0000 7f00b993c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f00b40cd3b0 0x7f00b40b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.595+0000 7f00b993c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b415af20 0x7f00b40c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.595+0000 7f00b993c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b414c710 con 0x7f00b415af20 2023-11-04T01:38:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.595+0000 7f00b993c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40c86d0 con 0x7f00b40cd3b0 2023-11-04T01:38:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.595+0000 7f00b993c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b4156e90 con 0x7f00b40b64c0 2023-11-04T01:38:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.595+0000 7f00b37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b415af20 0x7f00b40c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.595+0000 7f00b37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b415af20 0x7f00b40c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43210/0 (socket says 172.21.15.114:43210) 2023-11-04T01:38:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.595+0000 7f00b37fe640 1 -- 172.21.15.114:0/426308895 learned_addr learned my addr 172.21.15.114:0/426308895 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.595+0000 7f00b37fe640 1 -- 172.21.15.114:0/426308895 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00b40b64c0 msgr2=0x7f00b4156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.595+0000 7f00b37fe640 1 --2- 172.21.15.114:0/426308895 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00b40b64c0 0x7f00b4156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.595+0000 7f00b37fe640 1 -- 172.21.15.114:0/426308895 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f00b40cd3b0 msgr2=0x7f00b40b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.595+0000 7f00b37fe640 1 --2- 172.21.15.114:0/426308895 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f00b40cd3b0 0x7f00b40b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.595+0000 7f00b37fe640 1 -- 172.21.15.114:0/426308895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ac009b30 con 0x7f00b415af20 2023-11-04T01:38:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.595+0000 7f00b37fe640 1 --2- 172.21.15.114:0/426308895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b415af20 0x7f00b40c9f10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009fa0 tx=0x7f00ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.596+0000 7f009bfff640 1 -- 172.21.15.114:0/426308895 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac009510 con 0x7f00b415af20 2023-11-04T01:38:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.596+0000 7f009bfff640 1 -- 172.21.15.114:0/426308895 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ac03e450 con 0x7f00b415af20 2023-11-04T01:38:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.596+0000 7f00b993c640 1 -- 172.21.15.114:0/426308895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b40c7da0 con 0x7f00b415af20 2023-11-04T01:38:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.596+0000 7f009bfff640 1 -- 172.21.15.114:0/426308895 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac03e800 con 0x7f00b415af20 2023-11-04T01:38:05.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.596+0000 7f00b993c640 1 -- 172.21.15.114:0/426308895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b40c8360 con 0x7f00b415af20 2023-11-04T01:38:05.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.597+0000 7f00b993c640 1 -- 172.21.15.114:0/426308895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b415e660 con 0x7f00b415af20 2023-11-04T01:38:05.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.597+0000 7f009bfff640 1 -- 172.21.15.114:0/426308895 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f00ac03e960 con 0x7f00b415af20 2023-11-04T01:38:05.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.597+0000 7f009bfff640 1 --2- 172.21.15.114:0/426308895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f00a006ae70 0x7f00a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.597+0000 7f009bfff640 1 -- 172.21.15.114:0/426308895 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f00ac0ac860 con 0x7f00b415af20 2023-11-04T01:38:05.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.597+0000 7f00b2ffd640 1 --2- 172.21.15.114:0/426308895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f00a006ae70 0x7f00a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.598+0000 7f00b2ffd640 1 --2- 172.21.15.114:0/426308895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f00a006ae70 0x7f00a006d330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f00a4000f60 tx=0x7f00a40079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.602+0000 7f009bfff640 1 -- 172.21.15.114:0/426308895 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00ac077800 con 0x7f00b415af20 2023-11-04T01:38:05.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.767+0000 7f00b993c640 1 -- 172.21.15.114:0/426308895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00b40b0120 con 0x7f00b415af20 2023-11-04T01:38:05.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.768+0000 7f009bfff640 1 -- 172.21.15.114:0/426308895 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f00ac07ae20 con 0x7f00b415af20 2023-11-04T01:38:05.770 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:38:05.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.769+0000 7f00b993c640 1 -- 172.21.15.114:0/426308895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f00a006ae70 msgr2=0x7f00a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.769+0000 7f00b993c640 1 --2- 172.21.15.114:0/426308895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f00a006ae70 0x7f00a006d330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f00a4000f60 tx=0x7f00a40079b0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.769+0000 7f00b993c640 1 -- 172.21.15.114:0/426308895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b415af20 msgr2=0x7f00b40c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.769+0000 7f00b993c640 1 --2- 172.21.15.114:0/426308895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b415af20 0x7f00b40c9f10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009fa0 tx=0x7f00ac004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:05.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.770+0000 7f00b993c640 1 -- 172.21.15.114:0/426308895 shutdown_connections 2023-11-04T01:38:05.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.770+0000 7f00b993c640 1 --2- 172.21.15.114:0/426308895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b415af20 0x7f00b40c9f10 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.770+0000 7f00b993c640 1 --2- 172.21.15.114:0/426308895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f00a006ae70 0x7f00a006d330 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.770+0000 7f00b993c640 1 --2- 172.21.15.114:0/426308895 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f00b40cd3b0 0x7f00b40b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.770+0000 7f00b993c640 1 --2- 172.21.15.114:0/426308895 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f00b40b64c0 0x7f00b4156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.770+0000 7f00b993c640 1 -- 172.21.15.114:0/426308895 >> 172.21.15.114:0/426308895 conn(0x7f00b406ea20 msgr2=0x7f00b406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:05.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.770+0000 7f00b993c640 1 -- 172.21.15.114:0/426308895 shutdown_connections 2023-11-04T01:38:05.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.770+0000 7f00b993c640 1 -- 172.21.15.114:0/426308895 wait complete. 2023-11-04T01:38:05.783 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:05.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.883+0000 7eff4aa90640 1 Processor -- start 2023-11-04T01:38:05.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.884+0000 7eff4aa90640 1 -- start start 2023-11-04T01:38:05.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.884+0000 7eff4aa90640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7eff44153e60 0x7eff4415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.884+0000 7eff4aa90640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7eff440cd6d0 0x7eff44161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.884+0000 7eff4aa90640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff440cde60 con 0x7eff440b4880 2023-11-04T01:38:05.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.884+0000 7eff4aa90640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff44160f90 con 0x7eff44153e60 2023-11-04T01:38:05.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.884+0000 7eff4aa90640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4415e400 con 0x7eff440cd6d0 2023-11-04T01:38:05.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.884+0000 7eff4882c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7eff44153e60 0x7eff4415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.884+0000 7eff4882c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7eff44153e60 0x7eff4415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43222/0 (socket says 172.21.15.114:43222) 2023-11-04T01:38:05.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.884+0000 7eff4882c640 1 -- 172.21.15.114:0/492963360 learned_addr learned my addr 172.21.15.114:0/492963360 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:05.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.885+0000 7eff43fff640 1 --2- 172.21.15.114:0/492963360 >> v2:172.21.15.141:3300/0 conn(0x7eff440cd6d0 0x7eff44161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.885+0000 7eff4882c640 1 -- 172.21.15.114:0/492963360 >> v2:172.21.15.141:3300/0 conn(0x7eff440cd6d0 msgr2=0x7eff44161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:05.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.885+0000 7eff4882c640 1 --2- 172.21.15.114:0/492963360 >> v2:172.21.15.141:3300/0 conn(0x7eff440cd6d0 0x7eff44161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.885+0000 7eff4882c640 1 -- 172.21.15.114:0/492963360 >> v1:172.21.15.141:6789/0 conn(0x7eff440b4880 legacy=0x7eff4406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:05.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.885+0000 7eff4882c640 1 -- 172.21.15.114:0/492963360 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff44161960 con 0x7eff44153e60 2023-11-04T01:38:05.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.885+0000 7eff4882c640 1 --2- 172.21.15.114:0/492963360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff44153e60 0x7eff4415dec0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7eff440c9e80 tx=0x7eff3402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e6ce627e55698e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.886+0000 7eff437fe640 1 -- 172.21.15.114:0/492963360 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34031870 con 0x7eff44153e60 2023-11-04T01:38:05.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.886+0000 7eff437fe640 1 -- 172.21.15.114:0/492963360 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff340319d0 con 0x7eff44153e60 2023-11-04T01:38:05.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.886+0000 7eff437fe640 1 -- 172.21.15.114:0/492963360 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34031d60 con 0x7eff44153e60 2023-11-04T01:38:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.886+0000 7eff4aa90640 1 -- 172.21.15.114:0/492963360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff44153e60 msgr2=0x7eff4415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.886+0000 7eff4aa90640 1 --2- 172.21.15.114:0/492963360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff44153e60 0x7eff4415dec0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7eff440c9e80 tx=0x7eff3402b910 comp rx=0 tx=0).stop 2023-11-04T01:38:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.886+0000 7eff4aa90640 1 -- 172.21.15.114:0/492963360 shutdown_connections 2023-11-04T01:38:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.886+0000 7eff4aa90640 1 --2- 172.21.15.114:0/492963360 >> v2:172.21.15.141:3300/0 conn(0x7eff440cd6d0 0x7eff44161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.886+0000 7eff4aa90640 1 --2- 172.21.15.114:0/492963360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff44153e60 0x7eff4415dec0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.886+0000 7eff4aa90640 1 -- 172.21.15.114:0/492963360 >> 172.21.15.114:0/492963360 conn(0x7eff440cf880 msgr2=0x7eff440cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.886+0000 7eff4aa90640 1 -- 172.21.15.114:0/492963360 shutdown_connections 2023-11-04T01:38:05.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.886+0000 7eff4aa90640 1 -- 172.21.15.114:0/492963360 wait complete. 2023-11-04T01:38:05.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.887+0000 7eff4aa90640 1 Processor -- start 2023-11-04T01:38:05.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.887+0000 7eff4aa90640 1 -- start start 2023-11-04T01:38:05.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.888+0000 7eff4aa90640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff440b4880 0x7eff440b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.888+0000 7eff4aa90640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff440cd6d0 0x7eff440cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.888+0000 7eff4aa90640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff44153e60 0x7eff4415ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.888+0000 7eff4aa90640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff440cc290 con 0x7eff440cd6d0 2023-11-04T01:38:05.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.888+0000 7eff4aa90640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff44154240 con 0x7eff44153e60 2023-11-04T01:38:05.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.888+0000 7eff4aa90640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff44154520 con 0x7eff440b4880 2023-11-04T01:38:05.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.888+0000 7eff43fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff440cd6d0 0x7eff440cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.888+0000 7eff43fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff440cd6d0 0x7eff440cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43238/0 (socket says 172.21.15.114:43238) 2023-11-04T01:38:05.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.888+0000 7eff43fff640 1 -- 172.21.15.114:0/2115087417 learned_addr learned my addr 172.21.15.114:0/2115087417 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:05.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.888+0000 7eff4882c640 1 --2- 172.21.15.114:0/2115087417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff440b4880 0x7eff440b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.889+0000 7eff4902d640 1 --2- 172.21.15.114:0/2115087417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff44153e60 0x7eff4415ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.889+0000 7eff43fff640 1 -- 172.21.15.114:0/2115087417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff440b4880 msgr2=0x7eff440b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.889+0000 7eff43fff640 1 --2- 172.21.15.114:0/2115087417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff440b4880 0x7eff440b7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.889+0000 7eff43fff640 1 -- 172.21.15.114:0/2115087417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff44153e60 msgr2=0x7eff4415ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:05.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.889+0000 7eff43fff640 1 --2- 172.21.15.114:0/2115087417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff44153e60 0x7eff4415ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:05.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.889+0000 7eff43fff640 1 -- 172.21.15.114:0/2115087417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff340094d0 con 0x7eff440cd6d0 2023-11-04T01:38:05.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.889+0000 7eff43fff640 1 --2- 172.21.15.114:0/2115087417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff440cd6d0 0x7eff440cb8b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7eff3800d800 tx=0x7eff3800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.889+0000 7eff417fa640 1 -- 172.21.15.114:0/2115087417 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3800b6c0 con 0x7eff440cd6d0 2023-11-04T01:38:05.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.889+0000 7eff417fa640 1 -- 172.21.15.114:0/2115087417 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3800b820 con 0x7eff440cd6d0 2023-11-04T01:38:05.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.889+0000 7eff4aa90640 1 -- 172.21.15.114:0/2115087417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff44154800 con 0x7eff440cd6d0 2023-11-04T01:38:05.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.889+0000 7eff417fa640 1 -- 172.21.15.114:0/2115087417 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3800bbb0 con 0x7eff440cd6d0 2023-11-04T01:38:05.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.889+0000 7eff4aa90640 1 -- 172.21.15.114:0/2115087417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff440b77d0 con 0x7eff440cd6d0 2023-11-04T01:38:05.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.890+0000 7eff4aa90640 1 -- 172.21.15.114:0/2115087417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff440b7960 con 0x7eff440cd6d0 2023-11-04T01:38:05.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.890+0000 7eff417fa640 1 -- 172.21.15.114:0/2115087417 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff3800bd10 con 0x7eff440cd6d0 2023-11-04T01:38:05.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.891+0000 7eff417fa640 1 --2- 172.21.15.114:0/2115087417 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7eff3006aea0 0x7eff3006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:05.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.891+0000 7eff4882c640 1 --2- 172.21.15.114:0/2115087417 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7eff3006aea0 0x7eff3006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:05.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.891+0000 7eff417fa640 1 -- 172.21.15.114:0/2115087417 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7eff38089da0 con 0x7eff440cd6d0 2023-11-04T01:38:05.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.891+0000 7eff4882c640 1 --2- 172.21.15.114:0/2115087417 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7eff3006aea0 0x7eff3006d360 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7eff34036000 tx=0x7eff3403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:05.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:05.895+0000 7eff417fa640 1 -- 172.21.15.114:0/2115087417 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7eff38054c20 con 0x7eff440cd6d0 2023-11-04T01:38:06.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.063+0000 7eff4aa90640 1 -- 172.21.15.114:0/2115087417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7eff44074290 con 0x7eff440cd6d0 2023-11-04T01:38:06.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.064+0000 7eff417fa640 1 -- 172.21.15.114:0/2115087417 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v42) v1 ==== 103+0+11 (secure 0 0 0) 0x7eff38058240 con 0x7eff440cd6d0 2023-11-04T01:38:06.066 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:38:06.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.066+0000 7eff4aa90640 1 -- 172.21.15.114:0/2115087417 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7eff3006aea0 msgr2=0x7eff3006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.066+0000 7eff4aa90640 1 --2- 172.21.15.114:0/2115087417 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7eff3006aea0 0x7eff3006d360 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7eff34036000 tx=0x7eff3403c040 comp rx=0 tx=0).stop 2023-11-04T01:38:06.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.066+0000 7eff4aa90640 1 -- 172.21.15.114:0/2115087417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff440cd6d0 msgr2=0x7eff440cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.066+0000 7eff4aa90640 1 --2- 172.21.15.114:0/2115087417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff440cd6d0 0x7eff440cb8b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7eff3800d800 tx=0x7eff3800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.066+0000 7eff4aa90640 1 -- 172.21.15.114:0/2115087417 shutdown_connections 2023-11-04T01:38:06.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.066+0000 7eff4aa90640 1 --2- 172.21.15.114:0/2115087417 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7eff3006aea0 0x7eff3006d360 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.066+0000 7eff4aa90640 1 --2- 172.21.15.114:0/2115087417 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff44153e60 0x7eff4415ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.066+0000 7eff4aa90640 1 --2- 172.21.15.114:0/2115087417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff440cd6d0 0x7eff440cb8b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.066+0000 7eff4aa90640 1 --2- 172.21.15.114:0/2115087417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff440b4880 0x7eff440b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.066+0000 7eff4aa90640 1 -- 172.21.15.114:0/2115087417 >> 172.21.15.114:0/2115087417 conn(0x7eff440cf880 msgr2=0x7eff4415fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:06.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.066+0000 7eff4aa90640 1 -- 172.21.15.114:0/2115087417 shutdown_connections 2023-11-04T01:38:06.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.066+0000 7eff4aa90640 1 -- 172.21.15.114:0/2115087417 wait complete. 2023-11-04T01:38:06.079 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:06.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.177+0000 7f845026f640 1 Processor -- start 2023-11-04T01:38:06.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.177+0000 7f845026f640 1 -- start start 2023-11-04T01:38:06.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f845026f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8448159c70 0x7f84480ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f845026f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f844806db20 0x7f84480b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f845026f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f84480b0910 0x7f844815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f845026f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84480b49b0 con 0x7f844806db20 2023-11-04T01:38:06.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f845026f640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84480b0da0 con 0x7f84480b0910 2023-11-04T01:38:06.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f845026f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84480b4110 con 0x7f8448159c70 2023-11-04T01:38:06.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f844d80a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f844806db20 0x7f84480b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f844d80a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f844806db20 0x7f84480b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43250/0 (socket says 172.21.15.114:43250) 2023-11-04T01:38:06.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f844d80a640 1 -- 172.21.15.114:0/2855039533 learned_addr learned my addr 172.21.15.114:0/2855039533 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:06.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f844e00b640 1 --2- 172.21.15.114:0/2855039533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8448159c70 0x7f84480ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f844e80c640 1 --2- 172.21.15.114:0/2855039533 >> v2:172.21.15.141:3300/0 conn(0x7f84480b0910 0x7f844815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f844d80a640 1 -- 172.21.15.114:0/2855039533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8448159c70 msgr2=0x7f84480ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:06.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f844d80a640 1 --2- 172.21.15.114:0/2855039533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8448159c70 0x7f84480ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f844d80a640 1 -- 172.21.15.114:0/2855039533 >> v2:172.21.15.141:3300/0 conn(0x7f84480b0910 msgr2=0x7f844815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:06.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f844d80a640 1 --2- 172.21.15.114:0/2855039533 >> v2:172.21.15.141:3300/0 conn(0x7f84480b0910 0x7f844815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f844d80a640 1 -- 172.21.15.114:0/2855039533 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84480b43f0 con 0x7f844806db20 2023-11-04T01:38:06.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.178+0000 7f844e00b640 1 --2- 172.21.15.114:0/2855039533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8448159c70 0x7f84480ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:06.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.179+0000 7f844d80a640 1 --2- 172.21.15.114:0/2855039533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f844806db20 0x7f84480b03d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f84480ca130 tx=0x7f843802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926cfd66992f14de server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.179+0000 7f844d009640 1 -- 172.21.15.114:0/2855039533 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8438031870 con 0x7f844806db20 2023-11-04T01:38:06.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.179+0000 7f844d009640 1 -- 172.21.15.114:0/2855039533 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84380319d0 con 0x7f844806db20 2023-11-04T01:38:06.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.179+0000 7f844d009640 1 -- 172.21.15.114:0/2855039533 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8438031d60 con 0x7f844806db20 2023-11-04T01:38:06.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.180+0000 7f845026f640 1 -- 172.21.15.114:0/2855039533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f844806db20 msgr2=0x7f84480b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.180+0000 7f845026f640 1 --2- 172.21.15.114:0/2855039533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f844806db20 0x7f84480b03d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f84480ca130 tx=0x7f843802b910 comp rx=0 tx=0).stop 2023-11-04T01:38:06.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.180+0000 7f845026f640 1 -- 172.21.15.114:0/2855039533 shutdown_connections 2023-11-04T01:38:06.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.180+0000 7f845026f640 1 --2- 172.21.15.114:0/2855039533 >> v2:172.21.15.141:3300/0 conn(0x7f84480b0910 0x7f844815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.180+0000 7f845026f640 1 --2- 172.21.15.114:0/2855039533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f844806db20 0x7f84480b03d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.180+0000 7f845026f640 1 --2- 172.21.15.114:0/2855039533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8448159c70 0x7f84480ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.180+0000 7f845026f640 1 -- 172.21.15.114:0/2855039533 >> 172.21.15.114:0/2855039533 conn(0x7f84480ce950 msgr2=0x7f84480ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:06.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.180+0000 7f845026f640 1 -- 172.21.15.114:0/2855039533 shutdown_connections 2023-11-04T01:38:06.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.180+0000 7f845026f640 1 -- 172.21.15.114:0/2855039533 wait complete. 2023-11-04T01:38:06.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.181+0000 7f845026f640 1 Processor -- start 2023-11-04T01:38:06.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.181+0000 7f845026f640 1 -- start start 2023-11-04T01:38:06.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f845026f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f844806db20 0x7f844815b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f845026f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84480b0910 0x7f8448149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f845026f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8448159c70 0x7f844815c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f845026f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844815b1d0 con 0x7f84480b0910 2023-11-04T01:38:06.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f845026f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844815a5c0 con 0x7f844806db20 2023-11-04T01:38:06.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f845026f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844815a8a0 con 0x7f8448159c70 2023-11-04T01:38:06.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f844d80a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84480b0910 0x7f8448149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f844d80a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84480b0910 0x7f8448149d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43264/0 (socket says 172.21.15.114:43264) 2023-11-04T01:38:06.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f844d80a640 1 -- 172.21.15.114:0/2554648506 learned_addr learned my addr 172.21.15.114:0/2554648506 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:06.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f844e00b640 1 --2- 172.21.15.114:0/2554648506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f844806db20 0x7f844815b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f844e80c640 1 --2- 172.21.15.114:0/2554648506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8448159c70 0x7f844815c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f844d80a640 1 -- 172.21.15.114:0/2554648506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8448159c70 msgr2=0x7f844815c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f844d80a640 1 --2- 172.21.15.114:0/2554648506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8448159c70 0x7f844815c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f844d80a640 1 -- 172.21.15.114:0/2554648506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f844806db20 msgr2=0x7f844815b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f844d80a640 1 --2- 172.21.15.114:0/2554648506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f844806db20 0x7f844815b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f844d80a640 1 -- 172.21.15.114:0/2554648506 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84380094d0 con 0x7f84480b0910 2023-11-04T01:38:06.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f844d80a640 1 --2- 172.21.15.114:0/2554648506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84480b0910 0x7f8448149d10 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8438000c00 tx=0x7f8438004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.182+0000 7f843effd640 1 -- 172.21.15.114:0/2554648506 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843803bb80 con 0x7f84480b0910 2023-11-04T01:38:06.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.183+0000 7f843effd640 1 -- 172.21.15.114:0/2554648506 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843803bce0 con 0x7f84480b0910 2023-11-04T01:38:06.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.183+0000 7f843effd640 1 -- 172.21.15.114:0/2554648506 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8438045610 con 0x7f84480b0910 2023-11-04T01:38:06.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.183+0000 7f845026f640 1 -- 172.21.15.114:0/2554648506 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844815ab80 con 0x7f84480b0910 2023-11-04T01:38:06.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.183+0000 7f845026f640 1 -- 172.21.15.114:0/2554648506 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844814a250 con 0x7f84480b0910 2023-11-04T01:38:06.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.183+0000 7f845026f640 1 -- 172.21.15.114:0/2554648506 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f844815b340 con 0x7f84480b0910 2023-11-04T01:38:06.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.184+0000 7f843effd640 1 -- 172.21.15.114:0/2554648506 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f84380303c0 con 0x7f84480b0910 2023-11-04T01:38:06.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.184+0000 7f843effd640 1 --2- 172.21.15.114:0/2554648506 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f842c06aea0 0x7f842c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.184+0000 7f843effd640 1 -- 172.21.15.114:0/2554648506 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f843802d040 con 0x7f84480b0910 2023-11-04T01:38:06.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.184+0000 7f844e00b640 1 --2- 172.21.15.114:0/2554648506 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f842c06aea0 0x7f842c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.185+0000 7f844e00b640 1 --2- 172.21.15.114:0/2554648506 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f842c06aea0 0x7f842c06d360 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8444007510 tx=0x7f84440074a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.188+0000 7f843effd640 1 -- 172.21.15.114:0/2554648506 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8438078780 con 0x7f84480b0910 2023-11-04T01:38:06.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.389+0000 7f845026f640 1 -- 172.21.15.114:0/2554648506 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8448074290 con 0x7f84480b0910 2023-11-04T01:38:06.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.390+0000 7f843effd640 1 -- 172.21.15.114:0/2554648506 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f843804a090 con 0x7f84480b0910 2023-11-04T01:38:06.392 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:06.392 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5218,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/3821610653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":3821610653},{"type":"v1","addr":"172.21.15.141:6834","nonce":3821610653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2452742541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2452742541},{"type":"v1","addr":"172.21.15.114:6835","nonce":2452742541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3407147888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3407147888},{"type":"v1","addr":"172.21.15.114:6837","nonce":3407147888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:50.993779+0000","modified":"2023-11-04T01:37:53.001589+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5565":{"gid":5565,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6835/3122131633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3122131633},{"type":"v1","addr":"172.21.15.141:6835","nonce":3122131633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:38:06.392 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 16 2023-11-04T01:38:06.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.391+0000 7f845026f640 1 -- 172.21.15.114:0/2554648506 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f842c06aea0 msgr2=0x7f842c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.391+0000 7f845026f640 1 --2- 172.21.15.114:0/2554648506 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f842c06aea0 0x7f842c06d360 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8444007510 tx=0x7f84440074a0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.392+0000 7f845026f640 1 -- 172.21.15.114:0/2554648506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84480b0910 msgr2=0x7f8448149d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.392+0000 7f845026f640 1 --2- 172.21.15.114:0/2554648506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84480b0910 0x7f8448149d10 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8438000c00 tx=0x7f8438004730 comp rx=0 tx=0).stop 2023-11-04T01:38:06.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.392+0000 7f845026f640 1 -- 172.21.15.114:0/2554648506 shutdown_connections 2023-11-04T01:38:06.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.392+0000 7f845026f640 1 --2- 172.21.15.114:0/2554648506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8448159c70 0x7f844815c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.392+0000 7f845026f640 1 --2- 172.21.15.114:0/2554648506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84480b0910 0x7f8448149d10 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.392+0000 7f845026f640 1 --2- 172.21.15.114:0/2554648506 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f842c06aea0 0x7f842c06d360 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.392+0000 7f845026f640 1 --2- 172.21.15.114:0/2554648506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f844806db20 0x7f844815b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.392+0000 7f845026f640 1 -- 172.21.15.114:0/2554648506 >> 172.21.15.114:0/2554648506 conn(0x7f84480ce950 msgr2=0x7f8448157fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:06.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.392+0000 7f845026f640 1 -- 172.21.15.114:0/2554648506 shutdown_connections 2023-11-04T01:38:06.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.392+0000 7f845026f640 1 -- 172.21.15.114:0/2554648506 wait complete. 2023-11-04T01:38:06.404 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:06.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.501+0000 7fcb7f755640 1 Processor -- start 2023-11-04T01:38:06.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.502+0000 7fcb7f755640 1 -- start start 2023-11-04T01:38:06.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.502+0000 7fcb7f755640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fcb7815ab70 0x7fcb780cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.502+0000 7fcb7f755640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcb7806eba0 0x7fcb7806a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.502+0000 7fcb7f755640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7806aa70 con 0x7fcb7806a660 2023-11-04T01:38:06.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.502+0000 7fcb7f755640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb780cba70 con 0x7fcb7806eba0 2023-11-04T01:38:06.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.502+0000 7fcb7f755640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb78161c50 con 0x7fcb7815ab70 2023-11-04T01:38:06.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.503+0000 7fcb7ccf0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcb7806eba0 0x7fcb7806a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.503+0000 7fcb7dcf2640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcb7806a660 0x7fcb780ae5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53758/0 (socket says 172.21.15.114:53758) 2023-11-04T01:38:06.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.503+0000 7fcb7dcf2640 1 -- 172.21.15.114:0/2597317612 learned_addr learned my addr 172.21.15.114:0/2597317612 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:06.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.503+0000 7fcb7d4f1640 1 --2- 172.21.15.114:0/2597317612 >> v2:172.21.15.141:3300/0 conn(0x7fcb7815ab70 0x7fcb780cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.503+0000 7fcb7ccf0640 1 -- 172.21.15.114:0/2597317612 >> v2:172.21.15.141:3300/0 conn(0x7fcb7815ab70 msgr2=0x7fcb780cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:06.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.503+0000 7fcb7ccf0640 1 --2- 172.21.15.114:0/2597317612 >> v2:172.21.15.141:3300/0 conn(0x7fcb7815ab70 0x7fcb780cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.503+0000 7fcb7ccf0640 1 -- 172.21.15.114:0/2597317612 >> v1:172.21.15.114:6789/0 conn(0x7fcb7806a660 legacy=0x7fcb780ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.503+0000 7fcb6ffff640 1 -- 172.21.15.114:0/2597317612 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459190992 0 0) 0x7fcb7806aa70 con 0x7fcb7806a660 2023-11-04T01:38:06.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.503+0000 7fcb7ccf0640 1 -- 172.21.15.114:0/2597317612 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7806d310 con 0x7fcb7806eba0 2023-11-04T01:38:06.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.504+0000 7fcb7ccf0640 1 --2- 172.21.15.114:0/2597317612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb7806eba0 0x7fcb7806a120 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fcb780b2600 tx=0x7fcb7402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801b3a2af6a4debb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.504+0000 7fcb6ffff640 1 -- 172.21.15.114:0/2597317612 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7402e070 con 0x7fcb7806eba0 2023-11-04T01:38:06.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.504+0000 7fcb6ffff640 1 -- 172.21.15.114:0/2597317612 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb740315a0 con 0x7fcb7806eba0 2023-11-04T01:38:06.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.504+0000 7fcb6ffff640 1 -- 172.21.15.114:0/2597317612 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb74031930 con 0x7fcb7806eba0 2023-11-04T01:38:06.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.504+0000 7fcb7f755640 1 -- 172.21.15.114:0/2597317612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb7806eba0 msgr2=0x7fcb7806a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.504+0000 7fcb7f755640 1 --2- 172.21.15.114:0/2597317612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb7806eba0 0x7fcb7806a120 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fcb780b2600 tx=0x7fcb7402b840 comp rx=0 tx=0).stop 2023-11-04T01:38:06.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.504+0000 7fcb7f755640 1 -- 172.21.15.114:0/2597317612 shutdown_connections 2023-11-04T01:38:06.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.504+0000 7fcb7f755640 1 --2- 172.21.15.114:0/2597317612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb7806eba0 0x7fcb7806a120 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.504+0000 7fcb7f755640 1 --2- 172.21.15.114:0/2597317612 >> v2:172.21.15.141:3300/0 conn(0x7fcb7815ab70 0x7fcb780cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.504+0000 7fcb7f755640 1 -- 172.21.15.114:0/2597317612 >> 172.21.15.114:0/2597317612 conn(0x7fcb78098d40 msgr2=0x7fcb780cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:06.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.504+0000 7fcb7f755640 1 -- 172.21.15.114:0/2597317612 shutdown_connections 2023-11-04T01:38:06.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.504+0000 7fcb7f755640 1 -- 172.21.15.114:0/2597317612 wait complete. 2023-11-04T01:38:06.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.505+0000 7fcb7f755640 1 Processor -- start 2023-11-04T01:38:06.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.506+0000 7fcb7f755640 1 -- start start 2023-11-04T01:38:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.506+0000 7fcb7f755640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcb7806a660 0x7fcb78157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.506+0000 7fcb7f755640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcb7806eba0 0x7fcb780b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.506+0000 7fcb7f755640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb7815ab70 0x7fcb7806dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.506+0000 7fcb7f755640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb781575c0 con 0x7fcb7815ab70 2023-11-04T01:38:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.506+0000 7fcb7f755640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb780b5570 con 0x7fcb7806eba0 2023-11-04T01:38:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.506+0000 7fcb7f755640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb780c4b00 con 0x7fcb7806a660 2023-11-04T01:38:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.506+0000 7fcb7dcf2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb7815ab70 0x7fcb7806dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.506+0000 7fcb7dcf2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb7815ab70 0x7fcb7806dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57894/0 (socket says 172.21.15.114:57894) 2023-11-04T01:38:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.506+0000 7fcb7dcf2640 1 -- 172.21.15.114:0/3798591589 learned_addr learned my addr 172.21.15.114:0/3798591589 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.507+0000 7fcb7ccf0640 1 --2- 172.21.15.114:0/3798591589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcb7806eba0 0x7fcb780b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.507+0000 7fcb7d4f1640 1 --2- 172.21.15.114:0/3798591589 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcb7806a660 0x7fcb78157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.507+0000 7fcb7dcf2640 1 -- 172.21.15.114:0/3798591589 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcb7806a660 msgr2=0x7fcb78157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.507+0000 7fcb7dcf2640 1 --2- 172.21.15.114:0/3798591589 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcb7806a660 0x7fcb78157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.507+0000 7fcb7dcf2640 1 -- 172.21.15.114:0/3798591589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcb7806eba0 msgr2=0x7fcb780b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.507+0000 7fcb7dcf2640 1 --2- 172.21.15.114:0/3798591589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcb7806eba0 0x7fcb780b5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.507+0000 7fcb7dcf2640 1 -- 172.21.15.114:0/3798591589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb740093a0 con 0x7fcb7815ab70 2023-11-04T01:38:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.507+0000 7fcb7dcf2640 1 --2- 172.21.15.114:0/3798591589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb7815ab70 0x7fcb7806dfd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000c780 tx=0x7fcb7000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.507+0000 7fcb6dffb640 1 -- 172.21.15.114:0/3798591589 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7000ce90 con 0x7fcb7815ab70 2023-11-04T01:38:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.507+0000 7fcb6dffb640 1 -- 172.21.15.114:0/3798591589 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7000a640 con 0x7fcb7815ab70 2023-11-04T01:38:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.507+0000 7fcb7f755640 1 -- 172.21.15.114:0/3798591589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb780c4de0 con 0x7fcb7815ab70 2023-11-04T01:38:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.507+0000 7fcb6dffb640 1 -- 172.21.15.114:0/3798591589 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7000a9d0 con 0x7fcb7815ab70 2023-11-04T01:38:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.507+0000 7fcb7f755640 1 -- 172.21.15.114:0/3798591589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb780c53a0 con 0x7fcb7815ab70 2023-11-04T01:38:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.508+0000 7fcb7f755640 1 -- 172.21.15.114:0/3798591589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb78074290 con 0x7fcb7815ab70 2023-11-04T01:38:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.508+0000 7fcb6dffb640 1 -- 172.21.15.114:0/3798591589 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb7000ab30 con 0x7fcb7815ab70 2023-11-04T01:38:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.509+0000 7fcb6dffb640 1 --2- 172.21.15.114:0/3798591589 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcb5c06ae70 0x7fcb5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.509+0000 7fcb6dffb640 1 -- 172.21.15.114:0/3798591589 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fcb70089060 con 0x7fcb7815ab70 2023-11-04T01:38:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.509+0000 7fcb7d4f1640 1 --2- 172.21.15.114:0/3798591589 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcb5c06ae70 0x7fcb5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.509+0000 7fcb7d4f1640 1 --2- 172.21.15.114:0/3798591589 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcb5c06ae70 0x7fcb5c06d330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009770 tx=0x7fcb68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.513+0000 7fcb6dffb640 1 -- 172.21.15.114:0/3798591589 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcb70053ee0 con 0x7fcb7815ab70 2023-11-04T01:38:06.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.683+0000 7fcb7f755640 1 -- 172.21.15.114:0/3798591589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb7806d5d0 con 0x7fcb7815ab70 2023-11-04T01:38:06.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.685+0000 7fcb6dffb640 1 -- 172.21.15.114:0/3798591589 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18630 (secure 0 0 0) 0x7fcb70018090 con 0x7fcb7815ab70 2023-11-04T01:38:06.687 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:06.687 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":42,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:05.551741+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:48.832988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:49.974993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:06.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.687+0000 7fcb7f755640 1 -- 172.21.15.114:0/3798591589 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcb5c06ae70 msgr2=0x7fcb5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.687+0000 7fcb7f755640 1 --2- 172.21.15.114:0/3798591589 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcb5c06ae70 0x7fcb5c06d330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009770 tx=0x7fcb68008040 comp rx=0 tx=0).stop 2023-11-04T01:38:06.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.687+0000 7fcb7f755640 1 -- 172.21.15.114:0/3798591589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb7815ab70 msgr2=0x7fcb7806dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.687+0000 7fcb7f755640 1 --2- 172.21.15.114:0/3798591589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb7815ab70 0x7fcb7806dfd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000c780 tx=0x7fcb7000cc40 comp rx=0 tx=0).stop 2023-11-04T01:38:06.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.687+0000 7fcb7f755640 1 -- 172.21.15.114:0/3798591589 shutdown_connections 2023-11-04T01:38:06.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.687+0000 7fcb7f755640 1 --2- 172.21.15.114:0/3798591589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb7815ab70 0x7fcb7806dfd0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.687+0000 7fcb7f755640 1 --2- 172.21.15.114:0/3798591589 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcb5c06ae70 0x7fcb5c06d330 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.687+0000 7fcb7f755640 1 --2- 172.21.15.114:0/3798591589 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcb7806eba0 0x7fcb780b5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.687+0000 7fcb7f755640 1 --2- 172.21.15.114:0/3798591589 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcb7806a660 0x7fcb78157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.687+0000 7fcb7f755640 1 -- 172.21.15.114:0/3798591589 >> 172.21.15.114:0/3798591589 conn(0x7fcb78098d40 msgr2=0x7fcb780cf140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:06.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.687+0000 7fcb7f755640 1 -- 172.21.15.114:0/3798591589 shutdown_connections 2023-11-04T01:38:06.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.687+0000 7fcb7f755640 1 -- 172.21.15.114:0/3798591589 wait complete. 2023-11-04T01:38:06.699 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:38:06.700 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:06.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.798+0000 7f758661a640 1 Processor -- start 2023-11-04T01:38:06.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.798+0000 7f758661a640 1 -- start start 2023-11-04T01:38:06.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f758661a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f758015ce70 0x7f758006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f758661a640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f758015d250 0x7f75800c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f758661a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75800c9d70 0x7f75800ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f758661a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75800cdc10 con 0x7f758015ce70 2023-11-04T01:38:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f758661a640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f758006a120 con 0x7f758015d250 2023-11-04T01:38:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f758661a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758006def0 con 0x7f75800c9d70 2023-11-04T01:38:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f757ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f758015ce70 0x7f758006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f757ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f758015ce70 0x7f758006d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57898/0 (socket says 172.21.15.114:57898) 2023-11-04T01:38:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f757ffff640 1 -- 172.21.15.114:0/3913431111 learned_addr learned my addr 172.21.15.114:0/3913431111 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f757f7fe640 1 --2- 172.21.15.114:0/3913431111 >> v2:172.21.15.141:3300/0 conn(0x7f758015d250 0x7f75800c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f7584bb7640 1 --2- 172.21.15.114:0/3913431111 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75800c9d70 0x7f75800ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f757ffff640 1 -- 172.21.15.114:0/3913431111 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75800c9d70 msgr2=0x7f75800ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f757ffff640 1 --2- 172.21.15.114:0/3913431111 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75800c9d70 0x7f75800ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f757ffff640 1 -- 172.21.15.114:0/3913431111 >> v2:172.21.15.141:3300/0 conn(0x7f758015d250 msgr2=0x7f75800c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f757ffff640 1 --2- 172.21.15.114:0/3913431111 >> v2:172.21.15.141:3300/0 conn(0x7f758015d250 0x7f75800c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f757ffff640 1 -- 172.21.15.114:0/3913431111 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758006a370 con 0x7f758015ce70 2023-11-04T01:38:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f757f7fe640 1 --2- 172.21.15.114:0/3913431111 >> v2:172.21.15.141:3300/0 conn(0x7f758015d250 0x7f75800c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.799+0000 7f7584bb7640 1 --2- 172.21.15.114:0/3913431111 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75800c9d70 0x7f75800ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.800+0000 7f757ffff640 1 --2- 172.21.15.114:0/3913431111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f758015ce70 0x7f758006d9b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f75800d02c0 tx=0x7f757002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882ec8c84e46b90b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.800+0000 7f757effd640 1 -- 172.21.15.114:0/3913431111 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570031860 con 0x7f758015ce70 2023-11-04T01:38:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.800+0000 7f757effd640 1 -- 172.21.15.114:0/3913431111 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75700319c0 con 0x7f758015ce70 2023-11-04T01:38:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.800+0000 7f757effd640 1 -- 172.21.15.114:0/3913431111 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570031d50 con 0x7f758015ce70 2023-11-04T01:38:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.801+0000 7f758661a640 1 -- 172.21.15.114:0/3913431111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f758015ce70 msgr2=0x7f758006d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.801+0000 7f758661a640 1 --2- 172.21.15.114:0/3913431111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f758015ce70 0x7f758006d9b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f75800d02c0 tx=0x7f757002b900 comp rx=0 tx=0).stop 2023-11-04T01:38:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.801+0000 7f758661a640 1 -- 172.21.15.114:0/3913431111 shutdown_connections 2023-11-04T01:38:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.801+0000 7f758661a640 1 --2- 172.21.15.114:0/3913431111 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75800c9d70 0x7f75800ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.801+0000 7f758661a640 1 --2- 172.21.15.114:0/3913431111 >> v2:172.21.15.141:3300/0 conn(0x7f758015d250 0x7f75800c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.801+0000 7f758661a640 1 --2- 172.21.15.114:0/3913431111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f758015ce70 0x7f758006d9b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.801+0000 7f758661a640 1 -- 172.21.15.114:0/3913431111 >> 172.21.15.114:0/3913431111 conn(0x7f75800b0cd0 msgr2=0x7f75800b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.801+0000 7f758661a640 1 -- 172.21.15.114:0/3913431111 shutdown_connections 2023-11-04T01:38:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.801+0000 7f758661a640 1 -- 172.21.15.114:0/3913431111 wait complete. 2023-11-04T01:38:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.802+0000 7f758661a640 1 Processor -- start 2023-11-04T01:38:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.802+0000 7f758661a640 1 -- start start 2023-11-04T01:38:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f758661a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f758015ce70 0x7f758014a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f758661a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f758015d250 0x7f7580151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f758661a640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7580151890 0x7f758006b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f758661a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75801507a0 con 0x7f758015d250 2023-11-04T01:38:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f758661a640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75800c9090 con 0x7f7580151890 2023-11-04T01:38:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f758661a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7580156660 con 0x7f758015ce70 2023-11-04T01:38:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f757f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f758015d250 0x7f7580151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f757f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f758015d250 0x7f7580151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57908/0 (socket says 172.21.15.114:57908) 2023-11-04T01:38:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f757f7fe640 1 -- 172.21.15.114:0/2632781855 learned_addr learned my addr 172.21.15.114:0/2632781855 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f757ffff640 1 --2- 172.21.15.114:0/2632781855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f758015ce70 0x7f758014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f7584bb7640 1 --2- 172.21.15.114:0/2632781855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7580151890 0x7f758006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f757f7fe640 1 -- 172.21.15.114:0/2632781855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f758015ce70 msgr2=0x7f758014a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f757f7fe640 1 --2- 172.21.15.114:0/2632781855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f758015ce70 0x7f758014a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f757f7fe640 1 -- 172.21.15.114:0/2632781855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7580151890 msgr2=0x7f758006b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f757f7fe640 1 --2- 172.21.15.114:0/2632781855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7580151890 0x7f758006b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f757f7fe640 1 -- 172.21.15.114:0/2632781855 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75700094d0 con 0x7f758015d250 2023-11-04T01:38:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f7584bb7640 1 --2- 172.21.15.114:0/2632781855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7580151890 0x7f758006b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f757ffff640 1 --2- 172.21.15.114:0/2632781855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f758015ce70 0x7f758014a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f757f7fe640 1 --2- 172.21.15.114:0/2632781855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f758015d250 0x7f7580151350 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f757400c7f0 tx=0x7f757400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f757cff9640 1 -- 172.21.15.114:0/2632781855 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574007820 con 0x7f758015d250 2023-11-04T01:38:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f757cff9640 1 -- 172.21.15.114:0/2632781855 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7574007980 con 0x7f758015d250 2023-11-04T01:38:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f758661a640 1 -- 172.21.15.114:0/2632781855 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7580156940 con 0x7f758015d250 2023-11-04T01:38:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f757cff9640 1 -- 172.21.15.114:0/2632781855 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574007d30 con 0x7f758015d250 2023-11-04T01:38:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.803+0000 7f758661a640 1 -- 172.21.15.114:0/2632781855 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758014a9b0 con 0x7f758015d250 2023-11-04T01:38:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.804+0000 7f758661a640 1 -- 172.21.15.114:0/2632781855 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7580074290 con 0x7f758015d250 2023-11-04T01:38:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.805+0000 7f757cff9640 1 -- 172.21.15.114:0/2632781855 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f75740113f0 con 0x7f758015d250 2023-11-04T01:38:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.805+0000 7f757cff9640 1 --2- 172.21.15.114:0/2632781855 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f756c06ae70 0x7f756c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.805+0000 7f757cff9640 1 -- 172.21.15.114:0/2632781855 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7574089940 con 0x7f758015d250 2023-11-04T01:38:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.805+0000 7f757ffff640 1 --2- 172.21.15.114:0/2632781855 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f756c06ae70 0x7f756c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.806+0000 7f757ffff640 1 --2- 172.21.15.114:0/2632781855 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f756c06ae70 0x7f756c06d330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7570036000 tx=0x7f757003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:06.809+0000 7f757cff9640 1 -- 172.21.15.114:0/2632781855 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f75740547c0 con 0x7f758015d250 2023-11-04T01:38:07.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.010+0000 7f758661a640 1 -- 172.21.15.114:0/2632781855 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7580066170 con 0x7f758015d250 2023-11-04T01:38:07.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.011+0000 7f757cff9640 1 -- 172.21.15.114:0/2632781855 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f7574057de0 con 0x7f758015d250 2023-11-04T01:38:07.013 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:07.013 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5218,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/3821610653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":3821610653},{"type":"v1","addr":"172.21.15.141:6834","nonce":3821610653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2452742541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2452742541},{"type":"v1","addr":"172.21.15.114:6835","nonce":2452742541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3407147888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3407147888},{"type":"v1","addr":"172.21.15.114:6837","nonce":3407147888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:50.993779+0000","modified":"2023-11-04T01:37:53.001589+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5565":{"gid":5565,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6835/3122131633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3122131633},{"type":"v1","addr":"172.21.15.141:6835","nonce":3122131633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:38:07.013 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 16 2023-11-04T01:38:07.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.012+0000 7f758661a640 1 -- 172.21.15.114:0/2632781855 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f756c06ae70 msgr2=0x7f756c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.013+0000 7f758661a640 1 --2- 172.21.15.114:0/2632781855 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f756c06ae70 0x7f756c06d330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7570036000 tx=0x7f757003c040 comp rx=0 tx=0).stop 2023-11-04T01:38:07.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.013+0000 7f758661a640 1 -- 172.21.15.114:0/2632781855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f758015d250 msgr2=0x7f7580151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.013+0000 7f758661a640 1 --2- 172.21.15.114:0/2632781855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f758015d250 0x7f7580151350 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f757400c7f0 tx=0x7f757400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.013+0000 7f758661a640 1 -- 172.21.15.114:0/2632781855 shutdown_connections 2023-11-04T01:38:07.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.013+0000 7f758661a640 1 --2- 172.21.15.114:0/2632781855 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f756c06ae70 0x7f756c06d330 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.013+0000 7f758661a640 1 --2- 172.21.15.114:0/2632781855 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7580151890 0x7f758006b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.013+0000 7f758661a640 1 --2- 172.21.15.114:0/2632781855 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f758015d250 0x7f7580151350 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.013+0000 7f758661a640 1 --2- 172.21.15.114:0/2632781855 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f758015ce70 0x7f758014a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.013+0000 7f758661a640 1 -- 172.21.15.114:0/2632781855 >> 172.21.15.114:0/2632781855 conn(0x7f75800b0cd0 msgr2=0x7f75800aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:07.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.013+0000 7f758661a640 1 -- 172.21.15.114:0/2632781855 shutdown_connections 2023-11-04T01:38:07.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.013+0000 7f758661a640 1 -- 172.21.15.114:0/2632781855 wait complete. 2023-11-04T01:38:07.025 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:07.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.123+0000 7f377b690640 1 Processor -- start 2023-11-04T01:38:07.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.124+0000 7f377b690640 1 -- start start 2023-11-04T01:38:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.124+0000 7f377b690640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3774159c70 0x7f37740ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.124+0000 7f377b690640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37740b4110 con 0x7f37740b0ae0 2023-11-04T01:38:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.124+0000 7f377b690640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37740b43f0 con 0x7f377406db20 2023-11-04T01:38:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.124+0000 7f377b690640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37740b49b0 con 0x7f3774159c70 2023-11-04T01:38:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.124+0000 7f377942c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3774159c70 0x7f37740ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.125+0000 7f377942c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3774159c70 0x7f37740ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57918/0 (socket says 172.21.15.114:57918) 2023-11-04T01:38:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.125+0000 7f3779c2d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f37740b0ae0 0x7f377415d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53766/0 (socket says 172.21.15.114:53766) 2023-11-04T01:38:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.125+0000 7f377942c640 1 -- 172.21.15.114:0/1537590950 learned_addr learned my addr 172.21.15.114:0/1537590950 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.125+0000 7f377942c640 1 -- 172.21.15.114:0/1537590950 >> v1:172.21.15.141:6789/0 conn(0x7f377406db20 legacy=0x7f37740b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.125+0000 7f377942c640 1 -- 172.21.15.114:0/1537590950 >> v1:172.21.15.114:6789/0 conn(0x7f37740b0ae0 legacy=0x7f377415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.125+0000 7f376bfff640 1 -- 172.21.15.114:0/1537590950 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528244933 0 0) 0x7f37740b4110 con 0x7f37740b0ae0 2023-11-04T01:38:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.125+0000 7f377942c640 1 -- 172.21.15.114:0/1537590950 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37740b46d0 con 0x7f3774159c70 2023-11-04T01:38:07.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.125+0000 7f377942c640 1 --2- 172.21.15.114:0/1537590950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3774159c70 0x7f37740ce370 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3764009870 tx=0x7f376402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4e2dc63a09a4d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.126+0000 7f376bfff640 1 -- 172.21.15.114:0/1537590950 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764030860 con 0x7f3774159c70 2023-11-04T01:38:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.126+0000 7f376bfff640 1 -- 172.21.15.114:0/1537590950 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37640309c0 con 0x7f3774159c70 2023-11-04T01:38:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.126+0000 7f376bfff640 1 -- 172.21.15.114:0/1537590950 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764030d50 con 0x7f3774159c70 2023-11-04T01:38:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.126+0000 7f377b690640 1 -- 172.21.15.114:0/1537590950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3774159c70 msgr2=0x7f37740ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.126+0000 7f377b690640 1 --2- 172.21.15.114:0/1537590950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3774159c70 0x7f37740ce370 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3764009870 tx=0x7f376402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.126+0000 7f377b690640 1 -- 172.21.15.114:0/1537590950 shutdown_connections 2023-11-04T01:38:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.126+0000 7f377b690640 1 --2- 172.21.15.114:0/1537590950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3774159c70 0x7f37740ce370 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.126+0000 7f377b690640 1 -- 172.21.15.114:0/1537590950 >> 172.21.15.114:0/1537590950 conn(0x7f37740ce950 msgr2=0x7f37740ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.126+0000 7f377b690640 1 -- 172.21.15.114:0/1537590950 shutdown_connections 2023-11-04T01:38:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.126+0000 7f377b690640 1 -- 172.21.15.114:0/1537590950 wait complete. 2023-11-04T01:38:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.127+0000 7f377b690640 1 Processor -- start 2023-11-04T01:38:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.128+0000 7f377b690640 1 -- start start 2023-11-04T01:38:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.128+0000 7f377b690640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f377406db20 0x7f3774152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.128+0000 7f377b690640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37740b0ae0 0x7f37740c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.128+0000 7f377b690640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3774159c70 0x7f37741552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.128+0000 7f377b690640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37740c4c30 con 0x7f377406db20 2023-11-04T01:38:07.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.128+0000 7f377b690640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3774151390 con 0x7f37740b0ae0 2023-11-04T01:38:07.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.128+0000 7f377b690640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37741505f0 con 0x7f3774159c70 2023-11-04T01:38:07.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.128+0000 7f377942c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f377406db20 0x7f3774152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.128+0000 7f377942c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f377406db20 0x7f3774152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57934/0 (socket says 172.21.15.114:57934) 2023-11-04T01:38:07.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.128+0000 7f377942c640 1 -- 172.21.15.114:0/3533223261 learned_addr learned my addr 172.21.15.114:0/3533223261 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:07.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.128+0000 7f3779c2d640 1 --2- 172.21.15.114:0/3533223261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3774159c70 0x7f37741552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.128+0000 7f3778c2b640 1 --2- 172.21.15.114:0/3533223261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37740b0ae0 0x7f37740c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.129+0000 7f377942c640 1 -- 172.21.15.114:0/3533223261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3774159c70 msgr2=0x7f37741552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.129+0000 7f377942c640 1 --2- 172.21.15.114:0/3533223261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3774159c70 0x7f37741552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.129+0000 7f377942c640 1 -- 172.21.15.114:0/3533223261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37740b0ae0 msgr2=0x7f37740c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.129+0000 7f377942c640 1 --2- 172.21.15.114:0/3533223261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37740b0ae0 0x7f37740c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.129+0000 7f377942c640 1 -- 172.21.15.114:0/3533223261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37640094d0 con 0x7f377406db20 2023-11-04T01:38:07.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.129+0000 7f3779c2d640 1 --2- 172.21.15.114:0/3533223261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3774159c70 0x7f37741552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:07.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.129+0000 7f3778c2b640 1 --2- 172.21.15.114:0/3533223261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37740b0ae0 0x7f37740c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:07.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.129+0000 7f377942c640 1 --2- 172.21.15.114:0/3533223261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f377406db20 0x7f3774152510 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3764009870 tx=0x7f3764004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.129+0000 7f3769ffb640 1 -- 172.21.15.114:0/3533223261 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764030810 con 0x7f377406db20 2023-11-04T01:38:07.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.129+0000 7f3769ffb640 1 -- 172.21.15.114:0/3533223261 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3764039d90 con 0x7f377406db20 2023-11-04T01:38:07.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.129+0000 7f377b690640 1 -- 172.21.15.114:0/3533223261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37741508b0 con 0x7f377406db20 2023-11-04T01:38:07.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.129+0000 7f3769ffb640 1 -- 172.21.15.114:0/3533223261 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764043630 con 0x7f377406db20 2023-11-04T01:38:07.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.129+0000 7f377b690640 1 -- 172.21.15.114:0/3533223261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3774150e70 con 0x7f377406db20 2023-11-04T01:38:07.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.130+0000 7f377b690640 1 -- 172.21.15.114:0/3533223261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377406df90 con 0x7f377406db20 2023-11-04T01:38:07.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.131+0000 7f3769ffb640 1 -- 172.21.15.114:0/3533223261 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f376404c3b0 con 0x7f377406db20 2023-11-04T01:38:07.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.131+0000 7f3769ffb640 1 --2- 172.21.15.114:0/3533223261 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f375806ae70 0x7f375806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.131+0000 7f3769ffb640 1 -- 172.21.15.114:0/3533223261 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f37640abfc0 con 0x7f377406db20 2023-11-04T01:38:07.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.131+0000 7f3778c2b640 1 --2- 172.21.15.114:0/3533223261 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f375806ae70 0x7f375806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.131+0000 7f3778c2b640 1 --2- 172.21.15.114:0/3533223261 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f375806ae70 0x7f375806d330 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3774154f30 tx=0x7f3770009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.135+0000 7f3769ffb640 1 -- 172.21.15.114:0/3533223261 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f377406df90 con 0x7f377406db20 2023-11-04T01:38:07.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.337+0000 7f377b690640 1 -- 172.21.15.114:0/3533223261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f377406df90 con 0x7f377406db20 2023-11-04T01:38:07.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.337+0000 7f3769ffb640 1 -- 172.21.15.114:0/3533223261 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f377406df90 con 0x7f377406db20 2023-11-04T01:38:07.339 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5218,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/3821610653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":3821610653},{"type":"v1","addr":"172.21.15.141:6834","nonce":3821610653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2452742541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2452742541},{"type":"v1","addr":"172.21.15.114:6835","nonce":2452742541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3407147888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3407147888},{"type":"v1","addr":"172.21.15.114:6837","nonce":3407147888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:37:50.993779+0000","modified":"2023-11-04T01:37:53.001589+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5565":{"gid":5565,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6835/3122131633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3122131633},{"type":"v1","addr":"172.21.15.141:6835","nonce":3122131633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:38:07.340 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 16 2023-11-04T01:38:07.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.339+0000 7f377b690640 1 -- 172.21.15.114:0/3533223261 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f375806ae70 msgr2=0x7f375806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.339+0000 7f377b690640 1 --2- 172.21.15.114:0/3533223261 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f375806ae70 0x7f375806d330 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3774154f30 tx=0x7f3770009040 comp rx=0 tx=0).stop 2023-11-04T01:38:07.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.339+0000 7f377b690640 1 -- 172.21.15.114:0/3533223261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f377406db20 msgr2=0x7f3774152510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.339+0000 7f377b690640 1 --2- 172.21.15.114:0/3533223261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f377406db20 0x7f3774152510 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3764009870 tx=0x7f3764004730 comp rx=0 tx=0).stop 2023-11-04T01:38:07.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.339+0000 7f377b690640 1 -- 172.21.15.114:0/3533223261 shutdown_connections 2023-11-04T01:38:07.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.339+0000 7f377b690640 1 --2- 172.21.15.114:0/3533223261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3774159c70 0x7f37741552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.339+0000 7f377b690640 1 --2- 172.21.15.114:0/3533223261 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f375806ae70 0x7f375806d330 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.339+0000 7f377b690640 1 --2- 172.21.15.114:0/3533223261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37740b0ae0 0x7f37740c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.339+0000 7f377b690640 1 --2- 172.21.15.114:0/3533223261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f377406db20 0x7f3774152510 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.339+0000 7f377b690640 1 -- 172.21.15.114:0/3533223261 >> 172.21.15.114:0/3533223261 conn(0x7f37740ce950 msgr2=0x7f37740b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:07.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.339+0000 7f377b690640 1 -- 172.21.15.114:0/3533223261 shutdown_connections 2023-11-04T01:38:07.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.339+0000 7f377b690640 1 -- 172.21.15.114:0/3533223261 wait complete. 2023-11-04T01:38:07.354 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:07.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.452+0000 7ff10bb4c640 1 Processor -- start 2023-11-04T01:38:07.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.452+0000 7ff10bb4c640 1 -- start start 2023-11-04T01:38:07.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.453+0000 7ff10bb4c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1040b0ae0 0x7ff1040ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.453+0000 7ff10bb4c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1040b4110 con 0x7ff104159c70 2023-11-04T01:38:07.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.453+0000 7ff10bb4c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1040b43f0 con 0x7ff10406db20 2023-11-04T01:38:07.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.453+0000 7ff10bb4c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1040b49b0 con 0x7ff1040b0ae0 2023-11-04T01:38:07.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.453+0000 7ff1098e8640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff104159c70 0x7ff1040b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53774/0 (socket says 172.21.15.114:53774) 2023-11-04T01:38:07.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.453+0000 7ff1098e8640 1 -- 172.21.15.114:0/2597689847 learned_addr learned my addr 172.21.15.114:0/2597689847 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:07.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.453+0000 7ff1088e6640 1 -- 172.21.15.114:0/2597689847 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407961641 0 0) 0x7ff1040b4110 con 0x7ff104159c70 2023-11-04T01:38:07.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.453+0000 7ff1088e6640 1 -- 172.21.15.114:0/2597689847 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0f0003520 con 0x7ff104159c70 2023-11-04T01:38:07.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.453+0000 7ff1090e7640 1 --2- 172.21.15.114:0/2597689847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1040b0ae0 0x7ff1040ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff1088e6640 1 -- 172.21.15.114:0/2597689847 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1517161701 0 0) 0x7ff0f0003520 con 0x7ff104159c70 2023-11-04T01:38:07.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff1088e6640 1 -- 172.21.15.114:0/2597689847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1040b0ae0 msgr2=0x7ff1040ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:07.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff1088e6640 1 --2- 172.21.15.114:0/2597689847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1040b0ae0 0x7ff1040ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff1088e6640 1 -- 172.21.15.114:0/2597689847 >> v1:172.21.15.141:6789/0 conn(0x7ff10406db20 legacy=0x7ff10415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff1088e6640 1 -- 172.21.15.114:0/2597689847 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1040b46d0 con 0x7ff104159c70 2023-11-04T01:38:07.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff1088e6640 1 -- 172.21.15.114:0/2597689847 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7ff100001670 con 0x7ff104159c70 2023-11-04T01:38:07.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff1088e6640 1 -- 172.21.15.114:0/2597689847 >> v1:172.21.15.114:6789/0 conn(0x7ff104159c70 legacy=0x7ff1040b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff1088e6640 1 --2- 172.21.15.114:0/2597689847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1040b0ae0 0x7ff0f00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff1088e6640 1 --2- 172.21.15.114:0/2597689847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0f0003f20 0x7ff0f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff1088e6640 1 --2- 172.21.15.114:0/2597689847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0f0004d00 0x7ff0f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff1088e6640 1 -- 172.21.15.114:0/2597689847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1040b49b0 con 0x7ff0f0004d00 2023-11-04T01:38:07.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff1088e6640 1 -- 172.21.15.114:0/2597689847 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f000ba60 con 0x7ff0f0003f20 2023-11-04T01:38:07.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff1088e6640 1 -- 172.21.15.114:0/2597689847 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f000bc20 con 0x7ff1040b0ae0 2023-11-04T01:38:07.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff10a0e9640 1 --2- 172.21.15.114:0/2597689847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0f0004d00 0x7ff0f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff1098e8640 1 --2- 172.21.15.114:0/2597689847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1040b0ae0 0x7ff0f00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff1090e7640 1 --2- 172.21.15.114:0/2597689847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0f0003f20 0x7ff0f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff10a0e9640 1 -- 172.21.15.114:0/2597689847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1040b0ae0 msgr2=0x7ff0f00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:07.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff10a0e9640 1 --2- 172.21.15.114:0/2597689847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1040b0ae0 0x7ff0f00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff10a0e9640 1 -- 172.21.15.114:0/2597689847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0f0003f20 msgr2=0x7ff0f00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:07.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff10a0e9640 1 --2- 172.21.15.114:0/2597689847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0f0003f20 0x7ff0f00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.454+0000 7ff10a0e9640 1 -- 172.21.15.114:0/2597689847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f0003520 con 0x7ff0f0004d00 2023-11-04T01:38:07.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.455+0000 7ff10a0e9640 1 --2- 172.21.15.114:0/2597689847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0f0004d00 0x7ff0f0005180 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc001e50 tx=0x7ff0f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddd6c7af084acd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.455+0000 7ff1088e6640 1 -- 172.21.15.114:0/2597689847 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc003b70 con 0x7ff0f0004d00 2023-11-04T01:38:07.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.455+0000 7ff1088e6640 1 -- 172.21.15.114:0/2597689847 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc003cd0 con 0x7ff0f0004d00 2023-11-04T01:38:07.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.455+0000 7ff1088e6640 1 -- 172.21.15.114:0/2597689847 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc005310 con 0x7ff0f0004d00 2023-11-04T01:38:07.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.455+0000 7ff10bb4c640 1 -- 172.21.15.114:0/2597689847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0f0004d00 msgr2=0x7ff0f0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.455+0000 7ff10bb4c640 1 --2- 172.21.15.114:0/2597689847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0f0004d00 0x7ff0f0005180 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc001e50 tx=0x7ff0f00057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.455+0000 7ff10a0e9640 1 -- 172.21.15.114:0/2597689847 reap_dead start 2023-11-04T01:38:07.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.455+0000 7ff10bb4c640 1 -- 172.21.15.114:0/2597689847 shutdown_connections 2023-11-04T01:38:07.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.455+0000 7ff10bb4c640 1 -- 172.21.15.114:0/2597689847 >> 172.21.15.114:0/2597689847 conn(0x7ff1040ce950 msgr2=0x7ff1040ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:07.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.456+0000 7ff10bb4c640 1 -- 172.21.15.114:0/2597689847 shutdown_connections 2023-11-04T01:38:07.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.456+0000 7ff10bb4c640 1 -- 172.21.15.114:0/2597689847 wait complete. 2023-11-04T01:38:07.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.457+0000 7ff10bb4c640 1 Processor -- start 2023-11-04T01:38:07.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.457+0000 7ff10bb4c640 1 -- start start 2023-11-04T01:38:07.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.457+0000 7ff10bb4c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0f0004d00 0x7ff104154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.457+0000 7ff10bb4c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff104070630 0x7ff104070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.457+0000 7ff10bb4c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff10415bda0 0x7ff10415c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.457+0000 7ff10bb4c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1041491c0 con 0x7ff104070630 2023-11-04T01:38:07.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.457+0000 7ff10bb4c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff104070ff0 con 0x7ff0f0004d00 2023-11-04T01:38:07.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.457+0000 7ff10bb4c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10415c760 con 0x7ff10415bda0 2023-11-04T01:38:07.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.457+0000 7ff1090e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff104070630 0x7ff104070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.458+0000 7ff1090e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff104070630 0x7ff104070ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57954/0 (socket says 172.21.15.114:57954) 2023-11-04T01:38:07.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.458+0000 7ff1090e7640 1 -- 172.21.15.114:0/486892658 learned_addr learned my addr 172.21.15.114:0/486892658 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:07.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.458+0000 7ff1098e8640 1 --2- 172.21.15.114:0/486892658 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0f0004d00 0x7ff104154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.458+0000 7ff10a0e9640 1 --2- 172.21.15.114:0/486892658 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff10415bda0 0x7ff10415c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.458+0000 7ff1090e7640 1 -- 172.21.15.114:0/486892658 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff10415bda0 msgr2=0x7ff10415c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.458+0000 7ff1090e7640 1 --2- 172.21.15.114:0/486892658 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff10415bda0 0x7ff10415c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.458+0000 7ff1090e7640 1 -- 172.21.15.114:0/486892658 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0f0004d00 msgr2=0x7ff104154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.458+0000 7ff1090e7640 1 --2- 172.21.15.114:0/486892658 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0f0004d00 0x7ff104154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.458+0000 7ff1090e7640 1 -- 172.21.15.114:0/486892658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1041f2860 con 0x7ff104070630 2023-11-04T01:38:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.458+0000 7ff1090e7640 1 --2- 172.21.15.114:0/486892658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff104070630 0x7ff104070ab0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40119a0 tx=0x7ff0f4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.458+0000 7ff0fa7fc640 1 -- 172.21.15.114:0/486892658 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f400faf0 con 0x7ff104070630 2023-11-04T01:38:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.458+0000 7ff0fa7fc640 1 -- 172.21.15.114:0/486892658 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f400fc50 con 0x7ff104070630 2023-11-04T01:38:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.458+0000 7ff10bb4c640 1 -- 172.21.15.114:0/486892658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1041f1aa0 con 0x7ff104070630 2023-11-04T01:38:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.458+0000 7ff0fa7fc640 1 -- 172.21.15.114:0/486892658 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4014440 con 0x7ff104070630 2023-11-04T01:38:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.458+0000 7ff10bb4c640 1 -- 172.21.15.114:0/486892658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1041f2060 con 0x7ff104070630 2023-11-04T01:38:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.459+0000 7ff10bb4c640 1 -- 172.21.15.114:0/486892658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff104074290 con 0x7ff104070630 2023-11-04T01:38:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.459+0000 7ff0fa7fc640 1 -- 172.21.15.114:0/486892658 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff0f40145a0 con 0x7ff104070630 2023-11-04T01:38:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.460+0000 7ff0fa7fc640 1 --2- 172.21.15.114:0/486892658 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff0e806ae70 0x7ff0e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.460+0000 7ff0fa7fc640 1 -- 172.21.15.114:0/486892658 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff0f408a050 con 0x7ff104070630 2023-11-04T01:38:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.460+0000 7ff1098e8640 1 --2- 172.21.15.114:0/486892658 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff0e806ae70 0x7ff0e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.460+0000 7ff1098e8640 1 --2- 172.21.15.114:0/486892658 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff0e806ae70 0x7ff0e806d330 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff100009fd0 tx=0x7ff100000f80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.464+0000 7ff0fa7fc640 1 -- 172.21.15.114:0/486892658 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff0f4054ed0 con 0x7ff104070630 2023-11-04T01:38:07.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.629+0000 7ff10bb4c640 1 -- 172.21.15.114:0/486892658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff10406d3f0 con 0x7ff104070630 2023-11-04T01:38:07.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.631+0000 7ff0fa7fc640 1 -- 172.21.15.114:0/486892658 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18630 (secure 0 0 0) 0x7ff0f40584f0 con 0x7ff104070630 2023-11-04T01:38:07.638 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:07.638 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":42,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:05.551741+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:37:48.832988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:37:49.974993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:07.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.632+0000 7ff10bb4c640 1 -- 172.21.15.114:0/486892658 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff0e806ae70 msgr2=0x7ff0e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.632+0000 7ff10bb4c640 1 --2- 172.21.15.114:0/486892658 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff0e806ae70 0x7ff0e806d330 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff100009fd0 tx=0x7ff100000f80 comp rx=0 tx=0).stop 2023-11-04T01:38:07.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.632+0000 7ff10bb4c640 1 -- 172.21.15.114:0/486892658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff104070630 msgr2=0x7ff104070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.632+0000 7ff10bb4c640 1 --2- 172.21.15.114:0/486892658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff104070630 0x7ff104070ab0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40119a0 tx=0x7ff0f4011e60 comp rx=0 tx=0).stop 2023-11-04T01:38:07.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.632+0000 7ff10bb4c640 1 -- 172.21.15.114:0/486892658 shutdown_connections 2023-11-04T01:38:07.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.632+0000 7ff10bb4c640 1 --2- 172.21.15.114:0/486892658 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff10415bda0 0x7ff10415c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.632+0000 7ff10bb4c640 1 --2- 172.21.15.114:0/486892658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff104070630 0x7ff104070ab0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.632+0000 7ff10bb4c640 1 --2- 172.21.15.114:0/486892658 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff0e806ae70 0x7ff0e806d330 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.632+0000 7ff10bb4c640 1 --2- 172.21.15.114:0/486892658 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff0f0004d00 0x7ff104154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.633+0000 7ff10bb4c640 1 -- 172.21.15.114:0/486892658 >> 172.21.15.114:0/486892658 conn(0x7ff1040ce950 msgr2=0x7ff104158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:07.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.633+0000 7ff10bb4c640 1 -- 172.21.15.114:0/486892658 shutdown_connections 2023-11-04T01:38:07.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.633+0000 7ff10bb4c640 1 -- 172.21.15.114:0/486892658 wait complete. 2023-11-04T01:38:07.645 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:38:07.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.746+0000 7f14cfb6c640 1 Processor -- start 2023-11-04T01:38:07.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.746+0000 7f14cfb6c640 1 -- start start 2023-11-04T01:38:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.747+0000 7f14cfb6c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f14c80b1a40 0x7f14c80ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.747+0000 7f14cfb6c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f14c806a830 0x7f14c80cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.747+0000 7f14cfb6c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c8160990 con 0x7f14c81605b0 2023-11-04T01:38:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.747+0000 7f14cfb6c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c80cc7c0 con 0x7f14c80b1a40 2023-11-04T01:38:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.747+0000 7f14cfb6c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c80cd750 con 0x7f14c806a830 2023-11-04T01:38:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.747+0000 7f14cd107640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f14c80b1a40 0x7f14c80ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.747+0000 7f14cd908640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f14c81605b0 0x7f14c806a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53786/0 (socket says 172.21.15.114:53786) 2023-11-04T01:38:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.747+0000 7f14cd107640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f14c80b1a40 0x7f14c80ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57966/0 (socket says 172.21.15.114:57966) 2023-11-04T01:38:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.747+0000 7f14cd908640 1 -- 172.21.15.114:0/2039719152 learned_addr learned my addr 172.21.15.114:0/2039719152 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.747+0000 7f14cd107640 1 -- 172.21.15.114:0/2039719152 >> v2:172.21.15.141:3300/0 conn(0x7f14c806a830 msgr2=0x7f14c80cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.747+0000 7f14cd107640 1 --2- 172.21.15.114:0/2039719152 >> v2:172.21.15.141:3300/0 conn(0x7f14c806a830 0x7f14c80cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.747+0000 7f14cd107640 1 -- 172.21.15.114:0/2039719152 >> v1:172.21.15.114:6789/0 conn(0x7f14c81605b0 legacy=0x7f14c806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.747+0000 7f14cd107640 1 -- 172.21.15.114:0/2039719152 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80cc4e0 con 0x7f14c80b1a40 2023-11-04T01:38:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.747+0000 7f14cc906640 1 -- 172.21.15.114:0/2039719152 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257574891 0 0) 0x7f14c8160990 con 0x7f14c81605b0 2023-11-04T01:38:07.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.748+0000 7f14cd107640 1 --2- 172.21.15.114:0/2039719152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c80b1a40 0x7f14c80ccbc0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f14c80c6aa0 tx=0x7f14b802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf8aaf8555ffa45 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.748+0000 7f14cc906640 1 -- 172.21.15.114:0/2039719152 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8031710 con 0x7f14c80b1a40 2023-11-04T01:38:07.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.748+0000 7f14cc906640 1 -- 172.21.15.114:0/2039719152 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b802f050 con 0x7f14c80b1a40 2023-11-04T01:38:07.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.748+0000 7f14cc906640 1 -- 172.21.15.114:0/2039719152 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8031a90 con 0x7f14c80b1a40 2023-11-04T01:38:07.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.749+0000 7f14cfb6c640 1 -- 172.21.15.114:0/2039719152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c80b1a40 msgr2=0x7f14c80ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.749+0000 7f14cfb6c640 1 --2- 172.21.15.114:0/2039719152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c80b1a40 0x7f14c80ccbc0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f14c80c6aa0 tx=0x7f14b802b7b0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.749+0000 7f14cfb6c640 1 -- 172.21.15.114:0/2039719152 shutdown_connections 2023-11-04T01:38:07.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.749+0000 7f14cfb6c640 1 --2- 172.21.15.114:0/2039719152 >> v2:172.21.15.141:3300/0 conn(0x7f14c806a830 0x7f14c80cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.749+0000 7f14cfb6c640 1 --2- 172.21.15.114:0/2039719152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c80b1a40 0x7f14c80ccbc0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.749+0000 7f14cfb6c640 1 -- 172.21.15.114:0/2039719152 >> 172.21.15.114:0/2039719152 conn(0x7f14c8071820 msgr2=0x7f14c8071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:07.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.749+0000 7f14cfb6c640 1 -- 172.21.15.114:0/2039719152 shutdown_connections 2023-11-04T01:38:07.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.749+0000 7f14cfb6c640 1 -- 172.21.15.114:0/2039719152 wait complete. 2023-11-04T01:38:07.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.750+0000 7f14cfb6c640 1 Processor -- start 2023-11-04T01:38:07.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.750+0000 7f14cfb6c640 1 -- start start 2023-11-04T01:38:07.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.750+0000 7f14cfb6c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14c806a830 0x7f14c815a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14cfb6c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14c81605b0 0x7f14c80c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14cfb6c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c80c6b20 0x7f14c80c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14cfb6c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c815e650 con 0x7f14c80c6b20 2023-11-04T01:38:07.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14cfb6c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c815e8c0 con 0x7f14c81605b0 2023-11-04T01:38:07.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14cfb6c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c815eba0 con 0x7f14c806a830 2023-11-04T01:38:07.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14ce109640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c80c6b20 0x7f14c80c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14ce109640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c80c6b20 0x7f14c80c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57970/0 (socket says 172.21.15.114:57970) 2023-11-04T01:38:07.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14ce109640 1 -- 172.21.15.114:0/3651280817 learned_addr learned my addr 172.21.15.114:0/3651280817 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:07.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14cd107640 1 --2- 172.21.15.114:0/3651280817 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14c81605b0 0x7f14c80c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14cd908640 1 --2- 172.21.15.114:0/3651280817 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14c806a830 0x7f14c815a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14ce109640 1 -- 172.21.15.114:0/3651280817 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14c806a830 msgr2=0x7f14c815a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14ce109640 1 --2- 172.21.15.114:0/3651280817 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14c806a830 0x7f14c815a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14ce109640 1 -- 172.21.15.114:0/3651280817 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14c81605b0 msgr2=0x7f14c80c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14ce109640 1 --2- 172.21.15.114:0/3651280817 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14c81605b0 0x7f14c80c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14ce109640 1 -- 172.21.15.114:0/3651280817 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b8009400 con 0x7f14c80c6b20 2023-11-04T01:38:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14cd107640 1 --2- 172.21.15.114:0/3651280817 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14c81605b0 0x7f14c80c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14ce109640 1 --2- 172.21.15.114:0/3651280817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c80c6b20 0x7f14c80c9000 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f14c000b970 tx=0x7f14c000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14be7fc640 1 -- 172.21.15.114:0/3651280817 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c000cb40 con 0x7f14c80c6b20 2023-11-04T01:38:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14be7fc640 1 -- 172.21.15.114:0/3651280817 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c000ccc0 con 0x7f14c80c6b20 2023-11-04T01:38:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14cfb6c640 1 -- 172.21.15.114:0/3651280817 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c815ee80 con 0x7f14c80c6b20 2023-11-04T01:38:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14be7fc640 1 -- 172.21.15.114:0/3651280817 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0014680 con 0x7f14c80c6b20 2023-11-04T01:38:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.751+0000 7f14cfb6c640 1 -- 172.21.15.114:0/3651280817 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c815f3a0 con 0x7f14c80c6b20 2023-11-04T01:38:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.752+0000 7f14cfb6c640 1 -- 172.21.15.114:0/3651280817 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c80cbaf0 con 0x7f14c80c6b20 2023-11-04T01:38:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.753+0000 7f14be7fc640 1 -- 172.21.15.114:0/3651280817 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f14c001d3b0 con 0x7f14c80c6b20 2023-11-04T01:38:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.753+0000 7f14be7fc640 1 --2- 172.21.15.114:0/3651280817 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f14ac06ae70 0x7f14ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.753+0000 7f14cd908640 1 --2- 172.21.15.114:0/3651280817 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f14ac06ae70 0x7f14ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:07.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.753+0000 7f14be7fc640 1 -- 172.21.15.114:0/3651280817 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f14c00897c0 con 0x7f14c80c6b20 2023-11-04T01:38:07.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.753+0000 7f14cd908640 1 --2- 172.21.15.114:0/3651280817 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f14ac06ae70 0x7f14ac06d330 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f14c4000f60 tx=0x7f14c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:07.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.757+0000 7f14be7fc640 1 -- 172.21.15.114:0/3651280817 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f14c0054640 con 0x7f14c80c6b20 2023-11-04T01:38:07.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.962+0000 7f14cfb6c640 1 -- 172.21.15.114:0/3651280817 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f14c80672a0 con 0x7f14c80c6b20 2023-11-04T01:38:07.965 INFO:tasks.ceph.mon.a.smithi114.stderr:2023-11-04T01:38:07.963+0000 7f5b24eb8640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:38:07.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.966+0000 7f14be7fc640 1 -- 172.21.15.114:0/3651280817 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f14c0057c60 con 0x7f14c80c6b20 2023-11-04T01:38:07.968 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:38:07.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.968+0000 7f14cfb6c640 1 -- 172.21.15.114:0/3651280817 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f14ac06ae70 msgr2=0x7f14ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.968+0000 7f14cfb6c640 1 --2- 172.21.15.114:0/3651280817 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f14ac06ae70 0x7f14ac06d330 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f14c4000f60 tx=0x7f14c4009040 comp rx=0 tx=0).stop 2023-11-04T01:38:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.968+0000 7f14cfb6c640 1 -- 172.21.15.114:0/3651280817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c80c6b20 msgr2=0x7f14c80c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.968+0000 7f14cfb6c640 1 --2- 172.21.15.114:0/3651280817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c80c6b20 0x7f14c80c9000 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f14c000b970 tx=0x7f14c000be30 comp rx=0 tx=0).stop 2023-11-04T01:38:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.968+0000 7f14cfb6c640 1 -- 172.21.15.114:0/3651280817 shutdown_connections 2023-11-04T01:38:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.968+0000 7f14cfb6c640 1 --2- 172.21.15.114:0/3651280817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14c80c6b20 0x7f14c80c9000 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.968+0000 7f14cfb6c640 1 --2- 172.21.15.114:0/3651280817 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f14ac06ae70 0x7f14ac06d330 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.968+0000 7f14cfb6c640 1 --2- 172.21.15.114:0/3651280817 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f14c81605b0 0x7f14c80c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.968+0000 7f14cfb6c640 1 --2- 172.21.15.114:0/3651280817 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f14c806a830 0x7f14c815a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.968+0000 7f14cfb6c640 1 -- 172.21.15.114:0/3651280817 >> 172.21.15.114:0/3651280817 conn(0x7f14c8071820 msgr2=0x7f14c80af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.969+0000 7f14cfb6c640 1 -- 172.21.15.114:0/3651280817 shutdown_connections 2023-11-04T01:38:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:07.969+0000 7f14cfb6c640 1 -- 172.21.15.114:0/3651280817 wait complete. 2023-11-04T01:38:07.972 INFO:tasks.ceph.mds.d.smithi141.stderr: -665> 2023-11-04T01:37:56.135+0000 7faaa5f7d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:38:07.983 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:38:07.998 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-04T01:38:08.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.082+0000 7f04ab7bb640 1 Processor -- start 2023-11-04T01:38:08.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.082+0000 7f04ab7bb640 1 -- start start 2023-11-04T01:38:08.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.083+0000 7f04ab7bb640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f04a4153850 0x7f04a415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.083+0000 7f04ab7bb640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f04a40cc9d0 0x7f04a40c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.083+0000 7f04ab7bb640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a40c3860 con 0x7f04a40cc520 2023-11-04T01:38:08.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.083+0000 7f04ab7bb640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a40c9250 con 0x7f04a4153850 2023-11-04T01:38:08.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.083+0000 7f04ab7bb640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a4153c30 con 0x7f04a40cc9d0 2023-11-04T01:38:08.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.083+0000 7f04a9557640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f04a4153850 0x7f04a415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.083+0000 7f04a9557640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f04a4153850 0x7f04a415a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57982/0 (socket says 172.21.15.114:57982) 2023-11-04T01:38:08.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.083+0000 7f04a9557640 1 -- 172.21.15.114:0/2119122867 learned_addr learned my addr 172.21.15.114:0/2119122867 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:08.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.083+0000 7f04a9d58640 1 --2- 172.21.15.114:0/2119122867 >> v2:172.21.15.141:3300/0 conn(0x7f04a40cc9d0 0x7f04a40c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.083+0000 7f04a9557640 1 -- 172.21.15.114:0/2119122867 >> v2:172.21.15.141:3300/0 conn(0x7f04a40cc9d0 msgr2=0x7f04a40c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:08.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.083+0000 7f04a9557640 1 --2- 172.21.15.114:0/2119122867 >> v2:172.21.15.141:3300/0 conn(0x7f04a40cc9d0 0x7f04a40c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.083+0000 7f04a9557640 1 -- 172.21.15.114:0/2119122867 >> v1:172.21.15.141:6789/0 conn(0x7f04a40cc520 legacy=0x7f04a4070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.083+0000 7f04a9557640 1 -- 172.21.15.114:0/2119122867 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a415a700 con 0x7f04a4153850 2023-11-04T01:38:08.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.084+0000 7f04a9557640 1 --2- 172.21.15.114:0/2119122867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04a4153850 0x7f04a415a1c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f04a40ca7c0 tx=0x7f04a002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9515932325d6ce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.084+0000 7f049bfff640 1 -- 172.21.15.114:0/2119122867 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a002cb20 con 0x7f04a4153850 2023-11-04T01:38:08.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.084+0000 7f049bfff640 1 -- 172.21.15.114:0/2119122867 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a002cc80 con 0x7f04a4153850 2023-11-04T01:38:08.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.084+0000 7f049bfff640 1 -- 172.21.15.114:0/2119122867 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a00343f0 con 0x7f04a4153850 2023-11-04T01:38:08.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.085+0000 7f04ab7bb640 1 -- 172.21.15.114:0/2119122867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04a4153850 msgr2=0x7f04a415a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.085+0000 7f04ab7bb640 1 --2- 172.21.15.114:0/2119122867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04a4153850 0x7f04a415a1c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f04a40ca7c0 tx=0x7f04a002bf80 comp rx=0 tx=0).stop 2023-11-04T01:38:08.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.085+0000 7f04ab7bb640 1 -- 172.21.15.114:0/2119122867 shutdown_connections 2023-11-04T01:38:08.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.085+0000 7f04ab7bb640 1 --2- 172.21.15.114:0/2119122867 >> v2:172.21.15.141:3300/0 conn(0x7f04a40cc9d0 0x7f04a40c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.085+0000 7f04ab7bb640 1 --2- 172.21.15.114:0/2119122867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04a4153850 0x7f04a415a1c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.085+0000 7f04ab7bb640 1 -- 172.21.15.114:0/2119122867 >> 172.21.15.114:0/2119122867 conn(0x7f04a40ce950 msgr2=0x7f04a40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:08.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.085+0000 7f04ab7bb640 1 -- 172.21.15.114:0/2119122867 shutdown_connections 2023-11-04T01:38:08.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.085+0000 7f04ab7bb640 1 -- 172.21.15.114:0/2119122867 wait complete. 2023-11-04T01:38:08.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.086+0000 7f04ab7bb640 1 Processor -- start 2023-11-04T01:38:08.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.086+0000 7f04ab7bb640 1 -- start start 2023-11-04T01:38:08.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04ab7bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04a40cc520 0x7f04a41568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04ab7bb640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04a40cc9d0 0x7f04a41f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04ab7bb640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04a4153850 0x7f04a41f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04ab7bb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a41547e0 con 0x7f04a40cc520 2023-11-04T01:38:08.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04ab7bb640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a4156de0 con 0x7f04a4153850 2023-11-04T01:38:08.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04ab7bb640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a41f2980 con 0x7f04a40cc9d0 2023-11-04T01:38:08.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04a9557640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04a40cc520 0x7f04a41568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04a9557640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04a40cc520 0x7f04a41568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57986/0 (socket says 172.21.15.114:57986) 2023-11-04T01:38:08.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04a9557640 1 -- 172.21.15.114:0/2532284593 learned_addr learned my addr 172.21.15.114:0/2532284593 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:08.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04a9d58640 1 --2- 172.21.15.114:0/2532284593 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04a4153850 0x7f04a41f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04a8d56640 1 --2- 172.21.15.114:0/2532284593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04a40cc9d0 0x7f04a41f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04a9557640 1 -- 172.21.15.114:0/2532284593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04a40cc9d0 msgr2=0x7f04a41f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04a9557640 1 --2- 172.21.15.114:0/2532284593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04a40cc9d0 0x7f04a41f3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04a9557640 1 -- 172.21.15.114:0/2532284593 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04a4153850 msgr2=0x7f04a41f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04a9557640 1 --2- 172.21.15.114:0/2532284593 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04a4153850 0x7f04a41f5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04a9557640 1 -- 172.21.15.114:0/2532284593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a0009b30 con 0x7f04a40cc520 2023-11-04T01:38:08.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04a8d56640 1 --2- 172.21.15.114:0/2532284593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04a40cc9d0 0x7f04a41f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:08.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.087+0000 7f04a9557640 1 --2- 172.21.15.114:0/2532284593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04a40cc520 0x7f04a41568a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f04a0036040 tx=0x7f04a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.088+0000 7f0499ffb640 1 -- 172.21.15.114:0/2532284593 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0009510 con 0x7f04a40cc520 2023-11-04T01:38:08.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.088+0000 7f0499ffb640 1 -- 172.21.15.114:0/2532284593 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a0007e60 con 0x7f04a40cc520 2023-11-04T01:38:08.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.088+0000 7f04ab7bb640 1 -- 172.21.15.114:0/2532284593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a40c88c0 con 0x7f04a40cc520 2023-11-04T01:38:08.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.088+0000 7f0499ffb640 1 -- 172.21.15.114:0/2532284593 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a003e690 con 0x7f04a40cc520 2023-11-04T01:38:08.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.088+0000 7f04ab7bb640 1 -- 172.21.15.114:0/2532284593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a41f6c60 con 0x7f04a40cc520 2023-11-04T01:38:08.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.089+0000 7f04ab7bb640 1 -- 172.21.15.114:0/2532284593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a4074290 con 0x7f04a40cc520 2023-11-04T01:38:08.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.089+0000 7f0499ffb640 1 -- 172.21.15.114:0/2532284593 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04a003e7f0 con 0x7f04a40cc520 2023-11-04T01:38:08.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.090+0000 7f0499ffb640 1 --2- 172.21.15.114:0/2532284593 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f048806ae70 0x7f048806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:08.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.090+0000 7f0499ffb640 1 -- 172.21.15.114:0/2532284593 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f04a00ac3b0 con 0x7f04a40cc520 2023-11-04T01:38:08.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.090+0000 7f04a8d56640 1 --2- 172.21.15.114:0/2532284593 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f048806ae70 0x7f048806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:08.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.090+0000 7f04a8d56640 1 --2- 172.21.15.114:0/2532284593 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f048806ae70 0x7f048806d330 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f04a40c7340 tx=0x7f0494009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:08.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.094+0000 7f0499ffb640 1 -- 172.21.15.114:0/2532284593 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04a00771f0 con 0x7f04a40cc520 2023-11-04T01:38:08.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.294+0000 7f04ab7bb640 1 -- 172.21.15.114:0/2532284593 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f04a41f6df0 con 0x7f04a40cc520 2023-11-04T01:38:08.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.967+0000 7f0499ffb640 1 -- 172.21.15.114:0/2532284593 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f04a007a810 con 0x7f04a40cc520 2023-11-04T01:38:08.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.970+0000 7f04ab7bb640 1 -- 172.21.15.114:0/2532284593 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f048806ae70 msgr2=0x7f048806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.970+0000 7f04ab7bb640 1 --2- 172.21.15.114:0/2532284593 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f048806ae70 0x7f048806d330 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f04a40c7340 tx=0x7f0494009040 comp rx=0 tx=0).stop 2023-11-04T01:38:08.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.970+0000 7f04ab7bb640 1 -- 172.21.15.114:0/2532284593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04a40cc520 msgr2=0x7f04a41568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:08.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.970+0000 7f04ab7bb640 1 --2- 172.21.15.114:0/2532284593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04a40cc520 0x7f04a41568a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f04a0036040 tx=0x7f04a0004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:08.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.970+0000 7f04ab7bb640 1 -- 172.21.15.114:0/2532284593 shutdown_connections 2023-11-04T01:38:08.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.970+0000 7f04ab7bb640 1 --2- 172.21.15.114:0/2532284593 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f048806ae70 0x7f048806d330 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.970+0000 7f04ab7bb640 1 --2- 172.21.15.114:0/2532284593 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f04a4153850 0x7f04a41f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.970+0000 7f04ab7bb640 1 --2- 172.21.15.114:0/2532284593 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04a40cc9d0 0x7f04a41f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.970+0000 7f04ab7bb640 1 --2- 172.21.15.114:0/2532284593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04a40cc520 0x7f04a41568a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:08.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.970+0000 7f04ab7bb640 1 -- 172.21.15.114:0/2532284593 >> 172.21.15.114:0/2532284593 conn(0x7f04a40ce950 msgr2=0x7f04a4070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:08.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.970+0000 7f04ab7bb640 1 -- 172.21.15.114:0/2532284593 shutdown_connections 2023-11-04T01:38:08.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:08.970+0000 7f04ab7bb640 1 -- 172.21.15.114:0/2532284593 wait complete. 2023-11-04T01:38:08.983 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:38:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.086+0000 7f534cca2640 1 Processor -- start 2023-11-04T01:38:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.086+0000 7f534cca2640 1 -- start start 2023-11-04T01:38:09.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.087+0000 7f534cca2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f53480cb320 0x7f53480cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.087+0000 7f534cca2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f53480c41d0 0x7f53480c4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.087+0000 7f534cca2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5348160af0 con 0x7f534815a950 2023-11-04T01:38:09.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.087+0000 7f534cca2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53480cbcf0 con 0x7f53480cb320 2023-11-04T01:38:09.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.087+0000 7f534cca2640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5348160d90 con 0x7f53480c41d0 2023-11-04T01:38:09.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.087+0000 7f533ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f53480cb320 0x7f53480cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.087+0000 7f534659c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f534815a950 0x7f53480ccf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53794/0 (socket says 172.21.15.114:53794) 2023-11-04T01:38:09.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.087+0000 7f534659c640 1 -- 172.21.15.114:0/40379052 learned_addr learned my addr 172.21.15.114:0/40379052 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.087+0000 7f533ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f53480cb320 0x7f53480cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57988/0 (socket says 172.21.15.114:57988) 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.087+0000 7f5346d9d640 1 --2- 172.21.15.114:0/40379052 >> v2:172.21.15.141:3300/0 conn(0x7f53480c41d0 0x7f53480c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.087+0000 7f533ffff640 1 -- 172.21.15.114:0/40379052 >> v2:172.21.15.141:3300/0 conn(0x7f53480c41d0 msgr2=0x7f53480c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.087+0000 7f533ffff640 1 --2- 172.21.15.114:0/40379052 >> v2:172.21.15.141:3300/0 conn(0x7f53480c41d0 0x7f53480c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.087+0000 7f533ffff640 1 -- 172.21.15.114:0/40379052 >> v1:172.21.15.114:6789/0 conn(0x7f534815a950 legacy=0x7f53480ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.087+0000 7f533ffff640 1 -- 172.21.15.114:0/40379052 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5348161070 con 0x7f53480cb320 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.087+0000 7f5345d9b640 1 -- 172.21.15.114:0/40379052 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722217836 0 0) 0x7f5348160af0 con 0x7f534815a950 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.087+0000 7f5346d9d640 1 --2- 172.21.15.114:0/40379052 >> v2:172.21.15.141:3300/0 conn(0x7f53480c41d0 0x7f53480c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.088+0000 7f533ffff640 1 --2- 172.21.15.114:0/40379052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53480cb320 0x7f53480cb7b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f53480c9450 tx=0x7f533002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d588defb43ae92b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.088+0000 7f5345d9b640 1 -- 172.21.15.114:0/40379052 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330031830 con 0x7f53480cb320 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.088+0000 7f5345d9b640 1 -- 172.21.15.114:0/40379052 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5330031990 con 0x7f53480cb320 2023-11-04T01:38:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.088+0000 7f5345d9b640 1 -- 172.21.15.114:0/40379052 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330031d20 con 0x7f53480cb320 2023-11-04T01:38:09.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.089+0000 7f534cca2640 1 -- 172.21.15.114:0/40379052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53480cb320 msgr2=0x7f53480cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.089+0000 7f534cca2640 1 --2- 172.21.15.114:0/40379052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53480cb320 0x7f53480cb7b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f53480c9450 tx=0x7f533002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.089+0000 7f534cca2640 1 -- 172.21.15.114:0/40379052 shutdown_connections 2023-11-04T01:38:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.089+0000 7f534cca2640 1 --2- 172.21.15.114:0/40379052 >> v2:172.21.15.141:3300/0 conn(0x7f53480c41d0 0x7f53480c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.089+0000 7f534cca2640 1 --2- 172.21.15.114:0/40379052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53480cb320 0x7f53480cb7b0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.089+0000 7f534cca2640 1 -- 172.21.15.114:0/40379052 >> 172.21.15.114:0/40379052 conn(0x7f53480b05d0 msgr2=0x7f53480b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.089+0000 7f534cca2640 1 -- 172.21.15.114:0/40379052 shutdown_connections 2023-11-04T01:38:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.089+0000 7f534cca2640 1 -- 172.21.15.114:0/40379052 wait complete. 2023-11-04T01:38:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.090+0000 7f534cca2640 1 Processor -- start 2023-11-04T01:38:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.090+0000 7f534cca2640 1 -- start start 2023-11-04T01:38:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.091+0000 7f534cca2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53480c41d0 0x7f534814fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.091+0000 7f534cca2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53480cb320 0x7f53480af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.091+0000 7f534cca2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f534815a950 0x7f53480ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.091+0000 7f534cca2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53480c87d0 con 0x7f53480c41d0 2023-11-04T01:38:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.091+0000 7f534cca2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53480af6d0 con 0x7f534815a950 2023-11-04T01:38:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.091+0000 7f534cca2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53480c7b50 con 0x7f53480cb320 2023-11-04T01:38:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.091+0000 7f534659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53480c41d0 0x7f534814fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.091+0000 7f534659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53480c41d0 0x7f534814fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58002/0 (socket says 172.21.15.114:58002) 2023-11-04T01:38:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.091+0000 7f534659c640 1 -- 172.21.15.114:0/137087606 learned_addr learned my addr 172.21.15.114:0/137087606 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.091+0000 7f534659c640 1 -- 172.21.15.114:0/137087606 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53480cb320 msgr2=0x7f53480af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.091+0000 7f534659c640 1 --2- 172.21.15.114:0/137087606 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53480cb320 0x7f53480af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.091+0000 7f534659c640 1 -- 172.21.15.114:0/137087606 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f534815a950 msgr2=0x7f53480ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.091+0000 7f534659c640 1 --2- 172.21.15.114:0/137087606 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f534815a950 0x7f53480ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.091+0000 7f534659c640 1 -- 172.21.15.114:0/137087606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5330009400 con 0x7f53480c41d0 2023-11-04T01:38:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.091+0000 7f534659c640 1 --2- 172.21.15.114:0/137087606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53480c41d0 0x7f534814fe80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f533800c430 tx=0x7f533800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.092+0000 7f533effd640 1 -- 172.21.15.114:0/137087606 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53380074e0 con 0x7f53480c41d0 2023-11-04T01:38:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.092+0000 7f533effd640 1 -- 172.21.15.114:0/137087606 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5338007660 con 0x7f53480c41d0 2023-11-04T01:38:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.092+0000 7f533effd640 1 -- 172.21.15.114:0/137087606 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338004a20 con 0x7f53480c41d0 2023-11-04T01:38:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.092+0000 7f534cca2640 1 -- 172.21.15.114:0/137087606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53480c7e30 con 0x7f53480c41d0 2023-11-04T01:38:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.092+0000 7f534cca2640 1 -- 172.21.15.114:0/137087606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53480c83f0 con 0x7f53480c41d0 2023-11-04T01:38:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.093+0000 7f534cca2640 1 -- 172.21.15.114:0/137087606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534804e490 con 0x7f53480c41d0 2023-11-04T01:38:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.093+0000 7f533effd640 1 -- 172.21.15.114:0/137087606 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5338004b80 con 0x7f53480c41d0 2023-11-04T01:38:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.093+0000 7f533effd640 1 --2- 172.21.15.114:0/137087606 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f532806aea0 0x7f532806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.093+0000 7f533effd640 1 -- 172.21.15.114:0/137087606 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f53380896f0 con 0x7f53480c41d0 2023-11-04T01:38:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.093+0000 7f533ffff640 1 --2- 172.21.15.114:0/137087606 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f532806aea0 0x7f532806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.094+0000 7f533ffff640 1 --2- 172.21.15.114:0/137087606 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f532806aea0 0x7f532806d360 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5330036000 tx=0x7f5330030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:09.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.098+0000 7f533effd640 1 -- 172.21.15.114:0/137087606 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5338054530 con 0x7f53480c41d0 2023-11-04T01:38:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.263+0000 7f534cca2640 1 -- 172.21.15.114:0/137087606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f53480c8910 con 0x7f53480c41d0 2023-11-04T01:38:09.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.969+0000 7f533effd640 1 -- 172.21.15.114:0/137087606 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5338057b50 con 0x7f53480c41d0 2023-11-04T01:38:09.971 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:38:09.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.971+0000 7f534cca2640 1 -- 172.21.15.114:0/137087606 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f532806aea0 msgr2=0x7f532806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.971+0000 7f534cca2640 1 --2- 172.21.15.114:0/137087606 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f532806aea0 0x7f532806d360 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5330036000 tx=0x7f5330030000 comp rx=0 tx=0).stop 2023-11-04T01:38:09.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.971+0000 7f534cca2640 1 -- 172.21.15.114:0/137087606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53480c41d0 msgr2=0x7f534814fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:09.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.971+0000 7f534cca2640 1 --2- 172.21.15.114:0/137087606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53480c41d0 0x7f534814fe80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f533800c430 tx=0x7f533800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.971+0000 7f534cca2640 1 -- 172.21.15.114:0/137087606 shutdown_connections 2023-11-04T01:38:09.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.971+0000 7f534cca2640 1 --2- 172.21.15.114:0/137087606 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f532806aea0 0x7f532806d360 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.971+0000 7f534cca2640 1 --2- 172.21.15.114:0/137087606 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f534815a950 0x7f53480ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.971+0000 7f534cca2640 1 --2- 172.21.15.114:0/137087606 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53480cb320 0x7f53480af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.971+0000 7f534cca2640 1 --2- 172.21.15.114:0/137087606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53480c41d0 0x7f534814fe80 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:09.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.971+0000 7f534cca2640 1 -- 172.21.15.114:0/137087606 >> 172.21.15.114:0/137087606 conn(0x7f53480b05d0 msgr2=0x7f53480c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:09.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.971+0000 7f534cca2640 1 -- 172.21.15.114:0/137087606 shutdown_connections 2023-11-04T01:38:09.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:09.971+0000 7f534cca2640 1 -- 172.21.15.114:0/137087606 wait complete. 2023-11-04T01:38:09.986 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:38:10.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.097+0000 7fd78c125640 1 Processor -- start 2023-11-04T01:38:10.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.097+0000 7fd78c125640 1 -- start start 2023-11-04T01:38:10.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.098+0000 7fd78c125640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd78415f510 0x7fd7840cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.098+0000 7fd78c125640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd78415c0d0 con 0x7fd784151ea0 2023-11-04T01:38:10.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.098+0000 7fd78c125640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd78406cf90 con 0x7fd78406dd50 2023-11-04T01:38:10.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.098+0000 7fd78c125640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78406d270 con 0x7fd78415f510 2023-11-04T01:38:10.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.098+0000 7fd7896c0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd78415f510 0x7fd7840cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.098+0000 7fd789ec1640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd784151ea0 0x7fd78415b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53798/0 (socket says 172.21.15.114:53798) 2023-11-04T01:38:10.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.098+0000 7fd789ec1640 1 -- 172.21.15.114:0/4281210011 learned_addr learned my addr 172.21.15.114:0/4281210011 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:10.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.098+0000 7fd7896c0640 1 -- 172.21.15.114:0/4281210011 >> v1:172.21.15.141:6789/0 conn(0x7fd78406dd50 legacy=0x7fd7840c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.098+0000 7fd7896c0640 1 -- 172.21.15.114:0/4281210011 >> v1:172.21.15.114:6789/0 conn(0x7fd784151ea0 legacy=0x7fd78415b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.098+0000 7fd7896c0640 1 -- 172.21.15.114:0/4281210011 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78406d550 con 0x7fd78415f510 2023-11-04T01:38:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.098+0000 7fd788ebf640 1 -- 172.21.15.114:0/4281210011 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259324634 0 0) 0x7fd78415c0d0 con 0x7fd784151ea0 2023-11-04T01:38:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.099+0000 7fd7896c0640 1 --2- 172.21.15.114:0/4281210011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd78415f510 0x7fd7840cb150 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd7740097a0 tx=0x7fd77402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf958706e5546ebb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.099+0000 7fd788ebf640 1 -- 172.21.15.114:0/4281210011 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774031830 con 0x7fd78415f510 2023-11-04T01:38:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.099+0000 7fd788ebf640 1 -- 172.21.15.114:0/4281210011 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd774031990 con 0x7fd78415f510 2023-11-04T01:38:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.099+0000 7fd788ebf640 1 -- 172.21.15.114:0/4281210011 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774031d20 con 0x7fd78415f510 2023-11-04T01:38:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.100+0000 7fd78c125640 1 -- 172.21.15.114:0/4281210011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd78415f510 msgr2=0x7fd7840cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.100+0000 7fd78c125640 1 --2- 172.21.15.114:0/4281210011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd78415f510 0x7fd7840cb150 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd7740097a0 tx=0x7fd77402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.100+0000 7fd78c125640 1 -- 172.21.15.114:0/4281210011 shutdown_connections 2023-11-04T01:38:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.100+0000 7fd78c125640 1 --2- 172.21.15.114:0/4281210011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd78415f510 0x7fd7840cb150 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.100+0000 7fd78c125640 1 -- 172.21.15.114:0/4281210011 >> 172.21.15.114:0/4281210011 conn(0x7fd7840b05d0 msgr2=0x7fd7840b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.100+0000 7fd78c125640 1 -- 172.21.15.114:0/4281210011 shutdown_connections 2023-11-04T01:38:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.100+0000 7fd78c125640 1 -- 172.21.15.114:0/4281210011 wait complete. 2023-11-04T01:38:10.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.101+0000 7fd78c125640 1 Processor -- start 2023-11-04T01:38:10.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.101+0000 7fd78c125640 1 -- start start 2023-11-04T01:38:10.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78c125640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd78406dd50 0x7fd7841544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78c125640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd784151ea0 0x7fd784152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78c125640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd78415f510 0x7fd78415d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78c125640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7841527c0 con 0x7fd78415f510 2023-11-04T01:38:10.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78c125640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7841529f0 con 0x7fd78406dd50 2023-11-04T01:38:10.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78c125640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd784152cd0 con 0x7fd784151ea0 2023-11-04T01:38:10.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78a6c2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd78415f510 0x7fd78415d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78a6c2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd78415f510 0x7fd78415d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58030/0 (socket says 172.21.15.114:58030) 2023-11-04T01:38:10.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78a6c2640 1 -- 172.21.15.114:0/3080776195 learned_addr learned my addr 172.21.15.114:0/3080776195 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:10.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd789ec1640 1 --2- 172.21.15.114:0/3080776195 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd78406dd50 0x7fd7841544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd7896c0640 1 --2- 172.21.15.114:0/3080776195 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd784151ea0 0x7fd784152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78a6c2640 1 -- 172.21.15.114:0/3080776195 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd784151ea0 msgr2=0x7fd784152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78a6c2640 1 --2- 172.21.15.114:0/3080776195 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd784151ea0 0x7fd784152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78a6c2640 1 -- 172.21.15.114:0/3080776195 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd78406dd50 msgr2=0x7fd7841544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78a6c2640 1 --2- 172.21.15.114:0/3080776195 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd78406dd50 0x7fd7841544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78a6c2640 1 -- 172.21.15.114:0/3080776195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd774009400 con 0x7fd78415f510 2023-11-04T01:38:10.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd789ec1640 1 --2- 172.21.15.114:0/3080776195 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd78406dd50 0x7fd7841544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:10.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78a6c2640 1 --2- 172.21.15.114:0/3080776195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd78415f510 0x7fd78415d4d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00c390 tx=0x7fd77c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:10.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd77a7fc640 1 -- 172.21.15.114:0/3080776195 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0035f0 con 0x7fd78415f510 2023-11-04T01:38:10.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd77a7fc640 1 -- 172.21.15.114:0/3080776195 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c003750 con 0x7fd78415f510 2023-11-04T01:38:10.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78c125640 1 -- 172.21.15.114:0/3080776195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd784152fb0 con 0x7fd78415f510 2023-11-04T01:38:10.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd77a7fc640 1 -- 172.21.15.114:0/3080776195 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c003b00 con 0x7fd78415f510 2023-11-04T01:38:10.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.102+0000 7fd78c125640 1 -- 172.21.15.114:0/3080776195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7841f19f0 con 0x7fd78415f510 2023-11-04T01:38:10.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.103+0000 7fd78c125640 1 -- 172.21.15.114:0/3080776195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78404e490 con 0x7fd78415f510 2023-11-04T01:38:10.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.104+0000 7fd77a7fc640 1 -- 172.21.15.114:0/3080776195 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd77c003c60 con 0x7fd78415f510 2023-11-04T01:38:10.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.104+0000 7fd77a7fc640 1 --2- 172.21.15.114:0/3080776195 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd76806ae70 0x7fd76806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:10.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.104+0000 7fd77a7fc640 1 -- 172.21.15.114:0/3080776195 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6030+0+0 (secure 0 0 0) 0x7fd77c088d70 con 0x7fd78415f510 2023-11-04T01:38:10.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.104+0000 7fd789ec1640 1 --2- 172.21.15.114:0/3080776195 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd76806ae70 0x7fd76806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:10.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.105+0000 7fd789ec1640 1 --2- 172.21.15.114:0/3080776195 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd76806ae70 0x7fd76806d330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd7800012e0 tx=0x7fd780009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:10.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.108+0000 7fd77a7fc640 1 -- 172.21.15.114:0/3080776195 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd77c053cd0 con 0x7fd78415f510 2023-11-04T01:38:10.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.274+0000 7fd78c125640 1 -- 172.21.15.114:0/3080776195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd7840cda90 con 0x7fd78415f510 2023-11-04T01:38:10.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.974+0000 7fd77a7fc640 1 -- 172.21.15.114:0/3080776195 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd77c017020 con 0x7fd78415f510 2023-11-04T01:38:10.976 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2023-11-04T01:38:10.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.978+0000 7fd78c125640 1 -- 172.21.15.114:0/3080776195 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd76806ae70 msgr2=0x7fd76806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.978+0000 7fd78c125640 1 --2- 172.21.15.114:0/3080776195 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd76806ae70 0x7fd76806d330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd7800012e0 tx=0x7fd780009040 comp rx=0 tx=0).stop 2023-11-04T01:38:10.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.978+0000 7fd78c125640 1 -- 172.21.15.114:0/3080776195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd78415f510 msgr2=0x7fd78415d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:10.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.978+0000 7fd78c125640 1 --2- 172.21.15.114:0/3080776195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd78415f510 0x7fd78415d4d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00c390 tx=0x7fd77c00c850 comp rx=0 tx=0).stop 2023-11-04T01:38:10.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.978+0000 7fd78c125640 1 -- 172.21.15.114:0/3080776195 shutdown_connections 2023-11-04T01:38:10.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.978+0000 7fd78c125640 1 --2- 172.21.15.114:0/3080776195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd78415f510 0x7fd78415d4d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.978+0000 7fd78c125640 1 --2- 172.21.15.114:0/3080776195 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd784151ea0 0x7fd784152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.978+0000 7fd78c125640 1 --2- 172.21.15.114:0/3080776195 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd76806ae70 0x7fd76806d330 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.978+0000 7fd78c125640 1 --2- 172.21.15.114:0/3080776195 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd78406dd50 0x7fd7841544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:10.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.978+0000 7fd78c125640 1 -- 172.21.15.114:0/3080776195 >> 172.21.15.114:0/3080776195 conn(0x7fd7840b05d0 msgr2=0x7fd78414fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:10.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.978+0000 7fd78c125640 1 -- 172.21.15.114:0/3080776195 shutdown_connections 2023-11-04T01:38:10.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:10.978+0000 7fd78c125640 1 -- 172.21.15.114:0/3080776195 wait complete. 2023-11-04T01:38:10.995 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:38:11.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.098+0000 7fac9477c640 1 Processor -- start 2023-11-04T01:38:11.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.098+0000 7fac9477c640 1 -- start start 2023-11-04T01:38:11.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.099+0000 7fac9477c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fac8c15e430 0x7fac8c0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.099+0000 7fac9477c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fac8c0d0710 0x7fac8c0b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.099+0000 7fac9477c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8c0d0280 con 0x7fac8c0cf160 2023-11-04T01:38:11.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.099+0000 7fac9477c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c0cf670 con 0x7fac8c15e430 2023-11-04T01:38:11.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.099+0000 7fac9477c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c0cf950 con 0x7fac8c0d0710 2023-11-04T01:38:11.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.099+0000 7fac92518640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fac8c15e430 0x7fac8c0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.099+0000 7fac92518640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fac8c15e430 0x7fac8c0cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58042/0 (socket says 172.21.15.114:58042) 2023-11-04T01:38:11.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.099+0000 7fac92518640 1 -- 172.21.15.114:0/1923474523 learned_addr learned my addr 172.21.15.114:0/1923474523 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:11.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.099+0000 7fac92518640 1 -- 172.21.15.114:0/1923474523 >> v2:172.21.15.141:3300/0 conn(0x7fac8c0d0710 msgr2=0x7fac8c0b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:11.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.099+0000 7fac92d19640 1 --2- 172.21.15.114:0/1923474523 >> v2:172.21.15.141:3300/0 conn(0x7fac8c0d0710 0x7fac8c0b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.099+0000 7fac92518640 1 --2- 172.21.15.114:0/1923474523 >> v2:172.21.15.141:3300/0 conn(0x7fac8c0d0710 0x7fac8c0b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.099+0000 7fac92518640 1 -- 172.21.15.114:0/1923474523 >> v1:172.21.15.141:6789/0 conn(0x7fac8c0cf160 legacy=0x7fac8c0cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:11.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.099+0000 7fac92518640 1 -- 172.21.15.114:0/1923474523 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c0cfc30 con 0x7fac8c15e430 2023-11-04T01:38:11.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.099+0000 7fac92d19640 1 --2- 172.21.15.114:0/1923474523 >> v2:172.21.15.141:3300/0 conn(0x7fac8c0d0710 0x7fac8c0b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:11.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.100+0000 7fac92518640 1 --2- 172.21.15.114:0/1923474523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac8c15e430 0x7fac8c0cec20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0b6250 tx=0x7fac8402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c5816be85420c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:11.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.100+0000 7fac91516640 1 -- 172.21.15.114:0/1923474523 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8402ca80 con 0x7fac8c15e430 2023-11-04T01:38:11.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.100+0000 7fac91516640 1 -- 172.21.15.114:0/1923474523 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8402cbe0 con 0x7fac8c15e430 2023-11-04T01:38:11.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.100+0000 7fac91516640 1 -- 172.21.15.114:0/1923474523 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840343f0 con 0x7fac8c15e430 2023-11-04T01:38:11.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.100+0000 7fac9477c640 1 -- 172.21.15.114:0/1923474523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac8c15e430 msgr2=0x7fac8c0cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.100+0000 7fac9477c640 1 --2- 172.21.15.114:0/1923474523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac8c15e430 0x7fac8c0cec20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0b6250 tx=0x7fac8402bee0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.100+0000 7fac9477c640 1 -- 172.21.15.114:0/1923474523 shutdown_connections 2023-11-04T01:38:11.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.100+0000 7fac9477c640 1 --2- 172.21.15.114:0/1923474523 >> v2:172.21.15.141:3300/0 conn(0x7fac8c0d0710 0x7fac8c0b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.100+0000 7fac9477c640 1 --2- 172.21.15.114:0/1923474523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac8c15e430 0x7fac8c0cec20 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.101+0000 7fac9477c640 1 -- 172.21.15.114:0/1923474523 >> 172.21.15.114:0/1923474523 conn(0x7fac8c06ea20 msgr2=0x7fac8c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:11.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.101+0000 7fac9477c640 1 -- 172.21.15.114:0/1923474523 shutdown_connections 2023-11-04T01:38:11.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.101+0000 7fac9477c640 1 -- 172.21.15.114:0/1923474523 wait complete. 2023-11-04T01:38:11.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.102+0000 7fac9477c640 1 Processor -- start 2023-11-04T01:38:11.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.102+0000 7fac9477c640 1 -- start start 2023-11-04T01:38:11.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.102+0000 7fac9477c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fac8c0cf160 0x7fac8c149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.102+0000 7fac9477c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac8c0d0710 0x7fac8c1f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.102+0000 7fac9477c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac8c15e430 0x7fac8c0d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.102+0000 7fac9477c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c149e90 con 0x7fac8c15e430 2023-11-04T01:38:11.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.102+0000 7fac9477c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c14a440 con 0x7fac8c0d0710 2023-11-04T01:38:11.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.102+0000 7fac9477c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c0a8210 con 0x7fac8c0cf160 2023-11-04T01:38:11.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.102+0000 7fac92d19640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac8c15e430 0x7fac8c0d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.102+0000 7fac92d19640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac8c15e430 0x7fac8c0d0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58052/0 (socket says 172.21.15.114:58052) 2023-11-04T01:38:11.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.102+0000 7fac92d19640 1 -- 172.21.15.114:0/2377003138 learned_addr learned my addr 172.21.15.114:0/2377003138 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:11.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.103+0000 7fac92518640 1 --2- 172.21.15.114:0/2377003138 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fac8c0cf160 0x7fac8c149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.103+0000 7fac91d17640 1 --2- 172.21.15.114:0/2377003138 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac8c0d0710 0x7fac8c1f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.103+0000 7fac92d19640 1 -- 172.21.15.114:0/2377003138 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fac8c0cf160 msgr2=0x7fac8c149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.103+0000 7fac92d19640 1 --2- 172.21.15.114:0/2377003138 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fac8c0cf160 0x7fac8c149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.103+0000 7fac92d19640 1 -- 172.21.15.114:0/2377003138 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac8c0d0710 msgr2=0x7fac8c1f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.103+0000 7fac92d19640 1 --2- 172.21.15.114:0/2377003138 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac8c0d0710 0x7fac8c1f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.103+0000 7fac92d19640 1 -- 172.21.15.114:0/2377003138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac84009b30 con 0x7fac8c15e430 2023-11-04T01:38:11.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.103+0000 7fac91d17640 1 --2- 172.21.15.114:0/2377003138 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac8c0d0710 0x7fac8c1f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:11.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.103+0000 7fac92d19640 1 --2- 172.21.15.114:0/2377003138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac8c15e430 0x7fac8c0d0ba0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00c5e0 tx=0x7fac7c00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:11.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.103+0000 7fac8affd640 1 -- 172.21.15.114:0/2377003138 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c004220 con 0x7fac8c15e430 2023-11-04T01:38:11.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.103+0000 7fac8affd640 1 -- 172.21.15.114:0/2377003138 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c0043a0 con 0x7fac8c15e430 2023-11-04T01:38:11.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.103+0000 7fac9477c640 1 -- 172.21.15.114:0/2377003138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8c14a110 con 0x7fac8c15e430 2023-11-04T01:38:11.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.103+0000 7fac8affd640 1 -- 172.21.15.114:0/2377003138 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c003850 con 0x7fac8c15e430 2023-11-04T01:38:11.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.103+0000 7fac9477c640 1 -- 172.21.15.114:0/2377003138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8c1f47d0 con 0x7fac8c15e430 2023-11-04T01:38:11.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.104+0000 7fac9477c640 1 -- 172.21.15.114:0/2377003138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8c14a5f0 con 0x7fac8c15e430 2023-11-04T01:38:11.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.104+0000 7fac8affd640 1 -- 172.21.15.114:0/2377003138 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fac7c0039b0 con 0x7fac8c15e430 2023-11-04T01:38:11.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.105+0000 7fac8affd640 1 --2- 172.21.15.114:0/2377003138 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fac7806aea0 0x7fac7806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.105+0000 7fac8affd640 1 -- 172.21.15.114:0/2377003138 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fac7c089210 con 0x7fac8c15e430 2023-11-04T01:38:11.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.105+0000 7fac92518640 1 --2- 172.21.15.114:0/2377003138 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fac7806aea0 0x7fac7806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.105+0000 7fac92518640 1 --2- 172.21.15.114:0/2377003138 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fac7806aea0 0x7fac7806d360 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fac84035000 tx=0x7fac84030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:11.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.109+0000 7fac8affd640 1 -- 172.21.15.114:0/2377003138 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fac8c14a5f0 con 0x7fac8c15e430 2023-11-04T01:38:11.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.274+0000 7fac9477c640 1 -- 172.21.15.114:0/2377003138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fac8c14a5b0 con 0x7fac8c15e430 2023-11-04T01:38:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.278+0000 7fac8affd640 1 -- 172.21.15.114:0/2377003138 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7fac7c054320 con 0x7fac8c15e430 2023-11-04T01:38:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.280+0000 7fac9477c640 1 -- 172.21.15.114:0/2377003138 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fac7806aea0 msgr2=0x7fac7806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.280+0000 7fac9477c640 1 --2- 172.21.15.114:0/2377003138 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fac7806aea0 0x7fac7806d360 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fac84035000 tx=0x7fac84030000 comp rx=0 tx=0).stop 2023-11-04T01:38:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.280+0000 7fac9477c640 1 -- 172.21.15.114:0/2377003138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac8c15e430 msgr2=0x7fac8c0d0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.280+0000 7fac9477c640 1 --2- 172.21.15.114:0/2377003138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac8c15e430 0x7fac8c0d0ba0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00c5e0 tx=0x7fac7c00caa0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.280+0000 7fac9477c640 1 -- 172.21.15.114:0/2377003138 shutdown_connections 2023-11-04T01:38:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.280+0000 7fac9477c640 1 --2- 172.21.15.114:0/2377003138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac8c15e430 0x7fac8c0d0ba0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.280+0000 7fac9477c640 1 --2- 172.21.15.114:0/2377003138 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fac7806aea0 0x7fac7806d360 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.280+0000 7fac9477c640 1 --2- 172.21.15.114:0/2377003138 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac8c0d0710 0x7fac8c1f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.280+0000 7fac9477c640 1 --2- 172.21.15.114:0/2377003138 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fac8c0cf160 0x7fac8c149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.280+0000 7fac9477c640 1 -- 172.21.15.114:0/2377003138 >> 172.21.15.114:0/2377003138 conn(0x7fac8c06ea20 msgr2=0x7fac8c0b5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:11.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.280+0000 7fac9477c640 1 -- 172.21.15.114:0/2377003138 shutdown_connections 2023-11-04T01:38:11.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.280+0000 7fac9477c640 1 -- 172.21.15.114:0/2377003138 wait complete. 2023-11-04T01:38:11.292 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails' 2023-11-04T01:38:11.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.390+0000 7f176dc5d640 1 Processor -- start 2023-11-04T01:38:11.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.390+0000 7f176dc5d640 1 -- start start 2023-11-04T01:38:11.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.391+0000 7f176dc5d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17680b0ae0 0x7f17680ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.391+0000 7f176dc5d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f176806db20 0x7f176815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.391+0000 7f176dc5d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17680b4110 con 0x7f1768159c70 2023-11-04T01:38:11.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.391+0000 7f176dc5d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17680b49b0 con 0x7f176806db20 2023-11-04T01:38:11.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.391+0000 7f176dc5d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17680b43f0 con 0x7f17680b0ae0 2023-11-04T01:38:11.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.391+0000 7f17677fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1768159c70 0x7f17680b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53800/0 (socket says 172.21.15.114:53800) 2023-11-04T01:38:11.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.391+0000 7f1767fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f176806db20 0x7f176815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.391+0000 7f17677fe640 1 -- 172.21.15.114:0/1197154430 learned_addr learned my addr 172.21.15.114:0/1197154430 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:11.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.391+0000 7f17667fc640 1 -- 172.21.15.114:0/1197154430 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932978688 0 0) 0x7f17680b4110 con 0x7f1768159c70 2023-11-04T01:38:11.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.391+0000 7f17667fc640 1 -- 172.21.15.114:0/1197154430 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1750003520 con 0x7f1768159c70 2023-11-04T01:38:11.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.391+0000 7f1766ffd640 1 --2- 172.21.15.114:0/1197154430 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17680b0ae0 0x7f17680ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.392+0000 7f1767fff640 1 -- 172.21.15.114:0/1197154430 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17680b0ae0 msgr2=0x7f17680ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:11.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.392+0000 7f1767fff640 1 --2- 172.21.15.114:0/1197154430 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17680b0ae0 0x7f17680ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.392+0000 7f1767fff640 1 -- 172.21.15.114:0/1197154430 >> v1:172.21.15.114:6789/0 conn(0x7f1768159c70 legacy=0x7f17680b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.392+0000 7f1767fff640 1 -- 172.21.15.114:0/1197154430 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17680b46d0 con 0x7f176806db20 2023-11-04T01:38:11.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.392+0000 7f1766ffd640 1 --2- 172.21.15.114:0/1197154430 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17680b0ae0 0x7f17680ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:11.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.392+0000 7f1767fff640 1 --2- 172.21.15.114:0/1197154430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f176806db20 0x7f176815d7d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1760009d90 tx=0x7f176002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4415123e766e8e00 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:11.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.392+0000 7f17667fc640 1 -- 172.21.15.114:0/1197154430 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176002cc50 con 0x7f176806db20 2023-11-04T01:38:11.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.392+0000 7f17667fc640 1 -- 172.21.15.114:0/1197154430 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176002cdb0 con 0x7f176806db20 2023-11-04T01:38:11.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.392+0000 7f17667fc640 1 -- 172.21.15.114:0/1197154430 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760034660 con 0x7f176806db20 2023-11-04T01:38:11.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.393+0000 7f176dc5d640 1 -- 172.21.15.114:0/1197154430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f176806db20 msgr2=0x7f176815d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.393+0000 7f176dc5d640 1 --2- 172.21.15.114:0/1197154430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f176806db20 0x7f176815d7d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1760009d90 tx=0x7f176002bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.393+0000 7f176dc5d640 1 -- 172.21.15.114:0/1197154430 shutdown_connections 2023-11-04T01:38:11.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.393+0000 7f176dc5d640 1 --2- 172.21.15.114:0/1197154430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f176806db20 0x7f176815d7d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.393+0000 7f176dc5d640 1 --2- 172.21.15.114:0/1197154430 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17680b0ae0 0x7f17680ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.393+0000 7f176dc5d640 1 -- 172.21.15.114:0/1197154430 >> 172.21.15.114:0/1197154430 conn(0x7f17680ce950 msgr2=0x7f17680ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:11.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.393+0000 7f176dc5d640 1 -- 172.21.15.114:0/1197154430 shutdown_connections 2023-11-04T01:38:11.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.393+0000 7f176dc5d640 1 -- 172.21.15.114:0/1197154430 wait complete. 2023-11-04T01:38:11.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.394+0000 7f176dc5d640 1 Processor -- start 2023-11-04T01:38:11.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.394+0000 7f176dc5d640 1 -- start start 2023-11-04T01:38:11.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.395+0000 7f176dc5d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f176806db20 0x7f176814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.395+0000 7f176dc5d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17680b0ae0 0x7f176815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.395+0000 7f176dc5d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1768159c70 0x7f176815af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.395+0000 7f176dc5d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17680c6750 con 0x7f1768159c70 2023-11-04T01:38:11.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.395+0000 7f176dc5d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17680c6a30 con 0x7f17680b0ae0 2023-11-04T01:38:11.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.395+0000 7f176dc5d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176815a1f0 con 0x7f176806db20 2023-11-04T01:38:11.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.395+0000 7f1767fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1768159c70 0x7f176815af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.395+0000 7f1767fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1768159c70 0x7f176815af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58062/0 (socket says 172.21.15.114:58062) 2023-11-04T01:38:11.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.395+0000 7f1767fff640 1 -- 172.21.15.114:0/2140855342 learned_addr learned my addr 172.21.15.114:0/2140855342 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:11.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.395+0000 7f1767fff640 1 -- 172.21.15.114:0/2140855342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f176806db20 msgr2=0x7f176814dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.395+0000 7f1767fff640 1 --2- 172.21.15.114:0/2140855342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f176806db20 0x7f176814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.395+0000 7f1767fff640 1 -- 172.21.15.114:0/2140855342 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17680b0ae0 msgr2=0x7f176815a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.395+0000 7f1767fff640 1 --2- 172.21.15.114:0/2140855342 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17680b0ae0 0x7f176815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.395+0000 7f1767fff640 1 -- 172.21.15.114:0/2140855342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1760009a70 con 0x7f1768159c70 2023-11-04T01:38:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.396+0000 7f1767fff640 1 --2- 172.21.15.114:0/2140855342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1768159c70 0x7f176815af30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1760009d90 tx=0x7f1760004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.396+0000 7f174ffff640 1 -- 172.21.15.114:0/2140855342 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176003e610 con 0x7f1768159c70 2023-11-04T01:38:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.396+0000 7f174ffff640 1 -- 172.21.15.114:0/2140855342 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176003e770 con 0x7f1768159c70 2023-11-04T01:38:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.396+0000 7f176dc5d640 1 -- 172.21.15.114:0/2140855342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176815a4d0 con 0x7f1768159c70 2023-11-04T01:38:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.396+0000 7f174ffff640 1 -- 172.21.15.114:0/2140855342 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176003eb20 con 0x7f1768159c70 2023-11-04T01:38:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.396+0000 7f176dc5d640 1 -- 172.21.15.114:0/2140855342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176814eec0 con 0x7f1768159c70 2023-11-04T01:38:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.397+0000 7f176dc5d640 1 -- 172.21.15.114:0/2140855342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176815a050 con 0x7f1768159c70 2023-11-04T01:38:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.397+0000 7f174ffff640 1 -- 172.21.15.114:0/2140855342 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f176003b050 con 0x7f1768159c70 2023-11-04T01:38:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.398+0000 7f174ffff640 1 --2- 172.21.15.114:0/2140855342 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f175406aea0 0x7f175406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.398+0000 7f17677fe640 1 --2- 172.21.15.114:0/2140855342 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f175406aea0 0x7f175406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:11.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.398+0000 7f174ffff640 1 -- 172.21.15.114:0/2140855342 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f17600abec0 con 0x7f1768159c70 2023-11-04T01:38:11.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.398+0000 7f17677fe640 1 --2- 172.21.15.114:0/2140855342 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f175406aea0 0x7f175406d360 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1758001610 tx=0x7f1758007930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:11.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.402+0000 7f174ffff640 1 -- 172.21.15.114:0/2140855342 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f176815a050 con 0x7f1768159c70 2023-11-04T01:38:11.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.632+0000 7f176dc5d640 1 -- 172.21.15.114:0/2140855342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]} v 0) v1 -- 0x7f176815a050 con 0x7f1768159c70 2023-11-04T01:38:11.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.975+0000 7f174ffff640 1 -- 172.21.15.114:0/2140855342 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]}]=0 v117) v1 ==== 173+0+0 (secure 0 0 0) 0x7f176815a050 con 0x7f1768159c70 2023-11-04T01:38:11.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.977+0000 7f176dc5d640 1 -- 172.21.15.114:0/2140855342 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f175406aea0 msgr2=0x7f175406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.977+0000 7f176dc5d640 1 --2- 172.21.15.114:0/2140855342 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f175406aea0 0x7f175406d360 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1758001610 tx=0x7f1758007930 comp rx=0 tx=0).stop 2023-11-04T01:38:11.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.977+0000 7f176dc5d640 1 -- 172.21.15.114:0/2140855342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1768159c70 msgr2=0x7f176815af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:11.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.977+0000 7f176dc5d640 1 --2- 172.21.15.114:0/2140855342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1768159c70 0x7f176815af30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1760009d90 tx=0x7f1760004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:11.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.977+0000 7f176dc5d640 1 -- 172.21.15.114:0/2140855342 shutdown_connections 2023-11-04T01:38:11.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.977+0000 7f176dc5d640 1 --2- 172.21.15.114:0/2140855342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1768159c70 0x7f176815af30 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.977+0000 7f176dc5d640 1 --2- 172.21.15.114:0/2140855342 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f175406aea0 0x7f175406d360 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.977+0000 7f176dc5d640 1 --2- 172.21.15.114:0/2140855342 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17680b0ae0 0x7f176815a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.977+0000 7f176dc5d640 1 --2- 172.21.15.114:0/2140855342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f176806db20 0x7f176814dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:11.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.977+0000 7f176dc5d640 1 -- 172.21.15.114:0/2140855342 >> 172.21.15.114:0/2140855342 conn(0x7f17680ce950 msgr2=0x7f17680b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:11.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.978+0000 7f176dc5d640 1 -- 172.21.15.114:0/2140855342 shutdown_connections 2023-11-04T01:38:11.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:11.978+0000 7f176dc5d640 1 -- 172.21.15.114:0/2140855342 wait complete. 2023-11-04T01:38:11.991 INFO:tasks.cephfs_test_runner:Test that attempt to attach pool with snapshots to an fs fails ... ok 2023-11-04T01:38:11.991 INFO:tasks.cephfs_test_runner:Starting test: test_disallow_monitor_managed_snaps_for_fs_pools (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that creation of monitor managed snaps fails for pools attached 2023-11-04T01:38:11.992 INFO:tasks.cephfs_test_runner:test_disallow_monitor_managed_snaps_for_fs_pools (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:38:11.992 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:12.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.091+0000 7f554acbb640 1 Processor -- start 2023-11-04T01:38:12.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.091+0000 7f554acbb640 1 -- start start 2023-11-04T01:38:12.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.092+0000 7f554acbb640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f554415ae40 0x7f554415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.092+0000 7f554acbb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55440cc450 con 0x7f55440cda30 2023-11-04T01:38:12.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.092+0000 7f554acbb640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554415f400 con 0x7f55440cbc00 2023-11-04T01:38:12.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.092+0000 7f554acbb640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554415b220 con 0x7f554415ae40 2023-11-04T01:38:12.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.092+0000 7f5549258640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f55440cda30 0x7f55440ced70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53812/0 (socket says 172.21.15.114:53812) 2023-11-04T01:38:12.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.092+0000 7f5549258640 1 -- 172.21.15.114:0/4104094534 learned_addr learned my addr 172.21.15.114:0/4104094534 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f5548a57640 1 --2- 172.21.15.114:0/4104094534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f554415ae40 0x7f554415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f55437fe640 1 -- 172.21.15.114:0/4104094534 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135622424 0 0) 0x7f553c001490 con 0x7f55440cda30 2023-11-04T01:38:12.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f55437fe640 1 -- 172.21.15.114:0/4104094534 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f552c003520 con 0x7f55440cda30 2023-11-04T01:38:12.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f55437fe640 1 -- 172.21.15.114:0/4104094534 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3493929615 0 0) 0x7f552c003520 con 0x7f55440cda30 2023-11-04T01:38:12.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f55437fe640 1 -- 172.21.15.114:0/4104094534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f554415ae40 msgr2=0x7f554415bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f55437fe640 1 --2- 172.21.15.114:0/4104094534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f554415ae40 0x7f554415bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f55437fe640 1 -- 172.21.15.114:0/4104094534 >> v1:172.21.15.141:6789/0 conn(0x7f55440cbc00 legacy=0x7f55440cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f55437fe640 1 -- 172.21.15.114:0/4104094534 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554415f890 con 0x7f55440cda30 2023-11-04T01:38:12.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f55437fe640 1 -- 172.21.15.114:0/4104094534 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f553c001b80 con 0x7f55440cda30 2023-11-04T01:38:12.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f55437fe640 1 -- 172.21.15.114:0/4104094534 >> v1:172.21.15.114:6789/0 conn(0x7f55440cda30 legacy=0x7f55440ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f55437fe640 1 --2- 172.21.15.114:0/4104094534 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f552c0039a0 0x7f552c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f55437fe640 1 --2- 172.21.15.114:0/4104094534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f554415ae40 0x7f552c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f55437fe640 1 --2- 172.21.15.114:0/4104094534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f552c004d00 0x7f552c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f55437fe640 1 -- 172.21.15.114:0/4104094534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554415b220 con 0x7f552c004d00 2023-11-04T01:38:12.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f55437fe640 1 -- 172.21.15.114:0/4104094534 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c00ba30 con 0x7f552c0039a0 2023-11-04T01:38:12.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f55437fe640 1 -- 172.21.15.114:0/4104094534 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c00bbf0 con 0x7f554415ae40 2023-11-04T01:38:12.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f5549258640 1 --2- 172.21.15.114:0/4104094534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f552c004d00 0x7f552c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f5548a57640 1 --2- 172.21.15.114:0/4104094534 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f552c0039a0 0x7f552c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f5543fff640 1 --2- 172.21.15.114:0/4104094534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f554415ae40 0x7f552c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f5549258640 1 -- 172.21.15.114:0/4104094534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f554415ae40 msgr2=0x7f552c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f5549258640 1 --2- 172.21.15.114:0/4104094534 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f554415ae40 0x7f552c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f5549258640 1 -- 172.21.15.114:0/4104094534 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f552c0039a0 msgr2=0x7f552c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f5549258640 1 --2- 172.21.15.114:0/4104094534 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f552c0039a0 0x7f552c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.093+0000 7f5549258640 1 -- 172.21.15.114:0/4104094534 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c003520 con 0x7f552c004d00 2023-11-04T01:38:12.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.094+0000 7f5549258640 1 --2- 172.21.15.114:0/4104094534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f552c004d00 0x7f552c005180 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f553c00a800 tx=0x7f552c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257bc29aaa5bf9e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.094+0000 7f55437fe640 1 -- 172.21.15.114:0/4104094534 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c034630 con 0x7f552c004d00 2023-11-04T01:38:12.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.094+0000 7f55437fe640 1 -- 172.21.15.114:0/4104094534 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c02f070 con 0x7f552c004d00 2023-11-04T01:38:12.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.094+0000 7f55437fe640 1 -- 172.21.15.114:0/4104094534 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c0349f0 con 0x7f552c004d00 2023-11-04T01:38:12.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.095+0000 7f554acbb640 1 -- 172.21.15.114:0/4104094534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f552c004d00 msgr2=0x7f552c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.095+0000 7f554acbb640 1 --2- 172.21.15.114:0/4104094534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f552c004d00 0x7f552c005180 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f553c00a800 tx=0x7f552c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.095+0000 7f5549258640 1 -- 172.21.15.114:0/4104094534 reap_dead start 2023-11-04T01:38:12.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.095+0000 7f554acbb640 1 -- 172.21.15.114:0/4104094534 shutdown_connections 2023-11-04T01:38:12.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.095+0000 7f554acbb640 1 -- 172.21.15.114:0/4104094534 >> 172.21.15.114:0/4104094534 conn(0x7f554406ea90 msgr2=0x7f554406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:12.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.095+0000 7f554acbb640 1 -- 172.21.15.114:0/4104094534 shutdown_connections 2023-11-04T01:38:12.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.095+0000 7f554acbb640 1 -- 172.21.15.114:0/4104094534 wait complete. 2023-11-04T01:38:12.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.096+0000 7f554acbb640 1 Processor -- start 2023-11-04T01:38:12.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.096+0000 7f554acbb640 1 -- start start 2023-11-04T01:38:12.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f554acbb640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55441e69e0 0x7f55441e6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f554acbb640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5544141cb0 0x7f5544142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f554acbb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55440c7c70 0x7f55440c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f554acbb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55440c8630 con 0x7f55440c7c70 2023-11-04T01:38:12.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f554acbb640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55440c3df0 con 0x7f55441e69e0 2023-11-04T01:38:12.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f554acbb640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55440c9d80 con 0x7f5544141cb0 2023-11-04T01:38:12.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f5549258640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55440c7c70 0x7f55440c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f5549258640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55440c7c70 0x7f55440c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58082/0 (socket says 172.21.15.114:58082) 2023-11-04T01:38:12.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f5549258640 1 -- 172.21.15.114:0/2942667229 learned_addr learned my addr 172.21.15.114:0/2942667229 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:12.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f5548a57640 1 --2- 172.21.15.114:0/2942667229 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55441e69e0 0x7f55441e6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f5549258640 1 -- 172.21.15.114:0/2942667229 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5544141cb0 msgr2=0x7f5544142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f5549258640 1 --2- 172.21.15.114:0/2942667229 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5544141cb0 0x7f5544142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f5549258640 1 -- 172.21.15.114:0/2942667229 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55441e69e0 msgr2=0x7f55441e6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f5549258640 1 --2- 172.21.15.114:0/2942667229 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55441e69e0 0x7f55441e6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f5549258640 1 -- 172.21.15.114:0/2942667229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55440ca020 con 0x7f55440c7c70 2023-11-04T01:38:12.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f5549258640 1 --2- 172.21.15.114:0/2942667229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55440c7c70 0x7f55440c80f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f553c00a800 tx=0x7f553c001f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f55417fa640 1 -- 172.21.15.114:0/2942667229 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c03f670 con 0x7f55440c7c70 2023-11-04T01:38:12.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f55417fa640 1 -- 172.21.15.114:0/2942667229 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c02ce90 con 0x7f55440c7c70 2023-11-04T01:38:12.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f55417fa640 1 -- 172.21.15.114:0/2942667229 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c03f9f0 con 0x7f55440c7c70 2023-11-04T01:38:12.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f554acbb640 1 -- 172.21.15.114:0/2942667229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55440ca300 con 0x7f55440c7c70 2023-11-04T01:38:12.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.097+0000 7f554acbb640 1 -- 172.21.15.114:0/2942667229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55440ca8c0 con 0x7f55440c7c70 2023-11-04T01:38:12.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.098+0000 7f554acbb640 1 -- 172.21.15.114:0/2942667229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55440ce2d0 con 0x7f55440c7c70 2023-11-04T01:38:12.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.099+0000 7f55417fa640 1 -- 172.21.15.114:0/2942667229 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f553c031030 con 0x7f55440c7c70 2023-11-04T01:38:12.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.099+0000 7f55417fa640 1 --2- 172.21.15.114:0/2942667229 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f553006ae70 0x7f553006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.099+0000 7f55417fa640 1 -- 172.21.15.114:0/2942667229 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f553c0ab600 con 0x7f55440c7c70 2023-11-04T01:38:12.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.099+0000 7f5548a57640 1 --2- 172.21.15.114:0/2942667229 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f553006ae70 0x7f553006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.100+0000 7f5548a57640 1 --2- 172.21.15.114:0/2942667229 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f553006ae70 0x7f553006d330 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f55340099e0 tx=0x7f5534008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.103+0000 7f55417fa640 1 -- 172.21.15.114:0/2942667229 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f553c0767a0 con 0x7f55440c7c70 2023-11-04T01:38:12.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.277+0000 7f554acbb640 1 -- 172.21.15.114:0/2942667229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55440ce2d0 con 0x7f55440c7c70 2023-11-04T01:38:12.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.278+0000 7f55417fa640 1 -- 172.21.15.114:0/2942667229 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+15006 (secure 0 0 0) 0x7f553c079dc0 con 0x7f55440c7c70 2023-11-04T01:38:12.280 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:12.280 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":45,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:10.970289+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:6835/3122131633":"2023-11-05T01:38:07.964170+0000","172.21.15.141:6833/3122131633":"2023-11-05T01:38:07.964170+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:12.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.280+0000 7f554acbb640 1 -- 172.21.15.114:0/2942667229 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f553006ae70 msgr2=0x7f553006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.280+0000 7f554acbb640 1 --2- 172.21.15.114:0/2942667229 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f553006ae70 0x7f553006d330 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f55340099e0 tx=0x7f5534008040 comp rx=0 tx=0).stop 2023-11-04T01:38:12.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.280+0000 7f554acbb640 1 -- 172.21.15.114:0/2942667229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55440c7c70 msgr2=0x7f55440c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.280+0000 7f554acbb640 1 --2- 172.21.15.114:0/2942667229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55440c7c70 0x7f55440c80f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f553c00a800 tx=0x7f553c001f10 comp rx=0 tx=0).stop 2023-11-04T01:38:12.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.280+0000 7f554acbb640 1 -- 172.21.15.114:0/2942667229 shutdown_connections 2023-11-04T01:38:12.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.280+0000 7f554acbb640 1 --2- 172.21.15.114:0/2942667229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55440c7c70 0x7f55440c80f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.280+0000 7f554acbb640 1 --2- 172.21.15.114:0/2942667229 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5544141cb0 0x7f5544142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.280+0000 7f554acbb640 1 --2- 172.21.15.114:0/2942667229 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f553006ae70 0x7f553006d330 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.280+0000 7f554acbb640 1 --2- 172.21.15.114:0/2942667229 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55441e69e0 0x7f55441e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.280+0000 7f554acbb640 1 -- 172.21.15.114:0/2942667229 >> 172.21.15.114:0/2942667229 conn(0x7f554406ea90 msgr2=0x7f554415dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:12.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.280+0000 7f554acbb640 1 -- 172.21.15.114:0/2942667229 shutdown_connections 2023-11-04T01:38:12.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.280+0000 7f554acbb640 1 -- 172.21.15.114:0/2942667229 wait complete. 2023-11-04T01:38:12.293 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:12.293 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:12.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.396+0000 7fe91581f640 1 Processor -- start 2023-11-04T01:38:12.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.396+0000 7fe91581f640 1 -- start start 2023-11-04T01:38:12.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.397+0000 7fe91581f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe910153e60 0x7fe91015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.397+0000 7fe91581f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9100b4880 0x7fe9100b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.397+0000 7fe91581f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9100cde60 con 0x7fe9100cd6d0 2023-11-04T01:38:12.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.397+0000 7fe91581f640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe910160f90 con 0x7fe910153e60 2023-11-04T01:38:12.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.397+0000 7fe91581f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9100b5200 con 0x7fe9100b4880 2023-11-04T01:38:12.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.397+0000 7fe907fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe9100cd6d0 0x7fe910161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53816/0 (socket says 172.21.15.114:53816) 2023-11-04T01:38:12.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.397+0000 7fe907fff640 1 -- 172.21.15.114:0/3709655892 learned_addr learned my addr 172.21.15.114:0/3709655892 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:12.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.397+0000 7fe90e7fc640 1 -- 172.21.15.114:0/3709655892 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447836209 0 0) 0x7fe9100cde60 con 0x7fe9100cd6d0 2023-11-04T01:38:12.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.397+0000 7fe90e7fc640 1 -- 172.21.15.114:0/3709655892 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8fc003520 con 0x7fe9100cd6d0 2023-11-04T01:38:12.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.397+0000 7fe90f7fe640 1 --2- 172.21.15.114:0/3709655892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9100b4880 0x7fe9100b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90effd640 1 --2- 172.21.15.114:0/3709655892 >> v2:172.21.15.141:3300/0 conn(0x7fe910153e60 0x7fe91015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90e7fc640 1 -- 172.21.15.114:0/3709655892 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2971289236 0 0) 0x7fe8fc003520 con 0x7fe9100cd6d0 2023-11-04T01:38:12.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90e7fc640 1 -- 172.21.15.114:0/3709655892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9100b4880 msgr2=0x7fe9100b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90e7fc640 1 --2- 172.21.15.114:0/3709655892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9100b4880 0x7fe9100b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90e7fc640 1 -- 172.21.15.114:0/3709655892 >> v2:172.21.15.141:3300/0 conn(0x7fe910153e60 msgr2=0x7fe91015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90e7fc640 1 --2- 172.21.15.114:0/3709655892 >> v2:172.21.15.141:3300/0 conn(0x7fe910153e60 0x7fe91015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90e7fc640 1 -- 172.21.15.114:0/3709655892 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91015e400 con 0x7fe9100cd6d0 2023-11-04T01:38:12.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90e7fc640 1 -- 172.21.15.114:0/3709655892 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fe8f8001670 con 0x7fe9100cd6d0 2023-11-04T01:38:12.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90e7fc640 1 -- 172.21.15.114:0/3709655892 >> v1:172.21.15.114:6789/0 conn(0x7fe9100cd6d0 legacy=0x7fe910161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90e7fc640 1 --2- 172.21.15.114:0/3709655892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8fc003970 0x7fe8fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90e7fc640 1 --2- 172.21.15.114:0/3709655892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9100b4880 0x7fe8fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90e7fc640 1 --2- 172.21.15.114:0/3709655892 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe8fc004d00 0x7fe8fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90e7fc640 1 -- 172.21.15.114:0/3709655892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe910160f90 con 0x7fe8fc003970 2023-11-04T01:38:12.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90e7fc640 1 -- 172.21.15.114:0/3709655892 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9100b5200 con 0x7fe8fc004d00 2023-11-04T01:38:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90e7fc640 1 -- 172.21.15.114:0/3709655892 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc00b980 con 0x7fe9100b4880 2023-11-04T01:38:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90effd640 1 --2- 172.21.15.114:0/3709655892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8fc003970 0x7fe8fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe907fff640 1 --2- 172.21.15.114:0/3709655892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9100b4880 0x7fe8fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90f7fe640 1 --2- 172.21.15.114:0/3709655892 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe8fc004d00 0x7fe8fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90effd640 1 -- 172.21.15.114:0/3709655892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9100b4880 msgr2=0x7fe8fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90effd640 1 --2- 172.21.15.114:0/3709655892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9100b4880 0x7fe8fc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90effd640 1 -- 172.21.15.114:0/3709655892 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe8fc004d00 msgr2=0x7fe8fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90effd640 1 --2- 172.21.15.114:0/3709655892 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe8fc004d00 0x7fe8fc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe90effd640 1 -- 172.21.15.114:0/3709655892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8fc003520 con 0x7fe8fc003970 2023-11-04T01:38:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.398+0000 7fe907fff640 1 --2- 172.21.15.114:0/3709655892 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9100b4880 0x7fe8fc0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.399+0000 7fe90effd640 1 --2- 172.21.15.114:0/3709655892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8fc003970 0x7fe8fc003d90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe900009af0 tx=0x7fe8fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f21fde524d72a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.399+0000 7fe90e7fc640 1 -- 172.21.15.114:0/3709655892 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90002c710 con 0x7fe8fc003970 2023-11-04T01:38:12.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.399+0000 7fe90e7fc640 1 -- 172.21.15.114:0/3709655892 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90002c870 con 0x7fe8fc003970 2023-11-04T01:38:12.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.399+0000 7fe90e7fc640 1 -- 172.21.15.114:0/3709655892 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90002cc00 con 0x7fe8fc003970 2023-11-04T01:38:12.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.399+0000 7fe91581f640 1 -- 172.21.15.114:0/3709655892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8fc003970 msgr2=0x7fe8fc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.399+0000 7fe91581f640 1 --2- 172.21.15.114:0/3709655892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8fc003970 0x7fe8fc003d90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe900009af0 tx=0x7fe8fc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.400+0000 7fe90f7fe640 1 -- 172.21.15.114:0/3709655892 reap_dead start 2023-11-04T01:38:12.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.400+0000 7fe91581f640 1 -- 172.21.15.114:0/3709655892 shutdown_connections 2023-11-04T01:38:12.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.400+0000 7fe91581f640 1 -- 172.21.15.114:0/3709655892 >> 172.21.15.114:0/3709655892 conn(0x7fe9100cf880 msgr2=0x7fe9100cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:12.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.400+0000 7fe91581f640 1 -- 172.21.15.114:0/3709655892 shutdown_connections 2023-11-04T01:38:12.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.400+0000 7fe91581f640 1 -- 172.21.15.114:0/3709655892 wait complete. 2023-11-04T01:38:12.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.401+0000 7fe91581f640 1 Processor -- start 2023-11-04T01:38:12.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.401+0000 7fe91581f640 1 -- start start 2023-11-04T01:38:12.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.401+0000 7fe91581f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe8fc003970 0x7fe910154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.401+0000 7fe91581f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9100ca920 0x7fe9101482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.401+0000 7fe91581f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9101f2170 0x7fe9100b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe91581f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9100c9ed0 con 0x7fe9101f2170 2023-11-04T01:38:12.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe91581f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9100ca490 con 0x7fe9100ca920 2023-11-04T01:38:12.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe91581f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe910148810 con 0x7fe8fc003970 2023-11-04T01:38:12.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe90f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9101f2170 0x7fe9100b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe90f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9101f2170 0x7fe9100b7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58100/0 (socket says 172.21.15.114:58100) 2023-11-04T01:38:12.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe90f7fe640 1 -- 172.21.15.114:0/2615905953 learned_addr learned my addr 172.21.15.114:0/2615905953 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:12.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe90effd640 1 --2- 172.21.15.114:0/2615905953 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe8fc003970 0x7fe910154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe907fff640 1 --2- 172.21.15.114:0/2615905953 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9100ca920 0x7fe9101482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe90f7fe640 1 -- 172.21.15.114:0/2615905953 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe8fc003970 msgr2=0x7fe910154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe90f7fe640 1 --2- 172.21.15.114:0/2615905953 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe8fc003970 0x7fe910154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe90f7fe640 1 -- 172.21.15.114:0/2615905953 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9100ca920 msgr2=0x7fe9101482d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe90f7fe640 1 --2- 172.21.15.114:0/2615905953 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9100ca920 0x7fe9101482d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe90f7fe640 1 -- 172.21.15.114:0/2615905953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe910147d50 con 0x7fe9101f2170 2023-11-04T01:38:12.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe90effd640 1 --2- 172.21.15.114:0/2615905953 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe8fc003970 0x7fe910154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:12.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe90f7fe640 1 --2- 172.21.15.114:0/2615905953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9101f2170 0x7fe9100b7150 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe908007d10 tx=0x7fe9080115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe90cff9640 1 -- 172.21.15.114:0/2615905953 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90800e070 con 0x7fe9101f2170 2023-11-04T01:38:12.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe90cff9640 1 -- 172.21.15.114:0/2615905953 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe908011e40 con 0x7fe9101f2170 2023-11-04T01:38:12.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe91581f640 1 -- 172.21.15.114:0/2615905953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe910155580 con 0x7fe9101f2170 2023-11-04T01:38:12.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe90cff9640 1 -- 172.21.15.114:0/2615905953 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908003990 con 0x7fe9101f2170 2023-11-04T01:38:12.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.402+0000 7fe91581f640 1 -- 172.21.15.114:0/2615905953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9100ca120 con 0x7fe9101f2170 2023-11-04T01:38:12.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.403+0000 7fe91581f640 1 -- 172.21.15.114:0/2615905953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9100ca620 con 0x7fe9101f2170 2023-11-04T01:38:12.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.404+0000 7fe90cff9640 1 -- 172.21.15.114:0/2615905953 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe908003b10 con 0x7fe9101f2170 2023-11-04T01:38:12.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.404+0000 7fe90cff9640 1 --2- 172.21.15.114:0/2615905953 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe8f006aea0 0x7fe8f006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.404+0000 7fe90cff9640 1 -- 172.21.15.114:0/2615905953 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe908089b50 con 0x7fe9101f2170 2023-11-04T01:38:12.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.404+0000 7fe90effd640 1 --2- 172.21.15.114:0/2615905953 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe8f006aea0 0x7fe8f006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.404+0000 7fe90effd640 1 --2- 172.21.15.114:0/2615905953 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe8f006aea0 0x7fe8f006d360 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe900036000 tx=0x7fe900030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.408+0000 7fe90cff9640 1 -- 172.21.15.114:0/2615905953 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe908054cf0 con 0x7fe9101f2170 2023-11-04T01:38:12.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.573+0000 7fe91581f640 1 -- 172.21.15.114:0/2615905953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe910074290 con 0x7fe9101f2170 2023-11-04T01:38:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.574+0000 7fe90cff9640 1 -- 172.21.15.114:0/2615905953 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe908058310 con 0x7fe9101f2170 2023-11-04T01:38:12.576 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:38:12.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.576+0000 7fe91581f640 1 -- 172.21.15.114:0/2615905953 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe8f006aea0 msgr2=0x7fe8f006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.576+0000 7fe91581f640 1 --2- 172.21.15.114:0/2615905953 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe8f006aea0 0x7fe8f006d360 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe900036000 tx=0x7fe900030000 comp rx=0 tx=0).stop 2023-11-04T01:38:12.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.576+0000 7fe91581f640 1 -- 172.21.15.114:0/2615905953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9101f2170 msgr2=0x7fe9100b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.576+0000 7fe91581f640 1 --2- 172.21.15.114:0/2615905953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9101f2170 0x7fe9100b7150 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe908007d10 tx=0x7fe9080115a0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.576+0000 7fe91581f640 1 -- 172.21.15.114:0/2615905953 shutdown_connections 2023-11-04T01:38:12.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.576+0000 7fe91581f640 1 --2- 172.21.15.114:0/2615905953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9101f2170 0x7fe9100b7150 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.576+0000 7fe91581f640 1 --2- 172.21.15.114:0/2615905953 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe8f006aea0 0x7fe8f006d360 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.576+0000 7fe91581f640 1 --2- 172.21.15.114:0/2615905953 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9100ca920 0x7fe9101482d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.576+0000 7fe91581f640 1 --2- 172.21.15.114:0/2615905953 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe8fc003970 0x7fe910154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.576+0000 7fe91581f640 1 -- 172.21.15.114:0/2615905953 >> 172.21.15.114:0/2615905953 conn(0x7fe9100cf880 msgr2=0x7fe9100d2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:12.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.576+0000 7fe91581f640 1 -- 172.21.15.114:0/2615905953 shutdown_connections 2023-11-04T01:38:12.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.576+0000 7fe91581f640 1 -- 172.21.15.114:0/2615905953 wait complete. 2023-11-04T01:38:12.588 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:12.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.693+0000 7f5f768c2640 1 Processor -- start 2023-11-04T01:38:12.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.693+0000 7f5f768c2640 1 -- start start 2023-11-04T01:38:12.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.693+0000 7f5f768c2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f701605b0 0x7f5f700ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.693+0000 7f5f768c2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5f700b1a40 0x7f5f7006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.693+0000 7f5f768c2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5f700ca560 0x7f5f7006a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.693+0000 7f5f768c2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f70160990 con 0x7f5f700ca560 2023-11-04T01:38:12.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.693+0000 7f5f768c2640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f700cc7c0 con 0x7f5f700b1a40 2023-11-04T01:38:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.693+0000 7f5f768c2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f700cd750 con 0x7f5f701605b0 2023-11-04T01:38:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.694+0000 7f5f74e5f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5f700ca560 0x7f5f7006a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.694+0000 7f5f74e5f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5f700ca560 0x7f5f7006a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58110/0 (socket says 172.21.15.114:58110) 2023-11-04T01:38:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.694+0000 7f5f74e5f640 1 -- 172.21.15.114:0/3503909880 learned_addr learned my addr 172.21.15.114:0/3503909880 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.694+0000 7f5f6f7fe640 1 --2- 172.21.15.114:0/3503909880 >> v2:172.21.15.141:3300/0 conn(0x7f5f700b1a40 0x7f5f7006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.694+0000 7f5f6ffff640 1 --2- 172.21.15.114:0/3503909880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f701605b0 0x7f5f700ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.694+0000 7f5f74e5f640 1 -- 172.21.15.114:0/3503909880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f701605b0 msgr2=0x7f5f700ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.694+0000 7f5f74e5f640 1 --2- 172.21.15.114:0/3503909880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f701605b0 0x7f5f700ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.694+0000 7f5f74e5f640 1 -- 172.21.15.114:0/3503909880 >> v2:172.21.15.141:3300/0 conn(0x7f5f700b1a40 msgr2=0x7f5f7006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.694+0000 7f5f74e5f640 1 --2- 172.21.15.114:0/3503909880 >> v2:172.21.15.141:3300/0 conn(0x7f5f700b1a40 0x7f5f7006a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.694+0000 7f5f74e5f640 1 -- 172.21.15.114:0/3503909880 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f700cc4e0 con 0x7f5f700ca560 2023-11-04T01:38:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.694+0000 7f5f6ffff640 1 --2- 172.21.15.114:0/3503909880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f701605b0 0x7f5f700ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:12.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.694+0000 7f5f6f7fe640 1 --2- 172.21.15.114:0/3503909880 >> v2:172.21.15.141:3300/0 conn(0x7f5f700b1a40 0x7f5f7006a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:12.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.695+0000 7f5f74e5f640 1 --2- 172.21.15.114:0/3503909880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f700ca560 0x7f5f7006a660 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5f7006edd0 tx=0x7f5f6802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3755d452ea76950d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.695+0000 7f5f6effd640 1 -- 172.21.15.114:0/3503909880 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6802c950 con 0x7f5f700ca560 2023-11-04T01:38:12.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.695+0000 7f5f6effd640 1 -- 172.21.15.114:0/3503909880 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6802cab0 con 0x7f5f700ca560 2023-11-04T01:38:12.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.695+0000 7f5f6effd640 1 -- 172.21.15.114:0/3503909880 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6802ce40 con 0x7f5f700ca560 2023-11-04T01:38:12.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.695+0000 7f5f768c2640 1 -- 172.21.15.114:0/3503909880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f700ca560 msgr2=0x7f5f7006a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.695+0000 7f5f768c2640 1 --2- 172.21.15.114:0/3503909880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f700ca560 0x7f5f7006a660 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5f7006edd0 tx=0x7f5f6802bdb0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.695+0000 7f5f768c2640 1 -- 172.21.15.114:0/3503909880 shutdown_connections 2023-11-04T01:38:12.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.695+0000 7f5f768c2640 1 --2- 172.21.15.114:0/3503909880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f700ca560 0x7f5f7006a660 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.695+0000 7f5f768c2640 1 --2- 172.21.15.114:0/3503909880 >> v2:172.21.15.141:3300/0 conn(0x7f5f700b1a40 0x7f5f7006a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.695+0000 7f5f768c2640 1 --2- 172.21.15.114:0/3503909880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f701605b0 0x7f5f700ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.695+0000 7f5f768c2640 1 -- 172.21.15.114:0/3503909880 >> 172.21.15.114:0/3503909880 conn(0x7f5f70071820 msgr2=0x7f5f70071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:12.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.695+0000 7f5f768c2640 1 -- 172.21.15.114:0/3503909880 shutdown_connections 2023-11-04T01:38:12.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.695+0000 7f5f768c2640 1 -- 172.21.15.114:0/3503909880 wait complete. 2023-11-04T01:38:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.696+0000 7f5f768c2640 1 Processor -- start 2023-11-04T01:38:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.697+0000 7f5f768c2640 1 -- start start 2023-11-04T01:38:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.697+0000 7f5f768c2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f700ca560 0x7f5f701f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.697+0000 7f5f768c2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f701605b0 0x7f5f7015c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.697+0000 7f5f768c2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f700adf70 0x7f5f7015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.697+0000 7f5f768c2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f701f6e20 con 0x7f5f701605b0 2023-11-04T01:38:12.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.697+0000 7f5f768c2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7015c540 con 0x7f5f700adf70 2023-11-04T01:38:12.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.697+0000 7f5f768c2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f700ab8e0 con 0x7f5f700ca560 2023-11-04T01:38:12.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.697+0000 7f5f6f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f701605b0 0x7f5f7015c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.697+0000 7f5f6f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f701605b0 0x7f5f7015c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58116/0 (socket says 172.21.15.114:58116) 2023-11-04T01:38:12.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.698+0000 7f5f6f7fe640 1 -- 172.21.15.114:0/3238623679 learned_addr learned my addr 172.21.15.114:0/3238623679 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:12.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.698+0000 7f5f74e5f640 1 --2- 172.21.15.114:0/3238623679 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f700adf70 0x7f5f7015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.698+0000 7f5f6ffff640 1 --2- 172.21.15.114:0/3238623679 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f700ca560 0x7f5f701f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.698+0000 7f5f6f7fe640 1 -- 172.21.15.114:0/3238623679 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f700ca560 msgr2=0x7f5f701f68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.698+0000 7f5f6f7fe640 1 --2- 172.21.15.114:0/3238623679 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f700ca560 0x7f5f701f68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.698+0000 7f5f6f7fe640 1 -- 172.21.15.114:0/3238623679 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f700adf70 msgr2=0x7f5f7015d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.698+0000 7f5f6f7fe640 1 --2- 172.21.15.114:0/3238623679 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f700adf70 0x7f5f7015d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.698+0000 7f5f6f7fe640 1 -- 172.21.15.114:0/3238623679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f68009b30 con 0x7f5f701605b0 2023-11-04T01:38:12.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.698+0000 7f5f74e5f640 1 --2- 172.21.15.114:0/3238623679 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f700adf70 0x7f5f7015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:12.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.698+0000 7f5f6f7fe640 1 --2- 172.21.15.114:0/3238623679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f701605b0 0x7f5f7015c000 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000d830 tx=0x7f5f6000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.698+0000 7f5f6cff9640 1 -- 172.21.15.114:0/3238623679 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000be10 con 0x7f5f701605b0 2023-11-04T01:38:12.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.698+0000 7f5f6cff9640 1 -- 172.21.15.114:0/3238623679 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f60004030 con 0x7f5f701605b0 2023-11-04T01:38:12.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.698+0000 7f5f768c2640 1 -- 172.21.15.114:0/3238623679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f700abba0 con 0x7f5f701605b0 2023-11-04T01:38:12.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.698+0000 7f5f6cff9640 1 -- 172.21.15.114:0/3238623679 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f600043c0 con 0x7f5f701605b0 2023-11-04T01:38:12.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.698+0000 7f5f768c2640 1 -- 172.21.15.114:0/3238623679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f700ac160 con 0x7f5f701605b0 2023-11-04T01:38:12.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.699+0000 7f5f768c2640 1 -- 172.21.15.114:0/3238623679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f700672a0 con 0x7f5f701605b0 2023-11-04T01:38:12.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.699+0000 7f5f6cff9640 1 -- 172.21.15.114:0/3238623679 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f600098b0 con 0x7f5f701605b0 2023-11-04T01:38:12.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.700+0000 7f5f6cff9640 1 --2- 172.21.15.114:0/3238623679 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f5c06ae70 0x7f5f5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.700+0000 7f5f6cff9640 1 -- 172.21.15.114:0/3238623679 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f5f60089760 con 0x7f5f701605b0 2023-11-04T01:38:12.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.700+0000 7f5f6ffff640 1 --2- 172.21.15.114:0/3238623679 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f5c06ae70 0x7f5f5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.700+0000 7f5f6ffff640 1 --2- 172.21.15.114:0/3238623679 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f5c06ae70 0x7f5f5c06d330 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5f64006fd0 tx=0x7f5f64008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.704+0000 7f5f6cff9640 1 -- 172.21.15.114:0/3238623679 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5f60054870 con 0x7f5f701605b0 2023-11-04T01:38:12.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.870+0000 7f5f768c2640 1 -- 172.21.15.114:0/3238623679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f5f70074290 con 0x7f5f701605b0 2023-11-04T01:38:12.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.870+0000 7f5f6cff9640 1 -- 172.21.15.114:0/3238623679 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v45) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5f60057e90 con 0x7f5f701605b0 2023-11-04T01:38:12.875 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:38:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.872+0000 7f5f768c2640 1 -- 172.21.15.114:0/3238623679 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f5c06ae70 msgr2=0x7f5f5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.872+0000 7f5f768c2640 1 --2- 172.21.15.114:0/3238623679 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f5c06ae70 0x7f5f5c06d330 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5f64006fd0 tx=0x7f5f64008040 comp rx=0 tx=0).stop 2023-11-04T01:38:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.872+0000 7f5f768c2640 1 -- 172.21.15.114:0/3238623679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f701605b0 msgr2=0x7f5f7015c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.872+0000 7f5f768c2640 1 --2- 172.21.15.114:0/3238623679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f701605b0 0x7f5f7015c000 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000d830 tx=0x7f5f6000dcf0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.872+0000 7f5f768c2640 1 -- 172.21.15.114:0/3238623679 shutdown_connections 2023-11-04T01:38:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.872+0000 7f5f768c2640 1 --2- 172.21.15.114:0/3238623679 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f5c06ae70 0x7f5f5c06d330 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.872+0000 7f5f768c2640 1 --2- 172.21.15.114:0/3238623679 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f700adf70 0x7f5f7015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.872+0000 7f5f768c2640 1 --2- 172.21.15.114:0/3238623679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f701605b0 0x7f5f7015c000 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.872+0000 7f5f768c2640 1 --2- 172.21.15.114:0/3238623679 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f700ca560 0x7f5f701f68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.872+0000 7f5f768c2640 1 -- 172.21.15.114:0/3238623679 >> 172.21.15.114:0/3238623679 conn(0x7f5f70071820 msgr2=0x7f5f700caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:12.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.873+0000 7f5f768c2640 1 -- 172.21.15.114:0/3238623679 shutdown_connections 2023-11-04T01:38:12.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.873+0000 7f5f768c2640 1 -- 172.21.15.114:0/3238623679 wait complete. 2023-11-04T01:38:12.885 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools' 2023-11-04T01:38:12.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.983+0000 7f62bfd7c640 1 Processor -- start 2023-11-04T01:38:12.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.983+0000 7f62bfd7c640 1 -- start start 2023-11-04T01:38:12.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.984+0000 7f62bfd7c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f62b80b5e90 0x7f62b80b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.984+0000 7f62bfd7c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f62b806b770 0x7f62b806bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.984+0000 7f62bfd7c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b806c100 con 0x7f62b815cfb0 2023-11-04T01:38:12.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.984+0000 7f62bfd7c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b80d1ce0 con 0x7f62b80b5e90 2023-11-04T01:38:12.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.984+0000 7f62bfd7c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b80b26b0 con 0x7f62b806b770 2023-11-04T01:38:12.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.984+0000 7f62bd317640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f62b80b5e90 0x7f62b80b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.984+0000 7f62bd317640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f62b80b5e90 0x7f62b80b62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58132/0 (socket says 172.21.15.114:58132) 2023-11-04T01:38:12.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.984+0000 7f62bd317640 1 -- 172.21.15.114:0/2865581027 learned_addr learned my addr 172.21.15.114:0/2865581027 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:12.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.984+0000 7f62be319640 1 --2- 172.21.15.114:0/2865581027 >> v2:172.21.15.141:3300/0 conn(0x7f62b806b770 0x7f62b806bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.984+0000 7f62bd317640 1 -- 172.21.15.114:0/2865581027 >> v2:172.21.15.141:3300/0 conn(0x7f62b806b770 msgr2=0x7f62b806bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.985+0000 7f62bd317640 1 --2- 172.21.15.114:0/2865581027 >> v2:172.21.15.141:3300/0 conn(0x7f62b806b770 0x7f62b806bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.985+0000 7f62bd317640 1 -- 172.21.15.114:0/2865581027 >> v1:172.21.15.141:6789/0 conn(0x7f62b815cfb0 legacy=0x7f62b80b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:12.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.985+0000 7f62bd317640 1 -- 172.21.15.114:0/2865581027 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b80d1110 con 0x7f62b80b5e90 2023-11-04T01:38:12.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.985+0000 7f62be319640 1 --2- 172.21.15.114:0/2865581027 >> v2:172.21.15.141:3300/0 conn(0x7f62b806b770 0x7f62b806bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:12.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.985+0000 7f62bd317640 1 --2- 172.21.15.114:0/2865581027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62b80b5e90 0x7f62b80b62f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f62b80c6760 tx=0x7f62a802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b48fd0c1c98a3f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.985+0000 7f62bcb16640 1 -- 172.21.15.114:0/2865581027 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8031870 con 0x7f62b80b5e90 2023-11-04T01:38:12.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.985+0000 7f62bcb16640 1 -- 172.21.15.114:0/2865581027 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a80319d0 con 0x7f62b80b5e90 2023-11-04T01:38:12.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.985+0000 7f62bcb16640 1 -- 172.21.15.114:0/2865581027 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8031d60 con 0x7f62b80b5e90 2023-11-04T01:38:12.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.986+0000 7f62bfd7c640 1 -- 172.21.15.114:0/2865581027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62b80b5e90 msgr2=0x7f62b80b62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.986+0000 7f62bfd7c640 1 --2- 172.21.15.114:0/2865581027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62b80b5e90 0x7f62b80b62f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f62b80c6760 tx=0x7f62a802b910 comp rx=0 tx=0).stop 2023-11-04T01:38:12.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.986+0000 7f62bfd7c640 1 -- 172.21.15.114:0/2865581027 shutdown_connections 2023-11-04T01:38:12.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.986+0000 7f62bfd7c640 1 --2- 172.21.15.114:0/2865581027 >> v2:172.21.15.141:3300/0 conn(0x7f62b806b770 0x7f62b806bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.986+0000 7f62bfd7c640 1 --2- 172.21.15.114:0/2865581027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62b80b5e90 0x7f62b80b62f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.986+0000 7f62bfd7c640 1 -- 172.21.15.114:0/2865581027 >> 172.21.15.114:0/2865581027 conn(0x7f62b8071ca0 msgr2=0x7f62b80720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:12.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.986+0000 7f62bfd7c640 1 -- 172.21.15.114:0/2865581027 shutdown_connections 2023-11-04T01:38:12.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.986+0000 7f62bfd7c640 1 -- 172.21.15.114:0/2865581027 wait complete. 2023-11-04T01:38:12.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.987+0000 7f62bfd7c640 1 Processor -- start 2023-11-04T01:38:12.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.987+0000 7f62bfd7c640 1 -- start start 2023-11-04T01:38:12.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62bfd7c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62b806b770 0x7f62b80a97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62bfd7c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62b80b5e90 0x7f62b80c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62bfd7c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62b815cfb0 0x7f62b815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62bfd7c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80cb2d0 con 0x7f62b815cfb0 2023-11-04T01:38:12.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62bfd7c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80c77b0 con 0x7f62b806b770 2023-11-04T01:38:12.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62bfd7c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80c8010 con 0x7f62b80b5e90 2023-11-04T01:38:12.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62be319640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62b815cfb0 0x7f62b815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62be319640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62b815cfb0 0x7f62b815acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58140/0 (socket says 172.21.15.114:58140) 2023-11-04T01:38:12.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62be319640 1 -- 172.21.15.114:0/3969042370 learned_addr learned my addr 172.21.15.114:0/3969042370 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:12.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62bd317640 1 --2- 172.21.15.114:0/3969042370 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62b80b5e90 0x7f62b80c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62bdb18640 1 --2- 172.21.15.114:0/3969042370 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62b806b770 0x7f62b80a97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62be319640 1 -- 172.21.15.114:0/3969042370 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62b80b5e90 msgr2=0x7f62b80c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62be319640 1 --2- 172.21.15.114:0/3969042370 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62b80b5e90 0x7f62b80c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62be319640 1 -- 172.21.15.114:0/3969042370 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62b806b770 msgr2=0x7f62b80a97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:12.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62be319640 1 --2- 172.21.15.114:0/3969042370 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62b806b770 0x7f62b80a97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:12.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62be319640 1 -- 172.21.15.114:0/3969042370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a80094d0 con 0x7f62b815cfb0 2023-11-04T01:38:12.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.988+0000 7f62bdb18640 1 --2- 172.21.15.114:0/3969042370 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62b806b770 0x7f62b80a97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:12.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.989+0000 7f62be319640 1 --2- 172.21.15.114:0/3969042370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62b815cfb0 0x7f62b815acd0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f62b000c7c0 tx=0x7f62b000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.989+0000 7f62ae7fc640 1 -- 172.21.15.114:0/3969042370 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0004230 con 0x7f62b815cfb0 2023-11-04T01:38:12.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.989+0000 7f62ae7fc640 1 -- 172.21.15.114:0/3969042370 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b0004390 con 0x7f62b815cfb0 2023-11-04T01:38:12.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.989+0000 7f62bfd7c640 1 -- 172.21.15.114:0/3969042370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b80c7a50 con 0x7f62b815cfb0 2023-11-04T01:38:12.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.989+0000 7f62ae7fc640 1 -- 172.21.15.114:0/3969042370 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0007860 con 0x7f62b815cfb0 2023-11-04T01:38:12.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.989+0000 7f62bfd7c640 1 -- 172.21.15.114:0/3969042370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b80caf60 con 0x7f62b815cfb0 2023-11-04T01:38:12.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.990+0000 7f62bfd7c640 1 -- 172.21.15.114:0/3969042370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b80cb440 con 0x7f62b815cfb0 2023-11-04T01:38:12.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.990+0000 7f62ae7fc640 1 -- 172.21.15.114:0/3969042370 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f62b00079c0 con 0x7f62b815cfb0 2023-11-04T01:38:12.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.990+0000 7f62ae7fc640 1 --2- 172.21.15.114:0/3969042370 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f629c06ae70 0x7f629c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:12.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.991+0000 7f62ae7fc640 1 -- 172.21.15.114:0/3969042370 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f62b00897d0 con 0x7f62b815cfb0 2023-11-04T01:38:12.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.991+0000 7f62bdb18640 1 --2- 172.21.15.114:0/3969042370 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f629c06ae70 0x7f629c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:12.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.991+0000 7f62bdb18640 1 --2- 172.21.15.114:0/3969042370 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f629c06ae70 0x7f629c06d330 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f62b40045b0 tx=0x7f62b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:12.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:12.995+0000 7f62ae7fc640 1 -- 172.21.15.114:0/3969042370 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f62b00549a0 con 0x7f62b815cfb0 2023-11-04T01:38:13.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:13.228+0000 7f62bfd7c640 1 -- 172.21.15.114:0/3969042370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]} v 0) v1 -- 0x7f62b8074290 con 0x7f62b815cfb0 2023-11-04T01:38:13.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:13.981+0000 7f62ae7fc640 1 -- 172.21.15.114:0/3969042370 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]}]=0 v119) v1 ==== 181+0+0 (secure 0 0 0) 0x7f62b0057fc0 con 0x7f62b815cfb0 2023-11-04T01:38:13.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:13.984+0000 7f62bfd7c640 1 -- 172.21.15.114:0/3969042370 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f629c06ae70 msgr2=0x7f629c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:13.984+0000 7f62bfd7c640 1 --2- 172.21.15.114:0/3969042370 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f629c06ae70 0x7f629c06d330 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f62b40045b0 tx=0x7f62b4009040 comp rx=0 tx=0).stop 2023-11-04T01:38:13.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:13.984+0000 7f62bfd7c640 1 -- 172.21.15.114:0/3969042370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62b815cfb0 msgr2=0x7f62b815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:13.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:13.984+0000 7f62bfd7c640 1 --2- 172.21.15.114:0/3969042370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62b815cfb0 0x7f62b815acd0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f62b000c7c0 tx=0x7f62b000cc80 comp rx=0 tx=0).stop 2023-11-04T01:38:13.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:13.984+0000 7f62bfd7c640 1 -- 172.21.15.114:0/3969042370 shutdown_connections 2023-11-04T01:38:13.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:13.984+0000 7f62bfd7c640 1 --2- 172.21.15.114:0/3969042370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62b815cfb0 0x7f62b815acd0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:13.984+0000 7f62bfd7c640 1 --2- 172.21.15.114:0/3969042370 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f62b80b5e90 0x7f62b80c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:13.984+0000 7f62bfd7c640 1 --2- 172.21.15.114:0/3969042370 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f629c06ae70 0x7f629c06d330 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:13.984+0000 7f62bfd7c640 1 --2- 172.21.15.114:0/3969042370 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f62b806b770 0x7f62b80a97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:13.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:13.984+0000 7f62bfd7c640 1 -- 172.21.15.114:0/3969042370 >> 172.21.15.114:0/3969042370 conn(0x7f62b8071ca0 msgr2=0x7f62b80b8470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:13.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:13.984+0000 7f62bfd7c640 1 -- 172.21.15.114:0/3969042370 shutdown_connections 2023-11-04T01:38:13.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:13.984+0000 7f62bfd7c640 1 -- 172.21.15.114:0/3969042370 wait complete. 2023-11-04T01:38:13.999 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:38:14.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.104+0000 7fb4a88d4640 1 Processor -- start 2023-11-04T01:38:14.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.104+0000 7fb4a88d4640 1 -- start start 2023-11-04T01:38:14.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.105+0000 7fb4a88d4640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb4a40ae1d0 0x7fb4a40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.105+0000 7fb4a88d4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a415aff0 con 0x7fb4a4159c00 2023-11-04T01:38:14.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.105+0000 7fb4a88d4640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a415a3e0 con 0x7fb4a40c4ff0 2023-11-04T01:38:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.105+0000 7fb4a88d4640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a415a6c0 con 0x7fb4a40ae1d0 2023-11-04T01:38:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.105+0000 7fb4a259c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb4a4159c00 0x7fb4a40c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53830/0 (socket says 172.21.15.114:53830) 2023-11-04T01:38:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.105+0000 7fb4a259c640 1 -- 172.21.15.114:0/1570867111 learned_addr learned my addr 172.21.15.114:0/1570867111 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.105+0000 7fb4a2d9d640 1 --2- 172.21.15.114:0/1570867111 >> v2:172.21.15.141:3300/0 conn(0x7fb4a40ae1d0 0x7fb4a40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.105+0000 7fb4a159a640 1 -- 172.21.15.114:0/1570867111 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112628770 0 0) 0x7fb4a415aff0 con 0x7fb4a4159c00 2023-11-04T01:38:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.106+0000 7fb4a159a640 1 -- 172.21.15.114:0/1570867111 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb48c003520 con 0x7fb4a4159c00 2023-11-04T01:38:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.106+0000 7fb4a159a640 1 -- 172.21.15.114:0/1570867111 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258574908 0 0) 0x7fb4a415a3e0 con 0x7fb4a40c4ff0 2023-11-04T01:38:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.106+0000 7fb4a159a640 1 -- 172.21.15.114:0/1570867111 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4a415aff0 con 0x7fb4a40c4ff0 2023-11-04T01:38:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.106+0000 7fb4a159a640 1 -- 172.21.15.114:0/1570867111 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1770540293 0 0) 0x7fb48c003520 con 0x7fb4a4159c00 2023-11-04T01:38:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.106+0000 7fb4a2d9d640 1 -- 172.21.15.114:0/1570867111 >> v1:172.21.15.141:6789/0 conn(0x7fb4a40c4ff0 legacy=0x7fb4a40adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.106+0000 7fb4a2d9d640 1 -- 172.21.15.114:0/1570867111 >> v1:172.21.15.114:6789/0 conn(0x7fb4a4159c00 legacy=0x7fb4a40c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.106+0000 7fb4a2d9d640 1 -- 172.21.15.114:0/1570867111 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a415a9a0 con 0x7fb4a40ae1d0 2023-11-04T01:38:14.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.107+0000 7fb4a2d9d640 1 --2- 172.21.15.114:0/1570867111 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4a40ae1d0 0x7fb4a40cc890 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb49c0097a0 tx=0x7fb49c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ed52635fc2d1c13 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.107+0000 7fb4a159a640 1 -- 172.21.15.114:0/1570867111 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c02f050 con 0x7fb4a40ae1d0 2023-11-04T01:38:14.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.107+0000 7fb4a159a640 1 -- 172.21.15.114:0/1570867111 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c031500 con 0x7fb4a40ae1d0 2023-11-04T01:38:14.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.107+0000 7fb4a159a640 1 -- 172.21.15.114:0/1570867111 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4940019f0 con 0x7fb4a40ae1d0 2023-11-04T01:38:14.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.107+0000 7fb4a88d4640 1 -- 172.21.15.114:0/1570867111 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4a40ae1d0 msgr2=0x7fb4a40cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.107+0000 7fb4a88d4640 1 --2- 172.21.15.114:0/1570867111 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4a40ae1d0 0x7fb4a40cc890 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb49c0097a0 tx=0x7fb49c02b820 comp rx=0 tx=0).stop 2023-11-04T01:38:14.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.107+0000 7fb4a88d4640 1 -- 172.21.15.114:0/1570867111 shutdown_connections 2023-11-04T01:38:14.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.107+0000 7fb4a88d4640 1 --2- 172.21.15.114:0/1570867111 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4a40ae1d0 0x7fb4a40cc890 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.107+0000 7fb4a88d4640 1 -- 172.21.15.114:0/1570867111 >> 172.21.15.114:0/1570867111 conn(0x7fb4a40ce950 msgr2=0x7fb4a40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:14.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.107+0000 7fb4a88d4640 1 -- 172.21.15.114:0/1570867111 shutdown_connections 2023-11-04T01:38:14.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.107+0000 7fb4a88d4640 1 -- 172.21.15.114:0/1570867111 wait complete. 2023-11-04T01:38:14.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.109+0000 7fb4a88d4640 1 Processor -- start 2023-11-04T01:38:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.109+0000 7fb4a88d4640 1 -- start start 2023-11-04T01:38:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.109+0000 7fb4a88d4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4a40ae1d0 0x7fb4a413d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.109+0000 7fb4a88d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4a40c4ff0 0x7fb4a40c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.109+0000 7fb4a88d4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4a4159c00 0x7fb4a40c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.109+0000 7fb4a88d4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a414cd60 con 0x7fb4a4159c00 2023-11-04T01:38:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.109+0000 7fb4a88d4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a40c5d70 con 0x7fb4a40ae1d0 2023-11-04T01:38:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.109+0000 7fb4a88d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a414c150 con 0x7fb4a40c4ff0 2023-11-04T01:38:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb4a2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4a4159c00 0x7fb4a40c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb4a2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4a4159c00 0x7fb4a40c6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58146/0 (socket says 172.21.15.114:58146) 2023-11-04T01:38:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb4a2d9d640 1 -- 172.21.15.114:0/426610936 learned_addr learned my addr 172.21.15.114:0/426610936 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb4a259c640 1 --2- 172.21.15.114:0/426610936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4a40ae1d0 0x7fb4a413d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb4a1d9b640 1 --2- 172.21.15.114:0/426610936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4a40c4ff0 0x7fb4a40c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb4a2d9d640 1 -- 172.21.15.114:0/426610936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4a40c4ff0 msgr2=0x7fb4a40c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb4a2d9d640 1 --2- 172.21.15.114:0/426610936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4a40c4ff0 0x7fb4a40c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb4a2d9d640 1 -- 172.21.15.114:0/426610936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4a40ae1d0 msgr2=0x7fb4a413d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb4a2d9d640 1 --2- 172.21.15.114:0/426610936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4a40ae1d0 0x7fb4a413d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb4a2d9d640 1 -- 172.21.15.114:0/426610936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49c009400 con 0x7fb4a4159c00 2023-11-04T01:38:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb4a259c640 1 --2- 172.21.15.114:0/426610936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4a40ae1d0 0x7fb4a413d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb4a2d9d640 1 --2- 172.21.15.114:0/426610936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4a4159c00 0x7fb4a40c6bc0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb49c036040 tx=0x7fb49c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb492ffd640 1 -- 172.21.15.114:0/426610936 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c03d940 con 0x7fb4a4159c00 2023-11-04T01:38:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb492ffd640 1 -- 172.21.15.114:0/426610936 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c03daa0 con 0x7fb4a4159c00 2023-11-04T01:38:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb4a88d4640 1 -- 172.21.15.114:0/426610936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a414c430 con 0x7fb4a4159c00 2023-11-04T01:38:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb492ffd640 1 -- 172.21.15.114:0/426610936 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c03de10 con 0x7fb4a4159c00 2023-11-04T01:38:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.110+0000 7fb4a88d4640 1 -- 172.21.15.114:0/426610936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a414c9f0 con 0x7fb4a4159c00 2023-11-04T01:38:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.111+0000 7fb4a88d4640 1 -- 172.21.15.114:0/426610936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a414cb80 con 0x7fb4a4159c00 2023-11-04T01:38:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.112+0000 7fb492ffd640 1 -- 172.21.15.114:0/426610936 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb49c03a040 con 0x7fb4a4159c00 2023-11-04T01:38:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.112+0000 7fb492ffd640 1 --2- 172.21.15.114:0/426610936 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb48406ae70 0x7fb48406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.112+0000 7fb492ffd640 1 -- 172.21.15.114:0/426610936 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fb49c0ab0c0 con 0x7fb4a4159c00 2023-11-04T01:38:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.112+0000 7fb4a259c640 1 --2- 172.21.15.114:0/426610936 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb48406ae70 0x7fb48406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.113+0000 7fb4a259c640 1 --2- 172.21.15.114:0/426610936 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb48406ae70 0x7fb48406d330 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb4940012e0 tx=0x7fb494009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.116+0000 7fb492ffd640 1 -- 172.21.15.114:0/426610936 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb49c076380 con 0x7fb4a4159c00 2023-11-04T01:38:14.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.282+0000 7fb4a88d4640 1 -- 172.21.15.114:0/426610936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb4a4074290 con 0x7fb4a4159c00 2023-11-04T01:38:14.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.285+0000 7fb492ffd640 1 -- 172.21.15.114:0/426610936 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v13)=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb49c0799a0 con 0x7fb4a4159c00 2023-11-04T01:38:14.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.287+0000 7fb4a88d4640 1 -- 172.21.15.114:0/426610936 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb48406ae70 msgr2=0x7fb48406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.287+0000 7fb4a88d4640 1 --2- 172.21.15.114:0/426610936 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb48406ae70 0x7fb48406d330 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb4940012e0 tx=0x7fb494009040 comp rx=0 tx=0).stop 2023-11-04T01:38:14.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.287+0000 7fb4a88d4640 1 -- 172.21.15.114:0/426610936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4a4159c00 msgr2=0x7fb4a40c6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.287+0000 7fb4a88d4640 1 --2- 172.21.15.114:0/426610936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4a4159c00 0x7fb4a40c6bc0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb49c036040 tx=0x7fb49c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.287+0000 7fb4a88d4640 1 -- 172.21.15.114:0/426610936 shutdown_connections 2023-11-04T01:38:14.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.287+0000 7fb4a88d4640 1 --2- 172.21.15.114:0/426610936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4a4159c00 0x7fb4a40c6bc0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.287+0000 7fb4a88d4640 1 --2- 172.21.15.114:0/426610936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb4a40c4ff0 0x7fb4a40c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.287+0000 7fb4a88d4640 1 --2- 172.21.15.114:0/426610936 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb48406ae70 0x7fb48406d330 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.287+0000 7fb4a88d4640 1 --2- 172.21.15.114:0/426610936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb4a40ae1d0 0x7fb4a413d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.287+0000 7fb4a88d4640 1 -- 172.21.15.114:0/426610936 >> 172.21.15.114:0/426610936 conn(0x7fb4a40ce950 msgr2=0x7fb4a41588b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.287+0000 7fb4a88d4640 1 -- 172.21.15.114:0/426610936 shutdown_connections 2023-11-04T01:38:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.287+0000 7fb4a88d4640 1 -- 172.21.15.114:0/426610936 wait complete. 2023-11-04T01:38:14.300 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:38:14.300 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:14.339 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:14.380 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:38:14.380 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:38:14.380 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:14.396 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:14.396 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:38:14.396 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:14.439 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:14.440 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:38:14.440 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:14.456 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:14.457 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:38:14.457 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:14.496 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:14.496 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:38:14.497 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.594+0000 7f73bec0e640 1 Processor -- start 2023-11-04T01:38:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.594+0000 7f73bec0e640 1 -- start start 2023-11-04T01:38:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.595+0000 7f73bec0e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f73b80b0ae0 0x7f73b80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.595+0000 7f73bec0e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f73b806db20 0x7f73b815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.595+0000 7f73bec0e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b80b4110 con 0x7f73b8159c70 2023-11-04T01:38:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.595+0000 7f73bec0e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b80b49b0 con 0x7f73b806db20 2023-11-04T01:38:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.595+0000 7f73bec0e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b80b43f0 con 0x7f73b80b0ae0 2023-11-04T01:38:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.595+0000 7f73bd1ab640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f73b806db20 0x7f73b815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.595+0000 7f73bc9aa640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f73b8159c70 0x7f73b80b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53834/0 (socket says 172.21.15.114:53834) 2023-11-04T01:38:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.595+0000 7f73bc9aa640 1 -- 172.21.15.114:0/321558768 learned_addr learned my addr 172.21.15.114:0/321558768 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.595+0000 7f73bd1ab640 1 -- 172.21.15.114:0/321558768 >> v2:172.21.15.141:3300/0 conn(0x7f73b80b0ae0 msgr2=0x7f73b80ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.595+0000 7f73bd1ab640 1 --2- 172.21.15.114:0/321558768 >> v2:172.21.15.141:3300/0 conn(0x7f73b80b0ae0 0x7f73b80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.595+0000 7f73bd1ab640 1 -- 172.21.15.114:0/321558768 >> v1:172.21.15.114:6789/0 conn(0x7f73b8159c70 legacy=0x7f73b80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.595+0000 7f73b77fe640 1 -- 172.21.15.114:0/321558768 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805356969 0 0) 0x7f73b80b4110 con 0x7f73b8159c70 2023-11-04T01:38:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.595+0000 7f73bd1ab640 1 -- 172.21.15.114:0/321558768 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b80b46d0 con 0x7f73b806db20 2023-11-04T01:38:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.596+0000 7f73bd1ab640 1 --2- 172.21.15.114:0/321558768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b806db20 0x7f73b815d7d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f73b80cf800 tx=0x7f73b002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f83982ad323088 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.596+0000 7f73b77fe640 1 -- 172.21.15.114:0/321558768 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b002cc80 con 0x7f73b806db20 2023-11-04T01:38:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.596+0000 7f73b77fe640 1 -- 172.21.15.114:0/321558768 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b002cde0 con 0x7f73b806db20 2023-11-04T01:38:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.596+0000 7f73b77fe640 1 -- 172.21.15.114:0/321558768 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0034660 con 0x7f73b806db20 2023-11-04T01:38:14.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.596+0000 7f73bec0e640 1 -- 172.21.15.114:0/321558768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b806db20 msgr2=0x7f73b815d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.596+0000 7f73bec0e640 1 --2- 172.21.15.114:0/321558768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b806db20 0x7f73b815d7d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f73b80cf800 tx=0x7f73b002bed0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.597+0000 7f73bec0e640 1 -- 172.21.15.114:0/321558768 shutdown_connections 2023-11-04T01:38:14.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.597+0000 7f73bec0e640 1 --2- 172.21.15.114:0/321558768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b806db20 0x7f73b815d7d0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.597+0000 7f73bec0e640 1 --2- 172.21.15.114:0/321558768 >> v2:172.21.15.141:3300/0 conn(0x7f73b80b0ae0 0x7f73b80ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.597+0000 7f73bec0e640 1 -- 172.21.15.114:0/321558768 >> 172.21.15.114:0/321558768 conn(0x7f73b80ce950 msgr2=0x7f73b80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:14.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.597+0000 7f73bec0e640 1 -- 172.21.15.114:0/321558768 shutdown_connections 2023-11-04T01:38:14.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.597+0000 7f73bec0e640 1 -- 172.21.15.114:0/321558768 wait complete. 2023-11-04T01:38:14.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.598+0000 7f73bec0e640 1 Processor -- start 2023-11-04T01:38:14.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.598+0000 7f73bec0e640 1 -- start start 2023-11-04T01:38:14.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.598+0000 7f73bec0e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f73b806db20 0x7f73b815c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.598+0000 7f73bec0e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73b80b0ae0 0x7f73b80c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73bec0e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b8159c70 0x7f73b8152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73bec0e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b81f0dc0 con 0x7f73b8159c70 2023-11-04T01:38:14.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73bec0e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b80c6c10 con 0x7f73b806db20 2023-11-04T01:38:14.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73bec0e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b80c6370 con 0x7f73b80b0ae0 2023-11-04T01:38:14.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73bd1ab640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b8159c70 0x7f73b8152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73bd1ab640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b8159c70 0x7f73b8152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58166/0 (socket says 172.21.15.114:58166) 2023-11-04T01:38:14.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73bd1ab640 1 -- 172.21.15.114:0/2502243896 learned_addr learned my addr 172.21.15.114:0/2502243896 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:14.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73bc9aa640 1 --2- 172.21.15.114:0/2502243896 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f73b806db20 0x7f73b815c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73b7fff640 1 --2- 172.21.15.114:0/2502243896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73b80b0ae0 0x7f73b80c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73bd1ab640 1 -- 172.21.15.114:0/2502243896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73b80b0ae0 msgr2=0x7f73b80c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73bd1ab640 1 --2- 172.21.15.114:0/2502243896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73b80b0ae0 0x7f73b80c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73bd1ab640 1 -- 172.21.15.114:0/2502243896 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f73b806db20 msgr2=0x7f73b815c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73bd1ab640 1 --2- 172.21.15.114:0/2502243896 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f73b806db20 0x7f73b815c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73bd1ab640 1 -- 172.21.15.114:0/2502243896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b0009a70 con 0x7f73b8159c70 2023-11-04T01:38:14.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73b7fff640 1 --2- 172.21.15.114:0/2502243896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73b80b0ae0 0x7f73b80c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:14.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73bd1ab640 1 --2- 172.21.15.114:0/2502243896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b8159c70 0x7f73b8152de0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f73b0037040 tx=0x7f73b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73b57fa640 1 -- 172.21.15.114:0/2502243896 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0040650 con 0x7f73b8159c70 2023-11-04T01:38:14.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73b57fa640 1 -- 172.21.15.114:0/2502243896 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b00407b0 con 0x7f73b8159c70 2023-11-04T01:38:14.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73bec0e640 1 -- 172.21.15.114:0/2502243896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b80c6650 con 0x7f73b8159c70 2023-11-04T01:38:14.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73b57fa640 1 -- 172.21.15.114:0/2502243896 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0040b60 con 0x7f73b8159c70 2023-11-04T01:38:14.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.599+0000 7f73bec0e640 1 -- 172.21.15.114:0/2502243896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b815cc10 con 0x7f73b8159c70 2023-11-04T01:38:14.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.600+0000 7f73bec0e640 1 -- 172.21.15.114:0/2502243896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b81f0b90 con 0x7f73b8159c70 2023-11-04T01:38:14.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.601+0000 7f73b57fa640 1 -- 172.21.15.114:0/2502243896 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f73b0040cc0 con 0x7f73b8159c70 2023-11-04T01:38:14.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.601+0000 7f73b57fa640 1 --2- 172.21.15.114:0/2502243896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f739c06ae70 0x7f739c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.601+0000 7f73b57fa640 1 -- 172.21.15.114:0/2502243896 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f73b00ac450 con 0x7f73b8159c70 2023-11-04T01:38:14.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.601+0000 7f73bc9aa640 1 --2- 172.21.15.114:0/2502243896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f739c06ae70 0x7f739c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.601+0000 7f73bc9aa640 1 --2- 172.21.15.114:0/2502243896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f739c06ae70 0x7f739c06d330 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f73ac000f60 tx=0x7f73ac007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.605+0000 7f73b57fa640 1 -- 172.21.15.114:0/2502243896 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f73b81f0b90 con 0x7f73b8159c70 2023-11-04T01:38:14.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.808+0000 7f73bec0e640 1 -- 172.21.15.114:0/2502243896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73b81f0b90 con 0x7f73b8159c70 2023-11-04T01:38:14.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.809+0000 7f73b57fa640 1 -- 172.21.15.114:0/2502243896 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f73b0044e90 con 0x7f73b8159c70 2023-11-04T01:38:14.810 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:14.811 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5015,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291570175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291570175},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291570175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5218,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/3821610653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":3821610653},{"type":"v1","addr":"172.21.15.141:6834","nonce":3821610653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2452742541","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2452742541},{"type":"v1","addr":"172.21.15.114:6835","nonce":2452742541}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3407147888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":3407147888},{"type":"v1","addr":"172.21.15.114:6837","nonce":3407147888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-11-04T01:38:14.811 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2023-11-04T01:38:14.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.810+0000 7f73bec0e640 1 -- 172.21.15.114:0/2502243896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f739c06ae70 msgr2=0x7f739c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.810+0000 7f73bec0e640 1 --2- 172.21.15.114:0/2502243896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f739c06ae70 0x7f739c06d330 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f73ac000f60 tx=0x7f73ac007c00 comp rx=0 tx=0).stop 2023-11-04T01:38:14.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.810+0000 7f73bec0e640 1 -- 172.21.15.114:0/2502243896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b8159c70 msgr2=0x7f73b8152de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.810+0000 7f73bec0e640 1 --2- 172.21.15.114:0/2502243896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b8159c70 0x7f73b8152de0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f73b0037040 tx=0x7f73b0004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:14.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.811+0000 7f73bec0e640 1 -- 172.21.15.114:0/2502243896 shutdown_connections 2023-11-04T01:38:14.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.811+0000 7f73bec0e640 1 --2- 172.21.15.114:0/2502243896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73b8159c70 0x7f73b8152de0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.811+0000 7f73bec0e640 1 --2- 172.21.15.114:0/2502243896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73b80b0ae0 0x7f73b80c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.811+0000 7f73bec0e640 1 --2- 172.21.15.114:0/2502243896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f739c06ae70 0x7f739c06d330 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.811+0000 7f73bec0e640 1 --2- 172.21.15.114:0/2502243896 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f73b806db20 0x7f73b815c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.811+0000 7f73bec0e640 1 -- 172.21.15.114:0/2502243896 >> 172.21.15.114:0/2502243896 conn(0x7f73b80ce950 msgr2=0x7f73b80b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:14.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.811+0000 7f73bec0e640 1 -- 172.21.15.114:0/2502243896 shutdown_connections 2023-11-04T01:38:14.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.811+0000 7f73bec0e640 1 -- 172.21.15.114:0/2502243896 wait complete. 2023-11-04T01:38:14.823 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:38:14.823 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:38:14.824 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:38:14.824 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:14.824 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:38:14.824 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:38:14.824 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:38:14.824 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:14.825 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:38:14.825 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:38:14.825 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:38:14.825 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:14.825 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:38:14.825 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:38:14.825 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:38:14.826 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:14.834 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:38:14.834 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:38:14.835 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:38:14.835 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:38:14.840 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:38:14.841 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:38:14.841 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:38:14.842 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:38:14.877 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:38:14.877 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:14.878 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:38:14.878 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:14.883 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:38:14.883 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:14.884 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:38:14.884 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:14.884 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:38:14.952 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2023-11-04T01:38:14.952 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2023-11-04T01:38:14.968 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-04T01:38:14.968 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-04T01:38:14.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.986+0000 7f0360178640 1 Processor -- start 2023-11-04T01:38:14.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.987+0000 7f0360178640 1 -- start start 2023-11-04T01:38:14.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.987+0000 7f0360178640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f03580cd6d0 0x7f0358161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.987+0000 7f0360178640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f03580b4880 0x7f03580b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.987+0000 7f0360178640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03580cde60 con 0x7f0358153e60 2023-11-04T01:38:14.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.987+0000 7f0360178640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0358160f90 con 0x7f03580b4880 2023-11-04T01:38:14.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.987+0000 7f0360178640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0358161960 con 0x7f03580cd6d0 2023-11-04T01:38:14.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.988+0000 7f035e715640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f03580b4880 0x7f03580b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.988+0000 7f035e715640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f03580b4880 0x7f03580b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58190/0 (socket says 172.21.15.114:58190) 2023-11-04T01:38:14.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.988+0000 7f035e715640 1 -- 172.21.15.114:0/972654048 learned_addr learned my addr 172.21.15.114:0/972654048 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:14.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.988+0000 7f035d713640 1 --2- 172.21.15.114:0/972654048 >> v2:172.21.15.141:3300/0 conn(0x7f03580cd6d0 0x7f0358161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.988+0000 7f035e715640 1 -- 172.21.15.114:0/972654048 >> v2:172.21.15.141:3300/0 conn(0x7f03580cd6d0 msgr2=0x7f0358161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:14.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.988+0000 7f035e715640 1 --2- 172.21.15.114:0/972654048 >> v2:172.21.15.141:3300/0 conn(0x7f03580cd6d0 0x7f0358161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.988+0000 7f035e715640 1 -- 172.21.15.114:0/972654048 >> v1:172.21.15.141:6789/0 conn(0x7f0358153e60 legacy=0x7f035815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.988+0000 7f035e715640 1 -- 172.21.15.114:0/972654048 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03580b5220 con 0x7f03580b4880 2023-11-04T01:38:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.989+0000 7f035e715640 1 --2- 172.21.15.114:0/972654048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03580b4880 0x7f03580b4ce0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f03580c9e80 tx=0x7f035002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ddb17019e1bc164 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.989+0000 7f035cf12640 1 -- 172.21.15.114:0/972654048 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035002cb20 con 0x7f03580b4880 2023-11-04T01:38:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.989+0000 7f035cf12640 1 -- 172.21.15.114:0/972654048 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035002cc80 con 0x7f03580b4880 2023-11-04T01:38:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.989+0000 7f035cf12640 1 -- 172.21.15.114:0/972654048 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03500343f0 con 0x7f03580b4880 2023-11-04T01:38:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.989+0000 7f0360178640 1 -- 172.21.15.114:0/972654048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03580b4880 msgr2=0x7f03580b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.989+0000 7f0360178640 1 --2- 172.21.15.114:0/972654048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03580b4880 0x7f03580b4ce0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f03580c9e80 tx=0x7f035002bf80 comp rx=0 tx=0).stop 2023-11-04T01:38:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.990+0000 7f0360178640 1 -- 172.21.15.114:0/972654048 shutdown_connections 2023-11-04T01:38:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.990+0000 7f0360178640 1 --2- 172.21.15.114:0/972654048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03580b4880 0x7f03580b4ce0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.990+0000 7f0360178640 1 --2- 172.21.15.114:0/972654048 >> v2:172.21.15.141:3300/0 conn(0x7f03580cd6d0 0x7f0358161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.990+0000 7f0360178640 1 -- 172.21.15.114:0/972654048 >> 172.21.15.114:0/972654048 conn(0x7f03580cf880 msgr2=0x7f03580cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:14.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.990+0000 7f0360178640 1 -- 172.21.15.114:0/972654048 shutdown_connections 2023-11-04T01:38:14.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.990+0000 7f0360178640 1 -- 172.21.15.114:0/972654048 wait complete. 2023-11-04T01:38:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.991+0000 7f0360178640 1 Processor -- start 2023-11-04T01:38:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.991+0000 7f0360178640 1 -- start start 2023-11-04T01:38:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.991+0000 7f0360178640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03580b4880 0x7f0358152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f0360178640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03580cd6d0 0x7f03581f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f0360178640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0358153e60 0x7f03581f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f0360178640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03580cb0a0 con 0x7f0358153e60 2023-11-04T01:38:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f0360178640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03580ca490 con 0x7f03580b4880 2023-11-04T01:38:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f0360178640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03580ca770 con 0x7f03580cd6d0 2023-11-04T01:38:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f035e715640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0358153e60 0x7f03581f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f035e715640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0358153e60 0x7f03581f5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58196/0 (socket says 172.21.15.114:58196) 2023-11-04T01:38:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f035e715640 1 -- 172.21.15.114:0/2825698285 learned_addr learned my addr 172.21.15.114:0/2825698285 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f035df14640 1 --2- 172.21.15.114:0/2825698285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03580b4880 0x7f0358152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f035d713640 1 --2- 172.21.15.114:0/2825698285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03580cd6d0 0x7f03581f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f035e715640 1 -- 172.21.15.114:0/2825698285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03580cd6d0 msgr2=0x7f03581f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f035e715640 1 --2- 172.21.15.114:0/2825698285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03580cd6d0 0x7f03581f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f035e715640 1 -- 172.21.15.114:0/2825698285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03580b4880 msgr2=0x7f0358152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f035e715640 1 --2- 172.21.15.114:0/2825698285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03580b4880 0x7f0358152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f035e715640 1 -- 172.21.15.114:0/2825698285 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0350009b30 con 0x7f0358153e60 2023-11-04T01:38:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f035e715640 1 --2- 172.21.15.114:0/2825698285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0358153e60 0x7f03581f5e60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0350036040 tx=0x7f0350004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.992+0000 7f034e7fc640 1 -- 172.21.15.114:0/2825698285 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035002c920 con 0x7f0358153e60 2023-11-04T01:38:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.993+0000 7f034e7fc640 1 -- 172.21.15.114:0/2825698285 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035002ca80 con 0x7f0358153e60 2023-11-04T01:38:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.993+0000 7f0360178640 1 -- 172.21.15.114:0/2825698285 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03580caa50 con 0x7f0358153e60 2023-11-04T01:38:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.993+0000 7f034e7fc640 1 -- 172.21.15.114:0/2825698285 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035003e690 con 0x7f0358153e60 2023-11-04T01:38:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.993+0000 7f0360178640 1 -- 172.21.15.114:0/2825698285 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03580cb530 con 0x7f0358153e60 2023-11-04T01:38:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.994+0000 7f0360178640 1 -- 172.21.15.114:0/2825698285 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03580cb250 con 0x7f0358153e60 2023-11-04T01:38:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.997+0000 7f034e7fc640 1 -- 172.21.15.114:0/2825698285 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f035003e7f0 con 0x7f0358153e60 2023-11-04T01:38:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.997+0000 7f034e7fc640 1 --2- 172.21.15.114:0/2825698285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f033c06aea0 0x7f033c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.997+0000 7f034e7fc640 1 -- 172.21.15.114:0/2825698285 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f03500ac100 con 0x7f0358153e60 2023-11-04T01:38:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.997+0000 7f035df14640 1 --2- 172.21.15.114:0/2825698285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f033c06aea0 0x7f033c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:14.998+0000 7f035df14640 1 --2- 172.21.15.114:0/2825698285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f033c06aea0 0x7f033c06d360 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f03540016e0 tx=0x7f0354009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:15.001+0000 7f034e7fc640 1 -- 172.21.15.114:0/2825698285 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0350077350 con 0x7f0358153e60 2023-11-04T01:38:15.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:15.184+0000 7f0360178640 1 -- 172.21.15.114:0/2825698285 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0358074290 con 0x7f0358153e60 2023-11-04T01:38:16.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.004+0000 7f034e7fc640 1 -- 172.21.15.114:0/2825698285 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v50) v1 ==== 97+0+0 (secure 0 0 0) 0x7f035007a970 con 0x7f0358153e60 2023-11-04T01:38:16.006 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2023-11-04T01:38:16.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.007+0000 7f0360178640 1 -- 172.21.15.114:0/2825698285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f033c06aea0 msgr2=0x7f033c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.007+0000 7f0360178640 1 --2- 172.21.15.114:0/2825698285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f033c06aea0 0x7f033c06d360 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f03540016e0 tx=0x7f0354009040 comp rx=0 tx=0).stop 2023-11-04T01:38:16.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.007+0000 7f0360178640 1 -- 172.21.15.114:0/2825698285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0358153e60 msgr2=0x7f03581f5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.007+0000 7f0360178640 1 --2- 172.21.15.114:0/2825698285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0358153e60 0x7f03581f5e60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0350036040 tx=0x7f0350004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:16.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.008+0000 7f0360178640 1 -- 172.21.15.114:0/2825698285 shutdown_connections 2023-11-04T01:38:16.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.008+0000 7f0360178640 1 --2- 172.21.15.114:0/2825698285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0358153e60 0x7f03581f5e60 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.008+0000 7f0360178640 1 --2- 172.21.15.114:0/2825698285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03580cd6d0 0x7f03581f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.008+0000 7f0360178640 1 --2- 172.21.15.114:0/2825698285 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f033c06aea0 0x7f033c06d360 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.008+0000 7f0360178640 1 --2- 172.21.15.114:0/2825698285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03580b4880 0x7f0358152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.008+0000 7f0360178640 1 -- 172.21.15.114:0/2825698285 >> 172.21.15.114:0/2825698285 conn(0x7f03580cf880 msgr2=0x7f035815c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.008+0000 7f0360178640 1 -- 172.21.15.114:0/2825698285 shutdown_connections 2023-11-04T01:38:16.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.008+0000 7f0360178640 1 -- 172.21.15.114:0/2825698285 wait complete. 2023-11-04T01:38:16.024 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:38:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.127+0000 7f204e44b640 1 Processor -- start 2023-11-04T01:38:16.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.127+0000 7f204e44b640 1 -- start start 2023-11-04T01:38:16.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.128+0000 7f204e44b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2048159c70 0x7f20480ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.128+0000 7f204e44b640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f204806db20 0x7f20480b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.128+0000 7f204e44b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20480b4110 con 0x7f20480b0910 2023-11-04T01:38:16.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.128+0000 7f204e44b640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20480b49b0 con 0x7f204806db20 2023-11-04T01:38:16.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.128+0000 7f204e44b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20480b0da0 con 0x7f2048159c70 2023-11-04T01:38:16.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.128+0000 7f204c9e8640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f20480b0910 0x7f204815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53854/0 (socket says 172.21.15.114:53854) 2023-11-04T01:38:16.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.128+0000 7f204c9e8640 1 -- 172.21.15.114:0/2870644732 learned_addr learned my addr 172.21.15.114:0/2870644732 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:16.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.128+0000 7f20477fe640 1 --2- 172.21.15.114:0/2870644732 >> v2:172.21.15.141:3300/0 conn(0x7f204806db20 0x7f20480b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.128+0000 7f2047fff640 1 --2- 172.21.15.114:0/2870644732 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2048159c70 0x7f20480ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.129+0000 7f2046ffd640 1 -- 172.21.15.114:0/2870644732 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205811519 0 0) 0x7f20480b4110 con 0x7f20480b0910 2023-11-04T01:38:16.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.129+0000 7f2046ffd640 1 -- 172.21.15.114:0/2870644732 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2030003520 con 0x7f20480b0910 2023-11-04T01:38:16.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.129+0000 7f20477fe640 1 -- 172.21.15.114:0/2870644732 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2048159c70 msgr2=0x7f20480ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.129+0000 7f20477fe640 1 --2- 172.21.15.114:0/2870644732 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2048159c70 0x7f20480ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.129+0000 7f20477fe640 1 -- 172.21.15.114:0/2870644732 >> v1:172.21.15.114:6789/0 conn(0x7f20480b0910 legacy=0x7f204815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.129+0000 7f20477fe640 1 -- 172.21.15.114:0/2870644732 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20480b43f0 con 0x7f204806db20 2023-11-04T01:38:16.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.129+0000 7f2047fff640 1 --2- 172.21.15.114:0/2870644732 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2048159c70 0x7f20480ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:16.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.130+0000 7f20477fe640 1 --2- 172.21.15.114:0/2870644732 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f204806db20 0x7f20480b03d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f203c0097a0 tx=0x7f203c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fd09e75936567d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.130+0000 7f2046ffd640 1 -- 172.21.15.114:0/2870644732 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c031830 con 0x7f204806db20 2023-11-04T01:38:16.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.130+0000 7f2046ffd640 1 -- 172.21.15.114:0/2870644732 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c031990 con 0x7f204806db20 2023-11-04T01:38:16.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.130+0000 7f2046ffd640 1 -- 172.21.15.114:0/2870644732 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c031d20 con 0x7f204806db20 2023-11-04T01:38:16.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.130+0000 7f204e44b640 1 -- 172.21.15.114:0/2870644732 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f204806db20 msgr2=0x7f20480b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.130+0000 7f204e44b640 1 --2- 172.21.15.114:0/2870644732 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f204806db20 0x7f20480b03d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f203c0097a0 tx=0x7f203c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.130+0000 7f204e44b640 1 -- 172.21.15.114:0/2870644732 shutdown_connections 2023-11-04T01:38:16.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.130+0000 7f204e44b640 1 --2- 172.21.15.114:0/2870644732 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f204806db20 0x7f20480b03d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.130+0000 7f204e44b640 1 --2- 172.21.15.114:0/2870644732 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2048159c70 0x7f20480ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.130+0000 7f204e44b640 1 -- 172.21.15.114:0/2870644732 >> 172.21.15.114:0/2870644732 conn(0x7f20480ce950 msgr2=0x7f20480ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.130+0000 7f204e44b640 1 -- 172.21.15.114:0/2870644732 shutdown_connections 2023-11-04T01:38:16.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.130+0000 7f204e44b640 1 -- 172.21.15.114:0/2870644732 wait complete. 2023-11-04T01:38:16.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.132+0000 7f204e44b640 1 Processor -- start 2023-11-04T01:38:16.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.132+0000 7f204e44b640 1 -- start start 2023-11-04T01:38:16.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.132+0000 7f204e44b640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f204806db20 0x7f2048147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.132+0000 7f204e44b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20480b0910 0x7f2048148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f204e44b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2048159c70 0x7f20480c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f204e44b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2048149c70 con 0x7f20480b0910 2023-11-04T01:38:16.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f204e44b640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2048148250 con 0x7f204806db20 2023-11-04T01:38:16.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f204e44b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2048148ff0 con 0x7f2048159c70 2023-11-04T01:38:16.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f20477fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20480b0910 0x7f2048148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f20477fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20480b0910 0x7f2048148550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58204/0 (socket says 172.21.15.114:58204) 2023-11-04T01:38:16.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f20477fe640 1 -- 172.21.15.114:0/2146210488 learned_addr learned my addr 172.21.15.114:0/2146210488 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f204c9e8640 1 --2- 172.21.15.114:0/2146210488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2048159c70 0x7f20480c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f2047fff640 1 --2- 172.21.15.114:0/2146210488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f204806db20 0x7f2048147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f20477fe640 1 -- 172.21.15.114:0/2146210488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2048159c70 msgr2=0x7f20480c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f20477fe640 1 --2- 172.21.15.114:0/2146210488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2048159c70 0x7f20480c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f20477fe640 1 -- 172.21.15.114:0/2146210488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f204806db20 msgr2=0x7f2048147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f20477fe640 1 --2- 172.21.15.114:0/2146210488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f204806db20 0x7f2048147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f20477fe640 1 -- 172.21.15.114:0/2146210488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038009400 con 0x7f20480b0910 2023-11-04T01:38:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f204c9e8640 1 --2- 172.21.15.114:0/2146210488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2048159c70 0x7f20480c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f2047fff640 1 --2- 172.21.15.114:0/2146210488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f204806db20 0x7f2048147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f20477fe640 1 --2- 172.21.15.114:0/2146210488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20480b0910 0x7f2048148550 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f203c034040 tx=0x7f203c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f2044ff9640 1 -- 172.21.15.114:0/2146210488 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c03a830 con 0x7f20480b0910 2023-11-04T01:38:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f2044ff9640 1 -- 172.21.15.114:0/2146210488 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c03a9b0 con 0x7f20480b0910 2023-11-04T01:38:16.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f204e44b640 1 -- 172.21.15.114:0/2146210488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203c009400 con 0x7f20480b0910 2023-11-04T01:38:16.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f2044ff9640 1 -- 172.21.15.114:0/2146210488 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c03ad60 con 0x7f20480b0910 2023-11-04T01:38:16.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.133+0000 7f204e44b640 1 -- 172.21.15.114:0/2146210488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20481495b0 con 0x7f20480b0910 2023-11-04T01:38:16.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.134+0000 7f204e44b640 1 -- 172.21.15.114:0/2146210488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2048149db0 con 0x7f20480b0910 2023-11-04T01:38:16.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.135+0000 7f2044ff9640 1 -- 172.21.15.114:0/2146210488 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f203c04d440 con 0x7f20480b0910 2023-11-04T01:38:16.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.135+0000 7f2044ff9640 1 --2- 172.21.15.114:0/2146210488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f203406ae70 0x7f203406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.135+0000 7f2044ff9640 1 -- 172.21.15.114:0/2146210488 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f203c0ab660 con 0x7f20480b0910 2023-11-04T01:38:16.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.135+0000 7f2047fff640 1 --2- 172.21.15.114:0/2146210488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f203406ae70 0x7f203406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.136+0000 7f2047fff640 1 --2- 172.21.15.114:0/2146210488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f203406ae70 0x7f203406d330 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f20480c8720 tx=0x7f2038008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.140+0000 7f2044ff9640 1 -- 172.21.15.114:0/2146210488 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2048149db0 con 0x7f20480b0910 2023-11-04T01:38:16.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.370+0000 7f204e44b640 1 -- 172.21.15.114:0/2146210488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2048149db0 con 0x7f20480b0910 2023-11-04T01:38:16.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.370+0000 7f2044ff9640 1 -- 172.21.15.114:0/2146210488 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2048149db0 con 0x7f20480b0910 2023-11-04T01:38:16.373 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:16.373 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:38:16.373 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2023-11-04T01:38:16.373 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.373 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2023-11-04T01:38:16.373 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0VlswblMRAAotQqAxFKxonbXL/aDdoEPw==", 2023-11-04T01:38:16.373 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.373 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:38:16.373 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:38:16.373 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:38:16.373 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:16.374 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.374 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.374 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.374 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2023-11-04T01:38:16.374 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VluZGwAhAAZPVNOe2pR5yFwajeNFbXzw==", 2023-11-04T01:38:16.374 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.374 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:38:16.374 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:38:16.374 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:38:16.374 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:16.374 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.374 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.375 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.375 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2023-11-04T01:38:16.375 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0VlUsc9ORAAmZhkDVK2hR4wbky+cLfo+A==", 2023-11-04T01:38:16.375 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.375 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:38:16.375 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:38:16.375 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:38:16.375 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:16.375 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.375 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.375 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.375 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2023-11-04T01:38:16.375 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VlfxP9CRAAQppp4Lmc1v2xMGYc/AD7pA==", 2023-11-04T01:38:16.376 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.376 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:38:16.376 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:38:16.376 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:38:16.376 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:16.376 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.376 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.376 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.376 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2023-11-04T01:38:16.376 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDdn0Vl/xmgMBAANQCw5RUd/IlxHaDvCz2Gbg==", 2023-11-04T01:38:16.376 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.376 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:16.376 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:38:16.377 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:16.377 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.377 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.377 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.377 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2023-11-04T01:38:16.377 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDgn0VlTpuDLxAAf5vdQMiWBcLfx0Vf8Petyg==", 2023-11-04T01:38:16.377 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.377 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:16.377 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:38:16.377 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:16.377 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.377 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.377 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.378 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2023-11-04T01:38:16.378 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDjn0VlZonFLRAAHJMf/0DasOCeOrz4u8uV2w==", 2023-11-04T01:38:16.378 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.378 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:16.378 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:38:16.378 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:16.378 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.378 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.378 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.378 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2023-11-04T01:38:16.378 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDmn0VlLKK7KxAAKJzogyZTtMzEtAL+LL1V0w==", 2023-11-04T01:38:16.378 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.379 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:16.379 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:38:16.379 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:16.379 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.379 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.379 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.379 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2023-11-04T01:38:16.379 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDsn0VlLitpMhAA6ow9uVmS5YtOnqSWSB66ww==", 2023-11-04T01:38:16.379 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.379 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:16.379 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:38:16.379 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:16.379 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.380 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.380 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.380 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2023-11-04T01:38:16.380 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDvn0VlfkL/MBAA/LYWJLF7F12XMEICf18BwA==", 2023-11-04T01:38:16.380 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.380 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:16.380 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:38:16.380 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:16.380 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.380 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.380 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.380 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2023-11-04T01:38:16.381 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDyn0Vl8ZrhLxAAKDbE5KvbWhguLsNNi+3duA==", 2023-11-04T01:38:16.381 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.381 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:16.381 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:38:16.381 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:16.381 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.381 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.381 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.381 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2023-11-04T01:38:16.381 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD1n0Vlues1LhAARQs1LLq8y63wl8nAs8GbGQ==", 2023-11-04T01:38:16.381 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.381 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:16.381 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:38:16.382 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:16.382 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.382 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.382 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.382 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2023-11-04T01:38:16.382 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0Vl3QHODhAA6LWlhd+avWYsoYsWMbOiVA==", 2023-11-04T01:38:16.382 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.382 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:38:16.382 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2023-11-04T01:38:16.382 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:38:16.382 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.382 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.382 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.383 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2023-11-04T01:38:16.383 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VlRvgLGBAAAAhF9alG2eD5A/xjWXcVWA==", 2023-11-04T01:38:16.383 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.383 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:38:16.383 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-11-04T01:38:16.383 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-11-04T01:38:16.383 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-11-04T01:38:16.383 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.383 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.383 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.383 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2023-11-04T01:38:16.383 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VlgV6sFBAAxheFKb52kyZly4byr78vfw==", 2023-11-04T01:38:16.383 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.384 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:38:16.384 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-11-04T01:38:16.384 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-11-04T01:38:16.384 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-11-04T01:38:16.384 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.384 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.384 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.384 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2023-11-04T01:38:16.384 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VltiLUHRAAY0QtK328vB9H/l8FWCNB4g==", 2023-11-04T01:38:16.384 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.384 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:38:16.384 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-11-04T01:38:16.384 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-11-04T01:38:16.385 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-11-04T01:38:16.385 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.385 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.385 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.385 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2023-11-04T01:38:16.385 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0Vl3O6UFBAAZpdiB/7sBN6IpvNpe/LoIA==", 2023-11-04T01:38:16.385 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.385 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-11-04T01:38:16.385 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:38:16.385 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:38:16.385 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:16.385 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.385 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.386 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.386 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2023-11-04T01:38:16.386 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0Vlb1WELhAAcUQ6WxKBsUeJfXvaE+h0GQ==", 2023-11-04T01:38:16.386 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.386 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-11-04T01:38:16.386 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2023-11-04T01:38:16.386 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:16.386 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.386 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:16.386 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:16.386 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2023-11-04T01:38:16.386 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0VluGn6KRAAHsThhoAbKIz+kqF2DYyvkg==", 2023-11-04T01:38:16.386 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:16.387 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-11-04T01:38:16.387 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2023-11-04T01:38:16.387 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:16.387 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.387 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:16.387 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-11-04T01:38:16.387 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:38:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.372+0000 7f204e44b640 1 -- 172.21.15.114:0/2146210488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f203406ae70 msgr2=0x7f203406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.372+0000 7f204e44b640 1 --2- 172.21.15.114:0/2146210488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f203406ae70 0x7f203406d330 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f20480c8720 tx=0x7f2038008040 comp rx=0 tx=0).stop 2023-11-04T01:38:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.372+0000 7f204e44b640 1 -- 172.21.15.114:0/2146210488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20480b0910 msgr2=0x7f2048148550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.372+0000 7f204e44b640 1 --2- 172.21.15.114:0/2146210488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20480b0910 0x7f2048148550 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f203c034040 tx=0x7f203c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.372+0000 7f204e44b640 1 -- 172.21.15.114:0/2146210488 shutdown_connections 2023-11-04T01:38:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.372+0000 7f204e44b640 1 --2- 172.21.15.114:0/2146210488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2048159c70 0x7f20480c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.373+0000 7f204e44b640 1 --2- 172.21.15.114:0/2146210488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20480b0910 0x7f2048148550 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.373+0000 7f204e44b640 1 --2- 172.21.15.114:0/2146210488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f203406ae70 0x7f203406d330 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.373+0000 7f204e44b640 1 --2- 172.21.15.114:0/2146210488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f204806db20 0x7f2048147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.373+0000 7f204e44b640 1 -- 172.21.15.114:0/2146210488 >> 172.21.15.114:0/2146210488 conn(0x7f20480ce950 msgr2=0x7f20480ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.373+0000 7f204e44b640 1 -- 172.21.15.114:0/2146210488 shutdown_connections 2023-11-04T01:38:16.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.373+0000 7f204e44b640 1 -- 172.21.15.114:0/2146210488 wait complete. 2023-11-04T01:38:16.390 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:16.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.487+0000 7f92780d4640 1 Processor -- start 2023-11-04T01:38:16.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.487+0000 7f92780d4640 1 -- start start 2023-11-04T01:38:16.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.488+0000 7f92780d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92700b0ae0 0x7f92700ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.488+0000 7f92780d4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f927006db20 0x7f927015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.488+0000 7f92780d4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92700b4110 con 0x7f9270159c70 2023-11-04T01:38:16.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.488+0000 7f92780d4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92700b49b0 con 0x7f927006db20 2023-11-04T01:38:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.488+0000 7f92780d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92700b43f0 con 0x7f92700b0ae0 2023-11-04T01:38:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.488+0000 7f9276671640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f927006db20 0x7f927015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.488+0000 7f9275e70640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9270159c70 0x7f92700b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58426/0 (socket says 172.21.15.114:58426) 2023-11-04T01:38:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.488+0000 7f9275e70640 1 -- 172.21.15.114:0/2572740170 learned_addr learned my addr 172.21.15.114:0/2572740170 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.488+0000 7f9276671640 1 -- 172.21.15.114:0/2572740170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92700b0ae0 msgr2=0x7f92700ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.488+0000 7f9276671640 1 --2- 172.21.15.114:0/2572740170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92700b0ae0 0x7f92700ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.488+0000 7f9276671640 1 -- 172.21.15.114:0/2572740170 >> v1:172.21.15.114:6789/0 conn(0x7f9270159c70 legacy=0x7f92700b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.488+0000 7f9276671640 1 -- 172.21.15.114:0/2572740170 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92700b46d0 con 0x7f927006db20 2023-11-04T01:38:16.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.489+0000 7f9276671640 1 --2- 172.21.15.114:0/2572740170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f927006db20 0x7f927015d7d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9268009d90 tx=0x7f926802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0e9cfa6a90600d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.489+0000 7f9274e6e640 1 -- 172.21.15.114:0/2572740170 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926802cc50 con 0x7f927006db20 2023-11-04T01:38:16.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.489+0000 7f9274e6e640 1 -- 172.21.15.114:0/2572740170 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926802cdb0 con 0x7f927006db20 2023-11-04T01:38:16.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.489+0000 7f9274e6e640 1 -- 172.21.15.114:0/2572740170 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268034660 con 0x7f927006db20 2023-11-04T01:38:16.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.490+0000 7f92780d4640 1 -- 172.21.15.114:0/2572740170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f927006db20 msgr2=0x7f927015d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.490+0000 7f92780d4640 1 --2- 172.21.15.114:0/2572740170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f927006db20 0x7f927015d7d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9268009d90 tx=0x7f926802bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.490+0000 7f92780d4640 1 -- 172.21.15.114:0/2572740170 shutdown_connections 2023-11-04T01:38:16.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.490+0000 7f92780d4640 1 --2- 172.21.15.114:0/2572740170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f927006db20 0x7f927015d7d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.490+0000 7f92780d4640 1 --2- 172.21.15.114:0/2572740170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92700b0ae0 0x7f92700ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.490+0000 7f92780d4640 1 -- 172.21.15.114:0/2572740170 >> 172.21.15.114:0/2572740170 conn(0x7f92700ce950 msgr2=0x7f92700ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.490+0000 7f92780d4640 1 -- 172.21.15.114:0/2572740170 shutdown_connections 2023-11-04T01:38:16.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.490+0000 7f92780d4640 1 -- 172.21.15.114:0/2572740170 wait complete. 2023-11-04T01:38:16.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.491+0000 7f92780d4640 1 Processor -- start 2023-11-04T01:38:16.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.491+0000 7f92780d4640 1 -- start start 2023-11-04T01:38:16.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.491+0000 7f92780d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f927006db20 0x7f927014d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f92780d4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92700b0ae0 0x7f9270150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f92780d4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9270159c70 0x7f927014d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f92780d4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927014d630 con 0x7f9270159c70 2023-11-04T01:38:16.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f92780d4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927014ff50 con 0x7f92700b0ae0 2023-11-04T01:38:16.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f92780d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9270150230 con 0x7f927006db20 2023-11-04T01:38:16.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f9276671640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9270159c70 0x7f927014d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f9276671640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9270159c70 0x7f927014d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59624/0 (socket says 172.21.15.114:59624) 2023-11-04T01:38:16.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f9276671640 1 -- 172.21.15.114:0/20810608 learned_addr learned my addr 172.21.15.114:0/20810608 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:16.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f9275e70640 1 --2- 172.21.15.114:0/20810608 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f927006db20 0x7f927014d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f927566f640 1 --2- 172.21.15.114:0/20810608 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92700b0ae0 0x7f9270150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f9276671640 1 -- 172.21.15.114:0/20810608 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f927006db20 msgr2=0x7f927014d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f9276671640 1 --2- 172.21.15.114:0/20810608 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f927006db20 0x7f927014d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f9276671640 1 -- 172.21.15.114:0/20810608 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92700b0ae0 msgr2=0x7f9270150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f9276671640 1 --2- 172.21.15.114:0/20810608 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92700b0ae0 0x7f9270150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f9276671640 1 -- 172.21.15.114:0/20810608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9268009a70 con 0x7f9270159c70 2023-11-04T01:38:16.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f9276671640 1 --2- 172.21.15.114:0/20810608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9270159c70 0x7f927014d7f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9268009d90 tx=0x7f9268004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f92667fc640 1 -- 172.21.15.114:0/20810608 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926803e610 con 0x7f9270159c70 2023-11-04T01:38:16.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f92667fc640 1 -- 172.21.15.114:0/20810608 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926803e790 con 0x7f9270159c70 2023-11-04T01:38:16.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f92780d4640 1 -- 172.21.15.114:0/20810608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9270150510 con 0x7f9270159c70 2023-11-04T01:38:16.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f92667fc640 1 -- 172.21.15.114:0/20810608 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926803eb40 con 0x7f9270159c70 2023-11-04T01:38:16.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.492+0000 7f92780d4640 1 -- 172.21.15.114:0/20810608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9270150ad0 con 0x7f9270159c70 2023-11-04T01:38:16.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.493+0000 7f92780d4640 1 -- 172.21.15.114:0/20810608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9270150cc0 con 0x7f9270159c70 2023-11-04T01:38:16.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.494+0000 7f92667fc640 1 -- 172.21.15.114:0/20810608 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f926803b050 con 0x7f9270159c70 2023-11-04T01:38:16.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.494+0000 7f92667fc640 1 --2- 172.21.15.114:0/20810608 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f925406aea0 0x7f925406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.494+0000 7f9275e70640 1 --2- 172.21.15.114:0/20810608 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f925406aea0 0x7f925406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.494+0000 7f92667fc640 1 -- 172.21.15.114:0/20810608 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f92680aba40 con 0x7f9270159c70 2023-11-04T01:38:16.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.495+0000 7f9275e70640 1 --2- 172.21.15.114:0/20810608 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f925406aea0 0x7f925406d360 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f926c005880 tx=0x7f926c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.499+0000 7f92667fc640 1 -- 172.21.15.114:0/20810608 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f92680ade60 con 0x7f9270159c70 2023-11-04T01:38:16.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.668+0000 7f92780d4640 1 -- 172.21.15.114:0/20810608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9270074290 con 0x7f9270159c70 2023-11-04T01:38:16.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.669+0000 7f92667fc640 1 -- 172.21.15.114:0/20810608 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+14875 (secure 0 0 0) 0x7f9268076ba0 con 0x7f9270159c70 2023-11-04T01:38:16.671 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:16.671 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":50,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:16.002317+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.671+0000 7f92780d4640 1 -- 172.21.15.114:0/20810608 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f925406aea0 msgr2=0x7f925406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.671+0000 7f92780d4640 1 --2- 172.21.15.114:0/20810608 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f925406aea0 0x7f925406d360 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f926c005880 tx=0x7f926c009040 comp rx=0 tx=0).stop 2023-11-04T01:38:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.671+0000 7f92780d4640 1 -- 172.21.15.114:0/20810608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9270159c70 msgr2=0x7f927014d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.671+0000 7f92780d4640 1 --2- 172.21.15.114:0/20810608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9270159c70 0x7f927014d7f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9268009d90 tx=0x7f9268004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.671+0000 7f92780d4640 1 -- 172.21.15.114:0/20810608 shutdown_connections 2023-11-04T01:38:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.671+0000 7f92780d4640 1 --2- 172.21.15.114:0/20810608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9270159c70 0x7f927014d7f0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.671+0000 7f92780d4640 1 --2- 172.21.15.114:0/20810608 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f925406aea0 0x7f925406d360 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.671+0000 7f92780d4640 1 --2- 172.21.15.114:0/20810608 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92700b0ae0 0x7f9270150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.671+0000 7f92780d4640 1 --2- 172.21.15.114:0/20810608 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f927006db20 0x7f927014d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.671+0000 7f92780d4640 1 -- 172.21.15.114:0/20810608 >> 172.21.15.114:0/20810608 conn(0x7f92700ce950 msgr2=0x7f92700b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.671+0000 7f92780d4640 1 -- 172.21.15.114:0/20810608 shutdown_connections 2023-11-04T01:38:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.671+0000 7f92780d4640 1 -- 172.21.15.114:0/20810608 wait complete. 2023-11-04T01:38:16.684 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:16.684 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:16.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.786+0000 7fafb5f55640 1 Processor -- start 2023-11-04T01:38:16.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.786+0000 7fafb5f55640 1 -- start start 2023-11-04T01:38:16.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.787+0000 7fafb5f55640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafb015e430 0x7fafb00cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.787+0000 7fafb5f55640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb00d0280 con 0x7fafb00cf160 2023-11-04T01:38:16.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.787+0000 7fafb5f55640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb00cf670 con 0x7fafb00d0710 2023-11-04T01:38:16.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.787+0000 7fafb5f55640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00cf950 con 0x7fafb015e430 2023-11-04T01:38:16.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.787+0000 7fafaeffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fafb00cf160 0x7fafb00cd510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58428/0 (socket says 172.21.15.114:58428) 2023-11-04T01:38:16.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.787+0000 7fafaeffd640 1 -- 172.21.15.114:0/3848790767 learned_addr learned my addr 172.21.15.114:0/3848790767 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:16.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.787+0000 7fafae7fc640 1 -- 172.21.15.114:0/3848790767 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420932220 0 0) 0x7fafb00d0280 con 0x7fafb00cf160 2023-11-04T01:38:16.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafae7fc640 1 -- 172.21.15.114:0/3848790767 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf98003520 con 0x7fafb00cf160 2023-11-04T01:38:16.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafaf7fe640 1 --2- 172.21.15.114:0/3848790767 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafb015e430 0x7fafb00cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafae7fc640 1 -- 172.21.15.114:0/3848790767 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4035383059 0 0) 0x7faf98003520 con 0x7fafb00cf160 2023-11-04T01:38:16.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafae7fc640 1 -- 172.21.15.114:0/3848790767 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafb015e430 msgr2=0x7fafb00cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafae7fc640 1 --2- 172.21.15.114:0/3848790767 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafb015e430 0x7fafb00cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafae7fc640 1 -- 172.21.15.114:0/3848790767 >> v1:172.21.15.141:6789/0 conn(0x7fafb00d0710 legacy=0x7fafb00b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafae7fc640 1 -- 172.21.15.114:0/3848790767 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb00cfc30 con 0x7fafb00cf160 2023-11-04T01:38:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafae7fc640 1 -- 172.21.15.114:0/3848790767 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fafa4001670 con 0x7fafb00cf160 2023-11-04T01:38:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafae7fc640 1 -- 172.21.15.114:0/3848790767 >> v1:172.21.15.114:6789/0 conn(0x7fafb00cf160 legacy=0x7fafb00cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafae7fc640 1 --2- 172.21.15.114:0/3848790767 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafb015e430 0x7faf980039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafae7fc640 1 --2- 172.21.15.114:0/3848790767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf98003f20 0x7faf980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafae7fc640 1 --2- 172.21.15.114:0/3848790767 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf98004d00 0x7faf98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafae7fc640 1 -- 172.21.15.114:0/3848790767 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00cf950 con 0x7faf98003f20 2023-11-04T01:38:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafae7fc640 1 -- 172.21.15.114:0/3848790767 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9800ba60 con 0x7faf98004d00 2023-11-04T01:38:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafae7fc640 1 -- 172.21.15.114:0/3848790767 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9800bc20 con 0x7fafb015e430 2023-11-04T01:38:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafaeffd640 1 --2- 172.21.15.114:0/3848790767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf98003f20 0x7faf980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafaf7fe640 1 --2- 172.21.15.114:0/3848790767 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafb015e430 0x7faf980039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafaffff640 1 --2- 172.21.15.114:0/3848790767 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf98004d00 0x7faf98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafaeffd640 1 -- 172.21.15.114:0/3848790767 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafb015e430 msgr2=0x7faf980039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafaeffd640 1 --2- 172.21.15.114:0/3848790767 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fafb015e430 0x7faf980039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafaeffd640 1 -- 172.21.15.114:0/3848790767 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf98004d00 msgr2=0x7faf98005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:16.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafaeffd640 1 --2- 172.21.15.114:0/3848790767 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf98004d00 0x7faf98005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafaeffd640 1 -- 172.21.15.114:0/3848790767 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf98003520 con 0x7faf98003f20 2023-11-04T01:38:16.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.788+0000 7fafaffff640 1 --2- 172.21.15.114:0/3848790767 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faf98004d00 0x7faf98005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:16.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.789+0000 7fafaeffd640 1 --2- 172.21.15.114:0/3848790767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf98003f20 0x7faf980047c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fafa4001050 tx=0x7faf980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a91c2aea4ef009 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.789+0000 7fafae7fc640 1 -- 172.21.15.114:0/3848790767 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4005ad0 con 0x7faf98003f20 2023-11-04T01:38:16.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.789+0000 7fafae7fc640 1 -- 172.21.15.114:0/3848790767 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa4005c30 con 0x7faf98003f20 2023-11-04T01:38:16.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.789+0000 7fafae7fc640 1 -- 172.21.15.114:0/3848790767 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa402ca90 con 0x7faf98003f20 2023-11-04T01:38:16.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.790+0000 7fafb5f55640 1 -- 172.21.15.114:0/3848790767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf98003f20 msgr2=0x7faf980047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.790+0000 7fafb5f55640 1 --2- 172.21.15.114:0/3848790767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf98003f20 0x7faf980047c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fafa4001050 tx=0x7faf980057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.790+0000 7fafaffff640 1 -- 172.21.15.114:0/3848790767 reap_dead start 2023-11-04T01:38:16.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.790+0000 7fafb5f55640 1 -- 172.21.15.114:0/3848790767 shutdown_connections 2023-11-04T01:38:16.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.790+0000 7fafb5f55640 1 -- 172.21.15.114:0/3848790767 >> 172.21.15.114:0/3848790767 conn(0x7fafb006ea20 msgr2=0x7fafb006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.790+0000 7fafb5f55640 1 -- 172.21.15.114:0/3848790767 shutdown_connections 2023-11-04T01:38:16.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.790+0000 7fafb5f55640 1 -- 172.21.15.114:0/3848790767 wait complete. 2023-11-04T01:38:16.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.791+0000 7fafb5f55640 1 Processor -- start 2023-11-04T01:38:16.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.791+0000 7fafb5f55640 1 -- start start 2023-11-04T01:38:16.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafb5f55640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faf98003f20 0x7fafb01533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafb5f55640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fafb01f03d0 0x7fafb00c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafb5f55640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb0159700 0x7fafb00c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafb5f55640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb0153930 con 0x7fafb0159700 2023-11-04T01:38:16.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafb5f55640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00c8f80 con 0x7fafb01f03d0 2023-11-04T01:38:16.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafb5f55640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00c9260 con 0x7faf98003f20 2023-11-04T01:38:16.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafaffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb0159700 0x7fafb00c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafaffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb0159700 0x7fafb00c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59642/0 (socket says 172.21.15.114:59642) 2023-11-04T01:38:16.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafaffff640 1 -- 172.21.15.114:0/1251302663 learned_addr learned my addr 172.21.15.114:0/1251302663 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:16.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafaeffd640 1 --2- 172.21.15.114:0/1251302663 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fafb01f03d0 0x7fafb00c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafaf7fe640 1 --2- 172.21.15.114:0/1251302663 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faf98003f20 0x7fafb01533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafaffff640 1 -- 172.21.15.114:0/1251302663 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faf98003f20 msgr2=0x7fafb01533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafaffff640 1 --2- 172.21.15.114:0/1251302663 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faf98003f20 0x7fafb01533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafaffff640 1 -- 172.21.15.114:0/1251302663 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fafb01f03d0 msgr2=0x7fafb00c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafaffff640 1 --2- 172.21.15.114:0/1251302663 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fafb01f03d0 0x7fafb00c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafaffff640 1 -- 172.21.15.114:0/1251302663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb00b0500 con 0x7fafb0159700 2023-11-04T01:38:16.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafaffff640 1 --2- 172.21.15.114:0/1251302663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb0159700 0x7fafb00c9f80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fafa8000f80 tx=0x7fafa800ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7faf97fff640 1 -- 172.21.15.114:0/1251302663 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa8017070 con 0x7fafb0159700 2023-11-04T01:38:16.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7faf97fff640 1 -- 172.21.15.114:0/1251302663 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa8003b80 con 0x7fafb0159700 2023-11-04T01:38:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7fafb5f55640 1 -- 172.21.15.114:0/1251302663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb00b07e0 con 0x7fafb0159700 2023-11-04T01:38:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.792+0000 7faf97fff640 1 -- 172.21.15.114:0/1251302663 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa8003d30 con 0x7fafb0159700 2023-11-04T01:38:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.793+0000 7fafb5f55640 1 -- 172.21.15.114:0/1251302663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb00c8bc0 con 0x7fafb0159700 2023-11-04T01:38:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.793+0000 7fafb5f55640 1 -- 172.21.15.114:0/1251302663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb00c8d50 con 0x7fafb0159700 2023-11-04T01:38:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.794+0000 7faf97fff640 1 -- 172.21.15.114:0/1251302663 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fafa80050d0 con 0x7fafb0159700 2023-11-04T01:38:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.794+0000 7faf97fff640 1 --2- 172.21.15.114:0/1251302663 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faf9c06ae70 0x7faf9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.794+0000 7faf97fff640 1 -- 172.21.15.114:0/1251302663 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fafa8088980 con 0x7fafb0159700 2023-11-04T01:38:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.794+0000 7fafaf7fe640 1 --2- 172.21.15.114:0/1251302663 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faf9c06ae70 0x7faf9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.795+0000 7fafaf7fe640 1 --2- 172.21.15.114:0/1251302663 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faf9c06ae70 0x7faf9c06d330 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009bc0 tx=0x7fafa0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.798+0000 7faf97fff640 1 -- 172.21.15.114:0/1251302663 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fafa8053ae0 con 0x7fafb0159700 2023-11-04T01:38:16.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.963+0000 7fafb5f55640 1 -- 172.21.15.114:0/1251302663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fafb00b0d00 con 0x7fafb0159700 2023-11-04T01:38:16.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.964+0000 7faf97fff640 1 -- 172.21.15.114:0/1251302663 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7fafb00b0d00 con 0x7fafb0159700 2023-11-04T01:38:16.966 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:38:16.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.965+0000 7fafb5f55640 1 -- 172.21.15.114:0/1251302663 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faf9c06ae70 msgr2=0x7faf9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.965+0000 7fafb5f55640 1 --2- 172.21.15.114:0/1251302663 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faf9c06ae70 0x7faf9c06d330 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009bc0 tx=0x7fafa0009190 comp rx=0 tx=0).stop 2023-11-04T01:38:16.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.965+0000 7fafb5f55640 1 -- 172.21.15.114:0/1251302663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb0159700 msgr2=0x7fafb00c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:16.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.965+0000 7fafb5f55640 1 --2- 172.21.15.114:0/1251302663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb0159700 0x7fafb00c9f80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fafa8000f80 tx=0x7fafa800ead0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.965+0000 7fafb5f55640 1 -- 172.21.15.114:0/1251302663 shutdown_connections 2023-11-04T01:38:16.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.965+0000 7fafb5f55640 1 --2- 172.21.15.114:0/1251302663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb0159700 0x7fafb00c9f80 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.965+0000 7fafb5f55640 1 --2- 172.21.15.114:0/1251302663 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faf9c06ae70 0x7faf9c06d330 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.965+0000 7fafb5f55640 1 --2- 172.21.15.114:0/1251302663 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fafb01f03d0 0x7fafb00c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.965+0000 7fafb5f55640 1 --2- 172.21.15.114:0/1251302663 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faf98003f20 0x7fafb01533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:16.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.965+0000 7fafb5f55640 1 -- 172.21.15.114:0/1251302663 >> 172.21.15.114:0/1251302663 conn(0x7fafb006ea20 msgr2=0x7fafb00b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:16.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.966+0000 7fafb5f55640 1 -- 172.21.15.114:0/1251302663 shutdown_connections 2023-11-04T01:38:16.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:16.966+0000 7fafb5f55640 1 -- 172.21.15.114:0/1251302663 wait complete. 2023-11-04T01:38:16.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:17.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.078+0000 7f7289b25640 1 Processor -- start 2023-11-04T01:38:17.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.078+0000 7f7289b25640 1 -- start start 2023-11-04T01:38:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.079+0000 7f7289b25640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72840cd6d0 0x7f7284161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.079+0000 7f7289b25640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72840cde60 con 0x7f72840b4880 2023-11-04T01:38:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.079+0000 7f7289b25640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7284160f90 con 0x7f7284153e60 2023-11-04T01:38:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.079+0000 7f7289b25640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7284161960 con 0x7f72840cd6d0 2023-11-04T01:38:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.079+0000 7f7283fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f72840b4880 0x7f72840b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58444/0 (socket says 172.21.15.114:58444) 2023-11-04T01:38:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.079+0000 7f7283fff640 1 -- 172.21.15.114:0/2652337310 learned_addr learned my addr 172.21.15.114:0/2652337310 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.080+0000 7f7282ffd640 1 --2- 172.21.15.114:0/2652337310 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72840cd6d0 0x7f7284161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.080+0000 7f72827fc640 1 -- 172.21.15.114:0/2652337310 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804517628 0 0) 0x7f72840cde60 con 0x7f72840b4880 2023-11-04T01:38:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.080+0000 7f72827fc640 1 -- 172.21.15.114:0/2652337310 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f726c003520 con 0x7f72840b4880 2023-11-04T01:38:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.080+0000 7f7282ffd640 1 -- 172.21.15.114:0/2652337310 >> v1:172.21.15.141:6789/0 conn(0x7f7284153e60 legacy=0x7f728415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.080+0000 7f72827fc640 1 -- 172.21.15.114:0/2652337310 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2171927006 0 0) 0x7f726c003520 con 0x7f72840b4880 2023-11-04T01:38:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.080+0000 7f7282ffd640 1 -- 172.21.15.114:0/2652337310 >> v1:172.21.15.114:6789/0 conn(0x7f72840b4880 legacy=0x7f72840b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.080+0000 7f7282ffd640 1 -- 172.21.15.114:0/2652337310 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72840ce090 con 0x7f72840cd6d0 2023-11-04T01:38:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.081+0000 7f7282ffd640 1 --2- 172.21.15.114:0/2652337310 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72840cd6d0 0x7f7284161420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7278009750 tx=0x7f727802b5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4103024f554334c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.081+0000 7f72827fc640 1 -- 172.21.15.114:0/2652337310 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c001670 con 0x7f72840cd6d0 2023-11-04T01:38:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.081+0000 7f72827fc640 1 -- 172.21.15.114:0/2652337310 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727802e050 con 0x7f72840cd6d0 2023-11-04T01:38:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.081+0000 7f72827fc640 1 -- 172.21.15.114:0/2652337310 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278030710 con 0x7f72840cd6d0 2023-11-04T01:38:17.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.081+0000 7f7289b25640 1 -- 172.21.15.114:0/2652337310 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72840cd6d0 msgr2=0x7f7284161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.081+0000 7f7289b25640 1 --2- 172.21.15.114:0/2652337310 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72840cd6d0 0x7f7284161420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7278009750 tx=0x7f727802b5e0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.081+0000 7f7289b25640 1 -- 172.21.15.114:0/2652337310 shutdown_connections 2023-11-04T01:38:17.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.081+0000 7f7289b25640 1 --2- 172.21.15.114:0/2652337310 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72840cd6d0 0x7f7284161420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.081+0000 7f7289b25640 1 -- 172.21.15.114:0/2652337310 >> 172.21.15.114:0/2652337310 conn(0x7f72840cf880 msgr2=0x7f72840cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:17.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.081+0000 7f7289b25640 1 -- 172.21.15.114:0/2652337310 shutdown_connections 2023-11-04T01:38:17.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.081+0000 7f7289b25640 1 -- 172.21.15.114:0/2652337310 wait complete. 2023-11-04T01:38:17.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.083+0000 7f7289b25640 1 Processor -- start 2023-11-04T01:38:17.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.083+0000 7f7289b25640 1 -- start start 2023-11-04T01:38:17.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.083+0000 7f7289b25640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72840b4880 0x7f72841527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.083+0000 7f7289b25640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72840cd6d0 0x7f72840cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.083+0000 7f7289b25640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7284153e60 0x7f72840cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.083+0000 7f7289b25640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72841f34a0 con 0x7f72840cd6d0 2023-11-04T01:38:17.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.083+0000 7f7289b25640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72840ca000 con 0x7f7284153e60 2023-11-04T01:38:17.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.083+0000 7f7289b25640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72840ca2e0 con 0x7f72840b4880 2023-11-04T01:38:17.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.084+0000 7f7282ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72840cd6d0 0x7f72840cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.084+0000 7f7282ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72840cd6d0 0x7f72840cadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59646/0 (socket says 172.21.15.114:59646) 2023-11-04T01:38:17.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.084+0000 7f7282ffd640 1 -- 172.21.15.114:0/292926453 learned_addr learned my addr 172.21.15.114:0/292926453 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:17.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.084+0000 7f72837fe640 1 --2- 172.21.15.114:0/292926453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72840b4880 0x7f72841527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.084+0000 7f7283fff640 1 --2- 172.21.15.114:0/292926453 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7284153e60 0x7f72840cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.084+0000 7f7282ffd640 1 -- 172.21.15.114:0/292926453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72840b4880 msgr2=0x7f72841527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.084+0000 7f7282ffd640 1 --2- 172.21.15.114:0/292926453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72840b4880 0x7f72841527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.084+0000 7f7282ffd640 1 -- 172.21.15.114:0/292926453 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7284153e60 msgr2=0x7f72840cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.084+0000 7f7282ffd640 1 --2- 172.21.15.114:0/292926453 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7284153e60 0x7f72840cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.084+0000 7f7282ffd640 1 -- 172.21.15.114:0/292926453 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7278009400 con 0x7f72840cd6d0 2023-11-04T01:38:17.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.084+0000 7f7282ffd640 1 --2- 172.21.15.114:0/292926453 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72840cd6d0 0x7f72840cadc0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7278009870 tx=0x7f72780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:17.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.084+0000 7f726bfff640 1 -- 172.21.15.114:0/292926453 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278006e10 con 0x7f72840cd6d0 2023-11-04T01:38:17.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.084+0000 7f726bfff640 1 -- 172.21.15.114:0/292926453 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72780044c0 con 0x7f72840cd6d0 2023-11-04T01:38:17.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.084+0000 7f7289b25640 1 -- 172.21.15.114:0/292926453 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72840ca5c0 con 0x7f72840cd6d0 2023-11-04T01:38:17.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.084+0000 7f726bfff640 1 -- 172.21.15.114:0/292926453 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278030710 con 0x7f72840cd6d0 2023-11-04T01:38:17.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.084+0000 7f7289b25640 1 -- 172.21.15.114:0/292926453 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72840c8a90 con 0x7f72840cd6d0 2023-11-04T01:38:17.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.085+0000 7f7289b25640 1 -- 172.21.15.114:0/292926453 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72840caae0 con 0x7f72840cd6d0 2023-11-04T01:38:17.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.086+0000 7f726bfff640 1 -- 172.21.15.114:0/292926453 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7278030870 con 0x7f72840cd6d0 2023-11-04T01:38:17.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.086+0000 7f726bfff640 1 --2- 172.21.15.114:0/292926453 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f727006ae70 0x7f727006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.086+0000 7f726bfff640 1 -- 172.21.15.114:0/292926453 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f72780ab170 con 0x7f72840cd6d0 2023-11-04T01:38:17.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.086+0000 7f72837fe640 1 --2- 172.21.15.114:0/292926453 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f727006ae70 0x7f727006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.086+0000 7f72837fe640 1 --2- 172.21.15.114:0/292926453 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f727006ae70 0x7f727006d330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f72740012e0 tx=0x7f7274009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:17.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.090+0000 7f726bfff640 1 -- 172.21.15.114:0/292926453 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f72840caae0 con 0x7f72840cd6d0 2023-11-04T01:38:17.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.256+0000 7f7289b25640 1 -- 172.21.15.114:0/292926453 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f72840caae0 con 0x7f72840cd6d0 2023-11-04T01:38:17.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.256+0000 7f726bfff640 1 -- 172.21.15.114:0/292926453 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v50) v1 ==== 103+0+11 (secure 0 0 0) 0x7f72840caae0 con 0x7f72840cd6d0 2023-11-04T01:38:17.258 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:38:17.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.258+0000 7f7289b25640 1 -- 172.21.15.114:0/292926453 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f727006ae70 msgr2=0x7f727006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.258+0000 7f7289b25640 1 --2- 172.21.15.114:0/292926453 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f727006ae70 0x7f727006d330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f72740012e0 tx=0x7f7274009040 comp rx=0 tx=0).stop 2023-11-04T01:38:17.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.258+0000 7f7289b25640 1 -- 172.21.15.114:0/292926453 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72840cd6d0 msgr2=0x7f72840cadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.258+0000 7f7289b25640 1 --2- 172.21.15.114:0/292926453 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72840cd6d0 0x7f72840cadc0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7278009870 tx=0x7f72780046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.258+0000 7f7289b25640 1 -- 172.21.15.114:0/292926453 shutdown_connections 2023-11-04T01:38:17.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.258+0000 7f7289b25640 1 --2- 172.21.15.114:0/292926453 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f727006ae70 0x7f727006d330 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.258+0000 7f7289b25640 1 --2- 172.21.15.114:0/292926453 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7284153e60 0x7f72840cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.258+0000 7f7289b25640 1 --2- 172.21.15.114:0/292926453 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72840cd6d0 0x7f72840cadc0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.258+0000 7f7289b25640 1 --2- 172.21.15.114:0/292926453 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f72840b4880 0x7f72841527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.258+0000 7f7289b25640 1 -- 172.21.15.114:0/292926453 >> 172.21.15.114:0/292926453 conn(0x7f72840cf880 msgr2=0x7f728415fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:17.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.258+0000 7f7289b25640 1 -- 172.21.15.114:0/292926453 shutdown_connections 2023-11-04T01:38:17.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.258+0000 7f7289b25640 1 -- 172.21.15.114:0/292926453 wait complete. 2023-11-04T01:38:17.271 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:38:17.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.368+0000 7f77fc226640 1 Processor -- start 2023-11-04T01:38:17.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.368+0000 7f77fc226640 1 -- start start 2023-11-04T01:38:17.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.369+0000 7f77fc226640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f77f4159c70 0x7f77f40ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.369+0000 7f77fc226640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77f40b0ae0 0x7f77f415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.369+0000 7f77fc226640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f40b4110 con 0x7f77f406db20 2023-11-04T01:38:17.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.369+0000 7f77fc226640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f40b49b0 con 0x7f77f4159c70 2023-11-04T01:38:17.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.369+0000 7f77fc226640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40b43f0 con 0x7f77f40b0ae0 2023-11-04T01:38:17.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.369+0000 7f77f9fc2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f77f4159c70 0x7f77f40ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.369+0000 7f77f9fc2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f77f4159c70 0x7f77f40ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59648/0 (socket says 172.21.15.114:59648) 2023-11-04T01:38:17.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.369+0000 7f77f97c1640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f77f406db20 0x7f77f40b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58454/0 (socket says 172.21.15.114:58454) 2023-11-04T01:38:17.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.369+0000 7f77f9fc2640 1 -- 172.21.15.114:0/3476405383 learned_addr learned my addr 172.21.15.114:0/3476405383 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:17.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.369+0000 7f77fa7c3640 1 --2- 172.21.15.114:0/3476405383 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77f40b0ae0 0x7f77f415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.369+0000 7f77f9fc2640 1 -- 172.21.15.114:0/3476405383 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77f40b0ae0 msgr2=0x7f77f415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:17.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.369+0000 7f77f9fc2640 1 --2- 172.21.15.114:0/3476405383 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77f40b0ae0 0x7f77f415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.369+0000 7f77f9fc2640 1 -- 172.21.15.114:0/3476405383 >> v1:172.21.15.114:6789/0 conn(0x7f77f406db20 legacy=0x7f77f40b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.369+0000 7f77f9fc2640 1 -- 172.21.15.114:0/3476405383 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f40b46d0 con 0x7f77f4159c70 2023-11-04T01:38:17.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.369+0000 7f77f8fc0640 1 -- 172.21.15.114:0/3476405383 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177275792 0 0) 0x7f77f40b4110 con 0x7f77f406db20 2023-11-04T01:38:17.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.370+0000 7f77f9fc2640 1 --2- 172.21.15.114:0/3476405383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77f4159c70 0x7f77f40ce370 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009870 tx=0x7f77f002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a384af00a9ea8c90 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:17.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.370+0000 7f77f8fc0640 1 -- 172.21.15.114:0/3476405383 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0030840 con 0x7f77f4159c70 2023-11-04T01:38:17.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.370+0000 7f77f8fc0640 1 -- 172.21.15.114:0/3476405383 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f00309a0 con 0x7f77f4159c70 2023-11-04T01:38:17.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.370+0000 7f77f8fc0640 1 -- 172.21.15.114:0/3476405383 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0030d30 con 0x7f77f4159c70 2023-11-04T01:38:17.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.370+0000 7f77fc226640 1 -- 172.21.15.114:0/3476405383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77f4159c70 msgr2=0x7f77f40ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.370+0000 7f77fc226640 1 --2- 172.21.15.114:0/3476405383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77f4159c70 0x7f77f40ce370 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009870 tx=0x7f77f002b980 comp rx=0 tx=0).stop 2023-11-04T01:38:17.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.370+0000 7f77fc226640 1 -- 172.21.15.114:0/3476405383 shutdown_connections 2023-11-04T01:38:17.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.370+0000 7f77fc226640 1 --2- 172.21.15.114:0/3476405383 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77f40b0ae0 0x7f77f415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.371+0000 7f77fc226640 1 --2- 172.21.15.114:0/3476405383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77f4159c70 0x7f77f40ce370 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.371+0000 7f77fc226640 1 -- 172.21.15.114:0/3476405383 >> 172.21.15.114:0/3476405383 conn(0x7f77f40ce950 msgr2=0x7f77f40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:17.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.371+0000 7f77fc226640 1 -- 172.21.15.114:0/3476405383 shutdown_connections 2023-11-04T01:38:17.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.371+0000 7f77fc226640 1 -- 172.21.15.114:0/3476405383 wait complete. 2023-11-04T01:38:17.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.372+0000 7f77fc226640 1 Processor -- start 2023-11-04T01:38:17.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.372+0000 7f77fc226640 1 -- start start 2023-11-04T01:38:17.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.372+0000 7f77fc226640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77f406db20 0x7f77f40c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.372+0000 7f77fc226640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77f40b0ae0 0x7f77f40c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.372+0000 7f77fc226640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77f4159c70 0x7f77f40c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.372+0000 7f77fc226640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40c7660 con 0x7f77f4159c70 2023-11-04T01:38:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.372+0000 7f77fc226640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40c69e0 con 0x7f77f406db20 2023-11-04T01:38:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.372+0000 7f77fc226640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40c6cc0 con 0x7f77f40b0ae0 2023-11-04T01:38:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.373+0000 7f77fa7c3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77f4159c70 0x7f77f40c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.373+0000 7f77fa7c3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77f4159c70 0x7f77f40c4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59650/0 (socket says 172.21.15.114:59650) 2023-11-04T01:38:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.373+0000 7f77fa7c3640 1 -- 172.21.15.114:0/3177935642 learned_addr learned my addr 172.21.15.114:0/3177935642 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.373+0000 7f77f97c1640 1 --2- 172.21.15.114:0/3177935642 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77f40b0ae0 0x7f77f40c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.373+0000 7f77f9fc2640 1 --2- 172.21.15.114:0/3177935642 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77f406db20 0x7f77f40c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.373+0000 7f77fa7c3640 1 -- 172.21.15.114:0/3177935642 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77f40b0ae0 msgr2=0x7f77f40c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.373+0000 7f77fa7c3640 1 --2- 172.21.15.114:0/3177935642 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77f40b0ae0 0x7f77f40c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.373+0000 7f77fa7c3640 1 -- 172.21.15.114:0/3177935642 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77f406db20 msgr2=0x7f77f40c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.373+0000 7f77fa7c3640 1 --2- 172.21.15.114:0/3177935642 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77f406db20 0x7f77f40c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.373+0000 7f77fa7c3640 1 -- 172.21.15.114:0/3177935642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f00094d0 con 0x7f77f4159c70 2023-11-04T01:38:17.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.373+0000 7f77fa7c3640 1 --2- 172.21.15.114:0/3177935642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77f4159c70 0x7f77f40c4e60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f77ec007e40 tx=0x7f77ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:17.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.373+0000 7f77ea7fc640 1 -- 172.21.15.114:0/3177935642 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec014620 con 0x7f77f4159c70 2023-11-04T01:38:17.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.373+0000 7f77ea7fc640 1 -- 172.21.15.114:0/3177935642 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec00ee90 con 0x7f77f4159c70 2023-11-04T01:38:17.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.373+0000 7f77fc226640 1 -- 172.21.15.114:0/3177935642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f40c6fa0 con 0x7f77f4159c70 2023-11-04T01:38:17.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.373+0000 7f77ea7fc640 1 -- 172.21.15.114:0/3177935642 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec0149e0 con 0x7f77f4159c70 2023-11-04T01:38:17.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.373+0000 7f77fc226640 1 -- 172.21.15.114:0/3177935642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f4155b90 con 0x7f77f4159c70 2023-11-04T01:38:17.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.374+0000 7f77fc226640 1 -- 172.21.15.114:0/3177935642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f40c77a0 con 0x7f77f4159c70 2023-11-04T01:38:17.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.374+0000 7f77ea7fc640 1 -- 172.21.15.114:0/3177935642 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f77ec014b40 con 0x7f77f4159c70 2023-11-04T01:38:17.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.375+0000 7f77ea7fc640 1 --2- 172.21.15.114:0/3177935642 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f77d806ae70 0x7f77d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.375+0000 7f77ea7fc640 1 -- 172.21.15.114:0/3177935642 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f77ec089e80 con 0x7f77f4159c70 2023-11-04T01:38:17.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.375+0000 7f77f9fc2640 1 --2- 172.21.15.114:0/3177935642 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f77d806ae70 0x7f77d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.375+0000 7f77f9fc2640 1 --2- 172.21.15.114:0/3177935642 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f77d806ae70 0x7f77d806d330 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f77f0036000 tx=0x7f77f0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:17.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.379+0000 7f77ea7fc640 1 -- 172.21.15.114:0/3177935642 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f77f40c77a0 con 0x7f77f4159c70 2023-11-04T01:38:17.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.546+0000 7f77fc226640 1 -- 172.21.15.114:0/3177935642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f77f40c77a0 con 0x7f77f4159c70 2023-11-04T01:38:17.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.547+0000 7f77ea7fc640 1 -- 172.21.15.114:0/3177935642 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+137 (secure 0 0 0) 0x7f77f40c77a0 con 0x7f77f4159c70 2023-11-04T01:38:17.549 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:17.549 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2023-11-04T01:38:17.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:17.549 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2023-11-04T01:38:17.549 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2023-11-04T01:38:17.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:17.549 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:17.549 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 7, 2023-11-04T01:38:17.549 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "snap-test-pool" 2023-11-04T01:38:17.549 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:17.549 INFO:teuthology.orchestra.run.smithi114.stdout:] 2023-11-04T01:38:17.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.548+0000 7f77fc226640 1 -- 172.21.15.114:0/3177935642 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f77d806ae70 msgr2=0x7f77d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.548+0000 7f77fc226640 1 --2- 172.21.15.114:0/3177935642 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f77d806ae70 0x7f77d806d330 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f77f0036000 tx=0x7f77f0008030 comp rx=0 tx=0).stop 2023-11-04T01:38:17.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.548+0000 7f77fc226640 1 -- 172.21.15.114:0/3177935642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77f4159c70 msgr2=0x7f77f40c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.548+0000 7f77fc226640 1 --2- 172.21.15.114:0/3177935642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77f4159c70 0x7f77f40c4e60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f77ec007e40 tx=0x7f77ec00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.548+0000 7f77fc226640 1 -- 172.21.15.114:0/3177935642 shutdown_connections 2023-11-04T01:38:17.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.548+0000 7f77fc226640 1 --2- 172.21.15.114:0/3177935642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77f4159c70 0x7f77f40c4e60 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.548+0000 7f77fc226640 1 --2- 172.21.15.114:0/3177935642 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f77f40b0ae0 0x7f77f40c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.548+0000 7f77fc226640 1 --2- 172.21.15.114:0/3177935642 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f77d806ae70 0x7f77d806d330 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.549+0000 7f77fc226640 1 --2- 172.21.15.114:0/3177935642 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f77f406db20 0x7f77f40c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.549+0000 7f77fc226640 1 -- 172.21.15.114:0/3177935642 >> 172.21.15.114:0/3177935642 conn(0x7f77f40ce950 msgr2=0x7f77f40caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:17.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.549+0000 7f77fc226640 1 -- 172.21.15.114:0/3177935642 shutdown_connections 2023-11-04T01:38:17.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.549+0000 7f77fc226640 1 -- 172.21.15.114:0/3177935642 wait complete. 2023-11-04T01:38:17.561 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:38:17.561 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:38:17.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.662+0000 7fe56077c640 1 Processor -- start 2023-11-04T01:38:17.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.662+0000 7fe56077c640 1 -- start start 2023-11-04T01:38:17.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.663+0000 7fe56077c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe55815d0b0 0x7fe558065df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.663+0000 7fe56077c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe55806f6b0 0x7fe5580c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.663+0000 7fe56077c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe55806e320 0x7fe55806e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.663+0000 7fe56077c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55806ecf0 con 0x7fe55806f6b0 2023-11-04T01:38:17.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.663+0000 7fe56077c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5580cbad0 con 0x7fe55815d0b0 2023-11-04T01:38:17.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.663+0000 7fe56077c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5580cb5a0 con 0x7fe55806e320 2023-11-04T01:38:17.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.663+0000 7fe55dd17640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe55806f6b0 0x7fe5580c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.663+0000 7fe55dd17640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe55806f6b0 0x7fe5580c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59656/0 (socket says 172.21.15.114:59656) 2023-11-04T01:38:17.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.663+0000 7fe55dd17640 1 -- 172.21.15.114:0/32821397 learned_addr learned my addr 172.21.15.114:0/32821397 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:17.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.663+0000 7fe55ed19640 1 --2- 172.21.15.114:0/32821397 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe55806e320 0x7fe55806e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.663+0000 7fe55e518640 1 --2- 172.21.15.114:0/32821397 >> v2:172.21.15.141:3300/0 conn(0x7fe55815d0b0 0x7fe558065df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.663+0000 7fe55dd17640 1 -- 172.21.15.114:0/32821397 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe55806e320 msgr2=0x7fe55806e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:17.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.664+0000 7fe55dd17640 1 --2- 172.21.15.114:0/32821397 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe55806e320 0x7fe55806e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.664+0000 7fe55dd17640 1 -- 172.21.15.114:0/32821397 >> v2:172.21.15.141:3300/0 conn(0x7fe55815d0b0 msgr2=0x7fe558065df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:17.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.664+0000 7fe55dd17640 1 --2- 172.21.15.114:0/32821397 >> v2:172.21.15.141:3300/0 conn(0x7fe55815d0b0 0x7fe558065df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.664+0000 7fe55dd17640 1 -- 172.21.15.114:0/32821397 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5580cb7f0 con 0x7fe55806f6b0 2023-11-04T01:38:17.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.664+0000 7fe55dd17640 1 --2- 172.21.15.114:0/32821397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe55806f6b0 0x7fe5580c9dc0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe5580b1a00 tx=0x7fe54802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9eaf3aa389e608 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:17.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.664+0000 7fe55d516640 1 -- 172.21.15.114:0/32821397 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548031870 con 0x7fe55806f6b0 2023-11-04T01:38:17.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.664+0000 7fe55d516640 1 -- 172.21.15.114:0/32821397 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5480319d0 con 0x7fe55806f6b0 2023-11-04T01:38:17.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.664+0000 7fe55d516640 1 -- 172.21.15.114:0/32821397 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548031d60 con 0x7fe55806f6b0 2023-11-04T01:38:17.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.665+0000 7fe56077c640 1 -- 172.21.15.114:0/32821397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe55806f6b0 msgr2=0x7fe5580c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.665+0000 7fe56077c640 1 --2- 172.21.15.114:0/32821397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe55806f6b0 0x7fe5580c9dc0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe5580b1a00 tx=0x7fe54802b910 comp rx=0 tx=0).stop 2023-11-04T01:38:17.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.665+0000 7fe56077c640 1 -- 172.21.15.114:0/32821397 shutdown_connections 2023-11-04T01:38:17.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.665+0000 7fe56077c640 1 --2- 172.21.15.114:0/32821397 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe55806e320 0x7fe55806e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.665+0000 7fe56077c640 1 --2- 172.21.15.114:0/32821397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe55806f6b0 0x7fe5580c9dc0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.665+0000 7fe56077c640 1 --2- 172.21.15.114:0/32821397 >> v2:172.21.15.141:3300/0 conn(0x7fe55815d0b0 0x7fe558065df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.665+0000 7fe56077c640 1 -- 172.21.15.114:0/32821397 >> 172.21.15.114:0/32821397 conn(0x7fe5580b0ce0 msgr2=0x7fe5580b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:17.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.665+0000 7fe56077c640 1 -- 172.21.15.114:0/32821397 shutdown_connections 2023-11-04T01:38:17.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.665+0000 7fe56077c640 1 -- 172.21.15.114:0/32821397 wait complete. 2023-11-04T01:38:17.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.666+0000 7fe56077c640 1 Processor -- start 2023-11-04T01:38:17.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.666+0000 7fe56077c640 1 -- start start 2023-11-04T01:38:17.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.667+0000 7fe56077c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe55806e320 0x7fe55814d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.667+0000 7fe56077c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe55806f6b0 0x7fe55814b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.667+0000 7fe56077c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe55815d0b0 0x7fe55814ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.667+0000 7fe56077c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55814ce80 con 0x7fe55806f6b0 2023-11-04T01:38:17.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.667+0000 7fe56077c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55814d850 con 0x7fe55806e320 2023-11-04T01:38:17.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.667+0000 7fe56077c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55814b720 con 0x7fe55815d0b0 2023-11-04T01:38:17.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.667+0000 7fe55dd17640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe55806f6b0 0x7fe55814b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.667+0000 7fe55dd17640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe55806f6b0 0x7fe55814b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59670/0 (socket says 172.21.15.114:59670) 2023-11-04T01:38:17.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.667+0000 7fe55dd17640 1 -- 172.21.15.114:0/1741812473 learned_addr learned my addr 172.21.15.114:0/1741812473 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:17.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.667+0000 7fe55dd17640 1 -- 172.21.15.114:0/1741812473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe55815d0b0 msgr2=0x7fe55814ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.667+0000 7fe55dd17640 1 --2- 172.21.15.114:0/1741812473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe55815d0b0 0x7fe55814ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.667+0000 7fe55dd17640 1 -- 172.21.15.114:0/1741812473 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe55806e320 msgr2=0x7fe55814d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:17.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.667+0000 7fe55dd17640 1 --2- 172.21.15.114:0/1741812473 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe55806e320 0x7fe55814d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:17.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.667+0000 7fe55dd17640 1 -- 172.21.15.114:0/1741812473 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5480094d0 con 0x7fe55806f6b0 2023-11-04T01:38:17.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.667+0000 7fe55dd17640 1 --2- 172.21.15.114:0/1741812473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe55806f6b0 0x7fe55814b1e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe54802b950 tx=0x7fe5480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:17.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.667+0000 7fe54effd640 1 -- 172.21.15.114:0/1741812473 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54803ad30 con 0x7fe55806f6b0 2023-11-04T01:38:17.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.668+0000 7fe54effd640 1 -- 172.21.15.114:0/1741812473 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5480443f0 con 0x7fe55806f6b0 2023-11-04T01:38:17.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.668+0000 7fe56077c640 1 -- 172.21.15.114:0/1741812473 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55814c270 con 0x7fe55806f6b0 2023-11-04T01:38:17.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.668+0000 7fe54effd640 1 -- 172.21.15.114:0/1741812473 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5480447a0 con 0x7fe55806f6b0 2023-11-04T01:38:17.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.668+0000 7fe56077c640 1 -- 172.21.15.114:0/1741812473 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55814c830 con 0x7fe55806f6b0 2023-11-04T01:38:17.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.668+0000 7fe56077c640 1 -- 172.21.15.114:0/1741812473 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5580b17d0 con 0x7fe55806f6b0 2023-11-04T01:38:17.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.669+0000 7fe54effd640 1 -- 172.21.15.114:0/1741812473 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe54804d450 con 0x7fe55806f6b0 2023-11-04T01:38:17.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.669+0000 7fe54effd640 1 --2- 172.21.15.114:0/1741812473 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe53c06ae70 0x7fe53c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:17.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.670+0000 7fe55e518640 1 --2- 172.21.15.114:0/1741812473 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe53c06ae70 0x7fe53c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:17.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.670+0000 7fe54effd640 1 -- 172.21.15.114:0/1741812473 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe54802d040 con 0x7fe55806f6b0 2023-11-04T01:38:17.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.670+0000 7fe55e518640 1 --2- 172.21.15.114:0/1741812473 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe53c06ae70 0x7fe53c06d330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe5540098f0 tx=0x7fe554008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:17.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.674+0000 7fe54effd640 1 -- 172.21.15.114:0/1741812473 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe548076cd0 con 0x7fe55806f6b0 2023-11-04T01:38:17.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:17.841+0000 7fe56077c640 1 -- 172.21.15.114:0/1741812473 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe55804e490 con 0x7fe55806f6b0 2023-11-04T01:38:18.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.013+0000 7fe54effd640 1 -- 172.21.15.114:0/1741812473 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v51) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe548035070 con 0x7fe55806f6b0 2023-11-04T01:38:18.015 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2023-11-04T01:38:18.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.016+0000 7fe56077c640 1 -- 172.21.15.114:0/1741812473 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe53c06ae70 msgr2=0x7fe53c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:18.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.016+0000 7fe56077c640 1 --2- 172.21.15.114:0/1741812473 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe53c06ae70 0x7fe53c06d330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe5540098f0 tx=0x7fe554008040 comp rx=0 tx=0).stop 2023-11-04T01:38:18.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.016+0000 7fe56077c640 1 -- 172.21.15.114:0/1741812473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe55806f6b0 msgr2=0x7fe55814b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:18.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.016+0000 7fe56077c640 1 --2- 172.21.15.114:0/1741812473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe55806f6b0 0x7fe55814b1e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe54802b950 tx=0x7fe5480046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.016+0000 7fe56077c640 1 -- 172.21.15.114:0/1741812473 shutdown_connections 2023-11-04T01:38:18.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.016+0000 7fe56077c640 1 --2- 172.21.15.114:0/1741812473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe55815d0b0 0x7fe55814ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.016+0000 7fe56077c640 1 --2- 172.21.15.114:0/1741812473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe55806f6b0 0x7fe55814b1e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.016+0000 7fe56077c640 1 --2- 172.21.15.114:0/1741812473 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe53c06ae70 0x7fe53c06d330 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.016+0000 7fe56077c640 1 --2- 172.21.15.114:0/1741812473 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe55806e320 0x7fe55814d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.016+0000 7fe56077c640 1 -- 172.21.15.114:0/1741812473 >> 172.21.15.114:0/1741812473 conn(0x7fe5580b0ce0 msgr2=0x7fe5580b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:18.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.016+0000 7fe56077c640 1 -- 172.21.15.114:0/1741812473 shutdown_connections 2023-11-04T01:38:18.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.016+0000 7fe56077c640 1 -- 172.21.15.114:0/1741812473 wait complete. 2023-11-04T01:38:18.031 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:38:18.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.135+0000 7f2a5319e640 1 Processor -- start 2023-11-04T01:38:18.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.135+0000 7f2a5319e640 1 -- start start 2023-11-04T01:38:18.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.136+0000 7f2a5319e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a4c15cb50 0x7f2a4c0cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:18.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.136+0000 7f2a5319e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a4c06ba40 0x7f2a4c0b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:18.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.136+0000 7f2a5319e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2a4c0b17d0 0x7f2a4c160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:18.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.136+0000 7f2a5319e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4c06c1b0 con 0x7f2a4c06ba40 2023-11-04T01:38:18.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.136+0000 7f2a5319e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4c0b1c00 con 0x7f2a4c0b17d0 2023-11-04T01:38:18.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.136+0000 7f2a5319e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0716e0 con 0x7f2a4c15cb50 2023-11-04T01:38:18.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.136+0000 7f2a5199b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a4c06ba40 0x7f2a4c0b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:18.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.136+0000 7f2a5199b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a4c06ba40 0x7f2a4c0b1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59682/0 (socket says 172.21.15.114:59682) 2023-11-04T01:38:18.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.136+0000 7f2a5199b640 1 -- 172.21.15.114:0/4008725886 learned_addr learned my addr 172.21.15.114:0/4008725886 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:18.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.136+0000 7f2a5219c640 1 --2- 172.21.15.114:0/4008725886 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a4c15cb50 0x7f2a4c0cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:18.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.136+0000 7f2a5299d640 1 --2- 172.21.15.114:0/4008725886 >> v2:172.21.15.141:3300/0 conn(0x7f2a4c0b17d0 0x7f2a4c160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:18.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.136+0000 7f2a5199b640 1 -- 172.21.15.114:0/4008725886 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a4c15cb50 msgr2=0x7f2a4c0cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:18.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.136+0000 7f2a5199b640 1 --2- 172.21.15.114:0/4008725886 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a4c15cb50 0x7f2a4c0cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.136+0000 7f2a5199b640 1 -- 172.21.15.114:0/4008725886 >> v2:172.21.15.141:3300/0 conn(0x7f2a4c0b17d0 msgr2=0x7f2a4c160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:18.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.136+0000 7f2a5199b640 1 --2- 172.21.15.114:0/4008725886 >> v2:172.21.15.141:3300/0 conn(0x7f2a4c0b17d0 0x7f2a4c160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.136+0000 7f2a5199b640 1 -- 172.21.15.114:0/4008725886 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c0719c0 con 0x7f2a4c06ba40 2023-11-04T01:38:18.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.137+0000 7f2a5199b640 1 --2- 172.21.15.114:0/4008725886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4c06ba40 0x7f2a4c0b1290 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0cd340 tx=0x7f2a3c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c707383c3bbcc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:18.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.137+0000 7f2a5119a640 1 -- 172.21.15.114:0/4008725886 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c031870 con 0x7f2a4c06ba40 2023-11-04T01:38:18.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.137+0000 7f2a5119a640 1 -- 172.21.15.114:0/4008725886 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c0319d0 con 0x7f2a4c06ba40 2023-11-04T01:38:18.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.137+0000 7f2a5119a640 1 -- 172.21.15.114:0/4008725886 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c031d60 con 0x7f2a4c06ba40 2023-11-04T01:38:18.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.137+0000 7f2a5319e640 1 -- 172.21.15.114:0/4008725886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4c06ba40 msgr2=0x7f2a4c0b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:18.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.137+0000 7f2a5319e640 1 --2- 172.21.15.114:0/4008725886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4c06ba40 0x7f2a4c0b1290 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0cd340 tx=0x7f2a3c02b910 comp rx=0 tx=0).stop 2023-11-04T01:38:18.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.138+0000 7f2a5319e640 1 -- 172.21.15.114:0/4008725886 shutdown_connections 2023-11-04T01:38:18.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.138+0000 7f2a5319e640 1 --2- 172.21.15.114:0/4008725886 >> v2:172.21.15.141:3300/0 conn(0x7f2a4c0b17d0 0x7f2a4c160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.138+0000 7f2a5319e640 1 --2- 172.21.15.114:0/4008725886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4c06ba40 0x7f2a4c0b1290 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.138+0000 7f2a5319e640 1 --2- 172.21.15.114:0/4008725886 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a4c15cb50 0x7f2a4c0cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.138+0000 7f2a5319e640 1 -- 172.21.15.114:0/4008725886 >> 172.21.15.114:0/4008725886 conn(0x7f2a4c0cc290 msgr2=0x7f2a4c0cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:18.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.138+0000 7f2a5319e640 1 -- 172.21.15.114:0/4008725886 shutdown_connections 2023-11-04T01:38:18.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.138+0000 7f2a5319e640 1 -- 172.21.15.114:0/4008725886 wait complete. 2023-11-04T01:38:18.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.139+0000 7f2a5319e640 1 Processor -- start 2023-11-04T01:38:18.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.139+0000 7f2a5319e640 1 -- start start 2023-11-04T01:38:18.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5319e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a4c06ba40 0x7f2a4c0c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:18.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5319e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a4c0b17d0 0x7f2a4c0c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:18.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5319e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4c15cb50 0x7f2a4c153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:18.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5319e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c154210 con 0x7f2a4c15cb50 2023-11-04T01:38:18.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5319e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0c9740 con 0x7f2a4c06ba40 2023-11-04T01:38:18.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5319e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0c58b0 con 0x7f2a4c0b17d0 2023-11-04T01:38:18.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5299d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4c15cb50 0x7f2a4c153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:18.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5299d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4c15cb50 0x7f2a4c153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59690/0 (socket says 172.21.15.114:59690) 2023-11-04T01:38:18.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5299d640 1 -- 172.21.15.114:0/1417723072 learned_addr learned my addr 172.21.15.114:0/1417723072 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:18.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5199b640 1 --2- 172.21.15.114:0/1417723072 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a4c0b17d0 0x7f2a4c0c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:18.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5299d640 1 -- 172.21.15.114:0/1417723072 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a4c0b17d0 msgr2=0x7f2a4c0c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:18.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5219c640 1 --2- 172.21.15.114:0/1417723072 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a4c06ba40 0x7f2a4c0c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:18.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5299d640 1 --2- 172.21.15.114:0/1417723072 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a4c0b17d0 0x7f2a4c0c5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5299d640 1 -- 172.21.15.114:0/1417723072 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a4c06ba40 msgr2=0x7f2a4c0c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:18.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5299d640 1 --2- 172.21.15.114:0/1417723072 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a4c06ba40 0x7f2a4c0c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:18.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5299d640 1 -- 172.21.15.114:0/1417723072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c0094d0 con 0x7f2a4c15cb50 2023-11-04T01:38:18.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5299d640 1 --2- 172.21.15.114:0/1417723072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4c15cb50 0x7f2a4c153400 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2a44007e40 tx=0x7f2a4400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:18.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a42ffd640 1 -- 172.21.15.114:0/1417723072 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44014620 con 0x7f2a4c15cb50 2023-11-04T01:38:18.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a42ffd640 1 -- 172.21.15.114:0/1417723072 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a440147a0 con 0x7f2a4c15cb50 2023-11-04T01:38:18.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a42ffd640 1 -- 172.21.15.114:0/1417723072 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44014b50 con 0x7f2a4c15cb50 2023-11-04T01:38:18.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5319e640 1 -- 172.21.15.114:0/1417723072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c0c6280 con 0x7f2a4c15cb50 2023-11-04T01:38:18.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.140+0000 7f2a5319e640 1 -- 172.21.15.114:0/1417723072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c0c5260 con 0x7f2a4c15cb50 2023-11-04T01:38:18.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.141+0000 7f2a5319e640 1 -- 172.21.15.114:0/1417723072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4c0cc090 con 0x7f2a4c15cb50 2023-11-04T01:38:18.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.142+0000 7f2a42ffd640 1 -- 172.21.15.114:0/1417723072 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a44014cb0 con 0x7f2a4c15cb50 2023-11-04T01:38:18.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.142+0000 7f2a42ffd640 1 --2- 172.21.15.114:0/1417723072 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a3006ae70 0x7f2a3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:18.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.142+0000 7f2a5219c640 1 --2- 172.21.15.114:0/1417723072 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a3006ae70 0x7f2a3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:18.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.142+0000 7f2a42ffd640 1 -- 172.21.15.114:0/1417723072 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f2a4408a030 con 0x7f2a4c15cb50 2023-11-04T01:38:18.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.143+0000 7f2a5219c640 1 --2- 172.21.15.114:0/1417723072 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a3006ae70 0x7f2a3006d330 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2a48006fd0 tx=0x7f2a48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:18.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.147+0000 7f2a42ffd640 1 -- 172.21.15.114:0/1417723072 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2a44055020 con 0x7f2a4c15cb50 2023-11-04T01:38:18.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:18.315+0000 7f2a5319e640 1 -- 172.21.15.114:0/1417723072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2a4c04ece0 con 0x7f2a4c15cb50 2023-11-04T01:38:19.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.018+0000 7f2a42ffd640 1 -- 172.21.15.114:0/1417723072 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v52) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2a44058640 con 0x7f2a4c15cb50 2023-11-04T01:38:19.020 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2023-11-04T01:38:19.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.020+0000 7f2a5319e640 1 -- 172.21.15.114:0/1417723072 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a3006ae70 msgr2=0x7f2a3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.020+0000 7f2a5319e640 1 --2- 172.21.15.114:0/1417723072 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a3006ae70 0x7f2a3006d330 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2a48006fd0 tx=0x7f2a48008040 comp rx=0 tx=0).stop 2023-11-04T01:38:19.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.020+0000 7f2a5319e640 1 -- 172.21.15.114:0/1417723072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4c15cb50 msgr2=0x7f2a4c153400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.020+0000 7f2a5319e640 1 --2- 172.21.15.114:0/1417723072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4c15cb50 0x7f2a4c153400 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2a44007e40 tx=0x7f2a4400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.020+0000 7f2a5319e640 1 -- 172.21.15.114:0/1417723072 shutdown_connections 2023-11-04T01:38:19.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.020+0000 7f2a5319e640 1 --2- 172.21.15.114:0/1417723072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4c15cb50 0x7f2a4c153400 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.020+0000 7f2a5319e640 1 --2- 172.21.15.114:0/1417723072 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a4c0b17d0 0x7f2a4c0c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.020+0000 7f2a5319e640 1 --2- 172.21.15.114:0/1417723072 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a3006ae70 0x7f2a3006d330 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.020+0000 7f2a5319e640 1 --2- 172.21.15.114:0/1417723072 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a4c06ba40 0x7f2a4c0c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.020+0000 7f2a5319e640 1 -- 172.21.15.114:0/1417723072 >> 172.21.15.114:0/1417723072 conn(0x7f2a4c0cc290 msgr2=0x7f2a4c0cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:19.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.020+0000 7f2a5319e640 1 -- 172.21.15.114:0/1417723072 shutdown_connections 2023-11-04T01:38:19.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.020+0000 7f2a5319e640 1 -- 172.21.15.114:0/1417723072 wait complete. 2023-11-04T01:38:19.043 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:38:19.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.145+0000 7f8e79941640 1 Processor -- start 2023-11-04T01:38:19.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.145+0000 7f8e79941640 1 -- start start 2023-11-04T01:38:19.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.146+0000 7f8e79941640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e740cd6d0 0x7f8e74161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.146+0000 7f8e79941640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8e740b4880 0x7f8e740b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.146+0000 7f8e79941640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e740cde60 con 0x7f8e74153e60 2023-11-04T01:38:19.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.146+0000 7f8e79941640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e74160f90 con 0x7f8e740cd6d0 2023-11-04T01:38:19.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.146+0000 7f8e79941640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e74161960 con 0x7f8e740b4880 2023-11-04T01:38:19.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.146+0000 7f8e727fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e740cd6d0 0x7f8e74161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.146+0000 7f8e727fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e740cd6d0 0x7f8e74161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59696/0 (socket says 172.21.15.114:59696) 2023-11-04T01:38:19.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.146+0000 7f8e727fc640 1 -- 172.21.15.114:0/3230001799 learned_addr learned my addr 172.21.15.114:0/3230001799 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:19.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.146+0000 7f8e737fe640 1 --2- 172.21.15.114:0/3230001799 >> v2:172.21.15.141:3300/0 conn(0x7f8e740b4880 0x7f8e740b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.146+0000 7f8e727fc640 1 -- 172.21.15.114:0/3230001799 >> v2:172.21.15.141:3300/0 conn(0x7f8e740b4880 msgr2=0x7f8e740b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:19.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.146+0000 7f8e727fc640 1 --2- 172.21.15.114:0/3230001799 >> v2:172.21.15.141:3300/0 conn(0x7f8e740b4880 0x7f8e740b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.146+0000 7f8e727fc640 1 -- 172.21.15.114:0/3230001799 >> v1:172.21.15.141:6789/0 conn(0x7f8e74153e60 legacy=0x7f8e7415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:19.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.146+0000 7f8e727fc640 1 -- 172.21.15.114:0/3230001799 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e740b5220 con 0x7f8e740cd6d0 2023-11-04T01:38:19.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.147+0000 7f8e727fc640 1 --2- 172.21.15.114:0/3230001799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e740cd6d0 0x7f8e74161420 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f8e740b8f40 tx=0x7f8e6802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242cd7bbe75bf71a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:19.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.147+0000 7f8e71ffb640 1 -- 172.21.15.114:0/3230001799 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68031870 con 0x7f8e740cd6d0 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.147+0000 7f8e71ffb640 1 -- 172.21.15.114:0/3230001799 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e680319d0 con 0x7f8e740cd6d0 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.147+0000 7f8e71ffb640 1 -- 172.21.15.114:0/3230001799 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68031d60 con 0x7f8e740cd6d0 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.148+0000 7f8e79941640 1 -- 172.21.15.114:0/3230001799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e740cd6d0 msgr2=0x7f8e74161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.148+0000 7f8e79941640 1 --2- 172.21.15.114:0/3230001799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e740cd6d0 0x7f8e74161420 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f8e740b8f40 tx=0x7f8e6802b910 comp rx=0 tx=0).stop 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.148+0000 7f8e79941640 1 -- 172.21.15.114:0/3230001799 shutdown_connections 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.148+0000 7f8e79941640 1 --2- 172.21.15.114:0/3230001799 >> v2:172.21.15.141:3300/0 conn(0x7f8e740b4880 0x7f8e740b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.148+0000 7f8e79941640 1 --2- 172.21.15.114:0/3230001799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e740cd6d0 0x7f8e74161420 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.148+0000 7f8e79941640 1 -- 172.21.15.114:0/3230001799 >> 172.21.15.114:0/3230001799 conn(0x7f8e740cf880 msgr2=0x7f8e740cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.148+0000 7f8e79941640 1 -- 172.21.15.114:0/3230001799 shutdown_connections 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.148+0000 7f8e79941640 1 -- 172.21.15.114:0/3230001799 wait complete. 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.149+0000 7f8e79941640 1 Processor -- start 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.149+0000 7f8e79941640 1 -- start start 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e79941640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e740b4880 0x7f8e74156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e79941640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e740cd6d0 0x7f8e741f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e79941640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e74153e60 0x7f8e741f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e79941640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e740c6340 con 0x7f8e74153e60 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e79941640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e74158bc0 con 0x7f8e740cd6d0 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e79941640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e74158e80 con 0x7f8e740b4880 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e737fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e74153e60 0x7f8e741f3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e737fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e74153e60 0x7f8e741f3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59708/0 (socket says 172.21.15.114:59708) 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e737fe640 1 -- 172.21.15.114:0/4250062080 learned_addr learned my addr 172.21.15.114:0/4250062080 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e727fc640 1 --2- 172.21.15.114:0/4250062080 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e740cd6d0 0x7f8e741f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e72ffd640 1 --2- 172.21.15.114:0/4250062080 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e740b4880 0x7f8e74156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e737fe640 1 -- 172.21.15.114:0/4250062080 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e740b4880 msgr2=0x7f8e74156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e737fe640 1 --2- 172.21.15.114:0/4250062080 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e740b4880 0x7f8e74156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e737fe640 1 -- 172.21.15.114:0/4250062080 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e740cd6d0 msgr2=0x7f8e741f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e737fe640 1 --2- 172.21.15.114:0/4250062080 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e740cd6d0 0x7f8e741f55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e737fe640 1 -- 172.21.15.114:0/4250062080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e680094d0 con 0x7f8e74153e60 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e737fe640 1 --2- 172.21.15.114:0/4250062080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e74153e60 0x7f8e741f3b70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c007e40 tx=0x7f8e6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e5bfff640 1 -- 172.21.15.114:0/4250062080 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c014620 con 0x7f8e74153e60 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e79941640 1 -- 172.21.15.114:0/4250062080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e74159160 con 0x7f8e74153e60 2023-11-04T01:38:19.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e5bfff640 1 -- 172.21.15.114:0/4250062080 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c00ee90 con 0x7f8e74153e60 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.150+0000 7f8e5bfff640 1 -- 172.21.15.114:0/4250062080 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0149e0 con 0x7f8e74153e60 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.151+0000 7f8e79941640 1 -- 172.21.15.114:0/4250062080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e74159720 con 0x7f8e74153e60 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.152+0000 7f8e79941640 1 -- 172.21.15.114:0/4250062080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e74159910 con 0x7f8e74153e60 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.152+0000 7f8e5bfff640 1 -- 172.21.15.114:0/4250062080 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e6c014b40 con 0x7f8e74153e60 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.152+0000 7f8e5bfff640 1 --2- 172.21.15.114:0/4250062080 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8e6006ae70 0x7f8e6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.152+0000 7f8e5bfff640 1 -- 172.21.15.114:0/4250062080 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f8e6c08a0a0 con 0x7f8e74153e60 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.152+0000 7f8e72ffd640 1 --2- 172.21.15.114:0/4250062080 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8e6006ae70 0x7f8e6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:19.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.153+0000 7f8e72ffd640 1 --2- 172.21.15.114:0/4250062080 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8e6006ae70 0x7f8e6006d330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8e64006fd0 tx=0x7f8e64009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:19.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.156+0000 7f8e5bfff640 1 -- 172.21.15.114:0/4250062080 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8e6c054fd0 con 0x7f8e74153e60 2023-11-04T01:38:19.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:19.357+0000 7f8e79941640 1 -- 172.21.15.114:0/4250062080 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8e74074290 con 0x7f8e74153e60 2023-11-04T01:38:19.894 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:19.896 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:20.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.028+0000 7f8e5bfff640 1 -- 172.21.15.114:0/4250062080 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8e6c0585f0 con 0x7f8e74153e60 2023-11-04T01:38:20.030 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 8 and data pool 9 2023-11-04T01:38:20.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.032+0000 7f8e79941640 1 -- 172.21.15.114:0/4250062080 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8e6006ae70 msgr2=0x7f8e6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.032+0000 7f8e79941640 1 --2- 172.21.15.114:0/4250062080 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8e6006ae70 0x7f8e6006d330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8e64006fd0 tx=0x7f8e64009060 comp rx=0 tx=0).stop 2023-11-04T01:38:20.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.033+0000 7f8e79941640 1 -- 172.21.15.114:0/4250062080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e74153e60 msgr2=0x7f8e741f3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.033+0000 7f8e79941640 1 --2- 172.21.15.114:0/4250062080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e74153e60 0x7f8e741f3b70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c007e40 tx=0x7f8e6c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.035+0000 7f8e79941640 1 -- 172.21.15.114:0/4250062080 shutdown_connections 2023-11-04T01:38:20.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.035+0000 7f8e79941640 1 --2- 172.21.15.114:0/4250062080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e74153e60 0x7f8e741f3b70 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.035+0000 7f8e79941640 1 --2- 172.21.15.114:0/4250062080 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8e6006ae70 0x7f8e6006d330 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.035+0000 7f8e79941640 1 --2- 172.21.15.114:0/4250062080 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e740cd6d0 0x7f8e741f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.035+0000 7f8e79941640 1 --2- 172.21.15.114:0/4250062080 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e740b4880 0x7f8e74156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.035+0000 7f8e79941640 1 -- 172.21.15.114:0/4250062080 >> 172.21.15.114:0/4250062080 conn(0x7f8e740cf880 msgr2=0x7f8e7415fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:20.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.035+0000 7f8e79941640 1 -- 172.21.15.114:0/4250062080 shutdown_connections 2023-11-04T01:38:20.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.035+0000 7f8e79941640 1 -- 172.21.15.114:0/4250062080 wait complete. 2023-11-04T01:38:20.057 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:20.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.155+0000 7f403d864640 1 Processor -- start 2023-11-04T01:38:20.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.155+0000 7f403d864640 1 -- start start 2023-11-04T01:38:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.156+0000 7f403d864640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f403806a390 0x7f40380cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.156+0000 7f403d864640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f40380c2ae0 0x7f4038165810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.156+0000 7f403d864640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f403806a770 0x7f4038165d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.156+0000 7f403d864640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40380c33a0 con 0x7f403806a770 2023-11-04T01:38:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.156+0000 7f403d864640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40380b1630 con 0x7f403806a390 2023-11-04T01:38:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.156+0000 7f403d864640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40380b20f0 con 0x7f40380c2ae0 2023-11-04T01:38:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.156+0000 7f40377fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f403806a770 0x7f4038165d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.156+0000 7f40377fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f403806a770 0x7f4038165d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59720/0 (socket says 172.21.15.114:59720) 2023-11-04T01:38:20.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.156+0000 7f40377fe640 1 -- 172.21.15.114:0/724108779 learned_addr learned my addr 172.21.15.114:0/724108779 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:20.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.157+0000 7f4036ffd640 1 --2- 172.21.15.114:0/724108779 >> v2:172.21.15.141:3300/0 conn(0x7f403806a390 0x7f40380cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.157+0000 7f40367fc640 1 --2- 172.21.15.114:0/724108779 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f40380c2ae0 0x7f4038165810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.157+0000 7f40377fe640 1 -- 172.21.15.114:0/724108779 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f40380c2ae0 msgr2=0x7f4038165810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:20.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.157+0000 7f40377fe640 1 --2- 172.21.15.114:0/724108779 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f40380c2ae0 0x7f4038165810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.157+0000 7f40377fe640 1 -- 172.21.15.114:0/724108779 >> v2:172.21.15.141:3300/0 conn(0x7f403806a390 msgr2=0x7f40380cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:20.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.157+0000 7f40377fe640 1 --2- 172.21.15.114:0/724108779 >> v2:172.21.15.141:3300/0 conn(0x7f403806a390 0x7f40380cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.157+0000 7f40377fe640 1 -- 172.21.15.114:0/724108779 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40380b23d0 con 0x7f403806a770 2023-11-04T01:38:20.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.157+0000 7f40377fe640 1 --2- 172.21.15.114:0/724108779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f403806a770 0x7f4038165d50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f403806ee10 tx=0x7f403002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad662f3369f0852 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.158+0000 7f4035ffb640 1 -- 172.21.15.114:0/724108779 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40300317e0 con 0x7f403806a770 2023-11-04T01:38:20.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.158+0000 7f4035ffb640 1 -- 172.21.15.114:0/724108779 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4030031940 con 0x7f403806a770 2023-11-04T01:38:20.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.158+0000 7f4035ffb640 1 -- 172.21.15.114:0/724108779 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4030031cd0 con 0x7f403806a770 2023-11-04T01:38:20.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.158+0000 7f403d864640 1 -- 172.21.15.114:0/724108779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f403806a770 msgr2=0x7f4038165d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.158+0000 7f403d864640 1 --2- 172.21.15.114:0/724108779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f403806a770 0x7f4038165d50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f403806ee10 tx=0x7f403002b880 comp rx=0 tx=0).stop 2023-11-04T01:38:20.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.158+0000 7f403d864640 1 -- 172.21.15.114:0/724108779 shutdown_connections 2023-11-04T01:38:20.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.158+0000 7f403d864640 1 --2- 172.21.15.114:0/724108779 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f40380c2ae0 0x7f4038165810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.158+0000 7f403d864640 1 --2- 172.21.15.114:0/724108779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f403806a770 0x7f4038165d50 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.158+0000 7f403d864640 1 --2- 172.21.15.114:0/724108779 >> v2:172.21.15.141:3300/0 conn(0x7f403806a390 0x7f40380cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.158+0000 7f403d864640 1 -- 172.21.15.114:0/724108779 >> 172.21.15.114:0/724108779 conn(0x7f403806d8b0 msgr2=0x7f403806dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:20.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.158+0000 7f403d864640 1 -- 172.21.15.114:0/724108779 shutdown_connections 2023-11-04T01:38:20.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.158+0000 7f403d864640 1 -- 172.21.15.114:0/724108779 wait complete. 2023-11-04T01:38:20.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.159+0000 7f403d864640 1 Processor -- start 2023-11-04T01:38:20.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.160+0000 7f403d864640 1 -- start start 2023-11-04T01:38:20.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.160+0000 7f403d864640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f403806a390 0x7f40380c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.160+0000 7f403d864640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f403806a770 0x7f40380c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.160+0000 7f403d864640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40380c2ae0 0x7f40380c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.160+0000 7f403d864640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4038153380 con 0x7f40380c2ae0 2023-11-04T01:38:20.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.160+0000 7f403d864640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40380c44b0 con 0x7f403806a390 2023-11-04T01:38:20.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.160+0000 7f403d864640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40380c4790 con 0x7f403806a770 2023-11-04T01:38:20.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.160+0000 7f40377fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40380c2ae0 0x7f40380c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.160+0000 7f40377fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40380c2ae0 0x7f40380c95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59732/0 (socket says 172.21.15.114:59732) 2023-11-04T01:38:20.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.160+0000 7f40377fe640 1 -- 172.21.15.114:0/1464739758 learned_addr learned my addr 172.21.15.114:0/1464739758 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:20.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.161+0000 7f4036ffd640 1 --2- 172.21.15.114:0/1464739758 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f403806a390 0x7f40380c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.161+0000 7f40367fc640 1 --2- 172.21.15.114:0/1464739758 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f403806a770 0x7f40380c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.161+0000 7f40377fe640 1 -- 172.21.15.114:0/1464739758 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f403806a770 msgr2=0x7f40380c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.161+0000 7f40377fe640 1 --2- 172.21.15.114:0/1464739758 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f403806a770 0x7f40380c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.161+0000 7f40377fe640 1 -- 172.21.15.114:0/1464739758 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f403806a390 msgr2=0x7f40380c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.161+0000 7f40377fe640 1 --2- 172.21.15.114:0/1464739758 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f403806a390 0x7f40380c2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.161+0000 7f40377fe640 1 -- 172.21.15.114:0/1464739758 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40300094d0 con 0x7f40380c2ae0 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.161+0000 7f40377fe640 1 --2- 172.21.15.114:0/1464739758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40380c2ae0 0x7f40380c95b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f40300090b0 tx=0x7f40300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.161+0000 7f402ffff640 1 -- 172.21.15.114:0/1464739758 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4030032670 con 0x7f40380c2ae0 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.161+0000 7f402ffff640 1 -- 172.21.15.114:0/1464739758 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40300327d0 con 0x7f40380c2ae0 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.161+0000 7f403d864640 1 -- 172.21.15.114:0/1464739758 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40380c4a70 con 0x7f40380c2ae0 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.161+0000 7f402ffff640 1 -- 172.21.15.114:0/1464739758 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4030032b80 con 0x7f40380c2ae0 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.161+0000 7f403d864640 1 -- 172.21.15.114:0/1464739758 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40380c9af0 con 0x7f40380c2ae0 2023-11-04T01:38:20.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.162+0000 7f403d864640 1 -- 172.21.15.114:0/1464739758 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40381534f0 con 0x7f40380c2ae0 2023-11-04T01:38:20.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.162+0000 7f402ffff640 1 -- 172.21.15.114:0/1464739758 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4030032ce0 con 0x7f40380c2ae0 2023-11-04T01:38:20.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.163+0000 7f402ffff640 1 --2- 172.21.15.114:0/1464739758 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f401806ae70 0x7f401806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.163+0000 7f4036ffd640 1 --2- 172.21.15.114:0/1464739758 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f401806ae70 0x7f401806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.163+0000 7f402ffff640 1 -- 172.21.15.114:0/1464739758 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f40300ab760 con 0x7f40380c2ae0 2023-11-04T01:38:20.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.163+0000 7f4036ffd640 1 --2- 172.21.15.114:0/1464739758 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f401806ae70 0x7f401806d330 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f40380b5840 tx=0x7f402800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.167+0000 7f402ffff640 1 -- 172.21.15.114:0/1464739758 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4030076600 con 0x7f40380c2ae0 2023-11-04T01:38:20.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.335+0000 7f403d864640 1 -- 172.21.15.114:0/1464739758 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40380674e0 con 0x7f40380c2ae0 2023-11-04T01:38:20.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.336+0000 7f402ffff640 1 -- 172.21.15.114:0/1464739758 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18596 (secure 0 0 0) 0x7f4030079c20 con 0x7f40380c2ae0 2023-11-04T01:38:20.338 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:20.339 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":53,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:19.358806+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:17.859902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:18.334035+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:20.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.338+0000 7f403d864640 1 -- 172.21.15.114:0/1464739758 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f401806ae70 msgr2=0x7f401806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.338+0000 7f403d864640 1 --2- 172.21.15.114:0/1464739758 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f401806ae70 0x7f401806d330 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f40380b5840 tx=0x7f402800b040 comp rx=0 tx=0).stop 2023-11-04T01:38:20.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.338+0000 7f403d864640 1 -- 172.21.15.114:0/1464739758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40380c2ae0 msgr2=0x7f40380c95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.338+0000 7f403d864640 1 --2- 172.21.15.114:0/1464739758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40380c2ae0 0x7f40380c95b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f40300090b0 tx=0x7f40300046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.338+0000 7f403d864640 1 -- 172.21.15.114:0/1464739758 shutdown_connections 2023-11-04T01:38:20.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.338+0000 7f403d864640 1 --2- 172.21.15.114:0/1464739758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40380c2ae0 0x7f40380c95b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.338+0000 7f403d864640 1 --2- 172.21.15.114:0/1464739758 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f403806a770 0x7f40380c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.338+0000 7f403d864640 1 --2- 172.21.15.114:0/1464739758 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f401806ae70 0x7f401806d330 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.338+0000 7f403d864640 1 --2- 172.21.15.114:0/1464739758 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f403806a390 0x7f40380c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.338+0000 7f403d864640 1 -- 172.21.15.114:0/1464739758 >> 172.21.15.114:0/1464739758 conn(0x7f403806d8b0 msgr2=0x7f4038072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:20.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.339+0000 7f403d864640 1 -- 172.21.15.114:0/1464739758 shutdown_connections 2023-11-04T01:38:20.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.339+0000 7f403d864640 1 -- 172.21.15.114:0/1464739758 wait complete. 2023-11-04T01:38:20.352 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:20.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.448+0000 7f53683c9640 1 Processor -- start 2023-11-04T01:38:20.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.448+0000 7f53683c9640 1 -- start start 2023-11-04T01:38:20.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.449+0000 7f53683c9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f53600cda60 0x7f53600ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.449+0000 7f53683c9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f53600b0cd0 0x7f5360070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.449+0000 7f53683c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53600cace0 0x7f5360070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.449+0000 7f53683c9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53600cc990 con 0x7f53600b0cd0 2023-11-04T01:38:20.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.449+0000 7f53683c9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53600ccc70 con 0x7f53600cda60 2023-11-04T01:38:20.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.449+0000 7f53683c9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53600c9ce0 con 0x7f53600cace0 2023-11-04T01:38:20.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.449+0000 7f5365964640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f53600b0cd0 0x7f5360070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.450+0000 7f5365964640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f53600b0cd0 0x7f5360070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59734/0 (socket says 172.21.15.114:59734) 2023-11-04T01:38:20.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.450+0000 7f5365964640 1 -- 172.21.15.114:0/3563296966 learned_addr learned my addr 172.21.15.114:0/3563296966 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:20.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.450+0000 7f5366966640 1 --2- 172.21.15.114:0/3563296966 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53600cace0 0x7f5360070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.450+0000 7f5366165640 1 --2- 172.21.15.114:0/3563296966 >> v2:172.21.15.141:3300/0 conn(0x7f53600cda60 0x7f53600ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.450+0000 7f5365964640 1 -- 172.21.15.114:0/3563296966 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53600cace0 msgr2=0x7f5360070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:20.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.450+0000 7f5365964640 1 --2- 172.21.15.114:0/3563296966 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53600cace0 0x7f5360070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.450+0000 7f5365964640 1 -- 172.21.15.114:0/3563296966 >> v2:172.21.15.141:3300/0 conn(0x7f53600cda60 msgr2=0x7f53600ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:20.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.450+0000 7f5365964640 1 --2- 172.21.15.114:0/3563296966 >> v2:172.21.15.141:3300/0 conn(0x7f53600cda60 0x7f53600ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.450+0000 7f5365964640 1 -- 172.21.15.114:0/3563296966 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53600c9fc0 con 0x7f53600b0cd0 2023-11-04T01:38:20.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.450+0000 7f5365964640 1 --2- 172.21.15.114:0/3563296966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53600b0cd0 0x7f5360070630 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f53600cf800 tx=0x7f535c02cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5cb0f3d558b563 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.451+0000 7f5365163640 1 -- 172.21.15.114:0/3563296966 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c02d9e0 con 0x7f53600b0cd0 2023-11-04T01:38:20.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.451+0000 7f5365163640 1 -- 172.21.15.114:0/3563296966 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c02db40 con 0x7f53600b0cd0 2023-11-04T01:38:20.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.451+0000 7f5365163640 1 -- 172.21.15.114:0/3563296966 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c035440 con 0x7f53600b0cd0 2023-11-04T01:38:20.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.451+0000 7f53683c9640 1 -- 172.21.15.114:0/3563296966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53600b0cd0 msgr2=0x7f5360070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.451+0000 7f53683c9640 1 --2- 172.21.15.114:0/3563296966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53600b0cd0 0x7f5360070630 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f53600cf800 tx=0x7f535c02cc30 comp rx=0 tx=0).stop 2023-11-04T01:38:20.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.451+0000 7f53683c9640 1 -- 172.21.15.114:0/3563296966 shutdown_connections 2023-11-04T01:38:20.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.451+0000 7f53683c9640 1 --2- 172.21.15.114:0/3563296966 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53600cace0 0x7f5360070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.451+0000 7f53683c9640 1 --2- 172.21.15.114:0/3563296966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53600b0cd0 0x7f5360070630 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.451+0000 7f53683c9640 1 --2- 172.21.15.114:0/3563296966 >> v2:172.21.15.141:3300/0 conn(0x7f53600cda60 0x7f53600ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.451+0000 7f53683c9640 1 -- 172.21.15.114:0/3563296966 >> 172.21.15.114:0/3563296966 conn(0x7f53600ce950 msgr2=0x7f53600ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.451+0000 7f53683c9640 1 -- 172.21.15.114:0/3563296966 shutdown_connections 2023-11-04T01:38:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.451+0000 7f53683c9640 1 -- 172.21.15.114:0/3563296966 wait complete. 2023-11-04T01:38:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.452+0000 7f53683c9640 1 Processor -- start 2023-11-04T01:38:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.452+0000 7f53683c9640 1 -- start start 2023-11-04T01:38:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.453+0000 7f53683c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53600b0cd0 0x7f5360157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.453+0000 7f53683c9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f53600cace0 0x7f536014a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.453+0000 7f53683c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53600cda60 0x7f53601e34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.453+0000 7f53683c9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53601e2af0 con 0x7f53600b0cd0 2023-11-04T01:38:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.453+0000 7f53683c9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536014b310 con 0x7f53600cace0 2023-11-04T01:38:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.453+0000 7f53683c9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53601e1ee0 con 0x7f53600cda60 2023-11-04T01:38:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.453+0000 7f5366165640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53600b0cd0 0x7f5360157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.453+0000 7f5366165640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53600b0cd0 0x7f5360157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59748/0 (socket says 172.21.15.114:59748) 2023-11-04T01:38:20.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.453+0000 7f5366165640 1 -- 172.21.15.114:0/2223793092 learned_addr learned my addr 172.21.15.114:0/2223793092 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:20.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.453+0000 7f5365964640 1 --2- 172.21.15.114:0/2223793092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f53600cace0 0x7f536014a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.453+0000 7f5366966640 1 --2- 172.21.15.114:0/2223793092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53600cda60 0x7f53601e34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.454+0000 7f5366165640 1 -- 172.21.15.114:0/2223793092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53600cda60 msgr2=0x7f53601e34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.454+0000 7f5366165640 1 --2- 172.21.15.114:0/2223793092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53600cda60 0x7f53601e34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.454+0000 7f5366165640 1 -- 172.21.15.114:0/2223793092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f53600cace0 msgr2=0x7f536014a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.454+0000 7f5366165640 1 --2- 172.21.15.114:0/2223793092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f53600cace0 0x7f536014a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.454+0000 7f5366165640 1 -- 172.21.15.114:0/2223793092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c0094d0 con 0x7f53600b0cd0 2023-11-04T01:38:20.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.454+0000 7f5366966640 1 --2- 172.21.15.114:0/2223793092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53600cda60 0x7f53601e34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:20.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.454+0000 7f5366165640 1 --2- 172.21.15.114:0/2223793092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53600b0cd0 0x7f5360157a40 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f535000e8a0 tx=0x7f535000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.454+0000 7f5356ffd640 1 -- 172.21.15.114:0/2223793092 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53500094f0 con 0x7f53600b0cd0 2023-11-04T01:38:20.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.454+0000 7f5356ffd640 1 -- 172.21.15.114:0/2223793092 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535000c940 con 0x7f53600b0cd0 2023-11-04T01:38:20.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.454+0000 7f5356ffd640 1 -- 172.21.15.114:0/2223793092 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535000ccf0 con 0x7f53600b0cd0 2023-11-04T01:38:20.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.454+0000 7f53683c9640 1 -- 172.21.15.114:0/2223793092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53601e21c0 con 0x7f53600b0cd0 2023-11-04T01:38:20.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.454+0000 7f53683c9640 1 -- 172.21.15.114:0/2223793092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53601e2780 con 0x7f53600b0cd0 2023-11-04T01:38:20.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.455+0000 7f53683c9640 1 -- 172.21.15.114:0/2223793092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53600adf10 con 0x7f53600b0cd0 2023-11-04T01:38:20.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.455+0000 7f5356ffd640 1 -- 172.21.15.114:0/2223793092 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5350013470 con 0x7f53600b0cd0 2023-11-04T01:38:20.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.456+0000 7f5356ffd640 1 --2- 172.21.15.114:0/2223793092 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f534406ae70 0x7f534406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.456+0000 7f5356ffd640 1 -- 172.21.15.114:0/2223793092 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f53500898a0 con 0x7f53600b0cd0 2023-11-04T01:38:20.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.456+0000 7f5365964640 1 --2- 172.21.15.114:0/2223793092 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f534406ae70 0x7f534406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.456+0000 7f5365964640 1 --2- 172.21.15.114:0/2223793092 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f534406ae70 0x7f534406d330 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f535c037000 tx=0x7f535c031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.460+0000 7f5356ffd640 1 -- 172.21.15.114:0/2223793092 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5350054760 con 0x7f53600b0cd0 2023-11-04T01:38:20.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.631+0000 7f53683c9640 1 -- 172.21.15.114:0/2223793092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f536015c4a0 con 0x7f53600b0cd0 2023-11-04T01:38:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.632+0000 7f5356ffd640 1 -- 172.21.15.114:0/2223793092 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18596 (secure 0 0 0) 0x7f5350057d80 con 0x7f53600b0cd0 2023-11-04T01:38:20.634 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:20.634 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":53,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:19.358806+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:17.859902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:18.334035+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:20.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.634+0000 7f53683c9640 1 -- 172.21.15.114:0/2223793092 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f534406ae70 msgr2=0x7f534406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.634+0000 7f53683c9640 1 --2- 172.21.15.114:0/2223793092 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f534406ae70 0x7f534406d330 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f535c037000 tx=0x7f535c031000 comp rx=0 tx=0).stop 2023-11-04T01:38:20.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.634+0000 7f53683c9640 1 -- 172.21.15.114:0/2223793092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53600b0cd0 msgr2=0x7f5360157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.634+0000 7f53683c9640 1 --2- 172.21.15.114:0/2223793092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53600b0cd0 0x7f5360157a40 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f535000e8a0 tx=0x7f535000ed60 comp rx=0 tx=0).stop 2023-11-04T01:38:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.634+0000 7f53683c9640 1 -- 172.21.15.114:0/2223793092 shutdown_connections 2023-11-04T01:38:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.634+0000 7f53683c9640 1 --2- 172.21.15.114:0/2223793092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f53600cda60 0x7f53601e34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.634+0000 7f53683c9640 1 --2- 172.21.15.114:0/2223793092 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f534406ae70 0x7f534406d330 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.634+0000 7f53683c9640 1 --2- 172.21.15.114:0/2223793092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f53600cace0 0x7f536014a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.634+0000 7f53683c9640 1 --2- 172.21.15.114:0/2223793092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53600b0cd0 0x7f5360157a40 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.634+0000 7f53683c9640 1 -- 172.21.15.114:0/2223793092 >> 172.21.15.114:0/2223793092 conn(0x7f53600ce950 msgr2=0x7f5360158ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.634+0000 7f53683c9640 1 -- 172.21.15.114:0/2223793092 shutdown_connections 2023-11-04T01:38:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.634+0000 7f53683c9640 1 -- 172.21.15.114:0/2223793092 wait complete. 2023-11-04T01:38:20.647 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:38:20.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.747+0000 7f0adc57c640 1 Processor -- start 2023-11-04T01:38:20.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.747+0000 7f0adc57c640 1 -- start start 2023-11-04T01:38:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.748+0000 7f0adc57c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0ad415e1c0 0x7f0ad406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.748+0000 7f0adc57c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ad415e5a0 0x7f0ad415f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.748+0000 7f0adc57c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0ad40c9af0 0x7f0ad4070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.748+0000 7f0adc57c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad406bc40 con 0x7f0ad40c9af0 2023-11-04T01:38:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.748+0000 7f0adc57c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad4066530 con 0x7f0ad415e1c0 2023-11-04T01:38:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.748+0000 7f0adc57c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad4065f70 con 0x7f0ad415e5a0 2023-11-04T01:38:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.748+0000 7f0adab19640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0ad40c9af0 0x7f0ad4070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.748+0000 7f0adab19640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0ad40c9af0 0x7f0ad4070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59762/0 (socket says 172.21.15.114:59762) 2023-11-04T01:38:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.748+0000 7f0adab19640 1 -- 172.21.15.114:0/3355470023 learned_addr learned my addr 172.21.15.114:0/3355470023 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.749+0000 7f0ad9b17640 1 --2- 172.21.15.114:0/3355470023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ad415e5a0 0x7f0ad415f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.749+0000 7f0ada318640 1 --2- 172.21.15.114:0/3355470023 >> v2:172.21.15.141:3300/0 conn(0x7f0ad415e1c0 0x7f0ad406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.749+0000 7f0adab19640 1 -- 172.21.15.114:0/3355470023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ad415e5a0 msgr2=0x7f0ad415f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:20.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.749+0000 7f0adab19640 1 --2- 172.21.15.114:0/3355470023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ad415e5a0 0x7f0ad415f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.749+0000 7f0adab19640 1 -- 172.21.15.114:0/3355470023 >> v2:172.21.15.141:3300/0 conn(0x7f0ad415e1c0 msgr2=0x7f0ad406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:20.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.749+0000 7f0adab19640 1 --2- 172.21.15.114:0/3355470023 >> v2:172.21.15.141:3300/0 conn(0x7f0ad415e1c0 0x7f0ad406b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.749+0000 7f0adab19640 1 -- 172.21.15.114:0/3355470023 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad4066250 con 0x7f0ad40c9af0 2023-11-04T01:38:20.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.749+0000 7f0adab19640 1 --2- 172.21.15.114:0/3355470023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ad40c9af0 0x7f0ad4070ff0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0ad406c960 tx=0x7f0acc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4ab3c8fb993a6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.749+0000 7f0ad9316640 1 -- 172.21.15.114:0/3355470023 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc0317e0 con 0x7f0ad40c9af0 2023-11-04T01:38:20.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.750+0000 7f0ad9316640 1 -- 172.21.15.114:0/3355470023 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc031940 con 0x7f0ad40c9af0 2023-11-04T01:38:20.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.750+0000 7f0ad9316640 1 -- 172.21.15.114:0/3355470023 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc031cd0 con 0x7f0ad40c9af0 2023-11-04T01:38:20.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.750+0000 7f0adc57c640 1 -- 172.21.15.114:0/3355470023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ad40c9af0 msgr2=0x7f0ad4070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.750+0000 7f0adc57c640 1 --2- 172.21.15.114:0/3355470023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ad40c9af0 0x7f0ad4070ff0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0ad406c960 tx=0x7f0acc02b880 comp rx=0 tx=0).stop 2023-11-04T01:38:20.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.750+0000 7f0adc57c640 1 -- 172.21.15.114:0/3355470023 shutdown_connections 2023-11-04T01:38:20.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.750+0000 7f0adc57c640 1 --2- 172.21.15.114:0/3355470023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ad415e5a0 0x7f0ad415f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.750+0000 7f0adc57c640 1 --2- 172.21.15.114:0/3355470023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ad40c9af0 0x7f0ad4070ff0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.750+0000 7f0adc57c640 1 --2- 172.21.15.114:0/3355470023 >> v2:172.21.15.141:3300/0 conn(0x7f0ad415e1c0 0x7f0ad406b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.750+0000 7f0adc57c640 1 -- 172.21.15.114:0/3355470023 >> 172.21.15.114:0/3355470023 conn(0x7f0ad40cbc90 msgr2=0x7f0ad40cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:20.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.750+0000 7f0adc57c640 1 -- 172.21.15.114:0/3355470023 shutdown_connections 2023-11-04T01:38:20.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.750+0000 7f0adc57c640 1 -- 172.21.15.114:0/3355470023 wait complete. 2023-11-04T01:38:20.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.751+0000 7f0adc57c640 1 Processor -- start 2023-11-04T01:38:20.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.751+0000 7f0adc57c640 1 -- start start 2023-11-04T01:38:20.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.752+0000 7f0adc57c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ad40c9af0 0x7f0ad41f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.752+0000 7f0adc57c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ad415e1c0 0x7f0ad40c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.752+0000 7f0adc57c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ad415e5a0 0x7f0ad415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.752+0000 7f0adc57c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad40c3d10 con 0x7f0ad415e5a0 2023-11-04T01:38:20.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.752+0000 7f0adc57c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad415d1c0 con 0x7f0ad415e1c0 2023-11-04T01:38:20.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.752+0000 7f0adc57c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad40c3190 con 0x7f0ad40c9af0 2023-11-04T01:38:20.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.752+0000 7f0adab19640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ad415e5a0 0x7f0ad415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.752+0000 7f0adab19640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ad415e5a0 0x7f0ad415afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59776/0 (socket says 172.21.15.114:59776) 2023-11-04T01:38:20.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.752+0000 7f0adab19640 1 -- 172.21.15.114:0/2160894061 learned_addr learned my addr 172.21.15.114:0/2160894061 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:20.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.752+0000 7f0ad9b17640 1 --2- 172.21.15.114:0/2160894061 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ad415e1c0 0x7f0ad40c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.752+0000 7f0ada318640 1 --2- 172.21.15.114:0/2160894061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ad40c9af0 0x7f0ad41f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.752+0000 7f0adab19640 1 -- 172.21.15.114:0/2160894061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ad40c9af0 msgr2=0x7f0ad41f0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.752+0000 7f0adab19640 1 --2- 172.21.15.114:0/2160894061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ad40c9af0 0x7f0ad41f0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.752+0000 7f0adab19640 1 -- 172.21.15.114:0/2160894061 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ad415e1c0 msgr2=0x7f0ad40c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:20.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.752+0000 7f0adab19640 1 --2- 172.21.15.114:0/2160894061 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ad415e1c0 0x7f0ad40c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:20.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.752+0000 7f0adab19640 1 -- 172.21.15.114:0/2160894061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc0094d0 con 0x7f0ad415e5a0 2023-11-04T01:38:20.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.753+0000 7f0adab19640 1 --2- 172.21.15.114:0/2160894061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ad415e5a0 0x7f0ad415afa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0090b0 tx=0x7f0acc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.753+0000 7f0acaffd640 1 -- 172.21.15.114:0/2160894061 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc032900 con 0x7f0ad415e5a0 2023-11-04T01:38:20.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.753+0000 7f0acaffd640 1 -- 172.21.15.114:0/2160894061 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc032a80 con 0x7f0ad415e5a0 2023-11-04T01:38:20.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.753+0000 7f0adc57c640 1 -- 172.21.15.114:0/2160894061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad40c3470 con 0x7f0ad415e5a0 2023-11-04T01:38:20.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.753+0000 7f0acaffd640 1 -- 172.21.15.114:0/2160894061 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc032e30 con 0x7f0ad415e5a0 2023-11-04T01:38:20.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.753+0000 7f0adc57c640 1 -- 172.21.15.114:0/2160894061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad40c3a30 con 0x7f0ad415e5a0 2023-11-04T01:38:20.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.754+0000 7f0adc57c640 1 -- 172.21.15.114:0/2160894061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad4074290 con 0x7f0ad415e5a0 2023-11-04T01:38:20.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.754+0000 7f0acaffd640 1 -- 172.21.15.114:0/2160894061 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0acc04d3f0 con 0x7f0ad415e5a0 2023-11-04T01:38:20.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.755+0000 7f0acaffd640 1 --2- 172.21.15.114:0/2160894061 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ab806ae70 0x7f0ab806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:20.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.755+0000 7f0ada318640 1 --2- 172.21.15.114:0/2160894061 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ab806ae70 0x7f0ab806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:20.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.755+0000 7f0acaffd640 1 -- 172.21.15.114:0/2160894061 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0acc0ab720 con 0x7f0ad415e5a0 2023-11-04T01:38:20.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.755+0000 7f0ada318640 1 --2- 172.21.15.114:0/2160894061 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ab806ae70 0x7f0ab806d330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0007fd0 tx=0x7f0ad0007560 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:20.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.759+0000 7f0acaffd640 1 -- 172.21.15.114:0/2160894061 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0acc076670 con 0x7f0ad415e5a0 2023-11-04T01:38:20.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:20.960+0000 7f0adc57c640 1 -- 172.21.15.114:0/2160894061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0ad40c4820 con 0x7f0ad415e5a0 2023-11-04T01:38:21.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.562+0000 7f0acaffd640 1 -- 172.21.15.114:0/2160894061 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0acc079c90 con 0x7f0ad415e5a0 2023-11-04T01:38:21.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.564+0000 7f0adc57c640 1 -- 172.21.15.114:0/2160894061 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ab806ae70 msgr2=0x7f0ab806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.564+0000 7f0adc57c640 1 --2- 172.21.15.114:0/2160894061 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ab806ae70 0x7f0ab806d330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0007fd0 tx=0x7f0ad0007560 comp rx=0 tx=0).stop 2023-11-04T01:38:21.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.564+0000 7f0adc57c640 1 -- 172.21.15.114:0/2160894061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ad415e5a0 msgr2=0x7f0ad415afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.564+0000 7f0adc57c640 1 --2- 172.21.15.114:0/2160894061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ad415e5a0 0x7f0ad415afa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0090b0 tx=0x7f0acc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.564+0000 7f0adc57c640 1 -- 172.21.15.114:0/2160894061 shutdown_connections 2023-11-04T01:38:21.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.564+0000 7f0adc57c640 1 --2- 172.21.15.114:0/2160894061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ad415e5a0 0x7f0ad415afa0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.564+0000 7f0adc57c640 1 --2- 172.21.15.114:0/2160894061 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ab806ae70 0x7f0ab806d330 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.564+0000 7f0adc57c640 1 --2- 172.21.15.114:0/2160894061 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0ad415e1c0 0x7f0ad40c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.564+0000 7f0adc57c640 1 --2- 172.21.15.114:0/2160894061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0ad40c9af0 0x7f0ad41f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.564+0000 7f0adc57c640 1 -- 172.21.15.114:0/2160894061 >> 172.21.15.114:0/2160894061 conn(0x7f0ad40cbc90 msgr2=0x7f0ad40cc070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:21.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.564+0000 7f0adc57c640 1 -- 172.21.15.114:0/2160894061 shutdown_connections 2023-11-04T01:38:21.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.564+0000 7f0adc57c640 1 -- 172.21.15.114:0/2160894061 wait complete. 2023-11-04T01:38:21.578 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:38:21.579 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:38:21.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.682+0000 7f24db59e640 1 Processor -- start 2023-11-04T01:38:21.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.682+0000 7f24db59e640 1 -- start start 2023-11-04T01:38:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.683+0000 7f24db59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f24dc15a990 0x7f24dc06aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.683+0000 7f24db59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24dc06b6b0 con 0x7f24dc0cb2e0 2023-11-04T01:38:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.683+0000 7f24db59e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24dc06b990 con 0x7f24dc0b2a00 2023-11-04T01:38:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.683+0000 7f24db59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24dc06b4d0 con 0x7f24dc15a990 2023-11-04T01:38:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.684+0000 7f24da59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f24dc15a990 0x7f24dc06aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.684+0000 7f24da59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f24dc15a990 0x7f24dc06aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59790/0 (socket says 172.21.15.114:59790) 2023-11-04T01:38:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.684+0000 7f24d9d9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f24dc0cb2e0 0x7f24dc15dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58462/0 (socket says 172.21.15.114:58462) 2023-11-04T01:38:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.684+0000 7f24da59c640 1 -- 172.21.15.114:0/2128029803 learned_addr learned my addr 172.21.15.114:0/2128029803 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.684+0000 7f24da59c640 1 -- 172.21.15.114:0/2128029803 >> v1:172.21.15.141:6789/0 conn(0x7f24dc0b2a00 legacy=0x7f24dc06e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.684+0000 7f24da59c640 1 -- 172.21.15.114:0/2128029803 >> v1:172.21.15.114:6789/0 conn(0x7f24dc0cb2e0 legacy=0x7f24dc15dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.684+0000 7f24da59c640 1 -- 172.21.15.114:0/2128029803 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24dc06a1c0 con 0x7f24dc15a990 2023-11-04T01:38:21.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.684+0000 7f24d959a640 1 -- 172.21.15.114:0/2128029803 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2068407735 0 0) 0x7f24dc06b6b0 con 0x7f24dc0cb2e0 2023-11-04T01:38:21.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.685+0000 7f24da59c640 1 --2- 172.21.15.114:0/2128029803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc15a990 0x7f24dc06aca0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009870 tx=0x7f24cc02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb50d59a02ae59d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:21.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.685+0000 7f24d959a640 1 -- 172.21.15.114:0/2128029803 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc02f840 con 0x7f24dc15a990 2023-11-04T01:38:21.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.685+0000 7f24d959a640 1 -- 172.21.15.114:0/2128029803 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24cc02f9a0 con 0x7f24dc15a990 2023-11-04T01:38:21.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.685+0000 7f24d959a640 1 -- 172.21.15.114:0/2128029803 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc02fd30 con 0x7f24dc15a990 2023-11-04T01:38:21.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.685+0000 7f24db59e640 1 -- 172.21.15.114:0/2128029803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc15a990 msgr2=0x7f24dc06aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.685+0000 7f24db59e640 1 --2- 172.21.15.114:0/2128029803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc15a990 0x7f24dc06aca0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009870 tx=0x7f24cc02ba20 comp rx=0 tx=0).stop 2023-11-04T01:38:21.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.685+0000 7f24db59e640 1 -- 172.21.15.114:0/2128029803 shutdown_connections 2023-11-04T01:38:21.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.685+0000 7f24db59e640 1 --2- 172.21.15.114:0/2128029803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc15a990 0x7f24dc06aca0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.685+0000 7f24db59e640 1 -- 172.21.15.114:0/2128029803 >> 172.21.15.114:0/2128029803 conn(0x7f24dc0cf050 msgr2=0x7f24dc0cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:21.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.685+0000 7f24db59e640 1 -- 172.21.15.114:0/2128029803 shutdown_connections 2023-11-04T01:38:21.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.685+0000 7f24db59e640 1 -- 172.21.15.114:0/2128029803 wait complete. 2023-11-04T01:38:21.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.687+0000 7f24db59e640 1 Processor -- start 2023-11-04T01:38:21.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.687+0000 7f24db59e640 1 -- start start 2023-11-04T01:38:21.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.687+0000 7f24db59e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24dc0b2a00 0x7f24dc145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.687+0000 7f24db59e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24dc0cb2e0 0x7f24dc0cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.687+0000 7f24db59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc15a990 0x7f24dc0acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.687+0000 7f24db59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc146020 con 0x7f24dc15a990 2023-11-04T01:38:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.687+0000 7f24db59e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc0cc520 con 0x7f24dc0cb2e0 2023-11-04T01:38:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24db59e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc0cc800 con 0x7f24dc0b2a00 2023-11-04T01:38:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24dad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc15a990 0x7f24dc0acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24dad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc15a990 0x7f24dc0acf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59798/0 (socket says 172.21.15.114:59798) 2023-11-04T01:38:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24dad9d640 1 -- 172.21.15.114:0/4182010362 learned_addr learned my addr 172.21.15.114:0/4182010362 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24da59c640 1 --2- 172.21.15.114:0/4182010362 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24dc0b2a00 0x7f24dc145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24d9d9b640 1 --2- 172.21.15.114:0/4182010362 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24dc0cb2e0 0x7f24dc0cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24dad9d640 1 -- 172.21.15.114:0/4182010362 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24dc0b2a00 msgr2=0x7f24dc145ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24dad9d640 1 --2- 172.21.15.114:0/4182010362 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24dc0b2a00 0x7f24dc145ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24dad9d640 1 -- 172.21.15.114:0/4182010362 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24dc0cb2e0 msgr2=0x7f24dc0cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:21.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24dad9d640 1 --2- 172.21.15.114:0/4182010362 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24dc0cb2e0 0x7f24dc0cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:21.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24dad9d640 1 -- 172.21.15.114:0/4182010362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc0094d0 con 0x7f24dc15a990 2023-11-04T01:38:21.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24d9d9b640 1 --2- 172.21.15.114:0/4182010362 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24dc0cb2e0 0x7f24dc0cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:21.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24dad9d640 1 --2- 172.21.15.114:0/4182010362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc15a990 0x7f24dc0acf20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f24d400c7a0 tx=0x7f24d400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:21.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24caffd640 1 -- 172.21.15.114:0/4182010362 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d4003b70 con 0x7f24dc15a990 2023-11-04T01:38:21.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24caffd640 1 -- 172.21.15.114:0/4182010362 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d4003cf0 con 0x7f24dc15a990 2023-11-04T01:38:21.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24caffd640 1 -- 172.21.15.114:0/4182010362 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d4003ea0 con 0x7f24dc15a990 2023-11-04T01:38:21.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24db59e640 1 -- 172.21.15.114:0/4182010362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24dc0ccae0 con 0x7f24dc15a990 2023-11-04T01:38:21.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.688+0000 7f24db59e640 1 -- 172.21.15.114:0/4182010362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24dc0cd0a0 con 0x7f24dc15a990 2023-11-04T01:38:21.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.689+0000 7f24db59e640 1 -- 172.21.15.114:0/4182010362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24dc0ae550 con 0x7f24dc15a990 2023-11-04T01:38:21.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.690+0000 7f24caffd640 1 -- 172.21.15.114:0/4182010362 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f24d400aa90 con 0x7f24dc15a990 2023-11-04T01:38:21.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.690+0000 7f24caffd640 1 --2- 172.21.15.114:0/4182010362 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24bc06aea0 0x7f24bc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:21.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.690+0000 7f24caffd640 1 -- 172.21.15.114:0/4182010362 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f24d40896c0 con 0x7f24dc15a990 2023-11-04T01:38:21.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.690+0000 7f24da59c640 1 --2- 172.21.15.114:0/4182010362 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24bc06aea0 0x7f24bc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:21.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.691+0000 7f24da59c640 1 --2- 172.21.15.114:0/4182010362 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24bc06aea0 0x7f24bc06d360 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f24cc036000 tx=0x7f24cc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:21.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.694+0000 7f24caffd640 1 -- 172.21.15.114:0/4182010362 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f24d40544e0 con 0x7f24dc15a990 2023-11-04T01:38:21.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:21.894+0000 7f24db59e640 1 -- 172.21.15.114:0/4182010362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f24dc04ece0 con 0x7f24dc15a990 2023-11-04T01:38:22.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.566+0000 7f24caffd640 1 -- 172.21.15.114:0/4182010362 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7f24d4057b00 con 0x7f24dc15a990 2023-11-04T01:38:22.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.569+0000 7f24db59e640 1 -- 172.21.15.114:0/4182010362 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24bc06aea0 msgr2=0x7f24bc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.569+0000 7f24db59e640 1 --2- 172.21.15.114:0/4182010362 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24bc06aea0 0x7f24bc06d360 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f24cc036000 tx=0x7f24cc008030 comp rx=0 tx=0).stop 2023-11-04T01:38:22.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.569+0000 7f24db59e640 1 -- 172.21.15.114:0/4182010362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc15a990 msgr2=0x7f24dc0acf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.569+0000 7f24db59e640 1 --2- 172.21.15.114:0/4182010362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc15a990 0x7f24dc0acf20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f24d400c7a0 tx=0x7f24d400cc60 comp rx=0 tx=0).stop 2023-11-04T01:38:22.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.569+0000 7f24db59e640 1 -- 172.21.15.114:0/4182010362 shutdown_connections 2023-11-04T01:38:22.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.569+0000 7f24db59e640 1 --2- 172.21.15.114:0/4182010362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc15a990 0x7f24dc0acf20 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.569+0000 7f24db59e640 1 --2- 172.21.15.114:0/4182010362 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24bc06aea0 0x7f24bc06d360 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.569+0000 7f24db59e640 1 --2- 172.21.15.114:0/4182010362 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24dc0cb2e0 0x7f24dc0cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.569+0000 7f24db59e640 1 --2- 172.21.15.114:0/4182010362 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24dc0b2a00 0x7f24dc145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.569+0000 7f24db59e640 1 -- 172.21.15.114:0/4182010362 >> 172.21.15.114:0/4182010362 conn(0x7f24dc0cf050 msgr2=0x7f24dc15b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:22.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.569+0000 7f24db59e640 1 -- 172.21.15.114:0/4182010362 shutdown_connections 2023-11-04T01:38:22.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.569+0000 7f24db59e640 1 -- 172.21.15.114:0/4182010362 wait complete. 2023-11-04T01:38:22.583 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:38:22.583 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:22.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.685+0000 7f4f6a86f640 1 Processor -- start 2023-11-04T01:38:22.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.685+0000 7f4f6a86f640 1 -- start start 2023-11-04T01:38:22.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.686+0000 7f4f6a86f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f6415ab70 0x7f4f640cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.686+0000 7f4f6a86f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6406d310 con 0x7f4f6406eba0 2023-11-04T01:38:22.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.686+0000 7f4f6a86f640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6415d860 con 0x7f4f6406a830 2023-11-04T01:38:22.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.686+0000 7f4f6a86f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f640cba70 con 0x7f4f6415ab70 2023-11-04T01:38:22.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.686+0000 7f4f63fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f6415ab70 0x7f4f640cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.686+0000 7f4f637fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4f6406eba0 0x7f4f6406a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58468/0 (socket says 172.21.15.114:58468) 2023-11-04T01:38:22.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.686+0000 7f4f637fe640 1 -- 172.21.15.114:0/751783646 learned_addr learned my addr 172.21.15.114:0/751783646 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:22.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.686+0000 7f4f63fff640 1 -- 172.21.15.114:0/751783646 >> v1:172.21.15.141:6789/0 conn(0x7f4f6406a830 legacy=0x7f4f640ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:22.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.686+0000 7f4f63fff640 1 -- 172.21.15.114:0/751783646 >> v1:172.21.15.114:6789/0 conn(0x7f4f6406eba0 legacy=0x7f4f6406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.686+0000 7f4f62ffd640 1 -- 172.21.15.114:0/751783646 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961886609 0 0) 0x7f4f6406d310 con 0x7f4f6406eba0 2023-11-04T01:38:22.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.686+0000 7f4f63fff640 1 -- 172.21.15.114:0/751783646 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6415db40 con 0x7f4f6415ab70 2023-11-04T01:38:22.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.687+0000 7f4f63fff640 1 --2- 172.21.15.114:0/751783646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f6415ab70 0x7f4f640cbea0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009790 tx=0x7f4f5802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da45c4674baf2ccd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:22.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.687+0000 7f4f62ffd640 1 -- 172.21.15.114:0/751783646 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5802e070 con 0x7f4f6415ab70 2023-11-04T01:38:22.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.687+0000 7f4f62ffd640 1 -- 172.21.15.114:0/751783646 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f580315a0 con 0x7f4f6415ab70 2023-11-04T01:38:22.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.687+0000 7f4f62ffd640 1 -- 172.21.15.114:0/751783646 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f58031930 con 0x7f4f6415ab70 2023-11-04T01:38:22.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.687+0000 7f4f6a86f640 1 -- 172.21.15.114:0/751783646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f6415ab70 msgr2=0x7f4f640cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.687+0000 7f4f6a86f640 1 --2- 172.21.15.114:0/751783646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f6415ab70 0x7f4f640cbea0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009790 tx=0x7f4f5802b840 comp rx=0 tx=0).stop 2023-11-04T01:38:22.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.688+0000 7f4f6a86f640 1 -- 172.21.15.114:0/751783646 shutdown_connections 2023-11-04T01:38:22.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.688+0000 7f4f6a86f640 1 --2- 172.21.15.114:0/751783646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f6415ab70 0x7f4f640cbea0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.688+0000 7f4f6a86f640 1 -- 172.21.15.114:0/751783646 >> 172.21.15.114:0/751783646 conn(0x7f4f64098d40 msgr2=0x7f4f640cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:22.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.688+0000 7f4f6a86f640 1 -- 172.21.15.114:0/751783646 shutdown_connections 2023-11-04T01:38:22.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.688+0000 7f4f6a86f640 1 -- 172.21.15.114:0/751783646 wait complete. 2023-11-04T01:38:22.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.689+0000 7f4f6a86f640 1 Processor -- start 2023-11-04T01:38:22.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.689+0000 7f4f6a86f640 1 -- start start 2023-11-04T01:38:22.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f6a86f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f6406a830 0x7f4f640b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f6a86f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f6406eba0 0x7f4f6415bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f6a86f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f6415ab70 0x7f4f641576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f6a86f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f64161c50 con 0x7f4f6406a830 2023-11-04T01:38:22.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f6a86f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640b55d0 con 0x7f4f6406eba0 2023-11-04T01:38:22.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f6a86f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6415c1d0 con 0x7f4f6415ab70 2023-11-04T01:38:22.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f63fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f6406a830 0x7f4f640b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f63fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f6406a830 0x7f4f640b4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59812/0 (socket says 172.21.15.114:59812) 2023-11-04T01:38:22.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f63fff640 1 -- 172.21.15.114:0/471500708 learned_addr learned my addr 172.21.15.114:0/471500708 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:22.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f637fe640 1 --2- 172.21.15.114:0/471500708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f6406eba0 0x7f4f6415bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f68e0c640 1 --2- 172.21.15.114:0/471500708 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f6415ab70 0x7f4f641576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f63fff640 1 -- 172.21.15.114:0/471500708 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f6415ab70 msgr2=0x7f4f641576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f63fff640 1 --2- 172.21.15.114:0/471500708 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f6415ab70 0x7f4f641576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f63fff640 1 -- 172.21.15.114:0/471500708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f6406eba0 msgr2=0x7f4f6415bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f63fff640 1 --2- 172.21.15.114:0/471500708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f6406eba0 0x7f4f6415bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f63fff640 1 -- 172.21.15.114:0/471500708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f580093a0 con 0x7f4f6406a830 2023-11-04T01:38:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f63fff640 1 --2- 172.21.15.114:0/471500708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f6406a830 0x7f4f640b4370 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4f58034040 tx=0x7f4f580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f60ff9640 1 -- 172.21.15.114:0/471500708 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f58005da0 con 0x7f4f6406a830 2023-11-04T01:38:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f60ff9640 1 -- 172.21.15.114:0/471500708 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f58006030 con 0x7f4f6406a830 2023-11-04T01:38:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f6a86f640 1 -- 172.21.15.114:0/471500708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f640b49c0 con 0x7f4f6406a830 2023-11-04T01:38:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f60ff9640 1 -- 172.21.15.114:0/471500708 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f580063e0 con 0x7f4f6406a830 2023-11-04T01:38:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.690+0000 7f4f6a86f640 1 -- 172.21.15.114:0/471500708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f640b4f80 con 0x7f4f6406a830 2023-11-04T01:38:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.691+0000 7f4f6a86f640 1 -- 172.21.15.114:0/471500708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f64074290 con 0x7f4f6406a830 2023-11-04T01:38:22.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.692+0000 7f4f60ff9640 1 -- 172.21.15.114:0/471500708 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f58006540 con 0x7f4f6406a830 2023-11-04T01:38:22.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.692+0000 7f4f60ff9640 1 --2- 172.21.15.114:0/471500708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f5006ae70 0x7f4f5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:22.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.692+0000 7f4f60ff9640 1 -- 172.21.15.114:0/471500708 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4f580ab950 con 0x7f4f6406a830 2023-11-04T01:38:22.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.692+0000 7f4f637fe640 1 --2- 172.21.15.114:0/471500708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f5006ae70 0x7f4f5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:22.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.693+0000 7f4f637fe640 1 --2- 172.21.15.114:0/471500708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f5006ae70 0x7f4f5006d330 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4f54001360 tx=0x7f4f54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:22.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.696+0000 7f4f60ff9640 1 -- 172.21.15.114:0/471500708 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f580766e0 con 0x7f4f6406a830 2023-11-04T01:38:22.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.899+0000 7f4f6a86f640 1 -- 172.21.15.114:0/471500708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f6406ae70 con 0x7f4f6406a830 2023-11-04T01:38:22.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.900+0000 7f4f60ff9640 1 -- 172.21.15.114:0/471500708 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f4f5804b090 con 0x7f4f6406a830 2023-11-04T01:38:22.902 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:22.902 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1567359819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1567359819},{"type":"v1","addr":"172.21.15.141:6834","nonce":1567359819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/1960196694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":1960196694},{"type":"v1","addr":"172.21.15.141:6835","nonce":1960196694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2773454420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2773454420},{"type":"v1","addr":"172.21.15.114:6836","nonce":2773454420}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:19.359102+0000","modified":"2023-11-04T01:38:21.895586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6039":{"gid":6039,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2391405125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2391405125},{"type":"v1","addr":"172.21.15.114:6837","nonce":2391405125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:38:22.902 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 23 2023-11-04T01:38:22.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.902+0000 7f4f6a86f640 1 -- 172.21.15.114:0/471500708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f5006ae70 msgr2=0x7f4f5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.902+0000 7f4f6a86f640 1 --2- 172.21.15.114:0/471500708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f5006ae70 0x7f4f5006d330 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4f54001360 tx=0x7f4f54009040 comp rx=0 tx=0).stop 2023-11-04T01:38:22.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.902+0000 7f4f6a86f640 1 -- 172.21.15.114:0/471500708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f6406a830 msgr2=0x7f4f640b4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:22.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.902+0000 7f4f6a86f640 1 --2- 172.21.15.114:0/471500708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f6406a830 0x7f4f640b4370 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4f58034040 tx=0x7f4f580046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.902+0000 7f4f6a86f640 1 -- 172.21.15.114:0/471500708 shutdown_connections 2023-11-04T01:38:22.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.902+0000 7f4f6a86f640 1 --2- 172.21.15.114:0/471500708 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4f6415ab70 0x7f4f641576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.902+0000 7f4f6a86f640 1 --2- 172.21.15.114:0/471500708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4f5006ae70 0x7f4f5006d330 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.902+0000 7f4f6a86f640 1 --2- 172.21.15.114:0/471500708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4f6406eba0 0x7f4f6415bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.902+0000 7f4f6a86f640 1 --2- 172.21.15.114:0/471500708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f6406a830 0x7f4f640b4370 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:22.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.902+0000 7f4f6a86f640 1 -- 172.21.15.114:0/471500708 >> 172.21.15.114:0/471500708 conn(0x7f4f64098d40 msgr2=0x7f4f640cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:22.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.902+0000 7f4f6a86f640 1 -- 172.21.15.114:0/471500708 shutdown_connections 2023-11-04T01:38:22.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:22.902+0000 7f4f6a86f640 1 -- 172.21.15.114:0/471500708 wait complete. 2023-11-04T01:38:22.914 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:23.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.012+0000 7f66ad8db640 1 Processor -- start 2023-11-04T01:38:23.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.012+0000 7f66ad8db640 1 -- start start 2023-11-04T01:38:23.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.013+0000 7f66ad8db640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f66a80ce240 0x7f66a8157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.013+0000 7f66ad8db640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f66a8157540 0x7f66a80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.013+0000 7f66ad8db640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a815e000 con 0x7f66a80cde60 2023-11-04T01:38:23.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.013+0000 7f66ad8db640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a815e5c0 con 0x7f66a80ce240 2023-11-04T01:38:23.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.013+0000 7f66ad8db640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a815e2e0 con 0x7f66a8157540 2023-11-04T01:38:23.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.013+0000 7f66a67fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f66a80ce240 0x7f66a8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.013+0000 7f66a67fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f66a80ce240 0x7f66a8157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59822/0 (socket says 172.21.15.114:59822) 2023-11-04T01:38:23.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.013+0000 7f66a6ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f66a80cde60 0x7f66a815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58478/0 (socket says 172.21.15.114:58478) 2023-11-04T01:38:23.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.013+0000 7f66a67fc640 1 -- 172.21.15.114:0/3712849722 learned_addr learned my addr 172.21.15.114:0/3712849722 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:23.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.013+0000 7f66a77fe640 1 --2- 172.21.15.114:0/3712849722 >> v2:172.21.15.141:3300/0 conn(0x7f66a8157540 0x7f66a80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.013+0000 7f66a67fc640 1 -- 172.21.15.114:0/3712849722 >> v2:172.21.15.141:3300/0 conn(0x7f66a8157540 msgr2=0x7f66a80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:23.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.013+0000 7f66a67fc640 1 --2- 172.21.15.114:0/3712849722 >> v2:172.21.15.141:3300/0 conn(0x7f66a8157540 0x7f66a80d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.013+0000 7f66a67fc640 1 -- 172.21.15.114:0/3712849722 >> v1:172.21.15.114:6789/0 conn(0x7f66a80cde60 legacy=0x7f66a815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.013+0000 7f66a67fc640 1 -- 172.21.15.114:0/3712849722 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a80d1120 con 0x7f66a80ce240 2023-11-04T01:38:23.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.013+0000 7f66a5ffb640 1 -- 172.21.15.114:0/3712849722 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842366992 0 0) 0x7f66a815e000 con 0x7f66a80cde60 2023-11-04T01:38:23.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.013+0000 7f66a77fe640 1 --2- 172.21.15.114:0/3712849722 >> v2:172.21.15.141:3300/0 conn(0x7f66a8157540 0x7f66a80d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:23.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.014+0000 7f66a67fc640 1 --2- 172.21.15.114:0/3712849722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66a80ce240 0x7f66a8157000 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f66a80cf2e0 tx=0x7f669c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5baf6dcfc5e892c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.014+0000 7f66a5ffb640 1 -- 172.21.15.114:0/3712849722 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c030860 con 0x7f66a80ce240 2023-11-04T01:38:23.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.014+0000 7f66a5ffb640 1 -- 172.21.15.114:0/3712849722 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c0309c0 con 0x7f66a80ce240 2023-11-04T01:38:23.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.014+0000 7f66a5ffb640 1 -- 172.21.15.114:0/3712849722 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c030d50 con 0x7f66a80ce240 2023-11-04T01:38:23.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.014+0000 7f66ad8db640 1 -- 172.21.15.114:0/3712849722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66a80ce240 msgr2=0x7f66a8157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.014+0000 7f66ad8db640 1 --2- 172.21.15.114:0/3712849722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66a80ce240 0x7f66a8157000 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f66a80cf2e0 tx=0x7f669c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.015+0000 7f66ad8db640 1 -- 172.21.15.114:0/3712849722 shutdown_connections 2023-11-04T01:38:23.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.015+0000 7f66ad8db640 1 --2- 172.21.15.114:0/3712849722 >> v2:172.21.15.141:3300/0 conn(0x7f66a8157540 0x7f66a80d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.015+0000 7f66ad8db640 1 --2- 172.21.15.114:0/3712849722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66a80ce240 0x7f66a8157000 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.015+0000 7f66ad8db640 1 -- 172.21.15.114:0/3712849722 >> 172.21.15.114:0/3712849722 conn(0x7f66a8071f30 msgr2=0x7f66a80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.015+0000 7f66ad8db640 1 -- 172.21.15.114:0/3712849722 shutdown_connections 2023-11-04T01:38:23.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.015+0000 7f66ad8db640 1 -- 172.21.15.114:0/3712849722 wait complete. 2023-11-04T01:38:23.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.016+0000 7f66ad8db640 1 Processor -- start 2023-11-04T01:38:23.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.016+0000 7f66ad8db640 1 -- start start 2023-11-04T01:38:23.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66ad8db640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66a80cde60 0x7f66a814a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66ad8db640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66a80ce240 0x7f66a81f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66ad8db640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66a8157540 0x7f66a8158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66ad8db640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8148dd0 con 0x7f66a80cde60 2023-11-04T01:38:23.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66ad8db640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a814ae70 con 0x7f66a8157540 2023-11-04T01:38:23.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66ad8db640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a81f2210 con 0x7f66a80ce240 2023-11-04T01:38:23.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66a6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66a80cde60 0x7f66a814a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66a6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66a80cde60 0x7f66a814a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59826/0 (socket says 172.21.15.114:59826) 2023-11-04T01:38:23.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66a6ffd640 1 -- 172.21.15.114:0/3689760844 learned_addr learned my addr 172.21.15.114:0/3689760844 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:23.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66a77fe640 1 --2- 172.21.15.114:0/3689760844 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66a8157540 0x7f66a8158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66a6ffd640 1 -- 172.21.15.114:0/3689760844 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66a80ce240 msgr2=0x7f66a81f1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66a67fc640 1 --2- 172.21.15.114:0/3689760844 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66a80ce240 0x7f66a81f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66a6ffd640 1 --2- 172.21.15.114:0/3689760844 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66a80ce240 0x7f66a81f1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66a6ffd640 1 -- 172.21.15.114:0/3689760844 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66a8157540 msgr2=0x7f66a8158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66a6ffd640 1 --2- 172.21.15.114:0/3689760844 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66a8157540 0x7f66a8158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66a6ffd640 1 -- 172.21.15.114:0/3689760844 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c0094d0 con 0x7f66a80cde60 2023-11-04T01:38:23.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66a77fe640 1 --2- 172.21.15.114:0/3689760844 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66a8157540 0x7f66a8158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:23.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66a67fc640 1 --2- 172.21.15.114:0/3689760844 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66a80ce240 0x7f66a81f1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:23.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66a6ffd640 1 --2- 172.21.15.114:0/3689760844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66a80cde60 0x7f66a814a930 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f669800c500 tx=0x7f669800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f668ffff640 1 -- 172.21.15.114:0/3689760844 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698007560 con 0x7f66a80cde60 2023-11-04T01:38:23.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f668ffff640 1 -- 172.21.15.114:0/3689760844 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66980047e0 con 0x7f66a80cde60 2023-11-04T01:38:23.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66ad8db640 1 -- 172.21.15.114:0/3689760844 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a81481c0 con 0x7f66a80cde60 2023-11-04T01:38:23.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f668ffff640 1 -- 172.21.15.114:0/3689760844 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698004b90 con 0x7f66a80cde60 2023-11-04T01:38:23.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.017+0000 7f66ad8db640 1 -- 172.21.15.114:0/3689760844 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a8148780 con 0x7f66a80cde60 2023-11-04T01:38:23.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.018+0000 7f66ad8db640 1 -- 172.21.15.114:0/3689760844 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a81579b0 con 0x7f66a80cde60 2023-11-04T01:38:23.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.019+0000 7f668ffff640 1 -- 172.21.15.114:0/3689760844 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6698004cf0 con 0x7f66a80cde60 2023-11-04T01:38:23.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.019+0000 7f668ffff640 1 --2- 172.21.15.114:0/3689760844 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f669406aea0 0x7f669406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.019+0000 7f668ffff640 1 -- 172.21.15.114:0/3689760844 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6698088d00 con 0x7f66a80cde60 2023-11-04T01:38:23.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.019+0000 7f66a67fc640 1 --2- 172.21.15.114:0/3689760844 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f669406aea0 0x7f669406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.020+0000 7f66a67fc640 1 --2- 172.21.15.114:0/3689760844 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f669406aea0 0x7f669406d360 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f669c036000 tx=0x7f669c03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.023+0000 7f668ffff640 1 -- 172.21.15.114:0/3689760844 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6698053ba0 con 0x7f66a80cde60 2023-11-04T01:38:23.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.192+0000 7f66ad8db640 1 -- 172.21.15.114:0/3689760844 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66a8074290 con 0x7f66a80cde60 2023-11-04T01:38:23.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.193+0000 7f668ffff640 1 -- 172.21.15.114:0/3689760844 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18583 (secure 0 0 0) 0x7f6698018020 con 0x7f66a80cde60 2023-11-04T01:38:23.195 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:23.195 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":54,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:21.029391+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:17.859902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:18.334035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:23.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.195+0000 7f66ad8db640 1 -- 172.21.15.114:0/3689760844 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f669406aea0 msgr2=0x7f669406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.195+0000 7f66ad8db640 1 --2- 172.21.15.114:0/3689760844 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f669406aea0 0x7f669406d360 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f669c036000 tx=0x7f669c03b040 comp rx=0 tx=0).stop 2023-11-04T01:38:23.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.195+0000 7f66ad8db640 1 -- 172.21.15.114:0/3689760844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66a80cde60 msgr2=0x7f66a814a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.195+0000 7f66ad8db640 1 --2- 172.21.15.114:0/3689760844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66a80cde60 0x7f66a814a930 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f669800c500 tx=0x7f669800c9c0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.195+0000 7f66ad8db640 1 -- 172.21.15.114:0/3689760844 shutdown_connections 2023-11-04T01:38:23.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.195+0000 7f66ad8db640 1 --2- 172.21.15.114:0/3689760844 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f669406aea0 0x7f669406d360 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.195+0000 7f66ad8db640 1 --2- 172.21.15.114:0/3689760844 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66a8157540 0x7f66a8158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.195+0000 7f66ad8db640 1 --2- 172.21.15.114:0/3689760844 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66a80ce240 0x7f66a81f1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.195+0000 7f66ad8db640 1 --2- 172.21.15.114:0/3689760844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66a80cde60 0x7f66a814a930 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.195+0000 7f66ad8db640 1 -- 172.21.15.114:0/3689760844 >> 172.21.15.114:0/3689760844 conn(0x7f66a8071f30 msgr2=0x7f66a80b5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.195+0000 7f66ad8db640 1 -- 172.21.15.114:0/3689760844 shutdown_connections 2023-11-04T01:38:23.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.195+0000 7f66ad8db640 1 -- 172.21.15.114:0/3689760844 wait complete. 2023-11-04T01:38:23.208 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:38:23.208 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:38:23.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.305+0000 7f2b417b6640 1 Processor -- start 2023-11-04T01:38:23.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.305+0000 7f2b417b6640 1 -- start start 2023-11-04T01:38:23.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.306+0000 7f2b417b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2b3c0cde60 0x7f2b3c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.306+0000 7f2b417b6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3c15e000 con 0x7f2b3c0ce240 2023-11-04T01:38:23.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.306+0000 7f2b417b6640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3c15e2e0 con 0x7f2b3c15daa0 2023-11-04T01:38:23.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.306+0000 7f2b417b6640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b3c15e5c0 con 0x7f2b3c0cde60 2023-11-04T01:38:23.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.306+0000 7f2b3affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2b3c0cde60 0x7f2b3c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.306+0000 7f2b3b7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2b3c0ce240 0x7f2b3c0d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58490/0 (socket says 172.21.15.114:58490) 2023-11-04T01:38:23.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.306+0000 7f2b3b7fe640 1 -- 172.21.15.114:0/144419005 learned_addr learned my addr 172.21.15.114:0/144419005 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:23.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.306+0000 7f2b3affd640 1 -- 172.21.15.114:0/144419005 >> v1:172.21.15.141:6789/0 conn(0x7f2b3c15daa0 legacy=0x7f2b3c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:23.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.306+0000 7f2b3affd640 1 -- 172.21.15.114:0/144419005 >> v1:172.21.15.114:6789/0 conn(0x7f2b3c0ce240 legacy=0x7f2b3c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.306+0000 7f2b3affd640 1 -- 172.21.15.114:0/144419005 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c0d1120 con 0x7f2b3c0cde60 2023-11-04T01:38:23.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.306+0000 7f2b3a7fc640 1 -- 172.21.15.114:0/144419005 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945198274 0 0) 0x7f2b3c15e000 con 0x7f2b3c0ce240 2023-11-04T01:38:23.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.307+0000 7f2b3affd640 1 --2- 172.21.15.114:0/144419005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3c0cde60 0x7f2b3c15d560 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c0097a0 tx=0x7f2b2c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6f6f194814835 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.307+0000 7f2b3a7fc640 1 -- 172.21.15.114:0/144419005 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c031830 con 0x7f2b3c0cde60 2023-11-04T01:38:23.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.307+0000 7f2b3a7fc640 1 -- 172.21.15.114:0/144419005 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c031990 con 0x7f2b3c0cde60 2023-11-04T01:38:23.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.307+0000 7f2b3a7fc640 1 -- 172.21.15.114:0/144419005 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c031d20 con 0x7f2b3c0cde60 2023-11-04T01:38:23.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.308+0000 7f2b417b6640 1 -- 172.21.15.114:0/144419005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3c0cde60 msgr2=0x7f2b3c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.308+0000 7f2b417b6640 1 --2- 172.21.15.114:0/144419005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3c0cde60 0x7f2b3c15d560 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c0097a0 tx=0x7f2b2c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.308+0000 7f2b417b6640 1 -- 172.21.15.114:0/144419005 shutdown_connections 2023-11-04T01:38:23.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.308+0000 7f2b417b6640 1 --2- 172.21.15.114:0/144419005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3c0cde60 0x7f2b3c15d560 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.308+0000 7f2b417b6640 1 -- 172.21.15.114:0/144419005 >> 172.21.15.114:0/144419005 conn(0x7f2b3c071f30 msgr2=0x7f2b3c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.308+0000 7f2b417b6640 1 -- 172.21.15.114:0/144419005 shutdown_connections 2023-11-04T01:38:23.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.308+0000 7f2b417b6640 1 -- 172.21.15.114:0/144419005 wait complete. 2023-11-04T01:38:23.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.309+0000 7f2b417b6640 1 Processor -- start 2023-11-04T01:38:23.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.309+0000 7f2b417b6640 1 -- start start 2023-11-04T01:38:23.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b417b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b3c0cde60 0x7f2b3c1f1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b417b6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3c0ce240 0x7f2b3c147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b417b6640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b3c15daa0 0x7f2b3c0b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b417b6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c1490f0 con 0x7f2b3c0ce240 2023-11-04T01:38:23.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b417b6640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c1484e0 con 0x7f2b3c15daa0 2023-11-04T01:38:23.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b417b6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c1487c0 con 0x7f2b3c0cde60 2023-11-04T01:38:23.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b327fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3c0ce240 0x7f2b3c147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b327fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3c0ce240 0x7f2b3c147a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59852/0 (socket says 172.21.15.114:59852) 2023-11-04T01:38:23.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b327fc640 1 -- 172.21.15.114:0/532700270 learned_addr learned my addr 172.21.15.114:0/532700270 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:23.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b3affd640 1 --2- 172.21.15.114:0/532700270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b3c0cde60 0x7f2b3c1f1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b3b7fe640 1 --2- 172.21.15.114:0/532700270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b3c15daa0 0x7f2b3c0b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b327fc640 1 -- 172.21.15.114:0/532700270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b3c0cde60 msgr2=0x7f2b3c1f1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b327fc640 1 --2- 172.21.15.114:0/532700270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b3c0cde60 0x7f2b3c1f1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b327fc640 1 -- 172.21.15.114:0/532700270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b3c15daa0 msgr2=0x7f2b3c0b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b327fc640 1 --2- 172.21.15.114:0/532700270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b3c15daa0 0x7f2b3c0b7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b327fc640 1 -- 172.21.15.114:0/532700270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c009400 con 0x7f2b3c0ce240 2023-11-04T01:38:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b3b7fe640 1 --2- 172.21.15.114:0/532700270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b3c15daa0 0x7f2b3c0b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b327fc640 1 --2- 172.21.15.114:0/532700270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3c0ce240 0x7f2b3c147a20 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400b3c0 tx=0x7f2b2400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b33fff640 1 -- 172.21.15.114:0/532700270 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24011830 con 0x7f2b3c0ce240 2023-11-04T01:38:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b33fff640 1 -- 172.21.15.114:0/532700270 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b24011990 con 0x7f2b3c0ce240 2023-11-04T01:38:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.310+0000 7f2b417b6640 1 -- 172.21.15.114:0/532700270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3c148aa0 con 0x7f2b3c0ce240 2023-11-04T01:38:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.311+0000 7f2b33fff640 1 -- 172.21.15.114:0/532700270 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24011d80 con 0x7f2b3c0ce240 2023-11-04T01:38:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.311+0000 7f2b417b6640 1 -- 172.21.15.114:0/532700270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3c14dc90 con 0x7f2b3c0ce240 2023-11-04T01:38:23.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.311+0000 7f2b417b6640 1 -- 172.21.15.114:0/532700270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3c149260 con 0x7f2b3c0ce240 2023-11-04T01:38:23.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.312+0000 7f2b33fff640 1 -- 172.21.15.114:0/532700270 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b2401b460 con 0x7f2b3c0ce240 2023-11-04T01:38:23.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.312+0000 7f2b33fff640 1 --2- 172.21.15.114:0/532700270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2b1c06aea0 0x7f2b1c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.312+0000 7f2b3affd640 1 --2- 172.21.15.114:0/532700270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2b1c06aea0 0x7f2b1c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.312+0000 7f2b33fff640 1 -- 172.21.15.114:0/532700270 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2b24089490 con 0x7f2b3c0ce240 2023-11-04T01:38:23.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.313+0000 7f2b3affd640 1 --2- 172.21.15.114:0/532700270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2b1c06aea0 0x7f2b1c06d360 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c036000 tx=0x7f2b2c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.317+0000 7f2b33fff640 1 -- 172.21.15.114:0/532700270 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2b24054200 con 0x7f2b3c0ce240 2023-11-04T01:38:23.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.479+0000 7f2b417b6640 1 -- 172.21.15.114:0/532700270 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2b3c0d1400 con 0x7f2b1c06aea0 2023-11-04T01:38:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.487+0000 7f2b33fff640 1 -- 172.21.15.114:0/532700270 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355309 (secure 0 0 0) 0x7f2b2c045410 con 0x7f2b1c06aea0 2023-11-04T01:38:23.492 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:23.494 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:38:23.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.490+0000 7f2b417b6640 1 -- 172.21.15.114:0/532700270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2b1c06aea0 msgr2=0x7f2b1c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.490+0000 7f2b417b6640 1 --2- 172.21.15.114:0/532700270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2b1c06aea0 0x7f2b1c06d360 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c036000 tx=0x7f2b2c03c040 comp rx=0 tx=0).stop 2023-11-04T01:38:23.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.490+0000 7f2b417b6640 1 -- 172.21.15.114:0/532700270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3c0ce240 msgr2=0x7f2b3c147a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.490+0000 7f2b417b6640 1 --2- 172.21.15.114:0/532700270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3c0ce240 0x7f2b3c147a20 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400b3c0 tx=0x7f2b2400b880 comp rx=0 tx=0).stop 2023-11-04T01:38:23.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.490+0000 7f2b417b6640 1 -- 172.21.15.114:0/532700270 shutdown_connections 2023-11-04T01:38:23.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.490+0000 7f2b417b6640 1 --2- 172.21.15.114:0/532700270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2b1c06aea0 0x7f2b1c06d360 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.490+0000 7f2b417b6640 1 --2- 172.21.15.114:0/532700270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b3c15daa0 0x7f2b3c0b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.490+0000 7f2b417b6640 1 --2- 172.21.15.114:0/532700270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3c0ce240 0x7f2b3c147a20 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.490+0000 7f2b417b6640 1 --2- 172.21.15.114:0/532700270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b3c0cde60 0x7f2b3c1f1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.490+0000 7f2b417b6640 1 -- 172.21.15.114:0/532700270 >> 172.21.15.114:0/532700270 conn(0x7f2b3c071f30 msgr2=0x7f2b3c0c7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.490+0000 7f2b417b6640 1 -- 172.21.15.114:0/532700270 shutdown_connections 2023-11-04T01:38:23.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.490+0000 7f2b417b6640 1 -- 172.21.15.114:0/532700270 wait complete. 2023-11-04T01:38:23.503 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2023-11-04T01:38:21.881298+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221980,"kb_used_data":5800,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752740,"statfs":{"total":773094113280,"available":772866805760,"internally_reserved":0,"allocated":5939200,"data_stored":3299560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000911"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:38:14.998656+0000","last_change":"2023-11-04T01:38:02.156342+0000","last_active":"2023-11-04T01:38:14.998656+0000","last_peered":"2023-11-04T01:38:14.998656+0000","last_clean":"2023-11-04T01:38:14.998656+0000","last_became_active":"2023-11-04T01:38:00.708159+0000","last_became_peered":"2023-11-04T01:38:00.708159+0000","last_unstale":"2023-11-04T01:38:14.998656+0000","last_undegraded":"2023-11-04T01:38:14.998656+0000","last_fullsized":"2023-11-04T01:38:14.998656+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000435213,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.269219+0000","last_change":"2023-11-04T01:38:02.362289+0000","last_active":"2023-11-04T01:38:15.269219+0000","last_peered":"2023-11-04T01:38:15.269219+0000","last_clean":"2023-11-04T01:38:15.269219+0000","last_became_active":"2023-11-04T01:38:00.710033+0000","last_became_peered":"2023-11-04T01:38:00.710033+0000","last_unstale":"2023-11-04T01:38:15.269219+0000","last_undegraded":"2023-11-04T01:38:15.269219+0000","last_fullsized":"2023-11-04T01:38:15.269219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046467500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004296+0000","last_change":"2023-11-04T01:38:01.699171+0000","last_active":"2023-11-04T01:38:15.004296+0000","last_peered":"2023-11-04T01:38:15.004296+0000","last_clean":"2023-11-04T01:38:15.004296+0000","last_became_active":"2023-11-04T01:38:00.703927+0000","last_became_peered":"2023-11-04T01:38:00.703927+0000","last_unstale":"2023-11-04T01:38:15.004296+0000","last_undegraded":"2023-11-04T01:38:15.004296+0000","last_fullsized":"2023-11-04T01:38:15.004296+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072585499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:38:14.998679+0000","last_change":"2023-11-04T01:38:02.156160+0000","last_active":"2023-11-04T01:38:14.998679+0000","last_peered":"2023-11-04T01:38:14.998679+0000","last_clean":"2023-11-04T01:38:14.998679+0000","last_became_active":"2023-11-04T01:38:00.709137+0000","last_became_peered":"2023-11-04T01:38:00.709137+0000","last_unstale":"2023-11-04T01:38:14.998679+0000","last_undegraded":"2023-11-04T01:38:14.998679+0000","last_fullsized":"2023-11-04T01:38:14.998679+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028239399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004234+0000","last_change":"2023-11-04T01:38:01.698196+0000","last_active":"2023-11-04T01:38:15.004234+0000","last_peered":"2023-11-04T01:38:15.004234+0000","last_clean":"2023-11-04T01:38:15.004234+0000","last_became_active":"2023-11-04T01:38:00.705451+0000","last_became_peered":"2023-11-04T01:38:00.705451+0000","last_unstale":"2023-11-04T01:38:15.004234+0000","last_undegraded":"2023-11-04T01:38:15.004234+0000","last_fullsized":"2023-11-04T01:38:15.004234+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:16.759249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067668100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.006925+0000","last_change":"2023-11-04T01:38:01.983991+0000","last_active":"2023-11-04T01:38:15.006925+0000","last_peered":"2023-11-04T01:38:15.006925+0000","last_clean":"2023-11-04T01:38:15.006925+0000","last_became_active":"2023-11-04T01:38:00.708462+0000","last_became_peered":"2023-11-04T01:38:00.708462+0000","last_unstale":"2023-11-04T01:38:15.006925+0000","last_undegraded":"2023-11-04T01:38:15.006925+0000","last_fullsized":"2023-11-04T01:38:15.006925+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:37.727651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041811600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.007121+0000","last_change":"2023-11-04T01:38:01.984341+0000","last_active":"2023-11-04T01:38:15.007121+0000","last_peered":"2023-11-04T01:38:15.007121+0000","last_clean":"2023-11-04T01:38:15.007121+0000","last_became_active":"2023-11-04T01:38:00.708307+0000","last_became_peered":"2023-11-04T01:38:00.708307+0000","last_unstale":"2023-11-04T01:38:15.007121+0000","last_undegraded":"2023-11-04T01:38:15.007121+0000","last_fullsized":"2023-11-04T01:38:15.007121+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:17.369098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053627199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004383+0000","last_change":"2023-11-04T01:38:01.700471+0000","last_active":"2023-11-04T01:38:15.004383+0000","last_peered":"2023-11-04T01:38:15.004383+0000","last_clean":"2023-11-04T01:38:15.004383+0000","last_became_active":"2023-11-04T01:38:00.702522+0000","last_became_peered":"2023-11-04T01:38:00.702522+0000","last_unstale":"2023-11-04T01:38:15.004383+0000","last_undegraded":"2023-11-04T01:38:15.004383+0000","last_fullsized":"2023-11-04T01:38:15.004383+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086940300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665883+0000","last_change":"2023-11-04T01:38:01.696901+0000","last_active":"2023-11-04T01:38:15.665883+0000","last_peered":"2023-11-04T01:38:15.665883+0000","last_clean":"2023-11-04T01:38:15.665883+0000","last_became_active":"2023-11-04T01:38:00.706170+0000","last_became_peered":"2023-11-04T01:38:00.706170+0000","last_unstale":"2023-11-04T01:38:15.665883+0000","last_undegraded":"2023-11-04T01:38:15.665883+0000","last_fullsized":"2023-11-04T01:38:15.665883+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059391100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665582+0000","last_change":"2023-11-04T01:38:01.939972+0000","last_active":"2023-11-04T01:38:15.665582+0000","last_peered":"2023-11-04T01:38:15.665582+0000","last_clean":"2023-11-04T01:38:15.665582+0000","last_became_active":"2023-11-04T01:38:00.702784+0000","last_became_peered":"2023-11-04T01:38:00.702784+0000","last_unstale":"2023-11-04T01:38:15.665582+0000","last_undegraded":"2023-11-04T01:38:15.665582+0000","last_fullsized":"2023-11-04T01:38:15.665582+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:26.760402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071328600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665919+0000","last_change":"2023-11-04T01:38:01.699051+0000","last_active":"2023-11-04T01:38:15.665919+0000","last_peered":"2023-11-04T01:38:15.665919+0000","last_clean":"2023-11-04T01:38:15.665919+0000","last_became_active":"2023-11-04T01:38:00.708665+0000","last_became_peered":"2023-11-04T01:38:00.708665+0000","last_unstale":"2023-11-04T01:38:15.665919+0000","last_undegraded":"2023-11-04T01:38:15.665919+0000","last_fullsized":"2023-11-04T01:38:15.665919+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020995580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004154+0000","last_change":"2023-11-04T01:38:01.700742+0000","last_active":"2023-11-04T01:38:15.004154+0000","last_peered":"2023-11-04T01:38:15.004154+0000","last_clean":"2023-11-04T01:38:15.004154+0000","last_became_active":"2023-11-04T01:38:00.706671+0000","last_became_peered":"2023-11-04T01:38:00.706671+0000","last_unstale":"2023-11-04T01:38:15.004154+0000","last_undegraded":"2023-11-04T01:38:15.004154+0000","last_fullsized":"2023-11-04T01:38:15.004154+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072370699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665834+0000","last_change":"2023-11-04T01:38:01.697526+0000","last_active":"2023-11-04T01:38:15.665834+0000","last_peered":"2023-11-04T01:38:15.665834+0000","last_clean":"2023-11-04T01:38:15.665834+0000","last_became_active":"2023-11-04T01:38:00.707580+0000","last_became_peered":"2023-11-04T01:38:00.707580+0000","last_unstale":"2023-11-04T01:38:15.665834+0000","last_undegraded":"2023-11-04T01:38:15.665834+0000","last_fullsized":"2023-11-04T01:38:15.665834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010806699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665639+0000","last_change":"2023-11-04T01:38:01.939462+0000","last_active":"2023-11-04T01:38:15.665639+0000","last_peered":"2023-11-04T01:38:15.665639+0000","last_clean":"2023-11-04T01:38:15.665639+0000","last_became_active":"2023-11-04T01:38:00.705830+0000","last_became_peered":"2023-11-04T01:38:00.705830+0000","last_unstale":"2023-11-04T01:38:15.665639+0000","last_undegraded":"2023-11-04T01:38:15.665639+0000","last_fullsized":"2023-11-04T01:38:15.665639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059305000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.007130+0000","last_change":"2023-11-04T01:38:01.984456+0000","last_active":"2023-11-04T01:38:15.007130+0000","last_peered":"2023-11-04T01:38:15.007130+0000","last_clean":"2023-11-04T01:38:15.007130+0000","last_became_active":"2023-11-04T01:38:00.708803+0000","last_became_peered":"2023-11-04T01:38:00.708803+0000","last_unstale":"2023-11-04T01:38:15.007130+0000","last_undegraded":"2023-11-04T01:38:15.007130+0000","last_fullsized":"2023-11-04T01:38:15.007130+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:30.811033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061551599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004324+0000","last_change":"2023-11-04T01:38:01.698866+0000","last_active":"2023-11-04T01:38:15.004324+0000","last_peered":"2023-11-04T01:38:15.004324+0000","last_clean":"2023-11-04T01:38:15.004324+0000","last_became_active":"2023-11-04T01:38:00.706149+0000","last_became_peered":"2023-11-04T01:38:00.706149+0000","last_unstale":"2023-11-04T01:38:15.004324+0000","last_undegraded":"2023-11-04T01:38:15.004324+0000","last_fullsized":"2023-11-04T01:38:15.004324+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:59.391683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001344154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004211+0000","last_change":"2023-11-04T01:38:01.699187+0000","last_active":"2023-11-04T01:38:15.004211+0000","last_peered":"2023-11-04T01:38:15.004211+0000","last_clean":"2023-11-04T01:38:15.004211+0000","last_became_active":"2023-11-04T01:38:00.706136+0000","last_became_peered":"2023-11-04T01:38:00.706136+0000","last_unstale":"2023-11-04T01:38:15.004211+0000","last_undegraded":"2023-11-04T01:38:15.004211+0000","last_fullsized":"2023-11-04T01:38:15.004211+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074666999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004150+0000","last_change":"2023-11-04T01:38:01.699630+0000","last_active":"2023-11-04T01:38:15.004150+0000","last_peered":"2023-11-04T01:38:15.004150+0000","last_clean":"2023-11-04T01:38:15.004150+0000","last_became_active":"2023-11-04T01:38:00.702550+0000","last_became_peered":"2023-11-04T01:38:00.702550+0000","last_unstale":"2023-11-04T01:38:15.004150+0000","last_undegraded":"2023-11-04T01:38:15.004150+0000","last_fullsized":"2023-11-04T01:38:15.004150+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001016077,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.007141+0000","last_change":"2023-11-04T01:38:01.984764+0000","last_active":"2023-11-04T01:38:15.007141+0000","last_peered":"2023-11-04T01:38:15.007141+0000","last_clean":"2023-11-04T01:38:15.007141+0000","last_became_active":"2023-11-04T01:38:00.709894+0000","last_became_peered":"2023-11-04T01:38:00.709894+0000","last_unstale":"2023-11-04T01:38:15.007141+0000","last_undegraded":"2023-11-04T01:38:15.007141+0000","last_fullsized":"2023-11-04T01:38:15.007141+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:08:42.829255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045046799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665573+0000","last_change":"2023-11-04T01:38:02.321871+0000","last_active":"2023-11-04T01:38:15.665573+0000","last_peered":"2023-11-04T01:38:15.665573+0000","last_clean":"2023-11-04T01:38:15.665573+0000","last_became_active":"2023-11-04T01:38:00.708407+0000","last_became_peered":"2023-11-04T01:38:00.708407+0000","last_unstale":"2023-11-04T01:38:15.665573+0000","last_undegraded":"2023-11-04T01:38:15.665573+0000","last_fullsized":"2023-11-04T01:38:15.665573+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:48.672429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032387200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.006925+0000","last_change":"2023-11-04T01:38:01.983988+0000","last_active":"2023-11-04T01:38:15.006925+0000","last_peered":"2023-11-04T01:38:15.006925+0000","last_clean":"2023-11-04T01:38:15.006925+0000","last_became_active":"2023-11-04T01:38:00.711020+0000","last_became_peered":"2023-11-04T01:38:00.711020+0000","last_unstale":"2023-11-04T01:38:15.006925+0000","last_undegraded":"2023-11-04T01:38:15.006925+0000","last_fullsized":"2023-11-04T01:38:15.006925+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:06.374078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665510+0000","last_change":"2023-11-04T01:38:02.321641+0000","last_active":"2023-11-04T01:38:15.665510+0000","last_peered":"2023-11-04T01:38:15.665510+0000","last_clean":"2023-11-04T01:38:15.665510+0000","last_became_active":"2023-11-04T01:38:00.706199+0000","last_became_peered":"2023-11-04T01:38:00.706199+0000","last_unstale":"2023-11-04T01:38:15.665510+0000","last_undegraded":"2023-11-04T01:38:15.665510+0000","last_fullsized":"2023-11-04T01:38:15.665510+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:15.138325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045080400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:38:14.998610+0000","last_change":"2023-11-04T01:38:02.156148+0000","last_active":"2023-11-04T01:38:14.998610+0000","last_peered":"2023-11-04T01:38:14.998610+0000","last_clean":"2023-11-04T01:38:14.998610+0000","last_became_active":"2023-11-04T01:38:00.708352+0000","last_became_peered":"2023-11-04T01:38:00.708352+0000","last_unstale":"2023-11-04T01:38:14.998610+0000","last_undegraded":"2023-11-04T01:38:14.998610+0000","last_fullsized":"2023-11-04T01:38:14.998610+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035716799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665496+0000","last_change":"2023-11-04T01:38:01.939729+0000","last_active":"2023-11-04T01:38:15.665496+0000","last_peered":"2023-11-04T01:38:15.665496+0000","last_clean":"2023-11-04T01:38:15.665496+0000","last_became_active":"2023-11-04T01:38:00.704384+0000","last_became_peered":"2023-11-04T01:38:00.704384+0000","last_unstale":"2023-11-04T01:38:15.665496+0000","last_undegraded":"2023-11-04T01:38:15.665496+0000","last_fullsized":"2023-11-04T01:38:15.665496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080052200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665921+0000","last_change":"2023-11-04T01:38:01.697272+0000","last_active":"2023-11-04T01:38:15.665921+0000","last_peered":"2023-11-04T01:38:15.665921+0000","last_clean":"2023-11-04T01:38:15.665921+0000","last_became_active":"2023-11-04T01:38:00.709395+0000","last_became_peered":"2023-11-04T01:38:00.709395+0000","last_unstale":"2023-11-04T01:38:15.665921+0000","last_undegraded":"2023-11-04T01:38:15.665921+0000","last_fullsized":"2023-11-04T01:38:15.665921+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076665499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.007212+0000","last_change":"2023-11-04T01:38:01.984567+0000","last_active":"2023-11-04T01:38:15.007212+0000","last_peered":"2023-11-04T01:38:15.007212+0000","last_clean":"2023-11-04T01:38:15.007212+0000","last_became_active":"2023-11-04T01:38:00.708020+0000","last_became_peered":"2023-11-04T01:38:00.708020+0000","last_unstale":"2023-11-04T01:38:15.007212+0000","last_undegraded":"2023-11-04T01:38:15.007212+0000","last_fullsized":"2023-11-04T01:38:15.007212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:09.638146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056906299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004323+0000","last_change":"2023-11-04T01:38:01.699685+0000","last_active":"2023-11-04T01:38:15.004323+0000","last_peered":"2023-11-04T01:38:15.004323+0000","last_clean":"2023-11-04T01:38:15.004323+0000","last_became_active":"2023-11-04T01:38:00.706802+0000","last_became_peered":"2023-11-04T01:38:00.706802+0000","last_unstale":"2023-11-04T01:38:15.004323+0000","last_undegraded":"2023-11-04T01:38:15.004323+0000","last_fullsized":"2023-11-04T01:38:15.004323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085845400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004295+0000","last_change":"2023-11-04T01:38:01.700399+0000","last_active":"2023-11-04T01:38:15.004295+0000","last_peered":"2023-11-04T01:38:15.004295+0000","last_clean":"2023-11-04T01:38:15.004295+0000","last_became_active":"2023-11-04T01:38:00.701352+0000","last_became_peered":"2023-11-04T01:38:00.701352+0000","last_unstale":"2023-11-04T01:38:15.004295+0000","last_undegraded":"2023-11-04T01:38:15.004295+0000","last_fullsized":"2023-11-04T01:38:15.004295+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078589399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.269187+0000","last_change":"2023-11-04T01:38:02.362072+0000","last_active":"2023-11-04T01:38:15.269187+0000","last_peered":"2023-11-04T01:38:15.269187+0000","last_clean":"2023-11-04T01:38:15.269187+0000","last_became_active":"2023-11-04T01:38:00.710897+0000","last_became_peered":"2023-11-04T01:38:00.710897+0000","last_unstale":"2023-11-04T01:38:15.269187+0000","last_undegraded":"2023-11-04T01:38:15.269187+0000","last_fullsized":"2023-11-04T01:38:15.269187+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:25.229838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058055900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665422+0000","last_change":"2023-11-04T01:38:01.939857+0000","last_active":"2023-11-04T01:38:15.665422+0000","last_peered":"2023-11-04T01:38:15.665422+0000","last_clean":"2023-11-04T01:38:15.665422+0000","last_became_active":"2023-11-04T01:38:00.701371+0000","last_became_peered":"2023-11-04T01:38:00.701371+0000","last_unstale":"2023-11-04T01:38:15.665422+0000","last_undegraded":"2023-11-04T01:38:15.665422+0000","last_fullsized":"2023-11-04T01:38:15.665422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078632099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665422+0000","last_change":"2023-11-04T01:38:01.939662+0000","last_active":"2023-11-04T01:38:15.665422+0000","last_peered":"2023-11-04T01:38:15.665422+0000","last_clean":"2023-11-04T01:38:15.665422+0000","last_became_active":"2023-11-04T01:38:00.705871+0000","last_became_peered":"2023-11-04T01:38:00.705871+0000","last_unstale":"2023-11-04T01:38:15.665422+0000","last_undegraded":"2023-11-04T01:38:15.665422+0000","last_fullsized":"2023-11-04T01:38:15.665422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066873200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.007107+0000","last_change":"2023-11-04T01:38:01.984672+0000","last_active":"2023-11-04T01:38:15.007107+0000","last_peered":"2023-11-04T01:38:15.007107+0000","last_clean":"2023-11-04T01:38:15.007107+0000","last_became_active":"2023-11-04T01:38:00.706804+0000","last_became_peered":"2023-11-04T01:38:00.706804+0000","last_unstale":"2023-11-04T01:38:15.007107+0000","last_undegraded":"2023-11-04T01:38:15.007107+0000","last_fullsized":"2023-11-04T01:38:15.007107+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:48.412413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038439000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665834+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:38:15.665834+0000","last_peered":"2023-11-04T01:38:15.665834+0000","last_clean":"2023-11-04T01:38:15.665834+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:38:15.665834+0000","last_undegraded":"2023-11-04T01:38:15.665834+0000","last_fullsized":"2023-11-04T01:38:15.665834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1187840,"data_stored":855221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.76900000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.83299999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.872}]},{"osd":3,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.58199999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.442}]},{"osd":5,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.79000000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.71899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":264853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.214},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68799999999999994,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.372}]},{"osd":1,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67600000000000005,"5min":1.05,"15min":1.05},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70099999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.33100000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.66900000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.47499999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.748,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.314},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.44,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71999999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51400000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.501,"15min":0.501},"min":{"1min":0.373,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.443},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45800000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81899999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.38,"5min":0.372,"15min":0.372},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.40300000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.495},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":593920,"data_stored":264853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.45400000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.434}]},{"osd":2,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.41599999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.626}]},{"osd":6,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.47099999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.54100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":264853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.46899999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.56699999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.73399999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.81999999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.96699999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.92500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":593920,"data_stored":264853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.39300000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.32300000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.51900000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.54300000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":593920,"data_stored":264853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.28000000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.33500000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.312}]},{"osd":4,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.46000000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.503},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.41199999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56799999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.39500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":264853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.254}]},{"osd":2,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.316},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.33600000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.23300000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.55100000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.753},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.55900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1187840,"data_stored":855221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.35499999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.30399999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.379}]},{"osd":4,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53800000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.58599999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.59999999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.50900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:38:23.509 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:38:23.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.641+0000 7f922aa90640 1 Processor -- start 2023-11-04T01:38:23.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.641+0000 7f922aa90640 1 -- start start 2023-11-04T01:38:23.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.642+0000 7f922aa90640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f922415ce60 0x7f922406b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.642+0000 7f922aa90640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f922406bd30 0x7f9224160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.642+0000 7f922aa90640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9224161050 0x7f92240cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.642+0000 7f922aa90640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92240cbde0 con 0x7f922415ce60 2023-11-04T01:38:23.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.642+0000 7f922aa90640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92241615d0 con 0x7f9224161050 2023-11-04T01:38:23.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.642+0000 7f922aa90640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92241618b0 con 0x7f922406bd30 2023-11-04T01:38:23.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.642+0000 7f922882c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f922415ce60 0x7f922406b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.642+0000 7f922882c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f922415ce60 0x7f922406b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59856/0 (socket says 172.21.15.114:59856) 2023-11-04T01:38:23.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.642+0000 7f922882c640 1 -- 172.21.15.114:0/1598213340 learned_addr learned my addr 172.21.15.114:0/1598213340 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:23.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.642+0000 7f922882c640 1 -- 172.21.15.114:0/1598213340 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f922406bd30 msgr2=0x7f9224160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:23.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.642+0000 7f922882c640 1 --2- 172.21.15.114:0/1598213340 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f922406bd30 0x7f9224160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.642+0000 7f922882c640 1 -- 172.21.15.114:0/1598213340 >> v2:172.21.15.141:3300/0 conn(0x7f9224161050 msgr2=0x7f92240cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:23.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.642+0000 7f922882c640 1 --2- 172.21.15.114:0/1598213340 >> v2:172.21.15.141:3300/0 conn(0x7f9224161050 0x7f92240cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.642+0000 7f922882c640 1 -- 172.21.15.114:0/1598213340 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92240cba00 con 0x7f922415ce60 2023-11-04T01:38:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.643+0000 7f922882c640 1 --2- 172.21.15.114:0/1598213340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922415ce60 0x7f922406b7f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f92240b05d0 tx=0x7f921402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb12f56007380a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.643+0000 7f92237fe640 1 -- 172.21.15.114:0/1598213340 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9214031870 con 0x7f922415ce60 2023-11-04T01:38:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.643+0000 7f92237fe640 1 -- 172.21.15.114:0/1598213340 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92140319d0 con 0x7f922415ce60 2023-11-04T01:38:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.643+0000 7f92237fe640 1 -- 172.21.15.114:0/1598213340 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9214031d60 con 0x7f922415ce60 2023-11-04T01:38:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.644+0000 7f922aa90640 1 -- 172.21.15.114:0/1598213340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922415ce60 msgr2=0x7f922406b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.644+0000 7f922aa90640 1 --2- 172.21.15.114:0/1598213340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922415ce60 0x7f922406b7f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f92240b05d0 tx=0x7f921402b910 comp rx=0 tx=0).stop 2023-11-04T01:38:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.644+0000 7f922aa90640 1 -- 172.21.15.114:0/1598213340 shutdown_connections 2023-11-04T01:38:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.644+0000 7f922aa90640 1 --2- 172.21.15.114:0/1598213340 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f922406bd30 0x7f9224160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.644+0000 7f922aa90640 1 --2- 172.21.15.114:0/1598213340 >> v2:172.21.15.141:3300/0 conn(0x7f9224161050 0x7f92240cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.644+0000 7f922aa90640 1 --2- 172.21.15.114:0/1598213340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922415ce60 0x7f922406b7f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.644+0000 7f922aa90640 1 -- 172.21.15.114:0/1598213340 >> 172.21.15.114:0/1598213340 conn(0x7f922406ea90 msgr2=0x7f922406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.644+0000 7f922aa90640 1 -- 172.21.15.114:0/1598213340 shutdown_connections 2023-11-04T01:38:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.644+0000 7f922aa90640 1 -- 172.21.15.114:0/1598213340 wait complete. 2023-11-04T01:38:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.645+0000 7f922aa90640 1 Processor -- start 2023-11-04T01:38:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.645+0000 7f922aa90640 1 -- start start 2023-11-04T01:38:23.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.646+0000 7f922aa90640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f922415ce60 0x7f9224150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.646+0000 7f922aa90640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9224161050 0x7f92240b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.646+0000 7f922aa90640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92240ca880 0x7f92241f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.646+0000 7f922aa90640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92240c7c70 con 0x7f9224161050 2023-11-04T01:38:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.646+0000 7f922aa90640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9224150570 con 0x7f92240ca880 2023-11-04T01:38:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.646+0000 7f922aa90640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92240b4ea0 con 0x7f922415ce60 2023-11-04T01:38:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.646+0000 7f9223fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9224161050 0x7f92240b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.646+0000 7f9223fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9224161050 0x7f92240b4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59858/0 (socket says 172.21.15.114:59858) 2023-11-04T01:38:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.646+0000 7f9223fff640 1 -- 172.21.15.114:0/1048690585 learned_addr learned my addr 172.21.15.114:0/1048690585 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.646+0000 7f9223fff640 1 -- 172.21.15.114:0/1048690585 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f922415ce60 msgr2=0x7f9224150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.646+0000 7f9223fff640 1 --2- 172.21.15.114:0/1048690585 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f922415ce60 0x7f9224150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.646+0000 7f9223fff640 1 -- 172.21.15.114:0/1048690585 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92240ca880 msgr2=0x7f92241f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.646+0000 7f922902d640 1 --2- 172.21.15.114:0/1048690585 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92240ca880 0x7f92241f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.646+0000 7f9223fff640 1 --2- 172.21.15.114:0/1048690585 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92240ca880 0x7f92241f2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.646+0000 7f9223fff640 1 -- 172.21.15.114:0/1048690585 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92140094d0 con 0x7f9224161050 2023-11-04T01:38:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.646+0000 7f9223fff640 1 --2- 172.21.15.114:0/1048690585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9224161050 0x7f92240b4650 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f921800b440 tx=0x7f921800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.647+0000 7f92217fa640 1 -- 172.21.15.114:0/1048690585 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218011890 con 0x7f9224161050 2023-11-04T01:38:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.647+0000 7f92217fa640 1 -- 172.21.15.114:0/1048690585 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92180119f0 con 0x7f9224161050 2023-11-04T01:38:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.647+0000 7f92217fa640 1 -- 172.21.15.114:0/1048690585 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218011da0 con 0x7f9224161050 2023-11-04T01:38:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.647+0000 7f922aa90640 1 -- 172.21.15.114:0/1048690585 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92240c7ec0 con 0x7f9224161050 2023-11-04T01:38:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.647+0000 7f922aa90640 1 -- 172.21.15.114:0/1048690585 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92240c8480 con 0x7f9224161050 2023-11-04T01:38:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.648+0000 7f922aa90640 1 -- 172.21.15.114:0/1048690585 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92240c86a0 con 0x7f9224161050 2023-11-04T01:38:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.648+0000 7f92217fa640 1 -- 172.21.15.114:0/1048690585 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f921801a400 con 0x7f9224161050 2023-11-04T01:38:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.649+0000 7f92217fa640 1 --2- 172.21.15.114:0/1048690585 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f921006ae70 0x7f921006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.649+0000 7f922882c640 1 --2- 172.21.15.114:0/1048690585 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f921006ae70 0x7f921006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.649+0000 7f92217fa640 1 -- 172.21.15.114:0/1048690585 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9218089b50 con 0x7f9224161050 2023-11-04T01:38:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.649+0000 7f922882c640 1 --2- 172.21.15.114:0/1048690585 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f921006ae70 0x7f921006d330 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9214036000 tx=0x7f9214030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.653+0000 7f92217fa640 1 -- 172.21.15.114:0/1048690585 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f92180549f0 con 0x7f9224161050 2023-11-04T01:38:23.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.816+0000 7f922aa90640 1 -- 172.21.15.114:0/1048690585 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f92240cb6b0 con 0x7f921006ae70 2023-11-04T01:38:23.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.824+0000 7f92217fa640 1 -- 172.21.15.114:0/1048690585 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355309 (secure 0 0 0) 0x7f9214031c40 con 0x7f921006ae70 2023-11-04T01:38:23.830 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:23.832 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:38:23.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.827+0000 7f922aa90640 1 -- 172.21.15.114:0/1048690585 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f921006ae70 msgr2=0x7f921006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.827+0000 7f922aa90640 1 --2- 172.21.15.114:0/1048690585 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f921006ae70 0x7f921006d330 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9214036000 tx=0x7f9214030000 comp rx=0 tx=0).stop 2023-11-04T01:38:23.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.827+0000 7f922aa90640 1 -- 172.21.15.114:0/1048690585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9224161050 msgr2=0x7f92240b4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.827+0000 7f922aa90640 1 --2- 172.21.15.114:0/1048690585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9224161050 0x7f92240b4650 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f921800b440 tx=0x7f921800b900 comp rx=0 tx=0).stop 2023-11-04T01:38:23.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.828+0000 7f922aa90640 1 -- 172.21.15.114:0/1048690585 shutdown_connections 2023-11-04T01:38:23.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.828+0000 7f922aa90640 1 --2- 172.21.15.114:0/1048690585 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f921006ae70 0x7f921006d330 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.828+0000 7f922aa90640 1 --2- 172.21.15.114:0/1048690585 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92240ca880 0x7f92241f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.828+0000 7f922aa90640 1 --2- 172.21.15.114:0/1048690585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9224161050 0x7f92240b4650 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.828+0000 7f922aa90640 1 --2- 172.21.15.114:0/1048690585 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f922415ce60 0x7f9224150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.828+0000 7f922aa90640 1 -- 172.21.15.114:0/1048690585 >> 172.21.15.114:0/1048690585 conn(0x7f922406ea90 msgr2=0x7f922415ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.828+0000 7f922aa90640 1 -- 172.21.15.114:0/1048690585 shutdown_connections 2023-11-04T01:38:23.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.828+0000 7f922aa90640 1 -- 172.21.15.114:0/1048690585 wait complete. 2023-11-04T01:38:23.841 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2023-11-04T01:38:21.881298+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221980,"kb_used_data":5800,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752740,"statfs":{"total":773094113280,"available":772866805760,"internally_reserved":0,"allocated":5939200,"data_stored":3299560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000911"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:38:14.998656+0000","last_change":"2023-11-04T01:38:02.156342+0000","last_active":"2023-11-04T01:38:14.998656+0000","last_peered":"2023-11-04T01:38:14.998656+0000","last_clean":"2023-11-04T01:38:14.998656+0000","last_became_active":"2023-11-04T01:38:00.708159+0000","last_became_peered":"2023-11-04T01:38:00.708159+0000","last_unstale":"2023-11-04T01:38:14.998656+0000","last_undegraded":"2023-11-04T01:38:14.998656+0000","last_fullsized":"2023-11-04T01:38:14.998656+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000435213,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.269219+0000","last_change":"2023-11-04T01:38:02.362289+0000","last_active":"2023-11-04T01:38:15.269219+0000","last_peered":"2023-11-04T01:38:15.269219+0000","last_clean":"2023-11-04T01:38:15.269219+0000","last_became_active":"2023-11-04T01:38:00.710033+0000","last_became_peered":"2023-11-04T01:38:00.710033+0000","last_unstale":"2023-11-04T01:38:15.269219+0000","last_undegraded":"2023-11-04T01:38:15.269219+0000","last_fullsized":"2023-11-04T01:38:15.269219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046467500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004296+0000","last_change":"2023-11-04T01:38:01.699171+0000","last_active":"2023-11-04T01:38:15.004296+0000","last_peered":"2023-11-04T01:38:15.004296+0000","last_clean":"2023-11-04T01:38:15.004296+0000","last_became_active":"2023-11-04T01:38:00.703927+0000","last_became_peered":"2023-11-04T01:38:00.703927+0000","last_unstale":"2023-11-04T01:38:15.004296+0000","last_undegraded":"2023-11-04T01:38:15.004296+0000","last_fullsized":"2023-11-04T01:38:15.004296+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072585499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:38:14.998679+0000","last_change":"2023-11-04T01:38:02.156160+0000","last_active":"2023-11-04T01:38:14.998679+0000","last_peered":"2023-11-04T01:38:14.998679+0000","last_clean":"2023-11-04T01:38:14.998679+0000","last_became_active":"2023-11-04T01:38:00.709137+0000","last_became_peered":"2023-11-04T01:38:00.709137+0000","last_unstale":"2023-11-04T01:38:14.998679+0000","last_undegraded":"2023-11-04T01:38:14.998679+0000","last_fullsized":"2023-11-04T01:38:14.998679+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028239399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004234+0000","last_change":"2023-11-04T01:38:01.698196+0000","last_active":"2023-11-04T01:38:15.004234+0000","last_peered":"2023-11-04T01:38:15.004234+0000","last_clean":"2023-11-04T01:38:15.004234+0000","last_became_active":"2023-11-04T01:38:00.705451+0000","last_became_peered":"2023-11-04T01:38:00.705451+0000","last_unstale":"2023-11-04T01:38:15.004234+0000","last_undegraded":"2023-11-04T01:38:15.004234+0000","last_fullsized":"2023-11-04T01:38:15.004234+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:16.759249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067668100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.006925+0000","last_change":"2023-11-04T01:38:01.983991+0000","last_active":"2023-11-04T01:38:15.006925+0000","last_peered":"2023-11-04T01:38:15.006925+0000","last_clean":"2023-11-04T01:38:15.006925+0000","last_became_active":"2023-11-04T01:38:00.708462+0000","last_became_peered":"2023-11-04T01:38:00.708462+0000","last_unstale":"2023-11-04T01:38:15.006925+0000","last_undegraded":"2023-11-04T01:38:15.006925+0000","last_fullsized":"2023-11-04T01:38:15.006925+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:37.727651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041811600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.007121+0000","last_change":"2023-11-04T01:38:01.984341+0000","last_active":"2023-11-04T01:38:15.007121+0000","last_peered":"2023-11-04T01:38:15.007121+0000","last_clean":"2023-11-04T01:38:15.007121+0000","last_became_active":"2023-11-04T01:38:00.708307+0000","last_became_peered":"2023-11-04T01:38:00.708307+0000","last_unstale":"2023-11-04T01:38:15.007121+0000","last_undegraded":"2023-11-04T01:38:15.007121+0000","last_fullsized":"2023-11-04T01:38:15.007121+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:17.369098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053627199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004383+0000","last_change":"2023-11-04T01:38:01.700471+0000","last_active":"2023-11-04T01:38:15.004383+0000","last_peered":"2023-11-04T01:38:15.004383+0000","last_clean":"2023-11-04T01:38:15.004383+0000","last_became_active":"2023-11-04T01:38:00.702522+0000","last_became_peered":"2023-11-04T01:38:00.702522+0000","last_unstale":"2023-11-04T01:38:15.004383+0000","last_undegraded":"2023-11-04T01:38:15.004383+0000","last_fullsized":"2023-11-04T01:38:15.004383+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086940300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665883+0000","last_change":"2023-11-04T01:38:01.696901+0000","last_active":"2023-11-04T01:38:15.665883+0000","last_peered":"2023-11-04T01:38:15.665883+0000","last_clean":"2023-11-04T01:38:15.665883+0000","last_became_active":"2023-11-04T01:38:00.706170+0000","last_became_peered":"2023-11-04T01:38:00.706170+0000","last_unstale":"2023-11-04T01:38:15.665883+0000","last_undegraded":"2023-11-04T01:38:15.665883+0000","last_fullsized":"2023-11-04T01:38:15.665883+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059391100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665582+0000","last_change":"2023-11-04T01:38:01.939972+0000","last_active":"2023-11-04T01:38:15.665582+0000","last_peered":"2023-11-04T01:38:15.665582+0000","last_clean":"2023-11-04T01:38:15.665582+0000","last_became_active":"2023-11-04T01:38:00.702784+0000","last_became_peered":"2023-11-04T01:38:00.702784+0000","last_unstale":"2023-11-04T01:38:15.665582+0000","last_undegraded":"2023-11-04T01:38:15.665582+0000","last_fullsized":"2023-11-04T01:38:15.665582+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:26.760402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071328600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665919+0000","last_change":"2023-11-04T01:38:01.699051+0000","last_active":"2023-11-04T01:38:15.665919+0000","last_peered":"2023-11-04T01:38:15.665919+0000","last_clean":"2023-11-04T01:38:15.665919+0000","last_became_active":"2023-11-04T01:38:00.708665+0000","last_became_peered":"2023-11-04T01:38:00.708665+0000","last_unstale":"2023-11-04T01:38:15.665919+0000","last_undegraded":"2023-11-04T01:38:15.665919+0000","last_fullsized":"2023-11-04T01:38:15.665919+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020995580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004154+0000","last_change":"2023-11-04T01:38:01.700742+0000","last_active":"2023-11-04T01:38:15.004154+0000","last_peered":"2023-11-04T01:38:15.004154+0000","last_clean":"2023-11-04T01:38:15.004154+0000","last_became_active":"2023-11-04T01:38:00.706671+0000","last_became_peered":"2023-11-04T01:38:00.706671+0000","last_unstale":"2023-11-04T01:38:15.004154+0000","last_undegraded":"2023-11-04T01:38:15.004154+0000","last_fullsized":"2023-11-04T01:38:15.004154+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072370699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665834+0000","last_change":"2023-11-04T01:38:01.697526+0000","last_active":"2023-11-04T01:38:15.665834+0000","last_peered":"2023-11-04T01:38:15.665834+0000","last_clean":"2023-11-04T01:38:15.665834+0000","last_became_active":"2023-11-04T01:38:00.707580+0000","last_became_peered":"2023-11-04T01:38:00.707580+0000","last_unstale":"2023-11-04T01:38:15.665834+0000","last_undegraded":"2023-11-04T01:38:15.665834+0000","last_fullsized":"2023-11-04T01:38:15.665834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010806699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665639+0000","last_change":"2023-11-04T01:38:01.939462+0000","last_active":"2023-11-04T01:38:15.665639+0000","last_peered":"2023-11-04T01:38:15.665639+0000","last_clean":"2023-11-04T01:38:15.665639+0000","last_became_active":"2023-11-04T01:38:00.705830+0000","last_became_peered":"2023-11-04T01:38:00.705830+0000","last_unstale":"2023-11-04T01:38:15.665639+0000","last_undegraded":"2023-11-04T01:38:15.665639+0000","last_fullsized":"2023-11-04T01:38:15.665639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059305000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.007130+0000","last_change":"2023-11-04T01:38:01.984456+0000","last_active":"2023-11-04T01:38:15.007130+0000","last_peered":"2023-11-04T01:38:15.007130+0000","last_clean":"2023-11-04T01:38:15.007130+0000","last_became_active":"2023-11-04T01:38:00.708803+0000","last_became_peered":"2023-11-04T01:38:00.708803+0000","last_unstale":"2023-11-04T01:38:15.007130+0000","last_undegraded":"2023-11-04T01:38:15.007130+0000","last_fullsized":"2023-11-04T01:38:15.007130+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:30.811033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061551599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004324+0000","last_change":"2023-11-04T01:38:01.698866+0000","last_active":"2023-11-04T01:38:15.004324+0000","last_peered":"2023-11-04T01:38:15.004324+0000","last_clean":"2023-11-04T01:38:15.004324+0000","last_became_active":"2023-11-04T01:38:00.706149+0000","last_became_peered":"2023-11-04T01:38:00.706149+0000","last_unstale":"2023-11-04T01:38:15.004324+0000","last_undegraded":"2023-11-04T01:38:15.004324+0000","last_fullsized":"2023-11-04T01:38:15.004324+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:59.391683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001344154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004211+0000","last_change":"2023-11-04T01:38:01.699187+0000","last_active":"2023-11-04T01:38:15.004211+0000","last_peered":"2023-11-04T01:38:15.004211+0000","last_clean":"2023-11-04T01:38:15.004211+0000","last_became_active":"2023-11-04T01:38:00.706136+0000","last_became_peered":"2023-11-04T01:38:00.706136+0000","last_unstale":"2023-11-04T01:38:15.004211+0000","last_undegraded":"2023-11-04T01:38:15.004211+0000","last_fullsized":"2023-11-04T01:38:15.004211+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074666999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004150+0000","last_change":"2023-11-04T01:38:01.699630+0000","last_active":"2023-11-04T01:38:15.004150+0000","last_peered":"2023-11-04T01:38:15.004150+0000","last_clean":"2023-11-04T01:38:15.004150+0000","last_became_active":"2023-11-04T01:38:00.702550+0000","last_became_peered":"2023-11-04T01:38:00.702550+0000","last_unstale":"2023-11-04T01:38:15.004150+0000","last_undegraded":"2023-11-04T01:38:15.004150+0000","last_fullsized":"2023-11-04T01:38:15.004150+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001016077,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.007141+0000","last_change":"2023-11-04T01:38:01.984764+0000","last_active":"2023-11-04T01:38:15.007141+0000","last_peered":"2023-11-04T01:38:15.007141+0000","last_clean":"2023-11-04T01:38:15.007141+0000","last_became_active":"2023-11-04T01:38:00.709894+0000","last_became_peered":"2023-11-04T01:38:00.709894+0000","last_unstale":"2023-11-04T01:38:15.007141+0000","last_undegraded":"2023-11-04T01:38:15.007141+0000","last_fullsized":"2023-11-04T01:38:15.007141+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:08:42.829255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045046799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665573+0000","last_change":"2023-11-04T01:38:02.321871+0000","last_active":"2023-11-04T01:38:15.665573+0000","last_peered":"2023-11-04T01:38:15.665573+0000","last_clean":"2023-11-04T01:38:15.665573+0000","last_became_active":"2023-11-04T01:38:00.708407+0000","last_became_peered":"2023-11-04T01:38:00.708407+0000","last_unstale":"2023-11-04T01:38:15.665573+0000","last_undegraded":"2023-11-04T01:38:15.665573+0000","last_fullsized":"2023-11-04T01:38:15.665573+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:48.672429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032387200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.006925+0000","last_change":"2023-11-04T01:38:01.983988+0000","last_active":"2023-11-04T01:38:15.006925+0000","last_peered":"2023-11-04T01:38:15.006925+0000","last_clean":"2023-11-04T01:38:15.006925+0000","last_became_active":"2023-11-04T01:38:00.711020+0000","last_became_peered":"2023-11-04T01:38:00.711020+0000","last_unstale":"2023-11-04T01:38:15.006925+0000","last_undegraded":"2023-11-04T01:38:15.006925+0000","last_fullsized":"2023-11-04T01:38:15.006925+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:06.374078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665510+0000","last_change":"2023-11-04T01:38:02.321641+0000","last_active":"2023-11-04T01:38:15.665510+0000","last_peered":"2023-11-04T01:38:15.665510+0000","last_clean":"2023-11-04T01:38:15.665510+0000","last_became_active":"2023-11-04T01:38:00.706199+0000","last_became_peered":"2023-11-04T01:38:00.706199+0000","last_unstale":"2023-11-04T01:38:15.665510+0000","last_undegraded":"2023-11-04T01:38:15.665510+0000","last_fullsized":"2023-11-04T01:38:15.665510+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:15.138325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045080400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:38:14.998610+0000","last_change":"2023-11-04T01:38:02.156148+0000","last_active":"2023-11-04T01:38:14.998610+0000","last_peered":"2023-11-04T01:38:14.998610+0000","last_clean":"2023-11-04T01:38:14.998610+0000","last_became_active":"2023-11-04T01:38:00.708352+0000","last_became_peered":"2023-11-04T01:38:00.708352+0000","last_unstale":"2023-11-04T01:38:14.998610+0000","last_undegraded":"2023-11-04T01:38:14.998610+0000","last_fullsized":"2023-11-04T01:38:14.998610+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035716799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665496+0000","last_change":"2023-11-04T01:38:01.939729+0000","last_active":"2023-11-04T01:38:15.665496+0000","last_peered":"2023-11-04T01:38:15.665496+0000","last_clean":"2023-11-04T01:38:15.665496+0000","last_became_active":"2023-11-04T01:38:00.704384+0000","last_became_peered":"2023-11-04T01:38:00.704384+0000","last_unstale":"2023-11-04T01:38:15.665496+0000","last_undegraded":"2023-11-04T01:38:15.665496+0000","last_fullsized":"2023-11-04T01:38:15.665496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080052200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665921+0000","last_change":"2023-11-04T01:38:01.697272+0000","last_active":"2023-11-04T01:38:15.665921+0000","last_peered":"2023-11-04T01:38:15.665921+0000","last_clean":"2023-11-04T01:38:15.665921+0000","last_became_active":"2023-11-04T01:38:00.709395+0000","last_became_peered":"2023-11-04T01:38:00.709395+0000","last_unstale":"2023-11-04T01:38:15.665921+0000","last_undegraded":"2023-11-04T01:38:15.665921+0000","last_fullsized":"2023-11-04T01:38:15.665921+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076665499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.007212+0000","last_change":"2023-11-04T01:38:01.984567+0000","last_active":"2023-11-04T01:38:15.007212+0000","last_peered":"2023-11-04T01:38:15.007212+0000","last_clean":"2023-11-04T01:38:15.007212+0000","last_became_active":"2023-11-04T01:38:00.708020+0000","last_became_peered":"2023-11-04T01:38:00.708020+0000","last_unstale":"2023-11-04T01:38:15.007212+0000","last_undegraded":"2023-11-04T01:38:15.007212+0000","last_fullsized":"2023-11-04T01:38:15.007212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:09.638146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056906299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004323+0000","last_change":"2023-11-04T01:38:01.699685+0000","last_active":"2023-11-04T01:38:15.004323+0000","last_peered":"2023-11-04T01:38:15.004323+0000","last_clean":"2023-11-04T01:38:15.004323+0000","last_became_active":"2023-11-04T01:38:00.706802+0000","last_became_peered":"2023-11-04T01:38:00.706802+0000","last_unstale":"2023-11-04T01:38:15.004323+0000","last_undegraded":"2023-11-04T01:38:15.004323+0000","last_fullsized":"2023-11-04T01:38:15.004323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085845400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.004295+0000","last_change":"2023-11-04T01:38:01.700399+0000","last_active":"2023-11-04T01:38:15.004295+0000","last_peered":"2023-11-04T01:38:15.004295+0000","last_clean":"2023-11-04T01:38:15.004295+0000","last_became_active":"2023-11-04T01:38:00.701352+0000","last_became_peered":"2023-11-04T01:38:00.701352+0000","last_unstale":"2023-11-04T01:38:15.004295+0000","last_undegraded":"2023-11-04T01:38:15.004295+0000","last_fullsized":"2023-11-04T01:38:15.004295+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078589399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.269187+0000","last_change":"2023-11-04T01:38:02.362072+0000","last_active":"2023-11-04T01:38:15.269187+0000","last_peered":"2023-11-04T01:38:15.269187+0000","last_clean":"2023-11-04T01:38:15.269187+0000","last_became_active":"2023-11-04T01:38:00.710897+0000","last_became_peered":"2023-11-04T01:38:00.710897+0000","last_unstale":"2023-11-04T01:38:15.269187+0000","last_undegraded":"2023-11-04T01:38:15.269187+0000","last_fullsized":"2023-11-04T01:38:15.269187+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:25.229838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058055900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665422+0000","last_change":"2023-11-04T01:38:01.939857+0000","last_active":"2023-11-04T01:38:15.665422+0000","last_peered":"2023-11-04T01:38:15.665422+0000","last_clean":"2023-11-04T01:38:15.665422+0000","last_became_active":"2023-11-04T01:38:00.701371+0000","last_became_peered":"2023-11-04T01:38:00.701371+0000","last_unstale":"2023-11-04T01:38:15.665422+0000","last_undegraded":"2023-11-04T01:38:15.665422+0000","last_fullsized":"2023-11-04T01:38:15.665422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078632099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":23,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665422+0000","last_change":"2023-11-04T01:38:01.939662+0000","last_active":"2023-11-04T01:38:15.665422+0000","last_peered":"2023-11-04T01:38:15.665422+0000","last_clean":"2023-11-04T01:38:15.665422+0000","last_became_active":"2023-11-04T01:38:00.705871+0000","last_became_peered":"2023-11-04T01:38:00.705871+0000","last_unstale":"2023-11-04T01:38:15.665422+0000","last_undegraded":"2023-11-04T01:38:15.665422+0000","last_fullsized":"2023-11-04T01:38:15.665422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066873200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:19.014310+0000","last_change":"2023-11-04T01:38:19.014310+0000","last_active":"2023-11-04T01:38:19.014310+0000","last_peered":"2023-11-04T01:38:19.014310+0000","last_clean":"2023-11-04T01:38:19.014310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:19.014310+0000","last_undegraded":"2023-11-04T01:38:19.014310+0000","last_fullsized":"2023-11-04T01:38:19.014310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:18.009210+0000","last_change":"2023-11-04T01:38:18.009210+0000","last_active":"2023-11-04T01:38:18.009210+0000","last_peered":"2023-11-04T01:38:18.009210+0000","last_clean":"2023-11-04T01:38:18.009210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:18.009210+0000","last_undegraded":"2023-11-04T01:38:18.009210+0000","last_fullsized":"2023-11-04T01:38:18.009210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.007107+0000","last_change":"2023-11-04T01:38:01.984672+0000","last_active":"2023-11-04T01:38:15.007107+0000","last_peered":"2023-11-04T01:38:15.007107+0000","last_clean":"2023-11-04T01:38:15.007107+0000","last_became_active":"2023-11-04T01:38:00.706804+0000","last_became_peered":"2023-11-04T01:38:00.706804+0000","last_unstale":"2023-11-04T01:38:15.007107+0000","last_undegraded":"2023-11-04T01:38:15.007107+0000","last_fullsized":"2023-11-04T01:38:15.007107+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:48.412413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038439000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:38:15.665834+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:38:15.665834+0000","last_peered":"2023-11-04T01:38:15.665834+0000","last_clean":"2023-11-04T01:38:15.665834+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:38:15.665834+0000","last_undegraded":"2023-11-04T01:38:15.665834+0000","last_fullsized":"2023-11-04T01:38:15.665834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1187840,"data_stored":855221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.76900000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.83299999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.872}]},{"osd":3,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.58199999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.442}]},{"osd":5,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.79000000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.71899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":264853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.214},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68799999999999994,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.372}]},{"osd":1,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67600000000000005,"5min":1.05,"15min":1.05},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70099999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.33100000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.66900000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.47499999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.748,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.314},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.44,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71999999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51400000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.501,"15min":0.501},"min":{"1min":0.373,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.443},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45800000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81899999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.38,"5min":0.372,"15min":0.372},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.40300000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.495},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":593920,"data_stored":264853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.45400000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.434}]},{"osd":2,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.41599999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.626}]},{"osd":6,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.47099999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.54100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":264853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.46899999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.56699999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.73399999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.81999999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.96699999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.92500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":593920,"data_stored":264853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.39300000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.32300000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.51900000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.54300000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":593920,"data_stored":264853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.28000000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.33500000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.312}]},{"osd":4,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.46000000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.503},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.41199999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56799999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.39500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":264853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.254}]},{"osd":2,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.316},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.33600000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.23300000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.55100000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.753},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:37:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.55900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1187840,"data_stored":855221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.35499999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.30399999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.379}]},{"osd":4,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53800000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.58599999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.59999999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.50900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:38:23.847 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:38:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.977+0000 7f0fc0a61640 1 Processor -- start 2023-11-04T01:38:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.977+0000 7f0fc0a61640 1 -- start start 2023-11-04T01:38:23.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.978+0000 7f0fc0a61640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc0cda60 0x7f0fbc0ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.978+0000 7f0fc0a61640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0fbc070d40 0x7f0fbc06c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.978+0000 7f0fc0a61640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fbc0cc990 con 0x7f0fbc0b0cd0 2023-11-04T01:38:23.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.978+0000 7f0fc0a61640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc0ccc70 con 0x7f0fbc070d40 2023-11-04T01:38:23.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.978+0000 7f0fc0a61640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc0c9ce0 con 0x7f0fbc0cda60 2023-11-04T01:38:23.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.978+0000 7f0fbad9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0fbc070d40 0x7f0fbc06c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.978+0000 7f0fbad9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0fbc070d40 0x7f0fbc06c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59872/0 (socket says 172.21.15.114:59872) 2023-11-04T01:38:23.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.978+0000 7f0fbad9d640 1 -- 172.21.15.114:0/758243529 learned_addr learned my addr 172.21.15.114:0/758243529 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:23.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.978+0000 7f0fba59c640 1 --2- 172.21.15.114:0/758243529 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc0cda60 0x7f0fbc0ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.979+0000 7f0fbad9d640 1 -- 172.21.15.114:0/758243529 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc0cda60 msgr2=0x7f0fbc0ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.979+0000 7f0fbad9d640 1 --2- 172.21.15.114:0/758243529 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc0cda60 0x7f0fbc0ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.979+0000 7f0fbad9d640 1 -- 172.21.15.114:0/758243529 >> v1:172.21.15.141:6789/0 conn(0x7f0fbc0b0cd0 legacy=0x7f0fbc070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.979+0000 7f0fbad9d640 1 -- 172.21.15.114:0/758243529 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc0c9fc0 con 0x7f0fbc070d40 2023-11-04T01:38:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.979+0000 7f0fbad9d640 1 --2- 172.21.15.114:0/758243529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc070d40 0x7f0fbc06c200 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4009e50 tx=0x7f0fb402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03bd6963051ed server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.980+0000 7f0fb9d9b640 1 -- 172.21.15.114:0/758243529 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb402cb00 con 0x7f0fbc070d40 2023-11-04T01:38:23.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.980+0000 7f0fb9d9b640 1 -- 172.21.15.114:0/758243529 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb402cc60 con 0x7f0fbc070d40 2023-11-04T01:38:23.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.980+0000 7f0fb9d9b640 1 -- 172.21.15.114:0/758243529 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40343f0 con 0x7f0fbc070d40 2023-11-04T01:38:23.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.980+0000 7f0fc0a61640 1 -- 172.21.15.114:0/758243529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc070d40 msgr2=0x7f0fbc06c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.980+0000 7f0fc0a61640 1 --2- 172.21.15.114:0/758243529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc070d40 0x7f0fbc06c200 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4009e50 tx=0x7f0fb402bf60 comp rx=0 tx=0).stop 2023-11-04T01:38:23.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.980+0000 7f0fc0a61640 1 -- 172.21.15.114:0/758243529 shutdown_connections 2023-11-04T01:38:23.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.980+0000 7f0fc0a61640 1 --2- 172.21.15.114:0/758243529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc070d40 0x7f0fbc06c200 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.980+0000 7f0fc0a61640 1 --2- 172.21.15.114:0/758243529 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc0cda60 0x7f0fbc0ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.980+0000 7f0fc0a61640 1 -- 172.21.15.114:0/758243529 >> 172.21.15.114:0/758243529 conn(0x7f0fbc0ce950 msgr2=0x7f0fbc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:23.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.980+0000 7f0fc0a61640 1 -- 172.21.15.114:0/758243529 shutdown_connections 2023-11-04T01:38:23.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.980+0000 7f0fc0a61640 1 -- 172.21.15.114:0/758243529 wait complete. 2023-11-04T01:38:23.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.981+0000 7f0fc0a61640 1 Processor -- start 2023-11-04T01:38:23.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.981+0000 7f0fc0a61640 1 -- start start 2023-11-04T01:38:23.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.982+0000 7f0fc0a61640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc070d40 0x7f0fbc145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.982+0000 7f0fc0a61640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fbc0b0cd0 0x7f0fbc148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.982+0000 7f0fc0a61640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc0cda60 0x7f0fbc1e23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.982+0000 7f0fc0a61640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc0c4d80 con 0x7f0fbc070d40 2023-11-04T01:38:23.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.982+0000 7f0fc0a61640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc149220 con 0x7f0fbc0b0cd0 2023-11-04T01:38:23.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.982+0000 7f0fc0a61640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc146640 con 0x7f0fbc0cda60 2023-11-04T01:38:23.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.982+0000 7f0fba59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc070d40 0x7f0fbc145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.982+0000 7f0fba59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc070d40 0x7f0fbc145c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59876/0 (socket says 172.21.15.114:59876) 2023-11-04T01:38:23.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.982+0000 7f0fba59c640 1 -- 172.21.15.114:0/3695143938 learned_addr learned my addr 172.21.15.114:0/3695143938 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:23.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.982+0000 7f0fba59c640 1 -- 172.21.15.114:0/3695143938 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc0cda60 msgr2=0x7f0fbc1e23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.982+0000 7f0fba59c640 1 --2- 172.21.15.114:0/3695143938 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc0cda60 0x7f0fbc1e23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.983+0000 7f0fba59c640 1 -- 172.21.15.114:0/3695143938 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fbc0b0cd0 msgr2=0x7f0fbc148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:23.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.983+0000 7f0fb3fff640 1 --2- 172.21.15.114:0/3695143938 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fbc0b0cd0 0x7f0fbc148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.983+0000 7f0fba59c640 1 --2- 172.21.15.114:0/3695143938 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fbc0b0cd0 0x7f0fbc148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:23.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.983+0000 7f0fba59c640 1 -- 172.21.15.114:0/3695143938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb4009b30 con 0x7f0fbc070d40 2023-11-04T01:38:23.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.983+0000 7f0fb3fff640 1 --2- 172.21.15.114:0/3695143938 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fbc0b0cd0 0x7f0fbc148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:23.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.983+0000 7f0fba59c640 1 --2- 172.21.15.114:0/3695143938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc070d40 0x7f0fbc145c40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00e690 tx=0x7f0fac00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.983+0000 7f0fb2ffd640 1 -- 172.21.15.114:0/3695143938 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac00ca30 con 0x7f0fbc070d40 2023-11-04T01:38:23.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.983+0000 7f0fb2ffd640 1 -- 172.21.15.114:0/3695143938 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fac00cb90 con 0x7f0fbc070d40 2023-11-04T01:38:23.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.983+0000 7f0fc0a61640 1 -- 172.21.15.114:0/3695143938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fbc146920 con 0x7f0fbc070d40 2023-11-04T01:38:23.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.983+0000 7f0fb2ffd640 1 -- 172.21.15.114:0/3695143938 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac0113f0 con 0x7f0fbc070d40 2023-11-04T01:38:23.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.983+0000 7f0fc0a61640 1 -- 172.21.15.114:0/3695143938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fbc146ee0 con 0x7f0fbc070d40 2023-11-04T01:38:23.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.984+0000 7f0fc0a61640 1 -- 172.21.15.114:0/3695143938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fbc074290 con 0x7f0fbc070d40 2023-11-04T01:38:23.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.984+0000 7f0fb2ffd640 1 -- 172.21.15.114:0/3695143938 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0fac011550 con 0x7f0fbc070d40 2023-11-04T01:38:23.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.985+0000 7f0fb2ffd640 1 --2- 172.21.15.114:0/3695143938 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0f9c06ae70 0x7f0f9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:23.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.985+0000 7f0fb3fff640 1 --2- 172.21.15.114:0/3695143938 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0f9c06ae70 0x7f0f9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:23.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.985+0000 7f0fb2ffd640 1 -- 172.21.15.114:0/3695143938 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0fac089580 con 0x7f0fbc070d40 2023-11-04T01:38:23.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.985+0000 7f0fb3fff640 1 --2- 172.21.15.114:0/3695143938 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0f9c06ae70 0x7f0f9c06d330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0b4630 tx=0x7f0fa4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:23.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:23.989+0000 7f0fb2ffd640 1 -- 172.21.15.114:0/3695143938 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0fac054390 con 0x7f0fbc070d40 2023-11-04T01:38:24.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.152+0000 7f0fc0a61640 1 -- 172.21.15.114:0/3695143938 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fbc0ca2a0 con 0x7f0f9c06ae70 2023-11-04T01:38:24.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.161+0000 7f0fb2ffd640 1 -- 172.21.15.114:0/3695143938 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369924 (secure 0 0 0) 0x7f0fa40013e0 con 0x7f0f9c06ae70 2023-11-04T01:38:24.167 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:24.169 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:38:24.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.164+0000 7f0fc0a61640 1 -- 172.21.15.114:0/3695143938 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0f9c06ae70 msgr2=0x7f0f9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.164+0000 7f0fc0a61640 1 --2- 172.21.15.114:0/3695143938 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0f9c06ae70 0x7f0f9c06d330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0b4630 tx=0x7f0fa4009040 comp rx=0 tx=0).stop 2023-11-04T01:38:24.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.164+0000 7f0fc0a61640 1 -- 172.21.15.114:0/3695143938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc070d40 msgr2=0x7f0fbc145c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.164+0000 7f0fc0a61640 1 --2- 172.21.15.114:0/3695143938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc070d40 0x7f0fbc145c40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00e690 tx=0x7f0fac00eb50 comp rx=0 tx=0).stop 2023-11-04T01:38:24.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.164+0000 7f0fc0a61640 1 -- 172.21.15.114:0/3695143938 shutdown_connections 2023-11-04T01:38:24.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.164+0000 7f0fc0a61640 1 --2- 172.21.15.114:0/3695143938 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0fbc0cda60 0x7f0fbc1e23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.164+0000 7f0fc0a61640 1 --2- 172.21.15.114:0/3695143938 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0f9c06ae70 0x7f0f9c06d330 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.164+0000 7f0fc0a61640 1 --2- 172.21.15.114:0/3695143938 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0fbc0b0cd0 0x7f0fbc148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.164+0000 7f0fc0a61640 1 --2- 172.21.15.114:0/3695143938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc070d40 0x7f0fbc145c40 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.164+0000 7f0fc0a61640 1 -- 172.21.15.114:0/3695143938 >> 172.21.15.114:0/3695143938 conn(0x7f0fbc0ce950 msgr2=0x7f0fbc0c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:24.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.164+0000 7f0fc0a61640 1 -- 172.21.15.114:0/3695143938 shutdown_connections 2023-11-04T01:38:24.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.164+0000 7f0fc0a61640 1 -- 172.21.15.114:0/3695143938 wait complete. 2023-11-04T01:38:24.177 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-11-04T01:38:23.881659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":246,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222440,"kb_used_data":6248,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752280,"statfs":{"total":773094113280,"available":772866334720,"internally_reserved":0,"allocated":6397952,"data_stored":3527188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.867196"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205396+0000","last_change":"2023-11-04T01:38:20.049549+0000","last_active":"2023-11-04T01:38:21.205396+0000","last_peered":"2023-11-04T01:38:21.205396+0000","last_clean":"2023-11-04T01:38:21.205396+0000","last_became_active":"2023-11-04T01:38:20.049262+0000","last_became_peered":"2023-11-04T01:38:20.049262+0000","last_unstale":"2023-11-04T01:38:21.205396+0000","last_undegraded":"2023-11-04T01:38:21.205396+0000","last_fullsized":"2023-11-04T01:38:21.205396+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:27:08.487034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675168+0000","last_change":"2023-11-04T01:38:20.053859+0000","last_active":"2023-11-04T01:38:21.675168+0000","last_peered":"2023-11-04T01:38:21.675168+0000","last_clean":"2023-11-04T01:38:21.675168+0000","last_became_active":"2023-11-04T01:38:20.053576+0000","last_became_peered":"2023-11-04T01:38:20.053576+0000","last_unstale":"2023-11-04T01:38:21.675168+0000","last_undegraded":"2023-11-04T01:38:21.675168+0000","last_fullsized":"2023-11-04T01:38:21.675168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:26.807670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035426+0000","last_change":"2023-11-04T01:38:20.036689+0000","last_active":"2023-11-04T01:38:21.035426+0000","last_peered":"2023-11-04T01:38:21.035426+0000","last_clean":"2023-11-04T01:38:21.035426+0000","last_became_active":"2023-11-04T01:38:20.036295+0000","last_became_peered":"2023-11-04T01:38:20.036295+0000","last_unstale":"2023-11-04T01:38:21.035426+0000","last_undegraded":"2023-11-04T01:38:21.035426+0000","last_fullsized":"2023-11-04T01:38:21.035426+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:37:52.192853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674013+0000","last_change":"2023-11-04T01:38:20.041642+0000","last_active":"2023-11-04T01:38:21.674013+0000","last_peered":"2023-11-04T01:38:21.674013+0000","last_clean":"2023-11-04T01:38:21.674013+0000","last_became_active":"2023-11-04T01:38:20.041317+0000","last_became_peered":"2023-11-04T01:38:20.041317+0000","last_unstale":"2023-11-04T01:38:21.674013+0000","last_undegraded":"2023-11-04T01:38:21.674013+0000","last_fullsized":"2023-11-04T01:38:21.674013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:29:25.119418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205194+0000","last_change":"2023-11-04T01:38:20.040446+0000","last_active":"2023-11-04T01:38:21.205194+0000","last_peered":"2023-11-04T01:38:21.205194+0000","last_clean":"2023-11-04T01:38:21.205194+0000","last_became_active":"2023-11-04T01:38:20.040190+0000","last_became_peered":"2023-11-04T01:38:20.040190+0000","last_unstale":"2023-11-04T01:38:21.205194+0000","last_undegraded":"2023-11-04T01:38:21.205194+0000","last_fullsized":"2023-11-04T01:38:21.205194+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:36.086593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673683+0000","last_change":"2023-11-04T01:38:20.033717+0000","last_active":"2023-11-04T01:38:21.673683+0000","last_peered":"2023-11-04T01:38:21.673683+0000","last_clean":"2023-11-04T01:38:21.673683+0000","last_became_active":"2023-11-04T01:38:20.033489+0000","last_became_peered":"2023-11-04T01:38:20.033489+0000","last_unstale":"2023-11-04T01:38:21.673683+0000","last_undegraded":"2023-11-04T01:38:21.673683+0000","last_fullsized":"2023-11-04T01:38:21.673683+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:48:57.181502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035641+0000","last_change":"2023-11-04T01:38:20.038279+0000","last_active":"2023-11-04T01:38:21.035641+0000","last_peered":"2023-11-04T01:38:21.035641+0000","last_clean":"2023-11-04T01:38:21.035641+0000","last_became_active":"2023-11-04T01:38:20.038041+0000","last_became_peered":"2023-11-04T01:38:20.038041+0000","last_unstale":"2023-11-04T01:38:21.035641+0000","last_undegraded":"2023-11-04T01:38:21.035641+0000","last_fullsized":"2023-11-04T01:38:21.035641+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:29.142146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674889+0000","last_change":"2023-11-04T01:38:20.038609+0000","last_active":"2023-11-04T01:38:21.674889+0000","last_peered":"2023-11-04T01:38:21.674889+0000","last_clean":"2023-11-04T01:38:21.674889+0000","last_became_active":"2023-11-04T01:38:20.038286+0000","last_became_peered":"2023-11-04T01:38:20.038286+0000","last_unstale":"2023-11-04T01:38:21.674889+0000","last_undegraded":"2023-11-04T01:38:21.674889+0000","last_fullsized":"2023-11-04T01:38:21.674889+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:36.525521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034752+0000","last_change":"2023-11-04T01:38:20.039854+0000","last_active":"2023-11-04T01:38:21.034752+0000","last_peered":"2023-11-04T01:38:21.034752+0000","last_clean":"2023-11-04T01:38:21.034752+0000","last_became_active":"2023-11-04T01:38:20.039558+0000","last_became_peered":"2023-11-04T01:38:20.039558+0000","last_unstale":"2023-11-04T01:38:21.034752+0000","last_undegraded":"2023-11-04T01:38:21.034752+0000","last_fullsized":"2023-11-04T01:38:21.034752+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:38:22.194989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673965+0000","last_change":"2023-11-04T01:38:20.036447+0000","last_active":"2023-11-04T01:38:21.673965+0000","last_peered":"2023-11-04T01:38:21.673965+0000","last_clean":"2023-11-04T01:38:21.673965+0000","last_became_active":"2023-11-04T01:38:20.034559+0000","last_became_peered":"2023-11-04T01:38:20.034559+0000","last_unstale":"2023-11-04T01:38:21.673965+0000","last_undegraded":"2023-11-04T01:38:21.673965+0000","last_fullsized":"2023-11-04T01:38:21.673965+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:41.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674222+0000","last_change":"2023-11-04T01:38:20.049819+0000","last_active":"2023-11-04T01:38:21.674222+0000","last_peered":"2023-11-04T01:38:21.674222+0000","last_clean":"2023-11-04T01:38:21.674222+0000","last_became_active":"2023-11-04T01:38:20.048896+0000","last_became_peered":"2023-11-04T01:38:20.048896+0000","last_unstale":"2023-11-04T01:38:21.674222+0000","last_undegraded":"2023-11-04T01:38:21.674222+0000","last_fullsized":"2023-11-04T01:38:21.674222+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:40.786616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673854+0000","last_change":"2023-11-04T01:38:20.045669+0000","last_active":"2023-11-04T01:38:21.673854+0000","last_peered":"2023-11-04T01:38:21.673854+0000","last_clean":"2023-11-04T01:38:21.673854+0000","last_became_active":"2023-11-04T01:38:20.045304+0000","last_became_peered":"2023-11-04T01:38:20.045304+0000","last_unstale":"2023-11-04T01:38:21.673854+0000","last_undegraded":"2023-11-04T01:38:21.673854+0000","last_fullsized":"2023-11-04T01:38:21.673854+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:22.724353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034368+0000","last_change":"2023-11-04T01:38:20.038098+0000","last_active":"2023-11-04T01:38:21.034368+0000","last_peered":"2023-11-04T01:38:21.034368+0000","last_clean":"2023-11-04T01:38:21.034368+0000","last_became_active":"2023-11-04T01:38:20.037832+0000","last_became_peered":"2023-11-04T01:38:20.037832+0000","last_unstale":"2023-11-04T01:38:21.034368+0000","last_undegraded":"2023-11-04T01:38:21.034368+0000","last_fullsized":"2023-11-04T01:38:21.034368+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:51.180365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035420+0000","last_change":"2023-11-04T01:38:20.037420+0000","last_active":"2023-11-04T01:38:21.035420+0000","last_peered":"2023-11-04T01:38:21.035420+0000","last_clean":"2023-11-04T01:38:21.035420+0000","last_became_active":"2023-11-04T01:38:20.037129+0000","last_became_peered":"2023-11-04T01:38:20.037129+0000","last_unstale":"2023-11-04T01:38:21.035420+0000","last_undegraded":"2023-11-04T01:38:21.035420+0000","last_fullsized":"2023-11-04T01:38:21.035420+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:40.491312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034835+0000","last_change":"2023-11-04T01:38:20.037763+0000","last_active":"2023-11-04T01:38:21.034835+0000","last_peered":"2023-11-04T01:38:21.034835+0000","last_clean":"2023-11-04T01:38:21.034835+0000","last_became_active":"2023-11-04T01:38:20.037487+0000","last_became_peered":"2023-11-04T01:38:20.037487+0000","last_unstale":"2023-11-04T01:38:21.034835+0000","last_undegraded":"2023-11-04T01:38:21.034835+0000","last_fullsized":"2023-11-04T01:38:21.034835+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:40.786616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673419+0000","last_change":"2023-11-04T01:38:20.033267+0000","last_active":"2023-11-04T01:38:21.673419+0000","last_peered":"2023-11-04T01:38:21.673419+0000","last_clean":"2023-11-04T01:38:21.673419+0000","last_became_active":"2023-11-04T01:38:20.033012+0000","last_became_peered":"2023-11-04T01:38:20.033012+0000","last_unstale":"2023-11-04T01:38:21.673419+0000","last_undegraded":"2023-11-04T01:38:21.673419+0000","last_fullsized":"2023-11-04T01:38:21.673419+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:22:37.388957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675419+0000","last_change":"2023-11-04T01:38:20.042715+0000","last_active":"2023-11-04T01:38:21.675419+0000","last_peered":"2023-11-04T01:38:21.675419+0000","last_clean":"2023-11-04T01:38:21.675419+0000","last_became_active":"2023-11-04T01:38:20.042483+0000","last_became_peered":"2023-11-04T01:38:20.042483+0000","last_unstale":"2023-11-04T01:38:21.675419+0000","last_undegraded":"2023-11-04T01:38:21.675419+0000","last_fullsized":"2023-11-04T01:38:21.675419+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:30:19.149946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035622+0000","last_change":"2023-11-04T01:38:20.039785+0000","last_active":"2023-11-04T01:38:21.035622+0000","last_peered":"2023-11-04T01:38:21.035622+0000","last_clean":"2023-11-04T01:38:21.035622+0000","last_became_active":"2023-11-04T01:38:20.039539+0000","last_became_peered":"2023-11-04T01:38:20.039539+0000","last_unstale":"2023-11-04T01:38:21.035622+0000","last_undegraded":"2023-11-04T01:38:21.035622+0000","last_fullsized":"2023-11-04T01:38:21.035622+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:25:30.505923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205320+0000","last_change":"2023-11-04T01:38:20.049555+0000","last_active":"2023-11-04T01:38:21.205320+0000","last_peered":"2023-11-04T01:38:21.205320+0000","last_clean":"2023-11-04T01:38:21.205320+0000","last_became_active":"2023-11-04T01:38:20.049293+0000","last_became_peered":"2023-11-04T01:38:20.049293+0000","last_unstale":"2023-11-04T01:38:21.205320+0000","last_undegraded":"2023-11-04T01:38:21.205320+0000","last_fullsized":"2023-11-04T01:38:21.205320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:43.631674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675290+0000","last_change":"2023-11-04T01:38:20.041920+0000","last_active":"2023-11-04T01:38:21.675290+0000","last_peered":"2023-11-04T01:38:21.675290+0000","last_clean":"2023-11-04T01:38:21.675290+0000","last_became_active":"2023-11-04T01:38:20.041656+0000","last_became_peered":"2023-11-04T01:38:20.041656+0000","last_unstale":"2023-11-04T01:38:21.675290+0000","last_undegraded":"2023-11-04T01:38:21.675290+0000","last_fullsized":"2023-11-04T01:38:21.675290+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:02.149183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033793+0000","last_change":"2023-11-04T01:38:20.045716+0000","last_active":"2023-11-04T01:38:21.033793+0000","last_peered":"2023-11-04T01:38:21.033793+0000","last_clean":"2023-11-04T01:38:21.033793+0000","last_became_active":"2023-11-04T01:38:20.045380+0000","last_became_peered":"2023-11-04T01:38:20.045380+0000","last_unstale":"2023-11-04T01:38:21.033793+0000","last_undegraded":"2023-11-04T01:38:21.033793+0000","last_fullsized":"2023-11-04T01:38:21.033793+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:22.724353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674755+0000","last_change":"2023-11-04T01:38:20.043459+0000","last_active":"2023-11-04T01:38:21.674755+0000","last_peered":"2023-11-04T01:38:21.674755+0000","last_clean":"2023-11-04T01:38:21.674755+0000","last_became_active":"2023-11-04T01:38:20.043211+0000","last_became_peered":"2023-11-04T01:38:20.043211+0000","last_unstale":"2023-11-04T01:38:21.674755+0000","last_undegraded":"2023-11-04T01:38:21.674755+0000","last_fullsized":"2023-11-04T01:38:21.674755+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:25:30.505923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033973+0000","last_change":"2023-11-04T01:38:20.044304+0000","last_active":"2023-11-04T01:38:21.033973+0000","last_peered":"2023-11-04T01:38:21.033973+0000","last_clean":"2023-11-04T01:38:21.033973+0000","last_became_active":"2023-11-04T01:38:20.044039+0000","last_became_peered":"2023-11-04T01:38:20.044039+0000","last_unstale":"2023-11-04T01:38:21.033973+0000","last_undegraded":"2023-11-04T01:38:21.033973+0000","last_fullsized":"2023-11-04T01:38:21.033973+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:35.459885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033952+0000","last_change":"2023-11-04T01:38:20.040794+0000","last_active":"2023-11-04T01:38:21.033952+0000","last_peered":"2023-11-04T01:38:21.033952+0000","last_clean":"2023-11-04T01:38:21.033952+0000","last_became_active":"2023-11-04T01:38:20.040482+0000","last_became_peered":"2023-11-04T01:38:20.040482+0000","last_unstale":"2023-11-04T01:38:21.033952+0000","last_undegraded":"2023-11-04T01:38:21.033952+0000","last_fullsized":"2023-11-04T01:38:21.033952+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:31.017311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205414+0000","last_change":"2023-11-04T01:38:20.040557+0000","last_active":"2023-11-04T01:38:21.205414+0000","last_peered":"2023-11-04T01:38:21.205414+0000","last_clean":"2023-11-04T01:38:21.205414+0000","last_became_active":"2023-11-04T01:38:20.040102+0000","last_became_peered":"2023-11-04T01:38:20.040102+0000","last_unstale":"2023-11-04T01:38:21.205414+0000","last_undegraded":"2023-11-04T01:38:21.205414+0000","last_fullsized":"2023-11-04T01:38:21.205414+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:10.992954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673979+0000","last_change":"2023-11-04T01:38:20.042394+0000","last_active":"2023-11-04T01:38:21.673979+0000","last_peered":"2023-11-04T01:38:21.673979+0000","last_clean":"2023-11-04T01:38:21.673979+0000","last_became_active":"2023-11-04T01:38:20.042133+0000","last_became_peered":"2023-11-04T01:38:20.042133+0000","last_unstale":"2023-11-04T01:38:21.673979+0000","last_undegraded":"2023-11-04T01:38:21.673979+0000","last_fullsized":"2023-11-04T01:38:21.673979+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:35.459885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674258+0000","last_change":"2023-11-04T01:38:20.034976+0000","last_active":"2023-11-04T01:38:21.674258+0000","last_peered":"2023-11-04T01:38:21.674258+0000","last_clean":"2023-11-04T01:38:21.674258+0000","last_became_active":"2023-11-04T01:38:20.034718+0000","last_became_peered":"2023-11-04T01:38:20.034718+0000","last_unstale":"2023-11-04T01:38:21.674258+0000","last_undegraded":"2023-11-04T01:38:21.674258+0000","last_fullsized":"2023-11-04T01:38:21.674258+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:35.459885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205280+0000","last_change":"2023-11-04T01:38:20.047475+0000","last_active":"2023-11-04T01:38:21.205280+0000","last_peered":"2023-11-04T01:38:21.205280+0000","last_clean":"2023-11-04T01:38:21.205280+0000","last_became_active":"2023-11-04T01:38:20.047217+0000","last_became_peered":"2023-11-04T01:38:20.047217+0000","last_unstale":"2023-11-04T01:38:21.205280+0000","last_undegraded":"2023-11-04T01:38:21.205280+0000","last_fullsized":"2023-11-04T01:38:21.205280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:03:06.304104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675200+0000","last_change":"2023-11-04T01:38:20.045473+0000","last_active":"2023-11-04T01:38:21.675200+0000","last_peered":"2023-11-04T01:38:21.675200+0000","last_clean":"2023-11-04T01:38:21.675200+0000","last_became_active":"2023-11-04T01:38:20.045227+0000","last_became_peered":"2023-11-04T01:38:20.045227+0000","last_unstale":"2023-11-04T01:38:21.675200+0000","last_undegraded":"2023-11-04T01:38:21.675200+0000","last_fullsized":"2023-11-04T01:38:21.675200+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:11:33.289813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033793+0000","last_change":"2023-11-04T01:38:20.042348+0000","last_active":"2023-11-04T01:38:21.033793+0000","last_peered":"2023-11-04T01:38:21.033793+0000","last_clean":"2023-11-04T01:38:21.033793+0000","last_became_active":"2023-11-04T01:38:20.041643+0000","last_became_peered":"2023-11-04T01:38:20.041643+0000","last_unstale":"2023-11-04T01:38:21.033793+0000","last_undegraded":"2023-11-04T01:38:21.033793+0000","last_fullsized":"2023-11-04T01:38:21.033793+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:13.116417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205126+0000","last_change":"2023-11-04T01:38:20.031327+0000","last_active":"2023-11-04T01:38:21.205126+0000","last_peered":"2023-11-04T01:38:21.205126+0000","last_clean":"2023-11-04T01:38:21.205126+0000","last_became_active":"2023-11-04T01:38:20.031081+0000","last_became_peered":"2023-11-04T01:38:20.031081+0000","last_unstale":"2023-11-04T01:38:21.205126+0000","last_undegraded":"2023-11-04T01:38:21.205126+0000","last_fullsized":"2023-11-04T01:38:21.205126+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:18.719026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673381+0000","last_change":"2023-11-04T01:38:20.047492+0000","last_active":"2023-11-04T01:38:21.673381+0000","last_peered":"2023-11-04T01:38:21.673381+0000","last_clean":"2023-11-04T01:38:21.673381+0000","last_became_active":"2023-11-04T01:38:20.047236+0000","last_became_peered":"2023-11-04T01:38:20.047236+0000","last_unstale":"2023-11-04T01:38:21.673381+0000","last_undegraded":"2023-11-04T01:38:21.673381+0000","last_fullsized":"2023-11-04T01:38:21.673381+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:18:14.039193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034875+0000","last_change":"2023-11-04T01:38:20.035082+0000","last_active":"2023-11-04T01:38:21.034875+0000","last_peered":"2023-11-04T01:38:21.034875+0000","last_clean":"2023-11-04T01:38:21.034875+0000","last_became_active":"2023-11-04T01:38:20.034747+0000","last_became_peered":"2023-11-04T01:38:20.034747+0000","last_unstale":"2023-11-04T01:38:21.034875+0000","last_undegraded":"2023-11-04T01:38:21.034875+0000","last_fullsized":"2023-11-04T01:38:21.034875+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:42.068163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033934+0000","last_change":"2023-11-04T01:38:19.031932+0000","last_active":"2023-11-04T01:38:21.033934+0000","last_peered":"2023-11-04T01:38:21.033934+0000","last_clean":"2023-11-04T01:38:21.033934+0000","last_became_active":"2023-11-04T01:38:19.031665+0000","last_became_peered":"2023-11-04T01:38:19.031665+0000","last_unstale":"2023-11-04T01:38:21.033934+0000","last_undegraded":"2023-11-04T01:38:21.033934+0000","last_fullsized":"2023-11-04T01:38:21.033934+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:50.677621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025636+0000","last_change":"2023-11-04T01:38:02.156342+0000","last_active":"2023-11-04T01:38:20.025636+0000","last_peered":"2023-11-04T01:38:20.025636+0000","last_clean":"2023-11-04T01:38:20.025636+0000","last_became_active":"2023-11-04T01:38:00.708159+0000","last_became_peered":"2023-11-04T01:38:00.708159+0000","last_unstale":"2023-11-04T01:38:20.025636+0000","last_undegraded":"2023-11-04T01:38:20.025636+0000","last_fullsized":"2023-11-04T01:38:20.025636+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000435213,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673663+0000","last_change":"2023-11-04T01:38:20.050969+0000","last_active":"2023-11-04T01:38:21.673663+0000","last_peered":"2023-11-04T01:38:21.673663+0000","last_clean":"2023-11-04T01:38:21.673663+0000","last_became_active":"2023-11-04T01:38:20.050719+0000","last_became_peered":"2023-11-04T01:38:20.050719+0000","last_unstale":"2023-11-04T01:38:21.673663+0000","last_undegraded":"2023-11-04T01:38:21.673663+0000","last_fullsized":"2023-11-04T01:38:21.673663+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:13.116417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675141+0000","last_change":"2023-11-04T01:38:19.037354+0000","last_active":"2023-11-04T01:38:21.675141+0000","last_peered":"2023-11-04T01:38:21.675141+0000","last_clean":"2023-11-04T01:38:21.675141+0000","last_became_active":"2023-11-04T01:38:19.036874+0000","last_became_peered":"2023-11-04T01:38:19.036874+0000","last_unstale":"2023-11-04T01:38:21.675141+0000","last_undegraded":"2023-11-04T01:38:21.675141+0000","last_fullsized":"2023-11-04T01:38:21.675141+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:29:24.114318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.033990+0000","last_change":"2023-11-04T01:38:02.362289+0000","last_active":"2023-11-04T01:38:20.033990+0000","last_peered":"2023-11-04T01:38:20.033990+0000","last_clean":"2023-11-04T01:38:20.033990+0000","last_became_active":"2023-11-04T01:38:00.710033+0000","last_became_peered":"2023-11-04T01:38:00.710033+0000","last_unstale":"2023-11-04T01:38:20.033990+0000","last_undegraded":"2023-11-04T01:38:20.033990+0000","last_fullsized":"2023-11-04T01:38:20.033990+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046467500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034007+0000","last_change":"2023-11-04T01:38:20.046647+0000","last_active":"2023-11-04T01:38:21.034007+0000","last_peered":"2023-11-04T01:38:21.034007+0000","last_clean":"2023-11-04T01:38:21.034007+0000","last_became_active":"2023-11-04T01:38:20.045600+0000","last_became_peered":"2023-11-04T01:38:20.045600+0000","last_unstale":"2023-11-04T01:38:21.034007+0000","last_undegraded":"2023-11-04T01:38:21.034007+0000","last_fullsized":"2023-11-04T01:38:21.034007+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:29:25.119418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033634+0000","last_change":"2023-11-04T01:38:19.035524+0000","last_active":"2023-11-04T01:38:21.033634+0000","last_peered":"2023-11-04T01:38:21.033634+0000","last_clean":"2023-11-04T01:38:21.033634+0000","last_became_active":"2023-11-04T01:38:19.035253+0000","last_became_peered":"2023-11-04T01:38:19.035253+0000","last_unstale":"2023-11-04T01:38:21.033634+0000","last_undegraded":"2023-11-04T01:38:21.033634+0000","last_fullsized":"2023-11-04T01:38:21.033634+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:58:46.450993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.024830+0000","last_change":"2023-11-04T01:38:01.699171+0000","last_active":"2023-11-04T01:38:20.024830+0000","last_peered":"2023-11-04T01:38:20.024830+0000","last_clean":"2023-11-04T01:38:20.024830+0000","last_became_active":"2023-11-04T01:38:00.703927+0000","last_became_peered":"2023-11-04T01:38:00.703927+0000","last_unstale":"2023-11-04T01:38:20.024830+0000","last_undegraded":"2023-11-04T01:38:20.024830+0000","last_fullsized":"2023-11-04T01:38:20.024830+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072585499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035185+0000","last_change":"2023-11-04T01:38:20.042592+0000","last_active":"2023-11-04T01:38:21.035185+0000","last_peered":"2023-11-04T01:38:21.035185+0000","last_clean":"2023-11-04T01:38:21.035185+0000","last_became_active":"2023-11-04T01:38:20.041836+0000","last_became_peered":"2023-11-04T01:38:20.041836+0000","last_unstale":"2023-11-04T01:38:21.035185+0000","last_undegraded":"2023-11-04T01:38:21.035185+0000","last_fullsized":"2023-11-04T01:38:21.035185+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:12.069863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673588+0000","last_change":"2023-11-04T01:38:19.035245+0000","last_active":"2023-11-04T01:38:21.673588+0000","last_peered":"2023-11-04T01:38:21.673588+0000","last_clean":"2023-11-04T01:38:21.673588+0000","last_became_active":"2023-11-04T01:38:19.034978+0000","last_became_peered":"2023-11-04T01:38:19.034978+0000","last_unstale":"2023-11-04T01:38:21.673588+0000","last_undegraded":"2023-11-04T01:38:21.673588+0000","last_fullsized":"2023-11-04T01:38:21.673588+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:22:36.383857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025334+0000","last_change":"2023-11-04T01:38:02.156160+0000","last_active":"2023-11-04T01:38:20.025334+0000","last_peered":"2023-11-04T01:38:20.025334+0000","last_clean":"2023-11-04T01:38:20.025334+0000","last_became_active":"2023-11-04T01:38:00.709137+0000","last_became_peered":"2023-11-04T01:38:00.709137+0000","last_unstale":"2023-11-04T01:38:20.025334+0000","last_undegraded":"2023-11-04T01:38:20.025334+0000","last_fullsized":"2023-11-04T01:38:20.025334+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028239399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035851+0000","last_change":"2023-11-04T01:38:20.035081+0000","last_active":"2023-11-04T01:38:21.035851+0000","last_peered":"2023-11-04T01:38:21.035851+0000","last_clean":"2023-11-04T01:38:21.035851+0000","last_became_active":"2023-11-04T01:38:20.034778+0000","last_became_peered":"2023-11-04T01:38:20.034778+0000","last_unstale":"2023-11-04T01:38:21.035851+0000","last_undegraded":"2023-11-04T01:38:21.035851+0000","last_fullsized":"2023-11-04T01:38:21.035851+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:17:19.236320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675336+0000","last_change":"2023-11-04T01:38:19.037605+0000","last_active":"2023-11-04T01:38:21.675336+0000","last_peered":"2023-11-04T01:38:21.675336+0000","last_clean":"2023-11-04T01:38:21.675336+0000","last_became_active":"2023-11-04T01:38:19.037364+0000","last_became_peered":"2023-11-04T01:38:19.037364+0000","last_unstale":"2023-11-04T01:38:21.675336+0000","last_undegraded":"2023-11-04T01:38:21.675336+0000","last_fullsized":"2023-11-04T01:38:21.675336+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:37:51.187753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.024656+0000","last_change":"2023-11-04T01:38:01.698196+0000","last_active":"2023-11-04T01:38:20.024656+0000","last_peered":"2023-11-04T01:38:20.024656+0000","last_clean":"2023-11-04T01:38:20.024656+0000","last_became_active":"2023-11-04T01:38:00.705451+0000","last_became_peered":"2023-11-04T01:38:00.705451+0000","last_unstale":"2023-11-04T01:38:20.024656+0000","last_undegraded":"2023-11-04T01:38:20.024656+0000","last_fullsized":"2023-11-04T01:38:20.024656+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:16.759249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067668100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035195+0000","last_change":"2023-11-04T01:38:20.050980+0000","last_active":"2023-11-04T01:38:21.035195+0000","last_peered":"2023-11-04T01:38:21.035195+0000","last_clean":"2023-11-04T01:38:21.035195+0000","last_became_active":"2023-11-04T01:38:20.050697+0000","last_became_peered":"2023-11-04T01:38:20.050697+0000","last_unstale":"2023-11-04T01:38:21.035195+0000","last_undegraded":"2023-11-04T01:38:21.035195+0000","last_fullsized":"2023-11-04T01:38:21.035195+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:00.166299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035835+0000","last_change":"2023-11-04T01:38:19.039458+0000","last_active":"2023-11-04T01:38:21.035835+0000","last_peered":"2023-11-04T01:38:21.035835+0000","last_clean":"2023-11-04T01:38:21.035835+0000","last_became_active":"2023-11-04T01:38:19.039141+0000","last_became_peered":"2023-11-04T01:38:19.039141+0000","last_unstale":"2023-11-04T01:38:21.035835+0000","last_undegraded":"2023-11-04T01:38:21.035835+0000","last_fullsized":"2023-11-04T01:38:21.035835+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:22:36.383857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026612+0000","last_change":"2023-11-04T01:38:01.983991+0000","last_active":"2023-11-04T01:38:20.026612+0000","last_peered":"2023-11-04T01:38:20.026612+0000","last_clean":"2023-11-04T01:38:20.026612+0000","last_became_active":"2023-11-04T01:38:00.708462+0000","last_became_peered":"2023-11-04T01:38:00.708462+0000","last_unstale":"2023-11-04T01:38:20.026612+0000","last_undegraded":"2023-11-04T01:38:20.026612+0000","last_fullsized":"2023-11-04T01:38:20.026612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:37.727651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041811600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035839+0000","last_change":"2023-11-04T01:38:20.036153+0000","last_active":"2023-11-04T01:38:21.035839+0000","last_peered":"2023-11-04T01:38:21.035839+0000","last_clean":"2023-11-04T01:38:21.035839+0000","last_became_active":"2023-11-04T01:38:20.035851+0000","last_became_peered":"2023-11-04T01:38:20.035851+0000","last_unstale":"2023-11-04T01:38:21.035839+0000","last_undegraded":"2023-11-04T01:38:21.035839+0000","last_fullsized":"2023-11-04T01:38:21.035839+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:55.373532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035405+0000","last_change":"2023-11-04T01:38:19.039330+0000","last_active":"2023-11-04T01:38:21.035405+0000","last_peered":"2023-11-04T01:38:21.035405+0000","last_clean":"2023-11-04T01:38:21.035405+0000","last_became_active":"2023-11-04T01:38:19.039063+0000","last_became_peered":"2023-11-04T01:38:19.039063+0000","last_unstale":"2023-11-04T01:38:21.035405+0000","last_undegraded":"2023-11-04T01:38:21.035405+0000","last_fullsized":"2023-11-04T01:38:21.035405+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:57:33.405061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026083+0000","last_change":"2023-11-04T01:38:01.984341+0000","last_active":"2023-11-04T01:38:20.026083+0000","last_peered":"2023-11-04T01:38:20.026083+0000","last_clean":"2023-11-04T01:38:20.026083+0000","last_became_active":"2023-11-04T01:38:00.708307+0000","last_became_peered":"2023-11-04T01:38:00.708307+0000","last_unstale":"2023-11-04T01:38:20.026083+0000","last_undegraded":"2023-11-04T01:38:20.026083+0000","last_fullsized":"2023-11-04T01:38:20.026083+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:17.369098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053627199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673691+0000","last_change":"2023-11-04T01:38:20.039924+0000","last_active":"2023-11-04T01:38:21.673691+0000","last_peered":"2023-11-04T01:38:21.673691+0000","last_clean":"2023-11-04T01:38:21.673691+0000","last_became_active":"2023-11-04T01:38:20.039662+0000","last_became_peered":"2023-11-04T01:38:20.039662+0000","last_unstale":"2023-11-04T01:38:21.673691+0000","last_undegraded":"2023-11-04T01:38:21.673691+0000","last_fullsized":"2023-11-04T01:38:21.673691+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:46.087745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035678+0000","last_change":"2023-11-04T01:38:19.033659+0000","last_active":"2023-11-04T01:38:21.035678+0000","last_peered":"2023-11-04T01:38:21.035678+0000","last_clean":"2023-11-04T01:38:21.035678+0000","last_became_active":"2023-11-04T01:38:19.033376+0000","last_became_peered":"2023-11-04T01:38:19.033376+0000","last_unstale":"2023-11-04T01:38:21.035678+0000","last_undegraded":"2023-11-04T01:38:21.035678+0000","last_fullsized":"2023-11-04T01:38:21.035678+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:41:45.674982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.033795+0000","last_change":"2023-11-04T01:38:01.700471+0000","last_active":"2023-11-04T01:38:20.033795+0000","last_peered":"2023-11-04T01:38:20.033795+0000","last_clean":"2023-11-04T01:38:20.033795+0000","last_became_active":"2023-11-04T01:38:00.702522+0000","last_became_peered":"2023-11-04T01:38:00.702522+0000","last_unstale":"2023-11-04T01:38:20.033795+0000","last_undegraded":"2023-11-04T01:38:20.033795+0000","last_fullsized":"2023-11-04T01:38:20.033795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086940300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675059+0000","last_change":"2023-11-04T01:38:20.045928+0000","last_active":"2023-11-04T01:38:21.675059+0000","last_peered":"2023-11-04T01:38:21.675059+0000","last_clean":"2023-11-04T01:38:21.675059+0000","last_became_active":"2023-11-04T01:38:20.045655+0000","last_became_peered":"2023-11-04T01:38:20.045655+0000","last_unstale":"2023-11-04T01:38:21.675059+0000","last_undegraded":"2023-11-04T01:38:21.675059+0000","last_fullsized":"2023-11-04T01:38:21.675059+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:04.967285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673758+0000","last_change":"2023-11-04T01:38:19.038158+0000","last_active":"2023-11-04T01:38:21.673758+0000","last_peered":"2023-11-04T01:38:21.673758+0000","last_clean":"2023-11-04T01:38:21.673758+0000","last_became_active":"2023-11-04T01:38:19.037906+0000","last_became_peered":"2023-11-04T01:38:19.037906+0000","last_unstale":"2023-11-04T01:38:21.673758+0000","last_undegraded":"2023-11-04T01:38:21.673758+0000","last_fullsized":"2023-11-04T01:38:21.673758+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:46:26.432698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026970+0000","last_change":"2023-11-04T01:38:01.696901+0000","last_active":"2023-11-04T01:38:20.026970+0000","last_peered":"2023-11-04T01:38:20.026970+0000","last_clean":"2023-11-04T01:38:20.026970+0000","last_became_active":"2023-11-04T01:38:00.706170+0000","last_became_peered":"2023-11-04T01:38:00.706170+0000","last_unstale":"2023-11-04T01:38:20.026970+0000","last_undegraded":"2023-11-04T01:38:20.026970+0000","last_fullsized":"2023-11-04T01:38:20.026970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059391100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674835+0000","last_change":"2023-11-04T01:38:20.045308+0000","last_active":"2023-11-04T01:38:21.674835+0000","last_peered":"2023-11-04T01:38:21.674835+0000","last_clean":"2023-11-04T01:38:21.674835+0000","last_became_active":"2023-11-04T01:38:20.045053+0000","last_became_peered":"2023-11-04T01:38:20.045053+0000","last_unstale":"2023-11-04T01:38:21.674835+0000","last_undegraded":"2023-11-04T01:38:21.674835+0000","last_fullsized":"2023-11-04T01:38:21.674835+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:17:19.236320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035078+0000","last_change":"2023-11-04T01:38:19.034665+0000","last_active":"2023-11-04T01:38:21.035078+0000","last_peered":"2023-11-04T01:38:21.035078+0000","last_clean":"2023-11-04T01:38:21.035078+0000","last_became_active":"2023-11-04T01:38:19.034325+0000","last_became_peered":"2023-11-04T01:38:19.034325+0000","last_unstale":"2023-11-04T01:38:21.035078+0000","last_undegraded":"2023-11-04T01:38:21.035078+0000","last_fullsized":"2023-11-04T01:38:21.035078+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:37.353020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.040306+0000","last_change":"2023-11-04T01:38:01.939972+0000","last_active":"2023-11-04T01:38:20.040306+0000","last_peered":"2023-11-04T01:38:20.040306+0000","last_clean":"2023-11-04T01:38:20.040306+0000","last_became_active":"2023-11-04T01:38:00.702784+0000","last_became_peered":"2023-11-04T01:38:00.702784+0000","last_unstale":"2023-11-04T01:38:20.040306+0000","last_undegraded":"2023-11-04T01:38:20.040306+0000","last_fullsized":"2023-11-04T01:38:20.040306+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:26.760402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071328600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674770+0000","last_change":"2023-11-04T01:38:20.042335+0000","last_active":"2023-11-04T01:38:21.674770+0000","last_peered":"2023-11-04T01:38:21.674770+0000","last_clean":"2023-11-04T01:38:21.674770+0000","last_became_active":"2023-11-04T01:38:20.041831+0000","last_became_peered":"2023-11-04T01:38:20.041831+0000","last_unstale":"2023-11-04T01:38:21.674770+0000","last_undegraded":"2023-11-04T01:38:21.674770+0000","last_fullsized":"2023-11-04T01:38:21.674770+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:55.373532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035305+0000","last_change":"2023-11-04T01:38:19.037726+0000","last_active":"2023-11-04T01:38:21.035305+0000","last_peered":"2023-11-04T01:38:21.035305+0000","last_clean":"2023-11-04T01:38:21.035305+0000","last_became_active":"2023-11-04T01:38:19.037459+0000","last_became_peered":"2023-11-04T01:38:19.037459+0000","last_unstale":"2023-11-04T01:38:21.035305+0000","last_undegraded":"2023-11-04T01:38:21.035305+0000","last_fullsized":"2023-11-04T01:38:21.035305+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:45.082645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.027534+0000","last_change":"2023-11-04T01:38:01.699051+0000","last_active":"2023-11-04T01:38:20.027534+0000","last_peered":"2023-11-04T01:38:20.027534+0000","last_clean":"2023-11-04T01:38:20.027534+0000","last_became_active":"2023-11-04T01:38:00.708665+0000","last_became_peered":"2023-11-04T01:38:00.708665+0000","last_unstale":"2023-11-04T01:38:20.027534+0000","last_undegraded":"2023-11-04T01:38:20.027534+0000","last_fullsized":"2023-11-04T01:38:20.027534+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020995580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034089+0000","last_change":"2023-11-04T01:38:20.037174+0000","last_active":"2023-11-04T01:38:21.034089+0000","last_peered":"2023-11-04T01:38:21.034089+0000","last_clean":"2023-11-04T01:38:21.034089+0000","last_became_active":"2023-11-04T01:38:20.036695+0000","last_became_peered":"2023-11-04T01:38:20.036695+0000","last_unstale":"2023-11-04T01:38:21.034089+0000","last_undegraded":"2023-11-04T01:38:21.034089+0000","last_fullsized":"2023-11-04T01:38:21.034089+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:38.358120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673587+0000","last_change":"2023-11-04T01:38:19.034220+0000","last_active":"2023-11-04T01:38:21.673587+0000","last_peered":"2023-11-04T01:38:21.673587+0000","last_clean":"2023-11-04T01:38:21.673587+0000","last_became_active":"2023-11-04T01:38:19.033675+0000","last_became_peered":"2023-11-04T01:38:19.033675+0000","last_unstale":"2023-11-04T01:38:21.673587+0000","last_undegraded":"2023-11-04T01:38:21.673587+0000","last_fullsized":"2023-11-04T01:38:21.673587+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:03.869363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.034399+0000","last_change":"2023-11-04T01:38:01.700742+0000","last_active":"2023-11-04T01:38:20.034399+0000","last_peered":"2023-11-04T01:38:20.034399+0000","last_clean":"2023-11-04T01:38:20.034399+0000","last_became_active":"2023-11-04T01:38:00.706671+0000","last_became_peered":"2023-11-04T01:38:00.706671+0000","last_unstale":"2023-11-04T01:38:20.034399+0000","last_undegraded":"2023-11-04T01:38:20.034399+0000","last_fullsized":"2023-11-04T01:38:20.034399+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072370699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674120+0000","last_change":"2023-11-04T01:38:20.038173+0000","last_active":"2023-11-04T01:38:21.674120+0000","last_peered":"2023-11-04T01:38:21.674120+0000","last_clean":"2023-11-04T01:38:21.674120+0000","last_became_active":"2023-11-04T01:38:20.037915+0000","last_became_peered":"2023-11-04T01:38:20.037915+0000","last_unstale":"2023-11-04T01:38:21.674120+0000","last_undegraded":"2023-11-04T01:38:21.674120+0000","last_fullsized":"2023-11-04T01:38:21.674120+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:38:22.194989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675318+0000","last_change":"2023-11-04T01:38:19.036037+0000","last_active":"2023-11-04T01:38:21.675318+0000","last_peered":"2023-11-04T01:38:21.675318+0000","last_clean":"2023-11-04T01:38:21.675318+0000","last_became_active":"2023-11-04T01:38:19.035785+0000","last_became_peered":"2023-11-04T01:38:19.035785+0000","last_unstale":"2023-11-04T01:38:21.675318+0000","last_undegraded":"2023-11-04T01:38:21.675318+0000","last_fullsized":"2023-11-04T01:38:21.675318+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:06.620841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025946+0000","last_change":"2023-11-04T01:38:01.697526+0000","last_active":"2023-11-04T01:38:20.025946+0000","last_peered":"2023-11-04T01:38:20.025946+0000","last_clean":"2023-11-04T01:38:20.025946+0000","last_became_active":"2023-11-04T01:38:00.707580+0000","last_became_peered":"2023-11-04T01:38:00.707580+0000","last_unstale":"2023-11-04T01:38:20.025946+0000","last_undegraded":"2023-11-04T01:38:20.025946+0000","last_fullsized":"2023-11-04T01:38:20.025946+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010806699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674144+0000","last_change":"2023-11-04T01:38:20.037669+0000","last_active":"2023-11-04T01:38:21.674144+0000","last_peered":"2023-11-04T01:38:21.674144+0000","last_clean":"2023-11-04T01:38:21.674144+0000","last_became_active":"2023-11-04T01:38:20.037409+0000","last_became_peered":"2023-11-04T01:38:20.037409+0000","last_unstale":"2023-11-04T01:38:21.674144+0000","last_undegraded":"2023-11-04T01:38:21.674144+0000","last_fullsized":"2023-11-04T01:38:21.674144+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:13.116417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674012+0000","last_change":"2023-11-04T01:38:19.039222+0000","last_active":"2023-11-04T01:38:21.674012+0000","last_peered":"2023-11-04T01:38:21.674012+0000","last_clean":"2023-11-04T01:38:21.674012+0000","last_became_active":"2023-11-04T01:38:19.038641+0000","last_became_peered":"2023-11-04T01:38:19.038641+0000","last_unstale":"2023-11-04T01:38:21.674012+0000","last_undegraded":"2023-11-04T01:38:21.674012+0000","last_fullsized":"2023-11-04T01:38:21.674012+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:59.161199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.035103+0000","last_change":"2023-11-04T01:38:01.939462+0000","last_active":"2023-11-04T01:38:20.035103+0000","last_peered":"2023-11-04T01:38:20.035103+0000","last_clean":"2023-11-04T01:38:20.035103+0000","last_became_active":"2023-11-04T01:38:00.705830+0000","last_became_peered":"2023-11-04T01:38:00.705830+0000","last_unstale":"2023-11-04T01:38:20.035103+0000","last_undegraded":"2023-11-04T01:38:20.035103+0000","last_fullsized":"2023-11-04T01:38:20.035103+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059305000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674368+0000","last_change":"2023-11-04T01:38:20.041751+0000","last_active":"2023-11-04T01:38:21.674368+0000","last_peered":"2023-11-04T01:38:21.674368+0000","last_clean":"2023-11-04T01:38:21.674368+0000","last_became_active":"2023-11-04T01:38:20.041457+0000","last_became_peered":"2023-11-04T01:38:20.041457+0000","last_unstale":"2023-11-04T01:38:21.674368+0000","last_undegraded":"2023-11-04T01:38:21.674368+0000","last_fullsized":"2023-11-04T01:38:21.674368+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:29:25.119418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673850+0000","last_change":"2023-11-04T01:38:19.035414+0000","last_active":"2023-11-04T01:38:21.673850+0000","last_peered":"2023-11-04T01:38:21.673850+0000","last_clean":"2023-11-04T01:38:21.673850+0000","last_became_active":"2023-11-04T01:38:19.035150+0000","last_became_peered":"2023-11-04T01:38:19.035150+0000","last_unstale":"2023-11-04T01:38:21.673850+0000","last_undegraded":"2023-11-04T01:38:21.673850+0000","last_fullsized":"2023-11-04T01:38:21.673850+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:41:45.674982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026156+0000","last_change":"2023-11-04T01:38:01.984456+0000","last_active":"2023-11-04T01:38:20.026156+0000","last_peered":"2023-11-04T01:38:20.026156+0000","last_clean":"2023-11-04T01:38:20.026156+0000","last_became_active":"2023-11-04T01:38:00.708803+0000","last_became_peered":"2023-11-04T01:38:00.708803+0000","last_unstale":"2023-11-04T01:38:20.026156+0000","last_undegraded":"2023-11-04T01:38:20.026156+0000","last_fullsized":"2023-11-04T01:38:20.026156+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:30.811033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061551599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674187+0000","last_change":"2023-11-04T01:38:20.037620+0000","last_active":"2023-11-04T01:38:21.674187+0000","last_peered":"2023-11-04T01:38:21.674187+0000","last_clean":"2023-11-04T01:38:21.674187+0000","last_became_active":"2023-11-04T01:38:20.037323+0000","last_became_peered":"2023-11-04T01:38:20.037323+0000","last_unstale":"2023-11-04T01:38:21.674187+0000","last_undegraded":"2023-11-04T01:38:21.674187+0000","last_fullsized":"2023-11-04T01:38:21.674187+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:22.724353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674442+0000","last_change":"2023-11-04T01:38:19.039493+0000","last_active":"2023-11-04T01:38:21.674442+0000","last_peered":"2023-11-04T01:38:21.674442+0000","last_clean":"2023-11-04T01:38:21.674442+0000","last_became_active":"2023-11-04T01:38:19.039255+0000","last_became_peered":"2023-11-04T01:38:19.039255+0000","last_unstale":"2023-11-04T01:38:21.674442+0000","last_undegraded":"2023-11-04T01:38:21.674442+0000","last_fullsized":"2023-11-04T01:38:21.674442+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:27.992870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025849+0000","last_change":"2023-11-04T01:38:01.698866+0000","last_active":"2023-11-04T01:38:20.025849+0000","last_peered":"2023-11-04T01:38:20.025849+0000","last_clean":"2023-11-04T01:38:20.025849+0000","last_became_active":"2023-11-04T01:38:00.706149+0000","last_became_peered":"2023-11-04T01:38:00.706149+0000","last_unstale":"2023-11-04T01:38:20.025849+0000","last_undegraded":"2023-11-04T01:38:20.025849+0000","last_fullsized":"2023-11-04T01:38:20.025849+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:59.391683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001344154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035004+0000","last_change":"2023-11-04T01:38:20.047057+0000","last_active":"2023-11-04T01:38:21.035004+0000","last_peered":"2023-11-04T01:38:21.035004+0000","last_clean":"2023-11-04T01:38:21.035004+0000","last_became_active":"2023-11-04T01:38:20.046753+0000","last_became_peered":"2023-11-04T01:38:20.046753+0000","last_unstale":"2023-11-04T01:38:21.035004+0000","last_undegraded":"2023-11-04T01:38:21.035004+0000","last_fullsized":"2023-11-04T01:38:21.035004+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:07.625941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035408+0000","last_change":"2023-11-04T01:38:19.043265+0000","last_active":"2023-11-04T01:38:21.035408+0000","last_peered":"2023-11-04T01:38:21.035408+0000","last_clean":"2023-11-04T01:38:21.035408+0000","last_became_active":"2023-11-04T01:38:19.043036+0000","last_became_peered":"2023-11-04T01:38:19.043036+0000","last_unstale":"2023-11-04T01:38:21.035408+0000","last_undegraded":"2023-11-04T01:38:21.035408+0000","last_fullsized":"2023-11-04T01:38:21.035408+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:50.175265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025122+0000","last_change":"2023-11-04T01:38:01.699187+0000","last_active":"2023-11-04T01:38:20.025122+0000","last_peered":"2023-11-04T01:38:20.025122+0000","last_clean":"2023-11-04T01:38:20.025122+0000","last_became_active":"2023-11-04T01:38:00.706136+0000","last_became_peered":"2023-11-04T01:38:00.706136+0000","last_unstale":"2023-11-04T01:38:20.025122+0000","last_undegraded":"2023-11-04T01:38:20.025122+0000","last_fullsized":"2023-11-04T01:38:20.025122+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074666999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674880+0000","last_change":"2023-11-04T01:38:20.043562+0000","last_active":"2023-11-04T01:38:21.674880+0000","last_peered":"2023-11-04T01:38:21.674880+0000","last_clean":"2023-11-04T01:38:21.674880+0000","last_became_active":"2023-11-04T01:38:20.043168+0000","last_became_peered":"2023-11-04T01:38:20.043168+0000","last_unstale":"2023-11-04T01:38:21.674880+0000","last_undegraded":"2023-11-04T01:38:21.674880+0000","last_fullsized":"2023-11-04T01:38:21.674880+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:32:23.561456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673612+0000","last_change":"2023-11-04T01:38:19.033980+0000","last_active":"2023-11-04T01:38:21.673612+0000","last_peered":"2023-11-04T01:38:21.673612+0000","last_clean":"2023-11-04T01:38:21.673612+0000","last_became_active":"2023-11-04T01:38:19.033687+0000","last_became_peered":"2023-11-04T01:38:19.033687+0000","last_unstale":"2023-11-04T01:38:21.673612+0000","last_undegraded":"2023-11-04T01:38:21.673612+0000","last_fullsized":"2023-11-04T01:38:21.673612+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:18:55.720099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026532+0000","last_change":"2023-11-04T01:38:01.699630+0000","last_active":"2023-11-04T01:38:20.026532+0000","last_peered":"2023-11-04T01:38:20.026532+0000","last_clean":"2023-11-04T01:38:20.026532+0000","last_became_active":"2023-11-04T01:38:00.702550+0000","last_became_peered":"2023-11-04T01:38:00.702550+0000","last_unstale":"2023-11-04T01:38:20.026532+0000","last_undegraded":"2023-11-04T01:38:20.026532+0000","last_fullsized":"2023-11-04T01:38:20.026532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001016077,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675025+0000","last_change":"2023-11-04T01:38:20.042484+0000","last_active":"2023-11-04T01:38:21.675025+0000","last_peered":"2023-11-04T01:38:21.675025+0000","last_clean":"2023-11-04T01:38:21.675025+0000","last_became_active":"2023-11-04T01:38:20.042102+0000","last_became_peered":"2023-11-04T01:38:20.042102+0000","last_unstale":"2023-11-04T01:38:21.675025+0000","last_undegraded":"2023-11-04T01:38:21.675025+0000","last_fullsized":"2023-11-04T01:38:21.675025+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:33:40.713323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674757+0000","last_change":"2023-11-04T01:38:19.037850+0000","last_active":"2023-11-04T01:38:21.674757+0000","last_peered":"2023-11-04T01:38:21.674757+0000","last_clean":"2023-11-04T01:38:21.674757+0000","last_became_active":"2023-11-04T01:38:19.036655+0000","last_became_peered":"2023-11-04T01:38:19.036655+0000","last_unstale":"2023-11-04T01:38:21.674757+0000","last_undegraded":"2023-11-04T01:38:21.674757+0000","last_fullsized":"2023-11-04T01:38:21.674757+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:34.454786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025967+0000","last_change":"2023-11-04T01:38:01.984764+0000","last_active":"2023-11-04T01:38:20.025967+0000","last_peered":"2023-11-04T01:38:20.025967+0000","last_clean":"2023-11-04T01:38:20.025967+0000","last_became_active":"2023-11-04T01:38:00.709894+0000","last_became_peered":"2023-11-04T01:38:00.709894+0000","last_unstale":"2023-11-04T01:38:20.025967+0000","last_undegraded":"2023-11-04T01:38:20.025967+0000","last_fullsized":"2023-11-04T01:38:20.025967+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:08:42.829255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045046799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674470+0000","last_change":"2023-11-04T01:38:20.035044+0000","last_active":"2023-11-04T01:38:21.674470+0000","last_peered":"2023-11-04T01:38:21.674470+0000","last_clean":"2023-11-04T01:38:21.674470+0000","last_became_active":"2023-11-04T01:38:20.034798+0000","last_became_peered":"2023-11-04T01:38:20.034798+0000","last_unstale":"2023-11-04T01:38:21.674470+0000","last_undegraded":"2023-11-04T01:38:21.674470+0000","last_fullsized":"2023-11-04T01:38:21.674470+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:12.069863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673343+0000","last_change":"2023-11-04T01:38:19.040119+0000","last_active":"2023-11-04T01:38:21.673343+0000","last_peered":"2023-11-04T01:38:21.673343+0000","last_clean":"2023-11-04T01:38:21.673343+0000","last_became_active":"2023-11-04T01:38:19.039671+0000","last_became_peered":"2023-11-04T01:38:19.039671+0000","last_unstale":"2023-11-04T01:38:21.673343+0000","last_undegraded":"2023-11-04T01:38:21.673343+0000","last_fullsized":"2023-11-04T01:38:21.673343+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:27.960389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.030006+0000","last_change":"2023-11-04T01:38:02.321871+0000","last_active":"2023-11-04T01:38:20.030006+0000","last_peered":"2023-11-04T01:38:20.030006+0000","last_clean":"2023-11-04T01:38:20.030006+0000","last_became_active":"2023-11-04T01:38:00.708407+0000","last_became_peered":"2023-11-04T01:38:00.708407+0000","last_unstale":"2023-11-04T01:38:20.030006+0000","last_undegraded":"2023-11-04T01:38:20.030006+0000","last_fullsized":"2023-11-04T01:38:20.030006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:48.672429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032387200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674136+0000","last_change":"2023-11-04T01:38:20.046019+0000","last_active":"2023-11-04T01:38:21.674136+0000","last_peered":"2023-11-04T01:38:21.674136+0000","last_clean":"2023-11-04T01:38:21.674136+0000","last_became_active":"2023-11-04T01:38:20.045295+0000","last_became_peered":"2023-11-04T01:38:20.045295+0000","last_unstale":"2023-11-04T01:38:21.674136+0000","last_undegraded":"2023-11-04T01:38:21.674136+0000","last_fullsized":"2023-11-04T01:38:21.674136+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:07.625941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674334+0000","last_change":"2023-11-04T01:38:19.037308+0000","last_active":"2023-11-04T01:38:21.674334+0000","last_peered":"2023-11-04T01:38:21.674334+0000","last_clean":"2023-11-04T01:38:21.674334+0000","last_became_active":"2023-11-04T01:38:19.037030+0000","last_became_peered":"2023-11-04T01:38:19.037030+0000","last_unstale":"2023-11-04T01:38:21.674334+0000","last_undegraded":"2023-11-04T01:38:21.674334+0000","last_fullsized":"2023-11-04T01:38:21.674334+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:41.910027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026703+0000","last_change":"2023-11-04T01:38:01.983988+0000","last_active":"2023-11-04T01:38:20.026703+0000","last_peered":"2023-11-04T01:38:20.026703+0000","last_clean":"2023-11-04T01:38:20.026703+0000","last_became_active":"2023-11-04T01:38:00.711020+0000","last_became_peered":"2023-11-04T01:38:00.711020+0000","last_unstale":"2023-11-04T01:38:20.026703+0000","last_undegraded":"2023-11-04T01:38:20.026703+0000","last_fullsized":"2023-11-04T01:38:20.026703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:06.374078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674030+0000","last_change":"2023-11-04T01:38:20.043160+0000","last_active":"2023-11-04T01:38:21.674030+0000","last_peered":"2023-11-04T01:38:21.674030+0000","last_clean":"2023-11-04T01:38:21.674030+0000","last_became_active":"2023-11-04T01:38:20.042906+0000","last_became_peered":"2023-11-04T01:38:20.042906+0000","last_unstale":"2023-11-04T01:38:21.674030+0000","last_undegraded":"2023-11-04T01:38:21.674030+0000","last_fullsized":"2023-11-04T01:38:21.674030+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:42.068163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674140+0000","last_change":"2023-11-04T01:38:19.036924+0000","last_active":"2023-11-04T01:38:21.674140+0000","last_peered":"2023-11-04T01:38:21.674140+0000","last_clean":"2023-11-04T01:38:21.674140+0000","last_became_active":"2023-11-04T01:38:19.036653+0000","last_became_peered":"2023-11-04T01:38:19.036653+0000","last_unstale":"2023-11-04T01:38:21.674140+0000","last_undegraded":"2023-11-04T01:38:21.674140+0000","last_fullsized":"2023-11-04T01:38:21.674140+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:37.353020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.027634+0000","last_change":"2023-11-04T01:38:02.321641+0000","last_active":"2023-11-04T01:38:20.027634+0000","last_peered":"2023-11-04T01:38:20.027634+0000","last_clean":"2023-11-04T01:38:20.027634+0000","last_became_active":"2023-11-04T01:38:00.706199+0000","last_became_peered":"2023-11-04T01:38:00.706199+0000","last_unstale":"2023-11-04T01:38:20.027634+0000","last_undegraded":"2023-11-04T01:38:20.027634+0000","last_fullsized":"2023-11-04T01:38:20.027634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:15.138325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045080400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674411+0000","last_change":"2023-11-04T01:38:20.037896+0000","last_active":"2023-11-04T01:38:21.674411+0000","last_peered":"2023-11-04T01:38:21.674411+0000","last_clean":"2023-11-04T01:38:21.674411+0000","last_became_active":"2023-11-04T01:38:20.037634+0000","last_became_peered":"2023-11-04T01:38:20.037634+0000","last_unstale":"2023-11-04T01:38:21.674411+0000","last_undegraded":"2023-11-04T01:38:21.674411+0000","last_fullsized":"2023-11-04T01:38:21.674411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:42.068163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673947+0000","last_change":"2023-11-04T01:38:19.035871+0000","last_active":"2023-11-04T01:38:21.673947+0000","last_peered":"2023-11-04T01:38:21.673947+0000","last_clean":"2023-11-04T01:38:21.673947+0000","last_became_active":"2023-11-04T01:38:19.035611+0000","last_became_peered":"2023-11-04T01:38:19.035611+0000","last_unstale":"2023-11-04T01:38:21.673947+0000","last_undegraded":"2023-11-04T01:38:21.673947+0000","last_fullsized":"2023-11-04T01:38:21.673947+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:18:13.034093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025128+0000","last_change":"2023-11-04T01:38:02.156148+0000","last_active":"2023-11-04T01:38:20.025128+0000","last_peered":"2023-11-04T01:38:20.025128+0000","last_clean":"2023-11-04T01:38:20.025128+0000","last_became_active":"2023-11-04T01:38:00.708352+0000","last_became_peered":"2023-11-04T01:38:00.708352+0000","last_unstale":"2023-11-04T01:38:20.025128+0000","last_undegraded":"2023-11-04T01:38:20.025128+0000","last_fullsized":"2023-11-04T01:38:20.025128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035716799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673831+0000","last_change":"2023-11-04T01:38:20.039924+0000","last_active":"2023-11-04T01:38:21.673831+0000","last_peered":"2023-11-04T01:38:21.673831+0000","last_clean":"2023-11-04T01:38:21.673831+0000","last_became_active":"2023-11-04T01:38:20.039696+0000","last_became_peered":"2023-11-04T01:38:20.039696+0000","last_unstale":"2023-11-04T01:38:21.673831+0000","last_undegraded":"2023-11-04T01:38:21.673831+0000","last_fullsized":"2023-11-04T01:38:21.673831+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:57:34.410161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034108+0000","last_change":"2023-11-04T01:38:19.031312+0000","last_active":"2023-11-04T01:38:21.034108+0000","last_peered":"2023-11-04T01:38:21.034108+0000","last_clean":"2023-11-04T01:38:21.034108+0000","last_became_active":"2023-11-04T01:38:19.030697+0000","last_became_peered":"2023-11-04T01:38:19.030697+0000","last_unstale":"2023-11-04T01:38:21.034108+0000","last_undegraded":"2023-11-04T01:38:21.034108+0000","last_fullsized":"2023-11-04T01:38:21.034108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:43.411728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.040006+0000","last_change":"2023-11-04T01:38:01.939729+0000","last_active":"2023-11-04T01:38:20.040006+0000","last_peered":"2023-11-04T01:38:20.040006+0000","last_clean":"2023-11-04T01:38:20.040006+0000","last_became_active":"2023-11-04T01:38:00.704384+0000","last_became_peered":"2023-11-04T01:38:00.704384+0000","last_unstale":"2023-11-04T01:38:20.040006+0000","last_undegraded":"2023-11-04T01:38:20.040006+0000","last_fullsized":"2023-11-04T01:38:20.040006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080052200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673884+0000","last_change":"2023-11-04T01:38:20.034498+0000","last_active":"2023-11-04T01:38:21.673884+0000","last_peered":"2023-11-04T01:38:21.673884+0000","last_clean":"2023-11-04T01:38:21.673884+0000","last_became_active":"2023-11-04T01:38:20.033899+0000","last_became_peered":"2023-11-04T01:38:20.033899+0000","last_unstale":"2023-11-04T01:38:21.673884+0000","last_undegraded":"2023-11-04T01:38:21.673884+0000","last_fullsized":"2023-11-04T01:38:21.673884+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:47:02.791475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673776+0000","last_change":"2023-11-04T01:38:19.034468+0000","last_active":"2023-11-04T01:38:21.673776+0000","last_peered":"2023-11-04T01:38:21.673776+0000","last_clean":"2023-11-04T01:38:21.673776+0000","last_became_active":"2023-11-04T01:38:19.034221+0000","last_became_peered":"2023-11-04T01:38:19.034221+0000","last_unstale":"2023-11-04T01:38:21.673776+0000","last_undegraded":"2023-11-04T01:38:21.673776+0000","last_fullsized":"2023-11-04T01:38:21.673776+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:20:06.734657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.027053+0000","last_change":"2023-11-04T01:38:01.697272+0000","last_active":"2023-11-04T01:38:20.027053+0000","last_peered":"2023-11-04T01:38:20.027053+0000","last_clean":"2023-11-04T01:38:20.027053+0000","last_became_active":"2023-11-04T01:38:00.709395+0000","last_became_peered":"2023-11-04T01:38:00.709395+0000","last_unstale":"2023-11-04T01:38:20.027053+0000","last_undegraded":"2023-11-04T01:38:20.027053+0000","last_fullsized":"2023-11-04T01:38:20.027053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076665499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673660+0000","last_change":"2023-11-04T01:38:20.040105+0000","last_active":"2023-11-04T01:38:21.673660+0000","last_peered":"2023-11-04T01:38:21.673660+0000","last_clean":"2023-11-04T01:38:21.673660+0000","last_became_active":"2023-11-04T01:38:20.039595+0000","last_became_peered":"2023-11-04T01:38:20.039595+0000","last_unstale":"2023-11-04T01:38:21.673660+0000","last_undegraded":"2023-11-04T01:38:21.673660+0000","last_fullsized":"2023-11-04T01:38:21.673660+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:47:02.791475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675235+0000","last_change":"2023-11-04T01:38:19.035180+0000","last_active":"2023-11-04T01:38:21.675235+0000","last_peered":"2023-11-04T01:38:21.675235+0000","last_clean":"2023-11-04T01:38:21.675235+0000","last_became_active":"2023-11-04T01:38:19.034909+0000","last_became_peered":"2023-11-04T01:38:19.034909+0000","last_unstale":"2023-11-04T01:38:21.675235+0000","last_undegraded":"2023-11-04T01:38:21.675235+0000","last_fullsized":"2023-11-04T01:38:21.675235+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:41.063063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026616+0000","last_change":"2023-11-04T01:38:01.984567+0000","last_active":"2023-11-04T01:38:20.026616+0000","last_peered":"2023-11-04T01:38:20.026616+0000","last_clean":"2023-11-04T01:38:20.026616+0000","last_became_active":"2023-11-04T01:38:00.708020+0000","last_became_peered":"2023-11-04T01:38:00.708020+0000","last_unstale":"2023-11-04T01:38:20.026616+0000","last_undegraded":"2023-11-04T01:38:20.026616+0000","last_fullsized":"2023-11-04T01:38:20.026616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:09.638146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056906299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673592+0000","last_change":"2023-11-04T01:38:20.041668+0000","last_active":"2023-11-04T01:38:21.673592+0000","last_peered":"2023-11-04T01:38:21.673592+0000","last_clean":"2023-11-04T01:38:21.673592+0000","last_became_active":"2023-11-04T01:38:20.041410+0000","last_became_peered":"2023-11-04T01:38:20.041410+0000","last_unstale":"2023-11-04T01:38:21.673592+0000","last_undegraded":"2023-11-04T01:38:21.673592+0000","last_fullsized":"2023-11-04T01:38:21.673592+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:23:35.405508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673509+0000","last_change":"2023-11-04T01:38:19.038777+0000","last_active":"2023-11-04T01:38:21.673509+0000","last_peered":"2023-11-04T01:38:21.673509+0000","last_clean":"2023-11-04T01:38:21.673509+0000","last_became_active":"2023-11-04T01:38:19.038468+0000","last_became_peered":"2023-11-04T01:38:19.038468+0000","last_unstale":"2023-11-04T01:38:21.673509+0000","last_undegraded":"2023-11-04T01:38:21.673509+0000","last_fullsized":"2023-11-04T01:38:21.673509+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:04.103557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.024924+0000","last_change":"2023-11-04T01:38:01.699685+0000","last_active":"2023-11-04T01:38:20.024924+0000","last_peered":"2023-11-04T01:38:20.024924+0000","last_clean":"2023-11-04T01:38:20.024924+0000","last_became_active":"2023-11-04T01:38:00.706802+0000","last_became_peered":"2023-11-04T01:38:00.706802+0000","last_unstale":"2023-11-04T01:38:20.024924+0000","last_undegraded":"2023-11-04T01:38:20.024924+0000","last_fullsized":"2023-11-04T01:38:20.024924+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085845400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674147+0000","last_change":"2023-11-04T01:38:20.054374+0000","last_active":"2023-11-04T01:38:21.674147+0000","last_peered":"2023-11-04T01:38:21.674147+0000","last_clean":"2023-11-04T01:38:21.674147+0000","last_became_active":"2023-11-04T01:38:20.054116+0000","last_became_peered":"2023-11-04T01:38:20.054116+0000","last_unstale":"2023-11-04T01:38:21.674147+0000","last_undegraded":"2023-11-04T01:38:21.674147+0000","last_fullsized":"2023-11-04T01:38:21.674147+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:37:52.192853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674217+0000","last_change":"2023-11-04T01:38:19.038783+0000","last_active":"2023-11-04T01:38:21.674217+0000","last_peered":"2023-11-04T01:38:21.674217+0000","last_clean":"2023-11-04T01:38:21.674217+0000","last_became_active":"2023-11-04T01:38:19.038529+0000","last_became_peered":"2023-11-04T01:38:19.038529+0000","last_unstale":"2023-11-04T01:38:21.674217+0000","last_undegraded":"2023-11-04T01:38:21.674217+0000","last_fullsized":"2023-11-04T01:38:21.674217+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:39.781516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.033827+0000","last_change":"2023-11-04T01:38:01.700399+0000","last_active":"2023-11-04T01:38:20.033827+0000","last_peered":"2023-11-04T01:38:20.033827+0000","last_clean":"2023-11-04T01:38:20.033827+0000","last_became_active":"2023-11-04T01:38:00.701352+0000","last_became_peered":"2023-11-04T01:38:00.701352+0000","last_unstale":"2023-11-04T01:38:20.033827+0000","last_undegraded":"2023-11-04T01:38:20.033827+0000","last_fullsized":"2023-11-04T01:38:20.033827+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078589399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035927+0000","last_change":"2023-11-04T01:38:20.035907+0000","last_active":"2023-11-04T01:38:21.035927+0000","last_peered":"2023-11-04T01:38:21.035927+0000","last_clean":"2023-11-04T01:38:21.035927+0000","last_became_active":"2023-11-04T01:38:20.035487+0000","last_became_peered":"2023-11-04T01:38:20.035487+0000","last_unstale":"2023-11-04T01:38:21.035927+0000","last_undegraded":"2023-11-04T01:38:21.035927+0000","last_fullsized":"2023-11-04T01:38:21.035927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:32:23.561456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675407+0000","last_change":"2023-11-04T01:38:19.037147+0000","last_active":"2023-11-04T01:38:21.675407+0000","last_peered":"2023-11-04T01:38:21.675407+0000","last_clean":"2023-11-04T01:38:21.675407+0000","last_became_active":"2023-11-04T01:38:19.036862+0000","last_became_peered":"2023-11-04T01:38:19.036862+0000","last_unstale":"2023-11-04T01:38:21.675407+0000","last_undegraded":"2023-11-04T01:38:21.675407+0000","last_fullsized":"2023-11-04T01:38:21.675407+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:56.458934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.032215+0000","last_change":"2023-11-04T01:38:02.362072+0000","last_active":"2023-11-04T01:38:20.032215+0000","last_peered":"2023-11-04T01:38:20.032215+0000","last_clean":"2023-11-04T01:38:20.032215+0000","last_became_active":"2023-11-04T01:38:00.710897+0000","last_became_peered":"2023-11-04T01:38:00.710897+0000","last_unstale":"2023-11-04T01:38:20.032215+0000","last_undegraded":"2023-11-04T01:38:20.032215+0000","last_fullsized":"2023-11-04T01:38:20.032215+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:25.229838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058055900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035563+0000","last_change":"2023-11-04T01:38:20.035410+0000","last_active":"2023-11-04T01:38:21.035563+0000","last_peered":"2023-11-04T01:38:21.035563+0000","last_clean":"2023-11-04T01:38:21.035563+0000","last_became_active":"2023-11-04T01:38:20.034871+0000","last_became_peered":"2023-11-04T01:38:20.034871+0000","last_unstale":"2023-11-04T01:38:21.035563+0000","last_undegraded":"2023-11-04T01:38:21.035563+0000","last_fullsized":"2023-11-04T01:38:21.035563+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:57.464034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674269+0000","last_change":"2023-11-04T01:38:19.040085+0000","last_active":"2023-11-04T01:38:21.674269+0000","last_peered":"2023-11-04T01:38:21.674269+0000","last_clean":"2023-11-04T01:38:21.674269+0000","last_became_active":"2023-11-04T01:38:19.038670+0000","last_became_peered":"2023-11-04T01:38:19.038670+0000","last_unstale":"2023-11-04T01:38:21.674269+0000","last_undegraded":"2023-11-04T01:38:21.674269+0000","last_fullsized":"2023-11-04T01:38:21.674269+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:42:38.429638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.038809+0000","last_change":"2023-11-04T01:38:01.939857+0000","last_active":"2023-11-04T01:38:20.038809+0000","last_peered":"2023-11-04T01:38:20.038809+0000","last_clean":"2023-11-04T01:38:20.038809+0000","last_became_active":"2023-11-04T01:38:00.701371+0000","last_became_peered":"2023-11-04T01:38:00.701371+0000","last_unstale":"2023-11-04T01:38:20.038809+0000","last_undegraded":"2023-11-04T01:38:20.038809+0000","last_fullsized":"2023-11-04T01:38:20.038809+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078632099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675284+0000","last_change":"2023-11-04T01:38:20.047127+0000","last_active":"2023-11-04T01:38:21.675284+0000","last_peered":"2023-11-04T01:38:21.675284+0000","last_clean":"2023-11-04T01:38:21.675284+0000","last_became_active":"2023-11-04T01:38:20.046835+0000","last_became_peered":"2023-11-04T01:38:20.046835+0000","last_unstale":"2023-11-04T01:38:21.675284+0000","last_undegraded":"2023-11-04T01:38:21.675284+0000","last_fullsized":"2023-11-04T01:38:21.675284+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:58:25.387712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674005+0000","last_change":"2023-11-04T01:38:19.034880+0000","last_active":"2023-11-04T01:38:21.674005+0000","last_peered":"2023-11-04T01:38:21.674005+0000","last_clean":"2023-11-04T01:38:21.674005+0000","last_became_active":"2023-11-04T01:38:19.034612+0000","last_became_peered":"2023-11-04T01:38:19.034612+0000","last_unstale":"2023-11-04T01:38:21.674005+0000","last_undegraded":"2023-11-04T01:38:21.674005+0000","last_fullsized":"2023-11-04T01:38:21.674005+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:23:34.400408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.040072+0000","last_change":"2023-11-04T01:38:01.939662+0000","last_active":"2023-11-04T01:38:20.040072+0000","last_peered":"2023-11-04T01:38:20.040072+0000","last_clean":"2023-11-04T01:38:20.040072+0000","last_became_active":"2023-11-04T01:38:00.705871+0000","last_became_peered":"2023-11-04T01:38:00.705871+0000","last_unstale":"2023-11-04T01:38:20.040072+0000","last_undegraded":"2023-11-04T01:38:20.040072+0000","last_fullsized":"2023-11-04T01:38:20.040072+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066873200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675053+0000","last_change":"2023-11-04T01:38:20.046325+0000","last_active":"2023-11-04T01:38:21.675053+0000","last_peered":"2023-11-04T01:38:21.675053+0000","last_clean":"2023-11-04T01:38:21.675053+0000","last_became_active":"2023-11-04T01:38:20.045741+0000","last_became_peered":"2023-11-04T01:38:20.045741+0000","last_unstale":"2023-11-04T01:38:21.675053+0000","last_undegraded":"2023-11-04T01:38:21.675053+0000","last_fullsized":"2023-11-04T01:38:21.675053+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:33.689272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034334+0000","last_change":"2023-11-04T01:38:19.035913+0000","last_active":"2023-11-04T01:38:21.034334+0000","last_peered":"2023-11-04T01:38:21.034334+0000","last_clean":"2023-11-04T01:38:21.034334+0000","last_became_active":"2023-11-04T01:38:19.035614+0000","last_became_peered":"2023-11-04T01:38:19.035614+0000","last_unstale":"2023-11-04T01:38:21.034334+0000","last_undegraded":"2023-11-04T01:38:21.034334+0000","last_fullsized":"2023-11-04T01:38:21.034334+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:20:06.734657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025775+0000","last_change":"2023-11-04T01:38:01.984672+0000","last_active":"2023-11-04T01:38:20.025775+0000","last_peered":"2023-11-04T01:38:20.025775+0000","last_clean":"2023-11-04T01:38:20.025775+0000","last_became_active":"2023-11-04T01:38:00.706804+0000","last_became_peered":"2023-11-04T01:38:00.706804+0000","last_unstale":"2023-11-04T01:38:20.025775+0000","last_undegraded":"2023-11-04T01:38:20.025775+0000","last_fullsized":"2023-11-04T01:38:20.025775+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:48.412413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038439000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034257+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:38:21.034257+0000","last_peered":"2023-11-04T01:38:21.034257+0000","last_clean":"2023-11-04T01:38:21.034257+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:38:21.034257+0000","last_undegraded":"2023-11-04T01:38:21.034257+0000","last_fullsized":"2023-11-04T01:38:21.034257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1245184,"data_stored":883232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45300000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.318}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.38100000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.437,"15min":0.42999999999999999},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65200000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.499}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.504,"15min":0.496},"min":{"1min":0.35399999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.44,"5min":0.317,"15min":0.317},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.48099999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.48799999999999999,"15min":0.47899999999999998},"min":{"1min":0.39300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.42299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":643072,"data_stored":292704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68799999999999994,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.70099999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67600000000000005,"5min":1.05,"15min":1.05},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70099999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.51000000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.66900000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.48699999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.748,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.626},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.44,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71999999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.501,"15min":0.501},"min":{"1min":0.373,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.373}]},{"osd":5,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81899999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.38,"5min":0.372,"15min":0.372},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.434}]},{"osd":7,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.67900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":293356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.58399999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55000000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.624},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.59899999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.67200000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.44400000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.56799999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.53300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":294316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.442},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.65800000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52400000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82099999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.55500000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72199999999999998,"5min":0.879,"15min":0.879},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85499999999999998,"5min":1.089,"15min":1.089},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.33600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48499999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.34100000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.50700000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.40000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92500000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":292760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.311}]},{"osd":1,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.36499999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.5}]},{"osd":6,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.58399999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":292760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.32500000000000001,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.442,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.33600000000000002,"15min":0.34300000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.39300000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.29099999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.48399999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.31},{"interface":"front","average":{"1min":0.317,"5min":0.39100000000000001,"15min":0.40300000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.44,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.36299999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.40899999999999997,"15min":0.42099999999999999},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.51500000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.42099999999999999,"15min":0.433},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.46999999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.32900000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.63900000000000001,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.82399999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.45200000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68400000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.68300000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.877,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79700000000000004,"5min":1,"15min":1},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61199999999999999,"15min":0.62},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73099999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55800000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76200000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":647168,"data_stored":292794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.39500000000000002,"15min":0.36099999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":5.415},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.42599999999999999,"15min":0.41199999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":3.456,"5min":3.456,"15min":3.456},"last":3.456}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":2.355},{"interface":"front","average":{"1min":0.5,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":2.5299999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.52600000000000002,"15min":0.47099999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":8.891,"5min":8.891,"15min":8.891},"last":8.891},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.46800000000000003,"15min":0.39600000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":9.8889999999999993,"5min":9.8889999999999993,"15min":9.8889999999999993},"last":9.8889999999999993}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.629,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":4.5720000000000001,"5min":4.5720000000000001,"15min":4.5720000000000001},"last":4.5720000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":2.3260000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":2.3860000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.46899999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":2.4889999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.68700000000000006,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.915,"5min":5.915,"15min":5.915},"last":5.915},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.288}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":2.5609999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.66000000000000003,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":7.2599999999999998,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":7.2599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1253376,"data_stored":885266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30599999999999999,"15min":0.308},"min":{"1min":0.22500000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.40600000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.252},{"interface":"front","average":{"1min":0.318,"5min":0.33500000000000002,"15min":0.33800000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47499999999999998,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.33600000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.36299999999999999,"15min":0.36699999999999999},"min":{"1min":0.23599999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.39900000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.318},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.245,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.45500000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.26700000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.315,"15min":0.315},"min":{"1min":0.24199999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.38100000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.374,"15min":0.379},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44700000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72199999999999998,"5min":0.87,"15min":0.87},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.314,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.46500000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.73299999999999998,"5min":0.996,"15min":0.996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.66700000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.496}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60499999999999998,"15min":0.61399999999999999},"min":{"1min":0.433,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70899999999999996,"5min":1.026,"15min":1.026},"last":0.433},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":1.177,"15min":1.177},"last":0.42299999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.71999999999999997,"5min":1.131,"15min":1.131},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":0.746,"15min":0.746},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:38:24.183 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-04T01:38:24.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.313+0000 7fcdb9e26640 1 Processor -- start 2023-11-04T01:38:24.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.313+0000 7fcdb9e26640 1 -- start start 2023-11-04T01:38:24.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.313+0000 7fcdb9e26640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcdb415ae40 0x7fcdb415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.313+0000 7fcdb9e26640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fcdb40cbc00 0x7fcdb40cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.313+0000 7fcdb9e26640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb40cc450 con 0x7fcdb40cd860 2023-11-04T01:38:24.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.314+0000 7fcdb9e26640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb415f400 con 0x7fcdb415ae40 2023-11-04T01:38:24.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.314+0000 7fcdb9e26640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb415b220 con 0x7fcdb40cbc00 2023-11-04T01:38:24.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.314+0000 7fcdb37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcdb415ae40 0x7fcdb415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.314+0000 7fcdb37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcdb415ae40 0x7fcdb415bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59888/0 (socket says 172.21.15.114:59888) 2023-11-04T01:38:24.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.314+0000 7fcdb37fe640 1 -- 172.21.15.114:0/2447973704 learned_addr learned my addr 172.21.15.114:0/2447973704 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:24.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.314+0000 7fcdb2ffd640 1 --2- 172.21.15.114:0/2447973704 >> v2:172.21.15.141:3300/0 conn(0x7fcdb40cbc00 0x7fcdb40cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.314+0000 7fcdb37fe640 1 -- 172.21.15.114:0/2447973704 >> v2:172.21.15.141:3300/0 conn(0x7fcdb40cbc00 msgr2=0x7fcdb40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:24.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.314+0000 7fcdb37fe640 1 --2- 172.21.15.114:0/2447973704 >> v2:172.21.15.141:3300/0 conn(0x7fcdb40cbc00 0x7fcdb40cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.314+0000 7fcdb37fe640 1 -- 172.21.15.114:0/2447973704 >> v1:172.21.15.141:6789/0 conn(0x7fcdb40cd860 legacy=0x7fcdb40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:24.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.314+0000 7fcdb37fe640 1 -- 172.21.15.114:0/2447973704 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb415f890 con 0x7fcdb415ae40 2023-11-04T01:38:24.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.315+0000 7fcdb37fe640 1 --2- 172.21.15.114:0/2447973704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb415ae40 0x7fcdb415bfb0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40b05d0 tx=0x7fcda402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daebd3f3f5a49194 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.315+0000 7fcdb27fc640 1 -- 172.21.15.114:0/2447973704 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4031870 con 0x7fcdb415ae40 2023-11-04T01:38:24.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.315+0000 7fcdb27fc640 1 -- 172.21.15.114:0/2447973704 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda40319d0 con 0x7fcdb415ae40 2023-11-04T01:38:24.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.315+0000 7fcdb27fc640 1 -- 172.21.15.114:0/2447973704 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4031d60 con 0x7fcdb415ae40 2023-11-04T01:38:24.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.315+0000 7fcdb9e26640 1 -- 172.21.15.114:0/2447973704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb415ae40 msgr2=0x7fcdb415bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.315+0000 7fcdb9e26640 1 --2- 172.21.15.114:0/2447973704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb415ae40 0x7fcdb415bfb0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40b05d0 tx=0x7fcda402b910 comp rx=0 tx=0).stop 2023-11-04T01:38:24.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.315+0000 7fcdb9e26640 1 -- 172.21.15.114:0/2447973704 shutdown_connections 2023-11-04T01:38:24.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.315+0000 7fcdb9e26640 1 --2- 172.21.15.114:0/2447973704 >> v2:172.21.15.141:3300/0 conn(0x7fcdb40cbc00 0x7fcdb40cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.315+0000 7fcdb9e26640 1 --2- 172.21.15.114:0/2447973704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb415ae40 0x7fcdb415bfb0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.315+0000 7fcdb9e26640 1 -- 172.21.15.114:0/2447973704 >> 172.21.15.114:0/2447973704 conn(0x7fcdb406ea90 msgr2=0x7fcdb406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:24.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.315+0000 7fcdb9e26640 1 -- 172.21.15.114:0/2447973704 shutdown_connections 2023-11-04T01:38:24.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.316+0000 7fcdb9e26640 1 -- 172.21.15.114:0/2447973704 wait complete. 2023-11-04T01:38:24.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.317+0000 7fcdb9e26640 1 Processor -- start 2023-11-04T01:38:24.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.317+0000 7fcdb9e26640 1 -- start start 2023-11-04T01:38:24.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.317+0000 7fcdb9e26640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb40cbc00 0x7fcdb4144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.317+0000 7fcdb9e26640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcdb40cd860 0x7fcdb40c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.317+0000 7fcdb9e26640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcdb415ae40 0x7fcdb40c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.317+0000 7fcdb9e26640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb40c9740 con 0x7fcdb40cbc00 2023-11-04T01:38:24.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.317+0000 7fcdb9e26640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb40c8b30 con 0x7fcdb40cd860 2023-11-04T01:38:24.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.317+0000 7fcdb9e26640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb40c8e10 con 0x7fcdb415ae40 2023-11-04T01:38:24.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcdb37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb40cbc00 0x7fcdb4144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcdb37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb40cbc00 0x7fcdb4144de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59900/0 (socket says 172.21.15.114:59900) 2023-11-04T01:38:24.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcdb37fe640 1 -- 172.21.15.114:0/2151368594 learned_addr learned my addr 172.21.15.114:0/2151368594 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:24.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcdb2ffd640 1 --2- 172.21.15.114:0/2151368594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcdb40cd860 0x7fcdb40c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcdb3fff640 1 --2- 172.21.15.114:0/2151368594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcdb415ae40 0x7fcdb40c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcdb37fe640 1 -- 172.21.15.114:0/2151368594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcdb415ae40 msgr2=0x7fcdb40c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcdb37fe640 1 --2- 172.21.15.114:0/2151368594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcdb415ae40 0x7fcdb40c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcdb37fe640 1 -- 172.21.15.114:0/2151368594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcdb40cd860 msgr2=0x7fcdb40c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcdb37fe640 1 --2- 172.21.15.114:0/2151368594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcdb40cd860 0x7fcdb40c61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcdb37fe640 1 -- 172.21.15.114:0/2151368594 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda40094d0 con 0x7fcdb40cbc00 2023-11-04T01:38:24.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcdb3fff640 1 --2- 172.21.15.114:0/2151368594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcdb415ae40 0x7fcdb40c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:24.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcdb37fe640 1 --2- 172.21.15.114:0/2151368594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb40cbc00 0x7fcdb4144de0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fcda4000c00 tx=0x7fcda40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcd9bfff640 1 -- 172.21.15.114:0/2151368594 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4031840 con 0x7fcdb40cbc00 2023-11-04T01:38:24.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcd9bfff640 1 -- 172.21.15.114:0/2151368594 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda40443f0 con 0x7fcdb40cbc00 2023-11-04T01:38:24.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcdb9e26640 1 -- 172.21.15.114:0/2151368594 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb40c90f0 con 0x7fcdb40cbc00 2023-11-04T01:38:24.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcd9bfff640 1 -- 172.21.15.114:0/2151368594 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda40447a0 con 0x7fcdb40cbc00 2023-11-04T01:38:24.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.318+0000 7fcdb9e26640 1 -- 172.21.15.114:0/2151368594 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb4145320 con 0x7fcdb40cbc00 2023-11-04T01:38:24.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.319+0000 7fcdb9e26640 1 -- 172.21.15.114:0/2151368594 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb40ce2d0 con 0x7fcdb40cbc00 2023-11-04T01:38:24.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.319+0000 7fcd9bfff640 1 -- 172.21.15.114:0/2151368594 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcda404d450 con 0x7fcdb40cbc00 2023-11-04T01:38:24.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.320+0000 7fcd9bfff640 1 --2- 172.21.15.114:0/2151368594 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcda006aea0 0x7fcda006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.320+0000 7fcd9bfff640 1 -- 172.21.15.114:0/2151368594 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcda402d040 con 0x7fcdb40cbc00 2023-11-04T01:38:24.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.320+0000 7fcdb2ffd640 1 --2- 172.21.15.114:0/2151368594 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcda006aea0 0x7fcda006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.320+0000 7fcdb2ffd640 1 --2- 172.21.15.114:0/2151368594 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcda006aea0 0x7fcda006d360 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcdb415cf40 tx=0x7fcda8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.324+0000 7fcd9bfff640 1 -- 172.21.15.114:0/2151368594 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcda4076c80 con 0x7fcdb40cbc00 2023-11-04T01:38:24.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.552+0000 7fcdb9e26640 1 -- 172.21.15.114:0/2151368594 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fcdb40cc450 con 0x7fcdb40cbc00 2023-11-04T01:38:24.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.553+0000 7fcd9bfff640 1 -- 172.21.15.114:0/2151368594 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1168 (secure 0 0 0) 0x7fcda40354a0 con 0x7fcdb40cbc00 2023-11-04T01:38:24.556 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:24.556 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","health":{"status":"HEALTH_WARN","checks":{"POOL_APP_NOT_ENABLED":{"severity":"HEALTH_WARN","summary":{"message":"1 pool(s) do not have an application enabled","count":1},"muted":false}},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":138,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1699061777,"num_in_osds":8,"osd_in_since":1699061768,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":33}],"num_pgs":129,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":227307520,"bytes_avail":772866805760,"bytes_total":773094113280,"unknown_pgs_ratio":0.74418604373931885},"fsmap":{"epoch":23,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":6039}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-11-04T01:37:35.872036+0000","services":{}},"progress_events":{}} 2023-11-04T01:38:24.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.555+0000 7fcdb9e26640 1 -- 172.21.15.114:0/2151368594 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcda006aea0 msgr2=0x7fcda006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.555+0000 7fcdb9e26640 1 --2- 172.21.15.114:0/2151368594 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcda006aea0 0x7fcda006d360 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcdb415cf40 tx=0x7fcda8008040 comp rx=0 tx=0).stop 2023-11-04T01:38:24.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.555+0000 7fcdb9e26640 1 -- 172.21.15.114:0/2151368594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb40cbc00 msgr2=0x7fcdb4144de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.555+0000 7fcdb9e26640 1 --2- 172.21.15.114:0/2151368594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb40cbc00 0x7fcdb4144de0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fcda4000c00 tx=0x7fcda40046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.555+0000 7fcdb9e26640 1 -- 172.21.15.114:0/2151368594 shutdown_connections 2023-11-04T01:38:24.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.555+0000 7fcdb9e26640 1 --2- 172.21.15.114:0/2151368594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcdb415ae40 0x7fcdb40c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.555+0000 7fcdb9e26640 1 --2- 172.21.15.114:0/2151368594 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcda006aea0 0x7fcda006d360 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.555+0000 7fcdb9e26640 1 --2- 172.21.15.114:0/2151368594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcdb40cd860 0x7fcdb40c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.555+0000 7fcdb9e26640 1 --2- 172.21.15.114:0/2151368594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdb40cbc00 0x7fcdb4144de0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.555+0000 7fcdb9e26640 1 -- 172.21.15.114:0/2151368594 >> 172.21.15.114:0/2151368594 conn(0x7fcdb406ea90 msgr2=0x7fcdb415dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:24.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.555+0000 7fcdb9e26640 1 -- 172.21.15.114:0/2151368594 shutdown_connections 2023-11-04T01:38:24.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.555+0000 7fcdb9e26640 1 -- 172.21.15.114:0/2151368594 wait complete. 2023-11-04T01:38:24.570 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-04T01:38:24.570 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:38:24.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.667+0000 7f1e12e32640 1 Processor -- start 2023-11-04T01:38:24.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.667+0000 7f1e12e32640 1 -- start start 2023-11-04T01:38:24.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.668+0000 7f1e12e32640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1e0c0cf870 0x7f1e0c160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.668+0000 7f1e12e32640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e0c06bf00 con 0x7f1e0c160b10 2023-11-04T01:38:24.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.668+0000 7f1e12e32640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e0c1615d0 con 0x7f1e0c15ce60 2023-11-04T01:38:24.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.668+0000 7f1e12e32640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e0c0cbde0 con 0x7f1e0c0cf870 2023-11-04T01:38:24.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.668+0000 7f1e0bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1e0c160b10 0x7f1e0c0cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58500/0 (socket says 172.21.15.114:58500) 2023-11-04T01:38:24.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.668+0000 7f1e0bfff640 1 -- 172.21.15.114:0/520252974 learned_addr learned my addr 172.21.15.114:0/520252974 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:24.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e0b7fe640 1 -- 172.21.15.114:0/520252974 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181369849 0 0) 0x7f1e0c06bf00 con 0x7f1e0c160b10 2023-11-04T01:38:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e0b7fe640 1 -- 172.21.15.114:0/520252974 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df4003520 con 0x7f1e0c160b10 2023-11-04T01:38:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e113cf640 1 --2- 172.21.15.114:0/520252974 >> v2:172.21.15.141:3300/0 conn(0x7f1e0c0cf870 0x7f1e0c160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e0b7fe640 1 -- 172.21.15.114:0/520252974 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1131271128 0 0) 0x7f1df4003520 con 0x7f1e0c160b10 2023-11-04T01:38:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e0b7fe640 1 -- 172.21.15.114:0/520252974 >> v2:172.21.15.141:3300/0 conn(0x7f1e0c0cf870 msgr2=0x7f1e0c160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e0b7fe640 1 --2- 172.21.15.114:0/520252974 >> v2:172.21.15.141:3300/0 conn(0x7f1e0c0cf870 0x7f1e0c160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e0b7fe640 1 -- 172.21.15.114:0/520252974 >> v1:172.21.15.141:6789/0 conn(0x7f1e0c15ce60 legacy=0x7f1e0c06b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e0b7fe640 1 -- 172.21.15.114:0/520252974 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c1618b0 con 0x7f1e0c160b10 2023-11-04T01:38:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e0b7fe640 1 -- 172.21.15.114:0/520252974 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f1e00001670 con 0x7f1e0c160b10 2023-11-04T01:38:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e0b7fe640 1 -- 172.21.15.114:0/520252974 >> v1:172.21.15.114:6789/0 conn(0x7f1e0c160b10 legacy=0x7f1e0c0cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e0b7fe640 1 --2- 172.21.15.114:0/520252974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1df4003970 0x7f1df4003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e0b7fe640 1 --2- 172.21.15.114:0/520252974 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1df40047c0 0x7f1df4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e0b7fe640 1 --2- 172.21.15.114:0/520252974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1df4005180 0x7f1df400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e0b7fe640 1 -- 172.21.15.114:0/520252974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c0cbde0 con 0x7f1df4005180 2023-11-04T01:38:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e0b7fe640 1 -- 172.21.15.114:0/520252974 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df400c0b0 con 0x7f1df40047c0 2023-11-04T01:38:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e0b7fe640 1 -- 172.21.15.114:0/520252974 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df400c270 con 0x7f1df4003970 2023-11-04T01:38:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e113cf640 1 --2- 172.21.15.114:0/520252974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1df4005180 0x7f1df400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e10bce640 1 --2- 172.21.15.114:0/520252974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1df4003970 0x7f1df4003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e0bfff640 1 --2- 172.21.15.114:0/520252974 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1df40047c0 0x7f1df4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e113cf640 1 -- 172.21.15.114:0/520252974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1df4003970 msgr2=0x7f1df4003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e113cf640 1 --2- 172.21.15.114:0/520252974 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1df4003970 0x7f1df4003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e113cf640 1 -- 172.21.15.114:0/520252974 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1df40047c0 msgr2=0x7f1df4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e113cf640 1 --2- 172.21.15.114:0/520252974 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1df40047c0 0x7f1df4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.669+0000 7f1e113cf640 1 -- 172.21.15.114:0/520252974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df4003520 con 0x7f1df4005180 2023-11-04T01:38:24.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.670+0000 7f1e113cf640 1 -- 172.21.15.114:0/520252974 reap_dead start 2023-11-04T01:38:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.670+0000 7f1e113cf640 1 --2- 172.21.15.114:0/520252974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1df4005180 0x7f1df400b980 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c06f7c0 tx=0x7f1df40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f64075902adb0b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.670+0000 7f1e0b7fe640 1 -- 172.21.15.114:0/520252974 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0402cca0 con 0x7f1df4005180 2023-11-04T01:38:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.670+0000 7f1e0b7fe640 1 -- 172.21.15.114:0/520252974 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0402ce00 con 0x7f1df4005180 2023-11-04T01:38:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.670+0000 7f1e0b7fe640 1 -- 172.21.15.114:0/520252974 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04003bd0 con 0x7f1df4005180 2023-11-04T01:38:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.671+0000 7f1e12e32640 1 -- 172.21.15.114:0/520252974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1df4005180 msgr2=0x7f1df400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.671+0000 7f1e12e32640 1 --2- 172.21.15.114:0/520252974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1df4005180 0x7f1df400b980 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c06f7c0 tx=0x7f1df40057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.671+0000 7f1e12e32640 1 -- 172.21.15.114:0/520252974 shutdown_connections 2023-11-04T01:38:24.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.671+0000 7f1e12e32640 1 --2- 172.21.15.114:0/520252974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1df4005180 0x7f1df400b980 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.671+0000 7f1e12e32640 1 -- 172.21.15.114:0/520252974 >> 172.21.15.114:0/520252974 conn(0x7f1e0c06ea90 msgr2=0x7f1e0c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:24.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.671+0000 7f1e12e32640 1 -- 172.21.15.114:0/520252974 shutdown_connections 2023-11-04T01:38:24.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.671+0000 7f1e12e32640 1 -- 172.21.15.114:0/520252974 wait complete. 2023-11-04T01:38:24.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.672+0000 7f1e12e32640 1 Processor -- start 2023-11-04T01:38:24.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.672+0000 7f1e12e32640 1 -- start start 2023-11-04T01:38:24.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e12e32640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1df4005180 0x7f1e0c1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e12e32640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e0c0b49b0 0x7f1e0c15e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e12e32640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e0c15e5a0 0x7f1e0c0b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e12e32640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c15ea30 con 0x7f1e0c15e5a0 2023-11-04T01:38:24.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e12e32640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c0b3910 con 0x7f1df4005180 2023-11-04T01:38:24.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e12e32640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c0b3bf0 con 0x7f1e0c0b49b0 2023-11-04T01:38:24.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e113cf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e0c15e5a0 0x7f1e0c0b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e113cf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e0c15e5a0 0x7f1e0c0b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59910/0 (socket says 172.21.15.114:59910) 2023-11-04T01:38:24.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e113cf640 1 -- 172.21.15.114:0/995830555 learned_addr learned my addr 172.21.15.114:0/995830555 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:24.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e0bfff640 1 --2- 172.21.15.114:0/995830555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e0c0b49b0 0x7f1e0c15e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e10bce640 1 --2- 172.21.15.114:0/995830555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1df4005180 0x7f1e0c1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e113cf640 1 -- 172.21.15.114:0/995830555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e0c0b49b0 msgr2=0x7f1e0c15e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e113cf640 1 --2- 172.21.15.114:0/995830555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e0c0b49b0 0x7f1e0c15e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e113cf640 1 -- 172.21.15.114:0/995830555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1df4005180 msgr2=0x7f1e0c1545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e113cf640 1 --2- 172.21.15.114:0/995830555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1df4005180 0x7f1e0c1545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e113cf640 1 -- 172.21.15.114:0/995830555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c0b3ed0 con 0x7f1e0c15e5a0 2023-11-04T01:38:24.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.673+0000 7f1e10bce640 1 --2- 172.21.15.114:0/995830555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1df4005180 0x7f1e0c1545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:24.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.674+0000 7f1e113cf640 1 --2- 172.21.15.114:0/995830555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e0c15e5a0 0x7f1e0c0b5130 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1e0402c710 tx=0x7f1e04004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.674+0000 7f1e097fa640 1 -- 172.21.15.114:0/995830555 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04004760 con 0x7f1e0c15e5a0 2023-11-04T01:38:24.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.674+0000 7f1e097fa640 1 -- 172.21.15.114:0/995830555 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e04003e10 con 0x7f1e0c15e5a0 2023-11-04T01:38:24.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.674+0000 7f1e12e32640 1 -- 172.21.15.114:0/995830555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0c0b41b0 con 0x7f1e0c15e5a0 2023-11-04T01:38:24.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.674+0000 7f1e097fa640 1 -- 172.21.15.114:0/995830555 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0403f6b0 con 0x7f1e0c15e5a0 2023-11-04T01:38:24.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.674+0000 7f1e12e32640 1 -- 172.21.15.114:0/995830555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0c0b5670 con 0x7f1e0c15e5a0 2023-11-04T01:38:24.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.675+0000 7f1e12e32640 1 -- 172.21.15.114:0/995830555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e0c0b46d0 con 0x7f1e0c15e5a0 2023-11-04T01:38:24.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.675+0000 7f1e097fa640 1 -- 172.21.15.114:0/995830555 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e04034440 con 0x7f1e0c15e5a0 2023-11-04T01:38:24.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.676+0000 7f1e097fa640 1 --2- 172.21.15.114:0/995830555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1df806aea0 0x7f1df806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:24.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.676+0000 7f1e10bce640 1 --2- 172.21.15.114:0/995830555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1df806aea0 0x7f1df806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:24.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.676+0000 7f1e097fa640 1 -- 172.21.15.114:0/995830555 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1e0403b070 con 0x7f1e0c15e5a0 2023-11-04T01:38:24.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.676+0000 7f1e10bce640 1 --2- 172.21.15.114:0/995830555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1df806aea0 0x7f1df806d360 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc004ef0 tx=0x7f1dfc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:24.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.681+0000 7f1e097fa640 1 -- 172.21.15.114:0/995830555 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1e0c0b46d0 con 0x7f1e0c15e5a0 2023-11-04T01:38:24.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.845+0000 7f1e12e32640 1 -- 172.21.15.114:0/995830555 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1e0c0ce970 con 0x7f1df806aea0 2023-11-04T01:38:24.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.854+0000 7f1e097fa640 1 -- 172.21.15.114:0/995830555 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369924 (secure 0 0 0) 0x7f1dfc005470 con 0x7f1df806aea0 2023-11-04T01:38:24.861 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:24.864 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:38:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.858+0000 7f1e12e32640 1 -- 172.21.15.114:0/995830555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1df806aea0 msgr2=0x7f1df806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.858+0000 7f1e12e32640 1 --2- 172.21.15.114:0/995830555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1df806aea0 0x7f1df806d360 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc004ef0 tx=0x7f1dfc009040 comp rx=0 tx=0).stop 2023-11-04T01:38:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.858+0000 7f1e12e32640 1 -- 172.21.15.114:0/995830555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e0c15e5a0 msgr2=0x7f1e0c0b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.858+0000 7f1e12e32640 1 --2- 172.21.15.114:0/995830555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e0c15e5a0 0x7f1e0c0b5130 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1e0402c710 tx=0x7f1e04004ab0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.858+0000 7f1e12e32640 1 -- 172.21.15.114:0/995830555 shutdown_connections 2023-11-04T01:38:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.858+0000 7f1e12e32640 1 --2- 172.21.15.114:0/995830555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e0c15e5a0 0x7f1e0c0b5130 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.858+0000 7f1e12e32640 1 --2- 172.21.15.114:0/995830555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e0c0b49b0 0x7f1e0c15e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.858+0000 7f1e12e32640 1 --2- 172.21.15.114:0/995830555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1df806aea0 0x7f1df806d360 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.858+0000 7f1e12e32640 1 --2- 172.21.15.114:0/995830555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1df4005180 0x7f1e0c1545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:24.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.858+0000 7f1e12e32640 1 -- 172.21.15.114:0/995830555 >> 172.21.15.114:0/995830555 conn(0x7f1e0c06ea90 msgr2=0x7f1e0c0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:24.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.858+0000 7f1e12e32640 1 -- 172.21.15.114:0/995830555 shutdown_connections 2023-11-04T01:38:24.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:24.858+0000 7f1e12e32640 1 -- 172.21.15.114:0/995830555 wait complete. 2023-11-04T01:38:24.872 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-11-04T01:38:23.881659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":246,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222440,"kb_used_data":6248,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752280,"statfs":{"total":773094113280,"available":772866334720,"internally_reserved":0,"allocated":6397952,"data_stored":3527188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.867196"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205396+0000","last_change":"2023-11-04T01:38:20.049549+0000","last_active":"2023-11-04T01:38:21.205396+0000","last_peered":"2023-11-04T01:38:21.205396+0000","last_clean":"2023-11-04T01:38:21.205396+0000","last_became_active":"2023-11-04T01:38:20.049262+0000","last_became_peered":"2023-11-04T01:38:20.049262+0000","last_unstale":"2023-11-04T01:38:21.205396+0000","last_undegraded":"2023-11-04T01:38:21.205396+0000","last_fullsized":"2023-11-04T01:38:21.205396+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:27:08.487034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675168+0000","last_change":"2023-11-04T01:38:20.053859+0000","last_active":"2023-11-04T01:38:21.675168+0000","last_peered":"2023-11-04T01:38:21.675168+0000","last_clean":"2023-11-04T01:38:21.675168+0000","last_became_active":"2023-11-04T01:38:20.053576+0000","last_became_peered":"2023-11-04T01:38:20.053576+0000","last_unstale":"2023-11-04T01:38:21.675168+0000","last_undegraded":"2023-11-04T01:38:21.675168+0000","last_fullsized":"2023-11-04T01:38:21.675168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:26.807670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035426+0000","last_change":"2023-11-04T01:38:20.036689+0000","last_active":"2023-11-04T01:38:21.035426+0000","last_peered":"2023-11-04T01:38:21.035426+0000","last_clean":"2023-11-04T01:38:21.035426+0000","last_became_active":"2023-11-04T01:38:20.036295+0000","last_became_peered":"2023-11-04T01:38:20.036295+0000","last_unstale":"2023-11-04T01:38:21.035426+0000","last_undegraded":"2023-11-04T01:38:21.035426+0000","last_fullsized":"2023-11-04T01:38:21.035426+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:37:52.192853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674013+0000","last_change":"2023-11-04T01:38:20.041642+0000","last_active":"2023-11-04T01:38:21.674013+0000","last_peered":"2023-11-04T01:38:21.674013+0000","last_clean":"2023-11-04T01:38:21.674013+0000","last_became_active":"2023-11-04T01:38:20.041317+0000","last_became_peered":"2023-11-04T01:38:20.041317+0000","last_unstale":"2023-11-04T01:38:21.674013+0000","last_undegraded":"2023-11-04T01:38:21.674013+0000","last_fullsized":"2023-11-04T01:38:21.674013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:29:25.119418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205194+0000","last_change":"2023-11-04T01:38:20.040446+0000","last_active":"2023-11-04T01:38:21.205194+0000","last_peered":"2023-11-04T01:38:21.205194+0000","last_clean":"2023-11-04T01:38:21.205194+0000","last_became_active":"2023-11-04T01:38:20.040190+0000","last_became_peered":"2023-11-04T01:38:20.040190+0000","last_unstale":"2023-11-04T01:38:21.205194+0000","last_undegraded":"2023-11-04T01:38:21.205194+0000","last_fullsized":"2023-11-04T01:38:21.205194+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:36.086593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673683+0000","last_change":"2023-11-04T01:38:20.033717+0000","last_active":"2023-11-04T01:38:21.673683+0000","last_peered":"2023-11-04T01:38:21.673683+0000","last_clean":"2023-11-04T01:38:21.673683+0000","last_became_active":"2023-11-04T01:38:20.033489+0000","last_became_peered":"2023-11-04T01:38:20.033489+0000","last_unstale":"2023-11-04T01:38:21.673683+0000","last_undegraded":"2023-11-04T01:38:21.673683+0000","last_fullsized":"2023-11-04T01:38:21.673683+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:48:57.181502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035641+0000","last_change":"2023-11-04T01:38:20.038279+0000","last_active":"2023-11-04T01:38:21.035641+0000","last_peered":"2023-11-04T01:38:21.035641+0000","last_clean":"2023-11-04T01:38:21.035641+0000","last_became_active":"2023-11-04T01:38:20.038041+0000","last_became_peered":"2023-11-04T01:38:20.038041+0000","last_unstale":"2023-11-04T01:38:21.035641+0000","last_undegraded":"2023-11-04T01:38:21.035641+0000","last_fullsized":"2023-11-04T01:38:21.035641+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:29.142146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674889+0000","last_change":"2023-11-04T01:38:20.038609+0000","last_active":"2023-11-04T01:38:21.674889+0000","last_peered":"2023-11-04T01:38:21.674889+0000","last_clean":"2023-11-04T01:38:21.674889+0000","last_became_active":"2023-11-04T01:38:20.038286+0000","last_became_peered":"2023-11-04T01:38:20.038286+0000","last_unstale":"2023-11-04T01:38:21.674889+0000","last_undegraded":"2023-11-04T01:38:21.674889+0000","last_fullsized":"2023-11-04T01:38:21.674889+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:36.525521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034752+0000","last_change":"2023-11-04T01:38:20.039854+0000","last_active":"2023-11-04T01:38:21.034752+0000","last_peered":"2023-11-04T01:38:21.034752+0000","last_clean":"2023-11-04T01:38:21.034752+0000","last_became_active":"2023-11-04T01:38:20.039558+0000","last_became_peered":"2023-11-04T01:38:20.039558+0000","last_unstale":"2023-11-04T01:38:21.034752+0000","last_undegraded":"2023-11-04T01:38:21.034752+0000","last_fullsized":"2023-11-04T01:38:21.034752+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:38:22.194989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673965+0000","last_change":"2023-11-04T01:38:20.036447+0000","last_active":"2023-11-04T01:38:21.673965+0000","last_peered":"2023-11-04T01:38:21.673965+0000","last_clean":"2023-11-04T01:38:21.673965+0000","last_became_active":"2023-11-04T01:38:20.034559+0000","last_became_peered":"2023-11-04T01:38:20.034559+0000","last_unstale":"2023-11-04T01:38:21.673965+0000","last_undegraded":"2023-11-04T01:38:21.673965+0000","last_fullsized":"2023-11-04T01:38:21.673965+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:41.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674222+0000","last_change":"2023-11-04T01:38:20.049819+0000","last_active":"2023-11-04T01:38:21.674222+0000","last_peered":"2023-11-04T01:38:21.674222+0000","last_clean":"2023-11-04T01:38:21.674222+0000","last_became_active":"2023-11-04T01:38:20.048896+0000","last_became_peered":"2023-11-04T01:38:20.048896+0000","last_unstale":"2023-11-04T01:38:21.674222+0000","last_undegraded":"2023-11-04T01:38:21.674222+0000","last_fullsized":"2023-11-04T01:38:21.674222+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:40.786616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673854+0000","last_change":"2023-11-04T01:38:20.045669+0000","last_active":"2023-11-04T01:38:21.673854+0000","last_peered":"2023-11-04T01:38:21.673854+0000","last_clean":"2023-11-04T01:38:21.673854+0000","last_became_active":"2023-11-04T01:38:20.045304+0000","last_became_peered":"2023-11-04T01:38:20.045304+0000","last_unstale":"2023-11-04T01:38:21.673854+0000","last_undegraded":"2023-11-04T01:38:21.673854+0000","last_fullsized":"2023-11-04T01:38:21.673854+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:22.724353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034368+0000","last_change":"2023-11-04T01:38:20.038098+0000","last_active":"2023-11-04T01:38:21.034368+0000","last_peered":"2023-11-04T01:38:21.034368+0000","last_clean":"2023-11-04T01:38:21.034368+0000","last_became_active":"2023-11-04T01:38:20.037832+0000","last_became_peered":"2023-11-04T01:38:20.037832+0000","last_unstale":"2023-11-04T01:38:21.034368+0000","last_undegraded":"2023-11-04T01:38:21.034368+0000","last_fullsized":"2023-11-04T01:38:21.034368+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:51.180365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035420+0000","last_change":"2023-11-04T01:38:20.037420+0000","last_active":"2023-11-04T01:38:21.035420+0000","last_peered":"2023-11-04T01:38:21.035420+0000","last_clean":"2023-11-04T01:38:21.035420+0000","last_became_active":"2023-11-04T01:38:20.037129+0000","last_became_peered":"2023-11-04T01:38:20.037129+0000","last_unstale":"2023-11-04T01:38:21.035420+0000","last_undegraded":"2023-11-04T01:38:21.035420+0000","last_fullsized":"2023-11-04T01:38:21.035420+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:40.491312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034835+0000","last_change":"2023-11-04T01:38:20.037763+0000","last_active":"2023-11-04T01:38:21.034835+0000","last_peered":"2023-11-04T01:38:21.034835+0000","last_clean":"2023-11-04T01:38:21.034835+0000","last_became_active":"2023-11-04T01:38:20.037487+0000","last_became_peered":"2023-11-04T01:38:20.037487+0000","last_unstale":"2023-11-04T01:38:21.034835+0000","last_undegraded":"2023-11-04T01:38:21.034835+0000","last_fullsized":"2023-11-04T01:38:21.034835+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:40.786616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673419+0000","last_change":"2023-11-04T01:38:20.033267+0000","last_active":"2023-11-04T01:38:21.673419+0000","last_peered":"2023-11-04T01:38:21.673419+0000","last_clean":"2023-11-04T01:38:21.673419+0000","last_became_active":"2023-11-04T01:38:20.033012+0000","last_became_peered":"2023-11-04T01:38:20.033012+0000","last_unstale":"2023-11-04T01:38:21.673419+0000","last_undegraded":"2023-11-04T01:38:21.673419+0000","last_fullsized":"2023-11-04T01:38:21.673419+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:22:37.388957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675419+0000","last_change":"2023-11-04T01:38:20.042715+0000","last_active":"2023-11-04T01:38:21.675419+0000","last_peered":"2023-11-04T01:38:21.675419+0000","last_clean":"2023-11-04T01:38:21.675419+0000","last_became_active":"2023-11-04T01:38:20.042483+0000","last_became_peered":"2023-11-04T01:38:20.042483+0000","last_unstale":"2023-11-04T01:38:21.675419+0000","last_undegraded":"2023-11-04T01:38:21.675419+0000","last_fullsized":"2023-11-04T01:38:21.675419+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:30:19.149946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035622+0000","last_change":"2023-11-04T01:38:20.039785+0000","last_active":"2023-11-04T01:38:21.035622+0000","last_peered":"2023-11-04T01:38:21.035622+0000","last_clean":"2023-11-04T01:38:21.035622+0000","last_became_active":"2023-11-04T01:38:20.039539+0000","last_became_peered":"2023-11-04T01:38:20.039539+0000","last_unstale":"2023-11-04T01:38:21.035622+0000","last_undegraded":"2023-11-04T01:38:21.035622+0000","last_fullsized":"2023-11-04T01:38:21.035622+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:25:30.505923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205320+0000","last_change":"2023-11-04T01:38:20.049555+0000","last_active":"2023-11-04T01:38:21.205320+0000","last_peered":"2023-11-04T01:38:21.205320+0000","last_clean":"2023-11-04T01:38:21.205320+0000","last_became_active":"2023-11-04T01:38:20.049293+0000","last_became_peered":"2023-11-04T01:38:20.049293+0000","last_unstale":"2023-11-04T01:38:21.205320+0000","last_undegraded":"2023-11-04T01:38:21.205320+0000","last_fullsized":"2023-11-04T01:38:21.205320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:43.631674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675290+0000","last_change":"2023-11-04T01:38:20.041920+0000","last_active":"2023-11-04T01:38:21.675290+0000","last_peered":"2023-11-04T01:38:21.675290+0000","last_clean":"2023-11-04T01:38:21.675290+0000","last_became_active":"2023-11-04T01:38:20.041656+0000","last_became_peered":"2023-11-04T01:38:20.041656+0000","last_unstale":"2023-11-04T01:38:21.675290+0000","last_undegraded":"2023-11-04T01:38:21.675290+0000","last_fullsized":"2023-11-04T01:38:21.675290+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:02.149183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033793+0000","last_change":"2023-11-04T01:38:20.045716+0000","last_active":"2023-11-04T01:38:21.033793+0000","last_peered":"2023-11-04T01:38:21.033793+0000","last_clean":"2023-11-04T01:38:21.033793+0000","last_became_active":"2023-11-04T01:38:20.045380+0000","last_became_peered":"2023-11-04T01:38:20.045380+0000","last_unstale":"2023-11-04T01:38:21.033793+0000","last_undegraded":"2023-11-04T01:38:21.033793+0000","last_fullsized":"2023-11-04T01:38:21.033793+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:22.724353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674755+0000","last_change":"2023-11-04T01:38:20.043459+0000","last_active":"2023-11-04T01:38:21.674755+0000","last_peered":"2023-11-04T01:38:21.674755+0000","last_clean":"2023-11-04T01:38:21.674755+0000","last_became_active":"2023-11-04T01:38:20.043211+0000","last_became_peered":"2023-11-04T01:38:20.043211+0000","last_unstale":"2023-11-04T01:38:21.674755+0000","last_undegraded":"2023-11-04T01:38:21.674755+0000","last_fullsized":"2023-11-04T01:38:21.674755+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:25:30.505923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033973+0000","last_change":"2023-11-04T01:38:20.044304+0000","last_active":"2023-11-04T01:38:21.033973+0000","last_peered":"2023-11-04T01:38:21.033973+0000","last_clean":"2023-11-04T01:38:21.033973+0000","last_became_active":"2023-11-04T01:38:20.044039+0000","last_became_peered":"2023-11-04T01:38:20.044039+0000","last_unstale":"2023-11-04T01:38:21.033973+0000","last_undegraded":"2023-11-04T01:38:21.033973+0000","last_fullsized":"2023-11-04T01:38:21.033973+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:35.459885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033952+0000","last_change":"2023-11-04T01:38:20.040794+0000","last_active":"2023-11-04T01:38:21.033952+0000","last_peered":"2023-11-04T01:38:21.033952+0000","last_clean":"2023-11-04T01:38:21.033952+0000","last_became_active":"2023-11-04T01:38:20.040482+0000","last_became_peered":"2023-11-04T01:38:20.040482+0000","last_unstale":"2023-11-04T01:38:21.033952+0000","last_undegraded":"2023-11-04T01:38:21.033952+0000","last_fullsized":"2023-11-04T01:38:21.033952+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:31.017311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205414+0000","last_change":"2023-11-04T01:38:20.040557+0000","last_active":"2023-11-04T01:38:21.205414+0000","last_peered":"2023-11-04T01:38:21.205414+0000","last_clean":"2023-11-04T01:38:21.205414+0000","last_became_active":"2023-11-04T01:38:20.040102+0000","last_became_peered":"2023-11-04T01:38:20.040102+0000","last_unstale":"2023-11-04T01:38:21.205414+0000","last_undegraded":"2023-11-04T01:38:21.205414+0000","last_fullsized":"2023-11-04T01:38:21.205414+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:10.992954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673979+0000","last_change":"2023-11-04T01:38:20.042394+0000","last_active":"2023-11-04T01:38:21.673979+0000","last_peered":"2023-11-04T01:38:21.673979+0000","last_clean":"2023-11-04T01:38:21.673979+0000","last_became_active":"2023-11-04T01:38:20.042133+0000","last_became_peered":"2023-11-04T01:38:20.042133+0000","last_unstale":"2023-11-04T01:38:21.673979+0000","last_undegraded":"2023-11-04T01:38:21.673979+0000","last_fullsized":"2023-11-04T01:38:21.673979+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:35.459885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674258+0000","last_change":"2023-11-04T01:38:20.034976+0000","last_active":"2023-11-04T01:38:21.674258+0000","last_peered":"2023-11-04T01:38:21.674258+0000","last_clean":"2023-11-04T01:38:21.674258+0000","last_became_active":"2023-11-04T01:38:20.034718+0000","last_became_peered":"2023-11-04T01:38:20.034718+0000","last_unstale":"2023-11-04T01:38:21.674258+0000","last_undegraded":"2023-11-04T01:38:21.674258+0000","last_fullsized":"2023-11-04T01:38:21.674258+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:35.459885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205280+0000","last_change":"2023-11-04T01:38:20.047475+0000","last_active":"2023-11-04T01:38:21.205280+0000","last_peered":"2023-11-04T01:38:21.205280+0000","last_clean":"2023-11-04T01:38:21.205280+0000","last_became_active":"2023-11-04T01:38:20.047217+0000","last_became_peered":"2023-11-04T01:38:20.047217+0000","last_unstale":"2023-11-04T01:38:21.205280+0000","last_undegraded":"2023-11-04T01:38:21.205280+0000","last_fullsized":"2023-11-04T01:38:21.205280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:03:06.304104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675200+0000","last_change":"2023-11-04T01:38:20.045473+0000","last_active":"2023-11-04T01:38:21.675200+0000","last_peered":"2023-11-04T01:38:21.675200+0000","last_clean":"2023-11-04T01:38:21.675200+0000","last_became_active":"2023-11-04T01:38:20.045227+0000","last_became_peered":"2023-11-04T01:38:20.045227+0000","last_unstale":"2023-11-04T01:38:21.675200+0000","last_undegraded":"2023-11-04T01:38:21.675200+0000","last_fullsized":"2023-11-04T01:38:21.675200+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:11:33.289813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033793+0000","last_change":"2023-11-04T01:38:20.042348+0000","last_active":"2023-11-04T01:38:21.033793+0000","last_peered":"2023-11-04T01:38:21.033793+0000","last_clean":"2023-11-04T01:38:21.033793+0000","last_became_active":"2023-11-04T01:38:20.041643+0000","last_became_peered":"2023-11-04T01:38:20.041643+0000","last_unstale":"2023-11-04T01:38:21.033793+0000","last_undegraded":"2023-11-04T01:38:21.033793+0000","last_fullsized":"2023-11-04T01:38:21.033793+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:13.116417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205126+0000","last_change":"2023-11-04T01:38:20.031327+0000","last_active":"2023-11-04T01:38:21.205126+0000","last_peered":"2023-11-04T01:38:21.205126+0000","last_clean":"2023-11-04T01:38:21.205126+0000","last_became_active":"2023-11-04T01:38:20.031081+0000","last_became_peered":"2023-11-04T01:38:20.031081+0000","last_unstale":"2023-11-04T01:38:21.205126+0000","last_undegraded":"2023-11-04T01:38:21.205126+0000","last_fullsized":"2023-11-04T01:38:21.205126+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:18.719026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673381+0000","last_change":"2023-11-04T01:38:20.047492+0000","last_active":"2023-11-04T01:38:21.673381+0000","last_peered":"2023-11-04T01:38:21.673381+0000","last_clean":"2023-11-04T01:38:21.673381+0000","last_became_active":"2023-11-04T01:38:20.047236+0000","last_became_peered":"2023-11-04T01:38:20.047236+0000","last_unstale":"2023-11-04T01:38:21.673381+0000","last_undegraded":"2023-11-04T01:38:21.673381+0000","last_fullsized":"2023-11-04T01:38:21.673381+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:18:14.039193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034875+0000","last_change":"2023-11-04T01:38:20.035082+0000","last_active":"2023-11-04T01:38:21.034875+0000","last_peered":"2023-11-04T01:38:21.034875+0000","last_clean":"2023-11-04T01:38:21.034875+0000","last_became_active":"2023-11-04T01:38:20.034747+0000","last_became_peered":"2023-11-04T01:38:20.034747+0000","last_unstale":"2023-11-04T01:38:21.034875+0000","last_undegraded":"2023-11-04T01:38:21.034875+0000","last_fullsized":"2023-11-04T01:38:21.034875+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:42.068163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033934+0000","last_change":"2023-11-04T01:38:19.031932+0000","last_active":"2023-11-04T01:38:21.033934+0000","last_peered":"2023-11-04T01:38:21.033934+0000","last_clean":"2023-11-04T01:38:21.033934+0000","last_became_active":"2023-11-04T01:38:19.031665+0000","last_became_peered":"2023-11-04T01:38:19.031665+0000","last_unstale":"2023-11-04T01:38:21.033934+0000","last_undegraded":"2023-11-04T01:38:21.033934+0000","last_fullsized":"2023-11-04T01:38:21.033934+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:50.677621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025636+0000","last_change":"2023-11-04T01:38:02.156342+0000","last_active":"2023-11-04T01:38:20.025636+0000","last_peered":"2023-11-04T01:38:20.025636+0000","last_clean":"2023-11-04T01:38:20.025636+0000","last_became_active":"2023-11-04T01:38:00.708159+0000","last_became_peered":"2023-11-04T01:38:00.708159+0000","last_unstale":"2023-11-04T01:38:20.025636+0000","last_undegraded":"2023-11-04T01:38:20.025636+0000","last_fullsized":"2023-11-04T01:38:20.025636+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000435213,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673663+0000","last_change":"2023-11-04T01:38:20.050969+0000","last_active":"2023-11-04T01:38:21.673663+0000","last_peered":"2023-11-04T01:38:21.673663+0000","last_clean":"2023-11-04T01:38:21.673663+0000","last_became_active":"2023-11-04T01:38:20.050719+0000","last_became_peered":"2023-11-04T01:38:20.050719+0000","last_unstale":"2023-11-04T01:38:21.673663+0000","last_undegraded":"2023-11-04T01:38:21.673663+0000","last_fullsized":"2023-11-04T01:38:21.673663+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:13.116417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675141+0000","last_change":"2023-11-04T01:38:19.037354+0000","last_active":"2023-11-04T01:38:21.675141+0000","last_peered":"2023-11-04T01:38:21.675141+0000","last_clean":"2023-11-04T01:38:21.675141+0000","last_became_active":"2023-11-04T01:38:19.036874+0000","last_became_peered":"2023-11-04T01:38:19.036874+0000","last_unstale":"2023-11-04T01:38:21.675141+0000","last_undegraded":"2023-11-04T01:38:21.675141+0000","last_fullsized":"2023-11-04T01:38:21.675141+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:29:24.114318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.033990+0000","last_change":"2023-11-04T01:38:02.362289+0000","last_active":"2023-11-04T01:38:20.033990+0000","last_peered":"2023-11-04T01:38:20.033990+0000","last_clean":"2023-11-04T01:38:20.033990+0000","last_became_active":"2023-11-04T01:38:00.710033+0000","last_became_peered":"2023-11-04T01:38:00.710033+0000","last_unstale":"2023-11-04T01:38:20.033990+0000","last_undegraded":"2023-11-04T01:38:20.033990+0000","last_fullsized":"2023-11-04T01:38:20.033990+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046467500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034007+0000","last_change":"2023-11-04T01:38:20.046647+0000","last_active":"2023-11-04T01:38:21.034007+0000","last_peered":"2023-11-04T01:38:21.034007+0000","last_clean":"2023-11-04T01:38:21.034007+0000","last_became_active":"2023-11-04T01:38:20.045600+0000","last_became_peered":"2023-11-04T01:38:20.045600+0000","last_unstale":"2023-11-04T01:38:21.034007+0000","last_undegraded":"2023-11-04T01:38:21.034007+0000","last_fullsized":"2023-11-04T01:38:21.034007+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:29:25.119418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033634+0000","last_change":"2023-11-04T01:38:19.035524+0000","last_active":"2023-11-04T01:38:21.033634+0000","last_peered":"2023-11-04T01:38:21.033634+0000","last_clean":"2023-11-04T01:38:21.033634+0000","last_became_active":"2023-11-04T01:38:19.035253+0000","last_became_peered":"2023-11-04T01:38:19.035253+0000","last_unstale":"2023-11-04T01:38:21.033634+0000","last_undegraded":"2023-11-04T01:38:21.033634+0000","last_fullsized":"2023-11-04T01:38:21.033634+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:58:46.450993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.024830+0000","last_change":"2023-11-04T01:38:01.699171+0000","last_active":"2023-11-04T01:38:20.024830+0000","last_peered":"2023-11-04T01:38:20.024830+0000","last_clean":"2023-11-04T01:38:20.024830+0000","last_became_active":"2023-11-04T01:38:00.703927+0000","last_became_peered":"2023-11-04T01:38:00.703927+0000","last_unstale":"2023-11-04T01:38:20.024830+0000","last_undegraded":"2023-11-04T01:38:20.024830+0000","last_fullsized":"2023-11-04T01:38:20.024830+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072585499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035185+0000","last_change":"2023-11-04T01:38:20.042592+0000","last_active":"2023-11-04T01:38:21.035185+0000","last_peered":"2023-11-04T01:38:21.035185+0000","last_clean":"2023-11-04T01:38:21.035185+0000","last_became_active":"2023-11-04T01:38:20.041836+0000","last_became_peered":"2023-11-04T01:38:20.041836+0000","last_unstale":"2023-11-04T01:38:21.035185+0000","last_undegraded":"2023-11-04T01:38:21.035185+0000","last_fullsized":"2023-11-04T01:38:21.035185+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:12.069863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673588+0000","last_change":"2023-11-04T01:38:19.035245+0000","last_active":"2023-11-04T01:38:21.673588+0000","last_peered":"2023-11-04T01:38:21.673588+0000","last_clean":"2023-11-04T01:38:21.673588+0000","last_became_active":"2023-11-04T01:38:19.034978+0000","last_became_peered":"2023-11-04T01:38:19.034978+0000","last_unstale":"2023-11-04T01:38:21.673588+0000","last_undegraded":"2023-11-04T01:38:21.673588+0000","last_fullsized":"2023-11-04T01:38:21.673588+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:22:36.383857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025334+0000","last_change":"2023-11-04T01:38:02.156160+0000","last_active":"2023-11-04T01:38:20.025334+0000","last_peered":"2023-11-04T01:38:20.025334+0000","last_clean":"2023-11-04T01:38:20.025334+0000","last_became_active":"2023-11-04T01:38:00.709137+0000","last_became_peered":"2023-11-04T01:38:00.709137+0000","last_unstale":"2023-11-04T01:38:20.025334+0000","last_undegraded":"2023-11-04T01:38:20.025334+0000","last_fullsized":"2023-11-04T01:38:20.025334+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028239399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035851+0000","last_change":"2023-11-04T01:38:20.035081+0000","last_active":"2023-11-04T01:38:21.035851+0000","last_peered":"2023-11-04T01:38:21.035851+0000","last_clean":"2023-11-04T01:38:21.035851+0000","last_became_active":"2023-11-04T01:38:20.034778+0000","last_became_peered":"2023-11-04T01:38:20.034778+0000","last_unstale":"2023-11-04T01:38:21.035851+0000","last_undegraded":"2023-11-04T01:38:21.035851+0000","last_fullsized":"2023-11-04T01:38:21.035851+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:17:19.236320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675336+0000","last_change":"2023-11-04T01:38:19.037605+0000","last_active":"2023-11-04T01:38:21.675336+0000","last_peered":"2023-11-04T01:38:21.675336+0000","last_clean":"2023-11-04T01:38:21.675336+0000","last_became_active":"2023-11-04T01:38:19.037364+0000","last_became_peered":"2023-11-04T01:38:19.037364+0000","last_unstale":"2023-11-04T01:38:21.675336+0000","last_undegraded":"2023-11-04T01:38:21.675336+0000","last_fullsized":"2023-11-04T01:38:21.675336+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:37:51.187753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.024656+0000","last_change":"2023-11-04T01:38:01.698196+0000","last_active":"2023-11-04T01:38:20.024656+0000","last_peered":"2023-11-04T01:38:20.024656+0000","last_clean":"2023-11-04T01:38:20.024656+0000","last_became_active":"2023-11-04T01:38:00.705451+0000","last_became_peered":"2023-11-04T01:38:00.705451+0000","last_unstale":"2023-11-04T01:38:20.024656+0000","last_undegraded":"2023-11-04T01:38:20.024656+0000","last_fullsized":"2023-11-04T01:38:20.024656+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:16.759249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067668100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035195+0000","last_change":"2023-11-04T01:38:20.050980+0000","last_active":"2023-11-04T01:38:21.035195+0000","last_peered":"2023-11-04T01:38:21.035195+0000","last_clean":"2023-11-04T01:38:21.035195+0000","last_became_active":"2023-11-04T01:38:20.050697+0000","last_became_peered":"2023-11-04T01:38:20.050697+0000","last_unstale":"2023-11-04T01:38:21.035195+0000","last_undegraded":"2023-11-04T01:38:21.035195+0000","last_fullsized":"2023-11-04T01:38:21.035195+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:00.166299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035835+0000","last_change":"2023-11-04T01:38:19.039458+0000","last_active":"2023-11-04T01:38:21.035835+0000","last_peered":"2023-11-04T01:38:21.035835+0000","last_clean":"2023-11-04T01:38:21.035835+0000","last_became_active":"2023-11-04T01:38:19.039141+0000","last_became_peered":"2023-11-04T01:38:19.039141+0000","last_unstale":"2023-11-04T01:38:21.035835+0000","last_undegraded":"2023-11-04T01:38:21.035835+0000","last_fullsized":"2023-11-04T01:38:21.035835+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:22:36.383857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026612+0000","last_change":"2023-11-04T01:38:01.983991+0000","last_active":"2023-11-04T01:38:20.026612+0000","last_peered":"2023-11-04T01:38:20.026612+0000","last_clean":"2023-11-04T01:38:20.026612+0000","last_became_active":"2023-11-04T01:38:00.708462+0000","last_became_peered":"2023-11-04T01:38:00.708462+0000","last_unstale":"2023-11-04T01:38:20.026612+0000","last_undegraded":"2023-11-04T01:38:20.026612+0000","last_fullsized":"2023-11-04T01:38:20.026612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:37.727651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041811600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035839+0000","last_change":"2023-11-04T01:38:20.036153+0000","last_active":"2023-11-04T01:38:21.035839+0000","last_peered":"2023-11-04T01:38:21.035839+0000","last_clean":"2023-11-04T01:38:21.035839+0000","last_became_active":"2023-11-04T01:38:20.035851+0000","last_became_peered":"2023-11-04T01:38:20.035851+0000","last_unstale":"2023-11-04T01:38:21.035839+0000","last_undegraded":"2023-11-04T01:38:21.035839+0000","last_fullsized":"2023-11-04T01:38:21.035839+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:55.373532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035405+0000","last_change":"2023-11-04T01:38:19.039330+0000","last_active":"2023-11-04T01:38:21.035405+0000","last_peered":"2023-11-04T01:38:21.035405+0000","last_clean":"2023-11-04T01:38:21.035405+0000","last_became_active":"2023-11-04T01:38:19.039063+0000","last_became_peered":"2023-11-04T01:38:19.039063+0000","last_unstale":"2023-11-04T01:38:21.035405+0000","last_undegraded":"2023-11-04T01:38:21.035405+0000","last_fullsized":"2023-11-04T01:38:21.035405+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:57:33.405061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026083+0000","last_change":"2023-11-04T01:38:01.984341+0000","last_active":"2023-11-04T01:38:20.026083+0000","last_peered":"2023-11-04T01:38:20.026083+0000","last_clean":"2023-11-04T01:38:20.026083+0000","last_became_active":"2023-11-04T01:38:00.708307+0000","last_became_peered":"2023-11-04T01:38:00.708307+0000","last_unstale":"2023-11-04T01:38:20.026083+0000","last_undegraded":"2023-11-04T01:38:20.026083+0000","last_fullsized":"2023-11-04T01:38:20.026083+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:17.369098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053627199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673691+0000","last_change":"2023-11-04T01:38:20.039924+0000","last_active":"2023-11-04T01:38:21.673691+0000","last_peered":"2023-11-04T01:38:21.673691+0000","last_clean":"2023-11-04T01:38:21.673691+0000","last_became_active":"2023-11-04T01:38:20.039662+0000","last_became_peered":"2023-11-04T01:38:20.039662+0000","last_unstale":"2023-11-04T01:38:21.673691+0000","last_undegraded":"2023-11-04T01:38:21.673691+0000","last_fullsized":"2023-11-04T01:38:21.673691+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:46.087745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035678+0000","last_change":"2023-11-04T01:38:19.033659+0000","last_active":"2023-11-04T01:38:21.035678+0000","last_peered":"2023-11-04T01:38:21.035678+0000","last_clean":"2023-11-04T01:38:21.035678+0000","last_became_active":"2023-11-04T01:38:19.033376+0000","last_became_peered":"2023-11-04T01:38:19.033376+0000","last_unstale":"2023-11-04T01:38:21.035678+0000","last_undegraded":"2023-11-04T01:38:21.035678+0000","last_fullsized":"2023-11-04T01:38:21.035678+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:41:45.674982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.033795+0000","last_change":"2023-11-04T01:38:01.700471+0000","last_active":"2023-11-04T01:38:20.033795+0000","last_peered":"2023-11-04T01:38:20.033795+0000","last_clean":"2023-11-04T01:38:20.033795+0000","last_became_active":"2023-11-04T01:38:00.702522+0000","last_became_peered":"2023-11-04T01:38:00.702522+0000","last_unstale":"2023-11-04T01:38:20.033795+0000","last_undegraded":"2023-11-04T01:38:20.033795+0000","last_fullsized":"2023-11-04T01:38:20.033795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086940300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675059+0000","last_change":"2023-11-04T01:38:20.045928+0000","last_active":"2023-11-04T01:38:21.675059+0000","last_peered":"2023-11-04T01:38:21.675059+0000","last_clean":"2023-11-04T01:38:21.675059+0000","last_became_active":"2023-11-04T01:38:20.045655+0000","last_became_peered":"2023-11-04T01:38:20.045655+0000","last_unstale":"2023-11-04T01:38:21.675059+0000","last_undegraded":"2023-11-04T01:38:21.675059+0000","last_fullsized":"2023-11-04T01:38:21.675059+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:04.967285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673758+0000","last_change":"2023-11-04T01:38:19.038158+0000","last_active":"2023-11-04T01:38:21.673758+0000","last_peered":"2023-11-04T01:38:21.673758+0000","last_clean":"2023-11-04T01:38:21.673758+0000","last_became_active":"2023-11-04T01:38:19.037906+0000","last_became_peered":"2023-11-04T01:38:19.037906+0000","last_unstale":"2023-11-04T01:38:21.673758+0000","last_undegraded":"2023-11-04T01:38:21.673758+0000","last_fullsized":"2023-11-04T01:38:21.673758+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:46:26.432698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026970+0000","last_change":"2023-11-04T01:38:01.696901+0000","last_active":"2023-11-04T01:38:20.026970+0000","last_peered":"2023-11-04T01:38:20.026970+0000","last_clean":"2023-11-04T01:38:20.026970+0000","last_became_active":"2023-11-04T01:38:00.706170+0000","last_became_peered":"2023-11-04T01:38:00.706170+0000","last_unstale":"2023-11-04T01:38:20.026970+0000","last_undegraded":"2023-11-04T01:38:20.026970+0000","last_fullsized":"2023-11-04T01:38:20.026970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059391100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674835+0000","last_change":"2023-11-04T01:38:20.045308+0000","last_active":"2023-11-04T01:38:21.674835+0000","last_peered":"2023-11-04T01:38:21.674835+0000","last_clean":"2023-11-04T01:38:21.674835+0000","last_became_active":"2023-11-04T01:38:20.045053+0000","last_became_peered":"2023-11-04T01:38:20.045053+0000","last_unstale":"2023-11-04T01:38:21.674835+0000","last_undegraded":"2023-11-04T01:38:21.674835+0000","last_fullsized":"2023-11-04T01:38:21.674835+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:17:19.236320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035078+0000","last_change":"2023-11-04T01:38:19.034665+0000","last_active":"2023-11-04T01:38:21.035078+0000","last_peered":"2023-11-04T01:38:21.035078+0000","last_clean":"2023-11-04T01:38:21.035078+0000","last_became_active":"2023-11-04T01:38:19.034325+0000","last_became_peered":"2023-11-04T01:38:19.034325+0000","last_unstale":"2023-11-04T01:38:21.035078+0000","last_undegraded":"2023-11-04T01:38:21.035078+0000","last_fullsized":"2023-11-04T01:38:21.035078+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:37.353020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.040306+0000","last_change":"2023-11-04T01:38:01.939972+0000","last_active":"2023-11-04T01:38:20.040306+0000","last_peered":"2023-11-04T01:38:20.040306+0000","last_clean":"2023-11-04T01:38:20.040306+0000","last_became_active":"2023-11-04T01:38:00.702784+0000","last_became_peered":"2023-11-04T01:38:00.702784+0000","last_unstale":"2023-11-04T01:38:20.040306+0000","last_undegraded":"2023-11-04T01:38:20.040306+0000","last_fullsized":"2023-11-04T01:38:20.040306+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:26.760402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071328600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674770+0000","last_change":"2023-11-04T01:38:20.042335+0000","last_active":"2023-11-04T01:38:21.674770+0000","last_peered":"2023-11-04T01:38:21.674770+0000","last_clean":"2023-11-04T01:38:21.674770+0000","last_became_active":"2023-11-04T01:38:20.041831+0000","last_became_peered":"2023-11-04T01:38:20.041831+0000","last_unstale":"2023-11-04T01:38:21.674770+0000","last_undegraded":"2023-11-04T01:38:21.674770+0000","last_fullsized":"2023-11-04T01:38:21.674770+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:55.373532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035305+0000","last_change":"2023-11-04T01:38:19.037726+0000","last_active":"2023-11-04T01:38:21.035305+0000","last_peered":"2023-11-04T01:38:21.035305+0000","last_clean":"2023-11-04T01:38:21.035305+0000","last_became_active":"2023-11-04T01:38:19.037459+0000","last_became_peered":"2023-11-04T01:38:19.037459+0000","last_unstale":"2023-11-04T01:38:21.035305+0000","last_undegraded":"2023-11-04T01:38:21.035305+0000","last_fullsized":"2023-11-04T01:38:21.035305+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:45.082645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.027534+0000","last_change":"2023-11-04T01:38:01.699051+0000","last_active":"2023-11-04T01:38:20.027534+0000","last_peered":"2023-11-04T01:38:20.027534+0000","last_clean":"2023-11-04T01:38:20.027534+0000","last_became_active":"2023-11-04T01:38:00.708665+0000","last_became_peered":"2023-11-04T01:38:00.708665+0000","last_unstale":"2023-11-04T01:38:20.027534+0000","last_undegraded":"2023-11-04T01:38:20.027534+0000","last_fullsized":"2023-11-04T01:38:20.027534+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020995580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034089+0000","last_change":"2023-11-04T01:38:20.037174+0000","last_active":"2023-11-04T01:38:21.034089+0000","last_peered":"2023-11-04T01:38:21.034089+0000","last_clean":"2023-11-04T01:38:21.034089+0000","last_became_active":"2023-11-04T01:38:20.036695+0000","last_became_peered":"2023-11-04T01:38:20.036695+0000","last_unstale":"2023-11-04T01:38:21.034089+0000","last_undegraded":"2023-11-04T01:38:21.034089+0000","last_fullsized":"2023-11-04T01:38:21.034089+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:38.358120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673587+0000","last_change":"2023-11-04T01:38:19.034220+0000","last_active":"2023-11-04T01:38:21.673587+0000","last_peered":"2023-11-04T01:38:21.673587+0000","last_clean":"2023-11-04T01:38:21.673587+0000","last_became_active":"2023-11-04T01:38:19.033675+0000","last_became_peered":"2023-11-04T01:38:19.033675+0000","last_unstale":"2023-11-04T01:38:21.673587+0000","last_undegraded":"2023-11-04T01:38:21.673587+0000","last_fullsized":"2023-11-04T01:38:21.673587+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:03.869363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.034399+0000","last_change":"2023-11-04T01:38:01.700742+0000","last_active":"2023-11-04T01:38:20.034399+0000","last_peered":"2023-11-04T01:38:20.034399+0000","last_clean":"2023-11-04T01:38:20.034399+0000","last_became_active":"2023-11-04T01:38:00.706671+0000","last_became_peered":"2023-11-04T01:38:00.706671+0000","last_unstale":"2023-11-04T01:38:20.034399+0000","last_undegraded":"2023-11-04T01:38:20.034399+0000","last_fullsized":"2023-11-04T01:38:20.034399+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072370699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674120+0000","last_change":"2023-11-04T01:38:20.038173+0000","last_active":"2023-11-04T01:38:21.674120+0000","last_peered":"2023-11-04T01:38:21.674120+0000","last_clean":"2023-11-04T01:38:21.674120+0000","last_became_active":"2023-11-04T01:38:20.037915+0000","last_became_peered":"2023-11-04T01:38:20.037915+0000","last_unstale":"2023-11-04T01:38:21.674120+0000","last_undegraded":"2023-11-04T01:38:21.674120+0000","last_fullsized":"2023-11-04T01:38:21.674120+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:38:22.194989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675318+0000","last_change":"2023-11-04T01:38:19.036037+0000","last_active":"2023-11-04T01:38:21.675318+0000","last_peered":"2023-11-04T01:38:21.675318+0000","last_clean":"2023-11-04T01:38:21.675318+0000","last_became_active":"2023-11-04T01:38:19.035785+0000","last_became_peered":"2023-11-04T01:38:19.035785+0000","last_unstale":"2023-11-04T01:38:21.675318+0000","last_undegraded":"2023-11-04T01:38:21.675318+0000","last_fullsized":"2023-11-04T01:38:21.675318+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:06.620841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025946+0000","last_change":"2023-11-04T01:38:01.697526+0000","last_active":"2023-11-04T01:38:20.025946+0000","last_peered":"2023-11-04T01:38:20.025946+0000","last_clean":"2023-11-04T01:38:20.025946+0000","last_became_active":"2023-11-04T01:38:00.707580+0000","last_became_peered":"2023-11-04T01:38:00.707580+0000","last_unstale":"2023-11-04T01:38:20.025946+0000","last_undegraded":"2023-11-04T01:38:20.025946+0000","last_fullsized":"2023-11-04T01:38:20.025946+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010806699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674144+0000","last_change":"2023-11-04T01:38:20.037669+0000","last_active":"2023-11-04T01:38:21.674144+0000","last_peered":"2023-11-04T01:38:21.674144+0000","last_clean":"2023-11-04T01:38:21.674144+0000","last_became_active":"2023-11-04T01:38:20.037409+0000","last_became_peered":"2023-11-04T01:38:20.037409+0000","last_unstale":"2023-11-04T01:38:21.674144+0000","last_undegraded":"2023-11-04T01:38:21.674144+0000","last_fullsized":"2023-11-04T01:38:21.674144+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:13.116417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674012+0000","last_change":"2023-11-04T01:38:19.039222+0000","last_active":"2023-11-04T01:38:21.674012+0000","last_peered":"2023-11-04T01:38:21.674012+0000","last_clean":"2023-11-04T01:38:21.674012+0000","last_became_active":"2023-11-04T01:38:19.038641+0000","last_became_peered":"2023-11-04T01:38:19.038641+0000","last_unstale":"2023-11-04T01:38:21.674012+0000","last_undegraded":"2023-11-04T01:38:21.674012+0000","last_fullsized":"2023-11-04T01:38:21.674012+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:59.161199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.035103+0000","last_change":"2023-11-04T01:38:01.939462+0000","last_active":"2023-11-04T01:38:20.035103+0000","last_peered":"2023-11-04T01:38:20.035103+0000","last_clean":"2023-11-04T01:38:20.035103+0000","last_became_active":"2023-11-04T01:38:00.705830+0000","last_became_peered":"2023-11-04T01:38:00.705830+0000","last_unstale":"2023-11-04T01:38:20.035103+0000","last_undegraded":"2023-11-04T01:38:20.035103+0000","last_fullsized":"2023-11-04T01:38:20.035103+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059305000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674368+0000","last_change":"2023-11-04T01:38:20.041751+0000","last_active":"2023-11-04T01:38:21.674368+0000","last_peered":"2023-11-04T01:38:21.674368+0000","last_clean":"2023-11-04T01:38:21.674368+0000","last_became_active":"2023-11-04T01:38:20.041457+0000","last_became_peered":"2023-11-04T01:38:20.041457+0000","last_unstale":"2023-11-04T01:38:21.674368+0000","last_undegraded":"2023-11-04T01:38:21.674368+0000","last_fullsized":"2023-11-04T01:38:21.674368+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:29:25.119418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673850+0000","last_change":"2023-11-04T01:38:19.035414+0000","last_active":"2023-11-04T01:38:21.673850+0000","last_peered":"2023-11-04T01:38:21.673850+0000","last_clean":"2023-11-04T01:38:21.673850+0000","last_became_active":"2023-11-04T01:38:19.035150+0000","last_became_peered":"2023-11-04T01:38:19.035150+0000","last_unstale":"2023-11-04T01:38:21.673850+0000","last_undegraded":"2023-11-04T01:38:21.673850+0000","last_fullsized":"2023-11-04T01:38:21.673850+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:41:45.674982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026156+0000","last_change":"2023-11-04T01:38:01.984456+0000","last_active":"2023-11-04T01:38:20.026156+0000","last_peered":"2023-11-04T01:38:20.026156+0000","last_clean":"2023-11-04T01:38:20.026156+0000","last_became_active":"2023-11-04T01:38:00.708803+0000","last_became_peered":"2023-11-04T01:38:00.708803+0000","last_unstale":"2023-11-04T01:38:20.026156+0000","last_undegraded":"2023-11-04T01:38:20.026156+0000","last_fullsized":"2023-11-04T01:38:20.026156+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:30.811033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061551599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674187+0000","last_change":"2023-11-04T01:38:20.037620+0000","last_active":"2023-11-04T01:38:21.674187+0000","last_peered":"2023-11-04T01:38:21.674187+0000","last_clean":"2023-11-04T01:38:21.674187+0000","last_became_active":"2023-11-04T01:38:20.037323+0000","last_became_peered":"2023-11-04T01:38:20.037323+0000","last_unstale":"2023-11-04T01:38:21.674187+0000","last_undegraded":"2023-11-04T01:38:21.674187+0000","last_fullsized":"2023-11-04T01:38:21.674187+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:22.724353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674442+0000","last_change":"2023-11-04T01:38:19.039493+0000","last_active":"2023-11-04T01:38:21.674442+0000","last_peered":"2023-11-04T01:38:21.674442+0000","last_clean":"2023-11-04T01:38:21.674442+0000","last_became_active":"2023-11-04T01:38:19.039255+0000","last_became_peered":"2023-11-04T01:38:19.039255+0000","last_unstale":"2023-11-04T01:38:21.674442+0000","last_undegraded":"2023-11-04T01:38:21.674442+0000","last_fullsized":"2023-11-04T01:38:21.674442+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:27.992870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025849+0000","last_change":"2023-11-04T01:38:01.698866+0000","last_active":"2023-11-04T01:38:20.025849+0000","last_peered":"2023-11-04T01:38:20.025849+0000","last_clean":"2023-11-04T01:38:20.025849+0000","last_became_active":"2023-11-04T01:38:00.706149+0000","last_became_peered":"2023-11-04T01:38:00.706149+0000","last_unstale":"2023-11-04T01:38:20.025849+0000","last_undegraded":"2023-11-04T01:38:20.025849+0000","last_fullsized":"2023-11-04T01:38:20.025849+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:59.391683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001344154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035004+0000","last_change":"2023-11-04T01:38:20.047057+0000","last_active":"2023-11-04T01:38:21.035004+0000","last_peered":"2023-11-04T01:38:21.035004+0000","last_clean":"2023-11-04T01:38:21.035004+0000","last_became_active":"2023-11-04T01:38:20.046753+0000","last_became_peered":"2023-11-04T01:38:20.046753+0000","last_unstale":"2023-11-04T01:38:21.035004+0000","last_undegraded":"2023-11-04T01:38:21.035004+0000","last_fullsized":"2023-11-04T01:38:21.035004+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:07.625941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035408+0000","last_change":"2023-11-04T01:38:19.043265+0000","last_active":"2023-11-04T01:38:21.035408+0000","last_peered":"2023-11-04T01:38:21.035408+0000","last_clean":"2023-11-04T01:38:21.035408+0000","last_became_active":"2023-11-04T01:38:19.043036+0000","last_became_peered":"2023-11-04T01:38:19.043036+0000","last_unstale":"2023-11-04T01:38:21.035408+0000","last_undegraded":"2023-11-04T01:38:21.035408+0000","last_fullsized":"2023-11-04T01:38:21.035408+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:50.175265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025122+0000","last_change":"2023-11-04T01:38:01.699187+0000","last_active":"2023-11-04T01:38:20.025122+0000","last_peered":"2023-11-04T01:38:20.025122+0000","last_clean":"2023-11-04T01:38:20.025122+0000","last_became_active":"2023-11-04T01:38:00.706136+0000","last_became_peered":"2023-11-04T01:38:00.706136+0000","last_unstale":"2023-11-04T01:38:20.025122+0000","last_undegraded":"2023-11-04T01:38:20.025122+0000","last_fullsized":"2023-11-04T01:38:20.025122+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074666999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674880+0000","last_change":"2023-11-04T01:38:20.043562+0000","last_active":"2023-11-04T01:38:21.674880+0000","last_peered":"2023-11-04T01:38:21.674880+0000","last_clean":"2023-11-04T01:38:21.674880+0000","last_became_active":"2023-11-04T01:38:20.043168+0000","last_became_peered":"2023-11-04T01:38:20.043168+0000","last_unstale":"2023-11-04T01:38:21.674880+0000","last_undegraded":"2023-11-04T01:38:21.674880+0000","last_fullsized":"2023-11-04T01:38:21.674880+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:32:23.561456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673612+0000","last_change":"2023-11-04T01:38:19.033980+0000","last_active":"2023-11-04T01:38:21.673612+0000","last_peered":"2023-11-04T01:38:21.673612+0000","last_clean":"2023-11-04T01:38:21.673612+0000","last_became_active":"2023-11-04T01:38:19.033687+0000","last_became_peered":"2023-11-04T01:38:19.033687+0000","last_unstale":"2023-11-04T01:38:21.673612+0000","last_undegraded":"2023-11-04T01:38:21.673612+0000","last_fullsized":"2023-11-04T01:38:21.673612+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:18:55.720099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026532+0000","last_change":"2023-11-04T01:38:01.699630+0000","last_active":"2023-11-04T01:38:20.026532+0000","last_peered":"2023-11-04T01:38:20.026532+0000","last_clean":"2023-11-04T01:38:20.026532+0000","last_became_active":"2023-11-04T01:38:00.702550+0000","last_became_peered":"2023-11-04T01:38:00.702550+0000","last_unstale":"2023-11-04T01:38:20.026532+0000","last_undegraded":"2023-11-04T01:38:20.026532+0000","last_fullsized":"2023-11-04T01:38:20.026532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001016077,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675025+0000","last_change":"2023-11-04T01:38:20.042484+0000","last_active":"2023-11-04T01:38:21.675025+0000","last_peered":"2023-11-04T01:38:21.675025+0000","last_clean":"2023-11-04T01:38:21.675025+0000","last_became_active":"2023-11-04T01:38:20.042102+0000","last_became_peered":"2023-11-04T01:38:20.042102+0000","last_unstale":"2023-11-04T01:38:21.675025+0000","last_undegraded":"2023-11-04T01:38:21.675025+0000","last_fullsized":"2023-11-04T01:38:21.675025+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:33:40.713323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674757+0000","last_change":"2023-11-04T01:38:19.037850+0000","last_active":"2023-11-04T01:38:21.674757+0000","last_peered":"2023-11-04T01:38:21.674757+0000","last_clean":"2023-11-04T01:38:21.674757+0000","last_became_active":"2023-11-04T01:38:19.036655+0000","last_became_peered":"2023-11-04T01:38:19.036655+0000","last_unstale":"2023-11-04T01:38:21.674757+0000","last_undegraded":"2023-11-04T01:38:21.674757+0000","last_fullsized":"2023-11-04T01:38:21.674757+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:34.454786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025967+0000","last_change":"2023-11-04T01:38:01.984764+0000","last_active":"2023-11-04T01:38:20.025967+0000","last_peered":"2023-11-04T01:38:20.025967+0000","last_clean":"2023-11-04T01:38:20.025967+0000","last_became_active":"2023-11-04T01:38:00.709894+0000","last_became_peered":"2023-11-04T01:38:00.709894+0000","last_unstale":"2023-11-04T01:38:20.025967+0000","last_undegraded":"2023-11-04T01:38:20.025967+0000","last_fullsized":"2023-11-04T01:38:20.025967+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:08:42.829255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045046799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674470+0000","last_change":"2023-11-04T01:38:20.035044+0000","last_active":"2023-11-04T01:38:21.674470+0000","last_peered":"2023-11-04T01:38:21.674470+0000","last_clean":"2023-11-04T01:38:21.674470+0000","last_became_active":"2023-11-04T01:38:20.034798+0000","last_became_peered":"2023-11-04T01:38:20.034798+0000","last_unstale":"2023-11-04T01:38:21.674470+0000","last_undegraded":"2023-11-04T01:38:21.674470+0000","last_fullsized":"2023-11-04T01:38:21.674470+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:12.069863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673343+0000","last_change":"2023-11-04T01:38:19.040119+0000","last_active":"2023-11-04T01:38:21.673343+0000","last_peered":"2023-11-04T01:38:21.673343+0000","last_clean":"2023-11-04T01:38:21.673343+0000","last_became_active":"2023-11-04T01:38:19.039671+0000","last_became_peered":"2023-11-04T01:38:19.039671+0000","last_unstale":"2023-11-04T01:38:21.673343+0000","last_undegraded":"2023-11-04T01:38:21.673343+0000","last_fullsized":"2023-11-04T01:38:21.673343+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:27.960389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.030006+0000","last_change":"2023-11-04T01:38:02.321871+0000","last_active":"2023-11-04T01:38:20.030006+0000","last_peered":"2023-11-04T01:38:20.030006+0000","last_clean":"2023-11-04T01:38:20.030006+0000","last_became_active":"2023-11-04T01:38:00.708407+0000","last_became_peered":"2023-11-04T01:38:00.708407+0000","last_unstale":"2023-11-04T01:38:20.030006+0000","last_undegraded":"2023-11-04T01:38:20.030006+0000","last_fullsized":"2023-11-04T01:38:20.030006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:48.672429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032387200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674136+0000","last_change":"2023-11-04T01:38:20.046019+0000","last_active":"2023-11-04T01:38:21.674136+0000","last_peered":"2023-11-04T01:38:21.674136+0000","last_clean":"2023-11-04T01:38:21.674136+0000","last_became_active":"2023-11-04T01:38:20.045295+0000","last_became_peered":"2023-11-04T01:38:20.045295+0000","last_unstale":"2023-11-04T01:38:21.674136+0000","last_undegraded":"2023-11-04T01:38:21.674136+0000","last_fullsized":"2023-11-04T01:38:21.674136+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:07.625941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674334+0000","last_change":"2023-11-04T01:38:19.037308+0000","last_active":"2023-11-04T01:38:21.674334+0000","last_peered":"2023-11-04T01:38:21.674334+0000","last_clean":"2023-11-04T01:38:21.674334+0000","last_became_active":"2023-11-04T01:38:19.037030+0000","last_became_peered":"2023-11-04T01:38:19.037030+0000","last_unstale":"2023-11-04T01:38:21.674334+0000","last_undegraded":"2023-11-04T01:38:21.674334+0000","last_fullsized":"2023-11-04T01:38:21.674334+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:41.910027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026703+0000","last_change":"2023-11-04T01:38:01.983988+0000","last_active":"2023-11-04T01:38:20.026703+0000","last_peered":"2023-11-04T01:38:20.026703+0000","last_clean":"2023-11-04T01:38:20.026703+0000","last_became_active":"2023-11-04T01:38:00.711020+0000","last_became_peered":"2023-11-04T01:38:00.711020+0000","last_unstale":"2023-11-04T01:38:20.026703+0000","last_undegraded":"2023-11-04T01:38:20.026703+0000","last_fullsized":"2023-11-04T01:38:20.026703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:06.374078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674030+0000","last_change":"2023-11-04T01:38:20.043160+0000","last_active":"2023-11-04T01:38:21.674030+0000","last_peered":"2023-11-04T01:38:21.674030+0000","last_clean":"2023-11-04T01:38:21.674030+0000","last_became_active":"2023-11-04T01:38:20.042906+0000","last_became_peered":"2023-11-04T01:38:20.042906+0000","last_unstale":"2023-11-04T01:38:21.674030+0000","last_undegraded":"2023-11-04T01:38:21.674030+0000","last_fullsized":"2023-11-04T01:38:21.674030+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:42.068163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674140+0000","last_change":"2023-11-04T01:38:19.036924+0000","last_active":"2023-11-04T01:38:21.674140+0000","last_peered":"2023-11-04T01:38:21.674140+0000","last_clean":"2023-11-04T01:38:21.674140+0000","last_became_active":"2023-11-04T01:38:19.036653+0000","last_became_peered":"2023-11-04T01:38:19.036653+0000","last_unstale":"2023-11-04T01:38:21.674140+0000","last_undegraded":"2023-11-04T01:38:21.674140+0000","last_fullsized":"2023-11-04T01:38:21.674140+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:37.353020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.027634+0000","last_change":"2023-11-04T01:38:02.321641+0000","last_active":"2023-11-04T01:38:20.027634+0000","last_peered":"2023-11-04T01:38:20.027634+0000","last_clean":"2023-11-04T01:38:20.027634+0000","last_became_active":"2023-11-04T01:38:00.706199+0000","last_became_peered":"2023-11-04T01:38:00.706199+0000","last_unstale":"2023-11-04T01:38:20.027634+0000","last_undegraded":"2023-11-04T01:38:20.027634+0000","last_fullsized":"2023-11-04T01:38:20.027634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:15.138325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045080400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674411+0000","last_change":"2023-11-04T01:38:20.037896+0000","last_active":"2023-11-04T01:38:21.674411+0000","last_peered":"2023-11-04T01:38:21.674411+0000","last_clean":"2023-11-04T01:38:21.674411+0000","last_became_active":"2023-11-04T01:38:20.037634+0000","last_became_peered":"2023-11-04T01:38:20.037634+0000","last_unstale":"2023-11-04T01:38:21.674411+0000","last_undegraded":"2023-11-04T01:38:21.674411+0000","last_fullsized":"2023-11-04T01:38:21.674411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:42.068163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673947+0000","last_change":"2023-11-04T01:38:19.035871+0000","last_active":"2023-11-04T01:38:21.673947+0000","last_peered":"2023-11-04T01:38:21.673947+0000","last_clean":"2023-11-04T01:38:21.673947+0000","last_became_active":"2023-11-04T01:38:19.035611+0000","last_became_peered":"2023-11-04T01:38:19.035611+0000","last_unstale":"2023-11-04T01:38:21.673947+0000","last_undegraded":"2023-11-04T01:38:21.673947+0000","last_fullsized":"2023-11-04T01:38:21.673947+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:18:13.034093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025128+0000","last_change":"2023-11-04T01:38:02.156148+0000","last_active":"2023-11-04T01:38:20.025128+0000","last_peered":"2023-11-04T01:38:20.025128+0000","last_clean":"2023-11-04T01:38:20.025128+0000","last_became_active":"2023-11-04T01:38:00.708352+0000","last_became_peered":"2023-11-04T01:38:00.708352+0000","last_unstale":"2023-11-04T01:38:20.025128+0000","last_undegraded":"2023-11-04T01:38:20.025128+0000","last_fullsized":"2023-11-04T01:38:20.025128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035716799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673831+0000","last_change":"2023-11-04T01:38:20.039924+0000","last_active":"2023-11-04T01:38:21.673831+0000","last_peered":"2023-11-04T01:38:21.673831+0000","last_clean":"2023-11-04T01:38:21.673831+0000","last_became_active":"2023-11-04T01:38:20.039696+0000","last_became_peered":"2023-11-04T01:38:20.039696+0000","last_unstale":"2023-11-04T01:38:21.673831+0000","last_undegraded":"2023-11-04T01:38:21.673831+0000","last_fullsized":"2023-11-04T01:38:21.673831+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:57:34.410161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034108+0000","last_change":"2023-11-04T01:38:19.031312+0000","last_active":"2023-11-04T01:38:21.034108+0000","last_peered":"2023-11-04T01:38:21.034108+0000","last_clean":"2023-11-04T01:38:21.034108+0000","last_became_active":"2023-11-04T01:38:19.030697+0000","last_became_peered":"2023-11-04T01:38:19.030697+0000","last_unstale":"2023-11-04T01:38:21.034108+0000","last_undegraded":"2023-11-04T01:38:21.034108+0000","last_fullsized":"2023-11-04T01:38:21.034108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:43.411728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.040006+0000","last_change":"2023-11-04T01:38:01.939729+0000","last_active":"2023-11-04T01:38:20.040006+0000","last_peered":"2023-11-04T01:38:20.040006+0000","last_clean":"2023-11-04T01:38:20.040006+0000","last_became_active":"2023-11-04T01:38:00.704384+0000","last_became_peered":"2023-11-04T01:38:00.704384+0000","last_unstale":"2023-11-04T01:38:20.040006+0000","last_undegraded":"2023-11-04T01:38:20.040006+0000","last_fullsized":"2023-11-04T01:38:20.040006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080052200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673884+0000","last_change":"2023-11-04T01:38:20.034498+0000","last_active":"2023-11-04T01:38:21.673884+0000","last_peered":"2023-11-04T01:38:21.673884+0000","last_clean":"2023-11-04T01:38:21.673884+0000","last_became_active":"2023-11-04T01:38:20.033899+0000","last_became_peered":"2023-11-04T01:38:20.033899+0000","last_unstale":"2023-11-04T01:38:21.673884+0000","last_undegraded":"2023-11-04T01:38:21.673884+0000","last_fullsized":"2023-11-04T01:38:21.673884+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:47:02.791475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673776+0000","last_change":"2023-11-04T01:38:19.034468+0000","last_active":"2023-11-04T01:38:21.673776+0000","last_peered":"2023-11-04T01:38:21.673776+0000","last_clean":"2023-11-04T01:38:21.673776+0000","last_became_active":"2023-11-04T01:38:19.034221+0000","last_became_peered":"2023-11-04T01:38:19.034221+0000","last_unstale":"2023-11-04T01:38:21.673776+0000","last_undegraded":"2023-11-04T01:38:21.673776+0000","last_fullsized":"2023-11-04T01:38:21.673776+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:20:06.734657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.027053+0000","last_change":"2023-11-04T01:38:01.697272+0000","last_active":"2023-11-04T01:38:20.027053+0000","last_peered":"2023-11-04T01:38:20.027053+0000","last_clean":"2023-11-04T01:38:20.027053+0000","last_became_active":"2023-11-04T01:38:00.709395+0000","last_became_peered":"2023-11-04T01:38:00.709395+0000","last_unstale":"2023-11-04T01:38:20.027053+0000","last_undegraded":"2023-11-04T01:38:20.027053+0000","last_fullsized":"2023-11-04T01:38:20.027053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076665499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673660+0000","last_change":"2023-11-04T01:38:20.040105+0000","last_active":"2023-11-04T01:38:21.673660+0000","last_peered":"2023-11-04T01:38:21.673660+0000","last_clean":"2023-11-04T01:38:21.673660+0000","last_became_active":"2023-11-04T01:38:20.039595+0000","last_became_peered":"2023-11-04T01:38:20.039595+0000","last_unstale":"2023-11-04T01:38:21.673660+0000","last_undegraded":"2023-11-04T01:38:21.673660+0000","last_fullsized":"2023-11-04T01:38:21.673660+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:47:02.791475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675235+0000","last_change":"2023-11-04T01:38:19.035180+0000","last_active":"2023-11-04T01:38:21.675235+0000","last_peered":"2023-11-04T01:38:21.675235+0000","last_clean":"2023-11-04T01:38:21.675235+0000","last_became_active":"2023-11-04T01:38:19.034909+0000","last_became_peered":"2023-11-04T01:38:19.034909+0000","last_unstale":"2023-11-04T01:38:21.675235+0000","last_undegraded":"2023-11-04T01:38:21.675235+0000","last_fullsized":"2023-11-04T01:38:21.675235+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:41.063063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026616+0000","last_change":"2023-11-04T01:38:01.984567+0000","last_active":"2023-11-04T01:38:20.026616+0000","last_peered":"2023-11-04T01:38:20.026616+0000","last_clean":"2023-11-04T01:38:20.026616+0000","last_became_active":"2023-11-04T01:38:00.708020+0000","last_became_peered":"2023-11-04T01:38:00.708020+0000","last_unstale":"2023-11-04T01:38:20.026616+0000","last_undegraded":"2023-11-04T01:38:20.026616+0000","last_fullsized":"2023-11-04T01:38:20.026616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:09.638146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056906299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673592+0000","last_change":"2023-11-04T01:38:20.041668+0000","last_active":"2023-11-04T01:38:21.673592+0000","last_peered":"2023-11-04T01:38:21.673592+0000","last_clean":"2023-11-04T01:38:21.673592+0000","last_became_active":"2023-11-04T01:38:20.041410+0000","last_became_peered":"2023-11-04T01:38:20.041410+0000","last_unstale":"2023-11-04T01:38:21.673592+0000","last_undegraded":"2023-11-04T01:38:21.673592+0000","last_fullsized":"2023-11-04T01:38:21.673592+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:23:35.405508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673509+0000","last_change":"2023-11-04T01:38:19.038777+0000","last_active":"2023-11-04T01:38:21.673509+0000","last_peered":"2023-11-04T01:38:21.673509+0000","last_clean":"2023-11-04T01:38:21.673509+0000","last_became_active":"2023-11-04T01:38:19.038468+0000","last_became_peered":"2023-11-04T01:38:19.038468+0000","last_unstale":"2023-11-04T01:38:21.673509+0000","last_undegraded":"2023-11-04T01:38:21.673509+0000","last_fullsized":"2023-11-04T01:38:21.673509+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:04.103557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.024924+0000","last_change":"2023-11-04T01:38:01.699685+0000","last_active":"2023-11-04T01:38:20.024924+0000","last_peered":"2023-11-04T01:38:20.024924+0000","last_clean":"2023-11-04T01:38:20.024924+0000","last_became_active":"2023-11-04T01:38:00.706802+0000","last_became_peered":"2023-11-04T01:38:00.706802+0000","last_unstale":"2023-11-04T01:38:20.024924+0000","last_undegraded":"2023-11-04T01:38:20.024924+0000","last_fullsized":"2023-11-04T01:38:20.024924+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085845400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674147+0000","last_change":"2023-11-04T01:38:20.054374+0000","last_active":"2023-11-04T01:38:21.674147+0000","last_peered":"2023-11-04T01:38:21.674147+0000","last_clean":"2023-11-04T01:38:21.674147+0000","last_became_active":"2023-11-04T01:38:20.054116+0000","last_became_peered":"2023-11-04T01:38:20.054116+0000","last_unstale":"2023-11-04T01:38:21.674147+0000","last_undegraded":"2023-11-04T01:38:21.674147+0000","last_fullsized":"2023-11-04T01:38:21.674147+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:37:52.192853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674217+0000","last_change":"2023-11-04T01:38:19.038783+0000","last_active":"2023-11-04T01:38:21.674217+0000","last_peered":"2023-11-04T01:38:21.674217+0000","last_clean":"2023-11-04T01:38:21.674217+0000","last_became_active":"2023-11-04T01:38:19.038529+0000","last_became_peered":"2023-11-04T01:38:19.038529+0000","last_unstale":"2023-11-04T01:38:21.674217+0000","last_undegraded":"2023-11-04T01:38:21.674217+0000","last_fullsized":"2023-11-04T01:38:21.674217+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:39.781516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.033827+0000","last_change":"2023-11-04T01:38:01.700399+0000","last_active":"2023-11-04T01:38:20.033827+0000","last_peered":"2023-11-04T01:38:20.033827+0000","last_clean":"2023-11-04T01:38:20.033827+0000","last_became_active":"2023-11-04T01:38:00.701352+0000","last_became_peered":"2023-11-04T01:38:00.701352+0000","last_unstale":"2023-11-04T01:38:20.033827+0000","last_undegraded":"2023-11-04T01:38:20.033827+0000","last_fullsized":"2023-11-04T01:38:20.033827+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078589399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035927+0000","last_change":"2023-11-04T01:38:20.035907+0000","last_active":"2023-11-04T01:38:21.035927+0000","last_peered":"2023-11-04T01:38:21.035927+0000","last_clean":"2023-11-04T01:38:21.035927+0000","last_became_active":"2023-11-04T01:38:20.035487+0000","last_became_peered":"2023-11-04T01:38:20.035487+0000","last_unstale":"2023-11-04T01:38:21.035927+0000","last_undegraded":"2023-11-04T01:38:21.035927+0000","last_fullsized":"2023-11-04T01:38:21.035927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:32:23.561456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675407+0000","last_change":"2023-11-04T01:38:19.037147+0000","last_active":"2023-11-04T01:38:21.675407+0000","last_peered":"2023-11-04T01:38:21.675407+0000","last_clean":"2023-11-04T01:38:21.675407+0000","last_became_active":"2023-11-04T01:38:19.036862+0000","last_became_peered":"2023-11-04T01:38:19.036862+0000","last_unstale":"2023-11-04T01:38:21.675407+0000","last_undegraded":"2023-11-04T01:38:21.675407+0000","last_fullsized":"2023-11-04T01:38:21.675407+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:56.458934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.032215+0000","last_change":"2023-11-04T01:38:02.362072+0000","last_active":"2023-11-04T01:38:20.032215+0000","last_peered":"2023-11-04T01:38:20.032215+0000","last_clean":"2023-11-04T01:38:20.032215+0000","last_became_active":"2023-11-04T01:38:00.710897+0000","last_became_peered":"2023-11-04T01:38:00.710897+0000","last_unstale":"2023-11-04T01:38:20.032215+0000","last_undegraded":"2023-11-04T01:38:20.032215+0000","last_fullsized":"2023-11-04T01:38:20.032215+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:25.229838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058055900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035563+0000","last_change":"2023-11-04T01:38:20.035410+0000","last_active":"2023-11-04T01:38:21.035563+0000","last_peered":"2023-11-04T01:38:21.035563+0000","last_clean":"2023-11-04T01:38:21.035563+0000","last_became_active":"2023-11-04T01:38:20.034871+0000","last_became_peered":"2023-11-04T01:38:20.034871+0000","last_unstale":"2023-11-04T01:38:21.035563+0000","last_undegraded":"2023-11-04T01:38:21.035563+0000","last_fullsized":"2023-11-04T01:38:21.035563+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:57.464034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674269+0000","last_change":"2023-11-04T01:38:19.040085+0000","last_active":"2023-11-04T01:38:21.674269+0000","last_peered":"2023-11-04T01:38:21.674269+0000","last_clean":"2023-11-04T01:38:21.674269+0000","last_became_active":"2023-11-04T01:38:19.038670+0000","last_became_peered":"2023-11-04T01:38:19.038670+0000","last_unstale":"2023-11-04T01:38:21.674269+0000","last_undegraded":"2023-11-04T01:38:21.674269+0000","last_fullsized":"2023-11-04T01:38:21.674269+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:42:38.429638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.038809+0000","last_change":"2023-11-04T01:38:01.939857+0000","last_active":"2023-11-04T01:38:20.038809+0000","last_peered":"2023-11-04T01:38:20.038809+0000","last_clean":"2023-11-04T01:38:20.038809+0000","last_became_active":"2023-11-04T01:38:00.701371+0000","last_became_peered":"2023-11-04T01:38:00.701371+0000","last_unstale":"2023-11-04T01:38:20.038809+0000","last_undegraded":"2023-11-04T01:38:20.038809+0000","last_fullsized":"2023-11-04T01:38:20.038809+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078632099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675284+0000","last_change":"2023-11-04T01:38:20.047127+0000","last_active":"2023-11-04T01:38:21.675284+0000","last_peered":"2023-11-04T01:38:21.675284+0000","last_clean":"2023-11-04T01:38:21.675284+0000","last_became_active":"2023-11-04T01:38:20.046835+0000","last_became_peered":"2023-11-04T01:38:20.046835+0000","last_unstale":"2023-11-04T01:38:21.675284+0000","last_undegraded":"2023-11-04T01:38:21.675284+0000","last_fullsized":"2023-11-04T01:38:21.675284+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:58:25.387712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674005+0000","last_change":"2023-11-04T01:38:19.034880+0000","last_active":"2023-11-04T01:38:21.674005+0000","last_peered":"2023-11-04T01:38:21.674005+0000","last_clean":"2023-11-04T01:38:21.674005+0000","last_became_active":"2023-11-04T01:38:19.034612+0000","last_became_peered":"2023-11-04T01:38:19.034612+0000","last_unstale":"2023-11-04T01:38:21.674005+0000","last_undegraded":"2023-11-04T01:38:21.674005+0000","last_fullsized":"2023-11-04T01:38:21.674005+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:23:34.400408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.040072+0000","last_change":"2023-11-04T01:38:01.939662+0000","last_active":"2023-11-04T01:38:20.040072+0000","last_peered":"2023-11-04T01:38:20.040072+0000","last_clean":"2023-11-04T01:38:20.040072+0000","last_became_active":"2023-11-04T01:38:00.705871+0000","last_became_peered":"2023-11-04T01:38:00.705871+0000","last_unstale":"2023-11-04T01:38:20.040072+0000","last_undegraded":"2023-11-04T01:38:20.040072+0000","last_fullsized":"2023-11-04T01:38:20.040072+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066873200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675053+0000","last_change":"2023-11-04T01:38:20.046325+0000","last_active":"2023-11-04T01:38:21.675053+0000","last_peered":"2023-11-04T01:38:21.675053+0000","last_clean":"2023-11-04T01:38:21.675053+0000","last_became_active":"2023-11-04T01:38:20.045741+0000","last_became_peered":"2023-11-04T01:38:20.045741+0000","last_unstale":"2023-11-04T01:38:21.675053+0000","last_undegraded":"2023-11-04T01:38:21.675053+0000","last_fullsized":"2023-11-04T01:38:21.675053+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:33.689272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034334+0000","last_change":"2023-11-04T01:38:19.035913+0000","last_active":"2023-11-04T01:38:21.034334+0000","last_peered":"2023-11-04T01:38:21.034334+0000","last_clean":"2023-11-04T01:38:21.034334+0000","last_became_active":"2023-11-04T01:38:19.035614+0000","last_became_peered":"2023-11-04T01:38:19.035614+0000","last_unstale":"2023-11-04T01:38:21.034334+0000","last_undegraded":"2023-11-04T01:38:21.034334+0000","last_fullsized":"2023-11-04T01:38:21.034334+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:20:06.734657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025775+0000","last_change":"2023-11-04T01:38:01.984672+0000","last_active":"2023-11-04T01:38:20.025775+0000","last_peered":"2023-11-04T01:38:20.025775+0000","last_clean":"2023-11-04T01:38:20.025775+0000","last_became_active":"2023-11-04T01:38:00.706804+0000","last_became_peered":"2023-11-04T01:38:00.706804+0000","last_unstale":"2023-11-04T01:38:20.025775+0000","last_undegraded":"2023-11-04T01:38:20.025775+0000","last_fullsized":"2023-11-04T01:38:20.025775+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:48.412413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038439000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034257+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:38:21.034257+0000","last_peered":"2023-11-04T01:38:21.034257+0000","last_clean":"2023-11-04T01:38:21.034257+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:38:21.034257+0000","last_undegraded":"2023-11-04T01:38:21.034257+0000","last_fullsized":"2023-11-04T01:38:21.034257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1245184,"data_stored":883232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45300000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.318}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.38100000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.437,"15min":0.42999999999999999},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65200000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.499}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.504,"15min":0.496},"min":{"1min":0.35399999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.44,"5min":0.317,"15min":0.317},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.48099999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.48799999999999999,"15min":0.47899999999999998},"min":{"1min":0.39300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.42299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":643072,"data_stored":292704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68799999999999994,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.70099999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67600000000000005,"5min":1.05,"15min":1.05},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70099999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.51000000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.66900000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.48699999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.748,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.626},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.44,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71999999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.501,"15min":0.501},"min":{"1min":0.373,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.373}]},{"osd":5,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81899999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.38,"5min":0.372,"15min":0.372},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.434}]},{"osd":7,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.67900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":293356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.58399999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55000000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.624},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.59899999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.67200000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.44400000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.56799999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.53300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":294316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.442},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.65800000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52400000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82099999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.55500000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72199999999999998,"5min":0.879,"15min":0.879},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85499999999999998,"5min":1.089,"15min":1.089},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.33600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48499999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.34100000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.50700000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.40000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92500000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":292760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.311}]},{"osd":1,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.36499999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.5}]},{"osd":6,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.58399999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":292760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.32500000000000001,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.442,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.33600000000000002,"15min":0.34300000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.39300000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.29099999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.48399999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.31},{"interface":"front","average":{"1min":0.317,"5min":0.39100000000000001,"15min":0.40300000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.44,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.36299999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.40899999999999997,"15min":0.42099999999999999},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.51500000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.42099999999999999,"15min":0.433},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.46999999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.32900000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.63900000000000001,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.82399999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.45200000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68400000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.68300000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.877,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79700000000000004,"5min":1,"15min":1},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61199999999999999,"15min":0.62},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73099999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55800000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76200000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":647168,"data_stored":292794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.39500000000000002,"15min":0.36099999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":5.415},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.42599999999999999,"15min":0.41199999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":3.456,"5min":3.456,"15min":3.456},"last":3.456}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":2.355},{"interface":"front","average":{"1min":0.5,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":2.5299999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.52600000000000002,"15min":0.47099999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":8.891,"5min":8.891,"15min":8.891},"last":8.891},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.46800000000000003,"15min":0.39600000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":9.8889999999999993,"5min":9.8889999999999993,"15min":9.8889999999999993},"last":9.8889999999999993}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.629,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":4.5720000000000001,"5min":4.5720000000000001,"15min":4.5720000000000001},"last":4.5720000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":2.3260000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":2.3860000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.46899999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":2.4889999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.68700000000000006,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.915,"5min":5.915,"15min":5.915},"last":5.915},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.288}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":2.5609999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.66000000000000003,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":7.2599999999999998,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":7.2599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1253376,"data_stored":885266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30599999999999999,"15min":0.308},"min":{"1min":0.22500000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.40600000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.252},{"interface":"front","average":{"1min":0.318,"5min":0.33500000000000002,"15min":0.33800000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47499999999999998,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.33600000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.36299999999999999,"15min":0.36699999999999999},"min":{"1min":0.23599999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.39900000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.318},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.245,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.45500000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.26700000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.315,"15min":0.315},"min":{"1min":0.24199999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.38100000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.374,"15min":0.379},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44700000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72199999999999998,"5min":0.87,"15min":0.87},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.314,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.46500000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.73299999999999998,"5min":0.996,"15min":0.996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.66700000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.496}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60499999999999998,"15min":0.61399999999999999},"min":{"1min":0.433,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70899999999999996,"5min":1.026,"15min":1.026},"last":0.433},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":1.177,"15min":1.177},"last":0.42299999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.71999999999999997,"5min":1.131,"15min":1.131},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":0.746,"15min":0.746},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:38:25.292 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:38:25.291+0000 7fd5d50ea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:38:27.886 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:38:27.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.995+0000 7ff180325640 1 Processor -- start 2023-11-04T01:38:27.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.995+0000 7ff180325640 1 -- start start 2023-11-04T01:38:27.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.996+0000 7ff180325640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff178157710 0x7ff178167b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:27.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.996+0000 7ff180325640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17815e000 con 0x7ff1780ce240 2023-11-04T01:38:27.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.996+0000 7ff180325640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17815e2e0 con 0x7ff1780cde60 2023-11-04T01:38:27.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.996+0000 7ff180325640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17815e5c0 con 0x7ff178157710 2023-11-04T01:38:27.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.996+0000 7ff17e8c2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff178157710 0x7ff178167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:27.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.996+0000 7ff17d8c0640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff1780ce240 0x7ff178157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42418/0 (socket says 172.21.15.114:42418) 2023-11-04T01:38:27.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.996+0000 7ff17d8c0640 1 -- 172.21.15.114:0/1897265650 learned_addr learned my addr 172.21.15.114:0/1897265650 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:27.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.996+0000 7ff17e8c2640 1 -- 172.21.15.114:0/1897265650 >> v1:172.21.15.141:6789/0 conn(0x7ff1780cde60 legacy=0x7ff17815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:27.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.996+0000 7ff17e8c2640 1 -- 172.21.15.114:0/1897265650 >> v1:172.21.15.114:6789/0 conn(0x7ff1780ce240 legacy=0x7ff178157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:27.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.996+0000 7ff17d0bf640 1 -- 172.21.15.114:0/1897265650 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085819194 0 0) 0x7ff17815e000 con 0x7ff1780ce240 2023-11-04T01:38:27.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.996+0000 7ff17e8c2640 1 -- 172.21.15.114:0/1897265650 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1780d1120 con 0x7ff178157710 2023-11-04T01:38:28.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.997+0000 7ff17e8c2640 1 --2- 172.21.15.114:0/1897265650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178157710 0x7ff178167b90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff1700097a0 tx=0x7ff17002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e3f9dc14c49141 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.997+0000 7ff17d0bf640 1 -- 172.21.15.114:0/1897265650 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170031830 con 0x7ff178157710 2023-11-04T01:38:28.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.997+0000 7ff17d0bf640 1 -- 172.21.15.114:0/1897265650 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff170031990 con 0x7ff178157710 2023-11-04T01:38:28.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.997+0000 7ff17d0bf640 1 -- 172.21.15.114:0/1897265650 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170031d20 con 0x7ff178157710 2023-11-04T01:38:28.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.997+0000 7ff180325640 1 -- 172.21.15.114:0/1897265650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178157710 msgr2=0x7ff178167b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.997+0000 7ff180325640 1 --2- 172.21.15.114:0/1897265650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178157710 0x7ff178167b90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff1700097a0 tx=0x7ff17002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.998+0000 7ff180325640 1 -- 172.21.15.114:0/1897265650 shutdown_connections 2023-11-04T01:38:28.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.998+0000 7ff180325640 1 --2- 172.21.15.114:0/1897265650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178157710 0x7ff178167b90 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.998+0000 7ff180325640 1 -- 172.21.15.114:0/1897265650 >> 172.21.15.114:0/1897265650 conn(0x7ff178071f30 msgr2=0x7ff1780cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:28.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.998+0000 7ff180325640 1 -- 172.21.15.114:0/1897265650 shutdown_connections 2023-11-04T01:38:28.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.998+0000 7ff180325640 1 -- 172.21.15.114:0/1897265650 wait complete. 2023-11-04T01:38:28.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.999+0000 7ff180325640 1 Processor -- start 2023-11-04T01:38:28.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.999+0000 7ff180325640 1 -- start start 2023-11-04T01:38:28.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.999+0000 7ff180325640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1780cde60 0x7ff1781f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.999+0000 7ff180325640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1780ce240 0x7ff1781f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.999+0000 7ff180325640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178157710 0x7ff17814f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.999+0000 7ff180325640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1781f2f60 con 0x7ff178157710 2023-11-04T01:38:28.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.999+0000 7ff180325640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1781f6990 con 0x7ff1780ce240 2023-11-04T01:38:28.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:27.999+0000 7ff180325640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1781f6c70 con 0x7ff1780cde60 2023-11-04T01:38:28.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.000+0000 7ff17e8c2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178157710 0x7ff17814f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.000+0000 7ff17e8c2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178157710 0x7ff17814f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59604/0 (socket says 172.21.15.114:59604) 2023-11-04T01:38:28.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.000+0000 7ff17e8c2640 1 -- 172.21.15.114:0/4251572098 learned_addr learned my addr 172.21.15.114:0/4251572098 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.000+0000 7ff17d8c0640 1 --2- 172.21.15.114:0/4251572098 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1780ce240 0x7ff1781f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.000+0000 7ff17e0c1640 1 --2- 172.21.15.114:0/4251572098 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1780cde60 0x7ff1781f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.000+0000 7ff17e8c2640 1 -- 172.21.15.114:0/4251572098 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1780cde60 msgr2=0x7ff1781f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.000+0000 7ff17e8c2640 1 --2- 172.21.15.114:0/4251572098 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1780cde60 0x7ff1781f6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.000+0000 7ff17e8c2640 1 -- 172.21.15.114:0/4251572098 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1780ce240 msgr2=0x7ff1781f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.000+0000 7ff17e8c2640 1 --2- 172.21.15.114:0/4251572098 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1780ce240 0x7ff1781f3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.000+0000 7ff17e8c2640 1 -- 172.21.15.114:0/4251572098 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff170009400 con 0x7ff178157710 2023-11-04T01:38:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.000+0000 7ff17e8c2640 1 --2- 172.21.15.114:0/4251572098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178157710 0x7ff17814f9a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ff1700097a0 tx=0x7ff1700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.000+0000 7ff176ffd640 1 -- 172.21.15.114:0/4251572098 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17003a9e0 con 0x7ff178157710 2023-11-04T01:38:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.000+0000 7ff176ffd640 1 -- 172.21.15.114:0/4251572098 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17003ab40 con 0x7ff178157710 2023-11-04T01:38:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.000+0000 7ff180325640 1 -- 172.21.15.114:0/4251572098 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1781f6f50 con 0x7ff178157710 2023-11-04T01:38:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.000+0000 7ff176ffd640 1 -- 172.21.15.114:0/4251572098 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1700443f0 con 0x7ff178157710 2023-11-04T01:38:28.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.000+0000 7ff180325640 1 -- 172.21.15.114:0/4251572098 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1781f2b00 con 0x7ff178157710 2023-11-04T01:38:28.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.001+0000 7ff180325640 1 -- 172.21.15.114:0/4251572098 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1781f30a0 con 0x7ff178157710 2023-11-04T01:38:28.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.002+0000 7ff176ffd640 1 -- 172.21.15.114:0/4251572098 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff17004d450 con 0x7ff178157710 2023-11-04T01:38:28.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.002+0000 7ff176ffd640 1 --2- 172.21.15.114:0/4251572098 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff16406ae70 0x7ff16406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.002+0000 7ff176ffd640 1 -- 172.21.15.114:0/4251572098 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff1700ab8d0 con 0x7ff178157710 2023-11-04T01:38:28.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.002+0000 7ff17e0c1640 1 --2- 172.21.15.114:0/4251572098 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff16406ae70 0x7ff16406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.003+0000 7ff17e0c1640 1 --2- 172.21.15.114:0/4251572098 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff16406ae70 0x7ff16406d330 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff1780d2910 tx=0x7ff168009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.006+0000 7ff176ffd640 1 -- 172.21.15.114:0/4251572098 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff1781f30a0 con 0x7ff178157710 2023-11-04T01:38:28.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.172+0000 7ff180325640 1 -- 172.21.15.114:0/4251572098 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1780b8060 con 0x7ff16406ae70 2023-11-04T01:38:28.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.181+0000 7ff176ffd640 1 -- 172.21.15.114:0/4251572098 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369924 (secure 0 0 0) 0x7ff1780b8060 con 0x7ff16406ae70 2023-11-04T01:38:28.187 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:28.189 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:38:28.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.185+0000 7ff180325640 1 -- 172.21.15.114:0/4251572098 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff16406ae70 msgr2=0x7ff16406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.185+0000 7ff180325640 1 --2- 172.21.15.114:0/4251572098 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff16406ae70 0x7ff16406d330 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff1780d2910 tx=0x7ff168009040 comp rx=0 tx=0).stop 2023-11-04T01:38:28.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.185+0000 7ff180325640 1 -- 172.21.15.114:0/4251572098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178157710 msgr2=0x7ff17814f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.185+0000 7ff180325640 1 --2- 172.21.15.114:0/4251572098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178157710 0x7ff17814f9a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ff1700097a0 tx=0x7ff1700046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.185+0000 7ff180325640 1 -- 172.21.15.114:0/4251572098 shutdown_connections 2023-11-04T01:38:28.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.185+0000 7ff180325640 1 --2- 172.21.15.114:0/4251572098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff178157710 0x7ff17814f9a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.185+0000 7ff180325640 1 --2- 172.21.15.114:0/4251572098 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff16406ae70 0x7ff16406d330 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.185+0000 7ff180325640 1 --2- 172.21.15.114:0/4251572098 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1780ce240 0x7ff1781f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.185+0000 7ff180325640 1 --2- 172.21.15.114:0/4251572098 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1780cde60 0x7ff1781f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.185+0000 7ff180325640 1 -- 172.21.15.114:0/4251572098 >> 172.21.15.114:0/4251572098 conn(0x7ff178071f30 msgr2=0x7ff1780d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:28.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.185+0000 7ff180325640 1 -- 172.21.15.114:0/4251572098 shutdown_connections 2023-11-04T01:38:28.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.185+0000 7ff180325640 1 -- 172.21.15.114:0/4251572098 wait complete. 2023-11-04T01:38:28.197 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-11-04T01:38:27.882596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":246,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222440,"kb_used_data":6248,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752280,"statfs":{"total":773094113280,"available":772866334720,"internally_reserved":0,"allocated":6397952,"data_stored":3527188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001720"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205396+0000","last_change":"2023-11-04T01:38:20.049549+0000","last_active":"2023-11-04T01:38:21.205396+0000","last_peered":"2023-11-04T01:38:21.205396+0000","last_clean":"2023-11-04T01:38:21.205396+0000","last_became_active":"2023-11-04T01:38:20.049262+0000","last_became_peered":"2023-11-04T01:38:20.049262+0000","last_unstale":"2023-11-04T01:38:21.205396+0000","last_undegraded":"2023-11-04T01:38:21.205396+0000","last_fullsized":"2023-11-04T01:38:21.205396+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:27:08.487034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675168+0000","last_change":"2023-11-04T01:38:20.053859+0000","last_active":"2023-11-04T01:38:21.675168+0000","last_peered":"2023-11-04T01:38:21.675168+0000","last_clean":"2023-11-04T01:38:21.675168+0000","last_became_active":"2023-11-04T01:38:20.053576+0000","last_became_peered":"2023-11-04T01:38:20.053576+0000","last_unstale":"2023-11-04T01:38:21.675168+0000","last_undegraded":"2023-11-04T01:38:21.675168+0000","last_fullsized":"2023-11-04T01:38:21.675168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:26.807670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035426+0000","last_change":"2023-11-04T01:38:20.036689+0000","last_active":"2023-11-04T01:38:21.035426+0000","last_peered":"2023-11-04T01:38:21.035426+0000","last_clean":"2023-11-04T01:38:21.035426+0000","last_became_active":"2023-11-04T01:38:20.036295+0000","last_became_peered":"2023-11-04T01:38:20.036295+0000","last_unstale":"2023-11-04T01:38:21.035426+0000","last_undegraded":"2023-11-04T01:38:21.035426+0000","last_fullsized":"2023-11-04T01:38:21.035426+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:37:52.192853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674013+0000","last_change":"2023-11-04T01:38:20.041642+0000","last_active":"2023-11-04T01:38:21.674013+0000","last_peered":"2023-11-04T01:38:21.674013+0000","last_clean":"2023-11-04T01:38:21.674013+0000","last_became_active":"2023-11-04T01:38:20.041317+0000","last_became_peered":"2023-11-04T01:38:20.041317+0000","last_unstale":"2023-11-04T01:38:21.674013+0000","last_undegraded":"2023-11-04T01:38:21.674013+0000","last_fullsized":"2023-11-04T01:38:21.674013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:29:25.119418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205194+0000","last_change":"2023-11-04T01:38:20.040446+0000","last_active":"2023-11-04T01:38:21.205194+0000","last_peered":"2023-11-04T01:38:21.205194+0000","last_clean":"2023-11-04T01:38:21.205194+0000","last_became_active":"2023-11-04T01:38:20.040190+0000","last_became_peered":"2023-11-04T01:38:20.040190+0000","last_unstale":"2023-11-04T01:38:21.205194+0000","last_undegraded":"2023-11-04T01:38:21.205194+0000","last_fullsized":"2023-11-04T01:38:21.205194+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:36.086593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673683+0000","last_change":"2023-11-04T01:38:20.033717+0000","last_active":"2023-11-04T01:38:21.673683+0000","last_peered":"2023-11-04T01:38:21.673683+0000","last_clean":"2023-11-04T01:38:21.673683+0000","last_became_active":"2023-11-04T01:38:20.033489+0000","last_became_peered":"2023-11-04T01:38:20.033489+0000","last_unstale":"2023-11-04T01:38:21.673683+0000","last_undegraded":"2023-11-04T01:38:21.673683+0000","last_fullsized":"2023-11-04T01:38:21.673683+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:48:57.181502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035641+0000","last_change":"2023-11-04T01:38:20.038279+0000","last_active":"2023-11-04T01:38:21.035641+0000","last_peered":"2023-11-04T01:38:21.035641+0000","last_clean":"2023-11-04T01:38:21.035641+0000","last_became_active":"2023-11-04T01:38:20.038041+0000","last_became_peered":"2023-11-04T01:38:20.038041+0000","last_unstale":"2023-11-04T01:38:21.035641+0000","last_undegraded":"2023-11-04T01:38:21.035641+0000","last_fullsized":"2023-11-04T01:38:21.035641+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:29.142146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674889+0000","last_change":"2023-11-04T01:38:20.038609+0000","last_active":"2023-11-04T01:38:21.674889+0000","last_peered":"2023-11-04T01:38:21.674889+0000","last_clean":"2023-11-04T01:38:21.674889+0000","last_became_active":"2023-11-04T01:38:20.038286+0000","last_became_peered":"2023-11-04T01:38:20.038286+0000","last_unstale":"2023-11-04T01:38:21.674889+0000","last_undegraded":"2023-11-04T01:38:21.674889+0000","last_fullsized":"2023-11-04T01:38:21.674889+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:36.525521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034752+0000","last_change":"2023-11-04T01:38:20.039854+0000","last_active":"2023-11-04T01:38:21.034752+0000","last_peered":"2023-11-04T01:38:21.034752+0000","last_clean":"2023-11-04T01:38:21.034752+0000","last_became_active":"2023-11-04T01:38:20.039558+0000","last_became_peered":"2023-11-04T01:38:20.039558+0000","last_unstale":"2023-11-04T01:38:21.034752+0000","last_undegraded":"2023-11-04T01:38:21.034752+0000","last_fullsized":"2023-11-04T01:38:21.034752+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:38:22.194989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673965+0000","last_change":"2023-11-04T01:38:20.036447+0000","last_active":"2023-11-04T01:38:21.673965+0000","last_peered":"2023-11-04T01:38:21.673965+0000","last_clean":"2023-11-04T01:38:21.673965+0000","last_became_active":"2023-11-04T01:38:20.034559+0000","last_became_peered":"2023-11-04T01:38:20.034559+0000","last_unstale":"2023-11-04T01:38:21.673965+0000","last_undegraded":"2023-11-04T01:38:21.673965+0000","last_fullsized":"2023-11-04T01:38:21.673965+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:41.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674222+0000","last_change":"2023-11-04T01:38:20.049819+0000","last_active":"2023-11-04T01:38:21.674222+0000","last_peered":"2023-11-04T01:38:21.674222+0000","last_clean":"2023-11-04T01:38:21.674222+0000","last_became_active":"2023-11-04T01:38:20.048896+0000","last_became_peered":"2023-11-04T01:38:20.048896+0000","last_unstale":"2023-11-04T01:38:21.674222+0000","last_undegraded":"2023-11-04T01:38:21.674222+0000","last_fullsized":"2023-11-04T01:38:21.674222+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:40.786616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673854+0000","last_change":"2023-11-04T01:38:20.045669+0000","last_active":"2023-11-04T01:38:21.673854+0000","last_peered":"2023-11-04T01:38:21.673854+0000","last_clean":"2023-11-04T01:38:21.673854+0000","last_became_active":"2023-11-04T01:38:20.045304+0000","last_became_peered":"2023-11-04T01:38:20.045304+0000","last_unstale":"2023-11-04T01:38:21.673854+0000","last_undegraded":"2023-11-04T01:38:21.673854+0000","last_fullsized":"2023-11-04T01:38:21.673854+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:22.724353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034368+0000","last_change":"2023-11-04T01:38:20.038098+0000","last_active":"2023-11-04T01:38:21.034368+0000","last_peered":"2023-11-04T01:38:21.034368+0000","last_clean":"2023-11-04T01:38:21.034368+0000","last_became_active":"2023-11-04T01:38:20.037832+0000","last_became_peered":"2023-11-04T01:38:20.037832+0000","last_unstale":"2023-11-04T01:38:21.034368+0000","last_undegraded":"2023-11-04T01:38:21.034368+0000","last_fullsized":"2023-11-04T01:38:21.034368+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:51.180365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035420+0000","last_change":"2023-11-04T01:38:20.037420+0000","last_active":"2023-11-04T01:38:21.035420+0000","last_peered":"2023-11-04T01:38:21.035420+0000","last_clean":"2023-11-04T01:38:21.035420+0000","last_became_active":"2023-11-04T01:38:20.037129+0000","last_became_peered":"2023-11-04T01:38:20.037129+0000","last_unstale":"2023-11-04T01:38:21.035420+0000","last_undegraded":"2023-11-04T01:38:21.035420+0000","last_fullsized":"2023-11-04T01:38:21.035420+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:40.491312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034835+0000","last_change":"2023-11-04T01:38:20.037763+0000","last_active":"2023-11-04T01:38:21.034835+0000","last_peered":"2023-11-04T01:38:21.034835+0000","last_clean":"2023-11-04T01:38:21.034835+0000","last_became_active":"2023-11-04T01:38:20.037487+0000","last_became_peered":"2023-11-04T01:38:20.037487+0000","last_unstale":"2023-11-04T01:38:21.034835+0000","last_undegraded":"2023-11-04T01:38:21.034835+0000","last_fullsized":"2023-11-04T01:38:21.034835+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:40.786616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673419+0000","last_change":"2023-11-04T01:38:20.033267+0000","last_active":"2023-11-04T01:38:21.673419+0000","last_peered":"2023-11-04T01:38:21.673419+0000","last_clean":"2023-11-04T01:38:21.673419+0000","last_became_active":"2023-11-04T01:38:20.033012+0000","last_became_peered":"2023-11-04T01:38:20.033012+0000","last_unstale":"2023-11-04T01:38:21.673419+0000","last_undegraded":"2023-11-04T01:38:21.673419+0000","last_fullsized":"2023-11-04T01:38:21.673419+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:22:37.388957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675419+0000","last_change":"2023-11-04T01:38:20.042715+0000","last_active":"2023-11-04T01:38:21.675419+0000","last_peered":"2023-11-04T01:38:21.675419+0000","last_clean":"2023-11-04T01:38:21.675419+0000","last_became_active":"2023-11-04T01:38:20.042483+0000","last_became_peered":"2023-11-04T01:38:20.042483+0000","last_unstale":"2023-11-04T01:38:21.675419+0000","last_undegraded":"2023-11-04T01:38:21.675419+0000","last_fullsized":"2023-11-04T01:38:21.675419+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:30:19.149946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035622+0000","last_change":"2023-11-04T01:38:20.039785+0000","last_active":"2023-11-04T01:38:21.035622+0000","last_peered":"2023-11-04T01:38:21.035622+0000","last_clean":"2023-11-04T01:38:21.035622+0000","last_became_active":"2023-11-04T01:38:20.039539+0000","last_became_peered":"2023-11-04T01:38:20.039539+0000","last_unstale":"2023-11-04T01:38:21.035622+0000","last_undegraded":"2023-11-04T01:38:21.035622+0000","last_fullsized":"2023-11-04T01:38:21.035622+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:25:30.505923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205320+0000","last_change":"2023-11-04T01:38:20.049555+0000","last_active":"2023-11-04T01:38:21.205320+0000","last_peered":"2023-11-04T01:38:21.205320+0000","last_clean":"2023-11-04T01:38:21.205320+0000","last_became_active":"2023-11-04T01:38:20.049293+0000","last_became_peered":"2023-11-04T01:38:20.049293+0000","last_unstale":"2023-11-04T01:38:21.205320+0000","last_undegraded":"2023-11-04T01:38:21.205320+0000","last_fullsized":"2023-11-04T01:38:21.205320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:43.631674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675290+0000","last_change":"2023-11-04T01:38:20.041920+0000","last_active":"2023-11-04T01:38:21.675290+0000","last_peered":"2023-11-04T01:38:21.675290+0000","last_clean":"2023-11-04T01:38:21.675290+0000","last_became_active":"2023-11-04T01:38:20.041656+0000","last_became_peered":"2023-11-04T01:38:20.041656+0000","last_unstale":"2023-11-04T01:38:21.675290+0000","last_undegraded":"2023-11-04T01:38:21.675290+0000","last_fullsized":"2023-11-04T01:38:21.675290+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:02.149183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033793+0000","last_change":"2023-11-04T01:38:20.045716+0000","last_active":"2023-11-04T01:38:21.033793+0000","last_peered":"2023-11-04T01:38:21.033793+0000","last_clean":"2023-11-04T01:38:21.033793+0000","last_became_active":"2023-11-04T01:38:20.045380+0000","last_became_peered":"2023-11-04T01:38:20.045380+0000","last_unstale":"2023-11-04T01:38:21.033793+0000","last_undegraded":"2023-11-04T01:38:21.033793+0000","last_fullsized":"2023-11-04T01:38:21.033793+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:22.724353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674755+0000","last_change":"2023-11-04T01:38:20.043459+0000","last_active":"2023-11-04T01:38:21.674755+0000","last_peered":"2023-11-04T01:38:21.674755+0000","last_clean":"2023-11-04T01:38:21.674755+0000","last_became_active":"2023-11-04T01:38:20.043211+0000","last_became_peered":"2023-11-04T01:38:20.043211+0000","last_unstale":"2023-11-04T01:38:21.674755+0000","last_undegraded":"2023-11-04T01:38:21.674755+0000","last_fullsized":"2023-11-04T01:38:21.674755+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:25:30.505923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033973+0000","last_change":"2023-11-04T01:38:20.044304+0000","last_active":"2023-11-04T01:38:21.033973+0000","last_peered":"2023-11-04T01:38:21.033973+0000","last_clean":"2023-11-04T01:38:21.033973+0000","last_became_active":"2023-11-04T01:38:20.044039+0000","last_became_peered":"2023-11-04T01:38:20.044039+0000","last_unstale":"2023-11-04T01:38:21.033973+0000","last_undegraded":"2023-11-04T01:38:21.033973+0000","last_fullsized":"2023-11-04T01:38:21.033973+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:35.459885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033952+0000","last_change":"2023-11-04T01:38:20.040794+0000","last_active":"2023-11-04T01:38:21.033952+0000","last_peered":"2023-11-04T01:38:21.033952+0000","last_clean":"2023-11-04T01:38:21.033952+0000","last_became_active":"2023-11-04T01:38:20.040482+0000","last_became_peered":"2023-11-04T01:38:20.040482+0000","last_unstale":"2023-11-04T01:38:21.033952+0000","last_undegraded":"2023-11-04T01:38:21.033952+0000","last_fullsized":"2023-11-04T01:38:21.033952+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:31.017311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205414+0000","last_change":"2023-11-04T01:38:20.040557+0000","last_active":"2023-11-04T01:38:21.205414+0000","last_peered":"2023-11-04T01:38:21.205414+0000","last_clean":"2023-11-04T01:38:21.205414+0000","last_became_active":"2023-11-04T01:38:20.040102+0000","last_became_peered":"2023-11-04T01:38:20.040102+0000","last_unstale":"2023-11-04T01:38:21.205414+0000","last_undegraded":"2023-11-04T01:38:21.205414+0000","last_fullsized":"2023-11-04T01:38:21.205414+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:10.992954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673979+0000","last_change":"2023-11-04T01:38:20.042394+0000","last_active":"2023-11-04T01:38:21.673979+0000","last_peered":"2023-11-04T01:38:21.673979+0000","last_clean":"2023-11-04T01:38:21.673979+0000","last_became_active":"2023-11-04T01:38:20.042133+0000","last_became_peered":"2023-11-04T01:38:20.042133+0000","last_unstale":"2023-11-04T01:38:21.673979+0000","last_undegraded":"2023-11-04T01:38:21.673979+0000","last_fullsized":"2023-11-04T01:38:21.673979+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:35.459885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674258+0000","last_change":"2023-11-04T01:38:20.034976+0000","last_active":"2023-11-04T01:38:21.674258+0000","last_peered":"2023-11-04T01:38:21.674258+0000","last_clean":"2023-11-04T01:38:21.674258+0000","last_became_active":"2023-11-04T01:38:20.034718+0000","last_became_peered":"2023-11-04T01:38:20.034718+0000","last_unstale":"2023-11-04T01:38:21.674258+0000","last_undegraded":"2023-11-04T01:38:21.674258+0000","last_fullsized":"2023-11-04T01:38:21.674258+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:35.459885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205280+0000","last_change":"2023-11-04T01:38:20.047475+0000","last_active":"2023-11-04T01:38:21.205280+0000","last_peered":"2023-11-04T01:38:21.205280+0000","last_clean":"2023-11-04T01:38:21.205280+0000","last_became_active":"2023-11-04T01:38:20.047217+0000","last_became_peered":"2023-11-04T01:38:20.047217+0000","last_unstale":"2023-11-04T01:38:21.205280+0000","last_undegraded":"2023-11-04T01:38:21.205280+0000","last_fullsized":"2023-11-04T01:38:21.205280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:03:06.304104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675200+0000","last_change":"2023-11-04T01:38:20.045473+0000","last_active":"2023-11-04T01:38:21.675200+0000","last_peered":"2023-11-04T01:38:21.675200+0000","last_clean":"2023-11-04T01:38:21.675200+0000","last_became_active":"2023-11-04T01:38:20.045227+0000","last_became_peered":"2023-11-04T01:38:20.045227+0000","last_unstale":"2023-11-04T01:38:21.675200+0000","last_undegraded":"2023-11-04T01:38:21.675200+0000","last_fullsized":"2023-11-04T01:38:21.675200+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:11:33.289813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033793+0000","last_change":"2023-11-04T01:38:20.042348+0000","last_active":"2023-11-04T01:38:21.033793+0000","last_peered":"2023-11-04T01:38:21.033793+0000","last_clean":"2023-11-04T01:38:21.033793+0000","last_became_active":"2023-11-04T01:38:20.041643+0000","last_became_peered":"2023-11-04T01:38:20.041643+0000","last_unstale":"2023-11-04T01:38:21.033793+0000","last_undegraded":"2023-11-04T01:38:21.033793+0000","last_fullsized":"2023-11-04T01:38:21.033793+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:13.116417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.205126+0000","last_change":"2023-11-04T01:38:20.031327+0000","last_active":"2023-11-04T01:38:21.205126+0000","last_peered":"2023-11-04T01:38:21.205126+0000","last_clean":"2023-11-04T01:38:21.205126+0000","last_became_active":"2023-11-04T01:38:20.031081+0000","last_became_peered":"2023-11-04T01:38:20.031081+0000","last_unstale":"2023-11-04T01:38:21.205126+0000","last_undegraded":"2023-11-04T01:38:21.205126+0000","last_fullsized":"2023-11-04T01:38:21.205126+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:08:18.719026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673381+0000","last_change":"2023-11-04T01:38:20.047492+0000","last_active":"2023-11-04T01:38:21.673381+0000","last_peered":"2023-11-04T01:38:21.673381+0000","last_clean":"2023-11-04T01:38:21.673381+0000","last_became_active":"2023-11-04T01:38:20.047236+0000","last_became_peered":"2023-11-04T01:38:20.047236+0000","last_unstale":"2023-11-04T01:38:21.673381+0000","last_undegraded":"2023-11-04T01:38:21.673381+0000","last_fullsized":"2023-11-04T01:38:21.673381+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:18:14.039193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034875+0000","last_change":"2023-11-04T01:38:20.035082+0000","last_active":"2023-11-04T01:38:21.034875+0000","last_peered":"2023-11-04T01:38:21.034875+0000","last_clean":"2023-11-04T01:38:21.034875+0000","last_became_active":"2023-11-04T01:38:20.034747+0000","last_became_peered":"2023-11-04T01:38:20.034747+0000","last_unstale":"2023-11-04T01:38:21.034875+0000","last_undegraded":"2023-11-04T01:38:21.034875+0000","last_fullsized":"2023-11-04T01:38:21.034875+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:42.068163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033934+0000","last_change":"2023-11-04T01:38:19.031932+0000","last_active":"2023-11-04T01:38:21.033934+0000","last_peered":"2023-11-04T01:38:21.033934+0000","last_clean":"2023-11-04T01:38:21.033934+0000","last_became_active":"2023-11-04T01:38:19.031665+0000","last_became_peered":"2023-11-04T01:38:19.031665+0000","last_unstale":"2023-11-04T01:38:21.033934+0000","last_undegraded":"2023-11-04T01:38:21.033934+0000","last_fullsized":"2023-11-04T01:38:21.033934+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:50.677621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025636+0000","last_change":"2023-11-04T01:38:02.156342+0000","last_active":"2023-11-04T01:38:20.025636+0000","last_peered":"2023-11-04T01:38:20.025636+0000","last_clean":"2023-11-04T01:38:20.025636+0000","last_became_active":"2023-11-04T01:38:00.708159+0000","last_became_peered":"2023-11-04T01:38:00.708159+0000","last_unstale":"2023-11-04T01:38:20.025636+0000","last_undegraded":"2023-11-04T01:38:20.025636+0000","last_fullsized":"2023-11-04T01:38:20.025636+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000435213,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673663+0000","last_change":"2023-11-04T01:38:20.050969+0000","last_active":"2023-11-04T01:38:21.673663+0000","last_peered":"2023-11-04T01:38:21.673663+0000","last_clean":"2023-11-04T01:38:21.673663+0000","last_became_active":"2023-11-04T01:38:20.050719+0000","last_became_peered":"2023-11-04T01:38:20.050719+0000","last_unstale":"2023-11-04T01:38:21.673663+0000","last_undegraded":"2023-11-04T01:38:21.673663+0000","last_fullsized":"2023-11-04T01:38:21.673663+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:13.116417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675141+0000","last_change":"2023-11-04T01:38:19.037354+0000","last_active":"2023-11-04T01:38:21.675141+0000","last_peered":"2023-11-04T01:38:21.675141+0000","last_clean":"2023-11-04T01:38:21.675141+0000","last_became_active":"2023-11-04T01:38:19.036874+0000","last_became_peered":"2023-11-04T01:38:19.036874+0000","last_unstale":"2023-11-04T01:38:21.675141+0000","last_undegraded":"2023-11-04T01:38:21.675141+0000","last_fullsized":"2023-11-04T01:38:21.675141+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:29:24.114318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.033990+0000","last_change":"2023-11-04T01:38:02.362289+0000","last_active":"2023-11-04T01:38:20.033990+0000","last_peered":"2023-11-04T01:38:20.033990+0000","last_clean":"2023-11-04T01:38:20.033990+0000","last_became_active":"2023-11-04T01:38:00.710033+0000","last_became_peered":"2023-11-04T01:38:00.710033+0000","last_unstale":"2023-11-04T01:38:20.033990+0000","last_undegraded":"2023-11-04T01:38:20.033990+0000","last_fullsized":"2023-11-04T01:38:20.033990+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046467500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034007+0000","last_change":"2023-11-04T01:38:20.046647+0000","last_active":"2023-11-04T01:38:21.034007+0000","last_peered":"2023-11-04T01:38:21.034007+0000","last_clean":"2023-11-04T01:38:21.034007+0000","last_became_active":"2023-11-04T01:38:20.045600+0000","last_became_peered":"2023-11-04T01:38:20.045600+0000","last_unstale":"2023-11-04T01:38:21.034007+0000","last_undegraded":"2023-11-04T01:38:21.034007+0000","last_fullsized":"2023-11-04T01:38:21.034007+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:29:25.119418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.033634+0000","last_change":"2023-11-04T01:38:19.035524+0000","last_active":"2023-11-04T01:38:21.033634+0000","last_peered":"2023-11-04T01:38:21.033634+0000","last_clean":"2023-11-04T01:38:21.033634+0000","last_became_active":"2023-11-04T01:38:19.035253+0000","last_became_peered":"2023-11-04T01:38:19.035253+0000","last_unstale":"2023-11-04T01:38:21.033634+0000","last_undegraded":"2023-11-04T01:38:21.033634+0000","last_fullsized":"2023-11-04T01:38:21.033634+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:58:46.450993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.024830+0000","last_change":"2023-11-04T01:38:01.699171+0000","last_active":"2023-11-04T01:38:20.024830+0000","last_peered":"2023-11-04T01:38:20.024830+0000","last_clean":"2023-11-04T01:38:20.024830+0000","last_became_active":"2023-11-04T01:38:00.703927+0000","last_became_peered":"2023-11-04T01:38:00.703927+0000","last_unstale":"2023-11-04T01:38:20.024830+0000","last_undegraded":"2023-11-04T01:38:20.024830+0000","last_fullsized":"2023-11-04T01:38:20.024830+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072585499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035185+0000","last_change":"2023-11-04T01:38:20.042592+0000","last_active":"2023-11-04T01:38:21.035185+0000","last_peered":"2023-11-04T01:38:21.035185+0000","last_clean":"2023-11-04T01:38:21.035185+0000","last_became_active":"2023-11-04T01:38:20.041836+0000","last_became_peered":"2023-11-04T01:38:20.041836+0000","last_unstale":"2023-11-04T01:38:21.035185+0000","last_undegraded":"2023-11-04T01:38:21.035185+0000","last_fullsized":"2023-11-04T01:38:21.035185+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:12.069863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673588+0000","last_change":"2023-11-04T01:38:19.035245+0000","last_active":"2023-11-04T01:38:21.673588+0000","last_peered":"2023-11-04T01:38:21.673588+0000","last_clean":"2023-11-04T01:38:21.673588+0000","last_became_active":"2023-11-04T01:38:19.034978+0000","last_became_peered":"2023-11-04T01:38:19.034978+0000","last_unstale":"2023-11-04T01:38:21.673588+0000","last_undegraded":"2023-11-04T01:38:21.673588+0000","last_fullsized":"2023-11-04T01:38:21.673588+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:22:36.383857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025334+0000","last_change":"2023-11-04T01:38:02.156160+0000","last_active":"2023-11-04T01:38:20.025334+0000","last_peered":"2023-11-04T01:38:20.025334+0000","last_clean":"2023-11-04T01:38:20.025334+0000","last_became_active":"2023-11-04T01:38:00.709137+0000","last_became_peered":"2023-11-04T01:38:00.709137+0000","last_unstale":"2023-11-04T01:38:20.025334+0000","last_undegraded":"2023-11-04T01:38:20.025334+0000","last_fullsized":"2023-11-04T01:38:20.025334+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028239399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035851+0000","last_change":"2023-11-04T01:38:20.035081+0000","last_active":"2023-11-04T01:38:21.035851+0000","last_peered":"2023-11-04T01:38:21.035851+0000","last_clean":"2023-11-04T01:38:21.035851+0000","last_became_active":"2023-11-04T01:38:20.034778+0000","last_became_peered":"2023-11-04T01:38:20.034778+0000","last_unstale":"2023-11-04T01:38:21.035851+0000","last_undegraded":"2023-11-04T01:38:21.035851+0000","last_fullsized":"2023-11-04T01:38:21.035851+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:17:19.236320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675336+0000","last_change":"2023-11-04T01:38:19.037605+0000","last_active":"2023-11-04T01:38:21.675336+0000","last_peered":"2023-11-04T01:38:21.675336+0000","last_clean":"2023-11-04T01:38:21.675336+0000","last_became_active":"2023-11-04T01:38:19.037364+0000","last_became_peered":"2023-11-04T01:38:19.037364+0000","last_unstale":"2023-11-04T01:38:21.675336+0000","last_undegraded":"2023-11-04T01:38:21.675336+0000","last_fullsized":"2023-11-04T01:38:21.675336+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:37:51.187753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.024656+0000","last_change":"2023-11-04T01:38:01.698196+0000","last_active":"2023-11-04T01:38:20.024656+0000","last_peered":"2023-11-04T01:38:20.024656+0000","last_clean":"2023-11-04T01:38:20.024656+0000","last_became_active":"2023-11-04T01:38:00.705451+0000","last_became_peered":"2023-11-04T01:38:00.705451+0000","last_unstale":"2023-11-04T01:38:20.024656+0000","last_undegraded":"2023-11-04T01:38:20.024656+0000","last_fullsized":"2023-11-04T01:38:20.024656+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:16.759249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067668100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035195+0000","last_change":"2023-11-04T01:38:20.050980+0000","last_active":"2023-11-04T01:38:21.035195+0000","last_peered":"2023-11-04T01:38:21.035195+0000","last_clean":"2023-11-04T01:38:21.035195+0000","last_became_active":"2023-11-04T01:38:20.050697+0000","last_became_peered":"2023-11-04T01:38:20.050697+0000","last_unstale":"2023-11-04T01:38:21.035195+0000","last_undegraded":"2023-11-04T01:38:21.035195+0000","last_fullsized":"2023-11-04T01:38:21.035195+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:00.166299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035835+0000","last_change":"2023-11-04T01:38:19.039458+0000","last_active":"2023-11-04T01:38:21.035835+0000","last_peered":"2023-11-04T01:38:21.035835+0000","last_clean":"2023-11-04T01:38:21.035835+0000","last_became_active":"2023-11-04T01:38:19.039141+0000","last_became_peered":"2023-11-04T01:38:19.039141+0000","last_unstale":"2023-11-04T01:38:21.035835+0000","last_undegraded":"2023-11-04T01:38:21.035835+0000","last_fullsized":"2023-11-04T01:38:21.035835+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:22:36.383857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026612+0000","last_change":"2023-11-04T01:38:01.983991+0000","last_active":"2023-11-04T01:38:20.026612+0000","last_peered":"2023-11-04T01:38:20.026612+0000","last_clean":"2023-11-04T01:38:20.026612+0000","last_became_active":"2023-11-04T01:38:00.708462+0000","last_became_peered":"2023-11-04T01:38:00.708462+0000","last_unstale":"2023-11-04T01:38:20.026612+0000","last_undegraded":"2023-11-04T01:38:20.026612+0000","last_fullsized":"2023-11-04T01:38:20.026612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:37.727651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041811600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035839+0000","last_change":"2023-11-04T01:38:20.036153+0000","last_active":"2023-11-04T01:38:21.035839+0000","last_peered":"2023-11-04T01:38:21.035839+0000","last_clean":"2023-11-04T01:38:21.035839+0000","last_became_active":"2023-11-04T01:38:20.035851+0000","last_became_peered":"2023-11-04T01:38:20.035851+0000","last_unstale":"2023-11-04T01:38:21.035839+0000","last_undegraded":"2023-11-04T01:38:21.035839+0000","last_fullsized":"2023-11-04T01:38:21.035839+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:55.373532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035405+0000","last_change":"2023-11-04T01:38:19.039330+0000","last_active":"2023-11-04T01:38:21.035405+0000","last_peered":"2023-11-04T01:38:21.035405+0000","last_clean":"2023-11-04T01:38:21.035405+0000","last_became_active":"2023-11-04T01:38:19.039063+0000","last_became_peered":"2023-11-04T01:38:19.039063+0000","last_unstale":"2023-11-04T01:38:21.035405+0000","last_undegraded":"2023-11-04T01:38:21.035405+0000","last_fullsized":"2023-11-04T01:38:21.035405+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:57:33.405061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026083+0000","last_change":"2023-11-04T01:38:01.984341+0000","last_active":"2023-11-04T01:38:20.026083+0000","last_peered":"2023-11-04T01:38:20.026083+0000","last_clean":"2023-11-04T01:38:20.026083+0000","last_became_active":"2023-11-04T01:38:00.708307+0000","last_became_peered":"2023-11-04T01:38:00.708307+0000","last_unstale":"2023-11-04T01:38:20.026083+0000","last_undegraded":"2023-11-04T01:38:20.026083+0000","last_fullsized":"2023-11-04T01:38:20.026083+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:17.369098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053627199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673691+0000","last_change":"2023-11-04T01:38:20.039924+0000","last_active":"2023-11-04T01:38:21.673691+0000","last_peered":"2023-11-04T01:38:21.673691+0000","last_clean":"2023-11-04T01:38:21.673691+0000","last_became_active":"2023-11-04T01:38:20.039662+0000","last_became_peered":"2023-11-04T01:38:20.039662+0000","last_unstale":"2023-11-04T01:38:21.673691+0000","last_undegraded":"2023-11-04T01:38:21.673691+0000","last_fullsized":"2023-11-04T01:38:21.673691+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:46.087745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035678+0000","last_change":"2023-11-04T01:38:19.033659+0000","last_active":"2023-11-04T01:38:21.035678+0000","last_peered":"2023-11-04T01:38:21.035678+0000","last_clean":"2023-11-04T01:38:21.035678+0000","last_became_active":"2023-11-04T01:38:19.033376+0000","last_became_peered":"2023-11-04T01:38:19.033376+0000","last_unstale":"2023-11-04T01:38:21.035678+0000","last_undegraded":"2023-11-04T01:38:21.035678+0000","last_fullsized":"2023-11-04T01:38:21.035678+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:41:45.674982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.033795+0000","last_change":"2023-11-04T01:38:01.700471+0000","last_active":"2023-11-04T01:38:20.033795+0000","last_peered":"2023-11-04T01:38:20.033795+0000","last_clean":"2023-11-04T01:38:20.033795+0000","last_became_active":"2023-11-04T01:38:00.702522+0000","last_became_peered":"2023-11-04T01:38:00.702522+0000","last_unstale":"2023-11-04T01:38:20.033795+0000","last_undegraded":"2023-11-04T01:38:20.033795+0000","last_fullsized":"2023-11-04T01:38:20.033795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086940300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675059+0000","last_change":"2023-11-04T01:38:20.045928+0000","last_active":"2023-11-04T01:38:21.675059+0000","last_peered":"2023-11-04T01:38:21.675059+0000","last_clean":"2023-11-04T01:38:21.675059+0000","last_became_active":"2023-11-04T01:38:20.045655+0000","last_became_peered":"2023-11-04T01:38:20.045655+0000","last_unstale":"2023-11-04T01:38:21.675059+0000","last_undegraded":"2023-11-04T01:38:21.675059+0000","last_fullsized":"2023-11-04T01:38:21.675059+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:04.967285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673758+0000","last_change":"2023-11-04T01:38:19.038158+0000","last_active":"2023-11-04T01:38:21.673758+0000","last_peered":"2023-11-04T01:38:21.673758+0000","last_clean":"2023-11-04T01:38:21.673758+0000","last_became_active":"2023-11-04T01:38:19.037906+0000","last_became_peered":"2023-11-04T01:38:19.037906+0000","last_unstale":"2023-11-04T01:38:21.673758+0000","last_undegraded":"2023-11-04T01:38:21.673758+0000","last_fullsized":"2023-11-04T01:38:21.673758+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:46:26.432698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026970+0000","last_change":"2023-11-04T01:38:01.696901+0000","last_active":"2023-11-04T01:38:20.026970+0000","last_peered":"2023-11-04T01:38:20.026970+0000","last_clean":"2023-11-04T01:38:20.026970+0000","last_became_active":"2023-11-04T01:38:00.706170+0000","last_became_peered":"2023-11-04T01:38:00.706170+0000","last_unstale":"2023-11-04T01:38:20.026970+0000","last_undegraded":"2023-11-04T01:38:20.026970+0000","last_fullsized":"2023-11-04T01:38:20.026970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059391100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674835+0000","last_change":"2023-11-04T01:38:20.045308+0000","last_active":"2023-11-04T01:38:21.674835+0000","last_peered":"2023-11-04T01:38:21.674835+0000","last_clean":"2023-11-04T01:38:21.674835+0000","last_became_active":"2023-11-04T01:38:20.045053+0000","last_became_peered":"2023-11-04T01:38:20.045053+0000","last_unstale":"2023-11-04T01:38:21.674835+0000","last_undegraded":"2023-11-04T01:38:21.674835+0000","last_fullsized":"2023-11-04T01:38:21.674835+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:17:19.236320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035078+0000","last_change":"2023-11-04T01:38:19.034665+0000","last_active":"2023-11-04T01:38:21.035078+0000","last_peered":"2023-11-04T01:38:21.035078+0000","last_clean":"2023-11-04T01:38:21.035078+0000","last_became_active":"2023-11-04T01:38:19.034325+0000","last_became_peered":"2023-11-04T01:38:19.034325+0000","last_unstale":"2023-11-04T01:38:21.035078+0000","last_undegraded":"2023-11-04T01:38:21.035078+0000","last_fullsized":"2023-11-04T01:38:21.035078+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:37.353020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.040306+0000","last_change":"2023-11-04T01:38:01.939972+0000","last_active":"2023-11-04T01:38:20.040306+0000","last_peered":"2023-11-04T01:38:20.040306+0000","last_clean":"2023-11-04T01:38:20.040306+0000","last_became_active":"2023-11-04T01:38:00.702784+0000","last_became_peered":"2023-11-04T01:38:00.702784+0000","last_unstale":"2023-11-04T01:38:20.040306+0000","last_undegraded":"2023-11-04T01:38:20.040306+0000","last_fullsized":"2023-11-04T01:38:20.040306+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:26.760402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071328600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674770+0000","last_change":"2023-11-04T01:38:20.042335+0000","last_active":"2023-11-04T01:38:21.674770+0000","last_peered":"2023-11-04T01:38:21.674770+0000","last_clean":"2023-11-04T01:38:21.674770+0000","last_became_active":"2023-11-04T01:38:20.041831+0000","last_became_peered":"2023-11-04T01:38:20.041831+0000","last_unstale":"2023-11-04T01:38:21.674770+0000","last_undegraded":"2023-11-04T01:38:21.674770+0000","last_fullsized":"2023-11-04T01:38:21.674770+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:55.373532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035305+0000","last_change":"2023-11-04T01:38:19.037726+0000","last_active":"2023-11-04T01:38:21.035305+0000","last_peered":"2023-11-04T01:38:21.035305+0000","last_clean":"2023-11-04T01:38:21.035305+0000","last_became_active":"2023-11-04T01:38:19.037459+0000","last_became_peered":"2023-11-04T01:38:19.037459+0000","last_unstale":"2023-11-04T01:38:21.035305+0000","last_undegraded":"2023-11-04T01:38:21.035305+0000","last_fullsized":"2023-11-04T01:38:21.035305+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:45.082645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.027534+0000","last_change":"2023-11-04T01:38:01.699051+0000","last_active":"2023-11-04T01:38:20.027534+0000","last_peered":"2023-11-04T01:38:20.027534+0000","last_clean":"2023-11-04T01:38:20.027534+0000","last_became_active":"2023-11-04T01:38:00.708665+0000","last_became_peered":"2023-11-04T01:38:00.708665+0000","last_unstale":"2023-11-04T01:38:20.027534+0000","last_undegraded":"2023-11-04T01:38:20.027534+0000","last_fullsized":"2023-11-04T01:38:20.027534+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020995580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034089+0000","last_change":"2023-11-04T01:38:20.037174+0000","last_active":"2023-11-04T01:38:21.034089+0000","last_peered":"2023-11-04T01:38:21.034089+0000","last_clean":"2023-11-04T01:38:21.034089+0000","last_became_active":"2023-11-04T01:38:20.036695+0000","last_became_peered":"2023-11-04T01:38:20.036695+0000","last_unstale":"2023-11-04T01:38:21.034089+0000","last_undegraded":"2023-11-04T01:38:21.034089+0000","last_fullsized":"2023-11-04T01:38:21.034089+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:38.358120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673587+0000","last_change":"2023-11-04T01:38:19.034220+0000","last_active":"2023-11-04T01:38:21.673587+0000","last_peered":"2023-11-04T01:38:21.673587+0000","last_clean":"2023-11-04T01:38:21.673587+0000","last_became_active":"2023-11-04T01:38:19.033675+0000","last_became_peered":"2023-11-04T01:38:19.033675+0000","last_unstale":"2023-11-04T01:38:21.673587+0000","last_undegraded":"2023-11-04T01:38:21.673587+0000","last_fullsized":"2023-11-04T01:38:21.673587+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:03.869363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.034399+0000","last_change":"2023-11-04T01:38:01.700742+0000","last_active":"2023-11-04T01:38:20.034399+0000","last_peered":"2023-11-04T01:38:20.034399+0000","last_clean":"2023-11-04T01:38:20.034399+0000","last_became_active":"2023-11-04T01:38:00.706671+0000","last_became_peered":"2023-11-04T01:38:00.706671+0000","last_unstale":"2023-11-04T01:38:20.034399+0000","last_undegraded":"2023-11-04T01:38:20.034399+0000","last_fullsized":"2023-11-04T01:38:20.034399+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072370699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674120+0000","last_change":"2023-11-04T01:38:20.038173+0000","last_active":"2023-11-04T01:38:21.674120+0000","last_peered":"2023-11-04T01:38:21.674120+0000","last_clean":"2023-11-04T01:38:21.674120+0000","last_became_active":"2023-11-04T01:38:20.037915+0000","last_became_peered":"2023-11-04T01:38:20.037915+0000","last_unstale":"2023-11-04T01:38:21.674120+0000","last_undegraded":"2023-11-04T01:38:21.674120+0000","last_fullsized":"2023-11-04T01:38:21.674120+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:38:22.194989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675318+0000","last_change":"2023-11-04T01:38:19.036037+0000","last_active":"2023-11-04T01:38:21.675318+0000","last_peered":"2023-11-04T01:38:21.675318+0000","last_clean":"2023-11-04T01:38:21.675318+0000","last_became_active":"2023-11-04T01:38:19.035785+0000","last_became_peered":"2023-11-04T01:38:19.035785+0000","last_unstale":"2023-11-04T01:38:21.675318+0000","last_undegraded":"2023-11-04T01:38:21.675318+0000","last_fullsized":"2023-11-04T01:38:21.675318+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:06.620841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025946+0000","last_change":"2023-11-04T01:38:01.697526+0000","last_active":"2023-11-04T01:38:20.025946+0000","last_peered":"2023-11-04T01:38:20.025946+0000","last_clean":"2023-11-04T01:38:20.025946+0000","last_became_active":"2023-11-04T01:38:00.707580+0000","last_became_peered":"2023-11-04T01:38:00.707580+0000","last_unstale":"2023-11-04T01:38:20.025946+0000","last_undegraded":"2023-11-04T01:38:20.025946+0000","last_fullsized":"2023-11-04T01:38:20.025946+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010806699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674144+0000","last_change":"2023-11-04T01:38:20.037669+0000","last_active":"2023-11-04T01:38:21.674144+0000","last_peered":"2023-11-04T01:38:21.674144+0000","last_clean":"2023-11-04T01:38:21.674144+0000","last_became_active":"2023-11-04T01:38:20.037409+0000","last_became_peered":"2023-11-04T01:38:20.037409+0000","last_unstale":"2023-11-04T01:38:21.674144+0000","last_undegraded":"2023-11-04T01:38:21.674144+0000","last_fullsized":"2023-11-04T01:38:21.674144+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:13.116417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674012+0000","last_change":"2023-11-04T01:38:19.039222+0000","last_active":"2023-11-04T01:38:21.674012+0000","last_peered":"2023-11-04T01:38:21.674012+0000","last_clean":"2023-11-04T01:38:21.674012+0000","last_became_active":"2023-11-04T01:38:19.038641+0000","last_became_peered":"2023-11-04T01:38:19.038641+0000","last_unstale":"2023-11-04T01:38:21.674012+0000","last_undegraded":"2023-11-04T01:38:21.674012+0000","last_fullsized":"2023-11-04T01:38:21.674012+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:59.161199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.035103+0000","last_change":"2023-11-04T01:38:01.939462+0000","last_active":"2023-11-04T01:38:20.035103+0000","last_peered":"2023-11-04T01:38:20.035103+0000","last_clean":"2023-11-04T01:38:20.035103+0000","last_became_active":"2023-11-04T01:38:00.705830+0000","last_became_peered":"2023-11-04T01:38:00.705830+0000","last_unstale":"2023-11-04T01:38:20.035103+0000","last_undegraded":"2023-11-04T01:38:20.035103+0000","last_fullsized":"2023-11-04T01:38:20.035103+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059305000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674368+0000","last_change":"2023-11-04T01:38:20.041751+0000","last_active":"2023-11-04T01:38:21.674368+0000","last_peered":"2023-11-04T01:38:21.674368+0000","last_clean":"2023-11-04T01:38:21.674368+0000","last_became_active":"2023-11-04T01:38:20.041457+0000","last_became_peered":"2023-11-04T01:38:20.041457+0000","last_unstale":"2023-11-04T01:38:21.674368+0000","last_undegraded":"2023-11-04T01:38:21.674368+0000","last_fullsized":"2023-11-04T01:38:21.674368+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:29:25.119418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673850+0000","last_change":"2023-11-04T01:38:19.035414+0000","last_active":"2023-11-04T01:38:21.673850+0000","last_peered":"2023-11-04T01:38:21.673850+0000","last_clean":"2023-11-04T01:38:21.673850+0000","last_became_active":"2023-11-04T01:38:19.035150+0000","last_became_peered":"2023-11-04T01:38:19.035150+0000","last_unstale":"2023-11-04T01:38:21.673850+0000","last_undegraded":"2023-11-04T01:38:21.673850+0000","last_fullsized":"2023-11-04T01:38:21.673850+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:41:45.674982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026156+0000","last_change":"2023-11-04T01:38:01.984456+0000","last_active":"2023-11-04T01:38:20.026156+0000","last_peered":"2023-11-04T01:38:20.026156+0000","last_clean":"2023-11-04T01:38:20.026156+0000","last_became_active":"2023-11-04T01:38:00.708803+0000","last_became_peered":"2023-11-04T01:38:00.708803+0000","last_unstale":"2023-11-04T01:38:20.026156+0000","last_undegraded":"2023-11-04T01:38:20.026156+0000","last_fullsized":"2023-11-04T01:38:20.026156+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:30.811033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061551599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674187+0000","last_change":"2023-11-04T01:38:20.037620+0000","last_active":"2023-11-04T01:38:21.674187+0000","last_peered":"2023-11-04T01:38:21.674187+0000","last_clean":"2023-11-04T01:38:21.674187+0000","last_became_active":"2023-11-04T01:38:20.037323+0000","last_became_peered":"2023-11-04T01:38:20.037323+0000","last_unstale":"2023-11-04T01:38:21.674187+0000","last_undegraded":"2023-11-04T01:38:21.674187+0000","last_fullsized":"2023-11-04T01:38:21.674187+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:22.724353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674442+0000","last_change":"2023-11-04T01:38:19.039493+0000","last_active":"2023-11-04T01:38:21.674442+0000","last_peered":"2023-11-04T01:38:21.674442+0000","last_clean":"2023-11-04T01:38:21.674442+0000","last_became_active":"2023-11-04T01:38:19.039255+0000","last_became_peered":"2023-11-04T01:38:19.039255+0000","last_unstale":"2023-11-04T01:38:21.674442+0000","last_undegraded":"2023-11-04T01:38:21.674442+0000","last_fullsized":"2023-11-04T01:38:21.674442+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:27.992870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025849+0000","last_change":"2023-11-04T01:38:01.698866+0000","last_active":"2023-11-04T01:38:20.025849+0000","last_peered":"2023-11-04T01:38:20.025849+0000","last_clean":"2023-11-04T01:38:20.025849+0000","last_became_active":"2023-11-04T01:38:00.706149+0000","last_became_peered":"2023-11-04T01:38:00.706149+0000","last_unstale":"2023-11-04T01:38:20.025849+0000","last_undegraded":"2023-11-04T01:38:20.025849+0000","last_fullsized":"2023-11-04T01:38:20.025849+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:59.391683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001344154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035004+0000","last_change":"2023-11-04T01:38:20.047057+0000","last_active":"2023-11-04T01:38:21.035004+0000","last_peered":"2023-11-04T01:38:21.035004+0000","last_clean":"2023-11-04T01:38:21.035004+0000","last_became_active":"2023-11-04T01:38:20.046753+0000","last_became_peered":"2023-11-04T01:38:20.046753+0000","last_unstale":"2023-11-04T01:38:21.035004+0000","last_undegraded":"2023-11-04T01:38:21.035004+0000","last_fullsized":"2023-11-04T01:38:21.035004+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:07.625941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035408+0000","last_change":"2023-11-04T01:38:19.043265+0000","last_active":"2023-11-04T01:38:21.035408+0000","last_peered":"2023-11-04T01:38:21.035408+0000","last_clean":"2023-11-04T01:38:21.035408+0000","last_became_active":"2023-11-04T01:38:19.043036+0000","last_became_peered":"2023-11-04T01:38:19.043036+0000","last_unstale":"2023-11-04T01:38:21.035408+0000","last_undegraded":"2023-11-04T01:38:21.035408+0000","last_fullsized":"2023-11-04T01:38:21.035408+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:50.175265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025122+0000","last_change":"2023-11-04T01:38:01.699187+0000","last_active":"2023-11-04T01:38:20.025122+0000","last_peered":"2023-11-04T01:38:20.025122+0000","last_clean":"2023-11-04T01:38:20.025122+0000","last_became_active":"2023-11-04T01:38:00.706136+0000","last_became_peered":"2023-11-04T01:38:00.706136+0000","last_unstale":"2023-11-04T01:38:20.025122+0000","last_undegraded":"2023-11-04T01:38:20.025122+0000","last_fullsized":"2023-11-04T01:38:20.025122+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074666999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674880+0000","last_change":"2023-11-04T01:38:20.043562+0000","last_active":"2023-11-04T01:38:21.674880+0000","last_peered":"2023-11-04T01:38:21.674880+0000","last_clean":"2023-11-04T01:38:21.674880+0000","last_became_active":"2023-11-04T01:38:20.043168+0000","last_became_peered":"2023-11-04T01:38:20.043168+0000","last_unstale":"2023-11-04T01:38:21.674880+0000","last_undegraded":"2023-11-04T01:38:21.674880+0000","last_fullsized":"2023-11-04T01:38:21.674880+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:32:23.561456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673612+0000","last_change":"2023-11-04T01:38:19.033980+0000","last_active":"2023-11-04T01:38:21.673612+0000","last_peered":"2023-11-04T01:38:21.673612+0000","last_clean":"2023-11-04T01:38:21.673612+0000","last_became_active":"2023-11-04T01:38:19.033687+0000","last_became_peered":"2023-11-04T01:38:19.033687+0000","last_unstale":"2023-11-04T01:38:21.673612+0000","last_undegraded":"2023-11-04T01:38:21.673612+0000","last_fullsized":"2023-11-04T01:38:21.673612+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:18:55.720099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026532+0000","last_change":"2023-11-04T01:38:01.699630+0000","last_active":"2023-11-04T01:38:20.026532+0000","last_peered":"2023-11-04T01:38:20.026532+0000","last_clean":"2023-11-04T01:38:20.026532+0000","last_became_active":"2023-11-04T01:38:00.702550+0000","last_became_peered":"2023-11-04T01:38:00.702550+0000","last_unstale":"2023-11-04T01:38:20.026532+0000","last_undegraded":"2023-11-04T01:38:20.026532+0000","last_fullsized":"2023-11-04T01:38:20.026532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001016077,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675025+0000","last_change":"2023-11-04T01:38:20.042484+0000","last_active":"2023-11-04T01:38:21.675025+0000","last_peered":"2023-11-04T01:38:21.675025+0000","last_clean":"2023-11-04T01:38:21.675025+0000","last_became_active":"2023-11-04T01:38:20.042102+0000","last_became_peered":"2023-11-04T01:38:20.042102+0000","last_unstale":"2023-11-04T01:38:21.675025+0000","last_undegraded":"2023-11-04T01:38:21.675025+0000","last_fullsized":"2023-11-04T01:38:21.675025+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:33:40.713323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674757+0000","last_change":"2023-11-04T01:38:19.037850+0000","last_active":"2023-11-04T01:38:21.674757+0000","last_peered":"2023-11-04T01:38:21.674757+0000","last_clean":"2023-11-04T01:38:21.674757+0000","last_became_active":"2023-11-04T01:38:19.036655+0000","last_became_peered":"2023-11-04T01:38:19.036655+0000","last_unstale":"2023-11-04T01:38:21.674757+0000","last_undegraded":"2023-11-04T01:38:21.674757+0000","last_fullsized":"2023-11-04T01:38:21.674757+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:34.454786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025967+0000","last_change":"2023-11-04T01:38:01.984764+0000","last_active":"2023-11-04T01:38:20.025967+0000","last_peered":"2023-11-04T01:38:20.025967+0000","last_clean":"2023-11-04T01:38:20.025967+0000","last_became_active":"2023-11-04T01:38:00.709894+0000","last_became_peered":"2023-11-04T01:38:00.709894+0000","last_unstale":"2023-11-04T01:38:20.025967+0000","last_undegraded":"2023-11-04T01:38:20.025967+0000","last_fullsized":"2023-11-04T01:38:20.025967+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:08:42.829255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045046799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674470+0000","last_change":"2023-11-04T01:38:20.035044+0000","last_active":"2023-11-04T01:38:21.674470+0000","last_peered":"2023-11-04T01:38:21.674470+0000","last_clean":"2023-11-04T01:38:21.674470+0000","last_became_active":"2023-11-04T01:38:20.034798+0000","last_became_peered":"2023-11-04T01:38:20.034798+0000","last_unstale":"2023-11-04T01:38:21.674470+0000","last_undegraded":"2023-11-04T01:38:21.674470+0000","last_fullsized":"2023-11-04T01:38:21.674470+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:12.069863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673343+0000","last_change":"2023-11-04T01:38:19.040119+0000","last_active":"2023-11-04T01:38:21.673343+0000","last_peered":"2023-11-04T01:38:21.673343+0000","last_clean":"2023-11-04T01:38:21.673343+0000","last_became_active":"2023-11-04T01:38:19.039671+0000","last_became_peered":"2023-11-04T01:38:19.039671+0000","last_unstale":"2023-11-04T01:38:21.673343+0000","last_undegraded":"2023-11-04T01:38:21.673343+0000","last_fullsized":"2023-11-04T01:38:21.673343+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:27.960389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.030006+0000","last_change":"2023-11-04T01:38:02.321871+0000","last_active":"2023-11-04T01:38:20.030006+0000","last_peered":"2023-11-04T01:38:20.030006+0000","last_clean":"2023-11-04T01:38:20.030006+0000","last_became_active":"2023-11-04T01:38:00.708407+0000","last_became_peered":"2023-11-04T01:38:00.708407+0000","last_unstale":"2023-11-04T01:38:20.030006+0000","last_undegraded":"2023-11-04T01:38:20.030006+0000","last_fullsized":"2023-11-04T01:38:20.030006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:48.672429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032387200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674136+0000","last_change":"2023-11-04T01:38:20.046019+0000","last_active":"2023-11-04T01:38:21.674136+0000","last_peered":"2023-11-04T01:38:21.674136+0000","last_clean":"2023-11-04T01:38:21.674136+0000","last_became_active":"2023-11-04T01:38:20.045295+0000","last_became_peered":"2023-11-04T01:38:20.045295+0000","last_unstale":"2023-11-04T01:38:21.674136+0000","last_undegraded":"2023-11-04T01:38:21.674136+0000","last_fullsized":"2023-11-04T01:38:21.674136+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:07.625941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674334+0000","last_change":"2023-11-04T01:38:19.037308+0000","last_active":"2023-11-04T01:38:21.674334+0000","last_peered":"2023-11-04T01:38:21.674334+0000","last_clean":"2023-11-04T01:38:21.674334+0000","last_became_active":"2023-11-04T01:38:19.037030+0000","last_became_peered":"2023-11-04T01:38:19.037030+0000","last_unstale":"2023-11-04T01:38:21.674334+0000","last_undegraded":"2023-11-04T01:38:21.674334+0000","last_fullsized":"2023-11-04T01:38:21.674334+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:41.910027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026703+0000","last_change":"2023-11-04T01:38:01.983988+0000","last_active":"2023-11-04T01:38:20.026703+0000","last_peered":"2023-11-04T01:38:20.026703+0000","last_clean":"2023-11-04T01:38:20.026703+0000","last_became_active":"2023-11-04T01:38:00.711020+0000","last_became_peered":"2023-11-04T01:38:00.711020+0000","last_unstale":"2023-11-04T01:38:20.026703+0000","last_undegraded":"2023-11-04T01:38:20.026703+0000","last_fullsized":"2023-11-04T01:38:20.026703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:06.374078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674030+0000","last_change":"2023-11-04T01:38:20.043160+0000","last_active":"2023-11-04T01:38:21.674030+0000","last_peered":"2023-11-04T01:38:21.674030+0000","last_clean":"2023-11-04T01:38:21.674030+0000","last_became_active":"2023-11-04T01:38:20.042906+0000","last_became_peered":"2023-11-04T01:38:20.042906+0000","last_unstale":"2023-11-04T01:38:21.674030+0000","last_undegraded":"2023-11-04T01:38:21.674030+0000","last_fullsized":"2023-11-04T01:38:21.674030+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:42.068163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674140+0000","last_change":"2023-11-04T01:38:19.036924+0000","last_active":"2023-11-04T01:38:21.674140+0000","last_peered":"2023-11-04T01:38:21.674140+0000","last_clean":"2023-11-04T01:38:21.674140+0000","last_became_active":"2023-11-04T01:38:19.036653+0000","last_became_peered":"2023-11-04T01:38:19.036653+0000","last_unstale":"2023-11-04T01:38:21.674140+0000","last_undegraded":"2023-11-04T01:38:21.674140+0000","last_fullsized":"2023-11-04T01:38:21.674140+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:37.353020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.027634+0000","last_change":"2023-11-04T01:38:02.321641+0000","last_active":"2023-11-04T01:38:20.027634+0000","last_peered":"2023-11-04T01:38:20.027634+0000","last_clean":"2023-11-04T01:38:20.027634+0000","last_became_active":"2023-11-04T01:38:00.706199+0000","last_became_peered":"2023-11-04T01:38:00.706199+0000","last_unstale":"2023-11-04T01:38:20.027634+0000","last_undegraded":"2023-11-04T01:38:20.027634+0000","last_fullsized":"2023-11-04T01:38:20.027634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:15.138325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045080400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674411+0000","last_change":"2023-11-04T01:38:20.037896+0000","last_active":"2023-11-04T01:38:21.674411+0000","last_peered":"2023-11-04T01:38:21.674411+0000","last_clean":"2023-11-04T01:38:21.674411+0000","last_became_active":"2023-11-04T01:38:20.037634+0000","last_became_peered":"2023-11-04T01:38:20.037634+0000","last_unstale":"2023-11-04T01:38:21.674411+0000","last_undegraded":"2023-11-04T01:38:21.674411+0000","last_fullsized":"2023-11-04T01:38:21.674411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:42.068163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673947+0000","last_change":"2023-11-04T01:38:19.035871+0000","last_active":"2023-11-04T01:38:21.673947+0000","last_peered":"2023-11-04T01:38:21.673947+0000","last_clean":"2023-11-04T01:38:21.673947+0000","last_became_active":"2023-11-04T01:38:19.035611+0000","last_became_peered":"2023-11-04T01:38:19.035611+0000","last_unstale":"2023-11-04T01:38:21.673947+0000","last_undegraded":"2023-11-04T01:38:21.673947+0000","last_fullsized":"2023-11-04T01:38:21.673947+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:18:13.034093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025128+0000","last_change":"2023-11-04T01:38:02.156148+0000","last_active":"2023-11-04T01:38:20.025128+0000","last_peered":"2023-11-04T01:38:20.025128+0000","last_clean":"2023-11-04T01:38:20.025128+0000","last_became_active":"2023-11-04T01:38:00.708352+0000","last_became_peered":"2023-11-04T01:38:00.708352+0000","last_unstale":"2023-11-04T01:38:20.025128+0000","last_undegraded":"2023-11-04T01:38:20.025128+0000","last_fullsized":"2023-11-04T01:38:20.025128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035716799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673831+0000","last_change":"2023-11-04T01:38:20.039924+0000","last_active":"2023-11-04T01:38:21.673831+0000","last_peered":"2023-11-04T01:38:21.673831+0000","last_clean":"2023-11-04T01:38:21.673831+0000","last_became_active":"2023-11-04T01:38:20.039696+0000","last_became_peered":"2023-11-04T01:38:20.039696+0000","last_unstale":"2023-11-04T01:38:21.673831+0000","last_undegraded":"2023-11-04T01:38:21.673831+0000","last_fullsized":"2023-11-04T01:38:21.673831+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:57:34.410161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034108+0000","last_change":"2023-11-04T01:38:19.031312+0000","last_active":"2023-11-04T01:38:21.034108+0000","last_peered":"2023-11-04T01:38:21.034108+0000","last_clean":"2023-11-04T01:38:21.034108+0000","last_became_active":"2023-11-04T01:38:19.030697+0000","last_became_peered":"2023-11-04T01:38:19.030697+0000","last_unstale":"2023-11-04T01:38:21.034108+0000","last_undegraded":"2023-11-04T01:38:21.034108+0000","last_fullsized":"2023-11-04T01:38:21.034108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:43.411728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.040006+0000","last_change":"2023-11-04T01:38:01.939729+0000","last_active":"2023-11-04T01:38:20.040006+0000","last_peered":"2023-11-04T01:38:20.040006+0000","last_clean":"2023-11-04T01:38:20.040006+0000","last_became_active":"2023-11-04T01:38:00.704384+0000","last_became_peered":"2023-11-04T01:38:00.704384+0000","last_unstale":"2023-11-04T01:38:20.040006+0000","last_undegraded":"2023-11-04T01:38:20.040006+0000","last_fullsized":"2023-11-04T01:38:20.040006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080052200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673884+0000","last_change":"2023-11-04T01:38:20.034498+0000","last_active":"2023-11-04T01:38:21.673884+0000","last_peered":"2023-11-04T01:38:21.673884+0000","last_clean":"2023-11-04T01:38:21.673884+0000","last_became_active":"2023-11-04T01:38:20.033899+0000","last_became_peered":"2023-11-04T01:38:20.033899+0000","last_unstale":"2023-11-04T01:38:21.673884+0000","last_undegraded":"2023-11-04T01:38:21.673884+0000","last_fullsized":"2023-11-04T01:38:21.673884+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:47:02.791475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673776+0000","last_change":"2023-11-04T01:38:19.034468+0000","last_active":"2023-11-04T01:38:21.673776+0000","last_peered":"2023-11-04T01:38:21.673776+0000","last_clean":"2023-11-04T01:38:21.673776+0000","last_became_active":"2023-11-04T01:38:19.034221+0000","last_became_peered":"2023-11-04T01:38:19.034221+0000","last_unstale":"2023-11-04T01:38:21.673776+0000","last_undegraded":"2023-11-04T01:38:21.673776+0000","last_fullsized":"2023-11-04T01:38:21.673776+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:20:06.734657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.027053+0000","last_change":"2023-11-04T01:38:01.697272+0000","last_active":"2023-11-04T01:38:20.027053+0000","last_peered":"2023-11-04T01:38:20.027053+0000","last_clean":"2023-11-04T01:38:20.027053+0000","last_became_active":"2023-11-04T01:38:00.709395+0000","last_became_peered":"2023-11-04T01:38:00.709395+0000","last_unstale":"2023-11-04T01:38:20.027053+0000","last_undegraded":"2023-11-04T01:38:20.027053+0000","last_fullsized":"2023-11-04T01:38:20.027053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076665499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673660+0000","last_change":"2023-11-04T01:38:20.040105+0000","last_active":"2023-11-04T01:38:21.673660+0000","last_peered":"2023-11-04T01:38:21.673660+0000","last_clean":"2023-11-04T01:38:21.673660+0000","last_became_active":"2023-11-04T01:38:20.039595+0000","last_became_peered":"2023-11-04T01:38:20.039595+0000","last_unstale":"2023-11-04T01:38:21.673660+0000","last_undegraded":"2023-11-04T01:38:21.673660+0000","last_fullsized":"2023-11-04T01:38:21.673660+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:47:02.791475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675235+0000","last_change":"2023-11-04T01:38:19.035180+0000","last_active":"2023-11-04T01:38:21.675235+0000","last_peered":"2023-11-04T01:38:21.675235+0000","last_clean":"2023-11-04T01:38:21.675235+0000","last_became_active":"2023-11-04T01:38:19.034909+0000","last_became_peered":"2023-11-04T01:38:19.034909+0000","last_unstale":"2023-11-04T01:38:21.675235+0000","last_undegraded":"2023-11-04T01:38:21.675235+0000","last_fullsized":"2023-11-04T01:38:21.675235+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:41.063063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.026616+0000","last_change":"2023-11-04T01:38:01.984567+0000","last_active":"2023-11-04T01:38:20.026616+0000","last_peered":"2023-11-04T01:38:20.026616+0000","last_clean":"2023-11-04T01:38:20.026616+0000","last_became_active":"2023-11-04T01:38:00.708020+0000","last_became_peered":"2023-11-04T01:38:00.708020+0000","last_unstale":"2023-11-04T01:38:20.026616+0000","last_undegraded":"2023-11-04T01:38:20.026616+0000","last_fullsized":"2023-11-04T01:38:20.026616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:09.638146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056906299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673592+0000","last_change":"2023-11-04T01:38:20.041668+0000","last_active":"2023-11-04T01:38:21.673592+0000","last_peered":"2023-11-04T01:38:21.673592+0000","last_clean":"2023-11-04T01:38:21.673592+0000","last_became_active":"2023-11-04T01:38:20.041410+0000","last_became_peered":"2023-11-04T01:38:20.041410+0000","last_unstale":"2023-11-04T01:38:21.673592+0000","last_undegraded":"2023-11-04T01:38:21.673592+0000","last_fullsized":"2023-11-04T01:38:21.673592+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:23:35.405508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.673509+0000","last_change":"2023-11-04T01:38:19.038777+0000","last_active":"2023-11-04T01:38:21.673509+0000","last_peered":"2023-11-04T01:38:21.673509+0000","last_clean":"2023-11-04T01:38:21.673509+0000","last_became_active":"2023-11-04T01:38:19.038468+0000","last_became_peered":"2023-11-04T01:38:19.038468+0000","last_unstale":"2023-11-04T01:38:21.673509+0000","last_undegraded":"2023-11-04T01:38:21.673509+0000","last_fullsized":"2023-11-04T01:38:21.673509+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:04.103557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.024924+0000","last_change":"2023-11-04T01:38:01.699685+0000","last_active":"2023-11-04T01:38:20.024924+0000","last_peered":"2023-11-04T01:38:20.024924+0000","last_clean":"2023-11-04T01:38:20.024924+0000","last_became_active":"2023-11-04T01:38:00.706802+0000","last_became_peered":"2023-11-04T01:38:00.706802+0000","last_unstale":"2023-11-04T01:38:20.024924+0000","last_undegraded":"2023-11-04T01:38:20.024924+0000","last_fullsized":"2023-11-04T01:38:20.024924+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085845400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674147+0000","last_change":"2023-11-04T01:38:20.054374+0000","last_active":"2023-11-04T01:38:21.674147+0000","last_peered":"2023-11-04T01:38:21.674147+0000","last_clean":"2023-11-04T01:38:21.674147+0000","last_became_active":"2023-11-04T01:38:20.054116+0000","last_became_peered":"2023-11-04T01:38:20.054116+0000","last_unstale":"2023-11-04T01:38:21.674147+0000","last_undegraded":"2023-11-04T01:38:21.674147+0000","last_fullsized":"2023-11-04T01:38:21.674147+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:37:52.192853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674217+0000","last_change":"2023-11-04T01:38:19.038783+0000","last_active":"2023-11-04T01:38:21.674217+0000","last_peered":"2023-11-04T01:38:21.674217+0000","last_clean":"2023-11-04T01:38:21.674217+0000","last_became_active":"2023-11-04T01:38:19.038529+0000","last_became_peered":"2023-11-04T01:38:19.038529+0000","last_unstale":"2023-11-04T01:38:21.674217+0000","last_undegraded":"2023-11-04T01:38:21.674217+0000","last_fullsized":"2023-11-04T01:38:21.674217+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:39.781516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.033827+0000","last_change":"2023-11-04T01:38:01.700399+0000","last_active":"2023-11-04T01:38:20.033827+0000","last_peered":"2023-11-04T01:38:20.033827+0000","last_clean":"2023-11-04T01:38:20.033827+0000","last_became_active":"2023-11-04T01:38:00.701352+0000","last_became_peered":"2023-11-04T01:38:00.701352+0000","last_unstale":"2023-11-04T01:38:20.033827+0000","last_undegraded":"2023-11-04T01:38:20.033827+0000","last_fullsized":"2023-11-04T01:38:20.033827+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078589399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035927+0000","last_change":"2023-11-04T01:38:20.035907+0000","last_active":"2023-11-04T01:38:21.035927+0000","last_peered":"2023-11-04T01:38:21.035927+0000","last_clean":"2023-11-04T01:38:21.035927+0000","last_became_active":"2023-11-04T01:38:20.035487+0000","last_became_peered":"2023-11-04T01:38:20.035487+0000","last_unstale":"2023-11-04T01:38:21.035927+0000","last_undegraded":"2023-11-04T01:38:21.035927+0000","last_fullsized":"2023-11-04T01:38:21.035927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:32:23.561456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675407+0000","last_change":"2023-11-04T01:38:19.037147+0000","last_active":"2023-11-04T01:38:21.675407+0000","last_peered":"2023-11-04T01:38:21.675407+0000","last_clean":"2023-11-04T01:38:21.675407+0000","last_became_active":"2023-11-04T01:38:19.036862+0000","last_became_peered":"2023-11-04T01:38:19.036862+0000","last_unstale":"2023-11-04T01:38:21.675407+0000","last_undegraded":"2023-11-04T01:38:21.675407+0000","last_fullsized":"2023-11-04T01:38:21.675407+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:56.458934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.032215+0000","last_change":"2023-11-04T01:38:02.362072+0000","last_active":"2023-11-04T01:38:20.032215+0000","last_peered":"2023-11-04T01:38:20.032215+0000","last_clean":"2023-11-04T01:38:20.032215+0000","last_became_active":"2023-11-04T01:38:00.710897+0000","last_became_peered":"2023-11-04T01:38:00.710897+0000","last_unstale":"2023-11-04T01:38:20.032215+0000","last_undegraded":"2023-11-04T01:38:20.032215+0000","last_fullsized":"2023-11-04T01:38:20.032215+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:25.229838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058055900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.035563+0000","last_change":"2023-11-04T01:38:20.035410+0000","last_active":"2023-11-04T01:38:21.035563+0000","last_peered":"2023-11-04T01:38:21.035563+0000","last_clean":"2023-11-04T01:38:21.035563+0000","last_became_active":"2023-11-04T01:38:20.034871+0000","last_became_peered":"2023-11-04T01:38:20.034871+0000","last_unstale":"2023-11-04T01:38:21.035563+0000","last_undegraded":"2023-11-04T01:38:21.035563+0000","last_fullsized":"2023-11-04T01:38:21.035563+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:30:57.464034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674269+0000","last_change":"2023-11-04T01:38:19.040085+0000","last_active":"2023-11-04T01:38:21.674269+0000","last_peered":"2023-11-04T01:38:21.674269+0000","last_clean":"2023-11-04T01:38:21.674269+0000","last_became_active":"2023-11-04T01:38:19.038670+0000","last_became_peered":"2023-11-04T01:38:19.038670+0000","last_unstale":"2023-11-04T01:38:21.674269+0000","last_undegraded":"2023-11-04T01:38:21.674269+0000","last_fullsized":"2023-11-04T01:38:21.674269+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:42:38.429638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.038809+0000","last_change":"2023-11-04T01:38:01.939857+0000","last_active":"2023-11-04T01:38:20.038809+0000","last_peered":"2023-11-04T01:38:20.038809+0000","last_clean":"2023-11-04T01:38:20.038809+0000","last_became_active":"2023-11-04T01:38:00.701371+0000","last_became_peered":"2023-11-04T01:38:00.701371+0000","last_unstale":"2023-11-04T01:38:20.038809+0000","last_undegraded":"2023-11-04T01:38:20.038809+0000","last_fullsized":"2023-11-04T01:38:20.038809+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078632099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675284+0000","last_change":"2023-11-04T01:38:20.047127+0000","last_active":"2023-11-04T01:38:21.675284+0000","last_peered":"2023-11-04T01:38:21.675284+0000","last_clean":"2023-11-04T01:38:21.675284+0000","last_became_active":"2023-11-04T01:38:20.046835+0000","last_became_peered":"2023-11-04T01:38:20.046835+0000","last_unstale":"2023-11-04T01:38:21.675284+0000","last_undegraded":"2023-11-04T01:38:21.675284+0000","last_fullsized":"2023-11-04T01:38:21.675284+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:58:25.387712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.674005+0000","last_change":"2023-11-04T01:38:19.034880+0000","last_active":"2023-11-04T01:38:21.674005+0000","last_peered":"2023-11-04T01:38:21.674005+0000","last_clean":"2023-11-04T01:38:21.674005+0000","last_became_active":"2023-11-04T01:38:19.034612+0000","last_became_peered":"2023-11-04T01:38:19.034612+0000","last_unstale":"2023-11-04T01:38:21.674005+0000","last_undegraded":"2023-11-04T01:38:21.674005+0000","last_fullsized":"2023-11-04T01:38:21.674005+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:23:34.400408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.040072+0000","last_change":"2023-11-04T01:38:01.939662+0000","last_active":"2023-11-04T01:38:20.040072+0000","last_peered":"2023-11-04T01:38:20.040072+0000","last_clean":"2023-11-04T01:38:20.040072+0000","last_became_active":"2023-11-04T01:38:00.705871+0000","last_became_peered":"2023-11-04T01:38:00.705871+0000","last_unstale":"2023-11-04T01:38:20.040072+0000","last_undegraded":"2023-11-04T01:38:20.040072+0000","last_fullsized":"2023-11-04T01:38:20.040072+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066873200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.675053+0000","last_change":"2023-11-04T01:38:20.046325+0000","last_active":"2023-11-04T01:38:21.675053+0000","last_peered":"2023-11-04T01:38:21.675053+0000","last_clean":"2023-11-04T01:38:21.675053+0000","last_became_active":"2023-11-04T01:38:20.045741+0000","last_became_peered":"2023-11-04T01:38:20.045741+0000","last_unstale":"2023-11-04T01:38:21.675053+0000","last_undegraded":"2023-11-04T01:38:21.675053+0000","last_fullsized":"2023-11-04T01:38:21.675053+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:19.014310+0000","last_clean_scrub_stamp":"2023-11-04T01:38:19.014310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:33.689272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034334+0000","last_change":"2023-11-04T01:38:19.035913+0000","last_active":"2023-11-04T01:38:21.034334+0000","last_peered":"2023-11-04T01:38:21.034334+0000","last_clean":"2023-11-04T01:38:21.034334+0000","last_became_active":"2023-11-04T01:38:19.035614+0000","last_became_peered":"2023-11-04T01:38:19.035614+0000","last_unstale":"2023-11-04T01:38:21.034334+0000","last_undegraded":"2023-11-04T01:38:21.034334+0000","last_fullsized":"2023-11-04T01:38:21.034334+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:18.009210+0000","last_clean_scrub_stamp":"2023-11-04T01:38:18.009210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:20:06.734657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:38:20.025775+0000","last_change":"2023-11-04T01:38:01.984672+0000","last_active":"2023-11-04T01:38:20.025775+0000","last_peered":"2023-11-04T01:38:20.025775+0000","last_clean":"2023-11-04T01:38:20.025775+0000","last_became_active":"2023-11-04T01:38:00.706804+0000","last_became_peered":"2023-11-04T01:38:00.706804+0000","last_unstale":"2023-11-04T01:38:20.025775+0000","last_undegraded":"2023-11-04T01:38:20.025775+0000","last_fullsized":"2023-11-04T01:38:20.025775+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:48.412413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038439000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:38:21.034257+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:38:21.034257+0000","last_peered":"2023-11-04T01:38:21.034257+0000","last_clean":"2023-11-04T01:38:21.034257+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:38:21.034257+0000","last_undegraded":"2023-11-04T01:38:21.034257+0000","last_fullsized":"2023-11-04T01:38:21.034257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1245184,"data_stored":883232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45300000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.318}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.38100000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.437,"15min":0.42999999999999999},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65200000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.499}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.504,"15min":0.496},"min":{"1min":0.35399999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.44,"5min":0.317,"15min":0.317},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.48099999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.48799999999999999,"15min":0.47899999999999998},"min":{"1min":0.39300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.42299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":643072,"data_stored":292704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68799999999999994,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.70099999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67600000000000005,"5min":1.05,"15min":1.05},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70099999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.51000000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.66900000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.48699999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.748,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.626},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.44,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71999999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.501,"15min":0.501},"min":{"1min":0.373,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.373}]},{"osd":5,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81899999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.38,"5min":0.372,"15min":0.372},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.434}]},{"osd":7,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.67900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":293356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.58399999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55000000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.624},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.59899999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.67200000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.44400000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.56799999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.53300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":294316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.442},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.65800000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52400000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82099999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.55500000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72199999999999998,"5min":0.879,"15min":0.879},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85499999999999998,"5min":1.089,"15min":1.089},"last":0.57099999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.33600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48499999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.34100000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.50700000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.40000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92500000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":292760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.311}]},{"osd":1,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.36499999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.5}]},{"osd":6,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:37:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.58399999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":292760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.32500000000000001,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.442,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.33600000000000002,"15min":0.34300000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.39300000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.29099999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.48399999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.31},{"interface":"front","average":{"1min":0.317,"5min":0.39100000000000001,"15min":0.40300000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.44,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.36299999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.40899999999999997,"15min":0.42099999999999999},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.51500000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.42099999999999999,"15min":0.433},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.46999999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.32900000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.63900000000000001,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.82399999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.45200000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68400000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.68300000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.877,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79700000000000004,"5min":1,"15min":1},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61199999999999999,"15min":0.62},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73099999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55800000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76200000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":647168,"data_stored":292794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.39500000000000002,"15min":0.36099999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":5.415},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.42599999999999999,"15min":0.41199999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":3.456,"5min":3.456,"15min":3.456},"last":3.456}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":2.355},{"interface":"front","average":{"1min":0.5,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":2.5299999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.52600000000000002,"15min":0.47099999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":8.891,"5min":8.891,"15min":8.891},"last":8.891},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.46800000000000003,"15min":0.39600000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":9.8889999999999993,"5min":9.8889999999999993,"15min":9.8889999999999993},"last":9.8889999999999993}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.629,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":4.5720000000000001,"5min":4.5720000000000001,"15min":4.5720000000000001},"last":4.5720000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":2.3260000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":2.3860000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.46899999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":2.4889999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.68700000000000006,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.915,"5min":5.915,"15min":5.915},"last":5.915},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.288}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":2.5609999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.66000000000000003,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":7.2599999999999998,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":7.2599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1253376,"data_stored":885266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30599999999999999,"15min":0.308},"min":{"1min":0.22500000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.40600000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.252},{"interface":"front","average":{"1min":0.318,"5min":0.33500000000000002,"15min":0.33800000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47499999999999998,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.33600000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.36299999999999999,"15min":0.36699999999999999},"min":{"1min":0.23599999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.39900000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.318},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.245,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.45500000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.26700000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.315,"15min":0.315},"min":{"1min":0.24199999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.38100000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.374,"15min":0.379},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44700000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72199999999999998,"5min":0.87,"15min":0.87},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.314,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.46500000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.73299999999999998,"5min":0.996,"15min":0.996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.66700000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.496}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60499999999999998,"15min":0.61399999999999999},"min":{"1min":0.433,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70899999999999996,"5min":1.026,"15min":1.026},"last":0.433},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":1.177,"15min":1.177},"last":0.42299999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.71999999999999997,"5min":1.131,"15min":1.131},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":0.746,"15min":0.746},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:38:28.204 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:38:28.205 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:38:28.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.342+0000 7fc05eaa9640 1 Processor -- start 2023-11-04T01:38:28.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.342+0000 7fc05eaa9640 1 -- start start 2023-11-04T01:38:28.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.343+0000 7fc05eaa9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc05815e3f0 0x7fc0580b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.343+0000 7fc05eaa9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0580caa20 con 0x7fc0580cc300 2023-11-04T01:38:28.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.343+0000 7fc05eaa9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0580cb230 con 0x7fc0580ca0a0 2023-11-04T01:38:28.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.343+0000 7fc05eaa9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0580ca530 con 0x7fc05815e3f0 2023-11-04T01:38:28.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.343+0000 7fc05c845640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc05815e3f0 0x7fc0580b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.343+0000 7fc05d046640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc0580cc300 0x7fc0580b1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42426/0 (socket says 172.21.15.114:42426) 2023-11-04T01:38:28.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.343+0000 7fc05c845640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc05815e3f0 0x7fc0580b2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59608/0 (socket says 172.21.15.114:59608) 2023-11-04T01:38:28.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.343+0000 7fc05d046640 1 -- 172.21.15.114:0/669576192 learned_addr learned my addr 172.21.15.114:0/669576192 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:28.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.343+0000 7fc05c845640 1 -- 172.21.15.114:0/669576192 >> v1:172.21.15.141:6789/0 conn(0x7fc0580ca0a0 legacy=0x7fc0580cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:28.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.343+0000 7fc05c845640 1 -- 172.21.15.114:0/669576192 >> v1:172.21.15.114:6789/0 conn(0x7fc0580cc300 legacy=0x7fc0580b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.343+0000 7fc05c845640 1 -- 172.21.15.114:0/669576192 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0580cac70 con 0x7fc05815e3f0 2023-11-04T01:38:28.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.343+0000 7fc0577fe640 1 -- 172.21.15.114:0/669576192 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981121880 0 0) 0x7fc0580caa20 con 0x7fc0580cc300 2023-11-04T01:38:28.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.344+0000 7fc05c845640 1 --2- 172.21.15.114:0/669576192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc05815e3f0 0x7fc0580b2bf0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc0480097a0 tx=0x7fc04802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b39236afba551b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.344+0000 7fc0577fe640 1 -- 172.21.15.114:0/669576192 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048031830 con 0x7fc05815e3f0 2023-11-04T01:38:28.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.344+0000 7fc0577fe640 1 -- 172.21.15.114:0/669576192 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc048031990 con 0x7fc05815e3f0 2023-11-04T01:38:28.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.344+0000 7fc0577fe640 1 -- 172.21.15.114:0/669576192 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048031d20 con 0x7fc05815e3f0 2023-11-04T01:38:28.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.345+0000 7fc05eaa9640 1 -- 172.21.15.114:0/669576192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc05815e3f0 msgr2=0x7fc0580b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.345+0000 7fc05eaa9640 1 --2- 172.21.15.114:0/669576192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc05815e3f0 0x7fc0580b2bf0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc0480097a0 tx=0x7fc04802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.345+0000 7fc05eaa9640 1 -- 172.21.15.114:0/669576192 shutdown_connections 2023-11-04T01:38:28.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.345+0000 7fc05eaa9640 1 --2- 172.21.15.114:0/669576192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc05815e3f0 0x7fc0580b2bf0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.345+0000 7fc05eaa9640 1 -- 172.21.15.114:0/669576192 >> 172.21.15.114:0/669576192 conn(0x7fc058071820 msgr2=0x7fc058071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:28.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.345+0000 7fc05eaa9640 1 -- 172.21.15.114:0/669576192 shutdown_connections 2023-11-04T01:38:28.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.345+0000 7fc05eaa9640 1 -- 172.21.15.114:0/669576192 wait complete. 2023-11-04T01:38:28.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.346+0000 7fc05eaa9640 1 Processor -- start 2023-11-04T01:38:28.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.346+0000 7fc05eaa9640 1 -- start start 2023-11-04T01:38:28.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05eaa9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0580cc300 0x7fc058150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05eaa9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc05815e3f0 0x7fc0581e5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05eaa9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc05815c9d0 0x7fc05815ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05eaa9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05815d3c0 con 0x7fc0580cc300 2023-11-04T01:38:28.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05eaa9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0580c7660 con 0x7fc05815c9d0 2023-11-04T01:38:28.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05eaa9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0581e4ca0 con 0x7fc05815e3f0 2023-11-04T01:38:28.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05c845640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0580cc300 0x7fc058150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05c845640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0580cc300 0x7fc058150880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59626/0 (socket says 172.21.15.114:59626) 2023-11-04T01:38:28.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05c845640 1 -- 172.21.15.114:0/3199397447 learned_addr learned my addr 172.21.15.114:0/3199397447 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:28.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05c845640 1 -- 172.21.15.114:0/3199397447 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc05815e3f0 msgr2=0x7fc0581e5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc057fff640 1 --2- 172.21.15.114:0/3199397447 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc05815e3f0 0x7fc0581e5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05d046640 1 --2- 172.21.15.114:0/3199397447 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc05815c9d0 0x7fc05815ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05c845640 1 --2- 172.21.15.114:0/3199397447 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc05815e3f0 0x7fc0581e5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05c845640 1 -- 172.21.15.114:0/3199397447 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc05815c9d0 msgr2=0x7fc05815ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05c845640 1 --2- 172.21.15.114:0/3199397447 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc05815c9d0 0x7fc05815ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05c845640 1 -- 172.21.15.114:0/3199397447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc048009400 con 0x7fc0580cc300 2023-11-04T01:38:28.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc057fff640 1 --2- 172.21.15.114:0/3199397447 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc05815e3f0 0x7fc0581e5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:28.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05d046640 1 --2- 172.21.15.114:0/3199397447 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc05815c9d0 0x7fc05815ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:28.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.347+0000 7fc05c845640 1 --2- 172.21.15.114:0/3199397447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0580cc300 0x7fc058150880 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc0480098c0 tx=0x7fc0480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.348+0000 7fc0557fa640 1 -- 172.21.15.114:0/3199397447 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04803aa60 con 0x7fc0580cc300 2023-11-04T01:38:28.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.348+0000 7fc0557fa640 1 -- 172.21.15.114:0/3199397447 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04803abc0 con 0x7fc0580cc300 2023-11-04T01:38:28.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.348+0000 7fc05eaa9640 1 -- 172.21.15.114:0/3199397447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0581e4090 con 0x7fc0580cc300 2023-11-04T01:38:28.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.348+0000 7fc0557fa640 1 -- 172.21.15.114:0/3199397447 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0480443f0 con 0x7fc0580cc300 2023-11-04T01:38:28.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.348+0000 7fc05eaa9640 1 -- 172.21.15.114:0/3199397447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0581e4650 con 0x7fc0580cc300 2023-11-04T01:38:28.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.349+0000 7fc05eaa9640 1 -- 172.21.15.114:0/3199397447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc058074290 con 0x7fc0580cc300 2023-11-04T01:38:28.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.349+0000 7fc0557fa640 1 -- 172.21.15.114:0/3199397447 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc048044550 con 0x7fc0580cc300 2023-11-04T01:38:28.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.349+0000 7fc0557fa640 1 --2- 172.21.15.114:0/3199397447 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc04406aea0 0x7fc04406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.350+0000 7fc0557fa640 1 -- 172.21.15.114:0/3199397447 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc0480abc50 con 0x7fc0580cc300 2023-11-04T01:38:28.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.350+0000 7fc057fff640 1 --2- 172.21.15.114:0/3199397447 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc04406aea0 0x7fc04406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.350+0000 7fc057fff640 1 --2- 172.21.15.114:0/3199397447 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc04406aea0 0x7fc04406d360 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc0581f3980 tx=0x7fc04c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.354+0000 7fc0557fa640 1 -- 172.21.15.114:0/3199397447 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc0480b1020 con 0x7fc0580cc300 2023-11-04T01:38:28.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.582+0000 7fc05eaa9640 1 -- 172.21.15.114:0/3199397447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc05806a5a0 con 0x7fc0580cc300 2023-11-04T01:38:28.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.586+0000 7fc0557fa640 1 -- 172.21.15.114:0/3199397447 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7fc048076af0 con 0x7fc0580cc300 2023-11-04T01:38:28.588 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2023-11-04T01:38:28.588 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDan0Vl3QHODhAA6LWlhd+avWYsoYsWMbOiVA== 2023-11-04T01:38:28.589 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2023-11-04T01:38:28.589 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2023-11-04T01:38:28.589 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:38:28.589 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2023-11-04T01:38:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.588+0000 7fc05eaa9640 1 -- 172.21.15.114:0/3199397447 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc04406aea0 msgr2=0x7fc04406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.588+0000 7fc05eaa9640 1 --2- 172.21.15.114:0/3199397447 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc04406aea0 0x7fc04406d360 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc0581f3980 tx=0x7fc04c009040 comp rx=0 tx=0).stop 2023-11-04T01:38:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.588+0000 7fc05eaa9640 1 -- 172.21.15.114:0/3199397447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0580cc300 msgr2=0x7fc058150880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.588+0000 7fc05eaa9640 1 --2- 172.21.15.114:0/3199397447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0580cc300 0x7fc058150880 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc0480098c0 tx=0x7fc0480046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.589+0000 7fc05eaa9640 1 -- 172.21.15.114:0/3199397447 shutdown_connections 2023-11-04T01:38:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.589+0000 7fc05eaa9640 1 --2- 172.21.15.114:0/3199397447 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc04406aea0 0x7fc04406d360 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.589+0000 7fc05eaa9640 1 --2- 172.21.15.114:0/3199397447 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc05815c9d0 0x7fc05815ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.589+0000 7fc05eaa9640 1 --2- 172.21.15.114:0/3199397447 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc05815e3f0 0x7fc0581e5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.589+0000 7fc05eaa9640 1 --2- 172.21.15.114:0/3199397447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0580cc300 0x7fc058150880 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.589+0000 7fc05eaa9640 1 -- 172.21.15.114:0/3199397447 >> 172.21.15.114:0/3199397447 conn(0x7fc058071820 msgr2=0x7fc0580cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.589+0000 7fc05eaa9640 1 -- 172.21.15.114:0/3199397447 shutdown_connections 2023-11-04T01:38:28.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.589+0000 7fc05eaa9640 1 -- 172.21.15.114:0/3199397447 wait complete. 2023-11-04T01:38:28.601 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:28.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.702+0000 7fe4b211d640 1 Processor -- start 2023-11-04T01:38:28.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.702+0000 7fe4b211d640 1 -- start start 2023-11-04T01:38:28.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4b211d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4ac0cda30 0x7fe4ac165ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4b211d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ac0cc450 con 0x7fe4ac15bfb0 2023-11-04T01:38:28.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4b211d640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ac15f400 con 0x7fe4ac15ae40 2023-11-04T01:38:28.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4b211d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac15b220 con 0x7fe4ac0cda30 2023-11-04T01:38:28.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aaffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe4ac15bfb0 0x7fe4ac0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42428/0 (socket says 172.21.15.114:42428) 2023-11-04T01:38:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aaffd640 1 -- 172.21.15.114:0/2718533901 learned_addr learned my addr 172.21.15.114:0/2718533901 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4abfff640 1 --2- 172.21.15.114:0/2718533901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4ac0cda30 0x7fe4ac165ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aa7fc640 1 -- 172.21.15.114:0/2718533901 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429239037 0 0) 0x7fe494001110 con 0x7fe4ac15bfb0 2023-11-04T01:38:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aa7fc640 1 -- 172.21.15.114:0/2718533901 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe498003520 con 0x7fe4ac15bfb0 2023-11-04T01:38:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aa7fc640 1 -- 172.21.15.114:0/2718533901 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 972811090 0 0) 0x7fe498003520 con 0x7fe4ac15bfb0 2023-11-04T01:38:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aa7fc640 1 -- 172.21.15.114:0/2718533901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4ac0cda30 msgr2=0x7fe4ac165ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aa7fc640 1 --2- 172.21.15.114:0/2718533901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4ac0cda30 0x7fe4ac165ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aa7fc640 1 -- 172.21.15.114:0/2718533901 >> v1:172.21.15.141:6789/0 conn(0x7fe4ac15ae40 legacy=0x7fe4ac0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aa7fc640 1 -- 172.21.15.114:0/2718533901 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac15f890 con 0x7fe4ac15bfb0 2023-11-04T01:38:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aa7fc640 1 -- 172.21.15.114:0/2718533901 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fe494001800 con 0x7fe4ac15bfb0 2023-11-04T01:38:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aa7fc640 1 -- 172.21.15.114:0/2718533901 >> v1:172.21.15.114:6789/0 conn(0x7fe4ac15bfb0 legacy=0x7fe4ac0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aa7fc640 1 --2- 172.21.15.114:0/2718533901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4980039a0 0x7fe498003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aa7fc640 1 --2- 172.21.15.114:0/2718533901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4980047c0 0x7fe498004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aa7fc640 1 --2- 172.21.15.114:0/2718533901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4ac0cda30 0x7fe498005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aa7fc640 1 -- 172.21.15.114:0/2718533901 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac15b220 con 0x7fe4980039a0 2023-11-04T01:38:28.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aa7fc640 1 -- 172.21.15.114:0/2718533901 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49800ba30 con 0x7fe4980047c0 2023-11-04T01:38:28.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.703+0000 7fe4aa7fc640 1 -- 172.21.15.114:0/2718533901 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49800bbf0 con 0x7fe4ac0cda30 2023-11-04T01:38:28.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.704+0000 7fe4ab7fe640 1 --2- 172.21.15.114:0/2718533901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4980039a0 0x7fe498003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.704+0000 7fe4aaffd640 1 --2- 172.21.15.114:0/2718533901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4980047c0 0x7fe498004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.704+0000 7fe4abfff640 1 --2- 172.21.15.114:0/2718533901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4ac0cda30 0x7fe498005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.704+0000 7fe4ab7fe640 1 -- 172.21.15.114:0/2718533901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4ac0cda30 msgr2=0x7fe498005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:28.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.704+0000 7fe4ab7fe640 1 --2- 172.21.15.114:0/2718533901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4ac0cda30 0x7fe498005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.704+0000 7fe4ab7fe640 1 -- 172.21.15.114:0/2718533901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4980047c0 msgr2=0x7fe498004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:28.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.704+0000 7fe4ab7fe640 1 --2- 172.21.15.114:0/2718533901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4980047c0 0x7fe498004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.704+0000 7fe4ab7fe640 1 -- 172.21.15.114:0/2718533901 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe498003520 con 0x7fe4980039a0 2023-11-04T01:38:28.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.704+0000 7fe4ab7fe640 1 --2- 172.21.15.114:0/2718533901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4980039a0 0x7fe498003dc0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe49c001720 tx=0x7fe4980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7ea65cf5bf668 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.705+0000 7fe4aa7fc640 1 -- 172.21.15.114:0/2718533901 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0052d0 con 0x7fe4980039a0 2023-11-04T01:38:28.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.705+0000 7fe4aa7fc640 1 -- 172.21.15.114:0/2718533901 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c02e050 con 0x7fe4980039a0 2023-11-04T01:38:28.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.705+0000 7fe4aa7fc640 1 -- 172.21.15.114:0/2718533901 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0035f0 con 0x7fe4980039a0 2023-11-04T01:38:28.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.705+0000 7fe4b211d640 1 -- 172.21.15.114:0/2718533901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4980039a0 msgr2=0x7fe498003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.705+0000 7fe4b211d640 1 --2- 172.21.15.114:0/2718533901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4980039a0 0x7fe498003dc0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe49c001720 tx=0x7fe4980057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.705+0000 7fe4abfff640 1 -- 172.21.15.114:0/2718533901 reap_dead start 2023-11-04T01:38:28.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.705+0000 7fe4b211d640 1 -- 172.21.15.114:0/2718533901 shutdown_connections 2023-11-04T01:38:28.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.705+0000 7fe4b211d640 1 -- 172.21.15.114:0/2718533901 >> 172.21.15.114:0/2718533901 conn(0x7fe4ac06ea90 msgr2=0x7fe4ac06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:28.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.705+0000 7fe4b211d640 1 -- 172.21.15.114:0/2718533901 shutdown_connections 2023-11-04T01:38:28.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.705+0000 7fe4b211d640 1 -- 172.21.15.114:0/2718533901 wait complete. 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.706+0000 7fe4b211d640 1 Processor -- start 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.707+0000 7fe4b211d640 1 -- start start 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.707+0000 7fe4b211d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4980039a0 0x7fe4ac0d0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.707+0000 7fe4b211d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4ac1518a0 0x7fe4ac0c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.707+0000 7fe4b211d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4ac0c6890 0x7fe4ac0c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.707+0000 7fe4b211d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac152a90 con 0x7fe4ac1518a0 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.707+0000 7fe4b211d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac151e10 con 0x7fe4980039a0 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.707+0000 7fe4b211d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac1520f0 con 0x7fe4ac0c6890 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.707+0000 7fe4aaffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4ac1518a0 0x7fe4ac0c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.707+0000 7fe4aaffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4ac1518a0 0x7fe4ac0c6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59644/0 (socket says 172.21.15.114:59644) 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.707+0000 7fe4aaffd640 1 -- 172.21.15.114:0/3976209895 learned_addr learned my addr 172.21.15.114:0/3976209895 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.707+0000 7fe4ab7fe640 1 --2- 172.21.15.114:0/3976209895 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4980039a0 0x7fe4ac0d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.707+0000 7fe4abfff640 1 --2- 172.21.15.114:0/3976209895 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4ac0c6890 0x7fe4ac0c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.708+0000 7fe4aaffd640 1 -- 172.21.15.114:0/3976209895 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4ac0c6890 msgr2=0x7fe4ac0c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.708+0000 7fe4aaffd640 1 --2- 172.21.15.114:0/3976209895 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4ac0c6890 0x7fe4ac0c46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.708+0000 7fe4aaffd640 1 -- 172.21.15.114:0/3976209895 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4980039a0 msgr2=0x7fe4ac0d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.708+0000 7fe4aaffd640 1 --2- 172.21.15.114:0/3976209895 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4980039a0 0x7fe4ac0d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.708+0000 7fe4aaffd640 1 -- 172.21.15.114:0/3976209895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac1523d0 con 0x7fe4ac1518a0 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.708+0000 7fe4abfff640 1 --2- 172.21.15.114:0/3976209895 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4ac0c6890 0x7fe4ac0c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.708+0000 7fe4aaffd640 1 --2- 172.21.15.114:0/3976209895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4ac1518a0 0x7fe4ac0c6350 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe4940018b0 tx=0x7fe4940074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.708+0000 7fe4a3fff640 1 -- 172.21.15.114:0/3976209895 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494001180 con 0x7fe4ac1518a0 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.708+0000 7fe4a3fff640 1 -- 172.21.15.114:0/3976209895 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe494007740 con 0x7fe4ac1518a0 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.708+0000 7fe4b211d640 1 -- 172.21.15.114:0/3976209895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ac1526b0 con 0x7fe4ac1518a0 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.708+0000 7fe4a3fff640 1 -- 172.21.15.114:0/3976209895 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400fb60 con 0x7fe4ac1518a0 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.708+0000 7fe4b211d640 1 -- 172.21.15.114:0/3976209895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ac0d0880 con 0x7fe4ac1518a0 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.709+0000 7fe4b211d640 1 -- 172.21.15.114:0/3976209895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ac0c84a0 con 0x7fe4ac1518a0 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.709+0000 7fe4a3fff640 1 -- 172.21.15.114:0/3976209895 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe49400fcc0 con 0x7fe4ac1518a0 2023-11-04T01:38:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.710+0000 7fe4a3fff640 1 --2- 172.21.15.114:0/3976209895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe48c06aea0 0x7fe48c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:28.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.710+0000 7fe4a3fff640 1 -- 172.21.15.114:0/3976209895 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe494089590 con 0x7fe4ac1518a0 2023-11-04T01:38:28.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.710+0000 7fe4ab7fe640 1 --2- 172.21.15.114:0/3976209895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe48c06aea0 0x7fe48c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:28.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.710+0000 7fe4ab7fe640 1 --2- 172.21.15.114:0/3976209895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe48c06aea0 0x7fe48c06d360 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe49c033000 tx=0x7fe49c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:28.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.714+0000 7fe4a3fff640 1 -- 172.21.15.114:0/3976209895 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4940543a0 con 0x7fe4ac1518a0 2023-11-04T01:38:28.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.915+0000 7fe4b211d640 1 -- 172.21.15.114:0/3976209895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4ac0ce2d0 con 0x7fe4ac1518a0 2023-11-04T01:38:28.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.915+0000 7fe4a3fff640 1 -- 172.21.15.114:0/3976209895 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fe4940579c0 con 0x7fe4ac1518a0 2023-11-04T01:38:28.917 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:28.917 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1567359819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1567359819},{"type":"v1","addr":"172.21.15.141:6834","nonce":1567359819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/1960196694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":1960196694},{"type":"v1","addr":"172.21.15.141:6835","nonce":1960196694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2773454420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2773454420},{"type":"v1","addr":"172.21.15.114:6836","nonce":2773454420}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:19.359102+0000","modified":"2023-11-04T01:38:21.895586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6039":{"gid":6039,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2391405125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2391405125},{"type":"v1","addr":"172.21.15.114:6837","nonce":2391405125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:38:28.917 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 23 2023-11-04T01:38:28.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.917+0000 7fe4b211d640 1 -- 172.21.15.114:0/3976209895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe48c06aea0 msgr2=0x7fe48c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.917+0000 7fe4b211d640 1 --2- 172.21.15.114:0/3976209895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe48c06aea0 0x7fe48c06d360 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe49c033000 tx=0x7fe49c009030 comp rx=0 tx=0).stop 2023-11-04T01:38:28.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.917+0000 7fe4b211d640 1 -- 172.21.15.114:0/3976209895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4ac1518a0 msgr2=0x7fe4ac0c6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:28.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.917+0000 7fe4b211d640 1 --2- 172.21.15.114:0/3976209895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4ac1518a0 0x7fe4ac0c6350 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe4940018b0 tx=0x7fe4940074f0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.917+0000 7fe4b211d640 1 -- 172.21.15.114:0/3976209895 shutdown_connections 2023-11-04T01:38:28.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.917+0000 7fe4b211d640 1 --2- 172.21.15.114:0/3976209895 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe4ac0c6890 0x7fe4ac0c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.917+0000 7fe4b211d640 1 --2- 172.21.15.114:0/3976209895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4ac1518a0 0x7fe4ac0c6350 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.917+0000 7fe4b211d640 1 --2- 172.21.15.114:0/3976209895 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe48c06aea0 0x7fe48c06d360 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.917+0000 7fe4b211d640 1 --2- 172.21.15.114:0/3976209895 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe4980039a0 0x7fe4ac0d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:28.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.917+0000 7fe4b211d640 1 -- 172.21.15.114:0/3976209895 >> 172.21.15.114:0/3976209895 conn(0x7fe4ac06ea90 msgr2=0x7fe4ac0ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:28.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.917+0000 7fe4b211d640 1 -- 172.21.15.114:0/3976209895 shutdown_connections 2023-11-04T01:38:28.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:28.917+0000 7fe4b211d640 1 -- 172.21.15.114:0/3976209895 wait complete. 2023-11-04T01:38:29.334 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:38:19.359102+0000', 'modified': '2023-11-04T01:38:21.895586+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6039}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6039': {'gid': 6039, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6837/2391405125', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6835', 'nonce': 2391405125}, {'type': 'v1', 'addr': '172.21.15.114:6837', 'nonce': 2391405125}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:38:29.335 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:38:29.335 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:38:29.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.435+0000 7fefeddd7640 1 Processor -- start 2023-11-04T01:38:29.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.435+0000 7fefeddd7640 1 -- start start 2023-11-04T01:38:29.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.435+0000 7fefeddd7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fefe80cc9d0 0x7fefe80c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.435+0000 7fefeddd7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe80c3860 con 0x7fefe80cc520 2023-11-04T01:38:29.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.435+0000 7fefeddd7640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe80c9250 con 0x7fefe8153850 2023-11-04T01:38:29.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.435+0000 7fefeddd7640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe8153c30 con 0x7fefe80cc9d0 2023-11-04T01:38:29.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe6ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fefe80cc520 0x7fefe8070fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42440/0 (socket says 172.21.15.114:42440) 2023-11-04T01:38:29.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe6ffd640 1 -- 172.21.15.114:0/434649130 learned_addr learned my addr 172.21.15.114:0/434649130 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:29.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe67fc640 1 -- 172.21.15.114:0/434649130 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427974640 0 0) 0x7fefe80c3860 con 0x7fefe80cc520 2023-11-04T01:38:29.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe67fc640 1 -- 172.21.15.114:0/434649130 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd4004630 con 0x7fefe80cc520 2023-11-04T01:38:29.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe7fff640 1 --2- 172.21.15.114:0/434649130 >> v2:172.21.15.141:3300/0 conn(0x7fefe80cc9d0 0x7fefe80c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe67fc640 1 -- 172.21.15.114:0/434649130 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3139816771 0 0) 0x7fefd4004630 con 0x7fefe80cc520 2023-11-04T01:38:29.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe67fc640 1 -- 172.21.15.114:0/434649130 >> v2:172.21.15.141:3300/0 conn(0x7fefe80cc9d0 msgr2=0x7fefe80c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe67fc640 1 --2- 172.21.15.114:0/434649130 >> v2:172.21.15.141:3300/0 conn(0x7fefe80cc9d0 0x7fefe80c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe67fc640 1 -- 172.21.15.114:0/434649130 >> v1:172.21.15.141:6789/0 conn(0x7fefe8153850 legacy=0x7fefe815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe67fc640 1 -- 172.21.15.114:0/434649130 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe80ce590 con 0x7fefe80cc520 2023-11-04T01:38:29.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe67fc640 1 -- 172.21.15.114:0/434649130 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fefd0001670 con 0x7fefe80cc520 2023-11-04T01:38:29.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe67fc640 1 -- 172.21.15.114:0/434649130 >> v1:172.21.15.114:6789/0 conn(0x7fefe80cc520 legacy=0x7fefe8070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe67fc640 1 --2- 172.21.15.114:0/434649130 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefd4004a80 0x7fefd4004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe67fc640 1 --2- 172.21.15.114:0/434649130 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fefd40058d0 0x7fefd4005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe67fc640 1 --2- 172.21.15.114:0/434649130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd4006290 0x7fefd400ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe67fc640 1 -- 172.21.15.114:0/434649130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe8153c30 con 0x7fefd4006290 2023-11-04T01:38:29.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe67fc640 1 -- 172.21.15.114:0/434649130 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd400d130 con 0x7fefd40058d0 2023-11-04T01:38:29.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe67fc640 1 -- 172.21.15.114:0/434649130 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd400d2f0 con 0x7fefd4004a80 2023-11-04T01:38:29.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe7fff640 1 --2- 172.21.15.114:0/434649130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd4006290 0x7fefd400ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/434649130 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fefd40058d0 0x7fefd4005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.436+0000 7fefe77fe640 1 --2- 172.21.15.114:0/434649130 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefd4004a80 0x7fefd4004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.437+0000 7fefe7fff640 1 -- 172.21.15.114:0/434649130 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefd4004a80 msgr2=0x7fefd4004ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.437+0000 7fefe7fff640 1 --2- 172.21.15.114:0/434649130 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefd4004a80 0x7fefd4004ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.437+0000 7fefe7fff640 1 -- 172.21.15.114:0/434649130 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fefd40058d0 msgr2=0x7fefd4005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.437+0000 7fefe7fff640 1 --2- 172.21.15.114:0/434649130 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fefd40058d0 0x7fefd4005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.437+0000 7fefe7fff640 1 -- 172.21.15.114:0/434649130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd4004630 con 0x7fefd4006290 2023-11-04T01:38:29.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.437+0000 7fefe77fe640 1 --2- 172.21.15.114:0/434649130 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefd4004a80 0x7fefd4004ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:29.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.437+0000 7fefe7fff640 1 -- 172.21.15.114:0/434649130 reap_dead start 2023-11-04T01:38:29.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.437+0000 7fefe7fff640 1 --2- 172.21.15.114:0/434649130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd4006290 0x7fefd400ca90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009ac0 tx=0x7fefd4006900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a157555953ede969 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.437+0000 7fefe67fc640 1 -- 172.21.15.114:0/434649130 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe0004020 con 0x7fefd4006290 2023-11-04T01:38:29.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.437+0000 7fefe67fc640 1 -- 172.21.15.114:0/434649130 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe0004180 con 0x7fefd4006290 2023-11-04T01:38:29.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.437+0000 7fefe67fc640 1 -- 172.21.15.114:0/434649130 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe002c710 con 0x7fefd4006290 2023-11-04T01:38:29.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.438+0000 7fefeddd7640 1 -- 172.21.15.114:0/434649130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd4006290 msgr2=0x7fefd400ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.438+0000 7fefeddd7640 1 --2- 172.21.15.114:0/434649130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd4006290 0x7fefd400ca90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009ac0 tx=0x7fefd4006900 comp rx=0 tx=0).stop 2023-11-04T01:38:29.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.438+0000 7fefeddd7640 1 -- 172.21.15.114:0/434649130 shutdown_connections 2023-11-04T01:38:29.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.438+0000 7fefeddd7640 1 --2- 172.21.15.114:0/434649130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd4006290 0x7fefd400ca90 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.438+0000 7fefeddd7640 1 -- 172.21.15.114:0/434649130 >> 172.21.15.114:0/434649130 conn(0x7fefe80ce950 msgr2=0x7fefe80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:29.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.438+0000 7fefeddd7640 1 -- 172.21.15.114:0/434649130 shutdown_connections 2023-11-04T01:38:29.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.438+0000 7fefeddd7640 1 -- 172.21.15.114:0/434649130 wait complete. 2023-11-04T01:38:29.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.439+0000 7fefeddd7640 1 Processor -- start 2023-11-04T01:38:29.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.439+0000 7fefeddd7640 1 -- start start 2023-11-04T01:38:29.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefeddd7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd4006290 0x7fefe80c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefeddd7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fefe80c8170 0x7fefe80b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefeddd7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefe80b38b0 0x7fefe81f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefeddd7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe80c85f0 con 0x7fefd4006290 2023-11-04T01:38:29.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefeddd7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe81f06b0 con 0x7fefe80c8170 2023-11-04T01:38:29.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefeddd7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe81f0990 con 0x7fefe80b38b0 2023-11-04T01:38:29.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefe77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd4006290 0x7fefe80c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefe77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd4006290 0x7fefe80c7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59662/0 (socket says 172.21.15.114:59662) 2023-11-04T01:38:29.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefe77fe640 1 -- 172.21.15.114:0/79670318 learned_addr learned my addr 172.21.15.114:0/79670318 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:29.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefe7fff640 1 --2- 172.21.15.114:0/79670318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefe80b38b0 0x7fefe81f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/79670318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fefe80c8170 0x7fefe80b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefe77fe640 1 -- 172.21.15.114:0/79670318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefe80b38b0 msgr2=0x7fefe81f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefe77fe640 1 --2- 172.21.15.114:0/79670318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefe80b38b0 0x7fefe81f3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefe77fe640 1 -- 172.21.15.114:0/79670318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fefe80c8170 msgr2=0x7fefe80b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefe77fe640 1 --2- 172.21.15.114:0/79670318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fefe80c8170 0x7fefe80b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefe77fe640 1 -- 172.21.15.114:0/79670318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe81f0c70 con 0x7fefd4006290 2023-11-04T01:38:29.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefe7fff640 1 --2- 172.21.15.114:0/79670318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefe80b38b0 0x7fefe81f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:29.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.440+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/79670318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fefe80c8170 0x7fefe80b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:29.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.441+0000 7fefe77fe640 1 --2- 172.21.15.114:0/79670318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd4006290 0x7fefe80c7c30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fefd8002230 tx=0x7fefd800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.441+0000 7fefdffff640 1 -- 172.21.15.114:0/79670318 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8003b80 con 0x7fefd4006290 2023-11-04T01:38:29.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.441+0000 7fefdffff640 1 -- 172.21.15.114:0/79670318 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd8003ce0 con 0x7fefd4006290 2023-11-04T01:38:29.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.441+0000 7fefdffff640 1 -- 172.21.15.114:0/79670318 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8005310 con 0x7fefd4006290 2023-11-04T01:38:29.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.441+0000 7fefeddd7640 1 -- 172.21.15.114:0/79670318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe81f0f50 con 0x7fefd4006290 2023-11-04T01:38:29.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.441+0000 7fefeddd7640 1 -- 172.21.15.114:0/79670318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe814fc30 con 0x7fefd4006290 2023-11-04T01:38:29.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.442+0000 7fefdffff640 1 -- 172.21.15.114:0/79670318 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fefd8005470 con 0x7fefd4006290 2023-11-04T01:38:29.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.442+0000 7fefdffff640 1 --2- 172.21.15.114:0/79670318 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fefc806aea0 0x7fefc806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.443+0000 7fefdffff640 1 -- 172.21.15.114:0/79670318 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fefd8089920 con 0x7fefd4006290 2023-11-04T01:38:29.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.443+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/79670318 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fefc806aea0 0x7fefc806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.443+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/79670318 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fefc806aea0 0x7fefc806d360 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fefe80c5910 tx=0x7fefd0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.443+0000 7feff096b740 1 Processor -- start 2023-11-04T01:38:29.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.444+0000 7feff096b740 1 -- start start 2023-11-04T01:38:29.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.444+0000 7feff096b740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e3686b850 0x555e3683e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.444+0000 7feff096b740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e3686e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.444+0000 7feff096b740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e3683ec90 0x555e3686eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.444+0000 7feff096b740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e3674f740 con 0x555e3686bc30 2023-11-04T01:38:29.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.444+0000 7feff096b740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e367b18d0 con 0x555e3683ec90 2023-11-04T01:38:29.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.444+0000 7feff096b740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e367aefc0 con 0x555e3686b850 2023-11-04T01:38:29.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.444+0000 7fefe6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e3686e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.444+0000 7fefe6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e3686e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59666/0 (socket says 172.21.15.114:59666) 2023-11-04T01:38:29.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.444+0000 7fefe6ffd640 1 -- 172.21.15.114:0/3088151195 learned_addr learned my addr 172.21.15.114:0/3088151195 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:29.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.445+0000 7fefe77fe640 1 --2- 172.21.15.114:0/3088151195 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e3686b850 0x555e3683e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.445+0000 7fefe7fff640 1 --2- 172.21.15.114:0/3088151195 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e3683ec90 0x555e3686eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.445+0000 7fefe6ffd640 1 -- 172.21.15.114:0/3088151195 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e3686b850 msgr2=0x555e3683e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.445+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/3088151195 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e3686b850 0x555e3683e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.445+0000 7fefe6ffd640 1 -- 172.21.15.114:0/3088151195 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e3683ec90 msgr2=0x555e3686eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.445+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/3088151195 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e3683ec90 0x555e3686eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.445+0000 7fefe6ffd640 1 -- 172.21.15.114:0/3088151195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e3676dca0 con 0x555e3686bc30 2023-11-04T01:38:29.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.445+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/3088151195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e3686e5e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fefd0007e70 tx=0x7fefd0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83151fa93350f3da server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.445+0000 7fefdd7fa640 1 -- 172.21.15.114:0/3088151195 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0004e80 con 0x555e3686bc30 2023-11-04T01:38:29.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.445+0000 7fefdd7fa640 1 -- 172.21.15.114:0/3088151195 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd0015e40 con 0x555e3686bc30 2023-11-04T01:38:29.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.445+0000 7fefdd7fa640 1 -- 172.21.15.114:0/3088151195 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0021650 con 0x555e3686bc30 2023-11-04T01:38:29.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.446+0000 7feff096b740 1 -- 172.21.15.114:0/3088151195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 msgr2=0x555e3686e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.446+0000 7feff096b740 1 --2- 172.21.15.114:0/3088151195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e3686e5e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fefd0007e70 tx=0x7fefd0014000 comp rx=0 tx=0).stop 2023-11-04T01:38:29.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.446+0000 7feff096b740 1 -- 172.21.15.114:0/3088151195 shutdown_connections 2023-11-04T01:38:29.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.446+0000 7feff096b740 1 --2- 172.21.15.114:0/3088151195 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e3683ec90 0x555e3686eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.446+0000 7feff096b740 1 --2- 172.21.15.114:0/3088151195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e3686e5e0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.446+0000 7feff096b740 1 --2- 172.21.15.114:0/3088151195 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e3686b850 0x555e3683e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.446+0000 7feff096b740 1 -- 172.21.15.114:0/3088151195 >> 172.21.15.114:0/3088151195 conn(0x555e36840a60 msgr2=0x555e368895e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:29.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.446+0000 7feff096b740 1 -- 172.21.15.114:0/3088151195 shutdown_connections 2023-11-04T01:38:29.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.446+0000 7feff096b740 1 -- 172.21.15.114:0/3088151195 wait complete. 2023-11-04T01:38:29.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.446+0000 7feff096b740 1 -- start start 2023-11-04T01:38:29.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.446+0000 7feff096b740 1 Processor -- start 2023-11-04T01:38:29.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.447+0000 7feff096b740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e3686b850 0x555e3686d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.447+0000 7feff096b740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e368991f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.447+0000 7feff096b740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e3686deb0 0x555e36899730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.447+0000 7feff096b740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e367aa8b0 con 0x555e3686bc30 2023-11-04T01:38:29.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.447+0000 7feff096b740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e36764c80 con 0x555e3686deb0 2023-11-04T01:38:29.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.447+0000 7feff096b740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e36764920 con 0x555e3686b850 2023-11-04T01:38:29.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.447+0000 7feff096b740 10 client.0 _ll_register_callbacks cb 0x555e364bcac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:38:29.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.447+0000 7fefe6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e368991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.447+0000 7fefe6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e368991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59676/0 (socket says 172.21.15.114:59676) 2023-11-04T01:38:29.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.447+0000 7fefe6ffd640 1 -- 172.21.15.114:0/849790698 learned_addr learned my addr 172.21.15.114:0/849790698 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:29.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.447+0000 7fefe77fe640 1 --2- 172.21.15.114:0/849790698 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e3686b850 0x555e3686d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.447+0000 7fefe7fff640 1 --2- 172.21.15.114:0/849790698 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e3686deb0 0x555e36899730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7fefe6ffd640 1 -- 172.21.15.114:0/849790698 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e3686b850 msgr2=0x555e3686d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/849790698 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e3686b850 0x555e3686d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7fefe6ffd640 1 -- 172.21.15.114:0/849790698 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e3686deb0 msgr2=0x555e36899730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/849790698 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e3686deb0 0x555e36899730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7fefe6ffd640 1 -- 172.21.15.114:0/849790698 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe80ce590 con 0x555e3686bc30 2023-11-04T01:38:29.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/849790698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e368991f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fefd0015fd0 tx=0x7fefd0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3847b908fa0f5e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7fefc67fc640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:38:29.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7fefc67fc640 1 -- 172.21.15.114:0/849790698 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd002a420 con 0x555e3686bc30 2023-11-04T01:38:29.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7fefc67fc640 1 -- 172.21.15.114:0/849790698 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fefd001a030 con 0x555e3686bc30 2023-11-04T01:38:29.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7feff096b740 1 -- 172.21.15.114:0/849790698 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e36756bf0 con 0x555e3686bc30 2023-11-04T01:38:29.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7fefc67fc640 1 -- 172.21.15.114:0/849790698 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefd002a580 con 0x555e3686bc30 2023-11-04T01:38:29.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7feff096b740 10 client.6225 fetch_fsmap learned FSMap version 23 2023-11-04T01:38:29.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7feff096b740 1 -- 172.21.15.114:0/849790698 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x555e367a8f30 con 0x555e3686bc30 2023-11-04T01:38:29.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7fefc67fc640 1 -- 172.21.15.114:0/849790698 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd003b070 con 0x555e3686bc30 2023-11-04T01:38:29.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7fefc67fc640 1 -- 172.21.15.114:0/849790698 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fefd002a6e0 con 0x555e3686bc30 2023-11-04T01:38:29.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7feff096b740 10 client.6225 fetch_fsmap finished waiting for FSMap version 23 2023-11-04T01:38:29.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7feff096b740 10 client.6225 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:38:29.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7feff096b740 20 client.6225 populate_metadata read hostname 'smithi114' 2023-11-04T01:38:29.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7feff096b740 1 --2- 172.21.15.114:0/849790698 >> [v2:172.21.15.114:6835/2391405125,v1:172.21.15.114:6837/2391405125] conn(0x555e36866980 0x555e368a6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7feff096b740 4 client.6225 mds_command: new command op to 6039 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:38:29.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7feff096b740 1 -- 172.21.15.114:0/849790698 --> [v2:172.21.15.114:6835/2391405125,v1:172.21.15.114:6837/2391405125] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555e367a3890 con 0x555e36866980 2023-11-04T01:38:29.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.448+0000 7fefe77fe640 1 --2- 172.21.15.114:0/849790698 >> [v2:172.21.15.114:6835/2391405125,v1:172.21.15.114:6837/2391405125] conn(0x555e36866980 0x555e368a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.449+0000 7fefc67fc640 10 client.6225 ms_handle_connect on v2:172.21.15.114:6835/2391405125 2023-11-04T01:38:29.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.449+0000 7fefe77fe640 1 --2- 172.21.15.114:0/849790698 >> [v2:172.21.15.114:6835/2391405125,v1:172.21.15.114:6837/2391405125] conn(0x555e36866980 0x555e368a6970 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=475a20593e9c3483 server_cookie=444e78616649bbb3 in_seq=0 out_seq=0 2023-11-04T01:38:29.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.449+0000 7fefc67fc640 1 -- 172.21.15.114:0/849790698 <== mds.0 v2:172.21.15.114:6835/2391405125 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555e367a3890 con 0x555e36866980 2023-11-04T01:38:29.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.449+0000 7fefc67fc640 10 client.6225 handle_command_reply: tid=0 2023-11-04T01:38:29.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.449+0000 7feff096b740 1 client.6225 shutdown 2023-11-04T01:38:29.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.449+0000 7feff096b740 1 -- 172.21.15.114:0/849790698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 msgr2=0x555e368991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.449+0000 7feff096b740 1 --2- 172.21.15.114:0/849790698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e368991f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fefd0015fd0 tx=0x7fefd0001a00 comp rx=0 tx=0).stop 2023-11-04T01:38:29.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.449+0000 7feff096b740 1 -- 172.21.15.114:0/849790698 shutdown_connections 2023-11-04T01:38:29.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.449+0000 7feff096b740 1 --2- 172.21.15.114:0/849790698 >> [v2:172.21.15.114:6835/2391405125,v1:172.21.15.114:6837/2391405125] conn(0x555e36866980 0x555e368a6970 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.449+0000 7feff096b740 1 --2- 172.21.15.114:0/849790698 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e3686deb0 0x555e36899730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.449+0000 7feff096b740 1 --2- 172.21.15.114:0/849790698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e368991f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.449+0000 7fefc67fc640 0 client.6225 ms_handle_reset on v2:172.21.15.114:6835/2391405125 2023-11-04T01:38:29.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.449+0000 7feff096b740 1 --2- 172.21.15.114:0/849790698 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e3686b850 0x555e3686d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.449+0000 7feff096b740 1 -- 172.21.15.114:0/849790698 >> 172.21.15.114:0/849790698 conn(0x555e3683ec90 msgr2=0x555e3688d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:29.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.450+0000 7feff096b740 1 -- 172.21.15.114:0/849790698 shutdown_connections 2023-11-04T01:38:29.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.450+0000 7feff096b740 1 -- 172.21.15.114:0/849790698 wait complete. 2023-11-04T01:38:29.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.450+0000 7feff096b740 20 client.6225 trim_cache size 0 max 16384 2023-11-04T01:38:29.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.465+0000 7feff096b740 1 Processor -- start 2023-11-04T01:38:29.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.465+0000 7feff096b740 1 -- start start 2023-11-04T01:38:29.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.466+0000 7feff096b740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e3686b850 0x555e36865910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.466+0000 7feff096b740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e36865e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.466+0000 7feff096b740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e368e9f60 0x555e36869a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.466+0000 7feff096b740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e3672a280 con 0x555e3686bc30 2023-11-04T01:38:29.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.466+0000 7feff096b740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e368a8e70 con 0x555e3686b850 2023-11-04T01:38:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.466+0000 7feff096b740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e368816d0 con 0x555e368e9f60 2023-11-04T01:38:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.466+0000 7fefe6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e36865e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.466+0000 7fefe6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e36865e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59684/0 (socket says 172.21.15.114:59684) 2023-11-04T01:38:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.466+0000 7fefe6ffd640 1 -- 172.21.15.114:0/821639213 learned_addr learned my addr 172.21.15.114:0/821639213 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.466+0000 7fefe7fff640 1 --2- 172.21.15.114:0/821639213 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e368e9f60 0x555e36869a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.466+0000 7fefe77fe640 1 --2- 172.21.15.114:0/821639213 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e3686b850 0x555e36865910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.466+0000 7fefe6ffd640 1 -- 172.21.15.114:0/821639213 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e368e9f60 msgr2=0x555e36869a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.466+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/821639213 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e368e9f60 0x555e36869a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.466+0000 7fefe6ffd640 1 -- 172.21.15.114:0/821639213 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e3686b850 msgr2=0x555e36865910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.466+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/821639213 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e3686b850 0x555e36865910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.466+0000 7fefe6ffd640 1 -- 172.21.15.114:0/821639213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e36746d10 con 0x555e3686bc30 2023-11-04T01:38:29.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.467+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/821639213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e36865e50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fefd0007aa0 tx=0x7fefd002e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1410d8d66d406a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.467+0000 7fefddffb640 1 -- 172.21.15.114:0/821639213 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0021a50 con 0x555e3686bc30 2023-11-04T01:38:29.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.467+0000 7fefddffb640 1 -- 172.21.15.114:0/821639213 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd003b070 con 0x555e3686bc30 2023-11-04T01:38:29.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.467+0000 7fefddffb640 1 -- 172.21.15.114:0/821639213 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd002a620 con 0x555e3686bc30 2023-11-04T01:38:29.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.467+0000 7feff096b740 1 -- 172.21.15.114:0/821639213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 msgr2=0x555e36865e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.467+0000 7feff096b740 1 --2- 172.21.15.114:0/821639213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e36865e50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fefd0007aa0 tx=0x7fefd002e040 comp rx=0 tx=0).stop 2023-11-04T01:38:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.467+0000 7feff096b740 1 -- 172.21.15.114:0/821639213 shutdown_connections 2023-11-04T01:38:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.467+0000 7feff096b740 1 --2- 172.21.15.114:0/821639213 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e368e9f60 0x555e36869a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.467+0000 7feff096b740 1 --2- 172.21.15.114:0/821639213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e36865e50 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.467+0000 7feff096b740 1 --2- 172.21.15.114:0/821639213 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e3686b850 0x555e36865910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.467+0000 7feff096b740 1 -- 172.21.15.114:0/821639213 >> 172.21.15.114:0/821639213 conn(0x555e3683ec90 msgr2=0x555e3688c310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.467+0000 7feff096b740 1 -- 172.21.15.114:0/821639213 shutdown_connections 2023-11-04T01:38:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.467+0000 7feff096b740 1 -- 172.21.15.114:0/821639213 wait complete. 2023-11-04T01:38:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.468+0000 7feff096b740 1 -- start start 2023-11-04T01:38:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.468+0000 7feff096b740 1 Processor -- start 2023-11-04T01:38:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7feff096b740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e3686b850 0x555e368e59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7feff096b740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e368d5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7feff096b740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e368e9f60 0x555e36865910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7feff096b740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e3688d500 con 0x555e3686bc30 2023-11-04T01:38:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7feff096b740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e368e5f30 con 0x555e368e9f60 2023-11-04T01:38:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7feff096b740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e368d5c60 con 0x555e3686b850 2023-11-04T01:38:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7feff096b740 10 client.0 _ll_register_callbacks cb 0x7fefd40057d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:38:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7fefe6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e368d5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7fefe6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e368d5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59688/0 (socket says 172.21.15.114:59688) 2023-11-04T01:38:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7fefe6ffd640 1 -- 172.21.15.114:0/431166522 learned_addr learned my addr 172.21.15.114:0/431166522 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7fefe77fe640 1 --2- 172.21.15.114:0/431166522 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e3686b850 0x555e368e59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7fefe7fff640 1 --2- 172.21.15.114:0/431166522 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e368e9f60 0x555e36865910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7fefe6ffd640 1 -- 172.21.15.114:0/431166522 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e3686b850 msgr2=0x555e368e59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/431166522 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e3686b850 0x555e368e59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7fefe6ffd640 1 -- 172.21.15.114:0/431166522 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e368e9f60 msgr2=0x555e36865910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/431166522 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e368e9f60 0x555e36865910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7fefe6ffd640 1 -- 172.21.15.114:0/431166522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e367a8f30 con 0x555e3686bc30 2023-11-04T01:38:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7fefe6ffd640 1 --2- 172.21.15.114:0/431166522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e368d5720 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fefd0039040 tx=0x7fefd000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40423b2af76d224b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.469+0000 7fefc67fc640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:38:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7fefc67fc640 1 -- 172.21.15.114:0/431166522 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd002ad10 con 0x555e3686bc30 2023-11-04T01:38:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7fefc67fc640 1 -- 172.21.15.114:0/431166522 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fefd001a070 con 0x555e3686bc30 2023-11-04T01:38:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7feff096b740 1 -- 172.21.15.114:0/431166522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fefd0015e40 con 0x555e3686bc30 2023-11-04T01:38:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7fefc67fc640 1 -- 172.21.15.114:0/431166522 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefd0015c90 con 0x555e3686bc30 2023-11-04T01:38:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7feff096b740 10 client.6231 fetch_fsmap learned FSMap version 23 2023-11-04T01:38:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7feff096b740 1 -- 172.21.15.114:0/431166522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x555e3676c500 con 0x555e3686bc30 2023-11-04T01:38:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7fefc67fc640 1 -- 172.21.15.114:0/431166522 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd0015e40 con 0x555e3686bc30 2023-11-04T01:38:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7fefc67fc640 1 -- 172.21.15.114:0/431166522 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fefd002a620 con 0x555e3686bc30 2023-11-04T01:38:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7feff096b740 10 client.6231 fetch_fsmap finished waiting for FSMap version 23 2023-11-04T01:38:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7feff096b740 10 client.6231 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:38:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7feff096b740 20 client.6231 populate_metadata read hostname 'smithi114' 2023-11-04T01:38:29.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7feff096b740 1 --2- 172.21.15.114:0/431166522 >> [v2:172.21.15.114:6835/2391405125,v1:172.21.15.114:6837/2391405125] conn(0x555e368d9360 0x555e368d9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7feff096b740 4 client.6231 mds_command: new command op to 6039 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:38:29.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7feff096b740 1 -- 172.21.15.114:0/431166522 --> [v2:172.21.15.114:6835/2391405125,v1:172.21.15.114:6837/2391405125] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555e367a35b0 con 0x555e368d9360 2023-11-04T01:38:29.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7fefe77fe640 1 --2- 172.21.15.114:0/431166522 >> [v2:172.21.15.114:6835/2391405125,v1:172.21.15.114:6837/2391405125] conn(0x555e368d9360 0x555e368d9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7fefc67fc640 10 client.6231 ms_handle_connect on v2:172.21.15.114:6835/2391405125 2023-11-04T01:38:29.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.470+0000 7fefe77fe640 1 --2- 172.21.15.114:0/431166522 >> [v2:172.21.15.114:6835/2391405125,v1:172.21.15.114:6837/2391405125] conn(0x555e368d9360 0x555e368d9740 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3b84e54635ef987 server_cookie=c1c86e9c948d6600 in_seq=0 out_seq=0 2023-11-04T01:38:29.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7fefc67fc640 1 -- 172.21.15.114:0/431166522 <== mds.0 v2:172.21.15.114:6835/2391405125 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x555e367a35b0 con 0x555e368d9360 2023-11-04T01:38:29.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7fefc67fc640 10 client.6231 handle_command_reply: tid=0 2023-11-04T01:38:29.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7feff096b740 1 client.6231 shutdown 2023-11-04T01:38:29.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7feff096b740 1 -- 172.21.15.114:0/431166522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 msgr2=0x555e368d5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7feff096b740 1 --2- 172.21.15.114:0/431166522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e368d5720 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fefd0039040 tx=0x7fefd000c000 comp rx=0 tx=0).stop 2023-11-04T01:38:29.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7feff096b740 1 -- 172.21.15.114:0/431166522 shutdown_connections 2023-11-04T01:38:29.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7feff096b740 1 --2- 172.21.15.114:0/431166522 >> [v2:172.21.15.114:6835/2391405125,v1:172.21.15.114:6837/2391405125] conn(0x555e368d9360 0x555e368d9740 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7feff096b740 1 --2- 172.21.15.114:0/431166522 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x555e368e9f60 0x555e36865910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7fefc67fc640 0 client.6231 ms_handle_reset on v2:172.21.15.114:6835/2391405125 2023-11-04T01:38:29.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7feff096b740 1 --2- 172.21.15.114:0/431166522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555e3686bc30 0x555e368d5720 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7feff096b740 1 --2- 172.21.15.114:0/431166522 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x555e3686b850 0x555e368e59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7feff096b740 1 -- 172.21.15.114:0/431166522 >> 172.21.15.114:0/431166522 conn(0x555e3683ec90 msgr2=0x555e36839c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:29.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7feff096b740 1 -- 172.21.15.114:0/431166522 shutdown_connections 2023-11-04T01:38:29.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7feff096b740 1 -- 172.21.15.114:0/431166522 wait complete. 2023-11-04T01:38:29.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7feff096b740 20 client.6231 trim_cache size 0 max 16384 2023-11-04T01:38:29.488 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:38:29.488 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:38:29.488 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-11-04T01:38:29.488 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 6039, 2023-11-04T01:38:29.488 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:38:29.488 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:38:29.488 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:38:29.488 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 9.4413581349999998, 2023-11-04T01:38:29.488 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 23, 2023-11-04T01:38:29.488 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 54, 2023-11-04T01:38:29.488 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 54, 2023-11-04T01:38:29.489 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 14.518676459 2023-11-04T01:38:29.489 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:38:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7fefeddd7640 1 -- 172.21.15.114:0/79670318 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fefc806aea0 msgr2=0x7fefc806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7fefeddd7640 1 --2- 172.21.15.114:0/79670318 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fefc806aea0 0x7fefc806d360 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fefe80c5910 tx=0x7fefd0009040 comp rx=0 tx=0).stop 2023-11-04T01:38:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7fefeddd7640 1 -- 172.21.15.114:0/79670318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd4006290 msgr2=0x7fefe80c7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7fefeddd7640 1 --2- 172.21.15.114:0/79670318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd4006290 0x7fefe80c7c30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fefd8002230 tx=0x7fefd800ec80 comp rx=0 tx=0).stop 2023-11-04T01:38:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7fefeddd7640 1 -- 172.21.15.114:0/79670318 shutdown_connections 2023-11-04T01:38:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7fefeddd7640 1 --2- 172.21.15.114:0/79670318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fefe80b38b0 0x7fefe81f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7fefeddd7640 1 --2- 172.21.15.114:0/79670318 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fefc806aea0 0x7fefc806d360 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7fefeddd7640 1 --2- 172.21.15.114:0/79670318 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fefe80c8170 0x7fefe80b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7fefeddd7640 1 --2- 172.21.15.114:0/79670318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd4006290 0x7fefe80c7c30 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.471+0000 7fefeddd7640 1 -- 172.21.15.114:0/79670318 >> 172.21.15.114:0/79670318 conn(0x7fefe80ce950 msgr2=0x7fefe806d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.472+0000 7fefeddd7640 1 -- 172.21.15.114:0/79670318 shutdown_connections 2023-11-04T01:38:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.472+0000 7fefeddd7640 1 -- 172.21.15.114:0/79670318 wait complete. 2023-11-04T01:38:29.491 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:38:29.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.589+0000 7f6e27b33640 1 Processor -- start 2023-11-04T01:38:29.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.589+0000 7f6e27b33640 1 -- start start 2023-11-04T01:38:29.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.590+0000 7f6e27b33640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e20159c70 0x7f6e200ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.590+0000 7f6e27b33640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e2006db20 0x7f6e200b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.590+0000 7f6e27b33640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e200b4110 con 0x7f6e200b0910 2023-11-04T01:38:29.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.590+0000 7f6e27b33640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e200b49b0 con 0x7f6e2006db20 2023-11-04T01:38:29.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.590+0000 7f6e27b33640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e200b0da0 con 0x7f6e20159c70 2023-11-04T01:38:29.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.590+0000 7f6e250ce640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e2006db20 0x7f6e200b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.590+0000 7f6e250ce640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e2006db20 0x7f6e200b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59698/0 (socket says 172.21.15.114:59698) 2023-11-04T01:38:29.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.590+0000 7f6e250ce640 1 -- 172.21.15.114:0/2950780205 learned_addr learned my addr 172.21.15.114:0/2950780205 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:29.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.590+0000 7f6e258cf640 1 --2- 172.21.15.114:0/2950780205 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e20159c70 0x7f6e200ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.590+0000 7f6e250ce640 1 -- 172.21.15.114:0/2950780205 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e20159c70 msgr2=0x7f6e200ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.590+0000 7f6e250ce640 1 --2- 172.21.15.114:0/2950780205 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e20159c70 0x7f6e200ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.590+0000 7f6e250ce640 1 -- 172.21.15.114:0/2950780205 >> v1:172.21.15.141:6789/0 conn(0x7f6e200b0910 legacy=0x7f6e2015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:29.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.590+0000 7f6e250ce640 1 -- 172.21.15.114:0/2950780205 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e200b43f0 con 0x7f6e2006db20 2023-11-04T01:38:29.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.591+0000 7f6e250ce640 1 --2- 172.21.15.114:0/2950780205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2006db20 0x7f6e200b03d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009870 tx=0x7f6e1002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0ece8319f56c62 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.591+0000 7f6e248cd640 1 -- 172.21.15.114:0/2950780205 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10031640 con 0x7f6e2006db20 2023-11-04T01:38:29.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.591+0000 7f6e248cd640 1 -- 172.21.15.114:0/2950780205 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e100317a0 con 0x7f6e2006db20 2023-11-04T01:38:29.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.591+0000 7f6e248cd640 1 -- 172.21.15.114:0/2950780205 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10031b30 con 0x7f6e2006db20 2023-11-04T01:38:29.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.591+0000 7f6e27b33640 1 -- 172.21.15.114:0/2950780205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2006db20 msgr2=0x7f6e200b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.591+0000 7f6e27b33640 1 --2- 172.21.15.114:0/2950780205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2006db20 0x7f6e200b03d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009870 tx=0x7f6e1002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.592+0000 7f6e27b33640 1 -- 172.21.15.114:0/2950780205 shutdown_connections 2023-11-04T01:38:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.592+0000 7f6e27b33640 1 --2- 172.21.15.114:0/2950780205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2006db20 0x7f6e200b03d0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.592+0000 7f6e27b33640 1 --2- 172.21.15.114:0/2950780205 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e20159c70 0x7f6e200ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.592+0000 7f6e27b33640 1 -- 172.21.15.114:0/2950780205 >> 172.21.15.114:0/2950780205 conn(0x7f6e200ce950 msgr2=0x7f6e200ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.592+0000 7f6e27b33640 1 -- 172.21.15.114:0/2950780205 shutdown_connections 2023-11-04T01:38:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.592+0000 7f6e27b33640 1 -- 172.21.15.114:0/2950780205 wait complete. 2023-11-04T01:38:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.593+0000 7f6e27b33640 1 Processor -- start 2023-11-04T01:38:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.593+0000 7f6e27b33640 1 -- start start 2023-11-04T01:38:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.593+0000 7f6e27b33640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2006db20 0x7f6e200c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.593+0000 7f6e27b33640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e200b0910 0x7f6e200b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.593+0000 7f6e27b33640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e20159c70 0x7f6e2015a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.593+0000 7f6e27b33640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e200aded0 con 0x7f6e2006db20 2023-11-04T01:38:29.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.593+0000 7f6e27b33640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e200c7a60 con 0x7f6e200b0910 2023-11-04T01:38:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.593+0000 7f6e27b33640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e200c7ce0 con 0x7f6e20159c70 2023-11-04T01:38:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e258cf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2006db20 0x7f6e200c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e258cf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2006db20 0x7f6e200c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59710/0 (socket says 172.21.15.114:59710) 2023-11-04T01:38:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e258cf640 1 -- 172.21.15.114:0/3180227047 learned_addr learned my addr 172.21.15.114:0/3180227047 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e260d0640 1 --2- 172.21.15.114:0/3180227047 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e20159c70 0x7f6e2015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e250ce640 1 --2- 172.21.15.114:0/3180227047 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e200b0910 0x7f6e200b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e258cf640 1 -- 172.21.15.114:0/3180227047 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e20159c70 msgr2=0x7f6e2015a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e258cf640 1 --2- 172.21.15.114:0/3180227047 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e20159c70 0x7f6e2015a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e258cf640 1 -- 172.21.15.114:0/3180227047 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e200b0910 msgr2=0x7f6e200b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e258cf640 1 --2- 172.21.15.114:0/3180227047 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e200b0910 0x7f6e200b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e258cf640 1 -- 172.21.15.114:0/3180227047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e100094d0 con 0x7f6e2006db20 2023-11-04T01:38:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e260d0640 1 --2- 172.21.15.114:0/3180227047 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e20159c70 0x7f6e2015a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e258cf640 1 --2- 172.21.15.114:0/3180227047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2006db20 0x7f6e200c7520 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00c7f0 tx=0x7f6e1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e167fc640 1 -- 172.21.15.114:0/3180227047 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c004220 con 0x7f6e2006db20 2023-11-04T01:38:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e167fc640 1 -- 172.21.15.114:0/3180227047 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c0043a0 con 0x7f6e2006db20 2023-11-04T01:38:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e167fc640 1 -- 172.21.15.114:0/3180227047 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c007860 con 0x7f6e2006db20 2023-11-04T01:38:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e27b33640 1 -- 172.21.15.114:0/3180227047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e200c7fc0 con 0x7f6e2006db20 2023-11-04T01:38:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.594+0000 7f6e27b33640 1 -- 172.21.15.114:0/3180227047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e200ae0e0 con 0x7f6e2006db20 2023-11-04T01:38:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.595+0000 7f6e27b33640 1 -- 172.21.15.114:0/3180227047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e200c84e0 con 0x7f6e2006db20 2023-11-04T01:38:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.595+0000 7f6e167fc640 1 -- 172.21.15.114:0/3180227047 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e1c007bd0 con 0x7f6e2006db20 2023-11-04T01:38:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.596+0000 7f6e167fc640 1 --2- 172.21.15.114:0/3180227047 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e0406ae70 0x7f6e0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.596+0000 7f6e250ce640 1 --2- 172.21.15.114:0/3180227047 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e0406ae70 0x7f6e0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.596+0000 7f6e167fc640 1 -- 172.21.15.114:0/3180227047 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6e1c089850 con 0x7f6e2006db20 2023-11-04T01:38:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.596+0000 7f6e250ce640 1 --2- 172.21.15.114:0/3180227047 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e0406ae70 0x7f6e0406d330 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6e10036000 tx=0x7f6e1003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.600+0000 7f6e167fc640 1 -- 172.21.15.114:0/3180227047 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e1c054660 con 0x7f6e2006db20 2023-11-04T01:38:29.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.805+0000 7f6e27b33640 1 -- 172.21.15.114:0/3180227047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6e20074290 con 0x7f6e2006db20 2023-11-04T01:38:29.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.805+0000 7f6e167fc640 1 -- 172.21.15.114:0/3180227047 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6e1c01e070 con 0x7f6e2006db20 2023-11-04T01:38:29.807 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:38:29.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.807+0000 7f6e27b33640 1 -- 172.21.15.114:0/3180227047 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e0406ae70 msgr2=0x7f6e0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.807+0000 7f6e27b33640 1 --2- 172.21.15.114:0/3180227047 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e0406ae70 0x7f6e0406d330 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6e10036000 tx=0x7f6e1003c040 comp rx=0 tx=0).stop 2023-11-04T01:38:29.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.807+0000 7f6e27b33640 1 -- 172.21.15.114:0/3180227047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2006db20 msgr2=0x7f6e200c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:29.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.807+0000 7f6e27b33640 1 --2- 172.21.15.114:0/3180227047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2006db20 0x7f6e200c7520 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00c7f0 tx=0x7f6e1c00ccb0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.807+0000 7f6e27b33640 1 -- 172.21.15.114:0/3180227047 shutdown_connections 2023-11-04T01:38:29.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.807+0000 7f6e27b33640 1 --2- 172.21.15.114:0/3180227047 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e20159c70 0x7f6e2015a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.807+0000 7f6e27b33640 1 --2- 172.21.15.114:0/3180227047 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e0406ae70 0x7f6e0406d330 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.807+0000 7f6e27b33640 1 --2- 172.21.15.114:0/3180227047 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e200b0910 0x7f6e200b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.807+0000 7f6e27b33640 1 --2- 172.21.15.114:0/3180227047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2006db20 0x7f6e200c7520 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:29.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.807+0000 7f6e27b33640 1 -- 172.21.15.114:0/3180227047 >> 172.21.15.114:0/3180227047 conn(0x7f6e200ce950 msgr2=0x7f6e200b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:29.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.807+0000 7f6e27b33640 1 -- 172.21.15.114:0/3180227047 shutdown_connections 2023-11-04T01:38:29.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:29.807+0000 7f6e27b33640 1 -- 172.21.15.114:0/3180227047 wait complete. 2023-11-04T01:38:29.819 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:38:29.819 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:38:29.820 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-11-04T01:38:29.820 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:38:29.820 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:29.820 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:38:29.820 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:38:29.820 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:38:29.820 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:29.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:29.820 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-11-04T01:38:29.835 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:38:29.835 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:38:29.835 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:38:29.836 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:29.836 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-04T01:38:29.836 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:29.836 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:29.836 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:29.836 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-11-04T01:38:29.836 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:29.836 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:29.836 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-11-04T01:38:29.836 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:29.836 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:29.837 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:38:29.837 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:29.837 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:38:29.837 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42366sec preferred_lft 42366sec 2023-11-04T01:38:29.837 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-11-04T01:38:29.837 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:29.837 INFO:teuthology.orchestra.run.smithi114.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:38:29.837 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 7e:72:41:ca:70:95 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:29.837 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:38:29.837 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:29.837 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9c8d:d6ff:fe6f:d555/64 scope link 2023-11-04T01:38:29.837 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:29.837 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:38:29.838 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether f6:4c:1e:67:08:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:29.838 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::f44c:1eff:fe67:85a/64 scope link 2023-11-04T01:38:29.838 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:29.838 INFO:teuthology.orchestra.run.smithi114.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:38:29.838 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 7e:72:41:ca:70:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:29.838 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::7c72:41ff:feca:7095/64 scope link 2023-11-04T01:38:29.838 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:29.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:29.839 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:38:29.903 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-11-04T01:38:29.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:29.903 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-11-04T01:38:29.959 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-11-04T01:38:29.959 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:38:29.959 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:38:29.960 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:38:29.960 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:38:29.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:29.960 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:38:29.960 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:38:29.960 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:38:29.960 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:38:29.960 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:38:29.960 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:38:30.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:30.054 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-04T01:38:30.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:38:30.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:38:30.071 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:30.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:30.071 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-11-04T01:38:30.137 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:38:30.137 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:38:30.137 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:30.192 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:30.192 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:38:30.193 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:30.247 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:30.302 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:38:30.302 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:38:30.302 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:38:30.302 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:38:30.302 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:38:30.302 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:38:30.303 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:38:30.303 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:38:30.303 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:38:30.303 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:38:30.303 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:38:30.303 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:38:30.303 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:30.303 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:38:30.303 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:38:30.303 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:38:30.303 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:38:30.303 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:30.303 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:30.304 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:38:30.304 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:30.304 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:30.304 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:30.304 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:38:30.304 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:38:30.304 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:30.304 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:30.304 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:30.304 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:30.304 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:38:30.305 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:30.305 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:30.305 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:30.305 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:30.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:30.305 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:38:30.358 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:38:30.358 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:38:30.400 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:30.415 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:38:30.415 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:38:30.415 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:38:30.415 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:38:30.415 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:38:30.415 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:38:30.415 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:38:30.415 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:38:30.416 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:38:30.416 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:38:30.416 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:38:30.416 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:38:30.416 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:30.416 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:38:30.416 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:38:30.416 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:38:30.416 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:38:30.416 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:30.416 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:30.416 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:38:30.416 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:30.417 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:30.417 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:30.417 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:38:30.417 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:38:30.417 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:30.417 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:30.417 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:30.417 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:30.417 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:38:30.417 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:30.417 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:30.417 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:30.417 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:30.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:30.418 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:38:30.490 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:38:30.488+0000 7f8790237480 -1 init, newargv = 0x55a75388aa10 newargc=15 2023-11-04T01:38:30.490 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[108452]: starting ceph client 2023-11-04T01:38:30.494 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[108452]: starting fuse 2023-11-04T01:38:31.571 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:31.591 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:38:31.591 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:38:31.591 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:38:31.592 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:38:31.592 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:38:31.592 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:38:31.592 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:38:31.592 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:38:31.592 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:38:31.592 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:38:31.592 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:38:31.592 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:38:31.592 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:31.592 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:38:31.592 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:38:31.592 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:38:31.593 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:38:31.593 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:31.593 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:31.593 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:38:31.593 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:31.593 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:31.593 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:31.593 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:38:31.593 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:38:31.593 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:31.593 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:31.593 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:31.593 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:31.594 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:38:31.594 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:31.594 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:31.594 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:31.594 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:31.594 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:31.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:31.594 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:38:31.649 INFO:teuthology.orchestra.run.smithi114.stdout:41 2023-11-04T01:38:31.650 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:38:31.650 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:38:31.650 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2023-11-04T01:38:31.650 DEBUG:teuthology.orchestra.run.smithi114:> import re 2023-11-04T01:38:31.650 DEBUG:teuthology.orchestra.run.smithi114:> import os 2023-11-04T01:38:31.650 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2023-11-04T01:38:31.650 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:38:31.650 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2023-11-04T01:38:31.650 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:38:31.651 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2023-11-04T01:38:31.651 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:38:31.651 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:38:31.651 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2023-11-04T01:38:31.651 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2023-11-04T01:38:31.651 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2023-11-04T01:38:31.651 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2023-11-04T01:38:31.651 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:38:31.651 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2023-11-04T01:38:31.651 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:38:31.651 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:38:31.651 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:38:31.651 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2023-11-04T01:38:31.651 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2023-11-04T01:38:31.652 DEBUG:teuthology.orchestra.run.smithi114:> return f 2023-11-04T01:38:31.652 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:38:31.652 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:38:31.652 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.0")) 2023-11-04T01:38:31.652 DEBUG:teuthology.orchestra.run.smithi114:> ' 2023-11-04T01:38:31.777 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.0.108452.asok 2023-11-04T01:38:31.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:31.788 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.108452.asok 2023-11-04T01:38:31.788 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:31.788 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.108452.asok status 2023-11-04T01:38:31.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:31.955 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:38:31.955 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2023-11-04T01:38:31.956 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:38:31.956 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:38:31.956 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "0", 2023-11-04T01:38:31.956 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2023-11-04T01:38:31.956 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:38:31.956 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "108452", 2023-11-04T01:38:31.956 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2023-11-04T01:38:31.956 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:31.956 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 6243, 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 6243 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:38:31.957 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2694578881 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2694578881 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.6243 192.168.0.1:0/2694578881", 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "192.168.0.1:0/2694578881", 2023-11-04T01:38:31.958 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2023-11-04T01:38:31.959 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 23, 2023-11-04T01:38:31.959 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 54, 2023-11-04T01:38:31.959 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:38:31.959 INFO:teuthology.orchestra.run.smithi114.stdout: "blocklisted": false, 2023-11-04T01:38:31.959 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2023-11-04T01:38:31.959 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:38:31.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:31.969 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:31.970 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:38:31.970 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:32.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:32.028 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2023-11-04T01:38:32.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:32.035 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:32.035 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:32.035 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:32.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:32.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:32.101 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data mksnap snap1 2023-11-04T01:38:32.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.139+0000 7f8ecb63bf40 1 Processor -- start 2023-11-04T01:38:32.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.139+0000 7f8ecb63bf40 1 -- start start 2023-11-04T01:38:32.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ecb63bf40 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55deda889050 0x55deda889640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ecb63bf40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55deda8a8710 0x55deda889b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ecb63bf40 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55deda933860 0x55deda934550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ecb63bf40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deda80d3b0 con 0x55deda8a8710 2023-11-04T01:38:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ecb63bf40 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deda7a7650 con 0x55deda933860 2023-11-04T01:38:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ecb63bf40 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55deda7a72f0 con 0x55deda889050 2023-11-04T01:38:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ec817a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55deda8a8710 0x55deda889b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ec817a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55deda8a8710 0x55deda889b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59718/0 (socket says 172.21.15.114:59718) 2023-11-04T01:38:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ec817a640 1 -- 172.21.15.114:0/714098910 learned_addr learned my addr 172.21.15.114:0/714098910 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ec817a640 1 -- 172.21.15.114:0/714098910 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55deda889050 msgr2=0x55deda889640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ec817a640 1 --2- 172.21.15.114:0/714098910 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55deda889050 0x55deda889640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ec817a640 1 -- 172.21.15.114:0/714098910 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55deda933860 msgr2=0x55deda934550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ec817a640 1 --2- 172.21.15.114:0/714098910 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55deda933860 0x55deda934550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ec817a640 1 -- 172.21.15.114:0/714098910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ebc005de0 con 0x55deda8a8710 2023-11-04T01:38:32.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ec817a640 1 --2- 172.21.15.114:0/714098910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55deda8a8710 0x55deda889b80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0444d0 tx=0x7f8ebc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc89e4ba501c7e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:32.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ec7178640 1 -- 172.21.15.114:0/714098910 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc052440 con 0x55deda8a8710 2023-11-04T01:38:32.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ec7178640 1 -- 172.21.15.114:0/714098910 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc0525a0 con 0x55deda8a8710 2023-11-04T01:38:32.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.140+0000 7f8ec7178640 1 -- 172.21.15.114:0/714098910 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc052930 con 0x55deda8a8710 2023-11-04T01:38:32.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.141+0000 7f8ecb63bf40 1 -- 172.21.15.114:0/714098910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55deda8a8710 msgr2=0x55deda889b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.141+0000 7f8ecb63bf40 1 --2- 172.21.15.114:0/714098910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55deda8a8710 0x55deda889b80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0444d0 tx=0x7f8ebc04c000 comp rx=0 tx=0).stop 2023-11-04T01:38:32.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.141+0000 7f8ecb63bf40 1 -- 172.21.15.114:0/714098910 shutdown_connections 2023-11-04T01:38:32.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.141+0000 7f8ecb63bf40 1 --2- 172.21.15.114:0/714098910 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55deda933860 0x55deda934550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.141+0000 7f8ecb63bf40 1 --2- 172.21.15.114:0/714098910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55deda8a8710 0x55deda889b80 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.141+0000 7f8ecb63bf40 1 --2- 172.21.15.114:0/714098910 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55deda889050 0x55deda889640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.141+0000 7f8ecb63bf40 1 -- 172.21.15.114:0/714098910 >> 172.21.15.114:0/714098910 conn(0x55deda8a6670 msgr2=0x55deda8a73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:32.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.141+0000 7f8ecb63bf40 1 -- 172.21.15.114:0/714098910 shutdown_connections 2023-11-04T01:38:32.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.141+0000 7f8ecb63bf40 1 -- 172.21.15.114:0/714098910 wait complete. 2023-11-04T01:38:32.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.141+0000 7f8ecb63bf40 1 Processor -- start 2023-11-04T01:38:32.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.141+0000 7f8ecb63bf40 1 -- start start 2023-11-04T01:38:32.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.142+0000 7f8ecb63bf40 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55deda889050 0x55deda88ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.142+0000 7f8ecb63bf40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55deda8a8710 0x55deda8a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.142+0000 7f8ecb63bf40 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55deda933860 0x55deda8a2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.142+0000 7f8ecb63bf40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deda7874f0 con 0x55deda8a8710 2023-11-04T01:38:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.142+0000 7f8ecb63bf40 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deda88d110 con 0x55deda889050 2023-11-04T01:38:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.142+0000 7f8ecb63bf40 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55deda927aa0 con 0x55deda933860 2023-11-04T01:38:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.142+0000 7f8ec817a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55deda8a8710 0x55deda8a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.142+0000 7f8ec817a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55deda8a8710 0x55deda8a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59724/0 (socket says 172.21.15.114:59724) 2023-11-04T01:38:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.142+0000 7f8ec817a640 1 -- 172.21.15.114:0/411555428 learned_addr learned my addr 172.21.15.114:0/411555428 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.142+0000 7f8ec897b640 1 --2- 172.21.15.114:0/411555428 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55deda889050 0x55deda88ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.142+0000 7f8ec917c640 1 --2- 172.21.15.114:0/411555428 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55deda933860 0x55deda8a2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.143+0000 7f8ec817a640 1 -- 172.21.15.114:0/411555428 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55deda933860 msgr2=0x55deda8a2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.143+0000 7f8ec817a640 1 --2- 172.21.15.114:0/411555428 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55deda933860 0x55deda8a2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.143+0000 7f8ec817a640 1 -- 172.21.15.114:0/411555428 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55deda889050 msgr2=0x55deda88ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.143+0000 7f8ec817a640 1 --2- 172.21.15.114:0/411555428 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55deda889050 0x55deda88ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.143+0000 7f8ec817a640 1 -- 172.21.15.114:0/411555428 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55deda7cd770 con 0x55deda8a8710 2023-11-04T01:38:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.143+0000 7f8ec897b640 1 --2- 172.21.15.114:0/411555428 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55deda889050 0x55deda88ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:32.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.143+0000 7f8ec817a640 1 --2- 172.21.15.114:0/411555428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55deda8a8710 0x55deda8a0aa0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00a4f0 tx=0x7f8ebc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:32.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.143+0000 7f8ec6176640 1 -- 172.21.15.114:0/411555428 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc052c60 con 0x55deda8a8710 2023-11-04T01:38:32.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.143+0000 7f8ec6176640 1 -- 172.21.15.114:0/411555428 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc052de0 con 0x55deda8a8710 2023-11-04T01:38:32.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.143+0000 7f8ec6176640 1 -- 172.21.15.114:0/411555428 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc06d670 con 0x55deda8a8710 2023-11-04T01:38:32.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.143+0000 7f8ecb63bf40 1 -- 172.21.15.114:0/411555428 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55deda7b3780 con 0x55deda8a8710 2023-11-04T01:38:32.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.143+0000 7f8ecb63bf40 1 -- 172.21.15.114:0/411555428 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55deda7a6930 con 0x55deda8a8710 2023-11-04T01:38:32.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.144+0000 7f8ec6176640 1 -- 172.21.15.114:0/411555428 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8ebc06d7d0 con 0x55deda8a8710 2023-11-04T01:38:32.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.144+0000 7f8ec6176640 1 --2- 172.21.15.114:0/411555428 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8eb4069820 0x7f8eb406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ec6176640 1 -- 172.21.15.114:0/411555428 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8ebc0cafd0 con 0x55deda8a8710 2023-11-04T01:38:32.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ec897b640 1 --2- 172.21.15.114:0/411555428 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8eb4069820 0x7f8eb406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ecb63bf40 1 -- 172.21.15.114:0/411555428 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- pool_op(create snap pool 9 tid 1 name snap1 v0) v4 -- 0x55deda817330 con 0x55deda8a8710 2023-11-04T01:38:32.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ec6176640 1 -- 172.21.15.114:0/411555428 <== mon.0 v2:172.21.15.114:3300/0 6 ==== pool_op_reply(tid 1 (95) Operation not supported v54) v1 ==== 43+0+0 (secure 0 0 0) 0x7f8ebc095e70 con 0x55deda8a8710 2023-11-04T01:38:32.153 INFO:teuthology.orchestra.run.smithi114.stderr:error creating pool cephfs_data snapshot snap1: (95) Operation not supported 2023-11-04T01:38:32.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ecb63bf40 1 -- 172.21.15.114:0/411555428 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8eb4069820 msgr2=0x7f8eb406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ec897b640 1 --2- 172.21.15.114:0/411555428 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8eb4069820 0x7f8eb406bce0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8002700 tx=0x7f8eb8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:32.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ecb63bf40 1 --2- 172.21.15.114:0/411555428 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8eb4069820 0x7f8eb406bce0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8002700 tx=0x7f8eb8008040 comp rx=0 tx=0).stop 2023-11-04T01:38:32.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ecb63bf40 1 -- 172.21.15.114:0/411555428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55deda8a8710 msgr2=0x55deda8a0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ecb63bf40 1 --2- 172.21.15.114:0/411555428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55deda8a8710 0x55deda8a0aa0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00a4f0 tx=0x7f8ebc002fb0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ecb63bf40 1 -- 172.21.15.114:0/411555428 shutdown_connections 2023-11-04T01:38:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ecb63bf40 1 --2- 172.21.15.114:0/411555428 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55deda933860 0x55deda8a2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ecb63bf40 1 --2- 172.21.15.114:0/411555428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55deda8a8710 0x55deda8a0aa0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ecb63bf40 1 --2- 172.21.15.114:0/411555428 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8eb4069820 0x7f8eb406bce0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ecb63bf40 1 --2- 172.21.15.114:0/411555428 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55deda889050 0x55deda88ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ecb63bf40 1 -- 172.21.15.114:0/411555428 >> 172.21.15.114:0/411555428 conn(0x55deda8a6670 msgr2=0x55deda85f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ecb63bf40 1 -- 172.21.15.114:0/411555428 shutdown_connections 2023-11-04T01:38:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.145+0000 7f8ecb63bf40 1 -- 172.21.15.114:0/411555428 wait complete. 2023-11-04T01:38:32.156 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata mksnap snap2 2023-11-04T01:38:32.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.231+0000 7fa4be40bf40 1 Processor -- start 2023-11-04T01:38:32.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.231+0000 7fa4be40bf40 1 -- start start 2023-11-04T01:38:32.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.231+0000 7fa4be40bf40 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa4a4002260 0x559951747e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.231+0000 7fa4be40bf40 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559951749040 0x559951746380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.231+0000 7fa4be40bf40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599517e0b60 0x5599517e0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.231+0000 7fa4be40bf40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55995162aac0 con 0x5599517e0b60 2023-11-04T01:38:32.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.231+0000 7fa4be40bf40 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599516263b0 con 0x7fa4a4002260 2023-11-04T01:38:32.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.231+0000 7fa4be40bf40 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599515c0650 con 0x559951749040 2023-11-04T01:38:32.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4bbaba640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599517e0b60 0x5599517e0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4bbaba640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599517e0b60 0x5599517e0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59750/0 (socket says 172.21.15.114:59750) 2023-11-04T01:38:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4bbaba640 1 -- 172.21.15.114:0/1736756958 learned_addr learned my addr 172.21.15.114:0/1736756958 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4baab8640 1 --2- 172.21.15.114:0/1736756958 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559951749040 0x559951746380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4bb2b9640 1 --2- 172.21.15.114:0/1736756958 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa4a4002260 0x559951747e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4bbaba640 1 -- 172.21.15.114:0/1736756958 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559951749040 msgr2=0x559951746380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4bbaba640 1 --2- 172.21.15.114:0/1736756958 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559951749040 0x559951746380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4bbaba640 1 -- 172.21.15.114:0/1736756958 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa4a4002260 msgr2=0x559951747e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4bbaba640 1 --2- 172.21.15.114:0/1736756958 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa4a4002260 0x559951747e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4bbaba640 1 -- 172.21.15.114:0/1736756958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599515bf930 con 0x5599517e0b60 2023-11-04T01:38:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4bbaba640 1 --2- 172.21.15.114:0/1736756958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599517e0b60 0x5599517e0fe0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x559951664560 tx=0x7fa4b4001010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a8a5a8fd88b3f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4b9ab6640 1 -- 172.21.15.114:0/1736756958 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400f650 con 0x5599517e0b60 2023-11-04T01:38:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4b9ab6640 1 -- 172.21.15.114:0/1736756958 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b4005030 con 0x5599517e0b60 2023-11-04T01:38:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4b9ab6640 1 -- 172.21.15.114:0/1736756958 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400fa10 con 0x5599517e0b60 2023-11-04T01:38:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4be40bf40 1 -- 172.21.15.114:0/1736756958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599517e0b60 msgr2=0x5599517e0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4be40bf40 1 --2- 172.21.15.114:0/1736756958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599517e0b60 0x5599517e0fe0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x559951664560 tx=0x7fa4b4001010 comp rx=0 tx=0).stop 2023-11-04T01:38:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4be40bf40 1 -- 172.21.15.114:0/1736756958 shutdown_connections 2023-11-04T01:38:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4be40bf40 1 --2- 172.21.15.114:0/1736756958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5599517e0b60 0x5599517e0fe0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4be40bf40 1 --2- 172.21.15.114:0/1736756958 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559951749040 0x559951746380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4be40bf40 1 --2- 172.21.15.114:0/1736756958 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa4a4002260 0x559951747e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.232+0000 7fa4be40bf40 1 -- 172.21.15.114:0/1736756958 >> 172.21.15.114:0/1736756958 conn(0x5599516bf670 msgr2=0x5599516a2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.233+0000 7fa4be40bf40 1 -- 172.21.15.114:0/1736756958 shutdown_connections 2023-11-04T01:38:32.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.233+0000 7fa4be40bf40 1 -- 172.21.15.114:0/1736756958 wait complete. 2023-11-04T01:38:32.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.233+0000 7fa4be40bf40 1 Processor -- start 2023-11-04T01:38:32.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.233+0000 7fa4be40bf40 1 -- start start 2023-11-04T01:38:32.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4be40bf40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559951749040 0x5599517de640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4be40bf40 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5599517e0b60 0x559951747950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4be40bf40 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa4a4002260 0x55995174b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4be40bf40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599515c02f0 con 0x559951749040 2023-11-04T01:38:32.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4be40bf40 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599515a04f0 con 0x5599517e0b60 2023-11-04T01:38:32.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4be40bf40 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x559951741420 con 0x7fa4a4002260 2023-11-04T01:38:32.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4bb2b9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559951749040 0x5599517de640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4bb2b9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559951749040 0x5599517de640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59754/0 (socket says 172.21.15.114:59754) 2023-11-04T01:38:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4bb2b9640 1 -- 172.21.15.114:0/1806633238 learned_addr learned my addr 172.21.15.114:0/1806633238 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4bbaba640 1 --2- 172.21.15.114:0/1806633238 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa4a4002260 0x55995174b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4baab8640 1 --2- 172.21.15.114:0/1806633238 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5599517e0b60 0x559951747950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4bb2b9640 1 -- 172.21.15.114:0/1806633238 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa4a4002260 msgr2=0x55995174b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4bb2b9640 1 --2- 172.21.15.114:0/1806633238 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa4a4002260 0x55995174b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4bb2b9640 1 -- 172.21.15.114:0/1806633238 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5599517e0b60 msgr2=0x559951747950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4bb2b9640 1 --2- 172.21.15.114:0/1806633238 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5599517e0b60 0x559951747950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4bb2b9640 1 -- 172.21.15.114:0/1806633238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599515cc780 con 0x559951749040 2023-11-04T01:38:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.234+0000 7fa4baab8640 1 --2- 172.21.15.114:0/1806633238 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5599517e0b60 0x559951747950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.235+0000 7fa4bb2b9640 1 --2- 172.21.15.114:0/1806633238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559951749040 0x5599517de640 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac054040 tx=0x7fa4a40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.235+0000 7fa4b8ab4640 1 -- 172.21.15.114:0/1806633238 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac006030 con 0x559951749040 2023-11-04T01:38:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.235+0000 7fa4b8ab4640 1 -- 172.21.15.114:0/1806633238 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac006190 con 0x559951749040 2023-11-04T01:38:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.235+0000 7fa4be40bf40 1 -- 172.21.15.114:0/1806633238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5599515bf390 con 0x559951749040 2023-11-04T01:38:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.235+0000 7fa4b8ab4640 1 -- 172.21.15.114:0/1806633238 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac052b70 con 0x559951749040 2023-11-04T01:38:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.235+0000 7fa4be40bf40 1 -- 172.21.15.114:0/1806633238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55995174b720 con 0x559951749040 2023-11-04T01:38:32.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.236+0000 7fa4b8ab4640 1 -- 172.21.15.114:0/1806633238 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4ac064070 con 0x559951749040 2023-11-04T01:38:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.236+0000 7fa4b8ab4640 1 --2- 172.21.15.114:0/1806633238 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa4a8069850 0x7fa4a806bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.236+0000 7fa4b8ab4640 1 -- 172.21.15.114:0/1806633238 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa4ac0cdc40 con 0x559951749040 2023-11-04T01:38:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.236+0000 7fa4baab8640 1 --2- 172.21.15.114:0/1806633238 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa4a8069850 0x7fa4a806bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.237+0000 7fa4be40bf40 1 -- 172.21.15.114:0/1806633238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- pool_op(create snap pool 8 tid 1 name snap2 v0) v4 -- 0x559951630330 con 0x559951749040 2023-11-04T01:38:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.237+0000 7fa4b8ab4640 1 -- 172.21.15.114:0/1806633238 <== mon.0 v2:172.21.15.114:3300/0 6 ==== pool_op_reply(tid 1 (95) Operation not supported v54) v1 ==== 43+0+0 (secure 0 0 0) 0x7fa4ac098ae0 con 0x559951749040 2023-11-04T01:38:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:error creating pool cephfs_metadata snapshot snap2: (95) Operation not supported 2023-11-04T01:38:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.237+0000 7fa4be40bf40 1 -- 172.21.15.114:0/1806633238 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa4a8069850 msgr2=0x7fa4a806bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.237+0000 7fa4be40bf40 1 --2- 172.21.15.114:0/1806633238 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa4a8069850 0x7fa4a806bd10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0005630 tx=0x7fa4b0005520 comp rx=0 tx=0).stop 2023-11-04T01:38:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.237+0000 7fa4be40bf40 1 -- 172.21.15.114:0/1806633238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559951749040 msgr2=0x5599517de640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.237+0000 7fa4be40bf40 1 --2- 172.21.15.114:0/1806633238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559951749040 0x5599517de640 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac054040 tx=0x7fa4a40040e0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.237+0000 7fa4be40bf40 1 -- 172.21.15.114:0/1806633238 shutdown_connections 2023-11-04T01:38:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.237+0000 7fa4be40bf40 1 --2- 172.21.15.114:0/1806633238 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa4a4002260 0x55995174b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.237+0000 7fa4be40bf40 1 --2- 172.21.15.114:0/1806633238 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa4a8069850 0x7fa4a806bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.237+0000 7fa4be40bf40 1 --2- 172.21.15.114:0/1806633238 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5599517e0b60 0x559951747950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.237+0000 7fa4be40bf40 1 --2- 172.21.15.114:0/1806633238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559951749040 0x5599517de640 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.237+0000 7fa4be40bf40 1 -- 172.21.15.114:0/1806633238 >> 172.21.15.114:0/1806633238 conn(0x5599516bf670 msgr2=0x559951746960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:32.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.237+0000 7fa4be40bf40 1 -- 172.21.15.114:0/1806633238 shutdown_connections 2023-11-04T01:38:32.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.237+0000 7fa4be40bf40 1 -- 172.21.15.114:0/1806633238 wait complete. 2023-11-04T01:38:32.247 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool mksnap cephfs_data snap3 2023-11-04T01:38:32.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.386+0000 7f250333c640 1 Processor -- start 2023-11-04T01:38:32.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.387+0000 7f250333c640 1 -- start start 2023-11-04T01:38:32.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.387+0000 7f250333c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24fc153e60 0x7f24fc15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.387+0000 7f250333c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f24fc0cd6d0 0x7f24fc161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.387+0000 7f250333c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24fc0cde60 con 0x7f24fc0b4880 2023-11-04T01:38:32.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.387+0000 7f250333c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24fc160f90 con 0x7f24fc0cd6d0 2023-11-04T01:38:32.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.387+0000 7f250333c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc15e400 con 0x7f24fc153e60 2023-11-04T01:38:32.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.387+0000 7f25018d9640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f24fc0b4880 0x7f24fc06b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42458/0 (socket says 172.21.15.114:42458) 2023-11-04T01:38:32.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.387+0000 7f25018d9640 1 -- 172.21.15.114:0/3379156427 learned_addr learned my addr 172.21.15.114:0/3379156427 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:32.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f25008d7640 1 --2- 172.21.15.114:0/3379156427 >> v2:172.21.15.141:3300/0 conn(0x7f24fc0cd6d0 0x7f24fc161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f25010d8640 1 --2- 172.21.15.114:0/3379156427 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24fc153e60 0x7f24fc15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f24f3fff640 1 -- 172.21.15.114:0/3379156427 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812395136 0 0) 0x7f24fc0cde60 con 0x7f24fc0b4880 2023-11-04T01:38:32.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f24f3fff640 1 -- 172.21.15.114:0/3379156427 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24e8003520 con 0x7f24fc0b4880 2023-11-04T01:38:32.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f24f3fff640 1 -- 172.21.15.114:0/3379156427 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3366036167 0 0) 0x7f24e8003520 con 0x7f24fc0b4880 2023-11-04T01:38:32.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f24f3fff640 1 -- 172.21.15.114:0/3379156427 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24fc153e60 msgr2=0x7f24fc15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:32.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f24f3fff640 1 --2- 172.21.15.114:0/3379156427 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24fc153e60 0x7f24fc15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f24f3fff640 1 -- 172.21.15.114:0/3379156427 >> v2:172.21.15.141:3300/0 conn(0x7f24fc0cd6d0 msgr2=0x7f24fc161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:32.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f24f3fff640 1 --2- 172.21.15.114:0/3379156427 >> v2:172.21.15.141:3300/0 conn(0x7f24fc0cd6d0 0x7f24fc161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f24f3fff640 1 -- 172.21.15.114:0/3379156427 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc161960 con 0x7f24fc0b4880 2023-11-04T01:38:32.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f24f3fff640 1 -- 172.21.15.114:0/3379156427 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f24f40019f0 con 0x7f24fc0b4880 2023-11-04T01:38:32.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f24f3fff640 1 -- 172.21.15.114:0/3379156427 >> v1:172.21.15.114:6789/0 conn(0x7f24fc0b4880 legacy=0x7f24fc06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f24f3fff640 1 --2- 172.21.15.114:0/3379156427 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24e8003970 0x7f24e8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f24f3fff640 1 --2- 172.21.15.114:0/3379156427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24e80047c0 0x7f24e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f24f3fff640 1 --2- 172.21.15.114:0/3379156427 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24fc153e60 0x7f24e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f24f3fff640 1 -- 172.21.15.114:0/3379156427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc160f90 con 0x7f24e80047c0 2023-11-04T01:38:32.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f24f3fff640 1 -- 172.21.15.114:0/3379156427 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc15e400 con 0x7f24e8003970 2023-11-04T01:38:32.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f24f3fff640 1 -- 172.21.15.114:0/3379156427 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e800b980 con 0x7f24fc153e60 2023-11-04T01:38:32.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f25008d7640 1 --2- 172.21.15.114:0/3379156427 >> v2:172.21.15.141:3300/0 conn(0x7f24fc0cd6d0 0x7f24fc161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:32.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f25008d7640 1 --2- 172.21.15.114:0/3379156427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24e80047c0 0x7f24e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f25010d8640 1 --2- 172.21.15.114:0/3379156427 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24e8003970 0x7f24e8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f25018d9640 1 --2- 172.21.15.114:0/3379156427 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24fc153e60 0x7f24e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f25008d7640 1 -- 172.21.15.114:0/3379156427 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24fc153e60 msgr2=0x7f24e8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:32.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f25008d7640 1 --2- 172.21.15.114:0/3379156427 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24fc153e60 0x7f24e8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f25008d7640 1 -- 172.21.15.114:0/3379156427 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24e8003970 msgr2=0x7f24e8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:32.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f25008d7640 1 --2- 172.21.15.114:0/3379156427 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24e8003970 0x7f24e8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.388+0000 7f25008d7640 1 -- 172.21.15.114:0/3379156427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e8003520 con 0x7f24e80047c0 2023-11-04T01:38:32.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.389+0000 7f25008d7640 1 --2- 172.21.15.114:0/3379156427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24e80047c0 0x7f24e8004c40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009c60 tx=0x7f24e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ff3f8f85518364 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:32.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.389+0000 7f24f3fff640 1 -- 172.21.15.114:0/3379156427 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec02c950 con 0x7f24e80047c0 2023-11-04T01:38:32.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.389+0000 7f24f3fff640 1 -- 172.21.15.114:0/3379156427 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec02cab0 con 0x7f24e80047c0 2023-11-04T01:38:32.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.389+0000 7f24f3fff640 1 -- 172.21.15.114:0/3379156427 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec02ce20 con 0x7f24e80047c0 2023-11-04T01:38:32.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.390+0000 7f250333c640 1 -- 172.21.15.114:0/3379156427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24e80047c0 msgr2=0x7f24e8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.390+0000 7f250333c640 1 --2- 172.21.15.114:0/3379156427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24e80047c0 0x7f24e8004c40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009c60 tx=0x7f24e80057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.390+0000 7f25018d9640 1 -- 172.21.15.114:0/3379156427 reap_dead start 2023-11-04T01:38:32.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.390+0000 7f250333c640 1 -- 172.21.15.114:0/3379156427 shutdown_connections 2023-11-04T01:38:32.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.390+0000 7f250333c640 1 -- 172.21.15.114:0/3379156427 >> 172.21.15.114:0/3379156427 conn(0x7f24fc0cf880 msgr2=0x7f24fc0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:32.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.390+0000 7f250333c640 1 -- 172.21.15.114:0/3379156427 shutdown_connections 2023-11-04T01:38:32.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.390+0000 7f250333c640 1 -- 172.21.15.114:0/3379156427 wait complete. 2023-11-04T01:38:32.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.391+0000 7f250333c640 1 Processor -- start 2023-11-04T01:38:32.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.391+0000 7f250333c640 1 -- start start 2023-11-04T01:38:32.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f250333c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24e80047c0 0x7f24fc0c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f250333c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24fc141ef0 0x7f24fc142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f250333c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24fc0cab80 0x7f24fc0cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f250333c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc140770 con 0x7f24e80047c0 2023-11-04T01:38:32.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f250333c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc1428b0 con 0x7f24fc0cab80 2023-11-04T01:38:32.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f250333c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc13fe60 con 0x7f24fc141ef0 2023-11-04T01:38:32.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f25010d8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24e80047c0 0x7f24fc0c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f25010d8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24e80047c0 0x7f24fc0c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59778/0 (socket says 172.21.15.114:59778) 2023-11-04T01:38:32.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f25010d8640 1 -- 172.21.15.114:0/3085230591 learned_addr learned my addr 172.21.15.114:0/3085230591 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:32.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f25010d8640 1 -- 172.21.15.114:0/3085230591 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24fc141ef0 msgr2=0x7f24fc142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f25008d7640 1 --2- 172.21.15.114:0/3085230591 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24fc141ef0 0x7f24fc142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f25018d9640 1 --2- 172.21.15.114:0/3085230591 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24fc0cab80 0x7f24fc0cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f25010d8640 1 --2- 172.21.15.114:0/3085230591 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24fc141ef0 0x7f24fc142370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f25010d8640 1 -- 172.21.15.114:0/3085230591 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24fc0cab80 msgr2=0x7f24fc0cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f25010d8640 1 --2- 172.21.15.114:0/3085230591 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24fc0cab80 0x7f24fc0cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f25010d8640 1 -- 172.21.15.114:0/3085230591 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc0c68f0 con 0x7f24e80047c0 2023-11-04T01:38:32.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f25010d8640 1 --2- 172.21.15.114:0/3085230591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24e80047c0 0x7f24fc0c8360 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f24f8011910 tx=0x7f24f8011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:32.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f24f1ffb640 1 -- 172.21.15.114:0/3085230591 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f800faf0 con 0x7f24e80047c0 2023-11-04T01:38:32.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f24f1ffb640 1 -- 172.21.15.114:0/3085230591 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f800fc50 con 0x7f24e80047c0 2023-11-04T01:38:32.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f24f1ffb640 1 -- 172.21.15.114:0/3085230591 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8014440 con 0x7f24e80047c0 2023-11-04T01:38:32.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.392+0000 7f250333c640 1 -- 172.21.15.114:0/3085230591 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24fc0cb8f0 con 0x7f24e80047c0 2023-11-04T01:38:32.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.393+0000 7f250333c640 1 -- 172.21.15.114:0/3085230591 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24fc140390 con 0x7f24e80047c0 2023-11-04T01:38:32.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.394+0000 7f250333c640 1 -- 172.21.15.114:0/3085230591 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24fc140550 con 0x7f24e80047c0 2023-11-04T01:38:32.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.394+0000 7f24f1ffb640 1 -- 172.21.15.114:0/3085230591 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f24f80145a0 con 0x7f24e80047c0 2023-11-04T01:38:32.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.394+0000 7f24f1ffb640 1 --2- 172.21.15.114:0/3085230591 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24e006ae70 0x7f24e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.395+0000 7f24f1ffb640 1 -- 172.21.15.114:0/3085230591 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f24f8089f90 con 0x7f24e80047c0 2023-11-04T01:38:32.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.395+0000 7f25008d7640 1 --2- 172.21.15.114:0/3085230591 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24e006ae70 0x7f24e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.395+0000 7f25008d7640 1 --2- 172.21.15.114:0/3085230591 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24e006ae70 0x7f24e006d330 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f24ec036000 tx=0x7f24ec030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:32.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.399+0000 7f24f1ffb640 1 -- 172.21.15.114:0/3085230591 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f24f80bcca0 con 0x7f24e80047c0 2023-11-04T01:38:32.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.566+0000 7f250333c640 1 -- 172.21.15.114:0/3085230591 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool mksnap", "pool": "cephfs_data", "snap": "snap3"} v 0) v1 -- 0x7f24fc1409e0 con 0x7f24e80047c0 2023-11-04T01:38:32.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.566+0000 7f24f1ffb640 1 -- 172.21.15.114:0/3085230591 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool mksnap", "pool": "cephfs_data", "snap": "snap3"}]=-95 (95) Operation not supported v54) v1 ==== 131+0+0 (secure 0 0 0) 0x7f24f8054da0 con 0x7f24e80047c0 2023-11-04T01:38:32.568 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOTSUP: (95) Operation not supported 2023-11-04T01:38:32.573 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:38:32.574 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool mksnap cephfs_metadata snap4 2023-11-04T01:38:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.675+0000 7fa11f8ec640 1 Processor -- start 2023-11-04T01:38:32.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.675+0000 7fa11f8ec640 1 -- start start 2023-11-04T01:38:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.676+0000 7fa11f8ec640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa118153850 0x7fa11815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.676+0000 7fa11f8ec640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1180c3860 con 0x7fa1180cc9d0 2023-11-04T01:38:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.676+0000 7fa11f8ec640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1180c9250 con 0x7fa1180cc520 2023-11-04T01:38:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.676+0000 7fa11f8ec640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa118153c30 con 0x7fa118153850 2023-11-04T01:38:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.676+0000 7fa11d688640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa118153850 0x7fa11815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.676+0000 7fa11de89640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa1180cc9d0 0x7fa1180c3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42466/0 (socket says 172.21.15.114:42466) 2023-11-04T01:38:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.676+0000 7fa11de89640 1 -- 172.21.15.114:0/1566302005 learned_addr learned my addr 172.21.15.114:0/1566302005 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.676+0000 7fa11d688640 1 -- 172.21.15.114:0/1566302005 >> v1:172.21.15.141:6789/0 conn(0x7fa1180cc520 legacy=0x7fa118070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.676+0000 7fa11d688640 1 -- 172.21.15.114:0/1566302005 >> v1:172.21.15.114:6789/0 conn(0x7fa1180cc9d0 legacy=0x7fa1180c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.676+0000 7fa11d688640 1 -- 172.21.15.114:0/1566302005 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11815a700 con 0x7fa118153850 2023-11-04T01:38:32.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.676+0000 7fa10ffff640 1 -- 172.21.15.114:0/1566302005 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975135224 0 0) 0x7fa1180c3860 con 0x7fa1180cc9d0 2023-11-04T01:38:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.677+0000 7fa11d688640 1 --2- 172.21.15.114:0/1566302005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa118153850 0x7fa11815a1c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa1140097a0 tx=0x7fa11402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79c48b80c66fd4f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.677+0000 7fa10ffff640 1 -- 172.21.15.114:0/1566302005 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa114031830 con 0x7fa118153850 2023-11-04T01:38:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.677+0000 7fa10ffff640 1 -- 172.21.15.114:0/1566302005 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa114031990 con 0x7fa118153850 2023-11-04T01:38:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.677+0000 7fa10ffff640 1 -- 172.21.15.114:0/1566302005 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa114031d20 con 0x7fa118153850 2023-11-04T01:38:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.677+0000 7fa11f8ec640 1 -- 172.21.15.114:0/1566302005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa118153850 msgr2=0x7fa11815a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.677+0000 7fa11f8ec640 1 --2- 172.21.15.114:0/1566302005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa118153850 0x7fa11815a1c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa1140097a0 tx=0x7fa11402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.678+0000 7fa11f8ec640 1 -- 172.21.15.114:0/1566302005 shutdown_connections 2023-11-04T01:38:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.678+0000 7fa11f8ec640 1 --2- 172.21.15.114:0/1566302005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa118153850 0x7fa11815a1c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.678+0000 7fa11f8ec640 1 -- 172.21.15.114:0/1566302005 >> 172.21.15.114:0/1566302005 conn(0x7fa1180ce950 msgr2=0x7fa1180ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.678+0000 7fa11f8ec640 1 -- 172.21.15.114:0/1566302005 shutdown_connections 2023-11-04T01:38:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.678+0000 7fa11f8ec640 1 -- 172.21.15.114:0/1566302005 wait complete. 2023-11-04T01:38:32.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.679+0000 7fa11f8ec640 1 Processor -- start 2023-11-04T01:38:32.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.679+0000 7fa11f8ec640 1 -- start start 2023-11-04T01:38:32.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.679+0000 7fa11f8ec640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1180cc520 0x7fa118155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.679+0000 7fa11f8ec640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1180cc9d0 0x7fa118159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.679+0000 7fa11f8ec640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa118153850 0x7fa118150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.679+0000 7fa11f8ec640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa118153d70 con 0x7fa1180cc520 2023-11-04T01:38:32.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa11f8ec640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa118153f50 con 0x7fa1180cc9d0 2023-11-04T01:38:32.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa11f8ec640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa118154230 con 0x7fa118153850 2023-11-04T01:38:32.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa11d688640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1180cc520 0x7fa118155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa11d688640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1180cc520 0x7fa118155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59792/0 (socket says 172.21.15.114:59792) 2023-11-04T01:38:32.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa11d688640 1 -- 172.21.15.114:0/2925058548 learned_addr learned my addr 172.21.15.114:0/2925058548 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:32.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa11ce87640 1 --2- 172.21.15.114:0/2925058548 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1180cc9d0 0x7fa118159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa11de89640 1 --2- 172.21.15.114:0/2925058548 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa118153850 0x7fa118150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa11d688640 1 -- 172.21.15.114:0/2925058548 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa118153850 msgr2=0x7fa118150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa11d688640 1 --2- 172.21.15.114:0/2925058548 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa118153850 0x7fa118150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa11d688640 1 -- 172.21.15.114:0/2925058548 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1180cc9d0 msgr2=0x7fa118159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:32.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa11d688640 1 --2- 172.21.15.114:0/2925058548 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1180cc9d0 0x7fa118159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:32.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa11d688640 1 -- 172.21.15.114:0/2925058548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa114009400 con 0x7fa1180cc520 2023-11-04T01:38:32.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa11de89640 1 --2- 172.21.15.114:0/2925058548 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa118153850 0x7fa118150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:32.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa11d688640 1 --2- 172.21.15.114:0/2925058548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1180cc520 0x7fa118155c40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa1140097a0 tx=0x7fa1140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:32.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa10dffb640 1 -- 172.21.15.114:0/2925058548 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11403aa60 con 0x7fa1180cc520 2023-11-04T01:38:32.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa10dffb640 1 -- 172.21.15.114:0/2925058548 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11403abc0 con 0x7fa1180cc520 2023-11-04T01:38:32.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa11f8ec640 1 -- 172.21.15.114:0/2925058548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa118154510 con 0x7fa1180cc520 2023-11-04T01:38:32.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa10dffb640 1 -- 172.21.15.114:0/2925058548 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1140443f0 con 0x7fa1180cc520 2023-11-04T01:38:32.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.680+0000 7fa11f8ec640 1 -- 172.21.15.114:0/2925058548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa118154ad0 con 0x7fa1180cc520 2023-11-04T01:38:32.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.681+0000 7fa11f8ec640 1 -- 172.21.15.114:0/2925058548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa118074290 con 0x7fa1180cc520 2023-11-04T01:38:32.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.682+0000 7fa10dffb640 1 -- 172.21.15.114:0/2925058548 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa11404d450 con 0x7fa1180cc520 2023-11-04T01:38:32.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.682+0000 7fa10dffb640 1 --2- 172.21.15.114:0/2925058548 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa0fc06ae70 0x7fa0fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:32.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.682+0000 7fa10dffb640 1 -- 172.21.15.114:0/2925058548 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa1140aba10 con 0x7fa1180cc520 2023-11-04T01:38:32.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.682+0000 7fa11ce87640 1 --2- 172.21.15.114:0/2925058548 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa0fc06ae70 0x7fa0fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:32.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.683+0000 7fa11ce87640 1 --2- 172.21.15.114:0/2925058548 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa0fc06ae70 0x7fa0fc06d330 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa108004ea0 tx=0x7fa108009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:32.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.687+0000 7fa10dffb640 1 -- 172.21.15.114:0/2925058548 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1140768b0 con 0x7fa1180cc520 2023-11-04T01:38:32.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.854+0000 7fa11f8ec640 1 -- 172.21.15.114:0/2925058548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool mksnap", "pool": "cephfs_metadata", "snap": "snap4"} v 0) v1 -- 0x7fa1180c5010 con 0x7fa1180cc520 2023-11-04T01:38:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:32.855+0000 7fa10dffb640 1 -- 172.21.15.114:0/2925058548 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool mksnap", "pool": "cephfs_metadata", "snap": "snap4"}]=-95 (95) Operation not supported v54) v1 ==== 135+0+0 (secure 0 0 0) 0x7fa114079ed0 con 0x7fa1180cc520 2023-11-04T01:38:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOTSUP: (95) Operation not supported 2023-11-04T01:38:32.861 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:38:32.862 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:38:32.862 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:32.904 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:32.952 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:38:32.952 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:38:32.952 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:32.967 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:33.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.105+0000 7f3072a61640 1 Processor -- start 2023-11-04T01:38:33.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.105+0000 7f3072a61640 1 -- start start 2023-11-04T01:38:33.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.106+0000 7f3072a61640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f306c160b10 0x7f306c160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.106+0000 7f3072a61640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f306c0cf160 0x7f306c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.106+0000 7f3072a61640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c06bf00 con 0x7f306c15ce60 2023-11-04T01:38:33.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.106+0000 7f3072a61640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306c0cbde0 con 0x7f306c160b10 2023-11-04T01:38:33.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.106+0000 7f3072a61640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306c0cfb30 con 0x7f306c0cf160 2023-11-04T01:38:33.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.106+0000 7f306b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f306c160b10 0x7f306c160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.106+0000 7f306b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f306c160b10 0x7f306c160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59794/0 (socket says 172.21.15.114:59794) 2023-11-04T01:38:33.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.106+0000 7f306b7fe640 1 -- 172.21.15.114:0/3858286846 learned_addr learned my addr 172.21.15.114:0/3858286846 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:33.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.107+0000 7f306b7fe640 1 -- 172.21.15.114:0/3858286846 >> v2:172.21.15.141:3300/0 conn(0x7f306c0cf160 msgr2=0x7f306c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:33.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.107+0000 7f306b7fe640 1 --2- 172.21.15.114:0/3858286846 >> v2:172.21.15.141:3300/0 conn(0x7f306c0cf160 0x7f306c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.107+0000 7f306b7fe640 1 -- 172.21.15.114:0/3858286846 >> v1:172.21.15.141:6789/0 conn(0x7f306c15ce60 legacy=0x7f306c06b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:33.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.107+0000 7f306b7fe640 1 -- 172.21.15.114:0/3858286846 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c1615d0 con 0x7f306c160b10 2023-11-04T01:38:33.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.107+0000 7f306b7fe640 1 --2- 172.21.15.114:0/3858286846 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c160b10 0x7f306c160f90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f306c1614d0 tx=0x7f305402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feee581127fa4131 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.107+0000 7f306affd640 1 -- 172.21.15.114:0/3858286846 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054031870 con 0x7f306c160b10 2023-11-04T01:38:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.107+0000 7f306affd640 1 -- 172.21.15.114:0/3858286846 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30540319d0 con 0x7f306c160b10 2023-11-04T01:38:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.107+0000 7f306affd640 1 -- 172.21.15.114:0/3858286846 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054031d60 con 0x7f306c160b10 2023-11-04T01:38:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.108+0000 7f3072a61640 1 -- 172.21.15.114:0/3858286846 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c160b10 msgr2=0x7f306c160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.108+0000 7f3072a61640 1 --2- 172.21.15.114:0/3858286846 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c160b10 0x7f306c160f90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f306c1614d0 tx=0x7f305402b910 comp rx=0 tx=0).stop 2023-11-04T01:38:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.108+0000 7f3072a61640 1 -- 172.21.15.114:0/3858286846 shutdown_connections 2023-11-04T01:38:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.108+0000 7f3072a61640 1 --2- 172.21.15.114:0/3858286846 >> v2:172.21.15.141:3300/0 conn(0x7f306c0cf160 0x7f306c0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.108+0000 7f3072a61640 1 --2- 172.21.15.114:0/3858286846 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c160b10 0x7f306c160f90 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.108+0000 7f3072a61640 1 -- 172.21.15.114:0/3858286846 >> 172.21.15.114:0/3858286846 conn(0x7f306c06ea90 msgr2=0x7f306c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:33.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.108+0000 7f3072a61640 1 -- 172.21.15.114:0/3858286846 shutdown_connections 2023-11-04T01:38:33.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.108+0000 7f3072a61640 1 -- 172.21.15.114:0/3858286846 wait complete. 2023-11-04T01:38:33.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.109+0000 7f3072a61640 1 Processor -- start 2023-11-04T01:38:33.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.109+0000 7f3072a61640 1 -- start start 2023-11-04T01:38:33.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.110+0000 7f3072a61640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f306c0cf160 0x7f306c158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.110+0000 7f3072a61640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c15ce60 0x7f306c1f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.110+0000 7f3072a61640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f306c160b10 0x7f306c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.110+0000 7f3072a61640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0b3770 con 0x7f306c15ce60 2023-11-04T01:38:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.110+0000 7f3072a61640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0b68e0 con 0x7f306c0cf160 2023-11-04T01:38:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.110+0000 7f3072a61640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c1590e0 con 0x7f306c160b10 2023-11-04T01:38:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.110+0000 7f306b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c15ce60 0x7f306c1f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.110+0000 7f306b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c15ce60 0x7f306c1f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59810/0 (socket says 172.21.15.114:59810) 2023-11-04T01:38:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.110+0000 7f306b7fe640 1 -- 172.21.15.114:0/3944144334 learned_addr learned my addr 172.21.15.114:0/3944144334 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.111+0000 7f306bfff640 1 --2- 172.21.15.114:0/3944144334 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f306c0cf160 0x7f306c158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.111+0000 7f3070ffe640 1 --2- 172.21.15.114:0/3944144334 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f306c160b10 0x7f306c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.111+0000 7f306b7fe640 1 -- 172.21.15.114:0/3944144334 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f306c160b10 msgr2=0x7f306c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.111+0000 7f306b7fe640 1 --2- 172.21.15.114:0/3944144334 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f306c160b10 0x7f306c0b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.111+0000 7f306b7fe640 1 -- 172.21.15.114:0/3944144334 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f306c0cf160 msgr2=0x7f306c158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.111+0000 7f306b7fe640 1 --2- 172.21.15.114:0/3944144334 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f306c0cf160 0x7f306c158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.111+0000 7f306b7fe640 1 -- 172.21.15.114:0/3944144334 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30540094d0 con 0x7f306c15ce60 2023-11-04T01:38:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.111+0000 7f306bfff640 1 --2- 172.21.15.114:0/3944144334 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f306c0cf160 0x7f306c158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.111+0000 7f3070ffe640 1 --2- 172.21.15.114:0/3944144334 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f306c160b10 0x7f306c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.111+0000 7f306b7fe640 1 --2- 172.21.15.114:0/3944144334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c15ce60 0x7f306c1f2e20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3054000c00 tx=0x7f30540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.111+0000 7f3068ff9640 1 -- 172.21.15.114:0/3944144334 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054031840 con 0x7f306c15ce60 2023-11-04T01:38:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.111+0000 7f3068ff9640 1 -- 172.21.15.114:0/3944144334 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30540443f0 con 0x7f306c15ce60 2023-11-04T01:38:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.111+0000 7f3072a61640 1 -- 172.21.15.114:0/3944144334 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306c0b3980 con 0x7f306c15ce60 2023-11-04T01:38:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.111+0000 7f3068ff9640 1 -- 172.21.15.114:0/3944144334 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30540447a0 con 0x7f306c15ce60 2023-11-04T01:38:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.111+0000 7f3072a61640 1 -- 172.21.15.114:0/3944144334 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c158bd0 con 0x7f306c15ce60 2023-11-04T01:38:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.112+0000 7f3072a61640 1 -- 172.21.15.114:0/3944144334 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c074290 con 0x7f306c15ce60 2023-11-04T01:38:33.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.113+0000 7f3068ff9640 1 -- 172.21.15.114:0/3944144334 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f305404d450 con 0x7f306c15ce60 2023-11-04T01:38:33.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.113+0000 7f3068ff9640 1 --2- 172.21.15.114:0/3944144334 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f304c06ae70 0x7f304c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.113+0000 7f3068ff9640 1 -- 172.21.15.114:0/3944144334 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f305402d040 con 0x7f306c15ce60 2023-11-04T01:38:33.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.113+0000 7f306bfff640 1 --2- 172.21.15.114:0/3944144334 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f304c06ae70 0x7f304c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.113+0000 7f306bfff640 1 --2- 172.21.15.114:0/3944144334 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f304c06ae70 0x7f304c06d330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f305c00a810 tx=0x7f305c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:33.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.117+0000 7f3068ff9640 1 -- 172.21.15.114:0/3944144334 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3054076e20 con 0x7f306c15ce60 2023-11-04T01:38:33.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.285+0000 7f3072a61640 1 -- 172.21.15.114:0/3944144334 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f306c06b3e0 con 0x7f306c15ce60 2023-11-04T01:38:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.287+0000 7f3068ff9640 1 -- 172.21.15.114:0/3944144334 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18583 (secure 0 0 0) 0x7f305407a440 con 0x7f306c15ce60 2023-11-04T01:38:33.289 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:33.289 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":54,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:21.029391+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:17.859902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:18.334035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.289+0000 7f3072a61640 1 -- 172.21.15.114:0/3944144334 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f304c06ae70 msgr2=0x7f304c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.289+0000 7f3072a61640 1 --2- 172.21.15.114:0/3944144334 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f304c06ae70 0x7f304c06d330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f305c00a810 tx=0x7f305c008040 comp rx=0 tx=0).stop 2023-11-04T01:38:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.289+0000 7f3072a61640 1 -- 172.21.15.114:0/3944144334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c15ce60 msgr2=0x7f306c1f2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.289+0000 7f3072a61640 1 --2- 172.21.15.114:0/3944144334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c15ce60 0x7f306c1f2e20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3054000c00 tx=0x7f30540046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.289+0000 7f3072a61640 1 -- 172.21.15.114:0/3944144334 shutdown_connections 2023-11-04T01:38:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.289+0000 7f3072a61640 1 --2- 172.21.15.114:0/3944144334 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f306c160b10 0x7f306c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.289+0000 7f3072a61640 1 --2- 172.21.15.114:0/3944144334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306c15ce60 0x7f306c1f2e20 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.289+0000 7f3072a61640 1 --2- 172.21.15.114:0/3944144334 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f304c06ae70 0x7f304c06d330 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.289+0000 7f3072a61640 1 --2- 172.21.15.114:0/3944144334 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f306c0cf160 0x7f306c158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.289+0000 7f3072a61640 1 -- 172.21.15.114:0/3944144334 >> 172.21.15.114:0/3944144334 conn(0x7f306c06ea90 msgr2=0x7f306c0cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:33.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.289+0000 7f3072a61640 1 -- 172.21.15.114:0/3944144334 shutdown_connections 2023-11-04T01:38:33.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.289+0000 7f3072a61640 1 -- 172.21.15.114:0/3944144334 wait complete. 2023-11-04T01:38:33.301 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:38:17.859902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:38:18.334035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:33.302 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:33.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.401+0000 7f04800d4640 1 Processor -- start 2023-11-04T01:38:33.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.402+0000 7f04800d4640 1 -- start start 2023-11-04T01:38:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.402+0000 7f04800d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0478153e60 0x7f047815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.402+0000 7f04800d4640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f04780b4880 0x7f04780b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.402+0000 7f04800d4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04780cde60 con 0x7f04780cd6d0 2023-11-04T01:38:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.402+0000 7f04800d4640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04780b5230 con 0x7f04780b4880 2023-11-04T01:38:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.402+0000 7f04800d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0478160f90 con 0x7f0478153e60 2023-11-04T01:38:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047d66f640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f04780cd6d0 0x7f0478161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42476/0 (socket says 172.21.15.114:42476) 2023-11-04T01:38:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047d66f640 1 -- 172.21.15.114:0/1578650523 learned_addr learned my addr 172.21.15.114:0/1578650523 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047de70640 1 --2- 172.21.15.114:0/1578650523 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0478153e60 0x7f047815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047e671640 1 --2- 172.21.15.114:0/1578650523 >> v2:172.21.15.141:3300/0 conn(0x7f04780b4880 0x7f04780b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047ce6e640 1 -- 172.21.15.114:0/1578650523 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935648030 0 0) 0x7f04780cde60 con 0x7f04780cd6d0 2023-11-04T01:38:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047ce6e640 1 -- 172.21.15.114:0/1578650523 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0464003520 con 0x7f04780cd6d0 2023-11-04T01:38:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047ce6e640 1 -- 172.21.15.114:0/1578650523 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2574680454 0 0) 0x7f0464003520 con 0x7f04780cd6d0 2023-11-04T01:38:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047ce6e640 1 -- 172.21.15.114:0/1578650523 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0478153e60 msgr2=0x7f047815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047ce6e640 1 --2- 172.21.15.114:0/1578650523 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0478153e60 0x7f047815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047ce6e640 1 -- 172.21.15.114:0/1578650523 >> v2:172.21.15.141:3300/0 conn(0x7f04780b4880 msgr2=0x7f04780b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047ce6e640 1 --2- 172.21.15.114:0/1578650523 >> v2:172.21.15.141:3300/0 conn(0x7f04780b4880 0x7f04780b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047ce6e640 1 -- 172.21.15.114:0/1578650523 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047815e400 con 0x7f04780cd6d0 2023-11-04T01:38:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047ce6e640 1 -- 172.21.15.114:0/1578650523 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f0474001670 con 0x7f04780cd6d0 2023-11-04T01:38:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047ce6e640 1 -- 172.21.15.114:0/1578650523 >> v1:172.21.15.114:6789/0 conn(0x7f04780cd6d0 legacy=0x7f0478161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047ce6e640 1 --2- 172.21.15.114:0/1578650523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0464003970 0x7f0464003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047ce6e640 1 --2- 172.21.15.114:0/1578650523 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0478153e60 0x7f04640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047ce6e640 1 --2- 172.21.15.114:0/1578650523 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0464004d00 0x7f0464005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047ce6e640 1 -- 172.21.15.114:0/1578650523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780b5230 con 0x7f0464003970 2023-11-04T01:38:33.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047ce6e640 1 -- 172.21.15.114:0/1578650523 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0478160f90 con 0x7f0464004d00 2023-11-04T01:38:33.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047ce6e640 1 -- 172.21.15.114:0/1578650523 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046400b980 con 0x7f0478153e60 2023-11-04T01:38:33.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047de70640 1 --2- 172.21.15.114:0/1578650523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0464003970 0x7f0464003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047d66f640 1 --2- 172.21.15.114:0/1578650523 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0478153e60 0x7f04640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.403+0000 7f047e671640 1 --2- 172.21.15.114:0/1578650523 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0464004d00 0x7f0464005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.404+0000 7f047de70640 1 -- 172.21.15.114:0/1578650523 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0478153e60 msgr2=0x7f04640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:33.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.404+0000 7f047de70640 1 --2- 172.21.15.114:0/1578650523 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0478153e60 0x7f04640047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.404+0000 7f047de70640 1 -- 172.21.15.114:0/1578650523 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0464004d00 msgr2=0x7f0464005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:33.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.404+0000 7f047de70640 1 --2- 172.21.15.114:0/1578650523 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0464004d00 0x7f0464005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.404+0000 7f047de70640 1 -- 172.21.15.114:0/1578650523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0464003520 con 0x7f0464003970 2023-11-04T01:38:33.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.404+0000 7f047de70640 1 --2- 172.21.15.114:0/1578650523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0464003970 0x7f0464003d90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f046c009ac0 tx=0x7f04640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35780c1ce2e71187 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:33.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.404+0000 7f047ce6e640 1 -- 172.21.15.114:0/1578650523 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c02c6b0 con 0x7f0464003970 2023-11-04T01:38:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.404+0000 7f047ce6e640 1 -- 172.21.15.114:0/1578650523 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c02c810 con 0x7f0464003970 2023-11-04T01:38:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.404+0000 7f047ce6e640 1 -- 172.21.15.114:0/1578650523 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c02cba0 con 0x7f0464003970 2023-11-04T01:38:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.405+0000 7f04800d4640 1 -- 172.21.15.114:0/1578650523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0464003970 msgr2=0x7f0464003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.405+0000 7f04800d4640 1 --2- 172.21.15.114:0/1578650523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0464003970 0x7f0464003d90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f046c009ac0 tx=0x7f04640057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.405+0000 7f047e671640 1 -- 172.21.15.114:0/1578650523 reap_dead start 2023-11-04T01:38:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.405+0000 7f04800d4640 1 -- 172.21.15.114:0/1578650523 shutdown_connections 2023-11-04T01:38:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.405+0000 7f04800d4640 1 -- 172.21.15.114:0/1578650523 >> 172.21.15.114:0/1578650523 conn(0x7f04780cf880 msgr2=0x7f04780cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.405+0000 7f04800d4640 1 -- 172.21.15.114:0/1578650523 shutdown_connections 2023-11-04T01:38:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.405+0000 7f04800d4640 1 -- 172.21.15.114:0/1578650523 wait complete. 2023-11-04T01:38:33.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.406+0000 7f04800d4640 1 Processor -- start 2023-11-04T01:38:33.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.406+0000 7f04800d4640 1 -- start start 2023-11-04T01:38:33.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f04800d4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0464003970 0x7f0478152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f04800d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04780c8b00 0x7f04780c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f04800d4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04781f2d60 0x7f04781f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f04800d4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0478154d10 con 0x7f04781f2d60 2023-11-04T01:38:33.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f04800d4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780c94c0 con 0x7f0464003970 2023-11-04T01:38:33.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f04800d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04781f3a90 con 0x7f04780c8b00 2023-11-04T01:38:33.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f047e671640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04781f2d60 0x7f04781f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f047e671640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04781f2d60 0x7f04781f31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59818/0 (socket says 172.21.15.114:59818) 2023-11-04T01:38:33.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f047e671640 1 -- 172.21.15.114:0/1044317445 learned_addr learned my addr 172.21.15.114:0/1044317445 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:33.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f047d66f640 1 --2- 172.21.15.114:0/1044317445 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04780c8b00 0x7f04780c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f047e671640 1 -- 172.21.15.114:0/1044317445 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04780c8b00 msgr2=0x7f04780c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f047e671640 1 --2- 172.21.15.114:0/1044317445 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04780c8b00 0x7f04780c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f047de70640 1 --2- 172.21.15.114:0/1044317445 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0464003970 0x7f0478152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f047e671640 1 -- 172.21.15.114:0/1044317445 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0464003970 msgr2=0x7f0478152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f047e671640 1 --2- 172.21.15.114:0/1044317445 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0464003970 0x7f0478152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f047e671640 1 -- 172.21.15.114:0/1044317445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0478154370 con 0x7f04781f2d60 2023-11-04T01:38:33.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.407+0000 7f047e671640 1 --2- 172.21.15.114:0/1044317445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04781f2d60 0x7f04781f31e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f04780c6900 tx=0x7f047000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.408+0000 7f046a7fc640 1 -- 172.21.15.114:0/1044317445 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047000e040 con 0x7f04781f2d60 2023-11-04T01:38:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.408+0000 7f046a7fc640 1 -- 172.21.15.114:0/1044317445 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047000f040 con 0x7f04781f2d60 2023-11-04T01:38:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.408+0000 7f04800d4640 1 -- 172.21.15.114:0/1044317445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0478154650 con 0x7f04781f2d60 2023-11-04T01:38:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.408+0000 7f046a7fc640 1 -- 172.21.15.114:0/1044317445 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470015430 con 0x7f04781f2d60 2023-11-04T01:38:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.408+0000 7f04800d4640 1 -- 172.21.15.114:0/1044317445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04781f3720 con 0x7f04781f2d60 2023-11-04T01:38:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.409+0000 7f04800d4640 1 -- 172.21.15.114:0/1044317445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0478154e50 con 0x7f04781f2d60 2023-11-04T01:38:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.409+0000 7f046a7fc640 1 -- 172.21.15.114:0/1044317445 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0470015590 con 0x7f04781f2d60 2023-11-04T01:38:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.409+0000 7f046a7fc640 1 --2- 172.21.15.114:0/1044317445 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f045c06aea0 0x7f045c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.409+0000 7f046a7fc640 1 -- 172.21.15.114:0/1044317445 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f047008a190 con 0x7f04781f2d60 2023-11-04T01:38:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.409+0000 7f047de70640 1 --2- 172.21.15.114:0/1044317445 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f045c06aea0 0x7f045c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.410+0000 7f047de70640 1 --2- 172.21.15.114:0/1044317445 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f045c06aea0 0x7f045c06d360 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f046c036000 tx=0x7f046c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:33.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.413+0000 7f046a7fc640 1 -- 172.21.15.114:0/1044317445 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0478154e50 con 0x7f04781f2d60 2023-11-04T01:38:33.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.579+0000 7f04800d4640 1 -- 172.21.15.114:0/1044317445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0478154e50 con 0x7f04781f2d60 2023-11-04T01:38:33.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.579+0000 7f046a7fc640 1 -- 172.21.15.114:0/1044317445 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0478154e50 con 0x7f04781f2d60 2023-11-04T01:38:33.581 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:38:33.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.581+0000 7f04800d4640 1 -- 172.21.15.114:0/1044317445 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f045c06aea0 msgr2=0x7f045c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.581+0000 7f04800d4640 1 --2- 172.21.15.114:0/1044317445 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f045c06aea0 0x7f045c06d360 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f046c036000 tx=0x7f046c030000 comp rx=0 tx=0).stop 2023-11-04T01:38:33.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.581+0000 7f04800d4640 1 -- 172.21.15.114:0/1044317445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04781f2d60 msgr2=0x7f04781f31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.581+0000 7f04800d4640 1 --2- 172.21.15.114:0/1044317445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04781f2d60 0x7f04781f31e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f04780c6900 tx=0x7f047000f580 comp rx=0 tx=0).stop 2023-11-04T01:38:33.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.581+0000 7f04800d4640 1 -- 172.21.15.114:0/1044317445 shutdown_connections 2023-11-04T01:38:33.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.581+0000 7f04800d4640 1 --2- 172.21.15.114:0/1044317445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04781f2d60 0x7f04781f31e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.581+0000 7f04800d4640 1 --2- 172.21.15.114:0/1044317445 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f04780c8b00 0x7f04780c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.581+0000 7f04800d4640 1 --2- 172.21.15.114:0/1044317445 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f045c06aea0 0x7f045c06d360 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.581+0000 7f04800d4640 1 --2- 172.21.15.114:0/1044317445 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0464003970 0x7f0478152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.581+0000 7f04800d4640 1 -- 172.21.15.114:0/1044317445 >> 172.21.15.114:0/1044317445 conn(0x7f04780cf880 msgr2=0x7f04780b7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:33.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.582+0000 7f04800d4640 1 -- 172.21.15.114:0/1044317445 shutdown_connections 2023-11-04T01:38:33.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.582+0000 7f04800d4640 1 -- 172.21.15.114:0/1044317445 wait complete. 2023-11-04T01:38:33.594 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:33.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.694+0000 7f7b0013e640 1 Processor -- start 2023-11-04T01:38:33.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.694+0000 7f7b0013e640 1 -- start start 2023-11-04T01:38:33.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.695+0000 7f7b0013e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7af8159c00 0x7f7af80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.695+0000 7f7b0013e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7af80ae1d0 0x7f7af80c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.695+0000 7f7b0013e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af815aff0 con 0x7f7af80c48e0 2023-11-04T01:38:33.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.695+0000 7f7b0013e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af80c52d0 con 0x7f7af8159c00 2023-11-04T01:38:33.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.695+0000 7f7b0013e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af815a3e0 con 0x7f7af80ae1d0 2023-11-04T01:38:33.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.695+0000 7f7afdeda640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7af8159c00 0x7f7af80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.695+0000 7f7afe6db640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7af80ae1d0 0x7f7af80c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.695+0000 7f7afdeda640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7af8159c00 0x7f7af80cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:58454/0 (socket says 172.21.15.114:58454) 2023-11-04T01:38:33.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.695+0000 7f7afe6db640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7af80ae1d0 0x7f7af80c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:35484/0 (socket says 172.21.15.114:35484) 2023-11-04T01:38:33.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.695+0000 7f7afd6d9640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f7af80c48e0 0x7f7af80adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:54628/0 (socket says 172.21.15.114:54628) 2023-11-04T01:38:33.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.695+0000 7f7afdeda640 1 -- 172.21.15.114:0/891021254 learned_addr learned my addr 172.21.15.114:0/891021254 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:33.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.695+0000 7f7afdeda640 1 -- 172.21.15.114:0/891021254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7af80ae1d0 msgr2=0x7f7af80c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:33.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.695+0000 7f7afdeda640 1 --2- 172.21.15.114:0/891021254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7af80ae1d0 0x7f7af80c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.695+0000 7f7afdeda640 1 -- 172.21.15.114:0/891021254 >> v1:172.21.15.141:6789/0 conn(0x7f7af80c48e0 legacy=0x7f7af80adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.695+0000 7f7afdeda640 1 -- 172.21.15.114:0/891021254 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af815a6c0 con 0x7f7af8159c00 2023-11-04T01:38:33.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.696+0000 7f7afdeda640 1 --2- 172.21.15.114:0/891021254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7af8159c00 0x7f7af80cc890 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009870 tx=0x7f7af402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9470295c4dd0122 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:33.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.696+0000 7f7afced8640 1 -- 172.21.15.114:0/891021254 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4031640 con 0x7f7af8159c00 2023-11-04T01:38:33.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.696+0000 7f7afced8640 1 -- 172.21.15.114:0/891021254 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af40317a0 con 0x7f7af8159c00 2023-11-04T01:38:33.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.696+0000 7f7afced8640 1 -- 172.21.15.114:0/891021254 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4031b30 con 0x7f7af8159c00 2023-11-04T01:38:33.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.697+0000 7f7b0013e640 1 -- 172.21.15.114:0/891021254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7af8159c00 msgr2=0x7f7af80cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.697+0000 7f7b0013e640 1 --2- 172.21.15.114:0/891021254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7af8159c00 0x7f7af80cc890 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009870 tx=0x7f7af402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.697+0000 7f7b0013e640 1 -- 172.21.15.114:0/891021254 shutdown_connections 2023-11-04T01:38:33.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.697+0000 7f7b0013e640 1 --2- 172.21.15.114:0/891021254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7af80ae1d0 0x7f7af80c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.697+0000 7f7b0013e640 1 --2- 172.21.15.114:0/891021254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7af8159c00 0x7f7af80cc890 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.697+0000 7f7b0013e640 1 -- 172.21.15.114:0/891021254 >> 172.21.15.114:0/891021254 conn(0x7f7af80ce950 msgr2=0x7f7af80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:33.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.697+0000 7f7b0013e640 1 -- 172.21.15.114:0/891021254 shutdown_connections 2023-11-04T01:38:33.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.697+0000 7f7b0013e640 1 -- 172.21.15.114:0/891021254 wait complete. 2023-11-04T01:38:33.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.698+0000 7f7b0013e640 1 Processor -- start 2023-11-04T01:38:33.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.698+0000 7f7b0013e640 1 -- start start 2023-11-04T01:38:33.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7b0013e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7af80ae1d0 0x7f7af80b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7b0013e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7af80c48e0 0x7f7af80c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7b0013e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7af8159c00 0x7f7af8152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7b0013e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af80b3270 con 0x7f7af80ae1d0 2023-11-04T01:38:33.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7b0013e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af8144c10 con 0x7f7af8159c00 2023-11-04T01:38:33.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7b0013e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af80c6400 con 0x7f7af80c48e0 2023-11-04T01:38:33.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7afdeda640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7af80ae1d0 0x7f7af80b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7afdeda640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7af80ae1d0 0x7f7af80b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59820/0 (socket says 172.21.15.114:59820) 2023-11-04T01:38:33.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7afdeda640 1 -- 172.21.15.114:0/2577156254 learned_addr learned my addr 172.21.15.114:0/2577156254 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:33.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7afd6d9640 1 --2- 172.21.15.114:0/2577156254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7af80c48e0 0x7f7af80c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7afe6db640 1 --2- 172.21.15.114:0/2577156254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7af8159c00 0x7f7af8152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7afdeda640 1 -- 172.21.15.114:0/2577156254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7af80c48e0 msgr2=0x7f7af80c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7afdeda640 1 --2- 172.21.15.114:0/2577156254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7af80c48e0 0x7f7af80c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7afdeda640 1 -- 172.21.15.114:0/2577156254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7af8159c00 msgr2=0x7f7af8152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7afdeda640 1 --2- 172.21.15.114:0/2577156254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7af8159c00 0x7f7af8152b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7afdeda640 1 -- 172.21.15.114:0/2577156254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af40094d0 con 0x7f7af80ae1d0 2023-11-04T01:38:33.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.699+0000 7f7afdeda640 1 --2- 172.21.15.114:0/2577156254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7af80ae1d0 0x7f7af80b3690 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f7af4000c00 tx=0x7f7af40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:33.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.700+0000 7f7aee7fc640 1 -- 172.21.15.114:0/2577156254 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af403a930 con 0x7f7af80ae1d0 2023-11-04T01:38:33.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.700+0000 7f7aee7fc640 1 -- 172.21.15.114:0/2577156254 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af403aa90 con 0x7f7af80ae1d0 2023-11-04T01:38:33.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.700+0000 7f7b0013e640 1 -- 172.21.15.114:0/2577156254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af80b2bd0 con 0x7f7af80ae1d0 2023-11-04T01:38:33.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.700+0000 7f7aee7fc640 1 -- 172.21.15.114:0/2577156254 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af403ae40 con 0x7f7af80ae1d0 2023-11-04T01:38:33.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.700+0000 7f7b0013e640 1 -- 172.21.15.114:0/2577156254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af80b2e90 con 0x7f7af80ae1d0 2023-11-04T01:38:33.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.700+0000 7f7b0013e640 1 -- 172.21.15.114:0/2577156254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af80b33b0 con 0x7f7af80ae1d0 2023-11-04T01:38:33.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.701+0000 7f7aee7fc640 1 -- 172.21.15.114:0/2577156254 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7af402f050 con 0x7f7af80ae1d0 2023-11-04T01:38:33.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.701+0000 7f7aee7fc640 1 --2- 172.21.15.114:0/2577156254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7adc06ae70 0x7f7adc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.701+0000 7f7aee7fc640 1 -- 172.21.15.114:0/2577156254 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7af40ab4a0 con 0x7f7af80ae1d0 2023-11-04T01:38:33.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.701+0000 7f7afd6d9640 1 --2- 172.21.15.114:0/2577156254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7adc06ae70 0x7f7adc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.702+0000 7f7afd6d9640 1 --2- 172.21.15.114:0/2577156254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7adc06ae70 0x7f7adc06d330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7af80ae090 tx=0x7f7ae8000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:33.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.705+0000 7f7aee7fc640 1 -- 172.21.15.114:0/2577156254 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7af40763f0 con 0x7f7af80ae1d0 2023-11-04T01:38:33.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.871+0000 7f7b0013e640 1 -- 172.21.15.114:0/2577156254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f7af8074290 con 0x7f7af80ae1d0 2023-11-04T01:38:33.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.871+0000 7f7aee7fc640 1 -- 172.21.15.114:0/2577156254 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v54) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7af4079a10 con 0x7f7af80ae1d0 2023-11-04T01:38:33.873 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:38:33.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.873+0000 7f7b0013e640 1 -- 172.21.15.114:0/2577156254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7adc06ae70 msgr2=0x7f7adc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.873+0000 7f7b0013e640 1 --2- 172.21.15.114:0/2577156254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7adc06ae70 0x7f7adc06d330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7af80ae090 tx=0x7f7ae8000ed0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.873+0000 7f7b0013e640 1 -- 172.21.15.114:0/2577156254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7af80ae1d0 msgr2=0x7f7af80b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.873+0000 7f7b0013e640 1 --2- 172.21.15.114:0/2577156254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7af80ae1d0 0x7f7af80b3690 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f7af4000c00 tx=0x7f7af40046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.873+0000 7f7b0013e640 1 -- 172.21.15.114:0/2577156254 shutdown_connections 2023-11-04T01:38:33.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.873+0000 7f7b0013e640 1 --2- 172.21.15.114:0/2577156254 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7adc06ae70 0x7f7adc06d330 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.873+0000 7f7b0013e640 1 --2- 172.21.15.114:0/2577156254 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7af8159c00 0x7f7af8152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.873+0000 7f7b0013e640 1 --2- 172.21.15.114:0/2577156254 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7af80c48e0 0x7f7af80c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.873+0000 7f7b0013e640 1 --2- 172.21.15.114:0/2577156254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7af80ae1d0 0x7f7af80b3690 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.873+0000 7f7b0013e640 1 -- 172.21.15.114:0/2577156254 >> 172.21.15.114:0/2577156254 conn(0x7f7af80ce950 msgr2=0x7f7af80c37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:33.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.873+0000 7f7b0013e640 1 -- 172.21.15.114:0/2577156254 shutdown_connections 2023-11-04T01:38:33.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.873+0000 7f7b0013e640 1 -- 172.21.15.114:0/2577156254 wait complete. 2023-11-04T01:38:33.885 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:38:33.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.985+0000 7f1859c76640 1 Processor -- start 2023-11-04T01:38:33.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.985+0000 7f1859c76640 1 -- start start 2023-11-04T01:38:33.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.986+0000 7f1859c76640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f185406a830 0x7f18540ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.986+0000 7f1859c76640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f185415e590 0x7f18540722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.986+0000 7f1859c76640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18540ca620 con 0x7f185415e1b0 2023-11-04T01:38:33.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.986+0000 7f1859c76640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185406e7e0 con 0x7f185415e590 2023-11-04T01:38:33.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.986+0000 7f1859c76640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18540cb060 con 0x7f185406a830 2023-11-04T01:38:33.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.986+0000 7f1853fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f185415e590 0x7f18540722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.986+0000 7f1853fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f185415e590 0x7f18540722d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59824/0 (socket says 172.21.15.114:59824) 2023-11-04T01:38:33.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.986+0000 7f1853fff640 1 -- 172.21.15.114:0/1492669553 learned_addr learned my addr 172.21.15.114:0/1492669553 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:33.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.987+0000 7f1852ffd640 1 --2- 172.21.15.114:0/1492669553 >> v2:172.21.15.141:3300/0 conn(0x7f185406a830 0x7f18540ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.987+0000 7f1853fff640 1 -- 172.21.15.114:0/1492669553 >> v2:172.21.15.141:3300/0 conn(0x7f185406a830 msgr2=0x7f18540ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:33.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.987+0000 7f1853fff640 1 --2- 172.21.15.114:0/1492669553 >> v2:172.21.15.141:3300/0 conn(0x7f185406a830 0x7f18540ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.987+0000 7f1853fff640 1 -- 172.21.15.114:0/1492669553 >> v1:172.21.15.141:6789/0 conn(0x7f185415e1b0 legacy=0x7f185406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:33.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.987+0000 7f1853fff640 1 -- 172.21.15.114:0/1492669553 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18540ca060 con 0x7f185415e590 2023-11-04T01:38:33.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.987+0000 7f1852ffd640 1 --2- 172.21.15.114:0/1492669553 >> v2:172.21.15.141:3300/0 conn(0x7f185406a830 0x7f18540ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:33.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.987+0000 7f1853fff640 1 --2- 172.21.15.114:0/1492669553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f185415e590 0x7f18540722d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f18540cb710 tx=0x7f184c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6458cd2473e630 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:33.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.987+0000 7f18527fc640 1 -- 172.21.15.114:0/1492669553 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c02c9f0 con 0x7f185415e590 2023-11-04T01:38:33.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.988+0000 7f18527fc640 1 -- 172.21.15.114:0/1492669553 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c02cb50 con 0x7f185415e590 2023-11-04T01:38:33.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.988+0000 7f18527fc640 1 -- 172.21.15.114:0/1492669553 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c0343f0 con 0x7f185415e590 2023-11-04T01:38:33.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.988+0000 7f1859c76640 1 -- 172.21.15.114:0/1492669553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f185415e590 msgr2=0x7f18540722d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.988+0000 7f1859c76640 1 --2- 172.21.15.114:0/1492669553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f185415e590 0x7f18540722d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f18540cb710 tx=0x7f184c02be50 comp rx=0 tx=0).stop 2023-11-04T01:38:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.988+0000 7f1859c76640 1 -- 172.21.15.114:0/1492669553 shutdown_connections 2023-11-04T01:38:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.988+0000 7f1859c76640 1 --2- 172.21.15.114:0/1492669553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f185415e590 0x7f18540722d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.988+0000 7f1859c76640 1 --2- 172.21.15.114:0/1492669553 >> v2:172.21.15.141:3300/0 conn(0x7f185406a830 0x7f18540ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.988+0000 7f1859c76640 1 -- 172.21.15.114:0/1492669553 >> 172.21.15.114:0/1492669553 conn(0x7f185406d800 msgr2=0x7f185406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.988+0000 7f1859c76640 1 -- 172.21.15.114:0/1492669553 shutdown_connections 2023-11-04T01:38:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.988+0000 7f1859c76640 1 -- 172.21.15.114:0/1492669553 wait complete. 2023-11-04T01:38:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.989+0000 7f1859c76640 1 Processor -- start 2023-11-04T01:38:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.989+0000 7f1859c76640 1 -- start start 2023-11-04T01:38:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.990+0000 7f1859c76640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f185406a830 0x7f18540ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.990+0000 7f1859c76640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f185415e1b0 0x7f18540ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.990+0000 7f1859c76640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f185415e590 0x7f18540aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.990+0000 7f1859c76640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18540ad600 con 0x7f185415e590 2023-11-04T01:38:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.990+0000 7f1859c76640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18540a8260 con 0x7f185415e1b0 2023-11-04T01:38:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.990+0000 7f1859c76640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185415ab10 con 0x7f185406a830 2023-11-04T01:38:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.990+0000 7f1853fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f185415e590 0x7f18540aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.990+0000 7f1853fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f185415e590 0x7f18540aad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59828/0 (socket says 172.21.15.114:59828) 2023-11-04T01:38:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.990+0000 7f1853fff640 1 -- 172.21.15.114:0/2702533572 learned_addr learned my addr 172.21.15.114:0/2702533572 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.990+0000 7f18537fe640 1 --2- 172.21.15.114:0/2702533572 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f185406a830 0x7f18540ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.990+0000 7f1852ffd640 1 --2- 172.21.15.114:0/2702533572 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f185415e1b0 0x7f18540ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.991+0000 7f1853fff640 1 -- 172.21.15.114:0/2702533572 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f185406a830 msgr2=0x7f18540ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.991+0000 7f1853fff640 1 --2- 172.21.15.114:0/2702533572 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f185406a830 0x7f18540ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.991+0000 7f1853fff640 1 -- 172.21.15.114:0/2702533572 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f185415e1b0 msgr2=0x7f18540ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:33.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.991+0000 7f1853fff640 1 --2- 172.21.15.114:0/2702533572 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f185415e1b0 0x7f18540ae6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:33.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.991+0000 7f1853fff640 1 -- 172.21.15.114:0/2702533572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c009b30 con 0x7f185415e590 2023-11-04T01:38:33.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.991+0000 7f1852ffd640 1 --2- 172.21.15.114:0/2702533572 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f185415e1b0 0x7f18540ae6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:33.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.991+0000 7f1853fff640 1 --2- 172.21.15.114:0/2702533572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f185415e590 0x7f18540aad90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f184c036040 tx=0x7f184c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:33.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.991+0000 7f183bfff640 1 -- 172.21.15.114:0/2702533572 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c03e450 con 0x7f185415e590 2023-11-04T01:38:33.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.991+0000 7f183bfff640 1 -- 172.21.15.114:0/2702533572 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c03e5d0 con 0x7f185415e590 2023-11-04T01:38:33.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.991+0000 7f1859c76640 1 -- 172.21.15.114:0/2702533572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18540a7650 con 0x7f185415e590 2023-11-04T01:38:33.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.991+0000 7f183bfff640 1 -- 172.21.15.114:0/2702533572 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c03e980 con 0x7f185415e590 2023-11-04T01:38:33.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.991+0000 7f1859c76640 1 -- 172.21.15.114:0/2702533572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18540a7c10 con 0x7f185415e590 2023-11-04T01:38:33.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.992+0000 7f1859c76640 1 -- 172.21.15.114:0/2702533572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18540a83f0 con 0x7f185415e590 2023-11-04T01:38:33.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.992+0000 7f183bfff640 1 -- 172.21.15.114:0/2702533572 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f184c03eae0 con 0x7f185415e590 2023-11-04T01:38:33.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.993+0000 7f183bfff640 1 --2- 172.21.15.114:0/2702533572 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f184006ae70 0x7f184006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:33.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.993+0000 7f183bfff640 1 -- 172.21.15.114:0/2702533572 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f184c0aca50 con 0x7f185415e590 2023-11-04T01:38:33.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.993+0000 7f18537fe640 1 --2- 172.21.15.114:0/2702533572 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f184006ae70 0x7f184006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:33.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.993+0000 7f18537fe640 1 --2- 172.21.15.114:0/2702533572 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f184006ae70 0x7f184006d330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1844007fd0 tx=0x7f1844009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:34.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:33.997+0000 7f183bfff640 1 -- 172.21.15.114:0/2702533572 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f184c0778f0 con 0x7f185415e590 2023-11-04T01:38:34.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.162+0000 7f1859c76640 1 -- 172.21.15.114:0/2702533572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18540a83f0 con 0x7f185415e590 2023-11-04T01:38:34.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.163+0000 7f183bfff640 1 -- 172.21.15.114:0/2702533572 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f184c07af10 con 0x7f185415e590 2023-11-04T01:38:34.165 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:38:34.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.165+0000 7f1859c76640 1 -- 172.21.15.114:0/2702533572 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f184006ae70 msgr2=0x7f184006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.165+0000 7f1859c76640 1 --2- 172.21.15.114:0/2702533572 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f184006ae70 0x7f184006d330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1844007fd0 tx=0x7f1844009040 comp rx=0 tx=0).stop 2023-11-04T01:38:34.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.165+0000 7f1859c76640 1 -- 172.21.15.114:0/2702533572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f185415e590 msgr2=0x7f18540aad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.165+0000 7f1859c76640 1 --2- 172.21.15.114:0/2702533572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f185415e590 0x7f18540aad90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f184c036040 tx=0x7f184c004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:34.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.165+0000 7f1859c76640 1 -- 172.21.15.114:0/2702533572 shutdown_connections 2023-11-04T01:38:34.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.165+0000 7f1859c76640 1 --2- 172.21.15.114:0/2702533572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f185415e590 0x7f18540aad90 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.165+0000 7f1859c76640 1 --2- 172.21.15.114:0/2702533572 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f184006ae70 0x7f184006d330 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.165+0000 7f1859c76640 1 --2- 172.21.15.114:0/2702533572 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f185415e1b0 0x7f18540ae6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.165+0000 7f1859c76640 1 --2- 172.21.15.114:0/2702533572 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f185406a830 0x7f18540ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.165+0000 7f1859c76640 1 -- 172.21.15.114:0/2702533572 >> 172.21.15.114:0/2702533572 conn(0x7f185406d800 msgr2=0x7f18540b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:34.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.165+0000 7f1859c76640 1 -- 172.21.15.114:0/2702533572 shutdown_connections 2023-11-04T01:38:34.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.165+0000 7f1859c76640 1 -- 172.21.15.114:0/2702533572 wait complete. 2023-11-04T01:38:34.177 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:38:34.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.277+0000 7f0532c32640 1 Processor -- start 2023-11-04T01:38:34.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.277+0000 7f0532c32640 1 -- start start 2023-11-04T01:38:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.278+0000 7f0532c32640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f052c0c4ff0 0x7f052c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.278+0000 7f0532c32640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f052c0adac0 0x7f052c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.278+0000 7f0532c32640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052c15aff0 con 0x7f052c159c00 2023-11-04T01:38:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.278+0000 7f0532c32640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052c0ae450 con 0x7f052c0adac0 2023-11-04T01:38:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.278+0000 7f0532c32640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052c15a3e0 con 0x7f052c0c4ff0 2023-11-04T01:38:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.278+0000 7f05311cf640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f052c0adac0 0x7f052c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.278+0000 7f05311cf640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f052c0adac0 0x7f052c0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59834/0 (socket says 172.21.15.114:59834) 2023-11-04T01:38:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.278+0000 7f05311cf640 1 -- 172.21.15.114:0/490818368 learned_addr learned my addr 172.21.15.114:0/490818368 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.278+0000 7f052bfff640 1 --2- 172.21.15.114:0/490818368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f052c0c4ff0 0x7f052c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.278+0000 7f05311cf640 1 -- 172.21.15.114:0/490818368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f052c0c4ff0 msgr2=0x7f052c0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.278+0000 7f05311cf640 1 --2- 172.21.15.114:0/490818368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f052c0c4ff0 0x7f052c0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.278+0000 7f05311cf640 1 -- 172.21.15.114:0/490818368 >> v1:172.21.15.141:6789/0 conn(0x7f052c159c00 legacy=0x7f052c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.279+0000 7f05311cf640 1 -- 172.21.15.114:0/490818368 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c15a6c0 con 0x7f052c0adac0 2023-11-04T01:38:34.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.279+0000 7f05311cf640 1 --2- 172.21.15.114:0/490818368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f052c0adac0 0x7f052c0adf10 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0524009e50 tx=0x7f052402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f701475c0de68418 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:34.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.279+0000 7f052b7fe640 1 -- 172.21.15.114:0/490818368 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052402ca70 con 0x7f052c0adac0 2023-11-04T01:38:34.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.279+0000 7f052b7fe640 1 -- 172.21.15.114:0/490818368 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052402cbd0 con 0x7f052c0adac0 2023-11-04T01:38:34.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.279+0000 7f052b7fe640 1 -- 172.21.15.114:0/490818368 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05240343f0 con 0x7f052c0adac0 2023-11-04T01:38:34.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.280+0000 7f0532c32640 1 -- 172.21.15.114:0/490818368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f052c0adac0 msgr2=0x7f052c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.280+0000 7f0532c32640 1 --2- 172.21.15.114:0/490818368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f052c0adac0 0x7f052c0adf10 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0524009e50 tx=0x7f052402bed0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.280+0000 7f0532c32640 1 -- 172.21.15.114:0/490818368 shutdown_connections 2023-11-04T01:38:34.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.280+0000 7f0532c32640 1 --2- 172.21.15.114:0/490818368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f052c0adac0 0x7f052c0adf10 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.280+0000 7f0532c32640 1 --2- 172.21.15.114:0/490818368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f052c0c4ff0 0x7f052c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.280+0000 7f0532c32640 1 -- 172.21.15.114:0/490818368 >> 172.21.15.114:0/490818368 conn(0x7f052c0ce950 msgr2=0x7f052c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:34.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.280+0000 7f0532c32640 1 -- 172.21.15.114:0/490818368 shutdown_connections 2023-11-04T01:38:34.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.280+0000 7f0532c32640 1 -- 172.21.15.114:0/490818368 wait complete. 2023-11-04T01:38:34.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.281+0000 7f0532c32640 1 Processor -- start 2023-11-04T01:38:34.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.281+0000 7f0532c32640 1 -- start start 2023-11-04T01:38:34.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f0532c32640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f052c0adac0 0x7f052c0a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f0532c32640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f052c0c4ff0 0x7f052c0ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f0532c32640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f052c159c00 0x7f052c0ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f0532c32640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c0a9260 con 0x7f052c0c4ff0 2023-11-04T01:38:34.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f0532c32640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c0acd10 con 0x7f052c159c00 2023-11-04T01:38:34.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f0532c32640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052c0acff0 con 0x7f052c0adac0 2023-11-04T01:38:34.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f052bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f052c0c4ff0 0x7f052c0ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f052bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f052c0c4ff0 0x7f052c0ac1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59850/0 (socket says 172.21.15.114:59850) 2023-11-04T01:38:34.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f052bfff640 1 -- 172.21.15.114:0/625846501 learned_addr learned my addr 172.21.15.114:0/625846501 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:34.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f05311cf640 1 --2- 172.21.15.114:0/625846501 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f052c159c00 0x7f052c0ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f05309ce640 1 --2- 172.21.15.114:0/625846501 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f052c0adac0 0x7f052c0a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f052bfff640 1 -- 172.21.15.114:0/625846501 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f052c0adac0 msgr2=0x7f052c0a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f052bfff640 1 --2- 172.21.15.114:0/625846501 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f052c0adac0 0x7f052c0a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f052bfff640 1 -- 172.21.15.114:0/625846501 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f052c159c00 msgr2=0x7f052c0ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f052bfff640 1 --2- 172.21.15.114:0/625846501 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f052c159c00 0x7f052c0ac700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f052bfff640 1 -- 172.21.15.114:0/625846501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0524009b30 con 0x7f052c0c4ff0 2023-11-04T01:38:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.282+0000 7f052bfff640 1 --2- 172.21.15.114:0/625846501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f052c0c4ff0 0x7f052c0ac1c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f052000d7d0 tx=0x7f052000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.283+0000 7f05297fa640 1 -- 172.21.15.114:0/625846501 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0520018070 con 0x7f052c0c4ff0 2023-11-04T01:38:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.283+0000 7f05297fa640 1 -- 172.21.15.114:0/625846501 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0520004020 con 0x7f052c0c4ff0 2023-11-04T01:38:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.283+0000 7f05297fa640 1 -- 172.21.15.114:0/625846501 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05200041b0 con 0x7f052c0c4ff0 2023-11-04T01:38:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.283+0000 7f0532c32640 1 -- 172.21.15.114:0/625846501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052c0ad2d0 con 0x7f052c0c4ff0 2023-11-04T01:38:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.283+0000 7f0532c32640 1 -- 172.21.15.114:0/625846501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052c0a7a90 con 0x7f052c0c4ff0 2023-11-04T01:38:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.284+0000 7f0532c32640 1 -- 172.21.15.114:0/625846501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052c0a7c20 con 0x7f052c0c4ff0 2023-11-04T01:38:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.284+0000 7f05297fa640 1 -- 172.21.15.114:0/625846501 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0520004310 con 0x7f052c0c4ff0 2023-11-04T01:38:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.284+0000 7f05297fa640 1 --2- 172.21.15.114:0/625846501 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f051806ae70 0x7f051806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.284+0000 7f05297fa640 1 -- 172.21.15.114:0/625846501 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f05200897c0 con 0x7f052c0c4ff0 2023-11-04T01:38:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.284+0000 7f05309ce640 1 --2- 172.21.15.114:0/625846501 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f051806ae70 0x7f051806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.285+0000 7f05309ce640 1 --2- 172.21.15.114:0/625846501 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f051806ae70 0x7f051806d330 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f051c006fd0 tx=0x7f051c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:34.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.288+0000 7f05297fa640 1 -- 172.21.15.114:0/625846501 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f05200545d0 con 0x7f052c0c4ff0 2023-11-04T01:38:34.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.456+0000 7f0532c32640 1 -- 172.21.15.114:0/625846501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f052c074290 con 0x7f052c0c4ff0 2023-11-04T01:38:34.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.456+0000 7f05297fa640 1 -- 172.21.15.114:0/625846501 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0520057bf0 con 0x7f052c0c4ff0 2023-11-04T01:38:34.458 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:38:34.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.458+0000 7f0532c32640 1 -- 172.21.15.114:0/625846501 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f051806ae70 msgr2=0x7f051806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.458+0000 7f0532c32640 1 --2- 172.21.15.114:0/625846501 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f051806ae70 0x7f051806d330 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f051c006fd0 tx=0x7f051c008040 comp rx=0 tx=0).stop 2023-11-04T01:38:34.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.458+0000 7f0532c32640 1 -- 172.21.15.114:0/625846501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f052c0c4ff0 msgr2=0x7f052c0ac1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.458+0000 7f0532c32640 1 --2- 172.21.15.114:0/625846501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f052c0c4ff0 0x7f052c0ac1c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f052000d7d0 tx=0x7f052000dc90 comp rx=0 tx=0).stop 2023-11-04T01:38:34.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.458+0000 7f0532c32640 1 -- 172.21.15.114:0/625846501 shutdown_connections 2023-11-04T01:38:34.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.458+0000 7f0532c32640 1 --2- 172.21.15.114:0/625846501 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f051806ae70 0x7f051806d330 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.458+0000 7f0532c32640 1 --2- 172.21.15.114:0/625846501 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f052c159c00 0x7f052c0ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.458+0000 7f0532c32640 1 --2- 172.21.15.114:0/625846501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f052c0c4ff0 0x7f052c0ac1c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.458+0000 7f0532c32640 1 --2- 172.21.15.114:0/625846501 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f052c0adac0 0x7f052c0a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.458+0000 7f0532c32640 1 -- 172.21.15.114:0/625846501 >> 172.21.15.114:0/625846501 conn(0x7f052c0ce950 msgr2=0x7f052c0c4850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:34.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.458+0000 7f0532c32640 1 -- 172.21.15.114:0/625846501 shutdown_connections 2023-11-04T01:38:34.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.458+0000 7f0532c32640 1 -- 172.21.15.114:0/625846501 wait complete. 2023-11-04T01:38:34.472 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:38:34.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.569+0000 7f6685256640 1 Processor -- start 2023-11-04T01:38:34.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.569+0000 7f6685256640 1 -- start start 2023-11-04T01:38:34.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.570+0000 7f6685256640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6680159c00 0x7f66800cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.570+0000 7f6685256640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668015aff0 con 0x7f66800ae1d0 2023-11-04T01:38:34.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.570+0000 7f6685256640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668015a3e0 con 0x7f66800c48e0 2023-11-04T01:38:34.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.570+0000 7f6685256640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668015a6c0 con 0x7f6680159c00 2023-11-04T01:38:34.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.570+0000 7f667f59e640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f66800ae1d0 0x7f66800709f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42480/0 (socket says 172.21.15.114:42480) 2023-11-04T01:38:34.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.570+0000 7f667f59e640 1 -- 172.21.15.114:0/415893827 learned_addr learned my addr 172.21.15.114:0/415893827 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:34.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.570+0000 7f667dd9b640 1 -- 172.21.15.114:0/415893827 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737667633 0 0) 0x7f668015aff0 con 0x7f66800ae1d0 2023-11-04T01:38:34.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.570+0000 7f667dd9b640 1 -- 172.21.15.114:0/415893827 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6668003520 con 0x7f66800ae1d0 2023-11-04T01:38:34.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.570+0000 7f667ed9d640 1 --2- 172.21.15.114:0/415893827 >> v2:172.21.15.141:3300/0 conn(0x7f6680159c00 0x7f66800cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.570+0000 7f667dd9b640 1 -- 172.21.15.114:0/415893827 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2460103868 0 0) 0x7f6668003520 con 0x7f66800ae1d0 2023-11-04T01:38:34.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.570+0000 7f667dd9b640 1 -- 172.21.15.114:0/415893827 >> v2:172.21.15.141:3300/0 conn(0x7f6680159c00 msgr2=0x7f66800cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:34.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.570+0000 7f667dd9b640 1 --2- 172.21.15.114:0/415893827 >> v2:172.21.15.141:3300/0 conn(0x7f6680159c00 0x7f66800cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.570+0000 7f667dd9b640 1 -- 172.21.15.114:0/415893827 >> v1:172.21.15.141:6789/0 conn(0x7f66800c48e0 legacy=0x7f66800adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667dd9b640 1 -- 172.21.15.114:0/415893827 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668015a9a0 con 0x7f66800ae1d0 2023-11-04T01:38:34.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667dd9b640 1 -- 172.21.15.114:0/415893827 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f6678001670 con 0x7f66800ae1d0 2023-11-04T01:38:34.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667dd9b640 1 -- 172.21.15.114:0/415893827 >> v1:172.21.15.114:6789/0 conn(0x7f66800ae1d0 legacy=0x7f66800709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667dd9b640 1 --2- 172.21.15.114:0/415893827 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6668003970 0x7f6668003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667dd9b640 1 --2- 172.21.15.114:0/415893827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66680047c0 0x7f6668004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667dd9b640 1 --2- 172.21.15.114:0/415893827 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6668005180 0x7f666800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667dd9b640 1 -- 172.21.15.114:0/415893827 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668015a6c0 con 0x7f66680047c0 2023-11-04T01:38:34.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667dd9b640 1 -- 172.21.15.114:0/415893827 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666800c120 con 0x7f6668003970 2023-11-04T01:38:34.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667dd9b640 1 -- 172.21.15.114:0/415893827 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666800c2e0 con 0x7f6668005180 2023-11-04T01:38:34.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667e59c640 1 --2- 172.21.15.114:0/415893827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66680047c0 0x7f6668004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667ed9d640 1 --2- 172.21.15.114:0/415893827 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6668003970 0x7f6668003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667f59e640 1 --2- 172.21.15.114:0/415893827 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6668005180 0x7f666800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667e59c640 1 -- 172.21.15.114:0/415893827 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6668005180 msgr2=0x7f666800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:34.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667e59c640 1 --2- 172.21.15.114:0/415893827 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6668005180 0x7f666800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667e59c640 1 -- 172.21.15.114:0/415893827 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6668003970 msgr2=0x7f6668003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:34.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667e59c640 1 --2- 172.21.15.114:0/415893827 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6668003970 0x7f6668003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667e59c640 1 -- 172.21.15.114:0/415893827 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6668003520 con 0x7f66680047c0 2023-11-04T01:38:34.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.571+0000 7f667f59e640 1 -- 172.21.15.114:0/415893827 reap_dead start 2023-11-04T01:38:34.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.572+0000 7f667e59c640 1 --2- 172.21.15.114:0/415893827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66680047c0 0x7f6668004c40 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6674001750 tx=0x7f66680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f160b0eac07f2ea9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:34.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.572+0000 7f667dd9b640 1 -- 172.21.15.114:0/415893827 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66740052d0 con 0x7f66680047c0 2023-11-04T01:38:34.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.572+0000 7f667dd9b640 1 -- 172.21.15.114:0/415893827 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667402e050 con 0x7f66680047c0 2023-11-04T01:38:34.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.572+0000 7f667dd9b640 1 -- 172.21.15.114:0/415893827 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674003830 con 0x7f66680047c0 2023-11-04T01:38:34.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.572+0000 7f6685256640 1 -- 172.21.15.114:0/415893827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66680047c0 msgr2=0x7f6668004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.572+0000 7f6685256640 1 --2- 172.21.15.114:0/415893827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66680047c0 0x7f6668004c40 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6674001750 tx=0x7f66680057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.572+0000 7f6685256640 1 -- 172.21.15.114:0/415893827 shutdown_connections 2023-11-04T01:38:34.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.572+0000 7f6685256640 1 --2- 172.21.15.114:0/415893827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66680047c0 0x7f6668004c40 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.572+0000 7f6685256640 1 -- 172.21.15.114:0/415893827 >> 172.21.15.114:0/415893827 conn(0x7f66800ce950 msgr2=0x7f66800ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:34.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.572+0000 7f6685256640 1 -- 172.21.15.114:0/415893827 shutdown_connections 2023-11-04T01:38:34.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.572+0000 7f6685256640 1 -- 172.21.15.114:0/415893827 wait complete. 2023-11-04T01:38:34.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.574+0000 7f6685256640 1 Processor -- start 2023-11-04T01:38:34.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.574+0000 7f6685256640 1 -- start start 2023-11-04T01:38:34.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f6685256640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66680047c0 0x7f6680146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f6685256640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66801476a0 0x7f668014cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f6685256640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6680147b20 0x7f66800c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f6685256640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680146b50 con 0x7f66801476a0 2023-11-04T01:38:34.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f6685256640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66800c5d90 con 0x7f66680047c0 2023-11-04T01:38:34.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f6685256640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66800c6070 con 0x7f6680147b20 2023-11-04T01:38:34.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f667e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66801476a0 0x7f668014cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f667e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66801476a0 0x7f668014cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59870/0 (socket says 172.21.15.114:59870) 2023-11-04T01:38:34.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f667e59c640 1 -- 172.21.15.114:0/2896552814 learned_addr learned my addr 172.21.15.114:0/2896552814 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:34.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f667f59e640 1 --2- 172.21.15.114:0/2896552814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6680147b20 0x7f66800c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f667ed9d640 1 --2- 172.21.15.114:0/2896552814 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66680047c0 0x7f6680146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f667e59c640 1 -- 172.21.15.114:0/2896552814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6680147b20 msgr2=0x7f66800c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f667e59c640 1 --2- 172.21.15.114:0/2896552814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6680147b20 0x7f66800c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f667e59c640 1 -- 172.21.15.114:0/2896552814 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66680047c0 msgr2=0x7f6680146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f667e59c640 1 --2- 172.21.15.114:0/2896552814 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66680047c0 0x7f6680146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f667e59c640 1 -- 172.21.15.114:0/2896552814 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66800c6350 con 0x7f66801476a0 2023-11-04T01:38:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f667f59e640 1 --2- 172.21.15.114:0/2896552814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6680147b20 0x7f66800c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f667ed9d640 1 --2- 172.21.15.114:0/2896552814 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66680047c0 0x7f6680146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f667e59c640 1 --2- 172.21.15.114:0/2896552814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66801476a0 0x7f668014cbc0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f667402bc00 tx=0x7f6674001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f66677fe640 1 -- 172.21.15.114:0/2896552814 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66740076c0 con 0x7f66801476a0 2023-11-04T01:38:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f66677fe640 1 -- 172.21.15.114:0/2896552814 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6674007a30 con 0x7f66801476a0 2023-11-04T01:38:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f66677fe640 1 -- 172.21.15.114:0/2896552814 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674006be0 con 0x7f66801476a0 2023-11-04T01:38:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f6685256640 1 -- 172.21.15.114:0/2896552814 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66800c6630 con 0x7f66801476a0 2023-11-04T01:38:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.575+0000 7f6685256640 1 -- 172.21.15.114:0/2896552814 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66800c5a20 con 0x7f66801476a0 2023-11-04T01:38:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.576+0000 7f6685256640 1 -- 172.21.15.114:0/2896552814 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6680074290 con 0x7f66801476a0 2023-11-04T01:38:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.577+0000 7f66677fe640 1 -- 172.21.15.114:0/2896552814 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6674006d40 con 0x7f66801476a0 2023-11-04T01:38:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.577+0000 7f66677fe640 1 --2- 172.21.15.114:0/2896552814 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f666c06aea0 0x7f666c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.577+0000 7f66677fe640 1 -- 172.21.15.114:0/2896552814 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f66740ab430 con 0x7f66801476a0 2023-11-04T01:38:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.577+0000 7f667ed9d640 1 --2- 172.21.15.114:0/2896552814 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f666c06aea0 0x7f666c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:34.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.578+0000 7f667ed9d640 1 --2- 172.21.15.114:0/2896552814 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f666c06aea0 0x7f666c06d360 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6670007520 tx=0x7f667000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:34.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.582+0000 7f66677fe640 1 -- 172.21.15.114:0/2896552814 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f66740762d0 con 0x7f66801476a0 2023-11-04T01:38:34.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.759+0000 7f6685256640 1 -- 172.21.15.114:0/2896552814 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f66800c9750 con 0x7f66801476a0 2023-11-04T01:38:34.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.760+0000 7f66677fe640 1 -- 172.21.15.114:0/2896552814 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f66740798f0 con 0x7f66801476a0 2023-11-04T01:38:34.762 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-11-04T01:38:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.762+0000 7f6685256640 1 -- 172.21.15.114:0/2896552814 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f666c06aea0 msgr2=0x7f666c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.762+0000 7f6685256640 1 --2- 172.21.15.114:0/2896552814 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f666c06aea0 0x7f666c06d360 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6670007520 tx=0x7f667000b040 comp rx=0 tx=0).stop 2023-11-04T01:38:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.762+0000 7f6685256640 1 -- 172.21.15.114:0/2896552814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66801476a0 msgr2=0x7f668014cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.762+0000 7f6685256640 1 --2- 172.21.15.114:0/2896552814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66801476a0 0x7f668014cbc0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f667402bc00 tx=0x7f6674001120 comp rx=0 tx=0).stop 2023-11-04T01:38:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.762+0000 7f6685256640 1 -- 172.21.15.114:0/2896552814 shutdown_connections 2023-11-04T01:38:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.762+0000 7f6685256640 1 --2- 172.21.15.114:0/2896552814 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6680147b20 0x7f66800c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.762+0000 7f6685256640 1 --2- 172.21.15.114:0/2896552814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66801476a0 0x7f668014cbc0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.762+0000 7f6685256640 1 --2- 172.21.15.114:0/2896552814 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f666c06aea0 0x7f666c06d360 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.762+0000 7f6685256640 1 --2- 172.21.15.114:0/2896552814 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66680047c0 0x7f6680146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.762+0000 7f6685256640 1 -- 172.21.15.114:0/2896552814 >> 172.21.15.114:0/2896552814 conn(0x7f66800ce950 msgr2=0x7f668006df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.762+0000 7f6685256640 1 -- 172.21.15.114:0/2896552814 shutdown_connections 2023-11-04T01:38:34.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34.762+0000 7f6685256640 1 -- 172.21.15.114:0/2896552814 wait complete. 2023-11-04T01:38:34.774 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi114.front.sepia.ceph.com... 2023-11-04T01:38:34.774 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:34.775 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:34.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:34.833 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[108452]: fuse finished with error 0 and tester_r 0 2023-11-04T01:38:34.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:34.839 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:38:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:34.840 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:38:34.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:34.841 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:38:34.856 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:38:34.856 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:34.875 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:34.875 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:38:34.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:34.876 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:38:34.934 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:34.935 INFO:teuthology.orchestra.run.smithi141.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:38:34.935 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:38:34.935 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:34.951 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:34.951 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:38:34.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:34.951 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:38:35.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:38:35.008 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:38:35.008 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:35.026 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:35.026 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:38:35.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:35.027 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:38:35.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:35.084 INFO:teuthology.orchestra.run.smithi141.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:38:35.085 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:35.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.183+0000 7f5964df5640 1 Processor -- start 2023-11-04T01:38:35.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.183+0000 7f5964df5640 1 -- start start 2023-11-04T01:38:35.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.184+0000 7f5964df5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5960159c70 0x7f59600ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.184+0000 7f5964df5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59600b4110 con 0x7f596006db20 2023-11-04T01:38:35.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.184+0000 7f5964df5640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59600b43f0 con 0x7f59600b0ae0 2023-11-04T01:38:35.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.184+0000 7f5964df5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59600b49b0 con 0x7f5960159c70 2023-11-04T01:38:35.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.184+0000 7f595dd9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f596006db20 0x7f59600b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42486/0 (socket says 172.21.15.114:42486) 2023-11-04T01:38:35.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.184+0000 7f595dd9b640 1 -- 172.21.15.114:0/2472685023 learned_addr learned my addr 172.21.15.114:0/2472685023 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:35.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.184+0000 7f595e59c640 1 --2- 172.21.15.114:0/2472685023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5960159c70 0x7f59600ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.184+0000 7f595d59a640 1 -- 172.21.15.114:0/2472685023 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820873139 0 0) 0x7f59600b4110 con 0x7f596006db20 2023-11-04T01:38:35.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.184+0000 7f595d59a640 1 -- 172.21.15.114:0/2472685023 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5948003520 con 0x7f596006db20 2023-11-04T01:38:35.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.184+0000 7f595e59c640 1 -- 172.21.15.114:0/2472685023 >> v1:172.21.15.141:6789/0 conn(0x7f59600b0ae0 legacy=0x7f596015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.184+0000 7f595e59c640 1 -- 172.21.15.114:0/2472685023 >> v1:172.21.15.114:6789/0 conn(0x7f596006db20 legacy=0x7f59600b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.184+0000 7f595e59c640 1 -- 172.21.15.114:0/2472685023 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600b46d0 con 0x7f5960159c70 2023-11-04T01:38:35.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.185+0000 7f595e59c640 1 --2- 172.21.15.114:0/2472685023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5960159c70 0x7f59600ce370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f59500097d0 tx=0x7f595002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7f41cde1759c2a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.185+0000 7f595d59a640 1 -- 172.21.15.114:0/2472685023 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950031890 con 0x7f5960159c70 2023-11-04T01:38:35.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.185+0000 7f595d59a640 1 -- 172.21.15.114:0/2472685023 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59500319f0 con 0x7f5960159c70 2023-11-04T01:38:35.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.185+0000 7f595d59a640 1 -- 172.21.15.114:0/2472685023 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950031d60 con 0x7f5960159c70 2023-11-04T01:38:35.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.186+0000 7f5964df5640 1 -- 172.21.15.114:0/2472685023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5960159c70 msgr2=0x7f59600ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.186+0000 7f5964df5640 1 --2- 172.21.15.114:0/2472685023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5960159c70 0x7f59600ce370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f59500097d0 tx=0x7f595002b930 comp rx=0 tx=0).stop 2023-11-04T01:38:35.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.186+0000 7f5964df5640 1 -- 172.21.15.114:0/2472685023 shutdown_connections 2023-11-04T01:38:35.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.186+0000 7f5964df5640 1 --2- 172.21.15.114:0/2472685023 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5960159c70 0x7f59600ce370 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.186+0000 7f5964df5640 1 -- 172.21.15.114:0/2472685023 >> 172.21.15.114:0/2472685023 conn(0x7f59600ce950 msgr2=0x7f59600ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:35.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.186+0000 7f5964df5640 1 -- 172.21.15.114:0/2472685023 shutdown_connections 2023-11-04T01:38:35.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.186+0000 7f5964df5640 1 -- 172.21.15.114:0/2472685023 wait complete. 2023-11-04T01:38:35.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.187+0000 7f5964df5640 1 Processor -- start 2023-11-04T01:38:35.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.187+0000 7f5964df5640 1 -- start start 2023-11-04T01:38:35.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f5964df5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f596006db20 0x7f59600c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f5964df5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59600b0ae0 0x7f596014f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f5964df5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5960159c70 0x7f5960070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f5964df5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59600c69b0 con 0x7f59600b0ae0 2023-11-04T01:38:35.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f5964df5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596014f5c0 con 0x7f5960159c70 2023-11-04T01:38:35.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f5964df5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5960155df0 con 0x7f596006db20 2023-11-04T01:38:35.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f595dd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59600b0ae0 0x7f596014f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f595dd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59600b0ae0 0x7f596014f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59880/0 (socket says 172.21.15.114:59880) 2023-11-04T01:38:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f595dd9b640 1 -- 172.21.15.114:0/1508924130 learned_addr learned my addr 172.21.15.114:0/1508924130 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f595dd9b640 1 -- 172.21.15.114:0/1508924130 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f596006db20 msgr2=0x7f59600c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f595dd9b640 1 --2- 172.21.15.114:0/1508924130 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f596006db20 0x7f59600c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f595dd9b640 1 -- 172.21.15.114:0/1508924130 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5960159c70 msgr2=0x7f5960070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f595ed9d640 1 --2- 172.21.15.114:0/1508924130 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5960159c70 0x7f5960070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f595dd9b640 1 --2- 172.21.15.114:0/1508924130 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5960159c70 0x7f5960070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f595dd9b640 1 -- 172.21.15.114:0/1508924130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5950009400 con 0x7f59600b0ae0 2023-11-04T01:38:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f595dd9b640 1 --2- 172.21.15.114:0/1508924130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59600b0ae0 0x7f596014f080 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f595400c530 tx=0x7f595400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f594effd640 1 -- 172.21.15.114:0/1508924130 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954005ce0 con 0x7f59600b0ae0 2023-11-04T01:38:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f594effd640 1 -- 172.21.15.114:0/1508924130 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5954005e40 con 0x7f59600b0ae0 2023-11-04T01:38:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f5964df5640 1 -- 172.21.15.114:0/1508924130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59601f35b0 con 0x7f59600b0ae0 2023-11-04T01:38:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.188+0000 7f594effd640 1 -- 172.21.15.114:0/1508924130 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59540072b0 con 0x7f59600b0ae0 2023-11-04T01:38:35.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.189+0000 7f5964df5640 1 -- 172.21.15.114:0/1508924130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59600c5990 con 0x7f59600b0ae0 2023-11-04T01:38:35.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.190+0000 7f5964df5640 1 -- 172.21.15.114:0/1508924130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5960074290 con 0x7f59600b0ae0 2023-11-04T01:38:35.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.190+0000 7f594effd640 1 -- 172.21.15.114:0/1508924130 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5954007410 con 0x7f59600b0ae0 2023-11-04T01:38:35.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.190+0000 7f594effd640 1 --2- 172.21.15.114:0/1508924130 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f594006ae70 0x7f594006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.190+0000 7f594effd640 1 -- 172.21.15.114:0/1508924130 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5954088e80 con 0x7f59600b0ae0 2023-11-04T01:38:35.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.190+0000 7f595e59c640 1 --2- 172.21.15.114:0/1508924130 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f594006ae70 0x7f594006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.191+0000 7f595e59c640 1 --2- 172.21.15.114:0/1508924130 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f594006ae70 0x7f594006d330 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5950036000 tx=0x7f5950030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.195+0000 7f594effd640 1 -- 172.21.15.114:0/1508924130 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5954053d60 con 0x7f59600b0ae0 2023-11-04T01:38:35.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.398+0000 7f5964df5640 1 -- 172.21.15.114:0/1508924130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f596006d3f0 con 0x7f59600b0ae0 2023-11-04T01:38:35.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.398+0000 7f594effd640 1 -- 172.21.15.114:0/1508924130 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f5954057380 con 0x7f59600b0ae0 2023-11-04T01:38:35.400 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:35.400 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1567359819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1567359819},{"type":"v1","addr":"172.21.15.141:6834","nonce":1567359819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/1960196694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":1960196694},{"type":"v1","addr":"172.21.15.141:6835","nonce":1960196694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2773454420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2773454420},{"type":"v1","addr":"172.21.15.114:6836","nonce":2773454420}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:19.359102+0000","modified":"2023-11-04T01:38:21.895586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6039":{"gid":6039,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2391405125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2391405125},{"type":"v1","addr":"172.21.15.114:6837","nonce":2391405125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:38:35.400 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 23 2023-11-04T01:38:35.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.400+0000 7f5964df5640 1 -- 172.21.15.114:0/1508924130 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f594006ae70 msgr2=0x7f594006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.400+0000 7f5964df5640 1 --2- 172.21.15.114:0/1508924130 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f594006ae70 0x7f594006d330 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5950036000 tx=0x7f5950030000 comp rx=0 tx=0).stop 2023-11-04T01:38:35.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.400+0000 7f5964df5640 1 -- 172.21.15.114:0/1508924130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59600b0ae0 msgr2=0x7f596014f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.400+0000 7f5964df5640 1 --2- 172.21.15.114:0/1508924130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59600b0ae0 0x7f596014f080 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f595400c530 tx=0x7f595400c9f0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.400+0000 7f5964df5640 1 -- 172.21.15.114:0/1508924130 shutdown_connections 2023-11-04T01:38:35.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.400+0000 7f5964df5640 1 --2- 172.21.15.114:0/1508924130 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f594006ae70 0x7f594006d330 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.400+0000 7f5964df5640 1 --2- 172.21.15.114:0/1508924130 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5960159c70 0x7f5960070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.400+0000 7f5964df5640 1 --2- 172.21.15.114:0/1508924130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59600b0ae0 0x7f596014f080 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.400+0000 7f5964df5640 1 --2- 172.21.15.114:0/1508924130 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f596006db20 0x7f59600c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.400+0000 7f5964df5640 1 -- 172.21.15.114:0/1508924130 >> 172.21.15.114:0/1508924130 conn(0x7f59600ce950 msgr2=0x7f59600ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:35.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.400+0000 7f5964df5640 1 -- 172.21.15.114:0/1508924130 shutdown_connections 2023-11-04T01:38:35.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.400+0000 7f5964df5640 1 -- 172.21.15.114:0/1508924130 wait complete. 2023-11-04T01:38:35.412 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:35.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.510+0000 7f99153d7640 1 Processor -- start 2023-11-04T01:38:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.510+0000 7f99153d7640 1 -- start start 2023-11-04T01:38:35.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.510+0000 7f99153d7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f99100cde60 0x7f991015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.510+0000 7f99153d7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f991015daa0 0x7f9910157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.510+0000 7f99153d7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99100ce240 0x7f9910157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.510+0000 7f99153d7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991015e5c0 con 0x7f99100ce240 2023-11-04T01:38:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.510+0000 7f99153d7640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9910157a80 con 0x7f99100cde60 2023-11-04T01:38:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.510+0000 7f99153d7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991015e000 con 0x7f991015daa0 2023-11-04T01:38:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.511+0000 7f990f7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99100ce240 0x7f9910157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.511+0000 7f990f7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99100ce240 0x7f9910157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59882/0 (socket says 172.21.15.114:59882) 2023-11-04T01:38:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.511+0000 7f990f7fe640 1 -- 172.21.15.114:0/1720673741 learned_addr learned my addr 172.21.15.114:0/1720673741 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.511+0000 7f990e7fc640 1 --2- 172.21.15.114:0/1720673741 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f991015daa0 0x7f9910157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.511+0000 7f990effd640 1 --2- 172.21.15.114:0/1720673741 >> v2:172.21.15.141:3300/0 conn(0x7f99100cde60 0x7f991015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.511+0000 7f990f7fe640 1 -- 172.21.15.114:0/1720673741 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f991015daa0 msgr2=0x7f9910157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.511+0000 7f990f7fe640 1 --2- 172.21.15.114:0/1720673741 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f991015daa0 0x7f9910157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.511+0000 7f990f7fe640 1 -- 172.21.15.114:0/1720673741 >> v2:172.21.15.141:3300/0 conn(0x7f99100cde60 msgr2=0x7f991015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:35.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.511+0000 7f990f7fe640 1 --2- 172.21.15.114:0/1720673741 >> v2:172.21.15.141:3300/0 conn(0x7f99100cde60 0x7f991015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.511+0000 7f990f7fe640 1 -- 172.21.15.114:0/1720673741 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991015e2e0 con 0x7f99100ce240 2023-11-04T01:38:35.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.511+0000 7f990e7fc640 1 --2- 172.21.15.114:0/1720673741 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f991015daa0 0x7f9910157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:35.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.511+0000 7f990effd640 1 --2- 172.21.15.114:0/1720673741 >> v2:172.21.15.141:3300/0 conn(0x7f99100cde60 0x7f991015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:35.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.512+0000 7f990f7fe640 1 --2- 172.21.15.114:0/1720673741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100ce240 0x7f9910157540 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f99100b5550 tx=0x7f990802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebcfa78d6cd15a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.512+0000 7f990dffb640 1 -- 172.21.15.114:0/1720673741 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9908031870 con 0x7f99100ce240 2023-11-04T01:38:35.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.512+0000 7f990dffb640 1 -- 172.21.15.114:0/1720673741 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99080319d0 con 0x7f99100ce240 2023-11-04T01:38:35.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.512+0000 7f990dffb640 1 -- 172.21.15.114:0/1720673741 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9908031d60 con 0x7f99100ce240 2023-11-04T01:38:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.512+0000 7f99153d7640 1 -- 172.21.15.114:0/1720673741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100ce240 msgr2=0x7f9910157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.512+0000 7f99153d7640 1 --2- 172.21.15.114:0/1720673741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100ce240 0x7f9910157540 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f99100b5550 tx=0x7f990802b910 comp rx=0 tx=0).stop 2023-11-04T01:38:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.512+0000 7f99153d7640 1 -- 172.21.15.114:0/1720673741 shutdown_connections 2023-11-04T01:38:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.512+0000 7f99153d7640 1 --2- 172.21.15.114:0/1720673741 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f991015daa0 0x7f9910157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.512+0000 7f99153d7640 1 --2- 172.21.15.114:0/1720673741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100ce240 0x7f9910157540 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.512+0000 7f99153d7640 1 --2- 172.21.15.114:0/1720673741 >> v2:172.21.15.141:3300/0 conn(0x7f99100cde60 0x7f991015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.512+0000 7f99153d7640 1 -- 172.21.15.114:0/1720673741 >> 172.21.15.114:0/1720673741 conn(0x7f9910071f30 msgr2=0x7f99100cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.512+0000 7f99153d7640 1 -- 172.21.15.114:0/1720673741 shutdown_connections 2023-11-04T01:38:35.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.512+0000 7f99153d7640 1 -- 172.21.15.114:0/1720673741 wait complete. 2023-11-04T01:38:35.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.514+0000 7f99153d7640 1 Processor -- start 2023-11-04T01:38:35.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.514+0000 7f99153d7640 1 -- start start 2023-11-04T01:38:35.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.514+0000 7f99153d7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99100cde60 0x7f99100c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.514+0000 7f99153d7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100ce240 0x7f99100b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.514+0000 7f99153d7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f991015daa0 0x7f99100c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.514+0000 7f99153d7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99101470f0 con 0x7f99100ce240 2023-11-04T01:38:35.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.514+0000 7f99153d7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99100c7b90 con 0x7f991015daa0 2023-11-04T01:38:35.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.514+0000 7f99153d7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99100c7e50 con 0x7f99100cde60 2023-11-04T01:38:35.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.514+0000 7f990e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100ce240 0x7f99100b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.515+0000 7f990e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100ce240 0x7f99100b7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59890/0 (socket says 172.21.15.114:59890) 2023-11-04T01:38:35.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.515+0000 7f990e7fc640 1 -- 172.21.15.114:0/2419695072 learned_addr learned my addr 172.21.15.114:0/2419695072 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:35.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.515+0000 7f990effd640 1 --2- 172.21.15.114:0/2419695072 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99100cde60 0x7f99100c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.515+0000 7f990f7fe640 1 --2- 172.21.15.114:0/2419695072 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f991015daa0 0x7f99100c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.515+0000 7f990e7fc640 1 -- 172.21.15.114:0/2419695072 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99100cde60 msgr2=0x7f99100c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.515+0000 7f990e7fc640 1 --2- 172.21.15.114:0/2419695072 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99100cde60 0x7f99100c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.515+0000 7f990e7fc640 1 -- 172.21.15.114:0/2419695072 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f991015daa0 msgr2=0x7f99100c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.515+0000 7f990e7fc640 1 --2- 172.21.15.114:0/2419695072 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f991015daa0 0x7f99100c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.515+0000 7f990e7fc640 1 -- 172.21.15.114:0/2419695072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99080094d0 con 0x7f99100ce240 2023-11-04T01:38:35.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.515+0000 7f990e7fc640 1 --2- 172.21.15.114:0/2419695072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100ce240 0x7f99100b7b20 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f990400c7f0 tx=0x7f990400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.515+0000 7f98f77fe640 1 -- 172.21.15.114:0/2419695072 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904007820 con 0x7f99100ce240 2023-11-04T01:38:35.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.515+0000 7f98f77fe640 1 -- 172.21.15.114:0/2419695072 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9904007980 con 0x7f99100ce240 2023-11-04T01:38:35.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.515+0000 7f99153d7640 1 -- 172.21.15.114:0/2419695072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99100c8130 con 0x7f99100ce240 2023-11-04T01:38:35.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.515+0000 7f98f77fe640 1 -- 172.21.15.114:0/2419695072 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904007cf0 con 0x7f99100ce240 2023-11-04T01:38:35.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.515+0000 7f99153d7640 1 -- 172.21.15.114:0/2419695072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99100c89d0 con 0x7f99100ce240 2023-11-04T01:38:35.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.516+0000 7f99153d7640 1 -- 172.21.15.114:0/2419695072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99100b5230 con 0x7f99100ce240 2023-11-04T01:38:35.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.516+0000 7f98f77fe640 1 -- 172.21.15.114:0/2419695072 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f99040113f0 con 0x7f99100ce240 2023-11-04T01:38:35.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.517+0000 7f98f77fe640 1 --2- 172.21.15.114:0/2419695072 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f98fc06ae70 0x7f98fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.517+0000 7f98f77fe640 1 -- 172.21.15.114:0/2419695072 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9904089ab0 con 0x7f99100ce240 2023-11-04T01:38:35.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.517+0000 7f990effd640 1 --2- 172.21.15.114:0/2419695072 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f98fc06ae70 0x7f98fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.517+0000 7f990effd640 1 --2- 172.21.15.114:0/2419695072 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f98fc06ae70 0x7f98fc06d330 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9900007130 tx=0x7f99000077c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.521+0000 7f98f77fe640 1 -- 172.21.15.114:0/2419695072 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9904054a00 con 0x7f99100ce240 2023-11-04T01:38:35.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.689+0000 7f99153d7640 1 -- 172.21.15.114:0/2419695072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9910074290 con 0x7f99100ce240 2023-11-04T01:38:35.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.690+0000 7f98f77fe640 1 -- 172.21.15.114:0/2419695072 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18583 (secure 0 0 0) 0x7f990401f090 con 0x7f99100ce240 2023-11-04T01:38:35.693 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:35.693 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":54,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:21.029391+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:17.859902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:18.334035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:35.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.692+0000 7f99153d7640 1 -- 172.21.15.114:0/2419695072 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f98fc06ae70 msgr2=0x7f98fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.692+0000 7f99153d7640 1 --2- 172.21.15.114:0/2419695072 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f98fc06ae70 0x7f98fc06d330 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9900007130 tx=0x7f99000077c0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.692+0000 7f99153d7640 1 -- 172.21.15.114:0/2419695072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100ce240 msgr2=0x7f99100b7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.692+0000 7f99153d7640 1 --2- 172.21.15.114:0/2419695072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100ce240 0x7f99100b7b20 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f990400c7f0 tx=0x7f990400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.692+0000 7f99153d7640 1 -- 172.21.15.114:0/2419695072 shutdown_connections 2023-11-04T01:38:35.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.692+0000 7f99153d7640 1 --2- 172.21.15.114:0/2419695072 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f98fc06ae70 0x7f98fc06d330 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.692+0000 7f99153d7640 1 --2- 172.21.15.114:0/2419695072 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f991015daa0 0x7f99100c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.692+0000 7f99153d7640 1 --2- 172.21.15.114:0/2419695072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99100ce240 0x7f99100b7b20 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.692+0000 7f99153d7640 1 --2- 172.21.15.114:0/2419695072 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f99100cde60 0x7f99100c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.692+0000 7f99153d7640 1 -- 172.21.15.114:0/2419695072 >> 172.21.15.114:0/2419695072 conn(0x7f9910071f30 msgr2=0x7f99100b5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:35.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.692+0000 7f99153d7640 1 -- 172.21.15.114:0/2419695072 shutdown_connections 2023-11-04T01:38:35.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.692+0000 7f99153d7640 1 -- 172.21.15.114:0/2419695072 wait complete. 2023-11-04T01:38:35.706 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:38:17.859902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:38:18.334035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:35.707 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:35.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.807+0000 7fa011021640 1 Processor -- start 2023-11-04T01:38:35.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.807+0000 7fa011021640 1 -- start start 2023-11-04T01:38:35.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa011021640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c070ff0 0x7fa00c0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa011021640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00c0c9bf0 con 0x7fa00c066000 2023-11-04T01:38:35.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa011021640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00c0cd890 con 0x7fa00c15d1b0 2023-11-04T01:38:35.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa011021640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0cdb30 con 0x7fa00c070ff0 2023-11-04T01:38:35.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa00b59e640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa00c066000 0x7fa00c06a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42492/0 (socket says 172.21.15.114:42492) 2023-11-04T01:38:35.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa00b59e640 1 -- 172.21.15.114:0/2789870714 learned_addr learned my addr 172.21.15.114:0/2789870714 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:35.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa00ad9d640 1 --2- 172.21.15.114:0/2789870714 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c070ff0 0x7fa00c0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa00a59c640 1 -- 172.21.15.114:0/2789870714 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228333287 0 0) 0x7fa00c0c9bf0 con 0x7fa00c066000 2023-11-04T01:38:35.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa00a59c640 1 -- 172.21.15.114:0/2789870714 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ff8003520 con 0x7fa00c066000 2023-11-04T01:38:35.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa00a59c640 1 -- 172.21.15.114:0/2789870714 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3520720681 0 0) 0x7f9ff8003520 con 0x7fa00c066000 2023-11-04T01:38:35.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa00a59c640 1 -- 172.21.15.114:0/2789870714 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c070ff0 msgr2=0x7fa00c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:35.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa00a59c640 1 --2- 172.21.15.114:0/2789870714 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c070ff0 0x7fa00c0cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa00a59c640 1 -- 172.21.15.114:0/2789870714 >> v1:172.21.15.141:6789/0 conn(0x7fa00c15d1b0 legacy=0x7fa00c0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa00a59c640 1 -- 172.21.15.114:0/2789870714 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c0cde10 con 0x7fa00c066000 2023-11-04T01:38:35.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa00a59c640 1 -- 172.21.15.114:0/2789870714 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fa0040019f0 con 0x7fa00c066000 2023-11-04T01:38:35.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa00a59c640 1 -- 172.21.15.114:0/2789870714 >> v1:172.21.15.114:6789/0 conn(0x7fa00c066000 legacy=0x7fa00c06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa00a59c640 1 --2- 172.21.15.114:0/2789870714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff80039a0 0x7f9ff8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.808+0000 7fa00a59c640 1 --2- 172.21.15.114:0/2789870714 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ff8004350 0x7f9ff8004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.809+0000 7fa00a59c640 1 --2- 172.21.15.114:0/2789870714 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c070ff0 0x7f9ff8005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.809+0000 7fa00a59c640 1 -- 172.21.15.114:0/2789870714 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0cdb30 con 0x7f9ff80039a0 2023-11-04T01:38:35.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.809+0000 7fa00a59c640 1 -- 172.21.15.114:0/2789870714 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff800b980 con 0x7f9ff8004350 2023-11-04T01:38:35.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.809+0000 7fa00a59c640 1 -- 172.21.15.114:0/2789870714 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff800bb40 con 0x7fa00c070ff0 2023-11-04T01:38:35.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.809+0000 7fa00ad9d640 1 --2- 172.21.15.114:0/2789870714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff80039a0 0x7f9ff8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.809+0000 7fa003fff640 1 --2- 172.21.15.114:0/2789870714 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ff8004350 0x7f9ff8004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.809+0000 7fa00b59e640 1 --2- 172.21.15.114:0/2789870714 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c070ff0 0x7f9ff8005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.809+0000 7fa00ad9d640 1 -- 172.21.15.114:0/2789870714 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c070ff0 msgr2=0x7f9ff8005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:35.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.809+0000 7fa00ad9d640 1 --2- 172.21.15.114:0/2789870714 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c070ff0 0x7f9ff8005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.809+0000 7fa00ad9d640 1 -- 172.21.15.114:0/2789870714 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ff8004350 msgr2=0x7f9ff8004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:35.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.809+0000 7fa00ad9d640 1 --2- 172.21.15.114:0/2789870714 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9ff8004350 0x7f9ff8004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.809+0000 7fa00ad9d640 1 -- 172.21.15.114:0/2789870714 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8003520 con 0x7f9ff80039a0 2023-11-04T01:38:35.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.809+0000 7fa00b59e640 1 --2- 172.21.15.114:0/2789870714 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c070ff0 0x7f9ff8005080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:35.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.810+0000 7fa00ad9d640 1 --2- 172.21.15.114:0/2789870714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff80039a0 0x7f9ff8003d80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009ac0 tx=0x7f9ff80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcada8a967a1468 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.810+0000 7fa00a59c640 1 -- 172.21.15.114:0/2789870714 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc02c6b0 con 0x7f9ff80039a0 2023-11-04T01:38:35.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.810+0000 7fa00a59c640 1 -- 172.21.15.114:0/2789870714 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc02c810 con 0x7f9ff80039a0 2023-11-04T01:38:35.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.810+0000 7fa00a59c640 1 -- 172.21.15.114:0/2789870714 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc02cba0 con 0x7f9ff80039a0 2023-11-04T01:38:35.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.810+0000 7fa011021640 1 -- 172.21.15.114:0/2789870714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff80039a0 msgr2=0x7f9ff8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.810+0000 7fa011021640 1 --2- 172.21.15.114:0/2789870714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff80039a0 0x7f9ff8003d80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009ac0 tx=0x7f9ff80057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.810+0000 7fa00b59e640 1 -- 172.21.15.114:0/2789870714 reap_dead start 2023-11-04T01:38:35.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.810+0000 7fa011021640 1 -- 172.21.15.114:0/2789870714 shutdown_connections 2023-11-04T01:38:35.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.810+0000 7fa011021640 1 -- 172.21.15.114:0/2789870714 >> 172.21.15.114:0/2789870714 conn(0x7fa00c0cbc90 msgr2=0x7fa00c0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:35.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.810+0000 7fa011021640 1 -- 172.21.15.114:0/2789870714 shutdown_connections 2023-11-04T01:38:35.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.810+0000 7fa011021640 1 -- 172.21.15.114:0/2789870714 wait complete. 2023-11-04T01:38:35.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.812+0000 7fa011021640 1 Processor -- start 2023-11-04T01:38:35.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.812+0000 7fa011021640 1 -- start start 2023-11-04T01:38:35.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.812+0000 7fa011021640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff80039a0 0x7fa00c0c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.812+0000 7fa011021640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c1f3850 0x7fa00c1f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.812+0000 7fa011021640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa00c0b4920 0x7fa00c0c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.812+0000 7fa011021640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0c9640 con 0x7f9ff80039a0 2023-11-04T01:38:35.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.812+0000 7fa011021640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c1f3cd0 con 0x7fa00c0b4920 2023-11-04T01:38:35.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.812+0000 7fa011021640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c1f36a0 con 0x7fa00c1f3850 2023-11-04T01:38:35.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.812+0000 7fa00ad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff80039a0 0x7fa00c0c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.812+0000 7fa00ad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff80039a0 0x7fa00c0c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59912/0 (socket says 172.21.15.114:59912) 2023-11-04T01:38:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.812+0000 7fa00ad9d640 1 -- 172.21.15.114:0/2482454351 learned_addr learned my addr 172.21.15.114:0/2482454351 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.813+0000 7fa00b59e640 1 --2- 172.21.15.114:0/2482454351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa00c0b4920 0x7fa00c0c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.813+0000 7fa003fff640 1 --2- 172.21.15.114:0/2482454351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c1f3850 0x7fa00c1f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.813+0000 7fa00ad9d640 1 -- 172.21.15.114:0/2482454351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c1f3850 msgr2=0x7fa00c1f3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.813+0000 7fa00ad9d640 1 --2- 172.21.15.114:0/2482454351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c1f3850 0x7fa00c1f3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.813+0000 7fa00ad9d640 1 -- 172.21.15.114:0/2482454351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa00c0b4920 msgr2=0x7fa00c0c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.813+0000 7fa00ad9d640 1 --2- 172.21.15.114:0/2482454351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa00c0b4920 0x7fa00c0c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.813+0000 7fa00ad9d640 1 -- 172.21.15.114:0/2482454351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c0c4580 con 0x7f9ff80039a0 2023-11-04T01:38:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.813+0000 7fa00ad9d640 1 --2- 172.21.15.114:0/2482454351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff80039a0 0x7fa00c0c8cd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0099e0 tx=0x7f9ffc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.813+0000 7fa0037fe640 1 -- 172.21.15.114:0/2482454351 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc003810 con 0x7f9ff80039a0 2023-11-04T01:38:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.813+0000 7fa0037fe640 1 -- 172.21.15.114:0/2482454351 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc003970 con 0x7f9ff80039a0 2023-11-04T01:38:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.813+0000 7fa011021640 1 -- 172.21.15.114:0/2482454351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00c0c9360 con 0x7f9ff80039a0 2023-11-04T01:38:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.813+0000 7fa0037fe640 1 -- 172.21.15.114:0/2482454351 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc003d20 con 0x7f9ff80039a0 2023-11-04T01:38:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.813+0000 7fa011021640 1 -- 172.21.15.114:0/2482454351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00c0c4210 con 0x7f9ff80039a0 2023-11-04T01:38:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.814+0000 7fa011021640 1 -- 172.21.15.114:0/2482454351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00c0c43d0 con 0x7f9ff80039a0 2023-11-04T01:38:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.815+0000 7fa0037fe640 1 -- 172.21.15.114:0/2482454351 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ffc034440 con 0x7f9ff80039a0 2023-11-04T01:38:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.815+0000 7fa0037fe640 1 --2- 172.21.15.114:0/2482454351 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9fec06aea0 0x7f9fec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.815+0000 7fa0037fe640 1 -- 172.21.15.114:0/2482454351 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9ffc0ab5b0 con 0x7f9ff80039a0 2023-11-04T01:38:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.815+0000 7fa003fff640 1 --2- 172.21.15.114:0/2482454351 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9fec06aea0 0x7f9fec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.815+0000 7fa003fff640 1 --2- 172.21.15.114:0/2482454351 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9fec06aea0 0x7f9fec06d360 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0ce890 tx=0x7f9ff4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:35.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.819+0000 7fa0037fe640 1 -- 172.21.15.114:0/2482454351 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9ffc076590 con 0x7f9ff80039a0 2023-11-04T01:38:35.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.986+0000 7fa011021640 1 -- 172.21.15.114:0/2482454351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa00c0c3d90 con 0x7f9ff80039a0 2023-11-04T01:38:35.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.987+0000 7fa0037fe640 1 -- 172.21.15.114:0/2482454351 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa00c0c3d90 con 0x7f9ff80039a0 2023-11-04T01:38:35.988 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:38:35.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.989+0000 7fa011021640 1 -- 172.21.15.114:0/2482454351 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9fec06aea0 msgr2=0x7f9fec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.989+0000 7fa011021640 1 --2- 172.21.15.114:0/2482454351 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9fec06aea0 0x7f9fec06d360 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0ce890 tx=0x7f9ff4009040 comp rx=0 tx=0).stop 2023-11-04T01:38:35.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.989+0000 7fa011021640 1 -- 172.21.15.114:0/2482454351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff80039a0 msgr2=0x7fa00c0c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:35.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.989+0000 7fa011021640 1 --2- 172.21.15.114:0/2482454351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff80039a0 0x7fa00c0c8cd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0099e0 tx=0x7f9ffc004730 comp rx=0 tx=0).stop 2023-11-04T01:38:35.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.989+0000 7fa011021640 1 -- 172.21.15.114:0/2482454351 shutdown_connections 2023-11-04T01:38:35.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.989+0000 7fa011021640 1 --2- 172.21.15.114:0/2482454351 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9fec06aea0 0x7f9fec06d360 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.989+0000 7fa011021640 1 --2- 172.21.15.114:0/2482454351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa00c0b4920 0x7fa00c0c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.989+0000 7fa011021640 1 --2- 172.21.15.114:0/2482454351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa00c1f3850 0x7fa00c1f3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.989+0000 7fa011021640 1 --2- 172.21.15.114:0/2482454351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff80039a0 0x7fa00c0c8cd0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:35.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.989+0000 7fa011021640 1 -- 172.21.15.114:0/2482454351 >> 172.21.15.114:0/2482454351 conn(0x7fa00c0cbc90 msgr2=0x7fa00c15d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:35.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.989+0000 7fa011021640 1 -- 172.21.15.114:0/2482454351 shutdown_connections 2023-11-04T01:38:35.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:35.989+0000 7fa011021640 1 -- 172.21.15.114:0/2482454351 wait complete. 2023-11-04T01:38:36.001 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:36.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.104+0000 7fe40e925640 1 Processor -- start 2023-11-04T01:38:36.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.104+0000 7fe40e925640 1 -- start start 2023-11-04T01:38:36.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.105+0000 7fe40e925640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe40815d1b0 0x7fe4080cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.105+0000 7fe40e925640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe408066000 0x7fe40806a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.105+0000 7fe40e925640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4080c9bf0 con 0x7fe408070ff0 2023-11-04T01:38:36.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.105+0000 7fe40e925640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4080cd890 con 0x7fe408066000 2023-11-04T01:38:36.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.105+0000 7fe40e925640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4080cdb30 con 0x7fe40815d1b0 2023-11-04T01:38:36.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.105+0000 7fe40cec2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe408066000 0x7fe40806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.105+0000 7fe40cec2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe408066000 0x7fe40806a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59914/0 (socket says 172.21.15.114:59914) 2023-11-04T01:38:36.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.105+0000 7fe40cec2640 1 -- 172.21.15.114:0/221753996 learned_addr learned my addr 172.21.15.114:0/221753996 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:36.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.105+0000 7fe4077fe640 1 --2- 172.21.15.114:0/221753996 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe40815d1b0 0x7fe4080cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.105+0000 7fe40cec2640 1 -- 172.21.15.114:0/221753996 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe40815d1b0 msgr2=0x7fe4080cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:36.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.105+0000 7fe40cec2640 1 --2- 172.21.15.114:0/221753996 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe40815d1b0 0x7fe4080cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.105+0000 7fe40cec2640 1 -- 172.21.15.114:0/221753996 >> v1:172.21.15.141:6789/0 conn(0x7fe408070ff0 legacy=0x7fe4080713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.105+0000 7fe40cec2640 1 -- 172.21.15.114:0/221753996 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4080cde10 con 0x7fe408066000 2023-11-04T01:38:36.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.105+0000 7fe4077fe640 1 --2- 172.21.15.114:0/221753996 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe40815d1b0 0x7fe4080cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:36.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.106+0000 7fe40cec2640 1 --2- 172.21.15.114:0/221753996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe408066000 0x7fe40806a500 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe400009e50 tx=0x7fe40002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fdf04b8d5ed301 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.106+0000 7fe406ffd640 1 -- 172.21.15.114:0/221753996 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40002cb00 con 0x7fe408066000 2023-11-04T01:38:36.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.106+0000 7fe406ffd640 1 -- 172.21.15.114:0/221753996 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40002cc60 con 0x7fe408066000 2023-11-04T01:38:36.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.106+0000 7fe406ffd640 1 -- 172.21.15.114:0/221753996 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4000343f0 con 0x7fe408066000 2023-11-04T01:38:36.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.107+0000 7fe40e925640 1 -- 172.21.15.114:0/221753996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe408066000 msgr2=0x7fe40806a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.107+0000 7fe40e925640 1 --2- 172.21.15.114:0/221753996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe408066000 0x7fe40806a500 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe400009e50 tx=0x7fe40002bf60 comp rx=0 tx=0).stop 2023-11-04T01:38:36.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.107+0000 7fe40e925640 1 -- 172.21.15.114:0/221753996 shutdown_connections 2023-11-04T01:38:36.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.107+0000 7fe40e925640 1 --2- 172.21.15.114:0/221753996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe408066000 0x7fe40806a500 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.107+0000 7fe40e925640 1 --2- 172.21.15.114:0/221753996 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe40815d1b0 0x7fe4080cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.107+0000 7fe40e925640 1 -- 172.21.15.114:0/221753996 >> 172.21.15.114:0/221753996 conn(0x7fe4080cbc90 msgr2=0x7fe4080cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:36.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.107+0000 7fe40e925640 1 -- 172.21.15.114:0/221753996 shutdown_connections 2023-11-04T01:38:36.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.107+0000 7fe40e925640 1 -- 172.21.15.114:0/221753996 wait complete. 2023-11-04T01:38:36.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.108+0000 7fe40e925640 1 Processor -- start 2023-11-04T01:38:36.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.108+0000 7fe40e925640 1 -- start start 2023-11-04T01:38:36.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe40e925640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe408066000 0x7fe4081f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe40e925640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe408070ff0 0x7fe4080b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe40e925640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe40815d1b0 0x7fe4080b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe40e925640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4080b2f20 con 0x7fe40815d1b0 2023-11-04T01:38:36.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe40e925640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe408159600 con 0x7fe408070ff0 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe40e925640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4080c3b30 con 0x7fe408066000 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe40cec2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe40815d1b0 0x7fe4080b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe40cec2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe40815d1b0 0x7fe4080b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59924/0 (socket says 172.21.15.114:59924) 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe40cec2640 1 -- 172.21.15.114:0/2184294965 learned_addr learned my addr 172.21.15.114:0/2184294965 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe40cec2640 1 -- 172.21.15.114:0/2184294965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe408066000 msgr2=0x7fe4081f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe40cec2640 1 --2- 172.21.15.114:0/2184294965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe408066000 0x7fe4081f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe40cec2640 1 -- 172.21.15.114:0/2184294965 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe408070ff0 msgr2=0x7fe4080b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe40cec2640 1 --2- 172.21.15.114:0/2184294965 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe408070ff0 0x7fe4080b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe40cec2640 1 -- 172.21.15.114:0/2184294965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe400009b30 con 0x7fe40815d1b0 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe40cec2640 1 --2- 172.21.15.114:0/2184294965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe40815d1b0 0x7fe4080b2370 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe400036040 tx=0x7fe400004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe404ff9640 1 -- 172.21.15.114:0/2184294965 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400009510 con 0x7fe40815d1b0 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe404ff9640 1 -- 172.21.15.114:0/2184294965 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40003e450 con 0x7fe40815d1b0 2023-11-04T01:38:36.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.109+0000 7fe40e925640 1 -- 172.21.15.114:0/2184294965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4080c5be0 con 0x7fe40815d1b0 2023-11-04T01:38:36.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.110+0000 7fe404ff9640 1 -- 172.21.15.114:0/2184294965 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40003e7e0 con 0x7fe40815d1b0 2023-11-04T01:38:36.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.110+0000 7fe40e925640 1 -- 172.21.15.114:0/2184294965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4080b2c40 con 0x7fe40815d1b0 2023-11-04T01:38:36.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.110+0000 7fe40e925640 1 -- 172.21.15.114:0/2184294965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe408074290 con 0x7fe40815d1b0 2023-11-04T01:38:36.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.111+0000 7fe404ff9640 1 -- 172.21.15.114:0/2184294965 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe40003e940 con 0x7fe40815d1b0 2023-11-04T01:38:36.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.111+0000 7fe404ff9640 1 --2- 172.21.15.114:0/2184294965 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe3f406ae70 0x7fe3f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.111+0000 7fe404ff9640 1 -- 172.21.15.114:0/2184294965 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe4000ac610 con 0x7fe40815d1b0 2023-11-04T01:38:36.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.111+0000 7fe407fff640 1 --2- 172.21.15.114:0/2184294965 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe3f406ae70 0x7fe3f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.112+0000 7fe407fff640 1 --2- 172.21.15.114:0/2184294965 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe3f406ae70 0x7fe3f406d330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8000f60 tx=0x7fe3f80079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.116+0000 7fe404ff9640 1 -- 172.21.15.114:0/2184294965 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe400077420 con 0x7fe40815d1b0 2023-11-04T01:38:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.281+0000 7fe40e925640 1 -- 172.21.15.114:0/2184294965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fe4080b5190 con 0x7fe40815d1b0 2023-11-04T01:38:36.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.282+0000 7fe404ff9640 1 -- 172.21.15.114:0/2184294965 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v54) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe40007aa40 con 0x7fe40815d1b0 2023-11-04T01:38:36.284 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:38:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.284+0000 7fe40e925640 1 -- 172.21.15.114:0/2184294965 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe3f406ae70 msgr2=0x7fe3f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.284+0000 7fe40e925640 1 --2- 172.21.15.114:0/2184294965 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe3f406ae70 0x7fe3f406d330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8000f60 tx=0x7fe3f80079b0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.284+0000 7fe40e925640 1 -- 172.21.15.114:0/2184294965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe40815d1b0 msgr2=0x7fe4080b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.284+0000 7fe40e925640 1 --2- 172.21.15.114:0/2184294965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe40815d1b0 0x7fe4080b2370 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe400036040 tx=0x7fe400004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.284+0000 7fe40e925640 1 -- 172.21.15.114:0/2184294965 shutdown_connections 2023-11-04T01:38:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.284+0000 7fe40e925640 1 --2- 172.21.15.114:0/2184294965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe40815d1b0 0x7fe4080b2370 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.284+0000 7fe40e925640 1 --2- 172.21.15.114:0/2184294965 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe3f406ae70 0x7fe3f406d330 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.284+0000 7fe40e925640 1 --2- 172.21.15.114:0/2184294965 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe408070ff0 0x7fe4080b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.284+0000 7fe40e925640 1 --2- 172.21.15.114:0/2184294965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe408066000 0x7fe4081f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.284+0000 7fe40e925640 1 -- 172.21.15.114:0/2184294965 >> 172.21.15.114:0/2184294965 conn(0x7fe4080cbc90 msgr2=0x7fe4080cb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.284+0000 7fe40e925640 1 -- 172.21.15.114:0/2184294965 shutdown_connections 2023-11-04T01:38:36.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.284+0000 7fe40e925640 1 -- 172.21.15.114:0/2184294965 wait complete. 2023-11-04T01:38:36.296 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:38:36.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.396+0000 7f8dfc5a9640 1 Processor -- start 2023-11-04T01:38:36.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.396+0000 7f8dfc5a9640 1 -- start start 2023-11-04T01:38:36.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.397+0000 7f8dfc5a9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8df40b2d30 0x7f8df406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.397+0000 7f8dfc5a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8df406c1d0 0x7f8df40cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.397+0000 7f8dfc5a9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df406ca40 con 0x7f8df4160430 2023-11-04T01:38:36.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.397+0000 7f8dfc5a9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df40cb580 con 0x7f8df40b2d30 2023-11-04T01:38:36.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.397+0000 7f8dfc5a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df406cd20 con 0x7f8df406c1d0 2023-11-04T01:38:36.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.397+0000 7f8dfa345640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8df4160430 0x7f8df40b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42508/0 (socket says 172.21.15.114:42508) 2023-11-04T01:38:36.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.397+0000 7f8dfa345640 1 -- 172.21.15.114:0/3940476169 learned_addr learned my addr 172.21.15.114:0/3940476169 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:36.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9343640 1 -- 172.21.15.114:0/3940476169 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284504525 0 0) 0x7f8df406ca40 con 0x7f8df4160430 2023-11-04T01:38:36.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9343640 1 -- 172.21.15.114:0/3940476169 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8de0003520 con 0x7f8df4160430 2023-11-04T01:38:36.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8dfab46640 1 --2- 172.21.15.114:0/3940476169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8df406c1d0 0x7f8df40cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9b44640 1 --2- 172.21.15.114:0/3940476169 >> v2:172.21.15.141:3300/0 conn(0x7f8df40b2d30 0x7f8df406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9343640 1 -- 172.21.15.114:0/3940476169 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2344916350 0 0) 0x7f8de0003520 con 0x7f8df4160430 2023-11-04T01:38:36.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9343640 1 -- 172.21.15.114:0/3940476169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8df406c1d0 msgr2=0x7f8df40cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:36.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9343640 1 --2- 172.21.15.114:0/3940476169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8df406c1d0 0x7f8df40cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9343640 1 -- 172.21.15.114:0/3940476169 >> v2:172.21.15.141:3300/0 conn(0x7f8df40b2d30 msgr2=0x7f8df406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:36.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9343640 1 --2- 172.21.15.114:0/3940476169 >> v2:172.21.15.141:3300/0 conn(0x7f8df40b2d30 0x7f8df406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9343640 1 -- 172.21.15.114:0/3940476169 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df406d000 con 0x7f8df4160430 2023-11-04T01:38:36.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9343640 1 -- 172.21.15.114:0/3940476169 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f8df0001670 con 0x7f8df4160430 2023-11-04T01:38:36.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9343640 1 -- 172.21.15.114:0/3940476169 >> v1:172.21.15.114:6789/0 conn(0x7f8df4160430 legacy=0x7f8df40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9343640 1 --2- 172.21.15.114:0/3940476169 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8de0003970 0x7f8de0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9343640 1 --2- 172.21.15.114:0/3940476169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de00047c0 0x7f8de0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9343640 1 --2- 172.21.15.114:0/3940476169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8df406c1d0 0x7f8de0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9343640 1 -- 172.21.15.114:0/3940476169 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40cb580 con 0x7f8de00047c0 2023-11-04T01:38:36.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9343640 1 -- 172.21.15.114:0/3940476169 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df406cd20 con 0x7f8de0003970 2023-11-04T01:38:36.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9343640 1 -- 172.21.15.114:0/3940476169 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de000b980 con 0x7f8df406c1d0 2023-11-04T01:38:36.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9b44640 1 --2- 172.21.15.114:0/3940476169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de00047c0 0x7f8de0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8dfa345640 1 --2- 172.21.15.114:0/3940476169 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8de0003970 0x7f8de0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8dfab46640 1 --2- 172.21.15.114:0/3940476169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8df406c1d0 0x7f8de0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9b44640 1 -- 172.21.15.114:0/3940476169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8df406c1d0 msgr2=0x7f8de0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:36.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9b44640 1 --2- 172.21.15.114:0/3940476169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8df406c1d0 0x7f8de0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9b44640 1 -- 172.21.15.114:0/3940476169 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8de0003970 msgr2=0x7f8de0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:36.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9b44640 1 --2- 172.21.15.114:0/3940476169 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8de0003970 0x7f8de0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8df9b44640 1 -- 172.21.15.114:0/3940476169 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de0003520 con 0x7f8de00047c0 2023-11-04T01:38:36.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.398+0000 7f8dfa345640 1 --2- 172.21.15.114:0/3940476169 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8de0003970 0x7f8de0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:36.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.399+0000 7f8df9b44640 1 --2- 172.21.15.114:0/3940476169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de00047c0 0x7f8de0004c40 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8de4009ac0 tx=0x7f8de00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a8b105bd5efc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.399+0000 7f8df9343640 1 -- 172.21.15.114:0/3940476169 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de402c710 con 0x7f8de00047c0 2023-11-04T01:38:36.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.399+0000 7f8df9343640 1 -- 172.21.15.114:0/3940476169 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de402c870 con 0x7f8de00047c0 2023-11-04T01:38:36.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.399+0000 7f8df9343640 1 -- 172.21.15.114:0/3940476169 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de402cc00 con 0x7f8de00047c0 2023-11-04T01:38:36.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.400+0000 7f8dfc5a9640 1 -- 172.21.15.114:0/3940476169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de00047c0 msgr2=0x7f8de0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.400+0000 7f8dfc5a9640 1 --2- 172.21.15.114:0/3940476169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de00047c0 0x7f8de0004c40 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8de4009ac0 tx=0x7f8de00057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.400+0000 7f8dfab46640 1 -- 172.21.15.114:0/3940476169 reap_dead start 2023-11-04T01:38:36.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.400+0000 7f8dfc5a9640 1 -- 172.21.15.114:0/3940476169 shutdown_connections 2023-11-04T01:38:36.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.400+0000 7f8dfc5a9640 1 -- 172.21.15.114:0/3940476169 >> 172.21.15.114:0/3940476169 conn(0x7f8df406ea20 msgr2=0x7f8df406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:36.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.400+0000 7f8dfc5a9640 1 -- 172.21.15.114:0/3940476169 shutdown_connections 2023-11-04T01:38:36.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.400+0000 7f8dfc5a9640 1 -- 172.21.15.114:0/3940476169 wait complete. 2023-11-04T01:38:36.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.401+0000 7f8dfc5a9640 1 Processor -- start 2023-11-04T01:38:36.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.401+0000 7f8dfc5a9640 1 -- start start 2023-11-04T01:38:36.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfc5a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de00047c0 0x7f8df40c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfc5a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8df415e990 0x7f8df4151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfc5a9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8df40b20c0 0x7f8df40b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfc5a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40c6570 con 0x7f8de00047c0 2023-11-04T01:38:36.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfc5a9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40b2a60 con 0x7f8df40b20c0 2023-11-04T01:38:36.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfc5a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40c5960 con 0x7f8df415e990 2023-11-04T01:38:36.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfa345640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de00047c0 0x7f8df40c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfa345640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de00047c0 0x7f8df40c5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59944/0 (socket says 172.21.15.114:59944) 2023-11-04T01:38:36.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfa345640 1 -- 172.21.15.114:0/551203037 learned_addr learned my addr 172.21.15.114:0/551203037 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:36.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8df9b44640 1 --2- 172.21.15.114:0/551203037 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8df415e990 0x7f8df4151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfa345640 1 -- 172.21.15.114:0/551203037 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8df415e990 msgr2=0x7f8df4151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfa345640 1 --2- 172.21.15.114:0/551203037 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8df415e990 0x7f8df4151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfa345640 1 -- 172.21.15.114:0/551203037 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8df40b20c0 msgr2=0x7f8df40b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfa345640 1 --2- 172.21.15.114:0/551203037 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8df40b20c0 0x7f8df40b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfa345640 1 -- 172.21.15.114:0/551203037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df40c5c40 con 0x7f8de00047c0 2023-11-04T01:38:36.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfa345640 1 --2- 172.21.15.114:0/551203037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de00047c0 0x7f8df40c5080 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8df0001c10 tx=0x7f8df000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8deaffd640 1 -- 172.21.15.114:0/551203037 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df000c610 con 0x7f8de00047c0 2023-11-04T01:38:36.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8deaffd640 1 -- 172.21.15.114:0/551203037 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df000c770 con 0x7f8de00047c0 2023-11-04T01:38:36.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfc5a9640 1 -- 172.21.15.114:0/551203037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df40c5f20 con 0x7f8de00047c0 2023-11-04T01:38:36.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8deaffd640 1 -- 172.21.15.114:0/551203037 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df000cb20 con 0x7f8de00047c0 2023-11-04T01:38:36.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.402+0000 7f8dfc5a9640 1 -- 172.21.15.114:0/551203037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df40c55c0 con 0x7f8de00047c0 2023-11-04T01:38:36.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.403+0000 7f8dfc5a9640 1 -- 172.21.15.114:0/551203037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df406d400 con 0x7f8de00047c0 2023-11-04T01:38:36.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.404+0000 7f8deaffd640 1 -- 172.21.15.114:0/551203037 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8df001d460 con 0x7f8de00047c0 2023-11-04T01:38:36.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.404+0000 7f8deaffd640 1 --2- 172.21.15.114:0/551203037 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8dd806aea0 0x7f8dd806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.404+0000 7f8deaffd640 1 -- 172.21.15.114:0/551203037 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8df0089960 con 0x7f8de00047c0 2023-11-04T01:38:36.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.404+0000 7f8df9b44640 1 --2- 172.21.15.114:0/551203037 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8dd806aea0 0x7f8dd806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.404+0000 7f8df9b44640 1 --2- 172.21.15.114:0/551203037 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8dd806aea0 0x7f8dd806d360 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8de4036000 tx=0x7f8de4030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.408+0000 7f8deaffd640 1 -- 172.21.15.114:0/551203037 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8df0054770 con 0x7f8de00047c0 2023-11-04T01:38:36.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.573+0000 7f8dfc5a9640 1 -- 172.21.15.114:0/551203037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8df4074290 con 0x7f8de00047c0 2023-11-04T01:38:36.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.574+0000 7f8deaffd640 1 -- 172.21.15.114:0/551203037 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8df0057d90 con 0x7f8de00047c0 2023-11-04T01:38:36.576 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:38:36.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.575+0000 7f8dfc5a9640 1 -- 172.21.15.114:0/551203037 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8dd806aea0 msgr2=0x7f8dd806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.575+0000 7f8dfc5a9640 1 --2- 172.21.15.114:0/551203037 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8dd806aea0 0x7f8dd806d360 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8de4036000 tx=0x7f8de4030000 comp rx=0 tx=0).stop 2023-11-04T01:38:36.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.575+0000 7f8dfc5a9640 1 -- 172.21.15.114:0/551203037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de00047c0 msgr2=0x7f8df40c5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.575+0000 7f8dfc5a9640 1 --2- 172.21.15.114:0/551203037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de00047c0 0x7f8df40c5080 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8df0001c10 tx=0x7f8df000eb90 comp rx=0 tx=0).stop 2023-11-04T01:38:36.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.576+0000 7f8dfc5a9640 1 -- 172.21.15.114:0/551203037 shutdown_connections 2023-11-04T01:38:36.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.576+0000 7f8dfc5a9640 1 --2- 172.21.15.114:0/551203037 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8dd806aea0 0x7f8dd806d360 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.576+0000 7f8dfc5a9640 1 --2- 172.21.15.114:0/551203037 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8df40b20c0 0x7f8df40b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.576+0000 7f8dfc5a9640 1 --2- 172.21.15.114:0/551203037 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8df415e990 0x7f8df4151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.576+0000 7f8dfc5a9640 1 --2- 172.21.15.114:0/551203037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de00047c0 0x7f8df40c5080 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.576+0000 7f8dfc5a9640 1 -- 172.21.15.114:0/551203037 >> 172.21.15.114:0/551203037 conn(0x7f8df406ea20 msgr2=0x7f8df40c8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:36.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.576+0000 7f8dfc5a9640 1 -- 172.21.15.114:0/551203037 shutdown_connections 2023-11-04T01:38:36.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.576+0000 7f8dfc5a9640 1 -- 172.21.15.114:0/551203037 wait complete. 2023-11-04T01:38:36.588 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:38:36.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.689+0000 7fde55561640 1 Processor -- start 2023-11-04T01:38:36.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.689+0000 7fde55561640 1 -- start start 2023-11-04T01:38:36.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.690+0000 7fde55561640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fde500cd6d0 0x7fde50161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.690+0000 7fde55561640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fde500b4880 0x7fde500b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.690+0000 7fde55561640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde500cde60 con 0x7fde50153e60 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.690+0000 7fde55561640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde50160f90 con 0x7fde500b4880 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.690+0000 7fde55561640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde500b51e0 con 0x7fde500cd6d0 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.690+0000 7fde4effd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fde50153e60 0x7fde5015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45898/0 (socket says 172.21.15.114:45898) 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.690+0000 7fde4f7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fde500b4880 0x7fde500b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.690+0000 7fde4effd640 1 -- 172.21.15.114:0/950205452 learned_addr learned my addr 172.21.15.114:0/950205452 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.690+0000 7fde4dffb640 1 -- 172.21.15.114:0/950205452 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044264249 0 0) 0x7fde500cde60 con 0x7fde50153e60 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.690+0000 7fde4dffb640 1 -- 172.21.15.114:0/950205452 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde38003520 con 0x7fde50153e60 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.690+0000 7fde4e7fc640 1 --2- 172.21.15.114:0/950205452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fde500cd6d0 0x7fde50161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.690+0000 7fde4f7fe640 1 -- 172.21.15.114:0/950205452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fde500cd6d0 msgr2=0x7fde50161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.690+0000 7fde4f7fe640 1 --2- 172.21.15.114:0/950205452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fde500cd6d0 0x7fde50161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.690+0000 7fde4f7fe640 1 -- 172.21.15.114:0/950205452 >> v1:172.21.15.114:6789/0 conn(0x7fde50153e60 legacy=0x7fde5015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.690+0000 7fde4f7fe640 1 -- 172.21.15.114:0/950205452 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50161960 con 0x7fde500b4880 2023-11-04T01:38:36.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.691+0000 7fde4e7fc640 1 --2- 172.21.15.114:0/950205452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fde500cd6d0 0x7fde50161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.691+0000 7fde4f7fe640 1 --2- 172.21.15.114:0/950205452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde500b4880 0x7fde500b4ca0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fde480097a0 tx=0x7fde4802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e941b4be101797 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.691+0000 7fde4dffb640 1 -- 172.21.15.114:0/950205452 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48031830 con 0x7fde500b4880 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.691+0000 7fde4dffb640 1 -- 172.21.15.114:0/950205452 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde48031990 con 0x7fde500b4880 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.691+0000 7fde4dffb640 1 -- 172.21.15.114:0/950205452 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48031d20 con 0x7fde500b4880 2023-11-04T01:38:36.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.692+0000 7fde55561640 1 -- 172.21.15.114:0/950205452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde500b4880 msgr2=0x7fde500b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.692+0000 7fde55561640 1 --2- 172.21.15.114:0/950205452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde500b4880 0x7fde500b4ca0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fde480097a0 tx=0x7fde4802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.692+0000 7fde55561640 1 -- 172.21.15.114:0/950205452 shutdown_connections 2023-11-04T01:38:36.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.692+0000 7fde55561640 1 --2- 172.21.15.114:0/950205452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde500b4880 0x7fde500b4ca0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.692+0000 7fde55561640 1 --2- 172.21.15.114:0/950205452 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fde500cd6d0 0x7fde50161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.692+0000 7fde55561640 1 -- 172.21.15.114:0/950205452 >> 172.21.15.114:0/950205452 conn(0x7fde500cf880 msgr2=0x7fde500cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:36.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.692+0000 7fde55561640 1 -- 172.21.15.114:0/950205452 shutdown_connections 2023-11-04T01:38:36.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.692+0000 7fde55561640 1 -- 172.21.15.114:0/950205452 wait complete. 2023-11-04T01:38:36.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.693+0000 7fde55561640 1 Processor -- start 2023-11-04T01:38:36.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.693+0000 7fde55561640 1 -- start start 2023-11-04T01:38:36.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.694+0000 7fde55561640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde500b4880 0x7fde501f00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.694+0000 7fde55561640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fde500cd6d0 0x7fde500d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.694+0000 7fde55561640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fde50153e60 0x7fde500d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.694+0000 7fde55561640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde501f3c40 con 0x7fde500b4880 2023-11-04T01:38:36.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.694+0000 7fde55561640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde501f3960 con 0x7fde50153e60 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.694+0000 7fde55561640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde500cb050 con 0x7fde500cd6d0 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.694+0000 7fde4effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde500b4880 0x7fde501f00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.694+0000 7fde4effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde500b4880 0x7fde501f00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37590/0 (socket says 172.21.15.114:37590) 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.694+0000 7fde4effd640 1 -- 172.21.15.114:0/855296858 learned_addr learned my addr 172.21.15.114:0/855296858 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.694+0000 7fde4e7fc640 1 --2- 172.21.15.114:0/855296858 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fde500cd6d0 0x7fde500d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.694+0000 7fde4effd640 1 -- 172.21.15.114:0/855296858 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fde500cd6d0 msgr2=0x7fde500d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.694+0000 7fde4effd640 1 --2- 172.21.15.114:0/855296858 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fde500cd6d0 0x7fde500d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.694+0000 7fde4effd640 1 -- 172.21.15.114:0/855296858 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fde50153e60 msgr2=0x7fde500d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.694+0000 7fde4f7fe640 1 --2- 172.21.15.114:0/855296858 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fde50153e60 0x7fde500d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.695+0000 7fde4effd640 1 --2- 172.21.15.114:0/855296858 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fde50153e60 0x7fde500d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.695+0000 7fde4effd640 1 -- 172.21.15.114:0/855296858 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde48009400 con 0x7fde500b4880 2023-11-04T01:38:36.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.695+0000 7fde4f7fe640 1 --2- 172.21.15.114:0/855296858 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fde50153e60 0x7fde500d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:36.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.695+0000 7fde4effd640 1 --2- 172.21.15.114:0/855296858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde500b4880 0x7fde501f00e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fde4000cbc0 tx=0x7fde4000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.695+0000 7fde377fe640 1 -- 172.21.15.114:0/855296858 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4000ad40 con 0x7fde500b4880 2023-11-04T01:38:36.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.695+0000 7fde377fe640 1 -- 172.21.15.114:0/855296858 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde40012400 con 0x7fde500b4880 2023-11-04T01:38:36.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.695+0000 7fde55561640 1 -- 172.21.15.114:0/855296858 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde500cb330 con 0x7fde500b4880 2023-11-04T01:38:36.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.695+0000 7fde377fe640 1 -- 172.21.15.114:0/855296858 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4000aea0 con 0x7fde500b4880 2023-11-04T01:38:36.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.695+0000 7fde55561640 1 -- 172.21.15.114:0/855296858 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde501f0620 con 0x7fde500b4880 2023-11-04T01:38:36.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.696+0000 7fde55561640 1 -- 172.21.15.114:0/855296858 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde50074290 con 0x7fde500b4880 2023-11-04T01:38:36.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.696+0000 7fde377fe640 1 -- 172.21.15.114:0/855296858 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fde40007070 con 0x7fde500b4880 2023-11-04T01:38:36.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.696+0000 7fde377fe640 1 --2- 172.21.15.114:0/855296858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fde3c06ae70 0x7fde3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.697+0000 7fde377fe640 1 -- 172.21.15.114:0/855296858 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fde40089870 con 0x7fde500b4880 2023-11-04T01:38:36.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.697+0000 7fde4e7fc640 1 --2- 172.21.15.114:0/855296858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fde3c06ae70 0x7fde3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.697+0000 7fde4e7fc640 1 --2- 172.21.15.114:0/855296858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fde3c06ae70 0x7fde3c06d330 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fde5015cc90 tx=0x7fde44008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.701+0000 7fde377fe640 1 -- 172.21.15.114:0/855296858 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde40054710 con 0x7fde500b4880 2023-11-04T01:38:36.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.867+0000 7fde55561640 1 -- 172.21.15.114:0/855296858 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde500d0b80 con 0x7fde500b4880 2023-11-04T01:38:36.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.867+0000 7fde377fe640 1 -- 172.21.15.114:0/855296858 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7fde400170a0 con 0x7fde500b4880 2023-11-04T01:38:36.869 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:38:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.869+0000 7fde55561640 1 -- 172.21.15.114:0/855296858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fde3c06ae70 msgr2=0x7fde3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.869+0000 7fde55561640 1 --2- 172.21.15.114:0/855296858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fde3c06ae70 0x7fde3c06d330 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fde5015cc90 tx=0x7fde44008040 comp rx=0 tx=0).stop 2023-11-04T01:38:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.869+0000 7fde55561640 1 -- 172.21.15.114:0/855296858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde500b4880 msgr2=0x7fde501f00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.869+0000 7fde55561640 1 --2- 172.21.15.114:0/855296858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde500b4880 0x7fde501f00e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fde4000cbc0 tx=0x7fde4000a430 comp rx=0 tx=0).stop 2023-11-04T01:38:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.869+0000 7fde55561640 1 -- 172.21.15.114:0/855296858 shutdown_connections 2023-11-04T01:38:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.869+0000 7fde55561640 1 --2- 172.21.15.114:0/855296858 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fde3c06ae70 0x7fde3c06d330 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.869+0000 7fde55561640 1 --2- 172.21.15.114:0/855296858 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fde50153e60 0x7fde500d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.869+0000 7fde55561640 1 --2- 172.21.15.114:0/855296858 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fde500cd6d0 0x7fde500d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.869+0000 7fde55561640 1 --2- 172.21.15.114:0/855296858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde500b4880 0x7fde501f00e0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.869+0000 7fde55561640 1 -- 172.21.15.114:0/855296858 >> 172.21.15.114:0/855296858 conn(0x7fde500cf880 msgr2=0x7fde500d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:36.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.869+0000 7fde55561640 1 -- 172.21.15.114:0/855296858 shutdown_connections 2023-11-04T01:38:36.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.869+0000 7fde55561640 1 -- 172.21.15.114:0/855296858 wait complete. 2023-11-04T01:38:36.882 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:36.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.979+0000 7f5c51410640 1 Processor -- start 2023-11-04T01:38:36.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.980+0000 7f5c51410640 1 -- start start 2023-11-04T01:38:36.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.980+0000 7f5c51410640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5c4c0ce240 0x7f5c4c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.980+0000 7f5c51410640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c4c157540 0x7f5c4c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.980+0000 7f5c51410640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4c15e000 con 0x7f5c4c0cde60 2023-11-04T01:38:36.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.980+0000 7f5c51410640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c15e5c0 con 0x7f5c4c157540 2023-11-04T01:38:36.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.980+0000 7f5c51410640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c15e2e0 con 0x7f5c4c0ce240 2023-11-04T01:38:36.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.980+0000 7f5c4b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c4c157540 0x7f5c4c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.981+0000 7f5c4b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c4c157540 0x7f5c4c0d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37596/0 (socket says 172.21.15.114:37596) 2023-11-04T01:38:36.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.981+0000 7f5c4b7fe640 1 -- 172.21.15.114:0/279811038 learned_addr learned my addr 172.21.15.114:0/279811038 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:36.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.981+0000 7f5c4a7fc640 1 --2- 172.21.15.114:0/279811038 >> v2:172.21.15.141:3300/0 conn(0x7f5c4c0ce240 0x7f5c4c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.981+0000 7f5c4b7fe640 1 -- 172.21.15.114:0/279811038 >> v2:172.21.15.141:3300/0 conn(0x7f5c4c0ce240 msgr2=0x7f5c4c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:36.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.981+0000 7f5c4b7fe640 1 --2- 172.21.15.114:0/279811038 >> v2:172.21.15.141:3300/0 conn(0x7f5c4c0ce240 0x7f5c4c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.981+0000 7f5c4b7fe640 1 -- 172.21.15.114:0/279811038 >> v1:172.21.15.141:6789/0 conn(0x7f5c4c0cde60 legacy=0x7f5c4c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:36.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.981+0000 7f5c4b7fe640 1 -- 172.21.15.114:0/279811038 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c0d1120 con 0x7f5c4c157540 2023-11-04T01:38:36.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.982+0000 7f5c4b7fe640 1 --2- 172.21.15.114:0/279811038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c4c157540 0x7f5c4c0d1920 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0cf5f0 tx=0x7f5c4402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3333999eb4877cc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.982+0000 7f5c49ffb640 1 -- 172.21.15.114:0/279811038 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4402ca80 con 0x7f5c4c157540 2023-11-04T01:38:36.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.982+0000 7f5c49ffb640 1 -- 172.21.15.114:0/279811038 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4402cbe0 con 0x7f5c4c157540 2023-11-04T01:38:36.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.982+0000 7f5c49ffb640 1 -- 172.21.15.114:0/279811038 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440343f0 con 0x7f5c4c157540 2023-11-04T01:38:36.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.982+0000 7f5c51410640 1 -- 172.21.15.114:0/279811038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c4c157540 msgr2=0x7f5c4c0d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.982+0000 7f5c51410640 1 --2- 172.21.15.114:0/279811038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c4c157540 0x7f5c4c0d1920 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0cf5f0 tx=0x7f5c4402bee0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.982+0000 7f5c51410640 1 -- 172.21.15.114:0/279811038 shutdown_connections 2023-11-04T01:38:36.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.982+0000 7f5c51410640 1 --2- 172.21.15.114:0/279811038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c4c157540 0x7f5c4c0d1920 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.982+0000 7f5c51410640 1 --2- 172.21.15.114:0/279811038 >> v2:172.21.15.141:3300/0 conn(0x7f5c4c0ce240 0x7f5c4c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.982+0000 7f5c51410640 1 -- 172.21.15.114:0/279811038 >> 172.21.15.114:0/279811038 conn(0x7f5c4c071f30 msgr2=0x7f5c4c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:36.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.982+0000 7f5c51410640 1 -- 172.21.15.114:0/279811038 shutdown_connections 2023-11-04T01:38:36.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.982+0000 7f5c51410640 1 -- 172.21.15.114:0/279811038 wait complete. 2023-11-04T01:38:36.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.983+0000 7f5c51410640 1 Processor -- start 2023-11-04T01:38:36.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.984+0000 7f5c51410640 1 -- start start 2023-11-04T01:38:36.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.984+0000 7f5c51410640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c4c0cde60 0x7f5c4c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.984+0000 7f5c51410640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c4c0ce240 0x7f5c4c153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.984+0000 7f5c51410640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c4c157540 0x7f5c4c1f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.984+0000 7f5c51410640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c153a90 con 0x7f5c4c0ce240 2023-11-04T01:38:36.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.984+0000 7f5c51410640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0cc570 con 0x7f5c4c157540 2023-11-04T01:38:36.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.984+0000 7f5c51410640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c1f34a0 con 0x7f5c4c0cde60 2023-11-04T01:38:36.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.984+0000 7f5c4a7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c4c0ce240 0x7f5c4c153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.984+0000 7f5c4a7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c4c0ce240 0x7f5c4c153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37612/0 (socket says 172.21.15.114:37612) 2023-11-04T01:38:36.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.984+0000 7f5c4a7fc640 1 -- 172.21.15.114:0/508228564 learned_addr learned my addr 172.21.15.114:0/508228564 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:36.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.985+0000 7f5c4b7fe640 1 --2- 172.21.15.114:0/508228564 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c4c157540 0x7f5c4c1f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.985+0000 7f5c4affd640 1 --2- 172.21.15.114:0/508228564 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c4c0cde60 0x7f5c4c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.985+0000 7f5c4a7fc640 1 -- 172.21.15.114:0/508228564 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c4c0cde60 msgr2=0x7f5c4c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.985+0000 7f5c4a7fc640 1 --2- 172.21.15.114:0/508228564 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c4c0cde60 0x7f5c4c15ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.985+0000 7f5c4a7fc640 1 -- 172.21.15.114:0/508228564 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c4c157540 msgr2=0x7f5c4c1f2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.985+0000 7f5c4a7fc640 1 --2- 172.21.15.114:0/508228564 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c4c157540 0x7f5c4c1f2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.985+0000 7f5c4a7fc640 1 -- 172.21.15.114:0/508228564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c44009b30 con 0x7f5c4c0ce240 2023-11-04T01:38:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.985+0000 7f5c4affd640 1 --2- 172.21.15.114:0/508228564 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c4c0cde60 0x7f5c4c15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.985+0000 7f5c4b7fe640 1 --2- 172.21.15.114:0/508228564 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c4c157540 0x7f5c4c1f2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.985+0000 7f5c4a7fc640 1 --2- 172.21.15.114:0/508228564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c4c0ce240 0x7f5c4c153550 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000d800 tx=0x7f5c4000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.985+0000 7f5c337fe640 1 -- 172.21.15.114:0/508228564 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4000b6c0 con 0x7f5c4c0ce240 2023-11-04T01:38:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.985+0000 7f5c337fe640 1 -- 172.21.15.114:0/508228564 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4000b820 con 0x7f5c4c0ce240 2023-11-04T01:38:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.985+0000 7f5c51410640 1 -- 172.21.15.114:0/508228564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c15b4a0 con 0x7f5c4c0ce240 2023-11-04T01:38:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.985+0000 7f5c337fe640 1 -- 172.21.15.114:0/508228564 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4000bbb0 con 0x7f5c4c0ce240 2023-11-04T01:38:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.985+0000 7f5c51410640 1 -- 172.21.15.114:0/508228564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c15ba60 con 0x7f5c4c0ce240 2023-11-04T01:38:36.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.986+0000 7f5c51410640 1 -- 172.21.15.114:0/508228564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c074290 con 0x7f5c4c0ce240 2023-11-04T01:38:36.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.986+0000 7f5c337fe640 1 -- 172.21.15.114:0/508228564 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5c4000bd10 con 0x7f5c4c0ce240 2023-11-04T01:38:36.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.987+0000 7f5c337fe640 1 --2- 172.21.15.114:0/508228564 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c3806aea0 0x7f5c3806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:36.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.987+0000 7f5c4affd640 1 --2- 172.21.15.114:0/508228564 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c3806aea0 0x7f5c3806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:36.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.987+0000 7f5c337fe640 1 -- 172.21.15.114:0/508228564 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5c40089e10 con 0x7f5c4c0ce240 2023-11-04T01:38:36.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.987+0000 7f5c4affd640 1 --2- 172.21.15.114:0/508228564 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c3806aea0 0x7f5c3806d360 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0cd850 tx=0x7f5c3c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:36.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:36.991+0000 7f5c337fe640 1 -- 172.21.15.114:0/508228564 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5c40054c20 con 0x7f5c4c0ce240 2023-11-04T01:38:37.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.192+0000 7f5c51410640 1 -- 172.21.15.114:0/508228564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c4c0c9580 con 0x7f5c4c0ce240 2023-11-04T01:38:37.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.192+0000 7f5c337fe640 1 -- 172.21.15.114:0/508228564 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f5c40058240 con 0x7f5c4c0ce240 2023-11-04T01:38:37.194 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:37.195 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1567359819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1567359819},{"type":"v1","addr":"172.21.15.141:6834","nonce":1567359819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/1960196694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":1960196694},{"type":"v1","addr":"172.21.15.141:6835","nonce":1960196694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2773454420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2773454420},{"type":"v1","addr":"172.21.15.114:6836","nonce":2773454420}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:19.359102+0000","modified":"2023-11-04T01:38:21.895586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6039":{"gid":6039,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2391405125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2391405125},{"type":"v1","addr":"172.21.15.114:6837","nonce":2391405125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:38:37.195 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 23 2023-11-04T01:38:37.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.194+0000 7f5c51410640 1 -- 172.21.15.114:0/508228564 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c3806aea0 msgr2=0x7f5c3806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.194+0000 7f5c51410640 1 --2- 172.21.15.114:0/508228564 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c3806aea0 0x7f5c3806d360 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0cd850 tx=0x7f5c3c008040 comp rx=0 tx=0).stop 2023-11-04T01:38:37.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.194+0000 7f5c51410640 1 -- 172.21.15.114:0/508228564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c4c0ce240 msgr2=0x7f5c4c153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.194+0000 7f5c51410640 1 --2- 172.21.15.114:0/508228564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c4c0ce240 0x7f5c4c153550 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000d800 tx=0x7f5c4000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.194+0000 7f5c51410640 1 -- 172.21.15.114:0/508228564 shutdown_connections 2023-11-04T01:38:37.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.194+0000 7f5c51410640 1 --2- 172.21.15.114:0/508228564 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5c3806aea0 0x7f5c3806d360 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.194+0000 7f5c51410640 1 --2- 172.21.15.114:0/508228564 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5c4c157540 0x7f5c4c1f2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.194+0000 7f5c51410640 1 --2- 172.21.15.114:0/508228564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c4c0ce240 0x7f5c4c153550 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.194+0000 7f5c51410640 1 --2- 172.21.15.114:0/508228564 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5c4c0cde60 0x7f5c4c15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.194+0000 7f5c51410640 1 -- 172.21.15.114:0/508228564 >> 172.21.15.114:0/508228564 conn(0x7f5c4c071f30 msgr2=0x7f5c4c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:37.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.194+0000 7f5c51410640 1 -- 172.21.15.114:0/508228564 shutdown_connections 2023-11-04T01:38:37.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.194+0000 7f5c51410640 1 -- 172.21.15.114:0/508228564 wait complete. 2023-11-04T01:38:37.207 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:37.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.304+0000 7fabe24a9640 1 Processor -- start 2023-11-04T01:38:37.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.304+0000 7fabe24a9640 1 -- start start 2023-11-04T01:38:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.305+0000 7fabe24a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fabdc0b2870 0x7fabdc0ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.305+0000 7fabe24a9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fabdc0c4120 0x7fabdc160f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.305+0000 7fabe24a9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabdc165130 con 0x7fabdc0b2c50 2023-11-04T01:38:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.305+0000 7fabe24a9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabdc0cc900 con 0x7fabdc0c4120 2023-11-04T01:38:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.305+0000 7fabe24a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc165360 con 0x7fabdc0b2870 2023-11-04T01:38:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.305+0000 7fabdb7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fabdc0c4120 0x7fabdc160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.305+0000 7fabdb7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fabdc0c4120 0x7fabdc160f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37618/0 (socket says 172.21.15.114:37618) 2023-11-04T01:38:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.305+0000 7fabdb7fe640 1 -- 172.21.15.114:0/3393918464 learned_addr learned my addr 172.21.15.114:0/3393918464 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.306+0000 7fabdbfff640 1 --2- 172.21.15.114:0/3393918464 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fabdc0b2870 0x7fabdc0ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.306+0000 7fabdb7fe640 1 -- 172.21.15.114:0/3393918464 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fabdc0b2870 msgr2=0x7fabdc0ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.306+0000 7fabdb7fe640 1 --2- 172.21.15.114:0/3393918464 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fabdc0b2870 0x7fabdc0ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.306+0000 7fabdb7fe640 1 -- 172.21.15.114:0/3393918464 >> v1:172.21.15.141:6789/0 conn(0x7fabdc0b2c50 legacy=0x7fabdc161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.306+0000 7fabdb7fe640 1 -- 172.21.15.114:0/3393918464 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc165640 con 0x7fabdc0c4120 2023-11-04T01:38:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.306+0000 7fabdbfff640 1 --2- 172.21.15.114:0/3393918464 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fabdc0b2870 0x7fabdc0ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.306+0000 7fabdb7fe640 1 --2- 172.21.15.114:0/3393918464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabdc0c4120 0x7fabdc160f20 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009870 tx=0x7fabd002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1d78aed34733a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.307+0000 7fabdaffd640 1 -- 172.21.15.114:0/3393918464 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0031640 con 0x7fabdc0c4120 2023-11-04T01:38:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.307+0000 7fabdaffd640 1 -- 172.21.15.114:0/3393918464 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd00317a0 con 0x7fabdc0c4120 2023-11-04T01:38:37.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.307+0000 7fabdaffd640 1 -- 172.21.15.114:0/3393918464 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0031b30 con 0x7fabdc0c4120 2023-11-04T01:38:37.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.307+0000 7fabe24a9640 1 -- 172.21.15.114:0/3393918464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabdc0c4120 msgr2=0x7fabdc160f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.307+0000 7fabe24a9640 1 --2- 172.21.15.114:0/3393918464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabdc0c4120 0x7fabdc160f20 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009870 tx=0x7fabd002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.307+0000 7fabe24a9640 1 -- 172.21.15.114:0/3393918464 shutdown_connections 2023-11-04T01:38:37.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.307+0000 7fabe24a9640 1 --2- 172.21.15.114:0/3393918464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabdc0c4120 0x7fabdc160f20 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.307+0000 7fabe24a9640 1 --2- 172.21.15.114:0/3393918464 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fabdc0b2870 0x7fabdc0ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.307+0000 7fabe24a9640 1 -- 172.21.15.114:0/3393918464 >> 172.21.15.114:0/3393918464 conn(0x7fabdc0cd600 msgr2=0x7fabdc0cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.307+0000 7fabe24a9640 1 -- 172.21.15.114:0/3393918464 shutdown_connections 2023-11-04T01:38:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.307+0000 7fabe24a9640 1 -- 172.21.15.114:0/3393918464 wait complete. 2023-11-04T01:38:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.308+0000 7fabe24a9640 1 Processor -- start 2023-11-04T01:38:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.308+0000 7fabe24a9640 1 -- start start 2023-11-04T01:38:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.309+0000 7fabe24a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fabdc0b2870 0x7fabdc1549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.309+0000 7fabe24a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabdc0b2c50 0x7fabdc0b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.309+0000 7fabe24a9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fabdc0c4120 0x7fabdc0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.309+0000 7fabe24a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0b4b90 con 0x7fabdc0b2c50 2023-11-04T01:38:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.309+0000 7fabe24a9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc154f00 con 0x7fabdc0c4120 2023-11-04T01:38:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.309+0000 7fabe24a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0b3f80 con 0x7fabdc0b2870 2023-11-04T01:38:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.309+0000 7fabdb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabdc0b2c50 0x7fabdc0b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.309+0000 7fabdb7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabdc0b2c50 0x7fabdc0b5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37624/0 (socket says 172.21.15.114:37624) 2023-11-04T01:38:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.309+0000 7fabdb7fe640 1 -- 172.21.15.114:0/488716414 learned_addr learned my addr 172.21.15.114:0/488716414 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.309+0000 7fabe0a46640 1 --2- 172.21.15.114:0/488716414 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fabdc0c4120 0x7fabdc0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.309+0000 7fabdbfff640 1 --2- 172.21.15.114:0/488716414 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fabdc0b2870 0x7fabdc1549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.310+0000 7fabdb7fe640 1 -- 172.21.15.114:0/488716414 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fabdc0b2870 msgr2=0x7fabdc1549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.310+0000 7fabdb7fe640 1 --2- 172.21.15.114:0/488716414 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fabdc0b2870 0x7fabdc1549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.310+0000 7fabdb7fe640 1 -- 172.21.15.114:0/488716414 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fabdc0c4120 msgr2=0x7fabdc0c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.310+0000 7fabdb7fe640 1 --2- 172.21.15.114:0/488716414 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fabdc0c4120 0x7fabdc0c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.310+0000 7fabdb7fe640 1 -- 172.21.15.114:0/488716414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd00094d0 con 0x7fabdc0b2c50 2023-11-04T01:38:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.310+0000 7fabe0a46640 1 --2- 172.21.15.114:0/488716414 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fabdc0c4120 0x7fabdc0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.310+0000 7fabdb7fe640 1 --2- 172.21.15.114:0/488716414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabdc0b2c50 0x7fabdc0b5020 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fabd002b930 tx=0x7fabd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.310+0000 7fabd8ff9640 1 -- 172.21.15.114:0/488716414 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd003bc70 con 0x7fabdc0b2c50 2023-11-04T01:38:37.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.310+0000 7fabd8ff9640 1 -- 172.21.15.114:0/488716414 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd003bdf0 con 0x7fabdc0b2c50 2023-11-04T01:38:37.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.310+0000 7fabe24a9640 1 -- 172.21.15.114:0/488716414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabdc0b4260 con 0x7fabdc0b2c50 2023-11-04T01:38:37.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.310+0000 7fabd8ff9640 1 -- 172.21.15.114:0/488716414 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0045630 con 0x7fabdc0b2c50 2023-11-04T01:38:37.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.310+0000 7fabe24a9640 1 -- 172.21.15.114:0/488716414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabdc0b4820 con 0x7fabdc0b2c50 2023-11-04T01:38:37.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.311+0000 7fabe24a9640 1 -- 172.21.15.114:0/488716414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabdc165ec0 con 0x7fabdc0b2c50 2023-11-04T01:38:37.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.311+0000 7fabd8ff9640 1 -- 172.21.15.114:0/488716414 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fabd002f050 con 0x7fabdc0b2c50 2023-11-04T01:38:37.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.312+0000 7fabd8ff9640 1 --2- 172.21.15.114:0/488716414 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fabc806ae70 0x7fabc806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.312+0000 7fabd8ff9640 1 -- 172.21.15.114:0/488716414 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fabd00ab790 con 0x7fabdc0b2c50 2023-11-04T01:38:37.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.312+0000 7fabdbfff640 1 --2- 172.21.15.114:0/488716414 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fabc806ae70 0x7fabc806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.312+0000 7fabdbfff640 1 --2- 172.21.15.114:0/488716414 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fabc806ae70 0x7fabc806d330 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fabcc00b9f0 tx=0x7fabcc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.316+0000 7fabd8ff9640 1 -- 172.21.15.114:0/488716414 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fabdc165ec0 con 0x7fabdc0b2c50 2023-11-04T01:38:37.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.484+0000 7fabe24a9640 1 -- 172.21.15.114:0/488716414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabdc165ec0 con 0x7fabdc0b2c50 2023-11-04T01:38:37.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.486+0000 7fabd8ff9640 1 -- 172.21.15.114:0/488716414 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18583 (secure 0 0 0) 0x7fabdc165ec0 con 0x7fabdc0b2c50 2023-11-04T01:38:37.488 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:37.488 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":54,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:21.029391+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:17.859902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:18.334035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:37.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.488+0000 7fabe24a9640 1 -- 172.21.15.114:0/488716414 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fabc806ae70 msgr2=0x7fabc806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.488+0000 7fabe24a9640 1 --2- 172.21.15.114:0/488716414 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fabc806ae70 0x7fabc806d330 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fabcc00b9f0 tx=0x7fabcc008040 comp rx=0 tx=0).stop 2023-11-04T01:38:37.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.488+0000 7fabe24a9640 1 -- 172.21.15.114:0/488716414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabdc0b2c50 msgr2=0x7fabdc0b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.488+0000 7fabe24a9640 1 --2- 172.21.15.114:0/488716414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabdc0b2c50 0x7fabdc0b5020 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fabd002b930 tx=0x7fabd00046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.488+0000 7fabe24a9640 1 -- 172.21.15.114:0/488716414 shutdown_connections 2023-11-04T01:38:37.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.488+0000 7fabe24a9640 1 --2- 172.21.15.114:0/488716414 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fabc806ae70 0x7fabc806d330 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.488+0000 7fabe24a9640 1 --2- 172.21.15.114:0/488716414 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fabdc0c4120 0x7fabdc0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.488+0000 7fabe24a9640 1 --2- 172.21.15.114:0/488716414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabdc0b2c50 0x7fabdc0b5020 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.488+0000 7fabe24a9640 1 --2- 172.21.15.114:0/488716414 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fabdc0b2870 0x7fabdc1549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.488+0000 7fabe24a9640 1 -- 172.21.15.114:0/488716414 >> 172.21.15.114:0/488716414 conn(0x7fabdc0cd600 msgr2=0x7fabdc0d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:37.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.488+0000 7fabe24a9640 1 -- 172.21.15.114:0/488716414 shutdown_connections 2023-11-04T01:38:37.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.488+0000 7fabe24a9640 1 -- 172.21.15.114:0/488716414 wait complete. 2023-11-04T01:38:37.501 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:38:37.501 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:37.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.598+0000 7f55e1f3c640 1 Processor -- start 2023-11-04T01:38:37.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.598+0000 7f55e1f3c640 1 -- start start 2023-11-04T01:38:37.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.599+0000 7f55e1f3c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55dc0b0cd0 0x7f55dc070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.599+0000 7f55e1f3c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55dc0cc990 con 0x7f55dc0cda60 2023-11-04T01:38:37.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.599+0000 7f55e1f3c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55dc0ccc70 con 0x7f55dc0cde40 2023-11-04T01:38:37.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.599+0000 7f55e1f3c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55dc0c9ce0 con 0x7f55dc0b0cd0 2023-11-04T01:38:37.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.599+0000 7f55daffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55dc0b0cd0 0x7f55dc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.599+0000 7f55db7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f55dc0cda60 0x7f55dc0ca7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45914/0 (socket says 172.21.15.114:45914) 2023-11-04T01:38:37.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.599+0000 7f55daffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55dc0b0cd0 0x7f55dc070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37640/0 (socket says 172.21.15.114:37640) 2023-11-04T01:38:37.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.599+0000 7f55db7fe640 1 -- 172.21.15.114:0/282625163 learned_addr learned my addr 172.21.15.114:0/282625163 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:37.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.599+0000 7f55daffd640 1 -- 172.21.15.114:0/282625163 >> v1:172.21.15.141:6789/0 conn(0x7f55dc0cde40 legacy=0x7f55dc06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:37.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.599+0000 7f55daffd640 1 -- 172.21.15.114:0/282625163 >> v1:172.21.15.114:6789/0 conn(0x7f55dc0cda60 legacy=0x7f55dc0ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.600+0000 7f55daffd640 1 -- 172.21.15.114:0/282625163 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc0c9fc0 con 0x7f55dc0b0cd0 2023-11-04T01:38:37.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.600+0000 7f55daffd640 1 --2- 172.21.15.114:0/282625163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55dc0b0cd0 0x7f55dc070630 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f55d00097a0 tx=0x7f55d002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f587bb4d6e1c320 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.600+0000 7f55da7fc640 1 -- 172.21.15.114:0/282625163 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d0031830 con 0x7f55dc0b0cd0 2023-11-04T01:38:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.600+0000 7f55da7fc640 1 -- 172.21.15.114:0/282625163 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d0031990 con 0x7f55dc0b0cd0 2023-11-04T01:38:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.600+0000 7f55da7fc640 1 -- 172.21.15.114:0/282625163 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d0031d20 con 0x7f55dc0b0cd0 2023-11-04T01:38:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.601+0000 7f55e1f3c640 1 -- 172.21.15.114:0/282625163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55dc0b0cd0 msgr2=0x7f55dc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.601+0000 7f55e1f3c640 1 --2- 172.21.15.114:0/282625163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55dc0b0cd0 0x7f55dc070630 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f55d00097a0 tx=0x7f55d002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.601+0000 7f55e1f3c640 1 -- 172.21.15.114:0/282625163 shutdown_connections 2023-11-04T01:38:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.601+0000 7f55e1f3c640 1 --2- 172.21.15.114:0/282625163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55dc0b0cd0 0x7f55dc070630 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.601+0000 7f55e1f3c640 1 -- 172.21.15.114:0/282625163 >> 172.21.15.114:0/282625163 conn(0x7f55dc0ce950 msgr2=0x7f55dc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.601+0000 7f55e1f3c640 1 -- 172.21.15.114:0/282625163 shutdown_connections 2023-11-04T01:38:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.601+0000 7f55e1f3c640 1 -- 172.21.15.114:0/282625163 wait complete. 2023-11-04T01:38:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.602+0000 7f55e1f3c640 1 Processor -- start 2023-11-04T01:38:37.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.602+0000 7f55e1f3c640 1 -- start start 2023-11-04T01:38:37.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.603+0000 7f55e1f3c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55dc0b0cd0 0x7f55dc151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.603+0000 7f55e1f3c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55dc0cda60 0x7f55dc15b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.603+0000 7f55e1f3c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55dc0cde40 0x7f55dc0c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.603+0000 7f55e1f3c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc151790 con 0x7f55dc0cde40 2023-11-04T01:38:37.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.603+0000 7f55e1f3c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc150dc0 con 0x7f55dc0b0cd0 2023-11-04T01:38:37.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.603+0000 7f55e1f3c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc150490 con 0x7f55dc0cda60 2023-11-04T01:38:37.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.603+0000 7f55dbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55dc0cde40 0x7f55dc0c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.603+0000 7f55dbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55dc0cde40 0x7f55dc0c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37644/0 (socket says 172.21.15.114:37644) 2023-11-04T01:38:37.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.603+0000 7f55dbfff640 1 -- 172.21.15.114:0/1799222231 learned_addr learned my addr 172.21.15.114:0/1799222231 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:37.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.603+0000 7f55daffd640 1 --2- 172.21.15.114:0/1799222231 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55dc0cda60 0x7f55dc15b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.603+0000 7f55db7fe640 1 --2- 172.21.15.114:0/1799222231 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55dc0b0cd0 0x7f55dc151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.603+0000 7f55dbfff640 1 -- 172.21.15.114:0/1799222231 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55dc0cda60 msgr2=0x7f55dc15b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.603+0000 7f55dbfff640 1 --2- 172.21.15.114:0/1799222231 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55dc0cda60 0x7f55dc15b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.603+0000 7f55dbfff640 1 -- 172.21.15.114:0/1799222231 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55dc0b0cd0 msgr2=0x7f55dc151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.603+0000 7f55dbfff640 1 --2- 172.21.15.114:0/1799222231 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55dc0b0cd0 0x7f55dc151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.603+0000 7f55dbfff640 1 -- 172.21.15.114:0/1799222231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d0009400 con 0x7f55dc0cde40 2023-11-04T01:38:37.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.604+0000 7f55dbfff640 1 --2- 172.21.15.114:0/1799222231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55dc0cde40 0x7f55dc0c7fa0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f55d400db90 tx=0x7f55d400dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.604+0000 7f55c3fff640 1 -- 172.21.15.114:0/1799222231 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d400e980 con 0x7f55dc0cde40 2023-11-04T01:38:37.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.604+0000 7f55c3fff640 1 -- 172.21.15.114:0/1799222231 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d400eae0 con 0x7f55dc0cde40 2023-11-04T01:38:37.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.604+0000 7f55c3fff640 1 -- 172.21.15.114:0/1799222231 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4009560 con 0x7f55dc0cde40 2023-11-04T01:38:37.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.604+0000 7f55e1f3c640 1 -- 172.21.15.114:0/1799222231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55dc150770 con 0x7f55dc0cde40 2023-11-04T01:38:37.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.604+0000 7f55e1f3c640 1 -- 172.21.15.114:0/1799222231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55dc0c8ad0 con 0x7f55dc0cde40 2023-11-04T01:38:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.605+0000 7f55e1f3c640 1 -- 172.21.15.114:0/1799222231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55dc150f50 con 0x7f55dc0cde40 2023-11-04T01:38:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.605+0000 7f55c3fff640 1 -- 172.21.15.114:0/1799222231 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f55d40096c0 con 0x7f55dc0cde40 2023-11-04T01:38:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.606+0000 7f55c3fff640 1 --2- 172.21.15.114:0/1799222231 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f55c806ae70 0x7f55c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.606+0000 7f55db7fe640 1 --2- 172.21.15.114:0/1799222231 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f55c806ae70 0x7f55c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.606+0000 7f55c3fff640 1 -- 172.21.15.114:0/1799222231 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f55d408b5d0 con 0x7f55dc0cde40 2023-11-04T01:38:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.606+0000 7f55db7fe640 1 --2- 172.21.15.114:0/1799222231 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f55c806ae70 0x7f55c806d330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f55cc005880 tx=0x7f55cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.612+0000 7f55c3fff640 1 -- 172.21.15.114:0/1799222231 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f55d40563e0 con 0x7f55dc0cde40 2023-11-04T01:38:37.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.810+0000 7f55e1f3c640 1 -- 172.21.15.114:0/1799222231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55dc074290 con 0x7f55dc0cde40 2023-11-04T01:38:37.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.811+0000 7f55c3fff640 1 -- 172.21.15.114:0/1799222231 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f55d4059a00 con 0x7f55dc0cde40 2023-11-04T01:38:37.813 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:37.813 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1567359819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1567359819},{"type":"v1","addr":"172.21.15.141:6834","nonce":1567359819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/1960196694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":1960196694},{"type":"v1","addr":"172.21.15.141:6835","nonce":1960196694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2773454420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2773454420},{"type":"v1","addr":"172.21.15.114:6836","nonce":2773454420}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:19.359102+0000","modified":"2023-11-04T01:38:21.895586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6039":{"gid":6039,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2391405125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2391405125},{"type":"v1","addr":"172.21.15.114:6837","nonce":2391405125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:38:37.814 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 23 2023-11-04T01:38:37.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.813+0000 7f55e1f3c640 1 -- 172.21.15.114:0/1799222231 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f55c806ae70 msgr2=0x7f55c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.813+0000 7f55e1f3c640 1 --2- 172.21.15.114:0/1799222231 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f55c806ae70 0x7f55c806d330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f55cc005880 tx=0x7f55cc009040 comp rx=0 tx=0).stop 2023-11-04T01:38:37.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.813+0000 7f55e1f3c640 1 -- 172.21.15.114:0/1799222231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55dc0cde40 msgr2=0x7f55dc0c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.813+0000 7f55e1f3c640 1 --2- 172.21.15.114:0/1799222231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55dc0cde40 0x7f55dc0c7fa0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f55d400db90 tx=0x7f55d400dc80 comp rx=0 tx=0).stop 2023-11-04T01:38:37.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.813+0000 7f55e1f3c640 1 -- 172.21.15.114:0/1799222231 shutdown_connections 2023-11-04T01:38:37.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.813+0000 7f55e1f3c640 1 --2- 172.21.15.114:0/1799222231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55dc0cde40 0x7f55dc0c7fa0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.813+0000 7f55e1f3c640 1 --2- 172.21.15.114:0/1799222231 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f55dc0cda60 0x7f55dc15b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.813+0000 7f55e1f3c640 1 --2- 172.21.15.114:0/1799222231 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f55c806ae70 0x7f55c806d330 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.813+0000 7f55e1f3c640 1 --2- 172.21.15.114:0/1799222231 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f55dc0b0cd0 0x7f55dc151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.813+0000 7f55e1f3c640 1 -- 172.21.15.114:0/1799222231 >> 172.21.15.114:0/1799222231 conn(0x7f55dc0ce950 msgr2=0x7f55dc158da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:37.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.813+0000 7f55e1f3c640 1 -- 172.21.15.114:0/1799222231 shutdown_connections 2023-11-04T01:38:37.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.813+0000 7f55e1f3c640 1 -- 172.21.15.114:0/1799222231 wait complete. 2023-11-04T01:38:37.827 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.926+0000 7fbc4a856640 1 Processor -- start 2023-11-04T01:38:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.926+0000 7fbc4a856640 1 -- start start 2023-11-04T01:38:37.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.927+0000 7fbc4a856640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbc44159c70 0x7fbc440ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.927+0000 7fbc4a856640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc440b0ae0 0x7fbc4415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.927+0000 7fbc4a856640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc440b4110 con 0x7fbc4406db20 2023-11-04T01:38:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.927+0000 7fbc4a856640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc440b49b0 con 0x7fbc44159c70 2023-11-04T01:38:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.927+0000 7fbc4a856640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc440b43f0 con 0x7fbc440b0ae0 2023-11-04T01:38:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.927+0000 7fbc43fff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbc44159c70 0x7fbc440ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.927+0000 7fbc48df3640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc440b0ae0 0x7fbc4415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.927+0000 7fbc43fff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbc44159c70 0x7fbc440ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:53876/0 (socket says 172.21.15.114:53876) 2023-11-04T01:38:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.927+0000 7fbc43fff640 1 -- 172.21.15.114:0/2645801055 learned_addr learned my addr 172.21.15.114:0/2645801055 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.927+0000 7fbc48df3640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc440b0ae0 0x7fbc4415d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:43548/0 (socket says 172.21.15.114:43548) 2023-11-04T01:38:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.927+0000 7fbc437fe640 1 --1- 172.21.15.114:0/2645801055 >> v1:172.21.15.141:6789/0 conn(0x7fbc4406db20 0x7fbc440b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:53488/0 (socket says 172.21.15.114:53488) 2023-11-04T01:38:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.928+0000 7fbc43fff640 1 -- 172.21.15.114:0/2645801055 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc440b0ae0 msgr2=0x7fbc4415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.928+0000 7fbc43fff640 1 --2- 172.21.15.114:0/2645801055 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc440b0ae0 0x7fbc4415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.928+0000 7fbc43fff640 1 -- 172.21.15.114:0/2645801055 >> v1:172.21.15.141:6789/0 conn(0x7fbc4406db20 legacy=0x7fbc440b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.928+0000 7fbc42ffd640 1 -- 172.21.15.114:0/2645801055 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929060885 0 0) 0x7fbc440b4110 con 0x7fbc4406db20 2023-11-04T01:38:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.928+0000 7fbc43fff640 1 -- 172.21.15.114:0/2645801055 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc440b46d0 con 0x7fbc44159c70 2023-11-04T01:38:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.928+0000 7fbc48df3640 1 --2- 172.21.15.114:0/2645801055 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc440b0ae0 0x7fbc4415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.929+0000 7fbc43fff640 1 --2- 172.21.15.114:0/2645801055 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc44159c70 0x7fbc440ce370 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400bb10 tx=0x7fbc3402e150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=309f6eb4a3bd12d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.929+0000 7fbc42ffd640 1 -- 172.21.15.114:0/2645801055 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34036440 con 0x7fbc44159c70 2023-11-04T01:38:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.929+0000 7fbc42ffd640 1 -- 172.21.15.114:0/2645801055 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc340365a0 con 0x7fbc44159c70 2023-11-04T01:38:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.929+0000 7fbc42ffd640 1 -- 172.21.15.114:0/2645801055 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34036930 con 0x7fbc44159c70 2023-11-04T01:38:37.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.929+0000 7fbc4a856640 1 -- 172.21.15.114:0/2645801055 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc44159c70 msgr2=0x7fbc440ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.929+0000 7fbc4a856640 1 --2- 172.21.15.114:0/2645801055 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc44159c70 0x7fbc440ce370 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400bb10 tx=0x7fbc3402e150 comp rx=0 tx=0).stop 2023-11-04T01:38:37.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.929+0000 7fbc4a856640 1 -- 172.21.15.114:0/2645801055 shutdown_connections 2023-11-04T01:38:37.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.929+0000 7fbc4a856640 1 --2- 172.21.15.114:0/2645801055 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc440b0ae0 0x7fbc4415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.929+0000 7fbc4a856640 1 --2- 172.21.15.114:0/2645801055 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc44159c70 0x7fbc440ce370 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.929+0000 7fbc4a856640 1 -- 172.21.15.114:0/2645801055 >> 172.21.15.114:0/2645801055 conn(0x7fbc440ce950 msgr2=0x7fbc440ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:37.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.929+0000 7fbc4a856640 1 -- 172.21.15.114:0/2645801055 shutdown_connections 2023-11-04T01:38:37.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.929+0000 7fbc4a856640 1 -- 172.21.15.114:0/2645801055 wait complete. 2023-11-04T01:38:37.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.930+0000 7fbc4a856640 1 Processor -- start 2023-11-04T01:38:37.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.931+0000 7fbc4a856640 1 -- start start 2023-11-04T01:38:37.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.931+0000 7fbc4a856640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc4406db20 0x7fbc44156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.931+0000 7fbc4a856640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc440b0ae0 0x7fbc441ee6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.931+0000 7fbc4a856640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc44159c70 0x7fbc441ef830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.931+0000 7fbc4a856640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc441eefe0 con 0x7fbc4406db20 2023-11-04T01:38:37.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.931+0000 7fbc4a856640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc441ef2c0 con 0x7fbc44159c70 2023-11-04T01:38:37.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.931+0000 7fbc4a856640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc441ef5a0 con 0x7fbc440b0ae0 2023-11-04T01:38:37.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc43fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc4406db20 0x7fbc44156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc43fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc4406db20 0x7fbc44156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37662/0 (socket says 172.21.15.114:37662) 2023-11-04T01:38:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc43fff640 1 -- 172.21.15.114:0/104709847 learned_addr learned my addr 172.21.15.114:0/104709847 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc437fe640 1 --2- 172.21.15.114:0/104709847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc440b0ae0 0x7fbc441ee6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc48df3640 1 --2- 172.21.15.114:0/104709847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc44159c70 0x7fbc441ef830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc43fff640 1 -- 172.21.15.114:0/104709847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc440b0ae0 msgr2=0x7fbc441ee6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc43fff640 1 --2- 172.21.15.114:0/104709847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc440b0ae0 0x7fbc441ee6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc43fff640 1 -- 172.21.15.114:0/104709847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc44159c70 msgr2=0x7fbc441ef830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc43fff640 1 --2- 172.21.15.114:0/104709847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc44159c70 0x7fbc441ef830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc43fff640 1 -- 172.21.15.114:0/104709847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c009a70 con 0x7fbc4406db20 2023-11-04T01:38:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc437fe640 1 --2- 172.21.15.114:0/104709847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc440b0ae0 0x7fbc441ee6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc48df3640 1 --2- 172.21.15.114:0/104709847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc44159c70 0x7fbc441ef830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc43fff640 1 --2- 172.21.15.114:0/104709847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc4406db20 0x7fbc44156de0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fbc34000c00 tx=0x7fbc340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc40ff9640 1 -- 172.21.15.114:0/104709847 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34036440 con 0x7fbc4406db20 2023-11-04T01:38:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc40ff9640 1 -- 172.21.15.114:0/104709847 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc34004230 con 0x7fbc4406db20 2023-11-04T01:38:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc4a856640 1 -- 172.21.15.114:0/104709847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3400b770 con 0x7fbc4406db20 2023-11-04T01:38:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc40ff9640 1 -- 172.21.15.114:0/104709847 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34036e20 con 0x7fbc4406db20 2023-11-04T01:38:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.932+0000 7fbc4a856640 1 -- 172.21.15.114:0/104709847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc440a7850 con 0x7fbc4406db20 2023-11-04T01:38:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.933+0000 7fbc4a856640 1 -- 172.21.15.114:0/104709847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc44074290 con 0x7fbc4406db20 2023-11-04T01:38:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.934+0000 7fbc40ff9640 1 -- 172.21.15.114:0/104709847 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc34034980 con 0x7fbc4406db20 2023-11-04T01:38:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.934+0000 7fbc40ff9640 1 --2- 172.21.15.114:0/104709847 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbc3006ae70 0x7fbc3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.934+0000 7fbc40ff9640 1 -- 172.21.15.114:0/104709847 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbc340aee00 con 0x7fbc4406db20 2023-11-04T01:38:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.934+0000 7fbc437fe640 1 --2- 172.21.15.114:0/104709847 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbc3006ae70 0x7fbc3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.935+0000 7fbc437fe640 1 --2- 172.21.15.114:0/104709847 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbc3006ae70 0x7fbc3006d330 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbc44158bb0 tx=0x7fbc38007c30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:37.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:37.938+0000 7fbc40ff9640 1 -- 172.21.15.114:0/104709847 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc34079dc0 con 0x7fbc4406db20 2023-11-04T01:38:38.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.139+0000 7fbc4a856640 1 -- 172.21.15.114:0/104709847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc4406d3f0 con 0x7fbc4406db20 2023-11-04T01:38:38.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.140+0000 7fbc40ff9640 1 -- 172.21.15.114:0/104709847 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fbc3407d3e0 con 0x7fbc4406db20 2023-11-04T01:38:38.142 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:38.142 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1567359819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1567359819},{"type":"v1","addr":"172.21.15.141:6834","nonce":1567359819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/1960196694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":1960196694},{"type":"v1","addr":"172.21.15.141:6835","nonce":1960196694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2773454420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2773454420},{"type":"v1","addr":"172.21.15.114:6836","nonce":2773454420}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:19.359102+0000","modified":"2023-11-04T01:38:21.895586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6039":{"gid":6039,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/2391405125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2391405125},{"type":"v1","addr":"172.21.15.114:6837","nonce":2391405125}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:38:38.143 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 23 2023-11-04T01:38:38.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.142+0000 7fbc4a856640 1 -- 172.21.15.114:0/104709847 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbc3006ae70 msgr2=0x7fbc3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.142+0000 7fbc4a856640 1 --2- 172.21.15.114:0/104709847 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbc3006ae70 0x7fbc3006d330 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbc44158bb0 tx=0x7fbc38007c30 comp rx=0 tx=0).stop 2023-11-04T01:38:38.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.142+0000 7fbc4a856640 1 -- 172.21.15.114:0/104709847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc4406db20 msgr2=0x7fbc44156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.142+0000 7fbc4a856640 1 --2- 172.21.15.114:0/104709847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc4406db20 0x7fbc44156de0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fbc34000c00 tx=0x7fbc340046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.142+0000 7fbc4a856640 1 -- 172.21.15.114:0/104709847 shutdown_connections 2023-11-04T01:38:38.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.142+0000 7fbc4a856640 1 --2- 172.21.15.114:0/104709847 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbc3006ae70 0x7fbc3006d330 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.142+0000 7fbc4a856640 1 --2- 172.21.15.114:0/104709847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc44159c70 0x7fbc441ef830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.142+0000 7fbc4a856640 1 --2- 172.21.15.114:0/104709847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc440b0ae0 0x7fbc441ee6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.142+0000 7fbc4a856640 1 --2- 172.21.15.114:0/104709847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc4406db20 0x7fbc44156de0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.142+0000 7fbc4a856640 1 -- 172.21.15.114:0/104709847 >> 172.21.15.114:0/104709847 conn(0x7fbc440ce950 msgr2=0x7fbc44158e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:38.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.142+0000 7fbc4a856640 1 -- 172.21.15.114:0/104709847 shutdown_connections 2023-11-04T01:38:38.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.142+0000 7fbc4a856640 1 -- 172.21.15.114:0/104709847 wait complete. 2023-11-04T01:38:38.155 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:38.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.252+0000 7fb0ccb4c640 1 Processor -- start 2023-11-04T01:38:38.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.252+0000 7fb0ccb4c640 1 -- start start 2023-11-04T01:38:38.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.253+0000 7fb0ccb4c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb0c80b0ae0 0x7fb0c80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.253+0000 7fb0ccb4c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0c806db20 0x7fb0c815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.253+0000 7fb0ccb4c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c80b4110 con 0x7fb0c8159c70 2023-11-04T01:38:38.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.253+0000 7fb0ccb4c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c80b49b0 con 0x7fb0c806db20 2023-11-04T01:38:38.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.253+0000 7fb0ccb4c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c80b43f0 con 0x7fb0c80b0ae0 2023-11-04T01:38:38.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.253+0000 7fb0c6d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0c806db20 0x7fb0c815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.253+0000 7fb0c6d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0c806db20 0x7fb0c815d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37674/0 (socket says 172.21.15.114:37674) 2023-11-04T01:38:38.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.253+0000 7fb0c6d9d640 1 -- 172.21.15.114:0/4186217045 learned_addr learned my addr 172.21.15.114:0/4186217045 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:38.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.253+0000 7fb0c659c640 1 --1- 172.21.15.114:0/4186217045 >> v1:172.21.15.114:6789/0 conn(0x7fb0c8159c70 0x7fb0c80b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45926/0 (socket says 172.21.15.114:45926) 2023-11-04T01:38:38.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.253+0000 7fb0c6d9d640 1 -- 172.21.15.114:0/4186217045 >> v2:172.21.15.141:3300/0 conn(0x7fb0c80b0ae0 msgr2=0x7fb0c80ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:38.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.253+0000 7fb0bffff640 1 --2- 172.21.15.114:0/4186217045 >> v2:172.21.15.141:3300/0 conn(0x7fb0c80b0ae0 0x7fb0c80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.253+0000 7fb0c6d9d640 1 --2- 172.21.15.114:0/4186217045 >> v2:172.21.15.141:3300/0 conn(0x7fb0c80b0ae0 0x7fb0c80ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.253+0000 7fb0c6d9d640 1 -- 172.21.15.114:0/4186217045 >> v1:172.21.15.114:6789/0 conn(0x7fb0c8159c70 legacy=0x7fb0c80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.253+0000 7fb0c5d9b640 1 -- 172.21.15.114:0/4186217045 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136013552 0 0) 0x7fb0c80b4110 con 0x7fb0c8159c70 2023-11-04T01:38:38.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.253+0000 7fb0c6d9d640 1 -- 172.21.15.114:0/4186217045 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c80b46d0 con 0x7fb0c806db20 2023-11-04T01:38:38.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.254+0000 7fb0c6d9d640 1 --2- 172.21.15.114:0/4186217045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0c806db20 0x7fb0c815d7d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80cf800 tx=0x7fb0c002e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d45a6d01ab4a06 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.254+0000 7fb0c5d9b640 1 -- 172.21.15.114:0/4186217045 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c000b0d0 con 0x7fb0c806db20 2023-11-04T01:38:38.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.254+0000 7fb0c5d9b640 1 -- 172.21.15.114:0/4186217045 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c000b230 con 0x7fb0c806db20 2023-11-04T01:38:38.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.254+0000 7fb0c5d9b640 1 -- 172.21.15.114:0/4186217045 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0009600 con 0x7fb0c806db20 2023-11-04T01:38:38.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.254+0000 7fb0ccb4c640 1 -- 172.21.15.114:0/4186217045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0c806db20 msgr2=0x7fb0c815d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.254+0000 7fb0ccb4c640 1 --2- 172.21.15.114:0/4186217045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0c806db20 0x7fb0c815d7d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80cf800 tx=0x7fb0c002e180 comp rx=0 tx=0).stop 2023-11-04T01:38:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.255+0000 7fb0ccb4c640 1 -- 172.21.15.114:0/4186217045 shutdown_connections 2023-11-04T01:38:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.255+0000 7fb0ccb4c640 1 --2- 172.21.15.114:0/4186217045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0c806db20 0x7fb0c815d7d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.255+0000 7fb0ccb4c640 1 --2- 172.21.15.114:0/4186217045 >> v2:172.21.15.141:3300/0 conn(0x7fb0c80b0ae0 0x7fb0c80ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.255+0000 7fb0ccb4c640 1 -- 172.21.15.114:0/4186217045 >> 172.21.15.114:0/4186217045 conn(0x7fb0c80ce950 msgr2=0x7fb0c80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.255+0000 7fb0ccb4c640 1 -- 172.21.15.114:0/4186217045 shutdown_connections 2023-11-04T01:38:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.255+0000 7fb0ccb4c640 1 -- 172.21.15.114:0/4186217045 wait complete. 2023-11-04T01:38:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.256+0000 7fb0ccb4c640 1 Processor -- start 2023-11-04T01:38:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.256+0000 7fb0ccb4c640 1 -- start start 2023-11-04T01:38:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0ccb4c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0c806db20 0x7fb0c815a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0ccb4c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0c80b0ae0 0x7fb0c80ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0ccb4c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0c8159c70 0x7fb0c8153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0ccb4c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c80aede0 con 0x7fb0c806db20 2023-11-04T01:38:38.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0ccb4c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c80af0a0 con 0x7fb0c80b0ae0 2023-11-04T01:38:38.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0ccb4c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c815a900 con 0x7fb0c8159c70 2023-11-04T01:38:38.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0c659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0c806db20 0x7fb0c815a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0c659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0c806db20 0x7fb0c815a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37676/0 (socket says 172.21.15.114:37676) 2023-11-04T01:38:38.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0c659c640 1 -- 172.21.15.114:0/2073156100 learned_addr learned my addr 172.21.15.114:0/2073156100 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:38.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0c659c640 1 -- 172.21.15.114:0/2073156100 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0c8159c70 msgr2=0x7fb0c8153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0c659c640 1 --2- 172.21.15.114:0/2073156100 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0c8159c70 0x7fb0c8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0c659c640 1 -- 172.21.15.114:0/2073156100 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0c80b0ae0 msgr2=0x7fb0c80ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0c659c640 1 --2- 172.21.15.114:0/2073156100 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0c80b0ae0 0x7fb0c80ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0c659c640 1 -- 172.21.15.114:0/2073156100 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c000bd40 con 0x7fb0c806db20 2023-11-04T01:38:38.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0c659c640 1 --2- 172.21.15.114:0/2073156100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0c806db20 0x7fb0c815a3c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800c500 tx=0x7fb0b800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0beffd640 1 -- 172.21.15.114:0/2073156100 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8007560 con 0x7fb0c806db20 2023-11-04T01:38:38.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0beffd640 1 -- 172.21.15.114:0/2073156100 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b80047e0 con 0x7fb0c806db20 2023-11-04T01:38:38.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0ccb4c640 1 -- 172.21.15.114:0/2073156100 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c80abe20 con 0x7fb0c806db20 2023-11-04T01:38:38.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0beffd640 1 -- 172.21.15.114:0/2073156100 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8004b90 con 0x7fb0c806db20 2023-11-04T01:38:38.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.257+0000 7fb0ccb4c640 1 -- 172.21.15.114:0/2073156100 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c80ac3d0 con 0x7fb0c806db20 2023-11-04T01:38:38.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.258+0000 7fb0ccb4c640 1 -- 172.21.15.114:0/2073156100 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c8074290 con 0x7fb0c806db20 2023-11-04T01:38:38.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.259+0000 7fb0beffd640 1 -- 172.21.15.114:0/2073156100 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb0b8004cf0 con 0x7fb0c806db20 2023-11-04T01:38:38.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.259+0000 7fb0beffd640 1 --2- 172.21.15.114:0/2073156100 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0a806ae70 0x7fb0a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.259+0000 7fb0beffd640 1 -- 172.21.15.114:0/2073156100 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb0b8088d80 con 0x7fb0c806db20 2023-11-04T01:38:38.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.259+0000 7fb0bffff640 1 --2- 172.21.15.114:0/2073156100 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0a806ae70 0x7fb0a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.260+0000 7fb0bffff640 1 --2- 172.21.15.114:0/2073156100 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0a806ae70 0x7fb0a806d330 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0006fd0 tx=0x7fb0b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.263+0000 7fb0beffd640 1 -- 172.21.15.114:0/2073156100 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0b8053c20 con 0x7fb0c806db20 2023-11-04T01:38:38.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.431+0000 7fb0ccb4c640 1 -- 172.21.15.114:0/2073156100 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0c806d3f0 con 0x7fb0c806db20 2023-11-04T01:38:38.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.432+0000 7fb0beffd640 1 -- 172.21.15.114:0/2073156100 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18583 (secure 0 0 0) 0x7fb0b8018020 con 0x7fb0c806db20 2023-11-04T01:38:38.434 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:38.434 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":54,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:21.029391+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:17.859902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:18.334035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:38.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.434+0000 7fb0ccb4c640 1 -- 172.21.15.114:0/2073156100 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0a806ae70 msgr2=0x7fb0a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.434+0000 7fb0ccb4c640 1 --2- 172.21.15.114:0/2073156100 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0a806ae70 0x7fb0a806d330 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0006fd0 tx=0x7fb0b0008040 comp rx=0 tx=0).stop 2023-11-04T01:38:38.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.434+0000 7fb0ccb4c640 1 -- 172.21.15.114:0/2073156100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0c806db20 msgr2=0x7fb0c815a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.434+0000 7fb0ccb4c640 1 --2- 172.21.15.114:0/2073156100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0c806db20 0x7fb0c815a3c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800c500 tx=0x7fb0b800c9c0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.434+0000 7fb0ccb4c640 1 -- 172.21.15.114:0/2073156100 shutdown_connections 2023-11-04T01:38:38.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.434+0000 7fb0ccb4c640 1 --2- 172.21.15.114:0/2073156100 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0c8159c70 0x7fb0c8153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.434+0000 7fb0ccb4c640 1 --2- 172.21.15.114:0/2073156100 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0a806ae70 0x7fb0a806d330 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.434+0000 7fb0ccb4c640 1 --2- 172.21.15.114:0/2073156100 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0c80b0ae0 0x7fb0c80ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.434+0000 7fb0ccb4c640 1 --2- 172.21.15.114:0/2073156100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0c806db20 0x7fb0c815a3c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.434+0000 7fb0ccb4c640 1 -- 172.21.15.114:0/2073156100 >> 172.21.15.114:0/2073156100 conn(0x7fb0c80ce950 msgr2=0x7fb0c8158130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:38.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.434+0000 7fb0ccb4c640 1 -- 172.21.15.114:0/2073156100 shutdown_connections 2023-11-04T01:38:38.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.434+0000 7fb0ccb4c640 1 -- 172.21.15.114:0/2073156100 wait complete. 2023-11-04T01:38:38.447 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:38:38.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.545+0000 7fef44834640 1 Processor -- start 2023-11-04T01:38:38.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.545+0000 7fef44834640 1 -- start start 2023-11-04T01:38:38.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.546+0000 7fef44834640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fef4015e3f0 0x7fef400b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.546+0000 7fef44834640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef400cc300 0x7fef400b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.546+0000 7fef44834640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef400caa20 con 0x7fef400ca0a0 2023-11-04T01:38:38.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.546+0000 7fef44834640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef400cb230 con 0x7fef4015e3f0 2023-11-04T01:38:38.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.546+0000 7fef44834640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef400ca530 con 0x7fef400cc300 2023-11-04T01:38:38.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.546+0000 7fef3e59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fef4015e3f0 0x7fef400b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.546+0000 7fef3dd9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fef400ca0a0 0x7fef400cc920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45936/0 (socket says 172.21.15.114:45936) 2023-11-04T01:38:38.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.546+0000 7fef3dd9b640 1 -- 172.21.15.114:0/2362852990 learned_addr learned my addr 172.21.15.114:0/2362852990 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:38.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.546+0000 7fef3ed9d640 1 --2- 172.21.15.114:0/2362852990 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef400cc300 0x7fef400b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.546+0000 7fef3e59c640 1 -- 172.21.15.114:0/2362852990 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef400cc300 msgr2=0x7fef400b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:38.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.546+0000 7fef3e59c640 1 --2- 172.21.15.114:0/2362852990 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef400cc300 0x7fef400b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.546+0000 7fef3e59c640 1 -- 172.21.15.114:0/2362852990 >> v1:172.21.15.114:6789/0 conn(0x7fef400ca0a0 legacy=0x7fef400cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.546+0000 7fef3e59c640 1 -- 172.21.15.114:0/2362852990 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef400cac70 con 0x7fef4015e3f0 2023-11-04T01:38:38.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.546+0000 7fef3d59a640 1 -- 172.21.15.114:0/2362852990 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168422396 0 0) 0x7fef400caa20 con 0x7fef400ca0a0 2023-11-04T01:38:38.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.547+0000 7fef3e59c640 1 --2- 172.21.15.114:0/2362852990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef4015e3f0 0x7fef400b2bf0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fef30009d90 tx=0x7fef3002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24e2f68ecdee161 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.547+0000 7fef3d59a640 1 -- 172.21.15.114:0/2362852990 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3002cc50 con 0x7fef4015e3f0 2023-11-04T01:38:38.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.547+0000 7fef3d59a640 1 -- 172.21.15.114:0/2362852990 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3002cdb0 con 0x7fef4015e3f0 2023-11-04T01:38:38.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.547+0000 7fef3d59a640 1 -- 172.21.15.114:0/2362852990 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30034660 con 0x7fef4015e3f0 2023-11-04T01:38:38.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.547+0000 7fef44834640 1 -- 172.21.15.114:0/2362852990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef4015e3f0 msgr2=0x7fef400b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.547+0000 7fef44834640 1 --2- 172.21.15.114:0/2362852990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef4015e3f0 0x7fef400b2bf0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fef30009d90 tx=0x7fef3002bea0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.548+0000 7fef44834640 1 -- 172.21.15.114:0/2362852990 shutdown_connections 2023-11-04T01:38:38.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.548+0000 7fef44834640 1 --2- 172.21.15.114:0/2362852990 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef400cc300 0x7fef400b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.548+0000 7fef44834640 1 --2- 172.21.15.114:0/2362852990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef4015e3f0 0x7fef400b2bf0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.548+0000 7fef44834640 1 -- 172.21.15.114:0/2362852990 >> 172.21.15.114:0/2362852990 conn(0x7fef40071820 msgr2=0x7fef40071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:38.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.548+0000 7fef44834640 1 -- 172.21.15.114:0/2362852990 shutdown_connections 2023-11-04T01:38:38.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.548+0000 7fef44834640 1 -- 172.21.15.114:0/2362852990 wait complete. 2023-11-04T01:38:38.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.549+0000 7fef44834640 1 Processor -- start 2023-11-04T01:38:38.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.549+0000 7fef44834640 1 -- start start 2023-11-04T01:38:38.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef44834640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef400cc300 0x7fef400ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef44834640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef4015e3f0 0x7fef4015b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef44834640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4015d2a0 0x7fef400b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef44834640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4015cb10 con 0x7fef400cc300 2023-11-04T01:38:38.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef44834640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4015bff0 con 0x7fef4015e3f0 2023-11-04T01:38:38.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef44834640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4015c2d0 con 0x7fef4015d2a0 2023-11-04T01:38:38.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef3e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef400cc300 0x7fef400ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef3e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef400cc300 0x7fef400ceb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37684/0 (socket says 172.21.15.114:37684) 2023-11-04T01:38:38.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef3e59c640 1 -- 172.21.15.114:0/3166180731 learned_addr learned my addr 172.21.15.114:0/3166180731 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:38.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef3ed9d640 1 --2- 172.21.15.114:0/3166180731 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4015d2a0 0x7fef400b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef3dd9b640 1 --2- 172.21.15.114:0/3166180731 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef4015e3f0 0x7fef4015b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef3e59c640 1 -- 172.21.15.114:0/3166180731 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4015d2a0 msgr2=0x7fef400b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef3e59c640 1 --2- 172.21.15.114:0/3166180731 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4015d2a0 0x7fef400b4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef3e59c640 1 -- 172.21.15.114:0/3166180731 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef4015e3f0 msgr2=0x7fef4015b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef3e59c640 1 --2- 172.21.15.114:0/3166180731 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef4015e3f0 0x7fef4015b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef3e59c640 1 -- 172.21.15.114:0/3166180731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef30009a70 con 0x7fef400cc300 2023-11-04T01:38:38.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef3dd9b640 1 --2- 172.21.15.114:0/3166180731 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef4015e3f0 0x7fef4015b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:38.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef3e59c640 1 --2- 172.21.15.114:0/3166180731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef400cc300 0x7fef400ceb80 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fef30037040 tx=0x7fef30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef2effd640 1 -- 172.21.15.114:0/3166180731 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30040650 con 0x7fef400cc300 2023-11-04T01:38:38.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef2effd640 1 -- 172.21.15.114:0/3166180731 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef300407b0 con 0x7fef400cc300 2023-11-04T01:38:38.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef44834640 1 -- 172.21.15.114:0/3166180731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4015cd80 con 0x7fef400cc300 2023-11-04T01:38:38.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef2effd640 1 -- 172.21.15.114:0/3166180731 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30040ba0 con 0x7fef400cc300 2023-11-04T01:38:38.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.550+0000 7fef44834640 1 -- 172.21.15.114:0/3166180731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4015c5b0 con 0x7fef400cc300 2023-11-04T01:38:38.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.551+0000 7fef44834640 1 -- 172.21.15.114:0/3166180731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4015cf90 con 0x7fef400cc300 2023-11-04T01:38:38.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.552+0000 7fef2effd640 1 -- 172.21.15.114:0/3166180731 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef30040d00 con 0x7fef400cc300 2023-11-04T01:38:38.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.552+0000 7fef2effd640 1 --2- 172.21.15.114:0/3166180731 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fef2006ae70 0x7fef2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.552+0000 7fef3dd9b640 1 --2- 172.21.15.114:0/3166180731 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fef2006ae70 0x7fef2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.552+0000 7fef2effd640 1 -- 172.21.15.114:0/3166180731 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fef300ac6a0 con 0x7fef400cc300 2023-11-04T01:38:38.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.553+0000 7fef3dd9b640 1 --2- 172.21.15.114:0/3166180731 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fef2006ae70 0x7fef2006d330 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fef400cd6b0 tx=0x7fef34007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.557+0000 7fef2effd640 1 -- 172.21.15.114:0/3166180731 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fef300774b0 con 0x7fef400cc300 2023-11-04T01:38:38.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.758+0000 7fef44834640 1 -- 172.21.15.114:0/3166180731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fef40074290 con 0x7fef400cc300 2023-11-04T01:38:38.760 INFO:tasks.ceph.mon.a.smithi114.stderr:2023-11-04T01:38:38.758+0000 7f5b24eb8640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:38:38.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.760+0000 7fef2effd640 1 -- 172.21.15.114:0/3166180731 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7fef3007aad0 con 0x7fef400cc300 2023-11-04T01:38:38.761 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:38:38.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.762+0000 7fef44834640 1 -- 172.21.15.114:0/3166180731 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fef2006ae70 msgr2=0x7fef2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.762+0000 7fef44834640 1 --2- 172.21.15.114:0/3166180731 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fef2006ae70 0x7fef2006d330 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fef400cd6b0 tx=0x7fef34007c10 comp rx=0 tx=0).stop 2023-11-04T01:38:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.762+0000 7fef44834640 1 -- 172.21.15.114:0/3166180731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef400cc300 msgr2=0x7fef400ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.762+0000 7fef44834640 1 --2- 172.21.15.114:0/3166180731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef400cc300 0x7fef400ceb80 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fef30037040 tx=0x7fef30004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.762+0000 7fef44834640 1 -- 172.21.15.114:0/3166180731 shutdown_connections 2023-11-04T01:38:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.762+0000 7fef44834640 1 --2- 172.21.15.114:0/3166180731 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef4015d2a0 0x7fef400b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.762+0000 7fef44834640 1 --2- 172.21.15.114:0/3166180731 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fef2006ae70 0x7fef2006d330 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.762+0000 7fef44834640 1 --2- 172.21.15.114:0/3166180731 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef4015e3f0 0x7fef4015b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.762+0000 7fef44834640 1 --2- 172.21.15.114:0/3166180731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef400cc300 0x7fef400ceb80 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.762+0000 7fef44834640 1 -- 172.21.15.114:0/3166180731 >> 172.21.15.114:0/3166180731 conn(0x7fef40071820 msgr2=0x7fef40150f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.762+0000 7fef44834640 1 -- 172.21.15.114:0/3166180731 shutdown_connections 2023-11-04T01:38:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.762+0000 7fef44834640 1 -- 172.21.15.114:0/3166180731 wait complete. 2023-11-04T01:38:38.766 INFO:tasks.ceph.mds.c.smithi114.stderr: -630> 2023-11-04T01:38:25.291+0000 7fd5d50ea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:38:38.776 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:38:38.789 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2023-11-04T01:38:38.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.876+0000 7fe769589640 1 Processor -- start 2023-11-04T01:38:38.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.876+0000 7fe769589640 1 -- start start 2023-11-04T01:38:38.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.877+0000 7fe769589640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe7640ad730 0x7fe7640adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.877+0000 7fe769589640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7640c3900 con 0x7fe764070e20 2023-11-04T01:38:38.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.877+0000 7fe769589640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7640c3be0 con 0x7fe76415ad30 2023-11-04T01:38:38.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.877+0000 7fe769589640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7640ae260 con 0x7fe7640ad730 2023-11-04T01:38:38.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.877+0000 7fe7637fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe7640ad730 0x7fe7640adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.877+0000 7fe7637fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe7640ad730 0x7fe7640adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37714/0 (socket says 172.21.15.114:37714) 2023-11-04T01:38:38.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.877+0000 7fe7627fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe764070e20 0x7fe76415e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45940/0 (socket says 172.21.15.114:45940) 2023-11-04T01:38:38.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.877+0000 7fe7637fe640 1 -- 172.21.15.114:0/524084972 learned_addr learned my addr 172.21.15.114:0/524084972 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:38.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.878+0000 7fe7637fe640 1 -- 172.21.15.114:0/524084972 >> v1:172.21.15.141:6789/0 conn(0x7fe76415ad30 legacy=0x7fe764070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:38.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.878+0000 7fe7637fe640 1 -- 172.21.15.114:0/524084972 >> v1:172.21.15.114:6789/0 conn(0x7fe764070e20 legacy=0x7fe76415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.878+0000 7fe761ffb640 1 -- 172.21.15.114:0/524084972 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509620751 0 0) 0x7fe7640c3900 con 0x7fe764070e20 2023-11-04T01:38:38.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.878+0000 7fe7637fe640 1 -- 172.21.15.114:0/524084972 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7640c3ec0 con 0x7fe7640ad730 2023-11-04T01:38:38.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.878+0000 7fe7637fe640 1 --2- 172.21.15.114:0/524084972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7640ad730 0x7fe7640adc80 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009870 tx=0x7fe75c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb699c3a177c9a60 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.879+0000 7fe761ffb640 1 -- 172.21.15.114:0/524084972 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c031870 con 0x7fe7640ad730 2023-11-04T01:38:38.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.879+0000 7fe761ffb640 1 -- 172.21.15.114:0/524084972 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c0319d0 con 0x7fe7640ad730 2023-11-04T01:38:38.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.879+0000 7fe761ffb640 1 -- 172.21.15.114:0/524084972 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c031d60 con 0x7fe7640ad730 2023-11-04T01:38:38.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.879+0000 7fe769589640 1 -- 172.21.15.114:0/524084972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7640ad730 msgr2=0x7fe7640adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.879+0000 7fe769589640 1 --2- 172.21.15.114:0/524084972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7640ad730 0x7fe7640adc80 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009870 tx=0x7fe75c02b910 comp rx=0 tx=0).stop 2023-11-04T01:38:38.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.879+0000 7fe769589640 1 -- 172.21.15.114:0/524084972 shutdown_connections 2023-11-04T01:38:38.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.879+0000 7fe769589640 1 --2- 172.21.15.114:0/524084972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7640ad730 0x7fe7640adc80 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.879+0000 7fe769589640 1 -- 172.21.15.114:0/524084972 >> 172.21.15.114:0/524084972 conn(0x7fe7640ce950 msgr2=0x7fe7640ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:38.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.879+0000 7fe769589640 1 -- 172.21.15.114:0/524084972 shutdown_connections 2023-11-04T01:38:38.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.879+0000 7fe769589640 1 -- 172.21.15.114:0/524084972 wait complete. 2023-11-04T01:38:38.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.880+0000 7fe769589640 1 Processor -- start 2023-11-04T01:38:38.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.880+0000 7fe769589640 1 -- start start 2023-11-04T01:38:38.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.881+0000 7fe769589640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe764070e20 0x7fe76406d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.881+0000 7fe769589640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7640ad730 0x7fe76415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.881+0000 7fe769589640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe76415ad30 0x7fe76414b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.881+0000 7fe769589640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641f4340 con 0x7fe7640ad730 2023-11-04T01:38:38.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.881+0000 7fe769589640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641f4620 con 0x7fe764070e20 2023-11-04T01:38:38.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.881+0000 7fe769589640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641f4900 con 0x7fe76415ad30 2023-11-04T01:38:38.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.881+0000 7fe7627fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7640ad730 0x7fe76415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.881+0000 7fe7627fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7640ad730 0x7fe76415baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37718/0 (socket says 172.21.15.114:37718) 2023-11-04T01:38:38.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.881+0000 7fe7627fc640 1 -- 172.21.15.114:0/1319466189 learned_addr learned my addr 172.21.15.114:0/1319466189 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:38.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.881+0000 7fe762ffd640 1 --2- 172.21.15.114:0/1319466189 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe764070e20 0x7fe76406d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.881+0000 7fe7637fe640 1 --2- 172.21.15.114:0/1319466189 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe76415ad30 0x7fe76414b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.882+0000 7fe7627fc640 1 -- 172.21.15.114:0/1319466189 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe76415ad30 msgr2=0x7fe76414b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.882+0000 7fe7627fc640 1 --2- 172.21.15.114:0/1319466189 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe76415ad30 0x7fe76414b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.882+0000 7fe7627fc640 1 -- 172.21.15.114:0/1319466189 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe764070e20 msgr2=0x7fe76406d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:38.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.882+0000 7fe7627fc640 1 --2- 172.21.15.114:0/1319466189 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe764070e20 0x7fe76406d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:38.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.882+0000 7fe7627fc640 1 -- 172.21.15.114:0/1319466189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c0094d0 con 0x7fe7640ad730 2023-11-04T01:38:38.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.882+0000 7fe7627fc640 1 --2- 172.21.15.114:0/1319466189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7640ad730 0x7fe76415baa0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c4a0 tx=0x7fe75800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.882+0000 7fe74b7fe640 1 -- 172.21.15.114:0/1319466189 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7580074e0 con 0x7fe7640ad730 2023-11-04T01:38:38.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.882+0000 7fe74b7fe640 1 -- 172.21.15.114:0/1319466189 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe758007640 con 0x7fe7640ad730 2023-11-04T01:38:38.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.882+0000 7fe769589640 1 -- 172.21.15.114:0/1319466189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7641f4be0 con 0x7fe7640ad730 2023-11-04T01:38:38.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.882+0000 7fe74b7fe640 1 -- 172.21.15.114:0/1319466189 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758004a00 con 0x7fe7640ad730 2023-11-04T01:38:38.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.882+0000 7fe769589640 1 -- 172.21.15.114:0/1319466189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76406e090 con 0x7fe7640ad730 2023-11-04T01:38:38.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.883+0000 7fe769589640 1 -- 172.21.15.114:0/1319466189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7641f4e20 con 0x7fe7640ad730 2023-11-04T01:38:38.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.883+0000 7fe74b7fe640 1 -- 172.21.15.114:0/1319466189 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe758004b60 con 0x7fe7640ad730 2023-11-04T01:38:38.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.884+0000 7fe74b7fe640 1 --2- 172.21.15.114:0/1319466189 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe75006ae70 0x7fe75006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:38.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.884+0000 7fe74b7fe640 1 -- 172.21.15.114:0/1319466189 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fe758088ba0 con 0x7fe7640ad730 2023-11-04T01:38:38.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.884+0000 7fe762ffd640 1 --2- 172.21.15.114:0/1319466189 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe75006ae70 0x7fe75006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:38.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.884+0000 7fe762ffd640 1 --2- 172.21.15.114:0/1319466189 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe75006ae70 0x7fe75006d330 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe754009fd0 tx=0x7fe75400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:38.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:38.888+0000 7fe74b7fe640 1 -- 172.21.15.114:0/1319466189 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe758053a90 con 0x7fe7640ad730 2023-11-04T01:38:39.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.089+0000 7fe769589640 1 -- 172.21.15.114:0/1319466189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe76406e090 con 0x7fe7640ad730 2023-11-04T01:38:39.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.761+0000 7fe74b7fe640 1 -- 172.21.15.114:0/1319466189 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe76406e090 con 0x7fe7640ad730 2023-11-04T01:38:39.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.764+0000 7fe769589640 1 -- 172.21.15.114:0/1319466189 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe75006ae70 msgr2=0x7fe75006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.764+0000 7fe769589640 1 --2- 172.21.15.114:0/1319466189 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe75006ae70 0x7fe75006d330 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe754009fd0 tx=0x7fe75400d040 comp rx=0 tx=0).stop 2023-11-04T01:38:39.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.764+0000 7fe769589640 1 -- 172.21.15.114:0/1319466189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7640ad730 msgr2=0x7fe76415baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.764+0000 7fe769589640 1 --2- 172.21.15.114:0/1319466189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7640ad730 0x7fe76415baa0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c4a0 tx=0x7fe75800c960 comp rx=0 tx=0).stop 2023-11-04T01:38:39.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.764+0000 7fe769589640 1 -- 172.21.15.114:0/1319466189 shutdown_connections 2023-11-04T01:38:39.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.764+0000 7fe769589640 1 --2- 172.21.15.114:0/1319466189 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe76415ad30 0x7fe76414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.764+0000 7fe769589640 1 --2- 172.21.15.114:0/1319466189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7640ad730 0x7fe76415baa0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.764+0000 7fe769589640 1 --2- 172.21.15.114:0/1319466189 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe75006ae70 0x7fe75006d330 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.764+0000 7fe769589640 1 --2- 172.21.15.114:0/1319466189 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe764070e20 0x7fe76406d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.764+0000 7fe769589640 1 -- 172.21.15.114:0/1319466189 >> 172.21.15.114:0/1319466189 conn(0x7fe7640ce950 msgr2=0x7fe7640ca2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:39.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.764+0000 7fe769589640 1 -- 172.21.15.114:0/1319466189 shutdown_connections 2023-11-04T01:38:39.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.764+0000 7fe769589640 1 -- 172.21.15.114:0/1319466189 wait complete. 2023-11-04T01:38:39.779 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:38:39.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.929+0000 7f8e9b1a9640 1 Processor -- start 2023-11-04T01:38:39.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.929+0000 7f8e9b1a9640 1 -- start start 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e9b1a9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e94160c40 0x7f8e94071740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e9b1a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e940adbb0 0x7f8e94161020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e9b1a9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8e94161560 0x7f8e940c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e9b1a9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e940ccb00 con 0x7f8e94160c40 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e9b1a9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e940712b0 con 0x7f8e94161560 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e9b1a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e940cd030 con 0x7f8e940adbb0 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e98f45640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e94160c40 0x7f8e94071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e98f45640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e94160c40 0x7f8e94071740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37732/0 (socket says 172.21.15.114:37732) 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e98f45640 1 -- 172.21.15.114:0/3455434897 learned_addr learned my addr 172.21.15.114:0/3455434897 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e99746640 1 --2- 172.21.15.114:0/3455434897 >> v2:172.21.15.141:3300/0 conn(0x7f8e94161560 0x7f8e940c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e93fff640 1 --2- 172.21.15.114:0/3455434897 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e940adbb0 0x7f8e94161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e98f45640 1 -- 172.21.15.114:0/3455434897 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e940adbb0 msgr2=0x7f8e94161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:39.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e98f45640 1 --2- 172.21.15.114:0/3455434897 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e940adbb0 0x7f8e94161020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e98f45640 1 -- 172.21.15.114:0/3455434897 >> v2:172.21.15.141:3300/0 conn(0x7f8e94161560 msgr2=0x7f8e940c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:39.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e98f45640 1 --2- 172.21.15.114:0/3455434897 >> v2:172.21.15.141:3300/0 conn(0x7f8e94161560 0x7f8e940c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e98f45640 1 -- 172.21.15.114:0/3455434897 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e940ccd50 con 0x7f8e94160c40 2023-11-04T01:38:39.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e99746640 1 --2- 172.21.15.114:0/3455434897 >> v2:172.21.15.141:3300/0 conn(0x7f8e94161560 0x7f8e940c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:39.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.930+0000 7f8e93fff640 1 --2- 172.21.15.114:0/3455434897 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e940adbb0 0x7f8e94161020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:39.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.931+0000 7f8e98f45640 1 --2- 172.21.15.114:0/3455434897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e94160c40 0x7f8e94071740 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8e940ae0b0 tx=0x7f8e8802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0185680bb7940c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.931+0000 7f8e937fe640 1 -- 172.21.15.114:0/3455434897 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e88031870 con 0x7f8e94160c40 2023-11-04T01:38:39.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.931+0000 7f8e937fe640 1 -- 172.21.15.114:0/3455434897 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e880319d0 con 0x7f8e94160c40 2023-11-04T01:38:39.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.931+0000 7f8e937fe640 1 -- 172.21.15.114:0/3455434897 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e88031d60 con 0x7f8e94160c40 2023-11-04T01:38:39.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.932+0000 7f8e9b1a9640 1 -- 172.21.15.114:0/3455434897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e94160c40 msgr2=0x7f8e94071740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.932+0000 7f8e9b1a9640 1 --2- 172.21.15.114:0/3455434897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e94160c40 0x7f8e94071740 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8e940ae0b0 tx=0x7f8e8802b910 comp rx=0 tx=0).stop 2023-11-04T01:38:39.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.932+0000 7f8e9b1a9640 1 -- 172.21.15.114:0/3455434897 shutdown_connections 2023-11-04T01:38:39.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.932+0000 7f8e9b1a9640 1 --2- 172.21.15.114:0/3455434897 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e940adbb0 0x7f8e94161020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.932+0000 7f8e9b1a9640 1 --2- 172.21.15.114:0/3455434897 >> v2:172.21.15.141:3300/0 conn(0x7f8e94161560 0x7f8e940c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.932+0000 7f8e9b1a9640 1 --2- 172.21.15.114:0/3455434897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e94160c40 0x7f8e94071740 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.932+0000 7f8e9b1a9640 1 -- 172.21.15.114:0/3455434897 >> 172.21.15.114:0/3455434897 conn(0x7f8e940b0810 msgr2=0x7f8e940b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:39.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.932+0000 7f8e9b1a9640 1 -- 172.21.15.114:0/3455434897 shutdown_connections 2023-11-04T01:38:39.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.932+0000 7f8e9b1a9640 1 -- 172.21.15.114:0/3455434897 wait complete. 2023-11-04T01:38:39.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.933+0000 7f8e9b1a9640 1 Processor -- start 2023-11-04T01:38:39.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.933+0000 7f8e9b1a9640 1 -- start start 2023-11-04T01:38:39.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e9b1a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e940adbb0 0x7f8e940b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e9b1a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e94160c40 0x7f8e94150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e9b1a9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e94161560 0x7f8e941f5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e9b1a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e940af190 con 0x7f8e94160c40 2023-11-04T01:38:39.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e9b1a9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e940af470 con 0x7f8e94161560 2023-11-04T01:38:39.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e9b1a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e940af750 con 0x7f8e940adbb0 2023-11-04T01:38:39.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e93fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e94160c40 0x7f8e94150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e93fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e94160c40 0x7f8e94150b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37740/0 (socket says 172.21.15.114:37740) 2023-11-04T01:38:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e93fff640 1 -- 172.21.15.114:0/3012753862 learned_addr learned my addr 172.21.15.114:0/3012753862 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e99746640 1 --2- 172.21.15.114:0/3012753862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e94161560 0x7f8e941f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e98f45640 1 --2- 172.21.15.114:0/3012753862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e940adbb0 0x7f8e940b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e93fff640 1 -- 172.21.15.114:0/3012753862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e940adbb0 msgr2=0x7f8e940b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e93fff640 1 --2- 172.21.15.114:0/3012753862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e940adbb0 0x7f8e940b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e93fff640 1 -- 172.21.15.114:0/3012753862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e94161560 msgr2=0x7f8e941f5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e93fff640 1 --2- 172.21.15.114:0/3012753862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e94161560 0x7f8e941f5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e93fff640 1 -- 172.21.15.114:0/3012753862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e880094d0 con 0x7f8e94160c40 2023-11-04T01:38:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e93fff640 1 --2- 172.21.15.114:0/3012753862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e94160c40 0x7f8e94150b20 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000c7c0 tx=0x7f8e8000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e917fa640 1 -- 172.21.15.114:0/3012753862 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e80007a30 con 0x7f8e94160c40 2023-11-04T01:38:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e917fa640 1 -- 172.21.15.114:0/3012753862 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e80007b90 con 0x7f8e94160c40 2023-11-04T01:38:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e9b1a9640 1 -- 172.21.15.114:0/3012753862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e940afa30 con 0x7f8e94160c40 2023-11-04T01:38:39.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e917fa640 1 -- 172.21.15.114:0/3012753862 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8000ce70 con 0x7f8e94160c40 2023-11-04T01:38:39.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.934+0000 7f8e9b1a9640 1 -- 172.21.15.114:0/3012753862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e940b26f0 con 0x7f8e94160c40 2023-11-04T01:38:39.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.935+0000 7f8e9b1a9640 1 -- 172.21.15.114:0/3012753862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e940c6c10 con 0x7f8e94160c40 2023-11-04T01:38:39.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.936+0000 7f8e917fa640 1 -- 172.21.15.114:0/3012753862 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e800113f0 con 0x7f8e94160c40 2023-11-04T01:38:39.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.936+0000 7f8e917fa640 1 --2- 172.21.15.114:0/3012753862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8e7806ae70 0x7f8e7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:39.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.936+0000 7f8e917fa640 1 -- 172.21.15.114:0/3012753862 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f8e80089970 con 0x7f8e94160c40 2023-11-04T01:38:39.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.936+0000 7f8e98f45640 1 --2- 172.21.15.114:0/3012753862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8e7806ae70 0x7f8e7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:39.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.937+0000 7f8e98f45640 1 --2- 172.21.15.114:0/3012753862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8e7806ae70 0x7f8e7806d330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8e88036000 tx=0x7f8e8803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:39.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:39.940+0000 7f8e917fa640 1 -- 172.21.15.114:0/3012753862 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8e940c6c10 con 0x7f8e94160c40 2023-11-04T01:38:40.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.109+0000 7f8e9b1a9640 1 -- 172.21.15.114:0/3012753862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8e940c6c10 con 0x7f8e94160c40 2023-11-04T01:38:40.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.766+0000 7f8e917fa640 1 -- 172.21.15.114:0/3012753862 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8e940c6c10 con 0x7f8e94160c40 2023-11-04T01:38:40.768 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:38:40.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.768+0000 7f8e9b1a9640 1 -- 172.21.15.114:0/3012753862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8e7806ae70 msgr2=0x7f8e7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.768+0000 7f8e9b1a9640 1 --2- 172.21.15.114:0/3012753862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8e7806ae70 0x7f8e7806d330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8e88036000 tx=0x7f8e8803c040 comp rx=0 tx=0).stop 2023-11-04T01:38:40.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.768+0000 7f8e9b1a9640 1 -- 172.21.15.114:0/3012753862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e94160c40 msgr2=0x7f8e94150b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.768+0000 7f8e9b1a9640 1 --2- 172.21.15.114:0/3012753862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e94160c40 0x7f8e94150b20 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000c7c0 tx=0x7f8e8000cc80 comp rx=0 tx=0).stop 2023-11-04T01:38:40.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.768+0000 7f8e9b1a9640 1 -- 172.21.15.114:0/3012753862 shutdown_connections 2023-11-04T01:38:40.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.768+0000 7f8e9b1a9640 1 --2- 172.21.15.114:0/3012753862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8e7806ae70 0x7f8e7806d330 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.768+0000 7f8e9b1a9640 1 --2- 172.21.15.114:0/3012753862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8e94161560 0x7f8e941f5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.768+0000 7f8e9b1a9640 1 --2- 172.21.15.114:0/3012753862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e94160c40 0x7f8e94150b20 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.769+0000 7f8e9b1a9640 1 --2- 172.21.15.114:0/3012753862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8e940adbb0 0x7f8e940b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.769+0000 7f8e9b1a9640 1 -- 172.21.15.114:0/3012753862 >> 172.21.15.114:0/3012753862 conn(0x7f8e940b0810 msgr2=0x7f8e9415d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:40.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.769+0000 7f8e9b1a9640 1 -- 172.21.15.114:0/3012753862 shutdown_connections 2023-11-04T01:38:40.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.769+0000 7f8e9b1a9640 1 -- 172.21.15.114:0/3012753862 wait complete. 2023-11-04T01:38:40.784 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:38:40.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.888+0000 7f8fc93e7640 1 Processor -- start 2023-11-04T01:38:40.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.889+0000 7f8fc93e7640 1 -- start start 2023-11-04T01:38:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.889+0000 7f8fc93e7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8fc4160530 0x7f8fc40b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.889+0000 7f8fc93e7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fc40ca420 0x7f8fc406a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.889+0000 7f8fc93e7640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc406f380 con 0x7f8fc406a660 2023-11-04T01:38:40.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.889+0000 7f8fc93e7640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc406ab10 con 0x7f8fc4160530 2023-11-04T01:38:40.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.889+0000 7f8fc93e7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc4160910 con 0x7f8fc40ca420 2023-11-04T01:38:40.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.890+0000 7f8fc2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8fc4160530 0x7f8fc40b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.890+0000 7f8fc27fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fc40ca420 0x7f8fc406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.890+0000 7f8fc2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8fc4160530 0x7f8fc40b14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:53976/0 (socket says 172.21.15.114:53976) 2023-11-04T01:38:40.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.890+0000 7f8fc27fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fc40ca420 0x7f8fc406a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:43602/0 (socket says 172.21.15.114:43602) 2023-11-04T01:38:40.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.890+0000 7f8fc2ffd640 1 -- 172.21.15.114:0/2702687036 learned_addr learned my addr 172.21.15.114:0/2702687036 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:40.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.890+0000 7f8fc2ffd640 1 -- 172.21.15.114:0/2702687036 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fc40ca420 msgr2=0x7f8fc406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:40.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.890+0000 7f8fc2ffd640 1 --2- 172.21.15.114:0/2702687036 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fc40ca420 0x7f8fc406a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.890+0000 7f8fc2ffd640 1 -- 172.21.15.114:0/2702687036 >> v1:172.21.15.141:6789/0 conn(0x7f8fc406a660 legacy=0x7f8fc40cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.890+0000 7f8fc2ffd640 1 -- 172.21.15.114:0/2702687036 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc40b1a00 con 0x7f8fc4160530 2023-11-04T01:38:40.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.891+0000 7f8fc2ffd640 1 --2- 172.21.15.114:0/2702687036 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8fc4160530 0x7f8fc40b14c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009e50 tx=0x7f8fb402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25d6a3b845d3254c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.891+0000 7f8fc1ffb640 1 -- 172.21.15.114:0/2702687036 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb402ca70 con 0x7f8fc4160530 2023-11-04T01:38:40.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.891+0000 7f8fc1ffb640 1 -- 172.21.15.114:0/2702687036 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb402cbd0 con 0x7f8fc4160530 2023-11-04T01:38:40.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.891+0000 7f8fc1ffb640 1 -- 172.21.15.114:0/2702687036 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40343f0 con 0x7f8fc4160530 2023-11-04T01:38:40.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.891+0000 7f8fc93e7640 1 -- 172.21.15.114:0/2702687036 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8fc4160530 msgr2=0x7f8fc40b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.891+0000 7f8fc93e7640 1 --2- 172.21.15.114:0/2702687036 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8fc4160530 0x7f8fc40b14c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009e50 tx=0x7f8fb402bed0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.892+0000 7f8fc93e7640 1 -- 172.21.15.114:0/2702687036 shutdown_connections 2023-11-04T01:38:40.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.892+0000 7f8fc93e7640 1 --2- 172.21.15.114:0/2702687036 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fc40ca420 0x7f8fc406a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.892+0000 7f8fc93e7640 1 --2- 172.21.15.114:0/2702687036 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8fc4160530 0x7f8fc40b14c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.892+0000 7f8fc93e7640 1 -- 172.21.15.114:0/2702687036 >> 172.21.15.114:0/2702687036 conn(0x7f8fc406d890 msgr2=0x7f8fc406dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:40.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.892+0000 7f8fc93e7640 1 -- 172.21.15.114:0/2702687036 shutdown_connections 2023-11-04T01:38:40.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.892+0000 7f8fc93e7640 1 -- 172.21.15.114:0/2702687036 wait complete. 2023-11-04T01:38:40.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.893+0000 7f8fc93e7640 1 Processor -- start 2023-11-04T01:38:40.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.893+0000 7f8fc93e7640 1 -- start start 2023-11-04T01:38:40.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.893+0000 7f8fc93e7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fc406a660 0x7f8fc4157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc93e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fc40ca420 0x7f8fc40b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc93e7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8fc4160530 0x7f8fc4149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc93e7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc415aaf0 con 0x7f8fc40ca420 2023-11-04T01:38:40.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc93e7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40b57b0 con 0x7f8fc4160530 2023-11-04T01:38:40.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc93e7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc415a200 con 0x7f8fc406a660 2023-11-04T01:38:40.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc27fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fc40ca420 0x7f8fc40b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc27fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fc40ca420 0x7f8fc40b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37742/0 (socket says 172.21.15.114:37742) 2023-11-04T01:38:40.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc27fc640 1 -- 172.21.15.114:0/2400690708 learned_addr learned my addr 172.21.15.114:0/2400690708 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:40.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc2ffd640 1 --2- 172.21.15.114:0/2400690708 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fc406a660 0x7f8fc4157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc37fe640 1 --2- 172.21.15.114:0/2400690708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8fc4160530 0x7f8fc4149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc27fc640 1 -- 172.21.15.114:0/2400690708 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fc406a660 msgr2=0x7f8fc4157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc27fc640 1 --2- 172.21.15.114:0/2400690708 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fc406a660 0x7f8fc4157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc27fc640 1 -- 172.21.15.114:0/2400690708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8fc4160530 msgr2=0x7f8fc4149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:40.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc27fc640 1 --2- 172.21.15.114:0/2400690708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8fc4160530 0x7f8fc4149d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:40.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc27fc640 1 -- 172.21.15.114:0/2400690708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb4009b30 con 0x7f8fc40ca420 2023-11-04T01:38:40.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc27fc640 1 --2- 172.21.15.114:0/2400690708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fc40ca420 0x7f8fc40b5270 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800e870 tx=0x7f8fb800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fab7fe640 1 -- 172.21.15.114:0/2400690708 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8009510 con 0x7f8fc40ca420 2023-11-04T01:38:40.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fab7fe640 1 -- 172.21.15.114:0/2400690708 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb800eec0 con 0x7f8fc40ca420 2023-11-04T01:38:40.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fab7fe640 1 -- 172.21.15.114:0/2400690708 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb800cb80 con 0x7f8fc40ca420 2023-11-04T01:38:40.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc93e7640 1 -- 172.21.15.114:0/2400690708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc415a4a0 con 0x7f8fc40ca420 2023-11-04T01:38:40.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.894+0000 7f8fc93e7640 1 -- 172.21.15.114:0/2400690708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc414a2c0 con 0x7f8fc40ca420 2023-11-04T01:38:40.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.895+0000 7f8fc93e7640 1 -- 172.21.15.114:0/2400690708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc415aca0 con 0x7f8fc40ca420 2023-11-04T01:38:40.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.896+0000 7f8fab7fe640 1 -- 172.21.15.114:0/2400690708 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8fb800cd20 con 0x7f8fc40ca420 2023-11-04T01:38:40.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.896+0000 7f8fab7fe640 1 --2- 172.21.15.114:0/2400690708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8fb006ae70 0x7f8fb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:40.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.896+0000 7f8fab7fe640 1 -- 172.21.15.114:0/2400690708 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6030+0+0 (secure 0 0 0) 0x7f8fb8089890 con 0x7f8fc40ca420 2023-11-04T01:38:40.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.896+0000 7f8fc2ffd640 1 --2- 172.21.15.114:0/2400690708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8fb006ae70 0x7f8fb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:40.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.897+0000 7f8fc2ffd640 1 --2- 172.21.15.114:0/2400690708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8fb006ae70 0x7f8fb006d330 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4035000 tx=0x7f8fb4030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:40.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:40.900+0000 7f8fab7fe640 1 -- 172.21.15.114:0/2400690708 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8fb8054800 con 0x7f8fc40ca420 2023-11-04T01:38:41.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.068+0000 7f8fc93e7640 1 -- 172.21.15.114:0/2400690708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8fc40b59c0 con 0x7f8fc40ca420 2023-11-04T01:38:41.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.774+0000 7f8fab7fe640 1 -- 172.21.15.114:0/2400690708 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8fb80170d0 con 0x7f8fc40ca420 2023-11-04T01:38:41.776 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2023-11-04T01:38:41.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.776+0000 7f8fc93e7640 1 -- 172.21.15.114:0/2400690708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8fb006ae70 msgr2=0x7f8fb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.776+0000 7f8fc93e7640 1 --2- 172.21.15.114:0/2400690708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8fb006ae70 0x7f8fb006d330 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4035000 tx=0x7f8fb4030000 comp rx=0 tx=0).stop 2023-11-04T01:38:41.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.776+0000 7f8fc93e7640 1 -- 172.21.15.114:0/2400690708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fc40ca420 msgr2=0x7f8fc40b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.776+0000 7f8fc93e7640 1 --2- 172.21.15.114:0/2400690708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fc40ca420 0x7f8fc40b5270 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800e870 tx=0x7f8fb800ec70 comp rx=0 tx=0).stop 2023-11-04T01:38:41.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.776+0000 7f8fc93e7640 1 -- 172.21.15.114:0/2400690708 shutdown_connections 2023-11-04T01:38:41.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.776+0000 7f8fc93e7640 1 --2- 172.21.15.114:0/2400690708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8fb006ae70 0x7f8fb006d330 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.776+0000 7f8fc93e7640 1 --2- 172.21.15.114:0/2400690708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8fc4160530 0x7f8fc4149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.776+0000 7f8fc93e7640 1 --2- 172.21.15.114:0/2400690708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fc40ca420 0x7f8fc40b5270 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.776+0000 7f8fc93e7640 1 --2- 172.21.15.114:0/2400690708 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fc406a660 0x7f8fc4157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.776+0000 7f8fc93e7640 1 -- 172.21.15.114:0/2400690708 >> 172.21.15.114:0/2400690708 conn(0x7f8fc406d890 msgr2=0x7f8fc40cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:41.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.776+0000 7f8fc93e7640 1 -- 172.21.15.114:0/2400690708 shutdown_connections 2023-11-04T01:38:41.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.776+0000 7f8fc93e7640 1 -- 172.21.15.114:0/2400690708 wait complete. 2023-11-04T01:38:41.793 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:38:41.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.897+0000 7fb8b8a34640 1 Processor -- start 2023-11-04T01:38:41.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.897+0000 7fb8b8a34640 1 -- start start 2023-11-04T01:38:41.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.898+0000 7fb8b8a34640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b40b2d30 0x7fb8b406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.898+0000 7fb8b8a34640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b406ca40 con 0x7fb8b406c1d0 2023-11-04T01:38:41.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.898+0000 7fb8b8a34640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b406cd20 con 0x7fb8b4160430 2023-11-04T01:38:41.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.898+0000 7fb8b8a34640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40cb580 con 0x7fb8b40b2d30 2023-11-04T01:38:41.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.898+0000 7fb8b2d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb8b406c1d0 0x7fb8b40cbcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45952/0 (socket says 172.21.15.114:45952) 2023-11-04T01:38:41.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.898+0000 7fb8b2d9d640 1 -- 172.21.15.114:0/3357547314 learned_addr learned my addr 172.21.15.114:0/3357547314 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:41.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.898+0000 7fb8b1d9b640 1 --2- 172.21.15.114:0/3357547314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b40b2d30 0x7fb8b406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.899+0000 7fb8b159a640 1 -- 172.21.15.114:0/3357547314 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168287143 0 0) 0x7fb8b406ca40 con 0x7fb8b406c1d0 2023-11-04T01:38:41.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.899+0000 7fb8b159a640 1 -- 172.21.15.114:0/3357547314 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb89c003520 con 0x7fb8b406c1d0 2023-11-04T01:38:41.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.899+0000 7fb8b159a640 1 -- 172.21.15.114:0/3357547314 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712864430 0 0) 0x7fb8b406cd20 con 0x7fb8b4160430 2023-11-04T01:38:41.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.899+0000 7fb8b159a640 1 -- 172.21.15.114:0/3357547314 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b406ca40 con 0x7fb8b4160430 2023-11-04T01:38:41.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.899+0000 7fb8b159a640 1 -- 172.21.15.114:0/3357547314 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 251426226 0 0) 0x7fb89c003520 con 0x7fb8b406c1d0 2023-11-04T01:38:41.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.899+0000 7fb8b1d9b640 1 -- 172.21.15.114:0/3357547314 >> v1:172.21.15.141:6789/0 conn(0x7fb8b4160430 legacy=0x7fb8b40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.899+0000 7fb8b1d9b640 1 -- 172.21.15.114:0/3357547314 >> v1:172.21.15.114:6789/0 conn(0x7fb8b406c1d0 legacy=0x7fb8b40cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.899+0000 7fb8b1d9b640 1 -- 172.21.15.114:0/3357547314 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b406d000 con 0x7fb8b40b2d30 2023-11-04T01:38:41.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.900+0000 7fb8b1d9b640 1 --2- 172.21.15.114:0/3357547314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b40b2d30 0x7fb8b406bc90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80097d0 tx=0x7fb8a802b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7e58a821e3d5966 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.900+0000 7fb8b159a640 1 -- 172.21.15.114:0/3357547314 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac0019f0 con 0x7fb8b40b2d30 2023-11-04T01:38:41.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.900+0000 7fb8b159a640 1 -- 172.21.15.114:0/3357547314 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a802e050 con 0x7fb8b40b2d30 2023-11-04T01:38:41.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.900+0000 7fb8b159a640 1 -- 172.21.15.114:0/3357547314 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8030710 con 0x7fb8b40b2d30 2023-11-04T01:38:41.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.900+0000 7fb8b8a34640 1 -- 172.21.15.114:0/3357547314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b40b2d30 msgr2=0x7fb8b406bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.900+0000 7fb8b8a34640 1 --2- 172.21.15.114:0/3357547314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b40b2d30 0x7fb8b406bc90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80097d0 tx=0x7fb8a802b800 comp rx=0 tx=0).stop 2023-11-04T01:38:41.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.900+0000 7fb8b8a34640 1 -- 172.21.15.114:0/3357547314 shutdown_connections 2023-11-04T01:38:41.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.900+0000 7fb8b8a34640 1 --2- 172.21.15.114:0/3357547314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b40b2d30 0x7fb8b406bc90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.900+0000 7fb8b8a34640 1 -- 172.21.15.114:0/3357547314 >> 172.21.15.114:0/3357547314 conn(0x7fb8b406ea20 msgr2=0x7fb8b406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:41.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.900+0000 7fb8b8a34640 1 -- 172.21.15.114:0/3357547314 shutdown_connections 2023-11-04T01:38:41.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.900+0000 7fb8b8a34640 1 -- 172.21.15.114:0/3357547314 wait complete. 2023-11-04T01:38:41.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.902+0000 7fb8b8a34640 1 Processor -- start 2023-11-04T01:38:41.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.902+0000 7fb8b8a34640 1 -- start start 2023-11-04T01:38:41.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.902+0000 7fb8b8a34640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8b406c1d0 0x7fb8b4152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.902+0000 7fb8b8a34640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8b40b2d30 0x7fb8b40ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.902+0000 7fb8b8a34640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b4160430 0x7fb8b415a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.902+0000 7fb8b8a34640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40c8990 con 0x7fb8b406c1d0 2023-11-04T01:38:41.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.902+0000 7fb8b8a34640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b4152990 con 0x7fb8b40b2d30 2023-11-04T01:38:41.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.902+0000 7fb8b8a34640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40c7d10 con 0x7fb8b4160430 2023-11-04T01:38:41.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.902+0000 7fb8b259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8b406c1d0 0x7fb8b4152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.902+0000 7fb8b259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8b406c1d0 0x7fb8b4152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37746/0 (socket says 172.21.15.114:37746) 2023-11-04T01:38:41.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.902+0000 7fb8b259c640 1 -- 172.21.15.114:0/1960168386 learned_addr learned my addr 172.21.15.114:0/1960168386 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:41.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.903+0000 7fb8b1d9b640 1 --2- 172.21.15.114:0/1960168386 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8b40b2d30 0x7fb8b40ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.903+0000 7fb8b2d9d640 1 --2- 172.21.15.114:0/1960168386 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b4160430 0x7fb8b415a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.903+0000 7fb8b259c640 1 -- 172.21.15.114:0/1960168386 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b4160430 msgr2=0x7fb8b415a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.903+0000 7fb8b259c640 1 --2- 172.21.15.114:0/1960168386 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b4160430 0x7fb8b415a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.903+0000 7fb8b259c640 1 -- 172.21.15.114:0/1960168386 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8b40b2d30 msgr2=0x7fb8b40ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:41.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.903+0000 7fb8b259c640 1 --2- 172.21.15.114:0/1960168386 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8b40b2d30 0x7fb8b40ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:41.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.903+0000 7fb8b259c640 1 -- 172.21.15.114:0/1960168386 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a8009400 con 0x7fb8b406c1d0 2023-11-04T01:38:41.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.903+0000 7fb8b259c640 1 --2- 172.21.15.114:0/1960168386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8b406c1d0 0x7fb8b4152450 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400c460 tx=0x7fb8a400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.903+0000 7fb8a2ffd640 1 -- 172.21.15.114:0/1960168386 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a40052d0 con 0x7fb8b406c1d0 2023-11-04T01:38:41.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.903+0000 7fb8a2ffd640 1 -- 172.21.15.114:0/1960168386 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a4005450 con 0x7fb8b406c1d0 2023-11-04T01:38:41.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.903+0000 7fb8b8a34640 1 -- 172.21.15.114:0/1960168386 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b40c7ff0 con 0x7fb8b406c1d0 2023-11-04T01:38:41.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.903+0000 7fb8a2ffd640 1 -- 172.21.15.114:0/1960168386 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4003830 con 0x7fb8b406c1d0 2023-11-04T01:38:41.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.903+0000 7fb8b8a34640 1 -- 172.21.15.114:0/1960168386 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b40c85b0 con 0x7fb8b406c1d0 2023-11-04T01:38:41.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.904+0000 7fb8b8a34640 1 -- 172.21.15.114:0/1960168386 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b40c8740 con 0x7fb8b406c1d0 2023-11-04T01:38:41.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.905+0000 7fb8a2ffd640 1 -- 172.21.15.114:0/1960168386 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb8a4003990 con 0x7fb8b406c1d0 2023-11-04T01:38:41.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.905+0000 7fb8a2ffd640 1 --2- 172.21.15.114:0/1960168386 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb89406ae70 0x7fb89406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:41.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.905+0000 7fb8a2ffd640 1 -- 172.21.15.114:0/1960168386 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fb8a4088b10 con 0x7fb8b406c1d0 2023-11-04T01:38:41.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.905+0000 7fb8b1d9b640 1 --2- 172.21.15.114:0/1960168386 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb89406ae70 0x7fb89406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:41.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.905+0000 7fb8b1d9b640 1 --2- 172.21.15.114:0/1960168386 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb89406ae70 0x7fb89406d330 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8034000 tx=0x7fb8a8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:41.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:41.909+0000 7fb8a2ffd640 1 -- 172.21.15.114:0/1960168386 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb8a4053cd0 con 0x7fb8b406c1d0 2023-11-04T01:38:42.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.083+0000 7fb8b8a34640 1 -- 172.21.15.114:0/1960168386 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb8b4074290 con 0x7fb8b406c1d0 2023-11-04T01:38:42.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.086+0000 7fb8a2ffd640 1 -- 172.21.15.114:0/1960168386 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb8a40572f0 con 0x7fb8b406c1d0 2023-11-04T01:38:42.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.088+0000 7fb8b8a34640 1 -- 172.21.15.114:0/1960168386 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb89406ae70 msgr2=0x7fb89406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.088+0000 7fb8b8a34640 1 --2- 172.21.15.114:0/1960168386 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb89406ae70 0x7fb89406d330 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8034000 tx=0x7fb8a8008030 comp rx=0 tx=0).stop 2023-11-04T01:38:42.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.088+0000 7fb8b8a34640 1 -- 172.21.15.114:0/1960168386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8b406c1d0 msgr2=0x7fb8b4152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.088+0000 7fb8b8a34640 1 --2- 172.21.15.114:0/1960168386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8b406c1d0 0x7fb8b4152450 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400c460 tx=0x7fb8a400c920 comp rx=0 tx=0).stop 2023-11-04T01:38:42.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.088+0000 7fb8b8a34640 1 -- 172.21.15.114:0/1960168386 shutdown_connections 2023-11-04T01:38:42.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.088+0000 7fb8b8a34640 1 --2- 172.21.15.114:0/1960168386 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8b4160430 0x7fb8b415a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.088+0000 7fb8b8a34640 1 --2- 172.21.15.114:0/1960168386 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb89406ae70 0x7fb89406d330 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.088+0000 7fb8b8a34640 1 --2- 172.21.15.114:0/1960168386 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8b40b2d30 0x7fb8b40ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.088+0000 7fb8b8a34640 1 --2- 172.21.15.114:0/1960168386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8b406c1d0 0x7fb8b4152450 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.088+0000 7fb8b8a34640 1 -- 172.21.15.114:0/1960168386 >> 172.21.15.114:0/1960168386 conn(0x7fb8b406ea20 msgr2=0x7fb8b415ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:42.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.088+0000 7fb8b8a34640 1 -- 172.21.15.114:0/1960168386 shutdown_connections 2023-11-04T01:38:42.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.088+0000 7fb8b8a34640 1 -- 172.21.15.114:0/1960168386 wait complete. 2023-11-04T01:38:42.101 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools' 2023-11-04T01:38:42.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.199+0000 7ff8beaa2640 1 Processor -- start 2023-11-04T01:38:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.200+0000 7ff8beaa2640 1 -- start start 2023-11-04T01:38:42.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.200+0000 7ff8beaa2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b815d0a0 0x7ff8b80ce070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.200+0000 7ff8beaa2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff8b80d0f40 0x7ff8b80b4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.200+0000 7ff8beaa2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff8b80b4d50 0x7ff8b806b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.200+0000 7ff8beaa2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b80b51e0 con 0x7ff8b80d0f40 2023-11-04T01:38:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.200+0000 7ff8beaa2640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b815d480 con 0x7ff8b80b4d50 2023-11-04T01:38:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.200+0000 7ff8beaa2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b80b5e20 con 0x7ff8b815d0a0 2023-11-04T01:38:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.200+0000 7ff8affff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff8b80d0f40 0x7ff8b80b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.201+0000 7ff8affff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff8b80d0f40 0x7ff8b80b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37750/0 (socket says 172.21.15.114:37750) 2023-11-04T01:38:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.201+0000 7ff8affff640 1 -- 172.21.15.114:0/1393515580 learned_addr learned my addr 172.21.15.114:0/1393515580 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.201+0000 7ff8bc83e640 1 --2- 172.21.15.114:0/1393515580 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b815d0a0 0x7ff8b80ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.201+0000 7ff8bd03f640 1 --2- 172.21.15.114:0/1393515580 >> v2:172.21.15.141:3300/0 conn(0x7ff8b80b4d50 0x7ff8b806b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.201+0000 7ff8affff640 1 -- 172.21.15.114:0/1393515580 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b815d0a0 msgr2=0x7ff8b80ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.201+0000 7ff8affff640 1 --2- 172.21.15.114:0/1393515580 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b815d0a0 0x7ff8b80ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.201+0000 7ff8affff640 1 -- 172.21.15.114:0/1393515580 >> v2:172.21.15.141:3300/0 conn(0x7ff8b80b4d50 msgr2=0x7ff8b806b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.201+0000 7ff8affff640 1 --2- 172.21.15.114:0/1393515580 >> v2:172.21.15.141:3300/0 conn(0x7ff8b80b4d50 0x7ff8b806b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.201+0000 7ff8affff640 1 -- 172.21.15.114:0/1393515580 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b80b60e0 con 0x7ff8b80d0f40 2023-11-04T01:38:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.201+0000 7ff8affff640 1 --2- 172.21.15.114:0/1393515580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8b80d0f40 0x7ff8b80b4810 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff8b808c020 tx=0x7ff8a802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5b1a775ae5681 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.202+0000 7ff8af7fe640 1 -- 172.21.15.114:0/1393515580 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8031640 con 0x7ff8b80d0f40 2023-11-04T01:38:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.202+0000 7ff8af7fe640 1 -- 172.21.15.114:0/1393515580 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a80317a0 con 0x7ff8b80d0f40 2023-11-04T01:38:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.202+0000 7ff8af7fe640 1 -- 172.21.15.114:0/1393515580 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8031b30 con 0x7ff8b80d0f40 2023-11-04T01:38:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.202+0000 7ff8beaa2640 1 -- 172.21.15.114:0/1393515580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8b80d0f40 msgr2=0x7ff8b80b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.202+0000 7ff8beaa2640 1 --2- 172.21.15.114:0/1393515580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8b80d0f40 0x7ff8b80b4810 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff8b808c020 tx=0x7ff8a802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.202+0000 7ff8beaa2640 1 -- 172.21.15.114:0/1393515580 shutdown_connections 2023-11-04T01:38:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.202+0000 7ff8beaa2640 1 --2- 172.21.15.114:0/1393515580 >> v2:172.21.15.141:3300/0 conn(0x7ff8b80b4d50 0x7ff8b806b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.202+0000 7ff8beaa2640 1 --2- 172.21.15.114:0/1393515580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8b80d0f40 0x7ff8b80b4810 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.202+0000 7ff8beaa2640 1 --2- 172.21.15.114:0/1393515580 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b815d0a0 0x7ff8b80ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.202+0000 7ff8beaa2640 1 -- 172.21.15.114:0/1393515580 >> 172.21.15.114:0/1393515580 conn(0x7ff8b80cf810 msgr2=0x7ff8b80cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.202+0000 7ff8beaa2640 1 -- 172.21.15.114:0/1393515580 shutdown_connections 2023-11-04T01:38:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.202+0000 7ff8beaa2640 1 -- 172.21.15.114:0/1393515580 wait complete. 2023-11-04T01:38:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.203+0000 7ff8beaa2640 1 Processor -- start 2023-11-04T01:38:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.203+0000 7ff8beaa2640 1 -- start start 2023-11-04T01:38:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.204+0000 7ff8beaa2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b80b4d50 0x7ff8b8151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.204+0000 7ff8beaa2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8b80d0f40 0x7ff8b81514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.204+0000 7ff8beaa2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8b815d0a0 0x7ff8b80c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.204+0000 7ff8beaa2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b8156830 con 0x7ff8b815d0a0 2023-11-04T01:38:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.204+0000 7ff8beaa2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b8151a00 con 0x7ff8b80d0f40 2023-11-04T01:38:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.204+0000 7ff8beaa2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b8155f90 con 0x7ff8b80b4d50 2023-11-04T01:38:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.204+0000 7ff8bd03f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8b815d0a0 0x7ff8b80c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.204+0000 7ff8bd03f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8b815d0a0 0x7ff8b80c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37762/0 (socket says 172.21.15.114:37762) 2023-11-04T01:38:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.204+0000 7ff8bd03f640 1 -- 172.21.15.114:0/544699316 learned_addr learned my addr 172.21.15.114:0/544699316 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.204+0000 7ff8bc83e640 1 --2- 172.21.15.114:0/544699316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b80b4d50 0x7ff8b8151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.204+0000 7ff8affff640 1 --2- 172.21.15.114:0/544699316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8b80d0f40 0x7ff8b81514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.205+0000 7ff8bd03f640 1 -- 172.21.15.114:0/544699316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b80b4d50 msgr2=0x7ff8b8151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.205+0000 7ff8bd03f640 1 --2- 172.21.15.114:0/544699316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b80b4d50 0x7ff8b8151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.205+0000 7ff8bd03f640 1 -- 172.21.15.114:0/544699316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8b80d0f40 msgr2=0x7ff8b81514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.205+0000 7ff8bd03f640 1 --2- 172.21.15.114:0/544699316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8b80d0f40 0x7ff8b81514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.205+0000 7ff8bd03f640 1 -- 172.21.15.114:0/544699316 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a80094d0 con 0x7ff8b815d0a0 2023-11-04T01:38:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.205+0000 7ff8bd03f640 1 --2- 172.21.15.114:0/544699316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8b815d0a0 0x7ff8b80c7d90 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0007e60 tx=0x7ff8b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.205+0000 7ff8ad7fa640 1 -- 172.21.15.114:0/544699316 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0014420 con 0x7ff8b815d0a0 2023-11-04T01:38:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.205+0000 7ff8ad7fa640 1 -- 172.21.15.114:0/544699316 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b00145a0 con 0x7ff8b815d0a0 2023-11-04T01:38:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.205+0000 7ff8beaa2640 1 -- 172.21.15.114:0/544699316 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b8156270 con 0x7ff8b815d0a0 2023-11-04T01:38:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.205+0000 7ff8ad7fa640 1 -- 172.21.15.114:0/544699316 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0014950 con 0x7ff8b815d0a0 2023-11-04T01:38:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.205+0000 7ff8beaa2640 1 -- 172.21.15.114:0/544699316 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b80c8600 con 0x7ff8b815d0a0 2023-11-04T01:38:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.206+0000 7ff8beaa2640 1 -- 172.21.15.114:0/544699316 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b80c87f0 con 0x7ff8b815d0a0 2023-11-04T01:38:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.206+0000 7ff8ad7fa640 1 -- 172.21.15.114:0/544699316 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8b0014ab0 con 0x7ff8b815d0a0 2023-11-04T01:38:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.207+0000 7ff8ad7fa640 1 --2- 172.21.15.114:0/544699316 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8a406aea0 0x7ff8a406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.207+0000 7ff8ad7fa640 1 -- 172.21.15.114:0/544699316 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7ff8b0089eb0 con 0x7ff8b815d0a0 2023-11-04T01:38:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.207+0000 7ff8bc83e640 1 --2- 172.21.15.114:0/544699316 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8a406aea0 0x7ff8a406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.207+0000 7ff8bc83e640 1 --2- 172.21.15.114:0/544699316 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8a406aea0 0x7ff8a406d360 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4006fd0 tx=0x7ff8b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.211+0000 7ff8ad7fa640 1 -- 172.21.15.114:0/544699316 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8b0054fc0 con 0x7ff8b815d0a0 2023-11-04T01:38:42.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.442+0000 7ff8beaa2640 1 -- 172.21.15.114:0/544699316 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]} v 0) v1 -- 0x7ff8b8074290 con 0x7ff8b815d0a0 2023-11-04T01:38:42.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.779+0000 7ff8ad7fa640 1 -- 172.21.15.114:0/544699316 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]}]=0 v145) v1 ==== 178+0+0 (secure 0 0 0) 0x7ff8b00585e0 con 0x7ff8b815d0a0 2023-11-04T01:38:42.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.781+0000 7ff8beaa2640 1 -- 172.21.15.114:0/544699316 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8a406aea0 msgr2=0x7ff8a406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.781+0000 7ff8beaa2640 1 --2- 172.21.15.114:0/544699316 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8a406aea0 0x7ff8a406d360 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4006fd0 tx=0x7ff8b4008040 comp rx=0 tx=0).stop 2023-11-04T01:38:42.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.781+0000 7ff8beaa2640 1 -- 172.21.15.114:0/544699316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8b815d0a0 msgr2=0x7ff8b80c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.781+0000 7ff8beaa2640 1 --2- 172.21.15.114:0/544699316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8b815d0a0 0x7ff8b80c7d90 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0007e60 tx=0x7ff8b000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.781+0000 7ff8beaa2640 1 -- 172.21.15.114:0/544699316 shutdown_connections 2023-11-04T01:38:42.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.781+0000 7ff8beaa2640 1 --2- 172.21.15.114:0/544699316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8b815d0a0 0x7ff8b80c7d90 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.781+0000 7ff8beaa2640 1 --2- 172.21.15.114:0/544699316 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8a406aea0 0x7ff8a406d360 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.781+0000 7ff8beaa2640 1 --2- 172.21.15.114:0/544699316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8b80d0f40 0x7ff8b81514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.781+0000 7ff8beaa2640 1 --2- 172.21.15.114:0/544699316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8b80b4d50 0x7ff8b8151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.781+0000 7ff8beaa2640 1 -- 172.21.15.114:0/544699316 >> 172.21.15.114:0/544699316 conn(0x7ff8b80cf810 msgr2=0x7ff8b815c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:42.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.781+0000 7ff8beaa2640 1 -- 172.21.15.114:0/544699316 shutdown_connections 2023-11-04T01:38:42.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.781+0000 7ff8beaa2640 1 -- 172.21.15.114:0/544699316 wait complete. 2023-11-04T01:38:42.794 INFO:tasks.cephfs_test_runner:Test that creation of monitor managed snaps fails for pools attached ... ok 2023-11-04T01:38:42.794 INFO:tasks.cephfs_test_runner:Starting test: test_using_pool_with_snap_fails_fs_creation (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that using a pool with snaps for fs creation fails 2023-11-04T01:38:42.794 INFO:tasks.cephfs_test_runner:test_using_pool_with_snap_fails_fs_creation (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:38:42.795 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:42.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.892+0000 7f3d52fd0640 1 Processor -- start 2023-11-04T01:38:42.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.892+0000 7f3d52fd0640 1 -- start start 2023-11-04T01:38:42.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.893+0000 7f3d52fd0640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3d4c15ad80 0x7f3d4c06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.893+0000 7f3d52fd0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d4c0c9e10 0x7f3d4c0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.893+0000 7f3d52fd0640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4c06cd00 con 0x7f3d4c0b42c0 2023-11-04T01:38:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.893+0000 7f3d52fd0640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c06cfa0 con 0x7f3d4c15ad80 2023-11-04T01:38:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.893+0000 7f3d52fd0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c06d280 con 0x7f3d4c0c9e10 2023-11-04T01:38:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.893+0000 7f3d5156d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d4c0c9e10 0x7f3d4c0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.893+0000 7f3d50d6c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3d4c15ad80 0x7f3d4c06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.893+0000 7f3d5156d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d4c0c9e10 0x7f3d4c0b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:43636/0 (socket says 172.21.15.114:43636) 2023-11-04T01:38:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.893+0000 7f3d5156d640 1 -- 172.21.15.114:0/2250002875 learned_addr learned my addr 172.21.15.114:0/2250002875 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.893+0000 7f3d5156d640 1 -- 172.21.15.114:0/2250002875 >> v2:172.21.15.141:3300/0 conn(0x7f3d4c15ad80 msgr2=0x7f3d4c06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.893+0000 7f3d5156d640 1 --2- 172.21.15.114:0/2250002875 >> v2:172.21.15.141:3300/0 conn(0x7f3d4c15ad80 0x7f3d4c06c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.893+0000 7f3d5156d640 1 -- 172.21.15.114:0/2250002875 >> v1:172.21.15.141:6789/0 conn(0x7f3d4c0b42c0 legacy=0x7f3d4c0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.893+0000 7f3d5156d640 1 -- 172.21.15.114:0/2250002875 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c06d560 con 0x7f3d4c0c9e10 2023-11-04T01:38:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.893+0000 7f3d50d6c640 1 --2- 172.21.15.114:0/2250002875 >> v2:172.21.15.141:3300/0 conn(0x7f3d4c15ad80 0x7f3d4c06c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.894+0000 7f3d5156d640 1 --2- 172.21.15.114:0/2250002875 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d4c0c9e10 0x7f3d4c0b1a40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009e50 tx=0x7f3d4402bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ecc7df86b93eac2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.894+0000 7f3d4b7fe640 1 -- 172.21.15.114:0/2250002875 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4402cb90 con 0x7f3d4c0c9e10 2023-11-04T01:38:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.894+0000 7f3d4b7fe640 1 -- 172.21.15.114:0/2250002875 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4402ccf0 con 0x7f3d4c0c9e10 2023-11-04T01:38:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.894+0000 7f3d4b7fe640 1 -- 172.21.15.114:0/2250002875 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d44034610 con 0x7f3d4c0c9e10 2023-11-04T01:38:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.895+0000 7f3d52fd0640 1 -- 172.21.15.114:0/2250002875 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d4c0c9e10 msgr2=0x7f3d4c0b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.895+0000 7f3d52fd0640 1 --2- 172.21.15.114:0/2250002875 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d4c0c9e10 0x7f3d4c0b1a40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009e50 tx=0x7f3d4402bff0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.895+0000 7f3d52fd0640 1 -- 172.21.15.114:0/2250002875 shutdown_connections 2023-11-04T01:38:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.895+0000 7f3d52fd0640 1 --2- 172.21.15.114:0/2250002875 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d4c0c9e10 0x7f3d4c0b1a40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.895+0000 7f3d52fd0640 1 --2- 172.21.15.114:0/2250002875 >> v2:172.21.15.141:3300/0 conn(0x7f3d4c15ad80 0x7f3d4c06c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.895+0000 7f3d52fd0640 1 -- 172.21.15.114:0/2250002875 >> 172.21.15.114:0/2250002875 conn(0x7f3d4c0ce950 msgr2=0x7f3d4c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.895+0000 7f3d52fd0640 1 -- 172.21.15.114:0/2250002875 shutdown_connections 2023-11-04T01:38:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.895+0000 7f3d52fd0640 1 -- 172.21.15.114:0/2250002875 wait complete. 2023-11-04T01:38:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.896+0000 7f3d52fd0640 1 Processor -- start 2023-11-04T01:38:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.896+0000 7f3d52fd0640 1 -- start start 2023-11-04T01:38:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.897+0000 7f3d52fd0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d4c0b42c0 0x7f3d4c151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.897+0000 7f3d52fd0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d4c0c9e10 0x7f3d4c15c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.897+0000 7f3d52fd0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3d4c15ad80 0x7f3d4c0c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.897+0000 7f3d52fd0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c1519a0 con 0x7f3d4c0c9e10 2023-11-04T01:38:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.897+0000 7f3d52fd0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c15b2e0 con 0x7f3d4c15ad80 2023-11-04T01:38:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.897+0000 7f3d52fd0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c15b5c0 con 0x7f3d4c0b42c0 2023-11-04T01:38:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.897+0000 7f3d4bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d4c0c9e10 0x7f3d4c15c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.897+0000 7f3d4bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d4c0c9e10 0x7f3d4c15c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37772/0 (socket says 172.21.15.114:37772) 2023-11-04T01:38:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.897+0000 7f3d4bfff640 1 -- 172.21.15.114:0/3705808519 learned_addr learned my addr 172.21.15.114:0/3705808519 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:42.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.897+0000 7f3d50d6c640 1 --2- 172.21.15.114:0/3705808519 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d4c0b42c0 0x7f3d4c151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.897+0000 7f3d5156d640 1 --2- 172.21.15.114:0/3705808519 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3d4c15ad80 0x7f3d4c0c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.897+0000 7f3d4bfff640 1 -- 172.21.15.114:0/3705808519 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d4c0b42c0 msgr2=0x7f3d4c151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.897+0000 7f3d4bfff640 1 --2- 172.21.15.114:0/3705808519 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d4c0b42c0 0x7f3d4c151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.897+0000 7f3d4bfff640 1 -- 172.21.15.114:0/3705808519 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3d4c15ad80 msgr2=0x7f3d4c0c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:42.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.897+0000 7f3d4bfff640 1 --2- 172.21.15.114:0/3705808519 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3d4c15ad80 0x7f3d4c0c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:42.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.897+0000 7f3d4bfff640 1 -- 172.21.15.114:0/3705808519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40009400 con 0x7f3d4c0c9e10 2023-11-04T01:38:42.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.898+0000 7f3d4bfff640 1 --2- 172.21.15.114:0/3705808519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d4c0c9e10 0x7f3d4c15c380 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800c390 tx=0x7f3d3800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.898+0000 7f3d497fa640 1 -- 172.21.15.114:0/3705808519 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d380052d0 con 0x7f3d4c0c9e10 2023-11-04T01:38:42.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.898+0000 7f3d497fa640 1 -- 172.21.15.114:0/3705808519 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d38005430 con 0x7f3d4c0c9e10 2023-11-04T01:38:42.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.898+0000 7f3d52fd0640 1 -- 172.21.15.114:0/3705808519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d44009b30 con 0x7f3d4c0c9e10 2023-11-04T01:38:42.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.898+0000 7f3d497fa640 1 -- 172.21.15.114:0/3705808519 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38003830 con 0x7f3d4c0c9e10 2023-11-04T01:38:42.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.898+0000 7f3d52fd0640 1 -- 172.21.15.114:0/3705808519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4c15bb80 con 0x7f3d4c0c9e10 2023-11-04T01:38:42.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.899+0000 7f3d52fd0640 1 -- 172.21.15.114:0/3705808519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4c074290 con 0x7f3d4c0c9e10 2023-11-04T01:38:42.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.899+0000 7f3d497fa640 1 -- 172.21.15.114:0/3705808519 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d38003990 con 0x7f3d4c0c9e10 2023-11-04T01:38:42.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.900+0000 7f3d497fa640 1 --2- 172.21.15.114:0/3705808519 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3d3006ae70 0x7f3d3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:42.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.900+0000 7f3d497fa640 1 -- 172.21.15.114:0/3705808519 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f3d38088a90 con 0x7f3d4c0c9e10 2023-11-04T01:38:42.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.900+0000 7f3d50d6c640 1 --2- 172.21.15.114:0/3705808519 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3d3006ae70 0x7f3d3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:42.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.900+0000 7f3d50d6c640 1 --2- 172.21.15.114:0/3705808519 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3d3006ae70 0x7f3d3006d330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3d40009cd0 tx=0x7f3d40009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:42.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:42.904+0000 7f3d497fa640 1 -- 172.21.15.114:0/3705808519 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d38053c50 con 0x7f3d4c0c9e10 2023-11-04T01:38:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.074+0000 7f3d52fd0640 1 -- 172.21.15.114:0/3705808519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d4c1525b0 con 0x7f3d4c0c9e10 2023-11-04T01:38:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.075+0000 7f3d497fa640 1 -- 172.21.15.114:0/3705808519 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+15006 (secure 0 0 0) 0x7f3d38017090 con 0x7f3d4c0c9e10 2023-11-04T01:38:43.077 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:43.077 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:41.767333+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6837/2391405125":"2023-11-05T01:38:38.759325+0000","172.21.15.114:6835/2391405125":"2023-11-05T01:38:38.759325+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.077+0000 7f3d52fd0640 1 -- 172.21.15.114:0/3705808519 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3d3006ae70 msgr2=0x7f3d3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.077+0000 7f3d52fd0640 1 --2- 172.21.15.114:0/3705808519 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3d3006ae70 0x7f3d3006d330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3d40009cd0 tx=0x7f3d40009190 comp rx=0 tx=0).stop 2023-11-04T01:38:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.077+0000 7f3d52fd0640 1 -- 172.21.15.114:0/3705808519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d4c0c9e10 msgr2=0x7f3d4c15c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.077+0000 7f3d52fd0640 1 --2- 172.21.15.114:0/3705808519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d4c0c9e10 0x7f3d4c15c380 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800c390 tx=0x7f3d3800c850 comp rx=0 tx=0).stop 2023-11-04T01:38:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.077+0000 7f3d52fd0640 1 -- 172.21.15.114:0/3705808519 shutdown_connections 2023-11-04T01:38:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.077+0000 7f3d52fd0640 1 --2- 172.21.15.114:0/3705808519 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3d3006ae70 0x7f3d3006d330 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.077+0000 7f3d52fd0640 1 --2- 172.21.15.114:0/3705808519 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3d4c15ad80 0x7f3d4c0c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.077+0000 7f3d52fd0640 1 --2- 172.21.15.114:0/3705808519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d4c0c9e10 0x7f3d4c15c380 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.077+0000 7f3d52fd0640 1 --2- 172.21.15.114:0/3705808519 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3d4c0b42c0 0x7f3d4c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.077+0000 7f3d52fd0640 1 -- 172.21.15.114:0/3705808519 >> 172.21.15.114:0/3705808519 conn(0x7f3d4c0ce950 msgr2=0x7f3d4c0af490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.077+0000 7f3d52fd0640 1 -- 172.21.15.114:0/3705808519 shutdown_connections 2023-11-04T01:38:43.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.077+0000 7f3d52fd0640 1 -- 172.21.15.114:0/3705808519 wait complete. 2023-11-04T01:38:43.090 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:43.090 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:43.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.190+0000 7fe9bf26f640 1 Processor -- start 2023-11-04T01:38:43.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.190+0000 7fe9bf26f640 1 -- start start 2023-11-04T01:38:43.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.191+0000 7fe9bf26f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9b8070e20 0x7fe9b80adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.191+0000 7fe9bf26f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9b80ad730 0x7fe9b815e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.191+0000 7fe9bf26f640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b80c3900 con 0x7fe9b815ad30 2023-11-04T01:38:43.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.191+0000 7fe9bf26f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b80ae260 con 0x7fe9b80ad730 2023-11-04T01:38:43.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.191+0000 7fe9bf26f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b80c3be0 con 0x7fe9b8070e20 2023-11-04T01:38:43.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.191+0000 7fe9bd80c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9b80ad730 0x7fe9b815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.191+0000 7fe9bd80c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9b80ad730 0x7fe9b815e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37780/0 (socket says 172.21.15.114:37780) 2023-11-04T01:38:43.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.191+0000 7fe9bd80c640 1 -- 172.21.15.114:0/1669267050 learned_addr learned my addr 172.21.15.114:0/1669267050 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:43.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.191+0000 7fe9bc80a640 1 --2- 172.21.15.114:0/1669267050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9b8070e20 0x7fe9b80adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.191+0000 7fe9bd80c640 1 -- 172.21.15.114:0/1669267050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9b8070e20 msgr2=0x7fe9b80adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:43.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.191+0000 7fe9bd80c640 1 --2- 172.21.15.114:0/1669267050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9b8070e20 0x7fe9b80adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.191+0000 7fe9bd80c640 1 -- 172.21.15.114:0/1669267050 >> v1:172.21.15.141:6789/0 conn(0x7fe9b815ad30 legacy=0x7fe9b8070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.191+0000 7fe9bd80c640 1 -- 172.21.15.114:0/1669267050 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b80c3ec0 con 0x7fe9b80ad730 2023-11-04T01:38:43.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.192+0000 7fe9bd80c640 1 --2- 172.21.15.114:0/1669267050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b80ad730 0x7fe9b815e740 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009870 tx=0x7fe9b002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c513ef042b57a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.192+0000 7fe9affff640 1 -- 172.21.15.114:0/1669267050 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0031640 con 0x7fe9b80ad730 2023-11-04T01:38:43.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.192+0000 7fe9affff640 1 -- 172.21.15.114:0/1669267050 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b00317a0 con 0x7fe9b80ad730 2023-11-04T01:38:43.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.192+0000 7fe9affff640 1 -- 172.21.15.114:0/1669267050 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0031b30 con 0x7fe9b80ad730 2023-11-04T01:38:43.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.193+0000 7fe9bf26f640 1 -- 172.21.15.114:0/1669267050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b80ad730 msgr2=0x7fe9b815e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.193+0000 7fe9bf26f640 1 --2- 172.21.15.114:0/1669267050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b80ad730 0x7fe9b815e740 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009870 tx=0x7fe9b002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.193+0000 7fe9bf26f640 1 -- 172.21.15.114:0/1669267050 shutdown_connections 2023-11-04T01:38:43.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.193+0000 7fe9bf26f640 1 --2- 172.21.15.114:0/1669267050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b80ad730 0x7fe9b815e740 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.193+0000 7fe9bf26f640 1 --2- 172.21.15.114:0/1669267050 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9b8070e20 0x7fe9b80adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.193+0000 7fe9bf26f640 1 -- 172.21.15.114:0/1669267050 >> 172.21.15.114:0/1669267050 conn(0x7fe9b80ce950 msgr2=0x7fe9b80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:43.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.193+0000 7fe9bf26f640 1 -- 172.21.15.114:0/1669267050 shutdown_connections 2023-11-04T01:38:43.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.193+0000 7fe9bf26f640 1 -- 172.21.15.114:0/1669267050 wait complete. 2023-11-04T01:38:43.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.194+0000 7fe9bf26f640 1 Processor -- start 2023-11-04T01:38:43.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.194+0000 7fe9bf26f640 1 -- start start 2023-11-04T01:38:43.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bf26f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9b8070e20 0x7fe9b80b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bf26f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9b80ad730 0x7fe9b8153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bf26f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b815ad30 0x7fe9b8153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bf26f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b815bfa0 con 0x7fe9b815ad30 2023-11-04T01:38:43.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bf26f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b80b1bf0 con 0x7fe9b8070e20 2023-11-04T01:38:43.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bf26f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b815b320 con 0x7fe9b80ad730 2023-11-04T01:38:43.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bd80c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b815ad30 0x7fe9b8153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bd80c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b815ad30 0x7fe9b8153770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37786/0 (socket says 172.21.15.114:37786) 2023-11-04T01:38:43.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bd80c640 1 -- 172.21.15.114:0/3405057757 learned_addr learned my addr 172.21.15.114:0/3405057757 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:43.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bd00b640 1 --2- 172.21.15.114:0/3405057757 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9b8070e20 0x7fe9b80b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bc80a640 1 --2- 172.21.15.114:0/3405057757 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9b80ad730 0x7fe9b8153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bd80c640 1 -- 172.21.15.114:0/3405057757 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9b80ad730 msgr2=0x7fe9b8153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bd80c640 1 --2- 172.21.15.114:0/3405057757 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9b80ad730 0x7fe9b8153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bd80c640 1 -- 172.21.15.114:0/3405057757 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9b8070e20 msgr2=0x7fe9b80b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bd80c640 1 --2- 172.21.15.114:0/3405057757 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9b8070e20 0x7fe9b80b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bd80c640 1 -- 172.21.15.114:0/3405057757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b00094d0 con 0x7fe9b815ad30 2023-11-04T01:38:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bc80a640 1 --2- 172.21.15.114:0/3405057757 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9b80ad730 0x7fe9b8153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9bd80c640 1 --2- 172.21.15.114:0/3405057757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b815ad30 0x7fe9b8153770 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009870 tx=0x7fe9b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.195+0000 7fe9adffb640 1 -- 172.21.15.114:0/3405057757 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b003a930 con 0x7fe9b815ad30 2023-11-04T01:38:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.196+0000 7fe9adffb640 1 -- 172.21.15.114:0/3405057757 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b003aab0 con 0x7fe9b815ad30 2023-11-04T01:38:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.196+0000 7fe9bf26f640 1 -- 172.21.15.114:0/3405057757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b815b600 con 0x7fe9b815ad30 2023-11-04T01:38:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.196+0000 7fe9adffb640 1 -- 172.21.15.114:0/3405057757 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b003ae60 con 0x7fe9b815ad30 2023-11-04T01:38:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.196+0000 7fe9bf26f640 1 -- 172.21.15.114:0/3405057757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b815bbc0 con 0x7fe9b815ad30 2023-11-04T01:38:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.197+0000 7fe9bf26f640 1 -- 172.21.15.114:0/3405057757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b8074290 con 0x7fe9b815ad30 2023-11-04T01:38:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.197+0000 7fe9adffb640 1 -- 172.21.15.114:0/3405057757 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe9b002f050 con 0x7fe9b815ad30 2023-11-04T01:38:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.197+0000 7fe9adffb640 1 --2- 172.21.15.114:0/3405057757 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe99c06ae70 0x7fe99c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.198+0000 7fe9adffb640 1 -- 172.21.15.114:0/3405057757 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe9b00ab350 con 0x7fe9b815ad30 2023-11-04T01:38:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.198+0000 7fe9bd00b640 1 --2- 172.21.15.114:0/3405057757 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe99c06ae70 0x7fe99c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.198+0000 7fe9bd00b640 1 --2- 172.21.15.114:0/3405057757 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe99c06ae70 0x7fe99c06d330 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4001ca0 tx=0x7fe9b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.202+0000 7fe9adffb640 1 -- 172.21.15.114:0/3405057757 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe9b00764f0 con 0x7fe9b815ad30 2023-11-04T01:38:43.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.367+0000 7fe9bf26f640 1 -- 172.21.15.114:0/3405057757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9b8151b30 con 0x7fe9b815ad30 2023-11-04T01:38:43.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.367+0000 7fe9adffb640 1 -- 172.21.15.114:0/3405057757 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe9b0035020 con 0x7fe9b815ad30 2023-11-04T01:38:43.370 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:38:43.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.369+0000 7fe9bf26f640 1 -- 172.21.15.114:0/3405057757 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe99c06ae70 msgr2=0x7fe99c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.369+0000 7fe9bf26f640 1 --2- 172.21.15.114:0/3405057757 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe99c06ae70 0x7fe99c06d330 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4001ca0 tx=0x7fe9b4009040 comp rx=0 tx=0).stop 2023-11-04T01:38:43.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.369+0000 7fe9bf26f640 1 -- 172.21.15.114:0/3405057757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b815ad30 msgr2=0x7fe9b8153770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.369+0000 7fe9bf26f640 1 --2- 172.21.15.114:0/3405057757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b815ad30 0x7fe9b8153770 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009870 tx=0x7fe9b00046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.369+0000 7fe9bf26f640 1 -- 172.21.15.114:0/3405057757 shutdown_connections 2023-11-04T01:38:43.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.369+0000 7fe9bf26f640 1 --2- 172.21.15.114:0/3405057757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b815ad30 0x7fe9b8153770 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.369+0000 7fe9bf26f640 1 --2- 172.21.15.114:0/3405057757 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe9b80ad730 0x7fe9b8153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.369+0000 7fe9bf26f640 1 --2- 172.21.15.114:0/3405057757 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe99c06ae70 0x7fe99c06d330 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.369+0000 7fe9bf26f640 1 --2- 172.21.15.114:0/3405057757 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe9b8070e20 0x7fe9b80b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.369+0000 7fe9bf26f640 1 -- 172.21.15.114:0/3405057757 >> 172.21.15.114:0/3405057757 conn(0x7fe9b80ce950 msgr2=0x7fe9b80ca540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:43.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.369+0000 7fe9bf26f640 1 -- 172.21.15.114:0/3405057757 shutdown_connections 2023-11-04T01:38:43.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.369+0000 7fe9bf26f640 1 -- 172.21.15.114:0/3405057757 wait complete. 2023-11-04T01:38:43.381 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:43.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.482+0000 7f486db39640 1 Processor -- start 2023-11-04T01:38:43.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.482+0000 7f486db39640 1 -- start start 2023-11-04T01:38:43.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.482+0000 7f486db39640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f486815e430 0x7f48680cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.482+0000 7f486db39640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f48680cf160 0x7f48680cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.482+0000 7f486db39640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48680d0280 con 0x7f48680d0710 2023-11-04T01:38:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.482+0000 7f486db39640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48680cf670 con 0x7f48680cf160 2023-11-04T01:38:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.482+0000 7f486db39640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48680cf950 con 0x7f486815e430 2023-11-04T01:38:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.482+0000 7f485ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f48680cf160 0x7f48680cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.483+0000 7f485ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f48680cf160 0x7f48680cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37790/0 (socket says 172.21.15.114:37790) 2023-11-04T01:38:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.483+0000 7f485ffff640 1 -- 172.21.15.114:0/874059796 learned_addr learned my addr 172.21.15.114:0/874059796 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.483+0000 7f48677fe640 1 --2- 172.21.15.114:0/874059796 >> v2:172.21.15.141:3300/0 conn(0x7f486815e430 0x7f48680cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.483+0000 7f485ffff640 1 -- 172.21.15.114:0/874059796 >> v2:172.21.15.141:3300/0 conn(0x7f486815e430 msgr2=0x7f48680cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.483+0000 7f485ffff640 1 --2- 172.21.15.114:0/874059796 >> v2:172.21.15.141:3300/0 conn(0x7f486815e430 0x7f48680cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.483+0000 7f485ffff640 1 -- 172.21.15.114:0/874059796 >> v1:172.21.15.141:6789/0 conn(0x7f48680d0710 legacy=0x7f48680b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.483+0000 7f485ffff640 1 -- 172.21.15.114:0/874059796 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48680cfc30 con 0x7f48680cf160 2023-11-04T01:38:43.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.483+0000 7f485ffff640 1 --2- 172.21.15.114:0/874059796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48680cf160 0x7f48680cd510 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f486806e5b0 tx=0x7f485002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1628f6ebde327c9a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.484+0000 7f4866ffd640 1 -- 172.21.15.114:0/874059796 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850031870 con 0x7f48680cf160 2023-11-04T01:38:43.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.484+0000 7f4866ffd640 1 -- 172.21.15.114:0/874059796 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48500319d0 con 0x7f48680cf160 2023-11-04T01:38:43.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.484+0000 7f4866ffd640 1 -- 172.21.15.114:0/874059796 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850031d60 con 0x7f48680cf160 2023-11-04T01:38:43.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.484+0000 7f486db39640 1 -- 172.21.15.114:0/874059796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48680cf160 msgr2=0x7f48680cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.484+0000 7f486db39640 1 --2- 172.21.15.114:0/874059796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48680cf160 0x7f48680cd510 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f486806e5b0 tx=0x7f485002b910 comp rx=0 tx=0).stop 2023-11-04T01:38:43.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.484+0000 7f486db39640 1 -- 172.21.15.114:0/874059796 shutdown_connections 2023-11-04T01:38:43.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.484+0000 7f486db39640 1 --2- 172.21.15.114:0/874059796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48680cf160 0x7f48680cd510 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.484+0000 7f486db39640 1 --2- 172.21.15.114:0/874059796 >> v2:172.21.15.141:3300/0 conn(0x7f486815e430 0x7f48680cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.484+0000 7f486db39640 1 -- 172.21.15.114:0/874059796 >> 172.21.15.114:0/874059796 conn(0x7f486806ea20 msgr2=0x7f486806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:43.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.484+0000 7f486db39640 1 -- 172.21.15.114:0/874059796 shutdown_connections 2023-11-04T01:38:43.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.484+0000 7f486db39640 1 -- 172.21.15.114:0/874059796 wait complete. 2023-11-04T01:38:43.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.485+0000 7f486db39640 1 Processor -- start 2023-11-04T01:38:43.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.485+0000 7f486db39640 1 -- start start 2023-11-04T01:38:43.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.486+0000 7f486db39640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48680cf160 0x7f48680a7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.486+0000 7f486db39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48680d0710 0x7f4868149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.486+0000 7f486db39640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f486815e430 0x7f48680c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.486+0000 7f486db39640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486814b550 con 0x7f486815e430 2023-11-04T01:38:43.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.486+0000 7f486db39640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486814a660 con 0x7f48680cf160 2023-11-04T01:38:43.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.486+0000 7f486db39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486814a940 con 0x7f48680d0710 2023-11-04T01:38:43.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.486+0000 7f4867fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f486815e430 0x7f48680c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.486+0000 7f4867fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f486815e430 0x7f48680c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37804/0 (socket says 172.21.15.114:37804) 2023-11-04T01:38:43.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.486+0000 7f4867fff640 1 -- 172.21.15.114:0/4127442339 learned_addr learned my addr 172.21.15.114:0/4127442339 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:43.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.486+0000 7f48677fe640 1 --2- 172.21.15.114:0/4127442339 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48680cf160 0x7f48680a7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.486+0000 7f485ffff640 1 --2- 172.21.15.114:0/4127442339 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48680d0710 0x7f4868149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.486+0000 7f4867fff640 1 -- 172.21.15.114:0/4127442339 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48680d0710 msgr2=0x7f4868149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.487+0000 7f4867fff640 1 --2- 172.21.15.114:0/4127442339 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48680d0710 0x7f4868149f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.487+0000 7f4867fff640 1 -- 172.21.15.114:0/4127442339 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48680cf160 msgr2=0x7f48680a7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.487+0000 7f4867fff640 1 --2- 172.21.15.114:0/4127442339 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48680cf160 0x7f48680a7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.487+0000 7f4867fff640 1 -- 172.21.15.114:0/4127442339 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48500094d0 con 0x7f486815e430 2023-11-04T01:38:43.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.487+0000 7f48677fe640 1 --2- 172.21.15.114:0/4127442339 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48680cf160 0x7f48680a7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:43.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.487+0000 7f4867fff640 1 --2- 172.21.15.114:0/4127442339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f486815e430 0x7f48680c4650 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f486000c700 tx=0x7f486000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.487+0000 7f4864ff9640 1 -- 172.21.15.114:0/4127442339 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486000aa50 con 0x7f486815e430 2023-11-04T01:38:43.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.487+0000 7f4864ff9640 1 -- 172.21.15.114:0/4127442339 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486000abb0 con 0x7f486815e430 2023-11-04T01:38:43.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.487+0000 7f486db39640 1 -- 172.21.15.114:0/4127442339 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486814ac20 con 0x7f486815e430 2023-11-04T01:38:43.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.487+0000 7f4864ff9640 1 -- 172.21.15.114:0/4127442339 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486000ce10 con 0x7f486815e430 2023-11-04T01:38:43.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.487+0000 7f486db39640 1 -- 172.21.15.114:0/4127442339 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486814b1e0 con 0x7f486815e430 2023-11-04T01:38:43.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.488+0000 7f486db39640 1 -- 172.21.15.114:0/4127442339 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4868074290 con 0x7f486815e430 2023-11-04T01:38:43.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.488+0000 7f4864ff9640 1 -- 172.21.15.114:0/4127442339 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4860012420 con 0x7f486815e430 2023-11-04T01:38:43.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.489+0000 7f4864ff9640 1 --2- 172.21.15.114:0/4127442339 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f484806aea0 0x7f484806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.489+0000 7f4864ff9640 1 -- 172.21.15.114:0/4127442339 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f4860089b00 con 0x7f486815e430 2023-11-04T01:38:43.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.489+0000 7f48677fe640 1 --2- 172.21.15.114:0/4127442339 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f484806aea0 0x7f484806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.489+0000 7f48677fe640 1 --2- 172.21.15.114:0/4127442339 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f484806aea0 0x7f484806d360 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4858006fd0 tx=0x7f4858008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.493+0000 7f4864ff9640 1 -- 172.21.15.114:0/4127442339 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4860054c10 con 0x7f486815e430 2023-11-04T01:38:43.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.658+0000 7f486db39640 1 -- 172.21.15.114:0/4127442339 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f48680ced50 con 0x7f486815e430 2023-11-04T01:38:43.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.658+0000 7f4864ff9640 1 -- 172.21.15.114:0/4127442339 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v57) v1 ==== 103+0+11 (secure 0 0 0) 0x7f48600160a0 con 0x7f486815e430 2023-11-04T01:38:43.660 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:38:43.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.660+0000 7f486db39640 1 -- 172.21.15.114:0/4127442339 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f484806aea0 msgr2=0x7f484806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.660+0000 7f486db39640 1 --2- 172.21.15.114:0/4127442339 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f484806aea0 0x7f484806d360 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4858006fd0 tx=0x7f4858008040 comp rx=0 tx=0).stop 2023-11-04T01:38:43.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.660+0000 7f486db39640 1 -- 172.21.15.114:0/4127442339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f486815e430 msgr2=0x7f48680c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.660+0000 7f486db39640 1 --2- 172.21.15.114:0/4127442339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f486815e430 0x7f48680c4650 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f486000c700 tx=0x7f486000cbc0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.660+0000 7f486db39640 1 -- 172.21.15.114:0/4127442339 shutdown_connections 2023-11-04T01:38:43.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.660+0000 7f486db39640 1 --2- 172.21.15.114:0/4127442339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f486815e430 0x7f48680c4650 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.660+0000 7f486db39640 1 --2- 172.21.15.114:0/4127442339 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48680d0710 0x7f4868149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.660+0000 7f486db39640 1 --2- 172.21.15.114:0/4127442339 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f484806aea0 0x7f484806d360 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.660+0000 7f486db39640 1 --2- 172.21.15.114:0/4127442339 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48680cf160 0x7f48680a7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.660+0000 7f486db39640 1 -- 172.21.15.114:0/4127442339 >> 172.21.15.114:0/4127442339 conn(0x7f486806ea20 msgr2=0x7f486815ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:43.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.660+0000 7f486db39640 1 -- 172.21.15.114:0/4127442339 shutdown_connections 2023-11-04T01:38:43.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.660+0000 7f486db39640 1 -- 172.21.15.114:0/4127442339 wait complete. 2023-11-04T01:38:43.673 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation' 2023-11-04T01:38:43.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.770+0000 7fc2788e7640 1 Processor -- start 2023-11-04T01:38:43.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.770+0000 7fc2788e7640 1 -- start start 2023-11-04T01:38:43.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.771+0000 7fc2788e7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc2740cde60 0x7fc27415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.771+0000 7fc2788e7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2740ce240 0x7fc2740d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.771+0000 7fc2788e7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27415e000 con 0x7fc27415daa0 2023-11-04T01:38:43.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.771+0000 7fc2788e7640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27415e5c0 con 0x7fc2740cde60 2023-11-04T01:38:43.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.771+0000 7fc2788e7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27415e2e0 con 0x7fc2740ce240 2023-11-04T01:38:43.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.771+0000 7fc271d9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc27415daa0 0x7fc274157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45968/0 (socket says 172.21.15.114:45968) 2023-11-04T01:38:43.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.771+0000 7fc271d9b640 1 -- 172.21.15.114:0/2687042250 learned_addr learned my addr 172.21.15.114:0/2687042250 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:43.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.772+0000 7fc27259c640 1 --2- 172.21.15.114:0/2687042250 >> v2:172.21.15.141:3300/0 conn(0x7fc2740cde60 0x7fc27415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.772+0000 7fc272d9d640 1 --2- 172.21.15.114:0/2687042250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2740ce240 0x7fc2740d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.772+0000 7fc27159a640 1 -- 172.21.15.114:0/2687042250 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019059356 0 0) 0x7fc27415e000 con 0x7fc27415daa0 2023-11-04T01:38:43.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.772+0000 7fc27159a640 1 -- 172.21.15.114:0/2687042250 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc25c003520 con 0x7fc27415daa0 2023-11-04T01:38:43.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.772+0000 7fc272d9d640 1 -- 172.21.15.114:0/2687042250 >> v2:172.21.15.141:3300/0 conn(0x7fc2740cde60 msgr2=0x7fc27415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:43.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.772+0000 7fc272d9d640 1 --2- 172.21.15.114:0/2687042250 >> v2:172.21.15.141:3300/0 conn(0x7fc2740cde60 0x7fc27415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.772+0000 7fc272d9d640 1 -- 172.21.15.114:0/2687042250 >> v1:172.21.15.114:6789/0 conn(0x7fc27415daa0 legacy=0x7fc274157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.772+0000 7fc272d9d640 1 -- 172.21.15.114:0/2687042250 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2740d1120 con 0x7fc2740ce240 2023-11-04T01:38:43.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.773+0000 7fc272d9d640 1 --2- 172.21.15.114:0/2687042250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2740ce240 0x7fc2740d1920 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0097a0 tx=0x7fc26c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e50ca991b098acf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.773+0000 7fc27159a640 1 -- 172.21.15.114:0/2687042250 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c031830 con 0x7fc2740ce240 2023-11-04T01:38:43.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.773+0000 7fc27159a640 1 -- 172.21.15.114:0/2687042250 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c031990 con 0x7fc2740ce240 2023-11-04T01:38:43.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.773+0000 7fc27159a640 1 -- 172.21.15.114:0/2687042250 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c031d20 con 0x7fc2740ce240 2023-11-04T01:38:43.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.773+0000 7fc2788e7640 1 -- 172.21.15.114:0/2687042250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2740ce240 msgr2=0x7fc2740d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.773+0000 7fc2788e7640 1 --2- 172.21.15.114:0/2687042250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2740ce240 0x7fc2740d1920 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0097a0 tx=0x7fc26c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.774+0000 7fc2788e7640 1 -- 172.21.15.114:0/2687042250 shutdown_connections 2023-11-04T01:38:43.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.774+0000 7fc2788e7640 1 --2- 172.21.15.114:0/2687042250 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2740ce240 0x7fc2740d1920 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.774+0000 7fc2788e7640 1 --2- 172.21.15.114:0/2687042250 >> v2:172.21.15.141:3300/0 conn(0x7fc2740cde60 0x7fc27415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.774+0000 7fc2788e7640 1 -- 172.21.15.114:0/2687042250 >> 172.21.15.114:0/2687042250 conn(0x7fc274071f30 msgr2=0x7fc2740cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:43.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.774+0000 7fc2788e7640 1 -- 172.21.15.114:0/2687042250 shutdown_connections 2023-11-04T01:38:43.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.774+0000 7fc2788e7640 1 -- 172.21.15.114:0/2687042250 wait complete. 2023-11-04T01:38:43.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.775+0000 7fc2788e7640 1 Processor -- start 2023-11-04T01:38:43.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.775+0000 7fc2788e7640 1 -- start start 2023-11-04T01:38:43.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc2788e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2740cde60 0x7fc274152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc2788e7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2740ce240 0x7fc274155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc2788e7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc27415daa0 0x7fc2741513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc2788e7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc274154d70 con 0x7fc2740cde60 2023-11-04T01:38:43.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc2788e7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2741540f0 con 0x7fc2740ce240 2023-11-04T01:38:43.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc2788e7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2741543d0 con 0x7fc27415daa0 2023-11-04T01:38:43.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc27259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2740cde60 0x7fc274152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc27259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2740cde60 0x7fc274152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37806/0 (socket says 172.21.15.114:37806) 2023-11-04T01:38:43.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc27259c640 1 -- 172.21.15.114:0/1661464661 learned_addr learned my addr 172.21.15.114:0/1661464661 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:43.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc272d9d640 1 --2- 172.21.15.114:0/1661464661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc27415daa0 0x7fc2741513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc271d9b640 1 --2- 172.21.15.114:0/1661464661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2740ce240 0x7fc274155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc27259c640 1 -- 172.21.15.114:0/1661464661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc27415daa0 msgr2=0x7fc2741513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc27259c640 1 --2- 172.21.15.114:0/1661464661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc27415daa0 0x7fc2741513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc27259c640 1 -- 172.21.15.114:0/1661464661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2740ce240 msgr2=0x7fc274155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:43.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc27259c640 1 --2- 172.21.15.114:0/1661464661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2740ce240 0x7fc274155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:43.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc27259c640 1 -- 172.21.15.114:0/1661464661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c009400 con 0x7fc2740cde60 2023-11-04T01:38:43.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc27259c640 1 --2- 172.21.15.114:0/1661464661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2740cde60 0x7fc274152f00 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc26400efc0 tx=0x7fc26400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc262ffd640 1 -- 172.21.15.114:0/1661464661 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264014480 con 0x7fc2740cde60 2023-11-04T01:38:43.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc262ffd640 1 -- 172.21.15.114:0/1661464661 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26400f040 con 0x7fc2740cde60 2023-11-04T01:38:43.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc2788e7640 1 -- 172.21.15.114:0/1661464661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2741546b0 con 0x7fc2740cde60 2023-11-04T01:38:43.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc262ffd640 1 -- 172.21.15.114:0/1661464661 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264014800 con 0x7fc2740cde60 2023-11-04T01:38:43.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.776+0000 7fc2788e7640 1 -- 172.21.15.114:0/1661464661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc274153440 con 0x7fc2740cde60 2023-11-04T01:38:43.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.777+0000 7fc2788e7640 1 -- 172.21.15.114:0/1661464661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc274074290 con 0x7fc2740cde60 2023-11-04T01:38:43.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.778+0000 7fc262ffd640 1 -- 172.21.15.114:0/1661464661 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc264014960 con 0x7fc2740cde60 2023-11-04T01:38:43.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.778+0000 7fc262ffd640 1 --2- 172.21.15.114:0/1661464661 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc25406ae70 0x7fc25406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:43.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.778+0000 7fc262ffd640 1 -- 172.21.15.114:0/1661464661 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fc26408a1a0 con 0x7fc2740cde60 2023-11-04T01:38:43.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.778+0000 7fc271d9b640 1 --2- 172.21.15.114:0/1661464661 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc25406ae70 0x7fc25406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:43.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.778+0000 7fc271d9b640 1 --2- 172.21.15.114:0/1661464661 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc25406ae70 0x7fc25406d330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc274155e00 tx=0x7fc268009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:43.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:43.782+0000 7fc262ffd640 1 -- 172.21.15.114:0/1661464661 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc264055340 con 0x7fc2740cde60 2023-11-04T01:38:44.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.013+0000 7fc2788e7640 1 -- 172.21.15.114:0/1661464661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]} v 0) v1 -- 0x7fc274154fe0 con 0x7fc2740cde60 2023-11-04T01:38:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.788+0000 7fc262ffd640 1 -- 172.21.15.114:0/1661464661 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]}]=0 v147) v1 ==== 176+0+0 (secure 0 0 0) 0x7fc264058960 con 0x7fc2740cde60 2023-11-04T01:38:44.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.791+0000 7fc2788e7640 1 -- 172.21.15.114:0/1661464661 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc25406ae70 msgr2=0x7fc25406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.791+0000 7fc2788e7640 1 --2- 172.21.15.114:0/1661464661 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc25406ae70 0x7fc25406d330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc274155e00 tx=0x7fc268009040 comp rx=0 tx=0).stop 2023-11-04T01:38:44.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.791+0000 7fc2788e7640 1 -- 172.21.15.114:0/1661464661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2740cde60 msgr2=0x7fc274152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.791+0000 7fc2788e7640 1 --2- 172.21.15.114:0/1661464661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2740cde60 0x7fc274152f00 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc26400efc0 tx=0x7fc26400c490 comp rx=0 tx=0).stop 2023-11-04T01:38:44.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.791+0000 7fc2788e7640 1 -- 172.21.15.114:0/1661464661 shutdown_connections 2023-11-04T01:38:44.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.791+0000 7fc2788e7640 1 --2- 172.21.15.114:0/1661464661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc27415daa0 0x7fc2741513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.791+0000 7fc2788e7640 1 --2- 172.21.15.114:0/1661464661 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc25406ae70 0x7fc25406d330 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.791+0000 7fc2788e7640 1 --2- 172.21.15.114:0/1661464661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2740ce240 0x7fc274155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.791+0000 7fc2788e7640 1 --2- 172.21.15.114:0/1661464661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2740cde60 0x7fc274152f00 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.791+0000 7fc2788e7640 1 -- 172.21.15.114:0/1661464661 >> 172.21.15.114:0/1661464661 conn(0x7fc274071f30 msgr2=0x7fc2740b80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:44.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.791+0000 7fc2788e7640 1 -- 172.21.15.114:0/1661464661 shutdown_connections 2023-11-04T01:38:44.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.791+0000 7fc2788e7640 1 -- 172.21.15.114:0/1661464661 wait complete. 2023-11-04T01:38:44.806 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:38:44.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.912+0000 7f857f9ce640 1 Processor -- start 2023-11-04T01:38:44.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.912+0000 7f857f9ce640 1 -- start start 2023-11-04T01:38:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.913+0000 7f857f9ce640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f85780b1a40 0x7f85780ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.913+0000 7f857f9ce640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8578160990 con 0x7f85781605b0 2023-11-04T01:38:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.913+0000 7f857f9ce640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85780cc7c0 con 0x7f857806a830 2023-11-04T01:38:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.913+0000 7f857f9ce640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85780cd750 con 0x7f85780b1a40 2023-11-04T01:38:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.913+0000 7f857cf69640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f85780b1a40 0x7f85780ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.913+0000 7f857cf69640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f85780b1a40 0x7f85780ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37820/0 (socket says 172.21.15.114:37820) 2023-11-04T01:38:44.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.913+0000 7f857d76a640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f85781605b0 0x7f857806a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45980/0 (socket says 172.21.15.114:45980) 2023-11-04T01:38:44.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.913+0000 7f857cf69640 1 -- 172.21.15.114:0/3373302486 learned_addr learned my addr 172.21.15.114:0/3373302486 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:44.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.913+0000 7f857cf69640 1 -- 172.21.15.114:0/3373302486 >> v1:172.21.15.141:6789/0 conn(0x7f857806a830 legacy=0x7f85780cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:44.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.913+0000 7f857cf69640 1 -- 172.21.15.114:0/3373302486 >> v1:172.21.15.114:6789/0 conn(0x7f85781605b0 legacy=0x7f857806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.913+0000 7f857cf69640 1 -- 172.21.15.114:0/3373302486 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85780cc4e0 con 0x7f85780b1a40 2023-11-04T01:38:44.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.914+0000 7f857cf69640 1 --2- 172.21.15.114:0/3373302486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85780b1a40 0x7f85780ccbc0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f856c009870 tx=0x7f856c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0677aeb51d3813f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.914+0000 7f8577fff640 1 -- 172.21.15.114:0/3373302486 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c0317e0 con 0x7f85780b1a40 2023-11-04T01:38:44.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.914+0000 7f8577fff640 1 -- 172.21.15.114:0/3373302486 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c031940 con 0x7f85780b1a40 2023-11-04T01:38:44.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.914+0000 7f8577fff640 1 -- 172.21.15.114:0/3373302486 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c031cd0 con 0x7f85780b1a40 2023-11-04T01:38:44.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.915+0000 7f857f9ce640 1 -- 172.21.15.114:0/3373302486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85780b1a40 msgr2=0x7f85780ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.915+0000 7f857f9ce640 1 --2- 172.21.15.114:0/3373302486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85780b1a40 0x7f85780ccbc0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f856c009870 tx=0x7f856c02b880 comp rx=0 tx=0).stop 2023-11-04T01:38:44.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.915+0000 7f857f9ce640 1 -- 172.21.15.114:0/3373302486 shutdown_connections 2023-11-04T01:38:44.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.915+0000 7f857f9ce640 1 --2- 172.21.15.114:0/3373302486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85780b1a40 0x7f85780ccbc0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.915+0000 7f857f9ce640 1 -- 172.21.15.114:0/3373302486 >> 172.21.15.114:0/3373302486 conn(0x7f8578071820 msgr2=0x7f8578071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:44.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.915+0000 7f857f9ce640 1 -- 172.21.15.114:0/3373302486 shutdown_connections 2023-11-04T01:38:44.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.915+0000 7f857f9ce640 1 -- 172.21.15.114:0/3373302486 wait complete. 2023-11-04T01:38:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.916+0000 7f857f9ce640 1 Processor -- start 2023-11-04T01:38:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.916+0000 7f857f9ce640 1 -- start start 2023-11-04T01:38:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857f9ce640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f857806a830 0x7f85781567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857f9ce640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85781605b0 0x7f857815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857f9ce640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85781573c0 0x7f857815e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857f9ce640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85780b30b0 con 0x7f85781605b0 2023-11-04T01:38:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857f9ce640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85780b34d0 con 0x7f85781573c0 2023-11-04T01:38:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857f9ce640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857815f010 con 0x7f857806a830 2023-11-04T01:38:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857cf69640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85781605b0 0x7f857815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857cf69640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85781605b0 0x7f857815dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37832/0 (socket says 172.21.15.114:37832) 2023-11-04T01:38:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857cf69640 1 -- 172.21.15.114:0/3186174284 learned_addr learned my addr 172.21.15.114:0/3186174284 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857df6b640 1 --2- 172.21.15.114:0/3186174284 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85781573c0 0x7f857815e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857d76a640 1 --2- 172.21.15.114:0/3186174284 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f857806a830 0x7f85781567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857cf69640 1 -- 172.21.15.114:0/3186174284 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f857806a830 msgr2=0x7f85781567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857cf69640 1 --2- 172.21.15.114:0/3186174284 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f857806a830 0x7f85781567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857cf69640 1 -- 172.21.15.114:0/3186174284 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85781573c0 msgr2=0x7f857815e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857cf69640 1 --2- 172.21.15.114:0/3186174284 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85781573c0 0x7f857815e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857cf69640 1 -- 172.21.15.114:0/3186174284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c0094d0 con 0x7f85781605b0 2023-11-04T01:38:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857df6b640 1 --2- 172.21.15.114:0/3186174284 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85781573c0 0x7f857815e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857cf69640 1 --2- 172.21.15.114:0/3186174284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85781605b0 0x7f857815dba0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f856c000c00 tx=0x7f856c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f8575ffb640 1 -- 172.21.15.114:0/3186174284 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c0329c0 con 0x7f85781605b0 2023-11-04T01:38:44.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f8575ffb640 1 -- 172.21.15.114:0/3186174284 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c032b40 con 0x7f85781605b0 2023-11-04T01:38:44.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f8575ffb640 1 -- 172.21.15.114:0/3186174284 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c0453f0 con 0x7f85781605b0 2023-11-04T01:38:44.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.917+0000 7f857f9ce640 1 -- 172.21.15.114:0/3186174284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85780b2710 con 0x7f85781605b0 2023-11-04T01:38:44.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.918+0000 7f857f9ce640 1 -- 172.21.15.114:0/3186174284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85780b2cd0 con 0x7f85781605b0 2023-11-04T01:38:44.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.919+0000 7f857f9ce640 1 -- 172.21.15.114:0/3186174284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85780672a0 con 0x7f85781605b0 2023-11-04T01:38:44.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.919+0000 7f8575ffb640 1 -- 172.21.15.114:0/3186174284 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f856c04d3f0 con 0x7f85781605b0 2023-11-04T01:38:44.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.919+0000 7f8575ffb640 1 --2- 172.21.15.114:0/3186174284 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f856406ae70 0x7f856406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:44.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.919+0000 7f8575ffb640 1 -- 172.21.15.114:0/3186174284 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f856c0ab430 con 0x7f85781605b0 2023-11-04T01:38:44.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.920+0000 7f857d76a640 1 --2- 172.21.15.114:0/3186174284 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f856406ae70 0x7f856406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:44.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.920+0000 7f857d76a640 1 --2- 172.21.15.114:0/3186174284 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f856406ae70 0x7f856406d330 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f85680012e0 tx=0x7f8568005b70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:44.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:44.924+0000 7f8575ffb640 1 -- 172.21.15.114:0/3186174284 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f856c076680 con 0x7f85781605b0 2023-11-04T01:38:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.089+0000 7f857f9ce640 1 -- 172.21.15.114:0/3186174284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f85780b31f0 con 0x7f85781605b0 2023-11-04T01:38:45.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.092+0000 7f8575ffb640 1 -- 172.21.15.114:0/3186174284 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v15)=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f85780b31f0 con 0x7f85781605b0 2023-11-04T01:38:45.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.094+0000 7f857f9ce640 1 -- 172.21.15.114:0/3186174284 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f856406ae70 msgr2=0x7f856406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.094+0000 7f857f9ce640 1 --2- 172.21.15.114:0/3186174284 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f856406ae70 0x7f856406d330 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f85680012e0 tx=0x7f8568005b70 comp rx=0 tx=0).stop 2023-11-04T01:38:45.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.094+0000 7f857f9ce640 1 -- 172.21.15.114:0/3186174284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85781605b0 msgr2=0x7f857815dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.094+0000 7f857f9ce640 1 --2- 172.21.15.114:0/3186174284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85781605b0 0x7f857815dba0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f856c000c00 tx=0x7f856c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.094+0000 7f857f9ce640 1 -- 172.21.15.114:0/3186174284 shutdown_connections 2023-11-04T01:38:45.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.094+0000 7f857f9ce640 1 --2- 172.21.15.114:0/3186174284 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f856406ae70 0x7f856406d330 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.094+0000 7f857f9ce640 1 --2- 172.21.15.114:0/3186174284 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f85781573c0 0x7f857815e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.094+0000 7f857f9ce640 1 --2- 172.21.15.114:0/3186174284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85781605b0 0x7f857815dba0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.094+0000 7f857f9ce640 1 --2- 172.21.15.114:0/3186174284 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f857806a830 0x7f85781567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.094+0000 7f857f9ce640 1 -- 172.21.15.114:0/3186174284 >> 172.21.15.114:0/3186174284 conn(0x7f8578071820 msgr2=0x7f85780af500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:45.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.094+0000 7f857f9ce640 1 -- 172.21.15.114:0/3186174284 shutdown_connections 2023-11-04T01:38:45.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.094+0000 7f857f9ce640 1 -- 172.21.15.114:0/3186174284 wait complete. 2023-11-04T01:38:45.107 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:38:45.107 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:45.155 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:38:45.207 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:38:45.207 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:38:45.207 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:45.224 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:45.224 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:38:45.224 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:45.241 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:45.241 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:38:45.241 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:45.278 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:38:45.279 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:38:45.279 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:38:45.297 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:38:45.297 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:38:45.298 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:45.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.415+0000 7f6bc7590640 1 Processor -- start 2023-11-04T01:38:45.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.415+0000 7f6bc7590640 1 -- start start 2023-11-04T01:38:45.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.416+0000 7f6bc7590640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6bc006a830 0x7f6bc00cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.416+0000 7f6bc7590640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bc006eba0 0x7f6bc00ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.416+0000 7f6bc7590640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc006d310 con 0x7f6bc015ab70 2023-11-04T01:38:45.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.416+0000 7f6bc7590640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc00cba70 con 0x7f6bc006a830 2023-11-04T01:38:45.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.416+0000 7f6bc7590640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0161c50 con 0x7f6bc006eba0 2023-11-04T01:38:45.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.416+0000 7f6bc532c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6bc015ab70 0x7f6bc006a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45994/0 (socket says 172.21.15.114:45994) 2023-11-04T01:38:45.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.416+0000 7f6bc532c640 1 -- 172.21.15.114:0/176024344 learned_addr learned my addr 172.21.15.114:0/176024344 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:45.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bb7fff640 1 -- 172.21.15.114:0/176024344 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243553533 0 0) 0x7f6bc006d310 con 0x7f6bc015ab70 2023-11-04T01:38:45.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bb7fff640 1 -- 172.21.15.114:0/176024344 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bac003520 con 0x7f6bc015ab70 2023-11-04T01:38:45.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bc5b2d640 1 --2- 172.21.15.114:0/176024344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bc006eba0 0x7f6bc00ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bc4b2b640 1 --2- 172.21.15.114:0/176024344 >> v2:172.21.15.141:3300/0 conn(0x7f6bc006a830 0x7f6bc00cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bb7fff640 1 -- 172.21.15.114:0/176024344 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3188411000 0 0) 0x7f6bac003520 con 0x7f6bc015ab70 2023-11-04T01:38:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bb7fff640 1 -- 172.21.15.114:0/176024344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bc006eba0 msgr2=0x7f6bc00ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bb7fff640 1 --2- 172.21.15.114:0/176024344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bc006eba0 0x7f6bc00ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bb7fff640 1 -- 172.21.15.114:0/176024344 >> v2:172.21.15.141:3300/0 conn(0x7f6bc006a830 msgr2=0x7f6bc00cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bb7fff640 1 --2- 172.21.15.114:0/176024344 >> v2:172.21.15.141:3300/0 conn(0x7f6bc006a830 0x7f6bc00cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bb7fff640 1 -- 172.21.15.114:0/176024344 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc015d860 con 0x7f6bc015ab70 2023-11-04T01:38:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bb7fff640 1 -- 172.21.15.114:0/176024344 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f6bbc0017f0 con 0x7f6bc015ab70 2023-11-04T01:38:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bb7fff640 1 -- 172.21.15.114:0/176024344 >> v1:172.21.15.114:6789/0 conn(0x7f6bc015ab70 legacy=0x7f6bc006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bb7fff640 1 --2- 172.21.15.114:0/176024344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bc006eba0 0x7f6bac0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bb7fff640 1 --2- 172.21.15.114:0/176024344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bac003f70 0x7f6bac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bb7fff640 1 --2- 172.21.15.114:0/176024344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6bac004d00 0x7f6bac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bb7fff640 1 -- 172.21.15.114:0/176024344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc00cba70 con 0x7f6bac003f70 2023-11-04T01:38:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bb7fff640 1 -- 172.21.15.114:0/176024344 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0161c50 con 0x7f6bac004d00 2023-11-04T01:38:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bb7fff640 1 -- 172.21.15.114:0/176024344 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac00ba60 con 0x7f6bc006eba0 2023-11-04T01:38:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bc4b2b640 1 --2- 172.21.15.114:0/176024344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bac003f70 0x7f6bac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bc532c640 1 --2- 172.21.15.114:0/176024344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bc006eba0 0x7f6bac0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bc5b2d640 1 --2- 172.21.15.114:0/176024344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6bac004d00 0x7f6bac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bc4b2b640 1 -- 172.21.15.114:0/176024344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bc006eba0 msgr2=0x7f6bac0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bc4b2b640 1 --2- 172.21.15.114:0/176024344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bc006eba0 0x7f6bac0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bc4b2b640 1 -- 172.21.15.114:0/176024344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6bac004d00 msgr2=0x7f6bac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bc4b2b640 1 --2- 172.21.15.114:0/176024344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6bac004d00 0x7f6bac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.417+0000 7f6bc4b2b640 1 -- 172.21.15.114:0/176024344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac003520 con 0x7f6bac003f70 2023-11-04T01:38:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.418+0000 7f6bc4b2b640 1 --2- 172.21.15.114:0/176024344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bac003f70 0x7f6bac0047c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009a80 tx=0x7f6bac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64680b2ec3cdb62d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.418+0000 7f6bb7fff640 1 -- 172.21.15.114:0/176024344 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0005990 con 0x7f6bac003f70 2023-11-04T01:38:45.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.418+0000 7f6bb7fff640 1 -- 172.21.15.114:0/176024344 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb0005af0 con 0x7f6bac003f70 2023-11-04T01:38:45.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.418+0000 7f6bb7fff640 1 -- 172.21.15.114:0/176024344 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0005ea0 con 0x7f6bac003f70 2023-11-04T01:38:45.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.419+0000 7f6bc7590640 1 -- 172.21.15.114:0/176024344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bac003f70 msgr2=0x7f6bac0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.419+0000 7f6bc7590640 1 --2- 172.21.15.114:0/176024344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bac003f70 0x7f6bac0047c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009a80 tx=0x7f6bac0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.419+0000 7f6bc5b2d640 1 -- 172.21.15.114:0/176024344 reap_dead start 2023-11-04T01:38:45.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.419+0000 7f6bc7590640 1 -- 172.21.15.114:0/176024344 shutdown_connections 2023-11-04T01:38:45.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.419+0000 7f6bc7590640 1 -- 172.21.15.114:0/176024344 >> 172.21.15.114:0/176024344 conn(0x7f6bc0098d40 msgr2=0x7f6bc00cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:45.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.419+0000 7f6bc7590640 1 -- 172.21.15.114:0/176024344 shutdown_connections 2023-11-04T01:38:45.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.419+0000 7f6bc7590640 1 -- 172.21.15.114:0/176024344 wait complete. 2023-11-04T01:38:45.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.420+0000 7f6bc7590640 1 Processor -- start 2023-11-04T01:38:45.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.420+0000 7f6bc7590640 1 -- start start 2023-11-04T01:38:45.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc7590640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bac003f70 0x7f6bc009a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc7590640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bc01f3660 0x7f6bc01538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc7590640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6bc00b4c70 0x7f6bc009b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc7590640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0099850 con 0x7f6bc01f3660 2023-11-04T01:38:45.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc7590640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0099af0 con 0x7f6bc00b4c70 2023-11-04T01:38:45.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc7590640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0099dd0 con 0x7f6bac003f70 2023-11-04T01:38:45.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc4b2b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bc01f3660 0x7f6bc01538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc4b2b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bc01f3660 0x7f6bc01538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37844/0 (socket says 172.21.15.114:37844) 2023-11-04T01:38:45.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc4b2b640 1 -- 172.21.15.114:0/2972681628 learned_addr learned my addr 172.21.15.114:0/2972681628 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:45.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc5b2d640 1 --2- 172.21.15.114:0/2972681628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6bc00b4c70 0x7f6bc009b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc532c640 1 --2- 172.21.15.114:0/2972681628 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bac003f70 0x7f6bc009a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc4b2b640 1 -- 172.21.15.114:0/2972681628 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bac003f70 msgr2=0x7f6bc009a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc4b2b640 1 --2- 172.21.15.114:0/2972681628 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bac003f70 0x7f6bc009a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc4b2b640 1 -- 172.21.15.114:0/2972681628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6bc00b4c70 msgr2=0x7f6bc009b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc4b2b640 1 --2- 172.21.15.114:0/2972681628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6bc00b4c70 0x7f6bc009b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc4b2b640 1 -- 172.21.15.114:0/2972681628 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc009a0b0 con 0x7f6bc01f3660 2023-11-04T01:38:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.421+0000 7f6bc4b2b640 1 --2- 172.21.15.114:0/2972681628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bc01f3660 0x7f6bc01538d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0036040 tx=0x7f6bb0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.422+0000 7f6bb5ffb640 1 -- 172.21.15.114:0/2972681628 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0005e70 con 0x7f6bc01f3660 2023-11-04T01:38:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.422+0000 7f6bb5ffb640 1 -- 172.21.15.114:0/2972681628 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb0006030 con 0x7f6bc01f3660 2023-11-04T01:38:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.422+0000 7f6bb5ffb640 1 -- 172.21.15.114:0/2972681628 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00063c0 con 0x7f6bc01f3660 2023-11-04T01:38:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.422+0000 7f6bc7590640 1 -- 172.21.15.114:0/2972681628 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc0099850 con 0x7f6bc01f3660 2023-11-04T01:38:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.422+0000 7f6bc7590640 1 -- 172.21.15.114:0/2972681628 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc0153e10 con 0x7f6bc01f3660 2023-11-04T01:38:45.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.423+0000 7f6bc7590640 1 -- 172.21.15.114:0/2972681628 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc0066100 con 0x7f6bc01f3660 2023-11-04T01:38:45.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.423+0000 7f6bb5ffb640 1 -- 172.21.15.114:0/2972681628 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6bb0006520 con 0x7f6bc01f3660 2023-11-04T01:38:45.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.423+0000 7f6bb5ffb640 1 --2- 172.21.15.114:0/2972681628 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ba406ae70 0x7f6ba406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.424+0000 7f6bb5ffb640 1 -- 172.21.15.114:0/2972681628 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f6bb00ab850 con 0x7f6bc01f3660 2023-11-04T01:38:45.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.424+0000 7f6bc532c640 1 --2- 172.21.15.114:0/2972681628 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ba406ae70 0x7f6ba406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.424+0000 7f6bc532c640 1 --2- 172.21.15.114:0/2972681628 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ba406ae70 0x7f6ba406d330 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc000c00 tx=0x7f6bbc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.428+0000 7f6bb5ffb640 1 -- 172.21.15.114:0/2972681628 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6bb0076b30 con 0x7f6bc01f3660 2023-11-04T01:38:45.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.630+0000 7f6bc7590640 1 -- 172.21.15.114:0/2972681628 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bc0074290 con 0x7f6bc01f3660 2023-11-04T01:38:45.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.630+0000 7f6bb5ffb640 1 -- 172.21.15.114:0/2972681628 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f6bb004d020 con 0x7f6bc01f3660 2023-11-04T01:38:45.632 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:45.632 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1567359819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1567359819},{"type":"v1","addr":"172.21.15.141:6834","nonce":1567359819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/1960196694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":1960196694},{"type":"v1","addr":"172.21.15.141:6835","nonce":1960196694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2773454420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2773454420},{"type":"v1","addr":"172.21.15.114:6836","nonce":2773454420}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6396,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2215104550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2215104550},{"type":"v1","addr":"172.21.15.114:6837","nonce":2215104550}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[]} 2023-11-04T01:38:45.633 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 25 2023-11-04T01:38:45.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.632+0000 7f6bc7590640 1 -- 172.21.15.114:0/2972681628 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ba406ae70 msgr2=0x7f6ba406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.632+0000 7f6bc7590640 1 --2- 172.21.15.114:0/2972681628 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ba406ae70 0x7f6ba406d330 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc000c00 tx=0x7f6bbc009040 comp rx=0 tx=0).stop 2023-11-04T01:38:45.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.632+0000 7f6bc7590640 1 -- 172.21.15.114:0/2972681628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bc01f3660 msgr2=0x7f6bc01538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.632+0000 7f6bc7590640 1 --2- 172.21.15.114:0/2972681628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bc01f3660 0x7f6bc01538d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0036040 tx=0x7f6bb0004730 comp rx=0 tx=0).stop 2023-11-04T01:38:45.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.632+0000 7f6bc7590640 1 -- 172.21.15.114:0/2972681628 shutdown_connections 2023-11-04T01:38:45.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.632+0000 7f6bc7590640 1 --2- 172.21.15.114:0/2972681628 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ba406ae70 0x7f6ba406d330 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.632+0000 7f6bc7590640 1 --2- 172.21.15.114:0/2972681628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6bc00b4c70 0x7f6bc009b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.632+0000 7f6bc7590640 1 --2- 172.21.15.114:0/2972681628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bc01f3660 0x7f6bc01538d0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.632+0000 7f6bc7590640 1 --2- 172.21.15.114:0/2972681628 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6bac003f70 0x7f6bc009a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.632+0000 7f6bc7590640 1 -- 172.21.15.114:0/2972681628 >> 172.21.15.114:0/2972681628 conn(0x7f6bc0098d40 msgr2=0x7f6bc00cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:45.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.632+0000 7f6bc7590640 1 -- 172.21.15.114:0/2972681628 shutdown_connections 2023-11-04T01:38:45.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.632+0000 7f6bc7590640 1 -- 172.21.15.114:0/2972681628 wait complete. 2023-11-04T01:38:45.645 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:38:45.645 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:38:45.645 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:38:45.645 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:45.645 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:38:45.646 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:38:45.646 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:38:45.646 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:45.646 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:38:45.646 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:38:45.646 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:38:45.646 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:45.647 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:38:45.647 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:38:45.647 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:38:45.647 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:38:45.655 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:38:45.655 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:38:45.656 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:38:45.656 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:38:45.658 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:38:45.658 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:38:45.659 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:38:45.659 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:38:45.698 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:38:45.698 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:45.699 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:38:45.699 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:45.702 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:38:45.702 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:45.703 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:38:45.703 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:45.703 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:38:45.773 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2023-11-04T01:38:45.773 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2023-11-04T01:38:45.783 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-04T01:38:45.784 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-04T01:38:45.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.808+0000 7fc6aabe7640 1 Processor -- start 2023-11-04T01:38:45.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.809+0000 7fc6aabe7640 1 -- start start 2023-11-04T01:38:45.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.809+0000 7fc6aabe7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc6a40b4880 0x7fc6a40b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.809+0000 7fc6aabe7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a40cde60 con 0x7fc6a40cd6d0 2023-11-04T01:38:45.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.809+0000 7fc6aabe7640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a4160f90 con 0x7fc6a4153e60 2023-11-04T01:38:45.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.809+0000 7fc6aabe7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a40b5200 con 0x7fc6a40b4880 2023-11-04T01:38:45.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.809+0000 7fc6a9184640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc6a40b4880 0x7fc6a40b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.809+0000 7fc69bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc6a40cd6d0 0x7fc6a4161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46006/0 (socket says 172.21.15.114:46006) 2023-11-04T01:38:45.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.809+0000 7fc69bfff640 1 -- 172.21.15.114:0/1786922919 learned_addr learned my addr 172.21.15.114:0/1786922919 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:45.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.810+0000 7fc69b7fe640 1 -- 172.21.15.114:0/1786922919 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294771171 0 0) 0x7fc6a40cde60 con 0x7fc6a40cd6d0 2023-11-04T01:38:45.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.810+0000 7fc69b7fe640 1 -- 172.21.15.114:0/1786922919 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc68c003520 con 0x7fc6a40cd6d0 2023-11-04T01:38:45.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.810+0000 7fc69b7fe640 1 -- 172.21.15.114:0/1786922919 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448618179 0 0) 0x7fc6a4160f90 con 0x7fc6a4153e60 2023-11-04T01:38:45.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.810+0000 7fc69b7fe640 1 -- 172.21.15.114:0/1786922919 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a40cde60 con 0x7fc6a4153e60 2023-11-04T01:38:45.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.810+0000 7fc6a9184640 1 -- 172.21.15.114:0/1786922919 >> v1:172.21.15.141:6789/0 conn(0x7fc6a4153e60 legacy=0x7fc6a415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.810+0000 7fc6a9184640 1 -- 172.21.15.114:0/1786922919 >> v1:172.21.15.114:6789/0 conn(0x7fc6a40cd6d0 legacy=0x7fc6a4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.810+0000 7fc6a9184640 1 -- 172.21.15.114:0/1786922919 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40ce090 con 0x7fc6a40b4880 2023-11-04T01:38:45.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.811+0000 7fc6a9184640 1 --2- 172.21.15.114:0/1786922919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a40b4880 0x7fc6a40b4cc0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009d90 tx=0x7fc69c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e8707bb0c16800 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.811+0000 7fc69b7fe640 1 -- 172.21.15.114:0/1786922919 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c02cc60 con 0x7fc6a40b4880 2023-11-04T01:38:45.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.811+0000 7fc69b7fe640 1 -- 172.21.15.114:0/1786922919 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c02cdc0 con 0x7fc6a40b4880 2023-11-04T01:38:45.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.811+0000 7fc69b7fe640 1 -- 172.21.15.114:0/1786922919 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c034660 con 0x7fc6a40b4880 2023-11-04T01:38:45.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.811+0000 7fc6aabe7640 1 -- 172.21.15.114:0/1786922919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a40b4880 msgr2=0x7fc6a40b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.811+0000 7fc6aabe7640 1 --2- 172.21.15.114:0/1786922919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a40b4880 0x7fc6a40b4cc0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009d90 tx=0x7fc69c02beb0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.812+0000 7fc6aabe7640 1 -- 172.21.15.114:0/1786922919 shutdown_connections 2023-11-04T01:38:45.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.812+0000 7fc6aabe7640 1 --2- 172.21.15.114:0/1786922919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a40b4880 0x7fc6a40b4cc0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.812+0000 7fc6aabe7640 1 -- 172.21.15.114:0/1786922919 >> 172.21.15.114:0/1786922919 conn(0x7fc6a40cf880 msgr2=0x7fc6a40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:45.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.812+0000 7fc6aabe7640 1 -- 172.21.15.114:0/1786922919 shutdown_connections 2023-11-04T01:38:45.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.812+0000 7fc6aabe7640 1 -- 172.21.15.114:0/1786922919 wait complete. 2023-11-04T01:38:45.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.813+0000 7fc6aabe7640 1 Processor -- start 2023-11-04T01:38:45.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.813+0000 7fc6aabe7640 1 -- start start 2023-11-04T01:38:45.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc6aabe7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40b4880 0x7fc6a415a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc6aabe7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a40cd6d0 0x7fc6a40cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc6aabe7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a4153e60 0x7fc6a40cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc6aabe7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a415aa40 con 0x7fc6a40cd6d0 2023-11-04T01:38:45.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc6aabe7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40cc410 con 0x7fc6a40b4880 2023-11-04T01:38:45.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc6aabe7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40cc6f0 con 0x7fc6a4153e60 2023-11-04T01:38:45.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc69bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a40cd6d0 0x7fc6a40cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc69bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a40cd6d0 0x7fc6a40cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37878/0 (socket says 172.21.15.114:37878) 2023-11-04T01:38:45.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc69bfff640 1 -- 172.21.15.114:0/2217514956 learned_addr learned my addr 172.21.15.114:0/2217514956 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:45.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc6a8983640 1 --2- 172.21.15.114:0/2217514956 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40b4880 0x7fc6a415a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc6a9184640 1 --2- 172.21.15.114:0/2217514956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a4153e60 0x7fc6a40cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc69bfff640 1 -- 172.21.15.114:0/2217514956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a4153e60 msgr2=0x7fc6a40cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc69bfff640 1 --2- 172.21.15.114:0/2217514956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a4153e60 0x7fc6a40cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc69bfff640 1 -- 172.21.15.114:0/2217514956 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40b4880 msgr2=0x7fc6a415a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:45.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc69bfff640 1 --2- 172.21.15.114:0/2217514956 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40b4880 0x7fc6a415a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:45.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc69bfff640 1 -- 172.21.15.114:0/2217514956 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c009a70 con 0x7fc6a40cd6d0 2023-11-04T01:38:45.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc69bfff640 1 --2- 172.21.15.114:0/2217514956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a40cd6d0 0x7fc6a40cb8c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc69400c500 tx=0x7fc69400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc6997fa640 1 -- 172.21.15.114:0/2217514956 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694007560 con 0x7fc6a40cd6d0 2023-11-04T01:38:45.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc6aabe7640 1 -- 172.21.15.114:0/2217514956 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a40cc9d0 con 0x7fc6a40cd6d0 2023-11-04T01:38:45.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc6aabe7640 1 -- 172.21.15.114:0/2217514956 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a413cdf0 con 0x7fc6a40cd6d0 2023-11-04T01:38:45.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc6997fa640 1 -- 172.21.15.114:0/2217514956 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6940047e0 con 0x7fc6a40cd6d0 2023-11-04T01:38:45.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.814+0000 7fc6997fa640 1 -- 172.21.15.114:0/2217514956 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694007560 con 0x7fc6a40cd6d0 2023-11-04T01:38:45.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.815+0000 7fc6aabe7640 1 -- 172.21.15.114:0/2217514956 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc684005250 con 0x7fc6a40cd6d0 2023-11-04T01:38:45.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.816+0000 7fc6997fa640 1 -- 172.21.15.114:0/2217514956 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc694004950 con 0x7fc6a40cd6d0 2023-11-04T01:38:45.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.816+0000 7fc6997fa640 1 --2- 172.21.15.114:0/2217514956 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc69006af30 0x7fc69006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:45.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.816+0000 7fc6997fa640 1 -- 172.21.15.114:0/2217514956 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fc694088350 con 0x7fc6a40cd6d0 2023-11-04T01:38:45.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.816+0000 7fc6a8983640 1 --2- 172.21.15.114:0/2217514956 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc69006af30 0x7fc69006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:45.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.817+0000 7fc6a8983640 1 --2- 172.21.15.114:0/2217514956 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc69006af30 0x7fc69006d3f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0000f60 tx=0x7fc6a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:45.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.820+0000 7fc6997fa640 1 -- 172.21.15.114:0/2217514956 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc694053520 con 0x7fc6a40cd6d0 2023-11-04T01:38:46.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:45.999+0000 7fc6aabe7640 1 -- 172.21.15.114:0/2217514956 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc684005500 con 0x7fc6a40cd6d0 2023-11-04T01:38:46.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.809+0000 7fc6997fa640 1 -- 172.21.15.114:0/2217514956 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc694056b40 con 0x7fc6a40cd6d0 2023-11-04T01:38:46.811 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2023-11-04T01:38:46.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.812+0000 7fc6aabe7640 1 -- 172.21.15.114:0/2217514956 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc69006af30 msgr2=0x7fc69006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.812+0000 7fc6aabe7640 1 --2- 172.21.15.114:0/2217514956 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc69006af30 0x7fc69006d3f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0000f60 tx=0x7fc6a0009040 comp rx=0 tx=0).stop 2023-11-04T01:38:46.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.812+0000 7fc6aabe7640 1 -- 172.21.15.114:0/2217514956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a40cd6d0 msgr2=0x7fc6a40cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.812+0000 7fc6aabe7640 1 --2- 172.21.15.114:0/2217514956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a40cd6d0 0x7fc6a40cb8c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc69400c500 tx=0x7fc69400c9c0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.812+0000 7fc6aabe7640 1 -- 172.21.15.114:0/2217514956 shutdown_connections 2023-11-04T01:38:46.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.812+0000 7fc6aabe7640 1 --2- 172.21.15.114:0/2217514956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a4153e60 0x7fc6a40cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.812+0000 7fc6aabe7640 1 --2- 172.21.15.114:0/2217514956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a40cd6d0 0x7fc6a40cb8c0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.812+0000 7fc6aabe7640 1 --2- 172.21.15.114:0/2217514956 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc69006af30 0x7fc69006d3f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.812+0000 7fc6aabe7640 1 --2- 172.21.15.114:0/2217514956 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40b4880 0x7fc6a415a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.812+0000 7fc6aabe7640 1 -- 172.21.15.114:0/2217514956 >> 172.21.15.114:0/2217514956 conn(0x7fc6a40cf880 msgr2=0x7fc6a4161420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:46.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.812+0000 7fc6aabe7640 1 -- 172.21.15.114:0/2217514956 shutdown_connections 2023-11-04T01:38:46.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.812+0000 7fc6aabe7640 1 -- 172.21.15.114:0/2217514956 wait complete. 2023-11-04T01:38:46.827 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:38:46.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.930+0000 7f9218f55640 1 Processor -- start 2023-11-04T01:38:46.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.930+0000 7f9218f55640 1 -- start start 2023-11-04T01:38:46.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9218f55640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f921415bfb0 0x7f92140cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9218f55640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92140cc450 con 0x7f921415ae40 2023-11-04T01:38:46.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9218f55640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921415f400 con 0x7f92140cd860 2023-11-04T01:38:46.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9218f55640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921415b220 con 0x7f921415bfb0 2023-11-04T01:38:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f921259c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f921415ae40 0x7f92140cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41754/0 (socket says 172.21.15.114:41754) 2023-11-04T01:38:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f921259c640 1 -- 172.21.15.114:0/2526727638 learned_addr learned my addr 172.21.15.114:0/2526727638 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9211d9b640 1 -- 172.21.15.114:0/2526727638 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963238027 0 0) 0x7f9204001110 con 0x7f921415ae40 2023-11-04T01:38:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9211d9b640 1 -- 172.21.15.114:0/2526727638 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9200003520 con 0x7f921415ae40 2023-11-04T01:38:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f920bfff640 1 --2- 172.21.15.114:0/2526727638 >> v2:172.21.15.141:3300/0 conn(0x7f921415bfb0 0x7f92140cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9211d9b640 1 -- 172.21.15.114:0/2526727638 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 569999384 0 0) 0x7f9200003520 con 0x7f921415ae40 2023-11-04T01:38:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9211d9b640 1 -- 172.21.15.114:0/2526727638 >> v2:172.21.15.141:3300/0 conn(0x7f921415bfb0 msgr2=0x7f92140cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9211d9b640 1 --2- 172.21.15.114:0/2526727638 >> v2:172.21.15.141:3300/0 conn(0x7f921415bfb0 0x7f92140cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9211d9b640 1 -- 172.21.15.114:0/2526727638 >> v1:172.21.15.141:6789/0 conn(0x7f92140cd860 legacy=0x7f92140ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9211d9b640 1 -- 172.21.15.114:0/2526727638 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921415f890 con 0x7f921415ae40 2023-11-04T01:38:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9211d9b640 1 -- 172.21.15.114:0/2526727638 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f9204001800 con 0x7f921415ae40 2023-11-04T01:38:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9211d9b640 1 -- 172.21.15.114:0/2526727638 >> v1:172.21.15.114:6789/0 conn(0x7f921415ae40 legacy=0x7f92140cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9211d9b640 1 --2- 172.21.15.114:0/2526727638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9200003970 0x7f9200003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9211d9b640 1 --2- 172.21.15.114:0/2526727638 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92000047c0 0x7f9200004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9211d9b640 1 --2- 172.21.15.114:0/2526727638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9200005180 0x7f920000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9211d9b640 1 -- 172.21.15.114:0/2526727638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921415b220 con 0x7f9200005180 2023-11-04T01:38:46.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9211d9b640 1 -- 172.21.15.114:0/2526727638 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920000c0d0 con 0x7f92000047c0 2023-11-04T01:38:46.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.931+0000 7f9211d9b640 1 -- 172.21.15.114:0/2526727638 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920000c290 con 0x7f9200003970 2023-11-04T01:38:46.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.932+0000 7f9212d9d640 1 --2- 172.21.15.114:0/2526727638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9200005180 0x7f920000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.932+0000 7f921259c640 1 --2- 172.21.15.114:0/2526727638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9200003970 0x7f9200003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.932+0000 7f920bfff640 1 --2- 172.21.15.114:0/2526727638 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92000047c0 0x7f9200004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.932+0000 7f9212d9d640 1 -- 172.21.15.114:0/2526727638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9200003970 msgr2=0x7f9200003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:46.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.932+0000 7f9212d9d640 1 --2- 172.21.15.114:0/2526727638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9200003970 0x7f9200003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.932+0000 7f9212d9d640 1 -- 172.21.15.114:0/2526727638 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92000047c0 msgr2=0x7f9200004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:46.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.932+0000 7f9212d9d640 1 --2- 172.21.15.114:0/2526727638 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f92000047c0 0x7f9200004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.932+0000 7f9212d9d640 1 -- 172.21.15.114:0/2526727638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9200003520 con 0x7f9200005180 2023-11-04T01:38:46.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.932+0000 7f9212d9d640 1 -- 172.21.15.114:0/2526727638 reap_dead start 2023-11-04T01:38:46.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.933+0000 7f9212d9d640 1 --2- 172.21.15.114:0/2526727638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9200005180 0x7f920000b980 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f920c001e50 tx=0x7f92000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6403c2b0d5e2d90 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.933+0000 7f9211d9b640 1 -- 172.21.15.114:0/2526727638 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c003b70 con 0x7f9200005180 2023-11-04T01:38:46.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.933+0000 7f9211d9b640 1 -- 172.21.15.114:0/2526727638 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c003d10 con 0x7f9200005180 2023-11-04T01:38:46.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.933+0000 7f9211d9b640 1 -- 172.21.15.114:0/2526727638 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c005310 con 0x7f9200005180 2023-11-04T01:38:46.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.933+0000 7f9218f55640 1 -- 172.21.15.114:0/2526727638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9200005180 msgr2=0x7f920000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.933+0000 7f9218f55640 1 --2- 172.21.15.114:0/2526727638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9200005180 0x7f920000b980 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f920c001e50 tx=0x7f92000057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.933+0000 7f9218f55640 1 -- 172.21.15.114:0/2526727638 shutdown_connections 2023-11-04T01:38:46.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.933+0000 7f9218f55640 1 --2- 172.21.15.114:0/2526727638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9200005180 0x7f920000b980 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.933+0000 7f9218f55640 1 -- 172.21.15.114:0/2526727638 >> 172.21.15.114:0/2526727638 conn(0x7f921406ea90 msgr2=0x7f921406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:46.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.933+0000 7f9218f55640 1 -- 172.21.15.114:0/2526727638 shutdown_connections 2023-11-04T01:38:46.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.933+0000 7f9218f55640 1 -- 172.21.15.114:0/2526727638 wait complete. 2023-11-04T01:38:46.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.935+0000 7f9218f55640 1 Processor -- start 2023-11-04T01:38:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.935+0000 7f9218f55640 1 -- start start 2023-11-04T01:38:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.935+0000 7f9218f55640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9200005180 0x7f92141e51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.935+0000 7f9218f55640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140b25b0 0x7f921414e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.935+0000 7f9218f55640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92140c9ac0 0x7f92140c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.935+0000 7f9218f55640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92141e6400 con 0x7f92140b25b0 2023-11-04T01:38:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.935+0000 7f9218f55640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92140ca480 con 0x7f9200005180 2023-11-04T01:38:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.935+0000 7f9218f55640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92141e5880 con 0x7f92140c9ac0 2023-11-04T01:38:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.935+0000 7f920bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140b25b0 0x7f921414e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.935+0000 7f920bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140b25b0 0x7f921414e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48256/0 (socket says 172.21.15.114:48256) 2023-11-04T01:38:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.935+0000 7f920bfff640 1 -- 172.21.15.114:0/4178260284 learned_addr learned my addr 172.21.15.114:0/4178260284 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.936+0000 7f921259c640 1 --2- 172.21.15.114:0/4178260284 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9200005180 0x7f92141e51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.936+0000 7f9212d9d640 1 --2- 172.21.15.114:0/4178260284 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92140c9ac0 0x7f92140c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.936+0000 7f920bfff640 1 -- 172.21.15.114:0/4178260284 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92140c9ac0 msgr2=0x7f92140c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.936+0000 7f920bfff640 1 --2- 172.21.15.114:0/4178260284 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92140c9ac0 0x7f92140c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.936+0000 7f920bfff640 1 -- 172.21.15.114:0/4178260284 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9200005180 msgr2=0x7f92141e51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.936+0000 7f920bfff640 1 --2- 172.21.15.114:0/4178260284 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9200005180 0x7f92141e51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.936+0000 7f920bfff640 1 -- 172.21.15.114:0/4178260284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92141e5b60 con 0x7f92140b25b0 2023-11-04T01:38:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.936+0000 7f921259c640 1 --2- 172.21.15.114:0/4178260284 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9200005180 0x7f92141e51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.936+0000 7f920bfff640 1 --2- 172.21.15.114:0/4178260284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140b25b0 0x7f921414e730 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00b7c0 tx=0x7f91fc00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.936+0000 7f920affd640 1 -- 172.21.15.114:0/4178260284 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc010830 con 0x7f92140b25b0 2023-11-04T01:38:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.936+0000 7f920affd640 1 -- 172.21.15.114:0/4178260284 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc010990 con 0x7f92140b25b0 2023-11-04T01:38:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.936+0000 7f920affd640 1 -- 172.21.15.114:0/4178260284 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc010d20 con 0x7f92140b25b0 2023-11-04T01:38:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.936+0000 7f9218f55640 1 -- 172.21.15.114:0/4178260284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92141e5e40 con 0x7f92140b25b0 2023-11-04T01:38:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.936+0000 7f9218f55640 1 -- 172.21.15.114:0/4178260284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92140b2a30 con 0x7f92140b25b0 2023-11-04T01:38:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.937+0000 7f9218f55640 1 -- 172.21.15.114:0/4178260284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92140ce2d0 con 0x7f92140b25b0 2023-11-04T01:38:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.937+0000 7f920affd640 1 -- 172.21.15.114:0/4178260284 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f91fc014430 con 0x7f92140b25b0 2023-11-04T01:38:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.938+0000 7f920affd640 1 --2- 172.21.15.114:0/4178260284 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f91f406ae70 0x7f91f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.938+0000 7f920affd640 1 -- 172.21.15.114:0/4178260284 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f91fc089be0 con 0x7f92140b25b0 2023-11-04T01:38:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.938+0000 7f921259c640 1 --2- 172.21.15.114:0/4178260284 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f91f406ae70 0x7f91f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.938+0000 7f921259c640 1 --2- 172.21.15.114:0/4178260284 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f91f406ae70 0x7f91f406d330 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9204001270 tx=0x7f9204009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:46.942+0000 7f920affd640 1 -- 172.21.15.114:0/4178260284 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f91fc054d40 con 0x7f92140b25b0 2023-11-04T01:38:47.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.172+0000 7f9218f55640 1 -- 172.21.15.114:0/4178260284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9214074290 con 0x7f92140b25b0 2023-11-04T01:38:47.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.173+0000 7f920affd640 1 -- 172.21.15.114:0/4178260284 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f91fc022020 con 0x7f92140b25b0 2023-11-04T01:38:47.175 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:47.175 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:38:47.175 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2023-11-04T01:38:47.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.175 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2023-11-04T01:38:47.175 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0VlswblMRAAotQqAxFKxonbXL/aDdoEPw==", 2023-11-04T01:38:47.175 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.176 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:38:47.176 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:38:47.176 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:38:47.176 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:47.176 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.176 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2023-11-04T01:38:47.176 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VluZGwAhAAZPVNOe2pR5yFwajeNFbXzw==", 2023-11-04T01:38:47.176 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.176 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:38:47.176 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:38:47.177 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:38:47.177 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:47.177 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.177 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.177 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2023-11-04T01:38:47.177 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0VlUsc9ORAAmZhkDVK2hR4wbky+cLfo+A==", 2023-11-04T01:38:47.177 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.177 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:38:47.177 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:38:47.177 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:38:47.177 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:47.177 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.178 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.178 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2023-11-04T01:38:47.178 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VlfxP9CRAAQppp4Lmc1v2xMGYc/AD7pA==", 2023-11-04T01:38:47.178 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.178 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:38:47.178 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:38:47.178 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:38:47.178 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:47.178 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.179 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.179 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2023-11-04T01:38:47.179 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDdn0Vl/xmgMBAANQCw5RUd/IlxHaDvCz2Gbg==", 2023-11-04T01:38:47.179 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.179 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:47.179 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:38:47.179 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:47.179 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.179 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.180 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2023-11-04T01:38:47.180 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDgn0VlTpuDLxAAf5vdQMiWBcLfx0Vf8Petyg==", 2023-11-04T01:38:47.180 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.180 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:47.180 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:38:47.180 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:47.180 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.180 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.180 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2023-11-04T01:38:47.180 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDjn0VlZonFLRAAHJMf/0DasOCeOrz4u8uV2w==", 2023-11-04T01:38:47.180 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.181 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:47.181 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:38:47.181 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:47.181 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.181 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.181 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2023-11-04T01:38:47.181 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDmn0VlLKK7KxAAKJzogyZTtMzEtAL+LL1V0w==", 2023-11-04T01:38:47.181 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.181 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:47.181 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:38:47.181 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:47.181 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.182 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.182 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2023-11-04T01:38:47.182 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDsn0VlLitpMhAA6ow9uVmS5YtOnqSWSB66ww==", 2023-11-04T01:38:47.182 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.182 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:47.182 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:38:47.182 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:47.182 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.182 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.182 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2023-11-04T01:38:47.182 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDvn0VlfkL/MBAA/LYWJLF7F12XMEICf18BwA==", 2023-11-04T01:38:47.183 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.183 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:47.183 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:38:47.183 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:47.183 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.183 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.183 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2023-11-04T01:38:47.183 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDyn0Vl8ZrhLxAAKDbE5KvbWhguLsNNi+3duA==", 2023-11-04T01:38:47.183 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.183 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:47.183 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:38:47.183 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:47.184 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.184 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.184 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2023-11-04T01:38:47.184 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD1n0Vlues1LhAARQs1LLq8y63wl8nAs8GbGQ==", 2023-11-04T01:38:47.184 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.184 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:38:47.184 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:38:47.184 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:47.184 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.184 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.184 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2023-11-04T01:38:47.184 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0Vl3QHODhAA6LWlhd+avWYsoYsWMbOiVA==", 2023-11-04T01:38:47.185 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.185 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:38:47.185 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2023-11-04T01:38:47.185 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:38:47.185 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.185 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.185 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.185 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2023-11-04T01:38:47.185 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VlRvgLGBAAAAhF9alG2eD5A/xjWXcVWA==", 2023-11-04T01:38:47.185 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.185 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:38:47.185 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-11-04T01:38:47.185 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-11-04T01:38:47.186 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-11-04T01:38:47.186 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.186 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.186 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.186 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2023-11-04T01:38:47.186 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VlgV6sFBAAxheFKb52kyZly4byr78vfw==", 2023-11-04T01:38:47.186 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.186 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:38:47.186 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-11-04T01:38:47.186 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-11-04T01:38:47.186 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-11-04T01:38:47.186 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.186 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.187 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.187 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2023-11-04T01:38:47.187 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VltiLUHRAAY0QtK328vB9H/l8FWCNB4g==", 2023-11-04T01:38:47.187 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.187 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:38:47.187 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-11-04T01:38:47.187 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-11-04T01:38:47.187 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-11-04T01:38:47.187 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.187 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.187 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.187 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2023-11-04T01:38:47.187 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0Vl3O6UFBAAZpdiB/7sBN6IpvNpe/LoIA==", 2023-11-04T01:38:47.188 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.188 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-11-04T01:38:47.188 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:38:47.188 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:38:47.188 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:47.188 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.188 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.188 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2023-11-04T01:38:47.188 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0Vlb1WELhAAcUQ6WxKBsUeJfXvaE+h0GQ==", 2023-11-04T01:38:47.188 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.188 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-11-04T01:38:47.188 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2023-11-04T01:38:47.188 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:47.189 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.189 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:47.189 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:47.189 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2023-11-04T01:38:47.189 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0VluGn6KRAAHsThhoAbKIz+kqF2DYyvkg==", 2023-11-04T01:38:47.189 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:38:47.189 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-11-04T01:38:47.189 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2023-11-04T01:38:47.189 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:38:47.189 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.189 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:47.189 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-11-04T01:38:47.189 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:38:47.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.175+0000 7f9218f55640 1 -- 172.21.15.114:0/4178260284 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f91f406ae70 msgr2=0x7f91f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.175+0000 7f9218f55640 1 --2- 172.21.15.114:0/4178260284 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f91f406ae70 0x7f91f406d330 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9204001270 tx=0x7f9204009040 comp rx=0 tx=0).stop 2023-11-04T01:38:47.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.175+0000 7f9218f55640 1 -- 172.21.15.114:0/4178260284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140b25b0 msgr2=0x7f921414e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.175+0000 7f9218f55640 1 --2- 172.21.15.114:0/4178260284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140b25b0 0x7f921414e730 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00b7c0 tx=0x7f91fc00bc80 comp rx=0 tx=0).stop 2023-11-04T01:38:47.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.175+0000 7f9218f55640 1 -- 172.21.15.114:0/4178260284 shutdown_connections 2023-11-04T01:38:47.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.175+0000 7f9218f55640 1 --2- 172.21.15.114:0/4178260284 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f92140c9ac0 0x7f92140c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.175+0000 7f9218f55640 1 --2- 172.21.15.114:0/4178260284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92140b25b0 0x7f921414e730 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.175+0000 7f9218f55640 1 --2- 172.21.15.114:0/4178260284 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f91f406ae70 0x7f91f406d330 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.175+0000 7f9218f55640 1 --2- 172.21.15.114:0/4178260284 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9200005180 0x7f92141e51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.175+0000 7f9218f55640 1 -- 172.21.15.114:0/4178260284 >> 172.21.15.114:0/4178260284 conn(0x7f921406ea90 msgr2=0x7f92140d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:47.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.175+0000 7f9218f55640 1 -- 172.21.15.114:0/4178260284 shutdown_connections 2023-11-04T01:38:47.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.175+0000 7f9218f55640 1 -- 172.21.15.114:0/4178260284 wait complete. 2023-11-04T01:38:47.193 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:47.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.291+0000 7fd0e2ee1640 1 Processor -- start 2023-11-04T01:38:47.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.291+0000 7fd0e2ee1640 1 -- start start 2023-11-04T01:38:47.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.292+0000 7fd0e2ee1640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc15ae40 0x7fd0dc15bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.292+0000 7fd0e2ee1640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd0dc0cda30 0x7fd0dc0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.292+0000 7fd0e2ee1640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0dc0cc450 con 0x7fd0dc0cbc00 2023-11-04T01:38:47.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.292+0000 7fd0e2ee1640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0dc15f400 con 0x7fd0dc0cda30 2023-11-04T01:38:47.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.292+0000 7fd0e2ee1640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc15b220 con 0x7fd0dc15ae40 2023-11-04T01:38:47.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.292+0000 7fd0dbfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd0dc0cbc00 0x7fd0dc0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41762/0 (socket says 172.21.15.114:41762) 2023-11-04T01:38:47.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.292+0000 7fd0dbfff640 1 -- 172.21.15.114:0/1028418244 learned_addr learned my addr 172.21.15.114:0/1028418244 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:47.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.292+0000 7fd0db7fe640 1 -- 172.21.15.114:0/1028418244 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023647598 0 0) 0x7fd0d0001110 con 0x7fd0dc0cbc00 2023-11-04T01:38:47.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0db7fe640 1 -- 172.21.15.114:0/1028418244 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0c4003520 con 0x7fd0dc0cbc00 2023-11-04T01:38:47.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0e147e640 1 --2- 172.21.15.114:0/1028418244 >> v2:172.21.15.141:3300/0 conn(0x7fd0dc0cda30 0x7fd0dc0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0e0c7d640 1 --2- 172.21.15.114:0/1028418244 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc15ae40 0x7fd0dc15bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0db7fe640 1 -- 172.21.15.114:0/1028418244 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 402867541 0 0) 0x7fd0c4003520 con 0x7fd0dc0cbc00 2023-11-04T01:38:47.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0db7fe640 1 -- 172.21.15.114:0/1028418244 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc15ae40 msgr2=0x7fd0dc15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0db7fe640 1 --2- 172.21.15.114:0/1028418244 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc15ae40 0x7fd0dc15bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0db7fe640 1 -- 172.21.15.114:0/1028418244 >> v2:172.21.15.141:3300/0 conn(0x7fd0dc0cda30 msgr2=0x7fd0dc0ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0db7fe640 1 --2- 172.21.15.114:0/1028418244 >> v2:172.21.15.141:3300/0 conn(0x7fd0dc0cda30 0x7fd0dc0ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0db7fe640 1 -- 172.21.15.114:0/1028418244 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc15f890 con 0x7fd0dc0cbc00 2023-11-04T01:38:47.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0db7fe640 1 -- 172.21.15.114:0/1028418244 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fd0d0001800 con 0x7fd0dc0cbc00 2023-11-04T01:38:47.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0db7fe640 1 -- 172.21.15.114:0/1028418244 >> v1:172.21.15.114:6789/0 conn(0x7fd0dc0cbc00 legacy=0x7fd0dc0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0db7fe640 1 --2- 172.21.15.114:0/1028418244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0c4003970 0x7fd0c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0db7fe640 1 --2- 172.21.15.114:0/1028418244 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc15ae40 0x7fd0c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0db7fe640 1 --2- 172.21.15.114:0/1028418244 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd0c4004d00 0x7fd0c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0db7fe640 1 -- 172.21.15.114:0/1028418244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc15f400 con 0x7fd0c4003970 2023-11-04T01:38:47.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0db7fe640 1 -- 172.21.15.114:0/1028418244 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc15b220 con 0x7fd0c4004d00 2023-11-04T01:38:47.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0db7fe640 1 -- 172.21.15.114:0/1028418244 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c400b980 con 0x7fd0dc15ae40 2023-11-04T01:38:47.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0e0c7d640 1 --2- 172.21.15.114:0/1028418244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0c4003970 0x7fd0c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0dbfff640 1 --2- 172.21.15.114:0/1028418244 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc15ae40 0x7fd0c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0e147e640 1 --2- 172.21.15.114:0/1028418244 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd0c4004d00 0x7fd0c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0e0c7d640 1 -- 172.21.15.114:0/1028418244 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc15ae40 msgr2=0x7fd0c40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0e0c7d640 1 --2- 172.21.15.114:0/1028418244 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc15ae40 0x7fd0c40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0e0c7d640 1 -- 172.21.15.114:0/1028418244 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd0c4004d00 msgr2=0x7fd0c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0e0c7d640 1 --2- 172.21.15.114:0/1028418244 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd0c4004d00 0x7fd0c4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.293+0000 7fd0e0c7d640 1 -- 172.21.15.114:0/1028418244 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c4003520 con 0x7fd0c4003970 2023-11-04T01:38:47.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.294+0000 7fd0e0c7d640 1 --2- 172.21.15.114:0/1028418244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0c4003970 0x7fd0c4003d90 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009ac0 tx=0x7fd0c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e37098305c77b92 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.294+0000 7fd0db7fe640 1 -- 172.21.15.114:0/1028418244 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc02c6b0 con 0x7fd0c4003970 2023-11-04T01:38:47.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.294+0000 7fd0db7fe640 1 -- 172.21.15.114:0/1028418244 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0cc02c810 con 0x7fd0c4003970 2023-11-04T01:38:47.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.294+0000 7fd0db7fe640 1 -- 172.21.15.114:0/1028418244 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc02cba0 con 0x7fd0c4003970 2023-11-04T01:38:47.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.295+0000 7fd0e2ee1640 1 -- 172.21.15.114:0/1028418244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0c4003970 msgr2=0x7fd0c4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.295+0000 7fd0e2ee1640 1 --2- 172.21.15.114:0/1028418244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0c4003970 0x7fd0c4003d90 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009ac0 tx=0x7fd0c40057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.295+0000 7fd0e147e640 1 -- 172.21.15.114:0/1028418244 reap_dead start 2023-11-04T01:38:47.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.295+0000 7fd0e2ee1640 1 -- 172.21.15.114:0/1028418244 shutdown_connections 2023-11-04T01:38:47.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.295+0000 7fd0e2ee1640 1 -- 172.21.15.114:0/1028418244 >> 172.21.15.114:0/1028418244 conn(0x7fd0dc06ea90 msgr2=0x7fd0dc06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:47.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.295+0000 7fd0e2ee1640 1 -- 172.21.15.114:0/1028418244 shutdown_connections 2023-11-04T01:38:47.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.295+0000 7fd0e2ee1640 1 -- 172.21.15.114:0/1028418244 wait complete. 2023-11-04T01:38:47.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.296+0000 7fd0e2ee1640 1 Processor -- start 2023-11-04T01:38:47.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.296+0000 7fd0e2ee1640 1 -- start start 2023-11-04T01:38:47.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e2ee1640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd0c4003970 0x7fd0dc1f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e2ee1640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc06cc30 0x7fd0dc158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e2ee1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc14ec10 0x7fd0dc14f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e2ee1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc14f5d0 con 0x7fd0dc14ec10 2023-11-04T01:38:47.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e2ee1640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc1f6250 con 0x7fd0c4003970 2023-11-04T01:38:47.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e2ee1640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0c7c70 con 0x7fd0dc06cc30 2023-11-04T01:38:47.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e147e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc14ec10 0x7fd0dc14f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e147e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc14ec10 0x7fd0dc14f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48274/0 (socket says 172.21.15.114:48274) 2023-11-04T01:38:47.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e147e640 1 -- 172.21.15.114:0/65274468 learned_addr learned my addr 172.21.15.114:0/65274468 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:47.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e147e640 1 -- 172.21.15.114:0/65274468 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc06cc30 msgr2=0x7fd0dc158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e147e640 1 --2- 172.21.15.114:0/65274468 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc06cc30 0x7fd0dc158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e147e640 1 -- 172.21.15.114:0/65274468 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd0c4003970 msgr2=0x7fd0dc1f6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e147e640 1 --2- 172.21.15.114:0/65274468 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd0c4003970 0x7fd0dc1f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e147e640 1 -- 172.21.15.114:0/65274468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc0c7f50 con 0x7fd0dc14ec10 2023-11-04T01:38:47.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e147e640 1 --2- 172.21.15.114:0/65274468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc14ec10 0x7fd0dc14f090 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc06e580 tx=0x7fd0d40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0d97fa640 1 -- 172.21.15.114:0/65274468 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400e070 con 0x7fd0dc14ec10 2023-11-04T01:38:47.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0d97fa640 1 -- 172.21.15.114:0/65274468 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d4011e10 con 0x7fd0dc14ec10 2023-11-04T01:38:47.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e2ee1640 1 -- 172.21.15.114:0/65274468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc1f64f0 con 0x7fd0dc14ec10 2023-11-04T01:38:47.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0d97fa640 1 -- 172.21.15.114:0/65274468 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4003990 con 0x7fd0dc14ec10 2023-11-04T01:38:47.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.297+0000 7fd0e2ee1640 1 -- 172.21.15.114:0/65274468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc0b2f50 con 0x7fd0dc14ec10 2023-11-04T01:38:47.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.298+0000 7fd0e2ee1640 1 -- 172.21.15.114:0/65274468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc0ce2d0 con 0x7fd0dc14ec10 2023-11-04T01:38:47.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.299+0000 7fd0d97fa640 1 -- 172.21.15.114:0/65274468 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0d4003af0 con 0x7fd0dc14ec10 2023-11-04T01:38:47.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.299+0000 7fd0d97fa640 1 --2- 172.21.15.114:0/65274468 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd0c806aea0 0x7fd0c806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.299+0000 7fd0d97fa640 1 -- 172.21.15.114:0/65274468 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd0d4089cd0 con 0x7fd0dc14ec10 2023-11-04T01:38:47.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.299+0000 7fd0e0c7d640 1 --2- 172.21.15.114:0/65274468 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd0c806aea0 0x7fd0c806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.300+0000 7fd0e0c7d640 1 --2- 172.21.15.114:0/65274468 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd0c806aea0 0x7fd0c806d360 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc036000 tx=0x7fd0cc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.303+0000 7fd0d97fa640 1 -- 172.21.15.114:0/65274468 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd0d4054e30 con 0x7fd0dc14ec10 2023-11-04T01:38:47.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.470+0000 7fd0e2ee1640 1 -- 172.21.15.114:0/65274468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0dc1f6a10 con 0x7fd0dc14ec10 2023-11-04T01:38:47.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.471+0000 7fd0d97fa640 1 -- 172.21.15.114:0/65274468 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+14875 (secure 0 0 0) 0x7fd0dc1f6a10 con 0x7fd0dc14ec10 2023-11-04T01:38:47.472 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:47.473 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":62,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:46.807320+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:47.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.472+0000 7fd0e2ee1640 1 -- 172.21.15.114:0/65274468 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd0c806aea0 msgr2=0x7fd0c806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.472+0000 7fd0e2ee1640 1 --2- 172.21.15.114:0/65274468 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd0c806aea0 0x7fd0c806d360 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc036000 tx=0x7fd0cc02e000 comp rx=0 tx=0).stop 2023-11-04T01:38:47.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.472+0000 7fd0e2ee1640 1 -- 172.21.15.114:0/65274468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc14ec10 msgr2=0x7fd0dc14f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.472+0000 7fd0e2ee1640 1 --2- 172.21.15.114:0/65274468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc14ec10 0x7fd0dc14f090 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc06e580 tx=0x7fd0d40115a0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.473+0000 7fd0e2ee1640 1 -- 172.21.15.114:0/65274468 shutdown_connections 2023-11-04T01:38:47.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.473+0000 7fd0e2ee1640 1 --2- 172.21.15.114:0/65274468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc14ec10 0x7fd0dc14f090 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.473+0000 7fd0e2ee1640 1 --2- 172.21.15.114:0/65274468 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc06cc30 0x7fd0dc158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.473+0000 7fd0e2ee1640 1 --2- 172.21.15.114:0/65274468 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd0c806aea0 0x7fd0c806d360 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.473+0000 7fd0e2ee1640 1 --2- 172.21.15.114:0/65274468 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd0c4003970 0x7fd0dc1f6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.473+0000 7fd0e2ee1640 1 -- 172.21.15.114:0/65274468 >> 172.21.15.114:0/65274468 conn(0x7fd0dc06ea90 msgr2=0x7fd0dc15df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:47.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.473+0000 7fd0e2ee1640 1 -- 172.21.15.114:0/65274468 shutdown_connections 2023-11-04T01:38:47.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.473+0000 7fd0e2ee1640 1 -- 172.21.15.114:0/65274468 wait complete. 2023-11-04T01:38:47.485 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:38:47.485 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:38:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.586+0000 7fd951456640 1 Processor -- start 2023-11-04T01:38:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.586+0000 7fd951456640 1 -- start start 2023-11-04T01:38:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.587+0000 7fd951456640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd94c0b4880 0x7fd94c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.587+0000 7fd951456640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94c0cde60 con 0x7fd94c0cd6d0 2023-11-04T01:38:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.587+0000 7fd951456640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94c160f90 con 0x7fd94c153e60 2023-11-04T01:38:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.587+0000 7fd951456640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94c0b5200 con 0x7fd94c0b4880 2023-11-04T01:38:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.587+0000 7fd94a7fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd94c0cd6d0 0x7fd94c161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41770/0 (socket says 172.21.15.114:41770) 2023-11-04T01:38:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.587+0000 7fd94a7fc640 1 -- 172.21.15.114:0/20520860 learned_addr learned my addr 172.21.15.114:0/20520860 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.587+0000 7fd949ffb640 1 -- 172.21.15.114:0/20520860 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803473972 0 0) 0x7fd94c0cde60 con 0x7fd94c0cd6d0 2023-11-04T01:38:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.587+0000 7fd949ffb640 1 -- 172.21.15.114:0/20520860 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd934003520 con 0x7fd94c0cd6d0 2023-11-04T01:38:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd94b7fe640 1 --2- 172.21.15.114:0/20520860 >> v2:172.21.15.141:3300/0 conn(0x7fd94c0b4880 0x7fd94c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd949ffb640 1 -- 172.21.15.114:0/20520860 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 15307803 0 0) 0x7fd934003520 con 0x7fd94c0cd6d0 2023-11-04T01:38:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd949ffb640 1 -- 172.21.15.114:0/20520860 >> v2:172.21.15.141:3300/0 conn(0x7fd94c0b4880 msgr2=0x7fd94c0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd949ffb640 1 --2- 172.21.15.114:0/20520860 >> v2:172.21.15.141:3300/0 conn(0x7fd94c0b4880 0x7fd94c0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd949ffb640 1 -- 172.21.15.114:0/20520860 >> v1:172.21.15.141:6789/0 conn(0x7fd94c153e60 legacy=0x7fd94c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd949ffb640 1 -- 172.21.15.114:0/20520860 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c0ce090 con 0x7fd94c0cd6d0 2023-11-04T01:38:47.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd949ffb640 1 -- 172.21.15.114:0/20520860 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fd940001670 con 0x7fd94c0cd6d0 2023-11-04T01:38:47.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd949ffb640 1 -- 172.21.15.114:0/20520860 >> v1:172.21.15.114:6789/0 conn(0x7fd94c0cd6d0 legacy=0x7fd94c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd949ffb640 1 --2- 172.21.15.114:0/20520860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd934003970 0x7fd934003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd949ffb640 1 --2- 172.21.15.114:0/20520860 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd9340047c0 0x7fd934004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd949ffb640 1 --2- 172.21.15.114:0/20520860 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd934005180 0x7fd93400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd949ffb640 1 -- 172.21.15.114:0/20520860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0b5200 con 0x7fd934003970 2023-11-04T01:38:47.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd949ffb640 1 -- 172.21.15.114:0/20520860 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93400c020 con 0x7fd934005180 2023-11-04T01:38:47.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd949ffb640 1 -- 172.21.15.114:0/20520860 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93400c1e0 con 0x7fd9340047c0 2023-11-04T01:38:47.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd94affd640 1 --2- 172.21.15.114:0/20520860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd934003970 0x7fd934003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd94a7fc640 1 --2- 172.21.15.114:0/20520860 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd9340047c0 0x7fd934004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd94b7fe640 1 --2- 172.21.15.114:0/20520860 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd934005180 0x7fd93400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd94affd640 1 -- 172.21.15.114:0/20520860 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd9340047c0 msgr2=0x7fd934004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd94affd640 1 --2- 172.21.15.114:0/20520860 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd9340047c0 0x7fd934004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd94affd640 1 -- 172.21.15.114:0/20520860 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd934005180 msgr2=0x7fd93400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd94affd640 1 --2- 172.21.15.114:0/20520860 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd934005180 0x7fd93400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd94affd640 1 -- 172.21.15.114:0/20520860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd934003520 con 0x7fd934003970 2023-11-04T01:38:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd94b7fe640 1 --2- 172.21.15.114:0/20520860 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd934005180 0x7fd93400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.588+0000 7fd94b7fe640 1 -- 172.21.15.114:0/20520860 reap_dead start 2023-11-04T01:38:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.589+0000 7fd94affd640 1 --2- 172.21.15.114:0/20520860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd934003970 0x7fd934003d90 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd93c001e50 tx=0x7fd9340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d738f7b9dd3f3705 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.589+0000 7fd949ffb640 1 -- 172.21.15.114:0/20520860 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c003b70 con 0x7fd934003970 2023-11-04T01:38:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.589+0000 7fd949ffb640 1 -- 172.21.15.114:0/20520860 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93c003cd0 con 0x7fd934003970 2023-11-04T01:38:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.589+0000 7fd949ffb640 1 -- 172.21.15.114:0/20520860 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c005310 con 0x7fd934003970 2023-11-04T01:38:47.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.590+0000 7fd951456640 1 -- 172.21.15.114:0/20520860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd934003970 msgr2=0x7fd934003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.590+0000 7fd951456640 1 --2- 172.21.15.114:0/20520860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd934003970 0x7fd934003d90 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd93c001e50 tx=0x7fd9340057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.590+0000 7fd951456640 1 -- 172.21.15.114:0/20520860 shutdown_connections 2023-11-04T01:38:47.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.590+0000 7fd951456640 1 --2- 172.21.15.114:0/20520860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd934003970 0x7fd934003d90 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.590+0000 7fd951456640 1 -- 172.21.15.114:0/20520860 >> 172.21.15.114:0/20520860 conn(0x7fd94c0cf880 msgr2=0x7fd94c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:47.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.590+0000 7fd951456640 1 -- 172.21.15.114:0/20520860 shutdown_connections 2023-11-04T01:38:47.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.590+0000 7fd951456640 1 -- 172.21.15.114:0/20520860 wait complete. 2023-11-04T01:38:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.591+0000 7fd951456640 1 Processor -- start 2023-11-04T01:38:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.591+0000 7fd951456640 1 -- start start 2023-11-04T01:38:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd951456640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd934003970 0x7fd94c152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd951456640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd94c0cbc50 0x7fd94c14fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd951456640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c0cc0d0 0x7fd94c150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd951456640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c1506c0 con 0x7fd94c0cc0d0 2023-11-04T01:38:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd951456640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0ca2b0 con 0x7fd94c0cbc50 2023-11-04T01:38:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd951456640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0ca590 con 0x7fd934003970 2023-11-04T01:38:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd94b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c0cc0d0 0x7fd94c150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd94b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c0cc0d0 0x7fd94c150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48298/0 (socket says 172.21.15.114:48298) 2023-11-04T01:38:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd94b7fe640 1 -- 172.21.15.114:0/3921278118 learned_addr learned my addr 172.21.15.114:0/3921278118 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd94a7fc640 1 --2- 172.21.15.114:0/3921278118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd94c0cbc50 0x7fd94c14fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd94affd640 1 --2- 172.21.15.114:0/3921278118 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd934003970 0x7fd94c152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd94b7fe640 1 -- 172.21.15.114:0/3921278118 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd934003970 msgr2=0x7fd94c152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd94b7fe640 1 --2- 172.21.15.114:0/3921278118 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd934003970 0x7fd94c152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd94b7fe640 1 -- 172.21.15.114:0/3921278118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd94c0cbc50 msgr2=0x7fd94c14fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd94b7fe640 1 --2- 172.21.15.114:0/3921278118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd94c0cbc50 0x7fd94c14fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd94b7fe640 1 -- 172.21.15.114:0/3921278118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c0ca870 con 0x7fd94c0cc0d0 2023-11-04T01:38:47.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd94b7fe640 1 --2- 172.21.15.114:0/3921278118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c0cc0d0 0x7fd94c150180 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd94c06c900 tx=0x7fd944011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd9337fe640 1 -- 172.21.15.114:0/3921278118 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944004440 con 0x7fd94c0cc0d0 2023-11-04T01:38:47.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd9337fe640 1 -- 172.21.15.114:0/3921278118 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd944003610 con 0x7fd94c0cc0d0 2023-11-04T01:38:47.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd951456640 1 -- 172.21.15.114:0/3921278118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94c0cab50 con 0x7fd94c0cc0d0 2023-11-04T01:38:47.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd9337fe640 1 -- 172.21.15.114:0/3921278118 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9440039c0 con 0x7fd94c0cc0d0 2023-11-04T01:38:47.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.592+0000 7fd951456640 1 -- 172.21.15.114:0/3921278118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94c0c9ed0 con 0x7fd94c0cc0d0 2023-11-04T01:38:47.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.594+0000 7fd951456640 1 -- 172.21.15.114:0/3921278118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd94c074290 con 0x7fd94c0cc0d0 2023-11-04T01:38:47.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.594+0000 7fd9337fe640 1 -- 172.21.15.114:0/3921278118 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd944003b20 con 0x7fd94c0cc0d0 2023-11-04T01:38:47.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.594+0000 7fd9337fe640 1 --2- 172.21.15.114:0/3921278118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd93806aea0 0x7fd93806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.594+0000 7fd9337fe640 1 -- 172.21.15.114:0/3921278118 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd9440892a0 con 0x7fd94c0cc0d0 2023-11-04T01:38:47.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.594+0000 7fd94affd640 1 --2- 172.21.15.114:0/3921278118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd93806aea0 0x7fd93806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.595+0000 7fd94affd640 1 --2- 172.21.15.114:0/3921278118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd93806aea0 0x7fd93806d360 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd93c034000 tx=0x7fd93c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.598+0000 7fd9337fe640 1 -- 172.21.15.114:0/3921278118 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd944054400 con 0x7fd94c0cc0d0 2023-11-04T01:38:47.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.764+0000 7fd951456640 1 -- 172.21.15.114:0/3921278118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd94c0d0b80 con 0x7fd94c0cc0d0 2023-11-04T01:38:47.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.764+0000 7fd9337fe640 1 -- 172.21.15.114:0/3921278118 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd944057a20 con 0x7fd94c0cc0d0 2023-11-04T01:38:47.766 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:38:47.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.766+0000 7fd951456640 1 -- 172.21.15.114:0/3921278118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd93806aea0 msgr2=0x7fd93806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.766+0000 7fd951456640 1 --2- 172.21.15.114:0/3921278118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd93806aea0 0x7fd93806d360 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd93c034000 tx=0x7fd93c009030 comp rx=0 tx=0).stop 2023-11-04T01:38:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.766+0000 7fd951456640 1 -- 172.21.15.114:0/3921278118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c0cc0d0 msgr2=0x7fd94c150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.766+0000 7fd951456640 1 --2- 172.21.15.114:0/3921278118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c0cc0d0 0x7fd94c150180 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd94c06c900 tx=0x7fd944011920 comp rx=0 tx=0).stop 2023-11-04T01:38:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.766+0000 7fd951456640 1 -- 172.21.15.114:0/3921278118 shutdown_connections 2023-11-04T01:38:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.766+0000 7fd951456640 1 --2- 172.21.15.114:0/3921278118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c0cc0d0 0x7fd94c150180 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.766+0000 7fd951456640 1 --2- 172.21.15.114:0/3921278118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd93806aea0 0x7fd93806d360 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.766+0000 7fd951456640 1 --2- 172.21.15.114:0/3921278118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd94c0cbc50 0x7fd94c14fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.766+0000 7fd951456640 1 --2- 172.21.15.114:0/3921278118 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd934003970 0x7fd94c152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.766+0000 7fd951456640 1 -- 172.21.15.114:0/3921278118 >> 172.21.15.114:0/3921278118 conn(0x7fd94c0cf880 msgr2=0x7fd94c15fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.766+0000 7fd951456640 1 -- 172.21.15.114:0/3921278118 shutdown_connections 2023-11-04T01:38:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.766+0000 7fd951456640 1 -- 172.21.15.114:0/3921278118 wait complete. 2023-11-04T01:38:47.779 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:38:47.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.880+0000 7f1319589640 1 Processor -- start 2023-11-04T01:38:47.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.880+0000 7f1319589640 1 -- start start 2023-11-04T01:38:47.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.881+0000 7f1319589640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13140cdc20 0x7f1314165950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.881+0000 7f1319589640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13140d0280 con 0x7f131415e430 2023-11-04T01:38:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.881+0000 7f1319589640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13140cf670 con 0x7f13140d0710 2023-11-04T01:38:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.881+0000 7f1319589640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13140cf950 con 0x7f13140cdc20 2023-11-04T01:38:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.881+0000 7f1312ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f131415e430 0x7f13140cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41772/0 (socket says 172.21.15.114:41772) 2023-11-04T01:38:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.881+0000 7f1312ffd640 1 -- 172.21.15.114:0/200985636 learned_addr learned my addr 172.21.15.114:0/200985636 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.881+0000 7f1311ffb640 1 -- 172.21.15.114:0/200985636 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828520860 0 0) 0x7f13140d0280 con 0x7f131415e430 2023-11-04T01:38:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.881+0000 7f1311ffb640 1 -- 172.21.15.114:0/200985636 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12fc003520 con 0x7f131415e430 2023-11-04T01:38:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.881+0000 7f13137fe640 1 --2- 172.21.15.114:0/200985636 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13140cdc20 0x7f1314165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.881+0000 7f1311ffb640 1 -- 172.21.15.114:0/200985636 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2374158385 0 0) 0x7f12fc003520 con 0x7f131415e430 2023-11-04T01:38:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.881+0000 7f1311ffb640 1 -- 172.21.15.114:0/200985636 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13140cdc20 msgr2=0x7f1314165950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f1311ffb640 1 --2- 172.21.15.114:0/200985636 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13140cdc20 0x7f1314165950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f1311ffb640 1 -- 172.21.15.114:0/200985636 >> v1:172.21.15.141:6789/0 conn(0x7f13140d0710 legacy=0x7f13140cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f1311ffb640 1 -- 172.21.15.114:0/200985636 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13140cfc30 con 0x7f131415e430 2023-11-04T01:38:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f1311ffb640 1 -- 172.21.15.114:0/200985636 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f1304001670 con 0x7f131415e430 2023-11-04T01:38:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f1311ffb640 1 -- 172.21.15.114:0/200985636 >> v1:172.21.15.114:6789/0 conn(0x7f131415e430 legacy=0x7f13140cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f1311ffb640 1 --2- 172.21.15.114:0/200985636 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12fc0039a0 0x7f12fc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f1311ffb640 1 --2- 172.21.15.114:0/200985636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12fc0047c0 0x7f12fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f1311ffb640 1 --2- 172.21.15.114:0/200985636 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13140cdc20 0x7f12fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f1311ffb640 1 -- 172.21.15.114:0/200985636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13140cf950 con 0x7f12fc0047c0 2023-11-04T01:38:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f1311ffb640 1 -- 172.21.15.114:0/200985636 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc00bae0 con 0x7f12fc0039a0 2023-11-04T01:38:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f1311ffb640 1 -- 172.21.15.114:0/200985636 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc00bca0 con 0x7f13140cdc20 2023-11-04T01:38:47.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f13127fc640 1 --2- 172.21.15.114:0/200985636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12fc0047c0 0x7f12fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f1312ffd640 1 --2- 172.21.15.114:0/200985636 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12fc0039a0 0x7f12fc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f13137fe640 1 --2- 172.21.15.114:0/200985636 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13140cdc20 0x7f12fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f13127fc640 1 -- 172.21.15.114:0/200985636 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13140cdc20 msgr2=0x7f12fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f13127fc640 1 --2- 172.21.15.114:0/200985636 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13140cdc20 0x7f12fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f13127fc640 1 -- 172.21.15.114:0/200985636 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12fc0039a0 msgr2=0x7f12fc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:47.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f13127fc640 1 --2- 172.21.15.114:0/200985636 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12fc0039a0 0x7f12fc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f13127fc640 1 -- 172.21.15.114:0/200985636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc003520 con 0x7f12fc0047c0 2023-11-04T01:38:47.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.882+0000 7f1312ffd640 1 --2- 172.21.15.114:0/200985636 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12fc0039a0 0x7f12fc003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:47.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.883+0000 7f13127fc640 1 --2- 172.21.15.114:0/200985636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12fc0047c0 0x7f12fc004c40 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1308001750 tx=0x7f12fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ea353f6ef5aaa5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.883+0000 7f1311ffb640 1 -- 172.21.15.114:0/200985636 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080052d0 con 0x7f12fc0047c0 2023-11-04T01:38:47.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.883+0000 7f1311ffb640 1 -- 172.21.15.114:0/200985636 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130802e050 con 0x7f12fc0047c0 2023-11-04T01:38:47.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.883+0000 7f1311ffb640 1 -- 172.21.15.114:0/200985636 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080035f0 con 0x7f12fc0047c0 2023-11-04T01:38:47.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.883+0000 7f1319589640 1 -- 172.21.15.114:0/200985636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12fc0047c0 msgr2=0x7f12fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.883+0000 7f1319589640 1 --2- 172.21.15.114:0/200985636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12fc0047c0 0x7f12fc004c40 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1308001750 tx=0x7f12fc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.883+0000 7f13137fe640 1 -- 172.21.15.114:0/200985636 reap_dead start 2023-11-04T01:38:47.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.883+0000 7f1319589640 1 -- 172.21.15.114:0/200985636 shutdown_connections 2023-11-04T01:38:47.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.883+0000 7f1319589640 1 -- 172.21.15.114:0/200985636 >> 172.21.15.114:0/200985636 conn(0x7f131406ea20 msgr2=0x7f131406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:47.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.883+0000 7f1319589640 1 -- 172.21.15.114:0/200985636 shutdown_connections 2023-11-04T01:38:47.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.883+0000 7f1319589640 1 -- 172.21.15.114:0/200985636 wait complete. 2023-11-04T01:38:47.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.885+0000 7f1319589640 1 Processor -- start 2023-11-04T01:38:47.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.885+0000 7f1319589640 1 -- start start 2023-11-04T01:38:47.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.885+0000 7f1319589640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12fc0047c0 0x7f13141574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.885+0000 7f1319589640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1314157c50 0x7f13140ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.885+0000 7f1319589640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13140c5ca0 0x7f13140b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.885+0000 7f1319589640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13140c9120 con 0x7f1314157c50 2023-11-04T01:38:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.885+0000 7f1319589640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13140c9400 con 0x7f12fc0047c0 2023-11-04T01:38:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.885+0000 7f1319589640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13140c96e0 con 0x7f13140c5ca0 2023-11-04T01:38:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.886+0000 7f13127fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1314157c50 0x7f13140ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.886+0000 7f13127fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1314157c50 0x7f13140ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48318/0 (socket says 172.21.15.114:48318) 2023-11-04T01:38:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.886+0000 7f13127fc640 1 -- 172.21.15.114:0/3629892573 learned_addr learned my addr 172.21.15.114:0/3629892573 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.886+0000 7f1312ffd640 1 --2- 172.21.15.114:0/3629892573 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12fc0047c0 0x7f13141574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.886+0000 7f13137fe640 1 --2- 172.21.15.114:0/3629892573 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13140c5ca0 0x7f13140b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.886+0000 7f13127fc640 1 -- 172.21.15.114:0/3629892573 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13140c5ca0 msgr2=0x7f13140b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.886+0000 7f13127fc640 1 --2- 172.21.15.114:0/3629892573 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13140c5ca0 0x7f13140b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.886+0000 7f13127fc640 1 -- 172.21.15.114:0/3629892573 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12fc0047c0 msgr2=0x7f13141574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.886+0000 7f13127fc640 1 --2- 172.21.15.114:0/3629892573 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12fc0047c0 0x7f13141574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.886+0000 7f13127fc640 1 -- 172.21.15.114:0/3629892573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13140c99c0 con 0x7f1314157c50 2023-11-04T01:38:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.886+0000 7f13127fc640 1 --2- 172.21.15.114:0/3629892573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1314157c50 0x7f13140ca4a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1308008fd0 tx=0x7f1308001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.886+0000 7f12fb7fe640 1 -- 172.21.15.114:0/3629892573 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080076c0 con 0x7f1314157c50 2023-11-04T01:38:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.886+0000 7f12fb7fe640 1 -- 172.21.15.114:0/3629892573 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1308007a30 con 0x7f1314157c50 2023-11-04T01:38:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.886+0000 7f1319589640 1 -- 172.21.15.114:0/3629892573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13140c9ca0 con 0x7f1314157c50 2023-11-04T01:38:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.886+0000 7f12fb7fe640 1 -- 172.21.15.114:0/3629892573 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308006c00 con 0x7f1314157c50 2023-11-04T01:38:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.886+0000 7f1319589640 1 -- 172.21.15.114:0/3629892573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13141579e0 con 0x7f1314157c50 2023-11-04T01:38:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.887+0000 7f1319589640 1 -- 172.21.15.114:0/3629892573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1314074290 con 0x7f1314157c50 2023-11-04T01:38:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.888+0000 7f12fb7fe640 1 -- 172.21.15.114:0/3629892573 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f13080035f0 con 0x7f1314157c50 2023-11-04T01:38:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.888+0000 7f12fb7fe640 1 --2- 172.21.15.114:0/3629892573 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f130006aea0 0x7f130006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.888+0000 7f12fb7fe640 1 -- 172.21.15.114:0/3629892573 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f13080ab540 con 0x7f1314157c50 2023-11-04T01:38:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.888+0000 7f1312ffd640 1 --2- 172.21.15.114:0/3629892573 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f130006aea0 0x7f130006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.888+0000 7f1312ffd640 1 --2- 172.21.15.114:0/3629892573 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f130006aea0 0x7f130006d360 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1304001c90 tx=0x7f1304007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:47.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:47.892+0000 7f12fb7fe640 1 -- 172.21.15.114:0/3629892573 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1308076870 con 0x7f1314157c50 2023-11-04T01:38:48.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.060+0000 7f1319589640 1 -- 172.21.15.114:0/3629892573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f131415ce00 con 0x7f1314157c50 2023-11-04T01:38:48.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.061+0000 7f12fb7fe640 1 -- 172.21.15.114:0/3629892573 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v62) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1308079e90 con 0x7f1314157c50 2023-11-04T01:38:48.062 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:38:48.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.062+0000 7f1319589640 1 -- 172.21.15.114:0/3629892573 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f130006aea0 msgr2=0x7f130006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.062+0000 7f1319589640 1 --2- 172.21.15.114:0/3629892573 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f130006aea0 0x7f130006d360 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1304001c90 tx=0x7f1304007040 comp rx=0 tx=0).stop 2023-11-04T01:38:48.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.062+0000 7f1319589640 1 -- 172.21.15.114:0/3629892573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1314157c50 msgr2=0x7f13140ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.062+0000 7f1319589640 1 --2- 172.21.15.114:0/3629892573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1314157c50 0x7f13140ca4a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1308008fd0 tx=0x7f1308001120 comp rx=0 tx=0).stop 2023-11-04T01:38:48.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.062+0000 7f1319589640 1 -- 172.21.15.114:0/3629892573 shutdown_connections 2023-11-04T01:38:48.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.062+0000 7f1319589640 1 --2- 172.21.15.114:0/3629892573 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13140c5ca0 0x7f13140b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.062+0000 7f1319589640 1 --2- 172.21.15.114:0/3629892573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1314157c50 0x7f13140ca4a0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.062+0000 7f1319589640 1 --2- 172.21.15.114:0/3629892573 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f130006aea0 0x7f130006d360 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.062+0000 7f1319589640 1 --2- 172.21.15.114:0/3629892573 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f12fc0047c0 0x7f13141574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.062+0000 7f1319589640 1 -- 172.21.15.114:0/3629892573 >> 172.21.15.114:0/3629892573 conn(0x7f131406ea20 msgr2=0x7f131415b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:48.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.062+0000 7f1319589640 1 -- 172.21.15.114:0/3629892573 shutdown_connections 2023-11-04T01:38:48.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.062+0000 7f1319589640 1 -- 172.21.15.114:0/3629892573 wait complete. 2023-11-04T01:38:48.075 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:38:48.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.173+0000 7f6674b00640 1 Processor -- start 2023-11-04T01:38:48.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.173+0000 7f6674b00640 1 -- start start 2023-11-04T01:38:48.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f6674b00640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66700cce90 0x7f6670070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f6674b00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6670071500 con 0x7f667015cf30 2023-11-04T01:38:48.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f6674b00640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66700717e0 con 0x7f66700b07f0 2023-11-04T01:38:48.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f6674b00640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66700c9e00 con 0x7f66700cce90 2023-11-04T01:38:48.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666e59c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f667015cf30 0x7f667006cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41778/0 (socket says 172.21.15.114:41778) 2023-11-04T01:38:48.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666e59c640 1 -- 172.21.15.114:0/3556961181 learned_addr learned my addr 172.21.15.114:0/3556961181 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:48.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666dd9b640 1 -- 172.21.15.114:0/3556961181 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800764728 0 0) 0x7f6670071500 con 0x7f667015cf30 2023-11-04T01:38:48.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666dd9b640 1 -- 172.21.15.114:0/3556961181 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f665c003520 con 0x7f667015cf30 2023-11-04T01:38:48.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f6667fff640 1 --2- 172.21.15.114:0/3556961181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66700cce90 0x7f6670070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666dd9b640 1 -- 172.21.15.114:0/3556961181 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 152789630 0 0) 0x7f665c003520 con 0x7f667015cf30 2023-11-04T01:38:48.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666dd9b640 1 -- 172.21.15.114:0/3556961181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66700cce90 msgr2=0x7f6670070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666dd9b640 1 --2- 172.21.15.114:0/3556961181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66700cce90 0x7f6670070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666dd9b640 1 -- 172.21.15.114:0/3556961181 >> v1:172.21.15.141:6789/0 conn(0x7f66700b07f0 legacy=0x7f66700ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666dd9b640 1 -- 172.21.15.114:0/3556961181 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6670071ac0 con 0x7f667015cf30 2023-11-04T01:38:48.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666dd9b640 1 -- 172.21.15.114:0/3556961181 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f6660001670 con 0x7f667015cf30 2023-11-04T01:38:48.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f6667fff640 1 --2- 172.21.15.114:0/3556961181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66700cce90 0x7f6670070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:48.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666dd9b640 1 -- 172.21.15.114:0/3556961181 >> v1:172.21.15.114:6789/0 conn(0x7f667015cf30 legacy=0x7f667006cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666dd9b640 1 --2- 172.21.15.114:0/3556961181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66700cce90 0x7f665c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666dd9b640 1 --2- 172.21.15.114:0/3556961181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f665c003f90 0x7f665c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666dd9b640 1 --2- 172.21.15.114:0/3556961181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f665c004d00 0x7f665c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666dd9b640 1 -- 172.21.15.114:0/3556961181 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66700c9e00 con 0x7f665c004d00 2023-11-04T01:38:48.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666dd9b640 1 -- 172.21.15.114:0/3556961181 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c00bb70 con 0x7f665c003f90 2023-11-04T01:38:48.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.174+0000 7f666dd9b640 1 -- 172.21.15.114:0/3556961181 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665c00bd30 con 0x7f66700cce90 2023-11-04T01:38:48.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.175+0000 7f666ed9d640 1 --2- 172.21.15.114:0/3556961181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f665c004d00 0x7f665c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.175+0000 7f666e59c640 1 --2- 172.21.15.114:0/3556961181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66700cce90 0x7f665c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.175+0000 7f6667fff640 1 --2- 172.21.15.114:0/3556961181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f665c003f90 0x7f665c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.175+0000 7f666ed9d640 1 -- 172.21.15.114:0/3556961181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66700cce90 msgr2=0x7f665c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.175+0000 7f666ed9d640 1 --2- 172.21.15.114:0/3556961181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66700cce90 0x7f665c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.175+0000 7f666ed9d640 1 -- 172.21.15.114:0/3556961181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f665c003f90 msgr2=0x7f665c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.175+0000 7f666ed9d640 1 --2- 172.21.15.114:0/3556961181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f665c003f90 0x7f665c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.175+0000 7f666ed9d640 1 -- 172.21.15.114:0/3556961181 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665c003520 con 0x7f665c004d00 2023-11-04T01:38:48.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.176+0000 7f666ed9d640 1 --2- 172.21.15.114:0/3556961181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f665c004d00 0x7f665c005180 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6668001e50 tx=0x7f665c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f560199b1aeb6b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.176+0000 7f666dd9b640 1 -- 172.21.15.114:0/3556961181 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668003b70 con 0x7f665c004d00 2023-11-04T01:38:48.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.176+0000 7f666dd9b640 1 -- 172.21.15.114:0/3556961181 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6668003cd0 con 0x7f665c004d00 2023-11-04T01:38:48.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.176+0000 7f666dd9b640 1 -- 172.21.15.114:0/3556961181 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668005310 con 0x7f665c004d00 2023-11-04T01:38:48.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.176+0000 7f6674b00640 1 -- 172.21.15.114:0/3556961181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f665c004d00 msgr2=0x7f665c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.176+0000 7f6674b00640 1 --2- 172.21.15.114:0/3556961181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f665c004d00 0x7f665c005180 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6668001e50 tx=0x7f665c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.176+0000 7f666ed9d640 1 -- 172.21.15.114:0/3556961181 reap_dead start 2023-11-04T01:38:48.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.176+0000 7f6674b00640 1 -- 172.21.15.114:0/3556961181 shutdown_connections 2023-11-04T01:38:48.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.176+0000 7f6674b00640 1 -- 172.21.15.114:0/3556961181 >> 172.21.15.114:0/3556961181 conn(0x7f66700cb7f0 msgr2=0x7f66700cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:48.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.176+0000 7f6674b00640 1 -- 172.21.15.114:0/3556961181 shutdown_connections 2023-11-04T01:38:48.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.176+0000 7f6674b00640 1 -- 172.21.15.114:0/3556961181 wait complete. 2023-11-04T01:38:48.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.178+0000 7f6674b00640 1 Processor -- start 2023-11-04T01:38:48.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.178+0000 7f6674b00640 1 -- start start 2023-11-04T01:38:48.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.178+0000 7f6674b00640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6670150540 0x7f66700c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.178+0000 7f6674b00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6670150920 0x7f66700b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.178+0000 7f6674b00640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66700b1ed0 0x7f667015ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.178+0000 7f6674b00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66700c8dc0 con 0x7f6670150920 2023-11-04T01:38:48.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.178+0000 7f6674b00640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66700c5e40 con 0x7f66700b1ed0 2023-11-04T01:38:48.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.178+0000 7f6674b00640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667015e6e0 con 0x7f6670150540 2023-11-04T01:38:48.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.178+0000 7f6667fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6670150920 0x7f66700b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.179+0000 7f6667fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6670150920 0x7f66700b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48336/0 (socket says 172.21.15.114:48336) 2023-11-04T01:38:48.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.179+0000 7f6667fff640 1 -- 172.21.15.114:0/2442691860 learned_addr learned my addr 172.21.15.114:0/2442691860 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:48.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.179+0000 7f666ed9d640 1 --2- 172.21.15.114:0/2442691860 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66700b1ed0 0x7f667015ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.179+0000 7f666e59c640 1 --2- 172.21.15.114:0/2442691860 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6670150540 0x7f66700c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.179+0000 7f6667fff640 1 -- 172.21.15.114:0/2442691860 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6670150540 msgr2=0x7f66700c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.179+0000 7f6667fff640 1 --2- 172.21.15.114:0/2442691860 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6670150540 0x7f66700c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.179+0000 7f6667fff640 1 -- 172.21.15.114:0/2442691860 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66700b1ed0 msgr2=0x7f667015ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.179+0000 7f6667fff640 1 --2- 172.21.15.114:0/2442691860 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66700b1ed0 0x7f667015ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.179+0000 7f6667fff640 1 -- 172.21.15.114:0/2442691860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667015d490 con 0x7f6670150920 2023-11-04T01:38:48.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.179+0000 7f666ed9d640 1 --2- 172.21.15.114:0/2442691860 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66700b1ed0 0x7f667015ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:48.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.179+0000 7f6667fff640 1 --2- 172.21.15.114:0/2442691860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6670150920 0x7f66700b1990 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6658011620 tx=0x7f6658011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.179+0000 7f6666ffd640 1 -- 172.21.15.114:0/2442691860 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665800c070 con 0x7f6670150920 2023-11-04T01:38:48.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.179+0000 7f6666ffd640 1 -- 172.21.15.114:0/2442691860 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6658004220 con 0x7f6670150920 2023-11-04T01:38:48.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.179+0000 7f6674b00640 1 -- 172.21.15.114:0/2442691860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66700c6090 con 0x7f6670150920 2023-11-04T01:38:48.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.179+0000 7f6666ffd640 1 -- 172.21.15.114:0/2442691860 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665800f6c0 con 0x7f6670150920 2023-11-04T01:38:48.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.179+0000 7f6674b00640 1 -- 172.21.15.114:0/2442691860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667015e930 con 0x7f6670150920 2023-11-04T01:38:48.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.180+0000 7f6674b00640 1 -- 172.21.15.114:0/2442691860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66700ce9f0 con 0x7f6670150920 2023-11-04T01:38:48.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.181+0000 7f6666ffd640 1 -- 172.21.15.114:0/2442691860 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f665800f820 con 0x7f6670150920 2023-11-04T01:38:48.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.181+0000 7f6666ffd640 1 --2- 172.21.15.114:0/2442691860 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f665006ae70 0x7f665006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.181+0000 7f6666ffd640 1 -- 172.21.15.114:0/2442691860 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f6658089480 con 0x7f6670150920 2023-11-04T01:38:48.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.181+0000 7f666e59c640 1 --2- 172.21.15.114:0/2442691860 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f665006ae70 0x7f665006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.181+0000 7f666e59c640 1 --2- 172.21.15.114:0/2442691860 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f665006ae70 0x7f665006d330 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6660001200 tx=0x7f6660001150 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.185+0000 7f6666ffd640 1 -- 172.21.15.114:0/2442691860 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6658054690 con 0x7f6670150920 2023-11-04T01:38:48.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.353+0000 7f6674b00640 1 -- 172.21.15.114:0/2442691860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6670074290 con 0x7f6670150920 2023-11-04T01:38:48.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.354+0000 7f6666ffd640 1 -- 172.21.15.114:0/2442691860 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v62) v1 ==== 84+0+137 (secure 0 0 0) 0x7f6658057cb0 con 0x7f6670150920 2023-11-04T01:38:48.356 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:48.356 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2023-11-04T01:38:48.356 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:48.356 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2023-11-04T01:38:48.356 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2023-11-04T01:38:48.356 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:48.357 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:38:48.357 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 7, 2023-11-04T01:38:48.357 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "snap-test-pool" 2023-11-04T01:38:48.357 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:48.357 INFO:teuthology.orchestra.run.smithi114.stdout:] 2023-11-04T01:38:48.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.356+0000 7f6674b00640 1 -- 172.21.15.114:0/2442691860 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f665006ae70 msgr2=0x7f665006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.356+0000 7f6674b00640 1 --2- 172.21.15.114:0/2442691860 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f665006ae70 0x7f665006d330 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6660001200 tx=0x7f6660001150 comp rx=0 tx=0).stop 2023-11-04T01:38:48.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.356+0000 7f6674b00640 1 -- 172.21.15.114:0/2442691860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6670150920 msgr2=0x7f66700b1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.356+0000 7f6674b00640 1 --2- 172.21.15.114:0/2442691860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6670150920 0x7f66700b1990 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6658011620 tx=0x7f6658011ae0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.356+0000 7f6674b00640 1 -- 172.21.15.114:0/2442691860 shutdown_connections 2023-11-04T01:38:48.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.356+0000 7f6674b00640 1 --2- 172.21.15.114:0/2442691860 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f665006ae70 0x7f665006d330 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.356+0000 7f6674b00640 1 --2- 172.21.15.114:0/2442691860 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66700b1ed0 0x7f667015ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.356+0000 7f6674b00640 1 --2- 172.21.15.114:0/2442691860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6670150920 0x7f66700b1990 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.356+0000 7f6674b00640 1 --2- 172.21.15.114:0/2442691860 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6670150540 0x7f66700c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.356+0000 7f6674b00640 1 -- 172.21.15.114:0/2442691860 >> 172.21.15.114:0/2442691860 conn(0x7f66700cb7f0 msgr2=0x7f66700cafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:48.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.356+0000 7f6674b00640 1 -- 172.21.15.114:0/2442691860 shutdown_connections 2023-11-04T01:38:48.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.356+0000 7f6674b00640 1 -- 172.21.15.114:0/2442691860 wait complete. 2023-11-04T01:38:48.369 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:38:48.369 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:38:48.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.469+0000 7f7655b61640 1 Processor -- start 2023-11-04T01:38:48.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.469+0000 7f7655b61640 1 -- start start 2023-11-04T01:38:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.470+0000 7f7655b61640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f765015d4b0 0x7f765015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.470+0000 7f7655b61640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f76500d17b0 0x7f76500d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.470+0000 7f7655b61640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76500d1320 con 0x7f76500cd9f0 2023-11-04T01:38:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.470+0000 7f7655b61640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765015e4d0 con 0x7f765015d4b0 2023-11-04T01:38:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.470+0000 7f7655b61640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765015df10 con 0x7f76500d17b0 2023-11-04T01:38:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.470+0000 7f764effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f765015d4b0 0x7f765015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.470+0000 7f764effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f765015d4b0 0x7f765015d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48344/0 (socket says 172.21.15.114:48344) 2023-11-04T01:38:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.470+0000 7f764effd640 1 -- 172.21.15.114:0/2864010758 learned_addr learned my addr 172.21.15.114:0/2864010758 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.471+0000 7f764ffff640 1 --2- 172.21.15.114:0/2864010758 >> v2:172.21.15.141:3300/0 conn(0x7f76500d17b0 0x7f76500d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.471+0000 7f764effd640 1 -- 172.21.15.114:0/2864010758 >> v2:172.21.15.141:3300/0 conn(0x7f76500d17b0 msgr2=0x7f76500d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.471+0000 7f764effd640 1 --2- 172.21.15.114:0/2864010758 >> v2:172.21.15.141:3300/0 conn(0x7f76500d17b0 0x7f76500d1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.471+0000 7f764effd640 1 -- 172.21.15.114:0/2864010758 >> v1:172.21.15.141:6789/0 conn(0x7f76500cd9f0 legacy=0x7f76500cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.471+0000 7f764effd640 1 -- 172.21.15.114:0/2864010758 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765015e1f0 con 0x7f765015d4b0 2023-11-04T01:38:48.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.471+0000 7f764ffff640 1 --2- 172.21.15.114:0/2864010758 >> v2:172.21.15.141:3300/0 conn(0x7f76500d17b0 0x7f76500d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:48.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.471+0000 7f764effd640 1 --2- 172.21.15.114:0/2864010758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765015d4b0 0x7f765015d910 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7644009870 tx=0x7f764402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411f820b72a88193 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.472+0000 7f764e7fc640 1 -- 172.21.15.114:0/2864010758 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644030860 con 0x7f765015d4b0 2023-11-04T01:38:48.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.472+0000 7f764e7fc640 1 -- 172.21.15.114:0/2864010758 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76440309c0 con 0x7f765015d4b0 2023-11-04T01:38:48.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.472+0000 7f764e7fc640 1 -- 172.21.15.114:0/2864010758 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644030d50 con 0x7f765015d4b0 2023-11-04T01:38:48.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.472+0000 7f7655b61640 1 -- 172.21.15.114:0/2864010758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765015d4b0 msgr2=0x7f765015d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.472+0000 7f7655b61640 1 --2- 172.21.15.114:0/2864010758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765015d4b0 0x7f765015d910 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7644009870 tx=0x7f764402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.472+0000 7f7655b61640 1 -- 172.21.15.114:0/2864010758 shutdown_connections 2023-11-04T01:38:48.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.472+0000 7f7655b61640 1 --2- 172.21.15.114:0/2864010758 >> v2:172.21.15.141:3300/0 conn(0x7f76500d17b0 0x7f76500d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.472+0000 7f7655b61640 1 --2- 172.21.15.114:0/2864010758 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765015d4b0 0x7f765015d910 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.472+0000 7f7655b61640 1 -- 172.21.15.114:0/2864010758 >> 172.21.15.114:0/2864010758 conn(0x7f7650071c40 msgr2=0x7f7650072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:48.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.472+0000 7f7655b61640 1 -- 172.21.15.114:0/2864010758 shutdown_connections 2023-11-04T01:38:48.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.472+0000 7f7655b61640 1 -- 172.21.15.114:0/2864010758 wait complete. 2023-11-04T01:38:48.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.473+0000 7f7655b61640 1 Processor -- start 2023-11-04T01:38:48.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.474+0000 7f7655b61640 1 -- start start 2023-11-04T01:38:48.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.474+0000 7f7655b61640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76500cd9f0 0x7f765014b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.474+0000 7f7655b61640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76500d17b0 0x7f7650159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.474+0000 7f7655b61640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765015d4b0 0x7f765015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.474+0000 7f7655b61640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76500caee0 con 0x7f765015d4b0 2023-11-04T01:38:48.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.474+0000 7f7655b61640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76500cb1c0 con 0x7f76500d17b0 2023-11-04T01:38:48.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.474+0000 7f7655b61640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76500cb4a0 con 0x7f76500cd9f0 2023-11-04T01:38:48.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.474+0000 7f764ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765015d4b0 0x7f765015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.474+0000 7f764ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765015d4b0 0x7f765015c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48360/0 (socket says 172.21.15.114:48360) 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.474+0000 7f764ffff640 1 -- 172.21.15.114:0/75160660 learned_addr learned my addr 172.21.15.114:0/75160660 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.474+0000 7f764effd640 1 --2- 172.21.15.114:0/75160660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76500d17b0 0x7f7650159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.474+0000 7f764f7fe640 1 --2- 172.21.15.114:0/75160660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76500cd9f0 0x7f765014b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.475+0000 7f764ffff640 1 -- 172.21.15.114:0/75160660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76500cd9f0 msgr2=0x7f765014b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.475+0000 7f764ffff640 1 --2- 172.21.15.114:0/75160660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76500cd9f0 0x7f765014b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.475+0000 7f764ffff640 1 -- 172.21.15.114:0/75160660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76500d17b0 msgr2=0x7f7650159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.475+0000 7f764ffff640 1 --2- 172.21.15.114:0/75160660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76500d17b0 0x7f7650159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.475+0000 7f764ffff640 1 -- 172.21.15.114:0/75160660 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76440094d0 con 0x7f765015d4b0 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.475+0000 7f764effd640 1 --2- 172.21.15.114:0/75160660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76500d17b0 0x7f7650159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.475+0000 7f764ffff640 1 --2- 172.21.15.114:0/75160660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765015d4b0 0x7f765015c540 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f764800c7f0 tx=0x7f764800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.475+0000 7f7637fff640 1 -- 172.21.15.114:0/75160660 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648007820 con 0x7f765015d4b0 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.475+0000 7f7637fff640 1 -- 172.21.15.114:0/75160660 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7648007980 con 0x7f765015d4b0 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.475+0000 7f7655b61640 1 -- 172.21.15.114:0/75160660 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76500cb780 con 0x7f765015d4b0 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.475+0000 7f7637fff640 1 -- 172.21.15.114:0/75160660 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648007d70 con 0x7f765015d4b0 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.475+0000 7f7655b61640 1 -- 172.21.15.114:0/75160660 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76500cc860 con 0x7f765015d4b0 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.476+0000 7f7655b61640 1 -- 172.21.15.114:0/75160660 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76500cb970 con 0x7f765015d4b0 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.476+0000 7f7637fff640 1 -- 172.21.15.114:0/75160660 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f76480113f0 con 0x7f765015d4b0 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.477+0000 7f7637fff640 1 --2- 172.21.15.114:0/75160660 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f763c06ae70 0x7f763c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.477+0000 7f7637fff640 1 -- 172.21.15.114:0/75160660 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7648089930 con 0x7f765015d4b0 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.477+0000 7f764f7fe640 1 --2- 172.21.15.114:0/75160660 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f763c06ae70 0x7f763c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.477+0000 7f764f7fe640 1 --2- 172.21.15.114:0/75160660 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f763c06ae70 0x7f763c06d330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7640005520 tx=0x7f7640009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.481+0000 7f7637fff640 1 -- 172.21.15.114:0/75160660 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7648054a10 con 0x7f765015d4b0 2023-11-04T01:38:48.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.646+0000 7f7655b61640 1 -- 172.21.15.114:0/75160660 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f76500cb020 con 0x7f765015d4b0 2023-11-04T01:38:48.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.816+0000 7f7637fff640 1 -- 172.21.15.114:0/75160660 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v63) v1 ==== 138+0+0 (secure 0 0 0) 0x7f76500cb020 con 0x7f765015d4b0 2023-11-04T01:38:48.818 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2023-11-04T01:38:48.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.818+0000 7f7655b61640 1 -- 172.21.15.114:0/75160660 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f763c06ae70 msgr2=0x7f763c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.818+0000 7f7655b61640 1 --2- 172.21.15.114:0/75160660 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f763c06ae70 0x7f763c06d330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7640005520 tx=0x7f7640009040 comp rx=0 tx=0).stop 2023-11-04T01:38:48.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.818+0000 7f7655b61640 1 -- 172.21.15.114:0/75160660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765015d4b0 msgr2=0x7f765015c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.818+0000 7f7655b61640 1 --2- 172.21.15.114:0/75160660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765015d4b0 0x7f765015c540 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f764800c7f0 tx=0x7f764800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.818+0000 7f7655b61640 1 -- 172.21.15.114:0/75160660 shutdown_connections 2023-11-04T01:38:48.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.818+0000 7f7655b61640 1 --2- 172.21.15.114:0/75160660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765015d4b0 0x7f765015c540 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.818+0000 7f7655b61640 1 --2- 172.21.15.114:0/75160660 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f763c06ae70 0x7f763c06d330 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.818+0000 7f7655b61640 1 --2- 172.21.15.114:0/75160660 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f76500d17b0 0x7f7650159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.818+0000 7f7655b61640 1 --2- 172.21.15.114:0/75160660 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f76500cd9f0 0x7f765014b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.818+0000 7f7655b61640 1 -- 172.21.15.114:0/75160660 >> 172.21.15.114:0/75160660 conn(0x7f7650071c40 msgr2=0x7f76500cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:48.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.818+0000 7f7655b61640 1 -- 172.21.15.114:0/75160660 shutdown_connections 2023-11-04T01:38:48.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.818+0000 7f7655b61640 1 -- 172.21.15.114:0/75160660 wait complete. 2023-11-04T01:38:48.834 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:38:48.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.939+0000 7f7b5b939640 1 Processor -- start 2023-11-04T01:38:48.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.939+0000 7f7b5b939640 1 -- start start 2023-11-04T01:38:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.940+0000 7f7b5b939640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7b54159c00 0x7f7b540cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.940+0000 7f7b5b939640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b540ae1d0 0x7f7b540c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.940+0000 7f7b5b939640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5415aff0 con 0x7f7b540c48e0 2023-11-04T01:38:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.940+0000 7f7b5b939640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b540c52d0 con 0x7f7b54159c00 2023-11-04T01:38:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.940+0000 7f7b5b939640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5415a3e0 con 0x7f7b540ae1d0 2023-11-04T01:38:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.941+0000 7f7b59ed6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b540ae1d0 0x7f7b540c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.941+0000 7f7b596d5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7b54159c00 0x7f7b540cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.941+0000 7f7b58ed4640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f7b540c48e0 0x7f7b540adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:57148/0 (socket says 172.21.15.114:57148) 2023-11-04T01:38:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.941+0000 7f7b59ed6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b540ae1d0 0x7f7b540c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:44894/0 (socket says 172.21.15.114:44894) 2023-11-04T01:38:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.941+0000 7f7b58ed4640 1 -- 172.21.15.114:0/2858484015 learned_addr learned my addr 172.21.15.114:0/2858484015 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.941+0000 7f7b596d5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7b54159c00 0x7f7b540cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:60470/0 (socket says 172.21.15.114:60470) 2023-11-04T01:38:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.941+0000 7f7b59ed6640 1 -- 172.21.15.114:0/2858484015 >> v2:172.21.15.141:3300/0 conn(0x7f7b54159c00 msgr2=0x7f7b540cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.941+0000 7f7b59ed6640 1 --2- 172.21.15.114:0/2858484015 >> v2:172.21.15.141:3300/0 conn(0x7f7b54159c00 0x7f7b540cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.941+0000 7f7b59ed6640 1 -- 172.21.15.114:0/2858484015 >> v1:172.21.15.141:6789/0 conn(0x7f7b540c48e0 legacy=0x7f7b540adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.941+0000 7f7b59ed6640 1 -- 172.21.15.114:0/2858484015 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5415a6c0 con 0x7f7b540ae1d0 2023-11-04T01:38:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.941+0000 7f7b596d5640 1 --2- 172.21.15.114:0/2858484015 >> v2:172.21.15.141:3300/0 conn(0x7f7b54159c00 0x7f7b540cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.942+0000 7f7b59ed6640 1 --2- 172.21.15.114:0/2858484015 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b540ae1d0 0x7f7b540c4d90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0097a0 tx=0x7f7b4c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faaf61b335b4ebaa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.942+0000 7f7b4bfff640 1 -- 172.21.15.114:0/2858484015 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c02e070 con 0x7f7b540ae1d0 2023-11-04T01:38:48.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.942+0000 7f7b4bfff640 1 -- 172.21.15.114:0/2858484015 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4c0315a0 con 0x7f7b540ae1d0 2023-11-04T01:38:48.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.942+0000 7f7b4bfff640 1 -- 172.21.15.114:0/2858484015 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c031930 con 0x7f7b540ae1d0 2023-11-04T01:38:48.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.942+0000 7f7b5b939640 1 -- 172.21.15.114:0/2858484015 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b540ae1d0 msgr2=0x7f7b540c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.942+0000 7f7b5b939640 1 --2- 172.21.15.114:0/2858484015 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b540ae1d0 0x7f7b540c4d90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0097a0 tx=0x7f7b4c02b840 comp rx=0 tx=0).stop 2023-11-04T01:38:48.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.942+0000 7f7b5b939640 1 -- 172.21.15.114:0/2858484015 shutdown_connections 2023-11-04T01:38:48.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.942+0000 7f7b5b939640 1 --2- 172.21.15.114:0/2858484015 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b540ae1d0 0x7f7b540c4d90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.942+0000 7f7b5b939640 1 --2- 172.21.15.114:0/2858484015 >> v2:172.21.15.141:3300/0 conn(0x7f7b54159c00 0x7f7b540cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.942+0000 7f7b5b939640 1 -- 172.21.15.114:0/2858484015 >> 172.21.15.114:0/2858484015 conn(0x7f7b540ce950 msgr2=0x7f7b540ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:48.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.943+0000 7f7b5b939640 1 -- 172.21.15.114:0/2858484015 shutdown_connections 2023-11-04T01:38:48.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.943+0000 7f7b5b939640 1 -- 172.21.15.114:0/2858484015 wait complete. 2023-11-04T01:38:48.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.944+0000 7f7b5b939640 1 Processor -- start 2023-11-04T01:38:48.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.944+0000 7f7b5b939640 1 -- start start 2023-11-04T01:38:48.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.944+0000 7f7b5b939640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b540ae1d0 0x7f7b5414ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.944+0000 7f7b5b939640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b540c48e0 0x7f7b5406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.944+0000 7f7b5b939640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b54159c00 0x7f7b541f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.944+0000 7f7b5b939640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540b2a50 con 0x7f7b54159c00 2023-11-04T01:38:48.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.944+0000 7f7b5b939640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540c7750 con 0x7f7b540c48e0 2023-11-04T01:38:48.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.944+0000 7f7b5b939640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b54147cb0 con 0x7f7b540ae1d0 2023-11-04T01:38:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.945+0000 7f7b59ed6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b54159c00 0x7f7b541f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.945+0000 7f7b59ed6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b54159c00 0x7f7b541f2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48366/0 (socket says 172.21.15.114:48366) 2023-11-04T01:38:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.945+0000 7f7b59ed6640 1 -- 172.21.15.114:0/3457008997 learned_addr learned my addr 172.21.15.114:0/3457008997 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.945+0000 7f7b596d5640 1 --2- 172.21.15.114:0/3457008997 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b540ae1d0 0x7f7b5414ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.945+0000 7f7b58ed4640 1 --2- 172.21.15.114:0/3457008997 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b540c48e0 0x7f7b5406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.945+0000 7f7b59ed6640 1 -- 172.21.15.114:0/3457008997 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b540ae1d0 msgr2=0x7f7b5414ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.945+0000 7f7b59ed6640 1 --2- 172.21.15.114:0/3457008997 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b540ae1d0 0x7f7b5414ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.945+0000 7f7b59ed6640 1 -- 172.21.15.114:0/3457008997 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b540c48e0 msgr2=0x7f7b5406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.945+0000 7f7b59ed6640 1 --2- 172.21.15.114:0/3457008997 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b540c48e0 0x7f7b5406d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.945+0000 7f7b59ed6640 1 -- 172.21.15.114:0/3457008997 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b50009a70 con 0x7f7b54159c00 2023-11-04T01:38:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.945+0000 7f7b59ed6640 1 --2- 172.21.15.114:0/3457008997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b54159c00 0x7f7b541f2570 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c034040 tx=0x7f7b4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.945+0000 7f7b49ffb640 1 -- 172.21.15.114:0/3457008997 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c031f10 con 0x7f7b54159c00 2023-11-04T01:38:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.945+0000 7f7b49ffb640 1 -- 172.21.15.114:0/3457008997 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4c032860 con 0x7f7b54159c00 2023-11-04T01:38:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.945+0000 7f7b5b939640 1 -- 172.21.15.114:0/3457008997 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4c009400 con 0x7f7b54159c00 2023-11-04T01:38:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.945+0000 7f7b49ffb640 1 -- 172.21.15.114:0/3457008997 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c032c10 con 0x7f7b54159c00 2023-11-04T01:38:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.945+0000 7f7b5b939640 1 -- 172.21.15.114:0/3457008997 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5406df70 con 0x7f7b54159c00 2023-11-04T01:38:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.946+0000 7f7b5b939640 1 -- 172.21.15.114:0/3457008997 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b54074290 con 0x7f7b54159c00 2023-11-04T01:38:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.947+0000 7f7b49ffb640 1 -- 172.21.15.114:0/3457008997 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b4c04e430 con 0x7f7b54159c00 2023-11-04T01:38:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.947+0000 7f7b49ffb640 1 --2- 172.21.15.114:0/3457008997 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7b3806aea0 0x7f7b3806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.947+0000 7f7b49ffb640 1 -- 172.21.15.114:0/3457008997 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f7b4c0ab4e0 con 0x7f7b54159c00 2023-11-04T01:38:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.947+0000 7f7b596d5640 1 --2- 172.21.15.114:0/3457008997 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7b3806aea0 0x7f7b3806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.948+0000 7f7b596d5640 1 --2- 172.21.15.114:0/3457008997 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7b3806aea0 0x7f7b3806d360 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7b500114e0 tx=0x7f7b5000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:48.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:48.952+0000 7f7b49ffb640 1 -- 172.21.15.114:0/3457008997 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b4c076580 con 0x7f7b54159c00 2023-11-04T01:38:49.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.118+0000 7f7b5b939640 1 -- 172.21.15.114:0/3457008997 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7b540caae0 con 0x7f7b54159c00 2023-11-04T01:38:49.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.818+0000 7f7b49ffb640 1 -- 172.21.15.114:0/3457008997 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v64) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7b4c079ba0 con 0x7f7b54159c00 2023-11-04T01:38:49.820 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2023-11-04T01:38:49.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.822+0000 7f7b5b939640 1 -- 172.21.15.114:0/3457008997 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7b3806aea0 msgr2=0x7f7b3806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.822+0000 7f7b5b939640 1 --2- 172.21.15.114:0/3457008997 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7b3806aea0 0x7f7b3806d360 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7b500114e0 tx=0x7f7b5000b040 comp rx=0 tx=0).stop 2023-11-04T01:38:49.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.822+0000 7f7b5b939640 1 -- 172.21.15.114:0/3457008997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b54159c00 msgr2=0x7f7b541f2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.822+0000 7f7b5b939640 1 --2- 172.21.15.114:0/3457008997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b54159c00 0x7f7b541f2570 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c034040 tx=0x7f7b4c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.823+0000 7f7b5b939640 1 -- 172.21.15.114:0/3457008997 shutdown_connections 2023-11-04T01:38:49.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.823+0000 7f7b5b939640 1 --2- 172.21.15.114:0/3457008997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b54159c00 0x7f7b541f2570 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.823+0000 7f7b5b939640 1 --2- 172.21.15.114:0/3457008997 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7b3806aea0 0x7f7b3806d360 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.823+0000 7f7b5b939640 1 --2- 172.21.15.114:0/3457008997 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7b540c48e0 0x7f7b5406d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.823+0000 7f7b5b939640 1 --2- 172.21.15.114:0/3457008997 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7b540ae1d0 0x7f7b5414ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.823+0000 7f7b5b939640 1 -- 172.21.15.114:0/3457008997 >> 172.21.15.114:0/3457008997 conn(0x7f7b540ce950 msgr2=0x7f7b540c37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:49.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.826+0000 7f7b5b939640 1 -- 172.21.15.114:0/3457008997 shutdown_connections 2023-11-04T01:38:49.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.829+0000 7f7b5b939640 1 -- 172.21.15.114:0/3457008997 wait complete. 2023-11-04T01:38:49.853 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:38:49.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.956+0000 7f24236af640 1 Processor -- start 2023-11-04T01:38:49.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.957+0000 7f24236af640 1 -- start start 2023-11-04T01:38:49.959 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:49.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.957+0000 7f24236af640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f241c0b4880 0x7f241c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:49.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.957+0000 7f24236af640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241c0cde60 con 0x7f241c0cd6d0 2023-11-04T01:38:49.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.957+0000 7f24236af640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241c160f90 con 0x7f241c153e60 2023-11-04T01:38:49.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.957+0000 7f24236af640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c0b5200 con 0x7f241c0b4880 2023-11-04T01:38:49.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.958+0000 7f2420c4a640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f241c0cd6d0 0x7f241c161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41784/0 (socket says 172.21.15.114:41784) 2023-11-04T01:38:49.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.958+0000 7f2420c4a640 1 -- 172.21.15.114:0/1245359273 learned_addr learned my addr 172.21.15.114:0/1245359273 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:49.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.958+0000 7f2421c4c640 1 --2- 172.21.15.114:0/1245359273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f241c0b4880 0x7f241c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:49.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.958+0000 7f2413fff640 1 -- 172.21.15.114:0/1245359273 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234058356 0 0) 0x7f241c0cde60 con 0x7f241c0cd6d0 2023-11-04T01:38:49.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.958+0000 7f2413fff640 1 -- 172.21.15.114:0/1245359273 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2408003520 con 0x7f241c0cd6d0 2023-11-04T01:38:49.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.958+0000 7f2421c4c640 1 -- 172.21.15.114:0/1245359273 >> v1:172.21.15.141:6789/0 conn(0x7f241c153e60 legacy=0x7f241c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.958+0000 7f2413fff640 1 -- 172.21.15.114:0/1245359273 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1897436251 0 0) 0x7f241c160f90 con 0x7f241c153e60 2023-11-04T01:38:49.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.958+0000 7f2421c4c640 1 -- 172.21.15.114:0/1245359273 >> v1:172.21.15.114:6789/0 conn(0x7f241c0cd6d0 legacy=0x7f241c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.958+0000 7f2421c4c640 1 -- 172.21.15.114:0/1245359273 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c0ce090 con 0x7f241c0b4880 2023-11-04T01:38:49.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.959+0000 7f2421c4c640 1 --2- 172.21.15.114:0/1245359273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f241c0b4880 0x7f241c0b4cc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2414009dc0 tx=0x7f241402bd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7ad4c2966149dce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:49.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.959+0000 7f2413fff640 1 -- 172.21.15.114:0/1245359273 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2418001670 con 0x7f241c0b4880 2023-11-04T01:38:49.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.959+0000 7f2413fff640 1 -- 172.21.15.114:0/1245359273 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241402c840 con 0x7f241c0b4880 2023-11-04T01:38:49.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.959+0000 7f2413fff640 1 -- 172.21.15.114:0/1245359273 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241402cbd0 con 0x7f241c0b4880 2023-11-04T01:38:49.963 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:49.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.960+0000 7f24236af640 1 -- 172.21.15.114:0/1245359273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f241c0b4880 msgr2=0x7f241c0b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.960+0000 7f24236af640 1 --2- 172.21.15.114:0/1245359273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f241c0b4880 0x7f241c0b4cc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2414009dc0 tx=0x7f241402bd10 comp rx=0 tx=0).stop 2023-11-04T01:38:49.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.960+0000 7f24236af640 1 -- 172.21.15.114:0/1245359273 shutdown_connections 2023-11-04T01:38:49.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.960+0000 7f24236af640 1 --2- 172.21.15.114:0/1245359273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f241c0b4880 0x7f241c0b4cc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.960+0000 7f24236af640 1 -- 172.21.15.114:0/1245359273 >> 172.21.15.114:0/1245359273 conn(0x7f241c0cf880 msgr2=0x7f241c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:49.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.960+0000 7f24236af640 1 -- 172.21.15.114:0/1245359273 shutdown_connections 2023-11-04T01:38:49.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.960+0000 7f24236af640 1 -- 172.21.15.114:0/1245359273 wait complete. 2023-11-04T01:38:49.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.961+0000 7f24236af640 1 Processor -- start 2023-11-04T01:38:49.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.961+0000 7f24236af640 1 -- start start 2023-11-04T01:38:49.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.961+0000 7f24236af640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f241c0b4880 0x7f241c0c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:49.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f24236af640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f241c0cd6d0 0x7f241c148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:49.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f24236af640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c153e60 0x7f241c144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:49.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f24236af640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c1492e0 con 0x7f241c153e60 2023-11-04T01:38:49.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f24236af640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c1574e0 con 0x7f241c0cd6d0 2023-11-04T01:38:49.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f24236af640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c156960 con 0x7f241c0b4880 2023-11-04T01:38:49.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f2421c4c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c153e60 0x7f241c144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:49.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f2421c4c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c153e60 0x7f241c144d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48380/0 (socket says 172.21.15.114:48380) 2023-11-04T01:38:49.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f2421c4c640 1 -- 172.21.15.114:0/4226531343 learned_addr learned my addr 172.21.15.114:0/4226531343 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:49.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f2420c4a640 1 --2- 172.21.15.114:0/4226531343 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f241c0cd6d0 0x7f241c148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:49.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f242144b640 1 --2- 172.21.15.114:0/4226531343 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f241c0b4880 0x7f241c0c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:49.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f2421c4c640 1 -- 172.21.15.114:0/4226531343 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f241c0b4880 msgr2=0x7f241c0c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f2421c4c640 1 --2- 172.21.15.114:0/4226531343 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f241c0b4880 0x7f241c0c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f2421c4c640 1 -- 172.21.15.114:0/4226531343 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f241c0cd6d0 msgr2=0x7f241c148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:49.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f2421c4c640 1 --2- 172.21.15.114:0/4226531343 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f241c0cd6d0 0x7f241c148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:49.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f2421c4c640 1 -- 172.21.15.114:0/4226531343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2414009a70 con 0x7f241c153e60 2023-11-04T01:38:49.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f2421c4c640 1 --2- 172.21.15.114:0/4226531343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c153e60 0x7f241c144d30 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2414009ee0 tx=0x7f2414004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:49.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f2411ffb640 1 -- 172.21.15.114:0/4226531343 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414034e80 con 0x7f241c153e60 2023-11-04T01:38:49.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f2411ffb640 1 -- 172.21.15.114:0/4226531343 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241402ce50 con 0x7f241c153e60 2023-11-04T01:38:49.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f24236af640 1 -- 172.21.15.114:0/4226531343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241c156c40 con 0x7f241c153e60 2023-11-04T01:38:49.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.962+0000 7f2411ffb640 1 -- 172.21.15.114:0/4226531343 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414003bb0 con 0x7f241c153e60 2023-11-04T01:38:49.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.963+0000 7f24236af640 1 -- 172.21.15.114:0/4226531343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241c157200 con 0x7f241c153e60 2023-11-04T01:38:49.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.964+0000 7f24236af640 1 -- 172.21.15.114:0/4226531343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241c074290 con 0x7f241c153e60 2023-11-04T01:38:49.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.964+0000 7f2411ffb640 1 -- 172.21.15.114:0/4226531343 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f241403b050 con 0x7f241c153e60 2023-11-04T01:38:49.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.964+0000 7f2411ffb640 1 --2- 172.21.15.114:0/4226531343 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f240006ae70 0x7f240006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:49.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.965+0000 7f2411ffb640 1 -- 172.21.15.114:0/4226531343 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f24140abb90 con 0x7f241c153e60 2023-11-04T01:38:49.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.965+0000 7f242144b640 1 --2- 172.21.15.114:0/4226531343 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f240006ae70 0x7f240006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:49.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.965+0000 7f242144b640 1 --2- 172.21.15.114:0/4226531343 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f240006ae70 0x7f240006d330 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f240c000f60 tx=0x7f240c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:49.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:49.969+0000 7f2411ffb640 1 -- 172.21.15.114:0/4226531343 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2414076c60 con 0x7f241c153e60 2023-11-04T01:38:50.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.174+0000 7f24236af640 1 -- 172.21.15.114:0/4226531343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f241c142d00 con 0x7f241c153e60 2023-11-04T01:38:50.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.840+0000 7f2411ffb640 1 -- 172.21.15.114:0/4226531343 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v27) v1 ==== 174+0+0 (secure 0 0 0) 0x7f241404d0c0 con 0x7f241c153e60 2023-11-04T01:38:50.842 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 10 and data pool 11 2023-11-04T01:38:50.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.843+0000 7f24236af640 1 -- 172.21.15.114:0/4226531343 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f240006ae70 msgr2=0x7f240006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.843+0000 7f24236af640 1 --2- 172.21.15.114:0/4226531343 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f240006ae70 0x7f240006d330 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f240c000f60 tx=0x7f240c009040 comp rx=0 tx=0).stop 2023-11-04T01:38:50.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.843+0000 7f24236af640 1 -- 172.21.15.114:0/4226531343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c153e60 msgr2=0x7f241c144d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.843+0000 7f24236af640 1 --2- 172.21.15.114:0/4226531343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c153e60 0x7f241c144d30 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2414009ee0 tx=0x7f2414004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:50.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.843+0000 7f24236af640 1 -- 172.21.15.114:0/4226531343 shutdown_connections 2023-11-04T01:38:50.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.843+0000 7f24236af640 1 --2- 172.21.15.114:0/4226531343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c153e60 0x7f241c144d30 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.843+0000 7f24236af640 1 --2- 172.21.15.114:0/4226531343 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f240006ae70 0x7f240006d330 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.843+0000 7f24236af640 1 --2- 172.21.15.114:0/4226531343 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f241c0cd6d0 0x7f241c148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.843+0000 7f24236af640 1 --2- 172.21.15.114:0/4226531343 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f241c0b4880 0x7f241c0c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.843+0000 7f24236af640 1 -- 172.21.15.114:0/4226531343 >> 172.21.15.114:0/4226531343 conn(0x7f241c0cf880 msgr2=0x7f241c161420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:50.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.844+0000 7f24236af640 1 -- 172.21.15.114:0/4226531343 shutdown_connections 2023-11-04T01:38:50.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.844+0000 7f24236af640 1 -- 172.21.15.114:0/4226531343 wait complete. 2023-11-04T01:38:50.860 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:50.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.959+0000 7fa20c9e7640 1 Processor -- start 2023-11-04T01:38:50.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.959+0000 7fa20c9e7640 1 -- start start 2023-11-04T01:38:50.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.959+0000 7fa20c9e7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa20815ad80 0x7fa20806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.959+0000 7fa20c9e7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2080b42c0 0x7fa2080c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.959+0000 7fa20c9e7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2080ca070 con 0x7fa2080c9c40 2023-11-04T01:38:50.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.959+0000 7fa20c9e7640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20806cd00 con 0x7fa20815ad80 2023-11-04T01:38:50.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.959+0000 7fa20c9e7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20806cfa0 con 0x7fa2080b42c0 2023-11-04T01:38:50.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa206d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa2080c9c40 0x7fa208070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41786/0 (socket says 172.21.15.114:41786) 2023-11-04T01:38:50.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa206d9d640 1 -- 172.21.15.114:0/4293589671 learned_addr learned my addr 172.21.15.114:0/4293589671 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:50.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa205d9b640 1 -- 172.21.15.114:0/4293589671 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451940073 0 0) 0x7fa2080ca070 con 0x7fa2080c9c40 2023-11-04T01:38:50.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa205d9b640 1 -- 172.21.15.114:0/4293589671 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1f4003520 con 0x7fa2080c9c40 2023-11-04T01:38:50.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa1fdd9b640 1 --2- 172.21.15.114:0/4293589671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2080b42c0 0x7fa2080c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa20659c640 1 --2- 172.21.15.114:0/4293589671 >> v2:172.21.15.141:3300/0 conn(0x7fa20815ad80 0x7fa20806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa205d9b640 1 -- 172.21.15.114:0/4293589671 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3789836085 0 0) 0x7fa1f4003520 con 0x7fa2080c9c40 2023-11-04T01:38:50.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa205d9b640 1 -- 172.21.15.114:0/4293589671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2080b42c0 msgr2=0x7fa2080c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:50.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa205d9b640 1 --2- 172.21.15.114:0/4293589671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2080b42c0 0x7fa2080c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa205d9b640 1 -- 172.21.15.114:0/4293589671 >> v2:172.21.15.141:3300/0 conn(0x7fa20815ad80 msgr2=0x7fa20806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:50.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa205d9b640 1 --2- 172.21.15.114:0/4293589671 >> v2:172.21.15.141:3300/0 conn(0x7fa20815ad80 0x7fa20806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa205d9b640 1 -- 172.21.15.114:0/4293589671 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20806d280 con 0x7fa2080c9c40 2023-11-04T01:38:50.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa205d9b640 1 -- 172.21.15.114:0/4293589671 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fa200001a10 con 0x7fa2080c9c40 2023-11-04T01:38:50.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa205d9b640 1 -- 172.21.15.114:0/4293589671 >> v1:172.21.15.114:6789/0 conn(0x7fa2080c9c40 legacy=0x7fa208070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa205d9b640 1 --2- 172.21.15.114:0/4293589671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2080b42c0 0x7fa1f4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa205d9b640 1 --2- 172.21.15.114:0/4293589671 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1f4003fa0 0x7fa1f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa205d9b640 1 --2- 172.21.15.114:0/4293589671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1f4004d00 0x7fa1f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa205d9b640 1 -- 172.21.15.114:0/4293589671 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20806cd00 con 0x7fa1f4004d00 2023-11-04T01:38:50.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa205d9b640 1 -- 172.21.15.114:0/4293589671 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20806cfa0 con 0x7fa1f4003fa0 2023-11-04T01:38:50.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa205d9b640 1 -- 172.21.15.114:0/4293589671 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f400bb10 con 0x7fa2080b42c0 2023-11-04T01:38:50.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa206d9d640 1 --2- 172.21.15.114:0/4293589671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1f4004d00 0x7fa1f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa20659c640 1 --2- 172.21.15.114:0/4293589671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2080b42c0 0x7fa1f4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa1fdd9b640 1 --2- 172.21.15.114:0/4293589671 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1f4003fa0 0x7fa1f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa206d9d640 1 -- 172.21.15.114:0/4293589671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2080b42c0 msgr2=0x7fa1f4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:50.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.960+0000 7fa206d9d640 1 --2- 172.21.15.114:0/4293589671 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa2080b42c0 0x7fa1f4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.961+0000 7fa206d9d640 1 -- 172.21.15.114:0/4293589671 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1f4003fa0 msgr2=0x7fa1f40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:50.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.961+0000 7fa206d9d640 1 --2- 172.21.15.114:0/4293589671 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1f4003fa0 0x7fa1f40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.961+0000 7fa206d9d640 1 -- 172.21.15.114:0/4293589671 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f4003520 con 0x7fa1f4004d00 2023-11-04T01:38:50.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.961+0000 7fa1fdd9b640 1 --2- 172.21.15.114:0/4293589671 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa1f4003fa0 0x7fa1f40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:50.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.961+0000 7fa206d9d640 1 --2- 172.21.15.114:0/4293589671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1f4004d00 0x7fa1f4005180 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa20000a850 tx=0x7fa1f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafaca18a1eca756 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:50.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.961+0000 7fa205d9b640 1 -- 172.21.15.114:0/4293589671 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200034630 con 0x7fa1f4004d00 2023-11-04T01:38:50.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.961+0000 7fa205d9b640 1 -- 172.21.15.114:0/4293589671 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20002f070 con 0x7fa1f4004d00 2023-11-04T01:38:50.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.961+0000 7fa205d9b640 1 -- 172.21.15.114:0/4293589671 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200034a30 con 0x7fa1f4004d00 2023-11-04T01:38:50.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.962+0000 7fa20c9e7640 1 -- 172.21.15.114:0/4293589671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1f4004d00 msgr2=0x7fa1f4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.962+0000 7fa20c9e7640 1 --2- 172.21.15.114:0/4293589671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1f4004d00 0x7fa1f4005180 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa20000a850 tx=0x7fa1f40057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.962+0000 7fa206d9d640 1 -- 172.21.15.114:0/4293589671 reap_dead start 2023-11-04T01:38:50.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.962+0000 7fa20c9e7640 1 -- 172.21.15.114:0/4293589671 shutdown_connections 2023-11-04T01:38:50.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.962+0000 7fa20c9e7640 1 -- 172.21.15.114:0/4293589671 >> 172.21.15.114:0/4293589671 conn(0x7fa2080ce950 msgr2=0x7fa2080ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:50.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.962+0000 7fa20c9e7640 1 -- 172.21.15.114:0/4293589671 shutdown_connections 2023-11-04T01:38:50.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.962+0000 7fa20c9e7640 1 -- 172.21.15.114:0/4293589671 wait complete. 2023-11-04T01:38:50.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.963+0000 7fa20c9e7640 1 Processor -- start 2023-11-04T01:38:50.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.963+0000 7fa20c9e7640 1 -- start start 2023-11-04T01:38:50.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa20c9e7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1f4004d00 0x7fa208159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa20c9e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2080c69e0 0x7fa2080c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa20c9e7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2081f0630 0x7fa2081f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa20c9e7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa208159560 con 0x7fa2080c69e0 2023-11-04T01:38:50.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa20c9e7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080c73a0 con 0x7fa2081f0630 2023-11-04T01:38:50.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa20c9e7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2081f1520 con 0x7fa1f4004d00 2023-11-04T01:38:50.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa1fdd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2080c69e0 0x7fa2080c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa1fdd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2080c69e0 0x7fa2080c6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48412/0 (socket says 172.21.15.114:48412) 2023-11-04T01:38:50.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa1fdd9b640 1 -- 172.21.15.114:0/1469693014 learned_addr learned my addr 172.21.15.114:0/1469693014 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:50.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa1fdd9b640 1 -- 172.21.15.114:0/1469693014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1f4004d00 msgr2=0x7fa208159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa206d9d640 1 --2- 172.21.15.114:0/1469693014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2081f0630 0x7fa2081f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa20659c640 1 --2- 172.21.15.114:0/1469693014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1f4004d00 0x7fa208159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa1fdd9b640 1 --2- 172.21.15.114:0/1469693014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1f4004d00 0x7fa208159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa1fdd9b640 1 -- 172.21.15.114:0/1469693014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2081f0630 msgr2=0x7fa2081f0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:50.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa1fdd9b640 1 --2- 172.21.15.114:0/1469693014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2081f0630 0x7fa2081f0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:50.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa1fdd9b640 1 -- 172.21.15.114:0/1469693014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2081f0ff0 con 0x7fa2080c69e0 2023-11-04T01:38:50.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa206d9d640 1 --2- 172.21.15.114:0/1469693014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2081f0630 0x7fa2081f0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:50.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.964+0000 7fa20659c640 1 --2- 172.21.15.114:0/1469693014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1f4004d00 0x7fa208159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:50.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.965+0000 7fa1fdd9b640 1 --2- 172.21.15.114:0/1469693014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2080c69e0 0x7fa2080c6e60 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000f510 tx=0x7fa1f000f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:50.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.965+0000 7fa1ff7fe640 1 -- 172.21.15.114:0/1469693014 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0014870 con 0x7fa2080c69e0 2023-11-04T01:38:50.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.965+0000 7fa1ff7fe640 1 -- 172.21.15.114:0/1469693014 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f00149d0 con 0x7fa2080c69e0 2023-11-04T01:38:50.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.965+0000 7fa1ff7fe640 1 -- 172.21.15.114:0/1469693014 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0014d40 con 0x7fa2080c69e0 2023-11-04T01:38:50.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.965+0000 7fa20c9e7640 1 -- 172.21.15.114:0/1469693014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2080c75c0 con 0x7fa2080c69e0 2023-11-04T01:38:50.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.965+0000 7fa20c9e7640 1 -- 172.21.15.114:0/1469693014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2080c7b80 con 0x7fa2080c69e0 2023-11-04T01:38:50.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.966+0000 7fa20c9e7640 1 -- 172.21.15.114:0/1469693014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa208074290 con 0x7fa2080c69e0 2023-11-04T01:38:50.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.966+0000 7fa1ff7fe640 1 -- 172.21.15.114:0/1469693014 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa1f001d400 con 0x7fa2080c69e0 2023-11-04T01:38:50.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.966+0000 7fa1ff7fe640 1 --2- 172.21.15.114:0/1469693014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa1e806ae70 0x7fa1e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:50.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.967+0000 7fa1ff7fe640 1 -- 172.21.15.114:0/1469693014 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa1f0089f80 con 0x7fa2080c69e0 2023-11-04T01:38:50.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.967+0000 7fa20659c640 1 --2- 172.21.15.114:0/1469693014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa1e806ae70 0x7fa1e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:50.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.967+0000 7fa20659c640 1 --2- 172.21.15.114:0/1469693014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa1e806ae70 0x7fa1e806d330 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa2080af580 tx=0x7fa1f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:50.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:50.971+0000 7fa1ff7fe640 1 -- 172.21.15.114:0/1469693014 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1f00bcca0 con 0x7fa2080c69e0 2023-11-04T01:38:51.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.139+0000 7fa20c9e7640 1 -- 172.21.15.114:0/1469693014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2080b4880 con 0x7fa2080c69e0 2023-11-04T01:38:51.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.140+0000 7fa1ff7fe640 1 -- 172.21.15.114:0/1469693014 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18599 (secure 0 0 0) 0x7fa1f0054d90 con 0x7fa2080c69e0 2023-11-04T01:38:51.142 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:51.143 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":65,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:50.176042+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:48.665033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:49.137709+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:51.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.142+0000 7fa20c9e7640 1 -- 172.21.15.114:0/1469693014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa1e806ae70 msgr2=0x7fa1e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.142+0000 7fa20c9e7640 1 --2- 172.21.15.114:0/1469693014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa1e806ae70 0x7fa1e806d330 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa2080af580 tx=0x7fa1f8008040 comp rx=0 tx=0).stop 2023-11-04T01:38:51.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.142+0000 7fa20c9e7640 1 -- 172.21.15.114:0/1469693014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2080c69e0 msgr2=0x7fa2080c6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.142+0000 7fa20c9e7640 1 --2- 172.21.15.114:0/1469693014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2080c69e0 0x7fa2080c6e60 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000f510 tx=0x7fa1f000f9d0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.142+0000 7fa20c9e7640 1 -- 172.21.15.114:0/1469693014 shutdown_connections 2023-11-04T01:38:51.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.142+0000 7fa20c9e7640 1 --2- 172.21.15.114:0/1469693014 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa1e806ae70 0x7fa1e806d330 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.142+0000 7fa20c9e7640 1 --2- 172.21.15.114:0/1469693014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa2081f0630 0x7fa2081f0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.142+0000 7fa20c9e7640 1 --2- 172.21.15.114:0/1469693014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2080c69e0 0x7fa2080c6e60 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.142+0000 7fa20c9e7640 1 --2- 172.21.15.114:0/1469693014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa1f4004d00 0x7fa208159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.142+0000 7fa20c9e7640 1 -- 172.21.15.114:0/1469693014 >> 172.21.15.114:0/1469693014 conn(0x7fa2080ce950 msgr2=0x7fa2080b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:51.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.142+0000 7fa20c9e7640 1 -- 172.21.15.114:0/1469693014 shutdown_connections 2023-11-04T01:38:51.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.142+0000 7fa20c9e7640 1 -- 172.21.15.114:0/1469693014 wait complete. 2023-11-04T01:38:51.155 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:51.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.252+0000 7f14230fc640 1 Processor -- start 2023-11-04T01:38:51.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.252+0000 7f14230fc640 1 -- start start 2023-11-04T01:38:51.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.253+0000 7f14230fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f141c0b0ae0 0x7f141c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.253+0000 7f14230fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f141c06db20 0x7f141c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.253+0000 7f14230fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141c0b4110 con 0x7f141c159c70 2023-11-04T01:38:51.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.253+0000 7f14230fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141c0b49b0 con 0x7f141c0b0ae0 2023-11-04T01:38:51.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.253+0000 7f14230fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0b43f0 con 0x7f141c06db20 2023-11-04T01:38:51.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.253+0000 7f141bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f141c0b0ae0 0x7f141c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.253+0000 7f1420e98640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f141c159c70 0x7f141c0b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41802/0 (socket says 172.21.15.114:41802) 2023-11-04T01:38:51.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.253+0000 7f1420e98640 1 -- 172.21.15.114:0/1622600530 learned_addr learned my addr 172.21.15.114:0/1622600530 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:51.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.253+0000 7f141bfff640 1 -- 172.21.15.114:0/1622600530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f141c06db20 msgr2=0x7f141c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:51.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.253+0000 7f1421699640 1 --2- 172.21.15.114:0/1622600530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f141c06db20 0x7f141c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.253+0000 7f141bfff640 1 --2- 172.21.15.114:0/1622600530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f141c06db20 0x7f141c15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.253+0000 7f141bfff640 1 -- 172.21.15.114:0/1622600530 >> v1:172.21.15.114:6789/0 conn(0x7f141c159c70 legacy=0x7f141c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.253+0000 7f141bfff640 1 -- 172.21.15.114:0/1622600530 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0b46d0 con 0x7f141c0b0ae0 2023-11-04T01:38:51.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.253+0000 7f141b7fe640 1 -- 172.21.15.114:0/1622600530 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000897974 0 0) 0x7f141c0b4110 con 0x7f141c159c70 2023-11-04T01:38:51.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.253+0000 7f1421699640 1 --2- 172.21.15.114:0/1622600530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f141c06db20 0x7f141c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:51.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.254+0000 7f141bfff640 1 --2- 172.21.15.114:0/1622600530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f141c0b0ae0 0x7f141c0ce370 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f14100097a0 tx=0x7f141002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfd50284b3f4c37 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.254+0000 7f141b7fe640 1 -- 172.21.15.114:0/1622600530 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410031830 con 0x7f141c0b0ae0 2023-11-04T01:38:51.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.254+0000 7f141b7fe640 1 -- 172.21.15.114:0/1622600530 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1410031990 con 0x7f141c0b0ae0 2023-11-04T01:38:51.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.254+0000 7f141b7fe640 1 -- 172.21.15.114:0/1622600530 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410031d20 con 0x7f141c0b0ae0 2023-11-04T01:38:51.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.255+0000 7f14230fc640 1 -- 172.21.15.114:0/1622600530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f141c0b0ae0 msgr2=0x7f141c0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.255+0000 7f14230fc640 1 --2- 172.21.15.114:0/1622600530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f141c0b0ae0 0x7f141c0ce370 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f14100097a0 tx=0x7f141002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.255+0000 7f14230fc640 1 -- 172.21.15.114:0/1622600530 shutdown_connections 2023-11-04T01:38:51.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.255+0000 7f14230fc640 1 --2- 172.21.15.114:0/1622600530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f141c06db20 0x7f141c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.255+0000 7f14230fc640 1 --2- 172.21.15.114:0/1622600530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f141c0b0ae0 0x7f141c0ce370 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.255+0000 7f14230fc640 1 -- 172.21.15.114:0/1622600530 >> 172.21.15.114:0/1622600530 conn(0x7f141c0ce950 msgr2=0x7f141c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:51.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.255+0000 7f14230fc640 1 -- 172.21.15.114:0/1622600530 shutdown_connections 2023-11-04T01:38:51.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.255+0000 7f14230fc640 1 -- 172.21.15.114:0/1622600530 wait complete. 2023-11-04T01:38:51.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.256+0000 7f14230fc640 1 Processor -- start 2023-11-04T01:38:51.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.256+0000 7f14230fc640 1 -- start start 2023-11-04T01:38:51.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.257+0000 7f14230fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f141c06db20 0x7f141c140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.257+0000 7f14230fc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f141c0b0ae0 0x7f141c0c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.257+0000 7f14230fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f141c159c70 0x7f141c0b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.257+0000 7f14230fc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c146c60 con 0x7f141c159c70 2023-11-04T01:38:51.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.257+0000 7f14230fc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c1f26c0 con 0x7f141c0b0ae0 2023-11-04T01:38:51.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.257+0000 7f14230fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c1f1ab0 con 0x7f141c06db20 2023-11-04T01:38:51.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.257+0000 7f1421699640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f141c159c70 0x7f141c0b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.257+0000 7f1421699640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f141c159c70 0x7f141c0b0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48430/0 (socket says 172.21.15.114:48430) 2023-11-04T01:38:51.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.257+0000 7f1421699640 1 -- 172.21.15.114:0/1569487881 learned_addr learned my addr 172.21.15.114:0/1569487881 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:51.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.257+0000 7f1421699640 1 -- 172.21.15.114:0/1569487881 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f141c06db20 msgr2=0x7f141c140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.257+0000 7f1421699640 1 --2- 172.21.15.114:0/1569487881 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f141c06db20 0x7f141c140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.257+0000 7f141bfff640 1 --2- 172.21.15.114:0/1569487881 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f141c0b0ae0 0x7f141c0c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.257+0000 7f1421699640 1 -- 172.21.15.114:0/1569487881 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f141c0b0ae0 msgr2=0x7f141c0c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.257+0000 7f1421699640 1 --2- 172.21.15.114:0/1569487881 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f141c0b0ae0 0x7f141c0c4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.257+0000 7f1421699640 1 -- 172.21.15.114:0/1569487881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1410009400 con 0x7f141c159c70 2023-11-04T01:38:51.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.257+0000 7f1421699640 1 --2- 172.21.15.114:0/1569487881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f141c159c70 0x7f141c0b0020 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f141400cef0 tx=0x7f141400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.258+0000 7f14197fa640 1 -- 172.21.15.114:0/1569487881 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141400d840 con 0x7f141c159c70 2023-11-04T01:38:51.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.258+0000 7f14197fa640 1 -- 172.21.15.114:0/1569487881 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141400d9c0 con 0x7f141c159c70 2023-11-04T01:38:51.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.258+0000 7f14230fc640 1 -- 172.21.15.114:0/1569487881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141c1f1d90 con 0x7f141c159c70 2023-11-04T01:38:51.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.258+0000 7f14197fa640 1 -- 172.21.15.114:0/1569487881 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141400dd70 con 0x7f141c159c70 2023-11-04T01:38:51.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.258+0000 7f14230fc640 1 -- 172.21.15.114:0/1569487881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141c1f2350 con 0x7f141c159c70 2023-11-04T01:38:51.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.259+0000 7f14230fc640 1 -- 172.21.15.114:0/1569487881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141c074290 con 0x7f141c159c70 2023-11-04T01:38:51.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.259+0000 7f14197fa640 1 -- 172.21.15.114:0/1569487881 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f141401e3b0 con 0x7f141c159c70 2023-11-04T01:38:51.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.259+0000 7f14197fa640 1 --2- 172.21.15.114:0/1569487881 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f140806ae70 0x7f140806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.260+0000 7f1420e98640 1 --2- 172.21.15.114:0/1569487881 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f140806ae70 0x7f140806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.260+0000 7f14197fa640 1 -- 172.21.15.114:0/1569487881 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f141408a390 con 0x7f141c159c70 2023-11-04T01:38:51.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.260+0000 7f1420e98640 1 --2- 172.21.15.114:0/1569487881 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f140806ae70 0x7f140806d330 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f140c007fd0 tx=0x7f140c007960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.264+0000 7f14197fa640 1 -- 172.21.15.114:0/1569487881 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1414055260 con 0x7f141c159c70 2023-11-04T01:38:51.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.431+0000 7f14230fc640 1 -- 172.21.15.114:0/1569487881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f141c06d3f0 con 0x7f141c159c70 2023-11-04T01:38:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.432+0000 7f14197fa640 1 -- 172.21.15.114:0/1569487881 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18599 (secure 0 0 0) 0x7f1414058880 con 0x7f141c159c70 2023-11-04T01:38:51.434 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:51.434 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":65,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:50.176042+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:48.665033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:49.137709+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:51.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.434+0000 7f14230fc640 1 -- 172.21.15.114:0/1569487881 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f140806ae70 msgr2=0x7f140806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.434+0000 7f14230fc640 1 --2- 172.21.15.114:0/1569487881 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f140806ae70 0x7f140806d330 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f140c007fd0 tx=0x7f140c007960 comp rx=0 tx=0).stop 2023-11-04T01:38:51.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.434+0000 7f14230fc640 1 -- 172.21.15.114:0/1569487881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f141c159c70 msgr2=0x7f141c0b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.434+0000 7f14230fc640 1 --2- 172.21.15.114:0/1569487881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f141c159c70 0x7f141c0b0020 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f141400cef0 tx=0x7f141400a710 comp rx=0 tx=0).stop 2023-11-04T01:38:51.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.434+0000 7f14230fc640 1 -- 172.21.15.114:0/1569487881 shutdown_connections 2023-11-04T01:38:51.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.434+0000 7f14230fc640 1 --2- 172.21.15.114:0/1569487881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f141c159c70 0x7f141c0b0020 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.434+0000 7f14230fc640 1 --2- 172.21.15.114:0/1569487881 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f140806ae70 0x7f140806d330 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.434+0000 7f14230fc640 1 --2- 172.21.15.114:0/1569487881 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f141c0b0ae0 0x7f141c0c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.434+0000 7f14230fc640 1 --2- 172.21.15.114:0/1569487881 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f141c06db20 0x7f141c140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.434+0000 7f14230fc640 1 -- 172.21.15.114:0/1569487881 >> 172.21.15.114:0/1569487881 conn(0x7f141c0ce950 msgr2=0x7f141c0b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:51.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.434+0000 7f14230fc640 1 -- 172.21.15.114:0/1569487881 shutdown_connections 2023-11-04T01:38:51.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.434+0000 7f14230fc640 1 -- 172.21.15.114:0/1569487881 wait complete. 2023-11-04T01:38:51.447 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:38:51.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.548+0000 7f19a5c44640 1 Processor -- start 2023-11-04T01:38:51.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.548+0000 7f19a5c44640 1 -- start start 2023-11-04T01:38:51.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.548+0000 7f19a5c44640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f19a00cc520 0x7f19a0070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.548+0000 7f19a5c44640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f19a00cc9d0 0x7f19a00714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.548+0000 7f19a5c44640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a00c3860 con 0x7f19a0153850 2023-11-04T01:38:51.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.548+0000 7f19a5c44640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a00c9250 con 0x7f19a00cc9d0 2023-11-04T01:38:51.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.548+0000 7f19a5c44640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a0153c30 con 0x7f19a00cc520 2023-11-04T01:38:51.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.549+0000 7f199ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f19a00cc9d0 0x7f19a00714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.549+0000 7f199f7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f19a0153850 0x7f19a015a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41816/0 (socket says 172.21.15.114:41816) 2023-11-04T01:38:51.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.549+0000 7f199f7fe640 1 -- 172.21.15.114:0/2798825691 learned_addr learned my addr 172.21.15.114:0/2798825691 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:51.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.549+0000 7f199ffff640 1 -- 172.21.15.114:0/2798825691 >> v2:172.21.15.141:3300/0 conn(0x7f19a00cc520 msgr2=0x7f19a0070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:51.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.549+0000 7f199effd640 1 --2- 172.21.15.114:0/2798825691 >> v2:172.21.15.141:3300/0 conn(0x7f19a00cc520 0x7f19a0070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.549+0000 7f199ffff640 1 --2- 172.21.15.114:0/2798825691 >> v2:172.21.15.141:3300/0 conn(0x7f19a00cc520 0x7f19a0070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.549+0000 7f199e7fc640 1 -- 172.21.15.114:0/2798825691 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737876174 0 0) 0x7f19a00c3860 con 0x7f19a0153850 2023-11-04T01:38:51.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.549+0000 7f199ffff640 1 -- 172.21.15.114:0/2798825691 >> v1:172.21.15.114:6789/0 conn(0x7f19a0153850 legacy=0x7f19a015a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.549+0000 7f199ffff640 1 -- 172.21.15.114:0/2798825691 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a00ce590 con 0x7f19a00cc9d0 2023-11-04T01:38:51.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.550+0000 7f199ffff640 1 --2- 172.21.15.114:0/2798825691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19a00cc9d0 0x7f19a00714e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f19a0070560 tx=0x7f199802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0a1a07e4406f76 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.550+0000 7f199e7fc640 1 -- 172.21.15.114:0/2798825691 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199802ee90 con 0x7f19a00cc9d0 2023-11-04T01:38:51.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.550+0000 7f199e7fc640 1 -- 172.21.15.114:0/2798825691 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1998036440 con 0x7f19a00cc9d0 2023-11-04T01:38:51.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.550+0000 7f199e7fc640 1 -- 172.21.15.114:0/2798825691 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19980367d0 con 0x7f19a00cc9d0 2023-11-04T01:38:51.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.551+0000 7f19a5c44640 1 -- 172.21.15.114:0/2798825691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19a00cc9d0 msgr2=0x7f19a00714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.551+0000 7f19a5c44640 1 --2- 172.21.15.114:0/2798825691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19a00cc9d0 0x7f19a00714e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f19a0070560 tx=0x7f199802e0e0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.551+0000 7f19a5c44640 1 -- 172.21.15.114:0/2798825691 shutdown_connections 2023-11-04T01:38:51.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.551+0000 7f19a5c44640 1 --2- 172.21.15.114:0/2798825691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19a00cc9d0 0x7f19a00714e0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.551+0000 7f19a5c44640 1 --2- 172.21.15.114:0/2798825691 >> v2:172.21.15.141:3300/0 conn(0x7f19a00cc520 0x7f19a0070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.551+0000 7f19a5c44640 1 -- 172.21.15.114:0/2798825691 >> 172.21.15.114:0/2798825691 conn(0x7f19a00ce950 msgr2=0x7f19a00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:51.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.551+0000 7f19a5c44640 1 -- 172.21.15.114:0/2798825691 shutdown_connections 2023-11-04T01:38:51.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.551+0000 7f19a5c44640 1 -- 172.21.15.114:0/2798825691 wait complete. 2023-11-04T01:38:51.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.552+0000 7f19a5c44640 1 Processor -- start 2023-11-04T01:38:51.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.552+0000 7f19a5c44640 1 -- start start 2023-11-04T01:38:51.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f19a5c44640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19a00cc520 0x7f19a01500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f19a5c44640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19a00cc9d0 0x7f19a00c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f19a5c44640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19a0153850 0x7f19a0151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f19a5c44640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a01505f0 con 0x7f19a00cc9d0 2023-11-04T01:38:51.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f19a5c44640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a0154260 con 0x7f19a00cc520 2023-11-04T01:38:51.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f19a5c44640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00c7940 con 0x7f19a0153850 2023-11-04T01:38:51.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f199effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19a00cc9d0 0x7f19a00c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f199effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19a00cc9d0 0x7f19a00c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48456/0 (socket says 172.21.15.114:48456) 2023-11-04T01:38:51.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f199effd640 1 -- 172.21.15.114:0/3182913454 learned_addr learned my addr 172.21.15.114:0/3182913454 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:51.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f199effd640 1 -- 172.21.15.114:0/3182913454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19a0153850 msgr2=0x7f19a0151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f199effd640 1 --2- 172.21.15.114:0/3182913454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19a0153850 0x7f19a0151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f199effd640 1 -- 172.21.15.114:0/3182913454 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19a00cc520 msgr2=0x7f19a01500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f199effd640 1 --2- 172.21.15.114:0/3182913454 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19a00cc520 0x7f19a01500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f199effd640 1 -- 172.21.15.114:0/3182913454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1998009a70 con 0x7f19a00cc9d0 2023-11-04T01:38:51.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f199effd640 1 --2- 172.21.15.114:0/3182913454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19a00cc9d0 0x7f19a00c7c70 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f199400c7f0 tx=0x7f199400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f1987fff640 1 -- 172.21.15.114:0/3182913454 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994004220 con 0x7f19a00cc9d0 2023-11-04T01:38:51.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f1987fff640 1 -- 172.21.15.114:0/3182913454 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1994004380 con 0x7f19a00cc9d0 2023-11-04T01:38:51.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f19a5c44640 1 -- 172.21.15.114:0/3182913454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a00c7380 con 0x7f19a00cc9d0 2023-11-04T01:38:51.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f1987fff640 1 -- 172.21.15.114:0/3182913454 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994007840 con 0x7f19a00cc9d0 2023-11-04T01:38:51.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.553+0000 7f19a5c44640 1 -- 172.21.15.114:0/3182913454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a0153ef0 con 0x7f19a00cc9d0 2023-11-04T01:38:51.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.554+0000 7f19a5c44640 1 -- 172.21.15.114:0/3182913454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a0074290 con 0x7f19a00cc9d0 2023-11-04T01:38:51.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.555+0000 7f1987fff640 1 -- 172.21.15.114:0/3182913454 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19940079a0 con 0x7f19a00cc9d0 2023-11-04T01:38:51.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.555+0000 7f1987fff640 1 --2- 172.21.15.114:0/3182913454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f198c06ae70 0x7f198c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.555+0000 7f1987fff640 1 -- 172.21.15.114:0/3182913454 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f19940894b0 con 0x7f19a00cc9d0 2023-11-04T01:38:51.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.555+0000 7f199f7fe640 1 --2- 172.21.15.114:0/3182913454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f198c06ae70 0x7f198c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.556+0000 7f199f7fe640 1 --2- 172.21.15.114:0/3182913454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f198c06ae70 0x7f198c06d330 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1990007fd0 tx=0x7f1990007920 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.560+0000 7f1987fff640 1 -- 172.21.15.114:0/3182913454 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1994054350 con 0x7f19a00cc9d0 2023-11-04T01:38:51.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.761+0000 7f19a5c44640 1 -- 172.21.15.114:0/3182913454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f19a01543d0 con 0x7f19a00cc9d0 2023-11-04T01:38:51.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.844+0000 7f1987fff640 1 -- 172.21.15.114:0/3182913454 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v28) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1994057970 con 0x7f19a00cc9d0 2023-11-04T01:38:51.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.845+0000 7f19a5c44640 1 -- 172.21.15.114:0/3182913454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f198c06ae70 msgr2=0x7f198c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.845+0000 7f19a5c44640 1 --2- 172.21.15.114:0/3182913454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f198c06ae70 0x7f198c06d330 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1990007fd0 tx=0x7f1990007920 comp rx=0 tx=0).stop 2023-11-04T01:38:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.845+0000 7f19a5c44640 1 -- 172.21.15.114:0/3182913454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19a00cc9d0 msgr2=0x7f19a00c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.845+0000 7f19a5c44640 1 --2- 172.21.15.114:0/3182913454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19a00cc9d0 0x7f19a00c7c70 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f199400c7f0 tx=0x7f199400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.845+0000 7f19a5c44640 1 -- 172.21.15.114:0/3182913454 shutdown_connections 2023-11-04T01:38:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.845+0000 7f19a5c44640 1 --2- 172.21.15.114:0/3182913454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19a0153850 0x7f19a0151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.845+0000 7f19a5c44640 1 --2- 172.21.15.114:0/3182913454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19a00cc9d0 0x7f19a00c7c70 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.845+0000 7f19a5c44640 1 --2- 172.21.15.114:0/3182913454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f198c06ae70 0x7f198c06d330 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.845+0000 7f19a5c44640 1 --2- 172.21.15.114:0/3182913454 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19a00cc520 0x7f19a01500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.845+0000 7f19a5c44640 1 -- 172.21.15.114:0/3182913454 >> 172.21.15.114:0/3182913454 conn(0x7f19a00ce950 msgr2=0x7f19a00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:51.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.846+0000 7f19a5c44640 1 -- 172.21.15.114:0/3182913454 shutdown_connections 2023-11-04T01:38:51.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.846+0000 7f19a5c44640 1 -- 172.21.15.114:0/3182913454 wait complete. 2023-11-04T01:38:51.858 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:38:51.858 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:38:51.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.958+0000 7f460686f640 1 Processor -- start 2023-11-04T01:38:51.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.958+0000 7f460686f640 1 -- start start 2023-11-04T01:38:51.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.959+0000 7f460686f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46000b4880 0x7f46000b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.959+0000 7f460686f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46000cde60 con 0x7f4600153e60 2023-11-04T01:38:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.959+0000 7f460686f640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4600160f90 con 0x7f46000cd6d0 2023-11-04T01:38:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.959+0000 7f460686f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46000b5200 con 0x7f46000b4880 2023-11-04T01:38:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.959+0000 7f45fffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4600153e60 0x7f460015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41820/0 (socket says 172.21.15.114:41820) 2023-11-04T01:38:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.959+0000 7f45fffff640 1 -- 172.21.15.114:0/2286002654 learned_addr learned my addr 172.21.15.114:0/2286002654 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f4604e0c640 1 --2- 172.21.15.114:0/2286002654 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46000b4880 0x7f46000b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45feffd640 1 -- 172.21.15.114:0/2286002654 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652610113 0 0) 0x7f46000cde60 con 0x7f4600153e60 2023-11-04T01:38:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45feffd640 1 -- 172.21.15.114:0/2286002654 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45e8003520 con 0x7f4600153e60 2023-11-04T01:38:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45feffd640 1 -- 172.21.15.114:0/2286002654 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4112460176 0 0) 0x7f45e8003520 con 0x7f4600153e60 2023-11-04T01:38:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45feffd640 1 -- 172.21.15.114:0/2286002654 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46000b4880 msgr2=0x7f46000b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45feffd640 1 --2- 172.21.15.114:0/2286002654 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46000b4880 0x7f46000b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45feffd640 1 -- 172.21.15.114:0/2286002654 >> v1:172.21.15.141:6789/0 conn(0x7f46000cd6d0 legacy=0x7f4600161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45feffd640 1 -- 172.21.15.114:0/2286002654 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46000ce090 con 0x7f4600153e60 2023-11-04T01:38:51.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45feffd640 1 -- 172.21.15.114:0/2286002654 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f45f0001670 con 0x7f4600153e60 2023-11-04T01:38:51.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45feffd640 1 -- 172.21.15.114:0/2286002654 >> v1:172.21.15.114:6789/0 conn(0x7f4600153e60 legacy=0x7f460015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45feffd640 1 --2- 172.21.15.114:0/2286002654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45e80039a0 0x7f45e8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45feffd640 1 --2- 172.21.15.114:0/2286002654 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45e80047c0 0x7f45e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45feffd640 1 --2- 172.21.15.114:0/2286002654 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46000b4880 0x7f45e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45feffd640 1 -- 172.21.15.114:0/2286002654 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46000b5200 con 0x7f45e80039a0 2023-11-04T01:38:51.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45feffd640 1 -- 172.21.15.114:0/2286002654 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e800ba60 con 0x7f45e80047c0 2023-11-04T01:38:51.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45feffd640 1 -- 172.21.15.114:0/2286002654 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e800bc20 con 0x7f46000b4880 2023-11-04T01:38:51.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45fffff640 1 --2- 172.21.15.114:0/2286002654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45e80039a0 0x7f45e8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45ff7fe640 1 --2- 172.21.15.114:0/2286002654 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45e80047c0 0x7f45e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f4604e0c640 1 --2- 172.21.15.114:0/2286002654 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46000b4880 0x7f45e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45fffff640 1 -- 172.21.15.114:0/2286002654 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46000b4880 msgr2=0x7f45e8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45fffff640 1 --2- 172.21.15.114:0/2286002654 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46000b4880 0x7f45e8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45fffff640 1 -- 172.21.15.114:0/2286002654 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45e80047c0 msgr2=0x7f45e8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45fffff640 1 --2- 172.21.15.114:0/2286002654 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45e80047c0 0x7f45e8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.960+0000 7f45fffff640 1 -- 172.21.15.114:0/2286002654 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e8003520 con 0x7f45e80039a0 2023-11-04T01:38:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.961+0000 7f45fffff640 1 --2- 172.21.15.114:0/2286002654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45e80039a0 0x7f45e8003dc0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f45f0007fd0 tx=0x7f45e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4ac62fe50930c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.961+0000 7f45feffd640 1 -- 172.21.15.114:0/2286002654 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0005ad0 con 0x7f45e80039a0 2023-11-04T01:38:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.961+0000 7f45feffd640 1 -- 172.21.15.114:0/2286002654 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f0005c30 con 0x7f45e80039a0 2023-11-04T01:38:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.961+0000 7f45feffd640 1 -- 172.21.15.114:0/2286002654 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f002c850 con 0x7f45e80039a0 2023-11-04T01:38:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.962+0000 7f460686f640 1 -- 172.21.15.114:0/2286002654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45e80039a0 msgr2=0x7f45e8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.962+0000 7f460686f640 1 --2- 172.21.15.114:0/2286002654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45e80039a0 0x7f45e8003dc0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f45f0007fd0 tx=0x7f45e80057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.962+0000 7f4604e0c640 1 -- 172.21.15.114:0/2286002654 reap_dead start 2023-11-04T01:38:51.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.962+0000 7f460686f640 1 -- 172.21.15.114:0/2286002654 shutdown_connections 2023-11-04T01:38:51.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.962+0000 7f460686f640 1 -- 172.21.15.114:0/2286002654 >> 172.21.15.114:0/2286002654 conn(0x7f46000cf880 msgr2=0x7f46000cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:51.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.962+0000 7f460686f640 1 -- 172.21.15.114:0/2286002654 shutdown_connections 2023-11-04T01:38:51.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.962+0000 7f460686f640 1 -- 172.21.15.114:0/2286002654 wait complete. 2023-11-04T01:38:51.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.963+0000 7f460686f640 1 Processor -- start 2023-11-04T01:38:51.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.963+0000 7f460686f640 1 -- start start 2023-11-04T01:38:51.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f460686f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45e80039a0 0x7f46001f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f460686f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4600157b70 0x7f46001f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f460686f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46001f6110 0x7f46000b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f460686f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46000c7c00 con 0x7f46001f6110 2023-11-04T01:38:51.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f460686f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46001f6620 con 0x7f4600157b70 2023-11-04T01:38:51.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f460686f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46001f6900 con 0x7f45e80039a0 2023-11-04T01:38:51.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f4604e0c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46001f6110 0x7f46000b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f4604e0c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46001f6110 0x7f46000b7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48470/0 (socket says 172.21.15.114:48470) 2023-11-04T01:38:51.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f4604e0c640 1 -- 172.21.15.114:0/721332354 learned_addr learned my addr 172.21.15.114:0/721332354 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:51.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f45fffff640 1 --2- 172.21.15.114:0/721332354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45e80039a0 0x7f46001f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f45ff7fe640 1 --2- 172.21.15.114:0/721332354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4600157b70 0x7f46001f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f4604e0c640 1 -- 172.21.15.114:0/721332354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45e80039a0 msgr2=0x7f46001f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f4604e0c640 1 --2- 172.21.15.114:0/721332354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45e80039a0 0x7f46001f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f4604e0c640 1 -- 172.21.15.114:0/721332354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4600157b70 msgr2=0x7f46001f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:51.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f4604e0c640 1 --2- 172.21.15.114:0/721332354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4600157b70 0x7f46001f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:51.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f4604e0c640 1 -- 172.21.15.114:0/721332354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46000c7e50 con 0x7f46001f6110 2023-11-04T01:38:51.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f45fffff640 1 --2- 172.21.15.114:0/721332354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45e80039a0 0x7f46001f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:51.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f45ff7fe640 1 --2- 172.21.15.114:0/721332354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4600157b70 0x7f46001f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:51.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.964+0000 7f4604e0c640 1 --2- 172.21.15.114:0/721332354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46001f6110 0x7f46000b7020 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f460006c900 tx=0x7f45f80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.965+0000 7f45fcff9640 1 -- 172.21.15.114:0/721332354 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f800e070 con 0x7f46001f6110 2023-11-04T01:38:51.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.965+0000 7f45fcff9640 1 -- 172.21.15.114:0/721332354 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f8011ed0 con 0x7f46001f6110 2023-11-04T01:38:51.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.965+0000 7f45fcff9640 1 -- 172.21.15.114:0/721332354 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8003990 con 0x7f46001f6110 2023-11-04T01:38:51.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.965+0000 7f460686f640 1 -- 172.21.15.114:0/721332354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46000c8130 con 0x7f46001f6110 2023-11-04T01:38:51.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.965+0000 7f460686f640 1 -- 172.21.15.114:0/721332354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46000ccdc0 con 0x7f46001f6110 2023-11-04T01:38:51.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.966+0000 7f460686f640 1 -- 172.21.15.114:0/721332354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46000c8320 con 0x7f46001f6110 2023-11-04T01:38:51.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.966+0000 7f45fcff9640 1 -- 172.21.15.114:0/721332354 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f45f8003b10 con 0x7f46001f6110 2023-11-04T01:38:51.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.966+0000 7f45fcff9640 1 --2- 172.21.15.114:0/721332354 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f45ec06aea0 0x7f45ec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:51.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.966+0000 7f45fcff9640 1 -- 172.21.15.114:0/721332354 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f45f8089df0 con 0x7f46001f6110 2023-11-04T01:38:51.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.966+0000 7f45fffff640 1 --2- 172.21.15.114:0/721332354 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f45ec06aea0 0x7f45ec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:51.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.967+0000 7f45fffff640 1 --2- 172.21.15.114:0/721332354 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f45ec06aea0 0x7f45ec06d360 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f45f0034000 tx=0x7f45f0009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:51.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:51.970+0000 7f45fcff9640 1 -- 172.21.15.114:0/721332354 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f45f8054c90 con 0x7f46001f6110 2023-11-04T01:38:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.172+0000 7f460686f640 1 -- 172.21.15.114:0/721332354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4600074290 con 0x7f46001f6110 2023-11-04T01:38:52.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.848+0000 7f45fcff9640 1 -- 172.21.15.114:0/721332354 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v29) v1 ==== 122+0+0 (secure 0 0 0) 0x7f45f80582b0 con 0x7f46001f6110 2023-11-04T01:38:52.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.850+0000 7f460686f640 1 -- 172.21.15.114:0/721332354 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f45ec06aea0 msgr2=0x7f45ec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.850+0000 7f460686f640 1 --2- 172.21.15.114:0/721332354 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f45ec06aea0 0x7f45ec06d360 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f45f0034000 tx=0x7f45f0009030 comp rx=0 tx=0).stop 2023-11-04T01:38:52.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.850+0000 7f460686f640 1 -- 172.21.15.114:0/721332354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46001f6110 msgr2=0x7f46000b7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.850+0000 7f460686f640 1 --2- 172.21.15.114:0/721332354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46001f6110 0x7f46000b7020 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f460006c900 tx=0x7f45f80115a0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.850+0000 7f460686f640 1 -- 172.21.15.114:0/721332354 shutdown_connections 2023-11-04T01:38:52.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.850+0000 7f460686f640 1 --2- 172.21.15.114:0/721332354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46001f6110 0x7f46000b7020 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.850+0000 7f460686f640 1 --2- 172.21.15.114:0/721332354 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f45ec06aea0 0x7f45ec06d360 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.850+0000 7f460686f640 1 --2- 172.21.15.114:0/721332354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4600157b70 0x7f46001f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.850+0000 7f460686f640 1 --2- 172.21.15.114:0/721332354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45e80039a0 0x7f46001f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.850+0000 7f460686f640 1 -- 172.21.15.114:0/721332354 >> 172.21.15.114:0/721332354 conn(0x7f46000cf880 msgr2=0x7f46000cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:52.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.850+0000 7f460686f640 1 -- 172.21.15.114:0/721332354 shutdown_connections 2023-11-04T01:38:52.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.850+0000 7f460686f640 1 -- 172.21.15.114:0/721332354 wait complete. 2023-11-04T01:38:52.864 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:38:52.864 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:52.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.965+0000 7fdf3c1fc640 1 Processor -- start 2023-11-04T01:38:52.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.965+0000 7fdf3c1fc640 1 -- start start 2023-11-04T01:38:52.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.966+0000 7fdf3c1fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fdf3415ad80 0x7fdf340abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.966+0000 7fdf3c1fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdf340c9a40 0x7fdf340c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.966+0000 7fdf3c1fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf3406b720 con 0x7fdf3406a1b0 2023-11-04T01:38:52.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.966+0000 7fdf3c1fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf340ca410 con 0x7fdf340c9a40 2023-11-04T01:38:52.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.966+0000 7fdf3c1fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3406cf60 con 0x7fdf3415ad80 2023-11-04T01:38:52.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.966+0000 7fdf3a799640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdf340c9a40 0x7fdf340c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.966+0000 7fdf39797640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdf3406a1b0 0x7fdf3406b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41830/0 (socket says 172.21.15.114:41830) 2023-11-04T01:38:52.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.966+0000 7fdf39797640 1 -- 172.21.15.114:0/1010719146 learned_addr learned my addr 172.21.15.114:0/1010719146 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:52.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.966+0000 7fdf39f98640 1 --2- 172.21.15.114:0/1010719146 >> v2:172.21.15.141:3300/0 conn(0x7fdf3415ad80 0x7fdf340abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.966+0000 7fdf3a799640 1 -- 172.21.15.114:0/1010719146 >> v2:172.21.15.141:3300/0 conn(0x7fdf3415ad80 msgr2=0x7fdf340abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:52.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.966+0000 7fdf3a799640 1 --2- 172.21.15.114:0/1010719146 >> v2:172.21.15.141:3300/0 conn(0x7fdf3415ad80 0x7fdf340abe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.966+0000 7fdf3a799640 1 -- 172.21.15.114:0/1010719146 >> v1:172.21.15.114:6789/0 conn(0x7fdf3406a1b0 legacy=0x7fdf3406b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.966+0000 7fdf38f96640 1 -- 172.21.15.114:0/1010719146 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375569146 0 0) 0x7fdf3406b720 con 0x7fdf3406a1b0 2023-11-04T01:38:52.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.966+0000 7fdf3a799640 1 -- 172.21.15.114:0/1010719146 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf340ac390 con 0x7fdf340c9a40 2023-11-04T01:38:52.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.967+0000 7fdf3a799640 1 --2- 172.21.15.114:0/1010719146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf340c9a40 0x7fdf340c9ed0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fdf340d0130 tx=0x7fdf2c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d59736d41fe361 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:52.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.967+0000 7fdf38f96640 1 -- 172.21.15.114:0/1010719146 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c02cc80 con 0x7fdf340c9a40 2023-11-04T01:38:52.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.967+0000 7fdf38f96640 1 -- 172.21.15.114:0/1010719146 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2c02cde0 con 0x7fdf340c9a40 2023-11-04T01:38:52.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.967+0000 7fdf38f96640 1 -- 172.21.15.114:0/1010719146 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c034660 con 0x7fdf340c9a40 2023-11-04T01:38:52.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.967+0000 7fdf3c1fc640 1 -- 172.21.15.114:0/1010719146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf340c9a40 msgr2=0x7fdf340c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.967+0000 7fdf3c1fc640 1 --2- 172.21.15.114:0/1010719146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf340c9a40 0x7fdf340c9ed0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fdf340d0130 tx=0x7fdf2c02bed0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.967+0000 7fdf3c1fc640 1 -- 172.21.15.114:0/1010719146 shutdown_connections 2023-11-04T01:38:52.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.967+0000 7fdf3c1fc640 1 --2- 172.21.15.114:0/1010719146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf340c9a40 0x7fdf340c9ed0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.967+0000 7fdf3c1fc640 1 --2- 172.21.15.114:0/1010719146 >> v2:172.21.15.141:3300/0 conn(0x7fdf3415ad80 0x7fdf340abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.967+0000 7fdf3c1fc640 1 -- 172.21.15.114:0/1010719146 >> 172.21.15.114:0/1010719146 conn(0x7fdf340b0cd0 msgr2=0x7fdf340b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:52.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.968+0000 7fdf3c1fc640 1 -- 172.21.15.114:0/1010719146 shutdown_connections 2023-11-04T01:38:52.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.968+0000 7fdf3c1fc640 1 -- 172.21.15.114:0/1010719146 wait complete. 2023-11-04T01:38:52.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.969+0000 7fdf3c1fc640 1 Processor -- start 2023-11-04T01:38:52.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.969+0000 7fdf3c1fc640 1 -- start start 2023-11-04T01:38:52.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.969+0000 7fdf3c1fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3406a1b0 0x7fdf340c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.969+0000 7fdf3c1fc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf340c9a40 0x7fdf34157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.969+0000 7fdf3c1fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3415ad80 0x7fdf34157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.969+0000 7fdf3c1fc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf34143de0 con 0x7fdf3406a1b0 2023-11-04T01:38:52.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.969+0000 7fdf3c1fc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf340c6fa0 con 0x7fdf340c9a40 2023-11-04T01:38:52.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.969+0000 7fdf3c1fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf340c7280 con 0x7fdf3415ad80 2023-11-04T01:38:52.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.969+0000 7fdf39f98640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3406a1b0 0x7fdf340c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.970+0000 7fdf39f98640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3406a1b0 0x7fdf340c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48496/0 (socket says 172.21.15.114:48496) 2023-11-04T01:38:52.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.970+0000 7fdf39f98640 1 -- 172.21.15.114:0/2590753283 learned_addr learned my addr 172.21.15.114:0/2590753283 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:52.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.970+0000 7fdf39797640 1 --2- 172.21.15.114:0/2590753283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf340c9a40 0x7fdf34157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.970+0000 7fdf3a799640 1 --2- 172.21.15.114:0/2590753283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3415ad80 0x7fdf34157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.970+0000 7fdf39f98640 1 -- 172.21.15.114:0/2590753283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3415ad80 msgr2=0x7fdf34157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.970+0000 7fdf39f98640 1 --2- 172.21.15.114:0/2590753283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3415ad80 0x7fdf34157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.970+0000 7fdf39f98640 1 -- 172.21.15.114:0/2590753283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf340c9a40 msgr2=0x7fdf34157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:52.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.970+0000 7fdf39f98640 1 --2- 172.21.15.114:0/2590753283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf340c9a40 0x7fdf34157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:52.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.970+0000 7fdf39f98640 1 -- 172.21.15.114:0/2590753283 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c009a70 con 0x7fdf3406a1b0 2023-11-04T01:38:52.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.970+0000 7fdf39f98640 1 --2- 172.21.15.114:0/2590753283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3406a1b0 0x7fdf340c19e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000c7f0 tx=0x7fdf3000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:52.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.970+0000 7fdf2a7fc640 1 -- 172.21.15.114:0/2590753283 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf30004220 con 0x7fdf3406a1b0 2023-11-04T01:38:52.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.970+0000 7fdf2a7fc640 1 -- 172.21.15.114:0/2590753283 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf300043a0 con 0x7fdf3406a1b0 2023-11-04T01:38:52.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.970+0000 7fdf3c1fc640 1 -- 172.21.15.114:0/2590753283 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf340c7560 con 0x7fdf3406a1b0 2023-11-04T01:38:52.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.970+0000 7fdf2a7fc640 1 -- 172.21.15.114:0/2590753283 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf30007860 con 0x7fdf3406a1b0 2023-11-04T01:38:52.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.970+0000 7fdf3c1fc640 1 -- 172.21.15.114:0/2590753283 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf340c62b0 con 0x7fdf3406a1b0 2023-11-04T01:38:52.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.971+0000 7fdf3c1fc640 1 -- 172.21.15.114:0/2590753283 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf34074290 con 0x7fdf3406a1b0 2023-11-04T01:38:52.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.972+0000 7fdf2a7fc640 1 -- 172.21.15.114:0/2590753283 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf30007bd0 con 0x7fdf3406a1b0 2023-11-04T01:38:52.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.972+0000 7fdf2a7fc640 1 --2- 172.21.15.114:0/2590753283 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf1806ae70 0x7fdf1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:52.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.972+0000 7fdf2a7fc640 1 -- 172.21.15.114:0/2590753283 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdf30089710 con 0x7fdf3406a1b0 2023-11-04T01:38:52.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.972+0000 7fdf39797640 1 --2- 172.21.15.114:0/2590753283 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf1806ae70 0x7fdf1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:52.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.972+0000 7fdf39797640 1 --2- 172.21.15.114:0/2590753283 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf1806ae70 0x7fdf1806d330 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdf340ac9d0 tx=0x7fdf24007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:52.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:52.976+0000 7fdf2a7fc640 1 -- 172.21.15.114:0/2590753283 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf30054660 con 0x7fdf3406a1b0 2023-11-04T01:38:53.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.177+0000 7fdf3c1fc640 1 -- 172.21.15.114:0/2590753283 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf34066320 con 0x7fdf3406a1b0 2023-11-04T01:38:53.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.178+0000 7fdf2a7fc640 1 -- 172.21.15.114:0/2590753283 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fdf30057c80 con 0x7fdf3406a1b0 2023-11-04T01:38:53.179 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:53.180 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5731,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/4055552299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4055552299},{"type":"v1","addr":"172.21.15.141:6835","nonce":4055552299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6471,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/4254364199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":4254364199},{"type":"v1","addr":"172.21.15.114:6836","nonce":4254364199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6474,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3499206733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3499206733},{"type":"v1","addr":"172.21.15.114:6837","nonce":3499206733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:50.176333+0000","modified":"2023-11-04T01:38:52.173738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6486},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6486":{"gid":6486,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6834/1383574171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1383574171},{"type":"v1","addr":"172.21.15.141:6834","nonce":1383574171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:38:53.180 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 29 2023-11-04T01:38:53.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.179+0000 7fdf3c1fc640 1 -- 172.21.15.114:0/2590753283 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf1806ae70 msgr2=0x7fdf1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.179+0000 7fdf3c1fc640 1 --2- 172.21.15.114:0/2590753283 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf1806ae70 0x7fdf1806d330 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdf340ac9d0 tx=0x7fdf24007de0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.179+0000 7fdf3c1fc640 1 -- 172.21.15.114:0/2590753283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3406a1b0 msgr2=0x7fdf340c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.179+0000 7fdf3c1fc640 1 --2- 172.21.15.114:0/2590753283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3406a1b0 0x7fdf340c19e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000c7f0 tx=0x7fdf3000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.179+0000 7fdf3c1fc640 1 -- 172.21.15.114:0/2590753283 shutdown_connections 2023-11-04T01:38:53.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.179+0000 7fdf3c1fc640 1 --2- 172.21.15.114:0/2590753283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3415ad80 0x7fdf34157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.179+0000 7fdf3c1fc640 1 --2- 172.21.15.114:0/2590753283 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf1806ae70 0x7fdf1806d330 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.179+0000 7fdf3c1fc640 1 --2- 172.21.15.114:0/2590753283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf340c9a40 0x7fdf34157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.179+0000 7fdf3c1fc640 1 --2- 172.21.15.114:0/2590753283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3406a1b0 0x7fdf340c19e0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.179+0000 7fdf3c1fc640 1 -- 172.21.15.114:0/2590753283 >> 172.21.15.114:0/2590753283 conn(0x7fdf340b0cd0 msgr2=0x7fdf341556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:53.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.180+0000 7fdf3c1fc640 1 -- 172.21.15.114:0/2590753283 shutdown_connections 2023-11-04T01:38:53.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.180+0000 7fdf3c1fc640 1 -- 172.21.15.114:0/2590753283 wait complete. 2023-11-04T01:38:53.192 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:38:53.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.290+0000 7f709cdc9640 1 Processor -- start 2023-11-04T01:38:53.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.290+0000 7f709cdc9640 1 -- start start 2023-11-04T01:38:53.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709cdc9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f70980cb5c0 0x7f70980ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709cdc9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709806a120 con 0x7f709815ce70 2023-11-04T01:38:53.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709cdc9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70980c9f40 con 0x7f709815d250 2023-11-04T01:38:53.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709cdc9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70980cdc10 con 0x7f70980cb5c0 2023-11-04T01:38:53.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709659c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f709815ce70 0x7f709806d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41832/0 (socket says 172.21.15.114:41832) 2023-11-04T01:38:53.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709659c640 1 -- 172.21.15.114:0/2714062387 learned_addr learned my addr 172.21.15.114:0/2714062387 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:53.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709559a640 1 -- 172.21.15.114:0/2714062387 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978800723 0 0) 0x7f709806a120 con 0x7f709815ce70 2023-11-04T01:38:53.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709559a640 1 -- 172.21.15.114:0/2714062387 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7080003520 con 0x7f709815ce70 2023-11-04T01:38:53.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f7096d9d640 1 --2- 172.21.15.114:0/2714062387 >> v2:172.21.15.141:3300/0 conn(0x7f70980cb5c0 0x7f70980ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709559a640 1 -- 172.21.15.114:0/2714062387 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 294173234 0 0) 0x7f7080003520 con 0x7f709815ce70 2023-11-04T01:38:53.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709559a640 1 -- 172.21.15.114:0/2714062387 >> v2:172.21.15.141:3300/0 conn(0x7f70980cb5c0 msgr2=0x7f70980ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:53.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709559a640 1 --2- 172.21.15.114:0/2714062387 >> v2:172.21.15.141:3300/0 conn(0x7f70980cb5c0 0x7f70980ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709559a640 1 -- 172.21.15.114:0/2714062387 >> v1:172.21.15.141:6789/0 conn(0x7f709815d250 legacy=0x7f70980c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709559a640 1 -- 172.21.15.114:0/2714062387 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709806a370 con 0x7f709815ce70 2023-11-04T01:38:53.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709559a640 1 -- 172.21.15.114:0/2714062387 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f7088001670 con 0x7f709815ce70 2023-11-04T01:38:53.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709559a640 1 -- 172.21.15.114:0/2714062387 >> v1:172.21.15.114:6789/0 conn(0x7f709815ce70 legacy=0x7f709806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709559a640 1 --2- 172.21.15.114:0/2714062387 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70800039c0 0x7f7080003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709559a640 1 --2- 172.21.15.114:0/2714062387 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70800047c0 0x7f7080004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.291+0000 7f709559a640 1 --2- 172.21.15.114:0/2714062387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7080005180 0x7f708000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.292+0000 7f709559a640 1 -- 172.21.15.114:0/2714062387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70980cdc10 con 0x7f7080005180 2023-11-04T01:38:53.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.292+0000 7f709559a640 1 -- 172.21.15.114:0/2714062387 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708000c080 con 0x7f70800047c0 2023-11-04T01:38:53.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.292+0000 7f709559a640 1 -- 172.21.15.114:0/2714062387 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708000c240 con 0x7f70800039c0 2023-11-04T01:38:53.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.292+0000 7f7096d9d640 1 --2- 172.21.15.114:0/2714062387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7080005180 0x7f708000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.292+0000 7f709659c640 1 --2- 172.21.15.114:0/2714062387 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70800039c0 0x7f7080003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.292+0000 7f7095d9b640 1 --2- 172.21.15.114:0/2714062387 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70800047c0 0x7f7080004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.292+0000 7f7096d9d640 1 -- 172.21.15.114:0/2714062387 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70800039c0 msgr2=0x7f7080003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:53.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.292+0000 7f7096d9d640 1 --2- 172.21.15.114:0/2714062387 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70800039c0 0x7f7080003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.292+0000 7f7096d9d640 1 -- 172.21.15.114:0/2714062387 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70800047c0 msgr2=0x7f7080004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:53.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.292+0000 7f7096d9d640 1 --2- 172.21.15.114:0/2714062387 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70800047c0 0x7f7080004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.292+0000 7f7096d9d640 1 -- 172.21.15.114:0/2714062387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7080003520 con 0x7f7080005180 2023-11-04T01:38:53.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.292+0000 7f709659c640 1 --2- 172.21.15.114:0/2714062387 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70800039c0 0x7f7080003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:53.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.292+0000 7f7096d9d640 1 -- 172.21.15.114:0/2714062387 reap_dead start 2023-11-04T01:38:53.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.293+0000 7f7096d9d640 1 --2- 172.21.15.114:0/2714062387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7080005180 0x7f708000b980 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f7090009fc0 tx=0x7f70800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7484b4d496e6c2b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.293+0000 7f709559a640 1 -- 172.21.15.114:0/2714062387 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709002cc60 con 0x7f7080005180 2023-11-04T01:38:53.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.293+0000 7f709559a640 1 -- 172.21.15.114:0/2714062387 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709000f040 con 0x7f7080005180 2023-11-04T01:38:53.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.293+0000 7f709559a640 1 -- 172.21.15.114:0/2714062387 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090003990 con 0x7f7080005180 2023-11-04T01:38:53.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.293+0000 7f709cdc9640 1 -- 172.21.15.114:0/2714062387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7080005180 msgr2=0x7f708000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.293+0000 7f709cdc9640 1 --2- 172.21.15.114:0/2714062387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7080005180 0x7f708000b980 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f7090009fc0 tx=0x7f70800057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.293+0000 7f709cdc9640 1 -- 172.21.15.114:0/2714062387 shutdown_connections 2023-11-04T01:38:53.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.293+0000 7f709cdc9640 1 --2- 172.21.15.114:0/2714062387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7080005180 0x7f708000b980 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.293+0000 7f709cdc9640 1 -- 172.21.15.114:0/2714062387 >> 172.21.15.114:0/2714062387 conn(0x7f70980b0cd0 msgr2=0x7f70980b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:53.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.293+0000 7f709cdc9640 1 -- 172.21.15.114:0/2714062387 shutdown_connections 2023-11-04T01:38:53.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.293+0000 7f709cdc9640 1 -- 172.21.15.114:0/2714062387 wait complete. 2023-11-04T01:38:53.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.295+0000 7f709cdc9640 1 Processor -- start 2023-11-04T01:38:53.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.295+0000 7f709cdc9640 1 -- start start 2023-11-04T01:38:53.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.295+0000 7f709cdc9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7080005180 0x7f70981e35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.295+0000 7f709cdc9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70981e3ae0 0x7f70981e4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.295+0000 7f709cdc9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70981e4bb0 0x7f7098140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.295+0000 7f709cdc9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70981e5030 con 0x7f70981e4bb0 2023-11-04T01:38:53.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.295+0000 7f709cdc9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70981e2500 con 0x7f70981e3ae0 2023-11-04T01:38:53.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.295+0000 7f709cdc9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70981e27e0 con 0x7f7080005180 2023-11-04T01:38:53.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.295+0000 7f7096d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70981e4bb0 0x7f7098140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.295+0000 7f7096d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70981e4bb0 0x7f7098140310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48508/0 (socket says 172.21.15.114:48508) 2023-11-04T01:38:53.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.295+0000 7f7096d9d640 1 -- 172.21.15.114:0/2833158204 learned_addr learned my addr 172.21.15.114:0/2833158204 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:53.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.296+0000 7f7095d9b640 1 --2- 172.21.15.114:0/2833158204 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70981e3ae0 0x7f70981e4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.296+0000 7f709659c640 1 --2- 172.21.15.114:0/2833158204 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7080005180 0x7f70981e35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.296+0000 7f7096d9d640 1 -- 172.21.15.114:0/2833158204 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7080005180 msgr2=0x7f70981e35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.296+0000 7f7096d9d640 1 --2- 172.21.15.114:0/2833158204 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7080005180 0x7f70981e35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.296+0000 7f7096d9d640 1 -- 172.21.15.114:0/2833158204 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70981e3ae0 msgr2=0x7f70981e4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.296+0000 7f7096d9d640 1 --2- 172.21.15.114:0/2833158204 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70981e3ae0 0x7f70981e4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.296+0000 7f7096d9d640 1 -- 172.21.15.114:0/2833158204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70981e2ac0 con 0x7f70981e4bb0 2023-11-04T01:38:53.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.296+0000 7f709659c640 1 --2- 172.21.15.114:0/2833158204 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7080005180 0x7f70981e35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:53.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.296+0000 7f7095d9b640 1 --2- 172.21.15.114:0/2833158204 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70981e3ae0 0x7f70981e4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:53.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.296+0000 7f7096d9d640 1 --2- 172.21.15.114:0/2833158204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70981e4bb0 0x7f7098140310 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f709002c6d0 tx=0x7f7090009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.296+0000 7f7086ffd640 1 -- 172.21.15.114:0/2833158204 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090035dc0 con 0x7f70981e4bb0 2023-11-04T01:38:53.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.296+0000 7f7086ffd640 1 -- 172.21.15.114:0/2833158204 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7090003990 con 0x7f70981e4bb0 2023-11-04T01:38:53.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.296+0000 7f7086ffd640 1 -- 172.21.15.114:0/2833158204 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090003d80 con 0x7f70981e4bb0 2023-11-04T01:38:53.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.296+0000 7f709cdc9640 1 -- 172.21.15.114:0/2833158204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70981e2da0 con 0x7f70981e4bb0 2023-11-04T01:38:53.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.296+0000 7f709cdc9640 1 -- 172.21.15.114:0/2833158204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7098152b00 con 0x7f70981e4bb0 2023-11-04T01:38:53.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.297+0000 7f709cdc9640 1 -- 172.21.15.114:0/2833158204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70981e32c0 con 0x7f70981e4bb0 2023-11-04T01:38:53.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.297+0000 7f7086ffd640 1 -- 172.21.15.114:0/2833158204 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7090004030 con 0x7f70981e4bb0 2023-11-04T01:38:53.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.298+0000 7f7086ffd640 1 --2- 172.21.15.114:0/2833158204 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f707806aea0 0x7f707806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.298+0000 7f7086ffd640 1 -- 172.21.15.114:0/2833158204 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f70900ac590 con 0x7f70981e4bb0 2023-11-04T01:38:53.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.298+0000 7f709659c640 1 --2- 172.21.15.114:0/2833158204 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f707806aea0 0x7f707806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.298+0000 7f709659c640 1 --2- 172.21.15.114:0/2833158204 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f707806aea0 0x7f707806d360 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7088000c00 tx=0x7f7088009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.302+0000 7f7086ffd640 1 -- 172.21.15.114:0/2833158204 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f70981e32c0 con 0x7f70981e4bb0 2023-11-04T01:38:53.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.470+0000 7f709cdc9640 1 -- 172.21.15.114:0/2833158204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70981e32c0 con 0x7f70981e4bb0 2023-11-04T01:38:53.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.471+0000 7f7086ffd640 1 -- 172.21.15.114:0/2833158204 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+18586 (secure 0 0 0) 0x7f70981e32c0 con 0x7f70981e4bb0 2023-11-04T01:38:53.473 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:53.473 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":66,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:38:51.561477+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:48.665033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:49.137709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:38:53.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.473+0000 7f709cdc9640 1 -- 172.21.15.114:0/2833158204 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f707806aea0 msgr2=0x7f707806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.473+0000 7f709cdc9640 1 --2- 172.21.15.114:0/2833158204 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f707806aea0 0x7f707806d360 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7088000c00 tx=0x7f7088009040 comp rx=0 tx=0).stop 2023-11-04T01:38:53.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.473+0000 7f709cdc9640 1 -- 172.21.15.114:0/2833158204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70981e4bb0 msgr2=0x7f7098140310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.473+0000 7f709cdc9640 1 --2- 172.21.15.114:0/2833158204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70981e4bb0 0x7f7098140310 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f709002c6d0 tx=0x7f7090009750 comp rx=0 tx=0).stop 2023-11-04T01:38:53.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.473+0000 7f709cdc9640 1 -- 172.21.15.114:0/2833158204 shutdown_connections 2023-11-04T01:38:53.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.473+0000 7f709cdc9640 1 --2- 172.21.15.114:0/2833158204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70981e4bb0 0x7f7098140310 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.473+0000 7f709cdc9640 1 --2- 172.21.15.114:0/2833158204 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f707806aea0 0x7f707806d360 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.473+0000 7f709cdc9640 1 --2- 172.21.15.114:0/2833158204 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70981e3ae0 0x7f70981e4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.473+0000 7f709cdc9640 1 --2- 172.21.15.114:0/2833158204 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7080005180 0x7f70981e35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.473+0000 7f709cdc9640 1 -- 172.21.15.114:0/2833158204 >> 172.21.15.114:0/2833158204 conn(0x7f70980b0cd0 msgr2=0x7f70980adce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.473+0000 7f709cdc9640 1 -- 172.21.15.114:0/2833158204 shutdown_connections 2023-11-04T01:38:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.473+0000 7f709cdc9640 1 -- 172.21.15.114:0/2833158204 wait complete. 2023-11-04T01:38:53.486 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:38:53.486 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:38:53.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.583+0000 7f32c2fdc640 1 Processor -- start 2023-11-04T01:38:53.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.583+0000 7f32c2fdc640 1 -- start start 2023-11-04T01:38:53.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.584+0000 7f32c2fdc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f32bc159c70 0x7f32bc0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.584+0000 7f32c2fdc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f32bc0b0ae0 0x7f32bc15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.584+0000 7f32c2fdc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32bc0b4110 con 0x7f32bc06db20 2023-11-04T01:38:53.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.584+0000 7f32c2fdc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32bc0b49b0 con 0x7f32bc0b0ae0 2023-11-04T01:38:53.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.584+0000 7f32c2fdc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32bc0b43f0 con 0x7f32bc159c70 2023-11-04T01:38:53.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.584+0000 7f32c1579640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f32bc0b0ae0 0x7f32bc15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.584+0000 7f32c1579640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f32bc0b0ae0 0x7f32bc15d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48522/0 (socket says 172.21.15.114:48522) 2023-11-04T01:38:53.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.584+0000 7f32c1579640 1 -- 172.21.15.114:0/1042958167 learned_addr learned my addr 172.21.15.114:0/1042958167 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:53.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.585+0000 7f32c0d78640 1 --2- 172.21.15.114:0/1042958167 >> v2:172.21.15.141:3300/0 conn(0x7f32bc159c70 0x7f32bc0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.585+0000 7f32c1579640 1 -- 172.21.15.114:0/1042958167 >> v2:172.21.15.141:3300/0 conn(0x7f32bc159c70 msgr2=0x7f32bc0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:53.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.585+0000 7f32c1579640 1 --2- 172.21.15.114:0/1042958167 >> v2:172.21.15.141:3300/0 conn(0x7f32bc159c70 0x7f32bc0ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.585+0000 7f32c1579640 1 -- 172.21.15.114:0/1042958167 >> v1:172.21.15.141:6789/0 conn(0x7f32bc06db20 legacy=0x7f32bc0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:53.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.585+0000 7f32c1579640 1 -- 172.21.15.114:0/1042958167 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc0b46d0 con 0x7f32bc0b0ae0 2023-11-04T01:38:53.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.585+0000 7f32c1579640 1 --2- 172.21.15.114:0/1042958167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32bc0b0ae0 0x7f32bc15d7d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0cc440 tx=0x7f32b402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c28fdf25dce4733 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.585+0000 7f32bb7fe640 1 -- 172.21.15.114:0/1042958167 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b402ca80 con 0x7f32bc0b0ae0 2023-11-04T01:38:53.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.586+0000 7f32bb7fe640 1 -- 172.21.15.114:0/1042958167 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b402cbe0 con 0x7f32bc0b0ae0 2023-11-04T01:38:53.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.586+0000 7f32bb7fe640 1 -- 172.21.15.114:0/1042958167 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40343f0 con 0x7f32bc0b0ae0 2023-11-04T01:38:53.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.586+0000 7f32c2fdc640 1 -- 172.21.15.114:0/1042958167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32bc0b0ae0 msgr2=0x7f32bc15d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.586+0000 7f32c2fdc640 1 --2- 172.21.15.114:0/1042958167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32bc0b0ae0 0x7f32bc15d7d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0cc440 tx=0x7f32b402bee0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.586+0000 7f32c2fdc640 1 -- 172.21.15.114:0/1042958167 shutdown_connections 2023-11-04T01:38:53.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.586+0000 7f32c2fdc640 1 --2- 172.21.15.114:0/1042958167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32bc0b0ae0 0x7f32bc15d7d0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.586+0000 7f32c2fdc640 1 --2- 172.21.15.114:0/1042958167 >> v2:172.21.15.141:3300/0 conn(0x7f32bc159c70 0x7f32bc0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.586+0000 7f32c2fdc640 1 -- 172.21.15.114:0/1042958167 >> 172.21.15.114:0/1042958167 conn(0x7f32bc0ce950 msgr2=0x7f32bc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:53.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.586+0000 7f32c2fdc640 1 -- 172.21.15.114:0/1042958167 shutdown_connections 2023-11-04T01:38:53.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.586+0000 7f32c2fdc640 1 -- 172.21.15.114:0/1042958167 wait complete. 2023-11-04T01:38:53.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.587+0000 7f32c2fdc640 1 Processor -- start 2023-11-04T01:38:53.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.587+0000 7f32c2fdc640 1 -- start start 2023-11-04T01:38:53.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.588+0000 7f32c2fdc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32bc06db20 0x7f32bc1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.588+0000 7f32c2fdc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32bc0b0ae0 0x7f32bc1e49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.588+0000 7f32c2fdc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32bc159c70 0x7f32bc1e4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.588+0000 7f32c2fdc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc158310 con 0x7f32bc0b0ae0 2023-11-04T01:38:53.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.588+0000 7f32c2fdc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc1e5560 con 0x7f32bc06db20 2023-11-04T01:38:53.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.588+0000 7f32c2fdc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc1e3510 con 0x7f32bc159c70 2023-11-04T01:38:53.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.588+0000 7f32bbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32bc0b0ae0 0x7f32bc1e49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.588+0000 7f32bbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32bc0b0ae0 0x7f32bc1e49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48536/0 (socket says 172.21.15.114:48536) 2023-11-04T01:38:53.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.588+0000 7f32bbfff640 1 -- 172.21.15.114:0/1074424151 learned_addr learned my addr 172.21.15.114:0/1074424151 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:53.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.588+0000 7f32bbfff640 1 -- 172.21.15.114:0/1074424151 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32bc159c70 msgr2=0x7f32bc1e4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.588+0000 7f32bbfff640 1 --2- 172.21.15.114:0/1074424151 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32bc159c70 0x7f32bc1e4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.588+0000 7f32bbfff640 1 -- 172.21.15.114:0/1074424151 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32bc06db20 msgr2=0x7f32bc1579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.588+0000 7f32c0d78640 1 --2- 172.21.15.114:0/1074424151 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32bc06db20 0x7f32bc1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.588+0000 7f32bbfff640 1 --2- 172.21.15.114:0/1074424151 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32bc06db20 0x7f32bc1579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.588+0000 7f32bbfff640 1 -- 172.21.15.114:0/1074424151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b4009b30 con 0x7f32bc0b0ae0 2023-11-04T01:38:53.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.589+0000 7f32bbfff640 1 --2- 172.21.15.114:0/1074424151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32bc0b0ae0 0x7f32bc1e49a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f32b000b3e0 tx=0x7f32b000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.589+0000 7f32b97fa640 1 -- 172.21.15.114:0/1074424151 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0011830 con 0x7f32bc0b0ae0 2023-11-04T01:38:53.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.589+0000 7f32b97fa640 1 -- 172.21.15.114:0/1074424151 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b00119b0 con 0x7f32bc0b0ae0 2023-11-04T01:38:53.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.589+0000 7f32c2fdc640 1 -- 172.21.15.114:0/1074424151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32bc1e37f0 con 0x7f32bc0b0ae0 2023-11-04T01:38:53.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.589+0000 7f32b97fa640 1 -- 172.21.15.114:0/1074424151 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0011d60 con 0x7f32bc0b0ae0 2023-11-04T01:38:53.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.589+0000 7f32c2fdc640 1 -- 172.21.15.114:0/1074424151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32bc1e3ff0 con 0x7f32bc0b0ae0 2023-11-04T01:38:53.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.590+0000 7f32c2fdc640 1 -- 172.21.15.114:0/1074424151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32bc1e3d10 con 0x7f32bc0b0ae0 2023-11-04T01:38:53.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.590+0000 7f32b97fa640 1 -- 172.21.15.114:0/1074424151 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f32b001a400 con 0x7f32bc0b0ae0 2023-11-04T01:38:53.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.591+0000 7f32b97fa640 1 --2- 172.21.15.114:0/1074424151 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f32a806ae70 0x7f32a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.591+0000 7f32c0d78640 1 --2- 172.21.15.114:0/1074424151 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f32a806ae70 0x7f32a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.591+0000 7f32b97fa640 1 -- 172.21.15.114:0/1074424151 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f32b0089aa0 con 0x7f32bc0b0ae0 2023-11-04T01:38:53.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.591+0000 7f32c0d78640 1 --2- 172.21.15.114:0/1074424151 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f32a806ae70 0x7f32a806d330 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f32ac006fd0 tx=0x7f32ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.595+0000 7f32b97fa640 1 -- 172.21.15.114:0/1074424151 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f32bc1e3d10 con 0x7f32bc0b0ae0 2023-11-04T01:38:53.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.758+0000 7f32c2fdc640 1 -- 172.21.15.114:0/1074424151 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32bc0c97d0 con 0x7f32a806ae70 2023-11-04T01:38:53.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.766+0000 7f32b97fa640 1 -- 172.21.15.114:0/1074424151 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355370 (secure 0 0 0) 0x7f32bc0c97d0 con 0x7f32a806ae70 2023-11-04T01:38:53.772 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:53.774 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:38:53.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.770+0000 7f32c2fdc640 1 -- 172.21.15.114:0/1074424151 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f32a806ae70 msgr2=0x7f32a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.770+0000 7f32c2fdc640 1 --2- 172.21.15.114:0/1074424151 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f32a806ae70 0x7f32a806d330 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f32ac006fd0 tx=0x7f32ac008040 comp rx=0 tx=0).stop 2023-11-04T01:38:53.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.770+0000 7f32c2fdc640 1 -- 172.21.15.114:0/1074424151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32bc0b0ae0 msgr2=0x7f32bc1e49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.770+0000 7f32c2fdc640 1 --2- 172.21.15.114:0/1074424151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32bc0b0ae0 0x7f32bc1e49a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f32b000b3e0 tx=0x7f32b000b8a0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.770+0000 7f32c2fdc640 1 -- 172.21.15.114:0/1074424151 shutdown_connections 2023-11-04T01:38:53.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.770+0000 7f32c2fdc640 1 --2- 172.21.15.114:0/1074424151 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f32bc159c70 0x7f32bc1e4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.770+0000 7f32c2fdc640 1 --2- 172.21.15.114:0/1074424151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32bc0b0ae0 0x7f32bc1e49a0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.770+0000 7f32c2fdc640 1 --2- 172.21.15.114:0/1074424151 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f32a806ae70 0x7f32a806d330 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.770+0000 7f32c2fdc640 1 --2- 172.21.15.114:0/1074424151 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f32bc06db20 0x7f32bc1579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.770+0000 7f32c2fdc640 1 -- 172.21.15.114:0/1074424151 >> 172.21.15.114:0/1074424151 conn(0x7f32bc0ce950 msgr2=0x7f32bc15bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:53.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.770+0000 7f32c2fdc640 1 -- 172.21.15.114:0/1074424151 shutdown_connections 2023-11-04T01:38:53.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.770+0000 7f32c2fdc640 1 -- 172.21.15.114:0/1074424151 wait complete. 2023-11-04T01:38:53.783 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2023-11-04T01:38:51.887169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223096,"kb_used_data":6896,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751624,"statfs":{"total":773094113280,"available":772865662976,"internally_reserved":0,"allocated":7061504,"data_stored":3860560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000680"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:38:46.769561+0000","last_change":"2023-11-04T01:38:02.156342+0000","last_active":"2023-11-04T01:38:46.769561+0000","last_peered":"2023-11-04T01:38:46.769561+0000","last_clean":"2023-11-04T01:38:46.769561+0000","last_became_active":"2023-11-04T01:38:00.708159+0000","last_became_peered":"2023-11-04T01:38:00.708159+0000","last_unstale":"2023-11-04T01:38:46.769561+0000","last_undegraded":"2023-11-04T01:38:46.769561+0000","last_fullsized":"2023-11-04T01:38:46.769561+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000435213,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:38:45.808232+0000","last_change":"2023-11-04T01:38:02.362289+0000","last_active":"2023-11-04T01:38:45.808232+0000","last_peered":"2023-11-04T01:38:45.808232+0000","last_clean":"2023-11-04T01:38:45.808232+0000","last_became_active":"2023-11-04T01:38:00.710033+0000","last_became_peered":"2023-11-04T01:38:00.710033+0000","last_unstale":"2023-11-04T01:38:45.808232+0000","last_undegraded":"2023-11-04T01:38:45.808232+0000","last_fullsized":"2023-11-04T01:38:45.808232+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046467500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":37,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:45.809024+0000","last_change":"2023-11-04T01:38:01.699171+0000","last_active":"2023-11-04T01:38:45.809024+0000","last_peered":"2023-11-04T01:38:45.809024+0000","last_clean":"2023-11-04T01:38:45.809024+0000","last_became_active":"2023-11-04T01:38:00.703927+0000","last_became_peered":"2023-11-04T01:38:00.703927+0000","last_unstale":"2023-11-04T01:38:45.809024+0000","last_undegraded":"2023-11-04T01:38:45.809024+0000","last_fullsized":"2023-11-04T01:38:45.809024+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072585499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:38:46.769364+0000","last_change":"2023-11-04T01:38:02.156160+0000","last_active":"2023-11-04T01:38:46.769364+0000","last_peered":"2023-11-04T01:38:46.769364+0000","last_clean":"2023-11-04T01:38:46.769364+0000","last_became_active":"2023-11-04T01:38:00.709137+0000","last_became_peered":"2023-11-04T01:38:00.709137+0000","last_unstale":"2023-11-04T01:38:46.769364+0000","last_undegraded":"2023-11-04T01:38:46.769364+0000","last_fullsized":"2023-11-04T01:38:46.769364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028239399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":37,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:45.809071+0000","last_change":"2023-11-04T01:38:01.698196+0000","last_active":"2023-11-04T01:38:45.809071+0000","last_peered":"2023-11-04T01:38:45.809071+0000","last_clean":"2023-11-04T01:38:45.809071+0000","last_became_active":"2023-11-04T01:38:00.705451+0000","last_became_peered":"2023-11-04T01:38:00.705451+0000","last_unstale":"2023-11-04T01:38:45.809071+0000","last_undegraded":"2023-11-04T01:38:45.809071+0000","last_fullsized":"2023-11-04T01:38:45.809071+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:16.759249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067668100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:47.574825+0000","last_change":"2023-11-04T01:38:01.983991+0000","last_active":"2023-11-04T01:38:47.574825+0000","last_peered":"2023-11-04T01:38:47.574825+0000","last_clean":"2023-11-04T01:38:47.574825+0000","last_became_active":"2023-11-04T01:38:00.708462+0000","last_became_peered":"2023-11-04T01:38:00.708462+0000","last_unstale":"2023-11-04T01:38:47.574825+0000","last_undegraded":"2023-11-04T01:38:47.574825+0000","last_fullsized":"2023-11-04T01:38:47.574825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:37.727651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041811600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:47.574890+0000","last_change":"2023-11-04T01:38:01.984341+0000","last_active":"2023-11-04T01:38:47.574890+0000","last_peered":"2023-11-04T01:38:47.574890+0000","last_clean":"2023-11-04T01:38:47.574890+0000","last_became_active":"2023-11-04T01:38:00.708307+0000","last_became_peered":"2023-11-04T01:38:00.708307+0000","last_unstale":"2023-11-04T01:38:47.574890+0000","last_undegraded":"2023-11-04T01:38:47.574890+0000","last_fullsized":"2023-11-04T01:38:47.574890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:17.369098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053627199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":35,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:45.808753+0000","last_change":"2023-11-04T01:38:01.700471+0000","last_active":"2023-11-04T01:38:45.808753+0000","last_peered":"2023-11-04T01:38:45.808753+0000","last_clean":"2023-11-04T01:38:45.808753+0000","last_became_active":"2023-11-04T01:38:00.702522+0000","last_became_peered":"2023-11-04T01:38:00.702522+0000","last_unstale":"2023-11-04T01:38:45.808753+0000","last_undegraded":"2023-11-04T01:38:45.808753+0000","last_fullsized":"2023-11-04T01:38:45.808753+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086940300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":34,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:46.768954+0000","last_change":"2023-11-04T01:38:01.696901+0000","last_active":"2023-11-04T01:38:46.768954+0000","last_peered":"2023-11-04T01:38:46.768954+0000","last_clean":"2023-11-04T01:38:46.768954+0000","last_became_active":"2023-11-04T01:38:00.706170+0000","last_became_peered":"2023-11-04T01:38:00.706170+0000","last_unstale":"2023-11-04T01:38:46.768954+0000","last_undegraded":"2023-11-04T01:38:46.768954+0000","last_fullsized":"2023-11-04T01:38:46.768954+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059391100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":32,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:38:45.808259+0000","last_change":"2023-11-04T01:38:01.939972+0000","last_active":"2023-11-04T01:38:45.808259+0000","last_peered":"2023-11-04T01:38:45.808259+0000","last_clean":"2023-11-04T01:38:45.808259+0000","last_became_active":"2023-11-04T01:38:00.702784+0000","last_became_peered":"2023-11-04T01:38:00.702784+0000","last_unstale":"2023-11-04T01:38:45.808259+0000","last_undegraded":"2023-11-04T01:38:45.808259+0000","last_fullsized":"2023-11-04T01:38:45.808259+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:26.760402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071328600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":34,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:46.768997+0000","last_change":"2023-11-04T01:38:01.699051+0000","last_active":"2023-11-04T01:38:46.768997+0000","last_peered":"2023-11-04T01:38:46.768997+0000","last_clean":"2023-11-04T01:38:46.768997+0000","last_became_active":"2023-11-04T01:38:00.708665+0000","last_became_peered":"2023-11-04T01:38:00.708665+0000","last_unstale":"2023-11-04T01:38:46.768997+0000","last_undegraded":"2023-11-04T01:38:46.768997+0000","last_fullsized":"2023-11-04T01:38:46.768997+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020995580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":35,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:45.808797+0000","last_change":"2023-11-04T01:38:01.700742+0000","last_active":"2023-11-04T01:38:45.808797+0000","last_peered":"2023-11-04T01:38:45.808797+0000","last_clean":"2023-11-04T01:38:45.808797+0000","last_became_active":"2023-11-04T01:38:00.706671+0000","last_became_peered":"2023-11-04T01:38:00.706671+0000","last_unstale":"2023-11-04T01:38:45.808797+0000","last_undegraded":"2023-11-04T01:38:45.808797+0000","last_fullsized":"2023-11-04T01:38:45.808797+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072370699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":34,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:46.768941+0000","last_change":"2023-11-04T01:38:01.697526+0000","last_active":"2023-11-04T01:38:46.768941+0000","last_peered":"2023-11-04T01:38:46.768941+0000","last_clean":"2023-11-04T01:38:46.768941+0000","last_became_active":"2023-11-04T01:38:00.707580+0000","last_became_peered":"2023-11-04T01:38:00.707580+0000","last_unstale":"2023-11-04T01:38:46.768941+0000","last_undegraded":"2023-11-04T01:38:46.768941+0000","last_fullsized":"2023-11-04T01:38:46.768941+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010806699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":32,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:38:45.808082+0000","last_change":"2023-11-04T01:38:01.939462+0000","last_active":"2023-11-04T01:38:45.808082+0000","last_peered":"2023-11-04T01:38:45.808082+0000","last_clean":"2023-11-04T01:38:45.808082+0000","last_became_active":"2023-11-04T01:38:00.705830+0000","last_became_peered":"2023-11-04T01:38:00.705830+0000","last_unstale":"2023-11-04T01:38:45.808082+0000","last_undegraded":"2023-11-04T01:38:45.808082+0000","last_fullsized":"2023-11-04T01:38:45.808082+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059305000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:47.574977+0000","last_change":"2023-11-04T01:38:01.984456+0000","last_active":"2023-11-04T01:38:47.574977+0000","last_peered":"2023-11-04T01:38:47.574977+0000","last_clean":"2023-11-04T01:38:47.574977+0000","last_became_active":"2023-11-04T01:38:00.708803+0000","last_became_peered":"2023-11-04T01:38:00.708803+0000","last_unstale":"2023-11-04T01:38:47.574977+0000","last_undegraded":"2023-11-04T01:38:47.574977+0000","last_fullsized":"2023-11-04T01:38:47.574977+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:30.811033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061551599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":37,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:45.808986+0000","last_change":"2023-11-04T01:38:01.698866+0000","last_active":"2023-11-04T01:38:45.808986+0000","last_peered":"2023-11-04T01:38:45.808986+0000","last_clean":"2023-11-04T01:38:45.808986+0000","last_became_active":"2023-11-04T01:38:00.706149+0000","last_became_peered":"2023-11-04T01:38:00.706149+0000","last_unstale":"2023-11-04T01:38:45.808986+0000","last_undegraded":"2023-11-04T01:38:45.808986+0000","last_fullsized":"2023-11-04T01:38:45.808986+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:59.391683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001344154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":37,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:45.809066+0000","last_change":"2023-11-04T01:38:01.699187+0000","last_active":"2023-11-04T01:38:45.809066+0000","last_peered":"2023-11-04T01:38:45.809066+0000","last_clean":"2023-11-04T01:38:45.809066+0000","last_became_active":"2023-11-04T01:38:00.706136+0000","last_became_peered":"2023-11-04T01:38:00.706136+0000","last_unstale":"2023-11-04T01:38:45.809066+0000","last_undegraded":"2023-11-04T01:38:45.809066+0000","last_fullsized":"2023-11-04T01:38:45.809066+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074666999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":37,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:45.809003+0000","last_change":"2023-11-04T01:38:01.699630+0000","last_active":"2023-11-04T01:38:45.809003+0000","last_peered":"2023-11-04T01:38:45.809003+0000","last_clean":"2023-11-04T01:38:45.809003+0000","last_became_active":"2023-11-04T01:38:00.702550+0000","last_became_peered":"2023-11-04T01:38:00.702550+0000","last_unstale":"2023-11-04T01:38:45.809003+0000","last_undegraded":"2023-11-04T01:38:45.809003+0000","last_fullsized":"2023-11-04T01:38:45.809003+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001016077,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:47.574932+0000","last_change":"2023-11-04T01:38:01.984764+0000","last_active":"2023-11-04T01:38:47.574932+0000","last_peered":"2023-11-04T01:38:47.574932+0000","last_clean":"2023-11-04T01:38:47.574932+0000","last_became_active":"2023-11-04T01:38:00.709894+0000","last_became_peered":"2023-11-04T01:38:00.709894+0000","last_unstale":"2023-11-04T01:38:47.574932+0000","last_undegraded":"2023-11-04T01:38:47.574932+0000","last_fullsized":"2023-11-04T01:38:47.574932+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:08:42.829255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045046799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":31,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-04T01:38:42.042034+0000","last_change":"2023-11-04T01:38:02.321871+0000","last_active":"2023-11-04T01:38:42.042034+0000","last_peered":"2023-11-04T01:38:42.042034+0000","last_clean":"2023-11-04T01:38:42.042034+0000","last_became_active":"2023-11-04T01:38:00.708407+0000","last_became_peered":"2023-11-04T01:38:00.708407+0000","last_unstale":"2023-11-04T01:38:42.042034+0000","last_undegraded":"2023-11-04T01:38:42.042034+0000","last_fullsized":"2023-11-04T01:38:42.042034+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:48.672429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032387200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:47.574856+0000","last_change":"2023-11-04T01:38:01.983988+0000","last_active":"2023-11-04T01:38:47.574856+0000","last_peered":"2023-11-04T01:38:47.574856+0000","last_clean":"2023-11-04T01:38:47.574856+0000","last_became_active":"2023-11-04T01:38:00.711020+0000","last_became_peered":"2023-11-04T01:38:00.711020+0000","last_unstale":"2023-11-04T01:38:47.574856+0000","last_undegraded":"2023-11-04T01:38:47.574856+0000","last_fullsized":"2023-11-04T01:38:47.574856+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:06.374078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-11-04T01:38:42.038593+0000","last_change":"2023-11-04T01:38:02.321641+0000","last_active":"2023-11-04T01:38:42.038593+0000","last_peered":"2023-11-04T01:38:42.038593+0000","last_clean":"2023-11-04T01:38:42.038593+0000","last_became_active":"2023-11-04T01:38:00.706199+0000","last_became_peered":"2023-11-04T01:38:00.706199+0000","last_unstale":"2023-11-04T01:38:42.038593+0000","last_undegraded":"2023-11-04T01:38:42.038593+0000","last_fullsized":"2023-11-04T01:38:42.038593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:15.138325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045080400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:38:46.769332+0000","last_change":"2023-11-04T01:38:02.156148+0000","last_active":"2023-11-04T01:38:46.769332+0000","last_peered":"2023-11-04T01:38:46.769332+0000","last_clean":"2023-11-04T01:38:46.769332+0000","last_became_active":"2023-11-04T01:38:00.708352+0000","last_became_peered":"2023-11-04T01:38:00.708352+0000","last_unstale":"2023-11-04T01:38:46.769332+0000","last_undegraded":"2023-11-04T01:38:46.769332+0000","last_fullsized":"2023-11-04T01:38:46.769332+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035716799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":32,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:38:45.808081+0000","last_change":"2023-11-04T01:38:01.939729+0000","last_active":"2023-11-04T01:38:45.808081+0000","last_peered":"2023-11-04T01:38:45.808081+0000","last_clean":"2023-11-04T01:38:45.808081+0000","last_became_active":"2023-11-04T01:38:00.704384+0000","last_became_peered":"2023-11-04T01:38:00.704384+0000","last_unstale":"2023-11-04T01:38:45.808081+0000","last_undegraded":"2023-11-04T01:38:45.808081+0000","last_fullsized":"2023-11-04T01:38:45.808081+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080052200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":34,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:46.769074+0000","last_change":"2023-11-04T01:38:01.697272+0000","last_active":"2023-11-04T01:38:46.769074+0000","last_peered":"2023-11-04T01:38:46.769074+0000","last_clean":"2023-11-04T01:38:46.769074+0000","last_became_active":"2023-11-04T01:38:00.709395+0000","last_became_peered":"2023-11-04T01:38:00.709395+0000","last_unstale":"2023-11-04T01:38:46.769074+0000","last_undegraded":"2023-11-04T01:38:46.769074+0000","last_fullsized":"2023-11-04T01:38:46.769074+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076665499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:47.574914+0000","last_change":"2023-11-04T01:38:01.984567+0000","last_active":"2023-11-04T01:38:47.574914+0000","last_peered":"2023-11-04T01:38:47.574914+0000","last_clean":"2023-11-04T01:38:47.574914+0000","last_became_active":"2023-11-04T01:38:00.708020+0000","last_became_peered":"2023-11-04T01:38:00.708020+0000","last_unstale":"2023-11-04T01:38:47.574914+0000","last_undegraded":"2023-11-04T01:38:47.574914+0000","last_fullsized":"2023-11-04T01:38:47.574914+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:09.638146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056906299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":37,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:45.809065+0000","last_change":"2023-11-04T01:38:01.699685+0000","last_active":"2023-11-04T01:38:45.809065+0000","last_peered":"2023-11-04T01:38:45.809065+0000","last_clean":"2023-11-04T01:38:45.809065+0000","last_became_active":"2023-11-04T01:38:00.706802+0000","last_became_peered":"2023-11-04T01:38:00.706802+0000","last_unstale":"2023-11-04T01:38:45.809065+0000","last_undegraded":"2023-11-04T01:38:45.809065+0000","last_fullsized":"2023-11-04T01:38:45.809065+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085845400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":35,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:45.808756+0000","last_change":"2023-11-04T01:38:01.700399+0000","last_active":"2023-11-04T01:38:45.808756+0000","last_peered":"2023-11-04T01:38:45.808756+0000","last_clean":"2023-11-04T01:38:45.808756+0000","last_became_active":"2023-11-04T01:38:00.701352+0000","last_became_peered":"2023-11-04T01:38:00.701352+0000","last_unstale":"2023-11-04T01:38:45.808756+0000","last_undegraded":"2023-11-04T01:38:45.808756+0000","last_fullsized":"2023-11-04T01:38:45.808756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078589399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":31,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:38:45.808094+0000","last_change":"2023-11-04T01:38:02.362072+0000","last_active":"2023-11-04T01:38:45.808094+0000","last_peered":"2023-11-04T01:38:45.808094+0000","last_clean":"2023-11-04T01:38:45.808094+0000","last_became_active":"2023-11-04T01:38:00.710897+0000","last_became_peered":"2023-11-04T01:38:00.710897+0000","last_unstale":"2023-11-04T01:38:45.808094+0000","last_undegraded":"2023-11-04T01:38:45.808094+0000","last_fullsized":"2023-11-04T01:38:45.808094+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:25.229838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058055900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":32,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:38:45.808141+0000","last_change":"2023-11-04T01:38:01.939857+0000","last_active":"2023-11-04T01:38:45.808141+0000","last_peered":"2023-11-04T01:38:45.808141+0000","last_clean":"2023-11-04T01:38:45.808141+0000","last_became_active":"2023-11-04T01:38:00.701371+0000","last_became_peered":"2023-11-04T01:38:00.701371+0000","last_unstale":"2023-11-04T01:38:45.808141+0000","last_undegraded":"2023-11-04T01:38:45.808141+0000","last_fullsized":"2023-11-04T01:38:45.808141+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078632099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":32,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:38:45.808104+0000","last_change":"2023-11-04T01:38:01.939662+0000","last_active":"2023-11-04T01:38:45.808104+0000","last_peered":"2023-11-04T01:38:45.808104+0000","last_clean":"2023-11-04T01:38:45.808104+0000","last_became_active":"2023-11-04T01:38:00.705871+0000","last_became_peered":"2023-11-04T01:38:00.705871+0000","last_unstale":"2023-11-04T01:38:45.808104+0000","last_undegraded":"2023-11-04T01:38:45.808104+0000","last_fullsized":"2023-11-04T01:38:45.808104+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066873200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:49.817308+0000","last_change":"2023-11-04T01:38:49.817308+0000","last_active":"2023-11-04T01:38:49.817308+0000","last_peered":"2023-11-04T01:38:49.817308+0000","last_clean":"2023-11-04T01:38:49.817308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:49.817308+0000","last_undegraded":"2023-11-04T01:38:49.817308+0000","last_fullsized":"2023-11-04T01:38:49.817308+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:38:48.812332+0000","last_change":"2023-11-04T01:38:48.812332+0000","last_active":"2023-11-04T01:38:48.812332+0000","last_peered":"2023-11-04T01:38:48.812332+0000","last_clean":"2023-11-04T01:38:48.812332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:38:48.812332+0000","last_undegraded":"2023-11-04T01:38:48.812332+0000","last_fullsized":"2023-11-04T01:38:48.812332+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:47.574967+0000","last_change":"2023-11-04T01:38:01.984672+0000","last_active":"2023-11-04T01:38:47.574967+0000","last_peered":"2023-11-04T01:38:47.574967+0000","last_clean":"2023-11-04T01:38:47.574967+0000","last_became_active":"2023-11-04T01:38:00.706804+0000","last_became_peered":"2023-11-04T01:38:00.706804+0000","last_unstale":"2023-11-04T01:38:47.574967+0000","last_undegraded":"2023-11-04T01:38:47.574967+0000","last_fullsized":"2023-11-04T01:38:47.574967+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:48.412413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038439000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":201,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:38:46.769040+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:38:46.769040+0000","last_peered":"2023-11-04T01:38:46.769040+0000","last_clean":"2023-11-04T01:38:46.769040+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:38:46.769040+0000","last_undegraded":"2023-11-04T01:38:46.769040+0000","last_fullsized":"2023-11-04T01:38:46.769040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":1343488,"data_stored":932606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":1.0109999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.625},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.79200000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.92300000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":1.0549999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.437,"15min":0.42999999999999999},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65200000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.95799999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.504,"15min":0.496},"min":{"1min":0.35399999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.44,"5min":0.317,"15min":0.317},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.747}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.48799999999999999,"15min":0.47899999999999998},"min":{"1min":0.39300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.42299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.58699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":749568,"data_stored":342238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.375},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68799999999999994,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.45900000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67600000000000005,"5min":1.05,"15min":1.05},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70099999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.308}]},{"osd":2,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.66900000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.748,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.44,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71999999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.439}]},{"osd":4,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.501,"15min":0.501},"min":{"1min":0.373,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.39800000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81899999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.38,"5min":0.372,"15min":0.372},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.41899999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.504},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":749568,"data_stored":342238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.56899999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72499999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.50900000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.442},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.60099999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.74299999999999999,"5min":0.746,"15min":0.746},"last":0.624}]},{"osd":4,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48599999999999999,"15min":0.48899999999999999},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63800000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.35599999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.68500000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.40999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.37,"15min":0.37},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.69999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":737280,"data_stored":336438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.65800000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.77700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.70299999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82099999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.75700000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72199999999999998,"5min":0.879,"15min":0.879},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85499999999999998,"5min":1.089,"15min":1.089},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.874},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.33600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.89500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.34100000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.81799999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.40000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92500000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.85399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":330622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.32200000000000001,"15min":0.32400000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.316,"5min":0.314,"15min":0.314},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.41999999999999998,"5min":0.441,"15min":0.441},"last":0.28199999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.41699999999999998,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.252},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.24199999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.40600000000000003,"5min":0.502,"15min":0.502},"last":0.23799999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.29599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.442,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.309},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.371,"15min":0.375},"min":{"1min":0.27900000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.47599999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.29599999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.432,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77800000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.67500000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.74299999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.443,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76400000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.50900000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.41999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.71899999999999997,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.61899999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.42599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.46800000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.54600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":737280,"data_stored":336438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.32500000000000001,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.442,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.33600000000000002,"15min":0.34300000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.39300000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.27700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.48399999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.317,"5min":0.39100000000000001,"15min":0.40300000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.44,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.35199999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.40899999999999997,"15min":0.42099999999999999},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.51500000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.42099999999999999,"15min":0.433},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.46999999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.38400000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.63900000000000001,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.82399999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.45200000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.68300000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.877,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79700000000000004,"5min":1,"15min":1},"last":0.623},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61199999999999999,"15min":0.62},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73099999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.72599999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76200000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.74199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":712704,"data_stored":324806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.39500000000000002,"15min":0.36099999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":0.441},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.42599999999999999,"15min":0.41199999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":3.456,"5min":3.456,"15min":3.456},"last":0.27300000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.35299999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.52600000000000002,"15min":0.47099999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":8.891,"5min":8.891,"15min":8.891},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.46800000000000003,"15min":0.39600000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":9.8889999999999993,"5min":9.8889999999999993,"15min":9.8889999999999993},"last":0.372}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.629,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":4.5720000000000001,"5min":4.5720000000000001,"15min":4.5720000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.0409999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.46899999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.502}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.68700000000000006,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.915,"5min":5.915,"15min":5.915},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":1.1080000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.66000000000000003,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":7.2599999999999998,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.60099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1306624,"data_stored":915174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30599999999999999,"15min":0.308},"min":{"1min":0.22500000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.40600000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.318,"5min":0.33500000000000002,"15min":0.33800000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47499999999999998,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.27600000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.36299999999999999,"15min":0.36699999999999999},"min":{"1min":0.23599999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.39900000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.245,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.45500000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.36699999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.315,"15min":0.315},"min":{"1min":0.24199999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.38100000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.435},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.374,"15min":0.379},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44700000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.34999999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72199999999999998,"5min":0.87,"15min":0.87},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.314,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.66700000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.73299999999999998,"5min":0.996,"15min":0.996},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.66700000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.83299999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60499999999999998,"15min":0.61399999999999999},"min":{"1min":0.433,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70899999999999996,"5min":1.026,"15min":1.026},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":1.177,"15min":1.177},"last":0.89000000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.71999999999999997,"5min":1.131,"15min":1.131},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":0.746,"15min":0.746},"last":0.94099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:38:53.789 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:38:53.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.921+0000 7f08fd410640 1 Processor -- start 2023-11-04T01:38:53.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.921+0000 7f08fd410640 1 -- start start 2023-11-04T01:38:53.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.921+0000 7f08fd410640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f8157710 0x7f08f8167b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.921+0000 7f08fd410640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f815e000 con 0x7f08f80cde60 2023-11-04T01:38:53.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.921+0000 7f08fd410640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f815e2e0 con 0x7f08f80ce240 2023-11-04T01:38:53.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.921+0000 7f08fd410640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f815e5c0 con 0x7f08f8157710 2023-11-04T01:38:53.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f6ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f08f80cde60 0x7f08f815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41848/0 (socket says 172.21.15.114:41848) 2023-11-04T01:38:53.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f6ffd640 1 -- 172.21.15.114:0/674701187 learned_addr learned my addr 172.21.15.114:0/674701187 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:53.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f5ffb640 1 -- 172.21.15.114:0/674701187 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912010529 0 0) 0x7f08f815e000 con 0x7f08f80cde60 2023-11-04T01:38:53.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f5ffb640 1 -- 172.21.15.114:0/674701187 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08e0003520 con 0x7f08f80cde60 2023-11-04T01:38:53.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f77fe640 1 --2- 172.21.15.114:0/674701187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f8157710 0x7f08f8167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f5ffb640 1 -- 172.21.15.114:0/674701187 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1431800752 0 0) 0x7f08e0003520 con 0x7f08f80cde60 2023-11-04T01:38:53.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f5ffb640 1 -- 172.21.15.114:0/674701187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f8157710 msgr2=0x7f08f8167b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:53.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f5ffb640 1 --2- 172.21.15.114:0/674701187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f8157710 0x7f08f8167b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f5ffb640 1 -- 172.21.15.114:0/674701187 >> v1:172.21.15.141:6789/0 conn(0x7f08f80ce240 legacy=0x7f08f8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f5ffb640 1 -- 172.21.15.114:0/674701187 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f80d1120 con 0x7f08f80cde60 2023-11-04T01:38:53.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f5ffb640 1 -- 172.21.15.114:0/674701187 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f08f0001670 con 0x7f08f80cde60 2023-11-04T01:38:53.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f5ffb640 1 -- 172.21.15.114:0/674701187 >> v1:172.21.15.114:6789/0 conn(0x7f08f80cde60 legacy=0x7f08f815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f5ffb640 1 --2- 172.21.15.114:0/674701187 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08e00039a0 0x7f08e0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f5ffb640 1 --2- 172.21.15.114:0/674701187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08e00047c0 0x7f08e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f5ffb640 1 --2- 172.21.15.114:0/674701187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f8157710 0x7f08e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f5ffb640 1 -- 172.21.15.114:0/674701187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f815e5c0 con 0x7f08e00047c0 2023-11-04T01:38:53.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f5ffb640 1 -- 172.21.15.114:0/674701187 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e000ba30 con 0x7f08e00039a0 2023-11-04T01:38:53.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f5ffb640 1 -- 172.21.15.114:0/674701187 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e000bbf0 con 0x7f08f8157710 2023-11-04T01:38:53.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f67fc640 1 --2- 172.21.15.114:0/674701187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08e00047c0 0x7f08e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f6ffd640 1 --2- 172.21.15.114:0/674701187 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08e00039a0 0x7f08e0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f77fe640 1 --2- 172.21.15.114:0/674701187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f8157710 0x7f08e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.922+0000 7f08f67fc640 1 -- 172.21.15.114:0/674701187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f8157710 msgr2=0x7f08e0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:53.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.923+0000 7f08f67fc640 1 --2- 172.21.15.114:0/674701187 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08f8157710 0x7f08e0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.923+0000 7f08f67fc640 1 -- 172.21.15.114:0/674701187 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08e00039a0 msgr2=0x7f08e0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:53.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.923+0000 7f08f67fc640 1 --2- 172.21.15.114:0/674701187 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08e00039a0 0x7f08e0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.923+0000 7f08f67fc640 1 -- 172.21.15.114:0/674701187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e0003520 con 0x7f08e00047c0 2023-11-04T01:38:53.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.923+0000 7f08f67fc640 1 --2- 172.21.15.114:0/674701187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08e00047c0 0x7f08e0004c40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f08ec001720 tx=0x7f08e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6caa4ba88f92c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.923+0000 7f08f5ffb640 1 -- 172.21.15.114:0/674701187 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec0052d0 con 0x7f08e00047c0 2023-11-04T01:38:53.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.923+0000 7f08f5ffb640 1 -- 172.21.15.114:0/674701187 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ec02e050 con 0x7f08e00047c0 2023-11-04T01:38:53.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.923+0000 7f08f5ffb640 1 -- 172.21.15.114:0/674701187 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec0035f0 con 0x7f08e00047c0 2023-11-04T01:38:53.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.924+0000 7f08fd410640 1 -- 172.21.15.114:0/674701187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08e00047c0 msgr2=0x7f08e0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.924+0000 7f08fd410640 1 --2- 172.21.15.114:0/674701187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08e00047c0 0x7f08e0004c40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f08ec001720 tx=0x7f08e00057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.924+0000 7f08f77fe640 1 -- 172.21.15.114:0/674701187 reap_dead start 2023-11-04T01:38:53.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.924+0000 7f08fd410640 1 -- 172.21.15.114:0/674701187 shutdown_connections 2023-11-04T01:38:53.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.924+0000 7f08fd410640 1 -- 172.21.15.114:0/674701187 >> 172.21.15.114:0/674701187 conn(0x7f08f8071f30 msgr2=0x7f08f80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:53.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.924+0000 7f08fd410640 1 -- 172.21.15.114:0/674701187 shutdown_connections 2023-11-04T01:38:53.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.924+0000 7f08fd410640 1 -- 172.21.15.114:0/674701187 wait complete. 2023-11-04T01:38:53.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.925+0000 7f08fd410640 1 Processor -- start 2023-11-04T01:38:53.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.925+0000 7f08fd410640 1 -- start start 2023-11-04T01:38:53.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.926+0000 7f08fd410640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08e00047c0 0x7f08f81537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.926+0000 7f08fd410640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f8154450 0x7f08f80d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.926+0000 7f08fd410640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08f8153e70 0x7f08f80d3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.926+0000 7f08fd410640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f815c380 con 0x7f08f8154450 2023-11-04T01:38:53.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.926+0000 7f08fd410640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f81f2720 con 0x7f08f8153e70 2023-11-04T01:38:53.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.926+0000 7f08fd410640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f815c620 con 0x7f08e00047c0 2023-11-04T01:38:53.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.926+0000 7f08f67fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f8154450 0x7f08f80d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.926+0000 7f08f67fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f8154450 0x7f08f80d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48560/0 (socket says 172.21.15.114:48560) 2023-11-04T01:38:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.926+0000 7f08f67fc640 1 -- 172.21.15.114:0/1604880509 learned_addr learned my addr 172.21.15.114:0/1604880509 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.926+0000 7f08f67fc640 1 -- 172.21.15.114:0/1604880509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08e00047c0 msgr2=0x7f08f81537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.926+0000 7f08f67fc640 1 --2- 172.21.15.114:0/1604880509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08e00047c0 0x7f08f81537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.926+0000 7f08f77fe640 1 --2- 172.21.15.114:0/1604880509 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08f8153e70 0x7f08f80d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.926+0000 7f08f67fc640 1 -- 172.21.15.114:0/1604880509 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08f8153e70 msgr2=0x7f08f80d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.926+0000 7f08f67fc640 1 --2- 172.21.15.114:0/1604880509 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08f8153e70 0x7f08f80d3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.926+0000 7f08f67fc640 1 -- 172.21.15.114:0/1604880509 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f815c900 con 0x7f08f8154450 2023-11-04T01:38:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.927+0000 7f08f67fc640 1 --2- 172.21.15.114:0/1604880509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f8154450 0x7f08f80d2e00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f08ec008fd0 tx=0x7f08ec001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.927+0000 7f08df7fe640 1 -- 172.21.15.114:0/1604880509 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec0076c0 con 0x7f08f8154450 2023-11-04T01:38:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.927+0000 7f08df7fe640 1 -- 172.21.15.114:0/1604880509 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ec007a30 con 0x7f08f8154450 2023-11-04T01:38:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.927+0000 7f08fd410640 1 -- 172.21.15.114:0/1604880509 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f8159600 con 0x7f08f8154450 2023-11-04T01:38:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.927+0000 7f08df7fe640 1 -- 172.21.15.114:0/1604880509 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec006be0 con 0x7f08f8154450 2023-11-04T01:38:53.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.927+0000 7f08fd410640 1 -- 172.21.15.114:0/1604880509 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f8155a10 con 0x7f08f8154450 2023-11-04T01:38:53.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.928+0000 7f08fd410640 1 -- 172.21.15.114:0/1604880509 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f8159790 con 0x7f08f8154450 2023-11-04T01:38:53.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.928+0000 7f08df7fe640 1 -- 172.21.15.114:0/1604880509 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08ec006d40 con 0x7f08f8154450 2023-11-04T01:38:53.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.928+0000 7f08df7fe640 1 --2- 172.21.15.114:0/1604880509 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08e406aea0 0x7f08e406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:53.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.928+0000 7f08df7fe640 1 -- 172.21.15.114:0/1604880509 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f08ec0ab9f0 con 0x7f08f8154450 2023-11-04T01:38:53.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.929+0000 7f08f6ffd640 1 --2- 172.21.15.114:0/1604880509 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08e406aea0 0x7f08e406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:53.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.929+0000 7f08f6ffd640 1 --2- 172.21.15.114:0/1604880509 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08e406aea0 0x7f08e406d360 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f08f00011e0 tx=0x7f08f0001170 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:53.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:53.933+0000 7f08df7fe640 1 -- 172.21.15.114:0/1604880509 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08ec076800 con 0x7f08f8154450 2023-11-04T01:38:54.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.097+0000 7f08fd410640 1 -- 172.21.15.114:0/1604880509 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08f815dc70 con 0x7f08e406aea0 2023-11-04T01:38:54.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.106+0000 7f08df7fe640 1 -- 172.21.15.114:0/1604880509 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370192 (secure 0 0 0) 0x7f08f0007700 con 0x7f08e406aea0 2023-11-04T01:38:54.112 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:54.114 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:38:54.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.109+0000 7f08fd410640 1 -- 172.21.15.114:0/1604880509 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08e406aea0 msgr2=0x7f08e406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.109+0000 7f08fd410640 1 --2- 172.21.15.114:0/1604880509 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08e406aea0 0x7f08e406d360 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f08f00011e0 tx=0x7f08f0001170 comp rx=0 tx=0).stop 2023-11-04T01:38:54.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.109+0000 7f08fd410640 1 -- 172.21.15.114:0/1604880509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f8154450 msgr2=0x7f08f80d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.109+0000 7f08fd410640 1 --2- 172.21.15.114:0/1604880509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f8154450 0x7f08f80d2e00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f08ec008fd0 tx=0x7f08ec001120 comp rx=0 tx=0).stop 2023-11-04T01:38:54.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.109+0000 7f08fd410640 1 -- 172.21.15.114:0/1604880509 shutdown_connections 2023-11-04T01:38:54.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.109+0000 7f08fd410640 1 --2- 172.21.15.114:0/1604880509 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08e406aea0 0x7f08e406d360 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.109+0000 7f08fd410640 1 --2- 172.21.15.114:0/1604880509 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08f8153e70 0x7f08f80d3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.109+0000 7f08fd410640 1 --2- 172.21.15.114:0/1604880509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08f8154450 0x7f08f80d2e00 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.109+0000 7f08fd410640 1 --2- 172.21.15.114:0/1604880509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08e00047c0 0x7f08f81537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.109+0000 7f08fd410640 1 -- 172.21.15.114:0/1604880509 >> 172.21.15.114:0/1604880509 conn(0x7f08f8071f30 msgr2=0x7f08f8156070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:54.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.110+0000 7f08fd410640 1 -- 172.21.15.114:0/1604880509 shutdown_connections 2023-11-04T01:38:54.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.110+0000 7f08fd410640 1 -- 172.21.15.114:0/1604880509 wait complete. 2023-11-04T01:38:54.122 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-11-04T01:38:53.887488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":231,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223632,"kb_used_data":7416,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751088,"statfs":{"total":773094113280,"available":772865114112,"internally_reserved":0,"allocated":7593984,"data_stored":4118440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.069802"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.567283+0000","last_change":"2023-11-04T01:38:50.579354+0000","last_active":"2023-11-04T01:38:51.567283+0000","last_peered":"2023-11-04T01:38:51.567283+0000","last_clean":"2023-11-04T01:38:51.567283+0000","last_became_active":"2023-11-04T01:38:50.579027+0000","last_became_peered":"2023-11-04T01:38:50.579027+0000","last_unstale":"2023-11-04T01:38:51.567283+0000","last_undegraded":"2023-11-04T01:38:51.567283+0000","last_fullsized":"2023-11-04T01:38:51.567283+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:39.010733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.567650+0000","last_change":"2023-11-04T01:38:50.581417+0000","last_active":"2023-11-04T01:38:51.567650+0000","last_peered":"2023-11-04T01:38:51.567650+0000","last_clean":"2023-11-04T01:38:51.567650+0000","last_became_active":"2023-11-04T01:38:50.580671+0000","last_became_peered":"2023-11-04T01:38:50.580671+0000","last_unstale":"2023-11-04T01:38:51.567650+0000","last_undegraded":"2023-11-04T01:38:51.567650+0000","last_fullsized":"2023-11-04T01:38:51.567650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:22:47.045836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.574780+0000","last_change":"2023-11-04T01:38:50.571751+0000","last_active":"2023-11-04T01:38:50.574780+0000","last_peered":"2023-11-04T01:38:50.574780+0000","last_clean":"2023-11-04T01:38:50.574780+0000","last_became_active":"2023-11-04T01:38:50.571457+0000","last_became_peered":"2023-11-04T01:38:50.571457+0000","last_unstale":"2023-11-04T01:38:50.574780+0000","last_undegraded":"2023-11-04T01:38:50.574780+0000","last_fullsized":"2023-11-04T01:38:50.574780+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:11.218408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.639664+0000","last_change":"2023-11-04T01:38:50.583539+0000","last_active":"2023-11-04T01:38:52.639664+0000","last_peered":"2023-11-04T01:38:52.639664+0000","last_clean":"2023-11-04T01:38:52.639664+0000","last_became_active":"2023-11-04T01:38:50.583326+0000","last_became_peered":"2023-11-04T01:38:50.583326+0000","last_unstale":"2023-11-04T01:38:52.639664+0000","last_undegraded":"2023-11-04T01:38:52.639664+0000","last_fullsized":"2023-11-04T01:38:52.639664+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:35.770283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.579023+0000","last_change":"2023-11-04T01:38:50.573673+0000","last_active":"2023-11-04T01:38:50.579023+0000","last_peered":"2023-11-04T01:38:50.579023+0000","last_clean":"2023-11-04T01:38:50.579023+0000","last_became_active":"2023-11-04T01:38:50.573384+0000","last_became_peered":"2023-11-04T01:38:50.573384+0000","last_unstale":"2023-11-04T01:38:50.579023+0000","last_undegraded":"2023-11-04T01:38:50.579023+0000","last_fullsized":"2023-11-04T01:38:50.579023+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:37:09.161118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.567562+0000","last_change":"2023-11-04T01:38:50.583064+0000","last_active":"2023-11-04T01:38:51.567562+0000","last_peered":"2023-11-04T01:38:51.567562+0000","last_clean":"2023-11-04T01:38:51.567562+0000","last_became_active":"2023-11-04T01:38:50.581866+0000","last_became_peered":"2023-11-04T01:38:50.581866+0000","last_unstale":"2023-11-04T01:38:51.567562+0000","last_undegraded":"2023-11-04T01:38:51.567562+0000","last_fullsized":"2023-11-04T01:38:51.567562+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:26.992812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.587594+0000","last_change":"2023-11-04T01:38:50.582399+0000","last_active":"2023-11-04T01:38:50.587594+0000","last_peered":"2023-11-04T01:38:50.587594+0000","last_clean":"2023-11-04T01:38:50.587594+0000","last_became_active":"2023-11-04T01:38:50.582083+0000","last_became_peered":"2023-11-04T01:38:50.582083+0000","last_unstale":"2023-11-04T01:38:50.587594+0000","last_undegraded":"2023-11-04T01:38:50.587594+0000","last_fullsized":"2023-11-04T01:38:50.587594+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:13.809713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566425+0000","last_change":"2023-11-04T01:38:50.581421+0000","last_active":"2023-11-04T01:38:51.566425+0000","last_peered":"2023-11-04T01:38:51.566425+0000","last_clean":"2023-11-04T01:38:51.566425+0000","last_became_active":"2023-11-04T01:38:50.580608+0000","last_became_peered":"2023-11-04T01:38:50.580608+0000","last_unstale":"2023-11-04T01:38:51.566425+0000","last_undegraded":"2023-11-04T01:38:51.566425+0000","last_fullsized":"2023-11-04T01:38:51.566425+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:06.350594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.578991+0000","last_change":"2023-11-04T01:38:50.576176+0000","last_active":"2023-11-04T01:38:50.578991+0000","last_peered":"2023-11-04T01:38:50.578991+0000","last_clean":"2023-11-04T01:38:50.578991+0000","last_became_active":"2023-11-04T01:38:50.575798+0000","last_became_peered":"2023-11-04T01:38:50.575798+0000","last_unstale":"2023-11-04T01:38:50.578991+0000","last_undegraded":"2023-11-04T01:38:50.578991+0000","last_fullsized":"2023-11-04T01:38:50.578991+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:12.697290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566970+0000","last_change":"2023-11-04T01:38:50.582702+0000","last_active":"2023-11-04T01:38:51.566970+0000","last_peered":"2023-11-04T01:38:51.566970+0000","last_clean":"2023-11-04T01:38:51.566970+0000","last_became_active":"2023-11-04T01:38:50.582422+0000","last_became_peered":"2023-11-04T01:38:50.582422+0000","last_unstale":"2023-11-04T01:38:51.566970+0000","last_undegraded":"2023-11-04T01:38:51.566970+0000","last_fullsized":"2023-11-04T01:38:51.566970+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:08.878644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566242+0000","last_change":"2023-11-04T01:38:50.572421+0000","last_active":"2023-11-04T01:38:51.566242+0000","last_peered":"2023-11-04T01:38:51.566242+0000","last_clean":"2023-11-04T01:38:51.566242+0000","last_became_active":"2023-11-04T01:38:50.572071+0000","last_became_peered":"2023-11-04T01:38:50.572071+0000","last_unstale":"2023-11-04T01:38:51.566242+0000","last_undegraded":"2023-11-04T01:38:51.566242+0000","last_fullsized":"2023-11-04T01:38:51.566242+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:19.011474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.639664+0000","last_change":"2023-11-04T01:38:50.578221+0000","last_active":"2023-11-04T01:38:52.639664+0000","last_peered":"2023-11-04T01:38:52.639664+0000","last_clean":"2023-11-04T01:38:52.639664+0000","last_became_active":"2023-11-04T01:38:50.577897+0000","last_became_peered":"2023-11-04T01:38:50.577897+0000","last_unstale":"2023-11-04T01:38:52.639664+0000","last_undegraded":"2023-11-04T01:38:52.639664+0000","last_fullsized":"2023-11-04T01:38:52.639664+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:57.610668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.274523+0000","last_change":"2023-11-04T01:38:50.584565+0000","last_active":"2023-11-04T01:38:52.274523+0000","last_peered":"2023-11-04T01:38:52.274523+0000","last_clean":"2023-11-04T01:38:52.274523+0000","last_became_active":"2023-11-04T01:38:50.584305+0000","last_became_peered":"2023-11-04T01:38:50.584305+0000","last_unstale":"2023-11-04T01:38:52.274523+0000","last_undegraded":"2023-11-04T01:38:52.274523+0000","last_fullsized":"2023-11-04T01:38:52.274523+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:59:54.248945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.585622+0000","last_change":"2023-11-04T01:38:50.580351+0000","last_active":"2023-11-04T01:38:50.585622+0000","last_peered":"2023-11-04T01:38:50.585622+0000","last_clean":"2023-11-04T01:38:50.585622+0000","last_became_active":"2023-11-04T01:38:50.580093+0000","last_became_peered":"2023-11-04T01:38:50.580093+0000","last_unstale":"2023-11-04T01:38:50.585622+0000","last_undegraded":"2023-11-04T01:38:50.585622+0000","last_fullsized":"2023-11-04T01:38:50.585622+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:35.911655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.274414+0000","last_change":"2023-11-04T01:38:50.577387+0000","last_active":"2023-11-04T01:38:52.274414+0000","last_peered":"2023-11-04T01:38:52.274414+0000","last_clean":"2023-11-04T01:38:52.274414+0000","last_became_active":"2023-11-04T01:38:50.577129+0000","last_became_peered":"2023-11-04T01:38:50.577129+0000","last_unstale":"2023-11-04T01:38:52.274414+0000","last_undegraded":"2023-11-04T01:38:52.274414+0000","last_fullsized":"2023-11-04T01:38:52.274414+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:29.598374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.565558+0000","last_change":"2023-11-04T01:38:50.589300+0000","last_active":"2023-11-04T01:38:51.565558+0000","last_peered":"2023-11-04T01:38:51.565558+0000","last_clean":"2023-11-04T01:38:51.565558+0000","last_became_active":"2023-11-04T01:38:50.588692+0000","last_became_peered":"2023-11-04T01:38:50.588692+0000","last_unstale":"2023-11-04T01:38:51.565558+0000","last_undegraded":"2023-11-04T01:38:51.565558+0000","last_fullsized":"2023-11-04T01:38:51.565558+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:57.927107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.579014+0000","last_change":"2023-11-04T01:38:50.576230+0000","last_active":"2023-11-04T01:38:50.579014+0000","last_peered":"2023-11-04T01:38:50.579014+0000","last_clean":"2023-11-04T01:38:50.579014+0000","last_became_active":"2023-11-04T01:38:50.575913+0000","last_became_peered":"2023-11-04T01:38:50.575913+0000","last_unstale":"2023-11-04T01:38:50.579014+0000","last_undegraded":"2023-11-04T01:38:50.579014+0000","last_fullsized":"2023-11-04T01:38:50.579014+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:58:05.213159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.639838+0000","last_change":"2023-11-04T01:38:50.587126+0000","last_active":"2023-11-04T01:38:52.639838+0000","last_peered":"2023-11-04T01:38:52.639838+0000","last_clean":"2023-11-04T01:38:52.639838+0000","last_became_active":"2023-11-04T01:38:50.586897+0000","last_became_peered":"2023-11-04T01:38:50.586897+0000","last_unstale":"2023-11-04T01:38:52.639838+0000","last_undegraded":"2023-11-04T01:38:52.639838+0000","last_fullsized":"2023-11-04T01:38:52.639838+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:58:56.190710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.565781+0000","last_change":"2023-11-04T01:38:50.581581+0000","last_active":"2023-11-04T01:38:51.565781+0000","last_peered":"2023-11-04T01:38:51.565781+0000","last_clean":"2023-11-04T01:38:51.565781+0000","last_became_active":"2023-11-04T01:38:50.581089+0000","last_became_peered":"2023-11-04T01:38:50.581089+0000","last_unstale":"2023-11-04T01:38:51.565781+0000","last_undegraded":"2023-11-04T01:38:51.565781+0000","last_fullsized":"2023-11-04T01:38:51.565781+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:57.927107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.274632+0000","last_change":"2023-11-04T01:38:50.585550+0000","last_active":"2023-11-04T01:38:52.274632+0000","last_peered":"2023-11-04T01:38:52.274632+0000","last_clean":"2023-11-04T01:38:52.274632+0000","last_became_active":"2023-11-04T01:38:50.585272+0000","last_became_peered":"2023-11-04T01:38:50.585272+0000","last_unstale":"2023-11-04T01:38:52.274632+0000","last_undegraded":"2023-11-04T01:38:52.274632+0000","last_fullsized":"2023-11-04T01:38:52.274632+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:44.273336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566684+0000","last_change":"2023-11-04T01:38:50.580159+0000","last_active":"2023-11-04T01:38:51.566684+0000","last_peered":"2023-11-04T01:38:51.566684+0000","last_clean":"2023-11-04T01:38:51.566684+0000","last_became_active":"2023-11-04T01:38:50.579416+0000","last_became_peered":"2023-11-04T01:38:50.579416+0000","last_unstale":"2023-11-04T01:38:51.566684+0000","last_undegraded":"2023-11-04T01:38:51.566684+0000","last_fullsized":"2023-11-04T01:38:51.566684+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:06.350594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.565981+0000","last_change":"2023-11-04T01:38:50.586898+0000","last_active":"2023-11-04T01:38:51.565981+0000","last_peered":"2023-11-04T01:38:51.565981+0000","last_clean":"2023-11-04T01:38:51.565981+0000","last_became_active":"2023-11-04T01:38:50.586630+0000","last_became_peered":"2023-11-04T01:38:50.586630+0000","last_unstale":"2023-11-04T01:38:51.565981+0000","last_undegraded":"2023-11-04T01:38:51.565981+0000","last_fullsized":"2023-11-04T01:38:51.565981+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:59:42.935842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.565370+0000","last_change":"2023-11-04T01:38:50.581124+0000","last_active":"2023-11-04T01:38:51.565370+0000","last_peered":"2023-11-04T01:38:51.565370+0000","last_clean":"2023-11-04T01:38:51.565370+0000","last_became_active":"2023-11-04T01:38:50.580820+0000","last_became_peered":"2023-11-04T01:38:50.580820+0000","last_unstale":"2023-11-04T01:38:51.565370+0000","last_undegraded":"2023-11-04T01:38:51.565370+0000","last_fullsized":"2023-11-04T01:38:51.565370+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:58.684455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.565055+0000","last_change":"2023-11-04T01:38:50.585995+0000","last_active":"2023-11-04T01:38:51.565055+0000","last_peered":"2023-11-04T01:38:51.565055+0000","last_clean":"2023-11-04T01:38:51.565055+0000","last_became_active":"2023-11-04T01:38:50.585742+0000","last_became_peered":"2023-11-04T01:38:50.585742+0000","last_unstale":"2023-11-04T01:38:51.565055+0000","last_undegraded":"2023-11-04T01:38:51.565055+0000","last_fullsized":"2023-11-04T01:38:51.565055+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:52:05.108654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566186+0000","last_change":"2023-11-04T01:38:50.584413+0000","last_active":"2023-11-04T01:38:51.566186+0000","last_peered":"2023-11-04T01:38:51.566186+0000","last_clean":"2023-11-04T01:38:51.566186+0000","last_became_active":"2023-11-04T01:38:50.584146+0000","last_became_peered":"2023-11-04T01:38:50.584146+0000","last_unstale":"2023-11-04T01:38:51.566186+0000","last_undegraded":"2023-11-04T01:38:51.566186+0000","last_fullsized":"2023-11-04T01:38:51.566186+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:13.853761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.588271+0000","last_change":"2023-11-04T01:38:50.587336+0000","last_active":"2023-11-04T01:38:50.588271+0000","last_peered":"2023-11-04T01:38:50.588271+0000","last_clean":"2023-11-04T01:38:50.588271+0000","last_became_active":"2023-11-04T01:38:50.587064+0000","last_became_peered":"2023-11-04T01:38:50.587064+0000","last_unstale":"2023-11-04T01:38:50.588271+0000","last_undegraded":"2023-11-04T01:38:50.588271+0000","last_fullsized":"2023-11-04T01:38:50.588271+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:04:36.737733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.576419+0000","last_change":"2023-11-04T01:38:50.573119+0000","last_active":"2023-11-04T01:38:50.576419+0000","last_peered":"2023-11-04T01:38:50.576419+0000","last_clean":"2023-11-04T01:38:50.576419+0000","last_became_active":"2023-11-04T01:38:50.572857+0000","last_became_peered":"2023-11-04T01:38:50.572857+0000","last_unstale":"2023-11-04T01:38:50.576419+0000","last_undegraded":"2023-11-04T01:38:50.576419+0000","last_fullsized":"2023-11-04T01:38:50.576419+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:58.227168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.567215+0000","last_change":"2023-11-04T01:38:50.582980+0000","last_active":"2023-11-04T01:38:51.567215+0000","last_peered":"2023-11-04T01:38:51.567215+0000","last_clean":"2023-11-04T01:38:51.567215+0000","last_became_active":"2023-11-04T01:38:50.582694+0000","last_became_peered":"2023-11-04T01:38:50.582694+0000","last_unstale":"2023-11-04T01:38:51.567215+0000","last_undegraded":"2023-11-04T01:38:51.567215+0000","last_fullsized":"2023-11-04T01:38:51.567215+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:26.992812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.592976+0000","last_change":"2023-11-04T01:38:50.585390+0000","last_active":"2023-11-04T01:38:50.592976+0000","last_peered":"2023-11-04T01:38:50.592976+0000","last_clean":"2023-11-04T01:38:50.592976+0000","last_became_active":"2023-11-04T01:38:50.585119+0000","last_became_peered":"2023-11-04T01:38:50.585119+0000","last_unstale":"2023-11-04T01:38:50.592976+0000","last_undegraded":"2023-11-04T01:38:50.592976+0000","last_fullsized":"2023-11-04T01:38:50.592976+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:19.011474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.587576+0000","last_change":"2023-11-04T01:38:50.582722+0000","last_active":"2023-11-04T01:38:50.587576+0000","last_peered":"2023-11-04T01:38:50.587576+0000","last_clean":"2023-11-04T01:38:50.587576+0000","last_became_active":"2023-11-04T01:38:50.582458+0000","last_became_peered":"2023-11-04T01:38:50.582458+0000","last_unstale":"2023-11-04T01:38:50.587576+0000","last_undegraded":"2023-11-04T01:38:50.587576+0000","last_fullsized":"2023-11-04T01:38:50.587576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:27.200008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.587551+0000","last_change":"2023-11-04T01:38:50.579891+0000","last_active":"2023-11-04T01:38:50.587551+0000","last_peered":"2023-11-04T01:38:50.587551+0000","last_clean":"2023-11-04T01:38:50.587551+0000","last_became_active":"2023-11-04T01:38:50.579515+0000","last_became_peered":"2023-11-04T01:38:50.579515+0000","last_unstale":"2023-11-04T01:38:50.587551+0000","last_undegraded":"2023-11-04T01:38:50.587551+0000","last_fullsized":"2023-11-04T01:38:50.587551+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:43:24.947982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566555+0000","last_change":"2023-11-04T01:38:50.575517+0000","last_active":"2023-11-04T01:38:51.566555+0000","last_peered":"2023-11-04T01:38:51.566555+0000","last_clean":"2023-11-04T01:38:51.566555+0000","last_became_active":"2023-11-04T01:38:50.575235+0000","last_became_peered":"2023-11-04T01:38:50.575235+0000","last_unstale":"2023-11-04T01:38:51.566555+0000","last_undegraded":"2023-11-04T01:38:51.566555+0000","last_fullsized":"2023-11-04T01:38:51.566555+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:03:10.601613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.578943+0000","last_change":"2023-11-04T01:38:50.575601+0000","last_active":"2023-11-04T01:38:50.578943+0000","last_peered":"2023-11-04T01:38:50.578943+0000","last_clean":"2023-11-04T01:38:50.578943+0000","last_became_active":"2023-11-04T01:38:50.575293+0000","last_became_peered":"2023-11-04T01:38:50.575293+0000","last_unstale":"2023-11-04T01:38:50.578943+0000","last_undegraded":"2023-11-04T01:38:50.578943+0000","last_fullsized":"2023-11-04T01:38:50.578943+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:25:11.589614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"65'8","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.565505+0000","last_change":"2023-11-04T01:38:49.836848+0000","last_active":"2023-11-04T01:38:51.565505+0000","last_peered":"2023-11-04T01:38:51.565505+0000","last_clean":"2023-11-04T01:38:51.565505+0000","last_became_active":"2023-11-04T01:38:49.833918+0000","last_became_peered":"2023-11-04T01:38:49.833918+0000","last_unstale":"2023-11-04T01:38:51.565505+0000","last_undegraded":"2023-11-04T01:38:51.565505+0000","last_fullsized":"2023-11-04T01:38:51.565505+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:32:53.359479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.567132+0000","last_change":"2023-11-04T01:38:02.156342+0000","last_active":"2023-11-04T01:38:50.567132+0000","last_peered":"2023-11-04T01:38:50.567132+0000","last_clean":"2023-11-04T01:38:50.567132+0000","last_became_active":"2023-11-04T01:38:00.708159+0000","last_became_peered":"2023-11-04T01:38:00.708159+0000","last_unstale":"2023-11-04T01:38:50.567132+0000","last_undegraded":"2023-11-04T01:38:50.567132+0000","last_fullsized":"2023-11-04T01:38:50.567132+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000435213,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.274564+0000","last_change":"2023-11-04T01:38:50.588168+0000","last_active":"2023-11-04T01:38:52.274564+0000","last_peered":"2023-11-04T01:38:52.274564+0000","last_clean":"2023-11-04T01:38:52.274564+0000","last_became_active":"2023-11-04T01:38:50.587976+0000","last_became_peered":"2023-11-04T01:38:50.587976+0000","last_unstale":"2023-11-04T01:38:52.274564+0000","last_undegraded":"2023-11-04T01:38:52.274564+0000","last_fullsized":"2023-11-04T01:38:52.274564+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:58:14.180420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.573084+0000","last_change":"2023-11-04T01:38:49.838681+0000","last_active":"2023-11-04T01:38:50.573084+0000","last_peered":"2023-11-04T01:38:50.573084+0000","last_clean":"2023-11-04T01:38:50.573084+0000","last_became_active":"2023-11-04T01:38:49.838422+0000","last_became_peered":"2023-11-04T01:38:49.838422+0000","last_unstale":"2023-11-04T01:38:50.573084+0000","last_undegraded":"2023-11-04T01:38:50.573084+0000","last_fullsized":"2023-11-04T01:38:50.573084+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:12.554658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":34,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:38:49.827834+0000","last_change":"2023-11-04T01:38:02.362289+0000","last_active":"2023-11-04T01:38:49.827834+0000","last_peered":"2023-11-04T01:38:49.827834+0000","last_clean":"2023-11-04T01:38:49.827834+0000","last_became_active":"2023-11-04T01:38:00.710033+0000","last_became_peered":"2023-11-04T01:38:00.710033+0000","last_unstale":"2023-11-04T01:38:49.827834+0000","last_undegraded":"2023-11-04T01:38:49.827834+0000","last_fullsized":"2023-11-04T01:38:49.827834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046467500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.587491+0000","last_change":"2023-11-04T01:38:50.581252+0000","last_active":"2023-11-04T01:38:50.587491+0000","last_peered":"2023-11-04T01:38:50.587491+0000","last_clean":"2023-11-04T01:38:50.587491+0000","last_became_active":"2023-11-04T01:38:50.580891+0000","last_became_peered":"2023-11-04T01:38:50.580891+0000","last_unstale":"2023-11-04T01:38:50.587491+0000","last_undegraded":"2023-11-04T01:38:50.587491+0000","last_fullsized":"2023-11-04T01:38:50.587491+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:23:52.259417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.567210+0000","last_change":"2023-11-04T01:38:49.838437+0000","last_active":"2023-11-04T01:38:51.567210+0000","last_peered":"2023-11-04T01:38:51.567210+0000","last_clean":"2023-11-04T01:38:51.567210+0000","last_became_active":"2023-11-04T01:38:49.837696+0000","last_became_peered":"2023-11-04T01:38:49.837696+0000","last_unstale":"2023-11-04T01:38:51.567210+0000","last_undegraded":"2023-11-04T01:38:51.567210+0000","last_fullsized":"2023-11-04T01:38:51.567210+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:56.605693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":41,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.570094+0000","last_change":"2023-11-04T01:38:01.699171+0000","last_active":"2023-11-04T01:38:50.570094+0000","last_peered":"2023-11-04T01:38:50.570094+0000","last_clean":"2023-11-04T01:38:50.570094+0000","last_became_active":"2023-11-04T01:38:00.703927+0000","last_became_peered":"2023-11-04T01:38:00.703927+0000","last_unstale":"2023-11-04T01:38:50.570094+0000","last_undegraded":"2023-11-04T01:38:50.570094+0000","last_fullsized":"2023-11-04T01:38:50.570094+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072585499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566169+0000","last_change":"2023-11-04T01:38:50.578220+0000","last_active":"2023-11-04T01:38:51.566169+0000","last_peered":"2023-11-04T01:38:51.566169+0000","last_clean":"2023-11-04T01:38:51.566169+0000","last_became_active":"2023-11-04T01:38:50.577936+0000","last_became_peered":"2023-11-04T01:38:50.577936+0000","last_unstale":"2023-11-04T01:38:51.566169+0000","last_undegraded":"2023-11-04T01:38:51.566169+0000","last_fullsized":"2023-11-04T01:38:51.566169+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:11.218408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.639598+0000","last_change":"2023-11-04T01:38:49.838746+0000","last_active":"2023-11-04T01:38:52.639598+0000","last_peered":"2023-11-04T01:38:52.639598+0000","last_clean":"2023-11-04T01:38:52.639598+0000","last_became_active":"2023-11-04T01:38:49.838490+0000","last_became_peered":"2023-11-04T01:38:49.838490+0000","last_unstale":"2023-11-04T01:38:52.639598+0000","last_undegraded":"2023-11-04T01:38:52.639598+0000","last_fullsized":"2023-11-04T01:38:52.639598+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:38:25.171555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.566944+0000","last_change":"2023-11-04T01:38:02.156160+0000","last_active":"2023-11-04T01:38:50.566944+0000","last_peered":"2023-11-04T01:38:50.566944+0000","last_clean":"2023-11-04T01:38:50.566944+0000","last_became_active":"2023-11-04T01:38:00.709137+0000","last_became_peered":"2023-11-04T01:38:00.709137+0000","last_unstale":"2023-11-04T01:38:50.566944+0000","last_undegraded":"2023-11-04T01:38:50.566944+0000","last_fullsized":"2023-11-04T01:38:50.566944+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028239399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.578965+0000","last_change":"2023-11-04T01:38:50.575146+0000","last_active":"2023-11-04T01:38:50.578965+0000","last_peered":"2023-11-04T01:38:50.578965+0000","last_clean":"2023-11-04T01:38:50.578965+0000","last_became_active":"2023-11-04T01:38:50.574877+0000","last_became_peered":"2023-11-04T01:38:50.574877+0000","last_unstale":"2023-11-04T01:38:50.578965+0000","last_undegraded":"2023-11-04T01:38:50.578965+0000","last_fullsized":"2023-11-04T01:38:50.578965+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:30.969297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"65'6","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.639781+0000","last_change":"2023-11-04T01:38:49.837833+0000","last_active":"2023-11-04T01:38:52.639781+0000","last_peered":"2023-11-04T01:38:52.639781+0000","last_clean":"2023-11-04T01:38:52.639781+0000","last_became_active":"2023-11-04T01:38:49.837570+0000","last_became_peered":"2023-11-04T01:38:49.837570+0000","last_unstale":"2023-11-04T01:38:52.639781+0000","last_undegraded":"2023-11-04T01:38:52.639781+0000","last_fullsized":"2023-11-04T01:38:52.639781+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:00.303946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":41,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.570234+0000","last_change":"2023-11-04T01:38:01.698196+0000","last_active":"2023-11-04T01:38:50.570234+0000","last_peered":"2023-11-04T01:38:50.570234+0000","last_clean":"2023-11-04T01:38:50.570234+0000","last_became_active":"2023-11-04T01:38:00.705451+0000","last_became_peered":"2023-11-04T01:38:00.705451+0000","last_unstale":"2023-11-04T01:38:50.570234+0000","last_undegraded":"2023-11-04T01:38:50.570234+0000","last_fullsized":"2023-11-04T01:38:50.570234+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:16.759249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067668100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.567328+0000","last_change":"2023-11-04T01:38:50.582142+0000","last_active":"2023-11-04T01:38:51.567328+0000","last_peered":"2023-11-04T01:38:51.567328+0000","last_clean":"2023-11-04T01:38:51.567328+0000","last_became_active":"2023-11-04T01:38:50.581833+0000","last_became_peered":"2023-11-04T01:38:50.581833+0000","last_unstale":"2023-11-04T01:38:51.567328+0000","last_undegraded":"2023-11-04T01:38:51.567328+0000","last_fullsized":"2023-11-04T01:38:51.567328+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:24.725262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"65'3","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.852107+0000","last_change":"2023-11-04T01:38:49.836464+0000","last_active":"2023-11-04T01:38:50.852107+0000","last_peered":"2023-11-04T01:38:50.852107+0000","last_clean":"2023-11-04T01:38:50.852107+0000","last_became_active":"2023-11-04T01:38:49.836169+0000","last_became_peered":"2023-11-04T01:38:49.836169+0000","last_unstale":"2023-11-04T01:38:50.852107+0000","last_undegraded":"2023-11-04T01:38:50.852107+0000","last_fullsized":"2023-11-04T01:38:50.852107+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:45.121366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.568832+0000","last_change":"2023-11-04T01:38:01.983991+0000","last_active":"2023-11-04T01:38:50.568832+0000","last_peered":"2023-11-04T01:38:50.568832+0000","last_clean":"2023-11-04T01:38:50.568832+0000","last_became_active":"2023-11-04T01:38:00.708462+0000","last_became_peered":"2023-11-04T01:38:00.708462+0000","last_unstale":"2023-11-04T01:38:50.568832+0000","last_undegraded":"2023-11-04T01:38:50.568832+0000","last_fullsized":"2023-11-04T01:38:50.568832+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:37.727651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041811600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566493+0000","last_change":"2023-11-04T01:38:50.587456+0000","last_active":"2023-11-04T01:38:51.566493+0000","last_peered":"2023-11-04T01:38:51.566493+0000","last_clean":"2023-11-04T01:38:51.566493+0000","last_became_active":"2023-11-04T01:38:50.587189+0000","last_became_peered":"2023-11-04T01:38:50.587189+0000","last_unstale":"2023-11-04T01:38:51.566493+0000","last_undegraded":"2023-11-04T01:38:51.566493+0000","last_fullsized":"2023-11-04T01:38:51.566493+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:46.126342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.567598+0000","last_change":"2023-11-04T01:38:49.837635+0000","last_active":"2023-11-04T01:38:51.567598+0000","last_peered":"2023-11-04T01:38:51.567598+0000","last_clean":"2023-11-04T01:38:51.567598+0000","last_became_active":"2023-11-04T01:38:49.837367+0000","last_became_peered":"2023-11-04T01:38:49.837367+0000","last_unstale":"2023-11-04T01:38:51.567598+0000","last_undegraded":"2023-11-04T01:38:51.567598+0000","last_fullsized":"2023-11-04T01:38:51.567598+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:58:55.185735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.568094+0000","last_change":"2023-11-04T01:38:01.984341+0000","last_active":"2023-11-04T01:38:50.568094+0000","last_peered":"2023-11-04T01:38:50.568094+0000","last_clean":"2023-11-04T01:38:50.568094+0000","last_became_active":"2023-11-04T01:38:00.708307+0000","last_became_peered":"2023-11-04T01:38:00.708307+0000","last_unstale":"2023-11-04T01:38:50.568094+0000","last_undegraded":"2023-11-04T01:38:50.568094+0000","last_fullsized":"2023-11-04T01:38:50.568094+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:17.369098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053627199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.588176+0000","last_change":"2023-11-04T01:38:50.585177+0000","last_active":"2023-11-04T01:38:50.588176+0000","last_peered":"2023-11-04T01:38:50.588176+0000","last_clean":"2023-11-04T01:38:50.588176+0000","last_became_active":"2023-11-04T01:38:50.584893+0000","last_became_peered":"2023-11-04T01:38:50.584893+0000","last_unstale":"2023-11-04T01:38:50.588176+0000","last_undegraded":"2023-11-04T01:38:50.588176+0000","last_fullsized":"2023-11-04T01:38:50.588176+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:25.051227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566264+0000","last_change":"2023-11-04T01:38:49.838023+0000","last_active":"2023-11-04T01:38:51.566264+0000","last_peered":"2023-11-04T01:38:51.566264+0000","last_clean":"2023-11-04T01:38:51.566264+0000","last_became_active":"2023-11-04T01:38:49.837293+0000","last_became_peered":"2023-11-04T01:38:49.837293+0000","last_unstale":"2023-11-04T01:38:51.566264+0000","last_undegraded":"2023-11-04T01:38:51.566264+0000","last_fullsized":"2023-11-04T01:38:51.566264+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:06.323544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":39,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.575108+0000","last_change":"2023-11-04T01:38:01.700471+0000","last_active":"2023-11-04T01:38:50.575108+0000","last_peered":"2023-11-04T01:38:50.575108+0000","last_clean":"2023-11-04T01:38:50.575108+0000","last_became_active":"2023-11-04T01:38:00.702522+0000","last_became_peered":"2023-11-04T01:38:00.702522+0000","last_unstale":"2023-11-04T01:38:50.575108+0000","last_undegraded":"2023-11-04T01:38:50.575108+0000","last_fullsized":"2023-11-04T01:38:50.575108+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086940300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.274415+0000","last_change":"2023-11-04T01:38:50.580147+0000","last_active":"2023-11-04T01:38:52.274415+0000","last_peered":"2023-11-04T01:38:52.274415+0000","last_clean":"2023-11-04T01:38:52.274415+0000","last_became_active":"2023-11-04T01:38:50.579788+0000","last_became_peered":"2023-11-04T01:38:50.579788+0000","last_unstale":"2023-11-04T01:38:52.274415+0000","last_undegraded":"2023-11-04T01:38:52.274415+0000","last_fullsized":"2023-11-04T01:38:52.274415+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:52.481427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.567645+0000","last_change":"2023-11-04T01:38:49.834428+0000","last_active":"2023-11-04T01:38:50.567645+0000","last_peered":"2023-11-04T01:38:50.567645+0000","last_clean":"2023-11-04T01:38:50.567645+0000","last_became_active":"2023-11-04T01:38:49.834156+0000","last_became_peered":"2023-11-04T01:38:49.834156+0000","last_unstale":"2023-11-04T01:38:50.567645+0000","last_undegraded":"2023-11-04T01:38:50.567645+0000","last_fullsized":"2023-11-04T01:38:50.567645+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:55:10.289335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":38,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.567911+0000","last_change":"2023-11-04T01:38:01.696901+0000","last_active":"2023-11-04T01:38:50.567911+0000","last_peered":"2023-11-04T01:38:50.567911+0000","last_clean":"2023-11-04T01:38:50.567911+0000","last_became_active":"2023-11-04T01:38:00.706170+0000","last_became_peered":"2023-11-04T01:38:00.706170+0000","last_unstale":"2023-11-04T01:38:50.567911+0000","last_undegraded":"2023-11-04T01:38:50.567911+0000","last_fullsized":"2023-11-04T01:38:50.567911+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059391100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.585542+0000","last_change":"2023-11-04T01:38:50.579731+0000","last_active":"2023-11-04T01:38:50.585542+0000","last_peered":"2023-11-04T01:38:50.585542+0000","last_clean":"2023-11-04T01:38:50.585542+0000","last_became_active":"2023-11-04T01:38:50.579415+0000","last_became_peered":"2023-11-04T01:38:50.579415+0000","last_unstale":"2023-11-04T01:38:50.585542+0000","last_undegraded":"2023-11-04T01:38:50.585542+0000","last_fullsized":"2023-11-04T01:38:50.585542+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:42.872861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.639455+0000","last_change":"2023-11-04T01:38:49.839714+0000","last_active":"2023-11-04T01:38:52.639455+0000","last_peered":"2023-11-04T01:38:52.639455+0000","last_clean":"2023-11-04T01:38:52.639455+0000","last_became_active":"2023-11-04T01:38:49.839437+0000","last_became_peered":"2023-11-04T01:38:49.839437+0000","last_unstale":"2023-11-04T01:38:52.639455+0000","last_undegraded":"2023-11-04T01:38:52.639455+0000","last_fullsized":"2023-11-04T01:38:52.639455+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:32:53.359479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":36,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:38:49.822180+0000","last_change":"2023-11-04T01:38:01.939972+0000","last_active":"2023-11-04T01:38:49.822180+0000","last_peered":"2023-11-04T01:38:49.822180+0000","last_clean":"2023-11-04T01:38:49.822180+0000","last_became_active":"2023-11-04T01:38:00.702784+0000","last_became_peered":"2023-11-04T01:38:00.702784+0000","last_unstale":"2023-11-04T01:38:49.822180+0000","last_undegraded":"2023-11-04T01:38:49.822180+0000","last_fullsized":"2023-11-04T01:38:49.822180+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:26.760402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071328600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566833+0000","last_change":"2023-11-04T01:38:50.583894+0000","last_active":"2023-11-04T01:38:51.566833+0000","last_peered":"2023-11-04T01:38:51.566833+0000","last_clean":"2023-11-04T01:38:51.566833+0000","last_became_active":"2023-11-04T01:38:50.583601+0000","last_became_peered":"2023-11-04T01:38:50.583601+0000","last_unstale":"2023-11-04T01:38:51.566833+0000","last_undegraded":"2023-11-04T01:38:51.566833+0000","last_fullsized":"2023-11-04T01:38:51.566833+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:03:10.601613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.567385+0000","last_change":"2023-11-04T01:38:49.839103+0000","last_active":"2023-11-04T01:38:51.567385+0000","last_peered":"2023-11-04T01:38:51.567385+0000","last_clean":"2023-11-04T01:38:51.567385+0000","last_became_active":"2023-11-04T01:38:49.838847+0000","last_became_peered":"2023-11-04T01:38:49.838847+0000","last_unstale":"2023-11-04T01:38:51.567385+0000","last_undegraded":"2023-11-04T01:38:51.567385+0000","last_fullsized":"2023-11-04T01:38:51.567385+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:10.511346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":38,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.569537+0000","last_change":"2023-11-04T01:38:01.699051+0000","last_active":"2023-11-04T01:38:50.569537+0000","last_peered":"2023-11-04T01:38:50.569537+0000","last_clean":"2023-11-04T01:38:50.569537+0000","last_became_active":"2023-11-04T01:38:00.708665+0000","last_became_peered":"2023-11-04T01:38:00.708665+0000","last_unstale":"2023-11-04T01:38:50.569537+0000","last_undegraded":"2023-11-04T01:38:50.569537+0000","last_fullsized":"2023-11-04T01:38:50.569537+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020995580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.584833+0000","last_change":"2023-11-04T01:38:50.577375+0000","last_active":"2023-11-04T01:38:50.584833+0000","last_peered":"2023-11-04T01:38:50.584833+0000","last_clean":"2023-11-04T01:38:50.584833+0000","last_became_active":"2023-11-04T01:38:50.577117+0000","last_became_peered":"2023-11-04T01:38:50.577117+0000","last_unstale":"2023-11-04T01:38:50.584833+0000","last_undegraded":"2023-11-04T01:38:50.584833+0000","last_fullsized":"2023-11-04T01:38:50.584833+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:50.755859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"65'1","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.849578+0000","last_change":"2023-11-04T01:38:49.837164+0000","last_active":"2023-11-04T01:38:50.849578+0000","last_peered":"2023-11-04T01:38:50.849578+0000","last_clean":"2023-11-04T01:38:50.849578+0000","last_became_active":"2023-11-04T01:38:49.836901+0000","last_became_peered":"2023-11-04T01:38:49.836901+0000","last_unstale":"2023-11-04T01:38:50.849578+0000","last_undegraded":"2023-11-04T01:38:50.849578+0000","last_fullsized":"2023-11-04T01:38:50.849578+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:46:55.182002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":39,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.573926+0000","last_change":"2023-11-04T01:38:01.700742+0000","last_active":"2023-11-04T01:38:50.573926+0000","last_peered":"2023-11-04T01:38:50.573926+0000","last_clean":"2023-11-04T01:38:50.573926+0000","last_became_active":"2023-11-04T01:38:00.706671+0000","last_became_peered":"2023-11-04T01:38:00.706671+0000","last_unstale":"2023-11-04T01:38:50.573926+0000","last_undegraded":"2023-11-04T01:38:50.573926+0000","last_fullsized":"2023-11-04T01:38:50.573926+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072370699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.565846+0000","last_change":"2023-11-04T01:38:50.574694+0000","last_active":"2023-11-04T01:38:51.565846+0000","last_peered":"2023-11-04T01:38:51.565846+0000","last_clean":"2023-11-04T01:38:51.565846+0000","last_became_active":"2023-11-04T01:38:50.574422+0000","last_became_peered":"2023-11-04T01:38:50.574422+0000","last_unstale":"2023-11-04T01:38:51.565846+0000","last_undegraded":"2023-11-04T01:38:51.565846+0000","last_fullsized":"2023-11-04T01:38:51.565846+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:56:54.685121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.567414+0000","last_change":"2023-11-04T01:38:49.837003+0000","last_active":"2023-11-04T01:38:51.567414+0000","last_peered":"2023-11-04T01:38:51.567414+0000","last_clean":"2023-11-04T01:38:51.567414+0000","last_became_active":"2023-11-04T01:38:49.836067+0000","last_became_peered":"2023-11-04T01:38:49.836067+0000","last_unstale":"2023-11-04T01:38:51.567414+0000","last_undegraded":"2023-11-04T01:38:51.567414+0000","last_fullsized":"2023-11-04T01:38:51.567414+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:03.087835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":38,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.567132+0000","last_change":"2023-11-04T01:38:01.697526+0000","last_active":"2023-11-04T01:38:50.567132+0000","last_peered":"2023-11-04T01:38:50.567132+0000","last_clean":"2023-11-04T01:38:50.567132+0000","last_became_active":"2023-11-04T01:38:00.707580+0000","last_became_peered":"2023-11-04T01:38:00.707580+0000","last_unstale":"2023-11-04T01:38:50.567132+0000","last_undegraded":"2023-11-04T01:38:50.567132+0000","last_fullsized":"2023-11-04T01:38:50.567132+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010806699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.567193+0000","last_change":"2023-11-04T01:38:50.584404+0000","last_active":"2023-11-04T01:38:51.567193+0000","last_peered":"2023-11-04T01:38:51.567193+0000","last_clean":"2023-11-04T01:38:51.567193+0000","last_became_active":"2023-11-04T01:38:50.584141+0000","last_became_peered":"2023-11-04T01:38:50.584141+0000","last_unstale":"2023-11-04T01:38:51.567193+0000","last_undegraded":"2023-11-04T01:38:51.567193+0000","last_fullsized":"2023-11-04T01:38:51.567193+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:08.878644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566723+0000","last_change":"2023-11-04T01:38:49.838204+0000","last_active":"2023-11-04T01:38:51.566723+0000","last_peered":"2023-11-04T01:38:51.566723+0000","last_clean":"2023-11-04T01:38:51.566723+0000","last_became_active":"2023-11-04T01:38:49.836659+0000","last_became_peered":"2023-11-04T01:38:49.836659+0000","last_unstale":"2023-11-04T01:38:51.566723+0000","last_undegraded":"2023-11-04T01:38:51.566723+0000","last_fullsized":"2023-11-04T01:38:51.566723+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:03.087835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":36,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:38:49.821965+0000","last_change":"2023-11-04T01:38:01.939462+0000","last_active":"2023-11-04T01:38:49.821965+0000","last_peered":"2023-11-04T01:38:49.821965+0000","last_clean":"2023-11-04T01:38:49.821965+0000","last_became_active":"2023-11-04T01:38:00.705830+0000","last_became_peered":"2023-11-04T01:38:00.705830+0000","last_unstale":"2023-11-04T01:38:49.821965+0000","last_undegraded":"2023-11-04T01:38:49.821965+0000","last_fullsized":"2023-11-04T01:38:49.821965+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059305000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.578975+0000","last_change":"2023-11-04T01:38:50.576059+0000","last_active":"2023-11-04T01:38:50.578975+0000","last_peered":"2023-11-04T01:38:50.578975+0000","last_clean":"2023-11-04T01:38:50.578975+0000","last_became_active":"2023-11-04T01:38:50.575594+0000","last_became_peered":"2023-11-04T01:38:50.575594+0000","last_unstale":"2023-11-04T01:38:50.578975+0000","last_undegraded":"2023-11-04T01:38:50.578975+0000","last_fullsized":"2023-11-04T01:38:50.578975+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:47:16.890743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.274753+0000","last_change":"2023-11-04T01:38:49.835568+0000","last_active":"2023-11-04T01:38:52.274753+0000","last_peered":"2023-11-04T01:38:52.274753+0000","last_clean":"2023-11-04T01:38:52.274753+0000","last_became_active":"2023-11-04T01:38:49.835276+0000","last_became_peered":"2023-11-04T01:38:49.835276+0000","last_unstale":"2023-11-04T01:38:52.274753+0000","last_undegraded":"2023-11-04T01:38:52.274753+0000","last_fullsized":"2023-11-04T01:38:52.274753+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:04:59.373556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.568176+0000","last_change":"2023-11-04T01:38:01.984456+0000","last_active":"2023-11-04T01:38:50.568176+0000","last_peered":"2023-11-04T01:38:50.568176+0000","last_clean":"2023-11-04T01:38:50.568176+0000","last_became_active":"2023-11-04T01:38:00.708803+0000","last_became_peered":"2023-11-04T01:38:00.708803+0000","last_unstale":"2023-11-04T01:38:50.568176+0000","last_undegraded":"2023-11-04T01:38:50.568176+0000","last_fullsized":"2023-11-04T01:38:50.568176+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:30.811033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061551599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566347+0000","last_change":"2023-11-04T01:38:50.585303+0000","last_active":"2023-11-04T01:38:51.566347+0000","last_peered":"2023-11-04T01:38:51.566347+0000","last_clean":"2023-11-04T01:38:51.566347+0000","last_became_active":"2023-11-04T01:38:50.584339+0000","last_became_peered":"2023-11-04T01:38:50.584339+0000","last_unstale":"2023-11-04T01:38:51.566347+0000","last_undegraded":"2023-11-04T01:38:51.566347+0000","last_fullsized":"2023-11-04T01:38:51.566347+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:41.782225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"65'4","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566732+0000","last_change":"2023-11-04T01:38:49.839049+0000","last_active":"2023-11-04T01:38:51.566732+0000","last_peered":"2023-11-04T01:38:51.566732+0000","last_clean":"2023-11-04T01:38:51.566732+0000","last_became_active":"2023-11-04T01:38:49.838339+0000","last_became_peered":"2023-11-04T01:38:49.838339+0000","last_unstale":"2023-11-04T01:38:51.566732+0000","last_undegraded":"2023-11-04T01:38:51.566732+0000","last_fullsized":"2023-11-04T01:38:51.566732+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:45.570347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":41,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.570207+0000","last_change":"2023-11-04T01:38:01.698866+0000","last_active":"2023-11-04T01:38:50.570207+0000","last_peered":"2023-11-04T01:38:50.570207+0000","last_clean":"2023-11-04T01:38:50.570207+0000","last_became_active":"2023-11-04T01:38:00.706149+0000","last_became_peered":"2023-11-04T01:38:00.706149+0000","last_unstale":"2023-11-04T01:38:50.570207+0000","last_undegraded":"2023-11-04T01:38:50.570207+0000","last_fullsized":"2023-11-04T01:38:50.570207+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:59.391683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001344154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.565850+0000","last_change":"2023-11-04T01:38:50.580798+0000","last_active":"2023-11-04T01:38:51.565850+0000","last_peered":"2023-11-04T01:38:51.565850+0000","last_clean":"2023-11-04T01:38:51.565850+0000","last_became_active":"2023-11-04T01:38:50.580500+0000","last_became_peered":"2023-11-04T01:38:50.580500+0000","last_unstale":"2023-11-04T01:38:51.565850+0000","last_undegraded":"2023-11-04T01:38:51.565850+0000","last_fullsized":"2023-11-04T01:38:51.565850+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:59:42.935842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566638+0000","last_change":"2023-11-04T01:38:49.834762+0000","last_active":"2023-11-04T01:38:51.566638+0000","last_peered":"2023-11-04T01:38:51.566638+0000","last_clean":"2023-11-04T01:38:51.566638+0000","last_became_active":"2023-11-04T01:38:49.834352+0000","last_became_peered":"2023-11-04T01:38:49.834352+0000","last_unstale":"2023-11-04T01:38:51.566638+0000","last_undegraded":"2023-11-04T01:38:51.566638+0000","last_fullsized":"2023-11-04T01:38:51.566638+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:31.947206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":41,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.570351+0000","last_change":"2023-11-04T01:38:01.699187+0000","last_active":"2023-11-04T01:38:50.570351+0000","last_peered":"2023-11-04T01:38:50.570351+0000","last_clean":"2023-11-04T01:38:50.570351+0000","last_became_active":"2023-11-04T01:38:00.706136+0000","last_became_peered":"2023-11-04T01:38:00.706136+0000","last_unstale":"2023-11-04T01:38:50.570351+0000","last_undegraded":"2023-11-04T01:38:50.570351+0000","last_fullsized":"2023-11-04T01:38:50.570351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074666999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.639514+0000","last_change":"2023-11-04T01:38:50.574610+0000","last_active":"2023-11-04T01:38:52.639514+0000","last_peered":"2023-11-04T01:38:52.639514+0000","last_clean":"2023-11-04T01:38:52.639514+0000","last_became_active":"2023-11-04T01:38:50.574350+0000","last_became_peered":"2023-11-04T01:38:50.574350+0000","last_unstale":"2023-11-04T01:38:52.639514+0000","last_undegraded":"2023-11-04T01:38:52.639514+0000","last_fullsized":"2023-11-04T01:38:52.639514+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:28:04.492271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.565502+0000","last_change":"2023-11-04T01:38:49.837497+0000","last_active":"2023-11-04T01:38:51.565502+0000","last_peered":"2023-11-04T01:38:51.565502+0000","last_clean":"2023-11-04T01:38:51.565502+0000","last_became_active":"2023-11-04T01:38:49.836637+0000","last_became_peered":"2023-11-04T01:38:49.836637+0000","last_unstale":"2023-11-04T01:38:51.565502+0000","last_undegraded":"2023-11-04T01:38:51.565502+0000","last_fullsized":"2023-11-04T01:38:51.565502+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:28:03.487295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":41,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.570829+0000","last_change":"2023-11-04T01:38:01.699630+0000","last_active":"2023-11-04T01:38:50.570829+0000","last_peered":"2023-11-04T01:38:50.570829+0000","last_clean":"2023-11-04T01:38:50.570829+0000","last_became_active":"2023-11-04T01:38:00.702550+0000","last_became_peered":"2023-11-04T01:38:00.702550+0000","last_unstale":"2023-11-04T01:38:50.570829+0000","last_undegraded":"2023-11-04T01:38:50.570829+0000","last_fullsized":"2023-11-04T01:38:50.570829+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001016077,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566056+0000","last_change":"2023-11-04T01:38:50.577480+0000","last_active":"2023-11-04T01:38:51.566056+0000","last_peered":"2023-11-04T01:38:51.566056+0000","last_clean":"2023-11-04T01:38:51.566056+0000","last_became_active":"2023-11-04T01:38:50.577219+0000","last_became_peered":"2023-11-04T01:38:50.577219+0000","last_unstale":"2023-11-04T01:38:51.566056+0000","last_undegraded":"2023-11-04T01:38:51.566056+0000","last_fullsized":"2023-11-04T01:38:51.566056+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:13.853761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.639492+0000","last_change":"2023-11-04T01:38:49.841928+0000","last_active":"2023-11-04T01:38:52.639492+0000","last_peered":"2023-11-04T01:38:52.639492+0000","last_clean":"2023-11-04T01:38:52.639492+0000","last_became_active":"2023-11-04T01:38:49.841648+0000","last_became_peered":"2023-11-04T01:38:49.841648+0000","last_unstale":"2023-11-04T01:38:52.639492+0000","last_undegraded":"2023-11-04T01:38:52.639492+0000","last_fullsized":"2023-11-04T01:38:52.639492+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:06.323544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.568960+0000","last_change":"2023-11-04T01:38:01.984764+0000","last_active":"2023-11-04T01:38:50.568960+0000","last_peered":"2023-11-04T01:38:50.568960+0000","last_clean":"2023-11-04T01:38:50.568960+0000","last_became_active":"2023-11-04T01:38:00.709894+0000","last_became_peered":"2023-11-04T01:38:00.709894+0000","last_unstale":"2023-11-04T01:38:50.568960+0000","last_undegraded":"2023-11-04T01:38:50.568960+0000","last_fullsized":"2023-11-04T01:38:50.568960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:08:42.829255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045046799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.579014+0000","last_change":"2023-11-04T01:38:50.576165+0000","last_active":"2023-11-04T01:38:50.579014+0000","last_peered":"2023-11-04T01:38:50.579014+0000","last_clean":"2023-11-04T01:38:50.579014+0000","last_became_active":"2023-11-04T01:38:50.575881+0000","last_became_peered":"2023-11-04T01:38:50.575881+0000","last_unstale":"2023-11-04T01:38:50.579014+0000","last_undegraded":"2023-11-04T01:38:50.579014+0000","last_fullsized":"2023-11-04T01:38:50.579014+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:59:18.259091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.565775+0000","last_change":"2023-11-04T01:38:49.837036+0000","last_active":"2023-11-04T01:38:50.565775+0000","last_peered":"2023-11-04T01:38:50.565775+0000","last_clean":"2023-11-04T01:38:50.565775+0000","last_became_active":"2023-11-04T01:38:49.836777+0000","last_became_peered":"2023-11-04T01:38:49.836777+0000","last_unstale":"2023-11-04T01:38:50.565775+0000","last_undegraded":"2023-11-04T01:38:50.565775+0000","last_fullsized":"2023-11-04T01:38:50.565775+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:20.978388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":35,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:38:49.824662+0000","last_change":"2023-11-04T01:38:02.321871+0000","last_active":"2023-11-04T01:38:49.824662+0000","last_peered":"2023-11-04T01:38:49.824662+0000","last_clean":"2023-11-04T01:38:49.824662+0000","last_became_active":"2023-11-04T01:38:00.708407+0000","last_became_peered":"2023-11-04T01:38:00.708407+0000","last_unstale":"2023-11-04T01:38:49.824662+0000","last_undegraded":"2023-11-04T01:38:49.824662+0000","last_fullsized":"2023-11-04T01:38:49.824662+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:48.672429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032387200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.565965+0000","last_change":"2023-11-04T01:38:50.581961+0000","last_active":"2023-11-04T01:38:51.565965+0000","last_peered":"2023-11-04T01:38:51.565965+0000","last_clean":"2023-11-04T01:38:51.565965+0000","last_became_active":"2023-11-04T01:38:50.581673+0000","last_became_peered":"2023-11-04T01:38:50.581673+0000","last_unstale":"2023-11-04T01:38:51.565965+0000","last_undegraded":"2023-11-04T01:38:51.565965+0000","last_fullsized":"2023-11-04T01:38:51.565965+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:58.227168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.274633+0000","last_change":"2023-11-04T01:38:49.837998+0000","last_active":"2023-11-04T01:38:52.274633+0000","last_peered":"2023-11-04T01:38:52.274633+0000","last_clean":"2023-11-04T01:38:52.274633+0000","last_became_active":"2023-11-04T01:38:49.837475+0000","last_became_peered":"2023-11-04T01:38:49.837475+0000","last_unstale":"2023-11-04T01:38:52.274633+0000","last_undegraded":"2023-11-04T01:38:52.274633+0000","last_fullsized":"2023-11-04T01:38:52.274633+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:24.046252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.569304+0000","last_change":"2023-11-04T01:38:01.983988+0000","last_active":"2023-11-04T01:38:50.569304+0000","last_peered":"2023-11-04T01:38:50.569304+0000","last_clean":"2023-11-04T01:38:50.569304+0000","last_became_active":"2023-11-04T01:38:00.711020+0000","last_became_peered":"2023-11-04T01:38:00.711020+0000","last_unstale":"2023-11-04T01:38:50.569304+0000","last_undegraded":"2023-11-04T01:38:50.569304+0000","last_fullsized":"2023-11-04T01:38:50.569304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:06.374078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566015+0000","last_change":"2023-11-04T01:38:50.586721+0000","last_active":"2023-11-04T01:38:51.566015+0000","last_peered":"2023-11-04T01:38:51.566015+0000","last_clean":"2023-11-04T01:38:51.566015+0000","last_became_active":"2023-11-04T01:38:50.586246+0000","last_became_peered":"2023-11-04T01:38:50.586246+0000","last_unstale":"2023-11-04T01:38:51.566015+0000","last_undegraded":"2023-11-04T01:38:51.566015+0000","last_fullsized":"2023-11-04T01:38:51.566015+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:22.720888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.567731+0000","last_change":"2023-11-04T01:38:49.837841+0000","last_active":"2023-11-04T01:38:50.567731+0000","last_peered":"2023-11-04T01:38:50.567731+0000","last_clean":"2023-11-04T01:38:50.567731+0000","last_became_active":"2023-11-04T01:38:49.837557+0000","last_became_peered":"2023-11-04T01:38:49.837557+0000","last_unstale":"2023-11-04T01:38:50.567731+0000","last_undegraded":"2023-11-04T01:38:50.567731+0000","last_fullsized":"2023-11-04T01:38:50.567731+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:58.940169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":35,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:38:49.827708+0000","last_change":"2023-11-04T01:38:02.321641+0000","last_active":"2023-11-04T01:38:49.827708+0000","last_peered":"2023-11-04T01:38:49.827708+0000","last_clean":"2023-11-04T01:38:49.827708+0000","last_became_active":"2023-11-04T01:38:00.706199+0000","last_became_peered":"2023-11-04T01:38:00.706199+0000","last_unstale":"2023-11-04T01:38:49.827708+0000","last_undegraded":"2023-11-04T01:38:49.827708+0000","last_fullsized":"2023-11-04T01:38:49.827708+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:15.138325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045080400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.588537+0000","last_change":"2023-11-04T01:38:50.585560+0000","last_active":"2023-11-04T01:38:50.588537+0000","last_peered":"2023-11-04T01:38:50.588537+0000","last_clean":"2023-11-04T01:38:50.588537+0000","last_became_active":"2023-11-04T01:38:50.585278+0000","last_became_peered":"2023-11-04T01:38:50.585278+0000","last_unstale":"2023-11-04T01:38:50.588537+0000","last_undegraded":"2023-11-04T01:38:50.588537+0000","last_fullsized":"2023-11-04T01:38:50.588537+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:52.481427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.577141+0000","last_change":"2023-11-04T01:38:49.839480+0000","last_active":"2023-11-04T01:38:50.577141+0000","last_peered":"2023-11-04T01:38:50.577141+0000","last_clean":"2023-11-04T01:38:50.577141+0000","last_became_active":"2023-11-04T01:38:49.839229+0000","last_became_peered":"2023-11-04T01:38:49.839229+0000","last_unstale":"2023-11-04T01:38:50.577141+0000","last_undegraded":"2023-11-04T01:38:50.577141+0000","last_fullsized":"2023-11-04T01:38:50.577141+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:28.593398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.566699+0000","last_change":"2023-11-04T01:38:02.156148+0000","last_active":"2023-11-04T01:38:50.566699+0000","last_peered":"2023-11-04T01:38:50.566699+0000","last_clean":"2023-11-04T01:38:50.566699+0000","last_became_active":"2023-11-04T01:38:00.708352+0000","last_became_peered":"2023-11-04T01:38:00.708352+0000","last_unstale":"2023-11-04T01:38:50.566699+0000","last_undegraded":"2023-11-04T01:38:50.566699+0000","last_fullsized":"2023-11-04T01:38:50.566699+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035716799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.274789+0000","last_change":"2023-11-04T01:38:50.577331+0000","last_active":"2023-11-04T01:38:52.274789+0000","last_peered":"2023-11-04T01:38:52.274789+0000","last_clean":"2023-11-04T01:38:52.274789+0000","last_became_active":"2023-11-04T01:38:50.577069+0000","last_became_peered":"2023-11-04T01:38:50.577069+0000","last_unstale":"2023-11-04T01:38:52.274789+0000","last_undegraded":"2023-11-04T01:38:52.274789+0000","last_fullsized":"2023-11-04T01:38:52.274789+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:40.201900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.567587+0000","last_change":"2023-11-04T01:38:49.834676+0000","last_active":"2023-11-04T01:38:51.567587+0000","last_peered":"2023-11-04T01:38:51.567587+0000","last_clean":"2023-11-04T01:38:51.567587+0000","last_became_active":"2023-11-04T01:38:49.834394+0000","last_became_peered":"2023-11-04T01:38:49.834394+0000","last_unstale":"2023-11-04T01:38:51.567587+0000","last_undegraded":"2023-11-04T01:38:51.567587+0000","last_fullsized":"2023-11-04T01:38:51.567587+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:34.765307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":36,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:38:49.821971+0000","last_change":"2023-11-04T01:38:01.939729+0000","last_active":"2023-11-04T01:38:49.821971+0000","last_peered":"2023-11-04T01:38:49.821971+0000","last_clean":"2023-11-04T01:38:49.821971+0000","last_became_active":"2023-11-04T01:38:00.704384+0000","last_became_peered":"2023-11-04T01:38:00.704384+0000","last_unstale":"2023-11-04T01:38:49.821971+0000","last_undegraded":"2023-11-04T01:38:49.821971+0000","last_fullsized":"2023-11-04T01:38:49.821971+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080052200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.585518+0000","last_change":"2023-11-04T01:38:50.584473+0000","last_active":"2023-11-04T01:38:50.585518+0000","last_peered":"2023-11-04T01:38:50.585518+0000","last_clean":"2023-11-04T01:38:50.585518+0000","last_became_active":"2023-11-04T01:38:50.584229+0000","last_became_peered":"2023-11-04T01:38:50.584229+0000","last_unstale":"2023-11-04T01:38:50.585518+0000","last_undegraded":"2023-11-04T01:38:50.585518+0000","last_fullsized":"2023-11-04T01:38:50.585518+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:58.684455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.274336+0000","last_change":"2023-11-04T01:38:49.834873+0000","last_active":"2023-11-04T01:38:52.274336+0000","last_peered":"2023-11-04T01:38:52.274336+0000","last_clean":"2023-11-04T01:38:52.274336+0000","last_became_active":"2023-11-04T01:38:49.834600+0000","last_became_peered":"2023-11-04T01:38:49.834600+0000","last_unstale":"2023-11-04T01:38:52.274336+0000","last_undegraded":"2023-11-04T01:38:52.274336+0000","last_fullsized":"2023-11-04T01:38:52.274336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:12.804737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":38,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.567993+0000","last_change":"2023-11-04T01:38:01.697272+0000","last_active":"2023-11-04T01:38:50.567993+0000","last_peered":"2023-11-04T01:38:50.567993+0000","last_clean":"2023-11-04T01:38:50.567993+0000","last_became_active":"2023-11-04T01:38:00.709395+0000","last_became_peered":"2023-11-04T01:38:00.709395+0000","last_unstale":"2023-11-04T01:38:50.567993+0000","last_undegraded":"2023-11-04T01:38:50.567993+0000","last_fullsized":"2023-11-04T01:38:50.567993+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076665499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.585807+0000","last_change":"2023-11-04T01:38:50.584339+0000","last_active":"2023-11-04T01:38:50.585807+0000","last_peered":"2023-11-04T01:38:50.585807+0000","last_clean":"2023-11-04T01:38:50.585807+0000","last_became_active":"2023-11-04T01:38:50.584079+0000","last_became_peered":"2023-11-04T01:38:50.584079+0000","last_unstale":"2023-11-04T01:38:50.585807+0000","last_undegraded":"2023-11-04T01:38:50.585807+0000","last_fullsized":"2023-11-04T01:38:50.585807+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:41.782225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.573229+0000","last_change":"2023-11-04T01:38:49.838758+0000","last_active":"2023-11-04T01:38:50.573229+0000","last_peered":"2023-11-04T01:38:50.573229+0000","last_clean":"2023-11-04T01:38:50.573229+0000","last_became_active":"2023-11-04T01:38:49.838448+0000","last_became_peered":"2023-11-04T01:38:49.838448+0000","last_unstale":"2023-11-04T01:38:50.573229+0000","last_undegraded":"2023-11-04T01:38:50.573229+0000","last_fullsized":"2023-11-04T01:38:50.573229+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:04:59.373556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.569559+0000","last_change":"2023-11-04T01:38:01.984567+0000","last_active":"2023-11-04T01:38:50.569559+0000","last_peered":"2023-11-04T01:38:50.569559+0000","last_clean":"2023-11-04T01:38:50.569559+0000","last_became_active":"2023-11-04T01:38:00.708020+0000","last_became_peered":"2023-11-04T01:38:00.708020+0000","last_unstale":"2023-11-04T01:38:50.569559+0000","last_undegraded":"2023-11-04T01:38:50.569559+0000","last_fullsized":"2023-11-04T01:38:50.569559+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:09.638146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056906299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.576452+0000","last_change":"2023-11-04T01:38:50.573793+0000","last_active":"2023-11-04T01:38:50.576452+0000","last_peered":"2023-11-04T01:38:50.576452+0000","last_clean":"2023-11-04T01:38:50.576452+0000","last_became_active":"2023-11-04T01:38:50.573533+0000","last_became_peered":"2023-11-04T01:38:50.573533+0000","last_unstale":"2023-11-04T01:38:50.576452+0000","last_undegraded":"2023-11-04T01:38:50.576452+0000","last_fullsized":"2023-11-04T01:38:50.576452+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:22.720888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.567290+0000","last_change":"2023-11-04T01:38:49.840901+0000","last_active":"2023-11-04T01:38:51.567290+0000","last_peered":"2023-11-04T01:38:51.567290+0000","last_clean":"2023-11-04T01:38:51.567290+0000","last_became_active":"2023-11-04T01:38:49.839367+0000","last_became_peered":"2023-11-04T01:38:49.839367+0000","last_unstale":"2023-11-04T01:38:51.567290+0000","last_undegraded":"2023-11-04T01:38:51.567290+0000","last_fullsized":"2023-11-04T01:38:51.567290+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:32:53.359479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":41,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.570579+0000","last_change":"2023-11-04T01:38:01.699685+0000","last_active":"2023-11-04T01:38:50.570579+0000","last_peered":"2023-11-04T01:38:50.570579+0000","last_clean":"2023-11-04T01:38:50.570579+0000","last_became_active":"2023-11-04T01:38:00.706802+0000","last_became_peered":"2023-11-04T01:38:00.706802+0000","last_unstale":"2023-11-04T01:38:50.570579+0000","last_undegraded":"2023-11-04T01:38:50.570579+0000","last_fullsized":"2023-11-04T01:38:50.570579+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085845400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.585600+0000","last_change":"2023-11-04T01:38:50.580159+0000","last_active":"2023-11-04T01:38:50.585600+0000","last_peered":"2023-11-04T01:38:50.585600+0000","last_clean":"2023-11-04T01:38:50.585600+0000","last_became_active":"2023-11-04T01:38:50.579877+0000","last_became_peered":"2023-11-04T01:38:50.579877+0000","last_unstale":"2023-11-04T01:38:50.585600+0000","last_undegraded":"2023-11-04T01:38:50.585600+0000","last_fullsized":"2023-11-04T01:38:50.585600+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:38:52.997987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566107+0000","last_change":"2023-11-04T01:38:49.839808+0000","last_active":"2023-11-04T01:38:51.566107+0000","last_peered":"2023-11-04T01:38:51.566107+0000","last_clean":"2023-11-04T01:38:51.566107+0000","last_became_active":"2023-11-04T01:38:49.839489+0000","last_became_peered":"2023-11-04T01:38:49.839489+0000","last_unstale":"2023-11-04T01:38:51.566107+0000","last_undegraded":"2023-11-04T01:38:51.566107+0000","last_fullsized":"2023-11-04T01:38:51.566107+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:58:13.175445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":39,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.573215+0000","last_change":"2023-11-04T01:38:01.700399+0000","last_active":"2023-11-04T01:38:50.573215+0000","last_peered":"2023-11-04T01:38:50.573215+0000","last_clean":"2023-11-04T01:38:50.573215+0000","last_became_active":"2023-11-04T01:38:00.701352+0000","last_became_peered":"2023-11-04T01:38:00.701352+0000","last_unstale":"2023-11-04T01:38:50.573215+0000","last_undegraded":"2023-11-04T01:38:50.573215+0000","last_fullsized":"2023-11-04T01:38:50.573215+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078589399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:52.639809+0000","last_change":"2023-11-04T01:38:50.578031+0000","last_active":"2023-11-04T01:38:52.639809+0000","last_peered":"2023-11-04T01:38:52.639809+0000","last_clean":"2023-11-04T01:38:52.639809+0000","last_became_active":"2023-11-04T01:38:50.577756+0000","last_became_peered":"2023-11-04T01:38:50.577756+0000","last_unstale":"2023-11-04T01:38:52.639809+0000","last_undegraded":"2023-11-04T01:38:52.639809+0000","last_fullsized":"2023-11-04T01:38:52.639809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:04.092811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.565888+0000","last_change":"2023-11-04T01:38:49.840905+0000","last_active":"2023-11-04T01:38:51.565888+0000","last_peered":"2023-11-04T01:38:51.565888+0000","last_clean":"2023-11-04T01:38:51.565888+0000","last_became_active":"2023-11-04T01:38:49.840116+0000","last_became_peered":"2023-11-04T01:38:49.840116+0000","last_unstale":"2023-11-04T01:38:51.565888+0000","last_undegraded":"2023-11-04T01:38:51.565888+0000","last_fullsized":"2023-11-04T01:38:51.565888+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:28:03.487295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":34,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:38:49.828601+0000","last_change":"2023-11-04T01:38:02.362072+0000","last_active":"2023-11-04T01:38:49.828601+0000","last_peered":"2023-11-04T01:38:49.828601+0000","last_clean":"2023-11-04T01:38:49.828601+0000","last_became_active":"2023-11-04T01:38:00.710897+0000","last_became_peered":"2023-11-04T01:38:00.710897+0000","last_unstale":"2023-11-04T01:38:49.828601+0000","last_undegraded":"2023-11-04T01:38:49.828601+0000","last_fullsized":"2023-11-04T01:38:49.828601+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:25.229838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058055900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566626+0000","last_change":"2023-11-04T01:38:50.576435+0000","last_active":"2023-11-04T01:38:51.566626+0000","last_peered":"2023-11-04T01:38:51.566626+0000","last_clean":"2023-11-04T01:38:51.566626+0000","last_became_active":"2023-11-04T01:38:50.576179+0000","last_became_peered":"2023-11-04T01:38:50.576179+0000","last_unstale":"2023-11-04T01:38:51.566626+0000","last_undegraded":"2023-11-04T01:38:51.566626+0000","last_fullsized":"2023-11-04T01:38:51.566626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:46:56.186978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.567211+0000","last_change":"2023-11-04T01:38:49.840206+0000","last_active":"2023-11-04T01:38:51.567211+0000","last_peered":"2023-11-04T01:38:51.567211+0000","last_clean":"2023-11-04T01:38:51.567211+0000","last_became_active":"2023-11-04T01:38:49.839883+0000","last_became_peered":"2023-11-04T01:38:49.839883+0000","last_unstale":"2023-11-04T01:38:51.567211+0000","last_undegraded":"2023-11-04T01:38:51.567211+0000","last_fullsized":"2023-11-04T01:38:51.567211+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:58:55.185735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":36,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:38:49.822082+0000","last_change":"2023-11-04T01:38:01.939857+0000","last_active":"2023-11-04T01:38:49.822082+0000","last_peered":"2023-11-04T01:38:49.822082+0000","last_clean":"2023-11-04T01:38:49.822082+0000","last_became_active":"2023-11-04T01:38:00.701371+0000","last_became_peered":"2023-11-04T01:38:00.701371+0000","last_unstale":"2023-11-04T01:38:49.822082+0000","last_undegraded":"2023-11-04T01:38:49.822082+0000","last_fullsized":"2023-11-04T01:38:49.822082+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078632099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.567115+0000","last_change":"2023-11-04T01:38:50.586398+0000","last_active":"2023-11-04T01:38:51.567115+0000","last_peered":"2023-11-04T01:38:51.567115+0000","last_clean":"2023-11-04T01:38:51.567115+0000","last_became_active":"2023-11-04T01:38:50.586138+0000","last_became_peered":"2023-11-04T01:38:50.586138+0000","last_unstale":"2023-11-04T01:38:51.567115+0000","last_undegraded":"2023-11-04T01:38:51.567115+0000","last_fullsized":"2023-11-04T01:38:51.567115+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:24.725262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.567429+0000","last_change":"2023-11-04T01:38:49.835334+0000","last_active":"2023-11-04T01:38:51.567429+0000","last_peered":"2023-11-04T01:38:51.567429+0000","last_clean":"2023-11-04T01:38:51.567429+0000","last_became_active":"2023-11-04T01:38:49.835060+0000","last_became_peered":"2023-11-04T01:38:49.835060+0000","last_unstale":"2023-11-04T01:38:51.567429+0000","last_undegraded":"2023-11-04T01:38:51.567429+0000","last_fullsized":"2023-11-04T01:38:51.567429+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:06.323544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":36,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:38:49.821995+0000","last_change":"2023-11-04T01:38:01.939662+0000","last_active":"2023-11-04T01:38:49.821995+0000","last_peered":"2023-11-04T01:38:49.821995+0000","last_clean":"2023-11-04T01:38:49.821995+0000","last_became_active":"2023-11-04T01:38:00.705871+0000","last_became_peered":"2023-11-04T01:38:00.705871+0000","last_unstale":"2023-11-04T01:38:49.821995+0000","last_undegraded":"2023-11-04T01:38:49.821995+0000","last_fullsized":"2023-11-04T01:38:49.821995+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066873200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.585593+0000","last_change":"2023-11-04T01:38:50.584476+0000","last_active":"2023-11-04T01:38:50.585593+0000","last_peered":"2023-11-04T01:38:50.585593+0000","last_clean":"2023-11-04T01:38:50.585593+0000","last_became_active":"2023-11-04T01:38:50.584190+0000","last_became_peered":"2023-11-04T01:38:50.584190+0000","last_unstale":"2023-11-04T01:38:50.585593+0000","last_undegraded":"2023-11-04T01:38:50.585593+0000","last_fullsized":"2023-11-04T01:38:50.585593+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:49.817308+0000","last_clean_scrub_stamp":"2023-11-04T01:38:49.817308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:56:54.685121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:38:51.566150+0000","last_change":"2023-11-04T01:38:49.835780+0000","last_active":"2023-11-04T01:38:51.566150+0000","last_peered":"2023-11-04T01:38:51.566150+0000","last_clean":"2023-11-04T01:38:51.566150+0000","last_became_active":"2023-11-04T01:38:49.835483+0000","last_became_peered":"2023-11-04T01:38:49.835483+0000","last_unstale":"2023-11-04T01:38:51.566150+0000","last_undegraded":"2023-11-04T01:38:51.566150+0000","last_fullsized":"2023-11-04T01:38:51.566150+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:48.812332+0000","last_clean_scrub_stamp":"2023-11-04T01:38:48.812332+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:12:11.866186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.569148+0000","last_change":"2023-11-04T01:38:01.984672+0000","last_active":"2023-11-04T01:38:50.569148+0000","last_peered":"2023-11-04T01:38:50.569148+0000","last_clean":"2023-11-04T01:38:50.569148+0000","last_became_active":"2023-11-04T01:38:00.706804+0000","last_became_peered":"2023-11-04T01:38:00.706804+0000","last_unstale":"2023-11-04T01:38:50.569148+0000","last_undegraded":"2023-11-04T01:38:50.569148+0000","last_fullsized":"2023-11-04T01:38:50.569148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:48.412413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038439000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:38:50.566671+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:38:50.566671+0000","last_peered":"2023-11-04T01:38:50.566671+0000","last_clean":"2023-11-04T01:38:50.566671+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:38:50.566671+0000","last_undegraded":"2023-11-04T01:38:50.566671+0000","last_fullsized":"2023-11-04T01:38:50.566671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28400,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343440,"statfs":{"total":96636764160,"available":96607682560,"internally_reserved":0,"allocated":1400832,"data_stored":961081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.55900000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.497}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.53400000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.437,"15min":0.42999999999999999},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65200000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.69799999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.504,"15min":0.496},"min":{"1min":0.35399999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.44,"5min":0.317,"15min":0.317},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.71299999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.48799999999999999,"15min":0.47899999999999998},"min":{"1min":0.39300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.54000000000000004,"15min":0.52900000000000003},"min":{"1min":0.42299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.68200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":370189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.501,"15min":0.495},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68799999999999994,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.64300000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.375,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67600000000000005,"5min":1.05,"15min":1.05},"last":0.628},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70099999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.66400000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.66900000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.748,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.44,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71999999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.57399999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.501,"15min":0.501},"min":{"1min":0.373,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.51800000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.36199999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81899999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.38,"5min":0.372,"15min":0.372},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.45200000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.435}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":790528,"data_stored":363214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.41499999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72499999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.48799999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.74299999999999999,"5min":0.746,"15min":0.746},"last":0.55800000000000005}]},{"osd":4,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48599999999999999,"15min":0.48899999999999999},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63800000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.35599999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.57799999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.40999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.37,"15min":0.37},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.69099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":370167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.65800000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.51000000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82099999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.58899999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72199999999999998,"5min":0.879,"15min":0.879},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85499999999999998,"5min":1.089,"15min":1.089},"last":0.46400000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.33600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.56699999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.501},"min":{"1min":0.34100000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.625}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.40000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92500000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.374}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":363236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.32200000000000001,"15min":0.32400000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.316,"5min":0.314,"15min":0.314},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.41999999999999998,"5min":0.441,"15min":0.441},"last":0.28799999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.41699999999999998,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.24199999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.40600000000000003,"5min":0.502,"15min":0.502},"last":0.33900000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.29599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.442,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.371,"15min":0.375},"min":{"1min":0.27900000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.47599999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.36299999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.432,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77800000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.502}]},{"osd":5,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.74299999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.443,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76400000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.39300000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.41999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.71899999999999997,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.44500000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.42599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.46800000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.436}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":364736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.32500000000000001,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.442,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.33600000000000002,"15min":0.34300000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.39300000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.38}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.48399999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.249},{"interface":"front","average":{"1min":0.317,"5min":0.39100000000000001,"15min":0.40300000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.44,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.34599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.40899999999999997,"15min":0.42099999999999999},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.51500000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.42099999999999999,"15min":0.433},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.46999999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.30299999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.63900000000000001,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.82399999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.45200000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.61899999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.68300000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.877,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79700000000000004,"5min":1,"15min":1},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61199999999999999,"15min":0.62},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73099999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.64100000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76200000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.65800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":365352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.39500000000000002,"15min":0.36099999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.42599999999999999,"15min":0.41199999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":3.456,"5min":3.456,"15min":3.456},"last":0.38200000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":0.249},{"interface":"front","average":{"1min":0.5,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.29999999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.52600000000000002,"15min":0.47099999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":8.891,"5min":8.891,"15min":8.891},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.46800000000000003,"15min":0.39600000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":9.8889999999999993,"5min":9.8889999999999993,"15min":9.8889999999999993},"last":0.35599999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.629,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":4.5720000000000001,"5min":4.5720000000000001,"15min":4.5720000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":0.5}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.46899999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.44400000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.68700000000000006,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.915,"5min":5.915,"15min":5.915},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.52800000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.66000000000000003,"15min":0.60599999999999998},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":7.2599999999999998,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.45300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28380,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343460,"statfs":{"total":96636764160,"available":96607703040,"internally_reserved":0,"allocated":1392640,"data_stored":960465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30599999999999999,"15min":0.308},"min":{"1min":0.22500000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.40600000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.318,"5min":0.33500000000000002,"15min":0.33800000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.47499999999999998,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.49099999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.36299999999999999,"15min":0.36699999999999999},"min":{"1min":0.23599999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.39900000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.432},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.245,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.45500000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.44600000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.315,"15min":0.315},"min":{"1min":0.24199999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.38100000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.374,"15min":0.379},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44700000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46300000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72199999999999998,"5min":0.87,"15min":0.87},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.314,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.81899999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.73299999999999998,"5min":0.996,"15min":0.996},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.66700000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.88900000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60499999999999998,"15min":0.61399999999999999},"min":{"1min":0.433,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70899999999999996,"5min":1.026,"15min":1.026},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":1.177,"15min":1.177},"last":0.81000000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.71999999999999997,"5min":1.131,"15min":1.131},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":0.746,"15min":0.746},"last":0.94399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:38:54.128 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:38:54.128 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:38:54.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.267+0000 7f5f5c125640 1 Processor -- start 2023-11-04T01:38:54.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.268+0000 7f5f5c125640 1 -- start start 2023-11-04T01:38:54.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.268+0000 7f5f5c125640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5f54160430 0x7f5f540b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.268+0000 7f5f5c125640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5f540b2b60 0x7f5f5406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.268+0000 7f5f5c125640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f540b2fc0 con 0x7f5f5406c1d0 2023-11-04T01:38:54.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.268+0000 7f5f5c125640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f540cb580 con 0x7f5f54160430 2023-11-04T01:38:54.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.268+0000 7f5f5c125640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5406ca40 con 0x7f5f540b2b60 2023-11-04T01:38:54.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.269+0000 7f5f59ec1640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5f54160430 0x7f5f540b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.269+0000 7f5f5a6c2640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5f5406c1d0 0x7f5f54160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41854/0 (socket says 172.21.15.114:41854) 2023-11-04T01:38:54.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.269+0000 7f5f5a6c2640 1 -- 172.21.15.114:0/1866230970 learned_addr learned my addr 172.21.15.114:0/1866230970 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:54.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.269+0000 7f5f596c0640 1 --2- 172.21.15.114:0/1866230970 >> v2:172.21.15.141:3300/0 conn(0x7f5f540b2b60 0x7f5f5406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.269+0000 7f5f59ec1640 1 -- 172.21.15.114:0/1866230970 >> v2:172.21.15.141:3300/0 conn(0x7f5f540b2b60 msgr2=0x7f5f5406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:54.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.269+0000 7f5f59ec1640 1 --2- 172.21.15.114:0/1866230970 >> v2:172.21.15.141:3300/0 conn(0x7f5f540b2b60 0x7f5f5406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.269+0000 7f5f59ec1640 1 -- 172.21.15.114:0/1866230970 >> v1:172.21.15.114:6789/0 conn(0x7f5f5406c1d0 legacy=0x7f5f54160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.269+0000 7f5f59ec1640 1 -- 172.21.15.114:0/1866230970 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5406cd20 con 0x7f5f54160430 2023-11-04T01:38:54.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.269+0000 7f5f58ebf640 1 -- 172.21.15.114:0/1866230970 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436002455 0 0) 0x7f5f540b2fc0 con 0x7f5f5406c1d0 2023-11-04T01:38:54.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.270+0000 7f5f59ec1640 1 --2- 172.21.15.114:0/1866230970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f54160430 0x7f5f540b2620 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5f5406e5b0 tx=0x7f5f5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5e5f0cf3ece78c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:54.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.270+0000 7f5f58ebf640 1 -- 172.21.15.114:0/1866230970 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50031830 con 0x7f5f54160430 2023-11-04T01:38:54.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.270+0000 7f5f58ebf640 1 -- 172.21.15.114:0/1866230970 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f50031990 con 0x7f5f54160430 2023-11-04T01:38:54.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.270+0000 7f5f58ebf640 1 -- 172.21.15.114:0/1866230970 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50031d20 con 0x7f5f54160430 2023-11-04T01:38:54.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.270+0000 7f5f5c125640 1 -- 172.21.15.114:0/1866230970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f54160430 msgr2=0x7f5f540b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.270+0000 7f5f5c125640 1 --2- 172.21.15.114:0/1866230970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f54160430 0x7f5f540b2620 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5f5406e5b0 tx=0x7f5f5002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.270+0000 7f5f5c125640 1 -- 172.21.15.114:0/1866230970 shutdown_connections 2023-11-04T01:38:54.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.270+0000 7f5f5c125640 1 --2- 172.21.15.114:0/1866230970 >> v2:172.21.15.141:3300/0 conn(0x7f5f540b2b60 0x7f5f5406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.270+0000 7f5f5c125640 1 --2- 172.21.15.114:0/1866230970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f54160430 0x7f5f540b2620 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.270+0000 7f5f5c125640 1 -- 172.21.15.114:0/1866230970 >> 172.21.15.114:0/1866230970 conn(0x7f5f5406ea20 msgr2=0x7f5f5406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:54.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.270+0000 7f5f5c125640 1 -- 172.21.15.114:0/1866230970 shutdown_connections 2023-11-04T01:38:54.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.270+0000 7f5f5c125640 1 -- 172.21.15.114:0/1866230970 wait complete. 2023-11-04T01:38:54.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.272+0000 7f5f5c125640 1 Processor -- start 2023-11-04T01:38:54.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.272+0000 7f5f5c125640 1 -- start start 2023-11-04T01:38:54.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.272+0000 7f5f5c125640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f5406c1d0 0x7f5f54152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.272+0000 7f5f5c125640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f540b2b60 0x7f5f540c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.272+0000 7f5f5c125640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f54160430 0x7f5f540c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.272+0000 7f5f5c125640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f540c4980 con 0x7f5f540b2b60 2023-11-04T01:38:54.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.272+0000 7f5f5c125640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f540c4c60 con 0x7f5f54160430 2023-11-04T01:38:54.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.272+0000 7f5f5c125640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f540c4f40 con 0x7f5f5406c1d0 2023-11-04T01:38:54.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.272+0000 7f5f596c0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f540b2b60 0x7f5f540c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f596c0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f540b2b60 0x7f5f540c5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48578/0 (socket says 172.21.15.114:48578) 2023-11-04T01:38:54.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f596c0640 1 -- 172.21.15.114:0/1811547330 learned_addr learned my addr 172.21.15.114:0/1811547330 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:54.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f59ec1640 1 --2- 172.21.15.114:0/1811547330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f5406c1d0 0x7f5f54152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f5a6c2640 1 --2- 172.21.15.114:0/1811547330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f54160430 0x7f5f540c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f596c0640 1 -- 172.21.15.114:0/1811547330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f5406c1d0 msgr2=0x7f5f54152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f596c0640 1 --2- 172.21.15.114:0/1811547330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f5406c1d0 0x7f5f54152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f596c0640 1 -- 172.21.15.114:0/1811547330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f54160430 msgr2=0x7f5f540c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f596c0640 1 --2- 172.21.15.114:0/1811547330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f54160430 0x7f5f540c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f596c0640 1 -- 172.21.15.114:0/1811547330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f50009400 con 0x7f5f540b2b60 2023-11-04T01:38:54.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f59ec1640 1 --2- 172.21.15.114:0/1811547330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f5406c1d0 0x7f5f54152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:54.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f5a6c2640 1 --2- 172.21.15.114:0/1811547330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f54160430 0x7f5f540c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:54.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f596c0640 1 --2- 172.21.15.114:0/1811547330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f540b2b60 0x7f5f540c5a20 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400e9b0 tx=0x7f5f4400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:54.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f4a7fc640 1 -- 172.21.15.114:0/1811547330 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44009670 con 0x7f5f540b2b60 2023-11-04T01:38:54.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f4a7fc640 1 -- 172.21.15.114:0/1811547330 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4400c9a0 con 0x7f5f540b2b60 2023-11-04T01:38:54.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f5c125640 1 -- 172.21.15.114:0/1811547330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f540c5220 con 0x7f5f540b2b60 2023-11-04T01:38:54.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f4a7fc640 1 -- 172.21.15.114:0/1811547330 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400cd50 con 0x7f5f540b2b60 2023-11-04T01:38:54.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.273+0000 7f5f5c125640 1 -- 172.21.15.114:0/1811547330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f54152590 con 0x7f5f540b2b60 2023-11-04T01:38:54.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.274+0000 7f5f5c125640 1 -- 172.21.15.114:0/1811547330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f54074290 con 0x7f5f540b2b60 2023-11-04T01:38:54.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.274+0000 7f5f4a7fc640 1 -- 172.21.15.114:0/1811547330 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f44013470 con 0x7f5f540b2b60 2023-11-04T01:38:54.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.275+0000 7f5f4a7fc640 1 --2- 172.21.15.114:0/1811547330 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f3806ae70 0x7f5f3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.275+0000 7f5f59ec1640 1 --2- 172.21.15.114:0/1811547330 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f3806ae70 0x7f5f3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.275+0000 7f5f4a7fc640 1 -- 172.21.15.114:0/1811547330 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5f44089ac0 con 0x7f5f540b2b60 2023-11-04T01:38:54.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.275+0000 7f5f59ec1640 1 --2- 172.21.15.114:0/1811547330 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f3806ae70 0x7f5f3806d330 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5f50036000 tx=0x7f5f50008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:54.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.279+0000 7f5f4a7fc640 1 -- 172.21.15.114:0/1811547330 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5f44054960 con 0x7f5f540b2b60 2023-11-04T01:38:54.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.508+0000 7f5f5c125640 1 -- 172.21.15.114:0/1811547330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5f540b6b20 con 0x7f5f540b2b60 2023-11-04T01:38:54.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.510+0000 7f5f4a7fc640 1 -- 172.21.15.114:0/1811547330 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f5f440210b0 con 0x7f5f540b2b60 2023-11-04T01:38:54.512 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2023-11-04T01:38:54.512 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDan0Vl3QHODhAA6LWlhd+avWYsoYsWMbOiVA== 2023-11-04T01:38:54.513 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2023-11-04T01:38:54.513 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2023-11-04T01:38:54.513 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:38:54.513 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2023-11-04T01:38:54.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.512+0000 7f5f5c125640 1 -- 172.21.15.114:0/1811547330 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f3806ae70 msgr2=0x7f5f3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.512+0000 7f5f5c125640 1 --2- 172.21.15.114:0/1811547330 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f3806ae70 0x7f5f3806d330 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5f50036000 tx=0x7f5f50008030 comp rx=0 tx=0).stop 2023-11-04T01:38:54.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.512+0000 7f5f5c125640 1 -- 172.21.15.114:0/1811547330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f540b2b60 msgr2=0x7f5f540c5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.512+0000 7f5f5c125640 1 --2- 172.21.15.114:0/1811547330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f540b2b60 0x7f5f540c5a20 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400e9b0 tx=0x7f5f4400ee70 comp rx=0 tx=0).stop 2023-11-04T01:38:54.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.513+0000 7f5f5c125640 1 -- 172.21.15.114:0/1811547330 shutdown_connections 2023-11-04T01:38:54.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.513+0000 7f5f5c125640 1 --2- 172.21.15.114:0/1811547330 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f3806ae70 0x7f5f3806d330 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.513+0000 7f5f5c125640 1 --2- 172.21.15.114:0/1811547330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f54160430 0x7f5f540c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.513+0000 7f5f5c125640 1 --2- 172.21.15.114:0/1811547330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f540b2b60 0x7f5f540c5a20 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.513+0000 7f5f5c125640 1 --2- 172.21.15.114:0/1811547330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f5406c1d0 0x7f5f54152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.513+0000 7f5f5c125640 1 -- 172.21.15.114:0/1811547330 >> 172.21.15.114:0/1811547330 conn(0x7f5f5406ea20 msgr2=0x7f5f540ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:54.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.513+0000 7f5f5c125640 1 -- 172.21.15.114:0/1811547330 shutdown_connections 2023-11-04T01:38:54.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.513+0000 7f5f5c125640 1 -- 172.21.15.114:0/1811547330 wait complete. 2023-11-04T01:38:54.525 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:38:54.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.621+0000 7f96f8f05640 1 Processor -- start 2023-11-04T01:38:54.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.622+0000 7f96f8f05640 1 -- start start 2023-11-04T01:38:54.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.622+0000 7f96f8f05640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f96f40b42c0 0x7f96f40c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.622+0000 7f96f8f05640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f40ca050 con 0x7f96f40c9c40 2023-11-04T01:38:54.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.622+0000 7f96f8f05640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f406cfa0 con 0x7f96f415ad80 2023-11-04T01:38:54.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.622+0000 7f96f8f05640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f406d280 con 0x7f96f40b42c0 2023-11-04T01:38:54.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.623+0000 7f96f2d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f96f40c9c40 0x7f96f40b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41862/0 (socket says 172.21.15.114:41862) 2023-11-04T01:38:54.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.623+0000 7f96f2d9d640 1 -- 172.21.15.114:0/132487001 learned_addr learned my addr 172.21.15.114:0/132487001 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:54.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.623+0000 7f96f1d9b640 1 --2- 172.21.15.114:0/132487001 >> v2:172.21.15.141:3300/0 conn(0x7f96f40b42c0 0x7f96f40c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.623+0000 7f96f159a640 1 -- 172.21.15.114:0/132487001 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747203181 0 0) 0x7f96f40ca050 con 0x7f96f40c9c40 2023-11-04T01:38:54.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.623+0000 7f96f159a640 1 -- 172.21.15.114:0/132487001 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96e0003520 con 0x7f96f40c9c40 2023-11-04T01:38:54.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.623+0000 7f96f159a640 1 -- 172.21.15.114:0/132487001 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3891774097 0 0) 0x7f96e0003520 con 0x7f96f40c9c40 2023-11-04T01:38:54.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.623+0000 7f96f1d9b640 1 -- 172.21.15.114:0/132487001 >> v1:172.21.15.141:6789/0 conn(0x7f96f415ad80 legacy=0x7f96f406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.623+0000 7f96f1d9b640 1 -- 172.21.15.114:0/132487001 >> v1:172.21.15.114:6789/0 conn(0x7f96f40c9c40 legacy=0x7f96f40b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.623+0000 7f96f1d9b640 1 -- 172.21.15.114:0/132487001 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f406d560 con 0x7f96f40b42c0 2023-11-04T01:38:54.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.624+0000 7f96f1d9b640 1 --2- 172.21.15.114:0/132487001 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96f40b42c0 0x7f96f40c9700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0097a0 tx=0x7f96dc02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=320b47f13d1416f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:54.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.624+0000 7f96f159a640 1 -- 172.21.15.114:0/132487001 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e40019f0 con 0x7f96f40b42c0 2023-11-04T01:38:54.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.624+0000 7f96f159a640 1 -- 172.21.15.114:0/132487001 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc031590 con 0x7f96f40b42c0 2023-11-04T01:38:54.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.624+0000 7f96f159a640 1 -- 172.21.15.114:0/132487001 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc031920 con 0x7f96f40b42c0 2023-11-04T01:38:54.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.625+0000 7f96f8f05640 1 -- 172.21.15.114:0/132487001 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96f40b42c0 msgr2=0x7f96f40c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.625+0000 7f96f8f05640 1 --2- 172.21.15.114:0/132487001 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96f40b42c0 0x7f96f40c9700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0097a0 tx=0x7f96dc02b8b0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.625+0000 7f96f8f05640 1 -- 172.21.15.114:0/132487001 shutdown_connections 2023-11-04T01:38:54.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.625+0000 7f96f8f05640 1 --2- 172.21.15.114:0/132487001 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96f40b42c0 0x7f96f40c9700 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.625+0000 7f96f8f05640 1 -- 172.21.15.114:0/132487001 >> 172.21.15.114:0/132487001 conn(0x7f96f40ce950 msgr2=0x7f96f40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:54.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.625+0000 7f96f8f05640 1 -- 172.21.15.114:0/132487001 shutdown_connections 2023-11-04T01:38:54.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.625+0000 7f96f8f05640 1 -- 172.21.15.114:0/132487001 wait complete. 2023-11-04T01:38:54.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.626+0000 7f96f8f05640 1 Processor -- start 2023-11-04T01:38:54.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.626+0000 7f96f8f05640 1 -- start start 2023-11-04T01:38:54.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f8f05640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96f40b42c0 0x7f96f40acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f8f05640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96f40c9c40 0x7f96f40c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f8f05640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96f415ad80 0x7f96f40c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f8f05640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f40c7540 con 0x7f96f40b42c0 2023-11-04T01:38:54.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f8f05640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f40c7820 con 0x7f96f415ad80 2023-11-04T01:38:54.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f8f05640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f40c7b00 con 0x7f96f40c9c40 2023-11-04T01:38:54.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96f40b42c0 0x7f96f40acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96f40b42c0 0x7f96f40acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48592/0 (socket says 172.21.15.114:48592) 2023-11-04T01:38:54.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f259c640 1 -- 172.21.15.114:0/1215578923 learned_addr learned my addr 172.21.15.114:0/1215578923 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:54.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f1d9b640 1 --2- 172.21.15.114:0/1215578923 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96f40c9c40 0x7f96f40c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f2d9d640 1 --2- 172.21.15.114:0/1215578923 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96f415ad80 0x7f96f40c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f259c640 1 -- 172.21.15.114:0/1215578923 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96f40c9c40 msgr2=0x7f96f40c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f259c640 1 --2- 172.21.15.114:0/1215578923 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96f40c9c40 0x7f96f40c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f259c640 1 -- 172.21.15.114:0/1215578923 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96f415ad80 msgr2=0x7f96f40c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f259c640 1 --2- 172.21.15.114:0/1215578923 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96f415ad80 0x7f96f40c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f259c640 1 -- 172.21.15.114:0/1215578923 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc009400 con 0x7f96f40b42c0 2023-11-04T01:38:54.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f2d9d640 1 --2- 172.21.15.114:0/1215578923 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96f415ad80 0x7f96f40c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:54.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f1d9b640 1 --2- 172.21.15.114:0/1215578923 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96f40c9c40 0x7f96f40c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:54.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f259c640 1 --2- 172.21.15.114:0/1215578923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96f40b42c0 0x7f96f40acb00 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00c400 tx=0x7f96ec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:54.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96eaffd640 1 -- 172.21.15.114:0/1215578923 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec0052d0 con 0x7f96f40b42c0 2023-11-04T01:38:54.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96eaffd640 1 -- 172.21.15.114:0/1215578923 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec005430 con 0x7f96f40b42c0 2023-11-04T01:38:54.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f8f05640 1 -- 172.21.15.114:0/1215578923 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f40c7de0 con 0x7f96f40b42c0 2023-11-04T01:38:54.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96eaffd640 1 -- 172.21.15.114:0/1215578923 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec003830 con 0x7f96f40b42c0 2023-11-04T01:38:54.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.627+0000 7f96f8f05640 1 -- 172.21.15.114:0/1215578923 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f40ad040 con 0x7f96f40b42c0 2023-11-04T01:38:54.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.628+0000 7f96f8f05640 1 -- 172.21.15.114:0/1215578923 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f40ca5f0 con 0x7f96f40b42c0 2023-11-04T01:38:54.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.629+0000 7f96eaffd640 1 -- 172.21.15.114:0/1215578923 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f96ec003990 con 0x7f96f40b42c0 2023-11-04T01:38:54.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.629+0000 7f96eaffd640 1 --2- 172.21.15.114:0/1215578923 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f96d406aea0 0x7f96d406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:54.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.629+0000 7f96eaffd640 1 -- 172.21.15.114:0/1215578923 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f96ec088e20 con 0x7f96f40b42c0 2023-11-04T01:38:54.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.629+0000 7f96f1d9b640 1 --2- 172.21.15.114:0/1215578923 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f96d406aea0 0x7f96d406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:54.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.630+0000 7f96f1d9b640 1 --2- 172.21.15.114:0/1215578923 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f96d406aea0 0x7f96d406d360 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f96dc036000 tx=0x7f96dc03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:54.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.633+0000 7f96eaffd640 1 -- 172.21.15.114:0/1215578923 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f96ec053c40 con 0x7f96f40b42c0 2023-11-04T01:38:54.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.834+0000 7f96f8f05640 1 -- 172.21.15.114:0/1215578923 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96f4074290 con 0x7f96f40b42c0 2023-11-04T01:38:54.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.834+0000 7f96eaffd640 1 -- 172.21.15.114:0/1215578923 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f96ec074e60 con 0x7f96f40b42c0 2023-11-04T01:38:54.836 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:38:54.836 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5731,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/4055552299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4055552299},{"type":"v1","addr":"172.21.15.141:6835","nonce":4055552299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6471,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/4254364199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":4254364199},{"type":"v1","addr":"172.21.15.114:6836","nonce":4254364199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6474,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3499206733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3499206733},{"type":"v1","addr":"172.21.15.114:6837","nonce":3499206733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:50.176333+0000","modified":"2023-11-04T01:38:52.173738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6486},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6486":{"gid":6486,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6834/1383574171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1383574171},{"type":"v1","addr":"172.21.15.141:6834","nonce":1383574171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:38:54.837 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 29 2023-11-04T01:38:54.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.837+0000 7f96f8f05640 1 -- 172.21.15.114:0/1215578923 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f96d406aea0 msgr2=0x7f96d406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.837+0000 7f96f8f05640 1 --2- 172.21.15.114:0/1215578923 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f96d406aea0 0x7f96d406d360 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f96dc036000 tx=0x7f96dc03d040 comp rx=0 tx=0).stop 2023-11-04T01:38:54.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.837+0000 7f96f8f05640 1 -- 172.21.15.114:0/1215578923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96f40b42c0 msgr2=0x7f96f40acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:54.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.837+0000 7f96f8f05640 1 --2- 172.21.15.114:0/1215578923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96f40b42c0 0x7f96f40acb00 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00c400 tx=0x7f96ec00c8c0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.837+0000 7f96f8f05640 1 -- 172.21.15.114:0/1215578923 shutdown_connections 2023-11-04T01:38:54.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.837+0000 7f96f8f05640 1 --2- 172.21.15.114:0/1215578923 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f96d406aea0 0x7f96d406d360 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.837+0000 7f96f8f05640 1 --2- 172.21.15.114:0/1215578923 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96f415ad80 0x7f96f40c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.837+0000 7f96f8f05640 1 --2- 172.21.15.114:0/1215578923 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96f40c9c40 0x7f96f40c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.837+0000 7f96f8f05640 1 --2- 172.21.15.114:0/1215578923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96f40b42c0 0x7f96f40acb00 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:54.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.837+0000 7f96f8f05640 1 -- 172.21.15.114:0/1215578923 >> 172.21.15.114:0/1215578923 conn(0x7f96f40ce950 msgr2=0x7f96f40b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:54.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.837+0000 7f96f8f05640 1 -- 172.21.15.114:0/1215578923 shutdown_connections 2023-11-04T01:38:54.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:54.837+0000 7f96f8f05640 1 -- 172.21.15.114:0/1215578923 wait complete. 2023-11-04T01:38:55.252 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:38:50.176333+0000', 'modified': '2023-11-04T01:38:52.173738+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6486}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6486': {'gid': 6486, 'name': 'b', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.141:6834/1383574171', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.141:6832', 'nonce': 1383574171}, {'type': 'v1', 'addr': '172.21.15.141:6834', 'nonce': 1383574171}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:38:55.252 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:38:55.252 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:38:55.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.352+0000 7f462c4e7640 1 Processor -- start 2023-11-04T01:38:55.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.352+0000 7f462c4e7640 1 -- start start 2023-11-04T01:38:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.353+0000 7f462c4e7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f4624159c00 0x7f46240cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.353+0000 7f462c4e7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46240c48e0 0x7f46240c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.353+0000 7f462c4e7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462415aff0 con 0x7f46240adac0 2023-11-04T01:38:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.353+0000 7f462c4e7640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46240c52d0 con 0x7f4624159c00 2023-11-04T01:38:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.353+0000 7f462c4e7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462415a3e0 con 0x7f46240c48e0 2023-11-04T01:38:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.353+0000 7f462aa84640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f46240adac0 0x7f46240adf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41866/0 (socket says 172.21.15.114:41866) 2023-11-04T01:38:55.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.353+0000 7f462aa84640 1 -- 172.21.15.114:0/2251301988 learned_addr learned my addr 172.21.15.114:0/2251301988 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:55.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629281640 1 -- 172.21.15.114:0/2251301988 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708360216 0 0) 0x7f462415aff0 con 0x7f46240adac0 2023-11-04T01:38:55.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629281640 1 -- 172.21.15.114:0/2251301988 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4610003520 con 0x7f46240adac0 2023-11-04T01:38:55.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f462a283640 1 --2- 172.21.15.114:0/2251301988 >> v2:172.21.15.141:3300/0 conn(0x7f4624159c00 0x7f46240cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629a82640 1 --2- 172.21.15.114:0/2251301988 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46240c48e0 0x7f46240c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629281640 1 -- 172.21.15.114:0/2251301988 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2573533793 0 0) 0x7f4610003520 con 0x7f46240adac0 2023-11-04T01:38:55.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629281640 1 -- 172.21.15.114:0/2251301988 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46240c48e0 msgr2=0x7f46240c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629281640 1 --2- 172.21.15.114:0/2251301988 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46240c48e0 0x7f46240c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629281640 1 -- 172.21.15.114:0/2251301988 >> v2:172.21.15.141:3300/0 conn(0x7f4624159c00 msgr2=0x7f46240cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629281640 1 --2- 172.21.15.114:0/2251301988 >> v2:172.21.15.141:3300/0 conn(0x7f4624159c00 0x7f46240cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629281640 1 -- 172.21.15.114:0/2251301988 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462415a6c0 con 0x7f46240adac0 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629281640 1 -- 172.21.15.114:0/2251301988 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f461c0019f0 con 0x7f46240adac0 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f462a283640 1 --2- 172.21.15.114:0/2251301988 >> v2:172.21.15.141:3300/0 conn(0x7f4624159c00 0x7f46240cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629281640 1 -- 172.21.15.114:0/2251301988 >> v1:172.21.15.114:6789/0 conn(0x7f46240adac0 legacy=0x7f46240adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629281640 1 --2- 172.21.15.114:0/2251301988 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4610003970 0x7f4610003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629281640 1 --2- 172.21.15.114:0/2251301988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46100047c0 0x7f4610004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629281640 1 --2- 172.21.15.114:0/2251301988 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46240c48e0 0x7f4610005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629281640 1 -- 172.21.15.114:0/2251301988 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46240c52d0 con 0x7f46100047c0 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629281640 1 -- 172.21.15.114:0/2251301988 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462415a3e0 con 0x7f4610003970 2023-11-04T01:38:55.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629281640 1 -- 172.21.15.114:0/2251301988 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461000b9b0 con 0x7f46240c48e0 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629a82640 1 --2- 172.21.15.114:0/2251301988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46100047c0 0x7f4610004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f462a283640 1 --2- 172.21.15.114:0/2251301988 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4610003970 0x7f4610003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f462aa84640 1 --2- 172.21.15.114:0/2251301988 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46240c48e0 0x7f4610005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629a82640 1 -- 172.21.15.114:0/2251301988 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46240c48e0 msgr2=0x7f4610005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629a82640 1 --2- 172.21.15.114:0/2251301988 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46240c48e0 0x7f4610005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629a82640 1 -- 172.21.15.114:0/2251301988 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4610003970 msgr2=0x7f4610003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629a82640 1 --2- 172.21.15.114:0/2251301988 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4610003970 0x7f4610003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.354+0000 7f4629a82640 1 -- 172.21.15.114:0/2251301988 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4610003520 con 0x7f46100047c0 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.355+0000 7f4629a82640 1 --2- 172.21.15.114:0/2251301988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46100047c0 0x7f4610004c40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f4620009ac0 tx=0x7f46100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362ddd4d21811a21 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.355+0000 7f4629281640 1 -- 172.21.15.114:0/2251301988 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462002c6b0 con 0x7f46100047c0 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.355+0000 7f4629281640 1 -- 172.21.15.114:0/2251301988 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462002c810 con 0x7f46100047c0 2023-11-04T01:38:55.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.355+0000 7f4629281640 1 -- 172.21.15.114:0/2251301988 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462002cba0 con 0x7f46100047c0 2023-11-04T01:38:55.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.356+0000 7f462c4e7640 1 -- 172.21.15.114:0/2251301988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46100047c0 msgr2=0x7f4610004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.356+0000 7f462c4e7640 1 --2- 172.21.15.114:0/2251301988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46100047c0 0x7f4610004c40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f4620009ac0 tx=0x7f46100057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.356+0000 7f462aa84640 1 -- 172.21.15.114:0/2251301988 reap_dead start 2023-11-04T01:38:55.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.356+0000 7f462c4e7640 1 -- 172.21.15.114:0/2251301988 shutdown_connections 2023-11-04T01:38:55.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.356+0000 7f462c4e7640 1 -- 172.21.15.114:0/2251301988 >> 172.21.15.114:0/2251301988 conn(0x7f46240ce950 msgr2=0x7f46240ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.356+0000 7f462c4e7640 1 -- 172.21.15.114:0/2251301988 shutdown_connections 2023-11-04T01:38:55.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.356+0000 7f462c4e7640 1 -- 172.21.15.114:0/2251301988 wait complete. 2023-11-04T01:38:55.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.357+0000 7f462c4e7640 1 Processor -- start 2023-11-04T01:38:55.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.357+0000 7f462c4e7640 1 -- start start 2023-11-04T01:38:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462c4e7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46100047c0 0x7f462414c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462c4e7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f46240c71f0 0x7f4624140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462c4e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4624157910 0x7f4624157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462c4e7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4624158300 con 0x7f4624157910 2023-11-04T01:38:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462c4e7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462414c7d0 con 0x7f46240c71f0 2023-11-04T01:38:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462c4e7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46240c7910 con 0x7f46100047c0 2023-11-04T01:38:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462aa84640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4624157910 0x7f4624157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462aa84640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4624157910 0x7f4624157dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48614/0 (socket says 172.21.15.114:48614) 2023-11-04T01:38:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462aa84640 1 -- 172.21.15.114:0/955642264 learned_addr learned my addr 172.21.15.114:0/955642264 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:55.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462a283640 1 --2- 172.21.15.114:0/955642264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46100047c0 0x7f462414c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f4629a82640 1 --2- 172.21.15.114:0/955642264 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f46240c71f0 0x7f4624140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462aa84640 1 -- 172.21.15.114:0/955642264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46100047c0 msgr2=0x7f462414c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462aa84640 1 --2- 172.21.15.114:0/955642264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46100047c0 0x7f462414c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462aa84640 1 -- 172.21.15.114:0/955642264 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f46240c71f0 msgr2=0x7f4624140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462aa84640 1 --2- 172.21.15.114:0/955642264 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f46240c71f0 0x7f4624140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462aa84640 1 -- 172.21.15.114:0/955642264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46240c7bf0 con 0x7f4624157910 2023-11-04T01:38:55.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462aa84640 1 --2- 172.21.15.114:0/955642264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4624157910 0x7f4624157dc0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f461c000f80 tx=0x7f461c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f4616ffd640 1 -- 172.21.15.114:0/955642264 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c00eb90 con 0x7f4624157910 2023-11-04T01:38:55.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f4616ffd640 1 -- 172.21.15.114:0/955642264 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461c00ecf0 con 0x7f4624157910 2023-11-04T01:38:55.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f4616ffd640 1 -- 172.21.15.114:0/955642264 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c013660 con 0x7f4624157910 2023-11-04T01:38:55.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.358+0000 7f462c4e7640 1 -- 172.21.15.114:0/955642264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46240c7ed0 con 0x7f4624157910 2023-11-04T01:38:55.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.359+0000 7f462c4e7640 1 -- 172.21.15.114:0/955642264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46240c7670 con 0x7f4624157910 2023-11-04T01:38:55.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.360+0000 7f4616ffd640 1 -- 172.21.15.114:0/955642264 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f461c0137c0 con 0x7f4624157910 2023-11-04T01:38:55.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.360+0000 7f4616ffd640 1 --2- 172.21.15.114:0/955642264 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f460806ae70 0x7f460806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.360+0000 7f4616ffd640 1 -- 172.21.15.114:0/955642264 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f461c089b10 con 0x7f4624157910 2023-11-04T01:38:55.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.360+0000 7f462a283640 1 --2- 172.21.15.114:0/955642264 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f460806ae70 0x7f460806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.361+0000 7f462a283640 1 --2- 172.21.15.114:0/955642264 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f460806ae70 0x7f460806d330 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4618006fd0 tx=0x7f4618008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.361+0000 7f462f07f740 1 Processor -- start 2023-11-04T01:38:55.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.362+0000 7f462f07f740 1 -- start start 2023-11-04T01:38:55.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.362+0000 7f462f07f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25a1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.362+0000 7f462f07f740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25cec30 0x55a5b25d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.362+0000 7f462f07f740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25a1c90 0x55a5b25d1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.362+0000 7f462f07f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5b24b2740 con 0x55a5b25ce850 2023-11-04T01:38:55.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.362+0000 7f462f07f740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5b25148d0 con 0x55a5b25cec30 2023-11-04T01:38:55.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.362+0000 7f462f07f740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5b2511fc0 con 0x55a5b25a1c90 2023-11-04T01:38:55.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.362+0000 7f462a283640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.362+0000 7f462a283640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25a1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48622/0 (socket says 172.21.15.114:48622) 2023-11-04T01:38:55.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.362+0000 7f462a283640 1 -- 172.21.15.114:0/1972536070 learned_addr learned my addr 172.21.15.114:0/1972536070 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:55.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.363+0000 7f462a283640 1 -- 172.21.15.114:0/1972536070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25a1c90 msgr2=0x55a5b25d1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.363+0000 7f462aa84640 1 --2- 172.21.15.114:0/1972536070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25a1c90 0x55a5b25d1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.363+0000 7f4629a82640 1 --2- 172.21.15.114:0/1972536070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25cec30 0x55a5b25d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.363+0000 7f462a283640 1 --2- 172.21.15.114:0/1972536070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25a1c90 0x55a5b25d1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.363+0000 7f462a283640 1 -- 172.21.15.114:0/1972536070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25cec30 msgr2=0x55a5b25d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.363+0000 7f462a283640 1 --2- 172.21.15.114:0/1972536070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25cec30 0x55a5b25d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.363+0000 7f462a283640 1 -- 172.21.15.114:0/1972536070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5b24d0ca0 con 0x55a5b25ce850 2023-11-04T01:38:55.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.363+0000 7f462a283640 1 --2- 172.21.15.114:0/1972536070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25a1750 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4618014ce0 tx=0x7f4618017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1a7aee0a8ff600 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.363+0000 7f4607fff640 1 -- 172.21.15.114:0/1972536070 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4618023450 con 0x55a5b25ce850 2023-11-04T01:38:55.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.363+0000 7f4607fff640 1 -- 172.21.15.114:0/1972536070 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46180235b0 con 0x55a5b25ce850 2023-11-04T01:38:55.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.363+0000 7f4607fff640 1 -- 172.21.15.114:0/1972536070 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4618023920 con 0x55a5b25ce850 2023-11-04T01:38:55.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.363+0000 7f462f07f740 1 -- 172.21.15.114:0/1972536070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 msgr2=0x55a5b25a1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.363+0000 7f462f07f740 1 --2- 172.21.15.114:0/1972536070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25a1750 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4618014ce0 tx=0x7f4618017000 comp rx=0 tx=0).stop 2023-11-04T01:38:55.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.364+0000 7f462f07f740 1 -- 172.21.15.114:0/1972536070 shutdown_connections 2023-11-04T01:38:55.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.364+0000 7f462f07f740 1 --2- 172.21.15.114:0/1972536070 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25a1c90 0x55a5b25d1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.364+0000 7f462f07f740 1 --2- 172.21.15.114:0/1972536070 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25cec30 0x55a5b25d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.364+0000 7f462f07f740 1 --2- 172.21.15.114:0/1972536070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25a1750 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.364+0000 7f462f07f740 1 -- 172.21.15.114:0/1972536070 >> 172.21.15.114:0/1972536070 conn(0x55a5b25a3a60 msgr2=0x55a5b25ec5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.364+0000 7f462f07f740 1 -- 172.21.15.114:0/1972536070 shutdown_connections 2023-11-04T01:38:55.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.364+0000 7f462f07f740 1 -- 172.21.15.114:0/1972536070 wait complete. 2023-11-04T01:38:55.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.364+0000 7f462f07f740 1 -- start start 2023-11-04T01:38:55.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.364+0000 7f462f07f740 1 Processor -- start 2023-11-04T01:38:55.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.365+0000 7f462f07f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25d40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.365+0000 7f462f07f740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25cec30 0x55a5b25d4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.365+0000 7f462f07f740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25c2cd0 0x55a5b25e9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.365+0000 7f462f07f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5b250d8b0 con 0x55a5b25ce850 2023-11-04T01:38:55.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.365+0000 7f462f07f740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5b24c7c80 con 0x55a5b25c2cd0 2023-11-04T01:38:55.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.365+0000 7f462f07f740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5b24c7920 con 0x55a5b25cec30 2023-11-04T01:38:55.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.365+0000 7f462f07f740 10 client.0 _ll_register_callbacks cb 0x55a5b221fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:38:55.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.365+0000 7f462a283640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25d40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.365+0000 7f462a283640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25d40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48630/0 (socket says 172.21.15.114:48630) 2023-11-04T01:38:55.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.365+0000 7f462a283640 1 -- 172.21.15.114:0/434788081 learned_addr learned my addr 172.21.15.114:0/434788081 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:55.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f4629a82640 1 --2- 172.21.15.114:0/434788081 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25cec30 0x55a5b25d4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f462aa84640 1 --2- 172.21.15.114:0/434788081 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25c2cd0 0x55a5b25e9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f462a283640 1 -- 172.21.15.114:0/434788081 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25cec30 msgr2=0x55a5b25d4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f462a283640 1 --2- 172.21.15.114:0/434788081 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25cec30 0x55a5b25d4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f462a283640 1 -- 172.21.15.114:0/434788081 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25c2cd0 msgr2=0x55a5b25e9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f462a283640 1 --2- 172.21.15.114:0/434788081 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25c2cd0 0x55a5b25e9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f462a283640 1 -- 172.21.15.114:0/434788081 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461800e040 con 0x55a5b25ce850 2023-11-04T01:38:55.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f462a283640 1 --2- 172.21.15.114:0/434788081 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25d40c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4618014720 tx=0x7f46180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c112f22a81850a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f46057fa640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:38:55.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f46057fa640 1 -- 172.21.15.114:0/434788081 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4618031070 con 0x55a5b25ce850 2023-11-04T01:38:55.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f462f07f740 1 -- 172.21.15.114:0/434788081 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5b24b9bf0 con 0x55a5b25ce850 2023-11-04T01:38:55.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f46057fa640 1 -- 172.21.15.114:0/434788081 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4618023930 con 0x55a5b25ce850 2023-11-04T01:38:55.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f46057fa640 1 -- 172.21.15.114:0/434788081 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4618004510 con 0x55a5b25ce850 2023-11-04T01:38:55.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f462f07f740 10 client.6627 fetch_fsmap learned FSMap version 29 2023-11-04T01:38:55.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f462f07f740 1 -- 172.21.15.114:0/434788081 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x55a5b250bf30 con 0x55a5b25ce850 2023-11-04T01:38:55.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f46057fa640 1 -- 172.21.15.114:0/434788081 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5b24b9bf0 con 0x55a5b25ce850 2023-11-04T01:38:55.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f46057fa640 1 -- 172.21.15.114:0/434788081 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4618023af0 con 0x55a5b25ce850 2023-11-04T01:38:55.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.366+0000 7f462f07f740 10 client.6627 fetch_fsmap finished waiting for FSMap version 29 2023-11-04T01:38:55.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.367+0000 7f462f07f740 10 client.6627 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:38:55.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.367+0000 7f462f07f740 20 client.6627 populate_metadata read hostname 'smithi114' 2023-11-04T01:38:55.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.367+0000 7f462f07f740 1 --2- 172.21.15.114:0/434788081 >> [v2:172.21.15.141:6832/1383574171,v1:172.21.15.141:6834/1383574171] conn(0x55a5b25e8500 0x55a5b25e8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.367+0000 7f462f07f740 4 client.6627 mds_command: new command op to 6486 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:38:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.367+0000 7f462f07f740 1 -- 172.21.15.114:0/434788081 --> [v2:172.21.15.141:6832/1383574171,v1:172.21.15.141:6834/1383574171] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5b2506890 con 0x55a5b25e8500 2023-11-04T01:38:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.367+0000 7f4629a82640 1 --2- 172.21.15.114:0/434788081 >> [v2:172.21.15.141:6832/1383574171,v1:172.21.15.141:6834/1383574171] conn(0x55a5b25e8500 0x55a5b25e8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.367+0000 7f46057fa640 10 client.6627 ms_handle_connect on v2:172.21.15.141:6832/1383574171 2023-11-04T01:38:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.367+0000 7f4629a82640 1 --2- 172.21.15.114:0/434788081 >> [v2:172.21.15.141:6832/1383574171,v1:172.21.15.141:6834/1383574171] conn(0x55a5b25e8500 0x55a5b25e8900 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8ffe311eb2daac0 server_cookie=b5ba69b3ebfc71a1 in_seq=0 out_seq=0 2023-11-04T01:38:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.368+0000 7f46057fa640 1 -- 172.21.15.114:0/434788081 <== mds.0 v2:172.21.15.141:6832/1383574171 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a5b2506890 con 0x55a5b25e8500 2023-11-04T01:38:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.368+0000 7f46057fa640 10 client.6627 handle_command_reply: tid=0 2023-11-04T01:38:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.368+0000 7f462f07f740 1 client.6627 shutdown 2023-11-04T01:38:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.368+0000 7f462f07f740 1 -- 172.21.15.114:0/434788081 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 msgr2=0x55a5b25d40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.368+0000 7f462f07f740 1 --2- 172.21.15.114:0/434788081 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25d40c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4618014720 tx=0x7f46180046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.368+0000 7f462f07f740 1 -- 172.21.15.114:0/434788081 shutdown_connections 2023-11-04T01:38:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.368+0000 7f462f07f740 1 --2- 172.21.15.114:0/434788081 >> [v2:172.21.15.141:6832/1383574171,v1:172.21.15.141:6834/1383574171] conn(0x55a5b25e8500 0x55a5b25e8900 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.368+0000 7f462f07f740 1 --2- 172.21.15.114:0/434788081 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25c2cd0 0x55a5b25e9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.368+0000 7f46057fa640 0 client.6627 ms_handle_reset on v2:172.21.15.141:6832/1383574171 2023-11-04T01:38:55.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.368+0000 7f462f07f740 1 --2- 172.21.15.114:0/434788081 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25cec30 0x55a5b25d4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.368+0000 7f462f07f740 1 --2- 172.21.15.114:0/434788081 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25d40c0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.368+0000 7f462f07f740 1 -- 172.21.15.114:0/434788081 >> 172.21.15.114:0/434788081 conn(0x55a5b25a1c90 msgr2=0x55a5b25a56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.368+0000 7f462f07f740 1 -- 172.21.15.114:0/434788081 shutdown_connections 2023-11-04T01:38:55.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.368+0000 7f462f07f740 1 -- 172.21.15.114:0/434788081 wait complete. 2023-11-04T01:38:55.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.368+0000 7f462f07f740 20 client.6627 trim_cache size 0 max 16384 2023-11-04T01:38:55.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.384+0000 7f462f07f740 1 Processor -- start 2023-11-04T01:38:55.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.384+0000 7f462f07f740 1 -- start start 2023-11-04T01:38:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.384+0000 7f462f07f740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25c2cd0 0x55a5b25a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.384+0000 7f462f07f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.384+0000 7f462f07f740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25cec30 0x55a5b25ea980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.384+0000 7f462f07f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5b248d280 con 0x55a5b25ce850 2023-11-04T01:38:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.384+0000 7f462f07f740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5b25d1eb0 con 0x55a5b25c2cd0 2023-11-04T01:38:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.384+0000 7f462f07f740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5b260f1b0 con 0x55a5b25cec30 2023-11-04T01:38:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.385+0000 7f4629a82640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.385+0000 7f4629a82640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48642/0 (socket says 172.21.15.114:48642) 2023-11-04T01:38:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.385+0000 7f4629a82640 1 -- 172.21.15.114:0/3118341022 learned_addr learned my addr 172.21.15.114:0/3118341022 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.385+0000 7f462a283640 1 --2- 172.21.15.114:0/3118341022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25c2cd0 0x55a5b25a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.385+0000 7f462aa84640 1 --2- 172.21.15.114:0/3118341022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25cec30 0x55a5b25ea980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.385+0000 7f4629a82640 1 -- 172.21.15.114:0/3118341022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25cec30 msgr2=0x55a5b25ea980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.385+0000 7f4629a82640 1 --2- 172.21.15.114:0/3118341022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25cec30 0x55a5b25ea980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.385+0000 7f4629a82640 1 -- 172.21.15.114:0/3118341022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25c2cd0 msgr2=0x55a5b25a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.385+0000 7f4629a82640 1 --2- 172.21.15.114:0/3118341022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25c2cd0 0x55a5b25a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.385+0000 7f4629a82640 1 -- 172.21.15.114:0/3118341022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5b24a9d10 con 0x55a5b25ce850 2023-11-04T01:38:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.385+0000 7f462a283640 1 --2- 172.21.15.114:0/3118341022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25c2cd0 0x55a5b25a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.385+0000 7f4629a82640 1 --2- 172.21.15.114:0/3118341022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25d1970 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4620009ac0 tx=0x7f4620030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5dbc9e769ef432 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.385+0000 7f4614ff9640 1 -- 172.21.15.114:0/3118341022 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620045d00 con 0x55a5b25ce850 2023-11-04T01:38:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.385+0000 7f4614ff9640 1 -- 172.21.15.114:0/3118341022 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4620045e60 con 0x55a5b25ce850 2023-11-04T01:38:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.385+0000 7f4614ff9640 1 -- 172.21.15.114:0/3118341022 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620004310 con 0x55a5b25ce850 2023-11-04T01:38:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.386+0000 7f462f07f740 1 -- 172.21.15.114:0/3118341022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 msgr2=0x55a5b25d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.386+0000 7f462f07f740 1 --2- 172.21.15.114:0/3118341022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25d1970 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4620009ac0 tx=0x7f4620030000 comp rx=0 tx=0).stop 2023-11-04T01:38:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.386+0000 7f462f07f740 1 -- 172.21.15.114:0/3118341022 shutdown_connections 2023-11-04T01:38:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.386+0000 7f462f07f740 1 --2- 172.21.15.114:0/3118341022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25cec30 0x55a5b25ea980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.386+0000 7f462f07f740 1 --2- 172.21.15.114:0/3118341022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25d1970 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.386+0000 7f462f07f740 1 --2- 172.21.15.114:0/3118341022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25c2cd0 0x55a5b25a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.386+0000 7f462f07f740 1 -- 172.21.15.114:0/3118341022 >> 172.21.15.114:0/3118341022 conn(0x55a5b25a1c90 msgr2=0x55a5b25a04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.386+0000 7f462f07f740 1 -- 172.21.15.114:0/3118341022 shutdown_connections 2023-11-04T01:38:55.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.386+0000 7f462f07f740 1 -- 172.21.15.114:0/3118341022 wait complete. 2023-11-04T01:38:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.386+0000 7f462f07f740 1 -- start start 2023-11-04T01:38:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.386+0000 7f462f07f740 1 Processor -- start 2023-11-04T01:38:55.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.387+0000 7f462f07f740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25c2cd0 0x55a5b25ea980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.387+0000 7f462f07f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25eaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.387+0000 7f462f07f740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25cec30 0x55a5b265b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.387+0000 7f462f07f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5b265c990 con 0x55a5b25ce850 2023-11-04T01:38:55.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.387+0000 7f462f07f740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5b265b190 con 0x55a5b25cec30 2023-11-04T01:38:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.387+0000 7f462f07f740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5b25a0e30 con 0x55a5b25c2cd0 2023-11-04T01:38:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.387+0000 7f462f07f740 10 client.0 _ll_register_callbacks cb 0x7f461801a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:38:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.387+0000 7f4629a82640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25eaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.387+0000 7f4629a82640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25eaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48648/0 (socket says 172.21.15.114:48648) 2023-11-04T01:38:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.387+0000 7f4629a82640 1 -- 172.21.15.114:0/3604970 learned_addr learned my addr 172.21.15.114:0/3604970 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.387+0000 7f462aa84640 1 --2- 172.21.15.114:0/3604970 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25cec30 0x55a5b265b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.387+0000 7f462a283640 1 --2- 172.21.15.114:0/3604970 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25c2cd0 0x55a5b25ea980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f4629a82640 1 -- 172.21.15.114:0/3604970 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25c2cd0 msgr2=0x55a5b25ea980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f4629a82640 1 --2- 172.21.15.114:0/3604970 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25c2cd0 0x55a5b25ea980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f4629a82640 1 -- 172.21.15.114:0/3604970 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25cec30 msgr2=0x55a5b265b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f4629a82640 1 --2- 172.21.15.114:0/3604970 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25cec30 0x55a5b265b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f4629a82640 1 -- 172.21.15.114:0/3604970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4610003520 con 0x55a5b25ce850 2023-11-04T01:38:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f4629a82640 1 --2- 172.21.15.114:0/3604970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25eaec0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4620045fd0 tx=0x7f46200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb3c2653c723e1d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f46057fa640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:38:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f46057fa640 1 -- 172.21.15.114:0/3604970 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620004310 con 0x55a5b25ce850 2023-11-04T01:38:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f46057fa640 1 -- 172.21.15.114:0/3604970 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4620004470 con 0x55a5b25ce850 2023-11-04T01:38:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f462f07f740 1 -- 172.21.15.114:0/3604970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46180235b0 con 0x55a5b25ce850 2023-11-04T01:38:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f46057fa640 1 -- 172.21.15.114:0/3604970 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f462002c980 con 0x55a5b25ce850 2023-11-04T01:38:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f462f07f740 10 client.6633 fetch_fsmap learned FSMap version 29 2023-11-04T01:38:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f462f07f740 1 -- 172.21.15.114:0/3604970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x55a5b24cf500 con 0x55a5b25ce850 2023-11-04T01:38:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f46057fa640 1 -- 172.21.15.114:0/3604970 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46180235b0 con 0x55a5b25ce850 2023-11-04T01:38:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f46057fa640 1 -- 172.21.15.114:0/3604970 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f462002cae0 con 0x55a5b25ce850 2023-11-04T01:38:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f462f07f740 10 client.6633 fetch_fsmap finished waiting for FSMap version 29 2023-11-04T01:38:55.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f462f07f740 10 client.6633 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:38:55.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f462f07f740 20 client.6633 populate_metadata read hostname 'smithi114' 2023-11-04T01:38:55.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f462f07f740 1 --2- 172.21.15.114:0/3604970 >> [v2:172.21.15.141:6832/1383574171,v1:172.21.15.141:6834/1383574171] conn(0x55a5b2658a10 0x55a5b265bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f462f07f740 4 client.6633 mds_command: new command op to 6486 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:38:55.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.388+0000 7f462f07f740 1 -- 172.21.15.114:0/3604970 --> [v2:172.21.15.141:6832/1383574171,v1:172.21.15.141:6834/1383574171] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a5b25065b0 con 0x55a5b2658a10 2023-11-04T01:38:55.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f462a283640 1 --2- 172.21.15.114:0/3604970 >> [v2:172.21.15.141:6832/1383574171,v1:172.21.15.141:6834/1383574171] conn(0x55a5b2658a10 0x55a5b265bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f462a283640 1 --2- 172.21.15.114:0/3604970 >> [v2:172.21.15.141:6832/1383574171,v1:172.21.15.141:6834/1383574171] conn(0x55a5b2658a10 0x55a5b265bb70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f9e2b7893f7de10 server_cookie=25e3d22b8867ad3d in_seq=0 out_seq=0 2023-11-04T01:38:55.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f46057fa640 10 client.6633 ms_handle_connect on v2:172.21.15.141:6832/1383574171 2023-11-04T01:38:55.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f46057fa640 1 -- 172.21.15.114:0/3604970 <== mds.0 v2:172.21.15.141:6832/1383574171 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55a5b25065b0 con 0x55a5b2658a10 2023-11-04T01:38:55.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f46057fa640 10 client.6633 handle_command_reply: tid=0 2023-11-04T01:38:55.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f462f07f740 1 client.6633 shutdown 2023-11-04T01:38:55.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f462f07f740 1 -- 172.21.15.114:0/3604970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 msgr2=0x55a5b25eaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f462f07f740 1 --2- 172.21.15.114:0/3604970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25eaec0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4620045fd0 tx=0x7f46200046c0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f462f07f740 1 -- 172.21.15.114:0/3604970 shutdown_connections 2023-11-04T01:38:55.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f462f07f740 1 --2- 172.21.15.114:0/3604970 >> [v2:172.21.15.141:6832/1383574171,v1:172.21.15.141:6834/1383574171] conn(0x55a5b2658a10 0x55a5b265bb70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f462f07f740 1 --2- 172.21.15.114:0/3604970 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55a5b25cec30 0x55a5b265b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f462f07f740 1 --2- 172.21.15.114:0/3604970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5b25ce850 0x55a5b25eaec0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f462f07f740 1 --2- 172.21.15.114:0/3604970 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55a5b25c2cd0 0x55a5b25ea980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f46057fa640 0 client.6633 ms_handle_reset on v2:172.21.15.141:6832/1383574171 2023-11-04T01:38:55.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f462f07f740 1 -- 172.21.15.114:0/3604970 >> 172.21.15.114:0/3604970 conn(0x55a5b25a1c90 msgr2=0x55a5b25a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f462f07f740 1 -- 172.21.15.114:0/3604970 shutdown_connections 2023-11-04T01:38:55.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.389+0000 7f462f07f740 1 -- 172.21.15.114:0/3604970 wait complete. 2023-11-04T01:38:55.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.390+0000 7f462f07f740 20 client.6633 trim_cache size 0 max 16384 2023-11-04T01:38:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:38:55.399 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:38:55.399 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-11-04T01:38:55.400 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 6486, 2023-11-04T01:38:55.400 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:38:55.400 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:38:55.400 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:38:55.400 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 4.548455659, 2023-11-04T01:38:55.400 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 29, 2023-11-04T01:38:55.400 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 66, 2023-11-04T01:38:55.400 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 66, 2023-11-04T01:38:55.400 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 9.6061167479999998 2023-11-04T01:38:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:38:55.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.390+0000 7f462c4e7640 1 -- 172.21.15.114:0/955642264 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f460806ae70 msgr2=0x7f460806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.390+0000 7f462c4e7640 1 --2- 172.21.15.114:0/955642264 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f460806ae70 0x7f460806d330 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4618006fd0 tx=0x7f4618008040 comp rx=0 tx=0).stop 2023-11-04T01:38:55.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.390+0000 7f462c4e7640 1 -- 172.21.15.114:0/955642264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4624157910 msgr2=0x7f4624157dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.390+0000 7f462c4e7640 1 --2- 172.21.15.114:0/955642264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4624157910 0x7f4624157dc0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f461c000f80 tx=0x7f461c00e530 comp rx=0 tx=0).stop 2023-11-04T01:38:55.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.390+0000 7f462c4e7640 1 -- 172.21.15.114:0/955642264 shutdown_connections 2023-11-04T01:38:55.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.390+0000 7f462c4e7640 1 --2- 172.21.15.114:0/955642264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4624157910 0x7f4624157dc0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.390+0000 7f462c4e7640 1 --2- 172.21.15.114:0/955642264 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f460806ae70 0x7f460806d330 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.390+0000 7f462c4e7640 1 --2- 172.21.15.114:0/955642264 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f46240c71f0 0x7f4624140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.390+0000 7f462c4e7640 1 --2- 172.21.15.114:0/955642264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46100047c0 0x7f462414c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.390+0000 7f462c4e7640 1 -- 172.21.15.114:0/955642264 >> 172.21.15.114:0/955642264 conn(0x7f46240ce950 msgr2=0x7f46240cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.390+0000 7f462c4e7640 1 -- 172.21.15.114:0/955642264 shutdown_connections 2023-11-04T01:38:55.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.390+0000 7f462c4e7640 1 -- 172.21.15.114:0/955642264 wait complete. 2023-11-04T01:38:55.403 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:38:55.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.500+0000 7fe462397640 1 Processor -- start 2023-11-04T01:38:55.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.500+0000 7fe462397640 1 -- start start 2023-11-04T01:38:55.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.501+0000 7fe462397640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe45c15e1c0 0x7fe45c06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.501+0000 7fe462397640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe45c0b14a0 0x7fe45c06a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.501+0000 7fe462397640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45c0b1b80 con 0x7fe45c06fe80 2023-11-04T01:38:55.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.501+0000 7fe462397640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45c0b1e60 con 0x7fe45c15e1c0 2023-11-04T01:38:55.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.501+0000 7fe462397640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0b2140 con 0x7fe45c0b14a0 2023-11-04T01:38:55.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.501+0000 7fe460934640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe45c06fe80 0x7fe45c0cc430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41882/0 (socket says 172.21.15.114:41882) 2023-11-04T01:38:55.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.501+0000 7fe460934640 1 -- 172.21.15.114:0/1822766552 learned_addr learned my addr 172.21.15.114:0/1822766552 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:55.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.501+0000 7fe45bfff640 1 --2- 172.21.15.114:0/1822766552 >> v2:172.21.15.141:3300/0 conn(0x7fe45c15e1c0 0x7fe45c06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45b7fe640 1 --2- 172.21.15.114:0/1822766552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe45c0b14a0 0x7fe45c06a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45affd640 1 -- 172.21.15.114:0/1822766552 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398292324 0 0) 0x7fe45c0b1b80 con 0x7fe45c06fe80 2023-11-04T01:38:55.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45affd640 1 -- 172.21.15.114:0/1822766552 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe444003520 con 0x7fe45c06fe80 2023-11-04T01:38:55.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45affd640 1 -- 172.21.15.114:0/1822766552 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3868243591 0 0) 0x7fe444003520 con 0x7fe45c06fe80 2023-11-04T01:38:55.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45affd640 1 -- 172.21.15.114:0/1822766552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe45c0b14a0 msgr2=0x7fe45c06a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45affd640 1 --2- 172.21.15.114:0/1822766552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe45c0b14a0 0x7fe45c06a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45affd640 1 -- 172.21.15.114:0/1822766552 >> v2:172.21.15.141:3300/0 conn(0x7fe45c15e1c0 msgr2=0x7fe45c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45affd640 1 --2- 172.21.15.114:0/1822766552 >> v2:172.21.15.141:3300/0 conn(0x7fe45c15e1c0 0x7fe45c06a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45affd640 1 -- 172.21.15.114:0/1822766552 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c0ca990 con 0x7fe45c06fe80 2023-11-04T01:38:55.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45affd640 1 -- 172.21.15.114:0/1822766552 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fe4540019f0 con 0x7fe45c06fe80 2023-11-04T01:38:55.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45bfff640 1 --2- 172.21.15.114:0/1822766552 >> v2:172.21.15.141:3300/0 conn(0x7fe45c15e1c0 0x7fe45c06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:55.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45affd640 1 -- 172.21.15.114:0/1822766552 >> v1:172.21.15.114:6789/0 conn(0x7fe45c06fe80 legacy=0x7fe45c0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45affd640 1 --2- 172.21.15.114:0/1822766552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe444003970 0x7fe444003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45affd640 1 --2- 172.21.15.114:0/1822766552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe45c0b14a0 0x7fe4440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45affd640 1 --2- 172.21.15.114:0/1822766552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe444004d00 0x7fe444005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45affd640 1 -- 172.21.15.114:0/1822766552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0b1e60 con 0x7fe444003970 2023-11-04T01:38:55.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45affd640 1 -- 172.21.15.114:0/1822766552 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0b2140 con 0x7fe444004d00 2023-11-04T01:38:55.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45affd640 1 -- 172.21.15.114:0/1822766552 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44400b980 con 0x7fe45c0b14a0 2023-11-04T01:38:55.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45bfff640 1 --2- 172.21.15.114:0/1822766552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe444003970 0x7fe444003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45b7fe640 1 --2- 172.21.15.114:0/1822766552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe45c0b14a0 0x7fe4440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe460934640 1 --2- 172.21.15.114:0/1822766552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe444004d00 0x7fe444005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45bfff640 1 -- 172.21.15.114:0/1822766552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe45c0b14a0 msgr2=0x7fe4440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45bfff640 1 --2- 172.21.15.114:0/1822766552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe45c0b14a0 0x7fe4440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45bfff640 1 -- 172.21.15.114:0/1822766552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe444004d00 msgr2=0x7fe444005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:55.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45bfff640 1 --2- 172.21.15.114:0/1822766552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe444004d00 0x7fe444005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe45bfff640 1 -- 172.21.15.114:0/1822766552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe444003520 con 0x7fe444003970 2023-11-04T01:38:55.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.502+0000 7fe460934640 1 --2- 172.21.15.114:0/1822766552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe444004d00 0x7fe444005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:38:55.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.503+0000 7fe45bfff640 1 --2- 172.21.15.114:0/1822766552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe444003970 0x7fe444003d90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009c90 tx=0x7fe4440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a83594040a4df87 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.503+0000 7fe45affd640 1 -- 172.21.15.114:0/1822766552 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c02c980 con 0x7fe444003970 2023-11-04T01:38:55.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.503+0000 7fe45affd640 1 -- 172.21.15.114:0/1822766552 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c02cae0 con 0x7fe444003970 2023-11-04T01:38:55.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.503+0000 7fe45affd640 1 -- 172.21.15.114:0/1822766552 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c02ce90 con 0x7fe444003970 2023-11-04T01:38:55.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.504+0000 7fe462397640 1 -- 172.21.15.114:0/1822766552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe444003970 msgr2=0x7fe444003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.504+0000 7fe462397640 1 --2- 172.21.15.114:0/1822766552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe444003970 0x7fe444003d90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009c90 tx=0x7fe4440057f0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.504+0000 7fe460934640 1 -- 172.21.15.114:0/1822766552 reap_dead start 2023-11-04T01:38:55.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.504+0000 7fe462397640 1 -- 172.21.15.114:0/1822766552 shutdown_connections 2023-11-04T01:38:55.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.504+0000 7fe462397640 1 -- 172.21.15.114:0/1822766552 >> 172.21.15.114:0/1822766552 conn(0x7fe45c06d8b0 msgr2=0x7fe45c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.504+0000 7fe462397640 1 -- 172.21.15.114:0/1822766552 shutdown_connections 2023-11-04T01:38:55.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.504+0000 7fe462397640 1 -- 172.21.15.114:0/1822766552 wait complete. 2023-11-04T01:38:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.505+0000 7fe462397640 1 Processor -- start 2023-11-04T01:38:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.505+0000 7fe462397640 1 -- start start 2023-11-04T01:38:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe462397640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe444003970 0x7fe45c0c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe462397640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe45c156250 0x7fe45c1566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe462397640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe45c0c5230 0x7fe45c0c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe462397640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0c85f0 con 0x7fe444003970 2023-11-04T01:38:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe462397640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0c8860 con 0x7fe45c156250 2023-11-04T01:38:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe462397640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0c8b40 con 0x7fe45c0c5230 2023-11-04T01:38:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe45bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe444003970 0x7fe45c0c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe45bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe444003970 0x7fe45c0c3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48660/0 (socket says 172.21.15.114:48660) 2023-11-04T01:38:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe45bfff640 1 -- 172.21.15.114:0/1118951796 learned_addr learned my addr 172.21.15.114:0/1118951796 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:55.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe45bfff640 1 -- 172.21.15.114:0/1118951796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe45c0c5230 msgr2=0x7fe45c0c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe45bfff640 1 --2- 172.21.15.114:0/1118951796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe45c0c5230 0x7fe45c0c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe45bfff640 1 -- 172.21.15.114:0/1118951796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe45c156250 msgr2=0x7fe45c1566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe45bfff640 1 --2- 172.21.15.114:0/1118951796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe45c156250 0x7fe45c1566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe45bfff640 1 -- 172.21.15.114:0/1118951796 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c0c8e20 con 0x7fe444003970 2023-11-04T01:38:55.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe45bfff640 1 --2- 172.21.15.114:0/1118951796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe444003970 0x7fe45c0c3550 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe44c02c460 tx=0x7fe44c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe458ff9640 1 -- 172.21.15.114:0/1118951796 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c034c00 con 0x7fe444003970 2023-11-04T01:38:55.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe458ff9640 1 -- 172.21.15.114:0/1118951796 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c034d60 con 0x7fe444003970 2023-11-04T01:38:55.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe462397640 1 -- 172.21.15.114:0/1118951796 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45c0c9340 con 0x7fe444003970 2023-11-04T01:38:55.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.506+0000 7fe458ff9640 1 -- 172.21.15.114:0/1118951796 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c040690 con 0x7fe444003970 2023-11-04T01:38:55.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.507+0000 7fe462397640 1 -- 172.21.15.114:0/1118951796 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45c0c5bf0 con 0x7fe444003970 2023-11-04T01:38:55.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.507+0000 7fe462397640 1 -- 172.21.15.114:0/1118951796 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45c06f860 con 0x7fe444003970 2023-11-04T01:38:55.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.508+0000 7fe458ff9640 1 -- 172.21.15.114:0/1118951796 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe44c0407f0 con 0x7fe444003970 2023-11-04T01:38:55.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.508+0000 7fe458ff9640 1 --2- 172.21.15.114:0/1118951796 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe44806aea0 0x7fe44806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:55.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.508+0000 7fe45b7fe640 1 --2- 172.21.15.114:0/1118951796 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe44806aea0 0x7fe44806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:55.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.508+0000 7fe458ff9640 1 -- 172.21.15.114:0/1118951796 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe44c0abbd0 con 0x7fe444003970 2023-11-04T01:38:55.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.509+0000 7fe45b7fe640 1 --2- 172.21.15.114:0/1118951796 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe44806aea0 0x7fe44806d360 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe45c153be0 tx=0x7fe4500095d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:55.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.513+0000 7fe458ff9640 1 -- 172.21.15.114:0/1118951796 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe44c0769e0 con 0x7fe444003970 2023-11-04T01:38:55.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.714+0000 7fe462397640 1 -- 172.21.15.114:0/1118951796 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe45c0caf50 con 0x7fe444003970 2023-11-04T01:38:55.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.715+0000 7fe458ff9640 1 -- 172.21.15.114:0/1118951796 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe44c044070 con 0x7fe444003970 2023-11-04T01:38:55.717 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:38:55.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.717+0000 7fe462397640 1 -- 172.21.15.114:0/1118951796 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe44806aea0 msgr2=0x7fe44806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.717+0000 7fe462397640 1 --2- 172.21.15.114:0/1118951796 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe44806aea0 0x7fe44806d360 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe45c153be0 tx=0x7fe4500095d0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.717+0000 7fe462397640 1 -- 172.21.15.114:0/1118951796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe444003970 msgr2=0x7fe45c0c3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:55.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.717+0000 7fe462397640 1 --2- 172.21.15.114:0/1118951796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe444003970 0x7fe45c0c3550 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe44c02c460 tx=0x7fe44c004730 comp rx=0 tx=0).stop 2023-11-04T01:38:55.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.717+0000 7fe462397640 1 -- 172.21.15.114:0/1118951796 shutdown_connections 2023-11-04T01:38:55.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.717+0000 7fe462397640 1 --2- 172.21.15.114:0/1118951796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe45c0c5230 0x7fe45c0c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.717+0000 7fe462397640 1 --2- 172.21.15.114:0/1118951796 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe44806aea0 0x7fe44806d360 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.717+0000 7fe462397640 1 --2- 172.21.15.114:0/1118951796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe45c156250 0x7fe45c1566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.717+0000 7fe462397640 1 --2- 172.21.15.114:0/1118951796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe444003970 0x7fe45c0c3550 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:55.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.717+0000 7fe462397640 1 -- 172.21.15.114:0/1118951796 >> 172.21.15.114:0/1118951796 conn(0x7fe45c06d8b0 msgr2=0x7fe45c0b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:55.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.717+0000 7fe462397640 1 -- 172.21.15.114:0/1118951796 shutdown_connections 2023-11-04T01:38:55.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:55.717+0000 7fe462397640 1 -- 172.21.15.114:0/1118951796 wait complete. 2023-11-04T01:38:55.730 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:38:55.730 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:38:55.731 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-11-04T01:38:55.731 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:38:55.731 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:55.731 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:38:55.731 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:38:55.731 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:38:55.731 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:55.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:55.731 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-11-04T01:38:55.746 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:38:55.746 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:38:55.746 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:38:55.747 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:55.747 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-04T01:38:55.747 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:55.747 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:55.747 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-11-04T01:38:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:55.747 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:55.747 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-11-04T01:38:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:38:55.747 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:38:55.748 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:55.748 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:38:55.748 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42340sec preferred_lft 42340sec 2023-11-04T01:38:55.748 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-11-04T01:38:55.748 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:55.748 INFO:teuthology.orchestra.run.smithi114.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:38:55.748 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 7e:72:41:ca:70:95 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:38:55.749 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:38:55.749 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:55.749 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9c8d:d6ff:fe6f:d555/64 scope link 2023-11-04T01:38:55.749 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:55.749 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:38:55.749 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether f6:4c:1e:67:08:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:55.749 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::f44c:1eff:fe67:85a/64 scope link 2023-11-04T01:38:55.749 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:55.750 INFO:teuthology.orchestra.run.smithi114.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:38:55.750 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 7e:72:41:ca:70:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:55.750 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::7c72:41ff:feca:7095/64 scope link 2023-11-04T01:38:55.750 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:38:55.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:55.750 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:38:55.812 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-11-04T01:38:55.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:55.814 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-11-04T01:38:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-11-04T01:38:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:38:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:38:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:38:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:38:55.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:55.870 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:38:55.870 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:38:55.870 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:38:55.870 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:38:55.870 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:38:55.870 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:38:55.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:55.965 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-04T01:38:55.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:38:55.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:38:55.980 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:55.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:55.981 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-11-04T01:38:56.046 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:38:56.046 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:38:56.046 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:56.102 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:38:56.102 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:38:56.102 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:56.157 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:56.211 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:38:56.211 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:38:56.211 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:38:56.211 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:38:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:38:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:38:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:38:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:38:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:38:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:38:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:38:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:38:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:38:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:38:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:38:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:38:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:38:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:38:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:38:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:38:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:56.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:56.215 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:38:56.270 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:38:56.270 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:38:56.313 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:38:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:38:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:38:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:38:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:38:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:38:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:38:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:38:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:38:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:38:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:38:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:38:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:38:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:38:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:38:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:38:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:38:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:38:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:38:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:38:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:56.332 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:56.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:56.332 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:38:56.402 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:38:56.401+0000 7f474de62480 -1 init, newargv = 0x564325c22bb0 newargc=15 2023-11-04T01:38:56.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[111388]: starting ceph client 2023-11-04T01:38:56.407 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[111388]: starting fuse 2023-11-04T01:38:56.570 INFO:tasks.ceph.mds.b.smithi141.stderr:2023-11-04T01:38:56.568+0000 7fcc045f8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:38:57.485 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:38:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:38:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:38:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:38:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:38:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:38:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:38:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:38:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:38:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:38:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:38:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:38:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:38:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:38:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:38:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:38:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:38:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:38:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:38:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:38:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:38:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:38:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:38:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:38:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:38:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:38:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:38:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:38:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:38:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:38:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:38:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:38:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:38:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:57.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:38:57.508 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:38:57.563 INFO:teuthology.orchestra.run.smithi114.stdout:41 2023-11-04T01:38:57.563 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:38:57.563 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:38:57.563 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2023-11-04T01:38:57.563 DEBUG:teuthology.orchestra.run.smithi114:> import re 2023-11-04T01:38:57.564 DEBUG:teuthology.orchestra.run.smithi114:> import os 2023-11-04T01:38:57.564 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2023-11-04T01:38:57.564 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:38:57.564 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2023-11-04T01:38:57.564 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:38:57.564 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2023-11-04T01:38:57.564 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:38:57.564 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:38:57.564 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2023-11-04T01:38:57.564 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2023-11-04T01:38:57.564 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2023-11-04T01:38:57.564 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2023-11-04T01:38:57.564 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:38:57.565 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2023-11-04T01:38:57.565 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:38:57.565 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:38:57.565 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:38:57.565 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2023-11-04T01:38:57.565 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2023-11-04T01:38:57.565 DEBUG:teuthology.orchestra.run.smithi114:> return f 2023-11-04T01:38:57.565 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:38:57.565 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:38:57.565 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.0")) 2023-11-04T01:38:57.565 DEBUG:teuthology.orchestra.run.smithi114:> ' 2023-11-04T01:38:57.690 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.0.111388.asok 2023-11-04T01:38:57.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:57.700 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.111388.asok 2023-11-04T01:38:57.700 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:57.700 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.111388.asok status 2023-11-04T01:38:57.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:57.871 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:38:57.872 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2023-11-04T01:38:57.872 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:38:57.872 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:38:57.872 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "0", 2023-11-04T01:38:57.872 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2023-11-04T01:38:57.872 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:38:57.872 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "111388", 2023-11-04T01:38:57.872 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2023-11-04T01:38:57.872 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:57.872 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2023-11-04T01:38:57.872 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2023-11-04T01:38:57.872 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 6648, 2023-11-04T01:38:57.873 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2023-11-04T01:38:57.873 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2023-11-04T01:38:57.873 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2023-11-04T01:38:57.873 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 6648 2023-11-04T01:38:57.873 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:57.873 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:38:57.873 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:38:57.873 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:38:57.873 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2586843267 2023-11-04T01:38:57.873 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:38:57.873 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:57.873 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:38:57.873 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:38:57.874 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:38:57.874 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2586843267 2023-11-04T01:38:57.874 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:38:57.874 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.6648 192.168.0.1:0/2586843267", 2023-11-04T01:38:57.874 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "192.168.0.1:0/2586843267", 2023-11-04T01:38:57.874 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2023-11-04T01:38:57.874 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 29, 2023-11-04T01:38:57.874 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 66, 2023-11-04T01:38:57.874 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:38:57.874 INFO:teuthology.orchestra.run.smithi114.stdout: "blocklisted": false, 2023-11-04T01:38:57.874 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2023-11-04T01:38:57.874 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:38:57.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:57.886 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:57.886 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:38:57.886 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:57.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:57.945 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2023-11-04T01:38:57.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:57.952 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:57.952 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:38:57.952 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:38:58.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:38:58.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:38:58.020 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create test_data_pool 2023-11-04T01:38:58.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.120+0000 7fb7ca461640 1 Processor -- start 2023-11-04T01:38:58.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.120+0000 7fb7ca461640 1 -- start start 2023-11-04T01:38:58.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.121+0000 7fb7ca461640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb7c40d0710 0x7fb7c40cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.121+0000 7fb7ca461640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb7c40cda50 0x7fb7c40b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.121+0000 7fb7ca461640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c40d0280 con 0x7fb7c415e430 2023-11-04T01:38:58.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.121+0000 7fb7ca461640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c40cf670 con 0x7fb7c40cda50 2023-11-04T01:38:58.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.121+0000 7fb7ca461640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c40cf950 con 0x7fb7c40d0710 2023-11-04T01:38:58.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.121+0000 7fb7c3fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb7c415e430 0x7fb7c40cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60878/0 (socket says 172.21.15.114:60878) 2023-11-04T01:38:58.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.121+0000 7fb7c3fff640 1 -- 172.21.15.114:0/2837883630 learned_addr learned my addr 172.21.15.114:0/2837883630 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:38:58.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.121+0000 7fb7c89fe640 1 --2- 172.21.15.114:0/2837883630 >> v2:172.21.15.114:3300/0 conn(0x7fb7c40cda50 0x7fb7c40b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.121+0000 7fb7c37fe640 1 --2- 172.21.15.114:0/2837883630 >> v2:172.21.15.141:3300/0 conn(0x7fb7c40d0710 0x7fb7c40cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.121+0000 7fb7c89fe640 1 -- 172.21.15.114:0/2837883630 >> v2:172.21.15.141:3300/0 conn(0x7fb7c40d0710 msgr2=0x7fb7c40cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:58.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.121+0000 7fb7c89fe640 1 --2- 172.21.15.114:0/2837883630 >> v2:172.21.15.141:3300/0 conn(0x7fb7c40d0710 0x7fb7c40cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.121+0000 7fb7c89fe640 1 -- 172.21.15.114:0/2837883630 >> v1:172.21.15.114:6789/0 conn(0x7fb7c415e430 legacy=0x7fb7c40cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.121+0000 7fb7c89fe640 1 -- 172.21.15.114:0/2837883630 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c40cfc30 con 0x7fb7c40cda50 2023-11-04T01:38:58.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.121+0000 7fb7c37fe640 1 --2- 172.21.15.114:0/2837883630 >> v2:172.21.15.141:3300/0 conn(0x7fb7c40d0710 0x7fb7c40cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:38:58.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.121+0000 7fb7c2ffd640 1 -- 172.21.15.114:0/2837883630 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870716069 0 0) 0x7fb7c40d0280 con 0x7fb7c415e430 2023-11-04T01:38:58.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.122+0000 7fb7c89fe640 1 --2- 172.21.15.114:0/2837883630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7c40cda50 0x7fb7c40b3d40 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40cb3c0 tx=0x7fb7bc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b0595c2cb63e4b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.122+0000 7fb7c2ffd640 1 -- 172.21.15.114:0/2837883630 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc02cc80 con 0x7fb7c40cda50 2023-11-04T01:38:58.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.122+0000 7fb7c2ffd640 1 -- 172.21.15.114:0/2837883630 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc02cde0 con 0x7fb7c40cda50 2023-11-04T01:38:58.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.122+0000 7fb7c2ffd640 1 -- 172.21.15.114:0/2837883630 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc034660 con 0x7fb7c40cda50 2023-11-04T01:38:58.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.123+0000 7fb7ca461640 1 -- 172.21.15.114:0/2837883630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7c40cda50 msgr2=0x7fb7c40b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.123+0000 7fb7ca461640 1 --2- 172.21.15.114:0/2837883630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7c40cda50 0x7fb7c40b3d40 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40cb3c0 tx=0x7fb7bc02bed0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.123+0000 7fb7ca461640 1 -- 172.21.15.114:0/2837883630 shutdown_connections 2023-11-04T01:38:58.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.123+0000 7fb7ca461640 1 --2- 172.21.15.114:0/2837883630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7c40cda50 0x7fb7c40b3d40 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.123+0000 7fb7ca461640 1 --2- 172.21.15.114:0/2837883630 >> v2:172.21.15.141:3300/0 conn(0x7fb7c40d0710 0x7fb7c40cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.123+0000 7fb7ca461640 1 -- 172.21.15.114:0/2837883630 >> 172.21.15.114:0/2837883630 conn(0x7fb7c406ea20 msgr2=0x7fb7c406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:58.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.123+0000 7fb7ca461640 1 -- 172.21.15.114:0/2837883630 shutdown_connections 2023-11-04T01:38:58.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.123+0000 7fb7ca461640 1 -- 172.21.15.114:0/2837883630 wait complete. 2023-11-04T01:38:58.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.124+0000 7fb7ca461640 1 Processor -- start 2023-11-04T01:38:58.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.124+0000 7fb7ca461640 1 -- start start 2023-11-04T01:38:58.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.125+0000 7fb7ca461640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7c40cda50 0x7fb7c40b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.125+0000 7fb7ca461640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7c40d0710 0x7fb7c40c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.125+0000 7fb7ca461640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7c415e430 0x7fb7c40a77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.125+0000 7fb7ca461640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c40c8e20 con 0x7fb7c40d0710 2023-11-04T01:38:58.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.125+0000 7fb7ca461640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c40c90c0 con 0x7fb7c40cda50 2023-11-04T01:38:58.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.125+0000 7fb7ca461640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c40c93a0 con 0x7fb7c415e430 2023-11-04T01:38:58.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.125+0000 7fb7c37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7c40d0710 0x7fb7c40c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.125+0000 7fb7c37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7c40d0710 0x7fb7c40c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55288/0 (socket says 172.21.15.114:55288) 2023-11-04T01:38:58.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.125+0000 7fb7c37fe640 1 -- 172.21.15.114:0/711556893 learned_addr learned my addr 172.21.15.114:0/711556893 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:58.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.125+0000 7fb7c3fff640 1 --2- 172.21.15.114:0/711556893 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7c40cda50 0x7fb7c40b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.125+0000 7fb7c37fe640 1 -- 172.21.15.114:0/711556893 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7c415e430 msgr2=0x7fb7c40a77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.125+0000 7fb7c37fe640 1 --2- 172.21.15.114:0/711556893 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7c415e430 0x7fb7c40a77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.125+0000 7fb7c37fe640 1 -- 172.21.15.114:0/711556893 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7c40cda50 msgr2=0x7fb7c40b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.125+0000 7fb7c37fe640 1 --2- 172.21.15.114:0/711556893 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7c40cda50 0x7fb7c40b2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.125+0000 7fb7c37fe640 1 -- 172.21.15.114:0/711556893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc009a70 con 0x7fb7c40d0710 2023-11-04T01:38:58.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.126+0000 7fb7c37fe640 1 --2- 172.21.15.114:0/711556893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7c40d0710 0x7fb7c40c88e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800c7f0 tx=0x7fb7b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.126+0000 7fb7c0ff9640 1 -- 172.21.15.114:0/711556893 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8007a30 con 0x7fb7c40d0710 2023-11-04T01:38:58.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.126+0000 7fb7c0ff9640 1 -- 172.21.15.114:0/711556893 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b8007b90 con 0x7fb7c40d0710 2023-11-04T01:38:58.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.126+0000 7fb7ca461640 1 -- 172.21.15.114:0/711556893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c40c9680 con 0x7fb7c40d0710 2023-11-04T01:38:58.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.126+0000 7fb7c0ff9640 1 -- 172.21.15.114:0/711556893 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b800ce40 con 0x7fb7c40d0710 2023-11-04T01:38:58.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.126+0000 7fb7ca461640 1 -- 172.21.15.114:0/711556893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c40c9c40 con 0x7fb7c40d0710 2023-11-04T01:38:58.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.127+0000 7fb7ca461640 1 -- 172.21.15.114:0/711556893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c40c9e30 con 0x7fb7c40d0710 2023-11-04T01:38:58.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.127+0000 7fb7c0ff9640 1 -- 172.21.15.114:0/711556893 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb7b80113f0 con 0x7fb7c40d0710 2023-11-04T01:38:58.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.128+0000 7fb7c0ff9640 1 --2- 172.21.15.114:0/711556893 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb7b006ae70 0x7fb7b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.128+0000 7fb7c0ff9640 1 -- 172.21.15.114:0/711556893 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb7b80899c0 con 0x7fb7c40d0710 2023-11-04T01:38:58.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.128+0000 7fb7c3fff640 1 --2- 172.21.15.114:0/711556893 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb7b006ae70 0x7fb7b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.128+0000 7fb7c3fff640 1 --2- 172.21.15.114:0/711556893 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb7b006ae70 0x7fb7b006d330 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4007fd0 tx=0x7fb7b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.132+0000 7fb7c0ff9640 1 -- 172.21.15.114:0/711556893 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb7b8054860 con 0x7fb7c40d0710 2023-11-04T01:38:58.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.298+0000 7fb7ca461640 1 -- 172.21.15.114:0/711556893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "test_data_pool"} v 0) v1 -- 0x7fb7c4074290 con 0x7fb7c40d0710 2023-11-04T01:38:58.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.862+0000 7fb7c0ff9640 1 -- 172.21.15.114:0/711556893 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "test_data_pool"}]=0 pool 'test_data_pool' created v67) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb7b801f0a0 con 0x7fb7c40d0710 2023-11-04T01:38:58.864 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'test_data_pool' created 2023-11-04T01:38:58.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.866+0000 7fb7ca461640 1 -- 172.21.15.114:0/711556893 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb7b006ae70 msgr2=0x7fb7b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.866+0000 7fb7ca461640 1 --2- 172.21.15.114:0/711556893 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb7b006ae70 0x7fb7b006d330 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4007fd0 tx=0x7fb7b4009040 comp rx=0 tx=0).stop 2023-11-04T01:38:58.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.866+0000 7fb7ca461640 1 -- 172.21.15.114:0/711556893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7c40d0710 msgr2=0x7fb7c40c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.866+0000 7fb7ca461640 1 --2- 172.21.15.114:0/711556893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7c40d0710 0x7fb7c40c88e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800c7f0 tx=0x7fb7b800cbf0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.866+0000 7fb7ca461640 1 -- 172.21.15.114:0/711556893 shutdown_connections 2023-11-04T01:38:58.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.866+0000 7fb7ca461640 1 --2- 172.21.15.114:0/711556893 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb7c415e430 0x7fb7c40a77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.867+0000 7fb7ca461640 1 --2- 172.21.15.114:0/711556893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7c40d0710 0x7fb7c40c88e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.867+0000 7fb7ca461640 1 --2- 172.21.15.114:0/711556893 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb7b006ae70 0x7fb7b006d330 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.867+0000 7fb7ca461640 1 --2- 172.21.15.114:0/711556893 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb7c40cda50 0x7fb7c40b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.867+0000 7fb7ca461640 1 -- 172.21.15.114:0/711556893 >> 172.21.15.114:0/711556893 conn(0x7fb7c406ea20 msgr2=0x7fb7c40ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:58.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.867+0000 7fb7ca461640 1 -- 172.21.15.114:0/711556893 shutdown_connections 2023-11-04T01:38:58.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.867+0000 7fb7ca461640 1 -- 172.21.15.114:0/711556893 wait complete. 2023-11-04T01:38:58.884 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create test_metadata_pool 2023-11-04T01:38:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.987+0000 7f05637c0640 1 Processor -- start 2023-11-04T01:38:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.988+0000 7f05637c0640 1 -- start start 2023-11-04T01:38:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.988+0000 7f05637c0640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f055c0cc520 0x7f055c070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.988+0000 7f05637c0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f055c0cc9d0 0x7f055c0714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.988+0000 7f05637c0640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055c0c3860 con 0x7f055c153850 2023-11-04T01:38:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.988+0000 7f05637c0640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c0c9250 con 0x7f055c0cc520 2023-11-04T01:38:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.988+0000 7f05637c0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c153c30 con 0x7f055c0cc9d0 2023-11-04T01:38:58.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.989+0000 7f0561d5d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f055c0cc9d0 0x7f055c0714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.989+0000 7f0560d5b640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f055c0cc520 0x7f055c070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.989+0000 7f0561d5d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f055c0cc9d0 0x7f055c0714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:43352/0 (socket says 172.21.15.114:43352) 2023-11-04T01:38:58.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.989+0000 7f0561d5d640 1 -- 172.21.15.114:0/593307790 learned_addr learned my addr 172.21.15.114:0/593307790 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:58.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.989+0000 7f0561d5d640 1 -- 172.21.15.114:0/593307790 >> v2:172.21.15.141:3300/0 conn(0x7f055c0cc520 msgr2=0x7f055c070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:58.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.989+0000 7f0561d5d640 1 --2- 172.21.15.114:0/593307790 >> v2:172.21.15.141:3300/0 conn(0x7f055c0cc520 0x7f055c070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.989+0000 7f0561d5d640 1 -- 172.21.15.114:0/593307790 >> v1:172.21.15.141:6789/0 conn(0x7f055c153850 legacy=0x7f055c15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.989+0000 7f0561d5d640 1 -- 172.21.15.114:0/593307790 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c0ce590 con 0x7f055c0cc9d0 2023-11-04T01:38:58.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.989+0000 7f0560d5b640 1 --2- 172.21.15.114:0/593307790 >> v2:172.21.15.141:3300/0 conn(0x7f055c0cc520 0x7f055c070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:38:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.990+0000 7f0561d5d640 1 --2- 172.21.15.114:0/593307790 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f055c0cc9d0 0x7f055c0714e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0554009e50 tx=0x7f055402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b940f161c84db78b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.990+0000 7f054ffff640 1 -- 172.21.15.114:0/593307790 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055402cb00 con 0x7f055c0cc9d0 2023-11-04T01:38:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.990+0000 7f054ffff640 1 -- 172.21.15.114:0/593307790 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055402cc60 con 0x7f055c0cc9d0 2023-11-04T01:38:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.990+0000 7f054ffff640 1 -- 172.21.15.114:0/593307790 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05540343f0 con 0x7f055c0cc9d0 2023-11-04T01:38:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.991+0000 7f05637c0640 1 -- 172.21.15.114:0/593307790 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f055c0cc9d0 msgr2=0x7f055c0714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.991+0000 7f05637c0640 1 --2- 172.21.15.114:0/593307790 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f055c0cc9d0 0x7f055c0714e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0554009e50 tx=0x7f055402bf60 comp rx=0 tx=0).stop 2023-11-04T01:38:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.991+0000 7f05637c0640 1 -- 172.21.15.114:0/593307790 shutdown_connections 2023-11-04T01:38:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.991+0000 7f05637c0640 1 --2- 172.21.15.114:0/593307790 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f055c0cc9d0 0x7f055c0714e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.991+0000 7f05637c0640 1 --2- 172.21.15.114:0/593307790 >> v2:172.21.15.141:3300/0 conn(0x7f055c0cc520 0x7f055c070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.991+0000 7f05637c0640 1 -- 172.21.15.114:0/593307790 >> 172.21.15.114:0/593307790 conn(0x7f055c0ce950 msgr2=0x7f055c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.991+0000 7f05637c0640 1 -- 172.21.15.114:0/593307790 shutdown_connections 2023-11-04T01:38:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.991+0000 7f05637c0640 1 -- 172.21.15.114:0/593307790 wait complete. 2023-11-04T01:38:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.992+0000 7f05637c0640 1 Processor -- start 2023-11-04T01:38:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.992+0000 7f05637c0640 1 -- start start 2023-11-04T01:38:58.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.993+0000 7f05637c0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f055c0cc520 0x7f055c14f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.993+0000 7f05637c0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f055c0cc9d0 0x7f055c1456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.993+0000 7f05637c0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f055c153850 0x7f055c13ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:58.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.993+0000 7f05637c0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c141560 con 0x7f055c153850 2023-11-04T01:38:58.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.993+0000 7f05637c0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1464e0 con 0x7f055c0cc520 2023-11-04T01:38:58.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.993+0000 7f05637c0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c14a0a0 con 0x7f055c0cc9d0 2023-11-04T01:38:58.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.993+0000 7f0561d5d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f055c153850 0x7f055c13ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.993+0000 7f0561d5d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f055c153850 0x7f055c13ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55304/0 (socket says 172.21.15.114:55304) 2023-11-04T01:38:58.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.993+0000 7f0561d5d640 1 -- 172.21.15.114:0/1941173 learned_addr learned my addr 172.21.15.114:0/1941173 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:58.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.993+0000 7f0560d5b640 1 --2- 172.21.15.114:0/1941173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f055c0cc9d0 0x7f055c1456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.993+0000 7f056155c640 1 --2- 172.21.15.114:0/1941173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f055c0cc520 0x7f055c14f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:58.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.993+0000 7f0561d5d640 1 -- 172.21.15.114:0/1941173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f055c0cc9d0 msgr2=0x7f055c1456c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.993+0000 7f0561d5d640 1 --2- 172.21.15.114:0/1941173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f055c0cc9d0 0x7f055c1456c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.993+0000 7f0561d5d640 1 -- 172.21.15.114:0/1941173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f055c0cc520 msgr2=0x7f055c14f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:58.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.993+0000 7f0561d5d640 1 --2- 172.21.15.114:0/1941173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f055c0cc520 0x7f055c14f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.993+0000 7f0561d5d640 1 -- 172.21.15.114:0/1941173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0558009400 con 0x7f055c153850 2023-11-04T01:38:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.994+0000 7f0561d5d640 1 --2- 172.21.15.114:0/1941173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f055c153850 0x7f055c13ec40 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f0554036040 tx=0x7f0554004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.994+0000 7f054dffb640 1 -- 172.21.15.114:0/1941173 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554009510 con 0x7f055c153850 2023-11-04T01:38:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.994+0000 7f054dffb640 1 -- 172.21.15.114:0/1941173 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055403e450 con 0x7f055c153850 2023-11-04T01:38:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.994+0000 7f05637c0640 1 -- 172.21.15.114:0/1941173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0554009b30 con 0x7f055c153850 2023-11-04T01:38:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.994+0000 7f054dffb640 1 -- 172.21.15.114:0/1941173 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055403e800 con 0x7f055c153850 2023-11-04T01:38:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.994+0000 7f05637c0640 1 -- 172.21.15.114:0/1941173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c149dc0 con 0x7f055c153850 2023-11-04T01:38:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.995+0000 7f05637c0640 1 -- 172.21.15.114:0/1941173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055c146690 con 0x7f055c153850 2023-11-04T01:38:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.995+0000 7f054dffb640 1 -- 172.21.15.114:0/1941173 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f055403e960 con 0x7f055c153850 2023-11-04T01:38:59.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.996+0000 7f054dffb640 1 --2- 172.21.15.114:0/1941173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f054006ae70 0x7f054006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.996+0000 7f056155c640 1 --2- 172.21.15.114:0/1941173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f054006ae70 0x7f054006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.996+0000 7f054dffb640 1 -- 172.21.15.114:0/1941173 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f05540ac640 con 0x7f055c153850 2023-11-04T01:38:59.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:58.996+0000 7f056155c640 1 --2- 172.21.15.114:0/1941173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f054006ae70 0x7f054006d330 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f055c0b0bc0 tx=0x7f0550009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.000+0000 7f054dffb640 1 -- 172.21.15.114:0/1941173 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f055c146690 con 0x7f055c153850 2023-11-04T01:38:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.166+0000 7f05637c0640 1 -- 172.21.15.114:0/1941173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "test_metadata_pool"} v 0) v1 -- 0x7f055c146690 con 0x7f055c153850 2023-11-04T01:38:59.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.872+0000 7f054dffb640 1 -- 172.21.15.114:0/1941173 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "test_metadata_pool"}]=0 pool 'test_metadata_pool' created v68) v1 ==== 126+0+0 (secure 0 0 0) 0x7f055c146690 con 0x7f055c153850 2023-11-04T01:38:59.874 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'test_metadata_pool' created 2023-11-04T01:38:59.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.874+0000 7f05637c0640 1 -- 172.21.15.114:0/1941173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f054006ae70 msgr2=0x7f054006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.874+0000 7f05637c0640 1 --2- 172.21.15.114:0/1941173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f054006ae70 0x7f054006d330 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f055c0b0bc0 tx=0x7f0550009040 comp rx=0 tx=0).stop 2023-11-04T01:38:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.875+0000 7f05637c0640 1 -- 172.21.15.114:0/1941173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f055c153850 msgr2=0x7f055c13ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.875+0000 7f05637c0640 1 --2- 172.21.15.114:0/1941173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f055c153850 0x7f055c13ec40 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f0554036040 tx=0x7f0554004a40 comp rx=0 tx=0).stop 2023-11-04T01:38:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.875+0000 7f05637c0640 1 -- 172.21.15.114:0/1941173 shutdown_connections 2023-11-04T01:38:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.875+0000 7f05637c0640 1 --2- 172.21.15.114:0/1941173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f055c153850 0x7f055c13ec40 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.875+0000 7f05637c0640 1 --2- 172.21.15.114:0/1941173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f055c0cc9d0 0x7f055c1456c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.875+0000 7f05637c0640 1 --2- 172.21.15.114:0/1941173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f054006ae70 0x7f054006d330 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.875+0000 7f05637c0640 1 --2- 172.21.15.114:0/1941173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f055c0cc520 0x7f055c14f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.875+0000 7f05637c0640 1 -- 172.21.15.114:0/1941173 >> 172.21.15.114:0/1941173 conn(0x7f055c0ce950 msgr2=0x7f055c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.875+0000 7f05637c0640 1 -- 172.21.15.114:0/1941173 shutdown_connections 2023-11-04T01:38:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.875+0000 7f05637c0640 1 -- 172.21.15.114:0/1941173 wait complete. 2023-11-04T01:38:59.898 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool test_data_pool mksnap snap4 2023-11-04T01:38:59.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.939+0000 7f7ec7c61f40 1 Processor -- start 2023-11-04T01:38:59.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.939+0000 7f7ec7c61f40 1 -- start start 2023-11-04T01:38:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec7c61f40 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d96196f2b0 0x55d961a24040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec7c61f40 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d96199b240 0x55d96196c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec7c61f40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d961a2c310 0x55d96196c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec7c61f40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d96191d3b0 con 0x55d961a2c310 2023-11-04T01:38:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec7c61f40 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9618b7650 con 0x55d96196f2b0 2023-11-04T01:38:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec7c61f40 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d9618b72f0 con 0x55d96199b240 2023-11-04T01:38:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec5f64640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d961a2c310 0x55d96196c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec5f64640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d961a2c310 0x55d96196c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55320/0 (socket says 172.21.15.114:55320) 2023-11-04T01:38:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec5f64640 1 -- 172.21.15.114:0/2480006115 learned_addr learned my addr 172.21.15.114:0/2480006115 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec5763640 1 --2- 172.21.15.114:0/2480006115 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d96196f2b0 0x55d961a24040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec4f62640 1 --2- 172.21.15.114:0/2480006115 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d96199b240 0x55d96196c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec5f64640 1 -- 172.21.15.114:0/2480006115 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d96199b240 msgr2=0x55d96196c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec5f64640 1 --2- 172.21.15.114:0/2480006115 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d96199b240 0x55d96196c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec5f64640 1 -- 172.21.15.114:0/2480006115 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d96196f2b0 msgr2=0x55d961a24040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:38:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec5f64640 1 --2- 172.21.15.114:0/2480006115 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d96196f2b0 0x55d961a24040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec5f64640 1 -- 172.21.15.114:0/2480006115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc005d20 con 0x55d961a2c310 2023-11-04T01:38:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7ec5f64640 1 --2- 172.21.15.114:0/2480006115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d961a2c310 0x55d96196c770 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0006d70 tx=0x7f7ec000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd1bdfb46db6f26 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7eb77fe640 1 -- 172.21.15.114:0/2480006115 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec000e470 con 0x55d961a2c310 2023-11-04T01:38:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7eb77fe640 1 -- 172.21.15.114:0/2480006115 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec000e5d0 con 0x55d961a2c310 2023-11-04T01:38:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.940+0000 7f7eb77fe640 1 -- 172.21.15.114:0/2480006115 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec000e980 con 0x55d961a2c310 2023-11-04T01:38:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.941+0000 7f7ec7c61f40 1 -- 172.21.15.114:0/2480006115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d961a2c310 msgr2=0x55d96196c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.941+0000 7f7ec7c61f40 1 --2- 172.21.15.114:0/2480006115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d961a2c310 0x55d96196c770 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0006d70 tx=0x7f7ec000b6c0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.941+0000 7f7ec7c61f40 1 -- 172.21.15.114:0/2480006115 shutdown_connections 2023-11-04T01:38:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.941+0000 7f7ec7c61f40 1 --2- 172.21.15.114:0/2480006115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d961a2c310 0x55d96196c770 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.941+0000 7f7ec7c61f40 1 --2- 172.21.15.114:0/2480006115 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d96199b240 0x55d96196c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.941+0000 7f7ec7c61f40 1 --2- 172.21.15.114:0/2480006115 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d96196f2b0 0x55d961a24040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.941+0000 7f7ec7c61f40 1 -- 172.21.15.114:0/2480006115 >> 172.21.15.114:0/2480006115 conn(0x55d961999f40 msgr2=0x55d961a2c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:38:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.941+0000 7f7ec7c61f40 1 -- 172.21.15.114:0/2480006115 shutdown_connections 2023-11-04T01:38:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.941+0000 7f7ec7c61f40 1 -- 172.21.15.114:0/2480006115 wait complete. 2023-11-04T01:38:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.942+0000 7f7ec7c61f40 1 Processor -- start 2023-11-04T01:38:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.942+0000 7f7ec7c61f40 1 -- start start 2023-11-04T01:38:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.942+0000 7f7ec7c61f40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d96196f2b0 0x55d96196c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.942+0000 7f7ec7c61f40 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d96199b240 0x55d96196c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.942+0000 7f7ec7c61f40 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d961a2c310 0x55d961a21de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.942+0000 7f7ec7c61f40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9618974f0 con 0x55d96196f2b0 2023-11-04T01:38:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.942+0000 7f7ec7c61f40 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d961a2cef0 con 0x55d961a2c310 2023-11-04T01:38:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.942+0000 7f7ec7c61f40 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d961a2cc10 con 0x55d96199b240 2023-11-04T01:38:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.942+0000 7f7ec5763640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d96196f2b0 0x55d96196c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.942+0000 7f7ec5763640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d96196f2b0 0x55d96196c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55334/0 (socket says 172.21.15.114:55334) 2023-11-04T01:38:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.942+0000 7f7ec5763640 1 -- 172.21.15.114:0/651571582 learned_addr learned my addr 172.21.15.114:0/651571582 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:38:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.942+0000 7f7ec5f64640 1 --2- 172.21.15.114:0/651571582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d961a2c310 0x55d961a21de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.942+0000 7f7ec4f62640 1 --2- 172.21.15.114:0/651571582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d96199b240 0x55d96196c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.943+0000 7f7ec5763640 1 -- 172.21.15.114:0/651571582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d96199b240 msgr2=0x55d96196c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.943+0000 7f7ec5763640 1 --2- 172.21.15.114:0/651571582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d96199b240 0x55d96196c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.943+0000 7f7ec5763640 1 -- 172.21.15.114:0/651571582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d961a2c310 msgr2=0x55d961a21de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:38:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.943+0000 7f7ec5763640 1 --2- 172.21.15.114:0/651571582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d961a2c310 0x55d961a21de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:38:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.943+0000 7f7ec5763640 1 -- 172.21.15.114:0/651571582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9618b65a0 con 0x55d96196f2b0 2023-11-04T01:38:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.943+0000 7f7ec5763640 1 --2- 172.21.15.114:0/651571582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d96196f2b0 0x55d96196c230 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8007000 tx=0x7f7eb8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:38:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.943+0000 7f7eb67fc640 1 -- 172.21.15.114:0/651571582 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8067610 con 0x55d96196f2b0 2023-11-04T01:38:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.943+0000 7f7eb67fc640 1 -- 172.21.15.114:0/651571582 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb8067770 con 0x55d96196f2b0 2023-11-04T01:38:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.943+0000 7f7ec7c61f40 1 -- 172.21.15.114:0/651571582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb800a100 con 0x55d96196f2b0 2023-11-04T01:38:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.943+0000 7f7eb67fc640 1 -- 172.21.15.114:0/651571582 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8067b00 con 0x55d96196f2b0 2023-11-04T01:38:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.943+0000 7f7ec7c61f40 1 -- 172.21.15.114:0/651571582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d9618c3780 con 0x55d96196f2b0 2023-11-04T01:38:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.945+0000 7f7eb67fc640 1 -- 172.21.15.114:0/651571582 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7eb805d410 con 0x55d96196f2b0 2023-11-04T01:38:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.945+0000 7f7eb67fc640 1 --2- 172.21.15.114:0/651571582 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7ea8069820 0x7f7ea806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:38:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.945+0000 7f7eb67fc640 1 -- 172.21.15.114:0/651571582 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f7eb80cb340 con 0x55d96196f2b0 2023-11-04T01:38:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.945+0000 7f7ec4f62640 1 --2- 172.21.15.114:0/651571582 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7ea8069820 0x7f7ea806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:38:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.945+0000 7f7ec7c61f40 1 -- 172.21.15.114:0/651571582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- pool_op(create snap pool 12 tid 1 name snap4 v0) v4 -- 0x55d961927330 con 0x55d96196f2b0 2023-11-04T01:38:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:38:59.945+0000 7f7ec4f62640 1 --2- 172.21.15.114:0/651571582 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7ea8069820 0x7f7ea806bce0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x55d961a29200 tx=0x7f7ebc00c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:00.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:00.890+0000 7f7eb67fc640 1 -- 172.21.15.114:0/651571582 <== mon.0 v2:172.21.15.114:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v69) v1 ==== 43+0+0 (secure 0 0 0) 0x7f7eb8095fc0 con 0x55d96196f2b0 2023-11-04T01:39:00.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:00.890+0000 7f7eb67fc640 1 -- 172.21.15.114:0/651571582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=69}) v3 -- 0x7f7ea8073f00 con 0x55d96196f2b0 2023-11-04T01:39:00.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:00.891+0000 7f7eb67fc640 1 -- 172.21.15.114:0/651571582 <== mon.0 v2:172.21.15.114:3300/0 7 ==== osd_map(69..69 src has 1..69) v4 ==== 718+0+0 (secure 0 0 0) 0x7f7eb8099c80 con 0x55d96196f2b0 2023-11-04T01:39:00.893 INFO:teuthology.orchestra.run.smithi114.stdout:created pool test_data_pool snap snap4 2023-11-04T01:39:00.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:00.891+0000 7f7ec7c61f40 1 -- 172.21.15.114:0/651571582 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7ea8069820 msgr2=0x7f7ea806bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:00.891+0000 7f7ec7c61f40 1 --2- 172.21.15.114:0/651571582 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7ea8069820 0x7f7ea806bce0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x55d961a29200 tx=0x7f7ebc00c040 comp rx=0 tx=0).stop 2023-11-04T01:39:00.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:00.891+0000 7f7ec7c61f40 1 -- 172.21.15.114:0/651571582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d96196f2b0 msgr2=0x55d96196c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:00.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:00.891+0000 7f7ec7c61f40 1 --2- 172.21.15.114:0/651571582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d96196f2b0 0x55d96196c230 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8007000 tx=0x7f7eb8003330 comp rx=0 tx=0).stop 2023-11-04T01:39:00.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:00.891+0000 7f7ec7c61f40 1 -- 172.21.15.114:0/651571582 shutdown_connections 2023-11-04T01:39:00.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:00.891+0000 7f7ec7c61f40 1 --2- 172.21.15.114:0/651571582 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7ea8069820 0x7f7ea806bce0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:00.891+0000 7f7ec7c61f40 1 --2- 172.21.15.114:0/651571582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d961a2c310 0x55d961a21de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:00.891+0000 7f7ec7c61f40 1 --2- 172.21.15.114:0/651571582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d96199b240 0x55d96196c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:00.891+0000 7f7ec7c61f40 1 --2- 172.21.15.114:0/651571582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d96196f2b0 0x55d96196c230 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:00.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:00.891+0000 7f7ec7c61f40 1 -- 172.21.15.114:0/651571582 >> 172.21.15.114:0/651571582 conn(0x55d961999f40 msgr2=0x55d961a234b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:00.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:00.891+0000 7f7ec7c61f40 1 -- 172.21.15.114:0/651571582 shutdown_connections 2023-11-04T01:39:00.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:00.891+0000 7f7ec7c61f40 1 -- 172.21.15.114:0/651571582 wait complete. 2023-11-04T01:39:00.899 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testfs test_metadata_pool test_data_pool 2023-11-04T01:39:01.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.046+0000 7f71b46d4640 1 Processor -- start 2023-11-04T01:39:01.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.046+0000 7f71b46d4640 1 -- start start 2023-11-04T01:39:01.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.047+0000 7f71b46d4640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f71ac1609e0 0x7f71ac0cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.047+0000 7f71b46d4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ac06e1a0 con 0x7f71ac160600 2023-11-04T01:39:01.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.047+0000 7f71b46d4640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ac0cd330 con 0x7f71ac0ccde0 2023-11-04T01:39:01.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.047+0000 7f71b46d4640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ac06db50 con 0x7f71ac1609e0 2023-11-04T01:39:01.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b2470640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f71ac160600 0x7f71ac0cd610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60884/0 (socket says 172.21.15.114:60884) 2023-11-04T01:39:01.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b2470640 1 -- 172.21.15.114:0/3666879376 learned_addr learned my addr 172.21.15.114:0/3666879376 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:01.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b1c6f640 1 --2- 172.21.15.114:0/3666879376 >> v2:172.21.15.141:3300/0 conn(0x7f71ac1609e0 0x7f71ac0cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 -- 172.21.15.114:0/3666879376 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465208981 0 0) 0x7f71ac06e1a0 con 0x7f71ac160600 2023-11-04T01:39:01.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 -- 172.21.15.114:0/3666879376 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7198003520 con 0x7f71ac160600 2023-11-04T01:39:01.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 -- 172.21.15.114:0/3666879376 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544831183 0 0) 0x7f71ac0cd330 con 0x7f71ac0ccde0 2023-11-04T01:39:01.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 -- 172.21.15.114:0/3666879376 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71ac06e1a0 con 0x7f71ac0ccde0 2023-11-04T01:39:01.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 -- 172.21.15.114:0/3666879376 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 286555151 0 0) 0x7f7198003520 con 0x7f71ac160600 2023-11-04T01:39:01.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 -- 172.21.15.114:0/3666879376 >> v2:172.21.15.141:3300/0 conn(0x7f71ac1609e0 msgr2=0x7f71ac0cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:01.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 --2- 172.21.15.114:0/3666879376 >> v2:172.21.15.141:3300/0 conn(0x7f71ac1609e0 0x7f71ac0cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 -- 172.21.15.114:0/3666879376 >> v1:172.21.15.141:6789/0 conn(0x7f71ac0ccde0 legacy=0x7f71ac06e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 -- 172.21.15.114:0/3666879376 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac06de30 con 0x7f71ac160600 2023-11-04T01:39:01.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 -- 172.21.15.114:0/3666879376 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f71a0001670 con 0x7f71ac160600 2023-11-04T01:39:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 -- 172.21.15.114:0/3666879376 >> v1:172.21.15.114:6789/0 conn(0x7f71ac160600 legacy=0x7f71ac0cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 --2- 172.21.15.114:0/3666879376 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7198003b00 0x7f7198003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 --2- 172.21.15.114:0/3666879376 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71980047c0 0x7f7198004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 --2- 172.21.15.114:0/3666879376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7198005180 0x7f719800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 -- 172.21.15.114:0/3666879376 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac06db50 con 0x7f7198005180 2023-11-04T01:39:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 -- 172.21.15.114:0/3666879376 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719800bf70 con 0x7f71980047c0 2023-11-04T01:39:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b146e640 1 -- 172.21.15.114:0/3666879376 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719800c130 con 0x7f7198003b00 2023-11-04T01:39:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b2c71640 1 --2- 172.21.15.114:0/3666879376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7198005180 0x7f719800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b1c6f640 1 --2- 172.21.15.114:0/3666879376 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71980047c0 0x7f7198004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.048+0000 7f71b2470640 1 --2- 172.21.15.114:0/3666879376 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7198003b00 0x7f7198003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.049+0000 7f71b2c71640 1 -- 172.21.15.114:0/3666879376 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7198003b00 msgr2=0x7f7198003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.049+0000 7f71b2c71640 1 --2- 172.21.15.114:0/3666879376 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7198003b00 0x7f7198003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.049+0000 7f71b2c71640 1 -- 172.21.15.114:0/3666879376 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71980047c0 msgr2=0x7f7198004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.049+0000 7f71b2c71640 1 --2- 172.21.15.114:0/3666879376 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71980047c0 0x7f7198004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.049+0000 7f71b2c71640 1 -- 172.21.15.114:0/3666879376 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7198003520 con 0x7f7198005180 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.049+0000 7f71b2c71640 1 -- 172.21.15.114:0/3666879376 reap_dead start 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.049+0000 7f71b2c71640 1 --2- 172.21.15.114:0/3666879376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7198005180 0x7f719800b980 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f71a4001fa0 tx=0x7f71980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b8dce38c7a0335 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.049+0000 7f71b146e640 1 -- 172.21.15.114:0/3666879376 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4006d50 con 0x7f7198005180 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.049+0000 7f71b146e640 1 -- 172.21.15.114:0/3666879376 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a4003970 con 0x7f7198005180 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.049+0000 7f71b146e640 1 -- 172.21.15.114:0/3666879376 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4003d20 con 0x7f7198005180 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.050+0000 7f71b46d4640 1 -- 172.21.15.114:0/3666879376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7198005180 msgr2=0x7f719800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.050+0000 7f71b46d4640 1 --2- 172.21.15.114:0/3666879376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7198005180 0x7f719800b980 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f71a4001fa0 tx=0x7f71980057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.050+0000 7f71b46d4640 1 -- 172.21.15.114:0/3666879376 shutdown_connections 2023-11-04T01:39:01.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.050+0000 7f71b46d4640 1 --2- 172.21.15.114:0/3666879376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7198005180 0x7f719800b980 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.050+0000 7f71b46d4640 1 -- 172.21.15.114:0/3666879376 >> 172.21.15.114:0/3666879376 conn(0x7f71ac06a120 msgr2=0x7f71ac06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:01.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.050+0000 7f71b46d4640 1 -- 172.21.15.114:0/3666879376 shutdown_connections 2023-11-04T01:39:01.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.050+0000 7f71b46d4640 1 -- 172.21.15.114:0/3666879376 wait complete. 2023-11-04T01:39:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.051+0000 7f71b46d4640 1 Processor -- start 2023-11-04T01:39:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.051+0000 7f71b46d4640 1 -- start start 2023-11-04T01:39:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.052+0000 7f71b46d4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7198005180 0x7f71ac0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.052+0000 7f71b46d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71ac0acc20 0x7f71ac0c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.052+0000 7f71b46d4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71ac155e80 0x7f71ac156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.052+0000 7f71b46d4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac156840 con 0x7f7198005180 2023-11-04T01:39:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.052+0000 7f71b46d4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac0ab8e0 con 0x7f71ac155e80 2023-11-04T01:39:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.052+0000 7f71b46d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac0abb80 con 0x7f71ac0acc20 2023-11-04T01:39:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.052+0000 7f71b2470640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7198005180 0x7f71ac0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.052+0000 7f71b2470640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7198005180 0x7f71ac0ca410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55364/0 (socket says 172.21.15.114:55364) 2023-11-04T01:39:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.052+0000 7f71b2470640 1 -- 172.21.15.114:0/2712523618 learned_addr learned my addr 172.21.15.114:0/2712523618 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.052+0000 7f71b2470640 1 -- 172.21.15.114:0/2712523618 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71ac0acc20 msgr2=0x7f71ac0c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.052+0000 7f71b2470640 1 --2- 172.21.15.114:0/2712523618 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71ac0acc20 0x7f71ac0c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.052+0000 7f71b2470640 1 -- 172.21.15.114:0/2712523618 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71ac155e80 msgr2=0x7f71ac156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.052+0000 7f71b2470640 1 --2- 172.21.15.114:0/2712523618 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71ac155e80 0x7f71ac156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.052+0000 7f71b2470640 1 -- 172.21.15.114:0/2712523618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac0abe60 con 0x7f7198005180 2023-11-04T01:39:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.052+0000 7f71b2470640 1 --2- 172.21.15.114:0/2712523618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7198005180 0x7f71ac0ca410 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f71a0007310 tx=0x7f71a00077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.053+0000 7f719effd640 1 -- 172.21.15.114:0/2712523618 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a000f940 con 0x7f7198005180 2023-11-04T01:39:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.053+0000 7f719effd640 1 -- 172.21.15.114:0/2712523618 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a000fac0 con 0x7f7198005180 2023-11-04T01:39:01.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.053+0000 7f71b46d4640 1 -- 172.21.15.114:0/2712523618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ac0ac140 con 0x7f7198005180 2023-11-04T01:39:01.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.053+0000 7f719effd640 1 -- 172.21.15.114:0/2712523618 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a000fe70 con 0x7f7198005180 2023-11-04T01:39:01.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.053+0000 7f71b46d4640 1 -- 172.21.15.114:0/2712523618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ac0ac700 con 0x7f7198005180 2023-11-04T01:39:01.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.054+0000 7f71b46d4640 1 -- 172.21.15.114:0/2712523618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ac074290 con 0x7f7198005180 2023-11-04T01:39:01.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.054+0000 7f719effd640 1 -- 172.21.15.114:0/2712523618 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71a001d460 con 0x7f7198005180 2023-11-04T01:39:01.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.054+0000 7f719effd640 1 --2- 172.21.15.114:0/2712523618 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f719006ae70 0x7f719006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.054+0000 7f719effd640 1 -- 172.21.15.114:0/2712523618 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7131+0+0 (secure 0 0 0) 0x7f71a0089d40 con 0x7f7198005180 2023-11-04T01:39:01.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.054+0000 7f71b1c6f640 1 --2- 172.21.15.114:0/2712523618 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f719006ae70 0x7f719006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.055+0000 7f71b1c6f640 1 --2- 172.21.15.114:0/2712523618 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f719006ae70 0x7f719006d330 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0addc0 tx=0x7f71a8009320 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:01.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.059+0000 7f719effd640 1 -- 172.21.15.114:0/2712523618 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f71a0054860 con 0x7f7198005180 2023-11-04T01:39:01.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.257+0000 7f71b46d4640 1 -- 172.21.15.114:0/2712523618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testfs", "metadata": "test_metadata_pool", "data": "test_data_pool"} v 0) v1 -- 0x7f71ac0caca0 con 0x7f7198005180 2023-11-04T01:39:01.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.257+0000 7f719effd640 1 -- 172.21.15.114:0/2712523618 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testfs", "metadata": "test_metadata_pool", "data": "test_data_pool"}]=-95 pool(12) already has mon-managed snaps; can't attach pool to fs v29) v1 ==== 198+0+0 (secure 0 0 0) 0x7f71a0057e80 con 0x7f7198005180 2023-11-04T01:39:01.259 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOTSUP: pool(12) already has mon-managed snaps; can't attach pool to fs 2023-11-04T01:39:01.264 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:39:01.264 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool test_data_pool rmsnap snap4 2023-11-04T01:39:01.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.303+0000 7fd25b63af40 1 Processor -- start 2023-11-04T01:39:01.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.303+0000 7fd25b63af40 1 -- start start 2023-11-04T01:39:01.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.303+0000 7fd25b63af40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565428d5070 0x5565428bd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.303+0000 7fd25b63af40 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565428d8d00 0x5565428bbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.303+0000 7fd25b63af40 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556542964450 0x5565428bc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.303+0000 7fd25b63af40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55654283f3b0 con 0x5565428d5070 2023-11-04T01:39:01.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.303+0000 7fd25b63af40 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565427d9650 con 0x556542964450 2023-11-04T01:39:01.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.303+0000 7fd25b63af40 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5565427d92f0 con 0x5565428d8d00 2023-11-04T01:39:01.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.303+0000 7fd25894a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565428d5070 0x5565428bd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.304+0000 7fd25894a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565428d5070 0x5565428bd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55370/0 (socket says 172.21.15.114:55370) 2023-11-04T01:39:01.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.304+0000 7fd25894a640 1 -- 172.21.15.114:0/1407483343 learned_addr learned my addr 172.21.15.114:0/1407483343 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:01.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.304+0000 7fd25894a640 1 -- 172.21.15.114:0/1407483343 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565428d8d00 msgr2=0x5565428bbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:01.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.304+0000 7fd258149640 1 --2- 172.21.15.114:0/1407483343 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565428d8d00 0x5565428bbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.304+0000 7fd25914b640 1 --2- 172.21.15.114:0/1407483343 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556542964450 0x5565428bc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.304+0000 7fd25894a640 1 --2- 172.21.15.114:0/1407483343 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565428d8d00 0x5565428bbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.304+0000 7fd25894a640 1 -- 172.21.15.114:0/1407483343 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556542964450 msgr2=0x5565428bc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:01.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.304+0000 7fd25894a640 1 --2- 172.21.15.114:0/1407483343 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556542964450 0x5565428bc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.304+0000 7fd25894a640 1 -- 172.21.15.114:0/1407483343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24800c3f0 con 0x5565428d5070 2023-11-04T01:39:01.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.304+0000 7fd258149640 1 --2- 172.21.15.114:0/1407483343 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565428d8d00 0x5565428bbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:01.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.304+0000 7fd25914b640 1 --2- 172.21.15.114:0/1407483343 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556542964450 0x5565428bc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:01.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.304+0000 7fd25894a640 1 --2- 172.21.15.114:0/1407483343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565428d5070 0x5565428bd010 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd24801f980 tx=0x7fd248050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786d93c8e24e56e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:01.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.304+0000 7fd257147640 1 -- 172.21.15.114:0/1407483343 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24804e9e0 con 0x5565428d5070 2023-11-04T01:39:01.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.304+0000 7fd257147640 1 -- 172.21.15.114:0/1407483343 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24804eb40 con 0x5565428d5070 2023-11-04T01:39:01.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.304+0000 7fd257147640 1 -- 172.21.15.114:0/1407483343 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24804f430 con 0x5565428d5070 2023-11-04T01:39:01.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.305+0000 7fd25b63af40 1 -- 172.21.15.114:0/1407483343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565428d5070 msgr2=0x5565428bd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.305+0000 7fd25b63af40 1 --2- 172.21.15.114:0/1407483343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565428d5070 0x5565428bd010 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd24801f980 tx=0x7fd248050000 comp rx=0 tx=0).stop 2023-11-04T01:39:01.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.305+0000 7fd25b63af40 1 -- 172.21.15.114:0/1407483343 shutdown_connections 2023-11-04T01:39:01.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.305+0000 7fd25b63af40 1 --2- 172.21.15.114:0/1407483343 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x556542964450 0x5565428bc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.305+0000 7fd25b63af40 1 --2- 172.21.15.114:0/1407483343 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565428d8d00 0x5565428bbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.305+0000 7fd25b63af40 1 --2- 172.21.15.114:0/1407483343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565428d5070 0x5565428bd010 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.305+0000 7fd25b63af40 1 -- 172.21.15.114:0/1407483343 >> 172.21.15.114:0/1407483343 conn(0x5565428d7530 msgr2=0x5565428d7910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:01.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.305+0000 7fd25b63af40 1 -- 172.21.15.114:0/1407483343 shutdown_connections 2023-11-04T01:39:01.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.305+0000 7fd25b63af40 1 -- 172.21.15.114:0/1407483343 wait complete. 2023-11-04T01:39:01.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.305+0000 7fd25b63af40 1 Processor -- start 2023-11-04T01:39:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.305+0000 7fd25b63af40 1 -- start start 2023-11-04T01:39:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.306+0000 7fd25b63af40 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565428d5070 0x5565428bc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.306+0000 7fd25b63af40 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565428d8d00 0x556542957cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.306+0000 7fd25b63af40 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556542964450 0x55654288e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.306+0000 7fd25b63af40 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565427b94f0 con 0x556542964450 2023-11-04T01:39:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.306+0000 7fd25b63af40 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x556542966f60 con 0x5565428d5070 2023-11-04T01:39:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.306+0000 7fd25b63af40 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55654295d540 con 0x5565428d8d00 2023-11-04T01:39:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.306+0000 7fd25914b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556542964450 0x55654288e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.306+0000 7fd25914b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556542964450 0x55654288e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55384/0 (socket says 172.21.15.114:55384) 2023-11-04T01:39:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.306+0000 7fd25914b640 1 -- 172.21.15.114:0/3301922832 learned_addr learned my addr 172.21.15.114:0/3301922832 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.306+0000 7fd25894a640 1 --2- 172.21.15.114:0/3301922832 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565428d5070 0x5565428bc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.306+0000 7fd258149640 1 --2- 172.21.15.114:0/3301922832 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565428d8d00 0x556542957cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.306+0000 7fd25914b640 1 -- 172.21.15.114:0/3301922832 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565428d8d00 msgr2=0x556542957cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.306+0000 7fd25914b640 1 --2- 172.21.15.114:0/3301922832 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565428d8d00 0x556542957cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.306+0000 7fd25914b640 1 -- 172.21.15.114:0/3301922832 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565428d5070 msgr2=0x5565428bc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.306+0000 7fd25914b640 1 --2- 172.21.15.114:0/3301922832 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565428d5070 0x5565428bc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.306+0000 7fd25914b640 1 -- 172.21.15.114:0/3301922832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565427ff770 con 0x556542964450 2023-11-04T01:39:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.307+0000 7fd25914b640 1 --2- 172.21.15.114:0/3301922832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556542964450 0x55654288e240 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd250007e00 tx=0x7fd250006750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.307+0000 7fd256145640 1 -- 172.21.15.114:0/3301922832 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25000f470 con 0x556542964450 2023-11-04T01:39:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.307+0000 7fd256145640 1 -- 172.21.15.114:0/3301922832 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25000f5f0 con 0x556542964450 2023-11-04T01:39:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.307+0000 7fd256145640 1 -- 172.21.15.114:0/3301922832 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25000f9a0 con 0x556542964450 2023-11-04T01:39:01.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.307+0000 7fd25b63af40 1 -- 172.21.15.114:0/3301922832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5565427e5780 con 0x556542964450 2023-11-04T01:39:01.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.307+0000 7fd25b63af40 1 -- 172.21.15.114:0/3301922832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565427d8930 con 0x556542964450 2023-11-04T01:39:01.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.308+0000 7fd256145640 1 -- 172.21.15.114:0/3301922832 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd25000fb00 con 0x556542964450 2023-11-04T01:39:01.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.308+0000 7fd256145640 1 --2- 172.21.15.114:0/3301922832 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd244069820 0x7fd24406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:01.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.308+0000 7fd256145640 1 -- 172.21.15.114:0/3301922832 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7131+0+0 (secure 0 0 0) 0x7fd250087f20 con 0x556542964450 2023-11-04T01:39:01.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.308+0000 7fd25894a640 1 --2- 172.21.15.114:0/3301922832 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd244069820 0x7fd24406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:01.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.308+0000 7fd25b63af40 1 -- 172.21.15.114:0/3301922832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- pool_op(delete snap pool 12 tid 1 name snap4 v0) v4 -- 0x556542849330 con 0x556542964450 2023-11-04T01:39:01.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.309+0000 7fd25894a640 1 --2- 172.21.15.114:0/3301922832 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd244069820 0x7fd24406bce0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd248063000 tx=0x7fd248052000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:01.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.889+0000 7fd256145640 1 -- 172.21.15.114:0/3301922832 <== mon.0 v2:172.21.15.114:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v70) v1 ==== 43+0+0 (secure 0 0 0) 0x7fd250017070 con 0x556542964450 2023-11-04T01:39:01.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.889+0000 7fd256145640 1 -- 172.21.15.114:0/3301922832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7fd244073f60 con 0x556542964450 2023-11-04T01:39:01.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.890+0000 7fd256145640 1 -- 172.21.15.114:0/3301922832 <== mon.0 v2:172.21.15.114:3300/0 7 ==== osd_map(70..70 src has 1..70) v4 ==== 970+0+0 (secure 0 0 0) 0x7fd250056840 con 0x556542964450 2023-11-04T01:39:01.892 INFO:teuthology.orchestra.run.smithi114.stdout:removed pool test_data_pool snap snap4 2023-11-04T01:39:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.890+0000 7fd25b63af40 1 -- 172.21.15.114:0/3301922832 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd244069820 msgr2=0x7fd24406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.890+0000 7fd25b63af40 1 --2- 172.21.15.114:0/3301922832 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd244069820 0x7fd24406bce0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd248063000 tx=0x7fd248052000 comp rx=0 tx=0).stop 2023-11-04T01:39:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.890+0000 7fd25b63af40 1 -- 172.21.15.114:0/3301922832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556542964450 msgr2=0x55654288e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.890+0000 7fd25b63af40 1 --2- 172.21.15.114:0/3301922832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556542964450 0x55654288e240 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd250007e00 tx=0x7fd250006750 comp rx=0 tx=0).stop 2023-11-04T01:39:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.890+0000 7fd25b63af40 1 -- 172.21.15.114:0/3301922832 shutdown_connections 2023-11-04T01:39:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.890+0000 7fd25b63af40 1 --2- 172.21.15.114:0/3301922832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556542964450 0x55654288e240 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.890+0000 7fd25b63af40 1 --2- 172.21.15.114:0/3301922832 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565428d8d00 0x556542957cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.890+0000 7fd25b63af40 1 --2- 172.21.15.114:0/3301922832 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd244069820 0x7fd24406bce0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.890+0000 7fd25b63af40 1 --2- 172.21.15.114:0/3301922832 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565428d5070 0x5565428bc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:01.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.890+0000 7fd25b63af40 1 -- 172.21.15.114:0/3301922832 >> 172.21.15.114:0/3301922832 conn(0x5565428d7530 msgr2=0x5565428bcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:01.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.890+0000 7fd25b63af40 1 -- 172.21.15.114:0/3301922832 shutdown_connections 2023-11-04T01:39:01.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:01.890+0000 7fd25b63af40 1 -- 172.21.15.114:0/3301922832 wait complete. 2023-11-04T01:39:01.895 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete test_data_pool 2023-11-04T01:39:02.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.044+0000 7fe764753640 1 Processor -- start 2023-11-04T01:39:02.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.044+0000 7fe764753640 1 -- start start 2023-11-04T01:39:02.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.045+0000 7fe764753640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe75c0d0710 0x7fe75c0cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.045+0000 7fe764753640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe75c0cda50 0x7fe75c0b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.045+0000 7fe764753640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75c0d0280 con 0x7fe75c15e430 2023-11-04T01:39:02.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.045+0000 7fe764753640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75c0cf670 con 0x7fe75c0d0710 2023-11-04T01:39:02.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.045+0000 7fe764753640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c0cf950 con 0x7fe75c0cda50 2023-11-04T01:39:02.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.045+0000 7fe7624ef640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe75c15e430 0x7fe75c0cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60896/0 (socket says 172.21.15.114:60896) 2023-11-04T01:39:02.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.045+0000 7fe7624ef640 1 -- 172.21.15.114:0/1388587145 learned_addr learned my addr 172.21.15.114:0/1388587145 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:02.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.045+0000 7fe761cee640 1 --2- 172.21.15.114:0/1388587145 >> v2:172.21.15.114:3300/0 conn(0x7fe75c0d0710 0x7fe75c0cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.045+0000 7fe761cee640 1 -- 172.21.15.114:0/1388587145 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe75c0cda50 msgr2=0x7fe75c0b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:02.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.045+0000 7fe761cee640 1 --2- 172.21.15.114:0/1388587145 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe75c0cda50 0x7fe75c0b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.045+0000 7fe761cee640 1 -- 172.21.15.114:0/1388587145 >> v1:172.21.15.114:6789/0 conn(0x7fe75c15e430 legacy=0x7fe75c0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.045+0000 7fe761cee640 1 -- 172.21.15.114:0/1388587145 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c0cfc30 con 0x7fe75c0d0710 2023-11-04T01:39:02.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.045+0000 7fe7614ed640 1 -- 172.21.15.114:0/1388587145 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589011230 0 0) 0x7fe75c0d0280 con 0x7fe75c15e430 2023-11-04T01:39:02.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.046+0000 7fe761cee640 1 --2- 172.21.15.114:0/1388587145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe75c0d0710 0x7fe75c0cd510 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0097a0 tx=0x7fe74c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2be9dd1b617859 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.046+0000 7fe7614ed640 1 -- 172.21.15.114:0/1388587145 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c031830 con 0x7fe75c0d0710 2023-11-04T01:39:02.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.046+0000 7fe7614ed640 1 -- 172.21.15.114:0/1388587145 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c031990 con 0x7fe75c0d0710 2023-11-04T01:39:02.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.046+0000 7fe7614ed640 1 -- 172.21.15.114:0/1388587145 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c031d20 con 0x7fe75c0d0710 2023-11-04T01:39:02.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.047+0000 7fe764753640 1 -- 172.21.15.114:0/1388587145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe75c0d0710 msgr2=0x7fe75c0cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.047+0000 7fe764753640 1 --2- 172.21.15.114:0/1388587145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe75c0d0710 0x7fe75c0cd510 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0097a0 tx=0x7fe74c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.047+0000 7fe764753640 1 -- 172.21.15.114:0/1388587145 shutdown_connections 2023-11-04T01:39:02.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.047+0000 7fe764753640 1 --2- 172.21.15.114:0/1388587145 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe75c0cda50 0x7fe75c0b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.047+0000 7fe764753640 1 --2- 172.21.15.114:0/1388587145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe75c0d0710 0x7fe75c0cd510 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.047+0000 7fe764753640 1 -- 172.21.15.114:0/1388587145 >> 172.21.15.114:0/1388587145 conn(0x7fe75c06ea20 msgr2=0x7fe75c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:02.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.047+0000 7fe764753640 1 -- 172.21.15.114:0/1388587145 shutdown_connections 2023-11-04T01:39:02.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.047+0000 7fe764753640 1 -- 172.21.15.114:0/1388587145 wait complete. 2023-11-04T01:39:02.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.048+0000 7fe764753640 1 Processor -- start 2023-11-04T01:39:02.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.048+0000 7fe764753640 1 -- start start 2023-11-04T01:39:02.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.049+0000 7fe764753640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe75c0cda50 0x7fe75c15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.049+0000 7fe764753640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe75c0d0710 0x7fe75c1f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.049+0000 7fe764753640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe75c15e430 0x7fe75c15bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.049+0000 7fe764753640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c15a710 con 0x7fe75c15e430 2023-11-04T01:39:02.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.049+0000 7fe764753640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c0a8f20 con 0x7fe75c0d0710 2023-11-04T01:39:02.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.049+0000 7fe764753640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c0c5d60 con 0x7fe75c0cda50 2023-11-04T01:39:02.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.049+0000 7fe762cf0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe75c15e430 0x7fe75c15bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.049+0000 7fe762cf0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe75c15e430 0x7fe75c15bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55402/0 (socket says 172.21.15.114:55402) 2023-11-04T01:39:02.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.049+0000 7fe762cf0640 1 -- 172.21.15.114:0/3923002421 learned_addr learned my addr 172.21.15.114:0/3923002421 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:02.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.049+0000 7fe761cee640 1 --2- 172.21.15.114:0/3923002421 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe75c0d0710 0x7fe75c1f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.049+0000 7fe762cf0640 1 -- 172.21.15.114:0/3923002421 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe75c0cda50 msgr2=0x7fe75c15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.049+0000 7fe7624ef640 1 --2- 172.21.15.114:0/3923002421 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe75c0cda50 0x7fe75c15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.049+0000 7fe762cf0640 1 --2- 172.21.15.114:0/3923002421 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe75c0cda50 0x7fe75c15a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.049+0000 7fe762cf0640 1 -- 172.21.15.114:0/3923002421 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe75c0d0710 msgr2=0x7fe75c1f19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.049+0000 7fe762cf0640 1 --2- 172.21.15.114:0/3923002421 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe75c0d0710 0x7fe75c1f19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.049+0000 7fe762cf0640 1 -- 172.21.15.114:0/3923002421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c009400 con 0x7fe75c15e430 2023-11-04T01:39:02.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.050+0000 7fe762cf0640 1 --2- 172.21.15.114:0/3923002421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe75c15e430 0x7fe75c15bfe0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fe75400b970 tx=0x7fe75400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.050+0000 7fe752ffd640 1 -- 172.21.15.114:0/3923002421 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75400cb40 con 0x7fe75c15e430 2023-11-04T01:39:02.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.050+0000 7fe752ffd640 1 -- 172.21.15.114:0/3923002421 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75400ccc0 con 0x7fe75c15e430 2023-11-04T01:39:02.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.050+0000 7fe752ffd640 1 -- 172.21.15.114:0/3923002421 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754014680 con 0x7fe75c15e430 2023-11-04T01:39:02.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.050+0000 7fe764753640 1 -- 172.21.15.114:0/3923002421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c0c6040 con 0x7fe75c15e430 2023-11-04T01:39:02.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.050+0000 7fe764753640 1 -- 172.21.15.114:0/3923002421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c0c6600 con 0x7fe75c15e430 2023-11-04T01:39:02.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.051+0000 7fe764753640 1 -- 172.21.15.114:0/3923002421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c0c67f0 con 0x7fe75c15e430 2023-11-04T01:39:02.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.051+0000 7fe752ffd640 1 -- 172.21.15.114:0/3923002421 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe75401d3b0 con 0x7fe75c15e430 2023-11-04T01:39:02.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.051+0000 7fe752ffd640 1 --2- 172.21.15.114:0/3923002421 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe74006ae70 0x7fe74006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.051+0000 7fe752ffd640 1 -- 172.21.15.114:0/3923002421 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fe754089ad0 con 0x7fe75c15e430 2023-11-04T01:39:02.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.051+0000 7fe7624ef640 1 --2- 172.21.15.114:0/3923002421 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe74006ae70 0x7fe74006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.052+0000 7fe7624ef640 1 --2- 172.21.15.114:0/3923002421 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe74006ae70 0x7fe74006d330 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe758007fd0 tx=0x7fe758009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.056+0000 7fe752ffd640 1 -- 172.21.15.114:0/3923002421 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe754054670 con 0x7fe75c15e430 2023-11-04T01:39:02.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.223+0000 7fe764753640 1 -- 172.21.15.114:0/3923002421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "test_data_pool"} v 0) v1 -- 0x7fe75c074290 con 0x7fe75c15e430 2023-11-04T01:39:02.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.223+0000 7fe752ffd640 1 -- 172.21.15.114:0/3923002421 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "test_data_pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_data_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v70) v1 ==== 296+0+0 (secure 0 0 0) 0x7fe7540190a0 con 0x7fe75c15e430 2023-11-04T01:39:02.225 INFO:teuthology.orchestra.run.smithi114.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_data_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:39:02.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:02.231 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete test_metadata_pool 2023-11-04T01:39:02.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.330+0000 7f9ab2c64640 1 Processor -- start 2023-11-04T01:39:02.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.330+0000 7f9ab2c64640 1 -- start start 2023-11-04T01:39:02.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.331+0000 7f9ab2c64640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9aac15af20 0x7f9aac0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.331+0000 7f9ab2c64640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9aac0cd3b0 0x7f9aac0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.331+0000 7f9ab2c64640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aac0d01f0 con 0x7f9aac0b64c0 2023-11-04T01:39:02.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.331+0000 7f9ab2c64640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aac0cc380 con 0x7f9aac15af20 2023-11-04T01:39:02.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.331+0000 7f9ab2c64640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0cdd80 con 0x7f9aac0cd3b0 2023-11-04T01:39:02.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.331+0000 7f9aabfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9aac0b64c0 0x7f9aac0cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60902/0 (socket says 172.21.15.114:60902) 2023-11-04T01:39:02.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.331+0000 7f9aabfff640 1 -- 172.21.15.114:0/3247589342 learned_addr learned my addr 172.21.15.114:0/3247589342 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:02.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.331+0000 7f9ab0a00640 1 --2- 172.21.15.114:0/3247589342 >> v2:172.21.15.141:3300/0 conn(0x7f9aac15af20 0x7f9aac0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.331+0000 7f9ab1201640 1 --2- 172.21.15.114:0/3247589342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9aac0cd3b0 0x7f9aac0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.332+0000 7f9aab7fe640 1 -- 172.21.15.114:0/3247589342 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794181111 0 0) 0x7f9aac0d01f0 con 0x7f9aac0b64c0 2023-11-04T01:39:02.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.332+0000 7f9aab7fe640 1 -- 172.21.15.114:0/3247589342 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a94003520 con 0x7f9aac0b64c0 2023-11-04T01:39:02.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.332+0000 7f9ab0a00640 1 -- 172.21.15.114:0/3247589342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9aac0cd3b0 msgr2=0x7f9aac0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:02.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.332+0000 7f9ab0a00640 1 --2- 172.21.15.114:0/3247589342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9aac0cd3b0 0x7f9aac0cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.332+0000 7f9ab0a00640 1 -- 172.21.15.114:0/3247589342 >> v1:172.21.15.114:6789/0 conn(0x7f9aac0b64c0 legacy=0x7f9aac0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.332+0000 7f9ab0a00640 1 -- 172.21.15.114:0/3247589342 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac0b6a40 con 0x7f9aac15af20 2023-11-04T01:39:02.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.333+0000 7f9ab0a00640 1 --2- 172.21.15.114:0/3247589342 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9aac15af20 0x7f9aac0b3cd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009dc0 tx=0x7f9a9c02be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6a512468414c88a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.333+0000 7f9aab7fe640 1 -- 172.21.15.114:0/3247589342 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c02cc40 con 0x7f9aac15af20 2023-11-04T01:39:02.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.333+0000 7f9aab7fe640 1 -- 172.21.15.114:0/3247589342 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c02cda0 con 0x7f9aac15af20 2023-11-04T01:39:02.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.333+0000 7f9aab7fe640 1 -- 172.21.15.114:0/3247589342 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c034640 con 0x7f9aac15af20 2023-11-04T01:39:02.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.333+0000 7f9ab2c64640 1 -- 172.21.15.114:0/3247589342 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9aac15af20 msgr2=0x7f9aac0b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.333+0000 7f9ab2c64640 1 --2- 172.21.15.114:0/3247589342 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9aac15af20 0x7f9aac0b3cd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009dc0 tx=0x7f9a9c02be90 comp rx=0 tx=0).stop 2023-11-04T01:39:02.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.333+0000 7f9ab2c64640 1 -- 172.21.15.114:0/3247589342 shutdown_connections 2023-11-04T01:39:02.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.333+0000 7f9ab2c64640 1 --2- 172.21.15.114:0/3247589342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9aac0cd3b0 0x7f9aac0cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.333+0000 7f9ab2c64640 1 --2- 172.21.15.114:0/3247589342 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9aac15af20 0x7f9aac0b3cd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.334+0000 7f9ab2c64640 1 -- 172.21.15.114:0/3247589342 >> 172.21.15.114:0/3247589342 conn(0x7f9aac06ea20 msgr2=0x7f9aac06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:02.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.334+0000 7f9ab2c64640 1 -- 172.21.15.114:0/3247589342 shutdown_connections 2023-11-04T01:39:02.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.334+0000 7f9ab2c64640 1 -- 172.21.15.114:0/3247589342 wait complete. 2023-11-04T01:39:02.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.335+0000 7f9ab2c64640 1 Processor -- start 2023-11-04T01:39:02.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.335+0000 7f9ab2c64640 1 -- start start 2023-11-04T01:39:02.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab2c64640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aac0b64c0 0x7f9aac13dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab2c64640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9aac0cd3b0 0x7f9aac0c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab2c64640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9aac15af20 0x7f9aac0c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab2c64640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac140b80 con 0x7f9aac0b64c0 2023-11-04T01:39:02.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab2c64640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0b4310 con 0x7f9aac0cd3b0 2023-11-04T01:39:02.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab2c64640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0b45f0 con 0x7f9aac15af20 2023-11-04T01:39:02.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aac0b64c0 0x7f9aac13dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aac0b64c0 0x7f9aac13dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55404/0 (socket says 172.21.15.114:55404) 2023-11-04T01:39:02.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab0a00640 1 -- 172.21.15.114:0/3881377864 learned_addr learned my addr 172.21.15.114:0/3881377864 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:02.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab1201640 1 --2- 172.21.15.114:0/3881377864 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9aac15af20 0x7f9aac0c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9aabfff640 1 --2- 172.21.15.114:0/3881377864 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9aac0cd3b0 0x7f9aac0c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab0a00640 1 -- 172.21.15.114:0/3881377864 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9aac15af20 msgr2=0x7f9aac0c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab0a00640 1 --2- 172.21.15.114:0/3881377864 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9aac15af20 0x7f9aac0c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab0a00640 1 -- 172.21.15.114:0/3881377864 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9aac0cd3b0 msgr2=0x7f9aac0c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab0a00640 1 --2- 172.21.15.114:0/3881377864 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9aac0cd3b0 0x7f9aac0c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab0a00640 1 -- 172.21.15.114:0/3881377864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c009a70 con 0x7f9aac0b64c0 2023-11-04T01:39:02.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9aabfff640 1 --2- 172.21.15.114:0/3881377864 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9aac0cd3b0 0x7f9aac0c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:02.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab0a00640 1 --2- 172.21.15.114:0/3881377864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aac0b64c0 0x7f9aac13dc00 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009ee0 tx=0x7f9a9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9aa97fa640 1 -- 172.21.15.114:0/3881377864 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c004880 con 0x7f9aac0b64c0 2023-11-04T01:39:02.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9aa97fa640 1 -- 172.21.15.114:0/3881377864 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c009450 con 0x7f9aac0b64c0 2023-11-04T01:39:02.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab2c64640 1 -- 172.21.15.114:0/3881377864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aac0b48d0 con 0x7f9aac0b64c0 2023-11-04T01:39:02.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9aa97fa640 1 -- 172.21.15.114:0/3881377864 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c034640 con 0x7f9aac0b64c0 2023-11-04T01:39:02.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.336+0000 7f9ab2c64640 1 -- 172.21.15.114:0/3881377864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aac13e140 con 0x7f9aac0b64c0 2023-11-04T01:39:02.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.337+0000 7f9ab2c64640 1 -- 172.21.15.114:0/3881377864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aac0b4df0 con 0x7f9aac0b64c0 2023-11-04T01:39:02.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.338+0000 7f9aa97fa640 1 -- 172.21.15.114:0/3881377864 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a9c03b030 con 0x7f9aac0b64c0 2023-11-04T01:39:02.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.338+0000 7f9aa97fa640 1 --2- 172.21.15.114:0/3881377864 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9a9806ae70 0x7f9a9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.338+0000 7f9aa97fa640 1 -- 172.21.15.114:0/3881377864 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f9a9c0ac070 con 0x7f9aac0b64c0 2023-11-04T01:39:02.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.338+0000 7f9aabfff640 1 --2- 172.21.15.114:0/3881377864 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9a9806ae70 0x7f9a9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.338+0000 7f9aabfff640 1 --2- 172.21.15.114:0/3881377864 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9a9806ae70 0x7f9a9806d330 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9aac1f3df0 tx=0x7f9aa0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.342+0000 7f9aa97fa640 1 -- 172.21.15.114:0/3881377864 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9aac0b4df0 con 0x7f9aac0b64c0 2023-11-04T01:39:02.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.510+0000 7f9ab2c64640 1 -- 172.21.15.114:0/3881377864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "test_metadata_pool"} v 0) v1 -- 0x7f9aac0b4df0 con 0x7f9aac0b64c0 2023-11-04T01:39:02.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.511+0000 7f9aa97fa640 1 -- 172.21.15.114:0/3881377864 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "test_metadata_pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_metadata_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v70) v1 ==== 304+0+0 (secure 0 0 0) 0x7f9aac0b4df0 con 0x7f9aac0b64c0 2023-11-04T01:39:02.514 INFO:teuthology.orchestra.run.smithi114.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_metadata_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:39:02.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:02.517 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:39:02.517 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:39:02.555 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:39:02.598 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:39:02.598 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:39:02.598 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:02.614 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:02.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.751+0000 7f945287c640 1 Processor -- start 2023-11-04T01:39:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.751+0000 7f945287c640 1 -- start start 2023-11-04T01:39:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.751+0000 7f945287c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f944c15ad80 0x7f944c06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.751+0000 7f945287c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f944c0c9e10 0x7f944c0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.751+0000 7f945287c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f944c06cd00 con 0x7f944c0b42c0 2023-11-04T01:39:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.751+0000 7f945287c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f944c06cfa0 con 0x7f944c15ad80 2023-11-04T01:39:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.751+0000 7f945287c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f944c06d280 con 0x7f944c0c9e10 2023-11-04T01:39:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.752+0000 7f944bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f944c15ad80 0x7f944c06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.752+0000 7f944b7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f944c0b42c0 0x7f944c0c9700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60906/0 (socket says 172.21.15.114:60906) 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.752+0000 7f944b7fe640 1 -- 172.21.15.114:0/3942789177 learned_addr learned my addr 172.21.15.114:0/3942789177 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.752+0000 7f944bfff640 1 -- 172.21.15.114:0/3942789177 >> v2:172.21.15.141:3300/0 conn(0x7f944c0c9e10 msgr2=0x7f944c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.752+0000 7f9450e19640 1 --2- 172.21.15.114:0/3942789177 >> v2:172.21.15.141:3300/0 conn(0x7f944c0c9e10 0x7f944c0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.752+0000 7f944affd640 1 -- 172.21.15.114:0/3942789177 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133387562 0 0) 0x7f944c06cd00 con 0x7f944c0b42c0 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.752+0000 7f944bfff640 1 --2- 172.21.15.114:0/3942789177 >> v2:172.21.15.141:3300/0 conn(0x7f944c0c9e10 0x7f944c0b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.752+0000 7f944bfff640 1 -- 172.21.15.114:0/3942789177 >> v1:172.21.15.114:6789/0 conn(0x7f944c0b42c0 legacy=0x7f944c0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.752+0000 7f944bfff640 1 -- 172.21.15.114:0/3942789177 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c06d560 con 0x7f944c15ad80 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.753+0000 7f944bfff640 1 --2- 172.21.15.114:0/3942789177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944c15ad80 0x7f944c06c7c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f944c06c270 tx=0x7f943c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa8a3da9299e770 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.753+0000 7f944affd640 1 -- 172.21.15.114:0/3942789177 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c030610 con 0x7f944c15ad80 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.753+0000 7f944affd640 1 -- 172.21.15.114:0/3942789177 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c030770 con 0x7f944c15ad80 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.753+0000 7f944affd640 1 -- 172.21.15.114:0/3942789177 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c030b00 con 0x7f944c15ad80 2023-11-04T01:39:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.753+0000 7f945287c640 1 -- 172.21.15.114:0/3942789177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944c15ad80 msgr2=0x7f944c06c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.753+0000 7f945287c640 1 --2- 172.21.15.114:0/3942789177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944c15ad80 0x7f944c06c7c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f944c06c270 tx=0x7f943c02b960 comp rx=0 tx=0).stop 2023-11-04T01:39:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.753+0000 7f945287c640 1 -- 172.21.15.114:0/3942789177 shutdown_connections 2023-11-04T01:39:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.753+0000 7f945287c640 1 --2- 172.21.15.114:0/3942789177 >> v2:172.21.15.141:3300/0 conn(0x7f944c0c9e10 0x7f944c0b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.753+0000 7f945287c640 1 --2- 172.21.15.114:0/3942789177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944c15ad80 0x7f944c06c7c0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.753+0000 7f945287c640 1 -- 172.21.15.114:0/3942789177 >> 172.21.15.114:0/3942789177 conn(0x7f944c0ce950 msgr2=0x7f944c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.753+0000 7f945287c640 1 -- 172.21.15.114:0/3942789177 shutdown_connections 2023-11-04T01:39:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.753+0000 7f945287c640 1 -- 172.21.15.114:0/3942789177 wait complete. 2023-11-04T01:39:02.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.754+0000 7f945287c640 1 Processor -- start 2023-11-04T01:39:02.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.755+0000 7f945287c640 1 -- start start 2023-11-04T01:39:02.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.755+0000 7f945287c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f944c0b42c0 0x7f944c0c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.755+0000 7f945287c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944c0c9e10 0x7f944c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.755+0000 7f945287c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f944c15ad80 0x7f944c0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.755+0000 7f945287c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c1f6b80 con 0x7f944c0c9e10 2023-11-04T01:39:02.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.755+0000 7f945287c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c149d40 con 0x7f944c15ad80 2023-11-04T01:39:02.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.755+0000 7f945287c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c15e220 con 0x7f944c0b42c0 2023-11-04T01:39:02.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.755+0000 7f944b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944c0c9e10 0x7f944c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.755+0000 7f944b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944c0c9e10 0x7f944c0afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55416/0 (socket says 172.21.15.114:55416) 2023-11-04T01:39:02.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.755+0000 7f944b7fe640 1 -- 172.21.15.114:0/884234130 learned_addr learned my addr 172.21.15.114:0/884234130 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:02.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.756+0000 7f944b7fe640 1 -- 172.21.15.114:0/884234130 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f944c0b42c0 msgr2=0x7f944c0c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.756+0000 7f944b7fe640 1 --2- 172.21.15.114:0/884234130 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f944c0b42c0 0x7f944c0c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.756+0000 7f944b7fe640 1 -- 172.21.15.114:0/884234130 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f944c15ad80 msgr2=0x7f944c0b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.756+0000 7f9450e19640 1 --2- 172.21.15.114:0/884234130 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f944c15ad80 0x7f944c0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.756+0000 7f944b7fe640 1 --2- 172.21.15.114:0/884234130 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f944c15ad80 0x7f944c0b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.756+0000 7f944b7fe640 1 -- 172.21.15.114:0/884234130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c009400 con 0x7f944c0c9e10 2023-11-04T01:39:02.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.756+0000 7f944b7fe640 1 --2- 172.21.15.114:0/884234130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944c0c9e10 0x7f944c0afd80 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f944000c500 tx=0x7f944000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.756+0000 7f9448ff9640 1 -- 172.21.15.114:0/884234130 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440007560 con 0x7f944c0c9e10 2023-11-04T01:39:02.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.756+0000 7f9448ff9640 1 -- 172.21.15.114:0/884234130 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94400047e0 con 0x7f944c0c9e10 2023-11-04T01:39:02.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.756+0000 7f945287c640 1 -- 172.21.15.114:0/884234130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944c15dd90 con 0x7f944c0c9e10 2023-11-04T01:39:02.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.756+0000 7f9448ff9640 1 -- 172.21.15.114:0/884234130 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440004b90 con 0x7f944c0c9e10 2023-11-04T01:39:02.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.756+0000 7f945287c640 1 -- 172.21.15.114:0/884234130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944c15d200 con 0x7f944c0c9e10 2023-11-04T01:39:02.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.757+0000 7f945287c640 1 -- 172.21.15.114:0/884234130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944c074290 con 0x7f944c0c9e10 2023-11-04T01:39:02.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.757+0000 7f9448ff9640 1 -- 172.21.15.114:0/884234130 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9440004cf0 con 0x7f944c0c9e10 2023-11-04T01:39:02.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.758+0000 7f9448ff9640 1 --2- 172.21.15.114:0/884234130 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f943806ae70 0x7f943806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:02.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.758+0000 7f9448ff9640 1 -- 172.21.15.114:0/884234130 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f9440089030 con 0x7f944c0c9e10 2023-11-04T01:39:02.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.758+0000 7f944bfff640 1 --2- 172.21.15.114:0/884234130 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f943806ae70 0x7f943806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:02.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.758+0000 7f944bfff640 1 --2- 172.21.15.114:0/884234130 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f943806ae70 0x7f943806d330 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f943c036000 tx=0x7f943c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:02.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.762+0000 7f9448ff9640 1 -- 172.21.15.114:0/884234130 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9440053bd0 con 0x7f944c0c9e10 2023-11-04T01:39:02.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.934+0000 7f945287c640 1 -- 172.21.15.114:0/884234130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f944c0b4880 con 0x7f944c0c9e10 2023-11-04T01:39:02.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.935+0000 7f9448ff9640 1 -- 172.21.15.114:0/884234130 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+22161 (secure 0 0 0) 0x7f94400571f0 con 0x7f944c0c9e10 2023-11-04T01:39:02.937 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:02.938 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":70,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:01.886258+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:48.665033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:49.137709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:02.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.937+0000 7f945287c640 1 -- 172.21.15.114:0/884234130 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f943806ae70 msgr2=0x7f943806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.937+0000 7f945287c640 1 --2- 172.21.15.114:0/884234130 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f943806ae70 0x7f943806d330 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f943c036000 tx=0x7f943c030000 comp rx=0 tx=0).stop 2023-11-04T01:39:02.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.937+0000 7f945287c640 1 -- 172.21.15.114:0/884234130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944c0c9e10 msgr2=0x7f944c0afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:02.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.937+0000 7f945287c640 1 --2- 172.21.15.114:0/884234130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944c0c9e10 0x7f944c0afd80 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f944000c500 tx=0x7f944000c9c0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.937+0000 7f945287c640 1 -- 172.21.15.114:0/884234130 shutdown_connections 2023-11-04T01:39:02.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.937+0000 7f945287c640 1 --2- 172.21.15.114:0/884234130 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f943806ae70 0x7f943806d330 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.937+0000 7f945287c640 1 --2- 172.21.15.114:0/884234130 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f944c15ad80 0x7f944c0b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.937+0000 7f945287c640 1 --2- 172.21.15.114:0/884234130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944c0c9e10 0x7f944c0afd80 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.937+0000 7f945287c640 1 --2- 172.21.15.114:0/884234130 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f944c0b42c0 0x7f944c0c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:02.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.937+0000 7f945287c640 1 -- 172.21.15.114:0/884234130 >> 172.21.15.114:0/884234130 conn(0x7f944c0ce950 msgr2=0x7f944c0b3610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:02.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.938+0000 7f945287c640 1 -- 172.21.15.114:0/884234130 shutdown_connections 2023-11-04T01:39:02.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:02.938+0000 7f945287c640 1 -- 172.21.15.114:0/884234130 wait complete. 2023-11-04T01:39:02.950 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:38:48.665033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:38:49.137709+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:58.316710+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:59.185397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:02.950 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:03.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.051+0000 7f5ef8e89640 1 Processor -- start 2023-11-04T01:39:03.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.051+0000 7f5ef8e89640 1 -- start start 2023-11-04T01:39:03.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.052+0000 7f5ef8e89640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5ef4160430 0x7f5ef40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.052+0000 7f5ef8e89640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5ef406c3a0 0x7f5ef40cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.052+0000 7f5ef8e89640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef40b2fc0 con 0x7f5ef40b2b60 2023-11-04T01:39:03.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.052+0000 7f5ef8e89640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef40cb580 con 0x7f5ef406c3a0 2023-11-04T01:39:03.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.052+0000 7f5ef8e89640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef406c7d0 con 0x7f5ef4160430 2023-11-04T01:39:03.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.052+0000 7f5ef2d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5ef406c3a0 0x7f5ef40cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.052+0000 7f5ef1d9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5ef40b2b60 0x7f5ef406bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60910/0 (socket says 172.21.15.114:60910) 2023-11-04T01:39:03.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.052+0000 7f5ef2d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5ef406c3a0 0x7f5ef40cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55430/0 (socket says 172.21.15.114:55430) 2023-11-04T01:39:03.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.052+0000 7f5ef1d9b640 1 -- 172.21.15.114:0/1520524836 learned_addr learned my addr 172.21.15.114:0/1520524836 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:03.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.052+0000 7f5ef2d9d640 1 -- 172.21.15.114:0/1520524836 >> v2:172.21.15.141:3300/0 conn(0x7f5ef4160430 msgr2=0x7f5ef40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:03.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.052+0000 7f5ef259c640 1 --2- 172.21.15.114:0/1520524836 >> v2:172.21.15.141:3300/0 conn(0x7f5ef4160430 0x7f5ef40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.052+0000 7f5ef2d9d640 1 --2- 172.21.15.114:0/1520524836 >> v2:172.21.15.141:3300/0 conn(0x7f5ef4160430 0x7f5ef40b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.052+0000 7f5ef159a640 1 -- 172.21.15.114:0/1520524836 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495708513 0 0) 0x7f5ef40b2fc0 con 0x7f5ef40b2b60 2023-11-04T01:39:03.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.052+0000 7f5ef2d9d640 1 -- 172.21.15.114:0/1520524836 >> v1:172.21.15.114:6789/0 conn(0x7f5ef40b2b60 legacy=0x7f5ef406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.052+0000 7f5ef2d9d640 1 -- 172.21.15.114:0/1520524836 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef406ca40 con 0x7f5ef406c3a0 2023-11-04T01:39:03.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.052+0000 7f5ef259c640 1 --2- 172.21.15.114:0/1520524836 >> v2:172.21.15.141:3300/0 conn(0x7f5ef4160430 0x7f5ef40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:03.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.053+0000 7f5ef2d9d640 1 --2- 172.21.15.114:0/1520524836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ef406c3a0 0x7f5ef40cbcb0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f5ef406f6d0 tx=0x7f5eec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67815e8b1ef58b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.053+0000 7f5ef159a640 1 -- 172.21.15.114:0/1520524836 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec031830 con 0x7f5ef406c3a0 2023-11-04T01:39:03.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.053+0000 7f5ef159a640 1 -- 172.21.15.114:0/1520524836 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec031990 con 0x7f5ef406c3a0 2023-11-04T01:39:03.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.053+0000 7f5ef159a640 1 -- 172.21.15.114:0/1520524836 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec031d20 con 0x7f5ef406c3a0 2023-11-04T01:39:03.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.054+0000 7f5ef8e89640 1 -- 172.21.15.114:0/1520524836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ef406c3a0 msgr2=0x7f5ef40cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.054+0000 7f5ef8e89640 1 --2- 172.21.15.114:0/1520524836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ef406c3a0 0x7f5ef40cbcb0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f5ef406f6d0 tx=0x7f5eec02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.054+0000 7f5ef8e89640 1 -- 172.21.15.114:0/1520524836 shutdown_connections 2023-11-04T01:39:03.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.054+0000 7f5ef8e89640 1 --2- 172.21.15.114:0/1520524836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ef406c3a0 0x7f5ef40cbcb0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.054+0000 7f5ef8e89640 1 --2- 172.21.15.114:0/1520524836 >> v2:172.21.15.141:3300/0 conn(0x7f5ef4160430 0x7f5ef40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.054+0000 7f5ef8e89640 1 -- 172.21.15.114:0/1520524836 >> 172.21.15.114:0/1520524836 conn(0x7f5ef406ea20 msgr2=0x7f5ef406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.054+0000 7f5ef8e89640 1 -- 172.21.15.114:0/1520524836 shutdown_connections 2023-11-04T01:39:03.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.054+0000 7f5ef8e89640 1 -- 172.21.15.114:0/1520524836 wait complete. 2023-11-04T01:39:03.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.055+0000 7f5ef8e89640 1 Processor -- start 2023-11-04T01:39:03.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.055+0000 7f5ef8e89640 1 -- start start 2023-11-04T01:39:03.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.056+0000 7f5ef8e89640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ef406c3a0 0x7f5ef40c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.056+0000 7f5ef8e89640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ef40b2b60 0x7f5ef40c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.056+0000 7f5ef8e89640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ef4160430 0x7f5ef41f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.056+0000 7f5ef8e89640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef41f2620 con 0x7f5ef4160430 2023-11-04T01:39:03.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.056+0000 7f5ef8e89640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40c7c70 con 0x7f5ef406c3a0 2023-11-04T01:39:03.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.056+0000 7f5ef8e89640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40c84d0 con 0x7f5ef40b2b60 2023-11-04T01:39:03.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.056+0000 7f5ef2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ef4160430 0x7f5ef41f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.056+0000 7f5ef2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ef4160430 0x7f5ef41f20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55444/0 (socket says 172.21.15.114:55444) 2023-11-04T01:39:03.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.056+0000 7f5ef2d9d640 1 -- 172.21.15.114:0/70556756 learned_addr learned my addr 172.21.15.114:0/70556756 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:03.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.056+0000 7f5ef2d9d640 1 -- 172.21.15.114:0/70556756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ef40b2b60 msgr2=0x7f5ef40c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.056+0000 7f5ef2d9d640 1 --2- 172.21.15.114:0/70556756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ef40b2b60 0x7f5ef40c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.056+0000 7f5ef2d9d640 1 -- 172.21.15.114:0/70556756 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ef406c3a0 msgr2=0x7f5ef40c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.056+0000 7f5ef2d9d640 1 --2- 172.21.15.114:0/70556756 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ef406c3a0 0x7f5ef40c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.056+0000 7f5ef2d9d640 1 -- 172.21.15.114:0/70556756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec009400 con 0x7f5ef4160430 2023-11-04T01:39:03.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.057+0000 7f5ef2d9d640 1 --2- 172.21.15.114:0/70556756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ef4160430 0x7f5ef41f20e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f5eec02bee0 tx=0x7f5eec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.057+0000 7f5ee2ffd640 1 -- 172.21.15.114:0/70556756 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec03b9f0 con 0x7f5ef4160430 2023-11-04T01:39:03.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.057+0000 7f5ee2ffd640 1 -- 172.21.15.114:0/70556756 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec03bb70 con 0x7f5ef4160430 2023-11-04T01:39:03.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.057+0000 7f5ef8e89640 1 -- 172.21.15.114:0/70556756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef40c9e30 con 0x7f5ef4160430 2023-11-04T01:39:03.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.057+0000 7f5ee2ffd640 1 -- 172.21.15.114:0/70556756 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec045400 con 0x7f5ef4160430 2023-11-04T01:39:03.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.057+0000 7f5ef8e89640 1 -- 172.21.15.114:0/70556756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef40c8160 con 0x7f5ef4160430 2023-11-04T01:39:03.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.058+0000 7f5ef8e89640 1 -- 172.21.15.114:0/70556756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef4074290 con 0x7f5ef4160430 2023-11-04T01:39:03.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.058+0000 7f5ee2ffd640 1 -- 172.21.15.114:0/70556756 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5eec04e440 con 0x7f5ef4160430 2023-11-04T01:39:03.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.058+0000 7f5ee2ffd640 1 --2- 172.21.15.114:0/70556756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5ed406ae70 0x7f5ed406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.059+0000 7f5ee2ffd640 1 -- 172.21.15.114:0/70556756 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f5eec0abe70 con 0x7f5ef4160430 2023-11-04T01:39:03.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.059+0000 7f5ef259c640 1 --2- 172.21.15.114:0/70556756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5ed406ae70 0x7f5ed406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.059+0000 7f5ef259c640 1 --2- 172.21.15.114:0/70556756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5ed406ae70 0x7f5ed406d330 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4008e00 tx=0x7f5ee4008330 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.063+0000 7f5ee2ffd640 1 -- 172.21.15.114:0/70556756 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5eec076a10 con 0x7f5ef4160430 2023-11-04T01:39:03.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.230+0000 7f5ef8e89640 1 -- 172.21.15.114:0/70556756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ef40c8640 con 0x7f5ef4160430 2023-11-04T01:39:03.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.230+0000 7f5ee2ffd640 1 -- 172.21.15.114:0/70556756 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5eec07a030 con 0x7f5ef4160430 2023-11-04T01:39:03.232 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:39:03.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.232+0000 7f5ef8e89640 1 -- 172.21.15.114:0/70556756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5ed406ae70 msgr2=0x7f5ed406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.232+0000 7f5ef8e89640 1 --2- 172.21.15.114:0/70556756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5ed406ae70 0x7f5ed406d330 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4008e00 tx=0x7f5ee4008330 comp rx=0 tx=0).stop 2023-11-04T01:39:03.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.232+0000 7f5ef8e89640 1 -- 172.21.15.114:0/70556756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ef4160430 msgr2=0x7f5ef41f20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.232+0000 7f5ef8e89640 1 --2- 172.21.15.114:0/70556756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ef4160430 0x7f5ef41f20e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f5eec02bee0 tx=0x7f5eec0046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.232+0000 7f5ef8e89640 1 -- 172.21.15.114:0/70556756 shutdown_connections 2023-11-04T01:39:03.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.232+0000 7f5ef8e89640 1 --2- 172.21.15.114:0/70556756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ef4160430 0x7f5ef41f20e0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.232+0000 7f5ef8e89640 1 --2- 172.21.15.114:0/70556756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ef40b2b60 0x7f5ef40c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.232+0000 7f5ef8e89640 1 --2- 172.21.15.114:0/70556756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5ed406ae70 0x7f5ed406d330 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.232+0000 7f5ef8e89640 1 --2- 172.21.15.114:0/70556756 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ef406c3a0 0x7f5ef40c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.232+0000 7f5ef8e89640 1 -- 172.21.15.114:0/70556756 >> 172.21.15.114:0/70556756 conn(0x7f5ef406ea20 msgr2=0x7f5ef40d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.232+0000 7f5ef8e89640 1 -- 172.21.15.114:0/70556756 shutdown_connections 2023-11-04T01:39:03.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.232+0000 7f5ef8e89640 1 -- 172.21.15.114:0/70556756 wait complete. 2023-11-04T01:39:03.244 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:39:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.344+0000 7f3a299e2640 1 Processor -- start 2023-11-04T01:39:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.344+0000 7f3a299e2640 1 -- start start 2023-11-04T01:39:03.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.345+0000 7f3a299e2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3a240b2d30 0x7f3a2406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.345+0000 7f3a299e2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2406ca40 con 0x7f3a24160430 2023-11-04T01:39:03.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.345+0000 7f3a299e2640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2406cd20 con 0x7f3a2406c1d0 2023-11-04T01:39:03.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.345+0000 7f3a299e2640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a240cb580 con 0x7f3a240b2d30 2023-11-04T01:39:03.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.345+0000 7f3a22ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3a24160430 0x7f3a240b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60916/0 (socket says 172.21.15.114:60916) 2023-11-04T01:39:03.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.345+0000 7f3a22ffd640 1 -- 172.21.15.114:0/622684156 learned_addr learned my addr 172.21.15.114:0/622684156 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:03.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.345+0000 7f3a227fc640 1 --2- 172.21.15.114:0/622684156 >> v2:172.21.15.141:3300/0 conn(0x7f3a240b2d30 0x7f3a2406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.345+0000 7f3a21ffb640 1 -- 172.21.15.114:0/622684156 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195545149 0 0) 0x7f3a2406ca40 con 0x7f3a24160430 2023-11-04T01:39:03.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.345+0000 7f3a21ffb640 1 -- 172.21.15.114:0/622684156 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a0c003520 con 0x7f3a24160430 2023-11-04T01:39:03.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a21ffb640 1 -- 172.21.15.114:0/622684156 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 741078560 0 0) 0x7f3a0c003520 con 0x7f3a24160430 2023-11-04T01:39:03.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a21ffb640 1 -- 172.21.15.114:0/622684156 >> v2:172.21.15.141:3300/0 conn(0x7f3a240b2d30 msgr2=0x7f3a2406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:03.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a21ffb640 1 --2- 172.21.15.114:0/622684156 >> v2:172.21.15.141:3300/0 conn(0x7f3a240b2d30 0x7f3a2406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a21ffb640 1 -- 172.21.15.114:0/622684156 >> v1:172.21.15.141:6789/0 conn(0x7f3a2406c1d0 legacy=0x7f3a240cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a21ffb640 1 -- 172.21.15.114:0/622684156 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2406d000 con 0x7f3a24160430 2023-11-04T01:39:03.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a21ffb640 1 -- 172.21.15.114:0/622684156 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f3a14001670 con 0x7f3a24160430 2023-11-04T01:39:03.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a21ffb640 1 -- 172.21.15.114:0/622684156 >> v1:172.21.15.114:6789/0 conn(0x7f3a24160430 legacy=0x7f3a240b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a21ffb640 1 --2- 172.21.15.114:0/622684156 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a0c003970 0x7f3a0c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a21ffb640 1 --2- 172.21.15.114:0/622684156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c0047c0 0x7f3a0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a21ffb640 1 --2- 172.21.15.114:0/622684156 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3a0c005180 0x7f3a0c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a21ffb640 1 -- 172.21.15.114:0/622684156 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a240cb580 con 0x7f3a0c0047c0 2023-11-04T01:39:03.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a21ffb640 1 -- 172.21.15.114:0/622684156 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c00c020 con 0x7f3a0c005180 2023-11-04T01:39:03.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a21ffb640 1 -- 172.21.15.114:0/622684156 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c00c1e0 con 0x7f3a0c003970 2023-11-04T01:39:03.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a227fc640 1 --2- 172.21.15.114:0/622684156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c0047c0 0x7f3a0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a237fe640 1 --2- 172.21.15.114:0/622684156 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3a0c005180 0x7f3a0c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a22ffd640 1 --2- 172.21.15.114:0/622684156 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a0c003970 0x7f3a0c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a227fc640 1 -- 172.21.15.114:0/622684156 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a0c003970 msgr2=0x7f3a0c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:03.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a227fc640 1 --2- 172.21.15.114:0/622684156 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a0c003970 0x7f3a0c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a227fc640 1 -- 172.21.15.114:0/622684156 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3a0c005180 msgr2=0x7f3a0c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:03.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a227fc640 1 --2- 172.21.15.114:0/622684156 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3a0c005180 0x7f3a0c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a237fe640 1 -- 172.21.15.114:0/622684156 reap_dead start 2023-11-04T01:39:03.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a227fc640 1 -- 172.21.15.114:0/622684156 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c003520 con 0x7f3a0c0047c0 2023-11-04T01:39:03.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.346+0000 7f3a22ffd640 1 --2- 172.21.15.114:0/622684156 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a0c003970 0x7f3a0c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.347+0000 7f3a227fc640 1 --2- 172.21.15.114:0/622684156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c0047c0 0x7f3a0c004c40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009ac0 tx=0x7f3a0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4abf2ae171a786 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.347+0000 7f3a21ffb640 1 -- 172.21.15.114:0/622684156 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1802c6b0 con 0x7f3a0c0047c0 2023-11-04T01:39:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.347+0000 7f3a21ffb640 1 -- 172.21.15.114:0/622684156 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1802c810 con 0x7f3a0c0047c0 2023-11-04T01:39:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.347+0000 7f3a21ffb640 1 -- 172.21.15.114:0/622684156 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1802cba0 con 0x7f3a0c0047c0 2023-11-04T01:39:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.347+0000 7f3a299e2640 1 -- 172.21.15.114:0/622684156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c0047c0 msgr2=0x7f3a0c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.347+0000 7f3a299e2640 1 --2- 172.21.15.114:0/622684156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c0047c0 0x7f3a0c004c40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009ac0 tx=0x7f3a0c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.347+0000 7f3a299e2640 1 -- 172.21.15.114:0/622684156 shutdown_connections 2023-11-04T01:39:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.347+0000 7f3a299e2640 1 --2- 172.21.15.114:0/622684156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c0047c0 0x7f3a0c004c40 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.347+0000 7f3a299e2640 1 -- 172.21.15.114:0/622684156 >> 172.21.15.114:0/622684156 conn(0x7f3a2406ea20 msgr2=0x7f3a2406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.348+0000 7f3a299e2640 1 -- 172.21.15.114:0/622684156 shutdown_connections 2023-11-04T01:39:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.348+0000 7f3a299e2640 1 -- 172.21.15.114:0/622684156 wait complete. 2023-11-04T01:39:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.349+0000 7f3a299e2640 1 Processor -- start 2023-11-04T01:39:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.349+0000 7f3a299e2640 1 -- start start 2023-11-04T01:39:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.349+0000 7f3a299e2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a0c0047c0 0x7f3a240b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.349+0000 7f3a299e2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3a240b5380 0x7f3a241f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a299e2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241f6230 0x7f3a241f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a299e2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a241f6c20 con 0x7f3a241f6230 2023-11-04T01:39:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a299e2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a240b5b60 con 0x7f3a240b5380 2023-11-04T01:39:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a299e2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a240afc40 con 0x7f3a0c0047c0 2023-11-04T01:39:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a237fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241f6230 0x7f3a241f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a237fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241f6230 0x7f3a241f66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55462/0 (socket says 172.21.15.114:55462) 2023-11-04T01:39:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a237fe640 1 -- 172.21.15.114:0/1529026847 learned_addr learned my addr 172.21.15.114:0/1529026847 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a227fc640 1 --2- 172.21.15.114:0/1529026847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3a240b5380 0x7f3a241f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a22ffd640 1 --2- 172.21.15.114:0/1529026847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a0c0047c0 0x7f3a240b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a237fe640 1 -- 172.21.15.114:0/1529026847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a0c0047c0 msgr2=0x7f3a240b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a237fe640 1 --2- 172.21.15.114:0/1529026847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a0c0047c0 0x7f3a240b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a237fe640 1 -- 172.21.15.114:0/1529026847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3a240b5380 msgr2=0x7f3a241f00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a237fe640 1 --2- 172.21.15.114:0/1529026847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3a240b5380 0x7f3a241f00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a237fe640 1 -- 172.21.15.114:0/1529026847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a240aff20 con 0x7f3a241f6230 2023-11-04T01:39:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a227fc640 1 --2- 172.21.15.114:0/1529026847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3a240b5380 0x7f3a241f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a237fe640 1 --2- 172.21.15.114:0/1529026847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241f6230 0x7f3a241f66e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f3a240ce700 tx=0x7f3a1c00fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a0bfff640 1 -- 172.21.15.114:0/1529026847 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c00feb0 con 0x7f3a241f6230 2023-11-04T01:39:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a0bfff640 1 -- 172.21.15.114:0/1529026847 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1c003b80 con 0x7f3a241f6230 2023-11-04T01:39:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a299e2640 1 -- 172.21.15.114:0/1529026847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a240b0200 con 0x7f3a241f6230 2023-11-04T01:39:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a0bfff640 1 -- 172.21.15.114:0/1529026847 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0050d0 con 0x7f3a241f6230 2023-11-04T01:39:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.350+0000 7f3a299e2640 1 -- 172.21.15.114:0/1529026847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a241f0610 con 0x7f3a241f6230 2023-11-04T01:39:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.351+0000 7f3a299e2640 1 -- 172.21.15.114:0/1529026847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a240b0720 con 0x7f3a241f6230 2023-11-04T01:39:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.352+0000 7f3a0bfff640 1 -- 172.21.15.114:0/1529026847 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a1c005230 con 0x7f3a241f6230 2023-11-04T01:39:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.352+0000 7f3a0bfff640 1 --2- 172.21.15.114:0/1529026847 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a1006aea0 0x7f3a1006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.352+0000 7f3a0bfff640 1 -- 172.21.15.114:0/1529026847 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f3a1c089af0 con 0x7f3a241f6230 2023-11-04T01:39:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.352+0000 7f3a22ffd640 1 --2- 172.21.15.114:0/1529026847 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a1006aea0 0x7f3a1006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.352+0000 7f3a22ffd640 1 --2- 172.21.15.114:0/1529026847 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a1006aea0 0x7f3a1006d360 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3a240b21f0 tx=0x7f3a14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.356+0000 7f3a0bfff640 1 -- 172.21.15.114:0/1529026847 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a240b0720 con 0x7f3a241f6230 2023-11-04T01:39:03.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.520+0000 7f3a299e2640 1 -- 172.21.15.114:0/1529026847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f3a240b0720 con 0x7f3a241f6230 2023-11-04T01:39:03.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.520+0000 7f3a0bfff640 1 -- 172.21.15.114:0/1529026847 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v70) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3a240b0720 con 0x7f3a241f6230 2023-11-04T01:39:03.522 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:03.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.522+0000 7f3a299e2640 1 -- 172.21.15.114:0/1529026847 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a1006aea0 msgr2=0x7f3a1006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.522+0000 7f3a299e2640 1 --2- 172.21.15.114:0/1529026847 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a1006aea0 0x7f3a1006d360 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3a240b21f0 tx=0x7f3a14009040 comp rx=0 tx=0).stop 2023-11-04T01:39:03.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.522+0000 7f3a299e2640 1 -- 172.21.15.114:0/1529026847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241f6230 msgr2=0x7f3a241f66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.522+0000 7f3a299e2640 1 --2- 172.21.15.114:0/1529026847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241f6230 0x7f3a241f66e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f3a240ce700 tx=0x7f3a1c00fc00 comp rx=0 tx=0).stop 2023-11-04T01:39:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.522+0000 7f3a299e2640 1 -- 172.21.15.114:0/1529026847 shutdown_connections 2023-11-04T01:39:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.522+0000 7f3a299e2640 1 --2- 172.21.15.114:0/1529026847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241f6230 0x7f3a241f66e0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.522+0000 7f3a299e2640 1 --2- 172.21.15.114:0/1529026847 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3a1006aea0 0x7f3a1006d360 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.522+0000 7f3a299e2640 1 --2- 172.21.15.114:0/1529026847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3a240b5380 0x7f3a241f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.522+0000 7f3a299e2640 1 --2- 172.21.15.114:0/1529026847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3a0c0047c0 0x7f3a240b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.522+0000 7f3a299e2640 1 -- 172.21.15.114:0/1529026847 >> 172.21.15.114:0/1529026847 conn(0x7f3a2406ea20 msgr2=0x7f3a240ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.522+0000 7f3a299e2640 1 -- 172.21.15.114:0/1529026847 shutdown_connections 2023-11-04T01:39:03.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.523+0000 7f3a299e2640 1 -- 172.21.15.114:0/1529026847 wait complete. 2023-11-04T01:39:03.535 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:39:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.635+0000 7f5f82968640 1 Processor -- start 2023-11-04T01:39:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.635+0000 7f5f82968640 1 -- start start 2023-11-04T01:39:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.636+0000 7f5f82968640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f7c15ad30 0x7f5f7c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.636+0000 7f5f82968640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5f7c070e20 0x7f5f7c15e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.636+0000 7f5f82968640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c0c3900 con 0x7f5f7c0ad730 2023-11-04T01:39:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.636+0000 7f5f82968640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7c0ae260 con 0x7f5f7c070e20 2023-11-04T01:39:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.636+0000 7f5f82968640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0c3be0 con 0x7f5f7c15ad30 2023-11-04T01:39:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.636+0000 7f5f7b7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5f7c0ad730 0x7f5f7c070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60926/0 (socket says 172.21.15.114:60926) 2023-11-04T01:39:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.636+0000 7f5f7b7fe640 1 -- 172.21.15.114:0/89059944 learned_addr learned my addr 172.21.15.114:0/89059944 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.636+0000 7f5f80f05640 1 --2- 172.21.15.114:0/89059944 >> v2:172.21.15.141:3300/0 conn(0x7f5f7c070e20 0x7f5f7c15e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.636+0000 7f5f7bfff640 1 --2- 172.21.15.114:0/89059944 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f7c15ad30 0x7f5f7c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.637+0000 7f5f7affd640 1 -- 172.21.15.114:0/89059944 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642798602 0 0) 0x7f5f7c0c3900 con 0x7f5f7c0ad730 2023-11-04T01:39:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.637+0000 7f5f7affd640 1 -- 172.21.15.114:0/89059944 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f64003520 con 0x7f5f7c0ad730 2023-11-04T01:39:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.637+0000 7f5f80f05640 1 -- 172.21.15.114:0/89059944 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f7c15ad30 msgr2=0x7f5f7c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.637+0000 7f5f80f05640 1 --2- 172.21.15.114:0/89059944 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f7c15ad30 0x7f5f7c0adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.637+0000 7f5f80f05640 1 -- 172.21.15.114:0/89059944 >> v1:172.21.15.114:6789/0 conn(0x7f5f7c0ad730 legacy=0x7f5f7c070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.637+0000 7f5f80f05640 1 -- 172.21.15.114:0/89059944 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c0c3ec0 con 0x7f5f7c070e20 2023-11-04T01:39:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.637+0000 7f5f80f05640 1 --2- 172.21.15.114:0/89059944 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f7c070e20 0x7f5f7c15e740 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009d90 tx=0x7f5f7402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb0ecc3b84cd3ef2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.638+0000 7f5f7affd640 1 -- 172.21.15.114:0/89059944 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7402cbc0 con 0x7f5f7c070e20 2023-11-04T01:39:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.638+0000 7f5f7affd640 1 -- 172.21.15.114:0/89059944 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7402cd20 con 0x7f5f7c070e20 2023-11-04T01:39:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.638+0000 7f5f7affd640 1 -- 172.21.15.114:0/89059944 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74034660 con 0x7f5f7c070e20 2023-11-04T01:39:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.638+0000 7f5f82968640 1 -- 172.21.15.114:0/89059944 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f7c070e20 msgr2=0x7f5f7c15e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.638+0000 7f5f82968640 1 --2- 172.21.15.114:0/89059944 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f7c070e20 0x7f5f7c15e740 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009d90 tx=0x7f5f7402be10 comp rx=0 tx=0).stop 2023-11-04T01:39:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.638+0000 7f5f82968640 1 -- 172.21.15.114:0/89059944 shutdown_connections 2023-11-04T01:39:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.638+0000 7f5f82968640 1 --2- 172.21.15.114:0/89059944 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f7c070e20 0x7f5f7c15e740 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.638+0000 7f5f82968640 1 --2- 172.21.15.114:0/89059944 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f7c15ad30 0x7f5f7c0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.638+0000 7f5f82968640 1 -- 172.21.15.114:0/89059944 >> 172.21.15.114:0/89059944 conn(0x7f5f7c0ce950 msgr2=0x7f5f7c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.638+0000 7f5f82968640 1 -- 172.21.15.114:0/89059944 shutdown_connections 2023-11-04T01:39:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.638+0000 7f5f82968640 1 -- 172.21.15.114:0/89059944 wait complete. 2023-11-04T01:39:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.639+0000 7f5f82968640 1 Processor -- start 2023-11-04T01:39:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.640+0000 7f5f82968640 1 -- start start 2023-11-04T01:39:03.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.640+0000 7f5f82968640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f7c070e20 0x7f5f7c15bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.640+0000 7f5f82968640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f7c0ad730 0x7f5f7c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.640+0000 7f5f82968640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f7c15ad30 0x7f5f7c155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.640+0000 7f5f82968640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c153820 con 0x7f5f7c070e20 2023-11-04T01:39:03.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.640+0000 7f5f82968640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0ab8d0 con 0x7f5f7c15ad30 2023-11-04T01:39:03.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.640+0000 7f5f82968640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0abbb0 con 0x7f5f7c0ad730 2023-11-04T01:39:03.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.640+0000 7f5f7bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f7c070e20 0x7f5f7c15bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.640+0000 7f5f7bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f7c070e20 0x7f5f7c15bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55476/0 (socket says 172.21.15.114:55476) 2023-11-04T01:39:03.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.640+0000 7f5f7bfff640 1 -- 172.21.15.114:0/2770520 learned_addr learned my addr 172.21.15.114:0/2770520 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:03.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.641+0000 7f5f80f05640 1 --2- 172.21.15.114:0/2770520 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f7c15ad30 0x7f5f7c155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.641+0000 7f5f7b7fe640 1 --2- 172.21.15.114:0/2770520 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f7c0ad730 0x7f5f7c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.641+0000 7f5f7bfff640 1 -- 172.21.15.114:0/2770520 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f7c0ad730 msgr2=0x7f5f7c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.641+0000 7f5f7bfff640 1 --2- 172.21.15.114:0/2770520 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f7c0ad730 0x7f5f7c0b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.641+0000 7f5f7bfff640 1 -- 172.21.15.114:0/2770520 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f7c15ad30 msgr2=0x7f5f7c155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.641+0000 7f5f7bfff640 1 --2- 172.21.15.114:0/2770520 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f7c15ad30 0x7f5f7c155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.641+0000 7f5f7bfff640 1 -- 172.21.15.114:0/2770520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f74009a70 con 0x7f5f7c070e20 2023-11-04T01:39:03.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.641+0000 7f5f7bfff640 1 --2- 172.21.15.114:0/2770520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f7c070e20 0x7f5f7c15bb90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00e870 tx=0x7f5f6c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.641+0000 7f5f78ff9640 1 -- 172.21.15.114:0/2770520 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c0094f0 con 0x7f5f7c070e20 2023-11-04T01:39:03.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.641+0000 7f5f78ff9640 1 -- 172.21.15.114:0/2770520 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c00c940 con 0x7f5f7c070e20 2023-11-04T01:39:03.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.641+0000 7f5f82968640 1 -- 172.21.15.114:0/2770520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c0abe90 con 0x7f5f7c070e20 2023-11-04T01:39:03.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.641+0000 7f5f78ff9640 1 -- 172.21.15.114:0/2770520 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c00ccf0 con 0x7f5f7c070e20 2023-11-04T01:39:03.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.641+0000 7f5f82968640 1 -- 172.21.15.114:0/2770520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c0ac450 con 0x7f5f7c070e20 2023-11-04T01:39:03.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.642+0000 7f5f82968640 1 -- 172.21.15.114:0/2770520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7c074290 con 0x7f5f7c070e20 2023-11-04T01:39:03.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.642+0000 7f5f78ff9640 1 -- 172.21.15.114:0/2770520 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f6c013470 con 0x7f5f7c070e20 2023-11-04T01:39:03.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.643+0000 7f5f78ff9640 1 --2- 172.21.15.114:0/2770520 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f6806ae70 0x7f5f6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.643+0000 7f5f78ff9640 1 -- 172.21.15.114:0/2770520 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f5f6c089c20 con 0x7f5f7c070e20 2023-11-04T01:39:03.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.643+0000 7f5f7b7fe640 1 --2- 172.21.15.114:0/2770520 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f6806ae70 0x7f5f6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.643+0000 7f5f7b7fe640 1 --2- 172.21.15.114:0/2770520 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f6806ae70 0x7f5f6806d330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0ce700 tx=0x7f5f70007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.647+0000 7f5f78ff9640 1 -- 172.21.15.114:0/2770520 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5f6c0547e0 con 0x7f5f7c070e20 2023-11-04T01:39:03.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.812+0000 7f5f82968640 1 -- 172.21.15.114:0/2770520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f7c071970 con 0x7f5f7c070e20 2023-11-04T01:39:03.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.812+0000 7f5f78ff9640 1 -- 172.21.15.114:0/2770520 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f6c057e00 con 0x7f5f7c070e20 2023-11-04T01:39:03.814 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.814+0000 7f5f82968640 1 -- 172.21.15.114:0/2770520 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f6806ae70 msgr2=0x7f5f6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.814+0000 7f5f82968640 1 --2- 172.21.15.114:0/2770520 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f6806ae70 0x7f5f6806d330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0ce700 tx=0x7f5f70007d30 comp rx=0 tx=0).stop 2023-11-04T01:39:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.814+0000 7f5f82968640 1 -- 172.21.15.114:0/2770520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f7c070e20 msgr2=0x7f5f7c15bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.814+0000 7f5f82968640 1 --2- 172.21.15.114:0/2770520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f7c070e20 0x7f5f7c15bb90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00e870 tx=0x7f5f6c00ed30 comp rx=0 tx=0).stop 2023-11-04T01:39:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.814+0000 7f5f82968640 1 -- 172.21.15.114:0/2770520 shutdown_connections 2023-11-04T01:39:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.814+0000 7f5f82968640 1 --2- 172.21.15.114:0/2770520 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5f6806ae70 0x7f5f6806d330 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.814+0000 7f5f82968640 1 --2- 172.21.15.114:0/2770520 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5f7c15ad30 0x7f5f7c155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.814+0000 7f5f82968640 1 --2- 172.21.15.114:0/2770520 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5f7c0ad730 0x7f5f7c0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.814+0000 7f5f82968640 1 --2- 172.21.15.114:0/2770520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f7c070e20 0x7f5f7c15bb90 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.814+0000 7f5f82968640 1 -- 172.21.15.114:0/2770520 >> 172.21.15.114:0/2770520 conn(0x7f5f7c0ce950 msgr2=0x7f5f7c0c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.814+0000 7f5f82968640 1 -- 172.21.15.114:0/2770520 shutdown_connections 2023-11-04T01:39:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.814+0000 7f5f82968640 1 -- 172.21.15.114:0/2770520 wait complete. 2023-11-04T01:39:03.826 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:39:03.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.927+0000 7fb07f8a2640 1 Processor -- start 2023-11-04T01:39:03.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.928+0000 7fb07f8a2640 1 -- start start 2023-11-04T01:39:03.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.928+0000 7fb07f8a2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0780cc520 0x7fb078070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.928+0000 7fb07f8a2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0780cc9d0 0x7fb0780714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.928+0000 7fb07f8a2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0780c3860 con 0x7fb078153850 2023-11-04T01:39:03.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.928+0000 7fb07f8a2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0780c9250 con 0x7fb0780cc520 2023-11-04T01:39:03.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.928+0000 7fb07f8a2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb078153c30 con 0x7fb0780cc9d0 2023-11-04T01:39:03.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.929+0000 7fb07ce3d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0780cc520 0x7fb078070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.929+0000 7fb07ce3d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0780cc520 0x7fb078070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55492/0 (socket says 172.21.15.114:55492) 2023-11-04T01:39:03.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.929+0000 7fb07d63e640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb078153850 0x7fb07815a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60940/0 (socket says 172.21.15.114:60940) 2023-11-04T01:39:03.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.929+0000 7fb07ce3d640 1 -- 172.21.15.114:0/3246906136 learned_addr learned my addr 172.21.15.114:0/3246906136 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:03.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.929+0000 7fb07de3f640 1 --2- 172.21.15.114:0/3246906136 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0780cc9d0 0x7fb0780714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.929+0000 7fb07ce3d640 1 -- 172.21.15.114:0/3246906136 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0780cc9d0 msgr2=0x7fb0780714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:03.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.929+0000 7fb07ce3d640 1 --2- 172.21.15.114:0/3246906136 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0780cc9d0 0x7fb0780714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.929+0000 7fb07ce3d640 1 -- 172.21.15.114:0/3246906136 >> v1:172.21.15.114:6789/0 conn(0x7fb078153850 legacy=0x7fb07815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.929+0000 7fb06ffff640 1 -- 172.21.15.114:0/3246906136 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750181589 0 0) 0x7fb0780c3860 con 0x7fb078153850 2023-11-04T01:39:03.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.929+0000 7fb07ce3d640 1 -- 172.21.15.114:0/3246906136 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0780ce590 con 0x7fb0780cc520 2023-11-04T01:39:03.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.929+0000 7fb07de3f640 1 --2- 172.21.15.114:0/3246906136 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0780cc9d0 0x7fb0780714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:03.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.930+0000 7fb07ce3d640 1 --2- 172.21.15.114:0/3246906136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0780cc520 0x7fb078070fa0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb068009870 tx=0x7fb06802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecb17eaf3f4eb6a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.930+0000 7fb06ffff640 1 -- 172.21.15.114:0/3246906136 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb068030840 con 0x7fb0780cc520 2023-11-04T01:39:03.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.930+0000 7fb06ffff640 1 -- 172.21.15.114:0/3246906136 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0680309a0 con 0x7fb0780cc520 2023-11-04T01:39:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.930+0000 7fb06ffff640 1 -- 172.21.15.114:0/3246906136 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb068030d30 con 0x7fb0780cc520 2023-11-04T01:39:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.930+0000 7fb07f8a2640 1 -- 172.21.15.114:0/3246906136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0780cc520 msgr2=0x7fb078070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.930+0000 7fb07f8a2640 1 --2- 172.21.15.114:0/3246906136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0780cc520 0x7fb078070fa0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb068009870 tx=0x7fb06802b980 comp rx=0 tx=0).stop 2023-11-04T01:39:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.930+0000 7fb07f8a2640 1 -- 172.21.15.114:0/3246906136 shutdown_connections 2023-11-04T01:39:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.930+0000 7fb07f8a2640 1 --2- 172.21.15.114:0/3246906136 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0780cc9d0 0x7fb0780714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.930+0000 7fb07f8a2640 1 --2- 172.21.15.114:0/3246906136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0780cc520 0x7fb078070fa0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.930+0000 7fb07f8a2640 1 -- 172.21.15.114:0/3246906136 >> 172.21.15.114:0/3246906136 conn(0x7fb0780ce950 msgr2=0x7fb0780ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.930+0000 7fb07f8a2640 1 -- 172.21.15.114:0/3246906136 shutdown_connections 2023-11-04T01:39:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.930+0000 7fb07f8a2640 1 -- 172.21.15.114:0/3246906136 wait complete. 2023-11-04T01:39:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.931+0000 7fb07f8a2640 1 Processor -- start 2023-11-04T01:39:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.932+0000 7fb07f8a2640 1 -- start start 2023-11-04T01:39:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.932+0000 7fb07f8a2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0780cc520 0x7fb07814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.932+0000 7fb07f8a2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0780cc9d0 0x7fb078142240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.932+0000 7fb07f8a2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb078153850 0x7fb078142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.932+0000 7fb07f8a2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0781592a0 con 0x7fb078153850 2023-11-04T01:39:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.932+0000 7fb07f8a2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0781472d0 con 0x7fb0780cc520 2023-11-04T01:39:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.932+0000 7fb07f8a2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb078146510 con 0x7fb0780cc9d0 2023-11-04T01:39:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.932+0000 7fb07de3f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb078153850 0x7fb078142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.932+0000 7fb07de3f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb078153850 0x7fb078142780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55502/0 (socket says 172.21.15.114:55502) 2023-11-04T01:39:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.932+0000 7fb07de3f640 1 -- 172.21.15.114:0/1479756261 learned_addr learned my addr 172.21.15.114:0/1479756261 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.932+0000 7fb07ce3d640 1 --2- 172.21.15.114:0/1479756261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0780cc9d0 0x7fb078142240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.932+0000 7fb07d63e640 1 --2- 172.21.15.114:0/1479756261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0780cc520 0x7fb07814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.933+0000 7fb07de3f640 1 -- 172.21.15.114:0/1479756261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0780cc9d0 msgr2=0x7fb078142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.933+0000 7fb07de3f640 1 --2- 172.21.15.114:0/1479756261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0780cc9d0 0x7fb078142240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.933+0000 7fb07de3f640 1 -- 172.21.15.114:0/1479756261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0780cc520 msgr2=0x7fb07814bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.933+0000 7fb07de3f640 1 --2- 172.21.15.114:0/1479756261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0780cc520 0x7fb07814bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.933+0000 7fb07de3f640 1 -- 172.21.15.114:0/1479756261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0680094d0 con 0x7fb078153850 2023-11-04T01:39:03.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.933+0000 7fb07ce3d640 1 --2- 172.21.15.114:0/1479756261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0780cc9d0 0x7fb078142240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:03.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.933+0000 7fb07d63e640 1 --2- 172.21.15.114:0/1479756261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0780cc520 0x7fb07814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:03.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.933+0000 7fb07de3f640 1 --2- 172.21.15.114:0/1479756261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb078153850 0x7fb078142780 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb07400c7f0 tx=0x7fb07400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.933+0000 7fb06dffb640 1 -- 172.21.15.114:0/1479756261 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074004220 con 0x7fb078153850 2023-11-04T01:39:03.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.933+0000 7fb06dffb640 1 -- 172.21.15.114:0/1479756261 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0740043a0 con 0x7fb078153850 2023-11-04T01:39:03.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.933+0000 7fb06dffb640 1 -- 172.21.15.114:0/1479756261 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074007860 con 0x7fb078153850 2023-11-04T01:39:03.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.933+0000 7fb07f8a2640 1 -- 172.21.15.114:0/1479756261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0781467f0 con 0x7fb078153850 2023-11-04T01:39:03.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.933+0000 7fb07f8a2640 1 -- 172.21.15.114:0/1479756261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb078146db0 con 0x7fb078153850 2023-11-04T01:39:03.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.934+0000 7fb07f8a2640 1 -- 172.21.15.114:0/1479756261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb078074290 con 0x7fb078153850 2023-11-04T01:39:03.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.934+0000 7fb06dffb640 1 -- 172.21.15.114:0/1479756261 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb074007bd0 con 0x7fb078153850 2023-11-04T01:39:03.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.935+0000 7fb06dffb640 1 --2- 172.21.15.114:0/1479756261 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb05c06ae70 0x7fb05c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:03.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.935+0000 7fb06dffb640 1 -- 172.21.15.114:0/1479756261 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fb074089bd0 con 0x7fb078153850 2023-11-04T01:39:03.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.935+0000 7fb07d63e640 1 --2- 172.21.15.114:0/1479756261 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb05c06ae70 0x7fb05c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:03.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.935+0000 7fb07d63e640 1 --2- 172.21.15.114:0/1479756261 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb05c06ae70 0x7fb05c06d330 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb070007fd0 tx=0x7fb070005b70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:03.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:03.939+0000 7fb06dffb640 1 -- 172.21.15.114:0/1479756261 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0740546e0 con 0x7fb078153850 2023-11-04T01:39:04.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.105+0000 7fb07f8a2640 1 -- 172.21.15.114:0/1479756261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0780c5010 con 0x7fb078153850 2023-11-04T01:39:04.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.105+0000 7fb06dffb640 1 -- 172.21.15.114:0/1479756261 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb07401e020 con 0x7fb078153850 2023-11-04T01:39:04.108 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:39:04.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.107+0000 7fb07f8a2640 1 -- 172.21.15.114:0/1479756261 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb05c06ae70 msgr2=0x7fb05c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.107+0000 7fb07f8a2640 1 --2- 172.21.15.114:0/1479756261 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb05c06ae70 0x7fb05c06d330 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb070007fd0 tx=0x7fb070005b70 comp rx=0 tx=0).stop 2023-11-04T01:39:04.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.107+0000 7fb07f8a2640 1 -- 172.21.15.114:0/1479756261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb078153850 msgr2=0x7fb078142780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.107+0000 7fb07f8a2640 1 --2- 172.21.15.114:0/1479756261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb078153850 0x7fb078142780 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb07400c7f0 tx=0x7fb07400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.107+0000 7fb07f8a2640 1 -- 172.21.15.114:0/1479756261 shutdown_connections 2023-11-04T01:39:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.107+0000 7fb07f8a2640 1 --2- 172.21.15.114:0/1479756261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb078153850 0x7fb078142780 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.107+0000 7fb07f8a2640 1 --2- 172.21.15.114:0/1479756261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0780cc9d0 0x7fb078142240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.107+0000 7fb07f8a2640 1 --2- 172.21.15.114:0/1479756261 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb05c06ae70 0x7fb05c06d330 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.107+0000 7fb07f8a2640 1 --2- 172.21.15.114:0/1479756261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0780cc520 0x7fb07814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.107+0000 7fb07f8a2640 1 -- 172.21.15.114:0/1479756261 >> 172.21.15.114:0/1479756261 conn(0x7fb0780ce950 msgr2=0x7fb078071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.107+0000 7fb07f8a2640 1 -- 172.21.15.114:0/1479756261 shutdown_connections 2023-11-04T01:39:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.107+0000 7fb07f8a2640 1 -- 172.21.15.114:0/1479756261 wait complete. 2023-11-04T01:39:04.119 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:39:04.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.219+0000 7fe17ba39640 1 Processor -- start 2023-11-04T01:39:04.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.220+0000 7fe17ba39640 1 -- start start 2023-11-04T01:39:04.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.220+0000 7fe17ba39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe174153e60 0x7fe17415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.220+0000 7fe17ba39640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1740cde60 con 0x7fe1740b4880 2023-11-04T01:39:04.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.220+0000 7fe17ba39640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe174160f90 con 0x7fe1740cd6d0 2023-11-04T01:39:04.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.220+0000 7fe17ba39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17415e400 con 0x7fe174153e60 2023-11-04T01:39:04.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.221+0000 7fe179fd6640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe1740b4880 0x7fe1740d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60950/0 (socket says 172.21.15.114:60950) 2023-11-04T01:39:04.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.221+0000 7fe179fd6640 1 -- 172.21.15.114:0/2635131293 learned_addr learned my addr 172.21.15.114:0/2635131293 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:04.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.221+0000 7fe1797d5640 1 --2- 172.21.15.114:0/2635131293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe174153e60 0x7fe17415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.221+0000 7fe16bfff640 1 -- 172.21.15.114:0/2635131293 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112006888 0 0) 0x7fe1740cde60 con 0x7fe1740b4880 2023-11-04T01:39:04.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.221+0000 7fe16bfff640 1 -- 172.21.15.114:0/2635131293 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe160003520 con 0x7fe1740b4880 2023-11-04T01:39:04.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.221+0000 7fe16bfff640 1 -- 172.21.15.114:0/2635131293 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024197068 0 0) 0x7fe174160f90 con 0x7fe1740cd6d0 2023-11-04T01:39:04.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.221+0000 7fe16bfff640 1 -- 172.21.15.114:0/2635131293 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1740cde60 con 0x7fe1740cd6d0 2023-11-04T01:39:04.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.221+0000 7fe1797d5640 1 -- 172.21.15.114:0/2635131293 >> v1:172.21.15.141:6789/0 conn(0x7fe1740cd6d0 legacy=0x7fe174161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.221+0000 7fe1797d5640 1 -- 172.21.15.114:0/2635131293 >> v1:172.21.15.114:6789/0 conn(0x7fe1740b4880 legacy=0x7fe1740d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.221+0000 7fe16bfff640 1 -- 172.21.15.114:0/2635131293 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 692262079 0 0) 0x7fe160003520 con 0x7fe1740b4880 2023-11-04T01:39:04.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.221+0000 7fe1797d5640 1 -- 172.21.15.114:0/2635131293 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1740ce090 con 0x7fe174153e60 2023-11-04T01:39:04.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.222+0000 7fe1797d5640 1 --2- 172.21.15.114:0/2635131293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe174153e60 0x7fe17415dec0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe1700097d0 tx=0x7fe17002b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7db3308887a3aa23 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.222+0000 7fe16bfff640 1 -- 172.21.15.114:0/2635131293 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0019f0 con 0x7fe174153e60 2023-11-04T01:39:04.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.222+0000 7fe16bfff640 1 -- 172.21.15.114:0/2635131293 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17002e050 con 0x7fe174153e60 2023-11-04T01:39:04.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.222+0000 7fe16bfff640 1 -- 172.21.15.114:0/2635131293 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170030710 con 0x7fe174153e60 2023-11-04T01:39:04.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.222+0000 7fe17ba39640 1 -- 172.21.15.114:0/2635131293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe174153e60 msgr2=0x7fe17415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.222+0000 7fe17ba39640 1 --2- 172.21.15.114:0/2635131293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe174153e60 0x7fe17415dec0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe1700097d0 tx=0x7fe17002b800 comp rx=0 tx=0).stop 2023-11-04T01:39:04.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.223+0000 7fe17ba39640 1 -- 172.21.15.114:0/2635131293 shutdown_connections 2023-11-04T01:39:04.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.223+0000 7fe17ba39640 1 --2- 172.21.15.114:0/2635131293 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe174153e60 0x7fe17415dec0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.223+0000 7fe17ba39640 1 -- 172.21.15.114:0/2635131293 >> 172.21.15.114:0/2635131293 conn(0x7fe1740cf880 msgr2=0x7fe1740cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:04.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.223+0000 7fe17ba39640 1 -- 172.21.15.114:0/2635131293 shutdown_connections 2023-11-04T01:39:04.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.223+0000 7fe17ba39640 1 -- 172.21.15.114:0/2635131293 wait complete. 2023-11-04T01:39:04.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.224+0000 7fe17ba39640 1 Processor -- start 2023-11-04T01:39:04.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.224+0000 7fe17ba39640 1 -- start start 2023-11-04T01:39:04.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.224+0000 7fe17ba39640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1740b4880 0x7fe1741f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.224+0000 7fe17ba39640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe1740cd6d0 0x7fe1741508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.224+0000 7fe17ba39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe174153e60 0x7fe1740c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.224+0000 7fe17ba39640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe174150de0 con 0x7fe1740b4880 2023-11-04T01:39:04.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.224+0000 7fe17ba39640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740c7880 con 0x7fe1740cd6d0 2023-11-04T01:39:04.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.224+0000 7fe17ba39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740c88c0 con 0x7fe174153e60 2023-11-04T01:39:04.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.225+0000 7fe1797d5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1740b4880 0x7fe1741f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.225+0000 7fe1797d5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1740b4880 0x7fe1741f3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55514/0 (socket says 172.21.15.114:55514) 2023-11-04T01:39:04.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.225+0000 7fe1797d5640 1 -- 172.21.15.114:0/300320385 learned_addr learned my addr 172.21.15.114:0/300320385 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:04.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.225+0000 7fe1797d5640 1 -- 172.21.15.114:0/300320385 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe174153e60 msgr2=0x7fe1740c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.225+0000 7fe1797d5640 1 --2- 172.21.15.114:0/300320385 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe174153e60 0x7fe1740c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.225+0000 7fe178fd4640 1 --2- 172.21.15.114:0/300320385 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe1740cd6d0 0x7fe1741508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.225+0000 7fe1797d5640 1 -- 172.21.15.114:0/300320385 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe1740cd6d0 msgr2=0x7fe1741508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.225+0000 7fe1797d5640 1 --2- 172.21.15.114:0/300320385 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe1740cd6d0 0x7fe1741508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.225+0000 7fe1797d5640 1 -- 172.21.15.114:0/300320385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe170009400 con 0x7fe1740b4880 2023-11-04T01:39:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.225+0000 7fe178fd4640 1 --2- 172.21.15.114:0/300320385 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe1740cd6d0 0x7fe1741508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.225+0000 7fe1797d5640 1 --2- 172.21.15.114:0/300320385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1740b4880 0x7fe1741f3020 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fe17002b840 tx=0x7fe1700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.225+0000 7fe169ffb640 1 -- 172.21.15.114:0/300320385 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17003d830 con 0x7fe1740b4880 2023-11-04T01:39:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.225+0000 7fe169ffb640 1 -- 172.21.15.114:0/300320385 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17003d990 con 0x7fe1740b4880 2023-11-04T01:39:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.225+0000 7fe169ffb640 1 -- 172.21.15.114:0/300320385 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17003dd40 con 0x7fe1740b4880 2023-11-04T01:39:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.225+0000 7fe17ba39640 1 -- 172.21.15.114:0/300320385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1740c7ab0 con 0x7fe1740b4880 2023-11-04T01:39:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.225+0000 7fe17ba39640 1 -- 172.21.15.114:0/300320385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1740c8270 con 0x7fe1740b4880 2023-11-04T01:39:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.226+0000 7fe17ba39640 1 -- 172.21.15.114:0/300320385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe174074290 con 0x7fe1740b4880 2023-11-04T01:39:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.227+0000 7fe169ffb640 1 -- 172.21.15.114:0/300320385 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe170032400 con 0x7fe1740b4880 2023-11-04T01:39:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.227+0000 7fe169ffb640 1 --2- 172.21.15.114:0/300320385 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe15806ae70 0x7fe15806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.227+0000 7fe169ffb640 1 -- 172.21.15.114:0/300320385 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fe1700abb20 con 0x7fe1740b4880 2023-11-04T01:39:04.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.227+0000 7fe178fd4640 1 --2- 172.21.15.114:0/300320385 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe15806ae70 0x7fe15806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.228+0000 7fe178fd4640 1 --2- 172.21.15.114:0/300320385 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe15806ae70 0x7fe15806d330 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe1741f59c0 tx=0x7fe164009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.231+0000 7fe169ffb640 1 -- 172.21.15.114:0/300320385 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe170076630 con 0x7fe1740b4880 2023-11-04T01:39:04.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.396+0000 7fe17ba39640 1 -- 172.21.15.114:0/300320385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fe1740d0b80 con 0x7fe1740b4880 2023-11-04T01:39:04.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.396+0000 7fe169ffb640 1 -- 172.21.15.114:0/300320385 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v70) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe170079c50 con 0x7fe1740b4880 2023-11-04T01:39:04.398 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:04.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.398+0000 7fe17ba39640 1 -- 172.21.15.114:0/300320385 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe15806ae70 msgr2=0x7fe15806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.398+0000 7fe17ba39640 1 --2- 172.21.15.114:0/300320385 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe15806ae70 0x7fe15806d330 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe1741f59c0 tx=0x7fe164009040 comp rx=0 tx=0).stop 2023-11-04T01:39:04.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.398+0000 7fe17ba39640 1 -- 172.21.15.114:0/300320385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1740b4880 msgr2=0x7fe1741f3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.398+0000 7fe17ba39640 1 --2- 172.21.15.114:0/300320385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1740b4880 0x7fe1741f3020 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fe17002b840 tx=0x7fe1700046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.398+0000 7fe17ba39640 1 -- 172.21.15.114:0/300320385 shutdown_connections 2023-11-04T01:39:04.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.398+0000 7fe17ba39640 1 --2- 172.21.15.114:0/300320385 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe174153e60 0x7fe1740c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.398+0000 7fe17ba39640 1 --2- 172.21.15.114:0/300320385 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe15806ae70 0x7fe15806d330 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.398+0000 7fe17ba39640 1 --2- 172.21.15.114:0/300320385 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe1740cd6d0 0x7fe1741508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.398+0000 7fe17ba39640 1 --2- 172.21.15.114:0/300320385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1740b4880 0x7fe1741f3020 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.398+0000 7fe17ba39640 1 -- 172.21.15.114:0/300320385 >> 172.21.15.114:0/300320385 conn(0x7fe1740cf880 msgr2=0x7fe17415fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:04.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.398+0000 7fe17ba39640 1 -- 172.21.15.114:0/300320385 shutdown_connections 2023-11-04T01:39:04.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.398+0000 7fe17ba39640 1 -- 172.21.15.114:0/300320385 wait complete. 2023-11-04T01:39:04.411 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:39:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.511+0000 7f0dbad8a640 1 Processor -- start 2023-11-04T01:39:04.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.511+0000 7f0dbad8a640 1 -- start start 2023-11-04T01:39:04.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.512+0000 7f0dbad8a640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0db415e430 0x7f0db40cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.512+0000 7f0dbad8a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db40d0710 0x7f0db40b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.512+0000 7f0dbad8a640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db40d0280 con 0x7f0db40cf160 2023-11-04T01:39:04.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.512+0000 7f0dbad8a640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db40cf670 con 0x7f0db415e430 2023-11-04T01:39:04.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.512+0000 7f0dbad8a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40cf950 con 0x7f0db40d0710 2023-11-04T01:39:04.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.513+0000 7f0db9327640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db40d0710 0x7f0db40b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.513+0000 7f0db8b26640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0db415e430 0x7f0db40cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.513+0000 7f0db3fff640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f0db40cf160 0x7f0db40cd510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:54286/0 (socket says 172.21.15.114:54286) 2023-11-04T01:39:04.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.513+0000 7f0db3fff640 1 -- 172.21.15.114:0/733731903 learned_addr learned my addr 172.21.15.114:0/733731903 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:04.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.513+0000 7f0db37fe640 1 -- 172.21.15.114:0/733731903 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484138939 0 0) 0x7f0db40d0280 con 0x7f0db40cf160 2023-11-04T01:39:04.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.513+0000 7f0db37fe640 1 -- 172.21.15.114:0/733731903 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d9c003520 con 0x7f0db40cf160 2023-11-04T01:39:04.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.513+0000 7f0db9327640 1 -- 172.21.15.114:0/733731903 >> v2:172.21.15.141:3300/0 conn(0x7f0db415e430 msgr2=0x7f0db40cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:04.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.513+0000 7f0db9327640 1 --2- 172.21.15.114:0/733731903 >> v2:172.21.15.141:3300/0 conn(0x7f0db415e430 0x7f0db40cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.513+0000 7f0db9327640 1 -- 172.21.15.114:0/733731903 >> v1:172.21.15.141:6789/0 conn(0x7f0db40cf160 legacy=0x7f0db40cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.513+0000 7f0db9327640 1 -- 172.21.15.114:0/733731903 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db40cfc30 con 0x7f0db40d0710 2023-11-04T01:39:04.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.514+0000 7f0db9327640 1 --2- 172.21.15.114:0/733731903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db40d0710 0x7f0db40b3d40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009d90 tx=0x7f0dac02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40ea92144c8fbef7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.514+0000 7f0db37fe640 1 -- 172.21.15.114:0/733731903 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac02cc50 con 0x7f0db40d0710 2023-11-04T01:39:04.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.514+0000 7f0db37fe640 1 -- 172.21.15.114:0/733731903 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac02cdb0 con 0x7f0db40d0710 2023-11-04T01:39:04.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.514+0000 7f0db37fe640 1 -- 172.21.15.114:0/733731903 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac034640 con 0x7f0db40d0710 2023-11-04T01:39:04.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.514+0000 7f0dbad8a640 1 -- 172.21.15.114:0/733731903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db40d0710 msgr2=0x7f0db40b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.514+0000 7f0dbad8a640 1 --2- 172.21.15.114:0/733731903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db40d0710 0x7f0db40b3d40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009d90 tx=0x7f0dac02bea0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.514+0000 7f0dbad8a640 1 -- 172.21.15.114:0/733731903 shutdown_connections 2023-11-04T01:39:04.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.514+0000 7f0dbad8a640 1 --2- 172.21.15.114:0/733731903 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db40d0710 0x7f0db40b3d40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.514+0000 7f0dbad8a640 1 --2- 172.21.15.114:0/733731903 >> v2:172.21.15.141:3300/0 conn(0x7f0db415e430 0x7f0db40cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.514+0000 7f0dbad8a640 1 -- 172.21.15.114:0/733731903 >> 172.21.15.114:0/733731903 conn(0x7f0db406ea20 msgr2=0x7f0db406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:04.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.514+0000 7f0dbad8a640 1 -- 172.21.15.114:0/733731903 shutdown_connections 2023-11-04T01:39:04.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.514+0000 7f0dbad8a640 1 -- 172.21.15.114:0/733731903 wait complete. 2023-11-04T01:39:04.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.516+0000 7f0dbad8a640 1 Processor -- start 2023-11-04T01:39:04.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.516+0000 7f0dbad8a640 1 -- start start 2023-11-04T01:39:04.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.516+0000 7f0dbad8a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db40cf160 0x7f0db4157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.516+0000 7f0dbad8a640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db40d0710 0x7f0db414d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.516+0000 7f0dbad8a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db415e430 0x7f0db4153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.516+0000 7f0dbad8a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db4155e60 con 0x7f0db40cf160 2023-11-04T01:39:04.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.516+0000 7f0dbad8a640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40b1990 con 0x7f0db40d0710 2023-11-04T01:39:04.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.516+0000 7f0dbad8a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db4152d50 con 0x7f0db415e430 2023-11-04T01:39:04.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.517+0000 7f0db8b26640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db40cf160 0x7f0db4157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.517+0000 7f0db8b26640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db40cf160 0x7f0db4157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55518/0 (socket says 172.21.15.114:55518) 2023-11-04T01:39:04.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.517+0000 7f0db8b26640 1 -- 172.21.15.114:0/3038768058 learned_addr learned my addr 172.21.15.114:0/3038768058 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:04.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.517+0000 7f0db3fff640 1 --2- 172.21.15.114:0/3038768058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db40d0710 0x7f0db414d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.517+0000 7f0db9327640 1 --2- 172.21.15.114:0/3038768058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db415e430 0x7f0db4153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.517+0000 7f0db8b26640 1 -- 172.21.15.114:0/3038768058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db415e430 msgr2=0x7f0db4153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.517+0000 7f0db8b26640 1 --2- 172.21.15.114:0/3038768058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db415e430 0x7f0db4153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.517+0000 7f0db8b26640 1 -- 172.21.15.114:0/3038768058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db40d0710 msgr2=0x7f0db414d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.517+0000 7f0db8b26640 1 --2- 172.21.15.114:0/3038768058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db40d0710 0x7f0db414d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.517+0000 7f0db8b26640 1 -- 172.21.15.114:0/3038768058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac009a70 con 0x7f0db40cf160 2023-11-04T01:39:04.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.517+0000 7f0db8b26640 1 --2- 172.21.15.114:0/3038768058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db40cf160 0x7f0db4157600 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f0da400e9b0 tx=0x7f0da400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.517+0000 7f0db17fa640 1 -- 172.21.15.114:0/3038768058 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da4009670 con 0x7f0db40cf160 2023-11-04T01:39:04.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.517+0000 7f0db17fa640 1 -- 172.21.15.114:0/3038768058 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da400c9a0 con 0x7f0db40cf160 2023-11-04T01:39:04.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.517+0000 7f0dbad8a640 1 -- 172.21.15.114:0/3038768058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db4157b40 con 0x7f0db40cf160 2023-11-04T01:39:04.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.517+0000 7f0db17fa640 1 -- 172.21.15.114:0/3038768058 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da400cd50 con 0x7f0db40cf160 2023-11-04T01:39:04.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.517+0000 7f0dbad8a640 1 -- 172.21.15.114:0/3038768058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db41554c0 con 0x7f0db40cf160 2023-11-04T01:39:04.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.518+0000 7f0dbad8a640 1 -- 172.21.15.114:0/3038768058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db4074290 con 0x7f0db40cf160 2023-11-04T01:39:04.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.519+0000 7f0db17fa640 1 -- 172.21.15.114:0/3038768058 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0da4013470 con 0x7f0db40cf160 2023-11-04T01:39:04.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.519+0000 7f0db17fa640 1 --2- 172.21.15.114:0/3038768058 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0da006ae70 0x7f0da006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.519+0000 7f0db17fa640 1 -- 172.21.15.114:0/3038768058 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f0da4089bd0 con 0x7f0db40cf160 2023-11-04T01:39:04.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.519+0000 7f0db3fff640 1 --2- 172.21.15.114:0/3038768058 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0da006ae70 0x7f0da006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.519+0000 7f0db3fff640 1 --2- 172.21.15.114:0/3038768058 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0da006ae70 0x7f0da006d330 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0db4156420 tx=0x7f0da8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.523+0000 7f0db17fa640 1 -- 172.21.15.114:0/3038768058 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0da4054770 con 0x7f0db40cf160 2023-11-04T01:39:04.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.689+0000 7f0dbad8a640 1 -- 172.21.15.114:0/3038768058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f0db4157b40 con 0x7f0db40cf160 2023-11-04T01:39:04.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.689+0000 7f0db17fa640 1 -- 172.21.15.114:0/3038768058 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v70) v1 ==== 107+0+11 (secure 0 0 0) 0x7f0db4157b40 con 0x7f0db40cf160 2023-11-04T01:39:04.691 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:04.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.691+0000 7f0dbad8a640 1 -- 172.21.15.114:0/3038768058 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0da006ae70 msgr2=0x7f0da006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.691+0000 7f0dbad8a640 1 --2- 172.21.15.114:0/3038768058 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0da006ae70 0x7f0da006d330 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0db4156420 tx=0x7f0da8009040 comp rx=0 tx=0).stop 2023-11-04T01:39:04.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.691+0000 7f0dbad8a640 1 -- 172.21.15.114:0/3038768058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db40cf160 msgr2=0x7f0db4157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.691+0000 7f0dbad8a640 1 --2- 172.21.15.114:0/3038768058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db40cf160 0x7f0db4157600 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f0da400e9b0 tx=0x7f0da400ee70 comp rx=0 tx=0).stop 2023-11-04T01:39:04.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.691+0000 7f0dbad8a640 1 -- 172.21.15.114:0/3038768058 shutdown_connections 2023-11-04T01:39:04.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.691+0000 7f0dbad8a640 1 --2- 172.21.15.114:0/3038768058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db415e430 0x7f0db4153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.691+0000 7f0dbad8a640 1 --2- 172.21.15.114:0/3038768058 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0da006ae70 0x7f0da006d330 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.691+0000 7f0dbad8a640 1 --2- 172.21.15.114:0/3038768058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db40d0710 0x7f0db414d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.691+0000 7f0dbad8a640 1 --2- 172.21.15.114:0/3038768058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db40cf160 0x7f0db4157600 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.691+0000 7f0dbad8a640 1 -- 172.21.15.114:0/3038768058 >> 172.21.15.114:0/3038768058 conn(0x7f0db406ea20 msgr2=0x7f0db40ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:04.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.691+0000 7f0dbad8a640 1 -- 172.21.15.114:0/3038768058 shutdown_connections 2023-11-04T01:39:04.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.691+0000 7f0dbad8a640 1 -- 172.21.15.114:0/3038768058 wait complete. 2023-11-04T01:39:04.704 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:39:04.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.802+0000 7f203d116640 1 Processor -- start 2023-11-04T01:39:04.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.802+0000 7f203d116640 1 -- start start 2023-11-04T01:39:04.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.803+0000 7f203d116640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2038153850 0x7f203815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.803+0000 7f203d116640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f20380cc9d0 0x7f20380c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.803+0000 7f203d116640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20380c3860 con 0x7f20380cc520 2023-11-04T01:39:04.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.803+0000 7f203d116640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20380c9250 con 0x7f20380cc9d0 2023-11-04T01:39:04.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.803+0000 7f203d116640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2038153c30 con 0x7f2038153850 2023-11-04T01:39:04.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.803+0000 7f202ffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f20380cc520 0x7f2038070fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60956/0 (socket says 172.21.15.114:60956) 2023-11-04T01:39:04.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.803+0000 7f202ffff640 1 -- 172.21.15.114:0/2090995800 learned_addr learned my addr 172.21.15.114:0/2090995800 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:04.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.803+0000 7f203759e640 1 --2- 172.21.15.114:0/2090995800 >> v2:172.21.15.114:3300/0 conn(0x7f20380cc9d0 0x7f20380c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.803+0000 7f2036d9d640 1 --2- 172.21.15.114:0/2090995800 >> v2:172.21.15.141:3300/0 conn(0x7f2038153850 0x7f203815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.803+0000 7f203759e640 1 -- 172.21.15.114:0/2090995800 >> v2:172.21.15.141:3300/0 conn(0x7f2038153850 msgr2=0x7f203815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:04.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.803+0000 7f203759e640 1 --2- 172.21.15.114:0/2090995800 >> v2:172.21.15.141:3300/0 conn(0x7f2038153850 0x7f203815a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.803+0000 7f203759e640 1 -- 172.21.15.114:0/2090995800 >> v1:172.21.15.114:6789/0 conn(0x7f20380cc520 legacy=0x7f2038070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.803+0000 7f203759e640 1 -- 172.21.15.114:0/2090995800 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203815a700 con 0x7f20380cc9d0 2023-11-04T01:39:04.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.803+0000 7f203659c640 1 -- 172.21.15.114:0/2090995800 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521776092 0 0) 0x7f20380c3860 con 0x7f20380cc520 2023-11-04T01:39:04.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.804+0000 7f203759e640 1 --2- 172.21.15.114:0/2090995800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20380cc9d0 0x7f20380c3cf0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f20380c5710 tx=0x7f203002cfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b40aabd3837cc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.804+0000 7f203659c640 1 -- 172.21.15.114:0/2090995800 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203002dd70 con 0x7f20380cc9d0 2023-11-04T01:39:04.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.804+0000 7f203659c640 1 -- 172.21.15.114:0/2090995800 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2030035440 con 0x7f20380cc9d0 2023-11-04T01:39:04.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.804+0000 7f203659c640 1 -- 172.21.15.114:0/2090995800 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20300357d0 con 0x7f20380cc9d0 2023-11-04T01:39:04.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.805+0000 7f203d116640 1 -- 172.21.15.114:0/2090995800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20380cc9d0 msgr2=0x7f20380c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.805+0000 7f203d116640 1 --2- 172.21.15.114:0/2090995800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20380cc9d0 0x7f20380c3cf0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f20380c5710 tx=0x7f203002cfc0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.805+0000 7f203d116640 1 -- 172.21.15.114:0/2090995800 shutdown_connections 2023-11-04T01:39:04.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.805+0000 7f203d116640 1 --2- 172.21.15.114:0/2090995800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20380cc9d0 0x7f20380c3cf0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.805+0000 7f203d116640 1 --2- 172.21.15.114:0/2090995800 >> v2:172.21.15.141:3300/0 conn(0x7f2038153850 0x7f203815a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.805+0000 7f203d116640 1 -- 172.21.15.114:0/2090995800 >> 172.21.15.114:0/2090995800 conn(0x7f20380ce950 msgr2=0x7f20380ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:04.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.805+0000 7f203d116640 1 -- 172.21.15.114:0/2090995800 shutdown_connections 2023-11-04T01:39:04.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.805+0000 7f203d116640 1 -- 172.21.15.114:0/2090995800 wait complete. 2023-11-04T01:39:04.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.806+0000 7f203d116640 1 Processor -- start 2023-11-04T01:39:04.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.806+0000 7f203d116640 1 -- start start 2023-11-04T01:39:04.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f203d116640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20380cc520 0x7f20380c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f203d116640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20380cc9d0 0x7f203806d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f203d116640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2038153850 0x7f20381e2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f203d116640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20380b1740 con 0x7f20380cc9d0 2023-11-04T01:39:04.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f203d116640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20380b22c0 con 0x7f20380cc520 2023-11-04T01:39:04.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f203d116640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20380b1990 con 0x7f2038153850 2023-11-04T01:39:04.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f202ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20380cc9d0 0x7f203806d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f202ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20380cc9d0 0x7f203806d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55550/0 (socket says 172.21.15.114:55550) 2023-11-04T01:39:04.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f202ffff640 1 -- 172.21.15.114:0/3556771118 learned_addr learned my addr 172.21.15.114:0/3556771118 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:04.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f2036d9d640 1 --2- 172.21.15.114:0/3556771118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20380cc520 0x7f20380c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f202ffff640 1 -- 172.21.15.114:0/3556771118 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2038153850 msgr2=0x7f20381e2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f202ffff640 1 --2- 172.21.15.114:0/3556771118 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2038153850 0x7f20381e2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f202ffff640 1 -- 172.21.15.114:0/3556771118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20380cc520 msgr2=0x7f20380c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f202ffff640 1 --2- 172.21.15.114:0/3556771118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20380cc520 0x7f20380c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f202ffff640 1 -- 172.21.15.114:0/3556771118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203000d040 con 0x7f20380cc9d0 2023-11-04T01:39:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f2036d9d640 1 --2- 172.21.15.114:0/3556771118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20380cc520 0x7f20380c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f202ffff640 1 --2- 172.21.15.114:0/3556771118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20380cc9d0 0x7f203806d470 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f202000c500 tx=0x7f202000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f202f7fe640 1 -- 172.21.15.114:0/3556771118 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020007560 con 0x7f20380cc9d0 2023-11-04T01:39:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f202f7fe640 1 -- 172.21.15.114:0/3556771118 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20200047e0 con 0x7f20380cc9d0 2023-11-04T01:39:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f203d116640 1 -- 172.21.15.114:0/3556771118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20380b1c70 con 0x7f20380cc9d0 2023-11-04T01:39:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f202f7fe640 1 -- 172.21.15.114:0/3556771118 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020004b90 con 0x7f20380cc9d0 2023-11-04T01:39:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.807+0000 7f203d116640 1 -- 172.21.15.114:0/3556771118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203814f500 con 0x7f20380cc9d0 2023-11-04T01:39:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.809+0000 7f203d116640 1 -- 172.21.15.114:0/3556771118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20380b2400 con 0x7f20380cc9d0 2023-11-04T01:39:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.809+0000 7f202f7fe640 1 -- 172.21.15.114:0/3556771118 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2020004cf0 con 0x7f20380cc9d0 2023-11-04T01:39:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.809+0000 7f202f7fe640 1 --2- 172.21.15.114:0/3556771118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f201806ae70 0x7f201806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.809+0000 7f202f7fe640 1 -- 172.21.15.114:0/3556771118 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f2020089010 con 0x7f20380cc9d0 2023-11-04T01:39:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.809+0000 7f2036d9d640 1 --2- 172.21.15.114:0/3556771118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f201806ae70 0x7f201806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.809+0000 7f2036d9d640 1 --2- 172.21.15.114:0/3556771118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f201806ae70 0x7f201806d330 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2028009a20 tx=0x7f2028008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:04.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.813+0000 7f202f7fe640 1 -- 172.21.15.114:0/3556771118 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20380b2400 con 0x7f20380cc9d0 2023-11-04T01:39:04.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.991+0000 7f203d116640 1 -- 172.21.15.114:0/3556771118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f20380b2400 con 0x7f20380cc9d0 2023-11-04T01:39:04.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.992+0000 7f202f7fe640 1 -- 172.21.15.114:0/3556771118 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v70) v1 ==== 80+0+0 (secure 0 0 0) 0x7f20380b2400 con 0x7f20380cc9d0 2023-11-04T01:39:04.994 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-11-04T01:39:04.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.993+0000 7f203d116640 1 -- 172.21.15.114:0/3556771118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f201806ae70 msgr2=0x7f201806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.993+0000 7f203d116640 1 --2- 172.21.15.114:0/3556771118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f201806ae70 0x7f201806d330 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2028009a20 tx=0x7f2028008040 comp rx=0 tx=0).stop 2023-11-04T01:39:04.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.993+0000 7f203d116640 1 -- 172.21.15.114:0/3556771118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20380cc9d0 msgr2=0x7f203806d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:04.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.993+0000 7f203d116640 1 --2- 172.21.15.114:0/3556771118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20380cc9d0 0x7f203806d470 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f202000c500 tx=0x7f202000c9c0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.994+0000 7f203d116640 1 -- 172.21.15.114:0/3556771118 shutdown_connections 2023-11-04T01:39:04.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.994+0000 7f203d116640 1 --2- 172.21.15.114:0/3556771118 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2038153850 0x7f20381e2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.994+0000 7f203d116640 1 --2- 172.21.15.114:0/3556771118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20380cc9d0 0x7f203806d470 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.994+0000 7f203d116640 1 --2- 172.21.15.114:0/3556771118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f201806ae70 0x7f201806d330 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.994+0000 7f203d116640 1 --2- 172.21.15.114:0/3556771118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f20380cc520 0x7f20380c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:04.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.994+0000 7f203d116640 1 -- 172.21.15.114:0/3556771118 >> 172.21.15.114:0/3556771118 conn(0x7f20380ce950 msgr2=0x7f20380c5230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:04.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.994+0000 7f203d116640 1 -- 172.21.15.114:0/3556771118 shutdown_connections 2023-11-04T01:39:04.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:04.994+0000 7f203d116640 1 -- 172.21.15.114:0/3556771118 wait complete. 2023-11-04T01:39:05.006 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi114.front.sepia.ceph.com... 2023-11-04T01:39:05.006 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:05.006 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:05.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:05.065 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[111388]: fuse finished with error 0 and tester_r 0 2023-11-04T01:39:05.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:05.070 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:39:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:05.072 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:39:05.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:05.072 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:39:05.087 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:39:05.087 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:05.105 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:39:05.105 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:39:05.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:05.106 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:39:05.163 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:05.163 INFO:teuthology.orchestra.run.smithi141.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:39:05.163 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:39:05.163 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:05.179 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:39:05.179 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:39:05.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:05.179 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:39:05.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:39:05.235 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:39:05.235 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:05.252 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:39:05.252 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:39:05.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:05.253 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:39:05.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:05.309 INFO:teuthology.orchestra.run.smithi141.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:39:05.310 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.408+0000 7fab64e21640 1 Processor -- start 2023-11-04T01:39:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.408+0000 7fab64e21640 1 -- start start 2023-11-04T01:39:05.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab64e21640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fab6015ce70 0x7fab6006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab64e21640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab6015d250 0x7fab600c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab64e21640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6006a120 con 0x7fab600c9d70 2023-11-04T01:39:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab64e21640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab600cdc10 con 0x7fab6015ce70 2023-11-04T01:39:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab64e21640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6006def0 con 0x7fab6015d250 2023-11-04T01:39:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5ed9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fab600c9d70 0x7fab600ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60962/0 (socket says 172.21.15.114:60962) 2023-11-04T01:39:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5ed9d640 1 -- 172.21.15.114:0/4160090342 learned_addr learned my addr 172.21.15.114:0/4160090342 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5dd9b640 1 -- 172.21.15.114:0/4160090342 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799747844 0 0) 0x7fab6006a120 con 0x7fab600c9d70 2023-11-04T01:39:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5dd9b640 1 -- 172.21.15.114:0/4160090342 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab4c003520 con 0x7fab600c9d70 2023-11-04T01:39:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab57fff640 1 --2- 172.21.15.114:0/4160090342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab6015d250 0x7fab600c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5e59c640 1 --2- 172.21.15.114:0/4160090342 >> v2:172.21.15.141:3300/0 conn(0x7fab6015ce70 0x7fab6006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5dd9b640 1 -- 172.21.15.114:0/4160090342 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2148823442 0 0) 0x7fab4c003520 con 0x7fab600c9d70 2023-11-04T01:39:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5dd9b640 1 -- 172.21.15.114:0/4160090342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab6015d250 msgr2=0x7fab600c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5dd9b640 1 --2- 172.21.15.114:0/4160090342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab6015d250 0x7fab600c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5dd9b640 1 -- 172.21.15.114:0/4160090342 >> v2:172.21.15.141:3300/0 conn(0x7fab6015ce70 msgr2=0x7fab6006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5dd9b640 1 --2- 172.21.15.114:0/4160090342 >> v2:172.21.15.141:3300/0 conn(0x7fab6015ce70 0x7fab6006d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5dd9b640 1 -- 172.21.15.114:0/4160090342 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6006a370 con 0x7fab600c9d70 2023-11-04T01:39:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5dd9b640 1 -- 172.21.15.114:0/4160090342 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fab580019f0 con 0x7fab600c9d70 2023-11-04T01:39:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5dd9b640 1 -- 172.21.15.114:0/4160090342 >> v1:172.21.15.114:6789/0 conn(0x7fab600c9d70 legacy=0x7fab600ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5dd9b640 1 --2- 172.21.15.114:0/4160090342 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab4c003970 0x7fab4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5dd9b640 1 --2- 172.21.15.114:0/4160090342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab6015d250 0x7fab4c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5dd9b640 1 --2- 172.21.15.114:0/4160090342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab4c004d00 0x7fab4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5dd9b640 1 -- 172.21.15.114:0/4160090342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab600cdc10 con 0x7fab4c004d00 2023-11-04T01:39:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5dd9b640 1 -- 172.21.15.114:0/4160090342 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6006def0 con 0x7fab4c003970 2023-11-04T01:39:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.409+0000 7fab5dd9b640 1 -- 172.21.15.114:0/4160090342 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c00b980 con 0x7fab6015d250 2023-11-04T01:39:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.410+0000 7fab5ed9d640 1 --2- 172.21.15.114:0/4160090342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab4c004d00 0x7fab4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.410+0000 7fab5e59c640 1 --2- 172.21.15.114:0/4160090342 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab4c003970 0x7fab4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.410+0000 7fab57fff640 1 --2- 172.21.15.114:0/4160090342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab6015d250 0x7fab4c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.410+0000 7fab5ed9d640 1 -- 172.21.15.114:0/4160090342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab6015d250 msgr2=0x7fab4c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.410+0000 7fab5ed9d640 1 --2- 172.21.15.114:0/4160090342 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab6015d250 0x7fab4c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.410+0000 7fab5ed9d640 1 -- 172.21.15.114:0/4160090342 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab4c003970 msgr2=0x7fab4c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.410+0000 7fab5ed9d640 1 --2- 172.21.15.114:0/4160090342 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab4c003970 0x7fab4c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.410+0000 7fab5ed9d640 1 -- 172.21.15.114:0/4160090342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c003520 con 0x7fab4c004d00 2023-11-04T01:39:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.410+0000 7fab5ed9d640 1 --2- 172.21.15.114:0/4160090342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab4c004d00 0x7fab4c005180 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fab5800a860 tx=0x7fab4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73eeda1b3ca8dd9d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.411+0000 7fab5dd9b640 1 -- 172.21.15.114:0/4160090342 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58034630 con 0x7fab4c004d00 2023-11-04T01:39:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.411+0000 7fab5dd9b640 1 -- 172.21.15.114:0/4160090342 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5802f070 con 0x7fab4c004d00 2023-11-04T01:39:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.411+0000 7fab5dd9b640 1 -- 172.21.15.114:0/4160090342 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab580349d0 con 0x7fab4c004d00 2023-11-04T01:39:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.411+0000 7fab64e21640 1 -- 172.21.15.114:0/4160090342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab4c004d00 msgr2=0x7fab4c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.411+0000 7fab64e21640 1 --2- 172.21.15.114:0/4160090342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab4c004d00 0x7fab4c005180 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fab5800a860 tx=0x7fab4c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.411+0000 7fab5ed9d640 1 -- 172.21.15.114:0/4160090342 reap_dead start 2023-11-04T01:39:05.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.411+0000 7fab64e21640 1 -- 172.21.15.114:0/4160090342 shutdown_connections 2023-11-04T01:39:05.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.411+0000 7fab64e21640 1 -- 172.21.15.114:0/4160090342 >> 172.21.15.114:0/4160090342 conn(0x7fab600b0cd0 msgr2=0x7fab600b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.411+0000 7fab64e21640 1 -- 172.21.15.114:0/4160090342 shutdown_connections 2023-11-04T01:39:05.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.411+0000 7fab64e21640 1 -- 172.21.15.114:0/4160090342 wait complete. 2023-11-04T01:39:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.413+0000 7fab64e21640 1 Processor -- start 2023-11-04T01:39:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.413+0000 7fab64e21640 1 -- start start 2023-11-04T01:39:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.413+0000 7fab64e21640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab600c57e0 0x7fab600c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.413+0000 7fab64e21640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab600c71b0 0x7fab60158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.413+0000 7fab64e21640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab60158fd0 0x7fab601443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.413+0000 7fab64e21640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab60159460 con 0x7fab60158fd0 2023-11-04T01:39:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.413+0000 7fab64e21640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab600c7c60 con 0x7fab600c71b0 2023-11-04T01:39:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.413+0000 7fab64e21640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab600c76a0 con 0x7fab600c57e0 2023-11-04T01:39:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.413+0000 7fab5ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab60158fd0 0x7fab601443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.413+0000 7fab5ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab60158fd0 0x7fab601443d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55570/0 (socket says 172.21.15.114:55570) 2023-11-04T01:39:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.413+0000 7fab5ed9d640 1 -- 172.21.15.114:0/295645824 learned_addr learned my addr 172.21.15.114:0/295645824 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.414+0000 7fab5e59c640 1 --2- 172.21.15.114:0/295645824 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab600c57e0 0x7fab600c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.414+0000 7fab57fff640 1 --2- 172.21.15.114:0/295645824 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab600c71b0 0x7fab60158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.414+0000 7fab5ed9d640 1 -- 172.21.15.114:0/295645824 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab600c57e0 msgr2=0x7fab600c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.414+0000 7fab5ed9d640 1 --2- 172.21.15.114:0/295645824 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab600c57e0 0x7fab600c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.414+0000 7fab5ed9d640 1 -- 172.21.15.114:0/295645824 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab600c71b0 msgr2=0x7fab60158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.414+0000 7fab5ed9d640 1 --2- 172.21.15.114:0/295645824 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab600c71b0 0x7fab60158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.414+0000 7fab5ed9d640 1 -- 172.21.15.114:0/295645824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab600c7980 con 0x7fab60158fd0 2023-11-04T01:39:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.414+0000 7fab5e59c640 1 --2- 172.21.15.114:0/295645824 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab600c57e0 0x7fab600c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.414+0000 7fab57fff640 1 --2- 172.21.15.114:0/295645824 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab600c71b0 0x7fab60158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.414+0000 7fab5ed9d640 1 --2- 172.21.15.114:0/295645824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab60158fd0 0x7fab601443d0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fab580013d0 tx=0x7fab6006e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.414+0000 7fab56ffd640 1 -- 172.21.15.114:0/295645824 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58034840 con 0x7fab60158fd0 2023-11-04T01:39:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.414+0000 7fab56ffd640 1 -- 172.21.15.114:0/295645824 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab580349a0 con 0x7fab60158fd0 2023-11-04T01:39:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.414+0000 7fab64e21640 1 -- 172.21.15.114:0/295645824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab601424d0 con 0x7fab60158fd0 2023-11-04T01:39:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.414+0000 7fab56ffd640 1 -- 172.21.15.114:0/295645824 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58034d10 con 0x7fab60158fd0 2023-11-04T01:39:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.414+0000 7fab64e21640 1 -- 172.21.15.114:0/295645824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab600c5bc0 con 0x7fab60158fd0 2023-11-04T01:39:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.415+0000 7fab64e21640 1 -- 172.21.15.114:0/295645824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab601429f0 con 0x7fab60158fd0 2023-11-04T01:39:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.415+0000 7fab56ffd640 1 -- 172.21.15.114:0/295645824 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab58031030 con 0x7fab60158fd0 2023-11-04T01:39:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.416+0000 7fab56ffd640 1 --2- 172.21.15.114:0/295645824 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab4006ae70 0x7fab4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.416+0000 7fab56ffd640 1 -- 172.21.15.114:0/295645824 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fab580abd70 con 0x7fab60158fd0 2023-11-04T01:39:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.416+0000 7fab5e59c640 1 --2- 172.21.15.114:0/295645824 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab4006ae70 0x7fab4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.416+0000 7fab5e59c640 1 --2- 172.21.15.114:0/295645824 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab4006ae70 0x7fab4006d330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fab600c87c0 tx=0x7fab50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.420+0000 7fab56ffd640 1 -- 172.21.15.114:0/295645824 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fab601429f0 con 0x7fab60158fd0 2023-11-04T01:39:05.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.624+0000 7fab64e21640 1 -- 172.21.15.114:0/295645824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab601429f0 con 0x7fab60158fd0 2023-11-04T01:39:05.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.624+0000 7fab56ffd640 1 -- 172.21.15.114:0/295645824 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fab601429f0 con 0x7fab60158fd0 2023-11-04T01:39:05.626 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:05.626 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5731,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/4055552299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4055552299},{"type":"v1","addr":"172.21.15.141:6835","nonce":4055552299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6471,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/4254364199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":4254364199},{"type":"v1","addr":"172.21.15.114:6836","nonce":4254364199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6474,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3499206733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3499206733},{"type":"v1","addr":"172.21.15.114:6837","nonce":3499206733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:50.176333+0000","modified":"2023-11-04T01:38:52.173738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6486},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6486":{"gid":6486,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6834/1383574171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1383574171},{"type":"v1","addr":"172.21.15.141:6834","nonce":1383574171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:39:05.627 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 29 2023-11-04T01:39:05.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.626+0000 7fab64e21640 1 -- 172.21.15.114:0/295645824 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab4006ae70 msgr2=0x7fab4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.626+0000 7fab64e21640 1 --2- 172.21.15.114:0/295645824 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab4006ae70 0x7fab4006d330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fab600c87c0 tx=0x7fab50008040 comp rx=0 tx=0).stop 2023-11-04T01:39:05.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.626+0000 7fab64e21640 1 -- 172.21.15.114:0/295645824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab60158fd0 msgr2=0x7fab601443d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.626+0000 7fab64e21640 1 --2- 172.21.15.114:0/295645824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab60158fd0 0x7fab601443d0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fab580013d0 tx=0x7fab6006e170 comp rx=0 tx=0).stop 2023-11-04T01:39:05.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.626+0000 7fab64e21640 1 -- 172.21.15.114:0/295645824 shutdown_connections 2023-11-04T01:39:05.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.626+0000 7fab64e21640 1 --2- 172.21.15.114:0/295645824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab60158fd0 0x7fab601443d0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.626+0000 7fab64e21640 1 --2- 172.21.15.114:0/295645824 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab4006ae70 0x7fab4006d330 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.626+0000 7fab64e21640 1 --2- 172.21.15.114:0/295645824 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab600c71b0 0x7fab60158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.626+0000 7fab64e21640 1 --2- 172.21.15.114:0/295645824 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab600c57e0 0x7fab600c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.626+0000 7fab64e21640 1 -- 172.21.15.114:0/295645824 >> 172.21.15.114:0/295645824 conn(0x7fab600b0cd0 msgr2=0x7fab600abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.626+0000 7fab64e21640 1 -- 172.21.15.114:0/295645824 shutdown_connections 2023-11-04T01:39:05.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.626+0000 7fab64e21640 1 -- 172.21.15.114:0/295645824 wait complete. 2023-11-04T01:39:05.639 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:05.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.737+0000 7fc2f616c640 1 Processor -- start 2023-11-04T01:39:05.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.737+0000 7fc2f616c640 1 -- start start 2023-11-04T01:39:05.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.738+0000 7fc2f616c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2f015ad80 0x7fc2f00abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.738+0000 7fc2f616c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc2f00c9a40 0x7fc2f00c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.738+0000 7fc2f616c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f006b720 con 0x7fc2f006a1b0 2023-11-04T01:39:05.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.738+0000 7fc2f616c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f00ca430 con 0x7fc2f00c9a40 2023-11-04T01:39:05.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.738+0000 7fc2f616c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f006cf60 con 0x7fc2f015ad80 2023-11-04T01:39:05.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.739+0000 7fc2ef7fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2f015ad80 0x7fc2f00abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.739+0000 7fc2effff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc2f00c9a40 0x7fc2f00c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.739+0000 7fc2e7fff640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fc2f006a1b0 0x7fc2f006b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:54296/0 (socket says 172.21.15.114:54296) 2023-11-04T01:39:05.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.739+0000 7fc2e7fff640 1 -- 172.21.15.114:0/1319854991 learned_addr learned my addr 172.21.15.114:0/1319854991 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:05.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.739+0000 7fc2ef7fe640 1 -- 172.21.15.114:0/1319854991 >> v2:172.21.15.141:3300/0 conn(0x7fc2f00c9a40 msgr2=0x7fc2f00c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:05.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.739+0000 7fc2ef7fe640 1 --2- 172.21.15.114:0/1319854991 >> v2:172.21.15.141:3300/0 conn(0x7fc2f00c9a40 0x7fc2f00c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.739+0000 7fc2ef7fe640 1 -- 172.21.15.114:0/1319854991 >> v1:172.21.15.141:6789/0 conn(0x7fc2f006a1b0 legacy=0x7fc2f006b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.739+0000 7fc2ef7fe640 1 -- 172.21.15.114:0/1319854991 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f00ac390 con 0x7fc2f015ad80 2023-11-04T01:39:05.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.739+0000 7fc2eeffd640 1 -- 172.21.15.114:0/1319854991 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233313406 0 0) 0x7fc2f006b720 con 0x7fc2f006a1b0 2023-11-04T01:39:05.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.739+0000 7fc2effff640 1 --2- 172.21.15.114:0/1319854991 >> v2:172.21.15.141:3300/0 conn(0x7fc2f00c9a40 0x7fc2f00c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:05.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.740+0000 7fc2ef7fe640 1 --2- 172.21.15.114:0/1319854991 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2f015ad80 0x7fc2f00abe50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00097a0 tx=0x7fc2e002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dad0ed3529ca62e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.740+0000 7fc2eeffd640 1 -- 172.21.15.114:0/1319854991 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0031830 con 0x7fc2f015ad80 2023-11-04T01:39:05.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.740+0000 7fc2eeffd640 1 -- 172.21.15.114:0/1319854991 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e0031990 con 0x7fc2f015ad80 2023-11-04T01:39:05.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.740+0000 7fc2eeffd640 1 -- 172.21.15.114:0/1319854991 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0031d20 con 0x7fc2f015ad80 2023-11-04T01:39:05.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.741+0000 7fc2f616c640 1 -- 172.21.15.114:0/1319854991 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2f015ad80 msgr2=0x7fc2f00abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.741+0000 7fc2f616c640 1 --2- 172.21.15.114:0/1319854991 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2f015ad80 0x7fc2f00abe50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00097a0 tx=0x7fc2e002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.741+0000 7fc2f616c640 1 -- 172.21.15.114:0/1319854991 shutdown_connections 2023-11-04T01:39:05.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.741+0000 7fc2f616c640 1 --2- 172.21.15.114:0/1319854991 >> v2:172.21.15.141:3300/0 conn(0x7fc2f00c9a40 0x7fc2f00c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.741+0000 7fc2f616c640 1 --2- 172.21.15.114:0/1319854991 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2f015ad80 0x7fc2f00abe50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.741+0000 7fc2f616c640 1 -- 172.21.15.114:0/1319854991 >> 172.21.15.114:0/1319854991 conn(0x7fc2f00b0cd0 msgr2=0x7fc2f00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.741+0000 7fc2f616c640 1 -- 172.21.15.114:0/1319854991 shutdown_connections 2023-11-04T01:39:05.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.741+0000 7fc2f616c640 1 -- 172.21.15.114:0/1319854991 wait complete. 2023-11-04T01:39:05.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.742+0000 7fc2f616c640 1 Processor -- start 2023-11-04T01:39:05.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.742+0000 7fc2f616c640 1 -- start start 2023-11-04T01:39:05.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.742+0000 7fc2f616c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2f006a1b0 0x7fc2f014b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.742+0000 7fc2f616c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2f00c9a40 0x7fc2f014d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2f616c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f015ad80 0x7fc2f014e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2f616c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f014bc10 con 0x7fc2f015ad80 2023-11-04T01:39:05.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2f616c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f014c4d0 con 0x7fc2f00c9a40 2023-11-04T01:39:05.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2f616c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f014c7b0 con 0x7fc2f006a1b0 2023-11-04T01:39:05.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2effff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f015ad80 0x7fc2f014e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2effff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f015ad80 0x7fc2f014e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55582/0 (socket says 172.21.15.114:55582) 2023-11-04T01:39:05.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2effff640 1 -- 172.21.15.114:0/2736321512 learned_addr learned my addr 172.21.15.114:0/2736321512 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:05.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2ef7fe640 1 --2- 172.21.15.114:0/2736321512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2f006a1b0 0x7fc2f014b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2e7fff640 1 --2- 172.21.15.114:0/2736321512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2f00c9a40 0x7fc2f014d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2effff640 1 -- 172.21.15.114:0/2736321512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2f006a1b0 msgr2=0x7fc2f014b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2effff640 1 --2- 172.21.15.114:0/2736321512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2f006a1b0 0x7fc2f014b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2effff640 1 -- 172.21.15.114:0/2736321512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2f00c9a40 msgr2=0x7fc2f014d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2effff640 1 --2- 172.21.15.114:0/2736321512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2f00c9a40 0x7fc2f014d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2effff640 1 -- 172.21.15.114:0/2736321512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e8009a70 con 0x7fc2f015ad80 2023-11-04T01:39:05.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2effff640 1 --2- 172.21.15.114:0/2736321512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f015ad80 0x7fc2f014e600 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800efc0 tx=0x7fc2e8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2ecff9640 1 -- 172.21.15.114:0/2736321512 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8009d70 con 0x7fc2f015ad80 2023-11-04T01:39:05.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2ecff9640 1 -- 172.21.15.114:0/2736321512 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e800f040 con 0x7fc2f015ad80 2023-11-04T01:39:05.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2ecff9640 1 -- 172.21.15.114:0/2736321512 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8003990 con 0x7fc2f015ad80 2023-11-04T01:39:05.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2f616c640 1 -- 172.21.15.114:0/2736321512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e0009400 con 0x7fc2f015ad80 2023-11-04T01:39:05.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.743+0000 7fc2f616c640 1 -- 172.21.15.114:0/2736321512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f014cd70 con 0x7fc2f015ad80 2023-11-04T01:39:05.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.744+0000 7fc2f616c640 1 -- 172.21.15.114:0/2736321512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f0074290 con 0x7fc2f015ad80 2023-11-04T01:39:05.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.745+0000 7fc2ecff9640 1 -- 172.21.15.114:0/2736321512 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc2e80144a0 con 0x7fc2f015ad80 2023-11-04T01:39:05.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.745+0000 7fc2ecff9640 1 --2- 172.21.15.114:0/2736321512 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc2d006ae70 0x7fc2d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:05.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.745+0000 7fc2ecff9640 1 -- 172.21.15.114:0/2736321512 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fc2e808a6a0 con 0x7fc2f015ad80 2023-11-04T01:39:05.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.745+0000 7fc2ef7fe640 1 --2- 172.21.15.114:0/2736321512 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc2d006ae70 0x7fc2d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:05.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.746+0000 7fc2ef7fe640 1 --2- 172.21.15.114:0/2736321512 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc2d006ae70 0x7fc2d006d330 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0036000 tx=0x7fc2e003e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:05.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.750+0000 7fc2ecff9640 1 -- 172.21.15.114:0/2736321512 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc2e8055280 con 0x7fc2f015ad80 2023-11-04T01:39:05.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.921+0000 7fc2f616c640 1 -- 172.21.15.114:0/2736321512 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2f0066320 con 0x7fc2f015ad80 2023-11-04T01:39:05.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.923+0000 7fc2ecff9640 1 -- 172.21.15.114:0/2736321512 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+22117 (secure 0 0 0) 0x7fc2e80588a0 con 0x7fc2f015ad80 2023-11-04T01:39:05.925 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:05.925 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":71,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:05.562462+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:48.665033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:49.137709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.924+0000 7fc2f616c640 1 -- 172.21.15.114:0/2736321512 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc2d006ae70 msgr2=0x7fc2d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.925+0000 7fc2f616c640 1 --2- 172.21.15.114:0/2736321512 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc2d006ae70 0x7fc2d006d330 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0036000 tx=0x7fc2e003e040 comp rx=0 tx=0).stop 2023-11-04T01:39:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.925+0000 7fc2f616c640 1 -- 172.21.15.114:0/2736321512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f015ad80 msgr2=0x7fc2f014e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.925+0000 7fc2f616c640 1 --2- 172.21.15.114:0/2736321512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f015ad80 0x7fc2f014e600 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800efc0 tx=0x7fc2e8009f90 comp rx=0 tx=0).stop 2023-11-04T01:39:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.925+0000 7fc2f616c640 1 -- 172.21.15.114:0/2736321512 shutdown_connections 2023-11-04T01:39:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.925+0000 7fc2f616c640 1 --2- 172.21.15.114:0/2736321512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f015ad80 0x7fc2f014e600 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.925+0000 7fc2f616c640 1 --2- 172.21.15.114:0/2736321512 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc2d006ae70 0x7fc2d006d330 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.925+0000 7fc2f616c640 1 --2- 172.21.15.114:0/2736321512 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2f00c9a40 0x7fc2f014d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.925+0000 7fc2f616c640 1 --2- 172.21.15.114:0/2736321512 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2f006a1b0 0x7fc2f014b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.925+0000 7fc2f616c640 1 -- 172.21.15.114:0/2736321512 >> 172.21.15.114:0/2736321512 conn(0x7fc2f00b0cd0 msgr2=0x7fc2f0155770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.925+0000 7fc2f616c640 1 -- 172.21.15.114:0/2736321512 shutdown_connections 2023-11-04T01:39:05.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:05.925+0000 7fc2f616c640 1 -- 172.21.15.114:0/2736321512 wait complete. 2023-11-04T01:39:05.937 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:38:48.665033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:38:49.137709+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:58.316710+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:59.185397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:05.938 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:06.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.040+0000 7f2821355640 1 Processor -- start 2023-11-04T01:39:06.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.040+0000 7f2821355640 1 -- start start 2023-11-04T01:39:06.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.041+0000 7f2821355640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f281c153e60 0x7f281c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.041+0000 7f2821355640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f281c0cd6d0 0x7f281c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.041+0000 7f2821355640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f281c0b4880 0x7f281c0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.041+0000 7f2821355640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281c0cde60 con 0x7f281c153e60 2023-11-04T01:39:06.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.041+0000 7f2821355640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281c0b5220 con 0x7f281c0cd6d0 2023-11-04T01:39:06.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.041+0000 7f2821355640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c160f90 con 0x7f281c0b4880 2023-11-04T01:39:06.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.041+0000 7f281affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f281c153e60 0x7f281c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.041+0000 7f281affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f281c153e60 0x7f281c15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55592/0 (socket says 172.21.15.114:55592) 2023-11-04T01:39:06.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.041+0000 7f281affd640 1 -- 172.21.15.114:0/1721688393 learned_addr learned my addr 172.21.15.114:0/1721688393 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:06.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.041+0000 7f281b7fe640 1 --2- 172.21.15.114:0/1721688393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f281c0b4880 0x7f281c0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.041+0000 7f28127fc640 1 --2- 172.21.15.114:0/1721688393 >> v2:172.21.15.141:3300/0 conn(0x7f281c0cd6d0 0x7f281c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.041+0000 7f281affd640 1 -- 172.21.15.114:0/1721688393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f281c0b4880 msgr2=0x7f281c0b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:06.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.041+0000 7f281affd640 1 --2- 172.21.15.114:0/1721688393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f281c0b4880 0x7f281c0b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.041+0000 7f281affd640 1 -- 172.21.15.114:0/1721688393 >> v2:172.21.15.141:3300/0 conn(0x7f281c0cd6d0 msgr2=0x7f281c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.041+0000 7f281affd640 1 --2- 172.21.15.114:0/1721688393 >> v2:172.21.15.141:3300/0 conn(0x7f281c0cd6d0 0x7f281c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.041+0000 7f281affd640 1 -- 172.21.15.114:0/1721688393 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c15e400 con 0x7f281c153e60 2023-11-04T01:39:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.042+0000 7f281affd640 1 --2- 172.21.15.114:0/1721688393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f281c153e60 0x7f281c15dec0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f281c0c9e80 tx=0x7f280c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0682af24c3ffcb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.042+0000 7f281a7fc640 1 -- 172.21.15.114:0/1721688393 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c031640 con 0x7f281c153e60 2023-11-04T01:39:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.042+0000 7f281a7fc640 1 -- 172.21.15.114:0/1721688393 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280c0317a0 con 0x7f281c153e60 2023-11-04T01:39:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.042+0000 7f281a7fc640 1 -- 172.21.15.114:0/1721688393 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c031b30 con 0x7f281c153e60 2023-11-04T01:39:06.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.042+0000 7f2821355640 1 -- 172.21.15.114:0/1721688393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f281c153e60 msgr2=0x7f281c15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.042+0000 7f2821355640 1 --2- 172.21.15.114:0/1721688393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f281c153e60 0x7f281c15dec0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f281c0c9e80 tx=0x7f280c02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.042+0000 7f2821355640 1 -- 172.21.15.114:0/1721688393 shutdown_connections 2023-11-04T01:39:06.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.042+0000 7f2821355640 1 --2- 172.21.15.114:0/1721688393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f281c0b4880 0x7f281c0b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.042+0000 7f2821355640 1 --2- 172.21.15.114:0/1721688393 >> v2:172.21.15.141:3300/0 conn(0x7f281c0cd6d0 0x7f281c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.042+0000 7f2821355640 1 --2- 172.21.15.114:0/1721688393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f281c153e60 0x7f281c15dec0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.042+0000 7f2821355640 1 -- 172.21.15.114:0/1721688393 >> 172.21.15.114:0/1721688393 conn(0x7f281c0cf880 msgr2=0x7f281c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:06.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.042+0000 7f2821355640 1 -- 172.21.15.114:0/1721688393 shutdown_connections 2023-11-04T01:39:06.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.043+0000 7f2821355640 1 -- 172.21.15.114:0/1721688393 wait complete. 2023-11-04T01:39:06.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.044+0000 7f2821355640 1 Processor -- start 2023-11-04T01:39:06.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.044+0000 7f2821355640 1 -- start start 2023-11-04T01:39:06.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f2821355640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f281c0b4880 0x7f281c144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f2821355640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f281c0cd6d0 0x7f281c0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f2821355640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f281c153e60 0x7f281c155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f2821355640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c1450d0 con 0x7f281c153e60 2023-11-04T01:39:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f2821355640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c1424b0 con 0x7f281c0b4880 2023-11-04T01:39:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f2821355640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c142790 con 0x7f281c0cd6d0 2023-11-04T01:39:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f281b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f281c153e60 0x7f281c155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f281b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f281c153e60 0x7f281c155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55608/0 (socket says 172.21.15.114:55608) 2023-11-04T01:39:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f281b7fe640 1 -- 172.21.15.114:0/1337832351 learned_addr learned my addr 172.21.15.114:0/1337832351 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f281affd640 1 --2- 172.21.15.114:0/1337832351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f281c0b4880 0x7f281c144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f281b7fe640 1 -- 172.21.15.114:0/1337832351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f281c0cd6d0 msgr2=0x7f281c0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f28127fc640 1 --2- 172.21.15.114:0/1337832351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f281c0cd6d0 0x7f281c0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f281b7fe640 1 --2- 172.21.15.114:0/1337832351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f281c0cd6d0 0x7f281c0cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f281b7fe640 1 -- 172.21.15.114:0/1337832351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f281c0b4880 msgr2=0x7f281c144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f281b7fe640 1 --2- 172.21.15.114:0/1337832351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f281c0b4880 0x7f281c144b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f281b7fe640 1 -- 172.21.15.114:0/1337832351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c0094d0 con 0x7f281c153e60 2023-11-04T01:39:06.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f281b7fe640 1 --2- 172.21.15.114:0/1337832351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f281c153e60 0x7f281c155290 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f2814007e60 tx=0x7f281400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f2813fff640 1 -- 172.21.15.114:0/1337832351 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814014620 con 0x7f281c153e60 2023-11-04T01:39:06.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f2813fff640 1 -- 172.21.15.114:0/1337832351 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281400ee90 con 0x7f281c153e60 2023-11-04T01:39:06.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f2821355640 1 -- 172.21.15.114:0/1337832351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c142a70 con 0x7f281c153e60 2023-11-04T01:39:06.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f2813fff640 1 -- 172.21.15.114:0/1337832351 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28140149e0 con 0x7f281c153e60 2023-11-04T01:39:06.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.045+0000 7f2821355640 1 -- 172.21.15.114:0/1337832351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c143030 con 0x7f281c153e60 2023-11-04T01:39:06.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.046+0000 7f2821355640 1 -- 172.21.15.114:0/1337832351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c074290 con 0x7f281c153e60 2023-11-04T01:39:06.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.047+0000 7f2813fff640 1 -- 172.21.15.114:0/1337832351 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2814014b40 con 0x7f281c153e60 2023-11-04T01:39:06.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.047+0000 7f2813fff640 1 --2- 172.21.15.114:0/1337832351 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27fc06ae70 0x7f27fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.047+0000 7f2813fff640 1 -- 172.21.15.114:0/1337832351 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f281408a580 con 0x7f281c153e60 2023-11-04T01:39:06.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.047+0000 7f281affd640 1 --2- 172.21.15.114:0/1337832351 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27fc06ae70 0x7f27fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.047+0000 7f281affd640 1 --2- 172.21.15.114:0/1337832351 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27fc06ae70 0x7f27fc06d330 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f280c036000 tx=0x7f280c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.051+0000 7f2813fff640 1 -- 172.21.15.114:0/1337832351 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2814055020 con 0x7f281c153e60 2023-11-04T01:39:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.217+0000 7f2821355640 1 -- 172.21.15.114:0/1337832351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f281c0d0b80 con 0x7f281c153e60 2023-11-04T01:39:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.217+0000 7f2813fff640 1 -- 172.21.15.114:0/1337832351 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2814058640 con 0x7f281c153e60 2023-11-04T01:39:06.219 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:39:06.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.219+0000 7f2821355640 1 -- 172.21.15.114:0/1337832351 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27fc06ae70 msgr2=0x7f27fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.219+0000 7f2821355640 1 --2- 172.21.15.114:0/1337832351 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27fc06ae70 0x7f27fc06d330 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f280c036000 tx=0x7f280c03c040 comp rx=0 tx=0).stop 2023-11-04T01:39:06.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.219+0000 7f2821355640 1 -- 172.21.15.114:0/1337832351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f281c153e60 msgr2=0x7f281c155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.219+0000 7f2821355640 1 --2- 172.21.15.114:0/1337832351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f281c153e60 0x7f281c155290 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f2814007e60 tx=0x7f281400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.219+0000 7f2821355640 1 -- 172.21.15.114:0/1337832351 shutdown_connections 2023-11-04T01:39:06.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.219+0000 7f2821355640 1 --2- 172.21.15.114:0/1337832351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f281c153e60 0x7f281c155290 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.219+0000 7f2821355640 1 --2- 172.21.15.114:0/1337832351 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f281c0cd6d0 0x7f281c0cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.219+0000 7f2821355640 1 --2- 172.21.15.114:0/1337832351 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f27fc06ae70 0x7f27fc06d330 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.219+0000 7f2821355640 1 --2- 172.21.15.114:0/1337832351 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f281c0b4880 0x7f281c144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.219+0000 7f2821355640 1 -- 172.21.15.114:0/1337832351 >> 172.21.15.114:0/1337832351 conn(0x7f281c0cf880 msgr2=0x7f281c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:06.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.219+0000 7f2821355640 1 -- 172.21.15.114:0/1337832351 shutdown_connections 2023-11-04T01:39:06.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.219+0000 7f2821355640 1 -- 172.21.15.114:0/1337832351 wait complete. 2023-11-04T01:39:06.231 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:39:06.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.331+0000 7fb0f3105640 1 Processor -- start 2023-11-04T01:39:06.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.332+0000 7fb0f3105640 1 -- start start 2023-11-04T01:39:06.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.332+0000 7fb0f3105640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0ec15e430 0x7fb0ec0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.332+0000 7fb0f3105640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0ec0cf160 0x7fb0ec0cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.332+0000 7fb0f3105640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb0ec0d0710 0x7fb0ec0cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.332+0000 7fb0f3105640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ec0cdf90 con 0x7fb0ec0cf160 2023-11-04T01:39:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.332+0000 7fb0f3105640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ec0d0280 con 0x7fb0ec0d0710 2023-11-04T01:39:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.332+0000 7fb0f3105640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec0cf670 con 0x7fb0ec15e430 2023-11-04T01:39:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.333+0000 7fb0ebfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0ec0cf160 0x7fb0ec0cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.333+0000 7fb0ebfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0ec0cf160 0x7fb0ec0cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55618/0 (socket says 172.21.15.114:55618) 2023-11-04T01:39:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.333+0000 7fb0ebfff640 1 -- 172.21.15.114:0/1818442303 learned_addr learned my addr 172.21.15.114:0/1818442303 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.333+0000 7fb0f16a2640 1 --2- 172.21.15.114:0/1818442303 >> v2:172.21.15.141:3300/0 conn(0x7fb0ec0d0710 0x7fb0ec0cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.333+0000 7fb0f0ea1640 1 --2- 172.21.15.114:0/1818442303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0ec15e430 0x7fb0ec0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.333+0000 7fb0ebfff640 1 -- 172.21.15.114:0/1818442303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0ec15e430 msgr2=0x7fb0ec0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.333+0000 7fb0ebfff640 1 --2- 172.21.15.114:0/1818442303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0ec15e430 0x7fb0ec0cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.333+0000 7fb0ebfff640 1 -- 172.21.15.114:0/1818442303 >> v2:172.21.15.141:3300/0 conn(0x7fb0ec0d0710 msgr2=0x7fb0ec0cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.333+0000 7fb0ebfff640 1 --2- 172.21.15.114:0/1818442303 >> v2:172.21.15.141:3300/0 conn(0x7fb0ec0d0710 0x7fb0ec0cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.333+0000 7fb0ebfff640 1 -- 172.21.15.114:0/1818442303 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec0cf950 con 0x7fb0ec0cf160 2023-11-04T01:39:06.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.333+0000 7fb0f16a2640 1 --2- 172.21.15.114:0/1818442303 >> v2:172.21.15.141:3300/0 conn(0x7fb0ec0d0710 0x7fb0ec0cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:06.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.334+0000 7fb0ebfff640 1 --2- 172.21.15.114:0/1818442303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec0cf160 0x7fb0ec0cd510 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec06f860 tx=0x7fb0e002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10daa238c060b27 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.334+0000 7fb0eb7fe640 1 -- 172.21.15.114:0/1818442303 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0031870 con 0x7fb0ec0cf160 2023-11-04T01:39:06.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.334+0000 7fb0eb7fe640 1 -- 172.21.15.114:0/1818442303 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e00319d0 con 0x7fb0ec0cf160 2023-11-04T01:39:06.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.334+0000 7fb0eb7fe640 1 -- 172.21.15.114:0/1818442303 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0031d60 con 0x7fb0ec0cf160 2023-11-04T01:39:06.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.334+0000 7fb0f3105640 1 -- 172.21.15.114:0/1818442303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec0cf160 msgr2=0x7fb0ec0cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.334+0000 7fb0f3105640 1 --2- 172.21.15.114:0/1818442303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec0cf160 0x7fb0ec0cd510 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec06f860 tx=0x7fb0e002b910 comp rx=0 tx=0).stop 2023-11-04T01:39:06.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.334+0000 7fb0f3105640 1 -- 172.21.15.114:0/1818442303 shutdown_connections 2023-11-04T01:39:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.334+0000 7fb0f3105640 1 --2- 172.21.15.114:0/1818442303 >> v2:172.21.15.141:3300/0 conn(0x7fb0ec0d0710 0x7fb0ec0cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.334+0000 7fb0f3105640 1 --2- 172.21.15.114:0/1818442303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec0cf160 0x7fb0ec0cd510 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.334+0000 7fb0f3105640 1 --2- 172.21.15.114:0/1818442303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0ec15e430 0x7fb0ec0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.334+0000 7fb0f3105640 1 -- 172.21.15.114:0/1818442303 >> 172.21.15.114:0/1818442303 conn(0x7fb0ec06ea20 msgr2=0x7fb0ec06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.334+0000 7fb0f3105640 1 -- 172.21.15.114:0/1818442303 shutdown_connections 2023-11-04T01:39:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.334+0000 7fb0f3105640 1 -- 172.21.15.114:0/1818442303 wait complete. 2023-11-04T01:39:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.335+0000 7fb0f3105640 1 Processor -- start 2023-11-04T01:39:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.336+0000 7fb0f3105640 1 -- start start 2023-11-04T01:39:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.336+0000 7fb0f3105640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0ec0cf160 0x7fb0ec1480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.336+0000 7fb0f3105640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0ec0d0710 0x7fb0ec15c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.336+0000 7fb0f3105640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec15e430 0x7fb0ec1f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.336+0000 7fb0f3105640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec0c8f90 con 0x7fb0ec15e430 2023-11-04T01:39:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.336+0000 7fb0f3105640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec148a00 con 0x7fb0ec0cf160 2023-11-04T01:39:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.336+0000 7fb0f3105640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec0a7540 con 0x7fb0ec0d0710 2023-11-04T01:39:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.336+0000 7fb0f16a2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec15e430 0x7fb0ec1f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0f16a2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec15e430 0x7fb0ec1f3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55622/0 (socket says 172.21.15.114:55622) 2023-11-04T01:39:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0f16a2640 1 -- 172.21.15.114:0/2066214242 learned_addr learned my addr 172.21.15.114:0/2066214242 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0ebfff640 1 --2- 172.21.15.114:0/2066214242 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0ec0d0710 0x7fb0ec15c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0f0ea1640 1 --2- 172.21.15.114:0/2066214242 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0ec0cf160 0x7fb0ec1480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0f16a2640 1 -- 172.21.15.114:0/2066214242 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0ec0d0710 msgr2=0x7fb0ec15c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0f16a2640 1 --2- 172.21.15.114:0/2066214242 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0ec0d0710 0x7fb0ec15c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0f16a2640 1 -- 172.21.15.114:0/2066214242 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0ec0cf160 msgr2=0x7fb0ec1480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0f16a2640 1 --2- 172.21.15.114:0/2066214242 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0ec0cf160 0x7fb0ec1480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0f16a2640 1 -- 172.21.15.114:0/2066214242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e00094d0 con 0x7fb0ec15e430 2023-11-04T01:39:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0f0ea1640 1 --2- 172.21.15.114:0/2066214242 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0ec0cf160 0x7fb0ec1480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0ebfff640 1 --2- 172.21.15.114:0/2066214242 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0ec0d0710 0x7fb0ec15c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0f16a2640 1 --2- 172.21.15.114:0/2066214242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec15e430 0x7fb0ec1f3920 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400cd10 tx=0x7fb0e400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0e97fa640 1 -- 172.21.15.114:0/2066214242 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e400f680 con 0x7fb0ec15e430 2023-11-04T01:39:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0e97fa640 1 -- 172.21.15.114:0/2066214242 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e400f800 con 0x7fb0ec15e430 2023-11-04T01:39:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0e97fa640 1 -- 172.21.15.114:0/2066214242 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e400fbb0 con 0x7fb0ec15e430 2023-11-04T01:39:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0f3105640 1 -- 172.21.15.114:0/2066214242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ec0c8310 con 0x7fb0ec15e430 2023-11-04T01:39:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.337+0000 7fb0f3105640 1 -- 172.21.15.114:0/2066214242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ec0c88d0 con 0x7fb0ec15e430 2023-11-04T01:39:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.338+0000 7fb0f3105640 1 -- 172.21.15.114:0/2066214242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ec0c90d0 con 0x7fb0ec15e430 2023-11-04T01:39:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.338+0000 7fb0e97fa640 1 -- 172.21.15.114:0/2066214242 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb0e400b040 con 0x7fb0ec15e430 2023-11-04T01:39:06.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.339+0000 7fb0e97fa640 1 --2- 172.21.15.114:0/2066214242 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0d806aea0 0x7fb0d806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.339+0000 7fb0e97fa640 1 -- 172.21.15.114:0/2066214242 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fb0e408a5e0 con 0x7fb0ec15e430 2023-11-04T01:39:06.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.339+0000 7fb0f0ea1640 1 --2- 172.21.15.114:0/2066214242 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0d806aea0 0x7fb0d806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.339+0000 7fb0f0ea1640 1 --2- 172.21.15.114:0/2066214242 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0d806aea0 0x7fb0d806d360 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00a9d0 tx=0x7fb0dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.343+0000 7fb0e97fa640 1 -- 172.21.15.114:0/2066214242 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0ec0c90d0 con 0x7fb0ec15e430 2023-11-04T01:39:06.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.508+0000 7fb0f3105640 1 -- 172.21.15.114:0/2066214242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fb0ec0c90d0 con 0x7fb0ec15e430 2023-11-04T01:39:06.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.509+0000 7fb0e97fa640 1 -- 172.21.15.114:0/2066214242 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v71) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb0ec0c90d0 con 0x7fb0ec15e430 2023-11-04T01:39:06.511 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.511+0000 7fb0f3105640 1 -- 172.21.15.114:0/2066214242 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0d806aea0 msgr2=0x7fb0d806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.511+0000 7fb0f3105640 1 --2- 172.21.15.114:0/2066214242 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0d806aea0 0x7fb0d806d360 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00a9d0 tx=0x7fb0dc008040 comp rx=0 tx=0).stop 2023-11-04T01:39:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.511+0000 7fb0f3105640 1 -- 172.21.15.114:0/2066214242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec15e430 msgr2=0x7fb0ec1f3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.511+0000 7fb0f3105640 1 --2- 172.21.15.114:0/2066214242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec15e430 0x7fb0ec1f3920 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400cd10 tx=0x7fb0e400a650 comp rx=0 tx=0).stop 2023-11-04T01:39:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.511+0000 7fb0f3105640 1 -- 172.21.15.114:0/2066214242 shutdown_connections 2023-11-04T01:39:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.511+0000 7fb0f3105640 1 --2- 172.21.15.114:0/2066214242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec15e430 0x7fb0ec1f3920 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.511+0000 7fb0f3105640 1 --2- 172.21.15.114:0/2066214242 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0ec0d0710 0x7fb0ec15c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.511+0000 7fb0f3105640 1 --2- 172.21.15.114:0/2066214242 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0d806aea0 0x7fb0d806d360 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.511+0000 7fb0f3105640 1 --2- 172.21.15.114:0/2066214242 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0ec0cf160 0x7fb0ec1480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.511+0000 7fb0f3105640 1 -- 172.21.15.114:0/2066214242 >> 172.21.15.114:0/2066214242 conn(0x7fb0ec06ea20 msgr2=0x7fb0ec0c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.511+0000 7fb0f3105640 1 -- 172.21.15.114:0/2066214242 shutdown_connections 2023-11-04T01:39:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.511+0000 7fb0f3105640 1 -- 172.21.15.114:0/2066214242 wait complete. 2023-11-04T01:39:06.523 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:39:06.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.626+0000 7fae0db3e640 1 Processor -- start 2023-11-04T01:39:06.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.626+0000 7fae0db3e640 1 -- start start 2023-11-04T01:39:06.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.627+0000 7fae0db3e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fae08159c00 0x7fae080cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.627+0000 7fae0db3e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fae080ae1d0 0x7fae080c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.627+0000 7fae0db3e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0815aff0 con 0x7fae080c48e0 2023-11-04T01:39:06.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.627+0000 7fae0db3e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae080c52d0 con 0x7fae080ae1d0 2023-11-04T01:39:06.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.627+0000 7fae0db3e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0815a3e0 con 0x7fae08159c00 2023-11-04T01:39:06.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.627+0000 7fae07fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fae080ae1d0 0x7fae080c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.627+0000 7fae06ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fae080c48e0 0x7fae080adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51078/0 (socket says 172.21.15.114:51078) 2023-11-04T01:39:06.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.627+0000 7fae06ffd640 1 -- 172.21.15.114:0/1653404550 learned_addr learned my addr 172.21.15.114:0/1653404550 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:06.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.627+0000 7fae077fe640 1 --2- 172.21.15.114:0/1653404550 >> v2:172.21.15.141:3300/0 conn(0x7fae08159c00 0x7fae080cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.627+0000 7fae07fff640 1 -- 172.21.15.114:0/1653404550 >> v2:172.21.15.141:3300/0 conn(0x7fae08159c00 msgr2=0x7fae080cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:06.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.627+0000 7fae07fff640 1 --2- 172.21.15.114:0/1653404550 >> v2:172.21.15.141:3300/0 conn(0x7fae08159c00 0x7fae080cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.627+0000 7fae07fff640 1 -- 172.21.15.114:0/1653404550 >> v1:172.21.15.114:6789/0 conn(0x7fae080c48e0 legacy=0x7fae080adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.627+0000 7fae067fc640 1 -- 172.21.15.114:0/1653404550 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047569542 0 0) 0x7fae0815aff0 con 0x7fae080c48e0 2023-11-04T01:39:06.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.627+0000 7fae07fff640 1 -- 172.21.15.114:0/1653404550 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0815a6c0 con 0x7fae080ae1d0 2023-11-04T01:39:06.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.628+0000 7fae07fff640 1 --2- 172.21.15.114:0/1653404550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae080ae1d0 0x7fae080c4d90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fae080cc4d0 tx=0x7fae0002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4173f3b9413ff8c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.628+0000 7fae067fc640 1 -- 172.21.15.114:0/1653404550 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0002cbf0 con 0x7fae080ae1d0 2023-11-04T01:39:06.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.628+0000 7fae067fc640 1 -- 172.21.15.114:0/1653404550 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0002cd50 con 0x7fae080ae1d0 2023-11-04T01:39:06.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.628+0000 7fae067fc640 1 -- 172.21.15.114:0/1653404550 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00034660 con 0x7fae080ae1d0 2023-11-04T01:39:06.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.629+0000 7fae0db3e640 1 -- 172.21.15.114:0/1653404550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae080ae1d0 msgr2=0x7fae080c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.629+0000 7fae0db3e640 1 --2- 172.21.15.114:0/1653404550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae080ae1d0 0x7fae080c4d90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fae080cc4d0 tx=0x7fae0002be40 comp rx=0 tx=0).stop 2023-11-04T01:39:06.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.629+0000 7fae0db3e640 1 -- 172.21.15.114:0/1653404550 shutdown_connections 2023-11-04T01:39:06.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.629+0000 7fae0db3e640 1 --2- 172.21.15.114:0/1653404550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae080ae1d0 0x7fae080c4d90 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.629+0000 7fae0db3e640 1 --2- 172.21.15.114:0/1653404550 >> v2:172.21.15.141:3300/0 conn(0x7fae08159c00 0x7fae080cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.629+0000 7fae0db3e640 1 -- 172.21.15.114:0/1653404550 >> 172.21.15.114:0/1653404550 conn(0x7fae080ce950 msgr2=0x7fae080ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:06.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.629+0000 7fae0db3e640 1 -- 172.21.15.114:0/1653404550 shutdown_connections 2023-11-04T01:39:06.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.629+0000 7fae0db3e640 1 -- 172.21.15.114:0/1653404550 wait complete. 2023-11-04T01:39:06.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.630+0000 7fae0db3e640 1 Processor -- start 2023-11-04T01:39:06.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.630+0000 7fae0db3e640 1 -- start start 2023-11-04T01:39:06.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae0db3e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae080ae1d0 0x7fae080c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae0db3e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae080c48e0 0x7fae0815c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae0db3e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae08159c00 0x7fae08142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae0db3e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae080c69f0 con 0x7fae080ae1d0 2023-11-04T01:39:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae0db3e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae080c71c0 con 0x7fae080c48e0 2023-11-04T01:39:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae0db3e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae080c74a0 con 0x7fae08159c00 2023-11-04T01:39:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae077fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae080ae1d0 0x7fae080c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae077fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae080ae1d0 0x7fae080c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45574/0 (socket says 172.21.15.114:45574) 2023-11-04T01:39:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae077fe640 1 -- 172.21.15.114:0/355259736 learned_addr learned my addr 172.21.15.114:0/355259736 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae06ffd640 1 --2- 172.21.15.114:0/355259736 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae080c48e0 0x7fae0815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae07fff640 1 --2- 172.21.15.114:0/355259736 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae08159c00 0x7fae08142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae077fe640 1 -- 172.21.15.114:0/355259736 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae08159c00 msgr2=0x7fae08142fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae077fe640 1 --2- 172.21.15.114:0/355259736 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae08159c00 0x7fae08142fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae077fe640 1 -- 172.21.15.114:0/355259736 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae080c48e0 msgr2=0x7fae0815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae077fe640 1 --2- 172.21.15.114:0/355259736 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae080c48e0 0x7fae0815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae077fe640 1 -- 172.21.15.114:0/355259736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00009a70 con 0x7fae080ae1d0 2023-11-04T01:39:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae06ffd640 1 --2- 172.21.15.114:0/355259736 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae080c48e0 0x7fae0815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae07fff640 1 --2- 172.21.15.114:0/355259736 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae08159c00 0x7fae08142fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.631+0000 7fae077fe640 1 --2- 172.21.15.114:0/355259736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae080ae1d0 0x7fae080c7f80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fadf800d5f0 tx=0x7fadf800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.632+0000 7fadfffff640 1 -- 172.21.15.114:0/355259736 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf80125f0 con 0x7fae080ae1d0 2023-11-04T01:39:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.632+0000 7fadfffff640 1 -- 172.21.15.114:0/355259736 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf8012750 con 0x7fae080ae1d0 2023-11-04T01:39:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.632+0000 7fae0db3e640 1 -- 172.21.15.114:0/355259736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae080c7780 con 0x7fae080ae1d0 2023-11-04T01:39:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.632+0000 7fadfffff640 1 -- 172.21.15.114:0/355259736 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8012b00 con 0x7fae080ae1d0 2023-11-04T01:39:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.632+0000 7fae0db3e640 1 -- 172.21.15.114:0/355259736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae080c84c0 con 0x7fae080ae1d0 2023-11-04T01:39:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.633+0000 7fae0db3e640 1 -- 172.21.15.114:0/355259736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae08074290 con 0x7fae080ae1d0 2023-11-04T01:39:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.633+0000 7fadfffff640 1 -- 172.21.15.114:0/355259736 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fadf8012c60 con 0x7fae080ae1d0 2023-11-04T01:39:06.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.633+0000 7fadfffff640 1 --2- 172.21.15.114:0/355259736 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fade806ae70 0x7fade806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.633+0000 7fadfffff640 1 -- 172.21.15.114:0/355259736 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fadf808a030 con 0x7fae080ae1d0 2023-11-04T01:39:06.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.633+0000 7fae06ffd640 1 --2- 172.21.15.114:0/355259736 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fade806ae70 0x7fade806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.634+0000 7fae06ffd640 1 --2- 172.21.15.114:0/355259736 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fade806ae70 0x7fade806d330 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fae0815ca40 tx=0x7fadf0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.638+0000 7fadfffff640 1 -- 172.21.15.114:0/355259736 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fadf8054b60 con 0x7fae080ae1d0 2023-11-04T01:39:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.801+0000 7fae0db3e640 1 -- 172.21.15.114:0/355259736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae080cacf0 con 0x7fae080ae1d0 2023-11-04T01:39:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.801+0000 7fadfffff640 1 -- 172.21.15.114:0/355259736 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7fadf8058180 con 0x7fae080ae1d0 2023-11-04T01:39:06.803 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.803+0000 7fae0db3e640 1 -- 172.21.15.114:0/355259736 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fade806ae70 msgr2=0x7fade806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.803+0000 7fae0db3e640 1 --2- 172.21.15.114:0/355259736 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fade806ae70 0x7fade806d330 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fae0815ca40 tx=0x7fadf0009040 comp rx=0 tx=0).stop 2023-11-04T01:39:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.803+0000 7fae0db3e640 1 -- 172.21.15.114:0/355259736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae080ae1d0 msgr2=0x7fae080c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.803+0000 7fae0db3e640 1 --2- 172.21.15.114:0/355259736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae080ae1d0 0x7fae080c7f80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fadf800d5f0 tx=0x7fadf800dab0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.803+0000 7fae0db3e640 1 -- 172.21.15.114:0/355259736 shutdown_connections 2023-11-04T01:39:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.803+0000 7fae0db3e640 1 --2- 172.21.15.114:0/355259736 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fae08159c00 0x7fae08142fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.803+0000 7fae0db3e640 1 --2- 172.21.15.114:0/355259736 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fade806ae70 0x7fade806d330 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.803+0000 7fae0db3e640 1 --2- 172.21.15.114:0/355259736 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fae080c48e0 0x7fae0815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.803+0000 7fae0db3e640 1 --2- 172.21.15.114:0/355259736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae080ae1d0 0x7fae080c7f80 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.803+0000 7fae0db3e640 1 -- 172.21.15.114:0/355259736 >> 172.21.15.114:0/355259736 conn(0x7fae080ce950 msgr2=0x7fae08154690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.803+0000 7fae0db3e640 1 -- 172.21.15.114:0/355259736 shutdown_connections 2023-11-04T01:39:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.803+0000 7fae0db3e640 1 -- 172.21.15.114:0/355259736 wait complete. 2023-11-04T01:39:06.816 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:39:06.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.917+0000 7f978feaf640 1 Processor -- start 2023-11-04T01:39:06.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.918+0000 7f978feaf640 1 -- start start 2023-11-04T01:39:06.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.918+0000 7f978feaf640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9788160430 0x7f97880b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.918+0000 7f978feaf640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97880b2fc0 con 0x7f97880b2b60 2023-11-04T01:39:06.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.918+0000 7f978feaf640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978806c7d0 con 0x7f978806c3a0 2023-11-04T01:39:06.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.918+0000 7f978feaf640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97880cb580 con 0x7f9788160430 2023-11-04T01:39:06.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.918+0000 7f978d44a640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f97880b2b60 0x7f978806bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51092/0 (socket says 172.21.15.114:51092) 2023-11-04T01:39:06.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.918+0000 7f978d44a640 1 -- 172.21.15.114:0/3201008460 learned_addr learned my addr 172.21.15.114:0/3201008460 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978cc49640 1 -- 172.21.15.114:0/3201008460 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266898190 0 0) 0x7f97880b2fc0 con 0x7f97880b2b60 2023-11-04T01:39:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978cc49640 1 -- 172.21.15.114:0/3201008460 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9774003520 con 0x7f97880b2b60 2023-11-04T01:39:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978dc4b640 1 --2- 172.21.15.114:0/3201008460 >> v2:172.21.15.141:3300/0 conn(0x7f9788160430 0x7f97880b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978cc49640 1 -- 172.21.15.114:0/3201008460 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3998151182 0 0) 0x7f9774003520 con 0x7f97880b2b60 2023-11-04T01:39:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978cc49640 1 -- 172.21.15.114:0/3201008460 >> v2:172.21.15.141:3300/0 conn(0x7f9788160430 msgr2=0x7f97880b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978cc49640 1 --2- 172.21.15.114:0/3201008460 >> v2:172.21.15.141:3300/0 conn(0x7f9788160430 0x7f97880b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978cc49640 1 -- 172.21.15.114:0/3201008460 >> v1:172.21.15.141:6789/0 conn(0x7f978806c3a0 legacy=0x7f97880cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978cc49640 1 -- 172.21.15.114:0/3201008460 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978806ca40 con 0x7f97880b2b60 2023-11-04T01:39:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978cc49640 1 -- 172.21.15.114:0/3201008460 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f9778001670 con 0x7f97880b2b60 2023-11-04T01:39:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978cc49640 1 -- 172.21.15.114:0/3201008460 >> v1:172.21.15.114:6789/0 conn(0x7f97880b2b60 legacy=0x7f978806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978cc49640 1 --2- 172.21.15.114:0/3201008460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9774003970 0x7f9774003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978cc49640 1 --2- 172.21.15.114:0/3201008460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97740047c0 0x7f9774004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978cc49640 1 --2- 172.21.15.114:0/3201008460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9774005180 0x7f977400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978cc49640 1 -- 172.21.15.114:0/3201008460 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97880cb580 con 0x7f97740047c0 2023-11-04T01:39:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978cc49640 1 -- 172.21.15.114:0/3201008460 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977400c020 con 0x7f9774005180 2023-11-04T01:39:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978cc49640 1 -- 172.21.15.114:0/3201008460 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977400c1e0 con 0x7f9774003970 2023-11-04T01:39:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978d44a640 1 --2- 172.21.15.114:0/3201008460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97740047c0 0x7f9774004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978dc4b640 1 --2- 172.21.15.114:0/3201008460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9774003970 0x7f9774003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978e44c640 1 --2- 172.21.15.114:0/3201008460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9774005180 0x7f977400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978d44a640 1 -- 172.21.15.114:0/3201008460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9774003970 msgr2=0x7f9774003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978d44a640 1 --2- 172.21.15.114:0/3201008460 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9774003970 0x7f9774003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978d44a640 1 -- 172.21.15.114:0/3201008460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9774005180 msgr2=0x7f977400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978d44a640 1 --2- 172.21.15.114:0/3201008460 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9774005180 0x7f977400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978d44a640 1 -- 172.21.15.114:0/3201008460 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774003520 con 0x7f97740047c0 2023-11-04T01:39:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.919+0000 7f978e44c640 1 -- 172.21.15.114:0/3201008460 reap_dead start 2023-11-04T01:39:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.920+0000 7f978d44a640 1 --2- 172.21.15.114:0/3201008460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97740047c0 0x7f9774004c40 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f9778001050 tx=0x7f97740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801f0157e6a878c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.920+0000 7f978cc49640 1 -- 172.21.15.114:0/3201008460 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778005ad0 con 0x7f97740047c0 2023-11-04T01:39:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.920+0000 7f978cc49640 1 -- 172.21.15.114:0/3201008460 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9778005c30 con 0x7f97740047c0 2023-11-04T01:39:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.920+0000 7f978cc49640 1 -- 172.21.15.114:0/3201008460 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977802cad0 con 0x7f97740047c0 2023-11-04T01:39:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.921+0000 7f978feaf640 1 -- 172.21.15.114:0/3201008460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97740047c0 msgr2=0x7f9774004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.921+0000 7f978feaf640 1 --2- 172.21.15.114:0/3201008460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97740047c0 0x7f9774004c40 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f9778001050 tx=0x7f97740057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.921+0000 7f978feaf640 1 -- 172.21.15.114:0/3201008460 shutdown_connections 2023-11-04T01:39:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.921+0000 7f978feaf640 1 --2- 172.21.15.114:0/3201008460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97740047c0 0x7f9774004c40 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.921+0000 7f978feaf640 1 -- 172.21.15.114:0/3201008460 >> 172.21.15.114:0/3201008460 conn(0x7f978806ea20 msgr2=0x7f978806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.921+0000 7f978feaf640 1 -- 172.21.15.114:0/3201008460 shutdown_connections 2023-11-04T01:39:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.921+0000 7f978feaf640 1 -- 172.21.15.114:0/3201008460 wait complete. 2023-11-04T01:39:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.922+0000 7f978feaf640 1 Processor -- start 2023-11-04T01:39:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.922+0000 7f978feaf640 1 -- start start 2023-11-04T01:39:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978feaf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97740047c0 0x7f97880c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978feaf640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97880b62c0 0x7f9788153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978feaf640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9788151100 0x7f97880c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978feaf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9788154390 con 0x7f97740047c0 2023-11-04T01:39:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978feaf640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97880c49a0 con 0x7f97880b62c0 2023-11-04T01:39:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978feaf640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9788153e80 con 0x7f9788151100 2023-11-04T01:39:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978dc4b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97740047c0 0x7f97880c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978dc4b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97740047c0 0x7f97880c4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45578/0 (socket says 172.21.15.114:45578) 2023-11-04T01:39:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978dc4b640 1 -- 172.21.15.114:0/2553041573 learned_addr learned my addr 172.21.15.114:0/2553041573 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978e44c640 1 --2- 172.21.15.114:0/2553041573 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9788151100 0x7f97880c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978d44a640 1 --2- 172.21.15.114:0/2553041573 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97880b62c0 0x7f9788153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978dc4b640 1 -- 172.21.15.114:0/2553041573 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9788151100 msgr2=0x7f97880c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978dc4b640 1 --2- 172.21.15.114:0/2553041573 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9788151100 0x7f97880c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978dc4b640 1 -- 172.21.15.114:0/2553041573 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97880b62c0 msgr2=0x7f9788153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978dc4b640 1 --2- 172.21.15.114:0/2553041573 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97880b62c0 0x7f9788153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978dc4b640 1 -- 172.21.15.114:0/2553041573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97881515b0 con 0x7f97740047c0 2023-11-04T01:39:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978dc4b640 1 --2- 172.21.15.114:0/2553041573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97740047c0 0x7f97880c4b40 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f9784007f60 tx=0x7f9784007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f977e7fc640 1 -- 172.21.15.114:0/2553041573 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978400e030 con 0x7f97740047c0 2023-11-04T01:39:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f977e7fc640 1 -- 172.21.15.114:0/2553041573 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9784016470 con 0x7f97740047c0 2023-11-04T01:39:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978feaf640 1 -- 172.21.15.114:0/2553041573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97881540b0 con 0x7f97740047c0 2023-11-04T01:39:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f977e7fc640 1 -- 172.21.15.114:0/2553041573 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784016820 con 0x7f97740047c0 2023-11-04T01:39:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.923+0000 7f978feaf640 1 -- 172.21.15.114:0/2553041573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97880b3c40 con 0x7f97740047c0 2023-11-04T01:39:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.924+0000 7f978feaf640 1 -- 172.21.15.114:0/2553041573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97880b37c0 con 0x7f97740047c0 2023-11-04T01:39:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.925+0000 7f977e7fc640 1 -- 172.21.15.114:0/2553041573 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9784016980 con 0x7f97740047c0 2023-11-04T01:39:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.925+0000 7f977e7fc640 1 --2- 172.21.15.114:0/2553041573 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f976c06ae70 0x7f976c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.925+0000 7f977e7fc640 1 -- 172.21.15.114:0/2553041573 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f978400f070 con 0x7f97740047c0 2023-11-04T01:39:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.925+0000 7f978d44a640 1 --2- 172.21.15.114:0/2553041573 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f976c06ae70 0x7f976c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.926+0000 7f978d44a640 1 --2- 172.21.15.114:0/2553041573 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f976c06ae70 0x7f976c06d330 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9778034000 tx=0x7f9778007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:06.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:06.929+0000 7f977e7fc640 1 -- 172.21.15.114:0/2553041573 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97880b37c0 con 0x7f97740047c0 2023-11-04T01:39:07.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.095+0000 7f978feaf640 1 -- 172.21.15.114:0/2553041573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97880b37c0 con 0x7f97740047c0 2023-11-04T01:39:07.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.096+0000 7f977e7fc640 1 -- 172.21.15.114:0/2553041573 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97880b37c0 con 0x7f97740047c0 2023-11-04T01:39:07.098 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:39:07.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.098+0000 7f978feaf640 1 -- 172.21.15.114:0/2553041573 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f976c06ae70 msgr2=0x7f976c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.098+0000 7f978feaf640 1 --2- 172.21.15.114:0/2553041573 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f976c06ae70 0x7f976c06d330 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9778034000 tx=0x7f9778007000 comp rx=0 tx=0).stop 2023-11-04T01:39:07.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.098+0000 7f978feaf640 1 -- 172.21.15.114:0/2553041573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97740047c0 msgr2=0x7f97880c4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.098+0000 7f978feaf640 1 --2- 172.21.15.114:0/2553041573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97740047c0 0x7f97880c4b40 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f9784007f60 tx=0x7f9784007f90 comp rx=0 tx=0).stop 2023-11-04T01:39:07.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.098+0000 7f978feaf640 1 -- 172.21.15.114:0/2553041573 shutdown_connections 2023-11-04T01:39:07.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.098+0000 7f978feaf640 1 --2- 172.21.15.114:0/2553041573 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9788151100 0x7f97880c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.098+0000 7f978feaf640 1 --2- 172.21.15.114:0/2553041573 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f976c06ae70 0x7f976c06d330 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.098+0000 7f978feaf640 1 --2- 172.21.15.114:0/2553041573 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97880b62c0 0x7f9788153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.098+0000 7f978feaf640 1 --2- 172.21.15.114:0/2553041573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97740047c0 0x7f97880c4b40 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.098+0000 7f978feaf640 1 -- 172.21.15.114:0/2553041573 >> 172.21.15.114:0/2553041573 conn(0x7f978806ea20 msgr2=0x7f97880ce930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.098+0000 7f978feaf640 1 -- 172.21.15.114:0/2553041573 shutdown_connections 2023-11-04T01:39:07.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.098+0000 7f978feaf640 1 -- 172.21.15.114:0/2553041573 wait complete. 2023-11-04T01:39:07.110 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:39:07.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.211+0000 7f34e7ae1640 1 Processor -- start 2023-11-04T01:39:07.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.211+0000 7f34e7ae1640 1 -- start start 2023-11-04T01:39:07.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.212+0000 7f34e7ae1640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34e015ad40 0x7f34e006b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.212+0000 7f34e7ae1640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f34e015b120 0x7f34e015f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.212+0000 7f34e7ae1640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e0065df0 con 0x7f34e00c9b60 2023-11-04T01:39:07.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.212+0000 7f34e7ae1640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e006bc40 con 0x7f34e015b120 2023-11-04T01:39:07.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.212+0000 7f34e7ae1640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e015f910 con 0x7f34e015ad40 2023-11-04T01:39:07.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.212+0000 7f34e607e640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f34e00c9b60 0x7f34e0070ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51096/0 (socket says 172.21.15.114:51096) 2023-11-04T01:39:07.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.212+0000 7f34e607e640 1 -- 172.21.15.114:0/514714426 learned_addr learned my addr 172.21.15.114:0/514714426 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:07.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e487b640 1 -- 172.21.15.114:0/514714426 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781032367 0 0) 0x7f34e0065df0 con 0x7f34e00c9b60 2023-11-04T01:39:07.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e507c640 1 --2- 172.21.15.114:0/514714426 >> v2:172.21.15.141:3300/0 conn(0x7f34e015b120 0x7f34e015f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e587d640 1 --2- 172.21.15.114:0/514714426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34e015ad40 0x7f34e006b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e487b640 1 -- 172.21.15.114:0/514714426 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34cc003520 con 0x7f34e00c9b60 2023-11-04T01:39:07.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e487b640 1 -- 172.21.15.114:0/514714426 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3698337323 0 0) 0x7f34cc003520 con 0x7f34e00c9b60 2023-11-04T01:39:07.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e487b640 1 -- 172.21.15.114:0/514714426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34e015ad40 msgr2=0x7f34e006b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:07.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e487b640 1 --2- 172.21.15.114:0/514714426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34e015ad40 0x7f34e006b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e487b640 1 -- 172.21.15.114:0/514714426 >> v2:172.21.15.141:3300/0 conn(0x7f34e015b120 msgr2=0x7f34e015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:07.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e487b640 1 --2- 172.21.15.114:0/514714426 >> v2:172.21.15.141:3300/0 conn(0x7f34e015b120 0x7f34e015f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e487b640 1 -- 172.21.15.114:0/514714426 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e0066040 con 0x7f34e00c9b60 2023-11-04T01:39:07.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e487b640 1 -- 172.21.15.114:0/514714426 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f34d8001670 con 0x7f34e00c9b60 2023-11-04T01:39:07.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e487b640 1 -- 172.21.15.114:0/514714426 >> v1:172.21.15.114:6789/0 conn(0x7f34e00c9b60 legacy=0x7f34e0070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e487b640 1 --2- 172.21.15.114:0/514714426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34cc003970 0x7f34cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e487b640 1 --2- 172.21.15.114:0/514714426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34e015ad40 0x7f34cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e487b640 1 --2- 172.21.15.114:0/514714426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34cc004d00 0x7f34cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e487b640 1 -- 172.21.15.114:0/514714426 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e006bc40 con 0x7f34cc004d00 2023-11-04T01:39:07.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e487b640 1 -- 172.21.15.114:0/514714426 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e015f910 con 0x7f34cc003970 2023-11-04T01:39:07.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e487b640 1 -- 172.21.15.114:0/514714426 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc00b980 con 0x7f34e015ad40 2023-11-04T01:39:07.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e607e640 1 --2- 172.21.15.114:0/514714426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34cc004d00 0x7f34cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e507c640 1 --2- 172.21.15.114:0/514714426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34e015ad40 0x7f34cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e587d640 1 --2- 172.21.15.114:0/514714426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34cc003970 0x7f34cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e607e640 1 -- 172.21.15.114:0/514714426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34e015ad40 msgr2=0x7f34cc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:07.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e607e640 1 --2- 172.21.15.114:0/514714426 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34e015ad40 0x7f34cc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e607e640 1 -- 172.21.15.114:0/514714426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34cc003970 msgr2=0x7f34cc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:07.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e607e640 1 --2- 172.21.15.114:0/514714426 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34cc003970 0x7f34cc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.213+0000 7f34e607e640 1 -- 172.21.15.114:0/514714426 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc003520 con 0x7f34cc004d00 2023-11-04T01:39:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.214+0000 7f34e607e640 1 --2- 172.21.15.114:0/514714426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34cc004d00 0x7f34cc005180 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f34e0070fa0 tx=0x7f34cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56b71818c276eed server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.214+0000 7f34e487b640 1 -- 172.21.15.114:0/514714426 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8005ad0 con 0x7f34cc004d00 2023-11-04T01:39:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.214+0000 7f34e487b640 1 -- 172.21.15.114:0/514714426 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d8005c30 con 0x7f34cc004d00 2023-11-04T01:39:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.214+0000 7f34e487b640 1 -- 172.21.15.114:0/514714426 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d802c890 con 0x7f34cc004d00 2023-11-04T01:39:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.215+0000 7f34e7ae1640 1 -- 172.21.15.114:0/514714426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34cc004d00 msgr2=0x7f34cc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.215+0000 7f34e7ae1640 1 --2- 172.21.15.114:0/514714426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34cc004d00 0x7f34cc005180 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f34e0070fa0 tx=0x7f34cc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.215+0000 7f34e607e640 1 -- 172.21.15.114:0/514714426 reap_dead start 2023-11-04T01:39:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.215+0000 7f34e7ae1640 1 -- 172.21.15.114:0/514714426 shutdown_connections 2023-11-04T01:39:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.215+0000 7f34e7ae1640 1 -- 172.21.15.114:0/514714426 >> 172.21.15.114:0/514714426 conn(0x7f34e00cbc90 msgr2=0x7f34e00cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.215+0000 7f34e7ae1640 1 -- 172.21.15.114:0/514714426 shutdown_connections 2023-11-04T01:39:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.215+0000 7f34e7ae1640 1 -- 172.21.15.114:0/514714426 wait complete. 2023-11-04T01:39:07.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.216+0000 7f34e7ae1640 1 Processor -- start 2023-11-04T01:39:07.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.216+0000 7f34e7ae1640 1 -- start start 2023-11-04T01:39:07.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e7ae1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34cc004d00 0x7f34e0154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e7ae1640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34e015d700 0x7f34e01f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e7ae1640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34e015de30 0x7f34e0155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e7ae1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e01f09f0 con 0x7f34cc004d00 2023-11-04T01:39:07.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e7ae1640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e01f0400 con 0x7f34e015d700 2023-11-04T01:39:07.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e7ae1640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e01f13c0 con 0x7f34e015de30 2023-11-04T01:39:07.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e587d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34cc004d00 0x7f34e0154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e587d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34cc004d00 0x7f34e0154700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45598/0 (socket says 172.21.15.114:45598) 2023-11-04T01:39:07.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e587d640 1 -- 172.21.15.114:0/4022864801 learned_addr learned my addr 172.21.15.114:0/4022864801 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:07.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e587d640 1 -- 172.21.15.114:0/4022864801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34e015de30 msgr2=0x7f34e0155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e587d640 1 --2- 172.21.15.114:0/4022864801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34e015de30 0x7f34e0155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e587d640 1 -- 172.21.15.114:0/4022864801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34e015d700 msgr2=0x7f34e01f0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e587d640 1 --2- 172.21.15.114:0/4022864801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34e015d700 0x7f34e01f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e587d640 1 -- 172.21.15.114:0/4022864801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e00b06d0 con 0x7f34cc004d00 2023-11-04T01:39:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e587d640 1 --2- 172.21.15.114:0/4022864801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34cc004d00 0x7f34e0154700 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f34dc009fc0 tx=0x7f34dc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34d67fc640 1 -- 172.21.15.114:0/4022864801 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc00e040 con 0x7f34cc004d00 2023-11-04T01:39:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34d67fc640 1 -- 172.21.15.114:0/4022864801 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc00f040 con 0x7f34cc004d00 2023-11-04T01:39:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34d67fc640 1 -- 172.21.15.114:0/4022864801 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc015650 con 0x7f34cc004d00 2023-11-04T01:39:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e7ae1640 1 -- 172.21.15.114:0/4022864801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e00b09b0 con 0x7f34cc004d00 2023-11-04T01:39:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.217+0000 7f34e7ae1640 1 -- 172.21.15.114:0/4022864801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e015e2b0 con 0x7f34cc004d00 2023-11-04T01:39:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.218+0000 7f34e7ae1640 1 -- 172.21.15.114:0/4022864801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e0074290 con 0x7f34cc004d00 2023-11-04T01:39:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.219+0000 7f34d67fc640 1 -- 172.21.15.114:0/4022864801 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34dc0157b0 con 0x7f34cc004d00 2023-11-04T01:39:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.219+0000 7f34d67fc640 1 --2- 172.21.15.114:0/4022864801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f34c406aea0 0x7f34c406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.219+0000 7f34e507c640 1 --2- 172.21.15.114:0/4022864801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f34c406aea0 0x7f34c406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.219+0000 7f34d67fc640 1 -- 172.21.15.114:0/4022864801 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f34dc08a800 con 0x7f34cc004d00 2023-11-04T01:39:07.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.220+0000 7f34e507c640 1 --2- 172.21.15.114:0/4022864801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f34c406aea0 0x7f34c406d360 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f34d0006e80 tx=0x7f34d0006df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:07.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.223+0000 7f34d67fc640 1 -- 172.21.15.114:0/4022864801 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f34dc0553c0 con 0x7f34cc004d00 2023-11-04T01:39:07.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.390+0000 7f34e7ae1640 1 -- 172.21.15.114:0/4022864801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f34e00ccac0 con 0x7f34cc004d00 2023-11-04T01:39:07.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.391+0000 7f34d67fc640 1 -- 172.21.15.114:0/4022864801 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v71) v1 ==== 103+0+11 (secure 0 0 0) 0x7f34dc0589e0 con 0x7f34cc004d00 2023-11-04T01:39:07.393 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.393+0000 7f34e7ae1640 1 -- 172.21.15.114:0/4022864801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f34c406aea0 msgr2=0x7f34c406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.393+0000 7f34e7ae1640 1 --2- 172.21.15.114:0/4022864801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f34c406aea0 0x7f34c406d360 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f34d0006e80 tx=0x7f34d0006df0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.393+0000 7f34e7ae1640 1 -- 172.21.15.114:0/4022864801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34cc004d00 msgr2=0x7f34e0154700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.393+0000 7f34e7ae1640 1 --2- 172.21.15.114:0/4022864801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34cc004d00 0x7f34e0154700 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f34dc009fc0 tx=0x7f34dc00f580 comp rx=0 tx=0).stop 2023-11-04T01:39:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.393+0000 7f34e7ae1640 1 -- 172.21.15.114:0/4022864801 shutdown_connections 2023-11-04T01:39:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.393+0000 7f34e7ae1640 1 --2- 172.21.15.114:0/4022864801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34e015de30 0x7f34e0155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.393+0000 7f34e7ae1640 1 --2- 172.21.15.114:0/4022864801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f34c406aea0 0x7f34c406d360 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.393+0000 7f34e7ae1640 1 --2- 172.21.15.114:0/4022864801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34e015d700 0x7f34e01f0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.393+0000 7f34e7ae1640 1 --2- 172.21.15.114:0/4022864801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34cc004d00 0x7f34e0154700 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.393+0000 7f34e7ae1640 1 -- 172.21.15.114:0/4022864801 >> 172.21.15.114:0/4022864801 conn(0x7f34e00cbc90 msgr2=0x7f34e0159260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:07.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.393+0000 7f34e7ae1640 1 -- 172.21.15.114:0/4022864801 shutdown_connections 2023-11-04T01:39:07.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.393+0000 7f34e7ae1640 1 -- 172.21.15.114:0/4022864801 wait complete. 2023-11-04T01:39:07.405 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:39:07.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.505+0000 7f100b4c9640 1 Processor -- start 2023-11-04T01:39:07.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.505+0000 7f100b4c9640 1 -- start start 2023-11-04T01:39:07.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.506+0000 7f100b4c9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f10040cd6d0 0x7f1004161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.506+0000 7f100b4c9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f10040b4880 0x7f10040b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.506+0000 7f100b4c9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10040cde60 con 0x7f1004153e60 2023-11-04T01:39:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.506+0000 7f100b4c9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1004160f90 con 0x7f10040cd6d0 2023-11-04T01:39:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.506+0000 7f100b4c9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1004161960 con 0x7f10040b4880 2023-11-04T01:39:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.506+0000 7f1009265640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1004153e60 0x7f100415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51102/0 (socket says 172.21.15.114:51102) 2023-11-04T01:39:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.506+0000 7f1009265640 1 -- 172.21.15.114:0/975093591 learned_addr learned my addr 172.21.15.114:0/975093591 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.506+0000 7f1008a64640 1 --2- 172.21.15.114:0/975093591 >> v2:172.21.15.114:3300/0 conn(0x7f10040cd6d0 0x7f1004161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.507+0000 7f0ffbfff640 1 -- 172.21.15.114:0/975093591 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101234153 0 0) 0x7f10040cde60 con 0x7f1004153e60 2023-11-04T01:39:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.507+0000 7f1009a66640 1 --2- 172.21.15.114:0/975093591 >> v2:172.21.15.141:3300/0 conn(0x7f10040b4880 0x7f10040b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.507+0000 7f0ffbfff640 1 -- 172.21.15.114:0/975093591 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ff0003520 con 0x7f1004153e60 2023-11-04T01:39:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.507+0000 7f1008a64640 1 -- 172.21.15.114:0/975093591 >> v2:172.21.15.141:3300/0 conn(0x7f10040b4880 msgr2=0x7f10040b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:07.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.507+0000 7f1008a64640 1 --2- 172.21.15.114:0/975093591 >> v2:172.21.15.141:3300/0 conn(0x7f10040b4880 0x7f10040b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.507+0000 7f1008a64640 1 -- 172.21.15.114:0/975093591 >> v1:172.21.15.114:6789/0 conn(0x7f1004153e60 legacy=0x7f100415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.507+0000 7f1008a64640 1 -- 172.21.15.114:0/975093591 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10040b5220 con 0x7f10040cd6d0 2023-11-04T01:39:07.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.507+0000 7f1008a64640 1 --2- 172.21.15.114:0/975093591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10040cd6d0 0x7f1004161420 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f10040b8f40 tx=0x7f0ff402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee16b82bf2d38713 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:07.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.508+0000 7f0ffbfff640 1 -- 172.21.15.114:0/975093591 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4031830 con 0x7f10040cd6d0 2023-11-04T01:39:07.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.508+0000 7f0ffbfff640 1 -- 172.21.15.114:0/975093591 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff4031990 con 0x7f10040cd6d0 2023-11-04T01:39:07.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.508+0000 7f0ffbfff640 1 -- 172.21.15.114:0/975093591 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4031d20 con 0x7f10040cd6d0 2023-11-04T01:39:07.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.508+0000 7f100b4c9640 1 -- 172.21.15.114:0/975093591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10040cd6d0 msgr2=0x7f1004161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.508+0000 7f100b4c9640 1 --2- 172.21.15.114:0/975093591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10040cd6d0 0x7f1004161420 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f10040b8f40 tx=0x7f0ff402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.508+0000 7f100b4c9640 1 -- 172.21.15.114:0/975093591 shutdown_connections 2023-11-04T01:39:07.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.508+0000 7f100b4c9640 1 --2- 172.21.15.114:0/975093591 >> v2:172.21.15.141:3300/0 conn(0x7f10040b4880 0x7f10040b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.508+0000 7f100b4c9640 1 --2- 172.21.15.114:0/975093591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10040cd6d0 0x7f1004161420 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.508+0000 7f100b4c9640 1 -- 172.21.15.114:0/975093591 >> 172.21.15.114:0/975093591 conn(0x7f10040cf880 msgr2=0x7f10040cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:07.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.508+0000 7f100b4c9640 1 -- 172.21.15.114:0/975093591 shutdown_connections 2023-11-04T01:39:07.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.508+0000 7f100b4c9640 1 -- 172.21.15.114:0/975093591 wait complete. 2023-11-04T01:39:07.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.509+0000 7f100b4c9640 1 Processor -- start 2023-11-04T01:39:07.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.509+0000 7f100b4c9640 1 -- start start 2023-11-04T01:39:07.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.510+0000 7f100b4c9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10040b4880 0x7f10041527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.510+0000 7f100b4c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10040cd6d0 0x7f10040c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.510+0000 7f100b4c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1004153e60 0x7f10040c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.510+0000 7f100b4c9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10040c9fe0 con 0x7f1004153e60 2023-11-04T01:39:07.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.510+0000 7f100b4c9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10040ca2c0 con 0x7f10040b4880 2023-11-04T01:39:07.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.510+0000 7f100b4c9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10040ca5a0 con 0x7f10040cd6d0 2023-11-04T01:39:07.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.510+0000 7f1009a66640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1004153e60 0x7f10040c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.510+0000 7f1009a66640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1004153e60 0x7f10040c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45624/0 (socket says 172.21.15.114:45624) 2023-11-04T01:39:07.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.510+0000 7f1009a66640 1 -- 172.21.15.114:0/789649622 learned_addr learned my addr 172.21.15.114:0/789649622 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:07.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.510+0000 7f1008a64640 1 --2- 172.21.15.114:0/789649622 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10040cd6d0 0x7f10040c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.510+0000 7f1009265640 1 --2- 172.21.15.114:0/789649622 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10040b4880 0x7f10041527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.511+0000 7f1009a66640 1 -- 172.21.15.114:0/789649622 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10040cd6d0 msgr2=0x7f10040c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.511+0000 7f1009a66640 1 --2- 172.21.15.114:0/789649622 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10040cd6d0 0x7f10040c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.511+0000 7f1009a66640 1 -- 172.21.15.114:0/789649622 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10040b4880 msgr2=0x7f10041527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.511+0000 7f1009a66640 1 --2- 172.21.15.114:0/789649622 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10040b4880 0x7f10041527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.511+0000 7f1009a66640 1 -- 172.21.15.114:0/789649622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff4009400 con 0x7f1004153e60 2023-11-04T01:39:07.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.511+0000 7f1008a64640 1 --2- 172.21.15.114:0/789649622 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10040cd6d0 0x7f10040c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:07.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.511+0000 7f1009265640 1 --2- 172.21.15.114:0/789649622 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10040b4880 0x7f10041527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:07.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.511+0000 7f1009a66640 1 --2- 172.21.15.114:0/789649622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1004153e60 0x7f10040c9010 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00d800 tx=0x7f0ffc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:07.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.511+0000 7f0ff9ffb640 1 -- 172.21.15.114:0/789649622 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00b6c0 con 0x7f1004153e60 2023-11-04T01:39:07.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.511+0000 7f0ff9ffb640 1 -- 172.21.15.114:0/789649622 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc00b840 con 0x7f1004153e60 2023-11-04T01:39:07.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.511+0000 7f0ff9ffb640 1 -- 172.21.15.114:0/789649622 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00bbf0 con 0x7f1004153e60 2023-11-04T01:39:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.511+0000 7f100b4c9640 1 -- 172.21.15.114:0/789649622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10040ca880 con 0x7f1004153e60 2023-11-04T01:39:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.511+0000 7f100b4c9640 1 -- 172.21.15.114:0/789649622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1004152d20 con 0x7f1004153e60 2023-11-04T01:39:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.512+0000 7f100b4c9640 1 -- 172.21.15.114:0/789649622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10040cada0 con 0x7f1004153e60 2023-11-04T01:39:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.512+0000 7f0ff9ffb640 1 -- 172.21.15.114:0/789649622 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ffc00bd50 con 0x7f1004153e60 2023-11-04T01:39:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.512+0000 7f0ff9ffb640 1 --2- 172.21.15.114:0/789649622 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0fe806ae70 0x7f0fe806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.513+0000 7f0ff9ffb640 1 -- 172.21.15.114:0/789649622 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f0ffc08a120 con 0x7f1004153e60 2023-11-04T01:39:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.513+0000 7f1009265640 1 --2- 172.21.15.114:0/789649622 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0fe806ae70 0x7f0fe806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.513+0000 7f1009265640 1 --2- 172.21.15.114:0/789649622 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0fe806ae70 0x7f0fe806d330 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1000001560 tx=0x7f1000009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:07.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.517+0000 7f0ff9ffb640 1 -- 172.21.15.114:0/789649622 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f10040cada0 con 0x7f1004153e60 2023-11-04T01:39:07.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.683+0000 7f100b4c9640 1 -- 172.21.15.114:0/789649622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f10040cada0 con 0x7f1004153e60 2023-11-04T01:39:07.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.683+0000 7f0ff9ffb640 1 -- 172.21.15.114:0/789649622 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v71) v1 ==== 107+0+11 (secure 0 0 0) 0x7f10040cada0 con 0x7f1004153e60 2023-11-04T01:39:07.685 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:07.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.685+0000 7f100b4c9640 1 -- 172.21.15.114:0/789649622 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0fe806ae70 msgr2=0x7f0fe806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.685+0000 7f100b4c9640 1 --2- 172.21.15.114:0/789649622 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0fe806ae70 0x7f0fe806d330 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1000001560 tx=0x7f1000009040 comp rx=0 tx=0).stop 2023-11-04T01:39:07.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.685+0000 7f100b4c9640 1 -- 172.21.15.114:0/789649622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1004153e60 msgr2=0x7f10040c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.685+0000 7f100b4c9640 1 --2- 172.21.15.114:0/789649622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1004153e60 0x7f10040c9010 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00d800 tx=0x7f0ffc00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.685+0000 7f100b4c9640 1 -- 172.21.15.114:0/789649622 shutdown_connections 2023-11-04T01:39:07.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.685+0000 7f100b4c9640 1 --2- 172.21.15.114:0/789649622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1004153e60 0x7f10040c9010 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.685+0000 7f100b4c9640 1 --2- 172.21.15.114:0/789649622 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10040cd6d0 0x7f10040c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.685+0000 7f100b4c9640 1 --2- 172.21.15.114:0/789649622 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0fe806ae70 0x7f0fe806d330 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.685+0000 7f100b4c9640 1 --2- 172.21.15.114:0/789649622 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10040b4880 0x7f10041527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.685+0000 7f100b4c9640 1 -- 172.21.15.114:0/789649622 >> 172.21.15.114:0/789649622 conn(0x7f10040cf880 msgr2=0x7f10040cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:07.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.685+0000 7f100b4c9640 1 -- 172.21.15.114:0/789649622 shutdown_connections 2023-11-04T01:39:07.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.685+0000 7f100b4c9640 1 -- 172.21.15.114:0/789649622 wait complete. 2023-11-04T01:39:07.698 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:07.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.794+0000 7f753ae56640 1 Processor -- start 2023-11-04T01:39:07.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.794+0000 7f753ae56640 1 -- start start 2023-11-04T01:39:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.795+0000 7f753ae56640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f75340ca9c0 0x7f75340b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.795+0000 7f753ae56640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75340c9880 con 0x7f75340b07f0 2023-11-04T01:39:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.795+0000 7f753ae56640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753406d0f0 con 0x7f753415cf10 2023-11-04T01:39:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.795+0000 7f753ae56640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75340b11e0 con 0x7f75340ca9c0 2023-11-04T01:39:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.795+0000 7f75393f3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f75340ca9c0 0x7f75340b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.795+0000 7f7533fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f75340b07f0 0x7f75340ca2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51112/0 (socket says 172.21.15.114:51112) 2023-11-04T01:39:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.795+0000 7f7533fff640 1 -- 172.21.15.114:0/2179941078 learned_addr learned my addr 172.21.15.114:0/2179941078 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.795+0000 7f75393f3640 1 -- 172.21.15.114:0/2179941078 >> v1:172.21.15.141:6789/0 conn(0x7f753415cf10 legacy=0x7f753406c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.795+0000 7f75393f3640 1 -- 172.21.15.114:0/2179941078 >> v1:172.21.15.114:6789/0 conn(0x7f75340b07f0 legacy=0x7f75340ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.795+0000 7f75393f3640 1 -- 172.21.15.114:0/2179941078 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75340cd650 con 0x7f75340ca9c0 2023-11-04T01:39:07.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.796+0000 7f75393f3640 1 --2- 172.21.15.114:0/2179941078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340ca9c0 0x7f75340b0ca0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f752c009d90 tx=0x7f752c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55350a98c5ed4ae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:07.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.796+0000 7f75337fe640 1 -- 172.21.15.114:0/2179941078 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c02cc60 con 0x7f75340ca9c0 2023-11-04T01:39:07.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.796+0000 7f75337fe640 1 -- 172.21.15.114:0/2179941078 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c02cdc0 con 0x7f75340ca9c0 2023-11-04T01:39:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.796+0000 7f75337fe640 1 -- 172.21.15.114:0/2179941078 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c034660 con 0x7f75340ca9c0 2023-11-04T01:39:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.797+0000 7f753ae56640 1 -- 172.21.15.114:0/2179941078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340ca9c0 msgr2=0x7f75340b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.797+0000 7f753ae56640 1 --2- 172.21.15.114:0/2179941078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340ca9c0 0x7f75340b0ca0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f752c009d90 tx=0x7f752c02beb0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.797+0000 7f753ae56640 1 -- 172.21.15.114:0/2179941078 shutdown_connections 2023-11-04T01:39:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.797+0000 7f753ae56640 1 --2- 172.21.15.114:0/2179941078 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340ca9c0 0x7f75340b0ca0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.797+0000 7f753ae56640 1 -- 172.21.15.114:0/2179941078 >> 172.21.15.114:0/2179941078 conn(0x7f75340cb7f0 msgr2=0x7f75340cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.797+0000 7f753ae56640 1 -- 172.21.15.114:0/2179941078 shutdown_connections 2023-11-04T01:39:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.797+0000 7f753ae56640 1 -- 172.21.15.114:0/2179941078 wait complete. 2023-11-04T01:39:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.798+0000 7f753ae56640 1 Processor -- start 2023-11-04T01:39:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.798+0000 7f753ae56640 1 -- start start 2023-11-04T01:39:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f753ae56640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340b07f0 0x7f75340c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f753ae56640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75340ca9c0 0x7f75341531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f753ae56640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f753415cf10 0x7f75340ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f753ae56640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340c6b90 con 0x7f75340b07f0 2023-11-04T01:39:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f753ae56640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340c6570 con 0x7f753415cf10 2023-11-04T01:39:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f753ae56640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75340c6290 con 0x7f75340ca9c0 2023-11-04T01:39:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f7538bf2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340b07f0 0x7f75340c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f7538bf2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340b07f0 0x7f75340c2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45646/0 (socket says 172.21.15.114:45646) 2023-11-04T01:39:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f7538bf2640 1 -- 172.21.15.114:0/2736534614 learned_addr learned my addr 172.21.15.114:0/2736534614 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f75393f3640 1 --2- 172.21.15.114:0/2736534614 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f753415cf10 0x7f75340ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f7533fff640 1 --2- 172.21.15.114:0/2736534614 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75340ca9c0 0x7f75341531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f7538bf2640 1 -- 172.21.15.114:0/2736534614 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75340ca9c0 msgr2=0x7f75341531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f7538bf2640 1 --2- 172.21.15.114:0/2736534614 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75340ca9c0 0x7f75341531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f7538bf2640 1 -- 172.21.15.114:0/2736534614 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f753415cf10 msgr2=0x7f75340ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f7538bf2640 1 --2- 172.21.15.114:0/2736534614 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f753415cf10 0x7f75340ac540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f7538bf2640 1 -- 172.21.15.114:0/2736534614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c009a70 con 0x7f75340b07f0 2023-11-04T01:39:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f75393f3640 1 --2- 172.21.15.114:0/2736534614 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f753415cf10 0x7f75340ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.799+0000 7f7533fff640 1 --2- 172.21.15.114:0/2736534614 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75340ca9c0 0x7f75341531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.800+0000 7f7538bf2640 1 --2- 172.21.15.114:0/2736534614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340b07f0 0x7f75340c2ab0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f752400b3f0 tx=0x7f752400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.800+0000 7f75317fa640 1 -- 172.21.15.114:0/2736534614 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524011830 con 0x7f75340b07f0 2023-11-04T01:39:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.800+0000 7f75317fa640 1 -- 172.21.15.114:0/2736534614 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524011990 con 0x7f75340b07f0 2023-11-04T01:39:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.800+0000 7f753ae56640 1 -- 172.21.15.114:0/2736534614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75340aba60 con 0x7f75340b07f0 2023-11-04T01:39:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.800+0000 7f75317fa640 1 -- 172.21.15.114:0/2736534614 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524011d40 con 0x7f75340b07f0 2023-11-04T01:39:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.800+0000 7f753ae56640 1 -- 172.21.15.114:0/2736534614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75340ac020 con 0x7f75340b07f0 2023-11-04T01:39:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.801+0000 7f753ae56640 1 -- 172.21.15.114:0/2736534614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75340ac240 con 0x7f75340b07f0 2023-11-04T01:39:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.801+0000 7f75317fa640 1 -- 172.21.15.114:0/2736534614 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f752401a400 con 0x7f75340b07f0 2023-11-04T01:39:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.802+0000 7f75317fa640 1 --2- 172.21.15.114:0/2736534614 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f752006ae70 0x7f752006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.802+0000 7f7533fff640 1 --2- 172.21.15.114:0/2736534614 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f752006ae70 0x7f752006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.802+0000 7f75317fa640 1 -- 172.21.15.114:0/2736534614 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f75240899d0 con 0x7f75340b07f0 2023-11-04T01:39:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.802+0000 7f7533fff640 1 --2- 172.21.15.114:0/2736534614 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f752006ae70 0x7f752006d330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f75340c76c0 tx=0x7f7528009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:07.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:07.806+0000 7f75317fa640 1 -- 172.21.15.114:0/2736534614 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7524054500 con 0x7f75340b07f0 2023-11-04T01:39:08.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.011+0000 7f753ae56640 1 -- 172.21.15.114:0/2736534614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7534074290 con 0x7f75340b07f0 2023-11-04T01:39:08.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.011+0000 7f75317fa640 1 -- 172.21.15.114:0/2736534614 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f7524057b20 con 0x7f75340b07f0 2023-11-04T01:39:08.013 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:08.014 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5731,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/4055552299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4055552299},{"type":"v1","addr":"172.21.15.141:6835","nonce":4055552299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6471,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/4254364199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":4254364199},{"type":"v1","addr":"172.21.15.114:6836","nonce":4254364199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6474,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3499206733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3499206733},{"type":"v1","addr":"172.21.15.114:6837","nonce":3499206733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:50.176333+0000","modified":"2023-11-04T01:38:52.173738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6486},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6486":{"gid":6486,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6834/1383574171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1383574171},{"type":"v1","addr":"172.21.15.141:6834","nonce":1383574171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:39:08.014 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 29 2023-11-04T01:39:08.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.013+0000 7f753ae56640 1 -- 172.21.15.114:0/2736534614 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f752006ae70 msgr2=0x7f752006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.013+0000 7f753ae56640 1 --2- 172.21.15.114:0/2736534614 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f752006ae70 0x7f752006d330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f75340c76c0 tx=0x7f7528009040 comp rx=0 tx=0).stop 2023-11-04T01:39:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.013+0000 7f753ae56640 1 -- 172.21.15.114:0/2736534614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340b07f0 msgr2=0x7f75340c2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.013+0000 7f753ae56640 1 --2- 172.21.15.114:0/2736534614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340b07f0 0x7f75340c2ab0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f752400b3f0 tx=0x7f752400b8b0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.013+0000 7f753ae56640 1 -- 172.21.15.114:0/2736534614 shutdown_connections 2023-11-04T01:39:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.013+0000 7f753ae56640 1 --2- 172.21.15.114:0/2736534614 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f752006ae70 0x7f752006d330 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.013+0000 7f753ae56640 1 --2- 172.21.15.114:0/2736534614 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f753415cf10 0x7f75340ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.013+0000 7f753ae56640 1 --2- 172.21.15.114:0/2736534614 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75340ca9c0 0x7f75341531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.013+0000 7f753ae56640 1 --2- 172.21.15.114:0/2736534614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340b07f0 0x7f75340c2ab0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.013+0000 7f753ae56640 1 -- 172.21.15.114:0/2736534614 >> 172.21.15.114:0/2736534614 conn(0x7f75340cb7f0 msgr2=0x7f753406dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.013+0000 7f753ae56640 1 -- 172.21.15.114:0/2736534614 shutdown_connections 2023-11-04T01:39:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.013+0000 7f753ae56640 1 -- 172.21.15.114:0/2736534614 wait complete. 2023-11-04T01:39:08.026 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:08.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.123+0000 7f086a1c9640 1 Processor -- start 2023-11-04T01:39:08.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.123+0000 7f086a1c9640 1 -- start start 2023-11-04T01:39:08.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.123+0000 7f086a1c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08640cde60 0x7f086415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.123+0000 7f086a1c9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f08640ce240 0x7f08640d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.123+0000 7f086a1c9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086415e000 con 0x7f086415daa0 2023-11-04T01:39:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.123+0000 7f086a1c9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086415e5c0 con 0x7f08640ce240 2023-11-04T01:39:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.123+0000 7f086a1c9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086415e2e0 con 0x7f08640cde60 2023-11-04T01:39:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.124+0000 7f0863fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f08640ce240 0x7f08640d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.124+0000 7f0863fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f08640ce240 0x7f08640d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45658/0 (socket says 172.21.15.114:45658) 2023-11-04T01:39:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.124+0000 7f0863fff640 1 -- 172.21.15.114:0/2857680641 learned_addr learned my addr 172.21.15.114:0/2857680641 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.124+0000 7f0863fff640 1 -- 172.21.15.114:0/2857680641 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08640cde60 msgr2=0x7f086415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.124+0000 7f08637fe640 1 --2- 172.21.15.114:0/2857680641 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08640cde60 0x7f086415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.124+0000 7f0863fff640 1 --2- 172.21.15.114:0/2857680641 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08640cde60 0x7f086415d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.124+0000 7f0863fff640 1 -- 172.21.15.114:0/2857680641 >> v1:172.21.15.141:6789/0 conn(0x7f086415daa0 legacy=0x7f0864157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.124+0000 7f0863fff640 1 -- 172.21.15.114:0/2857680641 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08640d1120 con 0x7f08640ce240 2023-11-04T01:39:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.125+0000 7f0863fff640 1 --2- 172.21.15.114:0/2857680641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08640ce240 0x7f08640d1920 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f085c009e50 tx=0x7f085c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9365d0e5b592375 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.125+0000 7f08627fc640 1 -- 172.21.15.114:0/2857680641 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c02ca70 con 0x7f08640ce240 2023-11-04T01:39:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.125+0000 7f08627fc640 1 -- 172.21.15.114:0/2857680641 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c02cbd0 con 0x7f08640ce240 2023-11-04T01:39:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.125+0000 7f08627fc640 1 -- 172.21.15.114:0/2857680641 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c0343f0 con 0x7f08640ce240 2023-11-04T01:39:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.125+0000 7f086a1c9640 1 -- 172.21.15.114:0/2857680641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08640ce240 msgr2=0x7f08640d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.125+0000 7f086a1c9640 1 --2- 172.21.15.114:0/2857680641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08640ce240 0x7f08640d1920 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f085c009e50 tx=0x7f085c02bed0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.125+0000 7f086a1c9640 1 -- 172.21.15.114:0/2857680641 shutdown_connections 2023-11-04T01:39:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.125+0000 7f086a1c9640 1 --2- 172.21.15.114:0/2857680641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08640ce240 0x7f08640d1920 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.125+0000 7f086a1c9640 1 --2- 172.21.15.114:0/2857680641 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08640cde60 0x7f086415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.125+0000 7f086a1c9640 1 -- 172.21.15.114:0/2857680641 >> 172.21.15.114:0/2857680641 conn(0x7f0864071f30 msgr2=0x7f08640cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.125+0000 7f086a1c9640 1 -- 172.21.15.114:0/2857680641 shutdown_connections 2023-11-04T01:39:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.125+0000 7f086a1c9640 1 -- 172.21.15.114:0/2857680641 wait complete. 2023-11-04T01:39:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.126+0000 7f086a1c9640 1 Processor -- start 2023-11-04T01:39:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.127+0000 7f086a1c9640 1 -- start start 2023-11-04T01:39:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.127+0000 7f086a1c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08640cde60 0x7f086415b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.127+0000 7f086a1c9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08640ce240 0x7f0864154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.127+0000 7f086a1c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086415daa0 0x7f08640cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.127+0000 7f086a1c9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086415b020 con 0x7f086415daa0 2023-11-04T01:39:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.127+0000 7f086a1c9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086415a6a0 con 0x7f08640ce240 2023-11-04T01:39:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.127+0000 7f086a1c9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08641f3440 con 0x7f08640cde60 2023-11-04T01:39:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.127+0000 7f0863fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086415daa0 0x7f08640cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.128+0000 7f0863fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086415daa0 0x7f08640cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45668/0 (socket says 172.21.15.114:45668) 2023-11-04T01:39:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.128+0000 7f0863fff640 1 -- 172.21.15.114:0/4165435697 learned_addr learned my addr 172.21.15.114:0/4165435697 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.128+0000 7f08637fe640 1 --2- 172.21.15.114:0/4165435697 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08640cde60 0x7f086415b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.128+0000 7f0862ffd640 1 --2- 172.21.15.114:0/4165435697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08640ce240 0x7f0864154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.128+0000 7f0863fff640 1 -- 172.21.15.114:0/4165435697 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08640cde60 msgr2=0x7f086415b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.128+0000 7f0863fff640 1 --2- 172.21.15.114:0/4165435697 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08640cde60 0x7f086415b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.128+0000 7f0863fff640 1 -- 172.21.15.114:0/4165435697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08640ce240 msgr2=0x7f0864154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.128+0000 7f0863fff640 1 --2- 172.21.15.114:0/4165435697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08640ce240 0x7f0864154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.128+0000 7f0863fff640 1 -- 172.21.15.114:0/4165435697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c009b30 con 0x7f086415daa0 2023-11-04T01:39:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.128+0000 7f0863fff640 1 --2- 172.21.15.114:0/4165435697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086415daa0 0x7f08640cc0c0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f085c036040 tx=0x7f085c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.128+0000 7f084bfff640 1 -- 172.21.15.114:0/4165435697 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c03e450 con 0x7f086415daa0 2023-11-04T01:39:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.128+0000 7f084bfff640 1 -- 172.21.15.114:0/4165435697 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c03e5d0 con 0x7f086415daa0 2023-11-04T01:39:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.128+0000 7f086a1c9640 1 -- 172.21.15.114:0/4165435697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086415a960 con 0x7f086415daa0 2023-11-04T01:39:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.128+0000 7f084bfff640 1 -- 172.21.15.114:0/4165435697 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c03e980 con 0x7f086415daa0 2023-11-04T01:39:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.128+0000 7f086a1c9640 1 -- 172.21.15.114:0/4165435697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08641554f0 con 0x7f086415daa0 2023-11-04T01:39:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.129+0000 7f086a1c9640 1 -- 172.21.15.114:0/4165435697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086415b160 con 0x7f086415daa0 2023-11-04T01:39:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.130+0000 7f084bfff640 1 -- 172.21.15.114:0/4165435697 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f085c03eae0 con 0x7f086415daa0 2023-11-04T01:39:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.130+0000 7f084bfff640 1 --2- 172.21.15.114:0/4165435697 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f085006ae70 0x7f085006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.130+0000 7f084bfff640 1 -- 172.21.15.114:0/4165435697 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f085c0ac900 con 0x7f086415daa0 2023-11-04T01:39:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.130+0000 7f08637fe640 1 --2- 172.21.15.114:0/4165435697 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f085006ae70 0x7f085006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.130+0000 7f08637fe640 1 --2- 172.21.15.114:0/4165435697 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f085006ae70 0x7f085006d330 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f085400aac0 tx=0x7f0854008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.134+0000 7f084bfff640 1 -- 172.21.15.114:0/4165435697 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f086415b160 con 0x7f086415daa0 2023-11-04T01:39:08.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.303+0000 7f086a1c9640 1 -- 172.21.15.114:0/4165435697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f086415b160 con 0x7f086415daa0 2023-11-04T01:39:08.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.304+0000 7f084bfff640 1 -- 172.21.15.114:0/4165435697 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+22117 (secure 0 0 0) 0x7f086415b160 con 0x7f086415daa0 2023-11-04T01:39:08.306 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:08.306 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":71,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:05.562462+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:48.665033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:49.137709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.306+0000 7f086a1c9640 1 -- 172.21.15.114:0/4165435697 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f085006ae70 msgr2=0x7f085006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.306+0000 7f086a1c9640 1 --2- 172.21.15.114:0/4165435697 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f085006ae70 0x7f085006d330 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f085400aac0 tx=0x7f0854008040 comp rx=0 tx=0).stop 2023-11-04T01:39:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.306+0000 7f086a1c9640 1 -- 172.21.15.114:0/4165435697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086415daa0 msgr2=0x7f08640cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.306+0000 7f086a1c9640 1 --2- 172.21.15.114:0/4165435697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086415daa0 0x7f08640cc0c0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f085c036040 tx=0x7f085c004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.306+0000 7f086a1c9640 1 -- 172.21.15.114:0/4165435697 shutdown_connections 2023-11-04T01:39:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.306+0000 7f086a1c9640 1 --2- 172.21.15.114:0/4165435697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086415daa0 0x7f08640cc0c0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.306+0000 7f086a1c9640 1 --2- 172.21.15.114:0/4165435697 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f085006ae70 0x7f085006d330 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.306+0000 7f086a1c9640 1 --2- 172.21.15.114:0/4165435697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08640ce240 0x7f0864154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.306+0000 7f086a1c9640 1 --2- 172.21.15.114:0/4165435697 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08640cde60 0x7f086415b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.306+0000 7f086a1c9640 1 -- 172.21.15.114:0/4165435697 >> 172.21.15.114:0/4165435697 conn(0x7f0864071f30 msgr2=0x7f08640b7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.306+0000 7f086a1c9640 1 -- 172.21.15.114:0/4165435697 shutdown_connections 2023-11-04T01:39:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.306+0000 7f086a1c9640 1 -- 172.21.15.114:0/4165435697 wait complete. 2023-11-04T01:39:08.319 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:39:08.319 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:08.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.416+0000 7fb0ef9ee640 1 Processor -- start 2023-11-04T01:39:08.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.416+0000 7fb0ef9ee640 1 -- start start 2023-11-04T01:39:08.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.417+0000 7fb0ef9ee640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb0e80b0cd0 0x7fb0e8070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.417+0000 7fb0ef9ee640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0e80cde40 0x7fb0e8070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.417+0000 7fb0ef9ee640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e80cc990 con 0x7fb0e80cda60 2023-11-04T01:39:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.417+0000 7fb0ef9ee640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e80ccc70 con 0x7fb0e80cde40 2023-11-04T01:39:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.417+0000 7fb0ef9ee640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e80c9ce0 con 0x7fb0e80b0cd0 2023-11-04T01:39:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.417+0000 7fb0edf8b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0e80cde40 0x7fb0e8070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.417+0000 7fb0ed78a640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb0e80cda60 0x7fb0e80ca7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51120/0 (socket says 172.21.15.114:51120) 2023-11-04T01:39:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.417+0000 7fb0ed78a640 1 -- 172.21.15.114:0/1622259646 learned_addr learned my addr 172.21.15.114:0/1622259646 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.418+0000 7fb0ecf89640 1 --2- 172.21.15.114:0/1622259646 >> v2:172.21.15.141:3300/0 conn(0x7fb0e80b0cd0 0x7fb0e8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.418+0000 7fb0edf8b640 1 -- 172.21.15.114:0/1622259646 >> v2:172.21.15.141:3300/0 conn(0x7fb0e80b0cd0 msgr2=0x7fb0e8070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.418+0000 7fb0edf8b640 1 --2- 172.21.15.114:0/1622259646 >> v2:172.21.15.141:3300/0 conn(0x7fb0e80b0cd0 0x7fb0e8070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.418+0000 7fb0edf8b640 1 -- 172.21.15.114:0/1622259646 >> v1:172.21.15.114:6789/0 conn(0x7fb0e80cda60 legacy=0x7fb0e80ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.418+0000 7fb0dffff640 1 -- 172.21.15.114:0/1622259646 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731021704 0 0) 0x7fb0e80cc990 con 0x7fb0e80cda60 2023-11-04T01:39:08.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.418+0000 7fb0edf8b640 1 -- 172.21.15.114:0/1622259646 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e80c9fc0 con 0x7fb0e80cde40 2023-11-04T01:39:08.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.418+0000 7fb0edf8b640 1 --2- 172.21.15.114:0/1622259646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0e80cde40 0x7fb0e8070b70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fb0e806e330 tx=0x7fb0e002cfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252cb611a0183efd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.418+0000 7fb0dffff640 1 -- 172.21.15.114:0/1622259646 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e002dd90 con 0x7fb0e80cde40 2023-11-04T01:39:08.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.419+0000 7fb0dffff640 1 -- 172.21.15.114:0/1622259646 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e0035440 con 0x7fb0e80cde40 2023-11-04T01:39:08.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.419+0000 7fb0dffff640 1 -- 172.21.15.114:0/1622259646 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e00357d0 con 0x7fb0e80cde40 2023-11-04T01:39:08.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.419+0000 7fb0ef9ee640 1 -- 172.21.15.114:0/1622259646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0e80cde40 msgr2=0x7fb0e8070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.419+0000 7fb0ef9ee640 1 --2- 172.21.15.114:0/1622259646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0e80cde40 0x7fb0e8070b70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fb0e806e330 tx=0x7fb0e002cfe0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.419+0000 7fb0ef9ee640 1 -- 172.21.15.114:0/1622259646 shutdown_connections 2023-11-04T01:39:08.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.419+0000 7fb0ef9ee640 1 --2- 172.21.15.114:0/1622259646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0e80cde40 0x7fb0e8070b70 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.419+0000 7fb0ef9ee640 1 --2- 172.21.15.114:0/1622259646 >> v2:172.21.15.141:3300/0 conn(0x7fb0e80b0cd0 0x7fb0e8070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.419+0000 7fb0ef9ee640 1 -- 172.21.15.114:0/1622259646 >> 172.21.15.114:0/1622259646 conn(0x7fb0e80ce950 msgr2=0x7fb0e80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:08.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.419+0000 7fb0ef9ee640 1 -- 172.21.15.114:0/1622259646 shutdown_connections 2023-11-04T01:39:08.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.419+0000 7fb0ef9ee640 1 -- 172.21.15.114:0/1622259646 wait complete. 2023-11-04T01:39:08.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.420+0000 7fb0ef9ee640 1 Processor -- start 2023-11-04T01:39:08.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.420+0000 7fb0ef9ee640 1 -- start start 2023-11-04T01:39:08.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.421+0000 7fb0ef9ee640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0e80b0cd0 0x7fb0e80af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.421+0000 7fb0ef9ee640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0e80cda60 0x7fb0e80c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.421+0000 7fb0ef9ee640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0e80cde40 0x7fb0e80c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.421+0000 7fb0ef9ee640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80c6b10 con 0x7fb0e80cda60 2023-11-04T01:39:08.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.421+0000 7fb0ef9ee640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80c7370 con 0x7fb0e80cde40 2023-11-04T01:39:08.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.421+0000 7fb0ef9ee640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e8157380 con 0x7fb0e80b0cd0 2023-11-04T01:39:08.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.421+0000 7fb0ecf89640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0e80cda60 0x7fb0e80c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.421+0000 7fb0ecf89640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0e80cda60 0x7fb0e80c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45684/0 (socket says 172.21.15.114:45684) 2023-11-04T01:39:08.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.421+0000 7fb0ecf89640 1 -- 172.21.15.114:0/1978597022 learned_addr learned my addr 172.21.15.114:0/1978597022 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:08.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.421+0000 7fb0ed78a640 1 --2- 172.21.15.114:0/1978597022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0e80b0cd0 0x7fb0e80af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.421+0000 7fb0edf8b640 1 --2- 172.21.15.114:0/1978597022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0e80cde40 0x7fb0e80c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.421+0000 7fb0ecf89640 1 -- 172.21.15.114:0/1978597022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0e80b0cd0 msgr2=0x7fb0e80af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.421+0000 7fb0ecf89640 1 --2- 172.21.15.114:0/1978597022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0e80b0cd0 0x7fb0e80af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.421+0000 7fb0ecf89640 1 -- 172.21.15.114:0/1978597022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0e80cde40 msgr2=0x7fb0e80c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.421+0000 7fb0ecf89640 1 --2- 172.21.15.114:0/1978597022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0e80cde40 0x7fb0e80c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.421+0000 7fb0ecf89640 1 -- 172.21.15.114:0/1978597022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e0009a70 con 0x7fb0e80cda60 2023-11-04T01:39:08.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.422+0000 7fb0ecf89640 1 --2- 172.21.15.114:0/1978597022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0e80cda60 0x7fb0e80c7c70 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800d7d0 tx=0x7fb0d800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.422+0000 7fb0ddffb640 1 -- 172.21.15.114:0/1978597022 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800b6c0 con 0x7fb0e80cda60 2023-11-04T01:39:08.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.422+0000 7fb0ddffb640 1 -- 172.21.15.114:0/1978597022 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d800b840 con 0x7fb0e80cda60 2023-11-04T01:39:08.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.422+0000 7fb0ef9ee640 1 -- 172.21.15.114:0/1978597022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e80c87e0 con 0x7fb0e80cda60 2023-11-04T01:39:08.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.422+0000 7fb0ddffb640 1 -- 172.21.15.114:0/1978597022 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800bbf0 con 0x7fb0e80cda60 2023-11-04T01:39:08.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.422+0000 7fb0ef9ee640 1 -- 172.21.15.114:0/1978597022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e80c7000 con 0x7fb0e80cda60 2023-11-04T01:39:08.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.423+0000 7fb0ef9ee640 1 -- 172.21.15.114:0/1978597022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e80cc470 con 0x7fb0e80cda60 2023-11-04T01:39:08.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.423+0000 7fb0ddffb640 1 -- 172.21.15.114:0/1978597022 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb0d800bd50 con 0x7fb0e80cda60 2023-11-04T01:39:08.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.424+0000 7fb0ddffb640 1 --2- 172.21.15.114:0/1978597022 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0cc06ae70 0x7fb0cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.424+0000 7fb0ed78a640 1 --2- 172.21.15.114:0/1978597022 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0cc06ae70 0x7fb0cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.424+0000 7fb0ddffb640 1 -- 172.21.15.114:0/1978597022 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fb0d808a120 con 0x7fb0e80cda60 2023-11-04T01:39:08.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.424+0000 7fb0ed78a640 1 --2- 172.21.15.114:0/1978597022 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0cc06ae70 0x7fb0cc06d330 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4000f60 tx=0x7fb0e4007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.428+0000 7fb0ddffb640 1 -- 172.21.15.114:0/1978597022 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0e80cc470 con 0x7fb0e80cda60 2023-11-04T01:39:08.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.629+0000 7fb0ef9ee640 1 -- 172.21.15.114:0/1978597022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0e80cc470 con 0x7fb0e80cda60 2023-11-04T01:39:08.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.630+0000 7fb0ddffb640 1 -- 172.21.15.114:0/1978597022 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fb0e80cc470 con 0x7fb0e80cda60 2023-11-04T01:39:08.632 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:08.632 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5731,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/4055552299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4055552299},{"type":"v1","addr":"172.21.15.141:6835","nonce":4055552299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6471,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/4254364199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":4254364199},{"type":"v1","addr":"172.21.15.114:6836","nonce":4254364199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6474,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3499206733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3499206733},{"type":"v1","addr":"172.21.15.114:6837","nonce":3499206733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:50.176333+0000","modified":"2023-11-04T01:38:52.173738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6486},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6486":{"gid":6486,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6834/1383574171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1383574171},{"type":"v1","addr":"172.21.15.141:6834","nonce":1383574171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:39:08.632 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 29 2023-11-04T01:39:08.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.632+0000 7fb0ef9ee640 1 -- 172.21.15.114:0/1978597022 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0cc06ae70 msgr2=0x7fb0cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.632+0000 7fb0ef9ee640 1 --2- 172.21.15.114:0/1978597022 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0cc06ae70 0x7fb0cc06d330 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4000f60 tx=0x7fb0e4007b50 comp rx=0 tx=0).stop 2023-11-04T01:39:08.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.632+0000 7fb0ef9ee640 1 -- 172.21.15.114:0/1978597022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0e80cda60 msgr2=0x7fb0e80c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.632+0000 7fb0ef9ee640 1 --2- 172.21.15.114:0/1978597022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0e80cda60 0x7fb0e80c7c70 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800d7d0 tx=0x7fb0d800dc90 comp rx=0 tx=0).stop 2023-11-04T01:39:08.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.632+0000 7fb0ef9ee640 1 -- 172.21.15.114:0/1978597022 shutdown_connections 2023-11-04T01:39:08.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.632+0000 7fb0ef9ee640 1 --2- 172.21.15.114:0/1978597022 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb0cc06ae70 0x7fb0cc06d330 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.632+0000 7fb0ef9ee640 1 --2- 172.21.15.114:0/1978597022 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb0e80cde40 0x7fb0e80c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.632+0000 7fb0ef9ee640 1 --2- 172.21.15.114:0/1978597022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0e80cda60 0x7fb0e80c7c70 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.632+0000 7fb0ef9ee640 1 --2- 172.21.15.114:0/1978597022 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb0e80b0cd0 0x7fb0e80af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.632+0000 7fb0ef9ee640 1 -- 172.21.15.114:0/1978597022 >> 172.21.15.114:0/1978597022 conn(0x7fb0e80ce950 msgr2=0x7fb0e8158d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:08.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.632+0000 7fb0ef9ee640 1 -- 172.21.15.114:0/1978597022 shutdown_connections 2023-11-04T01:39:08.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.632+0000 7fb0ef9ee640 1 -- 172.21.15.114:0/1978597022 wait complete. 2023-11-04T01:39:08.645 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:08.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.741+0000 7ffb8c983640 1 Processor -- start 2023-11-04T01:39:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.741+0000 7ffb8c983640 1 -- start start 2023-11-04T01:39:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.742+0000 7ffb8c983640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb880ce240 0x7ffb88157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.742+0000 7ffb8c983640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8815e000 con 0x7ffb880cde60 2023-11-04T01:39:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.742+0000 7ffb8c983640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8815e2e0 con 0x7ffb88157540 2023-11-04T01:39:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.742+0000 7ffb8c983640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8815e5c0 con 0x7ffb880ce240 2023-11-04T01:39:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.743+0000 7ffb8659c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ffb880cde60 0x7ffb8815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51126/0 (socket says 172.21.15.114:51126) 2023-11-04T01:39:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.743+0000 7ffb8659c640 1 -- 172.21.15.114:0/1926796091 learned_addr learned my addr 172.21.15.114:0/1926796091 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:08.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.743+0000 7ffb85d9b640 1 --2- 172.21.15.114:0/1926796091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb880ce240 0x7ffb88157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.743+0000 7ffb8559a640 1 -- 172.21.15.114:0/1926796091 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409049380 0 0) 0x7ffb8815e000 con 0x7ffb880cde60 2023-11-04T01:39:08.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.743+0000 7ffb8559a640 1 -- 172.21.15.114:0/1926796091 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb70003520 con 0x7ffb880cde60 2023-11-04T01:39:08.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.743+0000 7ffb8559a640 1 -- 172.21.15.114:0/1926796091 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497913131 0 0) 0x7ffb8815e2e0 con 0x7ffb88157540 2023-11-04T01:39:08.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.743+0000 7ffb85d9b640 1 -- 172.21.15.114:0/1926796091 >> v1:172.21.15.141:6789/0 conn(0x7ffb88157540 legacy=0x7ffb880d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.743+0000 7ffb85d9b640 1 -- 172.21.15.114:0/1926796091 >> v1:172.21.15.114:6789/0 conn(0x7ffb880cde60 legacy=0x7ffb8815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.743+0000 7ffb85d9b640 1 -- 172.21.15.114:0/1926796091 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb880d1120 con 0x7ffb880ce240 2023-11-04T01:39:08.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.744+0000 7ffb85d9b640 1 --2- 172.21.15.114:0/1926796091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb880ce240 0x7ffb88157000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffb780097d0 tx=0x7ffb7802b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b6dcd43bdc89673 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.744+0000 7ffb8559a640 1 -- 172.21.15.114:0/1926796091 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c001670 con 0x7ffb880ce240 2023-11-04T01:39:08.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.744+0000 7ffb8559a640 1 -- 172.21.15.114:0/1926796091 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7802e050 con 0x7ffb880ce240 2023-11-04T01:39:08.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.744+0000 7ffb8559a640 1 -- 172.21.15.114:0/1926796091 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb78030710 con 0x7ffb880ce240 2023-11-04T01:39:08.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.744+0000 7ffb8c983640 1 -- 172.21.15.114:0/1926796091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb880ce240 msgr2=0x7ffb88157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.744+0000 7ffb8c983640 1 --2- 172.21.15.114:0/1926796091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb880ce240 0x7ffb88157000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffb780097d0 tx=0x7ffb7802b730 comp rx=0 tx=0).stop 2023-11-04T01:39:08.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.745+0000 7ffb8c983640 1 -- 172.21.15.114:0/1926796091 shutdown_connections 2023-11-04T01:39:08.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.745+0000 7ffb8c983640 1 --2- 172.21.15.114:0/1926796091 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb880ce240 0x7ffb88157000 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.745+0000 7ffb8c983640 1 -- 172.21.15.114:0/1926796091 >> 172.21.15.114:0/1926796091 conn(0x7ffb88071f30 msgr2=0x7ffb880cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:08.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.745+0000 7ffb8c983640 1 -- 172.21.15.114:0/1926796091 shutdown_connections 2023-11-04T01:39:08.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.745+0000 7ffb8c983640 1 -- 172.21.15.114:0/1926796091 wait complete. 2023-11-04T01:39:08.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.746+0000 7ffb8c983640 1 Processor -- start 2023-11-04T01:39:08.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.746+0000 7ffb8c983640 1 -- start start 2023-11-04T01:39:08.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8c983640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb880cde60 0x7ffb880b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8c983640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffb880ce240 0x7ffb88158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8c983640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb88157540 0x7ffb881593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8c983640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb88157c60 con 0x7ffb880cde60 2023-11-04T01:39:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8c983640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb88157f00 con 0x7ffb880ce240 2023-11-04T01:39:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8c983640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb881581e0 con 0x7ffb88157540 2023-11-04T01:39:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb880cde60 0x7ffb880b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb880cde60 0x7ffb880b70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45692/0 (socket says 172.21.15.114:45692) 2023-11-04T01:39:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8659c640 1 -- 172.21.15.114:0/1214855241 learned_addr learned my addr 172.21.15.114:0/1214855241 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb85d9b640 1 --2- 172.21.15.114:0/1214855241 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffb880ce240 0x7ffb88158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb86d9d640 1 --2- 172.21.15.114:0/1214855241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb88157540 0x7ffb881593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8659c640 1 -- 172.21.15.114:0/1214855241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb88157540 msgr2=0x7ffb881593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8659c640 1 --2- 172.21.15.114:0/1214855241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb88157540 0x7ffb881593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8659c640 1 -- 172.21.15.114:0/1214855241 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffb880ce240 msgr2=0x7ffb88158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8659c640 1 --2- 172.21.15.114:0/1214855241 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffb880ce240 0x7ffb88158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8659c640 1 -- 172.21.15.114:0/1214855241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb78009400 con 0x7ffb880cde60 2023-11-04T01:39:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb86d9d640 1 --2- 172.21.15.114:0/1214855241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb88157540 0x7ffb881593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb85d9b640 1 --2- 172.21.15.114:0/1214855241 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffb880ce240 0x7ffb88158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8659c640 1 --2- 172.21.15.114:0/1214855241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb880cde60 0x7ffb880b70c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00c840 tx=0x7ffb7c00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb76ffd640 1 -- 172.21.15.114:0/1214855241 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0074e0 con 0x7ffb880cde60 2023-11-04T01:39:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb76ffd640 1 -- 172.21.15.114:0/1214855241 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c007660 con 0x7ffb880cde60 2023-11-04T01:39:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8c983640 1 -- 172.21.15.114:0/1214855241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb881584c0 con 0x7ffb880cde60 2023-11-04T01:39:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb76ffd640 1 -- 172.21.15.114:0/1214855241 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c004a00 con 0x7ffb880cde60 2023-11-04T01:39:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.747+0000 7ffb8c983640 1 -- 172.21.15.114:0/1214855241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb880b7600 con 0x7ffb880cde60 2023-11-04T01:39:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.748+0000 7ffb8c983640 1 -- 172.21.15.114:0/1214855241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb88074290 con 0x7ffb880cde60 2023-11-04T01:39:08.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.749+0000 7ffb76ffd640 1 -- 172.21.15.114:0/1214855241 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb7c004b60 con 0x7ffb880cde60 2023-11-04T01:39:08.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.749+0000 7ffb76ffd640 1 --2- 172.21.15.114:0/1214855241 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ffb6806ae70 0x7ffb6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:08.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.749+0000 7ffb76ffd640 1 -- 172.21.15.114:0/1214855241 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7ffb7c089370 con 0x7ffb880cde60 2023-11-04T01:39:08.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.749+0000 7ffb85d9b640 1 --2- 172.21.15.114:0/1214855241 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ffb6806ae70 0x7ffb6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:08.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.749+0000 7ffb85d9b640 1 --2- 172.21.15.114:0/1214855241 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ffb6806ae70 0x7ffb6806d330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ffb78034000 tx=0x7ffb78008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:08.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.753+0000 7ffb76ffd640 1 -- 172.21.15.114:0/1214855241 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb7c053f30 con 0x7ffb880cde60 2023-11-04T01:39:08.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.958+0000 7ffb8c983640 1 -- 172.21.15.114:0/1214855241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb880b8510 con 0x7ffb880cde60 2023-11-04T01:39:08.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.959+0000 7ffb76ffd640 1 -- 172.21.15.114:0/1214855241 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4927 (secure 0 0 0) 0x7ffb7c057550 con 0x7ffb880cde60 2023-11-04T01:39:08.961 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:08.961 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5731,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/4055552299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4055552299},{"type":"v1","addr":"172.21.15.141:6835","nonce":4055552299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6471,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/4254364199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":4254364199},{"type":"v1","addr":"172.21.15.114:6836","nonce":4254364199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6474,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3499206733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3499206733},{"type":"v1","addr":"172.21.15.114:6837","nonce":3499206733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:38:50.176333+0000","modified":"2023-11-04T01:38:52.173738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6486},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6486":{"gid":6486,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6834/1383574171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1383574171},{"type":"v1","addr":"172.21.15.141:6834","nonce":1383574171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:39:08.961 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 29 2023-11-04T01:39:08.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.961+0000 7ffb8c983640 1 -- 172.21.15.114:0/1214855241 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ffb6806ae70 msgr2=0x7ffb6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.961+0000 7ffb8c983640 1 --2- 172.21.15.114:0/1214855241 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ffb6806ae70 0x7ffb6806d330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ffb78034000 tx=0x7ffb78008030 comp rx=0 tx=0).stop 2023-11-04T01:39:08.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.961+0000 7ffb8c983640 1 -- 172.21.15.114:0/1214855241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb880cde60 msgr2=0x7ffb880b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:08.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.961+0000 7ffb8c983640 1 --2- 172.21.15.114:0/1214855241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb880cde60 0x7ffb880b70c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00c840 tx=0x7ffb7c00cd00 comp rx=0 tx=0).stop 2023-11-04T01:39:08.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.961+0000 7ffb8c983640 1 -- 172.21.15.114:0/1214855241 shutdown_connections 2023-11-04T01:39:08.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.961+0000 7ffb8c983640 1 --2- 172.21.15.114:0/1214855241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb88157540 0x7ffb881593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.961+0000 7ffb8c983640 1 --2- 172.21.15.114:0/1214855241 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ffb6806ae70 0x7ffb6806d330 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.961+0000 7ffb8c983640 1 --2- 172.21.15.114:0/1214855241 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffb880ce240 0x7ffb88158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.961+0000 7ffb8c983640 1 --2- 172.21.15.114:0/1214855241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb880cde60 0x7ffb880b70c0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:08.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.961+0000 7ffb8c983640 1 -- 172.21.15.114:0/1214855241 >> 172.21.15.114:0/1214855241 conn(0x7ffb88071f30 msgr2=0x7ffb88072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:08.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.961+0000 7ffb8c983640 1 -- 172.21.15.114:0/1214855241 shutdown_connections 2023-11-04T01:39:08.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:08.961+0000 7ffb8c983640 1 -- 172.21.15.114:0/1214855241 wait complete. 2023-11-04T01:39:08.973 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:09.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.071+0000 7f17c0258640 1 Processor -- start 2023-11-04T01:39:09.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.071+0000 7f17c0258640 1 -- start start 2023-11-04T01:39:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.072+0000 7f17c0258640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17b80b42c0 0x7f17b80c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.072+0000 7f17c0258640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17b80c9c40 0x7f17b80b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.072+0000 7f17c0258640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b80ca090 con 0x7f17b815ad80 2023-11-04T01:39:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.072+0000 7f17c0258640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b806cfa0 con 0x7f17b80c9c40 2023-11-04T01:39:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.072+0000 7f17c0258640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b806d280 con 0x7f17b80b42c0 2023-11-04T01:39:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.072+0000 7f17be7f5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17b80c9c40 0x7f17b80b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.072+0000 7f17bdff4640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f17b815ad80 0x7f17b806c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51138/0 (socket says 172.21.15.114:51138) 2023-11-04T01:39:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.072+0000 7f17bdff4640 1 -- 172.21.15.114:0/3463839382 learned_addr learned my addr 172.21.15.114:0/3463839382 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.072+0000 7f17be7f5640 1 -- 172.21.15.114:0/3463839382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17b80b42c0 msgr2=0x7f17b80c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.072+0000 7f17be7f5640 1 --2- 172.21.15.114:0/3463839382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17b80b42c0 0x7f17b80c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.072+0000 7f17be7f5640 1 -- 172.21.15.114:0/3463839382 >> v1:172.21.15.114:6789/0 conn(0x7f17b815ad80 legacy=0x7f17b806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.072+0000 7f17be7f5640 1 -- 172.21.15.114:0/3463839382 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b806d560 con 0x7f17b80c9c40 2023-11-04T01:39:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.072+0000 7f17bcff2640 1 -- 172.21.15.114:0/3463839382 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144604242 0 0) 0x7f17b4001110 con 0x7f17b815ad80 2023-11-04T01:39:09.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.073+0000 7f17be7f5640 1 --2- 172.21.15.114:0/3463839382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17b80c9c40 0x7f17b80b1a40 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009d90 tx=0x7f17b002bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96e883c49ad7473 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.073+0000 7f17bcff2640 1 -- 172.21.15.114:0/3463839382 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b002cce0 con 0x7f17b80c9c40 2023-11-04T01:39:09.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.073+0000 7f17bcff2640 1 -- 172.21.15.114:0/3463839382 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b002ce40 con 0x7f17b80c9c40 2023-11-04T01:39:09.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.073+0000 7f17bcff2640 1 -- 172.21.15.114:0/3463839382 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0034660 con 0x7f17b80c9c40 2023-11-04T01:39:09.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.074+0000 7f17c0258640 1 -- 172.21.15.114:0/3463839382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17b80c9c40 msgr2=0x7f17b80b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.074+0000 7f17c0258640 1 --2- 172.21.15.114:0/3463839382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17b80c9c40 0x7f17b80b1a40 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009d90 tx=0x7f17b002bf30 comp rx=0 tx=0).stop 2023-11-04T01:39:09.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.074+0000 7f17c0258640 1 -- 172.21.15.114:0/3463839382 shutdown_connections 2023-11-04T01:39:09.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.074+0000 7f17c0258640 1 --2- 172.21.15.114:0/3463839382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17b80c9c40 0x7f17b80b1a40 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.074+0000 7f17c0258640 1 --2- 172.21.15.114:0/3463839382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17b80b42c0 0x7f17b80c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.074+0000 7f17c0258640 1 -- 172.21.15.114:0/3463839382 >> 172.21.15.114:0/3463839382 conn(0x7f17b80ce950 msgr2=0x7f17b80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:09.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.074+0000 7f17c0258640 1 -- 172.21.15.114:0/3463839382 shutdown_connections 2023-11-04T01:39:09.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.074+0000 7f17c0258640 1 -- 172.21.15.114:0/3463839382 wait complete. 2023-11-04T01:39:09.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.075+0000 7f17c0258640 1 Processor -- start 2023-11-04T01:39:09.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.075+0000 7f17c0258640 1 -- start start 2023-11-04T01:39:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.076+0000 7f17c0258640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17b80b42c0 0x7f17b81533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.076+0000 7f17c0258640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17b80c9c40 0x7f17b80c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.076+0000 7f17c0258640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17b815ad80 0x7f17b80c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.076+0000 7f17c0258640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b815bba0 con 0x7f17b80c9c40 2023-11-04T01:39:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.076+0000 7f17c0258640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8153920 con 0x7f17b80b42c0 2023-11-04T01:39:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.076+0000 7f17c0258640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80c6ea0 con 0x7f17b815ad80 2023-11-04T01:39:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.076+0000 7f17bd7f3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17b80c9c40 0x7f17b80c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.076+0000 7f17bd7f3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17b80c9c40 0x7f17b80c7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45716/0 (socket says 172.21.15.114:45716) 2023-11-04T01:39:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.076+0000 7f17bd7f3640 1 -- 172.21.15.114:0/527279156 learned_addr learned my addr 172.21.15.114:0/527279156 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.076+0000 7f17bd7f3640 1 -- 172.21.15.114:0/527279156 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17b815ad80 msgr2=0x7f17b80c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.076+0000 7f17bd7f3640 1 --2- 172.21.15.114:0/527279156 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17b815ad80 0x7f17b80c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.076+0000 7f17bd7f3640 1 -- 172.21.15.114:0/527279156 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17b80b42c0 msgr2=0x7f17b81533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.076+0000 7f17bd7f3640 1 --2- 172.21.15.114:0/527279156 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17b80b42c0 0x7f17b81533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.076+0000 7f17bd7f3640 1 -- 172.21.15.114:0/527279156 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b0009a70 con 0x7f17b80c9c40 2023-11-04T01:39:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.076+0000 7f17bd7f3640 1 --2- 172.21.15.114:0/527279156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17b80c9c40 0x7f17b80c7810 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f17a800b410 tx=0x7f17a800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.077+0000 7f17ae7fc640 1 -- 172.21.15.114:0/527279156 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8011830 con 0x7f17b80c9c40 2023-11-04T01:39:09.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.077+0000 7f17ae7fc640 1 -- 172.21.15.114:0/527279156 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a80119b0 con 0x7f17b80c9c40 2023-11-04T01:39:09.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.077+0000 7f17c0258640 1 -- 172.21.15.114:0/527279156 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b815b200 con 0x7f17b80c9c40 2023-11-04T01:39:09.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.077+0000 7f17ae7fc640 1 -- 172.21.15.114:0/527279156 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8011d60 con 0x7f17b80c9c40 2023-11-04T01:39:09.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.077+0000 7f17c0258640 1 -- 172.21.15.114:0/527279156 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b815b7c0 con 0x7f17b80c9c40 2023-11-04T01:39:09.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.077+0000 7f17c0258640 1 -- 172.21.15.114:0/527279156 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b815bce0 con 0x7f17b80c9c40 2023-11-04T01:39:09.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.078+0000 7f17ae7fc640 1 -- 172.21.15.114:0/527279156 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17a801a400 con 0x7f17b80c9c40 2023-11-04T01:39:09.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.079+0000 7f17ae7fc640 1 --2- 172.21.15.114:0/527279156 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f179c06ae70 0x7f179c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.079+0000 7f17ae7fc640 1 -- 172.21.15.114:0/527279156 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f17a808a090 con 0x7f17b80c9c40 2023-11-04T01:39:09.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.079+0000 7f17bdff4640 1 --2- 172.21.15.114:0/527279156 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f179c06ae70 0x7f179c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.079+0000 7f17bdff4640 1 --2- 172.21.15.114:0/527279156 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f179c06ae70 0x7f179c06d330 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f17b4007fd0 tx=0x7f17b4001310 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.082+0000 7f17ae7fc640 1 -- 172.21.15.114:0/527279156 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f17a8054c50 con 0x7f17b80c9c40 2023-11-04T01:39:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.250+0000 7f17c0258640 1 -- 172.21.15.114:0/527279156 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17b815bce0 con 0x7f17b80c9c40 2023-11-04T01:39:09.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.251+0000 7f17ae7fc640 1 -- 172.21.15.114:0/527279156 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+22117 (secure 0 0 0) 0x7f17b815bce0 con 0x7f17b80c9c40 2023-11-04T01:39:09.253 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:09.253 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":71,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:05.562462+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:38:48.665033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:38:49.137709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.253+0000 7f17c0258640 1 -- 172.21.15.114:0/527279156 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f179c06ae70 msgr2=0x7f179c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.253+0000 7f17c0258640 1 --2- 172.21.15.114:0/527279156 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f179c06ae70 0x7f179c06d330 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f17b4007fd0 tx=0x7f17b4001310 comp rx=0 tx=0).stop 2023-11-04T01:39:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.253+0000 7f17c0258640 1 -- 172.21.15.114:0/527279156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17b80c9c40 msgr2=0x7f17b80c7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.253+0000 7f17c0258640 1 --2- 172.21.15.114:0/527279156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17b80c9c40 0x7f17b80c7810 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f17a800b410 tx=0x7f17a800b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.253+0000 7f17c0258640 1 -- 172.21.15.114:0/527279156 shutdown_connections 2023-11-04T01:39:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.253+0000 7f17c0258640 1 --2- 172.21.15.114:0/527279156 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f17b815ad80 0x7f17b80c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.253+0000 7f17c0258640 1 --2- 172.21.15.114:0/527279156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17b80c9c40 0x7f17b80c7810 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.253+0000 7f17c0258640 1 --2- 172.21.15.114:0/527279156 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f179c06ae70 0x7f179c06d330 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.253+0000 7f17c0258640 1 --2- 172.21.15.114:0/527279156 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f17b80b42c0 0x7f17b81533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.253+0000 7f17c0258640 1 -- 172.21.15.114:0/527279156 >> 172.21.15.114:0/527279156 conn(0x7f17b80ce950 msgr2=0x7f17b80ae420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:09.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.253+0000 7f17c0258640 1 -- 172.21.15.114:0/527279156 shutdown_connections 2023-11-04T01:39:09.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.253+0000 7f17c0258640 1 -- 172.21.15.114:0/527279156 wait complete. 2023-11-04T01:39:09.266 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:39:09.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.364+0000 7fb194f55640 1 Processor -- start 2023-11-04T01:39:09.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.364+0000 7fb194f55640 1 -- start start 2023-11-04T01:39:09.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.365+0000 7fb194f55640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb190159c00 0x7fb1900cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.365+0000 7fb194f55640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19015aff0 con 0x7fb1900ae1d0 2023-11-04T01:39:09.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.365+0000 7fb194f55640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19015a3e0 con 0x7fb1900c48e0 2023-11-04T01:39:09.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.365+0000 7fb194f55640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19015a6c0 con 0x7fb190159c00 2023-11-04T01:39:09.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.365+0000 7fb18ed9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb1900ae1d0 0x7fb1900709f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51154/0 (socket says 172.21.15.114:51154) 2023-11-04T01:39:09.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.365+0000 7fb18ed9d640 1 -- 172.21.15.114:0/1943644259 learned_addr learned my addr 172.21.15.114:0/1943644259 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:09.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.365+0000 7fb18e59c640 1 --2- 172.21.15.114:0/1943644259 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb190159c00 0x7fb1900cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.365+0000 7fb18d59a640 1 -- 172.21.15.114:0/1943644259 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506988391 0 0) 0x7fb19015aff0 con 0x7fb1900ae1d0 2023-11-04T01:39:09.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.365+0000 7fb18d59a640 1 -- 172.21.15.114:0/1943644259 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb178003520 con 0x7fb1900ae1d0 2023-11-04T01:39:09.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.365+0000 7fb18d59a640 1 -- 172.21.15.114:0/1943644259 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 702920410 0 0) 0x7fb178003520 con 0x7fb1900ae1d0 2023-11-04T01:39:09.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.365+0000 7fb18d59a640 1 -- 172.21.15.114:0/1943644259 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb190159c00 msgr2=0x7fb1900cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:09.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.365+0000 7fb18d59a640 1 --2- 172.21.15.114:0/1943644259 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb190159c00 0x7fb1900cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.365+0000 7fb18d59a640 1 -- 172.21.15.114:0/1943644259 >> v1:172.21.15.141:6789/0 conn(0x7fb1900c48e0 legacy=0x7fb1900adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18d59a640 1 -- 172.21.15.114:0/1943644259 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19015a9a0 con 0x7fb1900ae1d0 2023-11-04T01:39:09.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18d59a640 1 -- 172.21.15.114:0/1943644259 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fb180001670 con 0x7fb1900ae1d0 2023-11-04T01:39:09.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18d59a640 1 -- 172.21.15.114:0/1943644259 >> v1:172.21.15.114:6789/0 conn(0x7fb1900ae1d0 legacy=0x7fb1900709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18d59a640 1 --2- 172.21.15.114:0/1943644259 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1780039a0 0x7fb178003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18d59a640 1 --2- 172.21.15.114:0/1943644259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb178004350 0x7fb178004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18d59a640 1 --2- 172.21.15.114:0/1943644259 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb190159c00 0x7fb178005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18d59a640 1 -- 172.21.15.114:0/1943644259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19015a6c0 con 0x7fb178004350 2023-11-04T01:39:09.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18d59a640 1 -- 172.21.15.114:0/1943644259 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17800b980 con 0x7fb1780039a0 2023-11-04T01:39:09.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18d59a640 1 -- 172.21.15.114:0/1943644259 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17800bb40 con 0x7fb190159c00 2023-11-04T01:39:09.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18dd9b640 1 --2- 172.21.15.114:0/1943644259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb178004350 0x7fb178004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18e59c640 1 --2- 172.21.15.114:0/1943644259 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1780039a0 0x7fb178003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18ed9d640 1 --2- 172.21.15.114:0/1943644259 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb190159c00 0x7fb178005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18dd9b640 1 -- 172.21.15.114:0/1943644259 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb190159c00 msgr2=0x7fb178005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18dd9b640 1 --2- 172.21.15.114:0/1943644259 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb190159c00 0x7fb178005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18dd9b640 1 -- 172.21.15.114:0/1943644259 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1780039a0 msgr2=0x7fb178003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18dd9b640 1 --2- 172.21.15.114:0/1943644259 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1780039a0 0x7fb178003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.366+0000 7fb18dd9b640 1 -- 172.21.15.114:0/1943644259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb178003520 con 0x7fb178004350 2023-11-04T01:39:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.367+0000 7fb18dd9b640 1 --2- 172.21.15.114:0/1943644259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb178004350 0x7fb178004820 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fb184001860 tx=0x7fb1780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94440bc5adda528 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.367+0000 7fb18d59a640 1 -- 172.21.15.114:0/1943644259 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184033410 con 0x7fb178004350 2023-11-04T01:39:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.367+0000 7fb18d59a640 1 -- 172.21.15.114:0/1943644259 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb184033590 con 0x7fb178004350 2023-11-04T01:39:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.367+0000 7fb18d59a640 1 -- 172.21.15.114:0/1943644259 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184033940 con 0x7fb178004350 2023-11-04T01:39:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.367+0000 7fb194f55640 1 -- 172.21.15.114:0/1943644259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb178004350 msgr2=0x7fb178004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.367+0000 7fb194f55640 1 --2- 172.21.15.114:0/1943644259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb178004350 0x7fb178004820 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fb184001860 tx=0x7fb1780057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.367+0000 7fb18ed9d640 1 -- 172.21.15.114:0/1943644259 reap_dead start 2023-11-04T01:39:09.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.367+0000 7fb194f55640 1 -- 172.21.15.114:0/1943644259 shutdown_connections 2023-11-04T01:39:09.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.367+0000 7fb194f55640 1 -- 172.21.15.114:0/1943644259 >> 172.21.15.114:0/1943644259 conn(0x7fb1900ce950 msgr2=0x7fb1900ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:09.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.367+0000 7fb194f55640 1 -- 172.21.15.114:0/1943644259 shutdown_connections 2023-11-04T01:39:09.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.367+0000 7fb194f55640 1 -- 172.21.15.114:0/1943644259 wait complete. 2023-11-04T01:39:09.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.369+0000 7fb194f55640 1 Processor -- start 2023-11-04T01:39:09.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.369+0000 7fb194f55640 1 -- start start 2023-11-04T01:39:09.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.369+0000 7fb194f55640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb178004350 0x7fb1900c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.369+0000 7fb194f55640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1900c63c0 0x7fb1901e2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.369+0000 7fb194f55640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1900c6840 0x7fb19015bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.369+0000 7fb194f55640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1901e33a0 con 0x7fb1900c6840 2023-11-04T01:39:09.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.369+0000 7fb194f55640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1901e2de0 con 0x7fb1900c63c0 2023-11-04T01:39:09.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.369+0000 7fb194f55640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1901e30c0 con 0x7fb178004350 2023-11-04T01:39:09.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.370+0000 7fb18ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1900c6840 0x7fb19015bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.370+0000 7fb18ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1900c6840 0x7fb19015bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45730/0 (socket says 172.21.15.114:45730) 2023-11-04T01:39:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.370+0000 7fb18ed9d640 1 -- 172.21.15.114:0/3543524255 learned_addr learned my addr 172.21.15.114:0/3543524255 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.370+0000 7fb18e59c640 1 --2- 172.21.15.114:0/3543524255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb178004350 0x7fb1900c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.370+0000 7fb18dd9b640 1 --2- 172.21.15.114:0/3543524255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1900c63c0 0x7fb1901e2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.370+0000 7fb18ed9d640 1 -- 172.21.15.114:0/3543524255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb178004350 msgr2=0x7fb1900c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.370+0000 7fb18ed9d640 1 --2- 172.21.15.114:0/3543524255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb178004350 0x7fb1900c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.370+0000 7fb18ed9d640 1 -- 172.21.15.114:0/3543524255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1900c63c0 msgr2=0x7fb1901e2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.370+0000 7fb18ed9d640 1 --2- 172.21.15.114:0/3543524255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1900c63c0 0x7fb1901e2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.370+0000 7fb18ed9d640 1 -- 172.21.15.114:0/3543524255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1900c5bc0 con 0x7fb1900c6840 2023-11-04T01:39:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.370+0000 7fb18ed9d640 1 --2- 172.21.15.114:0/3543524255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1900c6840 0x7fb19015bbe0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fb180000c00 tx=0x7fb180007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.370+0000 7fb17effd640 1 -- 172.21.15.114:0/3543524255 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180001660 con 0x7fb1900c6840 2023-11-04T01:39:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.370+0000 7fb17effd640 1 -- 172.21.15.114:0/3543524255 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18000f8b0 con 0x7fb1900c6840 2023-11-04T01:39:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.370+0000 7fb194f55640 1 -- 172.21.15.114:0/3543524255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1900c5ea0 con 0x7fb1900c6840 2023-11-04T01:39:09.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.370+0000 7fb17effd640 1 -- 172.21.15.114:0/3543524255 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18000fc60 con 0x7fb1900c6840 2023-11-04T01:39:09.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.370+0000 7fb194f55640 1 -- 172.21.15.114:0/3543524255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1901e2860 con 0x7fb1900c6840 2023-11-04T01:39:09.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.371+0000 7fb194f55640 1 -- 172.21.15.114:0/3543524255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1900c5a20 con 0x7fb1900c6840 2023-11-04T01:39:09.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.371+0000 7fb17effd640 1 -- 172.21.15.114:0/3543524255 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb18001d460 con 0x7fb1900c6840 2023-11-04T01:39:09.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.372+0000 7fb17effd640 1 --2- 172.21.15.114:0/3543524255 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb17006aea0 0x7fb17006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.372+0000 7fb17effd640 1 -- 172.21.15.114:0/3543524255 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fb180089af0 con 0x7fb1900c6840 2023-11-04T01:39:09.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.372+0000 7fb18e59c640 1 --2- 172.21.15.114:0/3543524255 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb17006aea0 0x7fb17006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.372+0000 7fb18e59c640 1 --2- 172.21.15.114:0/3543524255 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb17006aea0 0x7fb17006d360 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb19015c960 tx=0x7fb18800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.376+0000 7fb17effd640 1 -- 172.21.15.114:0/3543524255 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1900c5a20 con 0x7fb1900c6840 2023-11-04T01:39:09.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.578+0000 7fb194f55640 1 -- 172.21.15.114:0/3543524255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb1900c5a20 con 0x7fb1900c6840 2023-11-04T01:39:09.580 INFO:tasks.ceph.mon.a.smithi114.stderr:2023-11-04T01:39:09.579+0000 7f5b24eb8640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:39:09.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.580+0000 7fb17effd640 1 -- 172.21.15.114:0/3543524255 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb1900c5a20 con 0x7fb1900c6840 2023-11-04T01:39:09.582 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:39:09.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.583+0000 7fb194f55640 1 -- 172.21.15.114:0/3543524255 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb17006aea0 msgr2=0x7fb17006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.583+0000 7fb194f55640 1 --2- 172.21.15.114:0/3543524255 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb17006aea0 0x7fb17006d360 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb19015c960 tx=0x7fb18800b040 comp rx=0 tx=0).stop 2023-11-04T01:39:09.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.583+0000 7fb194f55640 1 -- 172.21.15.114:0/3543524255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1900c6840 msgr2=0x7fb19015bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.583+0000 7fb194f55640 1 --2- 172.21.15.114:0/3543524255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1900c6840 0x7fb19015bbe0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fb180000c00 tx=0x7fb180007720 comp rx=0 tx=0).stop 2023-11-04T01:39:09.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.583+0000 7fb194f55640 1 -- 172.21.15.114:0/3543524255 shutdown_connections 2023-11-04T01:39:09.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.583+0000 7fb194f55640 1 --2- 172.21.15.114:0/3543524255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1900c6840 0x7fb19015bbe0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.583+0000 7fb194f55640 1 --2- 172.21.15.114:0/3543524255 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb17006aea0 0x7fb17006d360 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.583+0000 7fb194f55640 1 --2- 172.21.15.114:0/3543524255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1900c63c0 0x7fb1901e2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.583+0000 7fb194f55640 1 --2- 172.21.15.114:0/3543524255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb178004350 0x7fb1900c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.583+0000 7fb194f55640 1 -- 172.21.15.114:0/3543524255 >> 172.21.15.114:0/3543524255 conn(0x7fb1900ce950 msgr2=0x7fb19014b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:09.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.583+0000 7fb194f55640 1 -- 172.21.15.114:0/3543524255 shutdown_connections 2023-11-04T01:39:09.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.583+0000 7fb194f55640 1 -- 172.21.15.114:0/3543524255 wait complete. 2023-11-04T01:39:09.587 INFO:tasks.ceph.mds.b.smithi141.stderr: -567> 2023-11-04T01:38:56.568+0000 7fcc045f8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:39:09.595 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:39:09.613 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-04T01:39:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.694+0000 7f51f0ca9640 1 Processor -- start 2023-11-04T01:39:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.694+0000 7f51f0ca9640 1 -- start start 2023-11-04T01:39:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.695+0000 7f51f0ca9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ec0ae1d0 0x7f51ec0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.695+0000 7f51f0ca9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec15aff0 con 0x7f51ec159c00 2023-11-04T01:39:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.695+0000 7f51f0ca9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec15a3e0 con 0x7f51ec0c4ff0 2023-11-04T01:39:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.695+0000 7f51f0ca9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec15a6c0 con 0x7f51ec0ae1d0 2023-11-04T01:39:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.695+0000 7f51ea59c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f51ec159c00 0x7f51ec0c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51158/0 (socket says 172.21.15.114:51158) 2023-11-04T01:39:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.695+0000 7f51ea59c640 1 -- 172.21.15.114:0/3771179584 learned_addr learned my addr 172.21.15.114:0/3771179584 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51ead9d640 1 --2- 172.21.15.114:0/3771179584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ec0ae1d0 0x7f51ec0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51e959a640 1 -- 172.21.15.114:0/3771179584 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899052456 0 0) 0x7f51ec15aff0 con 0x7f51ec159c00 2023-11-04T01:39:09.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51e959a640 1 -- 172.21.15.114:0/3771179584 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d4005730 con 0x7f51ec159c00 2023-11-04T01:39:09.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51e959a640 1 -- 172.21.15.114:0/3771179584 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 753989814 0 0) 0x7f51d4005730 con 0x7f51ec159c00 2023-11-04T01:39:09.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51e959a640 1 -- 172.21.15.114:0/3771179584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ec0ae1d0 msgr2=0x7f51ec0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:09.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51e959a640 1 --2- 172.21.15.114:0/3771179584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ec0ae1d0 0x7f51ec0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51e959a640 1 -- 172.21.15.114:0/3771179584 >> v1:172.21.15.141:6789/0 conn(0x7f51ec0c4ff0 legacy=0x7f51ec0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51e959a640 1 -- 172.21.15.114:0/3771179584 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec15a9a0 con 0x7f51ec159c00 2023-11-04T01:39:09.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51e959a640 1 -- 172.21.15.114:0/3771179584 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f51e0001670 con 0x7f51ec159c00 2023-11-04T01:39:09.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51e959a640 1 -- 172.21.15.114:0/3771179584 >> v1:172.21.15.114:6789/0 conn(0x7f51ec159c00 legacy=0x7f51ec0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51e959a640 1 --2- 172.21.15.114:0/3771179584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51d4005bb0 0x7f51d4005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51e959a640 1 --2- 172.21.15.114:0/3771179584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ec0ae1d0 0x7f51d40069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51e959a640 1 --2- 172.21.15.114:0/3771179584 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51d4006f10 0x7f51d4007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51e959a640 1 -- 172.21.15.114:0/3771179584 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec15a6c0 con 0x7f51d4005bb0 2023-11-04T01:39:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51e959a640 1 -- 172.21.15.114:0/3771179584 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d400dbc0 con 0x7f51d4006f10 2023-11-04T01:39:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51e959a640 1 -- 172.21.15.114:0/3771179584 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d400dd80 con 0x7f51ec0ae1d0 2023-11-04T01:39:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51ea59c640 1 --2- 172.21.15.114:0/3771179584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51d4005bb0 0x7f51d4005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51ead9d640 1 --2- 172.21.15.114:0/3771179584 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51d4006f10 0x7f51d4007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51e9d9b640 1 --2- 172.21.15.114:0/3771179584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ec0ae1d0 0x7f51d40069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51ea59c640 1 -- 172.21.15.114:0/3771179584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ec0ae1d0 msgr2=0x7f51d40069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51ea59c640 1 --2- 172.21.15.114:0/3771179584 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ec0ae1d0 0x7f51d40069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51ea59c640 1 -- 172.21.15.114:0/3771179584 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51d4006f10 msgr2=0x7f51d4007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51ea59c640 1 --2- 172.21.15.114:0/3771179584 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51d4006f10 0x7f51d4007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.696+0000 7f51ea59c640 1 -- 172.21.15.114:0/3771179584 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d4005730 con 0x7f51d4005bb0 2023-11-04T01:39:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.697+0000 7f51ea59c640 1 --2- 172.21.15.114:0/3771179584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51d4005bb0 0x7f51d4005f90 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f51e000c190 tx=0x7f51d4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ee63f0be10b408 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.697+0000 7f51e959a640 1 -- 172.21.15.114:0/3771179584 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0005ad0 con 0x7f51d4005bb0 2023-11-04T01:39:09.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.697+0000 7f51e959a640 1 -- 172.21.15.114:0/3771179584 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e0005c50 con 0x7f51d4005bb0 2023-11-04T01:39:09.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.697+0000 7f51e959a640 1 -- 172.21.15.114:0/3771179584 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e002c790 con 0x7f51d4005bb0 2023-11-04T01:39:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.698+0000 7f51f0ca9640 1 -- 172.21.15.114:0/3771179584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51d4005bb0 msgr2=0x7f51d4005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.698+0000 7f51f0ca9640 1 --2- 172.21.15.114:0/3771179584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51d4005bb0 0x7f51d4005f90 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f51e000c190 tx=0x7f51d4007a00 comp rx=0 tx=0).stop 2023-11-04T01:39:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.698+0000 7f51ead9d640 1 -- 172.21.15.114:0/3771179584 reap_dead start 2023-11-04T01:39:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.698+0000 7f51f0ca9640 1 -- 172.21.15.114:0/3771179584 shutdown_connections 2023-11-04T01:39:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.698+0000 7f51f0ca9640 1 -- 172.21.15.114:0/3771179584 >> 172.21.15.114:0/3771179584 conn(0x7f51ec0ce950 msgr2=0x7f51ec0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.698+0000 7f51f0ca9640 1 -- 172.21.15.114:0/3771179584 shutdown_connections 2023-11-04T01:39:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.698+0000 7f51f0ca9640 1 -- 172.21.15.114:0/3771179584 wait complete. 2023-11-04T01:39:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.699+0000 7f51f0ca9640 1 Processor -- start 2023-11-04T01:39:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.699+0000 7f51f0ca9640 1 -- start start 2023-11-04T01:39:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51f0ca9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51d4005bb0 0x7f51ec1f3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51f0ca9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ec15c1f0 0x7f51ec15c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51f0ca9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51ec14d6a0 0x7f51ec14db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51f0ca9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec15cbb0 con 0x7f51ec14d6a0 2023-11-04T01:39:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51f0ca9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec1f3290 con 0x7f51d4005bb0 2023-11-04T01:39:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51f0ca9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec140c40 con 0x7f51ec15c1f0 2023-11-04T01:39:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51ead9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51ec14d6a0 0x7f51ec14db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51ead9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51ec14d6a0 0x7f51ec14db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45748/0 (socket says 172.21.15.114:45748) 2023-11-04T01:39:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51ead9d640 1 -- 172.21.15.114:0/621850148 learned_addr learned my addr 172.21.15.114:0/621850148 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51ea59c640 1 --2- 172.21.15.114:0/621850148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51d4005bb0 0x7f51ec1f3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51e9d9b640 1 --2- 172.21.15.114:0/621850148 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ec15c1f0 0x7f51ec15c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51ead9d640 1 -- 172.21.15.114:0/621850148 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ec15c1f0 msgr2=0x7f51ec15c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51ead9d640 1 --2- 172.21.15.114:0/621850148 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ec15c1f0 0x7f51ec15c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51ead9d640 1 -- 172.21.15.114:0/621850148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51d4005bb0 msgr2=0x7f51ec1f3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51ead9d640 1 --2- 172.21.15.114:0/621850148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51d4005bb0 0x7f51ec1f3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51ead9d640 1 -- 172.21.15.114:0/621850148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec14cc00 con 0x7f51ec14d6a0 2023-11-04T01:39:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51e9d9b640 1 --2- 172.21.15.114:0/621850148 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ec15c1f0 0x7f51ec15c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51ead9d640 1 --2- 172.21.15.114:0/621850148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51ec14d6a0 0x7f51ec14db20 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0cb070 tx=0x7f51e400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51daffd640 1 -- 172.21.15.114:0/621850148 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400e040 con 0x7f51ec14d6a0 2023-11-04T01:39:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51daffd640 1 -- 172.21.15.114:0/621850148 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e400f040 con 0x7f51ec14d6a0 2023-11-04T01:39:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.700+0000 7f51f0ca9640 1 -- 172.21.15.114:0/621850148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec1f2cd0 con 0x7f51ec14d6a0 2023-11-04T01:39:09.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.701+0000 7f51daffd640 1 -- 172.21.15.114:0/621850148 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4015430 con 0x7f51ec14d6a0 2023-11-04T01:39:09.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.701+0000 7f51f0ca9640 1 -- 172.21.15.114:0/621850148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec14cea0 con 0x7f51ec14d6a0 2023-11-04T01:39:09.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.701+0000 7f51f0ca9640 1 -- 172.21.15.114:0/621850148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec074290 con 0x7f51ec14d6a0 2023-11-04T01:39:09.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.702+0000 7f51daffd640 1 -- 172.21.15.114:0/621850148 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51e4015590 con 0x7f51ec14d6a0 2023-11-04T01:39:09.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.702+0000 7f51daffd640 1 --2- 172.21.15.114:0/621850148 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51cc06ae70 0x7f51cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:09.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.702+0000 7f51daffd640 1 -- 172.21.15.114:0/621850148 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f51e408a2c0 con 0x7f51ec14d6a0 2023-11-04T01:39:09.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.702+0000 7f51ea59c640 1 --2- 172.21.15.114:0/621850148 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51cc06ae70 0x7f51cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:09.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.703+0000 7f51ea59c640 1 --2- 172.21.15.114:0/621850148 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51cc06ae70 0x7f51cc06d330 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f51e0034000 tx=0x7f51e0009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:09.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.706+0000 7f51daffd640 1 -- 172.21.15.114:0/621850148 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51e4054db0 con 0x7f51ec14d6a0 2023-11-04T01:39:09.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:09.909+0000 7f51f0ca9640 1 -- 172.21.15.114:0/621850148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f51ec06e250 con 0x7f51ec14d6a0 2023-11-04T01:39:10.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.583+0000 7f51daffd640 1 -- 172.21.15.114:0/621850148 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7f51e40583d0 con 0x7f51ec14d6a0 2023-11-04T01:39:10.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.585+0000 7f51f0ca9640 1 -- 172.21.15.114:0/621850148 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51cc06ae70 msgr2=0x7f51cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.585+0000 7f51f0ca9640 1 --2- 172.21.15.114:0/621850148 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51cc06ae70 0x7f51cc06d330 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f51e0034000 tx=0x7f51e0009030 comp rx=0 tx=0).stop 2023-11-04T01:39:10.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.585+0000 7f51f0ca9640 1 -- 172.21.15.114:0/621850148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51ec14d6a0 msgr2=0x7f51ec14db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.585+0000 7f51f0ca9640 1 --2- 172.21.15.114:0/621850148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51ec14d6a0 0x7f51ec14db20 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0cb070 tx=0x7f51e400f580 comp rx=0 tx=0).stop 2023-11-04T01:39:10.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.585+0000 7f51f0ca9640 1 -- 172.21.15.114:0/621850148 shutdown_connections 2023-11-04T01:39:10.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.585+0000 7f51f0ca9640 1 --2- 172.21.15.114:0/621850148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51ec14d6a0 0x7f51ec14db20 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.585+0000 7f51f0ca9640 1 --2- 172.21.15.114:0/621850148 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ec15c1f0 0x7f51ec15c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.585+0000 7f51f0ca9640 1 --2- 172.21.15.114:0/621850148 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51cc06ae70 0x7f51cc06d330 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.585+0000 7f51f0ca9640 1 --2- 172.21.15.114:0/621850148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51d4005bb0 0x7f51ec1f3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.585+0000 7f51f0ca9640 1 -- 172.21.15.114:0/621850148 >> 172.21.15.114:0/621850148 conn(0x7f51ec0ce950 msgr2=0x7f51ec06cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:10.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.586+0000 7f51f0ca9640 1 -- 172.21.15.114:0/621850148 shutdown_connections 2023-11-04T01:39:10.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.586+0000 7f51f0ca9640 1 -- 172.21.15.114:0/621850148 wait complete. 2023-11-04T01:39:10.601 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:39:10.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.705+0000 7fbd52fe7640 1 Processor -- start 2023-11-04T01:39:10.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.706+0000 7fbd52fe7640 1 -- start start 2023-11-04T01:39:10.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.706+0000 7fbd52fe7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd4c0cd9f0 0x7fbd4c0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.706+0000 7fbd52fe7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbd4c15d4b0 0x7fbd4c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.706+0000 7fbd52fe7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd4c0b47e0 0x7fbd4c0b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.706+0000 7fbd52fe7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c15e4d0 con 0x7fbd4c0cd9f0 2023-11-04T01:39:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.706+0000 7fbd52fe7640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c0d1320 con 0x7fbd4c15d4b0 2023-11-04T01:39:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.706+0000 7fbd52fe7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0ce310 con 0x7fbd4c0b47e0 2023-11-04T01:39:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.706+0000 7fbd50d83640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd4c0cd9f0 0x7fbd4c0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.706+0000 7fbd50d83640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd4c0cd9f0 0x7fbd4c0cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45762/0 (socket says 172.21.15.114:45762) 2023-11-04T01:39:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.706+0000 7fbd50d83640 1 -- 172.21.15.114:0/1850332739 learned_addr learned my addr 172.21.15.114:0/1850332739 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.707+0000 7fbd4bfff640 1 --2- 172.21.15.114:0/1850332739 >> v2:172.21.15.141:3300/0 conn(0x7fbd4c15d4b0 0x7fbd4c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.707+0000 7fbd51584640 1 --2- 172.21.15.114:0/1850332739 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd4c0b47e0 0x7fbd4c0b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.707+0000 7fbd50d83640 1 -- 172.21.15.114:0/1850332739 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd4c0b47e0 msgr2=0x7fbd4c0b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.707+0000 7fbd50d83640 1 --2- 172.21.15.114:0/1850332739 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd4c0b47e0 0x7fbd4c0b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.707+0000 7fbd50d83640 1 -- 172.21.15.114:0/1850332739 >> v2:172.21.15.141:3300/0 conn(0x7fbd4c15d4b0 msgr2=0x7fbd4c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.707+0000 7fbd50d83640 1 --2- 172.21.15.114:0/1850332739 >> v2:172.21.15.141:3300/0 conn(0x7fbd4c15d4b0 0x7fbd4c15d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.707+0000 7fbd50d83640 1 -- 172.21.15.114:0/1850332739 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c15df10 con 0x7fbd4c0cd9f0 2023-11-04T01:39:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.707+0000 7fbd50d83640 1 --2- 172.21.15.114:0/1850332739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4c0cd9f0 0x7fbd4c0cddd0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0cf320 tx=0x7fbd3c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fa5aa624c3d84c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.708+0000 7fbd4b7fe640 1 -- 172.21.15.114:0/1850332739 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c030860 con 0x7fbd4c0cd9f0 2023-11-04T01:39:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.708+0000 7fbd4b7fe640 1 -- 172.21.15.114:0/1850332739 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c0309c0 con 0x7fbd4c0cd9f0 2023-11-04T01:39:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.708+0000 7fbd4b7fe640 1 -- 172.21.15.114:0/1850332739 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c030d50 con 0x7fbd4c0cd9f0 2023-11-04T01:39:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.708+0000 7fbd52fe7640 1 -- 172.21.15.114:0/1850332739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4c0cd9f0 msgr2=0x7fbd4c0cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.708+0000 7fbd52fe7640 1 --2- 172.21.15.114:0/1850332739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4c0cd9f0 0x7fbd4c0cddd0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c0cf320 tx=0x7fbd3c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.708+0000 7fbd52fe7640 1 -- 172.21.15.114:0/1850332739 shutdown_connections 2023-11-04T01:39:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.708+0000 7fbd52fe7640 1 --2- 172.21.15.114:0/1850332739 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd4c0b47e0 0x7fbd4c0b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.708+0000 7fbd52fe7640 1 --2- 172.21.15.114:0/1850332739 >> v2:172.21.15.141:3300/0 conn(0x7fbd4c15d4b0 0x7fbd4c15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.708+0000 7fbd52fe7640 1 --2- 172.21.15.114:0/1850332739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4c0cd9f0 0x7fbd4c0cddd0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.708+0000 7fbd52fe7640 1 -- 172.21.15.114:0/1850332739 >> 172.21.15.114:0/1850332739 conn(0x7fbd4c071c40 msgr2=0x7fbd4c072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.708+0000 7fbd52fe7640 1 -- 172.21.15.114:0/1850332739 shutdown_connections 2023-11-04T01:39:10.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.708+0000 7fbd52fe7640 1 -- 172.21.15.114:0/1850332739 wait complete. 2023-11-04T01:39:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.709+0000 7fbd52fe7640 1 Processor -- start 2023-11-04T01:39:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.709+0000 7fbd52fe7640 1 -- start start 2023-11-04T01:39:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.710+0000 7fbd52fe7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4c0b47e0 0x7fbd4c157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.710+0000 7fbd52fe7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd4c0cd9f0 0x7fbd4c159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.710+0000 7fbd52fe7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd4c15d4b0 0x7fbd4c0c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.710+0000 7fbd52fe7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0cbb90 con 0x7fbd4c0b47e0 2023-11-04T01:39:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.710+0000 7fbd52fe7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0cbe70 con 0x7fbd4c15d4b0 2023-11-04T01:39:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.710+0000 7fbd52fe7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0cc150 con 0x7fbd4c0cd9f0 2023-11-04T01:39:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.710+0000 7fbd50d83640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4c0b47e0 0x7fbd4c157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.710+0000 7fbd50d83640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4c0b47e0 0x7fbd4c157460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45766/0 (socket says 172.21.15.114:45766) 2023-11-04T01:39:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.710+0000 7fbd50d83640 1 -- 172.21.15.114:0/2332239164 learned_addr learned my addr 172.21.15.114:0/2332239164 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.710+0000 7fbd50d83640 1 -- 172.21.15.114:0/2332239164 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd4c0cd9f0 msgr2=0x7fbd4c159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.710+0000 7fbd50d83640 1 --2- 172.21.15.114:0/2332239164 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd4c0cd9f0 0x7fbd4c159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.710+0000 7fbd50d83640 1 -- 172.21.15.114:0/2332239164 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd4c15d4b0 msgr2=0x7fbd4c0c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.710+0000 7fbd51584640 1 --2- 172.21.15.114:0/2332239164 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd4c15d4b0 0x7fbd4c0c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.711+0000 7fbd50d83640 1 --2- 172.21.15.114:0/2332239164 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd4c15d4b0 0x7fbd4c0c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.711+0000 7fbd50d83640 1 -- 172.21.15.114:0/2332239164 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c0094d0 con 0x7fbd4c0b47e0 2023-11-04T01:39:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.711+0000 7fbd51584640 1 --2- 172.21.15.114:0/2332239164 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd4c15d4b0 0x7fbd4c0c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.711+0000 7fbd50d83640 1 --2- 172.21.15.114:0/2332239164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4c0b47e0 0x7fbd4c157460 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c02b9e0 tx=0x7fbd3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.711+0000 7fbd497fa640 1 -- 172.21.15.114:0/2332239164 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c039b60 con 0x7fbd4c0b47e0 2023-11-04T01:39:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.711+0000 7fbd497fa640 1 -- 172.21.15.114:0/2332239164 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c039cc0 con 0x7fbd4c0b47e0 2023-11-04T01:39:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.711+0000 7fbd52fe7640 1 -- 172.21.15.114:0/2332239164 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c0cc430 con 0x7fbd4c0b47e0 2023-11-04T01:39:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.711+0000 7fbd497fa640 1 -- 172.21.15.114:0/2332239164 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c043650 con 0x7fbd4c0b47e0 2023-11-04T01:39:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.711+0000 7fbd52fe7640 1 -- 172.21.15.114:0/2332239164 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c15a3b0 con 0x7fbd4c0b47e0 2023-11-04T01:39:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.712+0000 7fbd52fe7640 1 -- 172.21.15.114:0/2332239164 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4c04e490 con 0x7fbd4c0b47e0 2023-11-04T01:39:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.712+0000 7fbd497fa640 1 -- 172.21.15.114:0/2332239164 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd3c04c3b0 con 0x7fbd4c0b47e0 2023-11-04T01:39:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.713+0000 7fbd497fa640 1 --2- 172.21.15.114:0/2332239164 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd3806ae70 0x7fbd3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.713+0000 7fbd4bfff640 1 --2- 172.21.15.114:0/2332239164 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd3806ae70 0x7fbd3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.713+0000 7fbd497fa640 1 -- 172.21.15.114:0/2332239164 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7178+0+0 (secure 0 0 0) 0x7fbd3c0ac0f0 con 0x7fbd4c0b47e0 2023-11-04T01:39:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.713+0000 7fbd4bfff640 1 --2- 172.21.15.114:0/2332239164 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd3806ae70 0x7fbd3806d330 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbd40006e80 tx=0x7fbd40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:10.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.717+0000 7fbd497fa640 1 -- 172.21.15.114:0/2332239164 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd3c076c70 con 0x7fbd4c0b47e0 2023-11-04T01:39:10.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:10.885+0000 7fbd52fe7640 1 -- 172.21.15.114:0/2332239164 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbd4c06a6e0 con 0x7fbd4c0b47e0 2023-11-04T01:39:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.584+0000 7fbd497fa640 1 -- 172.21.15.114:0/2332239164 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v73) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbd3c07a290 con 0x7fbd4c0b47e0 2023-11-04T01:39:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:39:11.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.587+0000 7fbd52fe7640 1 -- 172.21.15.114:0/2332239164 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd3806ae70 msgr2=0x7fbd3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.587+0000 7fbd52fe7640 1 --2- 172.21.15.114:0/2332239164 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd3806ae70 0x7fbd3806d330 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbd40006e80 tx=0x7fbd40008040 comp rx=0 tx=0).stop 2023-11-04T01:39:11.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.587+0000 7fbd52fe7640 1 -- 172.21.15.114:0/2332239164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4c0b47e0 msgr2=0x7fbd4c157460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.587+0000 7fbd52fe7640 1 --2- 172.21.15.114:0/2332239164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4c0b47e0 0x7fbd4c157460 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c02b9e0 tx=0x7fbd3c004730 comp rx=0 tx=0).stop 2023-11-04T01:39:11.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.587+0000 7fbd52fe7640 1 -- 172.21.15.114:0/2332239164 shutdown_connections 2023-11-04T01:39:11.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.587+0000 7fbd52fe7640 1 --2- 172.21.15.114:0/2332239164 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd3806ae70 0x7fbd3806d330 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.587+0000 7fbd52fe7640 1 --2- 172.21.15.114:0/2332239164 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd4c15d4b0 0x7fbd4c0c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.587+0000 7fbd52fe7640 1 --2- 172.21.15.114:0/2332239164 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd4c0cd9f0 0x7fbd4c159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.587+0000 7fbd52fe7640 1 --2- 172.21.15.114:0/2332239164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd4c0b47e0 0x7fbd4c157460 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.587+0000 7fbd52fe7640 1 -- 172.21.15.114:0/2332239164 >> 172.21.15.114:0/2332239164 conn(0x7fbd4c071c40 msgr2=0x7fbd4c0b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:11.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.587+0000 7fbd52fe7640 1 -- 172.21.15.114:0/2332239164 shutdown_connections 2023-11-04T01:39:11.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.587+0000 7fbd52fe7640 1 -- 172.21.15.114:0/2332239164 wait complete. 2023-11-04T01:39:11.605 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:39:11.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.708+0000 7f60450c9640 1 Processor -- start 2023-11-04T01:39:11.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.708+0000 7f60450c9640 1 -- start start 2023-11-04T01:39:11.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.708+0000 7f60450c9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6040159be0 0x7f60400c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.708+0000 7f60450c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60400ade40 0x7f60400c3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f60450c9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60400c5890 con 0x7f604015e420 2023-11-04T01:39:11.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f60450c9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60400cd8e0 con 0x7f6040159be0 2023-11-04T01:39:11.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f60450c9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60400cdbc0 con 0x7f60400ade40 2023-11-04T01:39:11.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603e59c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f604015e420 0x7f60400ad730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51160/0 (socket says 172.21.15.114:51160) 2023-11-04T01:39:11.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603e59c640 1 -- 172.21.15.114:0/1692163240 learned_addr learned my addr 172.21.15.114:0/1692163240 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603f59e640 1 --2- 172.21.15.114:0/1692163240 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60400ade40 0x7f60400c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603dd9b640 1 -- 172.21.15.114:0/1692163240 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216145343 0 0) 0x7f60400c5890 con 0x7f604015e420 2023-11-04T01:39:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603ed9d640 1 --2- 172.21.15.114:0/1692163240 >> v2:172.21.15.141:3300/0 conn(0x7f6040159be0 0x7f60400c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603dd9b640 1 -- 172.21.15.114:0/1692163240 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6028005730 con 0x7f604015e420 2023-11-04T01:39:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603dd9b640 1 -- 172.21.15.114:0/1692163240 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2192210779 0 0) 0x7f6028005730 con 0x7f604015e420 2023-11-04T01:39:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603dd9b640 1 -- 172.21.15.114:0/1692163240 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60400ade40 msgr2=0x7f60400c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603dd9b640 1 --2- 172.21.15.114:0/1692163240 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60400ade40 0x7f60400c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603dd9b640 1 -- 172.21.15.114:0/1692163240 >> v2:172.21.15.141:3300/0 conn(0x7f6040159be0 msgr2=0x7f60400c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603dd9b640 1 --2- 172.21.15.114:0/1692163240 >> v2:172.21.15.141:3300/0 conn(0x7f6040159be0 0x7f60400c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603dd9b640 1 -- 172.21.15.114:0/1692163240 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60400cdea0 con 0x7f604015e420 2023-11-04T01:39:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603dd9b640 1 -- 172.21.15.114:0/1692163240 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f6034001670 con 0x7f604015e420 2023-11-04T01:39:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603dd9b640 1 -- 172.21.15.114:0/1692163240 >> v1:172.21.15.114:6789/0 conn(0x7f604015e420 legacy=0x7f60400ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603dd9b640 1 --2- 172.21.15.114:0/1692163240 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60400ade40 0x7f6028005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603dd9b640 1 --2- 172.21.15.114:0/1692163240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6028006100 0x7f60280069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603dd9b640 1 --2- 172.21.15.114:0/1692163240 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6028006f10 0x7f6028007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603dd9b640 1 -- 172.21.15.114:0/1692163240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60400cd8e0 con 0x7f6028006100 2023-11-04T01:39:11.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603dd9b640 1 -- 172.21.15.114:0/1692163240 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60400cdbc0 con 0x7f6028006f10 2023-11-04T01:39:11.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603dd9b640 1 -- 172.21.15.114:0/1692163240 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602800dbe0 con 0x7f60400ade40 2023-11-04T01:39:11.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603e59c640 1 --2- 172.21.15.114:0/1692163240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6028006100 0x7f60280069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603f59e640 1 --2- 172.21.15.114:0/1692163240 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6028006f10 0x7f6028007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.709+0000 7f603ed9d640 1 --2- 172.21.15.114:0/1692163240 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60400ade40 0x7f6028005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.710+0000 7f603e59c640 1 -- 172.21.15.114:0/1692163240 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60400ade40 msgr2=0x7f6028005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:11.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.710+0000 7f603e59c640 1 --2- 172.21.15.114:0/1692163240 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60400ade40 0x7f6028005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.710+0000 7f603e59c640 1 -- 172.21.15.114:0/1692163240 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6028006f10 msgr2=0x7f6028007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:11.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.710+0000 7f603e59c640 1 --2- 172.21.15.114:0/1692163240 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6028006f10 0x7f6028007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.710+0000 7f603e59c640 1 -- 172.21.15.114:0/1692163240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6028005730 con 0x7f6028006100 2023-11-04T01:39:11.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.710+0000 7f603e59c640 1 --2- 172.21.15.114:0/1692163240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6028006100 0x7f60280069d0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f603400c290 tx=0x7f6028007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c447d9bb81aaff server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:11.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.710+0000 7f603dd9b640 1 -- 172.21.15.114:0/1692163240 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034005ad0 con 0x7f6028006100 2023-11-04T01:39:11.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.710+0000 7f603dd9b640 1 -- 172.21.15.114:0/1692163240 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6034005c30 con 0x7f6028006100 2023-11-04T01:39:11.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.710+0000 7f603dd9b640 1 -- 172.21.15.114:0/1692163240 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603402c890 con 0x7f6028006100 2023-11-04T01:39:11.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.711+0000 7f60450c9640 1 -- 172.21.15.114:0/1692163240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6028006100 msgr2=0x7f60280069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.711+0000 7f60450c9640 1 --2- 172.21.15.114:0/1692163240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6028006100 0x7f60280069d0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f603400c290 tx=0x7f6028007a00 comp rx=0 tx=0).stop 2023-11-04T01:39:11.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.711+0000 7f603f59e640 1 -- 172.21.15.114:0/1692163240 reap_dead start 2023-11-04T01:39:11.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.711+0000 7f60450c9640 1 -- 172.21.15.114:0/1692163240 shutdown_connections 2023-11-04T01:39:11.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.711+0000 7f60450c9640 1 -- 172.21.15.114:0/1692163240 >> 172.21.15.114:0/1692163240 conn(0x7f60400b05d0 msgr2=0x7f60400b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:11.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.711+0000 7f60450c9640 1 -- 172.21.15.114:0/1692163240 shutdown_connections 2023-11-04T01:39:11.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.711+0000 7f60450c9640 1 -- 172.21.15.114:0/1692163240 wait complete. 2023-11-04T01:39:11.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.712+0000 7f60450c9640 1 Processor -- start 2023-11-04T01:39:11.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.713+0000 7f60450c9640 1 -- start start 2023-11-04T01:39:11.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.713+0000 7f60450c9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6028006100 0x7f6040149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.713+0000 7f60450c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6040158d40 0x7f60400c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.713+0000 7f60450c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60401591c0 0x7f60400c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.713+0000 7f60450c9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60400c8910 con 0x7f6040158d40 2023-11-04T01:39:11.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.713+0000 7f60450c9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60400ad220 con 0x7f6028006100 2023-11-04T01:39:11.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.713+0000 7f60450c9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60400ac6a0 con 0x7f60401591c0 2023-11-04T01:39:11.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.713+0000 7f603e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6040158d40 0x7f60400c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.713+0000 7f603e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6040158d40 0x7f60400c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45774/0 (socket says 172.21.15.114:45774) 2023-11-04T01:39:11.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.713+0000 7f603e59c640 1 -- 172.21.15.114:0/1359699481 learned_addr learned my addr 172.21.15.114:0/1359699481 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:11.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.714+0000 7f603ed9d640 1 --2- 172.21.15.114:0/1359699481 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6028006100 0x7f6040149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.714+0000 7f603f59e640 1 --2- 172.21.15.114:0/1359699481 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60401591c0 0x7f60400c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.714+0000 7f603e59c640 1 -- 172.21.15.114:0/1359699481 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60401591c0 msgr2=0x7f60400c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.714+0000 7f603e59c640 1 --2- 172.21.15.114:0/1359699481 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60401591c0 0x7f60400c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.714+0000 7f603e59c640 1 -- 172.21.15.114:0/1359699481 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6028006100 msgr2=0x7f6040149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:11.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.714+0000 7f603e59c640 1 --2- 172.21.15.114:0/1359699481 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6028006100 0x7f6040149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:11.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.714+0000 7f603e59c640 1 -- 172.21.15.114:0/1359699481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60400ac980 con 0x7f6040158d40 2023-11-04T01:39:11.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.714+0000 7f603e59c640 1 --2- 172.21.15.114:0/1359699481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6040158d40 0x7f60400c6280 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f6034000f60 tx=0x7f6034000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:11.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.714+0000 7f60277fe640 1 -- 172.21.15.114:0/1359699481 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034039070 con 0x7f6040158d40 2023-11-04T01:39:11.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.714+0000 7f60277fe640 1 -- 172.21.15.114:0/1359699481 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603402dd50 con 0x7f6040158d40 2023-11-04T01:39:11.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.714+0000 7f60450c9640 1 -- 172.21.15.114:0/1359699481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60400acc60 con 0x7f6040158d40 2023-11-04T01:39:11.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.714+0000 7f60277fe640 1 -- 172.21.15.114:0/1359699481 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60340072b0 con 0x7f6040158d40 2023-11-04T01:39:11.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.714+0000 7f60450c9640 1 -- 172.21.15.114:0/1359699481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6040149960 con 0x7f6040158d40 2023-11-04T01:39:11.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.715+0000 7f60450c9640 1 -- 172.21.15.114:0/1359699481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604004e490 con 0x7f6040158d40 2023-11-04T01:39:11.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.715+0000 7f60277fe640 1 -- 172.21.15.114:0/1359699481 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6034032070 con 0x7f6040158d40 2023-11-04T01:39:11.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.716+0000 7f60277fe640 1 --2- 172.21.15.114:0/1359699481 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f602c06ae70 0x7f602c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:11.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.716+0000 7f60277fe640 1 -- 172.21.15.114:0/1359699481 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6798+0+0 (secure 0 0 0) 0x7f603403c040 con 0x7f6040158d40 2023-11-04T01:39:11.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.716+0000 7f603ed9d640 1 --2- 172.21.15.114:0/1359699481 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f602c06ae70 0x7f602c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:11.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.716+0000 7f603ed9d640 1 --2- 172.21.15.114:0/1359699481 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f602c06ae70 0x7f602c06d330 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f60401553e0 tx=0x7f6030008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:11.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.720+0000 7f60277fe640 1 -- 172.21.15.114:0/1359699481 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60340b0020 con 0x7f6040158d40 2023-11-04T01:39:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:11.891+0000 7f60450c9640 1 -- 172.21.15.114:0/1359699481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f60400c4d40 con 0x7f6040158d40 2023-11-04T01:39:12.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.588+0000 7f60277fe640 1 -- 172.21.15.114:0/1359699481 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v74) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6034075b10 con 0x7f6040158d40 2023-11-04T01:39:12.592 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2023-11-04T01:39:12.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.591+0000 7f60450c9640 1 -- 172.21.15.114:0/1359699481 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f602c06ae70 msgr2=0x7f602c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.591+0000 7f60450c9640 1 --2- 172.21.15.114:0/1359699481 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f602c06ae70 0x7f602c06d330 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f60401553e0 tx=0x7f6030008040 comp rx=0 tx=0).stop 2023-11-04T01:39:12.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.591+0000 7f60450c9640 1 -- 172.21.15.114:0/1359699481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6040158d40 msgr2=0x7f60400c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.591+0000 7f60450c9640 1 --2- 172.21.15.114:0/1359699481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6040158d40 0x7f60400c6280 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f6034000f60 tx=0x7f6034000fe0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.591+0000 7f60450c9640 1 -- 172.21.15.114:0/1359699481 shutdown_connections 2023-11-04T01:39:12.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.591+0000 7f60450c9640 1 --2- 172.21.15.114:0/1359699481 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60401591c0 0x7f60400c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.591+0000 7f60450c9640 1 --2- 172.21.15.114:0/1359699481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6040158d40 0x7f60400c6280 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.591+0000 7f60450c9640 1 --2- 172.21.15.114:0/1359699481 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f602c06ae70 0x7f602c06d330 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.591+0000 7f60450c9640 1 --2- 172.21.15.114:0/1359699481 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6028006100 0x7f6040149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.591+0000 7f60450c9640 1 -- 172.21.15.114:0/1359699481 >> 172.21.15.114:0/1359699481 conn(0x7f60400b05d0 msgr2=0x7f60400c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:12.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.591+0000 7f60450c9640 1 -- 172.21.15.114:0/1359699481 shutdown_connections 2023-11-04T01:39:12.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.591+0000 7f60450c9640 1 -- 172.21.15.114:0/1359699481 wait complete. 2023-11-04T01:39:12.608 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:39:12.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.719+0000 7ff2bc3a9640 1 Processor -- start 2023-11-04T01:39:12.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.719+0000 7ff2bc3a9640 1 -- start start 2023-11-04T01:39:12.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2bc3a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2b40cd6d0 0x7ff2b4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2bc3a9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff2b40b4880 0x7ff2b40b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2bc3a9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b40cde60 con 0x7ff2b4153e60 2023-11-04T01:39:12.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2bc3a9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b4160f90 con 0x7ff2b40b4880 2023-11-04T01:39:12.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2bc3a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40b51e0 con 0x7ff2b40cd6d0 2023-11-04T01:39:12.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2ba145640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff2b4153e60 0x7ff2b415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51176/0 (socket says 172.21.15.114:51176) 2023-11-04T01:39:12.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2ba145640 1 -- 172.21.15.114:0/502232140 learned_addr learned my addr 172.21.15.114:0/502232140 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:12.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2ba946640 1 --2- 172.21.15.114:0/502232140 >> v2:172.21.15.141:3300/0 conn(0x7ff2b40b4880 0x7ff2b40b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9944640 1 --2- 172.21.15.114:0/502232140 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2b40cd6d0 0x7ff2b4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9143640 1 -- 172.21.15.114:0/502232140 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948227400 0 0) 0x7ff2b40cde60 con 0x7ff2b4153e60 2023-11-04T01:39:12.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9143640 1 -- 172.21.15.114:0/502232140 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2a0003520 con 0x7ff2b4153e60 2023-11-04T01:39:12.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9143640 1 -- 172.21.15.114:0/502232140 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1900971077 0 0) 0x7ff2a0003520 con 0x7ff2b4153e60 2023-11-04T01:39:12.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9143640 1 -- 172.21.15.114:0/502232140 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2b40cd6d0 msgr2=0x7ff2b4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:12.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9143640 1 --2- 172.21.15.114:0/502232140 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2b40cd6d0 0x7ff2b4161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9143640 1 -- 172.21.15.114:0/502232140 >> v2:172.21.15.141:3300/0 conn(0x7ff2b40b4880 msgr2=0x7ff2b40b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:12.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9143640 1 --2- 172.21.15.114:0/502232140 >> v2:172.21.15.141:3300/0 conn(0x7ff2b40b4880 0x7ff2b40b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9143640 1 -- 172.21.15.114:0/502232140 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b4161960 con 0x7ff2b4153e60 2023-11-04T01:39:12.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9143640 1 -- 172.21.15.114:0/502232140 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7ff2b0001670 con 0x7ff2b4153e60 2023-11-04T01:39:12.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9143640 1 -- 172.21.15.114:0/502232140 >> v1:172.21.15.114:6789/0 conn(0x7ff2b4153e60 legacy=0x7ff2b415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9143640 1 --2- 172.21.15.114:0/502232140 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2a0003970 0x7ff2a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9143640 1 --2- 172.21.15.114:0/502232140 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2b40cd6d0 0x7ff2a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9143640 1 --2- 172.21.15.114:0/502232140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0004d00 0x7ff2a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9143640 1 -- 172.21.15.114:0/502232140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b4160f90 con 0x7ff2a0004d00 2023-11-04T01:39:12.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9143640 1 -- 172.21.15.114:0/502232140 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40b51e0 con 0x7ff2a0003970 2023-11-04T01:39:12.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2b9143640 1 -- 172.21.15.114:0/502232140 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a000b980 con 0x7ff2b40cd6d0 2023-11-04T01:39:12.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.720+0000 7ff2ba946640 1 --2- 172.21.15.114:0/502232140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0004d00 0x7ff2a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.721+0000 7ff2ba145640 1 --2- 172.21.15.114:0/502232140 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2a0003970 0x7ff2a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.721+0000 7ff2b9944640 1 --2- 172.21.15.114:0/502232140 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2b40cd6d0 0x7ff2a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.721+0000 7ff2ba946640 1 -- 172.21.15.114:0/502232140 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2b40cd6d0 msgr2=0x7ff2a00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:12.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.721+0000 7ff2ba946640 1 --2- 172.21.15.114:0/502232140 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2b40cd6d0 0x7ff2a00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.721+0000 7ff2ba946640 1 -- 172.21.15.114:0/502232140 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2a0003970 msgr2=0x7ff2a0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:12.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.721+0000 7ff2ba946640 1 --2- 172.21.15.114:0/502232140 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2a0003970 0x7ff2a0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.721+0000 7ff2ba946640 1 -- 172.21.15.114:0/502232140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a0003520 con 0x7ff2a0004d00 2023-11-04T01:39:12.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.721+0000 7ff2ba946640 1 --2- 172.21.15.114:0/502232140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0004d00 0x7ff2a0005180 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00e170 tx=0x7ff2a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132d2280a3b40ff7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:12.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.722+0000 7ff2b9143640 1 -- 172.21.15.114:0/502232140 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac02cc20 con 0x7ff2a0004d00 2023-11-04T01:39:12.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.722+0000 7ff2b9143640 1 -- 172.21.15.114:0/502232140 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac00f040 con 0x7ff2a0004d00 2023-11-04T01:39:12.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.722+0000 7ff2b9143640 1 -- 172.21.15.114:0/502232140 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac034440 con 0x7ff2a0004d00 2023-11-04T01:39:12.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.722+0000 7ff2bc3a9640 1 -- 172.21.15.114:0/502232140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0004d00 msgr2=0x7ff2a0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.722+0000 7ff2bc3a9640 1 --2- 172.21.15.114:0/502232140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0004d00 0x7ff2a0005180 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00e170 tx=0x7ff2a00057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.722+0000 7ff2ba946640 1 -- 172.21.15.114:0/502232140 reap_dead start 2023-11-04T01:39:12.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.722+0000 7ff2bc3a9640 1 -- 172.21.15.114:0/502232140 shutdown_connections 2023-11-04T01:39:12.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.722+0000 7ff2bc3a9640 1 -- 172.21.15.114:0/502232140 >> 172.21.15.114:0/502232140 conn(0x7ff2b40cf880 msgr2=0x7ff2b40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:12.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.722+0000 7ff2bc3a9640 1 -- 172.21.15.114:0/502232140 shutdown_connections 2023-11-04T01:39:12.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.722+0000 7ff2bc3a9640 1 -- 172.21.15.114:0/502232140 wait complete. 2023-11-04T01:39:12.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.723+0000 7ff2bc3a9640 1 Processor -- start 2023-11-04T01:39:12.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.723+0000 7ff2bc3a9640 1 -- start start 2023-11-04T01:39:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.724+0000 7ff2bc3a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0004d00 0x7ff2b41f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.724+0000 7ff2bc3a9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2b40c9ed0 0x7ff2b41501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.724+0000 7ff2bc3a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2b40cb100 0x7ff2b40cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.724+0000 7ff2bc3a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40cbaf0 con 0x7ff2a0004d00 2023-11-04T01:39:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.724+0000 7ff2bc3a9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b41f3440 con 0x7ff2b40c9ed0 2023-11-04T01:39:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.724+0000 7ff2bc3a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40ca450 con 0x7ff2b40cb100 2023-11-04T01:39:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.724+0000 7ff2ba145640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0004d00 0x7ff2b41f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.724+0000 7ff2ba145640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0004d00 0x7ff2b41f2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45792/0 (socket says 172.21.15.114:45792) 2023-11-04T01:39:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.724+0000 7ff2ba145640 1 -- 172.21.15.114:0/2589426581 learned_addr learned my addr 172.21.15.114:0/2589426581 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.724+0000 7ff2b9944640 1 --2- 172.21.15.114:0/2589426581 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2b40c9ed0 0x7ff2b41501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.724+0000 7ff2ba946640 1 --2- 172.21.15.114:0/2589426581 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2b40cb100 0x7ff2b40cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.724+0000 7ff2ba145640 1 -- 172.21.15.114:0/2589426581 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2b40cb100 msgr2=0x7ff2b40cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.724+0000 7ff2ba145640 1 --2- 172.21.15.114:0/2589426581 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2b40cb100 0x7ff2b40cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.724+0000 7ff2ba145640 1 -- 172.21.15.114:0/2589426581 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2b40c9ed0 msgr2=0x7ff2b41501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.724+0000 7ff2ba145640 1 --2- 172.21.15.114:0/2589426581 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2b40c9ed0 0x7ff2b41501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.724+0000 7ff2ba145640 1 -- 172.21.15.114:0/2589426581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b40ca730 con 0x7ff2a0004d00 2023-11-04T01:39:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.725+0000 7ff2ba145640 1 --2- 172.21.15.114:0/2589426581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0004d00 0x7ff2b41f2f00 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0007310 tx=0x7ff2b00077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.725+0000 7ff2aaffd640 1 -- 172.21.15.114:0/2589426581 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b000fa00 con 0x7ff2a0004d00 2023-11-04T01:39:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.725+0000 7ff2aaffd640 1 -- 172.21.15.114:0/2589426581 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b000fb80 con 0x7ff2a0004d00 2023-11-04T01:39:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.725+0000 7ff2bc3a9640 1 -- 172.21.15.114:0/2589426581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b40caa10 con 0x7ff2a0004d00 2023-11-04T01:39:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.725+0000 7ff2aaffd640 1 -- 172.21.15.114:0/2589426581 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00133f0 con 0x7ff2a0004d00 2023-11-04T01:39:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.725+0000 7ff2bc3a9640 1 -- 172.21.15.114:0/2589426581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b4150720 con 0x7ff2a0004d00 2023-11-04T01:39:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.726+0000 7ff2bc3a9640 1 -- 172.21.15.114:0/2589426581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b41508e0 con 0x7ff2a0004d00 2023-11-04T01:39:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.726+0000 7ff2aaffd640 1 -- 172.21.15.114:0/2589426581 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff2b0013550 con 0x7ff2a0004d00 2023-11-04T01:39:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.726+0000 7ff2aaffd640 1 --2- 172.21.15.114:0/2589426581 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff29806aea0 0x7ff29806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.727+0000 7ff2aaffd640 1 -- 172.21.15.114:0/2589426581 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7ff2b0089ad0 con 0x7ff2a0004d00 2023-11-04T01:39:12.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.727+0000 7ff2b9944640 1 --2- 172.21.15.114:0/2589426581 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff29806aea0 0x7ff29806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:12.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.727+0000 7ff2b9944640 1 --2- 172.21.15.114:0/2589426581 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff29806aea0 0x7ff29806d360 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40cd060 tx=0x7ff2a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:12.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.731+0000 7ff2aaffd640 1 -- 172.21.15.114:0/2589426581 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff2b0054880 con 0x7ff2a0004d00 2023-11-04T01:39:12.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.899+0000 7ff2bc3a9640 1 -- 172.21.15.114:0/2589426581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff2b40caf30 con 0x7ff2a0004d00 2023-11-04T01:39:12.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.902+0000 7ff2aaffd640 1 -- 172.21.15.114:0/2589426581 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff2b40caf30 con 0x7ff2a0004d00 2023-11-04T01:39:12.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.904+0000 7ff2bc3a9640 1 -- 172.21.15.114:0/2589426581 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff29806aea0 msgr2=0x7ff29806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.904+0000 7ff2bc3a9640 1 --2- 172.21.15.114:0/2589426581 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff29806aea0 0x7ff29806d360 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40cd060 tx=0x7ff2a4008040 comp rx=0 tx=0).stop 2023-11-04T01:39:12.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.904+0000 7ff2bc3a9640 1 -- 172.21.15.114:0/2589426581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0004d00 msgr2=0x7ff2b41f2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:12.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.904+0000 7ff2bc3a9640 1 --2- 172.21.15.114:0/2589426581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0004d00 0x7ff2b41f2f00 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0007310 tx=0x7ff2b00077d0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.904+0000 7ff2bc3a9640 1 -- 172.21.15.114:0/2589426581 shutdown_connections 2023-11-04T01:39:12.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.904+0000 7ff2bc3a9640 1 --2- 172.21.15.114:0/2589426581 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff2b40cb100 0x7ff2b40cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.904+0000 7ff2bc3a9640 1 --2- 172.21.15.114:0/2589426581 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff29806aea0 0x7ff29806d360 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.904+0000 7ff2bc3a9640 1 --2- 172.21.15.114:0/2589426581 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff2b40c9ed0 0x7ff2b41501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.904+0000 7ff2bc3a9640 1 --2- 172.21.15.114:0/2589426581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0004d00 0x7ff2b41f2f00 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:12.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.904+0000 7ff2bc3a9640 1 -- 172.21.15.114:0/2589426581 >> 172.21.15.114:0/2589426581 conn(0x7ff2b40cf880 msgr2=0x7ff2b40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:12.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.904+0000 7ff2bc3a9640 1 -- 172.21.15.114:0/2589426581 shutdown_connections 2023-11-04T01:39:12.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:12.904+0000 7ff2bc3a9640 1 -- 172.21.15.114:0/2589426581 wait complete. 2023-11-04T01:39:12.916 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation' 2023-11-04T01:39:13.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.013+0000 7f90c4afc640 1 Processor -- start 2023-11-04T01:39:13.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.013+0000 7f90c4afc640 1 -- start start 2023-11-04T01:39:13.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.014+0000 7f90c4afc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f90c015ce40 0x7f90c0161460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.014+0000 7f90c4afc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c006b910 con 0x7f90c00b2d10 2023-11-04T01:39:13.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.014+0000 7f90c4afc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c01619a0 con 0x7f90c006cc50 2023-11-04T01:39:13.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.014+0000 7f90c4afc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c006bbb0 con 0x7f90c015ce40 2023-11-04T01:39:13.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.014+0000 7f90bed9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f90c00b2d10 0x7f90c00cb560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51178/0 (socket says 172.21.15.114:51178) 2023-11-04T01:39:13.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.014+0000 7f90bed9d640 1 -- 172.21.15.114:0/3726176778 learned_addr learned my addr 172.21.15.114:0/3726176778 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:13.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90be59c640 1 --2- 172.21.15.114:0/3726176778 >> v2:172.21.15.141:3300/0 conn(0x7f90c015ce40 0x7f90c0161460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bd59a640 1 -- 172.21.15.114:0/3726176778 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192423492 0 0) 0x7f90c006b910 con 0x7f90c00b2d10 2023-11-04T01:39:13.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bd59a640 1 -- 172.21.15.114:0/3726176778 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90a8003520 con 0x7f90c00b2d10 2023-11-04T01:39:13.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bd59a640 1 -- 172.21.15.114:0/3726176778 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3951200041 0 0) 0x7f90a8003520 con 0x7f90c00b2d10 2023-11-04T01:39:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bd59a640 1 -- 172.21.15.114:0/3726176778 >> v2:172.21.15.141:3300/0 conn(0x7f90c015ce40 msgr2=0x7f90c0161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bd59a640 1 --2- 172.21.15.114:0/3726176778 >> v2:172.21.15.141:3300/0 conn(0x7f90c015ce40 0x7f90c0161460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bd59a640 1 -- 172.21.15.114:0/3726176778 >> v1:172.21.15.141:6789/0 conn(0x7f90c006cc50 legacy=0x7f90c00b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bd59a640 1 -- 172.21.15.114:0/3726176778 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c006be90 con 0x7f90c00b2d10 2023-11-04T01:39:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bd59a640 1 -- 172.21.15.114:0/3726176778 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f90b8001670 con 0x7f90c00b2d10 2023-11-04T01:39:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bd59a640 1 -- 172.21.15.114:0/3726176778 >> v1:172.21.15.114:6789/0 conn(0x7f90c00b2d10 legacy=0x7f90c00cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bd59a640 1 --2- 172.21.15.114:0/3726176778 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90a8003970 0x7f90a8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bd59a640 1 --2- 172.21.15.114:0/3726176778 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90a8004370 0x7f90a8004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bd59a640 1 --2- 172.21.15.114:0/3726176778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90a80050e0 0x7f90a800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bd59a640 1 -- 172.21.15.114:0/3726176778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c006bbb0 con 0x7f90a80050e0 2023-11-04T01:39:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bd59a640 1 -- 172.21.15.114:0/3726176778 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a800c020 con 0x7f90a8003970 2023-11-04T01:39:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bd59a640 1 -- 172.21.15.114:0/3726176778 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a800c1e0 con 0x7f90a8004370 2023-11-04T01:39:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bed9d640 1 --2- 172.21.15.114:0/3726176778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90a80050e0 0x7f90a800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90be59c640 1 --2- 172.21.15.114:0/3726176778 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90a8003970 0x7f90a8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bdd9b640 1 --2- 172.21.15.114:0/3726176778 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90a8004370 0x7f90a8004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bed9d640 1 -- 172.21.15.114:0/3726176778 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90a8004370 msgr2=0x7f90a8004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bed9d640 1 --2- 172.21.15.114:0/3726176778 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90a8004370 0x7f90a8004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bed9d640 1 -- 172.21.15.114:0/3726176778 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90a8003970 msgr2=0x7f90a8003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bed9d640 1 --2- 172.21.15.114:0/3726176778 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90a8003970 0x7f90a8003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.015+0000 7f90bed9d640 1 -- 172.21.15.114:0/3726176778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a8003520 con 0x7f90a80050e0 2023-11-04T01:39:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.016+0000 7f90bed9d640 1 -- 172.21.15.114:0/3726176778 reap_dead start 2023-11-04T01:39:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.016+0000 7f90bed9d640 1 --2- 172.21.15.114:0/3726176778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90a80050e0 0x7f90a800b980 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f90b800c190 tx=0x7f90a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8969c1bcdaab34 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.016+0000 7f90bd59a640 1 -- 172.21.15.114:0/3726176778 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8005ad0 con 0x7f90a80050e0 2023-11-04T01:39:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.016+0000 7f90bd59a640 1 -- 172.21.15.114:0/3726176778 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b8005c50 con 0x7f90a80050e0 2023-11-04T01:39:13.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.016+0000 7f90bd59a640 1 -- 172.21.15.114:0/3726176778 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b802c850 con 0x7f90a80050e0 2023-11-04T01:39:13.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.017+0000 7f90c4afc640 1 -- 172.21.15.114:0/3726176778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90a80050e0 msgr2=0x7f90a800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.017+0000 7f90c4afc640 1 --2- 172.21.15.114:0/3726176778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90a80050e0 0x7f90a800b980 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f90b800c190 tx=0x7f90a80057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.017+0000 7f90c4afc640 1 -- 172.21.15.114:0/3726176778 shutdown_connections 2023-11-04T01:39:13.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.017+0000 7f90c4afc640 1 --2- 172.21.15.114:0/3726176778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90a80050e0 0x7f90a800b980 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.017+0000 7f90c4afc640 1 -- 172.21.15.114:0/3726176778 >> 172.21.15.114:0/3726176778 conn(0x7f90c00cd600 msgr2=0x7f90c00cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.017+0000 7f90c4afc640 1 -- 172.21.15.114:0/3726176778 shutdown_connections 2023-11-04T01:39:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.017+0000 7f90c4afc640 1 -- 172.21.15.114:0/3726176778 wait complete. 2023-11-04T01:39:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.018+0000 7f90c4afc640 1 Processor -- start 2023-11-04T01:39:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.018+0000 7f90c4afc640 1 -- start start 2023-11-04T01:39:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.019+0000 7f90c4afc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90a80050e0 0x7f90c00aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.019+0000 7f90c4afc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90c01f64c0 0x7f90c00ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.019+0000 7f90c4afc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90c015f520 0x7f90c01f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.019+0000 7f90c4afc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c015e270 con 0x7f90c01f64c0 2023-11-04T01:39:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.019+0000 7f90c4afc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c014ad00 con 0x7f90c015f520 2023-11-04T01:39:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.019+0000 7f90c4afc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c015e480 con 0x7f90a80050e0 2023-11-04T01:39:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.019+0000 7f90bdd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90c01f64c0 0x7f90c00ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.019+0000 7f90bdd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90c01f64c0 0x7f90c00ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45816/0 (socket says 172.21.15.114:45816) 2023-11-04T01:39:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.019+0000 7f90bdd9b640 1 -- 172.21.15.114:0/3879763465 learned_addr learned my addr 172.21.15.114:0/3879763465 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:13.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.019+0000 7f90bdd9b640 1 -- 172.21.15.114:0/3879763465 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90a80050e0 msgr2=0x7f90c00aba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.019+0000 7f90bdd9b640 1 --2- 172.21.15.114:0/3879763465 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90a80050e0 0x7f90c00aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.019+0000 7f90bdd9b640 1 -- 172.21.15.114:0/3879763465 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90c015f520 msgr2=0x7f90c01f58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.019+0000 7f90bdd9b640 1 --2- 172.21.15.114:0/3879763465 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90c015f520 0x7f90c01f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.019+0000 7f90bdd9b640 1 -- 172.21.15.114:0/3879763465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c015e760 con 0x7f90c01f64c0 2023-11-04T01:39:13.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.019+0000 7f90bdd9b640 1 --2- 172.21.15.114:0/3879763465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90c01f64c0 0x7f90c00ca640 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f90b400f7c0 tx=0x7f90b400fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.019+0000 7f90aeffd640 1 -- 172.21.15.114:0/3879763465 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b400fe70 con 0x7f90c01f64c0 2023-11-04T01:39:13.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.020+0000 7f90aeffd640 1 -- 172.21.15.114:0/3879763465 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b40052e0 con 0x7f90c01f64c0 2023-11-04T01:39:13.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.020+0000 7f90aeffd640 1 -- 172.21.15.114:0/3879763465 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b400d970 con 0x7f90c01f64c0 2023-11-04T01:39:13.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.020+0000 7f90c4afc640 1 -- 172.21.15.114:0/3879763465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c015ea40 con 0x7f90c01f64c0 2023-11-04T01:39:13.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.020+0000 7f90c4afc640 1 -- 172.21.15.114:0/3879763465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c015f000 con 0x7f90c01f64c0 2023-11-04T01:39:13.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.021+0000 7f90c4afc640 1 -- 172.21.15.114:0/3879763465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c00b6b00 con 0x7f90c01f64c0 2023-11-04T01:39:13.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.021+0000 7f90aeffd640 1 -- 172.21.15.114:0/3879763465 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f90b400dad0 con 0x7f90c01f64c0 2023-11-04T01:39:13.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.021+0000 7f90aeffd640 1 --2- 172.21.15.114:0/3879763465 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f90a006ae70 0x7f90a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.021+0000 7f90aeffd640 1 -- 172.21.15.114:0/3879763465 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f90b40897f0 con 0x7f90c01f64c0 2023-11-04T01:39:13.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.021+0000 7f90be59c640 1 --2- 172.21.15.114:0/3879763465 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f90a006ae70 0x7f90a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.022+0000 7f90be59c640 1 --2- 172.21.15.114:0/3879763465 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f90a006ae70 0x7f90a006d330 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009f90 tx=0x7f90b0009750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.026+0000 7f90aeffd640 1 -- 172.21.15.114:0/3879763465 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f90b40546c0 con 0x7f90c01f64c0 2023-11-04T01:39:13.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.255+0000 7f90c4afc640 1 -- 172.21.15.114:0/3879763465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]} v 0) v1 -- 0x7f90c015f1c0 con 0x7f90c01f64c0 2023-11-04T01:39:13.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.591+0000 7f90aeffd640 1 -- 172.21.15.114:0/3879763465 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]}]=0 v174) v1 ==== 173+0+0 (secure 0 0 0) 0x7f90b4057ce0 con 0x7f90c01f64c0 2023-11-04T01:39:13.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.593+0000 7f90c4afc640 1 -- 172.21.15.114:0/3879763465 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f90a006ae70 msgr2=0x7f90a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.593+0000 7f90c4afc640 1 --2- 172.21.15.114:0/3879763465 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f90a006ae70 0x7f90a006d330 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009f90 tx=0x7f90b0009750 comp rx=0 tx=0).stop 2023-11-04T01:39:13.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.593+0000 7f90c4afc640 1 -- 172.21.15.114:0/3879763465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90c01f64c0 msgr2=0x7f90c00ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.593+0000 7f90c4afc640 1 --2- 172.21.15.114:0/3879763465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90c01f64c0 0x7f90c00ca640 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f90b400f7c0 tx=0x7f90b400fc80 comp rx=0 tx=0).stop 2023-11-04T01:39:13.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.593+0000 7f90c4afc640 1 -- 172.21.15.114:0/3879763465 shutdown_connections 2023-11-04T01:39:13.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.593+0000 7f90c4afc640 1 --2- 172.21.15.114:0/3879763465 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f90a006ae70 0x7f90a006d330 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.593+0000 7f90c4afc640 1 --2- 172.21.15.114:0/3879763465 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f90c015f520 0x7f90c01f58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.593+0000 7f90c4afc640 1 --2- 172.21.15.114:0/3879763465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90c01f64c0 0x7f90c00ca640 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.593+0000 7f90c4afc640 1 --2- 172.21.15.114:0/3879763465 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f90a80050e0 0x7f90c00aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.593+0000 7f90c4afc640 1 -- 172.21.15.114:0/3879763465 >> 172.21.15.114:0/3879763465 conn(0x7f90c00cd600 msgr2=0x7f90c00cb560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.593+0000 7f90c4afc640 1 -- 172.21.15.114:0/3879763465 shutdown_connections 2023-11-04T01:39:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.593+0000 7f90c4afc640 1 -- 172.21.15.114:0/3879763465 wait complete. 2023-11-04T01:39:13.606 INFO:tasks.cephfs_test_runner:Test that using a pool with snaps for fs creation fails ... ok 2023-11-04T01:39:13.606 INFO:tasks.cephfs_test_runner:Starting test: test_allow_new_snaps_config (tasks.cephfs.test_snapshots.TestSnapshots) Check whether 'allow_new_snaps' setting works 2023-11-04T01:39:13.606 INFO:tasks.cephfs_test_runner:test_allow_new_snaps_config (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:39:13.607 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:13.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.705+0000 7f585295e640 1 Processor -- start 2023-11-04T01:39:13.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.705+0000 7f585295e640 1 -- start start 2023-11-04T01:39:13.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f585295e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f584c159c70 0x7f584c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f585295e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f584c0b0ae0 0x7f584c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f585295e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c0b4110 con 0x7f584c06db20 2023-11-04T01:39:13.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f585295e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584c0b49b0 con 0x7f584c0b0ae0 2023-11-04T01:39:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f585295e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c0b43f0 con 0x7f584c159c70 2023-11-04T01:39:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584b7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f584c06db20 0x7f584c0b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51184/0 (socket says 172.21.15.114:51184) 2023-11-04T01:39:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584b7fe640 1 -- 172.21.15.114:0/800034354 learned_addr learned my addr 172.21.15.114:0/800034354 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584bfff640 1 --2- 172.21.15.114:0/800034354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f584c159c70 0x7f584c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584affd640 1 -- 172.21.15.114:0/800034354 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330421375 0 0) 0x7f584c0b4110 con 0x7f584c06db20 2023-11-04T01:39:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f5850efb640 1 --2- 172.21.15.114:0/800034354 >> v2:172.21.15.141:3300/0 conn(0x7f584c0b0ae0 0x7f584c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584affd640 1 -- 172.21.15.114:0/800034354 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5834003520 con 0x7f584c06db20 2023-11-04T01:39:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584affd640 1 -- 172.21.15.114:0/800034354 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 172571553 0 0) 0x7f5834003520 con 0x7f584c06db20 2023-11-04T01:39:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584affd640 1 -- 172.21.15.114:0/800034354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f584c159c70 msgr2=0x7f584c0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584affd640 1 --2- 172.21.15.114:0/800034354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f584c159c70 0x7f584c0ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584affd640 1 -- 172.21.15.114:0/800034354 >> v2:172.21.15.141:3300/0 conn(0x7f584c0b0ae0 msgr2=0x7f584c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584affd640 1 --2- 172.21.15.114:0/800034354 >> v2:172.21.15.141:3300/0 conn(0x7f584c0b0ae0 0x7f584c15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584affd640 1 -- 172.21.15.114:0/800034354 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c0b46d0 con 0x7f584c06db20 2023-11-04T01:39:13.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584affd640 1 -- 172.21.15.114:0/800034354 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f583c001670 con 0x7f584c06db20 2023-11-04T01:39:13.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584affd640 1 -- 172.21.15.114:0/800034354 >> v1:172.21.15.114:6789/0 conn(0x7f584c06db20 legacy=0x7f584c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584affd640 1 --2- 172.21.15.114:0/800034354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5834003970 0x7f5834003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584affd640 1 --2- 172.21.15.114:0/800034354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58340047c0 0x7f5834004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584affd640 1 --2- 172.21.15.114:0/800034354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f584c159c70 0x7f5834005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584affd640 1 -- 172.21.15.114:0/800034354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c0b49b0 con 0x7f58340047c0 2023-11-04T01:39:13.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584affd640 1 -- 172.21.15.114:0/800034354 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c0b43f0 con 0x7f5834003970 2023-11-04T01:39:13.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584affd640 1 -- 172.21.15.114:0/800034354 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583400b980 con 0x7f584c159c70 2023-11-04T01:39:13.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.706+0000 7f584b7fe640 1 --2- 172.21.15.114:0/800034354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58340047c0 0x7f5834004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.707+0000 7f584bfff640 1 --2- 172.21.15.114:0/800034354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5834003970 0x7f5834003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.707+0000 7f5850efb640 1 --2- 172.21.15.114:0/800034354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f584c159c70 0x7f5834005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.707+0000 7f584b7fe640 1 -- 172.21.15.114:0/800034354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f584c159c70 msgr2=0x7f5834005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.707+0000 7f584b7fe640 1 --2- 172.21.15.114:0/800034354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f584c159c70 0x7f5834005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.707+0000 7f584b7fe640 1 -- 172.21.15.114:0/800034354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5834003970 msgr2=0x7f5834003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.707+0000 7f584b7fe640 1 --2- 172.21.15.114:0/800034354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5834003970 0x7f5834003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.707+0000 7f584b7fe640 1 -- 172.21.15.114:0/800034354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5834003520 con 0x7f58340047c0 2023-11-04T01:39:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.707+0000 7f5850efb640 1 --2- 172.21.15.114:0/800034354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f584c159c70 0x7f5834005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.707+0000 7f584b7fe640 1 --2- 172.21.15.114:0/800034354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58340047c0 0x7f5834004c40 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f583c007f90 tx=0x7f58340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bf5cb1b3c04ce7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.708+0000 7f584affd640 1 -- 172.21.15.114:0/800034354 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c02ece0 con 0x7f58340047c0 2023-11-04T01:39:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.708+0000 7f584affd640 1 -- 172.21.15.114:0/800034354 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c02ee40 con 0x7f58340047c0 2023-11-04T01:39:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.708+0000 7f584affd640 1 -- 172.21.15.114:0/800034354 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c005af0 con 0x7f58340047c0 2023-11-04T01:39:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.708+0000 7f585295e640 1 -- 172.21.15.114:0/800034354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58340047c0 msgr2=0x7f5834004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.708+0000 7f585295e640 1 --2- 172.21.15.114:0/800034354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58340047c0 0x7f5834004c40 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f583c007f90 tx=0x7f58340057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.708+0000 7f5850efb640 1 -- 172.21.15.114:0/800034354 reap_dead start 2023-11-04T01:39:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.708+0000 7f585295e640 1 -- 172.21.15.114:0/800034354 shutdown_connections 2023-11-04T01:39:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.708+0000 7f585295e640 1 -- 172.21.15.114:0/800034354 >> 172.21.15.114:0/800034354 conn(0x7f584c0ce950 msgr2=0x7f584c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.708+0000 7f585295e640 1 -- 172.21.15.114:0/800034354 shutdown_connections 2023-11-04T01:39:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.708+0000 7f585295e640 1 -- 172.21.15.114:0/800034354 wait complete. 2023-11-04T01:39:13.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.709+0000 7f585295e640 1 Processor -- start 2023-11-04T01:39:13.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.709+0000 7f585295e640 1 -- start start 2023-11-04T01:39:13.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.710+0000 7f585295e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f584c0c7610 0x7f584c15c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.710+0000 7f585295e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f584c152be0 0x7f584c0c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.710+0000 7f585295e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f584c0c63a0 0x7f584c0c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.710+0000 7f585295e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c15a9f0 con 0x7f584c152be0 2023-11-04T01:39:13.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.710+0000 7f585295e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c0c8470 con 0x7f584c0c63a0 2023-11-04T01:39:13.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.710+0000 7f585295e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c151480 con 0x7f584c0c7610 2023-11-04T01:39:13.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.710+0000 7f584b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f584c152be0 0x7f584c0c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.710+0000 7f584b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f584c152be0 0x7f584c0c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45838/0 (socket says 172.21.15.114:45838) 2023-11-04T01:39:13.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.710+0000 7f584b7fe640 1 -- 172.21.15.114:0/1046222761 learned_addr learned my addr 172.21.15.114:0/1046222761 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:13.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.710+0000 7f584b7fe640 1 -- 172.21.15.114:0/1046222761 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f584c0c7610 msgr2=0x7f584c15c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.710+0000 7f584b7fe640 1 --2- 172.21.15.114:0/1046222761 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f584c0c7610 0x7f584c15c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.710+0000 7f584b7fe640 1 -- 172.21.15.114:0/1046222761 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f584c0c63a0 msgr2=0x7f584c0c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.710+0000 7f584b7fe640 1 --2- 172.21.15.114:0/1046222761 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f584c0c63a0 0x7f584c0c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.710+0000 7f584b7fe640 1 -- 172.21.15.114:0/1046222761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c0c7360 con 0x7f584c152be0 2023-11-04T01:39:13.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.711+0000 7f584b7fe640 1 --2- 172.21.15.114:0/1046222761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f584c152be0 0x7f584c0c79f0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f583c00c300 tx=0x7f584c0ce8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.711+0000 7f5848ff9640 1 -- 172.21.15.114:0/1046222761 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c007270 con 0x7f584c152be0 2023-11-04T01:39:13.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.711+0000 7f5848ff9640 1 -- 172.21.15.114:0/1046222761 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c0073d0 con 0x7f584c152be0 2023-11-04T01:39:13.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.711+0000 7f585295e640 1 -- 172.21.15.114:0/1046222761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584c0c6960 con 0x7f584c152be0 2023-11-04T01:39:13.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.711+0000 7f5848ff9640 1 -- 172.21.15.114:0/1046222761 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c007740 con 0x7f584c152be0 2023-11-04T01:39:13.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.711+0000 7f585295e640 1 -- 172.21.15.114:0/1046222761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584c15a610 con 0x7f584c152be0 2023-11-04T01:39:13.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.712+0000 7f585295e640 1 -- 172.21.15.114:0/1046222761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584c0cdb10 con 0x7f584c152be0 2023-11-04T01:39:13.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.712+0000 7f5848ff9640 1 -- 172.21.15.114:0/1046222761 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f583c034070 con 0x7f584c152be0 2023-11-04T01:39:13.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.712+0000 7f5848ff9640 1 --2- 172.21.15.114:0/1046222761 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f583806ae70 0x7f583806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:13.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.713+0000 7f5848ff9640 1 -- 172.21.15.114:0/1046222761 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f583c0aafa0 con 0x7f584c152be0 2023-11-04T01:39:13.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.713+0000 7f584bfff640 1 --2- 172.21.15.114:0/1046222761 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f583806ae70 0x7f583806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:13.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.713+0000 7f584bfff640 1 --2- 172.21.15.114:0/1046222761 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f583806ae70 0x7f583806d330 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5840009960 tx=0x7f5840009d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:13.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.717+0000 7f5848ff9640 1 -- 172.21.15.114:0/1046222761 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f583c0ddca0 con 0x7f584c152be0 2023-11-04T01:39:13.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.884+0000 7f585295e640 1 -- 172.21.15.114:0/1046222761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f584c074290 con 0x7f584c152be0 2023-11-04T01:39:13.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.885+0000 7f5848ff9640 1 -- 172.21.15.114:0/1046222761 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+18494 (secure 0 0 0) 0x7f583c075f30 con 0x7f584c152be0 2023-11-04T01:39:13.887 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:13.888 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":74,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:12.586929+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:6834/1383574171":"2023-11-05T01:39:09.579903+0000","172.21.15.141:6832/1383574171":"2023-11-05T01:39:09.579903+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:13.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.887+0000 7f585295e640 1 -- 172.21.15.114:0/1046222761 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f583806ae70 msgr2=0x7f583806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.887+0000 7f585295e640 1 --2- 172.21.15.114:0/1046222761 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f583806ae70 0x7f583806d330 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5840009960 tx=0x7f5840009d60 comp rx=0 tx=0).stop 2023-11-04T01:39:13.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.887+0000 7f585295e640 1 -- 172.21.15.114:0/1046222761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f584c152be0 msgr2=0x7f584c0c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:13.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.887+0000 7f585295e640 1 --2- 172.21.15.114:0/1046222761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f584c152be0 0x7f584c0c79f0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f583c00c300 tx=0x7f584c0ce8b0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.887+0000 7f585295e640 1 -- 172.21.15.114:0/1046222761 shutdown_connections 2023-11-04T01:39:13.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.887+0000 7f585295e640 1 --2- 172.21.15.114:0/1046222761 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f583806ae70 0x7f583806d330 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.887+0000 7f585295e640 1 --2- 172.21.15.114:0/1046222761 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f584c0c63a0 0x7f584c0c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.887+0000 7f585295e640 1 --2- 172.21.15.114:0/1046222761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f584c152be0 0x7f584c0c79f0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.887+0000 7f585295e640 1 --2- 172.21.15.114:0/1046222761 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f584c0c7610 0x7f584c15c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:13.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.887+0000 7f585295e640 1 -- 172.21.15.114:0/1046222761 >> 172.21.15.114:0/1046222761 conn(0x7f584c0ce950 msgr2=0x7f584c0b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:13.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.888+0000 7f585295e640 1 -- 172.21.15.114:0/1046222761 shutdown_connections 2023-11-04T01:39:13.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:13.888+0000 7f585295e640 1 -- 172.21.15.114:0/1046222761 wait complete. 2023-11-04T01:39:13.900 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:58.316710+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:59.185397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:13.901 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:14.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.003+0000 7f0dbfb0f640 1 Processor -- start 2023-11-04T01:39:14.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.003+0000 7f0dbfb0f640 1 -- start start 2023-11-04T01:39:14.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.004+0000 7f0dbfb0f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0db80c4ff0 0x7f0db80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.004+0000 7f0dbfb0f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0db80adac0 0x7f0db80adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.004+0000 7f0dbfb0f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db815aff0 con 0x7f0db8159c00 2023-11-04T01:39:14.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.004+0000 7f0dbfb0f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db80ae460 con 0x7f0db80adac0 2023-11-04T01:39:14.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.004+0000 7f0dbfb0f640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db815a3e0 con 0x7f0db80c4ff0 2023-11-04T01:39:14.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.005+0000 7f0dbe0ac640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0db80adac0 0x7f0db80adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.005+0000 7f0dbd8ab640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0db8159c00 0x7f0db80c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51192/0 (socket says 172.21.15.114:51192) 2023-11-04T01:39:14.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.005+0000 7f0dbd8ab640 1 -- 172.21.15.114:0/1980082327 learned_addr learned my addr 172.21.15.114:0/1980082327 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:14.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.005+0000 7f0dbd0aa640 1 --2- 172.21.15.114:0/1980082327 >> v2:172.21.15.141:3300/0 conn(0x7f0db80c4ff0 0x7f0db80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.005+0000 7f0dbe0ac640 1 -- 172.21.15.114:0/1980082327 >> v2:172.21.15.141:3300/0 conn(0x7f0db80c4ff0 msgr2=0x7f0db80cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:14.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.005+0000 7f0dbe0ac640 1 --2- 172.21.15.114:0/1980082327 >> v2:172.21.15.141:3300/0 conn(0x7f0db80c4ff0 0x7f0db80cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.005+0000 7f0dbe0ac640 1 -- 172.21.15.114:0/1980082327 >> v1:172.21.15.114:6789/0 conn(0x7f0db8159c00 legacy=0x7f0db80c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.005+0000 7f0dbe0ac640 1 -- 172.21.15.114:0/1980082327 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db815a6c0 con 0x7f0db80adac0 2023-11-04T01:39:14.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.006+0000 7f0dbe0ac640 1 --2- 172.21.15.114:0/1980082327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db80adac0 0x7f0db80adf20 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f0db80cde50 tx=0x7f0db002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77539252420bcff server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.006+0000 7f0dbc8a9640 1 -- 172.21.15.114:0/1980082327 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0031830 con 0x7f0db80adac0 2023-11-04T01:39:14.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.006+0000 7f0dbc8a9640 1 -- 172.21.15.114:0/1980082327 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db0031990 con 0x7f0db80adac0 2023-11-04T01:39:14.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.006+0000 7f0dbc8a9640 1 -- 172.21.15.114:0/1980082327 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0031d20 con 0x7f0db80adac0 2023-11-04T01:39:14.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.006+0000 7f0dbfb0f640 1 -- 172.21.15.114:0/1980082327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db80adac0 msgr2=0x7f0db80adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.006+0000 7f0dbfb0f640 1 --2- 172.21.15.114:0/1980082327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db80adac0 0x7f0db80adf20 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f0db80cde50 tx=0x7f0db002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.006+0000 7f0dbfb0f640 1 -- 172.21.15.114:0/1980082327 shutdown_connections 2023-11-04T01:39:14.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.006+0000 7f0dbfb0f640 1 --2- 172.21.15.114:0/1980082327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db80adac0 0x7f0db80adf20 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.006+0000 7f0dbfb0f640 1 --2- 172.21.15.114:0/1980082327 >> v2:172.21.15.141:3300/0 conn(0x7f0db80c4ff0 0x7f0db80cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.006+0000 7f0dbfb0f640 1 -- 172.21.15.114:0/1980082327 >> 172.21.15.114:0/1980082327 conn(0x7f0db80ce950 msgr2=0x7f0db80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.006+0000 7f0dbfb0f640 1 -- 172.21.15.114:0/1980082327 shutdown_connections 2023-11-04T01:39:14.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.006+0000 7f0dbfb0f640 1 -- 172.21.15.114:0/1980082327 wait complete. 2023-11-04T01:39:14.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.008+0000 7f0dbfb0f640 1 Processor -- start 2023-11-04T01:39:14.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.008+0000 7f0dbfb0f640 1 -- start start 2023-11-04T01:39:14.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.008+0000 7f0dbfb0f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db80adac0 0x7f0db8158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.008+0000 7f0dbfb0f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db80c4ff0 0x7f0db8152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.008+0000 7f0dbfb0f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db8159c00 0x7f0db806cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.008+0000 7f0dbfb0f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db806e5a0 con 0x7f0db80c4ff0 2023-11-04T01:39:14.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.008+0000 7f0dbfb0f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8152ad0 con 0x7f0db80adac0 2023-11-04T01:39:14.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.008+0000 7f0dbfb0f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8159100 con 0x7f0db8159c00 2023-11-04T01:39:14.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.008+0000 7f0dbd0aa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db80c4ff0 0x7f0db8152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dbd0aa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db80c4ff0 0x7f0db8152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45842/0 (socket says 172.21.15.114:45842) 2023-11-04T01:39:14.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dbd0aa640 1 -- 172.21.15.114:0/235091316 learned_addr learned my addr 172.21.15.114:0/235091316 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:14.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dbd8ab640 1 --2- 172.21.15.114:0/235091316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db80adac0 0x7f0db8158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dbe0ac640 1 --2- 172.21.15.114:0/235091316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db8159c00 0x7f0db806cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dbd0aa640 1 -- 172.21.15.114:0/235091316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db8159c00 msgr2=0x7f0db806cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dbd0aa640 1 --2- 172.21.15.114:0/235091316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db8159c00 0x7f0db806cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dbd0aa640 1 -- 172.21.15.114:0/235091316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db80adac0 msgr2=0x7f0db8158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dbd0aa640 1 --2- 172.21.15.114:0/235091316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db80adac0 0x7f0db8158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dbd0aa640 1 -- 172.21.15.114:0/235091316 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db0009400 con 0x7f0db80c4ff0 2023-11-04T01:39:14.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dbd8ab640 1 --2- 172.21.15.114:0/235091316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db80adac0 0x7f0db8158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:14.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dbe0ac640 1 --2- 172.21.15.114:0/235091316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db8159c00 0x7f0db806cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:14.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dbd0aa640 1 --2- 172.21.15.114:0/235091316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db80c4ff0 0x7f0db8152590 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f0da800d7d0 tx=0x7f0da800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dae7fc640 1 -- 172.21.15.114:0/235091316 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8004030 con 0x7f0db80c4ff0 2023-11-04T01:39:14.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dae7fc640 1 -- 172.21.15.114:0/235091316 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8004190 con 0x7f0db80c4ff0 2023-11-04T01:39:14.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dae7fc640 1 -- 172.21.15.114:0/235091316 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da800b6c0 con 0x7f0db80c4ff0 2023-11-04T01:39:14.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dbfb0f640 1 -- 172.21.15.114:0/235091316 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db8155a50 con 0x7f0db80c4ff0 2023-11-04T01:39:14.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.009+0000 7f0dbfb0f640 1 -- 172.21.15.114:0/235091316 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db8156010 con 0x7f0db80c4ff0 2023-11-04T01:39:14.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.010+0000 7f0dbfb0f640 1 -- 172.21.15.114:0/235091316 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db8074290 con 0x7f0db80c4ff0 2023-11-04T01:39:14.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.011+0000 7f0dae7fc640 1 -- 172.21.15.114:0/235091316 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0da800b820 con 0x7f0db80c4ff0 2023-11-04T01:39:14.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.011+0000 7f0dae7fc640 1 --2- 172.21.15.114:0/235091316 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d9c06ae40 0x7f0d9c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.011+0000 7f0dbd8ab640 1 --2- 172.21.15.114:0/235091316 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d9c06ae40 0x7f0d9c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.011+0000 7f0dae7fc640 1 -- 172.21.15.114:0/235091316 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f0da8089ad0 con 0x7f0db80c4ff0 2023-11-04T01:39:14.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.011+0000 7f0dbd8ab640 1 --2- 172.21.15.114:0/235091316 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d9c06ae40 0x7f0d9c06d300 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0db4005c00 tx=0x7f0db4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.015+0000 7f0dae7fc640 1 -- 172.21.15.114:0/235091316 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0da8054910 con 0x7f0db80c4ff0 2023-11-04T01:39:14.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.181+0000 7f0dbfb0f640 1 -- 172.21.15.114:0/235091316 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0db815bd20 con 0x7f0db80c4ff0 2023-11-04T01:39:14.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.181+0000 7f0dae7fc640 1 -- 172.21.15.114:0/235091316 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0da8057f30 con 0x7f0db80c4ff0 2023-11-04T01:39:14.183 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:39:14.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.183+0000 7f0dbfb0f640 1 -- 172.21.15.114:0/235091316 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d9c06ae40 msgr2=0x7f0d9c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.183+0000 7f0dbfb0f640 1 --2- 172.21.15.114:0/235091316 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d9c06ae40 0x7f0d9c06d300 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0db4005c00 tx=0x7f0db4009040 comp rx=0 tx=0).stop 2023-11-04T01:39:14.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.183+0000 7f0dbfb0f640 1 -- 172.21.15.114:0/235091316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db80c4ff0 msgr2=0x7f0db8152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.183+0000 7f0dbfb0f640 1 --2- 172.21.15.114:0/235091316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db80c4ff0 0x7f0db8152590 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f0da800d7d0 tx=0x7f0da800dc90 comp rx=0 tx=0).stop 2023-11-04T01:39:14.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.183+0000 7f0dbfb0f640 1 -- 172.21.15.114:0/235091316 shutdown_connections 2023-11-04T01:39:14.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.183+0000 7f0dbfb0f640 1 --2- 172.21.15.114:0/235091316 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db8159c00 0x7f0db806cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.183+0000 7f0dbfb0f640 1 --2- 172.21.15.114:0/235091316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db80c4ff0 0x7f0db8152590 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.183+0000 7f0dbfb0f640 1 --2- 172.21.15.114:0/235091316 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d9c06ae40 0x7f0d9c06d300 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.183+0000 7f0dbfb0f640 1 --2- 172.21.15.114:0/235091316 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db80adac0 0x7f0db8158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.183+0000 7f0dbfb0f640 1 -- 172.21.15.114:0/235091316 >> 172.21.15.114:0/235091316 conn(0x7f0db80ce950 msgr2=0x7f0db8154ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.183+0000 7f0dbfb0f640 1 -- 172.21.15.114:0/235091316 shutdown_connections 2023-11-04T01:39:14.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.183+0000 7f0dbfb0f640 1 -- 172.21.15.114:0/235091316 wait complete. 2023-11-04T01:39:14.196 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:39:14.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.297+0000 7f870e97c640 1 Processor -- start 2023-11-04T01:39:14.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.297+0000 7f870e97c640 1 -- start start 2023-11-04T01:39:14.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.298+0000 7f870e97c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f870815b120 0x7f870806b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.298+0000 7f870e97c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f87080c9b60 0x7f8708070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.298+0000 7f870e97c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8708065df0 con 0x7f870815ad40 2023-11-04T01:39:14.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.298+0000 7f870e97c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870806bc40 con 0x7f87080c9b60 2023-11-04T01:39:14.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.298+0000 7f870e97c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8708066040 con 0x7f870815b120 2023-11-04T01:39:14.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.298+0000 7f870cf19640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f87080c9b60 0x7f8708070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.298+0000 7f870cf19640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f87080c9b60 0x7f8708070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45858/0 (socket says 172.21.15.114:45858) 2023-11-04T01:39:14.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.298+0000 7f870cf19640 1 -- 172.21.15.114:0/1615549450 learned_addr learned my addr 172.21.15.114:0/1615549450 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:14.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.298+0000 7f87077fe640 1 --2- 172.21.15.114:0/1615549450 >> v2:172.21.15.141:3300/0 conn(0x7f870815b120 0x7f870806b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.298+0000 7f870cf19640 1 -- 172.21.15.114:0/1615549450 >> v2:172.21.15.141:3300/0 conn(0x7f870815b120 msgr2=0x7f870806b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:14.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.298+0000 7f870cf19640 1 --2- 172.21.15.114:0/1615549450 >> v2:172.21.15.141:3300/0 conn(0x7f870815b120 0x7f870806b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.298+0000 7f870cf19640 1 -- 172.21.15.114:0/1615549450 >> v1:172.21.15.141:6789/0 conn(0x7f870815ad40 legacy=0x7f870815f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:14.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.298+0000 7f870cf19640 1 -- 172.21.15.114:0/1615549450 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8708066320 con 0x7f87080c9b60 2023-11-04T01:39:14.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.299+0000 7f870cf19640 1 --2- 172.21.15.114:0/1615549450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87080c9b60 0x7f8708070ff0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f87080cf060 tx=0x7f870002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1bb7977af96afa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.299+0000 7f8706ffd640 1 -- 172.21.15.114:0/1615549450 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870002ca80 con 0x7f87080c9b60 2023-11-04T01:39:14.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.299+0000 7f8706ffd640 1 -- 172.21.15.114:0/1615549450 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870002cbe0 con 0x7f87080c9b60 2023-11-04T01:39:14.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.299+0000 7f8706ffd640 1 -- 172.21.15.114:0/1615549450 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87000343f0 con 0x7f87080c9b60 2023-11-04T01:39:14.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.300+0000 7f870e97c640 1 -- 172.21.15.114:0/1615549450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87080c9b60 msgr2=0x7f8708070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.300+0000 7f870e97c640 1 --2- 172.21.15.114:0/1615549450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87080c9b60 0x7f8708070ff0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f87080cf060 tx=0x7f870002bee0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.300+0000 7f870e97c640 1 -- 172.21.15.114:0/1615549450 shutdown_connections 2023-11-04T01:39:14.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.300+0000 7f870e97c640 1 --2- 172.21.15.114:0/1615549450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87080c9b60 0x7f8708070ff0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.300+0000 7f870e97c640 1 --2- 172.21.15.114:0/1615549450 >> v2:172.21.15.141:3300/0 conn(0x7f870815b120 0x7f870806b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.300+0000 7f870e97c640 1 -- 172.21.15.114:0/1615549450 >> 172.21.15.114:0/1615549450 conn(0x7f87080cbc90 msgr2=0x7f87080cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.300+0000 7f870e97c640 1 -- 172.21.15.114:0/1615549450 shutdown_connections 2023-11-04T01:39:14.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.300+0000 7f870e97c640 1 -- 172.21.15.114:0/1615549450 wait complete. 2023-11-04T01:39:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.301+0000 7f870e97c640 1 Processor -- start 2023-11-04T01:39:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.301+0000 7f870e97c640 1 -- start start 2023-11-04T01:39:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f870e97c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87080c9b60 0x7f870814b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f870e97c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f870815ad40 0x7f87080c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f870e97c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f870815b120 0x7f87080c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f870e97c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870814b950 con 0x7f870815ad40 2023-11-04T01:39:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f870e97c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87080c62e0 con 0x7f870815b120 2023-11-04T01:39:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f870e97c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87080c7140 con 0x7f87080c9b60 2023-11-04T01:39:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f87077fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f870815ad40 0x7f87080c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f87077fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f870815ad40 0x7f87080c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45862/0 (socket says 172.21.15.114:45862) 2023-11-04T01:39:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f87077fe640 1 -- 172.21.15.114:0/859039574 learned_addr learned my addr 172.21.15.114:0/859039574 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f870cf19640 1 --2- 172.21.15.114:0/859039574 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f870815b120 0x7f87080c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f8707fff640 1 --2- 172.21.15.114:0/859039574 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87080c9b60 0x7f870814b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f87077fe640 1 -- 172.21.15.114:0/859039574 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87080c9b60 msgr2=0x7f870814b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f87077fe640 1 --2- 172.21.15.114:0/859039574 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87080c9b60 0x7f870814b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f87077fe640 1 -- 172.21.15.114:0/859039574 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f870815b120 msgr2=0x7f87080c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f87077fe640 1 --2- 172.21.15.114:0/859039574 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f870815b120 0x7f87080c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f87077fe640 1 -- 172.21.15.114:0/859039574 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8700009b30 con 0x7f870815ad40 2023-11-04T01:39:14.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f870cf19640 1 --2- 172.21.15.114:0/859039574 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f870815b120 0x7f87080c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:14.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f8707fff640 1 --2- 172.21.15.114:0/859039574 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87080c9b60 0x7f870814b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:14.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f87077fe640 1 --2- 172.21.15.114:0/859039574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f870815ad40 0x7f87080c8ae0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00d5f0 tx=0x7f86fc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f8704ff9640 1 -- 172.21.15.114:0/859039574 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0125f0 con 0x7f870815ad40 2023-11-04T01:39:14.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f8704ff9640 1 -- 172.21.15.114:0/859039574 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc012750 con 0x7f870815ad40 2023-11-04T01:39:14.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f870e97c640 1 -- 172.21.15.114:0/859039574 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87080c6530 con 0x7f870815ad40 2023-11-04T01:39:14.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f8704ff9640 1 -- 172.21.15.114:0/859039574 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc012b00 con 0x7f870815ad40 2023-11-04T01:39:14.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.302+0000 7f870e97c640 1 -- 172.21.15.114:0/859039574 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87080c6af0 con 0x7f870815ad40 2023-11-04T01:39:14.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.303+0000 7f870e97c640 1 -- 172.21.15.114:0/859039574 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8708074290 con 0x7f870815ad40 2023-11-04T01:39:14.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.304+0000 7f8704ff9640 1 -- 172.21.15.114:0/859039574 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f86fc012c60 con 0x7f870815ad40 2023-11-04T01:39:14.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.304+0000 7f8704ff9640 1 --2- 172.21.15.114:0/859039574 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f86f406ae70 0x7f86f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.304+0000 7f8704ff9640 1 -- 172.21.15.114:0/859039574 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f86fc089c80 con 0x7f870815ad40 2023-11-04T01:39:14.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.304+0000 7f8707fff640 1 --2- 172.21.15.114:0/859039574 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f86f406ae70 0x7f86f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.305+0000 7f8707fff640 1 --2- 172.21.15.114:0/859039574 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f86f406ae70 0x7f86f406d330 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f86f8003eb0 tx=0x7f86f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.308+0000 7f8704ff9640 1 -- 172.21.15.114:0/859039574 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f86fc054b50 con 0x7f870815ad40 2023-11-04T01:39:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.473+0000 7f870e97c640 1 -- 172.21.15.114:0/859039574 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f87080ccac0 con 0x7f870815ad40 2023-11-04T01:39:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.473+0000 7f8704ff9640 1 -- 172.21.15.114:0/859039574 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v74) v1 ==== 103+0+11 (secure 0 0 0) 0x7f86fc058170 con 0x7f870815ad40 2023-11-04T01:39:14.475 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:14.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.475+0000 7f870e97c640 1 -- 172.21.15.114:0/859039574 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f86f406ae70 msgr2=0x7f86f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.475+0000 7f870e97c640 1 --2- 172.21.15.114:0/859039574 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f86f406ae70 0x7f86f406d330 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f86f8003eb0 tx=0x7f86f8009040 comp rx=0 tx=0).stop 2023-11-04T01:39:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.475+0000 7f870e97c640 1 -- 172.21.15.114:0/859039574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f870815ad40 msgr2=0x7f87080c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.475+0000 7f870e97c640 1 --2- 172.21.15.114:0/859039574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f870815ad40 0x7f87080c8ae0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00d5f0 tx=0x7f86fc00dab0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.475+0000 7f870e97c640 1 -- 172.21.15.114:0/859039574 shutdown_connections 2023-11-04T01:39:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.475+0000 7f870e97c640 1 --2- 172.21.15.114:0/859039574 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f86f406ae70 0x7f86f406d330 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.475+0000 7f870e97c640 1 --2- 172.21.15.114:0/859039574 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f870815b120 0x7f87080c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.475+0000 7f870e97c640 1 --2- 172.21.15.114:0/859039574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f870815ad40 0x7f87080c8ae0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.475+0000 7f870e97c640 1 --2- 172.21.15.114:0/859039574 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87080c9b60 0x7f870814b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.475+0000 7f870e97c640 1 -- 172.21.15.114:0/859039574 >> 172.21.15.114:0/859039574 conn(0x7f87080cbc90 msgr2=0x7f87080b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.475+0000 7f870e97c640 1 -- 172.21.15.114:0/859039574 shutdown_connections 2023-11-04T01:39:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.475+0000 7f870e97c640 1 -- 172.21.15.114:0/859039574 wait complete. 2023-11-04T01:39:14.488 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:39:14.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.588+0000 7fb2eeb61640 1 Processor -- start 2023-11-04T01:39:14.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.588+0000 7fb2eeb61640 1 -- start start 2023-11-04T01:39:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.589+0000 7fb2eeb61640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2e815e430 0x7fb2e80cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.589+0000 7fb2eeb61640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2e80cf160 0x7fb2e80cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.589+0000 7fb2eeb61640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb2e80d0710 0x7fb2e80cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.589+0000 7fb2eeb61640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e80cdf90 con 0x7fb2e815e430 2023-11-04T01:39:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.589+0000 7fb2eeb61640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e80d0280 con 0x7fb2e80d0710 2023-11-04T01:39:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.589+0000 7fb2eeb61640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e80cf670 con 0x7fb2e80cf160 2023-11-04T01:39:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.589+0000 7fb2ec8fd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2e815e430 0x7fb2e80cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.589+0000 7fb2ec8fd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2e815e430 0x7fb2e80cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45870/0 (socket says 172.21.15.114:45870) 2023-11-04T01:39:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.589+0000 7fb2ec8fd640 1 -- 172.21.15.114:0/2719076039 learned_addr learned my addr 172.21.15.114:0/2719076039 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.589+0000 7fb2ed0fe640 1 --2- 172.21.15.114:0/2719076039 >> v2:172.21.15.141:3300/0 conn(0x7fb2e80d0710 0x7fb2e80cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.590+0000 7fb2e7fff640 1 --2- 172.21.15.114:0/2719076039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2e80cf160 0x7fb2e80cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.590+0000 7fb2ec8fd640 1 -- 172.21.15.114:0/2719076039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2e80cf160 msgr2=0x7fb2e80cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.590+0000 7fb2ec8fd640 1 --2- 172.21.15.114:0/2719076039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2e80cf160 0x7fb2e80cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.590+0000 7fb2ec8fd640 1 -- 172.21.15.114:0/2719076039 >> v2:172.21.15.141:3300/0 conn(0x7fb2e80d0710 msgr2=0x7fb2e80cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.590+0000 7fb2ec8fd640 1 --2- 172.21.15.114:0/2719076039 >> v2:172.21.15.141:3300/0 conn(0x7fb2e80d0710 0x7fb2e80cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.590+0000 7fb2ec8fd640 1 -- 172.21.15.114:0/2719076039 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e80cf950 con 0x7fb2e815e430 2023-11-04T01:39:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.590+0000 7fb2e7fff640 1 --2- 172.21.15.114:0/2719076039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2e80cf160 0x7fb2e80cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.590+0000 7fb2ec8fd640 1 --2- 172.21.15.114:0/2719076039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e815e430 0x7fb2e80cec20 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fb2e806f860 tx=0x7fb2e002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80247069b044970 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.591+0000 7fb2e77fe640 1 -- 172.21.15.114:0/2719076039 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e002ca70 con 0x7fb2e815e430 2023-11-04T01:39:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.591+0000 7fb2e77fe640 1 -- 172.21.15.114:0/2719076039 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e002cbd0 con 0x7fb2e815e430 2023-11-04T01:39:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.591+0000 7fb2e77fe640 1 -- 172.21.15.114:0/2719076039 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e00343f0 con 0x7fb2e815e430 2023-11-04T01:39:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.591+0000 7fb2eeb61640 1 -- 172.21.15.114:0/2719076039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e815e430 msgr2=0x7fb2e80cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.591+0000 7fb2eeb61640 1 --2- 172.21.15.114:0/2719076039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e815e430 0x7fb2e80cec20 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fb2e806f860 tx=0x7fb2e002bed0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.591+0000 7fb2eeb61640 1 -- 172.21.15.114:0/2719076039 shutdown_connections 2023-11-04T01:39:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.591+0000 7fb2eeb61640 1 --2- 172.21.15.114:0/2719076039 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2e80cf160 0x7fb2e80cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.591+0000 7fb2eeb61640 1 --2- 172.21.15.114:0/2719076039 >> v2:172.21.15.141:3300/0 conn(0x7fb2e80d0710 0x7fb2e80cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.592+0000 7fb2eeb61640 1 --2- 172.21.15.114:0/2719076039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e815e430 0x7fb2e80cec20 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.592+0000 7fb2eeb61640 1 -- 172.21.15.114:0/2719076039 >> 172.21.15.114:0/2719076039 conn(0x7fb2e806ea20 msgr2=0x7fb2e806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.592+0000 7fb2eeb61640 1 -- 172.21.15.114:0/2719076039 shutdown_connections 2023-11-04T01:39:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.592+0000 7fb2eeb61640 1 -- 172.21.15.114:0/2719076039 wait complete. 2023-11-04T01:39:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.593+0000 7fb2eeb61640 1 Processor -- start 2023-11-04T01:39:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.593+0000 7fb2eeb61640 1 -- start start 2023-11-04T01:39:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2eeb61640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2e80cf160 0x7fb2e814a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2eeb61640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2e80d0710 0x7fb2e80a77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2eeb61640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e815e430 0x7fb2e80c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2eeb61640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e814a930 con 0x7fb2e815e430 2023-11-04T01:39:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2eeb61640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e81f1520 con 0x7fb2e80cf160 2023-11-04T01:39:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2eeb61640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e81f0950 con 0x7fb2e80d0710 2023-11-04T01:39:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2ed0fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e815e430 0x7fb2e80c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2ed0fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e815e430 0x7fb2e80c6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45882/0 (socket says 172.21.15.114:45882) 2023-11-04T01:39:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2ed0fe640 1 -- 172.21.15.114:0/3760703609 learned_addr learned my addr 172.21.15.114:0/3760703609 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2ec8fd640 1 --2- 172.21.15.114:0/3760703609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2e80cf160 0x7fb2e814a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2e7fff640 1 --2- 172.21.15.114:0/3760703609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2e80d0710 0x7fb2e80a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2ed0fe640 1 -- 172.21.15.114:0/3760703609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2e80d0710 msgr2=0x7fb2e80a77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2ed0fe640 1 --2- 172.21.15.114:0/3760703609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2e80d0710 0x7fb2e80a77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2ed0fe640 1 -- 172.21.15.114:0/3760703609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2e80cf160 msgr2=0x7fb2e814a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2ed0fe640 1 --2- 172.21.15.114:0/3760703609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2e80cf160 0x7fb2e814a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2ed0fe640 1 -- 172.21.15.114:0/3760703609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e0009b30 con 0x7fb2e815e430 2023-11-04T01:39:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2e7fff640 1 --2- 172.21.15.114:0/3760703609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2e80d0710 0x7fb2e80a77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2ed0fe640 1 --2- 172.21.15.114:0/3760703609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e815e430 0x7fb2e80c6800 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800e7f0 tx=0x7fb2d800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2e57fa640 1 -- 172.21.15.114:0/3760703609 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8009510 con 0x7fb2e815e430 2023-11-04T01:39:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2e57fa640 1 -- 172.21.15.114:0/3760703609 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d800ee40 con 0x7fb2e815e430 2023-11-04T01:39:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2e57fa640 1 -- 172.21.15.114:0/3760703609 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800cb80 con 0x7fb2e815e430 2023-11-04T01:39:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2eeb61640 1 -- 172.21.15.114:0/3760703609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e81f0bf0 con 0x7fb2e815e430 2023-11-04T01:39:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.594+0000 7fb2eeb61640 1 -- 172.21.15.114:0/3760703609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e81f11b0 con 0x7fb2e815e430 2023-11-04T01:39:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.595+0000 7fb2eeb61640 1 -- 172.21.15.114:0/3760703609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e8074290 con 0x7fb2e815e430 2023-11-04T01:39:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.596+0000 7fb2e57fa640 1 -- 172.21.15.114:0/3760703609 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb2d800cce0 con 0x7fb2e815e430 2023-11-04T01:39:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.596+0000 7fb2e57fa640 1 --2- 172.21.15.114:0/3760703609 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2d406ae70 0x7fb2d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.596+0000 7fb2e57fa640 1 -- 172.21.15.114:0/3760703609 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fb2d80898e0 con 0x7fb2e815e430 2023-11-04T01:39:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.596+0000 7fb2ec8fd640 1 --2- 172.21.15.114:0/3760703609 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2d406ae70 0x7fb2d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.597+0000 7fb2ec8fd640 1 --2- 172.21.15.114:0/3760703609 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2d406ae70 0x7fb2d406d330 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0035000 tx=0x7fb2e0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.602+0000 7fb2e57fa640 1 -- 172.21.15.114:0/3760703609 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb2d80547d0 con 0x7fb2e815e430 2023-11-04T01:39:14.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.768+0000 7fb2eeb61640 1 -- 172.21.15.114:0/3760703609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fb2e81f1660 con 0x7fb2e815e430 2023-11-04T01:39:14.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.768+0000 7fb2e57fa640 1 -- 172.21.15.114:0/3760703609 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v74) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb2d8057df0 con 0x7fb2e815e430 2023-11-04T01:39:14.770 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:14.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.770+0000 7fb2eeb61640 1 -- 172.21.15.114:0/3760703609 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2d406ae70 msgr2=0x7fb2d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.770+0000 7fb2eeb61640 1 --2- 172.21.15.114:0/3760703609 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2d406ae70 0x7fb2d406d330 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0035000 tx=0x7fb2e0030000 comp rx=0 tx=0).stop 2023-11-04T01:39:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.770+0000 7fb2eeb61640 1 -- 172.21.15.114:0/3760703609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e815e430 msgr2=0x7fb2e80c6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.770+0000 7fb2eeb61640 1 --2- 172.21.15.114:0/3760703609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e815e430 0x7fb2e80c6800 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800e7f0 tx=0x7fb2d800ebf0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.770+0000 7fb2eeb61640 1 -- 172.21.15.114:0/3760703609 shutdown_connections 2023-11-04T01:39:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.770+0000 7fb2eeb61640 1 --2- 172.21.15.114:0/3760703609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2e815e430 0x7fb2e80c6800 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.770+0000 7fb2eeb61640 1 --2- 172.21.15.114:0/3760703609 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb2e80d0710 0x7fb2e80a77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.770+0000 7fb2eeb61640 1 --2- 172.21.15.114:0/3760703609 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2d406ae70 0x7fb2d406d330 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.770+0000 7fb2eeb61640 1 --2- 172.21.15.114:0/3760703609 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb2e80cf160 0x7fb2e814a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.770+0000 7fb2eeb61640 1 -- 172.21.15.114:0/3760703609 >> 172.21.15.114:0/3760703609 conn(0x7fb2e806ea20 msgr2=0x7fb2e80b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.770+0000 7fb2eeb61640 1 -- 172.21.15.114:0/3760703609 shutdown_connections 2023-11-04T01:39:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.770+0000 7fb2eeb61640 1 -- 172.21.15.114:0/3760703609 wait complete. 2023-11-04T01:39:14.783 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:39:14.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.882+0000 7ff5b87b6640 1 Processor -- start 2023-11-04T01:39:14.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.883+0000 7ff5b87b6640 1 -- start start 2023-11-04T01:39:14.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.883+0000 7ff5b87b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff5b0160430 0x7ff5b00b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.883+0000 7ff5b87b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff5b006c3a0 0x7ff5b00cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.883+0000 7ff5b87b6640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b00b2fc0 con 0x7ff5b00b2b60 2023-11-04T01:39:14.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.883+0000 7ff5b87b6640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b00cb580 con 0x7ff5b0160430 2023-11-04T01:39:14.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.883+0000 7ff5b87b6640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b006c7d0 con 0x7ff5b006c3a0 2023-11-04T01:39:14.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.884+0000 7ff5b6552640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff5b0160430 0x7ff5b00b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.884+0000 7ff5b6552640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff5b0160430 0x7ff5b00b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45890/0 (socket says 172.21.15.114:45890) 2023-11-04T01:39:14.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.884+0000 7ff5b6552640 1 -- 172.21.15.114:0/4147238804 learned_addr learned my addr 172.21.15.114:0/4147238804 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:14.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.884+0000 7ff5b6d53640 1 --2- 172.21.15.114:0/4147238804 >> v2:172.21.15.141:3300/0 conn(0x7ff5b006c3a0 0x7ff5b00cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.884+0000 7ff5b6552640 1 -- 172.21.15.114:0/4147238804 >> v2:172.21.15.141:3300/0 conn(0x7ff5b006c3a0 msgr2=0x7ff5b00cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:14.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.884+0000 7ff5b6552640 1 --2- 172.21.15.114:0/4147238804 >> v2:172.21.15.141:3300/0 conn(0x7ff5b006c3a0 0x7ff5b00cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.884+0000 7ff5b6552640 1 -- 172.21.15.114:0/4147238804 >> v1:172.21.15.141:6789/0 conn(0x7ff5b00b2b60 legacy=0x7ff5b006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:14.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.884+0000 7ff5b6552640 1 -- 172.21.15.114:0/4147238804 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b006ca40 con 0x7ff5b0160430 2023-11-04T01:39:14.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.885+0000 7ff5b6552640 1 --2- 172.21.15.114:0/4147238804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5b0160430 0x7ff5b00b2620 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00c4600 tx=0x7ff5ac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8809b3fc49ea93a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.885+0000 7ff5b5550640 1 -- 172.21.15.114:0/4147238804 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac031870 con 0x7ff5b0160430 2023-11-04T01:39:14.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.885+0000 7ff5b5550640 1 -- 172.21.15.114:0/4147238804 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac0319d0 con 0x7ff5b0160430 2023-11-04T01:39:14.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.885+0000 7ff5b5550640 1 -- 172.21.15.114:0/4147238804 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac031d60 con 0x7ff5b0160430 2023-11-04T01:39:14.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.885+0000 7ff5b87b6640 1 -- 172.21.15.114:0/4147238804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5b0160430 msgr2=0x7ff5b00b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.885+0000 7ff5b87b6640 1 --2- 172.21.15.114:0/4147238804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5b0160430 0x7ff5b00b2620 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00c4600 tx=0x7ff5ac02b910 comp rx=0 tx=0).stop 2023-11-04T01:39:14.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.885+0000 7ff5b87b6640 1 -- 172.21.15.114:0/4147238804 shutdown_connections 2023-11-04T01:39:14.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.885+0000 7ff5b87b6640 1 --2- 172.21.15.114:0/4147238804 >> v2:172.21.15.141:3300/0 conn(0x7ff5b006c3a0 0x7ff5b00cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.885+0000 7ff5b87b6640 1 --2- 172.21.15.114:0/4147238804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5b0160430 0x7ff5b00b2620 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.885+0000 7ff5b87b6640 1 -- 172.21.15.114:0/4147238804 >> 172.21.15.114:0/4147238804 conn(0x7ff5b006ea20 msgr2=0x7ff5b006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:14.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.885+0000 7ff5b87b6640 1 -- 172.21.15.114:0/4147238804 shutdown_connections 2023-11-04T01:39:14.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.885+0000 7ff5b87b6640 1 -- 172.21.15.114:0/4147238804 wait complete. 2023-11-04T01:39:14.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.886+0000 7ff5b87b6640 1 Processor -- start 2023-11-04T01:39:14.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.887+0000 7ff5b87b6640 1 -- start start 2023-11-04T01:39:14.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.887+0000 7ff5b87b6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5b006c3a0 0x7ff5b01557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.887+0000 7ff5b87b6640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5b00b2b60 0x7ff5b01f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.887+0000 7ff5b87b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5b0160430 0x7ff5b0151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.887+0000 7ff5b87b6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b01f6c50 con 0x7ff5b006c3a0 2023-11-04T01:39:14.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.887+0000 7ff5b87b6640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00b37c0 con 0x7ff5b00b2b60 2023-11-04T01:39:14.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.887+0000 7ff5b87b6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b0151ca0 con 0x7ff5b0160430 2023-11-04T01:39:14.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.887+0000 7ff5b6552640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5b006c3a0 0x7ff5b01557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.887+0000 7ff5b6552640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5b006c3a0 0x7ff5b01557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45904/0 (socket says 172.21.15.114:45904) 2023-11-04T01:39:14.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.887+0000 7ff5b6552640 1 -- 172.21.15.114:0/3016153052 learned_addr learned my addr 172.21.15.114:0/3016153052 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:14.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.887+0000 7ff5b6d53640 1 --2- 172.21.15.114:0/3016153052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5b0160430 0x7ff5b0151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.887+0000 7ff5b5d51640 1 --2- 172.21.15.114:0/3016153052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5b00b2b60 0x7ff5b01f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.888+0000 7ff5b6552640 1 -- 172.21.15.114:0/3016153052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5b0160430 msgr2=0x7ff5b0151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.888+0000 7ff5b6552640 1 --2- 172.21.15.114:0/3016153052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5b0160430 0x7ff5b0151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.888+0000 7ff5b6552640 1 -- 172.21.15.114:0/3016153052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5b00b2b60 msgr2=0x7ff5b01f6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:14.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.888+0000 7ff5b6552640 1 --2- 172.21.15.114:0/3016153052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5b00b2b60 0x7ff5b01f6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:14.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.888+0000 7ff5b6552640 1 -- 172.21.15.114:0/3016153052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac0094d0 con 0x7ff5b006c3a0 2023-11-04T01:39:14.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.888+0000 7ff5b6552640 1 --2- 172.21.15.114:0/3016153052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5b006c3a0 0x7ff5b01557b0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac000c00 tx=0x7ff5ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.888+0000 7ff5a6ffd640 1 -- 172.21.15.114:0/3016153052 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac03abe0 con 0x7ff5b006c3a0 2023-11-04T01:39:14.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.888+0000 7ff5a6ffd640 1 -- 172.21.15.114:0/3016153052 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac03ad40 con 0x7ff5b006c3a0 2023-11-04T01:39:14.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.888+0000 7ff5b87b6640 1 -- 172.21.15.114:0/3016153052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b01f6e80 con 0x7ff5b006c3a0 2023-11-04T01:39:14.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.888+0000 7ff5a6ffd640 1 -- 172.21.15.114:0/3016153052 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac044610 con 0x7ff5b006c3a0 2023-11-04T01:39:14.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.888+0000 7ff5b87b6640 1 -- 172.21.15.114:0/3016153052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b01f7440 con 0x7ff5b006c3a0 2023-11-04T01:39:14.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.889+0000 7ff5b87b6640 1 -- 172.21.15.114:0/3016153052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b01f7630 con 0x7ff5b006c3a0 2023-11-04T01:39:14.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.889+0000 7ff5a6ffd640 1 -- 172.21.15.114:0/3016153052 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5ac04d450 con 0x7ff5b006c3a0 2023-11-04T01:39:14.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.890+0000 7ff5a6ffd640 1 --2- 172.21.15.114:0/3016153052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff59406ae70 0x7ff59406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:14.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.890+0000 7ff5a6ffd640 1 -- 172.21.15.114:0/3016153052 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7ff5ac02d040 con 0x7ff5b006c3a0 2023-11-04T01:39:14.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.890+0000 7ff5b5d51640 1 --2- 172.21.15.114:0/3016153052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff59406ae70 0x7ff59406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:14.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.890+0000 7ff5b5d51640 1 --2- 172.21.15.114:0/3016153052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff59406ae70 0x7ff59406d330 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff5b01f6670 tx=0x7ff5a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:14.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:14.894+0000 7ff5a6ffd640 1 -- 172.21.15.114:0/3016153052 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff5ac076c70 con 0x7ff5b006c3a0 2023-11-04T01:39:15.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.061+0000 7ff5b87b6640 1 -- 172.21.15.114:0/3016153052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7ff5b0160810 con 0x7ff5b006c3a0 2023-11-04T01:39:15.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.061+0000 7ff5a6ffd640 1 -- 172.21.15.114:0/3016153052 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v74) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff5ac0350b0 con 0x7ff5b006c3a0 2023-11-04T01:39:15.063 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:15.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.063+0000 7ff5b87b6640 1 -- 172.21.15.114:0/3016153052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff59406ae70 msgr2=0x7ff59406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.063+0000 7ff5b87b6640 1 --2- 172.21.15.114:0/3016153052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff59406ae70 0x7ff59406d330 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff5b01f6670 tx=0x7ff5a0009040 comp rx=0 tx=0).stop 2023-11-04T01:39:15.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.063+0000 7ff5b87b6640 1 -- 172.21.15.114:0/3016153052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5b006c3a0 msgr2=0x7ff5b01557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.063+0000 7ff5b87b6640 1 --2- 172.21.15.114:0/3016153052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5b006c3a0 0x7ff5b01557b0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac000c00 tx=0x7ff5ac0046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.063+0000 7ff5b87b6640 1 -- 172.21.15.114:0/3016153052 shutdown_connections 2023-11-04T01:39:15.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.063+0000 7ff5b87b6640 1 --2- 172.21.15.114:0/3016153052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5b0160430 0x7ff5b0151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.063+0000 7ff5b87b6640 1 --2- 172.21.15.114:0/3016153052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff59406ae70 0x7ff59406d330 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.063+0000 7ff5b87b6640 1 --2- 172.21.15.114:0/3016153052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5b00b2b60 0x7ff5b01f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.063+0000 7ff5b87b6640 1 --2- 172.21.15.114:0/3016153052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5b006c3a0 0x7ff5b01557b0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.063+0000 7ff5b87b6640 1 -- 172.21.15.114:0/3016153052 >> 172.21.15.114:0/3016153052 conn(0x7ff5b006ea20 msgr2=0x7ff5b00b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:15.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.063+0000 7ff5b87b6640 1 -- 172.21.15.114:0/3016153052 shutdown_connections 2023-11-04T01:39:15.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.063+0000 7ff5b87b6640 1 -- 172.21.15.114:0/3016153052 wait complete. 2023-11-04T01:39:15.075 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config' 2023-11-04T01:39:15.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.173+0000 7f713ccbb640 1 Processor -- start 2023-11-04T01:39:15.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.173+0000 7f713ccbb640 1 -- start start 2023-11-04T01:39:15.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.174+0000 7f713ccbb640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f71380ca030 0x7f7138071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.174+0000 7f713ccbb640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71380cf940 0x7f71380b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.174+0000 7f713ccbb640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71380c9710 con 0x7f713815af30 2023-11-04T01:39:15.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.174+0000 7f713ccbb640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71380b2600 con 0x7f71380ca030 2023-11-04T01:39:15.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.174+0000 7f713ccbb640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713806c8b0 con 0x7f71380cf940 2023-11-04T01:39:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.174+0000 7f7136d9d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71380cf940 0x7f71380b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.174+0000 7f7135d9b640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f71380ca030 0x7f7138071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.175+0000 7f7136d9d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71380cf940 0x7f71380b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:36880/0 (socket says 172.21.15.114:36880) 2023-11-04T01:39:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.175+0000 7f7136d9d640 1 -- 172.21.15.114:0/905010787 learned_addr learned my addr 172.21.15.114:0/905010787 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.175+0000 7f7136d9d640 1 -- 172.21.15.114:0/905010787 >> v2:172.21.15.141:3300/0 conn(0x7f71380ca030 msgr2=0x7f7138071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.175+0000 7f7136d9d640 1 --2- 172.21.15.114:0/905010787 >> v2:172.21.15.141:3300/0 conn(0x7f71380ca030 0x7f7138071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.175+0000 7f7136d9d640 1 -- 172.21.15.114:0/905010787 >> v1:172.21.15.141:6789/0 conn(0x7f713815af30 legacy=0x7f71380c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.175+0000 7f7136d9d640 1 -- 172.21.15.114:0/905010787 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713806cb90 con 0x7f71380cf940 2023-11-04T01:39:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.175+0000 7f7135d9b640 1 --2- 172.21.15.114:0/905010787 >> v2:172.21.15.141:3300/0 conn(0x7f71380ca030 0x7f7138071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.176+0000 7f7136d9d640 1 --2- 172.21.15.114:0/905010787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71380cf940 0x7f71380b20c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7130009850 tx=0x7f713002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5ec55eba64bb415 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.176+0000 7f713559a640 1 -- 172.21.15.114:0/905010787 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130030610 con 0x7f71380cf940 2023-11-04T01:39:15.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.176+0000 7f713559a640 1 -- 172.21.15.114:0/905010787 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7130030770 con 0x7f71380cf940 2023-11-04T01:39:15.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.176+0000 7f713559a640 1 -- 172.21.15.114:0/905010787 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130030b00 con 0x7f71380cf940 2023-11-04T01:39:15.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.176+0000 7f713ccbb640 1 -- 172.21.15.114:0/905010787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71380cf940 msgr2=0x7f71380b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.177+0000 7f713ccbb640 1 --2- 172.21.15.114:0/905010787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71380cf940 0x7f71380b20c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7130009850 tx=0x7f713002b960 comp rx=0 tx=0).stop 2023-11-04T01:39:15.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.177+0000 7f713ccbb640 1 -- 172.21.15.114:0/905010787 shutdown_connections 2023-11-04T01:39:15.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.177+0000 7f713ccbb640 1 --2- 172.21.15.114:0/905010787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f71380cf940 0x7f71380b20c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.177+0000 7f713ccbb640 1 --2- 172.21.15.114:0/905010787 >> v2:172.21.15.141:3300/0 conn(0x7f71380ca030 0x7f7138071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.177+0000 7f713ccbb640 1 -- 172.21.15.114:0/905010787 >> 172.21.15.114:0/905010787 conn(0x7f71380cee20 msgr2=0x7f71380cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:15.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.177+0000 7f713ccbb640 1 -- 172.21.15.114:0/905010787 shutdown_connections 2023-11-04T01:39:15.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.177+0000 7f713ccbb640 1 -- 172.21.15.114:0/905010787 wait complete. 2023-11-04T01:39:15.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.178+0000 7f713ccbb640 1 Processor -- start 2023-11-04T01:39:15.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.178+0000 7f713ccbb640 1 -- start start 2023-11-04T01:39:15.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f713ccbb640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71380ca030 0x7f71380afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f713ccbb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71380cf940 0x7f71381f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f713ccbb640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f713815af30 0x7f71381e50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f713ccbb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71381e46b0 con 0x7f71380cf940 2023-11-04T01:39:15.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f713ccbb640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71381f4c10 con 0x7f71380ca030 2023-11-04T01:39:15.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f713ccbb640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71381f4650 con 0x7f713815af30 2023-11-04T01:39:15.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f7135d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71380cf940 0x7f71381f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f7135d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71380cf940 0x7f71381f3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45906/0 (socket says 172.21.15.114:45906) 2023-11-04T01:39:15.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f7135d9b640 1 -- 172.21.15.114:0/2124842828 learned_addr learned my addr 172.21.15.114:0/2124842828 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:15.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f7136d9d640 1 --2- 172.21.15.114:0/2124842828 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f713815af30 0x7f71381e50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f713659c640 1 --2- 172.21.15.114:0/2124842828 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71380ca030 0x7f71380afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f7135d9b640 1 -- 172.21.15.114:0/2124842828 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f713815af30 msgr2=0x7f71381e50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f7135d9b640 1 --2- 172.21.15.114:0/2124842828 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f713815af30 0x7f71381e50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f7135d9b640 1 -- 172.21.15.114:0/2124842828 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71380ca030 msgr2=0x7f71380afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f7135d9b640 1 --2- 172.21.15.114:0/2124842828 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71380ca030 0x7f71380afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f7135d9b640 1 -- 172.21.15.114:0/2124842828 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c009400 con 0x7f71380cf940 2023-11-04T01:39:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f7135d9b640 1 --2- 172.21.15.114:0/2124842828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71380cf940 0x7f71381f3ce0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f712c00e910 tx=0x7f712c00edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f7126ffd640 1 -- 172.21.15.114:0/2124842828 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c00ca00 con 0x7f71380cf940 2023-11-04T01:39:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f7126ffd640 1 -- 172.21.15.114:0/2124842828 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712c00cb60 con 0x7f71380cf940 2023-11-04T01:39:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f713ccbb640 1 -- 172.21.15.114:0/2124842828 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71300094b0 con 0x7f71380cf940 2023-11-04T01:39:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f7126ffd640 1 -- 172.21.15.114:0/2124842828 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c013470 con 0x7f71380cf940 2023-11-04T01:39:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.179+0000 7f713ccbb640 1 -- 172.21.15.114:0/2124842828 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71381e4bc0 con 0x7f71380cf940 2023-11-04T01:39:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.180+0000 7f713ccbb640 1 -- 172.21.15.114:0/2124842828 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7138074290 con 0x7f71380cf940 2023-11-04T01:39:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.181+0000 7f7126ffd640 1 -- 172.21.15.114:0/2124842828 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f712c0135d0 con 0x7f71380cf940 2023-11-04T01:39:15.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.181+0000 7f7126ffd640 1 --2- 172.21.15.114:0/2124842828 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f711806ae70 0x7f711806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.181+0000 7f713659c640 1 --2- 172.21.15.114:0/2124842828 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f711806ae70 0x7f711806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.181+0000 7f7126ffd640 1 -- 172.21.15.114:0/2124842828 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f712c089b40 con 0x7f71380cf940 2023-11-04T01:39:15.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.182+0000 7f713659c640 1 --2- 172.21.15.114:0/2124842828 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f711806ae70 0x7f711806d330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7128007fd0 tx=0x7f7128009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.185+0000 7f7126ffd640 1 -- 172.21.15.114:0/2124842828 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f712c054900 con 0x7f71380cf940 2023-11-04T01:39:15.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.413+0000 7f713ccbb640 1 -- 172.21.15.114:0/2124842828 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]} v 0) v1 -- 0x7f7138071060 con 0x7f71380cf940 2023-11-04T01:39:15.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.600+0000 7f7126ffd640 1 -- 172.21.15.114:0/2124842828 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]}]=0 v176) v1 ==== 151+0+0 (secure 0 0 0) 0x7f712c057f20 con 0x7f71380cf940 2023-11-04T01:39:15.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.601+0000 7f713ccbb640 1 -- 172.21.15.114:0/2124842828 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f711806ae70 msgr2=0x7f711806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.601+0000 7f713ccbb640 1 --2- 172.21.15.114:0/2124842828 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f711806ae70 0x7f711806d330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7128007fd0 tx=0x7f7128009040 comp rx=0 tx=0).stop 2023-11-04T01:39:15.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.601+0000 7f713ccbb640 1 -- 172.21.15.114:0/2124842828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71380cf940 msgr2=0x7f71381f3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.601+0000 7f713ccbb640 1 --2- 172.21.15.114:0/2124842828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71380cf940 0x7f71381f3ce0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f712c00e910 tx=0x7f712c00edd0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.601+0000 7f713ccbb640 1 -- 172.21.15.114:0/2124842828 shutdown_connections 2023-11-04T01:39:15.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.601+0000 7f713ccbb640 1 --2- 172.21.15.114:0/2124842828 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f713815af30 0x7f71381e50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.601+0000 7f713ccbb640 1 --2- 172.21.15.114:0/2124842828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71380cf940 0x7f71381f3ce0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.601+0000 7f713ccbb640 1 --2- 172.21.15.114:0/2124842828 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f711806ae70 0x7f711806d330 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.602+0000 7f713ccbb640 1 --2- 172.21.15.114:0/2124842828 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f71380ca030 0x7f71380afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.602+0000 7f713ccbb640 1 -- 172.21.15.114:0/2124842828 >> 172.21.15.114:0/2124842828 conn(0x7f71380cee20 msgr2=0x7f71380b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:15.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.602+0000 7f713ccbb640 1 -- 172.21.15.114:0/2124842828 shutdown_connections 2023-11-04T01:39:15.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.602+0000 7f713ccbb640 1 -- 172.21.15.114:0/2124842828 wait complete. 2023-11-04T01:39:15.615 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:39:15.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.715+0000 7f0270ae0640 1 Processor -- start 2023-11-04T01:39:15.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.715+0000 7f0270ae0640 1 -- start start 2023-11-04T01:39:15.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.716+0000 7f0270ae0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f026c0cd6d0 0x7f026c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.716+0000 7f0270ae0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026c0cde60 con 0x7f026c153e60 2023-11-04T01:39:15.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.716+0000 7f0270ae0640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026c160f90 con 0x7f026c0b4880 2023-11-04T01:39:15.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.716+0000 7f0270ae0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c161960 con 0x7f026c0cd6d0 2023-11-04T01:39:15.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.716+0000 7f026a59c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f026c153e60 0x7f026c15dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51200/0 (socket says 172.21.15.114:51200) 2023-11-04T01:39:15.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.716+0000 7f026a59c640 1 -- 172.21.15.114:0/278258898 learned_addr learned my addr 172.21.15.114:0/278258898 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:15.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f0269d9b640 1 --2- 172.21.15.114:0/278258898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f026c0cd6d0 0x7f026c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026959a640 1 -- 172.21.15.114:0/278258898 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67241602 0 0) 0x7f026c0cde60 con 0x7f026c153e60 2023-11-04T01:39:15.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026959a640 1 -- 172.21.15.114:0/278258898 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0254003520 con 0x7f026c153e60 2023-11-04T01:39:15.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026959a640 1 -- 172.21.15.114:0/278258898 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 360574708 0 0) 0x7f0254003520 con 0x7f026c153e60 2023-11-04T01:39:15.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026959a640 1 -- 172.21.15.114:0/278258898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f026c0cd6d0 msgr2=0x7f026c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:15.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026959a640 1 --2- 172.21.15.114:0/278258898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f026c0cd6d0 0x7f026c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026959a640 1 -- 172.21.15.114:0/278258898 >> v1:172.21.15.141:6789/0 conn(0x7f026c0b4880 legacy=0x7f026c0b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026959a640 1 -- 172.21.15.114:0/278258898 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c0ce090 con 0x7f026c153e60 2023-11-04T01:39:15.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026959a640 1 -- 172.21.15.114:0/278258898 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f025c0019f0 con 0x7f026c153e60 2023-11-04T01:39:15.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026959a640 1 -- 172.21.15.114:0/278258898 >> v1:172.21.15.114:6789/0 conn(0x7f026c153e60 legacy=0x7f026c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026959a640 1 --2- 172.21.15.114:0/278258898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02540039a0 0x7f0254003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026959a640 1 --2- 172.21.15.114:0/278258898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f026c0cd6d0 0x7f02540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026959a640 1 --2- 172.21.15.114:0/278258898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0254004d00 0x7f0254005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026959a640 1 -- 172.21.15.114:0/278258898 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c161960 con 0x7f02540039a0 2023-11-04T01:39:15.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026959a640 1 -- 172.21.15.114:0/278258898 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025400b9b0 con 0x7f0254004d00 2023-11-04T01:39:15.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026959a640 1 -- 172.21.15.114:0/278258898 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025400bb70 con 0x7f026c0cd6d0 2023-11-04T01:39:15.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026a59c640 1 --2- 172.21.15.114:0/278258898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02540039a0 0x7f0254003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f0269d9b640 1 --2- 172.21.15.114:0/278258898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f026c0cd6d0 0x7f02540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026ad9d640 1 --2- 172.21.15.114:0/278258898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0254004d00 0x7f0254005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026a59c640 1 -- 172.21.15.114:0/278258898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f026c0cd6d0 msgr2=0x7f02540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:15.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026a59c640 1 --2- 172.21.15.114:0/278258898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f026c0cd6d0 0x7f02540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026a59c640 1 -- 172.21.15.114:0/278258898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0254004d00 msgr2=0x7f0254005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:15.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026a59c640 1 --2- 172.21.15.114:0/278258898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0254004d00 0x7f0254005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026a59c640 1 -- 172.21.15.114:0/278258898 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0254003520 con 0x7f02540039a0 2023-11-04T01:39:15.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.717+0000 7f026ad9d640 1 --2- 172.21.15.114:0/278258898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0254004d00 0x7f0254005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:15.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.718+0000 7f026a59c640 1 --2- 172.21.15.114:0/278258898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02540039a0 0x7f0254003d80 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f025c00a840 tx=0x7f02540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0a1984cffb315b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.718+0000 7f026959a640 1 -- 172.21.15.114:0/278258898 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c034630 con 0x7f02540039a0 2023-11-04T01:39:15.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.718+0000 7f026959a640 1 -- 172.21.15.114:0/278258898 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c02f070 con 0x7f02540039a0 2023-11-04T01:39:15.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.718+0000 7f026959a640 1 -- 172.21.15.114:0/278258898 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c0349d0 con 0x7f02540039a0 2023-11-04T01:39:15.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.719+0000 7f0270ae0640 1 -- 172.21.15.114:0/278258898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02540039a0 msgr2=0x7f0254003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.719+0000 7f0270ae0640 1 --2- 172.21.15.114:0/278258898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02540039a0 0x7f0254003d80 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f025c00a840 tx=0x7f02540057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.719+0000 7f026ad9d640 1 -- 172.21.15.114:0/278258898 reap_dead start 2023-11-04T01:39:15.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.719+0000 7f0270ae0640 1 -- 172.21.15.114:0/278258898 shutdown_connections 2023-11-04T01:39:15.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.719+0000 7f0270ae0640 1 -- 172.21.15.114:0/278258898 >> 172.21.15.114:0/278258898 conn(0x7f026c0cf880 msgr2=0x7f026c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:15.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.719+0000 7f0270ae0640 1 -- 172.21.15.114:0/278258898 shutdown_connections 2023-11-04T01:39:15.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.719+0000 7f0270ae0640 1 -- 172.21.15.114:0/278258898 wait complete. 2023-11-04T01:39:15.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.720+0000 7f0270ae0640 1 Processor -- start 2023-11-04T01:39:15.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.720+0000 7f0270ae0640 1 -- start start 2023-11-04T01:39:15.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f0270ae0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02540039a0 0x7f026c150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f0270ae0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c0c90e0 0x7f026c0c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f0270ae0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f026c0ca770 0x7f026c15eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f0270ae0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0c8870 con 0x7f026c0c90e0 2023-11-04T01:39:15.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f0270ae0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0c82b0 con 0x7f026c0ca770 2023-11-04T01:39:15.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f0270ae0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0c8590 con 0x7f02540039a0 2023-11-04T01:39:15.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f0269d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c0c90e0 0x7f026c0c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f0269d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c0c90e0 0x7f026c0c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45914/0 (socket says 172.21.15.114:45914) 2023-11-04T01:39:15.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f0269d9b640 1 -- 172.21.15.114:0/1100316871 learned_addr learned my addr 172.21.15.114:0/1100316871 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:15.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f026a59c640 1 --2- 172.21.15.114:0/1100316871 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02540039a0 0x7f026c150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f0269d9b640 1 -- 172.21.15.114:0/1100316871 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02540039a0 msgr2=0x7f026c150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f0269d9b640 1 --2- 172.21.15.114:0/1100316871 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02540039a0 0x7f026c150690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f0269d9b640 1 -- 172.21.15.114:0/1100316871 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f026c0ca770 msgr2=0x7f026c15eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f0269d9b640 1 --2- 172.21.15.114:0/1100316871 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f026c0ca770 0x7f026c15eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f0269d9b640 1 -- 172.21.15.114:0/1100316871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c0c9f70 con 0x7f026c0c90e0 2023-11-04T01:39:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f0269d9b640 1 --2- 172.21.15.114:0/1100316871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c0c90e0 0x7f026c0c7940 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0260011600 tx=0x7f0260011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.721+0000 7f025affd640 1 -- 172.21.15.114:0/1100316871 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260015870 con 0x7f026c0c90e0 2023-11-04T01:39:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.722+0000 7f025affd640 1 -- 172.21.15.114:0/1100316871 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02600159d0 con 0x7f026c0c90e0 2023-11-04T01:39:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.722+0000 7f0270ae0640 1 -- 172.21.15.114:0/1100316871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026c0ca250 con 0x7f026c0c90e0 2023-11-04T01:39:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.722+0000 7f025affd640 1 -- 172.21.15.114:0/1100316871 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260015d40 con 0x7f026c0c90e0 2023-11-04T01:39:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.722+0000 7f0270ae0640 1 -- 172.21.15.114:0/1100316871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026c0c8060 con 0x7f026c0c90e0 2023-11-04T01:39:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.723+0000 7f0270ae0640 1 -- 172.21.15.114:0/1100316871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026c074290 con 0x7f026c0c90e0 2023-11-04T01:39:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.723+0000 7f025affd640 1 -- 172.21.15.114:0/1100316871 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f026000f490 con 0x7f026c0c90e0 2023-11-04T01:39:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.723+0000 7f025affd640 1 --2- 172.21.15.114:0/1100316871 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f024c06aea0 0x7f024c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:15.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.723+0000 7f025affd640 1 -- 172.21.15.114:0/1100316871 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f0260089bb0 con 0x7f026c0c90e0 2023-11-04T01:39:15.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.723+0000 7f026a59c640 1 --2- 172.21.15.114:0/1100316871 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f024c06aea0 0x7f024c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:15.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.724+0000 7f026a59c640 1 --2- 172.21.15.114:0/1100316871 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f024c06aea0 0x7f024c06d360 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f025c034000 tx=0x7f025c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:15.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.728+0000 7f025affd640 1 -- 172.21.15.114:0/1100316871 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02600549f0 con 0x7f026c0c90e0 2023-11-04T01:39:15.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.898+0000 7f0270ae0640 1 -- 172.21.15.114:0/1100316871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f026c0d0b80 con 0x7f026c0c90e0 2023-11-04T01:39:15.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.903+0000 7f025affd640 1 -- 172.21.15.114:0/1100316871 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v17)=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f02600220c0 con 0x7f026c0c90e0 2023-11-04T01:39:15.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.905+0000 7f0270ae0640 1 -- 172.21.15.114:0/1100316871 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f024c06aea0 msgr2=0x7f024c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.905+0000 7f0270ae0640 1 --2- 172.21.15.114:0/1100316871 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f024c06aea0 0x7f024c06d360 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f025c034000 tx=0x7f025c02f000 comp rx=0 tx=0).stop 2023-11-04T01:39:15.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.905+0000 7f0270ae0640 1 -- 172.21.15.114:0/1100316871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c0c90e0 msgr2=0x7f026c0c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:15.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.905+0000 7f0270ae0640 1 --2- 172.21.15.114:0/1100316871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c0c90e0 0x7f026c0c7940 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0260011600 tx=0x7f0260011ac0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.905+0000 7f0270ae0640 1 -- 172.21.15.114:0/1100316871 shutdown_connections 2023-11-04T01:39:15.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.905+0000 7f0270ae0640 1 --2- 172.21.15.114:0/1100316871 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f024c06aea0 0x7f024c06d360 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.905+0000 7f0270ae0640 1 --2- 172.21.15.114:0/1100316871 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f026c0ca770 0x7f026c15eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.905+0000 7f0270ae0640 1 --2- 172.21.15.114:0/1100316871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f026c0c90e0 0x7f026c0c7940 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.905+0000 7f0270ae0640 1 --2- 172.21.15.114:0/1100316871 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02540039a0 0x7f026c150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:15.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.905+0000 7f0270ae0640 1 -- 172.21.15.114:0/1100316871 >> 172.21.15.114:0/1100316871 conn(0x7f026c0cf880 msgr2=0x7f026c0d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:15.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.905+0000 7f0270ae0640 1 -- 172.21.15.114:0/1100316871 shutdown_connections 2023-11-04T01:39:15.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:15.905+0000 7f0270ae0640 1 -- 172.21.15.114:0/1100316871 wait complete. 2023-11-04T01:39:15.917 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:39:15.918 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:39:15.968 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:39:16.011 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:39:16.011 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:39:16.011 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:16.026 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:39:16.027 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:39:16.027 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:16.068 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:39:16.068 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:39:16.068 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:16.083 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:39:16.083 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:39:16.083 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:16.125 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:39:16.126 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:39:16.126 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.223+0000 7f483f864640 1 Processor -- start 2023-11-04T01:39:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.224+0000 7f483f864640 1 -- start start 2023-11-04T01:39:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.224+0000 7f483f864640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f48380cde60 0x7f483815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.224+0000 7f483f864640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f483815daa0 0x7f4838157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.224+0000 7f483f864640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483815e000 con 0x7f48380ce240 2023-11-04T01:39:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.224+0000 7f483f864640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483815e5c0 con 0x7f483815daa0 2023-11-04T01:39:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.224+0000 7f483f864640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483815e2e0 con 0x7f48380cde60 2023-11-04T01:39:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.225+0000 7f483cdff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f483815daa0 0x7f4838157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.225+0000 7f483cdff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f483815daa0 0x7f4838157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45928/0 (socket says 172.21.15.114:45928) 2023-11-04T01:39:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.225+0000 7f483cdff640 1 -- 172.21.15.114:0/492150828 learned_addr learned my addr 172.21.15.114:0/492150828 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.225+0000 7f483d600640 1 --2- 172.21.15.114:0/492150828 >> v2:172.21.15.141:3300/0 conn(0x7f48380cde60 0x7f483815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.225+0000 7f483cdff640 1 -- 172.21.15.114:0/492150828 >> v2:172.21.15.141:3300/0 conn(0x7f48380cde60 msgr2=0x7f483815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.225+0000 7f483cdff640 1 --2- 172.21.15.114:0/492150828 >> v2:172.21.15.141:3300/0 conn(0x7f48380cde60 0x7f483815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.225+0000 7f483cdff640 1 -- 172.21.15.114:0/492150828 >> v1:172.21.15.114:6789/0 conn(0x7f48380ce240 legacy=0x7f483806b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.225+0000 7f483cdff640 1 -- 172.21.15.114:0/492150828 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48380d1120 con 0x7f483815daa0 2023-11-04T01:39:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.225+0000 7f482ffff640 1 -- 172.21.15.114:0/492150828 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616471038 0 0) 0x7f483815e000 con 0x7f48380ce240 2023-11-04T01:39:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.225+0000 7f483d600640 1 --2- 172.21.15.114:0/492150828 >> v2:172.21.15.141:3300/0 conn(0x7f48380cde60 0x7f483815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.226+0000 7f483cdff640 1 --2- 172.21.15.114:0/492150828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f483815daa0 0x7f4838157000 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f48380b5550 tx=0x7f482802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24410943c2b3a6a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.226+0000 7f482ffff640 1 -- 172.21.15.114:0/492150828 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828030860 con 0x7f483815daa0 2023-11-04T01:39:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.226+0000 7f482ffff640 1 -- 172.21.15.114:0/492150828 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48280309c0 con 0x7f483815daa0 2023-11-04T01:39:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.226+0000 7f482ffff640 1 -- 172.21.15.114:0/492150828 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828030d50 con 0x7f483815daa0 2023-11-04T01:39:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.226+0000 7f483f864640 1 -- 172.21.15.114:0/492150828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f483815daa0 msgr2=0x7f4838157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.226+0000 7f483f864640 1 --2- 172.21.15.114:0/492150828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f483815daa0 0x7f4838157000 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f48380b5550 tx=0x7f482802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.227+0000 7f483f864640 1 -- 172.21.15.114:0/492150828 shutdown_connections 2023-11-04T01:39:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.227+0000 7f483f864640 1 --2- 172.21.15.114:0/492150828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f483815daa0 0x7f4838157000 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.227+0000 7f483f864640 1 --2- 172.21.15.114:0/492150828 >> v2:172.21.15.141:3300/0 conn(0x7f48380cde60 0x7f483815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.227+0000 7f483f864640 1 -- 172.21.15.114:0/492150828 >> 172.21.15.114:0/492150828 conn(0x7f4838071f30 msgr2=0x7f48380cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.227+0000 7f483f864640 1 -- 172.21.15.114:0/492150828 shutdown_connections 2023-11-04T01:39:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.227+0000 7f483f864640 1 -- 172.21.15.114:0/492150828 wait complete. 2023-11-04T01:39:16.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.228+0000 7f483f864640 1 Processor -- start 2023-11-04T01:39:16.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.228+0000 7f483f864640 1 -- start start 2023-11-04T01:39:16.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483f864640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48380cde60 0x7f483814adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483f864640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48380ce240 0x7f48380ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483f864640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f483815daa0 0x7f4838151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483f864640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48380cd350 con 0x7f48380ce240 2023-11-04T01:39:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483f864640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483814b330 con 0x7f48380cde60 2023-11-04T01:39:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483f864640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48380cc740 con 0x7f483815daa0 2023-11-04T01:39:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483cdff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48380ce240 0x7f48380ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483cdff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48380ce240 0x7f48380ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45942/0 (socket says 172.21.15.114:45942) 2023-11-04T01:39:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483cdff640 1 -- 172.21.15.114:0/3013862657 learned_addr learned my addr 172.21.15.114:0/3013862657 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483d600640 1 --2- 172.21.15.114:0/3013862657 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48380cde60 0x7f483814adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483de01640 1 --2- 172.21.15.114:0/3013862657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f483815daa0 0x7f4838151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483cdff640 1 -- 172.21.15.114:0/3013862657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f483815daa0 msgr2=0x7f4838151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483cdff640 1 --2- 172.21.15.114:0/3013862657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f483815daa0 0x7f4838151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483cdff640 1 -- 172.21.15.114:0/3013862657 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48380cde60 msgr2=0x7f483814adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483cdff640 1 --2- 172.21.15.114:0/3013862657 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48380cde60 0x7f483814adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483cdff640 1 -- 172.21.15.114:0/3013862657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48280094d0 con 0x7f48380ce240 2023-11-04T01:39:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483de01640 1 --2- 172.21.15.114:0/3013862657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f483815daa0 0x7f4838151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483cdff640 1 --2- 172.21.15.114:0/3013862657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48380ce240 0x7f48380ca900 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f4828000c00 tx=0x7f4828004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f482dffb640 1 -- 172.21.15.114:0/3013862657 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828030830 con 0x7f48380ce240 2023-11-04T01:39:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f482dffb640 1 -- 172.21.15.114:0/3013862657 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4828039d90 con 0x7f48380ce240 2023-11-04T01:39:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483f864640 1 -- 172.21.15.114:0/3013862657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48380cca20 con 0x7f48380ce240 2023-11-04T01:39:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f482dffb640 1 -- 172.21.15.114:0/3013862657 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828043630 con 0x7f48380ce240 2023-11-04T01:39:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.229+0000 7f483f864640 1 -- 172.21.15.114:0/3013862657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48380ccfe0 con 0x7f48380ce240 2023-11-04T01:39:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.231+0000 7f483f864640 1 -- 172.21.15.114:0/3013862657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4838074290 con 0x7f48380ce240 2023-11-04T01:39:16.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.231+0000 7f482dffb640 1 -- 172.21.15.114:0/3013862657 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f482804c3b0 con 0x7f48380ce240 2023-11-04T01:39:16.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.231+0000 7f482dffb640 1 --2- 172.21.15.114:0/3013862657 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f481c06ae70 0x7f481c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.231+0000 7f482dffb640 1 -- 172.21.15.114:0/3013862657 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f48280abf30 con 0x7f48380ce240 2023-11-04T01:39:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.231+0000 7f483d600640 1 --2- 172.21.15.114:0/3013862657 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f481c06ae70 0x7f481c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.232+0000 7f483d600640 1 --2- 172.21.15.114:0/3013862657 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f481c06ae70 0x7f481c06d330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f483400a990 tx=0x7f4834008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.235+0000 7f482dffb640 1 -- 172.21.15.114:0/3013862657 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4828076e00 con 0x7f48380ce240 2023-11-04T01:39:16.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.434+0000 7f483f864640 1 -- 172.21.15.114:0/3013862657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48380d3a10 con 0x7f48380ce240 2023-11-04T01:39:16.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.435+0000 7f482dffb640 1 -- 172.21.15.114:0/3013862657 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f482807a420 con 0x7f48380ce240 2023-11-04T01:39:16.437 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:16.437 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":31,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5456,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1515559056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1515559056},{"type":"v1","addr":"172.21.15.141:6834","nonce":1515559056}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":5731,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/4055552299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":4055552299},{"type":"v1","addr":"172.21.15.141:6835","nonce":4055552299}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6471,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/4254364199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":4254364199},{"type":"v1","addr":"172.21.15.114:6836","nonce":4254364199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6474,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3499206733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3499206733},{"type":"v1","addr":"172.21.15.114:6837","nonce":3499206733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[]} 2023-11-04T01:39:16.437 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 31 2023-11-04T01:39:16.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.437+0000 7f483f864640 1 -- 172.21.15.114:0/3013862657 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f481c06ae70 msgr2=0x7f481c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.437+0000 7f483f864640 1 --2- 172.21.15.114:0/3013862657 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f481c06ae70 0x7f481c06d330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f483400a990 tx=0x7f4834008040 comp rx=0 tx=0).stop 2023-11-04T01:39:16.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.437+0000 7f483f864640 1 -- 172.21.15.114:0/3013862657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48380ce240 msgr2=0x7f48380ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.437+0000 7f483f864640 1 --2- 172.21.15.114:0/3013862657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48380ce240 0x7f48380ca900 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f4828000c00 tx=0x7f4828004730 comp rx=0 tx=0).stop 2023-11-04T01:39:16.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.437+0000 7f483f864640 1 -- 172.21.15.114:0/3013862657 shutdown_connections 2023-11-04T01:39:16.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.437+0000 7f483f864640 1 --2- 172.21.15.114:0/3013862657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f483815daa0 0x7f4838151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.437+0000 7f483f864640 1 --2- 172.21.15.114:0/3013862657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48380ce240 0x7f48380ca900 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.437+0000 7f483f864640 1 --2- 172.21.15.114:0/3013862657 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f481c06ae70 0x7f481c06d330 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.437+0000 7f483f864640 1 --2- 172.21.15.114:0/3013862657 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48380cde60 0x7f483814adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.437+0000 7f483f864640 1 -- 172.21.15.114:0/3013862657 >> 172.21.15.114:0/3013862657 conn(0x7f4838071f30 msgr2=0x7f48380d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:16.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.437+0000 7f483f864640 1 -- 172.21.15.114:0/3013862657 shutdown_connections 2023-11-04T01:39:16.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.437+0000 7f483f864640 1 -- 172.21.15.114:0/3013862657 wait complete. 2023-11-04T01:39:16.449 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:39:16.450 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:39:16.450 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:39:16.450 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:16.450 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:39:16.450 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:39:16.450 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:39:16.450 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:16.451 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:39:16.451 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:39:16.451 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:39:16.451 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:16.451 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:39:16.451 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:39:16.452 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:39:16.452 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:16.459 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:39:16.459 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:39:16.460 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:39:16.460 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:39:16.464 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:39:16.464 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:39:16.465 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:39:16.465 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:39:16.502 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:39:16.503 DEBUG:teuthology.parallel:result is None 2023-11-04T01:39:16.503 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:39:16.503 DEBUG:teuthology.parallel:result is None 2023-11-04T01:39:16.506 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:39:16.507 DEBUG:teuthology.parallel:result is None 2023-11-04T01:39:16.507 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:39:16.507 DEBUG:teuthology.parallel:result is None 2023-11-04T01:39:16.508 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:39:16.578 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2023-11-04T01:39:16.579 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2023-11-04T01:39:16.591 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-04T01:39:16.592 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-04T01:39:16.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.612+0000 7f9fdb16c640 1 Processor -- start 2023-11-04T01:39:16.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.612+0000 7f9fdb16c640 1 -- start start 2023-11-04T01:39:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.613+0000 7f9fdb16c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9fd40cc520 0x7f9fd4070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.613+0000 7f9fdb16c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9fd40cc9a0 0x7f9fd40714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.613+0000 7f9fdb16c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd40c3860 con 0x7f9fd4153850 2023-11-04T01:39:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.613+0000 7f9fdb16c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd40c9250 con 0x7f9fd40cc9a0 2023-11-04T01:39:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.613+0000 7f9fdb16c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd4153c30 con 0x7f9fd40cc520 2023-11-04T01:39:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.613+0000 7f9fd9709640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9fd40cc9a0 0x7f9fd40714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.613+0000 7f9fd9709640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9fd40cc9a0 0x7f9fd40714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32884/0 (socket says 172.21.15.114:32884) 2023-11-04T01:39:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.613+0000 7f9fd9709640 1 -- 172.21.15.114:0/1907060285 learned_addr learned my addr 172.21.15.114:0/1907060285 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.613+0000 7f9fd9709640 1 -- 172.21.15.114:0/1907060285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9fd40cc520 msgr2=0x7f9fd4070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.613+0000 7f9fd9709640 1 --2- 172.21.15.114:0/1907060285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9fd40cc520 0x7f9fd4070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.613+0000 7f9fd9709640 1 -- 172.21.15.114:0/1907060285 >> v1:172.21.15.141:6789/0 conn(0x7f9fd4153850 legacy=0x7f9fd415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.613+0000 7f9fd9709640 1 -- 172.21.15.114:0/1907060285 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd40ce590 con 0x7f9fd40cc9a0 2023-11-04T01:39:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.614+0000 7f9fd9709640 1 --2- 172.21.15.114:0/1907060285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fd40cc9a0 0x7f9fd40714e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00d150 tx=0x7f9fcc02e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da79b59f6f228f32 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.617+0000 7f9fd37fe640 1 -- 172.21.15.114:0/1907060285 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc038400 con 0x7f9fd40cc9a0 2023-11-04T01:39:16.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.617+0000 7f9fd37fe640 1 -- 172.21.15.114:0/1907060285 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc032070 con 0x7f9fd40cc9a0 2023-11-04T01:39:16.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.617+0000 7f9fd37fe640 1 -- 172.21.15.114:0/1907060285 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc038780 con 0x7f9fd40cc9a0 2023-11-04T01:39:16.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.618+0000 7f9fdb16c640 1 -- 172.21.15.114:0/1907060285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fd40cc9a0 msgr2=0x7f9fd40714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.618+0000 7f9fdb16c640 1 --2- 172.21.15.114:0/1907060285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fd40cc9a0 0x7f9fd40714e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00d150 tx=0x7f9fcc02e160 comp rx=0 tx=0).stop 2023-11-04T01:39:16.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.618+0000 7f9fdb16c640 1 -- 172.21.15.114:0/1907060285 shutdown_connections 2023-11-04T01:39:16.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.618+0000 7f9fdb16c640 1 --2- 172.21.15.114:0/1907060285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fd40cc9a0 0x7f9fd40714e0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.618+0000 7f9fdb16c640 1 --2- 172.21.15.114:0/1907060285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9fd40cc520 0x7f9fd4070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.618+0000 7f9fdb16c640 1 -- 172.21.15.114:0/1907060285 >> 172.21.15.114:0/1907060285 conn(0x7f9fd40ce950 msgr2=0x7f9fd40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:16.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.618+0000 7f9fdb16c640 1 -- 172.21.15.114:0/1907060285 shutdown_connections 2023-11-04T01:39:16.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.618+0000 7f9fdb16c640 1 -- 172.21.15.114:0/1907060285 wait complete. 2023-11-04T01:39:16.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.619+0000 7f9fdb16c640 1 Processor -- start 2023-11-04T01:39:16.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.619+0000 7f9fdb16c640 1 -- start start 2023-11-04T01:39:16.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.620+0000 7f9fdb16c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fd40cc520 0x7f9fd41f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.620+0000 7f9fdb16c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9fd40cc9a0 0x7f9fd40b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.620+0000 7f9fdb16c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9fd4153850 0x7f9fd414e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.620+0000 7f9fdb16c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd40ac030 con 0x7f9fd40cc520 2023-11-04T01:39:16.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.620+0000 7f9fdb16c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd40b32d0 con 0x7f9fd4153850 2023-11-04T01:39:16.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.620+0000 7f9fdb16c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd40b3860 con 0x7f9fd40cc9a0 2023-11-04T01:39:16.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.621+0000 7f9fd8f08640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fd40cc520 0x7f9fd41f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.621+0000 7f9fd8f08640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fd40cc520 0x7f9fd41f3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32898/0 (socket says 172.21.15.114:32898) 2023-11-04T01:39:16.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.621+0000 7f9fd8f08640 1 -- 172.21.15.114:0/1773737583 learned_addr learned my addr 172.21.15.114:0/1773737583 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:16.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.621+0000 7f9fd9709640 1 --2- 172.21.15.114:0/1773737583 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9fd4153850 0x7f9fd414e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.621+0000 7f9fd3fff640 1 --2- 172.21.15.114:0/1773737583 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9fd40cc9a0 0x7f9fd40b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.621+0000 7f9fd8f08640 1 -- 172.21.15.114:0/1773737583 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9fd40cc9a0 msgr2=0x7f9fd40b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.621+0000 7f9fd8f08640 1 --2- 172.21.15.114:0/1773737583 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9fd40cc9a0 0x7f9fd40b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.621+0000 7f9fd8f08640 1 -- 172.21.15.114:0/1773737583 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9fd4153850 msgr2=0x7f9fd414e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:16.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.621+0000 7f9fd8f08640 1 --2- 172.21.15.114:0/1773737583 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9fd4153850 0x7f9fd414e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:16.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.621+0000 7f9fd8f08640 1 -- 172.21.15.114:0/1773737583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc00bd40 con 0x7f9fd40cc520 2023-11-04T01:39:16.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.621+0000 7f9fd8f08640 1 --2- 172.21.15.114:0/1773737583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fd40cc520 0x7f9fd41f3750 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800c450 tx=0x7f9fc800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.623+0000 7f9fd17fa640 1 -- 172.21.15.114:0/1773737583 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80052d0 con 0x7f9fd40cc520 2023-11-04T01:39:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.623+0000 7f9fdb16c640 1 -- 172.21.15.114:0/1773737583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd40b3580 con 0x7f9fd40cc520 2023-11-04T01:39:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.623+0000 7f9fd17fa640 1 -- 172.21.15.114:0/1773737583 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc8005430 con 0x7f9fd40cc520 2023-11-04T01:39:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.623+0000 7f9fd17fa640 1 -- 172.21.15.114:0/1773737583 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8012870 con 0x7f9fd40cc520 2023-11-04T01:39:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.623+0000 7f9fdb16c640 1 -- 172.21.15.114:0/1773737583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd40abc50 con 0x7f9fd40cc520 2023-11-04T01:39:16.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.624+0000 7f9fdb16c640 1 -- 172.21.15.114:0/1773737583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd4074290 con 0x7f9fd40cc520 2023-11-04T01:39:16.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.625+0000 7f9fd17fa640 1 -- 172.21.15.114:0/1773737583 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9fc80129d0 con 0x7f9fd40cc520 2023-11-04T01:39:16.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.625+0000 7f9fd17fa640 1 --2- 172.21.15.114:0/1773737583 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9fb806ae70 0x7f9fb806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:16.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.625+0000 7f9fd17fa640 1 -- 172.21.15.114:0/1773737583 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f9fc80892d0 con 0x7f9fd40cc520 2023-11-04T01:39:16.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.625+0000 7f9fd3fff640 1 --2- 172.21.15.114:0/1773737583 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9fb806ae70 0x7f9fb806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:16.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.625+0000 7f9fd3fff640 1 --2- 172.21.15.114:0/1773737583 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9fb806ae70 0x7f9fb806d330 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9fd415a1a0 tx=0x7f9fc0009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:16.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.630+0000 7f9fd17fa640 1 -- 172.21.15.114:0/1773737583 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9fc8054140 con 0x7f9fd40cc520 2023-11-04T01:39:16.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:16.806+0000 7f9fdb16c640 1 -- 172.21.15.114:0/1773737583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9fd40c5010 con 0x7f9fd40cc520 2023-11-04T01:39:17.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.632+0000 7f9fd17fa640 1 -- 172.21.15.114:0/1773737583 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v79) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9fc8057760 con 0x7f9fd40cc520 2023-11-04T01:39:17.634 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2023-11-04T01:39:17.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.635+0000 7f9fdb16c640 1 -- 172.21.15.114:0/1773737583 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9fb806ae70 msgr2=0x7f9fb806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.635+0000 7f9fdb16c640 1 --2- 172.21.15.114:0/1773737583 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9fb806ae70 0x7f9fb806d330 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9fd415a1a0 tx=0x7f9fc0009060 comp rx=0 tx=0).stop 2023-11-04T01:39:17.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.635+0000 7f9fdb16c640 1 -- 172.21.15.114:0/1773737583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fd40cc520 msgr2=0x7f9fd41f3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.635+0000 7f9fdb16c640 1 --2- 172.21.15.114:0/1773737583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fd40cc520 0x7f9fd41f3750 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800c450 tx=0x7f9fc800c910 comp rx=0 tx=0).stop 2023-11-04T01:39:17.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.635+0000 7f9fdb16c640 1 -- 172.21.15.114:0/1773737583 shutdown_connections 2023-11-04T01:39:17.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.635+0000 7f9fdb16c640 1 --2- 172.21.15.114:0/1773737583 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9fb806ae70 0x7f9fb806d330 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.635+0000 7f9fdb16c640 1 --2- 172.21.15.114:0/1773737583 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9fd4153850 0x7f9fd414e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.635+0000 7f9fdb16c640 1 --2- 172.21.15.114:0/1773737583 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9fd40cc9a0 0x7f9fd40b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.635+0000 7f9fdb16c640 1 --2- 172.21.15.114:0/1773737583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fd40cc520 0x7f9fd41f3750 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.635+0000 7f9fdb16c640 1 -- 172.21.15.114:0/1773737583 >> 172.21.15.114:0/1773737583 conn(0x7f9fd40ce950 msgr2=0x7f9fd414f430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:17.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.635+0000 7f9fdb16c640 1 -- 172.21.15.114:0/1773737583 shutdown_connections 2023-11-04T01:39:17.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.635+0000 7f9fdb16c640 1 -- 172.21.15.114:0/1773737583 wait complete. 2023-11-04T01:39:17.651 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:39:17.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.753+0000 7f79d3c9b640 1 Processor -- start 2023-11-04T01:39:17.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.754+0000 7f79d3c9b640 1 -- start start 2023-11-04T01:39:17.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.754+0000 7f79d3c9b640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f79cc15bfb0 0x7f79cc0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.754+0000 7f79d3c9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f79cc0cd860 0x7f79cc0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.754+0000 7f79d3c9b640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79cc0cc450 con 0x7f79cc15ae40 2023-11-04T01:39:17.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.754+0000 7f79d3c9b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79cc15f400 con 0x7f79cc0cd860 2023-11-04T01:39:17.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.754+0000 7f79d3c9b640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79cc15b220 con 0x7f79cc15bfb0 2023-11-04T01:39:17.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.754+0000 7f79d2238640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f79cc0cd860 0x7f79cc0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.754+0000 7f79d2238640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f79cc0cd860 0x7f79cc0ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32910/0 (socket says 172.21.15.114:32910) 2023-11-04T01:39:17.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.754+0000 7f79d2238640 1 -- 172.21.15.114:0/1217750375 learned_addr learned my addr 172.21.15.114:0/1217750375 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:17.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.755+0000 7f79d1236640 1 --2- 172.21.15.114:0/1217750375 >> v2:172.21.15.141:3300/0 conn(0x7f79cc15bfb0 0x7f79cc0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.755+0000 7f79d2238640 1 -- 172.21.15.114:0/1217750375 >> v2:172.21.15.141:3300/0 conn(0x7f79cc15bfb0 msgr2=0x7f79cc0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:17.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.755+0000 7f79d2238640 1 --2- 172.21.15.114:0/1217750375 >> v2:172.21.15.141:3300/0 conn(0x7f79cc15bfb0 0x7f79cc0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.755+0000 7f79d2238640 1 -- 172.21.15.114:0/1217750375 >> v1:172.21.15.141:6789/0 conn(0x7f79cc15ae40 legacy=0x7f79cc0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.755+0000 7f79d2238640 1 -- 172.21.15.114:0/1217750375 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc15f890 con 0x7f79cc0cd860 2023-11-04T01:39:17.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.756+0000 7f79d2238640 1 --2- 172.21.15.114:0/1217750375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79cc0cd860 0x7f79cc0ced70 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0b05d0 tx=0x7f79c402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e64f69673906bb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:17.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.756+0000 7f79d0a35640 1 -- 172.21.15.114:0/1217750375 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4030860 con 0x7f79cc0cd860 2023-11-04T01:39:17.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.756+0000 7f79d0a35640 1 -- 172.21.15.114:0/1217750375 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c40309c0 con 0x7f79cc0cd860 2023-11-04T01:39:17.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.756+0000 7f79d0a35640 1 -- 172.21.15.114:0/1217750375 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4030d50 con 0x7f79cc0cd860 2023-11-04T01:39:17.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.756+0000 7f79d3c9b640 1 -- 172.21.15.114:0/1217750375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79cc0cd860 msgr2=0x7f79cc0ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.756+0000 7f79d3c9b640 1 --2- 172.21.15.114:0/1217750375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79cc0cd860 0x7f79cc0ced70 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0b05d0 tx=0x7f79c402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.756+0000 7f79d3c9b640 1 -- 172.21.15.114:0/1217750375 shutdown_connections 2023-11-04T01:39:17.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.756+0000 7f79d3c9b640 1 --2- 172.21.15.114:0/1217750375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79cc0cd860 0x7f79cc0ced70 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.756+0000 7f79d3c9b640 1 --2- 172.21.15.114:0/1217750375 >> v2:172.21.15.141:3300/0 conn(0x7f79cc15bfb0 0x7f79cc0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.756+0000 7f79d3c9b640 1 -- 172.21.15.114:0/1217750375 >> 172.21.15.114:0/1217750375 conn(0x7f79cc06ea90 msgr2=0x7f79cc06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:17.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.756+0000 7f79d3c9b640 1 -- 172.21.15.114:0/1217750375 shutdown_connections 2023-11-04T01:39:17.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.756+0000 7f79d3c9b640 1 -- 172.21.15.114:0/1217750375 wait complete. 2023-11-04T01:39:17.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.757+0000 7f79d3c9b640 1 Processor -- start 2023-11-04T01:39:17.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.758+0000 7f79d3c9b640 1 -- start start 2023-11-04T01:39:17.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.758+0000 7f79d3c9b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79cc0cd860 0x7f79cc14f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.758+0000 7f79d3c9b640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f79cc15ae40 0x7f79cc0c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.758+0000 7f79d3c9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79cc15bfb0 0x7f79cc0b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.758+0000 7f79d3c9b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0c6030 con 0x7f79cc15bfb0 2023-11-04T01:39:17.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.758+0000 7f79d3c9b640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0ca1b0 con 0x7f79cc15ae40 2023-11-04T01:39:17.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.758+0000 7f79d3c9b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0ca490 con 0x7f79cc0cd860 2023-11-04T01:39:17.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.758+0000 7f79d2238640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79cc15bfb0 0x7f79cc0b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.758+0000 7f79d2238640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79cc15bfb0 0x7f79cc0b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32914/0 (socket says 172.21.15.114:32914) 2023-11-04T01:39:17.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.758+0000 7f79d2238640 1 -- 172.21.15.114:0/307818154 learned_addr learned my addr 172.21.15.114:0/307818154 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:17.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.758+0000 7f79d1236640 1 --2- 172.21.15.114:0/307818154 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f79cc15ae40 0x7f79cc0c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.758+0000 7f79d1a37640 1 --2- 172.21.15.114:0/307818154 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79cc0cd860 0x7f79cc14f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.759+0000 7f79d2238640 1 -- 172.21.15.114:0/307818154 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79cc0cd860 msgr2=0x7f79cc14f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.759+0000 7f79d2238640 1 --2- 172.21.15.114:0/307818154 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79cc0cd860 0x7f79cc14f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.759+0000 7f79d2238640 1 -- 172.21.15.114:0/307818154 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f79cc15ae40 msgr2=0x7f79cc0c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:17.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.759+0000 7f79d2238640 1 --2- 172.21.15.114:0/307818154 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f79cc15ae40 0x7f79cc0c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:17.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.759+0000 7f79d2238640 1 -- 172.21.15.114:0/307818154 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c40094d0 con 0x7f79cc15bfb0 2023-11-04T01:39:17.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.759+0000 7f79d2238640 1 --2- 172.21.15.114:0/307818154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79cc15bfb0 0x7f79cc0b5c50 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f79c40090b0 tx=0x7f79c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:17.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.759+0000 7f79c27fc640 1 -- 172.21.15.114:0/307818154 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4039c90 con 0x7f79cc15bfb0 2023-11-04T01:39:17.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.759+0000 7f79c27fc640 1 -- 172.21.15.114:0/307818154 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c4039df0 con 0x7f79cc15bfb0 2023-11-04T01:39:17.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.759+0000 7f79d3c9b640 1 -- 172.21.15.114:0/307818154 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79cc0ca770 con 0x7f79cc15bfb0 2023-11-04T01:39:17.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.759+0000 7f79c27fc640 1 -- 172.21.15.114:0/307818154 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4043640 con 0x7f79cc15bfb0 2023-11-04T01:39:17.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.759+0000 7f79d3c9b640 1 -- 172.21.15.114:0/307818154 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79cc0c7d20 con 0x7f79cc15bfb0 2023-11-04T01:39:17.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.760+0000 7f79d3c9b640 1 -- 172.21.15.114:0/307818154 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79cc0ce2d0 con 0x7f79cc15bfb0 2023-11-04T01:39:17.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.760+0000 7f79c27fc640 1 -- 172.21.15.114:0/307818154 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f79c40437a0 con 0x7f79cc15bfb0 2023-11-04T01:39:17.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.761+0000 7f79c27fc640 1 --2- 172.21.15.114:0/307818154 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f79b006ae70 0x7f79b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:17.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.761+0000 7f79c27fc640 1 -- 172.21.15.114:0/307818154 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f79c403e070 con 0x7f79cc15bfb0 2023-11-04T01:39:17.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.761+0000 7f79d1a37640 1 --2- 172.21.15.114:0/307818154 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f79b006ae70 0x7f79b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:17.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.761+0000 7f79d1a37640 1 --2- 172.21.15.114:0/307818154 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f79b006ae70 0x7f79b006d330 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0b2c70 tx=0x7f79c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:17.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.765+0000 7f79c27fc640 1 -- 172.21.15.114:0/307818154 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79c40777c0 con 0x7f79cc15bfb0 2023-11-04T01:39:17.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.997+0000 7f79d3c9b640 1 -- 172.21.15.114:0/307818154 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f79cc06d3f0 con 0x7f79cc15bfb0 2023-11-04T01:39:17.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.997+0000 7f79c27fc640 1 -- 172.21.15.114:0/307818154 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f79cc06d3f0 con 0x7f79cc15bfb0 2023-11-04T01:39:17.999 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:17.999 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:39:17.999 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2023-11-04T01:39:17.999 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.000 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2023-11-04T01:39:18.000 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0VlswblMRAAotQqAxFKxonbXL/aDdoEPw==", 2023-11-04T01:39:18.000 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.000 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:39:18.000 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:39:18.000 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:39:18.000 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:18.000 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.000 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.000 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.001 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2023-11-04T01:39:18.001 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VluZGwAhAAZPVNOe2pR5yFwajeNFbXzw==", 2023-11-04T01:39:18.001 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.001 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:39:18.001 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:39:18.001 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:39:18.001 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:18.001 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.001 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.001 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.001 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2023-11-04T01:39:18.002 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0VlUsc9ORAAmZhkDVK2hR4wbky+cLfo+A==", 2023-11-04T01:39:18.002 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.002 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:39:18.002 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:39:18.002 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:39:18.002 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:18.002 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.002 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.002 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.002 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2023-11-04T01:39:18.003 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VlfxP9CRAAQppp4Lmc1v2xMGYc/AD7pA==", 2023-11-04T01:39:18.003 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.003 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:39:18.003 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:39:18.003 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:39:18.003 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:18.003 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.003 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.003 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.003 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2023-11-04T01:39:18.003 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDdn0Vl/xmgMBAANQCw5RUd/IlxHaDvCz2Gbg==", 2023-11-04T01:39:18.004 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.004 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:18.004 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:39:18.004 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:18.004 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.004 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.005 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.005 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2023-11-04T01:39:18.005 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDgn0VlTpuDLxAAf5vdQMiWBcLfx0Vf8Petyg==", 2023-11-04T01:39:18.005 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.005 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:18.005 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:39:18.005 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:18.005 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.005 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.006 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.006 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2023-11-04T01:39:18.006 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDjn0VlZonFLRAAHJMf/0DasOCeOrz4u8uV2w==", 2023-11-04T01:39:18.006 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.006 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:18.006 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:39:18.006 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:18.006 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.006 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.006 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.007 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2023-11-04T01:39:18.007 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDmn0VlLKK7KxAAKJzogyZTtMzEtAL+LL1V0w==", 2023-11-04T01:39:18.007 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.007 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:18.007 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:39:18.007 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:18.007 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.007 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.007 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2023-11-04T01:39:18.007 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDsn0VlLitpMhAA6ow9uVmS5YtOnqSWSB66ww==", 2023-11-04T01:39:18.008 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.008 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:18.008 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:39:18.008 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:18.008 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.008 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2023-11-04T01:39:18.008 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDvn0VlfkL/MBAA/LYWJLF7F12XMEICf18BwA==", 2023-11-04T01:39:18.008 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.008 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:18.009 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:39:18.009 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:18.009 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.009 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.009 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2023-11-04T01:39:18.009 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDyn0Vl8ZrhLxAAKDbE5KvbWhguLsNNi+3duA==", 2023-11-04T01:39:18.009 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.009 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:18.009 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:39:18.009 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:18.010 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.010 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.010 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.010 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2023-11-04T01:39:18.010 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD1n0Vlues1LhAARQs1LLq8y63wl8nAs8GbGQ==", 2023-11-04T01:39:18.010 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.010 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:18.010 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:39:18.010 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:18.010 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.011 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.011 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2023-11-04T01:39:18.011 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0Vl3QHODhAA6LWlhd+avWYsoYsWMbOiVA==", 2023-11-04T01:39:18.011 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.011 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:39:18.011 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2023-11-04T01:39:18.011 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:39:18.011 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.012 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.012 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2023-11-04T01:39:18.012 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VlRvgLGBAAAAhF9alG2eD5A/xjWXcVWA==", 2023-11-04T01:39:18.012 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.012 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:39:18.012 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-11-04T01:39:18.012 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-11-04T01:39:18.012 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-11-04T01:39:18.012 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.013 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2023-11-04T01:39:18.013 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VlgV6sFBAAxheFKb52kyZly4byr78vfw==", 2023-11-04T01:39:18.013 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.013 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:39:18.013 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-11-04T01:39:18.013 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-11-04T01:39:18.013 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-11-04T01:39:18.013 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.014 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.014 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2023-11-04T01:39:18.014 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VltiLUHRAAY0QtK328vB9H/l8FWCNB4g==", 2023-11-04T01:39:18.014 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.014 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:39:18.014 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-11-04T01:39:18.014 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-11-04T01:39:18.014 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-11-04T01:39:18.014 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.015 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2023-11-04T01:39:18.015 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0Vl3O6UFBAAZpdiB/7sBN6IpvNpe/LoIA==", 2023-11-04T01:39:18.015 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.015 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-11-04T01:39:18.015 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:39:18.015 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:39:18.015 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:18.015 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.016 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2023-11-04T01:39:18.016 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0Vlb1WELhAAcUQ6WxKBsUeJfXvaE+h0GQ==", 2023-11-04T01:39:18.016 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.016 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-11-04T01:39:18.016 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2023-11-04T01:39:18.016 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:18.016 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.016 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:18.016 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:18.016 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2023-11-04T01:39:18.017 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0VluGn6KRAAHsThhoAbKIz+kqF2DYyvkg==", 2023-11-04T01:39:18.017 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:18.017 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-11-04T01:39:18.017 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2023-11-04T01:39:18.017 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:18.017 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.017 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:18.017 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-11-04T01:39:18.017 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:39:18.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.999+0000 7f79d3c9b640 1 -- 172.21.15.114:0/307818154 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f79b006ae70 msgr2=0x7f79b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.999+0000 7f79d3c9b640 1 --2- 172.21.15.114:0/307818154 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f79b006ae70 0x7f79b006d330 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0b2c70 tx=0x7f79c8009040 comp rx=0 tx=0).stop 2023-11-04T01:39:18.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.999+0000 7f79d3c9b640 1 -- 172.21.15.114:0/307818154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79cc15bfb0 msgr2=0x7f79cc0b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.999+0000 7f79d3c9b640 1 --2- 172.21.15.114:0/307818154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79cc15bfb0 0x7f79cc0b5c50 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f79c40090b0 tx=0x7f79c4004730 comp rx=0 tx=0).stop 2023-11-04T01:39:18.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.999+0000 7f79d3c9b640 1 -- 172.21.15.114:0/307818154 shutdown_connections 2023-11-04T01:39:18.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.999+0000 7f79d3c9b640 1 --2- 172.21.15.114:0/307818154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79cc15bfb0 0x7f79cc0b5c50 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.999+0000 7f79d3c9b640 1 --2- 172.21.15.114:0/307818154 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f79b006ae70 0x7f79b006d330 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.999+0000 7f79d3c9b640 1 --2- 172.21.15.114:0/307818154 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f79cc15ae40 0x7f79cc0c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.999+0000 7f79d3c9b640 1 --2- 172.21.15.114:0/307818154 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79cc0cd860 0x7f79cc14f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.999+0000 7f79d3c9b640 1 -- 172.21.15.114:0/307818154 >> 172.21.15.114:0/307818154 conn(0x7f79cc06ea90 msgr2=0x7f79cc0b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.999+0000 7f79d3c9b640 1 -- 172.21.15.114:0/307818154 shutdown_connections 2023-11-04T01:39:18.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:17.999+0000 7f79d3c9b640 1 -- 172.21.15.114:0/307818154 wait complete. 2023-11-04T01:39:18.021 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:18.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.119+0000 7f260ec5d640 1 Processor -- start 2023-11-04T01:39:18.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.119+0000 7f260ec5d640 1 -- start start 2023-11-04T01:39:18.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.119+0000 7f260ec5d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26080ce240 0x7f2608157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.119+0000 7f260ec5d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2608157540 0x7f26080d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.119+0000 7f260ec5d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260815e000 con 0x7f26080cde60 2023-11-04T01:39:18.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.119+0000 7f260ec5d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260815e5c0 con 0x7f2608157540 2023-11-04T01:39:18.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.119+0000 7f260ec5d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260815e2e0 con 0x7f26080ce240 2023-11-04T01:39:18.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.120+0000 7f260d1fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2608157540 0x7f26080d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.120+0000 7f260c9f9640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f26080cde60 0x7f260815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53198/0 (socket says 172.21.15.114:53198) 2023-11-04T01:39:18.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.120+0000 7f260c9f9640 1 -- 172.21.15.114:0/3428837943 learned_addr learned my addr 172.21.15.114:0/3428837943 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:18.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.120+0000 7f2607fff640 1 --2- 172.21.15.114:0/3428837943 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26080ce240 0x7f2608157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.120+0000 7f260d1fa640 1 -- 172.21.15.114:0/3428837943 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26080ce240 msgr2=0x7f2608157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.120+0000 7f260d1fa640 1 --2- 172.21.15.114:0/3428837943 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26080ce240 0x7f2608157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.120+0000 7f260d1fa640 1 -- 172.21.15.114:0/3428837943 >> v1:172.21.15.114:6789/0 conn(0x7f26080cde60 legacy=0x7f260815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.120+0000 7f260d1fa640 1 -- 172.21.15.114:0/3428837943 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26080d1120 con 0x7f2608157540 2023-11-04T01:39:18.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.121+0000 7f260d1fa640 1 --2- 172.21.15.114:0/3428837943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2608157540 0x7f26080d1920 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f2600009d90 tx=0x7f260002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c843932e77e00a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.121+0000 7f26077fe640 1 -- 172.21.15.114:0/3428837943 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260002cc50 con 0x7f2608157540 2023-11-04T01:39:18.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.121+0000 7f26077fe640 1 -- 172.21.15.114:0/3428837943 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260002cdb0 con 0x7f2608157540 2023-11-04T01:39:18.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.121+0000 7f26077fe640 1 -- 172.21.15.114:0/3428837943 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600034660 con 0x7f2608157540 2023-11-04T01:39:18.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.121+0000 7f260ec5d640 1 -- 172.21.15.114:0/3428837943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2608157540 msgr2=0x7f26080d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.121+0000 7f260ec5d640 1 --2- 172.21.15.114:0/3428837943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2608157540 0x7f26080d1920 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f2600009d90 tx=0x7f260002bea0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.121+0000 7f260ec5d640 1 -- 172.21.15.114:0/3428837943 shutdown_connections 2023-11-04T01:39:18.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.121+0000 7f260ec5d640 1 --2- 172.21.15.114:0/3428837943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2608157540 0x7f26080d1920 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.121+0000 7f260ec5d640 1 --2- 172.21.15.114:0/3428837943 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26080ce240 0x7f2608157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.121+0000 7f260ec5d640 1 -- 172.21.15.114:0/3428837943 >> 172.21.15.114:0/3428837943 conn(0x7f2608071f30 msgr2=0x7f26080cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.121+0000 7f260ec5d640 1 -- 172.21.15.114:0/3428837943 shutdown_connections 2023-11-04T01:39:18.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.121+0000 7f260ec5d640 1 -- 172.21.15.114:0/3428837943 wait complete. 2023-11-04T01:39:18.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.122+0000 7f260ec5d640 1 Processor -- start 2023-11-04T01:39:18.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.123+0000 7f260ec5d640 1 -- start start 2023-11-04T01:39:18.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.123+0000 7f260ec5d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26080cde60 0x7f26081f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.123+0000 7f260ec5d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26080ce240 0x7f260815b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.123+0000 7f260ec5d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2608157540 0x7f260815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.123+0000 7f260ec5d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26081f24d0 con 0x7f2608157540 2023-11-04T01:39:18.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.123+0000 7f260ec5d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26080b8010 con 0x7f26080ce240 2023-11-04T01:39:18.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.123+0000 7f260ec5d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2608159150 con 0x7f26080cde60 2023-11-04T01:39:18.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.123+0000 7f260d1fa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2608157540 0x7f260815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.123+0000 7f260d1fa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2608157540 0x7f260815b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32932/0 (socket says 172.21.15.114:32932) 2023-11-04T01:39:18.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.123+0000 7f260d1fa640 1 -- 172.21.15.114:0/933353076 learned_addr learned my addr 172.21.15.114:0/933353076 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:18.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.124+0000 7f260c9f9640 1 --2- 172.21.15.114:0/933353076 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26080cde60 0x7f26081f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.124+0000 7f2607fff640 1 --2- 172.21.15.114:0/933353076 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26080ce240 0x7f260815b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.124+0000 7f260d1fa640 1 -- 172.21.15.114:0/933353076 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26080cde60 msgr2=0x7f26081f1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.124+0000 7f260d1fa640 1 --2- 172.21.15.114:0/933353076 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26080cde60 0x7f26081f1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.124+0000 7f260d1fa640 1 -- 172.21.15.114:0/933353076 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26080ce240 msgr2=0x7f260815b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.124+0000 7f260d1fa640 1 --2- 172.21.15.114:0/933353076 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26080ce240 0x7f260815b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.124+0000 7f260d1fa640 1 -- 172.21.15.114:0/933353076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2600009a70 con 0x7f2608157540 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.124+0000 7f260d1fa640 1 --2- 172.21.15.114:0/933353076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2608157540 0x7f260815b8c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2600009d90 tx=0x7f2600004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.124+0000 7f26057fa640 1 -- 172.21.15.114:0/933353076 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600040650 con 0x7f2608157540 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.124+0000 7f26057fa640 1 -- 172.21.15.114:0/933353076 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26000407d0 con 0x7f2608157540 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.124+0000 7f260ec5d640 1 -- 172.21.15.114:0/933353076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26080b7d30 con 0x7f2608157540 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.124+0000 7f26057fa640 1 -- 172.21.15.114:0/933353076 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600040b80 con 0x7f2608157540 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.124+0000 7f260ec5d640 1 -- 172.21.15.114:0/933353076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2608158de0 con 0x7f2608157540 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.125+0000 7f260ec5d640 1 -- 172.21.15.114:0/933353076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26081592c0 con 0x7f2608157540 2023-11-04T01:39:18.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.126+0000 7f26057fa640 1 -- 172.21.15.114:0/933353076 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2600040ce0 con 0x7f2608157540 2023-11-04T01:39:18.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.126+0000 7f26057fa640 1 --2- 172.21.15.114:0/933353076 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f25ec06aea0 0x7f25ec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.126+0000 7f260c9f9640 1 --2- 172.21.15.114:0/933353076 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f25ec06aea0 0x7f25ec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.126+0000 7f26057fa640 1 -- 172.21.15.114:0/933353076 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f26000ac450 con 0x7f2608157540 2023-11-04T01:39:18.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.126+0000 7f260c9f9640 1 --2- 172.21.15.114:0/933353076 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f25ec06aea0 0x7f25ec06d360 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f25fc005880 tx=0x7f25fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.130+0000 7f26057fa640 1 -- 172.21.15.114:0/933353076 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2600077430 con 0x7f2608157540 2023-11-04T01:39:18.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.296+0000 7f260ec5d640 1 -- 172.21.15.114:0/933353076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2608074290 con 0x7f2608157540 2023-11-04T01:39:18.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.298+0000 7f26057fa640 1 -- 172.21.15.114:0/933353076 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f260007aa50 con 0x7f2608157540 2023-11-04T01:39:18.300 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:18.300 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":79,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:17.631017+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.300+0000 7f260ec5d640 1 -- 172.21.15.114:0/933353076 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f25ec06aea0 msgr2=0x7f25ec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.300+0000 7f260ec5d640 1 --2- 172.21.15.114:0/933353076 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f25ec06aea0 0x7f25ec06d360 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f25fc005880 tx=0x7f25fc009040 comp rx=0 tx=0).stop 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.300+0000 7f260ec5d640 1 -- 172.21.15.114:0/933353076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2608157540 msgr2=0x7f260815b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.300+0000 7f260ec5d640 1 --2- 172.21.15.114:0/933353076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2608157540 0x7f260815b8c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2600009d90 tx=0x7f2600004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.300+0000 7f260ec5d640 1 -- 172.21.15.114:0/933353076 shutdown_connections 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.300+0000 7f260ec5d640 1 --2- 172.21.15.114:0/933353076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2608157540 0x7f260815b8c0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.300+0000 7f260ec5d640 1 --2- 172.21.15.114:0/933353076 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f25ec06aea0 0x7f25ec06d360 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.300+0000 7f260ec5d640 1 --2- 172.21.15.114:0/933353076 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f26080ce240 0x7f260815b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.300+0000 7f260ec5d640 1 --2- 172.21.15.114:0/933353076 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26080cde60 0x7f26081f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.300+0000 7f260ec5d640 1 -- 172.21.15.114:0/933353076 >> 172.21.15.114:0/933353076 conn(0x7f2608071f30 msgr2=0x7f26080cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.300+0000 7f260ec5d640 1 -- 172.21.15.114:0/933353076 shutdown_connections 2023-11-04T01:39:18.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.300+0000 7f260ec5d640 1 -- 172.21.15.114:0/933353076 wait complete. 2023-11-04T01:39:18.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:58.316710+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:59.185397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:18.313 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:18.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.413+0000 7f7443b1d640 1 Processor -- start 2023-11-04T01:39:18.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.413+0000 7f7443b1d640 1 -- start start 2023-11-04T01:39:18.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.414+0000 7f7443b1d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f743c0ae1d0 0x7f743c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.414+0000 7f7443b1d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c15aff0 con 0x7f743c159c00 2023-11-04T01:39:18.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.414+0000 7f7443b1d640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c15a3e0 con 0x7f743c0c4ff0 2023-11-04T01:39:18.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.414+0000 7f7443b1d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743c15a6c0 con 0x7f743c0ae1d0 2023-11-04T01:39:18.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.414+0000 7f74420ba640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f743c0ae1d0 0x7f743c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.414+0000 7f74418b9640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f743c159c00 0x7f743c0c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53214/0 (socket says 172.21.15.114:53214) 2023-11-04T01:39:18.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.414+0000 7f74418b9640 1 -- 172.21.15.114:0/4119087782 learned_addr learned my addr 172.21.15.114:0/4119087782 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:18.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.414+0000 7f74420ba640 1 -- 172.21.15.114:0/4119087782 >> v1:172.21.15.141:6789/0 conn(0x7f743c0c4ff0 legacy=0x7f743c0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.415+0000 7f74420ba640 1 -- 172.21.15.114:0/4119087782 >> v1:172.21.15.114:6789/0 conn(0x7f743c159c00 legacy=0x7f743c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.415+0000 7f74420ba640 1 -- 172.21.15.114:0/4119087782 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c15a9a0 con 0x7f743c0ae1d0 2023-11-04T01:39:18.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.415+0000 7f74420ba640 1 --2- 172.21.15.114:0/4119087782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c0ae1d0 0x7f743c0cc890 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f74340097a0 tx=0x7f743402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9c8cbc3546ee1b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.415+0000 7f74408b7640 1 -- 172.21.15.114:0/4119087782 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7434031830 con 0x7f743c0ae1d0 2023-11-04T01:39:18.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.415+0000 7f74408b7640 1 -- 172.21.15.114:0/4119087782 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7434031990 con 0x7f743c0ae1d0 2023-11-04T01:39:18.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.415+0000 7f74408b7640 1 -- 172.21.15.114:0/4119087782 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7434031d20 con 0x7f743c0ae1d0 2023-11-04T01:39:18.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.416+0000 7f7443b1d640 1 -- 172.21.15.114:0/4119087782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c0ae1d0 msgr2=0x7f743c0cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.416+0000 7f7443b1d640 1 --2- 172.21.15.114:0/4119087782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c0ae1d0 0x7f743c0cc890 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f74340097a0 tx=0x7f743402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.416+0000 7f7443b1d640 1 -- 172.21.15.114:0/4119087782 shutdown_connections 2023-11-04T01:39:18.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.416+0000 7f7443b1d640 1 --2- 172.21.15.114:0/4119087782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c0ae1d0 0x7f743c0cc890 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.416+0000 7f7443b1d640 1 -- 172.21.15.114:0/4119087782 >> 172.21.15.114:0/4119087782 conn(0x7f743c0ce950 msgr2=0x7f743c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.416+0000 7f7443b1d640 1 -- 172.21.15.114:0/4119087782 shutdown_connections 2023-11-04T01:39:18.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.416+0000 7f7443b1d640 1 -- 172.21.15.114:0/4119087782 wait complete. 2023-11-04T01:39:18.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.417+0000 7f7443b1d640 1 Processor -- start 2023-11-04T01:39:18.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.417+0000 7f7443b1d640 1 -- start start 2023-11-04T01:39:18.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.418+0000 7f7443b1d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f743c0ae1d0 0x7f743c14cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.418+0000 7f7443b1d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f743c0c4ff0 0x7f743c0c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.418+0000 7f7443b1d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c159c00 0x7f743c0b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.418+0000 7f7443b1d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0b2a50 con 0x7f743c159c00 2023-11-04T01:39:18.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.418+0000 7f7443b1d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0b45a0 con 0x7f743c0ae1d0 2023-11-04T01:39:18.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.418+0000 7f7443b1d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0c5a20 con 0x7f743c0c4ff0 2023-11-04T01:39:18.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.418+0000 7f74420ba640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c159c00 0x7f743c0b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.418+0000 7f74420ba640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c159c00 0x7f743c0b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32948/0 (socket says 172.21.15.114:32948) 2023-11-04T01:39:18.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.418+0000 7f74420ba640 1 -- 172.21.15.114:0/2864002212 learned_addr learned my addr 172.21.15.114:0/2864002212 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:18.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.418+0000 7f74420ba640 1 -- 172.21.15.114:0/2864002212 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f743c0c4ff0 msgr2=0x7f743c0c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.418+0000 7f74420ba640 1 --2- 172.21.15.114:0/2864002212 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f743c0c4ff0 0x7f743c0c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.418+0000 7f74420ba640 1 -- 172.21.15.114:0/2864002212 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f743c0ae1d0 msgr2=0x7f743c14cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.418+0000 7f74420ba640 1 --2- 172.21.15.114:0/2864002212 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f743c0ae1d0 0x7f743c14cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.418+0000 7f74420ba640 1 -- 172.21.15.114:0/2864002212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7434009400 con 0x7f743c159c00 2023-11-04T01:39:18.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.418+0000 7f74420ba640 1 --2- 172.21.15.114:0/2864002212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c159c00 0x7f743c0b2ea0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f74340098c0 tx=0x7f74340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.419+0000 7f74327fc640 1 -- 172.21.15.114:0/2864002212 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743403b9f0 con 0x7f743c159c00 2023-11-04T01:39:18.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.419+0000 7f74327fc640 1 -- 172.21.15.114:0/2864002212 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743403bb50 con 0x7f743c159c00 2023-11-04T01:39:18.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.419+0000 7f74327fc640 1 -- 172.21.15.114:0/2864002212 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74340453f0 con 0x7f743c159c00 2023-11-04T01:39:18.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.419+0000 7f7443b1d640 1 -- 172.21.15.114:0/2864002212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c0c5d00 con 0x7f743c159c00 2023-11-04T01:39:18.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.419+0000 7f7443b1d640 1 -- 172.21.15.114:0/2864002212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c140a50 con 0x7f743c159c00 2023-11-04T01:39:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.420+0000 7f7443b1d640 1 -- 172.21.15.114:0/2864002212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743c074290 con 0x7f743c159c00 2023-11-04T01:39:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.420+0000 7f74327fc640 1 -- 172.21.15.114:0/2864002212 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7434045550 con 0x7f743c159c00 2023-11-04T01:39:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.421+0000 7f74327fc640 1 --2- 172.21.15.114:0/2864002212 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f742006ae70 0x7f742006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.421+0000 7f74327fc640 1 -- 172.21.15.114:0/2864002212 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f74340abd00 con 0x7f743c159c00 2023-11-04T01:39:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.421+0000 7f74418b9640 1 --2- 172.21.15.114:0/2864002212 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f742006ae70 0x7f742006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.421+0000 7f74418b9640 1 --2- 172.21.15.114:0/2864002212 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f742006ae70 0x7f742006d330 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f743c140970 tx=0x7f74380015c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.425+0000 7f74327fc640 1 -- 172.21.15.114:0/2864002212 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7434076cc0 con 0x7f743c159c00 2023-11-04T01:39:18.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.590+0000 7f7443b1d640 1 -- 172.21.15.114:0/2864002212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f743c0b2b90 con 0x7f743c159c00 2023-11-04T01:39:18.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.591+0000 7f74327fc640 1 -- 172.21.15.114:0/2864002212 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7434035020 con 0x7f743c159c00 2023-11-04T01:39:18.593 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:39:18.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.593+0000 7f7443b1d640 1 -- 172.21.15.114:0/2864002212 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f742006ae70 msgr2=0x7f742006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.593+0000 7f7443b1d640 1 --2- 172.21.15.114:0/2864002212 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f742006ae70 0x7f742006d330 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f743c140970 tx=0x7f74380015c0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.593+0000 7f7443b1d640 1 -- 172.21.15.114:0/2864002212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c159c00 msgr2=0x7f743c0b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.593+0000 7f7443b1d640 1 --2- 172.21.15.114:0/2864002212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c159c00 0x7f743c0b2ea0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f74340098c0 tx=0x7f74340046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.593+0000 7f7443b1d640 1 -- 172.21.15.114:0/2864002212 shutdown_connections 2023-11-04T01:39:18.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.593+0000 7f7443b1d640 1 --2- 172.21.15.114:0/2864002212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c159c00 0x7f743c0b2ea0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.593+0000 7f7443b1d640 1 --2- 172.21.15.114:0/2864002212 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f743c0c4ff0 0x7f743c0c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.593+0000 7f7443b1d640 1 --2- 172.21.15.114:0/2864002212 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f742006ae70 0x7f742006d330 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.593+0000 7f7443b1d640 1 --2- 172.21.15.114:0/2864002212 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f743c0ae1d0 0x7f743c14cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.593+0000 7f7443b1d640 1 -- 172.21.15.114:0/2864002212 >> 172.21.15.114:0/2864002212 conn(0x7f743c0ce950 msgr2=0x7f743c158ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.593+0000 7f7443b1d640 1 -- 172.21.15.114:0/2864002212 shutdown_connections 2023-11-04T01:39:18.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.593+0000 7f7443b1d640 1 -- 172.21.15.114:0/2864002212 wait complete. 2023-11-04T01:39:18.605 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:39:18.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.706+0000 7f2c5b6af640 1 Processor -- start 2023-11-04T01:39:18.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.706+0000 7f2c5b6af640 1 -- start start 2023-11-04T01:39:18.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.707+0000 7f2c5b6af640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c5415af20 0x7f2c540b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.707+0000 7f2c5b6af640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2c540cd3b0 0x7f2c540cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.707+0000 7f2c5b6af640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c540d01f0 con 0x7f2c540b64c0 2023-11-04T01:39:18.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.707+0000 7f2c5b6af640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c540cc380 con 0x7f2c540cd3b0 2023-11-04T01:39:18.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.707+0000 7f2c5b6af640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c540cdd80 con 0x7f2c5415af20 2023-11-04T01:39:18.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.707+0000 7f2c58c4a640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2c540b64c0 0x7f2c540cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53222/0 (socket says 172.21.15.114:53222) 2023-11-04T01:39:18.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.707+0000 7f2c58c4a640 1 -- 172.21.15.114:0/3489113721 learned_addr learned my addr 172.21.15.114:0/3489113721 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:18.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c5944b640 1 --2- 172.21.15.114:0/3489113721 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c5415af20 0x7f2c540b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c59c4c640 1 --2- 172.21.15.114:0/3489113721 >> v2:172.21.15.141:3300/0 conn(0x7f2c540cd3b0 0x7f2c540cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c4bfff640 1 -- 172.21.15.114:0/3489113721 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711711028 0 0) 0x7f2c540d01f0 con 0x7f2c540b64c0 2023-11-04T01:39:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c4bfff640 1 -- 172.21.15.114:0/3489113721 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c40003520 con 0x7f2c540b64c0 2023-11-04T01:39:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c4bfff640 1 -- 172.21.15.114:0/3489113721 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1128190580 0 0) 0x7f2c40003520 con 0x7f2c540b64c0 2023-11-04T01:39:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c4bfff640 1 -- 172.21.15.114:0/3489113721 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c5415af20 msgr2=0x7f2c540b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c4bfff640 1 --2- 172.21.15.114:0/3489113721 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c5415af20 0x7f2c540b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c4bfff640 1 -- 172.21.15.114:0/3489113721 >> v2:172.21.15.141:3300/0 conn(0x7f2c540cd3b0 msgr2=0x7f2c540cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c4bfff640 1 --2- 172.21.15.114:0/3489113721 >> v2:172.21.15.141:3300/0 conn(0x7f2c540cd3b0 0x7f2c540cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c4bfff640 1 -- 172.21.15.114:0/3489113721 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c540b6a40 con 0x7f2c540b64c0 2023-11-04T01:39:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c4bfff640 1 -- 172.21.15.114:0/3489113721 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f2c44001670 con 0x7f2c540b64c0 2023-11-04T01:39:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c4bfff640 1 -- 172.21.15.114:0/3489113721 >> v1:172.21.15.114:6789/0 conn(0x7f2c540b64c0 legacy=0x7f2c540cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c4bfff640 1 --2- 172.21.15.114:0/3489113721 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c5415af20 0x7f2c400039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c4bfff640 1 --2- 172.21.15.114:0/3489113721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c40003f20 0x7f2c400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c4bfff640 1 --2- 172.21.15.114:0/3489113721 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c40004d00 0x7f2c40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c4bfff640 1 -- 172.21.15.114:0/3489113721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c540cc380 con 0x7f2c40003f20 2023-11-04T01:39:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c4bfff640 1 -- 172.21.15.114:0/3489113721 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c540cdd80 con 0x7f2c40004d00 2023-11-04T01:39:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c4bfff640 1 -- 172.21.15.114:0/3489113721 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4000b980 con 0x7f2c5415af20 2023-11-04T01:39:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c58c4a640 1 --2- 172.21.15.114:0/3489113721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c40003f20 0x7f2c400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c5944b640 1 --2- 172.21.15.114:0/3489113721 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c5415af20 0x7f2c400039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c59c4c640 1 --2- 172.21.15.114:0/3489113721 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c40004d00 0x7f2c40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c58c4a640 1 -- 172.21.15.114:0/3489113721 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c5415af20 msgr2=0x7f2c400039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c58c4a640 1 --2- 172.21.15.114:0/3489113721 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c5415af20 0x7f2c400039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c58c4a640 1 -- 172.21.15.114:0/3489113721 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c40004d00 msgr2=0x7f2c40005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c58c4a640 1 --2- 172.21.15.114:0/3489113721 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c40004d00 0x7f2c40005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.708+0000 7f2c58c4a640 1 -- 172.21.15.114:0/3489113721 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c40003520 con 0x7f2c40003f20 2023-11-04T01:39:18.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.709+0000 7f2c58c4a640 1 --2- 172.21.15.114:0/3489113721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c40003f20 0x7f2c400047c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400c240 tx=0x7f2c400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f996a5643c4bb39 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.709+0000 7f2c4bfff640 1 -- 172.21.15.114:0/3489113721 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44005ad0 con 0x7f2c40003f20 2023-11-04T01:39:18.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.709+0000 7f2c4bfff640 1 -- 172.21.15.114:0/3489113721 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c44005c50 con 0x7f2c40003f20 2023-11-04T01:39:18.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.709+0000 7f2c4bfff640 1 -- 172.21.15.114:0/3489113721 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4402c8b0 con 0x7f2c40003f20 2023-11-04T01:39:18.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.710+0000 7f2c5b6af640 1 -- 172.21.15.114:0/3489113721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c40003f20 msgr2=0x7f2c400047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.710+0000 7f2c5b6af640 1 --2- 172.21.15.114:0/3489113721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c40003f20 0x7f2c400047c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400c240 tx=0x7f2c400057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.710+0000 7f2c59c4c640 1 -- 172.21.15.114:0/3489113721 reap_dead start 2023-11-04T01:39:18.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.710+0000 7f2c5b6af640 1 -- 172.21.15.114:0/3489113721 shutdown_connections 2023-11-04T01:39:18.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.710+0000 7f2c5b6af640 1 -- 172.21.15.114:0/3489113721 >> 172.21.15.114:0/3489113721 conn(0x7f2c5406ea20 msgr2=0x7f2c5406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.710+0000 7f2c5b6af640 1 -- 172.21.15.114:0/3489113721 shutdown_connections 2023-11-04T01:39:18.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.710+0000 7f2c5b6af640 1 -- 172.21.15.114:0/3489113721 wait complete. 2023-11-04T01:39:18.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.711+0000 7f2c5b6af640 1 Processor -- start 2023-11-04T01:39:18.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.711+0000 7f2c5b6af640 1 -- start start 2023-11-04T01:39:18.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c5b6af640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c40003f20 0x7f2c541f4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c5b6af640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c54154c10 0x7f2c54150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c5b6af640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c541f0e70 0x7f2c540c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c5b6af640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c541f1de0 con 0x7f2c54154c10 2023-11-04T01:39:18.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c5b6af640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c541f1820 con 0x7f2c541f0e70 2023-11-04T01:39:18.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c5b6af640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c541f1b00 con 0x7f2c40003f20 2023-11-04T01:39:18.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c58c4a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c54154c10 0x7f2c54150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c58c4a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c54154c10 0x7f2c54150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32980/0 (socket says 172.21.15.114:32980) 2023-11-04T01:39:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c58c4a640 1 -- 172.21.15.114:0/663346929 learned_addr learned my addr 172.21.15.114:0/663346929 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c59c4c640 1 --2- 172.21.15.114:0/663346929 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c541f0e70 0x7f2c540c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c5944b640 1 --2- 172.21.15.114:0/663346929 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c40003f20 0x7f2c541f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c58c4a640 1 -- 172.21.15.114:0/663346929 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c40003f20 msgr2=0x7f2c541f4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c58c4a640 1 --2- 172.21.15.114:0/663346929 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c40003f20 0x7f2c541f4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c58c4a640 1 -- 172.21.15.114:0/663346929 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c541f0e70 msgr2=0x7f2c540c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c58c4a640 1 --2- 172.21.15.114:0/663346929 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c541f0e70 0x7f2c540c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c58c4a640 1 -- 172.21.15.114:0/663346929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c541f4500 con 0x7f2c54154c10 2023-11-04T01:39:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c58c4a640 1 --2- 172.21.15.114:0/663346929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c54154c10 0x7f2c54150980 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400c240 tx=0x7f2c44001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c49ffb640 1 -- 172.21.15.114:0/663346929 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4403c040 con 0x7f2c54154c10 2023-11-04T01:39:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c49ffb640 1 -- 172.21.15.114:0/663346929 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4402dd50 con 0x7f2c54154c10 2023-11-04T01:39:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c49ffb640 1 -- 172.21.15.114:0/663346929 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44007270 con 0x7f2c54154c10 2023-11-04T01:39:18.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.712+0000 7f2c5b6af640 1 -- 172.21.15.114:0/663346929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c541f47e0 con 0x7f2c54154c10 2023-11-04T01:39:18.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.713+0000 7f2c5b6af640 1 -- 172.21.15.114:0/663346929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c54150ec0 con 0x7f2c54154c10 2023-11-04T01:39:18.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.714+0000 7f2c5b6af640 1 -- 172.21.15.114:0/663346929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c541510b0 con 0x7f2c54154c10 2023-11-04T01:39:18.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.714+0000 7f2c49ffb640 1 -- 172.21.15.114:0/663346929 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c44032070 con 0x7f2c54154c10 2023-11-04T01:39:18.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.714+0000 7f2c49ffb640 1 --2- 172.21.15.114:0/663346929 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2c3806ae70 0x7f2c3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:18.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.715+0000 7f2c5944b640 1 --2- 172.21.15.114:0/663346929 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2c3806ae70 0x7f2c3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:18.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.715+0000 7f2c49ffb640 1 -- 172.21.15.114:0/663346929 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f2c440ab2d0 con 0x7f2c54154c10 2023-11-04T01:39:18.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.715+0000 7f2c5944b640 1 --2- 172.21.15.114:0/663346929 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2c3806ae70 0x7f2c3806d330 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2c50007440 tx=0x7f2c5000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:18.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.719+0000 7f2c49ffb640 1 -- 172.21.15.114:0/663346929 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c44076200 con 0x7f2c54154c10 2023-11-04T01:39:18.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.883+0000 7f2c5b6af640 1 -- 172.21.15.114:0/663346929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f2c5406f690 con 0x7f2c54154c10 2023-11-04T01:39:18.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.883+0000 7f2c49ffb640 1 -- 172.21.15.114:0/663346929 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v79) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2c44079820 con 0x7f2c54154c10 2023-11-04T01:39:18.886 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:18.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.885+0000 7f2c5b6af640 1 -- 172.21.15.114:0/663346929 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2c3806ae70 msgr2=0x7f2c3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.885+0000 7f2c5b6af640 1 --2- 172.21.15.114:0/663346929 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2c3806ae70 0x7f2c3806d330 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2c50007440 tx=0x7f2c5000b040 comp rx=0 tx=0).stop 2023-11-04T01:39:18.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.885+0000 7f2c5b6af640 1 -- 172.21.15.114:0/663346929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c54154c10 msgr2=0x7f2c54150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:18.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.885+0000 7f2c5b6af640 1 --2- 172.21.15.114:0/663346929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c54154c10 0x7f2c54150980 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400c240 tx=0x7f2c44001a00 comp rx=0 tx=0).stop 2023-11-04T01:39:18.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.885+0000 7f2c5b6af640 1 -- 172.21.15.114:0/663346929 shutdown_connections 2023-11-04T01:39:18.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.885+0000 7f2c5b6af640 1 --2- 172.21.15.114:0/663346929 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2c3806ae70 0x7f2c3806d330 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.885+0000 7f2c5b6af640 1 --2- 172.21.15.114:0/663346929 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c541f0e70 0x7f2c540c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.885+0000 7f2c5b6af640 1 --2- 172.21.15.114:0/663346929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c54154c10 0x7f2c54150980 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.885+0000 7f2c5b6af640 1 --2- 172.21.15.114:0/663346929 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c40003f20 0x7f2c541f4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:18.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.885+0000 7f2c5b6af640 1 -- 172.21.15.114:0/663346929 >> 172.21.15.114:0/663346929 conn(0x7f2c5406ea20 msgr2=0x7f2c540d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:18.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.885+0000 7f2c5b6af640 1 -- 172.21.15.114:0/663346929 shutdown_connections 2023-11-04T01:39:18.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.885+0000 7f2c5b6af640 1 -- 172.21.15.114:0/663346929 wait complete. 2023-11-04T01:39:18.898 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:39:19.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.998+0000 7f200b464640 1 Processor -- start 2023-11-04T01:39:19.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.998+0000 7f200b464640 1 -- start start 2023-11-04T01:39:19.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.999+0000 7f200b464640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f200406e990 0x7f200406ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.999+0000 7f200b464640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f200415a2f0 con 0x7f20040ccba0 2023-11-04T01:39:19.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.999+0000 7f200b464640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20040cea00 con 0x7f200406ad60 2023-11-04T01:39:19.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.999+0000 7f200b464640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200406d0e0 con 0x7f200406e990 2023-11-04T01:39:19.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.999+0000 7f20089ff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f20040ccba0 0x7f20040c9d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53226/0 (socket says 172.21.15.114:53226) 2023-11-04T01:39:19.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:18.999+0000 7f20089ff640 1 -- 172.21.15.114:0/2516876607 learned_addr learned my addr 172.21.15.114:0/2516876607 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.000+0000 7f2009200640 1 --2- 172.21.15.114:0/2516876607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f200406e990 0x7f200406ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.000+0000 7f1ffbfff640 1 -- 172.21.15.114:0/2516876607 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800984900 0 0) 0x7f200415a2f0 con 0x7f20040ccba0 2023-11-04T01:39:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.000+0000 7f1ffbfff640 1 -- 172.21.15.114:0/2516876607 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ff0003520 con 0x7f20040ccba0 2023-11-04T01:39:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.000+0000 7f1ffbfff640 1 -- 172.21.15.114:0/2516876607 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771105662 0 0) 0x7f20040cea00 con 0x7f200406ad60 2023-11-04T01:39:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.000+0000 7f1ffbfff640 1 -- 172.21.15.114:0/2516876607 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f200415a2f0 con 0x7f200406ad60 2023-11-04T01:39:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.000+0000 7f2009200640 1 -- 172.21.15.114:0/2516876607 >> v1:172.21.15.141:6789/0 conn(0x7f200406ad60 legacy=0x7f20040ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.000+0000 7f2009200640 1 -- 172.21.15.114:0/2516876607 >> v1:172.21.15.114:6789/0 conn(0x7f20040ccba0 legacy=0x7f20040c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.000+0000 7f1ffbfff640 1 -- 172.21.15.114:0/2516876607 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3886821409 0 0) 0x7f1ff0003520 con 0x7f20040ccba0 2023-11-04T01:39:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.000+0000 7f2009200640 1 -- 172.21.15.114:0/2516876607 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200406f2b0 con 0x7f200406e990 2023-11-04T01:39:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.001+0000 7f2009200640 1 --2- 172.21.15.114:0/2516876607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f200406e990 0x7f200406ed70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f20000097d0 tx=0x7f200002b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6de815d1886b43d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.001+0000 7f1ffbfff640 1 -- 172.21.15.114:0/2516876607 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4001670 con 0x7f200406e990 2023-11-04T01:39:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.001+0000 7f1ffbfff640 1 -- 172.21.15.114:0/2516876607 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200002e050 con 0x7f200406e990 2023-11-04T01:39:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.001+0000 7f1ffbfff640 1 -- 172.21.15.114:0/2516876607 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2000030710 con 0x7f200406e990 2023-11-04T01:39:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.002+0000 7f200b464640 1 -- 172.21.15.114:0/2516876607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f200406e990 msgr2=0x7f200406ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.002+0000 7f200b464640 1 --2- 172.21.15.114:0/2516876607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f200406e990 0x7f200406ed70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f20000097d0 tx=0x7f200002b6e0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.002+0000 7f200b464640 1 -- 172.21.15.114:0/2516876607 shutdown_connections 2023-11-04T01:39:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.002+0000 7f200b464640 1 --2- 172.21.15.114:0/2516876607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f200406e990 0x7f200406ed70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.002+0000 7f200b464640 1 -- 172.21.15.114:0/2516876607 >> 172.21.15.114:0/2516876607 conn(0x7f200406a120 msgr2=0x7f200406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.002+0000 7f200b464640 1 -- 172.21.15.114:0/2516876607 shutdown_connections 2023-11-04T01:39:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.002+0000 7f200b464640 1 -- 172.21.15.114:0/2516876607 wait complete. 2023-11-04T01:39:19.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.003+0000 7f200b464640 1 Processor -- start 2023-11-04T01:39:19.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.003+0000 7f200b464640 1 -- start start 2023-11-04T01:39:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f200b464640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f200406ad60 0x7f2004155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f200b464640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f200406e990 0x7f2004150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f200b464640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20040ccba0 0x7f20040c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f200b464640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20040c2b80 con 0x7f20040ccba0 2023-11-04T01:39:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f200b464640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2004158110 con 0x7f200406ad60 2023-11-04T01:39:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f200b464640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20040c2e20 con 0x7f200406e990 2023-11-04T01:39:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f2009a01640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20040ccba0 0x7f20040c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f2009a01640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20040ccba0 0x7f20040c3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32996/0 (socket says 172.21.15.114:32996) 2023-11-04T01:39:19.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f2009a01640 1 -- 172.21.15.114:0/3151844288 learned_addr learned my addr 172.21.15.114:0/3151844288 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:19.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f2009200640 1 --2- 172.21.15.114:0/3151844288 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f200406ad60 0x7f2004155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f20089ff640 1 --2- 172.21.15.114:0/3151844288 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f200406e990 0x7f2004150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f2009a01640 1 -- 172.21.15.114:0/3151844288 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f200406e990 msgr2=0x7f2004150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f2009a01640 1 --2- 172.21.15.114:0/3151844288 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f200406e990 0x7f2004150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f2009a01640 1 -- 172.21.15.114:0/3151844288 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f200406ad60 msgr2=0x7f2004155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f2009a01640 1 --2- 172.21.15.114:0/3151844288 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f200406ad60 0x7f2004155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f2009a01640 1 -- 172.21.15.114:0/3151844288 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2000009400 con 0x7f20040ccba0 2023-11-04T01:39:19.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f2009200640 1 --2- 172.21.15.114:0/3151844288 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f200406ad60 0x7f2004155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:19.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f2009a01640 1 --2- 172.21.15.114:0/3151844288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20040ccba0 0x7f20040c3470 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00c6e0 tx=0x7f1ffc00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:19.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f1ff9ffb640 1 -- 172.21.15.114:0/3151844288 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc003b70 con 0x7f20040ccba0 2023-11-04T01:39:19.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f1ff9ffb640 1 -- 172.21.15.114:0/3151844288 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc003cd0 con 0x7f20040ccba0 2023-11-04T01:39:19.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f200b464640 1 -- 172.21.15.114:0/3151844288 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20041583b0 con 0x7f20040ccba0 2023-11-04T01:39:19.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.004+0000 7f1ff9ffb640 1 -- 172.21.15.114:0/3151844288 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc0052d0 con 0x7f20040ccba0 2023-11-04T01:39:19.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.005+0000 7f200b464640 1 -- 172.21.15.114:0/3151844288 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20041559b0 con 0x7f20040ccba0 2023-11-04T01:39:19.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.006+0000 7f200b464640 1 -- 172.21.15.114:0/3151844288 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20041585f0 con 0x7f20040ccba0 2023-11-04T01:39:19.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.006+0000 7f1ff9ffb640 1 -- 172.21.15.114:0/3151844288 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ffc005430 con 0x7f20040ccba0 2023-11-04T01:39:19.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.006+0000 7f1ff9ffb640 1 --2- 172.21.15.114:0/3151844288 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1fe806ae70 0x7f1fe806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.006+0000 7f1ff9ffb640 1 -- 172.21.15.114:0/3151844288 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f1ffc0896a0 con 0x7f20040ccba0 2023-11-04T01:39:19.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.006+0000 7f2009200640 1 --2- 172.21.15.114:0/3151844288 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1fe806ae70 0x7f1fe806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.007+0000 7f2009200640 1 --2- 172.21.15.114:0/3151844288 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1fe806ae70 0x7f1fe806d330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2000034000 tx=0x7f2000008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:19.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.010+0000 7f1ff9ffb640 1 -- 172.21.15.114:0/3151844288 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20041585f0 con 0x7f20040ccba0 2023-11-04T01:39:19.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.175+0000 7f200b464640 1 -- 172.21.15.114:0/3151844288 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f20041585f0 con 0x7f20040ccba0 2023-11-04T01:39:19.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.175+0000 7f1ff9ffb640 1 -- 172.21.15.114:0/3151844288 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v79) v1 ==== 103+0+11 (secure 0 0 0) 0x7f20041585f0 con 0x7f20040ccba0 2023-11-04T01:39:19.177 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:19.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.177+0000 7f200b464640 1 -- 172.21.15.114:0/3151844288 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1fe806ae70 msgr2=0x7f1fe806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.177+0000 7f200b464640 1 --2- 172.21.15.114:0/3151844288 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1fe806ae70 0x7f1fe806d330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2000034000 tx=0x7f2000008030 comp rx=0 tx=0).stop 2023-11-04T01:39:19.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.177+0000 7f200b464640 1 -- 172.21.15.114:0/3151844288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20040ccba0 msgr2=0x7f20040c3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.177+0000 7f200b464640 1 --2- 172.21.15.114:0/3151844288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20040ccba0 0x7f20040c3470 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00c6e0 tx=0x7f1ffc00cba0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.177+0000 7f200b464640 1 -- 172.21.15.114:0/3151844288 shutdown_connections 2023-11-04T01:39:19.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.177+0000 7f200b464640 1 --2- 172.21.15.114:0/3151844288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20040ccba0 0x7f20040c3470 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.177+0000 7f200b464640 1 --2- 172.21.15.114:0/3151844288 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f200406e990 0x7f2004150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.177+0000 7f200b464640 1 --2- 172.21.15.114:0/3151844288 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1fe806ae70 0x7f1fe806d330 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.177+0000 7f200b464640 1 --2- 172.21.15.114:0/3151844288 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f200406ad60 0x7f2004155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.177+0000 7f200b464640 1 -- 172.21.15.114:0/3151844288 >> 172.21.15.114:0/3151844288 conn(0x7f200406a120 msgr2=0x7f20040cd190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:19.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.177+0000 7f200b464640 1 -- 172.21.15.114:0/3151844288 shutdown_connections 2023-11-04T01:39:19.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.177+0000 7f200b464640 1 -- 172.21.15.114:0/3151844288 wait complete. 2023-11-04T01:39:19.190 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:39:19.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.292+0000 7ff567a10640 1 Processor -- start 2023-11-04T01:39:19.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.292+0000 7ff567a10640 1 -- start start 2023-11-04T01:39:19.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.293+0000 7ff567a10640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff56015add0 0x7ff5600cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.293+0000 7ff567a10640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff560072370 0x7ff5600cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.293+0000 7ff567a10640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5600b1cc0 con 0x7ff560071f90 2023-11-04T01:39:19.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.293+0000 7ff567a10640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5600b1fa0 con 0x7ff56015add0 2023-11-04T01:39:19.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.293+0000 7ff567a10640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56015a0e0 con 0x7ff560072370 2023-11-04T01:39:19.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.293+0000 7ff5657ac640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff560071f90 0x7ff5600b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53234/0 (socket says 172.21.15.114:53234) 2023-11-04T01:39:19.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.293+0000 7ff5657ac640 1 -- 172.21.15.114:0/3832553917 learned_addr learned my addr 172.21.15.114:0/3832553917 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:19.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.293+0000 7ff564fab640 1 --2- 172.21.15.114:0/3832553917 >> v2:172.21.15.114:3300/0 conn(0x7ff56015add0 0x7ff5600cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.294+0000 7ff557fff640 1 -- 172.21.15.114:0/3832553917 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945795359 0 0) 0x7ff5600b1cc0 con 0x7ff560071f90 2023-11-04T01:39:19.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.294+0000 7ff557fff640 1 -- 172.21.15.114:0/3832553917 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff54c003520 con 0x7ff560071f90 2023-11-04T01:39:19.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.294+0000 7ff565fad640 1 --2- 172.21.15.114:0/3832553917 >> v2:172.21.15.141:3300/0 conn(0x7ff560072370 0x7ff5600cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.294+0000 7ff564fab640 1 -- 172.21.15.114:0/3832553917 >> v2:172.21.15.141:3300/0 conn(0x7ff560072370 msgr2=0x7ff5600cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:19.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.294+0000 7ff564fab640 1 --2- 172.21.15.114:0/3832553917 >> v2:172.21.15.141:3300/0 conn(0x7ff560072370 0x7ff5600cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.294+0000 7ff564fab640 1 -- 172.21.15.114:0/3832553917 >> v1:172.21.15.114:6789/0 conn(0x7ff560071f90 legacy=0x7ff5600b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.294+0000 7ff564fab640 1 -- 172.21.15.114:0/3832553917 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56015a2f0 con 0x7ff56015add0 2023-11-04T01:39:19.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.294+0000 7ff564fab640 1 --2- 172.21.15.114:0/3832553917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff56015add0 0x7ff5600cecc0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ff5600b1bd0 tx=0x7ff55c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e495b6182f78a78b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:19.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.295+0000 7ff557fff640 1 -- 172.21.15.114:0/3832553917 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c031830 con 0x7ff56015add0 2023-11-04T01:39:19.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.295+0000 7ff557fff640 1 -- 172.21.15.114:0/3832553917 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c031990 con 0x7ff56015add0 2023-11-04T01:39:19.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.295+0000 7ff557fff640 1 -- 172.21.15.114:0/3832553917 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c031d20 con 0x7ff56015add0 2023-11-04T01:39:19.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.295+0000 7ff567a10640 1 -- 172.21.15.114:0/3832553917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff56015add0 msgr2=0x7ff5600cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.295+0000 7ff567a10640 1 --2- 172.21.15.114:0/3832553917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff56015add0 0x7ff5600cecc0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ff5600b1bd0 tx=0x7ff55c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.295+0000 7ff567a10640 1 -- 172.21.15.114:0/3832553917 shutdown_connections 2023-11-04T01:39:19.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.295+0000 7ff567a10640 1 --2- 172.21.15.114:0/3832553917 >> v2:172.21.15.141:3300/0 conn(0x7ff560072370 0x7ff5600cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.295+0000 7ff567a10640 1 --2- 172.21.15.114:0/3832553917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff56015add0 0x7ff5600cecc0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.295+0000 7ff567a10640 1 -- 172.21.15.114:0/3832553917 >> 172.21.15.114:0/3832553917 conn(0x7ff56006d800 msgr2=0x7ff56006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:19.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.295+0000 7ff567a10640 1 -- 172.21.15.114:0/3832553917 shutdown_connections 2023-11-04T01:39:19.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.295+0000 7ff567a10640 1 -- 172.21.15.114:0/3832553917 wait complete. 2023-11-04T01:39:19.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.297+0000 7ff567a10640 1 Processor -- start 2023-11-04T01:39:19.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.297+0000 7ff567a10640 1 -- start start 2023-11-04T01:39:19.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.297+0000 7ff567a10640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff560071f90 0x7ff560153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.297+0000 7ff567a10640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff560072370 0x7ff5600c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.297+0000 7ff567a10640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff56015add0 0x7ff5600c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.297+0000 7ff567a10640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5600c4f00 con 0x7ff560072370 2023-11-04T01:39:19.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.297+0000 7ff567a10640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5600c50e0 con 0x7ff56015add0 2023-11-04T01:39:19.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.297+0000 7ff567a10640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5600c53c0 con 0x7ff560071f90 2023-11-04T01:39:19.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff564fab640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff560072370 0x7ff5600c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff564fab640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff560072370 0x7ff5600c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33016/0 (socket says 172.21.15.114:33016) 2023-11-04T01:39:19.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff564fab640 1 -- 172.21.15.114:0/2710554604 learned_addr learned my addr 172.21.15.114:0/2710554604 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:19.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff5657ac640 1 --2- 172.21.15.114:0/2710554604 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff560071f90 0x7ff560153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff565fad640 1 --2- 172.21.15.114:0/2710554604 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff56015add0 0x7ff5600c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff564fab640 1 -- 172.21.15.114:0/2710554604 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff560071f90 msgr2=0x7ff560153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff564fab640 1 --2- 172.21.15.114:0/2710554604 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff560071f90 0x7ff560153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff564fab640 1 -- 172.21.15.114:0/2710554604 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff56015add0 msgr2=0x7ff5600c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff564fab640 1 --2- 172.21.15.114:0/2710554604 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff56015add0 0x7ff5600c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff564fab640 1 -- 172.21.15.114:0/2710554604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c009400 con 0x7ff560072370 2023-11-04T01:39:19.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff565fad640 1 --2- 172.21.15.114:0/2710554604 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff56015add0 0x7ff5600c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:19.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff5657ac640 1 --2- 172.21.15.114:0/2710554604 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff560071f90 0x7ff560153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:19.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff564fab640 1 --2- 172.21.15.114:0/2710554604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff560072370 0x7ff5600c5ea0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ff55c000c00 tx=0x7ff55c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:19.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff555ffb640 1 -- 172.21.15.114:0/2710554604 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c03a8f0 con 0x7ff560072370 2023-11-04T01:39:19.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff555ffb640 1 -- 172.21.15.114:0/2710554604 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c03aa70 con 0x7ff560072370 2023-11-04T01:39:19.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff567a10640 1 -- 172.21.15.114:0/2710554604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5600c56a0 con 0x7ff560072370 2023-11-04T01:39:19.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.298+0000 7ff555ffb640 1 -- 172.21.15.114:0/2710554604 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c03ae20 con 0x7ff560072370 2023-11-04T01:39:19.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.299+0000 7ff567a10640 1 -- 172.21.15.114:0/2710554604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff560153b80 con 0x7ff560072370 2023-11-04T01:39:19.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.300+0000 7ff567a10640 1 -- 172.21.15.114:0/2710554604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5600c5bc0 con 0x7ff560072370 2023-11-04T01:39:19.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.300+0000 7ff555ffb640 1 -- 172.21.15.114:0/2710554604 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff55c04d450 con 0x7ff560072370 2023-11-04T01:39:19.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.301+0000 7ff555ffb640 1 --2- 172.21.15.114:0/2710554604 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff54406ae70 0x7ff54406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.301+0000 7ff555ffb640 1 -- 172.21.15.114:0/2710554604 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7ff55c0ab7e0 con 0x7ff560072370 2023-11-04T01:39:19.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.301+0000 7ff5657ac640 1 --2- 172.21.15.114:0/2710554604 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff54406ae70 0x7ff54406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.301+0000 7ff5657ac640 1 --2- 172.21.15.114:0/2710554604 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff54406ae70 0x7ff54406d330 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff550007fd0 tx=0x7ff550009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:19.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.305+0000 7ff555ffb640 1 -- 172.21.15.114:0/2710554604 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff5600c5bc0 con 0x7ff560072370 2023-11-04T01:39:19.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.474+0000 7ff567a10640 1 -- 172.21.15.114:0/2710554604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7ff5600c5bc0 con 0x7ff560072370 2023-11-04T01:39:19.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.474+0000 7ff555ffb640 1 -- 172.21.15.114:0/2710554604 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v79) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff5600c5bc0 con 0x7ff560072370 2023-11-04T01:39:19.476 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:19.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.476+0000 7ff567a10640 1 -- 172.21.15.114:0/2710554604 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff54406ae70 msgr2=0x7ff54406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.476+0000 7ff567a10640 1 --2- 172.21.15.114:0/2710554604 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff54406ae70 0x7ff54406d330 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff550007fd0 tx=0x7ff550009040 comp rx=0 tx=0).stop 2023-11-04T01:39:19.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.476+0000 7ff567a10640 1 -- 172.21.15.114:0/2710554604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff560072370 msgr2=0x7ff5600c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.476+0000 7ff567a10640 1 --2- 172.21.15.114:0/2710554604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff560072370 0x7ff5600c5ea0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ff55c000c00 tx=0x7ff55c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.476+0000 7ff567a10640 1 -- 172.21.15.114:0/2710554604 shutdown_connections 2023-11-04T01:39:19.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.476+0000 7ff567a10640 1 --2- 172.21.15.114:0/2710554604 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff54406ae70 0x7ff54406d330 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.476+0000 7ff567a10640 1 --2- 172.21.15.114:0/2710554604 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff56015add0 0x7ff5600c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.476+0000 7ff567a10640 1 --2- 172.21.15.114:0/2710554604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff560072370 0x7ff5600c5ea0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.476+0000 7ff567a10640 1 --2- 172.21.15.114:0/2710554604 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff560071f90 0x7ff560153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.476+0000 7ff567a10640 1 -- 172.21.15.114:0/2710554604 >> 172.21.15.114:0/2710554604 conn(0x7ff56006d800 msgr2=0x7ff56015c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:19.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.476+0000 7ff567a10640 1 -- 172.21.15.114:0/2710554604 shutdown_connections 2023-11-04T01:39:19.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.476+0000 7ff567a10640 1 -- 172.21.15.114:0/2710554604 wait complete. 2023-11-04T01:39:19.489 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:39:19.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.589+0000 7fa81fcc9640 1 Processor -- start 2023-11-04T01:39:19.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.589+0000 7fa81fcc9640 1 -- start start 2023-11-04T01:39:19.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.589+0000 7fa81fcc9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa8180b0ae0 0x7fa8180ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.589+0000 7fa81fcc9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa81806db20 0x7fa81815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.589+0000 7fa81fcc9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8180b4110 con 0x7fa818159c70 2023-11-04T01:39:19.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.589+0000 7fa81fcc9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8180b49b0 con 0x7fa8180b0ae0 2023-11-04T01:39:19.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.589+0000 7fa81fcc9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8180b43f0 con 0x7fa81806db20 2023-11-04T01:39:19.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.590+0000 7fa81d264640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa8180b0ae0 0x7fa8180ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.590+0000 7fa81da65640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa818159c70 0x7fa8180b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53240/0 (socket says 172.21.15.114:53240) 2023-11-04T01:39:19.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.590+0000 7fa81da65640 1 -- 172.21.15.114:0/4177272963 learned_addr learned my addr 172.21.15.114:0/4177272963 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:19.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.590+0000 7fa81e266640 1 --2- 172.21.15.114:0/4177272963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa81806db20 0x7fa81815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.590+0000 7fa81ca63640 1 -- 172.21.15.114:0/4177272963 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513338359 0 0) 0x7fa8180b4110 con 0x7fa818159c70 2023-11-04T01:39:19.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.590+0000 7fa81ca63640 1 -- 172.21.15.114:0/4177272963 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa804003520 con 0x7fa818159c70 2023-11-04T01:39:19.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.590+0000 7fa81d264640 1 -- 172.21.15.114:0/4177272963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa81806db20 msgr2=0x7fa81815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:19.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.590+0000 7fa81d264640 1 --2- 172.21.15.114:0/4177272963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa81806db20 0x7fa81815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.590+0000 7fa81d264640 1 -- 172.21.15.114:0/4177272963 >> v1:172.21.15.114:6789/0 conn(0x7fa818159c70 legacy=0x7fa8180b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.590+0000 7fa81d264640 1 -- 172.21.15.114:0/4177272963 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8180b46d0 con 0x7fa8180b0ae0 2023-11-04T01:39:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.591+0000 7fa81d264640 1 --2- 172.21.15.114:0/4177272963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8180b0ae0 0x7fa8180ce370 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa8080097a0 tx=0x7fa80802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf8a852a806f7a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.591+0000 7fa81ca63640 1 -- 172.21.15.114:0/4177272963 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80802d040 con 0x7fa8180b0ae0 2023-11-04T01:39:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.591+0000 7fa81ca63640 1 -- 172.21.15.114:0/4177272963 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa808031810 con 0x7fa8180b0ae0 2023-11-04T01:39:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.591+0000 7fa81ca63640 1 -- 172.21.15.114:0/4177272963 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808031b80 con 0x7fa8180b0ae0 2023-11-04T01:39:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.592+0000 7fa81fcc9640 1 -- 172.21.15.114:0/4177272963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8180b0ae0 msgr2=0x7fa8180ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.592+0000 7fa81fcc9640 1 --2- 172.21.15.114:0/4177272963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8180b0ae0 0x7fa8180ce370 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa8080097a0 tx=0x7fa80802b8b0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.592+0000 7fa81fcc9640 1 -- 172.21.15.114:0/4177272963 shutdown_connections 2023-11-04T01:39:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.592+0000 7fa81fcc9640 1 --2- 172.21.15.114:0/4177272963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa81806db20 0x7fa81815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.592+0000 7fa81fcc9640 1 --2- 172.21.15.114:0/4177272963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8180b0ae0 0x7fa8180ce370 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.592+0000 7fa81fcc9640 1 -- 172.21.15.114:0/4177272963 >> 172.21.15.114:0/4177272963 conn(0x7fa8180ce950 msgr2=0x7fa8180ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:19.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.592+0000 7fa81fcc9640 1 -- 172.21.15.114:0/4177272963 shutdown_connections 2023-11-04T01:39:19.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.592+0000 7fa81fcc9640 1 -- 172.21.15.114:0/4177272963 wait complete. 2023-11-04T01:39:19.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.593+0000 7fa81fcc9640 1 Processor -- start 2023-11-04T01:39:19.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.593+0000 7fa81fcc9640 1 -- start start 2023-11-04T01:39:19.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.594+0000 7fa81fcc9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa81806db20 0x7fa818156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.594+0000 7fa81fcc9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8180b0ae0 0x7fa8180c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.594+0000 7fa81fcc9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa818159c70 0x7fa8181f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.594+0000 7fa81fcc9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8180c52b0 con 0x7fa8180b0ae0 2023-11-04T01:39:19.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.594+0000 7fa81fcc9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa818143c40 con 0x7fa81806db20 2023-11-04T01:39:19.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.594+0000 7fa81fcc9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8180c7e40 con 0x7fa818159c70 2023-11-04T01:39:19.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.594+0000 7fa81d264640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8180b0ae0 0x7fa8180c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.594+0000 7fa81d264640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8180b0ae0 0x7fa8180c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33040/0 (socket says 172.21.15.114:33040) 2023-11-04T01:39:19.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.594+0000 7fa81d264640 1 -- 172.21.15.114:0/3054898602 learned_addr learned my addr 172.21.15.114:0/3054898602 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:19.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.594+0000 7fa81e266640 1 --2- 172.21.15.114:0/3054898602 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa818159c70 0x7fa8181f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.594+0000 7fa81da65640 1 --2- 172.21.15.114:0/3054898602 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa81806db20 0x7fa818156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.594+0000 7fa81d264640 1 -- 172.21.15.114:0/3054898602 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa818159c70 msgr2=0x7fa8181f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.594+0000 7fa81d264640 1 --2- 172.21.15.114:0/3054898602 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa818159c70 0x7fa8181f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.594+0000 7fa81d264640 1 -- 172.21.15.114:0/3054898602 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa81806db20 msgr2=0x7fa818156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.594+0000 7fa81d264640 1 --2- 172.21.15.114:0/3054898602 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa81806db20 0x7fa818156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.594+0000 7fa81d264640 1 -- 172.21.15.114:0/3054898602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa808009400 con 0x7fa8180b0ae0 2023-11-04T01:39:19.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.595+0000 7fa81d264640 1 --2- 172.21.15.114:0/3054898602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8180b0ae0 0x7fa8180c73f0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fa80802b8f0 tx=0x7fa8080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:19.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.595+0000 7fa80e7fc640 1 -- 172.21.15.114:0/3054898602 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808006e10 con 0x7fa8180b0ae0 2023-11-04T01:39:19.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.595+0000 7fa80e7fc640 1 -- 172.21.15.114:0/3054898602 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80803ad60 con 0x7fa8180b0ae0 2023-11-04T01:39:19.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.595+0000 7fa81fcc9640 1 -- 172.21.15.114:0/3054898602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8180c8120 con 0x7fa8180b0ae0 2023-11-04T01:39:19.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.595+0000 7fa80e7fc640 1 -- 172.21.15.114:0/3054898602 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808044610 con 0x7fa8180b0ae0 2023-11-04T01:39:19.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.595+0000 7fa81fcc9640 1 -- 172.21.15.114:0/3054898602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8181f3770 con 0x7fa8180b0ae0 2023-11-04T01:39:19.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.596+0000 7fa81fcc9640 1 -- 172.21.15.114:0/3054898602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa818074290 con 0x7fa8180b0ae0 2023-11-04T01:39:19.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.596+0000 7fa80e7fc640 1 -- 172.21.15.114:0/3054898602 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa80804d450 con 0x7fa8180b0ae0 2023-11-04T01:39:19.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.597+0000 7fa80e7fc640 1 --2- 172.21.15.114:0/3054898602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7fc06aea0 0x7fa7fc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.597+0000 7fa80e7fc640 1 -- 172.21.15.114:0/3054898602 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7fa8080aba30 con 0x7fa8180b0ae0 2023-11-04T01:39:19.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.597+0000 7fa81da65640 1 --2- 172.21.15.114:0/3054898602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7fc06aea0 0x7fa7fc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.597+0000 7fa81da65640 1 --2- 172.21.15.114:0/3054898602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7fc06aea0 0x7fa7fc06d360 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa814007fd0 tx=0x7fa814009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:19.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.601+0000 7fa80e7fc640 1 -- 172.21.15.114:0/3054898602 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa8080769f0 con 0x7fa8180b0ae0 2023-11-04T01:39:19.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.779+0000 7fa81fcc9640 1 -- 172.21.15.114:0/3054898602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa81806d3f0 con 0x7fa8180b0ae0 2023-11-04T01:39:19.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.779+0000 7fa80e7fc640 1 -- 172.21.15.114:0/3054898602 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+287 (secure 0 0 0) 0x7fa808035020 con 0x7fa8180b0ae0 2023-11-04T01:39:19.781 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:19.781 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2023-11-04T01:39:19.781 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:19.781 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2023-11-04T01:39:19.782 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2023-11-04T01:39:19.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:19.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:19.782 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 7, 2023-11-04T01:39:19.782 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "snap-test-pool" 2023-11-04T01:39:19.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:19.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:19.782 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 12, 2023-11-04T01:39:19.782 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "test_data_pool" 2023-11-04T01:39:19.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:19.782 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:19.782 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 13, 2023-11-04T01:39:19.782 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "test_metadata_pool" 2023-11-04T01:39:19.783 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:19.783 INFO:teuthology.orchestra.run.smithi114.stdout:] 2023-11-04T01:39:19.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.781+0000 7fa81fcc9640 1 -- 172.21.15.114:0/3054898602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7fc06aea0 msgr2=0x7fa7fc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.781+0000 7fa81fcc9640 1 --2- 172.21.15.114:0/3054898602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7fc06aea0 0x7fa7fc06d360 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa814007fd0 tx=0x7fa814009040 comp rx=0 tx=0).stop 2023-11-04T01:39:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.781+0000 7fa81fcc9640 1 -- 172.21.15.114:0/3054898602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8180b0ae0 msgr2=0x7fa8180c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.781+0000 7fa81fcc9640 1 --2- 172.21.15.114:0/3054898602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8180b0ae0 0x7fa8180c73f0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fa80802b8f0 tx=0x7fa8080046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.781+0000 7fa81fcc9640 1 -- 172.21.15.114:0/3054898602 shutdown_connections 2023-11-04T01:39:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.781+0000 7fa81fcc9640 1 --2- 172.21.15.114:0/3054898602 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa818159c70 0x7fa8181f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.781+0000 7fa81fcc9640 1 --2- 172.21.15.114:0/3054898602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8180b0ae0 0x7fa8180c73f0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.781+0000 7fa81fcc9640 1 --2- 172.21.15.114:0/3054898602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7fc06aea0 0x7fa7fc06d360 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.781+0000 7fa81fcc9640 1 --2- 172.21.15.114:0/3054898602 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa81806db20 0x7fa818156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.781+0000 7fa81fcc9640 1 -- 172.21.15.114:0/3054898602 >> 172.21.15.114:0/3054898602 conn(0x7fa8180ce950 msgr2=0x7fa8180b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:19.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.781+0000 7fa81fcc9640 1 -- 172.21.15.114:0/3054898602 shutdown_connections 2023-11-04T01:39:19.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.781+0000 7fa81fcc9640 1 -- 172.21.15.114:0/3054898602 wait complete. 2023-11-04T01:39:19.794 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:39:19.794 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:39:19.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.897+0000 7f5b86056640 1 Processor -- start 2023-11-04T01:39:19.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.898+0000 7f5b86056640 1 -- start start 2023-11-04T01:39:19.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.898+0000 7f5b86056640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b800cd9f0 0x7f5b800cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.898+0000 7f5b86056640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b800d1320 con 0x7f5b8015d4b0 2023-11-04T01:39:19.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.898+0000 7f5b86056640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b800b5600 con 0x7f5b800d27c0 2023-11-04T01:39:19.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.898+0000 7f5b86056640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8015e4d0 con 0x7f5b800cd9f0 2023-11-04T01:39:19.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.898+0000 7f5b7effd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5b8015d4b0 0x7f5b800b47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53246/0 (socket says 172.21.15.114:53246) 2023-11-04T01:39:19.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.898+0000 7f5b7effd640 1 -- 172.21.15.114:0/372280261 learned_addr learned my addr 172.21.15.114:0/372280261 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:19.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7f7fe640 1 --2- 172.21.15.114:0/372280261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b800cd9f0 0x7f5b800cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 -- 172.21.15.114:0/372280261 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983281608 0 0) 0x7f5b800d1320 con 0x7f5b8015d4b0 2023-11-04T01:39:19.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 -- 172.21.15.114:0/372280261 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b6c003520 con 0x7f5b8015d4b0 2023-11-04T01:39:19.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 -- 172.21.15.114:0/372280261 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244381053 0 0) 0x7f5b800b5600 con 0x7f5b800d27c0 2023-11-04T01:39:19.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 -- 172.21.15.114:0/372280261 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b800d1320 con 0x7f5b800d27c0 2023-11-04T01:39:19.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 -- 172.21.15.114:0/372280261 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 950102913 0 0) 0x7f5b6c003520 con 0x7f5b8015d4b0 2023-11-04T01:39:19.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 -- 172.21.15.114:0/372280261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b800cd9f0 msgr2=0x7f5b800cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:19.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 --2- 172.21.15.114:0/372280261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b800cd9f0 0x7f5b800cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 -- 172.21.15.114:0/372280261 >> v1:172.21.15.141:6789/0 conn(0x7f5b800d27c0 legacy=0x7f5b800b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 -- 172.21.15.114:0/372280261 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b800ce310 con 0x7f5b8015d4b0 2023-11-04T01:39:19.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 -- 172.21.15.114:0/372280261 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f5b68001670 con 0x7f5b8015d4b0 2023-11-04T01:39:19.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7f7fe640 1 --2- 172.21.15.114:0/372280261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b800cd9f0 0x7f5b800cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:19.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 -- 172.21.15.114:0/372280261 >> v1:172.21.15.114:6789/0 conn(0x7f5b8015d4b0 legacy=0x7f5b800b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 --2- 172.21.15.114:0/372280261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b800cd9f0 0x7f5b6c003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 --2- 172.21.15.114:0/372280261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b6c0040c0 0x7f5b6c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 --2- 172.21.15.114:0/372280261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b6c004d00 0x7f5b6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 -- 172.21.15.114:0/372280261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8015e4d0 con 0x7f5b6c0040c0 2023-11-04T01:39:19.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 -- 172.21.15.114:0/372280261 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c00ba90 con 0x7f5b6c004d00 2023-11-04T01:39:19.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7e7fc640 1 -- 172.21.15.114:0/372280261 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c00bc50 con 0x7f5b800cd9f0 2023-11-04T01:39:19.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7effd640 1 --2- 172.21.15.114:0/372280261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b6c0040c0 0x7f5b6c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7ffff640 1 --2- 172.21.15.114:0/372280261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b6c004d00 0x7f5b6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.899+0000 7f5b7f7fe640 1 --2- 172.21.15.114:0/372280261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b800cd9f0 0x7f5b6c003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.900+0000 7f5b7effd640 1 -- 172.21.15.114:0/372280261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b800cd9f0 msgr2=0x7f5b6c003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:19.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.900+0000 7f5b7effd640 1 --2- 172.21.15.114:0/372280261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b800cd9f0 0x7f5b6c003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.900+0000 7f5b7effd640 1 -- 172.21.15.114:0/372280261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b6c004d00 msgr2=0x7f5b6c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:19.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.900+0000 7f5b7effd640 1 --2- 172.21.15.114:0/372280261 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b6c004d00 0x7f5b6c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.900+0000 7f5b7effd640 1 -- 172.21.15.114:0/372280261 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b70009a70 con 0x7f5b6c0040c0 2023-11-04T01:39:19.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.900+0000 7f5b7f7fe640 1 --2- 172.21.15.114:0/372280261 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b800cd9f0 0x7f5b6c003b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:19.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.900+0000 7f5b7effd640 1 --2- 172.21.15.114:0/372280261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b6c0040c0 0x7f5b6c0047c0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f5b68001eb0 tx=0x7f5b6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebcdcc94793b266 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:19.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.900+0000 7f5b7e7fc640 1 -- 172.21.15.114:0/372280261 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68005ad0 con 0x7f5b6c0040c0 2023-11-04T01:39:19.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.900+0000 7f5b7e7fc640 1 -- 172.21.15.114:0/372280261 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b68005c30 con 0x7f5b6c0040c0 2023-11-04T01:39:19.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.900+0000 7f5b7e7fc640 1 -- 172.21.15.114:0/372280261 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68007290 con 0x7f5b6c0040c0 2023-11-04T01:39:19.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.901+0000 7f5b86056640 1 -- 172.21.15.114:0/372280261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b6c0040c0 msgr2=0x7f5b6c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.901+0000 7f5b86056640 1 --2- 172.21.15.114:0/372280261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b6c0040c0 0x7f5b6c0047c0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f5b68001eb0 tx=0x7f5b6c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.901+0000 7f5b7ffff640 1 -- 172.21.15.114:0/372280261 reap_dead start 2023-11-04T01:39:19.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.901+0000 7f5b86056640 1 -- 172.21.15.114:0/372280261 shutdown_connections 2023-11-04T01:39:19.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.901+0000 7f5b86056640 1 -- 172.21.15.114:0/372280261 >> 172.21.15.114:0/372280261 conn(0x7f5b80071c40 msgr2=0x7f5b80072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:19.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.901+0000 7f5b86056640 1 -- 172.21.15.114:0/372280261 shutdown_connections 2023-11-04T01:39:19.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.901+0000 7f5b86056640 1 -- 172.21.15.114:0/372280261 wait complete. 2023-11-04T01:39:19.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.902+0000 7f5b86056640 1 Processor -- start 2023-11-04T01:39:19.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.902+0000 7f5b86056640 1 -- start start 2023-11-04T01:39:19.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.903+0000 7f5b86056640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b6c0040c0 0x7f5b801f2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.903+0000 7f5b86056640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b800b3f90 0x7f5b8015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.903+0000 7f5b86056640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b8015ae10 0x7f5b8015b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.903+0000 7f5b86056640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8015b7d0 con 0x7f5b8015ae10 2023-11-04T01:39:19.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.903+0000 7f5b86056640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b800a96e0 con 0x7f5b800b3f90 2023-11-04T01:39:19.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.903+0000 7f5b86056640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b801f2ce0 con 0x7f5b6c0040c0 2023-11-04T01:39:19.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.903+0000 7f5b7ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b8015ae10 0x7f5b8015b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.903+0000 7f5b7ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b8015ae10 0x7f5b8015b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33064/0 (socket says 172.21.15.114:33064) 2023-11-04T01:39:19.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.903+0000 7f5b7ffff640 1 -- 172.21.15.114:0/580934729 learned_addr learned my addr 172.21.15.114:0/580934729 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:19.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.903+0000 7f5b7f7fe640 1 --2- 172.21.15.114:0/580934729 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b6c0040c0 0x7f5b801f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.903+0000 7f5b7effd640 1 --2- 172.21.15.114:0/580934729 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b800b3f90 0x7f5b8015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.904+0000 7f5b7ffff640 1 -- 172.21.15.114:0/580934729 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b6c0040c0 msgr2=0x7f5b801f2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.904+0000 7f5b7ffff640 1 --2- 172.21.15.114:0/580934729 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b6c0040c0 0x7f5b801f2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.904+0000 7f5b7ffff640 1 -- 172.21.15.114:0/580934729 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b800b3f90 msgr2=0x7f5b8015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:19.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.904+0000 7f5b7ffff640 1 --2- 172.21.15.114:0/580934729 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b800b3f90 0x7f5b8015bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:19.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.904+0000 7f5b7ffff640 1 -- 172.21.15.114:0/580934729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b801f2fc0 con 0x7f5b8015ae10 2023-11-04T01:39:19.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.904+0000 7f5b7f7fe640 1 --2- 172.21.15.114:0/580934729 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b6c0040c0 0x7f5b801f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:19.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.904+0000 7f5b7effd640 1 --2- 172.21.15.114:0/580934729 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b800b3f90 0x7f5b8015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:19.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.904+0000 7f5b7ffff640 1 --2- 172.21.15.114:0/580934729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b8015ae10 0x7f5b8015b290 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f5b800d3be0 tx=0x7f5b7800fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:19.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.904+0000 7f5b77fff640 1 -- 172.21.15.114:0/580934729 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b78005030 con 0x7f5b8015ae10 2023-11-04T01:39:19.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.904+0000 7f5b77fff640 1 -- 172.21.15.114:0/580934729 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b780051d0 con 0x7f5b8015ae10 2023-11-04T01:39:19.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.904+0000 7f5b86056640 1 -- 172.21.15.114:0/580934729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b801f32a0 con 0x7f5b8015ae10 2023-11-04T01:39:19.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.904+0000 7f5b77fff640 1 -- 172.21.15.114:0/580934729 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b780067d0 con 0x7f5b8015ae10 2023-11-04T01:39:19.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.904+0000 7f5b86056640 1 -- 172.21.15.114:0/580934729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8015c2c0 con 0x7f5b8015ae10 2023-11-04T01:39:19.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.905+0000 7f5b86056640 1 -- 172.21.15.114:0/580934729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b800a98e0 con 0x7f5b8015ae10 2023-11-04T01:39:19.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.905+0000 7f5b77fff640 1 -- 172.21.15.114:0/580934729 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b78006930 con 0x7f5b8015ae10 2023-11-04T01:39:19.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.906+0000 7f5b77fff640 1 --2- 172.21.15.114:0/580934729 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5b6006aea0 0x7f5b6006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:19.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.906+0000 7f5b77fff640 1 -- 172.21.15.114:0/580934729 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f5b780888c0 con 0x7f5b8015ae10 2023-11-04T01:39:19.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.906+0000 7f5b7f7fe640 1 --2- 172.21.15.114:0/580934729 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5b6006aea0 0x7f5b6006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:19.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.906+0000 7f5b7f7fe640 1 --2- 172.21.15.114:0/580934729 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5b6006aea0 0x7f5b6006d360 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5b70013580 tx=0x7f5b7000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:19.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:19.914+0000 7f5b77fff640 1 -- 172.21.15.114:0/580934729 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5b800a98e0 con 0x7f5b8015ae10 2023-11-04T01:39:20.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.087+0000 7f5b86056640 1 -- 172.21.15.114:0/580934729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5b800a98e0 con 0x7f5b8015ae10 2023-11-04T01:39:20.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:20.122 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:20.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.646+0000 7f5b77fff640 1 -- 172.21.15.114:0/580934729 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5b800a98e0 con 0x7f5b8015ae10 2023-11-04T01:39:20.648 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2023-11-04T01:39:20.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.648+0000 7f5b86056640 1 -- 172.21.15.114:0/580934729 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5b6006aea0 msgr2=0x7f5b6006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.648+0000 7f5b86056640 1 --2- 172.21.15.114:0/580934729 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5b6006aea0 0x7f5b6006d360 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5b70013580 tx=0x7f5b7000b040 comp rx=0 tx=0).stop 2023-11-04T01:39:20.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.648+0000 7f5b86056640 1 -- 172.21.15.114:0/580934729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b8015ae10 msgr2=0x7f5b8015b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.648+0000 7f5b86056640 1 --2- 172.21.15.114:0/580934729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b8015ae10 0x7f5b8015b290 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f5b800d3be0 tx=0x7f5b7800fc00 comp rx=0 tx=0).stop 2023-11-04T01:39:20.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.648+0000 7f5b86056640 1 -- 172.21.15.114:0/580934729 shutdown_connections 2023-11-04T01:39:20.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.648+0000 7f5b86056640 1 --2- 172.21.15.114:0/580934729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b8015ae10 0x7f5b8015b290 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.648+0000 7f5b86056640 1 --2- 172.21.15.114:0/580934729 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5b6006aea0 0x7f5b6006d360 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.648+0000 7f5b86056640 1 --2- 172.21.15.114:0/580934729 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5b800b3f90 0x7f5b8015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.648+0000 7f5b86056640 1 --2- 172.21.15.114:0/580934729 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5b6c0040c0 0x7f5b801f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.648+0000 7f5b86056640 1 -- 172.21.15.114:0/580934729 >> 172.21.15.114:0/580934729 conn(0x7f5b80071c40 msgr2=0x7f5b80072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:20.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.649+0000 7f5b86056640 1 -- 172.21.15.114:0/580934729 shutdown_connections 2023-11-04T01:39:20.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.649+0000 7f5b86056640 1 -- 172.21.15.114:0/580934729 wait complete. 2023-11-04T01:39:20.665 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:39:20.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.770+0000 7f615a705640 1 Processor -- start 2023-11-04T01:39:20.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.770+0000 7f615a705640 1 -- start start 2023-11-04T01:39:20.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.771+0000 7f615a705640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6154159c00 0x7f61540cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.771+0000 7f615a705640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f61540ae1d0 0x7f61540c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.771+0000 7f615a705640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615415aff0 con 0x7f61540c48e0 2023-11-04T01:39:20.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.771+0000 7f615a705640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61540c52d0 con 0x7f6154159c00 2023-11-04T01:39:20.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.771+0000 7f615a705640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615415a3e0 con 0x7f61540ae1d0 2023-11-04T01:39:20.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.771+0000 7f6153fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6154159c00 0x7f61540cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.771+0000 7f6153fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6154159c00 0x7f61540cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33080/0 (socket says 172.21.15.114:33080) 2023-11-04T01:39:20.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.771+0000 7f6153fff640 1 -- 172.21.15.114:0/2418569650 learned_addr learned my addr 172.21.15.114:0/2418569650 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:20.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.771+0000 7f6158ca2640 1 --2- 172.21.15.114:0/2418569650 >> v2:172.21.15.141:3300/0 conn(0x7f61540ae1d0 0x7f61540c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.771+0000 7f6153fff640 1 -- 172.21.15.114:0/2418569650 >> v2:172.21.15.141:3300/0 conn(0x7f61540ae1d0 msgr2=0x7f61540c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:20.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.771+0000 7f6153fff640 1 --2- 172.21.15.114:0/2418569650 >> v2:172.21.15.141:3300/0 conn(0x7f61540ae1d0 0x7f61540c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.771+0000 7f6153fff640 1 -- 172.21.15.114:0/2418569650 >> v1:172.21.15.141:6789/0 conn(0x7f61540c48e0 legacy=0x7f61540adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:20.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.771+0000 7f6153fff640 1 -- 172.21.15.114:0/2418569650 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615415a6c0 con 0x7f6154159c00 2023-11-04T01:39:20.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.771+0000 7f6158ca2640 1 --2- 172.21.15.114:0/2418569650 >> v2:172.21.15.141:3300/0 conn(0x7f61540ae1d0 0x7f61540c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:20.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.772+0000 7f6153fff640 1 --2- 172.21.15.114:0/2418569650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6154159c00 0x7f61540cc890 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f61540ce800 tx=0x7f614402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec2c4016e9ac452 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:20.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.772+0000 7f6152ffd640 1 -- 172.21.15.114:0/2418569650 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61440317e0 con 0x7f6154159c00 2023-11-04T01:39:20.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.772+0000 7f6152ffd640 1 -- 172.21.15.114:0/2418569650 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6144031940 con 0x7f6154159c00 2023-11-04T01:39:20.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.772+0000 7f6152ffd640 1 -- 172.21.15.114:0/2418569650 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144031cd0 con 0x7f6154159c00 2023-11-04T01:39:20.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.773+0000 7f615a705640 1 -- 172.21.15.114:0/2418569650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6154159c00 msgr2=0x7f61540cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.773+0000 7f615a705640 1 --2- 172.21.15.114:0/2418569650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6154159c00 0x7f61540cc890 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f61540ce800 tx=0x7f614402b880 comp rx=0 tx=0).stop 2023-11-04T01:39:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.773+0000 7f615a705640 1 -- 172.21.15.114:0/2418569650 shutdown_connections 2023-11-04T01:39:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.773+0000 7f615a705640 1 --2- 172.21.15.114:0/2418569650 >> v2:172.21.15.141:3300/0 conn(0x7f61540ae1d0 0x7f61540c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.773+0000 7f615a705640 1 --2- 172.21.15.114:0/2418569650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6154159c00 0x7f61540cc890 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.773+0000 7f615a705640 1 -- 172.21.15.114:0/2418569650 >> 172.21.15.114:0/2418569650 conn(0x7f61540ce950 msgr2=0x7f61540ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.773+0000 7f615a705640 1 -- 172.21.15.114:0/2418569650 shutdown_connections 2023-11-04T01:39:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.773+0000 7f615a705640 1 -- 172.21.15.114:0/2418569650 wait complete. 2023-11-04T01:39:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.774+0000 7f615a705640 1 Processor -- start 2023-11-04T01:39:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.774+0000 7f615a705640 1 -- start start 2023-11-04T01:39:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f615a705640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61540ae1d0 0x7f61541efbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f615a705640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61540c48e0 0x7f615414cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f615a705640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6154159c00 0x7f6154157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f615a705640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615414f510 con 0x7f6154159c00 2023-11-04T01:39:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f615a705640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615414e730 con 0x7f61540ae1d0 2023-11-04T01:39:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f615a705640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61541f0100 con 0x7f61540c48e0 2023-11-04T01:39:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f6158ca2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6154159c00 0x7f6154157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f6158ca2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6154159c00 0x7f6154157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33084/0 (socket says 172.21.15.114:33084) 2023-11-04T01:39:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f6158ca2640 1 -- 172.21.15.114:0/2803108073 learned_addr learned my addr 172.21.15.114:0/2803108073 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f6153fff640 1 --2- 172.21.15.114:0/2803108073 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61540ae1d0 0x7f61541efbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f61537fe640 1 --2- 172.21.15.114:0/2803108073 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61540c48e0 0x7f615414cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f6158ca2640 1 -- 172.21.15.114:0/2803108073 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61540c48e0 msgr2=0x7f615414cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f6158ca2640 1 --2- 172.21.15.114:0/2803108073 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61540c48e0 0x7f615414cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f6158ca2640 1 -- 172.21.15.114:0/2803108073 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61540ae1d0 msgr2=0x7f61541efbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f6158ca2640 1 --2- 172.21.15.114:0/2803108073 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61540ae1d0 0x7f61541efbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f6158ca2640 1 -- 172.21.15.114:0/2803108073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61440094d0 con 0x7f6154159c00 2023-11-04T01:39:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f6153fff640 1 --2- 172.21.15.114:0/2803108073 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61540ae1d0 0x7f61541efbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:20.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f61537fe640 1 --2- 172.21.15.114:0/2803108073 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61540c48e0 0x7f615414cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:20.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.775+0000 7f6158ca2640 1 --2- 172.21.15.114:0/2803108073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6154159c00 0x7f6154157910 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f614c00cef0 tx=0x7f614c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:20.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.776+0000 7f6150ff9640 1 -- 172.21.15.114:0/2803108073 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c00d840 con 0x7f6154159c00 2023-11-04T01:39:20.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.776+0000 7f6150ff9640 1 -- 172.21.15.114:0/2803108073 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c00d9c0 con 0x7f6154159c00 2023-11-04T01:39:20.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.776+0000 7f615a705640 1 -- 172.21.15.114:0/2803108073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615414e9b0 con 0x7f6154159c00 2023-11-04T01:39:20.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.776+0000 7f6150ff9640 1 -- 172.21.15.114:0/2803108073 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c00dd70 con 0x7f6154159c00 2023-11-04T01:39:20.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.776+0000 7f615a705640 1 -- 172.21.15.114:0/2803108073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615414ef50 con 0x7f6154159c00 2023-11-04T01:39:20.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.776+0000 7f615a705640 1 -- 172.21.15.114:0/2803108073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6154074290 con 0x7f6154159c00 2023-11-04T01:39:20.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.777+0000 7f6150ff9640 1 -- 172.21.15.114:0/2803108073 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f614c01e3b0 con 0x7f6154159c00 2023-11-04T01:39:20.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.777+0000 7f6150ff9640 1 --2- 172.21.15.114:0/2803108073 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f614006ae70 0x7f614006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:20.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.778+0000 7f6150ff9640 1 -- 172.21.15.114:0/2803108073 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6610+0+0 (secure 0 0 0) 0x7f614c08a440 con 0x7f6154159c00 2023-11-04T01:39:20.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.778+0000 7f6153fff640 1 --2- 172.21.15.114:0/2803108073 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f614006ae70 0x7f614006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:20.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.778+0000 7f6153fff640 1 --2- 172.21.15.114:0/2803108073 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f614006ae70 0x7f614006d330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6144036000 tx=0x7f614403d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:20.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.782+0000 7f6150ff9640 1 -- 172.21.15.114:0/2803108073 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f614c055220 con 0x7f6154159c00 2023-11-04T01:39:20.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:20.950+0000 7f615a705640 1 -- 172.21.15.114:0/2803108073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f615414a360 con 0x7f6154159c00 2023-11-04T01:39:21.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.651+0000 7f6150ff9640 1 -- 172.21.15.114:0/2803108073 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) v1 ==== 170+0+0 (secure 0 0 0) 0x7f614c058840 con 0x7f6154159c00 2023-11-04T01:39:21.653 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2023-11-04T01:39:21.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.654+0000 7f615a705640 1 -- 172.21.15.114:0/2803108073 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f614006ae70 msgr2=0x7f614006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.654+0000 7f615a705640 1 --2- 172.21.15.114:0/2803108073 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f614006ae70 0x7f614006d330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6144036000 tx=0x7f614403d040 comp rx=0 tx=0).stop 2023-11-04T01:39:21.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.654+0000 7f615a705640 1 -- 172.21.15.114:0/2803108073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6154159c00 msgr2=0x7f6154157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.654+0000 7f615a705640 1 --2- 172.21.15.114:0/2803108073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6154159c00 0x7f6154157910 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f614c00cef0 tx=0x7f614c00a710 comp rx=0 tx=0).stop 2023-11-04T01:39:21.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.655+0000 7f615a705640 1 -- 172.21.15.114:0/2803108073 shutdown_connections 2023-11-04T01:39:21.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.655+0000 7f615a705640 1 --2- 172.21.15.114:0/2803108073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6154159c00 0x7f6154157910 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.655+0000 7f615a705640 1 --2- 172.21.15.114:0/2803108073 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61540c48e0 0x7f615414cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.655+0000 7f615a705640 1 --2- 172.21.15.114:0/2803108073 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f614006ae70 0x7f614006d330 secure :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6144036000 tx=0x7f614403d040 comp rx=0 tx=0).stop 2023-11-04T01:39:21.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.655+0000 7f615a705640 1 --2- 172.21.15.114:0/2803108073 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f61540ae1d0 0x7f61541efbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.655+0000 7f615a705640 1 -- 172.21.15.114:0/2803108073 >> 172.21.15.114:0/2803108073 conn(0x7f61540ce950 msgr2=0x7f615415b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:21.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.657+0000 7f615a705640 1 -- 172.21.15.114:0/2803108073 shutdown_connections 2023-11-04T01:39:21.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.661+0000 7f615a705640 1 -- 172.21.15.114:0/2803108073 wait complete. 2023-11-04T01:39:21.685 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:39:21.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.787+0000 7f2b298c9640 1 Processor -- start 2023-11-04T01:39:21.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.787+0000 7f2b298c9640 1 -- start start 2023-11-04T01:39:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b298c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b240cd6d0 0x7f2b24161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b298c9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2b240b4880 0x7f2b240b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b298c9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b240cde60 con 0x7f2b24153e60 2023-11-04T01:39:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b298c9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b24160f90 con 0x7f2b240b4880 2023-11-04T01:39:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b298c9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b240b51e0 con 0x7f2b240cd6d0 2023-11-04T01:39:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b22ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2b24153e60 0x7f2b2415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53260/0 (socket says 172.21.15.114:53260) 2023-11-04T01:39:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b22ffd640 1 -- 172.21.15.114:0/433472170 learned_addr learned my addr 172.21.15.114:0/433472170 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b227fc640 1 -- 172.21.15.114:0/433472170 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722659793 0 0) 0x7f2b240cde60 con 0x7f2b24153e60 2023-11-04T01:39:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b237fe640 1 --2- 172.21.15.114:0/433472170 >> v2:172.21.15.141:3300/0 conn(0x7f2b240b4880 0x7f2b240b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b1bfff640 1 --2- 172.21.15.114:0/433472170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b240cd6d0 0x7f2b24161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b227fc640 1 -- 172.21.15.114:0/433472170 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b10003520 con 0x7f2b24153e60 2023-11-04T01:39:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b227fc640 1 -- 172.21.15.114:0/433472170 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2651703996 0 0) 0x7f2b10003520 con 0x7f2b24153e60 2023-11-04T01:39:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b227fc640 1 -- 172.21.15.114:0/433472170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b240cd6d0 msgr2=0x7f2b24161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b227fc640 1 --2- 172.21.15.114:0/433472170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b240cd6d0 0x7f2b24161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b227fc640 1 -- 172.21.15.114:0/433472170 >> v2:172.21.15.141:3300/0 conn(0x7f2b240b4880 msgr2=0x7f2b240b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:21.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b227fc640 1 --2- 172.21.15.114:0/433472170 >> v2:172.21.15.141:3300/0 conn(0x7f2b240b4880 0x7f2b240b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b227fc640 1 -- 172.21.15.114:0/433472170 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b24161960 con 0x7f2b24153e60 2023-11-04T01:39:21.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b227fc640 1 -- 172.21.15.114:0/433472170 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f2b14001670 con 0x7f2b24153e60 2023-11-04T01:39:21.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b227fc640 1 -- 172.21.15.114:0/433472170 >> v1:172.21.15.114:6789/0 conn(0x7f2b24153e60 legacy=0x7f2b2415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b227fc640 1 --2- 172.21.15.114:0/433472170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b240cd6d0 0x7f2b10003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b227fc640 1 --2- 172.21.15.114:0/433472170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b10003ef0 0x7f2b100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b227fc640 1 --2- 172.21.15.114:0/433472170 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b10004d00 0x7f2b10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b227fc640 1 -- 172.21.15.114:0/433472170 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b24160f90 con 0x7f2b10003ef0 2023-11-04T01:39:21.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b227fc640 1 -- 172.21.15.114:0/433472170 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b240b51e0 con 0x7f2b10004d00 2023-11-04T01:39:21.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b227fc640 1 -- 172.21.15.114:0/433472170 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1000b980 con 0x7f2b240cd6d0 2023-11-04T01:39:21.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b1bfff640 1 --2- 172.21.15.114:0/433472170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b10003ef0 0x7f2b100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.788+0000 7f2b22ffd640 1 --2- 172.21.15.114:0/433472170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b240cd6d0 0x7f2b10003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.789+0000 7f2b237fe640 1 --2- 172.21.15.114:0/433472170 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b10004d00 0x7f2b10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.789+0000 7f2b1bfff640 1 -- 172.21.15.114:0/433472170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b240cd6d0 msgr2=0x7f2b10003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:21.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.789+0000 7f2b1bfff640 1 --2- 172.21.15.114:0/433472170 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b240cd6d0 0x7f2b10003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.789+0000 7f2b1bfff640 1 -- 172.21.15.114:0/433472170 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b10004d00 msgr2=0x7f2b10005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:21.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.789+0000 7f2b1bfff640 1 --2- 172.21.15.114:0/433472170 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b10004d00 0x7f2b10005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.789+0000 7f2b1bfff640 1 -- 172.21.15.114:0/433472170 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b10003520 con 0x7f2b10003ef0 2023-11-04T01:39:21.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.789+0000 7f2b1bfff640 1 --2- 172.21.15.114:0/433472170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b10003ef0 0x7f2b100047c0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009ac0 tx=0x7f2b100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7f7932abde9317 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:21.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.790+0000 7f2b227fc640 1 -- 172.21.15.114:0/433472170 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c02c6b0 con 0x7f2b10003ef0 2023-11-04T01:39:21.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.790+0000 7f2b227fc640 1 -- 172.21.15.114:0/433472170 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c02c810 con 0x7f2b10003ef0 2023-11-04T01:39:21.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.790+0000 7f2b227fc640 1 -- 172.21.15.114:0/433472170 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c02cba0 con 0x7f2b10003ef0 2023-11-04T01:39:21.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.790+0000 7f2b298c9640 1 -- 172.21.15.114:0/433472170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b10003ef0 msgr2=0x7f2b100047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.790+0000 7f2b298c9640 1 --2- 172.21.15.114:0/433472170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b10003ef0 0x7f2b100047c0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009ac0 tx=0x7f2b100057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.790+0000 7f2b237fe640 1 -- 172.21.15.114:0/433472170 reap_dead start 2023-11-04T01:39:21.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.790+0000 7f2b298c9640 1 -- 172.21.15.114:0/433472170 shutdown_connections 2023-11-04T01:39:21.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.790+0000 7f2b298c9640 1 -- 172.21.15.114:0/433472170 >> 172.21.15.114:0/433472170 conn(0x7f2b240cf880 msgr2=0x7f2b240cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:21.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.790+0000 7f2b298c9640 1 -- 172.21.15.114:0/433472170 shutdown_connections 2023-11-04T01:39:21.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.790+0000 7f2b298c9640 1 -- 172.21.15.114:0/433472170 wait complete. 2023-11-04T01:39:21.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.791+0000 7f2b298c9640 1 Processor -- start 2023-11-04T01:39:21.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.791+0000 7f2b298c9640 1 -- start start 2023-11-04T01:39:21.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.792+0000 7f2b298c9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b10003ef0 0x7f2b24142830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.792+0000 7f2b298c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b240c82d0 0x7f2b2415f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.792+0000 7f2b298c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b240c5520 0x7f2b240c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.792+0000 7f2b298c9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b240c96c0 con 0x7f2b240c5520 2023-11-04T01:39:21.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.792+0000 7f2b298c9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b240c5ee0 con 0x7f2b10003ef0 2023-11-04T01:39:21.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.792+0000 7f2b298c9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b240c8a40 con 0x7f2b240c82d0 2023-11-04T01:39:21.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.792+0000 7f2b237fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b240c5520 0x7f2b240c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.792+0000 7f2b237fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b240c5520 0x7f2b240c59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33108/0 (socket says 172.21.15.114:33108) 2023-11-04T01:39:21.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.792+0000 7f2b237fe640 1 -- 172.21.15.114:0/3829438492 learned_addr learned my addr 172.21.15.114:0/3829438492 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:21.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.792+0000 7f2b237fe640 1 -- 172.21.15.114:0/3829438492 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b240c82d0 msgr2=0x7f2b2415f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.792+0000 7f2b237fe640 1 --2- 172.21.15.114:0/3829438492 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b240c82d0 0x7f2b2415f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.792+0000 7f2b237fe640 1 -- 172.21.15.114:0/3829438492 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b10003ef0 msgr2=0x7f2b24142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:21.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.792+0000 7f2b237fe640 1 --2- 172.21.15.114:0/3829438492 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b10003ef0 0x7f2b24142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:21.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.792+0000 7f2b237fe640 1 -- 172.21.15.114:0/3829438492 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b240c8d20 con 0x7f2b240c5520 2023-11-04T01:39:21.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.793+0000 7f2b237fe640 1 --2- 172.21.15.114:0/3829438492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b240c5520 0x7f2b240c59a0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f2b240b8f70 tx=0x7f2b1c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:21.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.793+0000 7f2b20ff9640 1 -- 172.21.15.114:0/3829438492 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c00e040 con 0x7f2b240c5520 2023-11-04T01:39:21.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.793+0000 7f2b20ff9640 1 -- 172.21.15.114:0/3829438492 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1c00f040 con 0x7f2b240c5520 2023-11-04T01:39:21.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.793+0000 7f2b20ff9640 1 -- 172.21.15.114:0/3829438492 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c015430 con 0x7f2b240c5520 2023-11-04T01:39:21.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.793+0000 7f2b298c9640 1 -- 172.21.15.114:0/3829438492 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b240c9000 con 0x7f2b240c5520 2023-11-04T01:39:21.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.793+0000 7f2b298c9640 1 -- 172.21.15.114:0/3829438492 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b240c8730 con 0x7f2b240c5520 2023-11-04T01:39:21.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.794+0000 7f2b298c9640 1 -- 172.21.15.114:0/3829438492 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b24074290 con 0x7f2b240c5520 2023-11-04T01:39:21.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.794+0000 7f2b20ff9640 1 -- 172.21.15.114:0/3829438492 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b1c015590 con 0x7f2b240c5520 2023-11-04T01:39:21.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.795+0000 7f2b20ff9640 1 --2- 172.21.15.114:0/3829438492 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2b0406ae70 0x7f2b0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:21.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.795+0000 7f2b20ff9640 1 -- 172.21.15.114:0/3829438492 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6992+0+0 (secure 0 0 0) 0x7f2b1c08a4d0 con 0x7f2b240c5520 2023-11-04T01:39:21.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.795+0000 7f2b22ffd640 1 --2- 172.21.15.114:0/3829438492 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2b0406ae70 0x7f2b0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:21.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.795+0000 7f2b22ffd640 1 --2- 172.21.15.114:0/3829438492 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2b0406ae70 0x7f2b0406d330 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2b14001b60 tx=0x7f2b14001ad0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:21.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:21.799+0000 7f2b20ff9640 1 -- 172.21.15.114:0/3829438492 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2b1c055110 con 0x7f2b240c5520 2023-11-04T01:39:22.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.001+0000 7f2b298c9640 1 -- 172.21.15.114:0/3829438492 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2b240d0b80 con 0x7f2b240c5520 2023-11-04T01:39:22.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.666+0000 7f2b20ff9640 1 -- 172.21.15.114:0/3829438492 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v33) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2b1c058730 con 0x7f2b240c5520 2023-11-04T01:39:22.670 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 14 and data pool 15 2023-11-04T01:39:22.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.675+0000 7f2b298c9640 1 -- 172.21.15.114:0/3829438492 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2b0406ae70 msgr2=0x7f2b0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.675+0000 7f2b298c9640 1 --2- 172.21.15.114:0/3829438492 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2b0406ae70 0x7f2b0406d330 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2b14001b60 tx=0x7f2b14001ad0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.675+0000 7f2b298c9640 1 -- 172.21.15.114:0/3829438492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b240c5520 msgr2=0x7f2b240c59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.675+0000 7f2b298c9640 1 --2- 172.21.15.114:0/3829438492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b240c5520 0x7f2b240c59a0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f2b240b8f70 tx=0x7f2b1c00f580 comp rx=0 tx=0).stop 2023-11-04T01:39:22.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.675+0000 7f2b298c9640 1 -- 172.21.15.114:0/3829438492 shutdown_connections 2023-11-04T01:39:22.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.675+0000 7f2b298c9640 1 --2- 172.21.15.114:0/3829438492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b240c5520 0x7f2b240c59a0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.675+0000 7f2b298c9640 1 --2- 172.21.15.114:0/3829438492 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b240c82d0 0x7f2b2415f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.675+0000 7f2b298c9640 1 --2- 172.21.15.114:0/3829438492 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2b0406ae70 0x7f2b0406d330 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.675+0000 7f2b298c9640 1 --2- 172.21.15.114:0/3829438492 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b10003ef0 0x7f2b24142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.675+0000 7f2b298c9640 1 -- 172.21.15.114:0/3829438492 >> 172.21.15.114:0/3829438492 conn(0x7f2b240cf880 msgr2=0x7f2b240cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:22.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.675+0000 7f2b298c9640 1 -- 172.21.15.114:0/3829438492 shutdown_connections 2023-11-04T01:39:22.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.675+0000 7f2b298c9640 1 -- 172.21.15.114:0/3829438492 wait complete. 2023-11-04T01:39:22.695 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:22.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.793+0000 7f107c5e2640 1 Processor -- start 2023-11-04T01:39:22.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.793+0000 7f107c5e2640 1 -- start start 2023-11-04T01:39:22.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.794+0000 7f107c5e2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f10740c9a40 0x7f10740c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.794+0000 7f107c5e2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107406b720 con 0x7f107415ad80 2023-11-04T01:39:22.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.794+0000 7f107c5e2640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107406cf60 con 0x7f107406a1b0 2023-11-04T01:39:22.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.794+0000 7f107c5e2640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10740ca430 con 0x7f10740c9a40 2023-11-04T01:39:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.794+0000 7f107a37e640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f107415ad80 0x7f10740abe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53266/0 (socket says 172.21.15.114:53266) 2023-11-04T01:39:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.794+0000 7f107a37e640 1 -- 172.21.15.114:0/1867274118 learned_addr learned my addr 172.21.15.114:0/1867274118 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.794+0000 7f107937c640 1 -- 172.21.15.114:0/1867274118 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754251688 0 0) 0x7f107406b720 con 0x7f107415ad80 2023-11-04T01:39:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.794+0000 7f107937c640 1 -- 172.21.15.114:0/1867274118 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1060003520 con 0x7f107415ad80 2023-11-04T01:39:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.794+0000 7f107ab7f640 1 --2- 172.21.15.114:0/1867274118 >> v2:172.21.15.141:3300/0 conn(0x7f10740c9a40 0x7f10740c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.794+0000 7f107937c640 1 -- 172.21.15.114:0/1867274118 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2055610547 0 0) 0x7f1060003520 con 0x7f107415ad80 2023-11-04T01:39:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.794+0000 7f107937c640 1 -- 172.21.15.114:0/1867274118 >> v2:172.21.15.141:3300/0 conn(0x7f10740c9a40 msgr2=0x7f10740c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.794+0000 7f107937c640 1 --2- 172.21.15.114:0/1867274118 >> v2:172.21.15.141:3300/0 conn(0x7f10740c9a40 0x7f10740c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.794+0000 7f107937c640 1 -- 172.21.15.114:0/1867274118 >> v1:172.21.15.141:6789/0 conn(0x7f107406a1b0 legacy=0x7f107406b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.794+0000 7f107937c640 1 -- 172.21.15.114:0/1867274118 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107415b160 con 0x7f107415ad80 2023-11-04T01:39:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.794+0000 7f107937c640 1 -- 172.21.15.114:0/1867274118 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f1070001670 con 0x7f107415ad80 2023-11-04T01:39:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.795+0000 7f107937c640 1 -- 172.21.15.114:0/1867274118 >> v1:172.21.15.114:6789/0 conn(0x7f107415ad80 legacy=0x7f10740abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.795+0000 7f107937c640 1 --2- 172.21.15.114:0/1867274118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1060003970 0x7f1060003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.795+0000 7f107937c640 1 --2- 172.21.15.114:0/1867274118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10600047c0 0x7f1060004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.795+0000 7f107937c640 1 --2- 172.21.15.114:0/1867274118 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1060005180 0x7f106000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.795+0000 7f107937c640 1 -- 172.21.15.114:0/1867274118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10740ca430 con 0x7f1060003970 2023-11-04T01:39:22.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.795+0000 7f107937c640 1 -- 172.21.15.114:0/1867274118 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106000c020 con 0x7f10600047c0 2023-11-04T01:39:22.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.795+0000 7f107937c640 1 -- 172.21.15.114:0/1867274118 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106000c1e0 con 0x7f1060005180 2023-11-04T01:39:22.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.795+0000 7f107a37e640 1 --2- 172.21.15.114:0/1867274118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1060003970 0x7f1060003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.795+0000 7f1079b7d640 1 --2- 172.21.15.114:0/1867274118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10600047c0 0x7f1060004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.795+0000 7f107ab7f640 1 --2- 172.21.15.114:0/1867274118 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1060005180 0x7f106000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.795+0000 7f107a37e640 1 -- 172.21.15.114:0/1867274118 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1060005180 msgr2=0x7f106000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:22.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.795+0000 7f107a37e640 1 --2- 172.21.15.114:0/1867274118 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1060005180 0x7f106000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.795+0000 7f107a37e640 1 -- 172.21.15.114:0/1867274118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10600047c0 msgr2=0x7f1060004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.795+0000 7f107a37e640 1 --2- 172.21.15.114:0/1867274118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f10600047c0 0x7f1060004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.795+0000 7f107a37e640 1 -- 172.21.15.114:0/1867274118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060003520 con 0x7f1060003970 2023-11-04T01:39:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.795+0000 7f107ab7f640 1 -- 172.21.15.114:0/1867274118 reap_dead start 2023-11-04T01:39:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.796+0000 7f107a37e640 1 --2- 172.21.15.114:0/1867274118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1060003970 0x7f1060003d90 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f1070001050 tx=0x7f10600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b342b913f60180d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.796+0000 7f107937c640 1 -- 172.21.15.114:0/1867274118 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1070005ad0 con 0x7f1060003970 2023-11-04T01:39:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.796+0000 7f107937c640 1 -- 172.21.15.114:0/1867274118 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1070005c30 con 0x7f1060003970 2023-11-04T01:39:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.796+0000 7f107937c640 1 -- 172.21.15.114:0/1867274118 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107002ca50 con 0x7f1060003970 2023-11-04T01:39:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.796+0000 7f107c5e2640 1 -- 172.21.15.114:0/1867274118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1060003970 msgr2=0x7f1060003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.796+0000 7f107c5e2640 1 --2- 172.21.15.114:0/1867274118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1060003970 0x7f1060003d90 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f1070001050 tx=0x7f10600057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.796+0000 7f107c5e2640 1 -- 172.21.15.114:0/1867274118 shutdown_connections 2023-11-04T01:39:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.796+0000 7f107c5e2640 1 --2- 172.21.15.114:0/1867274118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1060003970 0x7f1060003d90 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.796+0000 7f107c5e2640 1 -- 172.21.15.114:0/1867274118 >> 172.21.15.114:0/1867274118 conn(0x7f10740b0cd0 msgr2=0x7f10740b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:22.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.796+0000 7f107c5e2640 1 -- 172.21.15.114:0/1867274118 shutdown_connections 2023-11-04T01:39:22.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.796+0000 7f107c5e2640 1 -- 172.21.15.114:0/1867274118 wait complete. 2023-11-04T01:39:22.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.797+0000 7f107c5e2640 1 Processor -- start 2023-11-04T01:39:22.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.798+0000 7f107c5e2640 1 -- start start 2023-11-04T01:39:22.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.798+0000 7f107c5e2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1060003970 0x7f10740c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.798+0000 7f107c5e2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10740ce6e0 0x7f10740c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.798+0000 7f107c5e2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f107414a240 0x7f107414a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.798+0000 7f107c5e2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10740c8e50 con 0x7f1060003970 2023-11-04T01:39:22.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.798+0000 7f107c5e2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107414ac00 con 0x7f107414a240 2023-11-04T01:39:22.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.798+0000 7f107c5e2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10740c5df0 con 0x7f10740ce6e0 2023-11-04T01:39:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.798+0000 7f107a37e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1060003970 0x7f10740c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.798+0000 7f107a37e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1060003970 0x7f10740c62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33122/0 (socket says 172.21.15.114:33122) 2023-11-04T01:39:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.798+0000 7f107a37e640 1 -- 172.21.15.114:0/4250647505 learned_addr learned my addr 172.21.15.114:0/4250647505 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.798+0000 7f1079b7d640 1 --2- 172.21.15.114:0/4250647505 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10740ce6e0 0x7f10740c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.798+0000 7f107ab7f640 1 --2- 172.21.15.114:0/4250647505 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f107414a240 0x7f107414a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.799+0000 7f107a37e640 1 -- 172.21.15.114:0/4250647505 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10740ce6e0 msgr2=0x7f10740c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.799+0000 7f107a37e640 1 --2- 172.21.15.114:0/4250647505 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10740ce6e0 0x7f10740c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.799+0000 7f107a37e640 1 -- 172.21.15.114:0/4250647505 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f107414a240 msgr2=0x7f107414a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.799+0000 7f107a37e640 1 --2- 172.21.15.114:0/4250647505 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f107414a240 0x7f107414a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.799+0000 7f107a37e640 1 -- 172.21.15.114:0/4250647505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10740c6970 con 0x7f1060003970 2023-11-04T01:39:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.799+0000 7f107a37e640 1 --2- 172.21.15.114:0/4250647505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1060003970 0x7f10740c62b0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f107002c3b0 tx=0x7f1070000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.799+0000 7f106affd640 1 -- 172.21.15.114:0/4250647505 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107003c070 con 0x7f1060003970 2023-11-04T01:39:22.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.799+0000 7f106affd640 1 -- 172.21.15.114:0/4250647505 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107002ca20 con 0x7f1060003970 2023-11-04T01:39:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.799+0000 7f107c5e2640 1 -- 172.21.15.114:0/4250647505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10740c6c50 con 0x7f1060003970 2023-11-04T01:39:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.799+0000 7f106affd640 1 -- 172.21.15.114:0/4250647505 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107002cd90 con 0x7f1060003970 2023-11-04T01:39:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.799+0000 7f107c5e2640 1 -- 172.21.15.114:0/4250647505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10740c7210 con 0x7f1060003970 2023-11-04T01:39:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.800+0000 7f107c5e2640 1 -- 172.21.15.114:0/4250647505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10740c73d0 con 0x7f1060003970 2023-11-04T01:39:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.800+0000 7f106affd640 1 -- 172.21.15.114:0/4250647505 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1070032070 con 0x7f1060003970 2023-11-04T01:39:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.801+0000 7f106affd640 1 --2- 172.21.15.114:0/4250647505 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f105806ae70 0x7f105806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.801+0000 7f106affd640 1 -- 172.21.15.114:0/4250647505 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f10700aa9f0 con 0x7f1060003970 2023-11-04T01:39:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.801+0000 7f1079b7d640 1 --2- 172.21.15.114:0/4250647505 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f105806ae70 0x7f105806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.801+0000 7f1079b7d640 1 --2- 172.21.15.114:0/4250647505 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f105806ae70 0x7f105806d330 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f10740c9420 tx=0x7f1064009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:22.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.805+0000 7f106affd640 1 -- 172.21.15.114:0/4250647505 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1070075700 con 0x7f1060003970 2023-11-04T01:39:22.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.974+0000 7f107c5e2640 1 -- 172.21.15.114:0/4250647505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1074074290 con 0x7f1060003970 2023-11-04T01:39:22.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.976+0000 7f106affd640 1 -- 172.21.15.114:0/4250647505 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22026 (secure 0 0 0) 0x7f1070045020 con 0x7f1060003970 2023-11-04T01:39:22.978 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:22.978 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":82,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:22.003146+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:20.107188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:20.970024+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:22.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.978+0000 7f107c5e2640 1 -- 172.21.15.114:0/4250647505 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f105806ae70 msgr2=0x7f105806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.978+0000 7f107c5e2640 1 --2- 172.21.15.114:0/4250647505 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f105806ae70 0x7f105806d330 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f10740c9420 tx=0x7f1064009040 comp rx=0 tx=0).stop 2023-11-04T01:39:22.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.978+0000 7f107c5e2640 1 -- 172.21.15.114:0/4250647505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1060003970 msgr2=0x7f10740c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:22.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.978+0000 7f107c5e2640 1 --2- 172.21.15.114:0/4250647505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1060003970 0x7f10740c62b0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f107002c3b0 tx=0x7f1070000fe0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.978+0000 7f107c5e2640 1 -- 172.21.15.114:0/4250647505 shutdown_connections 2023-11-04T01:39:22.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.978+0000 7f107c5e2640 1 --2- 172.21.15.114:0/4250647505 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f105806ae70 0x7f105806d330 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.978+0000 7f107c5e2640 1 --2- 172.21.15.114:0/4250647505 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f107414a240 0x7f107414a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.978+0000 7f107c5e2640 1 --2- 172.21.15.114:0/4250647505 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f10740ce6e0 0x7f10740c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.978+0000 7f107c5e2640 1 --2- 172.21.15.114:0/4250647505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1060003970 0x7f10740c62b0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:22.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.978+0000 7f107c5e2640 1 -- 172.21.15.114:0/4250647505 >> 172.21.15.114:0/4250647505 conn(0x7f10740b0cd0 msgr2=0x7f107406ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:22.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.978+0000 7f107c5e2640 1 -- 172.21.15.114:0/4250647505 shutdown_connections 2023-11-04T01:39:22.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:22.978+0000 7f107c5e2640 1 -- 172.21.15.114:0/4250647505 wait complete. 2023-11-04T01:39:22.990 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:23.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.089+0000 7fd4bbeaf640 1 Processor -- start 2023-11-04T01:39:23.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.089+0000 7fd4bbeaf640 1 -- start start 2023-11-04T01:39:23.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4bbeaf640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd4b4159c70 0x7fd4b40ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4bbeaf640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b406db20 0x7fd4b40b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4bbeaf640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b40b4110 con 0x7fd4b40b0910 2023-11-04T01:39:23.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4bbeaf640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b40b49b0 con 0x7fd4b4159c70 2023-11-04T01:39:23.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4bbeaf640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40b0da0 con 0x7fd4b406db20 2023-11-04T01:39:23.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4ba44c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd4b40b0910 0x7fd4b415d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53282/0 (socket says 172.21.15.114:53282) 2023-11-04T01:39:23.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4ba44c640 1 -- 172.21.15.114:0/816030260 learned_addr learned my addr 172.21.15.114:0/816030260 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:23.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b944a640 1 --2- 172.21.15.114:0/816030260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b406db20 0x7fd4b40b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b9c4b640 1 --2- 172.21.15.114:0/816030260 >> v2:172.21.15.141:3300/0 conn(0x7fd4b4159c70 0x7fd4b40ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b8c49640 1 -- 172.21.15.114:0/816030260 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947668322 0 0) 0x7fd4b40b4110 con 0x7fd4b40b0910 2023-11-04T01:39:23.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b8c49640 1 -- 172.21.15.114:0/816030260 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4a0003520 con 0x7fd4b40b0910 2023-11-04T01:39:23.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b8c49640 1 -- 172.21.15.114:0/816030260 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3797306322 0 0) 0x7fd4a0003520 con 0x7fd4b40b0910 2023-11-04T01:39:23.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b8c49640 1 -- 172.21.15.114:0/816030260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b406db20 msgr2=0x7fd4b40b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:23.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b8c49640 1 --2- 172.21.15.114:0/816030260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b406db20 0x7fd4b40b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b8c49640 1 -- 172.21.15.114:0/816030260 >> v2:172.21.15.141:3300/0 conn(0x7fd4b4159c70 msgr2=0x7fd4b40ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:23.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b8c49640 1 --2- 172.21.15.114:0/816030260 >> v2:172.21.15.141:3300/0 conn(0x7fd4b4159c70 0x7fd4b40ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b8c49640 1 -- 172.21.15.114:0/816030260 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b40b43f0 con 0x7fd4b40b0910 2023-11-04T01:39:23.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b8c49640 1 -- 172.21.15.114:0/816030260 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fd4ac0019f0 con 0x7fd4b40b0910 2023-11-04T01:39:23.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b944a640 1 --2- 172.21.15.114:0/816030260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b406db20 0x7fd4b40b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:23.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b8c49640 1 -- 172.21.15.114:0/816030260 >> v1:172.21.15.114:6789/0 conn(0x7fd4b40b0910 legacy=0x7fd4b415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b8c49640 1 --2- 172.21.15.114:0/816030260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4a0003970 0x7fd4a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b8c49640 1 --2- 172.21.15.114:0/816030260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4a00047c0 0x7fd4a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b8c49640 1 --2- 172.21.15.114:0/816030260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b406db20 0x7fd4a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b8c49640 1 -- 172.21.15.114:0/816030260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40b49b0 con 0x7fd4a00047c0 2023-11-04T01:39:23.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b8c49640 1 -- 172.21.15.114:0/816030260 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40b0da0 con 0x7fd4a0003970 2023-11-04T01:39:23.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.090+0000 7fd4b8c49640 1 -- 172.21.15.114:0/816030260 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a000db90 con 0x7fd4b406db20 2023-11-04T01:39:23.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.091+0000 7fd4b944a640 1 --2- 172.21.15.114:0/816030260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4a00047c0 0x7fd4a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.091+0000 7fd4b9c4b640 1 --2- 172.21.15.114:0/816030260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4a0003970 0x7fd4a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.091+0000 7fd4ba44c640 1 --2- 172.21.15.114:0/816030260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b406db20 0x7fd4a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.091+0000 7fd4b944a640 1 -- 172.21.15.114:0/816030260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b406db20 msgr2=0x7fd4a0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:23.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.091+0000 7fd4b944a640 1 --2- 172.21.15.114:0/816030260 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b406db20 0x7fd4a0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.091+0000 7fd4b944a640 1 -- 172.21.15.114:0/816030260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4a0003970 msgr2=0x7fd4a0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:23.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.091+0000 7fd4b944a640 1 --2- 172.21.15.114:0/816030260 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4a0003970 0x7fd4a0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.091+0000 7fd4b944a640 1 -- 172.21.15.114:0/816030260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a4009400 con 0x7fd4a00047c0 2023-11-04T01:39:23.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.092+0000 7fd4b944a640 1 --2- 172.21.15.114:0/816030260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4a00047c0 0x7fd4a0004c40 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009c90 tx=0x7fd4a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774908005a36543f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.092+0000 7fd4b8c49640 1 -- 172.21.15.114:0/816030260 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a402c8f0 con 0x7fd4a00047c0 2023-11-04T01:39:23.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.092+0000 7fd4b8c49640 1 -- 172.21.15.114:0/816030260 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a402ca50 con 0x7fd4a00047c0 2023-11-04T01:39:23.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.092+0000 7fd4b8c49640 1 -- 172.21.15.114:0/816030260 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a402ce00 con 0x7fd4a00047c0 2023-11-04T01:39:23.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.092+0000 7fd4bbeaf640 1 -- 172.21.15.114:0/816030260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4a00047c0 msgr2=0x7fd4a0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.092+0000 7fd4bbeaf640 1 --2- 172.21.15.114:0/816030260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4a00047c0 0x7fd4a0004c40 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009c90 tx=0x7fd4a00057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.092+0000 7fd4ba44c640 1 -- 172.21.15.114:0/816030260 reap_dead start 2023-11-04T01:39:23.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.092+0000 7fd4bbeaf640 1 -- 172.21.15.114:0/816030260 shutdown_connections 2023-11-04T01:39:23.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.092+0000 7fd4bbeaf640 1 -- 172.21.15.114:0/816030260 >> 172.21.15.114:0/816030260 conn(0x7fd4b40ce950 msgr2=0x7fd4b40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:23.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.092+0000 7fd4bbeaf640 1 -- 172.21.15.114:0/816030260 shutdown_connections 2023-11-04T01:39:23.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.092+0000 7fd4bbeaf640 1 -- 172.21.15.114:0/816030260 wait complete. 2023-11-04T01:39:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.093+0000 7fd4bbeaf640 1 Processor -- start 2023-11-04T01:39:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.093+0000 7fd4bbeaf640 1 -- start start 2023-11-04T01:39:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.094+0000 7fd4bbeaf640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4a00047c0 0x7fd4b4157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.094+0000 7fd4bbeaf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4b4151e40 0x7fd4b41522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.094+0000 7fd4bbeaf640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b41ed2d0 0x7fd4b41ed750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.094+0000 7fd4bbeaf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b4154bb0 con 0x7fd4b4151e40 2023-11-04T01:39:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.094+0000 7fd4bbeaf640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40c52e0 con 0x7fd4a00047c0 2023-11-04T01:39:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.094+0000 7fd4bbeaf640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b4153f50 con 0x7fd4b41ed2d0 2023-11-04T01:39:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.094+0000 7fd4b944a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4b4151e40 0x7fd4b41522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.094+0000 7fd4b944a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4b4151e40 0x7fd4b41522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33142/0 (socket says 172.21.15.114:33142) 2023-11-04T01:39:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.094+0000 7fd4b944a640 1 -- 172.21.15.114:0/36477353 learned_addr learned my addr 172.21.15.114:0/36477353 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.094+0000 7fd4b9c4b640 1 --2- 172.21.15.114:0/36477353 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4a00047c0 0x7fd4b4157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.094+0000 7fd4ba44c640 1 --2- 172.21.15.114:0/36477353 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b41ed2d0 0x7fd4b41ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.095+0000 7fd4b944a640 1 -- 172.21.15.114:0/36477353 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b41ed2d0 msgr2=0x7fd4b41ed750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.095+0000 7fd4b944a640 1 --2- 172.21.15.114:0/36477353 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b41ed2d0 0x7fd4b41ed750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.095+0000 7fd4b944a640 1 -- 172.21.15.114:0/36477353 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4a00047c0 msgr2=0x7fd4b4157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.095+0000 7fd4b944a640 1 --2- 172.21.15.114:0/36477353 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4a00047c0 0x7fd4b4157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.095+0000 7fd4b944a640 1 -- 172.21.15.114:0/36477353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b4154210 con 0x7fd4b4151e40 2023-11-04T01:39:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.095+0000 7fd4b9c4b640 1 --2- 172.21.15.114:0/36477353 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4a00047c0 0x7fd4b4157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.095+0000 7fd4ba44c640 1 --2- 172.21.15.114:0/36477353 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b41ed2d0 0x7fd4b41ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.095+0000 7fd4b944a640 1 --2- 172.21.15.114:0/36477353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4b4151e40 0x7fd4b41522a0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4037040 tx=0x7fd4a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.095+0000 7fd4aa7fc640 1 -- 172.21.15.114:0/36477353 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4034ac0 con 0x7fd4b4151e40 2023-11-04T01:39:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.095+0000 7fd4aa7fc640 1 -- 172.21.15.114:0/36477353 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a4034c20 con 0x7fd4b4151e40 2023-11-04T01:39:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.095+0000 7fd4bbeaf640 1 -- 172.21.15.114:0/36477353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b41544f0 con 0x7fd4b4151e40 2023-11-04T01:39:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.095+0000 7fd4aa7fc640 1 -- 172.21.15.114:0/36477353 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4004020 con 0x7fd4b4151e40 2023-11-04T01:39:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.095+0000 7fd4bbeaf640 1 -- 172.21.15.114:0/36477353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b4153b40 con 0x7fd4b4151e40 2023-11-04T01:39:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.096+0000 7fd4bbeaf640 1 -- 172.21.15.114:0/36477353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b4074290 con 0x7fd4b4151e40 2023-11-04T01:39:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.096+0000 7fd4aa7fc640 1 -- 172.21.15.114:0/36477353 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4a4004180 con 0x7fd4b4151e40 2023-11-04T01:39:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.097+0000 7fd4aa7fc640 1 --2- 172.21.15.114:0/36477353 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd49806ae70 0x7fd49806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.097+0000 7fd4aa7fc640 1 -- 172.21.15.114:0/36477353 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fd4a40abe50 con 0x7fd4b4151e40 2023-11-04T01:39:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.097+0000 7fd4b9c4b640 1 --2- 172.21.15.114:0/36477353 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd49806ae70 0x7fd49806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.097+0000 7fd4b9c4b640 1 --2- 172.21.15.114:0/36477353 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd49806ae70 0x7fd49806d330 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009bc0 tx=0x7fd4b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.101+0000 7fd4aa7fc640 1 -- 172.21.15.114:0/36477353 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd4a4076a20 con 0x7fd4b4151e40 2023-11-04T01:39:23.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.268+0000 7fd4bbeaf640 1 -- 172.21.15.114:0/36477353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4b406d3f0 con 0x7fd4b4151e40 2023-11-04T01:39:23.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.269+0000 7fd4aa7fc640 1 -- 172.21.15.114:0/36477353 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22026 (secure 0 0 0) 0x7fd4a407a040 con 0x7fd4b4151e40 2023-11-04T01:39:23.272 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:23.272 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":82,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:22.003146+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:20.107188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:20.970024+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:23.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.271+0000 7fd4bbeaf640 1 -- 172.21.15.114:0/36477353 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd49806ae70 msgr2=0x7fd49806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.271+0000 7fd4bbeaf640 1 --2- 172.21.15.114:0/36477353 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd49806ae70 0x7fd49806d330 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009bc0 tx=0x7fd4b0008040 comp rx=0 tx=0).stop 2023-11-04T01:39:23.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.271+0000 7fd4bbeaf640 1 -- 172.21.15.114:0/36477353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4b4151e40 msgr2=0x7fd4b41522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.271+0000 7fd4bbeaf640 1 --2- 172.21.15.114:0/36477353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4b4151e40 0x7fd4b41522a0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4037040 tx=0x7fd4a4004730 comp rx=0 tx=0).stop 2023-11-04T01:39:23.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.271+0000 7fd4bbeaf640 1 -- 172.21.15.114:0/36477353 shutdown_connections 2023-11-04T01:39:23.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.271+0000 7fd4bbeaf640 1 --2- 172.21.15.114:0/36477353 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4b41ed2d0 0x7fd4b41ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.271+0000 7fd4bbeaf640 1 --2- 172.21.15.114:0/36477353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4b4151e40 0x7fd4b41522a0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.271+0000 7fd4bbeaf640 1 --2- 172.21.15.114:0/36477353 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd49806ae70 0x7fd49806d330 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.271+0000 7fd4bbeaf640 1 --2- 172.21.15.114:0/36477353 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4a00047c0 0x7fd4b4157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.271+0000 7fd4bbeaf640 1 -- 172.21.15.114:0/36477353 >> 172.21.15.114:0/36477353 conn(0x7fd4b40ce950 msgr2=0x7fd4b40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:23.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.271+0000 7fd4bbeaf640 1 -- 172.21.15.114:0/36477353 shutdown_connections 2023-11-04T01:39:23.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.271+0000 7fd4bbeaf640 1 -- 172.21.15.114:0/36477353 wait complete. 2023-11-04T01:39:23.284 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:39:23.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.384+0000 7f9a60768640 1 Processor -- start 2023-11-04T01:39:23.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.384+0000 7f9a60768640 1 -- start start 2023-11-04T01:39:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a60768640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a580cdc20 0x7f9a58165950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a60768640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a580d0280 con 0x7f9a580d0710 2023-11-04T01:39:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a60768640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a580cf670 con 0x7f9a5815e430 2023-11-04T01:39:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a60768640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a580cf950 con 0x7f9a580cdc20 2023-11-04T01:39:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5dd03640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9a580d0710 0x7f9a580cd510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53284/0 (socket says 172.21.15.114:53284) 2023-11-04T01:39:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5dd03640 1 -- 172.21.15.114:0/845392552 learned_addr learned my addr 172.21.15.114:0/845392552 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5d502640 1 -- 172.21.15.114:0/845392552 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822255370 0 0) 0x7f9a580d0280 con 0x7f9a580d0710 2023-11-04T01:39:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5d502640 1 -- 172.21.15.114:0/845392552 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a44003520 con 0x7f9a580d0710 2023-11-04T01:39:23.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5ed05640 1 --2- 172.21.15.114:0/845392552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a580cdc20 0x7f9a58165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5d502640 1 -- 172.21.15.114:0/845392552 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2134194187 0 0) 0x7f9a44003520 con 0x7f9a580d0710 2023-11-04T01:39:23.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5d502640 1 -- 172.21.15.114:0/845392552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a580cdc20 msgr2=0x7f9a58165950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:23.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5d502640 1 --2- 172.21.15.114:0/845392552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a580cdc20 0x7f9a58165950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5d502640 1 -- 172.21.15.114:0/845392552 >> v1:172.21.15.141:6789/0 conn(0x7f9a5815e430 legacy=0x7f9a580cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5d502640 1 -- 172.21.15.114:0/845392552 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a580cfc30 con 0x7f9a580d0710 2023-11-04T01:39:23.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5d502640 1 -- 172.21.15.114:0/845392552 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f9a48001670 con 0x7f9a580d0710 2023-11-04T01:39:23.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5d502640 1 -- 172.21.15.114:0/845392552 >> v1:172.21.15.114:6789/0 conn(0x7f9a580d0710 legacy=0x7f9a580cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5d502640 1 --2- 172.21.15.114:0/845392552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a440039a0 0x7f9a44003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5d502640 1 --2- 172.21.15.114:0/845392552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a580cdc20 0x7f9a440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5d502640 1 --2- 172.21.15.114:0/845392552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a44004d00 0x7f9a44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5d502640 1 -- 172.21.15.114:0/845392552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a580cf950 con 0x7f9a44004d00 2023-11-04T01:39:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5d502640 1 -- 172.21.15.114:0/845392552 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4400ba60 con 0x7f9a440039a0 2023-11-04T01:39:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5d502640 1 -- 172.21.15.114:0/845392552 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4400bc20 con 0x7f9a580cdc20 2023-11-04T01:39:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.385+0000 7f9a5ed05640 1 --2- 172.21.15.114:0/845392552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a44004d00 0x7f9a44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.386+0000 7f9a5e504640 1 --2- 172.21.15.114:0/845392552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a440039a0 0x7f9a44003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.386+0000 7f9a5dd03640 1 --2- 172.21.15.114:0/845392552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a580cdc20 0x7f9a440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.386+0000 7f9a5ed05640 1 -- 172.21.15.114:0/845392552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a580cdc20 msgr2=0x7f9a440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.386+0000 7f9a5ed05640 1 --2- 172.21.15.114:0/845392552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a580cdc20 0x7f9a440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.386+0000 7f9a5ed05640 1 -- 172.21.15.114:0/845392552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a440039a0 msgr2=0x7f9a44003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.386+0000 7f9a5ed05640 1 --2- 172.21.15.114:0/845392552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a440039a0 0x7f9a44003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.386+0000 7f9a5ed05640 1 -- 172.21.15.114:0/845392552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a44003520 con 0x7f9a44004d00 2023-11-04T01:39:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.386+0000 7f9a5ed05640 1 --2- 172.21.15.114:0/845392552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a44004d00 0x7f9a44005180 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009f90 tx=0x7f9a440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8e72521bb010ed server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.387+0000 7f9a5d502640 1 -- 172.21.15.114:0/845392552 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5002cbd0 con 0x7f9a44004d00 2023-11-04T01:39:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.387+0000 7f9a5d502640 1 -- 172.21.15.114:0/845392552 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5000f040 con 0x7f9a44004d00 2023-11-04T01:39:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.387+0000 7f9a5d502640 1 -- 172.21.15.114:0/845392552 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a50034440 con 0x7f9a44004d00 2023-11-04T01:39:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.387+0000 7f9a60768640 1 -- 172.21.15.114:0/845392552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a44004d00 msgr2=0x7f9a44005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.387+0000 7f9a60768640 1 --2- 172.21.15.114:0/845392552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a44004d00 0x7f9a44005180 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009f90 tx=0x7f9a440057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.387+0000 7f9a5ed05640 1 -- 172.21.15.114:0/845392552 reap_dead start 2023-11-04T01:39:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.387+0000 7f9a60768640 1 -- 172.21.15.114:0/845392552 shutdown_connections 2023-11-04T01:39:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.387+0000 7f9a60768640 1 -- 172.21.15.114:0/845392552 >> 172.21.15.114:0/845392552 conn(0x7f9a5806ea20 msgr2=0x7f9a5806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.387+0000 7f9a60768640 1 -- 172.21.15.114:0/845392552 shutdown_connections 2023-11-04T01:39:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.387+0000 7f9a60768640 1 -- 172.21.15.114:0/845392552 wait complete. 2023-11-04T01:39:23.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.388+0000 7f9a60768640 1 Processor -- start 2023-11-04T01:39:23.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.388+0000 7f9a60768640 1 -- start start 2023-11-04T01:39:23.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.389+0000 7f9a60768640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a44004d00 0x7f9a581f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.389+0000 7f9a60768640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a5814e850 0x7f9a581f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.389+0000 7f9a60768640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a5814a760 0x7f9a580b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.389+0000 7f9a60768640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5814b670 con 0x7f9a44004d00 2023-11-04T01:39:23.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.389+0000 7f9a60768640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5814b0b0 con 0x7f9a5814e850 2023-11-04T01:39:23.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.389+0000 7f9a60768640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5814b390 con 0x7f9a5814a760 2023-11-04T01:39:23.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.389+0000 7f9a5e504640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a44004d00 0x7f9a581f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.389+0000 7f9a5e504640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a44004d00 0x7f9a581f30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33162/0 (socket says 172.21.15.114:33162) 2023-11-04T01:39:23.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.389+0000 7f9a5e504640 1 -- 172.21.15.114:0/1744556003 learned_addr learned my addr 172.21.15.114:0/1744556003 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:23.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.389+0000 7f9a5ed05640 1 --2- 172.21.15.114:0/1744556003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a5814a760 0x7f9a580b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.389+0000 7f9a5dd03640 1 --2- 172.21.15.114:0/1744556003 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a5814e850 0x7f9a581f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.389+0000 7f9a5e504640 1 -- 172.21.15.114:0/1744556003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a5814a760 msgr2=0x7f9a580b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.389+0000 7f9a5e504640 1 --2- 172.21.15.114:0/1744556003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a5814a760 0x7f9a580b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.389+0000 7f9a5e504640 1 -- 172.21.15.114:0/1744556003 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a5814e850 msgr2=0x7f9a581f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.389+0000 7f9a5e504640 1 --2- 172.21.15.114:0/1744556003 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a5814e850 0x7f9a581f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.389+0000 7f9a5e504640 1 -- 172.21.15.114:0/1744556003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a581f39e0 con 0x7f9a44004d00 2023-11-04T01:39:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.390+0000 7f9a5e504640 1 --2- 172.21.15.114:0/1744556003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a44004d00 0x7f9a581f30e0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400f820 tx=0x7f9a5400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.390+0000 7f9a4effd640 1 -- 172.21.15.114:0/1744556003 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a540050d0 con 0x7f9a44004d00 2023-11-04T01:39:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.390+0000 7f9a4effd640 1 -- 172.21.15.114:0/1744556003 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a54005230 con 0x7f9a44004d00 2023-11-04T01:39:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.390+0000 7f9a4effd640 1 -- 172.21.15.114:0/1744556003 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5400d730 con 0x7f9a44004d00 2023-11-04T01:39:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.390+0000 7f9a60768640 1 -- 172.21.15.114:0/1744556003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a581f3cc0 con 0x7f9a44004d00 2023-11-04T01:39:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.390+0000 7f9a60768640 1 -- 172.21.15.114:0/1744556003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a581f4720 con 0x7f9a44004d00 2023-11-04T01:39:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.391+0000 7f9a60768640 1 -- 172.21.15.114:0/1744556003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5815d550 con 0x7f9a44004d00 2023-11-04T01:39:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.391+0000 7f9a4effd640 1 -- 172.21.15.114:0/1744556003 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a5400d890 con 0x7f9a44004d00 2023-11-04T01:39:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.391+0000 7f9a4effd640 1 --2- 172.21.15.114:0/1744556003 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9a3c06ae70 0x7f9a3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.392+0000 7f9a4effd640 1 -- 172.21.15.114:0/1744556003 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f9a54089b20 con 0x7f9a44004d00 2023-11-04T01:39:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.392+0000 7f9a5dd03640 1 --2- 172.21.15.114:0/1744556003 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9a3c06ae70 0x7f9a3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.392+0000 7f9a5dd03640 1 --2- 172.21.15.114:0/1744556003 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9a3c06ae70 0x7f9a3c06d330 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9a580b30c0 tx=0x7f9a48009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.396+0000 7f9a4effd640 1 -- 172.21.15.114:0/1744556003 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9a54054660 con 0x7f9a44004d00 2023-11-04T01:39:23.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.597+0000 7f9a60768640 1 -- 172.21.15.114:0/1744556003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9a58074290 con 0x7f9a44004d00 2023-11-04T01:39:23.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.665+0000 7f9a4effd640 1 -- 172.21.15.114:0/1744556003 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9a54057c80 con 0x7f9a44004d00 2023-11-04T01:39:23.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.667+0000 7f9a60768640 1 -- 172.21.15.114:0/1744556003 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9a3c06ae70 msgr2=0x7f9a3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.667+0000 7f9a60768640 1 --2- 172.21.15.114:0/1744556003 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9a3c06ae70 0x7f9a3c06d330 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9a580b30c0 tx=0x7f9a48009040 comp rx=0 tx=0).stop 2023-11-04T01:39:23.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.667+0000 7f9a60768640 1 -- 172.21.15.114:0/1744556003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a44004d00 msgr2=0x7f9a581f30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.667+0000 7f9a60768640 1 --2- 172.21.15.114:0/1744556003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a44004d00 0x7f9a581f30e0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400f820 tx=0x7f9a5400fce0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.667+0000 7f9a60768640 1 -- 172.21.15.114:0/1744556003 shutdown_connections 2023-11-04T01:39:23.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.667+0000 7f9a60768640 1 --2- 172.21.15.114:0/1744556003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9a5814a760 0x7f9a580b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.667+0000 7f9a60768640 1 --2- 172.21.15.114:0/1744556003 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9a3c06ae70 0x7f9a3c06d330 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.667+0000 7f9a60768640 1 --2- 172.21.15.114:0/1744556003 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9a5814e850 0x7f9a581f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.667+0000 7f9a60768640 1 --2- 172.21.15.114:0/1744556003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a44004d00 0x7f9a581f30e0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.667+0000 7f9a60768640 1 -- 172.21.15.114:0/1744556003 >> 172.21.15.114:0/1744556003 conn(0x7f9a5806ea20 msgr2=0x7f9a580c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:23.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.667+0000 7f9a60768640 1 -- 172.21.15.114:0/1744556003 shutdown_connections 2023-11-04T01:39:23.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.667+0000 7f9a60768640 1 -- 172.21.15.114:0/1744556003 wait complete. 2023-11-04T01:39:23.680 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:39:23.680 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:39:23.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.780+0000 7fd89f6fc640 1 Processor -- start 2023-11-04T01:39:23.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.780+0000 7fd89f6fc640 1 -- start start 2023-11-04T01:39:23.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.781+0000 7fd89f6fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd898159c00 0x7fd8980cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.781+0000 7fd89f6fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd8980c48e0 0x7fd8980c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.781+0000 7fd89f6fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89815aff0 con 0x7fd8980adac0 2023-11-04T01:39:23.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.781+0000 7fd89f6fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8980c52d0 con 0x7fd8980c48e0 2023-11-04T01:39:23.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.781+0000 7fd89f6fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89815a3e0 con 0x7fd898159c00 2023-11-04T01:39:23.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.781+0000 7fd89cc97640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd8980c48e0 0x7fd8980c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.781+0000 7fd89dc99640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd8980adac0 0x7fd8980adea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53290/0 (socket says 172.21.15.114:53290) 2023-11-04T01:39:23.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.781+0000 7fd89dc99640 1 -- 172.21.15.114:0/2694764924 learned_addr learned my addr 172.21.15.114:0/2694764924 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:23.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.782+0000 7fd89cc97640 1 -- 172.21.15.114:0/2694764924 >> v2:172.21.15.141:3300/0 conn(0x7fd898159c00 msgr2=0x7fd8980cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:23.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.782+0000 7fd89cc97640 1 --2- 172.21.15.114:0/2694764924 >> v2:172.21.15.141:3300/0 conn(0x7fd898159c00 0x7fd8980cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.782+0000 7fd89cc97640 1 -- 172.21.15.114:0/2694764924 >> v1:172.21.15.114:6789/0 conn(0x7fd8980adac0 legacy=0x7fd8980adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.782+0000 7fd89cc97640 1 -- 172.21.15.114:0/2694764924 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89815a6c0 con 0x7fd8980c48e0 2023-11-04T01:39:23.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.782+0000 7fd88ffff640 1 -- 172.21.15.114:0/2694764924 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616399684 0 0) 0x7fd89815aff0 con 0x7fd8980adac0 2023-11-04T01:39:23.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.782+0000 7fd89cc97640 1 --2- 172.21.15.114:0/2694764924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8980c48e0 0x7fd8980c4d90 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fd8980cc4d0 tx=0x7fd88802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbddb8ba03b2f2a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.782+0000 7fd88ffff640 1 -- 172.21.15.114:0/2694764924 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88802e070 con 0x7fd8980c48e0 2023-11-04T01:39:23.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.782+0000 7fd88ffff640 1 -- 172.21.15.114:0/2694764924 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8880315a0 con 0x7fd8980c48e0 2023-11-04T01:39:23.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.782+0000 7fd88ffff640 1 -- 172.21.15.114:0/2694764924 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd888031930 con 0x7fd8980c48e0 2023-11-04T01:39:23.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.783+0000 7fd89f6fc640 1 -- 172.21.15.114:0/2694764924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8980c48e0 msgr2=0x7fd8980c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.783+0000 7fd89f6fc640 1 --2- 172.21.15.114:0/2694764924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8980c48e0 0x7fd8980c4d90 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fd8980cc4d0 tx=0x7fd88802b840 comp rx=0 tx=0).stop 2023-11-04T01:39:23.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.783+0000 7fd89f6fc640 1 -- 172.21.15.114:0/2694764924 shutdown_connections 2023-11-04T01:39:23.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.783+0000 7fd89f6fc640 1 --2- 172.21.15.114:0/2694764924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8980c48e0 0x7fd8980c4d90 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.783+0000 7fd89f6fc640 1 --2- 172.21.15.114:0/2694764924 >> v2:172.21.15.141:3300/0 conn(0x7fd898159c00 0x7fd8980cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.783+0000 7fd89f6fc640 1 -- 172.21.15.114:0/2694764924 >> 172.21.15.114:0/2694764924 conn(0x7fd8980ce950 msgr2=0x7fd8980ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:23.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.783+0000 7fd89f6fc640 1 -- 172.21.15.114:0/2694764924 shutdown_connections 2023-11-04T01:39:23.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.783+0000 7fd89f6fc640 1 -- 172.21.15.114:0/2694764924 wait complete. 2023-11-04T01:39:23.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.784+0000 7fd89f6fc640 1 Processor -- start 2023-11-04T01:39:23.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.784+0000 7fd89f6fc640 1 -- start start 2023-11-04T01:39:23.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89f6fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8980adac0 0x7fd898151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89f6fc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8980c48e0 0x7fd8980c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89f6fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd898159c00 0x7fd8980c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89f6fc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd898157d10 con 0x7fd898159c00 2023-11-04T01:39:23.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89f6fc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd898157ff0 con 0x7fd8980c48e0 2023-11-04T01:39:23.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89f6fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8981582d0 con 0x7fd8980adac0 2023-11-04T01:39:23.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89dc99640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd898159c00 0x7fd8980c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89dc99640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd898159c00 0x7fd8980c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33176/0 (socket says 172.21.15.114:33176) 2023-11-04T01:39:23.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89dc99640 1 -- 172.21.15.114:0/2850216936 learned_addr learned my addr 172.21.15.114:0/2850216936 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:23.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89d498640 1 --2- 172.21.15.114:0/2850216936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8980adac0 0x7fd898151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89cc97640 1 --2- 172.21.15.114:0/2850216936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8980c48e0 0x7fd8980c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89dc99640 1 -- 172.21.15.114:0/2850216936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8980adac0 msgr2=0x7fd898151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89dc99640 1 --2- 172.21.15.114:0/2850216936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8980adac0 0x7fd898151530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89dc99640 1 -- 172.21.15.114:0/2850216936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8980c48e0 msgr2=0x7fd8980c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:23.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89dc99640 1 --2- 172.21.15.114:0/2850216936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8980c48e0 0x7fd8980c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:23.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89dc99640 1 -- 172.21.15.114:0/2850216936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd888009400 con 0x7fd898159c00 2023-11-04T01:39:23.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.785+0000 7fd89dc99640 1 --2- 172.21.15.114:0/2850216936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd898159c00 0x7fd8980c7f70 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fd89000c450 tx=0x7fd89000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.786+0000 7fd88dffb640 1 -- 172.21.15.114:0/2850216936 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8900074e0 con 0x7fd898159c00 2023-11-04T01:39:23.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.786+0000 7fd88dffb640 1 -- 172.21.15.114:0/2850216936 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd890007660 con 0x7fd898159c00 2023-11-04T01:39:23.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.786+0000 7fd89f6fc640 1 -- 172.21.15.114:0/2850216936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8981585b0 con 0x7fd898159c00 2023-11-04T01:39:23.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.786+0000 7fd88dffb640 1 -- 172.21.15.114:0/2850216936 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd890004a20 con 0x7fd898159c00 2023-11-04T01:39:23.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.786+0000 7fd89f6fc640 1 -- 172.21.15.114:0/2850216936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd898157a00 con 0x7fd898159c00 2023-11-04T01:39:23.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.787+0000 7fd89f6fc640 1 -- 172.21.15.114:0/2850216936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd898158ad0 con 0x7fd898159c00 2023-11-04T01:39:23.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.787+0000 7fd88dffb640 1 -- 172.21.15.114:0/2850216936 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd890004b80 con 0x7fd898159c00 2023-11-04T01:39:23.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.787+0000 7fd88dffb640 1 --2- 172.21.15.114:0/2850216936 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd87c06aea0 0x7fd87c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:23.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.788+0000 7fd88dffb640 1 -- 172.21.15.114:0/2850216936 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fd890088ff0 con 0x7fd898159c00 2023-11-04T01:39:23.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.788+0000 7fd89d498640 1 --2- 172.21.15.114:0/2850216936 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd87c06aea0 0x7fd87c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:23.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.788+0000 7fd89d498640 1 --2- 172.21.15.114:0/2850216936 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd87c06aea0 0x7fd87c06d360 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd8980c8620 tx=0x7fd8940094f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:23.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:23.792+0000 7fd88dffb640 1 -- 172.21.15.114:0/2850216936 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd898158ad0 con 0x7fd898159c00 2023-11-04T01:39:24.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.000+0000 7fd89f6fc640 1 -- 172.21.15.114:0/2850216936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd898158ad0 con 0x7fd898159c00 2023-11-04T01:39:24.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.676+0000 7fd88dffb640 1 -- 172.21.15.114:0/2850216936 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd898158ad0 con 0x7fd898159c00 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.678+0000 7fd89f6fc640 1 -- 172.21.15.114:0/2850216936 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd87c06aea0 msgr2=0x7fd87c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.678+0000 7fd89f6fc640 1 --2- 172.21.15.114:0/2850216936 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd87c06aea0 0x7fd87c06d360 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd8980c8620 tx=0x7fd8940094f0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.678+0000 7fd89f6fc640 1 -- 172.21.15.114:0/2850216936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd898159c00 msgr2=0x7fd8980c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.678+0000 7fd89f6fc640 1 --2- 172.21.15.114:0/2850216936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd898159c00 0x7fd8980c7f70 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fd89000c450 tx=0x7fd89000c910 comp rx=0 tx=0).stop 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.678+0000 7fd89f6fc640 1 -- 172.21.15.114:0/2850216936 shutdown_connections 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.678+0000 7fd89f6fc640 1 --2- 172.21.15.114:0/2850216936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd898159c00 0x7fd8980c7f70 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.678+0000 7fd89f6fc640 1 --2- 172.21.15.114:0/2850216936 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd87c06aea0 0x7fd87c06d360 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.678+0000 7fd89f6fc640 1 --2- 172.21.15.114:0/2850216936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd8980c48e0 0x7fd8980c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.678+0000 7fd89f6fc640 1 --2- 172.21.15.114:0/2850216936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd8980adac0 0x7fd898151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.678+0000 7fd89f6fc640 1 -- 172.21.15.114:0/2850216936 >> 172.21.15.114:0/2850216936 conn(0x7fd8980ce950 msgr2=0x7fd89806ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.678+0000 7fd89f6fc640 1 -- 172.21.15.114:0/2850216936 shutdown_connections 2023-11-04T01:39:24.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.678+0000 7fd89f6fc640 1 -- 172.21.15.114:0/2850216936 wait complete. 2023-11-04T01:39:24.691 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:39:24.692 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:24.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.792+0000 7f66f20c9640 1 Processor -- start 2023-11-04T01:39:24.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.792+0000 7f66f20c9640 1 -- start start 2023-11-04T01:39:24.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.792+0000 7f66f20c9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f66ec0cde60 0x7f66ec15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.792+0000 7f66f20c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66ec15daa0 0x7f66ec157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.793+0000 7f66f20c9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec15e000 con 0x7f66ec0ce240 2023-11-04T01:39:24.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.793+0000 7f66f20c9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ec15e5c0 con 0x7f66ec0cde60 2023-11-04T01:39:24.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.793+0000 7f66f20c9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec15e2e0 con 0x7f66ec15daa0 2023-11-04T01:39:24.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.793+0000 7f66eb7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f66ec0cde60 0x7f66ec15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.793+0000 7f66ebfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f66ec0ce240 0x7f66ec06b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53294/0 (socket says 172.21.15.114:53294) 2023-11-04T01:39:24.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.793+0000 7f66ebfff640 1 -- 172.21.15.114:0/1531247127 learned_addr learned my addr 172.21.15.114:0/1531247127 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:24.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.793+0000 7f66eb7fe640 1 -- 172.21.15.114:0/1531247127 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66ec15daa0 msgr2=0x7f66ec157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:24.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.793+0000 7f66eb7fe640 1 --2- 172.21.15.114:0/1531247127 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66ec15daa0 0x7f66ec157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.793+0000 7f66eb7fe640 1 -- 172.21.15.114:0/1531247127 >> v1:172.21.15.114:6789/0 conn(0x7f66ec0ce240 legacy=0x7f66ec06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.793+0000 7f66eb7fe640 1 -- 172.21.15.114:0/1531247127 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec0d1120 con 0x7f66ec0cde60 2023-11-04T01:39:24.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.793+0000 7f66eaffd640 1 -- 172.21.15.114:0/1531247127 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 558170984 0 0) 0x7f66ec15e000 con 0x7f66ec0ce240 2023-11-04T01:39:24.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.794+0000 7f66eb7fe640 1 --2- 172.21.15.114:0/1531247127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66ec0cde60 0x7f66ec15d560 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0097a0 tx=0x7f66dc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49e0dd776c9036f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.794+0000 7f66eaffd640 1 -- 172.21.15.114:0/1531247127 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc031830 con 0x7f66ec0cde60 2023-11-04T01:39:24.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.794+0000 7f66eaffd640 1 -- 172.21.15.114:0/1531247127 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc031990 con 0x7f66ec0cde60 2023-11-04T01:39:24.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.794+0000 7f66eaffd640 1 -- 172.21.15.114:0/1531247127 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc031d20 con 0x7f66ec0cde60 2023-11-04T01:39:24.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.794+0000 7f66f20c9640 1 -- 172.21.15.114:0/1531247127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66ec0cde60 msgr2=0x7f66ec15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.794+0000 7f66f20c9640 1 --2- 172.21.15.114:0/1531247127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66ec0cde60 0x7f66ec15d560 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0097a0 tx=0x7f66dc02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.794+0000 7f66f20c9640 1 -- 172.21.15.114:0/1531247127 shutdown_connections 2023-11-04T01:39:24.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.794+0000 7f66f20c9640 1 --2- 172.21.15.114:0/1531247127 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66ec15daa0 0x7f66ec157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.794+0000 7f66f20c9640 1 --2- 172.21.15.114:0/1531247127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66ec0cde60 0x7f66ec15d560 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.794+0000 7f66f20c9640 1 -- 172.21.15.114:0/1531247127 >> 172.21.15.114:0/1531247127 conn(0x7f66ec071f30 msgr2=0x7f66ec0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:24.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.795+0000 7f66f20c9640 1 -- 172.21.15.114:0/1531247127 shutdown_connections 2023-11-04T01:39:24.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.795+0000 7f66f20c9640 1 -- 172.21.15.114:0/1531247127 wait complete. 2023-11-04T01:39:24.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.796+0000 7f66f20c9640 1 Processor -- start 2023-11-04T01:39:24.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.796+0000 7f66f20c9640 1 -- start start 2023-11-04T01:39:24.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.796+0000 7f66f20c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66ec0cde60 0x7f66ec147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.796+0000 7f66f20c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66ec0ce240 0x7f66ec15adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.796+0000 7f66f20c9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66ec15daa0 0x7f66ec1579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.796+0000 7f66f20c9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec157ef0 con 0x7f66ec0ce240 2023-11-04T01:39:24.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.796+0000 7f66f20c9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec148910 con 0x7f66ec15daa0 2023-11-04T01:39:24.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.796+0000 7f66f20c9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec147d00 con 0x7f66ec0cde60 2023-11-04T01:39:24.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.796+0000 7f66e3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66ec0ce240 0x7f66ec15adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.796+0000 7f66e3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66ec0ce240 0x7f66ec15adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33198/0 (socket says 172.21.15.114:33198) 2023-11-04T01:39:24.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.796+0000 7f66e3fff640 1 -- 172.21.15.114:0/527944507 learned_addr learned my addr 172.21.15.114:0/527944507 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:24.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.797+0000 7f66eb7fe640 1 --2- 172.21.15.114:0/527944507 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66ec0cde60 0x7f66ec147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.797+0000 7f66ebfff640 1 --2- 172.21.15.114:0/527944507 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66ec15daa0 0x7f66ec1579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.797+0000 7f66e3fff640 1 -- 172.21.15.114:0/527944507 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66ec0cde60 msgr2=0x7f66ec147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.797+0000 7f66e3fff640 1 --2- 172.21.15.114:0/527944507 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66ec0cde60 0x7f66ec147600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.797+0000 7f66e3fff640 1 -- 172.21.15.114:0/527944507 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66ec15daa0 msgr2=0x7f66ec1579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.797+0000 7f66e3fff640 1 --2- 172.21.15.114:0/527944507 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66ec15daa0 0x7f66ec1579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.797+0000 7f66e3fff640 1 -- 172.21.15.114:0/527944507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc009400 con 0x7f66ec0ce240 2023-11-04T01:39:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.797+0000 7f66e3fff640 1 --2- 172.21.15.114:0/527944507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66ec0ce240 0x7f66ec15adc0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f66d400b410 tx=0x7f66d400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.797+0000 7f66e8ff9640 1 -- 172.21.15.114:0/527944507 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4011830 con 0x7f66ec0ce240 2023-11-04T01:39:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.797+0000 7f66e8ff9640 1 -- 172.21.15.114:0/527944507 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d40119b0 con 0x7f66ec0ce240 2023-11-04T01:39:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.797+0000 7f66e8ff9640 1 -- 172.21.15.114:0/527944507 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4011d60 con 0x7f66ec0ce240 2023-11-04T01:39:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.797+0000 7f66f20c9640 1 -- 172.21.15.114:0/527944507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ec147fe0 con 0x7f66ec0ce240 2023-11-04T01:39:24.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.797+0000 7f66f20c9640 1 -- 172.21.15.114:0/527944507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ec1485a0 con 0x7f66ec0ce240 2023-11-04T01:39:24.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.798+0000 7f66f20c9640 1 -- 172.21.15.114:0/527944507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ec074290 con 0x7f66ec0ce240 2023-11-04T01:39:24.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.798+0000 7f66e8ff9640 1 -- 172.21.15.114:0/527944507 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f66d401a400 con 0x7f66ec0ce240 2023-11-04T01:39:24.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.799+0000 7f66e8ff9640 1 --2- 172.21.15.114:0/527944507 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f66cc06aea0 0x7f66cc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:24.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.799+0000 7f66e8ff9640 1 -- 172.21.15.114:0/527944507 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f66d4089ba0 con 0x7f66ec0ce240 2023-11-04T01:39:24.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.799+0000 7f66eb7fe640 1 --2- 172.21.15.114:0/527944507 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f66cc06aea0 0x7f66cc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:24.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.799+0000 7f66eb7fe640 1 --2- 172.21.15.114:0/527944507 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f66cc06aea0 0x7f66cc06d360 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f66dc036000 tx=0x7f66dc03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:24.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:24.803+0000 7f66e8ff9640 1 -- 172.21.15.114:0/527944507 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f66d4054700 con 0x7f66ec0ce240 2023-11-04T01:39:25.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.006+0000 7f66f20c9640 1 -- 172.21.15.114:0/527944507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66ec148730 con 0x7f66ec0ce240 2023-11-04T01:39:25.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.007+0000 7f66e8ff9640 1 -- 172.21.15.114:0/527944507 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4924 (secure 0 0 0) 0x7f66d4015020 con 0x7f66ec0ce240 2023-11-04T01:39:25.009 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:25.009 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6055,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/775121992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":775121992},{"type":"v1","addr":"172.21.15.141:6835","nonce":775121992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6951,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1790830778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1790830778},{"type":"v1","addr":"172.21.15.114:6836","nonce":1790830778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6954,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2482757978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2482757978},{"type":"v1","addr":"172.21.15.114:6837","nonce":2482757978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:39:22.003461+0000","modified":"2023-11-04T01:39:24.001779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6966":{"gid":6966,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6834/1471552462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1471552462},{"type":"v1","addr":"172.21.15.141:6834","nonce":1471552462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:39:25.009 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 35 2023-11-04T01:39:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.009+0000 7f66f20c9640 1 -- 172.21.15.114:0/527944507 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f66cc06aea0 msgr2=0x7f66cc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.009+0000 7f66f20c9640 1 --2- 172.21.15.114:0/527944507 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f66cc06aea0 0x7f66cc06d360 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f66dc036000 tx=0x7f66dc03d040 comp rx=0 tx=0).stop 2023-11-04T01:39:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.009+0000 7f66f20c9640 1 -- 172.21.15.114:0/527944507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66ec0ce240 msgr2=0x7f66ec15adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.009+0000 7f66f20c9640 1 --2- 172.21.15.114:0/527944507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66ec0ce240 0x7f66ec15adc0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f66d400b410 tx=0x7f66d400b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.009+0000 7f66f20c9640 1 -- 172.21.15.114:0/527944507 shutdown_connections 2023-11-04T01:39:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.009+0000 7f66f20c9640 1 --2- 172.21.15.114:0/527944507 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f66cc06aea0 0x7f66cc06d360 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.009+0000 7f66f20c9640 1 --2- 172.21.15.114:0/527944507 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f66ec15daa0 0x7f66ec1579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.009+0000 7f66f20c9640 1 --2- 172.21.15.114:0/527944507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66ec0ce240 0x7f66ec15adc0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.009+0000 7f66f20c9640 1 --2- 172.21.15.114:0/527944507 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f66ec0cde60 0x7f66ec147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.009+0000 7f66f20c9640 1 -- 172.21.15.114:0/527944507 >> 172.21.15.114:0/527944507 conn(0x7f66ec071f30 msgr2=0x7f66ec0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.009+0000 7f66f20c9640 1 -- 172.21.15.114:0/527944507 shutdown_connections 2023-11-04T01:39:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.009+0000 7f66f20c9640 1 -- 172.21.15.114:0/527944507 wait complete. 2023-11-04T01:39:25.021 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:25.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.118+0000 7fe398f6c640 1 Processor -- start 2023-11-04T01:39:25.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.118+0000 7fe398f6c640 1 -- start start 2023-11-04T01:39:25.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.119+0000 7fe398f6c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe3940b42c0 0x7fe3940c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.119+0000 7fe398f6c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3940ca050 con 0x7fe39415ad80 2023-11-04T01:39:25.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.119+0000 7fe398f6c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39406cfa0 con 0x7fe3940c9c40 2023-11-04T01:39:25.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.119+0000 7fe398f6c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39406d280 con 0x7fe3940b42c0 2023-11-04T01:39:25.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.119+0000 7fe38bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe3940b42c0 0x7fe3940c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.119+0000 7fe39259c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe39415ad80 0x7fe39406c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53296/0 (socket says 172.21.15.114:53296) 2023-11-04T01:39:25.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.119+0000 7fe39259c640 1 -- 172.21.15.114:0/869197006 learned_addr learned my addr 172.21.15.114:0/869197006 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:25.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.119+0000 7fe38bfff640 1 -- 172.21.15.114:0/869197006 >> v1:172.21.15.141:6789/0 conn(0x7fe3940c9c40 legacy=0x7fe3940b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:25.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.119+0000 7fe38bfff640 1 -- 172.21.15.114:0/869197006 >> v1:172.21.15.114:6789/0 conn(0x7fe39415ad80 legacy=0x7fe39406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.119+0000 7fe38bfff640 1 -- 172.21.15.114:0/869197006 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39406d560 con 0x7fe3940b42c0 2023-11-04T01:39:25.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.119+0000 7fe391d9b640 1 -- 172.21.15.114:0/869197006 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472305368 0 0) 0x7fe3940ca050 con 0x7fe39415ad80 2023-11-04T01:39:25.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.120+0000 7fe38bfff640 1 --2- 172.21.15.114:0/869197006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3940b42c0 0x7fe3940c9700 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fe37c0097a0 tx=0x7fe37c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31aad037c3ed8e6f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:25.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.120+0000 7fe391d9b640 1 -- 172.21.15.114:0/869197006 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c030610 con 0x7fe3940b42c0 2023-11-04T01:39:25.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.120+0000 7fe391d9b640 1 -- 172.21.15.114:0/869197006 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37c030770 con 0x7fe3940b42c0 2023-11-04T01:39:25.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.120+0000 7fe391d9b640 1 -- 172.21.15.114:0/869197006 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c030b00 con 0x7fe3940b42c0 2023-11-04T01:39:25.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.121+0000 7fe398f6c640 1 -- 172.21.15.114:0/869197006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3940b42c0 msgr2=0x7fe3940c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.121+0000 7fe398f6c640 1 --2- 172.21.15.114:0/869197006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3940b42c0 0x7fe3940c9700 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fe37c0097a0 tx=0x7fe37c02b960 comp rx=0 tx=0).stop 2023-11-04T01:39:25.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.121+0000 7fe398f6c640 1 -- 172.21.15.114:0/869197006 shutdown_connections 2023-11-04T01:39:25.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.121+0000 7fe398f6c640 1 --2- 172.21.15.114:0/869197006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3940b42c0 0x7fe3940c9700 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.121+0000 7fe398f6c640 1 -- 172.21.15.114:0/869197006 >> 172.21.15.114:0/869197006 conn(0x7fe3940ce950 msgr2=0x7fe3940ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:25.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.121+0000 7fe398f6c640 1 -- 172.21.15.114:0/869197006 shutdown_connections 2023-11-04T01:39:25.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.121+0000 7fe398f6c640 1 -- 172.21.15.114:0/869197006 wait complete. 2023-11-04T01:39:25.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.122+0000 7fe398f6c640 1 Processor -- start 2023-11-04T01:39:25.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.122+0000 7fe398f6c640 1 -- start start 2023-11-04T01:39:25.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe398f6c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3940b42c0 0x7fe3940acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe398f6c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3940c9c40 0x7fe394151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe398f6c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39415ad80 0x7fe39415c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe398f6c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3940ad2a0 con 0x7fe39415ad80 2023-11-04T01:39:25.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe398f6c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe394152360 con 0x7fe3940b42c0 2023-11-04T01:39:25.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe398f6c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3940abcc0 con 0x7fe3940c9c40 2023-11-04T01:39:25.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe392d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39415ad80 0x7fe39415c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe392d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39415ad80 0x7fe39415c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33220/0 (socket says 172.21.15.114:33220) 2023-11-04T01:39:25.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe392d9d640 1 -- 172.21.15.114:0/3082730820 learned_addr learned my addr 172.21.15.114:0/3082730820 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:25.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe38bfff640 1 --2- 172.21.15.114:0/3082730820 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3940c9c40 0x7fe394151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe39259c640 1 --2- 172.21.15.114:0/3082730820 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3940b42c0 0x7fe3940acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe392d9d640 1 -- 172.21.15.114:0/3082730820 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3940c9c40 msgr2=0x7fe394151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe392d9d640 1 --2- 172.21.15.114:0/3082730820 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3940c9c40 0x7fe394151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe392d9d640 1 -- 172.21.15.114:0/3082730820 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3940b42c0 msgr2=0x7fe3940acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe392d9d640 1 --2- 172.21.15.114:0/3082730820 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3940b42c0 0x7fe3940acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe392d9d640 1 -- 172.21.15.114:0/3082730820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c009400 con 0x7fe39415ad80 2023-11-04T01:39:25.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe392d9d640 1 --2- 172.21.15.114:0/3082730820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39415ad80 0x7fe39415c290 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00c780 tx=0x7fe38c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:25.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe38affd640 1 -- 172.21.15.114:0/3082730820 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c004b60 con 0x7fe39415ad80 2023-11-04T01:39:25.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe38affd640 1 -- 172.21.15.114:0/3082730820 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c00ce90 con 0x7fe39415ad80 2023-11-04T01:39:25.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe398f6c640 1 -- 172.21.15.114:0/3082730820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3940abfa0 con 0x7fe39415ad80 2023-11-04T01:39:25.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe38affd640 1 -- 172.21.15.114:0/3082730820 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00a850 con 0x7fe39415ad80 2023-11-04T01:39:25.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.123+0000 7fe398f6c640 1 -- 172.21.15.114:0/3082730820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3940ac560 con 0x7fe39415ad80 2023-11-04T01:39:25.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.124+0000 7fe398f6c640 1 -- 172.21.15.114:0/3082730820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe394074290 con 0x7fe39415ad80 2023-11-04T01:39:25.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.125+0000 7fe38affd640 1 -- 172.21.15.114:0/3082730820 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe38c00a9b0 con 0x7fe39415ad80 2023-11-04T01:39:25.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.125+0000 7fe38affd640 1 --2- 172.21.15.114:0/3082730820 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe37406ae70 0x7fe37406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.125+0000 7fe38affd640 1 -- 172.21.15.114:0/3082730820 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fe38c089d40 con 0x7fe39415ad80 2023-11-04T01:39:25.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.125+0000 7fe39259c640 1 --2- 172.21.15.114:0/3082730820 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe37406ae70 0x7fe37406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.125+0000 7fe39259c640 1 --2- 172.21.15.114:0/3082730820 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe37406ae70 0x7fe37406d330 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe384000f60 tx=0x7fe384007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.129+0000 7fe38affd640 1 -- 172.21.15.114:0/3082730820 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe38c054880 con 0x7fe39415ad80 2023-11-04T01:39:25.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.297+0000 7fe398f6c640 1 -- 172.21.15.114:0/3082730820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3940b4880 con 0x7fe39415ad80 2023-11-04T01:39:25.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.299+0000 7fe38affd640 1 -- 172.21.15.114:0/3082730820 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22013 (secure 0 0 0) 0x7fe38c057ea0 con 0x7fe39415ad80 2023-11-04T01:39:25.301 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:25.301 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":83,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:23.665473+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:20.107188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:20.970024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:25.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.300+0000 7fe398f6c640 1 -- 172.21.15.114:0/3082730820 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe37406ae70 msgr2=0x7fe37406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.300+0000 7fe398f6c640 1 --2- 172.21.15.114:0/3082730820 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe37406ae70 0x7fe37406d330 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe384000f60 tx=0x7fe384007c00 comp rx=0 tx=0).stop 2023-11-04T01:39:25.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.300+0000 7fe398f6c640 1 -- 172.21.15.114:0/3082730820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39415ad80 msgr2=0x7fe39415c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.300+0000 7fe398f6c640 1 --2- 172.21.15.114:0/3082730820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39415ad80 0x7fe39415c290 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00c780 tx=0x7fe38c00cc40 comp rx=0 tx=0).stop 2023-11-04T01:39:25.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.300+0000 7fe398f6c640 1 -- 172.21.15.114:0/3082730820 shutdown_connections 2023-11-04T01:39:25.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.300+0000 7fe398f6c640 1 --2- 172.21.15.114:0/3082730820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39415ad80 0x7fe39415c290 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.300+0000 7fe398f6c640 1 --2- 172.21.15.114:0/3082730820 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe3940c9c40 0x7fe394151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.300+0000 7fe398f6c640 1 --2- 172.21.15.114:0/3082730820 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe37406ae70 0x7fe37406d330 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.300+0000 7fe398f6c640 1 --2- 172.21.15.114:0/3082730820 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe3940b42c0 0x7fe3940acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.300+0000 7fe398f6c640 1 -- 172.21.15.114:0/3082730820 >> 172.21.15.114:0/3082730820 conn(0x7fe3940ce950 msgr2=0x7fe3940b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:25.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.301+0000 7fe398f6c640 1 -- 172.21.15.114:0/3082730820 shutdown_connections 2023-11-04T01:39:25.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.301+0000 7fe398f6c640 1 -- 172.21.15.114:0/3082730820 wait complete. 2023-11-04T01:39:25.313 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:39:25.313 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:39:25.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.411+0000 7f1345333640 1 Processor -- start 2023-11-04T01:39:25.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.411+0000 7f1345333640 1 -- start start 2023-11-04T01:39:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.412+0000 7f1345333640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f13400cde60 0x7f134015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.412+0000 7f1345333640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f134015daa0 0x7f1340157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.412+0000 7f1345333640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134015e000 con 0x7f13400ce240 2023-11-04T01:39:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.412+0000 7f1345333640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134015e5c0 con 0x7f13400cde60 2023-11-04T01:39:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.412+0000 7f1345333640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134015e2e0 con 0x7f134015daa0 2023-11-04T01:39:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.412+0000 7f133effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f13400cde60 0x7f134015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.412+0000 7f133f7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f13400ce240 0x7f134006b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53298/0 (socket says 172.21.15.114:53298) 2023-11-04T01:39:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.412+0000 7f133f7fe640 1 -- 172.21.15.114:0/899142417 learned_addr learned my addr 172.21.15.114:0/899142417 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.412+0000 7f133effd640 1 -- 172.21.15.114:0/899142417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f134015daa0 msgr2=0x7f1340157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.412+0000 7f133effd640 1 --2- 172.21.15.114:0/899142417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f134015daa0 0x7f1340157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.412+0000 7f133effd640 1 -- 172.21.15.114:0/899142417 >> v1:172.21.15.114:6789/0 conn(0x7f13400ce240 legacy=0x7f134006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.412+0000 7f133effd640 1 -- 172.21.15.114:0/899142417 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13400d1120 con 0x7f13400cde60 2023-11-04T01:39:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.412+0000 7f133e7fc640 1 -- 172.21.15.114:0/899142417 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471316680 0 0) 0x7f134015e000 con 0x7f13400ce240 2023-11-04T01:39:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.413+0000 7f133effd640 1 --2- 172.21.15.114:0/899142417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13400cde60 0x7f134015d560 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f13300097a0 tx=0x7f133002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aefa102c8ab2c47 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.413+0000 7f133e7fc640 1 -- 172.21.15.114:0/899142417 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330031830 con 0x7f13400cde60 2023-11-04T01:39:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.413+0000 7f133e7fc640 1 -- 172.21.15.114:0/899142417 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1330031990 con 0x7f13400cde60 2023-11-04T01:39:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.413+0000 7f133e7fc640 1 -- 172.21.15.114:0/899142417 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330031d20 con 0x7f13400cde60 2023-11-04T01:39:25.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.414+0000 7f1345333640 1 -- 172.21.15.114:0/899142417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13400cde60 msgr2=0x7f134015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.414+0000 7f1345333640 1 --2- 172.21.15.114:0/899142417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13400cde60 0x7f134015d560 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f13300097a0 tx=0x7f133002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.414+0000 7f1345333640 1 -- 172.21.15.114:0/899142417 shutdown_connections 2023-11-04T01:39:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.414+0000 7f1345333640 1 --2- 172.21.15.114:0/899142417 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f134015daa0 0x7f1340157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.414+0000 7f1345333640 1 --2- 172.21.15.114:0/899142417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13400cde60 0x7f134015d560 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.414+0000 7f1345333640 1 -- 172.21.15.114:0/899142417 >> 172.21.15.114:0/899142417 conn(0x7f1340071f30 msgr2=0x7f13400cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.414+0000 7f1345333640 1 -- 172.21.15.114:0/899142417 shutdown_connections 2023-11-04T01:39:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.414+0000 7f1345333640 1 -- 172.21.15.114:0/899142417 wait complete. 2023-11-04T01:39:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.415+0000 7f1345333640 1 Processor -- start 2023-11-04T01:39:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.415+0000 7f1345333640 1 -- start start 2023-11-04T01:39:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f1345333640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13400cde60 0x7f1340147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f1345333640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13400ce240 0x7f134015adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f1345333640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f134015daa0 0x7f13401579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f1345333640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1340157ef0 con 0x7f13400cde60 2023-11-04T01:39:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f1345333640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1340148910 con 0x7f134015daa0 2023-11-04T01:39:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f1345333640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1340147d00 con 0x7f13400ce240 2023-11-04T01:39:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f133effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13400cde60 0x7f1340147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f133effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13400cde60 0x7f1340147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33234/0 (socket says 172.21.15.114:33234) 2023-11-04T01:39:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f133effd640 1 -- 172.21.15.114:0/2020568661 learned_addr learned my addr 172.21.15.114:0/2020568661 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f133effd640 1 -- 172.21.15.114:0/2020568661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13400ce240 msgr2=0x7f134015adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f133effd640 1 --2- 172.21.15.114:0/2020568661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13400ce240 0x7f134015adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f133effd640 1 -- 172.21.15.114:0/2020568661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f134015daa0 msgr2=0x7f13401579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f133effd640 1 --2- 172.21.15.114:0/2020568661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f134015daa0 0x7f13401579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f133effd640 1 -- 172.21.15.114:0/2020568661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1330009400 con 0x7f13400cde60 2023-11-04T01:39:25.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f133effd640 1 --2- 172.21.15.114:0/2020568661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13400cde60 0x7f1340147600 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f13300098c0 tx=0x7f13300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:25.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f13377fe640 1 -- 172.21.15.114:0/2020568661 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133003ba70 con 0x7f13400cde60 2023-11-04T01:39:25.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f13377fe640 1 -- 172.21.15.114:0/2020568661 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133003bbd0 con 0x7f13400cde60 2023-11-04T01:39:25.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f1345333640 1 -- 172.21.15.114:0/2020568661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1340147fe0 con 0x7f13400cde60 2023-11-04T01:39:25.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f13377fe640 1 -- 172.21.15.114:0/2020568661 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300453f0 con 0x7f13400cde60 2023-11-04T01:39:25.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.416+0000 7f1345333640 1 -- 172.21.15.114:0/2020568661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13401485a0 con 0x7f13400cde60 2023-11-04T01:39:25.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.417+0000 7f1345333640 1 -- 172.21.15.114:0/2020568661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1340074290 con 0x7f13400cde60 2023-11-04T01:39:25.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.418+0000 7f13377fe640 1 -- 172.21.15.114:0/2020568661 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f133004e450 con 0x7f13400cde60 2023-11-04T01:39:25.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.418+0000 7f13377fe640 1 --2- 172.21.15.114:0/2020568661 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f132006aea0 0x7f132006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.418+0000 7f13377fe640 1 -- 172.21.15.114:0/2020568661 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f13300abeb0 con 0x7f13400cde60 2023-11-04T01:39:25.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.418+0000 7f1337fff640 1 --2- 172.21.15.114:0/2020568661 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f132006aea0 0x7f132006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.418+0000 7f1337fff640 1 --2- 172.21.15.114:0/2020568661 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f132006aea0 0x7f132006d360 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f13400c9100 tx=0x7f1328006bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:25.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.422+0000 7f13377fe640 1 -- 172.21.15.114:0/2020568661 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1330076960 con 0x7f13400cde60 2023-11-04T01:39:25.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.587+0000 7f1345333640 1 -- 172.21.15.114:0/2020568661 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13400d1400 con 0x7f132006aea0 2023-11-04T01:39:25.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.599+0000 7f13377fe640 1 -- 172.21.15.114:0/2020568661 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+531988 (secure 0 0 0) 0x7f1328012390 con 0x7f132006aea0 2023-11-04T01:39:25.607 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:25.611 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:39:25.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.604+0000 7f1345333640 1 -- 172.21.15.114:0/2020568661 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f132006aea0 msgr2=0x7f132006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.604+0000 7f1345333640 1 --2- 172.21.15.114:0/2020568661 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f132006aea0 0x7f132006d360 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f13400c9100 tx=0x7f1328006bf0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.604+0000 7f1345333640 1 -- 172.21.15.114:0/2020568661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13400cde60 msgr2=0x7f1340147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.604+0000 7f1345333640 1 --2- 172.21.15.114:0/2020568661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13400cde60 0x7f1340147600 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f13300098c0 tx=0x7f13300046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.604+0000 7f1345333640 1 -- 172.21.15.114:0/2020568661 shutdown_connections 2023-11-04T01:39:25.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.604+0000 7f1345333640 1 --2- 172.21.15.114:0/2020568661 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f132006aea0 0x7f132006d360 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.604+0000 7f1345333640 1 --2- 172.21.15.114:0/2020568661 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f134015daa0 0x7f13401579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.604+0000 7f1345333640 1 --2- 172.21.15.114:0/2020568661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13400ce240 0x7f134015adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.604+0000 7f1345333640 1 --2- 172.21.15.114:0/2020568661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13400cde60 0x7f1340147600 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.604+0000 7f1345333640 1 -- 172.21.15.114:0/2020568661 >> 172.21.15.114:0/2020568661 conn(0x7f1340071f30 msgr2=0x7f13400c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:25.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.604+0000 7f1345333640 1 -- 172.21.15.114:0/2020568661 shutdown_connections 2023-11-04T01:39:25.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.604+0000 7f1345333640 1 -- 172.21.15.114:0/2020568661 wait complete. 2023-11-04T01:39:25.616 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2023-11-04T01:39:23.893771+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":234,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233428,"kb_used_data":8936,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754741292,"statfs":{"total":773094113280,"available":772855083008,"internally_reserved":0,"allocated":9150464,"data_stored":5019408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000891"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.685349+0000","last_change":"2023-11-04T01:39:22.684034+0000","last_active":"2023-11-04T01:39:22.685349+0000","last_peered":"2023-11-04T01:39:22.685349+0000","last_clean":"2023-11-04T01:39:22.685349+0000","last_became_active":"2023-11-04T01:39:22.683747+0000","last_became_peered":"2023-11-04T01:39:22.683747+0000","last_unstale":"2023-11-04T01:39:22.685349+0000","last_undegraded":"2023-11-04T01:39:22.685349+0000","last_fullsized":"2023-11-04T01:39:22.685349+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:17.956473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.690451+0000","last_change":"2023-11-04T01:39:22.683035+0000","last_active":"2023-11-04T01:39:22.690451+0000","last_peered":"2023-11-04T01:39:22.690451+0000","last_clean":"2023-11-04T01:39:22.690451+0000","last_became_active":"2023-11-04T01:39:22.682757+0000","last_became_peered":"2023-11-04T01:39:22.682757+0000","last_unstale":"2023-11-04T01:39:22.690451+0000","last_undegraded":"2023-11-04T01:39:22.690451+0000","last_fullsized":"2023-11-04T01:39:22.690451+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:29.339900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.684056+0000","last_change":"2023-11-04T01:39:22.677046+0000","last_active":"2023-11-04T01:39:22.684056+0000","last_peered":"2023-11-04T01:39:22.684056+0000","last_clean":"2023-11-04T01:39:22.684056+0000","last_became_active":"2023-11-04T01:39:22.676352+0000","last_became_peered":"2023-11-04T01:39:22.676352+0000","last_unstale":"2023-11-04T01:39:22.684056+0000","last_undegraded":"2023-11-04T01:39:22.684056+0000","last_fullsized":"2023-11-04T01:39:22.684056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:10.840865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.674381+0000","last_change":"2023-11-04T01:39:22.670029+0000","last_active":"2023-11-04T01:39:22.674381+0000","last_peered":"2023-11-04T01:39:22.674381+0000","last_clean":"2023-11-04T01:39:22.674381+0000","last_became_active":"2023-11-04T01:39:22.669596+0000","last_became_peered":"2023-11-04T01:39:22.669596+0000","last_unstale":"2023-11-04T01:39:22.674381+0000","last_undegraded":"2023-11-04T01:39:22.674381+0000","last_fullsized":"2023-11-04T01:39:22.674381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:03.305373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683663+0000","last_change":"2023-11-04T01:39:22.672101+0000","last_active":"2023-11-04T01:39:22.683663+0000","last_peered":"2023-11-04T01:39:22.683663+0000","last_clean":"2023-11-04T01:39:22.683663+0000","last_became_active":"2023-11-04T01:39:22.671676+0000","last_became_peered":"2023-11-04T01:39:22.671676+0000","last_unstale":"2023-11-04T01:39:22.683663+0000","last_undegraded":"2023-11-04T01:39:22.683663+0000","last_fullsized":"2023-11-04T01:39:22.683663+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:25.733293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.682375+0000","last_change":"2023-11-04T01:39:22.677660+0000","last_active":"2023-11-04T01:39:22.682375+0000","last_peered":"2023-11-04T01:39:22.682375+0000","last_clean":"2023-11-04T01:39:22.682375+0000","last_became_active":"2023-11-04T01:39:22.676965+0000","last_became_peered":"2023-11-04T01:39:22.676965+0000","last_unstale":"2023-11-04T01:39:22.682375+0000","last_undegraded":"2023-11-04T01:39:22.682375+0000","last_fullsized":"2023-11-04T01:39:22.682375+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:27.452701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.682038+0000","last_change":"2023-11-04T01:39:22.677327+0000","last_active":"2023-11-04T01:39:22.682038+0000","last_peered":"2023-11-04T01:39:22.682038+0000","last_clean":"2023-11-04T01:39:22.682038+0000","last_became_active":"2023-11-04T01:39:22.677031+0000","last_became_peered":"2023-11-04T01:39:22.677031+0000","last_unstale":"2023-11-04T01:39:22.682038+0000","last_undegraded":"2023-11-04T01:39:22.682038+0000","last_fullsized":"2023-11-04T01:39:22.682038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:41:52.002166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.679327+0000","last_change":"2023-11-04T01:39:22.673737+0000","last_active":"2023-11-04T01:39:22.679327+0000","last_peered":"2023-11-04T01:39:22.679327+0000","last_clean":"2023-11-04T01:39:22.679327+0000","last_became_active":"2023-11-04T01:39:22.673289+0000","last_became_peered":"2023-11-04T01:39:22.673289+0000","last_unstale":"2023-11-04T01:39:22.679327+0000","last_undegraded":"2023-11-04T01:39:22.679327+0000","last_fullsized":"2023-11-04T01:39:22.679327+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:22:20.902485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.680855+0000","last_change":"2023-11-04T01:39:22.675670+0000","last_active":"2023-11-04T01:39:22.680855+0000","last_peered":"2023-11-04T01:39:22.680855+0000","last_clean":"2023-11-04T01:39:22.680855+0000","last_became_active":"2023-11-04T01:39:22.675389+0000","last_became_peered":"2023-11-04T01:39:22.675389+0000","last_unstale":"2023-11-04T01:39:22.680855+0000","last_undegraded":"2023-11-04T01:39:22.680855+0000","last_fullsized":"2023-11-04T01:39:22.680855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:47.238603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683791+0000","last_change":"2023-11-04T01:39:22.675022+0000","last_active":"2023-11-04T01:39:22.683791+0000","last_peered":"2023-11-04T01:39:22.683791+0000","last_clean":"2023-11-04T01:39:22.683791+0000","last_became_active":"2023-11-04T01:39:22.674699+0000","last_became_peered":"2023-11-04T01:39:22.674699+0000","last_unstale":"2023-11-04T01:39:22.683791+0000","last_undegraded":"2023-11-04T01:39:22.683791+0000","last_fullsized":"2023-11-04T01:39:22.683791+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:37.397655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.685334+0000","last_change":"2023-11-04T01:39:22.679435+0000","last_active":"2023-11-04T01:39:22.685334+0000","last_peered":"2023-11-04T01:39:22.685334+0000","last_clean":"2023-11-04T01:39:22.685334+0000","last_became_active":"2023-11-04T01:39:22.679178+0000","last_became_peered":"2023-11-04T01:39:22.679178+0000","last_unstale":"2023-11-04T01:39:22.685334+0000","last_undegraded":"2023-11-04T01:39:22.685334+0000","last_fullsized":"2023-11-04T01:39:22.685334+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:42:48.311220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.682989+0000","last_change":"2023-11-04T01:39:22.678853+0000","last_active":"2023-11-04T01:39:22.682989+0000","last_peered":"2023-11-04T01:39:22.682989+0000","last_clean":"2023-11-04T01:39:22.682989+0000","last_became_active":"2023-11-04T01:39:22.678600+0000","last_became_peered":"2023-11-04T01:39:22.678600+0000","last_unstale":"2023-11-04T01:39:22.682989+0000","last_undegraded":"2023-11-04T01:39:22.682989+0000","last_fullsized":"2023-11-04T01:39:22.682989+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:05.241162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.685249+0000","last_change":"2023-11-04T01:39:22.679154+0000","last_active":"2023-11-04T01:39:22.685249+0000","last_peered":"2023-11-04T01:39:22.685249+0000","last_clean":"2023-11-04T01:39:22.685249+0000","last_became_active":"2023-11-04T01:39:22.678840+0000","last_became_peered":"2023-11-04T01:39:22.678840+0000","last_unstale":"2023-11-04T01:39:22.685249+0000","last_undegraded":"2023-11-04T01:39:22.685249+0000","last_fullsized":"2023-11-04T01:39:22.685249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:29.339900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.668395+0000","last_change":"2023-11-04T01:39:22.667660+0000","last_active":"2023-11-04T01:39:22.668395+0000","last_peered":"2023-11-04T01:39:22.668395+0000","last_clean":"2023-11-04T01:39:22.668395+0000","last_became_active":"2023-11-04T01:39:22.667393+0000","last_became_peered":"2023-11-04T01:39:22.667393+0000","last_unstale":"2023-11-04T01:39:22.668395+0000","last_undegraded":"2023-11-04T01:39:22.668395+0000","last_fullsized":"2023-11-04T01:39:22.668395+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:38.180726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.679144+0000","last_change":"2023-11-04T01:39:22.676752+0000","last_active":"2023-11-04T01:39:22.679144+0000","last_peered":"2023-11-04T01:39:22.679144+0000","last_clean":"2023-11-04T01:39:22.679144+0000","last_became_active":"2023-11-04T01:39:22.676495+0000","last_became_peered":"2023-11-04T01:39:22.676495+0000","last_unstale":"2023-11-04T01:39:22.679144+0000","last_undegraded":"2023-11-04T01:39:22.679144+0000","last_fullsized":"2023-11-04T01:39:22.679144+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:54.931063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.677929+0000","last_change":"2023-11-04T01:39:22.672317+0000","last_active":"2023-11-04T01:39:22.677929+0000","last_peered":"2023-11-04T01:39:22.677929+0000","last_clean":"2023-11-04T01:39:22.677929+0000","last_became_active":"2023-11-04T01:39:22.671996+0000","last_became_peered":"2023-11-04T01:39:22.671996+0000","last_unstale":"2023-11-04T01:39:22.677929+0000","last_undegraded":"2023-11-04T01:39:22.677929+0000","last_fullsized":"2023-11-04T01:39:22.677929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:03.305373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.687593+0000","last_change":"2023-11-04T01:39:22.680344+0000","last_active":"2023-11-04T01:39:22.687593+0000","last_peered":"2023-11-04T01:39:22.687593+0000","last_clean":"2023-11-04T01:39:22.687593+0000","last_became_active":"2023-11-04T01:39:22.680071+0000","last_became_peered":"2023-11-04T01:39:22.680071+0000","last_unstale":"2023-11-04T01:39:22.687593+0000","last_undegraded":"2023-11-04T01:39:22.687593+0000","last_fullsized":"2023-11-04T01:39:22.687593+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:33:53.430199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.679001+0000","last_change":"2023-11-04T01:39:22.675927+0000","last_active":"2023-11-04T01:39:22.679001+0000","last_peered":"2023-11-04T01:39:22.679001+0000","last_clean":"2023-11-04T01:39:22.679001+0000","last_became_active":"2023-11-04T01:39:22.675675+0000","last_became_peered":"2023-11-04T01:39:22.675675+0000","last_unstale":"2023-11-04T01:39:22.679001+0000","last_undegraded":"2023-11-04T01:39:22.679001+0000","last_fullsized":"2023-11-04T01:39:22.679001+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:14.309939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.678823+0000","last_change":"2023-11-04T01:39:22.675564+0000","last_active":"2023-11-04T01:39:22.678823+0000","last_peered":"2023-11-04T01:39:22.678823+0000","last_clean":"2023-11-04T01:39:22.678823+0000","last_became_active":"2023-11-04T01:39:22.675258+0000","last_became_peered":"2023-11-04T01:39:22.675258+0000","last_unstale":"2023-11-04T01:39:22.678823+0000","last_undegraded":"2023-11-04T01:39:22.678823+0000","last_fullsized":"2023-11-04T01:39:22.678823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:01:40.332558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683007+0000","last_change":"2023-11-04T01:39:22.679066+0000","last_active":"2023-11-04T01:39:22.683007+0000","last_peered":"2023-11-04T01:39:22.683007+0000","last_clean":"2023-11-04T01:39:22.683007+0000","last_became_active":"2023-11-04T01:39:22.676289+0000","last_became_peered":"2023-11-04T01:39:22.676289+0000","last_unstale":"2023-11-04T01:39:22.683007+0000","last_undegraded":"2023-11-04T01:39:22.683007+0000","last_fullsized":"2023-11-04T01:39:22.683007+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:10.748491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.685152+0000","last_change":"2023-11-04T01:39:22.683030+0000","last_active":"2023-11-04T01:39:22.685152+0000","last_peered":"2023-11-04T01:39:22.685152+0000","last_clean":"2023-11-04T01:39:22.685152+0000","last_became_active":"2023-11-04T01:39:22.682732+0000","last_became_peered":"2023-11-04T01:39:22.682732+0000","last_unstale":"2023-11-04T01:39:22.685152+0000","last_undegraded":"2023-11-04T01:39:22.685152+0000","last_fullsized":"2023-11-04T01:39:22.685152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:18.875968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.679427+0000","last_change":"2023-11-04T01:39:22.677110+0000","last_active":"2023-11-04T01:39:22.679427+0000","last_peered":"2023-11-04T01:39:22.679427+0000","last_clean":"2023-11-04T01:39:22.679427+0000","last_became_active":"2023-11-04T01:39:22.676872+0000","last_became_peered":"2023-11-04T01:39:22.676872+0000","last_unstale":"2023-11-04T01:39:22.679427+0000","last_undegraded":"2023-11-04T01:39:22.679427+0000","last_fullsized":"2023-11-04T01:39:22.679427+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:03.305373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.687523+0000","last_change":"2023-11-04T01:39:22.679527+0000","last_active":"2023-11-04T01:39:22.687523+0000","last_peered":"2023-11-04T01:39:22.687523+0000","last_clean":"2023-11-04T01:39:22.687523+0000","last_became_active":"2023-11-04T01:39:22.679253+0000","last_became_peered":"2023-11-04T01:39:22.679253+0000","last_unstale":"2023-11-04T01:39:22.687523+0000","last_undegraded":"2023-11-04T01:39:22.687523+0000","last_fullsized":"2023-11-04T01:39:22.687523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:14.309939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.669843+0000","last_change":"2023-11-04T01:39:22.664598+0000","last_active":"2023-11-04T01:39:22.669843+0000","last_peered":"2023-11-04T01:39:22.669843+0000","last_clean":"2023-11-04T01:39:22.669843+0000","last_became_active":"2023-11-04T01:39:22.664179+0000","last_became_peered":"2023-11-04T01:39:22.664179+0000","last_unstale":"2023-11-04T01:39:22.669843+0000","last_undegraded":"2023-11-04T01:39:22.669843+0000","last_fullsized":"2023-11-04T01:39:22.669843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:19:36.662698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683616+0000","last_change":"2023-11-04T01:39:22.670990+0000","last_active":"2023-11-04T01:39:22.683616+0000","last_peered":"2023-11-04T01:39:22.683616+0000","last_clean":"2023-11-04T01:39:22.683616+0000","last_became_active":"2023-11-04T01:39:22.670721+0000","last_became_peered":"2023-11-04T01:39:22.670721+0000","last_unstale":"2023-11-04T01:39:22.683616+0000","last_undegraded":"2023-11-04T01:39:22.683616+0000","last_fullsized":"2023-11-04T01:39:22.683616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:04:35.487784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.679231+0000","last_change":"2023-11-04T01:39:22.673092+0000","last_active":"2023-11-04T01:39:22.679231+0000","last_peered":"2023-11-04T01:39:22.679231+0000","last_clean":"2023-11-04T01:39:22.679231+0000","last_became_active":"2023-11-04T01:39:22.672823+0000","last_became_peered":"2023-11-04T01:39:22.672823+0000","last_unstale":"2023-11-04T01:39:22.679231+0000","last_undegraded":"2023-11-04T01:39:22.679231+0000","last_fullsized":"2023-11-04T01:39:22.679231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:06.778103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.673469+0000","last_change":"2023-11-04T01:39:22.669580+0000","last_active":"2023-11-04T01:39:22.673469+0000","last_peered":"2023-11-04T01:39:22.673469+0000","last_clean":"2023-11-04T01:39:22.673469+0000","last_became_active":"2023-11-04T01:39:22.669276+0000","last_became_peered":"2023-11-04T01:39:22.669276+0000","last_unstale":"2023-11-04T01:39:22.673469+0000","last_undegraded":"2023-11-04T01:39:22.673469+0000","last_fullsized":"2023-11-04T01:39:22.673469+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:22:20.902485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683845+0000","last_change":"2023-11-04T01:39:22.669109+0000","last_active":"2023-11-04T01:39:22.683845+0000","last_peered":"2023-11-04T01:39:22.683845+0000","last_clean":"2023-11-04T01:39:22.683845+0000","last_became_active":"2023-11-04T01:39:22.668845+0000","last_became_peered":"2023-11-04T01:39:22.668845+0000","last_unstale":"2023-11-04T01:39:22.683845+0000","last_undegraded":"2023-11-04T01:39:22.683845+0000","last_fullsized":"2023-11-04T01:39:22.683845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:54:30.601086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.679282+0000","last_change":"2023-11-04T01:39:22.673679+0000","last_active":"2023-11-04T01:39:22.679282+0000","last_peered":"2023-11-04T01:39:22.679282+0000","last_clean":"2023-11-04T01:39:22.679282+0000","last_became_active":"2023-11-04T01:39:22.673386+0000","last_became_peered":"2023-11-04T01:39:22.673386+0000","last_unstale":"2023-11-04T01:39:22.679282+0000","last_undegraded":"2023-11-04T01:39:22.679282+0000","last_fullsized":"2023-11-04T01:39:22.679282+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:07.297352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.684486+0000","last_change":"2023-11-04T01:39:22.677686+0000","last_active":"2023-11-04T01:39:22.684486+0000","last_peered":"2023-11-04T01:39:22.684486+0000","last_clean":"2023-11-04T01:39:22.684486+0000","last_became_active":"2023-11-04T01:39:22.677223+0000","last_became_peered":"2023-11-04T01:39:22.677223+0000","last_unstale":"2023-11-04T01:39:22.684486+0000","last_undegraded":"2023-11-04T01:39:22.684486+0000","last_fullsized":"2023-11-04T01:39:22.684486+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:58:22.585991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.687736+0000","last_change":"2023-11-04T01:39:22.684856+0000","last_active":"2023-11-04T01:39:22.687736+0000","last_peered":"2023-11-04T01:39:22.687736+0000","last_clean":"2023-11-04T01:39:22.687736+0000","last_became_active":"2023-11-04T01:39:22.684616+0000","last_became_peered":"2023-11-04T01:39:22.684616+0000","last_unstale":"2023-11-04T01:39:22.687736+0000","last_undegraded":"2023-11-04T01:39:22.687736+0000","last_fullsized":"2023-11-04T01:39:22.687736+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:22:20.902485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.675138+0000","last_change":"2023-11-04T01:39:22.671864+0000","last_active":"2023-11-04T01:39:22.675138+0000","last_peered":"2023-11-04T01:39:22.675138+0000","last_clean":"2023-11-04T01:39:22.675138+0000","last_became_active":"2023-11-04T01:39:22.671601+0000","last_became_peered":"2023-11-04T01:39:22.671601+0000","last_unstale":"2023-11-04T01:39:22.675138+0000","last_undegraded":"2023-11-04T01:39:22.675138+0000","last_fullsized":"2023-11-04T01:39:22.675138+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:30.057300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.676657+0000","last_change":"2023-11-04T01:39:22.671514+0000","last_active":"2023-11-04T01:39:22.676657+0000","last_peered":"2023-11-04T01:39:22.676657+0000","last_clean":"2023-11-04T01:39:22.676657+0000","last_became_active":"2023-11-04T01:39:22.671210+0000","last_became_peered":"2023-11-04T01:39:22.671210+0000","last_unstale":"2023-11-04T01:39:22.676657+0000","last_undegraded":"2023-11-04T01:39:22.676657+0000","last_fullsized":"2023-11-04T01:39:22.676657+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:16.646126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"82'6","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.696197+0000","last_change":"2023-11-04T01:39:21.668796+0000","last_active":"2023-11-04T01:39:22.696197+0000","last_peered":"2023-11-04T01:39:22.696197+0000","last_clean":"2023-11-04T01:39:22.696197+0000","last_became_active":"2023-11-04T01:39:21.668524+0000","last_became_peered":"2023-11-04T01:39:21.668524+0000","last_unstale":"2023-11-04T01:39:22.696197+0000","last_undegraded":"2023-11-04T01:39:22.696197+0000","last_fullsized":"2023-11-04T01:39:22.696197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:43.976692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.657319+0000","last_change":"2023-11-04T01:39:00.904362+0000","last_active":"2023-11-04T01:39:21.657319+0000","last_peered":"2023-11-04T01:39:21.657319+0000","last_clean":"2023-11-04T01:39:21.657319+0000","last_became_active":"2023-11-04T01:39:00.903861+0000","last_became_peered":"2023-11-04T01:39:00.903861+0000","last_unstale":"2023-11-04T01:39:21.657319+0000","last_undegraded":"2023-11-04T01:39:21.657319+0000","last_fullsized":"2023-11-04T01:39:21.657319+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:08:13.731370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.663266+0000","last_change":"2023-11-04T01:39:01.899189+0000","last_active":"2023-11-04T01:39:21.663266+0000","last_peered":"2023-11-04T01:39:21.663266+0000","last_clean":"2023-11-04T01:39:21.663266+0000","last_became_active":"2023-11-04T01:38:59.885803+0000","last_became_peered":"2023-11-04T01:38:59.885803+0000","last_unstale":"2023-11-04T01:39:21.663266+0000","last_undegraded":"2023-11-04T01:39:21.663266+0000","last_fullsized":"2023-11-04T01:39:21.663266+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:13.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061642800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654875+0000","last_change":"2023-11-04T01:38:02.156342+0000","last_active":"2023-11-04T01:39:21.654875+0000","last_peered":"2023-11-04T01:39:21.654875+0000","last_clean":"2023-11-04T01:39:21.654875+0000","last_became_active":"2023-11-04T01:38:00.708159+0000","last_became_peered":"2023-11-04T01:38:00.708159+0000","last_unstale":"2023-11-04T01:39:21.654875+0000","last_undegraded":"2023-11-04T01:39:21.654875+0000","last_fullsized":"2023-11-04T01:39:21.654875+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000435213,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683885+0000","last_change":"2023-11-04T01:39:22.672334+0000","last_active":"2023-11-04T01:39:22.683885+0000","last_peered":"2023-11-04T01:39:22.683885+0000","last_clean":"2023-11-04T01:39:22.683885+0000","last_became_active":"2023-11-04T01:39:22.672056+0000","last_became_peered":"2023-11-04T01:39:22.672056+0000","last_unstale":"2023-11-04T01:39:22.683885+0000","last_undegraded":"2023-11-04T01:39:22.683885+0000","last_fullsized":"2023-11-04T01:39:22.683885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:02.584204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"82'3","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.688465+0000","last_change":"2023-11-04T01:39:21.677191+0000","last_active":"2023-11-04T01:39:22.688465+0000","last_peered":"2023-11-04T01:39:22.688465+0000","last_clean":"2023-11-04T01:39:22.688465+0000","last_became_active":"2023-11-04T01:39:21.676933+0000","last_became_peered":"2023-11-04T01:39:21.676933+0000","last_unstale":"2023-11-04T01:39:22.688465+0000","last_undegraded":"2023-11-04T01:39:22.688465+0000","last_fullsized":"2023-11-04T01:39:22.688465+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:33:52.421326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.660157+0000","last_change":"2023-11-04T01:39:00.902826+0000","last_active":"2023-11-04T01:39:21.660157+0000","last_peered":"2023-11-04T01:39:21.660157+0000","last_clean":"2023-11-04T01:39:21.660157+0000","last_became_active":"2023-11-04T01:39:00.902547+0000","last_became_peered":"2023-11-04T01:39:00.902547+0000","last_unstale":"2023-11-04T01:39:21.660157+0000","last_undegraded":"2023-11-04T01:39:21.660157+0000","last_fullsized":"2023-11-04T01:39:21.660157+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:54:08.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664351+0000","last_change":"2023-11-04T01:39:01.899633+0000","last_active":"2023-11-04T01:39:21.664351+0000","last_peered":"2023-11-04T01:39:21.664351+0000","last_clean":"2023-11-04T01:39:21.664351+0000","last_became_active":"2023-11-04T01:38:59.897690+0000","last_became_peered":"2023-11-04T01:38:59.897690+0000","last_unstale":"2023-11-04T01:39:21.664351+0000","last_undegraded":"2023-11-04T01:39:21.664351+0000","last_fullsized":"2023-11-04T01:39:21.664351+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:48.990734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069036800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.657522+0000","last_change":"2023-11-04T01:38:02.362289+0000","last_active":"2023-11-04T01:39:21.657522+0000","last_peered":"2023-11-04T01:39:21.657522+0000","last_clean":"2023-11-04T01:39:21.657522+0000","last_became_active":"2023-11-04T01:38:00.710033+0000","last_became_peered":"2023-11-04T01:38:00.710033+0000","last_unstale":"2023-11-04T01:39:21.657522+0000","last_undegraded":"2023-11-04T01:39:21.657522+0000","last_fullsized":"2023-11-04T01:39:21.657522+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046467500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.688416+0000","last_change":"2023-11-04T01:39:22.685728+0000","last_active":"2023-11-04T01:39:22.688416+0000","last_peered":"2023-11-04T01:39:22.688416+0000","last_clean":"2023-11-04T01:39:22.688416+0000","last_became_active":"2023-11-04T01:39:22.685465+0000","last_became_peered":"2023-11-04T01:39:22.685465+0000","last_unstale":"2023-11-04T01:39:22.688416+0000","last_undegraded":"2023-11-04T01:39:22.688416+0000","last_fullsized":"2023-11-04T01:39:22.688416+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:08:35.514572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.658918+0000","last_change":"2023-11-04T01:39:21.671162+0000","last_active":"2023-11-04T01:39:22.658918+0000","last_peered":"2023-11-04T01:39:22.658918+0000","last_clean":"2023-11-04T01:39:22.658918+0000","last_became_active":"2023-11-04T01:39:21.670906+0000","last_became_peered":"2023-11-04T01:39:21.670906+0000","last_unstale":"2023-11-04T01:39:22.658918+0000","last_undegraded":"2023-11-04T01:39:22.658918+0000","last_fullsized":"2023-11-04T01:39:22.658918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:05.769230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662026+0000","last_change":"2023-11-04T01:39:00.905727+0000","last_active":"2023-11-04T01:39:21.662026+0000","last_peered":"2023-11-04T01:39:21.662026+0000","last_clean":"2023-11-04T01:39:21.662026+0000","last_became_active":"2023-11-04T01:39:00.905379+0000","last_became_peered":"2023-11-04T01:39:00.905379+0000","last_unstale":"2023-11-04T01:39:21.662026+0000","last_undegraded":"2023-11-04T01:39:21.662026+0000","last_fullsized":"2023-11-04T01:39:21.662026+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:08.595749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.657343+0000","last_change":"2023-11-04T01:39:02.289546+0000","last_active":"2023-11-04T01:39:21.657343+0000","last_peered":"2023-11-04T01:39:21.657343+0000","last_clean":"2023-11-04T01:39:21.657343+0000","last_became_active":"2023-11-04T01:38:59.894387+0000","last_became_peered":"2023-11-04T01:38:59.894387+0000","last_unstale":"2023-11-04T01:39:21.657343+0000","last_undegraded":"2023-11-04T01:39:21.657343+0000","last_fullsized":"2023-11-04T01:39:21.657343+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:12.983159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075893499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664701+0000","last_change":"2023-11-04T01:38:01.699171+0000","last_active":"2023-11-04T01:39:21.664701+0000","last_peered":"2023-11-04T01:39:21.664701+0000","last_clean":"2023-11-04T01:39:21.664701+0000","last_became_active":"2023-11-04T01:38:00.703927+0000","last_became_peered":"2023-11-04T01:38:00.703927+0000","last_unstale":"2023-11-04T01:39:21.664701+0000","last_undegraded":"2023-11-04T01:39:21.664701+0000","last_fullsized":"2023-11-04T01:39:21.664701+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072585499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.690431+0000","last_change":"2023-11-04T01:39:22.682471+0000","last_active":"2023-11-04T01:39:22.690431+0000","last_peered":"2023-11-04T01:39:22.690431+0000","last_clean":"2023-11-04T01:39:22.690431+0000","last_became_active":"2023-11-04T01:39:22.682062+0000","last_became_peered":"2023-11-04T01:39:22.682062+0000","last_unstale":"2023-11-04T01:39:22.690431+0000","last_undegraded":"2023-11-04T01:39:22.690431+0000","last_fullsized":"2023-11-04T01:39:22.690431+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:26:37.468995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.660007+0000","last_change":"2023-11-04T01:39:21.664627+0000","last_active":"2023-11-04T01:39:22.660007+0000","last_peered":"2023-11-04T01:39:22.660007+0000","last_clean":"2023-11-04T01:39:22.660007+0000","last_became_active":"2023-11-04T01:39:21.664339+0000","last_became_peered":"2023-11-04T01:39:21.664339+0000","last_unstale":"2023-11-04T01:39:22.660007+0000","last_undegraded":"2023-11-04T01:39:22.660007+0000","last_fullsized":"2023-11-04T01:39:22.660007+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:27.008236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662469+0000","last_change":"2023-11-04T01:39:00.907431+0000","last_active":"2023-11-04T01:39:21.662469+0000","last_peered":"2023-11-04T01:39:21.662469+0000","last_clean":"2023-11-04T01:39:21.662469+0000","last_became_active":"2023-11-04T01:39:00.907108+0000","last_became_peered":"2023-11-04T01:39:00.907108+0000","last_unstale":"2023-11-04T01:39:21.662469+0000","last_undegraded":"2023-11-04T01:39:21.662469+0000","last_fullsized":"2023-11-04T01:39:21.662469+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:19.094868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.663007+0000","last_change":"2023-11-04T01:39:01.898969+0000","last_active":"2023-11-04T01:39:21.663007+0000","last_peered":"2023-11-04T01:39:21.663007+0000","last_clean":"2023-11-04T01:39:21.663007+0000","last_became_active":"2023-11-04T01:38:59.890578+0000","last_became_peered":"2023-11-04T01:38:59.890578+0000","last_unstale":"2023-11-04T01:39:21.663007+0000","last_undegraded":"2023-11-04T01:39:21.663007+0000","last_fullsized":"2023-11-04T01:39:21.663007+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:55.167791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073951900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654331+0000","last_change":"2023-11-04T01:38:02.156160+0000","last_active":"2023-11-04T01:39:21.654331+0000","last_peered":"2023-11-04T01:39:21.654331+0000","last_clean":"2023-11-04T01:39:21.654331+0000","last_became_active":"2023-11-04T01:38:00.709137+0000","last_became_peered":"2023-11-04T01:38:00.709137+0000","last_unstale":"2023-11-04T01:39:21.654331+0000","last_undegraded":"2023-11-04T01:39:21.654331+0000","last_fullsized":"2023-11-04T01:39:21.654331+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028239399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.684097+0000","last_change":"2023-11-04T01:39:22.677832+0000","last_active":"2023-11-04T01:39:22.684097+0000","last_peered":"2023-11-04T01:39:22.684097+0000","last_clean":"2023-11-04T01:39:22.684097+0000","last_became_active":"2023-11-04T01:39:22.677580+0000","last_became_peered":"2023-11-04T01:39:22.677580+0000","last_unstale":"2023-11-04T01:39:22.684097+0000","last_undegraded":"2023-11-04T01:39:22.684097+0000","last_fullsized":"2023-11-04T01:39:22.684097+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:59:28.020842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"82'8","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.690648+0000","last_change":"2023-11-04T01:39:21.666710+0000","last_active":"2023-11-04T01:39:22.690648+0000","last_peered":"2023-11-04T01:39:22.690648+0000","last_clean":"2023-11-04T01:39:22.690648+0000","last_became_active":"2023-11-04T01:39:21.665857+0000","last_became_peered":"2023-11-04T01:39:21.665857+0000","last_unstale":"2023-11-04T01:39:22.690648+0000","last_undegraded":"2023-11-04T01:39:22.690648+0000","last_fullsized":"2023-11-04T01:39:22.690648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:10.770543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662234+0000","last_change":"2023-11-04T01:39:00.905486+0000","last_active":"2023-11-04T01:39:21.662234+0000","last_peered":"2023-11-04T01:39:21.662234+0000","last_clean":"2023-11-04T01:39:21.662234+0000","last_became_active":"2023-11-04T01:39:00.905221+0000","last_became_peered":"2023-11-04T01:39:00.905221+0000","last_unstale":"2023-11-04T01:39:21.662234+0000","last_undegraded":"2023-11-04T01:39:21.662234+0000","last_fullsized":"2023-11-04T01:39:21.662234+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:16.807464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.660561+0000","last_change":"2023-11-04T01:39:02.039221+0000","last_active":"2023-11-04T01:39:21.660561+0000","last_peered":"2023-11-04T01:39:21.660561+0000","last_clean":"2023-11-04T01:39:21.660561+0000","last_became_active":"2023-11-04T01:38:59.897804+0000","last_became_peered":"2023-11-04T01:38:59.897804+0000","last_unstale":"2023-11-04T01:39:21.660561+0000","last_undegraded":"2023-11-04T01:39:21.660561+0000","last_fullsized":"2023-11-04T01:39:21.660561+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:38:29.900299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038141100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662737+0000","last_change":"2023-11-04T01:38:01.698196+0000","last_active":"2023-11-04T01:39:21.662737+0000","last_peered":"2023-11-04T01:39:21.662737+0000","last_clean":"2023-11-04T01:39:21.662737+0000","last_became_active":"2023-11-04T01:38:00.705451+0000","last_became_peered":"2023-11-04T01:38:00.705451+0000","last_unstale":"2023-11-04T01:39:21.662737+0000","last_undegraded":"2023-11-04T01:39:21.662737+0000","last_fullsized":"2023-11-04T01:39:21.662737+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:16.759249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067668100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.682613+0000","last_change":"2023-11-04T01:39:22.677363+0000","last_active":"2023-11-04T01:39:22.682613+0000","last_peered":"2023-11-04T01:39:22.682613+0000","last_clean":"2023-11-04T01:39:22.682613+0000","last_became_active":"2023-11-04T01:39:22.676973+0000","last_became_peered":"2023-11-04T01:39:22.676973+0000","last_unstale":"2023-11-04T01:39:22.682613+0000","last_undegraded":"2023-11-04T01:39:22.682613+0000","last_fullsized":"2023-11-04T01:39:22.682613+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:35.771841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.664389+0000","last_change":"2023-11-04T01:39:21.668893+0000","last_active":"2023-11-04T01:39:22.664389+0000","last_peered":"2023-11-04T01:39:22.664389+0000","last_clean":"2023-11-04T01:39:22.664389+0000","last_became_active":"2023-11-04T01:39:21.668581+0000","last_became_peered":"2023-11-04T01:39:21.668581+0000","last_unstale":"2023-11-04T01:39:22.664389+0000","last_undegraded":"2023-11-04T01:39:22.664389+0000","last_fullsized":"2023-11-04T01:39:22.664389+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:49.520663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661995+0000","last_change":"2023-11-04T01:39:00.901434+0000","last_active":"2023-11-04T01:39:21.661995+0000","last_peered":"2023-11-04T01:39:21.661995+0000","last_clean":"2023-11-04T01:39:21.661995+0000","last_became_active":"2023-11-04T01:39:00.901094+0000","last_became_peered":"2023-11-04T01:39:00.901094+0000","last_unstale":"2023-11-04T01:39:21.661995+0000","last_undegraded":"2023-11-04T01:39:21.661995+0000","last_fullsized":"2023-11-04T01:39:21.661995+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:56:48.965289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654331+0000","last_change":"2023-11-04T01:39:02.371687+0000","last_active":"2023-11-04T01:39:21.654331+0000","last_peered":"2023-11-04T01:39:21.654331+0000","last_clean":"2023-11-04T01:39:21.654331+0000","last_became_active":"2023-11-04T01:38:59.888782+0000","last_became_peered":"2023-11-04T01:38:59.888782+0000","last_unstale":"2023-11-04T01:39:21.654331+0000","last_undegraded":"2023-11-04T01:39:21.654331+0000","last_fullsized":"2023-11-04T01:39:21.654331+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:34.092676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088740800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662873+0000","last_change":"2023-11-04T01:38:01.983991+0000","last_active":"2023-11-04T01:39:21.662873+0000","last_peered":"2023-11-04T01:39:21.662873+0000","last_clean":"2023-11-04T01:39:21.662873+0000","last_became_active":"2023-11-04T01:38:00.708462+0000","last_became_peered":"2023-11-04T01:38:00.708462+0000","last_unstale":"2023-11-04T01:39:21.662873+0000","last_undegraded":"2023-11-04T01:39:21.662873+0000","last_fullsized":"2023-11-04T01:39:21.662873+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:37.727651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041811600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.675040+0000","last_change":"2023-11-04T01:39:22.670994+0000","last_active":"2023-11-04T01:39:22.675040+0000","last_peered":"2023-11-04T01:39:22.675040+0000","last_clean":"2023-11-04T01:39:22.675040+0000","last_became_active":"2023-11-04T01:39:22.670491+0000","last_became_peered":"2023-11-04T01:39:22.670491+0000","last_unstale":"2023-11-04T01:39:22.675040+0000","last_undegraded":"2023-11-04T01:39:22.675040+0000","last_fullsized":"2023-11-04T01:39:22.675040+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:54.551020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.661481+0000","last_change":"2023-11-04T01:39:21.673479+0000","last_active":"2023-11-04T01:39:22.661481+0000","last_peered":"2023-11-04T01:39:22.661481+0000","last_clean":"2023-11-04T01:39:22.661481+0000","last_became_active":"2023-11-04T01:39:21.673142+0000","last_became_peered":"2023-11-04T01:39:21.673142+0000","last_unstale":"2023-11-04T01:39:22.661481+0000","last_undegraded":"2023-11-04T01:39:22.661481+0000","last_fullsized":"2023-11-04T01:39:22.661481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:51.916158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.653992+0000","last_change":"2023-11-04T01:39:00.907664+0000","last_active":"2023-11-04T01:39:21.653992+0000","last_peered":"2023-11-04T01:39:21.653992+0000","last_clean":"2023-11-04T01:39:21.653992+0000","last_became_active":"2023-11-04T01:39:00.907098+0000","last_became_peered":"2023-11-04T01:39:00.907098+0000","last_unstale":"2023-11-04T01:39:21.653992+0000","last_undegraded":"2023-11-04T01:39:21.653992+0000","last_fullsized":"2023-11-04T01:39:21.653992+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:43:34.994912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662601+0000","last_change":"2023-11-04T01:39:02.076144+0000","last_active":"2023-11-04T01:39:21.662601+0000","last_peered":"2023-11-04T01:39:21.662601+0000","last_clean":"2023-11-04T01:39:21.662601+0000","last_became_active":"2023-11-04T01:38:59.891521+0000","last_became_peered":"2023-11-04T01:38:59.891521+0000","last_unstale":"2023-11-04T01:39:21.662601+0000","last_undegraded":"2023-11-04T01:39:21.662601+0000","last_fullsized":"2023-11-04T01:39:21.662601+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:24.449921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063833,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.666557+0000","last_change":"2023-11-04T01:38:01.984341+0000","last_active":"2023-11-04T01:39:21.666557+0000","last_peered":"2023-11-04T01:39:21.666557+0000","last_clean":"2023-11-04T01:39:21.666557+0000","last_became_active":"2023-11-04T01:38:00.708307+0000","last_became_peered":"2023-11-04T01:38:00.708307+0000","last_unstale":"2023-11-04T01:39:21.666557+0000","last_undegraded":"2023-11-04T01:39:21.666557+0000","last_fullsized":"2023-11-04T01:39:21.666557+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:17.369098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053627199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.674598+0000","last_change":"2023-11-04T01:39:22.671028+0000","last_active":"2023-11-04T01:39:22.674598+0000","last_peered":"2023-11-04T01:39:22.674598+0000","last_clean":"2023-11-04T01:39:22.674598+0000","last_became_active":"2023-11-04T01:39:22.670776+0000","last_became_peered":"2023-11-04T01:39:22.670776+0000","last_unstale":"2023-11-04T01:39:22.674598+0000","last_undegraded":"2023-11-04T01:39:22.674598+0000","last_fullsized":"2023-11-04T01:39:22.674598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:07.297352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.688564+0000","last_change":"2023-11-04T01:39:21.667818+0000","last_active":"2023-11-04T01:39:22.688564+0000","last_peered":"2023-11-04T01:39:22.688564+0000","last_clean":"2023-11-04T01:39:22.688564+0000","last_became_active":"2023-11-04T01:39:21.667572+0000","last_became_peered":"2023-11-04T01:39:21.667572+0000","last_unstale":"2023-11-04T01:39:22.688564+0000","last_undegraded":"2023-11-04T01:39:22.688564+0000","last_fullsized":"2023-11-04T01:39:22.688564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:57.814070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654435+0000","last_change":"2023-11-04T01:39:00.905352+0000","last_active":"2023-11-04T01:39:21.654435+0000","last_peered":"2023-11-04T01:39:21.654435+0000","last_clean":"2023-11-04T01:39:21.654435+0000","last_became_active":"2023-11-04T01:39:00.905058+0000","last_became_peered":"2023-11-04T01:39:00.905058+0000","last_unstale":"2023-11-04T01:39:21.654435+0000","last_undegraded":"2023-11-04T01:39:21.654435+0000","last_fullsized":"2023-11-04T01:39:21.654435+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:37.246937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.655963+0000","last_change":"2023-11-04T01:39:02.289522+0000","last_active":"2023-11-04T01:39:21.655963+0000","last_peered":"2023-11-04T01:39:21.655963+0000","last_clean":"2023-11-04T01:39:21.655963+0000","last_became_active":"2023-11-04T01:38:59.887549+0000","last_became_peered":"2023-11-04T01:38:59.887549+0000","last_unstale":"2023-11-04T01:39:21.655963+0000","last_undegraded":"2023-11-04T01:39:21.655963+0000","last_fullsized":"2023-11-04T01:39:21.655963+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:13.888718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077706800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661695+0000","last_change":"2023-11-04T01:38:01.700471+0000","last_active":"2023-11-04T01:39:21.661695+0000","last_peered":"2023-11-04T01:39:21.661695+0000","last_clean":"2023-11-04T01:39:21.661695+0000","last_became_active":"2023-11-04T01:38:00.702522+0000","last_became_peered":"2023-11-04T01:38:00.702522+0000","last_unstale":"2023-11-04T01:39:21.661695+0000","last_undegraded":"2023-11-04T01:39:21.661695+0000","last_fullsized":"2023-11-04T01:39:21.661695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086940300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.682635+0000","last_change":"2023-11-04T01:39:22.678096+0000","last_active":"2023-11-04T01:39:22.682635+0000","last_peered":"2023-11-04T01:39:22.682635+0000","last_clean":"2023-11-04T01:39:22.682635+0000","last_became_active":"2023-11-04T01:39:22.677070+0000","last_became_peered":"2023-11-04T01:39:22.677070+0000","last_unstale":"2023-11-04T01:39:22.682635+0000","last_undegraded":"2023-11-04T01:39:22.682635+0000","last_fullsized":"2023-11-04T01:39:22.682635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:40.878070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.690318+0000","last_change":"2023-11-04T01:39:21.677390+0000","last_active":"2023-11-04T01:39:22.690318+0000","last_peered":"2023-11-04T01:39:22.690318+0000","last_clean":"2023-11-04T01:39:22.690318+0000","last_became_active":"2023-11-04T01:39:21.677128+0000","last_became_peered":"2023-11-04T01:39:21.677128+0000","last_unstale":"2023-11-04T01:39:22.690318+0000","last_undegraded":"2023-11-04T01:39:22.690318+0000","last_fullsized":"2023-11-04T01:39:22.690318+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:24.271627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664631+0000","last_change":"2023-11-04T01:39:00.905889+0000","last_active":"2023-11-04T01:39:21.664631+0000","last_peered":"2023-11-04T01:39:21.664631+0000","last_clean":"2023-11-04T01:39:21.664631+0000","last_became_active":"2023-11-04T01:39:00.905644+0000","last_became_peered":"2023-11-04T01:39:00.905644+0000","last_unstale":"2023-11-04T01:39:21.664631+0000","last_undegraded":"2023-11-04T01:39:21.664631+0000","last_fullsized":"2023-11-04T01:39:21.664631+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:13.988639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.663012+0000","last_change":"2023-11-04T01:39:01.897496+0000","last_active":"2023-11-04T01:39:21.663012+0000","last_peered":"2023-11-04T01:39:21.663012+0000","last_clean":"2023-11-04T01:39:21.663012+0000","last_became_active":"2023-11-04T01:38:59.894771+0000","last_became_peered":"2023-11-04T01:38:59.894771+0000","last_unstale":"2023-11-04T01:39:21.663012+0000","last_undegraded":"2023-11-04T01:39:21.663012+0000","last_fullsized":"2023-11-04T01:39:21.663012+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:50.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043645000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.665937+0000","last_change":"2023-11-04T01:38:01.696901+0000","last_active":"2023-11-04T01:39:21.665937+0000","last_peered":"2023-11-04T01:39:21.665937+0000","last_clean":"2023-11-04T01:39:21.665937+0000","last_became_active":"2023-11-04T01:38:00.706170+0000","last_became_peered":"2023-11-04T01:38:00.706170+0000","last_unstale":"2023-11-04T01:39:21.665937+0000","last_undegraded":"2023-11-04T01:39:21.665937+0000","last_fullsized":"2023-11-04T01:39:21.665937+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059391100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.685023+0000","last_change":"2023-11-04T01:39:22.681888+0000","last_active":"2023-11-04T01:39:22.685023+0000","last_peered":"2023-11-04T01:39:22.685023+0000","last_clean":"2023-11-04T01:39:22.685023+0000","last_became_active":"2023-11-04T01:39:22.681638+0000","last_became_peered":"2023-11-04T01:39:22.681638+0000","last_unstale":"2023-11-04T01:39:22.685023+0000","last_undegraded":"2023-11-04T01:39:22.685023+0000","last_fullsized":"2023-11-04T01:39:22.685023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:13.612357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.687702+0000","last_change":"2023-11-04T01:39:21.670429+0000","last_active":"2023-11-04T01:39:22.687702+0000","last_peered":"2023-11-04T01:39:22.687702+0000","last_clean":"2023-11-04T01:39:22.687702+0000","last_became_active":"2023-11-04T01:39:21.670162+0000","last_became_peered":"2023-11-04T01:39:21.670162+0000","last_unstale":"2023-11-04T01:39:22.687702+0000","last_undegraded":"2023-11-04T01:39:22.687702+0000","last_fullsized":"2023-11-04T01:39:22.687702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:55.034650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662928+0000","last_change":"2023-11-04T01:39:00.907377+0000","last_active":"2023-11-04T01:39:21.662928+0000","last_peered":"2023-11-04T01:39:21.662928+0000","last_clean":"2023-11-04T01:39:21.662928+0000","last_became_active":"2023-11-04T01:39:00.907059+0000","last_became_peered":"2023-11-04T01:39:00.907059+0000","last_unstale":"2023-11-04T01:39:21.662928+0000","last_undegraded":"2023-11-04T01:39:21.662928+0000","last_fullsized":"2023-11-04T01:39:21.662928+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:04.732051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664259+0000","last_change":"2023-11-04T01:39:01.899471+0000","last_active":"2023-11-04T01:39:21.664259+0000","last_peered":"2023-11-04T01:39:21.664259+0000","last_clean":"2023-11-04T01:39:21.664259+0000","last_became_active":"2023-11-04T01:38:59.893689+0000","last_became_peered":"2023-11-04T01:38:59.893689+0000","last_unstale":"2023-11-04T01:39:21.664259+0000","last_undegraded":"2023-11-04T01:39:21.664259+0000","last_fullsized":"2023-11-04T01:39:21.664259+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:36.506018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072622699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.659237+0000","last_change":"2023-11-04T01:38:01.939972+0000","last_active":"2023-11-04T01:39:21.659237+0000","last_peered":"2023-11-04T01:39:21.659237+0000","last_clean":"2023-11-04T01:39:21.659237+0000","last_became_active":"2023-11-04T01:38:00.702784+0000","last_became_peered":"2023-11-04T01:38:00.702784+0000","last_unstale":"2023-11-04T01:39:21.659237+0000","last_undegraded":"2023-11-04T01:39:21.659237+0000","last_fullsized":"2023-11-04T01:39:21.659237+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:26.760402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071328600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.687700+0000","last_change":"2023-11-04T01:39:22.684261+0000","last_active":"2023-11-04T01:39:22.687700+0000","last_peered":"2023-11-04T01:39:22.687700+0000","last_clean":"2023-11-04T01:39:22.687700+0000","last_became_active":"2023-11-04T01:39:22.684008+0000","last_became_peered":"2023-11-04T01:39:22.684008+0000","last_unstale":"2023-11-04T01:39:22.687700+0000","last_undegraded":"2023-11-04T01:39:22.687700+0000","last_fullsized":"2023-11-04T01:39:22.687700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:33:53.430199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.687827+0000","last_change":"2023-11-04T01:39:21.674030+0000","last_active":"2023-11-04T01:39:22.687827+0000","last_peered":"2023-11-04T01:39:22.687827+0000","last_clean":"2023-11-04T01:39:22.687827+0000","last_became_active":"2023-11-04T01:39:21.673666+0000","last_became_peered":"2023-11-04T01:39:21.673666+0000","last_unstale":"2023-11-04T01:39:22.687827+0000","last_undegraded":"2023-11-04T01:39:22.687827+0000","last_fullsized":"2023-11-04T01:39:22.687827+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:05.769230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664867+0000","last_change":"2023-11-04T01:39:00.901301+0000","last_active":"2023-11-04T01:39:21.664867+0000","last_peered":"2023-11-04T01:39:21.664867+0000","last_clean":"2023-11-04T01:39:21.664867+0000","last_became_active":"2023-11-04T01:39:00.901087+0000","last_became_peered":"2023-11-04T01:39:00.901087+0000","last_unstale":"2023-11-04T01:39:21.664867+0000","last_undegraded":"2023-11-04T01:39:21.664867+0000","last_fullsized":"2023-11-04T01:39:21.664867+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:07.192076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662643+0000","last_change":"2023-11-04T01:39:02.076926+0000","last_active":"2023-11-04T01:39:21.662643+0000","last_peered":"2023-11-04T01:39:21.662643+0000","last_clean":"2023-11-04T01:39:21.662643+0000","last_became_active":"2023-11-04T01:38:59.897799+0000","last_became_peered":"2023-11-04T01:38:59.897799+0000","last_unstale":"2023-11-04T01:39:21.662643+0000","last_undegraded":"2023-11-04T01:39:21.662643+0000","last_fullsized":"2023-11-04T01:39:21.662643+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:06.186596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051016799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.665873+0000","last_change":"2023-11-04T01:38:01.699051+0000","last_active":"2023-11-04T01:39:21.665873+0000","last_peered":"2023-11-04T01:39:21.665873+0000","last_clean":"2023-11-04T01:39:21.665873+0000","last_became_active":"2023-11-04T01:38:00.708665+0000","last_became_peered":"2023-11-04T01:38:00.708665+0000","last_unstale":"2023-11-04T01:39:21.665873+0000","last_undegraded":"2023-11-04T01:39:21.665873+0000","last_fullsized":"2023-11-04T01:39:21.665873+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020995580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.678061+0000","last_change":"2023-11-04T01:39:22.672770+0000","last_active":"2023-11-04T01:39:22.678061+0000","last_peered":"2023-11-04T01:39:22.678061+0000","last_clean":"2023-11-04T01:39:22.678061+0000","last_became_active":"2023-11-04T01:39:22.668474+0000","last_became_peered":"2023-11-04T01:39:22.668474+0000","last_unstale":"2023-11-04T01:39:22.678061+0000","last_undegraded":"2023-11-04T01:39:22.678061+0000","last_fullsized":"2023-11-04T01:39:22.678061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:29.757239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"82'4","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.690328+0000","last_change":"2023-11-04T01:39:21.669468+0000","last_active":"2023-11-04T01:39:22.690328+0000","last_peered":"2023-11-04T01:39:22.690328+0000","last_clean":"2023-11-04T01:39:22.690328+0000","last_became_active":"2023-11-04T01:39:21.668598+0000","last_became_peered":"2023-11-04T01:39:21.668598+0000","last_unstale":"2023-11-04T01:39:22.690328+0000","last_undegraded":"2023-11-04T01:39:22.690328+0000","last_fullsized":"2023-11-04T01:39:22.690328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:47.609733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662333+0000","last_change":"2023-11-04T01:39:00.903233+0000","last_active":"2023-11-04T01:39:21.662333+0000","last_peered":"2023-11-04T01:39:21.662333+0000","last_clean":"2023-11-04T01:39:21.662333+0000","last_became_active":"2023-11-04T01:39:00.902913+0000","last_became_peered":"2023-11-04T01:39:00.902913+0000","last_unstale":"2023-11-04T01:39:21.662333+0000","last_undegraded":"2023-11-04T01:39:21.662333+0000","last_fullsized":"2023-11-04T01:39:21.662333+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:29.058403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.663523+0000","last_change":"2023-11-04T01:39:02.076853+0000","last_active":"2023-11-04T01:39:21.663523+0000","last_peered":"2023-11-04T01:39:21.663523+0000","last_clean":"2023-11-04T01:39:21.663523+0000","last_became_active":"2023-11-04T01:38:59.898310+0000","last_became_peered":"2023-11-04T01:38:59.898310+0000","last_unstale":"2023-11-04T01:39:21.663523+0000","last_undegraded":"2023-11-04T01:39:21.663523+0000","last_fullsized":"2023-11-04T01:39:21.663523+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:22.196883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066256699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.663085+0000","last_change":"2023-11-04T01:38:01.700742+0000","last_active":"2023-11-04T01:39:21.663085+0000","last_peered":"2023-11-04T01:39:21.663085+0000","last_clean":"2023-11-04T01:39:21.663085+0000","last_became_active":"2023-11-04T01:38:00.706671+0000","last_became_peered":"2023-11-04T01:38:00.706671+0000","last_unstale":"2023-11-04T01:39:21.663085+0000","last_undegraded":"2023-11-04T01:39:21.663085+0000","last_fullsized":"2023-11-04T01:39:21.663085+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072370699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.682579+0000","last_change":"2023-11-04T01:39:22.678008+0000","last_active":"2023-11-04T01:39:22.682579+0000","last_peered":"2023-11-04T01:39:22.682579+0000","last_clean":"2023-11-04T01:39:22.682579+0000","last_became_active":"2023-11-04T01:39:22.677734+0000","last_became_peered":"2023-11-04T01:39:22.677734+0000","last_unstale":"2023-11-04T01:39:22.682579+0000","last_undegraded":"2023-11-04T01:39:22.682579+0000","last_fullsized":"2023-11-04T01:39:22.682579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:34.159049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.660519+0000","last_change":"2023-11-04T01:39:21.668329+0000","last_active":"2023-11-04T01:39:22.660519+0000","last_peered":"2023-11-04T01:39:22.660519+0000","last_clean":"2023-11-04T01:39:22.660519+0000","last_became_active":"2023-11-04T01:39:21.668059+0000","last_became_peered":"2023-11-04T01:39:21.668059+0000","last_unstale":"2023-11-04T01:39:22.660519+0000","last_undegraded":"2023-11-04T01:39:22.660519+0000","last_fullsized":"2023-11-04T01:39:22.660519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:58.285827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662237+0000","last_change":"2023-11-04T01:39:00.902537+0000","last_active":"2023-11-04T01:39:21.662237+0000","last_peered":"2023-11-04T01:39:21.662237+0000","last_clean":"2023-11-04T01:39:21.662237+0000","last_became_active":"2023-11-04T01:39:00.902217+0000","last_became_peered":"2023-11-04T01:39:00.902217+0000","last_unstale":"2023-11-04T01:39:21.662237+0000","last_undegraded":"2023-11-04T01:39:21.662237+0000","last_fullsized":"2023-11-04T01:39:21.662237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:56.622252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661229+0000","last_change":"2023-11-04T01:39:01.896481+0000","last_active":"2023-11-04T01:39:21.661229+0000","last_peered":"2023-11-04T01:39:21.661229+0000","last_clean":"2023-11-04T01:39:21.661229+0000","last_became_active":"2023-11-04T01:38:59.897511+0000","last_became_peered":"2023-11-04T01:38:59.897511+0000","last_unstale":"2023-11-04T01:39:21.661229+0000","last_undegraded":"2023-11-04T01:39:21.661229+0000","last_fullsized":"2023-11-04T01:39:21.661229+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:31.015230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001138319,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662047+0000","last_change":"2023-11-04T01:38:01.697526+0000","last_active":"2023-11-04T01:39:21.662047+0000","last_peered":"2023-11-04T01:39:21.662047+0000","last_clean":"2023-11-04T01:39:21.662047+0000","last_became_active":"2023-11-04T01:38:00.707580+0000","last_became_peered":"2023-11-04T01:38:00.707580+0000","last_unstale":"2023-11-04T01:39:21.662047+0000","last_undegraded":"2023-11-04T01:39:21.662047+0000","last_fullsized":"2023-11-04T01:39:21.662047+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010806699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.674355+0000","last_change":"2023-11-04T01:39:22.672824+0000","last_active":"2023-11-04T01:39:22.674355+0000","last_peered":"2023-11-04T01:39:22.674355+0000","last_clean":"2023-11-04T01:39:22.674355+0000","last_became_active":"2023-11-04T01:39:22.672499+0000","last_became_peered":"2023-11-04T01:39:22.672499+0000","last_unstale":"2023-11-04T01:39:22.674355+0000","last_undegraded":"2023-11-04T01:39:22.674355+0000","last_fullsized":"2023-11-04T01:39:22.674355+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:16.646126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.664104+0000","last_change":"2023-11-04T01:39:21.670345+0000","last_active":"2023-11-04T01:39:22.664104+0000","last_peered":"2023-11-04T01:39:22.664104+0000","last_clean":"2023-11-04T01:39:22.664104+0000","last_became_active":"2023-11-04T01:39:21.670059+0000","last_became_peered":"2023-11-04T01:39:21.670059+0000","last_unstale":"2023-11-04T01:39:22.664104+0000","last_undegraded":"2023-11-04T01:39:22.664104+0000","last_fullsized":"2023-11-04T01:39:22.664104+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:26.443828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654035+0000","last_change":"2023-11-04T01:39:00.905358+0000","last_active":"2023-11-04T01:39:21.654035+0000","last_peered":"2023-11-04T01:39:21.654035+0000","last_clean":"2023-11-04T01:39:21.654035+0000","last_became_active":"2023-11-04T01:39:00.905066+0000","last_became_peered":"2023-11-04T01:39:00.905066+0000","last_unstale":"2023-11-04T01:39:21.654035+0000","last_undegraded":"2023-11-04T01:39:21.654035+0000","last_fullsized":"2023-11-04T01:39:21.654035+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:23.606563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662307+0000","last_change":"2023-11-04T01:39:01.897060+0000","last_active":"2023-11-04T01:39:21.662307+0000","last_peered":"2023-11-04T01:39:21.662307+0000","last_clean":"2023-11-04T01:39:21.662307+0000","last_became_active":"2023-11-04T01:38:59.888827+0000","last_became_peered":"2023-11-04T01:38:59.888827+0000","last_unstale":"2023-11-04T01:39:21.662307+0000","last_undegraded":"2023-11-04T01:39:21.662307+0000","last_fullsized":"2023-11-04T01:39:21.662307+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:52:14.150104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000963042,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.660201+0000","last_change":"2023-11-04T01:38:01.939462+0000","last_active":"2023-11-04T01:39:21.660201+0000","last_peered":"2023-11-04T01:39:21.660201+0000","last_clean":"2023-11-04T01:39:21.660201+0000","last_became_active":"2023-11-04T01:38:00.705830+0000","last_became_peered":"2023-11-04T01:38:00.705830+0000","last_unstale":"2023-11-04T01:39:21.660201+0000","last_undegraded":"2023-11-04T01:39:21.660201+0000","last_fullsized":"2023-11-04T01:39:21.660201+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059305000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.673501+0000","last_change":"2023-11-04T01:39:22.669793+0000","last_active":"2023-11-04T01:39:22.673501+0000","last_peered":"2023-11-04T01:39:22.673501+0000","last_clean":"2023-11-04T01:39:22.673501+0000","last_became_active":"2023-11-04T01:39:22.666919+0000","last_became_peered":"2023-11-04T01:39:22.666919+0000","last_unstale":"2023-11-04T01:39:22.673501+0000","last_undegraded":"2023-11-04T01:39:22.673501+0000","last_fullsized":"2023-11-04T01:39:22.673501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:14.309939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.687566+0000","last_change":"2023-11-04T01:39:21.672019+0000","last_active":"2023-11-04T01:39:22.687566+0000","last_peered":"2023-11-04T01:39:22.687566+0000","last_clean":"2023-11-04T01:39:22.687566+0000","last_became_active":"2023-11-04T01:39:21.671762+0000","last_became_peered":"2023-11-04T01:39:21.671762+0000","last_unstale":"2023-11-04T01:39:22.687566+0000","last_undegraded":"2023-11-04T01:39:22.687566+0000","last_fullsized":"2023-11-04T01:39:22.687566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:20:55.389510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.660988+0000","last_change":"2023-11-04T01:39:00.898467+0000","last_active":"2023-11-04T01:39:21.660988+0000","last_peered":"2023-11-04T01:39:21.660988+0000","last_clean":"2023-11-04T01:39:21.660988+0000","last_became_active":"2023-11-04T01:39:00.898168+0000","last_became_peered":"2023-11-04T01:39:00.898168+0000","last_unstale":"2023-11-04T01:39:21.660988+0000","last_undegraded":"2023-11-04T01:39:21.660988+0000","last_fullsized":"2023-11-04T01:39:21.660988+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:03.950091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654522+0000","last_change":"2023-11-04T01:39:02.371405+0000","last_active":"2023-11-04T01:39:21.654522+0000","last_peered":"2023-11-04T01:39:21.654522+0000","last_clean":"2023-11-04T01:39:21.654522+0000","last_became_active":"2023-11-04T01:38:59.884832+0000","last_became_peered":"2023-11-04T01:38:59.884832+0000","last_unstale":"2023-11-04T01:39:21.654522+0000","last_undegraded":"2023-11-04T01:39:21.654522+0000","last_fullsized":"2023-11-04T01:39:21.654522+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:22.851162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00135917,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.666650+0000","last_change":"2023-11-04T01:38:01.984456+0000","last_active":"2023-11-04T01:39:21.666650+0000","last_peered":"2023-11-04T01:39:21.666650+0000","last_clean":"2023-11-04T01:39:21.666650+0000","last_became_active":"2023-11-04T01:38:00.708803+0000","last_became_peered":"2023-11-04T01:38:00.708803+0000","last_unstale":"2023-11-04T01:39:21.666650+0000","last_undegraded":"2023-11-04T01:39:21.666650+0000","last_fullsized":"2023-11-04T01:39:21.666650+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:30.811033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061551599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683077+0000","last_change":"2023-11-04T01:39:22.680923+0000","last_active":"2023-11-04T01:39:22.683077+0000","last_peered":"2023-11-04T01:39:22.683077+0000","last_clean":"2023-11-04T01:39:22.683077+0000","last_became_active":"2023-11-04T01:39:22.680562+0000","last_became_peered":"2023-11-04T01:39:22.680562+0000","last_unstale":"2023-11-04T01:39:22.683077+0000","last_undegraded":"2023-11-04T01:39:22.683077+0000","last_fullsized":"2023-11-04T01:39:22.683077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:44.985565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.688097+0000","last_change":"2023-11-04T01:39:21.666286+0000","last_active":"2023-11-04T01:39:22.688097+0000","last_peered":"2023-11-04T01:39:22.688097+0000","last_clean":"2023-11-04T01:39:22.688097+0000","last_became_active":"2023-11-04T01:39:21.666026+0000","last_became_peered":"2023-11-04T01:39:21.666026+0000","last_unstale":"2023-11-04T01:39:22.688097+0000","last_undegraded":"2023-11-04T01:39:22.688097+0000","last_fullsized":"2023-11-04T01:39:22.688097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:35.632719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662483+0000","last_change":"2023-11-04T01:39:00.898232+0000","last_active":"2023-11-04T01:39:21.662483+0000","last_peered":"2023-11-04T01:39:21.662483+0000","last_clean":"2023-11-04T01:39:21.662483+0000","last_became_active":"2023-11-04T01:39:00.897953+0000","last_became_peered":"2023-11-04T01:39:00.897953+0000","last_unstale":"2023-11-04T01:39:21.662483+0000","last_undegraded":"2023-11-04T01:39:21.662483+0000","last_fullsized":"2023-11-04T01:39:21.662483+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:19.094868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661276+0000","last_change":"2023-11-04T01:39:02.076201+0000","last_active":"2023-11-04T01:39:21.661276+0000","last_peered":"2023-11-04T01:39:21.661276+0000","last_clean":"2023-11-04T01:39:21.661276+0000","last_became_active":"2023-11-04T01:38:59.885672+0000","last_became_peered":"2023-11-04T01:38:59.885672+0000","last_unstale":"2023-11-04T01:39:21.661276+0000","last_undegraded":"2023-11-04T01:39:21.661276+0000","last_fullsized":"2023-11-04T01:39:21.661276+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:15.425248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063733799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661497+0000","last_change":"2023-11-04T01:38:01.698866+0000","last_active":"2023-11-04T01:39:21.661497+0000","last_peered":"2023-11-04T01:39:21.661497+0000","last_clean":"2023-11-04T01:39:21.661497+0000","last_became_active":"2023-11-04T01:38:00.706149+0000","last_became_peered":"2023-11-04T01:38:00.706149+0000","last_unstale":"2023-11-04T01:39:21.661497+0000","last_undegraded":"2023-11-04T01:39:21.661497+0000","last_fullsized":"2023-11-04T01:39:21.661497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:59.391683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001344154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683590+0000","last_change":"2023-11-04T01:39:22.671747+0000","last_active":"2023-11-04T01:39:22.683590+0000","last_peered":"2023-11-04T01:39:22.683590+0000","last_clean":"2023-11-04T01:39:22.683590+0000","last_became_active":"2023-11-04T01:39:22.670878+0000","last_became_peered":"2023-11-04T01:39:22.670878+0000","last_unstale":"2023-11-04T01:39:22.683590+0000","last_undegraded":"2023-11-04T01:39:22.683590+0000","last_fullsized":"2023-11-04T01:39:22.683590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:28.975278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.662590+0000","last_change":"2023-11-04T01:39:21.667894+0000","last_active":"2023-11-04T01:39:22.662590+0000","last_peered":"2023-11-04T01:39:22.662590+0000","last_clean":"2023-11-04T01:39:22.662590+0000","last_became_active":"2023-11-04T01:39:21.667595+0000","last_became_peered":"2023-11-04T01:39:21.667595+0000","last_unstale":"2023-11-04T01:39:22.662590+0000","last_undegraded":"2023-11-04T01:39:22.662590+0000","last_fullsized":"2023-11-04T01:39:22.662590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:41:50.993293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.665627+0000","last_change":"2023-11-04T01:39:00.907552+0000","last_active":"2023-11-04T01:39:21.665627+0000","last_peered":"2023-11-04T01:39:21.665627+0000","last_clean":"2023-11-04T01:39:21.665627+0000","last_became_active":"2023-11-04T01:39:00.907262+0000","last_became_peered":"2023-11-04T01:39:00.907262+0000","last_unstale":"2023-11-04T01:39:21.665627+0000","last_undegraded":"2023-11-04T01:39:21.665627+0000","last_fullsized":"2023-11-04T01:39:21.665627+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:23.202363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654413+0000","last_change":"2023-11-04T01:39:02.371758+0000","last_active":"2023-11-04T01:39:21.654413+0000","last_peered":"2023-11-04T01:39:21.654413+0000","last_clean":"2023-11-04T01:39:21.654413+0000","last_became_active":"2023-11-04T01:38:59.891579+0000","last_became_peered":"2023-11-04T01:38:59.891579+0000","last_unstale":"2023-11-04T01:39:21.654413+0000","last_undegraded":"2023-11-04T01:39:21.654413+0000","last_fullsized":"2023-11-04T01:39:21.654413+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:04:45.779183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063536799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.663139+0000","last_change":"2023-11-04T01:38:01.699187+0000","last_active":"2023-11-04T01:39:21.663139+0000","last_peered":"2023-11-04T01:39:21.663139+0000","last_clean":"2023-11-04T01:39:21.663139+0000","last_became_active":"2023-11-04T01:38:00.706136+0000","last_became_peered":"2023-11-04T01:38:00.706136+0000","last_unstale":"2023-11-04T01:39:21.663139+0000","last_undegraded":"2023-11-04T01:39:21.663139+0000","last_fullsized":"2023-11-04T01:39:21.663139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074666999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.675612+0000","last_change":"2023-11-04T01:39:22.669711+0000","last_active":"2023-11-04T01:39:22.675612+0000","last_peered":"2023-11-04T01:39:22.675612+0000","last_clean":"2023-11-04T01:39:22.675612+0000","last_became_active":"2023-11-04T01:39:22.667542+0000","last_became_peered":"2023-11-04T01:39:22.667542+0000","last_unstale":"2023-11-04T01:39:22.675612+0000","last_undegraded":"2023-11-04T01:39:22.675612+0000","last_fullsized":"2023-11-04T01:39:22.675612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:43.048540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.667638+0000","last_change":"2023-11-04T01:39:21.677238+0000","last_active":"2023-11-04T01:39:22.667638+0000","last_peered":"2023-11-04T01:39:22.667638+0000","last_clean":"2023-11-04T01:39:22.667638+0000","last_became_active":"2023-11-04T01:39:21.676982+0000","last_became_peered":"2023-11-04T01:39:21.676982+0000","last_unstale":"2023-11-04T01:39:22.667638+0000","last_undegraded":"2023-11-04T01:39:22.667638+0000","last_fullsized":"2023-11-04T01:39:22.667638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:31:19.679370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.663426+0000","last_change":"2023-11-04T01:39:00.904464+0000","last_active":"2023-11-04T01:39:21.663426+0000","last_peered":"2023-11-04T01:39:21.663426+0000","last_clean":"2023-11-04T01:39:21.663426+0000","last_became_active":"2023-11-04T01:39:00.904172+0000","last_became_peered":"2023-11-04T01:39:00.904172+0000","last_unstale":"2023-11-04T01:39:21.663426+0000","last_undegraded":"2023-11-04T01:39:21.663426+0000","last_fullsized":"2023-11-04T01:39:21.663426+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:32.767818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654425+0000","last_change":"2023-11-04T01:39:02.371427+0000","last_active":"2023-11-04T01:39:21.654425+0000","last_peered":"2023-11-04T01:39:21.654425+0000","last_clean":"2023-11-04T01:39:21.654425+0000","last_became_active":"2023-11-04T01:38:59.886795+0000","last_became_peered":"2023-11-04T01:38:59.886795+0000","last_unstale":"2023-11-04T01:39:21.654425+0000","last_undegraded":"2023-11-04T01:39:21.654425+0000","last_fullsized":"2023-11-04T01:39:21.654425+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:24:01.300866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082815500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662579+0000","last_change":"2023-11-04T01:38:01.699630+0000","last_active":"2023-11-04T01:39:21.662579+0000","last_peered":"2023-11-04T01:39:21.662579+0000","last_clean":"2023-11-04T01:39:21.662579+0000","last_became_active":"2023-11-04T01:38:00.702550+0000","last_became_peered":"2023-11-04T01:38:00.702550+0000","last_unstale":"2023-11-04T01:39:21.662579+0000","last_undegraded":"2023-11-04T01:39:21.662579+0000","last_fullsized":"2023-11-04T01:39:21.662579+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001016077,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.672445+0000","last_change":"2023-11-04T01:39:22.667084+0000","last_active":"2023-11-04T01:39:22.672445+0000","last_peered":"2023-11-04T01:39:22.672445+0000","last_clean":"2023-11-04T01:39:22.672445+0000","last_became_active":"2023-11-04T01:39:22.666239+0000","last_became_peered":"2023-11-04T01:39:22.666239+0000","last_unstale":"2023-11-04T01:39:22.672445+0000","last_undegraded":"2023-11-04T01:39:22.672445+0000","last_fullsized":"2023-11-04T01:39:22.672445+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:50.841605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.665412+0000","last_change":"2023-11-04T01:39:21.672578+0000","last_active":"2023-11-04T01:39:22.665412+0000","last_peered":"2023-11-04T01:39:22.665412+0000","last_clean":"2023-11-04T01:39:22.665412+0000","last_became_active":"2023-11-04T01:39:21.672265+0000","last_became_peered":"2023-11-04T01:39:21.672265+0000","last_unstale":"2023-11-04T01:39:22.665412+0000","last_undegraded":"2023-11-04T01:39:22.665412+0000","last_fullsized":"2023-11-04T01:39:22.665412+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:15:23.377046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662096+0000","last_change":"2023-11-04T01:39:00.905979+0000","last_active":"2023-11-04T01:39:21.662096+0000","last_peered":"2023-11-04T01:39:21.662096+0000","last_clean":"2023-11-04T01:39:21.662096+0000","last_became_active":"2023-11-04T01:39:00.905741+0000","last_became_peered":"2023-11-04T01:39:00.905741+0000","last_unstale":"2023-11-04T01:39:21.662096+0000","last_undegraded":"2023-11-04T01:39:21.662096+0000","last_fullsized":"2023-11-04T01:39:21.662096+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:29.058403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662410+0000","last_change":"2023-11-04T01:39:01.898934+0000","last_active":"2023-11-04T01:39:21.662410+0000","last_peered":"2023-11-04T01:39:21.662410+0000","last_clean":"2023-11-04T01:39:21.662410+0000","last_became_active":"2023-11-04T01:38:59.895023+0000","last_became_peered":"2023-11-04T01:38:59.895023+0000","last_unstale":"2023-11-04T01:39:21.662410+0000","last_undegraded":"2023-11-04T01:39:21.662410+0000","last_fullsized":"2023-11-04T01:39:21.662410+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:50.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091724099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661021+0000","last_change":"2023-11-04T01:38:01.984764+0000","last_active":"2023-11-04T01:39:21.661021+0000","last_peered":"2023-11-04T01:39:21.661021+0000","last_clean":"2023-11-04T01:39:21.661021+0000","last_became_active":"2023-11-04T01:38:00.709894+0000","last_became_peered":"2023-11-04T01:38:00.709894+0000","last_unstale":"2023-11-04T01:39:21.661021+0000","last_undegraded":"2023-11-04T01:39:21.661021+0000","last_fullsized":"2023-11-04T01:39:21.661021+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:08:42.829255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045046799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.690468+0000","last_change":"2023-11-04T01:39:22.683335+0000","last_active":"2023-11-04T01:39:22.690468+0000","last_peered":"2023-11-04T01:39:22.690468+0000","last_clean":"2023-11-04T01:39:22.690468+0000","last_became_active":"2023-11-04T01:39:22.683091+0000","last_became_peered":"2023-11-04T01:39:22.683091+0000","last_unstale":"2023-11-04T01:39:22.690468+0000","last_undegraded":"2023-11-04T01:39:22.690468+0000","last_fullsized":"2023-11-04T01:39:22.690468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:54:56.699605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.689171+0000","last_change":"2023-11-04T01:39:21.665094+0000","last_active":"2023-11-04T01:39:22.689171+0000","last_peered":"2023-11-04T01:39:22.689171+0000","last_clean":"2023-11-04T01:39:22.689171+0000","last_became_active":"2023-11-04T01:39:21.664770+0000","last_became_peered":"2023-11-04T01:39:21.664770+0000","last_unstale":"2023-11-04T01:39:22.689171+0000","last_undegraded":"2023-11-04T01:39:22.689171+0000","last_fullsized":"2023-11-04T01:39:22.689171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:24.724420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662480+0000","last_change":"2023-11-04T01:39:00.902634+0000","last_active":"2023-11-04T01:39:21.662480+0000","last_peered":"2023-11-04T01:39:21.662480+0000","last_clean":"2023-11-04T01:39:21.662480+0000","last_became_active":"2023-11-04T01:39:00.902174+0000","last_became_peered":"2023-11-04T01:39:00.902174+0000","last_unstale":"2023-11-04T01:39:21.662480+0000","last_undegraded":"2023-11-04T01:39:21.662480+0000","last_fullsized":"2023-11-04T01:39:21.662480+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:49.057663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662929+0000","last_change":"2023-11-04T01:39:01.899198+0000","last_active":"2023-11-04T01:39:21.662929+0000","last_peered":"2023-11-04T01:39:21.662929+0000","last_clean":"2023-11-04T01:39:21.662929+0000","last_became_active":"2023-11-04T01:38:59.893842+0000","last_became_peered":"2023-11-04T01:38:59.893842+0000","last_unstale":"2023-11-04T01:39:21.662929+0000","last_undegraded":"2023-11-04T01:39:21.662929+0000","last_fullsized":"2023-11-04T01:39:21.662929+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:05.228427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089883699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.658064+0000","last_change":"2023-11-04T01:38:02.321871+0000","last_active":"2023-11-04T01:39:21.658064+0000","last_peered":"2023-11-04T01:39:21.658064+0000","last_clean":"2023-11-04T01:39:21.658064+0000","last_became_active":"2023-11-04T01:38:00.708407+0000","last_became_peered":"2023-11-04T01:38:00.708407+0000","last_unstale":"2023-11-04T01:39:21.658064+0000","last_undegraded":"2023-11-04T01:39:21.658064+0000","last_fullsized":"2023-11-04T01:39:21.658064+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:48.672429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032387200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683735+0000","last_change":"2023-11-04T01:39:22.669226+0000","last_active":"2023-11-04T01:39:22.683735+0000","last_peered":"2023-11-04T01:39:22.683735+0000","last_clean":"2023-11-04T01:39:22.683735+0000","last_became_active":"2023-11-04T01:39:22.668915+0000","last_became_peered":"2023-11-04T01:39:22.668915+0000","last_unstale":"2023-11-04T01:39:22.683735+0000","last_undegraded":"2023-11-04T01:39:22.683735+0000","last_fullsized":"2023-11-04T01:39:22.683735+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:44.985565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.659968+0000","last_change":"2023-11-04T01:39:21.671540+0000","last_active":"2023-11-04T01:39:22.659968+0000","last_peered":"2023-11-04T01:39:22.659968+0000","last_clean":"2023-11-04T01:39:22.659968+0000","last_became_active":"2023-11-04T01:39:21.671205+0000","last_became_peered":"2023-11-04T01:39:21.671205+0000","last_unstale":"2023-11-04T01:39:22.659968+0000","last_undegraded":"2023-11-04T01:39:22.659968+0000","last_fullsized":"2023-11-04T01:39:22.659968+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:39.699903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.666284+0000","last_change":"2023-11-04T01:39:00.902561+0000","last_active":"2023-11-04T01:39:21.666284+0000","last_peered":"2023-11-04T01:39:21.666284+0000","last_clean":"2023-11-04T01:39:21.666284+0000","last_became_active":"2023-11-04T01:39:00.902203+0000","last_became_peered":"2023-11-04T01:39:00.902203+0000","last_unstale":"2023-11-04T01:39:21.666284+0000","last_undegraded":"2023-11-04T01:39:21.666284+0000","last_fullsized":"2023-11-04T01:39:21.666284+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:12.375847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661282+0000","last_change":"2023-11-04T01:39:01.896891+0000","last_active":"2023-11-04T01:39:21.661282+0000","last_peered":"2023-11-04T01:39:21.661282+0000","last_clean":"2023-11-04T01:39:21.661282+0000","last_became_active":"2023-11-04T01:38:59.894385+0000","last_became_peered":"2023-11-04T01:38:59.894385+0000","last_unstale":"2023-11-04T01:39:21.661282+0000","last_undegraded":"2023-11-04T01:39:21.661282+0000","last_fullsized":"2023-11-04T01:39:21.661282+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:36:07.725905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084524899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661351+0000","last_change":"2023-11-04T01:38:01.983988+0000","last_active":"2023-11-04T01:39:21.661351+0000","last_peered":"2023-11-04T01:39:21.661351+0000","last_clean":"2023-11-04T01:39:21.661351+0000","last_became_active":"2023-11-04T01:38:00.711020+0000","last_became_peered":"2023-11-04T01:38:00.711020+0000","last_unstale":"2023-11-04T01:39:21.661351+0000","last_undegraded":"2023-11-04T01:39:21.661351+0000","last_fullsized":"2023-11-04T01:39:21.661351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:06.374078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.678778+0000","last_change":"2023-11-04T01:39:22.676138+0000","last_active":"2023-11-04T01:39:22.678778+0000","last_peered":"2023-11-04T01:39:22.678778+0000","last_clean":"2023-11-04T01:39:22.678778+0000","last_became_active":"2023-11-04T01:39:22.675833+0000","last_became_peered":"2023-11-04T01:39:22.675833+0000","last_unstale":"2023-11-04T01:39:22.678778+0000","last_undegraded":"2023-11-04T01:39:22.678778+0000","last_fullsized":"2023-11-04T01:39:22.678778+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:54:04.782313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.661914+0000","last_change":"2023-11-04T01:39:21.671744+0000","last_active":"2023-11-04T01:39:22.661914+0000","last_peered":"2023-11-04T01:39:22.661914+0000","last_clean":"2023-11-04T01:39:22.661914+0000","last_became_active":"2023-11-04T01:39:21.671496+0000","last_became_peered":"2023-11-04T01:39:21.671496+0000","last_unstale":"2023-11-04T01:39:22.661914+0000","last_undegraded":"2023-11-04T01:39:22.661914+0000","last_fullsized":"2023-11-04T01:39:22.661914+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:26:36.460122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.657023+0000","last_change":"2023-11-04T01:39:00.902481+0000","last_active":"2023-11-04T01:39:21.657023+0000","last_peered":"2023-11-04T01:39:21.657023+0000","last_clean":"2023-11-04T01:39:21.657023+0000","last_became_active":"2023-11-04T01:39:00.902206+0000","last_became_peered":"2023-11-04T01:39:00.902206+0000","last_unstale":"2023-11-04T01:39:21.657023+0000","last_undegraded":"2023-11-04T01:39:21.657023+0000","last_fullsized":"2023-11-04T01:39:21.657023+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:49.996214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.666480+0000","last_change":"2023-11-04T01:39:02.076608+0000","last_active":"2023-11-04T01:39:21.666480+0000","last_peered":"2023-11-04T01:39:21.666480+0000","last_clean":"2023-11-04T01:39:21.666480+0000","last_became_active":"2023-11-04T01:38:59.892104+0000","last_became_peered":"2023-11-04T01:38:59.892104+0000","last_unstale":"2023-11-04T01:39:21.666480+0000","last_undegraded":"2023-11-04T01:39:21.666480+0000","last_fullsized":"2023-11-04T01:39:21.666480+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:15.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063915499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.657586+0000","last_change":"2023-11-04T01:38:02.321641+0000","last_active":"2023-11-04T01:39:21.657586+0000","last_peered":"2023-11-04T01:39:21.657586+0000","last_clean":"2023-11-04T01:39:21.657586+0000","last_became_active":"2023-11-04T01:38:00.706199+0000","last_became_peered":"2023-11-04T01:38:00.706199+0000","last_unstale":"2023-11-04T01:39:21.657586+0000","last_undegraded":"2023-11-04T01:39:21.657586+0000","last_fullsized":"2023-11-04T01:39:21.657586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:15.138325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045080400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683105+0000","last_change":"2023-11-04T01:39:22.682185+0000","last_active":"2023-11-04T01:39:22.683105+0000","last_peered":"2023-11-04T01:39:22.683105+0000","last_clean":"2023-11-04T01:39:22.683105+0000","last_became_active":"2023-11-04T01:39:22.680316+0000","last_became_peered":"2023-11-04T01:39:22.680316+0000","last_unstale":"2023-11-04T01:39:22.683105+0000","last_undegraded":"2023-11-04T01:39:22.683105+0000","last_fullsized":"2023-11-04T01:39:22.683105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:38.590666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.660972+0000","last_change":"2023-11-04T01:39:21.673727+0000","last_active":"2023-11-04T01:39:22.660972+0000","last_peered":"2023-11-04T01:39:22.660972+0000","last_clean":"2023-11-04T01:39:22.660972+0000","last_became_active":"2023-11-04T01:39:21.673415+0000","last_became_peered":"2023-11-04T01:39:21.673415+0000","last_unstale":"2023-11-04T01:39:22.660972+0000","last_undegraded":"2023-11-04T01:39:22.660972+0000","last_fullsized":"2023-11-04T01:39:22.660972+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:38:51.680108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662793+0000","last_change":"2023-11-04T01:39:00.906469+0000","last_active":"2023-11-04T01:39:21.662793+0000","last_peered":"2023-11-04T01:39:21.662793+0000","last_clean":"2023-11-04T01:39:21.662793+0000","last_became_active":"2023-11-04T01:39:00.905872+0000","last_became_peered":"2023-11-04T01:39:00.905872+0000","last_unstale":"2023-11-04T01:39:21.662793+0000","last_undegraded":"2023-11-04T01:39:21.662793+0000","last_fullsized":"2023-11-04T01:39:21.662793+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:32.767818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664128+0000","last_change":"2023-11-04T01:39:01.897198+0000","last_active":"2023-11-04T01:39:21.664128+0000","last_peered":"2023-11-04T01:39:21.664128+0000","last_clean":"2023-11-04T01:39:21.664128+0000","last_became_active":"2023-11-04T01:38:59.884103+0000","last_became_peered":"2023-11-04T01:38:59.884103+0000","last_unstale":"2023-11-04T01:39:21.664128+0000","last_undegraded":"2023-11-04T01:39:21.664128+0000","last_fullsized":"2023-11-04T01:39:21.664128+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:07.268618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074876599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654961+0000","last_change":"2023-11-04T01:38:02.156148+0000","last_active":"2023-11-04T01:39:21.654961+0000","last_peered":"2023-11-04T01:39:21.654961+0000","last_clean":"2023-11-04T01:39:21.654961+0000","last_became_active":"2023-11-04T01:38:00.708352+0000","last_became_peered":"2023-11-04T01:38:00.708352+0000","last_unstale":"2023-11-04T01:39:21.654961+0000","last_undegraded":"2023-11-04T01:39:21.654961+0000","last_fullsized":"2023-11-04T01:39:21.654961+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035716799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.679080+0000","last_change":"2023-11-04T01:39:22.676843+0000","last_active":"2023-11-04T01:39:22.679080+0000","last_peered":"2023-11-04T01:39:22.679080+0000","last_clean":"2023-11-04T01:39:22.679080+0000","last_became_active":"2023-11-04T01:39:22.676591+0000","last_became_peered":"2023-11-04T01:39:22.676591+0000","last_unstale":"2023-11-04T01:39:22.679080+0000","last_undegraded":"2023-11-04T01:39:22.679080+0000","last_fullsized":"2023-11-04T01:39:22.679080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:00:14.765974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.663799+0000","last_change":"2023-11-04T01:39:21.671653+0000","last_active":"2023-11-04T01:39:22.663799+0000","last_peered":"2023-11-04T01:39:22.663799+0000","last_clean":"2023-11-04T01:39:22.663799+0000","last_became_active":"2023-11-04T01:39:21.671407+0000","last_became_peered":"2023-11-04T01:39:21.671407+0000","last_unstale":"2023-11-04T01:39:22.663799+0000","last_undegraded":"2023-11-04T01:39:22.663799+0000","last_fullsized":"2023-11-04T01:39:22.663799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:53.922190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662583+0000","last_change":"2023-11-04T01:39:00.905021+0000","last_active":"2023-11-04T01:39:21.662583+0000","last_peered":"2023-11-04T01:39:21.662583+0000","last_clean":"2023-11-04T01:39:21.662583+0000","last_became_active":"2023-11-04T01:39:00.904730+0000","last_became_peered":"2023-11-04T01:39:00.904730+0000","last_unstale":"2023-11-04T01:39:21.662583+0000","last_undegraded":"2023-11-04T01:39:21.662583+0000","last_fullsized":"2023-11-04T01:39:21.662583+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:28.746335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662550+0000","last_change":"2023-11-04T01:39:01.897770+0000","last_active":"2023-11-04T01:39:21.662550+0000","last_peered":"2023-11-04T01:39:21.662550+0000","last_clean":"2023-11-04T01:39:21.662550+0000","last_became_active":"2023-11-04T01:38:59.894386+0000","last_became_peered":"2023-11-04T01:38:59.894386+0000","last_unstale":"2023-11-04T01:39:21.662550+0000","last_undegraded":"2023-11-04T01:39:21.662550+0000","last_fullsized":"2023-11-04T01:39:21.662550+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:20.259857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069590400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.660729+0000","last_change":"2023-11-04T01:38:01.939729+0000","last_active":"2023-11-04T01:39:21.660729+0000","last_peered":"2023-11-04T01:39:21.660729+0000","last_clean":"2023-11-04T01:39:21.660729+0000","last_became_active":"2023-11-04T01:38:00.704384+0000","last_became_peered":"2023-11-04T01:38:00.704384+0000","last_unstale":"2023-11-04T01:39:21.660729+0000","last_undegraded":"2023-11-04T01:39:21.660729+0000","last_fullsized":"2023-11-04T01:39:21.660729+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080052200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.685308+0000","last_change":"2023-11-04T01:39:22.679391+0000","last_active":"2023-11-04T01:39:22.685308+0000","last_peered":"2023-11-04T01:39:22.685308+0000","last_clean":"2023-11-04T01:39:22.685308+0000","last_became_active":"2023-11-04T01:39:22.679128+0000","last_became_peered":"2023-11-04T01:39:22.679128+0000","last_unstale":"2023-11-04T01:39:22.685308+0000","last_undegraded":"2023-11-04T01:39:22.685308+0000","last_fullsized":"2023-11-04T01:39:22.685308+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:29.339900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.665568+0000","last_change":"2023-11-04T01:39:21.677236+0000","last_active":"2023-11-04T01:39:22.665568+0000","last_peered":"2023-11-04T01:39:22.665568+0000","last_clean":"2023-11-04T01:39:22.665568+0000","last_became_active":"2023-11-04T01:39:21.676940+0000","last_became_peered":"2023-11-04T01:39:21.676940+0000","last_unstale":"2023-11-04T01:39:22.665568+0000","last_undegraded":"2023-11-04T01:39:22.665568+0000","last_fullsized":"2023-11-04T01:39:22.665568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:42:39.284455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664553+0000","last_change":"2023-11-04T01:39:00.904930+0000","last_active":"2023-11-04T01:39:21.664553+0000","last_peered":"2023-11-04T01:39:21.664553+0000","last_clean":"2023-11-04T01:39:21.664553+0000","last_became_active":"2023-11-04T01:39:00.904645+0000","last_became_peered":"2023-11-04T01:39:00.904645+0000","last_unstale":"2023-11-04T01:39:21.664553+0000","last_undegraded":"2023-11-04T01:39:21.664553+0000","last_fullsized":"2023-11-04T01:39:21.664553+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:14.894198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664384+0000","last_change":"2023-11-04T01:39:02.076751+0000","last_active":"2023-11-04T01:39:21.664384+0000","last_peered":"2023-11-04T01:39:21.664384+0000","last_clean":"2023-11-04T01:39:21.664384+0000","last_became_active":"2023-11-04T01:38:59.887859+0000","last_became_peered":"2023-11-04T01:38:59.887859+0000","last_unstale":"2023-11-04T01:39:21.664384+0000","last_undegraded":"2023-11-04T01:39:21.664384+0000","last_fullsized":"2023-11-04T01:39:21.664384+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:42.452480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057159799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.666030+0000","last_change":"2023-11-04T01:38:01.697272+0000","last_active":"2023-11-04T01:39:21.666030+0000","last_peered":"2023-11-04T01:39:21.666030+0000","last_clean":"2023-11-04T01:39:21.666030+0000","last_became_active":"2023-11-04T01:38:00.709395+0000","last_became_peered":"2023-11-04T01:38:00.709395+0000","last_unstale":"2023-11-04T01:39:21.666030+0000","last_undegraded":"2023-11-04T01:39:21.666030+0000","last_fullsized":"2023-11-04T01:39:21.666030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076665499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.687941+0000","last_change":"2023-11-04T01:39:22.684791+0000","last_active":"2023-11-04T01:39:22.687941+0000","last_peered":"2023-11-04T01:39:22.687941+0000","last_clean":"2023-11-04T01:39:22.687941+0000","last_became_active":"2023-11-04T01:39:22.684526+0000","last_became_peered":"2023-11-04T01:39:22.684526+0000","last_unstale":"2023-11-04T01:39:22.687941+0000","last_undegraded":"2023-11-04T01:39:22.687941+0000","last_fullsized":"2023-11-04T01:39:22.687941+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:28.975278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.688255+0000","last_change":"2023-11-04T01:39:21.665663+0000","last_active":"2023-11-04T01:39:22.688255+0000","last_peered":"2023-11-04T01:39:22.688255+0000","last_clean":"2023-11-04T01:39:22.688255+0000","last_became_active":"2023-11-04T01:39:21.665263+0000","last_became_peered":"2023-11-04T01:39:21.665263+0000","last_unstale":"2023-11-04T01:39:22.688255+0000","last_undegraded":"2023-11-04T01:39:22.688255+0000","last_fullsized":"2023-11-04T01:39:22.688255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:00.089969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.665412+0000","last_change":"2023-11-04T01:39:00.904589+0000","last_active":"2023-11-04T01:39:21.665412+0000","last_peered":"2023-11-04T01:39:21.665412+0000","last_clean":"2023-11-04T01:39:21.665412+0000","last_became_active":"2023-11-04T01:39:00.904277+0000","last_became_peered":"2023-11-04T01:39:00.904277+0000","last_unstale":"2023-11-04T01:39:21.665412+0000","last_undegraded":"2023-11-04T01:39:21.665412+0000","last_fullsized":"2023-11-04T01:39:21.665412+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:43.457960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664464+0000","last_change":"2023-11-04T01:39:01.899561+0000","last_active":"2023-11-04T01:39:21.664464+0000","last_peered":"2023-11-04T01:39:21.664464+0000","last_clean":"2023-11-04T01:39:21.664464+0000","last_became_active":"2023-11-04T01:38:59.886002+0000","last_became_peered":"2023-11-04T01:38:59.886002+0000","last_unstale":"2023-11-04T01:39:21.664464+0000","last_undegraded":"2023-11-04T01:39:21.664464+0000","last_fullsized":"2023-11-04T01:39:21.664464+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:06:48.983584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061693100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662719+0000","last_change":"2023-11-04T01:38:01.984567+0000","last_active":"2023-11-04T01:39:21.662719+0000","last_peered":"2023-11-04T01:39:21.662719+0000","last_clean":"2023-11-04T01:39:21.662719+0000","last_became_active":"2023-11-04T01:38:00.708020+0000","last_became_peered":"2023-11-04T01:38:00.708020+0000","last_unstale":"2023-11-04T01:39:21.662719+0000","last_undegraded":"2023-11-04T01:39:21.662719+0000","last_fullsized":"2023-11-04T01:39:21.662719+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:09.638146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056906299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683639+0000","last_change":"2023-11-04T01:39:22.676021+0000","last_active":"2023-11-04T01:39:22.683639+0000","last_peered":"2023-11-04T01:39:22.683639+0000","last_clean":"2023-11-04T01:39:22.683639+0000","last_became_active":"2023-11-04T01:39:22.675736+0000","last_became_peered":"2023-11-04T01:39:22.675736+0000","last_unstale":"2023-11-04T01:39:22.683639+0000","last_undegraded":"2023-11-04T01:39:22.683639+0000","last_fullsized":"2023-11-04T01:39:22.683639+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:53.717057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.690743+0000","last_change":"2023-11-04T01:39:21.670093+0000","last_active":"2023-11-04T01:39:22.690743+0000","last_peered":"2023-11-04T01:39:22.690743+0000","last_clean":"2023-11-04T01:39:22.690743+0000","last_became_active":"2023-11-04T01:39:21.669807+0000","last_became_peered":"2023-11-04T01:39:21.669807+0000","last_unstale":"2023-11-04T01:39:22.690743+0000","last_undegraded":"2023-11-04T01:39:22.690743+0000","last_fullsized":"2023-11-04T01:39:22.690743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:37.205057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662174+0000","last_change":"2023-11-04T01:39:00.902975+0000","last_active":"2023-11-04T01:39:21.662174+0000","last_peered":"2023-11-04T01:39:21.662174+0000","last_clean":"2023-11-04T01:39:21.662174+0000","last_became_active":"2023-11-04T01:39:00.902732+0000","last_became_peered":"2023-11-04T01:39:00.902732+0000","last_unstale":"2023-11-04T01:39:21.662174+0000","last_undegraded":"2023-11-04T01:39:21.662174+0000","last_fullsized":"2023-11-04T01:39:21.662174+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:21.265338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662565+0000","last_change":"2023-11-04T01:39:02.076570+0000","last_active":"2023-11-04T01:39:21.662565+0000","last_peered":"2023-11-04T01:39:21.662565+0000","last_clean":"2023-11-04T01:39:21.662565+0000","last_became_active":"2023-11-04T01:38:59.886841+0000","last_became_peered":"2023-11-04T01:38:59.886841+0000","last_unstale":"2023-11-04T01:39:21.662565+0000","last_undegraded":"2023-11-04T01:39:21.662565+0000","last_fullsized":"2023-11-04T01:39:21.662565+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:27.740854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064312500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664798+0000","last_change":"2023-11-04T01:38:01.699685+0000","last_active":"2023-11-04T01:39:21.664798+0000","last_peered":"2023-11-04T01:39:21.664798+0000","last_clean":"2023-11-04T01:39:21.664798+0000","last_became_active":"2023-11-04T01:38:00.706802+0000","last_became_peered":"2023-11-04T01:38:00.706802+0000","last_unstale":"2023-11-04T01:39:21.664798+0000","last_undegraded":"2023-11-04T01:39:21.664798+0000","last_fullsized":"2023-11-04T01:39:21.664798+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085845400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683755+0000","last_change":"2023-11-04T01:39:22.670527+0000","last_active":"2023-11-04T01:39:22.683755+0000","last_peered":"2023-11-04T01:39:22.683755+0000","last_clean":"2023-11-04T01:39:22.683755+0000","last_became_active":"2023-11-04T01:39:22.670065+0000","last_became_peered":"2023-11-04T01:39:22.670065+0000","last_unstale":"2023-11-04T01:39:22.683755+0000","last_undegraded":"2023-11-04T01:39:22.683755+0000","last_fullsized":"2023-11-04T01:39:22.683755+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:30.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.664054+0000","last_change":"2023-11-04T01:39:21.672384+0000","last_active":"2023-11-04T01:39:22.664054+0000","last_peered":"2023-11-04T01:39:22.664054+0000","last_clean":"2023-11-04T01:39:22.664054+0000","last_became_active":"2023-11-04T01:39:21.671973+0000","last_became_peered":"2023-11-04T01:39:21.671973+0000","last_unstale":"2023-11-04T01:39:22.664054+0000","last_undegraded":"2023-11-04T01:39:22.664054+0000","last_fullsized":"2023-11-04T01:39:22.664054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:52:06.433799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.657001+0000","last_change":"2023-11-04T01:39:00.904110+0000","last_active":"2023-11-04T01:39:21.657001+0000","last_peered":"2023-11-04T01:39:21.657001+0000","last_clean":"2023-11-04T01:39:21.657001+0000","last_became_active":"2023-11-04T01:39:00.903820+0000","last_became_peered":"2023-11-04T01:39:00.903820+0000","last_unstale":"2023-11-04T01:39:21.657001+0000","last_undegraded":"2023-11-04T01:39:21.657001+0000","last_fullsized":"2023-11-04T01:39:21.657001+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:06:49.989064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.658720+0000","last_change":"2023-11-04T01:39:02.370981+0000","last_active":"2023-11-04T01:39:21.658720+0000","last_peered":"2023-11-04T01:39:21.658720+0000","last_clean":"2023-11-04T01:39:21.658720+0000","last_became_active":"2023-11-04T01:38:59.893000+0000","last_became_peered":"2023-11-04T01:38:59.893000+0000","last_unstale":"2023-11-04T01:39:21.658720+0000","last_undegraded":"2023-11-04T01:39:21.658720+0000","last_fullsized":"2023-11-04T01:39:21.658720+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:10.350371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065268599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661885+0000","last_change":"2023-11-04T01:38:01.700399+0000","last_active":"2023-11-04T01:39:21.661885+0000","last_peered":"2023-11-04T01:39:21.661885+0000","last_clean":"2023-11-04T01:39:21.661885+0000","last_became_active":"2023-11-04T01:38:00.701352+0000","last_became_peered":"2023-11-04T01:38:00.701352+0000","last_unstale":"2023-11-04T01:39:21.661885+0000","last_undegraded":"2023-11-04T01:39:21.661885+0000","last_fullsized":"2023-11-04T01:39:21.661885+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078589399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.672498+0000","last_change":"2023-11-04T01:39:22.668564+0000","last_active":"2023-11-04T01:39:22.672498+0000","last_peered":"2023-11-04T01:39:22.672498+0000","last_clean":"2023-11-04T01:39:22.672498+0000","last_became_active":"2023-11-04T01:39:22.668281+0000","last_became_peered":"2023-11-04T01:39:22.668281+0000","last_unstale":"2023-11-04T01:39:22.672498+0000","last_undegraded":"2023-11-04T01:39:22.672498+0000","last_fullsized":"2023-11-04T01:39:22.672498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:45.683893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.673490+0000","last_change":"2023-11-04T01:39:21.668453+0000","last_active":"2023-11-04T01:39:22.673490+0000","last_peered":"2023-11-04T01:39:22.673490+0000","last_clean":"2023-11-04T01:39:22.673490+0000","last_became_active":"2023-11-04T01:39:21.668129+0000","last_became_peered":"2023-11-04T01:39:21.668129+0000","last_unstale":"2023-11-04T01:39:22.673490+0000","last_undegraded":"2023-11-04T01:39:22.673490+0000","last_fullsized":"2023-11-04T01:39:22.673490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:52.708183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.658771+0000","last_change":"2023-11-04T01:39:00.902993+0000","last_active":"2023-11-04T01:39:21.658771+0000","last_peered":"2023-11-04T01:39:21.658771+0000","last_clean":"2023-11-04T01:39:21.658771+0000","last_became_active":"2023-11-04T01:39:00.902704+0000","last_became_peered":"2023-11-04T01:39:00.902704+0000","last_unstale":"2023-11-04T01:39:21.658771+0000","last_undegraded":"2023-11-04T01:39:21.658771+0000","last_fullsized":"2023-11-04T01:39:21.658771+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:38.313962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.659198+0000","last_change":"2023-11-04T01:39:02.039353+0000","last_active":"2023-11-04T01:39:21.659198+0000","last_peered":"2023-11-04T01:39:21.659198+0000","last_clean":"2023-11-04T01:39:21.659198+0000","last_became_active":"2023-11-04T01:38:59.897877+0000","last_became_peered":"2023-11-04T01:38:59.897877+0000","last_unstale":"2023-11-04T01:39:21.659198+0000","last_undegraded":"2023-11-04T01:39:21.659198+0000","last_fullsized":"2023-11-04T01:39:21.659198+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:13:39.795522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000482974,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.655878+0000","last_change":"2023-11-04T01:38:02.362072+0000","last_active":"2023-11-04T01:39:21.655878+0000","last_peered":"2023-11-04T01:39:21.655878+0000","last_clean":"2023-11-04T01:39:21.655878+0000","last_became_active":"2023-11-04T01:38:00.710897+0000","last_became_peered":"2023-11-04T01:38:00.710897+0000","last_unstale":"2023-11-04T01:39:21.655878+0000","last_undegraded":"2023-11-04T01:39:21.655878+0000","last_fullsized":"2023-11-04T01:39:21.655878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:25.229838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058055900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.678088+0000","last_change":"2023-11-04T01:39:22.673323+0000","last_active":"2023-11-04T01:39:22.678088+0000","last_peered":"2023-11-04T01:39:22.678088+0000","last_clean":"2023-11-04T01:39:22.678088+0000","last_became_active":"2023-11-04T01:39:22.672234+0000","last_became_peered":"2023-11-04T01:39:22.672234+0000","last_unstale":"2023-11-04T01:39:22.678088+0000","last_undegraded":"2023-11-04T01:39:22.678088+0000","last_fullsized":"2023-11-04T01:39:22.678088+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:03:42.431745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.672498+0000","last_change":"2023-11-04T01:39:21.671402+0000","last_active":"2023-11-04T01:39:22.672498+0000","last_peered":"2023-11-04T01:39:22.672498+0000","last_clean":"2023-11-04T01:39:22.672498+0000","last_became_active":"2023-11-04T01:39:21.671180+0000","last_became_peered":"2023-11-04T01:39:21.671180+0000","last_unstale":"2023-11-04T01:39:22.672498+0000","last_undegraded":"2023-11-04T01:39:22.672498+0000","last_fullsized":"2023-11-04T01:39:22.672498+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:36.388782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.655788+0000","last_change":"2023-11-04T01:39:00.901761+0000","last_active":"2023-11-04T01:39:21.655788+0000","last_peered":"2023-11-04T01:39:21.655788+0000","last_clean":"2023-11-04T01:39:21.655788+0000","last_became_active":"2023-11-04T01:39:00.901485+0000","last_became_peered":"2023-11-04T01:39:00.901485+0000","last_unstale":"2023-11-04T01:39:21.655788+0000","last_undegraded":"2023-11-04T01:39:21.655788+0000","last_fullsized":"2023-11-04T01:39:21.655788+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:37.511499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.660122+0000","last_change":"2023-11-04T01:39:02.038972+0000","last_active":"2023-11-04T01:39:21.660122+0000","last_peered":"2023-11-04T01:39:21.660122+0000","last_clean":"2023-11-04T01:39:21.660122+0000","last_became_active":"2023-11-04T01:38:59.897966+0000","last_became_peered":"2023-11-04T01:38:59.897966+0000","last_unstale":"2023-11-04T01:39:21.660122+0000","last_undegraded":"2023-11-04T01:39:21.660122+0000","last_fullsized":"2023-11-04T01:39:21.660122+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:30.928374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041155899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.659272+0000","last_change":"2023-11-04T01:38:01.939857+0000","last_active":"2023-11-04T01:39:21.659272+0000","last_peered":"2023-11-04T01:39:21.659272+0000","last_clean":"2023-11-04T01:39:21.659272+0000","last_became_active":"2023-11-04T01:38:00.701371+0000","last_became_peered":"2023-11-04T01:38:00.701371+0000","last_unstale":"2023-11-04T01:39:21.659272+0000","last_undegraded":"2023-11-04T01:39:21.659272+0000","last_fullsized":"2023-11-04T01:39:21.659272+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078632099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.678282+0000","last_change":"2023-11-04T01:39:22.673038+0000","last_active":"2023-11-04T01:39:22.678282+0000","last_peered":"2023-11-04T01:39:22.678282+0000","last_clean":"2023-11-04T01:39:22.678282+0000","last_became_active":"2023-11-04T01:39:22.668969+0000","last_became_peered":"2023-11-04T01:39:22.668969+0000","last_unstale":"2023-11-04T01:39:22.678282+0000","last_undegraded":"2023-11-04T01:39:22.678282+0000","last_fullsized":"2023-11-04T01:39:22.678282+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:56.555393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.690377+0000","last_change":"2023-11-04T01:39:21.672574+0000","last_active":"2023-11-04T01:39:22.690377+0000","last_peered":"2023-11-04T01:39:22.690377+0000","last_clean":"2023-11-04T01:39:22.690377+0000","last_became_active":"2023-11-04T01:39:21.672291+0000","last_became_peered":"2023-11-04T01:39:21.672291+0000","last_unstale":"2023-11-04T01:39:22.690377+0000","last_undegraded":"2023-11-04T01:39:22.690377+0000","last_fullsized":"2023-11-04T01:39:22.690377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:15:30.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.657464+0000","last_change":"2023-11-04T01:39:00.901396+0000","last_active":"2023-11-04T01:39:21.657464+0000","last_peered":"2023-11-04T01:39:21.657464+0000","last_clean":"2023-11-04T01:39:21.657464+0000","last_became_active":"2023-11-04T01:39:00.901094+0000","last_became_peered":"2023-11-04T01:39:00.901094+0000","last_unstale":"2023-11-04T01:39:21.657464+0000","last_undegraded":"2023-11-04T01:39:21.657464+0000","last_fullsized":"2023-11-04T01:39:21.657464+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:48.475869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.656869+0000","last_change":"2023-11-04T01:39:02.370014+0000","last_active":"2023-11-04T01:39:21.656869+0000","last_peered":"2023-11-04T01:39:21.656869+0000","last_clean":"2023-11-04T01:39:21.656869+0000","last_became_active":"2023-11-04T01:38:59.893020+0000","last_became_peered":"2023-11-04T01:38:59.893020+0000","last_unstale":"2023-11-04T01:39:21.656869+0000","last_undegraded":"2023-11-04T01:39:21.656869+0000","last_fullsized":"2023-11-04T01:39:21.656869+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:32.037301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058077499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.660799+0000","last_change":"2023-11-04T01:38:01.939662+0000","last_active":"2023-11-04T01:39:21.660799+0000","last_peered":"2023-11-04T01:39:21.660799+0000","last_clean":"2023-11-04T01:39:21.660799+0000","last_became_active":"2023-11-04T01:38:00.705871+0000","last_became_peered":"2023-11-04T01:38:00.705871+0000","last_unstale":"2023-11-04T01:39:21.660799+0000","last_undegraded":"2023-11-04T01:39:21.660799+0000","last_fullsized":"2023-11-04T01:39:21.660799+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066873200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.674318+0000","last_change":"2023-11-04T01:39:22.671021+0000","last_active":"2023-11-04T01:39:22.674318+0000","last_peered":"2023-11-04T01:39:22.674318+0000","last_clean":"2023-11-04T01:39:22.674318+0000","last_became_active":"2023-11-04T01:39:22.670677+0000","last_became_peered":"2023-11-04T01:39:22.670677+0000","last_unstale":"2023-11-04T01:39:22.674318+0000","last_undegraded":"2023-11-04T01:39:22.674318+0000","last_fullsized":"2023-11-04T01:39:22.674318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:31:21.783076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.686157+0000","last_change":"2023-11-04T01:39:21.674136+0000","last_active":"2023-11-04T01:39:22.686157+0000","last_peered":"2023-11-04T01:39:22.686157+0000","last_clean":"2023-11-04T01:39:22.686157+0000","last_became_active":"2023-11-04T01:39:21.673850+0000","last_became_peered":"2023-11-04T01:39:21.673850+0000","last_unstale":"2023-11-04T01:39:22.686157+0000","last_undegraded":"2023-11-04T01:39:22.686157+0000","last_fullsized":"2023-11-04T01:39:22.686157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:29.284155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654253+0000","last_change":"2023-11-04T01:39:00.904488+0000","last_active":"2023-11-04T01:39:21.654253+0000","last_peered":"2023-11-04T01:39:21.654253+0000","last_clean":"2023-11-04T01:39:21.654253+0000","last_became_active":"2023-11-04T01:39:00.904234+0000","last_became_peered":"2023-11-04T01:39:00.904234+0000","last_unstale":"2023-11-04T01:39:21.654253+0000","last_undegraded":"2023-11-04T01:39:21.654253+0000","last_fullsized":"2023-11-04T01:39:21.654253+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:05:10.425461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664978+0000","last_change":"2023-11-04T01:39:01.896521+0000","last_active":"2023-11-04T01:39:21.664978+0000","last_peered":"2023-11-04T01:39:21.664978+0000","last_clean":"2023-11-04T01:39:21.664978+0000","last_became_active":"2023-11-04T01:38:59.890560+0000","last_became_peered":"2023-11-04T01:38:59.890560+0000","last_unstale":"2023-11-04T01:39:21.664978+0000","last_undegraded":"2023-11-04T01:39:21.664978+0000","last_fullsized":"2023-11-04T01:39:21.664978+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:14.608973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052638499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664511+0000","last_change":"2023-11-04T01:38:01.984672+0000","last_active":"2023-11-04T01:39:21.664511+0000","last_peered":"2023-11-04T01:39:21.664511+0000","last_clean":"2023-11-04T01:39:21.664511+0000","last_became_active":"2023-11-04T01:38:00.706804+0000","last_became_peered":"2023-11-04T01:38:00.706804+0000","last_unstale":"2023-11-04T01:39:21.664511+0000","last_undegraded":"2023-11-04T01:39:21.664511+0000","last_fullsized":"2023-11-04T01:39:21.664511+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:48.412413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038439000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":219,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662790+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:39:21.662790+0000","last_peered":"2023-11-04T01:39:21.662790+0000","last_clean":"2023-11-04T01:39:21.662790+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:39:21.662790+0000","last_undegraded":"2023-11-04T01:39:21.662790+0000","last_fullsized":"2023-11-04T01:39:21.662790+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1585152,"data_stored":1068081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.39200000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83299999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57399999999999995,"15min":0.56699999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.371,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.625,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.439,"5min":0.318,"15min":0.318},"max":{"1min":0.79200000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61399999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.40500000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.64900000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.40899999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.40799999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.44600000000000001,"15min":0.433},"min":{"1min":0.35099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65300000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.47199999999999998,"15min":0.45200000000000001},"min":{"1min":0.33100000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.33100000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51100000000000001,"15min":0.498},"min":{"1min":0.38700000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65300000000000002,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.747,"5min":0.877,"15min":0.877},"last":0.442}]},{"osd":6,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.503,"15min":0.48399999999999999},"min":{"1min":0.34399999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.374},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.53200000000000003},"min":{"1min":0.40799999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68200000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.40799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":486523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.51200000000000001,"15min":0.499},"min":{"1min":0.375,"5min":0.214,"15min":0.214},"max":{"1min":0.70699999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70099999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72299999999999998,"5min":1.05,"15min":1.05},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.39400000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.41599999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.70499999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.68400000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52200000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.67500000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.41499999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.502,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.75,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.498,"15min":0.497},"min":{"1min":0.34899999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63800000000000001,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57399999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32900000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68300000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.5},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40500000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.72699999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55400000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73499999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67900000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.374}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":991232,"data_stored":477713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57199999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72499999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42499999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.74299999999999999,"5min":0.746,"15min":0.746},"last":0.44600000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48599999999999999,"15min":0.48899999999999999},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63800000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.498},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.35599999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.58699999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.40999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.37,"15min":0.37},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.60199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":477713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79500000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57699999999999996,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77700000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.38100000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65700000000000003,"5min":0.875,"15min":0.875},"last":0.371},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70299999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75700000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.40200000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70399999999999996,"5min":0.879,"15min":0.879},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.57799999999999996,"15min":0.59699999999999998},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.624,"5min":1.089,"15min":1.089},"last":0.498}]},{"osd":5,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.874,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.52400000000000002},"min":{"1min":0.35399999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.89500000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.42699999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81799999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.52800000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.42099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70899999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85399999999999998,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":991232,"data_stored":477713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.32200000000000001,"15min":0.32400000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.438},{"interface":"front","average":{"1min":0.316,"5min":0.314,"15min":0.314},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.41999999999999998,"5min":0.441,"15min":0.441},"last":0.34399999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.41699999999999998,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.24199999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.40600000000000003,"5min":0.502,"15min":0.502},"last":0.56899999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.29599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.442,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.371,"15min":0.375},"min":{"1min":0.27900000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.47599999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.432,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77800000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.625},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.50900000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.74299999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.443,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76400000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.69599999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.41999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.71899999999999997,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.42599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.46800000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.58599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":485871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.32500000000000001,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.442,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.33600000000000002,"15min":0.34300000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.39300000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.309}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.48399999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.39100000000000001,"15min":0.40300000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.44,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.46700000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.40899999999999997,"15min":0.42099999999999999},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.51500000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.42099999999999999,"15min":0.433},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.46999999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.63900000000000001,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.82399999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.45200000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.48599999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.68300000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.877,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.52500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79700000000000004,"5min":1,"15min":1},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61199999999999999,"15min":0.62},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73099999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.5}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76200000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.61799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":991232,"data_stored":477713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39700000000000002,"15min":0.36199999999999999},"min":{"1min":0.23699999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.47699999999999998,"5min":5.415,"15min":5.415},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.41799999999999998,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52500000000000002,"5min":3.456,"15min":3.456},"last":0.35699999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.39400000000000002,"15min":0.39600000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.56399999999999995,"5min":2.355,"15min":2.355},"last":0.378},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.28299999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61499999999999999,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.308}]},{"osd":3,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.52200000000000002,"15min":0.46999999999999997},"min":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58099999999999996,"5min":8.891,"15min":8.891},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.46600000000000003,"15min":0.39600000000000002},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.54600000000000004,"5min":9.8889999999999993,"15min":9.8889999999999993},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63300000000000001,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76600000000000001,"5min":4.5720000000000001,"15min":4.5720000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59399999999999997,"15min":0.57599999999999996},"min":{"1min":0.45600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":0.68600000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.60099999999999998},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93100000000000005,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.872,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.68200000000000005,"15min":0.64600000000000002},"min":{"1min":0.48999999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82999999999999996,"5min":5.915,"15min":5.915},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1080000000000001,"5min":1.288,"15min":1.288},"last":0.60999999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.622,"15min":0.60599999999999998},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.84199999999999997,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66100000000000003,"15min":0.60599999999999998},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.93600000000000005,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.67300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1585152,"data_stored":1068081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.314,"15min":0.31},"min":{"1min":0.26500000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.374},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.221,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.49099999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.44}]},{"osd":2,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35999999999999999,"15min":0.36599999999999999},"min":{"1min":0.23899999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48599999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.23100000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.499,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.32300000000000001,"15min":0.317},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.376,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51800000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.42499999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81899999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68899999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.93000000000000005,"5min":0.996,"15min":0.996},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.72499999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.40500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90400000000000003,"5min":1.026,"15min":1.026},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.46000000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89000000000000001,"5min":1.177,"15min":1.177},"last":0.745}]},{"osd":7,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.443,"5min":0.374,"15min":0.374},"max":{"1min":0.85099999999999998,"5min":1.131,"15min":1.131},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:39:25.624 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:39:25.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.754+0000 7f344b7c5640 1 Processor -- start 2023-11-04T01:39:25.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.754+0000 7f344b7c5640 1 -- start start 2023-11-04T01:39:25.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.755+0000 7f344b7c5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34440cda60 0x7f34440ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.755+0000 7f344b7c5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3444070d40 0x7f344406c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.755+0000 7f344b7c5640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34440cc990 con 0x7f34440b0cd0 2023-11-04T01:39:25.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.755+0000 7f344b7c5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34440ccc70 con 0x7f34440cda60 2023-11-04T01:39:25.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.755+0000 7f344b7c5640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34440c9ce0 con 0x7f3444070d40 2023-11-04T01:39:25.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.755+0000 7f3449561640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34440cda60 0x7f34440ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.755+0000 7f3449561640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34440cda60 0x7f34440ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33250/0 (socket says 172.21.15.114:33250) 2023-11-04T01:39:25.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.755+0000 7f3449561640 1 -- 172.21.15.114:0/549623393 learned_addr learned my addr 172.21.15.114:0/549623393 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:25.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.755+0000 7f3449d62640 1 --2- 172.21.15.114:0/549623393 >> v2:172.21.15.141:3300/0 conn(0x7f3444070d40 0x7f344406c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.755+0000 7f3449561640 1 -- 172.21.15.114:0/549623393 >> v2:172.21.15.141:3300/0 conn(0x7f3444070d40 msgr2=0x7f344406c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:25.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.755+0000 7f3449561640 1 --2- 172.21.15.114:0/549623393 >> v2:172.21.15.141:3300/0 conn(0x7f3444070d40 0x7f344406c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.755+0000 7f3449561640 1 -- 172.21.15.114:0/549623393 >> v1:172.21.15.141:6789/0 conn(0x7f34440b0cd0 legacy=0x7f3444070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:25.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.755+0000 7f3449561640 1 -- 172.21.15.114:0/549623393 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34440c9fc0 con 0x7f34440cda60 2023-11-04T01:39:25.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.756+0000 7f3449561640 1 --2- 172.21.15.114:0/549623393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34440cda60 0x7f34440ca7a0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f34440c93d0 tx=0x7f343c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de40597b2c6784aa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:25.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.756+0000 7f343bfff640 1 -- 172.21.15.114:0/549623393 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c02ca80 con 0x7f34440cda60 2023-11-04T01:39:25.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.756+0000 7f343bfff640 1 -- 172.21.15.114:0/549623393 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343c02cbe0 con 0x7f34440cda60 2023-11-04T01:39:25.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.756+0000 7f343bfff640 1 -- 172.21.15.114:0/549623393 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c0343f0 con 0x7f34440cda60 2023-11-04T01:39:25.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.757+0000 7f344b7c5640 1 -- 172.21.15.114:0/549623393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34440cda60 msgr2=0x7f34440ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.757+0000 7f344b7c5640 1 --2- 172.21.15.114:0/549623393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34440cda60 0x7f34440ca7a0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f34440c93d0 tx=0x7f343c02bee0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.757+0000 7f344b7c5640 1 -- 172.21.15.114:0/549623393 shutdown_connections 2023-11-04T01:39:25.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.757+0000 7f344b7c5640 1 --2- 172.21.15.114:0/549623393 >> v2:172.21.15.141:3300/0 conn(0x7f3444070d40 0x7f344406c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.757+0000 7f344b7c5640 1 --2- 172.21.15.114:0/549623393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34440cda60 0x7f34440ca7a0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.757+0000 7f344b7c5640 1 -- 172.21.15.114:0/549623393 >> 172.21.15.114:0/549623393 conn(0x7f34440ce950 msgr2=0x7f34440ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:25.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.757+0000 7f344b7c5640 1 -- 172.21.15.114:0/549623393 shutdown_connections 2023-11-04T01:39:25.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.757+0000 7f344b7c5640 1 -- 172.21.15.114:0/549623393 wait complete. 2023-11-04T01:39:25.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.758+0000 7f344b7c5640 1 Processor -- start 2023-11-04T01:39:25.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.758+0000 7f344b7c5640 1 -- start start 2023-11-04T01:39:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f344b7c5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3444070d40 0x7f3444156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f344b7c5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34440b0cd0 0x7f34440c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f344b7c5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34440cda60 0x7f34440c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f344b7c5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3444159ba0 con 0x7f3444070d40 2023-11-04T01:39:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f344b7c5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34440c1f80 con 0x7f34440b0cd0 2023-11-04T01:39:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f344b7c5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34440ad120 con 0x7f34440cda60 2023-11-04T01:39:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f3449561640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3444070d40 0x7f3444156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f3449561640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3444070d40 0x7f3444156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33252/0 (socket says 172.21.15.114:33252) 2023-11-04T01:39:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f3449561640 1 -- 172.21.15.114:0/280940653 learned_addr learned my addr 172.21.15.114:0/280940653 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f3448d60640 1 --2- 172.21.15.114:0/280940653 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34440b0cd0 0x7f34440c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f3449d62640 1 --2- 172.21.15.114:0/280940653 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34440cda60 0x7f34440c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f3449561640 1 -- 172.21.15.114:0/280940653 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34440cda60 msgr2=0x7f34440c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f3449561640 1 --2- 172.21.15.114:0/280940653 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34440cda60 0x7f34440c6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f3449561640 1 -- 172.21.15.114:0/280940653 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34440b0cd0 msgr2=0x7f34440c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f3449561640 1 --2- 172.21.15.114:0/280940653 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34440b0cd0 0x7f34440c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f3449561640 1 -- 172.21.15.114:0/280940653 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c009b30 con 0x7f3444070d40 2023-11-04T01:39:25.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f3449d62640 1 --2- 172.21.15.114:0/280940653 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34440cda60 0x7f34440c6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:25.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f3449561640 1 --2- 172.21.15.114:0/280940653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3444070d40 0x7f3444156110 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f343c000f80 tx=0x7f343c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:25.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f3439ffb640 1 -- 172.21.15.114:0/280940653 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c009510 con 0x7f3444070d40 2023-11-04T01:39:25.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.759+0000 7f3439ffb640 1 -- 172.21.15.114:0/280940653 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343c03e450 con 0x7f3444070d40 2023-11-04T01:39:25.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.760+0000 7f344b7c5640 1 -- 172.21.15.114:0/280940653 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3444159df0 con 0x7f3444070d40 2023-11-04T01:39:25.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.760+0000 7f3439ffb640 1 -- 172.21.15.114:0/280940653 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c03e800 con 0x7f3444070d40 2023-11-04T01:39:25.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.760+0000 7f344b7c5640 1 -- 172.21.15.114:0/280940653 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f344415a3b0 con 0x7f3444070d40 2023-11-04T01:39:25.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.761+0000 7f344b7c5640 1 -- 172.21.15.114:0/280940653 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3444074290 con 0x7f3444070d40 2023-11-04T01:39:25.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.761+0000 7f3439ffb640 1 -- 172.21.15.114:0/280940653 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f343c02cd50 con 0x7f3444070d40 2023-11-04T01:39:25.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.761+0000 7f3439ffb640 1 --2- 172.21.15.114:0/280940653 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f342806aea0 0x7f342806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:25.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.761+0000 7f3439ffb640 1 -- 172.21.15.114:0/280940653 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f343c0ac440 con 0x7f3444070d40 2023-11-04T01:39:25.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.761+0000 7f3448d60640 1 --2- 172.21.15.114:0/280940653 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f342806aea0 0x7f342806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:25.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.762+0000 7f3448d60640 1 --2- 172.21.15.114:0/280940653 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f342806aea0 0x7f342806d360 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3444159b30 tx=0x7f3434009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:25.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.766+0000 7f3439ffb640 1 -- 172.21.15.114:0/280940653 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f343c0770a0 con 0x7f3444070d40 2023-11-04T01:39:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.929+0000 7f344b7c5640 1 -- 172.21.15.114:0/280940653 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34440ca2a0 con 0x7f342806aea0 2023-11-04T01:39:25.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.941+0000 7f3439ffb640 1 -- 172.21.15.114:0/280940653 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+531988 (secure 0 0 0) 0x7f34340053f0 con 0x7f342806aea0 2023-11-04T01:39:25.948 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:25.951 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:39:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.945+0000 7f344b7c5640 1 -- 172.21.15.114:0/280940653 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f342806aea0 msgr2=0x7f342806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.945+0000 7f344b7c5640 1 --2- 172.21.15.114:0/280940653 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f342806aea0 0x7f342806d360 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3444159b30 tx=0x7f3434009040 comp rx=0 tx=0).stop 2023-11-04T01:39:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.945+0000 7f344b7c5640 1 -- 172.21.15.114:0/280940653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3444070d40 msgr2=0x7f3444156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.945+0000 7f344b7c5640 1 --2- 172.21.15.114:0/280940653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3444070d40 0x7f3444156110 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f343c000f80 tx=0x7f343c004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.946+0000 7f344b7c5640 1 -- 172.21.15.114:0/280940653 shutdown_connections 2023-11-04T01:39:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.946+0000 7f344b7c5640 1 --2- 172.21.15.114:0/280940653 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f34440cda60 0x7f34440c6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.946+0000 7f344b7c5640 1 --2- 172.21.15.114:0/280940653 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f342806aea0 0x7f342806d360 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.946+0000 7f344b7c5640 1 --2- 172.21.15.114:0/280940653 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f34440b0cd0 0x7f34440c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.946+0000 7f344b7c5640 1 --2- 172.21.15.114:0/280940653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3444070d40 0x7f3444156110 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.946+0000 7f344b7c5640 1 -- 172.21.15.114:0/280940653 >> 172.21.15.114:0/280940653 conn(0x7f34440ce950 msgr2=0x7f34440ad830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.946+0000 7f344b7c5640 1 -- 172.21.15.114:0/280940653 shutdown_connections 2023-11-04T01:39:25.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:25.946+0000 7f344b7c5640 1 -- 172.21.15.114:0/280940653 wait complete. 2023-11-04T01:39:25.958 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2023-11-04T01:39:25.894208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":234,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233428,"kb_used_data":8936,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754741292,"statfs":{"total":773094113280,"available":772855083008,"internally_reserved":0,"allocated":9150464,"data_stored":5019408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.244469"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.685349+0000","last_change":"2023-11-04T01:39:22.684034+0000","last_active":"2023-11-04T01:39:22.685349+0000","last_peered":"2023-11-04T01:39:22.685349+0000","last_clean":"2023-11-04T01:39:22.685349+0000","last_became_active":"2023-11-04T01:39:22.683747+0000","last_became_peered":"2023-11-04T01:39:22.683747+0000","last_unstale":"2023-11-04T01:39:22.685349+0000","last_undegraded":"2023-11-04T01:39:22.685349+0000","last_fullsized":"2023-11-04T01:39:22.685349+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:17.956473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.690451+0000","last_change":"2023-11-04T01:39:22.683035+0000","last_active":"2023-11-04T01:39:22.690451+0000","last_peered":"2023-11-04T01:39:22.690451+0000","last_clean":"2023-11-04T01:39:22.690451+0000","last_became_active":"2023-11-04T01:39:22.682757+0000","last_became_peered":"2023-11-04T01:39:22.682757+0000","last_unstale":"2023-11-04T01:39:22.690451+0000","last_undegraded":"2023-11-04T01:39:22.690451+0000","last_fullsized":"2023-11-04T01:39:22.690451+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:29.339900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.684056+0000","last_change":"2023-11-04T01:39:22.677046+0000","last_active":"2023-11-04T01:39:22.684056+0000","last_peered":"2023-11-04T01:39:22.684056+0000","last_clean":"2023-11-04T01:39:22.684056+0000","last_became_active":"2023-11-04T01:39:22.676352+0000","last_became_peered":"2023-11-04T01:39:22.676352+0000","last_unstale":"2023-11-04T01:39:22.684056+0000","last_undegraded":"2023-11-04T01:39:22.684056+0000","last_fullsized":"2023-11-04T01:39:22.684056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:10.840865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.674381+0000","last_change":"2023-11-04T01:39:22.670029+0000","last_active":"2023-11-04T01:39:22.674381+0000","last_peered":"2023-11-04T01:39:22.674381+0000","last_clean":"2023-11-04T01:39:22.674381+0000","last_became_active":"2023-11-04T01:39:22.669596+0000","last_became_peered":"2023-11-04T01:39:22.669596+0000","last_unstale":"2023-11-04T01:39:22.674381+0000","last_undegraded":"2023-11-04T01:39:22.674381+0000","last_fullsized":"2023-11-04T01:39:22.674381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:03.305373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683663+0000","last_change":"2023-11-04T01:39:22.672101+0000","last_active":"2023-11-04T01:39:22.683663+0000","last_peered":"2023-11-04T01:39:22.683663+0000","last_clean":"2023-11-04T01:39:22.683663+0000","last_became_active":"2023-11-04T01:39:22.671676+0000","last_became_peered":"2023-11-04T01:39:22.671676+0000","last_unstale":"2023-11-04T01:39:22.683663+0000","last_undegraded":"2023-11-04T01:39:22.683663+0000","last_fullsized":"2023-11-04T01:39:22.683663+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:25.733293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.682375+0000","last_change":"2023-11-04T01:39:22.677660+0000","last_active":"2023-11-04T01:39:22.682375+0000","last_peered":"2023-11-04T01:39:22.682375+0000","last_clean":"2023-11-04T01:39:22.682375+0000","last_became_active":"2023-11-04T01:39:22.676965+0000","last_became_peered":"2023-11-04T01:39:22.676965+0000","last_unstale":"2023-11-04T01:39:22.682375+0000","last_undegraded":"2023-11-04T01:39:22.682375+0000","last_fullsized":"2023-11-04T01:39:22.682375+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:27.452701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.682038+0000","last_change":"2023-11-04T01:39:22.677327+0000","last_active":"2023-11-04T01:39:22.682038+0000","last_peered":"2023-11-04T01:39:22.682038+0000","last_clean":"2023-11-04T01:39:22.682038+0000","last_became_active":"2023-11-04T01:39:22.677031+0000","last_became_peered":"2023-11-04T01:39:22.677031+0000","last_unstale":"2023-11-04T01:39:22.682038+0000","last_undegraded":"2023-11-04T01:39:22.682038+0000","last_fullsized":"2023-11-04T01:39:22.682038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:41:52.002166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.679327+0000","last_change":"2023-11-04T01:39:22.673737+0000","last_active":"2023-11-04T01:39:22.679327+0000","last_peered":"2023-11-04T01:39:22.679327+0000","last_clean":"2023-11-04T01:39:22.679327+0000","last_became_active":"2023-11-04T01:39:22.673289+0000","last_became_peered":"2023-11-04T01:39:22.673289+0000","last_unstale":"2023-11-04T01:39:22.679327+0000","last_undegraded":"2023-11-04T01:39:22.679327+0000","last_fullsized":"2023-11-04T01:39:22.679327+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:22:20.902485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.680855+0000","last_change":"2023-11-04T01:39:22.675670+0000","last_active":"2023-11-04T01:39:22.680855+0000","last_peered":"2023-11-04T01:39:22.680855+0000","last_clean":"2023-11-04T01:39:22.680855+0000","last_became_active":"2023-11-04T01:39:22.675389+0000","last_became_peered":"2023-11-04T01:39:22.675389+0000","last_unstale":"2023-11-04T01:39:22.680855+0000","last_undegraded":"2023-11-04T01:39:22.680855+0000","last_fullsized":"2023-11-04T01:39:22.680855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:47.238603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683791+0000","last_change":"2023-11-04T01:39:22.675022+0000","last_active":"2023-11-04T01:39:22.683791+0000","last_peered":"2023-11-04T01:39:22.683791+0000","last_clean":"2023-11-04T01:39:22.683791+0000","last_became_active":"2023-11-04T01:39:22.674699+0000","last_became_peered":"2023-11-04T01:39:22.674699+0000","last_unstale":"2023-11-04T01:39:22.683791+0000","last_undegraded":"2023-11-04T01:39:22.683791+0000","last_fullsized":"2023-11-04T01:39:22.683791+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:37.397655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.685334+0000","last_change":"2023-11-04T01:39:22.679435+0000","last_active":"2023-11-04T01:39:22.685334+0000","last_peered":"2023-11-04T01:39:22.685334+0000","last_clean":"2023-11-04T01:39:22.685334+0000","last_became_active":"2023-11-04T01:39:22.679178+0000","last_became_peered":"2023-11-04T01:39:22.679178+0000","last_unstale":"2023-11-04T01:39:22.685334+0000","last_undegraded":"2023-11-04T01:39:22.685334+0000","last_fullsized":"2023-11-04T01:39:22.685334+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:42:48.311220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.682989+0000","last_change":"2023-11-04T01:39:22.678853+0000","last_active":"2023-11-04T01:39:22.682989+0000","last_peered":"2023-11-04T01:39:22.682989+0000","last_clean":"2023-11-04T01:39:22.682989+0000","last_became_active":"2023-11-04T01:39:22.678600+0000","last_became_peered":"2023-11-04T01:39:22.678600+0000","last_unstale":"2023-11-04T01:39:22.682989+0000","last_undegraded":"2023-11-04T01:39:22.682989+0000","last_fullsized":"2023-11-04T01:39:22.682989+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:05.241162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.685249+0000","last_change":"2023-11-04T01:39:22.679154+0000","last_active":"2023-11-04T01:39:22.685249+0000","last_peered":"2023-11-04T01:39:22.685249+0000","last_clean":"2023-11-04T01:39:22.685249+0000","last_became_active":"2023-11-04T01:39:22.678840+0000","last_became_peered":"2023-11-04T01:39:22.678840+0000","last_unstale":"2023-11-04T01:39:22.685249+0000","last_undegraded":"2023-11-04T01:39:22.685249+0000","last_fullsized":"2023-11-04T01:39:22.685249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:29.339900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.668395+0000","last_change":"2023-11-04T01:39:22.667660+0000","last_active":"2023-11-04T01:39:22.668395+0000","last_peered":"2023-11-04T01:39:22.668395+0000","last_clean":"2023-11-04T01:39:22.668395+0000","last_became_active":"2023-11-04T01:39:22.667393+0000","last_became_peered":"2023-11-04T01:39:22.667393+0000","last_unstale":"2023-11-04T01:39:22.668395+0000","last_undegraded":"2023-11-04T01:39:22.668395+0000","last_fullsized":"2023-11-04T01:39:22.668395+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:38.180726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.679144+0000","last_change":"2023-11-04T01:39:22.676752+0000","last_active":"2023-11-04T01:39:22.679144+0000","last_peered":"2023-11-04T01:39:22.679144+0000","last_clean":"2023-11-04T01:39:22.679144+0000","last_became_active":"2023-11-04T01:39:22.676495+0000","last_became_peered":"2023-11-04T01:39:22.676495+0000","last_unstale":"2023-11-04T01:39:22.679144+0000","last_undegraded":"2023-11-04T01:39:22.679144+0000","last_fullsized":"2023-11-04T01:39:22.679144+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:54.931063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.677929+0000","last_change":"2023-11-04T01:39:22.672317+0000","last_active":"2023-11-04T01:39:22.677929+0000","last_peered":"2023-11-04T01:39:22.677929+0000","last_clean":"2023-11-04T01:39:22.677929+0000","last_became_active":"2023-11-04T01:39:22.671996+0000","last_became_peered":"2023-11-04T01:39:22.671996+0000","last_unstale":"2023-11-04T01:39:22.677929+0000","last_undegraded":"2023-11-04T01:39:22.677929+0000","last_fullsized":"2023-11-04T01:39:22.677929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:03.305373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.687593+0000","last_change":"2023-11-04T01:39:22.680344+0000","last_active":"2023-11-04T01:39:22.687593+0000","last_peered":"2023-11-04T01:39:22.687593+0000","last_clean":"2023-11-04T01:39:22.687593+0000","last_became_active":"2023-11-04T01:39:22.680071+0000","last_became_peered":"2023-11-04T01:39:22.680071+0000","last_unstale":"2023-11-04T01:39:22.687593+0000","last_undegraded":"2023-11-04T01:39:22.687593+0000","last_fullsized":"2023-11-04T01:39:22.687593+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:33:53.430199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.679001+0000","last_change":"2023-11-04T01:39:22.675927+0000","last_active":"2023-11-04T01:39:22.679001+0000","last_peered":"2023-11-04T01:39:22.679001+0000","last_clean":"2023-11-04T01:39:22.679001+0000","last_became_active":"2023-11-04T01:39:22.675675+0000","last_became_peered":"2023-11-04T01:39:22.675675+0000","last_unstale":"2023-11-04T01:39:22.679001+0000","last_undegraded":"2023-11-04T01:39:22.679001+0000","last_fullsized":"2023-11-04T01:39:22.679001+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:14.309939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.678823+0000","last_change":"2023-11-04T01:39:22.675564+0000","last_active":"2023-11-04T01:39:22.678823+0000","last_peered":"2023-11-04T01:39:22.678823+0000","last_clean":"2023-11-04T01:39:22.678823+0000","last_became_active":"2023-11-04T01:39:22.675258+0000","last_became_peered":"2023-11-04T01:39:22.675258+0000","last_unstale":"2023-11-04T01:39:22.678823+0000","last_undegraded":"2023-11-04T01:39:22.678823+0000","last_fullsized":"2023-11-04T01:39:22.678823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:01:40.332558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683007+0000","last_change":"2023-11-04T01:39:22.679066+0000","last_active":"2023-11-04T01:39:22.683007+0000","last_peered":"2023-11-04T01:39:22.683007+0000","last_clean":"2023-11-04T01:39:22.683007+0000","last_became_active":"2023-11-04T01:39:22.676289+0000","last_became_peered":"2023-11-04T01:39:22.676289+0000","last_unstale":"2023-11-04T01:39:22.683007+0000","last_undegraded":"2023-11-04T01:39:22.683007+0000","last_fullsized":"2023-11-04T01:39:22.683007+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:10.748491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.685152+0000","last_change":"2023-11-04T01:39:22.683030+0000","last_active":"2023-11-04T01:39:22.685152+0000","last_peered":"2023-11-04T01:39:22.685152+0000","last_clean":"2023-11-04T01:39:22.685152+0000","last_became_active":"2023-11-04T01:39:22.682732+0000","last_became_peered":"2023-11-04T01:39:22.682732+0000","last_unstale":"2023-11-04T01:39:22.685152+0000","last_undegraded":"2023-11-04T01:39:22.685152+0000","last_fullsized":"2023-11-04T01:39:22.685152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:18.875968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.679427+0000","last_change":"2023-11-04T01:39:22.677110+0000","last_active":"2023-11-04T01:39:22.679427+0000","last_peered":"2023-11-04T01:39:22.679427+0000","last_clean":"2023-11-04T01:39:22.679427+0000","last_became_active":"2023-11-04T01:39:22.676872+0000","last_became_peered":"2023-11-04T01:39:22.676872+0000","last_unstale":"2023-11-04T01:39:22.679427+0000","last_undegraded":"2023-11-04T01:39:22.679427+0000","last_fullsized":"2023-11-04T01:39:22.679427+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:03.305373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.687523+0000","last_change":"2023-11-04T01:39:22.679527+0000","last_active":"2023-11-04T01:39:22.687523+0000","last_peered":"2023-11-04T01:39:22.687523+0000","last_clean":"2023-11-04T01:39:22.687523+0000","last_became_active":"2023-11-04T01:39:22.679253+0000","last_became_peered":"2023-11-04T01:39:22.679253+0000","last_unstale":"2023-11-04T01:39:22.687523+0000","last_undegraded":"2023-11-04T01:39:22.687523+0000","last_fullsized":"2023-11-04T01:39:22.687523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:14.309939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.669843+0000","last_change":"2023-11-04T01:39:22.664598+0000","last_active":"2023-11-04T01:39:22.669843+0000","last_peered":"2023-11-04T01:39:22.669843+0000","last_clean":"2023-11-04T01:39:22.669843+0000","last_became_active":"2023-11-04T01:39:22.664179+0000","last_became_peered":"2023-11-04T01:39:22.664179+0000","last_unstale":"2023-11-04T01:39:22.669843+0000","last_undegraded":"2023-11-04T01:39:22.669843+0000","last_fullsized":"2023-11-04T01:39:22.669843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:19:36.662698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683616+0000","last_change":"2023-11-04T01:39:22.670990+0000","last_active":"2023-11-04T01:39:22.683616+0000","last_peered":"2023-11-04T01:39:22.683616+0000","last_clean":"2023-11-04T01:39:22.683616+0000","last_became_active":"2023-11-04T01:39:22.670721+0000","last_became_peered":"2023-11-04T01:39:22.670721+0000","last_unstale":"2023-11-04T01:39:22.683616+0000","last_undegraded":"2023-11-04T01:39:22.683616+0000","last_fullsized":"2023-11-04T01:39:22.683616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:04:35.487784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.679231+0000","last_change":"2023-11-04T01:39:22.673092+0000","last_active":"2023-11-04T01:39:22.679231+0000","last_peered":"2023-11-04T01:39:22.679231+0000","last_clean":"2023-11-04T01:39:22.679231+0000","last_became_active":"2023-11-04T01:39:22.672823+0000","last_became_peered":"2023-11-04T01:39:22.672823+0000","last_unstale":"2023-11-04T01:39:22.679231+0000","last_undegraded":"2023-11-04T01:39:22.679231+0000","last_fullsized":"2023-11-04T01:39:22.679231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:06.778103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.673469+0000","last_change":"2023-11-04T01:39:22.669580+0000","last_active":"2023-11-04T01:39:22.673469+0000","last_peered":"2023-11-04T01:39:22.673469+0000","last_clean":"2023-11-04T01:39:22.673469+0000","last_became_active":"2023-11-04T01:39:22.669276+0000","last_became_peered":"2023-11-04T01:39:22.669276+0000","last_unstale":"2023-11-04T01:39:22.673469+0000","last_undegraded":"2023-11-04T01:39:22.673469+0000","last_fullsized":"2023-11-04T01:39:22.673469+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:22:20.902485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683845+0000","last_change":"2023-11-04T01:39:22.669109+0000","last_active":"2023-11-04T01:39:22.683845+0000","last_peered":"2023-11-04T01:39:22.683845+0000","last_clean":"2023-11-04T01:39:22.683845+0000","last_became_active":"2023-11-04T01:39:22.668845+0000","last_became_peered":"2023-11-04T01:39:22.668845+0000","last_unstale":"2023-11-04T01:39:22.683845+0000","last_undegraded":"2023-11-04T01:39:22.683845+0000","last_fullsized":"2023-11-04T01:39:22.683845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:54:30.601086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.679282+0000","last_change":"2023-11-04T01:39:22.673679+0000","last_active":"2023-11-04T01:39:22.679282+0000","last_peered":"2023-11-04T01:39:22.679282+0000","last_clean":"2023-11-04T01:39:22.679282+0000","last_became_active":"2023-11-04T01:39:22.673386+0000","last_became_peered":"2023-11-04T01:39:22.673386+0000","last_unstale":"2023-11-04T01:39:22.679282+0000","last_undegraded":"2023-11-04T01:39:22.679282+0000","last_fullsized":"2023-11-04T01:39:22.679282+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:07.297352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.684486+0000","last_change":"2023-11-04T01:39:22.677686+0000","last_active":"2023-11-04T01:39:22.684486+0000","last_peered":"2023-11-04T01:39:22.684486+0000","last_clean":"2023-11-04T01:39:22.684486+0000","last_became_active":"2023-11-04T01:39:22.677223+0000","last_became_peered":"2023-11-04T01:39:22.677223+0000","last_unstale":"2023-11-04T01:39:22.684486+0000","last_undegraded":"2023-11-04T01:39:22.684486+0000","last_fullsized":"2023-11-04T01:39:22.684486+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:58:22.585991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.687736+0000","last_change":"2023-11-04T01:39:22.684856+0000","last_active":"2023-11-04T01:39:22.687736+0000","last_peered":"2023-11-04T01:39:22.687736+0000","last_clean":"2023-11-04T01:39:22.687736+0000","last_became_active":"2023-11-04T01:39:22.684616+0000","last_became_peered":"2023-11-04T01:39:22.684616+0000","last_unstale":"2023-11-04T01:39:22.687736+0000","last_undegraded":"2023-11-04T01:39:22.687736+0000","last_fullsized":"2023-11-04T01:39:22.687736+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:22:20.902485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.675138+0000","last_change":"2023-11-04T01:39:22.671864+0000","last_active":"2023-11-04T01:39:22.675138+0000","last_peered":"2023-11-04T01:39:22.675138+0000","last_clean":"2023-11-04T01:39:22.675138+0000","last_became_active":"2023-11-04T01:39:22.671601+0000","last_became_peered":"2023-11-04T01:39:22.671601+0000","last_unstale":"2023-11-04T01:39:22.675138+0000","last_undegraded":"2023-11-04T01:39:22.675138+0000","last_fullsized":"2023-11-04T01:39:22.675138+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:30.057300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.676657+0000","last_change":"2023-11-04T01:39:22.671514+0000","last_active":"2023-11-04T01:39:22.676657+0000","last_peered":"2023-11-04T01:39:22.676657+0000","last_clean":"2023-11-04T01:39:22.676657+0000","last_became_active":"2023-11-04T01:39:22.671210+0000","last_became_peered":"2023-11-04T01:39:22.671210+0000","last_unstale":"2023-11-04T01:39:22.676657+0000","last_undegraded":"2023-11-04T01:39:22.676657+0000","last_fullsized":"2023-11-04T01:39:22.676657+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:16.646126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"82'6","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.696197+0000","last_change":"2023-11-04T01:39:21.668796+0000","last_active":"2023-11-04T01:39:22.696197+0000","last_peered":"2023-11-04T01:39:22.696197+0000","last_clean":"2023-11-04T01:39:22.696197+0000","last_became_active":"2023-11-04T01:39:21.668524+0000","last_became_peered":"2023-11-04T01:39:21.668524+0000","last_unstale":"2023-11-04T01:39:22.696197+0000","last_undegraded":"2023-11-04T01:39:22.696197+0000","last_fullsized":"2023-11-04T01:39:22.696197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:43.976692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.657319+0000","last_change":"2023-11-04T01:39:00.904362+0000","last_active":"2023-11-04T01:39:21.657319+0000","last_peered":"2023-11-04T01:39:21.657319+0000","last_clean":"2023-11-04T01:39:21.657319+0000","last_became_active":"2023-11-04T01:39:00.903861+0000","last_became_peered":"2023-11-04T01:39:00.903861+0000","last_unstale":"2023-11-04T01:39:21.657319+0000","last_undegraded":"2023-11-04T01:39:21.657319+0000","last_fullsized":"2023-11-04T01:39:21.657319+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:08:13.731370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.663266+0000","last_change":"2023-11-04T01:39:01.899189+0000","last_active":"2023-11-04T01:39:21.663266+0000","last_peered":"2023-11-04T01:39:21.663266+0000","last_clean":"2023-11-04T01:39:21.663266+0000","last_became_active":"2023-11-04T01:38:59.885803+0000","last_became_peered":"2023-11-04T01:38:59.885803+0000","last_unstale":"2023-11-04T01:39:21.663266+0000","last_undegraded":"2023-11-04T01:39:21.663266+0000","last_fullsized":"2023-11-04T01:39:21.663266+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:13.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061642800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654875+0000","last_change":"2023-11-04T01:38:02.156342+0000","last_active":"2023-11-04T01:39:21.654875+0000","last_peered":"2023-11-04T01:39:21.654875+0000","last_clean":"2023-11-04T01:39:21.654875+0000","last_became_active":"2023-11-04T01:38:00.708159+0000","last_became_peered":"2023-11-04T01:38:00.708159+0000","last_unstale":"2023-11-04T01:39:21.654875+0000","last_undegraded":"2023-11-04T01:39:21.654875+0000","last_fullsized":"2023-11-04T01:39:21.654875+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000435213,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683885+0000","last_change":"2023-11-04T01:39:22.672334+0000","last_active":"2023-11-04T01:39:22.683885+0000","last_peered":"2023-11-04T01:39:22.683885+0000","last_clean":"2023-11-04T01:39:22.683885+0000","last_became_active":"2023-11-04T01:39:22.672056+0000","last_became_peered":"2023-11-04T01:39:22.672056+0000","last_unstale":"2023-11-04T01:39:22.683885+0000","last_undegraded":"2023-11-04T01:39:22.683885+0000","last_fullsized":"2023-11-04T01:39:22.683885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:02.584204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"82'3","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.688465+0000","last_change":"2023-11-04T01:39:21.677191+0000","last_active":"2023-11-04T01:39:22.688465+0000","last_peered":"2023-11-04T01:39:22.688465+0000","last_clean":"2023-11-04T01:39:22.688465+0000","last_became_active":"2023-11-04T01:39:21.676933+0000","last_became_peered":"2023-11-04T01:39:21.676933+0000","last_unstale":"2023-11-04T01:39:22.688465+0000","last_undegraded":"2023-11-04T01:39:22.688465+0000","last_fullsized":"2023-11-04T01:39:22.688465+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:33:52.421326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.660157+0000","last_change":"2023-11-04T01:39:00.902826+0000","last_active":"2023-11-04T01:39:21.660157+0000","last_peered":"2023-11-04T01:39:21.660157+0000","last_clean":"2023-11-04T01:39:21.660157+0000","last_became_active":"2023-11-04T01:39:00.902547+0000","last_became_peered":"2023-11-04T01:39:00.902547+0000","last_unstale":"2023-11-04T01:39:21.660157+0000","last_undegraded":"2023-11-04T01:39:21.660157+0000","last_fullsized":"2023-11-04T01:39:21.660157+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:54:08.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664351+0000","last_change":"2023-11-04T01:39:01.899633+0000","last_active":"2023-11-04T01:39:21.664351+0000","last_peered":"2023-11-04T01:39:21.664351+0000","last_clean":"2023-11-04T01:39:21.664351+0000","last_became_active":"2023-11-04T01:38:59.897690+0000","last_became_peered":"2023-11-04T01:38:59.897690+0000","last_unstale":"2023-11-04T01:39:21.664351+0000","last_undegraded":"2023-11-04T01:39:21.664351+0000","last_fullsized":"2023-11-04T01:39:21.664351+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:48.990734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069036800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.657522+0000","last_change":"2023-11-04T01:38:02.362289+0000","last_active":"2023-11-04T01:39:21.657522+0000","last_peered":"2023-11-04T01:39:21.657522+0000","last_clean":"2023-11-04T01:39:21.657522+0000","last_became_active":"2023-11-04T01:38:00.710033+0000","last_became_peered":"2023-11-04T01:38:00.710033+0000","last_unstale":"2023-11-04T01:39:21.657522+0000","last_undegraded":"2023-11-04T01:39:21.657522+0000","last_fullsized":"2023-11-04T01:39:21.657522+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046467500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.688416+0000","last_change":"2023-11-04T01:39:22.685728+0000","last_active":"2023-11-04T01:39:22.688416+0000","last_peered":"2023-11-04T01:39:22.688416+0000","last_clean":"2023-11-04T01:39:22.688416+0000","last_became_active":"2023-11-04T01:39:22.685465+0000","last_became_peered":"2023-11-04T01:39:22.685465+0000","last_unstale":"2023-11-04T01:39:22.688416+0000","last_undegraded":"2023-11-04T01:39:22.688416+0000","last_fullsized":"2023-11-04T01:39:22.688416+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:08:35.514572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.658918+0000","last_change":"2023-11-04T01:39:21.671162+0000","last_active":"2023-11-04T01:39:22.658918+0000","last_peered":"2023-11-04T01:39:22.658918+0000","last_clean":"2023-11-04T01:39:22.658918+0000","last_became_active":"2023-11-04T01:39:21.670906+0000","last_became_peered":"2023-11-04T01:39:21.670906+0000","last_unstale":"2023-11-04T01:39:22.658918+0000","last_undegraded":"2023-11-04T01:39:22.658918+0000","last_fullsized":"2023-11-04T01:39:22.658918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:05.769230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662026+0000","last_change":"2023-11-04T01:39:00.905727+0000","last_active":"2023-11-04T01:39:21.662026+0000","last_peered":"2023-11-04T01:39:21.662026+0000","last_clean":"2023-11-04T01:39:21.662026+0000","last_became_active":"2023-11-04T01:39:00.905379+0000","last_became_peered":"2023-11-04T01:39:00.905379+0000","last_unstale":"2023-11-04T01:39:21.662026+0000","last_undegraded":"2023-11-04T01:39:21.662026+0000","last_fullsized":"2023-11-04T01:39:21.662026+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:08.595749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.657343+0000","last_change":"2023-11-04T01:39:02.289546+0000","last_active":"2023-11-04T01:39:21.657343+0000","last_peered":"2023-11-04T01:39:21.657343+0000","last_clean":"2023-11-04T01:39:21.657343+0000","last_became_active":"2023-11-04T01:38:59.894387+0000","last_became_peered":"2023-11-04T01:38:59.894387+0000","last_unstale":"2023-11-04T01:39:21.657343+0000","last_undegraded":"2023-11-04T01:39:21.657343+0000","last_fullsized":"2023-11-04T01:39:21.657343+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:12.983159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075893499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664701+0000","last_change":"2023-11-04T01:38:01.699171+0000","last_active":"2023-11-04T01:39:21.664701+0000","last_peered":"2023-11-04T01:39:21.664701+0000","last_clean":"2023-11-04T01:39:21.664701+0000","last_became_active":"2023-11-04T01:38:00.703927+0000","last_became_peered":"2023-11-04T01:38:00.703927+0000","last_unstale":"2023-11-04T01:39:21.664701+0000","last_undegraded":"2023-11-04T01:39:21.664701+0000","last_fullsized":"2023-11-04T01:39:21.664701+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072585499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.690431+0000","last_change":"2023-11-04T01:39:22.682471+0000","last_active":"2023-11-04T01:39:22.690431+0000","last_peered":"2023-11-04T01:39:22.690431+0000","last_clean":"2023-11-04T01:39:22.690431+0000","last_became_active":"2023-11-04T01:39:22.682062+0000","last_became_peered":"2023-11-04T01:39:22.682062+0000","last_unstale":"2023-11-04T01:39:22.690431+0000","last_undegraded":"2023-11-04T01:39:22.690431+0000","last_fullsized":"2023-11-04T01:39:22.690431+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:26:37.468995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.660007+0000","last_change":"2023-11-04T01:39:21.664627+0000","last_active":"2023-11-04T01:39:22.660007+0000","last_peered":"2023-11-04T01:39:22.660007+0000","last_clean":"2023-11-04T01:39:22.660007+0000","last_became_active":"2023-11-04T01:39:21.664339+0000","last_became_peered":"2023-11-04T01:39:21.664339+0000","last_unstale":"2023-11-04T01:39:22.660007+0000","last_undegraded":"2023-11-04T01:39:22.660007+0000","last_fullsized":"2023-11-04T01:39:22.660007+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:27.008236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662469+0000","last_change":"2023-11-04T01:39:00.907431+0000","last_active":"2023-11-04T01:39:21.662469+0000","last_peered":"2023-11-04T01:39:21.662469+0000","last_clean":"2023-11-04T01:39:21.662469+0000","last_became_active":"2023-11-04T01:39:00.907108+0000","last_became_peered":"2023-11-04T01:39:00.907108+0000","last_unstale":"2023-11-04T01:39:21.662469+0000","last_undegraded":"2023-11-04T01:39:21.662469+0000","last_fullsized":"2023-11-04T01:39:21.662469+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:19.094868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.663007+0000","last_change":"2023-11-04T01:39:01.898969+0000","last_active":"2023-11-04T01:39:21.663007+0000","last_peered":"2023-11-04T01:39:21.663007+0000","last_clean":"2023-11-04T01:39:21.663007+0000","last_became_active":"2023-11-04T01:38:59.890578+0000","last_became_peered":"2023-11-04T01:38:59.890578+0000","last_unstale":"2023-11-04T01:39:21.663007+0000","last_undegraded":"2023-11-04T01:39:21.663007+0000","last_fullsized":"2023-11-04T01:39:21.663007+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:55.167791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073951900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654331+0000","last_change":"2023-11-04T01:38:02.156160+0000","last_active":"2023-11-04T01:39:21.654331+0000","last_peered":"2023-11-04T01:39:21.654331+0000","last_clean":"2023-11-04T01:39:21.654331+0000","last_became_active":"2023-11-04T01:38:00.709137+0000","last_became_peered":"2023-11-04T01:38:00.709137+0000","last_unstale":"2023-11-04T01:39:21.654331+0000","last_undegraded":"2023-11-04T01:39:21.654331+0000","last_fullsized":"2023-11-04T01:39:21.654331+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028239399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.684097+0000","last_change":"2023-11-04T01:39:22.677832+0000","last_active":"2023-11-04T01:39:22.684097+0000","last_peered":"2023-11-04T01:39:22.684097+0000","last_clean":"2023-11-04T01:39:22.684097+0000","last_became_active":"2023-11-04T01:39:22.677580+0000","last_became_peered":"2023-11-04T01:39:22.677580+0000","last_unstale":"2023-11-04T01:39:22.684097+0000","last_undegraded":"2023-11-04T01:39:22.684097+0000","last_fullsized":"2023-11-04T01:39:22.684097+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:59:28.020842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"82'8","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.690648+0000","last_change":"2023-11-04T01:39:21.666710+0000","last_active":"2023-11-04T01:39:22.690648+0000","last_peered":"2023-11-04T01:39:22.690648+0000","last_clean":"2023-11-04T01:39:22.690648+0000","last_became_active":"2023-11-04T01:39:21.665857+0000","last_became_peered":"2023-11-04T01:39:21.665857+0000","last_unstale":"2023-11-04T01:39:22.690648+0000","last_undegraded":"2023-11-04T01:39:22.690648+0000","last_fullsized":"2023-11-04T01:39:22.690648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:10.770543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662234+0000","last_change":"2023-11-04T01:39:00.905486+0000","last_active":"2023-11-04T01:39:21.662234+0000","last_peered":"2023-11-04T01:39:21.662234+0000","last_clean":"2023-11-04T01:39:21.662234+0000","last_became_active":"2023-11-04T01:39:00.905221+0000","last_became_peered":"2023-11-04T01:39:00.905221+0000","last_unstale":"2023-11-04T01:39:21.662234+0000","last_undegraded":"2023-11-04T01:39:21.662234+0000","last_fullsized":"2023-11-04T01:39:21.662234+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:16.807464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.660561+0000","last_change":"2023-11-04T01:39:02.039221+0000","last_active":"2023-11-04T01:39:21.660561+0000","last_peered":"2023-11-04T01:39:21.660561+0000","last_clean":"2023-11-04T01:39:21.660561+0000","last_became_active":"2023-11-04T01:38:59.897804+0000","last_became_peered":"2023-11-04T01:38:59.897804+0000","last_unstale":"2023-11-04T01:39:21.660561+0000","last_undegraded":"2023-11-04T01:39:21.660561+0000","last_fullsized":"2023-11-04T01:39:21.660561+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:38:29.900299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038141100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662737+0000","last_change":"2023-11-04T01:38:01.698196+0000","last_active":"2023-11-04T01:39:21.662737+0000","last_peered":"2023-11-04T01:39:21.662737+0000","last_clean":"2023-11-04T01:39:21.662737+0000","last_became_active":"2023-11-04T01:38:00.705451+0000","last_became_peered":"2023-11-04T01:38:00.705451+0000","last_unstale":"2023-11-04T01:39:21.662737+0000","last_undegraded":"2023-11-04T01:39:21.662737+0000","last_fullsized":"2023-11-04T01:39:21.662737+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:16.759249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067668100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.682613+0000","last_change":"2023-11-04T01:39:22.677363+0000","last_active":"2023-11-04T01:39:22.682613+0000","last_peered":"2023-11-04T01:39:22.682613+0000","last_clean":"2023-11-04T01:39:22.682613+0000","last_became_active":"2023-11-04T01:39:22.676973+0000","last_became_peered":"2023-11-04T01:39:22.676973+0000","last_unstale":"2023-11-04T01:39:22.682613+0000","last_undegraded":"2023-11-04T01:39:22.682613+0000","last_fullsized":"2023-11-04T01:39:22.682613+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:35.771841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.664389+0000","last_change":"2023-11-04T01:39:21.668893+0000","last_active":"2023-11-04T01:39:22.664389+0000","last_peered":"2023-11-04T01:39:22.664389+0000","last_clean":"2023-11-04T01:39:22.664389+0000","last_became_active":"2023-11-04T01:39:21.668581+0000","last_became_peered":"2023-11-04T01:39:21.668581+0000","last_unstale":"2023-11-04T01:39:22.664389+0000","last_undegraded":"2023-11-04T01:39:22.664389+0000","last_fullsized":"2023-11-04T01:39:22.664389+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:49.520663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661995+0000","last_change":"2023-11-04T01:39:00.901434+0000","last_active":"2023-11-04T01:39:21.661995+0000","last_peered":"2023-11-04T01:39:21.661995+0000","last_clean":"2023-11-04T01:39:21.661995+0000","last_became_active":"2023-11-04T01:39:00.901094+0000","last_became_peered":"2023-11-04T01:39:00.901094+0000","last_unstale":"2023-11-04T01:39:21.661995+0000","last_undegraded":"2023-11-04T01:39:21.661995+0000","last_fullsized":"2023-11-04T01:39:21.661995+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:56:48.965289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654331+0000","last_change":"2023-11-04T01:39:02.371687+0000","last_active":"2023-11-04T01:39:21.654331+0000","last_peered":"2023-11-04T01:39:21.654331+0000","last_clean":"2023-11-04T01:39:21.654331+0000","last_became_active":"2023-11-04T01:38:59.888782+0000","last_became_peered":"2023-11-04T01:38:59.888782+0000","last_unstale":"2023-11-04T01:39:21.654331+0000","last_undegraded":"2023-11-04T01:39:21.654331+0000","last_fullsized":"2023-11-04T01:39:21.654331+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:34.092676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088740800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662873+0000","last_change":"2023-11-04T01:38:01.983991+0000","last_active":"2023-11-04T01:39:21.662873+0000","last_peered":"2023-11-04T01:39:21.662873+0000","last_clean":"2023-11-04T01:39:21.662873+0000","last_became_active":"2023-11-04T01:38:00.708462+0000","last_became_peered":"2023-11-04T01:38:00.708462+0000","last_unstale":"2023-11-04T01:39:21.662873+0000","last_undegraded":"2023-11-04T01:39:21.662873+0000","last_fullsized":"2023-11-04T01:39:21.662873+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:37.727651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041811600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.675040+0000","last_change":"2023-11-04T01:39:22.670994+0000","last_active":"2023-11-04T01:39:22.675040+0000","last_peered":"2023-11-04T01:39:22.675040+0000","last_clean":"2023-11-04T01:39:22.675040+0000","last_became_active":"2023-11-04T01:39:22.670491+0000","last_became_peered":"2023-11-04T01:39:22.670491+0000","last_unstale":"2023-11-04T01:39:22.675040+0000","last_undegraded":"2023-11-04T01:39:22.675040+0000","last_fullsized":"2023-11-04T01:39:22.675040+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:54.551020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.661481+0000","last_change":"2023-11-04T01:39:21.673479+0000","last_active":"2023-11-04T01:39:22.661481+0000","last_peered":"2023-11-04T01:39:22.661481+0000","last_clean":"2023-11-04T01:39:22.661481+0000","last_became_active":"2023-11-04T01:39:21.673142+0000","last_became_peered":"2023-11-04T01:39:21.673142+0000","last_unstale":"2023-11-04T01:39:22.661481+0000","last_undegraded":"2023-11-04T01:39:22.661481+0000","last_fullsized":"2023-11-04T01:39:22.661481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:51.916158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.653992+0000","last_change":"2023-11-04T01:39:00.907664+0000","last_active":"2023-11-04T01:39:21.653992+0000","last_peered":"2023-11-04T01:39:21.653992+0000","last_clean":"2023-11-04T01:39:21.653992+0000","last_became_active":"2023-11-04T01:39:00.907098+0000","last_became_peered":"2023-11-04T01:39:00.907098+0000","last_unstale":"2023-11-04T01:39:21.653992+0000","last_undegraded":"2023-11-04T01:39:21.653992+0000","last_fullsized":"2023-11-04T01:39:21.653992+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:43:34.994912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662601+0000","last_change":"2023-11-04T01:39:02.076144+0000","last_active":"2023-11-04T01:39:21.662601+0000","last_peered":"2023-11-04T01:39:21.662601+0000","last_clean":"2023-11-04T01:39:21.662601+0000","last_became_active":"2023-11-04T01:38:59.891521+0000","last_became_peered":"2023-11-04T01:38:59.891521+0000","last_unstale":"2023-11-04T01:39:21.662601+0000","last_undegraded":"2023-11-04T01:39:21.662601+0000","last_fullsized":"2023-11-04T01:39:21.662601+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:24.449921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063833,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.666557+0000","last_change":"2023-11-04T01:38:01.984341+0000","last_active":"2023-11-04T01:39:21.666557+0000","last_peered":"2023-11-04T01:39:21.666557+0000","last_clean":"2023-11-04T01:39:21.666557+0000","last_became_active":"2023-11-04T01:38:00.708307+0000","last_became_peered":"2023-11-04T01:38:00.708307+0000","last_unstale":"2023-11-04T01:39:21.666557+0000","last_undegraded":"2023-11-04T01:39:21.666557+0000","last_fullsized":"2023-11-04T01:39:21.666557+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:17.369098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053627199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.674598+0000","last_change":"2023-11-04T01:39:22.671028+0000","last_active":"2023-11-04T01:39:22.674598+0000","last_peered":"2023-11-04T01:39:22.674598+0000","last_clean":"2023-11-04T01:39:22.674598+0000","last_became_active":"2023-11-04T01:39:22.670776+0000","last_became_peered":"2023-11-04T01:39:22.670776+0000","last_unstale":"2023-11-04T01:39:22.674598+0000","last_undegraded":"2023-11-04T01:39:22.674598+0000","last_fullsized":"2023-11-04T01:39:22.674598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:07.297352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.688564+0000","last_change":"2023-11-04T01:39:21.667818+0000","last_active":"2023-11-04T01:39:22.688564+0000","last_peered":"2023-11-04T01:39:22.688564+0000","last_clean":"2023-11-04T01:39:22.688564+0000","last_became_active":"2023-11-04T01:39:21.667572+0000","last_became_peered":"2023-11-04T01:39:21.667572+0000","last_unstale":"2023-11-04T01:39:22.688564+0000","last_undegraded":"2023-11-04T01:39:22.688564+0000","last_fullsized":"2023-11-04T01:39:22.688564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:57.814070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654435+0000","last_change":"2023-11-04T01:39:00.905352+0000","last_active":"2023-11-04T01:39:21.654435+0000","last_peered":"2023-11-04T01:39:21.654435+0000","last_clean":"2023-11-04T01:39:21.654435+0000","last_became_active":"2023-11-04T01:39:00.905058+0000","last_became_peered":"2023-11-04T01:39:00.905058+0000","last_unstale":"2023-11-04T01:39:21.654435+0000","last_undegraded":"2023-11-04T01:39:21.654435+0000","last_fullsized":"2023-11-04T01:39:21.654435+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:37.246937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.655963+0000","last_change":"2023-11-04T01:39:02.289522+0000","last_active":"2023-11-04T01:39:21.655963+0000","last_peered":"2023-11-04T01:39:21.655963+0000","last_clean":"2023-11-04T01:39:21.655963+0000","last_became_active":"2023-11-04T01:38:59.887549+0000","last_became_peered":"2023-11-04T01:38:59.887549+0000","last_unstale":"2023-11-04T01:39:21.655963+0000","last_undegraded":"2023-11-04T01:39:21.655963+0000","last_fullsized":"2023-11-04T01:39:21.655963+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:13.888718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077706800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661695+0000","last_change":"2023-11-04T01:38:01.700471+0000","last_active":"2023-11-04T01:39:21.661695+0000","last_peered":"2023-11-04T01:39:21.661695+0000","last_clean":"2023-11-04T01:39:21.661695+0000","last_became_active":"2023-11-04T01:38:00.702522+0000","last_became_peered":"2023-11-04T01:38:00.702522+0000","last_unstale":"2023-11-04T01:39:21.661695+0000","last_undegraded":"2023-11-04T01:39:21.661695+0000","last_fullsized":"2023-11-04T01:39:21.661695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086940300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.682635+0000","last_change":"2023-11-04T01:39:22.678096+0000","last_active":"2023-11-04T01:39:22.682635+0000","last_peered":"2023-11-04T01:39:22.682635+0000","last_clean":"2023-11-04T01:39:22.682635+0000","last_became_active":"2023-11-04T01:39:22.677070+0000","last_became_peered":"2023-11-04T01:39:22.677070+0000","last_unstale":"2023-11-04T01:39:22.682635+0000","last_undegraded":"2023-11-04T01:39:22.682635+0000","last_fullsized":"2023-11-04T01:39:22.682635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:40.878070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.690318+0000","last_change":"2023-11-04T01:39:21.677390+0000","last_active":"2023-11-04T01:39:22.690318+0000","last_peered":"2023-11-04T01:39:22.690318+0000","last_clean":"2023-11-04T01:39:22.690318+0000","last_became_active":"2023-11-04T01:39:21.677128+0000","last_became_peered":"2023-11-04T01:39:21.677128+0000","last_unstale":"2023-11-04T01:39:22.690318+0000","last_undegraded":"2023-11-04T01:39:22.690318+0000","last_fullsized":"2023-11-04T01:39:22.690318+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:24.271627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664631+0000","last_change":"2023-11-04T01:39:00.905889+0000","last_active":"2023-11-04T01:39:21.664631+0000","last_peered":"2023-11-04T01:39:21.664631+0000","last_clean":"2023-11-04T01:39:21.664631+0000","last_became_active":"2023-11-04T01:39:00.905644+0000","last_became_peered":"2023-11-04T01:39:00.905644+0000","last_unstale":"2023-11-04T01:39:21.664631+0000","last_undegraded":"2023-11-04T01:39:21.664631+0000","last_fullsized":"2023-11-04T01:39:21.664631+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:13.988639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.663012+0000","last_change":"2023-11-04T01:39:01.897496+0000","last_active":"2023-11-04T01:39:21.663012+0000","last_peered":"2023-11-04T01:39:21.663012+0000","last_clean":"2023-11-04T01:39:21.663012+0000","last_became_active":"2023-11-04T01:38:59.894771+0000","last_became_peered":"2023-11-04T01:38:59.894771+0000","last_unstale":"2023-11-04T01:39:21.663012+0000","last_undegraded":"2023-11-04T01:39:21.663012+0000","last_fullsized":"2023-11-04T01:39:21.663012+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:50.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043645000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.665937+0000","last_change":"2023-11-04T01:38:01.696901+0000","last_active":"2023-11-04T01:39:21.665937+0000","last_peered":"2023-11-04T01:39:21.665937+0000","last_clean":"2023-11-04T01:39:21.665937+0000","last_became_active":"2023-11-04T01:38:00.706170+0000","last_became_peered":"2023-11-04T01:38:00.706170+0000","last_unstale":"2023-11-04T01:39:21.665937+0000","last_undegraded":"2023-11-04T01:39:21.665937+0000","last_fullsized":"2023-11-04T01:39:21.665937+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059391100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.685023+0000","last_change":"2023-11-04T01:39:22.681888+0000","last_active":"2023-11-04T01:39:22.685023+0000","last_peered":"2023-11-04T01:39:22.685023+0000","last_clean":"2023-11-04T01:39:22.685023+0000","last_became_active":"2023-11-04T01:39:22.681638+0000","last_became_peered":"2023-11-04T01:39:22.681638+0000","last_unstale":"2023-11-04T01:39:22.685023+0000","last_undegraded":"2023-11-04T01:39:22.685023+0000","last_fullsized":"2023-11-04T01:39:22.685023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:13.612357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.687702+0000","last_change":"2023-11-04T01:39:21.670429+0000","last_active":"2023-11-04T01:39:22.687702+0000","last_peered":"2023-11-04T01:39:22.687702+0000","last_clean":"2023-11-04T01:39:22.687702+0000","last_became_active":"2023-11-04T01:39:21.670162+0000","last_became_peered":"2023-11-04T01:39:21.670162+0000","last_unstale":"2023-11-04T01:39:22.687702+0000","last_undegraded":"2023-11-04T01:39:22.687702+0000","last_fullsized":"2023-11-04T01:39:22.687702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:55.034650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662928+0000","last_change":"2023-11-04T01:39:00.907377+0000","last_active":"2023-11-04T01:39:21.662928+0000","last_peered":"2023-11-04T01:39:21.662928+0000","last_clean":"2023-11-04T01:39:21.662928+0000","last_became_active":"2023-11-04T01:39:00.907059+0000","last_became_peered":"2023-11-04T01:39:00.907059+0000","last_unstale":"2023-11-04T01:39:21.662928+0000","last_undegraded":"2023-11-04T01:39:21.662928+0000","last_fullsized":"2023-11-04T01:39:21.662928+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:04.732051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664259+0000","last_change":"2023-11-04T01:39:01.899471+0000","last_active":"2023-11-04T01:39:21.664259+0000","last_peered":"2023-11-04T01:39:21.664259+0000","last_clean":"2023-11-04T01:39:21.664259+0000","last_became_active":"2023-11-04T01:38:59.893689+0000","last_became_peered":"2023-11-04T01:38:59.893689+0000","last_unstale":"2023-11-04T01:39:21.664259+0000","last_undegraded":"2023-11-04T01:39:21.664259+0000","last_fullsized":"2023-11-04T01:39:21.664259+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:36.506018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072622699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.659237+0000","last_change":"2023-11-04T01:38:01.939972+0000","last_active":"2023-11-04T01:39:21.659237+0000","last_peered":"2023-11-04T01:39:21.659237+0000","last_clean":"2023-11-04T01:39:21.659237+0000","last_became_active":"2023-11-04T01:38:00.702784+0000","last_became_peered":"2023-11-04T01:38:00.702784+0000","last_unstale":"2023-11-04T01:39:21.659237+0000","last_undegraded":"2023-11-04T01:39:21.659237+0000","last_fullsized":"2023-11-04T01:39:21.659237+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:26.760402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071328600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.687700+0000","last_change":"2023-11-04T01:39:22.684261+0000","last_active":"2023-11-04T01:39:22.687700+0000","last_peered":"2023-11-04T01:39:22.687700+0000","last_clean":"2023-11-04T01:39:22.687700+0000","last_became_active":"2023-11-04T01:39:22.684008+0000","last_became_peered":"2023-11-04T01:39:22.684008+0000","last_unstale":"2023-11-04T01:39:22.687700+0000","last_undegraded":"2023-11-04T01:39:22.687700+0000","last_fullsized":"2023-11-04T01:39:22.687700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:33:53.430199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.687827+0000","last_change":"2023-11-04T01:39:21.674030+0000","last_active":"2023-11-04T01:39:22.687827+0000","last_peered":"2023-11-04T01:39:22.687827+0000","last_clean":"2023-11-04T01:39:22.687827+0000","last_became_active":"2023-11-04T01:39:21.673666+0000","last_became_peered":"2023-11-04T01:39:21.673666+0000","last_unstale":"2023-11-04T01:39:22.687827+0000","last_undegraded":"2023-11-04T01:39:22.687827+0000","last_fullsized":"2023-11-04T01:39:22.687827+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:05.769230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664867+0000","last_change":"2023-11-04T01:39:00.901301+0000","last_active":"2023-11-04T01:39:21.664867+0000","last_peered":"2023-11-04T01:39:21.664867+0000","last_clean":"2023-11-04T01:39:21.664867+0000","last_became_active":"2023-11-04T01:39:00.901087+0000","last_became_peered":"2023-11-04T01:39:00.901087+0000","last_unstale":"2023-11-04T01:39:21.664867+0000","last_undegraded":"2023-11-04T01:39:21.664867+0000","last_fullsized":"2023-11-04T01:39:21.664867+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:07.192076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662643+0000","last_change":"2023-11-04T01:39:02.076926+0000","last_active":"2023-11-04T01:39:21.662643+0000","last_peered":"2023-11-04T01:39:21.662643+0000","last_clean":"2023-11-04T01:39:21.662643+0000","last_became_active":"2023-11-04T01:38:59.897799+0000","last_became_peered":"2023-11-04T01:38:59.897799+0000","last_unstale":"2023-11-04T01:39:21.662643+0000","last_undegraded":"2023-11-04T01:39:21.662643+0000","last_fullsized":"2023-11-04T01:39:21.662643+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:06.186596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051016799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.665873+0000","last_change":"2023-11-04T01:38:01.699051+0000","last_active":"2023-11-04T01:39:21.665873+0000","last_peered":"2023-11-04T01:39:21.665873+0000","last_clean":"2023-11-04T01:39:21.665873+0000","last_became_active":"2023-11-04T01:38:00.708665+0000","last_became_peered":"2023-11-04T01:38:00.708665+0000","last_unstale":"2023-11-04T01:39:21.665873+0000","last_undegraded":"2023-11-04T01:39:21.665873+0000","last_fullsized":"2023-11-04T01:39:21.665873+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020995580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.678061+0000","last_change":"2023-11-04T01:39:22.672770+0000","last_active":"2023-11-04T01:39:22.678061+0000","last_peered":"2023-11-04T01:39:22.678061+0000","last_clean":"2023-11-04T01:39:22.678061+0000","last_became_active":"2023-11-04T01:39:22.668474+0000","last_became_peered":"2023-11-04T01:39:22.668474+0000","last_unstale":"2023-11-04T01:39:22.678061+0000","last_undegraded":"2023-11-04T01:39:22.678061+0000","last_fullsized":"2023-11-04T01:39:22.678061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:29.757239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"82'4","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.690328+0000","last_change":"2023-11-04T01:39:21.669468+0000","last_active":"2023-11-04T01:39:22.690328+0000","last_peered":"2023-11-04T01:39:22.690328+0000","last_clean":"2023-11-04T01:39:22.690328+0000","last_became_active":"2023-11-04T01:39:21.668598+0000","last_became_peered":"2023-11-04T01:39:21.668598+0000","last_unstale":"2023-11-04T01:39:22.690328+0000","last_undegraded":"2023-11-04T01:39:22.690328+0000","last_fullsized":"2023-11-04T01:39:22.690328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:47.609733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662333+0000","last_change":"2023-11-04T01:39:00.903233+0000","last_active":"2023-11-04T01:39:21.662333+0000","last_peered":"2023-11-04T01:39:21.662333+0000","last_clean":"2023-11-04T01:39:21.662333+0000","last_became_active":"2023-11-04T01:39:00.902913+0000","last_became_peered":"2023-11-04T01:39:00.902913+0000","last_unstale":"2023-11-04T01:39:21.662333+0000","last_undegraded":"2023-11-04T01:39:21.662333+0000","last_fullsized":"2023-11-04T01:39:21.662333+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:29.058403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.663523+0000","last_change":"2023-11-04T01:39:02.076853+0000","last_active":"2023-11-04T01:39:21.663523+0000","last_peered":"2023-11-04T01:39:21.663523+0000","last_clean":"2023-11-04T01:39:21.663523+0000","last_became_active":"2023-11-04T01:38:59.898310+0000","last_became_peered":"2023-11-04T01:38:59.898310+0000","last_unstale":"2023-11-04T01:39:21.663523+0000","last_undegraded":"2023-11-04T01:39:21.663523+0000","last_fullsized":"2023-11-04T01:39:21.663523+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:22.196883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066256699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.663085+0000","last_change":"2023-11-04T01:38:01.700742+0000","last_active":"2023-11-04T01:39:21.663085+0000","last_peered":"2023-11-04T01:39:21.663085+0000","last_clean":"2023-11-04T01:39:21.663085+0000","last_became_active":"2023-11-04T01:38:00.706671+0000","last_became_peered":"2023-11-04T01:38:00.706671+0000","last_unstale":"2023-11-04T01:39:21.663085+0000","last_undegraded":"2023-11-04T01:39:21.663085+0000","last_fullsized":"2023-11-04T01:39:21.663085+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072370699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.682579+0000","last_change":"2023-11-04T01:39:22.678008+0000","last_active":"2023-11-04T01:39:22.682579+0000","last_peered":"2023-11-04T01:39:22.682579+0000","last_clean":"2023-11-04T01:39:22.682579+0000","last_became_active":"2023-11-04T01:39:22.677734+0000","last_became_peered":"2023-11-04T01:39:22.677734+0000","last_unstale":"2023-11-04T01:39:22.682579+0000","last_undegraded":"2023-11-04T01:39:22.682579+0000","last_fullsized":"2023-11-04T01:39:22.682579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:34.159049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.660519+0000","last_change":"2023-11-04T01:39:21.668329+0000","last_active":"2023-11-04T01:39:22.660519+0000","last_peered":"2023-11-04T01:39:22.660519+0000","last_clean":"2023-11-04T01:39:22.660519+0000","last_became_active":"2023-11-04T01:39:21.668059+0000","last_became_peered":"2023-11-04T01:39:21.668059+0000","last_unstale":"2023-11-04T01:39:22.660519+0000","last_undegraded":"2023-11-04T01:39:22.660519+0000","last_fullsized":"2023-11-04T01:39:22.660519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:58.285827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662237+0000","last_change":"2023-11-04T01:39:00.902537+0000","last_active":"2023-11-04T01:39:21.662237+0000","last_peered":"2023-11-04T01:39:21.662237+0000","last_clean":"2023-11-04T01:39:21.662237+0000","last_became_active":"2023-11-04T01:39:00.902217+0000","last_became_peered":"2023-11-04T01:39:00.902217+0000","last_unstale":"2023-11-04T01:39:21.662237+0000","last_undegraded":"2023-11-04T01:39:21.662237+0000","last_fullsized":"2023-11-04T01:39:21.662237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:56.622252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661229+0000","last_change":"2023-11-04T01:39:01.896481+0000","last_active":"2023-11-04T01:39:21.661229+0000","last_peered":"2023-11-04T01:39:21.661229+0000","last_clean":"2023-11-04T01:39:21.661229+0000","last_became_active":"2023-11-04T01:38:59.897511+0000","last_became_peered":"2023-11-04T01:38:59.897511+0000","last_unstale":"2023-11-04T01:39:21.661229+0000","last_undegraded":"2023-11-04T01:39:21.661229+0000","last_fullsized":"2023-11-04T01:39:21.661229+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:31.015230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001138319,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662047+0000","last_change":"2023-11-04T01:38:01.697526+0000","last_active":"2023-11-04T01:39:21.662047+0000","last_peered":"2023-11-04T01:39:21.662047+0000","last_clean":"2023-11-04T01:39:21.662047+0000","last_became_active":"2023-11-04T01:38:00.707580+0000","last_became_peered":"2023-11-04T01:38:00.707580+0000","last_unstale":"2023-11-04T01:39:21.662047+0000","last_undegraded":"2023-11-04T01:39:21.662047+0000","last_fullsized":"2023-11-04T01:39:21.662047+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010806699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.674355+0000","last_change":"2023-11-04T01:39:22.672824+0000","last_active":"2023-11-04T01:39:22.674355+0000","last_peered":"2023-11-04T01:39:22.674355+0000","last_clean":"2023-11-04T01:39:22.674355+0000","last_became_active":"2023-11-04T01:39:22.672499+0000","last_became_peered":"2023-11-04T01:39:22.672499+0000","last_unstale":"2023-11-04T01:39:22.674355+0000","last_undegraded":"2023-11-04T01:39:22.674355+0000","last_fullsized":"2023-11-04T01:39:22.674355+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:16.646126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.664104+0000","last_change":"2023-11-04T01:39:21.670345+0000","last_active":"2023-11-04T01:39:22.664104+0000","last_peered":"2023-11-04T01:39:22.664104+0000","last_clean":"2023-11-04T01:39:22.664104+0000","last_became_active":"2023-11-04T01:39:21.670059+0000","last_became_peered":"2023-11-04T01:39:21.670059+0000","last_unstale":"2023-11-04T01:39:22.664104+0000","last_undegraded":"2023-11-04T01:39:22.664104+0000","last_fullsized":"2023-11-04T01:39:22.664104+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:26.443828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654035+0000","last_change":"2023-11-04T01:39:00.905358+0000","last_active":"2023-11-04T01:39:21.654035+0000","last_peered":"2023-11-04T01:39:21.654035+0000","last_clean":"2023-11-04T01:39:21.654035+0000","last_became_active":"2023-11-04T01:39:00.905066+0000","last_became_peered":"2023-11-04T01:39:00.905066+0000","last_unstale":"2023-11-04T01:39:21.654035+0000","last_undegraded":"2023-11-04T01:39:21.654035+0000","last_fullsized":"2023-11-04T01:39:21.654035+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:23.606563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662307+0000","last_change":"2023-11-04T01:39:01.897060+0000","last_active":"2023-11-04T01:39:21.662307+0000","last_peered":"2023-11-04T01:39:21.662307+0000","last_clean":"2023-11-04T01:39:21.662307+0000","last_became_active":"2023-11-04T01:38:59.888827+0000","last_became_peered":"2023-11-04T01:38:59.888827+0000","last_unstale":"2023-11-04T01:39:21.662307+0000","last_undegraded":"2023-11-04T01:39:21.662307+0000","last_fullsized":"2023-11-04T01:39:21.662307+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:52:14.150104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000963042,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.660201+0000","last_change":"2023-11-04T01:38:01.939462+0000","last_active":"2023-11-04T01:39:21.660201+0000","last_peered":"2023-11-04T01:39:21.660201+0000","last_clean":"2023-11-04T01:39:21.660201+0000","last_became_active":"2023-11-04T01:38:00.705830+0000","last_became_peered":"2023-11-04T01:38:00.705830+0000","last_unstale":"2023-11-04T01:39:21.660201+0000","last_undegraded":"2023-11-04T01:39:21.660201+0000","last_fullsized":"2023-11-04T01:39:21.660201+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059305000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.673501+0000","last_change":"2023-11-04T01:39:22.669793+0000","last_active":"2023-11-04T01:39:22.673501+0000","last_peered":"2023-11-04T01:39:22.673501+0000","last_clean":"2023-11-04T01:39:22.673501+0000","last_became_active":"2023-11-04T01:39:22.666919+0000","last_became_peered":"2023-11-04T01:39:22.666919+0000","last_unstale":"2023-11-04T01:39:22.673501+0000","last_undegraded":"2023-11-04T01:39:22.673501+0000","last_fullsized":"2023-11-04T01:39:22.673501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:14.309939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.687566+0000","last_change":"2023-11-04T01:39:21.672019+0000","last_active":"2023-11-04T01:39:22.687566+0000","last_peered":"2023-11-04T01:39:22.687566+0000","last_clean":"2023-11-04T01:39:22.687566+0000","last_became_active":"2023-11-04T01:39:21.671762+0000","last_became_peered":"2023-11-04T01:39:21.671762+0000","last_unstale":"2023-11-04T01:39:22.687566+0000","last_undegraded":"2023-11-04T01:39:22.687566+0000","last_fullsized":"2023-11-04T01:39:22.687566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:20:55.389510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.660988+0000","last_change":"2023-11-04T01:39:00.898467+0000","last_active":"2023-11-04T01:39:21.660988+0000","last_peered":"2023-11-04T01:39:21.660988+0000","last_clean":"2023-11-04T01:39:21.660988+0000","last_became_active":"2023-11-04T01:39:00.898168+0000","last_became_peered":"2023-11-04T01:39:00.898168+0000","last_unstale":"2023-11-04T01:39:21.660988+0000","last_undegraded":"2023-11-04T01:39:21.660988+0000","last_fullsized":"2023-11-04T01:39:21.660988+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:03.950091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654522+0000","last_change":"2023-11-04T01:39:02.371405+0000","last_active":"2023-11-04T01:39:21.654522+0000","last_peered":"2023-11-04T01:39:21.654522+0000","last_clean":"2023-11-04T01:39:21.654522+0000","last_became_active":"2023-11-04T01:38:59.884832+0000","last_became_peered":"2023-11-04T01:38:59.884832+0000","last_unstale":"2023-11-04T01:39:21.654522+0000","last_undegraded":"2023-11-04T01:39:21.654522+0000","last_fullsized":"2023-11-04T01:39:21.654522+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:22.851162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00135917,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.666650+0000","last_change":"2023-11-04T01:38:01.984456+0000","last_active":"2023-11-04T01:39:21.666650+0000","last_peered":"2023-11-04T01:39:21.666650+0000","last_clean":"2023-11-04T01:39:21.666650+0000","last_became_active":"2023-11-04T01:38:00.708803+0000","last_became_peered":"2023-11-04T01:38:00.708803+0000","last_unstale":"2023-11-04T01:39:21.666650+0000","last_undegraded":"2023-11-04T01:39:21.666650+0000","last_fullsized":"2023-11-04T01:39:21.666650+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:30.811033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061551599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683077+0000","last_change":"2023-11-04T01:39:22.680923+0000","last_active":"2023-11-04T01:39:22.683077+0000","last_peered":"2023-11-04T01:39:22.683077+0000","last_clean":"2023-11-04T01:39:22.683077+0000","last_became_active":"2023-11-04T01:39:22.680562+0000","last_became_peered":"2023-11-04T01:39:22.680562+0000","last_unstale":"2023-11-04T01:39:22.683077+0000","last_undegraded":"2023-11-04T01:39:22.683077+0000","last_fullsized":"2023-11-04T01:39:22.683077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:44.985565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.688097+0000","last_change":"2023-11-04T01:39:21.666286+0000","last_active":"2023-11-04T01:39:22.688097+0000","last_peered":"2023-11-04T01:39:22.688097+0000","last_clean":"2023-11-04T01:39:22.688097+0000","last_became_active":"2023-11-04T01:39:21.666026+0000","last_became_peered":"2023-11-04T01:39:21.666026+0000","last_unstale":"2023-11-04T01:39:22.688097+0000","last_undegraded":"2023-11-04T01:39:22.688097+0000","last_fullsized":"2023-11-04T01:39:22.688097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:35.632719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662483+0000","last_change":"2023-11-04T01:39:00.898232+0000","last_active":"2023-11-04T01:39:21.662483+0000","last_peered":"2023-11-04T01:39:21.662483+0000","last_clean":"2023-11-04T01:39:21.662483+0000","last_became_active":"2023-11-04T01:39:00.897953+0000","last_became_peered":"2023-11-04T01:39:00.897953+0000","last_unstale":"2023-11-04T01:39:21.662483+0000","last_undegraded":"2023-11-04T01:39:21.662483+0000","last_fullsized":"2023-11-04T01:39:21.662483+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:19.094868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661276+0000","last_change":"2023-11-04T01:39:02.076201+0000","last_active":"2023-11-04T01:39:21.661276+0000","last_peered":"2023-11-04T01:39:21.661276+0000","last_clean":"2023-11-04T01:39:21.661276+0000","last_became_active":"2023-11-04T01:38:59.885672+0000","last_became_peered":"2023-11-04T01:38:59.885672+0000","last_unstale":"2023-11-04T01:39:21.661276+0000","last_undegraded":"2023-11-04T01:39:21.661276+0000","last_fullsized":"2023-11-04T01:39:21.661276+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:15.425248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063733799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661497+0000","last_change":"2023-11-04T01:38:01.698866+0000","last_active":"2023-11-04T01:39:21.661497+0000","last_peered":"2023-11-04T01:39:21.661497+0000","last_clean":"2023-11-04T01:39:21.661497+0000","last_became_active":"2023-11-04T01:38:00.706149+0000","last_became_peered":"2023-11-04T01:38:00.706149+0000","last_unstale":"2023-11-04T01:39:21.661497+0000","last_undegraded":"2023-11-04T01:39:21.661497+0000","last_fullsized":"2023-11-04T01:39:21.661497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:59.391683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001344154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683590+0000","last_change":"2023-11-04T01:39:22.671747+0000","last_active":"2023-11-04T01:39:22.683590+0000","last_peered":"2023-11-04T01:39:22.683590+0000","last_clean":"2023-11-04T01:39:22.683590+0000","last_became_active":"2023-11-04T01:39:22.670878+0000","last_became_peered":"2023-11-04T01:39:22.670878+0000","last_unstale":"2023-11-04T01:39:22.683590+0000","last_undegraded":"2023-11-04T01:39:22.683590+0000","last_fullsized":"2023-11-04T01:39:22.683590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:28.975278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.662590+0000","last_change":"2023-11-04T01:39:21.667894+0000","last_active":"2023-11-04T01:39:22.662590+0000","last_peered":"2023-11-04T01:39:22.662590+0000","last_clean":"2023-11-04T01:39:22.662590+0000","last_became_active":"2023-11-04T01:39:21.667595+0000","last_became_peered":"2023-11-04T01:39:21.667595+0000","last_unstale":"2023-11-04T01:39:22.662590+0000","last_undegraded":"2023-11-04T01:39:22.662590+0000","last_fullsized":"2023-11-04T01:39:22.662590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:41:50.993293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.665627+0000","last_change":"2023-11-04T01:39:00.907552+0000","last_active":"2023-11-04T01:39:21.665627+0000","last_peered":"2023-11-04T01:39:21.665627+0000","last_clean":"2023-11-04T01:39:21.665627+0000","last_became_active":"2023-11-04T01:39:00.907262+0000","last_became_peered":"2023-11-04T01:39:00.907262+0000","last_unstale":"2023-11-04T01:39:21.665627+0000","last_undegraded":"2023-11-04T01:39:21.665627+0000","last_fullsized":"2023-11-04T01:39:21.665627+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:23.202363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654413+0000","last_change":"2023-11-04T01:39:02.371758+0000","last_active":"2023-11-04T01:39:21.654413+0000","last_peered":"2023-11-04T01:39:21.654413+0000","last_clean":"2023-11-04T01:39:21.654413+0000","last_became_active":"2023-11-04T01:38:59.891579+0000","last_became_peered":"2023-11-04T01:38:59.891579+0000","last_unstale":"2023-11-04T01:39:21.654413+0000","last_undegraded":"2023-11-04T01:39:21.654413+0000","last_fullsized":"2023-11-04T01:39:21.654413+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:04:45.779183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063536799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.663139+0000","last_change":"2023-11-04T01:38:01.699187+0000","last_active":"2023-11-04T01:39:21.663139+0000","last_peered":"2023-11-04T01:39:21.663139+0000","last_clean":"2023-11-04T01:39:21.663139+0000","last_became_active":"2023-11-04T01:38:00.706136+0000","last_became_peered":"2023-11-04T01:38:00.706136+0000","last_unstale":"2023-11-04T01:39:21.663139+0000","last_undegraded":"2023-11-04T01:39:21.663139+0000","last_fullsized":"2023-11-04T01:39:21.663139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074666999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.675612+0000","last_change":"2023-11-04T01:39:22.669711+0000","last_active":"2023-11-04T01:39:22.675612+0000","last_peered":"2023-11-04T01:39:22.675612+0000","last_clean":"2023-11-04T01:39:22.675612+0000","last_became_active":"2023-11-04T01:39:22.667542+0000","last_became_peered":"2023-11-04T01:39:22.667542+0000","last_unstale":"2023-11-04T01:39:22.675612+0000","last_undegraded":"2023-11-04T01:39:22.675612+0000","last_fullsized":"2023-11-04T01:39:22.675612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:43.048540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.667638+0000","last_change":"2023-11-04T01:39:21.677238+0000","last_active":"2023-11-04T01:39:22.667638+0000","last_peered":"2023-11-04T01:39:22.667638+0000","last_clean":"2023-11-04T01:39:22.667638+0000","last_became_active":"2023-11-04T01:39:21.676982+0000","last_became_peered":"2023-11-04T01:39:21.676982+0000","last_unstale":"2023-11-04T01:39:22.667638+0000","last_undegraded":"2023-11-04T01:39:22.667638+0000","last_fullsized":"2023-11-04T01:39:22.667638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:31:19.679370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.663426+0000","last_change":"2023-11-04T01:39:00.904464+0000","last_active":"2023-11-04T01:39:21.663426+0000","last_peered":"2023-11-04T01:39:21.663426+0000","last_clean":"2023-11-04T01:39:21.663426+0000","last_became_active":"2023-11-04T01:39:00.904172+0000","last_became_peered":"2023-11-04T01:39:00.904172+0000","last_unstale":"2023-11-04T01:39:21.663426+0000","last_undegraded":"2023-11-04T01:39:21.663426+0000","last_fullsized":"2023-11-04T01:39:21.663426+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:32.767818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654425+0000","last_change":"2023-11-04T01:39:02.371427+0000","last_active":"2023-11-04T01:39:21.654425+0000","last_peered":"2023-11-04T01:39:21.654425+0000","last_clean":"2023-11-04T01:39:21.654425+0000","last_became_active":"2023-11-04T01:38:59.886795+0000","last_became_peered":"2023-11-04T01:38:59.886795+0000","last_unstale":"2023-11-04T01:39:21.654425+0000","last_undegraded":"2023-11-04T01:39:21.654425+0000","last_fullsized":"2023-11-04T01:39:21.654425+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:24:01.300866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082815500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662579+0000","last_change":"2023-11-04T01:38:01.699630+0000","last_active":"2023-11-04T01:39:21.662579+0000","last_peered":"2023-11-04T01:39:21.662579+0000","last_clean":"2023-11-04T01:39:21.662579+0000","last_became_active":"2023-11-04T01:38:00.702550+0000","last_became_peered":"2023-11-04T01:38:00.702550+0000","last_unstale":"2023-11-04T01:39:21.662579+0000","last_undegraded":"2023-11-04T01:39:21.662579+0000","last_fullsized":"2023-11-04T01:39:21.662579+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001016077,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.672445+0000","last_change":"2023-11-04T01:39:22.667084+0000","last_active":"2023-11-04T01:39:22.672445+0000","last_peered":"2023-11-04T01:39:22.672445+0000","last_clean":"2023-11-04T01:39:22.672445+0000","last_became_active":"2023-11-04T01:39:22.666239+0000","last_became_peered":"2023-11-04T01:39:22.666239+0000","last_unstale":"2023-11-04T01:39:22.672445+0000","last_undegraded":"2023-11-04T01:39:22.672445+0000","last_fullsized":"2023-11-04T01:39:22.672445+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:50.841605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.665412+0000","last_change":"2023-11-04T01:39:21.672578+0000","last_active":"2023-11-04T01:39:22.665412+0000","last_peered":"2023-11-04T01:39:22.665412+0000","last_clean":"2023-11-04T01:39:22.665412+0000","last_became_active":"2023-11-04T01:39:21.672265+0000","last_became_peered":"2023-11-04T01:39:21.672265+0000","last_unstale":"2023-11-04T01:39:22.665412+0000","last_undegraded":"2023-11-04T01:39:22.665412+0000","last_fullsized":"2023-11-04T01:39:22.665412+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:15:23.377046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662096+0000","last_change":"2023-11-04T01:39:00.905979+0000","last_active":"2023-11-04T01:39:21.662096+0000","last_peered":"2023-11-04T01:39:21.662096+0000","last_clean":"2023-11-04T01:39:21.662096+0000","last_became_active":"2023-11-04T01:39:00.905741+0000","last_became_peered":"2023-11-04T01:39:00.905741+0000","last_unstale":"2023-11-04T01:39:21.662096+0000","last_undegraded":"2023-11-04T01:39:21.662096+0000","last_fullsized":"2023-11-04T01:39:21.662096+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:29.058403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662410+0000","last_change":"2023-11-04T01:39:01.898934+0000","last_active":"2023-11-04T01:39:21.662410+0000","last_peered":"2023-11-04T01:39:21.662410+0000","last_clean":"2023-11-04T01:39:21.662410+0000","last_became_active":"2023-11-04T01:38:59.895023+0000","last_became_peered":"2023-11-04T01:38:59.895023+0000","last_unstale":"2023-11-04T01:39:21.662410+0000","last_undegraded":"2023-11-04T01:39:21.662410+0000","last_fullsized":"2023-11-04T01:39:21.662410+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:50.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091724099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661021+0000","last_change":"2023-11-04T01:38:01.984764+0000","last_active":"2023-11-04T01:39:21.661021+0000","last_peered":"2023-11-04T01:39:21.661021+0000","last_clean":"2023-11-04T01:39:21.661021+0000","last_became_active":"2023-11-04T01:38:00.709894+0000","last_became_peered":"2023-11-04T01:38:00.709894+0000","last_unstale":"2023-11-04T01:39:21.661021+0000","last_undegraded":"2023-11-04T01:39:21.661021+0000","last_fullsized":"2023-11-04T01:39:21.661021+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:08:42.829255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045046799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.690468+0000","last_change":"2023-11-04T01:39:22.683335+0000","last_active":"2023-11-04T01:39:22.690468+0000","last_peered":"2023-11-04T01:39:22.690468+0000","last_clean":"2023-11-04T01:39:22.690468+0000","last_became_active":"2023-11-04T01:39:22.683091+0000","last_became_peered":"2023-11-04T01:39:22.683091+0000","last_unstale":"2023-11-04T01:39:22.690468+0000","last_undegraded":"2023-11-04T01:39:22.690468+0000","last_fullsized":"2023-11-04T01:39:22.690468+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:54:56.699605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.689171+0000","last_change":"2023-11-04T01:39:21.665094+0000","last_active":"2023-11-04T01:39:22.689171+0000","last_peered":"2023-11-04T01:39:22.689171+0000","last_clean":"2023-11-04T01:39:22.689171+0000","last_became_active":"2023-11-04T01:39:21.664770+0000","last_became_peered":"2023-11-04T01:39:21.664770+0000","last_unstale":"2023-11-04T01:39:22.689171+0000","last_undegraded":"2023-11-04T01:39:22.689171+0000","last_fullsized":"2023-11-04T01:39:22.689171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:24.724420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662480+0000","last_change":"2023-11-04T01:39:00.902634+0000","last_active":"2023-11-04T01:39:21.662480+0000","last_peered":"2023-11-04T01:39:21.662480+0000","last_clean":"2023-11-04T01:39:21.662480+0000","last_became_active":"2023-11-04T01:39:00.902174+0000","last_became_peered":"2023-11-04T01:39:00.902174+0000","last_unstale":"2023-11-04T01:39:21.662480+0000","last_undegraded":"2023-11-04T01:39:21.662480+0000","last_fullsized":"2023-11-04T01:39:21.662480+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:49.057663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662929+0000","last_change":"2023-11-04T01:39:01.899198+0000","last_active":"2023-11-04T01:39:21.662929+0000","last_peered":"2023-11-04T01:39:21.662929+0000","last_clean":"2023-11-04T01:39:21.662929+0000","last_became_active":"2023-11-04T01:38:59.893842+0000","last_became_peered":"2023-11-04T01:38:59.893842+0000","last_unstale":"2023-11-04T01:39:21.662929+0000","last_undegraded":"2023-11-04T01:39:21.662929+0000","last_fullsized":"2023-11-04T01:39:21.662929+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:05.228427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089883699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.658064+0000","last_change":"2023-11-04T01:38:02.321871+0000","last_active":"2023-11-04T01:39:21.658064+0000","last_peered":"2023-11-04T01:39:21.658064+0000","last_clean":"2023-11-04T01:39:21.658064+0000","last_became_active":"2023-11-04T01:38:00.708407+0000","last_became_peered":"2023-11-04T01:38:00.708407+0000","last_unstale":"2023-11-04T01:39:21.658064+0000","last_undegraded":"2023-11-04T01:39:21.658064+0000","last_fullsized":"2023-11-04T01:39:21.658064+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:48.672429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032387200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683735+0000","last_change":"2023-11-04T01:39:22.669226+0000","last_active":"2023-11-04T01:39:22.683735+0000","last_peered":"2023-11-04T01:39:22.683735+0000","last_clean":"2023-11-04T01:39:22.683735+0000","last_became_active":"2023-11-04T01:39:22.668915+0000","last_became_peered":"2023-11-04T01:39:22.668915+0000","last_unstale":"2023-11-04T01:39:22.683735+0000","last_undegraded":"2023-11-04T01:39:22.683735+0000","last_fullsized":"2023-11-04T01:39:22.683735+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:44.985565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.659968+0000","last_change":"2023-11-04T01:39:21.671540+0000","last_active":"2023-11-04T01:39:22.659968+0000","last_peered":"2023-11-04T01:39:22.659968+0000","last_clean":"2023-11-04T01:39:22.659968+0000","last_became_active":"2023-11-04T01:39:21.671205+0000","last_became_peered":"2023-11-04T01:39:21.671205+0000","last_unstale":"2023-11-04T01:39:22.659968+0000","last_undegraded":"2023-11-04T01:39:22.659968+0000","last_fullsized":"2023-11-04T01:39:22.659968+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:39.699903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.666284+0000","last_change":"2023-11-04T01:39:00.902561+0000","last_active":"2023-11-04T01:39:21.666284+0000","last_peered":"2023-11-04T01:39:21.666284+0000","last_clean":"2023-11-04T01:39:21.666284+0000","last_became_active":"2023-11-04T01:39:00.902203+0000","last_became_peered":"2023-11-04T01:39:00.902203+0000","last_unstale":"2023-11-04T01:39:21.666284+0000","last_undegraded":"2023-11-04T01:39:21.666284+0000","last_fullsized":"2023-11-04T01:39:21.666284+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:12.375847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661282+0000","last_change":"2023-11-04T01:39:01.896891+0000","last_active":"2023-11-04T01:39:21.661282+0000","last_peered":"2023-11-04T01:39:21.661282+0000","last_clean":"2023-11-04T01:39:21.661282+0000","last_became_active":"2023-11-04T01:38:59.894385+0000","last_became_peered":"2023-11-04T01:38:59.894385+0000","last_unstale":"2023-11-04T01:39:21.661282+0000","last_undegraded":"2023-11-04T01:39:21.661282+0000","last_fullsized":"2023-11-04T01:39:21.661282+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:36:07.725905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084524899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661351+0000","last_change":"2023-11-04T01:38:01.983988+0000","last_active":"2023-11-04T01:39:21.661351+0000","last_peered":"2023-11-04T01:39:21.661351+0000","last_clean":"2023-11-04T01:39:21.661351+0000","last_became_active":"2023-11-04T01:38:00.711020+0000","last_became_peered":"2023-11-04T01:38:00.711020+0000","last_unstale":"2023-11-04T01:39:21.661351+0000","last_undegraded":"2023-11-04T01:39:21.661351+0000","last_fullsized":"2023-11-04T01:39:21.661351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:06.374078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.678778+0000","last_change":"2023-11-04T01:39:22.676138+0000","last_active":"2023-11-04T01:39:22.678778+0000","last_peered":"2023-11-04T01:39:22.678778+0000","last_clean":"2023-11-04T01:39:22.678778+0000","last_became_active":"2023-11-04T01:39:22.675833+0000","last_became_peered":"2023-11-04T01:39:22.675833+0000","last_unstale":"2023-11-04T01:39:22.678778+0000","last_undegraded":"2023-11-04T01:39:22.678778+0000","last_fullsized":"2023-11-04T01:39:22.678778+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:54:04.782313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.661914+0000","last_change":"2023-11-04T01:39:21.671744+0000","last_active":"2023-11-04T01:39:22.661914+0000","last_peered":"2023-11-04T01:39:22.661914+0000","last_clean":"2023-11-04T01:39:22.661914+0000","last_became_active":"2023-11-04T01:39:21.671496+0000","last_became_peered":"2023-11-04T01:39:21.671496+0000","last_unstale":"2023-11-04T01:39:22.661914+0000","last_undegraded":"2023-11-04T01:39:22.661914+0000","last_fullsized":"2023-11-04T01:39:22.661914+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:26:36.460122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.657023+0000","last_change":"2023-11-04T01:39:00.902481+0000","last_active":"2023-11-04T01:39:21.657023+0000","last_peered":"2023-11-04T01:39:21.657023+0000","last_clean":"2023-11-04T01:39:21.657023+0000","last_became_active":"2023-11-04T01:39:00.902206+0000","last_became_peered":"2023-11-04T01:39:00.902206+0000","last_unstale":"2023-11-04T01:39:21.657023+0000","last_undegraded":"2023-11-04T01:39:21.657023+0000","last_fullsized":"2023-11-04T01:39:21.657023+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:49.996214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.666480+0000","last_change":"2023-11-04T01:39:02.076608+0000","last_active":"2023-11-04T01:39:21.666480+0000","last_peered":"2023-11-04T01:39:21.666480+0000","last_clean":"2023-11-04T01:39:21.666480+0000","last_became_active":"2023-11-04T01:38:59.892104+0000","last_became_peered":"2023-11-04T01:38:59.892104+0000","last_unstale":"2023-11-04T01:39:21.666480+0000","last_undegraded":"2023-11-04T01:39:21.666480+0000","last_fullsized":"2023-11-04T01:39:21.666480+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:15.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063915499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.657586+0000","last_change":"2023-11-04T01:38:02.321641+0000","last_active":"2023-11-04T01:39:21.657586+0000","last_peered":"2023-11-04T01:39:21.657586+0000","last_clean":"2023-11-04T01:39:21.657586+0000","last_became_active":"2023-11-04T01:38:00.706199+0000","last_became_peered":"2023-11-04T01:38:00.706199+0000","last_unstale":"2023-11-04T01:39:21.657586+0000","last_undegraded":"2023-11-04T01:39:21.657586+0000","last_fullsized":"2023-11-04T01:39:21.657586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:15.138325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045080400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683105+0000","last_change":"2023-11-04T01:39:22.682185+0000","last_active":"2023-11-04T01:39:22.683105+0000","last_peered":"2023-11-04T01:39:22.683105+0000","last_clean":"2023-11-04T01:39:22.683105+0000","last_became_active":"2023-11-04T01:39:22.680316+0000","last_became_peered":"2023-11-04T01:39:22.680316+0000","last_unstale":"2023-11-04T01:39:22.683105+0000","last_undegraded":"2023-11-04T01:39:22.683105+0000","last_fullsized":"2023-11-04T01:39:22.683105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:38.590666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.660972+0000","last_change":"2023-11-04T01:39:21.673727+0000","last_active":"2023-11-04T01:39:22.660972+0000","last_peered":"2023-11-04T01:39:22.660972+0000","last_clean":"2023-11-04T01:39:22.660972+0000","last_became_active":"2023-11-04T01:39:21.673415+0000","last_became_peered":"2023-11-04T01:39:21.673415+0000","last_unstale":"2023-11-04T01:39:22.660972+0000","last_undegraded":"2023-11-04T01:39:22.660972+0000","last_fullsized":"2023-11-04T01:39:22.660972+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:38:51.680108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662793+0000","last_change":"2023-11-04T01:39:00.906469+0000","last_active":"2023-11-04T01:39:21.662793+0000","last_peered":"2023-11-04T01:39:21.662793+0000","last_clean":"2023-11-04T01:39:21.662793+0000","last_became_active":"2023-11-04T01:39:00.905872+0000","last_became_peered":"2023-11-04T01:39:00.905872+0000","last_unstale":"2023-11-04T01:39:21.662793+0000","last_undegraded":"2023-11-04T01:39:21.662793+0000","last_fullsized":"2023-11-04T01:39:21.662793+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:32.767818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664128+0000","last_change":"2023-11-04T01:39:01.897198+0000","last_active":"2023-11-04T01:39:21.664128+0000","last_peered":"2023-11-04T01:39:21.664128+0000","last_clean":"2023-11-04T01:39:21.664128+0000","last_became_active":"2023-11-04T01:38:59.884103+0000","last_became_peered":"2023-11-04T01:38:59.884103+0000","last_unstale":"2023-11-04T01:39:21.664128+0000","last_undegraded":"2023-11-04T01:39:21.664128+0000","last_fullsized":"2023-11-04T01:39:21.664128+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:07.268618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074876599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654961+0000","last_change":"2023-11-04T01:38:02.156148+0000","last_active":"2023-11-04T01:39:21.654961+0000","last_peered":"2023-11-04T01:39:21.654961+0000","last_clean":"2023-11-04T01:39:21.654961+0000","last_became_active":"2023-11-04T01:38:00.708352+0000","last_became_peered":"2023-11-04T01:38:00.708352+0000","last_unstale":"2023-11-04T01:39:21.654961+0000","last_undegraded":"2023-11-04T01:39:21.654961+0000","last_fullsized":"2023-11-04T01:39:21.654961+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035716799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.679080+0000","last_change":"2023-11-04T01:39:22.676843+0000","last_active":"2023-11-04T01:39:22.679080+0000","last_peered":"2023-11-04T01:39:22.679080+0000","last_clean":"2023-11-04T01:39:22.679080+0000","last_became_active":"2023-11-04T01:39:22.676591+0000","last_became_peered":"2023-11-04T01:39:22.676591+0000","last_unstale":"2023-11-04T01:39:22.679080+0000","last_undegraded":"2023-11-04T01:39:22.679080+0000","last_fullsized":"2023-11-04T01:39:22.679080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:00:14.765974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.663799+0000","last_change":"2023-11-04T01:39:21.671653+0000","last_active":"2023-11-04T01:39:22.663799+0000","last_peered":"2023-11-04T01:39:22.663799+0000","last_clean":"2023-11-04T01:39:22.663799+0000","last_became_active":"2023-11-04T01:39:21.671407+0000","last_became_peered":"2023-11-04T01:39:21.671407+0000","last_unstale":"2023-11-04T01:39:22.663799+0000","last_undegraded":"2023-11-04T01:39:22.663799+0000","last_fullsized":"2023-11-04T01:39:22.663799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:53.922190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662583+0000","last_change":"2023-11-04T01:39:00.905021+0000","last_active":"2023-11-04T01:39:21.662583+0000","last_peered":"2023-11-04T01:39:21.662583+0000","last_clean":"2023-11-04T01:39:21.662583+0000","last_became_active":"2023-11-04T01:39:00.904730+0000","last_became_peered":"2023-11-04T01:39:00.904730+0000","last_unstale":"2023-11-04T01:39:21.662583+0000","last_undegraded":"2023-11-04T01:39:21.662583+0000","last_fullsized":"2023-11-04T01:39:21.662583+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:28.746335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662550+0000","last_change":"2023-11-04T01:39:01.897770+0000","last_active":"2023-11-04T01:39:21.662550+0000","last_peered":"2023-11-04T01:39:21.662550+0000","last_clean":"2023-11-04T01:39:21.662550+0000","last_became_active":"2023-11-04T01:38:59.894386+0000","last_became_peered":"2023-11-04T01:38:59.894386+0000","last_unstale":"2023-11-04T01:39:21.662550+0000","last_undegraded":"2023-11-04T01:39:21.662550+0000","last_fullsized":"2023-11-04T01:39:21.662550+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:20.259857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069590400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.660729+0000","last_change":"2023-11-04T01:38:01.939729+0000","last_active":"2023-11-04T01:39:21.660729+0000","last_peered":"2023-11-04T01:39:21.660729+0000","last_clean":"2023-11-04T01:39:21.660729+0000","last_became_active":"2023-11-04T01:38:00.704384+0000","last_became_peered":"2023-11-04T01:38:00.704384+0000","last_unstale":"2023-11-04T01:39:21.660729+0000","last_undegraded":"2023-11-04T01:39:21.660729+0000","last_fullsized":"2023-11-04T01:39:21.660729+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080052200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.685308+0000","last_change":"2023-11-04T01:39:22.679391+0000","last_active":"2023-11-04T01:39:22.685308+0000","last_peered":"2023-11-04T01:39:22.685308+0000","last_clean":"2023-11-04T01:39:22.685308+0000","last_became_active":"2023-11-04T01:39:22.679128+0000","last_became_peered":"2023-11-04T01:39:22.679128+0000","last_unstale":"2023-11-04T01:39:22.685308+0000","last_undegraded":"2023-11-04T01:39:22.685308+0000","last_fullsized":"2023-11-04T01:39:22.685308+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:29.339900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.665568+0000","last_change":"2023-11-04T01:39:21.677236+0000","last_active":"2023-11-04T01:39:22.665568+0000","last_peered":"2023-11-04T01:39:22.665568+0000","last_clean":"2023-11-04T01:39:22.665568+0000","last_became_active":"2023-11-04T01:39:21.676940+0000","last_became_peered":"2023-11-04T01:39:21.676940+0000","last_unstale":"2023-11-04T01:39:22.665568+0000","last_undegraded":"2023-11-04T01:39:22.665568+0000","last_fullsized":"2023-11-04T01:39:22.665568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:42:39.284455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664553+0000","last_change":"2023-11-04T01:39:00.904930+0000","last_active":"2023-11-04T01:39:21.664553+0000","last_peered":"2023-11-04T01:39:21.664553+0000","last_clean":"2023-11-04T01:39:21.664553+0000","last_became_active":"2023-11-04T01:39:00.904645+0000","last_became_peered":"2023-11-04T01:39:00.904645+0000","last_unstale":"2023-11-04T01:39:21.664553+0000","last_undegraded":"2023-11-04T01:39:21.664553+0000","last_fullsized":"2023-11-04T01:39:21.664553+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:14.894198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664384+0000","last_change":"2023-11-04T01:39:02.076751+0000","last_active":"2023-11-04T01:39:21.664384+0000","last_peered":"2023-11-04T01:39:21.664384+0000","last_clean":"2023-11-04T01:39:21.664384+0000","last_became_active":"2023-11-04T01:38:59.887859+0000","last_became_peered":"2023-11-04T01:38:59.887859+0000","last_unstale":"2023-11-04T01:39:21.664384+0000","last_undegraded":"2023-11-04T01:39:21.664384+0000","last_fullsized":"2023-11-04T01:39:21.664384+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:42.452480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057159799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.666030+0000","last_change":"2023-11-04T01:38:01.697272+0000","last_active":"2023-11-04T01:39:21.666030+0000","last_peered":"2023-11-04T01:39:21.666030+0000","last_clean":"2023-11-04T01:39:21.666030+0000","last_became_active":"2023-11-04T01:38:00.709395+0000","last_became_peered":"2023-11-04T01:38:00.709395+0000","last_unstale":"2023-11-04T01:39:21.666030+0000","last_undegraded":"2023-11-04T01:39:21.666030+0000","last_fullsized":"2023-11-04T01:39:21.666030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076665499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.687941+0000","last_change":"2023-11-04T01:39:22.684791+0000","last_active":"2023-11-04T01:39:22.687941+0000","last_peered":"2023-11-04T01:39:22.687941+0000","last_clean":"2023-11-04T01:39:22.687941+0000","last_became_active":"2023-11-04T01:39:22.684526+0000","last_became_peered":"2023-11-04T01:39:22.684526+0000","last_unstale":"2023-11-04T01:39:22.687941+0000","last_undegraded":"2023-11-04T01:39:22.687941+0000","last_fullsized":"2023-11-04T01:39:22.687941+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:28.975278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.688255+0000","last_change":"2023-11-04T01:39:21.665663+0000","last_active":"2023-11-04T01:39:22.688255+0000","last_peered":"2023-11-04T01:39:22.688255+0000","last_clean":"2023-11-04T01:39:22.688255+0000","last_became_active":"2023-11-04T01:39:21.665263+0000","last_became_peered":"2023-11-04T01:39:21.665263+0000","last_unstale":"2023-11-04T01:39:22.688255+0000","last_undegraded":"2023-11-04T01:39:22.688255+0000","last_fullsized":"2023-11-04T01:39:22.688255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:00.089969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.665412+0000","last_change":"2023-11-04T01:39:00.904589+0000","last_active":"2023-11-04T01:39:21.665412+0000","last_peered":"2023-11-04T01:39:21.665412+0000","last_clean":"2023-11-04T01:39:21.665412+0000","last_became_active":"2023-11-04T01:39:00.904277+0000","last_became_peered":"2023-11-04T01:39:00.904277+0000","last_unstale":"2023-11-04T01:39:21.665412+0000","last_undegraded":"2023-11-04T01:39:21.665412+0000","last_fullsized":"2023-11-04T01:39:21.665412+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:43.457960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664464+0000","last_change":"2023-11-04T01:39:01.899561+0000","last_active":"2023-11-04T01:39:21.664464+0000","last_peered":"2023-11-04T01:39:21.664464+0000","last_clean":"2023-11-04T01:39:21.664464+0000","last_became_active":"2023-11-04T01:38:59.886002+0000","last_became_peered":"2023-11-04T01:38:59.886002+0000","last_unstale":"2023-11-04T01:39:21.664464+0000","last_undegraded":"2023-11-04T01:39:21.664464+0000","last_fullsized":"2023-11-04T01:39:21.664464+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:06:48.983584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061693100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662719+0000","last_change":"2023-11-04T01:38:01.984567+0000","last_active":"2023-11-04T01:39:21.662719+0000","last_peered":"2023-11-04T01:39:21.662719+0000","last_clean":"2023-11-04T01:39:21.662719+0000","last_became_active":"2023-11-04T01:38:00.708020+0000","last_became_peered":"2023-11-04T01:38:00.708020+0000","last_unstale":"2023-11-04T01:39:21.662719+0000","last_undegraded":"2023-11-04T01:39:21.662719+0000","last_fullsized":"2023-11-04T01:39:21.662719+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:09.638146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056906299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683639+0000","last_change":"2023-11-04T01:39:22.676021+0000","last_active":"2023-11-04T01:39:22.683639+0000","last_peered":"2023-11-04T01:39:22.683639+0000","last_clean":"2023-11-04T01:39:22.683639+0000","last_became_active":"2023-11-04T01:39:22.675736+0000","last_became_peered":"2023-11-04T01:39:22.675736+0000","last_unstale":"2023-11-04T01:39:22.683639+0000","last_undegraded":"2023-11-04T01:39:22.683639+0000","last_fullsized":"2023-11-04T01:39:22.683639+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:53.717057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.690743+0000","last_change":"2023-11-04T01:39:21.670093+0000","last_active":"2023-11-04T01:39:22.690743+0000","last_peered":"2023-11-04T01:39:22.690743+0000","last_clean":"2023-11-04T01:39:22.690743+0000","last_became_active":"2023-11-04T01:39:21.669807+0000","last_became_peered":"2023-11-04T01:39:21.669807+0000","last_unstale":"2023-11-04T01:39:22.690743+0000","last_undegraded":"2023-11-04T01:39:22.690743+0000","last_fullsized":"2023-11-04T01:39:22.690743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:37.205057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662174+0000","last_change":"2023-11-04T01:39:00.902975+0000","last_active":"2023-11-04T01:39:21.662174+0000","last_peered":"2023-11-04T01:39:21.662174+0000","last_clean":"2023-11-04T01:39:21.662174+0000","last_became_active":"2023-11-04T01:39:00.902732+0000","last_became_peered":"2023-11-04T01:39:00.902732+0000","last_unstale":"2023-11-04T01:39:21.662174+0000","last_undegraded":"2023-11-04T01:39:21.662174+0000","last_fullsized":"2023-11-04T01:39:21.662174+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:21.265338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662565+0000","last_change":"2023-11-04T01:39:02.076570+0000","last_active":"2023-11-04T01:39:21.662565+0000","last_peered":"2023-11-04T01:39:21.662565+0000","last_clean":"2023-11-04T01:39:21.662565+0000","last_became_active":"2023-11-04T01:38:59.886841+0000","last_became_peered":"2023-11-04T01:38:59.886841+0000","last_unstale":"2023-11-04T01:39:21.662565+0000","last_undegraded":"2023-11-04T01:39:21.662565+0000","last_fullsized":"2023-11-04T01:39:21.662565+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:27.740854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064312500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664798+0000","last_change":"2023-11-04T01:38:01.699685+0000","last_active":"2023-11-04T01:39:21.664798+0000","last_peered":"2023-11-04T01:39:21.664798+0000","last_clean":"2023-11-04T01:39:21.664798+0000","last_became_active":"2023-11-04T01:38:00.706802+0000","last_became_peered":"2023-11-04T01:38:00.706802+0000","last_unstale":"2023-11-04T01:39:21.664798+0000","last_undegraded":"2023-11-04T01:39:21.664798+0000","last_fullsized":"2023-11-04T01:39:21.664798+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085845400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.683755+0000","last_change":"2023-11-04T01:39:22.670527+0000","last_active":"2023-11-04T01:39:22.683755+0000","last_peered":"2023-11-04T01:39:22.683755+0000","last_clean":"2023-11-04T01:39:22.683755+0000","last_became_active":"2023-11-04T01:39:22.670065+0000","last_became_peered":"2023-11-04T01:39:22.670065+0000","last_unstale":"2023-11-04T01:39:22.683755+0000","last_undegraded":"2023-11-04T01:39:22.683755+0000","last_fullsized":"2023-11-04T01:39:22.683755+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:30.293028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.664054+0000","last_change":"2023-11-04T01:39:21.672384+0000","last_active":"2023-11-04T01:39:22.664054+0000","last_peered":"2023-11-04T01:39:22.664054+0000","last_clean":"2023-11-04T01:39:22.664054+0000","last_became_active":"2023-11-04T01:39:21.671973+0000","last_became_peered":"2023-11-04T01:39:21.671973+0000","last_unstale":"2023-11-04T01:39:22.664054+0000","last_undegraded":"2023-11-04T01:39:22.664054+0000","last_fullsized":"2023-11-04T01:39:22.664054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:52:06.433799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.657001+0000","last_change":"2023-11-04T01:39:00.904110+0000","last_active":"2023-11-04T01:39:21.657001+0000","last_peered":"2023-11-04T01:39:21.657001+0000","last_clean":"2023-11-04T01:39:21.657001+0000","last_became_active":"2023-11-04T01:39:00.903820+0000","last_became_peered":"2023-11-04T01:39:00.903820+0000","last_unstale":"2023-11-04T01:39:21.657001+0000","last_undegraded":"2023-11-04T01:39:21.657001+0000","last_fullsized":"2023-11-04T01:39:21.657001+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:06:49.989064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.658720+0000","last_change":"2023-11-04T01:39:02.370981+0000","last_active":"2023-11-04T01:39:21.658720+0000","last_peered":"2023-11-04T01:39:21.658720+0000","last_clean":"2023-11-04T01:39:21.658720+0000","last_became_active":"2023-11-04T01:38:59.893000+0000","last_became_peered":"2023-11-04T01:38:59.893000+0000","last_unstale":"2023-11-04T01:39:21.658720+0000","last_undegraded":"2023-11-04T01:39:21.658720+0000","last_fullsized":"2023-11-04T01:39:21.658720+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:10.350371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065268599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.661885+0000","last_change":"2023-11-04T01:38:01.700399+0000","last_active":"2023-11-04T01:39:21.661885+0000","last_peered":"2023-11-04T01:39:21.661885+0000","last_clean":"2023-11-04T01:39:21.661885+0000","last_became_active":"2023-11-04T01:38:00.701352+0000","last_became_peered":"2023-11-04T01:38:00.701352+0000","last_unstale":"2023-11-04T01:39:21.661885+0000","last_undegraded":"2023-11-04T01:39:21.661885+0000","last_fullsized":"2023-11-04T01:39:21.661885+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078589399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.672498+0000","last_change":"2023-11-04T01:39:22.668564+0000","last_active":"2023-11-04T01:39:22.672498+0000","last_peered":"2023-11-04T01:39:22.672498+0000","last_clean":"2023-11-04T01:39:22.672498+0000","last_became_active":"2023-11-04T01:39:22.668281+0000","last_became_peered":"2023-11-04T01:39:22.668281+0000","last_unstale":"2023-11-04T01:39:22.672498+0000","last_undegraded":"2023-11-04T01:39:22.672498+0000","last_fullsized":"2023-11-04T01:39:22.672498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:45.683893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.673490+0000","last_change":"2023-11-04T01:39:21.668453+0000","last_active":"2023-11-04T01:39:22.673490+0000","last_peered":"2023-11-04T01:39:22.673490+0000","last_clean":"2023-11-04T01:39:22.673490+0000","last_became_active":"2023-11-04T01:39:21.668129+0000","last_became_peered":"2023-11-04T01:39:21.668129+0000","last_unstale":"2023-11-04T01:39:22.673490+0000","last_undegraded":"2023-11-04T01:39:22.673490+0000","last_fullsized":"2023-11-04T01:39:22.673490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:52.708183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.658771+0000","last_change":"2023-11-04T01:39:00.902993+0000","last_active":"2023-11-04T01:39:21.658771+0000","last_peered":"2023-11-04T01:39:21.658771+0000","last_clean":"2023-11-04T01:39:21.658771+0000","last_became_active":"2023-11-04T01:39:00.902704+0000","last_became_peered":"2023-11-04T01:39:00.902704+0000","last_unstale":"2023-11-04T01:39:21.658771+0000","last_undegraded":"2023-11-04T01:39:21.658771+0000","last_fullsized":"2023-11-04T01:39:21.658771+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:38.313962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.659198+0000","last_change":"2023-11-04T01:39:02.039353+0000","last_active":"2023-11-04T01:39:21.659198+0000","last_peered":"2023-11-04T01:39:21.659198+0000","last_clean":"2023-11-04T01:39:21.659198+0000","last_became_active":"2023-11-04T01:38:59.897877+0000","last_became_peered":"2023-11-04T01:38:59.897877+0000","last_unstale":"2023-11-04T01:39:21.659198+0000","last_undegraded":"2023-11-04T01:39:21.659198+0000","last_fullsized":"2023-11-04T01:39:21.659198+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:13:39.795522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000482974,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.655878+0000","last_change":"2023-11-04T01:38:02.362072+0000","last_active":"2023-11-04T01:39:21.655878+0000","last_peered":"2023-11-04T01:39:21.655878+0000","last_clean":"2023-11-04T01:39:21.655878+0000","last_became_active":"2023-11-04T01:38:00.710897+0000","last_became_peered":"2023-11-04T01:38:00.710897+0000","last_unstale":"2023-11-04T01:39:21.655878+0000","last_undegraded":"2023-11-04T01:39:21.655878+0000","last_fullsized":"2023-11-04T01:39:21.655878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:25.229838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058055900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.678088+0000","last_change":"2023-11-04T01:39:22.673323+0000","last_active":"2023-11-04T01:39:22.678088+0000","last_peered":"2023-11-04T01:39:22.678088+0000","last_clean":"2023-11-04T01:39:22.678088+0000","last_became_active":"2023-11-04T01:39:22.672234+0000","last_became_peered":"2023-11-04T01:39:22.672234+0000","last_unstale":"2023-11-04T01:39:22.678088+0000","last_undegraded":"2023-11-04T01:39:22.678088+0000","last_fullsized":"2023-11-04T01:39:22.678088+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:03:42.431745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.672498+0000","last_change":"2023-11-04T01:39:21.671402+0000","last_active":"2023-11-04T01:39:22.672498+0000","last_peered":"2023-11-04T01:39:22.672498+0000","last_clean":"2023-11-04T01:39:22.672498+0000","last_became_active":"2023-11-04T01:39:21.671180+0000","last_became_peered":"2023-11-04T01:39:21.671180+0000","last_unstale":"2023-11-04T01:39:22.672498+0000","last_undegraded":"2023-11-04T01:39:22.672498+0000","last_fullsized":"2023-11-04T01:39:22.672498+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:36.388782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.655788+0000","last_change":"2023-11-04T01:39:00.901761+0000","last_active":"2023-11-04T01:39:21.655788+0000","last_peered":"2023-11-04T01:39:21.655788+0000","last_clean":"2023-11-04T01:39:21.655788+0000","last_became_active":"2023-11-04T01:39:00.901485+0000","last_became_peered":"2023-11-04T01:39:00.901485+0000","last_unstale":"2023-11-04T01:39:21.655788+0000","last_undegraded":"2023-11-04T01:39:21.655788+0000","last_fullsized":"2023-11-04T01:39:21.655788+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:37.511499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.660122+0000","last_change":"2023-11-04T01:39:02.038972+0000","last_active":"2023-11-04T01:39:21.660122+0000","last_peered":"2023-11-04T01:39:21.660122+0000","last_clean":"2023-11-04T01:39:21.660122+0000","last_became_active":"2023-11-04T01:38:59.897966+0000","last_became_peered":"2023-11-04T01:38:59.897966+0000","last_unstale":"2023-11-04T01:39:21.660122+0000","last_undegraded":"2023-11-04T01:39:21.660122+0000","last_fullsized":"2023-11-04T01:39:21.660122+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:30.928374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041155899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.659272+0000","last_change":"2023-11-04T01:38:01.939857+0000","last_active":"2023-11-04T01:39:21.659272+0000","last_peered":"2023-11-04T01:39:21.659272+0000","last_clean":"2023-11-04T01:39:21.659272+0000","last_became_active":"2023-11-04T01:38:00.701371+0000","last_became_peered":"2023-11-04T01:38:00.701371+0000","last_unstale":"2023-11-04T01:39:21.659272+0000","last_undegraded":"2023-11-04T01:39:21.659272+0000","last_fullsized":"2023-11-04T01:39:21.659272+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078632099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.678282+0000","last_change":"2023-11-04T01:39:22.673038+0000","last_active":"2023-11-04T01:39:22.678282+0000","last_peered":"2023-11-04T01:39:22.678282+0000","last_clean":"2023-11-04T01:39:22.678282+0000","last_became_active":"2023-11-04T01:39:22.668969+0000","last_became_peered":"2023-11-04T01:39:22.668969+0000","last_unstale":"2023-11-04T01:39:22.678282+0000","last_undegraded":"2023-11-04T01:39:22.678282+0000","last_fullsized":"2023-11-04T01:39:22.678282+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:56.555393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.690377+0000","last_change":"2023-11-04T01:39:21.672574+0000","last_active":"2023-11-04T01:39:22.690377+0000","last_peered":"2023-11-04T01:39:22.690377+0000","last_clean":"2023-11-04T01:39:22.690377+0000","last_became_active":"2023-11-04T01:39:21.672291+0000","last_became_peered":"2023-11-04T01:39:21.672291+0000","last_unstale":"2023-11-04T01:39:22.690377+0000","last_undegraded":"2023-11-04T01:39:22.690377+0000","last_fullsized":"2023-11-04T01:39:22.690377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:15:30.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.657464+0000","last_change":"2023-11-04T01:39:00.901396+0000","last_active":"2023-11-04T01:39:21.657464+0000","last_peered":"2023-11-04T01:39:21.657464+0000","last_clean":"2023-11-04T01:39:21.657464+0000","last_became_active":"2023-11-04T01:39:00.901094+0000","last_became_peered":"2023-11-04T01:39:00.901094+0000","last_unstale":"2023-11-04T01:39:21.657464+0000","last_undegraded":"2023-11-04T01:39:21.657464+0000","last_fullsized":"2023-11-04T01:39:21.657464+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:48.475869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.656869+0000","last_change":"2023-11-04T01:39:02.370014+0000","last_active":"2023-11-04T01:39:21.656869+0000","last_peered":"2023-11-04T01:39:21.656869+0000","last_clean":"2023-11-04T01:39:21.656869+0000","last_became_active":"2023-11-04T01:38:59.893020+0000","last_became_peered":"2023-11-04T01:38:59.893020+0000","last_unstale":"2023-11-04T01:39:21.656869+0000","last_undegraded":"2023-11-04T01:39:21.656869+0000","last_fullsized":"2023-11-04T01:39:21.656869+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:32.037301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058077499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.660799+0000","last_change":"2023-11-04T01:38:01.939662+0000","last_active":"2023-11-04T01:39:21.660799+0000","last_peered":"2023-11-04T01:39:21.660799+0000","last_clean":"2023-11-04T01:39:21.660799+0000","last_became_active":"2023-11-04T01:38:00.705871+0000","last_became_peered":"2023-11-04T01:38:00.705871+0000","last_unstale":"2023-11-04T01:39:21.660799+0000","last_undegraded":"2023-11-04T01:39:21.660799+0000","last_fullsized":"2023-11-04T01:39:21.660799+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066873200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.674318+0000","last_change":"2023-11-04T01:39:22.671021+0000","last_active":"2023-11-04T01:39:22.674318+0000","last_peered":"2023-11-04T01:39:22.674318+0000","last_clean":"2023-11-04T01:39:22.674318+0000","last_became_active":"2023-11-04T01:39:22.670677+0000","last_became_peered":"2023-11-04T01:39:22.670677+0000","last_unstale":"2023-11-04T01:39:22.674318+0000","last_undegraded":"2023-11-04T01:39:22.674318+0000","last_fullsized":"2023-11-04T01:39:22.674318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:21.647440+0000","last_clean_scrub_stamp":"2023-11-04T01:39:21.647440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:31:21.783076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:39:22.686157+0000","last_change":"2023-11-04T01:39:21.674136+0000","last_active":"2023-11-04T01:39:22.686157+0000","last_peered":"2023-11-04T01:39:22.686157+0000","last_clean":"2023-11-04T01:39:22.686157+0000","last_became_active":"2023-11-04T01:39:21.673850+0000","last_became_peered":"2023-11-04T01:39:21.673850+0000","last_unstale":"2023-11-04T01:39:22.686157+0000","last_undegraded":"2023-11-04T01:39:22.686157+0000","last_fullsized":"2023-11-04T01:39:22.686157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:20.638566+0000","last_clean_scrub_stamp":"2023-11-04T01:39:20.638566+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:29.284155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.654253+0000","last_change":"2023-11-04T01:39:00.904488+0000","last_active":"2023-11-04T01:39:21.654253+0000","last_peered":"2023-11-04T01:39:21.654253+0000","last_clean":"2023-11-04T01:39:21.654253+0000","last_became_active":"2023-11-04T01:39:00.904234+0000","last_became_peered":"2023-11-04T01:39:00.904234+0000","last_unstale":"2023-11-04T01:39:21.654253+0000","last_undegraded":"2023-11-04T01:39:21.654253+0000","last_fullsized":"2023-11-04T01:39:21.654253+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:05:10.425461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664978+0000","last_change":"2023-11-04T01:39:01.896521+0000","last_active":"2023-11-04T01:39:21.664978+0000","last_peered":"2023-11-04T01:39:21.664978+0000","last_clean":"2023-11-04T01:39:21.664978+0000","last_became_active":"2023-11-04T01:38:59.890560+0000","last_became_peered":"2023-11-04T01:38:59.890560+0000","last_unstale":"2023-11-04T01:39:21.664978+0000","last_undegraded":"2023-11-04T01:39:21.664978+0000","last_fullsized":"2023-11-04T01:39:21.664978+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:14.608973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052638499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.664511+0000","last_change":"2023-11-04T01:38:01.984672+0000","last_active":"2023-11-04T01:39:21.664511+0000","last_peered":"2023-11-04T01:39:21.664511+0000","last_clean":"2023-11-04T01:39:21.664511+0000","last_became_active":"2023-11-04T01:38:00.706804+0000","last_became_peered":"2023-11-04T01:38:00.706804+0000","last_unstale":"2023-11-04T01:39:21.664511+0000","last_undegraded":"2023-11-04T01:39:21.664511+0000","last_fullsized":"2023-11-04T01:39:21.664511+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:48.412413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038439000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":219,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:39:21.662790+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:39:21.662790+0000","last_peered":"2023-11-04T01:39:21.662790+0000","last_clean":"2023-11-04T01:39:21.662790+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:39:21.662790+0000","last_undegraded":"2023-11-04T01:39:21.662790+0000","last_fullsized":"2023-11-04T01:39:21.662790+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1585152,"data_stored":1068081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.39200000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83299999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57399999999999995,"15min":0.56699999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.371,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.625,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.439,"5min":0.318,"15min":0.318},"max":{"1min":0.79200000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61399999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.40500000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.64900000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.40899999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.40799999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.44600000000000001,"15min":0.433},"min":{"1min":0.35099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65300000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.47199999999999998,"15min":0.45200000000000001},"min":{"1min":0.33100000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.33100000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51100000000000001,"15min":0.498},"min":{"1min":0.38700000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65300000000000002,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.747,"5min":0.877,"15min":0.877},"last":0.442}]},{"osd":6,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.503,"15min":0.48399999999999999},"min":{"1min":0.34399999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.374},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.53200000000000003},"min":{"1min":0.40799999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68200000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.40799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":486523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.51200000000000001,"15min":0.499},"min":{"1min":0.375,"5min":0.214,"15min":0.214},"max":{"1min":0.70699999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70099999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72299999999999998,"5min":1.05,"15min":1.05},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.39400000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.41599999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.70499999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.68400000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52200000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.67500000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.41499999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.502,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.75,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.498,"15min":0.497},"min":{"1min":0.34899999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63800000000000001,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57399999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32900000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68300000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.5},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40500000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.72699999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55400000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73499999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67900000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.374}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":991232,"data_stored":477713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57199999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72499999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42499999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.74299999999999999,"5min":0.746,"15min":0.746},"last":0.44600000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48599999999999999,"15min":0.48899999999999999},"min":{"1min":0.30099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63800000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.498},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.35599999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.58699999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.40999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.37,"15min":0.37},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.60199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":477713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79500000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57699999999999996,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77700000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.38100000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65700000000000003,"5min":0.875,"15min":0.875},"last":0.371},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70299999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75700000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.40200000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70399999999999996,"5min":0.879,"15min":0.879},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.57799999999999996,"15min":0.59699999999999998},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.624,"5min":1.089,"15min":1.089},"last":0.498}]},{"osd":5,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.874,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.52400000000000002},"min":{"1min":0.35399999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.89500000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.42699999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81799999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.52800000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.42099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70899999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85399999999999998,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":991232,"data_stored":477713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.32200000000000001,"15min":0.32400000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.438},{"interface":"front","average":{"1min":0.316,"5min":0.314,"15min":0.314},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.41999999999999998,"5min":0.441,"15min":0.441},"last":0.34399999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.41699999999999998,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.24199999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.40600000000000003,"5min":0.502,"15min":0.502},"last":0.56899999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.29599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.442,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.371,"15min":0.375},"min":{"1min":0.27900000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.47599999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.432,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77800000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.625},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.50900000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.74299999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.443,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76400000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.69599999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.41999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.71899999999999997,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.42599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.46800000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.58599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":485871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.32500000000000001,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.442,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.33600000000000002,"15min":0.34300000000000003},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.39300000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.309}]},{"osd":1,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.48399999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.39100000000000001,"15min":0.40300000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.44,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.46700000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.40899999999999997,"15min":0.42099999999999999},"min":{"1min":0.26600000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.51500000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.42099999999999999,"15min":0.433},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.46999999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.63900000000000001,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.82399999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.45200000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.48599999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.68300000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.877,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.52500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.79700000000000004,"5min":1,"15min":1},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61199999999999999,"15min":0.62},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73099999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.5}]},{"osd":7,"last update":"Sat Nov 4 01:38:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.59899999999999998,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76200000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.61799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":991232,"data_stored":477713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39700000000000002,"15min":0.36199999999999999},"min":{"1min":0.23699999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.47699999999999998,"5min":5.415,"15min":5.415},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.41799999999999998,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52500000000000002,"5min":3.456,"15min":3.456},"last":0.35699999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.39400000000000002,"15min":0.39600000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.56399999999999995,"5min":2.355,"15min":2.355},"last":0.378},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.28299999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61499999999999999,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.308}]},{"osd":3,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.52200000000000002,"15min":0.46999999999999997},"min":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58099999999999996,"5min":8.891,"15min":8.891},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.46600000000000003,"15min":0.39600000000000002},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.54600000000000004,"5min":9.8889999999999993,"15min":9.8889999999999993},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63300000000000001,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76600000000000001,"5min":4.5720000000000001,"15min":4.5720000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59399999999999997,"15min":0.57599999999999996},"min":{"1min":0.45600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":0.68600000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.60099999999999998},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93100000000000005,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.872,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.68200000000000005,"15min":0.64600000000000002},"min":{"1min":0.48999999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82999999999999996,"5min":5.915,"15min":5.915},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1080000000000001,"5min":1.288,"15min":1.288},"last":0.60999999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.622,"15min":0.60599999999999998},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.84199999999999997,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66100000000000003,"15min":0.60599999999999998},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.93600000000000005,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.67300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1585152,"data_stored":1068081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.314,"15min":0.31},"min":{"1min":0.26500000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.374},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.221,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.49099999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.44}]},{"osd":2,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35999999999999999,"15min":0.36599999999999999},"min":{"1min":0.23899999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48599999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.23100000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.499,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.32300000000000001,"15min":0.317},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.376,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51800000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.42499999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81899999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68899999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.93000000000000005,"5min":0.996,"15min":0.996},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.72499999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.40500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90400000000000003,"5min":1.026,"15min":1.026},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.46000000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89000000000000001,"5min":1.177,"15min":1.177},"last":0.745}]},{"osd":7,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.443,"5min":0.374,"15min":0.374},"max":{"1min":0.85099999999999998,"5min":1.131,"15min":1.131},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:39:25.966 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:39:25.967 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:39:26.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.101+0000 7f70d5464640 1 Processor -- start 2023-11-04T01:39:26.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.101+0000 7f70d5464640 1 -- start start 2023-11-04T01:39:26.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.102+0000 7f70d5464640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f70d0159c00 0x7f70d00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.102+0000 7f70d5464640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d00c48e0 0x7f70d00c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.102+0000 7f70d5464640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70d00adac0 0x7f70d00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.102+0000 7f70d5464640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d00c52d0 con 0x7f70d00adac0 2023-11-04T01:39:26.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.102+0000 7f70d5464640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d015aff0 con 0x7f70d0159c00 2023-11-04T01:39:26.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.102+0000 7f70d5464640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00ae450 con 0x7f70d00c48e0 2023-11-04T01:39:26.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.102+0000 7f70cf7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70d00adac0 0x7f70d00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.102+0000 7f70cf7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70d00adac0 0x7f70d00adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33268/0 (socket says 172.21.15.114:33268) 2023-11-04T01:39:26.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.102+0000 7f70cf7fe640 1 -- 172.21.15.114:0/3698696547 learned_addr learned my addr 172.21.15.114:0/3698696547 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:26.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.102+0000 7f70cf7fe640 1 -- 172.21.15.114:0/3698696547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d00c48e0 msgr2=0x7f70d00c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:26.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.102+0000 7f70cf7fe640 1 --2- 172.21.15.114:0/3698696547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d00c48e0 0x7f70d00c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.102+0000 7f70cf7fe640 1 -- 172.21.15.114:0/3698696547 >> v2:172.21.15.141:3300/0 conn(0x7f70d0159c00 msgr2=0x7f70d00cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:26.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.102+0000 7f70cf7fe640 1 --2- 172.21.15.114:0/3698696547 >> v2:172.21.15.141:3300/0 conn(0x7f70d0159c00 0x7f70d00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.102+0000 7f70cf7fe640 1 -- 172.21.15.114:0/3698696547 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d015a3e0 con 0x7f70d00adac0 2023-11-04T01:39:26.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.103+0000 7f70cf7fe640 1 --2- 172.21.15.114:0/3698696547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d00adac0 0x7f70d00adf10 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f70d00cc4d0 tx=0x7f70c802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a37e2accd27808f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.103+0000 7f70cdffb640 1 -- 172.21.15.114:0/3698696547 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c802ca70 con 0x7f70d00adac0 2023-11-04T01:39:26.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.103+0000 7f70cdffb640 1 -- 172.21.15.114:0/3698696547 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c802cbd0 con 0x7f70d00adac0 2023-11-04T01:39:26.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.103+0000 7f70cdffb640 1 -- 172.21.15.114:0/3698696547 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c80343f0 con 0x7f70d00adac0 2023-11-04T01:39:26.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.104+0000 7f70d5464640 1 -- 172.21.15.114:0/3698696547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d00adac0 msgr2=0x7f70d00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.104+0000 7f70d5464640 1 --2- 172.21.15.114:0/3698696547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d00adac0 0x7f70d00adf10 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f70d00cc4d0 tx=0x7f70c802bed0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.104+0000 7f70d5464640 1 -- 172.21.15.114:0/3698696547 shutdown_connections 2023-11-04T01:39:26.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.104+0000 7f70d5464640 1 --2- 172.21.15.114:0/3698696547 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d00c48e0 0x7f70d00c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.104+0000 7f70d5464640 1 --2- 172.21.15.114:0/3698696547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d00adac0 0x7f70d00adf10 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.104+0000 7f70d5464640 1 --2- 172.21.15.114:0/3698696547 >> v2:172.21.15.141:3300/0 conn(0x7f70d0159c00 0x7f70d00cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.104+0000 7f70d5464640 1 -- 172.21.15.114:0/3698696547 >> 172.21.15.114:0/3698696547 conn(0x7f70d00ce950 msgr2=0x7f70d00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:26.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.104+0000 7f70d5464640 1 -- 172.21.15.114:0/3698696547 shutdown_connections 2023-11-04T01:39:26.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.104+0000 7f70d5464640 1 -- 172.21.15.114:0/3698696547 wait complete. 2023-11-04T01:39:26.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.105+0000 7f70d5464640 1 Processor -- start 2023-11-04T01:39:26.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.105+0000 7f70d5464640 1 -- start start 2023-11-04T01:39:26.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70d5464640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70d00adac0 0x7f70d0158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70d5464640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d00c48e0 0x7f70d0155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70d5464640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d0159c00 0x7f70d01483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70d5464640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d0159500 con 0x7f70d00c48e0 2023-11-04T01:39:26.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70d5464640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d01588f0 con 0x7f70d00adac0 2023-11-04T01:39:26.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70d5464640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d0158bd0 con 0x7f70d0159c00 2023-11-04T01:39:26.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70ce7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d00c48e0 0x7f70d0155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70ce7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d00c48e0 0x7f70d0155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33276/0 (socket says 172.21.15.114:33276) 2023-11-04T01:39:26.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70ce7fc640 1 -- 172.21.15.114:0/3835262602 learned_addr learned my addr 172.21.15.114:0/3835262602 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:26.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70cf7fe640 1 --2- 172.21.15.114:0/3835262602 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d0159c00 0x7f70d01483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70ceffd640 1 --2- 172.21.15.114:0/3835262602 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70d00adac0 0x7f70d0158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70ce7fc640 1 -- 172.21.15.114:0/3835262602 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d0159c00 msgr2=0x7f70d01483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70ce7fc640 1 --2- 172.21.15.114:0/3835262602 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d0159c00 0x7f70d01483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70ce7fc640 1 -- 172.21.15.114:0/3835262602 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70d00adac0 msgr2=0x7f70d0158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70ce7fc640 1 --2- 172.21.15.114:0/3835262602 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70d00adac0 0x7f70d0158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70ce7fc640 1 -- 172.21.15.114:0/3835262602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8009b30 con 0x7f70d00c48e0 2023-11-04T01:39:26.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.106+0000 7f70ce7fc640 1 --2- 172.21.15.114:0/3835262602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d00c48e0 0x7f70d0155a40 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f70c400b4a0 tx=0x7f70c400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.107+0000 7f70b77fe640 1 -- 172.21.15.114:0/3835262602 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4010610 con 0x7f70d00c48e0 2023-11-04T01:39:26.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.107+0000 7f70b77fe640 1 -- 172.21.15.114:0/3835262602 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c4010770 con 0x7f70d00c48e0 2023-11-04T01:39:26.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.107+0000 7f70b77fe640 1 -- 172.21.15.114:0/3835262602 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4010b20 con 0x7f70d00c48e0 2023-11-04T01:39:26.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.107+0000 7f70d5464640 1 -- 172.21.15.114:0/3835262602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d0158eb0 con 0x7f70d00c48e0 2023-11-04T01:39:26.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.107+0000 7f70d5464640 1 -- 172.21.15.114:0/3835262602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d0155f80 con 0x7f70d00c48e0 2023-11-04T01:39:26.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.108+0000 7f70d5464640 1 -- 172.21.15.114:0/3835262602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d00c6b70 con 0x7f70d00c48e0 2023-11-04T01:39:26.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.108+0000 7f70b77fe640 1 -- 172.21.15.114:0/3835262602 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70c4010c80 con 0x7f70d00c48e0 2023-11-04T01:39:26.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.108+0000 7f70b77fe640 1 --2- 172.21.15.114:0/3835262602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70bc06ae70 0x7f70bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.108+0000 7f70b77fe640 1 -- 172.21.15.114:0/3835262602 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f70c4089780 con 0x7f70d00c48e0 2023-11-04T01:39:26.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.108+0000 7f70ceffd640 1 --2- 172.21.15.114:0/3835262602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70bc06ae70 0x7f70bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.109+0000 7f70ceffd640 1 --2- 172.21.15.114:0/3835262602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70bc06ae70 0x7f70bc06d330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009890 tx=0x7f70c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.112+0000 7f70b77fe640 1 -- 172.21.15.114:0/3835262602 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f70c40542c0 con 0x7f70d00c48e0 2023-11-04T01:39:26.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.344+0000 7f70d5464640 1 -- 172.21.15.114:0/3835262602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f70d015d3e0 con 0x7f70d00c48e0 2023-11-04T01:39:26.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.345+0000 7f70b77fe640 1 -- 172.21.15.114:0/3835262602 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f70c40578e0 con 0x7f70d00c48e0 2023-11-04T01:39:26.347 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2023-11-04T01:39:26.347 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDan0Vl3QHODhAA6LWlhd+avWYsoYsWMbOiVA== 2023-11-04T01:39:26.347 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2023-11-04T01:39:26.348 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2023-11-04T01:39:26.348 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:39:26.348 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2023-11-04T01:39:26.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.347+0000 7f70d5464640 1 -- 172.21.15.114:0/3835262602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70bc06ae70 msgr2=0x7f70bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.347+0000 7f70d5464640 1 --2- 172.21.15.114:0/3835262602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70bc06ae70 0x7f70bc06d330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009890 tx=0x7f70c0008040 comp rx=0 tx=0).stop 2023-11-04T01:39:26.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.347+0000 7f70d5464640 1 -- 172.21.15.114:0/3835262602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d00c48e0 msgr2=0x7f70d0155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.347+0000 7f70d5464640 1 --2- 172.21.15.114:0/3835262602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d00c48e0 0x7f70d0155a40 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f70c400b4a0 tx=0x7f70c400b960 comp rx=0 tx=0).stop 2023-11-04T01:39:26.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.347+0000 7f70d5464640 1 -- 172.21.15.114:0/3835262602 shutdown_connections 2023-11-04T01:39:26.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.347+0000 7f70d5464640 1 --2- 172.21.15.114:0/3835262602 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70d0159c00 0x7f70d01483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.347+0000 7f70d5464640 1 --2- 172.21.15.114:0/3835262602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d00c48e0 0x7f70d0155a40 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.347+0000 7f70d5464640 1 --2- 172.21.15.114:0/3835262602 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70bc06ae70 0x7f70bc06d330 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.347+0000 7f70d5464640 1 --2- 172.21.15.114:0/3835262602 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70d00adac0 0x7f70d0158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.347+0000 7f70d5464640 1 -- 172.21.15.114:0/3835262602 >> 172.21.15.114:0/3835262602 conn(0x7f70d00ce950 msgr2=0x7f70d006dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:26.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.347+0000 7f70d5464640 1 -- 172.21.15.114:0/3835262602 shutdown_connections 2023-11-04T01:39:26.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.347+0000 7f70d5464640 1 -- 172.21.15.114:0/3835262602 wait complete. 2023-11-04T01:39:26.360 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:26.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.456+0000 7fc438716640 1 Processor -- start 2023-11-04T01:39:26.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.457+0000 7fc438716640 1 -- start start 2023-11-04T01:39:26.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.457+0000 7fc438716640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc4300ce370 0x7fc43006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.457+0000 7fc438716640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43006e060 con 0x7fc4300b0ae0 2023-11-04T01:39:26.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.457+0000 7fc438716640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4300b4110 con 0x7fc430159c70 2023-11-04T01:39:26.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.457+0000 7fc438716640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4300b49b0 con 0x7fc4300ce370 2023-11-04T01:39:26.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.458+0000 7fc435cb1640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc4300b0ae0 0x7fc43015d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35070/0 (socket says 172.21.15.114:35070) 2023-11-04T01:39:26.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.458+0000 7fc435cb1640 1 -- 172.21.15.114:0/3149873202 learned_addr learned my addr 172.21.15.114:0/3149873202 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:26.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.458+0000 7fc436cb3640 1 --2- 172.21.15.114:0/3149873202 >> v2:172.21.15.114:3300/0 conn(0x7fc4300ce370 0x7fc43006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.458+0000 7fc4354b0640 1 -- 172.21.15.114:0/3149873202 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218918278 0 0) 0x7fc43006e060 con 0x7fc4300b0ae0 2023-11-04T01:39:26.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.458+0000 7fc4354b0640 1 -- 172.21.15.114:0/3149873202 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc418003520 con 0x7fc4300b0ae0 2023-11-04T01:39:26.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.458+0000 7fc436cb3640 1 -- 172.21.15.114:0/3149873202 >> v1:172.21.15.141:6789/0 conn(0x7fc430159c70 legacy=0x7fc4300b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:26.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.458+0000 7fc436cb3640 1 -- 172.21.15.114:0/3149873202 >> v1:172.21.15.114:6789/0 conn(0x7fc4300b0ae0 legacy=0x7fc43015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.458+0000 7fc436cb3640 1 -- 172.21.15.114:0/3149873202 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4300b43f0 con 0x7fc4300ce370 2023-11-04T01:39:26.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.459+0000 7fc436cb3640 1 --2- 172.21.15.114:0/3149873202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4300ce370 0x7fc43006db20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc43006e1f0 tx=0x7fc42002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e6ce9a907402e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.459+0000 7fc4354b0640 1 -- 172.21.15.114:0/3149873202 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420030610 con 0x7fc4300ce370 2023-11-04T01:39:26.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.459+0000 7fc4354b0640 1 -- 172.21.15.114:0/3149873202 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc420030770 con 0x7fc4300ce370 2023-11-04T01:39:26.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.459+0000 7fc4354b0640 1 -- 172.21.15.114:0/3149873202 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420030b00 con 0x7fc4300ce370 2023-11-04T01:39:26.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.459+0000 7fc438716640 1 -- 172.21.15.114:0/3149873202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4300ce370 msgr2=0x7fc43006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.459+0000 7fc438716640 1 --2- 172.21.15.114:0/3149873202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4300ce370 0x7fc43006db20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc43006e1f0 tx=0x7fc42002b960 comp rx=0 tx=0).stop 2023-11-04T01:39:26.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.459+0000 7fc438716640 1 -- 172.21.15.114:0/3149873202 shutdown_connections 2023-11-04T01:39:26.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.459+0000 7fc438716640 1 --2- 172.21.15.114:0/3149873202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4300ce370 0x7fc43006db20 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.459+0000 7fc438716640 1 -- 172.21.15.114:0/3149873202 >> 172.21.15.114:0/3149873202 conn(0x7fc4300ce950 msgr2=0x7fc4300ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:26.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.459+0000 7fc438716640 1 -- 172.21.15.114:0/3149873202 shutdown_connections 2023-11-04T01:39:26.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.460+0000 7fc438716640 1 -- 172.21.15.114:0/3149873202 wait complete. 2023-11-04T01:39:26.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.461+0000 7fc438716640 1 Processor -- start 2023-11-04T01:39:26.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.461+0000 7fc438716640 1 -- start start 2023-11-04T01:39:26.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.461+0000 7fc438716640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4300b0ae0 0x7fc4300ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.461+0000 7fc438716640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4300ce370 0x7fc4301f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.461+0000 7fc438716640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc430159c70 0x7fc43015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.461+0000 7fc438716640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4300ce7e0 con 0x7fc4300ce370 2023-11-04T01:39:26.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.461+0000 7fc438716640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43015c0e0 con 0x7fc4300b0ae0 2023-11-04T01:39:26.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.461+0000 7fc438716640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43015b5e0 con 0x7fc430159c70 2023-11-04T01:39:26.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.461+0000 7fc435cb1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4300ce370 0x7fc4301f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.461+0000 7fc435cb1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4300ce370 0x7fc4301f37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50246/0 (socket says 172.21.15.114:50246) 2023-11-04T01:39:26.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.461+0000 7fc435cb1640 1 -- 172.21.15.114:0/3070605158 learned_addr learned my addr 172.21.15.114:0/3070605158 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:26.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.462+0000 7fc4364b2640 1 --2- 172.21.15.114:0/3070605158 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4300b0ae0 0x7fc4300ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.462+0000 7fc436cb3640 1 --2- 172.21.15.114:0/3070605158 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc430159c70 0x7fc43015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.462+0000 7fc435cb1640 1 -- 172.21.15.114:0/3070605158 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc430159c70 msgr2=0x7fc43015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.462+0000 7fc435cb1640 1 --2- 172.21.15.114:0/3070605158 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc430159c70 0x7fc43015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.462+0000 7fc435cb1640 1 -- 172.21.15.114:0/3070605158 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4300b0ae0 msgr2=0x7fc4300ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.462+0000 7fc435cb1640 1 --2- 172.21.15.114:0/3070605158 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4300b0ae0 0x7fc4300ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.462+0000 7fc435cb1640 1 -- 172.21.15.114:0/3070605158 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc420009400 con 0x7fc4300ce370 2023-11-04T01:39:26.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.462+0000 7fc435cb1640 1 --2- 172.21.15.114:0/3070605158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4300ce370 0x7fc4301f37e0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc42400cbc0 tx=0x7fc42400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.462+0000 7fc42effd640 1 -- 172.21.15.114:0/3070605158 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42400ad40 con 0x7fc4300ce370 2023-11-04T01:39:26.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.462+0000 7fc42effd640 1 -- 172.21.15.114:0/3070605158 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc424012400 con 0x7fc4300ce370 2023-11-04T01:39:26.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.462+0000 7fc438716640 1 -- 172.21.15.114:0/3070605158 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43015b840 con 0x7fc4300ce370 2023-11-04T01:39:26.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.462+0000 7fc42effd640 1 -- 172.21.15.114:0/3070605158 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42400aea0 con 0x7fc4300ce370 2023-11-04T01:39:26.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.462+0000 7fc438716640 1 -- 172.21.15.114:0/3070605158 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43015be00 con 0x7fc4300ce370 2023-11-04T01:39:26.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.463+0000 7fc438716640 1 -- 172.21.15.114:0/3070605158 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc430074290 con 0x7fc4300ce370 2023-11-04T01:39:26.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.463+0000 7fc42effd640 1 -- 172.21.15.114:0/3070605158 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc424007070 con 0x7fc4300ce370 2023-11-04T01:39:26.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.464+0000 7fc42effd640 1 --2- 172.21.15.114:0/3070605158 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc41c06ae70 0x7fc41c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:26.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.464+0000 7fc42effd640 1 -- 172.21.15.114:0/3070605158 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fc424089a70 con 0x7fc4300ce370 2023-11-04T01:39:26.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.464+0000 7fc4364b2640 1 --2- 172.21.15.114:0/3070605158 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc41c06ae70 0x7fc41c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:26.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.464+0000 7fc4364b2640 1 --2- 172.21.15.114:0/3070605158 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc41c06ae70 0x7fc41c06d330 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc4300ad1a0 tx=0x7fc428009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:26.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.468+0000 7fc42effd640 1 -- 172.21.15.114:0/3070605158 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4240546f0 con 0x7fc4300ce370 2023-11-04T01:39:26.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.671+0000 7fc438716640 1 -- 172.21.15.114:0/3070605158 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc43006d3f0 con 0x7fc4300ce370 2023-11-04T01:39:26.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.671+0000 7fc42effd640 1 -- 172.21.15.114:0/3070605158 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4924 (secure 0 0 0) 0x7fc424017090 con 0x7fc4300ce370 2023-11-04T01:39:26.673 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:26.673 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6055,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/775121992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":775121992},{"type":"v1","addr":"172.21.15.141:6835","nonce":775121992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6951,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1790830778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1790830778},{"type":"v1","addr":"172.21.15.114:6836","nonce":1790830778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6954,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2482757978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2482757978},{"type":"v1","addr":"172.21.15.114:6837","nonce":2482757978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:39:22.003461+0000","modified":"2023-11-04T01:39:24.001779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6966":{"gid":6966,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6834/1471552462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1471552462},{"type":"v1","addr":"172.21.15.141:6834","nonce":1471552462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:39:26.673 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 35 2023-11-04T01:39:26.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.673+0000 7fc438716640 1 -- 172.21.15.114:0/3070605158 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc41c06ae70 msgr2=0x7fc41c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.673+0000 7fc438716640 1 --2- 172.21.15.114:0/3070605158 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc41c06ae70 0x7fc41c06d330 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc4300ad1a0 tx=0x7fc428009040 comp rx=0 tx=0).stop 2023-11-04T01:39:26.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.673+0000 7fc438716640 1 -- 172.21.15.114:0/3070605158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4300ce370 msgr2=0x7fc4301f37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:26.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.673+0000 7fc438716640 1 --2- 172.21.15.114:0/3070605158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4300ce370 0x7fc4301f37e0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc42400cbc0 tx=0x7fc42400a430 comp rx=0 tx=0).stop 2023-11-04T01:39:26.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.673+0000 7fc438716640 1 -- 172.21.15.114:0/3070605158 shutdown_connections 2023-11-04T01:39:26.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.673+0000 7fc438716640 1 --2- 172.21.15.114:0/3070605158 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc430159c70 0x7fc43015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.673+0000 7fc438716640 1 --2- 172.21.15.114:0/3070605158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4300ce370 0x7fc4301f37e0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.673+0000 7fc438716640 1 --2- 172.21.15.114:0/3070605158 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc41c06ae70 0x7fc41c06d330 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.673+0000 7fc438716640 1 --2- 172.21.15.114:0/3070605158 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc4300b0ae0 0x7fc4300ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:26.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.673+0000 7fc438716640 1 -- 172.21.15.114:0/3070605158 >> 172.21.15.114:0/3070605158 conn(0x7fc4300ce950 msgr2=0x7fc43015d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:26.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.673+0000 7fc438716640 1 -- 172.21.15.114:0/3070605158 shutdown_connections 2023-11-04T01:39:26.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:26.673+0000 7fc438716640 1 -- 172.21.15.114:0/3070605158 wait complete. 2023-11-04T01:39:26.911 INFO:tasks.ceph.mds.b.smithi141.stderr:2023-11-04T01:39:26.909+0000 7fa794174640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:39:27.088 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:39:22.003461+0000', 'modified': '2023-11-04T01:39:24.001779+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6966}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6966': {'gid': 6966, 'name': 'b', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.141:6834/1471552462', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.141:6832', 'nonce': 1471552462}, {'type': 'v1', 'addr': '172.21.15.141:6834', 'nonce': 1471552462}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:39:27.088 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:39:27.088 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:39:27.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.188+0000 7f42f74d4640 1 Processor -- start 2023-11-04T01:39:27.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.188+0000 7f42f74d4640 1 -- start start 2023-11-04T01:39:27.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42f74d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42f00ae1d0 0x7f42f00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42f74d4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f015aff0 con 0x7f42f00c4ff0 2023-11-04T01:39:27.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42f74d4640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f015a3e0 con 0x7f42f0159c00 2023-11-04T01:39:27.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42f74d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f015a6c0 con 0x7f42f00ae1d0 2023-11-04T01:39:27.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42f4a6f640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f42f00c4ff0 0x7f42f00adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35086/0 (socket says 172.21.15.114:35086) 2023-11-04T01:39:27.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42f4a6f640 1 -- 172.21.15.114:0/4191584720 learned_addr learned my addr 172.21.15.114:0/4191584720 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:27.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42f5a71640 1 --2- 172.21.15.114:0/4191584720 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42f00ae1d0 0x7f42f00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42e7fff640 1 -- 172.21.15.114:0/4191584720 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238554466 0 0) 0x7f42f015aff0 con 0x7f42f00c4ff0 2023-11-04T01:39:27.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42e7fff640 1 -- 172.21.15.114:0/4191584720 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42dc003520 con 0x7f42f00c4ff0 2023-11-04T01:39:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42e7fff640 1 -- 172.21.15.114:0/4191584720 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2275308605 0 0) 0x7f42dc003520 con 0x7f42f00c4ff0 2023-11-04T01:39:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42e7fff640 1 -- 172.21.15.114:0/4191584720 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42f00ae1d0 msgr2=0x7f42f00cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42e7fff640 1 --2- 172.21.15.114:0/4191584720 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42f00ae1d0 0x7f42f00cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42e7fff640 1 -- 172.21.15.114:0/4191584720 >> v1:172.21.15.141:6789/0 conn(0x7f42f0159c00 legacy=0x7f42f00c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42e7fff640 1 -- 172.21.15.114:0/4191584720 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f015a9a0 con 0x7f42f00c4ff0 2023-11-04T01:39:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42e7fff640 1 -- 172.21.15.114:0/4191584720 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f42e0001670 con 0x7f42f00c4ff0 2023-11-04T01:39:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42e7fff640 1 -- 172.21.15.114:0/4191584720 >> v1:172.21.15.114:6789/0 conn(0x7f42f00c4ff0 legacy=0x7f42f00adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42e7fff640 1 --2- 172.21.15.114:0/4191584720 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42f00ae1d0 0x7f42dc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42e7fff640 1 --2- 172.21.15.114:0/4191584720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42dc003f20 0x7f42dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42e7fff640 1 --2- 172.21.15.114:0/4191584720 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42dc004d00 0x7f42dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42e7fff640 1 -- 172.21.15.114:0/4191584720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f015a6c0 con 0x7f42dc003f20 2023-11-04T01:39:27.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42e7fff640 1 -- 172.21.15.114:0/4191584720 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc00ba60 con 0x7f42dc004d00 2023-11-04T01:39:27.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42e7fff640 1 -- 172.21.15.114:0/4191584720 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc00bc20 con 0x7f42f00ae1d0 2023-11-04T01:39:27.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.189+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/4191584720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42dc003f20 0x7f42dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.190+0000 7f42f5270640 1 --2- 172.21.15.114:0/4191584720 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42f00ae1d0 0x7f42dc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.190+0000 7f42f5a71640 1 --2- 172.21.15.114:0/4191584720 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42dc004d00 0x7f42dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.190+0000 7f42f4a6f640 1 -- 172.21.15.114:0/4191584720 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42f00ae1d0 msgr2=0x7f42dc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.190+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/4191584720 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42f00ae1d0 0x7f42dc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.190+0000 7f42f4a6f640 1 -- 172.21.15.114:0/4191584720 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42dc004d00 msgr2=0x7f42dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.190+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/4191584720 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42dc004d00 0x7f42dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.190+0000 7f42f4a6f640 1 -- 172.21.15.114:0/4191584720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc003520 con 0x7f42dc003f20 2023-11-04T01:39:27.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.190+0000 7f42f5a71640 1 --2- 172.21.15.114:0/4191584720 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42dc004d00 0x7f42dc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:27.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.190+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/4191584720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42dc003f20 0x7f42dc0047c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f42f00b4a60 tx=0x7f42dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629dcf8bc2d40e39 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.191+0000 7f42e7fff640 1 -- 172.21.15.114:0/4191584720 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0005ad0 con 0x7f42dc003f20 2023-11-04T01:39:27.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.191+0000 7f42e7fff640 1 -- 172.21.15.114:0/4191584720 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e0005c30 con 0x7f42dc003f20 2023-11-04T01:39:27.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.191+0000 7f42e7fff640 1 -- 172.21.15.114:0/4191584720 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e002c850 con 0x7f42dc003f20 2023-11-04T01:39:27.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.191+0000 7f42f74d4640 1 -- 172.21.15.114:0/4191584720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42dc003f20 msgr2=0x7f42dc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.191+0000 7f42f74d4640 1 --2- 172.21.15.114:0/4191584720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42dc003f20 0x7f42dc0047c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f42f00b4a60 tx=0x7f42dc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.191+0000 7f42f5a71640 1 -- 172.21.15.114:0/4191584720 reap_dead start 2023-11-04T01:39:27.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.191+0000 7f42f74d4640 1 -- 172.21.15.114:0/4191584720 shutdown_connections 2023-11-04T01:39:27.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.191+0000 7f42f74d4640 1 -- 172.21.15.114:0/4191584720 >> 172.21.15.114:0/4191584720 conn(0x7f42f00ce950 msgr2=0x7f42f00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:27.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.191+0000 7f42f74d4640 1 -- 172.21.15.114:0/4191584720 shutdown_connections 2023-11-04T01:39:27.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.191+0000 7f42f74d4640 1 -- 172.21.15.114:0/4191584720 wait complete. 2023-11-04T01:39:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.192+0000 7f42f74d4640 1 Processor -- start 2023-11-04T01:39:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.192+0000 7f42f74d4640 1 -- start start 2023-11-04T01:39:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.193+0000 7f42f74d4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42dc003f20 0x7f42f01584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.193+0000 7f42f74d4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42f0149420 0x7f42f01f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.193+0000 7f42f74d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42f01f33e0 0x7f42f01f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.193+0000 7f42f74d4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f01565f0 con 0x7f42dc003f20 2023-11-04T01:39:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.193+0000 7f42f74d4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f00c7cd0 con 0x7f42f0149420 2023-11-04T01:39:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.193+0000 7f42f74d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f00c7fb0 con 0x7f42f01f33e0 2023-11-04T01:39:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.193+0000 7f42f5270640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42dc003f20 0x7f42f01584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.193+0000 7f42f5270640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42dc003f20 0x7f42f01584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50268/0 (socket says 172.21.15.114:50268) 2023-11-04T01:39:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.193+0000 7f42f5270640 1 -- 172.21.15.114:0/1136659461 learned_addr learned my addr 172.21.15.114:0/1136659461 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.193+0000 7f42f5270640 1 -- 172.21.15.114:0/1136659461 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42f01f33e0 msgr2=0x7f42f01f3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.193+0000 7f42f5270640 1 --2- 172.21.15.114:0/1136659461 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42f01f33e0 0x7f42f01f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.193+0000 7f42f5270640 1 -- 172.21.15.114:0/1136659461 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42f0149420 msgr2=0x7f42f01f2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.193+0000 7f42f5270640 1 --2- 172.21.15.114:0/1136659461 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42f0149420 0x7f42f01f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.193+0000 7f42f5270640 1 -- 172.21.15.114:0/1136659461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f00c8290 con 0x7f42dc003f20 2023-11-04T01:39:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.194+0000 7f42f5270640 1 --2- 172.21.15.114:0/1136659461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42dc003f20 0x7f42f01584f0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00f7a0 tx=0x7f42ec00fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.194+0000 7f42e5ffb640 1 -- 172.21.15.114:0/1136659461 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec0050d0 con 0x7f42dc003f20 2023-11-04T01:39:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.194+0000 7f42e5ffb640 1 -- 172.21.15.114:0/1136659461 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec005230 con 0x7f42dc003f20 2023-11-04T01:39:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.194+0000 7f42f74d4640 1 -- 172.21.15.114:0/1136659461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f01498a0 con 0x7f42dc003f20 2023-11-04T01:39:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.194+0000 7f42e5ffb640 1 -- 172.21.15.114:0/1136659461 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec00d730 con 0x7f42dc003f20 2023-11-04T01:39:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.194+0000 7f42f74d4640 1 -- 172.21.15.114:0/1136659461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f00c6a70 con 0x7f42dc003f20 2023-11-04T01:39:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.196+0000 7f42e5ffb640 1 -- 172.21.15.114:0/1136659461 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42ec00d890 con 0x7f42dc003f20 2023-11-04T01:39:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.196+0000 7f42e5ffb640 1 --2- 172.21.15.114:0/1136659461 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f42d406ae70 0x7f42d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.196+0000 7f42e5ffb640 1 -- 172.21.15.114:0/1136659461 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f42ec089a00 con 0x7f42dc003f20 2023-11-04T01:39:27.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.196+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/1136659461 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f42d406ae70 0x7f42d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.196+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/1136659461 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f42d406ae70 0x7f42d406d330 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f42e0034000 tx=0x7f42e0007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.197+0000 7f42fa066740 1 Processor -- start 2023-11-04T01:39:27.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.197+0000 7f42fa066740 1 -- start start 2023-11-04T01:39:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42fa066740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02850 0x562a679d5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42fa066740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02c30 0x562a67a055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42fa066740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a679d5c90 0x562a67a05b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42fa066740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a678e6740 con 0x562a67a02c30 2023-11-04T01:39:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42fa066740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a679488d0 con 0x562a67a02850 2023-11-04T01:39:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42fa066740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a67945fc0 con 0x562a679d5c90 2023-11-04T01:39:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42f4a6f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02c30 0x562a67a055e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42f4a6f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02c30 0x562a67a055e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50274/0 (socket says 172.21.15.114:50274) 2023-11-04T01:39:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42f4a6f640 1 -- 172.21.15.114:0/216306990 learned_addr learned my addr 172.21.15.114:0/216306990 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42f5a71640 1 --2- 172.21.15.114:0/216306990 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a679d5c90 0x562a67a05b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42f5270640 1 --2- 172.21.15.114:0/216306990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02850 0x562a679d5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42f4a6f640 1 -- 172.21.15.114:0/216306990 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a679d5c90 msgr2=0x562a67a05b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/216306990 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a679d5c90 0x562a67a05b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42f4a6f640 1 -- 172.21.15.114:0/216306990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02850 msgr2=0x562a679d5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/216306990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02850 0x562a679d5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42f4a6f640 1 -- 172.21.15.114:0/216306990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a67904ca0 con 0x562a67a02c30 2023-11-04T01:39:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/216306990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02c30 0x562a67a055e0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f42f00cfa50 tx=0x7f42e002f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f4e04aa58fa258 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42daffd640 1 -- 172.21.15.114:0/216306990 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0049070 con 0x562a67a02c30 2023-11-04T01:39:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42daffd640 1 -- 172.21.15.114:0/216306990 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e002ce10 con 0x562a67a02c30 2023-11-04T01:39:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.198+0000 7f42daffd640 1 -- 172.21.15.114:0/216306990 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e00049e0 con 0x562a67a02c30 2023-11-04T01:39:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.199+0000 7f42fa066740 1 -- 172.21.15.114:0/216306990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02c30 msgr2=0x562a67a055e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.199+0000 7f42fa066740 1 --2- 172.21.15.114:0/216306990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02c30 0x562a67a055e0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f42f00cfa50 tx=0x7f42e002f000 comp rx=0 tx=0).stop 2023-11-04T01:39:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.199+0000 7f42fa066740 1 -- 172.21.15.114:0/216306990 shutdown_connections 2023-11-04T01:39:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.199+0000 7f42fa066740 1 --2- 172.21.15.114:0/216306990 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a679d5c90 0x562a67a05b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.199+0000 7f42fa066740 1 --2- 172.21.15.114:0/216306990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02c30 0x562a67a055e0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.199+0000 7f42fa066740 1 --2- 172.21.15.114:0/216306990 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02850 0x562a679d5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.199+0000 7f42fa066740 1 -- 172.21.15.114:0/216306990 >> 172.21.15.114:0/216306990 conn(0x562a679d7a60 msgr2=0x562a67a205e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.199+0000 7f42fa066740 1 -- 172.21.15.114:0/216306990 shutdown_connections 2023-11-04T01:39:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.199+0000 7f42fa066740 1 -- 172.21.15.114:0/216306990 wait complete. 2023-11-04T01:39:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.200+0000 7f42fa066740 1 -- start start 2023-11-04T01:39:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.200+0000 7f42fa066740 1 Processor -- start 2023-11-04T01:39:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42fa066740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02850 0x562a67a01150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42fa066740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02c30 0x562a67a36240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42fa066740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a67a1b1b0 0x562a67a36780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42fa066740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a679418b0 con 0x562a67a02c30 2023-11-04T01:39:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42fa066740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a678fbc80 con 0x562a67a02850 2023-11-04T01:39:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42fa066740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a678fb920 con 0x562a67a1b1b0 2023-11-04T01:39:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42fa066740 10 client.0 _ll_register_callbacks cb 0x562a67653ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42f4a6f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02c30 0x562a67a36240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42f4a6f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02c30 0x562a67a36240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50276/0 (socket says 172.21.15.114:50276) 2023-11-04T01:39:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42f4a6f640 1 -- 172.21.15.114:0/2349263836 learned_addr learned my addr 172.21.15.114:0/2349263836 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42f5270640 1 --2- 172.21.15.114:0/2349263836 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02850 0x562a67a01150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42f5a71640 1 --2- 172.21.15.114:0/2349263836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a67a1b1b0 0x562a67a36780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42f4a6f640 1 -- 172.21.15.114:0/2349263836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a67a1b1b0 msgr2=0x562a67a36780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/2349263836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a67a1b1b0 0x562a67a36780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42f4a6f640 1 -- 172.21.15.114:0/2349263836 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02850 msgr2=0x562a67a01150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/2349263836 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02850 0x562a67a01150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42f4a6f640 1 -- 172.21.15.114:0/2349263836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42dc003520 con 0x562a67a02c30 2023-11-04T01:39:27.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42f5270640 1 --2- 172.21.15.114:0/2349263836 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02850 0x562a67a01150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:27.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/2349263836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02c30 0x562a67a36240 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f42e0043000 tx=0x7f42e002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30c48814aaaa2e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42cffff640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:39:27.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42cffff640 1 -- 172.21.15.114:0/2349263836 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0049040 con 0x562a67a02c30 2023-11-04T01:39:27.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42fa066740 1 -- 172.21.15.114:0/2349263836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a678edbf0 con 0x562a67a02c30 2023-11-04T01:39:27.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42cffff640 1 -- 172.21.15.114:0/2349263836 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f42e0040440 con 0x562a67a02c30 2023-11-04T01:39:27.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42cffff640 1 -- 172.21.15.114:0/2349263836 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42e0040600 con 0x562a67a02c30 2023-11-04T01:39:27.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42fa066740 10 client.7134 fetch_fsmap learned FSMap version 35 2023-11-04T01:39:27.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.201+0000 7f42fa066740 1 -- 172.21.15.114:0/2349263836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x562a6793ff30 con 0x562a67a02c30 2023-11-04T01:39:27.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.202+0000 7f42cffff640 1 -- 172.21.15.114:0/2349263836 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a678edbf0 con 0x562a67a02c30 2023-11-04T01:39:27.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.202+0000 7f42cffff640 1 -- 172.21.15.114:0/2349263836 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 35) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f42e0040760 con 0x562a67a02c30 2023-11-04T01:39:27.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.202+0000 7f42fa066740 10 client.7134 fetch_fsmap finished waiting for FSMap version 35 2023-11-04T01:39:27.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.202+0000 7f42fa066740 10 client.7134 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:39:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.202+0000 7f42fa066740 20 client.7134 populate_metadata read hostname 'smithi114' 2023-11-04T01:39:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.202+0000 7f42fa066740 1 --2- 172.21.15.114:0/2349263836 >> [v2:172.21.15.141:6832/1471552462,v1:172.21.15.141:6834/1471552462] conn(0x562a67a08480 0x562a67a40690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.202+0000 7f42fa066740 4 client.7134 mds_command: new command op to 6966 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:39:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.202+0000 7f42fa066740 1 -- 172.21.15.114:0/2349263836 --> [v2:172.21.15.141:6832/1471552462,v1:172.21.15.141:6834/1471552462] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a6793a890 con 0x562a67a08480 2023-11-04T01:39:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.202+0000 7f42f5270640 1 --2- 172.21.15.114:0/2349263836 >> [v2:172.21.15.141:6832/1471552462,v1:172.21.15.141:6834/1471552462] conn(0x562a67a08480 0x562a67a40690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.202+0000 7f42cffff640 10 client.7134 ms_handle_connect on v2:172.21.15.141:6832/1471552462 2023-11-04T01:39:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.202+0000 7f42f5270640 1 --2- 172.21.15.114:0/2349263836 >> [v2:172.21.15.141:6832/1471552462,v1:172.21.15.141:6834/1471552462] conn(0x562a67a08480 0x562a67a40690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad1638b3e7733ec4 server_cookie=20c4a5761983db05 in_seq=0 out_seq=0 2023-11-04T01:39:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.203+0000 7f42cffff640 1 -- 172.21.15.114:0/2349263836 <== mds.0 v2:172.21.15.141:6832/1471552462 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562a6793a890 con 0x562a67a08480 2023-11-04T01:39:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.203+0000 7f42cffff640 10 client.7134 handle_command_reply: tid=0 2023-11-04T01:39:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.203+0000 7f42fa066740 1 client.7134 shutdown 2023-11-04T01:39:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.203+0000 7f42fa066740 1 -- 172.21.15.114:0/2349263836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02c30 msgr2=0x562a67a36240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.203+0000 7f42fa066740 1 --2- 172.21.15.114:0/2349263836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02c30 0x562a67a36240 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f42e0043000 tx=0x7f42e002e000 comp rx=0 tx=0).stop 2023-11-04T01:39:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.203+0000 7f42fa066740 1 -- 172.21.15.114:0/2349263836 shutdown_connections 2023-11-04T01:39:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.203+0000 7f42fa066740 1 --2- 172.21.15.114:0/2349263836 >> [v2:172.21.15.141:6832/1471552462,v1:172.21.15.141:6834/1471552462] conn(0x562a67a08480 0x562a67a40690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.203+0000 7f42fa066740 1 --2- 172.21.15.114:0/2349263836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a67a1b1b0 0x562a67a36780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.203+0000 7f42fa066740 1 --2- 172.21.15.114:0/2349263836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02c30 0x562a67a36240 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.203+0000 7f42fa066740 1 --2- 172.21.15.114:0/2349263836 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02850 0x562a67a01150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.203+0000 7f42cffff640 0 client.7134 ms_handle_reset on v2:172.21.15.141:6832/1471552462 2023-11-04T01:39:27.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.203+0000 7f42fa066740 1 -- 172.21.15.114:0/2349263836 >> 172.21.15.114:0/2349263836 conn(0x562a679d5c90 msgr2=0x562a67a055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:27.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.203+0000 7f42fa066740 1 -- 172.21.15.114:0/2349263836 shutdown_connections 2023-11-04T01:39:27.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.203+0000 7f42fa066740 1 -- 172.21.15.114:0/2349263836 wait complete. 2023-11-04T01:39:27.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.203+0000 7f42fa066740 20 client.7134 trim_cache size 0 max 16384 2023-11-04T01:39:27.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.219+0000 7f42fa066740 1 Processor -- start 2023-11-04T01:39:27.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.219+0000 7f42fa066740 1 -- start start 2023-11-04T01:39:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.219+0000 7f42fa066740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a679d5c90 0x562a679dc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.219+0000 7f42fa066740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02850 0x562a67a01880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.219+0000 7f42fa066740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02c30 0x562a67a05ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.219+0000 7f42fa066740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a678c1280 con 0x562a67a02850 2023-11-04T01:39:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.219+0000 7f42fa066740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a67a07a80 con 0x562a67a02c30 2023-11-04T01:39:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.219+0000 7f42fa066740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a679d1010 con 0x562a679d5c90 2023-11-04T01:39:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.219+0000 7f42f4a6f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02850 0x562a67a01880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42f4a6f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02850 0x562a67a01880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50292/0 (socket says 172.21.15.114:50292) 2023-11-04T01:39:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42f4a6f640 1 -- 172.21.15.114:0/929178484 learned_addr learned my addr 172.21.15.114:0/929178484 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42f5270640 1 --2- 172.21.15.114:0/929178484 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a679d5c90 0x562a679dc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42f5a71640 1 --2- 172.21.15.114:0/929178484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02c30 0x562a67a05ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42f4a6f640 1 -- 172.21.15.114:0/929178484 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a679d5c90 msgr2=0x562a679dc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/929178484 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a679d5c90 0x562a679dc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42f4a6f640 1 -- 172.21.15.114:0/929178484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02c30 msgr2=0x562a67a05ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/929178484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02c30 0x562a67a05ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42f4a6f640 1 -- 172.21.15.114:0/929178484 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a678ddd10 con 0x562a67a02850 2023-11-04T01:39:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42f5a71640 1 --2- 172.21.15.114:0/929178484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02c30 0x562a67a05ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/929178484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02850 0x562a67a01880 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f42e0040d00 tx=0x7f42e0046050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb82f3ec16b56c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42db7fe640 1 -- 172.21.15.114:0/929178484 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0049070 con 0x562a67a02850 2023-11-04T01:39:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42db7fe640 1 -- 172.21.15.114:0/929178484 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e00076b0 con 0x562a67a02850 2023-11-04T01:39:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42db7fe640 1 -- 172.21.15.114:0/929178484 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0040660 con 0x562a67a02850 2023-11-04T01:39:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42fa066740 1 -- 172.21.15.114:0/929178484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02850 msgr2=0x562a67a01880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42fa066740 1 --2- 172.21.15.114:0/929178484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02850 0x562a67a01880 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f42e0040d00 tx=0x7f42e0046050 comp rx=0 tx=0).stop 2023-11-04T01:39:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.220+0000 7f42fa066740 1 -- 172.21.15.114:0/929178484 shutdown_connections 2023-11-04T01:39:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.221+0000 7f42fa066740 1 --2- 172.21.15.114:0/929178484 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a67a02c30 0x562a67a05ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.221+0000 7f42fa066740 1 --2- 172.21.15.114:0/929178484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02850 0x562a67a01880 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.221+0000 7f42fa066740 1 --2- 172.21.15.114:0/929178484 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a679d5c90 0x562a679dc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.221+0000 7f42fa066740 1 -- 172.21.15.114:0/929178484 >> 172.21.15.114:0/929178484 conn(0x562a67a012d0 msgr2=0x562a67a36540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.221+0000 7f42fa066740 1 -- 172.21.15.114:0/929178484 shutdown_connections 2023-11-04T01:39:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.221+0000 7f42fa066740 1 -- 172.21.15.114:0/929178484 wait complete. 2023-11-04T01:39:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.221+0000 7f42fa066740 1 -- start start 2023-11-04T01:39:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.221+0000 7f42fa066740 1 Processor -- start 2023-11-04T01:39:27.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42fa066740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a679d5c90 0x562a67a05ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42fa066740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02850 0x562a67a06020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42fa066740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a67a02c30 0x562a67a15f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42fa066740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a67a90fe0 con 0x562a67a02850 2023-11-04T01:39:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42fa066740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a679d0db0 con 0x562a679d5c90 2023-11-04T01:39:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42fa066740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a679d1000 con 0x562a67a02c30 2023-11-04T01:39:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42fa066740 10 client.0 _ll_register_callbacks cb 0x7f42dc0036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42f4a6f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02850 0x562a67a06020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42f4a6f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02850 0x562a67a06020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50294/0 (socket says 172.21.15.114:50294) 2023-11-04T01:39:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42f4a6f640 1 -- 172.21.15.114:0/1004708782 learned_addr learned my addr 172.21.15.114:0/1004708782 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42f5270640 1 --2- 172.21.15.114:0/1004708782 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a679d5c90 0x562a67a05ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42f5a71640 1 --2- 172.21.15.114:0/1004708782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a67a02c30 0x562a67a15f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42f4a6f640 1 -- 172.21.15.114:0/1004708782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a67a02c30 msgr2=0x562a67a15f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/1004708782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a67a02c30 0x562a67a15f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42f4a6f640 1 -- 172.21.15.114:0/1004708782 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a679d5c90 msgr2=0x562a67a05ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/1004708782 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a679d5c90 0x562a67a05ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42f4a6f640 1 -- 172.21.15.114:0/1004708782 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a6793ff30 con 0x562a67a02850 2023-11-04T01:39:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.222+0000 7f42f5a71640 1 --2- 172.21.15.114:0/1004708782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a67a02c30 0x562a67a15f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42f4a6f640 1 --2- 172.21.15.114:0/1004708782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02850 0x562a67a06020 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f42e000c160 tx=0x7f42e002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecf5697e143be8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42cffff640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:39:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42cffff640 1 -- 172.21.15.114:0/1004708782 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0049040 con 0x562a67a02850 2023-11-04T01:39:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42fa066740 1 -- 172.21.15.114:0/1004708782 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f42e002ce10 con 0x562a67a02850 2023-11-04T01:39:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42cffff640 1 -- 172.21.15.114:0/1004708782 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f42e0040850 con 0x562a67a02850 2023-11-04T01:39:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42cffff640 1 -- 172.21.15.114:0/1004708782 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42e006e480 con 0x562a67a02850 2023-11-04T01:39:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42fa066740 10 client.7140 fetch_fsmap learned FSMap version 35 2023-11-04T01:39:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42fa066740 1 -- 172.21.15.114:0/1004708782 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x562a67903500 con 0x562a67a02850 2023-11-04T01:39:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42cffff640 1 -- 172.21.15.114:0/1004708782 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e0077070 con 0x562a67a02850 2023-11-04T01:39:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42cffff640 1 -- 172.21.15.114:0/1004708782 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 35) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f42e006e5e0 con 0x562a67a02850 2023-11-04T01:39:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42fa066740 10 client.7140 fetch_fsmap finished waiting for FSMap version 35 2023-11-04T01:39:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42fa066740 10 client.7140 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:39:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42fa066740 20 client.7140 populate_metadata read hostname 'smithi114' 2023-11-04T01:39:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42fa066740 1 --2- 172.21.15.114:0/1004708782 >> [v2:172.21.15.141:6832/1471552462,v1:172.21.15.141:6834/1471552462] conn(0x562a67a1b1b0 0x562a67a164b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42fa066740 4 client.7140 mds_command: new command op to 6966 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:39:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42fa066740 1 -- 172.21.15.114:0/1004708782 --> [v2:172.21.15.141:6832/1471552462,v1:172.21.15.141:6834/1471552462] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562a6793a5b0 con 0x562a67a1b1b0 2023-11-04T01:39:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.223+0000 7f42f5270640 1 --2- 172.21.15.114:0/1004708782 >> [v2:172.21.15.141:6832/1471552462,v1:172.21.15.141:6834/1471552462] conn(0x562a67a1b1b0 0x562a67a164b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42cffff640 10 client.7140 ms_handle_connect on v2:172.21.15.141:6832/1471552462 2023-11-04T01:39:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42f5270640 1 --2- 172.21.15.114:0/1004708782 >> [v2:172.21.15.141:6832/1471552462,v1:172.21.15.141:6834/1471552462] conn(0x562a67a1b1b0 0x562a67a164b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=462363eee25f3cfb server_cookie=e6afb755999f7dfa in_seq=0 out_seq=0 2023-11-04T01:39:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42cffff640 1 -- 172.21.15.114:0/1004708782 <== mds.0 v2:172.21.15.141:6832/1471552462 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x562a6793a5b0 con 0x562a67a1b1b0 2023-11-04T01:39:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42cffff640 10 client.7140 handle_command_reply: tid=0 2023-11-04T01:39:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42fa066740 1 client.7140 shutdown 2023-11-04T01:39:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42fa066740 1 -- 172.21.15.114:0/1004708782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02850 msgr2=0x562a67a06020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42fa066740 1 --2- 172.21.15.114:0/1004708782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02850 0x562a67a06020 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f42e000c160 tx=0x7f42e002e070 comp rx=0 tx=0).stop 2023-11-04T01:39:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42fa066740 1 -- 172.21.15.114:0/1004708782 shutdown_connections 2023-11-04T01:39:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42fa066740 1 --2- 172.21.15.114:0/1004708782 >> [v2:172.21.15.141:6832/1471552462,v1:172.21.15.141:6834/1471552462] conn(0x562a67a1b1b0 0x562a67a164b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42fa066740 1 --2- 172.21.15.114:0/1004708782 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x562a67a02c30 0x562a67a15f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42fa066740 1 --2- 172.21.15.114:0/1004708782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a67a02850 0x562a67a06020 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42cffff640 0 client.7140 ms_handle_reset on v2:172.21.15.141:6832/1471552462 2023-11-04T01:39:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42fa066740 1 --2- 172.21.15.114:0/1004708782 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x562a679d5c90 0x562a67a05ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42fa066740 1 -- 172.21.15.114:0/1004708782 >> 172.21.15.114:0/1004708782 conn(0x562a67a012d0 msgr2=0x562a679d9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42fa066740 1 -- 172.21.15.114:0/1004708782 shutdown_connections 2023-11-04T01:39:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42fa066740 1 -- 172.21.15.114:0/1004708782 wait complete. 2023-11-04T01:39:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.224+0000 7f42fa066740 20 client.7140 trim_cache size 0 max 16384 2023-11-04T01:39:27.232 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:39:27.233 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:39:27.233 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-11-04T01:39:27.233 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 6966, 2023-11-04T01:39:27.233 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:39:27.233 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:39:27.233 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:39:27.233 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 4.5590259389999996, 2023-11-04T01:39:27.233 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 35, 2023-11-04T01:39:27.233 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 83, 2023-11-04T01:39:27.233 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 83, 2023-11-04T01:39:27.233 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 10.632965245999999 2023-11-04T01:39:27.233 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:39:27.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.225+0000 7f42f74d4640 1 -- 172.21.15.114:0/1136659461 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f42d406ae70 msgr2=0x7f42d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.225+0000 7f42f74d4640 1 --2- 172.21.15.114:0/1136659461 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f42d406ae70 0x7f42d406d330 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f42e0034000 tx=0x7f42e0007000 comp rx=0 tx=0).stop 2023-11-04T01:39:27.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.225+0000 7f42f74d4640 1 -- 172.21.15.114:0/1136659461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42dc003f20 msgr2=0x7f42f01584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.225+0000 7f42f74d4640 1 --2- 172.21.15.114:0/1136659461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42dc003f20 0x7f42f01584f0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00f7a0 tx=0x7f42ec00fc60 comp rx=0 tx=0).stop 2023-11-04T01:39:27.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.225+0000 7f42f74d4640 1 -- 172.21.15.114:0/1136659461 shutdown_connections 2023-11-04T01:39:27.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.225+0000 7f42f74d4640 1 --2- 172.21.15.114:0/1136659461 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42f01f33e0 0x7f42f01f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.225+0000 7f42f74d4640 1 --2- 172.21.15.114:0/1136659461 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f42d406ae70 0x7f42d406d330 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.225+0000 7f42f74d4640 1 --2- 172.21.15.114:0/1136659461 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42f0149420 0x7f42f01f2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.225+0000 7f42f74d4640 1 --2- 172.21.15.114:0/1136659461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42dc003f20 0x7f42f01584f0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.225+0000 7f42f74d4640 1 -- 172.21.15.114:0/1136659461 >> 172.21.15.114:0/1136659461 conn(0x7f42f00ce950 msgr2=0x7f42f015c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:27.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.225+0000 7f42f74d4640 1 -- 172.21.15.114:0/1136659461 shutdown_connections 2023-11-04T01:39:27.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.225+0000 7f42f74d4640 1 -- 172.21.15.114:0/1136659461 wait complete. 2023-11-04T01:39:27.237 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:39:27.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.334+0000 7f461906f640 1 Processor -- start 2023-11-04T01:39:27.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.334+0000 7f461906f640 1 -- start start 2023-11-04T01:39:27.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.335+0000 7f461906f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f46140aec80 0x7f46140b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.335+0000 7f461906f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46140af060 0x7f461406a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.335+0000 7f461906f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46140b1590 con 0x7f461406ef40 2023-11-04T01:39:27.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.335+0000 7f461906f640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4614155a40 con 0x7f46140aec80 2023-11-04T01:39:27.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.335+0000 7f461906f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461406a660 con 0x7f46140af060 2023-11-04T01:39:27.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.335+0000 7f461359e640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f461406ef40 0x7f46140cb7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35094/0 (socket says 172.21.15.114:35094) 2023-11-04T01:39:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.335+0000 7f461359e640 1 -- 172.21.15.114:0/2030951127 learned_addr learned my addr 172.21.15.114:0/2030951127 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.335+0000 7f460a59c640 1 --2- 172.21.15.114:0/2030951127 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46140af060 0x7f461406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.335+0000 7f461259c640 1 -- 172.21.15.114:0/2030951127 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197710922 0 0) 0x7f46140b1590 con 0x7f461406ef40 2023-11-04T01:39:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.335+0000 7f4612d9d640 1 --2- 172.21.15.114:0/2030951127 >> v2:172.21.15.141:3300/0 conn(0x7f46140aec80 0x7f46140b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.335+0000 7f461259c640 1 -- 172.21.15.114:0/2030951127 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4600003520 con 0x7f461406ef40 2023-11-04T01:39:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461259c640 1 -- 172.21.15.114:0/2030951127 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3084133595 0 0) 0x7f4600003520 con 0x7f461406ef40 2023-11-04T01:39:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461259c640 1 -- 172.21.15.114:0/2030951127 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46140af060 msgr2=0x7f461406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461259c640 1 --2- 172.21.15.114:0/2030951127 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46140af060 0x7f461406a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461259c640 1 -- 172.21.15.114:0/2030951127 >> v2:172.21.15.141:3300/0 conn(0x7f46140aec80 msgr2=0x7f46140b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461259c640 1 --2- 172.21.15.114:0/2030951127 >> v2:172.21.15.141:3300/0 conn(0x7f46140aec80 0x7f46140b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461259c640 1 -- 172.21.15.114:0/2030951127 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461406a8e0 con 0x7f461406ef40 2023-11-04T01:39:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461259c640 1 -- 172.21.15.114:0/2030951127 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f460c0019f0 con 0x7f461406ef40 2023-11-04T01:39:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461259c640 1 -- 172.21.15.114:0/2030951127 >> v1:172.21.15.114:6789/0 conn(0x7f461406ef40 legacy=0x7f46140cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461259c640 1 --2- 172.21.15.114:0/2030951127 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4600003970 0x7f4600003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461259c640 1 --2- 172.21.15.114:0/2030951127 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46140af060 0x7f46000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461259c640 1 --2- 172.21.15.114:0/2030951127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4600004d00 0x7f4600005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461259c640 1 -- 172.21.15.114:0/2030951127 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4614155a40 con 0x7f4600004d00 2023-11-04T01:39:27.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461259c640 1 -- 172.21.15.114:0/2030951127 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461406a660 con 0x7f4600003970 2023-11-04T01:39:27.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461259c640 1 -- 172.21.15.114:0/2030951127 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460000b980 con 0x7f46140af060 2023-11-04T01:39:27.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461359e640 1 --2- 172.21.15.114:0/2030951127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4600004d00 0x7f4600005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f4612d9d640 1 --2- 172.21.15.114:0/2030951127 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4600003970 0x7f4600003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f460a59c640 1 --2- 172.21.15.114:0/2030951127 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46140af060 0x7f46000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461359e640 1 -- 172.21.15.114:0/2030951127 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46140af060 msgr2=0x7f46000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461359e640 1 --2- 172.21.15.114:0/2030951127 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46140af060 0x7f46000047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461359e640 1 -- 172.21.15.114:0/2030951127 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4600003970 msgr2=0x7f4600003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:27.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461359e640 1 --2- 172.21.15.114:0/2030951127 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4600003970 0x7f4600003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.336+0000 7f461359e640 1 -- 172.21.15.114:0/2030951127 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4600003520 con 0x7f4600004d00 2023-11-04T01:39:27.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.337+0000 7f461359e640 1 --2- 172.21.15.114:0/2030951127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4600004d00 0x7f4600005180 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f460c00a860 tx=0x7f46000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec03f630404cc78 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.337+0000 7f461259c640 1 -- 172.21.15.114:0/2030951127 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c034630 con 0x7f4600004d00 2023-11-04T01:39:27.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.337+0000 7f461259c640 1 -- 172.21.15.114:0/2030951127 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c02f070 con 0x7f4600004d00 2023-11-04T01:39:27.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.337+0000 7f461259c640 1 -- 172.21.15.114:0/2030951127 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c034a10 con 0x7f4600004d00 2023-11-04T01:39:27.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.337+0000 7f461906f640 1 -- 172.21.15.114:0/2030951127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4600004d00 msgr2=0x7f4600005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.337+0000 7f461906f640 1 --2- 172.21.15.114:0/2030951127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4600004d00 0x7f4600005180 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f460c00a860 tx=0x7f46000057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.337+0000 7f461359e640 1 -- 172.21.15.114:0/2030951127 reap_dead start 2023-11-04T01:39:27.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.337+0000 7f461906f640 1 -- 172.21.15.114:0/2030951127 shutdown_connections 2023-11-04T01:39:27.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.337+0000 7f461906f640 1 -- 172.21.15.114:0/2030951127 >> 172.21.15.114:0/2030951127 conn(0x7f4614098d40 msgr2=0x7f46140cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:27.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.338+0000 7f461906f640 1 -- 172.21.15.114:0/2030951127 shutdown_connections 2023-11-04T01:39:27.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.338+0000 7f461906f640 1 -- 172.21.15.114:0/2030951127 wait complete. 2023-11-04T01:39:27.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.339+0000 7f461906f640 1 Processor -- start 2023-11-04T01:39:27.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.339+0000 7f461906f640 1 -- start start 2023-11-04T01:39:27.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f461906f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4614154ef0 0x7f46141f0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f461906f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46141552d0 0x7f46141e4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f461906f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46140adae0 0x7f46140adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f461906f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46140ae4d0 con 0x7f46141552d0 2023-11-04T01:39:27.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f461906f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461409d2d0 con 0x7f4614154ef0 2023-11-04T01:39:27.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f461906f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46140b23c0 con 0x7f46140adae0 2023-11-04T01:39:27.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f460a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46141552d0 0x7f46141e4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f460a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46141552d0 0x7f46141e4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50316/0 (socket says 172.21.15.114:50316) 2023-11-04T01:39:27.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f460a59c640 1 -- 172.21.15.114:0/312606875 learned_addr learned my addr 172.21.15.114:0/312606875 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:27.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f461359e640 1 --2- 172.21.15.114:0/312606875 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46140adae0 0x7f46140adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f460a59c640 1 -- 172.21.15.114:0/312606875 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46140adae0 msgr2=0x7f46140adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f4612d9d640 1 --2- 172.21.15.114:0/312606875 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4614154ef0 0x7f46141f0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f460a59c640 1 --2- 172.21.15.114:0/312606875 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46140adae0 0x7f46140adf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f460a59c640 1 -- 172.21.15.114:0/312606875 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4614154ef0 msgr2=0x7f46141f0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f460a59c640 1 --2- 172.21.15.114:0/312606875 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4614154ef0 0x7f46141f0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f460a59c640 1 -- 172.21.15.114:0/312606875 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46140b26a0 con 0x7f46141552d0 2023-11-04T01:39:27.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f460a59c640 1 --2- 172.21.15.114:0/312606875 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46141552d0 0x7f46141e4e90 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009fd0 tx=0x7f45fc011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f460bfff640 1 -- 172.21.15.114:0/312606875 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc009580 con 0x7f46141552d0 2023-11-04T01:39:27.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f460bfff640 1 -- 172.21.15.114:0/312606875 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc00faf0 con 0x7f46141552d0 2023-11-04T01:39:27.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f461906f640 1 -- 172.21.15.114:0/312606875 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46140b2980 con 0x7f46141552d0 2023-11-04T01:39:27.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.340+0000 7f460bfff640 1 -- 172.21.15.114:0/312606875 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc00fe80 con 0x7f46141552d0 2023-11-04T01:39:27.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.341+0000 7f461906f640 1 -- 172.21.15.114:0/312606875 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46140b2f40 con 0x7f46141552d0 2023-11-04T01:39:27.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.342+0000 7f461906f640 1 -- 172.21.15.114:0/312606875 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46140b3100 con 0x7f46141552d0 2023-11-04T01:39:27.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.342+0000 7f460bfff640 1 -- 172.21.15.114:0/312606875 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f45fc014440 con 0x7f46141552d0 2023-11-04T01:39:27.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.343+0000 7f460bfff640 1 --2- 172.21.15.114:0/312606875 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f45f406ae70 0x7f45f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:27.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.343+0000 7f4612d9d640 1 --2- 172.21.15.114:0/312606875 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f45f406ae70 0x7f45f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:27.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.343+0000 7f460bfff640 1 -- 172.21.15.114:0/312606875 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f45fc08a410 con 0x7f46141552d0 2023-11-04T01:39:27.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.343+0000 7f4612d9d640 1 --2- 172.21.15.114:0/312606875 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f45f406ae70 0x7f45f406d330 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f46040099f0 tx=0x7f4604008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:27.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.347+0000 7f460bfff640 1 -- 172.21.15.114:0/312606875 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f45fc054f50 con 0x7f46141552d0 2023-11-04T01:39:27.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.548+0000 7f461906f640 1 -- 172.21.15.114:0/312606875 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4614074290 con 0x7f46141552d0 2023-11-04T01:39:27.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.548+0000 7f460bfff640 1 -- 172.21.15.114:0/312606875 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7f45fc058570 con 0x7f46141552d0 2023-11-04T01:39:27.550 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:39:27.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.550+0000 7f461906f640 1 -- 172.21.15.114:0/312606875 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f45f406ae70 msgr2=0x7f45f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.550+0000 7f461906f640 1 --2- 172.21.15.114:0/312606875 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f45f406ae70 0x7f45f406d330 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f46040099f0 tx=0x7f4604008040 comp rx=0 tx=0).stop 2023-11-04T01:39:27.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.550+0000 7f461906f640 1 -- 172.21.15.114:0/312606875 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46141552d0 msgr2=0x7f46141e4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:27.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.550+0000 7f461906f640 1 --2- 172.21.15.114:0/312606875 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46141552d0 0x7f46141e4e90 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009fd0 tx=0x7f45fc011dc0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.550+0000 7f461906f640 1 -- 172.21.15.114:0/312606875 shutdown_connections 2023-11-04T01:39:27.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.550+0000 7f461906f640 1 --2- 172.21.15.114:0/312606875 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f46140adae0 0x7f46140adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.550+0000 7f461906f640 1 --2- 172.21.15.114:0/312606875 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46141552d0 0x7f46141e4e90 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.550+0000 7f461906f640 1 --2- 172.21.15.114:0/312606875 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f45f406ae70 0x7f45f406d330 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.550+0000 7f461906f640 1 --2- 172.21.15.114:0/312606875 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4614154ef0 0x7f46141f0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:27.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.550+0000 7f461906f640 1 -- 172.21.15.114:0/312606875 >> 172.21.15.114:0/312606875 conn(0x7f4614098d40 msgr2=0x7f46140ace80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:27.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.550+0000 7f461906f640 1 -- 172.21.15.114:0/312606875 shutdown_connections 2023-11-04T01:39:27.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:27.550+0000 7f461906f640 1 -- 172.21.15.114:0/312606875 wait complete. 2023-11-04T01:39:27.562 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:39:27.563 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:39:27.563 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-11-04T01:39:27.563 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:39:27.563 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:27.563 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:39:27.563 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:39:27.563 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:39:27.563 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:39:27.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:27.563 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-11-04T01:39:27.578 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:39:27.578 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:39:27.578 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:39:27.578 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:27.579 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-04T01:39:27.579 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:27.579 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:39:27.579 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:27.579 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-11-04T01:39:27.579 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:39:27.579 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:27.579 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-11-04T01:39:27.579 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:39:27.579 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:27.579 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:39:27.579 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:27.579 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:39:27.580 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42308sec preferred_lft 42308sec 2023-11-04T01:39:27.580 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-11-04T01:39:27.580 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:27.580 INFO:teuthology.orchestra.run.smithi114.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:39:27.580 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 7e:72:41:ca:70:95 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:27.580 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:39:27.580 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:27.580 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9c8d:d6ff:fe6f:d555/64 scope link 2023-11-04T01:39:27.580 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:27.580 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:39:27.580 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether f6:4c:1e:67:08:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:27.580 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::f44c:1eff:fe67:85a/64 scope link 2023-11-04T01:39:27.580 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:27.580 INFO:teuthology.orchestra.run.smithi114.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:39:27.580 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 7e:72:41:ca:70:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:27.581 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::7c72:41ff:feca:7095/64 scope link 2023-11-04T01:39:27.581 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:27.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:27.581 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:39:27.644 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-11-04T01:39:27.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:27.646 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-11-04T01:39:27.701 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-11-04T01:39:27.701 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:39:27.702 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:39:27.702 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:39:27.702 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:39:27.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:27.702 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:39:27.702 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:39:27.702 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:39:27.702 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:39:27.703 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:39:27.703 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:39:27.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:27.796 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-04T01:39:27.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:39:27.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:39:27.811 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:39:27.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:27.811 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-11-04T01:39:27.877 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:39:27.877 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:39:27.877 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:27.932 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:39:27.932 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:39:27.932 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:27.986 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:39:28.042 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:39:28.042 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:39:28.042 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:39:28.042 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:39:28.042 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:39:28.042 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:39:28.042 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:39:28.042 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:39:28.043 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:39:28.043 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:39:28.043 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:39:28.043 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:39:28.043 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:39:28.043 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:39:28.043 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:39:28.043 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:39:28.043 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:39:28.043 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:39:28.043 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:39:28.044 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:39:28.044 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:39:28.044 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:39:28.044 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:39:28.044 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:39:28.044 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:39:28.044 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:39:28.044 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:39:28.044 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:39:28.044 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:39:28.044 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:39:28.044 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:28.045 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:28.045 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:28.045 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:28.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:28.045 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:39:28.097 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:39:28.097 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:39:28.140 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:39:28.155 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:39:28.155 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:39:28.155 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:39:28.155 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:39:28.155 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:39:28.155 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:39:28.155 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:39:28.156 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:39:28.156 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:39:28.156 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:39:28.156 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:39:28.156 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:39:28.156 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:39:28.156 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:39:28.156 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:39:28.156 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:39:28.156 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:39:28.156 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:39:28.156 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:39:28.156 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:39:28.157 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:39:28.157 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:39:28.157 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:39:28.157 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:39:28.157 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:39:28.157 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:39:28.157 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:39:28.157 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:39:28.157 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:39:28.157 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:39:28.157 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:28.157 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:28.157 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:28.158 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:28.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:28.158 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:39:28.230 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:39:28.228+0000 7f0cace38480 -1 init, newargv = 0x55bc3fe42880 newargc=15 2023-11-04T01:39:28.230 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[114784]: starting ceph client 2023-11-04T01:39:28.234 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[114784]: starting fuse 2023-11-04T01:39:29.313 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:39:29.333 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:39:29.333 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:39:29.333 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:39:29.333 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:39:29.333 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:39:29.334 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:39:29.334 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:39:29.334 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:39:29.334 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:39:29.334 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:39:29.334 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:39:29.334 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:39:29.334 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:39:29.334 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:39:29.334 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:39:29.334 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:39:29.334 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:39:29.335 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:39:29.335 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:39:29.335 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:39:29.335 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:39:29.335 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:39:29.335 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:39:29.335 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:39:29.335 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:39:29.335 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:39:29.335 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:39:29.335 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:39:29.335 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:39:29.336 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:39:29.336 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:29.336 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:29.336 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:29.336 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:29.336 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:29.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:29.336 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:39:29.391 INFO:teuthology.orchestra.run.smithi114.stdout:41 2023-11-04T01:39:29.392 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:39:29.392 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:39:29.392 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2023-11-04T01:39:29.392 DEBUG:teuthology.orchestra.run.smithi114:> import re 2023-11-04T01:39:29.392 DEBUG:teuthology.orchestra.run.smithi114:> import os 2023-11-04T01:39:29.392 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2023-11-04T01:39:29.392 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:39:29.392 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2023-11-04T01:39:29.392 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:39:29.392 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2023-11-04T01:39:29.392 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:39:29.392 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:39:29.393 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2023-11-04T01:39:29.393 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2023-11-04T01:39:29.393 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2023-11-04T01:39:29.393 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2023-11-04T01:39:29.393 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:39:29.393 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2023-11-04T01:39:29.393 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:39:29.393 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:39:29.393 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:39:29.393 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2023-11-04T01:39:29.394 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2023-11-04T01:39:29.394 DEBUG:teuthology.orchestra.run.smithi114:> return f 2023-11-04T01:39:29.394 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:39:29.394 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:39:29.394 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.0")) 2023-11-04T01:39:29.394 DEBUG:teuthology.orchestra.run.smithi114:> ' 2023-11-04T01:39:29.520 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.0.114784.asok 2023-11-04T01:39:29.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:29.530 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.114784.asok 2023-11-04T01:39:29.531 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:29.531 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.114784.asok status 2023-11-04T01:39:29.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:29.701 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:39:29.701 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2023-11-04T01:39:29.702 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:39:29.702 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:39:29.702 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "0", 2023-11-04T01:39:29.702 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2023-11-04T01:39:29.702 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:39:29.702 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "114784", 2023-11-04T01:39:29.702 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2023-11-04T01:39:29.702 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:29.702 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2023-11-04T01:39:29.702 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2023-11-04T01:39:29.702 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 7155, 2023-11-04T01:39:29.702 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2023-11-04T01:39:29.703 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2023-11-04T01:39:29.703 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2023-11-04T01:39:29.703 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 7155 2023-11-04T01:39:29.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:29.703 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:39:29.703 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:39:29.703 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:39:29.703 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2900103495 2023-11-04T01:39:29.703 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:29.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:29.703 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:39:29.703 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:39:29.704 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:39:29.704 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2900103495 2023-11-04T01:39:29.704 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:29.704 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.7155 192.168.0.1:0/2900103495", 2023-11-04T01:39:29.704 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "192.168.0.1:0/2900103495", 2023-11-04T01:39:29.704 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2023-11-04T01:39:29.704 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 35, 2023-11-04T01:39:29.704 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 83, 2023-11-04T01:39:29.704 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:39:29.704 INFO:teuthology.orchestra.run.smithi114.stdout: "blocklisted": false, 2023-11-04T01:39:29.704 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2023-11-04T01:39:29.704 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:39:29.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:29.715 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:29.716 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:39:29.716 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:29.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:29.774 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2023-11-04T01:39:29.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:29.781 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:29.781 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:29.781 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:29.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:29.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:29.847 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_max_snaps_per_dir 2023-11-04T01:39:29.959 INFO:teuthology.orchestra.run.smithi114.stdout:{"mds_max_snaps_per_dir":"100"} 2023-11-04T01:39:29.960 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_snaps_per_dir": "100" } 2023-11-04T01:39:29.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:29.960 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps) 2023-11-04T01:39:29.981 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps false --yes-i-really-mean-it 2023-11-04T01:39:30.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.122+0000 7f0a04b90640 1 Processor -- start 2023-11-04T01:39:30.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.122+0000 7f0a04b90640 1 -- start start 2023-11-04T01:39:30.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.123+0000 7f0a04b90640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0a00159be0 0x7f0a000c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.123+0000 7f0a04b90640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a0015e420 0x7f0a000ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.123+0000 7f0a04b90640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a000c4850 con 0x7f0a000adc70 2023-11-04T01:39:30.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.123+0000 7f0a04b90640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a000ae100 con 0x7f0a00159be0 2023-11-04T01:39:30.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.123+0000 7f0a04b90640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a000c5890 con 0x7f0a0015e420 2023-11-04T01:39:30.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.123+0000 7f09fe59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0a00159be0 0x7f0a000c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.123+0000 7f09fe59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0a00159be0 0x7f0a000c4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50320/0 (socket says 172.21.15.114:50320) 2023-11-04T01:39:30.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.123+0000 7f09fed9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0a000adc70 0x7f0a000cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35110/0 (socket says 172.21.15.114:35110) 2023-11-04T01:39:30.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.123+0000 7f09fe59c640 1 -- 172.21.15.114:0/3443241177 learned_addr learned my addr 172.21.15.114:0/3443241177 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:30.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.123+0000 7f09fe59c640 1 -- 172.21.15.114:0/3443241177 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a0015e420 msgr2=0x7f0a000ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:30.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.123+0000 7f09f7fff640 1 --2- 172.21.15.114:0/3443241177 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a0015e420 0x7f0a000ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.123+0000 7f09fe59c640 1 --2- 172.21.15.114:0/3443241177 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a0015e420 0x7f0a000ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.123+0000 7f09fe59c640 1 -- 172.21.15.114:0/3443241177 >> v1:172.21.15.114:6789/0 conn(0x7f0a000adc70 legacy=0x7f0a000cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.123+0000 7f09fdd9b640 1 -- 172.21.15.114:0/3443241177 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502300955 0 0) 0x7f0a000c4850 con 0x7f0a000adc70 2023-11-04T01:39:30.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.123+0000 7f09fe59c640 1 -- 172.21.15.114:0/3443241177 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a000cd8e0 con 0x7f0a00159be0 2023-11-04T01:39:30.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.123+0000 7f09f7fff640 1 --2- 172.21.15.114:0/3443241177 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a0015e420 0x7f0a000ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:30.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.124+0000 7f09fe59c640 1 --2- 172.21.15.114:0/3443241177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a00159be0 0x7f0a000c4f60 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009870 tx=0x7f09f002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b719f473359a8ce5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:30.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.124+0000 7f09fdd9b640 1 -- 172.21.15.114:0/3443241177 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f0031640 con 0x7f0a00159be0 2023-11-04T01:39:30.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.124+0000 7f09fdd9b640 1 -- 172.21.15.114:0/3443241177 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f00317a0 con 0x7f0a00159be0 2023-11-04T01:39:30.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.124+0000 7f09fdd9b640 1 -- 172.21.15.114:0/3443241177 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f0031b30 con 0x7f0a00159be0 2023-11-04T01:39:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.124+0000 7f0a04b90640 1 -- 172.21.15.114:0/3443241177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a00159be0 msgr2=0x7f0a000c4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.124+0000 7f0a04b90640 1 --2- 172.21.15.114:0/3443241177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a00159be0 0x7f0a000c4f60 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009870 tx=0x7f09f002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.125+0000 7f0a04b90640 1 -- 172.21.15.114:0/3443241177 shutdown_connections 2023-11-04T01:39:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.125+0000 7f0a04b90640 1 --2- 172.21.15.114:0/3443241177 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a0015e420 0x7f0a000ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.125+0000 7f0a04b90640 1 --2- 172.21.15.114:0/3443241177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a00159be0 0x7f0a000c4f60 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.125+0000 7f0a04b90640 1 -- 172.21.15.114:0/3443241177 >> 172.21.15.114:0/3443241177 conn(0x7f0a000b05d0 msgr2=0x7f0a000b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.125+0000 7f0a04b90640 1 -- 172.21.15.114:0/3443241177 shutdown_connections 2023-11-04T01:39:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.125+0000 7f0a04b90640 1 -- 172.21.15.114:0/3443241177 wait complete. 2023-11-04T01:39:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.126+0000 7f0a04b90640 1 Processor -- start 2023-11-04T01:39:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.126+0000 7f0a04b90640 1 -- start start 2023-11-04T01:39:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f0a04b90640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a000adc70 0x7f0a0014b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f0a04b90640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a00159be0 0x7f0a0015b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f0a04b90640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0a0015e420 0x7f0a00158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f0a04b90640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a00159460 con 0x7f0a000adc70 2023-11-04T01:39:30.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f0a04b90640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a001546e0 con 0x7f0a0015e420 2023-11-04T01:39:30.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f0a04b90640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a001540d0 con 0x7f0a00159be0 2023-11-04T01:39:30.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f09fe59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a000adc70 0x7f0a0014b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f09fe59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a000adc70 0x7f0a0014b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50326/0 (socket says 172.21.15.114:50326) 2023-11-04T01:39:30.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f09fe59c640 1 -- 172.21.15.114:0/1354271682 learned_addr learned my addr 172.21.15.114:0/1354271682 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:30.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f09fe59c640 1 -- 172.21.15.114:0/1354271682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a00159be0 msgr2=0x7f0a0015b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f09fe59c640 1 --2- 172.21.15.114:0/1354271682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a00159be0 0x7f0a0015b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f09fe59c640 1 -- 172.21.15.114:0/1354271682 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0a0015e420 msgr2=0x7f0a00158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f09fe59c640 1 --2- 172.21.15.114:0/1354271682 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0a0015e420 0x7f0a00158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f09fe59c640 1 -- 172.21.15.114:0/1354271682 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f00094d0 con 0x7f0a000adc70 2023-11-04T01:39:30.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f09fe59c640 1 --2- 172.21.15.114:0/1354271682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a000adc70 0x7f0a0014b640 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f09f0000c00 tx=0x7f09f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:30.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f09f6ffd640 1 -- 172.21.15.114:0/1354271682 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f003ac60 con 0x7f0a000adc70 2023-11-04T01:39:30.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f09f6ffd640 1 -- 172.21.15.114:0/1354271682 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f003ade0 con 0x7f0a000adc70 2023-11-04T01:39:30.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f09f6ffd640 1 -- 172.21.15.114:0/1354271682 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f0044630 con 0x7f0a000adc70 2023-11-04T01:39:30.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f0a04b90640 1 -- 172.21.15.114:0/1354271682 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0015bc90 con 0x7f0a000adc70 2023-11-04T01:39:30.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.127+0000 7f0a04b90640 1 -- 172.21.15.114:0/1354271682 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0015bf70 con 0x7f0a000adc70 2023-11-04T01:39:30.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.128+0000 7f0a04b90640 1 -- 172.21.15.114:0/1354271682 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0004e490 con 0x7f0a000adc70 2023-11-04T01:39:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.129+0000 7f09f6ffd640 1 -- 172.21.15.114:0/1354271682 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f09f002f050 con 0x7f0a000adc70 2023-11-04T01:39:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.129+0000 7f09f6ffd640 1 --2- 172.21.15.114:0/1354271682 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f09e006ae70 0x7f09e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.129+0000 7f09f7fff640 1 --2- 172.21.15.114:0/1354271682 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f09e006ae70 0x7f09e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.129+0000 7f09f6ffd640 1 -- 172.21.15.114:0/1354271682 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f09f00abcf0 con 0x7f0a000adc70 2023-11-04T01:39:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.130+0000 7f09f7fff640 1 --2- 172.21.15.114:0/1354271682 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f09e006ae70 0x7f09e006d330 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0a00158c10 tx=0x7f09e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:30.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.133+0000 7f09f6ffd640 1 -- 172.21.15.114:0/1354271682 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f09f00b0070 con 0x7f0a000adc70 2023-11-04T01:39:30.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.334+0000 7f0a04b90640 1 -- 172.21.15.114:0/1354271682 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0a000c4d40 con 0x7f0a000adc70 2023-11-04T01:39:30.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.698+0000 7f09f6ffd640 1 -- 172.21.15.114:0/1354271682 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false", "yes_i_really_mean_it": true}]=0 disabled new snapshots v36) v1 ==== 169+0+0 (secure 0 0 0) 0x7f09f00350d0 con 0x7f0a000adc70 2023-11-04T01:39:30.700 INFO:teuthology.orchestra.run.smithi114.stderr:disabled new snapshots 2023-11-04T01:39:30.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.700+0000 7f0a04b90640 1 -- 172.21.15.114:0/1354271682 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f09e006ae70 msgr2=0x7f09e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.700+0000 7f0a04b90640 1 --2- 172.21.15.114:0/1354271682 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f09e006ae70 0x7f09e006d330 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0a00158c10 tx=0x7f09e8008040 comp rx=0 tx=0).stop 2023-11-04T01:39:30.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.700+0000 7f0a04b90640 1 -- 172.21.15.114:0/1354271682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a000adc70 msgr2=0x7f0a0014b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.700+0000 7f0a04b90640 1 --2- 172.21.15.114:0/1354271682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a000adc70 0x7f0a0014b640 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f09f0000c00 tx=0x7f09f00046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.700+0000 7f0a04b90640 1 -- 172.21.15.114:0/1354271682 shutdown_connections 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.700+0000 7f0a04b90640 1 --2- 172.21.15.114:0/1354271682 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f09e006ae70 0x7f09e006d330 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.700+0000 7f0a04b90640 1 --2- 172.21.15.114:0/1354271682 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0a0015e420 0x7f0a00158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.700+0000 7f0a04b90640 1 --2- 172.21.15.114:0/1354271682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0a00159be0 0x7f0a0015b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.700+0000 7f0a04b90640 1 --2- 172.21.15.114:0/1354271682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a000adc70 0x7f0a0014b640 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.700+0000 7f0a04b90640 1 -- 172.21.15.114:0/1354271682 >> 172.21.15.114:0/1354271682 conn(0x7f0a000b05d0 msgr2=0x7f0a0015ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.700+0000 7f0a04b90640 1 -- 172.21.15.114:0/1354271682 shutdown_connections 2023-11-04T01:39:30.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.700+0000 7f0a04b90640 1 -- 172.21.15.114:0/1354271682 wait complete. 2023-11-04T01:39:30.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:30.713 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps/.snap/snap00) 2023-11-04T01:39:30.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:30.731 INFO:teuthology.orchestra.run.smithi114.stderr:mkdir: cannot create directory ‘test-allow-snaps/.snap/snap00’: Operation not permitted 2023-11-04T01:39:30.731 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-11-04T01:39:30.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.873+0000 7fef1f36c640 1 Processor -- start 2023-11-04T01:39:30.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.874+0000 7fef1f36c640 1 -- start start 2023-11-04T01:39:30.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.874+0000 7fef1f36c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fef180cd9f0 0x7fef180cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.874+0000 7fef1f36c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fef180d27c0 0x7fef1815d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.874+0000 7fef1f36c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef180d1320 con 0x7fef1815d4b0 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.874+0000 7fef1f36c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1815e4d0 con 0x7fef180d27c0 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.874+0000 7fef1f36c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef180ce310 con 0x7fef180cd9f0 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.875+0000 7fef1d909640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fef180d27c0 0x7fef1815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.875+0000 7fef1c907640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fef1815d4b0 0x7fef180b47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35124/0 (socket says 172.21.15.114:35124) 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.875+0000 7fef1c907640 1 -- 172.21.15.114:0/252385009 learned_addr learned my addr 172.21.15.114:0/252385009 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.875+0000 7fef1d909640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fef180d27c0 0x7fef1815d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50338/0 (socket says 172.21.15.114:50338) 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.875+0000 7fef1d108640 1 --2- 172.21.15.114:0/252385009 >> v2:172.21.15.141:3300/0 conn(0x7fef180cd9f0 0x7fef180cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.875+0000 7fef1d909640 1 -- 172.21.15.114:0/252385009 >> v2:172.21.15.141:3300/0 conn(0x7fef180cd9f0 msgr2=0x7fef180cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.875+0000 7fef1d909640 1 --2- 172.21.15.114:0/252385009 >> v2:172.21.15.141:3300/0 conn(0x7fef180cd9f0 0x7fef180cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.875+0000 7fef1d909640 1 -- 172.21.15.114:0/252385009 >> v1:172.21.15.114:6789/0 conn(0x7fef1815d4b0 legacy=0x7fef180b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.875+0000 7fef1d909640 1 -- 172.21.15.114:0/252385009 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1815df10 con 0x7fef180d27c0 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.875+0000 7fef1d909640 1 --2- 172.21.15.114:0/252385009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef180d27c0 0x7fef1815d910 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fef10009d90 tx=0x7fef1002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae13187a1725d8b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.876+0000 7fef0ffff640 1 -- 172.21.15.114:0/252385009 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1002cd00 con 0x7fef180d27c0 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.876+0000 7fef0ffff640 1 -- 172.21.15.114:0/252385009 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1002ce60 con 0x7fef180d27c0 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.876+0000 7fef0ffff640 1 -- 172.21.15.114:0/252385009 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10034660 con 0x7fef180d27c0 2023-11-04T01:39:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.876+0000 7fef1f36c640 1 -- 172.21.15.114:0/252385009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef180d27c0 msgr2=0x7fef1815d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.876+0000 7fef1f36c640 1 --2- 172.21.15.114:0/252385009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef180d27c0 0x7fef1815d910 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fef10009d90 tx=0x7fef1002bf50 comp rx=0 tx=0).stop 2023-11-04T01:39:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.876+0000 7fef1f36c640 1 -- 172.21.15.114:0/252385009 shutdown_connections 2023-11-04T01:39:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.876+0000 7fef1f36c640 1 --2- 172.21.15.114:0/252385009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef180d27c0 0x7fef1815d910 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.876+0000 7fef1f36c640 1 --2- 172.21.15.114:0/252385009 >> v2:172.21.15.141:3300/0 conn(0x7fef180cd9f0 0x7fef180cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.876+0000 7fef1f36c640 1 -- 172.21.15.114:0/252385009 >> 172.21.15.114:0/252385009 conn(0x7fef18071c40 msgr2=0x7fef18072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.876+0000 7fef1f36c640 1 -- 172.21.15.114:0/252385009 shutdown_connections 2023-11-04T01:39:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.876+0000 7fef1f36c640 1 -- 172.21.15.114:0/252385009 wait complete. 2023-11-04T01:39:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.877+0000 7fef1f36c640 1 Processor -- start 2023-11-04T01:39:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.877+0000 7fef1f36c640 1 -- start start 2023-11-04T01:39:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.878+0000 7fef1f36c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef180cd9f0 0x7fef18151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.878+0000 7fef1f36c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef180d27c0 0x7fef18158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.878+0000 7fef1f36c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef1815d4b0 0x7fef180c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.878+0000 7fef1f36c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef18158af0 con 0x7fef1815d4b0 2023-11-04T01:39:30.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.878+0000 7fef1f36c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef18158dd0 con 0x7fef180cd9f0 2023-11-04T01:39:30.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.878+0000 7fef1f36c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef181590b0 con 0x7fef180d27c0 2023-11-04T01:39:30.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.878+0000 7fef1d909640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef1815d4b0 0x7fef180c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.878+0000 7fef1d909640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef1815d4b0 0x7fef180c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50344/0 (socket says 172.21.15.114:50344) 2023-11-04T01:39:30.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.878+0000 7fef1d909640 1 -- 172.21.15.114:0/3765406650 learned_addr learned my addr 172.21.15.114:0/3765406650 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:30.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.878+0000 7fef1d108640 1 --2- 172.21.15.114:0/3765406650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef180cd9f0 0x7fef18151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.878+0000 7fef1c907640 1 --2- 172.21.15.114:0/3765406650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef180d27c0 0x7fef18158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.879+0000 7fef1d909640 1 -- 172.21.15.114:0/3765406650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef180d27c0 msgr2=0x7fef18158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.879+0000 7fef1d909640 1 --2- 172.21.15.114:0/3765406650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef180d27c0 0x7fef18158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.879+0000 7fef1d909640 1 -- 172.21.15.114:0/3765406650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef180cd9f0 msgr2=0x7fef18151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.879+0000 7fef1d909640 1 --2- 172.21.15.114:0/3765406650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef180cd9f0 0x7fef18151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.879+0000 7fef1d909640 1 -- 172.21.15.114:0/3765406650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef10009a70 con 0x7fef1815d4b0 2023-11-04T01:39:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.879+0000 7fef1d909640 1 --2- 172.21.15.114:0/3765406650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef1815d4b0 0x7fef180c85f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fef10009d90 tx=0x7fef10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.879+0000 7fef0dffb640 1 -- 172.21.15.114:0/3765406650 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1003d600 con 0x7fef1815d4b0 2023-11-04T01:39:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.879+0000 7fef0dffb640 1 -- 172.21.15.114:0/3765406650 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1003d780 con 0x7fef1815d4b0 2023-11-04T01:39:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.879+0000 7fef1f36c640 1 -- 172.21.15.114:0/3765406650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef180cb2d0 con 0x7fef1815d4b0 2023-11-04T01:39:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.879+0000 7fef0dffb640 1 -- 172.21.15.114:0/3765406650 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1003db30 con 0x7fef1815d4b0 2023-11-04T01:39:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.879+0000 7fef1f36c640 1 -- 172.21.15.114:0/3765406650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef180c8b30 con 0x7fef1815d4b0 2023-11-04T01:39:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.880+0000 7fef1f36c640 1 -- 172.21.15.114:0/3765406650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef180cb130 con 0x7fef1815d4b0 2023-11-04T01:39:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.880+0000 7fef0dffb640 1 -- 172.21.15.114:0/3765406650 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef1003b040 con 0x7fef1815d4b0 2023-11-04T01:39:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.881+0000 7fef0dffb640 1 --2- 172.21.15.114:0/3765406650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feefc06ae70 0x7feefc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.881+0000 7fef0dffb640 1 -- 172.21.15.114:0/3765406650 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fef100ac1e0 con 0x7fef1815d4b0 2023-11-04T01:39:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.881+0000 7fef1d108640 1 --2- 172.21.15.114:0/3765406650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feefc06ae70 0x7feefc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.881+0000 7fef1d108640 1 --2- 172.21.15.114:0/3765406650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feefc06ae70 0x7feefc06d330 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fef14006fd0 tx=0x7fef14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:30.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:30.885+0000 7fef0dffb640 1 -- 172.21.15.114:0/3765406650 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fef180cb130 con 0x7fef1815d4b0 2023-11-04T01:39:31.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:31.087+0000 7fef1f36c640 1 -- 172.21.15.114:0/3765406650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fef180cb130 con 0x7fef1815d4b0 2023-11-04T01:39:31.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:31.704+0000 7fef0dffb640 1 -- 172.21.15.114:0/3765406650 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v37) v1 ==== 167+0+0 (secure 0 0 0) 0x7fef180cb130 con 0x7fef1815d4b0 2023-11-04T01:39:31.706 INFO:teuthology.orchestra.run.smithi114.stderr:enabled new snapshots 2023-11-04T01:39:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:31.707+0000 7fef1f36c640 1 -- 172.21.15.114:0/3765406650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feefc06ae70 msgr2=0x7feefc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:31.707+0000 7fef1f36c640 1 --2- 172.21.15.114:0/3765406650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feefc06ae70 0x7feefc06d330 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fef14006fd0 tx=0x7fef14008040 comp rx=0 tx=0).stop 2023-11-04T01:39:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:31.707+0000 7fef1f36c640 1 -- 172.21.15.114:0/3765406650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef1815d4b0 msgr2=0x7fef180c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:31.707+0000 7fef1f36c640 1 --2- 172.21.15.114:0/3765406650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef1815d4b0 0x7fef180c85f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fef10009d90 tx=0x7fef10004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:31.707+0000 7fef1f36c640 1 -- 172.21.15.114:0/3765406650 shutdown_connections 2023-11-04T01:39:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:31.707+0000 7fef1f36c640 1 --2- 172.21.15.114:0/3765406650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef1815d4b0 0x7fef180c85f0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:31.707+0000 7fef1f36c640 1 --2- 172.21.15.114:0/3765406650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef180d27c0 0x7fef18158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:31.707+0000 7fef1f36c640 1 --2- 172.21.15.114:0/3765406650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feefc06ae70 0x7feefc06d330 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:31.707+0000 7fef1f36c640 1 --2- 172.21.15.114:0/3765406650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef180cd9f0 0x7fef18151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:31.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:31.707+0000 7fef1f36c640 1 -- 172.21.15.114:0/3765406650 >> 172.21.15.114:0/3765406650 conn(0x7fef18071c40 msgr2=0x7fef180b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:31.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:31.707+0000 7fef1f36c640 1 -- 172.21.15.114:0/3765406650 shutdown_connections 2023-11-04T01:39:31.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:31.707+0000 7fef1f36c640 1 -- 172.21.15.114:0/3765406650 wait complete. 2023-11-04T01:39:31.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:31.721 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps/.snap/snap00) 2023-11-04T01:39:31.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:31.744 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir test-allow-snaps/.snap/snap00) 2023-11-04T01:39:31.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:31.806 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir test-allow-snaps) 2023-11-04T01:39:31.865 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:39:31.865 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:39:31.944 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:39:31.999 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:39:31.999 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:39:31.999 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:32.015 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:32.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.153+0000 7fb31974c640 1 Processor -- start 2023-11-04T01:39:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.153+0000 7fb31974c640 1 -- start start 2023-11-04T01:39:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.153+0000 7fb31974c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb3140ce240 0x7fb314157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.153+0000 7fb31974c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb314157540 0x7fb3140d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.153+0000 7fb31974c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31415e000 con 0x7fb3140cde60 2023-11-04T01:39:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.153+0000 7fb31974c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31415e5c0 con 0x7fb314157540 2023-11-04T01:39:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.153+0000 7fb31974c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31415e2e0 con 0x7fb3140ce240 2023-11-04T01:39:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.154+0000 7fb3137fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb314157540 0x7fb3140d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.154+0000 7fb3137fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb314157540 0x7fb3140d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50360/0 (socket says 172.21.15.114:50360) 2023-11-04T01:39:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.154+0000 7fb3137fe640 1 -- 172.21.15.114:0/1223081573 learned_addr learned my addr 172.21.15.114:0/1223081573 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.154+0000 7fb3127fc640 1 --2- 172.21.15.114:0/1223081573 >> v2:172.21.15.141:3300/0 conn(0x7fb3140ce240 0x7fb314157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.154+0000 7fb3137fe640 1 -- 172.21.15.114:0/1223081573 >> v2:172.21.15.141:3300/0 conn(0x7fb3140ce240 msgr2=0x7fb314157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.154+0000 7fb3137fe640 1 --2- 172.21.15.114:0/1223081573 >> v2:172.21.15.141:3300/0 conn(0x7fb3140ce240 0x7fb314157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.154+0000 7fb3137fe640 1 -- 172.21.15.114:0/1223081573 >> v1:172.21.15.141:6789/0 conn(0x7fb3140cde60 legacy=0x7fb31415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:32.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.154+0000 7fb3137fe640 1 -- 172.21.15.114:0/1223081573 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3140d1120 con 0x7fb314157540 2023-11-04T01:39:32.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.154+0000 7fb3127fc640 1 --2- 172.21.15.114:0/1223081573 >> v2:172.21.15.141:3300/0 conn(0x7fb3140ce240 0x7fb314157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:32.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.155+0000 7fb3137fe640 1 --2- 172.21.15.114:0/1223081573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb314157540 0x7fb3140d1920 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fb3140cf5f0 tx=0x7fb30c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbc8c29e03c5d05 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:32.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.155+0000 7fb311ffb640 1 -- 172.21.15.114:0/1223081573 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c02ca80 con 0x7fb314157540 2023-11-04T01:39:32.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.155+0000 7fb311ffb640 1 -- 172.21.15.114:0/1223081573 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c02cbe0 con 0x7fb314157540 2023-11-04T01:39:32.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.155+0000 7fb311ffb640 1 -- 172.21.15.114:0/1223081573 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c0343f0 con 0x7fb314157540 2023-11-04T01:39:32.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.155+0000 7fb31974c640 1 -- 172.21.15.114:0/1223081573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb314157540 msgr2=0x7fb3140d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.155+0000 7fb31974c640 1 --2- 172.21.15.114:0/1223081573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb314157540 0x7fb3140d1920 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fb3140cf5f0 tx=0x7fb30c02bee0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.155+0000 7fb31974c640 1 -- 172.21.15.114:0/1223081573 shutdown_connections 2023-11-04T01:39:32.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.155+0000 7fb31974c640 1 --2- 172.21.15.114:0/1223081573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb314157540 0x7fb3140d1920 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.155+0000 7fb31974c640 1 --2- 172.21.15.114:0/1223081573 >> v2:172.21.15.141:3300/0 conn(0x7fb3140ce240 0x7fb314157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.155+0000 7fb31974c640 1 -- 172.21.15.114:0/1223081573 >> 172.21.15.114:0/1223081573 conn(0x7fb314071f30 msgr2=0x7fb3140cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:32.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.155+0000 7fb31974c640 1 -- 172.21.15.114:0/1223081573 shutdown_connections 2023-11-04T01:39:32.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.155+0000 7fb31974c640 1 -- 172.21.15.114:0/1223081573 wait complete. 2023-11-04T01:39:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.157+0000 7fb31974c640 1 Processor -- start 2023-11-04T01:39:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.157+0000 7fb31974c640 1 -- start start 2023-11-04T01:39:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.157+0000 7fb31974c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3140cde60 0x7fb3140b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.157+0000 7fb31974c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3140ce240 0x7fb3140b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.157+0000 7fb31974c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb314157540 0x7fb31415c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.157+0000 7fb31974c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb314149260 con 0x7fb3140ce240 2023-11-04T01:39:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.157+0000 7fb31974c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb314159a60 con 0x7fb314157540 2023-11-04T01:39:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.157+0000 7fb31974c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3141594c0 con 0x7fb3140cde60 2023-11-04T01:39:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.157+0000 7fb3127fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3140ce240 0x7fb3140b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.157+0000 7fb3127fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3140ce240 0x7fb3140b4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50372/0 (socket says 172.21.15.114:50372) 2023-11-04T01:39:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.157+0000 7fb3127fc640 1 -- 172.21.15.114:0/509007649 learned_addr learned my addr 172.21.15.114:0/509007649 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.158+0000 7fb3137fe640 1 --2- 172.21.15.114:0/509007649 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb314157540 0x7fb31415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.158+0000 7fb312ffd640 1 --2- 172.21.15.114:0/509007649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3140cde60 0x7fb3140b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.158+0000 7fb3127fc640 1 -- 172.21.15.114:0/509007649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3140cde60 msgr2=0x7fb3140b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.158+0000 7fb3127fc640 1 --2- 172.21.15.114:0/509007649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3140cde60 0x7fb3140b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.158+0000 7fb3127fc640 1 -- 172.21.15.114:0/509007649 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb314157540 msgr2=0x7fb31415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.158+0000 7fb3127fc640 1 --2- 172.21.15.114:0/509007649 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb314157540 0x7fb31415c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.158+0000 7fb3127fc640 1 -- 172.21.15.114:0/509007649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c009b30 con 0x7fb3140ce240 2023-11-04T01:39:32.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.158+0000 7fb312ffd640 1 --2- 172.21.15.114:0/509007649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3140cde60 0x7fb3140b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:32.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.158+0000 7fb3127fc640 1 --2- 172.21.15.114:0/509007649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3140ce240 0x7fb3140b4360 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fb30800c820 tx=0x7fb30800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:32.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.158+0000 7fb2fb7fe640 1 -- 172.21.15.114:0/509007649 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb308007a30 con 0x7fb3140ce240 2023-11-04T01:39:32.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.158+0000 7fb2fb7fe640 1 -- 172.21.15.114:0/509007649 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb308007b90 con 0x7fb3140ce240 2023-11-04T01:39:32.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.158+0000 7fb31974c640 1 -- 172.21.15.114:0/509007649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3141494b0 con 0x7fb3140ce240 2023-11-04T01:39:32.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.158+0000 7fb2fb7fe640 1 -- 172.21.15.114:0/509007649 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30800ce70 con 0x7fb3140ce240 2023-11-04T01:39:32.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.158+0000 7fb31974c640 1 -- 172.21.15.114:0/509007649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb314149a70 con 0x7fb3140ce240 2023-11-04T01:39:32.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.159+0000 7fb31974c640 1 -- 172.21.15.114:0/509007649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb314149c90 con 0x7fb3140ce240 2023-11-04T01:39:32.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.160+0000 7fb2fb7fe640 1 -- 172.21.15.114:0/509007649 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb3080113f0 con 0x7fb3140ce240 2023-11-04T01:39:32.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.160+0000 7fb2fb7fe640 1 --2- 172.21.15.114:0/509007649 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb30006aea0 0x7fb30006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.160+0000 7fb2fb7fe640 1 -- 172.21.15.114:0/509007649 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fb308089cd0 con 0x7fb3140ce240 2023-11-04T01:39:32.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.160+0000 7fb312ffd640 1 --2- 172.21.15.114:0/509007649 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb30006aea0 0x7fb30006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.160+0000 7fb312ffd640 1 --2- 172.21.15.114:0/509007649 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb30006aea0 0x7fb30006d360 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb30400a830 tx=0x7fb304008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.164+0000 7fb2fb7fe640 1 -- 172.21.15.114:0/509007649 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb308054810 con 0x7fb3140ce240 2023-11-04T01:39:32.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.331+0000 7fb31974c640 1 -- 172.21.15.114:0/509007649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb314074290 con 0x7fb3140ce240 2023-11-04T01:39:32.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.332+0000 7fb2fb7fe640 1 -- 172.21.15.114:0/509007649 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22013 (secure 0 0 0) 0x7fb30801f090 con 0x7fb3140ce240 2023-11-04T01:39:32.334 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:32.335 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":83,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:23.665473+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:20.107188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:20.970024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:32.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.334+0000 7fb31974c640 1 -- 172.21.15.114:0/509007649 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb30006aea0 msgr2=0x7fb30006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.334+0000 7fb31974c640 1 --2- 172.21.15.114:0/509007649 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb30006aea0 0x7fb30006d360 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb30400a830 tx=0x7fb304008040 comp rx=0 tx=0).stop 2023-11-04T01:39:32.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.334+0000 7fb31974c640 1 -- 172.21.15.114:0/509007649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3140ce240 msgr2=0x7fb3140b4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.334+0000 7fb31974c640 1 --2- 172.21.15.114:0/509007649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3140ce240 0x7fb3140b4360 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fb30800c820 tx=0x7fb30800cc20 comp rx=0 tx=0).stop 2023-11-04T01:39:32.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.334+0000 7fb31974c640 1 -- 172.21.15.114:0/509007649 shutdown_connections 2023-11-04T01:39:32.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.334+0000 7fb31974c640 1 --2- 172.21.15.114:0/509007649 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb30006aea0 0x7fb30006d360 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.334+0000 7fb31974c640 1 --2- 172.21.15.114:0/509007649 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb314157540 0x7fb31415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.334+0000 7fb31974c640 1 --2- 172.21.15.114:0/509007649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3140ce240 0x7fb3140b4360 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.334+0000 7fb31974c640 1 --2- 172.21.15.114:0/509007649 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb3140cde60 0x7fb3140b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.334+0000 7fb31974c640 1 -- 172.21.15.114:0/509007649 >> 172.21.15.114:0/509007649 conn(0x7fb314071f30 msgr2=0x7fb3140d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:32.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.334+0000 7fb31974c640 1 -- 172.21.15.114:0/509007649 shutdown_connections 2023-11-04T01:39:32.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.334+0000 7fb31974c640 1 -- 172.21.15.114:0/509007649 wait complete. 2023-11-04T01:39:32.347 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:58.316710+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:59.185397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:20.107188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:20.970024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:32.348 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:32.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.448+0000 7fb595733640 1 Processor -- start 2023-11-04T01:39:32.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.448+0000 7fb595733640 1 -- start start 2023-11-04T01:39:32.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.449+0000 7fb595733640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb590153e60 0x7fb59015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.449+0000 7fb595733640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5900b4880 0x7fb5900b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.449+0000 7fb595733640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5900cde60 con 0x7fb5900cd6d0 2023-11-04T01:39:32.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.449+0000 7fb595733640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb590160f90 con 0x7fb590153e60 2023-11-04T01:39:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.449+0000 7fb595733640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5900b5200 con 0x7fb5900b4880 2023-11-04T01:39:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.449+0000 7fb58effd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb590153e60 0x7fb59015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.449+0000 7fb587fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb5900cd6d0 0x7fb590161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35132/0 (socket says 172.21.15.114:35132) 2023-11-04T01:39:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.449+0000 7fb587fff640 1 -- 172.21.15.114:0/2728812891 learned_addr learned my addr 172.21.15.114:0/2728812891 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.449+0000 7fb58f7fe640 1 --2- 172.21.15.114:0/2728812891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5900b4880 0x7fb5900b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.449+0000 7fb58effd640 1 -- 172.21.15.114:0/2728812891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5900b4880 msgr2=0x7fb5900b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.449+0000 7fb58effd640 1 --2- 172.21.15.114:0/2728812891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5900b4880 0x7fb5900b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.449+0000 7fb58effd640 1 -- 172.21.15.114:0/2728812891 >> v1:172.21.15.114:6789/0 conn(0x7fb5900cd6d0 legacy=0x7fb590161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.449+0000 7fb58effd640 1 -- 172.21.15.114:0/2728812891 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59015e400 con 0x7fb590153e60 2023-11-04T01:39:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.450+0000 7fb58effd640 1 --2- 172.21.15.114:0/2728812891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb590153e60 0x7fb59015dec0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fb5800097a0 tx=0x7fb58002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347871c6cd0a71a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.450+0000 7fb58e7fc640 1 -- 172.21.15.114:0/2728812891 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580031830 con 0x7fb590153e60 2023-11-04T01:39:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.450+0000 7fb58e7fc640 1 -- 172.21.15.114:0/2728812891 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb580031990 con 0x7fb590153e60 2023-11-04T01:39:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.450+0000 7fb58e7fc640 1 -- 172.21.15.114:0/2728812891 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580031d20 con 0x7fb590153e60 2023-11-04T01:39:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.451+0000 7fb595733640 1 -- 172.21.15.114:0/2728812891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb590153e60 msgr2=0x7fb59015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.451+0000 7fb595733640 1 --2- 172.21.15.114:0/2728812891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb590153e60 0x7fb59015dec0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fb5800097a0 tx=0x7fb58002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.451+0000 7fb595733640 1 -- 172.21.15.114:0/2728812891 shutdown_connections 2023-11-04T01:39:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.451+0000 7fb595733640 1 --2- 172.21.15.114:0/2728812891 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5900b4880 0x7fb5900b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.451+0000 7fb595733640 1 --2- 172.21.15.114:0/2728812891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb590153e60 0x7fb59015dec0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.451+0000 7fb595733640 1 -- 172.21.15.114:0/2728812891 >> 172.21.15.114:0/2728812891 conn(0x7fb5900cf880 msgr2=0x7fb5900cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.451+0000 7fb595733640 1 -- 172.21.15.114:0/2728812891 shutdown_connections 2023-11-04T01:39:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.451+0000 7fb595733640 1 -- 172.21.15.114:0/2728812891 wait complete. 2023-11-04T01:39:32.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.452+0000 7fb595733640 1 Processor -- start 2023-11-04T01:39:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.452+0000 7fb595733640 1 -- start start 2023-11-04T01:39:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.452+0000 7fb595733640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5900b4880 0x7fb5901533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.452+0000 7fb595733640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5900cd6d0 0x7fb590157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.452+0000 7fb595733640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb590153e60 0x7fb5900cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.452+0000 7fb595733640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59015b9d0 con 0x7fb5900b4880 2023-11-04T01:39:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.452+0000 7fb595733640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5901538e0 con 0x7fb5900cd6d0 2023-11-04T01:39:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.452+0000 7fb595733640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59015adc0 con 0x7fb590153e60 2023-11-04T01:39:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.453+0000 7fb58effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5900b4880 0x7fb5901533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.453+0000 7fb58effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5900b4880 0x7fb5901533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50386/0 (socket says 172.21.15.114:50386) 2023-11-04T01:39:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.453+0000 7fb58effd640 1 -- 172.21.15.114:0/435519225 learned_addr learned my addr 172.21.15.114:0/435519225 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.453+0000 7fb58f7fe640 1 --2- 172.21.15.114:0/435519225 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb590153e60 0x7fb5900cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.453+0000 7fb587fff640 1 --2- 172.21.15.114:0/435519225 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5900cd6d0 0x7fb590157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.453+0000 7fb58effd640 1 -- 172.21.15.114:0/435519225 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb590153e60 msgr2=0x7fb5900cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.453+0000 7fb58effd640 1 --2- 172.21.15.114:0/435519225 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb590153e60 0x7fb5900cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.453+0000 7fb58effd640 1 -- 172.21.15.114:0/435519225 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5900cd6d0 msgr2=0x7fb590157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.453+0000 7fb58effd640 1 --2- 172.21.15.114:0/435519225 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5900cd6d0 0x7fb590157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.453+0000 7fb58effd640 1 -- 172.21.15.114:0/435519225 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb580009400 con 0x7fb5900b4880 2023-11-04T01:39:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.453+0000 7fb58effd640 1 --2- 172.21.15.114:0/435519225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5900b4880 0x7fb5901533a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fb580034040 tx=0x7fb5800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.453+0000 7fb5877fe640 1 -- 172.21.15.114:0/435519225 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58003aa60 con 0x7fb5900b4880 2023-11-04T01:39:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.453+0000 7fb5877fe640 1 -- 172.21.15.114:0/435519225 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58003abe0 con 0x7fb5900b4880 2023-11-04T01:39:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.453+0000 7fb595733640 1 -- 172.21.15.114:0/435519225 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59015b0a0 con 0x7fb5900b4880 2023-11-04T01:39:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.453+0000 7fb5877fe640 1 -- 172.21.15.114:0/435519225 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580044400 con 0x7fb5900b4880 2023-11-04T01:39:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.453+0000 7fb595733640 1 -- 172.21.15.114:0/435519225 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59015b660 con 0x7fb5900b4880 2023-11-04T01:39:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.454+0000 7fb595733640 1 -- 172.21.15.114:0/435519225 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb590074290 con 0x7fb5900b4880 2023-11-04T01:39:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.455+0000 7fb5877fe640 1 -- 172.21.15.114:0/435519225 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb58004d440 con 0x7fb5900b4880 2023-11-04T01:39:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.455+0000 7fb5877fe640 1 --2- 172.21.15.114:0/435519225 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb57006ae70 0x7fb57006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.455+0000 7fb5877fe640 1 -- 172.21.15.114:0/435519225 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fb5800abc90 con 0x7fb5900b4880 2023-11-04T01:39:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.455+0000 7fb587fff640 1 --2- 172.21.15.114:0/435519225 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb57006ae70 0x7fb57006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.455+0000 7fb587fff640 1 --2- 172.21.15.114:0/435519225 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb57006ae70 0x7fb57006d330 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb5901557b0 tx=0x7fb578009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.459+0000 7fb5877fe640 1 -- 172.21.15.114:0/435519225 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb5800767d0 con 0x7fb5900b4880 2023-11-04T01:39:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.625+0000 7fb595733640 1 -- 172.21.15.114:0/435519225 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb5900d0b80 con 0x7fb5900b4880 2023-11-04T01:39:32.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.625+0000 7fb5877fe640 1 -- 172.21.15.114:0/435519225 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb5800350a0 con 0x7fb5900b4880 2023-11-04T01:39:32.627 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:39:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.627+0000 7fb595733640 1 -- 172.21.15.114:0/435519225 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb57006ae70 msgr2=0x7fb57006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.627+0000 7fb595733640 1 --2- 172.21.15.114:0/435519225 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb57006ae70 0x7fb57006d330 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb5901557b0 tx=0x7fb578009040 comp rx=0 tx=0).stop 2023-11-04T01:39:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.627+0000 7fb595733640 1 -- 172.21.15.114:0/435519225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5900b4880 msgr2=0x7fb5901533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.627+0000 7fb595733640 1 --2- 172.21.15.114:0/435519225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5900b4880 0x7fb5901533a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fb580034040 tx=0x7fb5800046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.627+0000 7fb595733640 1 -- 172.21.15.114:0/435519225 shutdown_connections 2023-11-04T01:39:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.627+0000 7fb595733640 1 --2- 172.21.15.114:0/435519225 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb590153e60 0x7fb5900cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.627+0000 7fb595733640 1 --2- 172.21.15.114:0/435519225 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb57006ae70 0x7fb57006d330 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.627+0000 7fb595733640 1 --2- 172.21.15.114:0/435519225 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5900cd6d0 0x7fb590157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.627+0000 7fb595733640 1 --2- 172.21.15.114:0/435519225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5900b4880 0x7fb5901533a0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.627+0000 7fb595733640 1 -- 172.21.15.114:0/435519225 >> 172.21.15.114:0/435519225 conn(0x7fb5900cf880 msgr2=0x7fb59015ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:32.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.627+0000 7fb595733640 1 -- 172.21.15.114:0/435519225 shutdown_connections 2023-11-04T01:39:32.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.627+0000 7fb595733640 1 -- 172.21.15.114:0/435519225 wait complete. 2023-11-04T01:39:32.639 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:39:32.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.741+0000 7fdc52b6c640 1 Processor -- start 2023-11-04T01:39:32.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.741+0000 7fdc52b6c640 1 -- start start 2023-11-04T01:39:32.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.742+0000 7fdc52b6c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdc4c153e60 0x7fdc4c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.742+0000 7fdc52b6c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc4c0cd6d0 0x7fdc4c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.742+0000 7fdc52b6c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fdc4c0b4880 0x7fdc4c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.742+0000 7fdc52b6c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4c0cde60 con 0x7fdc4c0cd6d0 2023-11-04T01:39:32.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.742+0000 7fdc52b6c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4c160f90 con 0x7fdc4c0b4880 2023-11-04T01:39:32.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.742+0000 7fdc52b6c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c0b5200 con 0x7fdc4c153e60 2023-11-04T01:39:32.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.742+0000 7fdc4bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc4c0cd6d0 0x7fdc4c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.742+0000 7fdc4bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc4c0cd6d0 0x7fdc4c161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50400/0 (socket says 172.21.15.114:50400) 2023-11-04T01:39:32.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.742+0000 7fdc4bfff640 1 -- 172.21.15.114:0/3575310860 learned_addr learned my addr 172.21.15.114:0/3575310860 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:32.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.742+0000 7fdc4bfff640 1 -- 172.21.15.114:0/3575310860 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdc4c153e60 msgr2=0x7fdc4c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:32.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.742+0000 7fdc4bfff640 1 --2- 172.21.15.114:0/3575310860 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdc4c153e60 0x7fdc4c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.742+0000 7fdc4bfff640 1 -- 172.21.15.114:0/3575310860 >> v2:172.21.15.141:3300/0 conn(0x7fdc4c0b4880 msgr2=0x7fdc4c0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:32.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.742+0000 7fdc4bfff640 1 --2- 172.21.15.114:0/3575310860 >> v2:172.21.15.141:3300/0 conn(0x7fdc4c0b4880 0x7fdc4c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.742+0000 7fdc4bfff640 1 -- 172.21.15.114:0/3575310860 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c15e400 con 0x7fdc4c0cd6d0 2023-11-04T01:39:32.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.743+0000 7fdc4bfff640 1 --2- 172.21.15.114:0/3575310860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c0cd6d0 0x7fdc4c161420 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0c9e50 tx=0x7fdc3802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866f97aef6e2bb07 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:32.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.743+0000 7fdc4b7fe640 1 -- 172.21.15.114:0/3575310860 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc38031870 con 0x7fdc4c0cd6d0 2023-11-04T01:39:32.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.743+0000 7fdc4b7fe640 1 -- 172.21.15.114:0/3575310860 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc380319d0 con 0x7fdc4c0cd6d0 2023-11-04T01:39:32.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.743+0000 7fdc4b7fe640 1 -- 172.21.15.114:0/3575310860 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc38031d60 con 0x7fdc4c0cd6d0 2023-11-04T01:39:32.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.743+0000 7fdc52b6c640 1 -- 172.21.15.114:0/3575310860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c0cd6d0 msgr2=0x7fdc4c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.743+0000 7fdc52b6c640 1 --2- 172.21.15.114:0/3575310860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c0cd6d0 0x7fdc4c161420 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0c9e50 tx=0x7fdc3802b910 comp rx=0 tx=0).stop 2023-11-04T01:39:32.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.743+0000 7fdc52b6c640 1 -- 172.21.15.114:0/3575310860 shutdown_connections 2023-11-04T01:39:32.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.743+0000 7fdc52b6c640 1 --2- 172.21.15.114:0/3575310860 >> v2:172.21.15.141:3300/0 conn(0x7fdc4c0b4880 0x7fdc4c0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.743+0000 7fdc52b6c640 1 --2- 172.21.15.114:0/3575310860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c0cd6d0 0x7fdc4c161420 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.743+0000 7fdc52b6c640 1 --2- 172.21.15.114:0/3575310860 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdc4c153e60 0x7fdc4c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.743+0000 7fdc52b6c640 1 -- 172.21.15.114:0/3575310860 >> 172.21.15.114:0/3575310860 conn(0x7fdc4c0cf880 msgr2=0x7fdc4c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:32.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.743+0000 7fdc52b6c640 1 -- 172.21.15.114:0/3575310860 shutdown_connections 2023-11-04T01:39:32.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.743+0000 7fdc52b6c640 1 -- 172.21.15.114:0/3575310860 wait complete. 2023-11-04T01:39:32.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.745+0000 7fdc52b6c640 1 Processor -- start 2023-11-04T01:39:32.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.745+0000 7fdc52b6c640 1 -- start start 2023-11-04T01:39:32.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.745+0000 7fdc52b6c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c0b4880 0x7fdc4c0c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.745+0000 7fdc52b6c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdc4c0cd6d0 0x7fdc4c158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.745+0000 7fdc52b6c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdc4c153e60 0x7fdc4c159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.745+0000 7fdc52b6c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c1538f0 con 0x7fdc4c0b4880 2023-11-04T01:39:32.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.745+0000 7fdc52b6c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c15f0c0 con 0x7fdc4c0cd6d0 2023-11-04T01:39:32.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.745+0000 7fdc52b6c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c0c9790 con 0x7fdc4c153e60 2023-11-04T01:39:32.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.746+0000 7fdc50908640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c0b4880 0x7fdc4c0c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.746+0000 7fdc50908640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c0b4880 0x7fdc4c0c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50404/0 (socket says 172.21.15.114:50404) 2023-11-04T01:39:32.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.746+0000 7fdc50908640 1 -- 172.21.15.114:0/2256759151 learned_addr learned my addr 172.21.15.114:0/2256759151 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:32.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.746+0000 7fdc4bfff640 1 --2- 172.21.15.114:0/2256759151 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdc4c0cd6d0 0x7fdc4c158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.746+0000 7fdc51109640 1 --2- 172.21.15.114:0/2256759151 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdc4c153e60 0x7fdc4c159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.746+0000 7fdc50908640 1 -- 172.21.15.114:0/2256759151 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdc4c153e60 msgr2=0x7fdc4c159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.746+0000 7fdc50908640 1 --2- 172.21.15.114:0/2256759151 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdc4c153e60 0x7fdc4c159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.746+0000 7fdc50908640 1 -- 172.21.15.114:0/2256759151 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdc4c0cd6d0 msgr2=0x7fdc4c158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.746+0000 7fdc50908640 1 --2- 172.21.15.114:0/2256759151 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdc4c0cd6d0 0x7fdc4c158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.746+0000 7fdc50908640 1 -- 172.21.15.114:0/2256759151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc380094d0 con 0x7fdc4c0b4880 2023-11-04T01:39:32.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.746+0000 7fdc50908640 1 --2- 172.21.15.114:0/2256759151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c0b4880 0x7fdc4c0c8fd0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000b440 tx=0x7fdc4000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:32.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.746+0000 7fdc497fa640 1 -- 172.21.15.114:0/2256759151 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40011890 con 0x7fdc4c0b4880 2023-11-04T01:39:32.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.746+0000 7fdc497fa640 1 -- 172.21.15.114:0/2256759151 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc400119f0 con 0x7fdc4c0b4880 2023-11-04T01:39:32.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.746+0000 7fdc52b6c640 1 -- 172.21.15.114:0/2256759151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4c0c9510 con 0x7fdc4c0b4880 2023-11-04T01:39:32.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.746+0000 7fdc497fa640 1 -- 172.21.15.114:0/2256759151 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40011da0 con 0x7fdc4c0b4880 2023-11-04T01:39:32.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.746+0000 7fdc52b6c640 1 -- 172.21.15.114:0/2256759151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4c0c7430 con 0x7fdc4c0b4880 2023-11-04T01:39:32.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.747+0000 7fdc52b6c640 1 -- 172.21.15.114:0/2256759151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc4c074290 con 0x7fdc4c0b4880 2023-11-04T01:39:32.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.748+0000 7fdc497fa640 1 -- 172.21.15.114:0/2256759151 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdc4001a400 con 0x7fdc4c0b4880 2023-11-04T01:39:32.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.748+0000 7fdc497fa640 1 --2- 172.21.15.114:0/2256759151 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdc3006ae70 0x7fdc3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.748+0000 7fdc497fa640 1 -- 172.21.15.114:0/2256759151 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fdc40089e20 con 0x7fdc4c0b4880 2023-11-04T01:39:32.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.748+0000 7fdc4bfff640 1 --2- 172.21.15.114:0/2256759151 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdc3006ae70 0x7fdc3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.748+0000 7fdc4bfff640 1 --2- 172.21.15.114:0/2256759151 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdc3006ae70 0x7fdc3006d330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdc38036000 tx=0x7fdc3803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:32.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.752+0000 7fdc497fa640 1 -- 172.21.15.114:0/2256759151 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdc400549f0 con 0x7fdc4c0b4880 2023-11-04T01:39:32.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.921+0000 7fdc52b6c640 1 -- 172.21.15.114:0/2256759151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fdc4c0b4fe0 con 0x7fdc4c0b4880 2023-11-04T01:39:32.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.921+0000 7fdc497fa640 1 -- 172.21.15.114:0/2256759151 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v83) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdc40015020 con 0x7fdc4c0b4880 2023-11-04T01:39:32.923 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:32.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.923+0000 7fdc52b6c640 1 -- 172.21.15.114:0/2256759151 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdc3006ae70 msgr2=0x7fdc3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.923+0000 7fdc52b6c640 1 --2- 172.21.15.114:0/2256759151 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdc3006ae70 0x7fdc3006d330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdc38036000 tx=0x7fdc3803c040 comp rx=0 tx=0).stop 2023-11-04T01:39:32.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.923+0000 7fdc52b6c640 1 -- 172.21.15.114:0/2256759151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c0b4880 msgr2=0x7fdc4c0c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:32.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.923+0000 7fdc52b6c640 1 --2- 172.21.15.114:0/2256759151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c0b4880 0x7fdc4c0c8fd0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000b440 tx=0x7fdc4000b900 comp rx=0 tx=0).stop 2023-11-04T01:39:32.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.923+0000 7fdc52b6c640 1 -- 172.21.15.114:0/2256759151 shutdown_connections 2023-11-04T01:39:32.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.923+0000 7fdc52b6c640 1 --2- 172.21.15.114:0/2256759151 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdc4c153e60 0x7fdc4c159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.923+0000 7fdc52b6c640 1 --2- 172.21.15.114:0/2256759151 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdc3006ae70 0x7fdc3006d330 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.923+0000 7fdc52b6c640 1 --2- 172.21.15.114:0/2256759151 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdc4c0cd6d0 0x7fdc4c158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.923+0000 7fdc52b6c640 1 --2- 172.21.15.114:0/2256759151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c0b4880 0x7fdc4c0c8fd0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:32.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.923+0000 7fdc52b6c640 1 -- 172.21.15.114:0/2256759151 >> 172.21.15.114:0/2256759151 conn(0x7fdc4c0cf880 msgr2=0x7fdc4c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:32.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.923+0000 7fdc52b6c640 1 -- 172.21.15.114:0/2256759151 shutdown_connections 2023-11-04T01:39:32.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:32.923+0000 7fdc52b6c640 1 -- 172.21.15.114:0/2256759151 wait complete. 2023-11-04T01:39:32.936 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:39:33.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.036+0000 7f2b1fdc0640 1 Processor -- start 2023-11-04T01:39:33.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.037+0000 7f2b1fdc0640 1 -- start start 2023-11-04T01:39:33.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.037+0000 7f2b1fdc0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2b181605b0 0x7f2b180ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.037+0000 7f2b1fdc0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b18160990 con 0x7f2b180b1a40 2023-11-04T01:39:33.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.037+0000 7f2b1fdc0640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b180cc7c0 con 0x7f2b1806a830 2023-11-04T01:39:33.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.037+0000 7f2b1fdc0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b180cd750 con 0x7f2b181605b0 2023-11-04T01:39:33.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.038+0000 7f2b1db5c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2b181605b0 0x7f2b180ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.038+0000 7f2b1db5c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2b181605b0 0x7f2b180ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50418/0 (socket says 172.21.15.114:50418) 2023-11-04T01:39:33.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.038+0000 7f2b1db5c640 1 -- 172.21.15.114:0/24048714 learned_addr learned my addr 172.21.15.114:0/24048714 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:33.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.038+0000 7f2b1db5c640 1 -- 172.21.15.114:0/24048714 >> v1:172.21.15.141:6789/0 conn(0x7f2b1806a830 legacy=0x7f2b180cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.038+0000 7f2b1db5c640 1 -- 172.21.15.114:0/24048714 >> v1:172.21.15.114:6789/0 conn(0x7f2b180b1a40 legacy=0x7f2b1806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.038+0000 7f2b1cb5a640 1 -- 172.21.15.114:0/24048714 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127079164 0 0) 0x7f2b18160990 con 0x7f2b180b1a40 2023-11-04T01:39:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.038+0000 7f2b1db5c640 1 -- 172.21.15.114:0/24048714 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b180cc4e0 con 0x7f2b181605b0 2023-11-04T01:39:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.039+0000 7f2b1db5c640 1 --2- 172.21.15.114:0/24048714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b181605b0 0x7f2b180ccbc0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009870 tx=0x7f2b1402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544d1caa53f6e5db server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.039+0000 7f2b1cb5a640 1 -- 172.21.15.114:0/24048714 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14031870 con 0x7f2b181605b0 2023-11-04T01:39:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.039+0000 7f2b1cb5a640 1 -- 172.21.15.114:0/24048714 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b140319d0 con 0x7f2b181605b0 2023-11-04T01:39:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.039+0000 7f2b1cb5a640 1 -- 172.21.15.114:0/24048714 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14031d60 con 0x7f2b181605b0 2023-11-04T01:39:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.039+0000 7f2b1fdc0640 1 -- 172.21.15.114:0/24048714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b181605b0 msgr2=0x7f2b180ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.039+0000 7f2b1fdc0640 1 --2- 172.21.15.114:0/24048714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b181605b0 0x7f2b180ccbc0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009870 tx=0x7f2b1402b910 comp rx=0 tx=0).stop 2023-11-04T01:39:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.039+0000 7f2b1fdc0640 1 -- 172.21.15.114:0/24048714 shutdown_connections 2023-11-04T01:39:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.039+0000 7f2b1fdc0640 1 --2- 172.21.15.114:0/24048714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b181605b0 0x7f2b180ccbc0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.039+0000 7f2b1fdc0640 1 -- 172.21.15.114:0/24048714 >> 172.21.15.114:0/24048714 conn(0x7f2b18071820 msgr2=0x7f2b18071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.040+0000 7f2b1fdc0640 1 -- 172.21.15.114:0/24048714 shutdown_connections 2023-11-04T01:39:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.040+0000 7f2b1fdc0640 1 -- 172.21.15.114:0/24048714 wait complete. 2023-11-04T01:39:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.041+0000 7f2b1fdc0640 1 Processor -- start 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.041+0000 7f2b1fdc0640 1 -- start start 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.041+0000 7f2b1fdc0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b1806a830 0x7f2b1815bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.041+0000 7f2b1fdc0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b181605b0 0x7f2b180b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.041+0000 7f2b1fdc0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b180adb80 0x7f2b180b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.041+0000 7f2b1fdc0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b180ac390 con 0x7f2b181605b0 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.041+0000 7f2b1fdc0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b180ac670 con 0x7f2b180adb80 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.041+0000 7f2b1fdc0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b180ac950 con 0x7f2b1806a830 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.041+0000 7f2b1d35b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b181605b0 0x7f2b180b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b1d35b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b181605b0 0x7f2b180b4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50428/0 (socket says 172.21.15.114:50428) 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b1d35b640 1 -- 172.21.15.114:0/3151382900 learned_addr learned my addr 172.21.15.114:0/3151382900 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b1e35d640 1 --2- 172.21.15.114:0/3151382900 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b180adb80 0x7f2b180b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b1db5c640 1 --2- 172.21.15.114:0/3151382900 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b1806a830 0x7f2b1815bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b1d35b640 1 -- 172.21.15.114:0/3151382900 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b1806a830 msgr2=0x7f2b1815bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b1d35b640 1 --2- 172.21.15.114:0/3151382900 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b1806a830 0x7f2b1815bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b1d35b640 1 -- 172.21.15.114:0/3151382900 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b180adb80 msgr2=0x7f2b180b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b1d35b640 1 --2- 172.21.15.114:0/3151382900 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b180adb80 0x7f2b180b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b1d35b640 1 -- 172.21.15.114:0/3151382900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b140094d0 con 0x7f2b181605b0 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b1e35d640 1 --2- 172.21.15.114:0/3151382900 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b180adb80 0x7f2b180b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b1db5c640 1 --2- 172.21.15.114:0/3151382900 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b1806a830 0x7f2b1815bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b1d35b640 1 --2- 172.21.15.114:0/3151382900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b181605b0 0x7f2b180b4110 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800c3c0 tx=0x7f2b0800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b0e7fc640 1 -- 172.21.15.114:0/3151382900 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b080035f0 con 0x7f2b181605b0 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b0e7fc640 1 -- 172.21.15.114:0/3151382900 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b08003770 con 0x7f2b181605b0 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b1fdc0640 1 -- 172.21.15.114:0/3151382900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b180acc30 con 0x7f2b181605b0 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b0e7fc640 1 -- 172.21.15.114:0/3151382900 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b08003b20 con 0x7f2b181605b0 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.042+0000 7f2b1fdc0640 1 -- 172.21.15.114:0/3151382900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1815c010 con 0x7f2b181605b0 2023-11-04T01:39:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.043+0000 7f2b1fdc0640 1 -- 172.21.15.114:0/3151382900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b180672a0 con 0x7f2b181605b0 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.044+0000 7f2b0e7fc640 1 -- 172.21.15.114:0/3151382900 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b08003c80 con 0x7f2b181605b0 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.044+0000 7f2b0e7fc640 1 --2- 172.21.15.114:0/3151382900 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2afc06ae70 0x7f2afc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.044+0000 7f2b0e7fc640 1 -- 172.21.15.114:0/3151382900 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f2b08089180 con 0x7f2b181605b0 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.044+0000 7f2b1db5c640 1 --2- 172.21.15.114:0/3151382900 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2afc06ae70 0x7f2afc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.044+0000 7f2b1db5c640 1 --2- 172.21.15.114:0/3151382900 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2afc06ae70 0x7f2afc06d330 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2b14036000 tx=0x7f2b1403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.048+0000 7f2b0e7fc640 1 -- 172.21.15.114:0/3151382900 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2b08053c20 con 0x7f2b181605b0 2023-11-04T01:39:33.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.215+0000 7f2b1fdc0640 1 -- 172.21.15.114:0/3151382900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f2b180ad150 con 0x7f2b181605b0 2023-11-04T01:39:33.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.215+0000 7f2b0e7fc640 1 -- 172.21.15.114:0/3151382900 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v83) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2b180ad150 con 0x7f2b181605b0 2023-11-04T01:39:33.217 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:33.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.217+0000 7f2b1fdc0640 1 -- 172.21.15.114:0/3151382900 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2afc06ae70 msgr2=0x7f2afc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.217+0000 7f2b1fdc0640 1 --2- 172.21.15.114:0/3151382900 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2afc06ae70 0x7f2afc06d330 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2b14036000 tx=0x7f2b1403c040 comp rx=0 tx=0).stop 2023-11-04T01:39:33.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.217+0000 7f2b1fdc0640 1 -- 172.21.15.114:0/3151382900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b181605b0 msgr2=0x7f2b180b4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.217+0000 7f2b1fdc0640 1 --2- 172.21.15.114:0/3151382900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b181605b0 0x7f2b180b4110 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800c3c0 tx=0x7f2b0800c880 comp rx=0 tx=0).stop 2023-11-04T01:39:33.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.217+0000 7f2b1fdc0640 1 -- 172.21.15.114:0/3151382900 shutdown_connections 2023-11-04T01:39:33.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.217+0000 7f2b1fdc0640 1 --2- 172.21.15.114:0/3151382900 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2afc06ae70 0x7f2afc06d330 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.217+0000 7f2b1fdc0640 1 --2- 172.21.15.114:0/3151382900 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2b180adb80 0x7f2b180b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.217+0000 7f2b1fdc0640 1 --2- 172.21.15.114:0/3151382900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b181605b0 0x7f2b180b4110 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.217+0000 7f2b1fdc0640 1 --2- 172.21.15.114:0/3151382900 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2b1806a830 0x7f2b1815bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.217+0000 7f2b1fdc0640 1 -- 172.21.15.114:0/3151382900 >> 172.21.15.114:0/3151382900 conn(0x7f2b18071820 msgr2=0x7f2b180b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.217+0000 7f2b1fdc0640 1 -- 172.21.15.114:0/3151382900 shutdown_connections 2023-11-04T01:39:33.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.217+0000 7f2b1fdc0640 1 -- 172.21.15.114:0/3151382900 wait complete. 2023-11-04T01:39:33.230 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:39:33.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.330+0000 7f7821939640 1 Processor -- start 2023-11-04T01:39:33.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.330+0000 7f7821939640 1 -- start start 2023-11-04T01:39:33.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.331+0000 7f7821939640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f781c159c00 0x7f781c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.331+0000 7f7821939640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f781c0c48e0 0x7f781c0c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.331+0000 7f7821939640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f781c0adac0 0x7f781c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.331+0000 7f7821939640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781c0c52d0 con 0x7f781c0adac0 2023-11-04T01:39:33.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.331+0000 7f7821939640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781c15aff0 con 0x7f781c159c00 2023-11-04T01:39:33.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.331+0000 7f7821939640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781c0ae450 con 0x7f781c0c48e0 2023-11-04T01:39:33.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.331+0000 7f781b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f781c0adac0 0x7f781c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.331+0000 7f781b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f781c0adac0 0x7f781c0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50436/0 (socket says 172.21.15.114:50436) 2023-11-04T01:39:33.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.331+0000 7f781b7fe640 1 -- 172.21.15.114:0/3642453661 learned_addr learned my addr 172.21.15.114:0/3642453661 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:33.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.332+0000 7f781affd640 1 --2- 172.21.15.114:0/3642453661 >> v2:172.21.15.141:3300/0 conn(0x7f781c159c00 0x7f781c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.332+0000 7f781a7fc640 1 --2- 172.21.15.114:0/3642453661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f781c0c48e0 0x7f781c0c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.332+0000 7f781b7fe640 1 -- 172.21.15.114:0/3642453661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f781c0c48e0 msgr2=0x7f781c0c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:33.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.332+0000 7f781b7fe640 1 --2- 172.21.15.114:0/3642453661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f781c0c48e0 0x7f781c0c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.332+0000 7f781b7fe640 1 -- 172.21.15.114:0/3642453661 >> v2:172.21.15.141:3300/0 conn(0x7f781c159c00 msgr2=0x7f781c0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:33.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.332+0000 7f781b7fe640 1 --2- 172.21.15.114:0/3642453661 >> v2:172.21.15.141:3300/0 conn(0x7f781c159c00 0x7f781c0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.332+0000 7f781b7fe640 1 -- 172.21.15.114:0/3642453661 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c15a3e0 con 0x7f781c0adac0 2023-11-04T01:39:33.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.332+0000 7f781a7fc640 1 --2- 172.21.15.114:0/3642453661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f781c0c48e0 0x7f781c0c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:33.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.332+0000 7f781affd640 1 --2- 172.21.15.114:0/3642453661 >> v2:172.21.15.141:3300/0 conn(0x7f781c159c00 0x7f781c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:33.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.332+0000 7f781b7fe640 1 --2- 172.21.15.114:0/3642453661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c0adac0 0x7f781c0adf10 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f781c0cc4d0 tx=0x7f781402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c63972deb280522 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.333+0000 7f7819ffb640 1 -- 172.21.15.114:0/3642453661 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814031870 con 0x7f781c0adac0 2023-11-04T01:39:33.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.333+0000 7f7819ffb640 1 -- 172.21.15.114:0/3642453661 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78140319d0 con 0x7f781c0adac0 2023-11-04T01:39:33.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.333+0000 7f7819ffb640 1 -- 172.21.15.114:0/3642453661 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814031d60 con 0x7f781c0adac0 2023-11-04T01:39:33.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.333+0000 7f7821939640 1 -- 172.21.15.114:0/3642453661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c0adac0 msgr2=0x7f781c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.333+0000 7f7821939640 1 --2- 172.21.15.114:0/3642453661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c0adac0 0x7f781c0adf10 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f781c0cc4d0 tx=0x7f781402b910 comp rx=0 tx=0).stop 2023-11-04T01:39:33.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.333+0000 7f7821939640 1 -- 172.21.15.114:0/3642453661 shutdown_connections 2023-11-04T01:39:33.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.333+0000 7f7821939640 1 --2- 172.21.15.114:0/3642453661 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f781c0c48e0 0x7f781c0c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.333+0000 7f7821939640 1 --2- 172.21.15.114:0/3642453661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c0adac0 0x7f781c0adf10 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.333+0000 7f7821939640 1 --2- 172.21.15.114:0/3642453661 >> v2:172.21.15.141:3300/0 conn(0x7f781c159c00 0x7f781c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.333+0000 7f7821939640 1 -- 172.21.15.114:0/3642453661 >> 172.21.15.114:0/3642453661 conn(0x7f781c0ce950 msgr2=0x7f781c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.333+0000 7f7821939640 1 -- 172.21.15.114:0/3642453661 shutdown_connections 2023-11-04T01:39:33.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.333+0000 7f7821939640 1 -- 172.21.15.114:0/3642453661 wait complete. 2023-11-04T01:39:33.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.334+0000 7f7821939640 1 Processor -- start 2023-11-04T01:39:33.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.335+0000 7f7821939640 1 -- start start 2023-11-04T01:39:33.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.335+0000 7f7821939640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c0adac0 0x7f781c148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.335+0000 7f7821939640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f781c0c48e0 0x7f781c0ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.335+0000 7f7821939640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f781c159c00 0x7f781c0c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.335+0000 7f7821939640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c148a50 con 0x7f781c0adac0 2023-11-04T01:39:33.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.335+0000 7f7821939640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c158c20 con 0x7f781c0c48e0 2023-11-04T01:39:33.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.335+0000 7f7821939640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781c156d70 con 0x7f781c159c00 2023-11-04T01:39:33.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.335+0000 7f781affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c0adac0 0x7f781c148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.335+0000 7f781affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c0adac0 0x7f781c148510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50446/0 (socket says 172.21.15.114:50446) 2023-11-04T01:39:33.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.335+0000 7f781affd640 1 -- 172.21.15.114:0/1790072301 learned_addr learned my addr 172.21.15.114:0/1790072301 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:33.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.335+0000 7f781a7fc640 1 --2- 172.21.15.114:0/1790072301 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f781c0c48e0 0x7f781c0ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.335+0000 7f781b7fe640 1 --2- 172.21.15.114:0/1790072301 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f781c159c00 0x7f781c0c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.336+0000 7f781affd640 1 -- 172.21.15.114:0/1790072301 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f781c159c00 msgr2=0x7f781c0c7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.336+0000 7f781affd640 1 --2- 172.21.15.114:0/1790072301 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f781c159c00 0x7f781c0c7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.336+0000 7f781affd640 1 -- 172.21.15.114:0/1790072301 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f781c0c48e0 msgr2=0x7f781c0ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.336+0000 7f781affd640 1 --2- 172.21.15.114:0/1790072301 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f781c0c48e0 0x7f781c0ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.336+0000 7f781affd640 1 -- 172.21.15.114:0/1790072301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78140094d0 con 0x7f781c0adac0 2023-11-04T01:39:33.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.336+0000 7f781affd640 1 --2- 172.21.15.114:0/1790072301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c0adac0 0x7f781c148510 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f780c00ce00 tx=0x7f780c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.336+0000 7f7803fff640 1 -- 172.21.15.114:0/1790072301 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c00f890 con 0x7f781c0adac0 2023-11-04T01:39:33.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.336+0000 7f7803fff640 1 -- 172.21.15.114:0/1790072301 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c00f9f0 con 0x7f781c0adac0 2023-11-04T01:39:33.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.336+0000 7f7821939640 1 -- 172.21.15.114:0/1790072301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781c157050 con 0x7f781c0adac0 2023-11-04T01:39:33.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.336+0000 7f7803fff640 1 -- 172.21.15.114:0/1790072301 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c00fdc0 con 0x7f781c0adac0 2023-11-04T01:39:33.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.336+0000 7f7821939640 1 -- 172.21.15.114:0/1790072301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781c157610 con 0x7f781c0adac0 2023-11-04T01:39:33.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.337+0000 7f7821939640 1 -- 172.21.15.114:0/1790072301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781c074290 con 0x7f781c0adac0 2023-11-04T01:39:33.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.337+0000 7f7803fff640 1 -- 172.21.15.114:0/1790072301 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f780c00b040 con 0x7f781c0adac0 2023-11-04T01:39:33.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.338+0000 7f7803fff640 1 --2- 172.21.15.114:0/1790072301 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f780806ae70 0x7f780806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.338+0000 7f7803fff640 1 -- 172.21.15.114:0/1790072301 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f780c08a480 con 0x7f781c0adac0 2023-11-04T01:39:33.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.338+0000 7f781a7fc640 1 --2- 172.21.15.114:0/1790072301 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f780806ae70 0x7f780806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.338+0000 7f781a7fc640 1 --2- 172.21.15.114:0/1790072301 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f780806ae70 0x7f780806d330 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f781c158330 tx=0x7f7810008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.342+0000 7f7803fff640 1 -- 172.21.15.114:0/1790072301 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f780c055050 con 0x7f781c0adac0 2023-11-04T01:39:33.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.508+0000 7f7821939640 1 -- 172.21.15.114:0/1790072301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f781c0cf220 con 0x7f781c0adac0 2023-11-04T01:39:33.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.508+0000 7f7803fff640 1 -- 172.21.15.114:0/1790072301 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7f780c01d020 con 0x7f781c0adac0 2023-11-04T01:39:33.510 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:33.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.510+0000 7f7821939640 1 -- 172.21.15.114:0/1790072301 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f780806ae70 msgr2=0x7f780806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.510+0000 7f7821939640 1 --2- 172.21.15.114:0/1790072301 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f780806ae70 0x7f780806d330 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f781c158330 tx=0x7f7810008040 comp rx=0 tx=0).stop 2023-11-04T01:39:33.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.510+0000 7f7821939640 1 -- 172.21.15.114:0/1790072301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c0adac0 msgr2=0x7f781c148510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.510+0000 7f7821939640 1 --2- 172.21.15.114:0/1790072301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c0adac0 0x7f781c148510 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f780c00ce00 tx=0x7f780c00a650 comp rx=0 tx=0).stop 2023-11-04T01:39:33.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.510+0000 7f7821939640 1 -- 172.21.15.114:0/1790072301 shutdown_connections 2023-11-04T01:39:33.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.510+0000 7f7821939640 1 --2- 172.21.15.114:0/1790072301 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f781c159c00 0x7f781c0c7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.510+0000 7f7821939640 1 --2- 172.21.15.114:0/1790072301 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f780806ae70 0x7f780806d330 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.510+0000 7f7821939640 1 --2- 172.21.15.114:0/1790072301 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f781c0c48e0 0x7f781c0ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.510+0000 7f7821939640 1 --2- 172.21.15.114:0/1790072301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c0adac0 0x7f781c148510 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.510+0000 7f7821939640 1 -- 172.21.15.114:0/1790072301 >> 172.21.15.114:0/1790072301 conn(0x7f781c0ce950 msgr2=0x7f781c0709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.510+0000 7f7821939640 1 -- 172.21.15.114:0/1790072301 shutdown_connections 2023-11-04T01:39:33.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.510+0000 7f7821939640 1 -- 172.21.15.114:0/1790072301 wait complete. 2023-11-04T01:39:33.523 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:39:33.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.624+0000 7f714300e640 1 Processor -- start 2023-11-04T01:39:33.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.624+0000 7f714300e640 1 -- start start 2023-11-04T01:39:33.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.625+0000 7f714300e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f713c153850 0x7f713c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.625+0000 7f714300e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c0c3860 con 0x7f713c0cc9d0 2023-11-04T01:39:33.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.625+0000 7f714300e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c0c9250 con 0x7f713c0cc520 2023-11-04T01:39:33.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.625+0000 7f714300e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c153c30 con 0x7f713c153850 2023-11-04T01:39:33.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.625+0000 7f7140daa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f713c153850 0x7f713c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.625+0000 7f71415ab640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f713c0cc9d0 0x7f713c0c3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35144/0 (socket says 172.21.15.114:35144) 2023-11-04T01:39:33.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.625+0000 7f7140daa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f713c153850 0x7f713c15a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50450/0 (socket says 172.21.15.114:50450) 2023-11-04T01:39:33.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.625+0000 7f71415ab640 1 -- 172.21.15.114:0/542802021 learned_addr learned my addr 172.21.15.114:0/542802021 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:33.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.625+0000 7f7140daa640 1 -- 172.21.15.114:0/542802021 >> v1:172.21.15.141:6789/0 conn(0x7f713c0cc520 legacy=0x7f713c070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:33.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.625+0000 7f7140daa640 1 -- 172.21.15.114:0/542802021 >> v1:172.21.15.114:6789/0 conn(0x7f713c0cc9d0 legacy=0x7f713c0c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.625+0000 7f7140daa640 1 -- 172.21.15.114:0/542802021 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c15a700 con 0x7f713c153850 2023-11-04T01:39:33.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.625+0000 7f713b7fe640 1 -- 172.21.15.114:0/542802021 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110911826 0 0) 0x7f713c0c3860 con 0x7f713c0cc9d0 2023-11-04T01:39:33.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.626+0000 7f7140daa640 1 --2- 172.21.15.114:0/542802021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f713c153850 0x7f713c15a1c0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f713000a940 tx=0x7f713002cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9097f2c99014e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.626+0000 7f713b7fe640 1 -- 172.21.15.114:0/542802021 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713002db40 con 0x7f713c153850 2023-11-04T01:39:33.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.626+0000 7f713b7fe640 1 -- 172.21.15.114:0/542802021 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713002dca0 con 0x7f713c153850 2023-11-04T01:39:33.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.626+0000 7f713b7fe640 1 -- 172.21.15.114:0/542802021 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130035660 con 0x7f713c153850 2023-11-04T01:39:33.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.627+0000 7f714300e640 1 -- 172.21.15.114:0/542802021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f713c153850 msgr2=0x7f713c15a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.627+0000 7f714300e640 1 --2- 172.21.15.114:0/542802021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f713c153850 0x7f713c15a1c0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f713000a940 tx=0x7f713002cd90 comp rx=0 tx=0).stop 2023-11-04T01:39:33.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.627+0000 7f714300e640 1 -- 172.21.15.114:0/542802021 shutdown_connections 2023-11-04T01:39:33.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.627+0000 7f714300e640 1 --2- 172.21.15.114:0/542802021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f713c153850 0x7f713c15a1c0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.627+0000 7f714300e640 1 -- 172.21.15.114:0/542802021 >> 172.21.15.114:0/542802021 conn(0x7f713c0ce950 msgr2=0x7f713c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.627+0000 7f714300e640 1 -- 172.21.15.114:0/542802021 shutdown_connections 2023-11-04T01:39:33.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.627+0000 7f714300e640 1 -- 172.21.15.114:0/542802021 wait complete. 2023-11-04T01:39:33.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.628+0000 7f714300e640 1 Processor -- start 2023-11-04T01:39:33.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.628+0000 7f714300e640 1 -- start start 2023-11-04T01:39:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f714300e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f713c0cc520 0x7f713c151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f714300e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f713c0cc9d0 0x7f713c0b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f714300e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f713c153850 0x7f713c156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f714300e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0b1530 con 0x7f713c0cc9d0 2023-11-04T01:39:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f714300e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c1f3f50 con 0x7f713c0cc520 2023-11-04T01:39:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f714300e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c1f4230 con 0x7f713c153850 2023-11-04T01:39:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f713bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f713c0cc9d0 0x7f713c0b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f713bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f713c0cc9d0 0x7f713c0b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50456/0 (socket says 172.21.15.114:50456) 2023-11-04T01:39:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f713bfff640 1 -- 172.21.15.114:0/831818521 learned_addr learned my addr 172.21.15.114:0/831818521 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f7140daa640 1 --2- 172.21.15.114:0/831818521 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f713c0cc520 0x7f713c151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f71415ab640 1 --2- 172.21.15.114:0/831818521 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f713c153850 0x7f713c156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f713bfff640 1 -- 172.21.15.114:0/831818521 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f713c153850 msgr2=0x7f713c156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f713bfff640 1 --2- 172.21.15.114:0/831818521 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f713c153850 0x7f713c156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f713bfff640 1 -- 172.21.15.114:0/831818521 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f713c0cc520 msgr2=0x7f713c151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f713bfff640 1 --2- 172.21.15.114:0/831818521 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f713c0cc520 0x7f713c151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f713bfff640 1 -- 172.21.15.114:0/831818521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713000a5a0 con 0x7f713c0cc9d0 2023-11-04T01:39:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f71415ab640 1 --2- 172.21.15.114:0/831818521 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f713c153850 0x7f713c156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f713bfff640 1 --2- 172.21.15.114:0/831818521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f713c0cc9d0 0x7f713c0b37e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f712800c430 tx=0x7f712800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f71397fa640 1 -- 172.21.15.114:0/831818521 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128011790 con 0x7f713c0cc9d0 2023-11-04T01:39:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f71397fa640 1 -- 172.21.15.114:0/831818521 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71280118f0 con 0x7f713c0cc9d0 2023-11-04T01:39:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f714300e640 1 -- 172.21.15.114:0/831818521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c1f4510 con 0x7f713c0cc9d0 2023-11-04T01:39:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f71397fa640 1 -- 172.21.15.114:0/831818521 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128011ce0 con 0x7f713c0cc9d0 2023-11-04T01:39:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.629+0000 7f714300e640 1 -- 172.21.15.114:0/831818521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c151ea0 con 0x7f713c0cc9d0 2023-11-04T01:39:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.630+0000 7f714300e640 1 -- 172.21.15.114:0/831818521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c0b16e0 con 0x7f713c0cc9d0 2023-11-04T01:39:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.631+0000 7f71397fa640 1 -- 172.21.15.114:0/831818521 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f712801c460 con 0x7f713c0cc9d0 2023-11-04T01:39:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.631+0000 7f71397fa640 1 --2- 172.21.15.114:0/831818521 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f712006ae70 0x7f712006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.631+0000 7f71397fa640 1 -- 172.21.15.114:0/831818521 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f7128089aa0 con 0x7f713c0cc9d0 2023-11-04T01:39:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.631+0000 7f7140daa640 1 --2- 172.21.15.114:0/831818521 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f712006ae70 0x7f712006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.632+0000 7f7140daa640 1 --2- 172.21.15.114:0/831818521 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f712006ae70 0x7f712006d330 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7130037000 tx=0x7f7130008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.635+0000 7f71397fa640 1 -- 172.21.15.114:0/831818521 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f713c0b16e0 con 0x7f713c0cc9d0 2023-11-04T01:39:33.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.802+0000 7f714300e640 1 -- 172.21.15.114:0/831818521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f713c15c2b0 con 0x7f713c0cc9d0 2023-11-04T01:39:33.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.803+0000 7f71397fa640 1 -- 172.21.15.114:0/831818521 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7128054670 con 0x7f713c0cc9d0 2023-11-04T01:39:33.805 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:33.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.805+0000 7f714300e640 1 -- 172.21.15.114:0/831818521 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f712006ae70 msgr2=0x7f712006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.805+0000 7f714300e640 1 --2- 172.21.15.114:0/831818521 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f712006ae70 0x7f712006d330 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7130037000 tx=0x7f7130008040 comp rx=0 tx=0).stop 2023-11-04T01:39:33.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.805+0000 7f714300e640 1 -- 172.21.15.114:0/831818521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f713c0cc9d0 msgr2=0x7f713c0b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.805+0000 7f714300e640 1 --2- 172.21.15.114:0/831818521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f713c0cc9d0 0x7f713c0b37e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f712800c430 tx=0x7f712800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.805+0000 7f714300e640 1 -- 172.21.15.114:0/831818521 shutdown_connections 2023-11-04T01:39:33.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.805+0000 7f714300e640 1 --2- 172.21.15.114:0/831818521 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f713c153850 0x7f713c156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.805+0000 7f714300e640 1 --2- 172.21.15.114:0/831818521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f713c0cc9d0 0x7f713c0b37e0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.805+0000 7f714300e640 1 --2- 172.21.15.114:0/831818521 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f712006ae70 0x7f712006d330 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.805+0000 7f714300e640 1 --2- 172.21.15.114:0/831818521 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f713c0cc520 0x7f713c151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.805+0000 7f714300e640 1 -- 172.21.15.114:0/831818521 >> 172.21.15.114:0/831818521 conn(0x7f713c0ce950 msgr2=0x7f713c152910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.805+0000 7f714300e640 1 -- 172.21.15.114:0/831818521 shutdown_connections 2023-11-04T01:39:33.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.805+0000 7f714300e640 1 -- 172.21.15.114:0/831818521 wait complete. 2023-11-04T01:39:33.818 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:39:33.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.919+0000 7fa5001b6640 1 Processor -- start 2023-11-04T01:39:33.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.919+0000 7fa5001b6640 1 -- start start 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.920+0000 7fa5001b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa4f815e5a0 0x7fa4f806b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.920+0000 7fa5001b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa4f80c9af0 0x7fa4f8070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.920+0000 7fa5001b6640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f8066530 con 0x7fa4f815e1c0 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.920+0000 7fa5001b6640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f815f9e0 con 0x7fa4f80c9af0 2023-11-04T01:39:33.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.920+0000 7fa5001b6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f806bc40 con 0x7fa4f815e5a0 2023-11-04T01:39:33.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.920+0000 7fa4fd751640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa4f815e5a0 0x7fa4f806b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.920+0000 7fa4fe753640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa4f80c9af0 0x7fa4f8070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.920+0000 7fa4fdf52640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fa4f815e1c0 0x7fa4f815f2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:50412/0 (socket says 172.21.15.114:50412) 2023-11-04T01:39:33.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.920+0000 7fa4fdf52640 1 -- 172.21.15.114:0/2609339061 learned_addr learned my addr 172.21.15.114:0/2609339061 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:33.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.920+0000 7fa4fd751640 1 -- 172.21.15.114:0/2609339061 >> v2:172.21.15.141:3300/0 conn(0x7fa4f80c9af0 msgr2=0x7fa4f8070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:33.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.920+0000 7fa4fd751640 1 --2- 172.21.15.114:0/2609339061 >> v2:172.21.15.141:3300/0 conn(0x7fa4f80c9af0 0x7fa4f8070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.920+0000 7fa4fd751640 1 -- 172.21.15.114:0/2609339061 >> v1:172.21.15.141:6789/0 conn(0x7fa4f815e1c0 legacy=0x7fa4f815f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.920+0000 7fa4fd751640 1 -- 172.21.15.114:0/2609339061 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f8065f70 con 0x7fa4f815e5a0 2023-11-04T01:39:33.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.920+0000 7fa4fcf50640 1 -- 172.21.15.114:0/2609339061 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462310780 0 0) 0x7fa4f8066530 con 0x7fa4f815e1c0 2023-11-04T01:39:33.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.921+0000 7fa4fd751640 1 --2- 172.21.15.114:0/2609339061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa4f815e5a0 0x7fa4f806b700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80097a0 tx=0x7fa4e802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b055090c7c54359 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.921+0000 7fa4fcf50640 1 -- 172.21.15.114:0/2609339061 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8031780 con 0x7fa4f815e5a0 2023-11-04T01:39:33.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.921+0000 7fa4fcf50640 1 -- 172.21.15.114:0/2609339061 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e80318e0 con 0x7fa4f815e5a0 2023-11-04T01:39:33.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.921+0000 7fa4fcf50640 1 -- 172.21.15.114:0/2609339061 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8031c70 con 0x7fa4f815e5a0 2023-11-04T01:39:33.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.922+0000 7fa5001b6640 1 -- 172.21.15.114:0/2609339061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa4f815e5a0 msgr2=0x7fa4f806b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.922+0000 7fa5001b6640 1 --2- 172.21.15.114:0/2609339061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa4f815e5a0 0x7fa4f806b700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80097a0 tx=0x7fa4e802b820 comp rx=0 tx=0).stop 2023-11-04T01:39:33.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.922+0000 7fa5001b6640 1 -- 172.21.15.114:0/2609339061 shutdown_connections 2023-11-04T01:39:33.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.922+0000 7fa5001b6640 1 --2- 172.21.15.114:0/2609339061 >> v2:172.21.15.141:3300/0 conn(0x7fa4f80c9af0 0x7fa4f8070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.922+0000 7fa5001b6640 1 --2- 172.21.15.114:0/2609339061 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa4f815e5a0 0x7fa4f806b700 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.922+0000 7fa5001b6640 1 -- 172.21.15.114:0/2609339061 >> 172.21.15.114:0/2609339061 conn(0x7fa4f80cbc90 msgr2=0x7fa4f80cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.922+0000 7fa5001b6640 1 -- 172.21.15.114:0/2609339061 shutdown_connections 2023-11-04T01:39:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.922+0000 7fa5001b6640 1 -- 172.21.15.114:0/2609339061 wait complete. 2023-11-04T01:39:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.923+0000 7fa5001b6640 1 Processor -- start 2023-11-04T01:39:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.923+0000 7fa5001b6640 1 -- start start 2023-11-04T01:39:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa5001b6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4f80c9af0 0x7fa4f81f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa5001b6640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa4f815e1c0 0x7fa4f80c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa5001b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa4f815e5a0 0x7fa4f81f02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa5001b6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80c5b20 con 0x7fa4f80c9af0 2023-11-04T01:39:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa5001b6640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80c5560 con 0x7fa4f815e1c0 2023-11-04T01:39:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa5001b6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80c5840 con 0x7fa4f815e5a0 2023-11-04T01:39:33.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa4fdf52640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4f80c9af0 0x7fa4f81f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa4fdf52640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4f80c9af0 0x7fa4f81f3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50466/0 (socket says 172.21.15.114:50466) 2023-11-04T01:39:33.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa4fdf52640 1 -- 172.21.15.114:0/3417359269 learned_addr learned my addr 172.21.15.114:0/3417359269 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:33.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa4fe753640 1 --2- 172.21.15.114:0/3417359269 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa4f815e5a0 0x7fa4f81f02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa4fd751640 1 --2- 172.21.15.114:0/3417359269 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa4f815e1c0 0x7fa4f80c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa4fdf52640 1 -- 172.21.15.114:0/3417359269 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa4f815e5a0 msgr2=0x7fa4f81f02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa4fdf52640 1 --2- 172.21.15.114:0/3417359269 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa4f815e5a0 0x7fa4f81f02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa4fdf52640 1 -- 172.21.15.114:0/3417359269 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa4f815e1c0 msgr2=0x7fa4f80c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa4fdf52640 1 --2- 172.21.15.114:0/3417359269 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa4f815e1c0 0x7fa4f80c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa4fdf52640 1 -- 172.21.15.114:0/3417359269 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e8009400 con 0x7fa4f80c9af0 2023-11-04T01:39:33.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa4fdf52640 1 --2- 172.21.15.114:0/3417359269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4f80c9af0 0x7fa4f81f3270 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400c4d0 tx=0x7fa4f400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa4ee7fc640 1 -- 172.21.15.114:0/3417359269 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40074e0 con 0x7fa4f80c9af0 2023-11-04T01:39:33.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa4ee7fc640 1 -- 172.21.15.114:0/3417359269 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f4007660 con 0x7fa4f80c9af0 2023-11-04T01:39:33.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa5001b6640 1 -- 172.21.15.114:0/3417359269 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f80c68b0 con 0x7fa4f80c9af0 2023-11-04T01:39:33.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.924+0000 7fa4ee7fc640 1 -- 172.21.15.114:0/3417359269 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4004a20 con 0x7fa4f80c9af0 2023-11-04T01:39:33.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.925+0000 7fa5001b6640 1 -- 172.21.15.114:0/3417359269 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f80c4560 con 0x7fa4f80c9af0 2023-11-04T01:39:33.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.925+0000 7fa5001b6640 1 -- 172.21.15.114:0/3417359269 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f80c6dd0 con 0x7fa4f80c9af0 2023-11-04T01:39:33.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.926+0000 7fa4ee7fc640 1 -- 172.21.15.114:0/3417359269 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4f4004b80 con 0x7fa4f80c9af0 2023-11-04T01:39:33.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.926+0000 7fa4ee7fc640 1 --2- 172.21.15.114:0/3417359269 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa4dc06ae70 0x7fa4dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.926+0000 7fa4ee7fc640 1 -- 172.21.15.114:0/3417359269 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fa4f4089000 con 0x7fa4f80c9af0 2023-11-04T01:39:33.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.926+0000 7fa4fd751640 1 --2- 172.21.15.114:0/3417359269 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa4dc06ae70 0x7fa4dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.927+0000 7fa4fd751640 1 --2- 172.21.15.114:0/3417359269 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa4dc06ae70 0x7fa4dc06d330 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8036000 tx=0x7fa4e8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:33.930+0000 7fa4ee7fc640 1 -- 172.21.15.114:0/3417359269 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa4f80c6dd0 con 0x7fa4f80c9af0 2023-11-04T01:39:34.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.095+0000 7fa5001b6640 1 -- 172.21.15.114:0/3417359269 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa4f80c6dd0 con 0x7fa4f80c9af0 2023-11-04T01:39:34.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.095+0000 7fa4ee7fc640 1 -- 172.21.15.114:0/3417359269 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa4f80c6dd0 con 0x7fa4f80c9af0 2023-11-04T01:39:34.097 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:39:34.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.097+0000 7fa5001b6640 1 -- 172.21.15.114:0/3417359269 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa4dc06ae70 msgr2=0x7fa4dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.097+0000 7fa5001b6640 1 --2- 172.21.15.114:0/3417359269 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa4dc06ae70 0x7fa4dc06d330 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8036000 tx=0x7fa4e8008030 comp rx=0 tx=0).stop 2023-11-04T01:39:34.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.097+0000 7fa5001b6640 1 -- 172.21.15.114:0/3417359269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4f80c9af0 msgr2=0x7fa4f81f3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.097+0000 7fa5001b6640 1 --2- 172.21.15.114:0/3417359269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4f80c9af0 0x7fa4f81f3270 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400c4d0 tx=0x7fa4f400c990 comp rx=0 tx=0).stop 2023-11-04T01:39:34.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.097+0000 7fa5001b6640 1 -- 172.21.15.114:0/3417359269 shutdown_connections 2023-11-04T01:39:34.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.097+0000 7fa5001b6640 1 --2- 172.21.15.114:0/3417359269 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa4f815e5a0 0x7fa4f81f02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.097+0000 7fa5001b6640 1 --2- 172.21.15.114:0/3417359269 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa4dc06ae70 0x7fa4dc06d330 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.097+0000 7fa5001b6640 1 --2- 172.21.15.114:0/3417359269 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa4f815e1c0 0x7fa4f80c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.097+0000 7fa5001b6640 1 --2- 172.21.15.114:0/3417359269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4f80c9af0 0x7fa4f81f3270 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.097+0000 7fa5001b6640 1 -- 172.21.15.114:0/3417359269 >> 172.21.15.114:0/3417359269 conn(0x7fa4f80cbc90 msgr2=0x7fa4f8070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.097+0000 7fa5001b6640 1 -- 172.21.15.114:0/3417359269 shutdown_connections 2023-11-04T01:39:34.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.097+0000 7fa5001b6640 1 -- 172.21.15.114:0/3417359269 wait complete. 2023-11-04T01:39:34.110 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:39:34.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.208+0000 7f19627b7640 1 Processor -- start 2023-11-04T01:39:34.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.209+0000 7f19627b7640 1 -- start start 2023-11-04T01:39:34.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.209+0000 7f19627b7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f195c0b4880 0x7f195c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.209+0000 7f19627b7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c0cde60 con 0x7f195c153e60 2023-11-04T01:39:34.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.209+0000 7f19627b7640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c160f90 con 0x7f195c0cd6d0 2023-11-04T01:39:34.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.209+0000 7f19627b7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0b5200 con 0x7f195c0b4880 2023-11-04T01:39:34.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.209+0000 7f195bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f195c153e60 0x7f195c15dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35154/0 (socket says 172.21.15.114:35154) 2023-11-04T01:39:34.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.209+0000 7f195bfff640 1 -- 172.21.15.114:0/3925439596 learned_addr learned my addr 172.21.15.114:0/3925439596 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:34.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f1960d54640 1 --2- 172.21.15.114:0/3925439596 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f195c0b4880 0x7f195c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195affd640 1 -- 172.21.15.114:0/3925439596 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323891750 0 0) 0x7f195c0cde60 con 0x7f195c153e60 2023-11-04T01:39:34.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195affd640 1 -- 172.21.15.114:0/3925439596 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1944003520 con 0x7f195c153e60 2023-11-04T01:39:34.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195affd640 1 -- 172.21.15.114:0/3925439596 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3855656302 0 0) 0x7f1944003520 con 0x7f195c153e60 2023-11-04T01:39:34.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195affd640 1 -- 172.21.15.114:0/3925439596 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f195c0b4880 msgr2=0x7f195c0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195affd640 1 --2- 172.21.15.114:0/3925439596 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f195c0b4880 0x7f195c0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195affd640 1 -- 172.21.15.114:0/3925439596 >> v1:172.21.15.141:6789/0 conn(0x7f195c0cd6d0 legacy=0x7f195c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195affd640 1 -- 172.21.15.114:0/3925439596 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c0ce090 con 0x7f195c153e60 2023-11-04T01:39:34.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195affd640 1 -- 172.21.15.114:0/3925439596 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f194c001670 con 0x7f195c153e60 2023-11-04T01:39:34.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195affd640 1 -- 172.21.15.114:0/3925439596 >> v1:172.21.15.114:6789/0 conn(0x7f195c153e60 legacy=0x7f195c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195affd640 1 --2- 172.21.15.114:0/3925439596 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19440039a0 0x7f1944003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195affd640 1 --2- 172.21.15.114:0/3925439596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19440047c0 0x7f1944004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195affd640 1 --2- 172.21.15.114:0/3925439596 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f195c0b4880 0x7f1944005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195affd640 1 -- 172.21.15.114:0/3925439596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0b5200 con 0x7f19440047c0 2023-11-04T01:39:34.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195affd640 1 -- 172.21.15.114:0/3925439596 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194400ba60 con 0x7f19440039a0 2023-11-04T01:39:34.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195affd640 1 -- 172.21.15.114:0/3925439596 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194400bc20 con 0x7f195c0b4880 2023-11-04T01:39:34.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195b7fe640 1 --2- 172.21.15.114:0/3925439596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19440047c0 0x7f1944004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f195bfff640 1 --2- 172.21.15.114:0/3925439596 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19440039a0 0x7f1944003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.210+0000 7f1960d54640 1 --2- 172.21.15.114:0/3925439596 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f195c0b4880 0x7f1944005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.211+0000 7f195b7fe640 1 -- 172.21.15.114:0/3925439596 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f195c0b4880 msgr2=0x7f1944005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.211+0000 7f195b7fe640 1 --2- 172.21.15.114:0/3925439596 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f195c0b4880 0x7f1944005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.211+0000 7f195b7fe640 1 -- 172.21.15.114:0/3925439596 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19440039a0 msgr2=0x7f1944003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.211+0000 7f195b7fe640 1 --2- 172.21.15.114:0/3925439596 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f19440039a0 0x7f1944003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.211+0000 7f195b7fe640 1 -- 172.21.15.114:0/3925439596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1944003520 con 0x7f19440047c0 2023-11-04T01:39:34.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.211+0000 7f1960d54640 1 --2- 172.21.15.114:0/3925439596 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f195c0b4880 0x7f1944005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:34.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.211+0000 7f195b7fe640 1 --2- 172.21.15.114:0/3925439596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19440047c0 0x7f1944004c40 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f195c161b30 tx=0x7f19440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519134db6206f437 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.211+0000 7f195affd640 1 -- 172.21.15.114:0/3925439596 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19500052d0 con 0x7f19440047c0 2023-11-04T01:39:34.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.211+0000 7f195affd640 1 -- 172.21.15.114:0/3925439596 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195002e050 con 0x7f19440047c0 2023-11-04T01:39:34.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.211+0000 7f195affd640 1 -- 172.21.15.114:0/3925439596 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19500035f0 con 0x7f19440047c0 2023-11-04T01:39:34.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.212+0000 7f19627b7640 1 -- 172.21.15.114:0/3925439596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19440047c0 msgr2=0x7f1944004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.212+0000 7f19627b7640 1 --2- 172.21.15.114:0/3925439596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19440047c0 0x7f1944004c40 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f195c161b30 tx=0x7f19440057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.212+0000 7f1960d54640 1 -- 172.21.15.114:0/3925439596 reap_dead start 2023-11-04T01:39:34.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.212+0000 7f19627b7640 1 -- 172.21.15.114:0/3925439596 shutdown_connections 2023-11-04T01:39:34.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.212+0000 7f19627b7640 1 -- 172.21.15.114:0/3925439596 >> 172.21.15.114:0/3925439596 conn(0x7f195c0cf880 msgr2=0x7f195c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.212+0000 7f19627b7640 1 -- 172.21.15.114:0/3925439596 shutdown_connections 2023-11-04T01:39:34.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.212+0000 7f19627b7640 1 -- 172.21.15.114:0/3925439596 wait complete. 2023-11-04T01:39:34.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.213+0000 7f19627b7640 1 Processor -- start 2023-11-04T01:39:34.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.213+0000 7f19627b7640 1 -- start start 2023-11-04T01:39:34.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f19627b7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19440047c0 0x7f195c0c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f19627b7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f195c1f35b0 0x7f195c0cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f19627b7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f195c152ec0 0x7f195c0c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f19627b7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c1f3a30 con 0x7f195c152ec0 2023-11-04T01:39:34.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f19627b7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0ccb50 con 0x7f195c1f35b0 2023-11-04T01:39:34.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f19627b7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0cc8f0 con 0x7f19440047c0 2023-11-04T01:39:34.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f1960d54640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f195c152ec0 0x7f195c0c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f1960d54640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f195c152ec0 0x7f195c0c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50484/0 (socket says 172.21.15.114:50484) 2023-11-04T01:39:34.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f1960d54640 1 -- 172.21.15.114:0/3586941457 learned_addr learned my addr 172.21.15.114:0/3586941457 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:34.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f195bfff640 1 --2- 172.21.15.114:0/3586941457 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19440047c0 0x7f195c0c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f195b7fe640 1 --2- 172.21.15.114:0/3586941457 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f195c1f35b0 0x7f195c0cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f1960d54640 1 -- 172.21.15.114:0/3586941457 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19440047c0 msgr2=0x7f195c0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f1960d54640 1 --2- 172.21.15.114:0/3586941457 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19440047c0 0x7f195c0c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f1960d54640 1 -- 172.21.15.114:0/3586941457 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f195c1f35b0 msgr2=0x7f195c0cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f1960d54640 1 --2- 172.21.15.114:0/3586941457 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f195c1f35b0 0x7f195c0cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f1960d54640 1 -- 172.21.15.114:0/3586941457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c0c8110 con 0x7f195c152ec0 2023-11-04T01:39:34.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.214+0000 7f195bfff640 1 --2- 172.21.15.114:0/3586941457 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19440047c0 0x7f195c0c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:34.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.215+0000 7f1960d54640 1 --2- 172.21.15.114:0/3586941457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f195c152ec0 0x7f195c0c6900 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f195c06c900 tx=0x7f1954009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.215+0000 7f1958ff9640 1 -- 172.21.15.114:0/3586941457 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195401b070 con 0x7f195c152ec0 2023-11-04T01:39:34.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.215+0000 7f1958ff9640 1 -- 172.21.15.114:0/3586941457 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195400f040 con 0x7f195c152ec0 2023-11-04T01:39:34.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.215+0000 7f19627b7640 1 -- 172.21.15.114:0/3586941457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c0c83f0 con 0x7f195c152ec0 2023-11-04T01:39:34.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.215+0000 7f1958ff9640 1 -- 172.21.15.114:0/3586941457 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195400e050 con 0x7f195c152ec0 2023-11-04T01:39:34.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.215+0000 7f19627b7640 1 -- 172.21.15.114:0/3586941457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c0c89b0 con 0x7f195c152ec0 2023-11-04T01:39:34.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.216+0000 7f19627b7640 1 -- 172.21.15.114:0/3586941457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c0cd4f0 con 0x7f195c152ec0 2023-11-04T01:39:34.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.216+0000 7f1958ff9640 1 -- 172.21.15.114:0/3586941457 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1954015440 con 0x7f195c152ec0 2023-11-04T01:39:34.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.217+0000 7f1958ff9640 1 --2- 172.21.15.114:0/3586941457 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f194806aea0 0x7f194806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.217+0000 7f1958ff9640 1 -- 172.21.15.114:0/3586941457 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f195408a040 con 0x7f195c152ec0 2023-11-04T01:39:34.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.217+0000 7f195bfff640 1 --2- 172.21.15.114:0/3586941457 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f194806aea0 0x7f194806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.217+0000 7f195bfff640 1 --2- 172.21.15.114:0/3586941457 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f194806aea0 0x7f194806d360 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f195c0cc340 tx=0x7f194c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.221+0000 7f1958ff9640 1 -- 172.21.15.114:0/3586941457 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1954054b80 con 0x7f195c152ec0 2023-11-04T01:39:34.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.400+0000 7f19627b7640 1 -- 172.21.15.114:0/3586941457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f195c074290 con 0x7f195c152ec0 2023-11-04T01:39:34.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.400+0000 7f1958ff9640 1 -- 172.21.15.114:0/3586941457 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) v1 ==== 80+0+0 (secure 0 0 0) 0x7f19540581a0 con 0x7f195c152ec0 2023-11-04T01:39:34.402 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-11-04T01:39:34.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.402+0000 7f19627b7640 1 -- 172.21.15.114:0/3586941457 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f194806aea0 msgr2=0x7f194806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.402+0000 7f19627b7640 1 --2- 172.21.15.114:0/3586941457 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f194806aea0 0x7f194806d360 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f195c0cc340 tx=0x7f194c009040 comp rx=0 tx=0).stop 2023-11-04T01:39:34.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.402+0000 7f19627b7640 1 -- 172.21.15.114:0/3586941457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f195c152ec0 msgr2=0x7f195c0c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.402+0000 7f19627b7640 1 --2- 172.21.15.114:0/3586941457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f195c152ec0 0x7f195c0c6900 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f195c06c900 tx=0x7f1954009f90 comp rx=0 tx=0).stop 2023-11-04T01:39:34.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.402+0000 7f19627b7640 1 -- 172.21.15.114:0/3586941457 shutdown_connections 2023-11-04T01:39:34.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.402+0000 7f19627b7640 1 --2- 172.21.15.114:0/3586941457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f195c152ec0 0x7f195c0c6900 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.402+0000 7f19627b7640 1 --2- 172.21.15.114:0/3586941457 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f194806aea0 0x7f194806d360 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.402+0000 7f19627b7640 1 --2- 172.21.15.114:0/3586941457 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f195c1f35b0 0x7f195c0cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.402+0000 7f19627b7640 1 --2- 172.21.15.114:0/3586941457 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f19440047c0 0x7f195c0c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.402+0000 7f19627b7640 1 -- 172.21.15.114:0/3586941457 >> 172.21.15.114:0/3586941457 conn(0x7f195c0cf880 msgr2=0x7f195c0d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.403+0000 7f19627b7640 1 -- 172.21.15.114:0/3586941457 shutdown_connections 2023-11-04T01:39:34.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.403+0000 7f19627b7640 1 -- 172.21.15.114:0/3586941457 wait complete. 2023-11-04T01:39:34.415 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi114.front.sepia.ceph.com... 2023-11-04T01:39:34.415 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:34.415 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:34.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:34.474 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[114784]: fuse finished with error 0 and tester_r 0 2023-11-04T01:39:34.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:34.482 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:39:34.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:34.482 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:39:34.483 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:39:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:34.497 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:39:34.497 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:34.517 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:39:34.517 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:39:34.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:34.517 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:39:34.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:34.575 INFO:teuthology.orchestra.run.smithi141.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:39:34.575 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:39:34.575 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:34.590 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:39:34.590 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:39:34.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:34.591 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:39:34.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:34.645 INFO:teuthology.orchestra.run.smithi114.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:39:34.645 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:39:34.646 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:34.663 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:39:34.663 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:39:34.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:34.663 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:39:34.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:34.721 INFO:teuthology.orchestra.run.smithi141.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:39:34.721 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:34.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.820+0000 7fe86fd16640 1 Processor -- start 2023-11-04T01:39:34.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.820+0000 7fe86fd16640 1 -- start start 2023-11-04T01:39:34.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.821+0000 7fe86fd16640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe868159c70 0x7fe8680ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.821+0000 7fe86fd16640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8680b4110 con 0x7fe8680b0ae0 2023-11-04T01:39:34.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.821+0000 7fe86fd16640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8680b43f0 con 0x7fe86806db20 2023-11-04T01:39:34.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.821+0000 7fe86fd16640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8680b49b0 con 0x7fe868159c70 2023-11-04T01:39:34.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.821+0000 7fe86e2b3640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe8680b0ae0 0x7fe86815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35170/0 (socket says 172.21.15.114:35170) 2023-11-04T01:39:34.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.821+0000 7fe86e2b3640 1 -- 172.21.15.114:0/959850556 learned_addr learned my addr 172.21.15.114:0/959850556 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:34.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.821+0000 7fe86cab0640 1 -- 172.21.15.114:0/959850556 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65074214 0 0) 0x7fe8680b4110 con 0x7fe8680b0ae0 2023-11-04T01:39:34.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.821+0000 7fe86cab0640 1 -- 172.21.15.114:0/959850556 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe854003520 con 0x7fe8680b0ae0 2023-11-04T01:39:34.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.821+0000 7fe86dab2640 1 --2- 172.21.15.114:0/959850556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe868159c70 0x7fe8680ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.821+0000 7fe86cab0640 1 -- 172.21.15.114:0/959850556 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3526015723 0 0) 0x7fe854003520 con 0x7fe8680b0ae0 2023-11-04T01:39:34.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.821+0000 7fe86cab0640 1 -- 172.21.15.114:0/959850556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe868159c70 msgr2=0x7fe8680ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.821+0000 7fe86cab0640 1 --2- 172.21.15.114:0/959850556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe868159c70 0x7fe8680ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.821+0000 7fe86cab0640 1 -- 172.21.15.114:0/959850556 >> v1:172.21.15.141:6789/0 conn(0x7fe86806db20 legacy=0x7fe8680b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.821+0000 7fe86cab0640 1 -- 172.21.15.114:0/959850556 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8680b46d0 con 0x7fe8680b0ae0 2023-11-04T01:39:34.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.821+0000 7fe86cab0640 1 -- 172.21.15.114:0/959850556 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fe8600019f0 con 0x7fe8680b0ae0 2023-11-04T01:39:34.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.821+0000 7fe86cab0640 1 -- 172.21.15.114:0/959850556 >> v1:172.21.15.114:6789/0 conn(0x7fe8680b0ae0 legacy=0x7fe86815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.822+0000 7fe86cab0640 1 --2- 172.21.15.114:0/959850556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8540039a0 0x7fe854003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.822+0000 7fe86cab0640 1 --2- 172.21.15.114:0/959850556 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe8540047c0 0x7fe854004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.822+0000 7fe86cab0640 1 --2- 172.21.15.114:0/959850556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe868159c70 0x7fe854005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.822+0000 7fe86cab0640 1 -- 172.21.15.114:0/959850556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8680b49b0 con 0x7fe8540039a0 2023-11-04T01:39:34.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.822+0000 7fe86cab0640 1 -- 172.21.15.114:0/959850556 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85400bb10 con 0x7fe8540047c0 2023-11-04T01:39:34.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.822+0000 7fe86cab0640 1 -- 172.21.15.114:0/959850556 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85400bcd0 con 0x7fe868159c70 2023-11-04T01:39:34.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.822+0000 7fe86dab2640 1 --2- 172.21.15.114:0/959850556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8540039a0 0x7fe854003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.822+0000 7fe86e2b3640 1 --2- 172.21.15.114:0/959850556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe868159c70 0x7fe854005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.822+0000 7fe86d2b1640 1 --2- 172.21.15.114:0/959850556 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe8540047c0 0x7fe854004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.822+0000 7fe86dab2640 1 -- 172.21.15.114:0/959850556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe868159c70 msgr2=0x7fe854005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.822+0000 7fe86dab2640 1 --2- 172.21.15.114:0/959850556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe868159c70 0x7fe854005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.822+0000 7fe86dab2640 1 -- 172.21.15.114:0/959850556 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe8540047c0 msgr2=0x7fe854004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.822+0000 7fe86dab2640 1 --2- 172.21.15.114:0/959850556 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe8540047c0 0x7fe854004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.822+0000 7fe86dab2640 1 -- 172.21.15.114:0/959850556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe854003520 con 0x7fe8540039a0 2023-11-04T01:39:34.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.822+0000 7fe86e2b3640 1 --2- 172.21.15.114:0/959850556 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe868159c70 0x7fe854005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:34.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.822+0000 7fe86d2b1640 1 --2- 172.21.15.114:0/959850556 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe8540047c0 0x7fe854004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:34.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.823+0000 7fe86dab2640 1 --2- 172.21.15.114:0/959850556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8540039a0 0x7fe854003dc0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fe86400ba30 tx=0x7fe8540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46304df981de8537 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.823+0000 7fe86cab0640 1 -- 172.21.15.114:0/959850556 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe864032640 con 0x7fe8540039a0 2023-11-04T01:39:34.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.823+0000 7fe86cab0640 1 -- 172.21.15.114:0/959850556 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8640327a0 con 0x7fe8540039a0 2023-11-04T01:39:34.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.823+0000 7fe86cab0640 1 -- 172.21.15.114:0/959850556 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe864032b30 con 0x7fe8540039a0 2023-11-04T01:39:34.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.823+0000 7fe86fd16640 1 -- 172.21.15.114:0/959850556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8540039a0 msgr2=0x7fe854003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.823+0000 7fe86fd16640 1 --2- 172.21.15.114:0/959850556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8540039a0 0x7fe854003dc0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fe86400ba30 tx=0x7fe8540057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.823+0000 7fe86e2b3640 1 -- 172.21.15.114:0/959850556 reap_dead start 2023-11-04T01:39:34.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.823+0000 7fe86fd16640 1 -- 172.21.15.114:0/959850556 shutdown_connections 2023-11-04T01:39:34.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.823+0000 7fe86fd16640 1 -- 172.21.15.114:0/959850556 >> 172.21.15.114:0/959850556 conn(0x7fe8680ce950 msgr2=0x7fe8680ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.823+0000 7fe86fd16640 1 -- 172.21.15.114:0/959850556 shutdown_connections 2023-11-04T01:39:34.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.823+0000 7fe86fd16640 1 -- 172.21.15.114:0/959850556 wait complete. 2023-11-04T01:39:34.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.824+0000 7fe86fd16640 1 Processor -- start 2023-11-04T01:39:34.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.824+0000 7fe86fd16640 1 -- start start 2023-11-04T01:39:34.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.825+0000 7fe86fd16640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8540039a0 0x7fe8681520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.825+0000 7fe86fd16640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe868154cf0 0x7fe8680c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.825+0000 7fe86fd16640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe86815afa0 0x7fe86815b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.825+0000 7fe86fd16640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86815b990 con 0x7fe8540039a0 2023-11-04T01:39:34.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.825+0000 7fe86fd16640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8681551d0 con 0x7fe86815afa0 2023-11-04T01:39:34.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.825+0000 7fe86fd16640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8681554b0 con 0x7fe868154cf0 2023-11-04T01:39:34.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.825+0000 7fe86dab2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8540039a0 0x7fe8681520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.825+0000 7fe86dab2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8540039a0 0x7fe8681520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50504/0 (socket says 172.21.15.114:50504) 2023-11-04T01:39:34.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.825+0000 7fe86dab2640 1 -- 172.21.15.114:0/2296537404 learned_addr learned my addr 172.21.15.114:0/2296537404 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:34.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.825+0000 7fe86e2b3640 1 --2- 172.21.15.114:0/2296537404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe86815afa0 0x7fe86815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.825+0000 7fe86d2b1640 1 --2- 172.21.15.114:0/2296537404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe868154cf0 0x7fe8680c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.825+0000 7fe86dab2640 1 -- 172.21.15.114:0/2296537404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe868154cf0 msgr2=0x7fe8680c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.826+0000 7fe86dab2640 1 --2- 172.21.15.114:0/2296537404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe868154cf0 0x7fe8680c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.826+0000 7fe86dab2640 1 -- 172.21.15.114:0/2296537404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe86815afa0 msgr2=0x7fe86815b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.826+0000 7fe86dab2640 1 --2- 172.21.15.114:0/2296537404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe86815afa0 0x7fe86815b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.826+0000 7fe86dab2640 1 -- 172.21.15.114:0/2296537404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868155790 con 0x7fe8540039a0 2023-11-04T01:39:34.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.826+0000 7fe86e2b3640 1 --2- 172.21.15.114:0/2296537404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe86815afa0 0x7fe86815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:34.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.826+0000 7fe86d2b1640 1 --2- 172.21.15.114:0/2296537404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe868154cf0 0x7fe8680c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:34.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.826+0000 7fe86dab2640 1 --2- 172.21.15.114:0/2296537404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8540039a0 0x7fe8681520d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fe86402bec0 tx=0x7fe864004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.826+0000 7fe85e7fc640 1 -- 172.21.15.114:0/2296537404 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86403ba70 con 0x7fe8540039a0 2023-11-04T01:39:34.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.826+0000 7fe85e7fc640 1 -- 172.21.15.114:0/2296537404 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86403bbd0 con 0x7fe8540039a0 2023-11-04T01:39:34.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.826+0000 7fe86fd16640 1 -- 172.21.15.114:0/2296537404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe868155a70 con 0x7fe8540039a0 2023-11-04T01:39:34.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.826+0000 7fe85e7fc640 1 -- 172.21.15.114:0/2296537404 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe864030410 con 0x7fe8540039a0 2023-11-04T01:39:34.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.826+0000 7fe86fd16640 1 -- 172.21.15.114:0/2296537404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe868152610 con 0x7fe8540039a0 2023-11-04T01:39:34.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.827+0000 7fe86fd16640 1 -- 172.21.15.114:0/2296537404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8681f2b30 con 0x7fe8540039a0 2023-11-04T01:39:34.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.827+0000 7fe85e7fc640 1 -- 172.21.15.114:0/2296537404 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe864030570 con 0x7fe8540039a0 2023-11-04T01:39:34.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.828+0000 7fe85e7fc640 1 --2- 172.21.15.114:0/2296537404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe84c06aea0 0x7fe84c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.828+0000 7fe86d2b1640 1 --2- 172.21.15.114:0/2296537404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe84c06aea0 0x7fe84c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.828+0000 7fe85e7fc640 1 -- 172.21.15.114:0/2296537404 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fe8640ac270 con 0x7fe8540039a0 2023-11-04T01:39:34.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.828+0000 7fe86d2b1640 1 --2- 172.21.15.114:0/2296537404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe84c06aea0 0x7fe84c06d360 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe858000c00 tx=0x7fe858009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:34.832+0000 7fe85e7fc640 1 -- 172.21.15.114:0/2296537404 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe864076e40 con 0x7fe8540039a0 2023-11-04T01:39:35.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.031+0000 7fe86fd16640 1 -- 172.21.15.114:0/2296537404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe868074290 con 0x7fe8540039a0 2023-11-04T01:39:35.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.032+0000 7fe85e7fc640 1 -- 172.21.15.114:0/2296537404 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4924 (secure 0 0 0) 0x7fe864036090 con 0x7fe8540039a0 2023-11-04T01:39:35.034 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:35.034 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6055,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/775121992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":775121992},{"type":"v1","addr":"172.21.15.141:6835","nonce":775121992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6951,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1790830778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1790830778},{"type":"v1","addr":"172.21.15.114:6836","nonce":1790830778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6954,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2482757978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2482757978},{"type":"v1","addr":"172.21.15.114:6837","nonce":2482757978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:22.003461+0000","modified":"2023-11-04T01:39:31.088794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6966":{"gid":6966,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6834/1471552462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1471552462},{"type":"v1","addr":"172.21.15.141:6834","nonce":1471552462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:39:35.034 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 37 2023-11-04T01:39:35.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.034+0000 7fe86fd16640 1 -- 172.21.15.114:0/2296537404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe84c06aea0 msgr2=0x7fe84c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.034+0000 7fe86fd16640 1 --2- 172.21.15.114:0/2296537404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe84c06aea0 0x7fe84c06d360 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe858000c00 tx=0x7fe858009040 comp rx=0 tx=0).stop 2023-11-04T01:39:35.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.034+0000 7fe86fd16640 1 -- 172.21.15.114:0/2296537404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8540039a0 msgr2=0x7fe8681520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.034+0000 7fe86fd16640 1 --2- 172.21.15.114:0/2296537404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8540039a0 0x7fe8681520d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fe86402bec0 tx=0x7fe864004730 comp rx=0 tx=0).stop 2023-11-04T01:39:35.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.034+0000 7fe86fd16640 1 -- 172.21.15.114:0/2296537404 shutdown_connections 2023-11-04T01:39:35.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.034+0000 7fe86fd16640 1 --2- 172.21.15.114:0/2296537404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe84c06aea0 0x7fe84c06d360 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.034+0000 7fe86fd16640 1 --2- 172.21.15.114:0/2296537404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe86815afa0 0x7fe86815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.034+0000 7fe86fd16640 1 --2- 172.21.15.114:0/2296537404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe868154cf0 0x7fe8680c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.034+0000 7fe86fd16640 1 --2- 172.21.15.114:0/2296537404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8540039a0 0x7fe8681520d0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.034+0000 7fe86fd16640 1 -- 172.21.15.114:0/2296537404 >> 172.21.15.114:0/2296537404 conn(0x7fe8680ce950 msgr2=0x7fe8680cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.034+0000 7fe86fd16640 1 -- 172.21.15.114:0/2296537404 shutdown_connections 2023-11-04T01:39:35.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.034+0000 7fe86fd16640 1 -- 172.21.15.114:0/2296537404 wait complete. 2023-11-04T01:39:35.047 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:35.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.143+0000 7f7aa924f640 1 Processor -- start 2023-11-04T01:39:35.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.143+0000 7f7aa924f640 1 -- start start 2023-11-04T01:39:35.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.144+0000 7f7aa924f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7aa40cda60 0x7f7aa40ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.144+0000 7f7aa924f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aa40b0cd0 0x7f7aa4070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.144+0000 7f7aa924f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7aa40cace0 0x7f7aa4070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.144+0000 7f7aa924f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa40cc990 con 0x7f7aa40cace0 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.144+0000 7f7aa924f640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa40ccc70 con 0x7f7aa40cda60 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.144+0000 7f7aa924f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40c9ce0 con 0x7f7aa40b0cd0 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.144+0000 7f7aa359e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7aa40cace0 0x7f7aa4070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.144+0000 7f7aa359e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7aa40cace0 0x7f7aa4070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50516/0 (socket says 172.21.15.114:50516) 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.144+0000 7f7aa359e640 1 -- 172.21.15.114:0/226933807 learned_addr learned my addr 172.21.15.114:0/226933807 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.145+0000 7f7aa259c640 1 --2- 172.21.15.114:0/226933807 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aa40b0cd0 0x7f7aa4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.145+0000 7f7aa2d9d640 1 --2- 172.21.15.114:0/226933807 >> v2:172.21.15.141:3300/0 conn(0x7f7aa40cda60 0x7f7aa40ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.145+0000 7f7aa359e640 1 -- 172.21.15.114:0/226933807 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aa40b0cd0 msgr2=0x7f7aa4070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.145+0000 7f7aa359e640 1 --2- 172.21.15.114:0/226933807 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aa40b0cd0 0x7f7aa4070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.145+0000 7f7aa359e640 1 -- 172.21.15.114:0/226933807 >> v2:172.21.15.141:3300/0 conn(0x7f7aa40cda60 msgr2=0x7f7aa40ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.145+0000 7f7aa359e640 1 --2- 172.21.15.114:0/226933807 >> v2:172.21.15.141:3300/0 conn(0x7f7aa40cda60 0x7f7aa40ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.145+0000 7f7aa359e640 1 -- 172.21.15.114:0/226933807 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa40c9fc0 con 0x7f7aa40cace0 2023-11-04T01:39:35.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.145+0000 7f7aa359e640 1 --2- 172.21.15.114:0/226933807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aa40cace0 0x7f7aa4070b70 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40cf800 tx=0x7f7a9c02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28cdc59117bf0a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.146+0000 7f7aa1d9b640 1 -- 172.21.15.114:0/226933807 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c02ee90 con 0x7f7aa40cace0 2023-11-04T01:39:35.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.146+0000 7f7aa1d9b640 1 -- 172.21.15.114:0/226933807 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c032070 con 0x7f7aa40cace0 2023-11-04T01:39:35.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.146+0000 7f7aa1d9b640 1 -- 172.21.15.114:0/226933807 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c038620 con 0x7f7aa40cace0 2023-11-04T01:39:35.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.146+0000 7f7aa924f640 1 -- 172.21.15.114:0/226933807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aa40cace0 msgr2=0x7f7aa4070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.146+0000 7f7aa924f640 1 --2- 172.21.15.114:0/226933807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aa40cace0 0x7f7aa4070b70 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40cf800 tx=0x7f7a9c02e0e0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.146+0000 7f7aa924f640 1 -- 172.21.15.114:0/226933807 shutdown_connections 2023-11-04T01:39:35.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.146+0000 7f7aa924f640 1 --2- 172.21.15.114:0/226933807 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aa40b0cd0 0x7f7aa4070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.146+0000 7f7aa924f640 1 --2- 172.21.15.114:0/226933807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aa40cace0 0x7f7aa4070b70 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.146+0000 7f7aa924f640 1 --2- 172.21.15.114:0/226933807 >> v2:172.21.15.141:3300/0 conn(0x7f7aa40cda60 0x7f7aa40ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.146+0000 7f7aa924f640 1 -- 172.21.15.114:0/226933807 >> 172.21.15.114:0/226933807 conn(0x7f7aa40ce950 msgr2=0x7f7aa40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.146+0000 7f7aa924f640 1 -- 172.21.15.114:0/226933807 shutdown_connections 2023-11-04T01:39:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.146+0000 7f7aa924f640 1 -- 172.21.15.114:0/226933807 wait complete. 2023-11-04T01:39:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.148+0000 7f7aa924f640 1 Processor -- start 2023-11-04T01:39:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.148+0000 7f7aa924f640 1 -- start start 2023-11-04T01:39:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.148+0000 7f7aa924f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aa40b0cd0 0x7f7aa4156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.148+0000 7f7aa924f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aa40cace0 0x7f7aa40c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.148+0000 7f7aa924f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7aa40cda60 0x7f7aa40c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.148+0000 7f7aa924f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa4157170 con 0x7f7aa40b0cd0 2023-11-04T01:39:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.148+0000 7f7aa924f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40b18f0 con 0x7f7aa40cda60 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.148+0000 7f7aa924f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40b1bb0 con 0x7f7aa40cace0 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.148+0000 7f7aa2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aa40b0cd0 0x7f7aa4156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.149+0000 7f7aa2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aa40b0cd0 0x7f7aa4156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50526/0 (socket says 172.21.15.114:50526) 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.149+0000 7f7aa2d9d640 1 -- 172.21.15.114:0/3435061515 learned_addr learned my addr 172.21.15.114:0/3435061515 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.149+0000 7f7aa259c640 1 --2- 172.21.15.114:0/3435061515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aa40cace0 0x7f7aa40c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.149+0000 7f7aa359e640 1 --2- 172.21.15.114:0/3435061515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7aa40cda60 0x7f7aa40c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.149+0000 7f7aa2d9d640 1 -- 172.21.15.114:0/3435061515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aa40cace0 msgr2=0x7f7aa40c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.149+0000 7f7aa2d9d640 1 --2- 172.21.15.114:0/3435061515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aa40cace0 0x7f7aa40c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.149+0000 7f7aa2d9d640 1 -- 172.21.15.114:0/3435061515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7aa40cda60 msgr2=0x7f7aa40c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.149+0000 7f7aa2d9d640 1 --2- 172.21.15.114:0/3435061515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7aa40cda60 0x7f7aa40c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.149+0000 7f7aa2d9d640 1 -- 172.21.15.114:0/3435061515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9c00bd40 con 0x7f7aa40b0cd0 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.149+0000 7f7aa2d9d640 1 --2- 172.21.15.114:0/3435061515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aa40b0cd0 0x7f7aa4156c30 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800e870 tx=0x7f7a9800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.149+0000 7f7a8b7fe640 1 -- 172.21.15.114:0/3435061515 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a980094f0 con 0x7f7aa40b0cd0 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.149+0000 7f7a8b7fe640 1 -- 172.21.15.114:0/3435061515 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9800c940 con 0x7f7aa40b0cd0 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.149+0000 7f7aa924f640 1 -- 172.21.15.114:0/3435061515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa40b1e90 con 0x7f7aa40b0cd0 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.149+0000 7f7a8b7fe640 1 -- 172.21.15.114:0/3435061515 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9800ccf0 con 0x7f7aa40b0cd0 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.149+0000 7f7aa924f640 1 -- 172.21.15.114:0/3435061515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa40b2450 con 0x7f7aa40b0cd0 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.150+0000 7f7aa924f640 1 -- 172.21.15.114:0/3435061515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa4074290 con 0x7f7aa40b0cd0 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.151+0000 7f7a8b7fe640 1 -- 172.21.15.114:0/3435061515 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a98013470 con 0x7f7aa40b0cd0 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.151+0000 7f7a8b7fe640 1 --2- 172.21.15.114:0/3435061515 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9006ae70 0x7f7a9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.151+0000 7f7aa259c640 1 --2- 172.21.15.114:0/3435061515 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9006ae70 0x7f7a9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.151+0000 7f7a8b7fe640 1 -- 172.21.15.114:0/3435061515 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f7a98089b60 con 0x7f7aa40b0cd0 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.152+0000 7f7aa259c640 1 --2- 172.21.15.114:0/3435061515 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9006ae70 0x7f7a9006d330 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40c8bc0 tx=0x7f7a94009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.155+0000 7f7a8b7fe640 1 -- 172.21.15.114:0/3435061515 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a980547e0 con 0x7f7aa40b0cd0 2023-11-04T01:39:35.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.323+0000 7f7aa924f640 1 -- 172.21.15.114:0/3435061515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7aa406ddf0 con 0x7f7aa40b0cd0 2023-11-04T01:39:35.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.324+0000 7f7a8b7fe640 1 -- 172.21.15.114:0/3435061515 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22013 (secure 0 0 0) 0x7f7a98057e00 con 0x7f7aa40b0cd0 2023-11-04T01:39:35.327 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:35.327 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":83,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:23.665473+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:20.107188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:20.970024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:35.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.326+0000 7f7aa924f640 1 -- 172.21.15.114:0/3435061515 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9006ae70 msgr2=0x7f7a9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.326+0000 7f7aa924f640 1 --2- 172.21.15.114:0/3435061515 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9006ae70 0x7f7a9006d330 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40c8bc0 tx=0x7f7a94009190 comp rx=0 tx=0).stop 2023-11-04T01:39:35.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.326+0000 7f7aa924f640 1 -- 172.21.15.114:0/3435061515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aa40b0cd0 msgr2=0x7f7aa4156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.326+0000 7f7aa924f640 1 --2- 172.21.15.114:0/3435061515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aa40b0cd0 0x7f7aa4156c30 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800e870 tx=0x7f7a9800ed30 comp rx=0 tx=0).stop 2023-11-04T01:39:35.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.326+0000 7f7aa924f640 1 -- 172.21.15.114:0/3435061515 shutdown_connections 2023-11-04T01:39:35.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.326+0000 7f7aa924f640 1 --2- 172.21.15.114:0/3435061515 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9006ae70 0x7f7a9006d330 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.326+0000 7f7aa924f640 1 --2- 172.21.15.114:0/3435061515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7aa40cda60 0x7f7aa40c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.326+0000 7f7aa924f640 1 --2- 172.21.15.114:0/3435061515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aa40cace0 0x7f7aa40c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.326+0000 7f7aa924f640 1 --2- 172.21.15.114:0/3435061515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aa40b0cd0 0x7f7aa4156c30 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.326+0000 7f7aa924f640 1 -- 172.21.15.114:0/3435061515 >> 172.21.15.114:0/3435061515 conn(0x7f7aa40ce950 msgr2=0x7f7aa4158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.327+0000 7f7aa924f640 1 -- 172.21.15.114:0/3435061515 shutdown_connections 2023-11-04T01:39:35.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.327+0000 7f7aa924f640 1 -- 172.21.15.114:0/3435061515 wait complete. 2023-11-04T01:39:35.340 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:58.316710+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:59.185397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:20.107188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:20.970024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:35.340 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:35.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.440+0000 7f428f290640 1 Processor -- start 2023-11-04T01:39:35.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.441+0000 7f428f290640 1 -- start start 2023-11-04T01:39:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.441+0000 7f428f290640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f42880d0710 0x7f42880cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.441+0000 7f428f290640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42880d0280 con 0x7f42880cda50 2023-11-04T01:39:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.441+0000 7f428f290640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42880cf670 con 0x7f428815e430 2023-11-04T01:39:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.441+0000 7f428f290640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42880cf950 con 0x7f42880d0710 2023-11-04T01:39:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.441+0000 7f428c82b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f42880d0710 0x7f42880cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.441+0000 7f428d82d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f42880cda50 0x7f42880b3d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35182/0 (socket says 172.21.15.114:35182) 2023-11-04T01:39:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.441+0000 7f428d82d640 1 -- 172.21.15.114:0/805320047 learned_addr learned my addr 172.21.15.114:0/805320047 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.442+0000 7f428c82b640 1 -- 172.21.15.114:0/805320047 >> v1:172.21.15.141:6789/0 conn(0x7f428815e430 legacy=0x7f42880cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.442+0000 7f428c82b640 1 -- 172.21.15.114:0/805320047 >> v1:172.21.15.114:6789/0 conn(0x7f42880cda50 legacy=0x7f42880b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.442+0000 7f428c82b640 1 -- 172.21.15.114:0/805320047 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42880cfc30 con 0x7f42880d0710 2023-11-04T01:39:35.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.442+0000 7f428c82b640 1 --2- 172.21.15.114:0/805320047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42880d0710 0x7f42880cd510 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f42780097a0 tx=0x7f427802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89d113e1d3d76a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.443+0000 7f427ffff640 1 -- 172.21.15.114:0/805320047 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278031830 con 0x7f42880d0710 2023-11-04T01:39:35.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.443+0000 7f427ffff640 1 -- 172.21.15.114:0/805320047 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4278031990 con 0x7f42880d0710 2023-11-04T01:39:35.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.443+0000 7f427ffff640 1 -- 172.21.15.114:0/805320047 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278031d20 con 0x7f42880d0710 2023-11-04T01:39:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.443+0000 7f428f290640 1 -- 172.21.15.114:0/805320047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42880d0710 msgr2=0x7f42880cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.443+0000 7f428f290640 1 --2- 172.21.15.114:0/805320047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42880d0710 0x7f42880cd510 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f42780097a0 tx=0x7f427802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.443+0000 7f428f290640 1 -- 172.21.15.114:0/805320047 shutdown_connections 2023-11-04T01:39:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.443+0000 7f428f290640 1 --2- 172.21.15.114:0/805320047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42880d0710 0x7f42880cd510 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.443+0000 7f428f290640 1 -- 172.21.15.114:0/805320047 >> 172.21.15.114:0/805320047 conn(0x7f428806ea20 msgr2=0x7f428806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.443+0000 7f428f290640 1 -- 172.21.15.114:0/805320047 shutdown_connections 2023-11-04T01:39:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.443+0000 7f428f290640 1 -- 172.21.15.114:0/805320047 wait complete. 2023-11-04T01:39:35.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.444+0000 7f428f290640 1 Processor -- start 2023-11-04T01:39:35.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.444+0000 7f428f290640 1 -- start start 2023-11-04T01:39:35.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.445+0000 7f428f290640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42880cda50 0x7f42880af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.445+0000 7f428f290640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42880d0710 0x7f428806c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.445+0000 7f428f290640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f428815e430 0x7f428815a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.445+0000 7f428f290640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428806c830 con 0x7f42880d0710 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.445+0000 7f428f290640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42880b0810 con 0x7f42880cda50 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.445+0000 7f428f290640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428806d2c0 con 0x7f428815e430 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.445+0000 7f428c82b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42880d0710 0x7f428806c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.445+0000 7f428c82b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42880d0710 0x7f428806c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50544/0 (socket says 172.21.15.114:50544) 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.445+0000 7f428c82b640 1 -- 172.21.15.114:0/2302840479 learned_addr learned my addr 172.21.15.114:0/2302840479 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.445+0000 7f428d02c640 1 --2- 172.21.15.114:0/2302840479 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42880cda50 0x7f42880af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.446+0000 7f428c82b640 1 -- 172.21.15.114:0/2302840479 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f428815e430 msgr2=0x7f428815a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.446+0000 7f428c82b640 1 --2- 172.21.15.114:0/2302840479 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f428815e430 0x7f428815a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.446+0000 7f428c82b640 1 -- 172.21.15.114:0/2302840479 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42880cda50 msgr2=0x7f42880af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.446+0000 7f428c82b640 1 --2- 172.21.15.114:0/2302840479 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42880cda50 0x7f42880af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.446+0000 7f428c82b640 1 -- 172.21.15.114:0/2302840479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278009400 con 0x7f42880d0710 2023-11-04T01:39:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.446+0000 7f428d02c640 1 --2- 172.21.15.114:0/2302840479 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42880cda50 0x7f42880af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.446+0000 7f428c82b640 1 --2- 172.21.15.114:0/2302840479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42880d0710 0x7f428806c2f0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f42780098c0 tx=0x7f42780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.446+0000 7f427dffb640 1 -- 172.21.15.114:0/2302840479 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427803aa60 con 0x7f42880d0710 2023-11-04T01:39:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.446+0000 7f427dffb640 1 -- 172.21.15.114:0/2302840479 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427803abc0 con 0x7f42880d0710 2023-11-04T01:39:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.446+0000 7f428f290640 1 -- 172.21.15.114:0/2302840479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428815a680 con 0x7f42880d0710 2023-11-04T01:39:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.446+0000 7f427dffb640 1 -- 172.21.15.114:0/2302840479 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780423f0 con 0x7f42880d0710 2023-11-04T01:39:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.446+0000 7f428f290640 1 -- 172.21.15.114:0/2302840479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428806cd00 con 0x7f42880d0710 2023-11-04T01:39:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.447+0000 7f428f290640 1 -- 172.21.15.114:0/2302840479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4288074290 con 0x7f42880d0710 2023-11-04T01:39:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.447+0000 7f427dffb640 1 -- 172.21.15.114:0/2302840479 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f427804b3b0 con 0x7f42880d0710 2023-11-04T01:39:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.448+0000 7f427dffb640 1 --2- 172.21.15.114:0/2302840479 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f426c06ae70 0x7f426c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.448+0000 7f427dffb640 1 -- 172.21.15.114:0/2302840479 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f42780ab9f0 con 0x7f42880d0710 2023-11-04T01:39:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.448+0000 7f428d02c640 1 --2- 172.21.15.114:0/2302840479 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f426c06ae70 0x7f426c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.448+0000 7f428d02c640 1 --2- 172.21.15.114:0/2302840479 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f426c06ae70 0x7f426c06d330 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4284003eb0 tx=0x7f4284009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.452+0000 7f427dffb640 1 -- 172.21.15.114:0/2302840479 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4278076530 con 0x7f42880d0710 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.617+0000 7f428f290640 1 -- 172.21.15.114:0/2302840479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f428806d400 con 0x7f42880d0710 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.617+0000 7f427dffb640 1 -- 172.21.15.114:0/2302840479 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4278035020 con 0x7f42880d0710 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:39:35.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.619+0000 7f428f290640 1 -- 172.21.15.114:0/2302840479 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f426c06ae70 msgr2=0x7f426c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.619+0000 7f428f290640 1 --2- 172.21.15.114:0/2302840479 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f426c06ae70 0x7f426c06d330 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4284003eb0 tx=0x7f4284009040 comp rx=0 tx=0).stop 2023-11-04T01:39:35.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.619+0000 7f428f290640 1 -- 172.21.15.114:0/2302840479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42880d0710 msgr2=0x7f428806c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.619+0000 7f428f290640 1 --2- 172.21.15.114:0/2302840479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42880d0710 0x7f428806c2f0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f42780098c0 tx=0x7f42780046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.619+0000 7f428f290640 1 -- 172.21.15.114:0/2302840479 shutdown_connections 2023-11-04T01:39:35.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.619+0000 7f428f290640 1 --2- 172.21.15.114:0/2302840479 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f428815e430 0x7f428815a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.619+0000 7f428f290640 1 --2- 172.21.15.114:0/2302840479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42880d0710 0x7f428806c2f0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.619+0000 7f428f290640 1 --2- 172.21.15.114:0/2302840479 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f426c06ae70 0x7f426c06d330 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.619+0000 7f428f290640 1 --2- 172.21.15.114:0/2302840479 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f42880cda50 0x7f42880af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.619+0000 7f428f290640 1 -- 172.21.15.114:0/2302840479 >> 172.21.15.114:0/2302840479 conn(0x7f428806ea20 msgr2=0x7f428815b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.620+0000 7f428f290640 1 -- 172.21.15.114:0/2302840479 shutdown_connections 2023-11-04T01:39:35.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.620+0000 7f428f290640 1 -- 172.21.15.114:0/2302840479 wait complete. 2023-11-04T01:39:35.632 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:39:35.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.734+0000 7f118a8da640 1 Processor -- start 2023-11-04T01:39:35.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.734+0000 7f118a8da640 1 -- start start 2023-11-04T01:39:35.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.734+0000 7f118a8da640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f11840ae1d0 0x7f11840cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.734+0000 7f118a8da640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118415aff0 con 0x7f1184159c00 2023-11-04T01:39:35.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.734+0000 7f118a8da640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118415a3e0 con 0x7f11840c4ff0 2023-11-04T01:39:35.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.734+0000 7f118a8da640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118415a6c0 con 0x7f11840ae1d0 2023-11-04T01:39:35.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1183fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1184159c00 0x7f11840c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35196/0 (socket says 172.21.15.114:35196) 2023-11-04T01:39:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1183fff640 1 -- 172.21.15.114:0/1521089823 learned_addr learned my addr 172.21.15.114:0/1521089823 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1182ffd640 1 -- 172.21.15.114:0/1521089823 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856267027 0 0) 0x7f118415aff0 con 0x7f1184159c00 2023-11-04T01:39:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1182ffd640 1 -- 172.21.15.114:0/1521089823 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f116c003520 con 0x7f1184159c00 2023-11-04T01:39:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1188e77640 1 --2- 172.21.15.114:0/1521089823 >> v2:172.21.15.141:3300/0 conn(0x7f11840ae1d0 0x7f11840cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1182ffd640 1 -- 172.21.15.114:0/1521089823 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2880367062 0 0) 0x7f116c003520 con 0x7f1184159c00 2023-11-04T01:39:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1182ffd640 1 -- 172.21.15.114:0/1521089823 >> v2:172.21.15.141:3300/0 conn(0x7f11840ae1d0 msgr2=0x7f11840cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1182ffd640 1 --2- 172.21.15.114:0/1521089823 >> v2:172.21.15.141:3300/0 conn(0x7f11840ae1d0 0x7f11840cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1182ffd640 1 -- 172.21.15.114:0/1521089823 >> v1:172.21.15.141:6789/0 conn(0x7f11840c4ff0 legacy=0x7f11840adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1182ffd640 1 -- 172.21.15.114:0/1521089823 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118415a9a0 con 0x7f1184159c00 2023-11-04T01:39:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1182ffd640 1 -- 172.21.15.114:0/1521089823 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f1174001670 con 0x7f1184159c00 2023-11-04T01:39:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1182ffd640 1 -- 172.21.15.114:0/1521089823 >> v1:172.21.15.114:6789/0 conn(0x7f1184159c00 legacy=0x7f11840c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1182ffd640 1 --2- 172.21.15.114:0/1521089823 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f116c003970 0x7f116c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1182ffd640 1 --2- 172.21.15.114:0/1521089823 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f116c0047c0 0x7f116c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1182ffd640 1 --2- 172.21.15.114:0/1521089823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f116c005180 0x7f116c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1182ffd640 1 -- 172.21.15.114:0/1521089823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118415a6c0 con 0x7f116c005180 2023-11-04T01:39:35.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1182ffd640 1 -- 172.21.15.114:0/1521089823 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116c00c0d0 con 0x7f116c003970 2023-11-04T01:39:35.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1182ffd640 1 -- 172.21.15.114:0/1521089823 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116c00c290 con 0x7f116c0047c0 2023-11-04T01:39:35.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1188e77640 1 --2- 172.21.15.114:0/1521089823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f116c005180 0x7f116c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1183fff640 1 --2- 172.21.15.114:0/1521089823 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f116c003970 0x7f116c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f11837fe640 1 --2- 172.21.15.114:0/1521089823 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f116c0047c0 0x7f116c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1188e77640 1 -- 172.21.15.114:0/1521089823 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f116c0047c0 msgr2=0x7f116c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1188e77640 1 --2- 172.21.15.114:0/1521089823 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f116c0047c0 0x7f116c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1188e77640 1 -- 172.21.15.114:0/1521089823 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f116c003970 msgr2=0x7f116c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.735+0000 7f1188e77640 1 --2- 172.21.15.114:0/1521089823 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f116c003970 0x7f116c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.736+0000 7f1188e77640 1 -- 172.21.15.114:0/1521089823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c003520 con 0x7f116c005180 2023-11-04T01:39:35.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.736+0000 7f11837fe640 1 --2- 172.21.15.114:0/1521089823 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f116c0047c0 0x7f116c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:35.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.736+0000 7f1188e77640 1 -- 172.21.15.114:0/1521089823 reap_dead start 2023-11-04T01:39:35.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.736+0000 7f1188e77640 1 --2- 172.21.15.114:0/1521089823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f116c005180 0x7f116c00b980 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f117c007360 tx=0x7f116c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43db245ec12c46e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.736+0000 7f1182ffd640 1 -- 172.21.15.114:0/1521089823 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c02ccf0 con 0x7f116c005180 2023-11-04T01:39:35.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.736+0000 7f1182ffd640 1 -- 172.21.15.114:0/1521089823 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c02ce90 con 0x7f116c005180 2023-11-04T01:39:35.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.736+0000 7f1182ffd640 1 -- 172.21.15.114:0/1521089823 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c003bd0 con 0x7f116c005180 2023-11-04T01:39:35.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.737+0000 7f118a8da640 1 -- 172.21.15.114:0/1521089823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f116c005180 msgr2=0x7f116c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.737+0000 7f118a8da640 1 --2- 172.21.15.114:0/1521089823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f116c005180 0x7f116c00b980 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f117c007360 tx=0x7f116c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.737+0000 7f118a8da640 1 -- 172.21.15.114:0/1521089823 shutdown_connections 2023-11-04T01:39:35.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.737+0000 7f118a8da640 1 --2- 172.21.15.114:0/1521089823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f116c005180 0x7f116c00b980 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.737+0000 7f118a8da640 1 -- 172.21.15.114:0/1521089823 >> 172.21.15.114:0/1521089823 conn(0x7f11840ce950 msgr2=0x7f11840ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.737+0000 7f118a8da640 1 -- 172.21.15.114:0/1521089823 shutdown_connections 2023-11-04T01:39:35.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.737+0000 7f118a8da640 1 -- 172.21.15.114:0/1521089823 wait complete. 2023-11-04T01:39:35.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.738+0000 7f118a8da640 1 Processor -- start 2023-11-04T01:39:35.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.738+0000 7f118a8da640 1 -- start start 2023-11-04T01:39:35.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f118a8da640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f116c005180 0x7f11840c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f118a8da640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f118414f710 0x7f11840c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f118a8da640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11841f2510 0x7f118415bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f118a8da640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11840c44c0 con 0x7f118414f710 2023-11-04T01:39:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f118a8da640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11840c5a20 con 0x7f116c005180 2023-11-04T01:39:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f118a8da640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11840c6230 con 0x7f11841f2510 2023-11-04T01:39:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f11837fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f118414f710 0x7f11840c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f11837fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f118414f710 0x7f11840c3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50574/0 (socket says 172.21.15.114:50574) 2023-11-04T01:39:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f11837fe640 1 -- 172.21.15.114:0/552276418 learned_addr learned my addr 172.21.15.114:0/552276418 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f1183fff640 1 --2- 172.21.15.114:0/552276418 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f116c005180 0x7f11840c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f1188e77640 1 --2- 172.21.15.114:0/552276418 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11841f2510 0x7f118415bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f11837fe640 1 -- 172.21.15.114:0/552276418 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11841f2510 msgr2=0x7f118415bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f11837fe640 1 --2- 172.21.15.114:0/552276418 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11841f2510 0x7f118415bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f11837fe640 1 -- 172.21.15.114:0/552276418 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f116c005180 msgr2=0x7f11840c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f11837fe640 1 --2- 172.21.15.114:0/552276418 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f116c005180 0x7f11840c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f11837fe640 1 -- 172.21.15.114:0/552276418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118414fb90 con 0x7f118414f710 2023-11-04T01:39:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.739+0000 7f11837fe640 1 --2- 172.21.15.114:0/552276418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f118414f710 0x7f11840c3f80 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f117800e410 tx=0x7f117800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.740+0000 7f1180ff9640 1 -- 172.21.15.114:0/552276418 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11780052e0 con 0x7f118414f710 2023-11-04T01:39:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.740+0000 7f1180ff9640 1 -- 172.21.15.114:0/552276418 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1178005440 con 0x7f118414f710 2023-11-04T01:39:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.740+0000 7f118a8da640 1 -- 172.21.15.114:0/552276418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11840c5c70 con 0x7f118414f710 2023-11-04T01:39:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.740+0000 7f1180ff9640 1 -- 172.21.15.114:0/552276418 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11780037f0 con 0x7f118414f710 2023-11-04T01:39:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.740+0000 7f118a8da640 1 -- 172.21.15.114:0/552276418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11841500b0 con 0x7f118414f710 2023-11-04T01:39:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.741+0000 7f118a8da640 1 -- 172.21.15.114:0/552276418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118414ff10 con 0x7f118414f710 2023-11-04T01:39:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.741+0000 7f1180ff9640 1 -- 172.21.15.114:0/552276418 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1178003950 con 0x7f118414f710 2023-11-04T01:39:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.742+0000 7f1180ff9640 1 --2- 172.21.15.114:0/552276418 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f117006ae70 0x7f117006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.742+0000 7f1180ff9640 1 -- 172.21.15.114:0/552276418 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f1178089210 con 0x7f118414f710 2023-11-04T01:39:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.742+0000 7f1183fff640 1 --2- 172.21.15.114:0/552276418 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f117006ae70 0x7f117006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.742+0000 7f1183fff640 1 --2- 172.21.15.114:0/552276418 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f117006ae70 0x7f117006d330 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1174007d20 tx=0x7f1174009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.746+0000 7f1180ff9640 1 -- 172.21.15.114:0/552276418 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f118414ff10 con 0x7f118414f710 2023-11-04T01:39:35.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.912+0000 7f118a8da640 1 -- 172.21.15.114:0/552276418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f118414ff10 con 0x7f118414f710 2023-11-04T01:39:35.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.912+0000 7f1180ff9640 1 -- 172.21.15.114:0/552276418 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v83) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1178019020 con 0x7f118414f710 2023-11-04T01:39:35.914 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:35.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.914+0000 7f118a8da640 1 -- 172.21.15.114:0/552276418 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f117006ae70 msgr2=0x7f117006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.914+0000 7f118a8da640 1 --2- 172.21.15.114:0/552276418 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f117006ae70 0x7f117006d330 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1174007d20 tx=0x7f1174009040 comp rx=0 tx=0).stop 2023-11-04T01:39:35.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.914+0000 7f118a8da640 1 -- 172.21.15.114:0/552276418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f118414f710 msgr2=0x7f11840c3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.914+0000 7f118a8da640 1 --2- 172.21.15.114:0/552276418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f118414f710 0x7f11840c3f80 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f117800e410 tx=0x7f117800e8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.914+0000 7f118a8da640 1 -- 172.21.15.114:0/552276418 shutdown_connections 2023-11-04T01:39:35.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.914+0000 7f118a8da640 1 --2- 172.21.15.114:0/552276418 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f11841f2510 0x7f118415bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.914+0000 7f118a8da640 1 --2- 172.21.15.114:0/552276418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f118414f710 0x7f11840c3f80 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.914+0000 7f118a8da640 1 --2- 172.21.15.114:0/552276418 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f117006ae70 0x7f117006d330 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.914+0000 7f118a8da640 1 --2- 172.21.15.114:0/552276418 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f116c005180 0x7f11840c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.914+0000 7f118a8da640 1 -- 172.21.15.114:0/552276418 >> 172.21.15.114:0/552276418 conn(0x7f11840ce950 msgr2=0x7f118406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.914+0000 7f118a8da640 1 -- 172.21.15.114:0/552276418 shutdown_connections 2023-11-04T01:39:35.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:35.914+0000 7f118a8da640 1 -- 172.21.15.114:0/552276418 wait complete. 2023-11-04T01:39:35.927 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:39:36.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.026+0000 7f43e3be2640 1 Processor -- start 2023-11-04T01:39:36.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.027+0000 7f43e3be2640 1 -- start start 2023-11-04T01:39:36.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.027+0000 7f43e3be2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f43dc1605b0 0x7f43dc0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.027+0000 7f43e3be2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f43dc06a830 0x7f43dc0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.027+0000 7f43e3be2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43dc160990 con 0x7f43dc0b1a40 2023-11-04T01:39:36.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.027+0000 7f43e3be2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc0cc7c0 con 0x7f43dc1605b0 2023-11-04T01:39:36.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.027+0000 7f43e3be2640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc0cd750 con 0x7f43dc06a830 2023-11-04T01:39:36.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.028+0000 7f43e197e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f43dc1605b0 0x7f43dc0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.028+0000 7f43e117d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f43dc0b1a40 0x7f43dc06a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35198/0 (socket says 172.21.15.114:35198) 2023-11-04T01:39:36.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.028+0000 7f43e117d640 1 -- 172.21.15.114:0/2407730279 learned_addr learned my addr 172.21.15.114:0/2407730279 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:36.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.028+0000 7f43e217f640 1 --2- 172.21.15.114:0/2407730279 >> v2:172.21.15.141:3300/0 conn(0x7f43dc06a830 0x7f43dc0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.028+0000 7f43e197e640 1 -- 172.21.15.114:0/2407730279 >> v2:172.21.15.141:3300/0 conn(0x7f43dc06a830 msgr2=0x7f43dc0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:36.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.028+0000 7f43e197e640 1 --2- 172.21.15.114:0/2407730279 >> v2:172.21.15.141:3300/0 conn(0x7f43dc06a830 0x7f43dc0cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.028+0000 7f43e197e640 1 -- 172.21.15.114:0/2407730279 >> v1:172.21.15.114:6789/0 conn(0x7f43dc0b1a40 legacy=0x7f43dc06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.028+0000 7f43e097c640 1 -- 172.21.15.114:0/2407730279 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161957006 0 0) 0x7f43dc160990 con 0x7f43dc0b1a40 2023-11-04T01:39:36.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.028+0000 7f43e197e640 1 -- 172.21.15.114:0/2407730279 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc0cc4e0 con 0x7f43dc1605b0 2023-11-04T01:39:36.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.029+0000 7f43e197e640 1 --2- 172.21.15.114:0/2407730279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43dc1605b0 0x7f43dc0ccbc0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0c6aa0 tx=0x7f43cc02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87fd604a77864c12 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.029+0000 7f43e097c640 1 -- 172.21.15.114:0/2407730279 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc031710 con 0x7f43dc1605b0 2023-11-04T01:39:36.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.029+0000 7f43e097c640 1 -- 172.21.15.114:0/2407730279 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc02f050 con 0x7f43dc1605b0 2023-11-04T01:39:36.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.029+0000 7f43e097c640 1 -- 172.21.15.114:0/2407730279 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc031a90 con 0x7f43dc1605b0 2023-11-04T01:39:36.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.029+0000 7f43e3be2640 1 -- 172.21.15.114:0/2407730279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43dc1605b0 msgr2=0x7f43dc0ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.029+0000 7f43e3be2640 1 --2- 172.21.15.114:0/2407730279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43dc1605b0 0x7f43dc0ccbc0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0c6aa0 tx=0x7f43cc02b7b0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.029+0000 7f43e3be2640 1 -- 172.21.15.114:0/2407730279 shutdown_connections 2023-11-04T01:39:36.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.029+0000 7f43e3be2640 1 --2- 172.21.15.114:0/2407730279 >> v2:172.21.15.141:3300/0 conn(0x7f43dc06a830 0x7f43dc0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.029+0000 7f43e3be2640 1 --2- 172.21.15.114:0/2407730279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43dc1605b0 0x7f43dc0ccbc0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.029+0000 7f43e3be2640 1 -- 172.21.15.114:0/2407730279 >> 172.21.15.114:0/2407730279 conn(0x7f43dc071820 msgr2=0x7f43dc071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:36.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.029+0000 7f43e3be2640 1 -- 172.21.15.114:0/2407730279 shutdown_connections 2023-11-04T01:39:36.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.029+0000 7f43e3be2640 1 -- 172.21.15.114:0/2407730279 wait complete. 2023-11-04T01:39:36.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.031+0000 7f43e3be2640 1 Processor -- start 2023-11-04T01:39:36.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.031+0000 7f43e3be2640 1 -- start start 2023-11-04T01:39:36.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.031+0000 7f43e3be2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43dc06a830 0x7f43dc15eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.031+0000 7f43e3be2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43dc1605b0 0x7f43dc0c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.031+0000 7f43e3be2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43dc0b2670 0x7f43dc14ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.031+0000 7f43e3be2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0b3680 con 0x7f43dc1605b0 2023-11-04T01:39:36.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.031+0000 7f43e3be2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0b2b00 con 0x7f43dc06a830 2023-11-04T01:39:36.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.031+0000 7f43e3be2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0b2de0 con 0x7f43dc0b2670 2023-11-04T01:39:36.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.031+0000 7f43e117d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43dc1605b0 0x7f43dc0c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.031+0000 7f43e117d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43dc1605b0 0x7f43dc0c6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50594/0 (socket says 172.21.15.114:50594) 2023-11-04T01:39:36.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.031+0000 7f43e117d640 1 -- 172.21.15.114:0/837713291 learned_addr learned my addr 172.21.15.114:0/837713291 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:36.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.032+0000 7f43e217f640 1 --2- 172.21.15.114:0/837713291 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43dc0b2670 0x7f43dc14ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.032+0000 7f43e197e640 1 --2- 172.21.15.114:0/837713291 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43dc06a830 0x7f43dc15eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.032+0000 7f43e117d640 1 -- 172.21.15.114:0/837713291 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43dc0b2670 msgr2=0x7f43dc14ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.032+0000 7f43e117d640 1 --2- 172.21.15.114:0/837713291 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43dc0b2670 0x7f43dc14ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.032+0000 7f43e117d640 1 -- 172.21.15.114:0/837713291 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43dc06a830 msgr2=0x7f43dc15eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.032+0000 7f43e117d640 1 --2- 172.21.15.114:0/837713291 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43dc06a830 0x7f43dc15eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.032+0000 7f43e117d640 1 -- 172.21.15.114:0/837713291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc009400 con 0x7f43dc1605b0 2023-11-04T01:39:36.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.032+0000 7f43e117d640 1 --2- 172.21.15.114:0/837713291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43dc1605b0 0x7f43dc0c6c00 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f43d800c430 tx=0x7f43d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.032+0000 7f43d27fc640 1 -- 172.21.15.114:0/837713291 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d80074e0 con 0x7f43dc1605b0 2023-11-04T01:39:36.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.032+0000 7f43d27fc640 1 -- 172.21.15.114:0/837713291 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d8007660 con 0x7f43dc1605b0 2023-11-04T01:39:36.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.032+0000 7f43e3be2640 1 -- 172.21.15.114:0/837713291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc0b30c0 con 0x7f43dc1605b0 2023-11-04T01:39:36.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.032+0000 7f43d27fc640 1 -- 172.21.15.114:0/837713291 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d8004a20 con 0x7f43dc1605b0 2023-11-04T01:39:36.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.032+0000 7f43e3be2640 1 -- 172.21.15.114:0/837713291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc15f1e0 con 0x7f43dc1605b0 2023-11-04T01:39:36.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.033+0000 7f43e3be2640 1 -- 172.21.15.114:0/837713291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43dc0672a0 con 0x7f43dc1605b0 2023-11-04T01:39:36.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.033+0000 7f43d27fc640 1 -- 172.21.15.114:0/837713291 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f43d8004b80 con 0x7f43dc1605b0 2023-11-04T01:39:36.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.034+0000 7f43d27fc640 1 --2- 172.21.15.114:0/837713291 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f43c006aea0 0x7f43c006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.034+0000 7f43d27fc640 1 -- 172.21.15.114:0/837713291 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f43d8089900 con 0x7f43dc1605b0 2023-11-04T01:39:36.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.034+0000 7f43e197e640 1 --2- 172.21.15.114:0/837713291 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f43c006aea0 0x7f43c006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.034+0000 7f43e197e640 1 --2- 172.21.15.114:0/837713291 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f43c006aea0 0x7f43c006d360 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f43cc035000 tx=0x7f43cc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.038+0000 7f43d27fc640 1 -- 172.21.15.114:0/837713291 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f43d80544d0 con 0x7f43dc1605b0 2023-11-04T01:39:36.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.203+0000 7f43e3be2640 1 -- 172.21.15.114:0/837713291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f43dc0b3b00 con 0x7f43dc1605b0 2023-11-04T01:39:36.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.204+0000 7f43d27fc640 1 -- 172.21.15.114:0/837713291 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v83) v1 ==== 103+0+11 (secure 0 0 0) 0x7f43dc0b3b00 con 0x7f43dc1605b0 2023-11-04T01:39:36.206 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.206+0000 7f43e3be2640 1 -- 172.21.15.114:0/837713291 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f43c006aea0 msgr2=0x7f43c006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.206+0000 7f43e3be2640 1 --2- 172.21.15.114:0/837713291 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f43c006aea0 0x7f43c006d360 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f43cc035000 tx=0x7f43cc008030 comp rx=0 tx=0).stop 2023-11-04T01:39:36.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.206+0000 7f43e3be2640 1 -- 172.21.15.114:0/837713291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43dc1605b0 msgr2=0x7f43dc0c6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.206+0000 7f43e3be2640 1 --2- 172.21.15.114:0/837713291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43dc1605b0 0x7f43dc0c6c00 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f43d800c430 tx=0x7f43d800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.206+0000 7f43e3be2640 1 -- 172.21.15.114:0/837713291 shutdown_connections 2023-11-04T01:39:36.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.206+0000 7f43e3be2640 1 --2- 172.21.15.114:0/837713291 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f43dc0b2670 0x7f43dc14ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.206+0000 7f43e3be2640 1 --2- 172.21.15.114:0/837713291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43dc1605b0 0x7f43dc0c6c00 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.206+0000 7f43e3be2640 1 --2- 172.21.15.114:0/837713291 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f43c006aea0 0x7f43c006d360 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.206+0000 7f43e3be2640 1 --2- 172.21.15.114:0/837713291 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f43dc06a830 0x7f43dc15eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.206+0000 7f43e3be2640 1 -- 172.21.15.114:0/837713291 >> 172.21.15.114:0/837713291 conn(0x7f43dc071820 msgr2=0x7f43dc06a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:36.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.206+0000 7f43e3be2640 1 -- 172.21.15.114:0/837713291 shutdown_connections 2023-11-04T01:39:36.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.206+0000 7f43e3be2640 1 -- 172.21.15.114:0/837713291 wait complete. 2023-11-04T01:39:36.218 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:39:36.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.318+0000 7fc6ac407640 1 Processor -- start 2023-11-04T01:39:36.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.319+0000 7fc6ac407640 1 -- start start 2023-11-04T01:39:36.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.319+0000 7fc6ac407640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a4070e20 0x7fc6a40adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.319+0000 7fc6ac407640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc6a40ad730 0x7fc6a415e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.319+0000 7fc6ac407640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a40c3900 con 0x7fc6a415ad30 2023-11-04T01:39:36.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.319+0000 7fc6ac407640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a40ae260 con 0x7fc6a40ad730 2023-11-04T01:39:36.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.319+0000 7fc6ac407640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40c3be0 con 0x7fc6a4070e20 2023-11-04T01:39:36.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.320+0000 7fc6aa9a4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc6a40ad730 0x7fc6a415e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.320+0000 7fc6aa1a3640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc6a415ad30 0x7fc6a4070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35208/0 (socket says 172.21.15.114:35208) 2023-11-04T01:39:36.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.320+0000 7fc6aa1a3640 1 -- 172.21.15.114:0/3923717511 learned_addr learned my addr 172.21.15.114:0/3923717511 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:36.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.320+0000 7fc6a99a2640 1 --2- 172.21.15.114:0/3923717511 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a4070e20 0x7fc6a40adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.320+0000 7fc6aa9a4640 1 -- 172.21.15.114:0/3923717511 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a4070e20 msgr2=0x7fc6a40adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:36.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.320+0000 7fc6aa9a4640 1 --2- 172.21.15.114:0/3923717511 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a4070e20 0x7fc6a40adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.320+0000 7fc6aa9a4640 1 -- 172.21.15.114:0/3923717511 >> v1:172.21.15.114:6789/0 conn(0x7fc6a415ad30 legacy=0x7fc6a4070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.320+0000 7fc6a91a1640 1 -- 172.21.15.114:0/3923717511 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89245549 0 0) 0x7fc6a40c3900 con 0x7fc6a415ad30 2023-11-04T01:39:36.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.320+0000 7fc6aa9a4640 1 -- 172.21.15.114:0/3923717511 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40c3ec0 con 0x7fc6a40ad730 2023-11-04T01:39:36.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.321+0000 7fc6aa9a4640 1 --2- 172.21.15.114:0/3923717511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a40ad730 0x7fc6a415e740 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009d90 tx=0x7fc69c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1a4edee1fa4942 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.321+0000 7fc6a91a1640 1 -- 172.21.15.114:0/3923717511 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c02cbc0 con 0x7fc6a40ad730 2023-11-04T01:39:36.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.321+0000 7fc6a91a1640 1 -- 172.21.15.114:0/3923717511 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c02cd20 con 0x7fc6a40ad730 2023-11-04T01:39:36.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.321+0000 7fc6a91a1640 1 -- 172.21.15.114:0/3923717511 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c034660 con 0x7fc6a40ad730 2023-11-04T01:39:36.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.321+0000 7fc6ac407640 1 -- 172.21.15.114:0/3923717511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a40ad730 msgr2=0x7fc6a415e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.321+0000 7fc6ac407640 1 --2- 172.21.15.114:0/3923717511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a40ad730 0x7fc6a415e740 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009d90 tx=0x7fc69c02be10 comp rx=0 tx=0).stop 2023-11-04T01:39:36.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.321+0000 7fc6ac407640 1 -- 172.21.15.114:0/3923717511 shutdown_connections 2023-11-04T01:39:36.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.321+0000 7fc6ac407640 1 --2- 172.21.15.114:0/3923717511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a40ad730 0x7fc6a415e740 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.321+0000 7fc6ac407640 1 --2- 172.21.15.114:0/3923717511 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a4070e20 0x7fc6a40adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.321+0000 7fc6ac407640 1 -- 172.21.15.114:0/3923717511 >> 172.21.15.114:0/3923717511 conn(0x7fc6a40ce950 msgr2=0x7fc6a40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:36.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.321+0000 7fc6ac407640 1 -- 172.21.15.114:0/3923717511 shutdown_connections 2023-11-04T01:39:36.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.321+0000 7fc6ac407640 1 -- 172.21.15.114:0/3923717511 wait complete. 2023-11-04T01:39:36.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.323+0000 7fc6ac407640 1 Processor -- start 2023-11-04T01:39:36.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.323+0000 7fc6ac407640 1 -- start start 2023-11-04T01:39:36.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.323+0000 7fc6ac407640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a4070e20 0x7fc6a413da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.323+0000 7fc6ac407640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40ad730 0x7fc6a4140c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.323+0000 7fc6ac407640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a415ad30 0x7fc6a40cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.323+0000 7fc6ac407640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a413dfc0 con 0x7fc6a415ad30 2023-11-04T01:39:36.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.323+0000 7fc6ac407640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40c84e0 con 0x7fc6a40ad730 2023-11-04T01:39:36.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.323+0000 7fc6ac407640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40c8970 con 0x7fc6a4070e20 2023-11-04T01:39:36.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.323+0000 7fc6aa9a4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a415ad30 0x7fc6a40cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.323+0000 7fc6aa9a4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a415ad30 0x7fc6a40cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50608/0 (socket says 172.21.15.114:50608) 2023-11-04T01:39:36.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.323+0000 7fc6aa9a4640 1 -- 172.21.15.114:0/3414829180 learned_addr learned my addr 172.21.15.114:0/3414829180 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:36.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.324+0000 7fc6aa1a3640 1 --2- 172.21.15.114:0/3414829180 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a4070e20 0x7fc6a413da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.324+0000 7fc6a99a2640 1 --2- 172.21.15.114:0/3414829180 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40ad730 0x7fc6a4140c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.324+0000 7fc6aa9a4640 1 -- 172.21.15.114:0/3414829180 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a4070e20 msgr2=0x7fc6a413da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.324+0000 7fc6aa9a4640 1 --2- 172.21.15.114:0/3414829180 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a4070e20 0x7fc6a413da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.324+0000 7fc6aa9a4640 1 -- 172.21.15.114:0/3414829180 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40ad730 msgr2=0x7fc6a4140c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.324+0000 7fc6aa9a4640 1 --2- 172.21.15.114:0/3414829180 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40ad730 0x7fc6a4140c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.324+0000 7fc6aa9a4640 1 -- 172.21.15.114:0/3414829180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c009a70 con 0x7fc6a415ad30 2023-11-04T01:39:36.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.324+0000 7fc6a99a2640 1 --2- 172.21.15.114:0/3414829180 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40ad730 0x7fc6a4140c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:36.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.324+0000 7fc6aa9a4640 1 --2- 172.21.15.114:0/3414829180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a415ad30 0x7fc6a40cb3d0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009eb0 tx=0x7fc69c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.324+0000 7fc69affd640 1 -- 172.21.15.114:0/3414829180 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c040650 con 0x7fc6a415ad30 2023-11-04T01:39:36.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.324+0000 7fc69affd640 1 -- 172.21.15.114:0/3414829180 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c02ce90 con 0x7fc6a415ad30 2023-11-04T01:39:36.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.324+0000 7fc69affd640 1 -- 172.21.15.114:0/3414829180 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c040a10 con 0x7fc6a415ad30 2023-11-04T01:39:36.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.324+0000 7fc6ac407640 1 -- 172.21.15.114:0/3414829180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a41515f0 con 0x7fc6a415ad30 2023-11-04T01:39:36.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.324+0000 7fc6ac407640 1 -- 172.21.15.114:0/3414829180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a40c7bb0 con 0x7fc6a415ad30 2023-11-04T01:39:36.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.325+0000 7fc6ac407640 1 -- 172.21.15.114:0/3414829180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a4074290 con 0x7fc6a415ad30 2023-11-04T01:39:36.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.325+0000 7fc69affd640 1 -- 172.21.15.114:0/3414829180 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc69c040b70 con 0x7fc6a415ad30 2023-11-04T01:39:36.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.326+0000 7fc69affd640 1 --2- 172.21.15.114:0/3414829180 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc68806aea0 0x7fc68806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.326+0000 7fc69affd640 1 -- 172.21.15.114:0/3414829180 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fc69c0ac8a0 con 0x7fc6a415ad30 2023-11-04T01:39:36.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.326+0000 7fc6aa1a3640 1 --2- 172.21.15.114:0/3414829180 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc68806aea0 0x7fc68806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.326+0000 7fc6aa1a3640 1 --2- 172.21.15.114:0/3414829180 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc68806aea0 0x7fc68806d360 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0000f60 tx=0x7fc6a0007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.330+0000 7fc69affd640 1 -- 172.21.15.114:0/3414829180 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc69c077590 con 0x7fc6a415ad30 2023-11-04T01:39:36.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.494+0000 7fc6ac407640 1 -- 172.21.15.114:0/3414829180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fc6a4071970 con 0x7fc6a415ad30 2023-11-04T01:39:36.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.495+0000 7fc69affd640 1 -- 172.21.15.114:0/3414829180 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc69c07abb0 con 0x7fc6a415ad30 2023-11-04T01:39:36.497 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:36.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.496+0000 7fc6ac407640 1 -- 172.21.15.114:0/3414829180 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc68806aea0 msgr2=0x7fc68806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.496+0000 7fc6ac407640 1 --2- 172.21.15.114:0/3414829180 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc68806aea0 0x7fc68806d360 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0000f60 tx=0x7fc6a0007c00 comp rx=0 tx=0).stop 2023-11-04T01:39:36.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.496+0000 7fc6ac407640 1 -- 172.21.15.114:0/3414829180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a415ad30 msgr2=0x7fc6a40cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.496+0000 7fc6ac407640 1 --2- 172.21.15.114:0/3414829180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a415ad30 0x7fc6a40cb3d0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009eb0 tx=0x7fc69c004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:36.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.496+0000 7fc6ac407640 1 -- 172.21.15.114:0/3414829180 shutdown_connections 2023-11-04T01:39:36.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.496+0000 7fc6ac407640 1 --2- 172.21.15.114:0/3414829180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a415ad30 0x7fc6a40cb3d0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.496+0000 7fc6ac407640 1 --2- 172.21.15.114:0/3414829180 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc68806aea0 0x7fc68806d360 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.496+0000 7fc6ac407640 1 --2- 172.21.15.114:0/3414829180 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6a40ad730 0x7fc6a4140c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.496+0000 7fc6ac407640 1 --2- 172.21.15.114:0/3414829180 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6a4070e20 0x7fc6a413da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.496+0000 7fc6ac407640 1 -- 172.21.15.114:0/3414829180 >> 172.21.15.114:0/3414829180 conn(0x7fc6a40ce950 msgr2=0x7fc6a40c95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:36.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.497+0000 7fc6ac407640 1 -- 172.21.15.114:0/3414829180 shutdown_connections 2023-11-04T01:39:36.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.497+0000 7fc6ac407640 1 -- 172.21.15.114:0/3414829180 wait complete. 2023-11-04T01:39:36.509 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:39:36.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.609+0000 7fdeac973640 1 Processor -- start 2023-11-04T01:39:36.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.609+0000 7fdeac973640 1 -- start start 2023-11-04T01:39:36.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.610+0000 7fdeac973640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdea8153e60 0x7fdea815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.610+0000 7fdeac973640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea80cde60 con 0x7fdea80b4880 2023-11-04T01:39:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.610+0000 7fdeac973640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea8160f90 con 0x7fdea80cd6d0 2023-11-04T01:39:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.610+0000 7fdeac973640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea815e400 con 0x7fdea8153e60 2023-11-04T01:39:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.610+0000 7fdea659c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdea8153e60 0x7fdea815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.610+0000 7fdea6d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdea80b4880 0x7fdea80d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41458/0 (socket says 172.21.15.114:41458) 2023-11-04T01:39:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.610+0000 7fdea6d9d640 1 -- 172.21.15.114:0/3645767294 learned_addr learned my addr 172.21.15.114:0/3645767294 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.611+0000 7fdea659c640 1 -- 172.21.15.114:0/3645767294 >> v1:172.21.15.141:6789/0 conn(0x7fdea80cd6d0 legacy=0x7fdea8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.611+0000 7fdea659c640 1 -- 172.21.15.114:0/3645767294 >> v1:172.21.15.114:6789/0 conn(0x7fdea80b4880 legacy=0x7fdea80d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.611+0000 7fdea659c640 1 -- 172.21.15.114:0/3645767294 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea80ce090 con 0x7fdea8153e60 2023-11-04T01:39:36.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.611+0000 7fdea659c640 1 --2- 172.21.15.114:0/3645767294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea8153e60 0x7fdea815dec0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fde98009d90 tx=0x7fde9802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d290d922fe8c0e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.612+0000 7fdea559a640 1 -- 172.21.15.114:0/3645767294 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9802cc60 con 0x7fdea8153e60 2023-11-04T01:39:36.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.612+0000 7fdea559a640 1 -- 172.21.15.114:0/3645767294 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9802cdc0 con 0x7fdea8153e60 2023-11-04T01:39:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.612+0000 7fdea559a640 1 -- 172.21.15.114:0/3645767294 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98034660 con 0x7fdea8153e60 2023-11-04T01:39:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.612+0000 7fdeac973640 1 -- 172.21.15.114:0/3645767294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea8153e60 msgr2=0x7fdea815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.612+0000 7fdeac973640 1 --2- 172.21.15.114:0/3645767294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea8153e60 0x7fdea815dec0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fde98009d90 tx=0x7fde9802beb0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.612+0000 7fdeac973640 1 -- 172.21.15.114:0/3645767294 shutdown_connections 2023-11-04T01:39:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.612+0000 7fdeac973640 1 --2- 172.21.15.114:0/3645767294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea8153e60 0x7fdea815dec0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.612+0000 7fdeac973640 1 -- 172.21.15.114:0/3645767294 >> 172.21.15.114:0/3645767294 conn(0x7fdea80cf880 msgr2=0x7fdea80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.612+0000 7fdeac973640 1 -- 172.21.15.114:0/3645767294 shutdown_connections 2023-11-04T01:39:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.612+0000 7fdeac973640 1 -- 172.21.15.114:0/3645767294 wait complete. 2023-11-04T01:39:36.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.613+0000 7fdeac973640 1 Processor -- start 2023-11-04T01:39:36.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.613+0000 7fdeac973640 1 -- start start 2023-11-04T01:39:36.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.614+0000 7fdeac973640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea80b4880 0x7fdea81555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.614+0000 7fdeac973640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdea80cd6d0 0x7fdea815eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.614+0000 7fdeac973640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdea8153e60 0x7fdea815f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.614+0000 7fdeac973640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea8150b20 con 0x7fdea80b4880 2023-11-04T01:39:36.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.614+0000 7fdeac973640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea81560b0 con 0x7fdea80cd6d0 2023-11-04T01:39:36.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.614+0000 7fdeac973640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea8156390 con 0x7fdea8153e60 2023-11-04T01:39:36.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.614+0000 7fdea659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea80b4880 0x7fdea81555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.614+0000 7fdea659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea80b4880 0x7fdea81555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54926/0 (socket says 172.21.15.114:54926) 2023-11-04T01:39:36.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.614+0000 7fdea659c640 1 -- 172.21.15.114:0/1067094508 learned_addr learned my addr 172.21.15.114:0/1067094508 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:36.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.615+0000 7fdea6d9d640 1 --2- 172.21.15.114:0/1067094508 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdea8153e60 0x7fdea815f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.615+0000 7fdea5d9b640 1 --2- 172.21.15.114:0/1067094508 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdea80cd6d0 0x7fdea815eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.615+0000 7fdea659c640 1 -- 172.21.15.114:0/1067094508 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdea8153e60 msgr2=0x7fdea815f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.615+0000 7fdea659c640 1 --2- 172.21.15.114:0/1067094508 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdea8153e60 0x7fdea815f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.615+0000 7fdea659c640 1 -- 172.21.15.114:0/1067094508 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdea80cd6d0 msgr2=0x7fdea815eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.615+0000 7fdea659c640 1 --2- 172.21.15.114:0/1067094508 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdea80cd6d0 0x7fdea815eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.615+0000 7fdea659c640 1 -- 172.21.15.114:0/1067094508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde98009a70 con 0x7fdea80b4880 2023-11-04T01:39:36.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.615+0000 7fdea5d9b640 1 --2- 172.21.15.114:0/1067094508 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdea80cd6d0 0x7fdea815eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:36.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.615+0000 7fdea6d9d640 1 --2- 172.21.15.114:0/1067094508 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdea8153e60 0x7fdea815f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:36.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.615+0000 7fdea659c640 1 --2- 172.21.15.114:0/1067094508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea80b4880 0x7fdea81555f0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fde98009eb0 tx=0x7fde98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.615+0000 7fde96ffd640 1 -- 172.21.15.114:0/1067094508 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9803f420 con 0x7fdea80b4880 2023-11-04T01:39:36.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.615+0000 7fde96ffd640 1 -- 172.21.15.114:0/1067094508 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9803f580 con 0x7fdea80b4880 2023-11-04T01:39:36.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.615+0000 7fde96ffd640 1 -- 172.21.15.114:0/1067094508 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9803f8f0 con 0x7fdea80b4880 2023-11-04T01:39:36.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.615+0000 7fdeac973640 1 -- 172.21.15.114:0/1067094508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea8156670 con 0x7fdea80b4880 2023-11-04T01:39:36.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.615+0000 7fdeac973640 1 -- 172.21.15.114:0/1067094508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea8156c30 con 0x7fdea80b4880 2023-11-04T01:39:36.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.616+0000 7fdeac973640 1 -- 172.21.15.114:0/1067094508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea80ceb60 con 0x7fdea80b4880 2023-11-04T01:39:36.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.616+0000 7fde96ffd640 1 -- 172.21.15.114:0/1067094508 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fde9803fa50 con 0x7fdea80b4880 2023-11-04T01:39:36.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.617+0000 7fde96ffd640 1 --2- 172.21.15.114:0/1067094508 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fde8806ae70 0x7fde8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.617+0000 7fde96ffd640 1 -- 172.21.15.114:0/1067094508 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fde980ac8f0 con 0x7fdea80b4880 2023-11-04T01:39:36.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.617+0000 7fdea5d9b640 1 --2- 172.21.15.114:0/1067094508 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fde8806ae70 0x7fde8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.617+0000 7fdea5d9b640 1 --2- 172.21.15.114:0/1067094508 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fde8806ae70 0x7fde8806d330 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fde9c007fd0 tx=0x7fde9c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.621+0000 7fde96ffd640 1 -- 172.21.15.114:0/1067094508 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde98077430 con 0x7fdea80b4880 2023-11-04T01:39:36.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.790+0000 7fdeac973640 1 -- 172.21.15.114:0/1067094508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdea80cce70 con 0x7fdea80b4880 2023-11-04T01:39:36.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.790+0000 7fde96ffd640 1 -- 172.21.15.114:0/1067094508 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde9807aa50 con 0x7fdea80b4880 2023-11-04T01:39:36.792 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:36.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.792+0000 7fdeac973640 1 -- 172.21.15.114:0/1067094508 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fde8806ae70 msgr2=0x7fde8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.792+0000 7fdeac973640 1 --2- 172.21.15.114:0/1067094508 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fde8806ae70 0x7fde8806d330 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fde9c007fd0 tx=0x7fde9c009040 comp rx=0 tx=0).stop 2023-11-04T01:39:36.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.792+0000 7fdeac973640 1 -- 172.21.15.114:0/1067094508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea80b4880 msgr2=0x7fdea81555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.792+0000 7fdeac973640 1 --2- 172.21.15.114:0/1067094508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea80b4880 0x7fdea81555f0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fde98009eb0 tx=0x7fde98004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:36.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.792+0000 7fdeac973640 1 -- 172.21.15.114:0/1067094508 shutdown_connections 2023-11-04T01:39:36.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.792+0000 7fdeac973640 1 --2- 172.21.15.114:0/1067094508 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdea8153e60 0x7fdea815f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.792+0000 7fdeac973640 1 --2- 172.21.15.114:0/1067094508 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fde8806ae70 0x7fde8806d330 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.792+0000 7fdeac973640 1 --2- 172.21.15.114:0/1067094508 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdea80cd6d0 0x7fdea815eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.792+0000 7fdeac973640 1 --2- 172.21.15.114:0/1067094508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea80b4880 0x7fdea81555f0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.792+0000 7fdeac973640 1 -- 172.21.15.114:0/1067094508 >> 172.21.15.114:0/1067094508 conn(0x7fdea80cf880 msgr2=0x7fdea80d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:36.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.792+0000 7fdeac973640 1 -- 172.21.15.114:0/1067094508 shutdown_connections 2023-11-04T01:39:36.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.792+0000 7fdeac973640 1 -- 172.21.15.114:0/1067094508 wait complete. 2023-11-04T01:39:36.805 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:39:36.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.904+0000 7f1c3e44f640 1 Processor -- start 2023-11-04T01:39:36.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.904+0000 7f1c3e44f640 1 -- start start 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.905+0000 7f1c3e44f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c381603d0 0x7f1c380b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.905+0000 7f1c3e44f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1c380722a0 0x7f1c3806a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.905+0000 7f1c3e44f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c380cdf80 con 0x7f1c3806a660 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.905+0000 7f1c3e44f640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c380b19d0 con 0x7f1c380722a0 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.905+0000 7f1c3e44f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3806aaf0 con 0x7f1c381603d0 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.905+0000 7f1c3c9ec640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1c3806a660 0x7f1c38160b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41460/0 (socket says 172.21.15.114:41460) 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.905+0000 7f1c3c9ec640 1 -- 172.21.15.114:0/1993489885 learned_addr learned my addr 172.21.15.114:0/1993489885 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:36.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c36ffd640 1 -- 172.21.15.114:0/1993489885 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503281579 0 0) 0x7f1c380cdf80 con 0x7f1c3806a660 2023-11-04T01:39:36.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c36ffd640 1 -- 172.21.15.114:0/1993489885 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c20003520 con 0x7f1c3806a660 2023-11-04T01:39:36.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c377fe640 1 --2- 172.21.15.114:0/1993489885 >> v2:172.21.15.141:3300/0 conn(0x7f1c380722a0 0x7f1c3806a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c37fff640 1 --2- 172.21.15.114:0/1993489885 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c381603d0 0x7f1c380b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c36ffd640 1 -- 172.21.15.114:0/1993489885 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 956802289 0 0) 0x7f1c20003520 con 0x7f1c3806a660 2023-11-04T01:39:36.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c36ffd640 1 -- 172.21.15.114:0/1993489885 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c381603d0 msgr2=0x7f1c380b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:36.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c36ffd640 1 --2- 172.21.15.114:0/1993489885 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c381603d0 0x7f1c380b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c36ffd640 1 -- 172.21.15.114:0/1993489885 >> v2:172.21.15.141:3300/0 conn(0x7f1c380722a0 msgr2=0x7f1c3806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:36.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c36ffd640 1 --2- 172.21.15.114:0/1993489885 >> v2:172.21.15.141:3300/0 conn(0x7f1c380722a0 0x7f1c3806a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c36ffd640 1 -- 172.21.15.114:0/1993489885 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c380ce6f0 con 0x7f1c3806a660 2023-11-04T01:39:36.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c36ffd640 1 -- 172.21.15.114:0/1993489885 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f1c300019f0 con 0x7f1c3806a660 2023-11-04T01:39:36.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c36ffd640 1 -- 172.21.15.114:0/1993489885 >> v1:172.21.15.114:6789/0 conn(0x7f1c3806a660 legacy=0x7f1c38160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c36ffd640 1 --2- 172.21.15.114:0/1993489885 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c20003970 0x7f1c20003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c36ffd640 1 --2- 172.21.15.114:0/1993489885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c200047c0 0x7f1c20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c36ffd640 1 --2- 172.21.15.114:0/1993489885 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c381603d0 0x7f1c20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c36ffd640 1 -- 172.21.15.114:0/1993489885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3806aaf0 con 0x7f1c200047c0 2023-11-04T01:39:36.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c36ffd640 1 -- 172.21.15.114:0/1993489885 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2000b980 con 0x7f1c20003970 2023-11-04T01:39:36.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c36ffd640 1 -- 172.21.15.114:0/1993489885 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2000bac0 con 0x7f1c381603d0 2023-11-04T01:39:36.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c377fe640 1 --2- 172.21.15.114:0/1993489885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c200047c0 0x7f1c20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c3c9ec640 1 --2- 172.21.15.114:0/1993489885 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c381603d0 0x7f1c20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c37fff640 1 --2- 172.21.15.114:0/1993489885 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c20003970 0x7f1c20003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c377fe640 1 -- 172.21.15.114:0/1993489885 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c381603d0 msgr2=0x7f1c20005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:36.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c377fe640 1 --2- 172.21.15.114:0/1993489885 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c381603d0 0x7f1c20005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c377fe640 1 -- 172.21.15.114:0/1993489885 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c20003970 msgr2=0x7f1c20003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:36.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c377fe640 1 --2- 172.21.15.114:0/1993489885 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c20003970 0x7f1c20003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.906+0000 7f1c377fe640 1 -- 172.21.15.114:0/1993489885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c20003520 con 0x7f1c200047c0 2023-11-04T01:39:36.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.907+0000 7f1c377fe640 1 --2- 172.21.15.114:0/1993489885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c200047c0 0x7f1c20004c40 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009af0 tx=0x7f1c200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f65102f0aaa93e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.907+0000 7f1c36ffd640 1 -- 172.21.15.114:0/1993489885 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c02c710 con 0x7f1c200047c0 2023-11-04T01:39:36.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.907+0000 7f1c36ffd640 1 -- 172.21.15.114:0/1993489885 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2c02c870 con 0x7f1c200047c0 2023-11-04T01:39:36.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.907+0000 7f1c36ffd640 1 -- 172.21.15.114:0/1993489885 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c02cc00 con 0x7f1c200047c0 2023-11-04T01:39:36.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.908+0000 7f1c3e44f640 1 -- 172.21.15.114:0/1993489885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c200047c0 msgr2=0x7f1c20004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.908+0000 7f1c3e44f640 1 --2- 172.21.15.114:0/1993489885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c200047c0 0x7f1c20004c40 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009af0 tx=0x7f1c200057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.908+0000 7f1c3c9ec640 1 -- 172.21.15.114:0/1993489885 reap_dead start 2023-11-04T01:39:36.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.908+0000 7f1c3e44f640 1 -- 172.21.15.114:0/1993489885 shutdown_connections 2023-11-04T01:39:36.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.908+0000 7f1c3e44f640 1 -- 172.21.15.114:0/1993489885 >> 172.21.15.114:0/1993489885 conn(0x7f1c3806d800 msgr2=0x7f1c3806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:36.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.908+0000 7f1c3e44f640 1 -- 172.21.15.114:0/1993489885 shutdown_connections 2023-11-04T01:39:36.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.908+0000 7f1c3e44f640 1 -- 172.21.15.114:0/1993489885 wait complete. 2023-11-04T01:39:36.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.909+0000 7f1c3e44f640 1 Processor -- start 2023-11-04T01:39:36.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.909+0000 7f1c3e44f640 1 -- start start 2023-11-04T01:39:36.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c3e44f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c200047c0 0x7f1c38152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c3e44f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c38152ab0 0x7f1c38152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c3e44f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c38154e30 0x7f1c381552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c3e44f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c381528d0 con 0x7f1c38154e30 2023-11-04T01:39:36.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c3e44f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c38156e90 con 0x7f1c38152ab0 2023-11-04T01:39:36.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c3e44f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c381557f0 con 0x7f1c200047c0 2023-11-04T01:39:36.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c3c9ec640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c38154e30 0x7f1c381552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c3c9ec640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c38154e30 0x7f1c381552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54944/0 (socket says 172.21.15.114:54944) 2023-11-04T01:39:36.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c3c9ec640 1 -- 172.21.15.114:0/675024555 learned_addr learned my addr 172.21.15.114:0/675024555 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:36.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c377fe640 1 --2- 172.21.15.114:0/675024555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c38152ab0 0x7f1c38152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c37fff640 1 --2- 172.21.15.114:0/675024555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c200047c0 0x7f1c38152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c3c9ec640 1 -- 172.21.15.114:0/675024555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c200047c0 msgr2=0x7f1c38152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c3c9ec640 1 --2- 172.21.15.114:0/675024555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c200047c0 0x7f1c38152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c3c9ec640 1 -- 172.21.15.114:0/675024555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c38152ab0 msgr2=0x7f1c38152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c3c9ec640 1 --2- 172.21.15.114:0/675024555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c38152ab0 0x7f1c38152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c3c9ec640 1 -- 172.21.15.114:0/675024555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c38153620 con 0x7f1c38154e30 2023-11-04T01:39:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c377fe640 1 --2- 172.21.15.114:0/675024555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c38152ab0 0x7f1c38152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c3c9ec640 1 --2- 172.21.15.114:0/675024555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c38154e30 0x7f1c381552b0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f1c30000f80 tx=0x7f1c3000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c34ff9640 1 -- 172.21.15.114:0/675024555 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3000ec10 con 0x7f1c38154e30 2023-11-04T01:39:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c34ff9640 1 -- 172.21.15.114:0/675024555 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3000ed90 con 0x7f1c38154e30 2023-11-04T01:39:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c34ff9640 1 -- 172.21.15.114:0/675024555 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c30013660 con 0x7f1c38154e30 2023-11-04T01:39:36.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.910+0000 7f1c3e44f640 1 -- 172.21.15.114:0/675024555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c38153900 con 0x7f1c38154e30 2023-11-04T01:39:36.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.911+0000 7f1c3e44f640 1 -- 172.21.15.114:0/675024555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c380b26a0 con 0x7f1c38154e30 2023-11-04T01:39:36.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.911+0000 7f1c3e44f640 1 -- 172.21.15.114:0/675024555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c380b2500 con 0x7f1c38154e30 2023-11-04T01:39:36.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.912+0000 7f1c34ff9640 1 -- 172.21.15.114:0/675024555 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c300137c0 con 0x7f1c38154e30 2023-11-04T01:39:36.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.912+0000 7f1c34ff9640 1 --2- 172.21.15.114:0/675024555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1c2406ae70 0x7f1c2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.912+0000 7f1c34ff9640 1 -- 172.21.15.114:0/675024555 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f1c30089f30 con 0x7f1c38154e30 2023-11-04T01:39:36.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.912+0000 7f1c37fff640 1 --2- 172.21.15.114:0/675024555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1c2406ae70 0x7f1c2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.913+0000 7f1c37fff640 1 --2- 172.21.15.114:0/675024555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1c2406ae70 0x7f1c2406d330 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009930 tx=0x7f1c28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:36.917+0000 7f1c34ff9640 1 -- 172.21.15.114:0/675024555 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c380b2500 con 0x7f1c38154e30 2023-11-04T01:39:37.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.084+0000 7f1c3e44f640 1 -- 172.21.15.114:0/675024555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1c380b2500 con 0x7f1c38154e30 2023-11-04T01:39:37.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.085+0000 7f1c34ff9640 1 -- 172.21.15.114:0/675024555 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1c380b2500 con 0x7f1c38154e30 2023-11-04T01:39:37.086 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:39:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.086+0000 7f1c3e44f640 1 -- 172.21.15.114:0/675024555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1c2406ae70 msgr2=0x7f1c2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.086+0000 7f1c3e44f640 1 --2- 172.21.15.114:0/675024555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1c2406ae70 0x7f1c2406d330 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009930 tx=0x7f1c28008040 comp rx=0 tx=0).stop 2023-11-04T01:39:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.086+0000 7f1c3e44f640 1 -- 172.21.15.114:0/675024555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c38154e30 msgr2=0x7f1c381552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.086+0000 7f1c3e44f640 1 --2- 172.21.15.114:0/675024555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c38154e30 0x7f1c381552b0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f1c30000f80 tx=0x7f1c3000e530 comp rx=0 tx=0).stop 2023-11-04T01:39:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.086+0000 7f1c3e44f640 1 -- 172.21.15.114:0/675024555 shutdown_connections 2023-11-04T01:39:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.086+0000 7f1c3e44f640 1 --2- 172.21.15.114:0/675024555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c38154e30 0x7f1c381552b0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.086+0000 7f1c3e44f640 1 --2- 172.21.15.114:0/675024555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1c2406ae70 0x7f1c2406d330 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.086+0000 7f1c3e44f640 1 --2- 172.21.15.114:0/675024555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1c38152ab0 0x7f1c38152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.086+0000 7f1c3e44f640 1 --2- 172.21.15.114:0/675024555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1c200047c0 0x7f1c38152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.086+0000 7f1c3e44f640 1 -- 172.21.15.114:0/675024555 >> 172.21.15.114:0/675024555 conn(0x7f1c3806d800 msgr2=0x7f1c380ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.087+0000 7f1c3e44f640 1 -- 172.21.15.114:0/675024555 shutdown_connections 2023-11-04T01:39:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.087+0000 7f1c3e44f640 1 -- 172.21.15.114:0/675024555 wait complete. 2023-11-04T01:39:37.099 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:37.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.196+0000 7f2f1cb0c640 1 Processor -- start 2023-11-04T01:39:37.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.196+0000 7f2f1cb0c640 1 -- start start 2023-11-04T01:39:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.197+0000 7f2f1cb0c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2f18159c70 0x7f2f180ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.197+0000 7f2f1cb0c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f180b0ae0 0x7f2f1815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.197+0000 7f2f1cb0c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f180b4110 con 0x7f2f1806db20 2023-11-04T01:39:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.197+0000 7f2f1cb0c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f180b49b0 con 0x7f2f18159c70 2023-11-04T01:39:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.197+0000 7f2f1cb0c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180b43f0 con 0x7f2f180b0ae0 2023-11-04T01:39:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.197+0000 7f2f15d9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2f1806db20 0x7f2f180b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41468/0 (socket says 172.21.15.114:41468) 2023-11-04T01:39:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.197+0000 7f2f15d9b640 1 -- 172.21.15.114:0/2685640699 learned_addr learned my addr 172.21.15.114:0/2685640699 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.197+0000 7f2f1659c640 1 --2- 172.21.15.114:0/2685640699 >> v2:172.21.15.141:3300/0 conn(0x7f2f18159c70 0x7f2f180ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.197+0000 7f2f16d9d640 1 --2- 172.21.15.114:0/2685640699 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f180b0ae0 0x7f2f1815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1559a640 1 -- 172.21.15.114:0/2685640699 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600686176 0 0) 0x7f2f180b4110 con 0x7f2f1806db20 2023-11-04T01:39:37.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1559a640 1 -- 172.21.15.114:0/2685640699 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f00003520 con 0x7f2f1806db20 2023-11-04T01:39:37.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1559a640 1 -- 172.21.15.114:0/2685640699 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3437298777 0 0) 0x7f2f00003520 con 0x7f2f1806db20 2023-11-04T01:39:37.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1559a640 1 -- 172.21.15.114:0/2685640699 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f180b0ae0 msgr2=0x7f2f1815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:37.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1559a640 1 --2- 172.21.15.114:0/2685640699 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f180b0ae0 0x7f2f1815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1559a640 1 -- 172.21.15.114:0/2685640699 >> v2:172.21.15.141:3300/0 conn(0x7f2f18159c70 msgr2=0x7f2f180ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:37.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1559a640 1 --2- 172.21.15.114:0/2685640699 >> v2:172.21.15.141:3300/0 conn(0x7f2f18159c70 0x7f2f180ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1559a640 1 -- 172.21.15.114:0/2685640699 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f180b46d0 con 0x7f2f1806db20 2023-11-04T01:39:37.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1559a640 1 -- 172.21.15.114:0/2685640699 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f2f0c001670 con 0x7f2f1806db20 2023-11-04T01:39:37.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1659c640 1 --2- 172.21.15.114:0/2685640699 >> v2:172.21.15.141:3300/0 conn(0x7f2f18159c70 0x7f2f180ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:37.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1559a640 1 -- 172.21.15.114:0/2685640699 >> v1:172.21.15.114:6789/0 conn(0x7f2f1806db20 legacy=0x7f2f180b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1559a640 1 --2- 172.21.15.114:0/2685640699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f00003970 0x7f2f00003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1559a640 1 --2- 172.21.15.114:0/2685640699 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f000047c0 0x7f2f00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1559a640 1 --2- 172.21.15.114:0/2685640699 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f00005180 0x7f2f0000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1559a640 1 -- 172.21.15.114:0/2685640699 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180b49b0 con 0x7f2f00003970 2023-11-04T01:39:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1559a640 1 -- 172.21.15.114:0/2685640699 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180b43f0 con 0x7f2f000047c0 2023-11-04T01:39:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1559a640 1 -- 172.21.15.114:0/2685640699 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0000bec0 con 0x7f2f00005180 2023-11-04T01:39:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f16d9d640 1 --2- 172.21.15.114:0/2685640699 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f180b0ae0 0x7f2f1815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1659c640 1 --2- 172.21.15.114:0/2685640699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f00003970 0x7f2f00003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f15d9b640 1 --2- 172.21.15.114:0/2685640699 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f000047c0 0x7f2f00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f16d9d640 1 --2- 172.21.15.114:0/2685640699 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f00005180 0x7f2f0000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1659c640 1 -- 172.21.15.114:0/2685640699 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f00005180 msgr2=0x7f2f0000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1659c640 1 --2- 172.21.15.114:0/2685640699 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f00005180 0x7f2f0000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1659c640 1 -- 172.21.15.114:0/2685640699 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f000047c0 msgr2=0x7f2f00004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:37.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1659c640 1 --2- 172.21.15.114:0/2685640699 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f000047c0 0x7f2f00004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.198+0000 7f2f1659c640 1 -- 172.21.15.114:0/2685640699 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f00003520 con 0x7f2f00003970 2023-11-04T01:39:37.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.199+0000 7f2f1659c640 1 --2- 172.21.15.114:0/2685640699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f00003970 0x7f2f00003d90 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f2f080104f0 tx=0x7f2f000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d90f36438a630a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:37.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.199+0000 7f2f1559a640 1 -- 172.21.15.114:0/2685640699 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0800b2d0 con 0x7f2f00003970 2023-11-04T01:39:37.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.199+0000 7f2f1559a640 1 -- 172.21.15.114:0/2685640699 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f08031050 con 0x7f2f00003970 2023-11-04T01:39:37.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.199+0000 7f2f1559a640 1 -- 172.21.15.114:0/2685640699 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08009740 con 0x7f2f00003970 2023-11-04T01:39:37.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.200+0000 7f2f1cb0c640 1 -- 172.21.15.114:0/2685640699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f00003970 msgr2=0x7f2f00003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.200+0000 7f2f1cb0c640 1 --2- 172.21.15.114:0/2685640699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f00003970 0x7f2f00003d90 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f2f080104f0 tx=0x7f2f000057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.200+0000 7f2f16d9d640 1 -- 172.21.15.114:0/2685640699 reap_dead start 2023-11-04T01:39:37.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.200+0000 7f2f1cb0c640 1 -- 172.21.15.114:0/2685640699 shutdown_connections 2023-11-04T01:39:37.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.200+0000 7f2f1cb0c640 1 -- 172.21.15.114:0/2685640699 >> 172.21.15.114:0/2685640699 conn(0x7f2f180ce950 msgr2=0x7f2f180ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:37.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.200+0000 7f2f1cb0c640 1 -- 172.21.15.114:0/2685640699 shutdown_connections 2023-11-04T01:39:37.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.200+0000 7f2f1cb0c640 1 -- 172.21.15.114:0/2685640699 wait complete. 2023-11-04T01:39:37.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.201+0000 7f2f1cb0c640 1 Processor -- start 2023-11-04T01:39:37.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.201+0000 7f2f1cb0c640 1 -- start start 2023-11-04T01:39:37.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f1cb0c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f00003970 0x7f2f180afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f1cb0c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f180aaa80 0x7f2f181edd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f1cb0c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f180aaf00 0x7f2f181ee2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f1cb0c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f181eecd0 con 0x7f2f00003970 2023-11-04T01:39:37.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f1cb0c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180b03c0 con 0x7f2f180aaf00 2023-11-04T01:39:37.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f1cb0c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180a82e0 con 0x7f2f180aaa80 2023-11-04T01:39:37.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f1659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f00003970 0x7f2f180afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f1659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f00003970 0x7f2f180afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54972/0 (socket says 172.21.15.114:54972) 2023-11-04T01:39:37.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f1659c640 1 -- 172.21.15.114:0/2928397404 learned_addr learned my addr 172.21.15.114:0/2928397404 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:37.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f15d9b640 1 --2- 172.21.15.114:0/2928397404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f180aaa80 0x7f2f181edd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f16d9d640 1 --2- 172.21.15.114:0/2928397404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f180aaf00 0x7f2f181ee2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f1659c640 1 -- 172.21.15.114:0/2928397404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f180aaa80 msgr2=0x7f2f181edd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f1659c640 1 --2- 172.21.15.114:0/2928397404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f180aaa80 0x7f2f181edd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f1659c640 1 -- 172.21.15.114:0/2928397404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f180aaf00 msgr2=0x7f2f181ee2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f1659c640 1 --2- 172.21.15.114:0/2928397404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f180aaf00 0x7f2f181ee2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f1659c640 1 -- 172.21.15.114:0/2928397404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f180a85c0 con 0x7f2f00003970 2023-11-04T01:39:37.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f1659c640 1 --2- 172.21.15.114:0/2928397404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f00003970 0x7f2f180afe80 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f2f08038040 tx=0x7f2f0800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:37.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f06ffd640 1 -- 172.21.15.114:0/2928397404 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08048410 con 0x7f2f00003970 2023-11-04T01:39:37.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.202+0000 7f2f06ffd640 1 -- 172.21.15.114:0/2928397404 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f08011040 con 0x7f2f00003970 2023-11-04T01:39:37.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.203+0000 7f2f1cb0c640 1 -- 172.21.15.114:0/2928397404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f180a88a0 con 0x7f2f00003970 2023-11-04T01:39:37.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.203+0000 7f2f06ffd640 1 -- 172.21.15.114:0/2928397404 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08048770 con 0x7f2f00003970 2023-11-04T01:39:37.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.203+0000 7f2f1cb0c640 1 -- 172.21.15.114:0/2928397404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f180a8e60 con 0x7f2f00003970 2023-11-04T01:39:37.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.203+0000 7f2f1cb0c640 1 -- 172.21.15.114:0/2928397404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f18074290 con 0x7f2f00003970 2023-11-04T01:39:37.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.204+0000 7f2f06ffd640 1 -- 172.21.15.114:0/2928397404 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f0803c070 con 0x7f2f00003970 2023-11-04T01:39:37.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.204+0000 7f2f06ffd640 1 --2- 172.21.15.114:0/2928397404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2ef806ae70 0x7f2ef806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.204+0000 7f2f06ffd640 1 -- 172.21.15.114:0/2928397404 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f2f080adf70 con 0x7f2f00003970 2023-11-04T01:39:37.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.204+0000 7f2f15d9b640 1 --2- 172.21.15.114:0/2928397404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2ef806ae70 0x7f2ef806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.205+0000 7f2f15d9b640 1 --2- 172.21.15.114:0/2928397404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2ef806ae70 0x7f2ef806d330 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c001050 tx=0x7f2f0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:37.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.208+0000 7f2f06ffd640 1 -- 172.21.15.114:0/2928397404 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f080e0ca0 con 0x7f2f00003970 2023-11-04T01:39:37.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.416+0000 7f2f1cb0c640 1 -- 172.21.15.114:0/2928397404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f1806d3f0 con 0x7f2f00003970 2023-11-04T01:39:37.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.416+0000 7f2f06ffd640 1 -- 172.21.15.114:0/2928397404 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4924 (secure 0 0 0) 0x7f2f08078bc0 con 0x7f2f00003970 2023-11-04T01:39:37.418 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:37.419 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6055,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/775121992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":775121992},{"type":"v1","addr":"172.21.15.141:6835","nonce":775121992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6951,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1790830778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1790830778},{"type":"v1","addr":"172.21.15.114:6836","nonce":1790830778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6954,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2482757978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2482757978},{"type":"v1","addr":"172.21.15.114:6837","nonce":2482757978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:22.003461+0000","modified":"2023-11-04T01:39:31.088794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6966":{"gid":6966,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6834/1471552462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1471552462},{"type":"v1","addr":"172.21.15.141:6834","nonce":1471552462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:39:37.419 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 37 2023-11-04T01:39:37.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.418+0000 7f2f1cb0c640 1 -- 172.21.15.114:0/2928397404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2ef806ae70 msgr2=0x7f2ef806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.418+0000 7f2f1cb0c640 1 --2- 172.21.15.114:0/2928397404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2ef806ae70 0x7f2ef806d330 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c001050 tx=0x7f2f0c009040 comp rx=0 tx=0).stop 2023-11-04T01:39:37.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.418+0000 7f2f1cb0c640 1 -- 172.21.15.114:0/2928397404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f00003970 msgr2=0x7f2f180afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.418+0000 7f2f1cb0c640 1 --2- 172.21.15.114:0/2928397404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f00003970 0x7f2f180afe80 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f2f08038040 tx=0x7f2f0800b960 comp rx=0 tx=0).stop 2023-11-04T01:39:37.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.418+0000 7f2f1cb0c640 1 -- 172.21.15.114:0/2928397404 shutdown_connections 2023-11-04T01:39:37.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.418+0000 7f2f1cb0c640 1 --2- 172.21.15.114:0/2928397404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2ef806ae70 0x7f2ef806d330 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.418+0000 7f2f1cb0c640 1 --2- 172.21.15.114:0/2928397404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2f180aaf00 0x7f2f181ee2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.418+0000 7f2f1cb0c640 1 --2- 172.21.15.114:0/2928397404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2f180aaa80 0x7f2f181edd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.418+0000 7f2f1cb0c640 1 --2- 172.21.15.114:0/2928397404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f00003970 0x7f2f180afe80 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.418+0000 7f2f1cb0c640 1 -- 172.21.15.114:0/2928397404 >> 172.21.15.114:0/2928397404 conn(0x7f2f180ce950 msgr2=0x7f2f1815c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:37.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.419+0000 7f2f1cb0c640 1 -- 172.21.15.114:0/2928397404 shutdown_connections 2023-11-04T01:39:37.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.419+0000 7f2f1cb0c640 1 -- 172.21.15.114:0/2928397404 wait complete. 2023-11-04T01:39:37.431 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.529+0000 7f6f61789640 1 Processor -- start 2023-11-04T01:39:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.529+0000 7f6f61789640 1 -- start start 2023-11-04T01:39:37.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.530+0000 7f6f61789640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6f5c0cde60 0x7f6f5c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.530+0000 7f6f61789640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6f5c15daa0 0x7f6f5c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.530+0000 7f6f61789640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c15e000 con 0x7f6f5c0ce240 2023-11-04T01:39:37.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.530+0000 7f6f61789640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c15e5c0 con 0x7f6f5c0cde60 2023-11-04T01:39:37.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.530+0000 7f6f61789640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c15e2e0 con 0x7f6f5c15daa0 2023-11-04T01:39:37.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.530+0000 7f6f5affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6f5c0cde60 0x7f6f5c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.530+0000 7f6f5affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6f5c0cde60 0x7f6f5c15d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54986/0 (socket says 172.21.15.114:54986) 2023-11-04T01:39:37.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.530+0000 7f6f5affd640 1 -- 172.21.15.114:0/185547990 learned_addr learned my addr 172.21.15.114:0/185547990 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:37.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.530+0000 7f6f5a7fc640 1 --2- 172.21.15.114:0/185547990 >> v2:172.21.15.141:3300/0 conn(0x7f6f5c15daa0 0x7f6f5c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.530+0000 7f6f5affd640 1 -- 172.21.15.114:0/185547990 >> v2:172.21.15.141:3300/0 conn(0x7f6f5c15daa0 msgr2=0x7f6f5c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:37.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.530+0000 7f6f5affd640 1 --2- 172.21.15.114:0/185547990 >> v2:172.21.15.141:3300/0 conn(0x7f6f5c15daa0 0x7f6f5c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.530+0000 7f6f5affd640 1 -- 172.21.15.114:0/185547990 >> v1:172.21.15.141:6789/0 conn(0x7f6f5c0ce240 legacy=0x7f6f5c06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:37.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.530+0000 7f6f5affd640 1 -- 172.21.15.114:0/185547990 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c0d1120 con 0x7f6f5c0cde60 2023-11-04T01:39:37.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.530+0000 7f6f5a7fc640 1 --2- 172.21.15.114:0/185547990 >> v2:172.21.15.141:3300/0 conn(0x7f6f5c15daa0 0x7f6f5c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:37.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.531+0000 7f6f5affd640 1 --2- 172.21.15.114:0/185547990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0cde60 0x7f6f5c15d560 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0cf5f0 tx=0x7f6f4c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe01132df927417 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:37.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.531+0000 7f6f59ffb640 1 -- 172.21.15.114:0/185547990 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c02ca80 con 0x7f6f5c0cde60 2023-11-04T01:39:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.531+0000 7f6f59ffb640 1 -- 172.21.15.114:0/185547990 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c02cbe0 con 0x7f6f5c0cde60 2023-11-04T01:39:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.531+0000 7f6f59ffb640 1 -- 172.21.15.114:0/185547990 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0343f0 con 0x7f6f5c0cde60 2023-11-04T01:39:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.531+0000 7f6f61789640 1 -- 172.21.15.114:0/185547990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0cde60 msgr2=0x7f6f5c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.531+0000 7f6f61789640 1 --2- 172.21.15.114:0/185547990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0cde60 0x7f6f5c15d560 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0cf5f0 tx=0x7f6f4c02bee0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.531+0000 7f6f61789640 1 -- 172.21.15.114:0/185547990 shutdown_connections 2023-11-04T01:39:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.531+0000 7f6f61789640 1 --2- 172.21.15.114:0/185547990 >> v2:172.21.15.141:3300/0 conn(0x7f6f5c15daa0 0x7f6f5c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.531+0000 7f6f61789640 1 --2- 172.21.15.114:0/185547990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0cde60 0x7f6f5c15d560 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.532+0000 7f6f61789640 1 -- 172.21.15.114:0/185547990 >> 172.21.15.114:0/185547990 conn(0x7f6f5c071f30 msgr2=0x7f6f5c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.532+0000 7f6f61789640 1 -- 172.21.15.114:0/185547990 shutdown_connections 2023-11-04T01:39:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.532+0000 7f6f61789640 1 -- 172.21.15.114:0/185547990 wait complete. 2023-11-04T01:39:37.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.533+0000 7f6f61789640 1 Processor -- start 2023-11-04T01:39:37.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.533+0000 7f6f61789640 1 -- start start 2023-11-04T01:39:37.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.533+0000 7f6f61789640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f5c0cde60 0x7f6f5c154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.533+0000 7f6f61789640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0ce240 0x7f6f5c15c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f61789640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f5c15daa0 0x7f6f5c0c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f61789640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c157100 con 0x7f6f5c0ce240 2023-11-04T01:39:37.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f61789640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c1573e0 con 0x7f6f5c15daa0 2023-11-04T01:39:37.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f61789640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c1576c0 con 0x7f6f5c0cde60 2023-11-04T01:39:37.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f5a7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0ce240 0x7f6f5c15c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f5a7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0ce240 0x7f6f5c15c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54998/0 (socket says 172.21.15.114:54998) 2023-11-04T01:39:37.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f5a7fc640 1 -- 172.21.15.114:0/2551460324 learned_addr learned my addr 172.21.15.114:0/2551460324 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f5affd640 1 --2- 172.21.15.114:0/2551460324 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f5c0cde60 0x7f6f5c154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f5b7fe640 1 --2- 172.21.15.114:0/2551460324 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f5c15daa0 0x7f6f5c0c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f5a7fc640 1 -- 172.21.15.114:0/2551460324 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f5c0cde60 msgr2=0x7f6f5c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f5a7fc640 1 --2- 172.21.15.114:0/2551460324 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f5c0cde60 0x7f6f5c154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f5a7fc640 1 -- 172.21.15.114:0/2551460324 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f5c15daa0 msgr2=0x7f6f5c0c6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f5a7fc640 1 --2- 172.21.15.114:0/2551460324 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f5c15daa0 0x7f6f5c0c6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f5a7fc640 1 -- 172.21.15.114:0/2551460324 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c009b30 con 0x7f6f5c0ce240 2023-11-04T01:39:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f5affd640 1 --2- 172.21.15.114:0/2551460324 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f5c0cde60 0x7f6f5c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f5b7fe640 1 --2- 172.21.15.114:0/2551460324 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f5c15daa0 0x7f6f5c0c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f5a7fc640 1 --2- 172.21.15.114:0/2551460324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0ce240 0x7f6f5c15c3f0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000c7f0 tx=0x7f6f5000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f437fe640 1 -- 172.21.15.114:0/2551460324 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50007820 con 0x7f6f5c0ce240 2023-11-04T01:39:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f437fe640 1 -- 172.21.15.114:0/2551460324 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f50007980 con 0x7f6f5c0ce240 2023-11-04T01:39:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f61789640 1 -- 172.21.15.114:0/2551460324 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c1579a0 con 0x7f6f5c0ce240 2023-11-04T01:39:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f437fe640 1 -- 172.21.15.114:0/2551460324 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50007d30 con 0x7f6f5c0ce240 2023-11-04T01:39:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.534+0000 7f6f61789640 1 -- 172.21.15.114:0/2551460324 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c154a80 con 0x7f6f5c0ce240 2023-11-04T01:39:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.535+0000 7f6f61789640 1 -- 172.21.15.114:0/2551460324 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c074290 con 0x7f6f5c0ce240 2023-11-04T01:39:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.536+0000 7f6f437fe640 1 -- 172.21.15.114:0/2551460324 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f500113f0 con 0x7f6f5c0ce240 2023-11-04T01:39:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.536+0000 7f6f437fe640 1 --2- 172.21.15.114:0/2551460324 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6f4806ae70 0x7f6f4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.536+0000 7f6f437fe640 1 -- 172.21.15.114:0/2551460324 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f6f50089ee0 con 0x7f6f5c0ce240 2023-11-04T01:39:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.536+0000 7f6f5affd640 1 --2- 172.21.15.114:0/2551460324 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6f4806ae70 0x7f6f4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.536+0000 7f6f5affd640 1 --2- 172.21.15.114:0/2551460324 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6f4806ae70 0x7f6f4806d330 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c035000 tx=0x7f6f4c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:37.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.540+0000 7f6f437fe640 1 -- 172.21.15.114:0/2551460324 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f500549f0 con 0x7f6f5c0ce240 2023-11-04T01:39:37.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.711+0000 7f6f61789640 1 -- 172.21.15.114:0/2551460324 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f5c156810 con 0x7f6f5c0ce240 2023-11-04T01:39:37.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.713+0000 7f6f437fe640 1 -- 172.21.15.114:0/2551460324 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22123 (secure 0 0 0) 0x7f6f50058010 con 0x7f6f5c0ce240 2023-11-04T01:39:37.715 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:37.715 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":84,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:36.716982+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:20.107188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:20.970024+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":84,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.715+0000 7f6f61789640 1 -- 172.21.15.114:0/2551460324 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6f4806ae70 msgr2=0x7f6f4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.715+0000 7f6f61789640 1 --2- 172.21.15.114:0/2551460324 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6f4806ae70 0x7f6f4806d330 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c035000 tx=0x7f6f4c030000 comp rx=0 tx=0).stop 2023-11-04T01:39:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.715+0000 7f6f61789640 1 -- 172.21.15.114:0/2551460324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0ce240 msgr2=0x7f6f5c15c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.715+0000 7f6f61789640 1 --2- 172.21.15.114:0/2551460324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0ce240 0x7f6f5c15c3f0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000c7f0 tx=0x7f6f5000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.715+0000 7f6f61789640 1 -- 172.21.15.114:0/2551460324 shutdown_connections 2023-11-04T01:39:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.715+0000 7f6f61789640 1 --2- 172.21.15.114:0/2551460324 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6f4806ae70 0x7f6f4806d330 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.715+0000 7f6f61789640 1 --2- 172.21.15.114:0/2551460324 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f5c15daa0 0x7f6f5c0c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.715+0000 7f6f61789640 1 --2- 172.21.15.114:0/2551460324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0ce240 0x7f6f5c15c3f0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.715+0000 7f6f61789640 1 --2- 172.21.15.114:0/2551460324 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f5c0cde60 0x7f6f5c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.715+0000 7f6f61789640 1 -- 172.21.15.114:0/2551460324 >> 172.21.15.114:0/2551460324 conn(0x7f6f5c071f30 msgr2=0x7f6f5c0b77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.715+0000 7f6f61789640 1 -- 172.21.15.114:0/2551460324 shutdown_connections 2023-11-04T01:39:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.715+0000 7f6f61789640 1 -- 172.21.15.114:0/2551460324 wait complete. 2023-11-04T01:39:37.728 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:39:37.728 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:37.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.825+0000 7ffb66cc9640 1 Processor -- start 2023-11-04T01:39:37.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.825+0000 7ffb66cc9640 1 -- start start 2023-11-04T01:39:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.826+0000 7ffb66cc9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffb600b42c0 0x7ffb600c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.826+0000 7ffb66cc9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ffb600c9c40 0x7ffb600b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.826+0000 7ffb66cc9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb600ca050 con 0x7ffb6015ad80 2023-11-04T01:39:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.826+0000 7ffb66cc9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6006cfa0 con 0x7ffb600b42c0 2023-11-04T01:39:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.826+0000 7ffb66cc9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6006d280 con 0x7ffb600c9c40 2023-11-04T01:39:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.826+0000 7ffb5ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffb600b42c0 0x7ffb600c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.826+0000 7ffb64a65640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ffb6015ad80 0x7ffb6006c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41482/0 (socket says 172.21.15.114:41482) 2023-11-04T01:39:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.826+0000 7ffb64a65640 1 -- 172.21.15.114:0/334297586 learned_addr learned my addr 172.21.15.114:0/334297586 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.827+0000 7ffb5ffff640 1 -- 172.21.15.114:0/334297586 >> v2:172.21.15.141:3300/0 conn(0x7ffb600c9c40 msgr2=0x7ffb600b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.827+0000 7ffb5ffff640 1 --2- 172.21.15.114:0/334297586 >> v2:172.21.15.141:3300/0 conn(0x7ffb600c9c40 0x7ffb600b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.827+0000 7ffb5ffff640 1 -- 172.21.15.114:0/334297586 >> v1:172.21.15.114:6789/0 conn(0x7ffb6015ad80 legacy=0x7ffb6006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.827+0000 7ffb5ffff640 1 -- 172.21.15.114:0/334297586 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6006d560 con 0x7ffb600b42c0 2023-11-04T01:39:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.827+0000 7ffb5f7fe640 1 -- 172.21.15.114:0/334297586 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794398858 0 0) 0x7ffb600ca050 con 0x7ffb6015ad80 2023-11-04T01:39:37.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.827+0000 7ffb5ffff640 1 --2- 172.21.15.114:0/334297586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb600b42c0 0x7ffb600c9700 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7ffb600c8e50 tx=0x7ffb5402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44b33ce19433044 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:37.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.827+0000 7ffb5f7fe640 1 -- 172.21.15.114:0/334297586 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb54030610 con 0x7ffb600b42c0 2023-11-04T01:39:37.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.827+0000 7ffb5f7fe640 1 -- 172.21.15.114:0/334297586 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb54030770 con 0x7ffb600b42c0 2023-11-04T01:39:37.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.827+0000 7ffb5f7fe640 1 -- 172.21.15.114:0/334297586 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb54030b00 con 0x7ffb600b42c0 2023-11-04T01:39:37.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.828+0000 7ffb66cc9640 1 -- 172.21.15.114:0/334297586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb600b42c0 msgr2=0x7ffb600c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.828+0000 7ffb66cc9640 1 --2- 172.21.15.114:0/334297586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb600b42c0 0x7ffb600c9700 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7ffb600c8e50 tx=0x7ffb5402b960 comp rx=0 tx=0).stop 2023-11-04T01:39:37.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.828+0000 7ffb66cc9640 1 -- 172.21.15.114:0/334297586 shutdown_connections 2023-11-04T01:39:37.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.828+0000 7ffb66cc9640 1 --2- 172.21.15.114:0/334297586 >> v2:172.21.15.141:3300/0 conn(0x7ffb600c9c40 0x7ffb600b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.828+0000 7ffb66cc9640 1 --2- 172.21.15.114:0/334297586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb600b42c0 0x7ffb600c9700 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.828+0000 7ffb66cc9640 1 -- 172.21.15.114:0/334297586 >> 172.21.15.114:0/334297586 conn(0x7ffb600ce950 msgr2=0x7ffb600ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:37.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.828+0000 7ffb66cc9640 1 -- 172.21.15.114:0/334297586 shutdown_connections 2023-11-04T01:39:37.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.828+0000 7ffb66cc9640 1 -- 172.21.15.114:0/334297586 wait complete. 2023-11-04T01:39:37.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.829+0000 7ffb66cc9640 1 Processor -- start 2023-11-04T01:39:37.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.829+0000 7ffb66cc9640 1 -- start start 2023-11-04T01:39:37.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb66cc9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffb600b42c0 0x7ffb6014d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb66cc9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb600c9c40 0x7ffb600a7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb66cc9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb6015ad80 0x7ffb600aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb66cc9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb600c7960 con 0x7ffb600c9c40 2023-11-04T01:39:37.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb66cc9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb600c6ce0 con 0x7ffb600b42c0 2023-11-04T01:39:37.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb66cc9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb600c6fc0 con 0x7ffb6015ad80 2023-11-04T01:39:37.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb5ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb600c9c40 0x7ffb600a7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb5ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb600c9c40 0x7ffb600a7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55010/0 (socket says 172.21.15.114:55010) 2023-11-04T01:39:37.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb5ffff640 1 -- 172.21.15.114:0/763822656 learned_addr learned my addr 172.21.15.114:0/763822656 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:37.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb64a65640 1 --2- 172.21.15.114:0/763822656 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffb600b42c0 0x7ffb6014d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb65266640 1 --2- 172.21.15.114:0/763822656 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb6015ad80 0x7ffb600aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb5ffff640 1 -- 172.21.15.114:0/763822656 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb6015ad80 msgr2=0x7ffb600aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb5ffff640 1 --2- 172.21.15.114:0/763822656 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb6015ad80 0x7ffb600aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb5ffff640 1 -- 172.21.15.114:0/763822656 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffb600b42c0 msgr2=0x7ffb6014d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:37.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb5ffff640 1 --2- 172.21.15.114:0/763822656 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffb600b42c0 0x7ffb6014d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:37.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb5ffff640 1 -- 172.21.15.114:0/763822656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb54009400 con 0x7ffb600c9c40 2023-11-04T01:39:37.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.830+0000 7ffb64a65640 1 --2- 172.21.15.114:0/763822656 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffb600b42c0 0x7ffb6014d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:37.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.831+0000 7ffb5ffff640 1 --2- 172.21.15.114:0/763822656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb600c9c40 0x7ffb600a7f70 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009890 tx=0x7ffb540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:37.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.831+0000 7ffb5d7fa640 1 -- 172.21.15.114:0/763822656 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5403f070 con 0x7ffb600c9c40 2023-11-04T01:39:37.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.831+0000 7ffb5d7fa640 1 -- 172.21.15.114:0/763822656 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb54006e10 con 0x7ffb600c9c40 2023-11-04T01:39:37.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.831+0000 7ffb66cc9640 1 -- 172.21.15.114:0/763822656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb600c72a0 con 0x7ffb600c9c40 2023-11-04T01:39:37.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.831+0000 7ffb5d7fa640 1 -- 172.21.15.114:0/763822656 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb54004270 con 0x7ffb600c9c40 2023-11-04T01:39:37.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.831+0000 7ffb66cc9640 1 -- 172.21.15.114:0/763822656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6014dc80 con 0x7ffb600c9c40 2023-11-04T01:39:37.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.832+0000 7ffb66cc9640 1 -- 172.21.15.114:0/763822656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb600c7aa0 con 0x7ffb600c9c40 2023-11-04T01:39:37.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.832+0000 7ffb5d7fa640 1 -- 172.21.15.114:0/763822656 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb54043070 con 0x7ffb600c9c40 2023-11-04T01:39:37.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.832+0000 7ffb5d7fa640 1 --2- 172.21.15.114:0/763822656 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ffb4c06ae70 0x7ffb4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:37.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.832+0000 7ffb5d7fa640 1 -- 172.21.15.114:0/763822656 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7ffb540ab980 con 0x7ffb600c9c40 2023-11-04T01:39:37.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.833+0000 7ffb64a65640 1 --2- 172.21.15.114:0/763822656 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ffb4c06ae70 0x7ffb4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.833+0000 7ffb64a65640 1 --2- 172.21.15.114:0/763822656 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ffb4c06ae70 0x7ffb4c06d330 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ffb50000f60 tx=0x7ffb50007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:37.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:37.837+0000 7ffb5d7fa640 1 -- 172.21.15.114:0/763822656 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb54076520 con 0x7ffb600c9c40 2023-11-04T01:39:38.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.037+0000 7ffb66cc9640 1 -- 172.21.15.114:0/763822656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb60074290 con 0x7ffb600c9c40 2023-11-04T01:39:38.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.037+0000 7ffb5d7fa640 1 -- 172.21.15.114:0/763822656 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4924 (secure 0 0 0) 0x7ffb54079b40 con 0x7ffb600c9c40 2023-11-04T01:39:38.039 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:38.039 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6055,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/775121992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":775121992},{"type":"v1","addr":"172.21.15.141:6835","nonce":775121992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6951,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1790830778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1790830778},{"type":"v1","addr":"172.21.15.114:6836","nonce":1790830778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6954,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2482757978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2482757978},{"type":"v1","addr":"172.21.15.114:6837","nonce":2482757978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:22.003461+0000","modified":"2023-11-04T01:39:31.088794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6966":{"gid":6966,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6834/1471552462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1471552462},{"type":"v1","addr":"172.21.15.141:6834","nonce":1471552462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:39:38.040 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 37 2023-11-04T01:39:38.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.039+0000 7ffb66cc9640 1 -- 172.21.15.114:0/763822656 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ffb4c06ae70 msgr2=0x7ffb4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.039+0000 7ffb66cc9640 1 --2- 172.21.15.114:0/763822656 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ffb4c06ae70 0x7ffb4c06d330 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ffb50000f60 tx=0x7ffb50007c10 comp rx=0 tx=0).stop 2023-11-04T01:39:38.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.039+0000 7ffb66cc9640 1 -- 172.21.15.114:0/763822656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb600c9c40 msgr2=0x7ffb600a7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.039+0000 7ffb66cc9640 1 --2- 172.21.15.114:0/763822656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb600c9c40 0x7ffb600a7f70 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009890 tx=0x7ffb540046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.039+0000 7ffb66cc9640 1 -- 172.21.15.114:0/763822656 shutdown_connections 2023-11-04T01:39:38.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.039+0000 7ffb66cc9640 1 --2- 172.21.15.114:0/763822656 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ffb6015ad80 0x7ffb600aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.039+0000 7ffb66cc9640 1 --2- 172.21.15.114:0/763822656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb600c9c40 0x7ffb600a7f70 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.039+0000 7ffb66cc9640 1 --2- 172.21.15.114:0/763822656 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ffb4c06ae70 0x7ffb4c06d330 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.039+0000 7ffb66cc9640 1 --2- 172.21.15.114:0/763822656 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ffb600b42c0 0x7ffb6014d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.039+0000 7ffb66cc9640 1 -- 172.21.15.114:0/763822656 >> 172.21.15.114:0/763822656 conn(0x7ffb600ce950 msgr2=0x7ffb600ae060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:38.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.039+0000 7ffb66cc9640 1 -- 172.21.15.114:0/763822656 shutdown_connections 2023-11-04T01:39:38.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.039+0000 7ffb66cc9640 1 -- 172.21.15.114:0/763822656 wait complete. 2023-11-04T01:39:38.052 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:38.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.149+0000 7f0de5f16640 1 Processor -- start 2023-11-04T01:39:38.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.149+0000 7f0de5f16640 1 -- start start 2023-11-04T01:39:38.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.150+0000 7f0de5f16640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0de00cbf10 0x7f0de0165b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.150+0000 7f0de5f16640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de0070930 con 0x7f0de0070370 2023-11-04T01:39:38.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.150+0000 7f0de5f16640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de0070c10 con 0x7f0de015e3c0 2023-11-04T01:39:38.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.150+0000 7f0de5f16640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de0070ef0 con 0x7f0de00cbf10 2023-11-04T01:39:38.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.150+0000 7f0ddeffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0de0070370 0x7f0de00cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41486/0 (socket says 172.21.15.114:41486) 2023-11-04T01:39:38.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.150+0000 7f0ddeffd640 1 -- 172.21.15.114:0/3493375429 learned_addr learned my addr 172.21.15.114:0/3493375429 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:38.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.150+0000 7f0ddffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0de00cbf10 0x7f0de0165b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.150+0000 7f0ddffff640 1 -- 172.21.15.114:0/3493375429 >> v1:172.21.15.141:6789/0 conn(0x7f0de015e3c0 legacy=0x7f0de00b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:38.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.150+0000 7f0ddffff640 1 -- 172.21.15.114:0/3493375429 >> v1:172.21.15.114:6789/0 conn(0x7f0de0070370 legacy=0x7f0de00cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.150+0000 7f0dde7fc640 1 -- 172.21.15.114:0/3493375429 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378986815 0 0) 0x7f0de0070930 con 0x7f0de0070370 2023-11-04T01:39:38.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.150+0000 7f0ddffff640 1 -- 172.21.15.114:0/3493375429 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de00711d0 con 0x7f0de00cbf10 2023-11-04T01:39:38.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.151+0000 7f0ddffff640 1 --2- 172.21.15.114:0/3493375429 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de00cbf10 0x7f0de0165b70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009d90 tx=0x7f0dd802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ded02aaaee10940 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:38.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.151+0000 7f0dde7fc640 1 -- 172.21.15.114:0/3493375429 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd802cbd0 con 0x7f0de00cbf10 2023-11-04T01:39:38.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.151+0000 7f0dde7fc640 1 -- 172.21.15.114:0/3493375429 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd802cd30 con 0x7f0de00cbf10 2023-11-04T01:39:38.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.151+0000 7f0dde7fc640 1 -- 172.21.15.114:0/3493375429 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd802cea0 con 0x7f0de00cbf10 2023-11-04T01:39:38.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.151+0000 7f0de5f16640 1 -- 172.21.15.114:0/3493375429 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de00cbf10 msgr2=0x7f0de0165b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.151+0000 7f0de5f16640 1 --2- 172.21.15.114:0/3493375429 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de00cbf10 0x7f0de0165b70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009d90 tx=0x7f0dd802be20 comp rx=0 tx=0).stop 2023-11-04T01:39:38.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.151+0000 7f0de5f16640 1 -- 172.21.15.114:0/3493375429 shutdown_connections 2023-11-04T01:39:38.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.151+0000 7f0de5f16640 1 --2- 172.21.15.114:0/3493375429 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de00cbf10 0x7f0de0165b70 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.151+0000 7f0de5f16640 1 -- 172.21.15.114:0/3493375429 >> 172.21.15.114:0/3493375429 conn(0x7f0de00d0b50 msgr2=0x7f0de00d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:38.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.152+0000 7f0de5f16640 1 -- 172.21.15.114:0/3493375429 shutdown_connections 2023-11-04T01:39:38.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.152+0000 7f0de5f16640 1 -- 172.21.15.114:0/3493375429 wait complete. 2023-11-04T01:39:38.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.153+0000 7f0de5f16640 1 Processor -- start 2023-11-04T01:39:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.153+0000 7f0de5f16640 1 -- start start 2023-11-04T01:39:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.153+0000 7f0de5f16640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de0070370 0x7f0de0157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.153+0000 7f0de5f16640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0de00cbf10 0x7f0de0156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.153+0000 7f0de5f16640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0de01f3b70 0x7f0de01f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.153+0000 7f0de5f16640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de01f4560 con 0x7f0de0070370 2023-11-04T01:39:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.153+0000 7f0de5f16640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de0152c70 con 0x7f0de01f3b70 2023-11-04T01:39:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.153+0000 7f0de5f16640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de0151930 con 0x7f0de00cbf10 2023-11-04T01:39:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0ddf7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de0070370 0x7f0de0157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0ddf7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de0070370 0x7f0de0157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55030/0 (socket says 172.21.15.114:55030) 2023-11-04T01:39:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0ddf7fe640 1 -- 172.21.15.114:0/523293638 learned_addr learned my addr 172.21.15.114:0/523293638 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0ddffff640 1 --2- 172.21.15.114:0/523293638 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0de01f3b70 0x7f0de01f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0ddeffd640 1 --2- 172.21.15.114:0/523293638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0de00cbf10 0x7f0de0156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0ddf7fe640 1 -- 172.21.15.114:0/523293638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0de00cbf10 msgr2=0x7f0de0156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0ddf7fe640 1 --2- 172.21.15.114:0/523293638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0de00cbf10 0x7f0de0156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0ddf7fe640 1 -- 172.21.15.114:0/523293638 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0de01f3b70 msgr2=0x7f0de01f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0ddf7fe640 1 --2- 172.21.15.114:0/523293638 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0de01f3b70 0x7f0de01f4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0ddf7fe640 1 -- 172.21.15.114:0/523293638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd8009a70 con 0x7f0de0070370 2023-11-04T01:39:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0ddeffd640 1 --2- 172.21.15.114:0/523293638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0de00cbf10 0x7f0de0156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0ddf7fe640 1 --2- 172.21.15.114:0/523293638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de0070370 0x7f0de0157250 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000b420 tx=0x7f0dd000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0dc7fff640 1 -- 172.21.15.114:0/523293638 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0011830 con 0x7f0de0070370 2023-11-04T01:39:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0dc7fff640 1 -- 172.21.15.114:0/523293638 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd0011990 con 0x7f0de0070370 2023-11-04T01:39:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0dc7fff640 1 -- 172.21.15.114:0/523293638 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0011d40 con 0x7f0de0070370 2023-11-04T01:39:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0de5f16640 1 -- 172.21.15.114:0/523293638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de0151bd0 con 0x7f0de0070370 2023-11-04T01:39:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.154+0000 7f0de5f16640 1 -- 172.21.15.114:0/523293638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de0152190 con 0x7f0de0070370 2023-11-04T01:39:38.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.155+0000 7f0de5f16640 1 -- 172.21.15.114:0/523293638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de0074290 con 0x7f0de0070370 2023-11-04T01:39:38.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.155+0000 7f0dc7fff640 1 -- 172.21.15.114:0/523293638 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0dd001b460 con 0x7f0de0070370 2023-11-04T01:39:38.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.156+0000 7f0dc7fff640 1 --2- 172.21.15.114:0/523293638 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0dcc06aea0 0x7f0dcc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.156+0000 7f0ddeffd640 1 --2- 172.21.15.114:0/523293638 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0dcc06aea0 0x7f0dcc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.156+0000 7f0dc7fff640 1 -- 172.21.15.114:0/523293638 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f0dd0089680 con 0x7f0de0070370 2023-11-04T01:39:38.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.156+0000 7f0ddeffd640 1 --2- 172.21.15.114:0/523293638 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0dcc06aea0 0x7f0dcc06d360 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0de00ca7b0 tx=0x7f0dd4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:38.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.160+0000 7f0dc7fff640 1 -- 172.21.15.114:0/523293638 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0dd0054220 con 0x7f0de0070370 2023-11-04T01:39:38.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.359+0000 7f0de5f16640 1 -- 172.21.15.114:0/523293638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0de00ce790 con 0x7f0de0070370 2023-11-04T01:39:38.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.359+0000 7f0dc7fff640 1 -- 172.21.15.114:0/523293638 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4924 (secure 0 0 0) 0x7f0dd0057840 con 0x7f0de0070370 2023-11-04T01:39:38.361 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:38.361 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6055,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/775121992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":775121992},{"type":"v1","addr":"172.21.15.141:6835","nonce":775121992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6951,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1790830778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1790830778},{"type":"v1","addr":"172.21.15.114:6836","nonce":1790830778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6954,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2482757978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2482757978},{"type":"v1","addr":"172.21.15.114:6837","nonce":2482757978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:22.003461+0000","modified":"2023-11-04T01:39:31.088794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6966":{"gid":6966,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.141:6834/1471552462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1471552462},{"type":"v1","addr":"172.21.15.141:6834","nonce":1471552462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:39:38.362 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 37 2023-11-04T01:39:38.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.361+0000 7f0de5f16640 1 -- 172.21.15.114:0/523293638 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0dcc06aea0 msgr2=0x7f0dcc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.361+0000 7f0de5f16640 1 --2- 172.21.15.114:0/523293638 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0dcc06aea0 0x7f0dcc06d360 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0de00ca7b0 tx=0x7f0dd4009040 comp rx=0 tx=0).stop 2023-11-04T01:39:38.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.361+0000 7f0de5f16640 1 -- 172.21.15.114:0/523293638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de0070370 msgr2=0x7f0de0157250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.361+0000 7f0de5f16640 1 --2- 172.21.15.114:0/523293638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de0070370 0x7f0de0157250 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000b420 tx=0x7f0dd000b8e0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.361+0000 7f0de5f16640 1 -- 172.21.15.114:0/523293638 shutdown_connections 2023-11-04T01:39:38.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.361+0000 7f0de5f16640 1 --2- 172.21.15.114:0/523293638 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0dcc06aea0 0x7f0dcc06d360 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.361+0000 7f0de5f16640 1 --2- 172.21.15.114:0/523293638 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0de01f3b70 0x7f0de01f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.361+0000 7f0de5f16640 1 --2- 172.21.15.114:0/523293638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0de00cbf10 0x7f0de0156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.361+0000 7f0de5f16640 1 --2- 172.21.15.114:0/523293638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de0070370 0x7f0de0157250 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.361+0000 7f0de5f16640 1 -- 172.21.15.114:0/523293638 >> 172.21.15.114:0/523293638 conn(0x7f0de00d0b50 msgr2=0x7f0de0158500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:38.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.361+0000 7f0de5f16640 1 -- 172.21.15.114:0/523293638 shutdown_connections 2023-11-04T01:39:38.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.361+0000 7f0de5f16640 1 -- 172.21.15.114:0/523293638 wait complete. 2023-11-04T01:39:38.374 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:38.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.472+0000 7f45bae7c640 1 Processor -- start 2023-11-04T01:39:38.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.472+0000 7f45bae7c640 1 -- start start 2023-11-04T01:39:38.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45bae7c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f45b415cfd0 0x7f45b40b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45bae7c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b40714b0 con 0x7f45b4070e90 2023-11-04T01:39:38.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45bae7c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b4071790 con 0x7f45b40b0910 2023-11-04T01:39:38.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45bae7c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b40ab8e0 con 0x7f45b415cfd0 2023-11-04T01:39:38.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b9419640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f45b4070e90 0x7f45b406ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41494/0 (socket says 172.21.15.114:41494) 2023-11-04T01:39:38.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b9419640 1 -- 172.21.15.114:0/4086537582 learned_addr learned my addr 172.21.15.114:0/4086537582 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:38.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b37fe640 1 -- 172.21.15.114:0/4086537582 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538326896 0 0) 0x7f45b40714b0 con 0x7f45b4070e90 2023-11-04T01:39:38.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b8c18640 1 --2- 172.21.15.114:0/4086537582 >> v2:172.21.15.141:3300/0 conn(0x7f45b415cfd0 0x7f45b40b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b37fe640 1 -- 172.21.15.114:0/4086537582 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a4003520 con 0x7f45b4070e90 2023-11-04T01:39:38.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b37fe640 1 -- 172.21.15.114:0/4086537582 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1442671878 0 0) 0x7f45a4003520 con 0x7f45b4070e90 2023-11-04T01:39:38.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b37fe640 1 -- 172.21.15.114:0/4086537582 >> v2:172.21.15.141:3300/0 conn(0x7f45b415cfd0 msgr2=0x7f45b40b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:38.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b37fe640 1 --2- 172.21.15.114:0/4086537582 >> v2:172.21.15.141:3300/0 conn(0x7f45b415cfd0 0x7f45b40b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b37fe640 1 -- 172.21.15.114:0/4086537582 >> v1:172.21.15.141:6789/0 conn(0x7f45b40b0910 legacy=0x7f45b4070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b37fe640 1 -- 172.21.15.114:0/4086537582 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b406c690 con 0x7f45b4070e90 2023-11-04T01:39:38.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b37fe640 1 -- 172.21.15.114:0/4086537582 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f45ac0019f0 con 0x7f45b4070e90 2023-11-04T01:39:38.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b37fe640 1 -- 172.21.15.114:0/4086537582 >> v1:172.21.15.114:6789/0 conn(0x7f45b4070e90 legacy=0x7f45b406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b37fe640 1 --2- 172.21.15.114:0/4086537582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45a4003970 0x7f45a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b37fe640 1 --2- 172.21.15.114:0/4086537582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45a40047c0 0x7f45a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b37fe640 1 --2- 172.21.15.114:0/4086537582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a4005180 0x7f45a400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b37fe640 1 -- 172.21.15.114:0/4086537582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a400bff0 con 0x7f45a4005180 2023-11-04T01:39:38.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b37fe640 1 -- 172.21.15.114:0/4086537582 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a400c160 con 0x7f45a4003970 2023-11-04T01:39:38.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.473+0000 7f45b37fe640 1 -- 172.21.15.114:0/4086537582 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a400c320 con 0x7f45a40047c0 2023-11-04T01:39:38.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.474+0000 7f45b9419640 1 --2- 172.21.15.114:0/4086537582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a4005180 0x7f45a400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.474+0000 7f45b8c18640 1 --2- 172.21.15.114:0/4086537582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45a4003970 0x7f45a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.474+0000 7f45b3fff640 1 --2- 172.21.15.114:0/4086537582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45a40047c0 0x7f45a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.474+0000 7f45b9419640 1 -- 172.21.15.114:0/4086537582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45a40047c0 msgr2=0x7f45a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:38.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.474+0000 7f45b9419640 1 --2- 172.21.15.114:0/4086537582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45a40047c0 0x7f45a4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.474+0000 7f45b9419640 1 -- 172.21.15.114:0/4086537582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45a4003970 msgr2=0x7f45a4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:38.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.474+0000 7f45b9419640 1 --2- 172.21.15.114:0/4086537582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45a4003970 0x7f45a4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.474+0000 7f45b9419640 1 -- 172.21.15.114:0/4086537582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a4003520 con 0x7f45a4005180 2023-11-04T01:39:38.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.474+0000 7f45b8c18640 1 --2- 172.21.15.114:0/4086537582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45a4003970 0x7f45a4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:38.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.474+0000 7f45b9419640 1 -- 172.21.15.114:0/4086537582 reap_dead start 2023-11-04T01:39:38.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.475+0000 7f45b9419640 1 --2- 172.21.15.114:0/4086537582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a4005180 0x7f45a400b980 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00a830 tx=0x7f45a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85289cb545f03f73 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:38.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.475+0000 7f45b37fe640 1 -- 172.21.15.114:0/4086537582 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac0072d0 con 0x7f45a4005180 2023-11-04T01:39:38.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.475+0000 7f45b37fe640 1 -- 172.21.15.114:0/4086537582 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac02f070 con 0x7f45a4005180 2023-11-04T01:39:38.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.475+0000 7f45b37fe640 1 -- 172.21.15.114:0/4086537582 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac007690 con 0x7f45a4005180 2023-11-04T01:39:38.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.475+0000 7f45bae7c640 1 -- 172.21.15.114:0/4086537582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a4005180 msgr2=0x7f45a400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.475+0000 7f45bae7c640 1 --2- 172.21.15.114:0/4086537582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a4005180 0x7f45a400b980 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00a830 tx=0x7f45a40057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.475+0000 7f45bae7c640 1 -- 172.21.15.114:0/4086537582 shutdown_connections 2023-11-04T01:39:38.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.475+0000 7f45bae7c640 1 --2- 172.21.15.114:0/4086537582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a4005180 0x7f45a400b980 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.475+0000 7f45bae7c640 1 -- 172.21.15.114:0/4086537582 >> 172.21.15.114:0/4086537582 conn(0x7f45b40ce950 msgr2=0x7f45b40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:38.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.475+0000 7f45bae7c640 1 -- 172.21.15.114:0/4086537582 shutdown_connections 2023-11-04T01:39:38.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.475+0000 7f45bae7c640 1 -- 172.21.15.114:0/4086537582 wait complete. 2023-11-04T01:39:38.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.476+0000 7f45bae7c640 1 Processor -- start 2023-11-04T01:39:38.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.476+0000 7f45bae7c640 1 -- start start 2023-11-04T01:39:38.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.477+0000 7f45bae7c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a4005180 0x7f45b41f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.477+0000 7f45bae7c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45b40cbd80 0x7f45b40c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.477+0000 7f45bae7c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45b40c7ee0 0x7f45b40c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.477+0000 7f45bae7c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b40c8370 con 0x7f45a4005180 2023-11-04T01:39:38.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.477+0000 7f45bae7c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b41f6770 con 0x7f45b40c7ee0 2023-11-04T01:39:38.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.477+0000 7f45bae7c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b41f6a50 con 0x7f45b40cbd80 2023-11-04T01:39:38.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.477+0000 7f45b8c18640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a4005180 0x7f45b41f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.477+0000 7f45b8c18640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a4005180 0x7f45b41f5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55044/0 (socket says 172.21.15.114:55044) 2023-11-04T01:39:38.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.477+0000 7f45b8c18640 1 -- 172.21.15.114:0/3036059311 learned_addr learned my addr 172.21.15.114:0/3036059311 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:38.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.478+0000 7f45b3fff640 1 --2- 172.21.15.114:0/3036059311 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45b40cbd80 0x7f45b40c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.478+0000 7f45b8c18640 1 -- 172.21.15.114:0/3036059311 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45b40cbd80 msgr2=0x7f45b40c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.478+0000 7f45b8c18640 1 --2- 172.21.15.114:0/3036059311 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45b40cbd80 0x7f45b40c79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.478+0000 7f45b8c18640 1 -- 172.21.15.114:0/3036059311 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45b40c7ee0 msgr2=0x7f45b40c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.478+0000 7f45b8c18640 1 --2- 172.21.15.114:0/3036059311 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45b40c7ee0 0x7f45b40c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.478+0000 7f45b8c18640 1 -- 172.21.15.114:0/3036059311 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b41f6d30 con 0x7f45a4005180 2023-11-04T01:39:38.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.478+0000 7f45b8c18640 1 --2- 172.21.15.114:0/3036059311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a4005180 0x7f45b41f5e70 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f45a8011a70 tx=0x7f45a8011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:38.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.478+0000 7f45b17fa640 1 -- 172.21.15.114:0/3036059311 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a800fbb0 con 0x7f45a4005180 2023-11-04T01:39:38.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.478+0000 7f45b17fa640 1 -- 172.21.15.114:0/3036059311 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a800fd10 con 0x7f45a4005180 2023-11-04T01:39:38.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.478+0000 7f45bae7c640 1 -- 172.21.15.114:0/3036059311 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b40c96c0 con 0x7f45a4005180 2023-11-04T01:39:38.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.478+0000 7f45b17fa640 1 -- 172.21.15.114:0/3036059311 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a8014640 con 0x7f45a4005180 2023-11-04T01:39:38.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.478+0000 7f45bae7c640 1 -- 172.21.15.114:0/3036059311 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b41f63b0 con 0x7f45a4005180 2023-11-04T01:39:38.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.479+0000 7f45bae7c640 1 -- 172.21.15.114:0/3036059311 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b4066b00 con 0x7f45a4005180 2023-11-04T01:39:38.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.479+0000 7f45b17fa640 1 -- 172.21.15.114:0/3036059311 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f45a80147a0 con 0x7f45a4005180 2023-11-04T01:39:38.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.480+0000 7f45b17fa640 1 --2- 172.21.15.114:0/3036059311 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f459806aea0 0x7f459806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.480+0000 7f45b17fa640 1 -- 172.21.15.114:0/3036059311 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f45a808a4f0 con 0x7f45a4005180 2023-11-04T01:39:38.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.480+0000 7f45b3fff640 1 --2- 172.21.15.114:0/3036059311 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f459806aea0 0x7f459806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.480+0000 7f45b3fff640 1 --2- 172.21.15.114:0/3036059311 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f459806aea0 0x7f459806d360 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f45a0000c00 tx=0x7f45a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:38.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.484+0000 7f45b17fa640 1 -- 172.21.15.114:0/3036059311 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f45a8055090 con 0x7f45a4005180 2023-11-04T01:39:38.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.651+0000 7f45bae7c640 1 -- 172.21.15.114:0/3036059311 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45b4074290 con 0x7f45a4005180 2023-11-04T01:39:38.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.652+0000 7f45b17fa640 1 -- 172.21.15.114:0/3036059311 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22123 (secure 0 0 0) 0x7f45a80586b0 con 0x7f45a4005180 2023-11-04T01:39:38.654 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:38.655 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":84,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:36.716982+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:20.107188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:20.970024+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":84,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:38.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.654+0000 7f45bae7c640 1 -- 172.21.15.114:0/3036059311 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f459806aea0 msgr2=0x7f459806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.654+0000 7f45bae7c640 1 --2- 172.21.15.114:0/3036059311 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f459806aea0 0x7f459806d360 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f45a0000c00 tx=0x7f45a0009040 comp rx=0 tx=0).stop 2023-11-04T01:39:38.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.654+0000 7f45bae7c640 1 -- 172.21.15.114:0/3036059311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a4005180 msgr2=0x7f45b41f5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.654+0000 7f45bae7c640 1 --2- 172.21.15.114:0/3036059311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a4005180 0x7f45b41f5e70 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f45a8011a70 tx=0x7f45a8011f30 comp rx=0 tx=0).stop 2023-11-04T01:39:38.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.654+0000 7f45bae7c640 1 -- 172.21.15.114:0/3036059311 shutdown_connections 2023-11-04T01:39:38.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.654+0000 7f45bae7c640 1 --2- 172.21.15.114:0/3036059311 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f459806aea0 0x7f459806d360 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.654+0000 7f45bae7c640 1 --2- 172.21.15.114:0/3036059311 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45b40c7ee0 0x7f45b40c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.654+0000 7f45bae7c640 1 --2- 172.21.15.114:0/3036059311 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45b40cbd80 0x7f45b40c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.654+0000 7f45bae7c640 1 --2- 172.21.15.114:0/3036059311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45a4005180 0x7f45b41f5e70 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.654+0000 7f45bae7c640 1 -- 172.21.15.114:0/3036059311 >> 172.21.15.114:0/3036059311 conn(0x7f45b40ce950 msgr2=0x7f45b415be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:38.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.655+0000 7f45bae7c640 1 -- 172.21.15.114:0/3036059311 shutdown_connections 2023-11-04T01:39:38.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.655+0000 7f45bae7c640 1 -- 172.21.15.114:0/3036059311 wait complete. 2023-11-04T01:39:38.668 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:39:38.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.768+0000 7fec69dc9640 1 Processor -- start 2023-11-04T01:39:38.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.768+0000 7fec69dc9640 1 -- start start 2023-11-04T01:39:38.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.768+0000 7fec69dc9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec6415b120 0x7fec6406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.768+0000 7fec69dc9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec64065df0 con 0x7fec6415ad40 2023-11-04T01:39:38.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.768+0000 7fec69dc9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec64066040 con 0x7fec640c9b60 2023-11-04T01:39:38.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.768+0000 7fec69dc9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6406bc40 con 0x7fec6415b120 2023-11-04T01:39:38.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec637fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fec6415ad40 0x7fec6415f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41502/0 (socket says 172.21.15.114:41502) 2023-11-04T01:39:38.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec637fe640 1 -- 172.21.15.114:0/444151533 learned_addr learned my addr 172.21.15.114:0/444151533 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:38.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec62ffd640 1 --2- 172.21.15.114:0/444151533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec6415b120 0x7fec6406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec627fc640 1 -- 172.21.15.114:0/444151533 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129376746 0 0) 0x7fec64065df0 con 0x7fec6415ad40 2023-11-04T01:39:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec627fc640 1 -- 172.21.15.114:0/444151533 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec4c003520 con 0x7fec6415ad40 2023-11-04T01:39:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec627fc640 1 -- 172.21.15.114:0/444151533 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1157291616 0 0) 0x7fec4c003520 con 0x7fec6415ad40 2023-11-04T01:39:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec627fc640 1 -- 172.21.15.114:0/444151533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec6415b120 msgr2=0x7fec6406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec627fc640 1 --2- 172.21.15.114:0/444151533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec6415b120 0x7fec6406b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec627fc640 1 -- 172.21.15.114:0/444151533 >> v1:172.21.15.141:6789/0 conn(0x7fec640c9b60 legacy=0x7fec64070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec627fc640 1 -- 172.21.15.114:0/444151533 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec64066320 con 0x7fec6415ad40 2023-11-04T01:39:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec627fc640 1 -- 172.21.15.114:0/444151533 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fec54001670 con 0x7fec6415ad40 2023-11-04T01:39:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec627fc640 1 -- 172.21.15.114:0/444151533 >> v1:172.21.15.114:6789/0 conn(0x7fec6415ad40 legacy=0x7fec6415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec627fc640 1 --2- 172.21.15.114:0/444151533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec4c0039a0 0x7fec4c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec627fc640 1 --2- 172.21.15.114:0/444151533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4c0047c0 0x7fec4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec627fc640 1 --2- 172.21.15.114:0/444151533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec6415b120 0x7fec4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec627fc640 1 -- 172.21.15.114:0/444151533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6406bc40 con 0x7fec4c0047c0 2023-11-04T01:39:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec627fc640 1 -- 172.21.15.114:0/444151533 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c00ba30 con 0x7fec4c0039a0 2023-11-04T01:39:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec627fc640 1 -- 172.21.15.114:0/444151533 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c00bbf0 con 0x7fec6415b120 2023-11-04T01:39:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec62ffd640 1 --2- 172.21.15.114:0/444151533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4c0047c0 0x7fec4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec637fe640 1 --2- 172.21.15.114:0/444151533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec4c0039a0 0x7fec4c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.769+0000 7fec63fff640 1 --2- 172.21.15.114:0/444151533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec6415b120 0x7fec4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.770+0000 7fec62ffd640 1 -- 172.21.15.114:0/444151533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec6415b120 msgr2=0x7fec4c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.770+0000 7fec62ffd640 1 --2- 172.21.15.114:0/444151533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec6415b120 0x7fec4c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.770+0000 7fec62ffd640 1 -- 172.21.15.114:0/444151533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec4c0039a0 msgr2=0x7fec4c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.770+0000 7fec62ffd640 1 --2- 172.21.15.114:0/444151533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec4c0039a0 0x7fec4c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.770+0000 7fec62ffd640 1 -- 172.21.15.114:0/444151533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c003520 con 0x7fec4c0047c0 2023-11-04T01:39:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.770+0000 7fec63fff640 1 --2- 172.21.15.114:0/444151533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec6415b120 0x7fec4c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.770+0000 7fec637fe640 1 --2- 172.21.15.114:0/444151533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec4c0039a0 0x7fec4c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:38.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.770+0000 7fec62ffd640 1 --2- 172.21.15.114:0/444151533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4c0047c0 0x7fec4c004c40 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fec6415b500 tx=0x7fec4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276a007b22e3c048 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:38.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.770+0000 7fec627fc640 1 -- 172.21.15.114:0/444151533 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5802c630 con 0x7fec4c0047c0 2023-11-04T01:39:38.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.770+0000 7fec627fc640 1 -- 172.21.15.114:0/444151533 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5802c790 con 0x7fec4c0047c0 2023-11-04T01:39:38.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.770+0000 7fec627fc640 1 -- 172.21.15.114:0/444151533 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5802cb20 con 0x7fec4c0047c0 2023-11-04T01:39:38.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.771+0000 7fec69dc9640 1 -- 172.21.15.114:0/444151533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4c0047c0 msgr2=0x7fec4c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.771+0000 7fec69dc9640 1 --2- 172.21.15.114:0/444151533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4c0047c0 0x7fec4c004c40 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fec6415b500 tx=0x7fec4c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.771+0000 7fec63fff640 1 -- 172.21.15.114:0/444151533 reap_dead start 2023-11-04T01:39:38.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.771+0000 7fec69dc9640 1 -- 172.21.15.114:0/444151533 shutdown_connections 2023-11-04T01:39:38.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.771+0000 7fec69dc9640 1 -- 172.21.15.114:0/444151533 >> 172.21.15.114:0/444151533 conn(0x7fec640cbc90 msgr2=0x7fec640cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:38.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.771+0000 7fec69dc9640 1 -- 172.21.15.114:0/444151533 shutdown_connections 2023-11-04T01:39:38.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.771+0000 7fec69dc9640 1 -- 172.21.15.114:0/444151533 wait complete. 2023-11-04T01:39:38.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.772+0000 7fec69dc9640 1 Processor -- start 2023-11-04T01:39:38.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.772+0000 7fec69dc9640 1 -- start start 2023-11-04T01:39:38.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec69dc9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4c0047c0 0x7fec641552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec69dc9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec64155900 0x7fec64154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec69dc9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec640ce050 0x7fec641e6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec69dc9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec640c6db0 con 0x7fec4c0047c0 2023-11-04T01:39:38.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec69dc9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec64155060 con 0x7fec640ce050 2023-11-04T01:39:38.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec69dc9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec640c6480 con 0x7fec64155900 2023-11-04T01:39:38.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec637fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4c0047c0 0x7fec641552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec637fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4c0047c0 0x7fec641552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55058/0 (socket says 172.21.15.114:55058) 2023-11-04T01:39:38.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec637fe640 1 -- 172.21.15.114:0/897339628 learned_addr learned my addr 172.21.15.114:0/897339628 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:38.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec62ffd640 1 --2- 172.21.15.114:0/897339628 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec64155900 0x7fec64154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec63fff640 1 --2- 172.21.15.114:0/897339628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec640ce050 0x7fec641e6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec637fe640 1 -- 172.21.15.114:0/897339628 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec64155900 msgr2=0x7fec64154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec637fe640 1 --2- 172.21.15.114:0/897339628 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec64155900 0x7fec64154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec637fe640 1 -- 172.21.15.114:0/897339628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec640ce050 msgr2=0x7fec641e6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec637fe640 1 --2- 172.21.15.114:0/897339628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec640ce050 0x7fec641e6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec637fe640 1 -- 172.21.15.114:0/897339628 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec640c6760 con 0x7fec4c0047c0 2023-11-04T01:39:38.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec63fff640 1 --2- 172.21.15.114:0/897339628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec640ce050 0x7fec641e6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:38.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.773+0000 7fec637fe640 1 --2- 172.21.15.114:0/897339628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4c0047c0 0x7fec641552b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fec54000f60 tx=0x7fec5400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:38.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.774+0000 7fec4bfff640 1 -- 172.21.15.114:0/897339628 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400c8d0 con 0x7fec4c0047c0 2023-11-04T01:39:38.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.774+0000 7fec4bfff640 1 -- 172.21.15.114:0/897339628 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5400ca30 con 0x7fec4c0047c0 2023-11-04T01:39:38.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.774+0000 7fec4bfff640 1 -- 172.21.15.114:0/897339628 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400cda0 con 0x7fec4c0047c0 2023-11-04T01:39:38.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.774+0000 7fec69dc9640 1 -- 172.21.15.114:0/897339628 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec640c6a40 con 0x7fec4c0047c0 2023-11-04T01:39:38.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.774+0000 7fec69dc9640 1 -- 172.21.15.114:0/897339628 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec640c7420 con 0x7fec4c0047c0 2023-11-04T01:39:38.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.775+0000 7fec69dc9640 1 -- 172.21.15.114:0/897339628 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec640c7670 con 0x7fec4c0047c0 2023-11-04T01:39:38.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.775+0000 7fec4bfff640 1 -- 172.21.15.114:0/897339628 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fec5401d460 con 0x7fec4c0047c0 2023-11-04T01:39:38.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.775+0000 7fec4bfff640 1 --2- 172.21.15.114:0/897339628 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec5006ae70 0x7fec5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.775+0000 7fec62ffd640 1 --2- 172.21.15.114:0/897339628 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec5006ae70 0x7fec5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.775+0000 7fec4bfff640 1 -- 172.21.15.114:0/897339628 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fec54089ba0 con 0x7fec4c0047c0 2023-11-04T01:39:38.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.776+0000 7fec62ffd640 1 --2- 172.21.15.114:0/897339628 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec5006ae70 0x7fec5006d330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fec58036000 tx=0x7fec58030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:38.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.779+0000 7fec4bfff640 1 -- 172.21.15.114:0/897339628 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fec540546b0 con 0x7fec4c0047c0 2023-11-04T01:39:38.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.979+0000 7fec69dc9640 1 -- 172.21.15.114:0/897339628 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fec64074290 con 0x7fec4c0047c0 2023-11-04T01:39:38.982 INFO:tasks.ceph.mon.a.smithi114.stderr:2023-11-04T01:39:38.979+0000 7f5b24eb8640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:39:38.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.983+0000 7fec4bfff640 1 -- 172.21.15.114:0/897339628 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7fec54057cd0 con 0x7fec4c0047c0 2023-11-04T01:39:38.985 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:39:38.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.985+0000 7fec69dc9640 1 -- 172.21.15.114:0/897339628 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec5006ae70 msgr2=0x7fec5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.985+0000 7fec69dc9640 1 --2- 172.21.15.114:0/897339628 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec5006ae70 0x7fec5006d330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fec58036000 tx=0x7fec58030000 comp rx=0 tx=0).stop 2023-11-04T01:39:38.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.985+0000 7fec69dc9640 1 -- 172.21.15.114:0/897339628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4c0047c0 msgr2=0x7fec641552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.985+0000 7fec69dc9640 1 --2- 172.21.15.114:0/897339628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4c0047c0 0x7fec641552b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fec54000f60 tx=0x7fec5400ed30 comp rx=0 tx=0).stop 2023-11-04T01:39:38.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.985+0000 7fec69dc9640 1 -- 172.21.15.114:0/897339628 shutdown_connections 2023-11-04T01:39:38.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.985+0000 7fec69dc9640 1 --2- 172.21.15.114:0/897339628 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fec5006ae70 0x7fec5006d330 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.985+0000 7fec69dc9640 1 --2- 172.21.15.114:0/897339628 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fec640ce050 0x7fec641e6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.985+0000 7fec69dc9640 1 --2- 172.21.15.114:0/897339628 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fec64155900 0x7fec64154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.985+0000 7fec69dc9640 1 --2- 172.21.15.114:0/897339628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4c0047c0 0x7fec641552b0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.985+0000 7fec69dc9640 1 -- 172.21.15.114:0/897339628 >> 172.21.15.114:0/897339628 conn(0x7fec640cbc90 msgr2=0x7fec640ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:38.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.985+0000 7fec69dc9640 1 -- 172.21.15.114:0/897339628 shutdown_connections 2023-11-04T01:39:38.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:38.985+0000 7fec69dc9640 1 -- 172.21.15.114:0/897339628 wait complete. 2023-11-04T01:39:38.990 INFO:tasks.ceph.mds.b.smithi141.stderr: -2670> 2023-11-04T01:39:26.909+0000 7fa794174640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:39:38.999 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:39:39.019 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-04T01:39:39.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.099+0000 7f76422c2640 1 Processor -- start 2023-11-04T01:39:39.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.099+0000 7f76422c2640 1 -- start start 2023-11-04T01:39:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.099+0000 7f76422c2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f763c0cd6d0 0x7f763c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.099+0000 7f76422c2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f763c0b4880 0x7f763c0b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.099+0000 7f76422c2640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763c0cde60 con 0x7f763c153e60 2023-11-04T01:39:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.099+0000 7f76422c2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763c160f90 con 0x7f763c0b4880 2023-11-04T01:39:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.099+0000 7f76422c2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0b51e0 con 0x7f763c0cd6d0 2023-11-04T01:39:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.100+0000 7f764085f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f763c0b4880 0x7f763c0b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.100+0000 7f764085f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f763c0b4880 0x7f763c0b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55060/0 (socket says 172.21.15.114:55060) 2023-11-04T01:39:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.100+0000 7f764085f640 1 -- 172.21.15.114:0/328030731 learned_addr learned my addr 172.21.15.114:0/328030731 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.100+0000 7f763b7fe640 1 --2- 172.21.15.114:0/328030731 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f763c0cd6d0 0x7f763c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.100+0000 7f764085f640 1 -- 172.21.15.114:0/328030731 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f763c0cd6d0 msgr2=0x7f763c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.100+0000 7f764085f640 1 --2- 172.21.15.114:0/328030731 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f763c0cd6d0 0x7f763c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.100+0000 7f764085f640 1 -- 172.21.15.114:0/328030731 >> v1:172.21.15.141:6789/0 conn(0x7f763c153e60 legacy=0x7f763c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:39.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.100+0000 7f764085f640 1 -- 172.21.15.114:0/328030731 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c161960 con 0x7f763c0b4880 2023-11-04T01:39:39.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.101+0000 7f764085f640 1 --2- 172.21.15.114:0/328030731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f763c0b4880 0x7f763c0b4ca0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f7634009e50 tx=0x7f763402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7beacac4f9358e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:39.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.101+0000 7f763affd640 1 -- 172.21.15.114:0/328030731 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763402cb00 con 0x7f763c0b4880 2023-11-04T01:39:39.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.101+0000 7f763affd640 1 -- 172.21.15.114:0/328030731 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763402cc60 con 0x7f763c0b4880 2023-11-04T01:39:39.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.101+0000 7f763affd640 1 -- 172.21.15.114:0/328030731 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76340343f0 con 0x7f763c0b4880 2023-11-04T01:39:39.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.101+0000 7f76422c2640 1 -- 172.21.15.114:0/328030731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f763c0b4880 msgr2=0x7f763c0b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:39.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.101+0000 7f76422c2640 1 --2- 172.21.15.114:0/328030731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f763c0b4880 0x7f763c0b4ca0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f7634009e50 tx=0x7f763402bf60 comp rx=0 tx=0).stop 2023-11-04T01:39:39.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.101+0000 7f76422c2640 1 -- 172.21.15.114:0/328030731 shutdown_connections 2023-11-04T01:39:39.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.101+0000 7f76422c2640 1 --2- 172.21.15.114:0/328030731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f763c0b4880 0x7f763c0b4ca0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.101+0000 7f76422c2640 1 --2- 172.21.15.114:0/328030731 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f763c0cd6d0 0x7f763c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.101+0000 7f76422c2640 1 -- 172.21.15.114:0/328030731 >> 172.21.15.114:0/328030731 conn(0x7f763c0cf880 msgr2=0x7f763c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:39.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.101+0000 7f76422c2640 1 -- 172.21.15.114:0/328030731 shutdown_connections 2023-11-04T01:39:39.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.101+0000 7f76422c2640 1 -- 172.21.15.114:0/328030731 wait complete. 2023-11-04T01:39:39.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.102+0000 7f76422c2640 1 Processor -- start 2023-11-04T01:39:39.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.103+0000 7f76422c2640 1 -- start start 2023-11-04T01:39:39.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.103+0000 7f76422c2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f763c0b4880 0x7f763c14fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:39.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.103+0000 7f76422c2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f763c0cd6d0 0x7f763c1f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.103+0000 7f76422c2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f763c153e60 0x7f763c0cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.103+0000 7f76422c2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0c7cd0 con 0x7f763c0cd6d0 2023-11-04T01:39:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.103+0000 7f76422c2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0ca410 con 0x7f763c153e60 2023-11-04T01:39:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.103+0000 7f76422c2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0ca680 con 0x7f763c0b4880 2023-11-04T01:39:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.103+0000 7f763b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f763c0cd6d0 0x7f763c1f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.103+0000 7f763b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f763c0cd6d0 0x7f763c1f2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55070/0 (socket says 172.21.15.114:55070) 2023-11-04T01:39:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.103+0000 7f763b7fe640 1 -- 172.21.15.114:0/1307071865 learned_addr learned my addr 172.21.15.114:0/1307071865 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.104+0000 7f764085f640 1 --2- 172.21.15.114:0/1307071865 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f763c153e60 0x7f763c0cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.104+0000 7f763bfff640 1 --2- 172.21.15.114:0/1307071865 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f763c0b4880 0x7f763c14fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.104+0000 7f763b7fe640 1 -- 172.21.15.114:0/1307071865 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f763c0b4880 msgr2=0x7f763c14fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.104+0000 7f763b7fe640 1 --2- 172.21.15.114:0/1307071865 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f763c0b4880 0x7f763c14fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.104+0000 7f763b7fe640 1 -- 172.21.15.114:0/1307071865 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f763c153e60 msgr2=0x7f763c0cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.104+0000 7f763b7fe640 1 --2- 172.21.15.114:0/1307071865 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f763c153e60 0x7f763c0cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.104+0000 7f763b7fe640 1 -- 172.21.15.114:0/1307071865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7634009b30 con 0x7f763c0cd6d0 2023-11-04T01:39:39.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.104+0000 7f763b7fe640 1 --2- 172.21.15.114:0/1307071865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f763c0cd6d0 0x7f763c1f2af0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f763000d800 tx=0x7f763000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:39.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.104+0000 7f7638ff9640 1 -- 172.21.15.114:0/1307071865 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763000b6c0 con 0x7f763c0cd6d0 2023-11-04T01:39:39.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.104+0000 7f7638ff9640 1 -- 172.21.15.114:0/1307071865 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763000b820 con 0x7f763c0cd6d0 2023-11-04T01:39:39.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.104+0000 7f76422c2640 1 -- 172.21.15.114:0/1307071865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763c0ca960 con 0x7f763c0cd6d0 2023-11-04T01:39:39.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.104+0000 7f7638ff9640 1 -- 172.21.15.114:0/1307071865 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763000bbb0 con 0x7f763c0cd6d0 2023-11-04T01:39:39.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.104+0000 7f76422c2640 1 -- 172.21.15.114:0/1307071865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763c0caf20 con 0x7f763c0cd6d0 2023-11-04T01:39:39.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.105+0000 7f76422c2640 1 -- 172.21.15.114:0/1307071865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763c0cb0e0 con 0x7f763c0cd6d0 2023-11-04T01:39:39.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.105+0000 7f7638ff9640 1 -- 172.21.15.114:0/1307071865 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f763000bd10 con 0x7f763c0cd6d0 2023-11-04T01:39:39.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.106+0000 7f7638ff9640 1 --2- 172.21.15.114:0/1307071865 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f762806aea0 0x7f762806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:39.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.106+0000 7f7638ff9640 1 -- 172.21.15.114:0/1307071865 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f7630089f60 con 0x7f763c0cd6d0 2023-11-04T01:39:39.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.106+0000 7f763bfff640 1 --2- 172.21.15.114:0/1307071865 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f762806aea0 0x7f762806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:39.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.106+0000 7f763bfff640 1 --2- 172.21.15.114:0/1307071865 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f762806aea0 0x7f762806d360 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f762c000f60 tx=0x7f762c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:39.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.110+0000 7f7638ff9640 1 -- 172.21.15.114:0/1307071865 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7630054ae0 con 0x7f763c0cd6d0 2023-11-04T01:39:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.311+0000 7f76422c2640 1 -- 172.21.15.114:0/1307071865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f763c074290 con 0x7f763c0cd6d0 2023-11-04T01:39:39.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.987+0000 7f7638ff9640 1 -- 172.21.15.114:0/1307071865 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7630058100 con 0x7f763c0cd6d0 2023-11-04T01:39:39.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.989+0000 7f76422c2640 1 -- 172.21.15.114:0/1307071865 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f762806aea0 msgr2=0x7f762806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:39.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.989+0000 7f76422c2640 1 --2- 172.21.15.114:0/1307071865 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f762806aea0 0x7f762806d360 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f762c000f60 tx=0x7f762c009040 comp rx=0 tx=0).stop 2023-11-04T01:39:39.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.989+0000 7f76422c2640 1 -- 172.21.15.114:0/1307071865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f763c0cd6d0 msgr2=0x7f763c1f2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:39.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.989+0000 7f76422c2640 1 --2- 172.21.15.114:0/1307071865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f763c0cd6d0 0x7f763c1f2af0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f763000d800 tx=0x7f763000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.989+0000 7f76422c2640 1 -- 172.21.15.114:0/1307071865 shutdown_connections 2023-11-04T01:39:39.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.989+0000 7f76422c2640 1 --2- 172.21.15.114:0/1307071865 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f762806aea0 0x7f762806d360 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.989+0000 7f76422c2640 1 --2- 172.21.15.114:0/1307071865 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f763c153e60 0x7f763c0cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.989+0000 7f76422c2640 1 --2- 172.21.15.114:0/1307071865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f763c0cd6d0 0x7f763c1f2af0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.989+0000 7f76422c2640 1 --2- 172.21.15.114:0/1307071865 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f763c0b4880 0x7f763c14fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:39.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.989+0000 7f76422c2640 1 -- 172.21.15.114:0/1307071865 >> 172.21.15.114:0/1307071865 conn(0x7f763c0cf880 msgr2=0x7f763c15fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:39.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.989+0000 7f76422c2640 1 -- 172.21.15.114:0/1307071865 shutdown_connections 2023-11-04T01:39:39.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:39.989+0000 7f76422c2640 1 -- 172.21.15.114:0/1307071865 wait complete. 2023-11-04T01:39:40.003 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:39:40.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.106+0000 7f4bb74c2640 1 Processor -- start 2023-11-04T01:39:40.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.106+0000 7f4bb74c2640 1 -- start start 2023-11-04T01:39:40.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.107+0000 7f4bb74c2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4bb0159be0 0x7f4bb00c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.107+0000 7f4bb74c2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4bb00ade40 0x7f4bb00c3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.107+0000 7f4bb74c2640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb00c5890 con 0x7f4bb015e420 2023-11-04T01:39:40.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.107+0000 7f4bb74c2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb00cd8e0 con 0x7f4bb00ade40 2023-11-04T01:39:40.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.107+0000 7f4bb74c2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb00cdbc0 con 0x7f4bb0159be0 2023-11-04T01:39:40.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.107+0000 7f4bb5a5f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4bb00ade40 0x7f4bb00c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.107+0000 7f4bb5a5f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4bb00ade40 0x7f4bb00c3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55074/0 (socket says 172.21.15.114:55074) 2023-11-04T01:39:40.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.107+0000 7f4bb5a5f640 1 -- 172.21.15.114:0/1546328784 learned_addr learned my addr 172.21.15.114:0/1546328784 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:40.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.107+0000 7f4bb525e640 1 --2- 172.21.15.114:0/1546328784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4bb0159be0 0x7f4bb00c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.107+0000 7f4bb5a5f640 1 -- 172.21.15.114:0/1546328784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4bb0159be0 msgr2=0x7f4bb00c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:40.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.107+0000 7f4bb5a5f640 1 --2- 172.21.15.114:0/1546328784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4bb0159be0 0x7f4bb00c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.107+0000 7f4bb5a5f640 1 -- 172.21.15.114:0/1546328784 >> v1:172.21.15.141:6789/0 conn(0x7f4bb015e420 legacy=0x7f4bb00ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:40.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.107+0000 7f4bb5a5f640 1 -- 172.21.15.114:0/1546328784 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb00cdea0 con 0x7f4bb00ade40 2023-11-04T01:39:40.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.108+0000 7f4bb5a5f640 1 --2- 172.21.15.114:0/1546328784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bb00ade40 0x7f4bb00c3840 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800bb10 tx=0x7f4ba802e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa3e2eef081393f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:40.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.108+0000 7f4ba7fff640 1 -- 172.21.15.114:0/1546328784 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba802ede0 con 0x7f4bb00ade40 2023-11-04T01:39:40.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.108+0000 7f4ba7fff640 1 -- 172.21.15.114:0/1546328784 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba8036440 con 0x7f4bb00ade40 2023-11-04T01:39:40.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.108+0000 7f4ba7fff640 1 -- 172.21.15.114:0/1546328784 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba80367d0 con 0x7f4bb00ade40 2023-11-04T01:39:40.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.109+0000 7f4bb74c2640 1 -- 172.21.15.114:0/1546328784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bb00ade40 msgr2=0x7f4bb00c3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.109+0000 7f4bb74c2640 1 --2- 172.21.15.114:0/1546328784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bb00ade40 0x7f4bb00c3840 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800bb10 tx=0x7f4ba802e030 comp rx=0 tx=0).stop 2023-11-04T01:39:40.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.109+0000 7f4bb74c2640 1 -- 172.21.15.114:0/1546328784 shutdown_connections 2023-11-04T01:39:40.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.109+0000 7f4bb74c2640 1 --2- 172.21.15.114:0/1546328784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bb00ade40 0x7f4bb00c3840 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.109+0000 7f4bb74c2640 1 --2- 172.21.15.114:0/1546328784 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4bb0159be0 0x7f4bb00c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.109+0000 7f4bb74c2640 1 -- 172.21.15.114:0/1546328784 >> 172.21.15.114:0/1546328784 conn(0x7f4bb00b05d0 msgr2=0x7f4bb00b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:40.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.109+0000 7f4bb74c2640 1 -- 172.21.15.114:0/1546328784 shutdown_connections 2023-11-04T01:39:40.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.109+0000 7f4bb74c2640 1 -- 172.21.15.114:0/1546328784 wait complete. 2023-11-04T01:39:40.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.110+0000 7f4bb74c2640 1 Processor -- start 2023-11-04T01:39:40.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.110+0000 7f4bb74c2640 1 -- start start 2023-11-04T01:39:40.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb74c2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4bb00ade40 0x7f4bb0140500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb74c2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bb0159be0 0x7f4bb006d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb74c2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4bb015e420 0x7f4bb006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb74c2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb014f750 con 0x7f4bb0159be0 2023-11-04T01:39:40.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb74c2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb014fa30 con 0x7f4bb015e420 2023-11-04T01:39:40.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb74c2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb014fd10 con 0x7f4bb00ade40 2023-11-04T01:39:40.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb4a5d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bb0159be0 0x7f4bb006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb4a5d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bb0159be0 0x7f4bb006d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55078/0 (socket says 172.21.15.114:55078) 2023-11-04T01:39:40.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb4a5d640 1 -- 172.21.15.114:0/3409546488 learned_addr learned my addr 172.21.15.114:0/3409546488 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:40.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb525e640 1 --2- 172.21.15.114:0/3409546488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4bb00ade40 0x7f4bb0140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb5a5f640 1 --2- 172.21.15.114:0/3409546488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4bb015e420 0x7f4bb006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb4a5d640 1 -- 172.21.15.114:0/3409546488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4bb00ade40 msgr2=0x7f4bb0140500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb4a5d640 1 --2- 172.21.15.114:0/3409546488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4bb00ade40 0x7f4bb0140500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb4a5d640 1 -- 172.21.15.114:0/3409546488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4bb015e420 msgr2=0x7f4bb006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb4a5d640 1 --2- 172.21.15.114:0/3409546488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4bb015e420 0x7f4bb006d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb4a5d640 1 -- 172.21.15.114:0/3409546488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba800b770 con 0x7f4bb0159be0 2023-11-04T01:39:40.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb525e640 1 --2- 172.21.15.114:0/3409546488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4bb00ade40 0x7f4bb0140500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:40.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb4a5d640 1 --2- 172.21.15.114:0/3409546488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bb0159be0 0x7f4bb006d290 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000b3c0 tx=0x7f4ba000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:40.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4ba5ffb640 1 -- 172.21.15.114:0/3409546488 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0011830 con 0x7f4bb0159be0 2023-11-04T01:39:40.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4ba5ffb640 1 -- 172.21.15.114:0/3409546488 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba0011990 con 0x7f4bb0159be0 2023-11-04T01:39:40.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4bb74c2640 1 -- 172.21.15.114:0/3409546488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb014fff0 con 0x7f4bb0159be0 2023-11-04T01:39:40.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.111+0000 7f4ba5ffb640 1 -- 172.21.15.114:0/3409546488 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0011d80 con 0x7f4bb0159be0 2023-11-04T01:39:40.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.112+0000 7f4bb74c2640 1 -- 172.21.15.114:0/3409546488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb014f400 con 0x7f4bb0159be0 2023-11-04T01:39:40.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.113+0000 7f4bb74c2640 1 -- 172.21.15.114:0/3409546488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb0150510 con 0x7f4bb0159be0 2023-11-04T01:39:40.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.113+0000 7f4ba5ffb640 1 -- 172.21.15.114:0/3409546488 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ba001b460 con 0x7f4bb0159be0 2023-11-04T01:39:40.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.113+0000 7f4ba5ffb640 1 --2- 172.21.15.114:0/3409546488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4b9406ae70 0x7f4b9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.113+0000 7f4ba5ffb640 1 -- 172.21.15.114:0/3409546488 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f4ba00896f0 con 0x7f4bb0159be0 2023-11-04T01:39:40.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.114+0000 7f4bb525e640 1 --2- 172.21.15.114:0/3409546488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4b9406ae70 0x7f4b9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.114+0000 7f4bb525e640 1 --2- 172.21.15.114:0/3409546488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4b9406ae70 0x7f4b9406d330 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4bac009b20 tx=0x7f4bac0039d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:40.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.118+0000 7f4ba5ffb640 1 -- 172.21.15.114:0/3409546488 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4bb0150510 con 0x7f4bb0159be0 2023-11-04T01:39:40.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.285+0000 7f4bb74c2640 1 -- 172.21.15.114:0/3409546488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4bb0150510 con 0x7f4bb0159be0 2023-11-04T01:39:40.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.989+0000 7f4ba5ffb640 1 -- 172.21.15.114:0/3409546488 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4bb0150510 con 0x7f4bb0159be0 2023-11-04T01:39:40.991 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:39:40.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.992+0000 7f4bb74c2640 1 -- 172.21.15.114:0/3409546488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4b9406ae70 msgr2=0x7f4b9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.992+0000 7f4bb74c2640 1 --2- 172.21.15.114:0/3409546488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4b9406ae70 0x7f4b9406d330 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4bac009b20 tx=0x7f4bac0039d0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.992+0000 7f4bb74c2640 1 -- 172.21.15.114:0/3409546488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bb0159be0 msgr2=0x7f4bb006d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.992+0000 7f4bb74c2640 1 --2- 172.21.15.114:0/3409546488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bb0159be0 0x7f4bb006d290 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000b3c0 tx=0x7f4ba000b880 comp rx=0 tx=0).stop 2023-11-04T01:39:40.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.992+0000 7f4bb74c2640 1 -- 172.21.15.114:0/3409546488 shutdown_connections 2023-11-04T01:39:40.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.992+0000 7f4bb74c2640 1 --2- 172.21.15.114:0/3409546488 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4b9406ae70 0x7f4b9406d330 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.992+0000 7f4bb74c2640 1 --2- 172.21.15.114:0/3409546488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4bb015e420 0x7f4bb006d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.992+0000 7f4bb74c2640 1 --2- 172.21.15.114:0/3409546488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bb0159be0 0x7f4bb006d290 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.992+0000 7f4bb74c2640 1 --2- 172.21.15.114:0/3409546488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4bb00ade40 0x7f4bb0140500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.992+0000 7f4bb74c2640 1 -- 172.21.15.114:0/3409546488 >> 172.21.15.114:0/3409546488 conn(0x7f4bb00b05d0 msgr2=0x7f4bb00b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:40.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.992+0000 7f4bb74c2640 1 -- 172.21.15.114:0/3409546488 shutdown_connections 2023-11-04T01:39:40.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:40.992+0000 7f4bb74c2640 1 -- 172.21.15.114:0/3409546488 wait complete. 2023-11-04T01:39:41.007 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:39:41.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.114+0000 7f70ba9dc640 1 Processor -- start 2023-11-04T01:39:41.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.114+0000 7f70ba9dc640 1 -- start start 2023-11-04T01:39:41.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.115+0000 7f70ba9dc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70b4159be0 0x7f70b40c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.115+0000 7f70ba9dc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f70b415e420 0x7f70b40ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.115+0000 7f70ba9dc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b40c4850 con 0x7f70b40adc70 2023-11-04T01:39:41.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.115+0000 7f70ba9dc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b40ae0e0 con 0x7f70b4159be0 2023-11-04T01:39:41.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.115+0000 7f70ba9dc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b40c5890 con 0x7f70b415e420 2023-11-04T01:39:41.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.115+0000 7f70b3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70b4159be0 0x7f70b40c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.115+0000 7f70b8f79640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f70b40adc70 0x7f70b40cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41512/0 (socket says 172.21.15.114:41512) 2023-11-04T01:39:41.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.115+0000 7f70b3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70b4159be0 0x7f70b40c4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55090/0 (socket says 172.21.15.114:55090) 2023-11-04T01:39:41.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.115+0000 7f70b8f79640 1 -- 172.21.15.114:0/282066138 learned_addr learned my addr 172.21.15.114:0/282066138 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:41.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.115+0000 7f70b37fe640 1 --2- 172.21.15.114:0/282066138 >> v2:172.21.15.141:3300/0 conn(0x7f70b415e420 0x7f70b40ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.115+0000 7f70b3fff640 1 -- 172.21.15.114:0/282066138 >> v2:172.21.15.141:3300/0 conn(0x7f70b415e420 msgr2=0x7f70b40ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:41.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.115+0000 7f70b3fff640 1 --2- 172.21.15.114:0/282066138 >> v2:172.21.15.141:3300/0 conn(0x7f70b415e420 0x7f70b40ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.115+0000 7f70b3fff640 1 -- 172.21.15.114:0/282066138 >> v1:172.21.15.114:6789/0 conn(0x7f70b40adc70 legacy=0x7f70b40cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.115+0000 7f70b2ffd640 1 -- 172.21.15.114:0/282066138 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186495618 0 0) 0x7f70b40c4850 con 0x7f70b40adc70 2023-11-04T01:39:41.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.115+0000 7f70b3fff640 1 -- 172.21.15.114:0/282066138 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b40cd8e0 con 0x7f70b4159be0 2023-11-04T01:39:41.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.115+0000 7f70b37fe640 1 --2- 172.21.15.114:0/282066138 >> v2:172.21.15.141:3300/0 conn(0x7f70b415e420 0x7f70b40ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:41.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.116+0000 7f70b3fff640 1 --2- 172.21.15.114:0/282066138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b4159be0 0x7f70b40c4f60 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f70b40b1690 tx=0x7f70a402e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fe637af673c75c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:41.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.116+0000 7f70b2ffd640 1 -- 172.21.15.114:0/282066138 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a402edc0 con 0x7f70b4159be0 2023-11-04T01:39:41.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.116+0000 7f70b2ffd640 1 -- 172.21.15.114:0/282066138 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a4036440 con 0x7f70b4159be0 2023-11-04T01:39:41.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.116+0000 7f70b2ffd640 1 -- 172.21.15.114:0/282066138 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a40367d0 con 0x7f70b4159be0 2023-11-04T01:39:41.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.117+0000 7f70ba9dc640 1 -- 172.21.15.114:0/282066138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b4159be0 msgr2=0x7f70b40c4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.117+0000 7f70ba9dc640 1 --2- 172.21.15.114:0/282066138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b4159be0 0x7f70b40c4f60 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f70b40b1690 tx=0x7f70a402e010 comp rx=0 tx=0).stop 2023-11-04T01:39:41.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.117+0000 7f70ba9dc640 1 -- 172.21.15.114:0/282066138 shutdown_connections 2023-11-04T01:39:41.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.117+0000 7f70ba9dc640 1 --2- 172.21.15.114:0/282066138 >> v2:172.21.15.141:3300/0 conn(0x7f70b415e420 0x7f70b40ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.117+0000 7f70ba9dc640 1 --2- 172.21.15.114:0/282066138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b4159be0 0x7f70b40c4f60 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.117+0000 7f70ba9dc640 1 -- 172.21.15.114:0/282066138 >> 172.21.15.114:0/282066138 conn(0x7f70b40b05d0 msgr2=0x7f70b40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:41.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.117+0000 7f70ba9dc640 1 -- 172.21.15.114:0/282066138 shutdown_connections 2023-11-04T01:39:41.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.117+0000 7f70ba9dc640 1 -- 172.21.15.114:0/282066138 wait complete. 2023-11-04T01:39:41.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.118+0000 7f70ba9dc640 1 Processor -- start 2023-11-04T01:39:41.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.118+0000 7f70ba9dc640 1 -- start start 2023-11-04T01:39:41.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70ba9dc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70b40adc70 0x7f70b415c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70ba9dc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70b4159be0 0x7f70b40ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70ba9dc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b415e420 0x7f70b40c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70ba9dc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b41ee480 con 0x7f70b415e420 2023-11-04T01:39:41.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70ba9dc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b40cacd0 con 0x7f70b40adc70 2023-11-04T01:39:41.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70ba9dc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b41ee290 con 0x7f70b4159be0 2023-11-04T01:39:41.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70b8f79640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b415e420 0x7f70b40c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70b8f79640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b415e420 0x7f70b40c5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55092/0 (socket says 172.21.15.114:55092) 2023-11-04T01:39:41.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70b8f79640 1 -- 172.21.15.114:0/2707825527 learned_addr learned my addr 172.21.15.114:0/2707825527 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:41.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70b3fff640 1 --2- 172.21.15.114:0/2707825527 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70b40adc70 0x7f70b415c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70b8f79640 1 -- 172.21.15.114:0/2707825527 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70b4159be0 msgr2=0x7f70b40ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70b8f79640 1 --2- 172.21.15.114:0/2707825527 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70b4159be0 0x7f70b40ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70b8f79640 1 -- 172.21.15.114:0/2707825527 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70b40adc70 msgr2=0x7f70b415c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70b8f79640 1 --2- 172.21.15.114:0/2707825527 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70b40adc70 0x7f70b415c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70b8f79640 1 -- 172.21.15.114:0/2707825527 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a400b6a0 con 0x7f70b415e420 2023-11-04T01:39:41.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70b3fff640 1 --2- 172.21.15.114:0/2707825527 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70b40adc70 0x7f70b415c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:41.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70b8f79640 1 --2- 172.21.15.114:0/2707825527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b415e420 0x7f70b40c5a90 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00c780 tx=0x7f70ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:41.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.119+0000 7f70b0ff9640 1 -- 172.21.15.114:0/2707825527 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac00ce90 con 0x7f70b415e420 2023-11-04T01:39:41.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.120+0000 7f70b0ff9640 1 -- 172.21.15.114:0/2707825527 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac00a640 con 0x7f70b415e420 2023-11-04T01:39:41.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.120+0000 7f70ba9dc640 1 -- 172.21.15.114:0/2707825527 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b40c5fd0 con 0x7f70b415e420 2023-11-04T01:39:41.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.120+0000 7f70b0ff9640 1 -- 172.21.15.114:0/2707825527 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac00a9d0 con 0x7f70b415e420 2023-11-04T01:39:41.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.120+0000 7f70ba9dc640 1 -- 172.21.15.114:0/2707825527 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b40cb1c0 con 0x7f70b415e420 2023-11-04T01:39:41.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.120+0000 7f70ba9dc640 1 -- 172.21.15.114:0/2707825527 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b41ee5c0 con 0x7f70b415e420 2023-11-04T01:39:41.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.121+0000 7f70b0ff9640 1 -- 172.21.15.114:0/2707825527 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70ac00ab30 con 0x7f70b415e420 2023-11-04T01:39:41.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.121+0000 7f70b0ff9640 1 --2- 172.21.15.114:0/2707825527 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70a006ae70 0x7f70a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.121+0000 7f70b0ff9640 1 -- 172.21.15.114:0/2707825527 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6768+0+0 (secure 0 0 0) 0x7f70ac089180 con 0x7f70b415e420 2023-11-04T01:39:41.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.121+0000 7f70b3fff640 1 --2- 172.21.15.114:0/2707825527 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70a006ae70 0x7f70a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.122+0000 7f70b3fff640 1 --2- 172.21.15.114:0/2707825527 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70a006ae70 0x7f70a006d330 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f70a4038000 tx=0x7f70a4032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:41.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.126+0000 7f70b0ff9640 1 -- 172.21.15.114:0/2707825527 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f70b41ee5c0 con 0x7f70b415e420 2023-11-04T01:39:41.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.293+0000 7f70ba9dc640 1 -- 172.21.15.114:0/2707825527 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f70b41ee5c0 con 0x7f70b415e420 2023-11-04T01:39:41.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.994+0000 7f70b0ff9640 1 -- 172.21.15.114:0/2707825527 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) v1 ==== 169+0+0 (secure 0 0 0) 0x7f70b41ee5c0 con 0x7f70b415e420 2023-11-04T01:39:41.996 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2023-11-04T01:39:41.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.996+0000 7f70ba9dc640 1 -- 172.21.15.114:0/2707825527 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70a006ae70 msgr2=0x7f70a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.996+0000 7f70ba9dc640 1 --2- 172.21.15.114:0/2707825527 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70a006ae70 0x7f70a006d330 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f70a4038000 tx=0x7f70a4032000 comp rx=0 tx=0).stop 2023-11-04T01:39:41.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.996+0000 7f70ba9dc640 1 -- 172.21.15.114:0/2707825527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b415e420 msgr2=0x7f70b40c5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.996+0000 7f70ba9dc640 1 --2- 172.21.15.114:0/2707825527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b415e420 0x7f70b40c5a90 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00c780 tx=0x7f70ac00cc40 comp rx=0 tx=0).stop 2023-11-04T01:39:41.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.996+0000 7f70ba9dc640 1 -- 172.21.15.114:0/2707825527 shutdown_connections 2023-11-04T01:39:41.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.996+0000 7f70ba9dc640 1 --2- 172.21.15.114:0/2707825527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b415e420 0x7f70b40c5a90 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.996+0000 7f70ba9dc640 1 --2- 172.21.15.114:0/2707825527 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f70b4159be0 0x7f70b40ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.996+0000 7f70ba9dc640 1 --2- 172.21.15.114:0/2707825527 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70a006ae70 0x7f70a006d330 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.996+0000 7f70ba9dc640 1 --2- 172.21.15.114:0/2707825527 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f70b40adc70 0x7f70b415c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.996+0000 7f70ba9dc640 1 -- 172.21.15.114:0/2707825527 >> 172.21.15.114:0/2707825527 conn(0x7f70b40b05d0 msgr2=0x7f70b4153880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:41.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.997+0000 7f70ba9dc640 1 -- 172.21.15.114:0/2707825527 shutdown_connections 2023-11-04T01:39:41.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:41.997+0000 7f70ba9dc640 1 -- 172.21.15.114:0/2707825527 wait complete. 2023-11-04T01:39:42.011 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:39:42.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.111+0000 7fcc17032640 1 Processor -- start 2023-11-04T01:39:42.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.111+0000 7fcc17032640 1 -- start start 2023-11-04T01:39:42.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc17032640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fcc100ae1d0 0x7fcc100cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc17032640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1015aff0 con 0x7fcc100c4ff0 2023-11-04T01:39:42.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc17032640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1015a3e0 con 0x7fcc10159c00 2023-11-04T01:39:42.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc17032640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1015a6c0 con 0x7fcc100ae1d0 2023-11-04T01:39:42.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0ffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcc100c4ff0 0x7fcc100adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41526/0 (socket says 172.21.15.114:41526) 2023-11-04T01:39:42.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0ffff640 1 -- 172.21.15.114:0/1336922330 learned_addr learned my addr 172.21.15.114:0/1336922330 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:42.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0f7fe640 1 -- 172.21.15.114:0/1336922330 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385433630 0 0) 0x7fcc1015aff0 con 0x7fcc100c4ff0 2023-11-04T01:39:42.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0f7fe640 1 -- 172.21.15.114:0/1336922330 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc00003520 con 0x7fcc100c4ff0 2023-11-04T01:39:42.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc155cf640 1 --2- 172.21.15.114:0/1336922330 >> v2:172.21.15.141:3300/0 conn(0x7fcc100ae1d0 0x7fcc100cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0f7fe640 1 -- 172.21.15.114:0/1336922330 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3960064328 0 0) 0x7fcc00003520 con 0x7fcc100c4ff0 2023-11-04T01:39:42.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0f7fe640 1 -- 172.21.15.114:0/1336922330 >> v2:172.21.15.141:3300/0 conn(0x7fcc100ae1d0 msgr2=0x7fcc100cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:42.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0f7fe640 1 --2- 172.21.15.114:0/1336922330 >> v2:172.21.15.141:3300/0 conn(0x7fcc100ae1d0 0x7fcc100cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0f7fe640 1 -- 172.21.15.114:0/1336922330 >> v1:172.21.15.141:6789/0 conn(0x7fcc10159c00 legacy=0x7fcc100c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0f7fe640 1 -- 172.21.15.114:0/1336922330 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1015a9a0 con 0x7fcc100c4ff0 2023-11-04T01:39:42.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0f7fe640 1 -- 172.21.15.114:0/1336922330 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fcbfc001670 con 0x7fcc100c4ff0 2023-11-04T01:39:42.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc155cf640 1 --2- 172.21.15.114:0/1336922330 >> v2:172.21.15.141:3300/0 conn(0x7fcc100ae1d0 0x7fcc100cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:42.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0f7fe640 1 -- 172.21.15.114:0/1336922330 >> v1:172.21.15.114:6789/0 conn(0x7fcc100c4ff0 legacy=0x7fcc100adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0f7fe640 1 --2- 172.21.15.114:0/1336922330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc00003970 0x7fcc00003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0f7fe640 1 --2- 172.21.15.114:0/1336922330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc000047c0 0x7fcc00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0f7fe640 1 --2- 172.21.15.114:0/1336922330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc00005180 0x7fcc0000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0f7fe640 1 -- 172.21.15.114:0/1336922330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1015a6c0 con 0x7fcc000047c0 2023-11-04T01:39:42.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0f7fe640 1 -- 172.21.15.114:0/1336922330 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0000c0d0 con 0x7fcc00003970 2023-11-04T01:39:42.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.112+0000 7fcc0f7fe640 1 -- 172.21.15.114:0/1336922330 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0000c290 con 0x7fcc00005180 2023-11-04T01:39:42.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.113+0000 7fcc0ffff640 1 --2- 172.21.15.114:0/1336922330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc000047c0 0x7fcc00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.113+0000 7fcc14dce640 1 --2- 172.21.15.114:0/1336922330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc00003970 0x7fcc00003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.113+0000 7fcc155cf640 1 --2- 172.21.15.114:0/1336922330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc00005180 0x7fcc0000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.113+0000 7fcc0ffff640 1 -- 172.21.15.114:0/1336922330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc00005180 msgr2=0x7fcc0000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:42.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.113+0000 7fcc0ffff640 1 --2- 172.21.15.114:0/1336922330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc00005180 0x7fcc0000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.113+0000 7fcc0ffff640 1 -- 172.21.15.114:0/1336922330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc00003970 msgr2=0x7fcc00003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.113+0000 7fcc0ffff640 1 --2- 172.21.15.114:0/1336922330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc00003970 0x7fcc00003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.113+0000 7fcc0ffff640 1 -- 172.21.15.114:0/1336922330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc00003520 con 0x7fcc000047c0 2023-11-04T01:39:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.113+0000 7fcc155cf640 1 -- 172.21.15.114:0/1336922330 reap_dead start 2023-11-04T01:39:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.114+0000 7fcc0ffff640 1 --2- 172.21.15.114:0/1336922330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc000047c0 0x7fcc00004c40 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fcc100b4a60 tx=0x7fcc000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb7b510ccc5d20 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.114+0000 7fcc0f7fe640 1 -- 172.21.15.114:0/1336922330 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc005ad0 con 0x7fcc000047c0 2023-11-04T01:39:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.114+0000 7fcc0f7fe640 1 -- 172.21.15.114:0/1336922330 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc005c30 con 0x7fcc000047c0 2023-11-04T01:39:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.114+0000 7fcc0f7fe640 1 -- 172.21.15.114:0/1336922330 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc02c7d0 con 0x7fcc000047c0 2023-11-04T01:39:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.114+0000 7fcc17032640 1 -- 172.21.15.114:0/1336922330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc000047c0 msgr2=0x7fcc00004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.114+0000 7fcc17032640 1 --2- 172.21.15.114:0/1336922330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc000047c0 0x7fcc00004c40 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fcc100b4a60 tx=0x7fcc000057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.114+0000 7fcc17032640 1 -- 172.21.15.114:0/1336922330 shutdown_connections 2023-11-04T01:39:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.114+0000 7fcc17032640 1 --2- 172.21.15.114:0/1336922330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc000047c0 0x7fcc00004c40 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.114+0000 7fcc17032640 1 -- 172.21.15.114:0/1336922330 >> 172.21.15.114:0/1336922330 conn(0x7fcc100ce950 msgr2=0x7fcc100ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.114+0000 7fcc17032640 1 -- 172.21.15.114:0/1336922330 shutdown_connections 2023-11-04T01:39:42.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.114+0000 7fcc17032640 1 -- 172.21.15.114:0/1336922330 wait complete. 2023-11-04T01:39:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.115+0000 7fcc17032640 1 Processor -- start 2023-11-04T01:39:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.115+0000 7fcc17032640 1 -- start start 2023-11-04T01:39:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.116+0000 7fcc17032640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc000047c0 0x7fcc100c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.116+0000 7fcc17032640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1014b080 0x7fcc1014b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.116+0000 7fcc17032640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc1014a090 0x7fcc1014a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.116+0000 7fcc17032640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1014aa50 con 0x7fcc1014b080 2023-11-04T01:39:42.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.116+0000 7fcc17032640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1014c100 con 0x7fcc000047c0 2023-11-04T01:39:42.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.116+0000 7fcc17032640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1014bb40 con 0x7fcc1014a090 2023-11-04T01:39:42.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.116+0000 7fcc0ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1014b080 0x7fcc1014b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.116+0000 7fcc0ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1014b080 0x7fcc1014b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55114/0 (socket says 172.21.15.114:55114) 2023-11-04T01:39:42.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.116+0000 7fcc0ffff640 1 -- 172.21.15.114:0/710623878 learned_addr learned my addr 172.21.15.114:0/710623878 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:42.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.116+0000 7fcc14dce640 1 --2- 172.21.15.114:0/710623878 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc000047c0 0x7fcc100c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.117+0000 7fcc155cf640 1 --2- 172.21.15.114:0/710623878 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc1014a090 0x7fcc1014a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.117+0000 7fcc0ffff640 1 -- 172.21.15.114:0/710623878 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc1014a090 msgr2=0x7fcc1014a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.117+0000 7fcc0ffff640 1 --2- 172.21.15.114:0/710623878 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc1014a090 0x7fcc1014a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.117+0000 7fcc0ffff640 1 -- 172.21.15.114:0/710623878 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc000047c0 msgr2=0x7fcc100c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.117+0000 7fcc0ffff640 1 --2- 172.21.15.114:0/710623878 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc000047c0 0x7fcc100c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.117+0000 7fcc0ffff640 1 -- 172.21.15.114:0/710623878 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1014be20 con 0x7fcc1014b080 2023-11-04T01:39:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.117+0000 7fcc0ffff640 1 --2- 172.21.15.114:0/710623878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1014b080 0x7fcc1014b500 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc02c370 tx=0x7fcbfc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.117+0000 7fcc0d7fa640 1 -- 172.21.15.114:0/710623878 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc03c070 con 0x7fcc1014b080 2023-11-04T01:39:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.117+0000 7fcc0d7fa640 1 -- 172.21.15.114:0/710623878 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc02caa0 con 0x7fcc1014b080 2023-11-04T01:39:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.117+0000 7fcc0d7fa640 1 -- 172.21.15.114:0/710623878 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc02ce10 con 0x7fcc1014b080 2023-11-04T01:39:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.117+0000 7fcc17032640 1 -- 172.21.15.114:0/710623878 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc100c5ac0 con 0x7fcc1014b080 2023-11-04T01:39:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.117+0000 7fcc17032640 1 -- 172.21.15.114:0/710623878 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc10158e70 con 0x7fcc1014b080 2023-11-04T01:39:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.118+0000 7fcc17032640 1 -- 172.21.15.114:0/710623878 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc10074290 con 0x7fcc1014b080 2023-11-04T01:39:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.118+0000 7fcc0d7fa640 1 -- 172.21.15.114:0/710623878 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcbfc032070 con 0x7fcc1014b080 2023-11-04T01:39:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.119+0000 7fcc0d7fa640 1 --2- 172.21.15.114:0/710623878 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcbf406ae90 0x7fcbf406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.119+0000 7fcc14dce640 1 --2- 172.21.15.114:0/710623878 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcbf406ae90 0x7fcbf406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.119+0000 7fcc0d7fa640 1 -- 172.21.15.114:0/710623878 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fcbfc0aa430 con 0x7fcc1014b080 2023-11-04T01:39:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.119+0000 7fcc14dce640 1 --2- 172.21.15.114:0/710623878 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcbf406ae90 0x7fcbf406d350 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcc040054d0 tx=0x7fcc04009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.123+0000 7fcc0d7fa640 1 -- 172.21.15.114:0/710623878 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcbfc075250 con 0x7fcc1014b080 2023-11-04T01:39:42.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.303+0000 7fcc17032640 1 -- 172.21.15.114:0/710623878 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcc100c8c60 con 0x7fcc1014b080 2023-11-04T01:39:42.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.306+0000 7fcc0d7fa640 1 -- 172.21.15.114:0/710623878 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcbfc078870 con 0x7fcc1014b080 2023-11-04T01:39:42.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.308+0000 7fcc17032640 1 -- 172.21.15.114:0/710623878 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcbf406ae90 msgr2=0x7fcbf406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.308+0000 7fcc17032640 1 --2- 172.21.15.114:0/710623878 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcbf406ae90 0x7fcbf406d350 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcc040054d0 tx=0x7fcc04009040 comp rx=0 tx=0).stop 2023-11-04T01:39:42.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.308+0000 7fcc17032640 1 -- 172.21.15.114:0/710623878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1014b080 msgr2=0x7fcc1014b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.308+0000 7fcc17032640 1 --2- 172.21.15.114:0/710623878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1014b080 0x7fcc1014b500 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc02c370 tx=0x7fcbfc001a00 comp rx=0 tx=0).stop 2023-11-04T01:39:42.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.308+0000 7fcc17032640 1 -- 172.21.15.114:0/710623878 shutdown_connections 2023-11-04T01:39:42.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.308+0000 7fcc17032640 1 --2- 172.21.15.114:0/710623878 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fcc1014a090 0x7fcc1014a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.308+0000 7fcc17032640 1 --2- 172.21.15.114:0/710623878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc1014b080 0x7fcc1014b500 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.308+0000 7fcc17032640 1 --2- 172.21.15.114:0/710623878 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fcbf406ae90 0x7fcbf406d350 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.308+0000 7fcc17032640 1 --2- 172.21.15.114:0/710623878 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fcc000047c0 0x7fcc100c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.308+0000 7fcc17032640 1 -- 172.21.15.114:0/710623878 >> 172.21.15.114:0/710623878 conn(0x7fcc100ce950 msgr2=0x7fcc100c42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.308+0000 7fcc17032640 1 -- 172.21.15.114:0/710623878 shutdown_connections 2023-11-04T01:39:42.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.308+0000 7fcc17032640 1 -- 172.21.15.114:0/710623878 wait complete. 2023-11-04T01:39:42.321 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config' 2023-11-04T01:39:42.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.418+0000 7ff90af7c640 1 Processor -- start 2023-11-04T01:39:42.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.418+0000 7ff90af7c640 1 -- start start 2023-11-04T01:39:42.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.419+0000 7ff90af7c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff904159c70 0x7ff9040ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.419+0000 7ff90af7c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff9040b0ae0 0x7ff90415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.419+0000 7ff90af7c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9040b4110 con 0x7ff90406db20 2023-11-04T01:39:42.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.419+0000 7ff90af7c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9040b49b0 con 0x7ff904159c70 2023-11-04T01:39:42.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.419+0000 7ff90af7c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9040b43f0 con 0x7ff9040b0ae0 2023-11-04T01:39:42.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.419+0000 7ff908d18640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff904159c70 0x7ff9040ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.419+0000 7ff903fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff90406db20 0x7ff9040b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41534/0 (socket says 172.21.15.114:41534) 2023-11-04T01:39:42.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.419+0000 7ff903fff640 1 -- 172.21.15.114:0/2634872767 learned_addr learned my addr 172.21.15.114:0/2634872767 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:42.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.419+0000 7ff909519640 1 --2- 172.21.15.114:0/2634872767 >> v2:172.21.15.141:3300/0 conn(0x7ff9040b0ae0 0x7ff90415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.419+0000 7ff908d18640 1 -- 172.21.15.114:0/2634872767 >> v2:172.21.15.141:3300/0 conn(0x7ff9040b0ae0 msgr2=0x7ff90415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:42.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.419+0000 7ff908d18640 1 --2- 172.21.15.114:0/2634872767 >> v2:172.21.15.141:3300/0 conn(0x7ff9040b0ae0 0x7ff90415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.419+0000 7ff908d18640 1 -- 172.21.15.114:0/2634872767 >> v1:172.21.15.114:6789/0 conn(0x7ff90406db20 legacy=0x7ff9040b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.419+0000 7ff9037fe640 1 -- 172.21.15.114:0/2634872767 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026625386 0 0) 0x7ff9040b4110 con 0x7ff90406db20 2023-11-04T01:39:42.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.419+0000 7ff908d18640 1 -- 172.21.15.114:0/2634872767 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9040b46d0 con 0x7ff904159c70 2023-11-04T01:39:42.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.419+0000 7ff909519640 1 --2- 172.21.15.114:0/2634872767 >> v2:172.21.15.141:3300/0 conn(0x7ff9040b0ae0 0x7ff90415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:42.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.420+0000 7ff908d18640 1 --2- 172.21.15.114:0/2634872767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff904159c70 0x7ff9040ce370 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7ff9040c5910 tx=0x7ff8f402e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5fe9126600a857 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.420+0000 7ff9037fe640 1 -- 172.21.15.114:0/2634872767 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f402ee50 con 0x7ff904159c70 2023-11-04T01:39:42.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.420+0000 7ff9037fe640 1 -- 172.21.15.114:0/2634872767 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f4036440 con 0x7ff904159c70 2023-11-04T01:39:42.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.420+0000 7ff9037fe640 1 -- 172.21.15.114:0/2634872767 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f40367d0 con 0x7ff904159c70 2023-11-04T01:39:42.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.421+0000 7ff90af7c640 1 -- 172.21.15.114:0/2634872767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff904159c70 msgr2=0x7ff9040ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.421+0000 7ff90af7c640 1 --2- 172.21.15.114:0/2634872767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff904159c70 0x7ff9040ce370 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7ff9040c5910 tx=0x7ff8f402e0a0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.421+0000 7ff90af7c640 1 -- 172.21.15.114:0/2634872767 shutdown_connections 2023-11-04T01:39:42.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.421+0000 7ff90af7c640 1 --2- 172.21.15.114:0/2634872767 >> v2:172.21.15.141:3300/0 conn(0x7ff9040b0ae0 0x7ff90415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.421+0000 7ff90af7c640 1 --2- 172.21.15.114:0/2634872767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff904159c70 0x7ff9040ce370 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.421+0000 7ff90af7c640 1 -- 172.21.15.114:0/2634872767 >> 172.21.15.114:0/2634872767 conn(0x7ff9040ce950 msgr2=0x7ff9040ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.421+0000 7ff90af7c640 1 -- 172.21.15.114:0/2634872767 shutdown_connections 2023-11-04T01:39:42.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.421+0000 7ff90af7c640 1 -- 172.21.15.114:0/2634872767 wait complete. 2023-11-04T01:39:42.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.422+0000 7ff90af7c640 1 Processor -- start 2023-11-04T01:39:42.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.422+0000 7ff90af7c640 1 -- start start 2023-11-04T01:39:42.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff90af7c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff90406db20 0x7ff9041f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff90af7c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9040b0ae0 0x7ff90415c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff90af7c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff904159c70 0x7ff90415cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff90af7c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9041ef110 con 0x7ff90406db20 2023-11-04T01:39:42.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff90af7c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9041f2610 con 0x7ff9040b0ae0 2023-11-04T01:39:42.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff90af7c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff904152a20 con 0x7ff904159c70 2023-11-04T01:39:42.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff908d18640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff90406db20 0x7ff9041f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff908d18640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff90406db20 0x7ff9041f20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55130/0 (socket says 172.21.15.114:55130) 2023-11-04T01:39:42.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff908d18640 1 -- 172.21.15.114:0/3737255420 learned_addr learned my addr 172.21.15.114:0/3737255420 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:42.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff903fff640 1 --2- 172.21.15.114:0/3737255420 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9040b0ae0 0x7ff90415c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff909519640 1 --2- 172.21.15.114:0/3737255420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff904159c70 0x7ff90415cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff908d18640 1 -- 172.21.15.114:0/3737255420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff904159c70 msgr2=0x7ff90415cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff908d18640 1 --2- 172.21.15.114:0/3737255420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff904159c70 0x7ff90415cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff908d18640 1 -- 172.21.15.114:0/3737255420 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9040b0ae0 msgr2=0x7ff90415c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff908d18640 1 --2- 172.21.15.114:0/3737255420 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9040b0ae0 0x7ff90415c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff908d18640 1 -- 172.21.15.114:0/3737255420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f400b6a0 con 0x7ff90406db20 2023-11-04T01:39:42.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff903fff640 1 --2- 172.21.15.114:0/3737255420 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9040b0ae0 0x7ff90415c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:42.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.423+0000 7ff908d18640 1 --2- 172.21.15.114:0/3737255420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff90406db20 0x7ff9041f20d0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4000c00 tx=0x7ff8f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.424+0000 7ff9017fa640 1 -- 172.21.15.114:0/3737255420 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4040810 con 0x7ff90406db20 2023-11-04T01:39:42.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.424+0000 7ff9017fa640 1 -- 172.21.15.114:0/3737255420 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f4040970 con 0x7ff90406db20 2023-11-04T01:39:42.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.424+0000 7ff90af7c640 1 -- 172.21.15.114:0/3737255420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9041ee590 con 0x7ff90406db20 2023-11-04T01:39:42.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.424+0000 7ff9017fa640 1 -- 172.21.15.114:0/3737255420 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4040d00 con 0x7ff90406db20 2023-11-04T01:39:42.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.424+0000 7ff90af7c640 1 -- 172.21.15.114:0/3737255420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9041eeb50 con 0x7ff90406db20 2023-11-04T01:39:42.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.425+0000 7ff90af7c640 1 -- 172.21.15.114:0/3737255420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff904074290 con 0x7ff90406db20 2023-11-04T01:39:42.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.425+0000 7ff9017fa640 1 -- 172.21.15.114:0/3737255420 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8f403f3a0 con 0x7ff90406db20 2023-11-04T01:39:42.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.425+0000 7ff9017fa640 1 --2- 172.21.15.114:0/3737255420 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8f006ae70 0x7ff8f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.425+0000 7ff9017fa640 1 -- 172.21.15.114:0/3737255420 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7ff8f40ae6a0 con 0x7ff90406db20 2023-11-04T01:39:42.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.425+0000 7ff903fff640 1 --2- 172.21.15.114:0/3737255420 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8f006ae70 0x7ff8f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.426+0000 7ff903fff640 1 --2- 172.21.15.114:0/3737255420 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8f006ae70 0x7ff8f006d330 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff904158230 tx=0x7ff8f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.429+0000 7ff9017fa640 1 -- 172.21.15.114:0/3737255420 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8f40794c0 con 0x7ff90406db20 2023-11-04T01:39:42.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.658+0000 7ff90af7c640 1 -- 172.21.15.114:0/3737255420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]} v 0) v1 -- 0x7ff90406d3f0 con 0x7ff90406db20 2023-11-04T01:39:42.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.995+0000 7ff9017fa640 1 -- 172.21.15.114:0/3737255420 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]}]=0 v202) v1 ==== 148+0+0 (secure 0 0 0) 0x7ff8f4040e60 con 0x7ff90406db20 2023-11-04T01:39:42.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.997+0000 7ff90af7c640 1 -- 172.21.15.114:0/3737255420 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8f006ae70 msgr2=0x7ff8f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.997+0000 7ff90af7c640 1 --2- 172.21.15.114:0/3737255420 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8f006ae70 0x7ff8f006d330 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff904158230 tx=0x7ff8f8009040 comp rx=0 tx=0).stop 2023-11-04T01:39:42.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.997+0000 7ff90af7c640 1 -- 172.21.15.114:0/3737255420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff90406db20 msgr2=0x7ff9041f20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.997+0000 7ff90af7c640 1 --2- 172.21.15.114:0/3737255420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff90406db20 0x7ff9041f20d0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4000c00 tx=0x7ff8f40046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.997+0000 7ff90af7c640 1 -- 172.21.15.114:0/3737255420 shutdown_connections 2023-11-04T01:39:42.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.997+0000 7ff90af7c640 1 --2- 172.21.15.114:0/3737255420 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff904159c70 0x7ff90415cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.997+0000 7ff90af7c640 1 --2- 172.21.15.114:0/3737255420 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8f006ae70 0x7ff8f006d330 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.997+0000 7ff90af7c640 1 --2- 172.21.15.114:0/3737255420 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9040b0ae0 0x7ff90415c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.997+0000 7ff90af7c640 1 --2- 172.21.15.114:0/3737255420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff90406db20 0x7ff9041f20d0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.997+0000 7ff90af7c640 1 -- 172.21.15.114:0/3737255420 >> 172.21.15.114:0/3737255420 conn(0x7ff9040ce950 msgr2=0x7ff9040b35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.997+0000 7ff90af7c640 1 -- 172.21.15.114:0/3737255420 shutdown_connections 2023-11-04T01:39:43.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:42.997+0000 7ff90af7c640 1 -- 172.21.15.114:0/3737255420 wait complete. 2023-11-04T01:39:43.010 INFO:tasks.cephfs_test_runner:Check whether 'allow_new_snaps' setting works ... ok 2023-11-04T01:39:43.010 INFO:tasks.cephfs_test_runner:Starting test: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) check snaptable transcation 2023-11-04T01:39:43.011 INFO:tasks.cephfs_test_runner:test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:39:43.011 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:43.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.109+0000 7f1a052fc640 1 Processor -- start 2023-11-04T01:39:43.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.109+0000 7f1a052fc640 1 -- start start 2023-11-04T01:39:43.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.110+0000 7f1a052fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1a000ce240 0x7f1a00157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.110+0000 7f1a052fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1a00157540 0x7f1a000d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.110+0000 7f1a052fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0015e000 con 0x7f1a000cde60 2023-11-04T01:39:43.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.110+0000 7f1a052fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0015e5c0 con 0x7f1a000ce240 2023-11-04T01:39:43.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.110+0000 7f1a052fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0015e2e0 con 0x7f1a00157540 2023-11-04T01:39:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.110+0000 7f19fe7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1a000ce240 0x7f1a00157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.110+0000 7f19fe7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1a000ce240 0x7f1a00157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55134/0 (socket says 172.21.15.114:55134) 2023-11-04T01:39:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.110+0000 7f19fe7fc640 1 -- 172.21.15.114:0/1816105961 learned_addr learned my addr 172.21.15.114:0/1816105961 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.111+0000 7f19ff7fe640 1 --2- 172.21.15.114:0/1816105961 >> v2:172.21.15.141:3300/0 conn(0x7f1a00157540 0x7f1a000d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.111+0000 7f19fe7fc640 1 -- 172.21.15.114:0/1816105961 >> v2:172.21.15.141:3300/0 conn(0x7f1a00157540 msgr2=0x7f1a000d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.111+0000 7f19fe7fc640 1 --2- 172.21.15.114:0/1816105961 >> v2:172.21.15.141:3300/0 conn(0x7f1a00157540 0x7f1a000d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.111+0000 7f19fe7fc640 1 -- 172.21.15.114:0/1816105961 >> v1:172.21.15.141:6789/0 conn(0x7f1a000cde60 legacy=0x7f1a0015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.111+0000 7f19fe7fc640 1 -- 172.21.15.114:0/1816105961 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a000d1120 con 0x7f1a000ce240 2023-11-04T01:39:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.111+0000 7f19fe7fc640 1 --2- 172.21.15.114:0/1816105961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a000ce240 0x7f1a00157000 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f1a000cf2e0 tx=0x7f19f402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad0249e02eb4314 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.112+0000 7f19fdffb640 1 -- 172.21.15.114:0/1816105961 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4030860 con 0x7f1a000ce240 2023-11-04T01:39:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.112+0000 7f19fdffb640 1 -- 172.21.15.114:0/1816105961 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f40309c0 con 0x7f1a000ce240 2023-11-04T01:39:43.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.112+0000 7f19fdffb640 1 -- 172.21.15.114:0/1816105961 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4030d50 con 0x7f1a000ce240 2023-11-04T01:39:43.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.112+0000 7f1a052fc640 1 -- 172.21.15.114:0/1816105961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a000ce240 msgr2=0x7f1a00157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.112+0000 7f1a052fc640 1 --2- 172.21.15.114:0/1816105961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a000ce240 0x7f1a00157000 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f1a000cf2e0 tx=0x7f19f402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.112+0000 7f1a052fc640 1 -- 172.21.15.114:0/1816105961 shutdown_connections 2023-11-04T01:39:43.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.112+0000 7f1a052fc640 1 --2- 172.21.15.114:0/1816105961 >> v2:172.21.15.141:3300/0 conn(0x7f1a00157540 0x7f1a000d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.112+0000 7f1a052fc640 1 --2- 172.21.15.114:0/1816105961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a000ce240 0x7f1a00157000 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.112+0000 7f1a052fc640 1 -- 172.21.15.114:0/1816105961 >> 172.21.15.114:0/1816105961 conn(0x7f1a00071f30 msgr2=0x7f1a000cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.112+0000 7f1a052fc640 1 -- 172.21.15.114:0/1816105961 shutdown_connections 2023-11-04T01:39:43.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.112+0000 7f1a052fc640 1 -- 172.21.15.114:0/1816105961 wait complete. 2023-11-04T01:39:43.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.113+0000 7f1a052fc640 1 Processor -- start 2023-11-04T01:39:43.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.113+0000 7f1a052fc640 1 -- start start 2023-11-04T01:39:43.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.114+0000 7f1a052fc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1a000cde60 0x7f1a0015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.114+0000 7f1a052fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a000ce240 0x7f1a001f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.114+0000 7f1a052fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1a00157540 0x7f1a001f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.114+0000 7f1a052fc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a001f4610 con 0x7f1a000ce240 2023-11-04T01:39:43.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.114+0000 7f1a052fc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a001f58e0 con 0x7f1a000cde60 2023-11-04T01:39:43.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.114+0000 7f1a052fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a001f4840 con 0x7f1a00157540 2023-11-04T01:39:43.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.114+0000 7f19fe7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a000ce240 0x7f1a001f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.114+0000 7f19fe7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a000ce240 0x7f1a001f3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55146/0 (socket says 172.21.15.114:55146) 2023-11-04T01:39:43.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.114+0000 7f19fe7fc640 1 -- 172.21.15.114:0/3151744962 learned_addr learned my addr 172.21.15.114:0/3151744962 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:43.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.114+0000 7f19feffd640 1 --2- 172.21.15.114:0/3151744962 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1a000cde60 0x7f1a0015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.115+0000 7f19ff7fe640 1 --2- 172.21.15.114:0/3151744962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1a00157540 0x7f1a001f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.115+0000 7f19fe7fc640 1 -- 172.21.15.114:0/3151744962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1a00157540 msgr2=0x7f1a001f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.115+0000 7f19fe7fc640 1 --2- 172.21.15.114:0/3151744962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1a00157540 0x7f1a001f40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.115+0000 7f19fe7fc640 1 -- 172.21.15.114:0/3151744962 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1a000cde60 msgr2=0x7f1a0015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.115+0000 7f19fe7fc640 1 --2- 172.21.15.114:0/3151744962 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1a000cde60 0x7f1a0015a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.115+0000 7f19fe7fc640 1 -- 172.21.15.114:0/3151744962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f40094d0 con 0x7f1a000ce240 2023-11-04T01:39:43.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.115+0000 7f19fe7fc640 1 --2- 172.21.15.114:0/3151744962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a000ce240 0x7f1a001f3070 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f19f402b9e0 tx=0x7f19f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.115+0000 7f19e77fe640 1 -- 172.21.15.114:0/3151744962 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4039d60 con 0x7f1a000ce240 2023-11-04T01:39:43.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.115+0000 7f19e77fe640 1 -- 172.21.15.114:0/3151744962 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f4043400 con 0x7f1a000ce240 2023-11-04T01:39:43.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.115+0000 7f19e77fe640 1 -- 172.21.15.114:0/3151744962 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40437b0 con 0x7f1a000ce240 2023-11-04T01:39:43.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.115+0000 7f1a052fc640 1 -- 172.21.15.114:0/3151744962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a001f4b20 con 0x7f1a000ce240 2023-11-04T01:39:43.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.115+0000 7f1a052fc640 1 -- 172.21.15.114:0/3151744962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a001f50e0 con 0x7f1a000ce240 2023-11-04T01:39:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.116+0000 7f1a052fc640 1 -- 172.21.15.114:0/3151744962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a00074290 con 0x7f1a000ce240 2023-11-04T01:39:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.116+0000 7f19e77fe640 1 -- 172.21.15.114:0/3151744962 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19f4043910 con 0x7f1a000ce240 2023-11-04T01:39:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.117+0000 7f19e77fe640 1 --2- 172.21.15.114:0/3151744962 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f19ec06aea0 0x7f19ec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.117+0000 7f19feffd640 1 --2- 172.21.15.114:0/3151744962 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f19ec06aea0 0x7f19ec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.117+0000 7f19e77fe640 1 -- 172.21.15.114:0/3151744962 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f19f403e070 con 0x7f1a000ce240 2023-11-04T01:39:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.117+0000 7f19feffd640 1 --2- 172.21.15.114:0/3151744962 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f19ec06aea0 0x7f19ec06d360 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f19f0000f60 tx=0x7f19f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.121+0000 7f19e77fe640 1 -- 172.21.15.114:0/3151744962 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f19f40779b0 con 0x7f1a000ce240 2023-11-04T01:39:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.288+0000 7f1a052fc640 1 -- 172.21.15.114:0/3151744962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a000c95b0 con 0x7f1a000ce240 2023-11-04T01:39:43.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.289+0000 7f19e77fe640 1 -- 172.21.15.114:0/3151744962 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+18538 (secure 0 0 0) 0x7f19f4034090 con 0x7f1a000ce240 2023-11-04T01:39:43.291 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:43.291 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":87,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:41.989930+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.141:6834/1471552462":"2023-11-05T01:39:38.980599+0000","172.21.15.141:6832/1471552462":"2023-11-05T01:39:38.980599+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:43.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.291+0000 7f1a052fc640 1 -- 172.21.15.114:0/3151744962 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f19ec06aea0 msgr2=0x7f19ec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.291+0000 7f1a052fc640 1 --2- 172.21.15.114:0/3151744962 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f19ec06aea0 0x7f19ec06d360 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f19f0000f60 tx=0x7f19f0009040 comp rx=0 tx=0).stop 2023-11-04T01:39:43.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.291+0000 7f1a052fc640 1 -- 172.21.15.114:0/3151744962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a000ce240 msgr2=0x7f1a001f3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.291+0000 7f1a052fc640 1 --2- 172.21.15.114:0/3151744962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a000ce240 0x7f1a001f3070 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f19f402b9e0 tx=0x7f19f4004730 comp rx=0 tx=0).stop 2023-11-04T01:39:43.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.291+0000 7f1a052fc640 1 -- 172.21.15.114:0/3151744962 shutdown_connections 2023-11-04T01:39:43.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.291+0000 7f1a052fc640 1 --2- 172.21.15.114:0/3151744962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1a00157540 0x7f1a001f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.291+0000 7f1a052fc640 1 --2- 172.21.15.114:0/3151744962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a000ce240 0x7f1a001f3070 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.291+0000 7f1a052fc640 1 --2- 172.21.15.114:0/3151744962 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f19ec06aea0 0x7f19ec06d360 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.291+0000 7f1a052fc640 1 --2- 172.21.15.114:0/3151744962 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1a000cde60 0x7f1a0015a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.291+0000 7f1a052fc640 1 -- 172.21.15.114:0/3151744962 >> 172.21.15.114:0/3151744962 conn(0x7f1a00071f30 msgr2=0x7f1a000d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.291+0000 7f1a052fc640 1 -- 172.21.15.114:0/3151744962 shutdown_connections 2023-11-04T01:39:43.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.291+0000 7f1a052fc640 1 -- 172.21.15.114:0/3151744962 wait complete. 2023-11-04T01:39:43.304 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:58.316710+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:59.185397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:43.304 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:43.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.405+0000 7f97ad79e640 1 Processor -- start 2023-11-04T01:39:43.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.405+0000 7f97ad79e640 1 -- start start 2023-11-04T01:39:43.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.405+0000 7f97ad79e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97a80cbd80 0x7f97a80cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.405+0000 7f97ad79e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f97a80cfee0 0x7f97a80b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.405+0000 7f97ad79e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a80d0370 con 0x7f97a80b23c0 2023-11-04T01:39:43.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.406+0000 7f97ad79e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a80b2f90 con 0x7f97a80cfee0 2023-11-04T01:39:43.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.406+0000 7f97ad79e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a80b3270 con 0x7f97a80cbd80 2023-11-04T01:39:43.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.406+0000 7f97a7fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f97a80b23c0 0x7f97a80b27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41538/0 (socket says 172.21.15.114:41538) 2023-11-04T01:39:43.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.406+0000 7f97a7fff640 1 -- 172.21.15.114:0/1330004719 learned_addr learned my addr 172.21.15.114:0/1330004719 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:43.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.406+0000 7f97acf9d640 1 --2- 172.21.15.114:0/1330004719 >> v2:172.21.15.141:3300/0 conn(0x7f97a80cfee0 0x7f97a80b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.406+0000 7f97a77fe640 1 --2- 172.21.15.114:0/1330004719 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97a80cbd80 0x7f97a80cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.406+0000 7f97a6ffd640 1 -- 172.21.15.114:0/1330004719 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798344416 0 0) 0x7f97a80d0370 con 0x7f97a80b23c0 2023-11-04T01:39:43.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.406+0000 7f97a6ffd640 1 -- 172.21.15.114:0/1330004719 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9790003520 con 0x7f97a80b23c0 2023-11-04T01:39:43.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.406+0000 7f97a77fe640 1 -- 172.21.15.114:0/1330004719 >> v2:172.21.15.141:3300/0 conn(0x7f97a80cfee0 msgr2=0x7f97a80b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.406+0000 7f97a77fe640 1 --2- 172.21.15.114:0/1330004719 >> v2:172.21.15.141:3300/0 conn(0x7f97a80cfee0 0x7f97a80b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.406+0000 7f97a77fe640 1 -- 172.21.15.114:0/1330004719 >> v1:172.21.15.114:6789/0 conn(0x7f97a80b23c0 legacy=0x7f97a80b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.406+0000 7f97a6ffd640 1 -- 172.21.15.114:0/1330004719 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3601413205 0 0) 0x7f9790003520 con 0x7f97a80b23c0 2023-11-04T01:39:43.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.406+0000 7f97a77fe640 1 -- 172.21.15.114:0/1330004719 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a80cb2c0 con 0x7f97a80cbd80 2023-11-04T01:39:43.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.406+0000 7f97acf9d640 1 --2- 172.21.15.114:0/1330004719 >> v2:172.21.15.141:3300/0 conn(0x7f97a80cfee0 0x7f97a80b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.407+0000 7f97a77fe640 1 --2- 172.21.15.114:0/1330004719 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97a80cbd80 0x7f97a80cdee0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f979c0097a0 tx=0x7f979c02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24b63e935eb3f872 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.407+0000 7f97a6ffd640 1 -- 172.21.15.114:0/1330004719 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c02f050 con 0x7f97a80cbd80 2023-11-04T01:39:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.407+0000 7f97a6ffd640 1 -- 172.21.15.114:0/1330004719 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c031500 con 0x7f97a80cbd80 2023-11-04T01:39:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.407+0000 7f97a6ffd640 1 -- 172.21.15.114:0/1330004719 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798001670 con 0x7f97a80cbd80 2023-11-04T01:39:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.408+0000 7f97ad79e640 1 -- 172.21.15.114:0/1330004719 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97a80cbd80 msgr2=0x7f97a80cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.408+0000 7f97ad79e640 1 --2- 172.21.15.114:0/1330004719 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97a80cbd80 0x7f97a80cdee0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f979c0097a0 tx=0x7f979c02b820 comp rx=0 tx=0).stop 2023-11-04T01:39:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.408+0000 7f97ad79e640 1 -- 172.21.15.114:0/1330004719 shutdown_connections 2023-11-04T01:39:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.408+0000 7f97ad79e640 1 --2- 172.21.15.114:0/1330004719 >> v2:172.21.15.141:3300/0 conn(0x7f97a80cfee0 0x7f97a80b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.408+0000 7f97ad79e640 1 --2- 172.21.15.114:0/1330004719 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97a80cbd80 0x7f97a80cdee0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.408+0000 7f97ad79e640 1 -- 172.21.15.114:0/1330004719 >> 172.21.15.114:0/1330004719 conn(0x7f97a80cd3c0 msgr2=0x7f97a80cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.408+0000 7f97ad79e640 1 -- 172.21.15.114:0/1330004719 shutdown_connections 2023-11-04T01:39:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.408+0000 7f97ad79e640 1 -- 172.21.15.114:0/1330004719 wait complete. 2023-11-04T01:39:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.409+0000 7f97ad79e640 1 Processor -- start 2023-11-04T01:39:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.409+0000 7f97ad79e640 1 -- start start 2023-11-04T01:39:43.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97ad79e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97a80b23c0 0x7f97a80ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97ad79e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97a80cbd80 0x7f97a81f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97ad79e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a80cfee0 0x7f97a81f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97ad79e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a815c590 con 0x7f97a80cfee0 2023-11-04T01:39:43.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97ad79e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a81f48c0 con 0x7f97a80b23c0 2023-11-04T01:39:43.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97ad79e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a80c6f50 con 0x7f97a80cbd80 2023-11-04T01:39:43.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97acf9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a80cfee0 0x7f97a81f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97acf9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a80cfee0 0x7f97a81f3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55152/0 (socket says 172.21.15.114:55152) 2023-11-04T01:39:43.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97acf9d640 1 -- 172.21.15.114:0/999233404 learned_addr learned my addr 172.21.15.114:0/999233404 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:43.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97a7fff640 1 --2- 172.21.15.114:0/999233404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97a80b23c0 0x7f97a80ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97acf9d640 1 -- 172.21.15.114:0/999233404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97a80cbd80 msgr2=0x7f97a81f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97a77fe640 1 --2- 172.21.15.114:0/999233404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97a80cbd80 0x7f97a81f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97acf9d640 1 --2- 172.21.15.114:0/999233404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97a80cbd80 0x7f97a81f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97acf9d640 1 -- 172.21.15.114:0/999233404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97a80b23c0 msgr2=0x7f97a80ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97acf9d640 1 --2- 172.21.15.114:0/999233404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97a80b23c0 0x7f97a80ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97acf9d640 1 -- 172.21.15.114:0/999233404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a0009a70 con 0x7f97a80cfee0 2023-11-04T01:39:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97a7fff640 1 --2- 172.21.15.114:0/999233404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97a80b23c0 0x7f97a80ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.410+0000 7f97a77fe640 1 --2- 172.21.15.114:0/999233404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97a80cbd80 0x7f97a81f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.411+0000 7f97acf9d640 1 --2- 172.21.15.114:0/999233404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a80cfee0 0x7f97a81f3f80 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009e60 tx=0x7f97a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.411+0000 7f97a4ff9640 1 -- 172.21.15.114:0/999233404 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0009cd0 con 0x7f97a80cfee0 2023-11-04T01:39:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.411+0000 7f97a4ff9640 1 -- 172.21.15.114:0/999233404 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a000f040 con 0x7f97a80cfee0 2023-11-04T01:39:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.411+0000 7f97a4ff9640 1 -- 172.21.15.114:0/999233404 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0003990 con 0x7f97a80cfee0 2023-11-04T01:39:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.411+0000 7f97ad79e640 1 -- 172.21.15.114:0/999233404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979c009400 con 0x7f97a80cfee0 2023-11-04T01:39:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.411+0000 7f97ad79e640 1 -- 172.21.15.114:0/999233404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a815c7a0 con 0x7f97a80cfee0 2023-11-04T01:39:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.412+0000 7f97ad79e640 1 -- 172.21.15.114:0/999233404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a804ece0 con 0x7f97a80cfee0 2023-11-04T01:39:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.412+0000 7f97a4ff9640 1 -- 172.21.15.114:0/999233404 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f97a0014480 con 0x7f97a80cfee0 2023-11-04T01:39:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.413+0000 7f97a4ff9640 1 --2- 172.21.15.114:0/999233404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f979406ae70 0x7f979406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.413+0000 7f97a7fff640 1 --2- 172.21.15.114:0/999233404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f979406ae70 0x7f979406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.413+0000 7f97a4ff9640 1 -- 172.21.15.114:0/999233404 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f97a008a490 con 0x7f97a80cfee0 2023-11-04T01:39:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.413+0000 7f97a7fff640 1 --2- 172.21.15.114:0/999233404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f979406ae70 0x7f979406d330 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f97a80c7b30 tx=0x7f9798009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.417+0000 7f97a4ff9640 1 -- 172.21.15.114:0/999233404 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97a00552b0 con 0x7f97a80cfee0 2023-11-04T01:39:43.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.582+0000 7f97ad79e640 1 -- 172.21.15.114:0/999233404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97a80af880 con 0x7f97a80cfee0 2023-11-04T01:39:43.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.582+0000 7f97a4ff9640 1 -- 172.21.15.114:0/999233404 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97a00588d0 con 0x7f97a80cfee0 2023-11-04T01:39:43.584 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:39:43.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.584+0000 7f97ad79e640 1 -- 172.21.15.114:0/999233404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f979406ae70 msgr2=0x7f979406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.584+0000 7f97ad79e640 1 --2- 172.21.15.114:0/999233404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f979406ae70 0x7f979406d330 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f97a80c7b30 tx=0x7f9798009040 comp rx=0 tx=0).stop 2023-11-04T01:39:43.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.584+0000 7f97ad79e640 1 -- 172.21.15.114:0/999233404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a80cfee0 msgr2=0x7f97a81f3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.584+0000 7f97ad79e640 1 --2- 172.21.15.114:0/999233404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a80cfee0 0x7f97a81f3f80 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009e60 tx=0x7f97a000c490 comp rx=0 tx=0).stop 2023-11-04T01:39:43.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.584+0000 7f97ad79e640 1 -- 172.21.15.114:0/999233404 shutdown_connections 2023-11-04T01:39:43.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.584+0000 7f97ad79e640 1 --2- 172.21.15.114:0/999233404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a80cfee0 0x7f97a81f3f80 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.584+0000 7f97ad79e640 1 --2- 172.21.15.114:0/999233404 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97a80cbd80 0x7f97a81f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.584+0000 7f97ad79e640 1 --2- 172.21.15.114:0/999233404 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f979406ae70 0x7f979406d330 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.584+0000 7f97ad79e640 1 --2- 172.21.15.114:0/999233404 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97a80b23c0 0x7f97a80ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.584+0000 7f97ad79e640 1 -- 172.21.15.114:0/999233404 >> 172.21.15.114:0/999233404 conn(0x7f97a80cd3c0 msgr2=0x7f97a80cd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.584+0000 7f97ad79e640 1 -- 172.21.15.114:0/999233404 shutdown_connections 2023-11-04T01:39:43.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.584+0000 7f97ad79e640 1 -- 172.21.15.114:0/999233404 wait complete. 2023-11-04T01:39:43.597 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:39:43.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.697+0000 7feeab505640 1 Processor -- start 2023-11-04T01:39:43.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.698+0000 7feeab505640 1 -- start start 2023-11-04T01:39:43.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.698+0000 7feeab505640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feea4153e60 0x7feea415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.698+0000 7feeab505640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea40cde60 con 0x7feea40cd6d0 2023-11-04T01:39:43.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.699+0000 7feeab505640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea4160f90 con 0x7feea40b4880 2023-11-04T01:39:43.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.699+0000 7feeab505640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea415e400 con 0x7feea4153e60 2023-11-04T01:39:43.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.699+0000 7feea8aa0640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7feea40cd6d0 0x7feea4161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41544/0 (socket says 172.21.15.114:41544) 2023-11-04T01:39:43.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.699+0000 7feea8aa0640 1 -- 172.21.15.114:0/2408424674 learned_addr learned my addr 172.21.15.114:0/2408424674 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:43.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.699+0000 7feea92a1640 1 --2- 172.21.15.114:0/2408424674 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feea4153e60 0x7feea415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.699+0000 7fee9bfff640 1 -- 172.21.15.114:0/2408424674 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3733628723 0 0) 0x7feea40cde60 con 0x7feea40cd6d0 2023-11-04T01:39:43.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.699+0000 7fee9bfff640 1 -- 172.21.15.114:0/2408424674 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee90003520 con 0x7feea40cd6d0 2023-11-04T01:39:43.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.699+0000 7fee9bfff640 1 -- 172.21.15.114:0/2408424674 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299056511 0 0) 0x7feea4160f90 con 0x7feea40b4880 2023-11-04T01:39:43.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.699+0000 7fee9bfff640 1 -- 172.21.15.114:0/2408424674 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feea40cde60 con 0x7feea40b4880 2023-11-04T01:39:43.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.699+0000 7feea92a1640 1 -- 172.21.15.114:0/2408424674 >> v1:172.21.15.141:6789/0 conn(0x7feea40b4880 legacy=0x7feea40d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.699+0000 7feea92a1640 1 -- 172.21.15.114:0/2408424674 >> v1:172.21.15.114:6789/0 conn(0x7feea40cd6d0 legacy=0x7feea4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.699+0000 7fee9bfff640 1 -- 172.21.15.114:0/2408424674 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2142067691 0 0) 0x7fee90003520 con 0x7feea40cd6d0 2023-11-04T01:39:43.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.699+0000 7feea92a1640 1 -- 172.21.15.114:0/2408424674 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40ce090 con 0x7feea4153e60 2023-11-04T01:39:43.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.700+0000 7feea92a1640 1 --2- 172.21.15.114:0/2408424674 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feea4153e60 0x7feea415dec0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009dc0 tx=0x7fee9c02bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c696a113fbfb27f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.700+0000 7fee9bfff640 1 -- 172.21.15.114:0/2408424674 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94001670 con 0x7feea4153e60 2023-11-04T01:39:43.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.700+0000 7fee9bfff640 1 -- 172.21.15.114:0/2408424674 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c02c910 con 0x7feea4153e60 2023-11-04T01:39:43.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.700+0000 7fee9bfff640 1 -- 172.21.15.114:0/2408424674 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c02cc80 con 0x7feea4153e60 2023-11-04T01:39:43.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.701+0000 7feeab505640 1 -- 172.21.15.114:0/2408424674 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feea4153e60 msgr2=0x7feea415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.701+0000 7feeab505640 1 --2- 172.21.15.114:0/2408424674 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feea4153e60 0x7feea415dec0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009dc0 tx=0x7fee9c02bde0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.701+0000 7feeab505640 1 -- 172.21.15.114:0/2408424674 shutdown_connections 2023-11-04T01:39:43.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.701+0000 7feeab505640 1 --2- 172.21.15.114:0/2408424674 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feea4153e60 0x7feea415dec0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.701+0000 7feeab505640 1 -- 172.21.15.114:0/2408424674 >> 172.21.15.114:0/2408424674 conn(0x7feea40cf880 msgr2=0x7feea40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.701+0000 7feeab505640 1 -- 172.21.15.114:0/2408424674 shutdown_connections 2023-11-04T01:39:43.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.701+0000 7feeab505640 1 -- 172.21.15.114:0/2408424674 wait complete. 2023-11-04T01:39:43.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.702+0000 7feeab505640 1 Processor -- start 2023-11-04T01:39:43.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.702+0000 7feeab505640 1 -- start start 2023-11-04T01:39:43.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feeab505640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feea40b4880 0x7feea40c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feeab505640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feea40cd6d0 0x7feea41f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feeab505640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea4153e60 0x7feea40d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feeab505640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea41f3850 con 0x7feea4153e60 2023-11-04T01:39:43.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feeab505640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea41f3290 con 0x7feea40b4880 2023-11-04T01:39:43.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feeab505640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea41f3570 con 0x7feea40cd6d0 2023-11-04T01:39:43.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feea9aa2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea4153e60 0x7feea40d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feea9aa2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea4153e60 0x7feea40d2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55166/0 (socket says 172.21.15.114:55166) 2023-11-04T01:39:43.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feea9aa2640 1 -- 172.21.15.114:0/1339048258 learned_addr learned my addr 172.21.15.114:0/1339048258 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:43.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feea92a1640 1 --2- 172.21.15.114:0/1339048258 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feea40b4880 0x7feea40c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feea8aa0640 1 --2- 172.21.15.114:0/1339048258 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feea40cd6d0 0x7feea41f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feea9aa2640 1 -- 172.21.15.114:0/1339048258 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feea40cd6d0 msgr2=0x7feea41f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feea9aa2640 1 --2- 172.21.15.114:0/1339048258 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feea40cd6d0 0x7feea41f27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feea9aa2640 1 -- 172.21.15.114:0/1339048258 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feea40b4880 msgr2=0x7feea40c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feea9aa2640 1 --2- 172.21.15.114:0/1339048258 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feea40b4880 0x7feea40c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feea9aa2640 1 -- 172.21.15.114:0/1339048258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c009a70 con 0x7feea4153e60 2023-11-04T01:39:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feea9aa2640 1 --2- 172.21.15.114:0/1339048258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea4153e60 0x7feea40d2de0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7feea000c400 tx=0x7feea000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7fee99ffb640 1 -- 172.21.15.114:0/1339048258 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00052d0 con 0x7feea4153e60 2023-11-04T01:39:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7fee99ffb640 1 -- 172.21.15.114:0/1339048258 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea0005430 con 0x7feea4153e60 2023-11-04T01:39:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7feeab505640 1 -- 172.21.15.114:0/1339048258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea40c7b20 con 0x7feea4153e60 2023-11-04T01:39:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.703+0000 7fee99ffb640 1 -- 172.21.15.114:0/1339048258 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00037f0 con 0x7feea4153e60 2023-11-04T01:39:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.704+0000 7feeab505640 1 -- 172.21.15.114:0/1339048258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea40c9400 con 0x7feea4153e60 2023-11-04T01:39:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.705+0000 7feeab505640 1 -- 172.21.15.114:0/1339048258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea40c7980 con 0x7feea4153e60 2023-11-04T01:39:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.705+0000 7fee99ffb640 1 -- 172.21.15.114:0/1339048258 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feea0003950 con 0x7feea4153e60 2023-11-04T01:39:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.705+0000 7fee99ffb640 1 --2- 172.21.15.114:0/1339048258 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee8806ae70 0x7fee8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.705+0000 7fee99ffb640 1 -- 172.21.15.114:0/1339048258 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7feea0088e10 con 0x7feea4153e60 2023-11-04T01:39:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.705+0000 7feea92a1640 1 --2- 172.21.15.114:0/1339048258 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee8806ae70 0x7fee8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.706+0000 7feea92a1640 1 --2- 172.21.15.114:0/1339048258 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee8806ae70 0x7fee8806d330 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fee9c036000 tx=0x7fee9c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.709+0000 7fee99ffb640 1 -- 172.21.15.114:0/1339048258 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feea40c7980 con 0x7feea4153e60 2023-11-04T01:39:43.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.876+0000 7feeab505640 1 -- 172.21.15.114:0/1339048258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7feea40c8040 con 0x7feea4153e60 2023-11-04T01:39:43.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.876+0000 7fee99ffb640 1 -- 172.21.15.114:0/1339048258 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v87) v1 ==== 103+0+11 (secure 0 0 0) 0x7feea40c8040 con 0x7feea4153e60 2023-11-04T01:39:43.878 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:43.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.878+0000 7feeab505640 1 -- 172.21.15.114:0/1339048258 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee8806ae70 msgr2=0x7fee8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.878+0000 7feeab505640 1 --2- 172.21.15.114:0/1339048258 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee8806ae70 0x7fee8806d330 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fee9c036000 tx=0x7fee9c030000 comp rx=0 tx=0).stop 2023-11-04T01:39:43.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.878+0000 7feeab505640 1 -- 172.21.15.114:0/1339048258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea4153e60 msgr2=0x7feea40d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.878+0000 7feeab505640 1 --2- 172.21.15.114:0/1339048258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea4153e60 0x7feea40d2de0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7feea000c400 tx=0x7feea000c8c0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.878+0000 7feeab505640 1 -- 172.21.15.114:0/1339048258 shutdown_connections 2023-11-04T01:39:43.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.878+0000 7feeab505640 1 --2- 172.21.15.114:0/1339048258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feea4153e60 0x7feea40d2de0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.878+0000 7feeab505640 1 --2- 172.21.15.114:0/1339048258 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feea40cd6d0 0x7feea41f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.878+0000 7feeab505640 1 --2- 172.21.15.114:0/1339048258 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee8806ae70 0x7fee8806d330 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.878+0000 7feeab505640 1 --2- 172.21.15.114:0/1339048258 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feea40b4880 0x7feea40c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.878+0000 7feeab505640 1 -- 172.21.15.114:0/1339048258 >> 172.21.15.114:0/1339048258 conn(0x7feea40cf880 msgr2=0x7feea415e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.878+0000 7feeab505640 1 -- 172.21.15.114:0/1339048258 shutdown_connections 2023-11-04T01:39:43.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.878+0000 7feeab505640 1 -- 172.21.15.114:0/1339048258 wait complete. 2023-11-04T01:39:43.891 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:39:43.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.991+0000 7fe05b59e640 1 Processor -- start 2023-11-04T01:39:43.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.991+0000 7fe05b59e640 1 -- start start 2023-11-04T01:39:43.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.992+0000 7fe05b59e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe05c159cf0 0x7fe05c0b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.992+0000 7fe05b59e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe05c0b39a0 0x7fe05c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.992+0000 7fe05b59e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05c0cbae0 con 0x7fe05c0cb140 2023-11-04T01:39:43.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.992+0000 7fe05b59e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05c15a0d0 con 0x7fe05c159cf0 2023-11-04T01:39:43.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.992+0000 7fe05b59e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0cae10 con 0x7fe05c0b39a0 2023-11-04T01:39:43.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.992+0000 7fe05ad9d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe05c0b39a0 0x7fe05c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.992+0000 7fe05a59c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe05c159cf0 0x7fe05c0b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.993+0000 7fe059d9b640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fe05c0cb140 0x7fe05c06c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:40736/0 (socket says 172.21.15.114:40736) 2023-11-04T01:39:43.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.993+0000 7fe059d9b640 1 -- 172.21.15.114:0/1891312281 learned_addr learned my addr 172.21.15.114:0/1891312281 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:43.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.993+0000 7fe05a59c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe05c159cf0 0x7fe05c0b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:41348/0 (socket says 172.21.15.114:41348) 2023-11-04T01:39:43.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.993+0000 7fe05959a640 1 -- 172.21.15.114:0/1891312281 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329694121 0 0) 0x7fe05c0cbae0 con 0x7fe05c0cb140 2023-11-04T01:39:43.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.993+0000 7fe05959a640 1 -- 172.21.15.114:0/1891312281 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe044003520 con 0x7fe05c0cb140 2023-11-04T01:39:43.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.993+0000 7fe05a59c640 1 -- 172.21.15.114:0/1891312281 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe05c0b39a0 msgr2=0x7fe05c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.993+0000 7fe05a59c640 1 --2- 172.21.15.114:0/1891312281 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe05c0b39a0 0x7fe05c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.993+0000 7fe05a59c640 1 -- 172.21.15.114:0/1891312281 >> v1:172.21.15.141:6789/0 conn(0x7fe05c0cb140 legacy=0x7fe05c06c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.993+0000 7fe05a59c640 1 -- 172.21.15.114:0/1891312281 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c0c90d0 con 0x7fe05c159cf0 2023-11-04T01:39:43.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.993+0000 7fe05ad9d640 1 --2- 172.21.15.114:0/1891312281 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe05c0b39a0 0x7fe05c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:43.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.994+0000 7fe05a59c640 1 --2- 172.21.15.114:0/1891312281 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe05c159cf0 0x7fe05c0b3fe0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0097a0 tx=0x7fe04c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53f24dc6c1d8ad3b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.994+0000 7fe05959a640 1 -- 172.21.15.114:0/1891312281 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c02d040 con 0x7fe05c159cf0 2023-11-04T01:39:43.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.994+0000 7fe05959a640 1 -- 172.21.15.114:0/1891312281 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c031810 con 0x7fe05c159cf0 2023-11-04T01:39:43.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.994+0000 7fe05959a640 1 -- 172.21.15.114:0/1891312281 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c031b80 con 0x7fe05c159cf0 2023-11-04T01:39:43.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.994+0000 7fe05b59e640 1 -- 172.21.15.114:0/1891312281 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe05c159cf0 msgr2=0x7fe05c0b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.994+0000 7fe05b59e640 1 --2- 172.21.15.114:0/1891312281 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe05c159cf0 0x7fe05c0b3fe0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0097a0 tx=0x7fe04c02b8b0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.994+0000 7fe05b59e640 1 -- 172.21.15.114:0/1891312281 shutdown_connections 2023-11-04T01:39:43.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.994+0000 7fe05b59e640 1 --2- 172.21.15.114:0/1891312281 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe05c0b39a0 0x7fe05c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.994+0000 7fe05b59e640 1 --2- 172.21.15.114:0/1891312281 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe05c159cf0 0x7fe05c0b3fe0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.994+0000 7fe05b59e640 1 -- 172.21.15.114:0/1891312281 >> 172.21.15.114:0/1891312281 conn(0x7fe05c0b02c0 msgr2=0x7fe05c0b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.994+0000 7fe05b59e640 1 -- 172.21.15.114:0/1891312281 shutdown_connections 2023-11-04T01:39:43.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.994+0000 7fe05b59e640 1 -- 172.21.15.114:0/1891312281 wait complete. 2023-11-04T01:39:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.996+0000 7fe05b59e640 1 Processor -- start 2023-11-04T01:39:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.996+0000 7fe05b59e640 1 -- start start 2023-11-04T01:39:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.996+0000 7fe05b59e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe05c0b39a0 0x7fe05c151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.996+0000 7fe05b59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe05c0cb140 0x7fe05c1505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.997+0000 7fe05b59e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe05c159cf0 0x7fe05c15a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.997+0000 7fe05b59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c150b00 con 0x7fe05c0cb140 2023-11-04T01:39:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.997+0000 7fe05b59e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c150d30 con 0x7fe05c0b39a0 2023-11-04T01:39:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.997+0000 7fe05b59e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c151010 con 0x7fe05c159cf0 2023-11-04T01:39:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.997+0000 7fe059d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe05c0cb140 0x7fe05c1505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.997+0000 7fe059d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe05c0cb140 0x7fe05c1505c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55176/0 (socket says 172.21.15.114:55176) 2023-11-04T01:39:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.997+0000 7fe059d9b640 1 -- 172.21.15.114:0/2458374172 learned_addr learned my addr 172.21.15.114:0/2458374172 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.997+0000 7fe05a59c640 1 --2- 172.21.15.114:0/2458374172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe05c0b39a0 0x7fe05c151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.997+0000 7fe05ad9d640 1 --2- 172.21.15.114:0/2458374172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe05c159cf0 0x7fe05c15a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.997+0000 7fe059d9b640 1 -- 172.21.15.114:0/2458374172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe05c159cf0 msgr2=0x7fe05c15a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.997+0000 7fe059d9b640 1 --2- 172.21.15.114:0/2458374172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe05c159cf0 0x7fe05c15a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.997+0000 7fe059d9b640 1 -- 172.21.15.114:0/2458374172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe05c0b39a0 msgr2=0x7fe05c151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.997+0000 7fe059d9b640 1 --2- 172.21.15.114:0/2458374172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe05c0b39a0 0x7fe05c151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.997+0000 7fe059d9b640 1 -- 172.21.15.114:0/2458374172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe054009a70 con 0x7fe05c0cb140 2023-11-04T01:39:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.997+0000 7fe059d9b640 1 --2- 172.21.15.114:0/2458374172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe05c0cb140 0x7fe05c1505c0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fe05000c430 tx=0x7fe05000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.998+0000 7fe04affd640 1 -- 172.21.15.114:0/2458374172 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe050005ce0 con 0x7fe05c0cb140 2023-11-04T01:39:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.998+0000 7fe04affd640 1 -- 172.21.15.114:0/2458374172 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe050005e40 con 0x7fe05c0cb140 2023-11-04T01:39:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.998+0000 7fe05b59e640 1 -- 172.21.15.114:0/2458374172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04c009400 con 0x7fe05c0cb140 2023-11-04T01:39:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.998+0000 7fe04affd640 1 -- 172.21.15.114:0/2458374172 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0500072f0 con 0x7fe05c0cb140 2023-11-04T01:39:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.998+0000 7fe05b59e640 1 -- 172.21.15.114:0/2458374172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c1515d0 con 0x7fe05c0cb140 2023-11-04T01:39:44.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.999+0000 7fe05b59e640 1 -- 172.21.15.114:0/2458374172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05c04ece0 con 0x7fe05c0cb140 2023-11-04T01:39:44.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:43.999+0000 7fe04affd640 1 -- 172.21.15.114:0/2458374172 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe050007450 con 0x7fe05c0cb140 2023-11-04T01:39:44.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.000+0000 7fe04affd640 1 --2- 172.21.15.114:0/2458374172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe03c06ae70 0x7fe03c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.000+0000 7fe04affd640 1 -- 172.21.15.114:0/2458374172 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fe050088d70 con 0x7fe05c0cb140 2023-11-04T01:39:44.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.000+0000 7fe05a59c640 1 --2- 172.21.15.114:0/2458374172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe03c06ae70 0x7fe03c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.000+0000 7fe05a59c640 1 --2- 172.21.15.114:0/2458374172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe03c06ae70 0x7fe03c06d330 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe04c036000 tx=0x7fe04c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:44.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.006+0000 7fe04affd640 1 -- 172.21.15.114:0/2458374172 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe050053cd0 con 0x7fe05c0cb140 2023-11-04T01:39:44.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.169+0000 7fe05b59e640 1 -- 172.21.15.114:0/2458374172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fe05c0b09e0 con 0x7fe05c0cb140 2023-11-04T01:39:44.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.170+0000 7fe04affd640 1 -- 172.21.15.114:0/2458374172 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v87) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe050017020 con 0x7fe05c0cb140 2023-11-04T01:39:44.171 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:44.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.171+0000 7fe05b59e640 1 -- 172.21.15.114:0/2458374172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe03c06ae70 msgr2=0x7fe03c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.171+0000 7fe05b59e640 1 --2- 172.21.15.114:0/2458374172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe03c06ae70 0x7fe03c06d330 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe04c036000 tx=0x7fe04c03c040 comp rx=0 tx=0).stop 2023-11-04T01:39:44.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.171+0000 7fe05b59e640 1 -- 172.21.15.114:0/2458374172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe05c0cb140 msgr2=0x7fe05c1505c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.171+0000 7fe05b59e640 1 --2- 172.21.15.114:0/2458374172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe05c0cb140 0x7fe05c1505c0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fe05000c430 tx=0x7fe05000c830 comp rx=0 tx=0).stop 2023-11-04T01:39:44.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.171+0000 7fe05b59e640 1 -- 172.21.15.114:0/2458374172 shutdown_connections 2023-11-04T01:39:44.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.171+0000 7fe05b59e640 1 --2- 172.21.15.114:0/2458374172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe05c159cf0 0x7fe05c15a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.171+0000 7fe05b59e640 1 --2- 172.21.15.114:0/2458374172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe05c0cb140 0x7fe05c1505c0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.171+0000 7fe05b59e640 1 --2- 172.21.15.114:0/2458374172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe03c06ae70 0x7fe03c06d330 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.171+0000 7fe05b59e640 1 --2- 172.21.15.114:0/2458374172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe05c0b39a0 0x7fe05c151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.171+0000 7fe05b59e640 1 -- 172.21.15.114:0/2458374172 >> 172.21.15.114:0/2458374172 conn(0x7fe05c0b02c0 msgr2=0x7fe05c070410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:44.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.171+0000 7fe05b59e640 1 -- 172.21.15.114:0/2458374172 shutdown_connections 2023-11-04T01:39:44.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.171+0000 7fe05b59e640 1 -- 172.21.15.114:0/2458374172 wait complete. 2023-11-04T01:39:44.184 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:39:44.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.284+0000 7f74ab490640 1 Processor -- start 2023-11-04T01:39:44.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.284+0000 7f74ab490640 1 -- start start 2023-11-04T01:39:44.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f74ab490640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f74a4159c00 0x7f74a40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f74ab490640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74a40ae1d0 0x7f74a40c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f74ab490640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a415aff0 con 0x7f74a40c48e0 2023-11-04T01:39:44.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f74ab490640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a40c52d0 con 0x7f74a4159c00 2023-11-04T01:39:44.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f74ab490640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a415a3e0 con 0x7f74a40ae1d0 2023-11-04T01:39:44.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f74a8a2b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f74a40c48e0 0x7f74a40adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41556/0 (socket says 172.21.15.114:41556) 2023-11-04T01:39:44.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f74a8a2b640 1 -- 172.21.15.114:0/225988796 learned_addr learned my addr 172.21.15.114:0/225988796 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:44.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f74a9a2d640 1 --2- 172.21.15.114:0/225988796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74a40ae1d0 0x7f74a40c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f74a922c640 1 --2- 172.21.15.114:0/225988796 >> v2:172.21.15.141:3300/0 conn(0x7f74a4159c00 0x7f74a40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f749bfff640 1 -- 172.21.15.114:0/225988796 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291218043 0 0) 0x7f74a415aff0 con 0x7f74a40c48e0 2023-11-04T01:39:44.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f749bfff640 1 -- 172.21.15.114:0/225988796 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7490003520 con 0x7f74a40c48e0 2023-11-04T01:39:44.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f749bfff640 1 -- 172.21.15.114:0/225988796 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3643425636 0 0) 0x7f7490003520 con 0x7f74a40c48e0 2023-11-04T01:39:44.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f749bfff640 1 -- 172.21.15.114:0/225988796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74a40ae1d0 msgr2=0x7f74a40c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:44.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f749bfff640 1 --2- 172.21.15.114:0/225988796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74a40ae1d0 0x7f74a40c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f749bfff640 1 -- 172.21.15.114:0/225988796 >> v2:172.21.15.141:3300/0 conn(0x7f74a4159c00 msgr2=0x7f74a40cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:44.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f749bfff640 1 --2- 172.21.15.114:0/225988796 >> v2:172.21.15.141:3300/0 conn(0x7f74a4159c00 0x7f74a40cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f749bfff640 1 -- 172.21.15.114:0/225988796 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a415a6c0 con 0x7f74a40c48e0 2023-11-04T01:39:44.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f749bfff640 1 -- 172.21.15.114:0/225988796 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f7494001670 con 0x7f74a40c48e0 2023-11-04T01:39:44.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f749bfff640 1 -- 172.21.15.114:0/225988796 >> v1:172.21.15.114:6789/0 conn(0x7f74a40c48e0 legacy=0x7f74a40adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f749bfff640 1 --2- 172.21.15.114:0/225988796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74a40ae1d0 0x7f7490003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f749bfff640 1 --2- 172.21.15.114:0/225988796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7490003ef0 0x7f74900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.285+0000 7f749bfff640 1 --2- 172.21.15.114:0/225988796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7490004d00 0x7f7490005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.286+0000 7f749bfff640 1 -- 172.21.15.114:0/225988796 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40c52d0 con 0x7f7490003ef0 2023-11-04T01:39:44.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.286+0000 7f749bfff640 1 -- 172.21.15.114:0/225988796 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a415a3e0 con 0x7f7490004d00 2023-11-04T01:39:44.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.286+0000 7f749bfff640 1 -- 172.21.15.114:0/225988796 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749000b9d0 con 0x7f74a40ae1d0 2023-11-04T01:39:44.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.286+0000 7f74a8a2b640 1 --2- 172.21.15.114:0/225988796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7490003ef0 0x7f74900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.286+0000 7f74a922c640 1 --2- 172.21.15.114:0/225988796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74a40ae1d0 0x7f7490003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.286+0000 7f74a9a2d640 1 --2- 172.21.15.114:0/225988796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7490004d00 0x7f7490005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.286+0000 7f74a8a2b640 1 -- 172.21.15.114:0/225988796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74a40ae1d0 msgr2=0x7f7490003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:44.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.286+0000 7f74a8a2b640 1 --2- 172.21.15.114:0/225988796 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74a40ae1d0 0x7f7490003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.286+0000 7f74a8a2b640 1 -- 172.21.15.114:0/225988796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7490004d00 msgr2=0x7f7490005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:44.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.286+0000 7f74a8a2b640 1 --2- 172.21.15.114:0/225988796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7490004d00 0x7f7490005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.286+0000 7f74a8a2b640 1 -- 172.21.15.114:0/225988796 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7490003520 con 0x7f7490003ef0 2023-11-04T01:39:44.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.286+0000 7f74a9a2d640 1 --2- 172.21.15.114:0/225988796 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7490004d00 0x7f7490005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:44.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.287+0000 7f74a8a2b640 1 --2- 172.21.15.114:0/225988796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7490003ef0 0x7f74900047c0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f749400c240 tx=0x7f74900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7496e2e7e9bc0ee6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:44.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.287+0000 7f749bfff640 1 -- 172.21.15.114:0/225988796 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7494005ad0 con 0x7f7490003ef0 2023-11-04T01:39:44.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.287+0000 7f749bfff640 1 -- 172.21.15.114:0/225988796 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7494005c30 con 0x7f7490003ef0 2023-11-04T01:39:44.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.287+0000 7f749bfff640 1 -- 172.21.15.114:0/225988796 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749402caf0 con 0x7f7490003ef0 2023-11-04T01:39:44.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.287+0000 7f74ab490640 1 -- 172.21.15.114:0/225988796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7490003ef0 msgr2=0x7f74900047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.287+0000 7f74ab490640 1 --2- 172.21.15.114:0/225988796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7490003ef0 0x7f74900047c0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f749400c240 tx=0x7f74900057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.287+0000 7f74a9a2d640 1 -- 172.21.15.114:0/225988796 reap_dead start 2023-11-04T01:39:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.287+0000 7f74ab490640 1 -- 172.21.15.114:0/225988796 shutdown_connections 2023-11-04T01:39:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.287+0000 7f74ab490640 1 -- 172.21.15.114:0/225988796 >> 172.21.15.114:0/225988796 conn(0x7f74a40ce950 msgr2=0x7f74a40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.287+0000 7f74ab490640 1 -- 172.21.15.114:0/225988796 shutdown_connections 2023-11-04T01:39:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.287+0000 7f74ab490640 1 -- 172.21.15.114:0/225988796 wait complete. 2023-11-04T01:39:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.288+0000 7f74ab490640 1 Processor -- start 2023-11-04T01:39:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.289+0000 7f74ab490640 1 -- start start 2023-11-04T01:39:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.289+0000 7f74ab490640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7490003ef0 0x7f74a414eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.289+0000 7f74ab490640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74a4156f20 0x7f74a41573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.289+0000 7f74ab490640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74a41e3350 0x7f74a41e37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.289+0000 7f74ab490640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a41578e0 con 0x7f7490003ef0 2023-11-04T01:39:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.289+0000 7f74ab490640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a41e3d10 con 0x7f74a41e3350 2023-11-04T01:39:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.289+0000 7f74ab490640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a414f0d0 con 0x7f74a4156f20 2023-11-04T01:39:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.289+0000 7f74a922c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7490003ef0 0x7f74a414eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.289+0000 7f74a922c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7490003ef0 0x7f74a414eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55198/0 (socket says 172.21.15.114:55198) 2023-11-04T01:39:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.289+0000 7f74a922c640 1 -- 172.21.15.114:0/410552600 learned_addr learned my addr 172.21.15.114:0/410552600 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.290+0000 7f74a9a2d640 1 --2- 172.21.15.114:0/410552600 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74a41e3350 0x7f74a41e37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.290+0000 7f74a8a2b640 1 --2- 172.21.15.114:0/410552600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74a4156f20 0x7f74a41573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.290+0000 7f74a922c640 1 -- 172.21.15.114:0/410552600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74a4156f20 msgr2=0x7f74a41573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.290+0000 7f74a922c640 1 --2- 172.21.15.114:0/410552600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74a4156f20 0x7f74a41573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.290+0000 7f74a922c640 1 -- 172.21.15.114:0/410552600 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74a41e3350 msgr2=0x7f74a41e37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.290+0000 7f74a922c640 1 --2- 172.21.15.114:0/410552600 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74a41e3350 0x7f74a41e37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.290+0000 7f74a922c640 1 -- 172.21.15.114:0/410552600 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40c8820 con 0x7f7490003ef0 2023-11-04T01:39:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.290+0000 7f74a9a2d640 1 --2- 172.21.15.114:0/410552600 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74a41e3350 0x7f74a41e37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.290+0000 7f74a8a2b640 1 --2- 172.21.15.114:0/410552600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74a4156f20 0x7f74a41573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.290+0000 7f74a922c640 1 --2- 172.21.15.114:0/410552600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7490003ef0 0x7f74a414eb90 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f74a0011a70 tx=0x7f74a0011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:44.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.290+0000 7f7499ffb640 1 -- 172.21.15.114:0/410552600 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0009680 con 0x7f7490003ef0 2023-11-04T01:39:44.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.290+0000 7f7499ffb640 1 -- 172.21.15.114:0/410552600 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a000fb50 con 0x7f7490003ef0 2023-11-04T01:39:44.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.290+0000 7f74ab490640 1 -- 172.21.15.114:0/410552600 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a40c7ca0 con 0x7f7490003ef0 2023-11-04T01:39:44.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.290+0000 7f7499ffb640 1 -- 172.21.15.114:0/410552600 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a000fee0 con 0x7f7490003ef0 2023-11-04T01:39:44.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.290+0000 7f74ab490640 1 -- 172.21.15.114:0/410552600 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a40c8260 con 0x7f7490003ef0 2023-11-04T01:39:44.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.291+0000 7f74ab490640 1 -- 172.21.15.114:0/410552600 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a4074290 con 0x7f7490003ef0 2023-11-04T01:39:44.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.292+0000 7f7499ffb640 1 -- 172.21.15.114:0/410552600 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f74a0014440 con 0x7f7490003ef0 2023-11-04T01:39:44.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.292+0000 7f7499ffb640 1 --2- 172.21.15.114:0/410552600 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f748806ae70 0x7f748806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.292+0000 7f7499ffb640 1 -- 172.21.15.114:0/410552600 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f74a008a1d0 con 0x7f7490003ef0 2023-11-04T01:39:44.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.292+0000 7f74a8a2b640 1 --2- 172.21.15.114:0/410552600 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f748806ae70 0x7f748806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.292+0000 7f74a8a2b640 1 --2- 172.21.15.114:0/410552600 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f748806ae70 0x7f748806d330 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7494034000 tx=0x7f7494007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:44.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.296+0000 7f7499ffb640 1 -- 172.21.15.114:0/410552600 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74a0054ff0 con 0x7f7490003ef0 2023-11-04T01:39:44.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.461+0000 7f74ab490640 1 -- 172.21.15.114:0/410552600 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f74a4071780 con 0x7f7490003ef0 2023-11-04T01:39:44.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.461+0000 7f7499ffb640 1 -- 172.21.15.114:0/410552600 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v87) v1 ==== 107+0+11 (secure 0 0 0) 0x7f74a0058610 con 0x7f7490003ef0 2023-11-04T01:39:44.463 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.463+0000 7f74ab490640 1 -- 172.21.15.114:0/410552600 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f748806ae70 msgr2=0x7f748806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.463+0000 7f74ab490640 1 --2- 172.21.15.114:0/410552600 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f748806ae70 0x7f748806d330 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7494034000 tx=0x7f7494007000 comp rx=0 tx=0).stop 2023-11-04T01:39:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.463+0000 7f74ab490640 1 -- 172.21.15.114:0/410552600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7490003ef0 msgr2=0x7f74a414eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.463+0000 7f74ab490640 1 --2- 172.21.15.114:0/410552600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7490003ef0 0x7f74a414eb90 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f74a0011a70 tx=0x7f74a0011f30 comp rx=0 tx=0).stop 2023-11-04T01:39:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.463+0000 7f74ab490640 1 -- 172.21.15.114:0/410552600 shutdown_connections 2023-11-04T01:39:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.463+0000 7f74ab490640 1 --2- 172.21.15.114:0/410552600 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f748806ae70 0x7f748806d330 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.463+0000 7f74ab490640 1 --2- 172.21.15.114:0/410552600 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f74a41e3350 0x7f74a41e37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.463+0000 7f74ab490640 1 --2- 172.21.15.114:0/410552600 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f74a4156f20 0x7f74a41573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.463+0000 7f74ab490640 1 --2- 172.21.15.114:0/410552600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7490003ef0 0x7f74a414eb90 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.463+0000 7f74ab490640 1 -- 172.21.15.114:0/410552600 >> 172.21.15.114:0/410552600 conn(0x7f74a40ce950 msgr2=0x7f74a406d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:44.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.463+0000 7f74ab490640 1 -- 172.21.15.114:0/410552600 shutdown_connections 2023-11-04T01:39:44.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.463+0000 7f74ab490640 1 -- 172.21.15.114:0/410552600 wait complete. 2023-11-04T01:39:44.475 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable' 2023-11-04T01:39:44.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.572+0000 7f395467c640 1 Processor -- start 2023-11-04T01:39:44.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.573+0000 7f395467c640 1 -- start start 2023-11-04T01:39:44.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.573+0000 7f395467c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f394c15ae40 0x7f394c0b0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.574+0000 7f395467c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f394c06c950 0x7f394c0b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.574+0000 7f395467c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394c06ce50 con 0x7f394c0c9390 2023-11-04T01:39:44.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.574+0000 7f395467c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c06d130 con 0x7f394c15ae40 2023-11-04T01:39:44.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.574+0000 7f395467c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c06d410 con 0x7f394c06c950 2023-11-04T01:39:44.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.574+0000 7f3952418640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f394c15ae40 0x7f394c0b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.574+0000 7f3952418640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f394c15ae40 0x7f394c0b0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55212/0 (socket says 172.21.15.114:55212) 2023-11-04T01:39:44.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.574+0000 7f3952418640 1 -- 172.21.15.114:0/1583852 learned_addr learned my addr 172.21.15.114:0/1583852 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:44.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.574+0000 7f3952418640 1 -- 172.21.15.114:0/1583852 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f394c06c950 msgr2=0x7f394c0b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:44.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.574+0000 7f3952418640 1 --2- 172.21.15.114:0/1583852 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f394c06c950 0x7f394c0b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.574+0000 7f3952418640 1 -- 172.21.15.114:0/1583852 >> v1:172.21.15.141:6789/0 conn(0x7f394c0c9390 legacy=0x7f394c0707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:44.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.574+0000 7f3952418640 1 -- 172.21.15.114:0/1583852 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c06d6f0 con 0x7f394c15ae40 2023-11-04T01:39:44.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.575+0000 7f3952418640 1 --2- 172.21.15.114:0/1583852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394c15ae40 0x7f394c0b0490 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f3948009870 tx=0x7f394802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf58c11e5a908be server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:44.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.575+0000 7f3951416640 1 -- 172.21.15.114:0/1583852 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948031640 con 0x7f394c15ae40 2023-11-04T01:39:44.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.575+0000 7f3951416640 1 -- 172.21.15.114:0/1583852 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39480317a0 con 0x7f394c15ae40 2023-11-04T01:39:44.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.575+0000 7f3951416640 1 -- 172.21.15.114:0/1583852 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948031b30 con 0x7f394c15ae40 2023-11-04T01:39:44.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.575+0000 7f395467c640 1 -- 172.21.15.114:0/1583852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394c15ae40 msgr2=0x7f394c0b0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.575+0000 7f395467c640 1 --2- 172.21.15.114:0/1583852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394c15ae40 0x7f394c0b0490 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f3948009870 tx=0x7f394802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.575+0000 7f395467c640 1 -- 172.21.15.114:0/1583852 shutdown_connections 2023-11-04T01:39:44.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.575+0000 7f395467c640 1 --2- 172.21.15.114:0/1583852 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f394c06c950 0x7f394c0b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.575+0000 7f395467c640 1 --2- 172.21.15.114:0/1583852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394c15ae40 0x7f394c0b0490 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.575+0000 7f395467c640 1 -- 172.21.15.114:0/1583852 >> 172.21.15.114:0/1583852 conn(0x7f394c0cb490 msgr2=0x7f394c0cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:44.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.575+0000 7f395467c640 1 -- 172.21.15.114:0/1583852 shutdown_connections 2023-11-04T01:39:44.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.575+0000 7f395467c640 1 -- 172.21.15.114:0/1583852 wait complete. 2023-11-04T01:39:44.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.577+0000 7f395467c640 1 Processor -- start 2023-11-04T01:39:44.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.577+0000 7f395467c640 1 -- start start 2023-11-04T01:39:44.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.577+0000 7f395467c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f394c06c950 0x7f394c149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.577+0000 7f395467c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f394c0c9390 0x7f394c0c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.577+0000 7f395467c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394c15ae40 0x7f394c0c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.577+0000 7f395467c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0c6c60 con 0x7f394c15ae40 2023-11-04T01:39:44.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.577+0000 7f395467c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0c6f00 con 0x7f394c0c9390 2023-11-04T01:39:44.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.577+0000 7f395467c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0c71e0 con 0x7f394c06c950 2023-11-04T01:39:44.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.577+0000 7f3952c19640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394c15ae40 0x7f394c0c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.577+0000 7f3952c19640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394c15ae40 0x7f394c0c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55226/0 (socket says 172.21.15.114:55226) 2023-11-04T01:39:44.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.577+0000 7f3952c19640 1 -- 172.21.15.114:0/1003169757 learned_addr learned my addr 172.21.15.114:0/1003169757 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:44.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.577+0000 7f3952418640 1 --2- 172.21.15.114:0/1003169757 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f394c06c950 0x7f394c149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.577+0000 7f3951c17640 1 --2- 172.21.15.114:0/1003169757 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f394c0c9390 0x7f394c0c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.578+0000 7f3952c19640 1 -- 172.21.15.114:0/1003169757 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f394c06c950 msgr2=0x7f394c149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.578+0000 7f3952c19640 1 --2- 172.21.15.114:0/1003169757 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f394c06c950 0x7f394c149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.578+0000 7f3952c19640 1 -- 172.21.15.114:0/1003169757 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f394c0c9390 msgr2=0x7f394c0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.578+0000 7f3952c19640 1 --2- 172.21.15.114:0/1003169757 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f394c0c9390 0x7f394c0c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.578+0000 7f3952c19640 1 -- 172.21.15.114:0/1003169757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39480094d0 con 0x7f394c15ae40 2023-11-04T01:39:44.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.578+0000 7f3952c19640 1 --2- 172.21.15.114:0/1003169757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394c15ae40 0x7f394c0c8200 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f394400c780 tx=0x7f394400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:44.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.578+0000 7f3942ffd640 1 -- 172.21.15.114:0/1003169757 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944003b70 con 0x7f394c15ae40 2023-11-04T01:39:44.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.578+0000 7f3942ffd640 1 -- 172.21.15.114:0/1003169757 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3944003cd0 con 0x7f394c15ae40 2023-11-04T01:39:44.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.578+0000 7f395467c640 1 -- 172.21.15.114:0/1003169757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394c0c74c0 con 0x7f394c15ae40 2023-11-04T01:39:44.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.578+0000 7f3942ffd640 1 -- 172.21.15.114:0/1003169757 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39440052b0 con 0x7f394c15ae40 2023-11-04T01:39:44.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.578+0000 7f395467c640 1 -- 172.21.15.114:0/1003169757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c14a000 con 0x7f394c15ae40 2023-11-04T01:39:44.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.579+0000 7f395467c640 1 -- 172.21.15.114:0/1003169757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394c0c79e0 con 0x7f394c15ae40 2023-11-04T01:39:44.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.579+0000 7f3942ffd640 1 -- 172.21.15.114:0/1003169757 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3944005410 con 0x7f394c15ae40 2023-11-04T01:39:44.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.580+0000 7f3942ffd640 1 --2- 172.21.15.114:0/1003169757 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f393006ae70 0x7f393006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.580+0000 7f3942ffd640 1 -- 172.21.15.114:0/1003169757 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f3944088f70 con 0x7f394c15ae40 2023-11-04T01:39:44.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.580+0000 7f3952418640 1 --2- 172.21.15.114:0/1003169757 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f393006ae70 0x7f393006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.580+0000 7f3952418640 1 --2- 172.21.15.114:0/1003169757 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f393006ae70 0x7f393006d330 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3948036000 tx=0x7f394803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:44.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.584+0000 7f3942ffd640 1 -- 172.21.15.114:0/1003169757 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39440bbca0 con 0x7f394c15ae40 2023-11-04T01:39:44.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:44.818+0000 7f395467c640 1 -- 172.21.15.114:0/1003169757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable"]} v 0) v1 -- 0x7f394c074290 con 0x7f394c15ae40 2023-11-04T01:39:45.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.000+0000 7f3942ffd640 1 -- 172.21.15.114:0/1003169757 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable"]}]=0 v204) v1 ==== 142+0+0 (secure 0 0 0) 0x7f39440170d0 con 0x7f394c15ae40 2023-11-04T01:39:45.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.002+0000 7f395467c640 1 -- 172.21.15.114:0/1003169757 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f393006ae70 msgr2=0x7f393006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.002+0000 7f395467c640 1 --2- 172.21.15.114:0/1003169757 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f393006ae70 0x7f393006d330 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3948036000 tx=0x7f394803c040 comp rx=0 tx=0).stop 2023-11-04T01:39:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.002+0000 7f395467c640 1 -- 172.21.15.114:0/1003169757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394c15ae40 msgr2=0x7f394c0c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.002+0000 7f395467c640 1 --2- 172.21.15.114:0/1003169757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394c15ae40 0x7f394c0c8200 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f394400c780 tx=0x7f394400cb80 comp rx=0 tx=0).stop 2023-11-04T01:39:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.003+0000 7f395467c640 1 -- 172.21.15.114:0/1003169757 shutdown_connections 2023-11-04T01:39:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.003+0000 7f395467c640 1 --2- 172.21.15.114:0/1003169757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394c15ae40 0x7f394c0c8200 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.003+0000 7f395467c640 1 --2- 172.21.15.114:0/1003169757 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f393006ae70 0x7f393006d330 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.003+0000 7f395467c640 1 --2- 172.21.15.114:0/1003169757 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f394c0c9390 0x7f394c0c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.003+0000 7f395467c640 1 --2- 172.21.15.114:0/1003169757 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f394c06c950 0x7f394c149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.003+0000 7f395467c640 1 -- 172.21.15.114:0/1003169757 >> 172.21.15.114:0/1003169757 conn(0x7f394c0cb490 msgr2=0x7f394c0b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.003+0000 7f395467c640 1 -- 172.21.15.114:0/1003169757 shutdown_connections 2023-11-04T01:39:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.003+0000 7f395467c640 1 -- 172.21.15.114:0/1003169757 wait complete. 2023-11-04T01:39:45.015 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:39:45.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.115+0000 7f2d9732c640 1 Processor -- start 2023-11-04T01:39:45.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.116+0000 7f2d9732c640 1 -- start start 2023-11-04T01:39:45.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.116+0000 7f2d9732c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d90153e60 0x7f2d9015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.116+0000 7f2d9732c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2d900cd6d0 0x7f2d90161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.116+0000 7f2d9732c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2d900b4880 0x7f2d900b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.116+0000 7f2d9732c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d900cde60 con 0x7f2d900cd6d0 2023-11-04T01:39:45.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.116+0000 7f2d9732c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d90160f90 con 0x7f2d900b4880 2023-11-04T01:39:45.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.116+0000 7f2d9732c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900b5200 con 0x7f2d90153e60 2023-11-04T01:39:45.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.116+0000 7f2d948c7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2d900cd6d0 0x7f2d90161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.117+0000 7f2d948c7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2d900cd6d0 0x7f2d90161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55230/0 (socket says 172.21.15.114:55230) 2023-11-04T01:39:45.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.117+0000 7f2d948c7640 1 -- 172.21.15.114:0/3046550455 learned_addr learned my addr 172.21.15.114:0/3046550455 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:45.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.117+0000 7f2d958c9640 1 --2- 172.21.15.114:0/3046550455 >> v2:172.21.15.141:3300/0 conn(0x7f2d900b4880 0x7f2d900b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.117+0000 7f2d950c8640 1 --2- 172.21.15.114:0/3046550455 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d90153e60 0x7f2d9015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.117+0000 7f2d948c7640 1 -- 172.21.15.114:0/3046550455 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d90153e60 msgr2=0x7f2d9015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:45.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.117+0000 7f2d948c7640 1 --2- 172.21.15.114:0/3046550455 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d90153e60 0x7f2d9015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.117+0000 7f2d948c7640 1 -- 172.21.15.114:0/3046550455 >> v2:172.21.15.141:3300/0 conn(0x7f2d900b4880 msgr2=0x7f2d900b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:45.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.117+0000 7f2d948c7640 1 --2- 172.21.15.114:0/3046550455 >> v2:172.21.15.141:3300/0 conn(0x7f2d900b4880 0x7f2d900b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.117+0000 7f2d948c7640 1 -- 172.21.15.114:0/3046550455 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9015e400 con 0x7f2d900cd6d0 2023-11-04T01:39:45.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.117+0000 7f2d958c9640 1 --2- 172.21.15.114:0/3046550455 >> v2:172.21.15.141:3300/0 conn(0x7f2d900b4880 0x7f2d900b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:45.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.117+0000 7f2d950c8640 1 --2- 172.21.15.114:0/3046550455 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d90153e60 0x7f2d9015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:45.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.117+0000 7f2d948c7640 1 --2- 172.21.15.114:0/3046550455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d900cd6d0 0x7f2d90161420 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f2d900c9e50 tx=0x7f2d8002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa36989ca3e2ee86 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:45.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.118+0000 7f2d87fff640 1 -- 172.21.15.114:0/3046550455 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80031860 con 0x7f2d900cd6d0 2023-11-04T01:39:45.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.118+0000 7f2d87fff640 1 -- 172.21.15.114:0/3046550455 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d800319c0 con 0x7f2d900cd6d0 2023-11-04T01:39:45.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.118+0000 7f2d87fff640 1 -- 172.21.15.114:0/3046550455 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80031d50 con 0x7f2d900cd6d0 2023-11-04T01:39:45.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.118+0000 7f2d9732c640 1 -- 172.21.15.114:0/3046550455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d900cd6d0 msgr2=0x7f2d90161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.118+0000 7f2d9732c640 1 --2- 172.21.15.114:0/3046550455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d900cd6d0 0x7f2d90161420 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f2d900c9e50 tx=0x7f2d8002b900 comp rx=0 tx=0).stop 2023-11-04T01:39:45.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.118+0000 7f2d9732c640 1 -- 172.21.15.114:0/3046550455 shutdown_connections 2023-11-04T01:39:45.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.118+0000 7f2d9732c640 1 --2- 172.21.15.114:0/3046550455 >> v2:172.21.15.141:3300/0 conn(0x7f2d900b4880 0x7f2d900b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.118+0000 7f2d9732c640 1 --2- 172.21.15.114:0/3046550455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d900cd6d0 0x7f2d90161420 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.118+0000 7f2d9732c640 1 --2- 172.21.15.114:0/3046550455 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d90153e60 0x7f2d9015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.118+0000 7f2d9732c640 1 -- 172.21.15.114:0/3046550455 >> 172.21.15.114:0/3046550455 conn(0x7f2d900cf880 msgr2=0x7f2d900cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:45.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.118+0000 7f2d9732c640 1 -- 172.21.15.114:0/3046550455 shutdown_connections 2023-11-04T01:39:45.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.118+0000 7f2d9732c640 1 -- 172.21.15.114:0/3046550455 wait complete. 2023-11-04T01:39:45.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.119+0000 7f2d9732c640 1 Processor -- start 2023-11-04T01:39:45.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.119+0000 7f2d9732c640 1 -- start start 2023-11-04T01:39:45.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.120+0000 7f2d9732c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d900b4880 0x7f2d901f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.120+0000 7f2d9732c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d900cd6d0 0x7f2d901f6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.120+0000 7f2d9732c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d90153e60 0x7f2d90152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.120+0000 7f2d9732c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d90157d10 con 0x7f2d900b4880 2023-11-04T01:39:45.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.120+0000 7f2d9732c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d901f69c0 con 0x7f2d90153e60 2023-11-04T01:39:45.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.120+0000 7f2d9732c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d90153420 con 0x7f2d900cd6d0 2023-11-04T01:39:45.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.120+0000 7f2d950c8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d900b4880 0x7f2d901f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.120+0000 7f2d950c8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d900b4880 0x7f2d901f24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55234/0 (socket says 172.21.15.114:55234) 2023-11-04T01:39:45.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.120+0000 7f2d950c8640 1 -- 172.21.15.114:0/893465533 learned_addr learned my addr 172.21.15.114:0/893465533 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:45.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.120+0000 7f2d950c8640 1 -- 172.21.15.114:0/893465533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d900cd6d0 msgr2=0x7f2d901f6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.120+0000 7f2d950c8640 1 --2- 172.21.15.114:0/893465533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d900cd6d0 0x7f2d901f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.120+0000 7f2d950c8640 1 -- 172.21.15.114:0/893465533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d90153e60 msgr2=0x7f2d90152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.120+0000 7f2d958c9640 1 --2- 172.21.15.114:0/893465533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d90153e60 0x7f2d90152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.120+0000 7f2d950c8640 1 --2- 172.21.15.114:0/893465533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d90153e60 0x7f2d90152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.120+0000 7f2d950c8640 1 -- 172.21.15.114:0/893465533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d800094d0 con 0x7f2d900b4880 2023-11-04T01:39:45.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.121+0000 7f2d950c8640 1 --2- 172.21.15.114:0/893465533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d900b4880 0x7f2d901f24f0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00c820 tx=0x7f2d8c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:45.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.121+0000 7f2d85ffb640 1 -- 172.21.15.114:0/893465533 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c007a30 con 0x7f2d900b4880 2023-11-04T01:39:45.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.121+0000 7f2d85ffb640 1 -- 172.21.15.114:0/893465533 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c007b90 con 0x7f2d900b4880 2023-11-04T01:39:45.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.121+0000 7f2d9732c640 1 -- 172.21.15.114:0/893465533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d90156f50 con 0x7f2d900b4880 2023-11-04T01:39:45.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.121+0000 7f2d85ffb640 1 -- 172.21.15.114:0/893465533 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c00ce10 con 0x7f2d900b4880 2023-11-04T01:39:45.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.121+0000 7f2d9732c640 1 -- 172.21.15.114:0/893465533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d901f2b80 con 0x7f2d900b4880 2023-11-04T01:39:45.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.122+0000 7f2d9732c640 1 -- 172.21.15.114:0/893465533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d90074290 con 0x7f2d900b4880 2023-11-04T01:39:45.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.122+0000 7f2d85ffb640 1 -- 172.21.15.114:0/893465533 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d8c0113f0 con 0x7f2d900b4880 2023-11-04T01:39:45.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.123+0000 7f2d85ffb640 1 --2- 172.21.15.114:0/893465533 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2d7406ae70 0x7f2d7406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.123+0000 7f2d85ffb640 1 -- 172.21.15.114:0/893465533 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f2d8c089970 con 0x7f2d900b4880 2023-11-04T01:39:45.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.123+0000 7f2d948c7640 1 --2- 172.21.15.114:0/893465533 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2d7406ae70 0x7f2d7406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.123+0000 7f2d948c7640 1 --2- 172.21.15.114:0/893465533 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2d7406ae70 0x7f2d7406d330 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2d80036000 tx=0x7f2d80030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:45.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.127+0000 7f2d85ffb640 1 -- 172.21.15.114:0/893465533 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2d8c054790 con 0x7f2d900b4880 2023-11-04T01:39:45.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.295+0000 7f2d9732c640 1 -- 172.21.15.114:0/893465533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2d9015d640 con 0x7f2d900b4880 2023-11-04T01:39:45.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.298+0000 7f2d85ffb640 1 -- 172.21.15.114:0/893465533 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v19)=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2d9015d640 con 0x7f2d900b4880 2023-11-04T01:39:45.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.300+0000 7f2d9732c640 1 -- 172.21.15.114:0/893465533 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2d7406ae70 msgr2=0x7f2d7406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.300+0000 7f2d9732c640 1 --2- 172.21.15.114:0/893465533 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2d7406ae70 0x7f2d7406d330 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2d80036000 tx=0x7f2d80030000 comp rx=0 tx=0).stop 2023-11-04T01:39:45.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.300+0000 7f2d9732c640 1 -- 172.21.15.114:0/893465533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d900b4880 msgr2=0x7f2d901f24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.300+0000 7f2d9732c640 1 --2- 172.21.15.114:0/893465533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d900b4880 0x7f2d901f24f0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00c820 tx=0x7f2d8c00cce0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.300+0000 7f2d9732c640 1 -- 172.21.15.114:0/893465533 shutdown_connections 2023-11-04T01:39:45.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.300+0000 7f2d9732c640 1 --2- 172.21.15.114:0/893465533 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2d7406ae70 0x7f2d7406d330 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.300+0000 7f2d9732c640 1 --2- 172.21.15.114:0/893465533 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2d90153e60 0x7f2d90152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.300+0000 7f2d9732c640 1 --2- 172.21.15.114:0/893465533 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2d900cd6d0 0x7f2d901f6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.300+0000 7f2d9732c640 1 --2- 172.21.15.114:0/893465533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d900b4880 0x7f2d901f24f0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.300+0000 7f2d9732c640 1 -- 172.21.15.114:0/893465533 >> 172.21.15.114:0/893465533 conn(0x7f2d900cf880 msgr2=0x7f2d900d25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:45.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.300+0000 7f2d9732c640 1 -- 172.21.15.114:0/893465533 shutdown_connections 2023-11-04T01:39:45.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.300+0000 7f2d9732c640 1 -- 172.21.15.114:0/893465533 wait complete. 2023-11-04T01:39:45.313 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:39:45.313 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:39:45.360 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:39:45.426 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:39:45.426 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:39:45.426 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:45.441 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:39:45.442 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:39:45.442 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:45.460 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:39:45.460 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:39:45.460 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:45.496 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:39:45.497 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:39:45.497 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:39:45.517 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:39:45.517 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:39:45.517 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:45.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.635+0000 7fe0fe37c640 1 Processor -- start 2023-11-04T01:39:45.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.635+0000 7fe0fe37c640 1 -- start start 2023-11-04T01:39:45.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.636+0000 7fe0fe37c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0f80b0ae0 0x7fe0f80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.636+0000 7fe0fe37c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0f806db20 0x7fe0f815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.636+0000 7fe0fe37c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f80b4110 con 0x7fe0f8159c70 2023-11-04T01:39:45.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.636+0000 7fe0fe37c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f80b49b0 con 0x7fe0f80b0ae0 2023-11-04T01:39:45.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.636+0000 7fe0fe37c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f80b43f0 con 0x7fe0f806db20 2023-11-04T01:39:45.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.636+0000 7fe0f77fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0f80b0ae0 0x7fe0f80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.636+0000 7fe0f77fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0f80b0ae0 0x7fe0f80ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55238/0 (socket says 172.21.15.114:55238) 2023-11-04T01:39:45.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.636+0000 7fe0f77fe640 1 -- 172.21.15.114:0/2075704993 learned_addr learned my addr 172.21.15.114:0/2075704993 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:45.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.636+0000 7fe0fc919640 1 --2- 172.21.15.114:0/2075704993 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0f806db20 0x7fe0f815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.636+0000 7fe0f77fe640 1 -- 172.21.15.114:0/2075704993 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0f806db20 msgr2=0x7fe0f815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:45.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.636+0000 7fe0f77fe640 1 --2- 172.21.15.114:0/2075704993 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0f806db20 0x7fe0f815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.636+0000 7fe0f77fe640 1 -- 172.21.15.114:0/2075704993 >> v1:172.21.15.141:6789/0 conn(0x7fe0f8159c70 legacy=0x7fe0f80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.636+0000 7fe0f77fe640 1 -- 172.21.15.114:0/2075704993 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f80b46d0 con 0x7fe0f80b0ae0 2023-11-04T01:39:45.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.637+0000 7fe0f77fe640 1 --2- 172.21.15.114:0/2075704993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f80b0ae0 0x7fe0f80ce370 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009870 tx=0x7fe0ec02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5e38573e14e6d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:45.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.637+0000 7fe0f6ffd640 1 -- 172.21.15.114:0/2075704993 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec030840 con 0x7fe0f80b0ae0 2023-11-04T01:39:45.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.637+0000 7fe0f6ffd640 1 -- 172.21.15.114:0/2075704993 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec0309a0 con 0x7fe0f80b0ae0 2023-11-04T01:39:45.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.637+0000 7fe0f6ffd640 1 -- 172.21.15.114:0/2075704993 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec030d30 con 0x7fe0f80b0ae0 2023-11-04T01:39:45.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.638+0000 7fe0fe37c640 1 -- 172.21.15.114:0/2075704993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f80b0ae0 msgr2=0x7fe0f80ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.638+0000 7fe0fe37c640 1 --2- 172.21.15.114:0/2075704993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f80b0ae0 0x7fe0f80ce370 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009870 tx=0x7fe0ec02b980 comp rx=0 tx=0).stop 2023-11-04T01:39:45.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.638+0000 7fe0fe37c640 1 -- 172.21.15.114:0/2075704993 shutdown_connections 2023-11-04T01:39:45.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.638+0000 7fe0fe37c640 1 --2- 172.21.15.114:0/2075704993 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0f806db20 0x7fe0f815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.638+0000 7fe0fe37c640 1 --2- 172.21.15.114:0/2075704993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f80b0ae0 0x7fe0f80ce370 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.638+0000 7fe0fe37c640 1 -- 172.21.15.114:0/2075704993 >> 172.21.15.114:0/2075704993 conn(0x7fe0f80ce950 msgr2=0x7fe0f80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:45.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.638+0000 7fe0fe37c640 1 -- 172.21.15.114:0/2075704993 shutdown_connections 2023-11-04T01:39:45.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.638+0000 7fe0fe37c640 1 -- 172.21.15.114:0/2075704993 wait complete. 2023-11-04T01:39:45.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.639+0000 7fe0fe37c640 1 Processor -- start 2023-11-04T01:39:45.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.639+0000 7fe0fe37c640 1 -- start start 2023-11-04T01:39:45.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0fe37c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f806db20 0x7fe0f80cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0fe37c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0f80b0ae0 0x7fe0f80c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0fe37c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0f8159c70 0x7fe0f814bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0fe37c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f80b2d60 con 0x7fe0f806db20 2023-11-04T01:39:45.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0fe37c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f80c7520 con 0x7fe0f80b0ae0 2023-11-04T01:39:45.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0fe37c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f80c77c0 con 0x7fe0f8159c70 2023-11-04T01:39:45.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0f7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f806db20 0x7fe0f80cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0f7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f806db20 0x7fe0f80cd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55246/0 (socket says 172.21.15.114:55246) 2023-11-04T01:39:45.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0f7fff640 1 -- 172.21.15.114:0/3234955515 learned_addr learned my addr 172.21.15.114:0/3234955515 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:45.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0f77fe640 1 --2- 172.21.15.114:0/3234955515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0f80b0ae0 0x7fe0f80c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0fc919640 1 --2- 172.21.15.114:0/3234955515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0f8159c70 0x7fe0f814bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0f7fff640 1 -- 172.21.15.114:0/3234955515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0f8159c70 msgr2=0x7fe0f814bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0f7fff640 1 --2- 172.21.15.114:0/3234955515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0f8159c70 0x7fe0f814bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0f7fff640 1 -- 172.21.15.114:0/3234955515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0f80b0ae0 msgr2=0x7fe0f80c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0f7fff640 1 --2- 172.21.15.114:0/3234955515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0f80b0ae0 0x7fe0f80c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0f7fff640 1 -- 172.21.15.114:0/3234955515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec0094d0 con 0x7fe0f806db20 2023-11-04T01:39:45.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.640+0000 7fe0f7fff640 1 --2- 172.21.15.114:0/3234955515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f806db20 0x7fe0f80cd380 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fe0e800c400 tx=0x7fe0e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:45.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.641+0000 7fe0f4ff9640 1 -- 172.21.15.114:0/3234955515 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e80052d0 con 0x7fe0f806db20 2023-11-04T01:39:45.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.641+0000 7fe0f4ff9640 1 -- 172.21.15.114:0/3234955515 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e8005430 con 0x7fe0f806db20 2023-11-04T01:39:45.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.641+0000 7fe0fe37c640 1 -- 172.21.15.114:0/3234955515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f80c7aa0 con 0x7fe0f806db20 2023-11-04T01:39:45.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.641+0000 7fe0f4ff9640 1 -- 172.21.15.114:0/3234955515 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8003830 con 0x7fe0f806db20 2023-11-04T01:39:45.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.641+0000 7fe0fe37c640 1 -- 172.21.15.114:0/3234955515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f814c160 con 0x7fe0f806db20 2023-11-04T01:39:45.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.642+0000 7fe0fe37c640 1 -- 172.21.15.114:0/3234955515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f8074290 con 0x7fe0f806db20 2023-11-04T01:39:45.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.642+0000 7fe0f4ff9640 1 -- 172.21.15.114:0/3234955515 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe0e8003990 con 0x7fe0f806db20 2023-11-04T01:39:45.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.642+0000 7fe0f4ff9640 1 --2- 172.21.15.114:0/3234955515 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe0e406ae70 0x7fe0e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:45.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.642+0000 7fe0f4ff9640 1 -- 172.21.15.114:0/3234955515 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fe0e8088e20 con 0x7fe0f806db20 2023-11-04T01:39:45.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.642+0000 7fe0f77fe640 1 --2- 172.21.15.114:0/3234955515 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe0e406ae70 0x7fe0e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:45.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.643+0000 7fe0f77fe640 1 --2- 172.21.15.114:0/3234955515 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe0e406ae70 0x7fe0e406d330 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec036000 tx=0x7fe0ec03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:45.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.647+0000 7fe0f4ff9640 1 -- 172.21.15.114:0/3234955515 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe0e8053c40 con 0x7fe0f806db20 2023-11-04T01:39:45.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.849+0000 7fe0fe37c640 1 -- 172.21.15.114:0/3234955515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0f806d3f0 con 0x7fe0f806db20 2023-11-04T01:39:45.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.849+0000 7fe0f4ff9640 1 -- 172.21.15.114:0/3234955515 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+3708 (secure 0 0 0) 0x7fe0e8017090 con 0x7fe0f806db20 2023-11-04T01:39:45.851 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:45.851 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6055,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/775121992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":775121992},{"type":"v1","addr":"172.21.15.141:6835","nonce":775121992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/2442365108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":2442365108},{"type":"v1","addr":"172.21.15.141:6834","nonce":2442365108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6951,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1790830778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1790830778},{"type":"v1","addr":"172.21.15.114:6836","nonce":1790830778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6954,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2482757978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2482757978},{"type":"v1","addr":"172.21.15.114:6837","nonce":2482757978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[]} 2023-11-04T01:39:45.852 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 39 2023-11-04T01:39:45.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.851+0000 7fe0fe37c640 1 -- 172.21.15.114:0/3234955515 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe0e406ae70 msgr2=0x7fe0e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.851+0000 7fe0fe37c640 1 --2- 172.21.15.114:0/3234955515 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe0e406ae70 0x7fe0e406d330 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec036000 tx=0x7fe0ec03b040 comp rx=0 tx=0).stop 2023-11-04T01:39:45.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.851+0000 7fe0fe37c640 1 -- 172.21.15.114:0/3234955515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f806db20 msgr2=0x7fe0f80cd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:45.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.851+0000 7fe0fe37c640 1 --2- 172.21.15.114:0/3234955515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f806db20 0x7fe0f80cd380 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fe0e800c400 tx=0x7fe0e800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.851+0000 7fe0fe37c640 1 -- 172.21.15.114:0/3234955515 shutdown_connections 2023-11-04T01:39:45.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.851+0000 7fe0fe37c640 1 --2- 172.21.15.114:0/3234955515 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0f8159c70 0x7fe0f814bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.851+0000 7fe0fe37c640 1 --2- 172.21.15.114:0/3234955515 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe0e406ae70 0x7fe0e406d330 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.851+0000 7fe0fe37c640 1 --2- 172.21.15.114:0/3234955515 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0f80b0ae0 0x7fe0f80c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.851+0000 7fe0fe37c640 1 --2- 172.21.15.114:0/3234955515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f806db20 0x7fe0f80cd380 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:45.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.851+0000 7fe0fe37c640 1 -- 172.21.15.114:0/3234955515 >> 172.21.15.114:0/3234955515 conn(0x7fe0f80ce950 msgr2=0x7fe0f815aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:45.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.852+0000 7fe0fe37c640 1 -- 172.21.15.114:0/3234955515 shutdown_connections 2023-11-04T01:39:45.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:45.852+0000 7fe0fe37c640 1 -- 172.21.15.114:0/3234955515 wait complete. 2023-11-04T01:39:45.864 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:39:45.864 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:39:45.865 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:39:45.865 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:45.865 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:39:45.865 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:39:45.865 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:39:45.865 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:45.866 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:39:45.866 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:39:45.866 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:39:45.866 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:45.866 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:39:45.866 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:39:45.867 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:39:45.867 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:39:45.874 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:39:45.874 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:39:45.875 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:39:45.875 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:39:45.878 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:39:45.879 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:39:45.879 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:39:45.879 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:39:45.917 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:39:45.917 DEBUG:teuthology.parallel:result is None 2023-11-04T01:39:45.918 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:39:45.918 DEBUG:teuthology.parallel:result is None 2023-11-04T01:39:45.921 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:39:45.921 DEBUG:teuthology.parallel:result is None 2023-11-04T01:39:45.921 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:39:45.922 DEBUG:teuthology.parallel:result is None 2023-11-04T01:39:45.922 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:39:45.993 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2023-11-04T01:39:45.993 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2023-11-04T01:39:46.001 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-04T01:39:46.002 INFO:tasks.ceph.mds.d.smithi141.stdout:starting mds.d at 2023-11-04T01:39:46.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.026+0000 7fc6ba59e640 1 Processor -- start 2023-11-04T01:39:46.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.026+0000 7fc6ba59e640 1 -- start start 2023-11-04T01:39:46.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.027+0000 7fc6ba59e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6b415ccc0 0x7fc6b40b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:46.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.027+0000 7fc6ba59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc6b415d0a0 0x7fc6b40b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:46.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.027+0000 7fc6ba59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b4160df0 con 0x7fc6b40cd680 2023-11-04T01:39:46.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.027+0000 7fc6ba59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b40ce260 con 0x7fc6b415d0a0 2023-11-04T01:39:46.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.027+0000 7fc6ba59e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40ce540 con 0x7fc6b415ccc0 2023-11-04T01:39:46.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.027+0000 7fc6b37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc6b415d0a0 0x7fc6b40b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:46.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.027+0000 7fc6b8b3b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc6b40cd680 0x7fc6b40cdab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41574/0 (socket says 172.21.15.114:41574) 2023-11-04T01:39:46.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.027+0000 7fc6b37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc6b415d0a0 0x7fc6b40b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55290/0 (socket says 172.21.15.114:55290) 2023-11-04T01:39:46.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.027+0000 7fc6b8b3b640 1 -- 172.21.15.114:0/1455478468 learned_addr learned my addr 172.21.15.114:0/1455478468 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:46.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.027+0000 7fc6b3fff640 1 --2- 172.21.15.114:0/1455478468 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6b415ccc0 0x7fc6b40b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:46.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.028+0000 7fc6b37fe640 1 -- 172.21.15.114:0/1455478468 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6b415ccc0 msgr2=0x7fc6b40b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:46.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.028+0000 7fc6b37fe640 1 --2- 172.21.15.114:0/1455478468 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6b415ccc0 0x7fc6b40b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:46.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.028+0000 7fc6b37fe640 1 -- 172.21.15.114:0/1455478468 >> v1:172.21.15.114:6789/0 conn(0x7fc6b40cd680 legacy=0x7fc6b40cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:46.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.028+0000 7fc6b37fe640 1 -- 172.21.15.114:0/1455478468 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b40d1050 con 0x7fc6b415d0a0 2023-11-04T01:39:46.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.028+0000 7fc6b2ffd640 1 -- 172.21.15.114:0/1455478468 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610877185 0 0) 0x7fc6ac001490 con 0x7fc6b40cd680 2023-11-04T01:39:46.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.028+0000 7fc6b3fff640 1 --2- 172.21.15.114:0/1455478468 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6b415ccc0 0x7fc6b40b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:46.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.028+0000 7fc6b37fe640 1 --2- 172.21.15.114:0/1455478468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6b415d0a0 0x7fc6b40b4de0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80097a0 tx=0x7fc6a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07817eed6f9aed3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:46.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.028+0000 7fc6b2ffd640 1 -- 172.21.15.114:0/1455478468 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8031830 con 0x7fc6b415d0a0 2023-11-04T01:39:46.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.029+0000 7fc6b2ffd640 1 -- 172.21.15.114:0/1455478468 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a8031990 con 0x7fc6b415d0a0 2023-11-04T01:39:46.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.029+0000 7fc6b2ffd640 1 -- 172.21.15.114:0/1455478468 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8031d20 con 0x7fc6b415d0a0 2023-11-04T01:39:46.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.029+0000 7fc6ba59e640 1 -- 172.21.15.114:0/1455478468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6b415d0a0 msgr2=0x7fc6b40b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:46.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.029+0000 7fc6ba59e640 1 --2- 172.21.15.114:0/1455478468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6b415d0a0 0x7fc6b40b4de0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80097a0 tx=0x7fc6a802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:46.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.029+0000 7fc6ba59e640 1 -- 172.21.15.114:0/1455478468 shutdown_connections 2023-11-04T01:39:46.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.029+0000 7fc6ba59e640 1 --2- 172.21.15.114:0/1455478468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6b415d0a0 0x7fc6b40b4de0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:46.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.029+0000 7fc6ba59e640 1 --2- 172.21.15.114:0/1455478468 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6b415ccc0 0x7fc6b40b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:46.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.029+0000 7fc6ba59e640 1 -- 172.21.15.114:0/1455478468 >> 172.21.15.114:0/1455478468 conn(0x7fc6b40cf8a0 msgr2=0x7fc6b40cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:46.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.029+0000 7fc6ba59e640 1 -- 172.21.15.114:0/1455478468 shutdown_connections 2023-11-04T01:39:46.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.029+0000 7fc6ba59e640 1 -- 172.21.15.114:0/1455478468 wait complete. 2023-11-04T01:39:46.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.031+0000 7fc6ba59e640 1 Processor -- start 2023-11-04T01:39:46.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.031+0000 7fc6ba59e640 1 -- start start 2023-11-04T01:39:46.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6ba59e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6b40cd680 0x7fc6b41524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:46.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6ba59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6b415ccc0 0x7fc6b40b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:46.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6ba59e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6b415d0a0 0x7fc6b40b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:46.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6ba59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40c7c50 con 0x7fc6b415ccc0 2023-11-04T01:39:46.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6ba59e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40b3670 con 0x7fc6b40cd680 2023-11-04T01:39:46.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6ba59e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40b3950 con 0x7fc6b415d0a0 2023-11-04T01:39:46.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6b37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6b415ccc0 0x7fc6b40b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:46.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6b37fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6b415ccc0 0x7fc6b40b7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55300/0 (socket says 172.21.15.114:55300) 2023-11-04T01:39:46.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6b37fe640 1 -- 172.21.15.114:0/2635910395 learned_addr learned my addr 172.21.15.114:0/2635910395 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:46.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6b3fff640 1 --2- 172.21.15.114:0/2635910395 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6b40cd680 0x7fc6b41524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:46.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6b8b3b640 1 --2- 172.21.15.114:0/2635910395 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6b415d0a0 0x7fc6b40b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:46.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6b37fe640 1 -- 172.21.15.114:0/2635910395 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6b415d0a0 msgr2=0x7fc6b40b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:46.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6b37fe640 1 --2- 172.21.15.114:0/2635910395 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6b415d0a0 0x7fc6b40b78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:46.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6b37fe640 1 -- 172.21.15.114:0/2635910395 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6b40cd680 msgr2=0x7fc6b41524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:46.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6b37fe640 1 --2- 172.21.15.114:0/2635910395 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6b40cd680 0x7fc6b41524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:46.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6b37fe640 1 -- 172.21.15.114:0/2635910395 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8009400 con 0x7fc6b415ccc0 2023-11-04T01:39:46.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6b8b3b640 1 --2- 172.21.15.114:0/2635910395 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6b415d0a0 0x7fc6b40b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:46.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6b37fe640 1 --2- 172.21.15.114:0/2635910395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6b415ccc0 0x7fc6b40b7360 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8034040 tx=0x7fc6a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:46.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6b0ff9640 1 -- 172.21.15.114:0/2635910395 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a803aa60 con 0x7fc6b415ccc0 2023-11-04T01:39:46.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6b0ff9640 1 -- 172.21.15.114:0/2635910395 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a803abe0 con 0x7fc6b415ccc0 2023-11-04T01:39:46.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6b0ff9640 1 -- 172.21.15.114:0/2635910395 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8044400 con 0x7fc6b415ccc0 2023-11-04T01:39:46.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.032+0000 7fc6ba59e640 1 -- 172.21.15.114:0/2635910395 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b40c7ef0 con 0x7fc6b415ccc0 2023-11-04T01:39:46.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.033+0000 7fc6ba59e640 1 -- 172.21.15.114:0/2635910395 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b40b2920 con 0x7fc6b415ccc0 2023-11-04T01:39:46.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.034+0000 7fc6ba59e640 1 -- 172.21.15.114:0/2635910395 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b40674e0 con 0x7fc6b415ccc0 2023-11-04T01:39:46.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.034+0000 7fc6b0ff9640 1 -- 172.21.15.114:0/2635910395 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc6a804d440 con 0x7fc6b415ccc0 2023-11-04T01:39:46.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.034+0000 7fc6b0ff9640 1 --2- 172.21.15.114:0/2635910395 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc6a006ae70 0x7fc6a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:46.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.034+0000 7fc6b0ff9640 1 -- 172.21.15.114:0/2635910395 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fc6a80abaa0 con 0x7fc6b415ccc0 2023-11-04T01:39:46.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.034+0000 7fc6b3fff640 1 --2- 172.21.15.114:0/2635910395 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc6a006ae70 0x7fc6a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:46.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.035+0000 7fc6b3fff640 1 --2- 172.21.15.114:0/2635910395 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc6a006ae70 0x7fc6a006d330 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc6b40b4a30 tx=0x7fc6a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:46.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.039+0000 7fc6b0ff9640 1 -- 172.21.15.114:0/2635910395 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc6a80768c0 con 0x7fc6b415ccc0 2023-11-04T01:39:46.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:46.216+0000 7fc6ba59e640 1 -- 172.21.15.114:0/2635910395 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc6b40d0b60 con 0x7fc6b415ccc0 2023-11-04T01:39:47.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.587+0000 7fc6b0ff9640 1 -- 172.21.15.114:0/2635910395 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v92) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc6a8035020 con 0x7fc6b415ccc0 2023-11-04T01:39:47.589 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2023-11-04T01:39:47.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.590+0000 7fc6ba59e640 1 -- 172.21.15.114:0/2635910395 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc6a006ae70 msgr2=0x7fc6a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.590+0000 7fc6ba59e640 1 --2- 172.21.15.114:0/2635910395 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc6a006ae70 0x7fc6a006d330 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc6b40b4a30 tx=0x7fc6a4008040 comp rx=0 tx=0).stop 2023-11-04T01:39:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.590+0000 7fc6ba59e640 1 -- 172.21.15.114:0/2635910395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6b415ccc0 msgr2=0x7fc6b40b7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.590+0000 7fc6ba59e640 1 --2- 172.21.15.114:0/2635910395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6b415ccc0 0x7fc6b40b7360 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8034040 tx=0x7fc6a80046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.590+0000 7fc6ba59e640 1 -- 172.21.15.114:0/2635910395 shutdown_connections 2023-11-04T01:39:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.590+0000 7fc6ba59e640 1 --2- 172.21.15.114:0/2635910395 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6b415d0a0 0x7fc6b40b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.590+0000 7fc6ba59e640 1 --2- 172.21.15.114:0/2635910395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6b415ccc0 0x7fc6b40b7360 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.590+0000 7fc6ba59e640 1 --2- 172.21.15.114:0/2635910395 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc6a006ae70 0x7fc6a006d330 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.590+0000 7fc6ba59e640 1 --2- 172.21.15.114:0/2635910395 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6b40cd680 0x7fc6b41524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.590+0000 7fc6ba59e640 1 -- 172.21.15.114:0/2635910395 >> 172.21.15.114:0/2635910395 conn(0x7fc6b40cf8a0 msgr2=0x7fc6b40b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.590+0000 7fc6ba59e640 1 -- 172.21.15.114:0/2635910395 shutdown_connections 2023-11-04T01:39:47.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.590+0000 7fc6ba59e640 1 -- 172.21.15.114:0/2635910395 wait complete. 2023-11-04T01:39:47.604 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:39:47.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.708+0000 7f0296b78640 1 Processor -- start 2023-11-04T01:39:47.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.708+0000 7f0296b78640 1 -- start start 2023-11-04T01:39:47.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.709+0000 7f0296b78640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f029006a1b0 0x7f029006b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:47.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.709+0000 7f0296b78640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02900c9a40 0x7f02900c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:47.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.709+0000 7f0296b78640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029006cf60 con 0x7f029015ad80 2023-11-04T01:39:47.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.709+0000 7f0296b78640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02900ca430 con 0x7f029006a1b0 2023-11-04T01:39:47.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.709+0000 7f0296b78640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029015b160 con 0x7f02900c9a40 2023-11-04T01:39:47.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.709+0000 7f0294914640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f029015ad80 0x7f02900abe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58032/0 (socket says 172.21.15.114:58032) 2023-11-04T01:39:47.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.709+0000 7f028ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f029006a1b0 0x7f029006b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:47.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.709+0000 7f0294914640 1 -- 172.21.15.114:0/4013621530 learned_addr learned my addr 172.21.15.114:0/4013621530 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:47.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.709+0000 7f0295115640 1 --2- 172.21.15.114:0/4013621530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02900c9a40 0x7f02900c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:47.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.710+0000 7f028ffff640 1 -- 172.21.15.114:0/4013621530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02900c9a40 msgr2=0x7f02900c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:47.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.710+0000 7f028ffff640 1 --2- 172.21.15.114:0/4013621530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02900c9a40 0x7f02900c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.710+0000 7f028ffff640 1 -- 172.21.15.114:0/4013621530 >> v1:172.21.15.114:6789/0 conn(0x7f029015ad80 legacy=0x7f02900abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:47.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.710+0000 7f028ffff640 1 -- 172.21.15.114:0/4013621530 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029006b9b0 con 0x7f029006a1b0 2023-11-04T01:39:47.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.710+0000 7f028f7fe640 1 -- 172.21.15.114:0/4013621530 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234598169 0 0) 0x7f029006cf60 con 0x7f029015ad80 2023-11-04T01:39:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.710+0000 7f028ffff640 1 --2- 172.21.15.114:0/4013621530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f029006a1b0 0x7f029006b010 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f02840097a0 tx=0x7f028402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6498ebe0d4e9bfd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.710+0000 7f028f7fe640 1 -- 172.21.15.114:0/4013621530 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284031830 con 0x7f029006a1b0 2023-11-04T01:39:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.710+0000 7f028f7fe640 1 -- 172.21.15.114:0/4013621530 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0284031990 con 0x7f029006a1b0 2023-11-04T01:39:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.710+0000 7f028f7fe640 1 -- 172.21.15.114:0/4013621530 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284031d20 con 0x7f029006a1b0 2023-11-04T01:39:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.711+0000 7f0296b78640 1 -- 172.21.15.114:0/4013621530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f029006a1b0 msgr2=0x7f029006b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.711+0000 7f0296b78640 1 --2- 172.21.15.114:0/4013621530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f029006a1b0 0x7f029006b010 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f02840097a0 tx=0x7f028402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.711+0000 7f0296b78640 1 -- 172.21.15.114:0/4013621530 shutdown_connections 2023-11-04T01:39:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.711+0000 7f0296b78640 1 --2- 172.21.15.114:0/4013621530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02900c9a40 0x7f02900c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.711+0000 7f0296b78640 1 --2- 172.21.15.114:0/4013621530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f029006a1b0 0x7f029006b010 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.711+0000 7f0296b78640 1 -- 172.21.15.114:0/4013621530 >> 172.21.15.114:0/4013621530 conn(0x7f02900b0cd0 msgr2=0x7f02900b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:47.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.711+0000 7f0296b78640 1 -- 172.21.15.114:0/4013621530 shutdown_connections 2023-11-04T01:39:47.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.711+0000 7f0296b78640 1 -- 172.21.15.114:0/4013621530 wait complete. 2023-11-04T01:39:47.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.712+0000 7f0296b78640 1 Processor -- start 2023-11-04T01:39:47.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.712+0000 7f0296b78640 1 -- start start 2023-11-04T01:39:47.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f0296b78640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f029006a1b0 0x7f02901547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:47.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f0296b78640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02900c9a40 0x7f02900ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:47.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f0296b78640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f029015ad80 0x7f02900c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:47.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f0296b78640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0290154d10 con 0x7f02900c9a40 2023-11-04T01:39:47.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f0296b78640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02900c5a80 con 0x7f029006a1b0 2023-11-04T01:39:47.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f0296b78640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02900cecf0 con 0x7f029015ad80 2023-11-04T01:39:47.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f028ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02900c9a40 0x7f02900ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:47.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f028ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02900c9a40 0x7f02900ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54396/0 (socket says 172.21.15.114:54396) 2023-11-04T01:39:47.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f028ffff640 1 -- 172.21.15.114:0/3922879697 learned_addr learned my addr 172.21.15.114:0/3922879697 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:47.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f0295115640 1 --2- 172.21.15.114:0/3922879697 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f029015ad80 0x7f02900c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:47.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f0294914640 1 --2- 172.21.15.114:0/3922879697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f029006a1b0 0x7f02901547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:47.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f028ffff640 1 -- 172.21.15.114:0/3922879697 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f029015ad80 msgr2=0x7f02900c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:47.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f028ffff640 1 --2- 172.21.15.114:0/3922879697 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f029015ad80 0x7f02900c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f028ffff640 1 -- 172.21.15.114:0/3922879697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f029006a1b0 msgr2=0x7f02901547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:47.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f028ffff640 1 --2- 172.21.15.114:0/3922879697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f029006a1b0 0x7f02901547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f028ffff640 1 -- 172.21.15.114:0/3922879697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0284009400 con 0x7f02900c9a40 2023-11-04T01:39:47.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f0294914640 1 --2- 172.21.15.114:0/3922879697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f029006a1b0 0x7f02901547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:47.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.713+0000 7f0295115640 1 --2- 172.21.15.114:0/3922879697 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f029015ad80 0x7f02900c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:47.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.714+0000 7f028ffff640 1 --2- 172.21.15.114:0/3922879697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02900c9a40 0x7f02900ce7b0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f0284034040 tx=0x7f02840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.714+0000 7f028d7fa640 1 -- 172.21.15.114:0/3922879697 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028403aa60 con 0x7f02900c9a40 2023-11-04T01:39:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.714+0000 7f028d7fa640 1 -- 172.21.15.114:0/3922879697 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028403abe0 con 0x7f02900c9a40 2023-11-04T01:39:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.714+0000 7f0296b78640 1 -- 172.21.15.114:0/3922879697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02900c2d10 con 0x7f02900c9a40 2023-11-04T01:39:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.714+0000 7f028d7fa640 1 -- 172.21.15.114:0/3922879697 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284044400 con 0x7f02900c9a40 2023-11-04T01:39:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.714+0000 7f0296b78640 1 -- 172.21.15.114:0/3922879697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02900c42b0 con 0x7f02900c9a40 2023-11-04T01:39:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.715+0000 7f0296b78640 1 -- 172.21.15.114:0/3922879697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0290074290 con 0x7f02900c9a40 2023-11-04T01:39:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.715+0000 7f028d7fa640 1 -- 172.21.15.114:0/3922879697 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f028404d440 con 0x7f02900c9a40 2023-11-04T01:39:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.716+0000 7f028d7fa640 1 --2- 172.21.15.114:0/3922879697 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f027c06ae70 0x7f027c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.716+0000 7f028d7fa640 1 -- 172.21.15.114:0/3922879697 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f02840ab860 con 0x7f02900c9a40 2023-11-04T01:39:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.716+0000 7f0294914640 1 --2- 172.21.15.114:0/3922879697 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f027c06ae70 0x7f027c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.716+0000 7f0294914640 1 --2- 172.21.15.114:0/3922879697 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f027c06ae70 0x7f027c06d330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0280000f60 tx=0x7f0280007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:47.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.720+0000 7f028d7fa640 1 -- 172.21.15.114:0/3922879697 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0284076770 con 0x7f02900c9a40 2023-11-04T01:39:47.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.953+0000 7f0296b78640 1 -- 172.21.15.114:0/3922879697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0290066320 con 0x7f02900c9a40 2023-11-04T01:39:47.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.953+0000 7f028d7fa640 1 -- 172.21.15.114:0/3922879697 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0284079d90 con 0x7f02900c9a40 2023-11-04T01:39:47.955 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:47.955 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:39:47.955 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2023-11-04T01:39:47.956 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.956 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2023-11-04T01:39:47.956 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0VlswblMRAAotQqAxFKxonbXL/aDdoEPw==", 2023-11-04T01:39:47.956 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.956 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:39:47.956 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:39:47.956 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:39:47.956 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:47.956 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.956 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.956 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.956 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2023-11-04T01:39:47.957 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VluZGwAhAAZPVNOe2pR5yFwajeNFbXzw==", 2023-11-04T01:39:47.957 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.957 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:39:47.957 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:39:47.957 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:39:47.957 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:47.957 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.957 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.957 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.957 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2023-11-04T01:39:47.957 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0VlUsc9ORAAmZhkDVK2hR4wbky+cLfo+A==", 2023-11-04T01:39:47.957 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.957 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:39:47.957 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:39:47.958 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:39:47.958 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:47.958 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.958 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.958 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.958 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2023-11-04T01:39:47.958 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VlfxP9CRAAQppp4Lmc1v2xMGYc/AD7pA==", 2023-11-04T01:39:47.958 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.958 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:39:47.958 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:39:47.958 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:39:47.959 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:47.959 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.959 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.959 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.959 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2023-11-04T01:39:47.959 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDdn0Vl/xmgMBAANQCw5RUd/IlxHaDvCz2Gbg==", 2023-11-04T01:39:47.959 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.959 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:47.959 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:39:47.959 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:47.959 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.960 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.960 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.960 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2023-11-04T01:39:47.960 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDgn0VlTpuDLxAAf5vdQMiWBcLfx0Vf8Petyg==", 2023-11-04T01:39:47.960 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.960 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:47.960 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:39:47.960 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:47.960 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.960 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.960 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.960 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2023-11-04T01:39:47.960 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDjn0VlZonFLRAAHJMf/0DasOCeOrz4u8uV2w==", 2023-11-04T01:39:47.961 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.961 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:47.961 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:39:47.961 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:47.961 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.961 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.961 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.961 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2023-11-04T01:39:47.961 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDmn0VlLKK7KxAAKJzogyZTtMzEtAL+LL1V0w==", 2023-11-04T01:39:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:39:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2023-11-04T01:39:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDsn0VlLitpMhAA6ow9uVmS5YtOnqSWSB66ww==", 2023-11-04T01:39:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:39:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:47.963 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.963 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.963 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.963 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2023-11-04T01:39:47.963 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDvn0VlfkL/MBAA/LYWJLF7F12XMEICf18BwA==", 2023-11-04T01:39:47.963 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.963 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:47.963 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:39:47.963 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:47.963 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.963 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.963 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.963 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2023-11-04T01:39:47.964 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDyn0Vl8ZrhLxAAKDbE5KvbWhguLsNNi+3duA==", 2023-11-04T01:39:47.964 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.964 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:47.964 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:39:47.964 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:47.964 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.964 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.964 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.964 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2023-11-04T01:39:47.964 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD1n0Vlues1LhAARQs1LLq8y63wl8nAs8GbGQ==", 2023-11-04T01:39:47.964 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.964 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-11-04T01:39:47.964 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-11-04T01:39:47.965 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:47.965 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.965 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.965 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.965 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2023-11-04T01:39:47.965 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0Vl3QHODhAA6LWlhd+avWYsoYsWMbOiVA==", 2023-11-04T01:39:47.965 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.965 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:39:47.965 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2023-11-04T01:39:47.965 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:39:47.965 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.965 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.965 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.966 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2023-11-04T01:39:47.966 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VlRvgLGBAAAAhF9alG2eD5A/xjWXcVWA==", 2023-11-04T01:39:47.966 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.966 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:39:47.966 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-11-04T01:39:47.966 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-11-04T01:39:47.966 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-11-04T01:39:47.966 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.966 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.966 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.966 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2023-11-04T01:39:47.966 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VlgV6sFBAAxheFKb52kyZly4byr78vfw==", 2023-11-04T01:39:47.966 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.967 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:39:47.967 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-11-04T01:39:47.967 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-11-04T01:39:47.967 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-11-04T01:39:47.967 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.967 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.967 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.967 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2023-11-04T01:39:47.967 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDan0VltiLUHRAAY0QtK328vB9H/l8FWCNB4g==", 2023-11-04T01:39:47.967 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.967 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-11-04T01:39:47.967 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-11-04T01:39:47.968 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-11-04T01:39:47.968 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-11-04T01:39:47.968 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.968 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.968 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.968 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2023-11-04T01:39:47.968 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0Vl3O6UFBAAZpdiB/7sBN6IpvNpe/LoIA==", 2023-11-04T01:39:47.968 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.968 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-11-04T01:39:47.968 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-11-04T01:39:47.968 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-11-04T01:39:47.968 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:47.968 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.968 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.969 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.969 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2023-11-04T01:39:47.969 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0Vlb1WELhAAcUQ6WxKBsUeJfXvaE+h0GQ==", 2023-11-04T01:39:47.969 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.969 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-11-04T01:39:47.969 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2023-11-04T01:39:47.969 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:47.969 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.969 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:47.969 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:47.969 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2023-11-04T01:39:47.969 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDZn0VluGn6KRAAHsThhoAbKIz+kqF2DYyvkg==", 2023-11-04T01:39:47.970 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-11-04T01:39:47.970 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-11-04T01:39:47.970 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2023-11-04T01:39:47.970 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-11-04T01:39:47.970 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.970 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:47.970 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-11-04T01:39:47.970 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:39:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.955+0000 7f0296b78640 1 -- 172.21.15.114:0/3922879697 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f027c06ae70 msgr2=0x7f027c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.955+0000 7f0296b78640 1 --2- 172.21.15.114:0/3922879697 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f027c06ae70 0x7f027c06d330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0280000f60 tx=0x7f0280007c10 comp rx=0 tx=0).stop 2023-11-04T01:39:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.955+0000 7f0296b78640 1 -- 172.21.15.114:0/3922879697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02900c9a40 msgr2=0x7f02900ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.955+0000 7f0296b78640 1 --2- 172.21.15.114:0/3922879697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02900c9a40 0x7f02900ce7b0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f0284034040 tx=0x7f02840046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.955+0000 7f0296b78640 1 -- 172.21.15.114:0/3922879697 shutdown_connections 2023-11-04T01:39:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.955+0000 7f0296b78640 1 --2- 172.21.15.114:0/3922879697 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f029015ad80 0x7f02900c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.955+0000 7f0296b78640 1 --2- 172.21.15.114:0/3922879697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02900c9a40 0x7f02900ce7b0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.955+0000 7f0296b78640 1 --2- 172.21.15.114:0/3922879697 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f027c06ae70 0x7f027c06d330 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.955+0000 7f0296b78640 1 --2- 172.21.15.114:0/3922879697 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f029006a1b0 0x7f02901547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.955+0000 7f0296b78640 1 -- 172.21.15.114:0/3922879697 >> 172.21.15.114:0/3922879697 conn(0x7f02900b0cd0 msgr2=0x7f02900acc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.955+0000 7f0296b78640 1 -- 172.21.15.114:0/3922879697 shutdown_connections 2023-11-04T01:39:47.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:47.955+0000 7f0296b78640 1 -- 172.21.15.114:0/3922879697 wait complete. 2023-11-04T01:39:47.973 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:48.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.071+0000 7feeb6090640 1 Processor -- start 2023-11-04T01:39:48.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.071+0000 7feeb6090640 1 -- start start 2023-11-04T01:39:48.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.072+0000 7feeb6090640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feeb00ce370 0x7feeb006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.072+0000 7feeb6090640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb006e060 con 0x7feeb0159c70 2023-11-04T01:39:48.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.072+0000 7feeb6090640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb00b4110 con 0x7feeb00b0ae0 2023-11-04T01:39:48.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.072+0000 7feeb6090640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb00b49b0 con 0x7feeb00ce370 2023-11-04T01:39:48.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.072+0000 7feeaffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feeb00ce370 0x7feeb006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.072+0000 7feeaf7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7feeb0159c70 0x7feeb00b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58044/0 (socket says 172.21.15.114:58044) 2023-11-04T01:39:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.072+0000 7feeaf7fe640 1 -- 172.21.15.114:0/3529425435 learned_addr learned my addr 172.21.15.114:0/3529425435 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.072+0000 7feeae7fc640 1 -- 172.21.15.114:0/3529425435 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067485132 0 0) 0x7feeb006e060 con 0x7feeb0159c70 2023-11-04T01:39:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.072+0000 7feeae7fc640 1 -- 172.21.15.114:0/3529425435 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee98003520 con 0x7feeb0159c70 2023-11-04T01:39:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.072+0000 7feeaffff640 1 -- 172.21.15.114:0/3529425435 >> v1:172.21.15.141:6789/0 conn(0x7feeb00b0ae0 legacy=0x7feeb015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.072+0000 7feeaffff640 1 -- 172.21.15.114:0/3529425435 >> v1:172.21.15.114:6789/0 conn(0x7feeb0159c70 legacy=0x7feeb00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.072+0000 7feeaffff640 1 -- 172.21.15.114:0/3529425435 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb00b43f0 con 0x7feeb00ce370 2023-11-04T01:39:48.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.073+0000 7feeaffff640 1 --2- 172.21.15.114:0/3529425435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb00ce370 0x7feeb006db20 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7feeb006e1f0 tx=0x7feea802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e7ef89669f51c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:48.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.073+0000 7feeae7fc640 1 -- 172.21.15.114:0/3529425435 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea802cce0 con 0x7feeb00ce370 2023-11-04T01:39:48.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.073+0000 7feeae7fc640 1 -- 172.21.15.114:0/3529425435 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea802ce40 con 0x7feeb00ce370 2023-11-04T01:39:48.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.073+0000 7feeae7fc640 1 -- 172.21.15.114:0/3529425435 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8034660 con 0x7feeb00ce370 2023-11-04T01:39:48.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.075+0000 7feeb6090640 1 -- 172.21.15.114:0/3529425435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb00ce370 msgr2=0x7feeb006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.075+0000 7feeb6090640 1 --2- 172.21.15.114:0/3529425435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb00ce370 0x7feeb006db20 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7feeb006e1f0 tx=0x7feea802bf30 comp rx=0 tx=0).stop 2023-11-04T01:39:48.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.075+0000 7feeb6090640 1 -- 172.21.15.114:0/3529425435 shutdown_connections 2023-11-04T01:39:48.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.075+0000 7feeb6090640 1 --2- 172.21.15.114:0/3529425435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb00ce370 0x7feeb006db20 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.075+0000 7feeb6090640 1 -- 172.21.15.114:0/3529425435 >> 172.21.15.114:0/3529425435 conn(0x7feeb00ce950 msgr2=0x7feeb00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:48.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.075+0000 7feeb6090640 1 -- 172.21.15.114:0/3529425435 shutdown_connections 2023-11-04T01:39:48.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.075+0000 7feeb6090640 1 -- 172.21.15.114:0/3529425435 wait complete. 2023-11-04T01:39:48.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.076+0000 7feeb6090640 1 Processor -- start 2023-11-04T01:39:48.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.076+0000 7feeb6090640 1 -- start start 2023-11-04T01:39:48.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeb6090640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feeb00b0ae0 0x7feeb00c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeb6090640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb00ce370 0x7feeb00c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeb6090640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feeb0159c70 0x7feeb00c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeb6090640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00ce7e0 con 0x7feeb00ce370 2023-11-04T01:39:48.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeb6090640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00c8f60 con 0x7feeb0159c70 2023-11-04T01:39:48.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeb6090640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb014ddd0 con 0x7feeb00b0ae0 2023-11-04T01:39:48.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeaeffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb00ce370 0x7feeb00c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeaeffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb00ce370 0x7feeb00c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54406/0 (socket says 172.21.15.114:54406) 2023-11-04T01:39:48.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeaeffd640 1 -- 172.21.15.114:0/951095541 learned_addr learned my addr 172.21.15.114:0/951095541 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:48.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeaffff640 1 --2- 172.21.15.114:0/951095541 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feeb0159c70 0x7feeb00c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeaf7fe640 1 --2- 172.21.15.114:0/951095541 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feeb00b0ae0 0x7feeb00c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeaeffd640 1 -- 172.21.15.114:0/951095541 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feeb00b0ae0 msgr2=0x7feeb00c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeaeffd640 1 --2- 172.21.15.114:0/951095541 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feeb00b0ae0 0x7feeb00c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeaeffd640 1 -- 172.21.15.114:0/951095541 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feeb0159c70 msgr2=0x7feeb00c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeaeffd640 1 --2- 172.21.15.114:0/951095541 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feeb0159c70 0x7feeb00c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeaeffd640 1 -- 172.21.15.114:0/951095541 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea8009a70 con 0x7feeb00ce370 2023-11-04T01:39:48.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.077+0000 7feeaeffd640 1 --2- 172.21.15.114:0/951095541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb00ce370 0x7feeb00c6360 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7feea400c450 tx=0x7feea400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:48.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.078+0000 7fee97fff640 1 -- 172.21.15.114:0/951095541 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea40052d0 con 0x7feeb00ce370 2023-11-04T01:39:48.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.078+0000 7fee97fff640 1 -- 172.21.15.114:0/951095541 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea4005430 con 0x7feeb00ce370 2023-11-04T01:39:48.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.078+0000 7feeb6090640 1 -- 172.21.15.114:0/951095541 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb00c68a0 con 0x7feeb00ce370 2023-11-04T01:39:48.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.078+0000 7fee97fff640 1 -- 172.21.15.114:0/951095541 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4012870 con 0x7feeb00ce370 2023-11-04T01:39:48.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.078+0000 7feeb6090640 1 -- 172.21.15.114:0/951095541 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb00c6db0 con 0x7feeb00ce370 2023-11-04T01:39:48.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.079+0000 7feeb6090640 1 -- 172.21.15.114:0/951095541 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb0074290 con 0x7feeb00ce370 2023-11-04T01:39:48.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.079+0000 7fee97fff640 1 -- 172.21.15.114:0/951095541 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feea40129d0 con 0x7feeb00ce370 2023-11-04T01:39:48.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.079+0000 7fee97fff640 1 --2- 172.21.15.114:0/951095541 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee9c06ae70 0x7fee9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.079+0000 7fee97fff640 1 -- 172.21.15.114:0/951095541 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7feea4089360 con 0x7feeb00ce370 2023-11-04T01:39:48.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.079+0000 7feeaf7fe640 1 --2- 172.21.15.114:0/951095541 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee9c06ae70 0x7fee9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.080+0000 7feeaf7fe640 1 --2- 172.21.15.114:0/951095541 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee9c06ae70 0x7fee9c06d330 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7feea00011e0 tx=0x7feea0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:48.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.084+0000 7fee97fff640 1 -- 172.21.15.114:0/951095541 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feea40541e0 con 0x7feeb00ce370 2023-11-04T01:39:48.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.251+0000 7feeb6090640 1 -- 172.21.15.114:0/951095541 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feeb00ca650 con 0x7feeb00ce370 2023-11-04T01:39:48.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.252+0000 7fee97fff640 1 -- 172.21.15.114:0/951095541 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+18407 (secure 0 0 0) 0x7feea4057800 con 0x7feeb00ce370 2023-11-04T01:39:48.254 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:48.254 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":92,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:47.586216+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.254+0000 7feeb6090640 1 -- 172.21.15.114:0/951095541 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee9c06ae70 msgr2=0x7fee9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.254+0000 7feeb6090640 1 --2- 172.21.15.114:0/951095541 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee9c06ae70 0x7fee9c06d330 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7feea00011e0 tx=0x7feea0009040 comp rx=0 tx=0).stop 2023-11-04T01:39:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.254+0000 7feeb6090640 1 -- 172.21.15.114:0/951095541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb00ce370 msgr2=0x7feeb00c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.254+0000 7feeb6090640 1 --2- 172.21.15.114:0/951095541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb00ce370 0x7feeb00c6360 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7feea400c450 tx=0x7feea400c910 comp rx=0 tx=0).stop 2023-11-04T01:39:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.254+0000 7feeb6090640 1 -- 172.21.15.114:0/951095541 shutdown_connections 2023-11-04T01:39:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.254+0000 7feeb6090640 1 --2- 172.21.15.114:0/951095541 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fee9c06ae70 0x7fee9c06d330 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.254+0000 7feeb6090640 1 --2- 172.21.15.114:0/951095541 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feeb0159c70 0x7feeb00c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.254+0000 7feeb6090640 1 --2- 172.21.15.114:0/951095541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb00ce370 0x7feeb00c6360 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.254+0000 7feeb6090640 1 --2- 172.21.15.114:0/951095541 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feeb00b0ae0 0x7feeb00c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.254+0000 7feeb6090640 1 -- 172.21.15.114:0/951095541 >> 172.21.15.114:0/951095541 conn(0x7feeb00ce950 msgr2=0x7feeb015e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:48.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.254+0000 7feeb6090640 1 -- 172.21.15.114:0/951095541 shutdown_connections 2023-11-04T01:39:48.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.254+0000 7feeb6090640 1 -- 172.21.15.114:0/951095541 wait complete. 2023-11-04T01:39:48.267 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:58.316710+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:59.185397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:48.267 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:48.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.368+0000 7f7d6d5a9640 1 Processor -- start 2023-11-04T01:39:48.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.368+0000 7f7d6d5a9640 1 -- start start 2023-11-04T01:39:48.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.369+0000 7f7d6d5a9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7d68153e60 0x7f7d6815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.369+0000 7f7d6d5a9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d680cd6d0 0x7f7d68161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.369+0000 7f7d6d5a9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d680cde60 con 0x7f7d680b4880 2023-11-04T01:39:48.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.369+0000 7f7d6d5a9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d68160f90 con 0x7f7d680cd6d0 2023-11-04T01:39:48.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.369+0000 7f7d6d5a9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6815e400 con 0x7f7d68153e60 2023-11-04T01:39:48.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.369+0000 7f7d5ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d680cd6d0 0x7f7d68161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.369+0000 7f7d677fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7d680b4880 0x7f7d6806b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58046/0 (socket says 172.21.15.114:58046) 2023-11-04T01:39:48.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.369+0000 7f7d677fe640 1 -- 172.21.15.114:0/3075305323 learned_addr learned my addr 172.21.15.114:0/3075305323 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:48.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.369+0000 7f7d66ffd640 1 --2- 172.21.15.114:0/3075305323 >> v2:172.21.15.141:3300/0 conn(0x7f7d68153e60 0x7f7d6815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.369+0000 7f7d5ffff640 1 -- 172.21.15.114:0/3075305323 >> v2:172.21.15.141:3300/0 conn(0x7f7d68153e60 msgr2=0x7f7d6815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.369+0000 7f7d5ffff640 1 --2- 172.21.15.114:0/3075305323 >> v2:172.21.15.141:3300/0 conn(0x7f7d68153e60 0x7f7d6815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.369+0000 7f7d5ffff640 1 -- 172.21.15.114:0/3075305323 >> v1:172.21.15.114:6789/0 conn(0x7f7d680b4880 legacy=0x7f7d6806b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.369+0000 7f7d5ffff640 1 -- 172.21.15.114:0/3075305323 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d68161960 con 0x7f7d680cd6d0 2023-11-04T01:39:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.369+0000 7f7d66ffd640 1 --2- 172.21.15.114:0/3075305323 >> v2:172.21.15.141:3300/0 conn(0x7f7d68153e60 0x7f7d6815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.370+0000 7f7d5ffff640 1 --2- 172.21.15.114:0/3075305323 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d680cd6d0 0x7f7d68161420 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f7d6808abe0 tx=0x7f7d5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355dfbb584f95d01 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.370+0000 7f7d667fc640 1 -- 172.21.15.114:0/3075305323 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d50031830 con 0x7f7d680cd6d0 2023-11-04T01:39:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.370+0000 7f7d667fc640 1 -- 172.21.15.114:0/3075305323 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d50031990 con 0x7f7d680cd6d0 2023-11-04T01:39:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.370+0000 7f7d667fc640 1 -- 172.21.15.114:0/3075305323 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d50031d20 con 0x7f7d680cd6d0 2023-11-04T01:39:48.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.370+0000 7f7d6d5a9640 1 -- 172.21.15.114:0/3075305323 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d680cd6d0 msgr2=0x7f7d68161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.370+0000 7f7d6d5a9640 1 --2- 172.21.15.114:0/3075305323 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d680cd6d0 0x7f7d68161420 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f7d6808abe0 tx=0x7f7d5002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.370+0000 7f7d6d5a9640 1 -- 172.21.15.114:0/3075305323 shutdown_connections 2023-11-04T01:39:48.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.370+0000 7f7d6d5a9640 1 --2- 172.21.15.114:0/3075305323 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d680cd6d0 0x7f7d68161420 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.370+0000 7f7d6d5a9640 1 --2- 172.21.15.114:0/3075305323 >> v2:172.21.15.141:3300/0 conn(0x7f7d68153e60 0x7f7d6815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.371+0000 7f7d6d5a9640 1 -- 172.21.15.114:0/3075305323 >> 172.21.15.114:0/3075305323 conn(0x7f7d680cf880 msgr2=0x7f7d680cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:48.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.371+0000 7f7d6d5a9640 1 -- 172.21.15.114:0/3075305323 shutdown_connections 2023-11-04T01:39:48.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.371+0000 7f7d6d5a9640 1 -- 172.21.15.114:0/3075305323 wait complete. 2023-11-04T01:39:48.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.372+0000 7f7d6d5a9640 1 Processor -- start 2023-11-04T01:39:48.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.372+0000 7f7d6d5a9640 1 -- start start 2023-11-04T01:39:48.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.372+0000 7f7d6d5a9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d680b4880 0x7f7d680c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.372+0000 7f7d6d5a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d680cd6d0 0x7f7d68150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.372+0000 7f7d6d5a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d68153e60 0x7f7d68151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.372+0000 7f7d6d5a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6815b570 con 0x7f7d68153e60 2023-11-04T01:39:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.372+0000 7f7d6d5a9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d68158230 con 0x7f7d680b4880 2023-11-04T01:39:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.372+0000 7f7d6d5a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d68157f50 con 0x7f7d680cd6d0 2023-11-04T01:39:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.372+0000 7f7d677fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d68153e60 0x7f7d68151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.372+0000 7f7d677fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d68153e60 0x7f7d68151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54434/0 (socket says 172.21.15.114:54434) 2023-11-04T01:39:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.372+0000 7f7d677fe640 1 -- 172.21.15.114:0/586712169 learned_addr learned my addr 172.21.15.114:0/586712169 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.373+0000 7f7d5ffff640 1 --2- 172.21.15.114:0/586712169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d680cd6d0 0x7f7d68150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.373+0000 7f7d66ffd640 1 --2- 172.21.15.114:0/586712169 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d680b4880 0x7f7d680c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.373+0000 7f7d677fe640 1 -- 172.21.15.114:0/586712169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d680cd6d0 msgr2=0x7f7d68150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.373+0000 7f7d677fe640 1 --2- 172.21.15.114:0/586712169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d680cd6d0 0x7f7d68150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.373+0000 7f7d677fe640 1 -- 172.21.15.114:0/586712169 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d680b4880 msgr2=0x7f7d680c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.373+0000 7f7d677fe640 1 --2- 172.21.15.114:0/586712169 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d680b4880 0x7f7d680c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.373+0000 7f7d677fe640 1 -- 172.21.15.114:0/586712169 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d50009400 con 0x7f7d68153e60 2023-11-04T01:39:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.373+0000 7f7d677fe640 1 --2- 172.21.15.114:0/586712169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d68153e60 0x7f7d68151e30 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000cbf0 tx=0x7f7d6000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.373+0000 7f7d5f7fe640 1 -- 172.21.15.114:0/586712169 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000ad40 con 0x7f7d68153e60 2023-11-04T01:39:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.373+0000 7f7d5f7fe640 1 -- 172.21.15.114:0/586712169 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d60012400 con 0x7f7d68153e60 2023-11-04T01:39:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.373+0000 7f7d6d5a9640 1 -- 172.21.15.114:0/586712169 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6815a910 con 0x7f7d68153e60 2023-11-04T01:39:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.373+0000 7f7d5f7fe640 1 -- 172.21.15.114:0/586712169 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000aea0 con 0x7f7d68153e60 2023-11-04T01:39:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.373+0000 7f7d6d5a9640 1 -- 172.21.15.114:0/586712169 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d68150740 con 0x7f7d68153e60 2023-11-04T01:39:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.374+0000 7f7d6d5a9640 1 -- 172.21.15.114:0/586712169 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d6815b6e0 con 0x7f7d68153e60 2023-11-04T01:39:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.375+0000 7f7d5f7fe640 1 -- 172.21.15.114:0/586712169 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7d60007070 con 0x7f7d68153e60 2023-11-04T01:39:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.375+0000 7f7d5f7fe640 1 --2- 172.21.15.114:0/586712169 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7d4806ae70 0x7f7d4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.375+0000 7f7d5f7fe640 1 -- 172.21.15.114:0/586712169 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f7d600896a0 con 0x7f7d68153e60 2023-11-04T01:39:48.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.375+0000 7f7d66ffd640 1 --2- 172.21.15.114:0/586712169 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7d4806ae70 0x7f7d4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.375+0000 7f7d66ffd640 1 --2- 172.21.15.114:0/586712169 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7d4806ae70 0x7f7d4806d330 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800a950 tx=0x7f7d58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:48.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.379+0000 7f7d5f7fe640 1 -- 172.21.15.114:0/586712169 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7d600545d0 con 0x7f7d68153e60 2023-11-04T01:39:48.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.543+0000 7f7d6d5a9640 1 -- 172.21.15.114:0/586712169 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d68074290 con 0x7f7d68153e60 2023-11-04T01:39:48.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.543+0000 7f7d5f7fe640 1 -- 172.21.15.114:0/586712169 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d60057bf0 con 0x7f7d68153e60 2023-11-04T01:39:48.545 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:39:48.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.545+0000 7f7d6d5a9640 1 -- 172.21.15.114:0/586712169 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7d4806ae70 msgr2=0x7f7d4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.545+0000 7f7d6d5a9640 1 --2- 172.21.15.114:0/586712169 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7d4806ae70 0x7f7d4806d330 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800a950 tx=0x7f7d58008040 comp rx=0 tx=0).stop 2023-11-04T01:39:48.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.545+0000 7f7d6d5a9640 1 -- 172.21.15.114:0/586712169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d68153e60 msgr2=0x7f7d68151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.545+0000 7f7d6d5a9640 1 --2- 172.21.15.114:0/586712169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d68153e60 0x7f7d68151e30 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000cbf0 tx=0x7f7d6000a430 comp rx=0 tx=0).stop 2023-11-04T01:39:48.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.545+0000 7f7d6d5a9640 1 -- 172.21.15.114:0/586712169 shutdown_connections 2023-11-04T01:39:48.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.545+0000 7f7d6d5a9640 1 --2- 172.21.15.114:0/586712169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d68153e60 0x7f7d68151e30 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.545+0000 7f7d6d5a9640 1 --2- 172.21.15.114:0/586712169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7d680cd6d0 0x7f7d68150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.545+0000 7f7d6d5a9640 1 --2- 172.21.15.114:0/586712169 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7d4806ae70 0x7f7d4806d330 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.545+0000 7f7d6d5a9640 1 --2- 172.21.15.114:0/586712169 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7d680b4880 0x7f7d680c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.545+0000 7f7d6d5a9640 1 -- 172.21.15.114:0/586712169 >> 172.21.15.114:0/586712169 conn(0x7f7d680cf880 msgr2=0x7f7d680d2530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:48.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.545+0000 7f7d6d5a9640 1 -- 172.21.15.114:0/586712169 shutdown_connections 2023-11-04T01:39:48.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.545+0000 7f7d6d5a9640 1 -- 172.21.15.114:0/586712169 wait complete. 2023-11-04T01:39:48.558 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:39:48.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.658+0000 7fa7d8dd0640 1 Processor -- start 2023-11-04T01:39:48.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.658+0000 7fa7d8dd0640 1 -- start start 2023-11-04T01:39:48.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.659+0000 7fa7d8dd0640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa7d415d1b0 0x7fa7d40cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.659+0000 7fa7d8dd0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa7d4066000 0x7fa7d406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.659+0000 7fa7d8dd0640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d40c9bf0 con 0x7fa7d4070ff0 2023-11-04T01:39:48.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.659+0000 7fa7d8dd0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d40cd890 con 0x7fa7d4066000 2023-11-04T01:39:48.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.659+0000 7fa7d8dd0640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d40cdb30 con 0x7fa7d415d1b0 2023-11-04T01:39:48.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.659+0000 7fa7d2d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa7d4066000 0x7fa7d406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.659+0000 7fa7d2d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa7d4066000 0x7fa7d406a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54442/0 (socket says 172.21.15.114:54442) 2023-11-04T01:39:48.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.659+0000 7fa7d2d9d640 1 -- 172.21.15.114:0/3472691352 learned_addr learned my addr 172.21.15.114:0/3472691352 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:48.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.659+0000 7fa7d2d9d640 1 -- 172.21.15.114:0/3472691352 >> v2:172.21.15.141:3300/0 conn(0x7fa7d415d1b0 msgr2=0x7fa7d40cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:48.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.659+0000 7fa7d2d9d640 1 --2- 172.21.15.114:0/3472691352 >> v2:172.21.15.141:3300/0 conn(0x7fa7d415d1b0 0x7fa7d40cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.659+0000 7fa7d2d9d640 1 -- 172.21.15.114:0/3472691352 >> v1:172.21.15.141:6789/0 conn(0x7fa7d4070ff0 legacy=0x7fa7d40713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:48.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.659+0000 7fa7d2d9d640 1 -- 172.21.15.114:0/3472691352 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d40cde10 con 0x7fa7d4066000 2023-11-04T01:39:48.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.660+0000 7fa7d2d9d640 1 --2- 172.21.15.114:0/3472691352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7d4066000 0x7fa7d406a500 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4161b90 tx=0x7fa7cc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6986b019ed0dea01 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:48.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.660+0000 7fa7d159a640 1 -- 172.21.15.114:0/3472691352 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc02ca80 con 0x7fa7d4066000 2023-11-04T01:39:48.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.660+0000 7fa7d159a640 1 -- 172.21.15.114:0/3472691352 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7cc02cbe0 con 0x7fa7d4066000 2023-11-04T01:39:48.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.660+0000 7fa7d159a640 1 -- 172.21.15.114:0/3472691352 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0343f0 con 0x7fa7d4066000 2023-11-04T01:39:48.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.661+0000 7fa7d8dd0640 1 -- 172.21.15.114:0/3472691352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7d4066000 msgr2=0x7fa7d406a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.661+0000 7fa7d8dd0640 1 --2- 172.21.15.114:0/3472691352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7d4066000 0x7fa7d406a500 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4161b90 tx=0x7fa7cc02bee0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.661+0000 7fa7d8dd0640 1 -- 172.21.15.114:0/3472691352 shutdown_connections 2023-11-04T01:39:48.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.661+0000 7fa7d8dd0640 1 --2- 172.21.15.114:0/3472691352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7d4066000 0x7fa7d406a500 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.661+0000 7fa7d8dd0640 1 --2- 172.21.15.114:0/3472691352 >> v2:172.21.15.141:3300/0 conn(0x7fa7d415d1b0 0x7fa7d40cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.661+0000 7fa7d8dd0640 1 -- 172.21.15.114:0/3472691352 >> 172.21.15.114:0/3472691352 conn(0x7fa7d40cbc90 msgr2=0x7fa7d40cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:48.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.661+0000 7fa7d8dd0640 1 -- 172.21.15.114:0/3472691352 shutdown_connections 2023-11-04T01:39:48.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.661+0000 7fa7d8dd0640 1 -- 172.21.15.114:0/3472691352 wait complete. 2023-11-04T01:39:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.662+0000 7fa7d8dd0640 1 Processor -- start 2023-11-04T01:39:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.662+0000 7fa7d8dd0640 1 -- start start 2023-11-04T01:39:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d8dd0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa7d4066000 0x7fa7d40b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d8dd0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7d4070ff0 0x7fa7d40b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d8dd0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa7d415d1b0 0x7fa7d40b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d8dd0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40c3b90 con 0x7fa7d4070ff0 2023-11-04T01:39:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d8dd0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40b4c20 con 0x7fa7d4066000 2023-11-04T01:39:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d8dd0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d4158b40 con 0x7fa7d415d1b0 2023-11-04T01:39:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7d4070ff0 0x7fa7d40b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7d4070ff0 0x7fa7d40b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54444/0 (socket says 172.21.15.114:54444) 2023-11-04T01:39:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d1d9b640 1 -- 172.21.15.114:0/2707547922 learned_addr learned my addr 172.21.15.114:0/2707547922 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d1d9b640 1 -- 172.21.15.114:0/2707547922 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa7d415d1b0 msgr2=0x7fa7d40b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d259c640 1 --2- 172.21.15.114:0/2707547922 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa7d4066000 0x7fa7d40b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d2d9d640 1 --2- 172.21.15.114:0/2707547922 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa7d415d1b0 0x7fa7d40b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d1d9b640 1 --2- 172.21.15.114:0/2707547922 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa7d415d1b0 0x7fa7d40b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d1d9b640 1 -- 172.21.15.114:0/2707547922 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa7d4066000 msgr2=0x7fa7d40b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d1d9b640 1 --2- 172.21.15.114:0/2707547922 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa7d4066000 0x7fa7d40b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d1d9b640 1 -- 172.21.15.114:0/2707547922 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc009b30 con 0x7fa7d4070ff0 2023-11-04T01:39:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d259c640 1 --2- 172.21.15.114:0/2707547922 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa7d4066000 0x7fa7d40b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:48.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.663+0000 7fa7d2d9d640 1 --2- 172.21.15.114:0/2707547922 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa7d415d1b0 0x7fa7d40b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:48.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.664+0000 7fa7d1d9b640 1 --2- 172.21.15.114:0/2707547922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7d4070ff0 0x7fa7d40b46e0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800b480 tx=0x7fa7c800b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:48.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.664+0000 7fa7c2ffd640 1 -- 172.21.15.114:0/2707547922 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8010870 con 0x7fa7d4070ff0 2023-11-04T01:39:48.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.664+0000 7fa7c2ffd640 1 -- 172.21.15.114:0/2707547922 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c80109d0 con 0x7fa7d4070ff0 2023-11-04T01:39:48.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.664+0000 7fa7d8dd0640 1 -- 172.21.15.114:0/2707547922 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d4158580 con 0x7fa7d4070ff0 2023-11-04T01:39:48.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.664+0000 7fa7c2ffd640 1 -- 172.21.15.114:0/2707547922 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8010d80 con 0x7fa7d4070ff0 2023-11-04T01:39:48.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.664+0000 7fa7d8dd0640 1 -- 172.21.15.114:0/2707547922 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d40c3820 con 0x7fa7d4070ff0 2023-11-04T01:39:48.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.665+0000 7fa7d8dd0640 1 -- 172.21.15.114:0/2707547922 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d4074290 con 0x7fa7d4070ff0 2023-11-04T01:39:48.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.665+0000 7fa7c2ffd640 1 -- 172.21.15.114:0/2707547922 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa7c800f3c0 con 0x7fa7d4070ff0 2023-11-04T01:39:48.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.665+0000 7fa7c2ffd640 1 --2- 172.21.15.114:0/2707547922 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7b406aea0 0x7fa7b406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.665+0000 7fa7c2ffd640 1 -- 172.21.15.114:0/2707547922 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7fa7c8089760 con 0x7fa7d4070ff0 2023-11-04T01:39:48.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.665+0000 7fa7d259c640 1 --2- 172.21.15.114:0/2707547922 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7b406aea0 0x7fa7b406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.666+0000 7fa7d259c640 1 --2- 172.21.15.114:0/2707547922 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7b406aea0 0x7fa7b406d360 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4007fd0 tx=0x7fa7c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:48.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.670+0000 7fa7c2ffd640 1 -- 172.21.15.114:0/2707547922 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa7c8058100 con 0x7fa7d4070ff0 2023-11-04T01:39:48.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.835+0000 7fa7d8dd0640 1 -- 172.21.15.114:0/2707547922 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fa7d40b5190 con 0x7fa7d4070ff0 2023-11-04T01:39:48.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.835+0000 7fa7c2ffd640 1 -- 172.21.15.114:0/2707547922 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v92) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa7c8009280 con 0x7fa7d4070ff0 2023-11-04T01:39:48.837 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:48.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.837+0000 7fa7d8dd0640 1 -- 172.21.15.114:0/2707547922 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7b406aea0 msgr2=0x7fa7b406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.837+0000 7fa7d8dd0640 1 --2- 172.21.15.114:0/2707547922 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7b406aea0 0x7fa7b406d360 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4007fd0 tx=0x7fa7c4009040 comp rx=0 tx=0).stop 2023-11-04T01:39:48.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.837+0000 7fa7d8dd0640 1 -- 172.21.15.114:0/2707547922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7d4070ff0 msgr2=0x7fa7d40b46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.837+0000 7fa7d8dd0640 1 --2- 172.21.15.114:0/2707547922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7d4070ff0 0x7fa7d40b46e0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800b480 tx=0x7fa7c800b940 comp rx=0 tx=0).stop 2023-11-04T01:39:48.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.837+0000 7fa7d8dd0640 1 -- 172.21.15.114:0/2707547922 shutdown_connections 2023-11-04T01:39:48.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.837+0000 7fa7d8dd0640 1 --2- 172.21.15.114:0/2707547922 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa7d415d1b0 0x7fa7d40b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.837+0000 7fa7d8dd0640 1 --2- 172.21.15.114:0/2707547922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7d4070ff0 0x7fa7d40b46e0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.837+0000 7fa7d8dd0640 1 --2- 172.21.15.114:0/2707547922 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7b406aea0 0x7fa7b406d360 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.837+0000 7fa7d8dd0640 1 --2- 172.21.15.114:0/2707547922 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa7d4066000 0x7fa7d40b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.837+0000 7fa7d8dd0640 1 -- 172.21.15.114:0/2707547922 >> 172.21.15.114:0/2707547922 conn(0x7fa7d40cbc90 msgr2=0x7fa7d406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:48.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.837+0000 7fa7d8dd0640 1 -- 172.21.15.114:0/2707547922 shutdown_connections 2023-11-04T01:39:48.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.837+0000 7fa7d8dd0640 1 -- 172.21.15.114:0/2707547922 wait complete. 2023-11-04T01:39:48.850 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:39:48.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.951+0000 7f0b06397640 1 Processor -- start 2023-11-04T01:39:48.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.951+0000 7f0b06397640 1 -- start start 2023-11-04T01:39:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.952+0000 7f0b06397640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b000cd6d0 0x7f0b00161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.952+0000 7f0b06397640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0b000b4880 0x7f0b000b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.952+0000 7f0b06397640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b000cde60 con 0x7f0b00153e60 2023-11-04T01:39:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.952+0000 7f0b06397640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b00160f90 con 0x7f0b000b4880 2023-11-04T01:39:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.952+0000 7f0b06397640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000b51e0 con 0x7f0b000cd6d0 2023-11-04T01:39:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.953+0000 7f0aff7fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b000cd6d0 0x7f0b00161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.953+0000 7f0b04934640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0b000b4880 0x7f0b000b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.953+0000 7f0afffff640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f0b00153e60 0x7f0b0015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:44188/0 (socket says 172.21.15.114:44188) 2023-11-04T01:39:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.953+0000 7f0aff7fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b000cd6d0 0x7f0b00161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:37370/0 (socket says 172.21.15.114:37370) 2023-11-04T01:39:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.953+0000 7f0afffff640 1 -- 172.21.15.114:0/4255664264 learned_addr learned my addr 172.21.15.114:0/4255664264 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.953+0000 7f0aff7fe640 1 -- 172.21.15.114:0/4255664264 >> v2:172.21.15.141:3300/0 conn(0x7f0b000b4880 msgr2=0x7f0b000b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.953+0000 7f0aff7fe640 1 --2- 172.21.15.114:0/4255664264 >> v2:172.21.15.141:3300/0 conn(0x7f0b000b4880 0x7f0b000b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.953+0000 7f0aff7fe640 1 -- 172.21.15.114:0/4255664264 >> v1:172.21.15.141:6789/0 conn(0x7f0b00153e60 legacy=0x7f0b0015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.953+0000 7f0aff7fe640 1 -- 172.21.15.114:0/4255664264 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b00161960 con 0x7f0b000cd6d0 2023-11-04T01:39:48.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.954+0000 7f0aff7fe640 1 --2- 172.21.15.114:0/4255664264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b000cd6d0 0x7f0b00161420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80097a0 tx=0x7f0ae802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfc3cbb45fd9b5b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:48.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.954+0000 7f0afeffd640 1 -- 172.21.15.114:0/4255664264 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8031830 con 0x7f0b000cd6d0 2023-11-04T01:39:48.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.954+0000 7f0afeffd640 1 -- 172.21.15.114:0/4255664264 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae8031990 con 0x7f0b000cd6d0 2023-11-04T01:39:48.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.954+0000 7f0afeffd640 1 -- 172.21.15.114:0/4255664264 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8031d20 con 0x7f0b000cd6d0 2023-11-04T01:39:48.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.954+0000 7f0b06397640 1 -- 172.21.15.114:0/4255664264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b000cd6d0 msgr2=0x7f0b00161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.954+0000 7f0b06397640 1 --2- 172.21.15.114:0/4255664264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b000cd6d0 0x7f0b00161420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80097a0 tx=0x7f0ae802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.955+0000 7f0b06397640 1 -- 172.21.15.114:0/4255664264 shutdown_connections 2023-11-04T01:39:48.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.955+0000 7f0b06397640 1 --2- 172.21.15.114:0/4255664264 >> v2:172.21.15.141:3300/0 conn(0x7f0b000b4880 0x7f0b000b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.955+0000 7f0b06397640 1 --2- 172.21.15.114:0/4255664264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b000cd6d0 0x7f0b00161420 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.955+0000 7f0b06397640 1 -- 172.21.15.114:0/4255664264 >> 172.21.15.114:0/4255664264 conn(0x7f0b000cf880 msgr2=0x7f0b000cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:48.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.955+0000 7f0b06397640 1 -- 172.21.15.114:0/4255664264 shutdown_connections 2023-11-04T01:39:48.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.955+0000 7f0b06397640 1 -- 172.21.15.114:0/4255664264 wait complete. 2023-11-04T01:39:48.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.956+0000 7f0b06397640 1 Processor -- start 2023-11-04T01:39:48.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.956+0000 7f0b06397640 1 -- start start 2023-11-04T01:39:48.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.956+0000 7f0b06397640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b000b4880 0x7f0b000cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.956+0000 7f0b06397640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b000cd6d0 0x7f0b001f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0b06397640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b00153e60 0x7f0b00154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0b06397640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000cbc90 con 0x7f0b000cd6d0 2023-11-04T01:39:48.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0b06397640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b00155bc0 con 0x7f0b000b4880 2023-11-04T01:39:48.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0b06397640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b00158d60 con 0x7f0b00153e60 2023-11-04T01:39:48.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0aff7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b000cd6d0 0x7f0b001f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0aff7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b000cd6d0 0x7f0b001f2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54448/0 (socket says 172.21.15.114:54448) 2023-11-04T01:39:48.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0aff7fe640 1 -- 172.21.15.114:0/3956520226 learned_addr learned my addr 172.21.15.114:0/3956520226 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:48.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0b04934640 1 --2- 172.21.15.114:0/3956520226 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b00153e60 0x7f0b00154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0afffff640 1 --2- 172.21.15.114:0/3956520226 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b000b4880 0x7f0b000cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0aff7fe640 1 -- 172.21.15.114:0/3956520226 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b00153e60 msgr2=0x7f0b00154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0aff7fe640 1 --2- 172.21.15.114:0/3956520226 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b00153e60 0x7f0b00154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0aff7fe640 1 -- 172.21.15.114:0/3956520226 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b000b4880 msgr2=0x7f0b000cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:48.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0aff7fe640 1 --2- 172.21.15.114:0/3956520226 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b000b4880 0x7f0b000cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:48.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0aff7fe640 1 -- 172.21.15.114:0/3956520226 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae8009400 con 0x7f0b000cd6d0 2023-11-04T01:39:48.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0aff7fe640 1 --2- 172.21.15.114:0/3956520226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b000cd6d0 0x7f0b001f2070 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009890 tx=0x7f0ae80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:48.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0afcff9640 1 -- 172.21.15.114:0/3956520226 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae803b980 con 0x7f0b000cd6d0 2023-11-04T01:39:48.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0afcff9640 1 -- 172.21.15.114:0/3956520226 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae803bb00 con 0x7f0b000cd6d0 2023-11-04T01:39:48.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0b06397640 1 -- 172.21.15.114:0/3956520226 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b000ca190 con 0x7f0b000cd6d0 2023-11-04T01:39:48.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0afcff9640 1 -- 172.21.15.114:0/3956520226 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8045400 con 0x7f0b000cd6d0 2023-11-04T01:39:48.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.957+0000 7f0b06397640 1 -- 172.21.15.114:0/3956520226 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b00159000 con 0x7f0b000cd6d0 2023-11-04T01:39:48.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.959+0000 7f0b06397640 1 -- 172.21.15.114:0/3956520226 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b00158bc0 con 0x7f0b000cd6d0 2023-11-04T01:39:48.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.959+0000 7f0afcff9640 1 -- 172.21.15.114:0/3956520226 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ae804e430 con 0x7f0b000cd6d0 2023-11-04T01:39:48.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.959+0000 7f0afcff9640 1 --2- 172.21.15.114:0/3956520226 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ae006ae70 0x7f0ae006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:48.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.959+0000 7f0afcff9640 1 -- 172.21.15.114:0/3956520226 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f0ae80ab880 con 0x7f0b000cd6d0 2023-11-04T01:39:48.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.959+0000 7f0afffff640 1 --2- 172.21.15.114:0/3956520226 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ae006ae70 0x7f0ae006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:48.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.960+0000 7f0afffff640 1 --2- 172.21.15.114:0/3956520226 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ae006ae70 0x7f0ae006d330 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0af0005880 tx=0x7f0af0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:48.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:48.963+0000 7f0afcff9640 1 -- 172.21.15.114:0/3956520226 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b00158bc0 con 0x7f0b000cd6d0 2023-11-04T01:39:49.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.131+0000 7f0b06397640 1 -- 172.21.15.114:0/3956520226 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f0b00158bc0 con 0x7f0b000cd6d0 2023-11-04T01:39:49.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.131+0000 7f0afcff9640 1 -- 172.21.15.114:0/3956520226 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v92) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0b00158bc0 con 0x7f0b000cd6d0 2023-11-04T01:39:49.133 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:49.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.133+0000 7f0b06397640 1 -- 172.21.15.114:0/3956520226 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ae006ae70 msgr2=0x7f0ae006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.133+0000 7f0b06397640 1 --2- 172.21.15.114:0/3956520226 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ae006ae70 0x7f0ae006d330 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0af0005880 tx=0x7f0af0009040 comp rx=0 tx=0).stop 2023-11-04T01:39:49.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.133+0000 7f0b06397640 1 -- 172.21.15.114:0/3956520226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b000cd6d0 msgr2=0x7f0b001f2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.133+0000 7f0b06397640 1 --2- 172.21.15.114:0/3956520226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b000cd6d0 0x7f0b001f2070 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009890 tx=0x7f0ae80046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.133+0000 7f0b06397640 1 -- 172.21.15.114:0/3956520226 shutdown_connections 2023-11-04T01:39:49.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.133+0000 7f0b06397640 1 --2- 172.21.15.114:0/3956520226 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b00153e60 0x7f0b00154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.133+0000 7f0b06397640 1 --2- 172.21.15.114:0/3956520226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b000cd6d0 0x7f0b001f2070 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.133+0000 7f0b06397640 1 --2- 172.21.15.114:0/3956520226 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ae006ae70 0x7f0ae006d330 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.133+0000 7f0b06397640 1 --2- 172.21.15.114:0/3956520226 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b000b4880 0x7f0b000cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.133+0000 7f0b06397640 1 -- 172.21.15.114:0/3956520226 >> 172.21.15.114:0/3956520226 conn(0x7f0b000cf880 msgr2=0x7f0b0015fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:49.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.133+0000 7f0b06397640 1 -- 172.21.15.114:0/3956520226 shutdown_connections 2023-11-04T01:39:49.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.133+0000 7f0b06397640 1 -- 172.21.15.114:0/3956520226 wait complete. 2023-11-04T01:39:49.146 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:39:49.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.246+0000 7f13343a9640 1 Processor -- start 2023-11-04T01:39:49.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.246+0000 7f13343a9640 1 -- start start 2023-11-04T01:39:49.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.247+0000 7f13343a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f132c153e60 0x7f132c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.247+0000 7f13343a9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f132c0cd6d0 0x7f132c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.247+0000 7f13343a9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f132c0cde60 con 0x7f132c0b4880 2023-11-04T01:39:49.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.247+0000 7f13343a9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f132c160f90 con 0x7f132c0cd6d0 2023-11-04T01:39:49.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.247+0000 7f13343a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132c15e400 con 0x7f132c153e60 2023-11-04T01:39:49.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.247+0000 7f1332946640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f132c0b4880 0x7f132c06b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58060/0 (socket says 172.21.15.114:58060) 2023-11-04T01:39:49.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.247+0000 7f1332946640 1 -- 172.21.15.114:0/141023707 learned_addr learned my addr 172.21.15.114:0/141023707 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:49.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331143640 1 -- 172.21.15.114:0/141023707 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100583204 0 0) 0x7f132c0cde60 con 0x7f132c0b4880 2023-11-04T01:39:49.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331944640 1 --2- 172.21.15.114:0/141023707 >> v2:172.21.15.141:3300/0 conn(0x7f132c0cd6d0 0x7f132c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331143640 1 -- 172.21.15.114:0/141023707 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1318003520 con 0x7f132c0b4880 2023-11-04T01:39:49.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1332145640 1 --2- 172.21.15.114:0/141023707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f132c153e60 0x7f132c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331143640 1 -- 172.21.15.114:0/141023707 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1480455655 0 0) 0x7f1318003520 con 0x7f132c0b4880 2023-11-04T01:39:49.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331143640 1 -- 172.21.15.114:0/141023707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f132c153e60 msgr2=0x7f132c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:49.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331143640 1 --2- 172.21.15.114:0/141023707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f132c153e60 0x7f132c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331143640 1 -- 172.21.15.114:0/141023707 >> v2:172.21.15.141:3300/0 conn(0x7f132c0cd6d0 msgr2=0x7f132c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:49.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331143640 1 --2- 172.21.15.114:0/141023707 >> v2:172.21.15.141:3300/0 conn(0x7f132c0cd6d0 0x7f132c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331143640 1 -- 172.21.15.114:0/141023707 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c161960 con 0x7f132c0b4880 2023-11-04T01:39:49.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331143640 1 -- 172.21.15.114:0/141023707 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f13240019f0 con 0x7f132c0b4880 2023-11-04T01:39:49.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331143640 1 -- 172.21.15.114:0/141023707 >> v1:172.21.15.114:6789/0 conn(0x7f132c0b4880 legacy=0x7f132c06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331143640 1 --2- 172.21.15.114:0/141023707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1318003970 0x7f1318003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331143640 1 --2- 172.21.15.114:0/141023707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13180047c0 0x7f1318004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331143640 1 --2- 172.21.15.114:0/141023707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f132c153e60 0x7f1318005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331143640 1 -- 172.21.15.114:0/141023707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c160f90 con 0x7f1318003970 2023-11-04T01:39:49.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331143640 1 -- 172.21.15.114:0/141023707 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c15e400 con 0x7f13180047c0 2023-11-04T01:39:49.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331143640 1 -- 172.21.15.114:0/141023707 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131800b980 con 0x7f132c153e60 2023-11-04T01:39:49.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1332145640 1 --2- 172.21.15.114:0/141023707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1318003970 0x7f1318003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1331944640 1 --2- 172.21.15.114:0/141023707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13180047c0 0x7f1318004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1332946640 1 --2- 172.21.15.114:0/141023707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f132c153e60 0x7f1318005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1332145640 1 -- 172.21.15.114:0/141023707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f132c153e60 msgr2=0x7f1318005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:49.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1332145640 1 --2- 172.21.15.114:0/141023707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f132c153e60 0x7f1318005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1332145640 1 -- 172.21.15.114:0/141023707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13180047c0 msgr2=0x7f1318004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:49.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.248+0000 7f1332145640 1 --2- 172.21.15.114:0/141023707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13180047c0 0x7f1318004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.249+0000 7f1332145640 1 -- 172.21.15.114:0/141023707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1318003520 con 0x7f1318003970 2023-11-04T01:39:49.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.249+0000 7f1332946640 1 --2- 172.21.15.114:0/141023707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f132c153e60 0x7f1318005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:49.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.249+0000 7f1331944640 1 --2- 172.21.15.114:0/141023707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13180047c0 0x7f1318004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:49.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.249+0000 7f1332145640 1 --2- 172.21.15.114:0/141023707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1318003970 0x7f1318003d90 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f131c009ac0 tx=0x7f13180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2e86e3527cddae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:49.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.249+0000 7f1331143640 1 -- 172.21.15.114:0/141023707 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c02c6b0 con 0x7f1318003970 2023-11-04T01:39:49.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.249+0000 7f1331143640 1 -- 172.21.15.114:0/141023707 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131c02c810 con 0x7f1318003970 2023-11-04T01:39:49.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.249+0000 7f1331143640 1 -- 172.21.15.114:0/141023707 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c02cba0 con 0x7f1318003970 2023-11-04T01:39:49.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.250+0000 7f13343a9640 1 -- 172.21.15.114:0/141023707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1318003970 msgr2=0x7f1318003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.250+0000 7f13343a9640 1 --2- 172.21.15.114:0/141023707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1318003970 0x7f1318003d90 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f131c009ac0 tx=0x7f13180057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.250+0000 7f1332946640 1 -- 172.21.15.114:0/141023707 reap_dead start 2023-11-04T01:39:49.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.250+0000 7f13343a9640 1 -- 172.21.15.114:0/141023707 shutdown_connections 2023-11-04T01:39:49.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.250+0000 7f13343a9640 1 -- 172.21.15.114:0/141023707 >> 172.21.15.114:0/141023707 conn(0x7f132c0cf880 msgr2=0x7f132c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:49.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.250+0000 7f13343a9640 1 -- 172.21.15.114:0/141023707 shutdown_connections 2023-11-04T01:39:49.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.250+0000 7f13343a9640 1 -- 172.21.15.114:0/141023707 wait complete. 2023-11-04T01:39:49.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.251+0000 7f13343a9640 1 Processor -- start 2023-11-04T01:39:49.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.251+0000 7f13343a9640 1 -- start start 2023-11-04T01:39:49.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f13343a9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1318003970 0x7f132c0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f13343a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f132c0c8b40 0x7f132c0c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f13343a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f132c1f5a90 0x7f132c1f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f13343a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c0c9500 con 0x7f132c1f5a90 2023-11-04T01:39:49.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f13343a9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c143890 con 0x7f1318003970 2023-11-04T01:39:49.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f13343a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132c142c80 con 0x7f132c0c8b40 2023-11-04T01:39:49.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f1332946640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f132c1f5a90 0x7f132c1f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f1332946640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f132c1f5a90 0x7f132c1f5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54472/0 (socket says 172.21.15.114:54472) 2023-11-04T01:39:49.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f1332946640 1 -- 172.21.15.114:0/707105963 learned_addr learned my addr 172.21.15.114:0/707105963 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:49.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f1332946640 1 -- 172.21.15.114:0/707105963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f132c0c8b40 msgr2=0x7f132c0c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f1332946640 1 --2- 172.21.15.114:0/707105963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f132c0c8b40 0x7f132c0c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f1332946640 1 -- 172.21.15.114:0/707105963 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1318003970 msgr2=0x7f132c0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f1332946640 1 --2- 172.21.15.114:0/707105963 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1318003970 0x7f132c0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f1332946640 1 -- 172.21.15.114:0/707105963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c142f60 con 0x7f132c1f5a90 2023-11-04T01:39:49.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f1332946640 1 --2- 172.21.15.114:0/707105963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f132c1f5a90 0x7f132c1f5ef0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f132c08abe0 tx=0x7f132400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:49.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f1322ffd640 1 -- 172.21.15.114:0/707105963 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324007ae0 con 0x7f132c1f5a90 2023-11-04T01:39:49.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f1322ffd640 1 -- 172.21.15.114:0/707105963 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132400ed40 con 0x7f132c1f5a90 2023-11-04T01:39:49.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f1322ffd640 1 -- 172.21.15.114:0/707105963 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324014650 con 0x7f132c1f5a90 2023-11-04T01:39:49.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.252+0000 7f13343a9640 1 -- 172.21.15.114:0/707105963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132c143240 con 0x7f132c1f5a90 2023-11-04T01:39:49.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.253+0000 7f13343a9640 1 -- 172.21.15.114:0/707105963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132c0cbd30 con 0x7f132c1f5a90 2023-11-04T01:39:49.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.253+0000 7f13343a9640 1 -- 172.21.15.114:0/707105963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f132c074290 con 0x7f132c1f5a90 2023-11-04T01:39:49.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.254+0000 7f1322ffd640 1 -- 172.21.15.114:0/707105963 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f13240147b0 con 0x7f132c1f5a90 2023-11-04T01:39:49.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.254+0000 7f1322ffd640 1 --2- 172.21.15.114:0/707105963 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f131006ae70 0x7f131006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.254+0000 7f1332145640 1 --2- 172.21.15.114:0/707105963 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f131006ae70 0x7f131006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.254+0000 7f1322ffd640 1 -- 172.21.15.114:0/707105963 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f13240895d0 con 0x7f132c1f5a90 2023-11-04T01:39:49.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.255+0000 7f1332145640 1 --2- 172.21.15.114:0/707105963 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f131006ae70 0x7f131006d330 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f131c036000 tx=0x7f131c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:49.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.259+0000 7f1322ffd640 1 -- 172.21.15.114:0/707105963 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1324054450 con 0x7f132c1f5a90 2023-11-04T01:39:49.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.424+0000 7f13343a9640 1 -- 172.21.15.114:0/707105963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f132c1439d0 con 0x7f132c1f5a90 2023-11-04T01:39:49.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.424+0000 7f1322ffd640 1 -- 172.21.15.114:0/707105963 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v92) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1324057a70 con 0x7f132c1f5a90 2023-11-04T01:39:49.426 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:39:49.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.426+0000 7f13343a9640 1 -- 172.21.15.114:0/707105963 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f131006ae70 msgr2=0x7f131006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.426+0000 7f13343a9640 1 --2- 172.21.15.114:0/707105963 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f131006ae70 0x7f131006d330 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f131c036000 tx=0x7f131c02e000 comp rx=0 tx=0).stop 2023-11-04T01:39:49.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.426+0000 7f13343a9640 1 -- 172.21.15.114:0/707105963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f132c1f5a90 msgr2=0x7f132c1f5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.426+0000 7f13343a9640 1 --2- 172.21.15.114:0/707105963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f132c1f5a90 0x7f132c1f5ef0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f132c08abe0 tx=0x7f132400e530 comp rx=0 tx=0).stop 2023-11-04T01:39:49.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.426+0000 7f13343a9640 1 -- 172.21.15.114:0/707105963 shutdown_connections 2023-11-04T01:39:49.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.426+0000 7f13343a9640 1 --2- 172.21.15.114:0/707105963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f132c1f5a90 0x7f132c1f5ef0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.426+0000 7f13343a9640 1 --2- 172.21.15.114:0/707105963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f132c0c8b40 0x7f132c0c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.426+0000 7f13343a9640 1 --2- 172.21.15.114:0/707105963 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f131006ae70 0x7f131006d330 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.426+0000 7f13343a9640 1 --2- 172.21.15.114:0/707105963 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1318003970 0x7f132c0cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.426+0000 7f13343a9640 1 -- 172.21.15.114:0/707105963 >> 172.21.15.114:0/707105963 conn(0x7f132c0cf880 msgr2=0x7f132c0b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:49.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.426+0000 7f13343a9640 1 -- 172.21.15.114:0/707105963 shutdown_connections 2023-11-04T01:39:49.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.426+0000 7f13343a9640 1 -- 172.21.15.114:0/707105963 wait complete. 2023-11-04T01:39:49.439 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:39:49.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.536+0000 7fbacf461640 1 Processor -- start 2023-11-04T01:39:49.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.536+0000 7fbacf461640 1 -- start start 2023-11-04T01:39:49.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.537+0000 7fbacf461640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbac80af060 0x7fbac80b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.537+0000 7fbacf461640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac80b1590 con 0x7fbac80aec80 2023-11-04T01:39:49.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.537+0000 7fbacf461640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac806a8e0 con 0x7fbac806ef40 2023-11-04T01:39:49.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.537+0000 7fbacf461640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac8155a40 con 0x7fbac80af060 2023-11-04T01:39:49.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.537+0000 7fbacc9fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbac80af060 0x7fbac80b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.537+0000 7fbacd1fd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbac80aec80 0x7fbac806a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58064/0 (socket says 172.21.15.114:58064) 2023-11-04T01:39:49.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.537+0000 7fbacd1fd640 1 -- 172.21.15.114:0/1282606679 learned_addr learned my addr 172.21.15.114:0/1282606679 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.537+0000 7fbacc9fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbac80af060 0x7fbac80b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54488/0 (socket says 172.21.15.114:54488) 2023-11-04T01:39:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.537+0000 7fbacc9fc640 1 -- 172.21.15.114:0/1282606679 >> v1:172.21.15.141:6789/0 conn(0x7fbac806ef40 legacy=0x7fbac80cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.537+0000 7fbacc9fc640 1 -- 172.21.15.114:0/1282606679 >> v1:172.21.15.114:6789/0 conn(0x7fbac80aec80 legacy=0x7fbac806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.537+0000 7fbabffff640 1 -- 172.21.15.114:0/1282606679 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119422000 0 0) 0x7fbac80b1590 con 0x7fbac80aec80 2023-11-04T01:39:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.537+0000 7fbacc9fc640 1 -- 172.21.15.114:0/1282606679 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80b1800 con 0x7fbac80af060 2023-11-04T01:39:49.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.538+0000 7fbacc9fc640 1 --2- 172.21.15.114:0/1282606679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80af060 0x7fbac80b1fe0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009790 tx=0x7fbab802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba80a48fbd8bf4f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:49.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.538+0000 7fbabffff640 1 -- 172.21.15.114:0/1282606679 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8031830 con 0x7fbac80af060 2023-11-04T01:39:49.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.538+0000 7fbabffff640 1 -- 172.21.15.114:0/1282606679 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab8031990 con 0x7fbac80af060 2023-11-04T01:39:49.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.538+0000 7fbabffff640 1 -- 172.21.15.114:0/1282606679 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8031d20 con 0x7fbac80af060 2023-11-04T01:39:49.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.538+0000 7fbacf461640 1 -- 172.21.15.114:0/1282606679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80af060 msgr2=0x7fbac80b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.538+0000 7fbacf461640 1 --2- 172.21.15.114:0/1282606679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80af060 0x7fbac80b1fe0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009790 tx=0x7fbab802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.538+0000 7fbacf461640 1 -- 172.21.15.114:0/1282606679 shutdown_connections 2023-11-04T01:39:49.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.539+0000 7fbacf461640 1 --2- 172.21.15.114:0/1282606679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80af060 0x7fbac80b1fe0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.539+0000 7fbacf461640 1 -- 172.21.15.114:0/1282606679 >> 172.21.15.114:0/1282606679 conn(0x7fbac8098d40 msgr2=0x7fbac80cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:49.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.539+0000 7fbacf461640 1 -- 172.21.15.114:0/1282606679 shutdown_connections 2023-11-04T01:39:49.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.539+0000 7fbacf461640 1 -- 172.21.15.114:0/1282606679 wait complete. 2023-11-04T01:39:49.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.540+0000 7fbacf461640 1 Processor -- start 2023-11-04T01:39:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.540+0000 7fbacf461640 1 -- start start 2023-11-04T01:39:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.540+0000 7fbacf461640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbac806ef40 0x7fbac80b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.540+0000 7fbacf461640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbac80aec80 0x7fbac80ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacf461640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80af060 0x7fbac81f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacf461640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80b2690 con 0x7fbac80af060 2023-11-04T01:39:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacf461640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac81f4af0 con 0x7fbac80aec80 2023-11-04T01:39:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacf461640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80add90 con 0x7fbac806ef40 2023-11-04T01:39:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacd9fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80af060 0x7fbac81f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacd9fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80af060 0x7fbac81f45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54498/0 (socket says 172.21.15.114:54498) 2023-11-04T01:39:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacd9fe640 1 -- 172.21.15.114:0/910717566 learned_addr learned my addr 172.21.15.114:0/910717566 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacc9fc640 1 --2- 172.21.15.114:0/910717566 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbac80aec80 0x7fbac80ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacd1fd640 1 --2- 172.21.15.114:0/910717566 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbac806ef40 0x7fbac80b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacd9fe640 1 -- 172.21.15.114:0/910717566 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbac806ef40 msgr2=0x7fbac80b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacd9fe640 1 --2- 172.21.15.114:0/910717566 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbac806ef40 0x7fbac80b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacd9fe640 1 -- 172.21.15.114:0/910717566 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbac80aec80 msgr2=0x7fbac80ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacd9fe640 1 --2- 172.21.15.114:0/910717566 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbac80aec80 0x7fbac80ad740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacd9fe640 1 -- 172.21.15.114:0/910717566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab80093a0 con 0x7fbac80af060 2023-11-04T01:39:49.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacd9fe640 1 --2- 172.21.15.114:0/910717566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80af060 0x7fbac81f45b0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fbac000c780 tx=0x7fbac000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:49.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbabdffb640 1 -- 172.21.15.114:0/910717566 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0004b60 con 0x7fbac80af060 2023-11-04T01:39:49.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbabdffb640 1 -- 172.21.15.114:0/910717566 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac000ce90 con 0x7fbac80af060 2023-11-04T01:39:49.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacf461640 1 -- 172.21.15.114:0/910717566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac80ae070 con 0x7fbac80af060 2023-11-04T01:39:49.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbabdffb640 1 -- 172.21.15.114:0/910717566 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac000a850 con 0x7fbac80af060 2023-11-04T01:39:49.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.541+0000 7fbacf461640 1 -- 172.21.15.114:0/910717566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac80c7fb0 con 0x7fbac80af060 2023-11-04T01:39:49.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.542+0000 7fbacf461640 1 -- 172.21.15.114:0/910717566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac8074290 con 0x7fbac80af060 2023-11-04T01:39:49.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.543+0000 7fbabdffb640 1 -- 172.21.15.114:0/910717566 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbac000a9b0 con 0x7fbac80af060 2023-11-04T01:39:49.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.543+0000 7fbabdffb640 1 --2- 172.21.15.114:0/910717566 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbaac06ae70 0x7fbaac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.543+0000 7fbacd1fd640 1 --2- 172.21.15.114:0/910717566 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbaac06ae70 0x7fbaac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.543+0000 7fbabdffb640 1 -- 172.21.15.114:0/910717566 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7fbac0089970 con 0x7fbac80af060 2023-11-04T01:39:49.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.544+0000 7fbacd1fd640 1 --2- 172.21.15.114:0/910717566 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbaac06ae70 0x7fbaac06d330 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbac40010e0 tx=0x7fbac4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:49.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.547+0000 7fbabdffb640 1 -- 172.21.15.114:0/910717566 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbac0054880 con 0x7fbac80af060 2023-11-04T01:39:49.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.716+0000 7fbacf461640 1 -- 172.21.15.114:0/910717566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbac80c6780 con 0x7fbac80af060 2023-11-04T01:39:49.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.717+0000 7fbabdffb640 1 -- 172.21.15.114:0/910717566 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v92) v1 ==== 84+0+287 (secure 0 0 0) 0x7fbac0057ea0 con 0x7fbac80af060 2023-11-04T01:39:49.719 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:49.719 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2023-11-04T01:39:49.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:49.719 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2023-11-04T01:39:49.719 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2023-11-04T01:39:49.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:49.719 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:49.719 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 7, 2023-11-04T01:39:49.719 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "snap-test-pool" 2023-11-04T01:39:49.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:49.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:49.720 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 12, 2023-11-04T01:39:49.720 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "test_data_pool" 2023-11-04T01:39:49.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:49.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-11-04T01:39:49.720 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 13, 2023-11-04T01:39:49.720 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "test_metadata_pool" 2023-11-04T01:39:49.720 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:49.720 INFO:teuthology.orchestra.run.smithi114.stdout:] 2023-11-04T01:39:49.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.719+0000 7fbacf461640 1 -- 172.21.15.114:0/910717566 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbaac06ae70 msgr2=0x7fbaac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.719+0000 7fbacf461640 1 --2- 172.21.15.114:0/910717566 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbaac06ae70 0x7fbaac06d330 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbac40010e0 tx=0x7fbac4009040 comp rx=0 tx=0).stop 2023-11-04T01:39:49.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.719+0000 7fbacf461640 1 -- 172.21.15.114:0/910717566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80af060 msgr2=0x7fbac81f45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.719+0000 7fbacf461640 1 --2- 172.21.15.114:0/910717566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80af060 0x7fbac81f45b0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fbac000c780 tx=0x7fbac000cc40 comp rx=0 tx=0).stop 2023-11-04T01:39:49.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.719+0000 7fbacf461640 1 -- 172.21.15.114:0/910717566 shutdown_connections 2023-11-04T01:39:49.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.719+0000 7fbacf461640 1 --2- 172.21.15.114:0/910717566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80af060 0x7fbac81f45b0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.719+0000 7fbacf461640 1 --2- 172.21.15.114:0/910717566 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbaac06ae70 0x7fbaac06d330 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.719+0000 7fbacf461640 1 --2- 172.21.15.114:0/910717566 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbac80aec80 0x7fbac80ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.719+0000 7fbacf461640 1 --2- 172.21.15.114:0/910717566 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbac806ef40 0x7fbac80b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.719+0000 7fbacf461640 1 -- 172.21.15.114:0/910717566 >> 172.21.15.114:0/910717566 conn(0x7fbac8098d40 msgr2=0x7fbac8154b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:49.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.719+0000 7fbacf461640 1 -- 172.21.15.114:0/910717566 shutdown_connections 2023-11-04T01:39:49.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.719+0000 7fbacf461640 1 -- 172.21.15.114:0/910717566 wait complete. 2023-11-04T01:39:49.731 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:39:49.731 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:39:49.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.833+0000 7fc3451b6640 1 Processor -- start 2023-11-04T01:39:49.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.833+0000 7fc3451b6640 1 -- start start 2023-11-04T01:39:49.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc3451b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3400ca0a0 0x7fc34006fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc3451b6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3400ae890 con 0x7fc34006a830 2023-11-04T01:39:49.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc3451b6640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3400c6900 con 0x7fc34015e590 2023-11-04T01:39:49.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc3451b6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400ca9b0 con 0x7fc3400ca0a0 2023-11-04T01:39:49.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc337fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc34006a830 0x7fc3400b2b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58072/0 (socket says 172.21.15.114:58072) 2023-11-04T01:39:49.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc337fff640 1 -- 172.21.15.114:0/2575538617 learned_addr learned my addr 172.21.15.114:0/2575538617 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:49.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc33f59e640 1 --2- 172.21.15.114:0/2575538617 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3400ca0a0 0x7fc34006fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc33e59c640 1 -- 172.21.15.114:0/2575538617 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669681076 0 0) 0x7fc3400ae890 con 0x7fc34006a830 2023-11-04T01:39:49.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc33e59c640 1 -- 172.21.15.114:0/2575538617 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc32c003520 con 0x7fc34006a830 2023-11-04T01:39:49.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc33e59c640 1 -- 172.21.15.114:0/2575538617 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2742245817 0 0) 0x7fc32c003520 con 0x7fc34006a830 2023-11-04T01:39:49.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc33e59c640 1 -- 172.21.15.114:0/2575538617 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3400ca0a0 msgr2=0x7fc34006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:49.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc33e59c640 1 --2- 172.21.15.114:0/2575538617 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3400ca0a0 0x7fc34006fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc33e59c640 1 -- 172.21.15.114:0/2575538617 >> v1:172.21.15.141:6789/0 conn(0x7fc34015e590 legacy=0x7fc34006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc33e59c640 1 -- 172.21.15.114:0/2575538617 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3400aeae0 con 0x7fc34006a830 2023-11-04T01:39:49.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc33e59c640 1 -- 172.21.15.114:0/2575538617 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fc328001670 con 0x7fc34006a830 2023-11-04T01:39:49.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc33e59c640 1 -- 172.21.15.114:0/2575538617 >> v1:172.21.15.114:6789/0 conn(0x7fc34006a830 legacy=0x7fc3400b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc33e59c640 1 --2- 172.21.15.114:0/2575538617 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3400ca0a0 0x7fc32c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc33e59c640 1 --2- 172.21.15.114:0/2575538617 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc32c003ee0 0x7fc32c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc33e59c640 1 --2- 172.21.15.114:0/2575538617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc32c004d00 0x7fc32c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc33e59c640 1 -- 172.21.15.114:0/2575538617 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400ca9b0 con 0x7fc32c004d00 2023-11-04T01:39:49.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc33e59c640 1 -- 172.21.15.114:0/2575538617 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c00ba90 con 0x7fc32c003ee0 2023-11-04T01:39:49.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.834+0000 7fc33e59c640 1 -- 172.21.15.114:0/2575538617 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c00bc50 con 0x7fc3400ca0a0 2023-11-04T01:39:49.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.835+0000 7fc33f59e640 1 --2- 172.21.15.114:0/2575538617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc32c004d00 0x7fc32c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.835+0000 7fc337fff640 1 --2- 172.21.15.114:0/2575538617 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc32c003ee0 0x7fc32c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.835+0000 7fc33ed9d640 1 --2- 172.21.15.114:0/2575538617 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3400ca0a0 0x7fc32c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.835+0000 7fc33f59e640 1 -- 172.21.15.114:0/2575538617 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3400ca0a0 msgr2=0x7fc32c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:49.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.835+0000 7fc33f59e640 1 --2- 172.21.15.114:0/2575538617 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3400ca0a0 0x7fc32c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.835+0000 7fc33f59e640 1 -- 172.21.15.114:0/2575538617 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc32c003ee0 msgr2=0x7fc32c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:49.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.835+0000 7fc33f59e640 1 --2- 172.21.15.114:0/2575538617 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc32c003ee0 0x7fc32c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.835+0000 7fc33f59e640 1 -- 172.21.15.114:0/2575538617 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c003520 con 0x7fc32c004d00 2023-11-04T01:39:49.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.836+0000 7fc33f59e640 1 --2- 172.21.15.114:0/2575538617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc32c004d00 0x7fc32c005180 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fc338009f90 tx=0x7fc32c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca82025110f4a0c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:49.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.836+0000 7fc33e59c640 1 -- 172.21.15.114:0/2575538617 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33802cbd0 con 0x7fc32c004d00 2023-11-04T01:39:49.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.836+0000 7fc33e59c640 1 -- 172.21.15.114:0/2575538617 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33800f040 con 0x7fc32c004d00 2023-11-04T01:39:49.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.836+0000 7fc33e59c640 1 -- 172.21.15.114:0/2575538617 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338034440 con 0x7fc32c004d00 2023-11-04T01:39:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.836+0000 7fc3451b6640 1 -- 172.21.15.114:0/2575538617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc32c004d00 msgr2=0x7fc32c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.836+0000 7fc3451b6640 1 --2- 172.21.15.114:0/2575538617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc32c004d00 0x7fc32c005180 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fc338009f90 tx=0x7fc32c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.836+0000 7fc33f59e640 1 -- 172.21.15.114:0/2575538617 reap_dead start 2023-11-04T01:39:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.836+0000 7fc3451b6640 1 -- 172.21.15.114:0/2575538617 shutdown_connections 2023-11-04T01:39:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.836+0000 7fc3451b6640 1 -- 172.21.15.114:0/2575538617 >> 172.21.15.114:0/2575538617 conn(0x7fc34006d820 msgr2=0x7fc34006dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.836+0000 7fc3451b6640 1 -- 172.21.15.114:0/2575538617 shutdown_connections 2023-11-04T01:39:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.836+0000 7fc3451b6640 1 -- 172.21.15.114:0/2575538617 wait complete. 2023-11-04T01:39:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.837+0000 7fc3451b6640 1 Processor -- start 2023-11-04T01:39:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.838+0000 7fc3451b6640 1 -- start start 2023-11-04T01:39:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.838+0000 7fc3451b6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3400c3100 0x7fc3400af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.838+0000 7fc3451b6640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3400af540 0x7fc3401f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.838+0000 7fc3451b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3401f43e0 0x7fc3400c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.838+0000 7fc3451b6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400cac90 con 0x7fc3400c3100 2023-11-04T01:39:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.838+0000 7fc3451b6640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400a7d80 con 0x7fc3400af540 2023-11-04T01:39:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.838+0000 7fc3451b6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3401f4860 con 0x7fc3401f43e0 2023-11-04T01:39:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.838+0000 7fc33ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3400c3100 0x7fc3400af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.838+0000 7fc33ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3400c3100 0x7fc3400af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54512/0 (socket says 172.21.15.114:54512) 2023-11-04T01:39:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.838+0000 7fc33ed9d640 1 -- 172.21.15.114:0/456075582 learned_addr learned my addr 172.21.15.114:0/456075582 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.839+0000 7fc337fff640 1 --2- 172.21.15.114:0/456075582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3400af540 0x7fc3401f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.839+0000 7fc33f59e640 1 --2- 172.21.15.114:0/456075582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3401f43e0 0x7fc3400c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.839+0000 7fc33ed9d640 1 -- 172.21.15.114:0/456075582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3401f43e0 msgr2=0x7fc3400c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.839+0000 7fc33ed9d640 1 --2- 172.21.15.114:0/456075582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3401f43e0 0x7fc3400c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.839+0000 7fc33ed9d640 1 -- 172.21.15.114:0/456075582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3400af540 msgr2=0x7fc3401f3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.839+0000 7fc33ed9d640 1 --2- 172.21.15.114:0/456075582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3400af540 0x7fc3401f3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.839+0000 7fc33ed9d640 1 -- 172.21.15.114:0/456075582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3400afaa0 con 0x7fc3400c3100 2023-11-04T01:39:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.839+0000 7fc33f59e640 1 --2- 172.21.15.114:0/456075582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3401f43e0 0x7fc3400c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.839+0000 7fc337fff640 1 --2- 172.21.15.114:0/456075582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3400af540 0x7fc3401f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.839+0000 7fc33ed9d640 1 --2- 172.21.15.114:0/456075582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3400c3100 0x7fc3400af000 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fc33000f7c0 tx=0x7fc33000fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.839+0000 7fc3377fe640 1 -- 172.21.15.114:0/456075582 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33000fed0 con 0x7fc3400c3100 2023-11-04T01:39:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.839+0000 7fc3377fe640 1 -- 172.21.15.114:0/456075582 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3300052e0 con 0x7fc3400c3100 2023-11-04T01:39:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.839+0000 7fc3377fe640 1 -- 172.21.15.114:0/456075582 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33000d970 con 0x7fc3400c3100 2023-11-04T01:39:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.839+0000 7fc3451b6640 1 -- 172.21.15.114:0/456075582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3400afd80 con 0x7fc3400c3100 2023-11-04T01:39:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.839+0000 7fc3451b6640 1 -- 172.21.15.114:0/456075582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3400b0340 con 0x7fc3400c3100 2023-11-04T01:39:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.840+0000 7fc3451b6640 1 -- 172.21.15.114:0/456075582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34004e490 con 0x7fc3400c3100 2023-11-04T01:39:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.840+0000 7fc3377fe640 1 -- 172.21.15.114:0/456075582 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc33000dad0 con 0x7fc3400c3100 2023-11-04T01:39:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.841+0000 7fc3377fe640 1 --2- 172.21.15.114:0/456075582 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc32006aea0 0x7fc32006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.841+0000 7fc3377fe640 1 -- 172.21.15.114:0/456075582 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7fc330089820 con 0x7fc3400c3100 2023-11-04T01:39:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.841+0000 7fc337fff640 1 --2- 172.21.15.114:0/456075582 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc32006aea0 0x7fc32006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:49.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.841+0000 7fc337fff640 1 --2- 172.21.15.114:0/456075582 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc32006aea0 0x7fc32006d360 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc328001cb0 tx=0x7fc328009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:49.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:49.845+0000 7fc3377fe640 1 -- 172.21.15.114:0/456075582 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc330054730 con 0x7fc3400c3100 2023-11-04T01:39:50.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.012+0000 7fc3451b6640 1 -- 172.21.15.114:0/456075582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc3400c67e0 con 0x7fc3400c3100 2023-11-04T01:39:50.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.084+0000 7fc3377fe640 1 -- 172.21.15.114:0/456075582 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v93) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc330057d50 con 0x7fc3400c3100 2023-11-04T01:39:50.086 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2023-11-04T01:39:50.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.086+0000 7fc3451b6640 1 -- 172.21.15.114:0/456075582 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc32006aea0 msgr2=0x7fc32006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:50.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.086+0000 7fc3451b6640 1 --2- 172.21.15.114:0/456075582 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc32006aea0 0x7fc32006d360 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc328001cb0 tx=0x7fc328009040 comp rx=0 tx=0).stop 2023-11-04T01:39:50.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.086+0000 7fc3451b6640 1 -- 172.21.15.114:0/456075582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3400c3100 msgr2=0x7fc3400af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:50.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.086+0000 7fc3451b6640 1 --2- 172.21.15.114:0/456075582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3400c3100 0x7fc3400af000 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fc33000f7c0 tx=0x7fc33000fc80 comp rx=0 tx=0).stop 2023-11-04T01:39:50.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.086+0000 7fc3451b6640 1 -- 172.21.15.114:0/456075582 shutdown_connections 2023-11-04T01:39:50.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.086+0000 7fc3451b6640 1 --2- 172.21.15.114:0/456075582 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc3401f43e0 0x7fc3400c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.086+0000 7fc3451b6640 1 --2- 172.21.15.114:0/456075582 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc32006aea0 0x7fc32006d360 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.086+0000 7fc3451b6640 1 --2- 172.21.15.114:0/456075582 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc3400af540 0x7fc3401f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.086+0000 7fc3451b6640 1 --2- 172.21.15.114:0/456075582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3400c3100 0x7fc3400af000 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.086+0000 7fc3451b6640 1 -- 172.21.15.114:0/456075582 >> 172.21.15.114:0/456075582 conn(0x7fc34006d820 msgr2=0x7fc3400c6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:50.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.086+0000 7fc3451b6640 1 -- 172.21.15.114:0/456075582 shutdown_connections 2023-11-04T01:39:50.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.086+0000 7fc3451b6640 1 -- 172.21.15.114:0/456075582 wait complete. 2023-11-04T01:39:50.103 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:39:50.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.208+0000 7f3337778640 1 Processor -- start 2023-11-04T01:39:50.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.208+0000 7f3337778640 1 -- start start 2023-11-04T01:39:50.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.209+0000 7f3337778640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33300c4ff0 0x7f33300cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.209+0000 7f3337778640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33300adac0 0x7f33300adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.209+0000 7f3337778640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333015aff0 con 0x7f3330159c00 2023-11-04T01:39:50.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.209+0000 7f3337778640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33300ae450 con 0x7f33300adac0 2023-11-04T01:39:50.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.209+0000 7f3337778640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333015a3e0 con 0x7f33300c4ff0 2023-11-04T01:39:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.209+0000 7f3335d15640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33300adac0 0x7f33300adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.209+0000 7f3335d15640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33300adac0 0x7f33300adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54516/0 (socket says 172.21.15.114:54516) 2023-11-04T01:39:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.209+0000 7f3335d15640 1 -- 172.21.15.114:0/304471896 learned_addr learned my addr 172.21.15.114:0/304471896 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.210+0000 7f3334d13640 1 --2- 172.21.15.114:0/304471896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33300c4ff0 0x7f33300cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.210+0000 7f3335d15640 1 -- 172.21.15.114:0/304471896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33300c4ff0 msgr2=0x7f33300cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.210+0000 7f3335d15640 1 --2- 172.21.15.114:0/304471896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33300c4ff0 0x7f33300cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.210+0000 7f3335d15640 1 -- 172.21.15.114:0/304471896 >> v1:172.21.15.141:6789/0 conn(0x7f3330159c00 legacy=0x7f33300c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.210+0000 7f3335d15640 1 -- 172.21.15.114:0/304471896 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333015a6c0 con 0x7f33300adac0 2023-11-04T01:39:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.210+0000 7f3334d13640 1 --2- 172.21.15.114:0/304471896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33300c4ff0 0x7f33300cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.210+0000 7f3335d15640 1 --2- 172.21.15.114:0/304471896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33300adac0 0x7f33300adf10 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f3328009870 tx=0x7f332802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4a25f6aadccb6e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.210+0000 7f3327fff640 1 -- 172.21.15.114:0/304471896 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328031640 con 0x7f33300adac0 2023-11-04T01:39:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.211+0000 7f3327fff640 1 -- 172.21.15.114:0/304471896 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33280317a0 con 0x7f33300adac0 2023-11-04T01:39:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.211+0000 7f3327fff640 1 -- 172.21.15.114:0/304471896 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328031b30 con 0x7f33300adac0 2023-11-04T01:39:50.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.211+0000 7f3337778640 1 -- 172.21.15.114:0/304471896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33300adac0 msgr2=0x7f33300adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:50.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.211+0000 7f3337778640 1 --2- 172.21.15.114:0/304471896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33300adac0 0x7f33300adf10 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f3328009870 tx=0x7f332802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.211+0000 7f3337778640 1 -- 172.21.15.114:0/304471896 shutdown_connections 2023-11-04T01:39:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.211+0000 7f3337778640 1 --2- 172.21.15.114:0/304471896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33300adac0 0x7f33300adf10 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.211+0000 7f3337778640 1 --2- 172.21.15.114:0/304471896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33300c4ff0 0x7f33300cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.211+0000 7f3337778640 1 -- 172.21.15.114:0/304471896 >> 172.21.15.114:0/304471896 conn(0x7f33300ce950 msgr2=0x7f33300ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.211+0000 7f3337778640 1 -- 172.21.15.114:0/304471896 shutdown_connections 2023-11-04T01:39:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.211+0000 7f3337778640 1 -- 172.21.15.114:0/304471896 wait complete. 2023-11-04T01:39:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.212+0000 7f3337778640 1 Processor -- start 2023-11-04T01:39:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.212+0000 7f3337778640 1 -- start start 2023-11-04T01:39:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3337778640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33300adac0 0x7f3330150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3337778640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33300c4ff0 0x7f3330157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3337778640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3330159c00 0x7f3330157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3337778640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33301591e0 con 0x7f3330159c00 2023-11-04T01:39:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3337778640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33300af2e0 con 0x7f33300c4ff0 2023-11-04T01:39:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3337778640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3330158560 con 0x7f33300adac0 2023-11-04T01:39:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3335d15640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3330159c00 0x7f3330157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3335d15640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3330159c00 0x7f3330157f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54518/0 (socket says 172.21.15.114:54518) 2023-11-04T01:39:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3335d15640 1 -- 172.21.15.114:0/1069314011 learned_addr learned my addr 172.21.15.114:0/1069314011 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3334d13640 1 --2- 172.21.15.114:0/1069314011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33300c4ff0 0x7f3330157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3335514640 1 --2- 172.21.15.114:0/1069314011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33300adac0 0x7f3330150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3335d15640 1 -- 172.21.15.114:0/1069314011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33300adac0 msgr2=0x7f3330150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3335d15640 1 --2- 172.21.15.114:0/1069314011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33300adac0 0x7f3330150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3335d15640 1 -- 172.21.15.114:0/1069314011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33300c4ff0 msgr2=0x7f3330157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3335d15640 1 --2- 172.21.15.114:0/1069314011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33300c4ff0 0x7f3330157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3335d15640 1 -- 172.21.15.114:0/1069314011 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33280094d0 con 0x7f3330159c00 2023-11-04T01:39:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3334d13640 1 --2- 172.21.15.114:0/1069314011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33300c4ff0 0x7f3330157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.213+0000 7f3335514640 1 --2- 172.21.15.114:0/1069314011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33300adac0 0x7f3330150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.214+0000 7f3335d15640 1 --2- 172.21.15.114:0/1069314011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3330159c00 0x7f3330157f70 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f332802b930 tx=0x7f33280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.214+0000 7f3325ffb640 1 -- 172.21.15.114:0/1069314011 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332803ac60 con 0x7f3330159c00 2023-11-04T01:39:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.214+0000 7f3325ffb640 1 -- 172.21.15.114:0/1069314011 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332803ade0 con 0x7f3330159c00 2023-11-04T01:39:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.214+0000 7f3337778640 1 -- 172.21.15.114:0/1069314011 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3330158840 con 0x7f3330159c00 2023-11-04T01:39:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.214+0000 7f3325ffb640 1 -- 172.21.15.114:0/1069314011 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328044630 con 0x7f3330159c00 2023-11-04T01:39:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.214+0000 7f3337778640 1 -- 172.21.15.114:0/1069314011 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3330158e00 con 0x7f3330159c00 2023-11-04T01:39:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.215+0000 7f3337778640 1 -- 172.21.15.114:0/1069314011 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3330159320 con 0x7f3330159c00 2023-11-04T01:39:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.216+0000 7f3325ffb640 1 -- 172.21.15.114:0/1069314011 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f332802f050 con 0x7f3330159c00 2023-11-04T01:39:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.216+0000 7f3325ffb640 1 --2- 172.21.15.114:0/1069314011 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f331406ae70 0x7f331406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.216+0000 7f3325ffb640 1 -- 172.21.15.114:0/1069314011 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6638+0+0 (secure 0 0 0) 0x7f33280abab0 con 0x7f3330159c00 2023-11-04T01:39:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.216+0000 7f3335514640 1 --2- 172.21.15.114:0/1069314011 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f331406ae70 0x7f331406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.216+0000 7f3335514640 1 --2- 172.21.15.114:0/1069314011 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f331406ae70 0x7f331406d330 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f332c007e90 tx=0x7f332c0073a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.220+0000 7f3325ffb640 1 -- 172.21.15.114:0/1069314011 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3330159320 con 0x7f3330159c00 2023-11-04T01:39:50.242 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:50.244 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:50.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:50.393+0000 7f3337778640 1 -- 172.21.15.114:0/1069314011 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3330159320 con 0x7f3330159c00 2023-11-04T01:39:51.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.088+0000 7f3325ffb640 1 -- 172.21.15.114:0/1069314011 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v94) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3330159320 con 0x7f3330159c00 2023-11-04T01:39:51.091 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2023-11-04T01:39:51.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.090+0000 7f3337778640 1 -- 172.21.15.114:0/1069314011 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f331406ae70 msgr2=0x7f331406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.090+0000 7f3337778640 1 --2- 172.21.15.114:0/1069314011 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f331406ae70 0x7f331406d330 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f332c007e90 tx=0x7f332c0073a0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.090+0000 7f3337778640 1 -- 172.21.15.114:0/1069314011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3330159c00 msgr2=0x7f3330157f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.090+0000 7f3337778640 1 --2- 172.21.15.114:0/1069314011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3330159c00 0x7f3330157f70 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f332802b930 tx=0x7f33280046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.090+0000 7f3337778640 1 -- 172.21.15.114:0/1069314011 shutdown_connections 2023-11-04T01:39:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.090+0000 7f3337778640 1 --2- 172.21.15.114:0/1069314011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3330159c00 0x7f3330157f70 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.090+0000 7f3337778640 1 --2- 172.21.15.114:0/1069314011 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f331406ae70 0x7f331406d330 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.090+0000 7f3337778640 1 --2- 172.21.15.114:0/1069314011 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33300c4ff0 0x7f3330157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.090+0000 7f3337778640 1 --2- 172.21.15.114:0/1069314011 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33300adac0 0x7f3330150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.090+0000 7f3337778640 1 -- 172.21.15.114:0/1069314011 >> 172.21.15.114:0/1069314011 conn(0x7f33300ce950 msgr2=0x7f333006d930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.090+0000 7f3337778640 1 -- 172.21.15.114:0/1069314011 shutdown_connections 2023-11-04T01:39:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.090+0000 7f3337778640 1 -- 172.21.15.114:0/1069314011 wait complete. 2023-11-04T01:39:51.111 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:39:51.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.214+0000 7f09cab00640 1 Processor -- start 2023-11-04T01:39:51.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.214+0000 7f09cab00640 1 -- start start 2023-11-04T01:39:51.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.214+0000 7f09cab00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f09c4153e60 0x7f09c415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.214+0000 7f09cab00640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09c40cd6d0 0x7f09c4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.214+0000 7f09cab00640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c40cde60 con 0x7f09c40b4880 2023-11-04T01:39:51.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.214+0000 7f09cab00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c4160f90 con 0x7f09c4153e60 2023-11-04T01:39:51.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.214+0000 7f09cab00640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c415e400 con 0x7f09c40cd6d0 2023-11-04T01:39:51.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.215+0000 7f09c889c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f09c4153e60 0x7f09c415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.215+0000 7f09c889c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f09c4153e60 0x7f09c415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54524/0 (socket says 172.21.15.114:54524) 2023-11-04T01:39:51.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.215+0000 7f09c889c640 1 -- 172.21.15.114:0/1307137555 learned_addr learned my addr 172.21.15.114:0/1307137555 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:51.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.215+0000 7f09c3fff640 1 --2- 172.21.15.114:0/1307137555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09c40cd6d0 0x7f09c4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.215+0000 7f09c889c640 1 -- 172.21.15.114:0/1307137555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09c40cd6d0 msgr2=0x7f09c4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:51.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.215+0000 7f09c889c640 1 --2- 172.21.15.114:0/1307137555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09c40cd6d0 0x7f09c4161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.215+0000 7f09c889c640 1 -- 172.21.15.114:0/1307137555 >> v1:172.21.15.141:6789/0 conn(0x7f09c40b4880 legacy=0x7f09c40b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.215+0000 7f09c889c640 1 -- 172.21.15.114:0/1307137555 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c4161960 con 0x7f09c4153e60 2023-11-04T01:39:51.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.216+0000 7f09c889c640 1 --2- 172.21.15.114:0/1307137555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09c4153e60 0x7f09c415dec0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f09b8009870 tx=0x7f09b802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6ec65f7d8b9744 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.216+0000 7f09c37fe640 1 -- 172.21.15.114:0/1307137555 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b8030840 con 0x7f09c4153e60 2023-11-04T01:39:51.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.216+0000 7f09c37fe640 1 -- 172.21.15.114:0/1307137555 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b80309a0 con 0x7f09c4153e60 2023-11-04T01:39:51.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.216+0000 7f09c37fe640 1 -- 172.21.15.114:0/1307137555 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b8030d30 con 0x7f09c4153e60 2023-11-04T01:39:51.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.216+0000 7f09cab00640 1 -- 172.21.15.114:0/1307137555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09c4153e60 msgr2=0x7f09c415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.216+0000 7f09cab00640 1 --2- 172.21.15.114:0/1307137555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09c4153e60 0x7f09c415dec0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f09b8009870 tx=0x7f09b802b980 comp rx=0 tx=0).stop 2023-11-04T01:39:51.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.216+0000 7f09cab00640 1 -- 172.21.15.114:0/1307137555 shutdown_connections 2023-11-04T01:39:51.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.216+0000 7f09cab00640 1 --2- 172.21.15.114:0/1307137555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09c40cd6d0 0x7f09c4161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.216+0000 7f09cab00640 1 --2- 172.21.15.114:0/1307137555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09c4153e60 0x7f09c415dec0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.216+0000 7f09cab00640 1 -- 172.21.15.114:0/1307137555 >> 172.21.15.114:0/1307137555 conn(0x7f09c40cf880 msgr2=0x7f09c40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:51.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.216+0000 7f09cab00640 1 -- 172.21.15.114:0/1307137555 shutdown_connections 2023-11-04T01:39:51.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.216+0000 7f09cab00640 1 -- 172.21.15.114:0/1307137555 wait complete. 2023-11-04T01:39:51.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.217+0000 7f09cab00640 1 Processor -- start 2023-11-04T01:39:51.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.218+0000 7f09cab00640 1 -- start start 2023-11-04T01:39:51.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.218+0000 7f09cab00640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09c40b4880 0x7f09c414d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.218+0000 7f09cab00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09c40cd6d0 0x7f09c40ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.218+0000 7f09cab00640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09c4153e60 0x7f09c41563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.218+0000 7f09cab00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c4155330 con 0x7f09c40cd6d0 2023-11-04T01:39:51.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.218+0000 7f09cab00640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c4155610 con 0x7f09c4153e60 2023-11-04T01:39:51.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.218+0000 7f09cab00640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c41558f0 con 0x7f09c40b4880 2023-11-04T01:39:51.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.218+0000 7f09c3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09c40cd6d0 0x7f09c40ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.219+0000 7f09c3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09c40cd6d0 0x7f09c40ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54526/0 (socket says 172.21.15.114:54526) 2023-11-04T01:39:51.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.219+0000 7f09c3fff640 1 -- 172.21.15.114:0/3957704444 learned_addr learned my addr 172.21.15.114:0/3957704444 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:51.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.219+0000 7f09c889c640 1 --2- 172.21.15.114:0/3957704444 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09c40b4880 0x7f09c414d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.219+0000 7f09c909d640 1 --2- 172.21.15.114:0/3957704444 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09c4153e60 0x7f09c41563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.219+0000 7f09c3fff640 1 -- 172.21.15.114:0/3957704444 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09c40b4880 msgr2=0x7f09c414d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.219+0000 7f09c3fff640 1 --2- 172.21.15.114:0/3957704444 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09c40b4880 0x7f09c414d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.219+0000 7f09c3fff640 1 -- 172.21.15.114:0/3957704444 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09c4153e60 msgr2=0x7f09c41563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.219+0000 7f09c3fff640 1 --2- 172.21.15.114:0/3957704444 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09c4153e60 0x7f09c41563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.219+0000 7f09c3fff640 1 -- 172.21.15.114:0/3957704444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b80094d0 con 0x7f09c40cd6d0 2023-11-04T01:39:51.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.219+0000 7f09c909d640 1 --2- 172.21.15.114:0/3957704444 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09c4153e60 0x7f09c41563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:51.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.219+0000 7f09c3fff640 1 --2- 172.21.15.114:0/3957704444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09c40cd6d0 0x7f09c40ca950 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f09b000d800 tx=0x7f09b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.219+0000 7f09c17fa640 1 -- 172.21.15.114:0/3957704444 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b000b6c0 con 0x7f09c40cd6d0 2023-11-04T01:39:51.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.219+0000 7f09c17fa640 1 -- 172.21.15.114:0/3957704444 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b000b820 con 0x7f09c40cd6d0 2023-11-04T01:39:51.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.219+0000 7f09cab00640 1 -- 172.21.15.114:0/3957704444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c4155bd0 con 0x7f09c40cd6d0 2023-11-04T01:39:51.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.219+0000 7f09c17fa640 1 -- 172.21.15.114:0/3957704444 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b000bbb0 con 0x7f09c40cd6d0 2023-11-04T01:39:51.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.219+0000 7f09cab00640 1 -- 172.21.15.114:0/3957704444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c415f260 con 0x7f09c40cd6d0 2023-11-04T01:39:51.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.220+0000 7f09cab00640 1 -- 172.21.15.114:0/3957704444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c4074290 con 0x7f09c40cd6d0 2023-11-04T01:39:51.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.221+0000 7f09c17fa640 1 -- 172.21.15.114:0/3957704444 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f09b000bd10 con 0x7f09c40cd6d0 2023-11-04T01:39:51.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.221+0000 7f09c17fa640 1 --2- 172.21.15.114:0/3957704444 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f09a806ae70 0x7f09a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.221+0000 7f09c17fa640 1 -- 172.21.15.114:0/3957704444 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 7020+0+0 (secure 0 0 0) 0x7f09b008a0d0 con 0x7f09c40cd6d0 2023-11-04T01:39:51.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.221+0000 7f09c889c640 1 --2- 172.21.15.114:0/3957704444 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f09a806ae70 0x7f09a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.221+0000 7f09c889c640 1 --2- 172.21.15.114:0/3957704444 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f09a806ae70 0x7f09a806d330 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f09b8036000 tx=0x7f09b803b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.225+0000 7f09c17fa640 1 -- 172.21.15.114:0/3957704444 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f09b0054c60 con 0x7f09c40cd6d0 2023-11-04T01:39:51.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:51.428+0000 7f09cab00640 1 -- 172.21.15.114:0/3957704444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f09c40d0b80 con 0x7f09c40cd6d0 2023-11-04T01:39:52.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.099+0000 7f09c17fa640 1 -- 172.21.15.114:0/3957704444 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v41) v1 ==== 174+0+0 (secure 0 0 0) 0x7f09b0058280 con 0x7f09c40cd6d0 2023-11-04T01:39:52.102 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 16 and data pool 17 2023-11-04T01:39:52.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.105+0000 7f09cab00640 1 -- 172.21.15.114:0/3957704444 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f09a806ae70 msgr2=0x7f09a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.105+0000 7f09cab00640 1 --2- 172.21.15.114:0/3957704444 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f09a806ae70 0x7f09a806d330 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f09b8036000 tx=0x7f09b803b040 comp rx=0 tx=0).stop 2023-11-04T01:39:52.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.105+0000 7f09cab00640 1 -- 172.21.15.114:0/3957704444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09c40cd6d0 msgr2=0x7f09c40ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.105+0000 7f09cab00640 1 --2- 172.21.15.114:0/3957704444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09c40cd6d0 0x7f09c40ca950 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f09b000d800 tx=0x7f09b000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.113+0000 7f09cab00640 1 -- 172.21.15.114:0/3957704444 shutdown_connections 2023-11-04T01:39:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.113+0000 7f09cab00640 1 --2- 172.21.15.114:0/3957704444 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f09a806ae70 0x7f09a806d330 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.113+0000 7f09cab00640 1 --2- 172.21.15.114:0/3957704444 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f09c4153e60 0x7f09c41563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.113+0000 7f09cab00640 1 --2- 172.21.15.114:0/3957704444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09c40cd6d0 0x7f09c40ca950 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.113+0000 7f09cab00640 1 --2- 172.21.15.114:0/3957704444 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f09c40b4880 0x7f09c414d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.113+0000 7f09cab00640 1 -- 172.21.15.114:0/3957704444 >> 172.21.15.114:0/3957704444 conn(0x7f09c40cf880 msgr2=0x7f09c40d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:52.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.116+0000 7f09cab00640 1 -- 172.21.15.114:0/3957704444 shutdown_connections 2023-11-04T01:39:52.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.119+0000 7f09cab00640 1 -- 172.21.15.114:0/3957704444 wait complete. 2023-11-04T01:39:52.138 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:52.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.238+0000 7f02c0dfb640 1 Processor -- start 2023-11-04T01:39:52.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.238+0000 7f02c0dfb640 1 -- start start 2023-11-04T01:39:52.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.239+0000 7f02c0dfb640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02bc0b0cd0 0x7f02bc070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.239+0000 7f02c0dfb640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f02bc0cde40 0x7f02bc070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.239+0000 7f02c0dfb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02bc0cc990 con 0x7f02bc0cda60 2023-11-04T01:39:52.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.239+0000 7f02c0dfb640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02bc0ccc70 con 0x7f02bc0cde40 2023-11-04T01:39:52.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.239+0000 7f02c0dfb640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0c9ce0 con 0x7f02bc0b0cd0 2023-11-04T01:39:52.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.239+0000 7f02bad9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f02bc0cde40 0x7f02bc070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.239+0000 7f02bad9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f02bc0cde40 0x7f02bc070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54540/0 (socket says 172.21.15.114:54540) 2023-11-04T01:39:52.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.239+0000 7f02bad9d640 1 -- 172.21.15.114:0/303739164 learned_addr learned my addr 172.21.15.114:0/303739164 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:52.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.239+0000 7f02bad9d640 1 -- 172.21.15.114:0/303739164 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02bc0b0cd0 msgr2=0x7f02bc070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:52.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.239+0000 7f02b9d9b640 1 --2- 172.21.15.114:0/303739164 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02bc0b0cd0 0x7f02bc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.239+0000 7f02bad9d640 1 --2- 172.21.15.114:0/303739164 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02bc0b0cd0 0x7f02bc070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.239+0000 7f02b959a640 1 -- 172.21.15.114:0/303739164 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860654182 0 0) 0x7f02bc0cc990 con 0x7f02bc0cda60 2023-11-04T01:39:52.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.239+0000 7f02bad9d640 1 -- 172.21.15.114:0/303739164 >> v1:172.21.15.114:6789/0 conn(0x7f02bc0cda60 legacy=0x7f02bc0ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.239+0000 7f02bad9d640 1 -- 172.21.15.114:0/303739164 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc0c9fc0 con 0x7f02bc0cde40 2023-11-04T01:39:52.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.240+0000 7f02bad9d640 1 --2- 172.21.15.114:0/303739164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02bc0cde40 0x7f02bc070b70 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009e50 tx=0x7f02b402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45c5339e14a898e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.240+0000 7f02b959a640 1 -- 172.21.15.114:0/303739164 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b402cb00 con 0x7f02bc0cde40 2023-11-04T01:39:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.240+0000 7f02b959a640 1 -- 172.21.15.114:0/303739164 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b402cc60 con 0x7f02bc0cde40 2023-11-04T01:39:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.240+0000 7f02b959a640 1 -- 172.21.15.114:0/303739164 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b40343f0 con 0x7f02bc0cde40 2023-11-04T01:39:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.240+0000 7f02c0dfb640 1 -- 172.21.15.114:0/303739164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02bc0cde40 msgr2=0x7f02bc070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.240+0000 7f02c0dfb640 1 --2- 172.21.15.114:0/303739164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02bc0cde40 0x7f02bc070b70 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009e50 tx=0x7f02b402bf60 comp rx=0 tx=0).stop 2023-11-04T01:39:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.241+0000 7f02c0dfb640 1 -- 172.21.15.114:0/303739164 shutdown_connections 2023-11-04T01:39:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.241+0000 7f02c0dfb640 1 --2- 172.21.15.114:0/303739164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02bc0cde40 0x7f02bc070b70 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.241+0000 7f02c0dfb640 1 --2- 172.21.15.114:0/303739164 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02bc0b0cd0 0x7f02bc070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.241+0000 7f02c0dfb640 1 -- 172.21.15.114:0/303739164 >> 172.21.15.114:0/303739164 conn(0x7f02bc0ce950 msgr2=0x7f02bc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.241+0000 7f02c0dfb640 1 -- 172.21.15.114:0/303739164 shutdown_connections 2023-11-04T01:39:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.241+0000 7f02c0dfb640 1 -- 172.21.15.114:0/303739164 wait complete. 2023-11-04T01:39:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.242+0000 7f02c0dfb640 1 Processor -- start 2023-11-04T01:39:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.242+0000 7f02c0dfb640 1 -- start start 2023-11-04T01:39:52.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02c0dfb640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02bc0b0cd0 0x7f02bc14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02c0dfb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02bc0cda60 0x7f02bc0b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02c0dfb640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02bc0cde40 0x7f02bc0b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02c0dfb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc150110 con 0x7f02bc0cda60 2023-11-04T01:39:52.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02c0dfb640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0b3750 con 0x7f02bc0cde40 2023-11-04T01:39:52.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02c0dfb640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0b39f0 con 0x7f02bc0b0cd0 2023-11-04T01:39:52.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02b9d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02bc0cda60 0x7f02bc0b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02b9d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02bc0cda60 0x7f02bc0b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54548/0 (socket says 172.21.15.114:54548) 2023-11-04T01:39:52.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02b9d9b640 1 -- 172.21.15.114:0/738386707 learned_addr learned my addr 172.21.15.114:0/738386707 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02b9d9b640 1 -- 172.21.15.114:0/738386707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02bc0b0cd0 msgr2=0x7f02bc14fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02b9d9b640 1 --2- 172.21.15.114:0/738386707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02bc0b0cd0 0x7f02bc14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02bad9d640 1 --2- 172.21.15.114:0/738386707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02bc0cde40 0x7f02bc0b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02b9d9b640 1 -- 172.21.15.114:0/738386707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02bc0cde40 msgr2=0x7f02bc0b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02b9d9b640 1 --2- 172.21.15.114:0/738386707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02bc0cde40 0x7f02bc0b1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02b9d9b640 1 -- 172.21.15.114:0/738386707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b4009b30 con 0x7f02bc0cda60 2023-11-04T01:39:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02b9d9b640 1 --2- 172.21.15.114:0/738386707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02bc0cda60 0x7f02bc0b18c0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f02b000c7f0 tx=0x7f02b000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02aaffd640 1 -- 172.21.15.114:0/738386707 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b0004220 con 0x7f02bc0cda60 2023-11-04T01:39:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02aaffd640 1 -- 172.21.15.114:0/738386707 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b00043a0 con 0x7f02bc0cda60 2023-11-04T01:39:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02aaffd640 1 -- 172.21.15.114:0/738386707 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b0007860 con 0x7f02bc0cda60 2023-11-04T01:39:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02c0dfb640 1 -- 172.21.15.114:0/738386707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02bc0b3cd0 con 0x7f02bc0cda60 2023-11-04T01:39:52.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.243+0000 7f02c0dfb640 1 -- 172.21.15.114:0/738386707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02bc0b4290 con 0x7f02bc0cda60 2023-11-04T01:39:52.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.245+0000 7f02c0dfb640 1 -- 172.21.15.114:0/738386707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02bc0cc470 con 0x7f02bc0cda60 2023-11-04T01:39:52.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.245+0000 7f02aaffd640 1 -- 172.21.15.114:0/738386707 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f02b00079c0 con 0x7f02bc0cda60 2023-11-04T01:39:52.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.245+0000 7f02aaffd640 1 --2- 172.21.15.114:0/738386707 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f029c06ae70 0x7f029c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.245+0000 7f02aaffd640 1 -- 172.21.15.114:0/738386707 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f02b00899c0 con 0x7f02bc0cda60 2023-11-04T01:39:52.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.245+0000 7f02ba59c640 1 --2- 172.21.15.114:0/738386707 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f029c06ae70 0x7f029c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.246+0000 7f02ba59c640 1 --2- 172.21.15.114:0/738386707 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f029c06ae70 0x7f029c06d330 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f02ac001600 tx=0x7f02ac007910 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:52.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.250+0000 7f02aaffd640 1 -- 172.21.15.114:0/738386707 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02bc0cc470 con 0x7f02bc0cda60 2023-11-04T01:39:52.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.417+0000 7f02c0dfb640 1 -- 172.21.15.114:0/738386707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02bc0cc470 con 0x7f02bc0cda60 2023-11-04T01:39:52.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.419+0000 7f02aaffd640 1 -- 172.21.15.114:0/738386707 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+22078 (secure 0 0 0) 0x7f02bc0cc470 con 0x7f02bc0cda60 2023-11-04T01:39:52.421 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:52.421 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":95,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:51.430029+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:50.031565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:50.411946+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:52.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.421+0000 7f02c0dfb640 1 -- 172.21.15.114:0/738386707 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f029c06ae70 msgr2=0x7f029c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.421+0000 7f02c0dfb640 1 --2- 172.21.15.114:0/738386707 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f029c06ae70 0x7f029c06d330 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f02ac001600 tx=0x7f02ac007910 comp rx=0 tx=0).stop 2023-11-04T01:39:52.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.421+0000 7f02c0dfb640 1 -- 172.21.15.114:0/738386707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02bc0cda60 msgr2=0x7f02bc0b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.421+0000 7f02c0dfb640 1 --2- 172.21.15.114:0/738386707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02bc0cda60 0x7f02bc0b18c0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f02b000c7f0 tx=0x7f02b000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.421+0000 7f02c0dfb640 1 -- 172.21.15.114:0/738386707 shutdown_connections 2023-11-04T01:39:52.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.421+0000 7f02c0dfb640 1 --2- 172.21.15.114:0/738386707 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f029c06ae70 0x7f029c06d330 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.421+0000 7f02c0dfb640 1 --2- 172.21.15.114:0/738386707 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f02bc0cde40 0x7f02bc0b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.421+0000 7f02c0dfb640 1 --2- 172.21.15.114:0/738386707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02bc0cda60 0x7f02bc0b18c0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.421+0000 7f02c0dfb640 1 --2- 172.21.15.114:0/738386707 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f02bc0b0cd0 0x7f02bc14fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.421+0000 7f02c0dfb640 1 -- 172.21.15.114:0/738386707 >> 172.21.15.114:0/738386707 conn(0x7f02bc0ce950 msgr2=0x7f02bc072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:52.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.421+0000 7f02c0dfb640 1 -- 172.21.15.114:0/738386707 shutdown_connections 2023-11-04T01:39:52.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.421+0000 7f02c0dfb640 1 -- 172.21.15.114:0/738386707 wait complete. 2023-11-04T01:39:52.434 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:52.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.531+0000 7fe8e693c640 1 Processor -- start 2023-11-04T01:39:52.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.531+0000 7fe8e693c640 1 -- start start 2023-11-04T01:39:52.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.532+0000 7fe8e693c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe8e0159c70 0x7fe8e00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.532+0000 7fe8e693c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe8e006db20 0x7fe8e00b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.532+0000 7fe8e693c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e00b4110 con 0x7fe8e00b0910 2023-11-04T01:39:52.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.532+0000 7fe8e693c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e00b49b0 con 0x7fe8e006db20 2023-11-04T01:39:52.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.532+0000 7fe8e693c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e00b0da0 con 0x7fe8e0159c70 2023-11-04T01:39:52.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.532+0000 7fe8df7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe8e006db20 0x7fe8e00b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.532+0000 7fe8df7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe8e006db20 0x7fe8e00b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54550/0 (socket says 172.21.15.114:54550) 2023-11-04T01:39:52.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.532+0000 7fe8df7fe640 1 -- 172.21.15.114:0/1220217543 learned_addr learned my addr 172.21.15.114:0/1220217543 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:52.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.532+0000 7fe8dffff640 1 --2- 172.21.15.114:0/1220217543 >> v2:172.21.15.141:3300/0 conn(0x7fe8e0159c70 0x7fe8e00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.532+0000 7fe8df7fe640 1 -- 172.21.15.114:0/1220217543 >> v2:172.21.15.141:3300/0 conn(0x7fe8e0159c70 msgr2=0x7fe8e00ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:52.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.532+0000 7fe8df7fe640 1 --2- 172.21.15.114:0/1220217543 >> v2:172.21.15.141:3300/0 conn(0x7fe8e0159c70 0x7fe8e00ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.532+0000 7fe8df7fe640 1 -- 172.21.15.114:0/1220217543 >> v1:172.21.15.141:6789/0 conn(0x7fe8e00b0910 legacy=0x7fe8e015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.532+0000 7fe8df7fe640 1 -- 172.21.15.114:0/1220217543 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e00b43f0 con 0x7fe8e006db20 2023-11-04T01:39:52.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.533+0000 7fe8df7fe640 1 --2- 172.21.15.114:0/1220217543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8e006db20 0x7fe8e00b03d0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00cc440 tx=0x7fe8d402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e009e94dd543d0d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:52.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.533+0000 7fe8deffd640 1 -- 172.21.15.114:0/1220217543 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4030860 con 0x7fe8e006db20 2023-11-04T01:39:52.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.533+0000 7fe8deffd640 1 -- 172.21.15.114:0/1220217543 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d40309c0 con 0x7fe8e006db20 2023-11-04T01:39:52.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.533+0000 7fe8deffd640 1 -- 172.21.15.114:0/1220217543 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4030d50 con 0x7fe8e006db20 2023-11-04T01:39:52.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.533+0000 7fe8e693c640 1 -- 172.21.15.114:0/1220217543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8e006db20 msgr2=0x7fe8e00b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.533+0000 7fe8e693c640 1 --2- 172.21.15.114:0/1220217543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8e006db20 0x7fe8e00b03d0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00cc440 tx=0x7fe8d402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.533+0000 7fe8e693c640 1 -- 172.21.15.114:0/1220217543 shutdown_connections 2023-11-04T01:39:52.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.533+0000 7fe8e693c640 1 --2- 172.21.15.114:0/1220217543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8e006db20 0x7fe8e00b03d0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.533+0000 7fe8e693c640 1 --2- 172.21.15.114:0/1220217543 >> v2:172.21.15.141:3300/0 conn(0x7fe8e0159c70 0x7fe8e00ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.534+0000 7fe8e693c640 1 -- 172.21.15.114:0/1220217543 >> 172.21.15.114:0/1220217543 conn(0x7fe8e00ce950 msgr2=0x7fe8e00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.534+0000 7fe8e693c640 1 -- 172.21.15.114:0/1220217543 shutdown_connections 2023-11-04T01:39:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.534+0000 7fe8e693c640 1 -- 172.21.15.114:0/1220217543 wait complete. 2023-11-04T01:39:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.535+0000 7fe8e693c640 1 Processor -- start 2023-11-04T01:39:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.535+0000 7fe8e693c640 1 -- start start 2023-11-04T01:39:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8e693c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8e006db20 0x7fe8e0152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8e693c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe8e00b0910 0x7fe8e0146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8e693c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe8e0159c70 0x7fe8e0146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8e693c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00c67c0 con 0x7fe8e006db20 2023-11-04T01:39:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8e693c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e014e230 con 0x7fe8e0159c70 2023-11-04T01:39:52.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8e693c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e01472c0 con 0x7fe8e00b0910 2023-11-04T01:39:52.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8dffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8e006db20 0x7fe8e0152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8dffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8e006db20 0x7fe8e0152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54560/0 (socket says 172.21.15.114:54560) 2023-11-04T01:39:52.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8dffff640 1 -- 172.21.15.114:0/2077118094 learned_addr learned my addr 172.21.15.114:0/2077118094 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:52.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8e4ed9640 1 --2- 172.21.15.114:0/2077118094 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe8e0159c70 0x7fe8e0146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8df7fe640 1 --2- 172.21.15.114:0/2077118094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe8e00b0910 0x7fe8e0146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8dffff640 1 -- 172.21.15.114:0/2077118094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe8e00b0910 msgr2=0x7fe8e0146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8dffff640 1 --2- 172.21.15.114:0/2077118094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe8e00b0910 0x7fe8e0146840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8dffff640 1 -- 172.21.15.114:0/2077118094 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe8e0159c70 msgr2=0x7fe8e0146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8dffff640 1 --2- 172.21.15.114:0/2077118094 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe8e0159c70 0x7fe8e0146d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8dffff640 1 -- 172.21.15.114:0/2077118094 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d40094d0 con 0x7fe8e006db20 2023-11-04T01:39:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8dffff640 1 --2- 172.21.15.114:0/2077118094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8e006db20 0x7fe8e0152070 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000d830 tx=0x7fe8d000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8dcff9640 1 -- 172.21.15.114:0/2077118094 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d000b6c0 con 0x7fe8e006db20 2023-11-04T01:39:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8dcff9640 1 -- 172.21.15.114:0/2077118094 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d000b820 con 0x7fe8e006db20 2023-11-04T01:39:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8e693c640 1 -- 172.21.15.114:0/2077118094 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e014e440 con 0x7fe8e006db20 2023-11-04T01:39:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8dcff9640 1 -- 172.21.15.114:0/2077118094 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d000bbb0 con 0x7fe8e006db20 2023-11-04T01:39:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.536+0000 7fe8e693c640 1 -- 172.21.15.114:0/2077118094 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e014ea00 con 0x7fe8e006db20 2023-11-04T01:39:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.537+0000 7fe8e693c640 1 -- 172.21.15.114:0/2077118094 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e0074290 con 0x7fe8e006db20 2023-11-04T01:39:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.538+0000 7fe8dcff9640 1 -- 172.21.15.114:0/2077118094 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe8d001e460 con 0x7fe8e006db20 2023-11-04T01:39:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.538+0000 7fe8dcff9640 1 --2- 172.21.15.114:0/2077118094 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe8cc06ae70 0x7fe8cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.538+0000 7fe8dcff9640 1 -- 172.21.15.114:0/2077118094 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fe8d008a280 con 0x7fe8e006db20 2023-11-04T01:39:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.538+0000 7fe8df7fe640 1 --2- 172.21.15.114:0/2077118094 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe8cc06ae70 0x7fe8cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.538+0000 7fe8df7fe640 1 --2- 172.21.15.114:0/2077118094 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe8cc06ae70 0x7fe8cc06d330 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4036000 tx=0x7fe8d403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:52.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.542+0000 7fe8dcff9640 1 -- 172.21.15.114:0/2077118094 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe8d0054e40 con 0x7fe8e006db20 2023-11-04T01:39:52.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.713+0000 7fe8e693c640 1 -- 172.21.15.114:0/2077118094 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8e006d3f0 con 0x7fe8e006db20 2023-11-04T01:39:52.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.715+0000 7fe8dcff9640 1 -- 172.21.15.114:0/2077118094 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+22078 (secure 0 0 0) 0x7fe8d0058460 con 0x7fe8e006db20 2023-11-04T01:39:52.717 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:52.718 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":95,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:51.430029+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:50.031565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:50.411946+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:52.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.717+0000 7fe8e693c640 1 -- 172.21.15.114:0/2077118094 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe8cc06ae70 msgr2=0x7fe8cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.717+0000 7fe8e693c640 1 --2- 172.21.15.114:0/2077118094 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe8cc06ae70 0x7fe8cc06d330 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4036000 tx=0x7fe8d403b040 comp rx=0 tx=0).stop 2023-11-04T01:39:52.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.717+0000 7fe8e693c640 1 -- 172.21.15.114:0/2077118094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8e006db20 msgr2=0x7fe8e0152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.717+0000 7fe8e693c640 1 --2- 172.21.15.114:0/2077118094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8e006db20 0x7fe8e0152070 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000d830 tx=0x7fe8d000dcf0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.717+0000 7fe8e693c640 1 -- 172.21.15.114:0/2077118094 shutdown_connections 2023-11-04T01:39:52.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.717+0000 7fe8e693c640 1 --2- 172.21.15.114:0/2077118094 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe8cc06ae70 0x7fe8cc06d330 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.717+0000 7fe8e693c640 1 --2- 172.21.15.114:0/2077118094 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe8e0159c70 0x7fe8e0146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.717+0000 7fe8e693c640 1 --2- 172.21.15.114:0/2077118094 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe8e00b0910 0x7fe8e0146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.717+0000 7fe8e693c640 1 --2- 172.21.15.114:0/2077118094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8e006db20 0x7fe8e0152070 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.717+0000 7fe8e693c640 1 -- 172.21.15.114:0/2077118094 >> 172.21.15.114:0/2077118094 conn(0x7fe8e00ce950 msgr2=0x7fe8e00cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:52.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.717+0000 7fe8e693c640 1 -- 172.21.15.114:0/2077118094 shutdown_connections 2023-11-04T01:39:52.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.717+0000 7fe8e693c640 1 -- 172.21.15.114:0/2077118094 wait complete. 2023-11-04T01:39:52.730 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:39:52.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.832+0000 7f6398b33640 1 Processor -- start 2023-11-04T01:39:52.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.832+0000 7f6398b33640 1 -- start start 2023-11-04T01:39:52.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.832+0000 7f6398b33640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6394153850 0x7f639415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.832+0000 7f6398b33640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63940cc9d0 0x7f63940c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.832+0000 7f6398b33640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63940c3860 con 0x7f63940cc520 2023-11-04T01:39:52.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.832+0000 7f6398b33640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63940c9250 con 0x7f6394153850 2023-11-04T01:39:52.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.832+0000 7f6398b33640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6394153c30 con 0x7f63940cc9d0 2023-11-04T01:39:52.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f638bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f63940cc520 0x7f6394070fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58088/0 (socket says 172.21.15.114:58088) 2023-11-04T01:39:52.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f638bfff640 1 -- 172.21.15.114:0/2399777516 learned_addr learned my addr 172.21.15.114:0/2399777516 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:52.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6391d9b640 1 -- 172.21.15.114:0/2399777516 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293198909 0 0) 0x7f63940c3860 con 0x7f63940cc520 2023-11-04T01:39:52.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f639259c640 1 --2- 172.21.15.114:0/2399777516 >> v2:172.21.15.141:3300/0 conn(0x7f6394153850 0x7f639415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6392d9d640 1 --2- 172.21.15.114:0/2399777516 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63940cc9d0 0x7f63940c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6391d9b640 1 -- 172.21.15.114:0/2399777516 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6380004630 con 0x7f63940cc520 2023-11-04T01:39:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6391d9b640 1 -- 172.21.15.114:0/2399777516 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 914404957 0 0) 0x7f6380004630 con 0x7f63940cc520 2023-11-04T01:39:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6391d9b640 1 -- 172.21.15.114:0/2399777516 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63940cc9d0 msgr2=0x7f63940c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6391d9b640 1 --2- 172.21.15.114:0/2399777516 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63940cc9d0 0x7f63940c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6391d9b640 1 -- 172.21.15.114:0/2399777516 >> v2:172.21.15.141:3300/0 conn(0x7f6394153850 msgr2=0x7f639415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6391d9b640 1 --2- 172.21.15.114:0/2399777516 >> v2:172.21.15.141:3300/0 conn(0x7f6394153850 0x7f639415a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6391d9b640 1 -- 172.21.15.114:0/2399777516 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639415a700 con 0x7f63940cc520 2023-11-04T01:39:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6391d9b640 1 -- 172.21.15.114:0/2399777516 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f637c001670 con 0x7f63940cc520 2023-11-04T01:39:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6391d9b640 1 -- 172.21.15.114:0/2399777516 >> v1:172.21.15.114:6789/0 conn(0x7f63940cc520 legacy=0x7f6394070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6391d9b640 1 --2- 172.21.15.114:0/2399777516 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6380004a80 0x7f6380004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6391d9b640 1 --2- 172.21.15.114:0/2399777516 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63940cc9d0 0x7f63800058d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6391d9b640 1 --2- 172.21.15.114:0/2399777516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6380005e10 0x7f6380006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6391d9b640 1 -- 172.21.15.114:0/2399777516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63940c9250 con 0x7f6380005e10 2023-11-04T01:39:52.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6391d9b640 1 -- 172.21.15.114:0/2399777516 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6394153c30 con 0x7f6380004a80 2023-11-04T01:39:52.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6391d9b640 1 -- 172.21.15.114:0/2399777516 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6380003440 con 0x7f63940cc9d0 2023-11-04T01:39:52.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f6392d9d640 1 --2- 172.21.15.114:0/2399777516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6380005e10 0x7f6380006290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f639259c640 1 --2- 172.21.15.114:0/2399777516 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6380004a80 0x7f6380004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.833+0000 7f638bfff640 1 --2- 172.21.15.114:0/2399777516 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63940cc9d0 0x7f63800058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.834+0000 7f6392d9d640 1 -- 172.21.15.114:0/2399777516 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63940cc9d0 msgr2=0x7f63800058d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:52.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.834+0000 7f6392d9d640 1 --2- 172.21.15.114:0/2399777516 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f63940cc9d0 0x7f63800058d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.834+0000 7f6392d9d640 1 -- 172.21.15.114:0/2399777516 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6380004a80 msgr2=0x7f6380004ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:52.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.834+0000 7f6392d9d640 1 --2- 172.21.15.114:0/2399777516 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6380004a80 0x7f6380004ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.834+0000 7f6392d9d640 1 -- 172.21.15.114:0/2399777516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6380004630 con 0x7f6380005e10 2023-11-04T01:39:52.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.834+0000 7f6392d9d640 1 --2- 172.21.15.114:0/2399777516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6380005e10 0x7f6380006290 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f638c009f90 tx=0x7f6380006900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5407f58c5d2d65f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:52.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.834+0000 7f6391d9b640 1 -- 172.21.15.114:0/2399777516 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c02cbd0 con 0x7f6380005e10 2023-11-04T01:39:52.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.834+0000 7f6391d9b640 1 -- 172.21.15.114:0/2399777516 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638c00f040 con 0x7f6380005e10 2023-11-04T01:39:52.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.835+0000 7f6391d9b640 1 -- 172.21.15.114:0/2399777516 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c034440 con 0x7f6380005e10 2023-11-04T01:39:52.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.835+0000 7f6398b33640 1 -- 172.21.15.114:0/2399777516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6380005e10 msgr2=0x7f6380006290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.835+0000 7f6398b33640 1 --2- 172.21.15.114:0/2399777516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6380005e10 0x7f6380006290 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f638c009f90 tx=0x7f6380006900 comp rx=0 tx=0).stop 2023-11-04T01:39:52.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.835+0000 7f6392d9d640 1 -- 172.21.15.114:0/2399777516 reap_dead start 2023-11-04T01:39:52.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.835+0000 7f6398b33640 1 -- 172.21.15.114:0/2399777516 shutdown_connections 2023-11-04T01:39:52.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.835+0000 7f6398b33640 1 -- 172.21.15.114:0/2399777516 >> 172.21.15.114:0/2399777516 conn(0x7f63940ce950 msgr2=0x7f63940ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:52.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.835+0000 7f6398b33640 1 -- 172.21.15.114:0/2399777516 shutdown_connections 2023-11-04T01:39:52.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.835+0000 7f6398b33640 1 -- 172.21.15.114:0/2399777516 wait complete. 2023-11-04T01:39:52.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.836+0000 7f6398b33640 1 Processor -- start 2023-11-04T01:39:52.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.836+0000 7f6398b33640 1 -- start start 2023-11-04T01:39:52.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.837+0000 7f6398b33640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f639413b4d0 0x7f639413ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.837+0000 7f6398b33640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f639413b8b0 0x7f639413be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.837+0000 7f6398b33640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63941f1e90 0x7f639415a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.837+0000 7f6398b33640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63940b3030 con 0x7f639413b8b0 2023-11-04T01:39:52.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.837+0000 7f6398b33640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639413c360 con 0x7f63941f1e90 2023-11-04T01:39:52.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.837+0000 7f6398b33640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63941f26a0 con 0x7f639413b4d0 2023-11-04T01:39:52.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.837+0000 7f638bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f639413b8b0 0x7f639413be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.837+0000 7f638bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f639413b8b0 0x7f639413be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54568/0 (socket says 172.21.15.114:54568) 2023-11-04T01:39:52.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.837+0000 7f638bfff640 1 -- 172.21.15.114:0/873068708 learned_addr learned my addr 172.21.15.114:0/873068708 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:52.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.837+0000 7f638bfff640 1 -- 172.21.15.114:0/873068708 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f639413b4d0 msgr2=0x7f639413ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.837+0000 7f639259c640 1 --2- 172.21.15.114:0/873068708 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f639413b4d0 0x7f639413ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.837+0000 7f6392d9d640 1 --2- 172.21.15.114:0/873068708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63941f1e90 0x7f639415a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.837+0000 7f638bfff640 1 --2- 172.21.15.114:0/873068708 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f639413b4d0 0x7f639413ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.837+0000 7f638bfff640 1 -- 172.21.15.114:0/873068708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63941f1e90 msgr2=0x7f639415a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.837+0000 7f638bfff640 1 --2- 172.21.15.114:0/873068708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63941f1e90 0x7f639415a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.837+0000 7f638bfff640 1 -- 172.21.15.114:0/873068708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63941f2980 con 0x7f639413b8b0 2023-11-04T01:39:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.838+0000 7f638bfff640 1 --2- 172.21.15.114:0/873068708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f639413b8b0 0x7f639413be20 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f637c007290 tx=0x7f637c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.838+0000 7f638affd640 1 -- 172.21.15.114:0/873068708 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c00f960 con 0x7f639413b8b0 2023-11-04T01:39:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.838+0000 7f638affd640 1 -- 172.21.15.114:0/873068708 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c00fac0 con 0x7f639413b8b0 2023-11-04T01:39:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.838+0000 7f6398b33640 1 -- 172.21.15.114:0/873068708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63941f2c60 con 0x7f639413b8b0 2023-11-04T01:39:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.838+0000 7f638affd640 1 -- 172.21.15.114:0/873068708 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c00fe70 con 0x7f639413b8b0 2023-11-04T01:39:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.838+0000 7f6398b33640 1 -- 172.21.15.114:0/873068708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63941f2310 con 0x7f639413b8b0 2023-11-04T01:39:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.839+0000 7f6398b33640 1 -- 172.21.15.114:0/873068708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6394074290 con 0x7f639413b8b0 2023-11-04T01:39:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.839+0000 7f638affd640 1 -- 172.21.15.114:0/873068708 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f637c01d460 con 0x7f639413b8b0 2023-11-04T01:39:52.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.840+0000 7f638affd640 1 --2- 172.21.15.114:0/873068708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f637406ae70 0x7f637406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:52.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.840+0000 7f639259c640 1 --2- 172.21.15.114:0/873068708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f637406ae70 0x7f637406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:52.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.840+0000 7f638affd640 1 -- 172.21.15.114:0/873068708 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f637c089d40 con 0x7f639413b8b0 2023-11-04T01:39:52.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.840+0000 7f639259c640 1 --2- 172.21.15.114:0/873068708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f637406ae70 0x7f637406d330 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6384009a60 tx=0x7f6384008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:52.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:52.844+0000 7f638affd640 1 -- 172.21.15.114:0/873068708 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f637c054870 con 0x7f639413b8b0 2023-11-04T01:39:53.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.046+0000 7f6398b33640 1 -- 172.21.15.114:0/873068708 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f63940cefe0 con 0x7f639413b8b0 2023-11-04T01:39:53.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.100+0000 7f638affd640 1 -- 172.21.15.114:0/873068708 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v42) v1 ==== 118+0+0 (secure 0 0 0) 0x7f637c057e90 con 0x7f639413b8b0 2023-11-04T01:39:53.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.102+0000 7f6398b33640 1 -- 172.21.15.114:0/873068708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f637406ae70 msgr2=0x7f637406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.102+0000 7f6398b33640 1 --2- 172.21.15.114:0/873068708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f637406ae70 0x7f637406d330 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6384009a60 tx=0x7f6384008040 comp rx=0 tx=0).stop 2023-11-04T01:39:53.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.102+0000 7f6398b33640 1 -- 172.21.15.114:0/873068708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f639413b8b0 msgr2=0x7f639413be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.102+0000 7f6398b33640 1 --2- 172.21.15.114:0/873068708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f639413b8b0 0x7f639413be20 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f637c007290 tx=0x7f637c007750 comp rx=0 tx=0).stop 2023-11-04T01:39:53.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.102+0000 7f6398b33640 1 -- 172.21.15.114:0/873068708 shutdown_connections 2023-11-04T01:39:53.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.102+0000 7f6398b33640 1 --2- 172.21.15.114:0/873068708 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f637406ae70 0x7f637406d330 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.102+0000 7f6398b33640 1 --2- 172.21.15.114:0/873068708 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f63941f1e90 0x7f639415a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.102+0000 7f6398b33640 1 --2- 172.21.15.114:0/873068708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f639413b8b0 0x7f639413be20 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.102+0000 7f6398b33640 1 --2- 172.21.15.114:0/873068708 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f639413b4d0 0x7f639413ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.102+0000 7f6398b33640 1 -- 172.21.15.114:0/873068708 >> 172.21.15.114:0/873068708 conn(0x7f63940ce950 msgr2=0x7f63940cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:53.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.102+0000 7f6398b33640 1 -- 172.21.15.114:0/873068708 shutdown_connections 2023-11-04T01:39:53.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.102+0000 7f6398b33640 1 -- 172.21.15.114:0/873068708 wait complete. 2023-11-04T01:39:53.115 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:39:53.115 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:39:53.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.215+0000 7f352c183640 1 Processor -- start 2023-11-04T01:39:53.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.215+0000 7f352c183640 1 -- start start 2023-11-04T01:39:53.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f352c183640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3524153850 0x7f352415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f352c183640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f35240cc520 0x7f3524070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f352c183640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35240c3860 con 0x7f35240cc9a0 2023-11-04T01:39:53.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f352c183640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35240c9250 con 0x7f35240cc520 2023-11-04T01:39:53.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f352c183640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3524153c30 con 0x7f3524153850 2023-11-04T01:39:53.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f352a720640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f35240cc9a0 0x7f35240c3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58092/0 (socket says 172.21.15.114:58092) 2023-11-04T01:39:53.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f352a720640 1 -- 172.21.15.114:0/2859407337 learned_addr learned my addr 172.21.15.114:0/2859407337 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:53.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3528f1d640 1 -- 172.21.15.114:0/2859407337 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794747123 0 0) 0x7f35240c3860 con 0x7f35240cc9a0 2023-11-04T01:39:53.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f352971e640 1 --2- 172.21.15.114:0/2859407337 >> v2:172.21.15.141:3300/0 conn(0x7f35240cc520 0x7f3524070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3528f1d640 1 -- 172.21.15.114:0/2859407337 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3510003520 con 0x7f35240cc9a0 2023-11-04T01:39:53.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3529f1f640 1 --2- 172.21.15.114:0/2859407337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3524153850 0x7f352415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3528f1d640 1 -- 172.21.15.114:0/2859407337 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1646110111 0 0) 0x7f3510003520 con 0x7f35240cc9a0 2023-11-04T01:39:53.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3528f1d640 1 -- 172.21.15.114:0/2859407337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3524153850 msgr2=0x7f352415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:53.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3528f1d640 1 --2- 172.21.15.114:0/2859407337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3524153850 0x7f352415a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3528f1d640 1 -- 172.21.15.114:0/2859407337 >> v2:172.21.15.141:3300/0 conn(0x7f35240cc520 msgr2=0x7f3524070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:53.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3528f1d640 1 --2- 172.21.15.114:0/2859407337 >> v2:172.21.15.141:3300/0 conn(0x7f35240cc520 0x7f3524070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3528f1d640 1 -- 172.21.15.114:0/2859407337 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352415a700 con 0x7f35240cc9a0 2023-11-04T01:39:53.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3528f1d640 1 -- 172.21.15.114:0/2859407337 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f351c001670 con 0x7f35240cc9a0 2023-11-04T01:39:53.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3528f1d640 1 -- 172.21.15.114:0/2859407337 >> v1:172.21.15.114:6789/0 conn(0x7f35240cc9a0 legacy=0x7f35240c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3528f1d640 1 --2- 172.21.15.114:0/2859407337 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3510003970 0x7f3510003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3528f1d640 1 --2- 172.21.15.114:0/2859407337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35100047c0 0x7f3510004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3528f1d640 1 --2- 172.21.15.114:0/2859407337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3524153850 0x7f3510005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3528f1d640 1 -- 172.21.15.114:0/2859407337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35240c9250 con 0x7f35100047c0 2023-11-04T01:39:53.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3528f1d640 1 -- 172.21.15.114:0/2859407337 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524153c30 con 0x7f3510003970 2023-11-04T01:39:53.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.216+0000 7f3528f1d640 1 -- 172.21.15.114:0/2859407337 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351000b980 con 0x7f3524153850 2023-11-04T01:39:53.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.217+0000 7f352971e640 1 --2- 172.21.15.114:0/2859407337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35100047c0 0x7f3510004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.217+0000 7f3529f1f640 1 --2- 172.21.15.114:0/2859407337 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3510003970 0x7f3510003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.217+0000 7f352a720640 1 --2- 172.21.15.114:0/2859407337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3524153850 0x7f3510005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.217+0000 7f352971e640 1 -- 172.21.15.114:0/2859407337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3524153850 msgr2=0x7f3510005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:53.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.217+0000 7f352971e640 1 --2- 172.21.15.114:0/2859407337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3524153850 0x7f3510005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.217+0000 7f352971e640 1 -- 172.21.15.114:0/2859407337 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3510003970 msgr2=0x7f3510003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:53.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.217+0000 7f352971e640 1 --2- 172.21.15.114:0/2859407337 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3510003970 0x7f3510003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.217+0000 7f352971e640 1 -- 172.21.15.114:0/2859407337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3510003520 con 0x7f35100047c0 2023-11-04T01:39:53.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.217+0000 7f352a720640 1 --2- 172.21.15.114:0/2859407337 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3524153850 0x7f3510005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:53.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.218+0000 7f352971e640 1 --2- 172.21.15.114:0/2859407337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35100047c0 0x7f3510004c40 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f3514009ac0 tx=0x7f35100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e1b23a9d73c73b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:53.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.218+0000 7f3528f1d640 1 -- 172.21.15.114:0/2859407337 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351402c710 con 0x7f35100047c0 2023-11-04T01:39:53.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.218+0000 7f3528f1d640 1 -- 172.21.15.114:0/2859407337 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351402c870 con 0x7f35100047c0 2023-11-04T01:39:53.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.218+0000 7f3528f1d640 1 -- 172.21.15.114:0/2859407337 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351402cc00 con 0x7f35100047c0 2023-11-04T01:39:53.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.218+0000 7f352c183640 1 -- 172.21.15.114:0/2859407337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35100047c0 msgr2=0x7f3510004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.218+0000 7f352c183640 1 --2- 172.21.15.114:0/2859407337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35100047c0 0x7f3510004c40 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f3514009ac0 tx=0x7f35100057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.218+0000 7f352a720640 1 -- 172.21.15.114:0/2859407337 reap_dead start 2023-11-04T01:39:53.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.218+0000 7f352c183640 1 -- 172.21.15.114:0/2859407337 shutdown_connections 2023-11-04T01:39:53.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.218+0000 7f352c183640 1 -- 172.21.15.114:0/2859407337 >> 172.21.15.114:0/2859407337 conn(0x7f35240ce950 msgr2=0x7f35240ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:53.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.218+0000 7f352c183640 1 -- 172.21.15.114:0/2859407337 shutdown_connections 2023-11-04T01:39:53.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.218+0000 7f352c183640 1 -- 172.21.15.114:0/2859407337 wait complete. 2023-11-04T01:39:53.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.219+0000 7f352c183640 1 Processor -- start 2023-11-04T01:39:53.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.219+0000 7f352c183640 1 -- start start 2023-11-04T01:39:53.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.220+0000 7f352c183640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35100047c0 0x7f35240c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.220+0000 7f352c183640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35240c6050 0x7f35240c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.220+0000 7f352c183640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f352415a8f0 0x7f352415ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.220+0000 7f352c183640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35240c6a10 con 0x7f35240c6050 2023-11-04T01:39:53.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.220+0000 7f352c183640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352415b2b0 con 0x7f35100047c0 2023-11-04T01:39:53.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.220+0000 7f352c183640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35240c7f00 con 0x7f352415a8f0 2023-11-04T01:39:53.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.220+0000 7f352971e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35240c6050 0x7f35240c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.220+0000 7f352971e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35240c6050 0x7f35240c64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54588/0 (socket says 172.21.15.114:54588) 2023-11-04T01:39:53.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.220+0000 7f352971e640 1 -- 172.21.15.114:0/3922694837 learned_addr learned my addr 172.21.15.114:0/3922694837 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:53.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.220+0000 7f352971e640 1 -- 172.21.15.114:0/3922694837 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f352415a8f0 msgr2=0x7f352415ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.220+0000 7f352971e640 1 --2- 172.21.15.114:0/3922694837 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f352415a8f0 0x7f352415ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.220+0000 7f352971e640 1 -- 172.21.15.114:0/3922694837 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35100047c0 msgr2=0x7f35240c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:53.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.220+0000 7f352971e640 1 --2- 172.21.15.114:0/3922694837 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35100047c0 0x7f35240c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:53.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.220+0000 7f352971e640 1 -- 172.21.15.114:0/3922694837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3524154650 con 0x7f35240c6050 2023-11-04T01:39:53.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.221+0000 7f352971e640 1 --2- 172.21.15.114:0/3922694837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35240c6050 0x7f35240c64d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f351402c2b0 tx=0x7f3514004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:53.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.221+0000 7f351a7fc640 1 -- 172.21.15.114:0/3922694837 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514003810 con 0x7f35240c6050 2023-11-04T01:39:53.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.221+0000 7f351a7fc640 1 -- 172.21.15.114:0/3922694837 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351402de90 con 0x7f35240c6050 2023-11-04T01:39:53.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.221+0000 7f351a7fc640 1 -- 172.21.15.114:0/3922694837 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514003bb0 con 0x7f35240c6050 2023-11-04T01:39:53.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.221+0000 7f352c183640 1 -- 172.21.15.114:0/3922694837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35240c7660 con 0x7f35240c6050 2023-11-04T01:39:53.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.221+0000 7f352c183640 1 -- 172.21.15.114:0/3922694837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35240c7c20 con 0x7f35240c6050 2023-11-04T01:39:53.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.222+0000 7f352c183640 1 -- 172.21.15.114:0/3922694837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3524074290 con 0x7f35240c6050 2023-11-04T01:39:53.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.222+0000 7f351a7fc640 1 -- 172.21.15.114:0/3922694837 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3514003d10 con 0x7f35240c6050 2023-11-04T01:39:53.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.223+0000 7f351a7fc640 1 --2- 172.21.15.114:0/3922694837 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f350806ae70 0x7f350806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:53.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.223+0000 7f351a7fc640 1 -- 172.21.15.114:0/3922694837 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f35140abb70 con 0x7f35240c6050 2023-11-04T01:39:53.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.223+0000 7f3529f1f640 1 --2- 172.21.15.114:0/3922694837 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f350806ae70 0x7f350806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:53.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.223+0000 7f3529f1f640 1 --2- 172.21.15.114:0/3922694837 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f350806ae70 0x7f350806d330 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f35240c8a00 tx=0x7f3520009750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:53.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.227+0000 7f351a7fc640 1 -- 172.21.15.114:0/3922694837 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f35140766a0 con 0x7f35240c6050 2023-11-04T01:39:53.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:53.428+0000 7f352c183640 1 -- 172.21.15.114:0/3922694837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3524166010 con 0x7f35240c6050 2023-11-04T01:39:54.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.108+0000 7f351a7fc640 1 -- 172.21.15.114:0/3922694837 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v43) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3514079cc0 con 0x7f35240c6050 2023-11-04T01:39:54.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.110+0000 7f352c183640 1 -- 172.21.15.114:0/3922694837 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f350806ae70 msgr2=0x7f350806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.110+0000 7f352c183640 1 --2- 172.21.15.114:0/3922694837 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f350806ae70 0x7f350806d330 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f35240c8a00 tx=0x7f3520009750 comp rx=0 tx=0).stop 2023-11-04T01:39:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.110+0000 7f352c183640 1 -- 172.21.15.114:0/3922694837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35240c6050 msgr2=0x7f35240c64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.110+0000 7f352c183640 1 --2- 172.21.15.114:0/3922694837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35240c6050 0x7f35240c64d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f351402c2b0 tx=0x7f3514004730 comp rx=0 tx=0).stop 2023-11-04T01:39:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.110+0000 7f352c183640 1 -- 172.21.15.114:0/3922694837 shutdown_connections 2023-11-04T01:39:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.110+0000 7f352c183640 1 --2- 172.21.15.114:0/3922694837 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f352415a8f0 0x7f352415ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.110+0000 7f352c183640 1 --2- 172.21.15.114:0/3922694837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35240c6050 0x7f35240c64d0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.110+0000 7f352c183640 1 --2- 172.21.15.114:0/3922694837 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f350806ae70 0x7f350806d330 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.110+0000 7f352c183640 1 --2- 172.21.15.114:0/3922694837 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f35100047c0 0x7f35240c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.110+0000 7f352c183640 1 -- 172.21.15.114:0/3922694837 >> 172.21.15.114:0/3922694837 conn(0x7f35240ce950 msgr2=0x7f352406d040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.110+0000 7f352c183640 1 -- 172.21.15.114:0/3922694837 shutdown_connections 2023-11-04T01:39:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.110+0000 7f352c183640 1 -- 172.21.15.114:0/3922694837 wait complete. 2023-11-04T01:39:54.125 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:39:54.125 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.228+0000 7f1f9ceec640 1 Processor -- start 2023-11-04T01:39:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.228+0000 7f1f9ceec640 1 -- start start 2023-11-04T01:39:54.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f9ceec640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f980cb5c0 0x7f1f980ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f9ceec640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9806a120 con 0x7f1f9815ce70 2023-11-04T01:39:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f9ceec640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f980c9f40 con 0x7f1f9815d250 2023-11-04T01:39:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f9ceec640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980cdc10 con 0x7f1f980cb5c0 2023-11-04T01:39:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f9659c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1f9815ce70 0x7f1f9806d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58096/0 (socket says 172.21.15.114:58096) 2023-11-04T01:39:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f9659c640 1 -- 172.21.15.114:0/2863106537 learned_addr learned my addr 172.21.15.114:0/2863106537 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f95d9b640 1 -- 172.21.15.114:0/2863106537 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941376848 0 0) 0x7f1f9806a120 con 0x7f1f9815ce70 2023-11-04T01:39:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f95d9b640 1 -- 172.21.15.114:0/2863106537 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f84003520 con 0x7f1f9815ce70 2023-11-04T01:39:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f96d9d640 1 --2- 172.21.15.114:0/2863106537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f980cb5c0 0x7f1f980ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f95d9b640 1 -- 172.21.15.114:0/2863106537 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 954869784 0 0) 0x7f1f84003520 con 0x7f1f9815ce70 2023-11-04T01:39:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f95d9b640 1 -- 172.21.15.114:0/2863106537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f980cb5c0 msgr2=0x7f1f980ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f95d9b640 1 --2- 172.21.15.114:0/2863106537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f980cb5c0 0x7f1f980ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f95d9b640 1 -- 172.21.15.114:0/2863106537 >> v1:172.21.15.141:6789/0 conn(0x7f1f9815d250 legacy=0x7f1f980c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f95d9b640 1 -- 172.21.15.114:0/2863106537 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9806a370 con 0x7f1f9815ce70 2023-11-04T01:39:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f95d9b640 1 -- 172.21.15.114:0/2863106537 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f1f88001670 con 0x7f1f9815ce70 2023-11-04T01:39:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f96d9d640 1 --2- 172.21.15.114:0/2863106537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f980cb5c0 0x7f1f980ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f95d9b640 1 -- 172.21.15.114:0/2863106537 >> v1:172.21.15.114:6789/0 conn(0x7f1f9815ce70 legacy=0x7f1f9806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f95d9b640 1 --2- 172.21.15.114:0/2863106537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f980cb5c0 0x7f1f840039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f95d9b640 1 --2- 172.21.15.114:0/2863106537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f84003f90 0x7f1f840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f95d9b640 1 --2- 172.21.15.114:0/2863106537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1f84004d00 0x7f1f84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f95d9b640 1 -- 172.21.15.114:0/2863106537 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980cdc10 con 0x7f1f84003f90 2023-11-04T01:39:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f95d9b640 1 -- 172.21.15.114:0/2863106537 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8400bae0 con 0x7f1f84004d00 2023-11-04T01:39:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f95d9b640 1 -- 172.21.15.114:0/2863106537 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8400bca0 con 0x7f1f980cb5c0 2023-11-04T01:39:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.229+0000 7f1f8dd9b640 1 --2- 172.21.15.114:0/2863106537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f84003f90 0x7f1f840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.230+0000 7f1f9659c640 1 --2- 172.21.15.114:0/2863106537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f980cb5c0 0x7f1f840039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.230+0000 7f1f96d9d640 1 --2- 172.21.15.114:0/2863106537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1f84004d00 0x7f1f84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.230+0000 7f1f8dd9b640 1 -- 172.21.15.114:0/2863106537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f980cb5c0 msgr2=0x7f1f840039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.230+0000 7f1f8dd9b640 1 --2- 172.21.15.114:0/2863106537 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f980cb5c0 0x7f1f840039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.230+0000 7f1f8dd9b640 1 -- 172.21.15.114:0/2863106537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1f84004d00 msgr2=0x7f1f84005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.230+0000 7f1f8dd9b640 1 --2- 172.21.15.114:0/2863106537 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1f84004d00 0x7f1f84005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.230+0000 7f1f8dd9b640 1 -- 172.21.15.114:0/2863106537 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f84003520 con 0x7f1f84003f90 2023-11-04T01:39:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.230+0000 7f1f8dd9b640 1 --2- 172.21.15.114:0/2863106537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f84003f90 0x7f1f840047c0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f1f80001720 tx=0x7f1f840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fed51a16b6108a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.231+0000 7f1f95d9b640 1 -- 172.21.15.114:0/2863106537 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f800052d0 con 0x7f1f84003f90 2023-11-04T01:39:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.231+0000 7f1f95d9b640 1 -- 172.21.15.114:0/2863106537 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8002e050 con 0x7f1f84003f90 2023-11-04T01:39:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.231+0000 7f1f95d9b640 1 -- 172.21.15.114:0/2863106537 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f80003830 con 0x7f1f84003f90 2023-11-04T01:39:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.231+0000 7f1f9ceec640 1 -- 172.21.15.114:0/2863106537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f84003f90 msgr2=0x7f1f840047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.231+0000 7f1f9ceec640 1 --2- 172.21.15.114:0/2863106537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f84003f90 0x7f1f840047c0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f1f80001720 tx=0x7f1f840057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.231+0000 7f1f96d9d640 1 -- 172.21.15.114:0/2863106537 reap_dead start 2023-11-04T01:39:54.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.231+0000 7f1f9ceec640 1 -- 172.21.15.114:0/2863106537 shutdown_connections 2023-11-04T01:39:54.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.231+0000 7f1f9ceec640 1 -- 172.21.15.114:0/2863106537 >> 172.21.15.114:0/2863106537 conn(0x7f1f980b0cd0 msgr2=0x7f1f980b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:54.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.231+0000 7f1f9ceec640 1 -- 172.21.15.114:0/2863106537 shutdown_connections 2023-11-04T01:39:54.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.231+0000 7f1f9ceec640 1 -- 172.21.15.114:0/2863106537 wait complete. 2023-11-04T01:39:54.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.233+0000 7f1f9ceec640 1 Processor -- start 2023-11-04T01:39:54.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.233+0000 7f1f9ceec640 1 -- start start 2023-11-04T01:39:54.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.233+0000 7f1f9ceec640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1f84003f90 0x7f1f980c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.233+0000 7f1f9ceec640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f980c62b0 0x7f1f981f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.233+0000 7f1f9ceec640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f9814f550 0x7f1f98158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.233+0000 7f1f9ceec640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980c73c0 con 0x7f1f980c62b0 2023-11-04T01:39:54.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.233+0000 7f1f9ceec640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f98155a60 con 0x7f1f84003f90 2023-11-04T01:39:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.233+0000 7f1f9ceec640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f981f3a10 con 0x7f1f9814f550 2023-11-04T01:39:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.233+0000 7f1f8dd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f980c62b0 0x7f1f981f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.233+0000 7f1f8dd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f980c62b0 0x7f1f981f34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54606/0 (socket says 172.21.15.114:54606) 2023-11-04T01:39:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.233+0000 7f1f8dd9b640 1 -- 172.21.15.114:0/1696761859 learned_addr learned my addr 172.21.15.114:0/1696761859 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.234+0000 7f1f9659c640 1 --2- 172.21.15.114:0/1696761859 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1f84003f90 0x7f1f980c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.234+0000 7f1f96d9d640 1 --2- 172.21.15.114:0/1696761859 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f9814f550 0x7f1f98158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.234+0000 7f1f8dd9b640 1 -- 172.21.15.114:0/1696761859 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f9814f550 msgr2=0x7f1f98158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.234+0000 7f1f8dd9b640 1 --2- 172.21.15.114:0/1696761859 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f9814f550 0x7f1f98158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.234+0000 7f1f8dd9b640 1 -- 172.21.15.114:0/1696761859 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1f84003f90 msgr2=0x7f1f980c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.234+0000 7f1f8dd9b640 1 --2- 172.21.15.114:0/1696761859 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1f84003f90 0x7f1f980c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.234+0000 7f1f8dd9b640 1 -- 172.21.15.114:0/1696761859 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f980c67b0 con 0x7f1f980c62b0 2023-11-04T01:39:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.234+0000 7f1f9659c640 1 --2- 172.21.15.114:0/1696761859 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1f84003f90 0x7f1f980c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.234+0000 7f1f96d9d640 1 --2- 172.21.15.114:0/1696761859 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f9814f550 0x7f1f98158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.234+0000 7f1f8dd9b640 1 --2- 172.21.15.114:0/1696761859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f980c62b0 0x7f1f981f34d0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f1f80008fd0 tx=0x7f1f80001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.234+0000 7f1f8f7fe640 1 -- 172.21.15.114:0/1696761859 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f80007a30 con 0x7f1f980c62b0 2023-11-04T01:39:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.234+0000 7f1f8f7fe640 1 -- 172.21.15.114:0/1696761859 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f800069e0 con 0x7f1f980c62b0 2023-11-04T01:39:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.234+0000 7f1f9ceec640 1 -- 172.21.15.114:0/1696761859 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f980c6a90 con 0x7f1f980c62b0 2023-11-04T01:39:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.234+0000 7f1f8f7fe640 1 -- 172.21.15.114:0/1696761859 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f80006d50 con 0x7f1f980c62b0 2023-11-04T01:39:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.234+0000 7f1f9ceec640 1 -- 172.21.15.114:0/1696761859 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f980c7050 con 0x7f1f980c62b0 2023-11-04T01:39:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.235+0000 7f1f9ceec640 1 -- 172.21.15.114:0/1696761859 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f98074290 con 0x7f1f980c62b0 2023-11-04T01:39:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.235+0000 7f1f8f7fe640 1 -- 172.21.15.114:0/1696761859 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f800035f0 con 0x7f1f980c62b0 2023-11-04T01:39:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.236+0000 7f1f8f7fe640 1 --2- 172.21.15.114:0/1696761859 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1f7806ae70 0x7f1f7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.236+0000 7f1f8f7fe640 1 -- 172.21.15.114:0/1696761859 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f1f800abd00 con 0x7f1f980c62b0 2023-11-04T01:39:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.236+0000 7f1f9659c640 1 --2- 172.21.15.114:0/1696761859 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1f7806ae70 0x7f1f7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.236+0000 7f1f9659c640 1 --2- 172.21.15.114:0/1696761859 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1f7806ae70 0x7f1f7806d330 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1f88001b40 tx=0x7f1f88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.240+0000 7f1f8f7fe640 1 -- 172.21.15.114:0/1696761859 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1f800768c0 con 0x7f1f980c62b0 2023-11-04T01:39:54.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.440+0000 7f1f9ceec640 1 -- 172.21.15.114:0/1696761859 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f98066170 con 0x7f1f980c62b0 2023-11-04T01:39:54.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.441+0000 7f1f8f7fe640 1 -- 172.21.15.114:0/1696761859 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f1f8004b090 con 0x7f1f980c62b0 2023-11-04T01:39:54.443 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:54.443 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":43,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:39:53.429982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7431":{"gid":7431,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/3780323525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3780323525},{"type":"v1","addr":"172.21.15.114:6836","nonce":3780323525}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:54.443 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 43 2023-11-04T01:39:54.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.443+0000 7f1f9ceec640 1 -- 172.21.15.114:0/1696761859 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1f7806ae70 msgr2=0x7f1f7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.443+0000 7f1f9ceec640 1 --2- 172.21.15.114:0/1696761859 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1f7806ae70 0x7f1f7806d330 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1f88001b40 tx=0x7f1f88009040 comp rx=0 tx=0).stop 2023-11-04T01:39:54.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.443+0000 7f1f9ceec640 1 -- 172.21.15.114:0/1696761859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f980c62b0 msgr2=0x7f1f981f34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.443+0000 7f1f9ceec640 1 --2- 172.21.15.114:0/1696761859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f980c62b0 0x7f1f981f34d0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f1f80008fd0 tx=0x7f1f80001120 comp rx=0 tx=0).stop 2023-11-04T01:39:54.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.443+0000 7f1f9ceec640 1 -- 172.21.15.114:0/1696761859 shutdown_connections 2023-11-04T01:39:54.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.443+0000 7f1f9ceec640 1 --2- 172.21.15.114:0/1696761859 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1f9814f550 0x7f1f98158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.443+0000 7f1f9ceec640 1 --2- 172.21.15.114:0/1696761859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f980c62b0 0x7f1f981f34d0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.443+0000 7f1f9ceec640 1 --2- 172.21.15.114:0/1696761859 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1f7806ae70 0x7f1f7806d330 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.443+0000 7f1f9ceec640 1 --2- 172.21.15.114:0/1696761859 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1f84003f90 0x7f1f980c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.443+0000 7f1f9ceec640 1 -- 172.21.15.114:0/1696761859 >> 172.21.15.114:0/1696761859 conn(0x7f1f980b0cd0 msgr2=0x7f1f980abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:54.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.443+0000 7f1f9ceec640 1 -- 172.21.15.114:0/1696761859 shutdown_connections 2023-11-04T01:39:54.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.443+0000 7f1f9ceec640 1 -- 172.21.15.114:0/1696761859 wait complete. 2023-11-04T01:39:54.455 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.553+0000 7f5493fe2640 1 Processor -- start 2023-11-04T01:39:54.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.553+0000 7f5493fe2640 1 -- start start 2023-11-04T01:39:54.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.553+0000 7f5493fe2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f548c06c6f0 0x7f548c06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.554+0000 7f5493fe2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f548c0b07f0 0x7f548c0b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.554+0000 7f5493fe2640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548c0b1150 con 0x7f548c15aa30 2023-11-04T01:39:54.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.554+0000 7f5493fe2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c0ca450 con 0x7f548c06c6f0 2023-11-04T01:39:54.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.554+0000 7f5493fe2640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c15bc30 con 0x7f548c0b07f0 2023-11-04T01:39:54.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.554+0000 7f549157d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f548c06c6f0 0x7f548c06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.554+0000 7f549157d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f548c06c6f0 0x7f548c06cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54620/0 (socket says 172.21.15.114:54620) 2023-11-04T01:39:54.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.554+0000 7f549157d640 1 -- 172.21.15.114:0/1533265962 learned_addr learned my addr 172.21.15.114:0/1533265962 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.554+0000 7f549257f640 1 --2- 172.21.15.114:0/1533265962 >> v2:172.21.15.141:3300/0 conn(0x7f548c0b07f0 0x7f548c0b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.554+0000 7f549157d640 1 -- 172.21.15.114:0/1533265962 >> v2:172.21.15.141:3300/0 conn(0x7f548c0b07f0 msgr2=0x7f548c0b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.554+0000 7f549157d640 1 --2- 172.21.15.114:0/1533265962 >> v2:172.21.15.141:3300/0 conn(0x7f548c0b07f0 0x7f548c0b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.554+0000 7f549157d640 1 -- 172.21.15.114:0/1533265962 >> v1:172.21.15.141:6789/0 conn(0x7f548c15aa30 legacy=0x7f548c0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.554+0000 7f549157d640 1 -- 172.21.15.114:0/1533265962 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c15bf10 con 0x7f548c06c6f0 2023-11-04T01:39:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.554+0000 7f549257f640 1 --2- 172.21.15.114:0/1533265962 >> v2:172.21.15.141:3300/0 conn(0x7f548c0b07f0 0x7f548c0b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:54.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.555+0000 7f549157d640 1 --2- 172.21.15.114:0/1533265962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c06c6f0 0x7f548c06cb80 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f548c0ae770 tx=0x7f547c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfc8e20e7be6623 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.555+0000 7f5490d7c640 1 -- 172.21.15.114:0/1533265962 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c030860 con 0x7f548c06c6f0 2023-11-04T01:39:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.555+0000 7f5490d7c640 1 -- 172.21.15.114:0/1533265962 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c0309c0 con 0x7f548c06c6f0 2023-11-04T01:39:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.555+0000 7f5490d7c640 1 -- 172.21.15.114:0/1533265962 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c030d50 con 0x7f548c06c6f0 2023-11-04T01:39:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.555+0000 7f5493fe2640 1 -- 172.21.15.114:0/1533265962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c06c6f0 msgr2=0x7f548c06cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.555+0000 7f5493fe2640 1 --2- 172.21.15.114:0/1533265962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c06c6f0 0x7f548c06cb80 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f548c0ae770 tx=0x7f547c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.555+0000 7f5493fe2640 1 -- 172.21.15.114:0/1533265962 shutdown_connections 2023-11-04T01:39:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.555+0000 7f5493fe2640 1 --2- 172.21.15.114:0/1533265962 >> v2:172.21.15.141:3300/0 conn(0x7f548c0b07f0 0x7f548c0b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.555+0000 7f5493fe2640 1 --2- 172.21.15.114:0/1533265962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c06c6f0 0x7f548c06cb80 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.555+0000 7f5493fe2640 1 -- 172.21.15.114:0/1533265962 >> 172.21.15.114:0/1533265962 conn(0x7f548c0cb7f0 msgr2=0x7f548c0cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.556+0000 7f5493fe2640 1 -- 172.21.15.114:0/1533265962 shutdown_connections 2023-11-04T01:39:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.556+0000 7f5493fe2640 1 -- 172.21.15.114:0/1533265962 wait complete. 2023-11-04T01:39:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.557+0000 7f5493fe2640 1 Processor -- start 2023-11-04T01:39:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.557+0000 7f5493fe2640 1 -- start start 2023-11-04T01:39:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.557+0000 7f5493fe2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c06c6f0 0x7f548c1e4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.557+0000 7f5493fe2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f548c0b07f0 0x7f548c14f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.557+0000 7f5493fe2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f548c15aa30 0x7f548c0c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.557+0000 7f5493fe2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c151d10 con 0x7f548c06c6f0 2023-11-04T01:39:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.557+0000 7f5493fe2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c1e5060 con 0x7f548c15aa30 2023-11-04T01:39:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.557+0000 7f5493fe2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c151100 con 0x7f548c0b07f0 2023-11-04T01:39:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.558+0000 7f5491d7e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c06c6f0 0x7f548c1e4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.558+0000 7f5491d7e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c06c6f0 0x7f548c1e4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54626/0 (socket says 172.21.15.114:54626) 2023-11-04T01:39:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.558+0000 7f5491d7e640 1 -- 172.21.15.114:0/3709386218 learned_addr learned my addr 172.21.15.114:0/3709386218 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.558+0000 7f549157d640 1 --2- 172.21.15.114:0/3709386218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f548c0b07f0 0x7f548c14f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.558+0000 7f549257f640 1 --2- 172.21.15.114:0/3709386218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f548c15aa30 0x7f548c0c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.558+0000 7f5491d7e640 1 -- 172.21.15.114:0/3709386218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f548c0b07f0 msgr2=0x7f548c14f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.558+0000 7f5491d7e640 1 --2- 172.21.15.114:0/3709386218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f548c0b07f0 0x7f548c14f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.558+0000 7f5491d7e640 1 -- 172.21.15.114:0/3709386218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f548c15aa30 msgr2=0x7f548c0c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.558+0000 7f5491d7e640 1 --2- 172.21.15.114:0/3709386218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f548c15aa30 0x7f548c0c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.558+0000 7f5491d7e640 1 -- 172.21.15.114:0/3709386218 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0094d0 con 0x7f548c06c6f0 2023-11-04T01:39:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.558+0000 7f5491d7e640 1 --2- 172.21.15.114:0/3709386218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c06c6f0 0x7f548c1e4b20 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f548400c730 tx=0x7f548400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.558+0000 7f54827fc640 1 -- 172.21.15.114:0/3709386218 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484003b70 con 0x7f548c06c6f0 2023-11-04T01:39:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.558+0000 7f54827fc640 1 -- 172.21.15.114:0/3709386218 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5484003cf0 con 0x7f548c06c6f0 2023-11-04T01:39:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.558+0000 7f54827fc640 1 -- 172.21.15.114:0/3709386218 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484003ea0 con 0x7f548c06c6f0 2023-11-04T01:39:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.558+0000 7f5493fe2640 1 -- 172.21.15.114:0/3709386218 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c1513e0 con 0x7f548c06c6f0 2023-11-04T01:39:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.558+0000 7f5493fe2640 1 -- 172.21.15.114:0/3709386218 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c1519a0 con 0x7f548c06c6f0 2023-11-04T01:39:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.559+0000 7f5493fe2640 1 -- 172.21.15.114:0/3709386218 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548c074290 con 0x7f548c06c6f0 2023-11-04T01:39:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.560+0000 7f54827fc640 1 -- 172.21.15.114:0/3709386218 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f548400aa90 con 0x7f548c06c6f0 2023-11-04T01:39:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.560+0000 7f54827fc640 1 --2- 172.21.15.114:0/3709386218 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f547006ae70 0x7f547006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.560+0000 7f54827fc640 1 -- 172.21.15.114:0/3709386218 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f5484089830 con 0x7f548c06c6f0 2023-11-04T01:39:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.560+0000 7f549157d640 1 --2- 172.21.15.114:0/3709386218 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f547006ae70 0x7f547006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.560+0000 7f549157d640 1 --2- 172.21.15.114:0/3709386218 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f547006ae70 0x7f547006d330 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f547c036000 tx=0x7f547c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.564+0000 7f54827fc640 1 -- 172.21.15.114:0/3709386218 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5484054410 con 0x7f548c06c6f0 2023-11-04T01:39:54.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.730+0000 7f5493fe2640 1 -- 172.21.15.114:0/3709386218 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f548c15c1f0 con 0x7f548c06c6f0 2023-11-04T01:39:54.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.732+0000 7f54827fc640 1 -- 172.21.15.114:0/3709386218 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+22065 (secure 0 0 0) 0x7f5484057a30 con 0x7f548c06c6f0 2023-11-04T01:39:54.734 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:54.734 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":96,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:39:53.099890+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:50.031565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:50.411946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:54.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.734+0000 7f5493fe2640 1 -- 172.21.15.114:0/3709386218 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f547006ae70 msgr2=0x7f547006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.734+0000 7f5493fe2640 1 --2- 172.21.15.114:0/3709386218 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f547006ae70 0x7f547006d330 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f547c036000 tx=0x7f547c008030 comp rx=0 tx=0).stop 2023-11-04T01:39:54.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.734+0000 7f5493fe2640 1 -- 172.21.15.114:0/3709386218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c06c6f0 msgr2=0x7f548c1e4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.734+0000 7f5493fe2640 1 --2- 172.21.15.114:0/3709386218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c06c6f0 0x7f548c1e4b20 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f548400c730 tx=0x7f548400cbf0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.734+0000 7f5493fe2640 1 -- 172.21.15.114:0/3709386218 shutdown_connections 2023-11-04T01:39:54.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.734+0000 7f5493fe2640 1 --2- 172.21.15.114:0/3709386218 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f547006ae70 0x7f547006d330 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.734+0000 7f5493fe2640 1 --2- 172.21.15.114:0/3709386218 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f548c15aa30 0x7f548c0c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.734+0000 7f5493fe2640 1 --2- 172.21.15.114:0/3709386218 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f548c0b07f0 0x7f548c14f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.734+0000 7f5493fe2640 1 --2- 172.21.15.114:0/3709386218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c06c6f0 0x7f548c1e4b20 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.734+0000 7f5493fe2640 1 -- 172.21.15.114:0/3709386218 >> 172.21.15.114:0/3709386218 conn(0x7f548c0cb7f0 msgr2=0x7f548c06cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:54.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.734+0000 7f5493fe2640 1 -- 172.21.15.114:0/3709386218 shutdown_connections 2023-11-04T01:39:54.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.734+0000 7f5493fe2640 1 -- 172.21.15.114:0/3709386218 wait complete. 2023-11-04T01:39:54.747 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:39:54.747 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:39:54.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.847+0000 7f2aa42c9640 1 Processor -- start 2023-11-04T01:39:54.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.847+0000 7f2aa42c9640 1 -- start start 2023-11-04T01:39:54.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.848+0000 7f2aa42c9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2a9c0cde60 0x7f2a9c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.848+0000 7f2aa42c9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a9c15e000 con 0x7f2a9c0ce240 2023-11-04T01:39:54.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.848+0000 7f2aa42c9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a9c15e2e0 con 0x7f2a9c15daa0 2023-11-04T01:39:54.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.848+0000 7f2aa42c9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a9c15e5c0 con 0x7f2a9c0cde60 2023-11-04T01:39:54.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.848+0000 7f2aa2866640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2a9c0ce240 0x7f2a9c0d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58110/0 (socket says 172.21.15.114:58110) 2023-11-04T01:39:54.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.848+0000 7f2aa2866640 1 -- 172.21.15.114:0/1257008762 learned_addr learned my addr 172.21.15.114:0/1257008762 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:54.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.848+0000 7f2aa1063640 1 -- 172.21.15.114:0/1257008762 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828532479 0 0) 0x7f2a9c15e000 con 0x7f2a9c0ce240 2023-11-04T01:39:54.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.848+0000 7f2aa1063640 1 -- 172.21.15.114:0/1257008762 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a88003520 con 0x7f2a9c0ce240 2023-11-04T01:39:54.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.848+0000 7f2aa2065640 1 --2- 172.21.15.114:0/1257008762 >> v2:172.21.15.141:3300/0 conn(0x7f2a9c0cde60 0x7f2a9c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.848+0000 7f2aa1063640 1 -- 172.21.15.114:0/1257008762 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 335497426 0 0) 0x7f2a88003520 con 0x7f2a9c0ce240 2023-11-04T01:39:54.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa1063640 1 -- 172.21.15.114:0/1257008762 >> v2:172.21.15.141:3300/0 conn(0x7f2a9c0cde60 msgr2=0x7f2a9c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:54.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa1063640 1 --2- 172.21.15.114:0/1257008762 >> v2:172.21.15.141:3300/0 conn(0x7f2a9c0cde60 0x7f2a9c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa1063640 1 -- 172.21.15.114:0/1257008762 >> v1:172.21.15.141:6789/0 conn(0x7f2a9c15daa0 legacy=0x7f2a9c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:54.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa1063640 1 -- 172.21.15.114:0/1257008762 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9c0d1120 con 0x7f2a9c0ce240 2023-11-04T01:39:54.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa1063640 1 -- 172.21.15.114:0/1257008762 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f2a940019f0 con 0x7f2a9c0ce240 2023-11-04T01:39:54.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa1063640 1 -- 172.21.15.114:0/1257008762 >> v1:172.21.15.114:6789/0 conn(0x7f2a9c0ce240 legacy=0x7f2a9c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa1063640 1 --2- 172.21.15.114:0/1257008762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a88003970 0x7f2a88003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa1063640 1 --2- 172.21.15.114:0/1257008762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a880047c0 0x7f2a88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa1063640 1 --2- 172.21.15.114:0/1257008762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a88005180 0x7f2a8800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa1063640 1 -- 172.21.15.114:0/1257008762 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c15e5c0 con 0x7f2a88005180 2023-11-04T01:39:54.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa1063640 1 -- 172.21.15.114:0/1257008762 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8800c0d0 con 0x7f2a880047c0 2023-11-04T01:39:54.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa1063640 1 -- 172.21.15.114:0/1257008762 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8800c290 con 0x7f2a88003970 2023-11-04T01:39:54.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa2866640 1 --2- 172.21.15.114:0/1257008762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a88005180 0x7f2a8800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa1864640 1 --2- 172.21.15.114:0/1257008762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a880047c0 0x7f2a88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa2065640 1 --2- 172.21.15.114:0/1257008762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a88003970 0x7f2a88003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa2866640 1 -- 172.21.15.114:0/1257008762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a88003970 msgr2=0x7f2a88003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:54.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa2866640 1 --2- 172.21.15.114:0/1257008762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a88003970 0x7f2a88003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa2866640 1 -- 172.21.15.114:0/1257008762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a880047c0 msgr2=0x7f2a88004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:54.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa2866640 1 --2- 172.21.15.114:0/1257008762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a880047c0 0x7f2a88004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.849+0000 7f2aa2866640 1 -- 172.21.15.114:0/1257008762 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a88003520 con 0x7f2a88005180 2023-11-04T01:39:54.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.850+0000 7f2aa2866640 1 -- 172.21.15.114:0/1257008762 reap_dead start 2023-11-04T01:39:54.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.850+0000 7f2aa2866640 1 --2- 172.21.15.114:0/1257008762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a88005180 0x7f2a8800b980 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f2a940013d0 tx=0x7f2a880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baee420c74ae4a0c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.850+0000 7f2aa1063640 1 -- 172.21.15.114:0/1257008762 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a94034630 con 0x7f2a88005180 2023-11-04T01:39:54.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.850+0000 7f2aa1063640 1 -- 172.21.15.114:0/1257008762 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9402f070 con 0x7f2a88005180 2023-11-04T01:39:54.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.850+0000 7f2aa1063640 1 -- 172.21.15.114:0/1257008762 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940349d0 con 0x7f2a88005180 2023-11-04T01:39:54.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.850+0000 7f2aa42c9640 1 -- 172.21.15.114:0/1257008762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a88005180 msgr2=0x7f2a8800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.850+0000 7f2aa42c9640 1 --2- 172.21.15.114:0/1257008762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a88005180 0x7f2a8800b980 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f2a940013d0 tx=0x7f2a880057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.850+0000 7f2aa42c9640 1 -- 172.21.15.114:0/1257008762 shutdown_connections 2023-11-04T01:39:54.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.850+0000 7f2aa42c9640 1 --2- 172.21.15.114:0/1257008762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a88005180 0x7f2a8800b980 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.850+0000 7f2aa42c9640 1 -- 172.21.15.114:0/1257008762 >> 172.21.15.114:0/1257008762 conn(0x7f2a9c071f30 msgr2=0x7f2a9c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:54.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.851+0000 7f2aa42c9640 1 -- 172.21.15.114:0/1257008762 shutdown_connections 2023-11-04T01:39:54.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.851+0000 7f2aa42c9640 1 -- 172.21.15.114:0/1257008762 wait complete. 2023-11-04T01:39:54.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.852+0000 7f2aa42c9640 1 Processor -- start 2023-11-04T01:39:54.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.852+0000 7f2aa42c9640 1 -- start start 2023-11-04T01:39:54.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.852+0000 7f2aa42c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a88005180 0x7f2a9c15c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.852+0000 7f2aa42c9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a9c155c70 0x7f2a9c153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.852+0000 7f2aa42c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a9c159e20 0x7f2a9c15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.852+0000 7f2aa42c9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c15a7e0 con 0x7f2a9c159e20 2023-11-04T01:39:54.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.852+0000 7f2aa42c9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c1542a0 con 0x7f2a9c155c70 2023-11-04T01:39:54.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.852+0000 7f2aa42c9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c1563e0 con 0x7f2a88005180 2023-11-04T01:39:54.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2aa2866640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a9c159e20 0x7f2a9c15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2aa2866640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a9c159e20 0x7f2a9c15a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54644/0 (socket says 172.21.15.114:54644) 2023-11-04T01:39:54.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2aa2866640 1 -- 172.21.15.114:0/1841219241 learned_addr learned my addr 172.21.15.114:0/1841219241 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:54.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2aa1864640 1 --2- 172.21.15.114:0/1841219241 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a9c155c70 0x7f2a9c153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2aa2065640 1 --2- 172.21.15.114:0/1841219241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a88005180 0x7f2a9c15c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2aa2866640 1 -- 172.21.15.114:0/1841219241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a88005180 msgr2=0x7f2a9c15c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2aa2866640 1 --2- 172.21.15.114:0/1841219241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a88005180 0x7f2a9c15c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2aa2866640 1 -- 172.21.15.114:0/1841219241 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a9c155c70 msgr2=0x7f2a9c153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2aa2866640 1 --2- 172.21.15.114:0/1841219241 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a9c155c70 0x7f2a9c153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2aa2866640 1 -- 172.21.15.114:0/1841219241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9c1566c0 con 0x7f2a9c159e20 2023-11-04T01:39:54.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2aa1864640 1 --2- 172.21.15.114:0/1841219241 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a9c155c70 0x7f2a9c153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:54.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2aa2065640 1 --2- 172.21.15.114:0/1841219241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a88005180 0x7f2a9c15c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:54.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2aa2866640 1 --2- 172.21.15.114:0/1841219241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a9c159e20 0x7f2a9c15a2a0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f2a94002230 tx=0x7f2a94001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2a92ffd640 1 -- 172.21.15.114:0/1841219241 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a94034430 con 0x7f2a9c159e20 2023-11-04T01:39:54.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2a92ffd640 1 -- 172.21.15.114:0/1841219241 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a94034590 con 0x7f2a9c159e20 2023-11-04T01:39:54.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2aa42c9640 1 -- 172.21.15.114:0/1841219241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a9c1569a0 con 0x7f2a9c159e20 2023-11-04T01:39:54.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2a92ffd640 1 -- 172.21.15.114:0/1841219241 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a94034920 con 0x7f2a9c159e20 2023-11-04T01:39:54.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.853+0000 7f2aa42c9640 1 -- 172.21.15.114:0/1841219241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a9c157650 con 0x7f2a9c159e20 2023-11-04T01:39:54.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.854+0000 7f2aa42c9640 1 -- 172.21.15.114:0/1841219241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9c157840 con 0x7f2a9c159e20 2023-11-04T01:39:54.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.855+0000 7f2a92ffd640 1 -- 172.21.15.114:0/1841219241 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a94031030 con 0x7f2a9c159e20 2023-11-04T01:39:54.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.855+0000 7f2a92ffd640 1 --2- 172.21.15.114:0/1841219241 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a8006ae70 0x7f2a8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.855+0000 7f2a92ffd640 1 -- 172.21.15.114:0/1841219241 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f2a940ab640 con 0x7f2a9c159e20 2023-11-04T01:39:54.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.855+0000 7f2aa2065640 1 --2- 172.21.15.114:0/1841219241 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a8006ae70 0x7f2a8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.855+0000 7f2aa2065640 1 --2- 172.21.15.114:0/1841219241 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a8006ae70 0x7f2a8006d330 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c006fd0 tx=0x7f2a8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:54.859+0000 7f2a92ffd640 1 -- 172.21.15.114:0/1841219241 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2a940760f0 con 0x7f2a9c159e20 2023-11-04T01:39:55.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.021+0000 7f2aa42c9640 1 -- 172.21.15.114:0/1841219241 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a9c0d1400 con 0x7f2a8006ae70 2023-11-04T01:39:55.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.033+0000 7f2a92ffd640 1 -- 172.21.15.114:0/1841219241 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+532153 (secure 0 0 0) 0x7f2a8c00b760 con 0x7f2a8006ae70 2023-11-04T01:39:55.041 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:55.045 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:39:55.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.037+0000 7f2aa42c9640 1 -- 172.21.15.114:0/1841219241 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a8006ae70 msgr2=0x7f2a8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.037+0000 7f2aa42c9640 1 --2- 172.21.15.114:0/1841219241 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a8006ae70 0x7f2a8006d330 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c006fd0 tx=0x7f2a8c008040 comp rx=0 tx=0).stop 2023-11-04T01:39:55.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.037+0000 7f2aa42c9640 1 -- 172.21.15.114:0/1841219241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a9c159e20 msgr2=0x7f2a9c15a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.037+0000 7f2aa42c9640 1 --2- 172.21.15.114:0/1841219241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a9c159e20 0x7f2a9c15a2a0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f2a94002230 tx=0x7f2a94001360 comp rx=0 tx=0).stop 2023-11-04T01:39:55.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.037+0000 7f2aa42c9640 1 -- 172.21.15.114:0/1841219241 shutdown_connections 2023-11-04T01:39:55.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.037+0000 7f2aa42c9640 1 --2- 172.21.15.114:0/1841219241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a9c159e20 0x7f2a9c15a2a0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.037+0000 7f2aa42c9640 1 --2- 172.21.15.114:0/1841219241 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2a8006ae70 0x7f2a8006d330 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.037+0000 7f2aa42c9640 1 --2- 172.21.15.114:0/1841219241 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2a9c155c70 0x7f2a9c153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.037+0000 7f2aa42c9640 1 --2- 172.21.15.114:0/1841219241 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2a88005180 0x7f2a9c15c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.038+0000 7f2aa42c9640 1 -- 172.21.15.114:0/1841219241 >> 172.21.15.114:0/1841219241 conn(0x7f2a9c071f30 msgr2=0x7f2a9c0c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:55.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.038+0000 7f2aa42c9640 1 -- 172.21.15.114:0/1841219241 shutdown_connections 2023-11-04T01:39:55.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.038+0000 7f2aa42c9640 1 -- 172.21.15.114:0/1841219241 wait complete. 2023-11-04T01:39:55.050 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2023-11-04T01:39:53.900824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":324,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247304,"kb_used_data":10332,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754727416,"statfs":{"total":773094113280,"available":772840873984,"internally_reserved":0,"allocated":10579968,"data_stored":5799916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001056"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.118788+0000","last_change":"2023-11-04T01:39:52.111293+0000","last_active":"2023-11-04T01:39:52.118788+0000","last_peered":"2023-11-04T01:39:52.118788+0000","last_clean":"2023-11-04T01:39:52.118788+0000","last_became_active":"2023-11-04T01:39:52.110996+0000","last_became_peered":"2023-11-04T01:39:52.110996+0000","last_unstale":"2023-11-04T01:39:52.118788+0000","last_undegraded":"2023-11-04T01:39:52.118788+0000","last_fullsized":"2023-11-04T01:39:52.118788+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:48.114823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114257+0000","last_change":"2023-11-04T01:39:52.108536+0000","last_active":"2023-11-04T01:39:52.114257+0000","last_peered":"2023-11-04T01:39:52.114257+0000","last_clean":"2023-11-04T01:39:52.114257+0000","last_became_active":"2023-11-04T01:39:52.108284+0000","last_became_peered":"2023-11-04T01:39:52.108284+0000","last_unstale":"2023-11-04T01:39:52.114257+0000","last_undegraded":"2023-11-04T01:39:52.114257+0000","last_fullsized":"2023-11-04T01:39:52.114257+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:31:50.126169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.112632+0000","last_change":"2023-11-04T01:39:52.109739+0000","last_active":"2023-11-04T01:39:52.112632+0000","last_peered":"2023-11-04T01:39:52.112632+0000","last_clean":"2023-11-04T01:39:52.112632+0000","last_became_active":"2023-11-04T01:39:52.109435+0000","last_became_peered":"2023-11-04T01:39:52.109435+0000","last_unstale":"2023-11-04T01:39:52.112632+0000","last_undegraded":"2023-11-04T01:39:52.112632+0000","last_fullsized":"2023-11-04T01:39:52.112632+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:42:48.684260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.120702+0000","last_change":"2023-11-04T01:39:52.115553+0000","last_active":"2023-11-04T01:39:52.120702+0000","last_peered":"2023-11-04T01:39:52.120702+0000","last_clean":"2023-11-04T01:39:52.120702+0000","last_became_active":"2023-11-04T01:39:52.115300+0000","last_became_peered":"2023-11-04T01:39:52.115300+0000","last_unstale":"2023-11-04T01:39:52.120702+0000","last_undegraded":"2023-11-04T01:39:52.120702+0000","last_fullsized":"2023-11-04T01:39:52.120702+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:22.489126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.107893+0000","last_change":"2023-11-04T01:39:52.103405+0000","last_active":"2023-11-04T01:39:52.107893+0000","last_peered":"2023-11-04T01:39:52.107893+0000","last_clean":"2023-11-04T01:39:52.107893+0000","last_became_active":"2023-11-04T01:39:52.103149+0000","last_became_peered":"2023-11-04T01:39:52.103149+0000","last_unstale":"2023-11-04T01:39:52.107893+0000","last_undegraded":"2023-11-04T01:39:52.107893+0000","last_fullsized":"2023-11-04T01:39:52.107893+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:55.171219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.112815+0000","last_change":"2023-11-04T01:39:52.107860+0000","last_active":"2023-11-04T01:39:52.112815+0000","last_peered":"2023-11-04T01:39:52.112815+0000","last_clean":"2023-11-04T01:39:52.112815+0000","last_became_active":"2023-11-04T01:39:52.107614+0000","last_became_peered":"2023-11-04T01:39:52.107614+0000","last_unstale":"2023-11-04T01:39:52.112815+0000","last_undegraded":"2023-11-04T01:39:52.112815+0000","last_fullsized":"2023-11-04T01:39:52.112815+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:58.777826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.113229+0000","last_change":"2023-11-04T01:39:52.109590+0000","last_active":"2023-11-04T01:39:52.113229+0000","last_peered":"2023-11-04T01:39:52.113229+0000","last_clean":"2023-11-04T01:39:52.113229+0000","last_became_active":"2023-11-04T01:39:52.108037+0000","last_became_peered":"2023-11-04T01:39:52.108037+0000","last_unstale":"2023-11-04T01:39:52.113229+0000","last_undegraded":"2023-11-04T01:39:52.113229+0000","last_fullsized":"2023-11-04T01:39:52.113229+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:15:53.823846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.115207+0000","last_change":"2023-11-04T01:39:52.113628+0000","last_active":"2023-11-04T01:39:52.115207+0000","last_peered":"2023-11-04T01:39:52.115207+0000","last_clean":"2023-11-04T01:39:52.115207+0000","last_became_active":"2023-11-04T01:39:52.113352+0000","last_became_peered":"2023-11-04T01:39:52.113352+0000","last_unstale":"2023-11-04T01:39:52.115207+0000","last_undegraded":"2023-11-04T01:39:52.115207+0000","last_fullsized":"2023-11-04T01:39:52.115207+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:11:45.914450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.119677+0000","last_change":"2023-11-04T01:39:52.116049+0000","last_active":"2023-11-04T01:39:52.119677+0000","last_peered":"2023-11-04T01:39:52.119677+0000","last_clean":"2023-11-04T01:39:52.119677+0000","last_became_active":"2023-11-04T01:39:52.115782+0000","last_became_peered":"2023-11-04T01:39:52.115782+0000","last_unstale":"2023-11-04T01:39:52.119677+0000","last_undegraded":"2023-11-04T01:39:52.119677+0000","last_fullsized":"2023-11-04T01:39:52.119677+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:48.491689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.118907+0000","last_change":"2023-11-04T01:39:52.112341+0000","last_active":"2023-11-04T01:39:52.118907+0000","last_peered":"2023-11-04T01:39:52.118907+0000","last_clean":"2023-11-04T01:39:52.118907+0000","last_became_active":"2023-11-04T01:39:52.111621+0000","last_became_peered":"2023-11-04T01:39:52.111621+0000","last_unstale":"2023-11-04T01:39:52.118907+0000","last_undegraded":"2023-11-04T01:39:52.118907+0000","last_fullsized":"2023-11-04T01:39:52.118907+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:06.419673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114214+0000","last_change":"2023-11-04T01:39:52.107330+0000","last_active":"2023-11-04T01:39:52.114214+0000","last_peered":"2023-11-04T01:39:52.114214+0000","last_clean":"2023-11-04T01:39:52.114214+0000","last_became_active":"2023-11-04T01:39:52.107065+0000","last_became_peered":"2023-11-04T01:39:52.107065+0000","last_unstale":"2023-11-04T01:39:52.114214+0000","last_undegraded":"2023-11-04T01:39:52.114214+0000","last_fullsized":"2023-11-04T01:39:52.114214+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:18.056532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.122271+0000","last_change":"2023-11-04T01:39:52.118620+0000","last_active":"2023-11-04T01:39:52.122271+0000","last_peered":"2023-11-04T01:39:52.122271+0000","last_clean":"2023-11-04T01:39:52.122271+0000","last_became_active":"2023-11-04T01:39:52.118372+0000","last_became_peered":"2023-11-04T01:39:52.118372+0000","last_unstale":"2023-11-04T01:39:52.122271+0000","last_undegraded":"2023-11-04T01:39:52.122271+0000","last_fullsized":"2023-11-04T01:39:52.122271+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:24.498771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.112900+0000","last_change":"2023-11-04T01:39:52.109196+0000","last_active":"2023-11-04T01:39:52.112900+0000","last_peered":"2023-11-04T01:39:52.112900+0000","last_clean":"2023-11-04T01:39:52.112900+0000","last_became_active":"2023-11-04T01:39:52.108906+0000","last_became_peered":"2023-11-04T01:39:52.108906+0000","last_unstale":"2023-11-04T01:39:52.112900+0000","last_undegraded":"2023-11-04T01:39:52.112900+0000","last_fullsized":"2023-11-04T01:39:52.112900+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:19.069016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.110981+0000","last_change":"2023-11-04T01:39:52.107584+0000","last_active":"2023-11-04T01:39:52.110981+0000","last_peered":"2023-11-04T01:39:52.110981+0000","last_clean":"2023-11-04T01:39:52.110981+0000","last_became_active":"2023-11-04T01:39:52.107316+0000","last_became_peered":"2023-11-04T01:39:52.107316+0000","last_unstale":"2023-11-04T01:39:52.110981+0000","last_undegraded":"2023-11-04T01:39:52.110981+0000","last_fullsized":"2023-11-04T01:39:52.110981+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:33.273803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.112780+0000","last_change":"2023-11-04T01:39:52.108588+0000","last_active":"2023-11-04T01:39:52.112780+0000","last_peered":"2023-11-04T01:39:52.112780+0000","last_clean":"2023-11-04T01:39:52.112780+0000","last_became_active":"2023-11-04T01:39:52.108232+0000","last_became_peered":"2023-11-04T01:39:52.108232+0000","last_unstale":"2023-11-04T01:39:52.112780+0000","last_undegraded":"2023-11-04T01:39:52.112780+0000","last_fullsized":"2023-11-04T01:39:52.112780+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:56.890627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.118895+0000","last_change":"2023-11-04T01:39:52.112183+0000","last_active":"2023-11-04T01:39:52.118895+0000","last_peered":"2023-11-04T01:39:52.118895+0000","last_clean":"2023-11-04T01:39:52.118895+0000","last_became_active":"2023-11-04T01:39:52.111916+0000","last_became_peered":"2023-11-04T01:39:52.111916+0000","last_unstale":"2023-11-04T01:39:52.118895+0000","last_undegraded":"2023-11-04T01:39:52.118895+0000","last_fullsized":"2023-11-04T01:39:52.118895+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:58.063749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114534+0000","last_change":"2023-11-04T01:39:52.109548+0000","last_active":"2023-11-04T01:39:52.114534+0000","last_peered":"2023-11-04T01:39:52.114534+0000","last_clean":"2023-11-04T01:39:52.114534+0000","last_became_active":"2023-11-04T01:39:52.108761+0000","last_became_peered":"2023-11-04T01:39:52.108761+0000","last_unstale":"2023-11-04T01:39:52.114534+0000","last_undegraded":"2023-11-04T01:39:52.114534+0000","last_fullsized":"2023-11-04T01:39:52.114534+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:44.903258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.111149+0000","last_change":"2023-11-04T01:39:52.106980+0000","last_active":"2023-11-04T01:39:52.111149+0000","last_peered":"2023-11-04T01:39:52.111149+0000","last_clean":"2023-11-04T01:39:52.111149+0000","last_became_active":"2023-11-04T01:39:52.106681+0000","last_became_peered":"2023-11-04T01:39:52.106681+0000","last_unstale":"2023-11-04T01:39:52.111149+0000","last_undegraded":"2023-11-04T01:39:52.111149+0000","last_fullsized":"2023-11-04T01:39:52.111149+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:11.209671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.111037+0000","last_change":"2023-11-04T01:39:52.107919+0000","last_active":"2023-11-04T01:39:52.111037+0000","last_peered":"2023-11-04T01:39:52.111037+0000","last_clean":"2023-11-04T01:39:52.111037+0000","last_became_active":"2023-11-04T01:39:52.107659+0000","last_became_peered":"2023-11-04T01:39:52.107659+0000","last_unstale":"2023-11-04T01:39:52.111037+0000","last_undegraded":"2023-11-04T01:39:52.111037+0000","last_fullsized":"2023-11-04T01:39:52.111037+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:24:30.092914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.108048+0000","last_change":"2023-11-04T01:39:52.102804+0000","last_active":"2023-11-04T01:39:52.108048+0000","last_peered":"2023-11-04T01:39:52.108048+0000","last_clean":"2023-11-04T01:39:52.108048+0000","last_became_active":"2023-11-04T01:39:52.101972+0000","last_became_peered":"2023-11-04T01:39:52.101972+0000","last_unstale":"2023-11-04T01:39:52.108048+0000","last_undegraded":"2023-11-04T01:39:52.108048+0000","last_fullsized":"2023-11-04T01:39:52.108048+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:14.191164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114306+0000","last_change":"2023-11-04T01:39:52.108915+0000","last_active":"2023-11-04T01:39:52.114306+0000","last_peered":"2023-11-04T01:39:52.114306+0000","last_clean":"2023-11-04T01:39:52.114306+0000","last_became_active":"2023-11-04T01:39:52.108311+0000","last_became_peered":"2023-11-04T01:39:52.108311+0000","last_unstale":"2023-11-04T01:39:52.114306+0000","last_undegraded":"2023-11-04T01:39:52.114306+0000","last_fullsized":"2023-11-04T01:39:52.114306+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:01.151684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.120218+0000","last_change":"2023-11-04T01:39:52.110708+0000","last_active":"2023-11-04T01:39:52.120218+0000","last_peered":"2023-11-04T01:39:52.120218+0000","last_clean":"2023-11-04T01:39:52.120218+0000","last_became_active":"2023-11-04T01:39:52.107892+0000","last_became_peered":"2023-11-04T01:39:52.107892+0000","last_unstale":"2023-11-04T01:39:52.120218+0000","last_undegraded":"2023-11-04T01:39:52.120218+0000","last_fullsized":"2023-11-04T01:39:52.120218+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:19.446214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.107022+0000","last_change":"2023-11-04T01:39:52.102291+0000","last_active":"2023-11-04T01:39:52.107022+0000","last_peered":"2023-11-04T01:39:52.107022+0000","last_clean":"2023-11-04T01:39:52.107022+0000","last_became_active":"2023-11-04T01:39:52.101963+0000","last_became_peered":"2023-11-04T01:39:52.101963+0000","last_unstale":"2023-11-04T01:39:52.107022+0000","last_undegraded":"2023-11-04T01:39:52.107022+0000","last_fullsized":"2023-11-04T01:39:52.107022+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:54.718426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.109421+0000","last_change":"2023-11-04T01:39:52.107440+0000","last_active":"2023-11-04T01:39:52.109421+0000","last_peered":"2023-11-04T01:39:52.109421+0000","last_clean":"2023-11-04T01:39:52.109421+0000","last_became_active":"2023-11-04T01:39:52.106712+0000","last_became_peered":"2023-11-04T01:39:52.106712+0000","last_unstale":"2023-11-04T01:39:52.109421+0000","last_undegraded":"2023-11-04T01:39:52.109421+0000","last_fullsized":"2023-11-04T01:39:52.109421+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:20.966615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114304+0000","last_change":"2023-11-04T01:39:52.107810+0000","last_active":"2023-11-04T01:39:52.114304+0000","last_peered":"2023-11-04T01:39:52.114304+0000","last_clean":"2023-11-04T01:39:52.114304+0000","last_became_active":"2023-11-04T01:39:52.107520+0000","last_became_peered":"2023-11-04T01:39:52.107520+0000","last_unstale":"2023-11-04T01:39:52.114304+0000","last_undegraded":"2023-11-04T01:39:52.114304+0000","last_fullsized":"2023-11-04T01:39:52.114304+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:06:31.062913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.118925+0000","last_change":"2023-11-04T01:39:52.112433+0000","last_active":"2023-11-04T01:39:52.118925+0000","last_peered":"2023-11-04T01:39:52.118925+0000","last_clean":"2023-11-04T01:39:52.118925+0000","last_became_active":"2023-11-04T01:39:52.111267+0000","last_became_peered":"2023-11-04T01:39:52.111267+0000","last_unstale":"2023-11-04T01:39:52.118925+0000","last_undegraded":"2023-11-04T01:39:52.118925+0000","last_fullsized":"2023-11-04T01:39:52.118925+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:42.736642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.115995+0000","last_change":"2023-11-04T01:39:52.113363+0000","last_active":"2023-11-04T01:39:52.115995+0000","last_peered":"2023-11-04T01:39:52.115995+0000","last_clean":"2023-11-04T01:39:52.115995+0000","last_became_active":"2023-11-04T01:39:52.113106+0000","last_became_peered":"2023-11-04T01:39:52.113106+0000","last_unstale":"2023-11-04T01:39:52.115995+0000","last_undegraded":"2023-11-04T01:39:52.115995+0000","last_fullsized":"2023-11-04T01:39:52.115995+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:36.216029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.123209+0000","last_change":"2023-11-04T01:39:52.118051+0000","last_active":"2023-11-04T01:39:52.123209+0000","last_peered":"2023-11-04T01:39:52.123209+0000","last_clean":"2023-11-04T01:39:52.123209+0000","last_became_active":"2023-11-04T01:39:52.117780+0000","last_became_peered":"2023-11-04T01:39:52.117780+0000","last_unstale":"2023-11-04T01:39:52.123209+0000","last_undegraded":"2023-11-04T01:39:52.123209+0000","last_fullsized":"2023-11-04T01:39:52.123209+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:48:31.873794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.106789+0000","last_change":"2023-11-04T01:39:52.102812+0000","last_active":"2023-11-04T01:39:52.106789+0000","last_peered":"2023-11-04T01:39:52.106789+0000","last_clean":"2023-11-04T01:39:52.106789+0000","last_became_active":"2023-11-04T01:39:52.102540+0000","last_became_peered":"2023-11-04T01:39:52.102540+0000","last_unstale":"2023-11-04T01:39:52.106789+0000","last_undegraded":"2023-11-04T01:39:52.106789+0000","last_fullsized":"2023-11-04T01:39:52.106789+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:13:05.237517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.121015+0000","last_change":"2023-11-04T01:39:52.119229+0000","last_active":"2023-11-04T01:39:52.121015+0000","last_peered":"2023-11-04T01:39:52.121015+0000","last_clean":"2023-11-04T01:39:52.121015+0000","last_became_active":"2023-11-04T01:39:52.118464+0000","last_became_peered":"2023-11-04T01:39:52.118464+0000","last_unstale":"2023-11-04T01:39:52.121015+0000","last_undegraded":"2023-11-04T01:39:52.121015+0000","last_fullsized":"2023-11-04T01:39:52.121015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:25.481450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.118722+0000","last_change":"2023-11-04T01:39:52.110163+0000","last_active":"2023-11-04T01:39:52.118722+0000","last_peered":"2023-11-04T01:39:52.118722+0000","last_clean":"2023-11-04T01:39:52.118722+0000","last_became_active":"2023-11-04T01:39:52.109822+0000","last_became_peered":"2023-11-04T01:39:52.109822+0000","last_unstale":"2023-11-04T01:39:52.118722+0000","last_undegraded":"2023-11-04T01:39:52.118722+0000","last_fullsized":"2023-11-04T01:39:52.118722+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:32:04.335242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114050+0000","last_change":"2023-11-04T01:39:52.108998+0000","last_active":"2023-11-04T01:39:52.114050+0000","last_peered":"2023-11-04T01:39:52.114050+0000","last_clean":"2023-11-04T01:39:52.114050+0000","last_became_active":"2023-11-04T01:39:52.108710+0000","last_became_peered":"2023-11-04T01:39:52.108710+0000","last_unstale":"2023-11-04T01:39:52.114050+0000","last_undegraded":"2023-11-04T01:39:52.114050+0000","last_fullsized":"2023-11-04T01:39:52.114050+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:59.730954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.119395+0000","last_change":"2023-11-04T01:39:52.111256+0000","last_active":"2023-11-04T01:39:52.119395+0000","last_peered":"2023-11-04T01:39:52.119395+0000","last_clean":"2023-11-04T01:39:52.119395+0000","last_became_active":"2023-11-04T01:39:52.111001+0000","last_became_peered":"2023-11-04T01:39:52.111001+0000","last_unstale":"2023-11-04T01:39:52.119395+0000","last_undegraded":"2023-11-04T01:39:52.119395+0000","last_fullsized":"2023-11-04T01:39:52.119395+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:09.131723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.093229+0000","last_change":"2023-11-04T01:39:51.113337+0000","last_active":"2023-11-04T01:39:52.093229+0000","last_peered":"2023-11-04T01:39:52.093229+0000","last_clean":"2023-11-04T01:39:52.093229+0000","last_became_active":"2023-11-04T01:39:51.113070+0000","last_became_peered":"2023-11-04T01:39:51.113070+0000","last_unstale":"2023-11-04T01:39:52.093229+0000","last_undegraded":"2023-11-04T01:39:52.093229+0000","last_fullsized":"2023-11-04T01:39:52.093229+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:26:05.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.104090+0000","last_change":"2023-11-04T01:39:00.904362+0000","last_active":"2023-11-04T01:39:51.104090+0000","last_peered":"2023-11-04T01:39:51.104090+0000","last_clean":"2023-11-04T01:39:51.104090+0000","last_became_active":"2023-11-04T01:39:00.903861+0000","last_became_peered":"2023-11-04T01:39:00.903861+0000","last_unstale":"2023-11-04T01:39:51.104090+0000","last_undegraded":"2023-11-04T01:39:51.104090+0000","last_fullsized":"2023-11-04T01:39:51.104090+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:08:13.731370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096123+0000","last_change":"2023-11-04T01:39:01.899189+0000","last_active":"2023-11-04T01:39:51.096123+0000","last_peered":"2023-11-04T01:39:51.096123+0000","last_clean":"2023-11-04T01:39:51.096123+0000","last_became_active":"2023-11-04T01:38:59.885803+0000","last_became_peered":"2023-11-04T01:38:59.885803+0000","last_unstale":"2023-11-04T01:39:51.096123+0000","last_undegraded":"2023-11-04T01:39:51.096123+0000","last_fullsized":"2023-11-04T01:39:51.096123+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:13.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061642800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.101278+0000","last_change":"2023-11-04T01:38:02.156342+0000","last_active":"2023-11-04T01:39:51.101278+0000","last_peered":"2023-11-04T01:39:51.101278+0000","last_clean":"2023-11-04T01:39:51.101278+0000","last_became_active":"2023-11-04T01:38:00.708159+0000","last_became_peered":"2023-11-04T01:38:00.708159+0000","last_unstale":"2023-11-04T01:39:51.101278+0000","last_undegraded":"2023-11-04T01:39:51.101278+0000","last_fullsized":"2023-11-04T01:39:51.101278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000435213,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114638+0000","last_change":"2023-11-04T01:39:52.111776+0000","last_active":"2023-11-04T01:39:52.114638+0000","last_peered":"2023-11-04T01:39:52.114638+0000","last_clean":"2023-11-04T01:39:52.114638+0000","last_became_active":"2023-11-04T01:39:52.111487+0000","last_became_peered":"2023-11-04T01:39:52.111487+0000","last_unstale":"2023-11-04T01:39:52.114638+0000","last_undegraded":"2023-11-04T01:39:52.114638+0000","last_fullsized":"2023-11-04T01:39:52.114638+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:12:59.990159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.124928+0000","last_change":"2023-11-04T01:39:51.110923+0000","last_active":"2023-11-04T01:39:52.124928+0000","last_peered":"2023-11-04T01:39:52.124928+0000","last_clean":"2023-11-04T01:39:52.124928+0000","last_became_active":"2023-11-04T01:39:51.110590+0000","last_became_peered":"2023-11-04T01:39:51.110590+0000","last_unstale":"2023-11-04T01:39:52.124928+0000","last_undegraded":"2023-11-04T01:39:52.124928+0000","last_fullsized":"2023-11-04T01:39:52.124928+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:34:21.864532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099491+0000","last_change":"2023-11-04T01:39:00.902826+0000","last_active":"2023-11-04T01:39:51.099491+0000","last_peered":"2023-11-04T01:39:51.099491+0000","last_clean":"2023-11-04T01:39:51.099491+0000","last_became_active":"2023-11-04T01:39:00.902547+0000","last_became_peered":"2023-11-04T01:39:00.902547+0000","last_unstale":"2023-11-04T01:39:51.099491+0000","last_undegraded":"2023-11-04T01:39:51.099491+0000","last_fullsized":"2023-11-04T01:39:51.099491+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:54:08.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096743+0000","last_change":"2023-11-04T01:39:01.899633+0000","last_active":"2023-11-04T01:39:51.096743+0000","last_peered":"2023-11-04T01:39:51.096743+0000","last_clean":"2023-11-04T01:39:51.096743+0000","last_became_active":"2023-11-04T01:38:59.897690+0000","last_became_peered":"2023-11-04T01:38:59.897690+0000","last_unstale":"2023-11-04T01:39:51.096743+0000","last_undegraded":"2023-11-04T01:39:51.096743+0000","last_fullsized":"2023-11-04T01:39:51.096743+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:48.990734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069036800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103578+0000","last_change":"2023-11-04T01:38:02.362289+0000","last_active":"2023-11-04T01:39:51.103578+0000","last_peered":"2023-11-04T01:39:51.103578+0000","last_clean":"2023-11-04T01:39:51.103578+0000","last_became_active":"2023-11-04T01:38:00.710033+0000","last_became_peered":"2023-11-04T01:38:00.710033+0000","last_unstale":"2023-11-04T01:39:51.103578+0000","last_undegraded":"2023-11-04T01:39:51.103578+0000","last_fullsized":"2023-11-04T01:39:51.103578+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046467500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.118940+0000","last_change":"2023-11-04T01:39:52.117326+0000","last_active":"2023-11-04T01:39:52.118940+0000","last_peered":"2023-11-04T01:39:52.118940+0000","last_clean":"2023-11-04T01:39:52.118940+0000","last_became_active":"2023-11-04T01:39:52.117093+0000","last_became_peered":"2023-11-04T01:39:52.117093+0000","last_unstale":"2023-11-04T01:39:52.118940+0000","last_undegraded":"2023-11-04T01:39:52.118940+0000","last_fullsized":"2023-11-04T01:39:52.118940+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:57:15.655447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.103240+0000","last_change":"2023-11-04T01:39:51.107281+0000","last_active":"2023-11-04T01:39:52.103240+0000","last_peered":"2023-11-04T01:39:52.103240+0000","last_clean":"2023-11-04T01:39:52.103240+0000","last_became_active":"2023-11-04T01:39:51.106854+0000","last_became_peered":"2023-11-04T01:39:51.106854+0000","last_unstale":"2023-11-04T01:39:52.103240+0000","last_undegraded":"2023-11-04T01:39:52.103240+0000","last_fullsized":"2023-11-04T01:39:52.103240+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:15.533226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097517+0000","last_change":"2023-11-04T01:39:00.905727+0000","last_active":"2023-11-04T01:39:51.097517+0000","last_peered":"2023-11-04T01:39:51.097517+0000","last_clean":"2023-11-04T01:39:51.097517+0000","last_became_active":"2023-11-04T01:39:00.905379+0000","last_became_peered":"2023-11-04T01:39:00.905379+0000","last_unstale":"2023-11-04T01:39:51.097517+0000","last_undegraded":"2023-11-04T01:39:51.097517+0000","last_fullsized":"2023-11-04T01:39:51.097517+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:08.595749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103386+0000","last_change":"2023-11-04T01:39:02.289546+0000","last_active":"2023-11-04T01:39:51.103386+0000","last_peered":"2023-11-04T01:39:51.103386+0000","last_clean":"2023-11-04T01:39:51.103386+0000","last_became_active":"2023-11-04T01:38:59.894387+0000","last_became_peered":"2023-11-04T01:38:59.894387+0000","last_unstale":"2023-11-04T01:39:51.103386+0000","last_undegraded":"2023-11-04T01:39:51.103386+0000","last_fullsized":"2023-11-04T01:39:51.103386+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:12.983159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075893499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097333+0000","last_change":"2023-11-04T01:38:01.699171+0000","last_active":"2023-11-04T01:39:51.097333+0000","last_peered":"2023-11-04T01:39:51.097333+0000","last_clean":"2023-11-04T01:39:51.097333+0000","last_became_active":"2023-11-04T01:38:00.703927+0000","last_became_peered":"2023-11-04T01:38:00.703927+0000","last_unstale":"2023-11-04T01:39:51.097333+0000","last_undegraded":"2023-11-04T01:39:51.097333+0000","last_fullsized":"2023-11-04T01:39:51.097333+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072585499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.113384+0000","last_change":"2023-11-04T01:39:52.110164+0000","last_active":"2023-11-04T01:39:52.113384+0000","last_peered":"2023-11-04T01:39:52.113384+0000","last_clean":"2023-11-04T01:39:52.113384+0000","last_became_active":"2023-11-04T01:39:52.109803+0000","last_became_peered":"2023-11-04T01:39:52.109803+0000","last_unstale":"2023-11-04T01:39:52.113384+0000","last_undegraded":"2023-11-04T01:39:52.113384+0000","last_fullsized":"2023-11-04T01:39:52.113384+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:45.051199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.096252+0000","last_change":"2023-11-04T01:39:51.109382+0000","last_active":"2023-11-04T01:39:52.096252+0000","last_peered":"2023-11-04T01:39:52.096252+0000","last_clean":"2023-11-04T01:39:52.096252+0000","last_became_active":"2023-11-04T01:39:51.109126+0000","last_became_peered":"2023-11-04T01:39:51.109126+0000","last_unstale":"2023-11-04T01:39:52.096252+0000","last_undegraded":"2023-11-04T01:39:52.096252+0000","last_fullsized":"2023-11-04T01:39:52.096252+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:45.080459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103323+0000","last_change":"2023-11-04T01:39:00.907431+0000","last_active":"2023-11-04T01:39:51.103323+0000","last_peered":"2023-11-04T01:39:51.103323+0000","last_clean":"2023-11-04T01:39:51.103323+0000","last_became_active":"2023-11-04T01:39:00.907108+0000","last_became_peered":"2023-11-04T01:39:00.907108+0000","last_unstale":"2023-11-04T01:39:51.103323+0000","last_undegraded":"2023-11-04T01:39:51.103323+0000","last_fullsized":"2023-11-04T01:39:51.103323+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:19.094868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096329+0000","last_change":"2023-11-04T01:39:01.898969+0000","last_active":"2023-11-04T01:39:51.096329+0000","last_peered":"2023-11-04T01:39:51.096329+0000","last_clean":"2023-11-04T01:39:51.096329+0000","last_became_active":"2023-11-04T01:38:59.890578+0000","last_became_peered":"2023-11-04T01:38:59.890578+0000","last_unstale":"2023-11-04T01:39:51.096329+0000","last_undegraded":"2023-11-04T01:39:51.096329+0000","last_fullsized":"2023-11-04T01:39:51.096329+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:55.167791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073951900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097426+0000","last_change":"2023-11-04T01:38:02.156160+0000","last_active":"2023-11-04T01:39:51.097426+0000","last_peered":"2023-11-04T01:39:51.097426+0000","last_clean":"2023-11-04T01:39:51.097426+0000","last_became_active":"2023-11-04T01:38:00.709137+0000","last_became_peered":"2023-11-04T01:38:00.709137+0000","last_unstale":"2023-11-04T01:39:51.097426+0000","last_undegraded":"2023-11-04T01:39:51.097426+0000","last_fullsized":"2023-11-04T01:39:51.097426+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028239399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.116404+0000","last_change":"2023-11-04T01:39:52.114057+0000","last_active":"2023-11-04T01:39:52.116404+0000","last_peered":"2023-11-04T01:39:52.116404+0000","last_clean":"2023-11-04T01:39:52.116404+0000","last_became_active":"2023-11-04T01:39:52.113479+0000","last_became_peered":"2023-11-04T01:39:52.113479+0000","last_unstale":"2023-11-04T01:39:52.116404+0000","last_undegraded":"2023-11-04T01:39:52.116404+0000","last_fullsized":"2023-11-04T01:39:52.116404+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:43.747865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.124387+0000","last_change":"2023-11-04T01:39:51.107732+0000","last_active":"2023-11-04T01:39:52.124387+0000","last_peered":"2023-11-04T01:39:52.124387+0000","last_clean":"2023-11-04T01:39:52.124387+0000","last_became_active":"2023-11-04T01:39:51.107483+0000","last_became_peered":"2023-11-04T01:39:51.107483+0000","last_unstale":"2023-11-04T01:39:52.124387+0000","last_undegraded":"2023-11-04T01:39:52.124387+0000","last_fullsized":"2023-11-04T01:39:52.124387+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:21.123314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094525+0000","last_change":"2023-11-04T01:39:00.905486+0000","last_active":"2023-11-04T01:39:51.094525+0000","last_peered":"2023-11-04T01:39:51.094525+0000","last_clean":"2023-11-04T01:39:51.094525+0000","last_became_active":"2023-11-04T01:39:00.905221+0000","last_became_peered":"2023-11-04T01:39:00.905221+0000","last_unstale":"2023-11-04T01:39:51.094525+0000","last_undegraded":"2023-11-04T01:39:51.094525+0000","last_fullsized":"2023-11-04T01:39:51.094525+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:16.807464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098973+0000","last_change":"2023-11-04T01:39:02.039221+0000","last_active":"2023-11-04T01:39:51.098973+0000","last_peered":"2023-11-04T01:39:51.098973+0000","last_clean":"2023-11-04T01:39:51.098973+0000","last_became_active":"2023-11-04T01:38:59.897804+0000","last_became_peered":"2023-11-04T01:38:59.897804+0000","last_unstale":"2023-11-04T01:39:51.098973+0000","last_undegraded":"2023-11-04T01:39:51.098973+0000","last_fullsized":"2023-11-04T01:39:51.098973+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:38:29.900299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038141100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.095167+0000","last_change":"2023-11-04T01:38:01.698196+0000","last_active":"2023-11-04T01:39:51.095167+0000","last_peered":"2023-11-04T01:39:51.095167+0000","last_clean":"2023-11-04T01:39:51.095167+0000","last_became_active":"2023-11-04T01:38:00.705451+0000","last_became_peered":"2023-11-04T01:38:00.705451+0000","last_unstale":"2023-11-04T01:39:51.095167+0000","last_undegraded":"2023-11-04T01:39:51.095167+0000","last_fullsized":"2023-11-04T01:39:51.095167+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:16.759249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067668100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.123044+0000","last_change":"2023-11-04T01:39:52.117642+0000","last_active":"2023-11-04T01:39:52.123044+0000","last_peered":"2023-11-04T01:39:52.123044+0000","last_clean":"2023-11-04T01:39:52.123044+0000","last_became_active":"2023-11-04T01:39:52.117316+0000","last_became_peered":"2023-11-04T01:39:52.117316+0000","last_unstale":"2023-11-04T01:39:52.123044+0000","last_undegraded":"2023-11-04T01:39:52.123044+0000","last_fullsized":"2023-11-04T01:39:52.123044+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:32.022130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.127676+0000","last_change":"2023-11-04T01:39:51.109842+0000","last_active":"2023-11-04T01:39:52.127676+0000","last_peered":"2023-11-04T01:39:52.127676+0000","last_clean":"2023-11-04T01:39:52.127676+0000","last_became_active":"2023-11-04T01:39:51.108271+0000","last_became_peered":"2023-11-04T01:39:51.108271+0000","last_unstale":"2023-11-04T01:39:52.127676+0000","last_undegraded":"2023-11-04T01:39:52.127676+0000","last_fullsized":"2023-11-04T01:39:52.127676+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:10.240859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098596+0000","last_change":"2023-11-04T01:39:00.901434+0000","last_active":"2023-11-04T01:39:51.098596+0000","last_peered":"2023-11-04T01:39:51.098596+0000","last_clean":"2023-11-04T01:39:51.098596+0000","last_became_active":"2023-11-04T01:39:00.901094+0000","last_became_peered":"2023-11-04T01:39:00.901094+0000","last_unstale":"2023-11-04T01:39:51.098596+0000","last_undegraded":"2023-11-04T01:39:51.098596+0000","last_fullsized":"2023-11-04T01:39:51.098596+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:56:48.965289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.102171+0000","last_change":"2023-11-04T01:39:02.371687+0000","last_active":"2023-11-04T01:39:51.102171+0000","last_peered":"2023-11-04T01:39:51.102171+0000","last_clean":"2023-11-04T01:39:51.102171+0000","last_became_active":"2023-11-04T01:38:59.888782+0000","last_became_peered":"2023-11-04T01:38:59.888782+0000","last_unstale":"2023-11-04T01:39:51.102171+0000","last_undegraded":"2023-11-04T01:39:51.102171+0000","last_fullsized":"2023-11-04T01:39:51.102171+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:34.092676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088740800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.102678+0000","last_change":"2023-11-04T01:38:01.983991+0000","last_active":"2023-11-04T01:39:51.102678+0000","last_peered":"2023-11-04T01:39:51.102678+0000","last_clean":"2023-11-04T01:39:51.102678+0000","last_became_active":"2023-11-04T01:38:00.708462+0000","last_became_peered":"2023-11-04T01:38:00.708462+0000","last_unstale":"2023-11-04T01:39:51.102678+0000","last_undegraded":"2023-11-04T01:39:51.102678+0000","last_fullsized":"2023-11-04T01:39:51.102678+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:37.727651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041811600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.110822+0000","last_change":"2023-11-04T01:39:52.106556+0000","last_active":"2023-11-04T01:39:52.110822+0000","last_peered":"2023-11-04T01:39:52.110822+0000","last_clean":"2023-11-04T01:39:52.110822+0000","last_became_active":"2023-11-04T01:39:52.106298+0000","last_became_peered":"2023-11-04T01:39:52.106298+0000","last_unstale":"2023-11-04T01:39:52.110822+0000","last_undegraded":"2023-11-04T01:39:52.110822+0000","last_fullsized":"2023-11-04T01:39:52.110822+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:21.807476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.103351+0000","last_change":"2023-11-04T01:39:51.114155+0000","last_active":"2023-11-04T01:39:52.103351+0000","last_peered":"2023-11-04T01:39:52.103351+0000","last_clean":"2023-11-04T01:39:52.103351+0000","last_became_active":"2023-11-04T01:39:51.113882+0000","last_became_peered":"2023-11-04T01:39:51.113882+0000","last_unstale":"2023-11-04T01:39:52.103351+0000","last_undegraded":"2023-11-04T01:39:52.103351+0000","last_fullsized":"2023-11-04T01:39:52.103351+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:25.133938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096648+0000","last_change":"2023-11-04T01:39:00.907664+0000","last_active":"2023-11-04T01:39:51.096648+0000","last_peered":"2023-11-04T01:39:51.096648+0000","last_clean":"2023-11-04T01:39:51.096648+0000","last_became_active":"2023-11-04T01:39:00.907098+0000","last_became_peered":"2023-11-04T01:39:00.907098+0000","last_unstale":"2023-11-04T01:39:51.096648+0000","last_undegraded":"2023-11-04T01:39:51.096648+0000","last_fullsized":"2023-11-04T01:39:51.096648+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:43:34.994912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.102608+0000","last_change":"2023-11-04T01:39:02.076144+0000","last_active":"2023-11-04T01:39:51.102608+0000","last_peered":"2023-11-04T01:39:51.102608+0000","last_clean":"2023-11-04T01:39:51.102608+0000","last_became_active":"2023-11-04T01:38:59.891521+0000","last_became_peered":"2023-11-04T01:38:59.891521+0000","last_unstale":"2023-11-04T01:39:51.102608+0000","last_undegraded":"2023-11-04T01:39:51.102608+0000","last_fullsized":"2023-11-04T01:39:51.102608+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:24.449921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063833,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099581+0000","last_change":"2023-11-04T01:38:01.984341+0000","last_active":"2023-11-04T01:39:51.099581+0000","last_peered":"2023-11-04T01:39:51.099581+0000","last_clean":"2023-11-04T01:39:51.099581+0000","last_became_active":"2023-11-04T01:38:00.708307+0000","last_became_peered":"2023-11-04T01:38:00.708307+0000","last_unstale":"2023-11-04T01:39:51.099581+0000","last_undegraded":"2023-11-04T01:39:51.099581+0000","last_fullsized":"2023-11-04T01:39:51.099581+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:17.369098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053627199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.115173+0000","last_change":"2023-11-04T01:39:52.113243+0000","last_active":"2023-11-04T01:39:52.115173+0000","last_peered":"2023-11-04T01:39:52.115173+0000","last_clean":"2023-11-04T01:39:52.115173+0000","last_became_active":"2023-11-04T01:39:52.112968+0000","last_became_peered":"2023-11-04T01:39:52.112968+0000","last_unstale":"2023-11-04T01:39:52.115173+0000","last_undegraded":"2023-11-04T01:39:52.115173+0000","last_fullsized":"2023-11-04T01:39:52.115173+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:24.650364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.122761+0000","last_change":"2023-11-04T01:39:51.104089+0000","last_active":"2023-11-04T01:39:52.122761+0000","last_peered":"2023-11-04T01:39:52.122761+0000","last_clean":"2023-11-04T01:39:52.122761+0000","last_became_active":"2023-11-04T01:39:51.103781+0000","last_became_peered":"2023-11-04T01:39:51.103781+0000","last_unstale":"2023-11-04T01:39:52.122761+0000","last_undegraded":"2023-11-04T01:39:52.122761+0000","last_fullsized":"2023-11-04T01:39:52.122761+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:23.646770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096156+0000","last_change":"2023-11-04T01:39:00.905352+0000","last_active":"2023-11-04T01:39:51.096156+0000","last_peered":"2023-11-04T01:39:51.096156+0000","last_clean":"2023-11-04T01:39:51.096156+0000","last_became_active":"2023-11-04T01:39:00.905058+0000","last_became_peered":"2023-11-04T01:39:00.905058+0000","last_unstale":"2023-11-04T01:39:51.096156+0000","last_undegraded":"2023-11-04T01:39:51.096156+0000","last_fullsized":"2023-11-04T01:39:51.096156+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:37.246937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103482+0000","last_change":"2023-11-04T01:39:02.289522+0000","last_active":"2023-11-04T01:39:51.103482+0000","last_peered":"2023-11-04T01:39:51.103482+0000","last_clean":"2023-11-04T01:39:51.103482+0000","last_became_active":"2023-11-04T01:38:59.887549+0000","last_became_peered":"2023-11-04T01:38:59.887549+0000","last_unstale":"2023-11-04T01:39:51.103482+0000","last_undegraded":"2023-11-04T01:39:51.103482+0000","last_fullsized":"2023-11-04T01:39:51.103482+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:13.888718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077706800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":67,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099115+0000","last_change":"2023-11-04T01:38:01.700471+0000","last_active":"2023-11-04T01:39:51.099115+0000","last_peered":"2023-11-04T01:39:51.099115+0000","last_clean":"2023-11-04T01:39:51.099115+0000","last_became_active":"2023-11-04T01:38:00.702522+0000","last_became_peered":"2023-11-04T01:38:00.702522+0000","last_unstale":"2023-11-04T01:39:51.099115+0000","last_undegraded":"2023-11-04T01:39:51.099115+0000","last_fullsized":"2023-11-04T01:39:51.099115+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086940300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114561+0000","last_change":"2023-11-04T01:39:52.110142+0000","last_active":"2023-11-04T01:39:52.114561+0000","last_peered":"2023-11-04T01:39:52.114561+0000","last_clean":"2023-11-04T01:39:52.114561+0000","last_became_active":"2023-11-04T01:39:52.109889+0000","last_became_peered":"2023-11-04T01:39:52.109889+0000","last_unstale":"2023-11-04T01:39:52.114561+0000","last_undegraded":"2023-11-04T01:39:52.114561+0000","last_fullsized":"2023-11-04T01:39:52.114561+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:25.481450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.096165+0000","last_change":"2023-11-04T01:39:51.111370+0000","last_active":"2023-11-04T01:39:52.096165+0000","last_peered":"2023-11-04T01:39:52.096165+0000","last_clean":"2023-11-04T01:39:52.096165+0000","last_became_active":"2023-11-04T01:39:51.111018+0000","last_became_peered":"2023-11-04T01:39:51.111018+0000","last_unstale":"2023-11-04T01:39:52.096165+0000","last_undegraded":"2023-11-04T01:39:52.096165+0000","last_fullsized":"2023-11-04T01:39:52.096165+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:02:34.970821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097644+0000","last_change":"2023-11-04T01:39:00.905889+0000","last_active":"2023-11-04T01:39:51.097644+0000","last_peered":"2023-11-04T01:39:51.097644+0000","last_clean":"2023-11-04T01:39:51.097644+0000","last_became_active":"2023-11-04T01:39:00.905644+0000","last_became_peered":"2023-11-04T01:39:00.905644+0000","last_unstale":"2023-11-04T01:39:51.097644+0000","last_undegraded":"2023-11-04T01:39:51.097644+0000","last_fullsized":"2023-11-04T01:39:51.097644+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:13.988639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097691+0000","last_change":"2023-11-04T01:39:01.897496+0000","last_active":"2023-11-04T01:39:51.097691+0000","last_peered":"2023-11-04T01:39:51.097691+0000","last_clean":"2023-11-04T01:39:51.097691+0000","last_became_active":"2023-11-04T01:38:59.894771+0000","last_became_peered":"2023-11-04T01:38:59.894771+0000","last_unstale":"2023-11-04T01:39:51.097691+0000","last_undegraded":"2023-11-04T01:39:51.097691+0000","last_fullsized":"2023-11-04T01:39:51.097691+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:50.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043645000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094849+0000","last_change":"2023-11-04T01:38:01.696901+0000","last_active":"2023-11-04T01:39:51.094849+0000","last_peered":"2023-11-04T01:39:51.094849+0000","last_clean":"2023-11-04T01:39:51.094849+0000","last_became_active":"2023-11-04T01:38:00.706170+0000","last_became_peered":"2023-11-04T01:38:00.706170+0000","last_unstale":"2023-11-04T01:39:51.094849+0000","last_undegraded":"2023-11-04T01:39:51.094849+0000","last_fullsized":"2023-11-04T01:39:51.094849+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059391100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114775+0000","last_change":"2023-11-04T01:39:52.112007+0000","last_active":"2023-11-04T01:39:52.114775+0000","last_peered":"2023-11-04T01:39:52.114775+0000","last_clean":"2023-11-04T01:39:52.114775+0000","last_became_active":"2023-11-04T01:39:52.111690+0000","last_became_peered":"2023-11-04T01:39:52.111690+0000","last_unstale":"2023-11-04T01:39:52.114775+0000","last_undegraded":"2023-11-04T01:39:52.114775+0000","last_fullsized":"2023-11-04T01:39:52.114775+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:15:53.823846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.103237+0000","last_change":"2023-11-04T01:39:51.108027+0000","last_active":"2023-11-04T01:39:52.103237+0000","last_peered":"2023-11-04T01:39:52.103237+0000","last_clean":"2023-11-04T01:39:52.103237+0000","last_became_active":"2023-11-04T01:39:51.107743+0000","last_became_peered":"2023-11-04T01:39:51.107743+0000","last_unstale":"2023-11-04T01:39:52.103237+0000","last_undegraded":"2023-11-04T01:39:52.103237+0000","last_fullsized":"2023-11-04T01:39:52.103237+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:52:35.877005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097529+0000","last_change":"2023-11-04T01:39:00.907377+0000","last_active":"2023-11-04T01:39:51.097529+0000","last_peered":"2023-11-04T01:39:51.097529+0000","last_clean":"2023-11-04T01:39:51.097529+0000","last_became_active":"2023-11-04T01:39:00.907059+0000","last_became_peered":"2023-11-04T01:39:00.907059+0000","last_unstale":"2023-11-04T01:39:51.097529+0000","last_undegraded":"2023-11-04T01:39:51.097529+0000","last_fullsized":"2023-11-04T01:39:51.097529+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:04.732051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096648+0000","last_change":"2023-11-04T01:39:01.899471+0000","last_active":"2023-11-04T01:39:51.096648+0000","last_peered":"2023-11-04T01:39:51.096648+0000","last_clean":"2023-11-04T01:39:51.096648+0000","last_became_active":"2023-11-04T01:38:59.893689+0000","last_became_peered":"2023-11-04T01:38:59.893689+0000","last_unstale":"2023-11-04T01:39:51.096648+0000","last_undegraded":"2023-11-04T01:39:51.096648+0000","last_fullsized":"2023-11-04T01:39:51.096648+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:36.506018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072622699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099980+0000","last_change":"2023-11-04T01:38:01.939972+0000","last_active":"2023-11-04T01:39:51.099980+0000","last_peered":"2023-11-04T01:39:51.099980+0000","last_clean":"2023-11-04T01:39:51.099980+0000","last_became_active":"2023-11-04T01:38:00.702784+0000","last_became_peered":"2023-11-04T01:38:00.702784+0000","last_unstale":"2023-11-04T01:39:51.099980+0000","last_undegraded":"2023-11-04T01:39:51.099980+0000","last_fullsized":"2023-11-04T01:39:51.099980+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:26.760402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071328600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.119651+0000","last_change":"2023-11-04T01:39:52.113911+0000","last_active":"2023-11-04T01:39:52.119651+0000","last_peered":"2023-11-04T01:39:52.119651+0000","last_clean":"2023-11-04T01:39:52.119651+0000","last_became_active":"2023-11-04T01:39:52.112692+0000","last_became_peered":"2023-11-04T01:39:52.112692+0000","last_unstale":"2023-11-04T01:39:52.119651+0000","last_undegraded":"2023-11-04T01:39:52.119651+0000","last_fullsized":"2023-11-04T01:39:52.119651+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:54.673777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.103390+0000","last_change":"2023-11-04T01:39:51.107113+0000","last_active":"2023-11-04T01:39:52.103390+0000","last_peered":"2023-11-04T01:39:52.103390+0000","last_clean":"2023-11-04T01:39:52.103390+0000","last_became_active":"2023-11-04T01:39:51.106188+0000","last_became_peered":"2023-11-04T01:39:51.106188+0000","last_unstale":"2023-11-04T01:39:52.103390+0000","last_undegraded":"2023-11-04T01:39:52.103390+0000","last_fullsized":"2023-11-04T01:39:52.103390+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:13:00.493080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094702+0000","last_change":"2023-11-04T01:39:00.901301+0000","last_active":"2023-11-04T01:39:51.094702+0000","last_peered":"2023-11-04T01:39:51.094702+0000","last_clean":"2023-11-04T01:39:51.094702+0000","last_became_active":"2023-11-04T01:39:00.901087+0000","last_became_peered":"2023-11-04T01:39:00.901087+0000","last_unstale":"2023-11-04T01:39:51.094702+0000","last_undegraded":"2023-11-04T01:39:51.094702+0000","last_fullsized":"2023-11-04T01:39:51.094702+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:07.192076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103451+0000","last_change":"2023-11-04T01:39:02.076926+0000","last_active":"2023-11-04T01:39:51.103451+0000","last_peered":"2023-11-04T01:39:51.103451+0000","last_clean":"2023-11-04T01:39:51.103451+0000","last_became_active":"2023-11-04T01:38:59.897799+0000","last_became_peered":"2023-11-04T01:38:59.897799+0000","last_unstale":"2023-11-04T01:39:51.103451+0000","last_undegraded":"2023-11-04T01:39:51.103451+0000","last_fullsized":"2023-11-04T01:39:51.103451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:06.186596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051016799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.095762+0000","last_change":"2023-11-04T01:38:01.699051+0000","last_active":"2023-11-04T01:39:51.095762+0000","last_peered":"2023-11-04T01:39:51.095762+0000","last_clean":"2023-11-04T01:39:51.095762+0000","last_became_active":"2023-11-04T01:38:00.708665+0000","last_became_peered":"2023-11-04T01:38:00.708665+0000","last_unstale":"2023-11-04T01:39:51.095762+0000","last_undegraded":"2023-11-04T01:39:51.095762+0000","last_fullsized":"2023-11-04T01:39:51.095762+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020995580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.113407+0000","last_change":"2023-11-04T01:39:52.110413+0000","last_active":"2023-11-04T01:39:52.113407+0000","last_peered":"2023-11-04T01:39:52.113407+0000","last_clean":"2023-11-04T01:39:52.113407+0000","last_became_active":"2023-11-04T01:39:52.110154+0000","last_became_peered":"2023-11-04T01:39:52.110154+0000","last_unstale":"2023-11-04T01:39:52.113407+0000","last_undegraded":"2023-11-04T01:39:52.113407+0000","last_fullsized":"2023-11-04T01:39:52.113407+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:19:10.300256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.092899+0000","last_change":"2023-11-04T01:39:51.111510+0000","last_active":"2023-11-04T01:39:52.092899+0000","last_peered":"2023-11-04T01:39:52.092899+0000","last_clean":"2023-11-04T01:39:52.092899+0000","last_became_active":"2023-11-04T01:39:51.111266+0000","last_became_peered":"2023-11-04T01:39:51.111266+0000","last_unstale":"2023-11-04T01:39:52.092899+0000","last_undegraded":"2023-11-04T01:39:52.092899+0000","last_fullsized":"2023-11-04T01:39:52.092899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:33.675495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096961+0000","last_change":"2023-11-04T01:39:00.903233+0000","last_active":"2023-11-04T01:39:51.096961+0000","last_peered":"2023-11-04T01:39:51.096961+0000","last_clean":"2023-11-04T01:39:51.096961+0000","last_became_active":"2023-11-04T01:39:00.902913+0000","last_became_peered":"2023-11-04T01:39:00.902913+0000","last_unstale":"2023-11-04T01:39:51.096961+0000","last_undegraded":"2023-11-04T01:39:51.096961+0000","last_fullsized":"2023-11-04T01:39:51.096961+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:29.058403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103243+0000","last_change":"2023-11-04T01:39:02.076853+0000","last_active":"2023-11-04T01:39:51.103243+0000","last_peered":"2023-11-04T01:39:51.103243+0000","last_clean":"2023-11-04T01:39:51.103243+0000","last_became_active":"2023-11-04T01:38:59.898310+0000","last_became_peered":"2023-11-04T01:38:59.898310+0000","last_unstale":"2023-11-04T01:39:51.103243+0000","last_undegraded":"2023-11-04T01:39:51.103243+0000","last_fullsized":"2023-11-04T01:39:51.103243+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:22.196883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066256699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":67,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097782+0000","last_change":"2023-11-04T01:38:01.700742+0000","last_active":"2023-11-04T01:39:51.097782+0000","last_peered":"2023-11-04T01:39:51.097782+0000","last_clean":"2023-11-04T01:39:51.097782+0000","last_became_active":"2023-11-04T01:38:00.706671+0000","last_became_peered":"2023-11-04T01:38:00.706671+0000","last_unstale":"2023-11-04T01:39:51.097782+0000","last_undegraded":"2023-11-04T01:39:51.097782+0000","last_fullsized":"2023-11-04T01:39:51.097782+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072370699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.118867+0000","last_change":"2023-11-04T01:39:52.112329+0000","last_active":"2023-11-04T01:39:52.118867+0000","last_peered":"2023-11-04T01:39:52.118867+0000","last_clean":"2023-11-04T01:39:52.118867+0000","last_became_active":"2023-11-04T01:39:52.112058+0000","last_became_peered":"2023-11-04T01:39:52.112058+0000","last_unstale":"2023-11-04T01:39:52.118867+0000","last_undegraded":"2023-11-04T01:39:52.118867+0000","last_fullsized":"2023-11-04T01:39:52.118867+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:57.869838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.097084+0000","last_change":"2023-11-04T01:39:51.106435+0000","last_active":"2023-11-04T01:39:52.097084+0000","last_peered":"2023-11-04T01:39:52.097084+0000","last_clean":"2023-11-04T01:39:52.097084+0000","last_became_active":"2023-11-04T01:39:51.106166+0000","last_became_peered":"2023-11-04T01:39:51.106166+0000","last_unstale":"2023-11-04T01:39:52.097084+0000","last_undegraded":"2023-11-04T01:39:52.097084+0000","last_fullsized":"2023-11-04T01:39:52.097084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:29.834255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.101293+0000","last_change":"2023-11-04T01:39:00.902537+0000","last_active":"2023-11-04T01:39:51.101293+0000","last_peered":"2023-11-04T01:39:51.101293+0000","last_clean":"2023-11-04T01:39:51.101293+0000","last_became_active":"2023-11-04T01:39:00.902217+0000","last_became_peered":"2023-11-04T01:39:00.902217+0000","last_unstale":"2023-11-04T01:39:51.101293+0000","last_undegraded":"2023-11-04T01:39:51.101293+0000","last_fullsized":"2023-11-04T01:39:51.101293+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:56.622252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098972+0000","last_change":"2023-11-04T01:39:01.896481+0000","last_active":"2023-11-04T01:39:51.098972+0000","last_peered":"2023-11-04T01:39:51.098972+0000","last_clean":"2023-11-04T01:39:51.098972+0000","last_became_active":"2023-11-04T01:38:59.897511+0000","last_became_peered":"2023-11-04T01:38:59.897511+0000","last_unstale":"2023-11-04T01:39:51.098972+0000","last_undegraded":"2023-11-04T01:39:51.098972+0000","last_fullsized":"2023-11-04T01:39:51.098972+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:31.015230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001138319,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094638+0000","last_change":"2023-11-04T01:38:01.697526+0000","last_active":"2023-11-04T01:39:51.094638+0000","last_peered":"2023-11-04T01:39:51.094638+0000","last_clean":"2023-11-04T01:39:51.094638+0000","last_became_active":"2023-11-04T01:38:00.707580+0000","last_became_peered":"2023-11-04T01:38:00.707580+0000","last_unstale":"2023-11-04T01:39:51.094638+0000","last_undegraded":"2023-11-04T01:39:51.094638+0000","last_fullsized":"2023-11-04T01:39:51.094638+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010806699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.115439+0000","last_change":"2023-11-04T01:39:52.114088+0000","last_active":"2023-11-04T01:39:52.115439+0000","last_peered":"2023-11-04T01:39:52.115439+0000","last_clean":"2023-11-04T01:39:52.115439+0000","last_became_active":"2023-11-04T01:39:52.113835+0000","last_became_peered":"2023-11-04T01:39:52.113835+0000","last_unstale":"2023-11-04T01:39:52.115439+0000","last_undegraded":"2023-11-04T01:39:52.115439+0000","last_fullsized":"2023-11-04T01:39:52.115439+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:59.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.125410+0000","last_change":"2023-11-04T01:39:51.114069+0000","last_active":"2023-11-04T01:39:52.125410+0000","last_peered":"2023-11-04T01:39:52.125410+0000","last_clean":"2023-11-04T01:39:52.125410+0000","last_became_active":"2023-11-04T01:39:51.113801+0000","last_became_peered":"2023-11-04T01:39:51.113801+0000","last_unstale":"2023-11-04T01:39:52.125410+0000","last_undegraded":"2023-11-04T01:39:52.125410+0000","last_fullsized":"2023-11-04T01:39:52.125410+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:20.803882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096823+0000","last_change":"2023-11-04T01:39:00.905358+0000","last_active":"2023-11-04T01:39:51.096823+0000","last_peered":"2023-11-04T01:39:51.096823+0000","last_clean":"2023-11-04T01:39:51.096823+0000","last_became_active":"2023-11-04T01:39:00.905066+0000","last_became_peered":"2023-11-04T01:39:00.905066+0000","last_unstale":"2023-11-04T01:39:51.096823+0000","last_undegraded":"2023-11-04T01:39:51.096823+0000","last_fullsized":"2023-11-04T01:39:51.096823+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:23.606563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.101368+0000","last_change":"2023-11-04T01:39:01.897060+0000","last_active":"2023-11-04T01:39:51.101368+0000","last_peered":"2023-11-04T01:39:51.101368+0000","last_clean":"2023-11-04T01:39:51.101368+0000","last_became_active":"2023-11-04T01:38:59.888827+0000","last_became_peered":"2023-11-04T01:38:59.888827+0000","last_unstale":"2023-11-04T01:39:51.101368+0000","last_undegraded":"2023-11-04T01:39:51.101368+0000","last_fullsized":"2023-11-04T01:39:51.101368+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:52:14.150104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000963042,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098130+0000","last_change":"2023-11-04T01:38:01.939462+0000","last_active":"2023-11-04T01:39:51.098130+0000","last_peered":"2023-11-04T01:39:51.098130+0000","last_clean":"2023-11-04T01:39:51.098130+0000","last_became_active":"2023-11-04T01:38:00.705830+0000","last_became_peered":"2023-11-04T01:38:00.705830+0000","last_unstale":"2023-11-04T01:39:51.098130+0000","last_undegraded":"2023-11-04T01:39:51.098130+0000","last_fullsized":"2023-11-04T01:39:51.098130+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059305000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.115409+0000","last_change":"2023-11-04T01:39:52.113522+0000","last_active":"2023-11-04T01:39:52.115409+0000","last_peered":"2023-11-04T01:39:52.115409+0000","last_clean":"2023-11-04T01:39:52.115409+0000","last_became_active":"2023-11-04T01:39:52.113254+0000","last_became_peered":"2023-11-04T01:39:52.113254+0000","last_unstale":"2023-11-04T01:39:52.115409+0000","last_undegraded":"2023-11-04T01:39:52.115409+0000","last_fullsized":"2023-11-04T01:39:52.115409+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:50.708519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.098207+0000","last_change":"2023-11-04T01:39:51.113329+0000","last_active":"2023-11-04T01:39:52.098207+0000","last_peered":"2023-11-04T01:39:52.098207+0000","last_clean":"2023-11-04T01:39:52.098207+0000","last_became_active":"2023-11-04T01:39:51.113056+0000","last_became_peered":"2023-11-04T01:39:51.113056+0000","last_unstale":"2023-11-04T01:39:52.098207+0000","last_undegraded":"2023-11-04T01:39:52.098207+0000","last_fullsized":"2023-11-04T01:39:52.098207+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:45.022331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098913+0000","last_change":"2023-11-04T01:39:00.898467+0000","last_active":"2023-11-04T01:39:51.098913+0000","last_peered":"2023-11-04T01:39:51.098913+0000","last_clean":"2023-11-04T01:39:51.098913+0000","last_became_active":"2023-11-04T01:39:00.898168+0000","last_became_peered":"2023-11-04T01:39:00.898168+0000","last_unstale":"2023-11-04T01:39:51.098913+0000","last_undegraded":"2023-11-04T01:39:51.098913+0000","last_fullsized":"2023-11-04T01:39:51.098913+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:03.950091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096225+0000","last_change":"2023-11-04T01:39:02.371405+0000","last_active":"2023-11-04T01:39:51.096225+0000","last_peered":"2023-11-04T01:39:51.096225+0000","last_clean":"2023-11-04T01:39:51.096225+0000","last_became_active":"2023-11-04T01:38:59.884832+0000","last_became_peered":"2023-11-04T01:38:59.884832+0000","last_unstale":"2023-11-04T01:39:51.096225+0000","last_undegraded":"2023-11-04T01:39:51.096225+0000","last_fullsized":"2023-11-04T01:39:51.096225+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:22.851162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00135917,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099649+0000","last_change":"2023-11-04T01:38:01.984456+0000","last_active":"2023-11-04T01:39:51.099649+0000","last_peered":"2023-11-04T01:39:51.099649+0000","last_clean":"2023-11-04T01:39:51.099649+0000","last_became_active":"2023-11-04T01:38:00.708803+0000","last_became_peered":"2023-11-04T01:38:00.708803+0000","last_unstale":"2023-11-04T01:39:51.099649+0000","last_undegraded":"2023-11-04T01:39:51.099649+0000","last_fullsized":"2023-11-04T01:39:51.099649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:30.811033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061551599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.119418+0000","last_change":"2023-11-04T01:39:52.113041+0000","last_active":"2023-11-04T01:39:52.119418+0000","last_peered":"2023-11-04T01:39:52.119418+0000","last_clean":"2023-11-04T01:39:52.119418+0000","last_became_active":"2023-11-04T01:39:52.112698+0000","last_became_peered":"2023-11-04T01:39:52.112698+0000","last_unstale":"2023-11-04T01:39:52.119418+0000","last_undegraded":"2023-11-04T01:39:52.119418+0000","last_fullsized":"2023-11-04T01:39:52.119418+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:55:22.716533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.106081+0000","last_change":"2023-11-04T01:39:51.107964+0000","last_active":"2023-11-04T01:39:52.106081+0000","last_peered":"2023-11-04T01:39:52.106081+0000","last_clean":"2023-11-04T01:39:52.106081+0000","last_became_active":"2023-11-04T01:39:51.107712+0000","last_became_peered":"2023-11-04T01:39:51.107712+0000","last_unstale":"2023-11-04T01:39:52.106081+0000","last_undegraded":"2023-11-04T01:39:52.106081+0000","last_fullsized":"2023-11-04T01:39:52.106081+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:55.322164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094459+0000","last_change":"2023-11-04T01:39:00.898232+0000","last_active":"2023-11-04T01:39:51.094459+0000","last_peered":"2023-11-04T01:39:51.094459+0000","last_clean":"2023-11-04T01:39:51.094459+0000","last_became_active":"2023-11-04T01:39:00.897953+0000","last_became_peered":"2023-11-04T01:39:00.897953+0000","last_unstale":"2023-11-04T01:39:51.094459+0000","last_undegraded":"2023-11-04T01:39:51.094459+0000","last_fullsized":"2023-11-04T01:39:51.094459+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:19.094868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096207+0000","last_change":"2023-11-04T01:39:02.076201+0000","last_active":"2023-11-04T01:39:51.096207+0000","last_peered":"2023-11-04T01:39:51.096207+0000","last_clean":"2023-11-04T01:39:51.096207+0000","last_became_active":"2023-11-04T01:38:59.885672+0000","last_became_peered":"2023-11-04T01:38:59.885672+0000","last_unstale":"2023-11-04T01:39:51.096207+0000","last_undegraded":"2023-11-04T01:39:51.096207+0000","last_fullsized":"2023-11-04T01:39:51.096207+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:15.425248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063733799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.095795+0000","last_change":"2023-11-04T01:38:01.698866+0000","last_active":"2023-11-04T01:39:51.095795+0000","last_peered":"2023-11-04T01:39:51.095795+0000","last_clean":"2023-11-04T01:39:51.095795+0000","last_became_active":"2023-11-04T01:38:00.706149+0000","last_became_peered":"2023-11-04T01:38:00.706149+0000","last_unstale":"2023-11-04T01:39:51.095795+0000","last_undegraded":"2023-11-04T01:39:51.095795+0000","last_fullsized":"2023-11-04T01:39:51.095795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:59.391683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001344154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114462+0000","last_change":"2023-11-04T01:39:52.109116+0000","last_active":"2023-11-04T01:39:52.114462+0000","last_peered":"2023-11-04T01:39:52.114462+0000","last_clean":"2023-11-04T01:39:52.114462+0000","last_became_active":"2023-11-04T01:39:52.108650+0000","last_became_peered":"2023-11-04T01:39:52.108650+0000","last_unstale":"2023-11-04T01:39:52.114462+0000","last_undegraded":"2023-11-04T01:39:52.114462+0000","last_fullsized":"2023-11-04T01:39:52.114462+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:28:56.522992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.122565+0000","last_change":"2023-11-04T01:39:51.107522+0000","last_active":"2023-11-04T01:39:52.122565+0000","last_peered":"2023-11-04T01:39:52.122565+0000","last_clean":"2023-11-04T01:39:52.122565+0000","last_became_active":"2023-11-04T01:39:51.107245+0000","last_became_peered":"2023-11-04T01:39:51.107245+0000","last_unstale":"2023-11-04T01:39:52.122565+0000","last_undegraded":"2023-11-04T01:39:52.122565+0000","last_fullsized":"2023-11-04T01:39:52.122565+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:53.670183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.095550+0000","last_change":"2023-11-04T01:39:00.907552+0000","last_active":"2023-11-04T01:39:51.095550+0000","last_peered":"2023-11-04T01:39:51.095550+0000","last_clean":"2023-11-04T01:39:51.095550+0000","last_became_active":"2023-11-04T01:39:00.907262+0000","last_became_peered":"2023-11-04T01:39:00.907262+0000","last_unstale":"2023-11-04T01:39:51.095550+0000","last_undegraded":"2023-11-04T01:39:51.095550+0000","last_fullsized":"2023-11-04T01:39:51.095550+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:23.202363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097359+0000","last_change":"2023-11-04T01:39:02.371758+0000","last_active":"2023-11-04T01:39:51.097359+0000","last_peered":"2023-11-04T01:39:51.097359+0000","last_clean":"2023-11-04T01:39:51.097359+0000","last_became_active":"2023-11-04T01:38:59.891579+0000","last_became_peered":"2023-11-04T01:38:59.891579+0000","last_unstale":"2023-11-04T01:39:51.097359+0000","last_undegraded":"2023-11-04T01:39:51.097359+0000","last_fullsized":"2023-11-04T01:39:51.097359+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:04:45.779183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063536799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096461+0000","last_change":"2023-11-04T01:38:01.699187+0000","last_active":"2023-11-04T01:39:51.096461+0000","last_peered":"2023-11-04T01:39:51.096461+0000","last_clean":"2023-11-04T01:39:51.096461+0000","last_became_active":"2023-11-04T01:38:00.706136+0000","last_became_peered":"2023-11-04T01:38:00.706136+0000","last_unstale":"2023-11-04T01:39:51.096461+0000","last_undegraded":"2023-11-04T01:39:51.096461+0000","last_fullsized":"2023-11-04T01:39:51.096461+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074666999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.120733+0000","last_change":"2023-11-04T01:39:52.115463+0000","last_active":"2023-11-04T01:39:52.120733+0000","last_peered":"2023-11-04T01:39:52.120733+0000","last_clean":"2023-11-04T01:39:52.120733+0000","last_became_active":"2023-11-04T01:39:52.115219+0000","last_became_peered":"2023-11-04T01:39:52.115219+0000","last_unstale":"2023-11-04T01:39:52.120733+0000","last_undegraded":"2023-11-04T01:39:52.120733+0000","last_fullsized":"2023-11-04T01:39:52.120733+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:01:02.592248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.123045+0000","last_change":"2023-11-04T01:39:51.111564+0000","last_active":"2023-11-04T01:39:52.123045+0000","last_peered":"2023-11-04T01:39:52.123045+0000","last_clean":"2023-11-04T01:39:52.123045+0000","last_became_active":"2023-11-04T01:39:51.111290+0000","last_became_peered":"2023-11-04T01:39:51.111290+0000","last_unstale":"2023-11-04T01:39:52.123045+0000","last_undegraded":"2023-11-04T01:39:52.123045+0000","last_fullsized":"2023-11-04T01:39:52.123045+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:05.903328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097611+0000","last_change":"2023-11-04T01:39:00.904464+0000","last_active":"2023-11-04T01:39:51.097611+0000","last_peered":"2023-11-04T01:39:51.097611+0000","last_clean":"2023-11-04T01:39:51.097611+0000","last_became_active":"2023-11-04T01:39:00.904172+0000","last_became_peered":"2023-11-04T01:39:00.904172+0000","last_unstale":"2023-11-04T01:39:51.097611+0000","last_undegraded":"2023-11-04T01:39:51.097611+0000","last_fullsized":"2023-11-04T01:39:51.097611+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:32.767818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.101820+0000","last_change":"2023-11-04T01:39:02.371427+0000","last_active":"2023-11-04T01:39:51.101820+0000","last_peered":"2023-11-04T01:39:51.101820+0000","last_clean":"2023-11-04T01:39:51.101820+0000","last_became_active":"2023-11-04T01:38:59.886795+0000","last_became_peered":"2023-11-04T01:38:59.886795+0000","last_unstale":"2023-11-04T01:39:51.101820+0000","last_undegraded":"2023-11-04T01:39:51.101820+0000","last_fullsized":"2023-11-04T01:39:51.101820+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:24:01.300866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082815500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097224+0000","last_change":"2023-11-04T01:38:01.699630+0000","last_active":"2023-11-04T01:39:51.097224+0000","last_peered":"2023-11-04T01:39:51.097224+0000","last_clean":"2023-11-04T01:39:51.097224+0000","last_became_active":"2023-11-04T01:38:00.702550+0000","last_became_peered":"2023-11-04T01:38:00.702550+0000","last_unstale":"2023-11-04T01:39:51.097224+0000","last_undegraded":"2023-11-04T01:39:51.097224+0000","last_fullsized":"2023-11-04T01:39:51.097224+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001016077,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.110468+0000","last_change":"2023-11-04T01:39:52.107600+0000","last_active":"2023-11-04T01:39:52.110468+0000","last_peered":"2023-11-04T01:39:52.110468+0000","last_clean":"2023-11-04T01:39:52.110468+0000","last_became_active":"2023-11-04T01:39:52.107205+0000","last_became_peered":"2023-11-04T01:39:52.107205+0000","last_unstale":"2023-11-04T01:39:52.110468+0000","last_undegraded":"2023-11-04T01:39:52.110468+0000","last_fullsized":"2023-11-04T01:39:52.110468+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:54.718426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.103531+0000","last_change":"2023-11-04T01:39:51.110482+0000","last_active":"2023-11-04T01:39:52.103531+0000","last_peered":"2023-11-04T01:39:52.103531+0000","last_clean":"2023-11-04T01:39:52.103531+0000","last_became_active":"2023-11-04T01:39:51.110230+0000","last_became_peered":"2023-11-04T01:39:51.110230+0000","last_unstale":"2023-11-04T01:39:52.103531+0000","last_undegraded":"2023-11-04T01:39:52.103531+0000","last_fullsized":"2023-11-04T01:39:52.103531+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:16.275046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097689+0000","last_change":"2023-11-04T01:39:00.905979+0000","last_active":"2023-11-04T01:39:51.097689+0000","last_peered":"2023-11-04T01:39:51.097689+0000","last_clean":"2023-11-04T01:39:51.097689+0000","last_became_active":"2023-11-04T01:39:00.905741+0000","last_became_peered":"2023-11-04T01:39:00.905741+0000","last_unstale":"2023-11-04T01:39:51.097689+0000","last_undegraded":"2023-11-04T01:39:51.097689+0000","last_fullsized":"2023-11-04T01:39:51.097689+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:29.058403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097082+0000","last_change":"2023-11-04T01:39:01.898934+0000","last_active":"2023-11-04T01:39:51.097082+0000","last_peered":"2023-11-04T01:39:51.097082+0000","last_clean":"2023-11-04T01:39:51.097082+0000","last_became_active":"2023-11-04T01:38:59.895023+0000","last_became_peered":"2023-11-04T01:38:59.895023+0000","last_unstale":"2023-11-04T01:39:51.097082+0000","last_undegraded":"2023-11-04T01:39:51.097082+0000","last_fullsized":"2023-11-04T01:39:51.097082+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:50.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091724099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103534+0000","last_change":"2023-11-04T01:38:01.984764+0000","last_active":"2023-11-04T01:39:51.103534+0000","last_peered":"2023-11-04T01:39:51.103534+0000","last_clean":"2023-11-04T01:39:51.103534+0000","last_became_active":"2023-11-04T01:38:00.709894+0000","last_became_peered":"2023-11-04T01:38:00.709894+0000","last_unstale":"2023-11-04T01:39:51.103534+0000","last_undegraded":"2023-11-04T01:39:51.103534+0000","last_fullsized":"2023-11-04T01:39:51.103534+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:08:42.829255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045046799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.119700+0000","last_change":"2023-11-04T01:39:52.113445+0000","last_active":"2023-11-04T01:39:52.119700+0000","last_peered":"2023-11-04T01:39:52.119700+0000","last_clean":"2023-11-04T01:39:52.119700+0000","last_became_active":"2023-11-04T01:39:52.113118+0000","last_became_peered":"2023-11-04T01:39:52.113118+0000","last_unstale":"2023-11-04T01:39:52.119700+0000","last_undegraded":"2023-11-04T01:39:52.119700+0000","last_fullsized":"2023-11-04T01:39:52.119700+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:01:07.632026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.094126+0000","last_change":"2023-11-04T01:39:51.107006+0000","last_active":"2023-11-04T01:39:52.094126+0000","last_peered":"2023-11-04T01:39:52.094126+0000","last_clean":"2023-11-04T01:39:52.094126+0000","last_became_active":"2023-11-04T01:39:51.106372+0000","last_became_peered":"2023-11-04T01:39:51.106372+0000","last_unstale":"2023-11-04T01:39:52.094126+0000","last_undegraded":"2023-11-04T01:39:52.094126+0000","last_fullsized":"2023-11-04T01:39:52.094126+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:43:08.727660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097156+0000","last_change":"2023-11-04T01:39:00.902634+0000","last_active":"2023-11-04T01:39:51.097156+0000","last_peered":"2023-11-04T01:39:51.097156+0000","last_clean":"2023-11-04T01:39:51.097156+0000","last_became_active":"2023-11-04T01:39:00.902174+0000","last_became_peered":"2023-11-04T01:39:00.902174+0000","last_unstale":"2023-11-04T01:39:51.097156+0000","last_undegraded":"2023-11-04T01:39:51.097156+0000","last_fullsized":"2023-11-04T01:39:51.097156+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:49.057663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096253+0000","last_change":"2023-11-04T01:39:01.899198+0000","last_active":"2023-11-04T01:39:51.096253+0000","last_peered":"2023-11-04T01:39:51.096253+0000","last_clean":"2023-11-04T01:39:51.096253+0000","last_became_active":"2023-11-04T01:38:59.893842+0000","last_became_peered":"2023-11-04T01:38:59.893842+0000","last_unstale":"2023-11-04T01:39:51.096253+0000","last_undegraded":"2023-11-04T01:39:51.096253+0000","last_fullsized":"2023-11-04T01:39:51.096253+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:05.228427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089883699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099059+0000","last_change":"2023-11-04T01:38:02.321871+0000","last_active":"2023-11-04T01:39:51.099059+0000","last_peered":"2023-11-04T01:39:51.099059+0000","last_clean":"2023-11-04T01:39:51.099059+0000","last_became_active":"2023-11-04T01:38:00.708407+0000","last_became_peered":"2023-11-04T01:38:00.708407+0000","last_unstale":"2023-11-04T01:39:51.099059+0000","last_undegraded":"2023-11-04T01:39:51.099059+0000","last_fullsized":"2023-11-04T01:39:51.099059+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:48.672429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032387200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.106784+0000","last_change":"2023-11-04T01:39:52.100695+0000","last_active":"2023-11-04T01:39:52.106784+0000","last_peered":"2023-11-04T01:39:52.106784+0000","last_clean":"2023-11-04T01:39:52.106784+0000","last_became_active":"2023-11-04T01:39:52.100440+0000","last_became_peered":"2023-11-04T01:39:52.100440+0000","last_unstale":"2023-11-04T01:39:52.106784+0000","last_undegraded":"2023-11-04T01:39:52.106784+0000","last_fullsized":"2023-11-04T01:39:52.106784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:45.707206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.121174+0000","last_change":"2023-11-04T01:39:51.106473+0000","last_active":"2023-11-04T01:39:52.121174+0000","last_peered":"2023-11-04T01:39:52.121174+0000","last_clean":"2023-11-04T01:39:52.121174+0000","last_became_active":"2023-11-04T01:39:51.106192+0000","last_became_peered":"2023-11-04T01:39:51.106192+0000","last_unstale":"2023-11-04T01:39:52.121174+0000","last_undegraded":"2023-11-04T01:39:52.121174+0000","last_fullsized":"2023-11-04T01:39:52.121174+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:29.834255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099124+0000","last_change":"2023-11-04T01:39:00.902561+0000","last_active":"2023-11-04T01:39:51.099124+0000","last_peered":"2023-11-04T01:39:51.099124+0000","last_clean":"2023-11-04T01:39:51.099124+0000","last_became_active":"2023-11-04T01:39:00.902203+0000","last_became_peered":"2023-11-04T01:39:00.902203+0000","last_unstale":"2023-11-04T01:39:51.099124+0000","last_undegraded":"2023-11-04T01:39:51.099124+0000","last_fullsized":"2023-11-04T01:39:51.099124+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:12.375847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099047+0000","last_change":"2023-11-04T01:39:01.896891+0000","last_active":"2023-11-04T01:39:51.099047+0000","last_peered":"2023-11-04T01:39:51.099047+0000","last_clean":"2023-11-04T01:39:51.099047+0000","last_became_active":"2023-11-04T01:38:59.894385+0000","last_became_peered":"2023-11-04T01:38:59.894385+0000","last_unstale":"2023-11-04T01:39:51.099047+0000","last_undegraded":"2023-11-04T01:39:51.099047+0000","last_fullsized":"2023-11-04T01:39:51.099047+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:36:07.725905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084524899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096286+0000","last_change":"2023-11-04T01:38:01.983988+0000","last_active":"2023-11-04T01:39:51.096286+0000","last_peered":"2023-11-04T01:39:51.096286+0000","last_clean":"2023-11-04T01:39:51.096286+0000","last_became_active":"2023-11-04T01:38:00.711020+0000","last_became_peered":"2023-11-04T01:38:00.711020+0000","last_unstale":"2023-11-04T01:39:51.096286+0000","last_undegraded":"2023-11-04T01:39:51.096286+0000","last_fullsized":"2023-11-04T01:39:51.096286+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:06.374078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.112753+0000","last_change":"2023-11-04T01:39:52.108497+0000","last_active":"2023-11-04T01:39:52.112753+0000","last_peered":"2023-11-04T01:39:52.112753+0000","last_clean":"2023-11-04T01:39:52.112753+0000","last_became_active":"2023-11-04T01:39:52.108237+0000","last_became_peered":"2023-11-04T01:39:52.108237+0000","last_unstale":"2023-11-04T01:39:52.112753+0000","last_undegraded":"2023-11-04T01:39:52.112753+0000","last_fullsized":"2023-11-04T01:39:52.112753+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:20:06.100624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"95'4","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.121433+0000","last_change":"2023-11-04T01:39:51.107623+0000","last_active":"2023-11-04T01:39:52.121433+0000","last_peered":"2023-11-04T01:39:52.121433+0000","last_clean":"2023-11-04T01:39:52.121433+0000","last_became_active":"2023-11-04T01:39:51.107118+0000","last_became_peered":"2023-11-04T01:39:51.107118+0000","last_unstale":"2023-11-04T01:39:52.121433+0000","last_undegraded":"2023-11-04T01:39:52.121433+0000","last_fullsized":"2023-11-04T01:39:52.121433+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:00.148090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.104057+0000","last_change":"2023-11-04T01:39:00.902481+0000","last_active":"2023-11-04T01:39:51.104057+0000","last_peered":"2023-11-04T01:39:51.104057+0000","last_clean":"2023-11-04T01:39:51.104057+0000","last_became_active":"2023-11-04T01:39:00.902206+0000","last_became_peered":"2023-11-04T01:39:00.902206+0000","last_unstale":"2023-11-04T01:39:51.104057+0000","last_undegraded":"2023-11-04T01:39:51.104057+0000","last_fullsized":"2023-11-04T01:39:51.104057+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:49.996214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099509+0000","last_change":"2023-11-04T01:39:02.076608+0000","last_active":"2023-11-04T01:39:51.099509+0000","last_peered":"2023-11-04T01:39:51.099509+0000","last_clean":"2023-11-04T01:39:51.099509+0000","last_became_active":"2023-11-04T01:38:59.892104+0000","last_became_peered":"2023-11-04T01:38:59.892104+0000","last_unstale":"2023-11-04T01:39:51.099509+0000","last_undegraded":"2023-11-04T01:39:51.099509+0000","last_fullsized":"2023-11-04T01:39:51.099509+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:15.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063915499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098700+0000","last_change":"2023-11-04T01:38:02.321641+0000","last_active":"2023-11-04T01:39:51.098700+0000","last_peered":"2023-11-04T01:39:51.098700+0000","last_clean":"2023-11-04T01:39:51.098700+0000","last_became_active":"2023-11-04T01:38:00.706199+0000","last_became_peered":"2023-11-04T01:38:00.706199+0000","last_unstale":"2023-11-04T01:39:51.098700+0000","last_undegraded":"2023-11-04T01:39:51.098700+0000","last_fullsized":"2023-11-04T01:39:51.098700+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:15.138325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045080400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.111057+0000","last_change":"2023-11-04T01:39:52.108569+0000","last_active":"2023-11-04T01:39:52.111057+0000","last_peered":"2023-11-04T01:39:52.111057+0000","last_clean":"2023-11-04T01:39:52.111057+0000","last_became_active":"2023-11-04T01:39:52.108330+0000","last_became_peered":"2023-11-04T01:39:52.108330+0000","last_unstale":"2023-11-04T01:39:52.111057+0000","last_undegraded":"2023-11-04T01:39:52.111057+0000","last_fullsized":"2023-11-04T01:39:52.111057+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:20.966615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.125030+0000","last_change":"2023-11-04T01:39:51.113710+0000","last_active":"2023-11-04T01:39:52.125030+0000","last_peered":"2023-11-04T01:39:52.125030+0000","last_clean":"2023-11-04T01:39:52.125030+0000","last_became_active":"2023-11-04T01:39:51.113461+0000","last_became_peered":"2023-11-04T01:39:51.113461+0000","last_unstale":"2023-11-04T01:39:52.125030+0000","last_undegraded":"2023-11-04T01:39:52.125030+0000","last_fullsized":"2023-11-04T01:39:52.125030+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:12:13.419898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094775+0000","last_change":"2023-11-04T01:39:00.906469+0000","last_active":"2023-11-04T01:39:51.094775+0000","last_peered":"2023-11-04T01:39:51.094775+0000","last_clean":"2023-11-04T01:39:51.094775+0000","last_became_active":"2023-11-04T01:39:00.905872+0000","last_became_peered":"2023-11-04T01:39:00.905872+0000","last_unstale":"2023-11-04T01:39:51.094775+0000","last_undegraded":"2023-11-04T01:39:51.094775+0000","last_fullsized":"2023-11-04T01:39:51.094775+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:32.767818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094918+0000","last_change":"2023-11-04T01:39:01.897198+0000","last_active":"2023-11-04T01:39:51.094918+0000","last_peered":"2023-11-04T01:39:51.094918+0000","last_clean":"2023-11-04T01:39:51.094918+0000","last_became_active":"2023-11-04T01:38:59.884103+0000","last_became_peered":"2023-11-04T01:38:59.884103+0000","last_unstale":"2023-11-04T01:39:51.094918+0000","last_undegraded":"2023-11-04T01:39:51.094918+0000","last_fullsized":"2023-11-04T01:39:51.094918+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:07.268618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074876599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.102204+0000","last_change":"2023-11-04T01:38:02.156148+0000","last_active":"2023-11-04T01:39:51.102204+0000","last_peered":"2023-11-04T01:39:51.102204+0000","last_clean":"2023-11-04T01:39:51.102204+0000","last_became_active":"2023-11-04T01:38:00.708352+0000","last_became_peered":"2023-11-04T01:38:00.708352+0000","last_unstale":"2023-11-04T01:39:51.102204+0000","last_undegraded":"2023-11-04T01:39:51.102204+0000","last_fullsized":"2023-11-04T01:39:51.102204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035716799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.113603+0000","last_change":"2023-11-04T01:39:52.107063+0000","last_active":"2023-11-04T01:39:52.113603+0000","last_peered":"2023-11-04T01:39:52.113603+0000","last_clean":"2023-11-04T01:39:52.113603+0000","last_became_active":"2023-11-04T01:39:52.106773+0000","last_became_peered":"2023-11-04T01:39:52.106773+0000","last_unstale":"2023-11-04T01:39:52.113603+0000","last_undegraded":"2023-11-04T01:39:52.113603+0000","last_fullsized":"2023-11-04T01:39:52.113603+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:32.743299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.124364+0000","last_change":"2023-11-04T01:39:51.112686+0000","last_active":"2023-11-04T01:39:52.124364+0000","last_peered":"2023-11-04T01:39:52.124364+0000","last_clean":"2023-11-04T01:39:52.124364+0000","last_became_active":"2023-11-04T01:39:51.112258+0000","last_became_peered":"2023-11-04T01:39:51.112258+0000","last_unstale":"2023-11-04T01:39:52.124364+0000","last_undegraded":"2023-11-04T01:39:52.124364+0000","last_fullsized":"2023-11-04T01:39:52.124364+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:57.409611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094352+0000","last_change":"2023-11-04T01:39:00.905021+0000","last_active":"2023-11-04T01:39:51.094352+0000","last_peered":"2023-11-04T01:39:51.094352+0000","last_clean":"2023-11-04T01:39:51.094352+0000","last_became_active":"2023-11-04T01:39:00.904730+0000","last_became_peered":"2023-11-04T01:39:00.904730+0000","last_unstale":"2023-11-04T01:39:51.094352+0000","last_undegraded":"2023-11-04T01:39:51.094352+0000","last_fullsized":"2023-11-04T01:39:51.094352+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:28.746335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094994+0000","last_change":"2023-11-04T01:39:01.897770+0000","last_active":"2023-11-04T01:39:51.094994+0000","last_peered":"2023-11-04T01:39:51.094994+0000","last_clean":"2023-11-04T01:39:51.094994+0000","last_became_active":"2023-11-04T01:38:59.894386+0000","last_became_peered":"2023-11-04T01:38:59.894386+0000","last_unstale":"2023-11-04T01:39:51.094994+0000","last_undegraded":"2023-11-04T01:39:51.094994+0000","last_fullsized":"2023-11-04T01:39:51.094994+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:20.259857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069590400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099729+0000","last_change":"2023-11-04T01:38:01.939729+0000","last_active":"2023-11-04T01:39:51.099729+0000","last_peered":"2023-11-04T01:39:51.099729+0000","last_clean":"2023-11-04T01:39:51.099729+0000","last_became_active":"2023-11-04T01:38:00.704384+0000","last_became_peered":"2023-11-04T01:38:00.704384+0000","last_unstale":"2023-11-04T01:39:51.099729+0000","last_undegraded":"2023-11-04T01:39:51.099729+0000","last_fullsized":"2023-11-04T01:39:51.099729+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080052200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.110583+0000","last_change":"2023-11-04T01:39:52.107272+0000","last_active":"2023-11-04T01:39:52.110583+0000","last_peered":"2023-11-04T01:39:52.110583+0000","last_clean":"2023-11-04T01:39:52.110583+0000","last_became_active":"2023-11-04T01:39:52.106564+0000","last_became_peered":"2023-11-04T01:39:52.106564+0000","last_unstale":"2023-11-04T01:39:52.110583+0000","last_undegraded":"2023-11-04T01:39:52.110583+0000","last_fullsized":"2023-11-04T01:39:52.110583+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:42:48.684260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.096750+0000","last_change":"2023-11-04T01:39:51.110707+0000","last_active":"2023-11-04T01:39:52.096750+0000","last_peered":"2023-11-04T01:39:52.096750+0000","last_clean":"2023-11-04T01:39:52.096750+0000","last_became_active":"2023-11-04T01:39:51.110409+0000","last_became_peered":"2023-11-04T01:39:51.110409+0000","last_unstale":"2023-11-04T01:39:52.096750+0000","last_undegraded":"2023-11-04T01:39:52.096750+0000","last_fullsized":"2023-11-04T01:39:52.096750+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:38:51.294106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096919+0000","last_change":"2023-11-04T01:39:00.904930+0000","last_active":"2023-11-04T01:39:51.096919+0000","last_peered":"2023-11-04T01:39:51.096919+0000","last_clean":"2023-11-04T01:39:51.096919+0000","last_became_active":"2023-11-04T01:39:00.904645+0000","last_became_peered":"2023-11-04T01:39:00.904645+0000","last_unstale":"2023-11-04T01:39:51.096919+0000","last_undegraded":"2023-11-04T01:39:51.096919+0000","last_fullsized":"2023-11-04T01:39:51.096919+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:14.894198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103243+0000","last_change":"2023-11-04T01:39:02.076751+0000","last_active":"2023-11-04T01:39:51.103243+0000","last_peered":"2023-11-04T01:39:51.103243+0000","last_clean":"2023-11-04T01:39:51.103243+0000","last_became_active":"2023-11-04T01:38:59.887859+0000","last_became_peered":"2023-11-04T01:38:59.887859+0000","last_unstale":"2023-11-04T01:39:51.103243+0000","last_undegraded":"2023-11-04T01:39:51.103243+0000","last_fullsized":"2023-11-04T01:39:51.103243+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:42.452480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057159799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094918+0000","last_change":"2023-11-04T01:38:01.697272+0000","last_active":"2023-11-04T01:39:51.094918+0000","last_peered":"2023-11-04T01:39:51.094918+0000","last_clean":"2023-11-04T01:39:51.094918+0000","last_became_active":"2023-11-04T01:38:00.709395+0000","last_became_peered":"2023-11-04T01:38:00.709395+0000","last_unstale":"2023-11-04T01:39:51.094918+0000","last_undegraded":"2023-11-04T01:39:51.094918+0000","last_fullsized":"2023-11-04T01:39:51.094918+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076665499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.120236+0000","last_change":"2023-11-04T01:39:52.117871+0000","last_active":"2023-11-04T01:39:52.120236+0000","last_peered":"2023-11-04T01:39:52.120236+0000","last_clean":"2023-11-04T01:39:52.120236+0000","last_became_active":"2023-11-04T01:39:52.116478+0000","last_became_peered":"2023-11-04T01:39:52.116478+0000","last_unstale":"2023-11-04T01:39:52.120236+0000","last_undegraded":"2023-11-04T01:39:52.120236+0000","last_fullsized":"2023-11-04T01:39:52.120236+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:19.069016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.121571+0000","last_change":"2023-11-04T01:39:51.109464+0000","last_active":"2023-11-04T01:39:52.121571+0000","last_peered":"2023-11-04T01:39:52.121571+0000","last_clean":"2023-11-04T01:39:52.121571+0000","last_became_active":"2023-11-04T01:39:51.109212+0000","last_became_peered":"2023-11-04T01:39:51.109212+0000","last_unstale":"2023-11-04T01:39:52.121571+0000","last_undegraded":"2023-11-04T01:39:52.121571+0000","last_fullsized":"2023-11-04T01:39:52.121571+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:43:16.745553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.095098+0000","last_change":"2023-11-04T01:39:00.904589+0000","last_active":"2023-11-04T01:39:51.095098+0000","last_peered":"2023-11-04T01:39:51.095098+0000","last_clean":"2023-11-04T01:39:51.095098+0000","last_became_active":"2023-11-04T01:39:00.904277+0000","last_became_peered":"2023-11-04T01:39:00.904277+0000","last_unstale":"2023-11-04T01:39:51.095098+0000","last_undegraded":"2023-11-04T01:39:51.095098+0000","last_fullsized":"2023-11-04T01:39:51.095098+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:43.457960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096828+0000","last_change":"2023-11-04T01:39:01.899561+0000","last_active":"2023-11-04T01:39:51.096828+0000","last_peered":"2023-11-04T01:39:51.096828+0000","last_clean":"2023-11-04T01:39:51.096828+0000","last_became_active":"2023-11-04T01:38:59.886002+0000","last_became_peered":"2023-11-04T01:38:59.886002+0000","last_unstale":"2023-11-04T01:39:51.096828+0000","last_undegraded":"2023-11-04T01:39:51.096828+0000","last_fullsized":"2023-11-04T01:39:51.096828+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:06:48.983584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061693100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103516+0000","last_change":"2023-11-04T01:38:01.984567+0000","last_active":"2023-11-04T01:39:51.103516+0000","last_peered":"2023-11-04T01:39:51.103516+0000","last_clean":"2023-11-04T01:39:51.103516+0000","last_became_active":"2023-11-04T01:38:00.708020+0000","last_became_peered":"2023-11-04T01:38:00.708020+0000","last_unstale":"2023-11-04T01:39:51.103516+0000","last_undegraded":"2023-11-04T01:39:51.103516+0000","last_fullsized":"2023-11-04T01:39:51.103516+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:09.638146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056906299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.108006+0000","last_change":"2023-11-04T01:39:52.107184+0000","last_active":"2023-11-04T01:39:52.108006+0000","last_peered":"2023-11-04T01:39:52.108006+0000","last_clean":"2023-11-04T01:39:52.108006+0000","last_became_active":"2023-11-04T01:39:52.106901+0000","last_became_peered":"2023-11-04T01:39:52.106901+0000","last_unstale":"2023-11-04T01:39:52.108006+0000","last_undegraded":"2023-11-04T01:39:52.108006+0000","last_fullsized":"2023-11-04T01:39:52.108006+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:30:39.612504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"95'8","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.128910+0000","last_change":"2023-11-04T01:39:51.111840+0000","last_active":"2023-11-04T01:39:52.128910+0000","last_peered":"2023-11-04T01:39:52.128910+0000","last_clean":"2023-11-04T01:39:52.128910+0000","last_became_active":"2023-11-04T01:39:51.111541+0000","last_became_peered":"2023-11-04T01:39:51.111541+0000","last_unstale":"2023-11-04T01:39:52.128910+0000","last_undegraded":"2023-11-04T01:39:52.128910+0000","last_fullsized":"2023-11-04T01:39:52.128910+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:07.024999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097601+0000","last_change":"2023-11-04T01:39:00.902975+0000","last_active":"2023-11-04T01:39:51.097601+0000","last_peered":"2023-11-04T01:39:51.097601+0000","last_clean":"2023-11-04T01:39:51.097601+0000","last_became_active":"2023-11-04T01:39:00.902732+0000","last_became_peered":"2023-11-04T01:39:00.902732+0000","last_unstale":"2023-11-04T01:39:51.097601+0000","last_undegraded":"2023-11-04T01:39:51.097601+0000","last_fullsized":"2023-11-04T01:39:51.097601+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:21.265338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103389+0000","last_change":"2023-11-04T01:39:02.076570+0000","last_active":"2023-11-04T01:39:51.103389+0000","last_peered":"2023-11-04T01:39:51.103389+0000","last_clean":"2023-11-04T01:39:51.103389+0000","last_became_active":"2023-11-04T01:38:59.886841+0000","last_became_peered":"2023-11-04T01:38:59.886841+0000","last_unstale":"2023-11-04T01:39:51.103389+0000","last_undegraded":"2023-11-04T01:39:51.103389+0000","last_fullsized":"2023-11-04T01:39:51.103389+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:27.740854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064312500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097417+0000","last_change":"2023-11-04T01:38:01.699685+0000","last_active":"2023-11-04T01:39:51.097417+0000","last_peered":"2023-11-04T01:39:51.097417+0000","last_clean":"2023-11-04T01:39:51.097417+0000","last_became_active":"2023-11-04T01:38:00.706802+0000","last_became_peered":"2023-11-04T01:38:00.706802+0000","last_unstale":"2023-11-04T01:39:51.097417+0000","last_undegraded":"2023-11-04T01:39:51.097417+0000","last_fullsized":"2023-11-04T01:39:51.097417+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085845400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.117625+0000","last_change":"2023-11-04T01:39:52.116590+0000","last_active":"2023-11-04T01:39:52.117625+0000","last_peered":"2023-11-04T01:39:52.117625+0000","last_clean":"2023-11-04T01:39:52.117625+0000","last_became_active":"2023-11-04T01:39:52.116257+0000","last_became_peered":"2023-11-04T01:39:52.116257+0000","last_unstale":"2023-11-04T01:39:52.117625+0000","last_undegraded":"2023-11-04T01:39:52.117625+0000","last_fullsized":"2023-11-04T01:39:52.117625+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:00:52.867584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.098100+0000","last_change":"2023-11-04T01:39:51.107937+0000","last_active":"2023-11-04T01:39:52.098100+0000","last_peered":"2023-11-04T01:39:52.098100+0000","last_clean":"2023-11-04T01:39:52.098100+0000","last_became_active":"2023-11-04T01:39:51.107695+0000","last_became_peered":"2023-11-04T01:39:51.107695+0000","last_unstale":"2023-11-04T01:39:52.098100+0000","last_undegraded":"2023-11-04T01:39:52.098100+0000","last_fullsized":"2023-11-04T01:39:52.098100+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:49:13.692636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.102441+0000","last_change":"2023-11-04T01:39:00.904110+0000","last_active":"2023-11-04T01:39:51.102441+0000","last_peered":"2023-11-04T01:39:51.102441+0000","last_clean":"2023-11-04T01:39:51.102441+0000","last_became_active":"2023-11-04T01:39:00.903820+0000","last_became_peered":"2023-11-04T01:39:00.903820+0000","last_unstale":"2023-11-04T01:39:51.102441+0000","last_undegraded":"2023-11-04T01:39:51.102441+0000","last_fullsized":"2023-11-04T01:39:51.102441+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:06:49.989064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.100409+0000","last_change":"2023-11-04T01:39:02.370981+0000","last_active":"2023-11-04T01:39:51.100409+0000","last_peered":"2023-11-04T01:39:51.100409+0000","last_clean":"2023-11-04T01:39:51.100409+0000","last_became_active":"2023-11-04T01:38:59.893000+0000","last_became_peered":"2023-11-04T01:38:59.893000+0000","last_unstale":"2023-11-04T01:39:51.100409+0000","last_undegraded":"2023-11-04T01:39:51.100409+0000","last_fullsized":"2023-11-04T01:39:51.100409+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:10.350371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065268599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":67,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098507+0000","last_change":"2023-11-04T01:38:01.700399+0000","last_active":"2023-11-04T01:39:51.098507+0000","last_peered":"2023-11-04T01:39:51.098507+0000","last_clean":"2023-11-04T01:39:51.098507+0000","last_became_active":"2023-11-04T01:38:00.701352+0000","last_became_peered":"2023-11-04T01:38:00.701352+0000","last_unstale":"2023-11-04T01:39:51.098507+0000","last_undegraded":"2023-11-04T01:39:51.098507+0000","last_fullsized":"2023-11-04T01:39:51.098507+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078589399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114813+0000","last_change":"2023-11-04T01:39:52.113489+0000","last_active":"2023-11-04T01:39:52.114813+0000","last_peered":"2023-11-04T01:39:52.114813+0000","last_clean":"2023-11-04T01:39:52.114813+0000","last_became_active":"2023-11-04T01:39:52.113214+0000","last_became_peered":"2023-11-04T01:39:52.113214+0000","last_unstale":"2023-11-04T01:39:52.114813+0000","last_undegraded":"2023-11-04T01:39:52.114813+0000","last_fullsized":"2023-11-04T01:39:52.114813+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:18.056532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.093358+0000","last_change":"2023-11-04T01:39:51.111916+0000","last_active":"2023-11-04T01:39:52.093358+0000","last_peered":"2023-11-04T01:39:52.093358+0000","last_clean":"2023-11-04T01:39:52.093358+0000","last_became_active":"2023-11-04T01:39:51.111571+0000","last_became_peered":"2023-11-04T01:39:51.111571+0000","last_unstale":"2023-11-04T01:39:52.093358+0000","last_undegraded":"2023-11-04T01:39:52.093358+0000","last_fullsized":"2023-11-04T01:39:52.093358+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:22.151389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.100463+0000","last_change":"2023-11-04T01:39:00.902993+0000","last_active":"2023-11-04T01:39:51.100463+0000","last_peered":"2023-11-04T01:39:51.100463+0000","last_clean":"2023-11-04T01:39:51.100463+0000","last_became_active":"2023-11-04T01:39:00.902704+0000","last_became_peered":"2023-11-04T01:39:00.902704+0000","last_unstale":"2023-11-04T01:39:51.100463+0000","last_undegraded":"2023-11-04T01:39:51.100463+0000","last_fullsized":"2023-11-04T01:39:51.100463+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:38.313962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099465+0000","last_change":"2023-11-04T01:39:02.039353+0000","last_active":"2023-11-04T01:39:51.099465+0000","last_peered":"2023-11-04T01:39:51.099465+0000","last_clean":"2023-11-04T01:39:51.099465+0000","last_became_active":"2023-11-04T01:38:59.897877+0000","last_became_peered":"2023-11-04T01:38:59.897877+0000","last_unstale":"2023-11-04T01:39:51.099465+0000","last_undegraded":"2023-11-04T01:39:51.099465+0000","last_fullsized":"2023-11-04T01:39:51.099465+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:13:39.795522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000482974,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.102793+0000","last_change":"2023-11-04T01:38:02.362072+0000","last_active":"2023-11-04T01:39:51.102793+0000","last_peered":"2023-11-04T01:39:51.102793+0000","last_clean":"2023-11-04T01:39:51.102793+0000","last_became_active":"2023-11-04T01:38:00.710897+0000","last_became_peered":"2023-11-04T01:38:00.710897+0000","last_unstale":"2023-11-04T01:39:51.102793+0000","last_undegraded":"2023-11-04T01:39:51.102793+0000","last_fullsized":"2023-11-04T01:39:51.102793+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:25.229838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058055900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114421+0000","last_change":"2023-11-04T01:39:52.111319+0000","last_active":"2023-11-04T01:39:52.114421+0000","last_peered":"2023-11-04T01:39:52.114421+0000","last_clean":"2023-11-04T01:39:52.114421+0000","last_became_active":"2023-11-04T01:39:52.111055+0000","last_became_peered":"2023-11-04T01:39:52.111055+0000","last_unstale":"2023-11-04T01:39:52.114421+0000","last_undegraded":"2023-11-04T01:39:52.114421+0000","last_fullsized":"2023-11-04T01:39:52.114421+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:25.836309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"95'6","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.130887+0000","last_change":"2023-11-04T01:39:51.111046+0000","last_active":"2023-11-04T01:39:52.130887+0000","last_peered":"2023-11-04T01:39:52.130887+0000","last_clean":"2023-11-04T01:39:52.130887+0000","last_became_active":"2023-11-04T01:39:51.110777+0000","last_became_peered":"2023-11-04T01:39:51.110777+0000","last_unstale":"2023-11-04T01:39:52.130887+0000","last_undegraded":"2023-11-04T01:39:52.130887+0000","last_fullsized":"2023-11-04T01:39:52.130887+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:14:25.705293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103137+0000","last_change":"2023-11-04T01:39:00.901761+0000","last_active":"2023-11-04T01:39:51.103137+0000","last_peered":"2023-11-04T01:39:51.103137+0000","last_clean":"2023-11-04T01:39:51.103137+0000","last_became_active":"2023-11-04T01:39:00.901485+0000","last_became_peered":"2023-11-04T01:39:00.901485+0000","last_unstale":"2023-11-04T01:39:51.103137+0000","last_undegraded":"2023-11-04T01:39:51.103137+0000","last_fullsized":"2023-11-04T01:39:51.103137+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:37.511499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098056+0000","last_change":"2023-11-04T01:39:02.038972+0000","last_active":"2023-11-04T01:39:51.098056+0000","last_peered":"2023-11-04T01:39:51.098056+0000","last_clean":"2023-11-04T01:39:51.098056+0000","last_became_active":"2023-11-04T01:38:59.897966+0000","last_became_peered":"2023-11-04T01:38:59.897966+0000","last_unstale":"2023-11-04T01:39:51.098056+0000","last_undegraded":"2023-11-04T01:39:51.098056+0000","last_fullsized":"2023-11-04T01:39:51.098056+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:30.928374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041155899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099537+0000","last_change":"2023-11-04T01:38:01.939857+0000","last_active":"2023-11-04T01:39:51.099537+0000","last_peered":"2023-11-04T01:39:51.099537+0000","last_clean":"2023-11-04T01:39:51.099537+0000","last_became_active":"2023-11-04T01:38:00.701371+0000","last_became_peered":"2023-11-04T01:38:00.701371+0000","last_unstale":"2023-11-04T01:39:51.099537+0000","last_undegraded":"2023-11-04T01:39:51.099537+0000","last_fullsized":"2023-11-04T01:39:51.099537+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078632099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.118138+0000","last_change":"2023-11-04T01:39:52.110240+0000","last_active":"2023-11-04T01:39:52.118138+0000","last_peered":"2023-11-04T01:39:52.118138+0000","last_clean":"2023-11-04T01:39:52.118138+0000","last_became_active":"2023-11-04T01:39:52.109963+0000","last_became_peered":"2023-11-04T01:39:52.109963+0000","last_unstale":"2023-11-04T01:39:52.118138+0000","last_undegraded":"2023-11-04T01:39:52.118138+0000","last_fullsized":"2023-11-04T01:39:52.118138+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:20:14.008608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"95'3","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.128035+0000","last_change":"2023-11-04T01:39:51.112196+0000","last_active":"2023-11-04T01:39:52.128035+0000","last_peered":"2023-11-04T01:39:52.128035+0000","last_clean":"2023-11-04T01:39:52.128035+0000","last_became_active":"2023-11-04T01:39:51.111916+0000","last_became_peered":"2023-11-04T01:39:51.111916+0000","last_unstale":"2023-11-04T01:39:52.128035+0000","last_undegraded":"2023-11-04T01:39:52.128035+0000","last_fullsized":"2023-11-04T01:39:52.128035+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:57.721643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098653+0000","last_change":"2023-11-04T01:39:00.901396+0000","last_active":"2023-11-04T01:39:51.098653+0000","last_peered":"2023-11-04T01:39:51.098653+0000","last_clean":"2023-11-04T01:39:51.098653+0000","last_became_active":"2023-11-04T01:39:00.901094+0000","last_became_peered":"2023-11-04T01:39:00.901094+0000","last_unstale":"2023-11-04T01:39:51.098653+0000","last_undegraded":"2023-11-04T01:39:51.098653+0000","last_fullsized":"2023-11-04T01:39:51.098653+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:48.475869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099289+0000","last_change":"2023-11-04T01:39:02.370014+0000","last_active":"2023-11-04T01:39:51.099289+0000","last_peered":"2023-11-04T01:39:51.099289+0000","last_clean":"2023-11-04T01:39:51.099289+0000","last_became_active":"2023-11-04T01:38:59.893020+0000","last_became_peered":"2023-11-04T01:38:59.893020+0000","last_unstale":"2023-11-04T01:39:51.099289+0000","last_undegraded":"2023-11-04T01:39:51.099289+0000","last_fullsized":"2023-11-04T01:39:51.099289+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:32.037301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058077499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099804+0000","last_change":"2023-11-04T01:38:01.939662+0000","last_active":"2023-11-04T01:39:51.099804+0000","last_peered":"2023-11-04T01:39:51.099804+0000","last_clean":"2023-11-04T01:39:51.099804+0000","last_became_active":"2023-11-04T01:38:00.705871+0000","last_became_peered":"2023-11-04T01:38:00.705871+0000","last_unstale":"2023-11-04T01:39:51.099804+0000","last_undegraded":"2023-11-04T01:39:51.099804+0000","last_fullsized":"2023-11-04T01:39:51.099804+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066873200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.109403+0000","last_change":"2023-11-04T01:39:52.107036+0000","last_active":"2023-11-04T01:39:52.109403+0000","last_peered":"2023-11-04T01:39:52.109403+0000","last_clean":"2023-11-04T01:39:52.109403+0000","last_became_active":"2023-11-04T01:39:52.106645+0000","last_became_peered":"2023-11-04T01:39:52.106645+0000","last_unstale":"2023-11-04T01:39:52.109403+0000","last_undegraded":"2023-11-04T01:39:52.109403+0000","last_fullsized":"2023-11-04T01:39:52.109403+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:45.051199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.104963+0000","last_change":"2023-11-04T01:39:51.110842+0000","last_active":"2023-11-04T01:39:52.104963+0000","last_peered":"2023-11-04T01:39:52.104963+0000","last_clean":"2023-11-04T01:39:52.104963+0000","last_became_active":"2023-11-04T01:39:51.110529+0000","last_became_peered":"2023-11-04T01:39:51.110529+0000","last_unstale":"2023-11-04T01:39:52.104963+0000","last_undegraded":"2023-11-04T01:39:52.104963+0000","last_fullsized":"2023-11-04T01:39:52.104963+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:43:08.727660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.095755+0000","last_change":"2023-11-04T01:39:00.904488+0000","last_active":"2023-11-04T01:39:51.095755+0000","last_peered":"2023-11-04T01:39:51.095755+0000","last_clean":"2023-11-04T01:39:51.095755+0000","last_became_active":"2023-11-04T01:39:00.904234+0000","last_became_peered":"2023-11-04T01:39:00.904234+0000","last_unstale":"2023-11-04T01:39:51.095755+0000","last_undegraded":"2023-11-04T01:39:51.095755+0000","last_fullsized":"2023-11-04T01:39:51.095755+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:05:10.425461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094780+0000","last_change":"2023-11-04T01:39:01.896521+0000","last_active":"2023-11-04T01:39:51.094780+0000","last_peered":"2023-11-04T01:39:51.094780+0000","last_clean":"2023-11-04T01:39:51.094780+0000","last_became_active":"2023-11-04T01:38:59.890560+0000","last_became_peered":"2023-11-04T01:38:59.890560+0000","last_unstale":"2023-11-04T01:39:51.094780+0000","last_undegraded":"2023-11-04T01:39:51.094780+0000","last_fullsized":"2023-11-04T01:39:51.094780+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:14.608973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052638499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103355+0000","last_change":"2023-11-04T01:38:01.984672+0000","last_active":"2023-11-04T01:39:51.103355+0000","last_peered":"2023-11-04T01:39:51.103355+0000","last_clean":"2023-11-04T01:39:51.103355+0000","last_became_active":"2023-11-04T01:38:00.706804+0000","last_became_peered":"2023-11-04T01:38:00.706804+0000","last_unstale":"2023-11-04T01:39:51.103355+0000","last_undegraded":"2023-11-04T01:39:51.103355+0000","last_fullsized":"2023-11-04T01:39:51.103355+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:48.412413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038439000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":230,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094548+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:39:51.094548+0000","last_peered":"2023-11-04T01:39:51.094548+0000","last_clean":"2023-11-04T01:39:51.094548+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:39:51.094548+0000","last_undegraded":"2023-11-04T01:39:51.094548+0000","last_fullsized":"2023-11-04T01:39:51.094548+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1773568,"data_stored":1170041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.39200000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83299999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57399999999999995,"15min":0.56699999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56499999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.371,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.625,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.439,"5min":0.318,"15min":0.318},"max":{"1min":0.79200000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.432}]},{"osd":2,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.442},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.40500000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45300000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.40899999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.40799999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.53400000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.44600000000000001,"15min":0.433},"min":{"1min":0.35099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65300000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.47199999999999998,"15min":0.45200000000000001},"min":{"1min":0.33100000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.34599999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51100000000000001,"15min":0.498},"min":{"1min":0.38700000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65300000000000002,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.747,"5min":0.877,"15min":0.877},"last":0.5}]},{"osd":6,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.503,"15min":0.48399999999999999},"min":{"1min":0.34399999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.53200000000000003},"min":{"1min":0.40799999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68200000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.379}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1175552,"data_stored":579127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.51200000000000001,"15min":0.499},"min":{"1min":0.375,"5min":0.214,"15min":0.214},"max":{"1min":0.70699999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70099999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.624}]},{"osd":1,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72299999999999998,"5min":1.05,"15min":1.05},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.59299999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.41599999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.70499999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.68400000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.63800000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.67500000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.502,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.75,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.498,"15min":0.497},"min":{"1min":0.34899999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63800000000000001,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.442}]},{"osd":5,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32900000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68300000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.379},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40500000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.72699999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.41099999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73499999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67900000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":579661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36899999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71499999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57999999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.747,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.60799999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78700000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.502}]},{"osd":3,"last update":"Sat Nov 4 01:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.45100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82699999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.42699999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48299999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.307,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.432},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.38100000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66800000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.51400000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.35199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.67800000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53800000000000003,"15min":0.53500000000000003},"min":{"1min":0.35399999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71899999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.35099999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.69999999999999996,"5min":0.751,"15min":0.751},"last":0.377}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1159168,"data_stored":570871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79500000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57699999999999996,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77700000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.76000000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65700000000000003,"5min":0.875,"15min":0.875},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70299999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67900000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75700000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.78600000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70399999999999996,"5min":0.879,"15min":0.879},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.57799999999999996,"15min":0.59699999999999998},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.624,"5min":1.089,"15min":1.089},"last":0.80200000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.874,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.52400000000000002},"min":{"1min":0.35399999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.89500000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81799999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58999999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.42099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70899999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85399999999999998,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.64500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":580739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.249},{"interface":"front","average":{"1min":0.307,"5min":0.313,"15min":0.313},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.26500000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32100000000000001,"15min":0.33000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.434,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.23799999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.38200000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.34999999999999998},"min":{"1min":0.28199999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.37,"15min":0.374},"min":{"1min":0.27200000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.495,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.313}]},{"osd":4,"last update":"Sat Nov 4 01:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.40400000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79900000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Sat Nov 4 01:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.52700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82699999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.747,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48999999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.44500000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77800000000000002,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.505}]},{"osd":7,"last update":"Sat Nov 4 01:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76200000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.436,"5min":0.378,"15min":0.378},"max":{"1min":0.81000000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1171456,"data_stored":579057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32200000000000001,"15min":0.33000000000000002},"min":{"1min":0.20399999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.44900000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.309,"5min":0.32900000000000001,"15min":0.34100000000000003},"min":{"1min":0.24199999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.43099999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.46200000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.35399999999999998,"15min":0.36799999999999999},"min":{"1min":0.23899999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.42199999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.379,"15min":0.39900000000000002},"min":{"1min":0.25600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.48499999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39800000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.39800000000000002,"15min":0.41699999999999998},"min":{"1min":0.29899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.46800000000000003,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.40400000000000003,"15min":0.42799999999999999},"min":{"1min":0.29299999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.46200000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.504}]},{"osd":4,"last update":"Sat Nov 4 01:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.626,"15min":0.64600000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77100000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.74399999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.94899999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.81100000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59699999999999998,"15min":0.61899999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71299999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.81299999999999994}]},{"osd":6,"last update":"Sat Nov 4 01:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82899999999999996,"5min":1,"15min":1},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60099999999999998,"15min":0.61599999999999999},"min":{"1min":0.41299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72599999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.78100000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.57599999999999996},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.60599999999999998},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.88100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1179648,"data_stored":579181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39700000000000002,"15min":0.36199999999999999},"min":{"1min":0.23699999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.47699999999999998,"5min":5.415,"15min":5.415},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.41799999999999998,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52500000000000002,"5min":3.456,"15min":3.456},"last":0.26100000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.39400000000000002,"15min":0.39600000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.56399999999999995,"5min":2.355,"15min":2.355},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.28299999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61499999999999999,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.33000000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.52200000000000002,"15min":0.46999999999999997},"min":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58099999999999996,"5min":8.891,"15min":8.891},"last":0.378},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.46600000000000003,"15min":0.39600000000000002},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.54600000000000004,"5min":9.8889999999999993,"15min":9.8889999999999993},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63300000000000001,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76600000000000001,"5min":4.5720000000000001,"15min":4.5720000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59399999999999997,"15min":0.57599999999999996},"min":{"1min":0.45600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":0.53400000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.60099999999999998},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93100000000000005,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.872,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.68200000000000005,"15min":0.64600000000000002},"min":{"1min":0.48999999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82999999999999996,"5min":5.915,"15min":5.915},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1080000000000001,"5min":1.288,"15min":1.288},"last":0.61799999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.622,"15min":0.60599999999999998},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.84199999999999997,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66100000000000003,"15min":0.60599999999999998},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.93600000000000005,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1753088,"data_stored":1161239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.314,"15min":0.31},"min":{"1min":0.26500000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.221,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.49099999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35999999999999999,"15min":0.36599999999999999},"min":{"1min":0.23899999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48599999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.23100000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.499,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.27400000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.32300000000000001,"15min":0.317},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.376,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51800000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.29499999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81899999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53500000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.93000000000000005,"5min":0.996,"15min":0.996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67600000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.40500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90400000000000003,"5min":1.026,"15min":1.026},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.46000000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89000000000000001,"5min":1.177,"15min":1.177},"last":0.59299999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.443,"5min":0.374,"15min":0.374},"max":{"1min":0.85099999999999998,"5min":1.131,"15min":1.131},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:39:55.059 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:39:55.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.190+0000 7ff1bb675640 1 Processor -- start 2023-11-04T01:39:55.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.190+0000 7ff1bb675640 1 -- start start 2023-11-04T01:39:55.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.191+0000 7ff1bb675640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff1b40b0ae0 0x7ff1b40ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.191+0000 7ff1bb675640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff1b406db20 0x7ff1b415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.191+0000 7ff1bb675640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b40b4110 con 0x7ff1b4159c70 2023-11-04T01:39:55.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.191+0000 7ff1bb675640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b40b49b0 con 0x7ff1b40b0ae0 2023-11-04T01:39:55.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.191+0000 7ff1bb675640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b40b43f0 con 0x7ff1b406db20 2023-11-04T01:39:55.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.191+0000 7ff1b8c10640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff1b40b0ae0 0x7ff1b40ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.191+0000 7ff1b9411640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff1b4159c70 0x7ff1b40b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58124/0 (socket says 172.21.15.114:58124) 2023-11-04T01:39:55.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.191+0000 7ff1b8c10640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff1b40b0ae0 0x7ff1b40ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54648/0 (socket says 172.21.15.114:54648) 2023-11-04T01:39:55.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.191+0000 7ff1b9411640 1 -- 172.21.15.114:0/2956530418 learned_addr learned my addr 172.21.15.114:0/2956530418 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:55.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.192+0000 7ff1b8c10640 1 -- 172.21.15.114:0/2956530418 >> v2:172.21.15.141:3300/0 conn(0x7ff1b406db20 msgr2=0x7ff1b415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:55.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.192+0000 7ff1b9c12640 1 --2- 172.21.15.114:0/2956530418 >> v2:172.21.15.141:3300/0 conn(0x7ff1b406db20 0x7ff1b415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.192+0000 7ff1b8c10640 1 --2- 172.21.15.114:0/2956530418 >> v2:172.21.15.141:3300/0 conn(0x7ff1b406db20 0x7ff1b415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.192+0000 7ff1b8c10640 1 -- 172.21.15.114:0/2956530418 >> v1:172.21.15.114:6789/0 conn(0x7ff1b4159c70 legacy=0x7ff1b40b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.192+0000 7ff1abfff640 1 -- 172.21.15.114:0/2956530418 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054396157 0 0) 0x7ff1b40b4110 con 0x7ff1b4159c70 2023-11-04T01:39:55.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.192+0000 7ff1b8c10640 1 -- 172.21.15.114:0/2956530418 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b40b46d0 con 0x7ff1b40b0ae0 2023-11-04T01:39:55.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.192+0000 7ff1b9c12640 1 --2- 172.21.15.114:0/2956530418 >> v2:172.21.15.141:3300/0 conn(0x7ff1b406db20 0x7ff1b415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:55.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.192+0000 7ff1b8c10640 1 --2- 172.21.15.114:0/2956530418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b40b0ae0 0x7ff1b40ce370 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4070580 tx=0x7ff1a402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303bb5c37f4649c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:55.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.192+0000 7ff1abfff640 1 -- 172.21.15.114:0/2956530418 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4031830 con 0x7ff1b40b0ae0 2023-11-04T01:39:55.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.192+0000 7ff1abfff640 1 -- 172.21.15.114:0/2956530418 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a4031990 con 0x7ff1b40b0ae0 2023-11-04T01:39:55.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.193+0000 7ff1abfff640 1 -- 172.21.15.114:0/2956530418 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4031d20 con 0x7ff1b40b0ae0 2023-11-04T01:39:55.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.193+0000 7ff1bb675640 1 -- 172.21.15.114:0/2956530418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b40b0ae0 msgr2=0x7ff1b40ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.193+0000 7ff1bb675640 1 --2- 172.21.15.114:0/2956530418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b40b0ae0 0x7ff1b40ce370 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4070580 tx=0x7ff1a402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.193+0000 7ff1bb675640 1 -- 172.21.15.114:0/2956530418 shutdown_connections 2023-11-04T01:39:55.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.193+0000 7ff1bb675640 1 --2- 172.21.15.114:0/2956530418 >> v2:172.21.15.141:3300/0 conn(0x7ff1b406db20 0x7ff1b415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.193+0000 7ff1bb675640 1 --2- 172.21.15.114:0/2956530418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b40b0ae0 0x7ff1b40ce370 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.193+0000 7ff1bb675640 1 -- 172.21.15.114:0/2956530418 >> 172.21.15.114:0/2956530418 conn(0x7ff1b40ce950 msgr2=0x7ff1b40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:55.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.193+0000 7ff1bb675640 1 -- 172.21.15.114:0/2956530418 shutdown_connections 2023-11-04T01:39:55.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.193+0000 7ff1bb675640 1 -- 172.21.15.114:0/2956530418 wait complete. 2023-11-04T01:39:55.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.194+0000 7ff1bb675640 1 Processor -- start 2023-11-04T01:39:55.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.194+0000 7ff1bb675640 1 -- start start 2023-11-04T01:39:55.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1bb675640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1b406db20 0x7ff1b4146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1bb675640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1b40b0ae0 0x7ff1b415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1bb675640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b4159c70 0x7ff1b4157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1bb675640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b4146db0 con 0x7ff1b4159c70 2023-11-04T01:39:55.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1bb675640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b415c970 con 0x7ff1b40b0ae0 2023-11-04T01:39:55.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1bb675640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b415cc50 con 0x7ff1b406db20 2023-11-04T01:39:55.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1b9c12640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b4159c70 0x7ff1b4157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1b9c12640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b4159c70 0x7ff1b4157d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54656/0 (socket says 172.21.15.114:54656) 2023-11-04T01:39:55.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1b9c12640 1 -- 172.21.15.114:0/1108644982 learned_addr learned my addr 172.21.15.114:0/1108644982 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:55.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1b8c10640 1 --2- 172.21.15.114:0/1108644982 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1b40b0ae0 0x7ff1b415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1b9411640 1 --2- 172.21.15.114:0/1108644982 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1b406db20 0x7ff1b4146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1b9c12640 1 -- 172.21.15.114:0/1108644982 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1b406db20 msgr2=0x7ff1b4146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1b9c12640 1 --2- 172.21.15.114:0/1108644982 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1b406db20 0x7ff1b4146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1b9c12640 1 -- 172.21.15.114:0/1108644982 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1b40b0ae0 msgr2=0x7ff1b415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1b9c12640 1 --2- 172.21.15.114:0/1108644982 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1b40b0ae0 0x7ff1b415ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1b9c12640 1 -- 172.21.15.114:0/1108644982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a4009400 con 0x7ff1b4159c70 2023-11-04T01:39:55.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.195+0000 7ff1b9c12640 1 --2- 172.21.15.114:0/1108644982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b4159c70 0x7ff1b4157d20 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00c7c0 tx=0x7ff1ac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:55.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.196+0000 7ff1a9ffb640 1 -- 172.21.15.114:0/1108644982 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac004230 con 0x7ff1b4159c70 2023-11-04T01:39:55.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.196+0000 7ff1a9ffb640 1 -- 172.21.15.114:0/1108644982 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac004390 con 0x7ff1b4159c70 2023-11-04T01:39:55.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.196+0000 7ff1a9ffb640 1 -- 172.21.15.114:0/1108644982 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac007860 con 0x7ff1b4159c70 2023-11-04T01:39:55.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.196+0000 7ff1bb675640 1 -- 172.21.15.114:0/1108644982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b415cf30 con 0x7ff1b4159c70 2023-11-04T01:39:55.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.196+0000 7ff1bb675640 1 -- 172.21.15.114:0/1108644982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b4146aa0 con 0x7ff1b4159c70 2023-11-04T01:39:55.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.197+0000 7ff1bb675640 1 -- 172.21.15.114:0/1108644982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b4165ef0 con 0x7ff1b4159c70 2023-11-04T01:39:55.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.197+0000 7ff1a9ffb640 1 -- 172.21.15.114:0/1108644982 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff1ac0079c0 con 0x7ff1b4159c70 2023-11-04T01:39:55.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.198+0000 7ff1a9ffb640 1 --2- 172.21.15.114:0/1108644982 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff19806ae70 0x7ff19806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.198+0000 7ff1a9ffb640 1 -- 172.21.15.114:0/1108644982 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7ff1ac089e60 con 0x7ff1b4159c70 2023-11-04T01:39:55.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.198+0000 7ff1b9411640 1 --2- 172.21.15.114:0/1108644982 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff19806ae70 0x7ff19806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.198+0000 7ff1b9411640 1 --2- 172.21.15.114:0/1108644982 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff19806ae70 0x7ff19806d330 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff1b00012e0 tx=0x7ff1b0007ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:55.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.202+0000 7ff1a9ffb640 1 -- 172.21.15.114:0/1108644982 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff1ac054a50 con 0x7ff1b4159c70 2023-11-04T01:39:55.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.367+0000 7ff1bb675640 1 -- 172.21.15.114:0/1108644982 --> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1b415d120 con 0x7ff19806ae70 2023-11-04T01:39:55.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.379+0000 7ff1a9ffb640 1 -- 172.21.15.114:0/1108644982 <== mgr.4105 v2:172.21.15.114:6832/1641722674 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+532153 (secure 0 0 0) 0x7ff1b415d120 con 0x7ff19806ae70 2023-11-04T01:39:55.389 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:55.393 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-11-04T01:39:55.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.383+0000 7ff1bb675640 1 -- 172.21.15.114:0/1108644982 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff19806ae70 msgr2=0x7ff19806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.384+0000 7ff1bb675640 1 --2- 172.21.15.114:0/1108644982 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff19806ae70 0x7ff19806d330 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff1b00012e0 tx=0x7ff1b0007ed0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.384+0000 7ff1bb675640 1 -- 172.21.15.114:0/1108644982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b4159c70 msgr2=0x7ff1b4157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.384+0000 7ff1bb675640 1 --2- 172.21.15.114:0/1108644982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b4159c70 0x7ff1b4157d20 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00c7c0 tx=0x7ff1ac00cc80 comp rx=0 tx=0).stop 2023-11-04T01:39:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.384+0000 7ff1bb675640 1 -- 172.21.15.114:0/1108644982 shutdown_connections 2023-11-04T01:39:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.384+0000 7ff1bb675640 1 --2- 172.21.15.114:0/1108644982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b4159c70 0x7ff1b4157d20 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.384+0000 7ff1bb675640 1 --2- 172.21.15.114:0/1108644982 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff19806ae70 0x7ff19806d330 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.384+0000 7ff1bb675640 1 --2- 172.21.15.114:0/1108644982 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff1b40b0ae0 0x7ff1b415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.384+0000 7ff1bb675640 1 --2- 172.21.15.114:0/1108644982 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff1b406db20 0x7ff1b4146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.384+0000 7ff1bb675640 1 -- 172.21.15.114:0/1108644982 >> 172.21.15.114:0/1108644982 conn(0x7ff1b40ce950 msgr2=0x7ff1b40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.384+0000 7ff1bb675640 1 -- 172.21.15.114:0/1108644982 shutdown_connections 2023-11-04T01:39:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.384+0000 7ff1bb675640 1 -- 172.21.15.114:0/1108644982 wait complete. 2023-11-04T01:39:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2023-11-04T01:39:53.900824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":324,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247304,"kb_used_data":10332,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754727416,"statfs":{"total":773094113280,"available":772840873984,"internally_reserved":0,"allocated":10579968,"data_stored":5799916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001056"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.118788+0000","last_change":"2023-11-04T01:39:52.111293+0000","last_active":"2023-11-04T01:39:52.118788+0000","last_peered":"2023-11-04T01:39:52.118788+0000","last_clean":"2023-11-04T01:39:52.118788+0000","last_became_active":"2023-11-04T01:39:52.110996+0000","last_became_peered":"2023-11-04T01:39:52.110996+0000","last_unstale":"2023-11-04T01:39:52.118788+0000","last_undegraded":"2023-11-04T01:39:52.118788+0000","last_fullsized":"2023-11-04T01:39:52.118788+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:48.114823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114257+0000","last_change":"2023-11-04T01:39:52.108536+0000","last_active":"2023-11-04T01:39:52.114257+0000","last_peered":"2023-11-04T01:39:52.114257+0000","last_clean":"2023-11-04T01:39:52.114257+0000","last_became_active":"2023-11-04T01:39:52.108284+0000","last_became_peered":"2023-11-04T01:39:52.108284+0000","last_unstale":"2023-11-04T01:39:52.114257+0000","last_undegraded":"2023-11-04T01:39:52.114257+0000","last_fullsized":"2023-11-04T01:39:52.114257+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:31:50.126169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.112632+0000","last_change":"2023-11-04T01:39:52.109739+0000","last_active":"2023-11-04T01:39:52.112632+0000","last_peered":"2023-11-04T01:39:52.112632+0000","last_clean":"2023-11-04T01:39:52.112632+0000","last_became_active":"2023-11-04T01:39:52.109435+0000","last_became_peered":"2023-11-04T01:39:52.109435+0000","last_unstale":"2023-11-04T01:39:52.112632+0000","last_undegraded":"2023-11-04T01:39:52.112632+0000","last_fullsized":"2023-11-04T01:39:52.112632+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:42:48.684260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.120702+0000","last_change":"2023-11-04T01:39:52.115553+0000","last_active":"2023-11-04T01:39:52.120702+0000","last_peered":"2023-11-04T01:39:52.120702+0000","last_clean":"2023-11-04T01:39:52.120702+0000","last_became_active":"2023-11-04T01:39:52.115300+0000","last_became_peered":"2023-11-04T01:39:52.115300+0000","last_unstale":"2023-11-04T01:39:52.120702+0000","last_undegraded":"2023-11-04T01:39:52.120702+0000","last_fullsized":"2023-11-04T01:39:52.120702+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:28:22.489126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.107893+0000","last_change":"2023-11-04T01:39:52.103405+0000","last_active":"2023-11-04T01:39:52.107893+0000","last_peered":"2023-11-04T01:39:52.107893+0000","last_clean":"2023-11-04T01:39:52.107893+0000","last_became_active":"2023-11-04T01:39:52.103149+0000","last_became_peered":"2023-11-04T01:39:52.103149+0000","last_unstale":"2023-11-04T01:39:52.107893+0000","last_undegraded":"2023-11-04T01:39:52.107893+0000","last_fullsized":"2023-11-04T01:39:52.107893+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:55.171219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.112815+0000","last_change":"2023-11-04T01:39:52.107860+0000","last_active":"2023-11-04T01:39:52.112815+0000","last_peered":"2023-11-04T01:39:52.112815+0000","last_clean":"2023-11-04T01:39:52.112815+0000","last_became_active":"2023-11-04T01:39:52.107614+0000","last_became_peered":"2023-11-04T01:39:52.107614+0000","last_unstale":"2023-11-04T01:39:52.112815+0000","last_undegraded":"2023-11-04T01:39:52.112815+0000","last_fullsized":"2023-11-04T01:39:52.112815+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:58.777826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.113229+0000","last_change":"2023-11-04T01:39:52.109590+0000","last_active":"2023-11-04T01:39:52.113229+0000","last_peered":"2023-11-04T01:39:52.113229+0000","last_clean":"2023-11-04T01:39:52.113229+0000","last_became_active":"2023-11-04T01:39:52.108037+0000","last_became_peered":"2023-11-04T01:39:52.108037+0000","last_unstale":"2023-11-04T01:39:52.113229+0000","last_undegraded":"2023-11-04T01:39:52.113229+0000","last_fullsized":"2023-11-04T01:39:52.113229+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:15:53.823846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.115207+0000","last_change":"2023-11-04T01:39:52.113628+0000","last_active":"2023-11-04T01:39:52.115207+0000","last_peered":"2023-11-04T01:39:52.115207+0000","last_clean":"2023-11-04T01:39:52.115207+0000","last_became_active":"2023-11-04T01:39:52.113352+0000","last_became_peered":"2023-11-04T01:39:52.113352+0000","last_unstale":"2023-11-04T01:39:52.115207+0000","last_undegraded":"2023-11-04T01:39:52.115207+0000","last_fullsized":"2023-11-04T01:39:52.115207+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:11:45.914450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.119677+0000","last_change":"2023-11-04T01:39:52.116049+0000","last_active":"2023-11-04T01:39:52.119677+0000","last_peered":"2023-11-04T01:39:52.119677+0000","last_clean":"2023-11-04T01:39:52.119677+0000","last_became_active":"2023-11-04T01:39:52.115782+0000","last_became_peered":"2023-11-04T01:39:52.115782+0000","last_unstale":"2023-11-04T01:39:52.119677+0000","last_undegraded":"2023-11-04T01:39:52.119677+0000","last_fullsized":"2023-11-04T01:39:52.119677+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:48.491689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.118907+0000","last_change":"2023-11-04T01:39:52.112341+0000","last_active":"2023-11-04T01:39:52.118907+0000","last_peered":"2023-11-04T01:39:52.118907+0000","last_clean":"2023-11-04T01:39:52.118907+0000","last_became_active":"2023-11-04T01:39:52.111621+0000","last_became_peered":"2023-11-04T01:39:52.111621+0000","last_unstale":"2023-11-04T01:39:52.118907+0000","last_undegraded":"2023-11-04T01:39:52.118907+0000","last_fullsized":"2023-11-04T01:39:52.118907+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:06.419673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114214+0000","last_change":"2023-11-04T01:39:52.107330+0000","last_active":"2023-11-04T01:39:52.114214+0000","last_peered":"2023-11-04T01:39:52.114214+0000","last_clean":"2023-11-04T01:39:52.114214+0000","last_became_active":"2023-11-04T01:39:52.107065+0000","last_became_peered":"2023-11-04T01:39:52.107065+0000","last_unstale":"2023-11-04T01:39:52.114214+0000","last_undegraded":"2023-11-04T01:39:52.114214+0000","last_fullsized":"2023-11-04T01:39:52.114214+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:18.056532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.122271+0000","last_change":"2023-11-04T01:39:52.118620+0000","last_active":"2023-11-04T01:39:52.122271+0000","last_peered":"2023-11-04T01:39:52.122271+0000","last_clean":"2023-11-04T01:39:52.122271+0000","last_became_active":"2023-11-04T01:39:52.118372+0000","last_became_peered":"2023-11-04T01:39:52.118372+0000","last_unstale":"2023-11-04T01:39:52.122271+0000","last_undegraded":"2023-11-04T01:39:52.122271+0000","last_fullsized":"2023-11-04T01:39:52.122271+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:24.498771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.112900+0000","last_change":"2023-11-04T01:39:52.109196+0000","last_active":"2023-11-04T01:39:52.112900+0000","last_peered":"2023-11-04T01:39:52.112900+0000","last_clean":"2023-11-04T01:39:52.112900+0000","last_became_active":"2023-11-04T01:39:52.108906+0000","last_became_peered":"2023-11-04T01:39:52.108906+0000","last_unstale":"2023-11-04T01:39:52.112900+0000","last_undegraded":"2023-11-04T01:39:52.112900+0000","last_fullsized":"2023-11-04T01:39:52.112900+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:19.069016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.110981+0000","last_change":"2023-11-04T01:39:52.107584+0000","last_active":"2023-11-04T01:39:52.110981+0000","last_peered":"2023-11-04T01:39:52.110981+0000","last_clean":"2023-11-04T01:39:52.110981+0000","last_became_active":"2023-11-04T01:39:52.107316+0000","last_became_peered":"2023-11-04T01:39:52.107316+0000","last_unstale":"2023-11-04T01:39:52.110981+0000","last_undegraded":"2023-11-04T01:39:52.110981+0000","last_fullsized":"2023-11-04T01:39:52.110981+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:33.273803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.112780+0000","last_change":"2023-11-04T01:39:52.108588+0000","last_active":"2023-11-04T01:39:52.112780+0000","last_peered":"2023-11-04T01:39:52.112780+0000","last_clean":"2023-11-04T01:39:52.112780+0000","last_became_active":"2023-11-04T01:39:52.108232+0000","last_became_peered":"2023-11-04T01:39:52.108232+0000","last_unstale":"2023-11-04T01:39:52.112780+0000","last_undegraded":"2023-11-04T01:39:52.112780+0000","last_fullsized":"2023-11-04T01:39:52.112780+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:56.890627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.118895+0000","last_change":"2023-11-04T01:39:52.112183+0000","last_active":"2023-11-04T01:39:52.118895+0000","last_peered":"2023-11-04T01:39:52.118895+0000","last_clean":"2023-11-04T01:39:52.118895+0000","last_became_active":"2023-11-04T01:39:52.111916+0000","last_became_peered":"2023-11-04T01:39:52.111916+0000","last_unstale":"2023-11-04T01:39:52.118895+0000","last_undegraded":"2023-11-04T01:39:52.118895+0000","last_fullsized":"2023-11-04T01:39:52.118895+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:58.063749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114534+0000","last_change":"2023-11-04T01:39:52.109548+0000","last_active":"2023-11-04T01:39:52.114534+0000","last_peered":"2023-11-04T01:39:52.114534+0000","last_clean":"2023-11-04T01:39:52.114534+0000","last_became_active":"2023-11-04T01:39:52.108761+0000","last_became_peered":"2023-11-04T01:39:52.108761+0000","last_unstale":"2023-11-04T01:39:52.114534+0000","last_undegraded":"2023-11-04T01:39:52.114534+0000","last_fullsized":"2023-11-04T01:39:52.114534+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:44.903258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.111149+0000","last_change":"2023-11-04T01:39:52.106980+0000","last_active":"2023-11-04T01:39:52.111149+0000","last_peered":"2023-11-04T01:39:52.111149+0000","last_clean":"2023-11-04T01:39:52.111149+0000","last_became_active":"2023-11-04T01:39:52.106681+0000","last_became_peered":"2023-11-04T01:39:52.106681+0000","last_unstale":"2023-11-04T01:39:52.111149+0000","last_undegraded":"2023-11-04T01:39:52.111149+0000","last_fullsized":"2023-11-04T01:39:52.111149+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:11.209671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.111037+0000","last_change":"2023-11-04T01:39:52.107919+0000","last_active":"2023-11-04T01:39:52.111037+0000","last_peered":"2023-11-04T01:39:52.111037+0000","last_clean":"2023-11-04T01:39:52.111037+0000","last_became_active":"2023-11-04T01:39:52.107659+0000","last_became_peered":"2023-11-04T01:39:52.107659+0000","last_unstale":"2023-11-04T01:39:52.111037+0000","last_undegraded":"2023-11-04T01:39:52.111037+0000","last_fullsized":"2023-11-04T01:39:52.111037+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:24:30.092914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.108048+0000","last_change":"2023-11-04T01:39:52.102804+0000","last_active":"2023-11-04T01:39:52.108048+0000","last_peered":"2023-11-04T01:39:52.108048+0000","last_clean":"2023-11-04T01:39:52.108048+0000","last_became_active":"2023-11-04T01:39:52.101972+0000","last_became_peered":"2023-11-04T01:39:52.101972+0000","last_unstale":"2023-11-04T01:39:52.108048+0000","last_undegraded":"2023-11-04T01:39:52.108048+0000","last_fullsized":"2023-11-04T01:39:52.108048+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:14.191164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114306+0000","last_change":"2023-11-04T01:39:52.108915+0000","last_active":"2023-11-04T01:39:52.114306+0000","last_peered":"2023-11-04T01:39:52.114306+0000","last_clean":"2023-11-04T01:39:52.114306+0000","last_became_active":"2023-11-04T01:39:52.108311+0000","last_became_peered":"2023-11-04T01:39:52.108311+0000","last_unstale":"2023-11-04T01:39:52.114306+0000","last_undegraded":"2023-11-04T01:39:52.114306+0000","last_fullsized":"2023-11-04T01:39:52.114306+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:01.151684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.120218+0000","last_change":"2023-11-04T01:39:52.110708+0000","last_active":"2023-11-04T01:39:52.120218+0000","last_peered":"2023-11-04T01:39:52.120218+0000","last_clean":"2023-11-04T01:39:52.120218+0000","last_became_active":"2023-11-04T01:39:52.107892+0000","last_became_peered":"2023-11-04T01:39:52.107892+0000","last_unstale":"2023-11-04T01:39:52.120218+0000","last_undegraded":"2023-11-04T01:39:52.120218+0000","last_fullsized":"2023-11-04T01:39:52.120218+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:19.446214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.107022+0000","last_change":"2023-11-04T01:39:52.102291+0000","last_active":"2023-11-04T01:39:52.107022+0000","last_peered":"2023-11-04T01:39:52.107022+0000","last_clean":"2023-11-04T01:39:52.107022+0000","last_became_active":"2023-11-04T01:39:52.101963+0000","last_became_peered":"2023-11-04T01:39:52.101963+0000","last_unstale":"2023-11-04T01:39:52.107022+0000","last_undegraded":"2023-11-04T01:39:52.107022+0000","last_fullsized":"2023-11-04T01:39:52.107022+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:54.718426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.109421+0000","last_change":"2023-11-04T01:39:52.107440+0000","last_active":"2023-11-04T01:39:52.109421+0000","last_peered":"2023-11-04T01:39:52.109421+0000","last_clean":"2023-11-04T01:39:52.109421+0000","last_became_active":"2023-11-04T01:39:52.106712+0000","last_became_peered":"2023-11-04T01:39:52.106712+0000","last_unstale":"2023-11-04T01:39:52.109421+0000","last_undegraded":"2023-11-04T01:39:52.109421+0000","last_fullsized":"2023-11-04T01:39:52.109421+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:20.966615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114304+0000","last_change":"2023-11-04T01:39:52.107810+0000","last_active":"2023-11-04T01:39:52.114304+0000","last_peered":"2023-11-04T01:39:52.114304+0000","last_clean":"2023-11-04T01:39:52.114304+0000","last_became_active":"2023-11-04T01:39:52.107520+0000","last_became_peered":"2023-11-04T01:39:52.107520+0000","last_unstale":"2023-11-04T01:39:52.114304+0000","last_undegraded":"2023-11-04T01:39:52.114304+0000","last_fullsized":"2023-11-04T01:39:52.114304+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:06:31.062913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.118925+0000","last_change":"2023-11-04T01:39:52.112433+0000","last_active":"2023-11-04T01:39:52.118925+0000","last_peered":"2023-11-04T01:39:52.118925+0000","last_clean":"2023-11-04T01:39:52.118925+0000","last_became_active":"2023-11-04T01:39:52.111267+0000","last_became_peered":"2023-11-04T01:39:52.111267+0000","last_unstale":"2023-11-04T01:39:52.118925+0000","last_undegraded":"2023-11-04T01:39:52.118925+0000","last_fullsized":"2023-11-04T01:39:52.118925+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:42.736642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.115995+0000","last_change":"2023-11-04T01:39:52.113363+0000","last_active":"2023-11-04T01:39:52.115995+0000","last_peered":"2023-11-04T01:39:52.115995+0000","last_clean":"2023-11-04T01:39:52.115995+0000","last_became_active":"2023-11-04T01:39:52.113106+0000","last_became_peered":"2023-11-04T01:39:52.113106+0000","last_unstale":"2023-11-04T01:39:52.115995+0000","last_undegraded":"2023-11-04T01:39:52.115995+0000","last_fullsized":"2023-11-04T01:39:52.115995+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:36.216029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.123209+0000","last_change":"2023-11-04T01:39:52.118051+0000","last_active":"2023-11-04T01:39:52.123209+0000","last_peered":"2023-11-04T01:39:52.123209+0000","last_clean":"2023-11-04T01:39:52.123209+0000","last_became_active":"2023-11-04T01:39:52.117780+0000","last_became_peered":"2023-11-04T01:39:52.117780+0000","last_unstale":"2023-11-04T01:39:52.123209+0000","last_undegraded":"2023-11-04T01:39:52.123209+0000","last_fullsized":"2023-11-04T01:39:52.123209+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:48:31.873794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.106789+0000","last_change":"2023-11-04T01:39:52.102812+0000","last_active":"2023-11-04T01:39:52.106789+0000","last_peered":"2023-11-04T01:39:52.106789+0000","last_clean":"2023-11-04T01:39:52.106789+0000","last_became_active":"2023-11-04T01:39:52.102540+0000","last_became_peered":"2023-11-04T01:39:52.102540+0000","last_unstale":"2023-11-04T01:39:52.106789+0000","last_undegraded":"2023-11-04T01:39:52.106789+0000","last_fullsized":"2023-11-04T01:39:52.106789+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:13:05.237517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.121015+0000","last_change":"2023-11-04T01:39:52.119229+0000","last_active":"2023-11-04T01:39:52.121015+0000","last_peered":"2023-11-04T01:39:52.121015+0000","last_clean":"2023-11-04T01:39:52.121015+0000","last_became_active":"2023-11-04T01:39:52.118464+0000","last_became_peered":"2023-11-04T01:39:52.118464+0000","last_unstale":"2023-11-04T01:39:52.121015+0000","last_undegraded":"2023-11-04T01:39:52.121015+0000","last_fullsized":"2023-11-04T01:39:52.121015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:25.481450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.118722+0000","last_change":"2023-11-04T01:39:52.110163+0000","last_active":"2023-11-04T01:39:52.118722+0000","last_peered":"2023-11-04T01:39:52.118722+0000","last_clean":"2023-11-04T01:39:52.118722+0000","last_became_active":"2023-11-04T01:39:52.109822+0000","last_became_peered":"2023-11-04T01:39:52.109822+0000","last_unstale":"2023-11-04T01:39:52.118722+0000","last_undegraded":"2023-11-04T01:39:52.118722+0000","last_fullsized":"2023-11-04T01:39:52.118722+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:32:04.335242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114050+0000","last_change":"2023-11-04T01:39:52.108998+0000","last_active":"2023-11-04T01:39:52.114050+0000","last_peered":"2023-11-04T01:39:52.114050+0000","last_clean":"2023-11-04T01:39:52.114050+0000","last_became_active":"2023-11-04T01:39:52.108710+0000","last_became_peered":"2023-11-04T01:39:52.108710+0000","last_unstale":"2023-11-04T01:39:52.114050+0000","last_undegraded":"2023-11-04T01:39:52.114050+0000","last_fullsized":"2023-11-04T01:39:52.114050+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:59.730954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.119395+0000","last_change":"2023-11-04T01:39:52.111256+0000","last_active":"2023-11-04T01:39:52.119395+0000","last_peered":"2023-11-04T01:39:52.119395+0000","last_clean":"2023-11-04T01:39:52.119395+0000","last_became_active":"2023-11-04T01:39:52.111001+0000","last_became_peered":"2023-11-04T01:39:52.111001+0000","last_unstale":"2023-11-04T01:39:52.119395+0000","last_undegraded":"2023-11-04T01:39:52.119395+0000","last_fullsized":"2023-11-04T01:39:52.119395+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:09.131723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.093229+0000","last_change":"2023-11-04T01:39:51.113337+0000","last_active":"2023-11-04T01:39:52.093229+0000","last_peered":"2023-11-04T01:39:52.093229+0000","last_clean":"2023-11-04T01:39:52.093229+0000","last_became_active":"2023-11-04T01:39:51.113070+0000","last_became_peered":"2023-11-04T01:39:51.113070+0000","last_unstale":"2023-11-04T01:39:52.093229+0000","last_undegraded":"2023-11-04T01:39:52.093229+0000","last_fullsized":"2023-11-04T01:39:52.093229+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:26:05.831988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.104090+0000","last_change":"2023-11-04T01:39:00.904362+0000","last_active":"2023-11-04T01:39:51.104090+0000","last_peered":"2023-11-04T01:39:51.104090+0000","last_clean":"2023-11-04T01:39:51.104090+0000","last_became_active":"2023-11-04T01:39:00.903861+0000","last_became_peered":"2023-11-04T01:39:00.903861+0000","last_unstale":"2023-11-04T01:39:51.104090+0000","last_undegraded":"2023-11-04T01:39:51.104090+0000","last_fullsized":"2023-11-04T01:39:51.104090+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:08:13.731370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096123+0000","last_change":"2023-11-04T01:39:01.899189+0000","last_active":"2023-11-04T01:39:51.096123+0000","last_peered":"2023-11-04T01:39:51.096123+0000","last_clean":"2023-11-04T01:39:51.096123+0000","last_became_active":"2023-11-04T01:38:59.885803+0000","last_became_peered":"2023-11-04T01:38:59.885803+0000","last_unstale":"2023-11-04T01:39:51.096123+0000","last_undegraded":"2023-11-04T01:39:51.096123+0000","last_fullsized":"2023-11-04T01:39:51.096123+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:13.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061642800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.101278+0000","last_change":"2023-11-04T01:38:02.156342+0000","last_active":"2023-11-04T01:39:51.101278+0000","last_peered":"2023-11-04T01:39:51.101278+0000","last_clean":"2023-11-04T01:39:51.101278+0000","last_became_active":"2023-11-04T01:38:00.708159+0000","last_became_peered":"2023-11-04T01:38:00.708159+0000","last_unstale":"2023-11-04T01:39:51.101278+0000","last_undegraded":"2023-11-04T01:39:51.101278+0000","last_fullsized":"2023-11-04T01:39:51.101278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000435213,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114638+0000","last_change":"2023-11-04T01:39:52.111776+0000","last_active":"2023-11-04T01:39:52.114638+0000","last_peered":"2023-11-04T01:39:52.114638+0000","last_clean":"2023-11-04T01:39:52.114638+0000","last_became_active":"2023-11-04T01:39:52.111487+0000","last_became_peered":"2023-11-04T01:39:52.111487+0000","last_unstale":"2023-11-04T01:39:52.114638+0000","last_undegraded":"2023-11-04T01:39:52.114638+0000","last_fullsized":"2023-11-04T01:39:52.114638+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:12:59.990159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.124928+0000","last_change":"2023-11-04T01:39:51.110923+0000","last_active":"2023-11-04T01:39:52.124928+0000","last_peered":"2023-11-04T01:39:52.124928+0000","last_clean":"2023-11-04T01:39:52.124928+0000","last_became_active":"2023-11-04T01:39:51.110590+0000","last_became_peered":"2023-11-04T01:39:51.110590+0000","last_unstale":"2023-11-04T01:39:52.124928+0000","last_undegraded":"2023-11-04T01:39:52.124928+0000","last_fullsized":"2023-11-04T01:39:52.124928+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:34:21.864532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099491+0000","last_change":"2023-11-04T01:39:00.902826+0000","last_active":"2023-11-04T01:39:51.099491+0000","last_peered":"2023-11-04T01:39:51.099491+0000","last_clean":"2023-11-04T01:39:51.099491+0000","last_became_active":"2023-11-04T01:39:00.902547+0000","last_became_peered":"2023-11-04T01:39:00.902547+0000","last_unstale":"2023-11-04T01:39:51.099491+0000","last_undegraded":"2023-11-04T01:39:51.099491+0000","last_fullsized":"2023-11-04T01:39:51.099491+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:54:08.817884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096743+0000","last_change":"2023-11-04T01:39:01.899633+0000","last_active":"2023-11-04T01:39:51.096743+0000","last_peered":"2023-11-04T01:39:51.096743+0000","last_clean":"2023-11-04T01:39:51.096743+0000","last_became_active":"2023-11-04T01:38:59.897690+0000","last_became_peered":"2023-11-04T01:38:59.897690+0000","last_unstale":"2023-11-04T01:39:51.096743+0000","last_undegraded":"2023-11-04T01:39:51.096743+0000","last_fullsized":"2023-11-04T01:39:51.096743+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:48.990734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069036800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103578+0000","last_change":"2023-11-04T01:38:02.362289+0000","last_active":"2023-11-04T01:39:51.103578+0000","last_peered":"2023-11-04T01:39:51.103578+0000","last_clean":"2023-11-04T01:39:51.103578+0000","last_became_active":"2023-11-04T01:38:00.710033+0000","last_became_peered":"2023-11-04T01:38:00.710033+0000","last_unstale":"2023-11-04T01:39:51.103578+0000","last_undegraded":"2023-11-04T01:39:51.103578+0000","last_fullsized":"2023-11-04T01:39:51.103578+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046467500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.118940+0000","last_change":"2023-11-04T01:39:52.117326+0000","last_active":"2023-11-04T01:39:52.118940+0000","last_peered":"2023-11-04T01:39:52.118940+0000","last_clean":"2023-11-04T01:39:52.118940+0000","last_became_active":"2023-11-04T01:39:52.117093+0000","last_became_peered":"2023-11-04T01:39:52.117093+0000","last_unstale":"2023-11-04T01:39:52.118940+0000","last_undegraded":"2023-11-04T01:39:52.118940+0000","last_fullsized":"2023-11-04T01:39:52.118940+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:57:15.655447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.103240+0000","last_change":"2023-11-04T01:39:51.107281+0000","last_active":"2023-11-04T01:39:52.103240+0000","last_peered":"2023-11-04T01:39:52.103240+0000","last_clean":"2023-11-04T01:39:52.103240+0000","last_became_active":"2023-11-04T01:39:51.106854+0000","last_became_peered":"2023-11-04T01:39:51.106854+0000","last_unstale":"2023-11-04T01:39:52.103240+0000","last_undegraded":"2023-11-04T01:39:52.103240+0000","last_fullsized":"2023-11-04T01:39:52.103240+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:15.533226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097517+0000","last_change":"2023-11-04T01:39:00.905727+0000","last_active":"2023-11-04T01:39:51.097517+0000","last_peered":"2023-11-04T01:39:51.097517+0000","last_clean":"2023-11-04T01:39:51.097517+0000","last_became_active":"2023-11-04T01:39:00.905379+0000","last_became_peered":"2023-11-04T01:39:00.905379+0000","last_unstale":"2023-11-04T01:39:51.097517+0000","last_undegraded":"2023-11-04T01:39:51.097517+0000","last_fullsized":"2023-11-04T01:39:51.097517+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:08.595749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103386+0000","last_change":"2023-11-04T01:39:02.289546+0000","last_active":"2023-11-04T01:39:51.103386+0000","last_peered":"2023-11-04T01:39:51.103386+0000","last_clean":"2023-11-04T01:39:51.103386+0000","last_became_active":"2023-11-04T01:38:59.894387+0000","last_became_peered":"2023-11-04T01:38:59.894387+0000","last_unstale":"2023-11-04T01:39:51.103386+0000","last_undegraded":"2023-11-04T01:39:51.103386+0000","last_fullsized":"2023-11-04T01:39:51.103386+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:12.983159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075893499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097333+0000","last_change":"2023-11-04T01:38:01.699171+0000","last_active":"2023-11-04T01:39:51.097333+0000","last_peered":"2023-11-04T01:39:51.097333+0000","last_clean":"2023-11-04T01:39:51.097333+0000","last_became_active":"2023-11-04T01:38:00.703927+0000","last_became_peered":"2023-11-04T01:38:00.703927+0000","last_unstale":"2023-11-04T01:39:51.097333+0000","last_undegraded":"2023-11-04T01:39:51.097333+0000","last_fullsized":"2023-11-04T01:39:51.097333+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072585499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.113384+0000","last_change":"2023-11-04T01:39:52.110164+0000","last_active":"2023-11-04T01:39:52.113384+0000","last_peered":"2023-11-04T01:39:52.113384+0000","last_clean":"2023-11-04T01:39:52.113384+0000","last_became_active":"2023-11-04T01:39:52.109803+0000","last_became_peered":"2023-11-04T01:39:52.109803+0000","last_unstale":"2023-11-04T01:39:52.113384+0000","last_undegraded":"2023-11-04T01:39:52.113384+0000","last_fullsized":"2023-11-04T01:39:52.113384+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:45.051199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.096252+0000","last_change":"2023-11-04T01:39:51.109382+0000","last_active":"2023-11-04T01:39:52.096252+0000","last_peered":"2023-11-04T01:39:52.096252+0000","last_clean":"2023-11-04T01:39:52.096252+0000","last_became_active":"2023-11-04T01:39:51.109126+0000","last_became_peered":"2023-11-04T01:39:51.109126+0000","last_unstale":"2023-11-04T01:39:52.096252+0000","last_undegraded":"2023-11-04T01:39:52.096252+0000","last_fullsized":"2023-11-04T01:39:52.096252+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:45.080459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103323+0000","last_change":"2023-11-04T01:39:00.907431+0000","last_active":"2023-11-04T01:39:51.103323+0000","last_peered":"2023-11-04T01:39:51.103323+0000","last_clean":"2023-11-04T01:39:51.103323+0000","last_became_active":"2023-11-04T01:39:00.907108+0000","last_became_peered":"2023-11-04T01:39:00.907108+0000","last_unstale":"2023-11-04T01:39:51.103323+0000","last_undegraded":"2023-11-04T01:39:51.103323+0000","last_fullsized":"2023-11-04T01:39:51.103323+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:19.094868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096329+0000","last_change":"2023-11-04T01:39:01.898969+0000","last_active":"2023-11-04T01:39:51.096329+0000","last_peered":"2023-11-04T01:39:51.096329+0000","last_clean":"2023-11-04T01:39:51.096329+0000","last_became_active":"2023-11-04T01:38:59.890578+0000","last_became_peered":"2023-11-04T01:38:59.890578+0000","last_unstale":"2023-11-04T01:39:51.096329+0000","last_undegraded":"2023-11-04T01:39:51.096329+0000","last_fullsized":"2023-11-04T01:39:51.096329+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:55.167791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073951900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097426+0000","last_change":"2023-11-04T01:38:02.156160+0000","last_active":"2023-11-04T01:39:51.097426+0000","last_peered":"2023-11-04T01:39:51.097426+0000","last_clean":"2023-11-04T01:39:51.097426+0000","last_became_active":"2023-11-04T01:38:00.709137+0000","last_became_peered":"2023-11-04T01:38:00.709137+0000","last_unstale":"2023-11-04T01:39:51.097426+0000","last_undegraded":"2023-11-04T01:39:51.097426+0000","last_fullsized":"2023-11-04T01:39:51.097426+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028239399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.116404+0000","last_change":"2023-11-04T01:39:52.114057+0000","last_active":"2023-11-04T01:39:52.116404+0000","last_peered":"2023-11-04T01:39:52.116404+0000","last_clean":"2023-11-04T01:39:52.116404+0000","last_became_active":"2023-11-04T01:39:52.113479+0000","last_became_peered":"2023-11-04T01:39:52.113479+0000","last_unstale":"2023-11-04T01:39:52.116404+0000","last_undegraded":"2023-11-04T01:39:52.116404+0000","last_fullsized":"2023-11-04T01:39:52.116404+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:43.747865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.124387+0000","last_change":"2023-11-04T01:39:51.107732+0000","last_active":"2023-11-04T01:39:52.124387+0000","last_peered":"2023-11-04T01:39:52.124387+0000","last_clean":"2023-11-04T01:39:52.124387+0000","last_became_active":"2023-11-04T01:39:51.107483+0000","last_became_peered":"2023-11-04T01:39:51.107483+0000","last_unstale":"2023-11-04T01:39:52.124387+0000","last_undegraded":"2023-11-04T01:39:52.124387+0000","last_fullsized":"2023-11-04T01:39:52.124387+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:21.123314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094525+0000","last_change":"2023-11-04T01:39:00.905486+0000","last_active":"2023-11-04T01:39:51.094525+0000","last_peered":"2023-11-04T01:39:51.094525+0000","last_clean":"2023-11-04T01:39:51.094525+0000","last_became_active":"2023-11-04T01:39:00.905221+0000","last_became_peered":"2023-11-04T01:39:00.905221+0000","last_unstale":"2023-11-04T01:39:51.094525+0000","last_undegraded":"2023-11-04T01:39:51.094525+0000","last_fullsized":"2023-11-04T01:39:51.094525+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:16.807464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098973+0000","last_change":"2023-11-04T01:39:02.039221+0000","last_active":"2023-11-04T01:39:51.098973+0000","last_peered":"2023-11-04T01:39:51.098973+0000","last_clean":"2023-11-04T01:39:51.098973+0000","last_became_active":"2023-11-04T01:38:59.897804+0000","last_became_peered":"2023-11-04T01:38:59.897804+0000","last_unstale":"2023-11-04T01:39:51.098973+0000","last_undegraded":"2023-11-04T01:39:51.098973+0000","last_fullsized":"2023-11-04T01:39:51.098973+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:38:29.900299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038141100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.095167+0000","last_change":"2023-11-04T01:38:01.698196+0000","last_active":"2023-11-04T01:39:51.095167+0000","last_peered":"2023-11-04T01:39:51.095167+0000","last_clean":"2023-11-04T01:39:51.095167+0000","last_became_active":"2023-11-04T01:38:00.705451+0000","last_became_peered":"2023-11-04T01:38:00.705451+0000","last_unstale":"2023-11-04T01:39:51.095167+0000","last_undegraded":"2023-11-04T01:39:51.095167+0000","last_fullsized":"2023-11-04T01:39:51.095167+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:16.759249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067668100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.123044+0000","last_change":"2023-11-04T01:39:52.117642+0000","last_active":"2023-11-04T01:39:52.123044+0000","last_peered":"2023-11-04T01:39:52.123044+0000","last_clean":"2023-11-04T01:39:52.123044+0000","last_became_active":"2023-11-04T01:39:52.117316+0000","last_became_peered":"2023-11-04T01:39:52.117316+0000","last_unstale":"2023-11-04T01:39:52.123044+0000","last_undegraded":"2023-11-04T01:39:52.123044+0000","last_fullsized":"2023-11-04T01:39:52.123044+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:32.022130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.127676+0000","last_change":"2023-11-04T01:39:51.109842+0000","last_active":"2023-11-04T01:39:52.127676+0000","last_peered":"2023-11-04T01:39:52.127676+0000","last_clean":"2023-11-04T01:39:52.127676+0000","last_became_active":"2023-11-04T01:39:51.108271+0000","last_became_peered":"2023-11-04T01:39:51.108271+0000","last_unstale":"2023-11-04T01:39:52.127676+0000","last_undegraded":"2023-11-04T01:39:52.127676+0000","last_fullsized":"2023-11-04T01:39:52.127676+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:10.240859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098596+0000","last_change":"2023-11-04T01:39:00.901434+0000","last_active":"2023-11-04T01:39:51.098596+0000","last_peered":"2023-11-04T01:39:51.098596+0000","last_clean":"2023-11-04T01:39:51.098596+0000","last_became_active":"2023-11-04T01:39:00.901094+0000","last_became_peered":"2023-11-04T01:39:00.901094+0000","last_unstale":"2023-11-04T01:39:51.098596+0000","last_undegraded":"2023-11-04T01:39:51.098596+0000","last_fullsized":"2023-11-04T01:39:51.098596+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:56:48.965289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.102171+0000","last_change":"2023-11-04T01:39:02.371687+0000","last_active":"2023-11-04T01:39:51.102171+0000","last_peered":"2023-11-04T01:39:51.102171+0000","last_clean":"2023-11-04T01:39:51.102171+0000","last_became_active":"2023-11-04T01:38:59.888782+0000","last_became_peered":"2023-11-04T01:38:59.888782+0000","last_unstale":"2023-11-04T01:39:51.102171+0000","last_undegraded":"2023-11-04T01:39:51.102171+0000","last_fullsized":"2023-11-04T01:39:51.102171+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:34.092676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088740800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.102678+0000","last_change":"2023-11-04T01:38:01.983991+0000","last_active":"2023-11-04T01:39:51.102678+0000","last_peered":"2023-11-04T01:39:51.102678+0000","last_clean":"2023-11-04T01:39:51.102678+0000","last_became_active":"2023-11-04T01:38:00.708462+0000","last_became_peered":"2023-11-04T01:38:00.708462+0000","last_unstale":"2023-11-04T01:39:51.102678+0000","last_undegraded":"2023-11-04T01:39:51.102678+0000","last_fullsized":"2023-11-04T01:39:51.102678+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:37.727651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041811600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.110822+0000","last_change":"2023-11-04T01:39:52.106556+0000","last_active":"2023-11-04T01:39:52.110822+0000","last_peered":"2023-11-04T01:39:52.110822+0000","last_clean":"2023-11-04T01:39:52.110822+0000","last_became_active":"2023-11-04T01:39:52.106298+0000","last_became_peered":"2023-11-04T01:39:52.106298+0000","last_unstale":"2023-11-04T01:39:52.110822+0000","last_undegraded":"2023-11-04T01:39:52.110822+0000","last_fullsized":"2023-11-04T01:39:52.110822+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:21.807476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.103351+0000","last_change":"2023-11-04T01:39:51.114155+0000","last_active":"2023-11-04T01:39:52.103351+0000","last_peered":"2023-11-04T01:39:52.103351+0000","last_clean":"2023-11-04T01:39:52.103351+0000","last_became_active":"2023-11-04T01:39:51.113882+0000","last_became_peered":"2023-11-04T01:39:51.113882+0000","last_unstale":"2023-11-04T01:39:52.103351+0000","last_undegraded":"2023-11-04T01:39:52.103351+0000","last_fullsized":"2023-11-04T01:39:52.103351+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:25.133938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096648+0000","last_change":"2023-11-04T01:39:00.907664+0000","last_active":"2023-11-04T01:39:51.096648+0000","last_peered":"2023-11-04T01:39:51.096648+0000","last_clean":"2023-11-04T01:39:51.096648+0000","last_became_active":"2023-11-04T01:39:00.907098+0000","last_became_peered":"2023-11-04T01:39:00.907098+0000","last_unstale":"2023-11-04T01:39:51.096648+0000","last_undegraded":"2023-11-04T01:39:51.096648+0000","last_fullsized":"2023-11-04T01:39:51.096648+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:43:34.994912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.102608+0000","last_change":"2023-11-04T01:39:02.076144+0000","last_active":"2023-11-04T01:39:51.102608+0000","last_peered":"2023-11-04T01:39:51.102608+0000","last_clean":"2023-11-04T01:39:51.102608+0000","last_became_active":"2023-11-04T01:38:59.891521+0000","last_became_peered":"2023-11-04T01:38:59.891521+0000","last_unstale":"2023-11-04T01:39:51.102608+0000","last_undegraded":"2023-11-04T01:39:51.102608+0000","last_fullsized":"2023-11-04T01:39:51.102608+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:24.449921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063833,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099581+0000","last_change":"2023-11-04T01:38:01.984341+0000","last_active":"2023-11-04T01:39:51.099581+0000","last_peered":"2023-11-04T01:39:51.099581+0000","last_clean":"2023-11-04T01:39:51.099581+0000","last_became_active":"2023-11-04T01:38:00.708307+0000","last_became_peered":"2023-11-04T01:38:00.708307+0000","last_unstale":"2023-11-04T01:39:51.099581+0000","last_undegraded":"2023-11-04T01:39:51.099581+0000","last_fullsized":"2023-11-04T01:39:51.099581+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:17.369098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053627199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.115173+0000","last_change":"2023-11-04T01:39:52.113243+0000","last_active":"2023-11-04T01:39:52.115173+0000","last_peered":"2023-11-04T01:39:52.115173+0000","last_clean":"2023-11-04T01:39:52.115173+0000","last_became_active":"2023-11-04T01:39:52.112968+0000","last_became_peered":"2023-11-04T01:39:52.112968+0000","last_unstale":"2023-11-04T01:39:52.115173+0000","last_undegraded":"2023-11-04T01:39:52.115173+0000","last_fullsized":"2023-11-04T01:39:52.115173+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:24.650364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.122761+0000","last_change":"2023-11-04T01:39:51.104089+0000","last_active":"2023-11-04T01:39:52.122761+0000","last_peered":"2023-11-04T01:39:52.122761+0000","last_clean":"2023-11-04T01:39:52.122761+0000","last_became_active":"2023-11-04T01:39:51.103781+0000","last_became_peered":"2023-11-04T01:39:51.103781+0000","last_unstale":"2023-11-04T01:39:52.122761+0000","last_undegraded":"2023-11-04T01:39:52.122761+0000","last_fullsized":"2023-11-04T01:39:52.122761+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:23.646770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096156+0000","last_change":"2023-11-04T01:39:00.905352+0000","last_active":"2023-11-04T01:39:51.096156+0000","last_peered":"2023-11-04T01:39:51.096156+0000","last_clean":"2023-11-04T01:39:51.096156+0000","last_became_active":"2023-11-04T01:39:00.905058+0000","last_became_peered":"2023-11-04T01:39:00.905058+0000","last_unstale":"2023-11-04T01:39:51.096156+0000","last_undegraded":"2023-11-04T01:39:51.096156+0000","last_fullsized":"2023-11-04T01:39:51.096156+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:37.246937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103482+0000","last_change":"2023-11-04T01:39:02.289522+0000","last_active":"2023-11-04T01:39:51.103482+0000","last_peered":"2023-11-04T01:39:51.103482+0000","last_clean":"2023-11-04T01:39:51.103482+0000","last_became_active":"2023-11-04T01:38:59.887549+0000","last_became_peered":"2023-11-04T01:38:59.887549+0000","last_unstale":"2023-11-04T01:39:51.103482+0000","last_undegraded":"2023-11-04T01:39:51.103482+0000","last_fullsized":"2023-11-04T01:39:51.103482+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:13.888718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077706800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":67,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099115+0000","last_change":"2023-11-04T01:38:01.700471+0000","last_active":"2023-11-04T01:39:51.099115+0000","last_peered":"2023-11-04T01:39:51.099115+0000","last_clean":"2023-11-04T01:39:51.099115+0000","last_became_active":"2023-11-04T01:38:00.702522+0000","last_became_peered":"2023-11-04T01:38:00.702522+0000","last_unstale":"2023-11-04T01:39:51.099115+0000","last_undegraded":"2023-11-04T01:39:51.099115+0000","last_fullsized":"2023-11-04T01:39:51.099115+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086940300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114561+0000","last_change":"2023-11-04T01:39:52.110142+0000","last_active":"2023-11-04T01:39:52.114561+0000","last_peered":"2023-11-04T01:39:52.114561+0000","last_clean":"2023-11-04T01:39:52.114561+0000","last_became_active":"2023-11-04T01:39:52.109889+0000","last_became_peered":"2023-11-04T01:39:52.109889+0000","last_unstale":"2023-11-04T01:39:52.114561+0000","last_undegraded":"2023-11-04T01:39:52.114561+0000","last_fullsized":"2023-11-04T01:39:52.114561+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:25.481450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.096165+0000","last_change":"2023-11-04T01:39:51.111370+0000","last_active":"2023-11-04T01:39:52.096165+0000","last_peered":"2023-11-04T01:39:52.096165+0000","last_clean":"2023-11-04T01:39:52.096165+0000","last_became_active":"2023-11-04T01:39:51.111018+0000","last_became_peered":"2023-11-04T01:39:51.111018+0000","last_unstale":"2023-11-04T01:39:52.096165+0000","last_undegraded":"2023-11-04T01:39:52.096165+0000","last_fullsized":"2023-11-04T01:39:52.096165+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:02:34.970821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097644+0000","last_change":"2023-11-04T01:39:00.905889+0000","last_active":"2023-11-04T01:39:51.097644+0000","last_peered":"2023-11-04T01:39:51.097644+0000","last_clean":"2023-11-04T01:39:51.097644+0000","last_became_active":"2023-11-04T01:39:00.905644+0000","last_became_peered":"2023-11-04T01:39:00.905644+0000","last_unstale":"2023-11-04T01:39:51.097644+0000","last_undegraded":"2023-11-04T01:39:51.097644+0000","last_fullsized":"2023-11-04T01:39:51.097644+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:13.988639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097691+0000","last_change":"2023-11-04T01:39:01.897496+0000","last_active":"2023-11-04T01:39:51.097691+0000","last_peered":"2023-11-04T01:39:51.097691+0000","last_clean":"2023-11-04T01:39:51.097691+0000","last_became_active":"2023-11-04T01:38:59.894771+0000","last_became_peered":"2023-11-04T01:38:59.894771+0000","last_unstale":"2023-11-04T01:39:51.097691+0000","last_undegraded":"2023-11-04T01:39:51.097691+0000","last_fullsized":"2023-11-04T01:39:51.097691+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:50.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043645000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094849+0000","last_change":"2023-11-04T01:38:01.696901+0000","last_active":"2023-11-04T01:39:51.094849+0000","last_peered":"2023-11-04T01:39:51.094849+0000","last_clean":"2023-11-04T01:39:51.094849+0000","last_became_active":"2023-11-04T01:38:00.706170+0000","last_became_peered":"2023-11-04T01:38:00.706170+0000","last_unstale":"2023-11-04T01:39:51.094849+0000","last_undegraded":"2023-11-04T01:39:51.094849+0000","last_fullsized":"2023-11-04T01:39:51.094849+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059391100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114775+0000","last_change":"2023-11-04T01:39:52.112007+0000","last_active":"2023-11-04T01:39:52.114775+0000","last_peered":"2023-11-04T01:39:52.114775+0000","last_clean":"2023-11-04T01:39:52.114775+0000","last_became_active":"2023-11-04T01:39:52.111690+0000","last_became_peered":"2023-11-04T01:39:52.111690+0000","last_unstale":"2023-11-04T01:39:52.114775+0000","last_undegraded":"2023-11-04T01:39:52.114775+0000","last_fullsized":"2023-11-04T01:39:52.114775+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:15:53.823846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.103237+0000","last_change":"2023-11-04T01:39:51.108027+0000","last_active":"2023-11-04T01:39:52.103237+0000","last_peered":"2023-11-04T01:39:52.103237+0000","last_clean":"2023-11-04T01:39:52.103237+0000","last_became_active":"2023-11-04T01:39:51.107743+0000","last_became_peered":"2023-11-04T01:39:51.107743+0000","last_unstale":"2023-11-04T01:39:52.103237+0000","last_undegraded":"2023-11-04T01:39:52.103237+0000","last_fullsized":"2023-11-04T01:39:52.103237+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:52:35.877005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097529+0000","last_change":"2023-11-04T01:39:00.907377+0000","last_active":"2023-11-04T01:39:51.097529+0000","last_peered":"2023-11-04T01:39:51.097529+0000","last_clean":"2023-11-04T01:39:51.097529+0000","last_became_active":"2023-11-04T01:39:00.907059+0000","last_became_peered":"2023-11-04T01:39:00.907059+0000","last_unstale":"2023-11-04T01:39:51.097529+0000","last_undegraded":"2023-11-04T01:39:51.097529+0000","last_fullsized":"2023-11-04T01:39:51.097529+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:04.732051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096648+0000","last_change":"2023-11-04T01:39:01.899471+0000","last_active":"2023-11-04T01:39:51.096648+0000","last_peered":"2023-11-04T01:39:51.096648+0000","last_clean":"2023-11-04T01:39:51.096648+0000","last_became_active":"2023-11-04T01:38:59.893689+0000","last_became_peered":"2023-11-04T01:38:59.893689+0000","last_unstale":"2023-11-04T01:39:51.096648+0000","last_undegraded":"2023-11-04T01:39:51.096648+0000","last_fullsized":"2023-11-04T01:39:51.096648+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:36.506018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072622699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099980+0000","last_change":"2023-11-04T01:38:01.939972+0000","last_active":"2023-11-04T01:39:51.099980+0000","last_peered":"2023-11-04T01:39:51.099980+0000","last_clean":"2023-11-04T01:39:51.099980+0000","last_became_active":"2023-11-04T01:38:00.702784+0000","last_became_peered":"2023-11-04T01:38:00.702784+0000","last_unstale":"2023-11-04T01:39:51.099980+0000","last_undegraded":"2023-11-04T01:39:51.099980+0000","last_fullsized":"2023-11-04T01:39:51.099980+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:46:26.760402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071328600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.119651+0000","last_change":"2023-11-04T01:39:52.113911+0000","last_active":"2023-11-04T01:39:52.119651+0000","last_peered":"2023-11-04T01:39:52.119651+0000","last_clean":"2023-11-04T01:39:52.119651+0000","last_became_active":"2023-11-04T01:39:52.112692+0000","last_became_peered":"2023-11-04T01:39:52.112692+0000","last_unstale":"2023-11-04T01:39:52.119651+0000","last_undegraded":"2023-11-04T01:39:52.119651+0000","last_fullsized":"2023-11-04T01:39:52.119651+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:54.673777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.103390+0000","last_change":"2023-11-04T01:39:51.107113+0000","last_active":"2023-11-04T01:39:52.103390+0000","last_peered":"2023-11-04T01:39:52.103390+0000","last_clean":"2023-11-04T01:39:52.103390+0000","last_became_active":"2023-11-04T01:39:51.106188+0000","last_became_peered":"2023-11-04T01:39:51.106188+0000","last_unstale":"2023-11-04T01:39:52.103390+0000","last_undegraded":"2023-11-04T01:39:52.103390+0000","last_fullsized":"2023-11-04T01:39:52.103390+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:13:00.493080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094702+0000","last_change":"2023-11-04T01:39:00.901301+0000","last_active":"2023-11-04T01:39:51.094702+0000","last_peered":"2023-11-04T01:39:51.094702+0000","last_clean":"2023-11-04T01:39:51.094702+0000","last_became_active":"2023-11-04T01:39:00.901087+0000","last_became_peered":"2023-11-04T01:39:00.901087+0000","last_unstale":"2023-11-04T01:39:51.094702+0000","last_undegraded":"2023-11-04T01:39:51.094702+0000","last_fullsized":"2023-11-04T01:39:51.094702+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:07.192076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103451+0000","last_change":"2023-11-04T01:39:02.076926+0000","last_active":"2023-11-04T01:39:51.103451+0000","last_peered":"2023-11-04T01:39:51.103451+0000","last_clean":"2023-11-04T01:39:51.103451+0000","last_became_active":"2023-11-04T01:38:59.897799+0000","last_became_peered":"2023-11-04T01:38:59.897799+0000","last_unstale":"2023-11-04T01:39:51.103451+0000","last_undegraded":"2023-11-04T01:39:51.103451+0000","last_fullsized":"2023-11-04T01:39:51.103451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:06.186596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051016799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.095762+0000","last_change":"2023-11-04T01:38:01.699051+0000","last_active":"2023-11-04T01:39:51.095762+0000","last_peered":"2023-11-04T01:39:51.095762+0000","last_clean":"2023-11-04T01:39:51.095762+0000","last_became_active":"2023-11-04T01:38:00.708665+0000","last_became_peered":"2023-11-04T01:38:00.708665+0000","last_unstale":"2023-11-04T01:39:51.095762+0000","last_undegraded":"2023-11-04T01:39:51.095762+0000","last_fullsized":"2023-11-04T01:39:51.095762+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020995580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.113407+0000","last_change":"2023-11-04T01:39:52.110413+0000","last_active":"2023-11-04T01:39:52.113407+0000","last_peered":"2023-11-04T01:39:52.113407+0000","last_clean":"2023-11-04T01:39:52.113407+0000","last_became_active":"2023-11-04T01:39:52.110154+0000","last_became_peered":"2023-11-04T01:39:52.110154+0000","last_unstale":"2023-11-04T01:39:52.113407+0000","last_undegraded":"2023-11-04T01:39:52.113407+0000","last_fullsized":"2023-11-04T01:39:52.113407+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:19:10.300256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.092899+0000","last_change":"2023-11-04T01:39:51.111510+0000","last_active":"2023-11-04T01:39:52.092899+0000","last_peered":"2023-11-04T01:39:52.092899+0000","last_clean":"2023-11-04T01:39:52.092899+0000","last_became_active":"2023-11-04T01:39:51.111266+0000","last_became_peered":"2023-11-04T01:39:51.111266+0000","last_unstale":"2023-11-04T01:39:52.092899+0000","last_undegraded":"2023-11-04T01:39:52.092899+0000","last_fullsized":"2023-11-04T01:39:52.092899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:33.675495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096961+0000","last_change":"2023-11-04T01:39:00.903233+0000","last_active":"2023-11-04T01:39:51.096961+0000","last_peered":"2023-11-04T01:39:51.096961+0000","last_clean":"2023-11-04T01:39:51.096961+0000","last_became_active":"2023-11-04T01:39:00.902913+0000","last_became_peered":"2023-11-04T01:39:00.902913+0000","last_unstale":"2023-11-04T01:39:51.096961+0000","last_undegraded":"2023-11-04T01:39:51.096961+0000","last_fullsized":"2023-11-04T01:39:51.096961+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:29.058403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103243+0000","last_change":"2023-11-04T01:39:02.076853+0000","last_active":"2023-11-04T01:39:51.103243+0000","last_peered":"2023-11-04T01:39:51.103243+0000","last_clean":"2023-11-04T01:39:51.103243+0000","last_became_active":"2023-11-04T01:38:59.898310+0000","last_became_peered":"2023-11-04T01:38:59.898310+0000","last_unstale":"2023-11-04T01:39:51.103243+0000","last_undegraded":"2023-11-04T01:39:51.103243+0000","last_fullsized":"2023-11-04T01:39:51.103243+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:22.196883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066256699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":67,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097782+0000","last_change":"2023-11-04T01:38:01.700742+0000","last_active":"2023-11-04T01:39:51.097782+0000","last_peered":"2023-11-04T01:39:51.097782+0000","last_clean":"2023-11-04T01:39:51.097782+0000","last_became_active":"2023-11-04T01:38:00.706671+0000","last_became_peered":"2023-11-04T01:38:00.706671+0000","last_unstale":"2023-11-04T01:39:51.097782+0000","last_undegraded":"2023-11-04T01:39:51.097782+0000","last_fullsized":"2023-11-04T01:39:51.097782+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072370699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.118867+0000","last_change":"2023-11-04T01:39:52.112329+0000","last_active":"2023-11-04T01:39:52.118867+0000","last_peered":"2023-11-04T01:39:52.118867+0000","last_clean":"2023-11-04T01:39:52.118867+0000","last_became_active":"2023-11-04T01:39:52.112058+0000","last_became_peered":"2023-11-04T01:39:52.112058+0000","last_unstale":"2023-11-04T01:39:52.118867+0000","last_undegraded":"2023-11-04T01:39:52.118867+0000","last_fullsized":"2023-11-04T01:39:52.118867+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:57.869838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.097084+0000","last_change":"2023-11-04T01:39:51.106435+0000","last_active":"2023-11-04T01:39:52.097084+0000","last_peered":"2023-11-04T01:39:52.097084+0000","last_clean":"2023-11-04T01:39:52.097084+0000","last_became_active":"2023-11-04T01:39:51.106166+0000","last_became_peered":"2023-11-04T01:39:51.106166+0000","last_unstale":"2023-11-04T01:39:52.097084+0000","last_undegraded":"2023-11-04T01:39:52.097084+0000","last_fullsized":"2023-11-04T01:39:52.097084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:29.834255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.101293+0000","last_change":"2023-11-04T01:39:00.902537+0000","last_active":"2023-11-04T01:39:51.101293+0000","last_peered":"2023-11-04T01:39:51.101293+0000","last_clean":"2023-11-04T01:39:51.101293+0000","last_became_active":"2023-11-04T01:39:00.902217+0000","last_became_peered":"2023-11-04T01:39:00.902217+0000","last_unstale":"2023-11-04T01:39:51.101293+0000","last_undegraded":"2023-11-04T01:39:51.101293+0000","last_fullsized":"2023-11-04T01:39:51.101293+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:56.622252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098972+0000","last_change":"2023-11-04T01:39:01.896481+0000","last_active":"2023-11-04T01:39:51.098972+0000","last_peered":"2023-11-04T01:39:51.098972+0000","last_clean":"2023-11-04T01:39:51.098972+0000","last_became_active":"2023-11-04T01:38:59.897511+0000","last_became_peered":"2023-11-04T01:38:59.897511+0000","last_unstale":"2023-11-04T01:39:51.098972+0000","last_undegraded":"2023-11-04T01:39:51.098972+0000","last_fullsized":"2023-11-04T01:39:51.098972+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:31.015230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001138319,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094638+0000","last_change":"2023-11-04T01:38:01.697526+0000","last_active":"2023-11-04T01:39:51.094638+0000","last_peered":"2023-11-04T01:39:51.094638+0000","last_clean":"2023-11-04T01:39:51.094638+0000","last_became_active":"2023-11-04T01:38:00.707580+0000","last_became_peered":"2023-11-04T01:38:00.707580+0000","last_unstale":"2023-11-04T01:39:51.094638+0000","last_undegraded":"2023-11-04T01:39:51.094638+0000","last_fullsized":"2023-11-04T01:39:51.094638+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010806699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.115439+0000","last_change":"2023-11-04T01:39:52.114088+0000","last_active":"2023-11-04T01:39:52.115439+0000","last_peered":"2023-11-04T01:39:52.115439+0000","last_clean":"2023-11-04T01:39:52.115439+0000","last_became_active":"2023-11-04T01:39:52.113835+0000","last_became_peered":"2023-11-04T01:39:52.113835+0000","last_unstale":"2023-11-04T01:39:52.115439+0000","last_undegraded":"2023-11-04T01:39:52.115439+0000","last_fullsized":"2023-11-04T01:39:52.115439+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:59.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.125410+0000","last_change":"2023-11-04T01:39:51.114069+0000","last_active":"2023-11-04T01:39:52.125410+0000","last_peered":"2023-11-04T01:39:52.125410+0000","last_clean":"2023-11-04T01:39:52.125410+0000","last_became_active":"2023-11-04T01:39:51.113801+0000","last_became_peered":"2023-11-04T01:39:51.113801+0000","last_unstale":"2023-11-04T01:39:52.125410+0000","last_undegraded":"2023-11-04T01:39:52.125410+0000","last_fullsized":"2023-11-04T01:39:52.125410+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:20.803882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096823+0000","last_change":"2023-11-04T01:39:00.905358+0000","last_active":"2023-11-04T01:39:51.096823+0000","last_peered":"2023-11-04T01:39:51.096823+0000","last_clean":"2023-11-04T01:39:51.096823+0000","last_became_active":"2023-11-04T01:39:00.905066+0000","last_became_peered":"2023-11-04T01:39:00.905066+0000","last_unstale":"2023-11-04T01:39:51.096823+0000","last_undegraded":"2023-11-04T01:39:51.096823+0000","last_fullsized":"2023-11-04T01:39:51.096823+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:23.606563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.101368+0000","last_change":"2023-11-04T01:39:01.897060+0000","last_active":"2023-11-04T01:39:51.101368+0000","last_peered":"2023-11-04T01:39:51.101368+0000","last_clean":"2023-11-04T01:39:51.101368+0000","last_became_active":"2023-11-04T01:38:59.888827+0000","last_became_peered":"2023-11-04T01:38:59.888827+0000","last_unstale":"2023-11-04T01:39:51.101368+0000","last_undegraded":"2023-11-04T01:39:51.101368+0000","last_fullsized":"2023-11-04T01:39:51.101368+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:52:14.150104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000963042,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098130+0000","last_change":"2023-11-04T01:38:01.939462+0000","last_active":"2023-11-04T01:39:51.098130+0000","last_peered":"2023-11-04T01:39:51.098130+0000","last_clean":"2023-11-04T01:39:51.098130+0000","last_became_active":"2023-11-04T01:38:00.705830+0000","last_became_peered":"2023-11-04T01:38:00.705830+0000","last_unstale":"2023-11-04T01:39:51.098130+0000","last_undegraded":"2023-11-04T01:39:51.098130+0000","last_fullsized":"2023-11-04T01:39:51.098130+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:32.355377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059305000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.115409+0000","last_change":"2023-11-04T01:39:52.113522+0000","last_active":"2023-11-04T01:39:52.115409+0000","last_peered":"2023-11-04T01:39:52.115409+0000","last_clean":"2023-11-04T01:39:52.115409+0000","last_became_active":"2023-11-04T01:39:52.113254+0000","last_became_peered":"2023-11-04T01:39:52.113254+0000","last_unstale":"2023-11-04T01:39:52.115409+0000","last_undegraded":"2023-11-04T01:39:52.115409+0000","last_fullsized":"2023-11-04T01:39:52.115409+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:50.708519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.098207+0000","last_change":"2023-11-04T01:39:51.113329+0000","last_active":"2023-11-04T01:39:52.098207+0000","last_peered":"2023-11-04T01:39:52.098207+0000","last_clean":"2023-11-04T01:39:52.098207+0000","last_became_active":"2023-11-04T01:39:51.113056+0000","last_became_peered":"2023-11-04T01:39:51.113056+0000","last_unstale":"2023-11-04T01:39:52.098207+0000","last_undegraded":"2023-11-04T01:39:52.098207+0000","last_fullsized":"2023-11-04T01:39:52.098207+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:45.022331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098913+0000","last_change":"2023-11-04T01:39:00.898467+0000","last_active":"2023-11-04T01:39:51.098913+0000","last_peered":"2023-11-04T01:39:51.098913+0000","last_clean":"2023-11-04T01:39:51.098913+0000","last_became_active":"2023-11-04T01:39:00.898168+0000","last_became_peered":"2023-11-04T01:39:00.898168+0000","last_unstale":"2023-11-04T01:39:51.098913+0000","last_undegraded":"2023-11-04T01:39:51.098913+0000","last_fullsized":"2023-11-04T01:39:51.098913+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:03.950091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096225+0000","last_change":"2023-11-04T01:39:02.371405+0000","last_active":"2023-11-04T01:39:51.096225+0000","last_peered":"2023-11-04T01:39:51.096225+0000","last_clean":"2023-11-04T01:39:51.096225+0000","last_became_active":"2023-11-04T01:38:59.884832+0000","last_became_peered":"2023-11-04T01:38:59.884832+0000","last_unstale":"2023-11-04T01:39:51.096225+0000","last_undegraded":"2023-11-04T01:39:51.096225+0000","last_fullsized":"2023-11-04T01:39:51.096225+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:22.851162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00135917,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099649+0000","last_change":"2023-11-04T01:38:01.984456+0000","last_active":"2023-11-04T01:39:51.099649+0000","last_peered":"2023-11-04T01:39:51.099649+0000","last_clean":"2023-11-04T01:39:51.099649+0000","last_became_active":"2023-11-04T01:38:00.708803+0000","last_became_peered":"2023-11-04T01:38:00.708803+0000","last_unstale":"2023-11-04T01:39:51.099649+0000","last_undegraded":"2023-11-04T01:39:51.099649+0000","last_fullsized":"2023-11-04T01:39:51.099649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:30.811033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061551599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.119418+0000","last_change":"2023-11-04T01:39:52.113041+0000","last_active":"2023-11-04T01:39:52.119418+0000","last_peered":"2023-11-04T01:39:52.119418+0000","last_clean":"2023-11-04T01:39:52.119418+0000","last_became_active":"2023-11-04T01:39:52.112698+0000","last_became_peered":"2023-11-04T01:39:52.112698+0000","last_unstale":"2023-11-04T01:39:52.119418+0000","last_undegraded":"2023-11-04T01:39:52.119418+0000","last_fullsized":"2023-11-04T01:39:52.119418+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:55:22.716533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.106081+0000","last_change":"2023-11-04T01:39:51.107964+0000","last_active":"2023-11-04T01:39:52.106081+0000","last_peered":"2023-11-04T01:39:52.106081+0000","last_clean":"2023-11-04T01:39:52.106081+0000","last_became_active":"2023-11-04T01:39:51.107712+0000","last_became_peered":"2023-11-04T01:39:51.107712+0000","last_unstale":"2023-11-04T01:39:52.106081+0000","last_undegraded":"2023-11-04T01:39:52.106081+0000","last_fullsized":"2023-11-04T01:39:52.106081+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:55.322164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094459+0000","last_change":"2023-11-04T01:39:00.898232+0000","last_active":"2023-11-04T01:39:51.094459+0000","last_peered":"2023-11-04T01:39:51.094459+0000","last_clean":"2023-11-04T01:39:51.094459+0000","last_became_active":"2023-11-04T01:39:00.897953+0000","last_became_peered":"2023-11-04T01:39:00.897953+0000","last_unstale":"2023-11-04T01:39:51.094459+0000","last_undegraded":"2023-11-04T01:39:51.094459+0000","last_fullsized":"2023-11-04T01:39:51.094459+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:19.094868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096207+0000","last_change":"2023-11-04T01:39:02.076201+0000","last_active":"2023-11-04T01:39:51.096207+0000","last_peered":"2023-11-04T01:39:51.096207+0000","last_clean":"2023-11-04T01:39:51.096207+0000","last_became_active":"2023-11-04T01:38:59.885672+0000","last_became_peered":"2023-11-04T01:38:59.885672+0000","last_unstale":"2023-11-04T01:39:51.096207+0000","last_undegraded":"2023-11-04T01:39:51.096207+0000","last_fullsized":"2023-11-04T01:39:51.096207+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:15.425248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063733799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.095795+0000","last_change":"2023-11-04T01:38:01.698866+0000","last_active":"2023-11-04T01:39:51.095795+0000","last_peered":"2023-11-04T01:39:51.095795+0000","last_clean":"2023-11-04T01:39:51.095795+0000","last_became_active":"2023-11-04T01:38:00.706149+0000","last_became_peered":"2023-11-04T01:38:00.706149+0000","last_unstale":"2023-11-04T01:39:51.095795+0000","last_undegraded":"2023-11-04T01:39:51.095795+0000","last_fullsized":"2023-11-04T01:39:51.095795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:07:59.391683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001344154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114462+0000","last_change":"2023-11-04T01:39:52.109116+0000","last_active":"2023-11-04T01:39:52.114462+0000","last_peered":"2023-11-04T01:39:52.114462+0000","last_clean":"2023-11-04T01:39:52.114462+0000","last_became_active":"2023-11-04T01:39:52.108650+0000","last_became_peered":"2023-11-04T01:39:52.108650+0000","last_unstale":"2023-11-04T01:39:52.114462+0000","last_undegraded":"2023-11-04T01:39:52.114462+0000","last_fullsized":"2023-11-04T01:39:52.114462+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:28:56.522992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.122565+0000","last_change":"2023-11-04T01:39:51.107522+0000","last_active":"2023-11-04T01:39:52.122565+0000","last_peered":"2023-11-04T01:39:52.122565+0000","last_clean":"2023-11-04T01:39:52.122565+0000","last_became_active":"2023-11-04T01:39:51.107245+0000","last_became_peered":"2023-11-04T01:39:51.107245+0000","last_unstale":"2023-11-04T01:39:52.122565+0000","last_undegraded":"2023-11-04T01:39:52.122565+0000","last_fullsized":"2023-11-04T01:39:52.122565+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:53.670183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.095550+0000","last_change":"2023-11-04T01:39:00.907552+0000","last_active":"2023-11-04T01:39:51.095550+0000","last_peered":"2023-11-04T01:39:51.095550+0000","last_clean":"2023-11-04T01:39:51.095550+0000","last_became_active":"2023-11-04T01:39:00.907262+0000","last_became_peered":"2023-11-04T01:39:00.907262+0000","last_unstale":"2023-11-04T01:39:51.095550+0000","last_undegraded":"2023-11-04T01:39:51.095550+0000","last_fullsized":"2023-11-04T01:39:51.095550+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:23.202363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097359+0000","last_change":"2023-11-04T01:39:02.371758+0000","last_active":"2023-11-04T01:39:51.097359+0000","last_peered":"2023-11-04T01:39:51.097359+0000","last_clean":"2023-11-04T01:39:51.097359+0000","last_became_active":"2023-11-04T01:38:59.891579+0000","last_became_peered":"2023-11-04T01:38:59.891579+0000","last_unstale":"2023-11-04T01:39:51.097359+0000","last_undegraded":"2023-11-04T01:39:51.097359+0000","last_fullsized":"2023-11-04T01:39:51.097359+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:04:45.779183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063536799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096461+0000","last_change":"2023-11-04T01:38:01.699187+0000","last_active":"2023-11-04T01:39:51.096461+0000","last_peered":"2023-11-04T01:39:51.096461+0000","last_clean":"2023-11-04T01:39:51.096461+0000","last_became_active":"2023-11-04T01:38:00.706136+0000","last_became_peered":"2023-11-04T01:38:00.706136+0000","last_unstale":"2023-11-04T01:39:51.096461+0000","last_undegraded":"2023-11-04T01:39:51.096461+0000","last_fullsized":"2023-11-04T01:39:51.096461+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074666999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.120733+0000","last_change":"2023-11-04T01:39:52.115463+0000","last_active":"2023-11-04T01:39:52.120733+0000","last_peered":"2023-11-04T01:39:52.120733+0000","last_clean":"2023-11-04T01:39:52.120733+0000","last_became_active":"2023-11-04T01:39:52.115219+0000","last_became_peered":"2023-11-04T01:39:52.115219+0000","last_unstale":"2023-11-04T01:39:52.120733+0000","last_undegraded":"2023-11-04T01:39:52.120733+0000","last_fullsized":"2023-11-04T01:39:52.120733+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:01:02.592248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.123045+0000","last_change":"2023-11-04T01:39:51.111564+0000","last_active":"2023-11-04T01:39:52.123045+0000","last_peered":"2023-11-04T01:39:52.123045+0000","last_clean":"2023-11-04T01:39:52.123045+0000","last_became_active":"2023-11-04T01:39:51.111290+0000","last_became_peered":"2023-11-04T01:39:51.111290+0000","last_unstale":"2023-11-04T01:39:52.123045+0000","last_undegraded":"2023-11-04T01:39:52.123045+0000","last_fullsized":"2023-11-04T01:39:52.123045+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:05.903328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097611+0000","last_change":"2023-11-04T01:39:00.904464+0000","last_active":"2023-11-04T01:39:51.097611+0000","last_peered":"2023-11-04T01:39:51.097611+0000","last_clean":"2023-11-04T01:39:51.097611+0000","last_became_active":"2023-11-04T01:39:00.904172+0000","last_became_peered":"2023-11-04T01:39:00.904172+0000","last_unstale":"2023-11-04T01:39:51.097611+0000","last_undegraded":"2023-11-04T01:39:51.097611+0000","last_fullsized":"2023-11-04T01:39:51.097611+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:32.767818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.101820+0000","last_change":"2023-11-04T01:39:02.371427+0000","last_active":"2023-11-04T01:39:51.101820+0000","last_peered":"2023-11-04T01:39:51.101820+0000","last_clean":"2023-11-04T01:39:51.101820+0000","last_became_active":"2023-11-04T01:38:59.886795+0000","last_became_peered":"2023-11-04T01:38:59.886795+0000","last_unstale":"2023-11-04T01:39:51.101820+0000","last_undegraded":"2023-11-04T01:39:51.101820+0000","last_fullsized":"2023-11-04T01:39:51.101820+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:24:01.300866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082815500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097224+0000","last_change":"2023-11-04T01:38:01.699630+0000","last_active":"2023-11-04T01:39:51.097224+0000","last_peered":"2023-11-04T01:39:51.097224+0000","last_clean":"2023-11-04T01:39:51.097224+0000","last_became_active":"2023-11-04T01:38:00.702550+0000","last_became_peered":"2023-11-04T01:38:00.702550+0000","last_unstale":"2023-11-04T01:39:51.097224+0000","last_undegraded":"2023-11-04T01:39:51.097224+0000","last_fullsized":"2023-11-04T01:39:51.097224+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:26:49.159691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001016077,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.110468+0000","last_change":"2023-11-04T01:39:52.107600+0000","last_active":"2023-11-04T01:39:52.110468+0000","last_peered":"2023-11-04T01:39:52.110468+0000","last_clean":"2023-11-04T01:39:52.110468+0000","last_became_active":"2023-11-04T01:39:52.107205+0000","last_became_peered":"2023-11-04T01:39:52.107205+0000","last_unstale":"2023-11-04T01:39:52.110468+0000","last_undegraded":"2023-11-04T01:39:52.110468+0000","last_fullsized":"2023-11-04T01:39:52.110468+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:54.718426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.103531+0000","last_change":"2023-11-04T01:39:51.110482+0000","last_active":"2023-11-04T01:39:52.103531+0000","last_peered":"2023-11-04T01:39:52.103531+0000","last_clean":"2023-11-04T01:39:52.103531+0000","last_became_active":"2023-11-04T01:39:51.110230+0000","last_became_peered":"2023-11-04T01:39:51.110230+0000","last_unstale":"2023-11-04T01:39:52.103531+0000","last_undegraded":"2023-11-04T01:39:52.103531+0000","last_fullsized":"2023-11-04T01:39:52.103531+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:16.275046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097689+0000","last_change":"2023-11-04T01:39:00.905979+0000","last_active":"2023-11-04T01:39:51.097689+0000","last_peered":"2023-11-04T01:39:51.097689+0000","last_clean":"2023-11-04T01:39:51.097689+0000","last_became_active":"2023-11-04T01:39:00.905741+0000","last_became_peered":"2023-11-04T01:39:00.905741+0000","last_unstale":"2023-11-04T01:39:51.097689+0000","last_undegraded":"2023-11-04T01:39:51.097689+0000","last_fullsized":"2023-11-04T01:39:51.097689+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:29.058403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097082+0000","last_change":"2023-11-04T01:39:01.898934+0000","last_active":"2023-11-04T01:39:51.097082+0000","last_peered":"2023-11-04T01:39:51.097082+0000","last_clean":"2023-11-04T01:39:51.097082+0000","last_became_active":"2023-11-04T01:38:59.895023+0000","last_became_peered":"2023-11-04T01:38:59.895023+0000","last_unstale":"2023-11-04T01:39:51.097082+0000","last_undegraded":"2023-11-04T01:39:51.097082+0000","last_fullsized":"2023-11-04T01:39:51.097082+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:50.823674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091724099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103534+0000","last_change":"2023-11-04T01:38:01.984764+0000","last_active":"2023-11-04T01:39:51.103534+0000","last_peered":"2023-11-04T01:39:51.103534+0000","last_clean":"2023-11-04T01:39:51.103534+0000","last_became_active":"2023-11-04T01:38:00.709894+0000","last_became_peered":"2023-11-04T01:38:00.709894+0000","last_unstale":"2023-11-04T01:39:51.103534+0000","last_undegraded":"2023-11-04T01:39:51.103534+0000","last_fullsized":"2023-11-04T01:39:51.103534+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:08:42.829255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045046799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.119700+0000","last_change":"2023-11-04T01:39:52.113445+0000","last_active":"2023-11-04T01:39:52.119700+0000","last_peered":"2023-11-04T01:39:52.119700+0000","last_clean":"2023-11-04T01:39:52.119700+0000","last_became_active":"2023-11-04T01:39:52.113118+0000","last_became_peered":"2023-11-04T01:39:52.113118+0000","last_unstale":"2023-11-04T01:39:52.119700+0000","last_undegraded":"2023-11-04T01:39:52.119700+0000","last_fullsized":"2023-11-04T01:39:52.119700+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:01:07.632026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.094126+0000","last_change":"2023-11-04T01:39:51.107006+0000","last_active":"2023-11-04T01:39:52.094126+0000","last_peered":"2023-11-04T01:39:52.094126+0000","last_clean":"2023-11-04T01:39:52.094126+0000","last_became_active":"2023-11-04T01:39:51.106372+0000","last_became_peered":"2023-11-04T01:39:51.106372+0000","last_unstale":"2023-11-04T01:39:52.094126+0000","last_undegraded":"2023-11-04T01:39:52.094126+0000","last_fullsized":"2023-11-04T01:39:52.094126+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:43:08.727660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097156+0000","last_change":"2023-11-04T01:39:00.902634+0000","last_active":"2023-11-04T01:39:51.097156+0000","last_peered":"2023-11-04T01:39:51.097156+0000","last_clean":"2023-11-04T01:39:51.097156+0000","last_became_active":"2023-11-04T01:39:00.902174+0000","last_became_peered":"2023-11-04T01:39:00.902174+0000","last_unstale":"2023-11-04T01:39:51.097156+0000","last_undegraded":"2023-11-04T01:39:51.097156+0000","last_fullsized":"2023-11-04T01:39:51.097156+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:49.057663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096253+0000","last_change":"2023-11-04T01:39:01.899198+0000","last_active":"2023-11-04T01:39:51.096253+0000","last_peered":"2023-11-04T01:39:51.096253+0000","last_clean":"2023-11-04T01:39:51.096253+0000","last_became_active":"2023-11-04T01:38:59.893842+0000","last_became_peered":"2023-11-04T01:38:59.893842+0000","last_unstale":"2023-11-04T01:39:51.096253+0000","last_undegraded":"2023-11-04T01:39:51.096253+0000","last_fullsized":"2023-11-04T01:39:51.096253+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:47:05.228427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089883699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099059+0000","last_change":"2023-11-04T01:38:02.321871+0000","last_active":"2023-11-04T01:39:51.099059+0000","last_peered":"2023-11-04T01:39:51.099059+0000","last_clean":"2023-11-04T01:39:51.099059+0000","last_became_active":"2023-11-04T01:38:00.708407+0000","last_became_peered":"2023-11-04T01:38:00.708407+0000","last_unstale":"2023-11-04T01:39:51.099059+0000","last_undegraded":"2023-11-04T01:39:51.099059+0000","last_fullsized":"2023-11-04T01:39:51.099059+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:48.672429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032387200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.106784+0000","last_change":"2023-11-04T01:39:52.100695+0000","last_active":"2023-11-04T01:39:52.106784+0000","last_peered":"2023-11-04T01:39:52.106784+0000","last_clean":"2023-11-04T01:39:52.106784+0000","last_became_active":"2023-11-04T01:39:52.100440+0000","last_became_peered":"2023-11-04T01:39:52.100440+0000","last_unstale":"2023-11-04T01:39:52.106784+0000","last_undegraded":"2023-11-04T01:39:52.106784+0000","last_fullsized":"2023-11-04T01:39:52.106784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:45.707206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.121174+0000","last_change":"2023-11-04T01:39:51.106473+0000","last_active":"2023-11-04T01:39:52.121174+0000","last_peered":"2023-11-04T01:39:52.121174+0000","last_clean":"2023-11-04T01:39:52.121174+0000","last_became_active":"2023-11-04T01:39:51.106192+0000","last_became_peered":"2023-11-04T01:39:51.106192+0000","last_unstale":"2023-11-04T01:39:52.121174+0000","last_undegraded":"2023-11-04T01:39:52.121174+0000","last_fullsized":"2023-11-04T01:39:52.121174+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:29.834255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099124+0000","last_change":"2023-11-04T01:39:00.902561+0000","last_active":"2023-11-04T01:39:51.099124+0000","last_peered":"2023-11-04T01:39:51.099124+0000","last_clean":"2023-11-04T01:39:51.099124+0000","last_became_active":"2023-11-04T01:39:00.902203+0000","last_became_peered":"2023-11-04T01:39:00.902203+0000","last_unstale":"2023-11-04T01:39:51.099124+0000","last_undegraded":"2023-11-04T01:39:51.099124+0000","last_fullsized":"2023-11-04T01:39:51.099124+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:12.375847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099047+0000","last_change":"2023-11-04T01:39:01.896891+0000","last_active":"2023-11-04T01:39:51.099047+0000","last_peered":"2023-11-04T01:39:51.099047+0000","last_clean":"2023-11-04T01:39:51.099047+0000","last_became_active":"2023-11-04T01:38:59.894385+0000","last_became_peered":"2023-11-04T01:38:59.894385+0000","last_unstale":"2023-11-04T01:39:51.099047+0000","last_undegraded":"2023-11-04T01:39:51.099047+0000","last_fullsized":"2023-11-04T01:39:51.099047+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:36:07.725905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084524899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096286+0000","last_change":"2023-11-04T01:38:01.983988+0000","last_active":"2023-11-04T01:39:51.096286+0000","last_peered":"2023-11-04T01:39:51.096286+0000","last_clean":"2023-11-04T01:39:51.096286+0000","last_became_active":"2023-11-04T01:38:00.711020+0000","last_became_peered":"2023-11-04T01:38:00.711020+0000","last_unstale":"2023-11-04T01:39:51.096286+0000","last_undegraded":"2023-11-04T01:39:51.096286+0000","last_fullsized":"2023-11-04T01:39:51.096286+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:06.374078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.112753+0000","last_change":"2023-11-04T01:39:52.108497+0000","last_active":"2023-11-04T01:39:52.112753+0000","last_peered":"2023-11-04T01:39:52.112753+0000","last_clean":"2023-11-04T01:39:52.112753+0000","last_became_active":"2023-11-04T01:39:52.108237+0000","last_became_peered":"2023-11-04T01:39:52.108237+0000","last_unstale":"2023-11-04T01:39:52.112753+0000","last_undegraded":"2023-11-04T01:39:52.112753+0000","last_fullsized":"2023-11-04T01:39:52.112753+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:20:06.100624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"95'4","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.121433+0000","last_change":"2023-11-04T01:39:51.107623+0000","last_active":"2023-11-04T01:39:52.121433+0000","last_peered":"2023-11-04T01:39:52.121433+0000","last_clean":"2023-11-04T01:39:52.121433+0000","last_became_active":"2023-11-04T01:39:51.107118+0000","last_became_peered":"2023-11-04T01:39:51.107118+0000","last_unstale":"2023-11-04T01:39:52.121433+0000","last_undegraded":"2023-11-04T01:39:52.121433+0000","last_fullsized":"2023-11-04T01:39:52.121433+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:00.148090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.104057+0000","last_change":"2023-11-04T01:39:00.902481+0000","last_active":"2023-11-04T01:39:51.104057+0000","last_peered":"2023-11-04T01:39:51.104057+0000","last_clean":"2023-11-04T01:39:51.104057+0000","last_became_active":"2023-11-04T01:39:00.902206+0000","last_became_peered":"2023-11-04T01:39:00.902206+0000","last_unstale":"2023-11-04T01:39:51.104057+0000","last_undegraded":"2023-11-04T01:39:51.104057+0000","last_fullsized":"2023-11-04T01:39:51.104057+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:49.996214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099509+0000","last_change":"2023-11-04T01:39:02.076608+0000","last_active":"2023-11-04T01:39:51.099509+0000","last_peered":"2023-11-04T01:39:51.099509+0000","last_clean":"2023-11-04T01:39:51.099509+0000","last_became_active":"2023-11-04T01:38:59.892104+0000","last_became_peered":"2023-11-04T01:38:59.892104+0000","last_unstale":"2023-11-04T01:39:51.099509+0000","last_undegraded":"2023-11-04T01:39:51.099509+0000","last_fullsized":"2023-11-04T01:39:51.099509+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:15.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063915499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098700+0000","last_change":"2023-11-04T01:38:02.321641+0000","last_active":"2023-11-04T01:39:51.098700+0000","last_peered":"2023-11-04T01:39:51.098700+0000","last_clean":"2023-11-04T01:39:51.098700+0000","last_became_active":"2023-11-04T01:38:00.706199+0000","last_became_peered":"2023-11-04T01:38:00.706199+0000","last_unstale":"2023-11-04T01:39:51.098700+0000","last_undegraded":"2023-11-04T01:39:51.098700+0000","last_fullsized":"2023-11-04T01:39:51.098700+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:15.138325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045080400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.111057+0000","last_change":"2023-11-04T01:39:52.108569+0000","last_active":"2023-11-04T01:39:52.111057+0000","last_peered":"2023-11-04T01:39:52.111057+0000","last_clean":"2023-11-04T01:39:52.111057+0000","last_became_active":"2023-11-04T01:39:52.108330+0000","last_became_peered":"2023-11-04T01:39:52.108330+0000","last_unstale":"2023-11-04T01:39:52.111057+0000","last_undegraded":"2023-11-04T01:39:52.111057+0000","last_fullsized":"2023-11-04T01:39:52.111057+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:20.966615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.125030+0000","last_change":"2023-11-04T01:39:51.113710+0000","last_active":"2023-11-04T01:39:52.125030+0000","last_peered":"2023-11-04T01:39:52.125030+0000","last_clean":"2023-11-04T01:39:52.125030+0000","last_became_active":"2023-11-04T01:39:51.113461+0000","last_became_peered":"2023-11-04T01:39:51.113461+0000","last_unstale":"2023-11-04T01:39:52.125030+0000","last_undegraded":"2023-11-04T01:39:52.125030+0000","last_fullsized":"2023-11-04T01:39:52.125030+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:12:13.419898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094775+0000","last_change":"2023-11-04T01:39:00.906469+0000","last_active":"2023-11-04T01:39:51.094775+0000","last_peered":"2023-11-04T01:39:51.094775+0000","last_clean":"2023-11-04T01:39:51.094775+0000","last_became_active":"2023-11-04T01:39:00.905872+0000","last_became_peered":"2023-11-04T01:39:00.905872+0000","last_unstale":"2023-11-04T01:39:51.094775+0000","last_undegraded":"2023-11-04T01:39:51.094775+0000","last_fullsized":"2023-11-04T01:39:51.094775+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:32.767818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094918+0000","last_change":"2023-11-04T01:39:01.897198+0000","last_active":"2023-11-04T01:39:51.094918+0000","last_peered":"2023-11-04T01:39:51.094918+0000","last_clean":"2023-11-04T01:39:51.094918+0000","last_became_active":"2023-11-04T01:38:59.884103+0000","last_became_peered":"2023-11-04T01:38:59.884103+0000","last_unstale":"2023-11-04T01:39:51.094918+0000","last_undegraded":"2023-11-04T01:39:51.094918+0000","last_fullsized":"2023-11-04T01:39:51.094918+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:07.268618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074876599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.102204+0000","last_change":"2023-11-04T01:38:02.156148+0000","last_active":"2023-11-04T01:39:51.102204+0000","last_peered":"2023-11-04T01:39:51.102204+0000","last_clean":"2023-11-04T01:39:51.102204+0000","last_became_active":"2023-11-04T01:38:00.708352+0000","last_became_peered":"2023-11-04T01:38:00.708352+0000","last_unstale":"2023-11-04T01:39:51.102204+0000","last_undegraded":"2023-11-04T01:39:51.102204+0000","last_fullsized":"2023-11-04T01:39:51.102204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:02:46.976761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035716799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.113603+0000","last_change":"2023-11-04T01:39:52.107063+0000","last_active":"2023-11-04T01:39:52.113603+0000","last_peered":"2023-11-04T01:39:52.113603+0000","last_clean":"2023-11-04T01:39:52.113603+0000","last_became_active":"2023-11-04T01:39:52.106773+0000","last_became_peered":"2023-11-04T01:39:52.106773+0000","last_unstale":"2023-11-04T01:39:52.113603+0000","last_undegraded":"2023-11-04T01:39:52.113603+0000","last_fullsized":"2023-11-04T01:39:52.113603+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:32.743299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.124364+0000","last_change":"2023-11-04T01:39:51.112686+0000","last_active":"2023-11-04T01:39:52.124364+0000","last_peered":"2023-11-04T01:39:52.124364+0000","last_clean":"2023-11-04T01:39:52.124364+0000","last_became_active":"2023-11-04T01:39:51.112258+0000","last_became_peered":"2023-11-04T01:39:51.112258+0000","last_unstale":"2023-11-04T01:39:52.124364+0000","last_undegraded":"2023-11-04T01:39:52.124364+0000","last_fullsized":"2023-11-04T01:39:52.124364+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:57.409611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094352+0000","last_change":"2023-11-04T01:39:00.905021+0000","last_active":"2023-11-04T01:39:51.094352+0000","last_peered":"2023-11-04T01:39:51.094352+0000","last_clean":"2023-11-04T01:39:51.094352+0000","last_became_active":"2023-11-04T01:39:00.904730+0000","last_became_peered":"2023-11-04T01:39:00.904730+0000","last_unstale":"2023-11-04T01:39:51.094352+0000","last_undegraded":"2023-11-04T01:39:51.094352+0000","last_fullsized":"2023-11-04T01:39:51.094352+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:28.746335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094994+0000","last_change":"2023-11-04T01:39:01.897770+0000","last_active":"2023-11-04T01:39:51.094994+0000","last_peered":"2023-11-04T01:39:51.094994+0000","last_clean":"2023-11-04T01:39:51.094994+0000","last_became_active":"2023-11-04T01:38:59.894386+0000","last_became_peered":"2023-11-04T01:38:59.894386+0000","last_unstale":"2023-11-04T01:39:51.094994+0000","last_undegraded":"2023-11-04T01:39:51.094994+0000","last_fullsized":"2023-11-04T01:39:51.094994+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:20.259857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069590400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099729+0000","last_change":"2023-11-04T01:38:01.939729+0000","last_active":"2023-11-04T01:39:51.099729+0000","last_peered":"2023-11-04T01:39:51.099729+0000","last_clean":"2023-11-04T01:39:51.099729+0000","last_became_active":"2023-11-04T01:38:00.704384+0000","last_became_peered":"2023-11-04T01:38:00.704384+0000","last_unstale":"2023-11-04T01:39:51.099729+0000","last_undegraded":"2023-11-04T01:39:51.099729+0000","last_fullsized":"2023-11-04T01:39:51.099729+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:11.689968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080052200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.110583+0000","last_change":"2023-11-04T01:39:52.107272+0000","last_active":"2023-11-04T01:39:52.110583+0000","last_peered":"2023-11-04T01:39:52.110583+0000","last_clean":"2023-11-04T01:39:52.110583+0000","last_became_active":"2023-11-04T01:39:52.106564+0000","last_became_peered":"2023-11-04T01:39:52.106564+0000","last_unstale":"2023-11-04T01:39:52.110583+0000","last_undegraded":"2023-11-04T01:39:52.110583+0000","last_fullsized":"2023-11-04T01:39:52.110583+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:42:48.684260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.096750+0000","last_change":"2023-11-04T01:39:51.110707+0000","last_active":"2023-11-04T01:39:52.096750+0000","last_peered":"2023-11-04T01:39:52.096750+0000","last_clean":"2023-11-04T01:39:52.096750+0000","last_became_active":"2023-11-04T01:39:51.110409+0000","last_became_peered":"2023-11-04T01:39:51.110409+0000","last_unstale":"2023-11-04T01:39:52.096750+0000","last_undegraded":"2023-11-04T01:39:52.096750+0000","last_fullsized":"2023-11-04T01:39:52.096750+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:38:51.294106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096919+0000","last_change":"2023-11-04T01:39:00.904930+0000","last_active":"2023-11-04T01:39:51.096919+0000","last_peered":"2023-11-04T01:39:51.096919+0000","last_clean":"2023-11-04T01:39:51.096919+0000","last_became_active":"2023-11-04T01:39:00.904645+0000","last_became_peered":"2023-11-04T01:39:00.904645+0000","last_unstale":"2023-11-04T01:39:51.096919+0000","last_undegraded":"2023-11-04T01:39:51.096919+0000","last_fullsized":"2023-11-04T01:39:51.096919+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:14.894198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103243+0000","last_change":"2023-11-04T01:39:02.076751+0000","last_active":"2023-11-04T01:39:51.103243+0000","last_peered":"2023-11-04T01:39:51.103243+0000","last_clean":"2023-11-04T01:39:51.103243+0000","last_became_active":"2023-11-04T01:38:59.887859+0000","last_became_peered":"2023-11-04T01:38:59.887859+0000","last_unstale":"2023-11-04T01:39:51.103243+0000","last_undegraded":"2023-11-04T01:39:51.103243+0000","last_fullsized":"2023-11-04T01:39:51.103243+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:42.452480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057159799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094918+0000","last_change":"2023-11-04T01:38:01.697272+0000","last_active":"2023-11-04T01:39:51.094918+0000","last_peered":"2023-11-04T01:39:51.094918+0000","last_clean":"2023-11-04T01:39:51.094918+0000","last_became_active":"2023-11-04T01:38:00.709395+0000","last_became_peered":"2023-11-04T01:38:00.709395+0000","last_unstale":"2023-11-04T01:39:51.094918+0000","last_undegraded":"2023-11-04T01:39:51.094918+0000","last_fullsized":"2023-11-04T01:39:51.094918+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076665499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.120236+0000","last_change":"2023-11-04T01:39:52.117871+0000","last_active":"2023-11-04T01:39:52.120236+0000","last_peered":"2023-11-04T01:39:52.120236+0000","last_clean":"2023-11-04T01:39:52.120236+0000","last_became_active":"2023-11-04T01:39:52.116478+0000","last_became_peered":"2023-11-04T01:39:52.116478+0000","last_unstale":"2023-11-04T01:39:52.120236+0000","last_undegraded":"2023-11-04T01:39:52.120236+0000","last_fullsized":"2023-11-04T01:39:52.120236+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:19.069016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.121571+0000","last_change":"2023-11-04T01:39:51.109464+0000","last_active":"2023-11-04T01:39:52.121571+0000","last_peered":"2023-11-04T01:39:52.121571+0000","last_clean":"2023-11-04T01:39:52.121571+0000","last_became_active":"2023-11-04T01:39:51.109212+0000","last_became_peered":"2023-11-04T01:39:51.109212+0000","last_unstale":"2023-11-04T01:39:52.121571+0000","last_undegraded":"2023-11-04T01:39:52.121571+0000","last_fullsized":"2023-11-04T01:39:52.121571+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:43:16.745553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.095098+0000","last_change":"2023-11-04T01:39:00.904589+0000","last_active":"2023-11-04T01:39:51.095098+0000","last_peered":"2023-11-04T01:39:51.095098+0000","last_clean":"2023-11-04T01:39:51.095098+0000","last_became_active":"2023-11-04T01:39:00.904277+0000","last_became_peered":"2023-11-04T01:39:00.904277+0000","last_unstale":"2023-11-04T01:39:51.095098+0000","last_undegraded":"2023-11-04T01:39:51.095098+0000","last_fullsized":"2023-11-04T01:39:51.095098+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:43.457960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.096828+0000","last_change":"2023-11-04T01:39:01.899561+0000","last_active":"2023-11-04T01:39:51.096828+0000","last_peered":"2023-11-04T01:39:51.096828+0000","last_clean":"2023-11-04T01:39:51.096828+0000","last_became_active":"2023-11-04T01:38:59.886002+0000","last_became_peered":"2023-11-04T01:38:59.886002+0000","last_unstale":"2023-11-04T01:39:51.096828+0000","last_undegraded":"2023-11-04T01:39:51.096828+0000","last_fullsized":"2023-11-04T01:39:51.096828+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:06:48.983584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061693100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103516+0000","last_change":"2023-11-04T01:38:01.984567+0000","last_active":"2023-11-04T01:39:51.103516+0000","last_peered":"2023-11-04T01:39:51.103516+0000","last_clean":"2023-11-04T01:39:51.103516+0000","last_became_active":"2023-11-04T01:38:00.708020+0000","last_became_peered":"2023-11-04T01:38:00.708020+0000","last_unstale":"2023-11-04T01:39:51.103516+0000","last_undegraded":"2023-11-04T01:39:51.103516+0000","last_fullsized":"2023-11-04T01:39:51.103516+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:09.638146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056906299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.108006+0000","last_change":"2023-11-04T01:39:52.107184+0000","last_active":"2023-11-04T01:39:52.108006+0000","last_peered":"2023-11-04T01:39:52.108006+0000","last_clean":"2023-11-04T01:39:52.108006+0000","last_became_active":"2023-11-04T01:39:52.106901+0000","last_became_peered":"2023-11-04T01:39:52.106901+0000","last_unstale":"2023-11-04T01:39:52.108006+0000","last_undegraded":"2023-11-04T01:39:52.108006+0000","last_fullsized":"2023-11-04T01:39:52.108006+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:30:39.612504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"95'8","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.128910+0000","last_change":"2023-11-04T01:39:51.111840+0000","last_active":"2023-11-04T01:39:52.128910+0000","last_peered":"2023-11-04T01:39:52.128910+0000","last_clean":"2023-11-04T01:39:52.128910+0000","last_became_active":"2023-11-04T01:39:51.111541+0000","last_became_peered":"2023-11-04T01:39:51.111541+0000","last_unstale":"2023-11-04T01:39:52.128910+0000","last_undegraded":"2023-11-04T01:39:52.128910+0000","last_fullsized":"2023-11-04T01:39:52.128910+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:07.024999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097601+0000","last_change":"2023-11-04T01:39:00.902975+0000","last_active":"2023-11-04T01:39:51.097601+0000","last_peered":"2023-11-04T01:39:51.097601+0000","last_clean":"2023-11-04T01:39:51.097601+0000","last_became_active":"2023-11-04T01:39:00.902732+0000","last_became_peered":"2023-11-04T01:39:00.902732+0000","last_unstale":"2023-11-04T01:39:51.097601+0000","last_undegraded":"2023-11-04T01:39:51.097601+0000","last_fullsized":"2023-11-04T01:39:51.097601+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:21.265338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103389+0000","last_change":"2023-11-04T01:39:02.076570+0000","last_active":"2023-11-04T01:39:51.103389+0000","last_peered":"2023-11-04T01:39:51.103389+0000","last_clean":"2023-11-04T01:39:51.103389+0000","last_became_active":"2023-11-04T01:38:59.886841+0000","last_became_peered":"2023-11-04T01:38:59.886841+0000","last_unstale":"2023-11-04T01:39:51.103389+0000","last_undegraded":"2023-11-04T01:39:51.103389+0000","last_fullsized":"2023-11-04T01:39:51.103389+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:27.740854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064312500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.097417+0000","last_change":"2023-11-04T01:38:01.699685+0000","last_active":"2023-11-04T01:39:51.097417+0000","last_peered":"2023-11-04T01:39:51.097417+0000","last_clean":"2023-11-04T01:39:51.097417+0000","last_became_active":"2023-11-04T01:38:00.706802+0000","last_became_peered":"2023-11-04T01:38:00.706802+0000","last_unstale":"2023-11-04T01:39:51.097417+0000","last_undegraded":"2023-11-04T01:39:51.097417+0000","last_fullsized":"2023-11-04T01:39:51.097417+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:51.665611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085845400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.117625+0000","last_change":"2023-11-04T01:39:52.116590+0000","last_active":"2023-11-04T01:39:52.117625+0000","last_peered":"2023-11-04T01:39:52.117625+0000","last_clean":"2023-11-04T01:39:52.117625+0000","last_became_active":"2023-11-04T01:39:52.116257+0000","last_became_peered":"2023-11-04T01:39:52.116257+0000","last_unstale":"2023-11-04T01:39:52.117625+0000","last_undegraded":"2023-11-04T01:39:52.117625+0000","last_fullsized":"2023-11-04T01:39:52.117625+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:00:52.867584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.098100+0000","last_change":"2023-11-04T01:39:51.107937+0000","last_active":"2023-11-04T01:39:52.098100+0000","last_peered":"2023-11-04T01:39:52.098100+0000","last_clean":"2023-11-04T01:39:52.098100+0000","last_became_active":"2023-11-04T01:39:51.107695+0000","last_became_peered":"2023-11-04T01:39:51.107695+0000","last_unstale":"2023-11-04T01:39:52.098100+0000","last_undegraded":"2023-11-04T01:39:52.098100+0000","last_fullsized":"2023-11-04T01:39:52.098100+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:49:13.692636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.102441+0000","last_change":"2023-11-04T01:39:00.904110+0000","last_active":"2023-11-04T01:39:51.102441+0000","last_peered":"2023-11-04T01:39:51.102441+0000","last_clean":"2023-11-04T01:39:51.102441+0000","last_became_active":"2023-11-04T01:39:00.903820+0000","last_became_peered":"2023-11-04T01:39:00.903820+0000","last_unstale":"2023-11-04T01:39:51.102441+0000","last_undegraded":"2023-11-04T01:39:51.102441+0000","last_fullsized":"2023-11-04T01:39:51.102441+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:06:49.989064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.100409+0000","last_change":"2023-11-04T01:39:02.370981+0000","last_active":"2023-11-04T01:39:51.100409+0000","last_peered":"2023-11-04T01:39:51.100409+0000","last_clean":"2023-11-04T01:39:51.100409+0000","last_became_active":"2023-11-04T01:38:59.893000+0000","last_became_peered":"2023-11-04T01:38:59.893000+0000","last_unstale":"2023-11-04T01:39:51.100409+0000","last_undegraded":"2023-11-04T01:39:51.100409+0000","last_fullsized":"2023-11-04T01:39:51.100409+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:10.350371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065268599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":67,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098507+0000","last_change":"2023-11-04T01:38:01.700399+0000","last_active":"2023-11-04T01:39:51.098507+0000","last_peered":"2023-11-04T01:39:51.098507+0000","last_clean":"2023-11-04T01:39:51.098507+0000","last_became_active":"2023-11-04T01:38:00.701352+0000","last_became_peered":"2023-11-04T01:38:00.701352+0000","last_unstale":"2023-11-04T01:39:51.098507+0000","last_undegraded":"2023-11-04T01:39:51.098507+0000","last_fullsized":"2023-11-04T01:39:51.098507+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:24.304331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078589399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114813+0000","last_change":"2023-11-04T01:39:52.113489+0000","last_active":"2023-11-04T01:39:52.114813+0000","last_peered":"2023-11-04T01:39:52.114813+0000","last_clean":"2023-11-04T01:39:52.114813+0000","last_became_active":"2023-11-04T01:39:52.113214+0000","last_became_peered":"2023-11-04T01:39:52.113214+0000","last_unstale":"2023-11-04T01:39:52.114813+0000","last_undegraded":"2023-11-04T01:39:52.114813+0000","last_fullsized":"2023-11-04T01:39:52.114813+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:18.056532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.093358+0000","last_change":"2023-11-04T01:39:51.111916+0000","last_active":"2023-11-04T01:39:52.093358+0000","last_peered":"2023-11-04T01:39:52.093358+0000","last_clean":"2023-11-04T01:39:52.093358+0000","last_became_active":"2023-11-04T01:39:51.111571+0000","last_became_peered":"2023-11-04T01:39:51.111571+0000","last_unstale":"2023-11-04T01:39:52.093358+0000","last_undegraded":"2023-11-04T01:39:52.093358+0000","last_fullsized":"2023-11-04T01:39:52.093358+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:22.151389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.100463+0000","last_change":"2023-11-04T01:39:00.902993+0000","last_active":"2023-11-04T01:39:51.100463+0000","last_peered":"2023-11-04T01:39:51.100463+0000","last_clean":"2023-11-04T01:39:51.100463+0000","last_became_active":"2023-11-04T01:39:00.902704+0000","last_became_peered":"2023-11-04T01:39:00.902704+0000","last_unstale":"2023-11-04T01:39:51.100463+0000","last_undegraded":"2023-11-04T01:39:51.100463+0000","last_fullsized":"2023-11-04T01:39:51.100463+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:38.313962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099465+0000","last_change":"2023-11-04T01:39:02.039353+0000","last_active":"2023-11-04T01:39:51.099465+0000","last_peered":"2023-11-04T01:39:51.099465+0000","last_clean":"2023-11-04T01:39:51.099465+0000","last_became_active":"2023-11-04T01:38:59.897877+0000","last_became_peered":"2023-11-04T01:38:59.897877+0000","last_unstale":"2023-11-04T01:39:51.099465+0000","last_undegraded":"2023-11-04T01:39:51.099465+0000","last_fullsized":"2023-11-04T01:39:51.099465+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:13:39.795522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000482974,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.102793+0000","last_change":"2023-11-04T01:38:02.362072+0000","last_active":"2023-11-04T01:39:51.102793+0000","last_peered":"2023-11-04T01:39:51.102793+0000","last_clean":"2023-11-04T01:39:51.102793+0000","last_became_active":"2023-11-04T01:38:00.710897+0000","last_became_peered":"2023-11-04T01:38:00.710897+0000","last_unstale":"2023-11-04T01:39:51.102793+0000","last_undegraded":"2023-11-04T01:39:51.102793+0000","last_fullsized":"2023-11-04T01:39:51.102793+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:25.229838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058055900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.114421+0000","last_change":"2023-11-04T01:39:52.111319+0000","last_active":"2023-11-04T01:39:52.114421+0000","last_peered":"2023-11-04T01:39:52.114421+0000","last_clean":"2023-11-04T01:39:52.114421+0000","last_became_active":"2023-11-04T01:39:52.111055+0000","last_became_peered":"2023-11-04T01:39:52.111055+0000","last_unstale":"2023-11-04T01:39:52.114421+0000","last_undegraded":"2023-11-04T01:39:52.114421+0000","last_fullsized":"2023-11-04T01:39:52.114421+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:25.836309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"95'6","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.130887+0000","last_change":"2023-11-04T01:39:51.111046+0000","last_active":"2023-11-04T01:39:52.130887+0000","last_peered":"2023-11-04T01:39:52.130887+0000","last_clean":"2023-11-04T01:39:52.130887+0000","last_became_active":"2023-11-04T01:39:51.110777+0000","last_became_peered":"2023-11-04T01:39:51.110777+0000","last_unstale":"2023-11-04T01:39:52.130887+0000","last_undegraded":"2023-11-04T01:39:52.130887+0000","last_fullsized":"2023-11-04T01:39:52.130887+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:14:25.705293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103137+0000","last_change":"2023-11-04T01:39:00.901761+0000","last_active":"2023-11-04T01:39:51.103137+0000","last_peered":"2023-11-04T01:39:51.103137+0000","last_clean":"2023-11-04T01:39:51.103137+0000","last_became_active":"2023-11-04T01:39:00.901485+0000","last_became_peered":"2023-11-04T01:39:00.901485+0000","last_unstale":"2023-11-04T01:39:51.103137+0000","last_undegraded":"2023-11-04T01:39:51.103137+0000","last_fullsized":"2023-11-04T01:39:51.103137+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:37.511499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098056+0000","last_change":"2023-11-04T01:39:02.038972+0000","last_active":"2023-11-04T01:39:51.098056+0000","last_peered":"2023-11-04T01:39:51.098056+0000","last_clean":"2023-11-04T01:39:51.098056+0000","last_became_active":"2023-11-04T01:38:59.897966+0000","last_became_peered":"2023-11-04T01:38:59.897966+0000","last_unstale":"2023-11-04T01:39:51.098056+0000","last_undegraded":"2023-11-04T01:39:51.098056+0000","last_fullsized":"2023-11-04T01:39:51.098056+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:30.928374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041155899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099537+0000","last_change":"2023-11-04T01:38:01.939857+0000","last_active":"2023-11-04T01:39:51.099537+0000","last_peered":"2023-11-04T01:39:51.099537+0000","last_clean":"2023-11-04T01:39:51.099537+0000","last_became_active":"2023-11-04T01:38:00.701371+0000","last_became_peered":"2023-11-04T01:38:00.701371+0000","last_unstale":"2023-11-04T01:39:51.099537+0000","last_undegraded":"2023-11-04T01:39:51.099537+0000","last_fullsized":"2023-11-04T01:39:51.099537+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:31.853022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078632099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.118138+0000","last_change":"2023-11-04T01:39:52.110240+0000","last_active":"2023-11-04T01:39:52.118138+0000","last_peered":"2023-11-04T01:39:52.118138+0000","last_clean":"2023-11-04T01:39:52.118138+0000","last_became_active":"2023-11-04T01:39:52.109963+0000","last_became_peered":"2023-11-04T01:39:52.109963+0000","last_unstale":"2023-11-04T01:39:52.118138+0000","last_undegraded":"2023-11-04T01:39:52.118138+0000","last_fullsized":"2023-11-04T01:39:52.118138+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:20:14.008608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"95'3","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.128035+0000","last_change":"2023-11-04T01:39:51.112196+0000","last_active":"2023-11-04T01:39:52.128035+0000","last_peered":"2023-11-04T01:39:52.128035+0000","last_clean":"2023-11-04T01:39:52.128035+0000","last_became_active":"2023-11-04T01:39:51.111916+0000","last_became_peered":"2023-11-04T01:39:51.111916+0000","last_unstale":"2023-11-04T01:39:52.128035+0000","last_undegraded":"2023-11-04T01:39:52.128035+0000","last_fullsized":"2023-11-04T01:39:52.128035+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:57.721643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.098653+0000","last_change":"2023-11-04T01:39:00.901396+0000","last_active":"2023-11-04T01:39:51.098653+0000","last_peered":"2023-11-04T01:39:51.098653+0000","last_clean":"2023-11-04T01:39:51.098653+0000","last_became_active":"2023-11-04T01:39:00.901094+0000","last_became_peered":"2023-11-04T01:39:00.901094+0000","last_unstale":"2023-11-04T01:39:51.098653+0000","last_undegraded":"2023-11-04T01:39:51.098653+0000","last_fullsized":"2023-11-04T01:39:51.098653+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:48.475869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099289+0000","last_change":"2023-11-04T01:39:02.370014+0000","last_active":"2023-11-04T01:39:51.099289+0000","last_peered":"2023-11-04T01:39:51.099289+0000","last_clean":"2023-11-04T01:39:51.099289+0000","last_became_active":"2023-11-04T01:38:59.893020+0000","last_became_peered":"2023-11-04T01:38:59.893020+0000","last_unstale":"2023-11-04T01:39:51.099289+0000","last_undegraded":"2023-11-04T01:39:51.099289+0000","last_fullsized":"2023-11-04T01:39:51.099289+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:32.037301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058077499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.099804+0000","last_change":"2023-11-04T01:38:01.939662+0000","last_active":"2023-11-04T01:39:51.099804+0000","last_peered":"2023-11-04T01:39:51.099804+0000","last_clean":"2023-11-04T01:39:51.099804+0000","last_became_active":"2023-11-04T01:38:00.705871+0000","last_became_peered":"2023-11-04T01:38:00.705871+0000","last_unstale":"2023-11-04T01:39:51.099804+0000","last_undegraded":"2023-11-04T01:39:51.099804+0000","last_fullsized":"2023-11-04T01:39:51.099804+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:19.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066873200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.109403+0000","last_change":"2023-11-04T01:39:52.107036+0000","last_active":"2023-11-04T01:39:52.109403+0000","last_peered":"2023-11-04T01:39:52.109403+0000","last_clean":"2023-11-04T01:39:52.109403+0000","last_became_active":"2023-11-04T01:39:52.106645+0000","last_became_peered":"2023-11-04T01:39:52.106645+0000","last_unstale":"2023-11-04T01:39:52.109403+0000","last_undegraded":"2023-11-04T01:39:52.109403+0000","last_fullsized":"2023-11-04T01:39:52.109403+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:51.085366+0000","last_clean_scrub_stamp":"2023-11-04T01:39:51.085366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:45.051199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:39:52.104963+0000","last_change":"2023-11-04T01:39:51.110842+0000","last_active":"2023-11-04T01:39:52.104963+0000","last_peered":"2023-11-04T01:39:52.104963+0000","last_clean":"2023-11-04T01:39:52.104963+0000","last_became_active":"2023-11-04T01:39:51.110529+0000","last_became_peered":"2023-11-04T01:39:51.110529+0000","last_unstale":"2023-11-04T01:39:52.104963+0000","last_undegraded":"2023-11-04T01:39:52.104963+0000","last_fullsized":"2023-11-04T01:39:52.104963+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:50.081772+0000","last_clean_scrub_stamp":"2023-11-04T01:39:50.081772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:43:08.727660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.095755+0000","last_change":"2023-11-04T01:39:00.904488+0000","last_active":"2023-11-04T01:39:51.095755+0000","last_peered":"2023-11-04T01:39:51.095755+0000","last_clean":"2023-11-04T01:39:51.095755+0000","last_became_active":"2023-11-04T01:39:00.904234+0000","last_became_peered":"2023-11-04T01:39:00.904234+0000","last_unstale":"2023-11-04T01:39:51.095755+0000","last_undegraded":"2023-11-04T01:39:51.095755+0000","last_fullsized":"2023-11-04T01:39:51.095755+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:59.864238+0000","last_clean_scrub_stamp":"2023-11-04T01:38:59.864238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:05:10.425461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094780+0000","last_change":"2023-11-04T01:39:01.896521+0000","last_active":"2023-11-04T01:39:51.094780+0000","last_peered":"2023-11-04T01:39:51.094780+0000","last_clean":"2023-11-04T01:39:51.094780+0000","last_became_active":"2023-11-04T01:38:59.890560+0000","last_became_peered":"2023-11-04T01:38:59.890560+0000","last_unstale":"2023-11-04T01:39:51.094780+0000","last_undegraded":"2023-11-04T01:39:51.094780+0000","last_fullsized":"2023-11-04T01:39:51.094780+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:38:58.858757+0000","last_clean_scrub_stamp":"2023-11-04T01:38:58.858757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:14.608973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052638499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.103355+0000","last_change":"2023-11-04T01:38:01.984672+0000","last_active":"2023-11-04T01:39:51.103355+0000","last_peered":"2023-11-04T01:39:51.103355+0000","last_clean":"2023-11-04T01:39:51.103355+0000","last_became_active":"2023-11-04T01:38:00.706804+0000","last_became_peered":"2023-11-04T01:38:00.706804+0000","last_unstale":"2023-11-04T01:39:51.103355+0000","last_undegraded":"2023-11-04T01:39:51.103355+0000","last_fullsized":"2023-11-04T01:39:51.103355+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:37:59.686967+0000","last_clean_scrub_stamp":"2023-11-04T01:37:59.686967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:48.412413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038439000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":230,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:39:51.094548+0000","last_change":"2023-11-04T01:36:19.262856+0000","last_active":"2023-11-04T01:39:51.094548+0000","last_peered":"2023-11-04T01:39:51.094548+0000","last_clean":"2023-11-04T01:39:51.094548+0000","last_became_active":"2023-11-04T01:36:19.261936+0000","last_became_peered":"2023-11-04T01:36:19.261936+0000","last_unstale":"2023-11-04T01:39:51.094548+0000","last_undegraded":"2023-11-04T01:39:51.094548+0000","last_fullsized":"2023-11-04T01:39:51.094548+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:36:18.028456+0000","last_clean_scrub_stamp":"2023-11-04T01:36:18.028456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:09.413839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1773568,"data_stored":1170041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.39200000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.83299999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57399999999999995,"15min":0.56699999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56499999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.371,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.625,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.439,"5min":0.318,"15min":0.318},"max":{"1min":0.79200000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.432}]},{"osd":2,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.442},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.40500000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45300000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.40899999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.40799999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.53400000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.44600000000000001,"15min":0.433},"min":{"1min":0.35099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65300000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.47199999999999998,"15min":0.45200000000000001},"min":{"1min":0.33100000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.34599999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51100000000000001,"15min":0.498},"min":{"1min":0.38700000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65300000000000002,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.747,"5min":0.877,"15min":0.877},"last":0.5}]},{"osd":6,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.503,"15min":0.48399999999999999},"min":{"1min":0.34399999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.53200000000000003},"min":{"1min":0.40799999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68200000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.379}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1175552,"data_stored":579127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.51200000000000001,"15min":0.499},"min":{"1min":0.375,"5min":0.214,"15min":0.214},"max":{"1min":0.70699999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70099999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.624}]},{"osd":1,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72299999999999998,"5min":1.05,"15min":1.05},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.59299999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.41599999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.70499999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.68400000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.63800000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.67500000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.502,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.75,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.498,"15min":0.497},"min":{"1min":0.34899999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63800000000000001,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.442}]},{"osd":5,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32900000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68300000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.379},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40500000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.72699999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.41099999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73499999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67900000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":579661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36899999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71499999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57999999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.747,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.60799999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78700000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.502}]},{"osd":3,"last update":"Sat Nov 4 01:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.45100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82699999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.42699999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48299999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.307,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.432},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.38100000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66800000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.51400000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.35199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.67800000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53800000000000003,"15min":0.53500000000000003},"min":{"1min":0.35399999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71899999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.35099999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.69999999999999996,"5min":0.751,"15min":0.751},"last":0.377}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1159168,"data_stored":570871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79500000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.57699999999999996,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77700000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.76000000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.371,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65700000000000003,"5min":0.875,"15min":0.875},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58399999999999996,"15min":0.59599999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70299999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67900000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58099999999999996,"15min":0.59199999999999997},"min":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75700000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.78600000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70399999999999996,"5min":0.879,"15min":0.879},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.57799999999999996,"15min":0.59699999999999998},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.624,"5min":1.089,"15min":1.089},"last":0.80200000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.316,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.874,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.52400000000000002},"min":{"1min":0.35399999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.89500000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81799999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58999999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.42099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70899999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85399999999999998,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.64500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":580739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.249},{"interface":"front","average":{"1min":0.307,"5min":0.313,"15min":0.313},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.26500000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32100000000000001,"15min":0.33000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.434,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.23799999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.38200000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.34999999999999998},"min":{"1min":0.28199999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.37,"15min":0.374},"min":{"1min":0.27200000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.495,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.313}]},{"osd":4,"last update":"Sat Nov 4 01:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.40400000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79900000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Sat Nov 4 01:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.52700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82699999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.747,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48999999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.55200000000000005,"15min":0.53600000000000003},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.44500000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77800000000000002,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.505}]},{"osd":7,"last update":"Sat Nov 4 01:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57799999999999996,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76200000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.436,"5min":0.378,"15min":0.378},"max":{"1min":0.81000000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1171456,"data_stored":579057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32200000000000001,"15min":0.33000000000000002},"min":{"1min":0.20399999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.44900000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.309,"5min":0.32900000000000001,"15min":0.34100000000000003},"min":{"1min":0.24199999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.43099999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.46200000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.35399999999999998,"15min":0.36799999999999999},"min":{"1min":0.23899999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.42199999999999999,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.379,"15min":0.39900000000000002},"min":{"1min":0.25600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.48499999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39800000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.39800000000000002,"15min":0.41699999999999998},"min":{"1min":0.29899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.46800000000000003,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.40400000000000003,"15min":0.42799999999999999},"min":{"1min":0.29299999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.46200000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.504}]},{"osd":4,"last update":"Sat Nov 4 01:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.626,"15min":0.64600000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77100000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.74399999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.94899999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.81100000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59699999999999998,"15min":0.61899999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71299999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.81299999999999994}]},{"osd":6,"last update":"Sat Nov 4 01:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82899999999999996,"5min":1,"15min":1},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.60099999999999998,"15min":0.61599999999999999},"min":{"1min":0.41299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72599999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.78100000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56699999999999995,"15min":0.57599999999999996},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.60599999999999998},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.88100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1179648,"data_stored":579181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39700000000000002,"15min":0.36199999999999999},"min":{"1min":0.23699999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.47699999999999998,"5min":5.415,"15min":5.415},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.41799999999999998,"15min":0.40899999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.52500000000000002,"5min":3.456,"15min":3.456},"last":0.26100000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.39400000000000002,"15min":0.39600000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.56399999999999995,"5min":2.355,"15min":2.355},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.40300000000000002,"15min":0.38700000000000001},"min":{"1min":0.28299999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61499999999999999,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.33000000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.52200000000000002,"15min":0.46999999999999997},"min":{"1min":0.32100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58099999999999996,"5min":8.891,"15min":8.891},"last":0.378},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.46600000000000003,"15min":0.39600000000000002},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.54600000000000004,"5min":9.8889999999999993,"15min":9.8889999999999993},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63300000000000001,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76600000000000001,"5min":4.5720000000000001,"15min":4.5720000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59399999999999997,"15min":0.57599999999999996},"min":{"1min":0.45600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":0.53400000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.60099999999999998},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93100000000000005,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.872,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.68200000000000005,"15min":0.64600000000000002},"min":{"1min":0.48999999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82999999999999996,"5min":5.915,"15min":5.915},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1080000000000001,"5min":1.288,"15min":1.288},"last":0.61799999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:39:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.622,"15min":0.60599999999999998},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.84199999999999997,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66100000000000003,"15min":0.60599999999999998},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.93600000000000005,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1753088,"data_stored":1161239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.314,"15min":0.31},"min":{"1min":0.26500000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33300000000000002,"15min":0.33700000000000002},"min":{"1min":0.221,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.49099999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35999999999999999,"15min":0.36599999999999999},"min":{"1min":0.23899999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48599999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.23100000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.499,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.27400000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.32300000000000001,"15min":0.317},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.376,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51800000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.29499999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81899999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53500000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.93000000000000005,"5min":0.996,"15min":0.996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67600000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.40500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90400000000000003,"5min":1.026,"15min":1.026},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.59699999999999998,"15min":0.59899999999999998},"min":{"1min":0.46000000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89000000000000001,"5min":1.177,"15min":1.177},"last":0.59299999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.443,"5min":0.374,"15min":0.374},"max":{"1min":0.85099999999999998,"5min":1.131,"15min":1.131},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:39:55.404 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:39:55.405 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:39:55.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.541+0000 7fbad8007640 1 Processor -- start 2023-11-04T01:39:55.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.541+0000 7fbad8007640 1 -- start start 2023-11-04T01:39:55.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.542+0000 7fbad8007640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbad015e430 0x7fbad00cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.542+0000 7fbad8007640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbad00d0710 0x7fbad00b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.542+0000 7fbad8007640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad00d0280 con 0x7fbad00cf160 2023-11-04T01:39:55.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.542+0000 7fbad8007640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad00cf670 con 0x7fbad00d0710 2023-11-04T01:39:55.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.542+0000 7fbad8007640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad00cf950 con 0x7fbad015e430 2023-11-04T01:39:55.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.542+0000 7fbad65a4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbad00d0710 0x7fbad00b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.542+0000 7fbad55a2640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbad00cf160 0x7fbad00cd510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58134/0 (socket says 172.21.15.114:58134) 2023-11-04T01:39:55.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.542+0000 7fbad55a2640 1 -- 172.21.15.114:0/1995041936 learned_addr learned my addr 172.21.15.114:0/1995041936 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:55.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.543+0000 7fbad5da3640 1 --2- 172.21.15.114:0/1995041936 >> v2:172.21.15.141:3300/0 conn(0x7fbad015e430 0x7fbad00cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.543+0000 7fbad4da1640 1 -- 172.21.15.114:0/1995041936 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134970156 0 0) 0x7fbad00d0280 con 0x7fbad00cf160 2023-11-04T01:39:55.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.543+0000 7fbad4da1640 1 -- 172.21.15.114:0/1995041936 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbabc003520 con 0x7fbad00cf160 2023-11-04T01:39:55.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.543+0000 7fbad65a4640 1 -- 172.21.15.114:0/1995041936 >> v2:172.21.15.141:3300/0 conn(0x7fbad015e430 msgr2=0x7fbad00cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:55.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.543+0000 7fbad65a4640 1 --2- 172.21.15.114:0/1995041936 >> v2:172.21.15.141:3300/0 conn(0x7fbad015e430 0x7fbad00cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.543+0000 7fbad65a4640 1 -- 172.21.15.114:0/1995041936 >> v1:172.21.15.114:6789/0 conn(0x7fbad00cf160 legacy=0x7fbad00cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.543+0000 7fbad65a4640 1 -- 172.21.15.114:0/1995041936 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad00cfc30 con 0x7fbad00d0710 2023-11-04T01:39:55.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.543+0000 7fbad5da3640 1 --2- 172.21.15.114:0/1995041936 >> v2:172.21.15.141:3300/0 conn(0x7fbad015e430 0x7fbad00cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:55.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.543+0000 7fbad65a4640 1 --2- 172.21.15.114:0/1995041936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad00d0710 0x7fbad00b3d40 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fbad006e5b0 tx=0x7fbac802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e383f5194a945fbc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:55.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.544+0000 7fbad4da1640 1 -- 172.21.15.114:0/1995041936 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8031830 con 0x7fbad00d0710 2023-11-04T01:39:55.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.544+0000 7fbad4da1640 1 -- 172.21.15.114:0/1995041936 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac8031990 con 0x7fbad00d0710 2023-11-04T01:39:55.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.544+0000 7fbad4da1640 1 -- 172.21.15.114:0/1995041936 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8031d00 con 0x7fbad00d0710 2023-11-04T01:39:55.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.544+0000 7fbad8007640 1 -- 172.21.15.114:0/1995041936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad00d0710 msgr2=0x7fbad00b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.544+0000 7fbad8007640 1 --2- 172.21.15.114:0/1995041936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad00d0710 0x7fbad00b3d40 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fbad006e5b0 tx=0x7fbac802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.544+0000 7fbad8007640 1 -- 172.21.15.114:0/1995041936 shutdown_connections 2023-11-04T01:39:55.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.544+0000 7fbad8007640 1 --2- 172.21.15.114:0/1995041936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad00d0710 0x7fbad00b3d40 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.544+0000 7fbad8007640 1 --2- 172.21.15.114:0/1995041936 >> v2:172.21.15.141:3300/0 conn(0x7fbad015e430 0x7fbad00cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.544+0000 7fbad8007640 1 -- 172.21.15.114:0/1995041936 >> 172.21.15.114:0/1995041936 conn(0x7fbad006ea20 msgr2=0x7fbad006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:55.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.544+0000 7fbad8007640 1 -- 172.21.15.114:0/1995041936 shutdown_connections 2023-11-04T01:39:55.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.544+0000 7fbad8007640 1 -- 172.21.15.114:0/1995041936 wait complete. 2023-11-04T01:39:55.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.545+0000 7fbad8007640 1 Processor -- start 2023-11-04T01:39:55.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.545+0000 7fbad8007640 1 -- start start 2023-11-04T01:39:55.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad8007640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbad00cf160 0x7fbad00c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad8007640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad00d0710 0x7fbad01f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad8007640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbad015e430 0x7fbad015a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad8007640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad00a7750 con 0x7fbad00d0710 2023-11-04T01:39:55.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad8007640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad00c7d10 con 0x7fbad00cf160 2023-11-04T01:39:55.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad8007640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad01f4760 con 0x7fbad015e430 2023-11-04T01:39:55.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad55a2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad00d0710 0x7fbad01f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad55a2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad00d0710 0x7fbad01f3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54670/0 (socket says 172.21.15.114:54670) 2023-11-04T01:39:55.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad55a2640 1 -- 172.21.15.114:0/2717443741 learned_addr learned my addr 172.21.15.114:0/2717443741 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:55.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad65a4640 1 --2- 172.21.15.114:0/2717443741 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbad015e430 0x7fbad015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad5da3640 1 --2- 172.21.15.114:0/2717443741 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbad00cf160 0x7fbad00c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad55a2640 1 -- 172.21.15.114:0/2717443741 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbad015e430 msgr2=0x7fbad015a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad55a2640 1 --2- 172.21.15.114:0/2717443741 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbad015e430 0x7fbad015a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad55a2640 1 -- 172.21.15.114:0/2717443741 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbad00cf160 msgr2=0x7fbad00c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad55a2640 1 --2- 172.21.15.114:0/2717443741 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbad00cf160 0x7fbad00c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad55a2640 1 -- 172.21.15.114:0/2717443741 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac8009400 con 0x7fbad00d0710 2023-11-04T01:39:55.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad65a4640 1 --2- 172.21.15.114:0/2717443741 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbad015e430 0x7fbad015a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:55.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad5da3640 1 --2- 172.21.15.114:0/2717443741 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbad00cf160 0x7fbad00c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:55.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.546+0000 7fbad55a2640 1 --2- 172.21.15.114:0/2717443741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad00d0710 0x7fbad01f3f10 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fbac000c3c0 tx=0x7fbac000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:55.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.547+0000 7fbac67fc640 1 -- 172.21.15.114:0/2717443741 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0005ce0 con 0x7fbad00d0710 2023-11-04T01:39:55.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.547+0000 7fbac67fc640 1 -- 172.21.15.114:0/2717443741 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac0005e40 con 0x7fbad00d0710 2023-11-04T01:39:55.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.547+0000 7fbad8007640 1 -- 172.21.15.114:0/2717443741 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad01f4a40 con 0x7fbad00d0710 2023-11-04T01:39:55.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.547+0000 7fbac67fc640 1 -- 172.21.15.114:0/2717443741 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac00072f0 con 0x7fbad00d0710 2023-11-04T01:39:55.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.547+0000 7fbad8007640 1 -- 172.21.15.114:0/2717443741 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad01f4450 con 0x7fbad00d0710 2023-11-04T01:39:55.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.548+0000 7fbad8007640 1 -- 172.21.15.114:0/2717443741 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad0074290 con 0x7fbad00d0710 2023-11-04T01:39:55.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.548+0000 7fbac67fc640 1 -- 172.21.15.114:0/2717443741 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbac0007450 con 0x7fbad00d0710 2023-11-04T01:39:55.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.548+0000 7fbac67fc640 1 --2- 172.21.15.114:0/2717443741 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbab406ae70 0x7fbab406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.549+0000 7fbac67fc640 1 -- 172.21.15.114:0/2717443741 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fbac0089150 con 0x7fbad00d0710 2023-11-04T01:39:55.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.549+0000 7fbad5da3640 1 --2- 172.21.15.114:0/2717443741 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbab406ae70 0x7fbab406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.549+0000 7fbad5da3640 1 --2- 172.21.15.114:0/2717443741 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbab406ae70 0x7fbab406d330 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00d430 tx=0x7fbacc007530 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:55.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.553+0000 7fbac67fc640 1 -- 172.21.15.114:0/2717443741 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbac0053c80 con 0x7fbad00d0710 2023-11-04T01:39:55.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.784+0000 7fbad8007640 1 -- 172.21.15.114:0/2717443741 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbad01e5730 con 0x7fbad00d0710 2023-11-04T01:39:55.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.786+0000 7fbac67fc640 1 -- 172.21.15.114:0/2717443741 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fbac00170e0 con 0x7fbad00d0710 2023-11-04T01:39:55.790 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2023-11-04T01:39:55.790 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDan0Vl3QHODhAA6LWlhd+avWYsoYsWMbOiVA== 2023-11-04T01:39:55.790 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2023-11-04T01:39:55.790 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2023-11-04T01:39:55.790 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:39:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2023-11-04T01:39:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.788+0000 7fbad8007640 1 -- 172.21.15.114:0/2717443741 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbab406ae70 msgr2=0x7fbab406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.788+0000 7fbad8007640 1 --2- 172.21.15.114:0/2717443741 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbab406ae70 0x7fbab406d330 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00d430 tx=0x7fbacc007530 comp rx=0 tx=0).stop 2023-11-04T01:39:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.788+0000 7fbad8007640 1 -- 172.21.15.114:0/2717443741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad00d0710 msgr2=0x7fbad01f3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.788+0000 7fbad8007640 1 --2- 172.21.15.114:0/2717443741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad00d0710 0x7fbad01f3f10 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fbac000c3c0 tx=0x7fbac000c880 comp rx=0 tx=0).stop 2023-11-04T01:39:55.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.788+0000 7fbad8007640 1 -- 172.21.15.114:0/2717443741 shutdown_connections 2023-11-04T01:39:55.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.788+0000 7fbad8007640 1 --2- 172.21.15.114:0/2717443741 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbad015e430 0x7fbad015a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.788+0000 7fbad8007640 1 --2- 172.21.15.114:0/2717443741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbad00d0710 0x7fbad01f3f10 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.788+0000 7fbad8007640 1 --2- 172.21.15.114:0/2717443741 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbab406ae70 0x7fbab406d330 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.788+0000 7fbad8007640 1 --2- 172.21.15.114:0/2717443741 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbad00cf160 0x7fbad00c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.788+0000 7fbad8007640 1 -- 172.21.15.114:0/2717443741 >> 172.21.15.114:0/2717443741 conn(0x7fbad006ea20 msgr2=0x7fbad015b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:55.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.788+0000 7fbad8007640 1 -- 172.21.15.114:0/2717443741 shutdown_connections 2023-11-04T01:39:55.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.788+0000 7fbad8007640 1 -- 172.21.15.114:0/2717443741 wait complete. 2023-11-04T01:39:55.800 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:55.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.899+0000 7f97f9ae7640 1 Processor -- start 2023-11-04T01:39:55.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.899+0000 7f97f9ae7640 1 -- start start 2023-11-04T01:39:55.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.900+0000 7f97f9ae7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97f40b0ae0 0x7f97f40ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.900+0000 7f97f9ae7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f97f406db20 0x7f97f415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.900+0000 7f97f9ae7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f40b4110 con 0x7f97f4159c70 2023-11-04T01:39:55.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.900+0000 7f97f9ae7640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f40b49b0 con 0x7f97f406db20 2023-11-04T01:39:55.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.900+0000 7f97f9ae7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f40b43f0 con 0x7f97f40b0ae0 2023-11-04T01:39:55.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.900+0000 7f97f37fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f97f4159c70 0x7f97f40b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58136/0 (socket says 172.21.15.114:58136) 2023-11-04T01:39:55.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.900+0000 7f97f37fe640 1 -- 172.21.15.114:0/679636773 learned_addr learned my addr 172.21.15.114:0/679636773 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:55.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.900+0000 7f97f2ffd640 1 --2- 172.21.15.114:0/679636773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97f40b0ae0 0x7f97f40ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.900+0000 7f97f3fff640 1 --2- 172.21.15.114:0/679636773 >> v2:172.21.15.141:3300/0 conn(0x7f97f406db20 0x7f97f415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.901+0000 7f97f2ffd640 1 -- 172.21.15.114:0/679636773 >> v2:172.21.15.141:3300/0 conn(0x7f97f406db20 msgr2=0x7f97f415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:55.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.901+0000 7f97f2ffd640 1 --2- 172.21.15.114:0/679636773 >> v2:172.21.15.141:3300/0 conn(0x7f97f406db20 0x7f97f415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.901+0000 7f97f2ffd640 1 -- 172.21.15.114:0/679636773 >> v1:172.21.15.114:6789/0 conn(0x7f97f4159c70 legacy=0x7f97f40b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.901+0000 7f97f2ffd640 1 -- 172.21.15.114:0/679636773 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f40b46d0 con 0x7f97f40b0ae0 2023-11-04T01:39:55.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.901+0000 7f97f3fff640 1 --2- 172.21.15.114:0/679636773 >> v2:172.21.15.141:3300/0 conn(0x7f97f406db20 0x7f97f415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:55.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.901+0000 7f97f2ffd640 1 --2- 172.21.15.114:0/679636773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97f40b0ae0 0x7f97f40ce370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f97e40097a0 tx=0x7f97e402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bb0436713728502 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:55.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.902+0000 7f97f27fc640 1 -- 172.21.15.114:0/679636773 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4031830 con 0x7f97f40b0ae0 2023-11-04T01:39:55.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.902+0000 7f97f27fc640 1 -- 172.21.15.114:0/679636773 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e4031990 con 0x7f97f40b0ae0 2023-11-04T01:39:55.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.902+0000 7f97f27fc640 1 -- 172.21.15.114:0/679636773 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4031d20 con 0x7f97f40b0ae0 2023-11-04T01:39:55.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.902+0000 7f97f9ae7640 1 -- 172.21.15.114:0/679636773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97f40b0ae0 msgr2=0x7f97f40ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.902+0000 7f97f9ae7640 1 --2- 172.21.15.114:0/679636773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97f40b0ae0 0x7f97f40ce370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f97e40097a0 tx=0x7f97e402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.902+0000 7f97f9ae7640 1 -- 172.21.15.114:0/679636773 shutdown_connections 2023-11-04T01:39:55.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.902+0000 7f97f9ae7640 1 --2- 172.21.15.114:0/679636773 >> v2:172.21.15.141:3300/0 conn(0x7f97f406db20 0x7f97f415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.902+0000 7f97f9ae7640 1 --2- 172.21.15.114:0/679636773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97f40b0ae0 0x7f97f40ce370 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.902+0000 7f97f9ae7640 1 -- 172.21.15.114:0/679636773 >> 172.21.15.114:0/679636773 conn(0x7f97f40ce950 msgr2=0x7f97f40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:55.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.902+0000 7f97f9ae7640 1 -- 172.21.15.114:0/679636773 shutdown_connections 2023-11-04T01:39:55.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.902+0000 7f97f9ae7640 1 -- 172.21.15.114:0/679636773 wait complete. 2023-11-04T01:39:55.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.903+0000 7f97f9ae7640 1 Processor -- start 2023-11-04T01:39:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.904+0000 7f97f9ae7640 1 -- start start 2023-11-04T01:39:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.904+0000 7f97f9ae7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97f406db20 0x7f97f4143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.904+0000 7f97f9ae7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97f40b0ae0 0x7f97f4150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.904+0000 7f97f9ae7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f4159c70 0x7f97f4151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.904+0000 7f97f9ae7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f415aa40 con 0x7f97f4159c70 2023-11-04T01:39:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.904+0000 7f97f9ae7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f4150ab0 con 0x7f97f406db20 2023-11-04T01:39:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.904+0000 7f97f9ae7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f4150d90 con 0x7f97f40b0ae0 2023-11-04T01:39:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.904+0000 7f97f3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f4159c70 0x7f97f4151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.904+0000 7f97f3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f4159c70 0x7f97f4151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54684/0 (socket says 172.21.15.114:54684) 2023-11-04T01:39:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.904+0000 7f97f3fff640 1 -- 172.21.15.114:0/3861880270 learned_addr learned my addr 172.21.15.114:0/3861880270 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.904+0000 7f97f37fe640 1 --2- 172.21.15.114:0/3861880270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97f406db20 0x7f97f4143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.905+0000 7f97f2ffd640 1 --2- 172.21.15.114:0/3861880270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97f40b0ae0 0x7f97f4150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.905+0000 7f97f3fff640 1 -- 172.21.15.114:0/3861880270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97f40b0ae0 msgr2=0x7f97f4150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.905+0000 7f97f3fff640 1 --2- 172.21.15.114:0/3861880270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97f40b0ae0 0x7f97f4150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.905+0000 7f97f3fff640 1 -- 172.21.15.114:0/3861880270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97f406db20 msgr2=0x7f97f4143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.905+0000 7f97f3fff640 1 --2- 172.21.15.114:0/3861880270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97f406db20 0x7f97f4143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.905+0000 7f97f3fff640 1 -- 172.21.15.114:0/3861880270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec009a70 con 0x7f97f4159c70 2023-11-04T01:39:55.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.905+0000 7f97f3fff640 1 --2- 172.21.15.114:0/3861880270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f4159c70 0x7f97f4151da0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00e580 tx=0x7f97ec00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:55.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.905+0000 7f97ebfff640 1 -- 172.21.15.114:0/3861880270 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec003b90 con 0x7f97f4159c70 2023-11-04T01:39:55.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.905+0000 7f97ebfff640 1 -- 172.21.15.114:0/3861880270 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec003cf0 con 0x7f97f4159c70 2023-11-04T01:39:55.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.905+0000 7f97f9ae7640 1 -- 172.21.15.114:0/3861880270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e4009400 con 0x7f97f4159c70 2023-11-04T01:39:55.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.905+0000 7f97ebfff640 1 -- 172.21.15.114:0/3861880270 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec004240 con 0x7f97f4159c70 2023-11-04T01:39:55.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.905+0000 7f97f9ae7640 1 -- 172.21.15.114:0/3861880270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f415ac50 con 0x7f97f4159c70 2023-11-04T01:39:55.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.906+0000 7f97f9ae7640 1 -- 172.21.15.114:0/3861880270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f415ae40 con 0x7f97f4159c70 2023-11-04T01:39:55.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.906+0000 7f97ebfff640 1 -- 172.21.15.114:0/3861880270 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f97ec0043a0 con 0x7f97f4159c70 2023-11-04T01:39:55.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.907+0000 7f97ebfff640 1 --2- 172.21.15.114:0/3861880270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f97d406ae70 0x7f97d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.907+0000 7f97f37fe640 1 --2- 172.21.15.114:0/3861880270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f97d406ae70 0x7f97d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.907+0000 7f97ebfff640 1 -- 172.21.15.114:0/3861880270 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f97ec016070 con 0x7f97f4159c70 2023-11-04T01:39:55.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.907+0000 7f97f37fe640 1 --2- 172.21.15.114:0/3861880270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f97d406ae70 0x7f97d406d330 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f97dc007fd0 tx=0x7f97dc007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:55.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:55.911+0000 7f97ebfff640 1 -- 172.21.15.114:0/3861880270 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97ec057550 con 0x7f97f4159c70 2023-11-04T01:39:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.112+0000 7f97f9ae7640 1 -- 172.21.15.114:0/3861880270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97f4074290 con 0x7f97f4159c70 2023-11-04T01:39:56.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.113+0000 7f97ebfff640 1 -- 172.21.15.114:0/3861880270 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f97ec009d70 con 0x7f97f4159c70 2023-11-04T01:39:56.115 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:39:56.115 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":43,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:39:53.429982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7431":{"gid":7431,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/3780323525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3780323525},{"type":"v1","addr":"172.21.15.114:6836","nonce":3780323525}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:39:56.115 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 43 2023-11-04T01:39:56.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.115+0000 7f97f9ae7640 1 -- 172.21.15.114:0/3861880270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f97d406ae70 msgr2=0x7f97d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.115+0000 7f97f9ae7640 1 --2- 172.21.15.114:0/3861880270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f97d406ae70 0x7f97d406d330 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f97dc007fd0 tx=0x7f97dc007e80 comp rx=0 tx=0).stop 2023-11-04T01:39:56.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.115+0000 7f97f9ae7640 1 -- 172.21.15.114:0/3861880270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f4159c70 msgr2=0x7f97f4151da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.115+0000 7f97f9ae7640 1 --2- 172.21.15.114:0/3861880270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f4159c70 0x7f97f4151da0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00e580 tx=0x7f97ec00ea40 comp rx=0 tx=0).stop 2023-11-04T01:39:56.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.115+0000 7f97f9ae7640 1 -- 172.21.15.114:0/3861880270 shutdown_connections 2023-11-04T01:39:56.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.115+0000 7f97f9ae7640 1 --2- 172.21.15.114:0/3861880270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97f4159c70 0x7f97f4151da0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.115+0000 7f97f9ae7640 1 --2- 172.21.15.114:0/3861880270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f97f40b0ae0 0x7f97f4150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.115+0000 7f97f9ae7640 1 --2- 172.21.15.114:0/3861880270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f97d406ae70 0x7f97d406d330 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.115+0000 7f97f9ae7640 1 --2- 172.21.15.114:0/3861880270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97f406db20 0x7f97f4143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.115+0000 7f97f9ae7640 1 -- 172.21.15.114:0/3861880270 >> 172.21.15.114:0/3861880270 conn(0x7f97f40ce950 msgr2=0x7f97f40cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:56.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.115+0000 7f97f9ae7640 1 -- 172.21.15.114:0/3861880270 shutdown_connections 2023-11-04T01:39:56.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.115+0000 7f97f9ae7640 1 -- 172.21.15.114:0/3861880270 wait complete. 2023-11-04T01:39:56.530 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:39:51.430343+0000', 'modified': '2023-11-04T01:39:53.429982+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7431}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7431': {'gid': 7431, 'name': 'c', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6836/3780323525', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6834', 'nonce': 3780323525}, {'type': 'v1', 'addr': '172.21.15.114:6836', 'nonce': 3780323525}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:39:56.530 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:39:56.530 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:39:56.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.630+0000 7f75e5b89640 1 Processor -- start 2023-11-04T01:39:56.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.630+0000 7f75e5b89640 1 -- start start 2023-11-04T01:39:56.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.631+0000 7f75e5b89640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f75e00b1a40 0x7f75e00ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.631+0000 7f75e5b89640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e0160990 con 0x7f75e006a830 2023-11-04T01:39:56.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.631+0000 7f75e5b89640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e00cc7c0 con 0x7f75e01605b0 2023-11-04T01:39:56.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.631+0000 7f75e5b89640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e00cd750 con 0x7f75e00b1a40 2023-11-04T01:39:56.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.631+0000 7f75dffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f75e006a830 0x7f75e00cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33310/0 (socket says 172.21.15.114:33310) 2023-11-04T01:39:56.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.631+0000 7f75dffff640 1 -- 172.21.15.114:0/3501303441 learned_addr learned my addr 172.21.15.114:0/3501303441 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:56.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.631+0000 7f75deffd640 1 --2- 172.21.15.114:0/3501303441 >> v2:172.21.15.141:3300/0 conn(0x7f75e00b1a40 0x7f75e00ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.631+0000 7f75de7fc640 1 -- 172.21.15.114:0/3501303441 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032519816 0 0) 0x7f75e0160990 con 0x7f75e006a830 2023-11-04T01:39:56.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.631+0000 7f75de7fc640 1 -- 172.21.15.114:0/3501303441 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75c8003520 con 0x7f75e006a830 2023-11-04T01:39:56.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75de7fc640 1 -- 172.21.15.114:0/3501303441 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2303356280 0 0) 0x7f75c8003520 con 0x7f75e006a830 2023-11-04T01:39:56.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75de7fc640 1 -- 172.21.15.114:0/3501303441 >> v2:172.21.15.141:3300/0 conn(0x7f75e00b1a40 msgr2=0x7f75e00ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:56.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75de7fc640 1 --2- 172.21.15.114:0/3501303441 >> v2:172.21.15.141:3300/0 conn(0x7f75e00b1a40 0x7f75e00ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75de7fc640 1 -- 172.21.15.114:0/3501303441 >> v1:172.21.15.141:6789/0 conn(0x7f75e01605b0 legacy=0x7f75e006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75de7fc640 1 -- 172.21.15.114:0/3501303441 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e00cc4e0 con 0x7f75e006a830 2023-11-04T01:39:56.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75de7fc640 1 -- 172.21.15.114:0/3501303441 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f75d80019f0 con 0x7f75e006a830 2023-11-04T01:39:56.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75deffd640 1 --2- 172.21.15.114:0/3501303441 >> v2:172.21.15.141:3300/0 conn(0x7f75e00b1a40 0x7f75e00ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:56.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75de7fc640 1 -- 172.21.15.114:0/3501303441 >> v1:172.21.15.114:6789/0 conn(0x7f75e006a830 legacy=0x7f75e00cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75de7fc640 1 --2- 172.21.15.114:0/3501303441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c8003970 0x7f75c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75de7fc640 1 --2- 172.21.15.114:0/3501303441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75c80047c0 0x7f75c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75de7fc640 1 --2- 172.21.15.114:0/3501303441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c80052a0 0x7f75c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75de7fc640 1 -- 172.21.15.114:0/3501303441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00cd750 con 0x7f75c80052a0 2023-11-04T01:39:56.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75de7fc640 1 -- 172.21.15.114:0/3501303441 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c800c170 con 0x7f75c80047c0 2023-11-04T01:39:56.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75de7fc640 1 -- 172.21.15.114:0/3501303441 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c800c330 con 0x7f75c8003970 2023-11-04T01:39:56.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75dffff640 1 --2- 172.21.15.114:0/3501303441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c80052a0 0x7f75c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75df7fe640 1 --2- 172.21.15.114:0/3501303441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c8003970 0x7f75c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75deffd640 1 --2- 172.21.15.114:0/3501303441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75c80047c0 0x7f75c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75dffff640 1 -- 172.21.15.114:0/3501303441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c8003970 msgr2=0x7f75c8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:56.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75dffff640 1 --2- 172.21.15.114:0/3501303441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c8003970 0x7f75c8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75dffff640 1 -- 172.21.15.114:0/3501303441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75c80047c0 msgr2=0x7f75c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:56.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75dffff640 1 --2- 172.21.15.114:0/3501303441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75c80047c0 0x7f75c8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75dffff640 1 -- 172.21.15.114:0/3501303441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c8003520 con 0x7f75c80052a0 2023-11-04T01:39:56.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.632+0000 7f75deffd640 1 --2- 172.21.15.114:0/3501303441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75c80047c0 0x7f75c8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:56.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.633+0000 7f75dffff640 1 -- 172.21.15.114:0/3501303441 reap_dead start 2023-11-04T01:39:56.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.633+0000 7f75dffff640 1 --2- 172.21.15.114:0/3501303441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c80052a0 0x7f75c800b980 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f75d800a800 tx=0x7f75c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60916ae753bec712 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:56.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.633+0000 7f75de7fc640 1 -- 172.21.15.114:0/3501303441 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d80072d0 con 0x7f75c80052a0 2023-11-04T01:39:56.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.633+0000 7f75de7fc640 1 -- 172.21.15.114:0/3501303441 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d802f070 con 0x7f75c80052a0 2023-11-04T01:39:56.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.633+0000 7f75de7fc640 1 -- 172.21.15.114:0/3501303441 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d8007670 con 0x7f75c80052a0 2023-11-04T01:39:56.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.634+0000 7f75e5b89640 1 -- 172.21.15.114:0/3501303441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c80052a0 msgr2=0x7f75c800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.634+0000 7f75e5b89640 1 --2- 172.21.15.114:0/3501303441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c80052a0 0x7f75c800b980 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f75d800a800 tx=0x7f75c80057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.634+0000 7f75e5b89640 1 -- 172.21.15.114:0/3501303441 shutdown_connections 2023-11-04T01:39:56.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.634+0000 7f75e5b89640 1 --2- 172.21.15.114:0/3501303441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75c80052a0 0x7f75c800b980 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.634+0000 7f75e5b89640 1 -- 172.21.15.114:0/3501303441 >> 172.21.15.114:0/3501303441 conn(0x7f75e0071820 msgr2=0x7f75e0071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:56.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.634+0000 7f75e5b89640 1 -- 172.21.15.114:0/3501303441 shutdown_connections 2023-11-04T01:39:56.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.634+0000 7f75e5b89640 1 -- 172.21.15.114:0/3501303441 wait complete. 2023-11-04T01:39:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.635+0000 7f75e5b89640 1 Processor -- start 2023-11-04T01:39:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.635+0000 7f75e5b89640 1 -- start start 2023-11-04T01:39:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75e5b89640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c80052a0 0x7f75e015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75e5b89640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75e015bc00 0x7f75e00cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75e5b89640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e00cfd80 0x7f75e00b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75e5b89640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00d0230 con 0x7f75e00cfd80 2023-11-04T01:39:56.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75e5b89640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e01f2ac0 con 0x7f75e015bc00 2023-11-04T01:39:56.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75e5b89640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e01f2d20 con 0x7f75c80052a0 2023-11-04T01:39:56.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75dffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e00cfd80 0x7f75e00b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75dffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e00cfd80 0x7f75e00b3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53314/0 (socket says 172.21.15.114:53314) 2023-11-04T01:39:56.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75dffff640 1 -- 172.21.15.114:0/800082716 learned_addr learned my addr 172.21.15.114:0/800082716 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:56.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75deffd640 1 --2- 172.21.15.114:0/800082716 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75e015bc00 0x7f75e00cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75df7fe640 1 --2- 172.21.15.114:0/800082716 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c80052a0 0x7f75e015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75dffff640 1 -- 172.21.15.114:0/800082716 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c80052a0 msgr2=0x7f75e015b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75dffff640 1 --2- 172.21.15.114:0/800082716 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c80052a0 0x7f75e015b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75dffff640 1 -- 172.21.15.114:0/800082716 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75e015bc00 msgr2=0x7f75e00cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75dffff640 1 --2- 172.21.15.114:0/800082716 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75e015bc00 0x7f75e00cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75dffff640 1 -- 172.21.15.114:0/800082716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e01f3000 con 0x7f75e00cfd80 2023-11-04T01:39:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75df7fe640 1 --2- 172.21.15.114:0/800082716 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c80052a0 0x7f75e015b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75dffff640 1 --2- 172.21.15.114:0/800082716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e00cfd80 0x7f75e00b3a50 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f75d8000f80 tx=0x7f75d8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75c7fff640 1 -- 172.21.15.114:0/800082716 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d8004d60 con 0x7f75e00cfd80 2023-11-04T01:39:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75c7fff640 1 -- 172.21.15.114:0/800082716 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d802ce90 con 0x7f75e00cfd80 2023-11-04T01:39:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75e5b89640 1 -- 172.21.15.114:0/800082716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e01f32e0 con 0x7f75e00cfd80 2023-11-04T01:39:56.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75c7fff640 1 -- 172.21.15.114:0/800082716 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d8005230 con 0x7f75e00cfd80 2023-11-04T01:39:56.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.636+0000 7f75e5b89640 1 -- 172.21.15.114:0/800082716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e01f38a0 con 0x7f75e00cfd80 2023-11-04T01:39:56.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.638+0000 7f75c7fff640 1 -- 172.21.15.114:0/800082716 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f75d8031030 con 0x7f75e00cfd80 2023-11-04T01:39:56.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.638+0000 7f75c7fff640 1 --2- 172.21.15.114:0/800082716 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f75cc06ae70 0x7f75cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.638+0000 7f75df7fe640 1 --2- 172.21.15.114:0/800082716 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f75cc06ae70 0x7f75cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.638+0000 7f75c7fff640 1 -- 172.21.15.114:0/800082716 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f75d80abbb0 con 0x7f75e00cfd80 2023-11-04T01:39:56.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.639+0000 7f75df7fe640 1 --2- 172.21.15.114:0/800082716 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f75cc06ae70 0x7f75cc06d330 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f75d0000c00 tx=0x7f75d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:56.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.639+0000 7f75e87f8740 1 Processor -- start 2023-11-04T01:39:56.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.639+0000 7f75e87f8740 1 -- start start 2023-11-04T01:39:56.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.640+0000 7f75e87f8740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3d850 0x559ad7c10750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.640+0000 7f75e87f8740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c3dc30 0x559ad7c405e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.640+0000 7f75e87f8740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c10c90 0x559ad7c40b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.640+0000 7f75e87f8740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ad7b21740 con 0x559ad7c10c90 2023-11-04T01:39:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.640+0000 7f75e87f8740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ad7b838d0 con 0x559ad7c3d850 2023-11-04T01:39:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.640+0000 7f75e87f8740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ad7b80fc0 con 0x559ad7c3dc30 2023-11-04T01:39:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.640+0000 7f75dffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c10c90 0x559ad7c40b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.640+0000 7f75dffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c10c90 0x559ad7c40b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53320/0 (socket says 172.21.15.114:53320) 2023-11-04T01:39:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.640+0000 7f75dffff640 1 -- 172.21.15.114:0/3971277248 learned_addr learned my addr 172.21.15.114:0/3971277248 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.640+0000 7f75df7fe640 1 --2- 172.21.15.114:0/3971277248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3d850 0x559ad7c10750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.640+0000 7f75deffd640 1 --2- 172.21.15.114:0/3971277248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c3dc30 0x559ad7c405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.641+0000 7f75dffff640 1 -- 172.21.15.114:0/3971277248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c3dc30 msgr2=0x559ad7c405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.641+0000 7f75dffff640 1 --2- 172.21.15.114:0/3971277248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c3dc30 0x559ad7c405e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.641+0000 7f75dffff640 1 -- 172.21.15.114:0/3971277248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3d850 msgr2=0x559ad7c10750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.641+0000 7f75dffff640 1 --2- 172.21.15.114:0/3971277248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3d850 0x559ad7c10750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.641+0000 7f75dffff640 1 -- 172.21.15.114:0/3971277248 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ad7b3fca0 con 0x559ad7c10c90 2023-11-04T01:39:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.641+0000 7f75df7fe640 1 --2- 172.21.15.114:0/3971277248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3d850 0x559ad7c10750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.641+0000 7f75deffd640 1 --2- 172.21.15.114:0/3971277248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c3dc30 0x559ad7c405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.641+0000 7f75dffff640 1 --2- 172.21.15.114:0/3971277248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c10c90 0x559ad7c40b20 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f75d8076930 tx=0x7f75d8079e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ed8529cbcd65b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.641+0000 7f75c57fa640 1 -- 172.21.15.114:0/3971277248 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d807e580 con 0x559ad7c10c90 2023-11-04T01:39:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.641+0000 7f75c57fa640 1 -- 172.21.15.114:0/3971277248 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d8082730 con 0x559ad7c10c90 2023-11-04T01:39:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.641+0000 7f75c57fa640 1 -- 172.21.15.114:0/3971277248 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d800a450 con 0x559ad7c10c90 2023-11-04T01:39:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.641+0000 7f75e87f8740 1 -- 172.21.15.114:0/3971277248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c10c90 msgr2=0x559ad7c40b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.641+0000 7f75e87f8740 1 --2- 172.21.15.114:0/3971277248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c10c90 0x559ad7c40b20 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f75d8076930 tx=0x7f75d8079e50 comp rx=0 tx=0).stop 2023-11-04T01:39:56.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.642+0000 7f75e87f8740 1 -- 172.21.15.114:0/3971277248 shutdown_connections 2023-11-04T01:39:56.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.642+0000 7f75e87f8740 1 --2- 172.21.15.114:0/3971277248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c10c90 0x559ad7c40b20 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.642+0000 7f75e87f8740 1 --2- 172.21.15.114:0/3971277248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c3dc30 0x559ad7c405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.642+0000 7f75e87f8740 1 --2- 172.21.15.114:0/3971277248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3d850 0x559ad7c10750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.642+0000 7f75e87f8740 1 -- 172.21.15.114:0/3971277248 >> 172.21.15.114:0/3971277248 conn(0x559ad7c12a60 msgr2=0x559ad7c5b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:56.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.642+0000 7f75e87f8740 1 -- 172.21.15.114:0/3971277248 shutdown_connections 2023-11-04T01:39:56.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.642+0000 7f75e87f8740 1 -- 172.21.15.114:0/3971277248 wait complete. 2023-11-04T01:39:56.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.642+0000 7f75e87f8740 1 -- start start 2023-11-04T01:39:56.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.642+0000 7f75e87f8740 1 Processor -- start 2023-11-04T01:39:56.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75e87f8740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3d850 0x559ad7c2da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75e87f8740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c3dc30 0x559ad7c415d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75e87f8740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c390a0 0x559ad7c0f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75e87f8740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ad7b7c8b0 con 0x559ad7c3dc30 2023-11-04T01:39:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75e87f8740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ad7b36c80 con 0x559ad7c3d850 2023-11-04T01:39:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75e87f8740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ad7b36920 con 0x559ad7c390a0 2023-11-04T01:39:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75e87f8740 10 client.0 _ll_register_callbacks cb 0x559ad788eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75deffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c3dc30 0x559ad7c415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75deffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c3dc30 0x559ad7c415d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53330/0 (socket says 172.21.15.114:53330) 2023-11-04T01:39:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75deffd640 1 -- 172.21.15.114:0/2077073988 learned_addr learned my addr 172.21.15.114:0/2077073988 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75df7fe640 1 --2- 172.21.15.114:0/2077073988 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3d850 0x559ad7c2da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75dffff640 1 --2- 172.21.15.114:0/2077073988 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c390a0 0x559ad7c0f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75deffd640 1 -- 172.21.15.114:0/2077073988 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c390a0 msgr2=0x559ad7c0f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75deffd640 1 --2- 172.21.15.114:0/2077073988 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c390a0 0x559ad7c0f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75deffd640 1 -- 172.21.15.114:0/2077073988 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3d850 msgr2=0x559ad7c2da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75deffd640 1 --2- 172.21.15.114:0/2077073988 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3d850 0x559ad7c2da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75deffd640 1 -- 172.21.15.114:0/2077073988 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d804e070 con 0x559ad7c3dc30 2023-11-04T01:39:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75deffd640 1 --2- 172.21.15.114:0/2077073988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c3dc30 0x559ad7c415d0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f75d4016760 tx=0x7f75d4016b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640ace03728d0660 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.643+0000 7f75be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:39:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75be7fc640 1 -- 172.21.15.114:0/2077073988 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4004230 con 0x559ad7c3dc30 2023-11-04T01:39:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75be7fc640 1 -- 172.21.15.114:0/2077073988 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f75d4004390 con 0x559ad7c3dc30 2023-11-04T01:39:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75e87f8740 1 -- 172.21.15.114:0/2077073988 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ad7b28bf0 con 0x559ad7c3dc30 2023-11-04T01:39:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75be7fc640 1 -- 172.21.15.114:0/2077073988 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75d4014930 con 0x559ad7c3dc30 2023-11-04T01:39:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75e87f8740 10 client.7611 fetch_fsmap learned FSMap version 43 2023-11-04T01:39:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75e87f8740 1 -- 172.21.15.114:0/2077073988 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x559ad7b7af30 con 0x559ad7c3dc30 2023-11-04T01:39:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75be7fc640 1 -- 172.21.15.114:0/2077073988 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559ad7b28bf0 con 0x559ad7c3dc30 2023-11-04T01:39:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75be7fc640 1 -- 172.21.15.114:0/2077073988 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f75d4014a90 con 0x559ad7c3dc30 2023-11-04T01:39:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75e87f8740 10 client.7611 fetch_fsmap finished waiting for FSMap version 43 2023-11-04T01:39:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75e87f8740 10 client.7611 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:39:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75e87f8740 20 client.7611 populate_metadata read hostname 'smithi114' 2023-11-04T01:39:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75e87f8740 1 --2- 172.21.15.114:0/2077073988 >> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] conn(0x559ad7c39560 0x559ad7c39940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75e87f8740 4 client.7611 mds_command: new command op to 7431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:39:56.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75e87f8740 1 -- 172.21.15.114:0/2077073988 --> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ad7b75890 con 0x559ad7c39560 2023-11-04T01:39:56.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75df7fe640 1 --2- 172.21.15.114:0/2077073988 >> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] conn(0x559ad7c39560 0x559ad7c39940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75be7fc640 10 client.7611 ms_handle_connect on v2:172.21.15.114:6834/3780323525 2023-11-04T01:39:56.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.644+0000 7f75df7fe640 1 --2- 172.21.15.114:0/2077073988 >> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] conn(0x559ad7c39560 0x559ad7c39940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26dbccdbb55e351b server_cookie=d2623896935cc74b in_seq=0 out_seq=0 2023-11-04T01:39:56.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.645+0000 7f75be7fc640 1 -- 172.21.15.114:0/2077073988 <== mds.0 v2:172.21.15.114:6834/3780323525 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559ad7b75890 con 0x559ad7c39560 2023-11-04T01:39:56.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.645+0000 7f75be7fc640 10 client.7611 handle_command_reply: tid=0 2023-11-04T01:39:56.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.645+0000 7f75e87f8740 1 client.7611 shutdown 2023-11-04T01:39:56.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.645+0000 7f75e87f8740 1 -- 172.21.15.114:0/2077073988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c3dc30 msgr2=0x559ad7c415d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.645+0000 7f75e87f8740 1 --2- 172.21.15.114:0/2077073988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c3dc30 0x559ad7c415d0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f75d4016760 tx=0x7f75d4016b60 comp rx=0 tx=0).stop 2023-11-04T01:39:56.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.645+0000 7f75e87f8740 1 -- 172.21.15.114:0/2077073988 shutdown_connections 2023-11-04T01:39:56.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.645+0000 7f75e87f8740 1 --2- 172.21.15.114:0/2077073988 >> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] conn(0x559ad7c39560 0x559ad7c39940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.645+0000 7f75e87f8740 1 --2- 172.21.15.114:0/2077073988 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c390a0 0x559ad7c0f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.645+0000 7f75e87f8740 1 --2- 172.21.15.114:0/2077073988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c3dc30 0x559ad7c415d0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.645+0000 7f75e87f8740 1 --2- 172.21.15.114:0/2077073988 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3d850 0x559ad7c2da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.645+0000 7f75be7fc640 0 client.7611 ms_handle_reset on v2:172.21.15.114:6834/3780323525 2023-11-04T01:39:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.645+0000 7f75e87f8740 1 -- 172.21.15.114:0/2077073988 >> 172.21.15.114:0/2077073988 conn(0x559ad7c10c90 msgr2=0x559ad7c5f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.645+0000 7f75e87f8740 1 -- 172.21.15.114:0/2077073988 shutdown_connections 2023-11-04T01:39:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.645+0000 7f75e87f8740 1 -- 172.21.15.114:0/2077073988 wait complete. 2023-11-04T01:39:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.645+0000 7f75e87f8740 20 client.7611 trim_cache size 0 max 16384 2023-11-04T01:39:56.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.661+0000 7f75e87f8740 1 Processor -- start 2023-11-04T01:39:56.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.661+0000 7f75e87f8740 1 -- start start 2023-11-04T01:39:56.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.661+0000 7f75e87f8740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c390a0 0x559ad7c38490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75e87f8740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c3d850 0x559ad7c2cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75e87f8740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3dc30 0x559ad7c2d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75e87f8740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ad7afc280 con 0x559ad7c390a0 2023-11-04T01:39:56.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75e87f8740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ad7c42ea0 con 0x559ad7c3dc30 2023-11-04T01:39:56.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75e87f8740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ad7c0be50 con 0x559ad7c3d850 2023-11-04T01:39:56.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75df7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c390a0 0x559ad7c38490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75df7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c390a0 0x559ad7c38490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53340/0 (socket says 172.21.15.114:53340) 2023-11-04T01:39:56.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75df7fe640 1 -- 172.21.15.114:0/3417897936 learned_addr learned my addr 172.21.15.114:0/3417897936 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:56.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75deffd640 1 --2- 172.21.15.114:0/3417897936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c3d850 0x559ad7c2cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75dffff640 1 --2- 172.21.15.114:0/3417897936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3dc30 0x559ad7c2d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75df7fe640 1 -- 172.21.15.114:0/3417897936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c3d850 msgr2=0x559ad7c2cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:56.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75df7fe640 1 --2- 172.21.15.114:0/3417897936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c3d850 0x559ad7c2cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75df7fe640 1 -- 172.21.15.114:0/3417897936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3dc30 msgr2=0x559ad7c2d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:56.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75df7fe640 1 --2- 172.21.15.114:0/3417897936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3dc30 0x559ad7c2d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75df7fe640 1 -- 172.21.15.114:0/3417897936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ad7b18d10 con 0x559ad7c390a0 2023-11-04T01:39:56.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75df7fe640 1 --2- 172.21.15.114:0/3417897936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c390a0 0x559ad7c38490 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f75d0001900 tx=0x7f75d0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e8b92af609503d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:56.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75c5ffb640 1 -- 172.21.15.114:0/3417897936 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d00158f0 con 0x559ad7c390a0 2023-11-04T01:39:56.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75c5ffb640 1 -- 172.21.15.114:0/3417897936 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d002d070 con 0x559ad7c390a0 2023-11-04T01:39:56.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.662+0000 7f75c5ffb640 1 -- 172.21.15.114:0/3417897936 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d0015c50 con 0x559ad7c390a0 2023-11-04T01:39:56.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.663+0000 7f75e87f8740 1 -- 172.21.15.114:0/3417897936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c390a0 msgr2=0x559ad7c38490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.663+0000 7f75e87f8740 1 --2- 172.21.15.114:0/3417897936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c390a0 0x559ad7c38490 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f75d0001900 tx=0x7f75d0014000 comp rx=0 tx=0).stop 2023-11-04T01:39:56.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.663+0000 7f75e87f8740 1 -- 172.21.15.114:0/3417897936 shutdown_connections 2023-11-04T01:39:56.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.663+0000 7f75e87f8740 1 --2- 172.21.15.114:0/3417897936 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3dc30 0x559ad7c2d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.663+0000 7f75e87f8740 1 --2- 172.21.15.114:0/3417897936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c3d850 0x559ad7c2cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.663+0000 7f75e87f8740 1 --2- 172.21.15.114:0/3417897936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c390a0 0x559ad7c38490 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.663+0000 7f75e87f8740 1 -- 172.21.15.114:0/3417897936 >> 172.21.15.114:0/3417897936 conn(0x559ad7c10c90 msgr2=0x559ad7c431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:56.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.663+0000 7f75e87f8740 1 -- 172.21.15.114:0/3417897936 shutdown_connections 2023-11-04T01:39:56.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.663+0000 7f75e87f8740 1 -- 172.21.15.114:0/3417897936 wait complete. 2023-11-04T01:39:56.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.663+0000 7f75e87f8740 1 -- start start 2023-11-04T01:39:56.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.664+0000 7f75e87f8740 1 Processor -- start 2023-11-04T01:39:56.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.664+0000 7f75e87f8740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c390a0 0x559ad7c69cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.664+0000 7f75e87f8740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3d850 0x559ad7c6a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.664+0000 7f75e87f8740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c3dc30 0x559ad7c74570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.664+0000 7f75e87f8740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ad7c74150 con 0x559ad7c3dc30 2023-11-04T01:39:56.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.664+0000 7f75e87f8740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ad7c2be20 con 0x559ad7c3d850 2023-11-04T01:39:56.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.664+0000 7f75e87f8740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ad7cc5950 con 0x559ad7c390a0 2023-11-04T01:39:56.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.664+0000 7f75e87f8740 10 client.0 _ll_register_callbacks cb 0x7f75d8004ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:39:56.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.664+0000 7f75dffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c3dc30 0x559ad7c74570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.664+0000 7f75dffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c3dc30 0x559ad7c74570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53356/0 (socket says 172.21.15.114:53356) 2023-11-04T01:39:56.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.664+0000 7f75dffff640 1 -- 172.21.15.114:0/1278180902 learned_addr learned my addr 172.21.15.114:0/1278180902 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:56.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.664+0000 7f75df7fe640 1 --2- 172.21.15.114:0/1278180902 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c390a0 0x559ad7c69cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.664+0000 7f75deffd640 1 --2- 172.21.15.114:0/1278180902 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3d850 0x559ad7c6a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75dffff640 1 -- 172.21.15.114:0/1278180902 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c390a0 msgr2=0x559ad7c69cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:56.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75dffff640 1 --2- 172.21.15.114:0/1278180902 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c390a0 0x559ad7c69cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75dffff640 1 -- 172.21.15.114:0/1278180902 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3d850 msgr2=0x559ad7c6a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:56.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75dffff640 1 --2- 172.21.15.114:0/1278180902 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3d850 0x559ad7c6a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75dffff640 1 -- 172.21.15.114:0/1278180902 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e00cc7c0 con 0x559ad7c3dc30 2023-11-04T01:39:56.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75dffff640 1 --2- 172.21.15.114:0/1278180902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c3dc30 0x559ad7c74570 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f75d8076930 tx=0x7f75d80021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ca5c1641a1f45d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:56.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:39:56.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75be7fc640 1 -- 172.21.15.114:0/1278180902 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d802cd30 con 0x559ad7c3dc30 2023-11-04T01:39:56.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75be7fc640 1 -- 172.21.15.114:0/1278180902 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f75d807e580 con 0x559ad7c3dc30 2023-11-04T01:39:56.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75e87f8740 1 -- 172.21.15.114:0/1278180902 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f75d8082730 con 0x559ad7c3dc30 2023-11-04T01:39:56.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75be7fc640 1 -- 172.21.15.114:0/1278180902 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75d80787d0 con 0x559ad7c3dc30 2023-11-04T01:39:56.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75e87f8740 10 client.7617 fetch_fsmap learned FSMap version 43 2023-11-04T01:39:56.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75e87f8740 1 -- 172.21.15.114:0/1278180902 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x559ad7b3e500 con 0x559ad7c3dc30 2023-11-04T01:39:56.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75be7fc640 1 -- 172.21.15.114:0/1278180902 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d8082730 con 0x559ad7c3dc30 2023-11-04T01:39:56.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75be7fc640 1 -- 172.21.15.114:0/1278180902 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f75d8076b40 con 0x559ad7c3dc30 2023-11-04T01:39:56.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75e87f8740 10 client.7617 fetch_fsmap finished waiting for FSMap version 43 2023-11-04T01:39:56.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75e87f8740 10 client.7617 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:39:56.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75e87f8740 20 client.7617 populate_metadata read hostname 'smithi114' 2023-11-04T01:39:56.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75e87f8740 1 --2- 172.21.15.114:0/1278180902 >> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] conn(0x559ad7c74ab0 0x559ad7c74e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75e87f8740 4 client.7617 mds_command: new command op to 7431 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:39:56.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75e87f8740 1 -- 172.21.15.114:0/1278180902 --> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559ad7b755b0 con 0x559ad7c74ab0 2023-11-04T01:39:56.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.665+0000 7f75df7fe640 1 --2- 172.21.15.114:0/1278180902 >> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] conn(0x559ad7c74ab0 0x559ad7c74e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75be7fc640 10 client.7617 ms_handle_connect on v2:172.21.15.114:6834/3780323525 2023-11-04T01:39:56.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75df7fe640 1 --2- 172.21.15.114:0/1278180902 >> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] conn(0x559ad7c74ab0 0x559ad7c74e90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76a966c1fc8ebc0a server_cookie=20314cc10887971c in_seq=0 out_seq=0 2023-11-04T01:39:56.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75be7fc640 1 -- 172.21.15.114:0/1278180902 <== mds.0 v2:172.21.15.114:6834/3780323525 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x559ad7b755b0 con 0x559ad7c74ab0 2023-11-04T01:39:56.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75be7fc640 10 client.7617 handle_command_reply: tid=0 2023-11-04T01:39:56.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75e87f8740 1 client.7617 shutdown 2023-11-04T01:39:56.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75e87f8740 1 -- 172.21.15.114:0/1278180902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c3dc30 msgr2=0x559ad7c74570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75e87f8740 1 --2- 172.21.15.114:0/1278180902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c3dc30 0x559ad7c74570 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f75d8076930 tx=0x7f75d80021f0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75e87f8740 1 -- 172.21.15.114:0/1278180902 shutdown_connections 2023-11-04T01:39:56.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75e87f8740 1 --2- 172.21.15.114:0/1278180902 >> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] conn(0x559ad7c74ab0 0x559ad7c74e90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75e87f8740 1 --2- 172.21.15.114:0/1278180902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ad7c3dc30 0x559ad7c74570 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75be7fc640 0 client.7617 ms_handle_reset on v2:172.21.15.114:6834/3780323525 2023-11-04T01:39:56.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75e87f8740 1 --2- 172.21.15.114:0/1278180902 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559ad7c3d850 0x559ad7c6a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75e87f8740 1 --2- 172.21.15.114:0/1278180902 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559ad7c390a0 0x559ad7c69cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75e87f8740 1 -- 172.21.15.114:0/1278180902 >> 172.21.15.114:0/1278180902 conn(0x559ad7c10c90 msgr2=0x559ad7c40820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:56.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75e87f8740 1 -- 172.21.15.114:0/1278180902 shutdown_connections 2023-11-04T01:39:56.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75e87f8740 1 -- 172.21.15.114:0/1278180902 wait complete. 2023-11-04T01:39:56.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.666+0000 7f75e87f8740 20 client.7617 trim_cache size 0 max 16384 2023-11-04T01:39:56.679 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:39:56.679 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:39:56.679 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-11-04T01:39:56.679 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 7431, 2023-11-04T01:39:56.679 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:39:56.679 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:39:56.679 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:39:56.679 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 4.5652188100000002, 2023-11-04T01:39:56.679 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 43, 2023-11-04T01:39:56.679 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 96, 2023-11-04T01:39:56.680 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 96, 2023-11-04T01:39:56.680 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 10.673809475000001 2023-11-04T01:39:56.680 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:39:56.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.667+0000 7f75e5b89640 1 -- 172.21.15.114:0/800082716 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f75cc06ae70 msgr2=0x7f75cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.667+0000 7f75e5b89640 1 --2- 172.21.15.114:0/800082716 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f75cc06ae70 0x7f75cc06d330 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f75d0000c00 tx=0x7f75d0009040 comp rx=0 tx=0).stop 2023-11-04T01:39:56.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.667+0000 7f75e5b89640 1 -- 172.21.15.114:0/800082716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e00cfd80 msgr2=0x7f75e00b3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.667+0000 7f75e5b89640 1 --2- 172.21.15.114:0/800082716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e00cfd80 0x7f75e00b3a50 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f75d8000f80 tx=0x7f75d8001d80 comp rx=0 tx=0).stop 2023-11-04T01:39:56.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.667+0000 7f75e5b89640 1 -- 172.21.15.114:0/800082716 shutdown_connections 2023-11-04T01:39:56.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.667+0000 7f75e5b89640 1 --2- 172.21.15.114:0/800082716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e00cfd80 0x7f75e00b3a50 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.667+0000 7f75e5b89640 1 --2- 172.21.15.114:0/800082716 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f75cc06ae70 0x7f75cc06d330 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.667+0000 7f75e5b89640 1 --2- 172.21.15.114:0/800082716 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f75e015bc00 0x7f75e00cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.667+0000 7f75e5b89640 1 --2- 172.21.15.114:0/800082716 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f75c80052a0 0x7f75e015b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.667+0000 7f75e5b89640 1 -- 172.21.15.114:0/800082716 >> 172.21.15.114:0/800082716 conn(0x7f75e0071820 msgr2=0x7f75e00c5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:56.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.667+0000 7f75e5b89640 1 -- 172.21.15.114:0/800082716 shutdown_connections 2023-11-04T01:39:56.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.667+0000 7f75e5b89640 1 -- 172.21.15.114:0/800082716 wait complete. 2023-11-04T01:39:56.683 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:39:56.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.779+0000 7fca5ca1a640 1 Processor -- start 2023-11-04T01:39:56.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.779+0000 7fca5ca1a640 1 -- start start 2023-11-04T01:39:56.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.780+0000 7fca5ca1a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fca58159c70 0x7fca580ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.780+0000 7fca5ca1a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca5806db20 0x7fca580b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.780+0000 7fca5ca1a640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca580b4110 con 0x7fca580b0910 2023-11-04T01:39:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.780+0000 7fca5ca1a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca580b49b0 con 0x7fca5806db20 2023-11-04T01:39:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.780+0000 7fca5ca1a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca580b0da0 con 0x7fca58159c70 2023-11-04T01:39:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.780+0000 7fca4ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca5806db20 0x7fca580b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.780+0000 7fca4ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca5806db20 0x7fca580b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53364/0 (socket says 172.21.15.114:53364) 2023-11-04T01:39:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.780+0000 7fca4ffff640 1 -- 172.21.15.114:0/2887635682 learned_addr learned my addr 172.21.15.114:0/2887635682 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.781+0000 7fca5659c640 1 --2- 172.21.15.114:0/2887635682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fca58159c70 0x7fca580ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.781+0000 7fca4ffff640 1 -- 172.21.15.114:0/2887635682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fca58159c70 msgr2=0x7fca580ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.781+0000 7fca4ffff640 1 --2- 172.21.15.114:0/2887635682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fca58159c70 0x7fca580ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.781+0000 7fca4ffff640 1 -- 172.21.15.114:0/2887635682 >> v1:172.21.15.141:6789/0 conn(0x7fca580b0910 legacy=0x7fca5815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.781+0000 7fca4ffff640 1 -- 172.21.15.114:0/2887635682 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca580b43f0 con 0x7fca5806db20 2023-11-04T01:39:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.781+0000 7fca4ffff640 1 --2- 172.21.15.114:0/2887635682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5806db20 0x7fca580b03d0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fca4000bb10 tx=0x7fca4002e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cb231b77b1477b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.781+0000 7fca55d9b640 1 -- 172.21.15.114:0/2887635682 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4002ee70 con 0x7fca5806db20 2023-11-04T01:39:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.781+0000 7fca55d9b640 1 -- 172.21.15.114:0/2887635682 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca40036440 con 0x7fca5806db20 2023-11-04T01:39:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.781+0000 7fca55d9b640 1 -- 172.21.15.114:0/2887635682 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca400367d0 con 0x7fca5806db20 2023-11-04T01:39:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.782+0000 7fca5ca1a640 1 -- 172.21.15.114:0/2887635682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5806db20 msgr2=0x7fca580b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.782+0000 7fca5ca1a640 1 --2- 172.21.15.114:0/2887635682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5806db20 0x7fca580b03d0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fca4000bb10 tx=0x7fca4002e0c0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.782+0000 7fca5ca1a640 1 -- 172.21.15.114:0/2887635682 shutdown_connections 2023-11-04T01:39:56.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.782+0000 7fca5ca1a640 1 --2- 172.21.15.114:0/2887635682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5806db20 0x7fca580b03d0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.782+0000 7fca5ca1a640 1 --2- 172.21.15.114:0/2887635682 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fca58159c70 0x7fca580ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.782+0000 7fca5ca1a640 1 -- 172.21.15.114:0/2887635682 >> 172.21.15.114:0/2887635682 conn(0x7fca580ce950 msgr2=0x7fca580ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:56.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.782+0000 7fca5ca1a640 1 -- 172.21.15.114:0/2887635682 shutdown_connections 2023-11-04T01:39:56.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.782+0000 7fca5ca1a640 1 -- 172.21.15.114:0/2887635682 wait complete. 2023-11-04T01:39:56.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.783+0000 7fca5ca1a640 1 Processor -- start 2023-11-04T01:39:56.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.783+0000 7fca5ca1a640 1 -- start start 2023-11-04T01:39:56.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.784+0000 7fca5ca1a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5806db20 0x7fca581517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.784+0000 7fca5ca1a640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca580b0910 0x7fca580c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.784+0000 7fca5ca1a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fca58159c70 0x7fca580afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.784+0000 7fca5ca1a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca58151ce0 con 0x7fca5806db20 2023-11-04T01:39:56.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.784+0000 7fca5ca1a640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca580ae850 con 0x7fca580b0910 2023-11-04T01:39:56.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.784+0000 7fca5ca1a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca58153cb0 con 0x7fca58159c70 2023-11-04T01:39:56.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.784+0000 7fca5659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5806db20 0x7fca581517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.784+0000 7fca5659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5806db20 0x7fca581517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53376/0 (socket says 172.21.15.114:53376) 2023-11-04T01:39:56.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.784+0000 7fca5659c640 1 -- 172.21.15.114:0/3463179341 learned_addr learned my addr 172.21.15.114:0/3463179341 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:56.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.784+0000 7fca4ffff640 1 --2- 172.21.15.114:0/3463179341 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca580b0910 0x7fca580c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.784+0000 7fca56d9d640 1 --2- 172.21.15.114:0/3463179341 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fca58159c70 0x7fca580afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.784+0000 7fca5659c640 1 -- 172.21.15.114:0/3463179341 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fca58159c70 msgr2=0x7fca580afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.784+0000 7fca5659c640 1 --2- 172.21.15.114:0/3463179341 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fca58159c70 0x7fca580afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.784+0000 7fca5659c640 1 -- 172.21.15.114:0/3463179341 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca580b0910 msgr2=0x7fca580c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.784+0000 7fca5659c640 1 --2- 172.21.15.114:0/3463179341 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca580b0910 0x7fca580c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.785+0000 7fca5659c640 1 -- 172.21.15.114:0/3463179341 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4000b770 con 0x7fca5806db20 2023-11-04T01:39:56.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.785+0000 7fca5659c640 1 --2- 172.21.15.114:0/3463179341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5806db20 0x7fca581517a0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fca4800c820 tx=0x7fca4800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:56.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.785+0000 7fca4effd640 1 -- 172.21.15.114:0/3463179341 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca48004220 con 0x7fca5806db20 2023-11-04T01:39:56.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.785+0000 7fca4effd640 1 -- 172.21.15.114:0/3463179341 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca480043a0 con 0x7fca5806db20 2023-11-04T01:39:56.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.785+0000 7fca5ca1a640 1 -- 172.21.15.114:0/3463179341 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca58153f90 con 0x7fca5806db20 2023-11-04T01:39:56.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.785+0000 7fca4effd640 1 -- 172.21.15.114:0/3463179341 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca48007a70 con 0x7fca5806db20 2023-11-04T01:39:56.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.785+0000 7fca5ca1a640 1 -- 172.21.15.114:0/3463179341 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca581525b0 con 0x7fca5806db20 2023-11-04T01:39:56.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.786+0000 7fca5ca1a640 1 -- 172.21.15.114:0/3463179341 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca58074290 con 0x7fca5806db20 2023-11-04T01:39:56.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.786+0000 7fca4effd640 1 -- 172.21.15.114:0/3463179341 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca48007bd0 con 0x7fca5806db20 2023-11-04T01:39:56.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.787+0000 7fca4effd640 1 --2- 172.21.15.114:0/3463179341 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fca3806ae70 0x7fca3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.787+0000 7fca4ffff640 1 --2- 172.21.15.114:0/3463179341 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fca3806ae70 0x7fca3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.787+0000 7fca4effd640 1 -- 172.21.15.114:0/3463179341 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fca480897d0 con 0x7fca5806db20 2023-11-04T01:39:56.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.787+0000 7fca4ffff640 1 --2- 172.21.15.114:0/3463179341 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fca3806ae70 0x7fca3806d330 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fca40038000 tx=0x7fca40032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:56.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.791+0000 7fca4effd640 1 -- 172.21.15.114:0/3463179341 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fca48054440 con 0x7fca5806db20 2023-11-04T01:39:56.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.995+0000 7fca5ca1a640 1 -- 172.21.15.114:0/3463179341 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fca58071160 con 0x7fca5806db20 2023-11-04T01:39:56.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.995+0000 7fca4effd640 1 -- 172.21.15.114:0/3463179341 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7fca4801e060 con 0x7fca5806db20 2023-11-04T01:39:56.997 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:39:56.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.997+0000 7fca5ca1a640 1 -- 172.21.15.114:0/3463179341 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fca3806ae70 msgr2=0x7fca3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.997+0000 7fca5ca1a640 1 --2- 172.21.15.114:0/3463179341 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fca3806ae70 0x7fca3806d330 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fca40038000 tx=0x7fca40032000 comp rx=0 tx=0).stop 2023-11-04T01:39:56.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.997+0000 7fca5ca1a640 1 -- 172.21.15.114:0/3463179341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5806db20 msgr2=0x7fca581517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.997+0000 7fca5ca1a640 1 --2- 172.21.15.114:0/3463179341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5806db20 0x7fca581517a0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fca4800c820 tx=0x7fca4800cce0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.997+0000 7fca5ca1a640 1 -- 172.21.15.114:0/3463179341 shutdown_connections 2023-11-04T01:39:56.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.997+0000 7fca5ca1a640 1 --2- 172.21.15.114:0/3463179341 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fca58159c70 0x7fca580afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.997+0000 7fca5ca1a640 1 --2- 172.21.15.114:0/3463179341 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fca3806ae70 0x7fca3806d330 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.997+0000 7fca5ca1a640 1 --2- 172.21.15.114:0/3463179341 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fca580b0910 0x7fca580c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.997+0000 7fca5ca1a640 1 --2- 172.21.15.114:0/3463179341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca5806db20 0x7fca581517a0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.997+0000 7fca5ca1a640 1 -- 172.21.15.114:0/3463179341 >> 172.21.15.114:0/3463179341 conn(0x7fca580ce950 msgr2=0x7fca580b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:56.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.997+0000 7fca5ca1a640 1 -- 172.21.15.114:0/3463179341 shutdown_connections 2023-11-04T01:39:57.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:56.997+0000 7fca5ca1a640 1 -- 172.21.15.114:0/3463179341 wait complete. 2023-11-04T01:39:57.009 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:39:57.009 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:39:57.009 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-11-04T01:39:57.009 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:39:57.009 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:57.009 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:39:57.009 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:39:57.009 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:39:57.009 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:39:57.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:57.010 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-11-04T01:39:57.018 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:39:57.017+0000 7feb1a720640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:39:57.024 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:39:57.024 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:39:57.025 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:39:57.025 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:57.025 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-04T01:39:57.025 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:57.025 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:39:57.025 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:57.025 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-11-04T01:39:57.025 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:39:57.025 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:57.025 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-11-04T01:39:57.025 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:39:57.026 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:57.026 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:39:57.026 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:57.026 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:39:57.026 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42279sec preferred_lft 42279sec 2023-11-04T01:39:57.026 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-11-04T01:39:57.026 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:57.026 INFO:teuthology.orchestra.run.smithi114.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:39:57.026 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 7e:72:41:ca:70:95 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:39:57.026 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:39:57.026 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:57.026 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9c8d:d6ff:fe6f:d555/64 scope link 2023-11-04T01:39:57.027 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:57.027 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:39:57.027 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether f6:4c:1e:67:08:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:57.027 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::f44c:1eff:fe67:85a/64 scope link 2023-11-04T01:39:57.027 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:57.027 INFO:teuthology.orchestra.run.smithi114.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:39:57.027 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 7e:72:41:ca:70:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:57.027 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::7c72:41ff:feca:7095/64 scope link 2023-11-04T01:39:57.027 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:39:57.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:57.027 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:39:57.090 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-11-04T01:39:57.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:57.092 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-11-04T01:39:57.148 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-11-04T01:39:57.148 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:39:57.148 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:39:57.148 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:39:57.148 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:39:57.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:57.149 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:39:57.149 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:39:57.149 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:39:57.149 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:39:57.149 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:39:57.149 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:39:57.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:57.244 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-04T01:39:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:39:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:39:57.259 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:39:57.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:57.259 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-11-04T01:39:57.325 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:39:57.325 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:39:57.325 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:57.380 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:39:57.381 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:39:57.381 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:57.435 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:39:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:39:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:39:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:39:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:39:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:39:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:39:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:39:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:39:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:39:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:39:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:39:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:39:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:39:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:39:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:39:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:39:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:39:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:39:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:39:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:39:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:39:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:39:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:39:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:39:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:39:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:39:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:39:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:39:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:39:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:39:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:57.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:57.494 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:39:57.546 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:39:57.546 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:39:57.589 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:39:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:39:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:39:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:39:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:39:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:39:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:39:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:39:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:39:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:39:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:39:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:39:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:39:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:39:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:39:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:39:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:39:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:39:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:39:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:39:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:39:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:39:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:39:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:39:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:39:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:39:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:39:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:39:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:39:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:39:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:39:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:57.607 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:57.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:57.607 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:39:57.678 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:39:57.675+0000 7f3bdce1b480 -1 init, newargv = 0x5649b94f39c0 newargc=15 2023-11-04T01:39:57.678 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[118081]: starting ceph client 2023-11-04T01:39:57.682 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[118081]: starting fuse 2023-11-04T01:39:58.761 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:39:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:39:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:39:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:39:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:39:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:39:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:39:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:39:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:39:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:39:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:39:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:39:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:39:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:39:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:39:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:39:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:39:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:39:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:39:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:39:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:39:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:39:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:39:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:39:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:39:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:39:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:39:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:39:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:39:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:39:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:39:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:39:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:39:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:58.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:39:58.783 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:39:58.841 INFO:teuthology.orchestra.run.smithi114.stdout:41 2023-11-04T01:39:58.841 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:39:58.842 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:39:58.842 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2023-11-04T01:39:58.842 DEBUG:teuthology.orchestra.run.smithi114:> import re 2023-11-04T01:39:58.842 DEBUG:teuthology.orchestra.run.smithi114:> import os 2023-11-04T01:39:58.842 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2023-11-04T01:39:58.842 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:39:58.842 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2023-11-04T01:39:58.842 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:39:58.842 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2023-11-04T01:39:58.842 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:39:58.842 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:39:58.842 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2023-11-04T01:39:58.843 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2023-11-04T01:39:58.843 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2023-11-04T01:39:58.843 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2023-11-04T01:39:58.843 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:39:58.843 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2023-11-04T01:39:58.843 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:39:58.843 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:39:58.843 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:39:58.843 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2023-11-04T01:39:58.843 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2023-11-04T01:39:58.843 DEBUG:teuthology.orchestra.run.smithi114:> return f 2023-11-04T01:39:58.843 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:39:58.843 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:39:58.843 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.0")) 2023-11-04T01:39:58.844 DEBUG:teuthology.orchestra.run.smithi114:> ' 2023-11-04T01:39:58.967 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.0.118081.asok 2023-11-04T01:39:58.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:58.978 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.118081.asok 2023-11-04T01:39:58.978 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:58.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.118081.asok status 2023-11-04T01:39:59.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:59.147 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:39:59.147 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2023-11-04T01:39:59.147 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:39:59.148 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:39:59.148 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "0", 2023-11-04T01:39:59.148 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2023-11-04T01:39:59.148 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:39:59.148 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "118081", 2023-11-04T01:39:59.148 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2023-11-04T01:39:59.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:59.148 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2023-11-04T01:39:59.148 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2023-11-04T01:39:59.148 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 7629, 2023-11-04T01:39:59.148 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2023-11-04T01:39:59.148 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2023-11-04T01:39:59.148 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2023-11-04T01:39:59.149 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 7629 2023-11-04T01:39:59.149 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:59.149 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:39:59.149 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:39:59.149 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:39:59.149 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 958873281 2023-11-04T01:39:59.149 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:39:59.149 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:59.149 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:39:59.149 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:39:59.149 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:39:59.149 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 958873281 2023-11-04T01:39:59.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:39:59.150 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.7629 192.168.0.1:0/958873281", 2023-11-04T01:39:59.150 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "192.168.0.1:0/958873281", 2023-11-04T01:39:59.150 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2023-11-04T01:39:59.150 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 43, 2023-11-04T01:39:59.150 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 96, 2023-11-04T01:39:59.150 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:39:59.150 INFO:teuthology.orchestra.run.smithi114.stdout: "blocklisted": false, 2023-11-04T01:39:59.150 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2023-11-04T01:39:59.150 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:39:59.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:59.161 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:59.161 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:39:59.161 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:59.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:59.220 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2023-11-04T01:39:59.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:59.226 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:59.226 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:39:59.226 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:39:59.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:39:59.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:39:59.292 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_max_snaps_per_dir 2023-11-04T01:39:59.405 INFO:teuthology.orchestra.run.smithi114.stdout:{"mds_max_snaps_per_dir":"100"} 2023-11-04T01:39:59.405 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_snaps_per_dir": "100" } 2023-11-04T01:39:59.406 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-11-04T01:39:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.507+0000 7fd421d90640 1 Processor -- start 2023-11-04T01:39:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.507+0000 7fd421d90640 1 -- start start 2023-11-04T01:39:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.508+0000 7fd421d90640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd41c0cd9f0 0x7fd41c0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.508+0000 7fd421d90640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41c0d1320 con 0x7fd41c15d4b0 2023-11-04T01:39:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.508+0000 7fd421d90640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41c0b5600 con 0x7fd41c0d27c0 2023-11-04T01:39:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.508+0000 7fd421d90640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c15e4d0 con 0x7fd41c0cd9f0 2023-11-04T01:39:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.508+0000 7fd412ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd41c15d4b0 0x7fd41c0b47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33316/0 (socket says 172.21.15.114:33316) 2023-11-04T01:39:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.508+0000 7fd412ffd640 1 -- 172.21.15.114:0/343368036 learned_addr learned my addr 172.21.15.114:0/343368036 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41affd640 1 -- 172.21.15.114:0/343368036 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991925771 0 0) 0x7fd41c0d1320 con 0x7fd41c15d4b0 2023-11-04T01:39:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41b7fe640 1 --2- 172.21.15.114:0/343368036 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd41c0cd9f0 0x7fd41c0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41affd640 1 -- 172.21.15.114:0/343368036 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd408003520 con 0x7fd41c15d4b0 2023-11-04T01:39:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41affd640 1 -- 172.21.15.114:0/343368036 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 969953578 0 0) 0x7fd408003520 con 0x7fd41c15d4b0 2023-11-04T01:39:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41affd640 1 -- 172.21.15.114:0/343368036 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd41c0cd9f0 msgr2=0x7fd41c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41affd640 1 --2- 172.21.15.114:0/343368036 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd41c0cd9f0 0x7fd41c0cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41affd640 1 -- 172.21.15.114:0/343368036 >> v1:172.21.15.141:6789/0 conn(0x7fd41c0d27c0 legacy=0x7fd41c0b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41affd640 1 -- 172.21.15.114:0/343368036 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c0ce310 con 0x7fd41c15d4b0 2023-11-04T01:39:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41affd640 1 -- 172.21.15.114:0/343368036 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fd404001670 con 0x7fd41c15d4b0 2023-11-04T01:39:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41affd640 1 -- 172.21.15.114:0/343368036 >> v1:172.21.15.114:6789/0 conn(0x7fd41c15d4b0 legacy=0x7fd41c0b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41affd640 1 --2- 172.21.15.114:0/343368036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080039a0 0x7fd408003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41affd640 1 --2- 172.21.15.114:0/343368036 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4080047c0 0x7fd408004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41affd640 1 --2- 172.21.15.114:0/343368036 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd41c0cd9f0 0x7fd408005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41affd640 1 -- 172.21.15.114:0/343368036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c15e4d0 con 0x7fd4080039a0 2023-11-04T01:39:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41affd640 1 -- 172.21.15.114:0/343368036 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40800bac0 con 0x7fd4080047c0 2023-11-04T01:39:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41affd640 1 -- 172.21.15.114:0/343368036 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40800bc80 con 0x7fd41c0cd9f0 2023-11-04T01:39:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41b7fe640 1 --2- 172.21.15.114:0/343368036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080039a0 0x7fd408003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd412ffd640 1 --2- 172.21.15.114:0/343368036 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4080047c0 0x7fd408004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41bfff640 1 --2- 172.21.15.114:0/343368036 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd41c0cd9f0 0x7fd408005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41b7fe640 1 -- 172.21.15.114:0/343368036 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd41c0cd9f0 msgr2=0x7fd408005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41b7fe640 1 --2- 172.21.15.114:0/343368036 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd41c0cd9f0 0x7fd408005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41b7fe640 1 -- 172.21.15.114:0/343368036 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4080047c0 msgr2=0x7fd408004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41b7fe640 1 --2- 172.21.15.114:0/343368036 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4080047c0 0x7fd408004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41b7fe640 1 -- 172.21.15.114:0/343368036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd408003520 con 0x7fd4080039a0 2023-11-04T01:39:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd412ffd640 1 --2- 172.21.15.114:0/343368036 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4080047c0 0x7fd408004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.509+0000 7fd41bfff640 1 --2- 172.21.15.114:0/343368036 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd41c0cd9f0 0x7fd408005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.510+0000 7fd41b7fe640 1 --2- 172.21.15.114:0/343368036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080039a0 0x7fd408003dc0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009a90 tx=0x7fd4080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfaed30bde963fd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.510+0000 7fd41affd640 1 -- 172.21.15.114:0/343368036 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c02c680 con 0x7fd4080039a0 2023-11-04T01:39:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.510+0000 7fd41affd640 1 -- 172.21.15.114:0/343368036 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c02c7e0 con 0x7fd4080039a0 2023-11-04T01:39:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.510+0000 7fd41affd640 1 -- 172.21.15.114:0/343368036 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c02cb70 con 0x7fd4080039a0 2023-11-04T01:39:59.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.511+0000 7fd421d90640 1 -- 172.21.15.114:0/343368036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080039a0 msgr2=0x7fd408003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.511+0000 7fd421d90640 1 --2- 172.21.15.114:0/343368036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080039a0 0x7fd408003dc0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009a90 tx=0x7fd4080057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.511+0000 7fd41bfff640 1 -- 172.21.15.114:0/343368036 reap_dead start 2023-11-04T01:39:59.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.511+0000 7fd421d90640 1 -- 172.21.15.114:0/343368036 shutdown_connections 2023-11-04T01:39:59.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.511+0000 7fd421d90640 1 -- 172.21.15.114:0/343368036 >> 172.21.15.114:0/343368036 conn(0x7fd41c071c40 msgr2=0x7fd41c072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:59.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.511+0000 7fd421d90640 1 -- 172.21.15.114:0/343368036 shutdown_connections 2023-11-04T01:39:59.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.511+0000 7fd421d90640 1 -- 172.21.15.114:0/343368036 wait complete. 2023-11-04T01:39:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.512+0000 7fd421d90640 1 Processor -- start 2023-11-04T01:39:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.512+0000 7fd421d90640 1 -- start start 2023-11-04T01:39:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd421d90640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080039a0 0x7fd41c159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd421d90640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd41c0b2010 0x7fd41c1f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd421d90640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd41c0ca5d0 0x7fd41c0cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd421d90640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c0c9e40 con 0x7fd4080039a0 2023-11-04T01:39:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd421d90640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c1f2f00 con 0x7fd41c0ca5d0 2023-11-04T01:39:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd421d90640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c1f31e0 con 0x7fd41c0b2010 2023-11-04T01:39:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd41b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080039a0 0x7fd41c159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd41b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080039a0 0x7fd41c159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53406/0 (socket says 172.21.15.114:53406) 2023-11-04T01:39:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd41b7fe640 1 -- 172.21.15.114:0/1396694558 learned_addr learned my addr 172.21.15.114:0/1396694558 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd41b7fe640 1 -- 172.21.15.114:0/1396694558 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd41c0b2010 msgr2=0x7fd41c1f2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd41b7fe640 1 --2- 172.21.15.114:0/1396694558 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd41c0b2010 0x7fd41c1f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd41b7fe640 1 -- 172.21.15.114:0/1396694558 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd41c0ca5d0 msgr2=0x7fd41c0cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd41b7fe640 1 --2- 172.21.15.114:0/1396694558 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd41c0ca5d0 0x7fd41c0cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd41b7fe640 1 -- 172.21.15.114:0/1396694558 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c0ca0b0 con 0x7fd4080039a0 2023-11-04T01:39:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd41b7fe640 1 --2- 172.21.15.114:0/1396694558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080039a0 0x7fd41c159cb0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009a90 tx=0x7fd40c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd418ff9640 1 -- 172.21.15.114:0/1396694558 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c003810 con 0x7fd4080039a0 2023-11-04T01:39:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd418ff9640 1 -- 172.21.15.114:0/1396694558 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c003970 con 0x7fd4080039a0 2023-11-04T01:39:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.513+0000 7fd421d90640 1 -- 172.21.15.114:0/1396694558 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd41c1f2ba0 con 0x7fd4080039a0 2023-11-04T01:39:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.514+0000 7fd418ff9640 1 -- 172.21.15.114:0/1396694558 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c003d00 con 0x7fd4080039a0 2023-11-04T01:39:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.514+0000 7fd421d90640 1 -- 172.21.15.114:0/1396694558 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd41c0caa80 con 0x7fd4080039a0 2023-11-04T01:39:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.514+0000 7fd421d90640 1 -- 172.21.15.114:0/1396694558 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41c0ca240 con 0x7fd4080039a0 2023-11-04T01:39:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.515+0000 7fd418ff9640 1 -- 172.21.15.114:0/1396694558 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd40c040450 con 0x7fd4080039a0 2023-11-04T01:39:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.515+0000 7fd418ff9640 1 --2- 172.21.15.114:0/1396694558 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd3fc06ae70 0x7fd3fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.515+0000 7fd418ff9640 1 -- 172.21.15.114:0/1396694558 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fd40c0ab9c0 con 0x7fd4080039a0 2023-11-04T01:39:59.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.515+0000 7fd412ffd640 1 --2- 172.21.15.114:0/1396694558 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd3fc06ae70 0x7fd3fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.516+0000 7fd412ffd640 1 --2- 172.21.15.114:0/1396694558 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd3fc06ae70 0x7fd3fc06d330 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd404000c00 tx=0x7fd404001150 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:59.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.520+0000 7fd418ff9640 1 -- 172.21.15.114:0/1396694558 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd40c0764f0 con 0x7fd4080039a0 2023-11-04T01:39:59.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.719+0000 7fd421d90640 1 -- 172.21.15.114:0/1396694558 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd41c04e490 con 0x7fd4080039a0 2023-11-04T01:39:59.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.799+0000 7fd418ff9640 1 -- 172.21.15.114:0/1396694558 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v44) v1 ==== 167+0+0 (secure 0 0 0) 0x7fd40c0044e0 con 0x7fd4080039a0 2023-11-04T01:39:59.801 INFO:teuthology.orchestra.run.smithi114.stderr:enabled new snapshots 2023-11-04T01:39:59.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.800+0000 7fd421d90640 1 -- 172.21.15.114:0/1396694558 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd3fc06ae70 msgr2=0x7fd3fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.800+0000 7fd421d90640 1 --2- 172.21.15.114:0/1396694558 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd3fc06ae70 0x7fd3fc06d330 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd404000c00 tx=0x7fd404001150 comp rx=0 tx=0).stop 2023-11-04T01:39:59.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.800+0000 7fd421d90640 1 -- 172.21.15.114:0/1396694558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080039a0 msgr2=0x7fd41c159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.800+0000 7fd421d90640 1 --2- 172.21.15.114:0/1396694558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080039a0 0x7fd41c159cb0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009a90 tx=0x7fd40c004730 comp rx=0 tx=0).stop 2023-11-04T01:39:59.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.800+0000 7fd421d90640 1 -- 172.21.15.114:0/1396694558 shutdown_connections 2023-11-04T01:39:59.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.800+0000 7fd421d90640 1 --2- 172.21.15.114:0/1396694558 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd3fc06ae70 0x7fd3fc06d330 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.800+0000 7fd421d90640 1 --2- 172.21.15.114:0/1396694558 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd41c0ca5d0 0x7fd41c0cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.800+0000 7fd421d90640 1 --2- 172.21.15.114:0/1396694558 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd41c0b2010 0x7fd41c1f2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.800+0000 7fd421d90640 1 --2- 172.21.15.114:0/1396694558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080039a0 0x7fd41c159cb0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.800+0000 7fd421d90640 1 -- 172.21.15.114:0/1396694558 >> 172.21.15.114:0/1396694558 conn(0x7fd41c071c40 msgr2=0x7fd41c15e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:59.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.800+0000 7fd421d90640 1 -- 172.21.15.114:0/1396694558 shutdown_connections 2023-11-04T01:39:59.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.800+0000 7fd421d90640 1 -- 172.21.15.114:0/1396694558 wait complete. 2023-11-04T01:39:59.813 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2023-11-04T01:39:59.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.913+0000 7fb8ed476640 1 Processor -- start 2023-11-04T01:39:59.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.913+0000 7fb8ed476640 1 -- start start 2023-11-04T01:39:59.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.913+0000 7fb8ed476640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb8e80cd6d0 0x7fb8e8161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.913+0000 7fb8ed476640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8e80b4880 0x7fb8e80b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.913+0000 7fb8ed476640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e80cde60 con 0x7fb8e8153e60 2023-11-04T01:39:59.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.913+0000 7fb8ed476640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e8160f90 con 0x7fb8e80cd6d0 2023-11-04T01:39:59.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.913+0000 7fb8ed476640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e8161960 con 0x7fb8e80b4880 2023-11-04T01:39:59.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e6ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb8e8153e60 0x7fb8e815dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33330/0 (socket says 172.21.15.114:33330) 2023-11-04T01:39:59.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e6ffd640 1 -- 172.21.15.114:0/2135253536 learned_addr learned my addr 172.21.15.114:0/2135253536 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:39:59.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e67fc640 1 --2- 172.21.15.114:0/2135253536 >> v2:172.21.15.141:3300/0 conn(0x7fb8e80cd6d0 0x7fb8e8161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e77fe640 1 --2- 172.21.15.114:0/2135253536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8e80b4880 0x7fb8e80b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e5ffb640 1 -- 172.21.15.114:0/2135253536 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260301292 0 0) 0x7fb8e80cde60 con 0x7fb8e8153e60 2023-11-04T01:39:59.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e5ffb640 1 -- 172.21.15.114:0/2135253536 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8d0003520 con 0x7fb8e8153e60 2023-11-04T01:39:59.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e5ffb640 1 -- 172.21.15.114:0/2135253536 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2725728589 0 0) 0x7fb8d0003520 con 0x7fb8e8153e60 2023-11-04T01:39:59.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e5ffb640 1 -- 172.21.15.114:0/2135253536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8e80b4880 msgr2=0x7fb8e80b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:59.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e5ffb640 1 --2- 172.21.15.114:0/2135253536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8e80b4880 0x7fb8e80b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e5ffb640 1 -- 172.21.15.114:0/2135253536 >> v2:172.21.15.141:3300/0 conn(0x7fb8e80cd6d0 msgr2=0x7fb8e8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:59.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e5ffb640 1 --2- 172.21.15.114:0/2135253536 >> v2:172.21.15.141:3300/0 conn(0x7fb8e80cd6d0 0x7fb8e8161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e5ffb640 1 -- 172.21.15.114:0/2135253536 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e80b5220 con 0x7fb8e8153e60 2023-11-04T01:39:59.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e5ffb640 1 -- 172.21.15.114:0/2135253536 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fb8d80019f0 con 0x7fb8e8153e60 2023-11-04T01:39:59.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e5ffb640 1 -- 172.21.15.114:0/2135253536 >> v1:172.21.15.114:6789/0 conn(0x7fb8e8153e60 legacy=0x7fb8e815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e5ffb640 1 --2- 172.21.15.114:0/2135253536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d0003970 0x7fb8d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e5ffb640 1 --2- 172.21.15.114:0/2135253536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8e80b4880 0x7fb8d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e5ffb640 1 --2- 172.21.15.114:0/2135253536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8d0004d00 0x7fb8d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e5ffb640 1 -- 172.21.15.114:0/2135253536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e8160f90 con 0x7fb8d0003970 2023-11-04T01:39:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e5ffb640 1 -- 172.21.15.114:0/2135253536 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e8161960 con 0x7fb8d0004d00 2023-11-04T01:39:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e5ffb640 1 -- 172.21.15.114:0/2135253536 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d000b980 con 0x7fb8e80b4880 2023-11-04T01:39:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e6ffd640 1 --2- 172.21.15.114:0/2135253536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d0003970 0x7fb8d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e77fe640 1 --2- 172.21.15.114:0/2135253536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8d0004d00 0x7fb8d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e67fc640 1 --2- 172.21.15.114:0/2135253536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8e80b4880 0x7fb8d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e6ffd640 1 -- 172.21.15.114:0/2135253536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8e80b4880 msgr2=0x7fb8d00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e6ffd640 1 --2- 172.21.15.114:0/2135253536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8e80b4880 0x7fb8d00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e6ffd640 1 -- 172.21.15.114:0/2135253536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8d0004d00 msgr2=0x7fb8d0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e6ffd640 1 --2- 172.21.15.114:0/2135253536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8d0004d00 0x7fb8d0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e6ffd640 1 -- 172.21.15.114:0/2135253536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d0003520 con 0x7fb8d0003970 2023-11-04T01:39:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.914+0000 7fb8e67fc640 1 --2- 172.21.15.114:0/2135253536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8e80b4880 0x7fb8d00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.915+0000 7fb8e6ffd640 1 --2- 172.21.15.114:0/2135253536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d0003970 0x7fb8d0003d90 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800a860 tx=0x7fb8d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6016bd0b6b92c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.915+0000 7fb8e5ffb640 1 -- 172.21.15.114:0/2135253536 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8034630 con 0x7fb8d0003970 2023-11-04T01:39:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.915+0000 7fb8e5ffb640 1 -- 172.21.15.114:0/2135253536 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d802f070 con 0x7fb8d0003970 2023-11-04T01:39:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.915+0000 7fb8e5ffb640 1 -- 172.21.15.114:0/2135253536 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8034a10 con 0x7fb8d0003970 2023-11-04T01:39:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.916+0000 7fb8ed476640 1 -- 172.21.15.114:0/2135253536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d0003970 msgr2=0x7fb8d0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.916+0000 7fb8ed476640 1 --2- 172.21.15.114:0/2135253536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d0003970 0x7fb8d0003d90 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800a860 tx=0x7fb8d00057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.916+0000 7fb8e77fe640 1 -- 172.21.15.114:0/2135253536 reap_dead start 2023-11-04T01:39:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.916+0000 7fb8ed476640 1 -- 172.21.15.114:0/2135253536 shutdown_connections 2023-11-04T01:39:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.916+0000 7fb8ed476640 1 -- 172.21.15.114:0/2135253536 >> 172.21.15.114:0/2135253536 conn(0x7fb8e80cf880 msgr2=0x7fb8e80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.916+0000 7fb8ed476640 1 -- 172.21.15.114:0/2135253536 shutdown_connections 2023-11-04T01:39:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.916+0000 7fb8ed476640 1 -- 172.21.15.114:0/2135253536 wait complete. 2023-11-04T01:39:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.917+0000 7fb8ed476640 1 Processor -- start 2023-11-04T01:39:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.917+0000 7fb8ed476640 1 -- start start 2023-11-04T01:39:59.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.918+0000 7fb8ed476640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d0003970 0x7fb8e814fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.918+0000 7fb8ed476640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8e80cc0a0 0x7fb8e80cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.918+0000 7fb8ed476640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8e80c7f10 0x7fb8e80c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.918+0000 7fb8ed476640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80c6c40 con 0x7fb8d0003970 2023-11-04T01:39:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.918+0000 7fb8ed476640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80cca60 con 0x7fb8e80c7f10 2023-11-04T01:39:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.918+0000 7fb8ed476640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e81f2760 con 0x7fb8e80cc0a0 2023-11-04T01:39:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.918+0000 7fb8e6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d0003970 0x7fb8e814fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.918+0000 7fb8e6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d0003970 0x7fb8e814fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53436/0 (socket says 172.21.15.114:53436) 2023-11-04T01:39:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.918+0000 7fb8e6ffd640 1 -- 172.21.15.114:0/2623394896 learned_addr learned my addr 172.21.15.114:0/2623394896 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:39:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.918+0000 7fb8e6ffd640 1 -- 172.21.15.114:0/2623394896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8e80cc0a0 msgr2=0x7fb8e80cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.918+0000 7fb8e6ffd640 1 --2- 172.21.15.114:0/2623394896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8e80cc0a0 0x7fb8e80cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.918+0000 7fb8e77fe640 1 --2- 172.21.15.114:0/2623394896 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8e80c7f10 0x7fb8e80c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.918+0000 7fb8e6ffd640 1 -- 172.21.15.114:0/2623394896 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8e80c7f10 msgr2=0x7fb8e80c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.918+0000 7fb8e6ffd640 1 --2- 172.21.15.114:0/2623394896 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8e80c7f10 0x7fb8e80c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.918+0000 7fb8e6ffd640 1 -- 172.21.15.114:0/2623394896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e80c88d0 con 0x7fb8d0003970 2023-11-04T01:39:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.918+0000 7fb8e6ffd640 1 --2- 172.21.15.114:0/2623394896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d0003970 0x7fb8e814fbf0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800a860 tx=0x7fb8e8160f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:59.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.919+0000 7fb8cf7fe640 1 -- 172.21.15.114:0/2623394896 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8004d60 con 0x7fb8d0003970 2023-11-04T01:39:59.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.919+0000 7fb8cf7fe640 1 -- 172.21.15.114:0/2623394896 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d8034430 con 0x7fb8d0003970 2023-11-04T01:39:59.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.919+0000 7fb8cf7fe640 1 -- 172.21.15.114:0/2623394896 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d80347a0 con 0x7fb8d0003970 2023-11-04T01:39:59.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.919+0000 7fb8ed476640 1 -- 172.21.15.114:0/2623394896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e80c8b40 con 0x7fb8d0003970 2023-11-04T01:39:59.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.919+0000 7fb8ed476640 1 -- 172.21.15.114:0/2623394896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e80c9100 con 0x7fb8d0003970 2023-11-04T01:39:59.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.920+0000 7fb8ed476640 1 -- 172.21.15.114:0/2623394896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e8074290 con 0x7fb8d0003970 2023-11-04T01:39:59.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.920+0000 7fb8cf7fe640 1 -- 172.21.15.114:0/2623394896 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb8d8031030 con 0x7fb8d0003970 2023-11-04T01:39:59.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.920+0000 7fb8cf7fe640 1 --2- 172.21.15.114:0/2623394896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb8d406ae70 0x7fb8d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.920+0000 7fb8cf7fe640 1 -- 172.21.15.114:0/2623394896 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fb8d80abb50 con 0x7fb8d0003970 2023-11-04T01:39:59.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.920+0000 7fb8e67fc640 1 --2- 172.21.15.114:0/2623394896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb8d406ae70 0x7fb8d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.921+0000 7fb8e67fc640 1 --2- 172.21.15.114:0/2623394896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb8d406ae70 0x7fb8d406d330 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80ccbf0 tx=0x7fb8dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:59.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:39:59.924+0000 7fb8cf7fe640 1 -- 172.21.15.114:0/2623394896 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb8d8076680 con 0x7fb8d0003970 2023-11-04T01:40:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.132+0000 7fb8ed476640 1 -- 172.21.15.114:0/2623394896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fb8e8074290 con 0x7fb8d0003970 2023-11-04T01:40:00.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.572+0000 7fb8cf7fe640 1 -- 172.21.15.114:0/2623394896 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v45) v1 ==== 105+0+0 (secure 0 0 0) 0x7fb8d8079ca0 con 0x7fb8d0003970 2023-11-04T01:40:00.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.575+0000 7fb8ed476640 1 -- 172.21.15.114:0/2623394896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb8d406ae70 msgr2=0x7fb8d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.575+0000 7fb8ed476640 1 --2- 172.21.15.114:0/2623394896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb8d406ae70 0x7fb8d406d330 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80ccbf0 tx=0x7fb8dc008040 comp rx=0 tx=0).stop 2023-11-04T01:40:00.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.575+0000 7fb8ed476640 1 -- 172.21.15.114:0/2623394896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d0003970 msgr2=0x7fb8e814fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.575+0000 7fb8ed476640 1 --2- 172.21.15.114:0/2623394896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d0003970 0x7fb8e814fbf0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800a860 tx=0x7fb8e8160f00 comp rx=0 tx=0).stop 2023-11-04T01:40:00.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.575+0000 7fb8ed476640 1 -- 172.21.15.114:0/2623394896 shutdown_connections 2023-11-04T01:40:00.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.575+0000 7fb8ed476640 1 --2- 172.21.15.114:0/2623394896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb8d406ae70 0x7fb8d406d330 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.575+0000 7fb8ed476640 1 --2- 172.21.15.114:0/2623394896 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb8e80c7f10 0x7fb8e80c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.575+0000 7fb8ed476640 1 --2- 172.21.15.114:0/2623394896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb8e80cc0a0 0x7fb8e80cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.575+0000 7fb8ed476640 1 --2- 172.21.15.114:0/2623394896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d0003970 0x7fb8e814fbf0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.575+0000 7fb8ed476640 1 -- 172.21.15.114:0/2623394896 >> 172.21.15.114:0/2623394896 conn(0x7fb8e80cf880 msgr2=0x7fb8e815f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.575+0000 7fb8ed476640 1 -- 172.21.15.114:0/2623394896 shutdown_connections 2023-11-04T01:40:00.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.575+0000 7fb8ed476640 1 -- 172.21.15.114:0/2623394896 wait complete. 2023-11-04T01:40:00.592 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:00.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.693+0000 7fbc106a9640 1 Processor -- start 2023-11-04T01:40:00.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.693+0000 7fbc106a9640 1 -- start start 2023-11-04T01:40:00.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.694+0000 7fbc106a9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbc08159c70 0x7fbc080ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.694+0000 7fbc106a9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc080b4110 con 0x7fbc080b0ae0 2023-11-04T01:40:00.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.694+0000 7fbc106a9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc080b43f0 con 0x7fbc0806db20 2023-11-04T01:40:00.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.694+0000 7fbc106a9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc080b49b0 con 0x7fbc08159c70 2023-11-04T01:40:00.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.694+0000 7fbc0e445640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbc08159c70 0x7fbc080ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.694+0000 7fbc0ec46640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbc080b0ae0 0x7fbc0815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33338/0 (socket says 172.21.15.114:33338) 2023-11-04T01:40:00.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.694+0000 7fbc0ec46640 1 -- 172.21.15.114:0/2284533938 learned_addr learned my addr 172.21.15.114:0/2284533938 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:00.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.694+0000 7fbc0e445640 1 -- 172.21.15.114:0/2284533938 >> v1:172.21.15.141:6789/0 conn(0x7fbc0806db20 legacy=0x7fbc080b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.694+0000 7fbc0e445640 1 -- 172.21.15.114:0/2284533938 >> v1:172.21.15.114:6789/0 conn(0x7fbc080b0ae0 legacy=0x7fbc0815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.694+0000 7fbc0d443640 1 -- 172.21.15.114:0/2284533938 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904359984 0 0) 0x7fbc080b4110 con 0x7fbc080b0ae0 2023-11-04T01:40:00.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.694+0000 7fbc0e445640 1 -- 172.21.15.114:0/2284533938 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc080b46d0 con 0x7fbc08159c70 2023-11-04T01:40:00.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.695+0000 7fbc0e445640 1 --2- 172.21.15.114:0/2284533938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc08159c70 0x7fbc080ce370 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009d90 tx=0x7fbc0402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6573de029e1b2488 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.695+0000 7fbc0d443640 1 -- 172.21.15.114:0/2284533938 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0402cd00 con 0x7fbc08159c70 2023-11-04T01:40:00.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.695+0000 7fbc0d443640 1 -- 172.21.15.114:0/2284533938 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0402ce60 con 0x7fbc08159c70 2023-11-04T01:40:00.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.695+0000 7fbc0d443640 1 -- 172.21.15.114:0/2284533938 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc04034660 con 0x7fbc08159c70 2023-11-04T01:40:00.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.696+0000 7fbc106a9640 1 -- 172.21.15.114:0/2284533938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc08159c70 msgr2=0x7fbc080ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.696+0000 7fbc106a9640 1 --2- 172.21.15.114:0/2284533938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc08159c70 0x7fbc080ce370 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009d90 tx=0x7fbc0402bf50 comp rx=0 tx=0).stop 2023-11-04T01:40:00.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.696+0000 7fbc106a9640 1 -- 172.21.15.114:0/2284533938 shutdown_connections 2023-11-04T01:40:00.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.696+0000 7fbc106a9640 1 --2- 172.21.15.114:0/2284533938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc08159c70 0x7fbc080ce370 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.696+0000 7fbc106a9640 1 -- 172.21.15.114:0/2284533938 >> 172.21.15.114:0/2284533938 conn(0x7fbc080ce950 msgr2=0x7fbc080ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.696+0000 7fbc106a9640 1 -- 172.21.15.114:0/2284533938 shutdown_connections 2023-11-04T01:40:00.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.696+0000 7fbc106a9640 1 -- 172.21.15.114:0/2284533938 wait complete. 2023-11-04T01:40:00.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.697+0000 7fbc106a9640 1 Processor -- start 2023-11-04T01:40:00.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.697+0000 7fbc106a9640 1 -- start start 2023-11-04T01:40:00.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc106a9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc0806db20 0x7fbc0815cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc106a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc080b0ae0 0x7fbc080c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc106a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc08159c70 0x7fbc080c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc106a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc08154c10 con 0x7fbc08159c70 2023-11-04T01:40:00.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc106a9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc08154040 con 0x7fbc0806db20 2023-11-04T01:40:00.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc106a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc081542e0 con 0x7fbc080b0ae0 2023-11-04T01:40:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc0ec46640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc08159c70 0x7fbc080c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc0ec46640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc08159c70 0x7fbc080c7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53456/0 (socket says 172.21.15.114:53456) 2023-11-04T01:40:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc0ec46640 1 -- 172.21.15.114:0/2192928905 learned_addr learned my addr 172.21.15.114:0/2192928905 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc0e445640 1 --2- 172.21.15.114:0/2192928905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc0806db20 0x7fbc0815cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc0dc44640 1 --2- 172.21.15.114:0/2192928905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc080b0ae0 0x7fbc080c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc0ec46640 1 -- 172.21.15.114:0/2192928905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc080b0ae0 msgr2=0x7fbc080c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc0ec46640 1 --2- 172.21.15.114:0/2192928905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc080b0ae0 0x7fbc080c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc0ec46640 1 -- 172.21.15.114:0/2192928905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc0806db20 msgr2=0x7fbc0815cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc0ec46640 1 --2- 172.21.15.114:0/2192928905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc0806db20 0x7fbc0815cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc0ec46640 1 -- 172.21.15.114:0/2192928905 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc04009a70 con 0x7fbc08159c70 2023-11-04T01:40:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc0ec46640 1 --2- 172.21.15.114:0/2192928905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc08159c70 0x7fbc080c7330 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000c430 tx=0x7fbc0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbbfeffd640 1 -- 172.21.15.114:0/2192928905 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc000074e0 con 0x7fbc08159c70 2023-11-04T01:40:00.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbbfeffd640 1 -- 172.21.15.114:0/2192928905 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc00007660 con 0x7fbc08159c70 2023-11-04T01:40:00.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc106a9640 1 -- 172.21.15.114:0/2192928905 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc081545c0 con 0x7fbc08159c70 2023-11-04T01:40:00.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbbfeffd640 1 -- 172.21.15.114:0/2192928905 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00004a20 con 0x7fbc08159c70 2023-11-04T01:40:00.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.698+0000 7fbc106a9640 1 -- 172.21.15.114:0/2192928905 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc08152660 con 0x7fbc08159c70 2023-11-04T01:40:00.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.699+0000 7fbc106a9640 1 -- 172.21.15.114:0/2192928905 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc08154d80 con 0x7fbc08159c70 2023-11-04T01:40:00.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.700+0000 7fbbfeffd640 1 -- 172.21.15.114:0/2192928905 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc00004b80 con 0x7fbc08159c70 2023-11-04T01:40:00.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.700+0000 7fbbfeffd640 1 --2- 172.21.15.114:0/2192928905 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbbec06aea0 0x7fbbec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.700+0000 7fbc0e445640 1 --2- 172.21.15.114:0/2192928905 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbbec06aea0 0x7fbbec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.700+0000 7fbbfeffd640 1 -- 172.21.15.114:0/2192928905 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fbc000899e0 con 0x7fbc08159c70 2023-11-04T01:40:00.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.701+0000 7fbc0e445640 1 --2- 172.21.15.114:0/2192928905 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbbec06aea0 0x7fbbec06d360 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbc04036000 tx=0x7fbc04030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.705+0000 7fbbfeffd640 1 -- 172.21.15.114:0/2192928905 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc000545d0 con 0x7fbc08159c70 2023-11-04T01:40:00.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.912+0000 7fbc106a9640 1 -- 172.21.15.114:0/2192928905 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc08074290 con 0x7fbc08159c70 2023-11-04T01:40:00.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.913+0000 7fbbfeffd640 1 -- 172.21.15.114:0/2192928905 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fbc00057bf0 con 0x7fbc08159c70 2023-11-04T01:40:00.915 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:00.915 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:00.572679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7431,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:creating","state_seq":1,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7431":{"gid":7431,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/3780323525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3780323525},{"type":"v1","addr":"172.21.15.114:6836","nonce":3780323525}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:00.915 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 45 2023-11-04T01:40:00.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.915+0000 7fbc106a9640 1 -- 172.21.15.114:0/2192928905 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbbec06aea0 msgr2=0x7fbbec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.915+0000 7fbc106a9640 1 --2- 172.21.15.114:0/2192928905 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbbec06aea0 0x7fbbec06d360 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbc04036000 tx=0x7fbc04030000 comp rx=0 tx=0).stop 2023-11-04T01:40:00.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.915+0000 7fbc106a9640 1 -- 172.21.15.114:0/2192928905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc08159c70 msgr2=0x7fbc080c7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.915+0000 7fbc106a9640 1 --2- 172.21.15.114:0/2192928905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc08159c70 0x7fbc080c7330 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000c430 tx=0x7fbc0000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.915+0000 7fbc106a9640 1 -- 172.21.15.114:0/2192928905 shutdown_connections 2023-11-04T01:40:00.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.915+0000 7fbc106a9640 1 --2- 172.21.15.114:0/2192928905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc08159c70 0x7fbc080c7330 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.915+0000 7fbc106a9640 1 --2- 172.21.15.114:0/2192928905 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc080b0ae0 0x7fbc080c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.915+0000 7fbc106a9640 1 --2- 172.21.15.114:0/2192928905 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbbec06aea0 0x7fbbec06d360 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.915+0000 7fbc106a9640 1 --2- 172.21.15.114:0/2192928905 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc0806db20 0x7fbc0815cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.915+0000 7fbc106a9640 1 -- 172.21.15.114:0/2192928905 >> 172.21.15.114:0/2192928905 conn(0x7fbc080ce950 msgr2=0x7fbc080cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.915+0000 7fbc106a9640 1 -- 172.21.15.114:0/2192928905 shutdown_connections 2023-11-04T01:40:00.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:00.915+0000 7fbc106a9640 1 -- 172.21.15.114:0/2192928905 wait complete. 2023-11-04T01:40:01.329 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:51.430343+0000', 'modified': '2023-11-04T01:40:00.572679+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7431, 'mds_1': 6298}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6298': {'gid': 6298, 'name': 'b', 'rank': 1, 'incarnation': 45, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.141:6834/1296600989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.141:6832', 'nonce': 1296600989}, {'type': 'v1', 'addr': '172.21.15.141:6834', 'nonce': 1296600989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7431': {'gid': 7431, 'name': 'c', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6836/3780323525', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6834', 'nonce': 3780323525}, {'type': 'v1', 'addr': '172.21.15.114:6836', 'nonce': 3780323525}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:40:01.329 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6298:up:creating 2023-11-04T01:40:02.019 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:40:02.017+0000 7feb1a720640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:02.330 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:02.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.440+0000 7fed38fcc640 1 Processor -- start 2023-11-04T01:40:02.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.440+0000 7fed38fcc640 1 -- start start 2023-11-04T01:40:02.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.441+0000 7fed38fcc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fed340ce240 0x7fed34157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.441+0000 7fed38fcc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed34157540 0x7fed340d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.441+0000 7fed38fcc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3415e000 con 0x7fed340cde60 2023-11-04T01:40:02.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.441+0000 7fed38fcc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed3415e5c0 con 0x7fed340ce240 2023-11-04T01:40:02.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.441+0000 7fed38fcc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3415e2e0 con 0x7fed34157540 2023-11-04T01:40:02.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.441+0000 7fed31d9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fed340ce240 0x7fed34157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.441+0000 7fed3259c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fed340cde60 0x7fed3415d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33346/0 (socket says 172.21.15.114:33346) 2023-11-04T01:40:02.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.441+0000 7fed3259c640 1 -- 172.21.15.114:0/911007739 learned_addr learned my addr 172.21.15.114:0/911007739 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:02.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.441+0000 7fed31d9b640 1 -- 172.21.15.114:0/911007739 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed34157540 msgr2=0x7fed340d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:02.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.441+0000 7fed31d9b640 1 --2- 172.21.15.114:0/911007739 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed34157540 0x7fed340d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.441+0000 7fed31d9b640 1 -- 172.21.15.114:0/911007739 >> v1:172.21.15.114:6789/0 conn(0x7fed340cde60 legacy=0x7fed3415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.441+0000 7fed3159a640 1 -- 172.21.15.114:0/911007739 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334233160 0 0) 0x7fed3415e000 con 0x7fed340cde60 2023-11-04T01:40:02.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.441+0000 7fed31d9b640 1 -- 172.21.15.114:0/911007739 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed340d1120 con 0x7fed340ce240 2023-11-04T01:40:02.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.442+0000 7fed31d9b640 1 --2- 172.21.15.114:0/911007739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed340ce240 0x7fed34157000 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fed280097a0 tx=0x7fed2802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ef37dc4ebe5b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.442+0000 7fed3159a640 1 -- 172.21.15.114:0/911007739 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28031830 con 0x7fed340ce240 2023-11-04T01:40:02.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.442+0000 7fed3159a640 1 -- 172.21.15.114:0/911007739 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed28031990 con 0x7fed340ce240 2023-11-04T01:40:02.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.442+0000 7fed3159a640 1 -- 172.21.15.114:0/911007739 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28031d20 con 0x7fed340ce240 2023-11-04T01:40:02.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.443+0000 7fed38fcc640 1 -- 172.21.15.114:0/911007739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed340ce240 msgr2=0x7fed34157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.443+0000 7fed38fcc640 1 --2- 172.21.15.114:0/911007739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed340ce240 0x7fed34157000 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fed280097a0 tx=0x7fed2802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.443+0000 7fed38fcc640 1 -- 172.21.15.114:0/911007739 shutdown_connections 2023-11-04T01:40:02.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.443+0000 7fed38fcc640 1 --2- 172.21.15.114:0/911007739 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed34157540 0x7fed340d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.443+0000 7fed38fcc640 1 --2- 172.21.15.114:0/911007739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed340ce240 0x7fed34157000 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.443+0000 7fed38fcc640 1 -- 172.21.15.114:0/911007739 >> 172.21.15.114:0/911007739 conn(0x7fed34071f30 msgr2=0x7fed340cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:02.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.443+0000 7fed38fcc640 1 -- 172.21.15.114:0/911007739 shutdown_connections 2023-11-04T01:40:02.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.443+0000 7fed38fcc640 1 -- 172.21.15.114:0/911007739 wait complete. 2023-11-04T01:40:02.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.444+0000 7fed38fcc640 1 Processor -- start 2023-11-04T01:40:02.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.444+0000 7fed38fcc640 1 -- start start 2023-11-04T01:40:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.445+0000 7fed38fcc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed340cde60 0x7fed340cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.445+0000 7fed38fcc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed340ce240 0x7fed341f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.445+0000 7fed38fcc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed34157540 0x7fed34152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.445+0000 7fed38fcc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed341f6810 con 0x7fed34157540 2023-11-04T01:40:02.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.445+0000 7fed38fcc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed340cac30 con 0x7fed340ce240 2023-11-04T01:40:02.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.445+0000 7fed38fcc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed340caf10 con 0x7fed340cde60 2023-11-04T01:40:02.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.445+0000 7fed32d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed34157540 0x7fed34152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.445+0000 7fed32d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed34157540 0x7fed34152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53468/0 (socket says 172.21.15.114:53468) 2023-11-04T01:40:02.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.445+0000 7fed32d9d640 1 -- 172.21.15.114:0/749076317 learned_addr learned my addr 172.21.15.114:0/749076317 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:02.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.445+0000 7fed3259c640 1 --2- 172.21.15.114:0/749076317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed340cde60 0x7fed340cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.445+0000 7fed32d9d640 1 -- 172.21.15.114:0/749076317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed340cde60 msgr2=0x7fed340cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.445+0000 7fed32d9d640 1 --2- 172.21.15.114:0/749076317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed340cde60 0x7fed340cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.445+0000 7fed32d9d640 1 -- 172.21.15.114:0/749076317 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed340ce240 msgr2=0x7fed341f5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.445+0000 7fed32d9d640 1 --2- 172.21.15.114:0/749076317 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed340ce240 0x7fed341f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.445+0000 7fed32d9d640 1 -- 172.21.15.114:0/749076317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed28009400 con 0x7fed34157540 2023-11-04T01:40:02.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.446+0000 7fed32d9d640 1 --2- 172.21.15.114:0/749076317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed34157540 0x7fed34152e40 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00b970 tx=0x7fed2c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.446+0000 7fed22ffd640 1 -- 172.21.15.114:0/749076317 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c00cb40 con 0x7fed34157540 2023-11-04T01:40:02.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.446+0000 7fed22ffd640 1 -- 172.21.15.114:0/749076317 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2c00ccc0 con 0x7fed34157540 2023-11-04T01:40:02.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.446+0000 7fed38fcc640 1 -- 172.21.15.114:0/749076317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed340cb1f0 con 0x7fed34157540 2023-11-04T01:40:02.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.446+0000 7fed22ffd640 1 -- 172.21.15.114:0/749076317 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c014680 con 0x7fed34157540 2023-11-04T01:40:02.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.446+0000 7fed38fcc640 1 -- 172.21.15.114:0/749076317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed340cb7b0 con 0x7fed34157540 2023-11-04T01:40:02.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.447+0000 7fed38fcc640 1 -- 172.21.15.114:0/749076317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed34074290 con 0x7fed34157540 2023-11-04T01:40:02.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.447+0000 7fed22ffd640 1 -- 172.21.15.114:0/749076317 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed2c01d3b0 con 0x7fed34157540 2023-11-04T01:40:02.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.448+0000 7fed22ffd640 1 --2- 172.21.15.114:0/749076317 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed1406ae70 0x7fed1406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.448+0000 7fed3259c640 1 --2- 172.21.15.114:0/749076317 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed1406ae70 0x7fed1406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.448+0000 7fed22ffd640 1 -- 172.21.15.114:0/749076317 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fed2c089b40 con 0x7fed34157540 2023-11-04T01:40:02.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.448+0000 7fed3259c640 1 --2- 172.21.15.114:0/749076317 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed1406ae70 0x7fed1406d330 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fed24007fd0 tx=0x7fed24009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.452+0000 7fed22ffd640 1 -- 172.21.15.114:0/749076317 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fed2c054670 con 0x7fed34157540 2023-11-04T01:40:02.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.650+0000 7fed38fcc640 1 -- 172.21.15.114:0/749076317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed340ca960 con 0x7fed34157540 2023-11-04T01:40:02.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.651+0000 7fed22ffd640 1 -- 172.21.15.114:0/749076317 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fed2c019090 con 0x7fed34157540 2023-11-04T01:40:02.653 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:02.654 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:00.589620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7431,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7431":{"gid":7431,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/3780323525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3780323525},{"type":"v1","addr":"172.21.15.114:6836","nonce":3780323525}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:02.656 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 46 2023-11-04T01:40:02.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.653+0000 7fed38fcc640 1 -- 172.21.15.114:0/749076317 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed1406ae70 msgr2=0x7fed1406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.653+0000 7fed38fcc640 1 --2- 172.21.15.114:0/749076317 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed1406ae70 0x7fed1406d330 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fed24007fd0 tx=0x7fed24009040 comp rx=0 tx=0).stop 2023-11-04T01:40:02.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.653+0000 7fed38fcc640 1 -- 172.21.15.114:0/749076317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed34157540 msgr2=0x7fed34152e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.653+0000 7fed38fcc640 1 --2- 172.21.15.114:0/749076317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed34157540 0x7fed34152e40 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00b970 tx=0x7fed2c00be30 comp rx=0 tx=0).stop 2023-11-04T01:40:02.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.653+0000 7fed38fcc640 1 -- 172.21.15.114:0/749076317 shutdown_connections 2023-11-04T01:40:02.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.653+0000 7fed38fcc640 1 --2- 172.21.15.114:0/749076317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed34157540 0x7fed34152e40 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.653+0000 7fed38fcc640 1 --2- 172.21.15.114:0/749076317 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fed1406ae70 0x7fed1406d330 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.653+0000 7fed38fcc640 1 --2- 172.21.15.114:0/749076317 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fed340ce240 0x7fed341f5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.653+0000 7fed38fcc640 1 --2- 172.21.15.114:0/749076317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fed340cde60 0x7fed340cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.653+0000 7fed38fcc640 1 -- 172.21.15.114:0/749076317 >> 172.21.15.114:0/749076317 conn(0x7fed34071f30 msgr2=0x7fed340d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:02.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.653+0000 7fed38fcc640 1 -- 172.21.15.114:0/749076317 shutdown_connections 2023-11-04T01:40:02.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:02.653+0000 7fed38fcc640 1 -- 172.21.15.114:0/749076317 wait complete. 2023-11-04T01:40:03.067 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:51.430343+0000', 'modified': '2023-11-04T01:40:00.589620+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7431, 'mds_1': 6298}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6298': {'gid': 6298, 'name': 'b', 'rank': 1, 'incarnation': 45, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.141:6834/1296600989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.141:6832', 'nonce': 1296600989}, {'type': 'v1', 'addr': '172.21.15.141:6834', 'nonce': 1296600989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7431': {'gid': 7431, 'name': 'c', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6836/3780323525', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6834', 'nonce': 3780323525}, {'type': 'v1', 'addr': '172.21.15.114:6836', 'nonce': 3780323525}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:40:03.067 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:40:03.067 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:40:03.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.168+0000 7f616174c640 1 Processor -- start 2023-11-04T01:40:03.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.168+0000 7f616174c640 1 -- start start 2023-11-04T01:40:03.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.168+0000 7f616174c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f615c0b4880 0x7f615c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f616174c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c0cde60 con 0x7f615c153e60 2023-11-04T01:40:03.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f616174c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c160f90 con 0x7f615c0cd6d0 2023-11-04T01:40:03.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f616174c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0b5200 con 0x7f615c0b4880 2023-11-04T01:40:03.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615affd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f615c153e60 0x7f615c15dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33352/0 (socket says 172.21.15.114:33352) 2023-11-04T01:40:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615affd640 1 -- 172.21.15.114:0/1306307955 learned_addr learned my addr 172.21.15.114:0/1306307955 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615b7fe640 1 --2- 172.21.15.114:0/1306307955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f615c0b4880 0x7f615c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615a7fc640 1 -- 172.21.15.114:0/1306307955 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437026429 0 0) 0x7f615c0cde60 con 0x7f615c153e60 2023-11-04T01:40:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615a7fc640 1 -- 172.21.15.114:0/1306307955 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6148003520 con 0x7f615c153e60 2023-11-04T01:40:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615a7fc640 1 -- 172.21.15.114:0/1306307955 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2477057177 0 0) 0x7f6148003520 con 0x7f615c153e60 2023-11-04T01:40:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615a7fc640 1 -- 172.21.15.114:0/1306307955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f615c0b4880 msgr2=0x7f615c0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615a7fc640 1 --2- 172.21.15.114:0/1306307955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f615c0b4880 0x7f615c0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615a7fc640 1 -- 172.21.15.114:0/1306307955 >> v1:172.21.15.141:6789/0 conn(0x7f615c0cd6d0 legacy=0x7f615c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615a7fc640 1 -- 172.21.15.114:0/1306307955 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c0ce090 con 0x7f615c153e60 2023-11-04T01:40:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615a7fc640 1 -- 172.21.15.114:0/1306307955 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f614c001670 con 0x7f615c153e60 2023-11-04T01:40:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615a7fc640 1 -- 172.21.15.114:0/1306307955 >> v1:172.21.15.114:6789/0 conn(0x7f615c153e60 legacy=0x7f615c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615a7fc640 1 --2- 172.21.15.114:0/1306307955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61480039a0 0x7f6148003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615a7fc640 1 --2- 172.21.15.114:0/1306307955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f615c0b4880 0x7f61480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615a7fc640 1 --2- 172.21.15.114:0/1306307955 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6148004d00 0x7f6148005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615a7fc640 1 -- 172.21.15.114:0/1306307955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0b5200 con 0x7f61480039a0 2023-11-04T01:40:03.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615a7fc640 1 -- 172.21.15.114:0/1306307955 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614800b9b0 con 0x7f6148004d00 2023-11-04T01:40:03.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615a7fc640 1 -- 172.21.15.114:0/1306307955 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614800bb70 con 0x7f615c0b4880 2023-11-04T01:40:03.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615affd640 1 --2- 172.21.15.114:0/1306307955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61480039a0 0x7f6148003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f615b7fe640 1 --2- 172.21.15.114:0/1306307955 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6148004d00 0x7f6148005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.169+0000 7f6153fff640 1 --2- 172.21.15.114:0/1306307955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f615c0b4880 0x7f61480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.170+0000 7f615affd640 1 -- 172.21.15.114:0/1306307955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f615c0b4880 msgr2=0x7f61480047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.170+0000 7f615affd640 1 --2- 172.21.15.114:0/1306307955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f615c0b4880 0x7f61480047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.170+0000 7f615affd640 1 -- 172.21.15.114:0/1306307955 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6148004d00 msgr2=0x7f6148005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.170+0000 7f615affd640 1 --2- 172.21.15.114:0/1306307955 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6148004d00 0x7f6148005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.170+0000 7f615affd640 1 -- 172.21.15.114:0/1306307955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6148003520 con 0x7f61480039a0 2023-11-04T01:40:03.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.170+0000 7f615affd640 1 --2- 172.21.15.114:0/1306307955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61480039a0 0x7f6148003d80 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f614c00c240 tx=0x7f61480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce59cb2d98f4409 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.170+0000 7f615a7fc640 1 -- 172.21.15.114:0/1306307955 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c005ad0 con 0x7f61480039a0 2023-11-04T01:40:03.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.170+0000 7f615a7fc640 1 -- 172.21.15.114:0/1306307955 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c005c30 con 0x7f61480039a0 2023-11-04T01:40:03.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.170+0000 7f615a7fc640 1 -- 172.21.15.114:0/1306307955 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c02c810 con 0x7f61480039a0 2023-11-04T01:40:03.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.171+0000 7f616174c640 1 -- 172.21.15.114:0/1306307955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61480039a0 msgr2=0x7f6148003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.171+0000 7f616174c640 1 --2- 172.21.15.114:0/1306307955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61480039a0 0x7f6148003d80 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f614c00c240 tx=0x7f61480057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.171+0000 7f615b7fe640 1 -- 172.21.15.114:0/1306307955 reap_dead start 2023-11-04T01:40:03.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.171+0000 7f616174c640 1 -- 172.21.15.114:0/1306307955 shutdown_connections 2023-11-04T01:40:03.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.171+0000 7f616174c640 1 -- 172.21.15.114:0/1306307955 >> 172.21.15.114:0/1306307955 conn(0x7f615c0cf880 msgr2=0x7f615c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.171+0000 7f616174c640 1 -- 172.21.15.114:0/1306307955 shutdown_connections 2023-11-04T01:40:03.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.171+0000 7f616174c640 1 -- 172.21.15.114:0/1306307955 wait complete. 2023-11-04T01:40:03.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.172+0000 7f616174c640 1 Processor -- start 2023-11-04T01:40:03.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.172+0000 7f616174c640 1 -- start start 2023-11-04T01:40:03.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f616174c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61480039a0 0x7f615c149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f616174c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f615c15d990 0x7f615c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f616174c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f615c0c7af0 0x7f615c1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f616174c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c156470 con 0x7f615c15d990 2023-11-04T01:40:03.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f616174c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0c7f70 con 0x7f615c0c7af0 2023-11-04T01:40:03.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f616174c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c1f2580 con 0x7f61480039a0 2023-11-04T01:40:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f6153fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f615c15d990 0x7f615c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f6153fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f615c15d990 0x7f615c0c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53472/0 (socket says 172.21.15.114:53472) 2023-11-04T01:40:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f6153fff640 1 -- 172.21.15.114:0/4106099177 learned_addr learned my addr 172.21.15.114:0/4106099177 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f6153fff640 1 -- 172.21.15.114:0/4106099177 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61480039a0 msgr2=0x7f615c149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f615b7fe640 1 --2- 172.21.15.114:0/4106099177 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f615c0c7af0 0x7f615c1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f615affd640 1 --2- 172.21.15.114:0/4106099177 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61480039a0 0x7f615c149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f6153fff640 1 --2- 172.21.15.114:0/4106099177 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61480039a0 0x7f615c149b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f6153fff640 1 -- 172.21.15.114:0/4106099177 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f615c0c7af0 msgr2=0x7f615c1545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f6153fff640 1 --2- 172.21.15.114:0/4106099177 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f615c0c7af0 0x7f615c1545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f6153fff640 1 -- 172.21.15.114:0/4106099177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c156670 con 0x7f615c15d990 2023-11-04T01:40:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f615b7fe640 1 --2- 172.21.15.114:0/4106099177 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f615c0c7af0 0x7f615c1545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f6153fff640 1 --2- 172.21.15.114:0/4106099177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f615c15d990 0x7f615c0c75b0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f614400e7d0 tx=0x7f614400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.173+0000 7f61537fe640 1 -- 172.21.15.114:0/4106099177 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61440050d0 con 0x7f615c15d990 2023-11-04T01:40:03.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.174+0000 7f61537fe640 1 -- 172.21.15.114:0/4106099177 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6144005250 con 0x7f615c15d990 2023-11-04T01:40:03.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.174+0000 7f616174c640 1 -- 172.21.15.114:0/4106099177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c156950 con 0x7f615c15d990 2023-11-04T01:40:03.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.174+0000 7f61537fe640 1 -- 172.21.15.114:0/4106099177 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614400c6c0 con 0x7f615c15d990 2023-11-04T01:40:03.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.174+0000 7f616174c640 1 -- 172.21.15.114:0/4106099177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c156f10 con 0x7f615c15d990 2023-11-04T01:40:03.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.175+0000 7f61537fe640 1 -- 172.21.15.114:0/4106099177 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f614400c820 con 0x7f615c15d990 2023-11-04T01:40:03.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.175+0000 7f61537fe640 1 --2- 172.21.15.114:0/4106099177 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f613c06aea0 0x7f613c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.175+0000 7f61537fe640 1 -- 172.21.15.114:0/4106099177 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f6144089a30 con 0x7f615c15d990 2023-11-04T01:40:03.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.175+0000 7f615affd640 1 --2- 172.21.15.114:0/4106099177 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f613c06aea0 0x7f613c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.176+0000 7f615affd640 1 --2- 172.21.15.114:0/4106099177 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f613c06aea0 0x7f613c06d360 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f614c034000 tx=0x7f614c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.176+0000 7f61643b6740 1 Processor -- start 2023-11-04T01:40:03.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.176+0000 7f61643b6740 1 -- start start 2023-11-04T01:40:03.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.177+0000 7f61643b6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2b9ee750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.177+0000 7f61643b6740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1bc30 0x557d2ba1e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.177+0000 7f61643b6740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2b9eec90 0x557d2ba1eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.177+0000 7f61643b6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2b8ff740 con 0x557d2ba1b850 2023-11-04T01:40:03.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.177+0000 7f61643b6740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2b9618d0 con 0x557d2ba1bc30 2023-11-04T01:40:03.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.177+0000 7f61643b6740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d2b95efc0 con 0x557d2b9eec90 2023-11-04T01:40:03.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.177+0000 7f615affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2b9ee750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.177+0000 7f615affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2b9ee750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53476/0 (socket says 172.21.15.114:53476) 2023-11-04T01:40:03.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.177+0000 7f615affd640 1 -- 172.21.15.114:0/816867309 learned_addr learned my addr 172.21.15.114:0/816867309 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:03.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.177+0000 7f615affd640 1 -- 172.21.15.114:0/816867309 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2b9eec90 msgr2=0x557d2ba1eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.177+0000 7f615affd640 1 --2- 172.21.15.114:0/816867309 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2b9eec90 0x557d2ba1eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.177+0000 7f615affd640 1 -- 172.21.15.114:0/816867309 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1bc30 msgr2=0x557d2ba1e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.177+0000 7f615affd640 1 --2- 172.21.15.114:0/816867309 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1bc30 0x557d2ba1e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.177+0000 7f615affd640 1 -- 172.21.15.114:0/816867309 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d2b91dca0 con 0x557d2ba1b850 2023-11-04T01:40:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.178+0000 7f615affd640 1 --2- 172.21.15.114:0/816867309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2b9ee750 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f614c00c270 tx=0x7f614c007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8343ecffb436f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.178+0000 7f6150ff9640 1 -- 172.21.15.114:0/816867309 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c049070 con 0x557d2ba1b850 2023-11-04T01:40:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.178+0000 7f6150ff9640 1 -- 172.21.15.114:0/816867309 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c001630 con 0x557d2ba1b850 2023-11-04T01:40:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.178+0000 7f6150ff9640 1 -- 172.21.15.114:0/816867309 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c02dcb0 con 0x557d2ba1b850 2023-11-04T01:40:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.178+0000 7f61643b6740 1 -- 172.21.15.114:0/816867309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 msgr2=0x557d2b9ee750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.178+0000 7f61643b6740 1 --2- 172.21.15.114:0/816867309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2b9ee750 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f614c00c270 tx=0x7f614c007000 comp rx=0 tx=0).stop 2023-11-04T01:40:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.178+0000 7f61643b6740 1 -- 172.21.15.114:0/816867309 shutdown_connections 2023-11-04T01:40:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.178+0000 7f61643b6740 1 --2- 172.21.15.114:0/816867309 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2b9eec90 0x557d2ba1eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.178+0000 7f61643b6740 1 --2- 172.21.15.114:0/816867309 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1bc30 0x557d2ba1e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.178+0000 7f61643b6740 1 --2- 172.21.15.114:0/816867309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2b9ee750 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.178+0000 7f61643b6740 1 -- 172.21.15.114:0/816867309 >> 172.21.15.114:0/816867309 conn(0x557d2b9f0a60 msgr2=0x557d2ba395e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.179+0000 7f61643b6740 1 -- 172.21.15.114:0/816867309 shutdown_connections 2023-11-04T01:40:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.179+0000 7f61643b6740 1 -- 172.21.15.114:0/816867309 wait complete. 2023-11-04T01:40:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.179+0000 7f61643b6740 1 -- start start 2023-11-04T01:40:03.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.179+0000 7f61643b6740 1 Processor -- start 2023-11-04T01:40:03.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f61643b6740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1b850 0x557d2ba33c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f61643b6740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2ba1bc30 0x557d2ba335b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f61643b6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba21f30 0x557d2ba208a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f61643b6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2b95a8b0 con 0x557d2ba21f30 2023-11-04T01:40:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f61643b6740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2b914c80 con 0x557d2ba1b850 2023-11-04T01:40:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f61643b6740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d2b914920 con 0x557d2ba1bc30 2023-11-04T01:40:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f61643b6740 10 client.0 _ll_register_callbacks cb 0x557d2b66cac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f615b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba21f30 0x557d2ba208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f615b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba21f30 0x557d2ba208a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53490/0 (socket says 172.21.15.114:53490) 2023-11-04T01:40:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f615b7fe640 1 -- 172.21.15.114:0/3594678962 learned_addr learned my addr 172.21.15.114:0/3594678962 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f615affd640 1 --2- 172.21.15.114:0/3594678962 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1b850 0x557d2ba33c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f6153fff640 1 --2- 172.21.15.114:0/3594678962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2ba1bc30 0x557d2ba335b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f615b7fe640 1 -- 172.21.15.114:0/3594678962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2ba1bc30 msgr2=0x557d2ba335b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f615b7fe640 1 --2- 172.21.15.114:0/3594678962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2ba1bc30 0x557d2ba335b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f615b7fe640 1 -- 172.21.15.114:0/3594678962 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1b850 msgr2=0x557d2ba33c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f615b7fe640 1 --2- 172.21.15.114:0/3594678962 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1b850 0x557d2ba33c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f615b7fe640 1 -- 172.21.15.114:0/3594678962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6148003520 con 0x557d2ba21f30 2023-11-04T01:40:03.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f615b7fe640 1 --2- 172.21.15.114:0/3594678962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba21f30 0x557d2ba208a0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f6154012900 tx=0x7f6154012dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ea4b6b6e538269 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f6139ffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:40:03.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.180+0000 7f6139ffb640 1 -- 172.21.15.114:0/3594678962 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615400e040 con 0x557d2ba21f30 2023-11-04T01:40:03.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.181+0000 7f61643b6740 1 -- 172.21.15.114:0/3594678962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557d2b906bf0 con 0x557d2ba21f30 2023-11-04T01:40:03.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.181+0000 7f6139ffb640 1 -- 172.21.15.114:0/3594678962 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f6154007c20 con 0x557d2ba21f30 2023-11-04T01:40:03.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.181+0000 7f6139ffb640 1 -- 172.21.15.114:0/3594678962 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6154007de0 con 0x557d2ba21f30 2023-11-04T01:40:03.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.181+0000 7f61643b6740 10 client.7671 fetch_fsmap learned FSMap version 46 2023-11-04T01:40:03.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.181+0000 7f61643b6740 1 -- 172.21.15.114:0/3594678962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x557d2b958f30 con 0x557d2ba21f30 2023-11-04T01:40:03.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.181+0000 7f6139ffb640 1 -- 172.21.15.114:0/3594678962 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557d2b906bf0 con 0x557d2ba21f30 2023-11-04T01:40:03.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.181+0000 7f6139ffb640 1 -- 172.21.15.114:0/3594678962 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 46) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f6154014040 con 0x557d2ba21f30 2023-11-04T01:40:03.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.181+0000 7f61643b6740 10 client.7671 fetch_fsmap finished waiting for FSMap version 46 2023-11-04T01:40:03.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.181+0000 7f61643b6740 10 client.7671 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:40:03.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.181+0000 7f61643b6740 20 client.7671 populate_metadata read hostname 'smithi114' 2023-11-04T01:40:03.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.181+0000 7f61643b6740 1 --2- 172.21.15.114:0/3594678962 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x557d2ba320a0 0x557d2ba56fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.181+0000 7f61643b6740 4 client.7671 mds_command: new command op to 6298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:03.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.181+0000 7f61643b6740 1 -- 172.21.15.114:0/3594678962 --> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557d2b953890 con 0x557d2ba320a0 2023-11-04T01:40:03.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.181+0000 7f615affd640 1 --2- 172.21.15.114:0/3594678962 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x557d2ba320a0 0x557d2ba56fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.182+0000 7f6139ffb640 10 client.7671 ms_handle_connect on v2:172.21.15.141:6832/1296600989 2023-11-04T01:40:03.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.182+0000 7f615affd640 1 --2- 172.21.15.114:0/3594678962 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x557d2ba320a0 0x557d2ba56fb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8acef9ee09bb62b9 server_cookie=985ece4f0efc77ac in_seq=0 out_seq=0 2023-11-04T01:40:03.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.182+0000 7f6139ffb640 1 -- 172.21.15.114:0/3594678962 <== mds.1 v2:172.21.15.141:6832/1296600989 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557d2b953890 con 0x557d2ba320a0 2023-11-04T01:40:03.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.182+0000 7f6139ffb640 10 client.7671 handle_command_reply: tid=0 2023-11-04T01:40:03.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.182+0000 7f61643b6740 1 client.7671 shutdown 2023-11-04T01:40:03.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.182+0000 7f61643b6740 1 -- 172.21.15.114:0/3594678962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba21f30 msgr2=0x557d2ba208a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.182+0000 7f61643b6740 1 --2- 172.21.15.114:0/3594678962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba21f30 0x557d2ba208a0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f6154012900 tx=0x7f6154012dc0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.182+0000 7f61643b6740 1 -- 172.21.15.114:0/3594678962 shutdown_connections 2023-11-04T01:40:03.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.182+0000 7f61643b6740 1 --2- 172.21.15.114:0/3594678962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba21f30 0x557d2ba208a0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.182+0000 7f61643b6740 1 --2- 172.21.15.114:0/3594678962 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2ba1bc30 0x557d2ba335b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.182+0000 7f61643b6740 1 --2- 172.21.15.114:0/3594678962 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x557d2ba320a0 0x557d2ba56fb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.182+0000 7f6139ffb640 0 client.7671 ms_handle_reset on v2:172.21.15.141:6832/1296600989 2023-11-04T01:40:03.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.182+0000 7f61643b6740 1 --2- 172.21.15.114:0/3594678962 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1b850 0x557d2ba33c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.182+0000 7f61643b6740 1 -- 172.21.15.114:0/3594678962 >> 172.21.15.114:0/3594678962 conn(0x557d2b9eec90 msgr2=0x557d2ba3a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.182+0000 7f61643b6740 1 -- 172.21.15.114:0/3594678962 shutdown_connections 2023-11-04T01:40:03.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.182+0000 7f61643b6740 1 -- 172.21.15.114:0/3594678962 wait complete. 2023-11-04T01:40:03.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.183+0000 7f61643b6740 20 client.7671 trim_cache size 0 max 16384 2023-11-04T01:40:03.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.198+0000 7f61643b6740 1 Processor -- start 2023-11-04T01:40:03.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.198+0000 7f61643b6740 1 -- start start 2023-11-04T01:40:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f61643b6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2ba212c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f61643b6740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1bc30 0x557d2ba21800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f61643b6740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2ba21f30 0x557d2ba5b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f61643b6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2b8da280 con 0x557d2ba1b850 2023-11-04T01:40:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f61643b6740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2b9f4430 con 0x557d2ba1bc30 2023-11-04T01:40:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f61643b6740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d2ba3d490 con 0x557d2ba21f30 2023-11-04T01:40:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f615affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2ba212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f615affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2ba212c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53504/0 (socket says 172.21.15.114:53504) 2023-11-04T01:40:03.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f615affd640 1 -- 172.21.15.114:0/2153714878 learned_addr learned my addr 172.21.15.114:0/2153714878 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:03.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f615affd640 1 -- 172.21.15.114:0/2153714878 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2ba21f30 msgr2=0x557d2ba5b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f615affd640 1 --2- 172.21.15.114:0/2153714878 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2ba21f30 0x557d2ba5b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f615affd640 1 -- 172.21.15.114:0/2153714878 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1bc30 msgr2=0x557d2ba21800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f615affd640 1 --2- 172.21.15.114:0/2153714878 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1bc30 0x557d2ba21800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f615affd640 1 -- 172.21.15.114:0/2153714878 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d2b8f6d10 con 0x557d2ba1b850 2023-11-04T01:40:03.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f615affd640 1 --2- 172.21.15.114:0/2153714878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2ba212c0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f614c000c00 tx=0x7f614c03f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1d3dda751c18d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f61517fa640 1 -- 172.21.15.114:0/2153714878 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c049040 con 0x557d2ba1b850 2023-11-04T01:40:03.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f61517fa640 1 -- 172.21.15.114:0/2153714878 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c056d00 con 0x557d2ba1b850 2023-11-04T01:40:03.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.199+0000 7f61517fa640 1 -- 172.21.15.114:0/2153714878 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c0565a0 con 0x557d2ba1b850 2023-11-04T01:40:03.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.200+0000 7f61643b6740 1 -- 172.21.15.114:0/2153714878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 msgr2=0x557d2ba212c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.200+0000 7f61643b6740 1 --2- 172.21.15.114:0/2153714878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2ba212c0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f614c000c00 tx=0x7f614c03f000 comp rx=0 tx=0).stop 2023-11-04T01:40:03.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.200+0000 7f61643b6740 1 -- 172.21.15.114:0/2153714878 shutdown_connections 2023-11-04T01:40:03.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.200+0000 7f61643b6740 1 --2- 172.21.15.114:0/2153714878 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2ba21f30 0x557d2ba5b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.200+0000 7f61643b6740 1 --2- 172.21.15.114:0/2153714878 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1bc30 0x557d2ba21800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.200+0000 7f61643b6740 1 --2- 172.21.15.114:0/2153714878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2ba212c0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.200+0000 7f61643b6740 1 -- 172.21.15.114:0/2153714878 >> 172.21.15.114:0/2153714878 conn(0x557d2b9eec90 msgr2=0x557d2ba1eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.200+0000 7f61643b6740 1 -- 172.21.15.114:0/2153714878 shutdown_connections 2023-11-04T01:40:03.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.200+0000 7f61643b6740 1 -- 172.21.15.114:0/2153714878 wait complete. 2023-11-04T01:40:03.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.200+0000 7f61643b6740 1 -- start start 2023-11-04T01:40:03.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.200+0000 7f61643b6740 1 Processor -- start 2023-11-04T01:40:03.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f61643b6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2ba34760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f61643b6740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1bc30 0x557d2ba34ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f61643b6740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2ba21f30 0x557d2baa3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f61643b6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2baa4900 con 0x557d2ba1b850 2023-11-04T01:40:03.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f61643b6740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2ba4c980 con 0x557d2ba1bc30 2023-11-04T01:40:03.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f61643b6740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d2ba39210 con 0x557d2ba21f30 2023-11-04T01:40:03.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f61643b6740 10 client.0 _ll_register_callbacks cb 0x7f61480036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:03.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f615affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2ba34760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f615affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2ba34760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53512/0 (socket says 172.21.15.114:53512) 2023-11-04T01:40:03.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f615affd640 1 -- 172.21.15.114:0/4237730086 learned_addr learned my addr 172.21.15.114:0/4237730086 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:03.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f6153fff640 1 --2- 172.21.15.114:0/4237730086 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1bc30 0x557d2ba34ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f615b7fe640 1 --2- 172.21.15.114:0/4237730086 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2ba21f30 0x557d2baa3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f615affd640 1 -- 172.21.15.114:0/4237730086 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2ba21f30 msgr2=0x557d2baa3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f615affd640 1 --2- 172.21.15.114:0/4237730086 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2ba21f30 0x557d2baa3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f615affd640 1 -- 172.21.15.114:0/4237730086 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1bc30 msgr2=0x557d2ba34ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f615affd640 1 --2- 172.21.15.114:0/4237730086 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1bc30 0x557d2ba34ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f615affd640 1 -- 172.21.15.114:0/4237730086 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d2b91dca0 con 0x557d2ba1b850 2023-11-04T01:40:03.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.201+0000 7f6153fff640 1 --2- 172.21.15.114:0/4237730086 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1bc30 0x557d2ba34ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:03.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f615affd640 1 --2- 172.21.15.114:0/4237730086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2ba34760 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f614c00c270 tx=0x7f614c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900078905dd72a86 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f6139ffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:40:03.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f6139ffb640 1 -- 172.21.15.114:0/4237730086 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c049070 con 0x557d2ba1b850 2023-11-04T01:40:03.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f6139ffb640 1 -- 172.21.15.114:0/4237730086 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f614c0567b0 con 0x557d2ba1b850 2023-11-04T01:40:03.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f61643b6740 1 -- 172.21.15.114:0/4237730086 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557d2ba101e0 con 0x557d2ba1b850 2023-11-04T01:40:03.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f6139ffb640 1 -- 172.21.15.114:0/4237730086 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f614c056b80 con 0x557d2ba1b850 2023-11-04T01:40:03.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f61643b6740 10 client.7677 fetch_fsmap learned FSMap version 46 2023-11-04T01:40:03.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f61643b6740 1 -- 172.21.15.114:0/4237730086 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x557d2b91c500 con 0x557d2ba1b850 2023-11-04T01:40:03.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f6139ffb640 1 -- 172.21.15.114:0/4237730086 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c068070 con 0x557d2ba1b850 2023-11-04T01:40:03.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f6139ffb640 1 -- 172.21.15.114:0/4237730086 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 46) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f614c007020 con 0x557d2ba1b850 2023-11-04T01:40:03.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f61643b6740 10 client.7677 fetch_fsmap finished waiting for FSMap version 46 2023-11-04T01:40:03.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f61643b6740 10 client.7677 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:40:03.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f61643b6740 20 client.7677 populate_metadata read hostname 'smithi114' 2023-11-04T01:40:03.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f61643b6740 1 --2- 172.21.15.114:0/4237730086 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x557d2ba320a0 0x557d2ba38040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f61643b6740 4 client.7677 mds_command: new command op to 6298 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:03.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f61643b6740 1 -- 172.21.15.114:0/4237730086 --> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f614c001630 con 0x557d2ba320a0 2023-11-04T01:40:03.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.202+0000 7f6153fff640 1 --2- 172.21.15.114:0/4237730086 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x557d2ba320a0 0x557d2ba38040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f6139ffb640 10 client.7677 ms_handle_connect on v2:172.21.15.141:6832/1296600989 2023-11-04T01:40:03.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f6153fff640 1 --2- 172.21.15.114:0/4237730086 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x557d2ba320a0 0x557d2ba38040 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a2efc336ca360593 server_cookie=bb1791f424831b47 in_seq=0 out_seq=0 2023-11-04T01:40:03.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f6139ffb640 1 -- 172.21.15.114:0/4237730086 <== mds.1 v2:172.21.15.141:6832/1296600989 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x7f614c001630 con 0x557d2ba320a0 2023-11-04T01:40:03.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f6139ffb640 10 client.7677 handle_command_reply: tid=0 2023-11-04T01:40:03.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f61643b6740 1 client.7677 shutdown 2023-11-04T01:40:03.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f61643b6740 1 -- 172.21.15.114:0/4237730086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 msgr2=0x557d2ba34760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f61643b6740 1 --2- 172.21.15.114:0/4237730086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2ba34760 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f614c00c270 tx=0x7f614c02e070 comp rx=0 tx=0).stop 2023-11-04T01:40:03.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f61643b6740 1 -- 172.21.15.114:0/4237730086 shutdown_connections 2023-11-04T01:40:03.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f61643b6740 1 --2- 172.21.15.114:0/4237730086 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557d2ba21f30 0x557d2baa3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f61643b6740 1 --2- 172.21.15.114:0/4237730086 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x557d2ba320a0 0x557d2ba38040 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f61643b6740 1 --2- 172.21.15.114:0/4237730086 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557d2ba1bc30 0x557d2ba34ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f6139ffb640 0 client.7677 ms_handle_reset on v2:172.21.15.141:6832/1296600989 2023-11-04T01:40:03.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f61643b6740 1 --2- 172.21.15.114:0/4237730086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557d2ba1b850 0x557d2ba34760 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f61643b6740 1 -- 172.21.15.114:0/4237730086 >> 172.21.15.114:0/4237730086 conn(0x557d2b9eec90 msgr2=0x557d2ba212c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f61643b6740 1 -- 172.21.15.114:0/4237730086 shutdown_connections 2023-11-04T01:40:03.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f61643b6740 1 -- 172.21.15.114:0/4237730086 wait complete. 2023-11-04T01:40:03.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.203+0000 7f61643b6740 20 client.7677 trim_cache size 0 max 16384 2023-11-04T01:40:03.212 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:40:03.212 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:40:03.212 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 1, 2023-11-04T01:40:03.212 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 6298, 2023-11-04T01:40:03.212 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:40:03.213 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:40:03.213 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:40:03.213 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 2.62943894, 2023-11-04T01:40:03.213 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 46, 2023-11-04T01:40:03.213 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 96, 2023-11-04T01:40:03.213 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 96, 2023-11-04T01:40:03.213 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 17.201800401 2023-11-04T01:40:03.213 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:40:03.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.204+0000 7f616174c640 1 -- 172.21.15.114:0/4106099177 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f613c06aea0 msgr2=0x7f613c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.204+0000 7f616174c640 1 --2- 172.21.15.114:0/4106099177 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f613c06aea0 0x7f613c06d360 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f614c034000 tx=0x7f614c009030 comp rx=0 tx=0).stop 2023-11-04T01:40:03.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.204+0000 7f616174c640 1 -- 172.21.15.114:0/4106099177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f615c15d990 msgr2=0x7f615c0c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.204+0000 7f616174c640 1 --2- 172.21.15.114:0/4106099177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f615c15d990 0x7f615c0c75b0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f614400e7d0 tx=0x7f614400ec90 comp rx=0 tx=0).stop 2023-11-04T01:40:03.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.204+0000 7f616174c640 1 -- 172.21.15.114:0/4106099177 shutdown_connections 2023-11-04T01:40:03.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.204+0000 7f616174c640 1 --2- 172.21.15.114:0/4106099177 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f613c06aea0 0x7f613c06d360 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.204+0000 7f616174c640 1 --2- 172.21.15.114:0/4106099177 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f615c0c7af0 0x7f615c1545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.204+0000 7f616174c640 1 --2- 172.21.15.114:0/4106099177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f615c15d990 0x7f615c0c75b0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.204+0000 7f616174c640 1 --2- 172.21.15.114:0/4106099177 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f61480039a0 0x7f615c149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.204+0000 7f616174c640 1 -- 172.21.15.114:0/4106099177 >> 172.21.15.114:0/4106099177 conn(0x7f615c0cf880 msgr2=0x7f615c15ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.204+0000 7f616174c640 1 -- 172.21.15.114:0/4106099177 shutdown_connections 2023-11-04T01:40:03.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.204+0000 7f616174c640 1 -- 172.21.15.114:0/4106099177 wait complete. 2023-11-04T01:40:03.216 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:40:03.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.314+0000 7efd29434640 1 Processor -- start 2023-11-04T01:40:03.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.314+0000 7efd29434640 1 -- start start 2023-11-04T01:40:03.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.315+0000 7efd29434640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd240cd6d0 0x7efd24161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.315+0000 7efd29434640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efd240b4880 0x7efd240b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.315+0000 7efd29434640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd240cde60 con 0x7efd24153e60 2023-11-04T01:40:03.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.315+0000 7efd29434640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd24160f90 con 0x7efd240b4880 2023-11-04T01:40:03.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.315+0000 7efd29434640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd240b51e0 con 0x7efd240cd6d0 2023-11-04T01:40:03.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.315+0000 7efd237fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efd240b4880 0x7efd240b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.315+0000 7efd237fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efd240b4880 0x7efd240b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53522/0 (socket says 172.21.15.114:53522) 2023-11-04T01:40:03.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.315+0000 7efd237fe640 1 -- 172.21.15.114:0/2307021292 learned_addr learned my addr 172.21.15.114:0/2307021292 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:03.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.315+0000 7efd227fc640 1 --2- 172.21.15.114:0/2307021292 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd240cd6d0 0x7efd24161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.315+0000 7efd237fe640 1 -- 172.21.15.114:0/2307021292 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd240cd6d0 msgr2=0x7efd24161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.315+0000 7efd237fe640 1 --2- 172.21.15.114:0/2307021292 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd240cd6d0 0x7efd24161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.315+0000 7efd237fe640 1 -- 172.21.15.114:0/2307021292 >> v1:172.21.15.141:6789/0 conn(0x7efd24153e60 legacy=0x7efd2415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.315+0000 7efd237fe640 1 -- 172.21.15.114:0/2307021292 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd24161960 con 0x7efd240b4880 2023-11-04T01:40:03.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.316+0000 7efd237fe640 1 --2- 172.21.15.114:0/2307021292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd240b4880 0x7efd240b4ca0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009e50 tx=0x7efd1c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bf38268b02ad29 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.316+0000 7efd21ffb640 1 -- 172.21.15.114:0/2307021292 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c02cb00 con 0x7efd240b4880 2023-11-04T01:40:03.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.316+0000 7efd21ffb640 1 -- 172.21.15.114:0/2307021292 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c02cc60 con 0x7efd240b4880 2023-11-04T01:40:03.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.316+0000 7efd21ffb640 1 -- 172.21.15.114:0/2307021292 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0343f0 con 0x7efd240b4880 2023-11-04T01:40:03.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.317+0000 7efd29434640 1 -- 172.21.15.114:0/2307021292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd240b4880 msgr2=0x7efd240b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.317+0000 7efd29434640 1 --2- 172.21.15.114:0/2307021292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd240b4880 0x7efd240b4ca0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009e50 tx=0x7efd1c02bf60 comp rx=0 tx=0).stop 2023-11-04T01:40:03.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.317+0000 7efd29434640 1 -- 172.21.15.114:0/2307021292 shutdown_connections 2023-11-04T01:40:03.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.317+0000 7efd29434640 1 --2- 172.21.15.114:0/2307021292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd240b4880 0x7efd240b4ca0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.317+0000 7efd29434640 1 --2- 172.21.15.114:0/2307021292 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd240cd6d0 0x7efd24161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.317+0000 7efd29434640 1 -- 172.21.15.114:0/2307021292 >> 172.21.15.114:0/2307021292 conn(0x7efd240cf880 msgr2=0x7efd240cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.317+0000 7efd29434640 1 -- 172.21.15.114:0/2307021292 shutdown_connections 2023-11-04T01:40:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.317+0000 7efd29434640 1 -- 172.21.15.114:0/2307021292 wait complete. 2023-11-04T01:40:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.318+0000 7efd29434640 1 Processor -- start 2023-11-04T01:40:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.318+0000 7efd29434640 1 -- start start 2023-11-04T01:40:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd29434640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efd240b4880 0x7efd24159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd29434640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd240cd6d0 0x7efd240c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd29434640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd24153e60 0x7efd240ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd29434640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd240ca410 con 0x7efd24153e60 2023-11-04T01:40:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd29434640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd240cb6a0 con 0x7efd240b4880 2023-11-04T01:40:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd29434640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd240cd3e0 con 0x7efd240cd6d0 2023-11-04T01:40:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd237fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd24153e60 0x7efd240ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd237fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd24153e60 0x7efd240ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53538/0 (socket says 172.21.15.114:53538) 2023-11-04T01:40:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd237fe640 1 -- 172.21.15.114:0/303334625 learned_addr learned my addr 172.21.15.114:0/303334625 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:03.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd22ffd640 1 --2- 172.21.15.114:0/303334625 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efd240b4880 0x7efd24159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd227fc640 1 --2- 172.21.15.114:0/303334625 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd240cd6d0 0x7efd240c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd237fe640 1 -- 172.21.15.114:0/303334625 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd240cd6d0 msgr2=0x7efd240c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd237fe640 1 --2- 172.21.15.114:0/303334625 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd240cd6d0 0x7efd240c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd237fe640 1 -- 172.21.15.114:0/303334625 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efd240b4880 msgr2=0x7efd24159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd237fe640 1 --2- 172.21.15.114:0/303334625 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efd240b4880 0x7efd24159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd237fe640 1 -- 172.21.15.114:0/303334625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c009b30 con 0x7efd24153e60 2023-11-04T01:40:03.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd22ffd640 1 --2- 172.21.15.114:0/303334625 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efd240b4880 0x7efd24159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:03.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.319+0000 7efd237fe640 1 --2- 172.21.15.114:0/303334625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd24153e60 0x7efd240ccea0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009f70 tx=0x7efd1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.320+0000 7efd0b7fe640 1 -- 172.21.15.114:0/303334625 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c009510 con 0x7efd24153e60 2023-11-04T01:40:03.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.320+0000 7efd0b7fe640 1 -- 172.21.15.114:0/303334625 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c03e450 con 0x7efd24153e60 2023-11-04T01:40:03.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.320+0000 7efd29434640 1 -- 172.21.15.114:0/303334625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd240ca600 con 0x7efd24153e60 2023-11-04T01:40:03.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.320+0000 7efd0b7fe640 1 -- 172.21.15.114:0/303334625 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c03e800 con 0x7efd24153e60 2023-11-04T01:40:03.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.320+0000 7efd29434640 1 -- 172.21.15.114:0/303334625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd240cabc0 con 0x7efd24153e60 2023-11-04T01:40:03.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.321+0000 7efd0b7fe640 1 -- 172.21.15.114:0/303334625 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efd1c03e960 con 0x7efd24153e60 2023-11-04T01:40:03.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.321+0000 7efd0b7fe640 1 --2- 172.21.15.114:0/303334625 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efd1006ae70 0x7efd1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.321+0000 7efd0b7fe640 1 -- 172.21.15.114:0/303334625 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7efd1c0ac8b0 con 0x7efd24153e60 2023-11-04T01:40:03.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.321+0000 7efd22ffd640 1 --2- 172.21.15.114:0/303334625 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efd1006ae70 0x7efd1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.322+0000 7efd22ffd640 1 --2- 172.21.15.114:0/303334625 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efd1006ae70 0x7efd1006d330 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7efd14001660 tx=0x7efd14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.323+0000 7efd2bfc6740 1 Processor -- start 2023-11-04T01:40:03.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.323+0000 7efd2bfc6740 1 -- start start 2023-11-04T01:40:03.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.323+0000 7efd2bfc6740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbf5850 0x557bcbbc8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.323+0000 7efd2bfc6740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbf5c30 0x557bcbbf85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.323+0000 7efd2bfc6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbc8c90 0x557bcbbf8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.323+0000 7efd2bfc6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bcbad9740 con 0x557bcbbc8c90 2023-11-04T01:40:03.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.323+0000 7efd2bfc6740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bcbb3b8d0 con 0x557bcbbf5c30 2023-11-04T01:40:03.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.323+0000 7efd2bfc6740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x557bcbb38fc0 con 0x557bcbbf5850 2023-11-04T01:40:03.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.324+0000 7efd237fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbc8c90 0x557bcbbf8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.324+0000 7efd237fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbc8c90 0x557bcbbf8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53546/0 (socket says 172.21.15.114:53546) 2023-11-04T01:40:03.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.324+0000 7efd237fe640 1 -- 172.21.15.114:0/232609954 learned_addr learned my addr 172.21.15.114:0/232609954 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:03.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.324+0000 7efd22ffd640 1 --2- 172.21.15.114:0/232609954 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbf5850 0x557bcbbc8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.324+0000 7efd227fc640 1 --2- 172.21.15.114:0/232609954 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbf5c30 0x557bcbbf85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.324+0000 7efd237fe640 1 -- 172.21.15.114:0/232609954 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbf5850 msgr2=0x557bcbbc8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.324+0000 7efd237fe640 1 --2- 172.21.15.114:0/232609954 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbf5850 0x557bcbbc8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.324+0000 7efd237fe640 1 -- 172.21.15.114:0/232609954 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbf5c30 msgr2=0x557bcbbf85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.324+0000 7efd237fe640 1 --2- 172.21.15.114:0/232609954 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbf5c30 0x557bcbbf85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.324+0000 7efd237fe640 1 -- 172.21.15.114:0/232609954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bcbaf7ca0 con 0x557bcbbc8c90 2023-11-04T01:40:03.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.324+0000 7efd237fe640 1 --2- 172.21.15.114:0/232609954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbc8c90 0x557bcbbf8b20 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7efd1c077650 tx=0x7efd1c03f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f213a2e1060a027c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.324+0000 7efd08ff9640 1 -- 172.21.15.114:0/232609954 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0833a0 con 0x557bcbbc8c90 2023-11-04T01:40:03.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.324+0000 7efd08ff9640 1 -- 172.21.15.114:0/232609954 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c0794f0 con 0x557bcbbc8c90 2023-11-04T01:40:03.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.324+0000 7efd08ff9640 1 -- 172.21.15.114:0/232609954 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c03ec10 con 0x557bcbbc8c90 2023-11-04T01:40:03.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.325+0000 7efd2bfc6740 1 -- 172.21.15.114:0/232609954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbc8c90 msgr2=0x557bcbbf8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.325+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/232609954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbc8c90 0x557bcbbf8b20 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7efd1c077650 tx=0x7efd1c03f000 comp rx=0 tx=0).stop 2023-11-04T01:40:03.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.325+0000 7efd2bfc6740 1 -- 172.21.15.114:0/232609954 shutdown_connections 2023-11-04T01:40:03.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.325+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/232609954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbc8c90 0x557bcbbf8b20 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.325+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/232609954 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbf5c30 0x557bcbbf85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.325+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/232609954 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbf5850 0x557bcbbc8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.325+0000 7efd2bfc6740 1 -- 172.21.15.114:0/232609954 >> 172.21.15.114:0/232609954 conn(0x557bcbbcaa60 msgr2=0x557bcbc135e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.325+0000 7efd2bfc6740 1 -- 172.21.15.114:0/232609954 shutdown_connections 2023-11-04T01:40:03.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.325+0000 7efd2bfc6740 1 -- 172.21.15.114:0/232609954 wait complete. 2023-11-04T01:40:03.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.325+0000 7efd2bfc6740 1 -- start start 2023-11-04T01:40:03.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.326+0000 7efd2bfc6740 1 Processor -- start 2023-11-04T01:40:03.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.326+0000 7efd2bfc6740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbf5850 0x557bcbbee2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.326+0000 7efd2bfc6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5c30 0x557bcbbe29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.326+0000 7efd2bfc6740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbed8d0 0x557bcbbf0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.326+0000 7efd2bfc6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bcbb348b0 con 0x557bcbbf5c30 2023-11-04T01:40:03.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.326+0000 7efd2bfc6740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bcbaeec80 con 0x557bcbbf5850 2023-11-04T01:40:03.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.326+0000 7efd2bfc6740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x557bcbaee920 con 0x557bcbbed8d0 2023-11-04T01:40:03.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.326+0000 7efd2bfc6740 10 client.0 _ll_register_callbacks cb 0x557bcb846ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:03.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.326+0000 7efd227fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5c30 0x557bcbbe29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.326+0000 7efd227fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5c30 0x557bcbbe29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53560/0 (socket says 172.21.15.114:53560) 2023-11-04T01:40:03.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.326+0000 7efd227fc640 1 -- 172.21.15.114:0/3708127048 learned_addr learned my addr 172.21.15.114:0/3708127048 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.326+0000 7efd237fe640 1 --2- 172.21.15.114:0/3708127048 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbed8d0 0x557bcbbf0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.326+0000 7efd22ffd640 1 --2- 172.21.15.114:0/3708127048 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbf5850 0x557bcbbee2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd227fc640 1 -- 172.21.15.114:0/3708127048 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbed8d0 msgr2=0x557bcbbf0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd227fc640 1 --2- 172.21.15.114:0/3708127048 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbed8d0 0x557bcbbf0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd227fc640 1 -- 172.21.15.114:0/3708127048 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbf5850 msgr2=0x557bcbbee2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd227fc640 1 --2- 172.21.15.114:0/3708127048 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbf5850 0x557bcbbee2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd227fc640 1 -- 172.21.15.114:0/3708127048 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd240cabc0 con 0x557bcbbf5c30 2023-11-04T01:40:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd227fc640 1 --2- 172.21.15.114:0/3708127048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5c30 0x557bcbbe29c0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7efd1800bf70 tx=0x7efd180116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6452163381187489 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:40:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd01ffb640 1 -- 172.21.15.114:0/3708127048 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd18011ec0 con 0x557bcbbf5c30 2023-11-04T01:40:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd2bfc6740 1 -- 172.21.15.114:0/3708127048 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557bcbae0bf0 con 0x557bcbbf5c30 2023-11-04T01:40:03.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd01ffb640 1 -- 172.21.15.114:0/3708127048 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7efd18004020 con 0x557bcbbf5c30 2023-11-04T01:40:03.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd01ffb640 1 -- 172.21.15.114:0/3708127048 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd180041e0 con 0x557bcbbf5c30 2023-11-04T01:40:03.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd2bfc6740 10 client.7689 fetch_fsmap learned FSMap version 46 2023-11-04T01:40:03.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd2bfc6740 1 -- 172.21.15.114:0/3708127048 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x557bcbb32f30 con 0x557bcbbf5c30 2023-11-04T01:40:03.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd01ffb640 1 -- 172.21.15.114:0/3708127048 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557bcbae0bf0 con 0x557bcbbf5c30 2023-11-04T01:40:03.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd01ffb640 1 -- 172.21.15.114:0/3708127048 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 46) v1 ==== 3306+0+0 (secure 0 0 0) 0x7efd18004340 con 0x557bcbbf5c30 2023-11-04T01:40:03.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd2bfc6740 10 client.7689 fetch_fsmap finished waiting for FSMap version 46 2023-11-04T01:40:03.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd2bfc6740 10 client.7689 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:40:03.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd2bfc6740 20 client.7689 populate_metadata read hostname 'smithi114' 2023-11-04T01:40:03.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/3708127048 >> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] conn(0x557bcbbf65c0 0x557bcbbf69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd2bfc6740 4 client.7689 mds_command: new command op to 7431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:03.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd2bfc6740 1 -- 172.21.15.114:0/3708127048 --> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557bcbb2d890 con 0x557bcbbf65c0 2023-11-04T01:40:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.327+0000 7efd22ffd640 1 --2- 172.21.15.114:0/3708127048 >> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] conn(0x557bcbbf65c0 0x557bcbbf69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.328+0000 7efd22ffd640 1 --2- 172.21.15.114:0/3708127048 >> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] conn(0x557bcbbf65c0 0x557bcbbf69a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73799ef89d856c9 server_cookie=ae7458b67709c864 in_seq=0 out_seq=0 2023-11-04T01:40:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.328+0000 7efd01ffb640 10 client.7689 ms_handle_connect on v2:172.21.15.114:6834/3780323525 2023-11-04T01:40:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.328+0000 7efd01ffb640 1 -- 172.21.15.114:0/3708127048 <== mds.0 v2:172.21.15.114:6834/3780323525 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557bcbb2d890 con 0x557bcbbf65c0 2023-11-04T01:40:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.328+0000 7efd01ffb640 10 client.7689 handle_command_reply: tid=0 2023-11-04T01:40:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.328+0000 7efd2bfc6740 1 client.7689 shutdown 2023-11-04T01:40:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.328+0000 7efd2bfc6740 1 -- 172.21.15.114:0/3708127048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5c30 msgr2=0x557bcbbe29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.328+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/3708127048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5c30 0x557bcbbe29c0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7efd1800bf70 tx=0x7efd180116f0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.328+0000 7efd2bfc6740 1 -- 172.21.15.114:0/3708127048 shutdown_connections 2023-11-04T01:40:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.328+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/3708127048 >> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] conn(0x557bcbbf65c0 0x557bcbbf69a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.328+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/3708127048 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbed8d0 0x557bcbbf0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.328+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/3708127048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5c30 0x557bcbbe29c0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.328+0000 7efd01ffb640 0 client.7689 ms_handle_reset on v2:172.21.15.114:6834/3780323525 2023-11-04T01:40:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.328+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/3708127048 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbf5850 0x557bcbbee2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.328+0000 7efd2bfc6740 1 -- 172.21.15.114:0/3708127048 >> 172.21.15.114:0/3708127048 conn(0x557bcbbc8c90 msgr2=0x557bcbbcc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.329+0000 7efd2bfc6740 1 -- 172.21.15.114:0/3708127048 shutdown_connections 2023-11-04T01:40:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.329+0000 7efd2bfc6740 1 -- 172.21.15.114:0/3708127048 wait complete. 2023-11-04T01:40:03.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.329+0000 7efd2bfc6740 20 client.7689 trim_cache size 0 max 16384 2023-11-04T01:40:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.344+0000 7efd2bfc6740 1 Processor -- start 2023-11-04T01:40:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.344+0000 7efd2bfc6740 1 -- start start 2023-11-04T01:40:03.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd2bfc6740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbed8d0 0x557bcbbc84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd2bfc6740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbf5850 0x557bcbbee1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd2bfc6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5c30 0x557bcbbcdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd2bfc6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bcbab4280 con 0x557bcbbf5c30 2023-11-04T01:40:03.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd2bfc6740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bcbc26410 con 0x557bcbbf5850 2023-11-04T01:40:03.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd2bfc6740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x557bcbb0fea0 con 0x557bcbbed8d0 2023-11-04T01:40:03.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd237fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5c30 0x557bcbbcdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd237fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5c30 0x557bcbbcdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53562/0 (socket says 172.21.15.114:53562) 2023-11-04T01:40:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd237fe640 1 -- 172.21.15.114:0/1764664959 learned_addr learned my addr 172.21.15.114:0/1764664959 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd237fe640 1 -- 172.21.15.114:0/1764664959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbed8d0 msgr2=0x557bcbbc84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd237fe640 1 --2- 172.21.15.114:0/1764664959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbed8d0 0x557bcbbc84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd237fe640 1 -- 172.21.15.114:0/1764664959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbf5850 msgr2=0x557bcbbee1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd237fe640 1 --2- 172.21.15.114:0/1764664959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbf5850 0x557bcbbee1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd237fe640 1 -- 172.21.15.114:0/1764664959 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bcbbf87a0 con 0x557bcbbf5c30 2023-11-04T01:40:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd237fe640 1 --2- 172.21.15.114:0/1764664959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5c30 0x557bcbbcdc30 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7efd1c077650 tx=0x7efd1c081070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9477cf6139c33a85 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd097fa640 1 -- 172.21.15.114:0/1764664959 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c077490 con 0x557bcbbf5c30 2023-11-04T01:40:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd097fa640 1 -- 172.21.15.114:0/1764664959 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c0a8070 con 0x557bcbbf5c30 2023-11-04T01:40:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.345+0000 7efd097fa640 1 -- 172.21.15.114:0/1764664959 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0833a0 con 0x557bcbbf5c30 2023-11-04T01:40:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.346+0000 7efd2bfc6740 1 -- 172.21.15.114:0/1764664959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5c30 msgr2=0x557bcbbcdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.346+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/1764664959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5c30 0x557bcbbcdc30 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7efd1c077650 tx=0x7efd1c081070 comp rx=0 tx=0).stop 2023-11-04T01:40:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.346+0000 7efd2bfc6740 1 -- 172.21.15.114:0/1764664959 shutdown_connections 2023-11-04T01:40:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.346+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/1764664959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5c30 0x557bcbbcdc30 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.346+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/1764664959 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbf5850 0x557bcbbee1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.346+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/1764664959 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbed8d0 0x557bcbbc84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.346+0000 7efd2bfc6740 1 -- 172.21.15.114:0/1764664959 >> 172.21.15.114:0/1764664959 conn(0x557bcbbc8c90 msgr2=0x557bcbbed0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.346+0000 7efd2bfc6740 1 -- 172.21.15.114:0/1764664959 shutdown_connections 2023-11-04T01:40:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.346+0000 7efd2bfc6740 1 -- 172.21.15.114:0/1764664959 wait complete. 2023-11-04T01:40:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.346+0000 7efd2bfc6740 1 -- start start 2023-11-04T01:40:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.347+0000 7efd2bfc6740 1 Processor -- start 2023-11-04T01:40:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.347+0000 7efd2bfc6740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbed8d0 0x557bcbbf6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.347+0000 7efd2bfc6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5850 0x557bcbc7dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.347+0000 7efd2bfc6740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbf5c30 0x557bcbbe2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.347+0000 7efd2bfc6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bcbc7e620 con 0x557bcbbf5850 2023-11-04T01:40:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.347+0000 7efd2bfc6740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bcbbce1e0 con 0x557bcbbed8d0 2023-11-04T01:40:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.347+0000 7efd2bfc6740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x557bcbbf74d0 con 0x557bcbbf5c30 2023-11-04T01:40:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.347+0000 7efd2bfc6740 10 client.0 _ll_register_callbacks cb 0x7efd1c0071f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.347+0000 7efd227fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5850 0x557bcbc7dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.347+0000 7efd227fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5850 0x557bcbc7dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53566/0 (socket says 172.21.15.114:53566) 2023-11-04T01:40:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.347+0000 7efd227fc640 1 -- 172.21.15.114:0/3944533390 learned_addr learned my addr 172.21.15.114:0/3944533390 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.347+0000 7efd22ffd640 1 --2- 172.21.15.114:0/3944533390 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbed8d0 0x557bcbbf6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.347+0000 7efd237fe640 1 --2- 172.21.15.114:0/3944533390 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbf5c30 0x557bcbbe2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd227fc640 1 -- 172.21.15.114:0/3944533390 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbf5c30 msgr2=0x557bcbbe2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd227fc640 1 --2- 172.21.15.114:0/3944533390 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbf5c30 0x557bcbbe2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd227fc640 1 -- 172.21.15.114:0/3944533390 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbed8d0 msgr2=0x557bcbbf6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd227fc640 1 --2- 172.21.15.114:0/3944533390 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbed8d0 0x557bcbbf6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd227fc640 1 -- 172.21.15.114:0/3944533390 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557bcbaf7ca0 con 0x557bcbbf5850 2023-11-04T01:40:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd22ffd640 1 --2- 172.21.15.114:0/3944533390 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbed8d0 0x557bcbbf6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd227fc640 1 --2- 172.21.15.114:0/3944533390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5850 0x557bcbc7dac0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7efd18001eb0 tx=0x7efd18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca46aa57219b221f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:40:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd01ffb640 1 -- 172.21.15.114:0/3944533390 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd18011bf0 con 0x557bcbbf5850 2023-11-04T01:40:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd01ffb640 1 -- 172.21.15.114:0/3944533390 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7efd18000e40 con 0x557bcbbf5850 2023-11-04T01:40:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd2bfc6740 1 -- 172.21.15.114:0/3944533390 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd1c0794f0 con 0x557bcbbf5850 2023-11-04T01:40:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd01ffb640 1 -- 172.21.15.114:0/3944533390 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd18034070 con 0x557bcbbf5850 2023-11-04T01:40:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd2bfc6740 10 client.7695 fetch_fsmap learned FSMap version 46 2023-11-04T01:40:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd2bfc6740 1 -- 172.21.15.114:0/3944533390 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x557bcbad0d10 con 0x557bcbbf5850 2023-11-04T01:40:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd01ffb640 1 -- 172.21.15.114:0/3944533390 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c0794f0 con 0x557bcbbf5850 2023-11-04T01:40:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd01ffb640 1 -- 172.21.15.114:0/3944533390 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 46) v1 ==== 3306+0+0 (secure 0 0 0) 0x7efd18015c60 con 0x557bcbbf5850 2023-11-04T01:40:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd2bfc6740 10 client.7695 fetch_fsmap finished waiting for FSMap version 46 2023-11-04T01:40:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd2bfc6740 10 client.7695 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:40:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd2bfc6740 20 client.7695 populate_metadata read hostname 'smithi114' 2023-11-04T01:40:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/3944533390 >> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] conn(0x557bcbc75870 0x557bcbc75c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd2bfc6740 4 client.7695 mds_command: new command op to 7431 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd2bfc6740 1 -- 172.21.15.114:0/3944533390 --> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557bcbb2d5b0 con 0x557bcbc75870 2023-11-04T01:40:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.348+0000 7efd22ffd640 1 --2- 172.21.15.114:0/3944533390 >> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] conn(0x557bcbc75870 0x557bcbc75c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd01ffb640 10 client.7695 ms_handle_connect on v2:172.21.15.114:6834/3780323525 2023-11-04T01:40:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd22ffd640 1 --2- 172.21.15.114:0/3944533390 >> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] conn(0x557bcbc75870 0x557bcbc75c50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4992cb1e6260a462 server_cookie=2d5f9c8d0ac01999 in_seq=0 out_seq=0 2023-11-04T01:40:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd01ffb640 1 -- 172.21.15.114:0/3944533390 <== mds.0 v2:172.21.15.114:6834/3780323525 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x557bcbb2d5b0 con 0x557bcbc75870 2023-11-04T01:40:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd01ffb640 10 client.7695 handle_command_reply: tid=0 2023-11-04T01:40:03.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd2bfc6740 1 client.7695 shutdown 2023-11-04T01:40:03.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd2bfc6740 1 -- 172.21.15.114:0/3944533390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5850 msgr2=0x557bcbc7dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/3944533390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5850 0x557bcbc7dac0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7efd18001eb0 tx=0x7efd18004730 comp rx=0 tx=0).stop 2023-11-04T01:40:03.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd2bfc6740 1 -- 172.21.15.114:0/3944533390 shutdown_connections 2023-11-04T01:40:03.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/3944533390 >> [v2:172.21.15.114:6834/3780323525,v1:172.21.15.114:6836/3780323525] conn(0x557bcbc75870 0x557bcbc75c50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/3944533390 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x557bcbbf5c30 0x557bcbbe2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd01ffb640 0 client.7695 ms_handle_reset on v2:172.21.15.114:6834/3780323525 2023-11-04T01:40:03.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/3944533390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557bcbbf5850 0x557bcbc7dac0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd2bfc6740 1 --2- 172.21.15.114:0/3944533390 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x557bcbbed8d0 0x557bcbbf6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd2bfc6740 1 -- 172.21.15.114:0/3944533390 >> 172.21.15.114:0/3944533390 conn(0x557bcbbc8c90 msgr2=0x557bcbbc84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd2bfc6740 1 -- 172.21.15.114:0/3944533390 shutdown_connections 2023-11-04T01:40:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd2bfc6740 1 -- 172.21.15.114:0/3944533390 wait complete. 2023-11-04T01:40:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.349+0000 7efd2bfc6740 20 client.7695 trim_cache size 0 max 16384 2023-11-04T01:40:03.364 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:40:03.365 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:40:03.365 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-11-04T01:40:03.365 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 7431, 2023-11-04T01:40:03.365 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:40:03.365 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:40:03.365 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:40:03.366 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 11.248207752000001, 2023-11-04T01:40:03.366 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 46, 2023-11-04T01:40:03.366 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 96, 2023-11-04T01:40:03.366 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 96, 2023-11-04T01:40:03.366 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 17.356794709999999 2023-11-04T01:40:03.367 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:40:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.350+0000 7efd29434640 1 -- 172.21.15.114:0/303334625 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efd1006ae70 msgr2=0x7efd1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.350+0000 7efd29434640 1 --2- 172.21.15.114:0/303334625 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efd1006ae70 0x7efd1006d330 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7efd14001660 tx=0x7efd14009040 comp rx=0 tx=0).stop 2023-11-04T01:40:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.350+0000 7efd29434640 1 -- 172.21.15.114:0/303334625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd24153e60 msgr2=0x7efd240ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.350+0000 7efd29434640 1 --2- 172.21.15.114:0/303334625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd24153e60 0x7efd240ccea0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009f70 tx=0x7efd1c004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.350+0000 7efd29434640 1 -- 172.21.15.114:0/303334625 shutdown_connections 2023-11-04T01:40:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.350+0000 7efd29434640 1 --2- 172.21.15.114:0/303334625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd24153e60 0x7efd240ccea0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.350+0000 7efd29434640 1 --2- 172.21.15.114:0/303334625 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efd240cd6d0 0x7efd240c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.350+0000 7efd29434640 1 --2- 172.21.15.114:0/303334625 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efd1006ae70 0x7efd1006d330 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.350+0000 7efd29434640 1 --2- 172.21.15.114:0/303334625 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efd240b4880 0x7efd24159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.350+0000 7efd29434640 1 -- 172.21.15.114:0/303334625 >> 172.21.15.114:0/303334625 conn(0x7efd240cf880 msgr2=0x7efd240d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.350+0000 7efd29434640 1 -- 172.21.15.114:0/303334625 shutdown_connections 2023-11-04T01:40:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.350+0000 7efd29434640 1 -- 172.21.15.114:0/303334625 wait complete. 2023-11-04T01:40:03.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:03.372 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/dir) 2023-11-04T01:40:03.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:03.394 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1) 2023-11-04T01:40:03.450 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.587+0000 7fe63dba9640 1 Processor -- start 2023-11-04T01:40:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.588+0000 7fe63dba9640 1 -- start start 2023-11-04T01:40:03.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.588+0000 7fe63dba9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe6380cde60 0x7fe63815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.588+0000 7fe63dba9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe63815daa0 0x7fe638157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.588+0000 7fe63dba9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe6380ce240 0x7fe638157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.588+0000 7fe63dba9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63815e5c0 con 0x7fe6380ce240 2023-11-04T01:40:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.588+0000 7fe63dba9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe638157a80 con 0x7fe63815daa0 2023-11-04T01:40:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.588+0000 7fe63dba9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63815e000 con 0x7fe6380cde60 2023-11-04T01:40:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.588+0000 7fe637fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe6380ce240 0x7fe638157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.588+0000 7fe637fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe6380ce240 0x7fe638157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53574/0 (socket says 172.21.15.114:53574) 2023-11-04T01:40:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.589+0000 7fe637fff640 1 -- 172.21.15.114:0/3201649146 learned_addr learned my addr 172.21.15.114:0/3201649146 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.589+0000 7fe636ffd640 1 --2- 172.21.15.114:0/3201649146 >> v2:172.21.15.141:3300/0 conn(0x7fe63815daa0 0x7fe638157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.589+0000 7fe6377fe640 1 --2- 172.21.15.114:0/3201649146 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe6380cde60 0x7fe63815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.589+0000 7fe637fff640 1 -- 172.21.15.114:0/3201649146 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe6380cde60 msgr2=0x7fe63815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.589+0000 7fe637fff640 1 --2- 172.21.15.114:0/3201649146 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe6380cde60 0x7fe63815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.589+0000 7fe637fff640 1 -- 172.21.15.114:0/3201649146 >> v2:172.21.15.141:3300/0 conn(0x7fe63815daa0 msgr2=0x7fe638157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.589+0000 7fe637fff640 1 --2- 172.21.15.114:0/3201649146 >> v2:172.21.15.141:3300/0 conn(0x7fe63815daa0 0x7fe638157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.589+0000 7fe637fff640 1 -- 172.21.15.114:0/3201649146 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63815e2e0 con 0x7fe6380ce240 2023-11-04T01:40:03.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.589+0000 7fe6377fe640 1 --2- 172.21.15.114:0/3201649146 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe6380cde60 0x7fe63815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:03.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.589+0000 7fe636ffd640 1 --2- 172.21.15.114:0/3201649146 >> v2:172.21.15.141:3300/0 conn(0x7fe63815daa0 0x7fe638157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:03.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.589+0000 7fe637fff640 1 --2- 172.21.15.114:0/3201649146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6380ce240 0x7fe638157540 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fe63806c7c0 tx=0x7fe63002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09c7413fca23a12 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.590+0000 7fe6367fc640 1 -- 172.21.15.114:0/3201649146 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63002ca70 con 0x7fe6380ce240 2023-11-04T01:40:03.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.590+0000 7fe6367fc640 1 -- 172.21.15.114:0/3201649146 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63002cbd0 con 0x7fe6380ce240 2023-11-04T01:40:03.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.590+0000 7fe6367fc640 1 -- 172.21.15.114:0/3201649146 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6300343f0 con 0x7fe6380ce240 2023-11-04T01:40:03.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.590+0000 7fe63dba9640 1 -- 172.21.15.114:0/3201649146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6380ce240 msgr2=0x7fe638157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.590+0000 7fe63dba9640 1 --2- 172.21.15.114:0/3201649146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6380ce240 0x7fe638157540 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fe63806c7c0 tx=0x7fe63002bed0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.590+0000 7fe63dba9640 1 -- 172.21.15.114:0/3201649146 shutdown_connections 2023-11-04T01:40:03.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.590+0000 7fe63dba9640 1 --2- 172.21.15.114:0/3201649146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6380ce240 0x7fe638157540 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.590+0000 7fe63dba9640 1 --2- 172.21.15.114:0/3201649146 >> v2:172.21.15.141:3300/0 conn(0x7fe63815daa0 0x7fe638157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.590+0000 7fe63dba9640 1 --2- 172.21.15.114:0/3201649146 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe6380cde60 0x7fe63815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.590+0000 7fe63dba9640 1 -- 172.21.15.114:0/3201649146 >> 172.21.15.114:0/3201649146 conn(0x7fe638071f30 msgr2=0x7fe6380cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.590+0000 7fe63dba9640 1 -- 172.21.15.114:0/3201649146 shutdown_connections 2023-11-04T01:40:03.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.590+0000 7fe63dba9640 1 -- 172.21.15.114:0/3201649146 wait complete. 2023-11-04T01:40:03.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.591+0000 7fe63dba9640 1 Processor -- start 2023-11-04T01:40:03.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.592+0000 7fe63dba9640 1 -- start start 2023-11-04T01:40:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.592+0000 7fe63dba9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6380cde60 0x7fe638150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.592+0000 7fe63dba9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe6380ce240 0x7fe63814b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.592+0000 7fe63dba9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63815daa0 0x7fe6380c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.592+0000 7fe63dba9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63814b8f0 con 0x7fe63815daa0 2023-11-04T01:40:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.592+0000 7fe63dba9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380ca000 con 0x7fe6380cde60 2023-11-04T01:40:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.592+0000 7fe63dba9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380ca2e0 con 0x7fe6380ce240 2023-11-04T01:40:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.592+0000 7fe637fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63815daa0 0x7fe6380c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.593+0000 7fe637fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63815daa0 0x7fe6380c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53580/0 (socket says 172.21.15.114:53580) 2023-11-04T01:40:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.593+0000 7fe637fff640 1 -- 172.21.15.114:0/969629914 learned_addr learned my addr 172.21.15.114:0/969629914 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.593+0000 7fe636ffd640 1 --2- 172.21.15.114:0/969629914 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe6380ce240 0x7fe63814b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.593+0000 7fe6377fe640 1 --2- 172.21.15.114:0/969629914 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6380cde60 0x7fe638150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.593+0000 7fe637fff640 1 -- 172.21.15.114:0/969629914 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe6380ce240 msgr2=0x7fe63814b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.593+0000 7fe637fff640 1 --2- 172.21.15.114:0/969629914 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe6380ce240 0x7fe63814b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.593+0000 7fe637fff640 1 -- 172.21.15.114:0/969629914 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6380cde60 msgr2=0x7fe638150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.593+0000 7fe637fff640 1 --2- 172.21.15.114:0/969629914 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6380cde60 0x7fe638150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.593+0000 7fe637fff640 1 -- 172.21.15.114:0/969629914 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe630009b30 con 0x7fe63815daa0 2023-11-04T01:40:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.593+0000 7fe6377fe640 1 --2- 172.21.15.114:0/969629914 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6380cde60 0x7fe638150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.593+0000 7fe637fff640 1 --2- 172.21.15.114:0/969629914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63815daa0 0x7fe6380c8b20 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fe630036040 tx=0x7fe630004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.593+0000 7fe61ffff640 1 -- 172.21.15.114:0/969629914 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630009510 con 0x7fe63815daa0 2023-11-04T01:40:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.593+0000 7fe61ffff640 1 -- 172.21.15.114:0/969629914 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63003e450 con 0x7fe63815daa0 2023-11-04T01:40:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.593+0000 7fe63dba9640 1 -- 172.21.15.114:0/969629914 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6380ca5c0 con 0x7fe63815daa0 2023-11-04T01:40:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.593+0000 7fe61ffff640 1 -- 172.21.15.114:0/969629914 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63003e800 con 0x7fe63815daa0 2023-11-04T01:40:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.593+0000 7fe63dba9640 1 -- 172.21.15.114:0/969629914 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6380cab80 con 0x7fe63815daa0 2023-11-04T01:40:03.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.594+0000 7fe63dba9640 1 -- 172.21.15.114:0/969629914 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe638074290 con 0x7fe63815daa0 2023-11-04T01:40:03.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.594+0000 7fe61ffff640 1 -- 172.21.15.114:0/969629914 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe63003e960 con 0x7fe63815daa0 2023-11-04T01:40:03.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.595+0000 7fe61ffff640 1 --2- 172.21.15.114:0/969629914 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe62406ae70 0x7fe62406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.595+0000 7fe61ffff640 1 -- 172.21.15.114:0/969629914 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fe6300ac920 con 0x7fe63815daa0 2023-11-04T01:40:03.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.595+0000 7fe6377fe640 1 --2- 172.21.15.114:0/969629914 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe62406ae70 0x7fe62406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.595+0000 7fe6377fe640 1 --2- 172.21.15.114:0/969629914 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe62406ae70 0x7fe62406d330 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe62800c940 tx=0x7fe628008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.599+0000 7fe61ffff640 1 -- 172.21.15.114:0/969629914 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe630077450 con 0x7fe63815daa0 2023-11-04T01:40:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.800+0000 7fe63dba9640 1 -- 172.21.15.114:0/969629914 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6380cad40 con 0x7fe63815daa0 2023-11-04T01:40:03.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.801+0000 7fe61ffff640 1 -- 172.21.15.114:0/969629914 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fe63007aa70 con 0x7fe63815daa0 2023-11-04T01:40:03.803 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:03.803 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:00.589620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7431,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7431":{"gid":7431,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/3780323525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3780323525},{"type":"v1","addr":"172.21.15.114:6836","nonce":3780323525}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:03.803 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 46 2023-11-04T01:40:03.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.803+0000 7fe63dba9640 1 -- 172.21.15.114:0/969629914 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe62406ae70 msgr2=0x7fe62406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.803+0000 7fe63dba9640 1 --2- 172.21.15.114:0/969629914 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe62406ae70 0x7fe62406d330 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe62800c940 tx=0x7fe628008040 comp rx=0 tx=0).stop 2023-11-04T01:40:03.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.803+0000 7fe63dba9640 1 -- 172.21.15.114:0/969629914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63815daa0 msgr2=0x7fe6380c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.803+0000 7fe63dba9640 1 --2- 172.21.15.114:0/969629914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63815daa0 0x7fe6380c8b20 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fe630036040 tx=0x7fe630004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:03.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.803+0000 7fe63dba9640 1 -- 172.21.15.114:0/969629914 shutdown_connections 2023-11-04T01:40:03.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.803+0000 7fe63dba9640 1 --2- 172.21.15.114:0/969629914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63815daa0 0x7fe6380c8b20 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.803+0000 7fe63dba9640 1 --2- 172.21.15.114:0/969629914 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe6380ce240 0x7fe63814b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.803+0000 7fe63dba9640 1 --2- 172.21.15.114:0/969629914 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe62406ae70 0x7fe62406d330 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.803+0000 7fe63dba9640 1 --2- 172.21.15.114:0/969629914 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe6380cde60 0x7fe638150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.803+0000 7fe63dba9640 1 -- 172.21.15.114:0/969629914 >> 172.21.15.114:0/969629914 conn(0x7fe638071f30 msgr2=0x7fe6380d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.803+0000 7fe63dba9640 1 -- 172.21.15.114:0/969629914 shutdown_connections 2023-11-04T01:40:03.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:03.803+0000 7fe63dba9640 1 -- 172.21.15.114:0/969629914 wait complete. 2023-11-04T01:40:03.815 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-11-04T01:40:03.948 INFO:teuthology.orchestra.run.smithi141.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:40:03.949 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:40:03.949 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:40:05.950 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.060+0000 7fd27415e640 1 Processor -- start 2023-11-04T01:40:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.060+0000 7fd27415e640 1 -- start start 2023-11-04T01:40:06.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.061+0000 7fd27415e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26c0cb5c0 0x7fd26c0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.061+0000 7fd27415e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26c06a120 con 0x7fd26c15ce70 2023-11-04T01:40:06.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.061+0000 7fd27415e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26c0c9f40 con 0x7fd26c15d250 2023-11-04T01:40:06.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.061+0000 7fd27415e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c0cdc10 con 0x7fd26c0cb5c0 2023-11-04T01:40:06.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.061+0000 7fd271efa640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd26c15ce70 0x7fd26c06d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33368/0 (socket says 172.21.15.114:33368) 2023-11-04T01:40:06.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.061+0000 7fd271efa640 1 -- 172.21.15.114:0/2002178850 learned_addr learned my addr 172.21.15.114:0/2002178850 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:06.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.061+0000 7fd270ef8640 1 -- 172.21.15.114:0/2002178850 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354063073 0 0) 0x7fd26c06a120 con 0x7fd26c15ce70 2023-11-04T01:40:06.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.061+0000 7fd2726fb640 1 --2- 172.21.15.114:0/2002178850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26c0cb5c0 0x7fd26c0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd270ef8640 1 -- 172.21.15.114:0/2002178850 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd258003520 con 0x7fd26c15ce70 2023-11-04T01:40:06.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd270ef8640 1 -- 172.21.15.114:0/2002178850 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1286366931 0 0) 0x7fd258003520 con 0x7fd26c15ce70 2023-11-04T01:40:06.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd270ef8640 1 -- 172.21.15.114:0/2002178850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26c0cb5c0 msgr2=0x7fd26c0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:06.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd270ef8640 1 --2- 172.21.15.114:0/2002178850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26c0cb5c0 0x7fd26c0ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd270ef8640 1 -- 172.21.15.114:0/2002178850 >> v1:172.21.15.141:6789/0 conn(0x7fd26c15d250 legacy=0x7fd26c0c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd270ef8640 1 -- 172.21.15.114:0/2002178850 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c06a370 con 0x7fd26c15ce70 2023-11-04T01:40:06.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd270ef8640 1 -- 172.21.15.114:0/2002178850 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fd268001670 con 0x7fd26c15ce70 2023-11-04T01:40:06.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd270ef8640 1 -- 172.21.15.114:0/2002178850 >> v1:172.21.15.114:6789/0 conn(0x7fd26c15ce70 legacy=0x7fd26c06d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd270ef8640 1 --2- 172.21.15.114:0/2002178850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26c0cb5c0 0x7fd2580039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd270ef8640 1 --2- 172.21.15.114:0/2002178850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd258003f20 0x7fd2580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd270ef8640 1 --2- 172.21.15.114:0/2002178850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd258004d00 0x7fd258005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd270ef8640 1 -- 172.21.15.114:0/2002178850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c0cdc10 con 0x7fd258003f20 2023-11-04T01:40:06.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd270ef8640 1 -- 172.21.15.114:0/2002178850 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25800ba60 con 0x7fd258004d00 2023-11-04T01:40:06.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd270ef8640 1 -- 172.21.15.114:0/2002178850 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25800bc20 con 0x7fd26c0cb5c0 2023-11-04T01:40:06.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd2716f9640 1 --2- 172.21.15.114:0/2002178850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd258003f20 0x7fd2580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd271efa640 1 --2- 172.21.15.114:0/2002178850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26c0cb5c0 0x7fd2580039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd2726fb640 1 --2- 172.21.15.114:0/2002178850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd258004d00 0x7fd258005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd2716f9640 1 -- 172.21.15.114:0/2002178850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26c0cb5c0 msgr2=0x7fd2580039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:06.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd2716f9640 1 --2- 172.21.15.114:0/2002178850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26c0cb5c0 0x7fd2580039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd2716f9640 1 -- 172.21.15.114:0/2002178850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd258004d00 msgr2=0x7fd258005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:06.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd2716f9640 1 --2- 172.21.15.114:0/2002178850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd258004d00 0x7fd258005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.062+0000 7fd2716f9640 1 -- 172.21.15.114:0/2002178850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd258003520 con 0x7fd258003f20 2023-11-04T01:40:06.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.063+0000 7fd2716f9640 1 --2- 172.21.15.114:0/2002178850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd258003f20 0x7fd2580047c0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fd25c001720 tx=0x7fd2580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7624aad3ea059eb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:06.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.063+0000 7fd270ef8640 1 -- 172.21.15.114:0/2002178850 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c0052d0 con 0x7fd258003f20 2023-11-04T01:40:06.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.063+0000 7fd270ef8640 1 -- 172.21.15.114:0/2002178850 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25c02e050 con 0x7fd258003f20 2023-11-04T01:40:06.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.063+0000 7fd270ef8640 1 -- 172.21.15.114:0/2002178850 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c003830 con 0x7fd258003f20 2023-11-04T01:40:06.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.064+0000 7fd27415e640 1 -- 172.21.15.114:0/2002178850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd258003f20 msgr2=0x7fd2580047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.064+0000 7fd27415e640 1 --2- 172.21.15.114:0/2002178850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd258003f20 0x7fd2580047c0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fd25c001720 tx=0x7fd2580057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.064+0000 7fd2726fb640 1 -- 172.21.15.114:0/2002178850 reap_dead start 2023-11-04T01:40:06.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.064+0000 7fd27415e640 1 -- 172.21.15.114:0/2002178850 shutdown_connections 2023-11-04T01:40:06.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.064+0000 7fd27415e640 1 -- 172.21.15.114:0/2002178850 >> 172.21.15.114:0/2002178850 conn(0x7fd26c0b0cd0 msgr2=0x7fd26c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:06.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.064+0000 7fd27415e640 1 -- 172.21.15.114:0/2002178850 shutdown_connections 2023-11-04T01:40:06.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.064+0000 7fd27415e640 1 -- 172.21.15.114:0/2002178850 wait complete. 2023-11-04T01:40:06.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.065+0000 7fd27415e640 1 Processor -- start 2023-11-04T01:40:06.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.065+0000 7fd27415e640 1 -- start start 2023-11-04T01:40:06.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd27415e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd258003f20 0x7fd26c0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd27415e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26c0c62b0 0x7fd26c1f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd27415e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd26c14f550 0x7fd26c158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd27415e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c0c73c0 con 0x7fd258003f20 2023-11-04T01:40:06.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd27415e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c155a60 con 0x7fd26c14f550 2023-11-04T01:40:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd27415e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c1f3a10 con 0x7fd26c0c62b0 2023-11-04T01:40:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd271efa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd258003f20 0x7fd26c0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd271efa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd258003f20 0x7fd26c0c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53598/0 (socket says 172.21.15.114:53598) 2023-11-04T01:40:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd271efa640 1 -- 172.21.15.114:0/1052863737 learned_addr learned my addr 172.21.15.114:0/1052863737 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd271efa640 1 -- 172.21.15.114:0/1052863737 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26c0c62b0 msgr2=0x7fd26c1f34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd271efa640 1 --2- 172.21.15.114:0/1052863737 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26c0c62b0 0x7fd26c1f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd271efa640 1 -- 172.21.15.114:0/1052863737 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd26c14f550 msgr2=0x7fd26c158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd271efa640 1 --2- 172.21.15.114:0/1052863737 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd26c14f550 0x7fd26c158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd271efa640 1 -- 172.21.15.114:0/1052863737 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c0c67b0 con 0x7fd258003f20 2023-11-04T01:40:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd271efa640 1 --2- 172.21.15.114:0/1052863737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd258003f20 0x7fd26c0c7850 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fd268007290 tx=0x7fd268007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd2627fc640 1 -- 172.21.15.114:0/1052863737 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26800f8c0 con 0x7fd258003f20 2023-11-04T01:40:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd2627fc640 1 -- 172.21.15.114:0/1052863737 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26800fa40 con 0x7fd258003f20 2023-11-04T01:40:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd27415e640 1 -- 172.21.15.114:0/1052863737 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd26c0c6a90 con 0x7fd258003f20 2023-11-04T01:40:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.066+0000 7fd2627fc640 1 -- 172.21.15.114:0/1052863737 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26800fdf0 con 0x7fd258003f20 2023-11-04T01:40:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.067+0000 7fd27415e640 1 -- 172.21.15.114:0/1052863737 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd26c0c7050 con 0x7fd258003f20 2023-11-04T01:40:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.068+0000 7fd27415e640 1 -- 172.21.15.114:0/1052863737 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26c074290 con 0x7fd258003f20 2023-11-04T01:40:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.068+0000 7fd2627fc640 1 -- 172.21.15.114:0/1052863737 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd26801d460 con 0x7fd258003f20 2023-11-04T01:40:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.068+0000 7fd2627fc640 1 --2- 172.21.15.114:0/1052863737 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd25006ae70 0x7fd25006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.068+0000 7fd2627fc640 1 -- 172.21.15.114:0/1052863737 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fd268089c00 con 0x7fd258003f20 2023-11-04T01:40:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.068+0000 7fd2716f9640 1 --2- 172.21.15.114:0/1052863737 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd25006ae70 0x7fd25006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.069+0000 7fd2716f9640 1 --2- 172.21.15.114:0/1052863737 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd25006ae70 0x7fd25006d330 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd25c033000 tx=0x7fd25c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:06.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.073+0000 7fd2627fc640 1 -- 172.21.15.114:0/1052863737 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd268090080 con 0x7fd258003f20 2023-11-04T01:40:06.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.276+0000 7fd27415e640 1 -- 172.21.15.114:0/1052863737 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd26c066170 con 0x7fd258003f20 2023-11-04T01:40:06.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.276+0000 7fd2627fc640 1 -- 172.21.15.114:0/1052863737 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fd2680547c0 con 0x7fd258003f20 2023-11-04T01:40:06.278 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:06.278 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:00.589620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7431,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7431":{"gid":7431,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/3780323525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3780323525},{"type":"v1","addr":"172.21.15.114:6836","nonce":3780323525}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:06.278 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 46 2023-11-04T01:40:06.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.278+0000 7fd27415e640 1 -- 172.21.15.114:0/1052863737 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd25006ae70 msgr2=0x7fd25006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.278+0000 7fd27415e640 1 --2- 172.21.15.114:0/1052863737 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd25006ae70 0x7fd25006d330 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd25c033000 tx=0x7fd25c02f000 comp rx=0 tx=0).stop 2023-11-04T01:40:06.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.278+0000 7fd27415e640 1 -- 172.21.15.114:0/1052863737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd258003f20 msgr2=0x7fd26c0c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.278+0000 7fd27415e640 1 --2- 172.21.15.114:0/1052863737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd258003f20 0x7fd26c0c7850 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fd268007290 tx=0x7fd268007750 comp rx=0 tx=0).stop 2023-11-04T01:40:06.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.278+0000 7fd27415e640 1 -- 172.21.15.114:0/1052863737 shutdown_connections 2023-11-04T01:40:06.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.278+0000 7fd27415e640 1 --2- 172.21.15.114:0/1052863737 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd25006ae70 0x7fd25006d330 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.278+0000 7fd27415e640 1 --2- 172.21.15.114:0/1052863737 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd26c14f550 0x7fd26c158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.278+0000 7fd27415e640 1 --2- 172.21.15.114:0/1052863737 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd26c0c62b0 0x7fd26c1f34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.278+0000 7fd27415e640 1 --2- 172.21.15.114:0/1052863737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd258003f20 0x7fd26c0c7850 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.278+0000 7fd27415e640 1 -- 172.21.15.114:0/1052863737 >> 172.21.15.114:0/1052863737 conn(0x7fd26c0b0cd0 msgr2=0x7fd26c0abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:06.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.278+0000 7fd27415e640 1 -- 172.21.15.114:0/1052863737 shutdown_connections 2023-11-04T01:40:06.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:06.278+0000 7fd27415e640 1 -- 172.21.15.114:0/1052863737 wait complete. 2023-11-04T01:40:06.291 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-11-04T01:40:06.416 INFO:teuthology.orchestra.run.smithi141.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:40:06.416 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:40:06.416 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:40:08.417 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:08.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.526+0000 7f0db90b4640 1 Processor -- start 2023-11-04T01:40:08.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.526+0000 7f0db90b4640 1 -- start start 2023-11-04T01:40:08.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.527+0000 7f0db90b4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db415ad80 0x7f0db406c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.527+0000 7f0db90b4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db406cd00 con 0x7f0db40c9e10 2023-11-04T01:40:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.527+0000 7f0db90b4640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db406cfa0 con 0x7f0db40b42c0 2023-11-04T01:40:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.527+0000 7f0db90b4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db406d280 con 0x7f0db415ad80 2023-11-04T01:40:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.527+0000 7f0db359e640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0db40c9e10 0x7f0db40b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51010/0 (socket says 172.21.15.114:51010) 2023-11-04T01:40:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.527+0000 7f0db359e640 1 -- 172.21.15.114:0/3843603956 learned_addr learned my addr 172.21.15.114:0/3843603956 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.527+0000 7f0db2d9d640 1 --2- 172.21.15.114:0/3843603956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db415ad80 0x7f0db406c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.527+0000 7f0db259c640 1 -- 172.21.15.114:0/3843603956 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789995562 0 0) 0x7f0db406cd00 con 0x7f0db40c9e10 2023-11-04T01:40:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.527+0000 7f0db259c640 1 -- 172.21.15.114:0/3843603956 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0da0003520 con 0x7f0db40c9e10 2023-11-04T01:40:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.527+0000 7f0db259c640 1 -- 172.21.15.114:0/3843603956 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3378328755 0 0) 0x7f0da0003520 con 0x7f0db40c9e10 2023-11-04T01:40:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.527+0000 7f0db259c640 1 -- 172.21.15.114:0/3843603956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db415ad80 msgr2=0x7f0db406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.527+0000 7f0db259c640 1 --2- 172.21.15.114:0/3843603956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db415ad80 0x7f0db406c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.527+0000 7f0db259c640 1 -- 172.21.15.114:0/3843603956 >> v1:172.21.15.141:6789/0 conn(0x7f0db40b42c0 legacy=0x7f0db40c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.527+0000 7f0db259c640 1 -- 172.21.15.114:0/3843603956 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db406d560 con 0x7f0db40c9e10 2023-11-04T01:40:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.527+0000 7f0db259c640 1 -- 172.21.15.114:0/3843603956 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f0dac001a10 con 0x7f0db40c9e10 2023-11-04T01:40:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.527+0000 7f0db259c640 1 -- 172.21.15.114:0/3843603956 >> v1:172.21.15.114:6789/0 conn(0x7f0db40c9e10 legacy=0x7f0db40b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.528+0000 7f0db259c640 1 --2- 172.21.15.114:0/3843603956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db415ad80 0x7f0da00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.528+0000 7f0db259c640 1 --2- 172.21.15.114:0/3843603956 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0da0003f20 0x7f0da00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.528+0000 7f0db259c640 1 --2- 172.21.15.114:0/3843603956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0da0004d00 0x7f0da0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.528+0000 7f0db259c640 1 -- 172.21.15.114:0/3843603956 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db406d280 con 0x7f0da0004d00 2023-11-04T01:40:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.528+0000 7f0db259c640 1 -- 172.21.15.114:0/3843603956 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da000baf0 con 0x7f0da0003f20 2023-11-04T01:40:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.528+0000 7f0db259c640 1 -- 172.21.15.114:0/3843603956 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da000bcb0 con 0x7f0db415ad80 2023-11-04T01:40:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.528+0000 7f0db359e640 1 --2- 172.21.15.114:0/3843603956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0da0004d00 0x7f0da0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.528+0000 7f0dabfff640 1 --2- 172.21.15.114:0/3843603956 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0da0003f20 0x7f0da00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.528+0000 7f0db2d9d640 1 --2- 172.21.15.114:0/3843603956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db415ad80 0x7f0da00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.528+0000 7f0db359e640 1 -- 172.21.15.114:0/3843603956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db415ad80 msgr2=0x7f0da00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.528+0000 7f0db359e640 1 --2- 172.21.15.114:0/3843603956 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db415ad80 0x7f0da00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.528+0000 7f0db359e640 1 -- 172.21.15.114:0/3843603956 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0da0003f20 msgr2=0x7f0da00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.528+0000 7f0db359e640 1 --2- 172.21.15.114:0/3843603956 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0da0003f20 0x7f0da00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.528+0000 7f0db359e640 1 -- 172.21.15.114:0/3843603956 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da0003520 con 0x7f0da0004d00 2023-11-04T01:40:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.529+0000 7f0db359e640 1 --2- 172.21.15.114:0/3843603956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0da0004d00 0x7f0da0005180 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f0db406c710 tx=0x7f0da00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4ed427395b01aa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.529+0000 7f0db259c640 1 -- 172.21.15.114:0/3843603956 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac034630 con 0x7f0da0004d00 2023-11-04T01:40:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.529+0000 7f0db259c640 1 -- 172.21.15.114:0/3843603956 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac02f070 con 0x7f0da0004d00 2023-11-04T01:40:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.529+0000 7f0db259c640 1 -- 172.21.15.114:0/3843603956 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0349d0 con 0x7f0da0004d00 2023-11-04T01:40:08.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.529+0000 7f0db90b4640 1 -- 172.21.15.114:0/3843603956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0da0004d00 msgr2=0x7f0da0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.529+0000 7f0db90b4640 1 --2- 172.21.15.114:0/3843603956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0da0004d00 0x7f0da0005180 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f0db406c710 tx=0x7f0da00057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.529+0000 7f0db359e640 1 -- 172.21.15.114:0/3843603956 reap_dead start 2023-11-04T01:40:08.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.529+0000 7f0db90b4640 1 -- 172.21.15.114:0/3843603956 shutdown_connections 2023-11-04T01:40:08.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.529+0000 7f0db90b4640 1 -- 172.21.15.114:0/3843603956 >> 172.21.15.114:0/3843603956 conn(0x7f0db40ce950 msgr2=0x7f0db40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:08.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.529+0000 7f0db90b4640 1 -- 172.21.15.114:0/3843603956 shutdown_connections 2023-11-04T01:40:08.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.529+0000 7f0db90b4640 1 -- 172.21.15.114:0/3843603956 wait complete. 2023-11-04T01:40:08.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.531+0000 7f0db90b4640 1 Processor -- start 2023-11-04T01:40:08.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.531+0000 7f0db90b4640 1 -- start start 2023-11-04T01:40:08.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db90b4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0da0004d00 0x7f0db4147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db90b4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db41487d0 0x7f0db40afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db90b4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db4148c50 0x7f0db40b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db90b4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db415c970 con 0x7f0da0004d00 2023-11-04T01:40:08.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db90b4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db41482a0 con 0x7f0db41487d0 2023-11-04T01:40:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db90b4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db415cc10 con 0x7f0db4148c50 2023-11-04T01:40:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0da0004d00 0x7f0db4147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db2d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0da0004d00 0x7f0db4147d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52340/0 (socket says 172.21.15.114:52340) 2023-11-04T01:40:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db2d9d640 1 -- 172.21.15.114:0/1161924004 learned_addr learned my addr 172.21.15.114:0/1161924004 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0dabfff640 1 --2- 172.21.15.114:0/1161924004 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db41487d0 0x7f0db40afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db359e640 1 --2- 172.21.15.114:0/1161924004 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db4148c50 0x7f0db40b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db2d9d640 1 -- 172.21.15.114:0/1161924004 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db4148c50 msgr2=0x7f0db40b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db2d9d640 1 --2- 172.21.15.114:0/1161924004 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db4148c50 0x7f0db40b00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db2d9d640 1 -- 172.21.15.114:0/1161924004 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db41487d0 msgr2=0x7f0db40afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db2d9d640 1 --2- 172.21.15.114:0/1161924004 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db41487d0 0x7f0db40afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db2d9d640 1 -- 172.21.15.114:0/1161924004 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db415cef0 con 0x7f0da0004d00 2023-11-04T01:40:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db359e640 1 --2- 172.21.15.114:0/1161924004 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db4148c50 0x7f0db40b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0dabfff640 1 --2- 172.21.15.114:0/1161924004 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db41487d0 0x7f0db40afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db2d9d640 1 --2- 172.21.15.114:0/1161924004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0da0004d00 0x7f0db4147d60 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f0da40119a0 tx=0x7f0da4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0dab7fe640 1 -- 172.21.15.114:0/1161924004 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da400faf0 con 0x7f0da0004d00 2023-11-04T01:40:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0dab7fe640 1 -- 172.21.15.114:0/1161924004 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da400fc50 con 0x7f0da0004d00 2023-11-04T01:40:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db90b4640 1 -- 172.21.15.114:0/1161924004 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db415d1d0 con 0x7f0da0004d00 2023-11-04T01:40:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0dab7fe640 1 -- 172.21.15.114:0/1161924004 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da4014440 con 0x7f0da0004d00 2023-11-04T01:40:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.532+0000 7f0db90b4640 1 -- 172.21.15.114:0/1161924004 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db4155670 con 0x7f0da0004d00 2023-11-04T01:40:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.534+0000 7f0db90b4640 1 -- 172.21.15.114:0/1161924004 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db4074290 con 0x7f0da0004d00 2023-11-04T01:40:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.534+0000 7f0dab7fe640 1 -- 172.21.15.114:0/1161924004 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0da40145a0 con 0x7f0da0004d00 2023-11-04T01:40:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.534+0000 7f0dab7fe640 1 --2- 172.21.15.114:0/1161924004 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d9406ae70 0x7f0d9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.534+0000 7f0dabfff640 1 --2- 172.21.15.114:0/1161924004 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d9406ae70 0x7f0d9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.534+0000 7f0dab7fe640 1 -- 172.21.15.114:0/1161924004 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f0da408a3d0 con 0x7f0da0004d00 2023-11-04T01:40:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.535+0000 7f0dabfff640 1 --2- 172.21.15.114:0/1161924004 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d9406ae70 0x7f0d9406d330 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0db41f4070 tx=0x7f0d9c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:08.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.539+0000 7f0dab7fe640 1 -- 172.21.15.114:0/1161924004 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0da4054f90 con 0x7f0da0004d00 2023-11-04T01:40:08.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.739+0000 7f0db90b4640 1 -- 172.21.15.114:0/1161924004 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0db40b4880 con 0x7f0da0004d00 2023-11-04T01:40:08.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.740+0000 7f0dab7fe640 1 -- 172.21.15.114:0/1161924004 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f0da40585b0 con 0x7f0da0004d00 2023-11-04T01:40:08.742 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:08.742 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:00.589620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7431,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7431":{"gid":7431,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/3780323525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3780323525},{"type":"v1","addr":"172.21.15.114:6836","nonce":3780323525}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:08.742 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 46 2023-11-04T01:40:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.742+0000 7f0db90b4640 1 -- 172.21.15.114:0/1161924004 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d9406ae70 msgr2=0x7f0d9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.742+0000 7f0db90b4640 1 --2- 172.21.15.114:0/1161924004 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d9406ae70 0x7f0d9406d330 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0db41f4070 tx=0x7f0d9c009040 comp rx=0 tx=0).stop 2023-11-04T01:40:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.742+0000 7f0db90b4640 1 -- 172.21.15.114:0/1161924004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0da0004d00 msgr2=0x7f0db4147d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.742+0000 7f0db90b4640 1 --2- 172.21.15.114:0/1161924004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0da0004d00 0x7f0db4147d60 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f0da40119a0 tx=0x7f0da4011e60 comp rx=0 tx=0).stop 2023-11-04T01:40:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.742+0000 7f0db90b4640 1 -- 172.21.15.114:0/1161924004 shutdown_connections 2023-11-04T01:40:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.742+0000 7f0db90b4640 1 --2- 172.21.15.114:0/1161924004 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0db4148c50 0x7f0db40b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.742+0000 7f0db90b4640 1 --2- 172.21.15.114:0/1161924004 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0d9406ae70 0x7f0d9406d330 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.742+0000 7f0db90b4640 1 --2- 172.21.15.114:0/1161924004 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0db41487d0 0x7f0db40afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.742+0000 7f0db90b4640 1 --2- 172.21.15.114:0/1161924004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0da0004d00 0x7f0db4147d60 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.742+0000 7f0db90b4640 1 -- 172.21.15.114:0/1161924004 >> 172.21.15.114:0/1161924004 conn(0x7f0db40ce950 msgr2=0x7f0db40b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.742+0000 7f0db90b4640 1 -- 172.21.15.114:0/1161924004 shutdown_connections 2023-11-04T01:40:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:08.742+0000 7f0db90b4640 1 -- 172.21.15.114:0/1161924004 wait complete. 2023-11-04T01:40:08.754 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-11-04T01:40:08.881 INFO:teuthology.orchestra.run.smithi141.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:40:08.881 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:40:08.882 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:40:10.882 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:10.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.991+0000 7f0b61e44640 1 Processor -- start 2023-11-04T01:40:10.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.991+0000 7f0b61e44640 1 -- start start 2023-11-04T01:40:10.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b61e44640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f0b5c159c70 0x7f0b5c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b61e44640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b5c06db20 0x7f0b5c0b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b61e44640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0b5c0b0910 0x7f0b5c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b61e44640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5c0b49b0 con 0x7f0b5c0b0910 2023-11-04T01:40:10.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b61e44640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5c0b0da0 con 0x7f0b5c159c70 2023-11-04T01:40:10.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b61e44640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0b4110 con 0x7f0b5c06db20 2023-11-04T01:40:10.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b5bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0b5c0b0910 0x7f0b5c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b5bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0b5c0b0910 0x7f0b5c15d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52342/0 (socket says 172.21.15.114:52342) 2023-11-04T01:40:10.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b5bfff640 1 -- 172.21.15.114:0/4237188562 learned_addr learned my addr 172.21.15.114:0/4237188562 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:10.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b5b7fe640 1 --2- 172.21.15.114:0/4237188562 >> v2:172.21.15.141:3300/0 conn(0x7f0b5c159c70 0x7f0b5c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b5affd640 1 --2- 172.21.15.114:0/4237188562 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b5c06db20 0x7f0b5c0b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b5bfff640 1 -- 172.21.15.114:0/4237188562 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b5c06db20 msgr2=0x7f0b5c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:10.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b5bfff640 1 --2- 172.21.15.114:0/4237188562 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b5c06db20 0x7f0b5c0b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b5bfff640 1 -- 172.21.15.114:0/4237188562 >> v2:172.21.15.141:3300/0 conn(0x7f0b5c159c70 msgr2=0x7f0b5c0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:10.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b5bfff640 1 --2- 172.21.15.114:0/4237188562 >> v2:172.21.15.141:3300/0 conn(0x7f0b5c159c70 0x7f0b5c0ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b5bfff640 1 -- 172.21.15.114:0/4237188562 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c0b43f0 con 0x7f0b5c0b0910 2023-11-04T01:40:10.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.992+0000 7f0b5b7fe640 1 --2- 172.21.15.114:0/4237188562 >> v2:172.21.15.141:3300/0 conn(0x7f0b5c159c70 0x7f0b5c0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:10.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.993+0000 7f0b5bfff640 1 --2- 172.21.15.114:0/4237188562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b5c0b0910 0x7f0b5c15d7d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0cc440 tx=0x7f0b4c034120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7243624202c3ea87 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:10.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.993+0000 7f0b5a7fc640 1 -- 172.21.15.114:0/4237188562 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c03c440 con 0x7f0b5c0b0910 2023-11-04T01:40:10.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.993+0000 7f0b5a7fc640 1 -- 172.21.15.114:0/4237188562 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c03c5a0 con 0x7f0b5c0b0910 2023-11-04T01:40:10.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.993+0000 7f0b5a7fc640 1 -- 172.21.15.114:0/4237188562 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c03c930 con 0x7f0b5c0b0910 2023-11-04T01:40:10.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.994+0000 7f0b61e44640 1 -- 172.21.15.114:0/4237188562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b5c0b0910 msgr2=0x7f0b5c15d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.994+0000 7f0b61e44640 1 --2- 172.21.15.114:0/4237188562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b5c0b0910 0x7f0b5c15d7d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0cc440 tx=0x7f0b4c034120 comp rx=0 tx=0).stop 2023-11-04T01:40:10.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.994+0000 7f0b61e44640 1 -- 172.21.15.114:0/4237188562 shutdown_connections 2023-11-04T01:40:10.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.994+0000 7f0b61e44640 1 --2- 172.21.15.114:0/4237188562 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b5c06db20 0x7f0b5c0b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.994+0000 7f0b61e44640 1 --2- 172.21.15.114:0/4237188562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b5c0b0910 0x7f0b5c15d7d0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.994+0000 7f0b61e44640 1 --2- 172.21.15.114:0/4237188562 >> v2:172.21.15.141:3300/0 conn(0x7f0b5c159c70 0x7f0b5c0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.994+0000 7f0b61e44640 1 -- 172.21.15.114:0/4237188562 >> 172.21.15.114:0/4237188562 conn(0x7f0b5c0ce950 msgr2=0x7f0b5c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:10.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.994+0000 7f0b61e44640 1 -- 172.21.15.114:0/4237188562 shutdown_connections 2023-11-04T01:40:10.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.994+0000 7f0b61e44640 1 -- 172.21.15.114:0/4237188562 wait complete. 2023-11-04T01:40:10.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.995+0000 7f0b61e44640 1 Processor -- start 2023-11-04T01:40:10.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.995+0000 7f0b61e44640 1 -- start start 2023-11-04T01:40:11.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.996+0000 7f0b61e44640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b5c06db20 0x7f0b5c1f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.996+0000 7f0b61e44640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b5c0b0910 0x7f0b5c15b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.996+0000 7f0b61e44640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b5c159c70 0x7f0b5c0b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b61e44640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c15b590 con 0x7f0b5c06db20 2023-11-04T01:40:11.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b61e44640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0c7130 con 0x7f0b5c159c70 2023-11-04T01:40:11.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b61e44640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c15b7c0 con 0x7f0b5c0b0910 2023-11-04T01:40:11.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b5b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b5c06db20 0x7f0b5c1f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b5b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b5c06db20 0x7f0b5c1f25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52348/0 (socket says 172.21.15.114:52348) 2023-11-04T01:40:11.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b5b7fe640 1 -- 172.21.15.114:0/3320604470 learned_addr learned my addr 172.21.15.114:0/3320604470 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:11.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b5affd640 1 --2- 172.21.15.114:0/3320604470 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b5c0b0910 0x7f0b5c15b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b5bfff640 1 --2- 172.21.15.114:0/3320604470 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b5c159c70 0x7f0b5c0b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b5b7fe640 1 -- 172.21.15.114:0/3320604470 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b5c0b0910 msgr2=0x7f0b5c15b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b5b7fe640 1 --2- 172.21.15.114:0/3320604470 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b5c0b0910 0x7f0b5c15b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b5b7fe640 1 -- 172.21.15.114:0/3320604470 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b5c159c70 msgr2=0x7f0b5c0b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b5b7fe640 1 --2- 172.21.15.114:0/3320604470 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b5c159c70 0x7f0b5c0b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b5b7fe640 1 -- 172.21.15.114:0/3320604470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c0094d0 con 0x7f0b5c06db20 2023-11-04T01:40:11.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b5b7fe640 1 --2- 172.21.15.114:0/3320604470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b5c06db20 0x7f0b5c1f25d0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009fc0 tx=0x7f0b5400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b53fff640 1 -- 172.21.15.114:0/3320604470 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54003b90 con 0x7f0b5c06db20 2023-11-04T01:40:11.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b53fff640 1 -- 172.21.15.114:0/3320604470 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5400f040 con 0x7f0b5c06db20 2023-11-04T01:40:11.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b53fff640 1 -- 172.21.15.114:0/3320604470 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54004030 con 0x7f0b5c06db20 2023-11-04T01:40:11.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.997+0000 7f0b61e44640 1 -- 172.21.15.114:0/3320604470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c0c73d0 con 0x7f0b5c06db20 2023-11-04T01:40:11.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.998+0000 7f0b61e44640 1 -- 172.21.15.114:0/3320604470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c15baa0 con 0x7f0b5c06db20 2023-11-04T01:40:11.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.999+0000 7f0b61e44640 1 -- 172.21.15.114:0/3320604470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5c074290 con 0x7f0b5c06db20 2023-11-04T01:40:11.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.999+0000 7f0b53fff640 1 -- 172.21.15.114:0/3320604470 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b54004190 con 0x7f0b5c06db20 2023-11-04T01:40:11.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.999+0000 7f0b53fff640 1 --2- 172.21.15.114:0/3320604470 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0b3c06aea0 0x7f0b3c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.999+0000 7f0b53fff640 1 -- 172.21.15.114:0/3320604470 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f0b54089d90 con 0x7f0b5c06db20 2023-11-04T01:40:11.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:10.999+0000 7f0b5affd640 1 --2- 172.21.15.114:0/3320604470 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0b3c06aea0 0x7f0b3c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:11.000+0000 7f0b5affd640 1 --2- 172.21.15.114:0/3320604470 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0b3c06aea0 0x7f0b3c06d360 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0b37c0 tx=0x7f0b4400f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:11.004+0000 7f0b53fff640 1 -- 172.21.15.114:0/3320604470 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b54054a00 con 0x7f0b5c06db20 2023-11-04T01:40:11.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:11.207+0000 7f0b61e44640 1 -- 172.21.15.114:0/3320604470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b5c06d3f0 con 0x7f0b5c06db20 2023-11-04T01:40:11.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:11.207+0000 7f0b53fff640 1 -- 172.21.15.114:0/3320604470 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f0b5401a090 con 0x7f0b5c06db20 2023-11-04T01:40:11.209 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:11.209 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:00.589620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7431,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7431":{"gid":7431,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/3780323525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3780323525},{"type":"v1","addr":"172.21.15.114:6836","nonce":3780323525}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:11.210 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 46 2023-11-04T01:40:11.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:11.209+0000 7f0b61e44640 1 -- 172.21.15.114:0/3320604470 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0b3c06aea0 msgr2=0x7f0b3c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:11.209+0000 7f0b61e44640 1 --2- 172.21.15.114:0/3320604470 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0b3c06aea0 0x7f0b3c06d360 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0b37c0 tx=0x7f0b4400f040 comp rx=0 tx=0).stop 2023-11-04T01:40:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:11.209+0000 7f0b61e44640 1 -- 172.21.15.114:0/3320604470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b5c06db20 msgr2=0x7f0b5c1f25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:11.209+0000 7f0b61e44640 1 --2- 172.21.15.114:0/3320604470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b5c06db20 0x7f0b5c1f25d0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009fc0 tx=0x7f0b5400d560 comp rx=0 tx=0).stop 2023-11-04T01:40:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:11.209+0000 7f0b61e44640 1 -- 172.21.15.114:0/3320604470 shutdown_connections 2023-11-04T01:40:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:11.209+0000 7f0b61e44640 1 --2- 172.21.15.114:0/3320604470 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0b3c06aea0 0x7f0b3c06d360 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:11.209+0000 7f0b61e44640 1 --2- 172.21.15.114:0/3320604470 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0b5c159c70 0x7f0b5c0b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:11.209+0000 7f0b61e44640 1 --2- 172.21.15.114:0/3320604470 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0b5c0b0910 0x7f0b5c15b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:11.209+0000 7f0b61e44640 1 --2- 172.21.15.114:0/3320604470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b5c06db20 0x7f0b5c1f25d0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:11.209+0000 7f0b61e44640 1 -- 172.21.15.114:0/3320604470 >> 172.21.15.114:0/3320604470 conn(0x7f0b5c0ce950 msgr2=0x7f0b5c0cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:11.210+0000 7f0b61e44640 1 -- 172.21.15.114:0/3320604470 shutdown_connections 2023-11-04T01:40:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:11.210+0000 7f0b61e44640 1 -- 172.21.15.114:0/3320604470 wait complete. 2023-11-04T01:40:11.222 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-11-04T01:40:11.347 INFO:teuthology.orchestra.run.smithi141.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:40:11.347 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:40:11.347 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:40:13.348 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:13.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.458+0000 7efdc96c2640 1 Processor -- start 2023-11-04T01:40:13.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.458+0000 7efdc96c2640 1 -- start start 2023-11-04T01:40:13.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.459+0000 7efdc96c2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40ce240 0x7efdc4157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.459+0000 7efdc96c2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4157540 0x7efdc40d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.459+0000 7efdc96c2640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc415e000 con 0x7efdc40cde60 2023-11-04T01:40:13.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.459+0000 7efdc96c2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc415e5c0 con 0x7efdc4157540 2023-11-04T01:40:13.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.459+0000 7efdc96c2640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc415e2e0 con 0x7efdc40ce240 2023-11-04T01:40:13.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.459+0000 7efdc37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4157540 0x7efdc40d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.459+0000 7efdc37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4157540 0x7efdc40d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52354/0 (socket says 172.21.15.114:52354) 2023-11-04T01:40:13.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.459+0000 7efdc37fe640 1 -- 172.21.15.114:0/3792526555 learned_addr learned my addr 172.21.15.114:0/3792526555 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:13.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.459+0000 7efdbbfff640 1 --2- 172.21.15.114:0/3792526555 >> v2:172.21.15.141:3300/0 conn(0x7efdc40ce240 0x7efdc4157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.459+0000 7efdc37fe640 1 -- 172.21.15.114:0/3792526555 >> v2:172.21.15.141:3300/0 conn(0x7efdc40ce240 msgr2=0x7efdc4157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:13.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.459+0000 7efdc37fe640 1 --2- 172.21.15.114:0/3792526555 >> v2:172.21.15.141:3300/0 conn(0x7efdc40ce240 0x7efdc4157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.459+0000 7efdc37fe640 1 -- 172.21.15.114:0/3792526555 >> v1:172.21.15.141:6789/0 conn(0x7efdc40cde60 legacy=0x7efdc415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:13.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.459+0000 7efdc37fe640 1 -- 172.21.15.114:0/3792526555 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc40d1120 con 0x7efdc4157540 2023-11-04T01:40:13.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.460+0000 7efdc37fe640 1 --2- 172.21.15.114:0/3792526555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdc4157540 0x7efdc40d1920 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7efdc40cf5f0 tx=0x7efdbc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75b4e0339542760 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:13.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.460+0000 7efdc27fc640 1 -- 172.21.15.114:0/3792526555 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc02ca80 con 0x7efdc4157540 2023-11-04T01:40:13.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.460+0000 7efdc27fc640 1 -- 172.21.15.114:0/3792526555 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc02cbe0 con 0x7efdc4157540 2023-11-04T01:40:13.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.460+0000 7efdc27fc640 1 -- 172.21.15.114:0/3792526555 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0343f0 con 0x7efdc4157540 2023-11-04T01:40:13.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.461+0000 7efdc96c2640 1 -- 172.21.15.114:0/3792526555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdc4157540 msgr2=0x7efdc40d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.461+0000 7efdc96c2640 1 --2- 172.21.15.114:0/3792526555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdc4157540 0x7efdc40d1920 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7efdc40cf5f0 tx=0x7efdbc02bee0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.461+0000 7efdc96c2640 1 -- 172.21.15.114:0/3792526555 shutdown_connections 2023-11-04T01:40:13.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.461+0000 7efdc96c2640 1 --2- 172.21.15.114:0/3792526555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdc4157540 0x7efdc40d1920 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.461+0000 7efdc96c2640 1 --2- 172.21.15.114:0/3792526555 >> v2:172.21.15.141:3300/0 conn(0x7efdc40ce240 0x7efdc4157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.461+0000 7efdc96c2640 1 -- 172.21.15.114:0/3792526555 >> 172.21.15.114:0/3792526555 conn(0x7efdc4071f30 msgr2=0x7efdc40cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:13.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.461+0000 7efdc96c2640 1 -- 172.21.15.114:0/3792526555 shutdown_connections 2023-11-04T01:40:13.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.461+0000 7efdc96c2640 1 -- 172.21.15.114:0/3792526555 wait complete. 2023-11-04T01:40:13.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.462+0000 7efdc96c2640 1 Processor -- start 2023-11-04T01:40:13.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.462+0000 7efdc96c2640 1 -- start start 2023-11-04T01:40:13.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdc96c2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efdc40cde60 0x7efdc415ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdc96c2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdc40ce240 0x7efdc4153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdc96c2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4157540 0x7efdc41f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdc96c2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4153a90 con 0x7efdc40ce240 2023-11-04T01:40:13.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdc96c2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc40cc570 con 0x7efdc40cde60 2023-11-04T01:40:13.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdc96c2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc41f34a0 con 0x7efdc4157540 2023-11-04T01:40:13.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdbbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdc40ce240 0x7efdc4153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdbbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdc40ce240 0x7efdc4153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52370/0 (socket says 172.21.15.114:52370) 2023-11-04T01:40:13.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdbbfff640 1 -- 172.21.15.114:0/407838436 learned_addr learned my addr 172.21.15.114:0/407838436 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:13.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdc2ffd640 1 --2- 172.21.15.114:0/407838436 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efdc40cde60 0x7efdc415ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdc37fe640 1 --2- 172.21.15.114:0/407838436 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4157540 0x7efdc41f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdbbfff640 1 -- 172.21.15.114:0/407838436 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4157540 msgr2=0x7efdc41f2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdbbfff640 1 --2- 172.21.15.114:0/407838436 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4157540 0x7efdc41f2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdbbfff640 1 -- 172.21.15.114:0/407838436 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efdc40cde60 msgr2=0x7efdc415ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdbbfff640 1 --2- 172.21.15.114:0/407838436 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efdc40cde60 0x7efdc415ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdbbfff640 1 -- 172.21.15.114:0/407838436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc009b30 con 0x7efdc40ce240 2023-11-04T01:40:13.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdbbfff640 1 --2- 172.21.15.114:0/407838436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdc40ce240 0x7efdc4153550 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7efdac00d800 tx=0x7efdac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:13.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.463+0000 7efdbb7fe640 1 -- 172.21.15.114:0/407838436 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac00b6c0 con 0x7efdc40ce240 2023-11-04T01:40:13.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.464+0000 7efdbb7fe640 1 -- 172.21.15.114:0/407838436 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac00b820 con 0x7efdc40ce240 2023-11-04T01:40:13.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.464+0000 7efdc96c2640 1 -- 172.21.15.114:0/407838436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc415b4a0 con 0x7efdc40ce240 2023-11-04T01:40:13.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.464+0000 7efdbb7fe640 1 -- 172.21.15.114:0/407838436 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac00bbb0 con 0x7efdc40ce240 2023-11-04T01:40:13.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.464+0000 7efdc96c2640 1 -- 172.21.15.114:0/407838436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc415ba60 con 0x7efdc40ce240 2023-11-04T01:40:13.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.465+0000 7efdc96c2640 1 -- 172.21.15.114:0/407838436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc4074290 con 0x7efdc40ce240 2023-11-04T01:40:13.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.465+0000 7efdbb7fe640 1 -- 172.21.15.114:0/407838436 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efdac00bd10 con 0x7efdc40ce240 2023-11-04T01:40:13.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.465+0000 7efdbb7fe640 1 --2- 172.21.15.114:0/407838436 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efda406aea0 0x7efda406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.466+0000 7efdbb7fe640 1 -- 172.21.15.114:0/407838436 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7178+0+0 (secure 0 0 0) 0x7efdac08a130 con 0x7efdc40ce240 2023-11-04T01:40:13.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.466+0000 7efdc2ffd640 1 --2- 172.21.15.114:0/407838436 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efda406aea0 0x7efda406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.466+0000 7efdc2ffd640 1 --2- 172.21.15.114:0/407838436 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efda406aea0 0x7efda406d360 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7efdb4006fd0 tx=0x7efdb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:13.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.470+0000 7efdbb7fe640 1 -- 172.21.15.114:0/407838436 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efdac054c20 con 0x7efdc40ce240 2023-11-04T01:40:13.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.668+0000 7efdc96c2640 1 -- 172.21.15.114:0/407838436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdc40c9580 con 0x7efdc40ce240 2023-11-04T01:40:13.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.669+0000 7efdbb7fe640 1 -- 172.21.15.114:0/407838436 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4942 (secure 0 0 0) 0x7efdac058240 con 0x7efdc40ce240 2023-11-04T01:40:13.671 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:13.671 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:10.996331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7431,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7431":{"gid":7431,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/3780323525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3780323525},{"type":"v1","addr":"172.21.15.114:6836","nonce":3780323525}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:13.671 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 47 2023-11-04T01:40:13.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.671+0000 7efdc96c2640 1 -- 172.21.15.114:0/407838436 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efda406aea0 msgr2=0x7efda406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.671+0000 7efdc96c2640 1 --2- 172.21.15.114:0/407838436 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efda406aea0 0x7efda406d360 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7efdb4006fd0 tx=0x7efdb4008040 comp rx=0 tx=0).stop 2023-11-04T01:40:13.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.671+0000 7efdc96c2640 1 -- 172.21.15.114:0/407838436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdc40ce240 msgr2=0x7efdc4153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.671+0000 7efdc96c2640 1 --2- 172.21.15.114:0/407838436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdc40ce240 0x7efdc4153550 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7efdac00d800 tx=0x7efdac00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.671+0000 7efdc96c2640 1 -- 172.21.15.114:0/407838436 shutdown_connections 2023-11-04T01:40:13.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.671+0000 7efdc96c2640 1 --2- 172.21.15.114:0/407838436 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4157540 0x7efdc41f2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.671+0000 7efdc96c2640 1 --2- 172.21.15.114:0/407838436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdc40ce240 0x7efdc4153550 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.671+0000 7efdc96c2640 1 --2- 172.21.15.114:0/407838436 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efda406aea0 0x7efda406d360 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.671+0000 7efdc96c2640 1 --2- 172.21.15.114:0/407838436 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efdc40cde60 0x7efdc415ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.671+0000 7efdc96c2640 1 -- 172.21.15.114:0/407838436 >> 172.21.15.114:0/407838436 conn(0x7efdc4071f30 msgr2=0x7efdc4072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:13.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.671+0000 7efdc96c2640 1 -- 172.21.15.114:0/407838436 shutdown_connections 2023-11-04T01:40:13.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:13.671+0000 7efdc96c2640 1 -- 172.21.15.114:0/407838436 wait complete. 2023-11-04T01:40:13.683 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-11-04T01:40:13.808 INFO:teuthology.orchestra.run.smithi141.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"8","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-11-04T01:40:13.809 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "8" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:40:13.809 INFO:tasks.cephfs.cephfs_test_case:[('/d1', 1)] =?= [('/d1', 1)] 2023-11-04T01:40:13.810 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:40:13.923 INFO:teuthology.orchestra.run.smithi114.stdout:{"last_snap":1,"last_created":1,"last_destroyed":1,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:40:13.924 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 1, "last_destroyed": 1, "last_snap": 1, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:40:13.924 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=1 2023-11-04T01:40:13.924 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:14.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.022+0000 7fbeadfd7640 1 Processor -- start 2023-11-04T01:40:14.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.022+0000 7fbeadfd7640 1 -- start start 2023-11-04T01:40:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.023+0000 7fbeadfd7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbea8070d40 0x7fbea806c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.023+0000 7fbeadfd7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea80cc990 con 0x7fbea80cda60 2023-11-04T01:40:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.023+0000 7fbeadfd7640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea80ccc70 con 0x7fbea80b0cd0 2023-11-04T01:40:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.023+0000 7fbeadfd7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea80c9ce0 con 0x7fbea8070d40 2023-11-04T01:40:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.023+0000 7fbea7fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbea8070d40 0x7fbea806c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.023+0000 7fbea77fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbea80cda60 0x7fbea80ca7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51014/0 (socket says 172.21.15.114:51014) 2023-11-04T01:40:14.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.023+0000 7fbea77fe640 1 -- 172.21.15.114:0/233418570 learned_addr learned my addr 172.21.15.114:0/233418570 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:14.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.023+0000 7fbea7fff640 1 -- 172.21.15.114:0/233418570 >> v1:172.21.15.141:6789/0 conn(0x7fbea80b0cd0 legacy=0x7fbea8070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.023+0000 7fbea7fff640 1 -- 172.21.15.114:0/233418570 >> v1:172.21.15.114:6789/0 conn(0x7fbea80cda60 legacy=0x7fbea80ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.023+0000 7fbea7fff640 1 -- 172.21.15.114:0/233418570 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea80c9fc0 con 0x7fbea8070d40 2023-11-04T01:40:14.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.024+0000 7fbea7fff640 1 --2- 172.21.15.114:0/233418570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbea8070d40 0x7fbea806c200 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fbea000aea0 tx=0x7fbea002d050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c673259cc98b50c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.024+0000 7fbea6ffd640 1 -- 172.21.15.114:0/233418570 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea002dbf0 con 0x7fbea8070d40 2023-11-04T01:40:14.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.024+0000 7fbea6ffd640 1 -- 172.21.15.114:0/233418570 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea002dd50 con 0x7fbea8070d40 2023-11-04T01:40:14.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.024+0000 7fbea6ffd640 1 -- 172.21.15.114:0/233418570 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0008660 con 0x7fbea8070d40 2023-11-04T01:40:14.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.024+0000 7fbeadfd7640 1 -- 172.21.15.114:0/233418570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbea8070d40 msgr2=0x7fbea806c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.025+0000 7fbeadfd7640 1 --2- 172.21.15.114:0/233418570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbea8070d40 0x7fbea806c200 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fbea000aea0 tx=0x7fbea002d050 comp rx=0 tx=0).stop 2023-11-04T01:40:14.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.025+0000 7fbeadfd7640 1 -- 172.21.15.114:0/233418570 shutdown_connections 2023-11-04T01:40:14.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.025+0000 7fbeadfd7640 1 --2- 172.21.15.114:0/233418570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbea8070d40 0x7fbea806c200 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.025+0000 7fbeadfd7640 1 -- 172.21.15.114:0/233418570 >> 172.21.15.114:0/233418570 conn(0x7fbea80ce950 msgr2=0x7fbea80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:14.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.025+0000 7fbeadfd7640 1 -- 172.21.15.114:0/233418570 shutdown_connections 2023-11-04T01:40:14.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.025+0000 7fbeadfd7640 1 -- 172.21.15.114:0/233418570 wait complete. 2023-11-04T01:40:14.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.026+0000 7fbeadfd7640 1 Processor -- start 2023-11-04T01:40:14.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.026+0000 7fbeadfd7640 1 -- start start 2023-11-04T01:40:14.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbeadfd7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbea8070d40 0x7fbea80c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbeadfd7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbea80b0cd0 0x7fbea8156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbeadfd7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbea80cda60 0x7fbea80c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbeadfd7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea80c6ad0 con 0x7fbea80cda60 2023-11-04T01:40:14.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbeadfd7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea80c6db0 con 0x7fbea80b0cd0 2023-11-04T01:40:14.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbeadfd7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea80c7090 con 0x7fbea8070d40 2023-11-04T01:40:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbea7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbea80cda60 0x7fbea80c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbea7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbea80cda60 0x7fbea80c4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52398/0 (socket says 172.21.15.114:52398) 2023-11-04T01:40:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbea7fff640 1 -- 172.21.15.114:0/456725552 learned_addr learned my addr 172.21.15.114:0/456725552 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbe9effd640 1 --2- 172.21.15.114:0/456725552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbea80b0cd0 0x7fbea8156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbea7fff640 1 -- 172.21.15.114:0/456725552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbea8070d40 msgr2=0x7fbea80c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbea77fe640 1 --2- 172.21.15.114:0/456725552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbea8070d40 0x7fbea80c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbea7fff640 1 --2- 172.21.15.114:0/456725552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbea8070d40 0x7fbea80c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbea7fff640 1 -- 172.21.15.114:0/456725552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbea80b0cd0 msgr2=0x7fbea8156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbea7fff640 1 --2- 172.21.15.114:0/456725552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbea80b0cd0 0x7fbea8156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbea7fff640 1 -- 172.21.15.114:0/456725552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea000ab80 con 0x7fbea80cda60 2023-11-04T01:40:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbe9effd640 1 --2- 172.21.15.114:0/456725552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbea80b0cd0 0x7fbea8156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbea7fff640 1 --2- 172.21.15.114:0/456725552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbea80cda60 0x7fbea80c4e90 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fbea000aea0 tx=0x7fbea0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbea4ff9640 1 -- 172.21.15.114:0/456725552 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0040670 con 0x7fbea80cda60 2023-11-04T01:40:14.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbea4ff9640 1 -- 172.21.15.114:0/456725552 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea00407d0 con 0x7fbea80cda60 2023-11-04T01:40:14.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbeadfd7640 1 -- 172.21.15.114:0/456725552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea80c7370 con 0x7fbea80cda60 2023-11-04T01:40:14.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbea4ff9640 1 -- 172.21.15.114:0/456725552 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0040b80 con 0x7fbea80cda60 2023-11-04T01:40:14.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.027+0000 7fbeadfd7640 1 -- 172.21.15.114:0/456725552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea80a8290 con 0x7fbea80cda60 2023-11-04T01:40:14.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.028+0000 7fbeadfd7640 1 -- 172.21.15.114:0/456725552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea80adb80 con 0x7fbea80cda60 2023-11-04T01:40:14.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.029+0000 7fbea4ff9640 1 -- 172.21.15.114:0/456725552 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbea0040ce0 con 0x7fbea80cda60 2023-11-04T01:40:14.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.029+0000 7fbea4ff9640 1 --2- 172.21.15.114:0/456725552 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbe8806ae70 0x7fbe8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.029+0000 7fbea4ff9640 1 -- 172.21.15.114:0/456725552 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7178+0+0 (secure 0 0 0) 0x7fbea00ad010 con 0x7fbea80cda60 2023-11-04T01:40:14.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.029+0000 7fbea77fe640 1 --2- 172.21.15.114:0/456725552 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbe8806ae70 0x7fbe8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.030+0000 7fbea77fe640 1 --2- 172.21.15.114:0/456725552 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbe8806ae70 0x7fbe8806d330 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fbe98005880 tx=0x7fbe98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.033+0000 7fbea4ff9640 1 -- 172.21.15.114:0/456725552 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbea0077b00 con 0x7fbea80cda60 2023-11-04T01:40:14.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.234+0000 7fbeadfd7640 1 -- 172.21.15.114:0/456725552 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbea8074290 con 0x7fbea80cda60 2023-11-04T01:40:14.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.234+0000 7fbea4ff9640 1 -- 172.21.15.114:0/456725552 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4942 (secure 0 0 0) 0x7fbea007b120 con 0x7fbea80cda60 2023-11-04T01:40:14.236 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:14.237 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:10.996331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7431,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7431":{"gid":7431,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/3780323525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3780323525},{"type":"v1","addr":"172.21.15.114:6836","nonce":3780323525}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:14.237 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 47 2023-11-04T01:40:14.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.236+0000 7fbeadfd7640 1 -- 172.21.15.114:0/456725552 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbe8806ae70 msgr2=0x7fbe8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.236+0000 7fbeadfd7640 1 --2- 172.21.15.114:0/456725552 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbe8806ae70 0x7fbe8806d330 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fbe98005880 tx=0x7fbe98009040 comp rx=0 tx=0).stop 2023-11-04T01:40:14.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.236+0000 7fbeadfd7640 1 -- 172.21.15.114:0/456725552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbea80cda60 msgr2=0x7fbea80c4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.236+0000 7fbeadfd7640 1 --2- 172.21.15.114:0/456725552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbea80cda60 0x7fbea80c4e90 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fbea000aea0 tx=0x7fbea0004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:14.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.237+0000 7fbeadfd7640 1 -- 172.21.15.114:0/456725552 shutdown_connections 2023-11-04T01:40:14.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.237+0000 7fbeadfd7640 1 --2- 172.21.15.114:0/456725552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbea80cda60 0x7fbea80c4e90 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.237+0000 7fbeadfd7640 1 --2- 172.21.15.114:0/456725552 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbe8806ae70 0x7fbe8806d330 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.237+0000 7fbeadfd7640 1 --2- 172.21.15.114:0/456725552 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbea80b0cd0 0x7fbea8156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.237+0000 7fbeadfd7640 1 --2- 172.21.15.114:0/456725552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbea8070d40 0x7fbea80c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.237+0000 7fbeadfd7640 1 -- 172.21.15.114:0/456725552 >> 172.21.15.114:0/456725552 conn(0x7fbea80ce950 msgr2=0x7fbea80af610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:14.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.237+0000 7fbeadfd7640 1 -- 172.21.15.114:0/456725552 shutdown_connections 2023-11-04T01:40:14.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.237+0000 7fbeadfd7640 1 -- 172.21.15.114:0/456725552 wait complete. 2023-11-04T01:40:14.249 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:40:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.348+0000 7f7367eaf640 1 Processor -- start 2023-11-04T01:40:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.349+0000 7f7367eaf640 1 -- start start 2023-11-04T01:40:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.349+0000 7f7367eaf640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f73600cd6d0 0x7f7360161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.349+0000 7f7367eaf640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73600b4880 0x7f73600b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.349+0000 7f7367eaf640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73600cde60 con 0x7f7360153e60 2023-11-04T01:40:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.349+0000 7f7367eaf640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7360160f90 con 0x7f73600cd6d0 2023-11-04T01:40:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.349+0000 7f7367eaf640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7360161960 con 0x7f73600b4880 2023-11-04T01:40:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.350+0000 7f736644c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73600b4880 0x7f73600b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.350+0000 7f736544a640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f73600cd6d0 0x7f7360161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.350+0000 7f7365c4b640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f7360153e60 0x7f736015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:41436/0 (socket says 172.21.15.114:41436) 2023-11-04T01:40:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.350+0000 7f7365c4b640 1 -- 172.21.15.114:0/3472628097 learned_addr learned my addr 172.21.15.114:0/3472628097 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.350+0000 7f7364c49640 1 -- 172.21.15.114:0/3472628097 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905771617 0 0) 0x7f73600cde60 con 0x7f7360153e60 2023-11-04T01:40:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.350+0000 7f7364c49640 1 -- 172.21.15.114:0/3472628097 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f734c003520 con 0x7f7360153e60 2023-11-04T01:40:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.350+0000 7f736644c640 1 -- 172.21.15.114:0/3472628097 >> v2:172.21.15.141:3300/0 conn(0x7f73600cd6d0 msgr2=0x7f7360161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.350+0000 7f736644c640 1 --2- 172.21.15.114:0/3472628097 >> v2:172.21.15.141:3300/0 conn(0x7f73600cd6d0 0x7f7360161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.350+0000 7f736644c640 1 -- 172.21.15.114:0/3472628097 >> v1:172.21.15.141:6789/0 conn(0x7f7360153e60 legacy=0x7f736015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.350+0000 7f736644c640 1 -- 172.21.15.114:0/3472628097 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73600b5220 con 0x7f73600b4880 2023-11-04T01:40:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.350+0000 7f736544a640 1 --2- 172.21.15.114:0/3472628097 >> v2:172.21.15.141:3300/0 conn(0x7f73600cd6d0 0x7f7360161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.351+0000 7f736644c640 1 --2- 172.21.15.114:0/3472628097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73600b4880 0x7f73600b4ce0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7358009d90 tx=0x7f735802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe86c8030b5372bb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.351+0000 7f7364c49640 1 -- 172.21.15.114:0/3472628097 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735802cc50 con 0x7f73600b4880 2023-11-04T01:40:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.351+0000 7f7364c49640 1 -- 172.21.15.114:0/3472628097 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735802cdb0 con 0x7f73600b4880 2023-11-04T01:40:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.351+0000 7f7364c49640 1 -- 172.21.15.114:0/3472628097 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358034640 con 0x7f73600b4880 2023-11-04T01:40:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.352+0000 7f7367eaf640 1 -- 172.21.15.114:0/3472628097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73600b4880 msgr2=0x7f73600b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.352+0000 7f7367eaf640 1 --2- 172.21.15.114:0/3472628097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73600b4880 0x7f73600b4ce0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7358009d90 tx=0x7f735802bea0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.352+0000 7f7367eaf640 1 -- 172.21.15.114:0/3472628097 shutdown_connections 2023-11-04T01:40:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.352+0000 7f7367eaf640 1 --2- 172.21.15.114:0/3472628097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73600b4880 0x7f73600b4ce0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.352+0000 7f7367eaf640 1 --2- 172.21.15.114:0/3472628097 >> v2:172.21.15.141:3300/0 conn(0x7f73600cd6d0 0x7f7360161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.352+0000 7f7367eaf640 1 -- 172.21.15.114:0/3472628097 >> 172.21.15.114:0/3472628097 conn(0x7f73600cf880 msgr2=0x7f73600cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.352+0000 7f7367eaf640 1 -- 172.21.15.114:0/3472628097 shutdown_connections 2023-11-04T01:40:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.352+0000 7f7367eaf640 1 -- 172.21.15.114:0/3472628097 wait complete. 2023-11-04T01:40:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.353+0000 7f7367eaf640 1 Processor -- start 2023-11-04T01:40:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.353+0000 7f7367eaf640 1 -- start start 2023-11-04T01:40:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f7367eaf640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73600b4880 0x7f7360157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f7367eaf640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f73600cd6d0 0x7f73600cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f7367eaf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7360153e60 0x7f73600cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f7367eaf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73600c92e0 con 0x7f7360153e60 2023-11-04T01:40:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f7367eaf640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736015b9e0 con 0x7f73600cd6d0 2023-11-04T01:40:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f7367eaf640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736015ae50 con 0x7f73600b4880 2023-11-04T01:40:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f736644c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7360153e60 0x7f73600cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f736644c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7360153e60 0x7f73600cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52414/0 (socket says 172.21.15.114:52414) 2023-11-04T01:40:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f736644c640 1 -- 172.21.15.114:0/1638809773 learned_addr learned my addr 172.21.15.114:0/1638809773 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f7365c4b640 1 --2- 172.21.15.114:0/1638809773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73600b4880 0x7f7360157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f736544a640 1 --2- 172.21.15.114:0/1638809773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f73600cd6d0 0x7f73600cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f736644c640 1 -- 172.21.15.114:0/1638809773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73600b4880 msgr2=0x7f7360157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f736644c640 1 --2- 172.21.15.114:0/1638809773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73600b4880 0x7f7360157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f736644c640 1 -- 172.21.15.114:0/1638809773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f73600cd6d0 msgr2=0x7f73600cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f736644c640 1 --2- 172.21.15.114:0/1638809773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f73600cd6d0 0x7f73600cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f736644c640 1 -- 172.21.15.114:0/1638809773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c009400 con 0x7f7360153e60 2023-11-04T01:40:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.354+0000 7f736544a640 1 --2- 172.21.15.114:0/1638809773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f73600cd6d0 0x7f73600cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.355+0000 7f736644c640 1 --2- 172.21.15.114:0/1638809773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7360153e60 0x7f73600cb160 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f7358009eb0 tx=0x7f7358004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.355+0000 7f73567fc640 1 -- 172.21.15.114:0/1638809773 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735803e610 con 0x7f7360153e60 2023-11-04T01:40:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.355+0000 7f73567fc640 1 -- 172.21.15.114:0/1638809773 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735803e770 con 0x7f7360153e60 2023-11-04T01:40:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.355+0000 7f7367eaf640 1 -- 172.21.15.114:0/1638809773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7358009a70 con 0x7f7360153e60 2023-11-04T01:40:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.355+0000 7f73567fc640 1 -- 172.21.15.114:0/1638809773 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735803eb60 con 0x7f7360153e60 2023-11-04T01:40:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.355+0000 7f7367eaf640 1 -- 172.21.15.114:0/1638809773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736015b390 con 0x7f7360153e60 2023-11-04T01:40:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.356+0000 7f7367eaf640 1 -- 172.21.15.114:0/1638809773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7360074290 con 0x7f7360153e60 2023-11-04T01:40:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.356+0000 7f73567fc640 1 -- 172.21.15.114:0/1638809773 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f735803b050 con 0x7f7360153e60 2023-11-04T01:40:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.357+0000 7f73567fc640 1 --2- 172.21.15.114:0/1638809773 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f734406ae70 0x7f734406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.357+0000 7f7365c4b640 1 --2- 172.21.15.114:0/1638809773 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f734406ae70 0x7f734406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.357+0000 7f73567fc640 1 -- 172.21.15.114:0/1638809773 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f73580abe00 con 0x7f7360153e60 2023-11-04T01:40:14.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.357+0000 7f7365c4b640 1 --2- 172.21.15.114:0/1638809773 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f734406ae70 0x7f734406d330 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7350005880 tx=0x7f7350009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.361+0000 7f73567fc640 1 -- 172.21.15.114:0/1638809773 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7358076870 con 0x7f7360153e60 2023-11-04T01:40:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.592+0000 7f7367eaf640 1 -- 172.21.15.114:0/1638809773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f736015bb20 con 0x7f7360153e60 2023-11-04T01:40:14.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.858+0000 7f73567fc640 1 -- 172.21.15.114:0/1638809773 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7431 v48) v1 ==== 112+0+0 (secure 0 0 0) 0x7f7358009450 con 0x7f7360153e60 2023-11-04T01:40:14.860 INFO:teuthology.orchestra.run.smithi114.stderr:freezing mds.7431 2023-11-04T01:40:14.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.860+0000 7f7367eaf640 1 -- 172.21.15.114:0/1638809773 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f734406ae70 msgr2=0x7f734406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.860+0000 7f7367eaf640 1 --2- 172.21.15.114:0/1638809773 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f734406ae70 0x7f734406d330 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7350005880 tx=0x7f7350009040 comp rx=0 tx=0).stop 2023-11-04T01:40:14.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.860+0000 7f7367eaf640 1 -- 172.21.15.114:0/1638809773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7360153e60 msgr2=0x7f73600cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.860+0000 7f7367eaf640 1 --2- 172.21.15.114:0/1638809773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7360153e60 0x7f73600cb160 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f7358009eb0 tx=0x7f7358004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:14.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.860+0000 7f7367eaf640 1 -- 172.21.15.114:0/1638809773 shutdown_connections 2023-11-04T01:40:14.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.860+0000 7f7367eaf640 1 --2- 172.21.15.114:0/1638809773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7360153e60 0x7f73600cb160 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.860+0000 7f7367eaf640 1 --2- 172.21.15.114:0/1638809773 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f734406ae70 0x7f734406d330 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.860+0000 7f7367eaf640 1 --2- 172.21.15.114:0/1638809773 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f73600cd6d0 0x7f73600cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.860+0000 7f7367eaf640 1 --2- 172.21.15.114:0/1638809773 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f73600b4880 0x7f7360157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.860+0000 7f7367eaf640 1 -- 172.21.15.114:0/1638809773 >> 172.21.15.114:0/1638809773 conn(0x7f73600cf880 msgr2=0x7f73600d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:14.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.860+0000 7f7367eaf640 1 -- 172.21.15.114:0/1638809773 shutdown_connections 2023-11-04T01:40:14.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:14.860+0000 7f7367eaf640 1 -- 172.21.15.114:0/1638809773 wait complete. 2023-11-04T01:40:14.873 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_kill_mdstable_at 1 2023-11-04T01:40:14.984 INFO:teuthology.orchestra.run.smithi114.stdout:{"success":"mds_kill_mdstable_at = '1' (not observed, change may require restart) "} 2023-11-04T01:40:14.984 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '1' (not observed, change may require restart) " } 2023-11-04T01:40:14.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:14.984 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s11) 2023-11-04T01:40:14.987 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:40:15.003 INFO:tasks.ceph.mds.c.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7feb1cf25640 time 2023-11-04T01:40:15.002886+0000 2023-11-04T01:40:15.003 INFO:tasks.ceph.mds.c.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:40:15.004 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:15.004 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feb22b6efaf] 2023-11-04T01:40:15.005 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7feb22b6f16d] 2023-11-04T01:40:15.005 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x559b7fadc254] 2023-11-04T01:40:15.005 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559b7f86f0a9] 2023-11-04T01:40:15.005 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x559b7f871b2b] 2023-11-04T01:40:15.005 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559b7f87201c] 2023-11-04T01:40:15.005 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559b7f85b325] 2023-11-04T01:40:15.005 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7feb22d5ff9a] 2023-11-04T01:40:15.005 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7feb22df1741] 2023-11-04T01:40:15.005 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7feb2229f802] 2023-11-04T01:40:15.005 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7feb2223f450] 2023-11-04T01:40:15.005 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:40:15.002+0000 7feb1cf25640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7feb1cf25640 time 2023-11-04T01:40:15.002886+0000 2023-11-04T01:40:15.005 INFO:tasks.ceph.mds.c.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:40:15.006 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:40:15.006 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:15.006 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feb22b6efaf] 2023-11-04T01:40:15.006 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7feb22b6f16d] 2023-11-04T01:40:15.006 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x559b7fadc254] 2023-11-04T01:40:15.006 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559b7f86f0a9] 2023-11-04T01:40:15.006 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x559b7f871b2b] 2023-11-04T01:40:15.006 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559b7f87201c] 2023-11-04T01:40:15.006 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559b7f85b325] 2023-11-04T01:40:15.006 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7feb22d5ff9a] 2023-11-04T01:40:15.006 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7feb22df1741] 2023-11-04T01:40:15.006 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7feb2229f802] 2023-11-04T01:40:15.006 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7feb2223f450] 2023-11-04T01:40:15.007 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:40:15.007 INFO:tasks.ceph.mds.c.smithi114.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:40:15.007 INFO:tasks.ceph.mds.c.smithi114.stderr: in thread 7feb1cf25640 thread_name:ms_dispatch 2023-11-04T01:40:15.007 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:15.007 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7feb22254db0] 2023-11-04T01:40:15.007 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7feb222a154c] 2023-11-04T01:40:15.007 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: raise() 2023-11-04T01:40:15.007 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: abort() 2023-11-04T01:40:15.007 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feb22b6f009] 2023-11-04T01:40:15.007 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7feb22b6f16d] 2023-11-04T01:40:15.007 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x559b7fadc254] 2023-11-04T01:40:15.007 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559b7f86f0a9] 2023-11-04T01:40:15.007 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x559b7f871b2b] 2023-11-04T01:40:15.008 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559b7f87201c] 2023-11-04T01:40:15.008 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559b7f85b325] 2023-11-04T01:40:15.008 INFO:tasks.ceph.mds.c.smithi114.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7feb22d5ff9a] 2023-11-04T01:40:15.008 INFO:tasks.ceph.mds.c.smithi114.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7feb22df1741] 2023-11-04T01:40:15.008 INFO:tasks.ceph.mds.c.smithi114.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7feb2229f802] 2023-11-04T01:40:15.008 INFO:tasks.ceph.mds.c.smithi114.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7feb2223f450] 2023-11-04T01:40:15.008 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:40:15.003+0000 7feb1cf25640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:15.008 INFO:tasks.ceph.mds.c.smithi114.stderr: in thread 7feb1cf25640 thread_name:ms_dispatch 2023-11-04T01:40:15.008 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:40:15.008 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:15.008 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7feb22254db0] 2023-11-04T01:40:15.008 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7feb222a154c] 2023-11-04T01:40:15.008 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: raise() 2023-11-04T01:40:15.009 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: abort() 2023-11-04T01:40:15.009 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feb22b6f009] 2023-11-04T01:40:15.009 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7feb22b6f16d] 2023-11-04T01:40:15.009 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x559b7fadc254] 2023-11-04T01:40:15.009 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559b7f86f0a9] 2023-11-04T01:40:15.009 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x559b7f871b2b] 2023-11-04T01:40:15.009 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559b7f87201c] 2023-11-04T01:40:15.009 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559b7f85b325] 2023-11-04T01:40:15.009 INFO:tasks.ceph.mds.c.smithi114.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7feb22d5ff9a] 2023-11-04T01:40:15.009 INFO:tasks.ceph.mds.c.smithi114.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7feb22df1741] 2023-11-04T01:40:15.009 INFO:tasks.ceph.mds.c.smithi114.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7feb2229f802] 2023-11-04T01:40:15.009 INFO:tasks.ceph.mds.c.smithi114.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7feb2223f450] 2023-11-04T01:40:15.010 INFO:tasks.ceph.mds.c.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:15.010 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:40:15.010 INFO:tasks.ceph.mds.c.smithi114.stderr: -2553> 2023-11-04T01:39:57.017+0000 7feb1a720640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:15.010 INFO:tasks.ceph.mds.c.smithi114.stderr: -2105> 2023-11-04T01:40:02.017+0000 7feb1a720640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:15.011 INFO:tasks.ceph.mds.c.smithi114.stderr: -1> 2023-11-04T01:40:15.002+0000 7feb1cf25640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7feb1cf25640 time 2023-11-04T01:40:15.002886+0000 2023-11-04T01:40:15.011 INFO:tasks.ceph.mds.c.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:40:15.011 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:40:15.011 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:15.011 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feb22b6efaf] 2023-11-04T01:40:15.011 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7feb22b6f16d] 2023-11-04T01:40:15.011 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x559b7fadc254] 2023-11-04T01:40:15.011 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559b7f86f0a9] 2023-11-04T01:40:15.011 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x559b7f871b2b] 2023-11-04T01:40:15.011 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559b7f87201c] 2023-11-04T01:40:15.011 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559b7f85b325] 2023-11-04T01:40:15.011 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7feb22d5ff9a] 2023-11-04T01:40:15.012 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7feb22df1741] 2023-11-04T01:40:15.012 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7feb2229f802] 2023-11-04T01:40:15.012 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7feb2223f450] 2023-11-04T01:40:15.012 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:40:15.012 INFO:tasks.ceph.mds.c.smithi114.stderr: 0> 2023-11-04T01:40:15.003+0000 7feb1cf25640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:15.012 INFO:tasks.ceph.mds.c.smithi114.stderr: in thread 7feb1cf25640 thread_name:ms_dispatch 2023-11-04T01:40:15.012 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:40:15.012 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:15.012 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7feb22254db0] 2023-11-04T01:40:15.012 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7feb222a154c] 2023-11-04T01:40:15.012 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: raise() 2023-11-04T01:40:15.012 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: abort() 2023-11-04T01:40:15.013 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feb22b6f009] 2023-11-04T01:40:15.013 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7feb22b6f16d] 2023-11-04T01:40:15.013 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x559b7fadc254] 2023-11-04T01:40:15.013 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559b7f86f0a9] 2023-11-04T01:40:15.013 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x559b7f871b2b] 2023-11-04T01:40:15.013 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559b7f87201c] 2023-11-04T01:40:15.013 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559b7f85b325] 2023-11-04T01:40:15.013 INFO:tasks.ceph.mds.c.smithi114.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7feb22d5ff9a] 2023-11-04T01:40:15.013 INFO:tasks.ceph.mds.c.smithi114.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7feb22df1741] 2023-11-04T01:40:15.013 INFO:tasks.ceph.mds.c.smithi114.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7feb2229f802] 2023-11-04T01:40:15.013 INFO:tasks.ceph.mds.c.smithi114.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7feb2223f450] 2023-11-04T01:40:15.013 INFO:tasks.ceph.mds.c.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:15.013 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:40:15.014 INFO:tasks.ceph.mds.c.smithi114.stderr: -2553> 2023-11-04T01:39:57.017+0000 7feb1a720640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:15.014 INFO:tasks.ceph.mds.c.smithi114.stderr: -2105> 2023-11-04T01:40:02.017+0000 7feb1a720640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:15.015 INFO:tasks.ceph.mds.c.smithi114.stderr: -1> 2023-11-04T01:40:15.002+0000 7feb1cf25640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7feb1cf25640 time 2023-11-04T01:40:15.002886+0000 2023-11-04T01:40:15.015 INFO:tasks.ceph.mds.c.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:40:15.015 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:40:15.015 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:15.015 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feb22b6efaf] 2023-11-04T01:40:15.016 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7feb22b6f16d] 2023-11-04T01:40:15.016 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x559b7fadc254] 2023-11-04T01:40:15.016 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559b7f86f0a9] 2023-11-04T01:40:15.016 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x559b7f871b2b] 2023-11-04T01:40:15.016 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559b7f87201c] 2023-11-04T01:40:15.016 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559b7f85b325] 2023-11-04T01:40:15.016 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7feb22d5ff9a] 2023-11-04T01:40:15.016 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7feb22df1741] 2023-11-04T01:40:15.016 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7feb2229f802] 2023-11-04T01:40:15.016 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7feb2223f450] 2023-11-04T01:40:15.016 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:40:15.016 INFO:tasks.ceph.mds.c.smithi114.stderr: 0> 2023-11-04T01:40:15.003+0000 7feb1cf25640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:15.016 INFO:tasks.ceph.mds.c.smithi114.stderr: in thread 7feb1cf25640 thread_name:ms_dispatch 2023-11-04T01:40:15.017 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:40:15.017 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:15.017 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7feb22254db0] 2023-11-04T01:40:15.017 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7feb222a154c] 2023-11-04T01:40:15.017 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: raise() 2023-11-04T01:40:15.017 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: abort() 2023-11-04T01:40:15.017 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feb22b6f009] 2023-11-04T01:40:15.017 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7feb22b6f16d] 2023-11-04T01:40:15.017 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x559b7fadc254] 2023-11-04T01:40:15.017 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559b7f86f0a9] 2023-11-04T01:40:15.017 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x559b7f871b2b] 2023-11-04T01:40:15.017 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559b7f87201c] 2023-11-04T01:40:15.017 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559b7f85b325] 2023-11-04T01:40:15.018 INFO:tasks.ceph.mds.c.smithi114.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7feb22d5ff9a] 2023-11-04T01:40:15.018 INFO:tasks.ceph.mds.c.smithi114.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7feb22df1741] 2023-11-04T01:40:15.018 INFO:tasks.ceph.mds.c.smithi114.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7feb2229f802] 2023-11-04T01:40:15.018 INFO:tasks.ceph.mds.c.smithi114.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7feb2223f450] 2023-11-04T01:40:15.018 INFO:tasks.ceph.mds.c.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:15.018 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:40:15.110 INFO:teuthology.orchestra.run.smithi114.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:40:15.110 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:40:15.110 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:15.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.249+0000 7f81fd78e640 1 Processor -- start 2023-11-04T01:40:15.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.249+0000 7f81fd78e640 1 -- start start 2023-11-04T01:40:15.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.249+0000 7f81fd78e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81f8157710 0x7f81f8167b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.249+0000 7f81fd78e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f815e000 con 0x7f81f80cde60 2023-11-04T01:40:15.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.249+0000 7f81fd78e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f815e2e0 con 0x7f81f80ce240 2023-11-04T01:40:15.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.249+0000 7f81fd78e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f815e5c0 con 0x7f81f8157710 2023-11-04T01:40:15.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f6ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f81f80cde60 0x7f81f815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51020/0 (socket says 172.21.15.114:51020) 2023-11-04T01:40:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f6ffd640 1 -- 172.21.15.114:0/3307766509 learned_addr learned my addr 172.21.15.114:0/3307766509 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f77fe640 1 --2- 172.21.15.114:0/3307766509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81f8157710 0x7f81f8167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 -- 172.21.15.114:0/3307766509 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974401656 0 0) 0x7f81f815e000 con 0x7f81f80cde60 2023-11-04T01:40:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 -- 172.21.15.114:0/3307766509 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e0003520 con 0x7f81f80cde60 2023-11-04T01:40:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 -- 172.21.15.114:0/3307766509 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550536862 0 0) 0x7f81f815e2e0 con 0x7f81f80ce240 2023-11-04T01:40:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 -- 172.21.15.114:0/3307766509 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81f815e000 con 0x7f81f80ce240 2023-11-04T01:40:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 -- 172.21.15.114:0/3307766509 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1361882175 0 0) 0x7f81e0003520 con 0x7f81f80cde60 2023-11-04T01:40:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 -- 172.21.15.114:0/3307766509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81f8157710 msgr2=0x7f81f8167b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 --2- 172.21.15.114:0/3307766509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81f8157710 0x7f81f8167b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 -- 172.21.15.114:0/3307766509 >> v1:172.21.15.141:6789/0 conn(0x7f81f80ce240 legacy=0x7f81f8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 -- 172.21.15.114:0/3307766509 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f80d1120 con 0x7f81f80cde60 2023-11-04T01:40:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 -- 172.21.15.114:0/3307766509 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f81e8001670 con 0x7f81f80cde60 2023-11-04T01:40:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 -- 172.21.15.114:0/3307766509 >> v1:172.21.15.114:6789/0 conn(0x7f81f80cde60 legacy=0x7f81f815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 --2- 172.21.15.114:0/3307766509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81e0003b30 0x7f81e0003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 --2- 172.21.15.114:0/3307766509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81f8157710 0x7f81e00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 --2- 172.21.15.114:0/3307766509 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81e0004d00 0x7f81e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 -- 172.21.15.114:0/3307766509 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f815e5c0 con 0x7f81e0003b30 2023-11-04T01:40:15.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 -- 172.21.15.114:0/3307766509 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e000ba30 con 0x7f81e0004d00 2023-11-04T01:40:15.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f5ffb640 1 -- 172.21.15.114:0/3307766509 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e000bbf0 con 0x7f81f8157710 2023-11-04T01:40:15.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f6ffd640 1 --2- 172.21.15.114:0/3307766509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81e0003b30 0x7f81e0003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f77fe640 1 --2- 172.21.15.114:0/3307766509 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81e0004d00 0x7f81e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.250+0000 7f81f67fc640 1 --2- 172.21.15.114:0/3307766509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81f8157710 0x7f81e00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.251+0000 7f81f6ffd640 1 -- 172.21.15.114:0/3307766509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81f8157710 msgr2=0x7f81e00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:15.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.251+0000 7f81f6ffd640 1 --2- 172.21.15.114:0/3307766509 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81f8157710 0x7f81e00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.251+0000 7f81f6ffd640 1 -- 172.21.15.114:0/3307766509 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81e0004d00 msgr2=0x7f81e0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:15.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.251+0000 7f81f6ffd640 1 --2- 172.21.15.114:0/3307766509 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81e0004d00 0x7f81e0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.251+0000 7f81f6ffd640 1 -- 172.21.15.114:0/3307766509 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e0003520 con 0x7f81e0003b30 2023-11-04T01:40:15.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.251+0000 7f81f6ffd640 1 --2- 172.21.15.114:0/3307766509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81e0003b30 0x7f81e0003f30 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f81e8007f90 tx=0x7f81e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe8f5486edd7007 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:15.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.251+0000 7f81f5ffb640 1 -- 172.21.15.114:0/3307766509 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e8005ad0 con 0x7f81e0003b30 2023-11-04T01:40:15.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.251+0000 7f81f5ffb640 1 -- 172.21.15.114:0/3307766509 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e8005c30 con 0x7f81e0003b30 2023-11-04T01:40:15.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.251+0000 7f81f5ffb640 1 -- 172.21.15.114:0/3307766509 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e802c790 con 0x7f81e0003b30 2023-11-04T01:40:15.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.252+0000 7f81fd78e640 1 -- 172.21.15.114:0/3307766509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81e0003b30 msgr2=0x7f81e0003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.252+0000 7f81fd78e640 1 --2- 172.21.15.114:0/3307766509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81e0003b30 0x7f81e0003f30 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f81e8007f90 tx=0x7f81e00057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.252+0000 7f81f77fe640 1 -- 172.21.15.114:0/3307766509 reap_dead start 2023-11-04T01:40:15.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.252+0000 7f81fd78e640 1 -- 172.21.15.114:0/3307766509 shutdown_connections 2023-11-04T01:40:15.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.252+0000 7f81fd78e640 1 -- 172.21.15.114:0/3307766509 >> 172.21.15.114:0/3307766509 conn(0x7f81f8071f30 msgr2=0x7f81f80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:15.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.252+0000 7f81fd78e640 1 -- 172.21.15.114:0/3307766509 shutdown_connections 2023-11-04T01:40:15.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.252+0000 7f81fd78e640 1 -- 172.21.15.114:0/3307766509 wait complete. 2023-11-04T01:40:15.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.253+0000 7f81fd78e640 1 Processor -- start 2023-11-04T01:40:15.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.253+0000 7f81fd78e640 1 -- start start 2023-11-04T01:40:15.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81fd78e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81e0003b30 0x7f81f814d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81fd78e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81f8154470 0x7f81f81f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81fd78e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81f81549c0 0x7f81f815a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81fd78e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f80cb950 con 0x7f81f8154470 2023-11-04T01:40:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81fd78e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f814d7a0 con 0x7f81e0003b30 2023-11-04T01:40:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81fd78e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f815ce90 con 0x7f81f81549c0 2023-11-04T01:40:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81f67fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81f8154470 0x7f81f81f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81f67fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81f8154470 0x7f81f81f28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52436/0 (socket says 172.21.15.114:52436) 2023-11-04T01:40:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81f67fc640 1 -- 172.21.15.114:0/430378849 learned_addr learned my addr 172.21.15.114:0/430378849 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81f6ffd640 1 --2- 172.21.15.114:0/430378849 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81e0003b30 0x7f81f814d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81f77fe640 1 --2- 172.21.15.114:0/430378849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81f81549c0 0x7f81f815a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81f67fc640 1 -- 172.21.15.114:0/430378849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81f81549c0 msgr2=0x7f81f815a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81f67fc640 1 --2- 172.21.15.114:0/430378849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81f81549c0 0x7f81f815a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81f67fc640 1 -- 172.21.15.114:0/430378849 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81e0003b30 msgr2=0x7f81f814d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81f67fc640 1 --2- 172.21.15.114:0/430378849 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81e0003b30 0x7f81f814d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81f67fc640 1 -- 172.21.15.114:0/430378849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f8159d90 con 0x7f81f8154470 2023-11-04T01:40:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.254+0000 7f81f67fc640 1 --2- 172.21.15.114:0/430378849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81f8154470 0x7f81f81f28c0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00f7a0 tx=0x7f81ec00fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.255+0000 7f81df7fe640 1 -- 172.21.15.114:0/430378849 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec00feb0 con 0x7f81f8154470 2023-11-04T01:40:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.255+0000 7f81df7fe640 1 -- 172.21.15.114:0/430378849 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec005320 con 0x7f81f8154470 2023-11-04T01:40:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.255+0000 7f81fd78e640 1 -- 172.21.15.114:0/430378849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f815a070 con 0x7f81f8154470 2023-11-04T01:40:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.255+0000 7f81df7fe640 1 -- 172.21.15.114:0/430378849 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec0072b0 con 0x7f81f8154470 2023-11-04T01:40:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.255+0000 7f81fd78e640 1 -- 172.21.15.114:0/430378849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f81f2e00 con 0x7f81f8154470 2023-11-04T01:40:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.256+0000 7f81fd78e640 1 -- 172.21.15.114:0/430378849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f80cbac0 con 0x7f81f8154470 2023-11-04T01:40:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.256+0000 7f81df7fe640 1 -- 172.21.15.114:0/430378849 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81ec007410 con 0x7f81f8154470 2023-11-04T01:40:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.256+0000 7f81df7fe640 1 --2- 172.21.15.114:0/430378849 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f81e406aea0 0x7f81e406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.257+0000 7f81f6ffd640 1 --2- 172.21.15.114:0/430378849 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f81e406aea0 0x7f81e406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.257+0000 7f81df7fe640 1 -- 172.21.15.114:0/430378849 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f81ec089640 con 0x7f81f8154470 2023-11-04T01:40:15.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.257+0000 7f81f6ffd640 1 --2- 172.21.15.114:0/430378849 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f81e406aea0 0x7f81e406d360 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f81e8034000 tx=0x7f81e8009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:15.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.261+0000 7f81df7fe640 1 -- 172.21.15.114:0/430378849 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81f80cbac0 con 0x7f81f8154470 2023-11-04T01:40:15.411 INFO:tasks.ceph.mds.c.smithi114.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:40:15.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.464+0000 7f81fd78e640 1 -- 172.21.15.114:0/430378849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81f80cba90 con 0x7f81f8154470 2023-11-04T01:40:15.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.464+0000 7f81df7fe640 1 -- 172.21.15.114:0/430378849 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4942 (secure 0 0 0) 0x7f81ec054130 con 0x7f81f8154470 2023-11-04T01:40:15.467 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:15.467 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:14.593325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7431,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7431":{"gid":7431,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/3780323525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3780323525},{"type":"v1","addr":"172.21.15.114:6836","nonce":3780323525}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:15.467 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 48 2023-11-04T01:40:15.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.466+0000 7f81fd78e640 1 -- 172.21.15.114:0/430378849 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f81e406aea0 msgr2=0x7f81e406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.466+0000 7f81fd78e640 1 --2- 172.21.15.114:0/430378849 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f81e406aea0 0x7f81e406d360 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f81e8034000 tx=0x7f81e8009030 comp rx=0 tx=0).stop 2023-11-04T01:40:15.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.466+0000 7f81fd78e640 1 -- 172.21.15.114:0/430378849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81f8154470 msgr2=0x7f81f81f28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.466+0000 7f81fd78e640 1 --2- 172.21.15.114:0/430378849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81f8154470 0x7f81f81f28c0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00f7a0 tx=0x7f81ec00fc60 comp rx=0 tx=0).stop 2023-11-04T01:40:15.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.466+0000 7f81fd78e640 1 -- 172.21.15.114:0/430378849 shutdown_connections 2023-11-04T01:40:15.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.466+0000 7f81fd78e640 1 --2- 172.21.15.114:0/430378849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81f81549c0 0x7f81f815a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.466+0000 7f81fd78e640 1 --2- 172.21.15.114:0/430378849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81f8154470 0x7f81f81f28c0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.466+0000 7f81fd78e640 1 --2- 172.21.15.114:0/430378849 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f81e406aea0 0x7f81e406d360 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.466+0000 7f81fd78e640 1 --2- 172.21.15.114:0/430378849 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81e0003b30 0x7f81f814d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.466+0000 7f81fd78e640 1 -- 172.21.15.114:0/430378849 >> 172.21.15.114:0/430378849 conn(0x7f81f8071f30 msgr2=0x7f81f80b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:15.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.466+0000 7f81fd78e640 1 -- 172.21.15.114:0/430378849 shutdown_connections 2023-11-04T01:40:15.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:15.466+0000 7f81fd78e640 1 -- 172.21.15.114:0/430378849 wait complete. 2023-11-04T01:40:15.479 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:18.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:40:20.381 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:20.384 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:20.480 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:20.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.588+0000 7f0765e07640 1 Processor -- start 2023-11-04T01:40:20.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.588+0000 7f0765e07640 1 -- start start 2023-11-04T01:40:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.588+0000 7f0765e07640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f07600ce240 0x7f0760157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.588+0000 7f0765e07640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0760157540 0x7f07600d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.588+0000 7f0765e07640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076015e000 con 0x7f07600cde60 2023-11-04T01:40:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.588+0000 7f0765e07640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076015e5c0 con 0x7f0760157540 2023-11-04T01:40:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.589+0000 7f0765e07640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076015e2e0 con 0x7f07600ce240 2023-11-04T01:40:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.589+0000 7f075ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0760157540 0x7f07600d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.589+0000 7f075ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0760157540 0x7f07600d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57956/0 (socket says 172.21.15.114:57956) 2023-11-04T01:40:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.589+0000 7f075ffff640 1 -- 172.21.15.114:0/2743176205 learned_addr learned my addr 172.21.15.114:0/2743176205 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.589+0000 7f075ffff640 1 -- 172.21.15.114:0/2743176205 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f07600ce240 msgr2=0x7f0760157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:20.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.589+0000 7f075ffff640 1 --2- 172.21.15.114:0/2743176205 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f07600ce240 0x7f0760157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.589+0000 7f075ffff640 1 -- 172.21.15.114:0/2743176205 >> v1:172.21.15.141:6789/0 conn(0x7f07600cde60 legacy=0x7f076015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:20.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.589+0000 7f075ffff640 1 -- 172.21.15.114:0/2743176205 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07600d1120 con 0x7f0760157540 2023-11-04T01:40:20.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.590+0000 7f075ffff640 1 --2- 172.21.15.114:0/2743176205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0760157540 0x7f07600d1920 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f0758009e50 tx=0x7f075802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d946f7861f331ea server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.590+0000 7f075effd640 1 -- 172.21.15.114:0/2743176205 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075802ca70 con 0x7f0760157540 2023-11-04T01:40:20.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.590+0000 7f075effd640 1 -- 172.21.15.114:0/2743176205 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075802cbd0 con 0x7f0760157540 2023-11-04T01:40:20.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.590+0000 7f075effd640 1 -- 172.21.15.114:0/2743176205 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07580343f0 con 0x7f0760157540 2023-11-04T01:40:20.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.590+0000 7f0765e07640 1 -- 172.21.15.114:0/2743176205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0760157540 msgr2=0x7f07600d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.590+0000 7f0765e07640 1 --2- 172.21.15.114:0/2743176205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0760157540 0x7f07600d1920 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f0758009e50 tx=0x7f075802bed0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.590+0000 7f0765e07640 1 -- 172.21.15.114:0/2743176205 shutdown_connections 2023-11-04T01:40:20.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.590+0000 7f0765e07640 1 --2- 172.21.15.114:0/2743176205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0760157540 0x7f07600d1920 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.590+0000 7f0765e07640 1 --2- 172.21.15.114:0/2743176205 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f07600ce240 0x7f0760157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.590+0000 7f0765e07640 1 -- 172.21.15.114:0/2743176205 >> 172.21.15.114:0/2743176205 conn(0x7f0760071f30 msgr2=0x7f07600cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:20.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.591+0000 7f0765e07640 1 -- 172.21.15.114:0/2743176205 shutdown_connections 2023-11-04T01:40:20.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.591+0000 7f0765e07640 1 -- 172.21.15.114:0/2743176205 wait complete. 2023-11-04T01:40:20.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.592+0000 7f0765e07640 1 Processor -- start 2023-11-04T01:40:20.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.592+0000 7f0765e07640 1 -- start start 2023-11-04T01:40:20.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.592+0000 7f0765e07640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f07600cde60 0x7f07600cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.592+0000 7f0765e07640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f07600ce240 0x7f076015b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.592+0000 7f0765e07640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0760157540 0x7f07601f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.592+0000 7f0765e07640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076015bc20 con 0x7f0760157540 2023-11-04T01:40:20.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.592+0000 7f0765e07640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076015bf00 con 0x7f07600ce240 2023-11-04T01:40:20.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.592+0000 7f0765e07640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076015c1e0 con 0x7f07600cde60 2023-11-04T01:40:20.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.593+0000 7f075ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0760157540 0x7f07601f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.593+0000 7f075ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0760157540 0x7f07601f21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57966/0 (socket says 172.21.15.114:57966) 2023-11-04T01:40:20.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.593+0000 7f075ffff640 1 -- 172.21.15.114:0/369218888 learned_addr learned my addr 172.21.15.114:0/369218888 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:20.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.593+0000 7f075f7fe640 1 --2- 172.21.15.114:0/369218888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f07600cde60 0x7f07600cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.593+0000 7f0757fff640 1 --2- 172.21.15.114:0/369218888 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f07600ce240 0x7f076015b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.593+0000 7f075ffff640 1 -- 172.21.15.114:0/369218888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f07600cde60 msgr2=0x7f07600cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.593+0000 7f075ffff640 1 --2- 172.21.15.114:0/369218888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f07600cde60 0x7f07600cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.593+0000 7f075ffff640 1 -- 172.21.15.114:0/369218888 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f07600ce240 msgr2=0x7f076015b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.593+0000 7f075ffff640 1 --2- 172.21.15.114:0/369218888 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f07600ce240 0x7f076015b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.593+0000 7f075ffff640 1 -- 172.21.15.114:0/369218888 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0758009b30 con 0x7f0760157540 2023-11-04T01:40:20.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.593+0000 7f075ffff640 1 --2- 172.21.15.114:0/369218888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0760157540 0x7f07601f21e0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f0758036040 tx=0x7f0758004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.593+0000 7f075cff9640 1 -- 172.21.15.114:0/369218888 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075803e450 con 0x7f0760157540 2023-11-04T01:40:20.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.593+0000 7f075cff9640 1 -- 172.21.15.114:0/369218888 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075803e5d0 con 0x7f0760157540 2023-11-04T01:40:20.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.593+0000 7f0765e07640 1 -- 172.21.15.114:0/369218888 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076015c4c0 con 0x7f0760157540 2023-11-04T01:40:20.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.593+0000 7f075cff9640 1 -- 172.21.15.114:0/369218888 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075803e980 con 0x7f0760157540 2023-11-04T01:40:20.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.593+0000 7f0765e07640 1 -- 172.21.15.114:0/369218888 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076015b8a0 con 0x7f0760157540 2023-11-04T01:40:20.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.594+0000 7f0765e07640 1 -- 172.21.15.114:0/369218888 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076015c9e0 con 0x7f0760157540 2023-11-04T01:40:20.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.595+0000 7f075cff9640 1 -- 172.21.15.114:0/369218888 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f075803eae0 con 0x7f0760157540 2023-11-04T01:40:20.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.595+0000 7f075cff9640 1 --2- 172.21.15.114:0/369218888 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f074006ae70 0x7f074006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.595+0000 7f075f7fe640 1 --2- 172.21.15.114:0/369218888 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f074006ae70 0x7f074006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.595+0000 7f075cff9640 1 -- 172.21.15.114:0/369218888 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f07580aca00 con 0x7f0760157540 2023-11-04T01:40:20.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.596+0000 7f075f7fe640 1 --2- 172.21.15.114:0/369218888 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f074006ae70 0x7f074006d330 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0750004ea0 tx=0x7f0750009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.599+0000 7f075cff9640 1 -- 172.21.15.114:0/369218888 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f076015c9e0 con 0x7f0760157540 2023-11-04T01:40:20.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.800+0000 7f0765e07640 1 -- 172.21.15.114:0/369218888 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f076015c9e0 con 0x7f0760157540 2023-11-04T01:40:20.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.800+0000 7f075cff9640 1 -- 172.21.15.114:0/369218888 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4942 (secure 0 0 0) 0x7f076015c9e0 con 0x7f0760157540 2023-11-04T01:40:20.802 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:20.803 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:14.593325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7431,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7431":{"gid":7431,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/3780323525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3780323525},{"type":"v1","addr":"172.21.15.114:6836","nonce":3780323525}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:20.803 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 48 2023-11-04T01:40:20.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.802+0000 7f0765e07640 1 -- 172.21.15.114:0/369218888 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f074006ae70 msgr2=0x7f074006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.802+0000 7f0765e07640 1 --2- 172.21.15.114:0/369218888 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f074006ae70 0x7f074006d330 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0750004ea0 tx=0x7f0750009040 comp rx=0 tx=0).stop 2023-11-04T01:40:20.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.803+0000 7f0765e07640 1 -- 172.21.15.114:0/369218888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0760157540 msgr2=0x7f07601f21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.803+0000 7f0765e07640 1 --2- 172.21.15.114:0/369218888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0760157540 0x7f07601f21e0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f0758036040 tx=0x7f0758004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:20.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.803+0000 7f0765e07640 1 -- 172.21.15.114:0/369218888 shutdown_connections 2023-11-04T01:40:20.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.803+0000 7f0765e07640 1 --2- 172.21.15.114:0/369218888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0760157540 0x7f07601f21e0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.803+0000 7f0765e07640 1 --2- 172.21.15.114:0/369218888 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f074006ae70 0x7f074006d330 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.803+0000 7f0765e07640 1 --2- 172.21.15.114:0/369218888 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f07600ce240 0x7f076015b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.803+0000 7f0765e07640 1 --2- 172.21.15.114:0/369218888 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f07600cde60 0x7f07600cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.803+0000 7f0765e07640 1 -- 172.21.15.114:0/369218888 >> 172.21.15.114:0/369218888 conn(0x7f0760071f30 msgr2=0x7f07600b6730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:20.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.803+0000 7f0765e07640 1 -- 172.21.15.114:0/369218888 shutdown_connections 2023-11-04T01:40:20.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:20.803+0000 7f0765e07640 1 -- 172.21.15.114:0/369218888 wait complete. 2023-11-04T01:40:20.815 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:25.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-04T01:40:25.816 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:25.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.926+0000 7f967c13c640 1 Processor -- start 2023-11-04T01:40:25.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.926+0000 7f967c13c640 1 -- start start 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f967c13c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f96740cda60 0x7f96740ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f967c13c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f96740b0cd0 0x7f9674070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f967c13c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96740cace0 0x7f9674070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f967c13c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96740cc990 con 0x7f96740cda60 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f967c13c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96740ccc70 con 0x7f96740b0cd0 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f967c13c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96740c9ce0 con 0x7f96740cace0 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f9679ed8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f96740cda60 0x7f96740ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f9679ed8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f96740cda60 0x7f96740ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57970/0 (socket says 172.21.15.114:57970) 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f9679ed8640 1 -- 172.21.15.114:0/1103790827 learned_addr learned my addr 172.21.15.114:0/1103790827 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:25.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f96796d7640 1 --2- 172.21.15.114:0/1103790827 >> v2:172.21.15.141:3300/0 conn(0x7f96740b0cd0 0x7f9674070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f9679ed8640 1 -- 172.21.15.114:0/1103790827 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96740cace0 msgr2=0x7f9674070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f967a6d9640 1 --2- 172.21.15.114:0/1103790827 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96740cace0 0x7f9674070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f9679ed8640 1 --2- 172.21.15.114:0/1103790827 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96740cace0 0x7f9674070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f9679ed8640 1 -- 172.21.15.114:0/1103790827 >> v2:172.21.15.141:3300/0 conn(0x7f96740b0cd0 msgr2=0x7f9674070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f9679ed8640 1 --2- 172.21.15.114:0/1103790827 >> v2:172.21.15.141:3300/0 conn(0x7f96740b0cd0 0x7f9674070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f9679ed8640 1 -- 172.21.15.114:0/1103790827 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96740c9fc0 con 0x7f96740cda60 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.927+0000 7f96796d7640 1 --2- 172.21.15.114:0/1103790827 >> v2:172.21.15.141:3300/0 conn(0x7f96740b0cd0 0x7f9674070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.928+0000 7f9679ed8640 1 --2- 172.21.15.114:0/1103790827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96740cda60 0x7f96740ca7a0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f967406e330 tx=0x7f967002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e72cd3f6c52107 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.928+0000 7f9678ed6640 1 -- 172.21.15.114:0/1103790827 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670031870 con 0x7f96740cda60 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.928+0000 7f9678ed6640 1 -- 172.21.15.114:0/1103790827 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96700319d0 con 0x7f96740cda60 2023-11-04T01:40:25.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.928+0000 7f9678ed6640 1 -- 172.21.15.114:0/1103790827 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670031d60 con 0x7f96740cda60 2023-11-04T01:40:25.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.929+0000 7f967c13c640 1 -- 172.21.15.114:0/1103790827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96740cda60 msgr2=0x7f96740ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.929+0000 7f967c13c640 1 --2- 172.21.15.114:0/1103790827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96740cda60 0x7f96740ca7a0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f967406e330 tx=0x7f967002b910 comp rx=0 tx=0).stop 2023-11-04T01:40:25.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.929+0000 7f967c13c640 1 -- 172.21.15.114:0/1103790827 shutdown_connections 2023-11-04T01:40:25.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.929+0000 7f967c13c640 1 --2- 172.21.15.114:0/1103790827 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96740cace0 0x7f9674070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.929+0000 7f967c13c640 1 --2- 172.21.15.114:0/1103790827 >> v2:172.21.15.141:3300/0 conn(0x7f96740b0cd0 0x7f9674070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.929+0000 7f967c13c640 1 --2- 172.21.15.114:0/1103790827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96740cda60 0x7f96740ca7a0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.929+0000 7f967c13c640 1 -- 172.21.15.114:0/1103790827 >> 172.21.15.114:0/1103790827 conn(0x7f96740ce950 msgr2=0x7f96740ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.929+0000 7f967c13c640 1 -- 172.21.15.114:0/1103790827 shutdown_connections 2023-11-04T01:40:25.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.929+0000 7f967c13c640 1 -- 172.21.15.114:0/1103790827 wait complete. 2023-11-04T01:40:25.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.930+0000 7f967c13c640 1 Processor -- start 2023-11-04T01:40:25.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.930+0000 7f967c13c640 1 -- start start 2023-11-04T01:40:25.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f967c13c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96740b0cd0 0x7f9674166b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f967c13c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96740cace0 0x7f967415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f967c13c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96740cda60 0x7f96741589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f967c13c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96740ab8e0 con 0x7f96740b0cd0 2023-11-04T01:40:25.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f967c13c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967415bdd0 con 0x7f96740cace0 2023-11-04T01:40:25.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f967c13c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967415c0b0 con 0x7f96740cda60 2023-11-04T01:40:25.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f9679ed8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96740b0cd0 0x7f9674166b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f9679ed8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96740b0cd0 0x7f9674166b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57984/0 (socket says 172.21.15.114:57984) 2023-11-04T01:40:25.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f9679ed8640 1 -- 172.21.15.114:0/2490219125 learned_addr learned my addr 172.21.15.114:0/2490219125 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:25.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f96796d7640 1 --2- 172.21.15.114:0/2490219125 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96740cace0 0x7f967415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f967a6d9640 1 --2- 172.21.15.114:0/2490219125 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96740cda60 0x7f96741589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f9679ed8640 1 -- 172.21.15.114:0/2490219125 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96740cda60 msgr2=0x7f96741589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f9679ed8640 1 --2- 172.21.15.114:0/2490219125 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96740cda60 0x7f96741589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f9679ed8640 1 -- 172.21.15.114:0/2490219125 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96740cace0 msgr2=0x7f967415b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f9679ed8640 1 --2- 172.21.15.114:0/2490219125 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96740cace0 0x7f967415b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f9679ed8640 1 -- 172.21.15.114:0/2490219125 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96700094d0 con 0x7f96740b0cd0 2023-11-04T01:40:25.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f967a6d9640 1 --2- 172.21.15.114:0/2490219125 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96740cda60 0x7f96741589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:25.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f9679ed8640 1 --2- 172.21.15.114:0/2490219125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96740b0cd0 0x7f9674166b40 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f967002b950 tx=0x7f96700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.931+0000 7f966a7fc640 1 -- 172.21.15.114:0/2490219125 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670031860 con 0x7f96740b0cd0 2023-11-04T01:40:25.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.932+0000 7f966a7fc640 1 -- 172.21.15.114:0/2490219125 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96700443f0 con 0x7f96740b0cd0 2023-11-04T01:40:25.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.932+0000 7f967c13c640 1 -- 172.21.15.114:0/2490219125 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96740abba0 con 0x7f96740b0cd0 2023-11-04T01:40:25.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.932+0000 7f966a7fc640 1 -- 172.21.15.114:0/2490219125 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96700447a0 con 0x7f96740b0cd0 2023-11-04T01:40:25.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.932+0000 7f967c13c640 1 -- 172.21.15.114:0/2490219125 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96740c8600 con 0x7f96740b0cd0 2023-11-04T01:40:25.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.933+0000 7f967c13c640 1 -- 172.21.15.114:0/2490219125 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9674074290 con 0x7f96740b0cd0 2023-11-04T01:40:25.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.933+0000 7f966a7fc640 1 -- 172.21.15.114:0/2490219125 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f967004d450 con 0x7f96740b0cd0 2023-11-04T01:40:25.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.933+0000 7f966a7fc640 1 --2- 172.21.15.114:0/2490219125 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f965806ae70 0x7f965806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.933+0000 7f966a7fc640 1 -- 172.21.15.114:0/2490219125 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f967002d040 con 0x7f96740b0cd0 2023-11-04T01:40:25.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.933+0000 7f96796d7640 1 --2- 172.21.15.114:0/2490219125 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f965806ae70 0x7f965806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.934+0000 7f96796d7640 1 --2- 172.21.15.114:0/2490219125 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f965806ae70 0x7f965806d330 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f967415b260 tx=0x7f9664008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:25.938+0000 7f966a7fc640 1 -- 172.21.15.114:0/2490219125 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9670076e00 con 0x7f96740b0cd0 2023-11-04T01:40:26.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:26.140+0000 7f967c13c640 1 -- 172.21.15.114:0/2490219125 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96740b48d0 con 0x7f96740b0cd0 2023-11-04T01:40:26.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:26.140+0000 7f966a7fc640 1 -- 172.21.15.114:0/2490219125 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4942 (secure 0 0 0) 0x7f967007a420 con 0x7f96740b0cd0 2023-11-04T01:40:26.143 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:26.143 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:14.593325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7431,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7431":{"gid":7431,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/3780323525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3780323525},{"type":"v1","addr":"172.21.15.114:6836","nonce":3780323525}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:26.143 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 48 2023-11-04T01:40:26.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:26.142+0000 7f967c13c640 1 -- 172.21.15.114:0/2490219125 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f965806ae70 msgr2=0x7f965806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:26.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:26.142+0000 7f967c13c640 1 --2- 172.21.15.114:0/2490219125 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f965806ae70 0x7f965806d330 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f967415b260 tx=0x7f9664008040 comp rx=0 tx=0).stop 2023-11-04T01:40:26.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:26.142+0000 7f967c13c640 1 -- 172.21.15.114:0/2490219125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96740b0cd0 msgr2=0x7f9674166b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:26.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:26.142+0000 7f967c13c640 1 --2- 172.21.15.114:0/2490219125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96740b0cd0 0x7f9674166b40 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f967002b950 tx=0x7f96700046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:26.142+0000 7f967c13c640 1 -- 172.21.15.114:0/2490219125 shutdown_connections 2023-11-04T01:40:26.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:26.142+0000 7f967c13c640 1 --2- 172.21.15.114:0/2490219125 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f96740cda60 0x7f96741589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:26.142+0000 7f967c13c640 1 --2- 172.21.15.114:0/2490219125 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f965806ae70 0x7f965806d330 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:26.142+0000 7f967c13c640 1 --2- 172.21.15.114:0/2490219125 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f96740cace0 0x7f967415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:26.142+0000 7f967c13c640 1 --2- 172.21.15.114:0/2490219125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96740b0cd0 0x7f9674166b40 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:26.142+0000 7f967c13c640 1 -- 172.21.15.114:0/2490219125 >> 172.21.15.114:0/2490219125 conn(0x7f96740ce950 msgr2=0x7f96740ae3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:26.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:26.143+0000 7f967c13c640 1 -- 172.21.15.114:0/2490219125 shutdown_connections 2023-11-04T01:40:26.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:26.143+0000 7f967c13c640 1 -- 172.21.15.114:0/2490219125 wait complete. 2023-11-04T01:40:26.155 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:31.156 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:31.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.265+0000 7fce8ad16640 1 Processor -- start 2023-11-04T01:40:31.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.265+0000 7fce8ad16640 1 -- start start 2023-11-04T01:40:31.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.265+0000 7fce8ad16640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fce840b0ae0 0x7fce840ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.265+0000 7fce8ad16640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce840b4110 con 0x7fce8406db20 2023-11-04T01:40:31.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.265+0000 7fce8ad16640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce840b43f0 con 0x7fce84159c70 2023-11-04T01:40:31.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.265+0000 7fce8ad16640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce840b49b0 con 0x7fce840b0ae0 2023-11-04T01:40:31.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.266+0000 7fce892b3640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fce8406db20 0x7fce8415d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37510/0 (socket says 172.21.15.114:37510) 2023-11-04T01:40:31.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.266+0000 7fce83fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fce840b0ae0 0x7fce840ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.266+0000 7fce892b3640 1 -- 172.21.15.114:0/2841996872 learned_addr learned my addr 172.21.15.114:0/2841996872 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:31.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.266+0000 7fce83fff640 1 -- 172.21.15.114:0/2841996872 >> v1:172.21.15.141:6789/0 conn(0x7fce84159c70 legacy=0x7fce840b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.266+0000 7fce83fff640 1 -- 172.21.15.114:0/2841996872 >> v1:172.21.15.114:6789/0 conn(0x7fce8406db20 legacy=0x7fce8415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.266+0000 7fce837fe640 1 -- 172.21.15.114:0/2841996872 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143599037 0 0) 0x7fce840b4110 con 0x7fce8406db20 2023-11-04T01:40:31.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.266+0000 7fce83fff640 1 -- 172.21.15.114:0/2841996872 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce840b46d0 con 0x7fce840b0ae0 2023-11-04T01:40:31.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.267+0000 7fce83fff640 1 --2- 172.21.15.114:0/2841996872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce840b0ae0 0x7fce840ce370 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0097a0 tx=0x7fce6c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc5ea8d983ddccf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.267+0000 7fce837fe640 1 -- 172.21.15.114:0/2841996872 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c030610 con 0x7fce840b0ae0 2023-11-04T01:40:31.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.267+0000 7fce837fe640 1 -- 172.21.15.114:0/2841996872 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c030770 con 0x7fce840b0ae0 2023-11-04T01:40:31.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.267+0000 7fce837fe640 1 -- 172.21.15.114:0/2841996872 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c030b00 con 0x7fce840b0ae0 2023-11-04T01:40:31.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.267+0000 7fce8ad16640 1 -- 172.21.15.114:0/2841996872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce840b0ae0 msgr2=0x7fce840ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.267+0000 7fce8ad16640 1 --2- 172.21.15.114:0/2841996872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce840b0ae0 0x7fce840ce370 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0097a0 tx=0x7fce6c02b960 comp rx=0 tx=0).stop 2023-11-04T01:40:31.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.267+0000 7fce8ad16640 1 -- 172.21.15.114:0/2841996872 shutdown_connections 2023-11-04T01:40:31.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.267+0000 7fce8ad16640 1 --2- 172.21.15.114:0/2841996872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce840b0ae0 0x7fce840ce370 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.267+0000 7fce8ad16640 1 -- 172.21.15.114:0/2841996872 >> 172.21.15.114:0/2841996872 conn(0x7fce840ce950 msgr2=0x7fce840ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:31.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.267+0000 7fce8ad16640 1 -- 172.21.15.114:0/2841996872 shutdown_connections 2023-11-04T01:40:31.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.268+0000 7fce8ad16640 1 -- 172.21.15.114:0/2841996872 wait complete. 2023-11-04T01:40:31.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.269+0000 7fce8ad16640 1 Processor -- start 2023-11-04T01:40:31.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.269+0000 7fce8ad16640 1 -- start start 2023-11-04T01:40:31.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce8ad16640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce8406db20 0x7fce840ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce8ad16640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce840b0ae0 0x7fce840ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce8ad16640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce84159c70 0x7fce840add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce8ad16640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce840b1ce0 con 0x7fce840b0ae0 2023-11-04T01:40:31.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce8ad16640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce840ac4f0 con 0x7fce8406db20 2023-11-04T01:40:31.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce8ad16640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce840ab8e0 con 0x7fce84159c70 2023-11-04T01:40:31.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce83fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce840b0ae0 0x7fce840ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce83fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce840b0ae0 0x7fce840ad7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52294/0 (socket says 172.21.15.114:52294) 2023-11-04T01:40:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce83fff640 1 -- 172.21.15.114:0/3661868726 learned_addr learned my addr 172.21.15.114:0/3661868726 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce88ab2640 1 --2- 172.21.15.114:0/3661868726 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce8406db20 0x7fce840ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce892b3640 1 --2- 172.21.15.114:0/3661868726 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce84159c70 0x7fce840add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce83fff640 1 -- 172.21.15.114:0/3661868726 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce84159c70 msgr2=0x7fce840add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce83fff640 1 --2- 172.21.15.114:0/3661868726 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce84159c70 0x7fce840add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce83fff640 1 -- 172.21.15.114:0/3661868726 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce8406db20 msgr2=0x7fce840ac980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce83fff640 1 --2- 172.21.15.114:0/3661868726 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce8406db20 0x7fce840ac980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce83fff640 1 -- 172.21.15.114:0/3661868726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c009400 con 0x7fce840b0ae0 2023-11-04T01:40:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce88ab2640 1 --2- 172.21.15.114:0/3661868726 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce8406db20 0x7fce840ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce83fff640 1 --2- 172.21.15.114:0/3661868726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce840b0ae0 0x7fce840ad7c0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0098c0 tx=0x7fce6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce817fa640 1 -- 172.21.15.114:0/3661868726 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c03e040 con 0x7fce840b0ae0 2023-11-04T01:40:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce817fa640 1 -- 172.21.15.114:0/3661868726 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c039cb0 con 0x7fce840b0ae0 2023-11-04T01:40:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce8ad16640 1 -- 172.21.15.114:0/3661868726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce840abbc0 con 0x7fce840b0ae0 2023-11-04T01:40:31.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce817fa640 1 -- 172.21.15.114:0/3661868726 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c044630 con 0x7fce840b0ae0 2023-11-04T01:40:31.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.270+0000 7fce8ad16640 1 -- 172.21.15.114:0/3661868726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce840ac180 con 0x7fce840b0ae0 2023-11-04T01:40:31.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.272+0000 7fce8ad16640 1 -- 172.21.15.114:0/3661868726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce84074290 con 0x7fce840b0ae0 2023-11-04T01:40:31.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.272+0000 7fce817fa640 1 -- 172.21.15.114:0/3661868726 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce6c04d3b0 con 0x7fce840b0ae0 2023-11-04T01:40:31.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.272+0000 7fce817fa640 1 --2- 172.21.15.114:0/3661868726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fce6406ae70 0x7fce6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.272+0000 7fce817fa640 1 -- 172.21.15.114:0/3661868726 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7178+0+0 (secure 0 0 0) 0x7fce6c0ac1b0 con 0x7fce840b0ae0 2023-11-04T01:40:31.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.272+0000 7fce88ab2640 1 --2- 172.21.15.114:0/3661868726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fce6406ae70 0x7fce6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.273+0000 7fce88ab2640 1 --2- 172.21.15.114:0/3661868726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fce6406ae70 0x7fce6406d330 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0012e0 tx=0x7fce7c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.277+0000 7fce817fa640 1 -- 172.21.15.114:0/3661868726 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fce6c076ca0 con 0x7fce840b0ae0 2023-11-04T01:40:31.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.481+0000 7fce8ad16640 1 -- 172.21.15.114:0/3661868726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce8406d3f0 con 0x7fce840b0ae0 2023-11-04T01:40:31.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.481+0000 7fce817fa640 1 -- 172.21.15.114:0/3661868726 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4990 (secure 0 0 0) 0x7fce6c07a2c0 con 0x7fce840b0ae0 2023-11-04T01:40:31.484 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:31.484 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:30.578853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7431,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7431":{"gid":7431,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6836/3780323525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3780323525},{"type":"v1","addr":"172.21.15.114:6836","nonce":3780323525}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:40:30.578853+0000","export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:31.484 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 49 2023-11-04T01:40:31.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.483+0000 7fce8ad16640 1 -- 172.21.15.114:0/3661868726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fce6406ae70 msgr2=0x7fce6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.483+0000 7fce8ad16640 1 --2- 172.21.15.114:0/3661868726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fce6406ae70 0x7fce6406d330 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0012e0 tx=0x7fce7c009040 comp rx=0 tx=0).stop 2023-11-04T01:40:31.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.483+0000 7fce8ad16640 1 -- 172.21.15.114:0/3661868726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce840b0ae0 msgr2=0x7fce840ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.484+0000 7fce8ad16640 1 --2- 172.21.15.114:0/3661868726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce840b0ae0 0x7fce840ad7c0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0098c0 tx=0x7fce6c004730 comp rx=0 tx=0).stop 2023-11-04T01:40:31.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.484+0000 7fce8ad16640 1 -- 172.21.15.114:0/3661868726 shutdown_connections 2023-11-04T01:40:31.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.484+0000 7fce8ad16640 1 --2- 172.21.15.114:0/3661868726 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fce84159c70 0x7fce840add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.484+0000 7fce8ad16640 1 --2- 172.21.15.114:0/3661868726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce840b0ae0 0x7fce840ad7c0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.484+0000 7fce8ad16640 1 --2- 172.21.15.114:0/3661868726 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fce6406ae70 0x7fce6406d330 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.484+0000 7fce8ad16640 1 --2- 172.21.15.114:0/3661868726 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fce8406db20 0x7fce840ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.484+0000 7fce8ad16640 1 -- 172.21.15.114:0/3661868726 >> 172.21.15.114:0/3661868726 conn(0x7fce840ce950 msgr2=0x7fce840b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:31.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.484+0000 7fce8ad16640 1 -- 172.21.15.114:0/3661868726 shutdown_connections 2023-11-04T01:40:31.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.484+0000 7fce8ad16640 1 -- 172.21.15.114:0/3661868726 wait complete. 2023-11-04T01:40:31.496 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:40:31.496 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:40:31.522 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:40:31.523 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:40:31.523 DEBUG:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:40:31.594 INFO:teuthology.orchestra.run.smithi114.stdout:1699062015.116806.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:40:31.595 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062015.116806.core'] 2023-11-04T01:40:31.595 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062015.116806.core, deleting it 2023-11-04T01:40:31.596 DEBUG:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062015.116806.core 2023-11-04T01:40:31.666 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:40:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.805+0000 7fa9f7cec640 1 Processor -- start 2023-11-04T01:40:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.805+0000 7fa9f7cec640 1 -- start start 2023-11-04T01:40:31.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.806+0000 7fa9f7cec640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9f0153850 0x7fa9f015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.806+0000 7fa9f7cec640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa9f00cc520 0x7fa9f0070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.806+0000 7fa9f7cec640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa9f00cc9a0 0x7fa9f00714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.806+0000 7fa9f7cec640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f00c3860 con 0x7fa9f00cc520 2023-11-04T01:40:31.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.806+0000 7fa9f7cec640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f00c9250 con 0x7fa9f00cc9a0 2023-11-04T01:40:31.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.806+0000 7fa9f7cec640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f0153c30 con 0x7fa9f0153850 2023-11-04T01:40:31.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.806+0000 7fa9f5287640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa9f00cc520 0x7fa9f0070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.806+0000 7fa9f5287640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa9f00cc520 0x7fa9f0070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52296/0 (socket says 172.21.15.114:52296) 2023-11-04T01:40:31.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.806+0000 7fa9f5287640 1 -- 172.21.15.114:0/111294760 learned_addr learned my addr 172.21.15.114:0/111294760 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:31.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.806+0000 7fa9f5a88640 1 --2- 172.21.15.114:0/111294760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9f0153850 0x7fa9f015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.806+0000 7fa9f6289640 1 --2- 172.21.15.114:0/111294760 >> v2:172.21.15.141:3300/0 conn(0x7fa9f00cc9a0 0x7fa9f00714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.806+0000 7fa9f5287640 1 -- 172.21.15.114:0/111294760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9f0153850 msgr2=0x7fa9f015a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:31.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.806+0000 7fa9f5287640 1 --2- 172.21.15.114:0/111294760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9f0153850 0x7fa9f015a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.806+0000 7fa9f5287640 1 -- 172.21.15.114:0/111294760 >> v2:172.21.15.141:3300/0 conn(0x7fa9f00cc9a0 msgr2=0x7fa9f00714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:31.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.806+0000 7fa9f5287640 1 --2- 172.21.15.114:0/111294760 >> v2:172.21.15.141:3300/0 conn(0x7fa9f00cc9a0 0x7fa9f00714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.806+0000 7fa9f5287640 1 -- 172.21.15.114:0/111294760 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f015a700 con 0x7fa9f00cc520 2023-11-04T01:40:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.807+0000 7fa9f5287640 1 --2- 172.21.15.114:0/111294760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9f00cc520 0x7fa9f0070fa0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00cb380 tx=0x7fa9e002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247a08457d829d4e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.807+0000 7fa9f4a86640 1 -- 172.21.15.114:0/111294760 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0031870 con 0x7fa9f00cc520 2023-11-04T01:40:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.807+0000 7fa9f4a86640 1 -- 172.21.15.114:0/111294760 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e00319d0 con 0x7fa9f00cc520 2023-11-04T01:40:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.807+0000 7fa9f4a86640 1 -- 172.21.15.114:0/111294760 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0031d60 con 0x7fa9f00cc520 2023-11-04T01:40:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.808+0000 7fa9f7cec640 1 -- 172.21.15.114:0/111294760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9f00cc520 msgr2=0x7fa9f0070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.808+0000 7fa9f7cec640 1 --2- 172.21.15.114:0/111294760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9f00cc520 0x7fa9f0070fa0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00cb380 tx=0x7fa9e002b910 comp rx=0 tx=0).stop 2023-11-04T01:40:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.808+0000 7fa9f7cec640 1 -- 172.21.15.114:0/111294760 shutdown_connections 2023-11-04T01:40:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.808+0000 7fa9f7cec640 1 --2- 172.21.15.114:0/111294760 >> v2:172.21.15.141:3300/0 conn(0x7fa9f00cc9a0 0x7fa9f00714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.808+0000 7fa9f7cec640 1 --2- 172.21.15.114:0/111294760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9f00cc520 0x7fa9f0070fa0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.808+0000 7fa9f7cec640 1 --2- 172.21.15.114:0/111294760 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9f0153850 0x7fa9f015a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.808+0000 7fa9f7cec640 1 -- 172.21.15.114:0/111294760 >> 172.21.15.114:0/111294760 conn(0x7fa9f00ce950 msgr2=0x7fa9f00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:31.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.808+0000 7fa9f7cec640 1 -- 172.21.15.114:0/111294760 shutdown_connections 2023-11-04T01:40:31.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.808+0000 7fa9f7cec640 1 -- 172.21.15.114:0/111294760 wait complete. 2023-11-04T01:40:31.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.809+0000 7fa9f7cec640 1 Processor -- start 2023-11-04T01:40:31.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.809+0000 7fa9f7cec640 1 -- start start 2023-11-04T01:40:31.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f7cec640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9f00cc520 0x7fa9f01f1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f7cec640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9f00cc9a0 0x7fa9f00c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f7cec640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9f0153850 0x7fa9f00c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f7cec640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f01f1e10 con 0x7fa9f00cc520 2023-11-04T01:40:31.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f7cec640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f0151860 con 0x7fa9f0153850 2023-11-04T01:40:31.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f7cec640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f0151b40 con 0x7fa9f00cc9a0 2023-11-04T01:40:31.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f5a88640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9f00cc520 0x7fa9f01f1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f5a88640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9f00cc520 0x7fa9f01f1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52300/0 (socket says 172.21.15.114:52300) 2023-11-04T01:40:31.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f5a88640 1 -- 172.21.15.114:0/2647446996 learned_addr learned my addr 172.21.15.114:0/2647446996 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:31.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f6289640 1 --2- 172.21.15.114:0/2647446996 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9f0153850 0x7fa9f00c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f5287640 1 --2- 172.21.15.114:0/2647446996 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9f00cc9a0 0x7fa9f00c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f5a88640 1 -- 172.21.15.114:0/2647446996 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9f00cc9a0 msgr2=0x7fa9f00c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f5a88640 1 --2- 172.21.15.114:0/2647446996 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9f00cc9a0 0x7fa9f00c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f5a88640 1 -- 172.21.15.114:0/2647446996 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9f0153850 msgr2=0x7fa9f00c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f5a88640 1 --2- 172.21.15.114:0/2647446996 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9f0153850 0x7fa9f00c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f5a88640 1 -- 172.21.15.114:0/2647446996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e00094d0 con 0x7fa9f00cc520 2023-11-04T01:40:31.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f5a88640 1 --2- 172.21.15.114:0/2647446996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9f00cc520 0x7fa9f01f1180 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00d5f0 tx=0x7fa9ec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9e67fc640 1 -- 172.21.15.114:0/2647446996 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0125f0 con 0x7fa9f00cc520 2023-11-04T01:40:31.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9e67fc640 1 -- 172.21.15.114:0/2647446996 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ec012750 con 0x7fa9f00cc520 2023-11-04T01:40:31.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f7cec640 1 -- 172.21.15.114:0/2647446996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f0151e20 con 0x7fa9f00cc520 2023-11-04T01:40:31.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9e67fc640 1 -- 172.21.15.114:0/2647446996 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec012b00 con 0x7fa9f00cc520 2023-11-04T01:40:31.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.810+0000 7fa9f7cec640 1 -- 172.21.15.114:0/2647446996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f01523e0 con 0x7fa9f00cc520 2023-11-04T01:40:31.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.811+0000 7fa9f7cec640 1 -- 172.21.15.114:0/2647446996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f0152570 con 0x7fa9f00cc520 2023-11-04T01:40:31.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.812+0000 7fa9e67fc640 1 -- 172.21.15.114:0/2647446996 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa9ec012c60 con 0x7fa9f00cc520 2023-11-04T01:40:31.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.812+0000 7fa9e67fc640 1 --2- 172.21.15.114:0/2647446996 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa9d406ae70 0x7fa9d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.812+0000 7fa9f5287640 1 --2- 172.21.15.114:0/2647446996 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa9d406ae70 0x7fa9d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.812+0000 7fa9e67fc640 1 -- 172.21.15.114:0/2647446996 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7178+0+0 (secure 0 0 0) 0x7fa9ec089fc0 con 0x7fa9f00cc520 2023-11-04T01:40:31.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.813+0000 7fa9f5287640 1 --2- 172.21.15.114:0/2647446996 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa9d406ae70 0x7fa9d406d330 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0036000 tx=0x7fa9e003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:31.817+0000 7fa9e67fc640 1 -- 172.21.15.114:0/2647446996 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa9ec0bcca0 con 0x7fa9f00cc520 2023-11-04T01:40:31.886 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-11-04T01:40:32.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.049+0000 7fa9f7cec640 1 -- 172.21.15.114:0/2647446996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7fa9f0074290 con 0x7fa9f00cc520 2023-11-04T01:40:32.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.053+0000 7fa9e67fc640 1 -- 172.21.15.114:0/2647446996 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7431 v50) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa9ec054b40 con 0x7fa9f00cc520 2023-11-04T01:40:32.054 INFO:teuthology.orchestra.run.smithi114.stderr:failed mds gid 7431 2023-11-04T01:40:32.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.055+0000 7fa9f7cec640 1 -- 172.21.15.114:0/2647446996 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa9d406ae70 msgr2=0x7fa9d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.055+0000 7fa9f7cec640 1 --2- 172.21.15.114:0/2647446996 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa9d406ae70 0x7fa9d406d330 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0036000 tx=0x7fa9e003c040 comp rx=0 tx=0).stop 2023-11-04T01:40:32.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.055+0000 7fa9f7cec640 1 -- 172.21.15.114:0/2647446996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9f00cc520 msgr2=0x7fa9f01f1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.055+0000 7fa9f7cec640 1 --2- 172.21.15.114:0/2647446996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9f00cc520 0x7fa9f01f1180 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00d5f0 tx=0x7fa9ec00dab0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.055+0000 7fa9f7cec640 1 -- 172.21.15.114:0/2647446996 shutdown_connections 2023-11-04T01:40:32.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.055+0000 7fa9f7cec640 1 --2- 172.21.15.114:0/2647446996 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa9d406ae70 0x7fa9d406d330 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.055+0000 7fa9f7cec640 1 --2- 172.21.15.114:0/2647446996 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa9f0153850 0x7fa9f00c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.055+0000 7fa9f7cec640 1 --2- 172.21.15.114:0/2647446996 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa9f00cc9a0 0x7fa9f00c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.055+0000 7fa9f7cec640 1 --2- 172.21.15.114:0/2647446996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9f00cc520 0x7fa9f01f1180 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.055+0000 7fa9f7cec640 1 -- 172.21.15.114:0/2647446996 >> 172.21.15.114:0/2647446996 conn(0x7fa9f00ce950 msgr2=0x7fa9f006da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.055+0000 7fa9f7cec640 1 -- 172.21.15.114:0/2647446996 shutdown_connections 2023-11-04T01:40:32.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.055+0000 7fa9f7cec640 1 -- 172.21.15.114:0/2647446996 wait complete. 2023-11-04T01:40:32.070 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:40:32.070 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:40:32.070 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:40:32.070 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:40:32.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:40:32.070 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:40:32.071 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:40:32.071 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:40:32.074 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:40:32.074 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:32.151 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2023-11-04T01:40:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.174+0000 7ff7f67ee640 1 Processor -- start 2023-11-04T01:40:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.174+0000 7ff7f67ee640 1 -- start start 2023-11-04T01:40:32.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.175+0000 7ff7f67ee640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff7f00cde60 0x7ff7f015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.175+0000 7ff7f67ee640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff7f00ce240 0x7ff7f00d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.175+0000 7ff7f67ee640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f015e000 con 0x7ff7f015daa0 2023-11-04T01:40:32.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.175+0000 7ff7f67ee640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f015e5c0 con 0x7ff7f00ce240 2023-11-04T01:40:32.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.175+0000 7ff7f67ee640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f015e2e0 con 0x7ff7f00cde60 2023-11-04T01:40:32.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.175+0000 7ff7f4d8b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff7f00ce240 0x7ff7f00d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.175+0000 7ff7f4d8b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff7f00ce240 0x7ff7f00d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52328/0 (socket says 172.21.15.114:52328) 2023-11-04T01:40:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.175+0000 7ff7f4d8b640 1 -- 172.21.15.114:0/3812326088 learned_addr learned my addr 172.21.15.114:0/3812326088 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.175+0000 7ff7effff640 1 --2- 172.21.15.114:0/3812326088 >> v2:172.21.15.141:3300/0 conn(0x7ff7f00cde60 0x7ff7f015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.176+0000 7ff7f4d8b640 1 -- 172.21.15.114:0/3812326088 >> v2:172.21.15.141:3300/0 conn(0x7ff7f00cde60 msgr2=0x7ff7f015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.176+0000 7ff7f4d8b640 1 --2- 172.21.15.114:0/3812326088 >> v2:172.21.15.141:3300/0 conn(0x7ff7f00cde60 0x7ff7f015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.176+0000 7ff7f4d8b640 1 -- 172.21.15.114:0/3812326088 >> v1:172.21.15.141:6789/0 conn(0x7ff7f015daa0 legacy=0x7ff7f0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.176+0000 7ff7f4d8b640 1 -- 172.21.15.114:0/3812326088 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f00d1120 con 0x7ff7f00ce240 2023-11-04T01:40:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.176+0000 7ff7effff640 1 --2- 172.21.15.114:0/3812326088 >> v2:172.21.15.141:3300/0 conn(0x7ff7f00cde60 0x7ff7f015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.176+0000 7ff7f4d8b640 1 --2- 172.21.15.114:0/3812326088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7f00ce240 0x7ff7f00d1920 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00b5550 tx=0x7ff7e802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7c48922b126d4b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.176+0000 7ff7eeffd640 1 -- 172.21.15.114:0/3812326088 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e802cb20 con 0x7ff7f00ce240 2023-11-04T01:40:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.176+0000 7ff7eeffd640 1 -- 172.21.15.114:0/3812326088 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e802cc80 con 0x7ff7f00ce240 2023-11-04T01:40:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.176+0000 7ff7eeffd640 1 -- 172.21.15.114:0/3812326088 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e80343f0 con 0x7ff7f00ce240 2023-11-04T01:40:32.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.177+0000 7ff7f67ee640 1 -- 172.21.15.114:0/3812326088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7f00ce240 msgr2=0x7ff7f00d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.177+0000 7ff7f67ee640 1 --2- 172.21.15.114:0/3812326088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7f00ce240 0x7ff7f00d1920 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00b5550 tx=0x7ff7e802bf80 comp rx=0 tx=0).stop 2023-11-04T01:40:32.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.177+0000 7ff7f67ee640 1 -- 172.21.15.114:0/3812326088 shutdown_connections 2023-11-04T01:40:32.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.177+0000 7ff7f67ee640 1 --2- 172.21.15.114:0/3812326088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7f00ce240 0x7ff7f00d1920 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.177+0000 7ff7f67ee640 1 --2- 172.21.15.114:0/3812326088 >> v2:172.21.15.141:3300/0 conn(0x7ff7f00cde60 0x7ff7f015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.177+0000 7ff7f67ee640 1 -- 172.21.15.114:0/3812326088 >> 172.21.15.114:0/3812326088 conn(0x7ff7f0071f30 msgr2=0x7ff7f00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.177+0000 7ff7f67ee640 1 -- 172.21.15.114:0/3812326088 shutdown_connections 2023-11-04T01:40:32.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.177+0000 7ff7f67ee640 1 -- 172.21.15.114:0/3812326088 wait complete. 2023-11-04T01:40:32.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.178+0000 7ff7f67ee640 1 Processor -- start 2023-11-04T01:40:32.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.178+0000 7ff7f67ee640 1 -- start start 2023-11-04T01:40:32.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.179+0000 7ff7f67ee640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7f00cde60 0x7ff7f015b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.179+0000 7ff7f67ee640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7f00ce240 0x7ff7f01f1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.179+0000 7ff7f67ee640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff7f015daa0 0x7ff7f00c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.179+0000 7ff7f67ee640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00a98c0 con 0x7ff7f00ce240 2023-11-04T01:40:32.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.179+0000 7ff7f67ee640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00b7e10 con 0x7ff7f015daa0 2023-11-04T01:40:32.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.179+0000 7ff7f67ee640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f0158200 con 0x7ff7f00cde60 2023-11-04T01:40:32.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.179+0000 7ff7ef7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7f00ce240 0x7ff7f01f1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.179+0000 7ff7ef7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7f00ce240 0x7ff7f01f1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52344/0 (socket says 172.21.15.114:52344) 2023-11-04T01:40:32.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.179+0000 7ff7ef7fe640 1 -- 172.21.15.114:0/901514961 learned_addr learned my addr 172.21.15.114:0/901514961 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:32.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.179+0000 7ff7ef7fe640 1 -- 172.21.15.114:0/901514961 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7f00cde60 msgr2=0x7ff7f015b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.179+0000 7ff7f4d8b640 1 --2- 172.21.15.114:0/901514961 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff7f015daa0 0x7ff7f00c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.179+0000 7ff7ef7fe640 1 --2- 172.21.15.114:0/901514961 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7f00cde60 0x7ff7f015b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.179+0000 7ff7ef7fe640 1 -- 172.21.15.114:0/901514961 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff7f015daa0 msgr2=0x7ff7f00c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.179+0000 7ff7ef7fe640 1 --2- 172.21.15.114:0/901514961 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff7f015daa0 0x7ff7f00c76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.179+0000 7ff7ef7fe640 1 -- 172.21.15.114:0/901514961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e8009b30 con 0x7ff7f00ce240 2023-11-04T01:40:32.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.180+0000 7ff7ef7fe640 1 --2- 172.21.15.114:0/901514961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7f00ce240 0x7ff7f01f1f20 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c440 tx=0x7ff7e400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.180+0000 7ff7ecff9640 1 -- 172.21.15.114:0/901514961 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40052d0 con 0x7ff7f00ce240 2023-11-04T01:40:32.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.180+0000 7ff7ecff9640 1 -- 172.21.15.114:0/901514961 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e4005430 con 0x7ff7f00ce240 2023-11-04T01:40:32.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.180+0000 7ff7f67ee640 1 -- 172.21.15.114:0/901514961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f01584e0 con 0x7ff7f00ce240 2023-11-04T01:40:32.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.180+0000 7ff7ecff9640 1 -- 172.21.15.114:0/901514961 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4007260 con 0x7ff7f00ce240 2023-11-04T01:40:32.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.180+0000 7ff7f67ee640 1 -- 172.21.15.114:0/901514961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f0158aa0 con 0x7ff7f00ce240 2023-11-04T01:40:32.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.181+0000 7ff7f67ee640 1 -- 172.21.15.114:0/901514961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f0074290 con 0x7ff7f00ce240 2023-11-04T01:40:32.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.181+0000 7ff7ecff9640 1 -- 172.21.15.114:0/901514961 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff7e40073c0 con 0x7ff7f00ce240 2023-11-04T01:40:32.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.182+0000 7ff7ecff9640 1 --2- 172.21.15.114:0/901514961 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff7dc06ae70 0x7ff7dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.182+0000 7ff7effff640 1 --2- 172.21.15.114:0/901514961 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff7dc06ae70 0x7ff7dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.182+0000 7ff7ecff9640 1 -- 172.21.15.114:0/901514961 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7ff7e4088ee0 con 0x7ff7f00ce240 2023-11-04T01:40:32.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.182+0000 7ff7effff640 1 --2- 172.21.15.114:0/901514961 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff7dc06ae70 0x7ff7dc06d330 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0006fd0 tx=0x7ff7e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.186+0000 7ff7ecff9640 1 -- 172.21.15.114:0/901514961 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff7e4053a10 con 0x7ff7f00ce240 2023-11-04T01:40:32.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.386+0000 7ff7f67ee640 1 -- 172.21.15.114:0/901514961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7f00c9120 con 0x7ff7f00ce240 2023-11-04T01:40:32.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.386+0000 7ff7ecff9640 1 -- 172.21.15.114:0/901514961 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4148 (secure 0 0 0) 0x7ff7e4057030 con 0x7ff7f00ce240 2023-11-04T01:40:32.388 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:32.389 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:32.059384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6292,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6292":{"gid":6292,"name":"a","rank":0,"incarnation":51,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:32.389 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 51 2023-11-04T01:40:32.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.388+0000 7ff7f67ee640 1 -- 172.21.15.114:0/901514961 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff7dc06ae70 msgr2=0x7ff7dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.388+0000 7ff7f67ee640 1 --2- 172.21.15.114:0/901514961 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff7dc06ae70 0x7ff7dc06d330 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0006fd0 tx=0x7ff7e0008040 comp rx=0 tx=0).stop 2023-11-04T01:40:32.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.388+0000 7ff7f67ee640 1 -- 172.21.15.114:0/901514961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7f00ce240 msgr2=0x7ff7f01f1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.388+0000 7ff7f67ee640 1 --2- 172.21.15.114:0/901514961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7f00ce240 0x7ff7f01f1f20 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c440 tx=0x7ff7e400c900 comp rx=0 tx=0).stop 2023-11-04T01:40:32.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.388+0000 7ff7f67ee640 1 -- 172.21.15.114:0/901514961 shutdown_connections 2023-11-04T01:40:32.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.388+0000 7ff7f67ee640 1 --2- 172.21.15.114:0/901514961 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff7dc06ae70 0x7ff7dc06d330 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.388+0000 7ff7f67ee640 1 --2- 172.21.15.114:0/901514961 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff7f015daa0 0x7ff7f00c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.388+0000 7ff7f67ee640 1 --2- 172.21.15.114:0/901514961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7f00ce240 0x7ff7f01f1f20 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.388+0000 7ff7f67ee640 1 --2- 172.21.15.114:0/901514961 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff7f00cde60 0x7ff7f015b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.388+0000 7ff7f67ee640 1 -- 172.21.15.114:0/901514961 >> 172.21.15.114:0/901514961 conn(0x7ff7f0071f30 msgr2=0x7ff7f0156530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.388+0000 7ff7f67ee640 1 -- 172.21.15.114:0/901514961 shutdown_connections 2023-11-04T01:40:32.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:32.388+0000 7ff7f67ee640 1 -- 172.21.15.114:0/901514961 wait complete. 2023-11-04T01:40:32.401 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:40:37.021 INFO:tasks.ceph.mds.a.smithi114.stderr:2023-11-04T01:40:37.019+0000 7f098e5ba640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:37.021 INFO:tasks.ceph.mds.a.smithi114.stderr:2023-11-04T01:40:37.019+0000 7f098e5ba640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:37.401 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:37.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.511+0000 7f8a7dc07640 1 Processor -- start 2023-11-04T01:40:37.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.511+0000 7f8a7dc07640 1 -- start start 2023-11-04T01:40:37.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.511+0000 7f8a7dc07640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a7815ad80 0x7f8a7806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.511+0000 7f8a7dc07640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7806cd00 con 0x7f8a780c9e10 2023-11-04T01:40:37.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.511+0000 7f8a7dc07640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7806cfa0 con 0x7f8a780b42c0 2023-11-04T01:40:37.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.511+0000 7f8a7dc07640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7806d280 con 0x7f8a7815ad80 2023-11-04T01:40:37.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a77fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8a780c9e10 0x7f8a780b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38436/0 (socket says 172.21.15.114:38436) 2023-11-04T01:40:37.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a77fff640 1 -- 172.21.15.114:0/2663665949 learned_addr learned my addr 172.21.15.114:0/2663665949 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:37.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a777fe640 1 --2- 172.21.15.114:0/2663665949 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a7815ad80 0x7f8a7806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 -- 172.21.15.114:0/2663665949 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765820766 0 0) 0x7f8a7806cd00 con 0x7f8a780c9e10 2023-11-04T01:40:37.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 -- 172.21.15.114:0/2663665949 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a60003520 con 0x7f8a780c9e10 2023-11-04T01:40:37.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 -- 172.21.15.114:0/2663665949 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397837107 0 0) 0x7f8a7806cfa0 con 0x7f8a780b42c0 2023-11-04T01:40:37.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 -- 172.21.15.114:0/2663665949 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a7806cd00 con 0x7f8a780b42c0 2023-11-04T01:40:37.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 -- 172.21.15.114:0/2663665949 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 91584851 0 0) 0x7f8a60003520 con 0x7f8a780c9e10 2023-11-04T01:40:37.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 -- 172.21.15.114:0/2663665949 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a7815ad80 msgr2=0x7f8a7806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:37.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 --2- 172.21.15.114:0/2663665949 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a7815ad80 0x7f8a7806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 -- 172.21.15.114:0/2663665949 >> v1:172.21.15.141:6789/0 conn(0x7f8a780b42c0 legacy=0x7f8a780c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 -- 172.21.15.114:0/2663665949 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7806d560 con 0x7f8a780c9e10 2023-11-04T01:40:37.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 -- 172.21.15.114:0/2663665949 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f8a70001a10 con 0x7f8a780c9e10 2023-11-04T01:40:37.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a777fe640 1 --2- 172.21.15.114:0/2663665949 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a7815ad80 0x7f8a7806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:37.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 -- 172.21.15.114:0/2663665949 >> v1:172.21.15.114:6789/0 conn(0x7f8a780c9e10 legacy=0x7f8a780b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 --2- 172.21.15.114:0/2663665949 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a7815ad80 0x7f8a60003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 --2- 172.21.15.114:0/2663665949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a60004070 0x7f8a600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 --2- 172.21.15.114:0/2663665949 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a60004d00 0x7f8a60005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 -- 172.21.15.114:0/2663665949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7806d280 con 0x7f8a60004070 2023-11-04T01:40:37.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 -- 172.21.15.114:0/2663665949 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6000ba30 con 0x7f8a60004d00 2023-11-04T01:40:37.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a767fc640 1 -- 172.21.15.114:0/2663665949 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6000bbf0 con 0x7f8a7815ad80 2023-11-04T01:40:37.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a76ffd640 1 --2- 172.21.15.114:0/2663665949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a60004070 0x7f8a600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a777fe640 1 --2- 172.21.15.114:0/2663665949 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a7815ad80 0x7f8a60003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.512+0000 7f8a77fff640 1 --2- 172.21.15.114:0/2663665949 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a60004d00 0x7f8a60005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.513+0000 7f8a76ffd640 1 -- 172.21.15.114:0/2663665949 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a7815ad80 msgr2=0x7f8a60003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:37.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.513+0000 7f8a76ffd640 1 --2- 172.21.15.114:0/2663665949 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a7815ad80 0x7f8a60003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.513+0000 7f8a76ffd640 1 -- 172.21.15.114:0/2663665949 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a60004d00 msgr2=0x7f8a60005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:37.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.513+0000 7f8a76ffd640 1 --2- 172.21.15.114:0/2663665949 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a60004d00 0x7f8a60005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.513+0000 7f8a76ffd640 1 -- 172.21.15.114:0/2663665949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a68009400 con 0x7f8a60004070 2023-11-04T01:40:37.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.513+0000 7f8a77fff640 1 --2- 172.21.15.114:0/2663665949 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a60004d00 0x7f8a60005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:37.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.513+0000 7f8a76ffd640 1 --2- 172.21.15.114:0/2663665949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a60004070 0x7f8a600047c0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0018d0 tx=0x7f8a600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d35f1b3cc48c2b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.513+0000 7f8a767fc640 1 -- 172.21.15.114:0/2663665949 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c0052d0 con 0x7f8a60004070 2023-11-04T01:40:37.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.513+0000 7f8a767fc640 1 -- 172.21.15.114:0/2663665949 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6c005430 con 0x7f8a60004070 2023-11-04T01:40:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.513+0000 7f8a767fc640 1 -- 172.21.15.114:0/2663665949 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c003810 con 0x7f8a60004070 2023-11-04T01:40:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.514+0000 7f8a7dc07640 1 -- 172.21.15.114:0/2663665949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a60004070 msgr2=0x7f8a600047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.514+0000 7f8a7dc07640 1 --2- 172.21.15.114:0/2663665949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a60004070 0x7f8a600047c0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0018d0 tx=0x7f8a600057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.514+0000 7f8a77fff640 1 -- 172.21.15.114:0/2663665949 reap_dead start 2023-11-04T01:40:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.514+0000 7f8a7dc07640 1 -- 172.21.15.114:0/2663665949 shutdown_connections 2023-11-04T01:40:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.514+0000 7f8a7dc07640 1 -- 172.21.15.114:0/2663665949 >> 172.21.15.114:0/2663665949 conn(0x7f8a780ce950 msgr2=0x7f8a780ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.514+0000 7f8a7dc07640 1 -- 172.21.15.114:0/2663665949 shutdown_connections 2023-11-04T01:40:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.514+0000 7f8a7dc07640 1 -- 172.21.15.114:0/2663665949 wait complete. 2023-11-04T01:40:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.515+0000 7f8a7dc07640 1 Processor -- start 2023-11-04T01:40:37.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.515+0000 7f8a7dc07640 1 -- start start 2023-11-04T01:40:37.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.516+0000 7f8a7dc07640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a60004070 0x7f8a781f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.516+0000 7f8a7dc07640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a780cdf00 0x7f8a7815c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.516+0000 7f8a7dc07640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a780ac1f0 0x7f8a780ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.516+0000 7f8a7dc07640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a780acbb0 con 0x7f8a780ac1f0 2023-11-04T01:40:37.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.516+0000 7f8a7dc07640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7815c820 con 0x7f8a60004070 2023-11-04T01:40:37.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.516+0000 7f8a7dc07640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7815caf0 con 0x7f8a780cdf00 2023-11-04T01:40:37.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.516+0000 7f8a77fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a780ac1f0 0x7f8a780ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.516+0000 7f8a77fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a780ac1f0 0x7f8a780ac670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40356/0 (socket says 172.21.15.114:40356) 2023-11-04T01:40:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.516+0000 7f8a77fff640 1 -- 172.21.15.114:0/601304264 learned_addr learned my addr 172.21.15.114:0/601304264 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.516+0000 7f8a777fe640 1 --2- 172.21.15.114:0/601304264 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a60004070 0x7f8a781f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.516+0000 7f8a76ffd640 1 --2- 172.21.15.114:0/601304264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a780cdf00 0x7f8a7815c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.517+0000 7f8a77fff640 1 -- 172.21.15.114:0/601304264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a780cdf00 msgr2=0x7f8a7815c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.517+0000 7f8a77fff640 1 --2- 172.21.15.114:0/601304264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a780cdf00 0x7f8a7815c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.517+0000 7f8a77fff640 1 -- 172.21.15.114:0/601304264 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a60004070 msgr2=0x7f8a781f31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.517+0000 7f8a77fff640 1 --2- 172.21.15.114:0/601304264 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a60004070 0x7f8a781f31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.517+0000 7f8a77fff640 1 -- 172.21.15.114:0/601304264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7815cdd0 con 0x7f8a780ac1f0 2023-11-04T01:40:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.517+0000 7f8a76ffd640 1 --2- 172.21.15.114:0/601304264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a780cdf00 0x7f8a7815c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.517+0000 7f8a777fe640 1 --2- 172.21.15.114:0/601304264 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a60004070 0x7f8a781f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.517+0000 7f8a77fff640 1 --2- 172.21.15.114:0/601304264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a780ac1f0 0x7f8a780ac670 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f8a780c8e70 tx=0x7f8a7000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.517+0000 7f8a5ffff640 1 -- 172.21.15.114:0/601304264 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7000ec10 con 0x7f8a780ac1f0 2023-11-04T01:40:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.517+0000 7f8a5ffff640 1 -- 172.21.15.114:0/601304264 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7000ed70 con 0x7f8a780ac1f0 2023-11-04T01:40:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.517+0000 7f8a7dc07640 1 -- 172.21.15.114:0/601304264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7815d0b0 con 0x7f8a780ac1f0 2023-11-04T01:40:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.517+0000 7f8a5ffff640 1 -- 172.21.15.114:0/601304264 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7000eee0 con 0x7f8a780ac1f0 2023-11-04T01:40:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.517+0000 7f8a7dc07640 1 -- 172.21.15.114:0/601304264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7815d670 con 0x7f8a780ac1f0 2023-11-04T01:40:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.518+0000 7f8a7dc07640 1 -- 172.21.15.114:0/601304264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a78074290 con 0x7f8a780ac1f0 2023-11-04T01:40:37.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.518+0000 7f8a5ffff640 1 -- 172.21.15.114:0/601304264 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a70013660 con 0x7f8a780ac1f0 2023-11-04T01:40:37.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.519+0000 7f8a5ffff640 1 --2- 172.21.15.114:0/601304264 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8a6406ae70 0x7f8a6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.519+0000 7f8a5ffff640 1 -- 172.21.15.114:0/601304264 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f8a70089fe0 con 0x7f8a780ac1f0 2023-11-04T01:40:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.519+0000 7f8a777fe640 1 --2- 172.21.15.114:0/601304264 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8a6406ae70 0x7f8a6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.519+0000 7f8a777fe640 1 --2- 172.21.15.114:0/601304264 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8a6406ae70 0x7f8a6406d330 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8a781f6c60 tx=0x7f8a68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.523+0000 7f8a5ffff640 1 -- 172.21.15.114:0/601304264 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8a70054b10 con 0x7f8a780ac1f0 2023-11-04T01:40:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.724+0000 7f8a7dc07640 1 -- 172.21.15.114:0/601304264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a780b4880 con 0x7f8a780ac1f0 2023-11-04T01:40:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.725+0000 7f8a5ffff640 1 -- 172.21.15.114:0/601304264 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f8a70058130 con 0x7f8a780ac1f0 2023-11-04T01:40:37.727 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:37.727 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7773,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:35.074875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6292,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6292":{"gid":6292,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:37.727 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 55 2023-11-04T01:40:37.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.726+0000 7f8a7dc07640 1 -- 172.21.15.114:0/601304264 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8a6406ae70 msgr2=0x7f8a6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.727+0000 7f8a7dc07640 1 --2- 172.21.15.114:0/601304264 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8a6406ae70 0x7f8a6406d330 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8a781f6c60 tx=0x7f8a68008040 comp rx=0 tx=0).stop 2023-11-04T01:40:37.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.727+0000 7f8a7dc07640 1 -- 172.21.15.114:0/601304264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a780ac1f0 msgr2=0x7f8a780ac670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.727+0000 7f8a7dc07640 1 --2- 172.21.15.114:0/601304264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a780ac1f0 0x7f8a780ac670 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f8a780c8e70 tx=0x7f8a7000e530 comp rx=0 tx=0).stop 2023-11-04T01:40:37.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.727+0000 7f8a7dc07640 1 -- 172.21.15.114:0/601304264 shutdown_connections 2023-11-04T01:40:37.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.727+0000 7f8a7dc07640 1 --2- 172.21.15.114:0/601304264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a780ac1f0 0x7f8a780ac670 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.727+0000 7f8a7dc07640 1 --2- 172.21.15.114:0/601304264 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8a780cdf00 0x7f8a7815c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.727+0000 7f8a7dc07640 1 --2- 172.21.15.114:0/601304264 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8a6406ae70 0x7f8a6406d330 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.727+0000 7f8a7dc07640 1 --2- 172.21.15.114:0/601304264 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8a60004070 0x7f8a781f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.727+0000 7f8a7dc07640 1 -- 172.21.15.114:0/601304264 >> 172.21.15.114:0/601304264 conn(0x7f8a780ce950 msgr2=0x7f8a780ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:37.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.727+0000 7f8a7dc07640 1 -- 172.21.15.114:0/601304264 shutdown_connections 2023-11-04T01:40:37.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.727+0000 7f8a7dc07640 1 -- 172.21.15.114:0/601304264 wait complete. 2023-11-04T01:40:37.739 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:40:37.739 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:37.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.836+0000 7f063b1b6640 1 Processor -- start 2023-11-04T01:40:37.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.836+0000 7f063b1b6640 1 -- start start 2023-11-04T01:40:37.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.837+0000 7f063b1b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f063415ce70 0x7f063406d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.837+0000 7f063b1b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f063415d250 0x7f06340c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.837+0000 7f063b1b6640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063406a120 con 0x7f06340c9d70 2023-11-04T01:40:37.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.837+0000 7f063b1b6640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06340cdc10 con 0x7f063415ce70 2023-11-04T01:40:37.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.837+0000 7f063b1b6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063406def0 con 0x7f063415d250 2023-11-04T01:40:37.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.837+0000 7f0638f52640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f063415ce70 0x7f063406d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.837+0000 7f0638f52640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f063415ce70 0x7f063406d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40362/0 (socket says 172.21.15.114:40362) 2023-11-04T01:40:37.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.837+0000 7f0638f52640 1 -- 172.21.15.114:0/2128670317 learned_addr learned my addr 172.21.15.114:0/2128670317 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:37.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.837+0000 7f0638f52640 1 -- 172.21.15.114:0/2128670317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f063415d250 msgr2=0x7f06340c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:37.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.837+0000 7f0633fff640 1 --2- 172.21.15.114:0/2128670317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f063415d250 0x7f06340c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.837+0000 7f0638f52640 1 --2- 172.21.15.114:0/2128670317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f063415d250 0x7f06340c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.837+0000 7f0638f52640 1 -- 172.21.15.114:0/2128670317 >> v1:172.21.15.141:6789/0 conn(0x7f06340c9d70 legacy=0x7f06340ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:37.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.837+0000 7f0638f52640 1 -- 172.21.15.114:0/2128670317 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063406a370 con 0x7f063415ce70 2023-11-04T01:40:37.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.838+0000 7f0638f52640 1 --2- 172.21.15.114:0/2128670317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f063415ce70 0x7f063406d9b0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f0624009870 tx=0x7f062402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c425ae93fbdb01 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.838+0000 7f06337fe640 1 -- 172.21.15.114:0/2128670317 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624031640 con 0x7f063415ce70 2023-11-04T01:40:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.838+0000 7f06337fe640 1 -- 172.21.15.114:0/2128670317 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06240317a0 con 0x7f063415ce70 2023-11-04T01:40:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.838+0000 7f06337fe640 1 -- 172.21.15.114:0/2128670317 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624031b30 con 0x7f063415ce70 2023-11-04T01:40:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.839+0000 7f063b1b6640 1 -- 172.21.15.114:0/2128670317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f063415ce70 msgr2=0x7f063406d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.839+0000 7f063b1b6640 1 --2- 172.21.15.114:0/2128670317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f063415ce70 0x7f063406d9b0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f0624009870 tx=0x7f062402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.839+0000 7f063b1b6640 1 -- 172.21.15.114:0/2128670317 shutdown_connections 2023-11-04T01:40:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.839+0000 7f063b1b6640 1 --2- 172.21.15.114:0/2128670317 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f063415d250 0x7f06340c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.839+0000 7f063b1b6640 1 --2- 172.21.15.114:0/2128670317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f063415ce70 0x7f063406d9b0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.839+0000 7f063b1b6640 1 -- 172.21.15.114:0/2128670317 >> 172.21.15.114:0/2128670317 conn(0x7f06340b0cd0 msgr2=0x7f06340b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.839+0000 7f063b1b6640 1 -- 172.21.15.114:0/2128670317 shutdown_connections 2023-11-04T01:40:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.839+0000 7f063b1b6640 1 -- 172.21.15.114:0/2128670317 wait complete. 2023-11-04T01:40:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.840+0000 7f063b1b6640 1 Processor -- start 2023-11-04T01:40:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.840+0000 7f063b1b6640 1 -- start start 2023-11-04T01:40:37.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f063b1b6640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f063415ce70 0x7f06340ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f063b1b6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f063415d250 0x7f063415be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f063b1b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f063414c6c0 0x7f06341e3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f063b1b6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06340c9310 con 0x7f063415d250 2023-11-04T01:40:37.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f063b1b6640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063415c3d0 con 0x7f063415ce70 2023-11-04T01:40:37.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f063b1b6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06340c8970 con 0x7f063414c6c0 2023-11-04T01:40:37.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f0633fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f063415d250 0x7f063415be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f0633fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f063415d250 0x7f063415be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40372/0 (socket says 172.21.15.114:40372) 2023-11-04T01:40:37.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f0633fff640 1 -- 172.21.15.114:0/409286932 learned_addr learned my addr 172.21.15.114:0/409286932 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:37.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f0638f52640 1 --2- 172.21.15.114:0/409286932 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f063415ce70 0x7f06340ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f0639753640 1 --2- 172.21.15.114:0/409286932 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f063414c6c0 0x7f06341e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f0633fff640 1 -- 172.21.15.114:0/409286932 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f063414c6c0 msgr2=0x7f06341e3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f0633fff640 1 --2- 172.21.15.114:0/409286932 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f063414c6c0 0x7f06341e3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f0633fff640 1 -- 172.21.15.114:0/409286932 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f063415ce70 msgr2=0x7f06340ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f0633fff640 1 --2- 172.21.15.114:0/409286932 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f063415ce70 0x7f06340ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f0633fff640 1 -- 172.21.15.114:0/409286932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06240094d0 con 0x7f063415d250 2023-11-04T01:40:37.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f0639753640 1 --2- 172.21.15.114:0/409286932 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f063414c6c0 0x7f06341e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:37.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f0638f52640 1 --2- 172.21.15.114:0/409286932 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f063415ce70 0x7f06340ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:37.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.841+0000 7f0633fff640 1 --2- 172.21.15.114:0/409286932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f063415d250 0x7f063415be90 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f062800c7f0 tx=0x7f062800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.842+0000 7f06317fa640 1 -- 172.21.15.114:0/409286932 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0628004230 con 0x7f063415d250 2023-11-04T01:40:37.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.842+0000 7f06317fa640 1 -- 172.21.15.114:0/409286932 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0628004390 con 0x7f063415d250 2023-11-04T01:40:37.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.842+0000 7f063b1b6640 1 -- 172.21.15.114:0/409286932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06340c8c50 con 0x7f063415d250 2023-11-04T01:40:37.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.842+0000 7f06317fa640 1 -- 172.21.15.114:0/409286932 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0628007860 con 0x7f063415d250 2023-11-04T01:40:37.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.842+0000 7f063b1b6640 1 -- 172.21.15.114:0/409286932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063414cb40 con 0x7f063415d250 2023-11-04T01:40:37.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.842+0000 7f063b1b6640 1 -- 172.21.15.114:0/409286932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063414cd60 con 0x7f063415d250 2023-11-04T01:40:37.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.843+0000 7f06317fa640 1 -- 172.21.15.114:0/409286932 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0628007bd0 con 0x7f063415d250 2023-11-04T01:40:37.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.843+0000 7f06317fa640 1 --2- 172.21.15.114:0/409286932 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f062006ae70 0x7f062006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.843+0000 7f06317fa640 1 -- 172.21.15.114:0/409286932 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f0628089c20 con 0x7f063415d250 2023-11-04T01:40:37.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.843+0000 7f0638f52640 1 --2- 172.21.15.114:0/409286932 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f062006ae70 0x7f062006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.844+0000 7f0638f52640 1 --2- 172.21.15.114:0/409286932 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f062006ae70 0x7f062006d330 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0624036000 tx=0x7f062403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:37.848+0000 7f06317fa640 1 -- 172.21.15.114:0/409286932 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f063414cd60 con 0x7f063415d250 2023-11-04T01:40:38.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.051+0000 7f063b1b6640 1 -- 172.21.15.114:0/409286932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f063414cd60 con 0x7f063415d250 2023-11-04T01:40:38.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.052+0000 7f06317fa640 1 -- 172.21.15.114:0/409286932 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f063414cd60 con 0x7f063415d250 2023-11-04T01:40:38.054 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:38.054 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7773,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:35.074875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6292,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6292":{"gid":6292,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:38.054 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 55 2023-11-04T01:40:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.054+0000 7f063b1b6640 1 -- 172.21.15.114:0/409286932 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f062006ae70 msgr2=0x7f062006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.054+0000 7f063b1b6640 1 --2- 172.21.15.114:0/409286932 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f062006ae70 0x7f062006d330 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0624036000 tx=0x7f062403c040 comp rx=0 tx=0).stop 2023-11-04T01:40:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.054+0000 7f063b1b6640 1 -- 172.21.15.114:0/409286932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f063415d250 msgr2=0x7f063415be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.054+0000 7f063b1b6640 1 --2- 172.21.15.114:0/409286932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f063415d250 0x7f063415be90 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f062800c7f0 tx=0x7f062800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.054+0000 7f063b1b6640 1 -- 172.21.15.114:0/409286932 shutdown_connections 2023-11-04T01:40:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.054+0000 7f063b1b6640 1 --2- 172.21.15.114:0/409286932 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f063414c6c0 0x7f06341e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.054+0000 7f063b1b6640 1 --2- 172.21.15.114:0/409286932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f063415d250 0x7f063415be90 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.054+0000 7f063b1b6640 1 --2- 172.21.15.114:0/409286932 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f062006ae70 0x7f062006d330 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.054+0000 7f063b1b6640 1 --2- 172.21.15.114:0/409286932 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f063415ce70 0x7f06340ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.054+0000 7f063b1b6640 1 -- 172.21.15.114:0/409286932 >> 172.21.15.114:0/409286932 conn(0x7f06340b0cd0 msgr2=0x7f063415c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.054+0000 7f063b1b6640 1 -- 172.21.15.114:0/409286932 shutdown_connections 2023-11-04T01:40:38.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.054+0000 7f063b1b6640 1 -- 172.21.15.114:0/409286932 wait complete. 2023-11-04T01:40:38.469 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:51.430343+0000', 'modified': '2023-11-04T01:40:35.074875+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 99, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6292, 'mds_1': 6298}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6292': {'gid': 6292, 'name': 'a', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.114:6837/1768068040', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6835', 'nonce': 1768068040}, {'type': 'v1', 'addr': '172.21.15.114:6837', 'nonce': 1768068040}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_6298': {'gid': 6298, 'name': 'b', 'rank': 1, 'incarnation': 45, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.141:6834/1296600989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.141:6832', 'nonce': 1296600989}, {'type': 'v1', 'addr': '172.21.15.141:6834', 'nonce': 1296600989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:40:38.469 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:40:38.470 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:40:38.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.571+0000 7f6e4906b640 1 Processor -- start 2023-11-04T01:40:38.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.571+0000 7f6e4906b640 1 -- start start 2023-11-04T01:40:38.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.571+0000 7f6e4906b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e44070e20 0x7f6e440adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.571+0000 7f6e4906b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e440c3900 con 0x7f6e4415ad30 2023-11-04T01:40:38.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.571+0000 7f6e4906b640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e440c3be0 con 0x7f6e440ad730 2023-11-04T01:40:38.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.571+0000 7f6e4906b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440ae260 con 0x7f6e44070e20 2023-11-04T01:40:38.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e42d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6e4415ad30 0x7f6e44070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38452/0 (socket says 172.21.15.114:38452) 2023-11-04T01:40:38.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e42d9d640 1 -- 172.21.15.114:0/1415254843 learned_addr learned my addr 172.21.15.114:0/1415254843 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:38.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e4259c640 1 --2- 172.21.15.114:0/1415254843 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e44070e20 0x7f6e440adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e41d9b640 1 -- 172.21.15.114:0/1415254843 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162922352 0 0) 0x7f6e440c3900 con 0x7f6e4415ad30 2023-11-04T01:40:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e41d9b640 1 -- 172.21.15.114:0/1415254843 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e2c003520 con 0x7f6e4415ad30 2023-11-04T01:40:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e41d9b640 1 -- 172.21.15.114:0/1415254843 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3797550418 0 0) 0x7f6e2c003520 con 0x7f6e4415ad30 2023-11-04T01:40:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e41d9b640 1 -- 172.21.15.114:0/1415254843 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e44070e20 msgr2=0x7f6e440adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e41d9b640 1 --2- 172.21.15.114:0/1415254843 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e44070e20 0x7f6e440adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e41d9b640 1 -- 172.21.15.114:0/1415254843 >> v1:172.21.15.141:6789/0 conn(0x7f6e440ad730 legacy=0x7f6e4415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e41d9b640 1 -- 172.21.15.114:0/1415254843 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e440c3ec0 con 0x7f6e4415ad30 2023-11-04T01:40:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e41d9b640 1 -- 172.21.15.114:0/1415254843 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f6e34001670 con 0x7f6e4415ad30 2023-11-04T01:40:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e41d9b640 1 -- 172.21.15.114:0/1415254843 >> v1:172.21.15.114:6789/0 conn(0x7f6e4415ad30 legacy=0x7f6e44070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e41d9b640 1 --2- 172.21.15.114:0/1415254843 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e2c0039a0 0x7f6e2c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e41d9b640 1 --2- 172.21.15.114:0/1415254843 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e44070e20 0x7f6e2c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e41d9b640 1 --2- 172.21.15.114:0/1415254843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2c004d00 0x7f6e2c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e41d9b640 1 -- 172.21.15.114:0/1415254843 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440ae260 con 0x7f6e2c004d00 2023-11-04T01:40:38.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e41d9b640 1 -- 172.21.15.114:0/1415254843 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c00ba30 con 0x7f6e2c0039a0 2023-11-04T01:40:38.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e41d9b640 1 -- 172.21.15.114:0/1415254843 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c00bbf0 con 0x7f6e44070e20 2023-11-04T01:40:38.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e4359e640 1 --2- 172.21.15.114:0/1415254843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2c004d00 0x7f6e2c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e42d9d640 1 --2- 172.21.15.114:0/1415254843 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e2c0039a0 0x7f6e2c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.572+0000 7f6e4259c640 1 --2- 172.21.15.114:0/1415254843 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e44070e20 0x7f6e2c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.573+0000 7f6e4359e640 1 -- 172.21.15.114:0/1415254843 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e44070e20 msgr2=0x7f6e2c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.573+0000 7f6e4359e640 1 --2- 172.21.15.114:0/1415254843 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e44070e20 0x7f6e2c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.573+0000 7f6e4359e640 1 -- 172.21.15.114:0/1415254843 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e2c0039a0 msgr2=0x7f6e2c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.573+0000 7f6e4359e640 1 --2- 172.21.15.114:0/1415254843 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e2c0039a0 0x7f6e2c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.573+0000 7f6e4359e640 1 -- 172.21.15.114:0/1415254843 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c003520 con 0x7f6e2c004d00 2023-11-04T01:40:38.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.573+0000 7f6e4359e640 1 --2- 172.21.15.114:0/1415254843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2c004d00 0x7f6e2c005180 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c001f60 tx=0x7f6e2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299c6f11140e7be5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.573+0000 7f6e41d9b640 1 -- 172.21.15.114:0/1415254843 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c02d6f0 con 0x7f6e2c004d00 2023-11-04T01:40:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.573+0000 7f6e41d9b640 1 -- 172.21.15.114:0/1415254843 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c02d870 con 0x7f6e2c004d00 2023-11-04T01:40:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.573+0000 7f6e41d9b640 1 -- 172.21.15.114:0/1415254843 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c02dc20 con 0x7f6e2c004d00 2023-11-04T01:40:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.574+0000 7f6e4906b640 1 -- 172.21.15.114:0/1415254843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2c004d00 msgr2=0x7f6e2c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.574+0000 7f6e4906b640 1 --2- 172.21.15.114:0/1415254843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2c004d00 0x7f6e2c005180 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c001f60 tx=0x7f6e2c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.574+0000 7f6e4359e640 1 -- 172.21.15.114:0/1415254843 reap_dead start 2023-11-04T01:40:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.574+0000 7f6e4906b640 1 -- 172.21.15.114:0/1415254843 shutdown_connections 2023-11-04T01:40:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.574+0000 7f6e4906b640 1 -- 172.21.15.114:0/1415254843 >> 172.21.15.114:0/1415254843 conn(0x7f6e440ce950 msgr2=0x7f6e440ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.574+0000 7f6e4906b640 1 -- 172.21.15.114:0/1415254843 shutdown_connections 2023-11-04T01:40:38.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.574+0000 7f6e4906b640 1 -- 172.21.15.114:0/1415254843 wait complete. 2023-11-04T01:40:38.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.575+0000 7f6e4906b640 1 Processor -- start 2023-11-04T01:40:38.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.576+0000 7f6e4906b640 1 -- start start 2023-11-04T01:40:38.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.576+0000 7f6e4906b640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e441efbf0 0x7f6e4415b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.576+0000 7f6e4906b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e441effd0 0x7f6e440b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.576+0000 7f6e4906b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e440b2440 0x7f6e440b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.576+0000 7f6e4906b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440b2950 con 0x7f6e440b2440 2023-11-04T01:40:38.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.576+0000 7f6e4906b640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440c6d20 con 0x7f6e441efbf0 2023-11-04T01:40:38.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.576+0000 7f6e4906b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440c7000 con 0x7f6e441effd0 2023-11-04T01:40:38.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.576+0000 7f6e4359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e440b2440 0x7f6e440b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.576+0000 7f6e4359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e440b2440 0x7f6e440b12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40382/0 (socket says 172.21.15.114:40382) 2023-11-04T01:40:38.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.576+0000 7f6e4359e640 1 -- 172.21.15.114:0/2312932118 learned_addr learned my addr 172.21.15.114:0/2312932118 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:38.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.576+0000 7f6e42d9d640 1 --2- 172.21.15.114:0/2312932118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e441efbf0 0x7f6e4415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.576+0000 7f6e4259c640 1 --2- 172.21.15.114:0/2312932118 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e441effd0 0x7f6e440b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.577+0000 7f6e4359e640 1 -- 172.21.15.114:0/2312932118 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e441effd0 msgr2=0x7f6e440b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.577+0000 7f6e4359e640 1 --2- 172.21.15.114:0/2312932118 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e441effd0 0x7f6e440b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.577+0000 7f6e4359e640 1 -- 172.21.15.114:0/2312932118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e441efbf0 msgr2=0x7f6e4415b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.577+0000 7f6e4359e640 1 --2- 172.21.15.114:0/2312932118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e441efbf0 0x7f6e4415b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.577+0000 7f6e4359e640 1 -- 172.21.15.114:0/2312932118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e440c72e0 con 0x7f6e440b2440 2023-11-04T01:40:38.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.577+0000 7f6e4359e640 1 --2- 172.21.15.114:0/2312932118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e440b2440 0x7f6e440b12b0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c002080 tx=0x7f6e3c0015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.577+0000 7f6e2b7fe640 1 -- 172.21.15.114:0/2312932118 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c003b80 con 0x7f6e440b2440 2023-11-04T01:40:38.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.577+0000 7f6e2b7fe640 1 -- 172.21.15.114:0/2312932118 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c003ce0 con 0x7f6e440b2440 2023-11-04T01:40:38.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.577+0000 7f6e4906b640 1 -- 172.21.15.114:0/2312932118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e440c75c0 con 0x7f6e440b2440 2023-11-04T01:40:38.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.577+0000 7f6e2b7fe640 1 -- 172.21.15.114:0/2312932118 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c0052e0 con 0x7f6e440b2440 2023-11-04T01:40:38.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.577+0000 7f6e4906b640 1 -- 172.21.15.114:0/2312932118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e440b17f0 con 0x7f6e440b2440 2023-11-04T01:40:38.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.579+0000 7f6e2b7fe640 1 -- 172.21.15.114:0/2312932118 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e3c005440 con 0x7f6e440b2440 2023-11-04T01:40:38.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.579+0000 7f6e2b7fe640 1 --2- 172.21.15.114:0/2312932118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e3006aea0 0x7f6e3006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.579+0000 7f6e2b7fe640 1 -- 172.21.15.114:0/2312932118 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f6e3c031070 con 0x7f6e440b2440 2023-11-04T01:40:38.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.579+0000 7f6e42d9d640 1 --2- 172.21.15.114:0/2312932118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e3006aea0 0x7f6e3006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.580+0000 7f6e42d9d640 1 --2- 172.21.15.114:0/2312932118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e3006aea0 0x7f6e3006d360 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6e34000c00 tx=0x7f6e34001c40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.580+0000 7f6e4bbfd740 1 Processor -- start 2023-11-04T01:40:38.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.580+0000 7f6e4bbfd740 1 -- start start 2023-11-04T01:40:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e4bbfd740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f388184850 0x55f388157750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e4bbfd740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f388184c30 0x55f3881875e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e4bbfd740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388157c90 0x55f388187b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e4bbfd740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f388068740 con 0x55f388157c90 2023-11-04T01:40:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e4bbfd740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3880ca8d0 con 0x55f388184850 2023-11-04T01:40:38.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e4bbfd740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3880c7fc0 con 0x55f388184c30 2023-11-04T01:40:38.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e4359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388157c90 0x55f388187b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e4359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388157c90 0x55f388187b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40398/0 (socket says 172.21.15.114:40398) 2023-11-04T01:40:38.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e4359e640 1 -- 172.21.15.114:0/1090582578 learned_addr learned my addr 172.21.15.114:0/1090582578 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:38.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e4259c640 1 --2- 172.21.15.114:0/1090582578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f388184c30 0x55f3881875e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e42d9d640 1 --2- 172.21.15.114:0/1090582578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f388184850 0x55f388157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e4359e640 1 -- 172.21.15.114:0/1090582578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f388184c30 msgr2=0x55f3881875e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e4359e640 1 --2- 172.21.15.114:0/1090582578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f388184c30 0x55f3881875e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e4359e640 1 -- 172.21.15.114:0/1090582578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f388184850 msgr2=0x55f388157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e4359e640 1 --2- 172.21.15.114:0/1090582578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f388184850 0x55f388157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e4359e640 1 -- 172.21.15.114:0/1090582578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f388086ca0 con 0x55f388157c90 2023-11-04T01:40:38.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.581+0000 7f6e4359e640 1 --2- 172.21.15.114:0/1090582578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388157c90 0x55f388187b20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0817b0 tx=0x7f6e3c0011c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32af88acf9aec04c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.582+0000 7f6e28ff9640 1 -- 172.21.15.114:0/1090582578 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c0799e0 con 0x55f388157c90 2023-11-04T01:40:38.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.582+0000 7f6e28ff9640 1 -- 172.21.15.114:0/1090582578 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c07db30 con 0x55f388157c90 2023-11-04T01:40:38.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.582+0000 7f6e28ff9640 1 -- 172.21.15.114:0/1090582578 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c081ce0 con 0x55f388157c90 2023-11-04T01:40:38.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.582+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/1090582578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388157c90 msgr2=0x55f388187b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.582+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/1090582578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388157c90 0x55f388187b20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0817b0 tx=0x7f6e3c0011c0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.582+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/1090582578 shutdown_connections 2023-11-04T01:40:38.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.582+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/1090582578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388157c90 0x55f388187b20 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.582+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/1090582578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f388184c30 0x55f3881875e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.582+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/1090582578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f388184850 0x55f388157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.582+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/1090582578 >> 172.21.15.114:0/1090582578 conn(0x55f388159a60 msgr2=0x55f3881a25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.582+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/1090582578 shutdown_connections 2023-11-04T01:40:38.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.582+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/1090582578 wait complete. 2023-11-04T01:40:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.583+0000 7f6e4bbfd740 1 -- start start 2023-11-04T01:40:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.583+0000 7f6e4bbfd740 1 Processor -- start 2023-11-04T01:40:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e4bbfd740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388184850 0x55f38818b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e4bbfd740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f388184c30 0x55f38819b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e4bbfd740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f3881564f0 0x55f388156970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e4bbfd740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3880c38b0 con 0x55f388184850 2023-11-04T01:40:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e4bbfd740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f38807dc80 con 0x55f3881564f0 2023-11-04T01:40:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e4bbfd740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f38807d920 con 0x55f388184c30 2023-11-04T01:40:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e4bbfd740 10 client.0 _ll_register_callbacks cb 0x55f387dd5ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e42d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388184850 0x55f38818b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e42d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388184850 0x55f38818b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40404/0 (socket says 172.21.15.114:40404) 2023-11-04T01:40:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e42d9d640 1 -- 172.21.15.114:0/4119563873 learned_addr learned my addr 172.21.15.114:0/4119563873 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e4359e640 1 --2- 172.21.15.114:0/4119563873 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f3881564f0 0x55f388156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e4259c640 1 --2- 172.21.15.114:0/4119563873 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f388184c30 0x55f38819b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e42d9d640 1 -- 172.21.15.114:0/4119563873 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f388184c30 msgr2=0x55f38819b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e42d9d640 1 --2- 172.21.15.114:0/4119563873 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f388184c30 0x55f38819b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e42d9d640 1 -- 172.21.15.114:0/4119563873 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f3881564f0 msgr2=0x55f388156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e42d9d640 1 --2- 172.21.15.114:0/4119563873 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f3881564f0 0x55f388156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e42d9d640 1 -- 172.21.15.114:0/4119563873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e440b17f0 con 0x55f388184850 2023-11-04T01:40:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e4359e640 1 --2- 172.21.15.114:0/4119563873 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f3881564f0 0x55f388156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e4259c640 1 --2- 172.21.15.114:0/4119563873 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f388184c30 0x55f38819b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e42d9d640 1 --2- 172.21.15.114:0/4119563873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388184850 0x55f38818b090 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f6e34015a20 tx=0x7f6e34001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdf028a16c511cf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:40:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e21ffb640 1 -- 172.21.15.114:0/4119563873 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3401a040 con 0x55f388184850 2023-11-04T01:40:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e21ffb640 1 -- 172.21.15.114:0/4119563873 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f6e34022670 con 0x55f388184850 2023-11-04T01:40:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.584+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/4119563873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f38806fbf0 con 0x55f388184850 2023-11-04T01:40:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.585+0000 7f6e21ffb640 1 -- 172.21.15.114:0/4119563873 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e34022830 con 0x55f388184850 2023-11-04T01:40:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.585+0000 7f6e4bbfd740 10 client.7803 fetch_fsmap learned FSMap version 55 2023-11-04T01:40:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.585+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/4119563873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55f3880c1f30 con 0x55f388184850 2023-11-04T01:40:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.585+0000 7f6e21ffb640 1 -- 172.21.15.114:0/4119563873 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f38806fbf0 con 0x55f388184850 2023-11-04T01:40:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.585+0000 7f6e21ffb640 1 -- 172.21.15.114:0/4119563873 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 55) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f6e34020050 con 0x55f388184850 2023-11-04T01:40:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.585+0000 7f6e4bbfd740 10 client.7803 fetch_fsmap finished waiting for FSMap version 55 2023-11-04T01:40:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.585+0000 7f6e4bbfd740 10 client.7803 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:40:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.585+0000 7f6e4bbfd740 20 client.7803 populate_metadata read hostname 'smithi114' 2023-11-04T01:40:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.585+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/4119563873 >> [v2:172.21.15.114:6835/1768068040,v1:172.21.15.114:6837/1768068040] conn(0x55f388188aa0 0x55f388188e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.585+0000 7f6e4bbfd740 4 client.7803 mds_command: new command op to 6292 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.585+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/4119563873 --> [v2:172.21.15.114:6835/1768068040,v1:172.21.15.114:6837/1768068040] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3880bc890 con 0x55f388188aa0 2023-11-04T01:40:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.585+0000 7f6e4259c640 1 --2- 172.21.15.114:0/4119563873 >> [v2:172.21.15.114:6835/1768068040,v1:172.21.15.114:6837/1768068040] conn(0x55f388188aa0 0x55f388188e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.585+0000 7f6e21ffb640 10 client.7803 ms_handle_connect on v2:172.21.15.114:6835/1768068040 2023-11-04T01:40:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.585+0000 7f6e4259c640 1 --2- 172.21.15.114:0/4119563873 >> [v2:172.21.15.114:6835/1768068040,v1:172.21.15.114:6837/1768068040] conn(0x55f388188aa0 0x55f388188e80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa56d6d4cd0ceb7e server_cookie=f895dd860bb16bdb in_seq=0 out_seq=0 2023-11-04T01:40:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.586+0000 7f6e21ffb640 1 -- 172.21.15.114:0/4119563873 <== mds.0 v2:172.21.15.114:6835/1768068040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f3880bc890 con 0x55f388188aa0 2023-11-04T01:40:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.586+0000 7f6e21ffb640 10 client.7803 handle_command_reply: tid=0 2023-11-04T01:40:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.586+0000 7f6e4bbfd740 1 client.7803 shutdown 2023-11-04T01:40:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.586+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/4119563873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388184850 msgr2=0x55f38818b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.586+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/4119563873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388184850 0x55f38818b090 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f6e34015a20 tx=0x7f6e34001a00 comp rx=0 tx=0).stop 2023-11-04T01:40:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.586+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/4119563873 shutdown_connections 2023-11-04T01:40:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.586+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/4119563873 >> [v2:172.21.15.114:6835/1768068040,v1:172.21.15.114:6837/1768068040] conn(0x55f388188aa0 0x55f388188e80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.586+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/4119563873 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f3881564f0 0x55f388156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.586+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/4119563873 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f388184c30 0x55f38819b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.586+0000 7f6e21ffb640 0 client.7803 ms_handle_reset on v2:172.21.15.114:6835/1768068040 2023-11-04T01:40:38.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.586+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/4119563873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388184850 0x55f38818b090 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.586+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/4119563873 >> 172.21.15.114:0/4119563873 conn(0x55f388157c90 msgr2=0x55f3881a6380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.586+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/4119563873 shutdown_connections 2023-11-04T01:40:38.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.586+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/4119563873 wait complete. 2023-11-04T01:40:38.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.586+0000 7f6e4bbfd740 20 client.7803 trim_cache size 0 max 16384 2023-11-04T01:40:38.599 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:40:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.602+0000 7f6e4bbfd740 1 Processor -- start 2023-11-04T01:40:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.602+0000 7f6e4bbfd740 1 -- start start 2023-11-04T01:40:38.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.602+0000 7f6e4bbfd740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f3881564f0 0x55f3881877c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.602+0000 7f6e4bbfd740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f388184850 0x55f38818a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.602+0000 7f6e4bbfd740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f388184c30 0x55f38818a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.602+0000 7f6e4bbfd740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f388043280 con 0x55f3881564f0 2023-11-04T01:40:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.602+0000 7f6e4bbfd740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f38819b4c0 con 0x55f388184850 2023-11-04T01:40:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.602+0000 7f6e4bbfd740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f388184160 con 0x55f388184c30 2023-11-04T01:40:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.602+0000 7f6e42d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f3881564f0 0x55f3881877c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.602+0000 7f6e42d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f3881564f0 0x55f3881877c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40414/0 (socket says 172.21.15.114:40414) 2023-11-04T01:40:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.602+0000 7f6e42d9d640 1 -- 172.21.15.114:0/3208168940 learned_addr learned my addr 172.21.15.114:0/3208168940 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e42d9d640 1 -- 172.21.15.114:0/3208168940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f388184c30 msgr2=0x55f38818a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e42d9d640 1 --2- 172.21.15.114:0/3208168940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f388184c30 0x55f38818a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e42d9d640 1 -- 172.21.15.114:0/3208168940 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f388184850 msgr2=0x55f38818a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e42d9d640 1 --2- 172.21.15.114:0/3208168940 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f388184850 0x55f38818a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e42d9d640 1 -- 172.21.15.114:0/3208168940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f38805fd10 con 0x55f3881564f0 2023-11-04T01:40:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e42d9d640 1 --2- 172.21.15.114:0/3208168940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f3881564f0 0x55f3881877c0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f6e34001d30 tx=0x7f6e34023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f29d112c84d2ca server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e297fa640 1 -- 172.21.15.114:0/3208168940 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34022670 con 0x55f3881564f0 2023-11-04T01:40:38.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e297fa640 1 -- 172.21.15.114:0/3208168940 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e340227d0 con 0x55f3881564f0 2023-11-04T01:40:38.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e297fa640 1 -- 172.21.15.114:0/3208168940 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34023440 con 0x55f3881564f0 2023-11-04T01:40:38.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/3208168940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f3881564f0 msgr2=0x55f3881877c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/3208168940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f3881564f0 0x55f3881877c0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f6e34001d30 tx=0x7f6e34023000 comp rx=0 tx=0).stop 2023-11-04T01:40:38.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/3208168940 shutdown_connections 2023-11-04T01:40:38.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/3208168940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f388184c30 0x55f38818a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/3208168940 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f388184850 0x55f38818a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/3208168940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f3881564f0 0x55f3881877c0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/3208168940 >> 172.21.15.114:0/3208168940 conn(0x55f388157c90 msgr2=0x55f38818aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/3208168940 shutdown_connections 2023-11-04T01:40:38.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.603+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/3208168940 wait complete. 2023-11-04T01:40:38.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.604+0000 7f6e4bbfd740 1 -- start start 2023-11-04T01:40:38.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.604+0000 7f6e4bbfd740 1 Processor -- start 2023-11-04T01:40:38.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4bbfd740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f3881564f0 0x55f388180920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4bbfd740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f388184850 0x55f38820c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4bbfd740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388184c30 0x55f38818b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4bbfd740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f38815d430 con 0x55f388184c30 2023-11-04T01:40:38.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4bbfd740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f388181170 con 0x55f388184850 2023-11-04T01:40:38.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4bbfd740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f388197f70 con 0x55f3881564f0 2023-11-04T01:40:38.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4bbfd740 10 client.0 _ll_register_callbacks cb 0x7f6e3c075d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:38.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388184c30 0x55f38818b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388184c30 0x55f38818b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40430/0 (socket says 172.21.15.114:40430) 2023-11-04T01:40:38.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4359e640 1 -- 172.21.15.114:0/66929105 learned_addr learned my addr 172.21.15.114:0/66929105 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:38.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4359e640 1 -- 172.21.15.114:0/66929105 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f3881564f0 msgr2=0x55f388180920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4359e640 1 --2- 172.21.15.114:0/66929105 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f3881564f0 0x55f388180920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4359e640 1 -- 172.21.15.114:0/66929105 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f388184850 msgr2=0x55f38820c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4359e640 1 --2- 172.21.15.114:0/66929105 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f388184850 0x55f38820c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4359e640 1 -- 172.21.15.114:0/66929105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3880c1f30 con 0x55f388184c30 2023-11-04T01:40:38.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4359e640 1 --2- 172.21.15.114:0/66929105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388184c30 0x55f38818b210 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c02c080 tx=0x7f6e3c0a8fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90065c73e32874cf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:40:38.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e21ffb640 1 -- 172.21.15.114:0/66929105 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c081ce0 con 0x55f388184c30 2023-11-04T01:40:38.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e21ffb640 1 -- 172.21.15.114:0/66929105 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f6e3c0799e0 con 0x55f388184c30 2023-11-04T01:40:38.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.605+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/66929105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e3c07db30 con 0x55f388184c30 2023-11-04T01:40:38.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e21ffb640 1 -- 172.21.15.114:0/66929105 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e3c0056f0 con 0x55f388184c30 2023-11-04T01:40:38.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 10 client.7809 fetch_fsmap learned FSMap version 55 2023-11-04T01:40:38.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/66929105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55f388085500 con 0x55f388184c30 2023-11-04T01:40:38.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e21ffb640 1 -- 172.21.15.114:0/66929105 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c07db30 con 0x55f388184c30 2023-11-04T01:40:38.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e21ffb640 1 -- 172.21.15.114:0/66929105 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 55) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f6e3c093d20 con 0x55f388184c30 2023-11-04T01:40:38.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 10 client.7809 fetch_fsmap finished waiting for FSMap version 55 2023-11-04T01:40:38.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 10 client.7809 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:40:38.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 20 client.7809 populate_metadata read hostname 'smithi114' 2023-11-04T01:40:38.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/66929105 >> [v2:172.21.15.114:6835/1768068040,v1:172.21.15.114:6837/1768068040] conn(0x55f38815c4f0 0x55f38815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 4 client.7809 mds_command: new command op to 6292 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:38.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/66929105 --> [v2:172.21.15.114:6835/1768068040,v1:172.21.15.114:6837/1768068040] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f3880bc5b0 con 0x55f38815c4f0 2023-11-04T01:40:38.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e42d9d640 1 --2- 172.21.15.114:0/66929105 >> [v2:172.21.15.114:6835/1768068040,v1:172.21.15.114:6837/1768068040] conn(0x55f38815c4f0 0x55f38815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e21ffb640 10 client.7809 ms_handle_connect on v2:172.21.15.114:6835/1768068040 2023-11-04T01:40:38.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e42d9d640 1 --2- 172.21.15.114:0/66929105 >> [v2:172.21.15.114:6835/1768068040,v1:172.21.15.114:6837/1768068040] conn(0x55f38815c4f0 0x55f38815c8d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54408681df7cc499 server_cookie=1270215ab57b4839 in_seq=0 out_seq=0 2023-11-04T01:40:38.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e21ffb640 1 -- 172.21.15.114:0/66929105 <== mds.0 v2:172.21.15.114:6835/1768068040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f3880bc5b0 con 0x55f38815c4f0 2023-11-04T01:40:38.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e21ffb640 10 client.7809 handle_command_reply: tid=0 2023-11-04T01:40:38.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 1 client.7809 shutdown 2023-11-04T01:40:38.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/66929105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388184c30 msgr2=0x55f38818b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/66929105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388184c30 0x55f38818b210 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c02c080 tx=0x7f6e3c0a8fb0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/66929105 shutdown_connections 2023-11-04T01:40:38.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/66929105 >> [v2:172.21.15.114:6835/1768068040,v1:172.21.15.114:6837/1768068040] conn(0x55f38815c4f0 0x55f38815c8d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/66929105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f388184c30 0x55f38818b210 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/66929105 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55f388184850 0x55f38820c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 1 --2- 172.21.15.114:0/66929105 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55f3881564f0 0x55f388180920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/66929105 >> 172.21.15.114:0/66929105 conn(0x55f388157c90 msgr2=0x55f3881a2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.606+0000 7f6e21ffb640 0 client.7809 ms_handle_reset on v2:172.21.15.114:6835/1768068040 2023-11-04T01:40:38.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.607+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/66929105 shutdown_connections 2023-11-04T01:40:38.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.607+0000 7f6e4bbfd740 1 -- 172.21.15.114:0/66929105 wait complete. 2023-11-04T01:40:38.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.607+0000 7f6e4bbfd740 20 client.7809 trim_cache size 0 max 16384 2023-11-04T01:40:38.617 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:40:38.617 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:40:38.617 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-11-04T01:40:38.617 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 6292, 2023-11-04T01:40:38.617 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:40:38.617 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:40:38.617 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:40:38.617 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 6.5442318019999997, 2023-11-04T01:40:38.617 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 55, 2023-11-04T01:40:38.617 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 99, 2023-11-04T01:40:38.617 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 99, 2023-11-04T01:40:38.617 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 52.613757999999997 2023-11-04T01:40:38.618 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:40:38.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.607+0000 7f6e4906b640 1 -- 172.21.15.114:0/2312932118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e3006aea0 msgr2=0x7f6e3006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.607+0000 7f6e4906b640 1 --2- 172.21.15.114:0/2312932118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e3006aea0 0x7f6e3006d360 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6e34000c00 tx=0x7f6e34001c40 comp rx=0 tx=0).stop 2023-11-04T01:40:38.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.607+0000 7f6e4906b640 1 -- 172.21.15.114:0/2312932118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e440b2440 msgr2=0x7f6e440b12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.607+0000 7f6e4906b640 1 --2- 172.21.15.114:0/2312932118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e440b2440 0x7f6e440b12b0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c002080 tx=0x7f6e3c0015b0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.607+0000 7f6e4906b640 1 -- 172.21.15.114:0/2312932118 shutdown_connections 2023-11-04T01:40:38.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.607+0000 7f6e4906b640 1 --2- 172.21.15.114:0/2312932118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e440b2440 0x7f6e440b12b0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.607+0000 7f6e4906b640 1 --2- 172.21.15.114:0/2312932118 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6e441effd0 0x7f6e440b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.607+0000 7f6e4906b640 1 --2- 172.21.15.114:0/2312932118 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6e3006aea0 0x7f6e3006d360 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.607+0000 7f6e4906b640 1 --2- 172.21.15.114:0/2312932118 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6e441efbf0 0x7f6e4415b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.607+0000 7f6e4906b640 1 -- 172.21.15.114:0/2312932118 >> 172.21.15.114:0/2312932118 conn(0x7f6e440ce950 msgr2=0x7f6e44072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.607+0000 7f6e4906b640 1 -- 172.21.15.114:0/2312932118 shutdown_connections 2023-11-04T01:40:38.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.607+0000 7f6e4906b640 1 -- 172.21.15.114:0/2312932118 wait complete. 2023-11-04T01:40:38.620 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:40:38.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.718+0000 7f5989f89640 1 Processor -- start 2023-11-04T01:40:38.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.718+0000 7f5989f89640 1 -- start start 2023-11-04T01:40:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.719+0000 7f5989f89640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5984070ff0 0x7f59840cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.719+0000 7f5989f89640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59840c9bf0 con 0x7f5984066000 2023-11-04T01:40:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.719+0000 7f5989f89640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59840cd890 con 0x7f598415d1b0 2023-11-04T01:40:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.719+0000 7f5989f89640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59840cdb30 con 0x7f5984070ff0 2023-11-04T01:40:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.719+0000 7f59837fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5984070ff0 0x7f59840cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.719+0000 7f5983fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5984066000 0x7f598406a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38454/0 (socket says 172.21.15.114:38454) 2023-11-04T01:40:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.719+0000 7f5983fff640 1 -- 172.21.15.114:0/741535857 learned_addr learned my addr 172.21.15.114:0/741535857 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.719+0000 7f59837fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5984070ff0 0x7f59840cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40440/0 (socket says 172.21.15.114:40440) 2023-11-04T01:40:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.719+0000 7f59837fe640 1 -- 172.21.15.114:0/741535857 >> v1:172.21.15.141:6789/0 conn(0x7f598415d1b0 legacy=0x7f59840713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.720+0000 7f59837fe640 1 -- 172.21.15.114:0/741535857 >> v1:172.21.15.114:6789/0 conn(0x7f5984066000 legacy=0x7f598406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.720+0000 7f59827fc640 1 -- 172.21.15.114:0/741535857 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278244864 0 0) 0x7f59840c9bf0 con 0x7f5984066000 2023-11-04T01:40:38.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.720+0000 7f59837fe640 1 -- 172.21.15.114:0/741535857 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59840cde10 con 0x7f5984070ff0 2023-11-04T01:40:38.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.720+0000 7f59837fe640 1 --2- 172.21.15.114:0/741535857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5984070ff0 0x7f59840cb4e0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f59740097a0 tx=0x7f597402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd3d961a77b7395 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.720+0000 7f59827fc640 1 -- 172.21.15.114:0/741535857 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5974031830 con 0x7f5984070ff0 2023-11-04T01:40:38.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.720+0000 7f59827fc640 1 -- 172.21.15.114:0/741535857 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5974031990 con 0x7f5984070ff0 2023-11-04T01:40:38.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.720+0000 7f59827fc640 1 -- 172.21.15.114:0/741535857 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5974031d20 con 0x7f5984070ff0 2023-11-04T01:40:38.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.721+0000 7f5989f89640 1 -- 172.21.15.114:0/741535857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5984070ff0 msgr2=0x7f59840cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.721+0000 7f5989f89640 1 --2- 172.21.15.114:0/741535857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5984070ff0 0x7f59840cb4e0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f59740097a0 tx=0x7f597402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.721+0000 7f5989f89640 1 -- 172.21.15.114:0/741535857 shutdown_connections 2023-11-04T01:40:38.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.721+0000 7f5989f89640 1 --2- 172.21.15.114:0/741535857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5984070ff0 0x7f59840cb4e0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.721+0000 7f5989f89640 1 -- 172.21.15.114:0/741535857 >> 172.21.15.114:0/741535857 conn(0x7f59840cbc90 msgr2=0x7f59840cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.721+0000 7f5989f89640 1 -- 172.21.15.114:0/741535857 shutdown_connections 2023-11-04T01:40:38.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.721+0000 7f5989f89640 1 -- 172.21.15.114:0/741535857 wait complete. 2023-11-04T01:40:38.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.722+0000 7f5989f89640 1 Processor -- start 2023-11-04T01:40:38.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.722+0000 7f5989f89640 1 -- start start 2023-11-04T01:40:38.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.723+0000 7f5989f89640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5984066000 0x7f59840c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.723+0000 7f5989f89640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5984070ff0 0x7f59840afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.723+0000 7f5989f89640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f598415d1b0 0x7f59840b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.723+0000 7f5989f89640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59841f3a30 con 0x7f598415d1b0 2023-11-04T01:40:38.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.723+0000 7f5989f89640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59840b3de0 con 0x7f5984070ff0 2023-11-04T01:40:38.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.723+0000 7f5989f89640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59840b40c0 con 0x7f5984066000 2023-11-04T01:40:38.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.723+0000 7f5983fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f598415d1b0 0x7f59840b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.723+0000 7f5983fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f598415d1b0 0x7f59840b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40456/0 (socket says 172.21.15.114:40456) 2023-11-04T01:40:38.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.723+0000 7f5983fff640 1 -- 172.21.15.114:0/811005058 learned_addr learned my addr 172.21.15.114:0/811005058 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:38.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.723+0000 7f5983fff640 1 -- 172.21.15.114:0/811005058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5984066000 msgr2=0x7f59840c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.723+0000 7f5983fff640 1 --2- 172.21.15.114:0/811005058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5984066000 0x7f59840c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.723+0000 7f5982ffd640 1 --2- 172.21.15.114:0/811005058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5984070ff0 0x7f59840afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.723+0000 7f5983fff640 1 -- 172.21.15.114:0/811005058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5984070ff0 msgr2=0x7f59840afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.723+0000 7f5983fff640 1 --2- 172.21.15.114:0/811005058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5984070ff0 0x7f59840afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.723+0000 7f5983fff640 1 -- 172.21.15.114:0/811005058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5974009400 con 0x7f598415d1b0 2023-11-04T01:40:38.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.723+0000 7f5982ffd640 1 --2- 172.21.15.114:0/811005058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5984070ff0 0x7f59840afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:38.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.724+0000 7f5983fff640 1 --2- 172.21.15.114:0/811005058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f598415d1b0 0x7f59840b02c0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f597c00c780 tx=0x7f597c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.724+0000 7f596bfff640 1 -- 172.21.15.114:0/811005058 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c00ce90 con 0x7f598415d1b0 2023-11-04T01:40:38.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.724+0000 7f596bfff640 1 -- 172.21.15.114:0/811005058 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c00a640 con 0x7f598415d1b0 2023-11-04T01:40:38.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.724+0000 7f596bfff640 1 -- 172.21.15.114:0/811005058 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c00a9d0 con 0x7f598415d1b0 2023-11-04T01:40:38.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.724+0000 7f5989f89640 1 -- 172.21.15.114:0/811005058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59840b43a0 con 0x7f598415d1b0 2023-11-04T01:40:38.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.724+0000 7f5989f89640 1 -- 172.21.15.114:0/811005058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59840c92e0 con 0x7f598415d1b0 2023-11-04T01:40:38.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.726+0000 7f596bfff640 1 -- 172.21.15.114:0/811005058 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f597c00ab30 con 0x7f598415d1b0 2023-11-04T01:40:38.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.726+0000 7f596bfff640 1 --2- 172.21.15.114:0/811005058 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f597006ae70 0x7f597006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.726+0000 7f596bfff640 1 -- 172.21.15.114:0/811005058 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f597c089140 con 0x7f598415d1b0 2023-11-04T01:40:38.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.726+0000 7f59837fe640 1 --2- 172.21.15.114:0/811005058 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f597006ae70 0x7f597006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.726+0000 7f59837fe640 1 --2- 172.21.15.114:0/811005058 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f597006ae70 0x7f597006d330 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5974036000 tx=0x7f5974030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.727+0000 7f598cbfc740 1 Processor -- start 2023-11-04T01:40:38.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.727+0000 7f598cbfc740 1 -- start start 2023-11-04T01:40:38.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f598cbfc740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb91f850 0x5571fb8f2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f598cbfc740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb91fc30 0x5571fb9225e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f598cbfc740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb8f2c90 0x5571fb922b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f598cbfc740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fb803740 con 0x5571fb91fc30 2023-11-04T01:40:38.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f598cbfc740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fb8658d0 con 0x5571fb91f850 2023-11-04T01:40:38.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f598cbfc740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571fb862fc0 con 0x5571fb8f2c90 2023-11-04T01:40:38.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f5982ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb91fc30 0x5571fb9225e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f5982ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb91fc30 0x5571fb9225e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40462/0 (socket says 172.21.15.114:40462) 2023-11-04T01:40:38.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f5982ffd640 1 -- 172.21.15.114:0/2644426878 learned_addr learned my addr 172.21.15.114:0/2644426878 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:38.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f5982ffd640 1 -- 172.21.15.114:0/2644426878 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb8f2c90 msgr2=0x5571fb922b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f5982ffd640 1 --2- 172.21.15.114:0/2644426878 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb8f2c90 0x5571fb922b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f5982ffd640 1 -- 172.21.15.114:0/2644426878 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb91f850 msgr2=0x5571fb8f2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f5982ffd640 1 --2- 172.21.15.114:0/2644426878 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb91f850 0x5571fb8f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f5982ffd640 1 -- 172.21.15.114:0/2644426878 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571fb821ca0 con 0x5571fb91fc30 2023-11-04T01:40:38.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f5982ffd640 1 --2- 172.21.15.114:0/2644426878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb91fc30 0x5571fb9225e0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f5978003ea0 tx=0x7f5978004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb989bc1d20bbf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f59697fa640 1 -- 172.21.15.114:0/2644426878 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978005270 con 0x5571fb91fc30 2023-11-04T01:40:38.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f59697fa640 1 -- 172.21.15.114:0/2644426878 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59780053f0 con 0x5571fb91fc30 2023-11-04T01:40:38.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.728+0000 7f59697fa640 1 -- 172.21.15.114:0/2644426878 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597800db80 con 0x5571fb91fc30 2023-11-04T01:40:38.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.729+0000 7f598cbfc740 1 -- 172.21.15.114:0/2644426878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb91fc30 msgr2=0x5571fb9225e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.729+0000 7f598cbfc740 1 --2- 172.21.15.114:0/2644426878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb91fc30 0x5571fb9225e0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f5978003ea0 tx=0x7f5978004360 comp rx=0 tx=0).stop 2023-11-04T01:40:38.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.729+0000 7f598cbfc740 1 -- 172.21.15.114:0/2644426878 shutdown_connections 2023-11-04T01:40:38.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.729+0000 7f598cbfc740 1 --2- 172.21.15.114:0/2644426878 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb8f2c90 0x5571fb922b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.729+0000 7f598cbfc740 1 --2- 172.21.15.114:0/2644426878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb91fc30 0x5571fb9225e0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.729+0000 7f598cbfc740 1 --2- 172.21.15.114:0/2644426878 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb91f850 0x5571fb8f2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.729+0000 7f598cbfc740 1 -- 172.21.15.114:0/2644426878 >> 172.21.15.114:0/2644426878 conn(0x5571fb8f4a60 msgr2=0x5571fb93d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.729+0000 7f598cbfc740 1 -- 172.21.15.114:0/2644426878 shutdown_connections 2023-11-04T01:40:38.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.729+0000 7f598cbfc740 1 -- 172.21.15.114:0/2644426878 wait complete. 2023-11-04T01:40:38.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.730+0000 7f598cbfc740 1 -- start start 2023-11-04T01:40:38.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.730+0000 7f598cbfc740 1 Processor -- start 2023-11-04T01:40:38.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.730+0000 7f598cbfc740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb91f850 0x5571fb9354e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.730+0000 7f598cbfc740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb91fc30 0x5571fb9375b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.730+0000 7f598cbfc740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb950260 0x5571fb8f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.730+0000 7f598cbfc740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fb85e8b0 con 0x5571fb950260 2023-11-04T01:40:38.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.730+0000 7f598cbfc740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fb818c80 con 0x5571fb91fc30 2023-11-04T01:40:38.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.730+0000 7f598cbfc740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571fb818920 con 0x5571fb91f850 2023-11-04T01:40:38.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.730+0000 7f598cbfc740 10 client.0 _ll_register_callbacks cb 0x5571fb570ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:38.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f5983fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb950260 0x5571fb8f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f5983fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb950260 0x5571fb8f14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40464/0 (socket says 172.21.15.114:40464) 2023-11-04T01:40:38.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f5983fff640 1 -- 172.21.15.114:0/3422919966 learned_addr learned my addr 172.21.15.114:0/3422919966 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:38.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f59837fe640 1 --2- 172.21.15.114:0/3422919966 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb91f850 0x5571fb9354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f5982ffd640 1 --2- 172.21.15.114:0/3422919966 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb91fc30 0x5571fb9375b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f5983fff640 1 -- 172.21.15.114:0/3422919966 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb91f850 msgr2=0x5571fb9354e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f5983fff640 1 --2- 172.21.15.114:0/3422919966 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb91f850 0x5571fb9354e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f5983fff640 1 -- 172.21.15.114:0/3422919966 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb91fc30 msgr2=0x5571fb9375b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f5983fff640 1 --2- 172.21.15.114:0/3422919966 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb91fc30 0x5571fb9375b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f5983fff640 1 -- 172.21.15.114:0/3422919966 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5978003ad0 con 0x5571fb950260 2023-11-04T01:40:38.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f5982ffd640 1 --2- 172.21.15.114:0/3422919966 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb91fc30 0x5571fb9375b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:38.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f5983fff640 1 --2- 172.21.15.114:0/3422919966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb950260 0x5571fb8f14f0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f597c0575b0 tx=0x7f597c05ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44181a4d846e8f59 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f59627fc640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:40:38.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f59627fc640 1 -- 172.21.15.114:0/3422919966 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c058de0 con 0x5571fb950260 2023-11-04T01:40:38.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f59627fc640 1 -- 172.21.15.114:0/3422919966 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f597c056da0 con 0x5571fb950260 2023-11-04T01:40:38.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f598cbfc740 1 -- 172.21.15.114:0/3422919966 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571fb80abf0 con 0x5571fb950260 2023-11-04T01:40:38.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f59627fc640 1 -- 172.21.15.114:0/3422919966 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f597c055ab0 con 0x5571fb950260 2023-11-04T01:40:38.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f598cbfc740 10 client.7824 fetch_fsmap learned FSMap version 55 2023-11-04T01:40:38.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f598cbfc740 1 -- 172.21.15.114:0/3422919966 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x5571fb85cf30 con 0x5571fb950260 2023-11-04T01:40:38.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f59627fc640 1 -- 172.21.15.114:0/3422919966 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c074080 con 0x5571fb950260 2023-11-04T01:40:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f59627fc640 1 -- 172.21.15.114:0/3422919966 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 55) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f597c05f720 con 0x5571fb950260 2023-11-04T01:40:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f598cbfc740 10 client.7824 fetch_fsmap finished waiting for FSMap version 55 2023-11-04T01:40:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f598cbfc740 10 client.7824 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:40:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f598cbfc740 20 client.7824 populate_metadata read hostname 'smithi114' 2023-11-04T01:40:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f598cbfc740 1 --2- 172.21.15.114:0/3422919966 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x5571fb913760 0x5571fb9248a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f598cbfc740 4 client.7824 mds_command: new command op to 6298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.731+0000 7f598cbfc740 1 -- 172.21.15.114:0/3422919966 --> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571fb857890 con 0x5571fb913760 2023-11-04T01:40:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.732+0000 7f59837fe640 1 --2- 172.21.15.114:0/3422919966 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x5571fb913760 0x5571fb9248a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.732+0000 7f59627fc640 10 client.7824 ms_handle_connect on v2:172.21.15.141:6832/1296600989 2023-11-04T01:40:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.732+0000 7f59837fe640 1 --2- 172.21.15.114:0/3422919966 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x5571fb913760 0x5571fb9248a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e81af1f7e19f99e8 server_cookie=5c7d0599b602d1fc in_seq=0 out_seq=0 2023-11-04T01:40:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.733+0000 7f59627fc640 1 -- 172.21.15.114:0/3422919966 <== mds.1 v2:172.21.15.141:6832/1296600989 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5571fb857890 con 0x5571fb913760 2023-11-04T01:40:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.733+0000 7f59627fc640 10 client.7824 handle_command_reply: tid=0 2023-11-04T01:40:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.733+0000 7f598cbfc740 1 client.7824 shutdown 2023-11-04T01:40:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.733+0000 7f598cbfc740 1 -- 172.21.15.114:0/3422919966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb950260 msgr2=0x5571fb8f14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.733+0000 7f598cbfc740 1 --2- 172.21.15.114:0/3422919966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb950260 0x5571fb8f14f0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f597c0575b0 tx=0x7f597c05ba00 comp rx=0 tx=0).stop 2023-11-04T01:40:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.733+0000 7f598cbfc740 1 -- 172.21.15.114:0/3422919966 shutdown_connections 2023-11-04T01:40:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.733+0000 7f598cbfc740 1 --2- 172.21.15.114:0/3422919966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb950260 0x5571fb8f14f0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.733+0000 7f598cbfc740 1 --2- 172.21.15.114:0/3422919966 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x5571fb913760 0x5571fb9248a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.733+0000 7f598cbfc740 1 --2- 172.21.15.114:0/3422919966 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb91fc30 0x5571fb9375b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.733+0000 7f598cbfc740 1 --2- 172.21.15.114:0/3422919966 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb91f850 0x5571fb9354e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.733+0000 7f598cbfc740 1 -- 172.21.15.114:0/3422919966 >> 172.21.15.114:0/3422919966 conn(0x5571fb8f2c90 msgr2=0x5571fb941380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.733+0000 7f59627fc640 0 client.7824 ms_handle_reset on v2:172.21.15.141:6832/1296600989 2023-11-04T01:40:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.733+0000 7f598cbfc740 1 -- 172.21.15.114:0/3422919966 shutdown_connections 2023-11-04T01:40:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.733+0000 7f598cbfc740 1 -- 172.21.15.114:0/3422919966 wait complete. 2023-11-04T01:40:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.733+0000 7f598cbfc740 20 client.7824 trim_cache size 0 max 16384 2023-11-04T01:40:38.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.748+0000 7f598cbfc740 1 Processor -- start 2023-11-04T01:40:38.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.748+0000 7f598cbfc740 1 -- start start 2023-11-04T01:40:38.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.749+0000 7f598cbfc740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb91f850 0x5571fb8f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.749+0000 7f598cbfc740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb91fc30 0x5571fb937100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.749+0000 7f598cbfc740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb950260 0x5571fb94e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.749+0000 7f598cbfc740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fb7de280 con 0x5571fb91fc30 2023-11-04T01:40:38.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.749+0000 7f598cbfc740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fb9138a0 con 0x5571fb950260 2023-11-04T01:40:38.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.749+0000 7f598cbfc740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571fb91e420 con 0x5571fb91f850 2023-11-04T01:40:38.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.749+0000 7f5982ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb91fc30 0x5571fb937100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.749+0000 7f5982ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb91fc30 0x5571fb937100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40472/0 (socket says 172.21.15.114:40472) 2023-11-04T01:40:38.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.749+0000 7f5982ffd640 1 -- 172.21.15.114:0/956883581 learned_addr learned my addr 172.21.15.114:0/956883581 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:38.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f5982ffd640 1 -- 172.21.15.114:0/956883581 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb91f850 msgr2=0x5571fb8f14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f5983fff640 1 --2- 172.21.15.114:0/956883581 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb950260 0x5571fb94e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f59837fe640 1 --2- 172.21.15.114:0/956883581 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb91f850 0x5571fb8f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f5982ffd640 1 --2- 172.21.15.114:0/956883581 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb91f850 0x5571fb8f14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f5982ffd640 1 -- 172.21.15.114:0/956883581 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb950260 msgr2=0x5571fb94e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f5982ffd640 1 --2- 172.21.15.114:0/956883581 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb950260 0x5571fb94e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f5982ffd640 1 -- 172.21.15.114:0/956883581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571fb7fad10 con 0x5571fb91fc30 2023-11-04T01:40:38.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f5982ffd640 1 --2- 172.21.15.114:0/956883581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb91fc30 0x5571fb937100 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f5978007a60 tx=0x7f5978012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2602367e9e87265a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f5969ffb640 1 -- 172.21.15.114:0/956883581 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597800db40 con 0x5571fb91fc30 2023-11-04T01:40:38.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f5969ffb640 1 -- 172.21.15.114:0/956883581 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597800dcc0 con 0x5571fb91fc30 2023-11-04T01:40:38.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f5969ffb640 1 -- 172.21.15.114:0/956883581 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978007030 con 0x5571fb91fc30 2023-11-04T01:40:38.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f598cbfc740 1 -- 172.21.15.114:0/956883581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb91fc30 msgr2=0x5571fb937100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f598cbfc740 1 --2- 172.21.15.114:0/956883581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb91fc30 0x5571fb937100 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f5978007a60 tx=0x7f5978012000 comp rx=0 tx=0).stop 2023-11-04T01:40:38.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f598cbfc740 1 -- 172.21.15.114:0/956883581 shutdown_connections 2023-11-04T01:40:38.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f598cbfc740 1 --2- 172.21.15.114:0/956883581 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb950260 0x5571fb94e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f598cbfc740 1 --2- 172.21.15.114:0/956883581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb91fc30 0x5571fb937100 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f598cbfc740 1 --2- 172.21.15.114:0/956883581 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb91f850 0x5571fb8f14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.750+0000 7f598cbfc740 1 -- 172.21.15.114:0/956883581 >> 172.21.15.114:0/956883581 conn(0x5571fb8f2c90 msgr2=0x5571fb9225d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.751+0000 7f598cbfc740 1 -- 172.21.15.114:0/956883581 shutdown_connections 2023-11-04T01:40:38.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.751+0000 7f598cbfc740 1 -- 172.21.15.114:0/956883581 wait complete. 2023-11-04T01:40:38.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.751+0000 7f598cbfc740 1 -- start start 2023-11-04T01:40:38.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.751+0000 7f598cbfc740 1 Processor -- start 2023-11-04T01:40:38.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f598cbfc740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb91f850 0x5571fb95e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f598cbfc740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb91fc30 0x5571fb960340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f598cbfc740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb950260 0x5571fb960880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f598cbfc740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fb91ef00 con 0x5571fb950260 2023-11-04T01:40:38.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f598cbfc740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fb925770 con 0x5571fb91f850 2023-11-04T01:40:38.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f598cbfc740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571fb95ee40 con 0x5571fb91fc30 2023-11-04T01:40:38.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f598cbfc740 10 client.0 _ll_register_callbacks cb 0x7f5978007e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:38.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f5983fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb950260 0x5571fb960880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f5983fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb950260 0x5571fb960880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40488/0 (socket says 172.21.15.114:40488) 2023-11-04T01:40:38.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f5983fff640 1 -- 172.21.15.114:0/457378866 learned_addr learned my addr 172.21.15.114:0/457378866 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:38.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f5982ffd640 1 --2- 172.21.15.114:0/457378866 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb91fc30 0x5571fb960340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f59837fe640 1 --2- 172.21.15.114:0/457378866 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb91f850 0x5571fb95e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f5983fff640 1 -- 172.21.15.114:0/457378866 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb91fc30 msgr2=0x5571fb960340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f5983fff640 1 --2- 172.21.15.114:0/457378866 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb91fc30 0x5571fb960340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f5983fff640 1 -- 172.21.15.114:0/457378866 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb91f850 msgr2=0x5571fb95e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f5983fff640 1 --2- 172.21.15.114:0/457378866 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb91f850 0x5571fb95e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f5983fff640 1 -- 172.21.15.114:0/457378866 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5571fb821ca0 con 0x5571fb950260 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f5983fff640 1 --2- 172.21.15.114:0/457378866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb950260 0x5571fb960880 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f597c076440 tx=0x7f597c001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98022c5d8d5712fe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f59627fc640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f59627fc640 1 -- 172.21.15.114:0/457378866 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c0573f0 con 0x5571fb950260 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f59627fc640 1 -- 172.21.15.114:0/457378866 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f597c056da0 con 0x5571fb950260 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.752+0000 7f598cbfc740 1 -- 172.21.15.114:0/457378866 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f59780053f0 con 0x5571fb950260 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.753+0000 7f59627fc640 1 -- 172.21.15.114:0/457378866 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f597c057fb0 con 0x5571fb950260 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.753+0000 7f598cbfc740 10 client.7830 fetch_fsmap learned FSMap version 55 2023-11-04T01:40:38.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.753+0000 7f598cbfc740 1 -- 172.21.15.114:0/457378866 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x5571fb820500 con 0x5571fb950260 2023-11-04T01:40:38.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.753+0000 7f59627fc640 1 -- 172.21.15.114:0/457378866 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59780053f0 con 0x5571fb950260 2023-11-04T01:40:38.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.753+0000 7f59627fc640 1 -- 172.21.15.114:0/457378866 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 55) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f597c0536a0 con 0x5571fb950260 2023-11-04T01:40:38.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.753+0000 7f598cbfc740 10 client.7830 fetch_fsmap finished waiting for FSMap version 55 2023-11-04T01:40:38.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.753+0000 7f598cbfc740 10 client.7830 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:40:38.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.753+0000 7f598cbfc740 20 client.7830 populate_metadata read hostname 'smithi114' 2023-11-04T01:40:38.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.753+0000 7f598cbfc740 1 --2- 172.21.15.114:0/457378866 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x5571fb8f7b80 0x5571fb8f7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.753+0000 7f598cbfc740 4 client.7830 mds_command: new command op to 6298 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:38.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.753+0000 7f598cbfc740 1 -- 172.21.15.114:0/457378866 --> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5571fb8575b0 con 0x5571fb8f7b80 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.753+0000 7f59837fe640 1 --2- 172.21.15.114:0/457378866 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x5571fb8f7b80 0x5571fb8f7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.753+0000 7f59627fc640 10 client.7830 ms_handle_connect on v2:172.21.15.141:6832/1296600989 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.753+0000 7f59837fe640 1 --2- 172.21.15.114:0/457378866 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x5571fb8f7b80 0x5571fb8f7f60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9505374fbed25187 server_cookie=ae250d0ecc673328 in_seq=0 out_seq=0 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f59627fc640 1 -- 172.21.15.114:0/457378866 <== mds.1 v2:172.21.15.141:6832/1296600989 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5571fb8575b0 con 0x5571fb8f7b80 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f59627fc640 10 client.7830 handle_command_reply: tid=0 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f598cbfc740 1 client.7830 shutdown 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f598cbfc740 1 -- 172.21.15.114:0/457378866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb950260 msgr2=0x5571fb960880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f598cbfc740 1 --2- 172.21.15.114:0/457378866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb950260 0x5571fb960880 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f597c076440 tx=0x7f597c001400 comp rx=0 tx=0).stop 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f598cbfc740 1 -- 172.21.15.114:0/457378866 shutdown_connections 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f598cbfc740 1 --2- 172.21.15.114:0/457378866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5571fb950260 0x5571fb960880 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f598cbfc740 1 --2- 172.21.15.114:0/457378866 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5571fb91fc30 0x5571fb960340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f598cbfc740 1 --2- 172.21.15.114:0/457378866 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x5571fb8f7b80 0x5571fb8f7f60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f598cbfc740 1 --2- 172.21.15.114:0/457378866 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5571fb91f850 0x5571fb95e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f598cbfc740 1 -- 172.21.15.114:0/457378866 >> 172.21.15.114:0/457378866 conn(0x5571fb8f2c90 msgr2=0x5571fb8edc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f59627fc640 0 client.7830 ms_handle_reset on v2:172.21.15.141:6832/1296600989 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f598cbfc740 1 -- 172.21.15.114:0/457378866 shutdown_connections 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f598cbfc740 1 -- 172.21.15.114:0/457378866 wait complete. 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f598cbfc740 20 client.7830 trim_cache size 0 max 16384 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 1, 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 6298, 2023-11-04T01:40:38.764 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:40:38.764 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:40:38.764 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:40:38.764 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 38.180212079999997, 2023-11-04T01:40:38.764 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 55, 2023-11-04T01:40:38.764 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 99, 2023-11-04T01:40:38.764 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 99, 2023-11-04T01:40:38.764 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 52.752573405 2023-11-04T01:40:38.764 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:40:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f5989f89640 1 -- 172.21.15.114:0/811005058 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f597006ae70 msgr2=0x7f597006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f5989f89640 1 --2- 172.21.15.114:0/811005058 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f597006ae70 0x7f597006d330 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5974036000 tx=0x7f5974030000 comp rx=0 tx=0).stop 2023-11-04T01:40:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f5989f89640 1 -- 172.21.15.114:0/811005058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f598415d1b0 msgr2=0x7f59840b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f5989f89640 1 --2- 172.21.15.114:0/811005058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f598415d1b0 0x7f59840b02c0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f597c00c780 tx=0x7f597c00cc40 comp rx=0 tx=0).stop 2023-11-04T01:40:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f5989f89640 1 -- 172.21.15.114:0/811005058 shutdown_connections 2023-11-04T01:40:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f5989f89640 1 --2- 172.21.15.114:0/811005058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f598415d1b0 0x7f59840b02c0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f5989f89640 1 --2- 172.21.15.114:0/811005058 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f597006ae70 0x7f597006d330 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f5989f89640 1 --2- 172.21.15.114:0/811005058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5984070ff0 0x7f59840afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f5989f89640 1 --2- 172.21.15.114:0/811005058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5984066000 0x7f59840c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.754+0000 7f5989f89640 1 -- 172.21.15.114:0/811005058 >> 172.21.15.114:0/811005058 conn(0x7f59840cbc90 msgr2=0x7f5984160830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.755+0000 7f5989f89640 1 -- 172.21.15.114:0/811005058 shutdown_connections 2023-11-04T01:40:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.755+0000 7f5989f89640 1 -- 172.21.15.114:0/811005058 wait complete. 2023-11-04T01:40:38.767 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:38.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.865+0000 7f36719dc640 1 Processor -- start 2023-11-04T01:40:38.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.865+0000 7f36719dc640 1 -- start start 2023-11-04T01:40:38.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.865+0000 7f36719dc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f366c0cde60 0x7f366c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.865+0000 7f36719dc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366c15e000 con 0x7f366c0ce240 2023-11-04T01:40:38.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.865+0000 7f36719dc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366c15e2e0 con 0x7f366c15daa0 2023-11-04T01:40:38.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.865+0000 7f36719dc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c15e5c0 con 0x7f366c0cde60 2023-11-04T01:40:38.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.866+0000 7f366affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f366c0cde60 0x7f366c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.866+0000 7f366affd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f366c0cde60 0x7f366c15d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40500/0 (socket says 172.21.15.114:40500) 2023-11-04T01:40:38.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.866+0000 7f366b7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f366c0ce240 0x7f366c0d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38464/0 (socket says 172.21.15.114:38464) 2023-11-04T01:40:38.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.866+0000 7f366affd640 1 -- 172.21.15.114:0/2214631824 learned_addr learned my addr 172.21.15.114:0/2214631824 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:38.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.866+0000 7f366affd640 1 -- 172.21.15.114:0/2214631824 >> v1:172.21.15.141:6789/0 conn(0x7f366c15daa0 legacy=0x7f366c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.866+0000 7f366affd640 1 -- 172.21.15.114:0/2214631824 >> v1:172.21.15.114:6789/0 conn(0x7f366c0ce240 legacy=0x7f366c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.866+0000 7f366affd640 1 -- 172.21.15.114:0/2214631824 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c0d1120 con 0x7f366c0cde60 2023-11-04T01:40:38.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.866+0000 7f3669ffb640 1 -- 172.21.15.114:0/2214631824 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634883270 0 0) 0x7f366c15e000 con 0x7f366c0ce240 2023-11-04T01:40:38.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.867+0000 7f366affd640 1 --2- 172.21.15.114:0/2214631824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f366c0cde60 0x7f366c15d560 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f3664009870 tx=0x7f366402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf94ce232682e488 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.867+0000 7f3669ffb640 1 -- 172.21.15.114:0/2214631824 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366402f840 con 0x7f366c0cde60 2023-11-04T01:40:38.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.867+0000 7f3669ffb640 1 -- 172.21.15.114:0/2214631824 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366402f9a0 con 0x7f366c0cde60 2023-11-04T01:40:38.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.867+0000 7f3669ffb640 1 -- 172.21.15.114:0/2214631824 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366402fd30 con 0x7f366c0cde60 2023-11-04T01:40:38.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.867+0000 7f36719dc640 1 -- 172.21.15.114:0/2214631824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f366c0cde60 msgr2=0x7f366c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.867+0000 7f36719dc640 1 --2- 172.21.15.114:0/2214631824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f366c0cde60 0x7f366c15d560 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f3664009870 tx=0x7f366402ba20 comp rx=0 tx=0).stop 2023-11-04T01:40:38.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.867+0000 7f36719dc640 1 -- 172.21.15.114:0/2214631824 shutdown_connections 2023-11-04T01:40:38.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.867+0000 7f36719dc640 1 --2- 172.21.15.114:0/2214631824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f366c0cde60 0x7f366c15d560 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.867+0000 7f36719dc640 1 -- 172.21.15.114:0/2214631824 >> 172.21.15.114:0/2214631824 conn(0x7f366c071f30 msgr2=0x7f366c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.867+0000 7f36719dc640 1 -- 172.21.15.114:0/2214631824 shutdown_connections 2023-11-04T01:40:38.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.867+0000 7f36719dc640 1 -- 172.21.15.114:0/2214631824 wait complete. 2023-11-04T01:40:38.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.868+0000 7f36719dc640 1 Processor -- start 2023-11-04T01:40:38.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.869+0000 7f36719dc640 1 -- start start 2023-11-04T01:40:38.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.869+0000 7f36719dc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f366c0cde60 0x7f366c1f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.869+0000 7f36719dc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f366c0ce240 0x7f366c148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.869+0000 7f36719dc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f366c15daa0 0x7f366c0c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.869+0000 7f36719dc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c149c90 con 0x7f366c0ce240 2023-11-04T01:40:38.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.869+0000 7f36719dc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c1f23b0 con 0x7f366c15daa0 2023-11-04T01:40:38.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.869+0000 7f36719dc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c149110 con 0x7f366c0cde60 2023-11-04T01:40:38.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.869+0000 7f366a7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f366c0ce240 0x7f366c148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.869+0000 7f366a7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f366c0ce240 0x7f366c148830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40506/0 (socket says 172.21.15.114:40506) 2023-11-04T01:40:38.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.869+0000 7f366a7fc640 1 -- 172.21.15.114:0/1347882862 learned_addr learned my addr 172.21.15.114:0/1347882862 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:38.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.870+0000 7f366b7fe640 1 --2- 172.21.15.114:0/1347882862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f366c15daa0 0x7f366c0c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.870+0000 7f366affd640 1 --2- 172.21.15.114:0/1347882862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f366c0cde60 0x7f366c1f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.870+0000 7f366a7fc640 1 -- 172.21.15.114:0/1347882862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f366c0cde60 msgr2=0x7f366c1f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.870+0000 7f366a7fc640 1 --2- 172.21.15.114:0/1347882862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f366c0cde60 0x7f366c1f1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.870+0000 7f366a7fc640 1 -- 172.21.15.114:0/1347882862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f366c15daa0 msgr2=0x7f366c0c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.870+0000 7f366a7fc640 1 --2- 172.21.15.114:0/1347882862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f366c15daa0 0x7f366c0c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.870+0000 7f366a7fc640 1 -- 172.21.15.114:0/1347882862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36640094d0 con 0x7f366c0ce240 2023-11-04T01:40:38.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.870+0000 7f366b7fe640 1 --2- 172.21.15.114:0/1347882862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f366c15daa0 0x7f366c0c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:38.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.870+0000 7f366affd640 1 --2- 172.21.15.114:0/1347882862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f366c0cde60 0x7f366c1f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:38.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.870+0000 7f366a7fc640 1 --2- 172.21.15.114:0/1347882862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f366c0ce240 0x7f366c148830 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f366000c700 tx=0x7f366000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.870+0000 7f3653fff640 1 -- 172.21.15.114:0/1347882862 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660003b70 con 0x7f366c0ce240 2023-11-04T01:40:38.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.870+0000 7f3653fff640 1 -- 172.21.15.114:0/1347882862 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3660003cd0 con 0x7f366c0ce240 2023-11-04T01:40:38.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.870+0000 7f36719dc640 1 -- 172.21.15.114:0/1347882862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c1493f0 con 0x7f366c0ce240 2023-11-04T01:40:38.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.870+0000 7f3653fff640 1 -- 172.21.15.114:0/1347882862 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366000aa90 con 0x7f366c0ce240 2023-11-04T01:40:38.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.870+0000 7f36719dc640 1 -- 172.21.15.114:0/1347882862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c1499b0 con 0x7f366c0ce240 2023-11-04T01:40:38.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.871+0000 7f36719dc640 1 -- 172.21.15.114:0/1347882862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c14b3a0 con 0x7f366c0ce240 2023-11-04T01:40:38.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.871+0000 7f3653fff640 1 -- 172.21.15.114:0/1347882862 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f366000abf0 con 0x7f366c0ce240 2023-11-04T01:40:38.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.872+0000 7f3653fff640 1 --2- 172.21.15.114:0/1347882862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f365806ae70 0x7f365806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.872+0000 7f3653fff640 1 -- 172.21.15.114:0/1347882862 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f3660089990 con 0x7f366c0ce240 2023-11-04T01:40:38.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.872+0000 7f366affd640 1 --2- 172.21.15.114:0/1347882862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f365806ae70 0x7f365806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.872+0000 7f366affd640 1 --2- 172.21.15.114:0/1347882862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f365806ae70 0x7f365806d330 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3664036000 tx=0x7f3664039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:38.876+0000 7f3653fff640 1 -- 172.21.15.114:0/1347882862 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f366c14b3a0 con 0x7f366c0ce240 2023-11-04T01:40:39.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.076+0000 7f36719dc640 1 -- 172.21.15.114:0/1347882862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f366c14b3a0 con 0x7f366c0ce240 2023-11-04T01:40:39.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.077+0000 7f3653fff640 1 -- 172.21.15.114:0/1347882862 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f366c14b3a0 con 0x7f366c0ce240 2023-11-04T01:40:39.079 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:39.079 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7773,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:35.074875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6292,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6292":{"gid":6292,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:39.079 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 55 2023-11-04T01:40:39.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.079+0000 7f36719dc640 1 -- 172.21.15.114:0/1347882862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f365806ae70 msgr2=0x7f365806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.079+0000 7f36719dc640 1 --2- 172.21.15.114:0/1347882862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f365806ae70 0x7f365806d330 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3664036000 tx=0x7f3664039040 comp rx=0 tx=0).stop 2023-11-04T01:40:39.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.079+0000 7f36719dc640 1 -- 172.21.15.114:0/1347882862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f366c0ce240 msgr2=0x7f366c148830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.079+0000 7f36719dc640 1 --2- 172.21.15.114:0/1347882862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f366c0ce240 0x7f366c148830 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f366000c700 tx=0x7f366000cbc0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.079+0000 7f36719dc640 1 -- 172.21.15.114:0/1347882862 shutdown_connections 2023-11-04T01:40:39.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.079+0000 7f36719dc640 1 --2- 172.21.15.114:0/1347882862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f365806ae70 0x7f365806d330 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.079+0000 7f36719dc640 1 --2- 172.21.15.114:0/1347882862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f366c15daa0 0x7f366c0c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.079+0000 7f36719dc640 1 --2- 172.21.15.114:0/1347882862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f366c0ce240 0x7f366c148830 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.079+0000 7f36719dc640 1 --2- 172.21.15.114:0/1347882862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f366c0cde60 0x7f366c1f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.079+0000 7f36719dc640 1 -- 172.21.15.114:0/1347882862 >> 172.21.15.114:0/1347882862 conn(0x7f366c071f30 msgr2=0x7f366c0cd130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:39.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.079+0000 7f36719dc640 1 -- 172.21.15.114:0/1347882862 shutdown_connections 2023-11-04T01:40:39.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.079+0000 7f36719dc640 1 -- 172.21.15.114:0/1347882862 wait complete. 2023-11-04T01:40:39.092 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:40:39.205 INFO:teuthology.orchestra.run.smithi114.stdout:{"last_snap":2,"last_created":2,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:40:15.002825+0000","name":"s11","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:40:39.205 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 2, "last_destroyed": 1, "last_snap": 2, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:40:15.002825+0000" } ] } 2023-11-04T01:40:39.205 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:40:39.205 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=2 2023-11-04T01:40:39.205 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.304+0000 7f0af9a1a640 1 Processor -- start 2023-11-04T01:40:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.304+0000 7f0af9a1a640 1 -- start start 2023-11-04T01:40:39.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.304+0000 7f0af9a1a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0af40cde60 0x7f0af415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.305+0000 7f0af9a1a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0af415daa0 0x7f0af4157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.305+0000 7f0af9a1a640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af415e000 con 0x7f0af40ce240 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.305+0000 7f0af9a1a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af415e5c0 con 0x7f0af40cde60 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.305+0000 7f0af9a1a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af415e2e0 con 0x7f0af415daa0 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.305+0000 7f0af2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0af40cde60 0x7f0af415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.305+0000 7f0af2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0af40cde60 0x7f0af415d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40518/0 (socket says 172.21.15.114:40518) 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.305+0000 7f0af2ffd640 1 -- 172.21.15.114:0/2495129178 learned_addr learned my addr 172.21.15.114:0/2495129178 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.305+0000 7f0aebfff640 1 --2- 172.21.15.114:0/2495129178 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0af415daa0 0x7f0af4157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.305+0000 7f0af2ffd640 1 -- 172.21.15.114:0/2495129178 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0af415daa0 msgr2=0x7f0af4157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.305+0000 7f0af2ffd640 1 --2- 172.21.15.114:0/2495129178 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0af415daa0 0x7f0af4157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.305+0000 7f0af2ffd640 1 -- 172.21.15.114:0/2495129178 >> v1:172.21.15.141:6789/0 conn(0x7f0af40ce240 legacy=0x7f0af406b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.305+0000 7f0af2ffd640 1 -- 172.21.15.114:0/2495129178 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af40d1120 con 0x7f0af40cde60 2023-11-04T01:40:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.306+0000 7f0af2ffd640 1 --2- 172.21.15.114:0/2495129178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af40cde60 0x7f0af415d560 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4009870 tx=0x7f0ae402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4580470d3b717ea5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.306+0000 7f0af27fc640 1 -- 172.21.15.114:0/2495129178 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4031640 con 0x7f0af40cde60 2023-11-04T01:40:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.306+0000 7f0af27fc640 1 -- 172.21.15.114:0/2495129178 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae40317a0 con 0x7f0af40cde60 2023-11-04T01:40:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.306+0000 7f0af27fc640 1 -- 172.21.15.114:0/2495129178 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4031b30 con 0x7f0af40cde60 2023-11-04T01:40:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.306+0000 7f0af9a1a640 1 -- 172.21.15.114:0/2495129178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af40cde60 msgr2=0x7f0af415d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.306+0000 7f0af9a1a640 1 --2- 172.21.15.114:0/2495129178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af40cde60 0x7f0af415d560 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4009870 tx=0x7f0ae402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.306+0000 7f0af9a1a640 1 -- 172.21.15.114:0/2495129178 shutdown_connections 2023-11-04T01:40:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.306+0000 7f0af9a1a640 1 --2- 172.21.15.114:0/2495129178 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0af415daa0 0x7f0af4157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.306+0000 7f0af9a1a640 1 --2- 172.21.15.114:0/2495129178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af40cde60 0x7f0af415d560 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.306+0000 7f0af9a1a640 1 -- 172.21.15.114:0/2495129178 >> 172.21.15.114:0/2495129178 conn(0x7f0af4071f30 msgr2=0x7f0af40cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.306+0000 7f0af9a1a640 1 -- 172.21.15.114:0/2495129178 shutdown_connections 2023-11-04T01:40:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.307+0000 7f0af9a1a640 1 -- 172.21.15.114:0/2495129178 wait complete. 2023-11-04T01:40:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.308+0000 7f0af9a1a640 1 Processor -- start 2023-11-04T01:40:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.308+0000 7f0af9a1a640 1 -- start start 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.308+0000 7f0af9a1a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af40cde60 0x7f0af41524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.308+0000 7f0af9a1a640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0af40ce240 0x7f0af40cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.308+0000 7f0af9a1a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0af415daa0 0x7f0af4158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.308+0000 7f0af9a1a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af41f31f0 con 0x7f0af40cde60 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.308+0000 7f0af9a1a640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af41529f0 con 0x7f0af40ce240 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.308+0000 7f0af9a1a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af41f28c0 con 0x7f0af415daa0 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.308+0000 7f0af2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af40cde60 0x7f0af41524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.308+0000 7f0af2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af40cde60 0x7f0af41524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40526/0 (socket says 172.21.15.114:40526) 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.308+0000 7f0af2ffd640 1 -- 172.21.15.114:0/3089149052 learned_addr learned my addr 172.21.15.114:0/3089149052 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.309+0000 7f0aebfff640 1 --2- 172.21.15.114:0/3089149052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0af40ce240 0x7f0af40cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.309+0000 7f0af2ffd640 1 -- 172.21.15.114:0/3089149052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0af415daa0 msgr2=0x7f0af4158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.309+0000 7f0af37fe640 1 --2- 172.21.15.114:0/3089149052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0af415daa0 0x7f0af4158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.309+0000 7f0af2ffd640 1 --2- 172.21.15.114:0/3089149052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0af415daa0 0x7f0af4158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.309+0000 7f0af2ffd640 1 -- 172.21.15.114:0/3089149052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0af40ce240 msgr2=0x7f0af40cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.309+0000 7f0af2ffd640 1 --2- 172.21.15.114:0/3089149052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0af40ce240 0x7f0af40cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.309+0000 7f0af2ffd640 1 -- 172.21.15.114:0/3089149052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae40094d0 con 0x7f0af40cde60 2023-11-04T01:40:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.309+0000 7f0aebfff640 1 --2- 172.21.15.114:0/3089149052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0af40ce240 0x7f0af40cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.309+0000 7f0af37fe640 1 --2- 172.21.15.114:0/3089149052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0af415daa0 0x7f0af4158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.309+0000 7f0af2ffd640 1 --2- 172.21.15.114:0/3089149052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af40cde60 0x7f0af41524b0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4000c00 tx=0x7f0ae40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.309+0000 7f0af0ff9640 1 -- 172.21.15.114:0/3089149052 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae403ac60 con 0x7f0af40cde60 2023-11-04T01:40:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.309+0000 7f0af0ff9640 1 -- 172.21.15.114:0/3089149052 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae403ade0 con 0x7f0af40cde60 2023-11-04T01:40:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.309+0000 7f0af9a1a640 1 -- 172.21.15.114:0/3089149052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af41f2ba0 con 0x7f0af40cde60 2023-11-04T01:40:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.309+0000 7f0af0ff9640 1 -- 172.21.15.114:0/3089149052 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4044630 con 0x7f0af40cde60 2023-11-04T01:40:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.309+0000 7f0af9a1a640 1 -- 172.21.15.114:0/3089149052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af41f2520 con 0x7f0af40cde60 2023-11-04T01:40:39.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.310+0000 7f0af9a1a640 1 -- 172.21.15.114:0/3089149052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af4074290 con 0x7f0af40cde60 2023-11-04T01:40:39.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.310+0000 7f0af0ff9640 1 -- 172.21.15.114:0/3089149052 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ae402f050 con 0x7f0af40cde60 2023-11-04T01:40:39.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.311+0000 7f0af0ff9640 1 --2- 172.21.15.114:0/3089149052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ad406aea0 0x7f0ad406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.311+0000 7f0aebfff640 1 --2- 172.21.15.114:0/3089149052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ad406aea0 0x7f0ad406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.311+0000 7f0af0ff9640 1 -- 172.21.15.114:0/3089149052 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f0ae40abca0 con 0x7f0af40cde60 2023-11-04T01:40:39.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.311+0000 7f0aebfff640 1 --2- 172.21.15.114:0/3089149052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ad406aea0 0x7f0ad406d360 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0af415d190 tx=0x7f0adc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.315+0000 7f0af0ff9640 1 -- 172.21.15.114:0/3089149052 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0ae40767d0 con 0x7f0af40cde60 2023-11-04T01:40:39.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.515+0000 7f0af9a1a640 1 -- 172.21.15.114:0/3089149052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0af4152b30 con 0x7f0af40cde60 2023-11-04T01:40:39.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.516+0000 7f0af0ff9640 1 -- 172.21.15.114:0/3089149052 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f0af4152b30 con 0x7f0af40cde60 2023-11-04T01:40:39.518 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:39.518 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7773,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:35.074875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6292,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6292":{"gid":6292,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:39.518 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 55 2023-11-04T01:40:39.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.518+0000 7f0af9a1a640 1 -- 172.21.15.114:0/3089149052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ad406aea0 msgr2=0x7f0ad406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.518+0000 7f0af9a1a640 1 --2- 172.21.15.114:0/3089149052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ad406aea0 0x7f0ad406d360 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0af415d190 tx=0x7f0adc008040 comp rx=0 tx=0).stop 2023-11-04T01:40:39.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.518+0000 7f0af9a1a640 1 -- 172.21.15.114:0/3089149052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af40cde60 msgr2=0x7f0af41524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.518+0000 7f0af9a1a640 1 --2- 172.21.15.114:0/3089149052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af40cde60 0x7f0af41524b0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4000c00 tx=0x7f0ae40046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.518+0000 7f0af9a1a640 1 -- 172.21.15.114:0/3089149052 shutdown_connections 2023-11-04T01:40:39.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.518+0000 7f0af9a1a640 1 --2- 172.21.15.114:0/3089149052 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0af415daa0 0x7f0af4158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.518+0000 7f0af9a1a640 1 --2- 172.21.15.114:0/3089149052 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0ad406aea0 0x7f0ad406d360 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.518+0000 7f0af9a1a640 1 --2- 172.21.15.114:0/3089149052 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0af40ce240 0x7f0af40cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.518+0000 7f0af9a1a640 1 --2- 172.21.15.114:0/3089149052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0af40cde60 0x7f0af41524b0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.518+0000 7f0af9a1a640 1 -- 172.21.15.114:0/3089149052 >> 172.21.15.114:0/3089149052 conn(0x7f0af4071f30 msgr2=0x7f0af40c6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:39.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.518+0000 7f0af9a1a640 1 -- 172.21.15.114:0/3089149052 shutdown_connections 2023-11-04T01:40:39.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.518+0000 7f0af9a1a640 1 -- 172.21.15.114:0/3089149052 wait complete. 2023-11-04T01:40:39.530 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:40:39.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.630+0000 7fad425d0640 1 Processor -- start 2023-11-04T01:40:39.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.630+0000 7fad425d0640 1 -- start start 2023-11-04T01:40:39.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.630+0000 7fad425d0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fad3c159c00 0x7fad3c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.630+0000 7fad425d0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fad3c0ae1d0 0x7fad3c0c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.630+0000 7fad425d0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad3c15aff0 con 0x7fad3c0c48e0 2023-11-04T01:40:39.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.630+0000 7fad425d0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3c0c52a0 con 0x7fad3c0ae1d0 2023-11-04T01:40:39.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.630+0000 7fad425d0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c15a3e0 con 0x7fad3c159c00 2023-11-04T01:40:39.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.631+0000 7fad40b6d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fad3c0ae1d0 0x7fad3c0c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.631+0000 7fad3b7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fad3c0c48e0 0x7fad3c0adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38480/0 (socket says 172.21.15.114:38480) 2023-11-04T01:40:39.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.631+0000 7fad3b7fe640 1 -- 172.21.15.114:0/2312455498 learned_addr learned my addr 172.21.15.114:0/2312455498 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:39.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.631+0000 7fad3bfff640 1 --2- 172.21.15.114:0/2312455498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fad3c159c00 0x7fad3c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.631+0000 7fad40b6d640 1 -- 172.21.15.114:0/2312455498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fad3c159c00 msgr2=0x7fad3c0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:39.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.631+0000 7fad40b6d640 1 --2- 172.21.15.114:0/2312455498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fad3c159c00 0x7fad3c0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.631+0000 7fad40b6d640 1 -- 172.21.15.114:0/2312455498 >> v1:172.21.15.114:6789/0 conn(0x7fad3c0c48e0 legacy=0x7fad3c0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.631+0000 7fad3affd640 1 -- 172.21.15.114:0/2312455498 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221577956 0 0) 0x7fad3c15aff0 con 0x7fad3c0c48e0 2023-11-04T01:40:39.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.631+0000 7fad40b6d640 1 -- 172.21.15.114:0/2312455498 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c15a6c0 con 0x7fad3c0ae1d0 2023-11-04T01:40:39.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.631+0000 7fad3bfff640 1 --2- 172.21.15.114:0/2312455498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fad3c159c00 0x7fad3c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:39.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.632+0000 7fad40b6d640 1 --2- 172.21.15.114:0/2312455498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3c0ae1d0 0x7fad3c0c4d60 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fad34009d90 tx=0x7fad3402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e23dfd371e94463 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.632+0000 7fad3affd640 1 -- 172.21.15.114:0/2312455498 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3402cc50 con 0x7fad3c0ae1d0 2023-11-04T01:40:39.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.632+0000 7fad3affd640 1 -- 172.21.15.114:0/2312455498 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3402cdb0 con 0x7fad3c0ae1d0 2023-11-04T01:40:39.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.632+0000 7fad3affd640 1 -- 172.21.15.114:0/2312455498 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34034660 con 0x7fad3c0ae1d0 2023-11-04T01:40:39.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.632+0000 7fad425d0640 1 -- 172.21.15.114:0/2312455498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3c0ae1d0 msgr2=0x7fad3c0c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.632+0000 7fad425d0640 1 --2- 172.21.15.114:0/2312455498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3c0ae1d0 0x7fad3c0c4d60 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fad34009d90 tx=0x7fad3402bea0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.632+0000 7fad425d0640 1 -- 172.21.15.114:0/2312455498 shutdown_connections 2023-11-04T01:40:39.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.632+0000 7fad425d0640 1 --2- 172.21.15.114:0/2312455498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3c0ae1d0 0x7fad3c0c4d60 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.632+0000 7fad425d0640 1 --2- 172.21.15.114:0/2312455498 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fad3c159c00 0x7fad3c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.632+0000 7fad425d0640 1 -- 172.21.15.114:0/2312455498 >> 172.21.15.114:0/2312455498 conn(0x7fad3c0ce950 msgr2=0x7fad3c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:39.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.632+0000 7fad425d0640 1 -- 172.21.15.114:0/2312455498 shutdown_connections 2023-11-04T01:40:39.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.632+0000 7fad425d0640 1 -- 172.21.15.114:0/2312455498 wait complete. 2023-11-04T01:40:39.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.634+0000 7fad425d0640 1 Processor -- start 2023-11-04T01:40:39.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.634+0000 7fad425d0640 1 -- start start 2023-11-04T01:40:39.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.634+0000 7fad425d0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fad3c0ae1d0 0x7fad3c153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.634+0000 7fad425d0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3c0c48e0 0x7fad3c0af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.634+0000 7fad425d0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fad3c159c00 0x7fad3c154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.634+0000 7fad425d0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c0b14e0 con 0x7fad3c0c48e0 2023-11-04T01:40:39.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.634+0000 7fad425d0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c159110 con 0x7fad3c159c00 2023-11-04T01:40:39.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.634+0000 7fad425d0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c153970 con 0x7fad3c0ae1d0 2023-11-04T01:40:39.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.635+0000 7fad3b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3c0c48e0 0x7fad3c0af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.635+0000 7fad3b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3c0c48e0 0x7fad3c0af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40538/0 (socket says 172.21.15.114:40538) 2023-11-04T01:40:39.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.635+0000 7fad3b7fe640 1 -- 172.21.15.114:0/2923047481 learned_addr learned my addr 172.21.15.114:0/2923047481 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:39.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.635+0000 7fad40b6d640 1 --2- 172.21.15.114:0/2923047481 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fad3c159c00 0x7fad3c154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.635+0000 7fad3bfff640 1 --2- 172.21.15.114:0/2923047481 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fad3c0ae1d0 0x7fad3c153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.635+0000 7fad3b7fe640 1 -- 172.21.15.114:0/2923047481 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fad3c0ae1d0 msgr2=0x7fad3c153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.635+0000 7fad3b7fe640 1 --2- 172.21.15.114:0/2923047481 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fad3c0ae1d0 0x7fad3c153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.635+0000 7fad3b7fe640 1 -- 172.21.15.114:0/2923047481 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fad3c159c00 msgr2=0x7fad3c154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.635+0000 7fad3b7fe640 1 --2- 172.21.15.114:0/2923047481 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fad3c159c00 0x7fad3c154760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.635+0000 7fad3b7fe640 1 -- 172.21.15.114:0/2923047481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad34009a70 con 0x7fad3c0c48e0 2023-11-04T01:40:39.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.635+0000 7fad3b7fe640 1 --2- 172.21.15.114:0/2923047481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3c0c48e0 0x7fad3c0af990 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fad3000c4d0 tx=0x7fad3000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.635+0000 7fad38ff9640 1 -- 172.21.15.114:0/2923047481 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad300074e0 con 0x7fad3c0c48e0 2023-11-04T01:40:39.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.635+0000 7fad38ff9640 1 -- 172.21.15.114:0/2923047481 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad30007660 con 0x7fad3c0c48e0 2023-11-04T01:40:39.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.635+0000 7fad38ff9640 1 -- 172.21.15.114:0/2923047481 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30004a20 con 0x7fad3c0c48e0 2023-11-04T01:40:39.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.635+0000 7fad425d0640 1 -- 172.21.15.114:0/2923047481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3c158b50 con 0x7fad3c0c48e0 2023-11-04T01:40:39.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.635+0000 7fad425d0640 1 -- 172.21.15.114:0/2923047481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3c0b1710 con 0x7fad3c0c48e0 2023-11-04T01:40:39.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.636+0000 7fad425d0640 1 -- 172.21.15.114:0/2923047481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad3c074290 con 0x7fad3c0c48e0 2023-11-04T01:40:39.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.637+0000 7fad38ff9640 1 -- 172.21.15.114:0/2923047481 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad30004b80 con 0x7fad3c0c48e0 2023-11-04T01:40:39.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.637+0000 7fad38ff9640 1 --2- 172.21.15.114:0/2923047481 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fad2806ae70 0x7fad2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.637+0000 7fad38ff9640 1 -- 172.21.15.114:0/2923047481 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7fad30088e10 con 0x7fad3c0c48e0 2023-11-04T01:40:39.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.637+0000 7fad3bfff640 1 --2- 172.21.15.114:0/2923047481 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fad2806ae70 0x7fad2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.637+0000 7fad3bfff640 1 --2- 172.21.15.114:0/2923047481 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fad2806ae70 0x7fad2806d330 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fad2c00b840 tx=0x7fad2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.641+0000 7fad38ff9640 1 -- 172.21.15.114:0/2923047481 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad300538b0 con 0x7fad3c0c48e0 2023-11-04T01:40:39.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:39.872+0000 7fad425d0640 1 -- 172.21.15.114:0/2923047481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7fad3c0725c0 con 0x7fad3c0c48e0 2023-11-04T01:40:40.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.087+0000 7fad38ff9640 1 -- 172.21.15.114:0/2923047481 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.6292 v56) v1 ==== 112+0+0 (secure 0 0 0) 0x7fad30018020 con 0x7fad3c0c48e0 2023-11-04T01:40:40.089 INFO:teuthology.orchestra.run.smithi114.stderr:freezing mds.6292 2023-11-04T01:40:40.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.089+0000 7fad425d0640 1 -- 172.21.15.114:0/2923047481 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fad2806ae70 msgr2=0x7fad2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.089+0000 7fad425d0640 1 --2- 172.21.15.114:0/2923047481 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fad2806ae70 0x7fad2806d330 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fad2c00b840 tx=0x7fad2c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:40.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.089+0000 7fad425d0640 1 -- 172.21.15.114:0/2923047481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3c0c48e0 msgr2=0x7fad3c0af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.089+0000 7fad425d0640 1 --2- 172.21.15.114:0/2923047481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3c0c48e0 0x7fad3c0af990 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fad3000c4d0 tx=0x7fad3000c990 comp rx=0 tx=0).stop 2023-11-04T01:40:40.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.089+0000 7fad425d0640 1 -- 172.21.15.114:0/2923047481 shutdown_connections 2023-11-04T01:40:40.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.089+0000 7fad425d0640 1 --2- 172.21.15.114:0/2923047481 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fad2806ae70 0x7fad2806d330 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.089+0000 7fad425d0640 1 --2- 172.21.15.114:0/2923047481 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fad3c159c00 0x7fad3c154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.089+0000 7fad425d0640 1 --2- 172.21.15.114:0/2923047481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3c0c48e0 0x7fad3c0af990 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.089+0000 7fad425d0640 1 --2- 172.21.15.114:0/2923047481 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fad3c0ae1d0 0x7fad3c153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.089+0000 7fad425d0640 1 -- 172.21.15.114:0/2923047481 >> 172.21.15.114:0/2923047481 conn(0x7fad3c0ce950 msgr2=0x7fad3c0c37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:40.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.089+0000 7fad425d0640 1 -- 172.21.15.114:0/2923047481 shutdown_connections 2023-11-04T01:40:40.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.089+0000 7fad425d0640 1 -- 172.21.15.114:0/2923047481 wait complete. 2023-11-04T01:40:40.101 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_kill_mdstable_at 2 2023-11-04T01:40:40.214 INFO:teuthology.orchestra.run.smithi114.stdout:{"success":"mds_kill_mdstable_at = '2' (not observed, change may require restart) "} 2023-11-04T01:40:40.214 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '2' (not observed, change may require restart) " } 2023-11-04T01:40:40.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:40.215 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s12) 2023-11-04T01:40:40.217 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:40:40.234 INFO:tasks.ceph.mds.a.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f098adb3640 time 2023-11-04T01:40:40.234080+0000 2023-11-04T01:40:40.234 INFO:tasks.ceph.mds.a.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:40:40.236 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:40.236 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f099696efaf] 2023-11-04T01:40:40.236 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f099696f16d] 2023-11-04T01:40:40.236 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x560884de89ce] 2023-11-04T01:40:40.236 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: (MDSContext::complete(int)+0x5c) [0x560884e18bcc] 2023-11-04T01:40:40.236 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x560884e21b0c] 2023-11-04T01:40:40.236 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x560884e21c63] 2023-11-04T01:40:40.236 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f0996a164a5] 2023-11-04T01:40:40.236 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f099609f802] 2023-11-04T01:40:40.236 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f099603f450] 2023-11-04T01:40:40.236 INFO:tasks.ceph.mds.a.smithi114.stderr:2023-11-04T01:40:40.233+0000 7f098adb3640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f098adb3640 time 2023-11-04T01:40:40.234080+0000 2023-11-04T01:40:40.236 INFO:tasks.ceph.mds.a.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:40:40.237 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:40:40.237 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:40.237 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f099696efaf] 2023-11-04T01:40:40.237 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f099696f16d] 2023-11-04T01:40:40.237 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x560884de89ce] 2023-11-04T01:40:40.237 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: (MDSContext::complete(int)+0x5c) [0x560884e18bcc] 2023-11-04T01:40:40.237 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x560884e21b0c] 2023-11-04T01:40:40.237 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x560884e21c63] 2023-11-04T01:40:40.237 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f0996a164a5] 2023-11-04T01:40:40.237 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f099609f802] 2023-11-04T01:40:40.237 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f099603f450] 2023-11-04T01:40:40.237 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:40:40.237 INFO:tasks.ceph.mds.a.smithi114.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:40:40.238 INFO:tasks.ceph.mds.a.smithi114.stderr: in thread 7f098adb3640 thread_name:MR_Finisher 2023-11-04T01:40:40.238 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:40.238 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0996054db0] 2023-11-04T01:40:40.238 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f09960a154c] 2023-11-04T01:40:40.238 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: raise() 2023-11-04T01:40:40.238 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: abort() 2023-11-04T01:40:40.238 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f099696f009] 2023-11-04T01:40:40.238 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f099696f16d] 2023-11-04T01:40:40.238 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x560884de89ce] 2023-11-04T01:40:40.238 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (MDSContext::complete(int)+0x5c) [0x560884e18bcc] 2023-11-04T01:40:40.238 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x560884e21b0c] 2023-11-04T01:40:40.238 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x560884e21c63] 2023-11-04T01:40:40.239 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f0996a164a5] 2023-11-04T01:40:40.242 INFO:tasks.ceph.mds.a.smithi114.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f099609f802] 2023-11-04T01:40:40.242 INFO:tasks.ceph.mds.a.smithi114.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f099603f450] 2023-11-04T01:40:40.242 INFO:tasks.ceph.mds.a.smithi114.stderr:2023-11-04T01:40:40.234+0000 7f098adb3640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:40.242 INFO:tasks.ceph.mds.a.smithi114.stderr: in thread 7f098adb3640 thread_name:MR_Finisher 2023-11-04T01:40:40.242 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:40:40.242 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:40.242 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0996054db0] 2023-11-04T01:40:40.242 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f09960a154c] 2023-11-04T01:40:40.242 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: raise() 2023-11-04T01:40:40.242 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: abort() 2023-11-04T01:40:40.243 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f099696f009] 2023-11-04T01:40:40.243 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f099696f16d] 2023-11-04T01:40:40.243 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x560884de89ce] 2023-11-04T01:40:40.243 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (MDSContext::complete(int)+0x5c) [0x560884e18bcc] 2023-11-04T01:40:40.243 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x560884e21b0c] 2023-11-04T01:40:40.243 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x560884e21c63] 2023-11-04T01:40:40.243 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f0996a164a5] 2023-11-04T01:40:40.243 INFO:tasks.ceph.mds.a.smithi114.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f099609f802] 2023-11-04T01:40:40.243 INFO:tasks.ceph.mds.a.smithi114.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f099603f450] 2023-11-04T01:40:40.243 INFO:tasks.ceph.mds.a.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:40.244 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:40:40.245 INFO:tasks.ceph.mds.a.smithi114.stderr: -337> 2023-11-04T01:40:37.019+0000 7f098e5ba640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:40.245 INFO:tasks.ceph.mds.a.smithi114.stderr: -335> 2023-11-04T01:40:37.019+0000 7f098e5ba640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:40.245 INFO:tasks.ceph.mds.a.smithi114.stderr: -1> 2023-11-04T01:40:40.233+0000 7f098adb3640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f098adb3640 time 2023-11-04T01:40:40.234080+0000 2023-11-04T01:40:40.245 INFO:tasks.ceph.mds.a.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:40:40.245 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:40:40.246 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:40.246 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f099696efaf] 2023-11-04T01:40:40.246 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f099696f16d] 2023-11-04T01:40:40.246 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x560884de89ce] 2023-11-04T01:40:40.246 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: (MDSContext::complete(int)+0x5c) [0x560884e18bcc] 2023-11-04T01:40:40.246 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x560884e21b0c] 2023-11-04T01:40:40.246 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x560884e21c63] 2023-11-04T01:40:40.246 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f0996a164a5] 2023-11-04T01:40:40.246 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f099609f802] 2023-11-04T01:40:40.246 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f099603f450] 2023-11-04T01:40:40.246 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:40:40.246 INFO:tasks.ceph.mds.a.smithi114.stderr: 0> 2023-11-04T01:40:40.234+0000 7f098adb3640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:40.246 INFO:tasks.ceph.mds.a.smithi114.stderr: in thread 7f098adb3640 thread_name:MR_Finisher 2023-11-04T01:40:40.247 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:40:40.247 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:40.247 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0996054db0] 2023-11-04T01:40:40.247 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f09960a154c] 2023-11-04T01:40:40.247 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: raise() 2023-11-04T01:40:40.247 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: abort() 2023-11-04T01:40:40.247 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f099696f009] 2023-11-04T01:40:40.247 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f099696f16d] 2023-11-04T01:40:40.247 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x560884de89ce] 2023-11-04T01:40:40.247 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (MDSContext::complete(int)+0x5c) [0x560884e18bcc] 2023-11-04T01:40:40.247 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x560884e21b0c] 2023-11-04T01:40:40.247 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x560884e21c63] 2023-11-04T01:40:40.247 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f0996a164a5] 2023-11-04T01:40:40.248 INFO:tasks.ceph.mds.a.smithi114.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f099609f802] 2023-11-04T01:40:40.248 INFO:tasks.ceph.mds.a.smithi114.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f099603f450] 2023-11-04T01:40:40.248 INFO:tasks.ceph.mds.a.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:40.248 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:40:40.248 INFO:tasks.ceph.mds.a.smithi114.stderr: -337> 2023-11-04T01:40:37.019+0000 7f098e5ba640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:40.248 INFO:tasks.ceph.mds.a.smithi114.stderr: -335> 2023-11-04T01:40:37.019+0000 7f098e5ba640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:40:40.248 INFO:tasks.ceph.mds.a.smithi114.stderr: -1> 2023-11-04T01:40:40.233+0000 7f098adb3640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f098adb3640 time 2023-11-04T01:40:40.234080+0000 2023-11-04T01:40:40.248 INFO:tasks.ceph.mds.a.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:40:40.248 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:40:40.248 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:40.248 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f099696efaf] 2023-11-04T01:40:40.248 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f099696f16d] 2023-11-04T01:40:40.248 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x560884de89ce] 2023-11-04T01:40:40.249 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: (MDSContext::complete(int)+0x5c) [0x560884e18bcc] 2023-11-04T01:40:40.249 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x560884e21b0c] 2023-11-04T01:40:40.249 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x560884e21c63] 2023-11-04T01:40:40.249 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f0996a164a5] 2023-11-04T01:40:40.249 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f099609f802] 2023-11-04T01:40:40.249 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f099603f450] 2023-11-04T01:40:40.249 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:40:40.249 INFO:tasks.ceph.mds.a.smithi114.stderr: 0> 2023-11-04T01:40:40.234+0000 7f098adb3640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:40:40.249 INFO:tasks.ceph.mds.a.smithi114.stderr: in thread 7f098adb3640 thread_name:MR_Finisher 2023-11-04T01:40:40.249 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:40:40.249 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:40:40.249 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0996054db0] 2023-11-04T01:40:40.249 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f09960a154c] 2023-11-04T01:40:40.250 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: raise() 2023-11-04T01:40:40.250 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: abort() 2023-11-04T01:40:40.250 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f099696f009] 2023-11-04T01:40:40.250 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f099696f16d] 2023-11-04T01:40:40.250 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x560884de89ce] 2023-11-04T01:40:40.250 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (MDSContext::complete(int)+0x5c) [0x560884e18bcc] 2023-11-04T01:40:40.250 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x560884e21b0c] 2023-11-04T01:40:40.250 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x560884e21c63] 2023-11-04T01:40:40.250 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f0996a164a5] 2023-11-04T01:40:40.250 INFO:tasks.ceph.mds.a.smithi114.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f099609f802] 2023-11-04T01:40:40.250 INFO:tasks.ceph.mds.a.smithi114.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f099603f450] 2023-11-04T01:40:40.250 INFO:tasks.ceph.mds.a.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:40:40.251 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:40:40.340 INFO:teuthology.orchestra.run.smithi114.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:40:40.340 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:40:40.340 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:40.446 INFO:tasks.ceph.mds.a.smithi114.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:40:40.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.479+0000 7fbe4a316640 1 Processor -- start 2023-11-04T01:40:40.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.479+0000 7fbe4a316640 1 -- start start 2023-11-04T01:40:40.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.480+0000 7fbe4a316640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbe4415ce60 0x7fbe4406b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.480+0000 7fbe4a316640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe441615d0 con 0x7fbe440cf160 2023-11-04T01:40:40.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.480+0000 7fbe4a316640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe441618b0 con 0x7fbe4406bd30 2023-11-04T01:40:40.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.480+0000 7fbe4a316640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe440cbde0 con 0x7fbe4415ce60 2023-11-04T01:40:40.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.480+0000 7fbe43fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbe4415ce60 0x7fbe4406b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.480+0000 7fbe488b3640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbe440cf160 0x7fbe440cc200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38486/0 (socket says 172.21.15.114:38486) 2023-11-04T01:40:40.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.480+0000 7fbe488b3640 1 -- 172.21.15.114:0/3899704124 learned_addr learned my addr 172.21.15.114:0/3899704124 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:40.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.480+0000 7fbe43fff640 1 -- 172.21.15.114:0/3899704124 >> v1:172.21.15.141:6789/0 conn(0x7fbe4406bd30 legacy=0x7fbe44160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:40.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.480+0000 7fbe43fff640 1 -- 172.21.15.114:0/3899704124 >> v1:172.21.15.114:6789/0 conn(0x7fbe440cf160 legacy=0x7fbe440cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.480+0000 7fbe43fff640 1 -- 172.21.15.114:0/3899704124 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe440cba00 con 0x7fbe4415ce60 2023-11-04T01:40:40.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.481+0000 7fbe43fff640 1 --2- 172.21.15.114:0/3899704124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe4415ce60 0x7fbe4406b7f0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fbe340097a0 tx=0x7fbe3402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45bbeb5251be49d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.481+0000 7fbe42ffd640 1 -- 172.21.15.114:0/3899704124 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34031830 con 0x7fbe4415ce60 2023-11-04T01:40:40.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.481+0000 7fbe42ffd640 1 -- 172.21.15.114:0/3899704124 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe34031990 con 0x7fbe4415ce60 2023-11-04T01:40:40.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.481+0000 7fbe42ffd640 1 -- 172.21.15.114:0/3899704124 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34031d20 con 0x7fbe4415ce60 2023-11-04T01:40:40.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.481+0000 7fbe4a316640 1 -- 172.21.15.114:0/3899704124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe4415ce60 msgr2=0x7fbe4406b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.481+0000 7fbe4a316640 1 --2- 172.21.15.114:0/3899704124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe4415ce60 0x7fbe4406b7f0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fbe340097a0 tx=0x7fbe3402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.482+0000 7fbe4a316640 1 -- 172.21.15.114:0/3899704124 shutdown_connections 2023-11-04T01:40:40.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.482+0000 7fbe4a316640 1 --2- 172.21.15.114:0/3899704124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe4415ce60 0x7fbe4406b7f0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.482+0000 7fbe4a316640 1 -- 172.21.15.114:0/3899704124 >> 172.21.15.114:0/3899704124 conn(0x7fbe4406ea90 msgr2=0x7fbe4406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:40.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.482+0000 7fbe4a316640 1 -- 172.21.15.114:0/3899704124 shutdown_connections 2023-11-04T01:40:40.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.482+0000 7fbe4a316640 1 -- 172.21.15.114:0/3899704124 wait complete. 2023-11-04T01:40:40.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.483+0000 7fbe4a316640 1 Processor -- start 2023-11-04T01:40:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.483+0000 7fbe4a316640 1 -- start start 2023-11-04T01:40:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe4a316640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe440cf160 0x7fbe4414f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe4a316640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe4415ce60 0x7fbe440b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe4a316640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe440c5f00 0x7fbe440b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe4a316640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe440c91e0 con 0x7fbe440c5f00 2023-11-04T01:40:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe4a316640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4415dfa0 con 0x7fbe4415ce60 2023-11-04T01:40:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe4a316640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4415d240 con 0x7fbe440cf160 2023-11-04T01:40:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe488b3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe440c5f00 0x7fbe440b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe488b3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe440c5f00 0x7fbe440b5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40556/0 (socket says 172.21.15.114:40556) 2023-11-04T01:40:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe488b3640 1 -- 172.21.15.114:0/3750021806 learned_addr learned my addr 172.21.15.114:0/3750021806 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe437fe640 1 --2- 172.21.15.114:0/3750021806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe4415ce60 0x7fbe440b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe43fff640 1 --2- 172.21.15.114:0/3750021806 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe440cf160 0x7fbe4414f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe488b3640 1 -- 172.21.15.114:0/3750021806 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe440cf160 msgr2=0x7fbe4414f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe488b3640 1 --2- 172.21.15.114:0/3750021806 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe440cf160 0x7fbe4414f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe488b3640 1 -- 172.21.15.114:0/3750021806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe4415ce60 msgr2=0x7fbe440b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe488b3640 1 --2- 172.21.15.114:0/3750021806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe4415ce60 0x7fbe440b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe488b3640 1 -- 172.21.15.114:0/3750021806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe34009400 con 0x7fbe440c5f00 2023-11-04T01:40:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe437fe640 1 --2- 172.21.15.114:0/3750021806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe4415ce60 0x7fbe440b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe488b3640 1 --2- 172.21.15.114:0/3750021806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe440c5f00 0x7fbe440b5ed0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00cbc0 tx=0x7fbe3c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe40ff9640 1 -- 172.21.15.114:0/3750021806 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00ad40 con 0x7fbe440c5f00 2023-11-04T01:40:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe40ff9640 1 -- 172.21.15.114:0/3750021806 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c012400 con 0x7fbe440c5f00 2023-11-04T01:40:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe4a316640 1 -- 172.21.15.114:0/3750021806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe4415d520 con 0x7fbe440c5f00 2023-11-04T01:40:40.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe40ff9640 1 -- 172.21.15.114:0/3750021806 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00aea0 con 0x7fbe440c5f00 2023-11-04T01:40:40.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.484+0000 7fbe4a316640 1 -- 172.21.15.114:0/3750021806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4414f910 con 0x7fbe440c5f00 2023-11-04T01:40:40.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.486+0000 7fbe4a316640 1 -- 172.21.15.114:0/3750021806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe44074290 con 0x7fbe440c5f00 2023-11-04T01:40:40.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.486+0000 7fbe40ff9640 1 -- 172.21.15.114:0/3750021806 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe3c007070 con 0x7fbe440c5f00 2023-11-04T01:40:40.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.486+0000 7fbe40ff9640 1 --2- 172.21.15.114:0/3750021806 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbe3006aea0 0x7fbe3006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.486+0000 7fbe40ff9640 1 -- 172.21.15.114:0/3750021806 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7fbe3c089a90 con 0x7fbe440c5f00 2023-11-04T01:40:40.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.486+0000 7fbe43fff640 1 --2- 172.21.15.114:0/3750021806 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbe3006aea0 0x7fbe3006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.487+0000 7fbe43fff640 1 --2- 172.21.15.114:0/3750021806 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbe3006aea0 0x7fbe3006d360 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbe34036000 tx=0x7fbe34008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.490+0000 7fbe40ff9640 1 -- 172.21.15.114:0/3750021806 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe3c0545e0 con 0x7fbe440c5f00 2023-11-04T01:40:40.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.693+0000 7fbe4a316640 1 -- 172.21.15.114:0/3750021806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe440b3480 con 0x7fbe440c5f00 2023-11-04T01:40:40.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.693+0000 7fbe40ff9640 1 -- 172.21.15.114:0/3750021806 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fbe3c017090 con 0x7fbe440c5f00 2023-11-04T01:40:40.695 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:40.696 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7773,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:39.873713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6292,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6292":{"gid":6292,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:40.696 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 56 2023-11-04T01:40:40.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.695+0000 7fbe4a316640 1 -- 172.21.15.114:0/3750021806 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbe3006aea0 msgr2=0x7fbe3006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.695+0000 7fbe4a316640 1 --2- 172.21.15.114:0/3750021806 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbe3006aea0 0x7fbe3006d360 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbe34036000 tx=0x7fbe34008030 comp rx=0 tx=0).stop 2023-11-04T01:40:40.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.695+0000 7fbe4a316640 1 -- 172.21.15.114:0/3750021806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe440c5f00 msgr2=0x7fbe440b5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.695+0000 7fbe4a316640 1 --2- 172.21.15.114:0/3750021806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe440c5f00 0x7fbe440b5ed0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00cbc0 tx=0x7fbe3c00a430 comp rx=0 tx=0).stop 2023-11-04T01:40:40.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.695+0000 7fbe4a316640 1 -- 172.21.15.114:0/3750021806 shutdown_connections 2023-11-04T01:40:40.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.695+0000 7fbe4a316640 1 --2- 172.21.15.114:0/3750021806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe440c5f00 0x7fbe440b5ed0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.695+0000 7fbe4a316640 1 --2- 172.21.15.114:0/3750021806 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbe3006aea0 0x7fbe3006d360 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.695+0000 7fbe4a316640 1 --2- 172.21.15.114:0/3750021806 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbe4415ce60 0x7fbe440b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.695+0000 7fbe4a316640 1 --2- 172.21.15.114:0/3750021806 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbe440cf160 0x7fbe4414f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.695+0000 7fbe4a316640 1 -- 172.21.15.114:0/3750021806 >> 172.21.15.114:0/3750021806 conn(0x7fbe4406ea90 msgr2=0x7fbe440c4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:40.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.695+0000 7fbe4a316640 1 -- 172.21.15.114:0/3750021806 shutdown_connections 2023-11-04T01:40:40.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:40.695+0000 7fbe4a316640 1 -- 172.21.15.114:0/3750021806 wait complete. 2023-11-04T01:40:40.708 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:45.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:40:45.709 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:45.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.818+0000 7f48ac525640 1 Processor -- start 2023-11-04T01:40:45.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.818+0000 7f48ac525640 1 -- start start 2023-11-04T01:40:45.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.819+0000 7f48ac525640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48a40b0ae0 0x7f48a40ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.819+0000 7f48ac525640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a40b4110 con 0x7f48a4159c70 2023-11-04T01:40:45.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.819+0000 7f48ac525640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a40b43f0 con 0x7f48a406db20 2023-11-04T01:40:45.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.819+0000 7f48ac525640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a40b49b0 con 0x7f48a40b0ae0 2023-11-04T01:40:45.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.819+0000 7f48aa2c1640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f48a4159c70 0x7f48a40b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38496/0 (socket says 172.21.15.114:38496) 2023-11-04T01:40:45.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.819+0000 7f48aa2c1640 1 -- 172.21.15.114:0/1076048369 learned_addr learned my addr 172.21.15.114:0/1076048369 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:45.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.819+0000 7f48a9ac0640 1 --2- 172.21.15.114:0/1076048369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48a40b0ae0 0x7f48a40ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.819+0000 7f48a92bf640 1 -- 172.21.15.114:0/1076048369 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1351728174 0 0) 0x7f48a40b4110 con 0x7f48a4159c70 2023-11-04T01:40:45.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.819+0000 7f48a92bf640 1 -- 172.21.15.114:0/1076048369 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4890003520 con 0x7f48a4159c70 2023-11-04T01:40:45.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.820+0000 7f48a92bf640 1 -- 172.21.15.114:0/1076048369 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254938447 0 0) 0x7f48a40b43f0 con 0x7f48a406db20 2023-11-04T01:40:45.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.820+0000 7f48a92bf640 1 -- 172.21.15.114:0/1076048369 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a40b4110 con 0x7f48a406db20 2023-11-04T01:40:45.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.820+0000 7f48a9ac0640 1 -- 172.21.15.114:0/1076048369 >> v1:172.21.15.141:6789/0 conn(0x7f48a406db20 legacy=0x7f48a415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.820+0000 7f48a9ac0640 1 -- 172.21.15.114:0/1076048369 >> v1:172.21.15.114:6789/0 conn(0x7f48a4159c70 legacy=0x7f48a40b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.820+0000 7f48a9ac0640 1 -- 172.21.15.114:0/1076048369 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a40b46d0 con 0x7f48a40b0ae0 2023-11-04T01:40:45.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.820+0000 7f48a9ac0640 1 --2- 172.21.15.114:0/1076048369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48a40b0ae0 0x7f48a40ce370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f48940097d0 tx=0x7f489402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c6821951f4aab83 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.821+0000 7f48a92bf640 1 -- 172.21.15.114:0/1076048369 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894031890 con 0x7f48a40b0ae0 2023-11-04T01:40:45.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.821+0000 7f48a92bf640 1 -- 172.21.15.114:0/1076048369 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48940319f0 con 0x7f48a40b0ae0 2023-11-04T01:40:45.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.821+0000 7f48a92bf640 1 -- 172.21.15.114:0/1076048369 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894031d60 con 0x7f48a40b0ae0 2023-11-04T01:40:45.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.821+0000 7f48ac525640 1 -- 172.21.15.114:0/1076048369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48a40b0ae0 msgr2=0x7f48a40ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.821+0000 7f48ac525640 1 --2- 172.21.15.114:0/1076048369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48a40b0ae0 0x7f48a40ce370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f48940097d0 tx=0x7f489402b930 comp rx=0 tx=0).stop 2023-11-04T01:40:45.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.821+0000 7f48ac525640 1 -- 172.21.15.114:0/1076048369 shutdown_connections 2023-11-04T01:40:45.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.821+0000 7f48ac525640 1 --2- 172.21.15.114:0/1076048369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48a40b0ae0 0x7f48a40ce370 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.821+0000 7f48ac525640 1 -- 172.21.15.114:0/1076048369 >> 172.21.15.114:0/1076048369 conn(0x7f48a40ce950 msgr2=0x7f48a40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:45.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.821+0000 7f48ac525640 1 -- 172.21.15.114:0/1076048369 shutdown_connections 2023-11-04T01:40:45.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.821+0000 7f48ac525640 1 -- 172.21.15.114:0/1076048369 wait complete. 2023-11-04T01:40:45.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.823+0000 7f48ac525640 1 Processor -- start 2023-11-04T01:40:45.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.823+0000 7f48ac525640 1 -- start start 2023-11-04T01:40:45.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.823+0000 7f48ac525640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48a406db20 0x7f48a4146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.823+0000 7f48ac525640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48a40b0ae0 0x7f48a41edb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.823+0000 7f48ac525640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48a4159c70 0x7f48a40c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.823+0000 7f48ac525640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4145430 con 0x7f48a40b0ae0 2023-11-04T01:40:45.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.823+0000 7f48ac525640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4147410 con 0x7f48a4159c70 2023-11-04T01:40:45.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.823+0000 7f48ac525640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4144820 con 0x7f48a406db20 2023-11-04T01:40:45.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.823+0000 7f48a9ac0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48a40b0ae0 0x7f48a41edb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.823+0000 7f48a9ac0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48a40b0ae0 0x7f48a41edb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40568/0 (socket says 172.21.15.114:40568) 2023-11-04T01:40:45.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.823+0000 7f48a9ac0640 1 -- 172.21.15.114:0/47358611 learned_addr learned my addr 172.21.15.114:0/47358611 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:45.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.824+0000 7f48aa2c1640 1 --2- 172.21.15.114:0/47358611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48a406db20 0x7f48a4146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.824+0000 7f48aaac2640 1 --2- 172.21.15.114:0/47358611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48a4159c70 0x7f48a40c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.824+0000 7f48a9ac0640 1 -- 172.21.15.114:0/47358611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48a406db20 msgr2=0x7f48a4146ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.824+0000 7f48a9ac0640 1 --2- 172.21.15.114:0/47358611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48a406db20 0x7f48a4146ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.824+0000 7f48a9ac0640 1 -- 172.21.15.114:0/47358611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48a4159c70 msgr2=0x7f48a40c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.824+0000 7f48a9ac0640 1 --2- 172.21.15.114:0/47358611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48a4159c70 0x7f48a40c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.824+0000 7f48a9ac0640 1 -- 172.21.15.114:0/47358611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4894009400 con 0x7f48a40b0ae0 2023-11-04T01:40:45.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.824+0000 7f48aaac2640 1 --2- 172.21.15.114:0/47358611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48a4159c70 0x7f48a40c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:45.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.824+0000 7f48a9ac0640 1 --2- 172.21.15.114:0/47358611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48a40b0ae0 0x7f48a41edb10 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f4894000c00 tx=0x7f48940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.824+0000 7f489affd640 1 -- 172.21.15.114:0/47358611 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489403bbf0 con 0x7f48a40b0ae0 2023-11-04T01:40:45.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.824+0000 7f489affd640 1 -- 172.21.15.114:0/47358611 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489403bd50 con 0x7f48a40b0ae0 2023-11-04T01:40:45.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.824+0000 7f48ac525640 1 -- 172.21.15.114:0/47358611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a4144b00 con 0x7f48a40b0ae0 2023-11-04T01:40:45.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.824+0000 7f489affd640 1 -- 172.21.15.114:0/47358611 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894045630 con 0x7f48a40b0ae0 2023-11-04T01:40:45.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.824+0000 7f48ac525640 1 -- 172.21.15.114:0/47358611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a41450c0 con 0x7f48a40b0ae0 2023-11-04T01:40:45.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.825+0000 7f48ac525640 1 -- 172.21.15.114:0/47358611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a41455e0 con 0x7f48a40b0ae0 2023-11-04T01:40:45.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.825+0000 7f489affd640 1 -- 172.21.15.114:0/47358611 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f489404e450 con 0x7f48a40b0ae0 2023-11-04T01:40:45.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.826+0000 7f489affd640 1 --2- 172.21.15.114:0/47358611 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f488806ae70 0x7f488806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.826+0000 7f489affd640 1 -- 172.21.15.114:0/47358611 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f48940ac050 con 0x7f48a40b0ae0 2023-11-04T01:40:45.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.826+0000 7f48aa2c1640 1 --2- 172.21.15.114:0/47358611 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f488806ae70 0x7f488806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.826+0000 7f48aa2c1640 1 --2- 172.21.15.114:0/47358611 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f488806ae70 0x7f488806d330 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f48a0000f60 tx=0x7f48a0007d70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:45.831+0000 7f489affd640 1 -- 172.21.15.114:0/47358611 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f48a41455e0 con 0x7f48a40b0ae0 2023-11-04T01:40:46.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:46.034+0000 7f48ac525640 1 -- 172.21.15.114:0/47358611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48a4074290 con 0x7f48a40b0ae0 2023-11-04T01:40:46.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:46.035+0000 7f489affd640 1 -- 172.21.15.114:0/47358611 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f4894076b80 con 0x7f48a40b0ae0 2023-11-04T01:40:46.038 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:46.038 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7773,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:39.873713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6292,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6292":{"gid":6292,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:46.038 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 56 2023-11-04T01:40:46.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:46.037+0000 7f48ac525640 1 -- 172.21.15.114:0/47358611 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f488806ae70 msgr2=0x7f488806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:46.037+0000 7f48ac525640 1 --2- 172.21.15.114:0/47358611 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f488806ae70 0x7f488806d330 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f48a0000f60 tx=0x7f48a0007d70 comp rx=0 tx=0).stop 2023-11-04T01:40:46.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:46.037+0000 7f48ac525640 1 -- 172.21.15.114:0/47358611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48a40b0ae0 msgr2=0x7f48a41edb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:46.037+0000 7f48ac525640 1 --2- 172.21.15.114:0/47358611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48a40b0ae0 0x7f48a41edb10 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f4894000c00 tx=0x7f48940046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:46.037+0000 7f48ac525640 1 -- 172.21.15.114:0/47358611 shutdown_connections 2023-11-04T01:40:46.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:46.037+0000 7f48ac525640 1 --2- 172.21.15.114:0/47358611 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f488806ae70 0x7f488806d330 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:46.037+0000 7f48ac525640 1 --2- 172.21.15.114:0/47358611 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f48a4159c70 0x7f48a40c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:46.037+0000 7f48ac525640 1 --2- 172.21.15.114:0/47358611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48a40b0ae0 0x7f48a41edb10 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:46.037+0000 7f48ac525640 1 --2- 172.21.15.114:0/47358611 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f48a406db20 0x7f48a4146ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:46.037+0000 7f48ac525640 1 -- 172.21.15.114:0/47358611 >> 172.21.15.114:0/47358611 conn(0x7f48a40ce950 msgr2=0x7f48a40b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:46.037+0000 7f48ac525640 1 -- 172.21.15.114:0/47358611 shutdown_connections 2023-11-04T01:40:46.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:46.037+0000 7f48ac525640 1 -- 172.21.15.114:0/47358611 wait complete. 2023-11-04T01:40:46.050 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:50.452 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:50.455 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:51.052 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:51.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.161+0000 7f7fddc10640 1 Processor -- start 2023-11-04T01:40:51.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.162+0000 7f7fddc10640 1 -- start start 2023-11-04T01:40:51.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.162+0000 7f7fddc10640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fd815ae40 0x7f7fd815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.162+0000 7f7fddc10640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd80cc450 con 0x7f7fd80cda30 2023-11-04T01:40:51.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.162+0000 7f7fddc10640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd815f400 con 0x7f7fd80cbc00 2023-11-04T01:40:51.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.162+0000 7f7fddc10640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd815b220 con 0x7f7fd815ae40 2023-11-04T01:40:51.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.162+0000 7f7fd7fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7fd80cda30 0x7f7fd80ced70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34300/0 (socket says 172.21.15.114:34300) 2023-11-04T01:40:51.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.163+0000 7f7fd7fff640 1 -- 172.21.15.114:0/1471625048 learned_addr learned my addr 172.21.15.114:0/1471625048 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:51.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.163+0000 7f7fd77fe640 1 --2- 172.21.15.114:0/1471625048 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fd815ae40 0x7f7fd815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.163+0000 7f7fd67fc640 1 -- 172.21.15.114:0/1471625048 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283523088 0 0) 0x7f7fd0001490 con 0x7f7fd80cda30 2023-11-04T01:40:51.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.163+0000 7f7fd67fc640 1 -- 172.21.15.114:0/1471625048 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fc0003520 con 0x7f7fd80cda30 2023-11-04T01:40:51.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.163+0000 7f7fd67fc640 1 -- 172.21.15.114:0/1471625048 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694983959 0 0) 0x7f7fd815f400 con 0x7f7fd80cbc00 2023-11-04T01:40:51.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.163+0000 7f7fd67fc640 1 -- 172.21.15.114:0/1471625048 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fd0001490 con 0x7f7fd80cbc00 2023-11-04T01:40:51.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.163+0000 7f7fd67fc640 1 -- 172.21.15.114:0/1471625048 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2170162595 0 0) 0x7f7fc0003520 con 0x7f7fd80cda30 2023-11-04T01:40:51.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.163+0000 7f7fd77fe640 1 -- 172.21.15.114:0/1471625048 >> v1:172.21.15.141:6789/0 conn(0x7f7fd80cbc00 legacy=0x7f7fd80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.163+0000 7f7fd77fe640 1 -- 172.21.15.114:0/1471625048 >> v1:172.21.15.114:6789/0 conn(0x7f7fd80cda30 legacy=0x7f7fd80ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.163+0000 7f7fd77fe640 1 -- 172.21.15.114:0/1471625048 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd815f890 con 0x7f7fd815ae40 2023-11-04T01:40:51.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.164+0000 7f7fd77fe640 1 --2- 172.21.15.114:0/1471625048 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fd815ae40 0x7f7fd815bfb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80097d0 tx=0x7f7fc802b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=384663f4c98000d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.164+0000 7f7fd67fc640 1 -- 172.21.15.114:0/1471625048 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0001b80 con 0x7f7fd815ae40 2023-11-04T01:40:51.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.164+0000 7f7fd67fc640 1 -- 172.21.15.114:0/1471625048 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc802e050 con 0x7f7fd815ae40 2023-11-04T01:40:51.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.164+0000 7f7fd67fc640 1 -- 172.21.15.114:0/1471625048 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8030710 con 0x7f7fd815ae40 2023-11-04T01:40:51.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.165+0000 7f7fddc10640 1 -- 172.21.15.114:0/1471625048 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fd815ae40 msgr2=0x7f7fd815bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.165+0000 7f7fddc10640 1 --2- 172.21.15.114:0/1471625048 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fd815ae40 0x7f7fd815bfb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80097d0 tx=0x7f7fc802b800 comp rx=0 tx=0).stop 2023-11-04T01:40:51.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.165+0000 7f7fddc10640 1 -- 172.21.15.114:0/1471625048 shutdown_connections 2023-11-04T01:40:51.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.165+0000 7f7fddc10640 1 --2- 172.21.15.114:0/1471625048 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fd815ae40 0x7f7fd815bfb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.165+0000 7f7fddc10640 1 -- 172.21.15.114:0/1471625048 >> 172.21.15.114:0/1471625048 conn(0x7f7fd806ea90 msgr2=0x7f7fd806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.165+0000 7f7fddc10640 1 -- 172.21.15.114:0/1471625048 shutdown_connections 2023-11-04T01:40:51.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.165+0000 7f7fddc10640 1 -- 172.21.15.114:0/1471625048 wait complete. 2023-11-04T01:40:51.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.166+0000 7f7fddc10640 1 Processor -- start 2023-11-04T01:40:51.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.166+0000 7f7fddc10640 1 -- start start 2023-11-04T01:40:51.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fddc10640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fd80cbc00 0x7f7fd80c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fddc10640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fd80cda30 0x7f7fd815dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fddc10640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fd815ae40 0x7f7fd815e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fddc10640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd81451e0 con 0x7f7fd80cda30 2023-11-04T01:40:51.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fddc10640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd81457a0 con 0x7f7fd815ae40 2023-11-04T01:40:51.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fddc10640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd80c70c0 con 0x7f7fd80cbc00 2023-11-04T01:40:51.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fd6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fd80cda30 0x7f7fd815dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fd6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fd80cda30 0x7f7fd815dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38372/0 (socket says 172.21.15.114:38372) 2023-11-04T01:40:51.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fd6ffd640 1 -- 172.21.15.114:0/1570259834 learned_addr learned my addr 172.21.15.114:0/1570259834 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:51.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fd77fe640 1 --2- 172.21.15.114:0/1570259834 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fd80cbc00 0x7f7fd80c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fd6ffd640 1 -- 172.21.15.114:0/1570259834 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fd80cbc00 msgr2=0x7f7fd80c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fd6ffd640 1 --2- 172.21.15.114:0/1570259834 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fd80cbc00 0x7f7fd80c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fd7fff640 1 --2- 172.21.15.114:0/1570259834 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fd815ae40 0x7f7fd815e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fd6ffd640 1 -- 172.21.15.114:0/1570259834 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fd815ae40 msgr2=0x7f7fd815e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fd6ffd640 1 --2- 172.21.15.114:0/1570259834 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fd815ae40 0x7f7fd815e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fd6ffd640 1 -- 172.21.15.114:0/1570259834 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc8009400 con 0x7f7fd80cda30 2023-11-04T01:40:51.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fd77fe640 1 --2- 172.21.15.114:0/1570259834 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fd80cbc00 0x7f7fd80c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:51.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.167+0000 7f7fd7fff640 1 --2- 172.21.15.114:0/1570259834 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fd815ae40 0x7f7fd815e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:51.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.168+0000 7f7fd6ffd640 1 --2- 172.21.15.114:0/1570259834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fd80cda30 0x7f7fd815dd60 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00c500 tx=0x7f7fcc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.168+0000 7f7fbffff640 1 -- 172.21.15.114:0/1570259834 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0052d0 con 0x7f7fd80cda30 2023-11-04T01:40:51.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.168+0000 7f7fbffff640 1 -- 172.21.15.114:0/1570259834 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc005450 con 0x7f7fd80cda30 2023-11-04T01:40:51.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.168+0000 7f7fddc10640 1 -- 172.21.15.114:0/1570259834 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd80c73a0 con 0x7f7fd80cda30 2023-11-04T01:40:51.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.168+0000 7f7fbffff640 1 -- 172.21.15.114:0/1570259834 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc012870 con 0x7f7fd80cda30 2023-11-04T01:40:51.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.168+0000 7f7fddc10640 1 -- 172.21.15.114:0/1570259834 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd80c6300 con 0x7f7fd80cda30 2023-11-04T01:40:51.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.169+0000 7f7fddc10640 1 -- 172.21.15.114:0/1570259834 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd80ce2d0 con 0x7f7fd80cda30 2023-11-04T01:40:51.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.169+0000 7f7fbffff640 1 -- 172.21.15.114:0/1570259834 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7fcc0129d0 con 0x7f7fd80cda30 2023-11-04T01:40:51.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.169+0000 7f7fbffff640 1 --2- 172.21.15.114:0/1570259834 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7fc406aea0 0x7f7fc406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.170+0000 7f7fbffff640 1 -- 172.21.15.114:0/1570259834 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f7fcc089800 con 0x7f7fd80cda30 2023-11-04T01:40:51.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.170+0000 7f7fd77fe640 1 --2- 172.21.15.114:0/1570259834 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7fc406aea0 0x7f7fc406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.170+0000 7f7fd77fe640 1 --2- 172.21.15.114:0/1570259834 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7fc406aea0 0x7f7fc406d360 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8034000 tx=0x7f7fc8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.174+0000 7f7fbffff640 1 -- 172.21.15.114:0/1570259834 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7fcc0542b0 con 0x7f7fd80cda30 2023-11-04T01:40:51.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.375+0000 7f7fddc10640 1 -- 172.21.15.114:0/1570259834 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fd80cc060 con 0x7f7fd80cda30 2023-11-04T01:40:51.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.376+0000 7f7fbffff640 1 -- 172.21.15.114:0/1570259834 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f7fcc0578d0 con 0x7f7fd80cda30 2023-11-04T01:40:51.378 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:51.378 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7773,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:39.873713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6292,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6292":{"gid":6292,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:51.378 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 56 2023-11-04T01:40:51.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.378+0000 7f7fddc10640 1 -- 172.21.15.114:0/1570259834 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7fc406aea0 msgr2=0x7f7fc406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.378+0000 7f7fddc10640 1 --2- 172.21.15.114:0/1570259834 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7fc406aea0 0x7f7fc406d360 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8034000 tx=0x7f7fc8008030 comp rx=0 tx=0).stop 2023-11-04T01:40:51.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.378+0000 7f7fddc10640 1 -- 172.21.15.114:0/1570259834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fd80cda30 msgr2=0x7f7fd815dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.378+0000 7f7fddc10640 1 --2- 172.21.15.114:0/1570259834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fd80cda30 0x7f7fd815dd60 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00c500 tx=0x7f7fcc00c9c0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.378+0000 7f7fddc10640 1 -- 172.21.15.114:0/1570259834 shutdown_connections 2023-11-04T01:40:51.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.378+0000 7f7fddc10640 1 --2- 172.21.15.114:0/1570259834 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7fc406aea0 0x7f7fc406d360 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.378+0000 7f7fddc10640 1 --2- 172.21.15.114:0/1570259834 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fd815ae40 0x7f7fd815e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.378+0000 7f7fddc10640 1 --2- 172.21.15.114:0/1570259834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fd80cda30 0x7f7fd815dd60 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.378+0000 7f7fddc10640 1 --2- 172.21.15.114:0/1570259834 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fd80cbc00 0x7f7fd80c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.378+0000 7f7fddc10640 1 -- 172.21.15.114:0/1570259834 >> 172.21.15.114:0/1570259834 conn(0x7f7fd806ea90 msgr2=0x7f7fd815cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.378+0000 7f7fddc10640 1 -- 172.21.15.114:0/1570259834 shutdown_connections 2023-11-04T01:40:51.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:51.378+0000 7f7fddc10640 1 -- 172.21.15.114:0/1570259834 wait complete. 2023-11-04T01:40:51.391 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:40:51.824 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-11-04T01:40:56.392 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:56.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.500+0000 7fd974125640 1 Processor -- start 2023-11-04T01:40:56.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.501+0000 7fd974125640 1 -- start start 2023-11-04T01:40:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.501+0000 7fd974125640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd96c159c70 0x7fd96c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.501+0000 7fd974125640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd96c06db20 0x7fd96c0b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.501+0000 7fd974125640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd96c0b0910 0x7fd96c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.501+0000 7fd974125640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c0b49b0 con 0x7fd96c06db20 2023-11-04T01:40:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.501+0000 7fd974125640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c0b0da0 con 0x7fd96c0b0910 2023-11-04T01:40:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.501+0000 7fd974125640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c0b4110 con 0x7fd96c159c70 2023-11-04T01:40:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.502+0000 7fd9716c0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd96c06db20 0x7fd96c0b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.502+0000 7fd9716c0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd96c06db20 0x7fd96c0b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44386/0 (socket says 172.21.15.114:44386) 2023-11-04T01:40:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.502+0000 7fd9716c0640 1 -- 172.21.15.114:0/1807329412 learned_addr learned my addr 172.21.15.114:0/1807329412 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.502+0000 7fd9716c0640 1 -- 172.21.15.114:0/1807329412 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd96c159c70 msgr2=0x7fd96c0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.502+0000 7fd9716c0640 1 --2- 172.21.15.114:0/1807329412 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd96c159c70 0x7fd96c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.502+0000 7fd9716c0640 1 -- 172.21.15.114:0/1807329412 >> v2:172.21.15.141:3300/0 conn(0x7fd96c0b0910 msgr2=0x7fd96c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.502+0000 7fd9726c2640 1 --2- 172.21.15.114:0/1807329412 >> v2:172.21.15.141:3300/0 conn(0x7fd96c0b0910 0x7fd96c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.502+0000 7fd9716c0640 1 --2- 172.21.15.114:0/1807329412 >> v2:172.21.15.141:3300/0 conn(0x7fd96c0b0910 0x7fd96c15d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.502+0000 7fd9716c0640 1 -- 172.21.15.114:0/1807329412 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c0b43f0 con 0x7fd96c06db20 2023-11-04T01:40:56.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.503+0000 7fd9716c0640 1 --2- 172.21.15.114:0/1807329412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd96c06db20 0x7fd96c0b03d0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0ca130 tx=0x7fd95c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893839b4efcaa59e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.503+0000 7fd970ebf640 1 -- 172.21.15.114:0/1807329412 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c031870 con 0x7fd96c06db20 2023-11-04T01:40:56.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.503+0000 7fd970ebf640 1 -- 172.21.15.114:0/1807329412 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c0319d0 con 0x7fd96c06db20 2023-11-04T01:40:56.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.503+0000 7fd970ebf640 1 -- 172.21.15.114:0/1807329412 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c031d60 con 0x7fd96c06db20 2023-11-04T01:40:56.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.503+0000 7fd974125640 1 -- 172.21.15.114:0/1807329412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd96c06db20 msgr2=0x7fd96c0b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.503+0000 7fd974125640 1 --2- 172.21.15.114:0/1807329412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd96c06db20 0x7fd96c0b03d0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0ca130 tx=0x7fd95c02b910 comp rx=0 tx=0).stop 2023-11-04T01:40:56.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.503+0000 7fd974125640 1 -- 172.21.15.114:0/1807329412 shutdown_connections 2023-11-04T01:40:56.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.503+0000 7fd974125640 1 --2- 172.21.15.114:0/1807329412 >> v2:172.21.15.141:3300/0 conn(0x7fd96c0b0910 0x7fd96c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.503+0000 7fd974125640 1 --2- 172.21.15.114:0/1807329412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd96c06db20 0x7fd96c0b03d0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.503+0000 7fd974125640 1 --2- 172.21.15.114:0/1807329412 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd96c159c70 0x7fd96c0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.503+0000 7fd974125640 1 -- 172.21.15.114:0/1807329412 >> 172.21.15.114:0/1807329412 conn(0x7fd96c0ce950 msgr2=0x7fd96c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:56.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.504+0000 7fd974125640 1 -- 172.21.15.114:0/1807329412 shutdown_connections 2023-11-04T01:40:56.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.504+0000 7fd974125640 1 -- 172.21.15.114:0/1807329412 wait complete. 2023-11-04T01:40:56.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.505+0000 7fd974125640 1 Processor -- start 2023-11-04T01:40:56.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.505+0000 7fd974125640 1 -- start start 2023-11-04T01:40:56.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd974125640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd96c06db20 0x7fd96c157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd974125640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd96c0b0910 0x7fd96c0c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd974125640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd96c159c70 0x7fd96c0a9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd974125640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c0c69e0 con 0x7fd96c0b0910 2023-11-04T01:40:56.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd974125640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c0a8410 con 0x7fd96c159c70 2023-11-04T01:40:56.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd974125640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c0a86f0 con 0x7fd96c06db20 2023-11-04T01:40:56.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd9716c0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd96c0b0910 0x7fd96c0c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd9716c0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd96c0b0910 0x7fd96c0c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44394/0 (socket says 172.21.15.114:44394) 2023-11-04T01:40:56.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd9716c0640 1 -- 172.21.15.114:0/714553969 learned_addr learned my addr 172.21.15.114:0/714553969 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd9716c0640 1 -- 172.21.15.114:0/714553969 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd96c06db20 msgr2=0x7fd96c157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd971ec1640 1 --2- 172.21.15.114:0/714553969 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd96c06db20 0x7fd96c157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd9726c2640 1 --2- 172.21.15.114:0/714553969 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd96c159c70 0x7fd96c0a9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd9716c0640 1 --2- 172.21.15.114:0/714553969 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd96c06db20 0x7fd96c157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd9716c0640 1 -- 172.21.15.114:0/714553969 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd96c159c70 msgr2=0x7fd96c0a9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd9716c0640 1 --2- 172.21.15.114:0/714553969 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd96c159c70 0x7fd96c0a9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd9716c0640 1 -- 172.21.15.114:0/714553969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c0094d0 con 0x7fd96c0b0910 2023-11-04T01:40:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd9716c0640 1 --2- 172.21.15.114:0/714553969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd96c0b0910 0x7fd96c0c88a0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd95c000c00 tx=0x7fd95c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd9627fc640 1 -- 172.21.15.114:0/714553969 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c031840 con 0x7fd96c0b0910 2023-11-04T01:40:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd9627fc640 1 -- 172.21.15.114:0/714553969 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c0443f0 con 0x7fd96c0b0910 2023-11-04T01:40:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd9627fc640 1 -- 172.21.15.114:0/714553969 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c0447a0 con 0x7fd96c0b0910 2023-11-04T01:40:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd974125640 1 -- 172.21.15.114:0/714553969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96c0c6ca0 con 0x7fd96c0b0910 2023-11-04T01:40:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.506+0000 7fd974125640 1 -- 172.21.15.114:0/714553969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96c0c8de0 con 0x7fd96c0b0910 2023-11-04T01:40:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.507+0000 7fd974125640 1 -- 172.21.15.114:0/714553969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96c0c71c0 con 0x7fd96c0b0910 2023-11-04T01:40:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.508+0000 7fd9627fc640 1 -- 172.21.15.114:0/714553969 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd95c04d450 con 0x7fd96c0b0910 2023-11-04T01:40:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.508+0000 7fd9627fc640 1 --2- 172.21.15.114:0/714553969 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd95006ae70 0x7fd95006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.508+0000 7fd9627fc640 1 -- 172.21.15.114:0/714553969 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7fd95c02d040 con 0x7fd96c0b0910 2023-11-04T01:40:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.508+0000 7fd971ec1640 1 --2- 172.21.15.114:0/714553969 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd95006ae70 0x7fd95006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.509+0000 7fd971ec1640 1 --2- 172.21.15.114:0/714553969 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd95006ae70 0x7fd95006d330 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd96800a810 tx=0x7fd968008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.513+0000 7fd9627fc640 1 -- 172.21.15.114:0/714553969 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd96c0c71c0 con 0x7fd96c0b0910 2023-11-04T01:40:56.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.718+0000 7fd974125640 1 -- 172.21.15.114:0/714553969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd96c0c71c0 con 0x7fd96c0b0910 2023-11-04T01:40:56.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.718+0000 7fd9627fc640 1 -- 172.21.15.114:0/714553969 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4991 (secure 0 0 0) 0x7fd96c0c71c0 con 0x7fd96c0b0910 2023-11-04T01:40:56.720 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:56.721 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7773,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:55.584103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6292,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6292":{"gid":6292,"name":"a","rank":0,"incarnation":51,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/1768068040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1768068040},{"type":"v1","addr":"172.21.15.114:6837","nonce":1768068040}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:40:55.584103+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 57 2023-11-04T01:40:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.720+0000 7fd974125640 1 -- 172.21.15.114:0/714553969 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd95006ae70 msgr2=0x7fd95006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.720+0000 7fd974125640 1 --2- 172.21.15.114:0/714553969 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd95006ae70 0x7fd95006d330 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd96800a810 tx=0x7fd968008040 comp rx=0 tx=0).stop 2023-11-04T01:40:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.720+0000 7fd974125640 1 -- 172.21.15.114:0/714553969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd96c0b0910 msgr2=0x7fd96c0c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.720+0000 7fd974125640 1 --2- 172.21.15.114:0/714553969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd96c0b0910 0x7fd96c0c88a0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd95c000c00 tx=0x7fd95c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.720+0000 7fd974125640 1 -- 172.21.15.114:0/714553969 shutdown_connections 2023-11-04T01:40:56.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.720+0000 7fd974125640 1 --2- 172.21.15.114:0/714553969 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd95006ae70 0x7fd95006d330 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.720+0000 7fd974125640 1 --2- 172.21.15.114:0/714553969 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd96c159c70 0x7fd96c0a9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.720+0000 7fd974125640 1 --2- 172.21.15.114:0/714553969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd96c0b0910 0x7fd96c0c88a0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.720+0000 7fd974125640 1 --2- 172.21.15.114:0/714553969 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd96c06db20 0x7fd96c157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.720+0000 7fd974125640 1 -- 172.21.15.114:0/714553969 >> 172.21.15.114:0/714553969 conn(0x7fd96c0ce950 msgr2=0x7fd96c1578c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:56.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.720+0000 7fd974125640 1 -- 172.21.15.114:0/714553969 shutdown_connections 2023-11-04T01:40:56.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:56.720+0000 7fd974125640 1 -- 172.21.15.114:0/714553969 wait complete. 2023-11-04T01:40:56.733 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:40:56.733 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:40:56.758 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:40:56.759 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:40:56.760 DEBUG:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:40:56.829 INFO:teuthology.orchestra.run.smithi114.stdout:1699062040.116805.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:40:56.831 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062040.116805.core'] 2023-11-04T01:40:56.831 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062040.116805.core, deleting it 2023-11-04T01:40:56.831 DEBUG:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062040.116805.core 2023-11-04T01:40:56.899 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:40:57.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.037+0000 7fb5b7ff5640 1 Processor -- start 2023-11-04T01:40:57.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.038+0000 7fb5b7ff5640 1 -- start start 2023-11-04T01:40:57.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.038+0000 7fb5b7ff5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb5b00c4690 0x7fb5b00cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.038+0000 7fb5b7ff5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b00c4b20 con 0x7fb5b0070710 2023-11-04T01:40:57.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.038+0000 7fb5b7ff5640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b00cca60 con 0x7fb5b0164760 2023-11-04T01:40:57.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.038+0000 7fb5b7ff5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b0164b40 con 0x7fb5b00c4690 2023-11-04T01:40:57.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.039+0000 7fb5b5590640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb5b00c4690 0x7fb5b00cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.039+0000 7fb5b6592640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb5b0070710 0x7fb5b00cdd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48030/0 (socket says 172.21.15.114:48030) 2023-11-04T01:40:57.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.039+0000 7fb5b6592640 1 -- 172.21.15.114:0/4279884856 learned_addr learned my addr 172.21.15.114:0/4279884856 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:40:57.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.039+0000 7fb5b4d8f640 1 -- 172.21.15.114:0/4279884856 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606409350 0 0) 0x7fb5b00c4b20 con 0x7fb5b0070710 2023-11-04T01:40:57.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.039+0000 7fb5b4d8f640 1 -- 172.21.15.114:0/4279884856 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb59c003520 con 0x7fb5b0070710 2023-11-04T01:40:57.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.039+0000 7fb5b5590640 1 -- 172.21.15.114:0/4279884856 >> v1:172.21.15.141:6789/0 conn(0x7fb5b0164760 legacy=0x7fb5b00b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.039+0000 7fb5b5590640 1 -- 172.21.15.114:0/4279884856 >> v1:172.21.15.114:6789/0 conn(0x7fb5b0070710 legacy=0x7fb5b00cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.039+0000 7fb5b5590640 1 -- 172.21.15.114:0/4279884856 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b00ccc90 con 0x7fb5b00c4690 2023-11-04T01:40:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.040+0000 7fb5b5590640 1 --2- 172.21.15.114:0/4279884856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5b00c4690 0x7fb5b00cc520 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00097a0 tx=0x7fb5a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e818f4505c3f4f55 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.040+0000 7fb5b4d8f640 1 -- 172.21.15.114:0/4279884856 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0031830 con 0x7fb5b00c4690 2023-11-04T01:40:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.040+0000 7fb5b4d8f640 1 -- 172.21.15.114:0/4279884856 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a0031990 con 0x7fb5b00c4690 2023-11-04T01:40:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.040+0000 7fb5b4d8f640 1 -- 172.21.15.114:0/4279884856 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0031d00 con 0x7fb5b00c4690 2023-11-04T01:40:57.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.040+0000 7fb5b7ff5640 1 -- 172.21.15.114:0/4279884856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5b00c4690 msgr2=0x7fb5b00cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.040+0000 7fb5b7ff5640 1 --2- 172.21.15.114:0/4279884856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5b00c4690 0x7fb5b00cc520 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00097a0 tx=0x7fb5a002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.040+0000 7fb5b7ff5640 1 -- 172.21.15.114:0/4279884856 shutdown_connections 2023-11-04T01:40:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.040+0000 7fb5b7ff5640 1 --2- 172.21.15.114:0/4279884856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5b00c4690 0x7fb5b00cc520 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.040+0000 7fb5b7ff5640 1 -- 172.21.15.114:0/4279884856 >> 172.21.15.114:0/4279884856 conn(0x7fb5b00ce950 msgr2=0x7fb5b00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.040+0000 7fb5b7ff5640 1 -- 172.21.15.114:0/4279884856 shutdown_connections 2023-11-04T01:40:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.040+0000 7fb5b7ff5640 1 -- 172.21.15.114:0/4279884856 wait complete. 2023-11-04T01:40:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.041+0000 7fb5b7ff5640 1 Processor -- start 2023-11-04T01:40:57.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.042+0000 7fb5b7ff5640 1 -- start start 2023-11-04T01:40:57.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.042+0000 7fb5b7ff5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5b0070710 0x7fb5b014b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.042+0000 7fb5b7ff5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5b00c4690 0x7fb5b01fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.042+0000 7fb5b7ff5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5b0164760 0x7fb5b01619b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.042+0000 7fb5b7ff5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00c7580 con 0x7fb5b0070710 2023-11-04T01:40:57.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.042+0000 7fb5b7ff5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b01fb0b0 con 0x7fb5b0164760 2023-11-04T01:40:57.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.042+0000 7fb5b7ff5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b01faaf0 con 0x7fb5b00c4690 2023-11-04T01:40:57.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.042+0000 7fb5b5d91640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5b0070710 0x7fb5b014b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.042+0000 7fb5b5d91640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5b0070710 0x7fb5b014b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44412/0 (socket says 172.21.15.114:44412) 2023-11-04T01:40:57.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.042+0000 7fb5b5d91640 1 -- 172.21.15.114:0/1139628363 learned_addr learned my addr 172.21.15.114:0/1139628363 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:57.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.043+0000 7fb5b6592640 1 --2- 172.21.15.114:0/1139628363 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5b0164760 0x7fb5b01619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.043+0000 7fb5b5590640 1 --2- 172.21.15.114:0/1139628363 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5b00c4690 0x7fb5b01fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.043+0000 7fb5b5d91640 1 -- 172.21.15.114:0/1139628363 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5b00c4690 msgr2=0x7fb5b01fa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.043+0000 7fb5b5d91640 1 --2- 172.21.15.114:0/1139628363 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5b00c4690 0x7fb5b01fa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.043+0000 7fb5b5d91640 1 -- 172.21.15.114:0/1139628363 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5b0164760 msgr2=0x7fb5b01619b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.043+0000 7fb5b5d91640 1 --2- 172.21.15.114:0/1139628363 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5b0164760 0x7fb5b01619b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.043+0000 7fb5b5d91640 1 -- 172.21.15.114:0/1139628363 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a0009400 con 0x7fb5b0070710 2023-11-04T01:40:57.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.043+0000 7fb5b6592640 1 --2- 172.21.15.114:0/1139628363 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5b0164760 0x7fb5b01619b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:57.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.043+0000 7fb5b5590640 1 --2- 172.21.15.114:0/1139628363 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5b00c4690 0x7fb5b01fa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:57.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.043+0000 7fb5b5d91640 1 --2- 172.21.15.114:0/1139628363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5b0070710 0x7fb5b014b530 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00c730 tx=0x7fb5ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.043+0000 7fb5a67fc640 1 -- 172.21.15.114:0/1139628363 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac006d50 con 0x7fb5b0070710 2023-11-04T01:40:57.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.043+0000 7fb5a67fc640 1 -- 172.21.15.114:0/1139628363 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac00ce40 con 0x7fb5b0070710 2023-11-04T01:40:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.043+0000 7fb5b7ff5640 1 -- 172.21.15.114:0/1139628363 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b01fadd0 con 0x7fb5b0070710 2023-11-04T01:40:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.043+0000 7fb5a67fc640 1 -- 172.21.15.114:0/1139628363 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac003bb0 con 0x7fb5b0070710 2023-11-04T01:40:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.043+0000 7fb5b7ff5640 1 -- 172.21.15.114:0/1139628363 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b014ba70 con 0x7fb5b0070710 2023-11-04T01:40:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.044+0000 7fb5b7ff5640 1 -- 172.21.15.114:0/1139628363 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b0074290 con 0x7fb5b0070710 2023-11-04T01:40:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.044+0000 7fb5a67fc640 1 -- 172.21.15.114:0/1139628363 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb5ac003d10 con 0x7fb5b0070710 2023-11-04T01:40:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.045+0000 7fb5a67fc640 1 --2- 172.21.15.114:0/1139628363 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb59406ae70 0x7fb59406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.045+0000 7fb5a67fc640 1 -- 172.21.15.114:0/1139628363 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7fb5ac089770 con 0x7fb5b0070710 2023-11-04T01:40:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.045+0000 7fb5b5590640 1 --2- 172.21.15.114:0/1139628363 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb59406ae70 0x7fb59406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.045+0000 7fb5b5590640 1 --2- 172.21.15.114:0/1139628363 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb59406ae70 0x7fb59406d330 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0036000 tx=0x7fb5a0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.049+0000 7fb5a67fc640 1 -- 172.21.15.114:0/1139628363 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb5ac057d30 con 0x7fb5b0070710 2023-11-04T01:40:57.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.282+0000 7fb5b7ff5640 1 -- 172.21.15.114:0/1139628363 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7fb5b006d1c0 con 0x7fb5b0070710 2023-11-04T01:40:57.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.284+0000 7fb5a67fc640 1 -- 172.21.15.114:0/1139628363 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 6292 v58) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb5ac0578c0 con 0x7fb5b0070710 2023-11-04T01:40:57.286 INFO:teuthology.orchestra.run.smithi114.stderr:failed mds gid 6292 2023-11-04T01:40:57.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.286+0000 7fb5b7ff5640 1 -- 172.21.15.114:0/1139628363 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb59406ae70 msgr2=0x7fb59406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.286+0000 7fb5b7ff5640 1 --2- 172.21.15.114:0/1139628363 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb59406ae70 0x7fb59406d330 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0036000 tx=0x7fb5a0008030 comp rx=0 tx=0).stop 2023-11-04T01:40:57.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.286+0000 7fb5b7ff5640 1 -- 172.21.15.114:0/1139628363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5b0070710 msgr2=0x7fb5b014b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.286+0000 7fb5b7ff5640 1 --2- 172.21.15.114:0/1139628363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5b0070710 0x7fb5b014b530 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00c730 tx=0x7fb5ac00cbf0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.286+0000 7fb5b7ff5640 1 -- 172.21.15.114:0/1139628363 shutdown_connections 2023-11-04T01:40:57.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.286+0000 7fb5b7ff5640 1 --2- 172.21.15.114:0/1139628363 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb59406ae70 0x7fb59406d330 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.286+0000 7fb5b7ff5640 1 --2- 172.21.15.114:0/1139628363 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb5b0164760 0x7fb5b01619b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.286+0000 7fb5b7ff5640 1 --2- 172.21.15.114:0/1139628363 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb5b00c4690 0x7fb5b01fa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.286+0000 7fb5b7ff5640 1 --2- 172.21.15.114:0/1139628363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5b0070710 0x7fb5b014b530 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.286+0000 7fb5b7ff5640 1 -- 172.21.15.114:0/1139628363 >> 172.21.15.114:0/1139628363 conn(0x7fb5b00ce950 msgr2=0x7fb5b015ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.287+0000 7fb5b7ff5640 1 -- 172.21.15.114:0/1139628363 shutdown_connections 2023-11-04T01:40:57.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.287+0000 7fb5b7ff5640 1 -- 172.21.15.114:0/1139628363 wait complete. 2023-11-04T01:40:57.301 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:40:57.301 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:40:57.301 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:40:57.301 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:40:57.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:40:57.301 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:40:57.302 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:40:57.302 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:40:57.304 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:40:57.304 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:57.381 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2023-11-04T01:40:57.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.405+0000 7ff91f7a5640 1 Processor -- start 2023-11-04T01:40:57.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.405+0000 7ff91f7a5640 1 -- start start 2023-11-04T01:40:57.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.406+0000 7ff91f7a5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff91815ae40 0x7ff91815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.406+0000 7ff91f7a5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff9180cbc00 0x7ff9180cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.406+0000 7ff91f7a5640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9180cc450 con 0x7ff9180cd860 2023-11-04T01:40:57.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.406+0000 7ff91f7a5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91815f400 con 0x7ff9180cbc00 2023-11-04T01:40:57.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.406+0000 7ff91f7a5640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91815b220 con 0x7ff91815ae40 2023-11-04T01:40:57.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.406+0000 7ff91cd40640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff9180cbc00 0x7ff9180cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.406+0000 7ff91cd40640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff9180cbc00 0x7ff9180cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44426/0 (socket says 172.21.15.114:44426) 2023-11-04T01:40:57.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.406+0000 7ff91cd40640 1 -- 172.21.15.114:0/2573246872 learned_addr learned my addr 172.21.15.114:0/2573246872 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:57.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.406+0000 7ff91cd40640 1 -- 172.21.15.114:0/2573246872 >> v2:172.21.15.141:3300/0 conn(0x7ff91815ae40 msgr2=0x7ff91815bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:57.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.406+0000 7ff91cd40640 1 --2- 172.21.15.114:0/2573246872 >> v2:172.21.15.141:3300/0 conn(0x7ff91815ae40 0x7ff91815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.406+0000 7ff91cd40640 1 -- 172.21.15.114:0/2573246872 >> v1:172.21.15.141:6789/0 conn(0x7ff9180cd860 legacy=0x7ff9180b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:57.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.406+0000 7ff91cd40640 1 -- 172.21.15.114:0/2573246872 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91815f890 con 0x7ff9180cbc00 2023-11-04T01:40:57.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.407+0000 7ff91cd40640 1 --2- 172.21.15.114:0/2573246872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9180cbc00 0x7ff9180cd320 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7ff91806e580 tx=0x7ff91402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337ac81d35e5a922 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.407+0000 7ff90ffff640 1 -- 172.21.15.114:0/2573246872 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914031870 con 0x7ff9180cbc00 2023-11-04T01:40:57.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.407+0000 7ff90ffff640 1 -- 172.21.15.114:0/2573246872 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9140319d0 con 0x7ff9180cbc00 2023-11-04T01:40:57.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.407+0000 7ff90ffff640 1 -- 172.21.15.114:0/2573246872 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914031d60 con 0x7ff9180cbc00 2023-11-04T01:40:57.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.407+0000 7ff91f7a5640 1 -- 172.21.15.114:0/2573246872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9180cbc00 msgr2=0x7ff9180cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.407+0000 7ff91f7a5640 1 --2- 172.21.15.114:0/2573246872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9180cbc00 0x7ff9180cd320 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7ff91806e580 tx=0x7ff91402b910 comp rx=0 tx=0).stop 2023-11-04T01:40:57.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.408+0000 7ff91f7a5640 1 -- 172.21.15.114:0/2573246872 shutdown_connections 2023-11-04T01:40:57.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.408+0000 7ff91f7a5640 1 --2- 172.21.15.114:0/2573246872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9180cbc00 0x7ff9180cd320 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.408+0000 7ff91f7a5640 1 --2- 172.21.15.114:0/2573246872 >> v2:172.21.15.141:3300/0 conn(0x7ff91815ae40 0x7ff91815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.408+0000 7ff91f7a5640 1 -- 172.21.15.114:0/2573246872 >> 172.21.15.114:0/2573246872 conn(0x7ff91806ea90 msgr2=0x7ff91806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.408+0000 7ff91f7a5640 1 -- 172.21.15.114:0/2573246872 shutdown_connections 2023-11-04T01:40:57.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.408+0000 7ff91f7a5640 1 -- 172.21.15.114:0/2573246872 wait complete. 2023-11-04T01:40:57.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.409+0000 7ff91f7a5640 1 Processor -- start 2023-11-04T01:40:57.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.409+0000 7ff91f7a5640 1 -- start start 2023-11-04T01:40:57.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.409+0000 7ff91f7a5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9180cbc00 0x7ff9180ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.409+0000 7ff91f7a5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff9180cd860 0x7ff91806bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.409+0000 7ff91f7a5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff91815ae40 0x7ff9181577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff91f7a5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180c7070 con 0x7ff91815ae40 2023-11-04T01:40:57.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff91f7a5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180c49f0 con 0x7ff9180cbc00 2023-11-04T01:40:57.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff91f7a5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180c7500 con 0x7ff9180cd860 2023-11-04T01:40:57.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff91dd42640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff91815ae40 0x7ff9181577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff91dd42640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff91815ae40 0x7ff9181577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44438/0 (socket says 172.21.15.114:44438) 2023-11-04T01:40:57.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff91dd42640 1 -- 172.21.15.114:0/3385817457 learned_addr learned my addr 172.21.15.114:0/3385817457 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:40:57.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff91cd40640 1 --2- 172.21.15.114:0/3385817457 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff9180cd860 0x7ff91806bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff91d541640 1 --2- 172.21.15.114:0/3385817457 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9180cbc00 0x7ff9180ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff91dd42640 1 -- 172.21.15.114:0/3385817457 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff9180cd860 msgr2=0x7ff91806bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff91dd42640 1 --2- 172.21.15.114:0/3385817457 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff9180cd860 0x7ff91806bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff91dd42640 1 -- 172.21.15.114:0/3385817457 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9180cbc00 msgr2=0x7ff9180ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff91dd42640 1 --2- 172.21.15.114:0/3385817457 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9180cbc00 0x7ff9180ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff91dd42640 1 -- 172.21.15.114:0/3385817457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9140094d0 con 0x7ff91815ae40 2023-11-04T01:40:57.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff91dd42640 1 --2- 172.21.15.114:0/3385817457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff91815ae40 0x7ff9181577f0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7ff91000c7b0 tx=0x7ff91000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff90dffb640 1 -- 172.21.15.114:0/3385817457 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff910003d80 con 0x7ff91815ae40 2023-11-04T01:40:57.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff90dffb640 1 -- 172.21.15.114:0/3385817457 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff910005070 con 0x7ff91815ae40 2023-11-04T01:40:57.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff91f7a5640 1 -- 172.21.15.114:0/3385817457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9180c6460 con 0x7ff91815ae40 2023-11-04T01:40:57.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff90dffb640 1 -- 172.21.15.114:0/3385817457 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff910005420 con 0x7ff91815ae40 2023-11-04T01:40:57.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.410+0000 7ff91f7a5640 1 -- 172.21.15.114:0/3385817457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9180c6a20 con 0x7ff91815ae40 2023-11-04T01:40:57.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.411+0000 7ff91f7a5640 1 -- 172.21.15.114:0/3385817457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9180ce2d0 con 0x7ff91815ae40 2023-11-04T01:40:57.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.412+0000 7ff90dffb640 1 -- 172.21.15.114:0/3385817457 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff910005580 con 0x7ff91815ae40 2023-11-04T01:40:57.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.412+0000 7ff90dffb640 1 --2- 172.21.15.114:0/3385817457 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8fc06ae70 0x7ff8fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.412+0000 7ff90dffb640 1 -- 172.21.15.114:0/3385817457 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7ff9100890c0 con 0x7ff91815ae40 2023-11-04T01:40:57.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.412+0000 7ff91d541640 1 --2- 172.21.15.114:0/3385817457 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8fc06ae70 0x7ff8fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.412+0000 7ff91d541640 1 --2- 172.21.15.114:0/3385817457 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8fc06ae70 0x7ff8fc06d330 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff91815bff0 tx=0x7ff908008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.416+0000 7ff90dffb640 1 -- 172.21.15.114:0/3385817457 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff910053b90 con 0x7ff91815ae40 2023-11-04T01:40:57.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.619+0000 7ff91f7a5640 1 -- 172.21.15.114:0/3385817457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff918074290 con 0x7ff91815ae40 2023-11-04T01:40:57.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.619+0000 7ff90dffb640 1 -- 172.21.15.114:0/3385817457 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4149 (secure 0 0 0) 0x7ff910017090 con 0x7ff91815ae40 2023-11-04T01:40:57.621 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:40:57.621 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":59,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:40:57.290689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7773,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7773":{"gid":7773,"name":"c","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:40:57.622 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 59 2023-11-04T01:40:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.621+0000 7ff91f7a5640 1 -- 172.21.15.114:0/3385817457 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8fc06ae70 msgr2=0x7ff8fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.621+0000 7ff91f7a5640 1 --2- 172.21.15.114:0/3385817457 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8fc06ae70 0x7ff8fc06d330 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff91815bff0 tx=0x7ff908008040 comp rx=0 tx=0).stop 2023-11-04T01:40:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.621+0000 7ff91f7a5640 1 -- 172.21.15.114:0/3385817457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff91815ae40 msgr2=0x7ff9181577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.621+0000 7ff91f7a5640 1 --2- 172.21.15.114:0/3385817457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff91815ae40 0x7ff9181577f0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7ff91000c7b0 tx=0x7ff91000cc70 comp rx=0 tx=0).stop 2023-11-04T01:40:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.621+0000 7ff91f7a5640 1 -- 172.21.15.114:0/3385817457 shutdown_connections 2023-11-04T01:40:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.621+0000 7ff91f7a5640 1 --2- 172.21.15.114:0/3385817457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff91815ae40 0x7ff9181577f0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.621+0000 7ff91f7a5640 1 --2- 172.21.15.114:0/3385817457 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff9180cd860 0x7ff91806bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.621+0000 7ff91f7a5640 1 --2- 172.21.15.114:0/3385817457 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8fc06ae70 0x7ff8fc06d330 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.621+0000 7ff91f7a5640 1 --2- 172.21.15.114:0/3385817457 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff9180cbc00 0x7ff9180ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.621+0000 7ff91f7a5640 1 -- 172.21.15.114:0/3385817457 >> 172.21.15.114:0/3385817457 conn(0x7ff91806ea90 msgr2=0x7ff91815cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.621+0000 7ff91f7a5640 1 -- 172.21.15.114:0/3385817457 shutdown_connections 2023-11-04T01:40:57.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:40:57.621+0000 7ff91f7a5640 1 -- 172.21.15.114:0/3385817457 wait complete. 2023-11-04T01:40:57.634 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:40:58.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:41:02.634 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.743+0000 7f5748ecf640 1 Processor -- start 2023-11-04T01:41:02.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.743+0000 7f5748ecf640 1 -- start start 2023-11-04T01:41:02.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.744+0000 7f5748ecf640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744159c70 0x7f57440ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.744+0000 7f5748ecf640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f57440b0ae0 0x7f574415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.744+0000 7f5748ecf640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57440b4110 con 0x7f574406db20 2023-11-04T01:41:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.744+0000 7f5748ecf640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57440b49b0 con 0x7f57440b0ae0 2023-11-04T01:41:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.744+0000 7f5748ecf640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57440b43f0 con 0x7f5744159c70 2023-11-04T01:41:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.744+0000 7f5742d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f57440b0ae0 0x7f574415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.744+0000 7f5741d9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f574406db20 0x7f57440b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48048/0 (socket says 172.21.15.114:48048) 2023-11-04T01:41:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.744+0000 7f5741d9b640 1 -- 172.21.15.114:0/645967368 learned_addr learned my addr 172.21.15.114:0/645967368 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.744+0000 7f574259c640 1 --2- 172.21.15.114:0/645967368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744159c70 0x7f57440ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.744+0000 7f5742d9d640 1 -- 172.21.15.114:0/645967368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744159c70 msgr2=0x7f57440ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.744+0000 7f5742d9d640 1 --2- 172.21.15.114:0/645967368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744159c70 0x7f57440ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.744+0000 7f5742d9d640 1 -- 172.21.15.114:0/645967368 >> v1:172.21.15.114:6789/0 conn(0x7f574406db20 legacy=0x7f57440b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.744+0000 7f5742d9d640 1 -- 172.21.15.114:0/645967368 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57440b46d0 con 0x7f57440b0ae0 2023-11-04T01:41:02.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.744+0000 7f574259c640 1 --2- 172.21.15.114:0/645967368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744159c70 0x7f57440ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:02.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.745+0000 7f5742d9d640 1 --2- 172.21.15.114:0/645967368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57440b0ae0 0x7f574415d7d0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f573c009d90 tx=0x7f573c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681b7aa927b7a2e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.745+0000 7f574159a640 1 -- 172.21.15.114:0/645967368 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c02cc50 con 0x7f57440b0ae0 2023-11-04T01:41:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.745+0000 7f574159a640 1 -- 172.21.15.114:0/645967368 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c02cdb0 con 0x7f57440b0ae0 2023-11-04T01:41:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.745+0000 7f574159a640 1 -- 172.21.15.114:0/645967368 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c034660 con 0x7f57440b0ae0 2023-11-04T01:41:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.746+0000 7f5748ecf640 1 -- 172.21.15.114:0/645967368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57440b0ae0 msgr2=0x7f574415d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.746+0000 7f5748ecf640 1 --2- 172.21.15.114:0/645967368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57440b0ae0 0x7f574415d7d0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f573c009d90 tx=0x7f573c02bea0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.746+0000 7f5748ecf640 1 -- 172.21.15.114:0/645967368 shutdown_connections 2023-11-04T01:41:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.746+0000 7f5748ecf640 1 --2- 172.21.15.114:0/645967368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57440b0ae0 0x7f574415d7d0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.746+0000 7f5748ecf640 1 --2- 172.21.15.114:0/645967368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744159c70 0x7f57440ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.746+0000 7f5748ecf640 1 -- 172.21.15.114:0/645967368 >> 172.21.15.114:0/645967368 conn(0x7f57440ce950 msgr2=0x7f57440ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.746+0000 7f5748ecf640 1 -- 172.21.15.114:0/645967368 shutdown_connections 2023-11-04T01:41:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.746+0000 7f5748ecf640 1 -- 172.21.15.114:0/645967368 wait complete. 2023-11-04T01:41:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.747+0000 7f5748ecf640 1 Processor -- start 2023-11-04T01:41:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.747+0000 7f5748ecf640 1 -- start start 2023-11-04T01:41:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f5748ecf640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f574406db20 0x7f5744153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f5748ecf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57440b0ae0 0x7f57441f0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f5748ecf640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744159c70 0x7f57440a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f5748ecf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57440c7470 con 0x7f57440b0ae0 2023-11-04T01:41:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f5748ecf640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5744154510 con 0x7f574406db20 2023-11-04T01:41:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f5748ecf640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57440c6860 con 0x7f5744159c70 2023-11-04T01:41:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f5741d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57440b0ae0 0x7f57441f0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f5741d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57440b0ae0 0x7f57441f0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44450/0 (socket says 172.21.15.114:44450) 2023-11-04T01:41:02.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f5741d9b640 1 -- 172.21.15.114:0/1484954156 learned_addr learned my addr 172.21.15.114:0/1484954156 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:02.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f5742d9d640 1 --2- 172.21.15.114:0/1484954156 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744159c70 0x7f57440a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f574259c640 1 --2- 172.21.15.114:0/1484954156 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f574406db20 0x7f5744153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f5741d9b640 1 -- 172.21.15.114:0/1484954156 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744159c70 msgr2=0x7f57440a7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f5741d9b640 1 --2- 172.21.15.114:0/1484954156 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744159c70 0x7f57440a7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f5741d9b640 1 -- 172.21.15.114:0/1484954156 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f574406db20 msgr2=0x7f5744153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f5741d9b640 1 --2- 172.21.15.114:0/1484954156 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f574406db20 0x7f5744153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f5741d9b640 1 -- 172.21.15.114:0/1484954156 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c009a70 con 0x7f57440b0ae0 2023-11-04T01:41:02.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.748+0000 7f5741d9b640 1 --2- 172.21.15.114:0/1484954156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57440b0ae0 0x7f57441f0730 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f573800c4a0 tx=0x7f573800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.749+0000 7f5732ffd640 1 -- 172.21.15.114:0/1484954156 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5738005ce0 con 0x7f57440b0ae0 2023-11-04T01:41:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.749+0000 7f5732ffd640 1 -- 172.21.15.114:0/1484954156 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5738005e40 con 0x7f57440b0ae0 2023-11-04T01:41:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.749+0000 7f5748ecf640 1 -- 172.21.15.114:0/1484954156 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57440c6b40 con 0x7f57440b0ae0 2023-11-04T01:41:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.749+0000 7f5732ffd640 1 -- 172.21.15.114:0/1484954156 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5738007270 con 0x7f57440b0ae0 2023-11-04T01:41:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.749+0000 7f5748ecf640 1 -- 172.21.15.114:0/1484954156 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57440c7100 con 0x7f57440b0ae0 2023-11-04T01:41:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.750+0000 7f5748ecf640 1 -- 172.21.15.114:0/1484954156 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5744074290 con 0x7f57440b0ae0 2023-11-04T01:41:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.750+0000 7f5732ffd640 1 -- 172.21.15.114:0/1484954156 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5738007490 con 0x7f57440b0ae0 2023-11-04T01:41:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.751+0000 7f5732ffd640 1 --2- 172.21.15.114:0/1484954156 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f572406ae70 0x7f572406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.751+0000 7f5732ffd640 1 -- 172.21.15.114:0/1484954156 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f5738089020 con 0x7f57440b0ae0 2023-11-04T01:41:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.751+0000 7f574259c640 1 --2- 172.21.15.114:0/1484954156 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f572406ae70 0x7f572406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.751+0000 7f574259c640 1 --2- 172.21.15.114:0/1484954156 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f572406ae70 0x7f572406d330 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f573400a950 tx=0x7f5734008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.755+0000 7f5732ffd640 1 -- 172.21.15.114:0/1484954156 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5738053ba0 con 0x7f57440b0ae0 2023-11-04T01:41:02.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.959+0000 7f5748ecf640 1 -- 172.21.15.114:0/1484954156 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f574406d3f0 con 0x7f57440b0ae0 2023-11-04T01:41:02.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.960+0000 7f5732ffd640 1 -- 172.21.15.114:0/1484954156 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f57380571c0 con 0x7f57440b0ae0 2023-11-04T01:41:02.962 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:02.962 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:00.303070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7773,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7773":{"gid":7773,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:02.962 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 63 2023-11-04T01:41:02.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.962+0000 7f5748ecf640 1 -- 172.21.15.114:0/1484954156 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f572406ae70 msgr2=0x7f572406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.962+0000 7f5748ecf640 1 --2- 172.21.15.114:0/1484954156 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f572406ae70 0x7f572406d330 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f573400a950 tx=0x7f5734008040 comp rx=0 tx=0).stop 2023-11-04T01:41:02.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.962+0000 7f5748ecf640 1 -- 172.21.15.114:0/1484954156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57440b0ae0 msgr2=0x7f57441f0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.962+0000 7f5748ecf640 1 --2- 172.21.15.114:0/1484954156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57440b0ae0 0x7f57441f0730 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f573800c4a0 tx=0x7f573800c960 comp rx=0 tx=0).stop 2023-11-04T01:41:02.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.962+0000 7f5748ecf640 1 -- 172.21.15.114:0/1484954156 shutdown_connections 2023-11-04T01:41:02.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.962+0000 7f5748ecf640 1 --2- 172.21.15.114:0/1484954156 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5744159c70 0x7f57440a7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.962+0000 7f5748ecf640 1 --2- 172.21.15.114:0/1484954156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57440b0ae0 0x7f57441f0730 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.962+0000 7f5748ecf640 1 --2- 172.21.15.114:0/1484954156 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f572406ae70 0x7f572406d330 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.962+0000 7f5748ecf640 1 --2- 172.21.15.114:0/1484954156 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f574406db20 0x7f5744153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.962+0000 7f5748ecf640 1 -- 172.21.15.114:0/1484954156 >> 172.21.15.114:0/1484954156 conn(0x7f57440ce950 msgr2=0x7f57440ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:02.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.962+0000 7f5748ecf640 1 -- 172.21.15.114:0/1484954156 shutdown_connections 2023-11-04T01:41:02.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:02.962+0000 7f5748ecf640 1 -- 172.21.15.114:0/1484954156 wait complete. 2023-11-04T01:41:02.974 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:41:02.975 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:03.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.072+0000 7f0322561640 1 Processor -- start 2023-11-04T01:41:03.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.072+0000 7f0322561640 1 -- start start 2023-11-04T01:41:03.075 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:41:03.072+0000 7f03b2d1d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:03.075 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:41:03.072+0000 7f03b2d1d640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:03.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.073+0000 7f0322561640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f031c0b42c0 0x7f031c0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.073+0000 7f0322561640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f031c0c9c40 0x7f031c0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.073+0000 7f0322561640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031c0ca050 con 0x7f031c15ad80 2023-11-04T01:41:03.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.073+0000 7f0322561640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f031c06cfa0 con 0x7f031c0c9c40 2023-11-04T01:41:03.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.073+0000 7f0322561640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f031c06d280 con 0x7f031c0b42c0 2023-11-04T01:41:03.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.073+0000 7f0320afe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f031c0c9c40 0x7f031c0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.073+0000 7f031bfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f031c15ad80 0x7f031c06c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48052/0 (socket says 172.21.15.114:48052) 2023-11-04T01:41:03.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.073+0000 7f031bfff640 1 -- 172.21.15.114:0/515947770 learned_addr learned my addr 172.21.15.114:0/515947770 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:03.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.073+0000 7f0320afe640 1 -- 172.21.15.114:0/515947770 >> v2:172.21.15.141:3300/0 conn(0x7f031c0b42c0 msgr2=0x7f031c0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.073+0000 7f0320afe640 1 --2- 172.21.15.114:0/515947770 >> v2:172.21.15.141:3300/0 conn(0x7f031c0b42c0 0x7f031c0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.073+0000 7f0320afe640 1 -- 172.21.15.114:0/515947770 >> v1:172.21.15.114:6789/0 conn(0x7f031c15ad80 legacy=0x7f031c06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.073+0000 7f0320afe640 1 -- 172.21.15.114:0/515947770 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031c06d560 con 0x7f031c0c9c40 2023-11-04T01:41:03.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.073+0000 7f031affd640 1 -- 172.21.15.114:0/515947770 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378548379 0 0) 0x7f031c0ca050 con 0x7f031c15ad80 2023-11-04T01:41:03.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.074+0000 7f0320afe640 1 --2- 172.21.15.114:0/515947770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f031c0c9c40 0x7f031c0b1a40 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f031c0c23c0 tx=0x7f031402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a509af1fa974ea8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.074+0000 7f031affd640 1 -- 172.21.15.114:0/515947770 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031402cd00 con 0x7f031c0c9c40 2023-11-04T01:41:03.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.074+0000 7f031affd640 1 -- 172.21.15.114:0/515947770 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031402ce60 con 0x7f031c0c9c40 2023-11-04T01:41:03.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.074+0000 7f031affd640 1 -- 172.21.15.114:0/515947770 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314034660 con 0x7f031c0c9c40 2023-11-04T01:41:03.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.075+0000 7f0322561640 1 -- 172.21.15.114:0/515947770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f031c0c9c40 msgr2=0x7f031c0b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.075+0000 7f0322561640 1 --2- 172.21.15.114:0/515947770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f031c0c9c40 0x7f031c0b1a40 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f031c0c23c0 tx=0x7f031402bf50 comp rx=0 tx=0).stop 2023-11-04T01:41:03.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.075+0000 7f0322561640 1 -- 172.21.15.114:0/515947770 shutdown_connections 2023-11-04T01:41:03.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.075+0000 7f0322561640 1 --2- 172.21.15.114:0/515947770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f031c0c9c40 0x7f031c0b1a40 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.075+0000 7f0322561640 1 --2- 172.21.15.114:0/515947770 >> v2:172.21.15.141:3300/0 conn(0x7f031c0b42c0 0x7f031c0c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.075+0000 7f0322561640 1 -- 172.21.15.114:0/515947770 >> 172.21.15.114:0/515947770 conn(0x7f031c0ce950 msgr2=0x7f031c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.075+0000 7f0322561640 1 -- 172.21.15.114:0/515947770 shutdown_connections 2023-11-04T01:41:03.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.075+0000 7f0322561640 1 -- 172.21.15.114:0/515947770 wait complete. 2023-11-04T01:41:03.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.076+0000 7f0322561640 1 Processor -- start 2023-11-04T01:41:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.076+0000 7f0322561640 1 -- start start 2023-11-04T01:41:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.077+0000 7f0322561640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f031c0b42c0 0x7f031c0c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.077+0000 7f0322561640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f031c0c9c40 0x7f031c0c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.077+0000 7f0322561640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f031c15ad80 0x7f031c152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.077+0000 7f0322561640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c15b290 con 0x7f031c0b42c0 2023-11-04T01:41:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.077+0000 7f0322561640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c15b570 con 0x7f031c15ad80 2023-11-04T01:41:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.077+0000 7f0322561640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031c15b850 con 0x7f031c0c9c40 2023-11-04T01:41:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.077+0000 7f031bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f031c0b42c0 0x7f031c0c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.077+0000 7f031bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f031c0b42c0 0x7f031c0c63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44464/0 (socket says 172.21.15.114:44464) 2023-11-04T01:41:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.077+0000 7f031bfff640 1 -- 172.21.15.114:0/399885081 learned_addr learned my addr 172.21.15.114:0/399885081 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.077+0000 7f031bfff640 1 -- 172.21.15.114:0/399885081 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f031c0c9c40 msgr2=0x7f031c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.077+0000 7f031bfff640 1 --2- 172.21.15.114:0/399885081 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f031c0c9c40 0x7f031c0c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.077+0000 7f031bfff640 1 -- 172.21.15.114:0/399885081 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f031c15ad80 msgr2=0x7f031c152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.077+0000 7f031bfff640 1 --2- 172.21.15.114:0/399885081 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f031c15ad80 0x7f031c152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.077+0000 7f031bfff640 1 -- 172.21.15.114:0/399885081 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0314009a70 con 0x7f031c0b42c0 2023-11-04T01:41:03.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.077+0000 7f031bfff640 1 --2- 172.21.15.114:0/399885081 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f031c0b42c0 0x7f031c0c63a0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f030c00c4d0 tx=0x7f030c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.078+0000 7f0318ff9640 1 -- 172.21.15.114:0/399885081 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c0074e0 con 0x7f031c0b42c0 2023-11-04T01:41:03.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.078+0000 7f0318ff9640 1 -- 172.21.15.114:0/399885081 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030c007660 con 0x7f031c0b42c0 2023-11-04T01:41:03.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.078+0000 7f0322561640 1 -- 172.21.15.114:0/399885081 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031c15bb30 con 0x7f031c0b42c0 2023-11-04T01:41:03.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.078+0000 7f0318ff9640 1 -- 172.21.15.114:0/399885081 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c004a20 con 0x7f031c0b42c0 2023-11-04T01:41:03.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.078+0000 7f0322561640 1 -- 172.21.15.114:0/399885081 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031c0c68e0 con 0x7f031c0b42c0 2023-11-04T01:41:03.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.079+0000 7f0322561640 1 -- 172.21.15.114:0/399885081 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f031c15c050 con 0x7f031c0b42c0 2023-11-04T01:41:03.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.079+0000 7f0318ff9640 1 -- 172.21.15.114:0/399885081 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f030c004b80 con 0x7f031c0b42c0 2023-11-04T01:41:03.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.079+0000 7f0318ff9640 1 --2- 172.21.15.114:0/399885081 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f030806ae70 0x7f030806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.079+0000 7f031b7fe640 1 --2- 172.21.15.114:0/399885081 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f030806ae70 0x7f030806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.079+0000 7f0318ff9640 1 -- 172.21.15.114:0/399885081 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f030c089160 con 0x7f031c0b42c0 2023-11-04T01:41:03.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.080+0000 7f031b7fe640 1 --2- 172.21.15.114:0/399885081 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f030806ae70 0x7f030806d330 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f031c0c91c0 tx=0x7f0310006bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.084+0000 7f0318ff9640 1 -- 172.21.15.114:0/399885081 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f030c053c30 con 0x7f031c0b42c0 2023-11-04T01:41:03.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.287+0000 7f0322561640 1 -- 172.21.15.114:0/399885081 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f031c066b00 con 0x7f031c0b42c0 2023-11-04T01:41:03.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.288+0000 7f0318ff9640 1 -- 172.21.15.114:0/399885081 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f030c057250 con 0x7f031c0b42c0 2023-11-04T01:41:03.290 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:03.290 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:00.303070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7773,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7773":{"gid":7773,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:03.290 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 63 2023-11-04T01:41:03.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.290+0000 7f0322561640 1 -- 172.21.15.114:0/399885081 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f030806ae70 msgr2=0x7f030806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.290+0000 7f0322561640 1 --2- 172.21.15.114:0/399885081 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f030806ae70 0x7f030806d330 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f031c0c91c0 tx=0x7f0310006bf0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.290+0000 7f0322561640 1 -- 172.21.15.114:0/399885081 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f031c0b42c0 msgr2=0x7f031c0c63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.290+0000 7f0322561640 1 --2- 172.21.15.114:0/399885081 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f031c0b42c0 0x7f031c0c63a0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f030c00c4d0 tx=0x7f030c00c990 comp rx=0 tx=0).stop 2023-11-04T01:41:03.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.290+0000 7f0322561640 1 -- 172.21.15.114:0/399885081 shutdown_connections 2023-11-04T01:41:03.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.290+0000 7f0322561640 1 --2- 172.21.15.114:0/399885081 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f030806ae70 0x7f030806d330 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.290+0000 7f0322561640 1 --2- 172.21.15.114:0/399885081 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f031c15ad80 0x7f031c152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.290+0000 7f0322561640 1 --2- 172.21.15.114:0/399885081 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f031c0c9c40 0x7f031c0c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.290+0000 7f0322561640 1 --2- 172.21.15.114:0/399885081 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f031c0b42c0 0x7f031c0c63a0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.290+0000 7f0322561640 1 -- 172.21.15.114:0/399885081 >> 172.21.15.114:0/399885081 conn(0x7f031c0ce950 msgr2=0x7f031c0b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.290+0000 7f0322561640 1 -- 172.21.15.114:0/399885081 shutdown_connections 2023-11-04T01:41:03.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.290+0000 7f0322561640 1 -- 172.21.15.114:0/399885081 wait complete. 2023-11-04T01:41:03.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:51.430343+0000', 'modified': '2023-11-04T01:41:00.303070+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 100, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7773, 'mds_1': 6298}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6298': {'gid': 6298, 'name': 'b', 'rank': 1, 'incarnation': 45, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.141:6834/1296600989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.141:6832', 'nonce': 1296600989}, {'type': 'v1', 'addr': '172.21.15.141:6834', 'nonce': 1296600989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7773': {'gid': 7773, 'name': 'c', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.114:6836/2722332212', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6834', 'nonce': 2722332212}, {'type': 'v1', 'addr': '172.21.15.114:6836', 'nonce': 2722332212}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:41:03.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:41:03.705 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:41:03.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.806+0000 7f2943b9e640 1 Processor -- start 2023-11-04T01:41:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.806+0000 7f2943b9e640 1 -- start start 2023-11-04T01:41:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.807+0000 7f2943b9e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f293c15e3f0 0x7f293c0b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.807+0000 7f2943b9e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f293c0ca0a0 0x7f293c0cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.807+0000 7f2943b9e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f293c0cc300 0x7f293c0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.807+0000 7f2943b9e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293c0caa20 con 0x7f293c0cc300 2023-11-04T01:41:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.807+0000 7f2943b9e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293c0cb230 con 0x7f293c15e3f0 2023-11-04T01:41:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.807+0000 7f2943b9e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293c0ca530 con 0x7f293c0ca0a0 2023-11-04T01:41:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.807+0000 7f294213b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f293c0cc300 0x7f293c0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.807+0000 7f294213b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f293c0cc300 0x7f293c0cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44470/0 (socket says 172.21.15.114:44470) 2023-11-04T01:41:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.807+0000 7f294213b640 1 -- 172.21.15.114:0/2317012650 learned_addr learned my addr 172.21.15.114:0/2317012650 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.807+0000 7f294213b640 1 -- 172.21.15.114:0/2317012650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f293c0ca0a0 msgr2=0x7f293c0cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.807+0000 7f294213b640 1 --2- 172.21.15.114:0/2317012650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f293c0ca0a0 0x7f293c0cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.807+0000 7f294193a640 1 --2- 172.21.15.114:0/2317012650 >> v2:172.21.15.141:3300/0 conn(0x7f293c15e3f0 0x7f293c0b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.807+0000 7f294213b640 1 -- 172.21.15.114:0/2317012650 >> v2:172.21.15.141:3300/0 conn(0x7f293c15e3f0 msgr2=0x7f293c0b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.807+0000 7f294213b640 1 --2- 172.21.15.114:0/2317012650 >> v2:172.21.15.141:3300/0 conn(0x7f293c15e3f0 0x7f293c0b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.807+0000 7f294213b640 1 -- 172.21.15.114:0/2317012650 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c0cac70 con 0x7f293c0cc300 2023-11-04T01:41:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.807+0000 7f294193a640 1 --2- 172.21.15.114:0/2317012650 >> v2:172.21.15.141:3300/0 conn(0x7f293c15e3f0 0x7f293c0b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:03.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.808+0000 7f294213b640 1 --2- 172.21.15.114:0/2317012650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f293c0cc300 0x7f293c0cce60 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f293c0b5bc0 tx=0x7f293402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7125e1571778f67 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.808+0000 7f2940938640 1 -- 172.21.15.114:0/2317012650 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293402ca70 con 0x7f293c0cc300 2023-11-04T01:41:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.808+0000 7f2940938640 1 -- 172.21.15.114:0/2317012650 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293402cbd0 con 0x7f293c0cc300 2023-11-04T01:41:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.808+0000 7f2940938640 1 -- 172.21.15.114:0/2317012650 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29340343f0 con 0x7f293c0cc300 2023-11-04T01:41:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.809+0000 7f2943b9e640 1 -- 172.21.15.114:0/2317012650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f293c0cc300 msgr2=0x7f293c0cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.809+0000 7f2943b9e640 1 --2- 172.21.15.114:0/2317012650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f293c0cc300 0x7f293c0cce60 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f293c0b5bc0 tx=0x7f293402bed0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.809+0000 7f2943b9e640 1 -- 172.21.15.114:0/2317012650 shutdown_connections 2023-11-04T01:41:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.809+0000 7f2943b9e640 1 --2- 172.21.15.114:0/2317012650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f293c0ca0a0 0x7f293c0cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.809+0000 7f2943b9e640 1 --2- 172.21.15.114:0/2317012650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f293c0cc300 0x7f293c0cce60 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.809+0000 7f2943b9e640 1 --2- 172.21.15.114:0/2317012650 >> v2:172.21.15.141:3300/0 conn(0x7f293c15e3f0 0x7f293c0b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.809+0000 7f2943b9e640 1 -- 172.21.15.114:0/2317012650 >> 172.21.15.114:0/2317012650 conn(0x7f293c071820 msgr2=0x7f293c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.809+0000 7f2943b9e640 1 -- 172.21.15.114:0/2317012650 shutdown_connections 2023-11-04T01:41:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.809+0000 7f2943b9e640 1 -- 172.21.15.114:0/2317012650 wait complete. 2023-11-04T01:41:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.810+0000 7f2943b9e640 1 Processor -- start 2023-11-04T01:41:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.810+0000 7f2943b9e640 1 -- start start 2023-11-04T01:41:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.810+0000 7f2943b9e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f293c0cc300 0x7f293c150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.810+0000 7f2943b9e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f293c15e3f0 0x7f293c0c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.810+0000 7f2943b9e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f293c0b04a0 0x7f293c0b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f2943b9e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c0c61e0 con 0x7f293c0b04a0 2023-11-04T01:41:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f2943b9e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c1505c0 con 0x7f293c15e3f0 2023-11-04T01:41:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f2943b9e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293c0b0e70 con 0x7f293c0cc300 2023-11-04T01:41:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f294213b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f293c0b04a0 0x7f293c0b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f294213b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f293c0b04a0 0x7f293c0b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44476/0 (socket says 172.21.15.114:44476) 2023-11-04T01:41:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f294213b640 1 -- 172.21.15.114:0/1593917380 learned_addr learned my addr 172.21.15.114:0/1593917380 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f294193a640 1 --2- 172.21.15.114:0/1593917380 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f293c0cc300 0x7f293c150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f2941139640 1 --2- 172.21.15.114:0/1593917380 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f293c15e3f0 0x7f293c0c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f294213b640 1 -- 172.21.15.114:0/1593917380 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f293c0cc300 msgr2=0x7f293c150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f294213b640 1 --2- 172.21.15.114:0/1593917380 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f293c0cc300 0x7f293c150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f294213b640 1 -- 172.21.15.114:0/1593917380 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f293c15e3f0 msgr2=0x7f293c0c41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f294213b640 1 --2- 172.21.15.114:0/1593917380 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f293c15e3f0 0x7f293c0c41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f294213b640 1 -- 172.21.15.114:0/1593917380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2934009b30 con 0x7f293c0b04a0 2023-11-04T01:41:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f294213b640 1 --2- 172.21.15.114:0/1593917380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f293c0b04a0 0x7f293c0b0930 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f2934009f40 tx=0x7f2934004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f29327fc640 1 -- 172.21.15.114:0/1593917380 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293403e450 con 0x7f293c0b04a0 2023-11-04T01:41:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f29327fc640 1 -- 172.21.15.114:0/1593917380 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293403e5d0 con 0x7f293c0b04a0 2023-11-04T01:41:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f2943b9e640 1 -- 172.21.15.114:0/1593917380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f293c0c7b10 con 0x7f293c0b04a0 2023-11-04T01:41:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f29327fc640 1 -- 172.21.15.114:0/1593917380 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293403e980 con 0x7f293c0b04a0 2023-11-04T01:41:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.811+0000 7f2943b9e640 1 -- 172.21.15.114:0/1593917380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293c0c71e0 con 0x7f293c0b04a0 2023-11-04T01:41:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.813+0000 7f29327fc640 1 -- 172.21.15.114:0/1593917380 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f293403eae0 con 0x7f293c0b04a0 2023-11-04T01:41:03.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.813+0000 7f29327fc640 1 --2- 172.21.15.114:0/1593917380 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f292006aea0 0x7f292006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.813+0000 7f29327fc640 1 -- 172.21.15.114:0/1593917380 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f29340acdd0 con 0x7f293c0b04a0 2023-11-04T01:41:03.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.813+0000 7f294193a640 1 --2- 172.21.15.114:0/1593917380 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f292006aea0 0x7f292006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.813+0000 7f294193a640 1 --2- 172.21.15.114:0/1593917380 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f292006aea0 0x7f292006d360 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f293c0c9b20 tx=0x7f2938008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.814+0000 7f294680c740 1 Processor -- start 2023-11-04T01:41:03.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.814+0000 7f294680c740 1 -- start start 2023-11-04T01:41:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.815+0000 7f294680c740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d257163d0 0x559d25713f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.815+0000 7f294680c740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d256f5c10 0x559d256cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.815+0000 7f294680c740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d256cde40 0x559d256f85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.815+0000 7f294680c740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d255d9740 con 0x559d256cde40 2023-11-04T01:41:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.815+0000 7f294680c740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d2563b8d0 con 0x559d256f5c10 2023-11-04T01:41:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.815+0000 7f294680c740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d25638fc0 con 0x559d257163d0 2023-11-04T01:41:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.815+0000 7f294213b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d256cde40 0x559d256f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.815+0000 7f294213b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d256cde40 0x559d256f85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44492/0 (socket says 172.21.15.114:44492) 2023-11-04T01:41:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.815+0000 7f294213b640 1 -- 172.21.15.114:0/1933196529 learned_addr learned my addr 172.21.15.114:0/1933196529 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.815+0000 7f294213b640 1 -- 172.21.15.114:0/1933196529 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d257163d0 msgr2=0x559d25713f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.815+0000 7f294213b640 1 --2- 172.21.15.114:0/1933196529 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d257163d0 0x559d25713f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.815+0000 7f294213b640 1 -- 172.21.15.114:0/1933196529 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d256f5c10 msgr2=0x559d256cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.815+0000 7f294213b640 1 --2- 172.21.15.114:0/1933196529 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d256f5c10 0x559d256cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.815+0000 7f294213b640 1 -- 172.21.15.114:0/1933196529 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d255f7ca0 con 0x559d256cde40 2023-11-04T01:41:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.815+0000 7f294213b640 1 --2- 172.21.15.114:0/1933196529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d256cde40 0x559d256f85e0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f2934083330 tx=0x7f293407b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59abc694d24708a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.815+0000 7f291f7fe640 1 -- 172.21.15.114:0/1933196529 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934083860 con 0x559d256cde40 2023-11-04T01:41:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.816+0000 7f291f7fe640 1 -- 172.21.15.114:0/1933196529 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2934079900 con 0x559d256cde40 2023-11-04T01:41:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.816+0000 7f291f7fe640 1 -- 172.21.15.114:0/1933196529 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934077c70 con 0x559d256cde40 2023-11-04T01:41:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.816+0000 7f294680c740 1 -- 172.21.15.114:0/1933196529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d256cde40 msgr2=0x559d256f85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.816+0000 7f294680c740 1 --2- 172.21.15.114:0/1933196529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d256cde40 0x559d256f85e0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f2934083330 tx=0x7f293407b460 comp rx=0 tx=0).stop 2023-11-04T01:41:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.816+0000 7f294680c740 1 -- 172.21.15.114:0/1933196529 shutdown_connections 2023-11-04T01:41:03.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.816+0000 7f294680c740 1 --2- 172.21.15.114:0/1933196529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d256cde40 0x559d256f85e0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.816+0000 7f294680c740 1 --2- 172.21.15.114:0/1933196529 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d256f5c10 0x559d256cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.816+0000 7f294680c740 1 --2- 172.21.15.114:0/1933196529 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d257163d0 0x559d25713f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.816+0000 7f294680c740 1 -- 172.21.15.114:0/1933196529 >> 172.21.15.114:0/1933196529 conn(0x559d256caa60 msgr2=0x559d257135e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.816+0000 7f294680c740 1 -- 172.21.15.114:0/1933196529 shutdown_connections 2023-11-04T01:41:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.816+0000 7f294680c740 1 -- 172.21.15.114:0/1933196529 wait complete. 2023-11-04T01:41:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.817+0000 7f294680c740 1 -- start start 2023-11-04T01:41:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.817+0000 7f294680c740 1 Processor -- start 2023-11-04T01:41:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f294680c740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d256f5c10 0x559d256f0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f294680c740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d257163d0 0x559d2570f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f294680c740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d2570fec0 0x559d25710310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f294680c740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d256348b0 con 0x559d257163d0 2023-11-04T01:41:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f294680c740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d255eec80 con 0x559d2570fec0 2023-11-04T01:41:03.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f294680c740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d255ee920 con 0x559d256f5c10 2023-11-04T01:41:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f294680c740 10 client.0 _ll_register_callbacks cb 0x559d25346ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f2941139640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d257163d0 0x559d2570f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f2941139640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d257163d0 0x559d2570f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44500/0 (socket says 172.21.15.114:44500) 2023-11-04T01:41:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f2941139640 1 -- 172.21.15.114:0/1396195638 learned_addr learned my addr 172.21.15.114:0/1396195638 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f294213b640 1 --2- 172.21.15.114:0/1396195638 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d2570fec0 0x559d25710310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f294193a640 1 --2- 172.21.15.114:0/1396195638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d256f5c10 0x559d256f0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f2941139640 1 -- 172.21.15.114:0/1396195638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d256f5c10 msgr2=0x559d256f0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f2941139640 1 --2- 172.21.15.114:0/1396195638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d256f5c10 0x559d256f0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f2941139640 1 -- 172.21.15.114:0/1396195638 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d2570fec0 msgr2=0x559d25710310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f2941139640 1 --2- 172.21.15.114:0/1396195638 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d2570fec0 0x559d25710310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f2941139640 1 -- 172.21.15.114:0/1396195638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293c0c71e0 con 0x559d257163d0 2023-11-04T01:41:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f294213b640 1 --2- 172.21.15.114:0/1396195638 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d2570fec0 0x559d25710310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:03.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f2941139640 1 --2- 172.21.15.114:0/1396195638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d257163d0 0x559d2570f980 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f292c00ae80 tx=0x7f292c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f53754e233d736 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f291cff9640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:41:03.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f291cff9640 1 -- 172.21.15.114:0/1396195638 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0115f0 con 0x559d257163d0 2023-11-04T01:41:03.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f291cff9640 1 -- 172.21.15.114:0/1396195638 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f292c011750 con 0x559d257163d0 2023-11-04T01:41:03.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.818+0000 7f294680c740 1 -- 172.21.15.114:0/1396195638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d255e0bf0 con 0x559d257163d0 2023-11-04T01:41:03.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.819+0000 7f291cff9640 1 -- 172.21.15.114:0/1396195638 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f292c011910 con 0x559d257163d0 2023-11-04T01:41:03.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.819+0000 7f294680c740 10 client.7935 fetch_fsmap learned FSMap version 63 2023-11-04T01:41:03.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.819+0000 7f294680c740 1 -- 172.21.15.114:0/1396195638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x559d25632f30 con 0x559d257163d0 2023-11-04T01:41:03.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.819+0000 7f291cff9640 1 -- 172.21.15.114:0/1396195638 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559d255e0bf0 con 0x559d257163d0 2023-11-04T01:41:03.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.819+0000 7f291cff9640 1 -- 172.21.15.114:0/1396195638 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 63) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f292c020020 con 0x559d257163d0 2023-11-04T01:41:03.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.819+0000 7f294680c740 10 client.7935 fetch_fsmap finished waiting for FSMap version 63 2023-11-04T01:41:03.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.819+0000 7f294680c740 10 client.7935 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:41:03.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.819+0000 7f294680c740 20 client.7935 populate_metadata read hostname 'smithi114' 2023-11-04T01:41:03.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.819+0000 7f294680c740 1 --2- 172.21.15.114:0/1396195638 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x559d25712970 0x559d2572b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.819+0000 7f294680c740 4 client.7935 mds_command: new command op to 6298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:41:03.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.819+0000 7f294680c740 1 -- 172.21.15.114:0/1396195638 --> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d2562d890 con 0x559d25712970 2023-11-04T01:41:03.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.819+0000 7f294193a640 1 --2- 172.21.15.114:0/1396195638 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x559d25712970 0x559d2572b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.820+0000 7f294193a640 1 --2- 172.21.15.114:0/1396195638 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x559d25712970 0x559d2572b260 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=25c3957480047b36 server_cookie=3e5b870a5c902bcc in_seq=0 out_seq=0 2023-11-04T01:41:03.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.820+0000 7f291cff9640 10 client.7935 ms_handle_connect on v2:172.21.15.141:6832/1296600989 2023-11-04T01:41:03.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.820+0000 7f291cff9640 1 -- 172.21.15.114:0/1396195638 <== mds.1 v2:172.21.15.141:6832/1296600989 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559d2562d890 con 0x559d25712970 2023-11-04T01:41:03.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.820+0000 7f291cff9640 10 client.7935 handle_command_reply: tid=0 2023-11-04T01:41:03.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.820+0000 7f294680c740 1 client.7935 shutdown 2023-11-04T01:41:03.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.820+0000 7f294680c740 1 -- 172.21.15.114:0/1396195638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d257163d0 msgr2=0x559d2570f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.820+0000 7f294680c740 1 --2- 172.21.15.114:0/1396195638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d257163d0 0x559d2570f980 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f292c00ae80 tx=0x7f292c00c520 comp rx=0 tx=0).stop 2023-11-04T01:41:03.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.821+0000 7f294680c740 1 -- 172.21.15.114:0/1396195638 shutdown_connections 2023-11-04T01:41:03.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.821+0000 7f294680c740 1 --2- 172.21.15.114:0/1396195638 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x559d25712970 0x559d2572b260 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.821+0000 7f294680c740 1 --2- 172.21.15.114:0/1396195638 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d2570fec0 0x559d25710310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.821+0000 7f294680c740 1 --2- 172.21.15.114:0/1396195638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d257163d0 0x559d2570f980 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.821+0000 7f291cff9640 0 client.7935 ms_handle_reset on v2:172.21.15.141:6832/1296600989 2023-11-04T01:41:03.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.821+0000 7f294680c740 1 --2- 172.21.15.114:0/1396195638 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d256f5c10 0x559d256f0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.821+0000 7f294680c740 1 -- 172.21.15.114:0/1396195638 >> 172.21.15.114:0/1396195638 conn(0x559d256cde40 msgr2=0x559d25713500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.821+0000 7f294680c740 1 -- 172.21.15.114:0/1396195638 shutdown_connections 2023-11-04T01:41:03.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.821+0000 7f294680c740 1 -- 172.21.15.114:0/1396195638 wait complete. 2023-11-04T01:41:03.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.821+0000 7f294680c740 20 client.7935 trim_cache size 0 max 16384 2023-11-04T01:41:03.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.836+0000 7f294680c740 1 Processor -- start 2023-11-04T01:41:03.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.836+0000 7f294680c740 1 -- start start 2023-11-04T01:41:03.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f294680c740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d256f5c10 0x559d2570ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f294680c740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d2570fec0 0x559d2570d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f294680c740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d257163d0 0x559d2570dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f294680c740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d255b4280 con 0x559d2570fec0 2023-11-04T01:41:03.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f294680c740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d256f1d80 con 0x559d256f5c10 2023-11-04T01:41:03.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f294680c740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d25710f40 con 0x559d257163d0 2023-11-04T01:41:03.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f2941139640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d2570fec0 0x559d2570d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f2941139640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d2570fec0 0x559d2570d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44508/0 (socket says 172.21.15.114:44508) 2023-11-04T01:41:03.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f2941139640 1 -- 172.21.15.114:0/1211632072 learned_addr learned my addr 172.21.15.114:0/1211632072 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f294193a640 1 --2- 172.21.15.114:0/1211632072 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d256f5c10 0x559d2570ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f294213b640 1 --2- 172.21.15.114:0/1211632072 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d257163d0 0x559d2570dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f2941139640 1 -- 172.21.15.114:0/1211632072 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d257163d0 msgr2=0x559d2570dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f2941139640 1 --2- 172.21.15.114:0/1211632072 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d257163d0 0x559d2570dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f2941139640 1 -- 172.21.15.114:0/1211632072 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d256f5c10 msgr2=0x559d2570ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f2941139640 1 --2- 172.21.15.114:0/1211632072 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d256f5c10 0x559d2570ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f2941139640 1 -- 172.21.15.114:0/1211632072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d255d0d10 con 0x559d2570fec0 2023-11-04T01:41:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.837+0000 7f294213b640 1 --2- 172.21.15.114:0/1211632072 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d257163d0 0x559d2570dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.838+0000 7f2941139640 1 --2- 172.21.15.114:0/1211632072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d2570fec0 0x559d2570d3a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f292c00a140 tx=0x7f292c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32774bf0a258bc15 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.838+0000 7f291ffff640 1 -- 172.21.15.114:0/1211632072 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c006a50 con 0x559d2570fec0 2023-11-04T01:41:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.838+0000 7f291ffff640 1 -- 172.21.15.114:0/1211632072 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c0113f0 con 0x559d2570fec0 2023-11-04T01:41:03.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.838+0000 7f291ffff640 1 -- 172.21.15.114:0/1211632072 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0117a0 con 0x559d2570fec0 2023-11-04T01:41:03.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.838+0000 7f294680c740 1 -- 172.21.15.114:0/1211632072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d2570fec0 msgr2=0x559d2570d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.838+0000 7f294680c740 1 --2- 172.21.15.114:0/1211632072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d2570fec0 0x559d2570d3a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f292c00a140 tx=0x7f292c011000 comp rx=0 tx=0).stop 2023-11-04T01:41:03.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.838+0000 7f294680c740 1 -- 172.21.15.114:0/1211632072 shutdown_connections 2023-11-04T01:41:03.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.838+0000 7f294680c740 1 --2- 172.21.15.114:0/1211632072 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d257163d0 0x559d2570dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.838+0000 7f294680c740 1 --2- 172.21.15.114:0/1211632072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d2570fec0 0x559d2570d3a0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.838+0000 7f294680c740 1 --2- 172.21.15.114:0/1211632072 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d256f5c10 0x559d2570ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.838+0000 7f294680c740 1 -- 172.21.15.114:0/1211632072 >> 172.21.15.114:0/1211632072 conn(0x559d256cde40 msgr2=0x559d256ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.838+0000 7f294680c740 1 -- 172.21.15.114:0/1211632072 shutdown_connections 2023-11-04T01:41:03.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.838+0000 7f294680c740 1 -- 172.21.15.114:0/1211632072 wait complete. 2023-11-04T01:41:03.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.839+0000 7f294680c740 1 -- start start 2023-11-04T01:41:03.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.839+0000 7f294680c740 1 Processor -- start 2023-11-04T01:41:03.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f294680c740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d256f5c10 0x559d257601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f294680c740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d2570fec0 0x559d25775d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f294680c740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d257163d0 0x559d25715050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f294680c740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d25761150 con 0x559d2570fec0 2023-11-04T01:41:03.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f294680c740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d257767f0 con 0x559d257163d0 2023-11-04T01:41:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f294680c740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d25760940 con 0x559d256f5c10 2023-11-04T01:41:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f294680c740 10 client.0 _ll_register_callbacks cb 0x7f293402cb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f2941139640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d2570fec0 0x559d25775d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f2941139640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d2570fec0 0x559d25775d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44520/0 (socket says 172.21.15.114:44520) 2023-11-04T01:41:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f2941139640 1 -- 172.21.15.114:0/3364937627 learned_addr learned my addr 172.21.15.114:0/3364937627 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f294213b640 1 --2- 172.21.15.114:0/3364937627 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d257163d0 0x559d25715050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f294193a640 1 --2- 172.21.15.114:0/3364937627 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d256f5c10 0x559d257601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f2941139640 1 -- 172.21.15.114:0/3364937627 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d256f5c10 msgr2=0x559d257601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f2941139640 1 --2- 172.21.15.114:0/3364937627 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d256f5c10 0x559d257601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f2941139640 1 -- 172.21.15.114:0/3364937627 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d257163d0 msgr2=0x559d25715050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f2941139640 1 --2- 172.21.15.114:0/3364937627 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d257163d0 0x559d25715050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f2941139640 1 -- 172.21.15.114:0/3364937627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d25632f30 con 0x559d2570fec0 2023-11-04T01:41:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f2941139640 1 --2- 172.21.15.114:0/3364937627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d2570fec0 0x559d25775d00 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f292c008010 tx=0x7f292c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c094c81c4d6b821f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f291cff9640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:41:03.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f291cff9640 1 -- 172.21.15.114:0/3364937627 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c036450 con 0x559d2570fec0 2023-11-04T01:41:03.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f291cff9640 1 -- 172.21.15.114:0/3364937627 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f292c0365b0 con 0x559d2570fec0 2023-11-04T01:41:03.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f294680c740 1 -- 172.21.15.114:0/3364937627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2934079900 con 0x559d2570fec0 2023-11-04T01:41:03.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f291cff9640 1 -- 172.21.15.114:0/3364937627 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f292c036790 con 0x559d2570fec0 2023-11-04T01:41:03.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.840+0000 7f294680c740 10 client.7941 fetch_fsmap learned FSMap version 63 2023-11-04T01:41:03.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.841+0000 7f294680c740 1 -- 172.21.15.114:0/3364937627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x559d255f6500 con 0x559d2570fec0 2023-11-04T01:41:03.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.841+0000 7f291cff9640 1 -- 172.21.15.114:0/3364937627 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2934079900 con 0x559d2570fec0 2023-11-04T01:41:03.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.841+0000 7f291cff9640 1 -- 172.21.15.114:0/3364937627 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 63) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f292c020040 con 0x559d2570fec0 2023-11-04T01:41:03.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.841+0000 7f294680c740 10 client.7941 fetch_fsmap finished waiting for FSMap version 63 2023-11-04T01:41:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.841+0000 7f294680c740 10 client.7941 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:41:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.841+0000 7f294680c740 20 client.7941 populate_metadata read hostname 'smithi114' 2023-11-04T01:41:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.841+0000 7f294680c740 1 --2- 172.21.15.114:0/3364937627 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x559d256f4f40 0x559d256ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.841+0000 7f294680c740 4 client.7941 mds_command: new command op to 6298 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:41:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.841+0000 7f294680c740 1 -- 172.21.15.114:0/3364937627 --> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559d2562d5b0 con 0x559d256f4f40 2023-11-04T01:41:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.841+0000 7f294193a640 1 --2- 172.21.15.114:0/3364937627 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x559d256f4f40 0x559d256ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.841+0000 7f291cff9640 10 client.7941 ms_handle_connect on v2:172.21.15.141:6832/1296600989 2023-11-04T01:41:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.841+0000 7f294193a640 1 --2- 172.21.15.114:0/3364937627 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x559d256f4f40 0x559d256ce280 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eebc0349380b151e server_cookie=62a7d31565887082 in_seq=0 out_seq=0 2023-11-04T01:41:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f291cff9640 1 -- 172.21.15.114:0/3364937627 <== mds.1 v2:172.21.15.141:6832/1296600989 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x559d2562d5b0 con 0x559d256f4f40 2023-11-04T01:41:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f291cff9640 10 client.7941 handle_command_reply: tid=0 2023-11-04T01:41:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f294680c740 1 client.7941 shutdown 2023-11-04T01:41:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f294680c740 1 -- 172.21.15.114:0/3364937627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d2570fec0 msgr2=0x559d25775d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f294680c740 1 --2- 172.21.15.114:0/3364937627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d2570fec0 0x559d25775d00 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f292c008010 tx=0x7f292c004730 comp rx=0 tx=0).stop 2023-11-04T01:41:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f294680c740 1 -- 172.21.15.114:0/3364937627 shutdown_connections 2023-11-04T01:41:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f294680c740 1 --2- 172.21.15.114:0/3364937627 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x559d256f4f40 0x559d256ce280 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f294680c740 1 --2- 172.21.15.114:0/3364937627 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559d257163d0 0x559d25715050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f294680c740 1 --2- 172.21.15.114:0/3364937627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559d2570fec0 0x559d25775d00 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f291cff9640 0 client.7941 ms_handle_reset on v2:172.21.15.141:6832/1296600989 2023-11-04T01:41:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f294680c740 1 --2- 172.21.15.114:0/3364937627 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559d256f5c10 0x559d257601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f294680c740 1 -- 172.21.15.114:0/3364937627 >> 172.21.15.114:0/3364937627 conn(0x559d256cde40 msgr2=0x559d257158d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f294680c740 1 -- 172.21.15.114:0/3364937627 shutdown_connections 2023-11-04T01:41:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f294680c740 1 -- 172.21.15.114:0/3364937627 wait complete. 2023-11-04T01:41:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f294680c740 20 client.7941 trim_cache size 0 max 16384 2023-11-04T01:41:03.853 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:41:03.853 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:41:03.853 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 1, 2023-11-04T01:41:03.853 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 6298, 2023-11-04T01:41:03.853 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:41:03.853 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:41:03.853 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:41:03.854 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 63.268153503999997, 2023-11-04T01:41:03.854 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 63, 2023-11-04T01:41:03.854 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 100, 2023-11-04T01:41:03.854 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 100, 2023-11-04T01:41:03.854 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 77.840517219000006 2023-11-04T01:41:03.854 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:41:03.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f2943b9e640 1 -- 172.21.15.114:0/1593917380 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f292006aea0 msgr2=0x7f292006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f2943b9e640 1 --2- 172.21.15.114:0/1593917380 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f292006aea0 0x7f292006d360 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f293c0c9b20 tx=0x7f2938008040 comp rx=0 tx=0).stop 2023-11-04T01:41:03.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f2943b9e640 1 -- 172.21.15.114:0/1593917380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f293c0b04a0 msgr2=0x7f293c0b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f2943b9e640 1 --2- 172.21.15.114:0/1593917380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f293c0b04a0 0x7f293c0b0930 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f2934009f40 tx=0x7f2934004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:03.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f2943b9e640 1 -- 172.21.15.114:0/1593917380 shutdown_connections 2023-11-04T01:41:03.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f2943b9e640 1 --2- 172.21.15.114:0/1593917380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f293c0b04a0 0x7f293c0b0930 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f2943b9e640 1 --2- 172.21.15.114:0/1593917380 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f292006aea0 0x7f292006d360 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f2943b9e640 1 --2- 172.21.15.114:0/1593917380 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f293c15e3f0 0x7f293c0c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f2943b9e640 1 --2- 172.21.15.114:0/1593917380 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f293c0cc300 0x7f293c150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.842+0000 7f2943b9e640 1 -- 172.21.15.114:0/1593917380 >> 172.21.15.114:0/1593917380 conn(0x7f293c071820 msgr2=0x7f293c0b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.843+0000 7f2943b9e640 1 -- 172.21.15.114:0/1593917380 shutdown_connections 2023-11-04T01:41:03.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.843+0000 7f2943b9e640 1 -- 172.21.15.114:0/1593917380 wait complete. 2023-11-04T01:41:03.856 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:41:03.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.955+0000 7f599af90640 1 Processor -- start 2023-11-04T01:41:03.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.955+0000 7f599af90640 1 -- start start 2023-11-04T01:41:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.956+0000 7f599af90640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f599415ad40 0x7f599406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.956+0000 7f599af90640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f599415b120 0x7f599415f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.956+0000 7f599af90640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f59940c9b60 0x7f5994070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.956+0000 7f599af90640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599406bc40 con 0x7f599415ad40 2023-11-04T01:41:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.956+0000 7f599af90640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5994065df0 con 0x7f59940c9b60 2023-11-04T01:41:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.956+0000 7f599af90640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599415f910 con 0x7f599415b120 2023-11-04T01:41:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.956+0000 7f5998d2c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f599415ad40 0x7f599406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.956+0000 7f5998d2c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f599415ad40 0x7f599406b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44522/0 (socket says 172.21.15.114:44522) 2023-11-04T01:41:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.956+0000 7f5998d2c640 1 -- 172.21.15.114:0/2706849696 learned_addr learned my addr 172.21.15.114:0/2706849696 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.956+0000 7f5998d2c640 1 -- 172.21.15.114:0/2706849696 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f599415b120 msgr2=0x7f599415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.956+0000 7f5998d2c640 1 --2- 172.21.15.114:0/2706849696 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f599415b120 0x7f599415f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.956+0000 7f5998d2c640 1 -- 172.21.15.114:0/2706849696 >> v2:172.21.15.141:3300/0 conn(0x7f59940c9b60 msgr2=0x7f5994070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.956+0000 7f5998d2c640 1 --2- 172.21.15.114:0/2706849696 >> v2:172.21.15.141:3300/0 conn(0x7f59940c9b60 0x7f5994070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.956+0000 7f5998d2c640 1 -- 172.21.15.114:0/2706849696 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5994066040 con 0x7f599415ad40 2023-11-04T01:41:03.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.957+0000 7f5998d2c640 1 --2- 172.21.15.114:0/2706849696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f599415ad40 0x7f599406b700 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f599406e130 tx=0x7f598402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f328adc81abacf3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.957+0000 7f59937fe640 1 -- 172.21.15.114:0/2706849696 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984031870 con 0x7f599415ad40 2023-11-04T01:41:03.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.957+0000 7f59937fe640 1 -- 172.21.15.114:0/2706849696 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59840319d0 con 0x7f599415ad40 2023-11-04T01:41:03.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.957+0000 7f59937fe640 1 -- 172.21.15.114:0/2706849696 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984031d60 con 0x7f599415ad40 2023-11-04T01:41:03.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.958+0000 7f599af90640 1 -- 172.21.15.114:0/2706849696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f599415ad40 msgr2=0x7f599406b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.958+0000 7f599af90640 1 --2- 172.21.15.114:0/2706849696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f599415ad40 0x7f599406b700 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f599406e130 tx=0x7f598402b910 comp rx=0 tx=0).stop 2023-11-04T01:41:03.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.958+0000 7f599af90640 1 -- 172.21.15.114:0/2706849696 shutdown_connections 2023-11-04T01:41:03.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.958+0000 7f599af90640 1 --2- 172.21.15.114:0/2706849696 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f599415b120 0x7f599415f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.958+0000 7f599af90640 1 --2- 172.21.15.114:0/2706849696 >> v2:172.21.15.141:3300/0 conn(0x7f59940c9b60 0x7f5994070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.958+0000 7f599af90640 1 --2- 172.21.15.114:0/2706849696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f599415ad40 0x7f599406b700 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.958+0000 7f599af90640 1 -- 172.21.15.114:0/2706849696 >> 172.21.15.114:0/2706849696 conn(0x7f59940cbc90 msgr2=0x7f59940cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.958+0000 7f599af90640 1 -- 172.21.15.114:0/2706849696 shutdown_connections 2023-11-04T01:41:03.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.958+0000 7f599af90640 1 -- 172.21.15.114:0/2706849696 wait complete. 2023-11-04T01:41:03.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.959+0000 7f599af90640 1 Processor -- start 2023-11-04T01:41:03.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.959+0000 7f599af90640 1 -- start start 2023-11-04T01:41:03.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f599af90640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f59940c9b60 0x7f59940c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f599af90640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f599415ad40 0x7f59940c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f599af90640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f599415b120 0x7f59941f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f599af90640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599414dab0 con 0x7f599415b120 2023-11-04T01:41:03.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f599af90640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599414f450 con 0x7f59940c9b60 2023-11-04T01:41:03.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f599af90640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599414ce30 con 0x7f599415ad40 2023-11-04T01:41:03.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f599952d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f599415b120 0x7f59941f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f599952d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f599415b120 0x7f59941f0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44532/0 (socket says 172.21.15.114:44532) 2023-11-04T01:41:03.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f599952d640 1 -- 172.21.15.114:0/790164896 learned_addr learned my addr 172.21.15.114:0/790164896 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:03.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f599952d640 1 -- 172.21.15.114:0/790164896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f599415ad40 msgr2=0x7f59940c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f599952d640 1 --2- 172.21.15.114:0/790164896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f599415ad40 0x7f59940c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f599952d640 1 -- 172.21.15.114:0/790164896 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f59940c9b60 msgr2=0x7f59940c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f599952d640 1 --2- 172.21.15.114:0/790164896 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f59940c9b60 0x7f59940c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f599952d640 1 -- 172.21.15.114:0/790164896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59840094d0 con 0x7f599415b120 2023-11-04T01:41:03.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f599952d640 1 --2- 172.21.15.114:0/790164896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f599415b120 0x7f59941f0cf0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f598c00b9e0 tx=0x7f598c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f59917fa640 1 -- 172.21.15.114:0/790164896 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c00cb20 con 0x7f599415b120 2023-11-04T01:41:03.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.960+0000 7f59917fa640 1 -- 172.21.15.114:0/790164896 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598c00cc80 con 0x7f599415b120 2023-11-04T01:41:03.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.961+0000 7f599af90640 1 -- 172.21.15.114:0/790164896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599414d110 con 0x7f599415b120 2023-11-04T01:41:03.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.961+0000 7f59917fa640 1 -- 172.21.15.114:0/790164896 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c014680 con 0x7f599415b120 2023-11-04T01:41:03.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.961+0000 7f599af90640 1 -- 172.21.15.114:0/790164896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599414d6d0 con 0x7f599415b120 2023-11-04T01:41:03.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.962+0000 7f59917fa640 1 -- 172.21.15.114:0/790164896 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f598c01d3b0 con 0x7f599415b120 2023-11-04T01:41:03.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.962+0000 7f59917fa640 1 --2- 172.21.15.114:0/790164896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f598006aea0 0x7f598006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.962+0000 7f59917fa640 1 -- 172.21.15.114:0/790164896 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f598c089ba0 con 0x7f599415b120 2023-11-04T01:41:03.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.962+0000 7f5998d2c640 1 --2- 172.21.15.114:0/790164896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f598006aea0 0x7f598006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.963+0000 7f5998d2c640 1 --2- 172.21.15.114:0/790164896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f598006aea0 0x7f598006d360 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5984036000 tx=0x7f5984030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.963+0000 7f599dc02740 1 Processor -- start 2023-11-04T01:41:03.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.963+0000 7f599dc02740 1 -- start start 2023-11-04T01:41:03.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.964+0000 7f599dc02740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf35d850 0x55d4bf330750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.964+0000 7f599dc02740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf35dc30 0x55d4bf3605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.964+0000 7f599dc02740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf330c90 0x55d4bf360b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.964+0000 7f599dc02740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bf241740 con 0x55d4bf35d850 2023-11-04T01:41:03.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.964+0000 7f599dc02740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bf2a38d0 con 0x55d4bf330c90 2023-11-04T01:41:03.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.964+0000 7f599dc02740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4bf2a0fc0 con 0x55d4bf35dc30 2023-11-04T01:41:03.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.964+0000 7f5998d2c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf35d850 0x55d4bf330750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.964+0000 7f5998d2c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf35d850 0x55d4bf330750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44546/0 (socket says 172.21.15.114:44546) 2023-11-04T01:41:03.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.964+0000 7f5998d2c640 1 -- 172.21.15.114:0/1098555545 learned_addr learned my addr 172.21.15.114:0/1098555545 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:03.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.964+0000 7f5998d2c640 1 -- 172.21.15.114:0/1098555545 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf35dc30 msgr2=0x55d4bf3605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.964+0000 7f5998d2c640 1 --2- 172.21.15.114:0/1098555545 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf35dc30 0x55d4bf3605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.964+0000 7f5998d2c640 1 -- 172.21.15.114:0/1098555545 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf330c90 msgr2=0x55d4bf360b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.964+0000 7f5998d2c640 1 --2- 172.21.15.114:0/1098555545 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf330c90 0x55d4bf360b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.964+0000 7f5998d2c640 1 -- 172.21.15.114:0/1098555545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4bf25fca0 con 0x55d4bf35d850 2023-11-04T01:41:03.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.964+0000 7f5998d2c640 1 --2- 172.21.15.114:0/1098555545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf35d850 0x55d4bf330750 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f5984031c40 tx=0x7f5984031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af43b1714d612047 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.965+0000 7f597a7fc640 1 -- 172.21.15.114:0/1098555545 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598403a9a0 con 0x55d4bf35d850 2023-11-04T01:41:03.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.965+0000 7f597a7fc640 1 -- 172.21.15.114:0/1098555545 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598404a070 con 0x55d4bf35d850 2023-11-04T01:41:03.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.965+0000 7f597a7fc640 1 -- 172.21.15.114:0/1098555545 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598403ad00 con 0x55d4bf35d850 2023-11-04T01:41:03.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.965+0000 7f599dc02740 1 -- 172.21.15.114:0/1098555545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf35d850 msgr2=0x55d4bf330750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.965+0000 7f599dc02740 1 --2- 172.21.15.114:0/1098555545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf35d850 0x55d4bf330750 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f5984031c40 tx=0x7f5984031000 comp rx=0 tx=0).stop 2023-11-04T01:41:03.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.965+0000 7f599dc02740 1 -- 172.21.15.114:0/1098555545 shutdown_connections 2023-11-04T01:41:03.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.965+0000 7f599dc02740 1 --2- 172.21.15.114:0/1098555545 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf330c90 0x55d4bf360b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.965+0000 7f599dc02740 1 --2- 172.21.15.114:0/1098555545 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf35dc30 0x55d4bf3605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.965+0000 7f599dc02740 1 --2- 172.21.15.114:0/1098555545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf35d850 0x55d4bf330750 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.965+0000 7f599dc02740 1 -- 172.21.15.114:0/1098555545 >> 172.21.15.114:0/1098555545 conn(0x55d4bf332a60 msgr2=0x55d4bf37b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.965+0000 7f599dc02740 1 -- 172.21.15.114:0/1098555545 shutdown_connections 2023-11-04T01:41:03.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.965+0000 7f599dc02740 1 -- 172.21.15.114:0/1098555545 wait complete. 2023-11-04T01:41:03.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.966+0000 7f599dc02740 1 -- start start 2023-11-04T01:41:03.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.966+0000 7f599dc02740 1 Processor -- start 2023-11-04T01:41:03.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599dc02740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35d850 0x55d4bf367860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599dc02740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf35dc30 0x55d4bf3620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599dc02740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf3625f0 0x55d4bf350570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599dc02740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bf29c8b0 con 0x55d4bf3625f0 2023-11-04T01:41:03.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599dc02740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bf256c80 con 0x55d4bf35d850 2023-11-04T01:41:03.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599dc02740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4bf256920 con 0x55d4bf35dc30 2023-11-04T01:41:03.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599dc02740 10 client.0 _ll_register_callbacks cb 0x55d4befaeac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:03.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599952d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf3625f0 0x55d4bf350570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599952d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf3625f0 0x55d4bf350570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44554/0 (socket says 172.21.15.114:44554) 2023-11-04T01:41:03.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599952d640 1 -- 172.21.15.114:0/1692078554 learned_addr learned my addr 172.21.15.114:0/1692078554 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:03.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f5998d2c640 1 --2- 172.21.15.114:0/1692078554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35d850 0x55d4bf367860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f5993fff640 1 --2- 172.21.15.114:0/1692078554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf35dc30 0x55d4bf3620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599952d640 1 -- 172.21.15.114:0/1692078554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf35dc30 msgr2=0x55d4bf3620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599952d640 1 --2- 172.21.15.114:0/1692078554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf35dc30 0x55d4bf3620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599952d640 1 -- 172.21.15.114:0/1692078554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35d850 msgr2=0x55d4bf367860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599952d640 1 --2- 172.21.15.114:0/1692078554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35d850 0x55d4bf367860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599952d640 1 -- 172.21.15.114:0/1692078554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5984040070 con 0x55d4bf3625f0 2023-11-04T01:41:03.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599952d640 1 --2- 172.21.15.114:0/1692078554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf3625f0 0x55d4bf350570 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f598c060070 tx=0x7f598c058360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d90f92d5b6c0849 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f59737fe640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:41:03.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f59737fe640 1 -- 172.21.15.114:0/1692078554 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c05e050 con 0x55d4bf3625f0 2023-11-04T01:41:03.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f59737fe640 1 -- 172.21.15.114:0/1692078554 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f598c057790 con 0x55d4bf3625f0 2023-11-04T01:41:03.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.967+0000 7f599dc02740 1 -- 172.21.15.114:0/1692078554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4bf248bf0 con 0x55d4bf3625f0 2023-11-04T01:41:03.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.968+0000 7f59737fe640 1 -- 172.21.15.114:0/1692078554 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f598c057990 con 0x55d4bf3625f0 2023-11-04T01:41:03.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.968+0000 7f599dc02740 10 client.7953 fetch_fsmap learned FSMap version 63 2023-11-04T01:41:03.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.968+0000 7f599dc02740 1 -- 172.21.15.114:0/1692078554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55d4bf29af30 con 0x55d4bf3625f0 2023-11-04T01:41:03.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.968+0000 7f59737fe640 1 -- 172.21.15.114:0/1692078554 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4bf248bf0 con 0x55d4bf3625f0 2023-11-04T01:41:03.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.968+0000 7f59737fe640 1 -- 172.21.15.114:0/1692078554 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 63) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f598c060110 con 0x55d4bf3625f0 2023-11-04T01:41:03.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.968+0000 7f599dc02740 10 client.7953 fetch_fsmap finished waiting for FSMap version 63 2023-11-04T01:41:03.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.968+0000 7f599dc02740 10 client.7953 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:41:03.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.968+0000 7f599dc02740 20 client.7953 populate_metadata read hostname 'smithi114' 2023-11-04T01:41:03.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.968+0000 7f599dc02740 1 --2- 172.21.15.114:0/1692078554 >> [v2:172.21.15.114:6834/2722332212,v1:172.21.15.114:6836/2722332212] conn(0x55d4bf38f280 0x55d4bf365b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.968+0000 7f599dc02740 4 client.7953 mds_command: new command op to 7773 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:41:03.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.968+0000 7f599dc02740 1 -- 172.21.15.114:0/1692078554 --> [v2:172.21.15.114:6834/2722332212,v1:172.21.15.114:6836/2722332212] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4bf295890 con 0x55d4bf38f280 2023-11-04T01:41:03.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.968+0000 7f5998d2c640 1 --2- 172.21.15.114:0/1692078554 >> [v2:172.21.15.114:6834/2722332212,v1:172.21.15.114:6836/2722332212] conn(0x55d4bf38f280 0x55d4bf365b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.968+0000 7f5998d2c640 1 --2- 172.21.15.114:0/1692078554 >> [v2:172.21.15.114:6834/2722332212,v1:172.21.15.114:6836/2722332212] conn(0x55d4bf38f280 0x55d4bf365b90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb092320bda0d795 server_cookie=3c80280a9189f58a in_seq=0 out_seq=0 2023-11-04T01:41:03.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.968+0000 7f59737fe640 10 client.7953 ms_handle_connect on v2:172.21.15.114:6834/2722332212 2023-11-04T01:41:03.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.969+0000 7f59737fe640 1 -- 172.21.15.114:0/1692078554 <== mds.0 v2:172.21.15.114:6834/2722332212 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d4bf295890 con 0x55d4bf38f280 2023-11-04T01:41:03.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.969+0000 7f59737fe640 10 client.7953 handle_command_reply: tid=0 2023-11-04T01:41:03.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.969+0000 7f599dc02740 1 client.7953 shutdown 2023-11-04T01:41:03.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.969+0000 7f599dc02740 1 -- 172.21.15.114:0/1692078554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf3625f0 msgr2=0x55d4bf350570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.969+0000 7f599dc02740 1 --2- 172.21.15.114:0/1692078554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf3625f0 0x55d4bf350570 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f598c060070 tx=0x7f598c058360 comp rx=0 tx=0).stop 2023-11-04T01:41:03.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.969+0000 7f599dc02740 1 -- 172.21.15.114:0/1692078554 shutdown_connections 2023-11-04T01:41:03.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.969+0000 7f599dc02740 1 --2- 172.21.15.114:0/1692078554 >> [v2:172.21.15.114:6834/2722332212,v1:172.21.15.114:6836/2722332212] conn(0x55d4bf38f280 0x55d4bf365b90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.969+0000 7f599dc02740 1 --2- 172.21.15.114:0/1692078554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf3625f0 0x55d4bf350570 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.969+0000 7f59737fe640 0 client.7953 ms_handle_reset on v2:172.21.15.114:6834/2722332212 2023-11-04T01:41:03.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.969+0000 7f599dc02740 1 --2- 172.21.15.114:0/1692078554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf35dc30 0x55d4bf3620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.969+0000 7f599dc02740 1 --2- 172.21.15.114:0/1692078554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35d850 0x55d4bf367860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.969+0000 7f599dc02740 1 -- 172.21.15.114:0/1692078554 >> 172.21.15.114:0/1692078554 conn(0x55d4bf330c90 msgr2=0x55d4bf334860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.969+0000 7f599dc02740 1 -- 172.21.15.114:0/1692078554 shutdown_connections 2023-11-04T01:41:03.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.969+0000 7f599dc02740 1 -- 172.21.15.114:0/1692078554 wait complete. 2023-11-04T01:41:03.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.969+0000 7f599dc02740 20 client.7953 trim_cache size 0 max 16384 2023-11-04T01:41:03.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.985+0000 7f599dc02740 1 Processor -- start 2023-11-04T01:41:03.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.985+0000 7f599dc02740 1 -- start start 2023-11-04T01:41:03.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.985+0000 7f599dc02740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf35d850 0x55d4bf363d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.985+0000 7f599dc02740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35dc30 0x55d4bf361950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.985+0000 7f599dc02740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf3625f0 0x55d4bf361e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.985+0000 7f599dc02740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bf21c280 con 0x55d4bf35d850 2023-11-04T01:41:03.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.985+0000 7f599dc02740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bf277eb0 con 0x55d4bf35dc30 2023-11-04T01:41:03.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.985+0000 7f599dc02740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4bf3300e0 con 0x55d4bf3625f0 2023-11-04T01:41:03.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.986+0000 7f5998d2c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf35d850 0x55d4bf363d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.986+0000 7f5998d2c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf35d850 0x55d4bf363d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44564/0 (socket says 172.21.15.114:44564) 2023-11-04T01:41:03.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.986+0000 7f5998d2c640 1 -- 172.21.15.114:0/3570873154 learned_addr learned my addr 172.21.15.114:0/3570873154 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:03.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.986+0000 7f5998d2c640 1 -- 172.21.15.114:0/3570873154 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf3625f0 msgr2=0x55d4bf361e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.986+0000 7f5998d2c640 1 --2- 172.21.15.114:0/3570873154 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf3625f0 0x55d4bf361e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.986+0000 7f5998d2c640 1 -- 172.21.15.114:0/3570873154 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35dc30 msgr2=0x55d4bf361950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.986+0000 7f5993fff640 1 --2- 172.21.15.114:0/3570873154 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35dc30 0x55d4bf361950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.986+0000 7f5998d2c640 1 --2- 172.21.15.114:0/3570873154 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35dc30 0x55d4bf361950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.986+0000 7f5998d2c640 1 -- 172.21.15.114:0/3570873154 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4bf238d10 con 0x55d4bf35d850 2023-11-04T01:41:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.986+0000 7f5993fff640 1 --2- 172.21.15.114:0/3570873154 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35dc30 0x55d4bf361950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.986+0000 7f5998d2c640 1 --2- 172.21.15.114:0/3570873154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf35d850 0x55d4bf363d50 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f598402bf20 tx=0x7f598403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd24ec6091d78cb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.986+0000 7f597affd640 1 -- 172.21.15.114:0/3570873154 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598403a9a0 con 0x55d4bf35d850 2023-11-04T01:41:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.986+0000 7f597affd640 1 -- 172.21.15.114:0/3570873154 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598403ab00 con 0x55d4bf35d850 2023-11-04T01:41:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.986+0000 7f597affd640 1 -- 172.21.15.114:0/3570873154 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598403ae70 con 0x55d4bf35d850 2023-11-04T01:41:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.987+0000 7f599dc02740 1 -- 172.21.15.114:0/3570873154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf35d850 msgr2=0x55d4bf363d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.987+0000 7f599dc02740 1 --2- 172.21.15.114:0/3570873154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf35d850 0x55d4bf363d50 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f598402bf20 tx=0x7f598403d000 comp rx=0 tx=0).stop 2023-11-04T01:41:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.987+0000 7f599dc02740 1 -- 172.21.15.114:0/3570873154 shutdown_connections 2023-11-04T01:41:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.987+0000 7f599dc02740 1 --2- 172.21.15.114:0/3570873154 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf3625f0 0x55d4bf361e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.987+0000 7f599dc02740 1 --2- 172.21.15.114:0/3570873154 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35dc30 0x55d4bf361950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.987+0000 7f599dc02740 1 --2- 172.21.15.114:0/3570873154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf35d850 0x55d4bf363d50 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.987+0000 7f599dc02740 1 -- 172.21.15.114:0/3570873154 >> 172.21.15.114:0/3570873154 conn(0x55d4bf330c90 msgr2=0x55d4bf35af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.987+0000 7f599dc02740 1 -- 172.21.15.114:0/3570873154 shutdown_connections 2023-11-04T01:41:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.987+0000 7f599dc02740 1 -- 172.21.15.114:0/3570873154 wait complete. 2023-11-04T01:41:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.987+0000 7f599dc02740 1 -- start start 2023-11-04T01:41:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.987+0000 7f599dc02740 1 Processor -- start 2023-11-04T01:41:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.988+0000 7f599dc02740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf35d850 0x55d4bf3353c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.988+0000 7f599dc02740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35dc30 0x55d4bf3e3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.988+0000 7f599dc02740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf3625f0 0x55d4bf361900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.988+0000 7f599dc02740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bf38eac0 con 0x55d4bf3625f0 2023-11-04T01:41:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.988+0000 7f599dc02740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4bf3ea6f0 con 0x55d4bf35dc30 2023-11-04T01:41:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.988+0000 7f599dc02740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4bf35c5d0 con 0x55d4bf35d850 2023-11-04T01:41:03.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.988+0000 7f599dc02740 10 client.0 _ll_register_callbacks cb 0x7f59840096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:03.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.988+0000 7f599952d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf3625f0 0x55d4bf361900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.988+0000 7f599952d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf3625f0 0x55d4bf361900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44568/0 (socket says 172.21.15.114:44568) 2023-11-04T01:41:03.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.988+0000 7f599952d640 1 -- 172.21.15.114:0/4248797770 learned_addr learned my addr 172.21.15.114:0/4248797770 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:03.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.988+0000 7f5998d2c640 1 --2- 172.21.15.114:0/4248797770 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf35d850 0x55d4bf3353c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.988+0000 7f5993fff640 1 --2- 172.21.15.114:0/4248797770 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35dc30 0x55d4bf3e3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f599952d640 1 -- 172.21.15.114:0/4248797770 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf35d850 msgr2=0x55d4bf3353c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f599952d640 1 --2- 172.21.15.114:0/4248797770 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf35d850 0x55d4bf3353c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f599952d640 1 -- 172.21.15.114:0/4248797770 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35dc30 msgr2=0x55d4bf3e3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f599952d640 1 --2- 172.21.15.114:0/4248797770 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35dc30 0x55d4bf3e3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f599952d640 1 -- 172.21.15.114:0/4248797770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5984053040 con 0x55d4bf3625f0 2023-11-04T01:41:03.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f5993fff640 1 --2- 172.21.15.114:0/4248797770 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35dc30 0x55d4bf3e3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:03.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f599952d640 1 --2- 172.21.15.114:0/4248797770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf3625f0 0x55d4bf361900 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f598c089e80 tx=0x7f598c00c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc93220cccf853f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f59737fe640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:41:03.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f59737fe640 1 -- 172.21.15.114:0/4248797770 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c05e050 con 0x55d4bf3625f0 2023-11-04T01:41:03.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f59737fe640 1 -- 172.21.15.114:0/4248797770 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f598c06ed60 con 0x55d4bf3625f0 2023-11-04T01:41:03.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f599dc02740 1 -- 172.21.15.114:0/4248797770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f598404a070 con 0x55d4bf3625f0 2023-11-04T01:41:03.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f59737fe640 1 -- 172.21.15.114:0/4248797770 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f598c05e1b0 con 0x55d4bf3625f0 2023-11-04T01:41:03.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f599dc02740 10 client.7959 fetch_fsmap learned FSMap version 63 2023-11-04T01:41:03.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f599dc02740 1 -- 172.21.15.114:0/4248797770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55d4bf25e500 con 0x55d4bf3625f0 2023-11-04T01:41:03.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f59737fe640 1 -- 172.21.15.114:0/4248797770 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598404a070 con 0x55d4bf3625f0 2023-11-04T01:41:03.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f59737fe640 1 -- 172.21.15.114:0/4248797770 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 63) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f598c05e310 con 0x55d4bf3625f0 2023-11-04T01:41:03.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f599dc02740 10 client.7959 fetch_fsmap finished waiting for FSMap version 63 2023-11-04T01:41:03.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f599dc02740 10 client.7959 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:41:03.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f599dc02740 20 client.7959 populate_metadata read hostname 'smithi114' 2023-11-04T01:41:03.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f599dc02740 1 --2- 172.21.15.114:0/4248797770 >> [v2:172.21.15.114:6834/2722332212,v1:172.21.15.114:6836/2722332212] conn(0x55d4bf361f80 0x55d4bf3e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f599dc02740 4 client.7959 mds_command: new command op to 7773 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:41:03.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f599dc02740 1 -- 172.21.15.114:0/4248797770 --> [v2:172.21.15.114:6834/2722332212,v1:172.21.15.114:6836/2722332212] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d4bf2955b0 con 0x55d4bf361f80 2023-11-04T01:41:03.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.989+0000 7f5998d2c640 1 --2- 172.21.15.114:0/4248797770 >> [v2:172.21.15.114:6834/2722332212,v1:172.21.15.114:6836/2722332212] conn(0x55d4bf361f80 0x55d4bf3e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f59737fe640 10 client.7959 ms_handle_connect on v2:172.21.15.114:6834/2722332212 2023-11-04T01:41:03.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f5998d2c640 1 --2- 172.21.15.114:0/4248797770 >> [v2:172.21.15.114:6834/2722332212,v1:172.21.15.114:6836/2722332212] conn(0x55d4bf361f80 0x55d4bf3e98b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc95810ba443509 server_cookie=503c7f28268f9276 in_seq=0 out_seq=0 2023-11-04T01:41:03.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f59737fe640 1 -- 172.21.15.114:0/4248797770 <== mds.0 v2:172.21.15.114:6834/2722332212 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55d4bf2955b0 con 0x55d4bf361f80 2023-11-04T01:41:03.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f59737fe640 10 client.7959 handle_command_reply: tid=0 2023-11-04T01:41:03.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f599dc02740 1 client.7959 shutdown 2023-11-04T01:41:03.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f599dc02740 1 -- 172.21.15.114:0/4248797770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf3625f0 msgr2=0x55d4bf361900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f599dc02740 1 --2- 172.21.15.114:0/4248797770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf3625f0 0x55d4bf361900 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f598c089e80 tx=0x7f598c00c5e0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f599dc02740 1 -- 172.21.15.114:0/4248797770 shutdown_connections 2023-11-04T01:41:03.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f599dc02740 1 --2- 172.21.15.114:0/4248797770 >> [v2:172.21.15.114:6834/2722332212,v1:172.21.15.114:6836/2722332212] conn(0x55d4bf361f80 0x55d4bf3e98b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f599dc02740 1 --2- 172.21.15.114:0/4248797770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d4bf3625f0 0x55d4bf361900 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f599dc02740 1 --2- 172.21.15.114:0/4248797770 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d4bf35dc30 0x55d4bf3e3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f59737fe640 0 client.7959 ms_handle_reset on v2:172.21.15.114:6834/2722332212 2023-11-04T01:41:03.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f599dc02740 1 --2- 172.21.15.114:0/4248797770 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d4bf35d850 0x55d4bf3353c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f599dc02740 1 -- 172.21.15.114:0/4248797770 >> 172.21.15.114:0/4248797770 conn(0x55d4bf330c90 msgr2=0x55d4bf35af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f599dc02740 1 -- 172.21.15.114:0/4248797770 shutdown_connections 2023-11-04T01:41:03.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f599dc02740 1 -- 172.21.15.114:0/4248797770 wait complete. 2023-11-04T01:41:03.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.990+0000 7f599dc02740 20 client.7959 trim_cache size 0 max 16384 2023-11-04T01:41:03.999 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:41:04.000 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:41:04.000 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-11-04T01:41:04.000 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 7773, 2023-11-04T01:41:04.000 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:41:04.000 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:41:04.000 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:41:04.000 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 6.695609202, 2023-11-04T01:41:04.000 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 63, 2023-11-04T01:41:04.000 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 100, 2023-11-04T01:41:04.000 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 100, 2023-11-04T01:41:04.000 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 31.839475890999999 2023-11-04T01:41:04.000 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:41:04.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.991+0000 7f599af90640 1 -- 172.21.15.114:0/790164896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f598006aea0 msgr2=0x7f598006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.991+0000 7f599af90640 1 --2- 172.21.15.114:0/790164896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f598006aea0 0x7f598006d360 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5984036000 tx=0x7f5984030000 comp rx=0 tx=0).stop 2023-11-04T01:41:04.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.991+0000 7f599af90640 1 -- 172.21.15.114:0/790164896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f599415b120 msgr2=0x7f59941f0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.991+0000 7f599af90640 1 --2- 172.21.15.114:0/790164896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f599415b120 0x7f59941f0cf0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f598c00b9e0 tx=0x7f598c00bea0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.991+0000 7f599af90640 1 -- 172.21.15.114:0/790164896 shutdown_connections 2023-11-04T01:41:04.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.991+0000 7f599af90640 1 --2- 172.21.15.114:0/790164896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f599415b120 0x7f59941f0cf0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.991+0000 7f599af90640 1 --2- 172.21.15.114:0/790164896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f599415ad40 0x7f59940c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.991+0000 7f599af90640 1 --2- 172.21.15.114:0/790164896 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f598006aea0 0x7f598006d360 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.991+0000 7f599af90640 1 --2- 172.21.15.114:0/790164896 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f59940c9b60 0x7f59940c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.991+0000 7f599af90640 1 -- 172.21.15.114:0/790164896 >> 172.21.15.114:0/790164896 conn(0x7f59940cbc90 msgr2=0x7f599415b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:04.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.991+0000 7f599af90640 1 -- 172.21.15.114:0/790164896 shutdown_connections 2023-11-04T01:41:04.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:03.991+0000 7f599af90640 1 -- 172.21.15.114:0/790164896 wait complete. 2023-11-04T01:41:04.003 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:04.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.101+0000 7f9d02256640 1 Processor -- start 2023-11-04T01:41:04.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.101+0000 7f9d02256640 1 -- start start 2023-11-04T01:41:04.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.102+0000 7f9d02256640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9cfc0cda60 0x7f9cfc0ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.102+0000 7f9d02256640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9cfc070d40 0x7f9cfc06c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.102+0000 7f9d02256640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cc990 con 0x7f9cfc0b0cd0 2023-11-04T01:41:04.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.102+0000 7f9d02256640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc0ccc70 con 0x7f9cfc070d40 2023-11-04T01:41:04.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.102+0000 7f9d02256640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc0c9ce0 con 0x7f9cfc0cda60 2023-11-04T01:41:04.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.102+0000 7f9cfbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9cfc070d40 0x7f9cfc06c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.102+0000 7f9cfbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9cfc070d40 0x7f9cfc06c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44576/0 (socket says 172.21.15.114:44576) 2023-11-04T01:41:04.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.102+0000 7f9cfbfff640 1 -- 172.21.15.114:0/4121743049 learned_addr learned my addr 172.21.15.114:0/4121743049 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:04.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.102+0000 7f9cfb7fe640 1 --2- 172.21.15.114:0/4121743049 >> v2:172.21.15.141:3300/0 conn(0x7f9cfc0cda60 0x7f9cfc0ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.102+0000 7f9cfbfff640 1 -- 172.21.15.114:0/4121743049 >> v2:172.21.15.141:3300/0 conn(0x7f9cfc0cda60 msgr2=0x7f9cfc0ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:04.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.102+0000 7f9cfbfff640 1 --2- 172.21.15.114:0/4121743049 >> v2:172.21.15.141:3300/0 conn(0x7f9cfc0cda60 0x7f9cfc0ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.102+0000 7f9cfbfff640 1 -- 172.21.15.114:0/4121743049 >> v1:172.21.15.141:6789/0 conn(0x7f9cfc0b0cd0 legacy=0x7f9cfc070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.102+0000 7f9cfbfff640 1 -- 172.21.15.114:0/4121743049 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc0c9fc0 con 0x7f9cfc070d40 2023-11-04T01:41:04.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.103+0000 7f9cfbfff640 1 --2- 172.21.15.114:0/4121743049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cfc070d40 0x7f9cfc06c200 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0cf800 tx=0x7f9cf402d090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8af508118e31983 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.103+0000 7f9cfa7fc640 1 -- 172.21.15.114:0/4121743049 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf402da30 con 0x7f9cfc070d40 2023-11-04T01:41:04.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.103+0000 7f9cfa7fc640 1 -- 172.21.15.114:0/4121743049 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf402db90 con 0x7f9cfc070d40 2023-11-04T01:41:04.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.103+0000 7f9cfa7fc640 1 -- 172.21.15.114:0/4121743049 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4008500 con 0x7f9cfc070d40 2023-11-04T01:41:04.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.104+0000 7f9d02256640 1 -- 172.21.15.114:0/4121743049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cfc070d40 msgr2=0x7f9cfc06c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.104+0000 7f9d02256640 1 --2- 172.21.15.114:0/4121743049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cfc070d40 0x7f9cfc06c200 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0cf800 tx=0x7f9cf402d090 comp rx=0 tx=0).stop 2023-11-04T01:41:04.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.104+0000 7f9d02256640 1 -- 172.21.15.114:0/4121743049 shutdown_connections 2023-11-04T01:41:04.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.104+0000 7f9d02256640 1 --2- 172.21.15.114:0/4121743049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cfc070d40 0x7f9cfc06c200 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.104+0000 7f9d02256640 1 --2- 172.21.15.114:0/4121743049 >> v2:172.21.15.141:3300/0 conn(0x7f9cfc0cda60 0x7f9cfc0ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.104+0000 7f9d02256640 1 -- 172.21.15.114:0/4121743049 >> 172.21.15.114:0/4121743049 conn(0x7f9cfc0ce950 msgr2=0x7f9cfc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:04.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.104+0000 7f9d02256640 1 -- 172.21.15.114:0/4121743049 shutdown_connections 2023-11-04T01:41:04.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.104+0000 7f9d02256640 1 -- 172.21.15.114:0/4121743049 wait complete. 2023-11-04T01:41:04.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.105+0000 7f9d02256640 1 Processor -- start 2023-11-04T01:41:04.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.105+0000 7f9d02256640 1 -- start start 2023-11-04T01:41:04.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.106+0000 7f9d02256640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cfc070d40 0x7f9cfc14cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.106+0000 7f9d02256640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cfc0b0cd0 0x7f9cfc0c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.106+0000 7f9d02256640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cfc0cda60 0x7f9cfc1f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.106+0000 7f9d02256640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc15ab00 con 0x7f9cfc0cda60 2023-11-04T01:41:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.106+0000 7f9d02256640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc14d1e0 con 0x7f9cfc070d40 2023-11-04T01:41:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.106+0000 7f9d02256640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc159ef0 con 0x7f9cfc0b0cd0 2023-11-04T01:41:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.106+0000 7f9cfbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cfc0cda60 0x7f9cfc1f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.106+0000 7f9cfbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cfc0cda60 0x7f9cfc1f2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44578/0 (socket says 172.21.15.114:44578) 2023-11-04T01:41:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.106+0000 7f9cfbfff640 1 -- 172.21.15.114:0/3269248236 learned_addr learned my addr 172.21.15.114:0/3269248236 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.106+0000 7f9cfbfff640 1 -- 172.21.15.114:0/3269248236 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cfc0b0cd0 msgr2=0x7f9cfc0c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.106+0000 7f9cfbfff640 1 --2- 172.21.15.114:0/3269248236 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cfc0b0cd0 0x7f9cfc0c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.106+0000 7f9cfbfff640 1 -- 172.21.15.114:0/3269248236 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cfc070d40 msgr2=0x7f9cfc14cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.106+0000 7f9cfb7fe640 1 --2- 172.21.15.114:0/3269248236 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cfc070d40 0x7f9cfc14cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.106+0000 7f9cfbfff640 1 --2- 172.21.15.114:0/3269248236 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cfc070d40 0x7f9cfc14cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.106+0000 7f9cfbfff640 1 -- 172.21.15.114:0/3269248236 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf400ac40 con 0x7f9cfc0cda60 2023-11-04T01:41:04.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.107+0000 7f9cfbfff640 1 --2- 172.21.15.114:0/3269248236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cfc0cda60 0x7f9cfc1f2470 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4037040 tx=0x7f9cf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.107+0000 7f9ce3fff640 1 -- 172.21.15.114:0/3269248236 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf402da30 con 0x7f9cfc0cda60 2023-11-04T01:41:04.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.107+0000 7f9ce3fff640 1 -- 172.21.15.114:0/3269248236 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf4040690 con 0x7f9cfc0cda60 2023-11-04T01:41:04.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.107+0000 7f9d02256640 1 -- 172.21.15.114:0/3269248236 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc15a1d0 con 0x7f9cfc0cda60 2023-11-04T01:41:04.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.107+0000 7f9ce3fff640 1 -- 172.21.15.114:0/3269248236 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4040a40 con 0x7f9cfc0cda60 2023-11-04T01:41:04.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.107+0000 7f9d02256640 1 -- 172.21.15.114:0/3269248236 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cfc15a790 con 0x7f9cfc0cda60 2023-11-04T01:41:04.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.108+0000 7f9d02256640 1 -- 172.21.15.114:0/3269248236 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cfc15acb0 con 0x7f9cfc0cda60 2023-11-04T01:41:04.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.109+0000 7f9ce3fff640 1 -- 172.21.15.114:0/3269248236 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9cf4040ba0 con 0x7f9cfc0cda60 2023-11-04T01:41:04.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.109+0000 7f9ce3fff640 1 --2- 172.21.15.114:0/3269248236 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ce806ae70 0x7f9ce806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.109+0000 7f9ce3fff640 1 -- 172.21.15.114:0/3269248236 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f9cf40ad160 con 0x7f9cfc0cda60 2023-11-04T01:41:04.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.109+0000 7f9cfb7fe640 1 --2- 172.21.15.114:0/3269248236 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ce806ae70 0x7f9ce806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.110+0000 7f9cfb7fe640 1 --2- 172.21.15.114:0/3269248236 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ce806ae70 0x7f9ce806d330 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009a10 tx=0x7f9cec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.114+0000 7f9ce3fff640 1 -- 172.21.15.114:0/3269248236 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9cfc15acb0 con 0x7f9cfc0cda60 2023-11-04T01:41:04.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.315+0000 7f9d02256640 1 -- 172.21.15.114:0/3269248236 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cfc074290 con 0x7f9cfc0cda60 2023-11-04T01:41:04.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.316+0000 7f9ce3fff640 1 -- 172.21.15.114:0/3269248236 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f9cf4077c40 con 0x7f9cfc0cda60 2023-11-04T01:41:04.318 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:04.318 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:00.303070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7773,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7773":{"gid":7773,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:04.318 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 63 2023-11-04T01:41:04.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.318+0000 7f9d02256640 1 -- 172.21.15.114:0/3269248236 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ce806ae70 msgr2=0x7f9ce806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.318+0000 7f9d02256640 1 --2- 172.21.15.114:0/3269248236 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ce806ae70 0x7f9ce806d330 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009a10 tx=0x7f9cec008040 comp rx=0 tx=0).stop 2023-11-04T01:41:04.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.318+0000 7f9d02256640 1 -- 172.21.15.114:0/3269248236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cfc0cda60 msgr2=0x7f9cfc1f2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.318+0000 7f9d02256640 1 --2- 172.21.15.114:0/3269248236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cfc0cda60 0x7f9cfc1f2470 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4037040 tx=0x7f9cf4004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:04.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.318+0000 7f9d02256640 1 -- 172.21.15.114:0/3269248236 shutdown_connections 2023-11-04T01:41:04.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.318+0000 7f9d02256640 1 --2- 172.21.15.114:0/3269248236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cfc0cda60 0x7f9cfc1f2470 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.318+0000 7f9d02256640 1 --2- 172.21.15.114:0/3269248236 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9cfc0b0cd0 0x7f9cfc0c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.318+0000 7f9d02256640 1 --2- 172.21.15.114:0/3269248236 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ce806ae70 0x7f9ce806d330 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.318+0000 7f9d02256640 1 --2- 172.21.15.114:0/3269248236 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9cfc070d40 0x7f9cfc14cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.318+0000 7f9d02256640 1 -- 172.21.15.114:0/3269248236 >> 172.21.15.114:0/3269248236 conn(0x7f9cfc0ce950 msgr2=0x7f9cfc158cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:04.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.318+0000 7f9d02256640 1 -- 172.21.15.114:0/3269248236 shutdown_connections 2023-11-04T01:41:04.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.318+0000 7f9d02256640 1 -- 172.21.15.114:0/3269248236 wait complete. 2023-11-04T01:41:04.330 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:41:04.443 INFO:teuthology.orchestra.run.smithi114.stdout:{"last_snap":3,"last_created":3,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:40:15.002825+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:40:40.232732+0000","name":"s12","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:41:04.444 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 3, "last_destroyed": 1, "last_snap": 3, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:40:15.002825+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:40:40.232732+0000" } ] } 2023-11-04T01:41:04.444 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:41:04.444 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=5 2023-11-04T01:41:04.444 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:04.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.542+0000 7f0adb59e640 1 Processor -- start 2023-11-04T01:41:04.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.542+0000 7f0adb59e640 1 -- start start 2023-11-04T01:41:04.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.543+0000 7f0adb59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0adc15e220 0x7f0adc0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.543+0000 7f0adb59e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0adc0cdf30 0x7f0adc0b2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.543+0000 7f0adb59e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0adc0c7860 con 0x7f0adc0b2950 2023-11-04T01:41:04.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.543+0000 7f0adb59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc0b2de0 con 0x7f0adc15e220 2023-11-04T01:41:04.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.543+0000 7f0adb59e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0cf110 con 0x7f0adc0cdf30 2023-11-04T01:41:04.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.543+0000 7f0ada59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0adc15e220 0x7f0adc0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.543+0000 7f0ada59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0adc15e220 0x7f0adc0b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44592/0 (socket says 172.21.15.114:44592) 2023-11-04T01:41:04.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.543+0000 7f0ada59c640 1 -- 172.21.15.114:0/2478488568 learned_addr learned my addr 172.21.15.114:0/2478488568 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:04.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.543+0000 7f0ada59c640 1 -- 172.21.15.114:0/2478488568 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0adc0cdf30 msgr2=0x7f0adc0b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:04.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.543+0000 7f0ada59c640 1 --2- 172.21.15.114:0/2478488568 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0adc0cdf30 0x7f0adc0b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.543+0000 7f0ada59c640 1 -- 172.21.15.114:0/2478488568 >> v1:172.21.15.141:6789/0 conn(0x7f0adc0b2950 legacy=0x7f0adc0cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:04.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.543+0000 7f0ada59c640 1 -- 172.21.15.114:0/2478488568 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0cbfb0 con 0x7f0adc15e220 2023-11-04T01:41:04.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.544+0000 7f0ada59c640 1 --2- 172.21.15.114:0/2478488568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc15e220 0x7f0adc0b3990 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009870 tx=0x7f0acc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a8f49dc2044b0a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.544+0000 7f0ad9d9b640 1 -- 172.21.15.114:0/2478488568 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc030840 con 0x7f0adc15e220 2023-11-04T01:41:04.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.544+0000 7f0ad9d9b640 1 -- 172.21.15.114:0/2478488568 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc0309a0 con 0x7f0adc15e220 2023-11-04T01:41:04.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.544+0000 7f0ad9d9b640 1 -- 172.21.15.114:0/2478488568 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc030d30 con 0x7f0adc15e220 2023-11-04T01:41:04.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.545+0000 7f0adb59e640 1 -- 172.21.15.114:0/2478488568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc15e220 msgr2=0x7f0adc0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.545+0000 7f0adb59e640 1 --2- 172.21.15.114:0/2478488568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc15e220 0x7f0adc0b3990 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009870 tx=0x7f0acc02b980 comp rx=0 tx=0).stop 2023-11-04T01:41:04.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.545+0000 7f0adb59e640 1 -- 172.21.15.114:0/2478488568 shutdown_connections 2023-11-04T01:41:04.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.545+0000 7f0adb59e640 1 --2- 172.21.15.114:0/2478488568 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0adc0cdf30 0x7f0adc0b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.545+0000 7f0adb59e640 1 --2- 172.21.15.114:0/2478488568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc15e220 0x7f0adc0b3990 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.545+0000 7f0adb59e640 1 -- 172.21.15.114:0/2478488568 >> 172.21.15.114:0/2478488568 conn(0x7f0adc0cd410 msgr2=0x7f0adc0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:04.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.545+0000 7f0adb59e640 1 -- 172.21.15.114:0/2478488568 shutdown_connections 2023-11-04T01:41:04.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.545+0000 7f0adb59e640 1 -- 172.21.15.114:0/2478488568 wait complete. 2023-11-04T01:41:04.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.546+0000 7f0adb59e640 1 Processor -- start 2023-11-04T01:41:04.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.546+0000 7f0adb59e640 1 -- start start 2023-11-04T01:41:04.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0adb59e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0adc0b2950 0x7f0adc152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0adb59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc0cdf30 0x7f0adc0c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0adb59e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0adc15e220 0x7f0adc0b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0adb59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0c9c40 con 0x7f0adc0cdf30 2023-11-04T01:41:04.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0adb59e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0c9f20 con 0x7f0adc15e220 2023-11-04T01:41:04.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0adb59e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0ca200 con 0x7f0adc0b2950 2023-11-04T01:41:04.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0ad3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc0cdf30 0x7f0adc0c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0ad3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc0cdf30 0x7f0adc0c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44600/0 (socket says 172.21.15.114:44600) 2023-11-04T01:41:04.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0ad3fff640 1 -- 172.21.15.114:0/1873168382 learned_addr learned my addr 172.21.15.114:0/1873168382 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:04.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0ad3fff640 1 -- 172.21.15.114:0/1873168382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0adc0b2950 msgr2=0x7f0adc152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0ad3fff640 1 --2- 172.21.15.114:0/1873168382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0adc0b2950 0x7f0adc152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0ad3fff640 1 -- 172.21.15.114:0/1873168382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0adc15e220 msgr2=0x7f0adc0b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0ad3fff640 1 --2- 172.21.15.114:0/1873168382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0adc15e220 0x7f0adc0b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0ad3fff640 1 -- 172.21.15.114:0/1873168382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc0094d0 con 0x7f0adc0cdf30 2023-11-04T01:41:04.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0ad3fff640 1 --2- 172.21.15.114:0/1873168382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc0cdf30 0x7f0adc0c9170 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f0ac400b4a0 tx=0x7f0ac400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0ad2ffd640 1 -- 172.21.15.114:0/1873168382 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac4010610 con 0x7f0adc0cdf30 2023-11-04T01:41:04.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0ad2ffd640 1 -- 172.21.15.114:0/1873168382 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac4010770 con 0x7f0adc0cdf30 2023-11-04T01:41:04.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0ad2ffd640 1 -- 172.21.15.114:0/1873168382 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac4010b20 con 0x7f0adc0cdf30 2023-11-04T01:41:04.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0adb59e640 1 -- 172.21.15.114:0/1873168382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc0ca4e0 con 0x7f0adc0cdf30 2023-11-04T01:41:04.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.547+0000 7f0adb59e640 1 -- 172.21.15.114:0/1873168382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc06ca50 con 0x7f0adc0cdf30 2023-11-04T01:41:04.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.548+0000 7f0adb59e640 1 -- 172.21.15.114:0/1873168382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0adc0caa00 con 0x7f0adc0cdf30 2023-11-04T01:41:04.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.549+0000 7f0ad2ffd640 1 -- 172.21.15.114:0/1873168382 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ac4010c80 con 0x7f0adc0cdf30 2023-11-04T01:41:04.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.549+0000 7f0ad2ffd640 1 --2- 172.21.15.114:0/1873168382 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0abc06ae70 0x7f0abc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.549+0000 7f0ad2ffd640 1 -- 172.21.15.114:0/1873168382 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f0ac4089850 con 0x7f0adc0cdf30 2023-11-04T01:41:04.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.549+0000 7f0ada59c640 1 --2- 172.21.15.114:0/1873168382 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0abc06ae70 0x7f0abc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.550+0000 7f0ada59c640 1 --2- 172.21.15.114:0/1873168382 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0abc06ae70 0x7f0abc06d330 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0acc036000 tx=0x7f0acc03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.553+0000 7f0ad2ffd640 1 -- 172.21.15.114:0/1873168382 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0adc0caa00 con 0x7f0adc0cdf30 2023-11-04T01:41:04.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.756+0000 7f0adb59e640 1 -- 172.21.15.114:0/1873168382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0adc0caa00 con 0x7f0adc0cdf30 2023-11-04T01:41:04.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.757+0000 7f0ad2ffd640 1 -- 172.21.15.114:0/1873168382 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f0adc0caa00 con 0x7f0adc0cdf30 2023-11-04T01:41:04.759 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:04.759 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:00.303070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7773,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7773":{"gid":7773,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:04.759 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 63 2023-11-04T01:41:04.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.759+0000 7f0adb59e640 1 -- 172.21.15.114:0/1873168382 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0abc06ae70 msgr2=0x7f0abc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.759+0000 7f0adb59e640 1 --2- 172.21.15.114:0/1873168382 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0abc06ae70 0x7f0abc06d330 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0acc036000 tx=0x7f0acc03b040 comp rx=0 tx=0).stop 2023-11-04T01:41:04.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.759+0000 7f0adb59e640 1 -- 172.21.15.114:0/1873168382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc0cdf30 msgr2=0x7f0adc0c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.759+0000 7f0adb59e640 1 --2- 172.21.15.114:0/1873168382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc0cdf30 0x7f0adc0c9170 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f0ac400b4a0 tx=0x7f0ac400b960 comp rx=0 tx=0).stop 2023-11-04T01:41:04.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.759+0000 7f0adb59e640 1 -- 172.21.15.114:0/1873168382 shutdown_connections 2023-11-04T01:41:04.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.759+0000 7f0adb59e640 1 --2- 172.21.15.114:0/1873168382 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0abc06ae70 0x7f0abc06d330 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.759+0000 7f0adb59e640 1 --2- 172.21.15.114:0/1873168382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0adc15e220 0x7f0adc0b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.759+0000 7f0adb59e640 1 --2- 172.21.15.114:0/1873168382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0adc0cdf30 0x7f0adc0c9170 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.759+0000 7f0adb59e640 1 --2- 172.21.15.114:0/1873168382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0adc0b2950 0x7f0adc152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.759+0000 7f0adb59e640 1 -- 172.21.15.114:0/1873168382 >> 172.21.15.114:0/1873168382 conn(0x7f0adc0cd410 msgr2=0x7f0adc0cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:04.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.759+0000 7f0adb59e640 1 -- 172.21.15.114:0/1873168382 shutdown_connections 2023-11-04T01:41:04.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.759+0000 7f0adb59e640 1 -- 172.21.15.114:0/1873168382 wait complete. 2023-11-04T01:41:04.771 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:41:04.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.870+0000 7f2830c1a640 1 Processor -- start 2023-11-04T01:41:04.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.870+0000 7f2830c1a640 1 -- start start 2023-11-04T01:41:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.871+0000 7f2830c1a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f282c159d40 0x7f282c0cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.871+0000 7f2830c1a640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f282c0cf420 0x7f282c0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.871+0000 7f2830c1a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282c0ca550 con 0x7f282c0c87d0 2023-11-04T01:41:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.871+0000 7f2830c1a640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282c0caeb0 con 0x7f282c0cf420 2023-11-04T01:41:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.871+0000 7f2830c1a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c06d060 con 0x7f282c159d40 2023-11-04T01:41:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.871+0000 7f2829d9b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f282c0c87d0 0x7f282c0ced10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48062/0 (socket says 172.21.15.114:48062) 2023-11-04T01:41:04.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.871+0000 7f2829d9b640 1 -- 172.21.15.114:0/1636720870 learned_addr learned my addr 172.21.15.114:0/1636720870 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:04.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282959a640 1 -- 172.21.15.114:0/1636720870 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348375837 0 0) 0x7f282c0ca550 con 0x7f282c0c87d0 2023-11-04T01:41:04.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282959a640 1 -- 172.21.15.114:0/1636720870 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2818003520 con 0x7f282c0c87d0 2023-11-04T01:41:04.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282ad9d640 1 --2- 172.21.15.114:0/1636720870 >> v2:172.21.15.141:3300/0 conn(0x7f282c0cf420 0x7f282c0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282a59c640 1 --2- 172.21.15.114:0/1636720870 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f282c159d40 0x7f282c0cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282959a640 1 -- 172.21.15.114:0/1636720870 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2287483837 0 0) 0x7f2818003520 con 0x7f282c0c87d0 2023-11-04T01:41:04.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282959a640 1 -- 172.21.15.114:0/1636720870 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f282c159d40 msgr2=0x7f282c0cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:04.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282959a640 1 --2- 172.21.15.114:0/1636720870 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f282c159d40 0x7f282c0cdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282959a640 1 -- 172.21.15.114:0/1636720870 >> v2:172.21.15.141:3300/0 conn(0x7f282c0cf420 msgr2=0x7f282c0cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:04.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282959a640 1 --2- 172.21.15.114:0/1636720870 >> v2:172.21.15.141:3300/0 conn(0x7f282c0cf420 0x7f282c0cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282959a640 1 -- 172.21.15.114:0/1636720870 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c0ce1b0 con 0x7f282c0c87d0 2023-11-04T01:41:04.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282959a640 1 -- 172.21.15.114:0/1636720870 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f2814001670 con 0x7f282c0c87d0 2023-11-04T01:41:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282ad9d640 1 --2- 172.21.15.114:0/1636720870 >> v2:172.21.15.141:3300/0 conn(0x7f282c0cf420 0x7f282c0cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282959a640 1 -- 172.21.15.114:0/1636720870 >> v1:172.21.15.114:6789/0 conn(0x7f282c0c87d0 legacy=0x7f282c0ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282959a640 1 --2- 172.21.15.114:0/1636720870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2818003970 0x7f2818003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282959a640 1 --2- 172.21.15.114:0/1636720870 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f282c159d40 0x7f28180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282959a640 1 --2- 172.21.15.114:0/1636720870 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2818004d00 0x7f2818005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282959a640 1 -- 172.21.15.114:0/1636720870 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0caeb0 con 0x7f2818003970 2023-11-04T01:41:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282959a640 1 -- 172.21.15.114:0/1636720870 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c06d060 con 0x7f2818004d00 2023-11-04T01:41:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282959a640 1 -- 172.21.15.114:0/1636720870 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281800ba30 con 0x7f282c159d40 2023-11-04T01:41:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282a59c640 1 --2- 172.21.15.114:0/1636720870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2818003970 0x7f2818003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f2829d9b640 1 --2- 172.21.15.114:0/1636720870 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f282c159d40 0x7f28180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282ad9d640 1 --2- 172.21.15.114:0/1636720870 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2818004d00 0x7f2818005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282a59c640 1 -- 172.21.15.114:0/1636720870 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f282c159d40 msgr2=0x7f28180047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:04.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282a59c640 1 --2- 172.21.15.114:0/1636720870 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f282c159d40 0x7f28180047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282a59c640 1 -- 172.21.15.114:0/1636720870 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2818004d00 msgr2=0x7f2818005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:04.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282a59c640 1 --2- 172.21.15.114:0/1636720870 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2818004d00 0x7f2818005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.872+0000 7f282a59c640 1 -- 172.21.15.114:0/1636720870 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2818003520 con 0x7f2818003970 2023-11-04T01:41:04.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.873+0000 7f282a59c640 1 --2- 172.21.15.114:0/1636720870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2818003970 0x7f2818003d90 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f2824009ac0 tx=0x7f28180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0471f1f59a2018 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.873+0000 7f282959a640 1 -- 172.21.15.114:0/1636720870 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282402c6b0 con 0x7f2818003970 2023-11-04T01:41:04.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.873+0000 7f282959a640 1 -- 172.21.15.114:0/1636720870 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282402c810 con 0x7f2818003970 2023-11-04T01:41:04.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.873+0000 7f282959a640 1 -- 172.21.15.114:0/1636720870 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282402cba0 con 0x7f2818003970 2023-11-04T01:41:04.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.874+0000 7f2830c1a640 1 -- 172.21.15.114:0/1636720870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2818003970 msgr2=0x7f2818003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.874+0000 7f2830c1a640 1 --2- 172.21.15.114:0/1636720870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2818003970 0x7f2818003d90 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f2824009ac0 tx=0x7f28180057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.874+0000 7f282ad9d640 1 -- 172.21.15.114:0/1636720870 reap_dead start 2023-11-04T01:41:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.874+0000 7f2830c1a640 1 -- 172.21.15.114:0/1636720870 shutdown_connections 2023-11-04T01:41:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.874+0000 7f2830c1a640 1 -- 172.21.15.114:0/1636720870 >> 172.21.15.114:0/1636720870 conn(0x7f282c0b1c50 msgr2=0x7f282c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.874+0000 7f2830c1a640 1 -- 172.21.15.114:0/1636720870 shutdown_connections 2023-11-04T01:41:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.874+0000 7f2830c1a640 1 -- 172.21.15.114:0/1636720870 wait complete. 2023-11-04T01:41:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.875+0000 7f2830c1a640 1 Processor -- start 2023-11-04T01:41:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.875+0000 7f2830c1a640 1 -- start start 2023-11-04T01:41:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f2830c1a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2818003970 0x7f282c1f1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f2830c1a640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f282c1edb00 0x7f282c0a9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f2830c1a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f282c15bdc0 0x7f282c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f2830c1a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c15b9c0 con 0x7f2818003970 2023-11-04T01:41:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f2830c1a640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0aa500 con 0x7f282c1edb00 2023-11-04T01:41:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f2830c1a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0a9c70 con 0x7f282c15bdc0 2023-11-04T01:41:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f282a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2818003970 0x7f282c1f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f282a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2818003970 0x7f282c1f1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44614/0 (socket says 172.21.15.114:44614) 2023-11-04T01:41:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f282a59c640 1 -- 172.21.15.114:0/1591737612 learned_addr learned my addr 172.21.15.114:0/1591737612 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f282ad9d640 1 --2- 172.21.15.114:0/1591737612 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f282c15bdc0 0x7f282c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f2829d9b640 1 --2- 172.21.15.114:0/1591737612 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f282c1edb00 0x7f282c0a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f282a59c640 1 -- 172.21.15.114:0/1591737612 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f282c15bdc0 msgr2=0x7f282c0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f282a59c640 1 --2- 172.21.15.114:0/1591737612 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f282c15bdc0 0x7f282c0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f282a59c640 1 -- 172.21.15.114:0/1591737612 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f282c1edb00 msgr2=0x7f282c0a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f282a59c640 1 --2- 172.21.15.114:0/1591737612 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f282c1edb00 0x7f282c0a9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f282a59c640 1 -- 172.21.15.114:0/1591737612 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c0a9f40 con 0x7f2818003970 2023-11-04T01:41:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f282a59c640 1 --2- 172.21.15.114:0/1591737612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2818003970 0x7f282c1f1260 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f282402c250 tx=0x7f2824004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f2822ffd640 1 -- 172.21.15.114:0/1591737612 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2824003810 con 0x7f2818003970 2023-11-04T01:41:04.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.876+0000 7f2822ffd640 1 -- 172.21.15.114:0/1591737612 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2824003970 con 0x7f2818003970 2023-11-04T01:41:04.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.877+0000 7f2830c1a640 1 -- 172.21.15.114:0/1591737612 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282c0aa220 con 0x7f2818003970 2023-11-04T01:41:04.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.877+0000 7f2822ffd640 1 -- 172.21.15.114:0/1591737612 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2824003ce0 con 0x7f2818003970 2023-11-04T01:41:04.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.877+0000 7f2830c1a640 1 -- 172.21.15.114:0/1591737612 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282c1edf60 con 0x7f2818003970 2023-11-04T01:41:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.878+0000 7f2830c1a640 1 -- 172.21.15.114:0/1591737612 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282c074290 con 0x7f2818003970 2023-11-04T01:41:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.878+0000 7f2822ffd640 1 -- 172.21.15.114:0/1591737612 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2824047450 con 0x7f2818003970 2023-11-04T01:41:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.878+0000 7f2822ffd640 1 --2- 172.21.15.114:0/1591737612 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f280c06ae70 0x7f280c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.878+0000 7f2822ffd640 1 -- 172.21.15.114:0/1591737612 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f28240abe60 con 0x7f2818003970 2023-11-04T01:41:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.878+0000 7f2829d9b640 1 --2- 172.21.15.114:0/1591737612 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f280c06ae70 0x7f280c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.879+0000 7f2829d9b640 1 --2- 172.21.15.114:0/1591737612 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f280c06ae70 0x7f280c06d330 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2814001eb0 tx=0x7f2814009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:04.883+0000 7f2822ffd640 1 -- 172.21.15.114:0/1591737612 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f28240769e0 con 0x7f2818003970 2023-11-04T01:41:05.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:05.114+0000 7f2830c1a640 1 -- 172.21.15.114:0/1591737612 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f282c0caac0 con 0x7f2818003970 2023-11-04T01:41:05.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:05.626+0000 7f2822ffd640 1 -- 172.21.15.114:0/1591737612 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7773 v64) v1 ==== 112+0+0 (secure 0 0 0) 0x7f28240044e0 con 0x7f2818003970 2023-11-04T01:41:05.628 INFO:teuthology.orchestra.run.smithi114.stderr:freezing mds.7773 2023-11-04T01:41:05.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:05.628+0000 7f2830c1a640 1 -- 172.21.15.114:0/1591737612 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f280c06ae70 msgr2=0x7f280c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:05.628+0000 7f2830c1a640 1 --2- 172.21.15.114:0/1591737612 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f280c06ae70 0x7f280c06d330 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2814001eb0 tx=0x7f2814009040 comp rx=0 tx=0).stop 2023-11-04T01:41:05.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:05.628+0000 7f2830c1a640 1 -- 172.21.15.114:0/1591737612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2818003970 msgr2=0x7f282c1f1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:05.628+0000 7f2830c1a640 1 --2- 172.21.15.114:0/1591737612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2818003970 0x7f282c1f1260 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f282402c250 tx=0x7f2824004730 comp rx=0 tx=0).stop 2023-11-04T01:41:05.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:05.628+0000 7f2830c1a640 1 -- 172.21.15.114:0/1591737612 shutdown_connections 2023-11-04T01:41:05.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:05.629+0000 7f2830c1a640 1 --2- 172.21.15.114:0/1591737612 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f282c15bdc0 0x7f282c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:05.629+0000 7f2830c1a640 1 --2- 172.21.15.114:0/1591737612 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f280c06ae70 0x7f280c06d330 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:05.629+0000 7f2830c1a640 1 --2- 172.21.15.114:0/1591737612 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f282c1edb00 0x7f282c0a9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:05.629+0000 7f2830c1a640 1 --2- 172.21.15.114:0/1591737612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2818003970 0x7f282c1f1260 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:05.629+0000 7f2830c1a640 1 -- 172.21.15.114:0/1591737612 >> 172.21.15.114:0/1591737612 conn(0x7f282c0b1c50 msgr2=0x7f282c158f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:05.629+0000 7f2830c1a640 1 -- 172.21.15.114:0/1591737612 shutdown_connections 2023-11-04T01:41:05.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:05.629+0000 7f2830c1a640 1 -- 172.21.15.114:0/1591737612 wait complete. 2023-11-04T01:41:05.643 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_kill_mdstable_at 5 2023-11-04T01:41:05.760 INFO:teuthology.orchestra.run.smithi114.stdout:{"success":"mds_kill_mdstable_at = '5' (not observed, change may require restart) "} 2023-11-04T01:41:05.760 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '5' (not observed, change may require restart) " } 2023-11-04T01:41:05.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:05.760 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s15) 2023-11-04T01:41:05.763 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:41:05.782 INFO:tasks.ceph.mds.c.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f03b5522640 time 2023-11-04T01:41:05.781579+0000 2023-11-04T01:41:05.782 INFO:tasks.ceph.mds.c.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:41:05.783 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:05.783 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f03bb16efaf] 2023-11-04T01:41:05.783 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f03bb16f16d] 2023-11-04T01:41:05.783 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x557f19c08187] 2023-11-04T01:41:05.784 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x557f199970a9] 2023-11-04T01:41:05.784 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x557f19999b2b] 2023-11-04T01:41:05.784 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557f1999a01c] 2023-11-04T01:41:05.784 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x557f19983325] 2023-11-04T01:41:05.784 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f03bb35ff9a] 2023-11-04T01:41:05.784 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f03bb3f1741] 2023-11-04T01:41:05.784 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f03ba89f802] 2023-11-04T01:41:05.784 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f03ba83f450] 2023-11-04T01:41:05.784 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:41:05.781+0000 7f03b5522640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f03b5522640 time 2023-11-04T01:41:05.781579+0000 2023-11-04T01:41:05.784 INFO:tasks.ceph.mds.c.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:41:05.784 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:05.784 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:05.784 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f03bb16efaf] 2023-11-04T01:41:05.785 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f03bb16f16d] 2023-11-04T01:41:05.785 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x557f19c08187] 2023-11-04T01:41:05.785 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x557f199970a9] 2023-11-04T01:41:05.785 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x557f19999b2b] 2023-11-04T01:41:05.785 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557f1999a01c] 2023-11-04T01:41:05.785 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x557f19983325] 2023-11-04T01:41:05.785 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f03bb35ff9a] 2023-11-04T01:41:05.785 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f03bb3f1741] 2023-11-04T01:41:05.785 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f03ba89f802] 2023-11-04T01:41:05.785 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f03ba83f450] 2023-11-04T01:41:05.785 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:05.785 INFO:tasks.ceph.mds.c.smithi114.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:41:05.785 INFO:tasks.ceph.mds.c.smithi114.stderr: in thread 7f03b5522640 thread_name:ms_dispatch 2023-11-04T01:41:05.787 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:05.787 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f03ba854db0] 2023-11-04T01:41:05.787 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f03ba8a154c] 2023-11-04T01:41:05.787 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: raise() 2023-11-04T01:41:05.787 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: abort() 2023-11-04T01:41:05.787 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f03bb16f009] 2023-11-04T01:41:05.787 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f03bb16f16d] 2023-11-04T01:41:05.787 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x557f19c08187] 2023-11-04T01:41:05.787 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x557f199970a9] 2023-11-04T01:41:05.787 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x557f19999b2b] 2023-11-04T01:41:05.787 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557f1999a01c] 2023-11-04T01:41:05.787 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x557f19983325] 2023-11-04T01:41:05.788 INFO:tasks.ceph.mds.c.smithi114.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f03bb35ff9a] 2023-11-04T01:41:05.788 INFO:tasks.ceph.mds.c.smithi114.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f03bb3f1741] 2023-11-04T01:41:05.788 INFO:tasks.ceph.mds.c.smithi114.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f03ba89f802] 2023-11-04T01:41:05.788 INFO:tasks.ceph.mds.c.smithi114.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f03ba83f450] 2023-11-04T01:41:05.788 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:41:05.781+0000 7f03b5522640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:05.788 INFO:tasks.ceph.mds.c.smithi114.stderr: in thread 7f03b5522640 thread_name:ms_dispatch 2023-11-04T01:41:05.788 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:05.788 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:05.788 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f03ba854db0] 2023-11-04T01:41:05.788 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f03ba8a154c] 2023-11-04T01:41:05.788 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: raise() 2023-11-04T01:41:05.788 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: abort() 2023-11-04T01:41:05.788 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f03bb16f009] 2023-11-04T01:41:05.789 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f03bb16f16d] 2023-11-04T01:41:05.789 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x557f19c08187] 2023-11-04T01:41:05.789 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x557f199970a9] 2023-11-04T01:41:05.789 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x557f19999b2b] 2023-11-04T01:41:05.789 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557f1999a01c] 2023-11-04T01:41:05.789 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x557f19983325] 2023-11-04T01:41:05.789 INFO:tasks.ceph.mds.c.smithi114.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f03bb35ff9a] 2023-11-04T01:41:05.789 INFO:tasks.ceph.mds.c.smithi114.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f03bb3f1741] 2023-11-04T01:41:05.789 INFO:tasks.ceph.mds.c.smithi114.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f03ba89f802] 2023-11-04T01:41:05.789 INFO:tasks.ceph.mds.c.smithi114.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f03ba83f450] 2023-11-04T01:41:05.789 INFO:tasks.ceph.mds.c.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:05.789 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:05.790 INFO:tasks.ceph.mds.c.smithi114.stderr: -200> 2023-11-04T01:41:03.072+0000 7f03b2d1d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:05.790 INFO:tasks.ceph.mds.c.smithi114.stderr: -198> 2023-11-04T01:41:03.072+0000 7f03b2d1d640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:05.790 INFO:tasks.ceph.mds.c.smithi114.stderr: -1> 2023-11-04T01:41:05.781+0000 7f03b5522640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f03b5522640 time 2023-11-04T01:41:05.781579+0000 2023-11-04T01:41:05.790 INFO:tasks.ceph.mds.c.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:41:05.790 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:05.790 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:05.790 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f03bb16efaf] 2023-11-04T01:41:05.790 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f03bb16f16d] 2023-11-04T01:41:05.790 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x557f19c08187] 2023-11-04T01:41:05.790 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x557f199970a9] 2023-11-04T01:41:05.790 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x557f19999b2b] 2023-11-04T01:41:05.790 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557f1999a01c] 2023-11-04T01:41:05.791 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x557f19983325] 2023-11-04T01:41:05.791 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f03bb35ff9a] 2023-11-04T01:41:05.791 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f03bb3f1741] 2023-11-04T01:41:05.791 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f03ba89f802] 2023-11-04T01:41:05.791 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f03ba83f450] 2023-11-04T01:41:05.791 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:05.791 INFO:tasks.ceph.mds.c.smithi114.stderr: 0> 2023-11-04T01:41:05.781+0000 7f03b5522640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:05.791 INFO:tasks.ceph.mds.c.smithi114.stderr: in thread 7f03b5522640 thread_name:ms_dispatch 2023-11-04T01:41:05.791 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:05.791 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:05.791 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f03ba854db0] 2023-11-04T01:41:05.791 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f03ba8a154c] 2023-11-04T01:41:05.791 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: raise() 2023-11-04T01:41:05.792 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: abort() 2023-11-04T01:41:05.792 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f03bb16f009] 2023-11-04T01:41:05.792 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f03bb16f16d] 2023-11-04T01:41:05.792 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x557f19c08187] 2023-11-04T01:41:05.792 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x557f199970a9] 2023-11-04T01:41:05.792 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x557f19999b2b] 2023-11-04T01:41:05.792 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557f1999a01c] 2023-11-04T01:41:05.792 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x557f19983325] 2023-11-04T01:41:05.792 INFO:tasks.ceph.mds.c.smithi114.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f03bb35ff9a] 2023-11-04T01:41:05.792 INFO:tasks.ceph.mds.c.smithi114.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f03bb3f1741] 2023-11-04T01:41:05.792 INFO:tasks.ceph.mds.c.smithi114.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f03ba89f802] 2023-11-04T01:41:05.792 INFO:tasks.ceph.mds.c.smithi114.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f03ba83f450] 2023-11-04T01:41:05.792 INFO:tasks.ceph.mds.c.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:05.792 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:05.793 INFO:tasks.ceph.mds.c.smithi114.stderr: -200> 2023-11-04T01:41:03.072+0000 7f03b2d1d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:05.793 INFO:tasks.ceph.mds.c.smithi114.stderr: -198> 2023-11-04T01:41:03.072+0000 7f03b2d1d640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:05.793 INFO:tasks.ceph.mds.c.smithi114.stderr: -1> 2023-11-04T01:41:05.781+0000 7f03b5522640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f03b5522640 time 2023-11-04T01:41:05.781579+0000 2023-11-04T01:41:05.793 INFO:tasks.ceph.mds.c.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:41:05.793 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:05.793 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:05.793 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f03bb16efaf] 2023-11-04T01:41:05.793 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f03bb16f16d] 2023-11-04T01:41:05.794 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x557f19c08187] 2023-11-04T01:41:05.794 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x557f199970a9] 2023-11-04T01:41:05.794 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x557f19999b2b] 2023-11-04T01:41:05.794 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557f1999a01c] 2023-11-04T01:41:05.794 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x557f19983325] 2023-11-04T01:41:05.794 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f03bb35ff9a] 2023-11-04T01:41:05.794 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f03bb3f1741] 2023-11-04T01:41:05.794 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f03ba89f802] 2023-11-04T01:41:05.794 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f03ba83f450] 2023-11-04T01:41:05.794 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:05.794 INFO:tasks.ceph.mds.c.smithi114.stderr: 0> 2023-11-04T01:41:05.781+0000 7f03b5522640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:05.794 INFO:tasks.ceph.mds.c.smithi114.stderr: in thread 7f03b5522640 thread_name:ms_dispatch 2023-11-04T01:41:05.794 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:05.795 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:05.795 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f03ba854db0] 2023-11-04T01:41:05.795 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f03ba8a154c] 2023-11-04T01:41:05.795 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: raise() 2023-11-04T01:41:05.795 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: abort() 2023-11-04T01:41:05.795 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f03bb16f009] 2023-11-04T01:41:05.795 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f03bb16f16d] 2023-11-04T01:41:05.795 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x557f19c08187] 2023-11-04T01:41:05.795 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x557f199970a9] 2023-11-04T01:41:05.795 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x557f19999b2b] 2023-11-04T01:41:05.795 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557f1999a01c] 2023-11-04T01:41:05.795 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x557f19983325] 2023-11-04T01:41:05.795 INFO:tasks.ceph.mds.c.smithi114.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f03bb35ff9a] 2023-11-04T01:41:05.796 INFO:tasks.ceph.mds.c.smithi114.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f03bb3f1741] 2023-11-04T01:41:05.796 INFO:tasks.ceph.mds.c.smithi114.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f03ba89f802] 2023-11-04T01:41:05.796 INFO:tasks.ceph.mds.c.smithi114.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f03ba83f450] 2023-11-04T01:41:05.796 INFO:tasks.ceph.mds.c.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:05.796 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:05.887 INFO:teuthology.orchestra.run.smithi114.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:41:05.887 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:41:05.887 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:06.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.026+0000 7f7ab2d05640 1 Processor -- start 2023-11-04T01:41:06.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.026+0000 7f7ab2d05640 1 -- start start 2023-11-04T01:41:06.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.027+0000 7f7ab2d05640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7aac0cc430 0x7f7aac0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.027+0000 7f7ab2d05640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aac0ce730 0x7f7aac0cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.027+0000 7f7ab2d05640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aac0ccdb0 con 0x7f7aac159da0 2023-11-04T01:41:06.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.027+0000 7f7ab2d05640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aac0cd690 con 0x7f7aac0cc430 2023-11-04T01:41:06.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.027+0000 7f7ab2d05640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac0cd970 con 0x7f7aac0ce730 2023-11-04T01:41:06.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.027+0000 7f7aabfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7aac0cc430 0x7f7aac0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.027+0000 7f7aabfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7aac0cc430 0x7f7aac0cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44616/0 (socket says 172.21.15.114:44616) 2023-11-04T01:41:06.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.027+0000 7f7aabfff640 1 -- 172.21.15.114:0/3487011169 learned_addr learned my addr 172.21.15.114:0/3487011169 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:06.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.028+0000 7f7aabfff640 1 -- 172.21.15.114:0/3487011169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aac0ce730 msgr2=0x7f7aac0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:06.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.028+0000 7f7aabfff640 1 --2- 172.21.15.114:0/3487011169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aac0ce730 0x7f7aac0cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.028+0000 7f7aabfff640 1 -- 172.21.15.114:0/3487011169 >> v1:172.21.15.114:6789/0 conn(0x7f7aac159da0 legacy=0x7f7aac0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.028+0000 7f7aabfff640 1 -- 172.21.15.114:0/3487011169 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac0cdc50 con 0x7f7aac0cc430 2023-11-04T01:41:06.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.028+0000 7f7aabfff640 1 --2- 172.21.15.114:0/3487011169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aac0cc430 0x7f7aac0cc870 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000bb10 tx=0x7f7aa002e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d2a58fe19f4703 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.028+0000 7f7aab7fe640 1 -- 172.21.15.114:0/3487011169 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0036440 con 0x7f7aac0cc430 2023-11-04T01:41:06.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.028+0000 7f7aab7fe640 1 -- 172.21.15.114:0/3487011169 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa00365a0 con 0x7f7aac0cc430 2023-11-04T01:41:06.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.028+0000 7f7aab7fe640 1 -- 172.21.15.114:0/3487011169 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0036930 con 0x7f7aac0cc430 2023-11-04T01:41:06.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.029+0000 7f7ab2d05640 1 -- 172.21.15.114:0/3487011169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aac0cc430 msgr2=0x7f7aac0cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.029+0000 7f7ab2d05640 1 --2- 172.21.15.114:0/3487011169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aac0cc430 0x7f7aac0cc870 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000bb10 tx=0x7f7aa002e150 comp rx=0 tx=0).stop 2023-11-04T01:41:06.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.029+0000 7f7ab2d05640 1 -- 172.21.15.114:0/3487011169 shutdown_connections 2023-11-04T01:41:06.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.029+0000 7f7ab2d05640 1 --2- 172.21.15.114:0/3487011169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aac0ce730 0x7f7aac0cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.029+0000 7f7ab2d05640 1 --2- 172.21.15.114:0/3487011169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aac0cc430 0x7f7aac0cc870 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.029+0000 7f7ab2d05640 1 -- 172.21.15.114:0/3487011169 >> 172.21.15.114:0/3487011169 conn(0x7f7aac06d8b0 msgr2=0x7f7aac06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:06.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.029+0000 7f7ab2d05640 1 -- 172.21.15.114:0/3487011169 shutdown_connections 2023-11-04T01:41:06.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.029+0000 7f7ab2d05640 1 -- 172.21.15.114:0/3487011169 wait complete. 2023-11-04T01:41:06.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.030+0000 7f7ab2d05640 1 Processor -- start 2023-11-04T01:41:06.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.030+0000 7f7ab2d05640 1 -- start start 2023-11-04T01:41:06.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.031+0000 7f7ab2d05640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aac0cc430 0x7f7aac0c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.031+0000 7f7ab2d05640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aac0ce730 0x7f7aac1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.031+0000 7f7ab2d05640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7aac159da0 0x7f7aac0ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.031+0000 7f7ab2d05640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac0c3a90 con 0x7f7aac0ce730 2023-11-04T01:41:06.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.031+0000 7f7ab2d05640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac0b39e0 con 0x7f7aac159da0 2023-11-04T01:41:06.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.031+0000 7f7ab2d05640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac0c4890 con 0x7f7aac0cc430 2023-11-04T01:41:06.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.031+0000 7f7aabfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aac0ce730 0x7f7aac1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.031+0000 7f7aabfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aac0ce730 0x7f7aac1571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44624/0 (socket says 172.21.15.114:44624) 2023-11-04T01:41:06.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.031+0000 7f7aabfff640 1 -- 172.21.15.114:0/1252215955 learned_addr learned my addr 172.21.15.114:0/1252215955 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:06.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.031+0000 7f7aabfff640 1 -- 172.21.15.114:0/1252215955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aac0cc430 msgr2=0x7f7aac0c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.031+0000 7f7aabfff640 1 --2- 172.21.15.114:0/1252215955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aac0cc430 0x7f7aac0c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.031+0000 7f7aabfff640 1 -- 172.21.15.114:0/1252215955 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7aac159da0 msgr2=0x7f7aac0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.031+0000 7f7aabfff640 1 --2- 172.21.15.114:0/1252215955 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7aac159da0 0x7f7aac0ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.031+0000 7f7aabfff640 1 -- 172.21.15.114:0/1252215955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa000b770 con 0x7f7aac0ce730 2023-11-04T01:41:06.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.032+0000 7f7aabfff640 1 --2- 172.21.15.114:0/1252215955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aac0ce730 0x7f7aac1571a0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0000c00 tx=0x7f7aa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.032+0000 7f7aa97fa640 1 -- 172.21.15.114:0/1252215955 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0034b00 con 0x7f7aac0ce730 2023-11-04T01:41:06.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.032+0000 7f7aa97fa640 1 -- 172.21.15.114:0/1252215955 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa0034c80 con 0x7f7aac0ce730 2023-11-04T01:41:06.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.032+0000 7f7ab2d05640 1 -- 172.21.15.114:0/1252215955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aac1576e0 con 0x7f7aac0ce730 2023-11-04T01:41:06.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.032+0000 7f7aa97fa640 1 -- 172.21.15.114:0/1252215955 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0041440 con 0x7f7aac0ce730 2023-11-04T01:41:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.032+0000 7f7ab2d05640 1 -- 172.21.15.114:0/1252215955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aac0c3f60 con 0x7f7aac0ce730 2023-11-04T01:41:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.033+0000 7f7ab2d05640 1 -- 172.21.15.114:0/1252215955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aac0cc990 con 0x7f7aac0ce730 2023-11-04T01:41:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.033+0000 7f7aa97fa640 1 -- 172.21.15.114:0/1252215955 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7aa003d040 con 0x7f7aac0ce730 2023-11-04T01:41:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.033+0000 7f7aa97fa640 1 --2- 172.21.15.114:0/1252215955 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9806ae70 0x7f7a9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.033+0000 7f7aa97fa640 1 -- 172.21.15.114:0/1252215955 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f7aa00aeb40 con 0x7f7aac0ce730 2023-11-04T01:41:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.033+0000 7f7ab0aa1640 1 --2- 172.21.15.114:0/1252215955 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9806ae70 0x7f7a9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.034+0000 7f7ab0aa1640 1 --2- 172.21.15.114:0/1252215955 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9806ae70 0x7f7a9806d330 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c000f60 tx=0x7f7a9c0079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.038+0000 7f7aa97fa640 1 -- 172.21.15.114:0/1252215955 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7aa00796c0 con 0x7f7aac0ce730 2023-11-04T01:41:06.176 INFO:tasks.ceph.mds.c.smithi114.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:41:06.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.241+0000 7f7ab2d05640 1 -- 172.21.15.114:0/1252215955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7aac0674e0 con 0x7f7aac0ce730 2023-11-04T01:41:06.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.241+0000 7f7aa97fa640 1 -- 172.21.15.114:0/1252215955 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f7aa007cce0 con 0x7f7aac0ce730 2023-11-04T01:41:06.243 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:06.244 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:05.115931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7773,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7773":{"gid":7773,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:06.244 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 64 2023-11-04T01:41:06.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.243+0000 7f7ab2d05640 1 -- 172.21.15.114:0/1252215955 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9806ae70 msgr2=0x7f7a9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.243+0000 7f7ab2d05640 1 --2- 172.21.15.114:0/1252215955 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9806ae70 0x7f7a9806d330 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c000f60 tx=0x7f7a9c0079b0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.243+0000 7f7ab2d05640 1 -- 172.21.15.114:0/1252215955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aac0ce730 msgr2=0x7f7aac1571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.243+0000 7f7ab2d05640 1 --2- 172.21.15.114:0/1252215955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aac0ce730 0x7f7aac1571a0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0000c00 tx=0x7f7aa00046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.243+0000 7f7ab2d05640 1 -- 172.21.15.114:0/1252215955 shutdown_connections 2023-11-04T01:41:06.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.243+0000 7f7ab2d05640 1 --2- 172.21.15.114:0/1252215955 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a9806ae70 0x7f7a9806d330 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.243+0000 7f7ab2d05640 1 --2- 172.21.15.114:0/1252215955 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7aac159da0 0x7f7aac0ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.243+0000 7f7ab2d05640 1 --2- 172.21.15.114:0/1252215955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aac0ce730 0x7f7aac1571a0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.244+0000 7f7ab2d05640 1 --2- 172.21.15.114:0/1252215955 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7aac0cc430 0x7f7aac0c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.244+0000 7f7ab2d05640 1 -- 172.21.15.114:0/1252215955 >> 172.21.15.114:0/1252215955 conn(0x7f7aac06d8b0 msgr2=0x7f7aac159090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:06.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.244+0000 7f7ab2d05640 1 -- 172.21.15.114:0/1252215955 shutdown_connections 2023-11-04T01:41:06.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:06.244+0000 7f7ab2d05640 1 -- 172.21.15.114:0/1252215955 wait complete. 2023-11-04T01:41:06.256 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:11.257 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:11.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.366+0000 7f6b44105640 1 Processor -- start 2023-11-04T01:41:11.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.366+0000 7f6b44105640 1 -- start start 2023-11-04T01:41:11.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.367+0000 7f6b44105640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b3c0b0ae0 0x7f6b3c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.367+0000 7f6b44105640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6b3c06db20 0x7f6b3c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.367+0000 7f6b44105640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3c0b4110 con 0x7f6b3c159c70 2023-11-04T01:41:11.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.367+0000 7f6b44105640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3c0b49b0 con 0x7f6b3c06db20 2023-11-04T01:41:11.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.367+0000 7f6b44105640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c0b43f0 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.367+0000 7f6b426a2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6b3c06db20 0x7f6b3c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.367+0000 7f6b416a0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b3c0b0ae0 0x7f6b3c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.367+0000 7f6b41ea1640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f6b3c159c70 0x7f6b3c0b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:37442/0 (socket says 172.21.15.114:37442) 2023-11-04T01:41:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.367+0000 7f6b41ea1640 1 -- 172.21.15.114:0/1637211811 learned_addr learned my addr 172.21.15.114:0/1637211811 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.368+0000 7f6b416a0640 1 -- 172.21.15.114:0/1637211811 >> v2:172.21.15.141:3300/0 conn(0x7f6b3c06db20 msgr2=0x7f6b3c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.368+0000 7f6b416a0640 1 --2- 172.21.15.114:0/1637211811 >> v2:172.21.15.141:3300/0 conn(0x7f6b3c06db20 0x7f6b3c15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.368+0000 7f6b416a0640 1 -- 172.21.15.114:0/1637211811 >> v1:172.21.15.141:6789/0 conn(0x7f6b3c159c70 legacy=0x7f6b3c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.368+0000 7f6b416a0640 1 -- 172.21.15.114:0/1637211811 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c0b46d0 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.368+0000 7f6b426a2640 1 --2- 172.21.15.114:0/1637211811 >> v2:172.21.15.141:3300/0 conn(0x7f6b3c06db20 0x7f6b3c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.369+0000 7f6b416a0640 1 --2- 172.21.15.114:0/1637211811 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b3c0b0ae0 0x7f6b3c0ce370 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0097a0 tx=0x7f6b2c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31cf2025e3537360 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.369+0000 7f6b40e9f640 1 -- 172.21.15.114:0/1637211811 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c031830 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.369+0000 7f6b40e9f640 1 -- 172.21.15.114:0/1637211811 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c031990 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.369+0000 7f6b40e9f640 1 -- 172.21.15.114:0/1637211811 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c031d20 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.369+0000 7f6b44105640 1 -- 172.21.15.114:0/1637211811 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b3c0b0ae0 msgr2=0x7f6b3c0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.369+0000 7f6b44105640 1 --2- 172.21.15.114:0/1637211811 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b3c0b0ae0 0x7f6b3c0ce370 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0097a0 tx=0x7f6b2c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.369+0000 7f6b44105640 1 -- 172.21.15.114:0/1637211811 shutdown_connections 2023-11-04T01:41:11.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.369+0000 7f6b44105640 1 --2- 172.21.15.114:0/1637211811 >> v2:172.21.15.141:3300/0 conn(0x7f6b3c06db20 0x7f6b3c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.369+0000 7f6b44105640 1 --2- 172.21.15.114:0/1637211811 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b3c0b0ae0 0x7f6b3c0ce370 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.369+0000 7f6b44105640 1 -- 172.21.15.114:0/1637211811 >> 172.21.15.114:0/1637211811 conn(0x7f6b3c0ce950 msgr2=0x7f6b3c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:11.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.370+0000 7f6b44105640 1 -- 172.21.15.114:0/1637211811 shutdown_connections 2023-11-04T01:41:11.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.370+0000 7f6b44105640 1 -- 172.21.15.114:0/1637211811 wait complete. 2023-11-04T01:41:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.371+0000 7f6b44105640 1 Processor -- start 2023-11-04T01:41:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.371+0000 7f6b44105640 1 -- start start 2023-11-04T01:41:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.371+0000 7f6b44105640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b3c06db20 0x7f6b3c158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.371+0000 7f6b44105640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3c0b0ae0 0x7f6b3c15e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.371+0000 7f6b44105640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b3c159c70 0x7f6b3c0c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.371+0000 7f6b44105640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c156ad0 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.371+0000 7f6b44105640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c156db0 con 0x7f6b3c06db20 2023-11-04T01:41:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.371+0000 7f6b44105640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c157090 con 0x7f6b3c159c70 2023-11-04T01:41:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.372+0000 7f6b416a0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3c0b0ae0 0x7f6b3c15e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.372+0000 7f6b416a0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3c0b0ae0 0x7f6b3c15e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41990/0 (socket says 172.21.15.114:41990) 2023-11-04T01:41:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.372+0000 7f6b416a0640 1 -- 172.21.15.114:0/1298475035 learned_addr learned my addr 172.21.15.114:0/1298475035 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.372+0000 7f6b41ea1640 1 --2- 172.21.15.114:0/1298475035 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b3c06db20 0x7f6b3c158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.372+0000 7f6b426a2640 1 --2- 172.21.15.114:0/1298475035 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b3c159c70 0x7f6b3c0c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.372+0000 7f6b416a0640 1 -- 172.21.15.114:0/1298475035 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b3c159c70 msgr2=0x7f6b3c0c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.372+0000 7f6b416a0640 1 --2- 172.21.15.114:0/1298475035 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b3c159c70 0x7f6b3c0c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.372+0000 7f6b416a0640 1 -- 172.21.15.114:0/1298475035 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b3c06db20 msgr2=0x7f6b3c158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.372+0000 7f6b416a0640 1 --2- 172.21.15.114:0/1298475035 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b3c06db20 0x7f6b3c158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.372+0000 7f6b416a0640 1 -- 172.21.15.114:0/1298475035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b34009a70 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.372+0000 7f6b416a0640 1 --2- 172.21.15.114:0/1298475035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3c0b0ae0 0x7f6b3c15e8c0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0098c0 tx=0x7f6b2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.372+0000 7f6b327fc640 1 -- 172.21.15.114:0/1298475035 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c03a630 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.372+0000 7f6b327fc640 1 -- 172.21.15.114:0/1298475035 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c03a790 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.372+0000 7f6b327fc640 1 -- 172.21.15.114:0/1298475035 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c03ab40 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.372+0000 7f6b44105640 1 -- 172.21.15.114:0/1298475035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2c009400 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.372+0000 7f6b44105640 1 -- 172.21.15.114:0/1298475035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3c153020 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.373+0000 7f6b44105640 1 -- 172.21.15.114:0/1298475035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3c15b380 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.374+0000 7f6b327fc640 1 -- 172.21.15.114:0/1298475035 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b2c03aca0 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.374+0000 7f6b327fc640 1 --2- 172.21.15.114:0/1298475035 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6b2006ae70 0x7f6b2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.374+0000 7f6b327fc640 1 -- 172.21.15.114:0/1298475035 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f6b2c0ab620 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.374+0000 7f6b41ea1640 1 --2- 172.21.15.114:0/1298475035 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6b2006ae70 0x7f6b2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.375+0000 7f6b41ea1640 1 --2- 172.21.15.114:0/1298475035 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6b2006ae70 0x7f6b2006d330 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6b38005880 tx=0x7f6b38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.379+0000 7f6b327fc640 1 -- 172.21.15.114:0/1298475035 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b3c15b380 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.579+0000 7f6b44105640 1 -- 172.21.15.114:0/1298475035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b3c15b380 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.580+0000 7f6b327fc640 1 -- 172.21.15.114:0/1298475035 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f6b3c15b380 con 0x7f6b3c0b0ae0 2023-11-04T01:41:11.582 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:11.582 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:05.115931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7773,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7773":{"gid":7773,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 64 2023-11-04T01:41:11.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.582+0000 7f6b44105640 1 -- 172.21.15.114:0/1298475035 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6b2006ae70 msgr2=0x7f6b2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.582+0000 7f6b44105640 1 --2- 172.21.15.114:0/1298475035 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6b2006ae70 0x7f6b2006d330 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6b38005880 tx=0x7f6b38009040 comp rx=0 tx=0).stop 2023-11-04T01:41:11.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.582+0000 7f6b44105640 1 -- 172.21.15.114:0/1298475035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3c0b0ae0 msgr2=0x7f6b3c15e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.582+0000 7f6b44105640 1 --2- 172.21.15.114:0/1298475035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3c0b0ae0 0x7f6b3c15e8c0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0098c0 tx=0x7f6b2c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.582+0000 7f6b44105640 1 -- 172.21.15.114:0/1298475035 shutdown_connections 2023-11-04T01:41:11.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.582+0000 7f6b44105640 1 --2- 172.21.15.114:0/1298475035 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b3c159c70 0x7f6b3c0c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.582+0000 7f6b44105640 1 --2- 172.21.15.114:0/1298475035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3c0b0ae0 0x7f6b3c15e8c0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.582+0000 7f6b44105640 1 --2- 172.21.15.114:0/1298475035 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6b2006ae70 0x7f6b2006d330 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.582+0000 7f6b44105640 1 --2- 172.21.15.114:0/1298475035 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b3c06db20 0x7f6b3c158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.582+0000 7f6b44105640 1 -- 172.21.15.114:0/1298475035 >> 172.21.15.114:0/1298475035 conn(0x7f6b3c0ce950 msgr2=0x7f6b3c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:11.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.582+0000 7f6b44105640 1 -- 172.21.15.114:0/1298475035 shutdown_connections 2023-11-04T01:41:11.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:11.582+0000 7f6b44105640 1 -- 172.21.15.114:0/1298475035 wait complete. 2023-11-04T01:41:11.595 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:11.866 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:41:16.595 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.705+0000 7f087ce61640 1 Processor -- start 2023-11-04T01:41:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.705+0000 7f087ce61640 1 -- start start 2023-11-04T01:41:16.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f087ce61640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08780b0cd0 0x7f0878070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f087ce61640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08780cc990 con 0x7f08780cda60 2023-11-04T01:41:16.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f087ce61640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08780ccc70 con 0x7f08780cde40 2023-11-04T01:41:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f087ce61640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08780c9ce0 con 0x7f08780b0cd0 2023-11-04T01:41:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f087659c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f08780cda60 0x7f08780ca7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52350/0 (socket says 172.21.15.114:52350) 2023-11-04T01:41:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f087659c640 1 -- 172.21.15.114:0/33698135 learned_addr learned my addr 172.21.15.114:0/33698135 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f0875d9b640 1 -- 172.21.15.114:0/33698135 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009707781 0 0) 0x7f08780cc990 con 0x7f08780cda60 2023-11-04T01:41:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f0875d9b640 1 -- 172.21.15.114:0/33698135 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0864003440 con 0x7f08780cda60 2023-11-04T01:41:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f086ffff640 1 --2- 172.21.15.114:0/33698135 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08780b0cd0 0x7f0878070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f0875d9b640 1 -- 172.21.15.114:0/33698135 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3124525567 0 0) 0x7f0864003440 con 0x7f08780cda60 2023-11-04T01:41:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f0875d9b640 1 -- 172.21.15.114:0/33698135 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08780b0cd0 msgr2=0x7f0878070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f0875d9b640 1 --2- 172.21.15.114:0/33698135 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08780b0cd0 0x7f0878070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f0875d9b640 1 -- 172.21.15.114:0/33698135 >> v1:172.21.15.141:6789/0 conn(0x7f08780cde40 legacy=0x7f087806c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f0875d9b640 1 -- 172.21.15.114:0/33698135 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08780c9fc0 con 0x7f08780cda60 2023-11-04T01:41:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f0875d9b640 1 -- 172.21.15.114:0/33698135 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f0868001670 con 0x7f08780cda60 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f0875d9b640 1 -- 172.21.15.114:0/33698135 >> v1:172.21.15.114:6789/0 conn(0x7f08780cda60 legacy=0x7f08780ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f0875d9b640 1 --2- 172.21.15.114:0/33698135 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0864003a90 0x7f0864003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f0875d9b640 1 --2- 172.21.15.114:0/33698135 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08780b0cd0 0x7f086400a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f0875d9b640 1 --2- 172.21.15.114:0/33698135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086400afa0 0x7f086400d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f0875d9b640 1 -- 172.21.15.114:0/33698135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08780c9ce0 con 0x7f086400afa0 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f0875d9b640 1 -- 172.21.15.114:0/33698135 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086400dc10 con 0x7f0864003a90 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.706+0000 7f0875d9b640 1 -- 172.21.15.114:0/33698135 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086400ddd0 con 0x7f08780b0cd0 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.707+0000 7f0876d9d640 1 --2- 172.21.15.114:0/33698135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086400afa0 0x7f086400d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.707+0000 7f087659c640 1 --2- 172.21.15.114:0/33698135 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0864003a90 0x7f0864003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.707+0000 7f086ffff640 1 --2- 172.21.15.114:0/33698135 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08780b0cd0 0x7f086400a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.707+0000 7f0876d9d640 1 -- 172.21.15.114:0/33698135 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08780b0cd0 msgr2=0x7f086400a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.707+0000 7f0876d9d640 1 --2- 172.21.15.114:0/33698135 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08780b0cd0 0x7f086400a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.707+0000 7f0876d9d640 1 -- 172.21.15.114:0/33698135 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0864003a90 msgr2=0x7f0864003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.707+0000 7f0876d9d640 1 --2- 172.21.15.114:0/33698135 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0864003a90 0x7f0864003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.707+0000 7f0876d9d640 1 -- 172.21.15.114:0/33698135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0864003440 con 0x7f086400afa0 2023-11-04T01:41:16.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.708+0000 7f0876d9d640 1 --2- 172.21.15.114:0/33698135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086400afa0 0x7f086400d430 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f0870001e20 tx=0x7f08640036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9053445dd4103cc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.708+0000 7f0875d9b640 1 -- 172.21.15.114:0/33698135 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870003b70 con 0x7f086400afa0 2023-11-04T01:41:16.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.708+0000 7f0875d9b640 1 -- 172.21.15.114:0/33698135 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870003cd0 con 0x7f086400afa0 2023-11-04T01:41:16.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.708+0000 7f0875d9b640 1 -- 172.21.15.114:0/33698135 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870005310 con 0x7f086400afa0 2023-11-04T01:41:16.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.708+0000 7f087ce61640 1 -- 172.21.15.114:0/33698135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086400afa0 msgr2=0x7f086400d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.708+0000 7f087ce61640 1 --2- 172.21.15.114:0/33698135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086400afa0 0x7f086400d430 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f0870001e20 tx=0x7f08640036f0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.708+0000 7f0876d9d640 1 -- 172.21.15.114:0/33698135 reap_dead start 2023-11-04T01:41:16.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.708+0000 7f087ce61640 1 -- 172.21.15.114:0/33698135 shutdown_connections 2023-11-04T01:41:16.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.708+0000 7f087ce61640 1 -- 172.21.15.114:0/33698135 >> 172.21.15.114:0/33698135 conn(0x7f08780ce950 msgr2=0x7f08780ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:16.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.708+0000 7f087ce61640 1 -- 172.21.15.114:0/33698135 shutdown_connections 2023-11-04T01:41:16.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.708+0000 7f087ce61640 1 -- 172.21.15.114:0/33698135 wait complete. 2023-11-04T01:41:16.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.710+0000 7f087ce61640 1 Processor -- start 2023-11-04T01:41:16.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.710+0000 7f087ce61640 1 -- start start 2023-11-04T01:41:16.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.710+0000 7f087ce61640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f086400afa0 0x7f08781512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.710+0000 7f087ce61640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0878151b10 0x7f08780b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.710+0000 7f087ce61640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f087814c2c0 0x7f087814c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.710+0000 7f087ce61640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087814cc80 con 0x7f0878151b10 2023-11-04T01:41:16.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.710+0000 7f087ce61640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08781518b0 con 0x7f086400afa0 2023-11-04T01:41:16.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.710+0000 7f087ce61640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08781542c0 con 0x7f087814c2c0 2023-11-04T01:41:16.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.710+0000 7f086ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0878151b10 0x7f08780b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.711+0000 7f086ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0878151b10 0x7f08780b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36810/0 (socket says 172.21.15.114:36810) 2023-11-04T01:41:16.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.711+0000 7f086ffff640 1 -- 172.21.15.114:0/3431664930 learned_addr learned my addr 172.21.15.114:0/3431664930 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:16.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.711+0000 7f087659c640 1 --2- 172.21.15.114:0/3431664930 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f086400afa0 0x7f08781512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.711+0000 7f0876d9d640 1 --2- 172.21.15.114:0/3431664930 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f087814c2c0 0x7f087814c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.711+0000 7f086ffff640 1 -- 172.21.15.114:0/3431664930 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f087814c2c0 msgr2=0x7f087814c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.711+0000 7f086ffff640 1 --2- 172.21.15.114:0/3431664930 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f087814c2c0 0x7f087814c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.711+0000 7f086ffff640 1 -- 172.21.15.114:0/3431664930 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f086400afa0 msgr2=0x7f08781512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.711+0000 7f086ffff640 1 --2- 172.21.15.114:0/3431664930 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f086400afa0 0x7f08781512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.711+0000 7f086ffff640 1 -- 172.21.15.114:0/3431664930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08781545a0 con 0x7f0878151b10 2023-11-04T01:41:16.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.711+0000 7f086ffff640 1 --2- 172.21.15.114:0/3431664930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0878151b10 0x7f08780b2cb0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f08600119a0 tx=0x7f0860011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.711+0000 7f086effd640 1 -- 172.21.15.114:0/3431664930 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086000fa70 con 0x7f0878151b10 2023-11-04T01:41:16.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.711+0000 7f086effd640 1 -- 172.21.15.114:0/3431664930 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086000fbd0 con 0x7f0878151b10 2023-11-04T01:41:16.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.711+0000 7f087ce61640 1 -- 172.21.15.114:0/3431664930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0878154880 con 0x7f0878151b10 2023-11-04T01:41:16.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.711+0000 7f086effd640 1 -- 172.21.15.114:0/3431664930 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0860014440 con 0x7f0878151b10 2023-11-04T01:41:16.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.711+0000 7f087ce61640 1 -- 172.21.15.114:0/3431664930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08780b31f0 con 0x7f0878151b10 2023-11-04T01:41:16.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.712+0000 7f087ce61640 1 -- 172.21.15.114:0/3431664930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08780cc470 con 0x7f0878151b10 2023-11-04T01:41:16.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.712+0000 7f086effd640 1 -- 172.21.15.114:0/3431664930 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08600145a0 con 0x7f0878151b10 2023-11-04T01:41:16.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.713+0000 7f086effd640 1 --2- 172.21.15.114:0/3431664930 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f085806aea0 0x7f085806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.713+0000 7f086effd640 1 -- 172.21.15.114:0/3431664930 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f086008a290 con 0x7f0878151b10 2023-11-04T01:41:16.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.713+0000 7f087659c640 1 --2- 172.21.15.114:0/3431664930 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f085806aea0 0x7f085806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.713+0000 7f087659c640 1 --2- 172.21.15.114:0/3431664930 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f085806aea0 0x7f085806d360 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0868001050 tx=0x7f0868000f80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.717+0000 7f086effd640 1 -- 172.21.15.114:0/3431664930 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08780cc470 con 0x7f0878151b10 2023-11-04T01:41:16.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.920+0000 7f087ce61640 1 -- 172.21.15.114:0/3431664930 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0878154ed0 con 0x7f0878151b10 2023-11-04T01:41:16.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.920+0000 7f086effd640 1 -- 172.21.15.114:0/3431664930 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f0878154ed0 con 0x7f0878151b10 2023-11-04T01:41:16.922 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:16.922 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:05.115931+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7773,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7773":{"gid":7773,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:16.922 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 64 2023-11-04T01:41:16.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.922+0000 7f087ce61640 1 -- 172.21.15.114:0/3431664930 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f085806aea0 msgr2=0x7f085806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.922+0000 7f087ce61640 1 --2- 172.21.15.114:0/3431664930 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f085806aea0 0x7f085806d360 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0868001050 tx=0x7f0868000f80 comp rx=0 tx=0).stop 2023-11-04T01:41:16.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.922+0000 7f087ce61640 1 -- 172.21.15.114:0/3431664930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0878151b10 msgr2=0x7f08780b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.922+0000 7f087ce61640 1 --2- 172.21.15.114:0/3431664930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0878151b10 0x7f08780b2cb0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f08600119a0 tx=0x7f0860011e60 comp rx=0 tx=0).stop 2023-11-04T01:41:16.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.922+0000 7f087ce61640 1 -- 172.21.15.114:0/3431664930 shutdown_connections 2023-11-04T01:41:16.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.922+0000 7f087ce61640 1 --2- 172.21.15.114:0/3431664930 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f087814c2c0 0x7f087814c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.922+0000 7f087ce61640 1 --2- 172.21.15.114:0/3431664930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0878151b10 0x7f08780b2cb0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.922+0000 7f087ce61640 1 --2- 172.21.15.114:0/3431664930 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f085806aea0 0x7f085806d360 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.922+0000 7f087ce61640 1 --2- 172.21.15.114:0/3431664930 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f086400afa0 0x7f08781512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.922+0000 7f087ce61640 1 -- 172.21.15.114:0/3431664930 >> 172.21.15.114:0/3431664930 conn(0x7f08780ce950 msgr2=0x7f0878158b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:16.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.922+0000 7f087ce61640 1 -- 172.21.15.114:0/3431664930 shutdown_connections 2023-11-04T01:41:16.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:16.922+0000 7f087ce61640 1 -- 172.21.15.114:0/3431664930 wait complete. 2023-11-04T01:41:16.935 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:18.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-04T01:41:20.524 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:20.527 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:21.936 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:22.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.045+0000 7f4211239640 1 Processor -- start 2023-11-04T01:41:22.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.045+0000 7f4211239640 1 -- start start 2023-11-04T01:41:22.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.046+0000 7f4211239640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420c0ce370 0x7f420c06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.046+0000 7f4211239640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c06e060 con 0x7f420c0b0ae0 2023-11-04T01:41:22.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.046+0000 7f4211239640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c0b4110 con 0x7f420c159c70 2023-11-04T01:41:22.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.046+0000 7f4211239640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0b49b0 con 0x7f420c0ce370 2023-11-04T01:41:22.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.046+0000 7f4203fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f420c0b0ae0 0x7f420c15d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52366/0 (socket says 172.21.15.114:52366) 2023-11-04T01:41:22.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.046+0000 7f4203fff640 1 -- 172.21.15.114:0/2552287285 learned_addr learned my addr 172.21.15.114:0/2552287285 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:22.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.046+0000 7f420b59e640 1 --2- 172.21.15.114:0/2552287285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420c0ce370 0x7f420c06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.046+0000 7f420a59c640 1 -- 172.21.15.114:0/2552287285 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129219892 0 0) 0x7f420c06e060 con 0x7f420c0b0ae0 2023-11-04T01:41:22.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.046+0000 7f420a59c640 1 -- 172.21.15.114:0/2552287285 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41f8003520 con 0x7f420c0b0ae0 2023-11-04T01:41:22.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.046+0000 7f420a59c640 1 -- 172.21.15.114:0/2552287285 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2565007998 0 0) 0x7f41f8003520 con 0x7f420c0b0ae0 2023-11-04T01:41:22.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.046+0000 7f420a59c640 1 -- 172.21.15.114:0/2552287285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420c0ce370 msgr2=0x7f420c06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:22.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.046+0000 7f420a59c640 1 --2- 172.21.15.114:0/2552287285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420c0ce370 0x7f420c06db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.046+0000 7f420a59c640 1 -- 172.21.15.114:0/2552287285 >> v1:172.21.15.141:6789/0 conn(0x7f420c159c70 legacy=0x7f420c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.046+0000 7f420a59c640 1 -- 172.21.15.114:0/2552287285 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c0b43f0 con 0x7f420c0b0ae0 2023-11-04T01:41:22.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.046+0000 7f420a59c640 1 -- 172.21.15.114:0/2552287285 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f41f4001670 con 0x7f420c0b0ae0 2023-11-04T01:41:22.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.047+0000 7f420a59c640 1 -- 172.21.15.114:0/2552287285 >> v1:172.21.15.114:6789/0 conn(0x7f420c0b0ae0 legacy=0x7f420c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.047+0000 7f420a59c640 1 --2- 172.21.15.114:0/2552287285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f80039a0 0x7f41f8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.047+0000 7f420a59c640 1 --2- 172.21.15.114:0/2552287285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f8004350 0x7f41f8004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.047+0000 7f420a59c640 1 --2- 172.21.15.114:0/2552287285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420c0ce370 0x7f41f8005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.047+0000 7f420a59c640 1 -- 172.21.15.114:0/2552287285 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0b49b0 con 0x7f41f8004350 2023-11-04T01:41:22.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.047+0000 7f420a59c640 1 -- 172.21.15.114:0/2552287285 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f800b980 con 0x7f41f80039a0 2023-11-04T01:41:22.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.047+0000 7f420a59c640 1 -- 172.21.15.114:0/2552287285 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f800bb40 con 0x7f420c0ce370 2023-11-04T01:41:22.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.047+0000 7f4203fff640 1 --2- 172.21.15.114:0/2552287285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f8004350 0x7f41f8004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.047+0000 7f420ad9d640 1 --2- 172.21.15.114:0/2552287285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f80039a0 0x7f41f8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.047+0000 7f420b59e640 1 --2- 172.21.15.114:0/2552287285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420c0ce370 0x7f41f8005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.047+0000 7f4203fff640 1 -- 172.21.15.114:0/2552287285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420c0ce370 msgr2=0x7f41f8005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:22.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.047+0000 7f4203fff640 1 --2- 172.21.15.114:0/2552287285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420c0ce370 0x7f41f8005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.047+0000 7f4203fff640 1 -- 172.21.15.114:0/2552287285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f80039a0 msgr2=0x7f41f8003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:22.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.047+0000 7f4203fff640 1 --2- 172.21.15.114:0/2552287285 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f80039a0 0x7f41f8003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.047+0000 7f4203fff640 1 -- 172.21.15.114:0/2552287285 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f8003520 con 0x7f41f8004350 2023-11-04T01:41:22.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.047+0000 7f420b59e640 1 --2- 172.21.15.114:0/2552287285 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420c0ce370 0x7f41f8005080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:22.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.048+0000 7f4203fff640 1 --2- 172.21.15.114:0/2552287285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f8004350 0x7f41f8004820 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f41f400c210 tx=0x7f41f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9381c7870ca024df server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.048+0000 7f420a59c640 1 -- 172.21.15.114:0/2552287285 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4005ad0 con 0x7f41f8004350 2023-11-04T01:41:22.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.048+0000 7f420a59c640 1 -- 172.21.15.114:0/2552287285 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f4005c50 con 0x7f41f8004350 2023-11-04T01:41:22.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.048+0000 7f420a59c640 1 -- 172.21.15.114:0/2552287285 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f402c8d0 con 0x7f41f8004350 2023-11-04T01:41:22.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.048+0000 7f4211239640 1 -- 172.21.15.114:0/2552287285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f8004350 msgr2=0x7f41f8004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.048+0000 7f4211239640 1 --2- 172.21.15.114:0/2552287285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f8004350 0x7f41f8004820 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f41f400c210 tx=0x7f41f80057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.048+0000 7f420b59e640 1 -- 172.21.15.114:0/2552287285 reap_dead start 2023-11-04T01:41:22.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.048+0000 7f4211239640 1 -- 172.21.15.114:0/2552287285 shutdown_connections 2023-11-04T01:41:22.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.048+0000 7f4211239640 1 -- 172.21.15.114:0/2552287285 >> 172.21.15.114:0/2552287285 conn(0x7f420c0ce950 msgr2=0x7f420c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:22.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.048+0000 7f4211239640 1 -- 172.21.15.114:0/2552287285 shutdown_connections 2023-11-04T01:41:22.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.048+0000 7f4211239640 1 -- 172.21.15.114:0/2552287285 wait complete. 2023-11-04T01:41:22.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.050+0000 7f4211239640 1 Processor -- start 2023-11-04T01:41:22.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.050+0000 7f4211239640 1 -- start start 2023-11-04T01:41:22.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.050+0000 7f4211239640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f8004350 0x7f420c145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.050+0000 7f4211239640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420c146bd0 0x7f420c14bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.050+0000 7f4211239640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420c147050 0x7f420c14c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f4211239640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c147540 con 0x7f420c146bd0 2023-11-04T01:41:22.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f4211239640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c1483d0 con 0x7f41f8004350 2023-11-04T01:41:22.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f4211239640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c148670 con 0x7f420c147050 2023-11-04T01:41:22.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f4203fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420c146bd0 0x7f420c14bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f4203fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420c146bd0 0x7f420c14bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36818/0 (socket says 172.21.15.114:36818) 2023-11-04T01:41:22.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f4203fff640 1 -- 172.21.15.114:0/3140964256 learned_addr learned my addr 172.21.15.114:0/3140964256 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:22.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f420ad9d640 1 --2- 172.21.15.114:0/3140964256 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f8004350 0x7f420c145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f420b59e640 1 --2- 172.21.15.114:0/3140964256 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420c147050 0x7f420c14c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f4203fff640 1 -- 172.21.15.114:0/3140964256 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420c147050 msgr2=0x7f420c14c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f4203fff640 1 --2- 172.21.15.114:0/3140964256 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420c147050 0x7f420c14c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f4203fff640 1 -- 172.21.15.114:0/3140964256 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f8004350 msgr2=0x7f420c145910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f4203fff640 1 --2- 172.21.15.114:0/3140964256 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f8004350 0x7f420c145910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f4203fff640 1 -- 172.21.15.114:0/3140964256 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c148950 con 0x7f420c146bd0 2023-11-04T01:41:22.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f4203fff640 1 --2- 172.21.15.114:0/3140964256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420c146bd0 0x7f420c14bdb0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f41f400c330 tx=0x7f41f4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f42037fe640 1 -- 172.21.15.114:0/3140964256 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f403c040 con 0x7f420c146bd0 2023-11-04T01:41:22.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f42037fe640 1 -- 172.21.15.114:0/3140964256 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f402cce0 con 0x7f420c146bd0 2023-11-04T01:41:22.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f4211239640 1 -- 172.21.15.114:0/3140964256 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c148c30 con 0x7f420c146bd0 2023-11-04T01:41:22.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f42037fe640 1 -- 172.21.15.114:0/3140964256 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4007270 con 0x7f420c146bd0 2023-11-04T01:41:22.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.051+0000 7f4211239640 1 -- 172.21.15.114:0/3140964256 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c145e50 con 0x7f420c146bd0 2023-11-04T01:41:22.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.052+0000 7f4211239640 1 -- 172.21.15.114:0/3140964256 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420c146010 con 0x7f420c146bd0 2023-11-04T01:41:22.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.053+0000 7f42037fe640 1 -- 172.21.15.114:0/3140964256 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41f4032070 con 0x7f420c146bd0 2023-11-04T01:41:22.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.053+0000 7f42037fe640 1 --2- 172.21.15.114:0/3140964256 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41ec06ae70 0x7f41ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.053+0000 7f42037fe640 1 -- 172.21.15.114:0/3140964256 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f41f40ab0d0 con 0x7f420c146bd0 2023-11-04T01:41:22.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.053+0000 7f420ad9d640 1 --2- 172.21.15.114:0/3140964256 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41ec06ae70 0x7f41ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.054+0000 7f420ad9d640 1 --2- 172.21.15.114:0/3140964256 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41ec06ae70 0x7f41ec06d330 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f420c159170 tx=0x7f41fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.058+0000 7f42037fe640 1 -- 172.21.15.114:0/3140964256 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41f4075c50 con 0x7f420c146bd0 2023-11-04T01:41:22.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.258+0000 7f4211239640 1 -- 172.21.15.114:0/3140964256 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f420c074290 con 0x7f420c146bd0 2023-11-04T01:41:22.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.258+0000 7f42037fe640 1 -- 172.21.15.114:0/3140964256 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4992 (secure 0 0 0) 0x7f41f4046020 con 0x7f420c146bd0 2023-11-04T01:41:22.260 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:22.260 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7899,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:20.589274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7773,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7773":{"gid":7773,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/2722332212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2722332212},{"type":"v1","addr":"172.21.15.114:6836","nonce":2722332212}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:41:20.589274+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:22.261 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 65 2023-11-04T01:41:22.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.260+0000 7f4211239640 1 -- 172.21.15.114:0/3140964256 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41ec06ae70 msgr2=0x7f41ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.260+0000 7f4211239640 1 --2- 172.21.15.114:0/3140964256 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41ec06ae70 0x7f41ec06d330 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f420c159170 tx=0x7f41fc009040 comp rx=0 tx=0).stop 2023-11-04T01:41:22.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.260+0000 7f4211239640 1 -- 172.21.15.114:0/3140964256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420c146bd0 msgr2=0x7f420c14bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.260+0000 7f4211239640 1 --2- 172.21.15.114:0/3140964256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420c146bd0 0x7f420c14bdb0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f41f400c330 tx=0x7f41f4001a00 comp rx=0 tx=0).stop 2023-11-04T01:41:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.260+0000 7f4211239640 1 -- 172.21.15.114:0/3140964256 shutdown_connections 2023-11-04T01:41:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.260+0000 7f4211239640 1 --2- 172.21.15.114:0/3140964256 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f420c147050 0x7f420c14c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.260+0000 7f4211239640 1 --2- 172.21.15.114:0/3140964256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f420c146bd0 0x7f420c14bdb0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.260+0000 7f4211239640 1 --2- 172.21.15.114:0/3140964256 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41ec06ae70 0x7f41ec06d330 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.260+0000 7f4211239640 1 --2- 172.21.15.114:0/3140964256 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f8004350 0x7f420c145910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.260+0000 7f4211239640 1 -- 172.21.15.114:0/3140964256 >> 172.21.15.114:0/3140964256 conn(0x7f420c0ce950 msgr2=0x7f420c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.260+0000 7f4211239640 1 -- 172.21.15.114:0/3140964256 shutdown_connections 2023-11-04T01:41:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.260+0000 7f4211239640 1 -- 172.21.15.114:0/3140964256 wait complete. 2023-11-04T01:41:22.273 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:41:22.273 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:41:22.298 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:41:22.299 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:41:22.300 DEBUG:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:41:22.369 INFO:teuthology.orchestra.run.smithi114.stdout:1699062065.119288.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:41:22.370 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062065.119288.core'] 2023-11-04T01:41:22.370 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062065.119288.core, deleting it 2023-11-04T01:41:22.370 DEBUG:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062065.119288.core 2023-11-04T01:41:22.439 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:41:22.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.577+0000 7f0e75475640 1 Processor -- start 2023-11-04T01:41:22.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.577+0000 7f0e75475640 1 -- start start 2023-11-04T01:41:22.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.578+0000 7f0e75475640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e7006e5a0 0x7f0e700af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.578+0000 7f0e75475640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0e700cbd20 0x7f0e7006d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.578+0000 7f0e75475640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e700cc180 con 0x7f0e700ceed0 2023-11-04T01:41:22.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.578+0000 7f0e75475640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e700cc370 con 0x7f0e700cbd20 2023-11-04T01:41:22.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.578+0000 7f0e75475640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700cd1d0 con 0x7f0e7006e5a0 2023-11-04T01:41:22.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.578+0000 7f0e6e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0e700cbd20 0x7f0e7006d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.578+0000 7f0e6e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0e700cbd20 0x7f0e7006d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36834/0 (socket says 172.21.15.114:36834) 2023-11-04T01:41:22.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.578+0000 7f0e6e7fc640 1 -- 172.21.15.114:0/4085639899 learned_addr learned my addr 172.21.15.114:0/4085639899 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:22.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.579+0000 7f0e6effd640 1 --2- 172.21.15.114:0/4085639899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e7006e5a0 0x7f0e700af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.579+0000 7f0e6e7fc640 1 -- 172.21.15.114:0/4085639899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e7006e5a0 msgr2=0x7f0e700af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:22.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.579+0000 7f0e6e7fc640 1 --2- 172.21.15.114:0/4085639899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e7006e5a0 0x7f0e700af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.579+0000 7f0e6e7fc640 1 -- 172.21.15.114:0/4085639899 >> v1:172.21.15.114:6789/0 conn(0x7f0e700ceed0 legacy=0x7f0e700cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.579+0000 7f0e6e7fc640 1 -- 172.21.15.114:0/4085639899 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e700cc5c0 con 0x7f0e700cbd20 2023-11-04T01:41:22.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.579+0000 7f0e6effd640 1 --2- 172.21.15.114:0/4085639899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e7006e5a0 0x7f0e700af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:22.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.579+0000 7f0e6e7fc640 1 --2- 172.21.15.114:0/4085639899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e700cbd20 0x7f0e7006d4c0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009870 tx=0x7f0e5802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f827c20093c82653 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.579+0000 7f0e6dffb640 1 -- 172.21.15.114:0/4085639899 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e580317c0 con 0x7f0e700cbd20 2023-11-04T01:41:22.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.580+0000 7f0e6dffb640 1 -- 172.21.15.114:0/4085639899 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e58031920 con 0x7f0e700cbd20 2023-11-04T01:41:22.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.580+0000 7f0e6dffb640 1 -- 172.21.15.114:0/4085639899 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58031cb0 con 0x7f0e700cbd20 2023-11-04T01:41:22.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.580+0000 7f0e75475640 1 -- 172.21.15.114:0/4085639899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e700cbd20 msgr2=0x7f0e7006d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.580+0000 7f0e75475640 1 --2- 172.21.15.114:0/4085639899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e700cbd20 0x7f0e7006d4c0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009870 tx=0x7f0e5802b860 comp rx=0 tx=0).stop 2023-11-04T01:41:22.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.580+0000 7f0e75475640 1 -- 172.21.15.114:0/4085639899 shutdown_connections 2023-11-04T01:41:22.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.580+0000 7f0e75475640 1 --2- 172.21.15.114:0/4085639899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e700cbd20 0x7f0e7006d4c0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.580+0000 7f0e75475640 1 --2- 172.21.15.114:0/4085639899 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e7006e5a0 0x7f0e700af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.580+0000 7f0e75475640 1 -- 172.21.15.114:0/4085639899 >> 172.21.15.114:0/4085639899 conn(0x7f0e7006bcb0 msgr2=0x7f0e70098ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:22.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.580+0000 7f0e75475640 1 -- 172.21.15.114:0/4085639899 shutdown_connections 2023-11-04T01:41:22.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.580+0000 7f0e75475640 1 -- 172.21.15.114:0/4085639899 wait complete. 2023-11-04T01:41:22.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.581+0000 7f0e75475640 1 Processor -- start 2023-11-04T01:41:22.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.581+0000 7f0e75475640 1 -- start start 2023-11-04T01:41:22.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.582+0000 7f0e75475640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e7006e5a0 0x7f0e7015a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.582+0000 7f0e75475640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e700cbd20 0x7f0e700b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.582+0000 7f0e75475640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e700ceed0 0x7f0e700b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.582+0000 7f0e75475640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700c6fc0 con 0x7f0e700cbd20 2023-11-04T01:41:22.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.582+0000 7f0e75475640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700b5150 con 0x7f0e700ceed0 2023-11-04T01:41:22.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.582+0000 7f0e75475640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700b5430 con 0x7f0e7006e5a0 2023-11-04T01:41:22.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.582+0000 7f0e6e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e700cbd20 0x7f0e700b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.582+0000 7f0e6e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e700cbd20 0x7f0e700b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36848/0 (socket says 172.21.15.114:36848) 2023-11-04T01:41:22.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.582+0000 7f0e6e7fc640 1 -- 172.21.15.114:0/2077777965 learned_addr learned my addr 172.21.15.114:0/2077777965 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:22.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.582+0000 7f0e6effd640 1 --2- 172.21.15.114:0/2077777965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e7006e5a0 0x7f0e7015a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.583+0000 7f0e6e7fc640 1 -- 172.21.15.114:0/2077777965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e7006e5a0 msgr2=0x7f0e7015a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.583+0000 7f0e6e7fc640 1 --2- 172.21.15.114:0/2077777965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e7006e5a0 0x7f0e7015a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.583+0000 7f0e6e7fc640 1 -- 172.21.15.114:0/2077777965 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e700ceed0 msgr2=0x7f0e700b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.583+0000 7f0e6f7fe640 1 --2- 172.21.15.114:0/2077777965 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e700ceed0 0x7f0e700b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.583+0000 7f0e6e7fc640 1 --2- 172.21.15.114:0/2077777965 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e700ceed0 0x7f0e700b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.583+0000 7f0e6e7fc640 1 -- 172.21.15.114:0/2077777965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580094d0 con 0x7f0e700cbd20 2023-11-04T01:41:22.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.583+0000 7f0e6f7fe640 1 --2- 172.21.15.114:0/2077777965 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e700ceed0 0x7f0e700b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:22.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.583+0000 7f0e6e7fc640 1 --2- 172.21.15.114:0/2077777965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e700cbd20 0x7f0e700b43b0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f0e58000c00 tx=0x7f0e580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.583+0000 7f0e677fe640 1 -- 172.21.15.114:0/2077777965 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58032860 con 0x7f0e700cbd20 2023-11-04T01:41:22.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.583+0000 7f0e677fe640 1 -- 172.21.15.114:0/2077777965 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e580329e0 con 0x7f0e700cbd20 2023-11-04T01:41:22.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.583+0000 7f0e75475640 1 -- 172.21.15.114:0/2077777965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e700b5710 con 0x7f0e700cbd20 2023-11-04T01:41:22.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.583+0000 7f0e677fe640 1 -- 172.21.15.114:0/2077777965 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58032d90 con 0x7f0e700cbd20 2023-11-04T01:41:22.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.583+0000 7f0e75475640 1 -- 172.21.15.114:0/2077777965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e700b4e30 con 0x7f0e700cbd20 2023-11-04T01:41:22.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.584+0000 7f0e75475640 1 -- 172.21.15.114:0/2077777965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e700b15e0 con 0x7f0e700cbd20 2023-11-04T01:41:22.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.584+0000 7f0e677fe640 1 -- 172.21.15.114:0/2077777965 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e5804d3f0 con 0x7f0e700cbd20 2023-11-04T01:41:22.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.585+0000 7f0e677fe640 1 --2- 172.21.15.114:0/2077777965 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0e5006aea0 0x7f0e5006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.585+0000 7f0e677fe640 1 -- 172.21.15.114:0/2077777965 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f0e580abb50 con 0x7f0e700cbd20 2023-11-04T01:41:22.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.585+0000 7f0e6effd640 1 --2- 172.21.15.114:0/2077777965 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0e5006aea0 0x7f0e5006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.585+0000 7f0e6effd640 1 --2- 172.21.15.114:0/2077777965 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0e5006aea0 0x7f0e5006d360 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0e700ad8b0 tx=0x7f0e600084a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.589+0000 7f0e677fe640 1 -- 172.21.15.114:0/2077777965 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e58076590 con 0x7f0e700cbd20 2023-11-04T01:41:22.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.823+0000 7f0e75475640 1 -- 172.21.15.114:0/2077777965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f0e700b1790 con 0x7f0e700cbd20 2023-11-04T01:41:22.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.826+0000 7f0e677fe640 1 -- 172.21.15.114:0/2077777965 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7773 v66) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0e58079bb0 con 0x7f0e700cbd20 2023-11-04T01:41:22.828 INFO:teuthology.orchestra.run.smithi114.stderr:failed mds gid 7773 2023-11-04T01:41:22.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.828+0000 7f0e75475640 1 -- 172.21.15.114:0/2077777965 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0e5006aea0 msgr2=0x7f0e5006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.828+0000 7f0e75475640 1 --2- 172.21.15.114:0/2077777965 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0e5006aea0 0x7f0e5006d360 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0e700ad8b0 tx=0x7f0e600084a0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.828+0000 7f0e75475640 1 -- 172.21.15.114:0/2077777965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e700cbd20 msgr2=0x7f0e700b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.828+0000 7f0e75475640 1 --2- 172.21.15.114:0/2077777965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e700cbd20 0x7f0e700b43b0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f0e58000c00 tx=0x7f0e580046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.828+0000 7f0e75475640 1 -- 172.21.15.114:0/2077777965 shutdown_connections 2023-11-04T01:41:22.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.828+0000 7f0e75475640 1 --2- 172.21.15.114:0/2077777965 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0e5006aea0 0x7f0e5006d360 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.828+0000 7f0e75475640 1 --2- 172.21.15.114:0/2077777965 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e700ceed0 0x7f0e700b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.828+0000 7f0e75475640 1 --2- 172.21.15.114:0/2077777965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e700cbd20 0x7f0e700b43b0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.828+0000 7f0e75475640 1 --2- 172.21.15.114:0/2077777965 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e7006e5a0 0x7f0e7015a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.828+0000 7f0e75475640 1 -- 172.21.15.114:0/2077777965 >> 172.21.15.114:0/2077777965 conn(0x7f0e7006bcb0 msgr2=0x7f0e700cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:22.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.828+0000 7f0e75475640 1 -- 172.21.15.114:0/2077777965 shutdown_connections 2023-11-04T01:41:22.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.829+0000 7f0e75475640 1 -- 172.21.15.114:0/2077777965 wait complete. 2023-11-04T01:41:22.842 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:41:22.843 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:41:22.843 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:41:22.843 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:22.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:22.843 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:41:22.843 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:41:22.844 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:41:22.846 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:41:22.846 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:22.922 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2023-11-04T01:41:22.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.947+0000 7f170207c640 1 Processor -- start 2023-11-04T01:41:22.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.947+0000 7f170207c640 1 -- start start 2023-11-04T01:41:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.948+0000 7f170207c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f16fc159c70 0x7f16fc0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.948+0000 7f170207c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16fc0b4110 con 0x7f16fc0b0ae0 2023-11-04T01:41:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.948+0000 7f170207c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16fc0b43f0 con 0x7f16fc06db20 2023-11-04T01:41:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.948+0000 7f170207c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16fc0b49b0 con 0x7f16fc159c70 2023-11-04T01:41:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.948+0000 7f16fb7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f16fc159c70 0x7f16fc0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.948+0000 7f16fbfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f16fc0b0ae0 0x7f16fc15d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52390/0 (socket says 172.21.15.114:52390) 2023-11-04T01:41:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.948+0000 7f16fbfff640 1 -- 172.21.15.114:0/1703153261 learned_addr learned my addr 172.21.15.114:0/1703153261 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.948+0000 7f16fb7fe640 1 -- 172.21.15.114:0/1703153261 >> v1:172.21.15.141:6789/0 conn(0x7f16fc06db20 legacy=0x7f16fc0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.948+0000 7f16fb7fe640 1 -- 172.21.15.114:0/1703153261 >> v1:172.21.15.114:6789/0 conn(0x7f16fc0b0ae0 legacy=0x7f16fc15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.948+0000 7f16fa7fc640 1 -- 172.21.15.114:0/1703153261 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796596834 0 0) 0x7f16fc0b4110 con 0x7f16fc0b0ae0 2023-11-04T01:41:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.948+0000 7f16fb7fe640 1 -- 172.21.15.114:0/1703153261 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc0b46d0 con 0x7f16fc159c70 2023-11-04T01:41:22.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.949+0000 7f16fb7fe640 1 --2- 172.21.15.114:0/1703153261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16fc159c70 0x7f16fc0ce370 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0097a0 tx=0x7f16ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19b6d940003bfdd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.949+0000 7f16fa7fc640 1 -- 172.21.15.114:0/1703153261 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec031830 con 0x7f16fc159c70 2023-11-04T01:41:22.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.949+0000 7f16fa7fc640 1 -- 172.21.15.114:0/1703153261 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec031990 con 0x7f16fc159c70 2023-11-04T01:41:22.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.949+0000 7f16fa7fc640 1 -- 172.21.15.114:0/1703153261 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec031d20 con 0x7f16fc159c70 2023-11-04T01:41:22.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.950+0000 7f170207c640 1 -- 172.21.15.114:0/1703153261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16fc159c70 msgr2=0x7f16fc0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.950+0000 7f170207c640 1 --2- 172.21.15.114:0/1703153261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16fc159c70 0x7f16fc0ce370 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0097a0 tx=0x7f16ec02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.950+0000 7f170207c640 1 -- 172.21.15.114:0/1703153261 shutdown_connections 2023-11-04T01:41:22.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.950+0000 7f170207c640 1 --2- 172.21.15.114:0/1703153261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16fc159c70 0x7f16fc0ce370 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.950+0000 7f170207c640 1 -- 172.21.15.114:0/1703153261 >> 172.21.15.114:0/1703153261 conn(0x7f16fc0ce950 msgr2=0x7f16fc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:22.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.950+0000 7f170207c640 1 -- 172.21.15.114:0/1703153261 shutdown_connections 2023-11-04T01:41:22.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.950+0000 7f170207c640 1 -- 172.21.15.114:0/1703153261 wait complete. 2023-11-04T01:41:22.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.951+0000 7f170207c640 1 Processor -- start 2023-11-04T01:41:22.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.951+0000 7f170207c640 1 -- start start 2023-11-04T01:41:22.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f170207c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16fc06db20 0x7f16fc0c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f170207c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16fc0b0ae0 0x7f16fc15b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f170207c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16fc159c70 0x7f16fc15a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f170207c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc1451c0 con 0x7f16fc159c70 2023-11-04T01:41:22.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f170207c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc1525c0 con 0x7f16fc06db20 2023-11-04T01:41:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f170207c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc15a050 con 0x7f16fc0b0ae0 2023-11-04T01:41:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f16fbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16fc159c70 0x7f16fc15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f16fbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16fc159c70 0x7f16fc15a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36896/0 (socket says 172.21.15.114:36896) 2023-11-04T01:41:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f16fbfff640 1 -- 172.21.15.114:0/4229196954 learned_addr learned my addr 172.21.15.114:0/4229196954 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f16fb7fe640 1 --2- 172.21.15.114:0/4229196954 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16fc06db20 0x7f16fc0c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f16faffd640 1 --2- 172.21.15.114:0/4229196954 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16fc0b0ae0 0x7f16fc15b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f16fbfff640 1 -- 172.21.15.114:0/4229196954 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16fc0b0ae0 msgr2=0x7f16fc15b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f16fbfff640 1 --2- 172.21.15.114:0/4229196954 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16fc0b0ae0 0x7f16fc15b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f16fbfff640 1 -- 172.21.15.114:0/4229196954 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16fc06db20 msgr2=0x7f16fc0c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f16fbfff640 1 --2- 172.21.15.114:0/4229196954 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16fc06db20 0x7f16fc0c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f16fbfff640 1 -- 172.21.15.114:0/4229196954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec009400 con 0x7f16fc159c70 2023-11-04T01:41:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f16fbfff640 1 --2- 172.21.15.114:0/4229196954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16fc159c70 0x7f16fc15a780 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f16f400c7e0 tx=0x7f16f400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.952+0000 7f16e3fff640 1 -- 172.21.15.114:0/4229196954 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f400a640 con 0x7f16fc159c70 2023-11-04T01:41:22.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.953+0000 7f16e3fff640 1 -- 172.21.15.114:0/4229196954 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f400a7a0 con 0x7f16fc159c70 2023-11-04T01:41:22.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.953+0000 7f170207c640 1 -- 172.21.15.114:0/4229196954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16fc15bec0 con 0x7f16fc159c70 2023-11-04T01:41:22.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.953+0000 7f16e3fff640 1 -- 172.21.15.114:0/4229196954 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f400ab30 con 0x7f16fc159c70 2023-11-04T01:41:22.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.953+0000 7f170207c640 1 -- 172.21.15.114:0/4229196954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16fc15c3d0 con 0x7f16fc159c70 2023-11-04T01:41:22.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.954+0000 7f170207c640 1 -- 172.21.15.114:0/4229196954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16fc074290 con 0x7f16fc159c70 2023-11-04T01:41:22.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.954+0000 7f16e3fff640 1 -- 172.21.15.114:0/4229196954 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16f400ac90 con 0x7f16fc159c70 2023-11-04T01:41:22.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.954+0000 7f16e3fff640 1 --2- 172.21.15.114:0/4229196954 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f16e806aea0 0x7f16e806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.954+0000 7f16e3fff640 1 -- 172.21.15.114:0/4229196954 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f16f4089570 con 0x7f16fc159c70 2023-11-04T01:41:22.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.954+0000 7f16fb7fe640 1 --2- 172.21.15.114:0/4229196954 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f16e806aea0 0x7f16e806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.955+0000 7f16fb7fe640 1 --2- 172.21.15.114:0/4229196954 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f16e806aea0 0x7f16e806d360 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f16ec036000 tx=0x7f16ec03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:22.958+0000 7f16e3fff640 1 -- 172.21.15.114:0/4229196954 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f16f4053ed0 con 0x7f16fc159c70 2023-11-04T01:41:23.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:23.157+0000 7f170207c640 1 -- 172.21.15.114:0/4229196954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16fc06d3f0 con 0x7f16fc159c70 2023-11-04T01:41:23.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:23.158+0000 7f16e3fff640 1 -- 172.21.15.114:0/4229196954 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4149 (secure 0 0 0) 0x7f16f4018090 con 0x7f16fc159c70 2023-11-04T01:41:23.160 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:23.160 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:22.832514+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7899,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7899":{"gid":7899,"name":"a","rank":0,"incarnation":67,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:23.160 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 67 2023-11-04T01:41:23.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:23.160+0000 7f170207c640 1 -- 172.21.15.114:0/4229196954 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f16e806aea0 msgr2=0x7f16e806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:23.160+0000 7f170207c640 1 --2- 172.21.15.114:0/4229196954 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f16e806aea0 0x7f16e806d360 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f16ec036000 tx=0x7f16ec03c040 comp rx=0 tx=0).stop 2023-11-04T01:41:23.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:23.160+0000 7f170207c640 1 -- 172.21.15.114:0/4229196954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16fc159c70 msgr2=0x7f16fc15a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:23.160+0000 7f170207c640 1 --2- 172.21.15.114:0/4229196954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16fc159c70 0x7f16fc15a780 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f16f400c7e0 tx=0x7f16f400cca0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:23.160+0000 7f170207c640 1 -- 172.21.15.114:0/4229196954 shutdown_connections 2023-11-04T01:41:23.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:23.160+0000 7f170207c640 1 --2- 172.21.15.114:0/4229196954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16fc159c70 0x7f16fc15a780 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:23.160+0000 7f170207c640 1 --2- 172.21.15.114:0/4229196954 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16fc0b0ae0 0x7f16fc15b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:23.160+0000 7f170207c640 1 --2- 172.21.15.114:0/4229196954 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f16e806aea0 0x7f16e806d360 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:23.160+0000 7f170207c640 1 --2- 172.21.15.114:0/4229196954 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16fc06db20 0x7f16fc0c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:23.160+0000 7f170207c640 1 -- 172.21.15.114:0/4229196954 >> 172.21.15.114:0/4229196954 conn(0x7f16fc0ce950 msgr2=0x7f16fc0cbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:23.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:23.160+0000 7f170207c640 1 -- 172.21.15.114:0/4229196954 shutdown_connections 2023-11-04T01:41:23.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:23.160+0000 7f170207c640 1 -- 172.21.15.114:0/4229196954 wait complete. 2023-11-04T01:41:23.172 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:41:25.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:41:28.174 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:28.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.283+0000 7f71121cc640 1 Processor -- start 2023-11-04T01:41:28.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.284+0000 7f71121cc640 1 -- start start 2023-11-04T01:41:28.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.284+0000 7f71121cc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f710c0ce240 0x7f710c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.284+0000 7f71121cc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f710c157540 0x7f710c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.284+0000 7f71121cc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710c15e000 con 0x7f710c0cde60 2023-11-04T01:41:28.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.284+0000 7f71121cc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f710c15e5c0 con 0x7f710c157540 2023-11-04T01:41:28.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.284+0000 7f71121cc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f710c15e2e0 con 0x7f710c0ce240 2023-11-04T01:41:28.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.284+0000 7f710bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f710c157540 0x7f710c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.285+0000 7f710bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f710c157540 0x7f710c0d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43088/0 (socket says 172.21.15.114:43088) 2023-11-04T01:41:28.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.285+0000 7f710bfff640 1 -- 172.21.15.114:0/455060803 learned_addr learned my addr 172.21.15.114:0/455060803 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:28.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.285+0000 7f7102ffd640 1 --2- 172.21.15.114:0/455060803 >> v2:172.21.15.141:3300/0 conn(0x7f710c0ce240 0x7f710c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.285+0000 7f710bfff640 1 -- 172.21.15.114:0/455060803 >> v2:172.21.15.141:3300/0 conn(0x7f710c0ce240 msgr2=0x7f710c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:28.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.285+0000 7f710bfff640 1 --2- 172.21.15.114:0/455060803 >> v2:172.21.15.141:3300/0 conn(0x7f710c0ce240 0x7f710c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.285+0000 7f710bfff640 1 -- 172.21.15.114:0/455060803 >> v1:172.21.15.141:6789/0 conn(0x7f710c0cde60 legacy=0x7f710c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.285+0000 7f710bfff640 1 -- 172.21.15.114:0/455060803 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c0d1120 con 0x7f710c157540 2023-11-04T01:41:28.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.286+0000 7f710bfff640 1 --2- 172.21.15.114:0/455060803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f710c157540 0x7f710c0d1920 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f710c0cf5f0 tx=0x7f710402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07a61832348fb14 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.286+0000 7f710affd640 1 -- 172.21.15.114:0/455060803 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710402cb20 con 0x7f710c157540 2023-11-04T01:41:28.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.286+0000 7f710affd640 1 -- 172.21.15.114:0/455060803 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710402cc80 con 0x7f710c157540 2023-11-04T01:41:28.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.286+0000 7f710affd640 1 -- 172.21.15.114:0/455060803 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040343f0 con 0x7f710c157540 2023-11-04T01:41:28.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.286+0000 7f71121cc640 1 -- 172.21.15.114:0/455060803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f710c157540 msgr2=0x7f710c0d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.286+0000 7f71121cc640 1 --2- 172.21.15.114:0/455060803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f710c157540 0x7f710c0d1920 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f710c0cf5f0 tx=0x7f710402bf80 comp rx=0 tx=0).stop 2023-11-04T01:41:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.286+0000 7f71121cc640 1 -- 172.21.15.114:0/455060803 shutdown_connections 2023-11-04T01:41:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.286+0000 7f71121cc640 1 --2- 172.21.15.114:0/455060803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f710c157540 0x7f710c0d1920 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.286+0000 7f71121cc640 1 --2- 172.21.15.114:0/455060803 >> v2:172.21.15.141:3300/0 conn(0x7f710c0ce240 0x7f710c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.286+0000 7f71121cc640 1 -- 172.21.15.114:0/455060803 >> 172.21.15.114:0/455060803 conn(0x7f710c071f30 msgr2=0x7f710c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.286+0000 7f71121cc640 1 -- 172.21.15.114:0/455060803 shutdown_connections 2023-11-04T01:41:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.286+0000 7f71121cc640 1 -- 172.21.15.114:0/455060803 wait complete. 2023-11-04T01:41:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.287+0000 7f71121cc640 1 Processor -- start 2023-11-04T01:41:28.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.288+0000 7f71121cc640 1 -- start start 2023-11-04T01:41:28.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.288+0000 7f71121cc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f710c0cde60 0x7f710c0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.288+0000 7f71121cc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f710c0ce240 0x7f710c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.288+0000 7f71121cc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f710c157540 0x7f710c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.288+0000 7f71121cc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c147e20 con 0x7f710c0ce240 2023-11-04T01:41:28.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.288+0000 7f71121cc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c1f34f0 con 0x7f710c0cde60 2023-11-04T01:41:28.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.288+0000 7f71121cc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710c14ac50 con 0x7f710c157540 2023-11-04T01:41:28.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f7102ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f710c0ce240 0x7f710c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f7102ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f710c0ce240 0x7f710c0cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43094/0 (socket says 172.21.15.114:43094) 2023-11-04T01:41:28.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f7102ffd640 1 -- 172.21.15.114:0/4109296348 learned_addr learned my addr 172.21.15.114:0/4109296348 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:28.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f710b7fe640 1 --2- 172.21.15.114:0/4109296348 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f710c0cde60 0x7f710c0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f7102ffd640 1 -- 172.21.15.114:0/4109296348 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f710c157540 msgr2=0x7f710c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f710bfff640 1 --2- 172.21.15.114:0/4109296348 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f710c157540 0x7f710c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f7102ffd640 1 --2- 172.21.15.114:0/4109296348 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f710c157540 0x7f710c0cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f7102ffd640 1 -- 172.21.15.114:0/4109296348 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f710c0cde60 msgr2=0x7f710c0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f7102ffd640 1 --2- 172.21.15.114:0/4109296348 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f710c0cde60 0x7f710c0b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f7102ffd640 1 -- 172.21.15.114:0/4109296348 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7104009b30 con 0x7f710c0ce240 2023-11-04T01:41:28.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f710b7fe640 1 --2- 172.21.15.114:0/4109296348 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f710c0cde60 0x7f710c0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:28.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f7102ffd640 1 --2- 172.21.15.114:0/4109296348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f710c0ce240 0x7f710c0cc0c0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f70f400d800 tx=0x7f70f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f7108ff9640 1 -- 172.21.15.114:0/4109296348 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f400b6c0 con 0x7f710c0ce240 2023-11-04T01:41:28.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f7108ff9640 1 -- 172.21.15.114:0/4109296348 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f400b820 con 0x7f710c0ce240 2023-11-04T01:41:28.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f7108ff9640 1 -- 172.21.15.114:0/4109296348 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f400bbb0 con 0x7f710c0ce240 2023-11-04T01:41:28.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f71121cc640 1 -- 172.21.15.114:0/4109296348 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710c148030 con 0x7f710c0ce240 2023-11-04T01:41:28.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.289+0000 7f71121cc640 1 -- 172.21.15.114:0/4109296348 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710c1485f0 con 0x7f710c0ce240 2023-11-04T01:41:28.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.290+0000 7f71121cc640 1 -- 172.21.15.114:0/4109296348 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710c074290 con 0x7f710c0ce240 2023-11-04T01:41:28.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.291+0000 7f7108ff9640 1 -- 172.21.15.114:0/4109296348 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70f400bd10 con 0x7f710c0ce240 2023-11-04T01:41:28.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.291+0000 7f7108ff9640 1 --2- 172.21.15.114:0/4109296348 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70ec06ae70 0x7f70ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.291+0000 7f710b7fe640 1 --2- 172.21.15.114:0/4109296348 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70ec06ae70 0x7f70ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.291+0000 7f7108ff9640 1 -- 172.21.15.114:0/4109296348 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f70f408a270 con 0x7f710c0ce240 2023-11-04T01:41:28.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.292+0000 7f710b7fe640 1 --2- 172.21.15.114:0/4109296348 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70ec06ae70 0x7f70ec06d330 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f710c0b7e40 tx=0x7f70fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.296+0000 7f7108ff9640 1 -- 172.21.15.114:0/4109296348 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f70f4054c60 con 0x7f710c0ce240 2023-11-04T01:41:28.304 INFO:tasks.ceph.mds.a.smithi114.stderr:2023-11-04T01:41:28.302+0000 7fd04fb0c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:28.304 INFO:tasks.ceph.mds.a.smithi114.stderr:2023-11-04T01:41:28.302+0000 7fd04fb0c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:28.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.495+0000 7f71121cc640 1 -- 172.21.15.114:0/4109296348 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f710c0b8940 con 0x7f710c0ce240 2023-11-04T01:41:28.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.495+0000 7f7108ff9640 1 -- 172.21.15.114:0/4109296348 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f70f4058280 con 0x7f710c0ce240 2023-11-04T01:41:28.497 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:28.497 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":71,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8013,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:25.851340+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7899,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7899":{"gid":7899,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:28.498 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 71 2023-11-04T01:41:28.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.497+0000 7f71121cc640 1 -- 172.21.15.114:0/4109296348 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70ec06ae70 msgr2=0x7f70ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.497+0000 7f71121cc640 1 --2- 172.21.15.114:0/4109296348 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70ec06ae70 0x7f70ec06d330 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f710c0b7e40 tx=0x7f70fc009040 comp rx=0 tx=0).stop 2023-11-04T01:41:28.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.497+0000 7f71121cc640 1 -- 172.21.15.114:0/4109296348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f710c0ce240 msgr2=0x7f710c0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.497+0000 7f71121cc640 1 --2- 172.21.15.114:0/4109296348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f710c0ce240 0x7f710c0cc0c0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f70f400d800 tx=0x7f70f400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.497+0000 7f71121cc640 1 -- 172.21.15.114:0/4109296348 shutdown_connections 2023-11-04T01:41:28.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.497+0000 7f71121cc640 1 --2- 172.21.15.114:0/4109296348 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f710c157540 0x7f710c0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.497+0000 7f71121cc640 1 --2- 172.21.15.114:0/4109296348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f710c0ce240 0x7f710c0cc0c0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.497+0000 7f71121cc640 1 --2- 172.21.15.114:0/4109296348 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f70ec06ae70 0x7f70ec06d330 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.497+0000 7f71121cc640 1 --2- 172.21.15.114:0/4109296348 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f710c0cde60 0x7f710c0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.497+0000 7f71121cc640 1 -- 172.21.15.114:0/4109296348 >> 172.21.15.114:0/4109296348 conn(0x7f710c071f30 msgr2=0x7f710c072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:28.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.497+0000 7f71121cc640 1 -- 172.21.15.114:0/4109296348 shutdown_connections 2023-11-04T01:41:28.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.497+0000 7f71121cc640 1 -- 172.21.15.114:0/4109296348 wait complete. 2023-11-04T01:41:28.509 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:41:28.509 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:28.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.606+0000 7ff881ae7640 1 Processor -- start 2023-11-04T01:41:28.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.606+0000 7ff881ae7640 1 -- start start 2023-11-04T01:41:28.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.607+0000 7ff881ae7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff87c0b0ae0 0x7ff87c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.607+0000 7ff881ae7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff87c06db20 0x7ff87c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.607+0000 7ff881ae7640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff87c0b4110 con 0x7ff87c159c70 2023-11-04T01:41:28.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.607+0000 7ff881ae7640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff87c0b49b0 con 0x7ff87c06db20 2023-11-04T01:41:28.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.607+0000 7ff881ae7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c0b43f0 con 0x7ff87c0b0ae0 2023-11-04T01:41:28.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.607+0000 7ff87bfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff87c06db20 0x7ff87c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.607+0000 7ff87b7fe640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7ff87c159c70 0x7ff87c0b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:60742/0 (socket says 172.21.15.114:60742) 2023-11-04T01:41:28.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.607+0000 7ff872ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff87c0b0ae0 0x7ff87c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.607+0000 7ff87b7fe640 1 -- 172.21.15.114:0/1804679139 learned_addr learned my addr 172.21.15.114:0/1804679139 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:28.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.607+0000 7ff872ffd640 1 -- 172.21.15.114:0/1804679139 >> v2:172.21.15.141:3300/0 conn(0x7ff87c06db20 msgr2=0x7ff87c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:28.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.607+0000 7ff872ffd640 1 --2- 172.21.15.114:0/1804679139 >> v2:172.21.15.141:3300/0 conn(0x7ff87c06db20 0x7ff87c15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.608+0000 7ff872ffd640 1 -- 172.21.15.114:0/1804679139 >> v1:172.21.15.141:6789/0 conn(0x7ff87c159c70 legacy=0x7ff87c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.608+0000 7ff872ffd640 1 -- 172.21.15.114:0/1804679139 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c0b46d0 con 0x7ff87c0b0ae0 2023-11-04T01:41:28.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.608+0000 7ff87bfff640 1 --2- 172.21.15.114:0/1804679139 >> v2:172.21.15.141:3300/0 conn(0x7ff87c06db20 0x7ff87c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:28.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.608+0000 7ff872ffd640 1 --2- 172.21.15.114:0/1804679139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff87c0b0ae0 0x7ff87c0ce370 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff8640097a0 tx=0x7ff86402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ffcbeb434a6f725 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.608+0000 7ff87affd640 1 -- 172.21.15.114:0/1804679139 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864031830 con 0x7ff87c0b0ae0 2023-11-04T01:41:28.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.609+0000 7ff87affd640 1 -- 172.21.15.114:0/1804679139 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff864031990 con 0x7ff87c0b0ae0 2023-11-04T01:41:28.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.609+0000 7ff87affd640 1 -- 172.21.15.114:0/1804679139 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864031d20 con 0x7ff87c0b0ae0 2023-11-04T01:41:28.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.609+0000 7ff881ae7640 1 -- 172.21.15.114:0/1804679139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff87c0b0ae0 msgr2=0x7ff87c0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.609+0000 7ff881ae7640 1 --2- 172.21.15.114:0/1804679139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff87c0b0ae0 0x7ff87c0ce370 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff8640097a0 tx=0x7ff86402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.609+0000 7ff881ae7640 1 -- 172.21.15.114:0/1804679139 shutdown_connections 2023-11-04T01:41:28.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.609+0000 7ff881ae7640 1 --2- 172.21.15.114:0/1804679139 >> v2:172.21.15.141:3300/0 conn(0x7ff87c06db20 0x7ff87c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.609+0000 7ff881ae7640 1 --2- 172.21.15.114:0/1804679139 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff87c0b0ae0 0x7ff87c0ce370 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.609+0000 7ff881ae7640 1 -- 172.21.15.114:0/1804679139 >> 172.21.15.114:0/1804679139 conn(0x7ff87c0ce950 msgr2=0x7ff87c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:28.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.609+0000 7ff881ae7640 1 -- 172.21.15.114:0/1804679139 shutdown_connections 2023-11-04T01:41:28.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.609+0000 7ff881ae7640 1 -- 172.21.15.114:0/1804679139 wait complete. 2023-11-04T01:41:28.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.610+0000 7ff881ae7640 1 Processor -- start 2023-11-04T01:41:28.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.610+0000 7ff881ae7640 1 -- start start 2023-11-04T01:41:28.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.611+0000 7ff881ae7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87c06db20 0x7ff87c0c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.611+0000 7ff881ae7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff87c0b0ae0 0x7ff87c15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.611+0000 7ff881ae7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff87c159c70 0x7ff87c142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.611+0000 7ff881ae7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c140ec0 con 0x7ff87c06db20 2023-11-04T01:41:28.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.611+0000 7ff881ae7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c0c4da0 con 0x7ff87c159c70 2023-11-04T01:41:28.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.611+0000 7ff881ae7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c1576a0 con 0x7ff87c0b0ae0 2023-11-04T01:41:28.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.611+0000 7ff87b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87c06db20 0x7ff87c0c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.611+0000 7ff87b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87c06db20 0x7ff87c0c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43106/0 (socket says 172.21.15.114:43106) 2023-11-04T01:41:28.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.611+0000 7ff87b7fe640 1 -- 172.21.15.114:0/2037254017 learned_addr learned my addr 172.21.15.114:0/2037254017 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:28.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.611+0000 7ff872ffd640 1 --2- 172.21.15.114:0/2037254017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff87c0b0ae0 0x7ff87c15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.611+0000 7ff87bfff640 1 --2- 172.21.15.114:0/2037254017 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff87c159c70 0x7ff87c142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.612+0000 7ff87b7fe640 1 -- 172.21.15.114:0/2037254017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff87c0b0ae0 msgr2=0x7ff87c15a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.612+0000 7ff87b7fe640 1 --2- 172.21.15.114:0/2037254017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff87c0b0ae0 0x7ff87c15a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.612+0000 7ff87b7fe640 1 -- 172.21.15.114:0/2037254017 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff87c159c70 msgr2=0x7ff87c142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.612+0000 7ff87b7fe640 1 --2- 172.21.15.114:0/2037254017 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff87c159c70 0x7ff87c142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.612+0000 7ff87b7fe640 1 -- 172.21.15.114:0/2037254017 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff874009a70 con 0x7ff87c06db20 2023-11-04T01:41:28.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.612+0000 7ff87b7fe640 1 --2- 172.21.15.114:0/2037254017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87c06db20 0x7ff87c0c84e0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00c4a0 tx=0x7ff86c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.612+0000 7ff878ff9640 1 -- 172.21.15.114:0/2037254017 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c005ce0 con 0x7ff87c06db20 2023-11-04T01:41:28.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.612+0000 7ff878ff9640 1 -- 172.21.15.114:0/2037254017 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c005e40 con 0x7ff87c06db20 2023-11-04T01:41:28.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.612+0000 7ff881ae7640 1 -- 172.21.15.114:0/2037254017 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff864009400 con 0x7ff87c06db20 2023-11-04T01:41:28.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.612+0000 7ff878ff9640 1 -- 172.21.15.114:0/2037254017 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c0072d0 con 0x7ff87c06db20 2023-11-04T01:41:28.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.612+0000 7ff881ae7640 1 -- 172.21.15.114:0/2037254017 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87c157c60 con 0x7ff87c06db20 2023-11-04T01:41:28.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.613+0000 7ff881ae7640 1 -- 172.21.15.114:0/2037254017 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff87c074290 con 0x7ff87c06db20 2023-11-04T01:41:28.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.613+0000 7ff878ff9640 1 -- 172.21.15.114:0/2037254017 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff86c0074f0 con 0x7ff87c06db20 2023-11-04T01:41:28.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.614+0000 7ff878ff9640 1 --2- 172.21.15.114:0/2037254017 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff85c06ae70 0x7ff85c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.614+0000 7ff878ff9640 1 -- 172.21.15.114:0/2037254017 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7ff86c0891c0 con 0x7ff87c06db20 2023-11-04T01:41:28.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.614+0000 7ff872ffd640 1 --2- 172.21.15.114:0/2037254017 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff85c06ae70 0x7ff85c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.614+0000 7ff872ffd640 1 --2- 172.21.15.114:0/2037254017 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff85c06ae70 0x7ff85c06d330 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff864036000 tx=0x7ff86403d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.618+0000 7ff878ff9640 1 -- 172.21.15.114:0/2037254017 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff86c053be0 con 0x7ff87c06db20 2023-11-04T01:41:28.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.822+0000 7ff881ae7640 1 -- 172.21.15.114:0/2037254017 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff87c06d3f0 con 0x7ff87c06db20 2023-11-04T01:41:28.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.822+0000 7ff878ff9640 1 -- 172.21.15.114:0/2037254017 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4944 (secure 0 0 0) 0x7ff86c057200 con 0x7ff87c06db20 2023-11-04T01:41:28.824 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:28.824 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":71,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8013,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:25.851340+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7899,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7899":{"gid":7899,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:28.825 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 71 2023-11-04T01:41:28.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.824+0000 7ff881ae7640 1 -- 172.21.15.114:0/2037254017 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff85c06ae70 msgr2=0x7ff85c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.824+0000 7ff881ae7640 1 --2- 172.21.15.114:0/2037254017 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff85c06ae70 0x7ff85c06d330 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff864036000 tx=0x7ff86403d040 comp rx=0 tx=0).stop 2023-11-04T01:41:28.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.824+0000 7ff881ae7640 1 -- 172.21.15.114:0/2037254017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87c06db20 msgr2=0x7ff87c0c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.824+0000 7ff881ae7640 1 --2- 172.21.15.114:0/2037254017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87c06db20 0x7ff87c0c84e0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00c4a0 tx=0x7ff86c00c8a0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.824+0000 7ff881ae7640 1 -- 172.21.15.114:0/2037254017 shutdown_connections 2023-11-04T01:41:28.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.824+0000 7ff881ae7640 1 --2- 172.21.15.114:0/2037254017 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff85c06ae70 0x7ff85c06d330 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.824+0000 7ff881ae7640 1 --2- 172.21.15.114:0/2037254017 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff87c159c70 0x7ff87c142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.824+0000 7ff881ae7640 1 --2- 172.21.15.114:0/2037254017 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff87c0b0ae0 0x7ff87c15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.824+0000 7ff881ae7640 1 --2- 172.21.15.114:0/2037254017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87c06db20 0x7ff87c0c84e0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.824+0000 7ff881ae7640 1 -- 172.21.15.114:0/2037254017 >> 172.21.15.114:0/2037254017 conn(0x7ff87c0ce950 msgr2=0x7ff87c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:28.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.824+0000 7ff881ae7640 1 -- 172.21.15.114:0/2037254017 shutdown_connections 2023-11-04T01:41:28.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:28.824+0000 7ff881ae7640 1 -- 172.21.15.114:0/2037254017 wait complete. 2023-11-04T01:41:29.239 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:51.430343+0000', 'modified': '2023-11-04T01:41:25.851340+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7899, 'mds_1': 6298}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6298': {'gid': 6298, 'name': 'b', 'rank': 1, 'incarnation': 45, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.141:6834/1296600989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.141:6832', 'nonce': 1296600989}, {'type': 'v1', 'addr': '172.21.15.141:6834', 'nonce': 1296600989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7899': {'gid': 7899, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.114:6837/1052115332', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6835', 'nonce': 1052115332}, {'type': 'v1', 'addr': '172.21.15.114:6837', 'nonce': 1052115332}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:41:29.239 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:41:29.240 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:41:29.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.339+0000 7f163007c640 1 Processor -- start 2023-11-04T01:41:29.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.339+0000 7f163007c640 1 -- start start 2023-11-04T01:41:29.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.340+0000 7f163007c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16280b2d30 0x7f162806bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.340+0000 7f163007c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f162806c1d0 0x7f16280cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.340+0000 7f163007c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162806ca40 con 0x7f1628160430 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.340+0000 7f163007c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16280cb580 con 0x7f162806c1d0 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.340+0000 7f163007c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162806cd20 con 0x7f16280b2d30 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.340+0000 7f162e619640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f162806c1d0 0x7f16280cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.340+0000 7f162e619640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f162806c1d0 0x7f16280cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43118/0 (socket says 172.21.15.114:43118) 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.340+0000 7f162e619640 1 -- 172.21.15.114:0/1062081936 learned_addr learned my addr 172.21.15.114:0/1062081936 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.340+0000 7f162d617640 1 --2- 172.21.15.114:0/1062081936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16280b2d30 0x7f162806bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.340+0000 7f162e619640 1 -- 172.21.15.114:0/1062081936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16280b2d30 msgr2=0x7f162806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.340+0000 7f162e619640 1 --2- 172.21.15.114:0/1062081936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16280b2d30 0x7f162806bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.340+0000 7f162e619640 1 -- 172.21.15.114:0/1062081936 >> v1:172.21.15.141:6789/0 conn(0x7f1628160430 legacy=0x7f16280b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.340+0000 7f162e619640 1 -- 172.21.15.114:0/1062081936 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162806d000 con 0x7f162806c1d0 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.341+0000 7f162e619640 1 --2- 172.21.15.114:0/1062081936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f162806c1d0 0x7f16280cbcb0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f1620009e50 tx=0x7f162002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e4baff87d02f29 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.341+0000 7f162ce16640 1 -- 172.21.15.114:0/1062081936 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162002cb00 con 0x7f162806c1d0 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.341+0000 7f162ce16640 1 -- 172.21.15.114:0/1062081936 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162002cc60 con 0x7f162806c1d0 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.341+0000 7f162ce16640 1 -- 172.21.15.114:0/1062081936 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16200343f0 con 0x7f162806c1d0 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.342+0000 7f163007c640 1 -- 172.21.15.114:0/1062081936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f162806c1d0 msgr2=0x7f16280cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.342+0000 7f163007c640 1 --2- 172.21.15.114:0/1062081936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f162806c1d0 0x7f16280cbcb0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f1620009e50 tx=0x7f162002bf60 comp rx=0 tx=0).stop 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.342+0000 7f163007c640 1 -- 172.21.15.114:0/1062081936 shutdown_connections 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.342+0000 7f163007c640 1 --2- 172.21.15.114:0/1062081936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f162806c1d0 0x7f16280cbcb0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.342+0000 7f163007c640 1 --2- 172.21.15.114:0/1062081936 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f16280b2d30 0x7f162806bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.342+0000 7f163007c640 1 -- 172.21.15.114:0/1062081936 >> 172.21.15.114:0/1062081936 conn(0x7f162806ea20 msgr2=0x7f162806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.342+0000 7f163007c640 1 -- 172.21.15.114:0/1062081936 shutdown_connections 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.342+0000 7f163007c640 1 -- 172.21.15.114:0/1062081936 wait complete. 2023-11-04T01:41:29.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.343+0000 7f163007c640 1 Processor -- start 2023-11-04T01:41:29.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.343+0000 7f163007c640 1 -- start start 2023-11-04T01:41:29.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f163007c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f162806c1d0 0x7f16280b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f163007c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16280b2d30 0x7f1628151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f163007c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1628160430 0x7f16280b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f163007c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280c5370 con 0x7f1628160430 2023-11-04T01:41:29.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f163007c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280b3e90 con 0x7f16280b2d30 2023-11-04T01:41:29.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f163007c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16280c47a0 con 0x7f162806c1d0 2023-11-04T01:41:29.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f162e619640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1628160430 0x7f16280b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f162e619640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1628160430 0x7f16280b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43124/0 (socket says 172.21.15.114:43124) 2023-11-04T01:41:29.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f162e619640 1 -- 172.21.15.114:0/342668393 learned_addr learned my addr 172.21.15.114:0/342668393 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:29.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f162e619640 1 -- 172.21.15.114:0/342668393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f162806c1d0 msgr2=0x7f16280b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f162e619640 1 --2- 172.21.15.114:0/342668393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f162806c1d0 0x7f16280b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f162e619640 1 -- 172.21.15.114:0/342668393 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16280b2d30 msgr2=0x7f1628151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f162e619640 1 --2- 172.21.15.114:0/342668393 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16280b2d30 0x7f1628151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f162e619640 1 -- 172.21.15.114:0/342668393 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1620009b30 con 0x7f1628160430 2023-11-04T01:41:29.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f162e619640 1 --2- 172.21.15.114:0/342668393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1628160430 0x7f16280b11e0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f1620009e50 tx=0x7f1620004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f161e7fc640 1 -- 172.21.15.114:0/342668393 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620009510 con 0x7f1628160430 2023-11-04T01:41:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f161e7fc640 1 -- 172.21.15.114:0/342668393 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162003e450 con 0x7f1628160430 2023-11-04T01:41:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f161e7fc640 1 -- 172.21.15.114:0/342668393 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162003e800 con 0x7f1628160430 2023-11-04T01:41:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f163007c640 1 -- 172.21.15.114:0/342668393 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16280c4a40 con 0x7f1628160430 2023-11-04T01:41:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.344+0000 7f163007c640 1 -- 172.21.15.114:0/342668393 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16280c5000 con 0x7f1628160430 2023-11-04T01:41:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.346+0000 7f161e7fc640 1 -- 172.21.15.114:0/342668393 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f162003e960 con 0x7f1628160430 2023-11-04T01:41:29.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.346+0000 7f161e7fc640 1 --2- 172.21.15.114:0/342668393 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f160c06ae70 0x7f160c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.346+0000 7f161e7fc640 1 -- 172.21.15.114:0/342668393 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f16200ac9d0 con 0x7f1628160430 2023-11-04T01:41:29.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.346+0000 7f162de18640 1 --2- 172.21.15.114:0/342668393 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f160c06ae70 0x7f160c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.347+0000 7f162de18640 1 --2- 172.21.15.114:0/342668393 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f160c06ae70 0x7f160c06d330 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1624000f60 tx=0x7f16240079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.347+0000 7f1632c13740 1 Processor -- start 2023-11-04T01:41:29.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.347+0000 7f1632c13740 1 -- start start 2023-11-04T01:41:29.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.348+0000 7f1632c13740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0cd850 0x559f4f0a0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.348+0000 7f1632c13740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 0x559f4f0d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.348+0000 7f1632c13740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0a0c90 0x559f4f0d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.348+0000 7f1632c13740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4efb1740 con 0x559f4f0a0c90 2023-11-04T01:41:29.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.348+0000 7f1632c13740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4f0138d0 con 0x559f4f0cdc30 2023-11-04T01:41:29.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.348+0000 7f1632c13740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f4f010fc0 con 0x559f4f0cd850 2023-11-04T01:41:29.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.348+0000 7f162e619640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0a0c90 0x559f4f0d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.348+0000 7f162e619640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0a0c90 0x559f4f0d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43138/0 (socket says 172.21.15.114:43138) 2023-11-04T01:41:29.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.348+0000 7f162e619640 1 -- 172.21.15.114:0/4091600296 learned_addr learned my addr 172.21.15.114:0/4091600296 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:29.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.348+0000 7f162de18640 1 --2- 172.21.15.114:0/4091600296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0cd850 0x559f4f0a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.348+0000 7f162d617640 1 --2- 172.21.15.114:0/4091600296 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 0x559f4f0d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.348+0000 7f162e619640 1 -- 172.21.15.114:0/4091600296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0cd850 msgr2=0x559f4f0a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.348+0000 7f162e619640 1 --2- 172.21.15.114:0/4091600296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0cd850 0x559f4f0a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.348+0000 7f162e619640 1 -- 172.21.15.114:0/4091600296 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 msgr2=0x559f4f0d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.348+0000 7f162e619640 1 --2- 172.21.15.114:0/4091600296 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 0x559f4f0d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.348+0000 7f162e619640 1 -- 172.21.15.114:0/4091600296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f4efcfca0 con 0x559f4f0a0c90 2023-11-04T01:41:29.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.349+0000 7f162e619640 1 --2- 172.21.15.114:0/4091600296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0a0c90 0x559f4f0d0b20 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f1620077610 tx=0x7f162003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af2ef5c9ab7af2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.349+0000 7f160b7fe640 1 -- 172.21.15.114:0/4091600296 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162007f080 con 0x559f4f0a0c90 2023-11-04T01:41:29.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.349+0000 7f160b7fe640 1 -- 172.21.15.114:0/4091600296 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162007f260 con 0x559f4f0a0c90 2023-11-04T01:41:29.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.349+0000 7f160b7fe640 1 -- 172.21.15.114:0/4091600296 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620083410 con 0x559f4f0a0c90 2023-11-04T01:41:29.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.349+0000 7f1632c13740 1 -- 172.21.15.114:0/4091600296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0a0c90 msgr2=0x559f4f0d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.349+0000 7f1632c13740 1 --2- 172.21.15.114:0/4091600296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0a0c90 0x559f4f0d0b20 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f1620077610 tx=0x7f162003f000 comp rx=0 tx=0).stop 2023-11-04T01:41:29.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.349+0000 7f1632c13740 1 -- 172.21.15.114:0/4091600296 shutdown_connections 2023-11-04T01:41:29.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.349+0000 7f1632c13740 1 --2- 172.21.15.114:0/4091600296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0a0c90 0x559f4f0d0b20 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.349+0000 7f1632c13740 1 --2- 172.21.15.114:0/4091600296 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 0x559f4f0d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.349+0000 7f1632c13740 1 --2- 172.21.15.114:0/4091600296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0cd850 0x559f4f0a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.349+0000 7f1632c13740 1 -- 172.21.15.114:0/4091600296 >> 172.21.15.114:0/4091600296 conn(0x559f4f0a2a60 msgr2=0x559f4f0eb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.349+0000 7f1632c13740 1 -- 172.21.15.114:0/4091600296 shutdown_connections 2023-11-04T01:41:29.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.349+0000 7f1632c13740 1 -- 172.21.15.114:0/4091600296 wait complete. 2023-11-04T01:41:29.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.350+0000 7f1632c13740 1 -- start start 2023-11-04T01:41:29.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.350+0000 7f1632c13740 1 Processor -- start 2023-11-04T01:41:29.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f1632c13740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0cd850 0x559f4f0ec080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f1632c13740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 0x559f4f0e34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f1632c13740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0d2380 0x559f4f0e45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f1632c13740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4f00c8b0 con 0x559f4f0d2380 2023-11-04T01:41:29.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f1632c13740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4efc6c80 con 0x559f4f0cdc30 2023-11-04T01:41:29.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f1632c13740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f4efc6920 con 0x559f4f0cd850 2023-11-04T01:41:29.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f1632c13740 10 client.0 _ll_register_callbacks cb 0x559f4ed1eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:29.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f162e619640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0d2380 0x559f4f0e45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f162e619640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0d2380 0x559f4f0e45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43150/0 (socket says 172.21.15.114:43150) 2023-11-04T01:41:29.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f162e619640 1 -- 172.21.15.114:0/1900758092 learned_addr learned my addr 172.21.15.114:0/1900758092 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:29.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f162de18640 1 --2- 172.21.15.114:0/1900758092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0cd850 0x559f4f0ec080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f162d617640 1 --2- 172.21.15.114:0/1900758092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 0x559f4f0e34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f162e619640 1 -- 172.21.15.114:0/1900758092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0cd850 msgr2=0x559f4f0ec080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f162e619640 1 --2- 172.21.15.114:0/1900758092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0cd850 0x559f4f0ec080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f162e619640 1 -- 172.21.15.114:0/1900758092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 msgr2=0x559f4f0e34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f162e619640 1 --2- 172.21.15.114:0/1900758092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 0x559f4f0e34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f162e619640 1 -- 172.21.15.114:0/1900758092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16280c5000 con 0x559f4f0d2380 2023-11-04T01:41:29.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f162de18640 1 --2- 172.21.15.114:0/1900758092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0cd850 0x559f4f0ec080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:29.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f162e619640 1 --2- 172.21.15.114:0/1900758092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0d2380 0x559f4f0e45e0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f1620077610 tx=0x7f1620009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6611d756a297353 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f1608ff9640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:41:29.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f1608ff9640 1 -- 172.21.15.114:0/1900758092 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162007a600 con 0x559f4f0d2380 2023-11-04T01:41:29.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f1608ff9640 1 -- 172.21.15.114:0/1900758092 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f1620036da0 con 0x559f4f0d2380 2023-11-04T01:41:29.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.351+0000 7f1632c13740 1 -- 172.21.15.114:0/1900758092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f4efb8bf0 con 0x559f4f0d2380 2023-11-04T01:41:29.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.352+0000 7f1608ff9640 1 -- 172.21.15.114:0/1900758092 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f162007a760 con 0x559f4f0d2380 2023-11-04T01:41:29.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.352+0000 7f1632c13740 10 client.8043 fetch_fsmap learned FSMap version 71 2023-11-04T01:41:29.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.352+0000 7f1632c13740 1 -- 172.21.15.114:0/1900758092 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x559f4f00af30 con 0x559f4f0d2380 2023-11-04T01:41:29.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.352+0000 7f1608ff9640 1 -- 172.21.15.114:0/1900758092 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f4efb8bf0 con 0x559f4f0d2380 2023-11-04T01:41:29.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.352+0000 7f1608ff9640 1 -- 172.21.15.114:0/1900758092 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 71) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f162004f020 con 0x559f4f0d2380 2023-11-04T01:41:29.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.352+0000 7f1632c13740 10 client.8043 fetch_fsmap finished waiting for FSMap version 71 2023-11-04T01:41:29.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.352+0000 7f1632c13740 10 client.8043 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:41:29.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.352+0000 7f1632c13740 20 client.8043 populate_metadata read hostname 'smithi114' 2023-11-04T01:41:29.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.352+0000 7f1632c13740 1 --2- 172.21.15.114:0/1900758092 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x559f4f0c0b80 0x559f4f0e21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.352+0000 7f1632c13740 4 client.8043 mds_command: new command op to 6298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:41:29.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.352+0000 7f1632c13740 1 -- 172.21.15.114:0/1900758092 --> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f4f005890 con 0x559f4f0c0b80 2023-11-04T01:41:29.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.352+0000 7f162de18640 1 --2- 172.21.15.114:0/1900758092 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x559f4f0c0b80 0x559f4f0e21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.352+0000 7f1608ff9640 10 client.8043 ms_handle_connect on v2:172.21.15.141:6832/1296600989 2023-11-04T01:41:29.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.352+0000 7f162de18640 1 --2- 172.21.15.114:0/1900758092 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x559f4f0c0b80 0x559f4f0e21b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=45aa0ee6a8c9902f server_cookie=a26da86110df02d7 in_seq=0 out_seq=0 2023-11-04T01:41:29.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.353+0000 7f1608ff9640 1 -- 172.21.15.114:0/1900758092 <== mds.1 v2:172.21.15.141:6832/1296600989 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559f4f005890 con 0x559f4f0c0b80 2023-11-04T01:41:29.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.353+0000 7f1608ff9640 10 client.8043 handle_command_reply: tid=0 2023-11-04T01:41:29.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.353+0000 7f1632c13740 1 client.8043 shutdown 2023-11-04T01:41:29.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.353+0000 7f1632c13740 1 -- 172.21.15.114:0/1900758092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0d2380 msgr2=0x559f4f0e45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.353+0000 7f1632c13740 1 --2- 172.21.15.114:0/1900758092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0d2380 0x559f4f0e45e0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f1620077610 tx=0x7f1620009810 comp rx=0 tx=0).stop 2023-11-04T01:41:29.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.353+0000 7f1632c13740 1 -- 172.21.15.114:0/1900758092 shutdown_connections 2023-11-04T01:41:29.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.353+0000 7f1632c13740 1 --2- 172.21.15.114:0/1900758092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0d2380 0x559f4f0e45e0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.353+0000 7f1632c13740 1 --2- 172.21.15.114:0/1900758092 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x559f4f0c0b80 0x559f4f0e21b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.353+0000 7f1632c13740 1 --2- 172.21.15.114:0/1900758092 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 0x559f4f0e34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.353+0000 7f1632c13740 1 --2- 172.21.15.114:0/1900758092 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0cd850 0x559f4f0ec080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.353+0000 7f1608ff9640 0 client.8043 ms_handle_reset on v2:172.21.15.141:6832/1296600989 2023-11-04T01:41:29.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.353+0000 7f1632c13740 1 -- 172.21.15.114:0/1900758092 >> 172.21.15.114:0/1900758092 conn(0x559f4f0a0c90 msgr2=0x559f4f0a46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.353+0000 7f1632c13740 1 -- 172.21.15.114:0/1900758092 shutdown_connections 2023-11-04T01:41:29.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.353+0000 7f1632c13740 1 -- 172.21.15.114:0/1900758092 wait complete. 2023-11-04T01:41:29.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.354+0000 7f1632c13740 20 client.8043 trim_cache size 0 max 16384 2023-11-04T01:41:29.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.369+0000 7f1632c13740 1 Processor -- start 2023-11-04T01:41:29.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.369+0000 7f1632c13740 1 -- start start 2023-11-04T01:41:29.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f1632c13740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0cd850 0x559f4f0e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f1632c13740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 0x559f4f0a5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f1632c13740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0d2380 0x559f4f0a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f1632c13740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4ef8c280 con 0x559f4f0cd850 2023-11-04T01:41:29.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f1632c13740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4efd87e0 con 0x559f4f0cdc30 2023-11-04T01:41:29.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f1632c13740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f4f09c1d0 con 0x559f4f0d2380 2023-11-04T01:41:29.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f162de18640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0cd850 0x559f4f0e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f162de18640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0cd850 0x559f4f0e50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43164/0 (socket says 172.21.15.114:43164) 2023-11-04T01:41:29.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f162de18640 1 -- 172.21.15.114:0/4218567114 learned_addr learned my addr 172.21.15.114:0/4218567114 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:29.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f162de18640 1 -- 172.21.15.114:0/4218567114 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0d2380 msgr2=0x559f4f0a5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f162de18640 1 --2- 172.21.15.114:0/4218567114 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0d2380 0x559f4f0a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f162de18640 1 -- 172.21.15.114:0/4218567114 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 msgr2=0x559f4f0a5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f162de18640 1 --2- 172.21.15.114:0/4218567114 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 0x559f4f0a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f162de18640 1 -- 172.21.15.114:0/4218567114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f4f0a6f10 con 0x559f4f0cd850 2023-11-04T01:41:29.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f162de18640 1 --2- 172.21.15.114:0/4218567114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0cd850 0x559f4f0e50a0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x559f4f0c1020 tx=0x7f1624012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44190eb681fd0c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f160bfff640 1 -- 172.21.15.114:0/4218567114 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624023460 con 0x559f4f0cd850 2023-11-04T01:41:29.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f160bfff640 1 -- 172.21.15.114:0/4218567114 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162401c070 con 0x559f4f0cd850 2023-11-04T01:41:29.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.370+0000 7f160bfff640 1 -- 172.21.15.114:0/4218567114 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16240237e0 con 0x559f4f0cd850 2023-11-04T01:41:29.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.371+0000 7f1632c13740 1 -- 172.21.15.114:0/4218567114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0cd850 msgr2=0x559f4f0e50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.371+0000 7f1632c13740 1 --2- 172.21.15.114:0/4218567114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0cd850 0x559f4f0e50a0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x559f4f0c1020 tx=0x7f1624012000 comp rx=0 tx=0).stop 2023-11-04T01:41:29.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.371+0000 7f1632c13740 1 -- 172.21.15.114:0/4218567114 shutdown_connections 2023-11-04T01:41:29.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.371+0000 7f1632c13740 1 --2- 172.21.15.114:0/4218567114 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0d2380 0x559f4f0a5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.371+0000 7f1632c13740 1 --2- 172.21.15.114:0/4218567114 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 0x559f4f0a5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.371+0000 7f1632c13740 1 --2- 172.21.15.114:0/4218567114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0cd850 0x559f4f0e50a0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.371+0000 7f1632c13740 1 -- 172.21.15.114:0/4218567114 >> 172.21.15.114:0/4218567114 conn(0x559f4f0a0c90 msgr2=0x559f4f0e43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.371+0000 7f1632c13740 1 -- 172.21.15.114:0/4218567114 shutdown_connections 2023-11-04T01:41:29.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.371+0000 7f1632c13740 1 -- 172.21.15.114:0/4218567114 wait complete. 2023-11-04T01:41:29.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.371+0000 7f1632c13740 1 -- start start 2023-11-04T01:41:29.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.371+0000 7f1632c13740 1 Processor -- start 2023-11-04T01:41:29.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.372+0000 7f1632c13740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0cd850 0x559f4f1557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.372+0000 7f1632c13740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 0x559f4f0e9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.372+0000 7f1632c13740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0d2380 0x559f4f0ea020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.372+0000 7f1632c13740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4f0e6b40 con 0x559f4f0cd850 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.372+0000 7f1632c13740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4f0fe060 con 0x559f4f0cdc30 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.372+0000 7f1632c13740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f4f0e6760 con 0x559f4f0d2380 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.372+0000 7f1632c13740 10 client.0 _ll_register_callbacks cb 0x7f162002cb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.372+0000 7f162de18640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0cd850 0x559f4f1557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.372+0000 7f162de18640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0cd850 0x559f4f1557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43170/0 (socket says 172.21.15.114:43170) 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.372+0000 7f162de18640 1 -- 172.21.15.114:0/88608692 learned_addr learned my addr 172.21.15.114:0/88608692 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.372+0000 7f162e619640 1 --2- 172.21.15.114:0/88608692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0d2380 0x559f4f0ea020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.372+0000 7f162d617640 1 --2- 172.21.15.114:0/88608692 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 0x559f4f0e9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f162de18640 1 -- 172.21.15.114:0/88608692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0d2380 msgr2=0x559f4f0ea020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f162de18640 1 --2- 172.21.15.114:0/88608692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0d2380 0x559f4f0ea020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f162de18640 1 -- 172.21.15.114:0/88608692 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 msgr2=0x559f4f0e9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f162de18640 1 --2- 172.21.15.114:0/88608692 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 0x559f4f0e9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f162de18640 1 -- 172.21.15.114:0/88608692 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162806ca40 con 0x559f4f0cd850 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f162e619640 1 --2- 172.21.15.114:0/88608692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0d2380 0x559f4f0ea020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f162de18640 1 --2- 172.21.15.114:0/88608692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0cd850 0x559f4f1557e0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f1624026040 tx=0x7f16240010f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f34a3a5f4fb045 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f1608ff9640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f1608ff9640 1 -- 172.21.15.114:0/88608692 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624006be0 con 0x559f4f0cd850 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f1608ff9640 1 -- 172.21.15.114:0/88608692 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f1624006d40 con 0x559f4f0cd850 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f1632c13740 1 -- 172.21.15.114:0/88608692 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f162007f260 con 0x559f4f0cd850 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f1608ff9640 1 -- 172.21.15.114:0/88608692 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1624007040 con 0x559f4f0cd850 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f1632c13740 10 client.8049 fetch_fsmap learned FSMap version 71 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f1632c13740 1 -- 172.21.15.114:0/88608692 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x559f4efa8d10 con 0x559f4f0cd850 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f1608ff9640 1 -- 172.21.15.114:0/88608692 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162007f260 con 0x559f4f0cd850 2023-11-04T01:41:29.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f1608ff9640 1 -- 172.21.15.114:0/88608692 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 71) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f1624021050 con 0x559f4f0cd850 2023-11-04T01:41:29.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f1632c13740 10 client.8049 fetch_fsmap finished waiting for FSMap version 71 2023-11-04T01:41:29.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f1632c13740 10 client.8049 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:41:29.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f1632c13740 20 client.8049 populate_metadata read hostname 'smithi114' 2023-11-04T01:41:29.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f1632c13740 1 --2- 172.21.15.114:0/88608692 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x559f4f0e7d50 0x559f4f0e7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f1632c13740 4 client.8049 mds_command: new command op to 6298 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:41:29.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f1632c13740 1 -- 172.21.15.114:0/88608692 --> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559f4f0055b0 con 0x559f4f0e7d50 2023-11-04T01:41:29.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.373+0000 7f162d617640 1 --2- 172.21.15.114:0/88608692 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x559f4f0e7d50 0x559f4f0e7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.374+0000 7f1608ff9640 10 client.8049 ms_handle_connect on v2:172.21.15.141:6832/1296600989 2023-11-04T01:41:29.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.374+0000 7f162d617640 1 --2- 172.21.15.114:0/88608692 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x559f4f0e7d50 0x559f4f0e7390 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d5004284342072c7 server_cookie=d705ec002f7de6b2 in_seq=0 out_seq=0 2023-11-04T01:41:29.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.374+0000 7f1608ff9640 1 -- 172.21.15.114:0/88608692 <== mds.1 v2:172.21.15.141:6832/1296600989 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x559f4f0055b0 con 0x559f4f0e7d50 2023-11-04T01:41:29.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.374+0000 7f1608ff9640 10 client.8049 handle_command_reply: tid=0 2023-11-04T01:41:29.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.374+0000 7f1632c13740 1 client.8049 shutdown 2023-11-04T01:41:29.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.374+0000 7f1632c13740 1 -- 172.21.15.114:0/88608692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0cd850 msgr2=0x559f4f1557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.374+0000 7f1632c13740 1 --2- 172.21.15.114:0/88608692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0cd850 0x559f4f1557e0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f1624026040 tx=0x7f16240010f0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.374+0000 7f1632c13740 1 -- 172.21.15.114:0/88608692 shutdown_connections 2023-11-04T01:41:29.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.374+0000 7f1632c13740 1 --2- 172.21.15.114:0/88608692 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559f4f0d2380 0x559f4f0ea020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.374+0000 7f1632c13740 1 --2- 172.21.15.114:0/88608692 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x559f4f0e7d50 0x559f4f0e7390 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.374+0000 7f1632c13740 1 --2- 172.21.15.114:0/88608692 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559f4f0cdc30 0x559f4f0e9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.374+0000 7f1608ff9640 0 client.8049 ms_handle_reset on v2:172.21.15.141:6832/1296600989 2023-11-04T01:41:29.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.374+0000 7f1632c13740 1 --2- 172.21.15.114:0/88608692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559f4f0cd850 0x559f4f1557e0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.374+0000 7f1632c13740 1 -- 172.21.15.114:0/88608692 >> 172.21.15.114:0/88608692 conn(0x559f4f0a0c90 msgr2=0x559f4f0e50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.374+0000 7f1632c13740 1 -- 172.21.15.114:0/88608692 shutdown_connections 2023-11-04T01:41:29.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.374+0000 7f1632c13740 1 -- 172.21.15.114:0/88608692 wait complete. 2023-11-04T01:41:29.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.375+0000 7f1632c13740 20 client.8049 trim_cache size 0 max 16384 2023-11-04T01:41:29.384 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:41:29.384 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 1, 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 6298, 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 88.800655925000001, 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 71, 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 101, 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 101, 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 103.373017385 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:41:29.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.375+0000 7f163007c640 1 -- 172.21.15.114:0/342668393 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f160c06ae70 msgr2=0x7f160c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.375+0000 7f163007c640 1 --2- 172.21.15.114:0/342668393 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f160c06ae70 0x7f160c06d330 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1624000f60 tx=0x7f16240079b0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.375+0000 7f163007c640 1 -- 172.21.15.114:0/342668393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1628160430 msgr2=0x7f16280b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.375+0000 7f163007c640 1 --2- 172.21.15.114:0/342668393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1628160430 0x7f16280b11e0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f1620009e50 tx=0x7f1620004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:29.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.375+0000 7f163007c640 1 -- 172.21.15.114:0/342668393 shutdown_connections 2023-11-04T01:41:29.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.375+0000 7f163007c640 1 --2- 172.21.15.114:0/342668393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1628160430 0x7f16280b11e0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.375+0000 7f163007c640 1 --2- 172.21.15.114:0/342668393 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f160c06ae70 0x7f160c06d330 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.375+0000 7f163007c640 1 --2- 172.21.15.114:0/342668393 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f16280b2d30 0x7f1628151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.375+0000 7f163007c640 1 --2- 172.21.15.114:0/342668393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f162806c1d0 0x7f16280b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.375+0000 7f163007c640 1 -- 172.21.15.114:0/342668393 >> 172.21.15.114:0/342668393 conn(0x7f162806ea20 msgr2=0x7f16280cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.375+0000 7f163007c640 1 -- 172.21.15.114:0/342668393 shutdown_connections 2023-11-04T01:41:29.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.375+0000 7f163007c640 1 -- 172.21.15.114:0/342668393 wait complete. 2023-11-04T01:41:29.388 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:41:29.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.486+0000 7fa07e44b640 1 Processor -- start 2023-11-04T01:41:29.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.486+0000 7fa07e44b640 1 -- start start 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.487+0000 7fa07e44b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa07815e3f0 0x7fa0780b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.487+0000 7fa07e44b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0780ca0a0 0x7fa0780cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.487+0000 7fa07e44b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0780caa20 con 0x7fa0780cc300 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.487+0000 7fa07e44b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0780cb230 con 0x7fa0780ca0a0 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.487+0000 7fa07e44b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780ca530 con 0x7fa07815e3f0 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.487+0000 7fa07c9e8640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa0780cc300 0x7fa0780b1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44008/0 (socket says 172.21.15.114:44008) 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.487+0000 7fa07c9e8640 1 -- 172.21.15.114:0/2463012034 learned_addr learned my addr 172.21.15.114:0/2463012034 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.487+0000 7fa0777fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0780ca0a0 0x7fa0780cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.487+0000 7fa076ffd640 1 -- 172.21.15.114:0/2463012034 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946167795 0 0) 0x7fa0780caa20 con 0x7fa0780cc300 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.487+0000 7fa076ffd640 1 -- 172.21.15.114:0/2463012034 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa060003520 con 0x7fa0780cc300 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.487+0000 7fa077fff640 1 --2- 172.21.15.114:0/2463012034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa07815e3f0 0x7fa0780b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.487+0000 7fa0777fe640 1 -- 172.21.15.114:0/2463012034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa07815e3f0 msgr2=0x7fa0780b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.487+0000 7fa0777fe640 1 --2- 172.21.15.114:0/2463012034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa07815e3f0 0x7fa0780b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.487+0000 7fa0777fe640 1 -- 172.21.15.114:0/2463012034 >> v1:172.21.15.114:6789/0 conn(0x7fa0780cc300 legacy=0x7fa0780b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.487+0000 7fa0777fe640 1 -- 172.21.15.114:0/2463012034 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780cac70 con 0x7fa0780ca0a0 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.487+0000 7fa077fff640 1 --2- 172.21.15.114:0/2463012034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa07815e3f0 0x7fa0780b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.488+0000 7fa0777fe640 1 --2- 172.21.15.114:0/2463012034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0780ca0a0 0x7fa0780cc920 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fa0680097a0 tx=0x7fa06802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9f8313663043be server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.488+0000 7fa076ffd640 1 -- 172.21.15.114:0/2463012034 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068031830 con 0x7fa0780ca0a0 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.488+0000 7fa076ffd640 1 -- 172.21.15.114:0/2463012034 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa068031990 con 0x7fa0780ca0a0 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.488+0000 7fa076ffd640 1 -- 172.21.15.114:0/2463012034 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068031d20 con 0x7fa0780ca0a0 2023-11-04T01:41:29.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.489+0000 7fa07e44b640 1 -- 172.21.15.114:0/2463012034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0780ca0a0 msgr2=0x7fa0780cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.489+0000 7fa07e44b640 1 --2- 172.21.15.114:0/2463012034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0780ca0a0 0x7fa0780cc920 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fa0680097a0 tx=0x7fa06802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.489+0000 7fa07e44b640 1 -- 172.21.15.114:0/2463012034 shutdown_connections 2023-11-04T01:41:29.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.489+0000 7fa07e44b640 1 --2- 172.21.15.114:0/2463012034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0780ca0a0 0x7fa0780cc920 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.489+0000 7fa07e44b640 1 --2- 172.21.15.114:0/2463012034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa07815e3f0 0x7fa0780b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.489+0000 7fa07e44b640 1 -- 172.21.15.114:0/2463012034 >> 172.21.15.114:0/2463012034 conn(0x7fa078071820 msgr2=0x7fa078071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.489+0000 7fa07e44b640 1 -- 172.21.15.114:0/2463012034 shutdown_connections 2023-11-04T01:41:29.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.489+0000 7fa07e44b640 1 -- 172.21.15.114:0/2463012034 wait complete. 2023-11-04T01:41:29.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.490+0000 7fa07e44b640 1 Processor -- start 2023-11-04T01:41:29.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.490+0000 7fa07e44b640 1 -- start start 2023-11-04T01:41:29.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa07e44b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0780cc300 0x7fa0781503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa07e44b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa07815e3f0 0x7fa0780c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa07e44b640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa0780c8850 0x7fa0781e46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa07e44b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780c8ce0 con 0x7fa0780cc300 2023-11-04T01:41:29.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa07e44b640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780c8fc0 con 0x7fa0780c8850 2023-11-04T01:41:29.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa07e44b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780c92a0 con 0x7fa07815e3f0 2023-11-04T01:41:29.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa077fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0780cc300 0x7fa0781503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa077fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0780cc300 0x7fa0781503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43184/0 (socket says 172.21.15.114:43184) 2023-11-04T01:41:29.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa077fff640 1 -- 172.21.15.114:0/2071808283 learned_addr learned my addr 172.21.15.114:0/2071808283 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:29.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa0777fe640 1 --2- 172.21.15.114:0/2071808283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa07815e3f0 0x7fa0780c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa07c9e8640 1 --2- 172.21.15.114:0/2071808283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa0780c8850 0x7fa0781e46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa077fff640 1 -- 172.21.15.114:0/2071808283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa07815e3f0 msgr2=0x7fa0780c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa077fff640 1 --2- 172.21.15.114:0/2071808283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa07815e3f0 0x7fa0780c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa077fff640 1 -- 172.21.15.114:0/2071808283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa0780c8850 msgr2=0x7fa0781e46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa077fff640 1 --2- 172.21.15.114:0/2071808283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa0780c8850 0x7fa0781e46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa077fff640 1 -- 172.21.15.114:0/2071808283 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa068009400 con 0x7fa0780cc300 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa0777fe640 1 --2- 172.21.15.114:0/2071808283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa07815e3f0 0x7fa0780c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa07c9e8640 1 --2- 172.21.15.114:0/2071808283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa0780c8850 0x7fa0781e46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa077fff640 1 --2- 172.21.15.114:0/2071808283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0780cc300 0x7fa0781503b0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00c7f0 tx=0x7fa06c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa074ff9640 1 -- 172.21.15.114:0/2071808283 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c007820 con 0x7fa0780cc300 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa074ff9640 1 -- 172.21.15.114:0/2071808283 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c007980 con 0x7fa0780cc300 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa07e44b640 1 -- 172.21.15.114:0/2071808283 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0780c9580 con 0x7fa0780cc300 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa074ff9640 1 -- 172.21.15.114:0/2071808283 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c007cf0 con 0x7fa0780cc300 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.491+0000 7fa07e44b640 1 -- 172.21.15.114:0/2071808283 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0780c8400 con 0x7fa0780cc300 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.493+0000 7fa074ff9640 1 -- 172.21.15.114:0/2071808283 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa06c0113f0 con 0x7fa0780cc300 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.493+0000 7fa074ff9640 1 --2- 172.21.15.114:0/2071808283 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa06406ae70 0x7fa06406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.493+0000 7fa0777fe640 1 --2- 172.21.15.114:0/2071808283 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa06406ae70 0x7fa06406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.493+0000 7fa074ff9640 1 -- 172.21.15.114:0/2071808283 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fa06c089fb0 con 0x7fa0780cc300 2023-11-04T01:41:29.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.494+0000 7fa0777fe640 1 --2- 172.21.15.114:0/2071808283 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa06406ae70 0x7fa06406d330 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa068036000 tx=0x7fa068008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.494+0000 7fa080fd9740 1 Processor -- start 2023-11-04T01:41:29.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.494+0000 7fa080fd9740 1 -- start start 2023-11-04T01:41:29.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.495+0000 7fa080fd9740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8d8850 0x55b5ae8ab750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.495+0000 7fa080fd9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8db5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.495+0000 7fa080fd9740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8abc90 0x55b5ae8dbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.495+0000 7fa080fd9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ae7bc740 con 0x55b5ae8d8c30 2023-11-04T01:41:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.495+0000 7fa080fd9740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ae81e8d0 con 0x55b5ae8d8850 2023-11-04T01:41:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.495+0000 7fa080fd9740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5ae81bfc0 con 0x55b5ae8abc90 2023-11-04T01:41:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.495+0000 7fa0777fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8db5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.495+0000 7fa0777fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8db5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43188/0 (socket says 172.21.15.114:43188) 2023-11-04T01:41:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.495+0000 7fa0777fe640 1 -- 172.21.15.114:0/2289715901 learned_addr learned my addr 172.21.15.114:0/2289715901 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.495+0000 7fa0777fe640 1 -- 172.21.15.114:0/2289715901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8abc90 msgr2=0x55b5ae8dbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.495+0000 7fa0777fe640 1 --2- 172.21.15.114:0/2289715901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8abc90 0x55b5ae8dbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.495+0000 7fa0777fe640 1 -- 172.21.15.114:0/2289715901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8d8850 msgr2=0x55b5ae8ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.495+0000 7fa0777fe640 1 --2- 172.21.15.114:0/2289715901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8d8850 0x55b5ae8ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.495+0000 7fa0777fe640 1 -- 172.21.15.114:0/2289715901 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5ae7daca0 con 0x55b5ae8d8c30 2023-11-04T01:41:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.496+0000 7fa0777fe640 1 --2- 172.21.15.114:0/2289715901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8db5e0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fa068031c60 tx=0x7fa068030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730792402008c4bc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.496+0000 7fa05dffb640 1 -- 172.21.15.114:0/2289715901 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06803f070 con 0x55b5ae8d8c30 2023-11-04T01:41:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.496+0000 7fa05dffb640 1 -- 172.21.15.114:0/2289715901 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa068031d50 con 0x55b5ae8d8c30 2023-11-04T01:41:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.496+0000 7fa05dffb640 1 -- 172.21.15.114:0/2289715901 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068045640 con 0x55b5ae8d8c30 2023-11-04T01:41:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.496+0000 7fa080fd9740 1 -- 172.21.15.114:0/2289715901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 msgr2=0x55b5ae8db5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.496+0000 7fa080fd9740 1 --2- 172.21.15.114:0/2289715901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8db5e0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fa068031c60 tx=0x7fa068030000 comp rx=0 tx=0).stop 2023-11-04T01:41:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.496+0000 7fa080fd9740 1 -- 172.21.15.114:0/2289715901 shutdown_connections 2023-11-04T01:41:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.496+0000 7fa080fd9740 1 --2- 172.21.15.114:0/2289715901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8abc90 0x55b5ae8dbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.496+0000 7fa080fd9740 1 --2- 172.21.15.114:0/2289715901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8db5e0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.496+0000 7fa080fd9740 1 --2- 172.21.15.114:0/2289715901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8d8850 0x55b5ae8ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.496+0000 7fa080fd9740 1 -- 172.21.15.114:0/2289715901 >> 172.21.15.114:0/2289715901 conn(0x55b5ae8ada60 msgr2=0x55b5ae8f65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.496+0000 7fa080fd9740 1 -- 172.21.15.114:0/2289715901 shutdown_connections 2023-11-04T01:41:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.496+0000 7fa080fd9740 1 -- 172.21.15.114:0/2289715901 wait complete. 2023-11-04T01:41:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.497+0000 7fa080fd9740 1 -- start start 2023-11-04T01:41:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.497+0000 7fa080fd9740 1 Processor -- start 2023-11-04T01:41:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.498+0000 7fa080fd9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8850 0x55b5ae8d7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.498+0000 7fa080fd9740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8f0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.498+0000 7fa080fd9740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8ee680 0x55b5ae8eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.498+0000 7fa080fd9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ae8178b0 con 0x55b5ae8d8850 2023-11-04T01:41:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.498+0000 7fa080fd9740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ae7d1c80 con 0x55b5ae8d8c30 2023-11-04T01:41:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.498+0000 7fa080fd9740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5ae7d1920 con 0x55b5ae8ee680 2023-11-04T01:41:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.498+0000 7fa080fd9740 10 client.0 _ll_register_callbacks cb 0x55b5ae529ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.498+0000 7fa077fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8850 0x55b5ae8d7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.498+0000 7fa077fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8850 0x55b5ae8d7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43198/0 (socket says 172.21.15.114:43198) 2023-11-04T01:41:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.498+0000 7fa077fff640 1 -- 172.21.15.114:0/3289346443 learned_addr learned my addr 172.21.15.114:0/3289346443 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.498+0000 7fa077fff640 1 -- 172.21.15.114:0/3289346443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8ee680 msgr2=0x55b5ae8eeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.498+0000 7fa077fff640 1 --2- 172.21.15.114:0/3289346443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8ee680 0x55b5ae8eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.498+0000 7fa077fff640 1 -- 172.21.15.114:0/3289346443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8d8c30 msgr2=0x55b5ae8f0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.498+0000 7fa0777fe640 1 --2- 172.21.15.114:0/3289346443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.498+0000 7fa077fff640 1 --2- 172.21.15.114:0/3289346443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8f0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.498+0000 7fa077fff640 1 -- 172.21.15.114:0/3289346443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0780cac70 con 0x55b5ae8d8850 2023-11-04T01:41:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa077fff640 1 --2- 172.21.15.114:0/3289346443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8850 0x55b5ae8d7dd0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fa06c060460 tx=0x7fa06c058ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e112d96bb7229a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa056ffd640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:41:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa056ffd640 1 -- 172.21.15.114:0/3289346443 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c060500 con 0x55b5ae8d8850 2023-11-04T01:41:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa056ffd640 1 -- 172.21.15.114:0/3289346443 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fa06c060660 con 0x55b5ae8d8850 2023-11-04T01:41:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa080fd9740 1 -- 172.21.15.114:0/3289346443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5ae7c3bf0 con 0x55b5ae8d8850 2023-11-04T01:41:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa056ffd640 1 -- 172.21.15.114:0/3289346443 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa06c054480 con 0x55b5ae8d8850 2023-11-04T01:41:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa080fd9740 10 client.8064 fetch_fsmap learned FSMap version 71 2023-11-04T01:41:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa080fd9740 1 -- 172.21.15.114:0/3289346443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55b5ae815f30 con 0x55b5ae8d8850 2023-11-04T01:41:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa056ffd640 1 -- 172.21.15.114:0/3289346443 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b5ae7c3bf0 con 0x55b5ae8d8850 2023-11-04T01:41:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa056ffd640 1 -- 172.21.15.114:0/3289346443 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 71) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fa06c0545e0 con 0x55b5ae8d8850 2023-11-04T01:41:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa080fd9740 10 client.8064 fetch_fsmap finished waiting for FSMap version 71 2023-11-04T01:41:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa080fd9740 10 client.8064 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:41:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa080fd9740 20 client.8064 populate_metadata read hostname 'smithi114' 2023-11-04T01:41:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa080fd9740 1 --2- 172.21.15.114:0/3289346443 >> [v2:172.21.15.114:6835/1052115332,v1:172.21.15.114:6837/1052115332] conn(0x55b5ae9068b0 0x55b5ae906c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa080fd9740 4 client.8064 mds_command: new command op to 7899 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:41:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa080fd9740 1 -- 172.21.15.114:0/3289346443 --> [v2:172.21.15.114:6835/1052115332,v1:172.21.15.114:6837/1052115332] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b5ae810890 con 0x55b5ae9068b0 2023-11-04T01:41:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.499+0000 7fa0777fe640 1 --2- 172.21.15.114:0/3289346443 >> [v2:172.21.15.114:6835/1052115332,v1:172.21.15.114:6837/1052115332] conn(0x55b5ae9068b0 0x55b5ae906c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.500+0000 7fa056ffd640 10 client.8064 ms_handle_connect on v2:172.21.15.114:6835/1052115332 2023-11-04T01:41:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.500+0000 7fa0777fe640 1 --2- 172.21.15.114:0/3289346443 >> [v2:172.21.15.114:6835/1052115332,v1:172.21.15.114:6837/1052115332] conn(0x55b5ae9068b0 0x55b5ae906c90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f96902c0d4c760c2 server_cookie=fa02ffa24db1df0f in_seq=0 out_seq=0 2023-11-04T01:41:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.500+0000 7fa056ffd640 1 -- 172.21.15.114:0/3289346443 <== mds.0 v2:172.21.15.114:6835/1052115332 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b5ae810890 con 0x55b5ae9068b0 2023-11-04T01:41:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.500+0000 7fa056ffd640 10 client.8064 handle_command_reply: tid=0 2023-11-04T01:41:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.500+0000 7fa080fd9740 1 client.8064 shutdown 2023-11-04T01:41:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.500+0000 7fa080fd9740 1 -- 172.21.15.114:0/3289346443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8850 msgr2=0x55b5ae8d7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.500+0000 7fa080fd9740 1 --2- 172.21.15.114:0/3289346443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8850 0x55b5ae8d7dd0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fa06c060460 tx=0x7fa06c058ed0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.500+0000 7fa080fd9740 1 -- 172.21.15.114:0/3289346443 shutdown_connections 2023-11-04T01:41:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.500+0000 7fa080fd9740 1 --2- 172.21.15.114:0/3289346443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8ee680 0x55b5ae8eeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.500+0000 7fa080fd9740 1 --2- 172.21.15.114:0/3289346443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8f0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.500+0000 7fa080fd9740 1 --2- 172.21.15.114:0/3289346443 >> [v2:172.21.15.114:6835/1052115332,v1:172.21.15.114:6837/1052115332] conn(0x55b5ae9068b0 0x55b5ae906c90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.500+0000 7fa080fd9740 1 --2- 172.21.15.114:0/3289346443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8850 0x55b5ae8d7dd0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.500+0000 7fa056ffd640 0 client.8064 ms_handle_reset on v2:172.21.15.114:6835/1052115332 2023-11-04T01:41:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.500+0000 7fa080fd9740 1 -- 172.21.15.114:0/3289346443 >> 172.21.15.114:0/3289346443 conn(0x55b5ae8abc90 msgr2=0x55b5ae8fa380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.500+0000 7fa080fd9740 1 -- 172.21.15.114:0/3289346443 shutdown_connections 2023-11-04T01:41:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.500+0000 7fa080fd9740 1 -- 172.21.15.114:0/3289346443 wait complete. 2023-11-04T01:41:29.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.501+0000 7fa080fd9740 20 client.8064 trim_cache size 0 max 16384 2023-11-04T01:41:29.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.516+0000 7fa080fd9740 1 Processor -- start 2023-11-04T01:41:29.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.516+0000 7fa080fd9740 1 -- start start 2023-11-04T01:41:29.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.516+0000 7fa080fd9740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8d8850 0x55b5ae8deb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.516+0000 7fa080fd9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8af350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.516+0000 7fa080fd9740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8ee680 0x55b5ae8af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.516+0000 7fa080fd9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ae797280 con 0x55b5ae8d8c30 2023-11-04T01:41:29.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.516+0000 7fa080fd9740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ae906d20 con 0x55b5ae8ee680 2023-11-04T01:41:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.516+0000 7fa080fd9740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5ae7b60b0 con 0x55b5ae8d8850 2023-11-04T01:41:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.516+0000 7fa0777fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.517+0000 7fa0777fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43202/0 (socket says 172.21.15.114:43202) 2023-11-04T01:41:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.517+0000 7fa0777fe640 1 -- 172.21.15.114:0/3307171354 learned_addr learned my addr 172.21.15.114:0/3307171354 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.517+0000 7fa0777fe640 1 -- 172.21.15.114:0/3307171354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8d8850 msgr2=0x55b5ae8deb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.517+0000 7fa0777fe640 1 --2- 172.21.15.114:0/3307171354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8d8850 0x55b5ae8deb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.517+0000 7fa0777fe640 1 -- 172.21.15.114:0/3307171354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8ee680 msgr2=0x55b5ae8af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.517+0000 7fa0777fe640 1 --2- 172.21.15.114:0/3307171354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8ee680 0x55b5ae8af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.517+0000 7fa0777fe640 1 -- 172.21.15.114:0/3307171354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5ae7b3d10 con 0x55b5ae8d8c30 2023-11-04T01:41:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.517+0000 7fa0777fe640 1 --2- 172.21.15.114:0/3307171354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8af350 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fa06802bee0 tx=0x7fa06803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2b12a124ffdaf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.517+0000 7fa05e7fc640 1 -- 172.21.15.114:0/3307171354 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068004400 con 0x55b5ae8d8c30 2023-11-04T01:41:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.517+0000 7fa05e7fc640 1 -- 172.21.15.114:0/3307171354 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06805f0d0 con 0x55b5ae8d8c30 2023-11-04T01:41:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.517+0000 7fa05e7fc640 1 -- 172.21.15.114:0/3307171354 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06805f440 con 0x55b5ae8d8c30 2023-11-04T01:41:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.518+0000 7fa080fd9740 1 -- 172.21.15.114:0/3307171354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 msgr2=0x55b5ae8af350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.518+0000 7fa080fd9740 1 --2- 172.21.15.114:0/3307171354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8af350 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fa06802bee0 tx=0x7fa06803f000 comp rx=0 tx=0).stop 2023-11-04T01:41:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.518+0000 7fa080fd9740 1 -- 172.21.15.114:0/3307171354 shutdown_connections 2023-11-04T01:41:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.518+0000 7fa080fd9740 1 --2- 172.21.15.114:0/3307171354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8ee680 0x55b5ae8af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.518+0000 7fa080fd9740 1 --2- 172.21.15.114:0/3307171354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8af350 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.518+0000 7fa080fd9740 1 --2- 172.21.15.114:0/3307171354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8d8850 0x55b5ae8deb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.518+0000 7fa080fd9740 1 -- 172.21.15.114:0/3307171354 >> 172.21.15.114:0/3307171354 conn(0x55b5ae8abc90 msgr2=0x55b5ae8d7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.518+0000 7fa080fd9740 1 -- 172.21.15.114:0/3307171354 shutdown_connections 2023-11-04T01:41:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.518+0000 7fa080fd9740 1 -- 172.21.15.114:0/3307171354 wait complete. 2023-11-04T01:41:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.518+0000 7fa080fd9740 1 -- start start 2023-11-04T01:41:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.518+0000 7fa080fd9740 1 Processor -- start 2023-11-04T01:41:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.519+0000 7fa080fd9740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8d8850 0x55b5ae8a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.519+0000 7fa080fd9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8af350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.519+0000 7fa080fd9740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8ee680 0x55b5ae8af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.519+0000 7fa080fd9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ae960bc0 con 0x55b5ae8d8c30 2023-11-04T01:41:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.519+0000 7fa080fd9740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ae8f9af0 con 0x55b5ae8ee680 2023-11-04T01:41:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.519+0000 7fa080fd9740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5ae8f9f50 con 0x55b5ae8d8850 2023-11-04T01:41:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.519+0000 7fa080fd9740 10 client.0 _ll_register_callbacks cb 0x7fa0600036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.519+0000 7fa0777fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.519+0000 7fa0777fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43212/0 (socket says 172.21.15.114:43212) 2023-11-04T01:41:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.519+0000 7fa0777fe640 1 -- 172.21.15.114:0/915022224 learned_addr learned my addr 172.21.15.114:0/915022224 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.519+0000 7fa077fff640 1 --2- 172.21.15.114:0/915022224 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8d8850 0x55b5ae8a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.519+0000 7fa07c9e8640 1 --2- 172.21.15.114:0/915022224 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8ee680 0x55b5ae8af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa0777fe640 1 -- 172.21.15.114:0/915022224 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8d8850 msgr2=0x55b5ae8a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa0777fe640 1 --2- 172.21.15.114:0/915022224 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8d8850 0x55b5ae8a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa0777fe640 1 -- 172.21.15.114:0/915022224 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8ee680 msgr2=0x55b5ae8af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa0777fe640 1 --2- 172.21.15.114:0/915022224 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8ee680 0x55b5ae8af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa0777fe640 1 -- 172.21.15.114:0/915022224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5ae7daca0 con 0x55b5ae8d8c30 2023-11-04T01:41:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa0777fe640 1 --2- 172.21.15.114:0/915022224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8af350 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fa06802b910 tx=0x7fa068004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1271a7defdc1f808 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa056ffd640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:41:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa056ffd640 1 -- 172.21.15.114:0/915022224 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06803f070 con 0x55b5ae8d8c30 2023-11-04T01:41:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa056ffd640 1 -- 172.21.15.114:0/915022224 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fa06805fe40 con 0x55b5ae8d8c30 2023-11-04T01:41:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa080fd9740 1 -- 172.21.15.114:0/915022224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa068031d50 con 0x55b5ae8d8c30 2023-11-04T01:41:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa056ffd640 1 -- 172.21.15.114:0/915022224 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa06805f240 con 0x55b5ae8d8c30 2023-11-04T01:41:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa080fd9740 10 client.8070 fetch_fsmap learned FSMap version 71 2023-11-04T01:41:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa080fd9740 1 -- 172.21.15.114:0/915022224 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55b5ae7d9500 con 0x55b5ae8d8c30 2023-11-04T01:41:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa056ffd640 1 -- 172.21.15.114:0/915022224 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa068031d50 con 0x55b5ae8d8c30 2023-11-04T01:41:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa056ffd640 1 -- 172.21.15.114:0/915022224 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 71) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fa06805f3a0 con 0x55b5ae8d8c30 2023-11-04T01:41:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa080fd9740 10 client.8070 fetch_fsmap finished waiting for FSMap version 71 2023-11-04T01:41:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa080fd9740 10 client.8070 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:41:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa080fd9740 20 client.8070 populate_metadata read hostname 'smithi114' 2023-11-04T01:41:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa080fd9740 1 --2- 172.21.15.114:0/915022224 >> [v2:172.21.15.114:6835/1052115332,v1:172.21.15.114:6837/1052115332] conn(0x55b5ae9644f0 0x55b5ae9648d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa080fd9740 4 client.8070 mds_command: new command op to 7899 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:41:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa080fd9740 1 -- 172.21.15.114:0/915022224 --> [v2:172.21.15.114:6835/1052115332,v1:172.21.15.114:6837/1052115332] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b5ae8105b0 con 0x55b5ae9644f0 2023-11-04T01:41:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.520+0000 7fa077fff640 1 --2- 172.21.15.114:0/915022224 >> [v2:172.21.15.114:6835/1052115332,v1:172.21.15.114:6837/1052115332] conn(0x55b5ae9644f0 0x55b5ae9648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa056ffd640 10 client.8070 ms_handle_connect on v2:172.21.15.114:6835/1052115332 2023-11-04T01:41:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa077fff640 1 --2- 172.21.15.114:0/915022224 >> [v2:172.21.15.114:6835/1052115332,v1:172.21.15.114:6837/1052115332] conn(0x55b5ae9644f0 0x55b5ae9648d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af761612a5709a04 server_cookie=ae509707a0973ea9 in_seq=0 out_seq=0 2023-11-04T01:41:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa056ffd640 1 -- 172.21.15.114:0/915022224 <== mds.0 v2:172.21.15.114:6835/1052115332 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55b5ae8105b0 con 0x55b5ae9644f0 2023-11-04T01:41:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa056ffd640 10 client.8070 handle_command_reply: tid=0 2023-11-04T01:41:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa080fd9740 1 client.8070 shutdown 2023-11-04T01:41:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa080fd9740 1 -- 172.21.15.114:0/915022224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 msgr2=0x55b5ae8af350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa080fd9740 1 --2- 172.21.15.114:0/915022224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8af350 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fa06802b910 tx=0x7fa068004730 comp rx=0 tx=0).stop 2023-11-04T01:41:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa080fd9740 1 -- 172.21.15.114:0/915022224 shutdown_connections 2023-11-04T01:41:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa080fd9740 1 --2- 172.21.15.114:0/915022224 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55b5ae8ee680 0x55b5ae8af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa080fd9740 1 --2- 172.21.15.114:0/915022224 >> [v2:172.21.15.114:6835/1052115332,v1:172.21.15.114:6837/1052115332] conn(0x55b5ae9644f0 0x55b5ae9648d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa080fd9740 1 --2- 172.21.15.114:0/915022224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b5ae8d8c30 0x55b5ae8af350 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa080fd9740 1 --2- 172.21.15.114:0/915022224 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55b5ae8d8850 0x55b5ae8a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa056ffd640 0 client.8070 ms_handle_reset on v2:172.21.15.114:6835/1052115332 2023-11-04T01:41:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa080fd9740 1 -- 172.21.15.114:0/915022224 >> 172.21.15.114:0/915022224 conn(0x55b5ae8abc90 msgr2=0x55b5ae8d7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa080fd9740 1 -- 172.21.15.114:0/915022224 shutdown_connections 2023-11-04T01:41:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa080fd9740 1 -- 172.21.15.114:0/915022224 wait complete. 2023-11-04T01:41:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.521+0000 7fa080fd9740 20 client.8070 trim_cache size 0 max 16384 2023-11-04T01:41:29.532 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:41:29.532 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:41:29.532 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-11-04T01:41:29.532 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 7899, 2023-11-04T01:41:29.532 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:41:29.532 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:41:29.532 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:41:29.532 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 6.685559713, 2023-11-04T01:41:29.532 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 71, 2023-11-04T01:41:29.532 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 101, 2023-11-04T01:41:29.532 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 101, 2023-11-04T01:41:29.532 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 32.140056561000002 2023-11-04T01:41:29.532 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:41:29.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.522+0000 7fa07e44b640 1 -- 172.21.15.114:0/2071808283 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa06406ae70 msgr2=0x7fa06406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.522+0000 7fa07e44b640 1 --2- 172.21.15.114:0/2071808283 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa06406ae70 0x7fa06406d330 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa068036000 tx=0x7fa068008030 comp rx=0 tx=0).stop 2023-11-04T01:41:29.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.522+0000 7fa07e44b640 1 -- 172.21.15.114:0/2071808283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0780cc300 msgr2=0x7fa0781503b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.522+0000 7fa07e44b640 1 --2- 172.21.15.114:0/2071808283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0780cc300 0x7fa0781503b0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00c7f0 tx=0x7fa06c00ccb0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.522+0000 7fa07e44b640 1 -- 172.21.15.114:0/2071808283 shutdown_connections 2023-11-04T01:41:29.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.522+0000 7fa07e44b640 1 --2- 172.21.15.114:0/2071808283 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa06406ae70 0x7fa06406d330 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.522+0000 7fa07e44b640 1 --2- 172.21.15.114:0/2071808283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa0780c8850 0x7fa0781e46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.522+0000 7fa07e44b640 1 --2- 172.21.15.114:0/2071808283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa07815e3f0 0x7fa0780c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.522+0000 7fa07e44b640 1 --2- 172.21.15.114:0/2071808283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0780cc300 0x7fa0781503b0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.522+0000 7fa07e44b640 1 -- 172.21.15.114:0/2071808283 >> 172.21.15.114:0/2071808283 conn(0x7fa078071820 msgr2=0x7fa0780b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.522+0000 7fa07e44b640 1 -- 172.21.15.114:0/2071808283 shutdown_connections 2023-11-04T01:41:29.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.522+0000 7fa07e44b640 1 -- 172.21.15.114:0/2071808283 wait complete. 2023-11-04T01:41:29.535 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:29.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.632+0000 7f906ad25640 1 Processor -- start 2023-11-04T01:41:29.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.632+0000 7f906ad25640 1 -- start start 2023-11-04T01:41:29.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.633+0000 7f906ad25640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9064159c70 0x7f90640ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.633+0000 7f906ad25640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90640b0ae0 0x7f906415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.633+0000 7f906ad25640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90640b4110 con 0x7f906406db20 2023-11-04T01:41:29.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.633+0000 7f906ad25640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90640b49b0 con 0x7f90640b0ae0 2023-11-04T01:41:29.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.633+0000 7f906ad25640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90640b43f0 con 0x7f9064159c70 2023-11-04T01:41:29.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.633+0000 7f90692c2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90640b0ae0 0x7f906415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.633+0000 7f90692c2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90640b0ae0 0x7f906415d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43222/0 (socket says 172.21.15.114:43222) 2023-11-04T01:41:29.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.633+0000 7f90692c2640 1 -- 172.21.15.114:0/337673167 learned_addr learned my addr 172.21.15.114:0/337673167 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:29.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.633+0000 7f9068ac1640 1 --2- 172.21.15.114:0/337673167 >> v2:172.21.15.141:3300/0 conn(0x7f9064159c70 0x7f90640ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.633+0000 7f90692c2640 1 -- 172.21.15.114:0/337673167 >> v2:172.21.15.141:3300/0 conn(0x7f9064159c70 msgr2=0x7f90640ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.633+0000 7f90692c2640 1 --2- 172.21.15.114:0/337673167 >> v2:172.21.15.141:3300/0 conn(0x7f9064159c70 0x7f90640ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.633+0000 7f90692c2640 1 -- 172.21.15.114:0/337673167 >> v1:172.21.15.141:6789/0 conn(0x7f906406db20 legacy=0x7f90640b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.633+0000 7f90692c2640 1 -- 172.21.15.114:0/337673167 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90640b46d0 con 0x7f90640b0ae0 2023-11-04T01:41:29.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.634+0000 7f90692c2640 1 --2- 172.21.15.114:0/337673167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90640b0ae0 0x7f906415d7d0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f90640cc440 tx=0x7f905c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e56b213a25817c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.634+0000 7f90637fe640 1 -- 172.21.15.114:0/337673167 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c02cb20 con 0x7f90640b0ae0 2023-11-04T01:41:29.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.634+0000 7f90637fe640 1 -- 172.21.15.114:0/337673167 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c02cc80 con 0x7f90640b0ae0 2023-11-04T01:41:29.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.634+0000 7f90637fe640 1 -- 172.21.15.114:0/337673167 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c0343f0 con 0x7f90640b0ae0 2023-11-04T01:41:29.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.635+0000 7f906ad25640 1 -- 172.21.15.114:0/337673167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90640b0ae0 msgr2=0x7f906415d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.635+0000 7f906ad25640 1 --2- 172.21.15.114:0/337673167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90640b0ae0 0x7f906415d7d0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f90640cc440 tx=0x7f905c02bf80 comp rx=0 tx=0).stop 2023-11-04T01:41:29.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.635+0000 7f906ad25640 1 -- 172.21.15.114:0/337673167 shutdown_connections 2023-11-04T01:41:29.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.635+0000 7f906ad25640 1 --2- 172.21.15.114:0/337673167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90640b0ae0 0x7f906415d7d0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.635+0000 7f906ad25640 1 --2- 172.21.15.114:0/337673167 >> v2:172.21.15.141:3300/0 conn(0x7f9064159c70 0x7f90640ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.635+0000 7f906ad25640 1 -- 172.21.15.114:0/337673167 >> 172.21.15.114:0/337673167 conn(0x7f90640ce950 msgr2=0x7f90640ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.635+0000 7f906ad25640 1 -- 172.21.15.114:0/337673167 shutdown_connections 2023-11-04T01:41:29.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.635+0000 7f906ad25640 1 -- 172.21.15.114:0/337673167 wait complete. 2023-11-04T01:41:29.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.636+0000 7f906ad25640 1 Processor -- start 2023-11-04T01:41:29.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.636+0000 7f906ad25640 1 -- start start 2023-11-04T01:41:29.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f906ad25640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f906406db20 0x7f90640ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f906ad25640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90640b0ae0 0x7f90640c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f906ad25640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9064159c70 0x7f90640ac770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f906ad25640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90640ad660 con 0x7f90640b0ae0 2023-11-04T01:41:29.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f906ad25640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90640ae020 con 0x7f906406db20 2023-11-04T01:41:29.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f906ad25640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9064158460 con 0x7f9064159c70 2023-11-04T01:41:29.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f9063fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90640b0ae0 0x7f90640c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f9063fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90640b0ae0 0x7f90640c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43236/0 (socket says 172.21.15.114:43236) 2023-11-04T01:41:29.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f9063fff640 1 -- 172.21.15.114:0/2435685924 learned_addr learned my addr 172.21.15.114:0/2435685924 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:29.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f90692c2640 1 --2- 172.21.15.114:0/2435685924 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9064159c70 0x7f90640ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f9068ac1640 1 --2- 172.21.15.114:0/2435685924 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f906406db20 0x7f90640ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f9063fff640 1 -- 172.21.15.114:0/2435685924 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9064159c70 msgr2=0x7f90640ac770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f9063fff640 1 --2- 172.21.15.114:0/2435685924 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9064159c70 0x7f90640ac770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f9063fff640 1 -- 172.21.15.114:0/2435685924 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f906406db20 msgr2=0x7f90640ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f9063fff640 1 --2- 172.21.15.114:0/2435685924 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f906406db20 0x7f90640ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f9063fff640 1 -- 172.21.15.114:0/2435685924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905c009b30 con 0x7f90640b0ae0 2023-11-04T01:41:29.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.637+0000 7f9063fff640 1 --2- 172.21.15.114:0/2435685924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90640b0ae0 0x7f90640c7dc0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f905800c400 tx=0x7f905800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.638+0000 7f90617fa640 1 -- 172.21.15.114:0/2435685924 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90580052d0 con 0x7f90640b0ae0 2023-11-04T01:41:29.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.638+0000 7f90617fa640 1 -- 172.21.15.114:0/2435685924 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9058005430 con 0x7f90640b0ae0 2023-11-04T01:41:29.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.638+0000 7f90617fa640 1 -- 172.21.15.114:0/2435685924 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9058003830 con 0x7f90640b0ae0 2023-11-04T01:41:29.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.638+0000 7f906ad25640 1 -- 172.21.15.114:0/2435685924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90640ae980 con 0x7f90640b0ae0 2023-11-04T01:41:29.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.638+0000 7f906ad25640 1 -- 172.21.15.114:0/2435685924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90640ad960 con 0x7f90640b0ae0 2023-11-04T01:41:29.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.639+0000 7f906ad25640 1 -- 172.21.15.114:0/2435685924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90640ad7c0 con 0x7f90640b0ae0 2023-11-04T01:41:29.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.639+0000 7f90617fa640 1 -- 172.21.15.114:0/2435685924 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9058003990 con 0x7f90640b0ae0 2023-11-04T01:41:29.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.639+0000 7f90617fa640 1 --2- 172.21.15.114:0/2435685924 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f905006ae70 0x7f905006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.640+0000 7f90617fa640 1 -- 172.21.15.114:0/2435685924 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f90580892c0 con 0x7f90640b0ae0 2023-11-04T01:41:29.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.640+0000 7f9068ac1640 1 --2- 172.21.15.114:0/2435685924 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f905006ae70 0x7f905006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.640+0000 7f9068ac1640 1 --2- 172.21.15.114:0/2435685924 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f905006ae70 0x7f905006d330 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9054009ad0 tx=0x7f9054008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.644+0000 7f90617fa640 1 -- 172.21.15.114:0/2435685924 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f90640ad7c0 con 0x7f90640b0ae0 2023-11-04T01:41:29.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.845+0000 7f906ad25640 1 -- 172.21.15.114:0/2435685924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90640ae160 con 0x7f90640b0ae0 2023-11-04T01:41:29.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.845+0000 7f90617fa640 1 -- 172.21.15.114:0/2435685924 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f90640ae160 con 0x7f90640b0ae0 2023-11-04T01:41:29.847 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:29.847 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":71,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8013,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:25.851340+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7899,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7899":{"gid":7899,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:29.848 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 71 2023-11-04T01:41:29.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.847+0000 7f906ad25640 1 -- 172.21.15.114:0/2435685924 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f905006ae70 msgr2=0x7f905006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.847+0000 7f906ad25640 1 --2- 172.21.15.114:0/2435685924 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f905006ae70 0x7f905006d330 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9054009ad0 tx=0x7f9054008040 comp rx=0 tx=0).stop 2023-11-04T01:41:29.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.847+0000 7f906ad25640 1 -- 172.21.15.114:0/2435685924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90640b0ae0 msgr2=0x7f90640c7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.847+0000 7f906ad25640 1 --2- 172.21.15.114:0/2435685924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90640b0ae0 0x7f90640c7dc0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f905800c400 tx=0x7f905800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.847+0000 7f906ad25640 1 -- 172.21.15.114:0/2435685924 shutdown_connections 2023-11-04T01:41:29.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.847+0000 7f906ad25640 1 --2- 172.21.15.114:0/2435685924 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9064159c70 0x7f90640ac770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.847+0000 7f906ad25640 1 --2- 172.21.15.114:0/2435685924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90640b0ae0 0x7f90640c7dc0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.847+0000 7f906ad25640 1 --2- 172.21.15.114:0/2435685924 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f905006ae70 0x7f905006d330 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.847+0000 7f906ad25640 1 --2- 172.21.15.114:0/2435685924 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f906406db20 0x7f90640ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.847+0000 7f906ad25640 1 -- 172.21.15.114:0/2435685924 >> 172.21.15.114:0/2435685924 conn(0x7f90640ce950 msgr2=0x7f906415cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.847+0000 7f906ad25640 1 -- 172.21.15.114:0/2435685924 shutdown_connections 2023-11-04T01:41:29.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:29.848+0000 7f906ad25640 1 -- 172.21.15.114:0/2435685924 wait complete. 2023-11-04T01:41:29.860 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:41:29.973 INFO:teuthology.orchestra.run.smithi114.stdout:{"last_snap":4,"last_created":4,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:40:15.002825+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:40:40.232732+0000","name":"s12","metadata":{}},{"snapid":4,"ino":1099511627777,"stamp":"2023-11-04T01:41:05.777702+0000","name":"s15","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:41:29.973 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 4, "last_destroyed": 1, "last_snap": 4, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:40:15.002825+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:40:40.232732+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s15", "snapid": 4, "stamp": "2023-11-04T01:41:05.777702+0000" } ] } 2023-11-04T01:41:29.973 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:41:29.974 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=6 2023-11-04T01:41:29.974 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:30.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.071+0000 7fd73cae0640 1 Processor -- start 2023-11-04T01:41:30.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.071+0000 7fd73cae0640 1 -- start start 2023-11-04T01:41:30.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.072+0000 7fd73cae0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd73806cae0 0x7fd7380b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.072+0000 7fd73cae0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd73806cf40 0x7fd7380b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.072+0000 7fd73cae0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73806c650 con 0x7fd73815cd20 2023-11-04T01:41:30.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.072+0000 7fd73cae0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73806b830 con 0x7fd73806cf40 2023-11-04T01:41:30.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.072+0000 7fd73cae0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73806ba40 con 0x7fd73806cae0 2023-11-04T01:41:30.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.072+0000 7fd736d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd73806cf40 0x7fd7380b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.072+0000 7fd73659c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd73815cd20 0x7fd7381613b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44020/0 (socket says 172.21.15.114:44020) 2023-11-04T01:41:30.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.073+0000 7fd73659c640 1 -- 172.21.15.114:0/2005979490 learned_addr learned my addr 172.21.15.114:0/2005979490 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:30.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.073+0000 7fd736d9d640 1 -- 172.21.15.114:0/2005979490 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd73806cae0 msgr2=0x7fd7380b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:30.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.073+0000 7fd735d9b640 1 --2- 172.21.15.114:0/2005979490 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd73806cae0 0x7fd7380b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.073+0000 7fd73559a640 1 -- 172.21.15.114:0/2005979490 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832285888 0 0) 0x7fd73806c650 con 0x7fd73815cd20 2023-11-04T01:41:30.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.073+0000 7fd736d9d640 1 --2- 172.21.15.114:0/2005979490 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd73806cae0 0x7fd7380b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.073+0000 7fd736d9d640 1 -- 172.21.15.114:0/2005979490 >> v1:172.21.15.114:6789/0 conn(0x7fd73815cd20 legacy=0x7fd7381613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.073+0000 7fd736d9d640 1 -- 172.21.15.114:0/2005979490 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73806bd20 con 0x7fd73806cf40 2023-11-04T01:41:30.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.074+0000 7fd736d9d640 1 --2- 172.21.15.114:0/2005979490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd73806cf40 0x7fd7380b2b40 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fd730009d90 tx=0x7fd73002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a50388b8822143e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.074+0000 7fd73559a640 1 -- 172.21.15.114:0/2005979490 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73002cc50 con 0x7fd73806cf40 2023-11-04T01:41:30.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.074+0000 7fd73559a640 1 -- 172.21.15.114:0/2005979490 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73002cdb0 con 0x7fd73806cf40 2023-11-04T01:41:30.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.074+0000 7fd73559a640 1 -- 172.21.15.114:0/2005979490 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730034660 con 0x7fd73806cf40 2023-11-04T01:41:30.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.074+0000 7fd73cae0640 1 -- 172.21.15.114:0/2005979490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd73806cf40 msgr2=0x7fd7380b2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.074+0000 7fd73cae0640 1 --2- 172.21.15.114:0/2005979490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd73806cf40 0x7fd7380b2b40 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fd730009d90 tx=0x7fd73002bea0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.074+0000 7fd73cae0640 1 -- 172.21.15.114:0/2005979490 shutdown_connections 2023-11-04T01:41:30.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.074+0000 7fd73cae0640 1 --2- 172.21.15.114:0/2005979490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd73806cf40 0x7fd7380b2b40 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.074+0000 7fd73cae0640 1 --2- 172.21.15.114:0/2005979490 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd73806cae0 0x7fd7380b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.074+0000 7fd73cae0640 1 -- 172.21.15.114:0/2005979490 >> 172.21.15.114:0/2005979490 conn(0x7fd7380cd600 msgr2=0x7fd7380cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.074+0000 7fd73cae0640 1 -- 172.21.15.114:0/2005979490 shutdown_connections 2023-11-04T01:41:30.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.074+0000 7fd73cae0640 1 -- 172.21.15.114:0/2005979490 wait complete. 2023-11-04T01:41:30.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.076+0000 7fd73cae0640 1 Processor -- start 2023-11-04T01:41:30.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.076+0000 7fd73cae0640 1 -- start start 2023-11-04T01:41:30.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.076+0000 7fd73cae0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd73806cae0 0x7fd738157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.076+0000 7fd73cae0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd73806cf40 0x7fd7380b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.076+0000 7fd73cae0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd73815cd20 0x7fd7380b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.076+0000 7fd73cae0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73815dc10 con 0x7fd73806cae0 2023-11-04T01:41:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.076+0000 7fd73cae0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73815d440 con 0x7fd73806cf40 2023-11-04T01:41:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.076+0000 7fd73cae0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380b6540 con 0x7fd73815cd20 2023-11-04T01:41:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.076+0000 7fd73659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd73806cae0 0x7fd738157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.076+0000 7fd73659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd73806cae0 0x7fd738157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43248/0 (socket says 172.21.15.114:43248) 2023-11-04T01:41:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.076+0000 7fd73659c640 1 -- 172.21.15.114:0/3723802822 learned_addr learned my addr 172.21.15.114:0/3723802822 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.077+0000 7fd736d9d640 1 --2- 172.21.15.114:0/3723802822 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd73815cd20 0x7fd7380b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.077+0000 7fd735d9b640 1 --2- 172.21.15.114:0/3723802822 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd73806cf40 0x7fd7380b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.077+0000 7fd73659c640 1 -- 172.21.15.114:0/3723802822 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd73815cd20 msgr2=0x7fd7380b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.077+0000 7fd73659c640 1 --2- 172.21.15.114:0/3723802822 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd73815cd20 0x7fd7380b10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.077+0000 7fd73659c640 1 -- 172.21.15.114:0/3723802822 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd73806cf40 msgr2=0x7fd7380b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.077+0000 7fd73659c640 1 --2- 172.21.15.114:0/3723802822 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd73806cf40 0x7fd7380b0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.077+0000 7fd73659c640 1 -- 172.21.15.114:0/3723802822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd730009a70 con 0x7fd73806cae0 2023-11-04T01:41:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.077+0000 7fd73659c640 1 --2- 172.21.15.114:0/3723802822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd73806cae0 0x7fd738157eb0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fd72c00c410 tx=0x7fd72c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.077+0000 7fd726ffd640 1 -- 172.21.15.114:0/3723802822 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c0074e0 con 0x7fd73806cae0 2023-11-04T01:41:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.077+0000 7fd726ffd640 1 -- 172.21.15.114:0/3723802822 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72c0057a0 con 0x7fd73806cae0 2023-11-04T01:41:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.077+0000 7fd73cae0640 1 -- 172.21.15.114:0/3723802822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73815d650 con 0x7fd73806cae0 2023-11-04T01:41:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.077+0000 7fd726ffd640 1 -- 172.21.15.114:0/3723802822 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c007660 con 0x7fd73806cae0 2023-11-04T01:41:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.077+0000 7fd73cae0640 1 -- 172.21.15.114:0/3723802822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7381583f0 con 0x7fd73806cae0 2023-11-04T01:41:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.078+0000 7fd73cae0640 1 -- 172.21.15.114:0/3723802822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73806d3c0 con 0x7fd73806cae0 2023-11-04T01:41:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.078+0000 7fd726ffd640 1 -- 172.21.15.114:0/3723802822 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd72c005bd0 con 0x7fd73806cae0 2023-11-04T01:41:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.079+0000 7fd726ffd640 1 --2- 172.21.15.114:0/3723802822 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd71806ae70 0x7fd71806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.079+0000 7fd726ffd640 1 -- 172.21.15.114:0/3723802822 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fd72c089350 con 0x7fd73806cae0 2023-11-04T01:41:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.079+0000 7fd735d9b640 1 --2- 172.21.15.114:0/3723802822 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd71806ae70 0x7fd71806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.079+0000 7fd735d9b640 1 --2- 172.21.15.114:0/3723802822 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd71806ae70 0x7fd71806d330 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd728006fd0 tx=0x7fd728008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.083+0000 7fd726ffd640 1 -- 172.21.15.114:0/3723802822 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd72c053d40 con 0x7fd73806cae0 2023-11-04T01:41:30.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.283+0000 7fd73cae0640 1 -- 172.21.15.114:0/3723802822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7380b6b00 con 0x7fd73806cae0 2023-11-04T01:41:30.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.284+0000 7fd726ffd640 1 -- 172.21.15.114:0/3723802822 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fd72c057360 con 0x7fd73806cae0 2023-11-04T01:41:30.286 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:30.286 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":71,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8013,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:25.851340+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7899,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7899":{"gid":7899,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:30.286 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 71 2023-11-04T01:41:30.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.286+0000 7fd73cae0640 1 -- 172.21.15.114:0/3723802822 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd71806ae70 msgr2=0x7fd71806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.286+0000 7fd73cae0640 1 --2- 172.21.15.114:0/3723802822 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd71806ae70 0x7fd71806d330 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd728006fd0 tx=0x7fd728008040 comp rx=0 tx=0).stop 2023-11-04T01:41:30.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.286+0000 7fd73cae0640 1 -- 172.21.15.114:0/3723802822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd73806cae0 msgr2=0x7fd738157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.286+0000 7fd73cae0640 1 --2- 172.21.15.114:0/3723802822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd73806cae0 0x7fd738157eb0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fd72c00c410 tx=0x7fd72c00c8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.286+0000 7fd73cae0640 1 -- 172.21.15.114:0/3723802822 shutdown_connections 2023-11-04T01:41:30.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.286+0000 7fd73cae0640 1 --2- 172.21.15.114:0/3723802822 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd73815cd20 0x7fd7380b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.286+0000 7fd73cae0640 1 --2- 172.21.15.114:0/3723802822 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd71806ae70 0x7fd71806d330 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.286+0000 7fd73cae0640 1 --2- 172.21.15.114:0/3723802822 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd73806cf40 0x7fd7380b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.286+0000 7fd73cae0640 1 --2- 172.21.15.114:0/3723802822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd73806cae0 0x7fd738157eb0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.286+0000 7fd73cae0640 1 -- 172.21.15.114:0/3723802822 >> 172.21.15.114:0/3723802822 conn(0x7fd7380cd600 msgr2=0x7fd7380cc060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.286+0000 7fd73cae0640 1 -- 172.21.15.114:0/3723802822 shutdown_connections 2023-11-04T01:41:30.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.286+0000 7fd73cae0640 1 -- 172.21.15.114:0/3723802822 wait complete. 2023-11-04T01:41:30.298 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:41:30.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.396+0000 7fa7efb00640 1 Processor -- start 2023-11-04T01:41:30.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.397+0000 7fa7efb00640 1 -- start start 2023-11-04T01:41:30.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.397+0000 7fa7efb00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa7e80cd6d0 0x7fa7e8161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.397+0000 7fa7efb00640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa7e80b4880 0x7fa7e80b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.397+0000 7fa7efb00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e80cde60 con 0x7fa7e8153e60 2023-11-04T01:41:30.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.397+0000 7fa7efb00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e8160f90 con 0x7fa7e80cd6d0 2023-11-04T01:41:30.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.397+0000 7fa7efb00640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e8161960 con 0x7fa7e80b4880 2023-11-04T01:41:30.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.398+0000 7fa7ed89c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa7e8153e60 0x7fa7e815dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44036/0 (socket says 172.21.15.114:44036) 2023-11-04T01:41:30.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.398+0000 7fa7ed89c640 1 -- 172.21.15.114:0/2508520042 learned_addr learned my addr 172.21.15.114:0/2508520042 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:30.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.398+0000 7fa7ed09b640 1 --2- 172.21.15.114:0/2508520042 >> v2:172.21.15.114:3300/0 conn(0x7fa7e80cd6d0 0x7fa7e8161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.398+0000 7fa7ee09d640 1 --2- 172.21.15.114:0/2508520042 >> v2:172.21.15.141:3300/0 conn(0x7fa7e80b4880 0x7fa7e80b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.398+0000 7fa7ec89a640 1 -- 172.21.15.114:0/2508520042 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586937915 0 0) 0x7fa7e80cde60 con 0x7fa7e8153e60 2023-11-04T01:41:30.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.398+0000 7fa7ec89a640 1 -- 172.21.15.114:0/2508520042 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d4003520 con 0x7fa7e8153e60 2023-11-04T01:41:30.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.398+0000 7fa7ed09b640 1 -- 172.21.15.114:0/2508520042 >> v2:172.21.15.141:3300/0 conn(0x7fa7e80b4880 msgr2=0x7fa7e80b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:30.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.398+0000 7fa7ed09b640 1 --2- 172.21.15.114:0/2508520042 >> v2:172.21.15.141:3300/0 conn(0x7fa7e80b4880 0x7fa7e80b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.398+0000 7fa7ed09b640 1 -- 172.21.15.114:0/2508520042 >> v1:172.21.15.114:6789/0 conn(0x7fa7e8153e60 legacy=0x7fa7e815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.398+0000 7fa7ed09b640 1 -- 172.21.15.114:0/2508520042 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e80b5220 con 0x7fa7e80cd6d0 2023-11-04T01:41:30.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.399+0000 7fa7ed09b640 1 --2- 172.21.15.114:0/2508520042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e80cd6d0 0x7fa7e8161420 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80b8f40 tx=0x7fa7e402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c266550b0f1c8e13 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.399+0000 7fa7ec89a640 1 -- 172.21.15.114:0/2508520042 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4031830 con 0x7fa7e80cd6d0 2023-11-04T01:41:30.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.399+0000 7fa7ec89a640 1 -- 172.21.15.114:0/2508520042 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e4031990 con 0x7fa7e80cd6d0 2023-11-04T01:41:30.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.399+0000 7fa7ec89a640 1 -- 172.21.15.114:0/2508520042 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4031d20 con 0x7fa7e80cd6d0 2023-11-04T01:41:30.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.399+0000 7fa7efb00640 1 -- 172.21.15.114:0/2508520042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e80cd6d0 msgr2=0x7fa7e8161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.399+0000 7fa7efb00640 1 --2- 172.21.15.114:0/2508520042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e80cd6d0 0x7fa7e8161420 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80b8f40 tx=0x7fa7e402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.399+0000 7fa7efb00640 1 -- 172.21.15.114:0/2508520042 shutdown_connections 2023-11-04T01:41:30.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.399+0000 7fa7efb00640 1 --2- 172.21.15.114:0/2508520042 >> v2:172.21.15.141:3300/0 conn(0x7fa7e80b4880 0x7fa7e80b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.399+0000 7fa7efb00640 1 --2- 172.21.15.114:0/2508520042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e80cd6d0 0x7fa7e8161420 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.399+0000 7fa7efb00640 1 -- 172.21.15.114:0/2508520042 >> 172.21.15.114:0/2508520042 conn(0x7fa7e80cf880 msgr2=0x7fa7e80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.399+0000 7fa7efb00640 1 -- 172.21.15.114:0/2508520042 shutdown_connections 2023-11-04T01:41:30.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.399+0000 7fa7efb00640 1 -- 172.21.15.114:0/2508520042 wait complete. 2023-11-04T01:41:30.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.401+0000 7fa7efb00640 1 Processor -- start 2023-11-04T01:41:30.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.401+0000 7fa7efb00640 1 -- start start 2023-11-04T01:41:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.401+0000 7fa7efb00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e80b4880 0x7fa7e80c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.401+0000 7fa7efb00640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa7e80cd6d0 0x7fa7e80c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.401+0000 7fa7efb00640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa7e8153e60 0x7fa7e8159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.401+0000 7fa7efb00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80c62b0 con 0x7fa7e80b4880 2023-11-04T01:41:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.401+0000 7fa7efb00640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80c9270 con 0x7fa7e8153e60 2023-11-04T01:41:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.401+0000 7fa7efb00640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80c89d0 con 0x7fa7e80cd6d0 2023-11-04T01:41:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.401+0000 7fa7ed89c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e80b4880 0x7fa7e80c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.401+0000 7fa7ed89c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e80b4880 0x7fa7e80c7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43266/0 (socket says 172.21.15.114:43266) 2023-11-04T01:41:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.401+0000 7fa7ed89c640 1 -- 172.21.15.114:0/2650055931 learned_addr learned my addr 172.21.15.114:0/2650055931 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.402+0000 7fa7ed89c640 1 -- 172.21.15.114:0/2650055931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa7e80cd6d0 msgr2=0x7fa7e80c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.402+0000 7fa7ee09d640 1 --2- 172.21.15.114:0/2650055931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa7e8153e60 0x7fa7e8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.402+0000 7fa7ed89c640 1 --2- 172.21.15.114:0/2650055931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa7e80cd6d0 0x7fa7e80c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.402+0000 7fa7ed89c640 1 -- 172.21.15.114:0/2650055931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa7e8153e60 msgr2=0x7fa7e8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.402+0000 7fa7ed89c640 1 --2- 172.21.15.114:0/2650055931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa7e8153e60 0x7fa7e8159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.402+0000 7fa7ed89c640 1 -- 172.21.15.114:0/2650055931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e4009400 con 0x7fa7e80b4880 2023-11-04T01:41:30.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.402+0000 7fa7ed89c640 1 --2- 172.21.15.114:0/2650055931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e80b4880 0x7fa7e80c7c60 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800c410 tx=0x7fa7d800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.402+0000 7fa7de7fc640 1 -- 172.21.15.114:0/2650055931 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8005ce0 con 0x7fa7e80b4880 2023-11-04T01:41:30.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.402+0000 7fa7de7fc640 1 -- 172.21.15.114:0/2650055931 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d8005e40 con 0x7fa7e80b4880 2023-11-04T01:41:30.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.402+0000 7fa7de7fc640 1 -- 172.21.15.114:0/2650055931 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80072f0 con 0x7fa7e80b4880 2023-11-04T01:41:30.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.402+0000 7fa7efb00640 1 -- 172.21.15.114:0/2650055931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e80c8cb0 con 0x7fa7e80b4880 2023-11-04T01:41:30.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.402+0000 7fa7efb00640 1 -- 172.21.15.114:0/2650055931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e8154890 con 0x7fa7e80b4880 2023-11-04T01:41:30.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.403+0000 7fa7efb00640 1 -- 172.21.15.114:0/2650055931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e815d7c0 con 0x7fa7e80b4880 2023-11-04T01:41:30.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.403+0000 7fa7de7fc640 1 -- 172.21.15.114:0/2650055931 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa7d8007510 con 0x7fa7e80b4880 2023-11-04T01:41:30.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.404+0000 7fa7de7fc640 1 --2- 172.21.15.114:0/2650055931 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7cc06ae70 0x7fa7cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.404+0000 7fa7ed09b640 1 --2- 172.21.15.114:0/2650055931 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7cc06ae70 0x7fa7cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.404+0000 7fa7de7fc640 1 -- 172.21.15.114:0/2650055931 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fa7d8089380 con 0x7fa7e80b4880 2023-11-04T01:41:30.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.404+0000 7fa7ed09b640 1 --2- 172.21.15.114:0/2650055931 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7cc06ae70 0x7fa7cc06d330 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4036000 tx=0x7fa7e4030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.408+0000 7fa7de7fc640 1 -- 172.21.15.114:0/2650055931 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa7d8053e30 con 0x7fa7e80b4880 2023-11-04T01:41:30.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:30.639+0000 7fa7efb00640 1 -- 172.21.15.114:0/2650055931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7fa7e8074290 con 0x7fa7e80b4880 2023-11-04T01:41:31.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.592+0000 7fa7de7fc640 1 -- 172.21.15.114:0/2650055931 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7899 v72) v1 ==== 112+0+0 (secure 0 0 0) 0x7fa7d8057450 con 0x7fa7e80b4880 2023-11-04T01:41:31.596 INFO:teuthology.orchestra.run.smithi114.stderr:freezing mds.7899 2023-11-04T01:41:31.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.595+0000 7fa7efb00640 1 -- 172.21.15.114:0/2650055931 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7cc06ae70 msgr2=0x7fa7cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.595+0000 7fa7efb00640 1 --2- 172.21.15.114:0/2650055931 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7cc06ae70 0x7fa7cc06d330 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4036000 tx=0x7fa7e4030000 comp rx=0 tx=0).stop 2023-11-04T01:41:31.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.595+0000 7fa7efb00640 1 -- 172.21.15.114:0/2650055931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e80b4880 msgr2=0x7fa7e80c7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.595+0000 7fa7efb00640 1 --2- 172.21.15.114:0/2650055931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e80b4880 0x7fa7e80c7c60 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800c410 tx=0x7fa7d800c8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.596+0000 7fa7efb00640 1 -- 172.21.15.114:0/2650055931 shutdown_connections 2023-11-04T01:41:31.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.596+0000 7fa7efb00640 1 --2- 172.21.15.114:0/2650055931 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa7cc06ae70 0x7fa7cc06d330 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.596+0000 7fa7efb00640 1 --2- 172.21.15.114:0/2650055931 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa7e8153e60 0x7fa7e8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.596+0000 7fa7efb00640 1 --2- 172.21.15.114:0/2650055931 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa7e80cd6d0 0x7fa7e80c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.596+0000 7fa7efb00640 1 --2- 172.21.15.114:0/2650055931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e80b4880 0x7fa7e80c7c60 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.596+0000 7fa7efb00640 1 -- 172.21.15.114:0/2650055931 >> 172.21.15.114:0/2650055931 conn(0x7fa7e80cf880 msgr2=0x7fa7e815fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:31.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.596+0000 7fa7efb00640 1 -- 172.21.15.114:0/2650055931 shutdown_connections 2023-11-04T01:41:31.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.596+0000 7fa7efb00640 1 -- 172.21.15.114:0/2650055931 wait complete. 2023-11-04T01:41:31.611 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_kill_mdstable_at 6 2023-11-04T01:41:31.728 INFO:teuthology.orchestra.run.smithi114.stdout:{"success":"mds_kill_mdstable_at = '6' (not observed, change may require restart) "} 2023-11-04T01:41:31.729 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '6' (not observed, change may require restart) " } 2023-11-04T01:41:31.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:31.729 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s16) 2023-11-04T01:41:31.732 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:41:31.856 INFO:teuthology.orchestra.run.smithi114.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:41:31.857 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:41:31.857 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:31.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.956+0000 7f45958d4640 1 Processor -- start 2023-11-04T01:41:31.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.956+0000 7f45958d4640 1 -- start start 2023-11-04T01:41:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f45958d4640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f45900ce240 0x7f4590157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f45958d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4590157540 0x7f45900d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f45958d4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459015e000 con 0x7f45900cde60 2023-11-04T01:41:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f45958d4640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459015e5c0 con 0x7f45900ce240 2023-11-04T01:41:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f45958d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459015e2e0 con 0x7f4590157540 2023-11-04T01:41:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f458effd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f45900cde60 0x7f459015d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44042/0 (socket says 172.21.15.114:44042) 2023-11-04T01:41:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f458effd640 1 -- 172.21.15.114:0/2973592768 learned_addr learned my addr 172.21.15.114:0/2973592768 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f458e7fc640 1 -- 172.21.15.114:0/2973592768 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657493691 0 0) 0x7f459015e000 con 0x7f45900cde60 2023-11-04T01:41:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f458e7fc640 1 -- 172.21.15.114:0/2973592768 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f457c003520 con 0x7f45900cde60 2023-11-04T01:41:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f458f7fe640 1 --2- 172.21.15.114:0/2973592768 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4590157540 0x7f45900d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f4587fff640 1 --2- 172.21.15.114:0/2973592768 >> v2:172.21.15.141:3300/0 conn(0x7f45900ce240 0x7f4590157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f458e7fc640 1 -- 172.21.15.114:0/2973592768 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3692478918 0 0) 0x7f457c003520 con 0x7f45900cde60 2023-11-04T01:41:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f458e7fc640 1 -- 172.21.15.114:0/2973592768 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4590157540 msgr2=0x7f45900d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f458e7fc640 1 --2- 172.21.15.114:0/2973592768 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4590157540 0x7f45900d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f458e7fc640 1 -- 172.21.15.114:0/2973592768 >> v2:172.21.15.141:3300/0 conn(0x7f45900ce240 msgr2=0x7f4590157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f458e7fc640 1 --2- 172.21.15.114:0/2973592768 >> v2:172.21.15.141:3300/0 conn(0x7f45900ce240 0x7f4590157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f458e7fc640 1 -- 172.21.15.114:0/2973592768 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45900d1120 con 0x7f45900cde60 2023-11-04T01:41:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.957+0000 7f458e7fc640 1 -- 172.21.15.114:0/2973592768 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f4580001670 con 0x7f45900cde60 2023-11-04T01:41:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.958+0000 7f458e7fc640 1 -- 172.21.15.114:0/2973592768 >> v1:172.21.15.114:6789/0 conn(0x7f45900cde60 legacy=0x7f459015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.958+0000 7f458e7fc640 1 --2- 172.21.15.114:0/2973592768 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4590157540 0x7f457c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.958+0000 7f458e7fc640 1 --2- 172.21.15.114:0/2973592768 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f457c003ef0 0x7f457c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.958+0000 7f458e7fc640 1 --2- 172.21.15.114:0/2973592768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f457c004d00 0x7f457c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.958+0000 7f458e7fc640 1 -- 172.21.15.114:0/2973592768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459015e5c0 con 0x7f457c004d00 2023-11-04T01:41:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.958+0000 7f458e7fc640 1 -- 172.21.15.114:0/2973592768 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459015e2e0 con 0x7f457c003ef0 2023-11-04T01:41:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.958+0000 7f458e7fc640 1 -- 172.21.15.114:0/2973592768 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457c00b980 con 0x7f4590157540 2023-11-04T01:41:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.958+0000 7f458f7fe640 1 --2- 172.21.15.114:0/2973592768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f457c004d00 0x7f457c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.958+0000 7f4587fff640 1 --2- 172.21.15.114:0/2973592768 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f457c003ef0 0x7f457c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.958+0000 7f458effd640 1 --2- 172.21.15.114:0/2973592768 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4590157540 0x7f457c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.958+0000 7f458f7fe640 1 -- 172.21.15.114:0/2973592768 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4590157540 msgr2=0x7f457c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.958+0000 7f458f7fe640 1 --2- 172.21.15.114:0/2973592768 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4590157540 0x7f457c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.958+0000 7f458f7fe640 1 -- 172.21.15.114:0/2973592768 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f457c003ef0 msgr2=0x7f457c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.958+0000 7f458f7fe640 1 --2- 172.21.15.114:0/2973592768 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f457c003ef0 0x7f457c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.958+0000 7f458f7fe640 1 -- 172.21.15.114:0/2973592768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c003520 con 0x7f457c004d00 2023-11-04T01:41:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.958+0000 7f4587fff640 1 --2- 172.21.15.114:0/2973592768 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f457c003ef0 0x7f457c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.959+0000 7f458f7fe640 1 --2- 172.21.15.114:0/2973592768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f457c004d00 0x7f457c005180 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f4588009fc0 tx=0x7f457c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd414048d8c5638b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.959+0000 7f458e7fc640 1 -- 172.21.15.114:0/2973592768 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458802cc00 con 0x7f457c004d00 2023-11-04T01:41:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.959+0000 7f458e7fc640 1 -- 172.21.15.114:0/2973592768 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458800f040 con 0x7f457c004d00 2023-11-04T01:41:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.959+0000 7f458e7fc640 1 -- 172.21.15.114:0/2973592768 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4588034440 con 0x7f457c004d00 2023-11-04T01:41:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.959+0000 7f45958d4640 1 -- 172.21.15.114:0/2973592768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f457c004d00 msgr2=0x7f457c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.959+0000 7f45958d4640 1 --2- 172.21.15.114:0/2973592768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f457c004d00 0x7f457c005180 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f4588009fc0 tx=0x7f457c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.959+0000 7f458f7fe640 1 -- 172.21.15.114:0/2973592768 reap_dead start 2023-11-04T01:41:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.959+0000 7f45958d4640 1 -- 172.21.15.114:0/2973592768 shutdown_connections 2023-11-04T01:41:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.959+0000 7f45958d4640 1 -- 172.21.15.114:0/2973592768 >> 172.21.15.114:0/2973592768 conn(0x7f4590071f30 msgr2=0x7f45900cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.959+0000 7f45958d4640 1 -- 172.21.15.114:0/2973592768 shutdown_connections 2023-11-04T01:41:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.959+0000 7f45958d4640 1 -- 172.21.15.114:0/2973592768 wait complete. 2023-11-04T01:41:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.961+0000 7f45958d4640 1 Processor -- start 2023-11-04T01:41:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.961+0000 7f45958d4640 1 -- start start 2023-11-04T01:41:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.961+0000 7f45958d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4590154fe0 0x7f459015b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.961+0000 7f45958d4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45901553c0 0x7f459015b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.961+0000 7f45958d4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45900caf80 0x7f45900cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.961+0000 7f45958d4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45900cc8f0 con 0x7f45901553c0 2023-11-04T01:41:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.961+0000 7f45958d4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45900cbce0 con 0x7f45900caf80 2023-11-04T01:41:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.961+0000 7f45958d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45900cbfc0 con 0x7f4590154fe0 2023-11-04T01:41:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.961+0000 7f4587fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45901553c0 0x7f459015b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.961+0000 7f4587fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45901553c0 0x7f459015b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43282/0 (socket says 172.21.15.114:43282) 2023-11-04T01:41:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.961+0000 7f4587fff640 1 -- 172.21.15.114:0/970180576 learned_addr learned my addr 172.21.15.114:0/970180576 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.962+0000 7f458effd640 1 --2- 172.21.15.114:0/970180576 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4590154fe0 0x7f459015b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.962+0000 7f458f7fe640 1 --2- 172.21.15.114:0/970180576 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45900caf80 0x7f45900cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.962+0000 7f4587fff640 1 -- 172.21.15.114:0/970180576 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4590154fe0 msgr2=0x7f459015b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.962+0000 7f4587fff640 1 --2- 172.21.15.114:0/970180576 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4590154fe0 0x7f459015b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.962+0000 7f4587fff640 1 -- 172.21.15.114:0/970180576 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45900caf80 msgr2=0x7f45900cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.962+0000 7f4587fff640 1 --2- 172.21.15.114:0/970180576 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45900caf80 0x7f45900cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.962+0000 7f4587fff640 1 -- 172.21.15.114:0/970180576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45900cc2a0 con 0x7f45901553c0 2023-11-04T01:41:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.962+0000 7f458f7fe640 1 --2- 172.21.15.114:0/970180576 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45900caf80 0x7f45900cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.962+0000 7f4587fff640 1 --2- 172.21.15.114:0/970180576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45901553c0 0x7f459015b9a0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f45780115d0 tx=0x7f45780119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.962+0000 7f458cff9640 1 -- 172.21.15.114:0/970180576 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578015870 con 0x7f45901553c0 2023-11-04T01:41:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.962+0000 7f458cff9640 1 -- 172.21.15.114:0/970180576 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45780159d0 con 0x7f45901553c0 2023-11-04T01:41:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.962+0000 7f45958d4640 1 -- 172.21.15.114:0/970180576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45900cc580 con 0x7f45901553c0 2023-11-04T01:41:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.962+0000 7f458cff9640 1 -- 172.21.15.114:0/970180576 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578015d60 con 0x7f45901553c0 2023-11-04T01:41:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.962+0000 7f45958d4640 1 -- 172.21.15.114:0/970180576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45901f26b0 con 0x7f45901553c0 2023-11-04T01:41:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.963+0000 7f45958d4640 1 -- 172.21.15.114:0/970180576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45900d0a40 con 0x7f45901553c0 2023-11-04T01:41:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.963+0000 7f458cff9640 1 -- 172.21.15.114:0/970180576 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f457801d400 con 0x7f45901553c0 2023-11-04T01:41:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.964+0000 7f458cff9640 1 --2- 172.21.15.114:0/970180576 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f457006aea0 0x7f457006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.964+0000 7f458cff9640 1 -- 172.21.15.114:0/970180576 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f457808a360 con 0x7f45901553c0 2023-11-04T01:41:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.964+0000 7f458effd640 1 --2- 172.21.15.114:0/970180576 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f457006aea0 0x7f457006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.964+0000 7f458effd640 1 --2- 172.21.15.114:0/970180576 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f457006aea0 0x7f457006d360 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4580001050 tx=0x7f4580007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:31.968+0000 7f458cff9640 1 -- 172.21.15.114:0/970180576 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4578054de0 con 0x7f45901553c0 2023-11-04T01:41:32.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:32.169+0000 7f45958d4640 1 -- 172.21.15.114:0/970180576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45901579b0 con 0x7f45901553c0 2023-11-04T01:41:32.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:32.170+0000 7f458cff9640 1 -- 172.21.15.114:0/970180576 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f4578058400 con 0x7f45901553c0 2023-11-04T01:41:32.173 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:32.174 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8013,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:30.640767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7899,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7899":{"gid":7899,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:32.175 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 72 2023-11-04T01:41:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:32.172+0000 7f45958d4640 1 -- 172.21.15.114:0/970180576 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f457006aea0 msgr2=0x7f457006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:32.172+0000 7f45958d4640 1 --2- 172.21.15.114:0/970180576 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f457006aea0 0x7f457006d360 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4580001050 tx=0x7f4580007040 comp rx=0 tx=0).stop 2023-11-04T01:41:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:32.172+0000 7f45958d4640 1 -- 172.21.15.114:0/970180576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45901553c0 msgr2=0x7f459015b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:32.172+0000 7f45958d4640 1 --2- 172.21.15.114:0/970180576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45901553c0 0x7f459015b9a0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f45780115d0 tx=0x7f45780119d0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:32.172+0000 7f45958d4640 1 -- 172.21.15.114:0/970180576 shutdown_connections 2023-11-04T01:41:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:32.172+0000 7f45958d4640 1 --2- 172.21.15.114:0/970180576 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f457006aea0 0x7f457006d360 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:32.172+0000 7f45958d4640 1 --2- 172.21.15.114:0/970180576 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45900caf80 0x7f45900cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:32.172+0000 7f45958d4640 1 --2- 172.21.15.114:0/970180576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45901553c0 0x7f459015b9a0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:32.172+0000 7f45958d4640 1 --2- 172.21.15.114:0/970180576 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4590154fe0 0x7f459015b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:32.172+0000 7f45958d4640 1 -- 172.21.15.114:0/970180576 >> 172.21.15.114:0/970180576 conn(0x7f4590071f30 msgr2=0x7f45900d3690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:32.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:32.172+0000 7f45958d4640 1 -- 172.21.15.114:0/970180576 shutdown_connections 2023-11-04T01:41:32.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:32.172+0000 7f45958d4640 1 -- 172.21.15.114:0/970180576 wait complete. 2023-11-04T01:41:32.185 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:32.388 INFO:tasks.ceph.mds.a.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fd04c305640 time 2023-11-04T01:41:32.386397+0000 2023-11-04T01:41:32.388 INFO:tasks.ceph.mds.a.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:41:32.388 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:32.389 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd057f6efaf] 2023-11-04T01:41:32.389 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fd057f6f16d] 2023-11-04T01:41:32.389 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55cec1a8921b] 2023-11-04T01:41:32.389 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55cec1ab8bcc] 2023-11-04T01:41:32.389 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55cec1ac1b0c] 2023-11-04T01:41:32.389 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55cec1ac1c63] 2023-11-04T01:41:32.390 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fd0580164a5] 2023-11-04T01:41:32.390 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fd05769f802] 2023-11-04T01:41:32.390 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fd05763f450] 2023-11-04T01:41:32.390 INFO:tasks.ceph.mds.a.smithi114.stderr:2023-11-04T01:41:32.384+0000 7fd04c305640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fd04c305640 time 2023-11-04T01:41:32.386397+0000 2023-11-04T01:41:32.390 INFO:tasks.ceph.mds.a.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:41:32.391 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:41:32.391 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:32.391 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd057f6efaf] 2023-11-04T01:41:32.391 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fd057f6f16d] 2023-11-04T01:41:32.391 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55cec1a8921b] 2023-11-04T01:41:32.392 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55cec1ab8bcc] 2023-11-04T01:41:32.392 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55cec1ac1b0c] 2023-11-04T01:41:32.392 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55cec1ac1c63] 2023-11-04T01:41:32.392 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fd0580164a5] 2023-11-04T01:41:32.393 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fd05769f802] 2023-11-04T01:41:32.393 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fd05763f450] 2023-11-04T01:41:32.393 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:41:32.393 INFO:tasks.ceph.mds.a.smithi114.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:41:32.393 INFO:tasks.ceph.mds.a.smithi114.stderr: in thread 7fd04c305640 thread_name:MR_Finisher 2023-11-04T01:41:32.393 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:32.394 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fd057654db0] 2023-11-04T01:41:32.394 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fd0576a154c] 2023-11-04T01:41:32.394 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: raise() 2023-11-04T01:41:32.394 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: abort() 2023-11-04T01:41:32.394 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd057f6f009] 2023-11-04T01:41:32.394 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fd057f6f16d] 2023-11-04T01:41:32.395 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55cec1a8921b] 2023-11-04T01:41:32.395 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55cec1ab8bcc] 2023-11-04T01:41:32.395 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55cec1ac1b0c] 2023-11-04T01:41:32.395 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55cec1ac1c63] 2023-11-04T01:41:32.395 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fd0580164a5] 2023-11-04T01:41:32.395 INFO:tasks.ceph.mds.a.smithi114.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fd05769f802] 2023-11-04T01:41:32.395 INFO:tasks.ceph.mds.a.smithi114.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fd05763f450] 2023-11-04T01:41:32.396 INFO:tasks.ceph.mds.a.smithi114.stderr:2023-11-04T01:41:32.385+0000 7fd04c305640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:32.396 INFO:tasks.ceph.mds.a.smithi114.stderr: in thread 7fd04c305640 thread_name:MR_Finisher 2023-11-04T01:41:32.396 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:41:32.396 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:32.396 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fd057654db0] 2023-11-04T01:41:32.396 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fd0576a154c] 2023-11-04T01:41:32.396 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: raise() 2023-11-04T01:41:32.396 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: abort() 2023-11-04T01:41:32.396 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd057f6f009] 2023-11-04T01:41:32.397 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fd057f6f16d] 2023-11-04T01:41:32.397 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55cec1a8921b] 2023-11-04T01:41:32.397 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55cec1ab8bcc] 2023-11-04T01:41:32.397 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55cec1ac1b0c] 2023-11-04T01:41:32.397 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55cec1ac1c63] 2023-11-04T01:41:32.397 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fd0580164a5] 2023-11-04T01:41:32.397 INFO:tasks.ceph.mds.a.smithi114.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fd05769f802] 2023-11-04T01:41:32.397 INFO:tasks.ceph.mds.a.smithi114.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fd05763f450] 2023-11-04T01:41:32.398 INFO:tasks.ceph.mds.a.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:32.398 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:41:32.399 INFO:tasks.ceph.mds.a.smithi114.stderr: -583> 2023-11-04T01:41:28.302+0000 7fd04fb0c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:32.399 INFO:tasks.ceph.mds.a.smithi114.stderr: -581> 2023-11-04T01:41:28.302+0000 7fd04fb0c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:32.399 INFO:tasks.ceph.mds.a.smithi114.stderr: -4> 2023-11-04T01:41:32.384+0000 7fd04c305640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fd04c305640 time 2023-11-04T01:41:32.386397+0000 2023-11-04T01:41:32.399 INFO:tasks.ceph.mds.a.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:41:32.400 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:41:32.400 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:32.400 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd057f6efaf] 2023-11-04T01:41:32.400 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fd057f6f16d] 2023-11-04T01:41:32.400 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55cec1a8921b] 2023-11-04T01:41:32.400 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55cec1ab8bcc] 2023-11-04T01:41:32.400 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55cec1ac1b0c] 2023-11-04T01:41:32.400 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55cec1ac1c63] 2023-11-04T01:41:32.400 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fd0580164a5] 2023-11-04T01:41:32.400 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fd05769f802] 2023-11-04T01:41:32.400 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fd05763f450] 2023-11-04T01:41:32.400 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:41:32.401 INFO:tasks.ceph.mds.a.smithi114.stderr: 0> 2023-11-04T01:41:32.385+0000 7fd04c305640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:32.401 INFO:tasks.ceph.mds.a.smithi114.stderr: in thread 7fd04c305640 thread_name:MR_Finisher 2023-11-04T01:41:32.401 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:41:32.401 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:32.401 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fd057654db0] 2023-11-04T01:41:32.401 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fd0576a154c] 2023-11-04T01:41:32.401 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: raise() 2023-11-04T01:41:32.401 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: abort() 2023-11-04T01:41:32.401 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd057f6f009] 2023-11-04T01:41:32.401 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fd057f6f16d] 2023-11-04T01:41:32.401 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55cec1a8921b] 2023-11-04T01:41:32.401 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55cec1ab8bcc] 2023-11-04T01:41:32.401 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55cec1ac1b0c] 2023-11-04T01:41:32.402 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55cec1ac1c63] 2023-11-04T01:41:32.402 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fd0580164a5] 2023-11-04T01:41:32.402 INFO:tasks.ceph.mds.a.smithi114.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fd05769f802] 2023-11-04T01:41:32.402 INFO:tasks.ceph.mds.a.smithi114.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fd05763f450] 2023-11-04T01:41:32.402 INFO:tasks.ceph.mds.a.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:32.402 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:41:32.402 INFO:tasks.ceph.mds.a.smithi114.stderr: -583> 2023-11-04T01:41:28.302+0000 7fd04fb0c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:32.402 INFO:tasks.ceph.mds.a.smithi114.stderr: -581> 2023-11-04T01:41:28.302+0000 7fd04fb0c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:32.402 INFO:tasks.ceph.mds.a.smithi114.stderr: -4> 2023-11-04T01:41:32.384+0000 7fd04c305640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fd04c305640 time 2023-11-04T01:41:32.386397+0000 2023-11-04T01:41:32.403 INFO:tasks.ceph.mds.a.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:41:32.403 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:41:32.403 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:32.403 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd057f6efaf] 2023-11-04T01:41:32.403 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fd057f6f16d] 2023-11-04T01:41:32.403 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55cec1a8921b] 2023-11-04T01:41:32.403 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55cec1ab8bcc] 2023-11-04T01:41:32.403 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55cec1ac1b0c] 2023-11-04T01:41:32.403 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55cec1ac1c63] 2023-11-04T01:41:32.403 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fd0580164a5] 2023-11-04T01:41:32.403 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fd05769f802] 2023-11-04T01:41:32.403 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fd05763f450] 2023-11-04T01:41:32.404 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:41:32.404 INFO:tasks.ceph.mds.a.smithi114.stderr: 0> 2023-11-04T01:41:32.385+0000 7fd04c305640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:32.404 INFO:tasks.ceph.mds.a.smithi114.stderr: in thread 7fd04c305640 thread_name:MR_Finisher 2023-11-04T01:41:32.404 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:41:32.404 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:32.404 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fd057654db0] 2023-11-04T01:41:32.404 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fd0576a154c] 2023-11-04T01:41:32.404 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: raise() 2023-11-04T01:41:32.405 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: abort() 2023-11-04T01:41:32.405 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd057f6f009] 2023-11-04T01:41:32.405 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fd057f6f16d] 2023-11-04T01:41:32.405 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55cec1a8921b] 2023-11-04T01:41:32.405 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55cec1ab8bcc] 2023-11-04T01:41:32.405 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55cec1ac1b0c] 2023-11-04T01:41:32.405 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55cec1ac1c63] 2023-11-04T01:41:32.405 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fd0580164a5] 2023-11-04T01:41:32.406 INFO:tasks.ceph.mds.a.smithi114.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fd05769f802] 2023-11-04T01:41:32.406 INFO:tasks.ceph.mds.a.smithi114.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fd05763f450] 2023-11-04T01:41:32.406 INFO:tasks.ceph.mds.a.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:32.406 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:41:32.608 INFO:tasks.ceph.mds.a.smithi114.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:41:37.186 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:37.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.295+0000 7fe7d62f2640 1 Processor -- start 2023-11-04T01:41:37.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.296+0000 7fe7d62f2640 1 -- start start 2023-11-04T01:41:37.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.296+0000 7fe7d62f2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7d015bfb0 0x7fe7d00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.296+0000 7fe7d62f2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d00cc450 con 0x7fe7d00cd860 2023-11-04T01:41:37.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.296+0000 7fe7d62f2640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d015f400 con 0x7fe7d015ae40 2023-11-04T01:41:37.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.296+0000 7fe7d62f2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d015b220 con 0x7fe7d015bfb0 2023-11-04T01:41:37.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.296+0000 7fe7d488f640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe7d00cd860 0x7fe7d00ced70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34654/0 (socket says 172.21.15.114:34654) 2023-11-04T01:41:37.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.296+0000 7fe7d488f640 1 -- 172.21.15.114:0/4231417488 learned_addr learned my addr 172.21.15.114:0/4231417488 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7cf7fe640 1 --2- 172.21.15.114:0/4231417488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7d015bfb0 0x7fe7d00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 -- 172.21.15.114:0/4231417488 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592379181 0 0) 0x7fe7c8001490 con 0x7fe7d00cd860 2023-11-04T01:41:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 -- 172.21.15.114:0/4231417488 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7b8003520 con 0x7fe7d00cd860 2023-11-04T01:41:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 -- 172.21.15.114:0/4231417488 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972437718 0 0) 0x7fe7d015f400 con 0x7fe7d015ae40 2023-11-04T01:41:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 -- 172.21.15.114:0/4231417488 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7c8001490 con 0x7fe7d015ae40 2023-11-04T01:41:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 -- 172.21.15.114:0/4231417488 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1563918237 0 0) 0x7fe7b8003520 con 0x7fe7d00cd860 2023-11-04T01:41:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 -- 172.21.15.114:0/4231417488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7d015bfb0 msgr2=0x7fe7d00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 --2- 172.21.15.114:0/4231417488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7d015bfb0 0x7fe7d00cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 -- 172.21.15.114:0/4231417488 >> v1:172.21.15.141:6789/0 conn(0x7fe7d015ae40 legacy=0x7fe7d00cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 -- 172.21.15.114:0/4231417488 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d015f890 con 0x7fe7d00cd860 2023-11-04T01:41:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 -- 172.21.15.114:0/4231417488 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fe7c8001b80 con 0x7fe7d00cd860 2023-11-04T01:41:37.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7cf7fe640 1 --2- 172.21.15.114:0/4231417488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7d015bfb0 0x7fe7d00cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:37.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 -- 172.21.15.114:0/4231417488 >> v1:172.21.15.114:6789/0 conn(0x7fe7d00cd860 legacy=0x7fe7d00ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 --2- 172.21.15.114:0/4231417488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7d015bfb0 0x7fe7b8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 --2- 172.21.15.114:0/4231417488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7b8004070 0x7fe7b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 --2- 172.21.15.114:0/4231417488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7b8004d00 0x7fe7b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 -- 172.21.15.114:0/4231417488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d015b220 con 0x7fe7b8004070 2023-11-04T01:41:37.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 -- 172.21.15.114:0/4231417488 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b800ba30 con 0x7fe7b8004d00 2023-11-04T01:41:37.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7ceffd640 1 -- 172.21.15.114:0/4231417488 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b800bbf0 con 0x7fe7d015bfb0 2023-11-04T01:41:37.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7cf7fe640 1 --2- 172.21.15.114:0/4231417488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7b8004070 0x7fe7b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7cffff640 1 --2- 172.21.15.114:0/4231417488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7d015bfb0 0x7fe7b8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7d488f640 1 --2- 172.21.15.114:0/4231417488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7b8004d00 0x7fe7b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7cf7fe640 1 -- 172.21.15.114:0/4231417488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7d015bfb0 msgr2=0x7fe7b8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7cf7fe640 1 --2- 172.21.15.114:0/4231417488 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7d015bfb0 0x7fe7b8003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7cf7fe640 1 -- 172.21.15.114:0/4231417488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7b8004d00 msgr2=0x7fe7b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7cf7fe640 1 --2- 172.21.15.114:0/4231417488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7b8004d00 0x7fe7b8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7cf7fe640 1 -- 172.21.15.114:0/4231417488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c4009400 con 0x7fe7b8004070 2023-11-04T01:41:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.297+0000 7fe7d488f640 1 --2- 172.21.15.114:0/4231417488 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7b8004d00 0x7fe7b8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.298+0000 7fe7cf7fe640 1 --2- 172.21.15.114:0/4231417488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7b8004070 0x7fe7b80047c0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009c70 tx=0x7fe7b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57064fba62a0db46 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.298+0000 7fe7ceffd640 1 -- 172.21.15.114:0/4231417488 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c402c910 con 0x7fe7b8004070 2023-11-04T01:41:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.298+0000 7fe7ceffd640 1 -- 172.21.15.114:0/4231417488 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c402ca70 con 0x7fe7b8004070 2023-11-04T01:41:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.298+0000 7fe7ceffd640 1 -- 172.21.15.114:0/4231417488 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c402cde0 con 0x7fe7b8004070 2023-11-04T01:41:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.299+0000 7fe7d62f2640 1 -- 172.21.15.114:0/4231417488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7b8004070 msgr2=0x7fe7b80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.299+0000 7fe7d62f2640 1 --2- 172.21.15.114:0/4231417488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7b8004070 0x7fe7b80047c0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009c70 tx=0x7fe7b80057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.299+0000 7fe7d488f640 1 -- 172.21.15.114:0/4231417488 reap_dead start 2023-11-04T01:41:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.299+0000 7fe7d62f2640 1 -- 172.21.15.114:0/4231417488 shutdown_connections 2023-11-04T01:41:37.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.299+0000 7fe7d62f2640 1 -- 172.21.15.114:0/4231417488 >> 172.21.15.114:0/4231417488 conn(0x7fe7d006ea90 msgr2=0x7fe7d006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.299+0000 7fe7d62f2640 1 -- 172.21.15.114:0/4231417488 shutdown_connections 2023-11-04T01:41:37.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.299+0000 7fe7d62f2640 1 -- 172.21.15.114:0/4231417488 wait complete. 2023-11-04T01:41:37.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.300+0000 7fe7d62f2640 1 Processor -- start 2023-11-04T01:41:37.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.300+0000 7fe7d62f2640 1 -- start start 2023-11-04T01:41:37.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.301+0000 7fe7d62f2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7b8004070 0x7fe7d0150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.301+0000 7fe7d62f2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7d00c9760 0x7fe7d00c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.301+0000 7fe7d62f2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7d00ca850 0x7fe7d00c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.301+0000 7fe7d62f2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d0153ff0 con 0x7fe7d00c9760 2023-11-04T01:41:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.301+0000 7fe7d62f2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d00c7440 con 0x7fe7d00ca850 2023-11-04T01:41:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.301+0000 7fe7d62f2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d0150890 con 0x7fe7b8004070 2023-11-04T01:41:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.301+0000 7fe7cf7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7d00c9760 0x7fe7d00c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.301+0000 7fe7cf7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7d00c9760 0x7fe7d00c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51718/0 (socket says 172.21.15.114:51718) 2023-11-04T01:41:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.301+0000 7fe7cf7fe640 1 -- 172.21.15.114:0/2351756984 learned_addr learned my addr 172.21.15.114:0/2351756984 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.301+0000 7fe7cffff640 1 --2- 172.21.15.114:0/2351756984 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7b8004070 0x7fe7d0150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.301+0000 7fe7d488f640 1 --2- 172.21.15.114:0/2351756984 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7d00ca850 0x7fe7d00c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.302+0000 7fe7cf7fe640 1 -- 172.21.15.114:0/2351756984 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7b8004070 msgr2=0x7fe7d0150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.302+0000 7fe7cf7fe640 1 --2- 172.21.15.114:0/2351756984 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7b8004070 0x7fe7d0150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.302+0000 7fe7cf7fe640 1 -- 172.21.15.114:0/2351756984 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7d00ca850 msgr2=0x7fe7d00c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.302+0000 7fe7cf7fe640 1 --2- 172.21.15.114:0/2351756984 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7d00ca850 0x7fe7d00c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.302+0000 7fe7cf7fe640 1 -- 172.21.15.114:0/2351756984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d00c9bf0 con 0x7fe7d00c9760 2023-11-04T01:41:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.302+0000 7fe7cf7fe640 1 --2- 172.21.15.114:0/2351756984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7d00c9760 0x7fe7d00c69c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4037040 tx=0x7fe7c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.302+0000 7fe7ccff9640 1 -- 172.21.15.114:0/2351756984 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4034c80 con 0x7fe7d00c9760 2023-11-04T01:41:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.302+0000 7fe7ccff9640 1 -- 172.21.15.114:0/2351756984 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c4034e00 con 0x7fe7d00c9760 2023-11-04T01:41:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.302+0000 7fe7ccff9640 1 -- 172.21.15.114:0/2351756984 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c403e640 con 0x7fe7d00c9760 2023-11-04T01:41:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.302+0000 7fe7d62f2640 1 -- 172.21.15.114:0/2351756984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d00c9ed0 con 0x7fe7d00c9760 2023-11-04T01:41:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.302+0000 7fe7d62f2640 1 -- 172.21.15.114:0/2351756984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d00b17c0 con 0x7fe7d00c9760 2023-11-04T01:41:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.303+0000 7fe7d62f2640 1 -- 172.21.15.114:0/2351756984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d00b1950 con 0x7fe7d00c9760 2023-11-04T01:41:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.303+0000 7fe7ccff9640 1 -- 172.21.15.114:0/2351756984 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe7c403e7a0 con 0x7fe7d00c9760 2023-11-04T01:41:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.304+0000 7fe7ccff9640 1 --2- 172.21.15.114:0/2351756984 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe7bc06ae70 0x7fe7bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.304+0000 7fe7ccff9640 1 -- 172.21.15.114:0/2351756984 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fe7c40abbc0 con 0x7fe7d00c9760 2023-11-04T01:41:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.304+0000 7fe7cffff640 1 --2- 172.21.15.114:0/2351756984 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe7bc06ae70 0x7fe7bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.304+0000 7fe7cffff640 1 --2- 172.21.15.114:0/2351756984 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe7bc06ae70 0x7fe7bc06d330 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00018d0 tx=0x7fe7c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.308+0000 7fe7ccff9640 1 -- 172.21.15.114:0/2351756984 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7c40767b0 con 0x7fe7d00c9760 2023-11-04T01:41:37.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.508+0000 7fe7d62f2640 1 -- 172.21.15.114:0/2351756984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7d0153ff0 con 0x7fe7d00c9760 2023-11-04T01:41:37.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.509+0000 7fe7ccff9640 1 -- 172.21.15.114:0/2351756984 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fe7c404c090 con 0x7fe7d00c9760 2023-11-04T01:41:37.511 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:37.512 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8013,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:30.640767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7899,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7899":{"gid":7899,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:37.513 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 72 2023-11-04T01:41:37.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.511+0000 7fe7d62f2640 1 -- 172.21.15.114:0/2351756984 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe7bc06ae70 msgr2=0x7fe7bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.511+0000 7fe7d62f2640 1 --2- 172.21.15.114:0/2351756984 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe7bc06ae70 0x7fe7bc06d330 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00018d0 tx=0x7fe7c0009040 comp rx=0 tx=0).stop 2023-11-04T01:41:37.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.511+0000 7fe7d62f2640 1 -- 172.21.15.114:0/2351756984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7d00c9760 msgr2=0x7fe7d00c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.511+0000 7fe7d62f2640 1 --2- 172.21.15.114:0/2351756984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7d00c9760 0x7fe7d00c69c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4037040 tx=0x7fe7c4004730 comp rx=0 tx=0).stop 2023-11-04T01:41:37.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.511+0000 7fe7d62f2640 1 -- 172.21.15.114:0/2351756984 shutdown_connections 2023-11-04T01:41:37.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.511+0000 7fe7d62f2640 1 --2- 172.21.15.114:0/2351756984 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe7bc06ae70 0x7fe7bc06d330 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.511+0000 7fe7d62f2640 1 --2- 172.21.15.114:0/2351756984 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe7d00ca850 0x7fe7d00c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.511+0000 7fe7d62f2640 1 --2- 172.21.15.114:0/2351756984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7d00c9760 0x7fe7d00c69c0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.511+0000 7fe7d62f2640 1 --2- 172.21.15.114:0/2351756984 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe7b8004070 0x7fe7d0150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.511+0000 7fe7d62f2640 1 -- 172.21.15.114:0/2351756984 >> 172.21.15.114:0/2351756984 conn(0x7fe7d006ea90 msgr2=0x7fe7d015ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.511+0000 7fe7d62f2640 1 -- 172.21.15.114:0/2351756984 shutdown_connections 2023-11-04T01:41:37.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:37.511+0000 7fe7d62f2640 1 -- 172.21.15.114:0/2351756984 wait complete. 2023-11-04T01:41:37.523 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:38.523 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:41:42.524 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:42.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.633+0000 7fb65aec2640 1 Processor -- start 2023-11-04T01:41:42.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.633+0000 7fb65aec2640 1 -- start start 2023-11-04T01:41:42.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.634+0000 7fb65aec2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb654159c70 0x7fb6540ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.634+0000 7fb65aec2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb65406db20 0x7fb6540b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.634+0000 7fb65aec2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6540b4110 con 0x7fb6540b0910 2023-11-04T01:41:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.634+0000 7fb65aec2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6540b49b0 con 0x7fb654159c70 2023-11-04T01:41:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.634+0000 7fb65aec2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6540b0da0 con 0x7fb65406db20 2023-11-04T01:41:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.634+0000 7fb65945f640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb6540b0910 0x7fb65415d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34662/0 (socket says 172.21.15.114:34662) 2023-11-04T01:41:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.634+0000 7fb65945f640 1 -- 172.21.15.114:0/2001379625 learned_addr learned my addr 172.21.15.114:0/2001379625 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.634+0000 7fb658c5e640 1 --2- 172.21.15.114:0/2001379625 >> v2:172.21.15.114:3300/0 conn(0x7fb654159c70 0x7fb6540ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.634+0000 7fb653fff640 1 --2- 172.21.15.114:0/2001379625 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb65406db20 0x7fb6540b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.634+0000 7fb6537fe640 1 -- 172.21.15.114:0/2001379625 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928943463 0 0) 0x7fb6540b4110 con 0x7fb6540b0910 2023-11-04T01:41:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.634+0000 7fb6537fe640 1 -- 172.21.15.114:0/2001379625 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb63c003520 con 0x7fb6540b0910 2023-11-04T01:41:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.634+0000 7fb658c5e640 1 -- 172.21.15.114:0/2001379625 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb65406db20 msgr2=0x7fb6540b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.635+0000 7fb658c5e640 1 --2- 172.21.15.114:0/2001379625 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb65406db20 0x7fb6540b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.635+0000 7fb658c5e640 1 -- 172.21.15.114:0/2001379625 >> v1:172.21.15.114:6789/0 conn(0x7fb6540b0910 legacy=0x7fb65415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.635+0000 7fb658c5e640 1 -- 172.21.15.114:0/2001379625 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6540b43f0 con 0x7fb654159c70 2023-11-04T01:41:42.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.635+0000 7fb658c5e640 1 --2- 172.21.15.114:0/2001379625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb654159c70 0x7fb6540ce370 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fb6440097a0 tx=0x7fb64402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e123b2abd8c32125 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.635+0000 7fb6537fe640 1 -- 172.21.15.114:0/2001379625 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644031830 con 0x7fb654159c70 2023-11-04T01:41:42.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.635+0000 7fb6537fe640 1 -- 172.21.15.114:0/2001379625 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb644031990 con 0x7fb654159c70 2023-11-04T01:41:42.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.635+0000 7fb6537fe640 1 -- 172.21.15.114:0/2001379625 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644031d20 con 0x7fb654159c70 2023-11-04T01:41:42.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.636+0000 7fb65aec2640 1 -- 172.21.15.114:0/2001379625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb654159c70 msgr2=0x7fb6540ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.636+0000 7fb65aec2640 1 --2- 172.21.15.114:0/2001379625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb654159c70 0x7fb6540ce370 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fb6440097a0 tx=0x7fb64402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.636+0000 7fb65aec2640 1 -- 172.21.15.114:0/2001379625 shutdown_connections 2023-11-04T01:41:42.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.636+0000 7fb65aec2640 1 --2- 172.21.15.114:0/2001379625 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb65406db20 0x7fb6540b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.636+0000 7fb65aec2640 1 --2- 172.21.15.114:0/2001379625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb654159c70 0x7fb6540ce370 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.636+0000 7fb65aec2640 1 -- 172.21.15.114:0/2001379625 >> 172.21.15.114:0/2001379625 conn(0x7fb6540ce950 msgr2=0x7fb6540ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:42.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.636+0000 7fb65aec2640 1 -- 172.21.15.114:0/2001379625 shutdown_connections 2023-11-04T01:41:42.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.636+0000 7fb65aec2640 1 -- 172.21.15.114:0/2001379625 wait complete. 2023-11-04T01:41:42.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.637+0000 7fb65aec2640 1 Processor -- start 2023-11-04T01:41:42.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.637+0000 7fb65aec2640 1 -- start start 2023-11-04T01:41:42.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.638+0000 7fb65aec2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb65406db20 0x7fb654157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.638+0000 7fb65aec2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb6540b0910 0x7fb6540a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.638+0000 7fb65aec2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb654159c70 0x7fb6540a7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.638+0000 7fb65aec2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6541f0760 con 0x7fb65406db20 2023-11-04T01:41:42.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.638+0000 7fb65aec2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb654158110 con 0x7fb6540b0910 2023-11-04T01:41:42.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.638+0000 7fb65aec2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6541e5a10 con 0x7fb654159c70 2023-11-04T01:41:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.638+0000 7fb658c5e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb65406db20 0x7fb654157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.638+0000 7fb658c5e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb65406db20 0x7fb654157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51748/0 (socket says 172.21.15.114:51748) 2023-11-04T01:41:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.638+0000 7fb658c5e640 1 -- 172.21.15.114:0/485227146 learned_addr learned my addr 172.21.15.114:0/485227146 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.638+0000 7fb65945f640 1 --2- 172.21.15.114:0/485227146 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb654159c70 0x7fb6540a7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.638+0000 7fb653fff640 1 --2- 172.21.15.114:0/485227146 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb6540b0910 0x7fb6540a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.639+0000 7fb658c5e640 1 -- 172.21.15.114:0/485227146 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb654159c70 msgr2=0x7fb6540a7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.639+0000 7fb658c5e640 1 --2- 172.21.15.114:0/485227146 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb654159c70 0x7fb6540a7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.639+0000 7fb658c5e640 1 -- 172.21.15.114:0/485227146 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb6540b0910 msgr2=0x7fb6540a74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.639+0000 7fb658c5e640 1 --2- 172.21.15.114:0/485227146 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb6540b0910 0x7fb6540a74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.639+0000 7fb658c5e640 1 -- 172.21.15.114:0/485227146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb644009400 con 0x7fb65406db20 2023-11-04T01:41:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.639+0000 7fb653fff640 1 --2- 172.21.15.114:0/485227146 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb6540b0910 0x7fb6540a74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.639+0000 7fb658c5e640 1 --2- 172.21.15.114:0/485227146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb65406db20 0x7fb654157590 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fb64402bee0 tx=0x7fb6440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.639+0000 7fb6517fa640 1 -- 172.21.15.114:0/485227146 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64403a6f0 con 0x7fb65406db20 2023-11-04T01:41:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.639+0000 7fb6517fa640 1 -- 172.21.15.114:0/485227146 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64403a870 con 0x7fb65406db20 2023-11-04T01:41:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.639+0000 7fb65aec2640 1 -- 172.21.15.114:0/485227146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6541e5cf0 con 0x7fb65406db20 2023-11-04T01:41:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.639+0000 7fb6517fa640 1 -- 172.21.15.114:0/485227146 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64403ac20 con 0x7fb65406db20 2023-11-04T01:41:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.639+0000 7fb65aec2640 1 -- 172.21.15.114:0/485227146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6541e62b0 con 0x7fb65406db20 2023-11-04T01:41:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.640+0000 7fb65aec2640 1 -- 172.21.15.114:0/485227146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb654074290 con 0x7fb65406db20 2023-11-04T01:41:42.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.640+0000 7fb6517fa640 1 -- 172.21.15.114:0/485227146 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb64404c3b0 con 0x7fb65406db20 2023-11-04T01:41:42.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.641+0000 7fb6517fa640 1 --2- 172.21.15.114:0/485227146 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb64006ae70 0x7fb64006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.641+0000 7fb6517fa640 1 -- 172.21.15.114:0/485227146 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fb6440ab910 con 0x7fb65406db20 2023-11-04T01:41:42.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.641+0000 7fb653fff640 1 --2- 172.21.15.114:0/485227146 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb64006ae70 0x7fb64006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.641+0000 7fb653fff640 1 --2- 172.21.15.114:0/485227146 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb64006ae70 0x7fb64006d330 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb648006fd0 tx=0x7fb648008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.645+0000 7fb6517fa640 1 -- 172.21.15.114:0/485227146 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb644076420 con 0x7fb65406db20 2023-11-04T01:41:42.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.849+0000 7fb65aec2640 1 -- 172.21.15.114:0/485227146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb65406d3f0 con 0x7fb65406db20 2023-11-04T01:41:42.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.849+0000 7fb6517fa640 1 -- 172.21.15.114:0/485227146 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fb644079a40 con 0x7fb65406db20 2023-11-04T01:41:42.851 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:42.851 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8013,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:30.640767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7899,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7899":{"gid":7899,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:42.852 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 72 2023-11-04T01:41:42.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.851+0000 7fb65aec2640 1 -- 172.21.15.114:0/485227146 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb64006ae70 msgr2=0x7fb64006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.851+0000 7fb65aec2640 1 --2- 172.21.15.114:0/485227146 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb64006ae70 0x7fb64006d330 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb648006fd0 tx=0x7fb648008040 comp rx=0 tx=0).stop 2023-11-04T01:41:42.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.851+0000 7fb65aec2640 1 -- 172.21.15.114:0/485227146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb65406db20 msgr2=0x7fb654157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.851+0000 7fb65aec2640 1 --2- 172.21.15.114:0/485227146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb65406db20 0x7fb654157590 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fb64402bee0 tx=0x7fb6440046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.851+0000 7fb65aec2640 1 -- 172.21.15.114:0/485227146 shutdown_connections 2023-11-04T01:41:42.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.851+0000 7fb65aec2640 1 --2- 172.21.15.114:0/485227146 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb654159c70 0x7fb6540a7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.851+0000 7fb65aec2640 1 --2- 172.21.15.114:0/485227146 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb64006ae70 0x7fb64006d330 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.851+0000 7fb65aec2640 1 --2- 172.21.15.114:0/485227146 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb6540b0910 0x7fb6540a74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.851+0000 7fb65aec2640 1 --2- 172.21.15.114:0/485227146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb65406db20 0x7fb654157590 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.851+0000 7fb65aec2640 1 -- 172.21.15.114:0/485227146 >> 172.21.15.114:0/485227146 conn(0x7fb6540ce950 msgr2=0x7fb65415a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:42.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.851+0000 7fb65aec2640 1 -- 172.21.15.114:0/485227146 shutdown_connections 2023-11-04T01:41:42.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:42.851+0000 7fb65aec2640 1 -- 172.21.15.114:0/485227146 wait complete. 2023-11-04T01:41:42.864 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:41:45.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-11-04T01:41:47.865 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:47.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.976+0000 7f60b774c640 1 Processor -- start 2023-11-04T01:41:47.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.976+0000 7f60b774c640 1 -- start start 2023-11-04T01:41:47.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.977+0000 7f60b774c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b00cda60 0x7f60b00ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.977+0000 7f60b774c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f60b00b0cd0 0x7f60b0070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.977+0000 7f60b774c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b00cc990 con 0x7f60b00cace0 2023-11-04T01:41:47.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.977+0000 7f60b774c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b00ccc70 con 0x7f60b00b0cd0 2023-11-04T01:41:47.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.977+0000 7f60b774c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00c9ce0 con 0x7f60b00cda60 2023-11-04T01:41:47.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.977+0000 7f60b5ce9640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f60b00cace0 0x7f60b006c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49394/0 (socket says 172.21.15.114:49394) 2023-11-04T01:41:47.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.977+0000 7f60b5ce9640 1 -- 172.21.15.114:0/352092014 learned_addr learned my addr 172.21.15.114:0/352092014 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:47.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.977+0000 7f60b4ce7640 1 --2- 172.21.15.114:0/352092014 >> v2:172.21.15.141:3300/0 conn(0x7f60b00b0cd0 0x7f60b0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.977+0000 7f60b54e8640 1 --2- 172.21.15.114:0/352092014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b00cda60 0x7f60b00ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60a7fff640 1 -- 172.21.15.114:0/352092014 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790761234 0 0) 0x7f60b00cc990 con 0x7f60b00cace0 2023-11-04T01:41:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60a7fff640 1 -- 172.21.15.114:0/352092014 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f609c004630 con 0x7f60b00cace0 2023-11-04T01:41:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60a7fff640 1 -- 172.21.15.114:0/352092014 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 410344830 0 0) 0x7f609c004630 con 0x7f60b00cace0 2023-11-04T01:41:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60a7fff640 1 -- 172.21.15.114:0/352092014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b00cda60 msgr2=0x7f60b00ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60a7fff640 1 --2- 172.21.15.114:0/352092014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b00cda60 0x7f60b00ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60a7fff640 1 -- 172.21.15.114:0/352092014 >> v2:172.21.15.141:3300/0 conn(0x7f60b00b0cd0 msgr2=0x7f60b0070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60a7fff640 1 --2- 172.21.15.114:0/352092014 >> v2:172.21.15.141:3300/0 conn(0x7f60b00b0cd0 0x7f60b0070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60a7fff640 1 -- 172.21.15.114:0/352092014 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b00c9fc0 con 0x7f60b00cace0 2023-11-04T01:41:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60a7fff640 1 -- 172.21.15.114:0/352092014 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f60a8001670 con 0x7f60b00cace0 2023-11-04T01:41:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60a7fff640 1 -- 172.21.15.114:0/352092014 >> v1:172.21.15.114:6789/0 conn(0x7f60b00cace0 legacy=0x7f60b006c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60a7fff640 1 --2- 172.21.15.114:0/352092014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b00cda60 0x7f609c004a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60a7fff640 1 --2- 172.21.15.114:0/352092014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f609c005000 0x7f609c0058d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60a7fff640 1 --2- 172.21.15.114:0/352092014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f609c005e10 0x7f609c006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60a7fff640 1 -- 172.21.15.114:0/352092014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00ccc70 con 0x7f609c005000 2023-11-04T01:41:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60a7fff640 1 -- 172.21.15.114:0/352092014 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00c9ce0 con 0x7f609c005e10 2023-11-04T01:41:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60a7fff640 1 -- 172.21.15.114:0/352092014 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c00ca90 con 0x7f60b00cda60 2023-11-04T01:41:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60b4ce7640 1 --2- 172.21.15.114:0/352092014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f609c005000 0x7f609c0058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60b54e8640 1 --2- 172.21.15.114:0/352092014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b00cda60 0x7f609c004a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60b5ce9640 1 --2- 172.21.15.114:0/352092014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f609c005e10 0x7f609c006290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60b4ce7640 1 -- 172.21.15.114:0/352092014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b00cda60 msgr2=0x7f609c004a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60b4ce7640 1 --2- 172.21.15.114:0/352092014 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b00cda60 0x7f609c004a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60b4ce7640 1 -- 172.21.15.114:0/352092014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f609c005e10 msgr2=0x7f609c006290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60b4ce7640 1 --2- 172.21.15.114:0/352092014 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f609c005e10 0x7f609c006290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.978+0000 7f60b4ce7640 1 -- 172.21.15.114:0/352092014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c004630 con 0x7f609c005000 2023-11-04T01:41:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.979+0000 7f60b4ce7640 1 --2- 172.21.15.114:0/352092014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f609c005000 0x7f609c0058d0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009ac0 tx=0x7f609c006900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bd99f08c97ef6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.979+0000 7f60a7fff640 1 -- 172.21.15.114:0/352092014 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a002c6d0 con 0x7f609c005000 2023-11-04T01:41:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.979+0000 7f60a7fff640 1 -- 172.21.15.114:0/352092014 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a002c830 con 0x7f609c005000 2023-11-04T01:41:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.979+0000 7f60a7fff640 1 -- 172.21.15.114:0/352092014 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a002cbc0 con 0x7f609c005000 2023-11-04T01:41:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.980+0000 7f60b774c640 1 -- 172.21.15.114:0/352092014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f609c005000 msgr2=0x7f609c0058d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.980+0000 7f60b774c640 1 --2- 172.21.15.114:0/352092014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f609c005000 0x7f609c0058d0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009ac0 tx=0x7f609c006900 comp rx=0 tx=0).stop 2023-11-04T01:41:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.980+0000 7f60b5ce9640 1 -- 172.21.15.114:0/352092014 reap_dead start 2023-11-04T01:41:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.980+0000 7f60b774c640 1 -- 172.21.15.114:0/352092014 shutdown_connections 2023-11-04T01:41:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.980+0000 7f60b774c640 1 -- 172.21.15.114:0/352092014 >> 172.21.15.114:0/352092014 conn(0x7f60b00ce950 msgr2=0x7f60b00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.980+0000 7f60b774c640 1 -- 172.21.15.114:0/352092014 shutdown_connections 2023-11-04T01:41:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.980+0000 7f60b774c640 1 -- 172.21.15.114:0/352092014 wait complete. 2023-11-04T01:41:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.981+0000 7f60b774c640 1 Processor -- start 2023-11-04T01:41:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.981+0000 7f60b774c640 1 -- start start 2023-11-04T01:41:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.982+0000 7f60b774c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f609c005000 0x7f60b01df420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.982+0000 7f60b774c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60b01dede0 0x7f60b01e1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.982+0000 7f60b774c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b01e2350 0x7f60b0147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.982+0000 7f60b774c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b01e27d0 con 0x7f60b01dede0 2023-11-04T01:41:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.982+0000 7f60b774c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b0157520 con 0x7f609c005000 2023-11-04T01:41:47.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.982+0000 7f60b774c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00c83c0 con 0x7f60b01e2350 2023-11-04T01:41:47.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.982+0000 7f60b4ce7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60b01dede0 0x7f60b01e1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.982+0000 7f60b4ce7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60b01dede0 0x7f60b01e1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52888/0 (socket says 172.21.15.114:52888) 2023-11-04T01:41:47.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.982+0000 7f60b4ce7640 1 -- 172.21.15.114:0/4086106346 learned_addr learned my addr 172.21.15.114:0/4086106346 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:47.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.982+0000 7f60b4ce7640 1 -- 172.21.15.114:0/4086106346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b01e2350 msgr2=0x7f60b0147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.982+0000 7f60b4ce7640 1 --2- 172.21.15.114:0/4086106346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b01e2350 0x7f60b0147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.982+0000 7f60b4ce7640 1 -- 172.21.15.114:0/4086106346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f609c005000 msgr2=0x7f60b01df420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.982+0000 7f60b4ce7640 1 --2- 172.21.15.114:0/4086106346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f609c005000 0x7f60b01df420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.982+0000 7f60b4ce7640 1 -- 172.21.15.114:0/4086106346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b01df960 con 0x7f60b01dede0 2023-11-04T01:41:47.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.982+0000 7f60b4ce7640 1 --2- 172.21.15.114:0/4086106346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60b01dede0 0x7f60b01e1e10 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f60a002c2d0 tx=0x7f60a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:47.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.982+0000 7f60a5ffb640 1 -- 172.21.15.114:0/4086106346 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a0003810 con 0x7f60b01dede0 2023-11-04T01:41:47.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.983+0000 7f60a5ffb640 1 -- 172.21.15.114:0/4086106346 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a0003970 con 0x7f60b01dede0 2023-11-04T01:41:47.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.983+0000 7f60a5ffb640 1 -- 172.21.15.114:0/4086106346 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a0003ce0 con 0x7f60b01dede0 2023-11-04T01:41:47.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.983+0000 7f60b774c640 1 -- 172.21.15.114:0/4086106346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b00c7840 con 0x7f60b01dede0 2023-11-04T01:41:47.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.983+0000 7f60b774c640 1 -- 172.21.15.114:0/4086106346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b00c7e00 con 0x7f60b01dede0 2023-11-04T01:41:47.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.984+0000 7f60b774c640 1 -- 172.21.15.114:0/4086106346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b0074290 con 0x7f60b01dede0 2023-11-04T01:41:47.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.984+0000 7f60a5ffb640 1 -- 172.21.15.114:0/4086106346 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60a0040450 con 0x7f60b01dede0 2023-11-04T01:41:47.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.985+0000 7f60a5ffb640 1 --2- 172.21.15.114:0/4086106346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f609406ae60 0x7f609406d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.985+0000 7f60a5ffb640 1 -- 172.21.15.114:0/4086106346 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f60a00abb60 con 0x7f60b01dede0 2023-11-04T01:41:47.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.985+0000 7f60b54e8640 1 --2- 172.21.15.114:0/4086106346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f609406ae60 0x7f609406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.985+0000 7f60b54e8640 1 --2- 172.21.15.114:0/4086106346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f609406ae60 0x7f609406d320 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009ee0 tx=0x7f60ac009750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:47.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:47.989+0000 7f60a5ffb640 1 -- 172.21.15.114:0/4086106346 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60a0079fe0 con 0x7f60b01dede0 2023-11-04T01:41:48.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.190+0000 7f60b774c640 1 -- 172.21.15.114:0/4086106346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60b00ae440 con 0x7f60b01dede0 2023-11-04T01:41:48.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.190+0000 7f60a5ffb640 1 -- 172.21.15.114:0/4086106346 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4992 (secure 0 0 0) 0x7f60a00044e0 con 0x7f60b01dede0 2023-11-04T01:41:48.192 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:48.192 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8013,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:45.594610+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7899,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7899":{"gid":7899,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6837/1052115332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1052115332},{"type":"v1","addr":"172.21.15.114:6837","nonce":1052115332}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:41:45.594610+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:48.193 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 73 2023-11-04T01:41:48.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.192+0000 7f60b774c640 1 -- 172.21.15.114:0/4086106346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f609406ae60 msgr2=0x7f609406d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.192+0000 7f60b774c640 1 --2- 172.21.15.114:0/4086106346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f609406ae60 0x7f609406d320 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009ee0 tx=0x7f60ac009750 comp rx=0 tx=0).stop 2023-11-04T01:41:48.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.192+0000 7f60b774c640 1 -- 172.21.15.114:0/4086106346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60b01dede0 msgr2=0x7f60b01e1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.192+0000 7f60b774c640 1 --2- 172.21.15.114:0/4086106346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60b01dede0 0x7f60b01e1e10 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f60a002c2d0 tx=0x7f60a0004730 comp rx=0 tx=0).stop 2023-11-04T01:41:48.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.192+0000 7f60b774c640 1 -- 172.21.15.114:0/4086106346 shutdown_connections 2023-11-04T01:41:48.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.192+0000 7f60b774c640 1 --2- 172.21.15.114:0/4086106346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60b01e2350 0x7f60b0147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.192+0000 7f60b774c640 1 --2- 172.21.15.114:0/4086106346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60b01dede0 0x7f60b01e1e10 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.192+0000 7f60b774c640 1 --2- 172.21.15.114:0/4086106346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f609406ae60 0x7f609406d320 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.192+0000 7f60b774c640 1 --2- 172.21.15.114:0/4086106346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f609c005000 0x7f60b01df420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.192+0000 7f60b774c640 1 -- 172.21.15.114:0/4086106346 >> 172.21.15.114:0/4086106346 conn(0x7f60b00ce950 msgr2=0x7f60b00af170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:48.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.192+0000 7f60b774c640 1 -- 172.21.15.114:0/4086106346 shutdown_connections 2023-11-04T01:41:48.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.192+0000 7f60b774c640 1 -- 172.21.15.114:0/4086106346 wait complete. 2023-11-04T01:41:48.204 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:41:48.205 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:41:48.230 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:41:48.231 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:41:48.231 DEBUG:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:41:48.301 INFO:teuthology.orchestra.run.smithi114.stdout:1699062092.120089.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:41:48.303 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062092.120089.core'] 2023-11-04T01:41:48.303 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062092.120089.core, deleting it 2023-11-04T01:41:48.303 DEBUG:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062092.120089.core 2023-11-04T01:41:48.373 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:41:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.510+0000 7f03fcb55640 1 Processor -- start 2023-11-04T01:41:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.510+0000 7f03fcb55640 1 -- start start 2023-11-04T01:41:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03fcb55640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f03f815ad30 0x7f03f80adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03fcb55640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03f80ad730 0x7f03f8070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03fcb55640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f03f8070c50 0x7f03f80c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03fcb55640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f80ae260 con 0x7f03f815ad30 2023-11-04T01:41:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03fcb55640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f80710e0 con 0x7f03f8070c50 2023-11-04T01:41:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03fcb55640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f80c3900 con 0x7f03f80ad730 2023-11-04T01:41:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03f659c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f03f815ad30 0x7f03f80adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03f659c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f03f815ad30 0x7f03f80adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52904/0 (socket says 172.21.15.114:52904) 2023-11-04T01:41:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03f659c640 1 -- 172.21.15.114:0/3705550588 learned_addr learned my addr 172.21.15.114:0/3705550588 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03f659c640 1 -- 172.21.15.114:0/3705550588 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03f80ad730 msgr2=0x7f03f8070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03f6d9d640 1 --2- 172.21.15.114:0/3705550588 >> v2:172.21.15.141:3300/0 conn(0x7f03f8070c50 0x7f03f80c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03f5d9b640 1 --2- 172.21.15.114:0/3705550588 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03f80ad730 0x7f03f8070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03f659c640 1 --2- 172.21.15.114:0/3705550588 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03f80ad730 0x7f03f8070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03f659c640 1 -- 172.21.15.114:0/3705550588 >> v2:172.21.15.141:3300/0 conn(0x7f03f8070c50 msgr2=0x7f03f80c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03f659c640 1 --2- 172.21.15.114:0/3705550588 >> v2:172.21.15.141:3300/0 conn(0x7f03f8070c50 0x7f03f80c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03f659c640 1 -- 172.21.15.114:0/3705550588 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f80c3be0 con 0x7f03f815ad30 2023-11-04T01:41:48.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.511+0000 7f03f6d9d640 1 --2- 172.21.15.114:0/3705550588 >> v2:172.21.15.141:3300/0 conn(0x7f03f8070c50 0x7f03f80c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:48.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.512+0000 7f03f659c640 1 --2- 172.21.15.114:0/3705550588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f815ad30 0x7f03f80adc80 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009870 tx=0x7f03f002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb01573b1e0a2b3f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:48.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.512+0000 7f03f559a640 1 -- 172.21.15.114:0/3705550588 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f00317c0 con 0x7f03f815ad30 2023-11-04T01:41:48.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.512+0000 7f03f559a640 1 -- 172.21.15.114:0/3705550588 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f0031920 con 0x7f03f815ad30 2023-11-04T01:41:48.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.512+0000 7f03f559a640 1 -- 172.21.15.114:0/3705550588 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0031cb0 con 0x7f03f815ad30 2023-11-04T01:41:48.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.513+0000 7f03fcb55640 1 -- 172.21.15.114:0/3705550588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f815ad30 msgr2=0x7f03f80adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.513+0000 7f03fcb55640 1 --2- 172.21.15.114:0/3705550588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f815ad30 0x7f03f80adc80 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009870 tx=0x7f03f002b860 comp rx=0 tx=0).stop 2023-11-04T01:41:48.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.513+0000 7f03fcb55640 1 -- 172.21.15.114:0/3705550588 shutdown_connections 2023-11-04T01:41:48.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.513+0000 7f03fcb55640 1 --2- 172.21.15.114:0/3705550588 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03f80ad730 0x7f03f8070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.513+0000 7f03fcb55640 1 --2- 172.21.15.114:0/3705550588 >> v2:172.21.15.141:3300/0 conn(0x7f03f8070c50 0x7f03f80c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.513+0000 7f03fcb55640 1 --2- 172.21.15.114:0/3705550588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f815ad30 0x7f03f80adc80 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.513+0000 7f03fcb55640 1 -- 172.21.15.114:0/3705550588 >> 172.21.15.114:0/3705550588 conn(0x7f03f80ce950 msgr2=0x7f03f80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:48.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.513+0000 7f03fcb55640 1 -- 172.21.15.114:0/3705550588 shutdown_connections 2023-11-04T01:41:48.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.513+0000 7f03fcb55640 1 -- 172.21.15.114:0/3705550588 wait complete. 2023-11-04T01:41:48.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.514+0000 7f03fcb55640 1 Processor -- start 2023-11-04T01:41:48.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.514+0000 7f03fcb55640 1 -- start start 2023-11-04T01:41:48.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03fcb55640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f8070c50 0x7f03f8149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03fcb55640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03f80ad730 0x7f03f8157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03fcb55640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03f815ad30 0x7f03f8156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03fcb55640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f81f4590 con 0x7f03f8070c50 2023-11-04T01:41:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03fcb55640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f81f3cd0 con 0x7f03f80ad730 2023-11-04T01:41:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03fcb55640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f81f3f40 con 0x7f03f815ad30 2023-11-04T01:41:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03f659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f8070c50 0x7f03f8149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03f659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f8070c50 0x7f03f8149500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52908/0 (socket says 172.21.15.114:52908) 2023-11-04T01:41:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03f659c640 1 -- 172.21.15.114:0/1859827507 learned_addr learned my addr 172.21.15.114:0/1859827507 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03f6d9d640 1 --2- 172.21.15.114:0/1859827507 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03f815ad30 0x7f03f8156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03f5d9b640 1 --2- 172.21.15.114:0/1859827507 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03f80ad730 0x7f03f8157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03f659c640 1 -- 172.21.15.114:0/1859827507 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03f815ad30 msgr2=0x7f03f8156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03f659c640 1 --2- 172.21.15.114:0/1859827507 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03f815ad30 0x7f03f8156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03f659c640 1 -- 172.21.15.114:0/1859827507 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03f80ad730 msgr2=0x7f03f8157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03f659c640 1 --2- 172.21.15.114:0/1859827507 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03f80ad730 0x7f03f8157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03f659c640 1 -- 172.21.15.114:0/1859827507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00094d0 con 0x7f03f8070c50 2023-11-04T01:41:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03f659c640 1 --2- 172.21.15.114:0/1859827507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f8070c50 0x7f03f8149500 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f03f002b8a0 tx=0x7f03f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.515+0000 7f03e6ffd640 1 -- 172.21.15.114:0/1859827507 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f00329a0 con 0x7f03f8070c50 2023-11-04T01:41:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.516+0000 7f03e6ffd640 1 -- 172.21.15.114:0/1859827507 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f0032b40 con 0x7f03f8070c50 2023-11-04T01:41:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.516+0000 7f03fcb55640 1 -- 172.21.15.114:0/1859827507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f81f4220 con 0x7f03f8070c50 2023-11-04T01:41:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.516+0000 7f03e6ffd640 1 -- 172.21.15.114:0/1859827507 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f00453f0 con 0x7f03f8070c50 2023-11-04T01:41:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.516+0000 7f03fcb55640 1 -- 172.21.15.114:0/1859827507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f80c7530 con 0x7f03f8070c50 2023-11-04T01:41:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.517+0000 7f03fcb55640 1 -- 172.21.15.114:0/1859827507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f8074290 con 0x7f03f8070c50 2023-11-04T01:41:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.517+0000 7f03e6ffd640 1 -- 172.21.15.114:0/1859827507 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03f004e450 con 0x7f03f8070c50 2023-11-04T01:41:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.517+0000 7f03e6ffd640 1 --2- 172.21.15.114:0/1859827507 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f03d806aea0 0x7f03d806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.517+0000 7f03e6ffd640 1 -- 172.21.15.114:0/1859827507 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f03f00abef0 con 0x7f03f8070c50 2023-11-04T01:41:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.517+0000 7f03f5d9b640 1 --2- 172.21.15.114:0/1859827507 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f03d806aea0 0x7f03d806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.518+0000 7f03f5d9b640 1 --2- 172.21.15.114:0/1859827507 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f03d806aea0 0x7f03d806d360 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f03ec006fd0 tx=0x7f03ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:48.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.522+0000 7f03e6ffd640 1 -- 172.21.15.114:0/1859827507 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f03f0076a90 con 0x7f03f8070c50 2023-11-04T01:41:48.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.752+0000 7f03fcb55640 1 -- 172.21.15.114:0/1859827507 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f03f80c8d60 con 0x7f03f8070c50 2023-11-04T01:41:48.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.754+0000 7f03e6ffd640 1 -- 172.21.15.114:0/1859827507 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7899 v74) v1 ==== 97+0+0 (secure 0 0 0) 0x7f03f007a0b0 con 0x7f03f8070c50 2023-11-04T01:41:48.756 INFO:teuthology.orchestra.run.smithi114.stderr:failed mds gid 7899 2023-11-04T01:41:48.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.756+0000 7f03fcb55640 1 -- 172.21.15.114:0/1859827507 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f03d806aea0 msgr2=0x7f03d806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.756+0000 7f03fcb55640 1 --2- 172.21.15.114:0/1859827507 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f03d806aea0 0x7f03d806d360 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f03ec006fd0 tx=0x7f03ec008040 comp rx=0 tx=0).stop 2023-11-04T01:41:48.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.756+0000 7f03fcb55640 1 -- 172.21.15.114:0/1859827507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f8070c50 msgr2=0x7f03f8149500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.756+0000 7f03fcb55640 1 --2- 172.21.15.114:0/1859827507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f8070c50 0x7f03f8149500 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f03f002b8a0 tx=0x7f03f00046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.756+0000 7f03fcb55640 1 -- 172.21.15.114:0/1859827507 shutdown_connections 2023-11-04T01:41:48.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.756+0000 7f03fcb55640 1 --2- 172.21.15.114:0/1859827507 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03f815ad30 0x7f03f8156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.756+0000 7f03fcb55640 1 --2- 172.21.15.114:0/1859827507 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f03d806aea0 0x7f03d806d360 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.756+0000 7f03fcb55640 1 --2- 172.21.15.114:0/1859827507 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03f80ad730 0x7f03f8157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.756+0000 7f03fcb55640 1 --2- 172.21.15.114:0/1859827507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f8070c50 0x7f03f8149500 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.756+0000 7f03fcb55640 1 -- 172.21.15.114:0/1859827507 >> 172.21.15.114:0/1859827507 conn(0x7f03f80ce950 msgr2=0x7f03f806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:48.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.756+0000 7f03fcb55640 1 -- 172.21.15.114:0/1859827507 shutdown_connections 2023-11-04T01:41:48.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.756+0000 7f03fcb55640 1 -- 172.21.15.114:0/1859827507 wait complete. 2023-11-04T01:41:48.772 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:41:48.772 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:41:48.772 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:41:48.772 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:48.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:48.773 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:41:48.773 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:41:48.773 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:41:48.775 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:41:48.775 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:48.850 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2023-11-04T01:41:48.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.874+0000 7f1e0312c640 1 Processor -- start 2023-11-04T01:41:48.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.874+0000 7f1e0312c640 1 -- start start 2023-11-04T01:41:48.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.875+0000 7f1e0312c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1dfc0cde60 0x7f1dfc15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.875+0000 7f1e0312c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f1dfc0ce240 0x7f1dfc0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.875+0000 7f1e0312c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dfc15e000 con 0x7f1dfc15daa0 2023-11-04T01:41:48.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.875+0000 7f1e0312c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dfc15e5c0 con 0x7f1dfc0cde60 2023-11-04T01:41:48.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.875+0000 7f1e0312c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dfc15e2e0 con 0x7f1dfc0ce240 2023-11-04T01:41:48.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.875+0000 7f1e00ec8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1dfc0cde60 0x7f1dfc15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.875+0000 7f1dfbfff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1dfc15daa0 0x7f1dfc157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49410/0 (socket says 172.21.15.114:49410) 2023-11-04T01:41:48.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.875+0000 7f1dfbfff640 1 -- 172.21.15.114:0/3818339459 learned_addr learned my addr 172.21.15.114:0/3818339459 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:48.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.876+0000 7f1e00ec8640 1 -- 172.21.15.114:0/3818339459 >> v2:172.21.15.141:3300/0 conn(0x7f1dfc0ce240 msgr2=0x7f1dfc0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:48.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.876+0000 7f1e016c9640 1 --2- 172.21.15.114:0/3818339459 >> v2:172.21.15.141:3300/0 conn(0x7f1dfc0ce240 0x7f1dfc0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.876+0000 7f1e00ec8640 1 --2- 172.21.15.114:0/3818339459 >> v2:172.21.15.141:3300/0 conn(0x7f1dfc0ce240 0x7f1dfc0d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.876+0000 7f1e00ec8640 1 -- 172.21.15.114:0/3818339459 >> v1:172.21.15.114:6789/0 conn(0x7f1dfc15daa0 legacy=0x7f1dfc157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.876+0000 7f1e00ec8640 1 -- 172.21.15.114:0/3818339459 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc0d1120 con 0x7f1dfc0cde60 2023-11-04T01:41:48.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.876+0000 7f1dfb7fe640 1 -- 172.21.15.114:0/3818339459 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438275020 0 0) 0x7f1dfc15e000 con 0x7f1dfc15daa0 2023-11-04T01:41:48.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.876+0000 7f1e00ec8640 1 --2- 172.21.15.114:0/3818339459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dfc0cde60 0x7f1dfc15d560 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0cf2e0 tx=0x7f1dec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f110c76444e5d9f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:48.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.876+0000 7f1dfb7fe640 1 -- 172.21.15.114:0/3818339459 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec031830 con 0x7f1dfc0cde60 2023-11-04T01:41:48.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.876+0000 7f1dfb7fe640 1 -- 172.21.15.114:0/3818339459 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dec031990 con 0x7f1dfc0cde60 2023-11-04T01:41:48.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.876+0000 7f1dfb7fe640 1 -- 172.21.15.114:0/3818339459 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec031d20 con 0x7f1dfc0cde60 2023-11-04T01:41:48.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.877+0000 7f1e0312c640 1 -- 172.21.15.114:0/3818339459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dfc0cde60 msgr2=0x7f1dfc15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.877+0000 7f1e0312c640 1 --2- 172.21.15.114:0/3818339459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dfc0cde60 0x7f1dfc15d560 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0cf2e0 tx=0x7f1dec02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.877+0000 7f1e0312c640 1 -- 172.21.15.114:0/3818339459 shutdown_connections 2023-11-04T01:41:48.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.877+0000 7f1e0312c640 1 --2- 172.21.15.114:0/3818339459 >> v2:172.21.15.141:3300/0 conn(0x7f1dfc0ce240 0x7f1dfc0d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.877+0000 7f1e0312c640 1 --2- 172.21.15.114:0/3818339459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dfc0cde60 0x7f1dfc15d560 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.877+0000 7f1e0312c640 1 -- 172.21.15.114:0/3818339459 >> 172.21.15.114:0/3818339459 conn(0x7f1dfc071f30 msgr2=0x7f1dfc0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:48.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.877+0000 7f1e0312c640 1 -- 172.21.15.114:0/3818339459 shutdown_connections 2023-11-04T01:41:48.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.877+0000 7f1e0312c640 1 -- 172.21.15.114:0/3818339459 wait complete. 2023-11-04T01:41:48.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.878+0000 7f1e0312c640 1 Processor -- start 2023-11-04T01:41:48.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.878+0000 7f1e0312c640 1 -- start start 2023-11-04T01:41:48.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.879+0000 7f1e0312c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1dfc0cde60 0x7f1dfc156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.879+0000 7f1e0312c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1dfc0ce240 0x7f1dfc15c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.879+0000 7f1e0312c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dfc15daa0 0x7f1dfc1f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.879+0000 7f1e0312c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc15cbd0 con 0x7f1dfc15daa0 2023-11-04T01:41:48.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.879+0000 7f1e0312c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc1f44d0 con 0x7f1dfc0ce240 2023-11-04T01:41:48.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.879+0000 7f1e0312c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc1f47b0 con 0x7f1dfc0cde60 2023-11-04T01:41:48.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.879+0000 7f1e016c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dfc15daa0 0x7f1dfc1f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.879+0000 7f1e016c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dfc15daa0 0x7f1dfc1f04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52962/0 (socket says 172.21.15.114:52962) 2023-11-04T01:41:48.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.879+0000 7f1e016c9640 1 -- 172.21.15.114:0/2315027557 learned_addr learned my addr 172.21.15.114:0/2315027557 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:48.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.879+0000 7f1e016c9640 1 -- 172.21.15.114:0/2315027557 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1dfc0cde60 msgr2=0x7f1dfc156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.879+0000 7f1e016c9640 1 --2- 172.21.15.114:0/2315027557 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1dfc0cde60 0x7f1dfc156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.879+0000 7f1e016c9640 1 -- 172.21.15.114:0/2315027557 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1dfc0ce240 msgr2=0x7f1dfc15c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.879+0000 7f1e016c9640 1 --2- 172.21.15.114:0/2315027557 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1dfc0ce240 0x7f1dfc15c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.879+0000 7f1e016c9640 1 -- 172.21.15.114:0/2315027557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec009400 con 0x7f1dfc15daa0 2023-11-04T01:41:48.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.879+0000 7f1e016c9640 1 --2- 172.21.15.114:0/2315027557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dfc15daa0 0x7f1dfc1f04a0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f1df400cd60 tx=0x7f1df400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:48.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.880+0000 7f1df97fa640 1 -- 172.21.15.114:0/2315027557 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4003b90 con 0x7f1dfc15daa0 2023-11-04T01:41:48.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.880+0000 7f1df97fa640 1 -- 172.21.15.114:0/2315027557 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df4003d10 con 0x7f1dfc15daa0 2023-11-04T01:41:48.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.880+0000 7f1e0312c640 1 -- 172.21.15.114:0/2315027557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dfc1f4a90 con 0x7f1dfc15daa0 2023-11-04T01:41:48.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.880+0000 7f1df97fa640 1 -- 172.21.15.114:0/2315027557 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4004260 con 0x7f1dfc15daa0 2023-11-04T01:41:48.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.880+0000 7f1e0312c640 1 -- 172.21.15.114:0/2315027557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dfc1f0200 con 0x7f1dfc15daa0 2023-11-04T01:41:48.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.881+0000 7f1e0312c640 1 -- 172.21.15.114:0/2315027557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dfc1f4fb0 con 0x7f1dfc15daa0 2023-11-04T01:41:48.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.881+0000 7f1df97fa640 1 -- 172.21.15.114:0/2315027557 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1df40043c0 con 0x7f1dfc15daa0 2023-11-04T01:41:48.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.881+0000 7f1df97fa640 1 --2- 172.21.15.114:0/2315027557 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1de806aea0 0x7f1de806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.882+0000 7f1df97fa640 1 -- 172.21.15.114:0/2315027557 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f1df4012070 con 0x7f1dfc15daa0 2023-11-04T01:41:48.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.882+0000 7f1e00ec8640 1 --2- 172.21.15.114:0/2315027557 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1de806aea0 0x7f1de806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.882+0000 7f1e00ec8640 1 --2- 172.21.15.114:0/2315027557 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1de806aea0 0x7f1de806d360 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1dec036000 tx=0x7f1dec030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:48.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:48.886+0000 7f1df97fa640 1 -- 172.21.15.114:0/2315027557 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1dfc1f4fb0 con 0x7f1dfc15daa0 2023-11-04T01:41:49.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:49.091+0000 7f1e0312c640 1 -- 172.21.15.114:0/2315027557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dfc1f4fb0 con 0x7f1dfc15daa0 2023-11-04T01:41:49.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:49.091+0000 7f1df97fa640 1 -- 172.21.15.114:0/2315027557 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4149 (secure 0 0 0) 0x7f1dfc1f4fb0 con 0x7f1dfc15daa0 2023-11-04T01:41:49.093 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:49.093 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":75,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:48.757916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8013,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8013":{"gid":8013,"name":"c","rank":0,"incarnation":75,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:49.094 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 75 2023-11-04T01:41:49.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:49.093+0000 7f1e0312c640 1 -- 172.21.15.114:0/2315027557 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1de806aea0 msgr2=0x7f1de806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:49.093+0000 7f1e0312c640 1 --2- 172.21.15.114:0/2315027557 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1de806aea0 0x7f1de806d360 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1dec036000 tx=0x7f1dec030000 comp rx=0 tx=0).stop 2023-11-04T01:41:49.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:49.093+0000 7f1e0312c640 1 -- 172.21.15.114:0/2315027557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dfc15daa0 msgr2=0x7f1dfc1f04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:49.093+0000 7f1e0312c640 1 --2- 172.21.15.114:0/2315027557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dfc15daa0 0x7f1dfc1f04a0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f1df400cd60 tx=0x7f1df400a660 comp rx=0 tx=0).stop 2023-11-04T01:41:49.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:49.093+0000 7f1e0312c640 1 -- 172.21.15.114:0/2315027557 shutdown_connections 2023-11-04T01:41:49.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:49.093+0000 7f1e0312c640 1 --2- 172.21.15.114:0/2315027557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dfc15daa0 0x7f1dfc1f04a0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:49.093+0000 7f1e0312c640 1 --2- 172.21.15.114:0/2315027557 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1de806aea0 0x7f1de806d360 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:49.093+0000 7f1e0312c640 1 --2- 172.21.15.114:0/2315027557 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1dfc0ce240 0x7f1dfc15c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:49.093+0000 7f1e0312c640 1 --2- 172.21.15.114:0/2315027557 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1dfc0cde60 0x7f1dfc156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:49.093+0000 7f1e0312c640 1 -- 172.21.15.114:0/2315027557 >> 172.21.15.114:0/2315027557 conn(0x7f1dfc071f30 msgr2=0x7f1dfc0d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:49.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:49.093+0000 7f1e0312c640 1 -- 172.21.15.114:0/2315027557 shutdown_connections 2023-11-04T01:41:49.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:49.093+0000 7f1e0312c640 1 -- 172.21.15.114:0/2315027557 wait complete. 2023-11-04T01:41:49.106 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:41:50.671 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:50.674 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:51.847 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:41:53.846 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:41:53.844+0000 7ff3628ce640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:53.846 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:41:53.844+0000 7ff3628ce640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:54.107 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.216+0000 7f8c9667c640 1 Processor -- start 2023-11-04T01:41:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.216+0000 7f8c9667c640 1 -- start start 2023-11-04T01:41:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.217+0000 7f8c9667c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8c9015ad80 0x7f8c9006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.217+0000 7f8c9667c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c900c9e10 0x7f8c900b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.217+0000 7f8c9667c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9006cd00 con 0x7f8c900b42c0 2023-11-04T01:41:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.217+0000 7f8c9667c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9006cfa0 con 0x7f8c9015ad80 2023-11-04T01:41:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.217+0000 7f8c9667c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9006d280 con 0x7f8c900c9e10 2023-11-04T01:41:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.218+0000 7f8c8ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8c9015ad80 0x7f8c9006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.218+0000 7f8c94c19640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c900c9e10 0x7f8c900b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.218+0000 7f8c8f7fe640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f8c900b42c0 0x7f8c900c9700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:42052/0 (socket says 172.21.15.114:42052) 2023-11-04T01:41:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.218+0000 7f8c8ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8c9015ad80 0x7f8c9006c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:49498/0 (socket says 172.21.15.114:49498) 2023-11-04T01:41:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.218+0000 7f8c94c19640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c900c9e10 0x7f8c900b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:44392/0 (socket says 172.21.15.114:44392) 2023-11-04T01:41:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.218+0000 7f8c8ffff640 1 -- 172.21.15.114:0/3580976853 learned_addr learned my addr 172.21.15.114:0/3580976853 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.218+0000 7f8c8ffff640 1 -- 172.21.15.114:0/3580976853 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c900c9e10 msgr2=0x7f8c900b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.218+0000 7f8c8ffff640 1 --2- 172.21.15.114:0/3580976853 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c900c9e10 0x7f8c900b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.218+0000 7f8c8ffff640 1 -- 172.21.15.114:0/3580976853 >> v1:172.21.15.141:6789/0 conn(0x7f8c900b42c0 legacy=0x7f8c900c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.218+0000 7f8c8ffff640 1 -- 172.21.15.114:0/3580976853 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9006d560 con 0x7f8c9015ad80 2023-11-04T01:41:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.218+0000 7f8c94c19640 1 --2- 172.21.15.114:0/3580976853 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c900c9e10 0x7f8c900b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:54.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.219+0000 7f8c8ffff640 1 --2- 172.21.15.114:0/3580976853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c9015ad80 0x7f8c9006c7c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009870 tx=0x7f8c8002ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54023040e754928f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.219+0000 7f8c8effd640 1 -- 172.21.15.114:0/3580976853 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8002f830 con 0x7f8c9015ad80 2023-11-04T01:41:54.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.219+0000 7f8c8effd640 1 -- 172.21.15.114:0/3580976853 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8002f990 con 0x7f8c9015ad80 2023-11-04T01:41:54.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.219+0000 7f8c8effd640 1 -- 172.21.15.114:0/3580976853 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8002fd20 con 0x7f8c9015ad80 2023-11-04T01:41:54.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.219+0000 7f8c9667c640 1 -- 172.21.15.114:0/3580976853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c9015ad80 msgr2=0x7f8c9006c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.219+0000 7f8c9667c640 1 --2- 172.21.15.114:0/3580976853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c9015ad80 0x7f8c9006c7c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009870 tx=0x7f8c8002ba10 comp rx=0 tx=0).stop 2023-11-04T01:41:54.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.219+0000 7f8c9667c640 1 -- 172.21.15.114:0/3580976853 shutdown_connections 2023-11-04T01:41:54.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.219+0000 7f8c9667c640 1 --2- 172.21.15.114:0/3580976853 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c900c9e10 0x7f8c900b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.219+0000 7f8c9667c640 1 --2- 172.21.15.114:0/3580976853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c9015ad80 0x7f8c9006c7c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.219+0000 7f8c9667c640 1 -- 172.21.15.114:0/3580976853 >> 172.21.15.114:0/3580976853 conn(0x7f8c900ce950 msgr2=0x7f8c900ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:54.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.220+0000 7f8c9667c640 1 -- 172.21.15.114:0/3580976853 shutdown_connections 2023-11-04T01:41:54.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.220+0000 7f8c9667c640 1 -- 172.21.15.114:0/3580976853 wait complete. 2023-11-04T01:41:54.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.221+0000 7f8c9667c640 1 Processor -- start 2023-11-04T01:41:54.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.221+0000 7f8c9667c640 1 -- start start 2023-11-04T01:41:54.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c9667c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c900b42c0 0x7f8c900ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c9667c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c900c9e10 0x7f8c9014f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c9667c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c9015ad80 0x7f8c900c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c9667c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900ac820 con 0x7f8c900c9e10 2023-11-04T01:41:54.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c9667c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9015c630 con 0x7f8c9015ad80 2023-11-04T01:41:54.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c9667c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9015b6b0 con 0x7f8c900b42c0 2023-11-04T01:41:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c8f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c900c9e10 0x7f8c9014f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c8f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c900c9e10 0x7f8c9014f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52972/0 (socket says 172.21.15.114:52972) 2023-11-04T01:41:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c8f7fe640 1 -- 172.21.15.114:0/168931055 learned_addr learned my addr 172.21.15.114:0/168931055 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c94c19640 1 --2- 172.21.15.114:0/168931055 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c9015ad80 0x7f8c900c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c8ffff640 1 --2- 172.21.15.114:0/168931055 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c900b42c0 0x7f8c900ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c8f7fe640 1 -- 172.21.15.114:0/168931055 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c900b42c0 msgr2=0x7f8c900ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c8f7fe640 1 --2- 172.21.15.114:0/168931055 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c900b42c0 0x7f8c900ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c8f7fe640 1 -- 172.21.15.114:0/168931055 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c9015ad80 msgr2=0x7f8c900c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c8f7fe640 1 --2- 172.21.15.114:0/168931055 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c9015ad80 0x7f8c900c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c8f7fe640 1 -- 172.21.15.114:0/168931055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c88009a70 con 0x7f8c900c9e10 2023-11-04T01:41:54.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c8f7fe640 1 --2- 172.21.15.114:0/168931055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c900c9e10 0x7f8c9014f9b0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400c450 tx=0x7f8c8400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c8cff9640 1 -- 172.21.15.114:0/168931055 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c840074e0 con 0x7f8c900c9e10 2023-11-04T01:41:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c8cff9640 1 -- 172.21.15.114:0/168931055 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c84007660 con 0x7f8c900c9e10 2023-11-04T01:41:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.222+0000 7f8c9667c640 1 -- 172.21.15.114:0/168931055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c800094d0 con 0x7f8c900c9e10 2023-11-04T01:41:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.223+0000 7f8c8cff9640 1 -- 172.21.15.114:0/168931055 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c84004a20 con 0x7f8c900c9e10 2023-11-04T01:41:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.223+0000 7f8c9667c640 1 -- 172.21.15.114:0/168931055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c900aba60 con 0x7f8c900c9e10 2023-11-04T01:41:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.223+0000 7f8c9667c640 1 -- 172.21.15.114:0/168931055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c90074290 con 0x7f8c900c9e10 2023-11-04T01:41:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.224+0000 7f8c8cff9640 1 -- 172.21.15.114:0/168931055 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c84004b80 con 0x7f8c900c9e10 2023-11-04T01:41:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.224+0000 7f8c8cff9640 1 --2- 172.21.15.114:0/168931055 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c7c06ae70 0x7f8c7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.224+0000 7f8c8cff9640 1 -- 172.21.15.114:0/168931055 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f8c84089680 con 0x7f8c900c9e10 2023-11-04T01:41:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.224+0000 7f8c8ffff640 1 --2- 172.21.15.114:0/168931055 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c7c06ae70 0x7f8c7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.225+0000 7f8c8ffff640 1 --2- 172.21.15.114:0/168931055 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c7c06ae70 0x7f8c7c06d330 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8c80036000 tx=0x7f8c80008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.229+0000 7f8c8cff9640 1 -- 172.21.15.114:0/168931055 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8c84053f90 con 0x7f8c900c9e10 2023-11-04T01:41:54.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.431+0000 7f8c9667c640 1 -- 172.21.15.114:0/168931055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c900b4880 con 0x7f8c900c9e10 2023-11-04T01:41:54.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.432+0000 7f8c8cff9640 1 -- 172.21.15.114:0/168931055 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f8c840575b0 con 0x7f8c900c9e10 2023-11-04T01:41:54.434 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:54.434 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":79,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:51.777191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8013,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8013":{"gid":8013,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:54.434 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 79 2023-11-04T01:41:54.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.434+0000 7f8c9667c640 1 -- 172.21.15.114:0/168931055 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c7c06ae70 msgr2=0x7f8c7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.434+0000 7f8c9667c640 1 --2- 172.21.15.114:0/168931055 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c7c06ae70 0x7f8c7c06d330 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8c80036000 tx=0x7f8c80008030 comp rx=0 tx=0).stop 2023-11-04T01:41:54.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.434+0000 7f8c9667c640 1 -- 172.21.15.114:0/168931055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c900c9e10 msgr2=0x7f8c9014f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.434+0000 7f8c9667c640 1 --2- 172.21.15.114:0/168931055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c900c9e10 0x7f8c9014f9b0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400c450 tx=0x7f8c8400c850 comp rx=0 tx=0).stop 2023-11-04T01:41:54.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.434+0000 7f8c9667c640 1 -- 172.21.15.114:0/168931055 shutdown_connections 2023-11-04T01:41:54.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.434+0000 7f8c9667c640 1 --2- 172.21.15.114:0/168931055 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c7c06ae70 0x7f8c7c06d330 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.434+0000 7f8c9667c640 1 --2- 172.21.15.114:0/168931055 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c9015ad80 0x7f8c900c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.434+0000 7f8c9667c640 1 --2- 172.21.15.114:0/168931055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c900c9e10 0x7f8c9014f9b0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.434+0000 7f8c9667c640 1 --2- 172.21.15.114:0/168931055 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c900b42c0 0x7f8c900ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.434+0000 7f8c9667c640 1 -- 172.21.15.114:0/168931055 >> 172.21.15.114:0/168931055 conn(0x7f8c900ce950 msgr2=0x7f8c900b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:54.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.434+0000 7f8c9667c640 1 -- 172.21.15.114:0/168931055 shutdown_connections 2023-11-04T01:41:54.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.434+0000 7f8c9667c640 1 -- 172.21.15.114:0/168931055 wait complete. 2023-11-04T01:41:54.446 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:41:54.447 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:54.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.544+0000 7f2c6659e640 1 Processor -- start 2023-11-04T01:41:54.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.545+0000 7f2c6659e640 1 -- start start 2023-11-04T01:41:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.545+0000 7f2c6659e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c600cced0 0x7f2c600ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.545+0000 7f2c6659e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2c600717b0 0x7f2c600cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.545+0000 7f2c6659e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c600721c0 con 0x7f2c601604a0 2023-11-04T01:41:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.545+0000 7f2c6659e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c600726f0 con 0x7f2c600717b0 2023-11-04T01:41:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.545+0000 7f2c6659e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c600cfea0 con 0x7f2c600cced0 2023-11-04T01:41:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.545+0000 7f2c6559c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2c601604a0 0x7f2c600cc7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49416/0 (socket says 172.21.15.114:49416) 2023-11-04T01:41:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.545+0000 7f2c6559c640 1 -- 172.21.15.114:0/2048030762 learned_addr learned my addr 172.21.15.114:0/2048030762 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c57fff640 1 -- 172.21.15.114:0/2048030762 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276517744 0 0) 0x7f2c600721c0 con 0x7f2c601604a0 2023-11-04T01:41:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c57fff640 1 -- 172.21.15.114:0/2048030762 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c4c003520 con 0x7f2c601604a0 2023-11-04T01:41:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c64d9b640 1 --2- 172.21.15.114:0/2048030762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c600cced0 0x7f2c600ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c65d9d640 1 --2- 172.21.15.114:0/2048030762 >> v2:172.21.15.141:3300/0 conn(0x7f2c600717b0 0x7f2c600cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c57fff640 1 -- 172.21.15.114:0/2048030762 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2729686110 0 0) 0x7f2c4c003520 con 0x7f2c601604a0 2023-11-04T01:41:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c57fff640 1 -- 172.21.15.114:0/2048030762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c600cced0 msgr2=0x7f2c600ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c57fff640 1 --2- 172.21.15.114:0/2048030762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c600cced0 0x7f2c600ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c57fff640 1 -- 172.21.15.114:0/2048030762 >> v2:172.21.15.141:3300/0 conn(0x7f2c600717b0 msgr2=0x7f2c600cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c57fff640 1 --2- 172.21.15.114:0/2048030762 >> v2:172.21.15.141:3300/0 conn(0x7f2c600717b0 0x7f2c600cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c57fff640 1 -- 172.21.15.114:0/2048030762 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c600cdbe0 con 0x7f2c601604a0 2023-11-04T01:41:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c57fff640 1 -- 172.21.15.114:0/2048030762 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f2c5c0019f0 con 0x7f2c601604a0 2023-11-04T01:41:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c57fff640 1 -- 172.21.15.114:0/2048030762 >> v1:172.21.15.114:6789/0 conn(0x7f2c601604a0 legacy=0x7f2c600cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c57fff640 1 --2- 172.21.15.114:0/2048030762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4c003970 0x7f2c4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c57fff640 1 --2- 172.21.15.114:0/2048030762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c4c0047c0 0x7f2c4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c57fff640 1 --2- 172.21.15.114:0/2048030762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c600cced0 0x7f2c4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c57fff640 1 -- 172.21.15.114:0/2048030762 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c600726f0 con 0x7f2c4c003970 2023-11-04T01:41:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c57fff640 1 -- 172.21.15.114:0/2048030762 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c600cfea0 con 0x7f2c4c0047c0 2023-11-04T01:41:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c57fff640 1 -- 172.21.15.114:0/2048030762 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c00ba00 con 0x7f2c600cced0 2023-11-04T01:41:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c6559c640 1 --2- 172.21.15.114:0/2048030762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4c003970 0x7f2c4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c64d9b640 1 --2- 172.21.15.114:0/2048030762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c4c0047c0 0x7f2c4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c65d9d640 1 --2- 172.21.15.114:0/2048030762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c600cced0 0x7f2c4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c6559c640 1 -- 172.21.15.114:0/2048030762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c600cced0 msgr2=0x7f2c4c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c6559c640 1 --2- 172.21.15.114:0/2048030762 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c600cced0 0x7f2c4c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c6559c640 1 -- 172.21.15.114:0/2048030762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c4c0047c0 msgr2=0x7f2c4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:54.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c6559c640 1 --2- 172.21.15.114:0/2048030762 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c4c0047c0 0x7f2c4c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.546+0000 7f2c6559c640 1 -- 172.21.15.114:0/2048030762 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c003520 con 0x7f2c4c003970 2023-11-04T01:41:54.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.547+0000 7f2c6559c640 1 --2- 172.21.15.114:0/2048030762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4c003970 0x7f2c4c003d90 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00a840 tx=0x7f2c4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca701bd1e2d9a0b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.547+0000 7f2c57fff640 1 -- 172.21.15.114:0/2048030762 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c034630 con 0x7f2c4c003970 2023-11-04T01:41:54.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.547+0000 7f2c57fff640 1 -- 172.21.15.114:0/2048030762 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c02f070 con 0x7f2c4c003970 2023-11-04T01:41:54.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.547+0000 7f2c57fff640 1 -- 172.21.15.114:0/2048030762 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c0349f0 con 0x7f2c4c003970 2023-11-04T01:41:54.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.548+0000 7f2c6659e640 1 -- 172.21.15.114:0/2048030762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4c003970 msgr2=0x7f2c4c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.548+0000 7f2c6659e640 1 --2- 172.21.15.114:0/2048030762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4c003970 0x7f2c4c003d90 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00a840 tx=0x7f2c4c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.548+0000 7f2c65d9d640 1 -- 172.21.15.114:0/2048030762 reap_dead start 2023-11-04T01:41:54.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.548+0000 7f2c6659e640 1 -- 172.21.15.114:0/2048030762 shutdown_connections 2023-11-04T01:41:54.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.548+0000 7f2c6659e640 1 -- 172.21.15.114:0/2048030762 >> 172.21.15.114:0/2048030762 conn(0x7f2c6006b620 msgr2=0x7f2c6006ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.548+0000 7f2c6659e640 1 -- 172.21.15.114:0/2048030762 shutdown_connections 2023-11-04T01:41:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.548+0000 7f2c6659e640 1 -- 172.21.15.114:0/2048030762 wait complete. 2023-11-04T01:41:54.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.549+0000 7f2c6659e640 1 Processor -- start 2023-11-04T01:41:54.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.549+0000 7f2c6659e640 1 -- start start 2023-11-04T01:41:54.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.550+0000 7f2c6659e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4c003970 0x7f2c6015a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.550+0000 7f2c6659e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c600ac930 0x7f2c600c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.550+0000 7f2c6659e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c600c4880 0x7f2c600c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.550+0000 7f2c6659e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c600c4d30 con 0x7f2c4c003970 2023-11-04T01:41:54.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.550+0000 7f2c6659e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c600b45b0 con 0x7f2c600ac930 2023-11-04T01:41:54.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.550+0000 7f2c6659e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c600b39e0 con 0x7f2c600c4880 2023-11-04T01:41:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.550+0000 7f2c6559c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4c003970 0x7f2c6015a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.550+0000 7f2c6559c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4c003970 0x7f2c6015a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52986/0 (socket says 172.21.15.114:52986) 2023-11-04T01:41:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.550+0000 7f2c6559c640 1 -- 172.21.15.114:0/4033419816 learned_addr learned my addr 172.21.15.114:0/4033419816 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.550+0000 7f2c6559c640 1 -- 172.21.15.114:0/4033419816 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c600c4880 msgr2=0x7f2c600c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.550+0000 7f2c6559c640 1 --2- 172.21.15.114:0/4033419816 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c600c4880 0x7f2c600c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.550+0000 7f2c6559c640 1 -- 172.21.15.114:0/4033419816 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c600ac930 msgr2=0x7f2c600c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.550+0000 7f2c6559c640 1 --2- 172.21.15.114:0/4033419816 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c600ac930 0x7f2c600c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.550+0000 7f2c6559c640 1 -- 172.21.15.114:0/4033419816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c600b3c80 con 0x7f2c4c003970 2023-11-04T01:41:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.551+0000 7f2c6559c640 1 --2- 172.21.15.114:0/4033419816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4c003970 0x7f2c6015a320 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00a840 tx=0x7f2c60072830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.551+0000 7f2c55ffb640 1 -- 172.21.15.114:0/4033419816 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c034840 con 0x7f2c4c003970 2023-11-04T01:41:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.551+0000 7f2c55ffb640 1 -- 172.21.15.114:0/4033419816 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c0349a0 con 0x7f2c4c003970 2023-11-04T01:41:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.551+0000 7f2c55ffb640 1 -- 172.21.15.114:0/4033419816 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c034d30 con 0x7f2c4c003970 2023-11-04T01:41:54.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.551+0000 7f2c6659e640 1 -- 172.21.15.114:0/4033419816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c600b3f60 con 0x7f2c4c003970 2023-11-04T01:41:54.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.551+0000 7f2c6659e640 1 -- 172.21.15.114:0/4033419816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6015a860 con 0x7f2c4c003970 2023-11-04T01:41:54.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.552+0000 7f2c6659e640 1 -- 172.21.15.114:0/4033419816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c600c4d30 con 0x7f2c4c003970 2023-11-04T01:41:54.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.552+0000 7f2c55ffb640 1 -- 172.21.15.114:0/4033419816 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c5c031030 con 0x7f2c4c003970 2023-11-04T01:41:54.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.553+0000 7f2c55ffb640 1 --2- 172.21.15.114:0/4033419816 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2c4406ae70 0x7f2c4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.553+0000 7f2c55ffb640 1 -- 172.21.15.114:0/4033419816 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f2c5c0ab560 con 0x7f2c4c003970 2023-11-04T01:41:54.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.553+0000 7f2c64d9b640 1 --2- 172.21.15.114:0/4033419816 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2c4406ae70 0x7f2c4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.553+0000 7f2c64d9b640 1 --2- 172.21.15.114:0/4033419816 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2c4406ae70 0x7f2c4406d330 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2c601f5ac0 tx=0x7f2c50009320 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.557+0000 7f2c55ffb640 1 -- 172.21.15.114:0/4033419816 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c600c4d30 con 0x7f2c4c003970 2023-11-04T01:41:54.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.755+0000 7f2c6659e640 1 -- 172.21.15.114:0/4033419816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c600c4d30 con 0x7f2c4c003970 2023-11-04T01:41:54.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.755+0000 7f2c55ffb640 1 -- 172.21.15.114:0/4033419816 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f2c600c4d30 con 0x7f2c4c003970 2023-11-04T01:41:54.757 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:54.757 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":79,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:51.777191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8013,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8013":{"gid":8013,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:54.757 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 79 2023-11-04T01:41:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.757+0000 7f2c6659e640 1 -- 172.21.15.114:0/4033419816 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2c4406ae70 msgr2=0x7f2c4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.757+0000 7f2c6659e640 1 --2- 172.21.15.114:0/4033419816 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2c4406ae70 0x7f2c4406d330 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2c601f5ac0 tx=0x7f2c50009320 comp rx=0 tx=0).stop 2023-11-04T01:41:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.757+0000 7f2c6659e640 1 -- 172.21.15.114:0/4033419816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4c003970 msgr2=0x7f2c6015a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.757+0000 7f2c6659e640 1 --2- 172.21.15.114:0/4033419816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4c003970 0x7f2c6015a320 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00a840 tx=0x7f2c60072830 comp rx=0 tx=0).stop 2023-11-04T01:41:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.757+0000 7f2c6659e640 1 -- 172.21.15.114:0/4033419816 shutdown_connections 2023-11-04T01:41:54.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.757+0000 7f2c6659e640 1 --2- 172.21.15.114:0/4033419816 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2c600c4880 0x7f2c600c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.757+0000 7f2c6659e640 1 --2- 172.21.15.114:0/4033419816 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2c4406ae70 0x7f2c4406d330 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.757+0000 7f2c6659e640 1 --2- 172.21.15.114:0/4033419816 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2c600ac930 0x7f2c600c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.757+0000 7f2c6659e640 1 --2- 172.21.15.114:0/4033419816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4c003970 0x7f2c6015a320 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.757+0000 7f2c6659e640 1 -- 172.21.15.114:0/4033419816 >> 172.21.15.114:0/4033419816 conn(0x7f2c6006b620 msgr2=0x7f2c6006ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:54.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.757+0000 7f2c6659e640 1 -- 172.21.15.114:0/4033419816 shutdown_connections 2023-11-04T01:41:54.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:54.757+0000 7f2c6659e640 1 -- 172.21.15.114:0/4033419816 wait complete. 2023-11-04T01:41:55.171 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:39:51.430343+0000', 'modified': '2023-11-04T01:41:51.777191+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 8013, 'mds_1': 6298}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6298': {'gid': 6298, 'name': 'b', 'rank': 1, 'incarnation': 45, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.141:6834/1296600989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.141:6832', 'nonce': 1296600989}, {'type': 'v1', 'addr': '172.21.15.141:6834', 'nonce': 1296600989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_8013': {'gid': 8013, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.114:6836/1629274449', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6834', 'nonce': 1629274449}, {'type': 'v1', 'addr': '172.21.15.114:6836', 'nonce': 1629274449}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:41:55.172 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:41:55.172 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:41:55.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.270+0000 7fc94fb61640 1 Processor -- start 2023-11-04T01:41:55.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.271+0000 7fc94fb61640 1 -- start start 2023-11-04T01:41:55.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.271+0000 7fc94fb61640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc94815cfd0 0x7fc94806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.271+0000 7fc94fb61640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9480cea20 con 0x7fc9480cf180 2023-11-04T01:41:55.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.271+0000 7fc94fb61640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9480cf610 con 0x7fc9480cd570 2023-11-04T01:41:55.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.271+0000 7fc94fb61640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94815d3b0 con 0x7fc94815cfd0 2023-11-04T01:41:55.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.271+0000 7fc94d0fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc9480cf180 0x7fc948161440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49422/0 (socket says 172.21.15.114:49422) 2023-11-04T01:41:55.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.271+0000 7fc94d0fc640 1 -- 172.21.15.114:0/429390536 learned_addr learned my addr 172.21.15.114:0/429390536 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:55.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/429390536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc94815cfd0 0x7fc94806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94c8fb640 1 -- 172.21.15.114:0/429390536 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371905805 0 0) 0x7fc9480cea20 con 0x7fc9480cf180 2023-11-04T01:41:55.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94c8fb640 1 -- 172.21.15.114:0/429390536 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc934003520 con 0x7fc9480cf180 2023-11-04T01:41:55.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94c8fb640 1 -- 172.21.15.114:0/429390536 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1263818497 0 0) 0x7fc934003520 con 0x7fc9480cf180 2023-11-04T01:41:55.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94c8fb640 1 -- 172.21.15.114:0/429390536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc94815cfd0 msgr2=0x7fc94806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94c8fb640 1 --2- 172.21.15.114:0/429390536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc94815cfd0 0x7fc94806c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94c8fb640 1 -- 172.21.15.114:0/429390536 >> v1:172.21.15.141:6789/0 conn(0x7fc9480cd570 legacy=0x7fc9480cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94c8fb640 1 -- 172.21.15.114:0/429390536 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480cf8f0 con 0x7fc9480cf180 2023-11-04T01:41:55.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94c8fb640 1 -- 172.21.15.114:0/429390536 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fc938001670 con 0x7fc9480cf180 2023-11-04T01:41:55.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94c8fb640 1 -- 172.21.15.114:0/429390536 >> v1:172.21.15.114:6789/0 conn(0x7fc9480cf180 legacy=0x7fc948161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94c8fb640 1 --2- 172.21.15.114:0/429390536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9340039a0 0x7fc934003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94c8fb640 1 --2- 172.21.15.114:0/429390536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc94815cfd0 0x7fc9340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94c8fb640 1 --2- 172.21.15.114:0/429390536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc934004d00 0x7fc934005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94c8fb640 1 -- 172.21.15.114:0/429390536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94815d3b0 con 0x7fc934004d00 2023-11-04T01:41:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94c8fb640 1 -- 172.21.15.114:0/429390536 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93400ba30 con 0x7fc9340039a0 2023-11-04T01:41:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94c8fb640 1 -- 172.21.15.114:0/429390536 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93400bbf0 con 0x7fc94815cfd0 2023-11-04T01:41:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94e0fe640 1 --2- 172.21.15.114:0/429390536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc934004d00 0x7fc934005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/429390536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9340039a0 0x7fc934003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94d0fc640 1 --2- 172.21.15.114:0/429390536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc94815cfd0 0x7fc9340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94e0fe640 1 -- 172.21.15.114:0/429390536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc94815cfd0 msgr2=0x7fc9340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94e0fe640 1 --2- 172.21.15.114:0/429390536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc94815cfd0 0x7fc9340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94e0fe640 1 -- 172.21.15.114:0/429390536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9340039a0 msgr2=0x7fc934003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94e0fe640 1 --2- 172.21.15.114:0/429390536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9340039a0 0x7fc934003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94e0fe640 1 -- 172.21.15.114:0/429390536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc934003520 con 0x7fc934004d00 2023-11-04T01:41:55.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/429390536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc9340039a0 0x7fc934003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:55.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.272+0000 7fc94d0fc640 1 --2- 172.21.15.114:0/429390536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc94815cfd0 0x7fc9340047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:55.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.273+0000 7fc94e0fe640 1 --2- 172.21.15.114:0/429390536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc934004d00 0x7fc934005180 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fc940001910 tx=0x7fc9340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee96489f5e9e6379 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.273+0000 7fc94c8fb640 1 -- 172.21.15.114:0/429390536 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc940032620 con 0x7fc934004d00 2023-11-04T01:41:55.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.273+0000 7fc94c8fb640 1 -- 172.21.15.114:0/429390536 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc940032780 con 0x7fc934004d00 2023-11-04T01:41:55.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.273+0000 7fc94c8fb640 1 -- 172.21.15.114:0/429390536 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc940032b10 con 0x7fc934004d00 2023-11-04T01:41:55.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.274+0000 7fc94fb61640 1 -- 172.21.15.114:0/429390536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc934004d00 msgr2=0x7fc934005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.274+0000 7fc94fb61640 1 --2- 172.21.15.114:0/429390536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc934004d00 0x7fc934005180 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fc940001910 tx=0x7fc9340057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.274+0000 7fc94e0fe640 1 -- 172.21.15.114:0/429390536 reap_dead start 2023-11-04T01:41:55.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.274+0000 7fc94fb61640 1 -- 172.21.15.114:0/429390536 shutdown_connections 2023-11-04T01:41:55.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.274+0000 7fc94fb61640 1 -- 172.21.15.114:0/429390536 >> 172.21.15.114:0/429390536 conn(0x7fc94806ea20 msgr2=0x7fc94806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.274+0000 7fc94fb61640 1 -- 172.21.15.114:0/429390536 shutdown_connections 2023-11-04T01:41:55.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.274+0000 7fc94fb61640 1 -- 172.21.15.114:0/429390536 wait complete. 2023-11-04T01:41:55.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.275+0000 7fc94fb61640 1 Processor -- start 2023-11-04T01:41:55.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.275+0000 7fc94fb61640 1 -- start start 2023-11-04T01:41:55.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94fb61640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc948150130 0x7fc9480c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94fb61640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480c81b0 0x7fc9480b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94fb61640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc948150510 0x7fc9480b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94fb61640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc948152290 con 0x7fc9480c81b0 2023-11-04T01:41:55.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94fb61640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480b4290 con 0x7fc948150130 2023-11-04T01:41:55.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94fb61640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480b2e90 con 0x7fc948150510 2023-11-04T01:41:55.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94d0fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480c81b0 0x7fc9480b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94d0fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480c81b0 0x7fc9480b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52998/0 (socket says 172.21.15.114:52998) 2023-11-04T01:41:55.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94d0fc640 1 -- 172.21.15.114:0/3224081876 learned_addr learned my addr 172.21.15.114:0/3224081876 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:55.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94e0fe640 1 --2- 172.21.15.114:0/3224081876 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc948150510 0x7fc9480b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/3224081876 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc948150130 0x7fc9480c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94d0fc640 1 -- 172.21.15.114:0/3224081876 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc948150510 msgr2=0x7fc9480b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94d0fc640 1 --2- 172.21.15.114:0/3224081876 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc948150510 0x7fc9480b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94d0fc640 1 -- 172.21.15.114:0/3224081876 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc948150130 msgr2=0x7fc9480c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94d0fc640 1 --2- 172.21.15.114:0/3224081876 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc948150130 0x7fc9480c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94d0fc640 1 -- 172.21.15.114:0/3224081876 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480b3170 con 0x7fc9480c81b0 2023-11-04T01:41:55.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/3224081876 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc948150130 0x7fc9480c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:55.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.276+0000 7fc94d0fc640 1 --2- 172.21.15.114:0/3224081876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480c81b0 0x7fc9480b4720 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fc93800eb20 tx=0x7fc938005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.277+0000 7fc93e7fc640 1 -- 172.21.15.114:0/3224081876 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93800c8d0 con 0x7fc9480c81b0 2023-11-04T01:41:55.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.277+0000 7fc93e7fc640 1 -- 172.21.15.114:0/3224081876 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93800ca30 con 0x7fc9480c81b0 2023-11-04T01:41:55.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.277+0000 7fc94fb61640 1 -- 172.21.15.114:0/3224081876 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc948151f40 con 0x7fc9480c81b0 2023-11-04T01:41:55.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.277+0000 7fc93e7fc640 1 -- 172.21.15.114:0/3224081876 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93800cdc0 con 0x7fc9480c81b0 2023-11-04T01:41:55.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.277+0000 7fc94fb61640 1 -- 172.21.15.114:0/3224081876 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc948152490 con 0x7fc9480c81b0 2023-11-04T01:41:55.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.278+0000 7fc93e7fc640 1 -- 172.21.15.114:0/3224081876 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc93801d460 con 0x7fc9480c81b0 2023-11-04T01:41:55.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.279+0000 7fc93e7fc640 1 --2- 172.21.15.114:0/3224081876 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc92c06aea0 0x7fc92c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.279+0000 7fc93e7fc640 1 -- 172.21.15.114:0/3224081876 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7fc938089c30 con 0x7fc9480c81b0 2023-11-04T01:41:55.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.279+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/3224081876 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc92c06aea0 0x7fc92c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.279+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/3224081876 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc92c06aea0 0x7fc92c06d360 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc944007380 tx=0x7fc94400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.280+0000 7fc9527d1740 1 Processor -- start 2023-11-04T01:41:55.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.280+0000 7fc9527d1740 1 -- start start 2023-11-04T01:41:55.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.280+0000 7fc9527d1740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075403850 0x5590753d6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.280+0000 7fc9527d1740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403c30 0x5590754065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.280+0000 7fc9527d1740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590753d6c90 0x559075406b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.280+0000 7fc9527d1740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590752e7740 con 0x559075403c30 2023-11-04T01:41:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.280+0000 7fc9527d1740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590753498d0 con 0x559075403850 2023-11-04T01:41:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.280+0000 7fc9527d1740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x559075346fc0 con 0x5590753d6c90 2023-11-04T01:41:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.281+0000 7fc94d0fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403c30 0x5590754065e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.281+0000 7fc94d0fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403c30 0x5590754065e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53002/0 (socket says 172.21.15.114:53002) 2023-11-04T01:41:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.281+0000 7fc94d0fc640 1 -- 172.21.15.114:0/3319924393 learned_addr learned my addr 172.21.15.114:0/3319924393 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.281+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/3319924393 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075403850 0x5590753d6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.281+0000 7fc94e0fe640 1 --2- 172.21.15.114:0/3319924393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590753d6c90 0x559075406b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.281+0000 7fc94d0fc640 1 -- 172.21.15.114:0/3319924393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590753d6c90 msgr2=0x559075406b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.281+0000 7fc94d0fc640 1 --2- 172.21.15.114:0/3319924393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590753d6c90 0x559075406b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.281+0000 7fc94d0fc640 1 -- 172.21.15.114:0/3319924393 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075403850 msgr2=0x5590753d6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.281+0000 7fc94d0fc640 1 --2- 172.21.15.114:0/3319924393 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075403850 0x5590753d6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.281+0000 7fc94d0fc640 1 -- 172.21.15.114:0/3319924393 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559075305ca0 con 0x559075403c30 2023-11-04T01:41:55.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.281+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/3319924393 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075403850 0x5590753d6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:55.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.281+0000 7fc94d0fc640 1 --2- 172.21.15.114:0/3319924393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403c30 0x5590754065e0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fc938087a40 tx=0x7fc938058a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934fa29dd53e3e52 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.281+0000 7fc92b7fe640 1 -- 172.21.15.114:0/3319924393 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93805c460 con 0x559075403c30 2023-11-04T01:41:55.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.281+0000 7fc92b7fe640 1 -- 172.21.15.114:0/3319924393 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc938060610 con 0x559075403c30 2023-11-04T01:41:55.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.281+0000 7fc92b7fe640 1 -- 172.21.15.114:0/3319924393 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93805c150 con 0x559075403c30 2023-11-04T01:41:55.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.282+0000 7fc9527d1740 1 -- 172.21.15.114:0/3319924393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403c30 msgr2=0x5590754065e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.282+0000 7fc9527d1740 1 --2- 172.21.15.114:0/3319924393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403c30 0x5590754065e0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fc938087a40 tx=0x7fc938058a10 comp rx=0 tx=0).stop 2023-11-04T01:41:55.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.282+0000 7fc9527d1740 1 -- 172.21.15.114:0/3319924393 shutdown_connections 2023-11-04T01:41:55.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.282+0000 7fc9527d1740 1 --2- 172.21.15.114:0/3319924393 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5590753d6c90 0x559075406b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.282+0000 7fc9527d1740 1 --2- 172.21.15.114:0/3319924393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403c30 0x5590754065e0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.282+0000 7fc9527d1740 1 --2- 172.21.15.114:0/3319924393 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075403850 0x5590753d6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.282+0000 7fc9527d1740 1 -- 172.21.15.114:0/3319924393 >> 172.21.15.114:0/3319924393 conn(0x5590753d8a60 msgr2=0x5590754215e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.282+0000 7fc9527d1740 1 -- 172.21.15.114:0/3319924393 shutdown_connections 2023-11-04T01:41:55.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.282+0000 7fc9527d1740 1 -- 172.21.15.114:0/3319924393 wait complete. 2023-11-04T01:41:55.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.282+0000 7fc9527d1740 1 -- start start 2023-11-04T01:41:55.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.282+0000 7fc9527d1740 1 Processor -- start 2023-11-04T01:41:55.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.283+0000 7fc9527d1740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075403850 0x55907541b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.283+0000 7fc9527d1740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403c30 0x5590753f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.283+0000 7fc9527d1740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075419850 0x55907541bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.283+0000 7fc9527d1740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590753428b0 con 0x559075419850 2023-11-04T01:41:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.283+0000 7fc9527d1740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590752fcc80 con 0x559075403850 2023-11-04T01:41:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.283+0000 7fc9527d1740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590752fc920 con 0x559075403c30 2023-11-04T01:41:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.283+0000 7fc9527d1740 10 client.0 _ll_register_callbacks cb 0x559075054ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.283+0000 7fc94e0fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075419850 0x55907541bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.283+0000 7fc94e0fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075419850 0x55907541bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53016/0 (socket says 172.21.15.114:53016) 2023-11-04T01:41:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.283+0000 7fc94e0fe640 1 -- 172.21.15.114:0/3464951607 learned_addr learned my addr 172.21.15.114:0/3464951607 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.283+0000 7fc94d0fc640 1 --2- 172.21.15.114:0/3464951607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403c30 0x5590753f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.283+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/3464951607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075403850 0x55907541b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc94e0fe640 1 -- 172.21.15.114:0/3464951607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403c30 msgr2=0x5590753f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc94e0fe640 1 --2- 172.21.15.114:0/3464951607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403c30 0x5590753f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc94e0fe640 1 -- 172.21.15.114:0/3464951607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075403850 msgr2=0x55907541b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc94e0fe640 1 --2- 172.21.15.114:0/3464951607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075403850 0x55907541b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc94e0fe640 1 -- 172.21.15.114:0/3464951607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc948152490 con 0x559075419850 2023-11-04T01:41:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/3464951607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075403850 0x55907541b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc94e0fe640 1 --2- 172.21.15.114:0/3464951607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075419850 0x55907541bfe0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fc940001a30 tx=0x7fc940001320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5360e9a23192caf3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc928ff9640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:41:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc928ff9640 1 -- 172.21.15.114:0/3464951607 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400054f0 con 0x559075419850 2023-11-04T01:41:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc928ff9640 1 -- 172.21.15.114:0/3464951607 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7fc9400328f0 con 0x559075419850 2023-11-04T01:41:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc9527d1740 1 -- 172.21.15.114:0/3464951607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5590752eebf0 con 0x559075419850 2023-11-04T01:41:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc928ff9640 1 -- 172.21.15.114:0/3464951607 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc940032ab0 con 0x559075419850 2023-11-04T01:41:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc9527d1740 10 client.8163 fetch_fsmap learned FSMap version 79 2023-11-04T01:41:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc9527d1740 1 -- 172.21.15.114:0/3464951607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x559075340f30 con 0x559075419850 2023-11-04T01:41:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc928ff9640 1 -- 172.21.15.114:0/3464951607 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5590752eebf0 con 0x559075419850 2023-11-04T01:41:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc928ff9640 1 -- 172.21.15.114:0/3464951607 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 79) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fc940032c10 con 0x559075419850 2023-11-04T01:41:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc9527d1740 10 client.8163 fetch_fsmap finished waiting for FSMap version 79 2023-11-04T01:41:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc9527d1740 10 client.8163 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:41:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc9527d1740 20 client.8163 populate_metadata read hostname 'smithi114' 2023-11-04T01:41:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc9527d1740 1 --2- 172.21.15.114:0/3464951607 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x55907543d040 0x55907543f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc9527d1740 4 client.8163 mds_command: new command op to 6298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:41:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.284+0000 7fc9527d1740 1 -- 172.21.15.114:0/3464951607 --> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55907533b890 con 0x55907543d040 2023-11-04T01:41:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.285+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/3464951607 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x55907543d040 0x55907543f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.285+0000 7fc928ff9640 10 client.8163 ms_handle_connect on v2:172.21.15.141:6832/1296600989 2023-11-04T01:41:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.285+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/3464951607 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x55907543d040 0x55907543f430 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=57136f409d8d8a0f server_cookie=290040817b15974a in_seq=0 out_seq=0 2023-11-04T01:41:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.286+0000 7fc928ff9640 1 -- 172.21.15.114:0/3464951607 <== mds.1 v2:172.21.15.141:6832/1296600989 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55907533b890 con 0x55907543d040 2023-11-04T01:41:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.286+0000 7fc928ff9640 10 client.8163 handle_command_reply: tid=0 2023-11-04T01:41:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.286+0000 7fc9527d1740 1 client.8163 shutdown 2023-11-04T01:41:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.286+0000 7fc9527d1740 1 -- 172.21.15.114:0/3464951607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075419850 msgr2=0x55907541bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.286+0000 7fc9527d1740 1 --2- 172.21.15.114:0/3464951607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075419850 0x55907541bfe0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fc940001a30 tx=0x7fc940001320 comp rx=0 tx=0).stop 2023-11-04T01:41:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.286+0000 7fc9527d1740 1 -- 172.21.15.114:0/3464951607 shutdown_connections 2023-11-04T01:41:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.286+0000 7fc9527d1740 1 --2- 172.21.15.114:0/3464951607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075419850 0x55907541bfe0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.286+0000 7fc9527d1740 1 --2- 172.21.15.114:0/3464951607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403c30 0x5590753f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.286+0000 7fc9527d1740 1 --2- 172.21.15.114:0/3464951607 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x55907543d040 0x55907543f430 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.286+0000 7fc9527d1740 1 --2- 172.21.15.114:0/3464951607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075403850 0x55907541b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.286+0000 7fc928ff9640 0 client.8163 ms_handle_reset on v2:172.21.15.141:6832/1296600989 2023-11-04T01:41:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.286+0000 7fc9527d1740 1 -- 172.21.15.114:0/3464951607 >> 172.21.15.114:0/3464951607 conn(0x5590753d6c90 msgr2=0x5590753d54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.286+0000 7fc9527d1740 1 -- 172.21.15.114:0/3464951607 shutdown_connections 2023-11-04T01:41:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.286+0000 7fc9527d1740 1 -- 172.21.15.114:0/3464951607 wait complete. 2023-11-04T01:41:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.286+0000 7fc9527d1740 20 client.8163 trim_cache size 0 max 16384 2023-11-04T01:41:55.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.302+0000 7fc9527d1740 1 Processor -- start 2023-11-04T01:41:55.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.302+0000 7fc9527d1740 1 -- start start 2023-11-04T01:41:55.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.302+0000 7fc9527d1740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403850 0x5590753d54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.302+0000 7fc9527d1740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403c30 0x559075406060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.302+0000 7fc9527d1740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075419850 0x5590754065a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.302+0000 7fc9527d1740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590752c2280 con 0x559075403850 2023-11-04T01:41:55.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.302+0000 7fc9527d1740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55907541c650 con 0x559075419850 2023-11-04T01:41:55.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.302+0000 7fc9527d1740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590753f3bc0 con 0x559075403c30 2023-11-04T01:41:55.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.302+0000 7fc94d8fd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403850 0x5590753d54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.302+0000 7fc94d8fd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403850 0x5590753d54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53026/0 (socket says 172.21.15.114:53026) 2023-11-04T01:41:55.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.302+0000 7fc94d8fd640 1 -- 172.21.15.114:0/1903148341 learned_addr learned my addr 172.21.15.114:0/1903148341 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:55.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc94e0fe640 1 --2- 172.21.15.114:0/1903148341 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075419850 0x5590754065a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc94d8fd640 1 -- 172.21.15.114:0/1903148341 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403c30 msgr2=0x559075406060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc94d0fc640 1 --2- 172.21.15.114:0/1903148341 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403c30 0x559075406060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/1903148341 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403c30 0x559075406060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc94d8fd640 1 -- 172.21.15.114:0/1903148341 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075419850 msgr2=0x5590754065a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/1903148341 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075419850 0x5590754065a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc94d8fd640 1 -- 172.21.15.114:0/1903148341 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590752ded10 con 0x559075403850 2023-11-04T01:41:55.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc94e0fe640 1 --2- 172.21.15.114:0/1903148341 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075419850 0x5590754065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:55.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc94d0fc640 1 --2- 172.21.15.114:0/1903148341 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403c30 0x559075406060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:55.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/1903148341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403850 0x5590753d54f0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x55907541ac70 tx=0x7fc944017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d7708dcce0c61 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc92bfff640 1 -- 172.21.15.114:0/1903148341 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94400e040 con 0x559075403850 2023-11-04T01:41:55.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc92bfff640 1 -- 172.21.15.114:0/1903148341 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94401e040 con 0x559075403850 2023-11-04T01:41:55.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc92bfff640 1 -- 172.21.15.114:0/1903148341 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944015df0 con 0x559075403850 2023-11-04T01:41:55.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc9527d1740 1 -- 172.21.15.114:0/1903148341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403850 msgr2=0x5590753d54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc9527d1740 1 --2- 172.21.15.114:0/1903148341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403850 0x5590753d54f0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x55907541ac70 tx=0x7fc944017000 comp rx=0 tx=0).stop 2023-11-04T01:41:55.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc9527d1740 1 -- 172.21.15.114:0/1903148341 shutdown_connections 2023-11-04T01:41:55.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc9527d1740 1 --2- 172.21.15.114:0/1903148341 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075419850 0x5590754065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc9527d1740 1 --2- 172.21.15.114:0/1903148341 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403c30 0x559075406060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc9527d1740 1 --2- 172.21.15.114:0/1903148341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403850 0x5590753d54f0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc9527d1740 1 -- 172.21.15.114:0/1903148341 >> 172.21.15.114:0/1903148341 conn(0x5590753d6c90 msgr2=0x5590753f59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc9527d1740 1 -- 172.21.15.114:0/1903148341 shutdown_connections 2023-11-04T01:41:55.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.303+0000 7fc9527d1740 1 -- 172.21.15.114:0/1903148341 wait complete. 2023-11-04T01:41:55.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.304+0000 7fc9527d1740 1 -- start start 2023-11-04T01:41:55.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.304+0000 7fc9527d1740 1 Processor -- start 2023-11-04T01:41:55.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc9527d1740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403850 0x55907548bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc9527d1740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403c30 0x55907543ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc9527d1740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075419850 0x5590754189f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc9527d1740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559075406a50 con 0x559075403c30 2023-11-04T01:41:55.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc9527d1740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55907543b720 con 0x559075419850 2023-11-04T01:41:55.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc9527d1740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x559075406800 con 0x559075403850 2023-11-04T01:41:55.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc9527d1740 10 client.0 _ll_register_callbacks cb 0x7fc938054650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:55.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc94d0fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403c30 0x55907543ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc94d0fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403c30 0x55907543ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53034/0 (socket says 172.21.15.114:53034) 2023-11-04T01:41:55.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc94d0fc640 1 -- 172.21.15.114:0/2355812570 learned_addr learned my addr 172.21.15.114:0/2355812570 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:55.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/2355812570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403850 0x55907548bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc94e0fe640 1 --2- 172.21.15.114:0/2355812570 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075419850 0x5590754189f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc94d0fc640 1 -- 172.21.15.114:0/2355812570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403850 msgr2=0x55907548bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc94d0fc640 1 --2- 172.21.15.114:0/2355812570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403850 0x55907548bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc94d0fc640 1 -- 172.21.15.114:0/2355812570 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075419850 msgr2=0x5590754189f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc94d0fc640 1 --2- 172.21.15.114:0/2355812570 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075419850 0x5590754189f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc94d0fc640 1 -- 172.21.15.114:0/2355812570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559075304500 con 0x559075403c30 2023-11-04T01:41:55.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/2355812570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403850 0x55907548bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:55.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc94d0fc640 1 --2- 172.21.15.114:0/2355812570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403c30 0x55907543ad10 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fc9380584d0 tx=0x7fc9380047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711117996e061b18 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.305+0000 7fc928ff9640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:41:55.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.306+0000 7fc928ff9640 1 -- 172.21.15.114:0/2355812570 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938054a20 con 0x559075403c30 2023-11-04T01:41:55.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.306+0000 7fc928ff9640 1 -- 172.21.15.114:0/2355812570 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7fc938054b80 con 0x559075403c30 2023-11-04T01:41:55.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.306+0000 7fc9527d1740 1 -- 172.21.15.114:0/2355812570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc938060610 con 0x559075403c30 2023-11-04T01:41:55.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.306+0000 7fc928ff9640 1 -- 172.21.15.114:0/2355812570 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc938060180 con 0x559075403c30 2023-11-04T01:41:55.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.306+0000 7fc9527d1740 10 client.8169 fetch_fsmap learned FSMap version 79 2023-11-04T01:41:55.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.306+0000 7fc9527d1740 1 -- 172.21.15.114:0/2355812570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x5590752eb0d0 con 0x559075403c30 2023-11-04T01:41:55.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.306+0000 7fc928ff9640 1 -- 172.21.15.114:0/2355812570 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc938060610 con 0x559075403c30 2023-11-04T01:41:55.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.306+0000 7fc928ff9640 1 -- 172.21.15.114:0/2355812570 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 79) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fc93805e210 con 0x559075403c30 2023-11-04T01:41:55.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.306+0000 7fc9527d1740 10 client.8169 fetch_fsmap finished waiting for FSMap version 79 2023-11-04T01:41:55.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.306+0000 7fc9527d1740 10 client.8169 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:41:55.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.306+0000 7fc9527d1740 20 client.8169 populate_metadata read hostname 'smithi114' 2023-11-04T01:41:55.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.306+0000 7fc9527d1740 1 --2- 172.21.15.114:0/2355812570 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x5590753d54f0 0x5590753d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.306+0000 7fc9527d1740 4 client.8169 mds_command: new command op to 6298 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:41:55.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.306+0000 7fc9527d1740 1 -- 172.21.15.114:0/2355812570 --> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55907533b5b0 con 0x5590753d54f0 2023-11-04T01:41:55.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.306+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/2355812570 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x5590753d54f0 0x5590753d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc928ff9640 10 client.8169 ms_handle_connect on v2:172.21.15.141:6832/1296600989 2023-11-04T01:41:55.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc94d8fd640 1 --2- 172.21.15.114:0/2355812570 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x5590753d54f0 0x5590753d58d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c9c951add90105c5 server_cookie=18d2e2ba16fb12e1 in_seq=0 out_seq=0 2023-11-04T01:41:55.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc928ff9640 1 -- 172.21.15.114:0/2355812570 <== mds.1 v2:172.21.15.141:6832/1296600989 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55907533b5b0 con 0x5590753d54f0 2023-11-04T01:41:55.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc928ff9640 10 client.8169 handle_command_reply: tid=0 2023-11-04T01:41:55.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc9527d1740 1 client.8169 shutdown 2023-11-04T01:41:55.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc9527d1740 1 -- 172.21.15.114:0/2355812570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403c30 msgr2=0x55907543ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc9527d1740 1 --2- 172.21.15.114:0/2355812570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403c30 0x55907543ad10 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fc9380584d0 tx=0x7fc9380047e0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc9527d1740 1 -- 172.21.15.114:0/2355812570 shutdown_connections 2023-11-04T01:41:55.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc9527d1740 1 --2- 172.21.15.114:0/2355812570 >> [v2:172.21.15.141:6832/1296600989,v1:172.21.15.141:6834/1296600989] conn(0x5590753d54f0 0x5590753d58d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc9527d1740 1 --2- 172.21.15.114:0/2355812570 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x559075419850 0x5590754189f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc928ff9640 0 client.8169 ms_handle_reset on v2:172.21.15.141:6832/1296600989 2023-11-04T01:41:55.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc9527d1740 1 --2- 172.21.15.114:0/2355812570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559075403c30 0x55907543ad10 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc9527d1740 1 --2- 172.21.15.114:0/2355812570 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x559075403850 0x55907548bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc9527d1740 1 -- 172.21.15.114:0/2355812570 >> 172.21.15.114:0/2355812570 conn(0x5590753d6c90 msgr2=0x559075406060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc9527d1740 1 -- 172.21.15.114:0/2355812570 shutdown_connections 2023-11-04T01:41:55.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc9527d1740 1 -- 172.21.15.114:0/2355812570 wait complete. 2023-11-04T01:41:55.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.307+0000 7fc9527d1740 20 client.8169 trim_cache size 0 max 16384 2023-11-04T01:41:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:41:55.317 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:41:55.317 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 1, 2023-11-04T01:41:55.317 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 6298, 2023-11-04T01:41:55.317 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:41:55.317 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:41:55.317 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:41:55.317 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 114.73339337100001, 2023-11-04T01:41:55.317 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 79, 2023-11-04T01:41:55.317 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 102, 2023-11-04T01:41:55.318 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 102, 2023-11-04T01:41:55.318 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 129.30575548900001 2023-11-04T01:41:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:41:55.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.308+0000 7fc94fb61640 1 -- 172.21.15.114:0/3224081876 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc92c06aea0 msgr2=0x7fc92c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.308+0000 7fc94fb61640 1 --2- 172.21.15.114:0/3224081876 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc92c06aea0 0x7fc92c06d360 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc944007380 tx=0x7fc94400b040 comp rx=0 tx=0).stop 2023-11-04T01:41:55.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.308+0000 7fc94fb61640 1 -- 172.21.15.114:0/3224081876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480c81b0 msgr2=0x7fc9480b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.308+0000 7fc94fb61640 1 --2- 172.21.15.114:0/3224081876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480c81b0 0x7fc9480b4720 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fc93800eb20 tx=0x7fc938005e30 comp rx=0 tx=0).stop 2023-11-04T01:41:55.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.308+0000 7fc94fb61640 1 -- 172.21.15.114:0/3224081876 shutdown_connections 2023-11-04T01:41:55.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.308+0000 7fc94fb61640 1 --2- 172.21.15.114:0/3224081876 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc948150510 0x7fc9480b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.308+0000 7fc94fb61640 1 --2- 172.21.15.114:0/3224081876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480c81b0 0x7fc9480b4720 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.308+0000 7fc94fb61640 1 --2- 172.21.15.114:0/3224081876 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc92c06aea0 0x7fc92c06d360 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.308+0000 7fc94fb61640 1 --2- 172.21.15.114:0/3224081876 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc948150130 0x7fc9480c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.308+0000 7fc94fb61640 1 -- 172.21.15.114:0/3224081876 >> 172.21.15.114:0/3224081876 conn(0x7fc94806ea20 msgr2=0x7fc9480cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.308+0000 7fc94fb61640 1 -- 172.21.15.114:0/3224081876 shutdown_connections 2023-11-04T01:41:55.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.308+0000 7fc94fb61640 1 -- 172.21.15.114:0/3224081876 wait complete. 2023-11-04T01:41:55.320 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:41:55.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.419+0000 7f86813c5640 1 Processor -- start 2023-11-04T01:41:55.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.419+0000 7f86813c5640 1 -- start start 2023-11-04T01:41:55.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.420+0000 7f86813c5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f867c0cd6d0 0x7f867c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.420+0000 7f86813c5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f867c0b4880 0x7f867c0b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.420+0000 7f86813c5640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c0cde60 con 0x7f867c153e60 2023-11-04T01:41:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.420+0000 7f86813c5640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c160f90 con 0x7f867c0b4880 2023-11-04T01:41:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.420+0000 7f86813c5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0b51e0 con 0x7f867c0cd6d0 2023-11-04T01:41:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.420+0000 7f867a7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f867c0cd6d0 0x7f867c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.421+0000 7f867b7fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f867c0b4880 0x7f867c0b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.421+0000 7f867b7fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f867c0b4880 0x7f867c0b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:49622/0 (socket says 172.21.15.114:49622) 2023-11-04T01:41:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.421+0000 7f867b7fe640 1 -- 172.21.15.114:0/2505112942 learned_addr learned my addr 172.21.15.114:0/2505112942 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.421+0000 7f867affd640 1 --1- 172.21.15.114:0/2505112942 >> v1:172.21.15.141:6789/0 conn(0x7f867c153e60 0x7f867c15dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:42056/0 (socket says 172.21.15.114:42056) 2023-11-04T01:41:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.421+0000 7f867a7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f867c0cd6d0 0x7f867c161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:44510/0 (socket says 172.21.15.114:44510) 2023-11-04T01:41:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.421+0000 7f867b7fe640 1 -- 172.21.15.114:0/2505112942 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f867c0cd6d0 msgr2=0x7f867c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.421+0000 7f867b7fe640 1 --2- 172.21.15.114:0/2505112942 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f867c0cd6d0 0x7f867c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.421+0000 7f867b7fe640 1 -- 172.21.15.114:0/2505112942 >> v1:172.21.15.141:6789/0 conn(0x7f867c153e60 legacy=0x7f867c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.421+0000 7f867b7fe640 1 -- 172.21.15.114:0/2505112942 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c161960 con 0x7f867c0b4880 2023-11-04T01:41:55.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.421+0000 7f867a7fc640 1 --2- 172.21.15.114:0/2505112942 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f867c0cd6d0 0x7f867c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:55.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.422+0000 7f867b7fe640 1 --2- 172.21.15.114:0/2505112942 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f867c0b4880 0x7f867c0b4ca0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8674009870 tx=0x7f867402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f57eec7ce9b82116 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.422+0000 7f8679ffb640 1 -- 172.21.15.114:0/2505112942 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674030840 con 0x7f867c0b4880 2023-11-04T01:41:55.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.422+0000 7f8679ffb640 1 -- 172.21.15.114:0/2505112942 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86740309a0 con 0x7f867c0b4880 2023-11-04T01:41:55.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.422+0000 7f8679ffb640 1 -- 172.21.15.114:0/2505112942 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674030d30 con 0x7f867c0b4880 2023-11-04T01:41:55.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.422+0000 7f86813c5640 1 -- 172.21.15.114:0/2505112942 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f867c0b4880 msgr2=0x7f867c0b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.422+0000 7f86813c5640 1 --2- 172.21.15.114:0/2505112942 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f867c0b4880 0x7f867c0b4ca0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8674009870 tx=0x7f867402b980 comp rx=0 tx=0).stop 2023-11-04T01:41:55.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.422+0000 7f86813c5640 1 -- 172.21.15.114:0/2505112942 shutdown_connections 2023-11-04T01:41:55.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.422+0000 7f86813c5640 1 --2- 172.21.15.114:0/2505112942 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f867c0b4880 0x7f867c0b4ca0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.422+0000 7f86813c5640 1 --2- 172.21.15.114:0/2505112942 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f867c0cd6d0 0x7f867c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.422+0000 7f86813c5640 1 -- 172.21.15.114:0/2505112942 >> 172.21.15.114:0/2505112942 conn(0x7f867c0cf880 msgr2=0x7f867c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.422+0000 7f86813c5640 1 -- 172.21.15.114:0/2505112942 shutdown_connections 2023-11-04T01:41:55.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.422+0000 7f86813c5640 1 -- 172.21.15.114:0/2505112942 wait complete. 2023-11-04T01:41:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.424+0000 7f86813c5640 1 Processor -- start 2023-11-04T01:41:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.424+0000 7f86813c5640 1 -- start start 2023-11-04T01:41:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.424+0000 7f86813c5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867c0b4880 0x7f867c1534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.424+0000 7f86813c5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f867c0cd6d0 0x7f867c1f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.424+0000 7f86813c5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f867c153e60 0x7f867c0cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.424+0000 7f86813c5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0c7630 con 0x7f867c0b4880 2023-11-04T01:41:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f86813c5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0c6a20 con 0x7f867c153e60 2023-11-04T01:41:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f86813c5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0c6d00 con 0x7f867c0cd6d0 2023-11-04T01:41:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f867affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867c0b4880 0x7f867c1534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f867affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867c0b4880 0x7f867c1534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53044/0 (socket says 172.21.15.114:53044) 2023-11-04T01:41:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f867affd640 1 -- 172.21.15.114:0/828113360 learned_addr learned my addr 172.21.15.114:0/828113360 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f867a7fc640 1 --2- 172.21.15.114:0/828113360 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f867c0cd6d0 0x7f867c1f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f867b7fe640 1 --2- 172.21.15.114:0/828113360 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f867c153e60 0x7f867c0cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f867affd640 1 -- 172.21.15.114:0/828113360 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f867c0cd6d0 msgr2=0x7f867c1f39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f867affd640 1 --2- 172.21.15.114:0/828113360 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f867c0cd6d0 0x7f867c1f39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f867affd640 1 -- 172.21.15.114:0/828113360 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f867c153e60 msgr2=0x7f867c0cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f867affd640 1 --2- 172.21.15.114:0/828113360 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f867c153e60 0x7f867c0cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f867affd640 1 -- 172.21.15.114:0/828113360 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8670009400 con 0x7f867c0b4880 2023-11-04T01:41:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f867affd640 1 --2- 172.21.15.114:0/828113360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867c0b4880 0x7f867c1534c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f866c00c7a0 tx=0x7f866c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f86637fe640 1 -- 172.21.15.114:0/828113360 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c00a640 con 0x7f867c0b4880 2023-11-04T01:41:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f86637fe640 1 -- 172.21.15.114:0/828113360 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c00a7a0 con 0x7f867c0b4880 2023-11-04T01:41:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f86813c5640 1 -- 172.21.15.114:0/828113360 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86740094d0 con 0x7f867c0b4880 2023-11-04T01:41:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f86637fe640 1 -- 172.21.15.114:0/828113360 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c00ab10 con 0x7f867c0b4880 2023-11-04T01:41:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.425+0000 7f86813c5640 1 -- 172.21.15.114:0/828113360 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c0c72c0 con 0x7f867c0b4880 2023-11-04T01:41:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.427+0000 7f86637fe640 1 -- 172.21.15.114:0/828113360 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f866c00ac70 con 0x7f867c0b4880 2023-11-04T01:41:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.427+0000 7f86637fe640 1 --2- 172.21.15.114:0/828113360 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f866806ae70 0x7f866806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.427+0000 7f86637fe640 1 -- 172.21.15.114:0/828113360 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f866c0893e0 con 0x7f867c0b4880 2023-11-04T01:41:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.427+0000 7f867a7fc640 1 --2- 172.21.15.114:0/828113360 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f866806ae70 0x7f866806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.428+0000 7f867a7fc640 1 --2- 172.21.15.114:0/828113360 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f866806ae70 0x7f866806d330 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f867c1576e0 tx=0x7f8670008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.428+0000 7f8684031740 1 Processor -- start 2023-11-04T01:41:55.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.428+0000 7f8684031740 1 -- start start 2023-11-04T01:41:55.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.429+0000 7f8684031740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dbb850 0x55d8b8d8e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.429+0000 7f8684031740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dbbc30 0x55d8b8dbe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.429+0000 7f8684031740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8d8ec90 0x55d8b8dbeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.429+0000 7f8684031740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b8c9f740 con 0x55d8b8d8ec90 2023-11-04T01:41:55.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.429+0000 7f8684031740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b8d018d0 con 0x55d8b8dbb850 2023-11-04T01:41:55.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.429+0000 7f8684031740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8b8cfefc0 con 0x55d8b8dbbc30 2023-11-04T01:41:55.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.429+0000 7f867b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8d8ec90 0x55d8b8dbeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.429+0000 7f867b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8d8ec90 0x55d8b8dbeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53058/0 (socket says 172.21.15.114:53058) 2023-11-04T01:41:55.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.429+0000 7f867b7fe640 1 -- 172.21.15.114:0/2447858997 learned_addr learned my addr 172.21.15.114:0/2447858997 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:55.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.429+0000 7f867b7fe640 1 -- 172.21.15.114:0/2447858997 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dbbc30 msgr2=0x55d8b8dbe5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.429+0000 7f867b7fe640 1 --2- 172.21.15.114:0/2447858997 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dbbc30 0x55d8b8dbe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.429+0000 7f867b7fe640 1 -- 172.21.15.114:0/2447858997 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dbb850 msgr2=0x55d8b8d8e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.429+0000 7f867b7fe640 1 --2- 172.21.15.114:0/2447858997 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dbb850 0x55d8b8d8e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.429+0000 7f867b7fe640 1 -- 172.21.15.114:0/2447858997 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8b8cbdca0 con 0x55d8b8d8ec90 2023-11-04T01:41:55.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.429+0000 7f867b7fe640 1 --2- 172.21.15.114:0/2447858997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8d8ec90 0x55d8b8dbeb20 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f8674009870 tx=0x7f8674030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675fd03c6942d945 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.430+0000 7f8660ff9640 1 -- 172.21.15.114:0/2447858997 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674030840 con 0x55d8b8d8ec90 2023-11-04T01:41:55.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.430+0000 7f8660ff9640 1 -- 172.21.15.114:0/2447858997 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8674030d10 con 0x55d8b8d8ec90 2023-11-04T01:41:55.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.430+0000 7f8660ff9640 1 -- 172.21.15.114:0/2447858997 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674039650 con 0x55d8b8d8ec90 2023-11-04T01:41:55.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.430+0000 7f8684031740 1 -- 172.21.15.114:0/2447858997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8d8ec90 msgr2=0x55d8b8dbeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.430+0000 7f8684031740 1 --2- 172.21.15.114:0/2447858997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8d8ec90 0x55d8b8dbeb20 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f8674009870 tx=0x7f8674030000 comp rx=0 tx=0).stop 2023-11-04T01:41:55.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.430+0000 7f8684031740 1 -- 172.21.15.114:0/2447858997 shutdown_connections 2023-11-04T01:41:55.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.430+0000 7f8684031740 1 --2- 172.21.15.114:0/2447858997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8d8ec90 0x55d8b8dbeb20 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.430+0000 7f8684031740 1 --2- 172.21.15.114:0/2447858997 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dbbc30 0x55d8b8dbe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.430+0000 7f8684031740 1 --2- 172.21.15.114:0/2447858997 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dbb850 0x55d8b8d8e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.430+0000 7f8684031740 1 -- 172.21.15.114:0/2447858997 >> 172.21.15.114:0/2447858997 conn(0x55d8b8d90a60 msgr2=0x55d8b8dd95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.430+0000 7f8684031740 1 -- 172.21.15.114:0/2447858997 shutdown_connections 2023-11-04T01:41:55.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.430+0000 7f8684031740 1 -- 172.21.15.114:0/2447858997 wait complete. 2023-11-04T01:41:55.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.431+0000 7f8684031740 1 -- start start 2023-11-04T01:41:55.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.431+0000 7f8684031740 1 Processor -- start 2023-11-04T01:41:55.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f8684031740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dbb850 0x55d8b8dd2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f8684031740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbbc30 0x55d8b8dd1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f8684031740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dafd40 0x55d8b8de9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f8684031740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b8cfa8b0 con 0x55d8b8dbbc30 2023-11-04T01:41:55.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f8684031740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b8cb4c80 con 0x55d8b8dbb850 2023-11-04T01:41:55.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f8684031740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8b8cb4920 con 0x55d8b8dafd40 2023-11-04T01:41:55.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f8684031740 10 client.0 _ll_register_callbacks cb 0x55d8b8a0cac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:55.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f867a7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbbc30 0x55d8b8dd1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f867a7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbbc30 0x55d8b8dd1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53062/0 (socket says 172.21.15.114:53062) 2023-11-04T01:41:55.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f867a7fc640 1 -- 172.21.15.114:0/3398530194 learned_addr learned my addr 172.21.15.114:0/3398530194 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:55.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f867affd640 1 --2- 172.21.15.114:0/3398530194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dbb850 0x55d8b8dd2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f867b7fe640 1 --2- 172.21.15.114:0/3398530194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dafd40 0x55d8b8de9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f867a7fc640 1 -- 172.21.15.114:0/3398530194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dafd40 msgr2=0x55d8b8de9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f867a7fc640 1 --2- 172.21.15.114:0/3398530194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dafd40 0x55d8b8de9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f867a7fc640 1 -- 172.21.15.114:0/3398530194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dbb850 msgr2=0x55d8b8dd2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f867a7fc640 1 --2- 172.21.15.114:0/3398530194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dbb850 0x55d8b8dd2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f867a7fc640 1 -- 172.21.15.114:0/3398530194 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c161960 con 0x55d8b8dbbc30 2023-11-04T01:41:55.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f867a7fc640 1 --2- 172.21.15.114:0/3398530194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbbc30 0x55d8b8dd1160 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f8670015750 tx=0x7f8670009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce76661ac47c776d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.432+0000 7f8659ffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:41:55.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f8659ffb640 1 -- 172.21.15.114:0/3398530194 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86700147e0 con 0x55d8b8dbbc30 2023-11-04T01:41:55.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f8659ffb640 1 -- 172.21.15.114:0/3398530194 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f8670014940 con 0x55d8b8dbbc30 2023-11-04T01:41:55.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f8684031740 1 -- 172.21.15.114:0/3398530194 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8b8ca6bf0 con 0x55d8b8dbbc30 2023-11-04T01:41:55.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f8659ffb640 1 -- 172.21.15.114:0/3398530194 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8670014b00 con 0x55d8b8dbbc30 2023-11-04T01:41:55.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f8684031740 10 client.8178 fetch_fsmap learned FSMap version 79 2023-11-04T01:41:55.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f8684031740 1 -- 172.21.15.114:0/3398530194 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x55d8b8cf8f30 con 0x55d8b8dbbc30 2023-11-04T01:41:55.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f8659ffb640 1 -- 172.21.15.114:0/3398530194 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8b8ca6bf0 con 0x55d8b8dbbc30 2023-11-04T01:41:55.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f8659ffb640 1 -- 172.21.15.114:0/3398530194 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 79) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f8670014c60 con 0x55d8b8dbbc30 2023-11-04T01:41:55.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f8684031740 10 client.8178 fetch_fsmap finished waiting for FSMap version 79 2023-11-04T01:41:55.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f8684031740 10 client.8178 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:41:55.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f8684031740 20 client.8178 populate_metadata read hostname 'smithi114' 2023-11-04T01:41:55.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f8684031740 1 --2- 172.21.15.114:0/3398530194 >> [v2:172.21.15.114:6834/1629274449,v1:172.21.15.114:6836/1629274449] conn(0x55d8b8dc0620 0x55d8b8dc0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f8684031740 4 client.8178 mds_command: new command op to 8013 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:41:55.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f8684031740 1 -- 172.21.15.114:0/3398530194 --> [v2:172.21.15.114:6834/1629274449,v1:172.21.15.114:6836/1629274449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8b8cf3890 con 0x55d8b8dc0620 2023-11-04T01:41:55.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f867affd640 1 --2- 172.21.15.114:0/3398530194 >> [v2:172.21.15.114:6834/1629274449,v1:172.21.15.114:6836/1629274449] conn(0x55d8b8dc0620 0x55d8b8dc0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f867affd640 1 --2- 172.21.15.114:0/3398530194 >> [v2:172.21.15.114:6834/1629274449,v1:172.21.15.114:6836/1629274449] conn(0x55d8b8dc0620 0x55d8b8dc0a00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=662b56e636008187 server_cookie=4a5900a0090d611c in_seq=0 out_seq=0 2023-11-04T01:41:55.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.433+0000 7f8659ffb640 10 client.8178 ms_handle_connect on v2:172.21.15.114:6834/1629274449 2023-11-04T01:41:55.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.434+0000 7f8659ffb640 1 -- 172.21.15.114:0/3398530194 <== mds.0 v2:172.21.15.114:6834/1629274449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d8b8cf3890 con 0x55d8b8dc0620 2023-11-04T01:41:55.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.434+0000 7f8659ffb640 10 client.8178 handle_command_reply: tid=0 2023-11-04T01:41:55.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.434+0000 7f8684031740 1 client.8178 shutdown 2023-11-04T01:41:55.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.434+0000 7f8684031740 1 -- 172.21.15.114:0/3398530194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbbc30 msgr2=0x55d8b8dd1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.434+0000 7f8684031740 1 --2- 172.21.15.114:0/3398530194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbbc30 0x55d8b8dd1160 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f8670015750 tx=0x7f8670009190 comp rx=0 tx=0).stop 2023-11-04T01:41:55.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.434+0000 7f8684031740 1 -- 172.21.15.114:0/3398530194 shutdown_connections 2023-11-04T01:41:55.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.434+0000 7f8684031740 1 --2- 172.21.15.114:0/3398530194 >> [v2:172.21.15.114:6834/1629274449,v1:172.21.15.114:6836/1629274449] conn(0x55d8b8dc0620 0x55d8b8dc0a00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.434+0000 7f8684031740 1 --2- 172.21.15.114:0/3398530194 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dafd40 0x55d8b8de9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.434+0000 7f8659ffb640 0 client.8178 ms_handle_reset on v2:172.21.15.114:6834/1629274449 2023-11-04T01:41:55.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.434+0000 7f8684031740 1 --2- 172.21.15.114:0/3398530194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbbc30 0x55d8b8dd1160 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.434+0000 7f8684031740 1 --2- 172.21.15.114:0/3398530194 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dbb850 0x55d8b8dd2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.434+0000 7f8684031740 1 -- 172.21.15.114:0/3398530194 >> 172.21.15.114:0/3398530194 conn(0x55d8b8d8ec90 msgr2=0x55d8b8ddd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.434+0000 7f8684031740 1 -- 172.21.15.114:0/3398530194 shutdown_connections 2023-11-04T01:41:55.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.434+0000 7f8684031740 1 -- 172.21.15.114:0/3398530194 wait complete. 2023-11-04T01:41:55.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.434+0000 7f8684031740 20 client.8178 trim_cache size 0 max 16384 2023-11-04T01:41:55.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.450+0000 7f8684031740 1 Processor -- start 2023-11-04T01:41:55.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.450+0000 7f8684031740 1 -- start start 2023-11-04T01:41:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f8684031740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dafd40 0x55d8b8daed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f8684031740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dbb850 0x55d8b8dbf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f8684031740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbbc30 0x55d8b8dbfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f8684031740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b8c7a280 con 0x55d8b8dbbc30 2023-11-04T01:41:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f8684031740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b8d92060 con 0x55d8b8dafd40 2023-11-04T01:41:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f8684031740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8b8ddc830 con 0x55d8b8dbb850 2023-11-04T01:41:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f867b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbbc30 0x55d8b8dbfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f867b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbbc30 0x55d8b8dbfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53064/0 (socket says 172.21.15.114:53064) 2023-11-04T01:41:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f867b7fe640 1 -- 172.21.15.114:0/4112990046 learned_addr learned my addr 172.21.15.114:0/4112990046 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f867b7fe640 1 -- 172.21.15.114:0/4112990046 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dbb850 msgr2=0x55d8b8dbf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f867b7fe640 1 --2- 172.21.15.114:0/4112990046 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dbb850 0x55d8b8dbf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f867b7fe640 1 -- 172.21.15.114:0/4112990046 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dafd40 msgr2=0x55d8b8daed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f867b7fe640 1 --2- 172.21.15.114:0/4112990046 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dafd40 0x55d8b8daed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f867b7fe640 1 -- 172.21.15.114:0/4112990046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8b8c96d10 con 0x55d8b8dbbc30 2023-11-04T01:41:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f867b7fe640 1 --2- 172.21.15.114:0/4112990046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbbc30 0x55d8b8dbfb10 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f8674009870 tx=0x7f8674009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c154d7724cc8f3c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f86617fa640 1 -- 172.21.15.114:0/4112990046 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674030e80 con 0x55d8b8dbbc30 2023-11-04T01:41:55.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f86617fa640 1 -- 172.21.15.114:0/4112990046 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8674004040 con 0x55d8b8dbbc30 2023-11-04T01:41:55.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.451+0000 7f86617fa640 1 -- 172.21.15.114:0/4112990046 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740043d0 con 0x55d8b8dbbc30 2023-11-04T01:41:55.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.452+0000 7f8684031740 1 -- 172.21.15.114:0/4112990046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbbc30 msgr2=0x55d8b8dbfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.452+0000 7f8684031740 1 --2- 172.21.15.114:0/4112990046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbbc30 0x55d8b8dbfb10 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f8674009870 tx=0x7f8674009240 comp rx=0 tx=0).stop 2023-11-04T01:41:55.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.452+0000 7f8684031740 1 -- 172.21.15.114:0/4112990046 shutdown_connections 2023-11-04T01:41:55.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.452+0000 7f8684031740 1 --2- 172.21.15.114:0/4112990046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbbc30 0x55d8b8dbfb10 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.452+0000 7f8684031740 1 --2- 172.21.15.114:0/4112990046 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dbb850 0x55d8b8dbf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.452+0000 7f8684031740 1 --2- 172.21.15.114:0/4112990046 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dafd40 0x55d8b8daed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.452+0000 7f8684031740 1 -- 172.21.15.114:0/4112990046 >> 172.21.15.114:0/4112990046 conn(0x55d8b8d8ec90 msgr2=0x55d8b8d923f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.452+0000 7f8684031740 1 -- 172.21.15.114:0/4112990046 shutdown_connections 2023-11-04T01:41:55.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.452+0000 7f8684031740 1 -- 172.21.15.114:0/4112990046 wait complete. 2023-11-04T01:41:55.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.452+0000 7f8684031740 1 -- start start 2023-11-04T01:41:55.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.452+0000 7f8684031740 1 Processor -- start 2023-11-04T01:41:55.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f8684031740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dafd40 0x55d8b8e3dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f8684031740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbb850 0x55d8b8dda830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f8684031740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dbbc30 0x55d8b8df2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f8684031740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b8ddb180 con 0x55d8b8dbb850 2023-11-04T01:41:55.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f8684031740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8b8e3e400 con 0x55d8b8dbbc30 2023-11-04T01:41:55.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f8684031740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8b8dd1300 con 0x55d8b8dafd40 2023-11-04T01:41:55.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f8684031740 10 client.0 _ll_register_callbacks cb 0x7f8670009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:55.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f867a7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbb850 0x55d8b8dda830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f867a7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbb850 0x55d8b8dda830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53080/0 (socket says 172.21.15.114:53080) 2023-11-04T01:41:55.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f867a7fc640 1 -- 172.21.15.114:0/3395463686 learned_addr learned my addr 172.21.15.114:0/3395463686 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:55.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f867b7fe640 1 --2- 172.21.15.114:0/3395463686 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dbbc30 0x55d8b8df2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f867affd640 1 --2- 172.21.15.114:0/3395463686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dafd40 0x55d8b8e3dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f867a7fc640 1 -- 172.21.15.114:0/3395463686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dafd40 msgr2=0x55d8b8e3dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f867a7fc640 1 --2- 172.21.15.114:0/3395463686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dafd40 0x55d8b8e3dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f867a7fc640 1 -- 172.21.15.114:0/3395463686 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dbbc30 msgr2=0x55d8b8df2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f867a7fc640 1 --2- 172.21.15.114:0/3395463686 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dbbc30 0x55d8b8df2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f867a7fc640 1 -- 172.21.15.114:0/3395463686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8b8cbdca0 con 0x55d8b8dbb850 2023-11-04T01:41:55.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.453+0000 7f867b7fe640 1 --2- 172.21.15.114:0/3395463686 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dbbc30 0x55d8b8df2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:55.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f867a7fc640 1 --2- 172.21.15.114:0/3395463686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbb850 0x55d8b8dda830 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f86700144b0 tx=0x7f8670016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636890613e1d0d40 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f8659ffb640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:41:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f8659ffb640 1 -- 172.21.15.114:0/3395463686 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670004640 con 0x55d8b8dbb850 2023-11-04T01:41:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f8659ffb640 1 -- 172.21.15.114:0/3395463686 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f86700098b0 con 0x55d8b8dbb850 2023-11-04T01:41:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f8684031740 1 -- 172.21.15.114:0/3395463686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8674030d10 con 0x55d8b8dbb850 2023-11-04T01:41:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f8659ffb640 1 -- 172.21.15.114:0/3395463686 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8670011b40 con 0x55d8b8dbb850 2023-11-04T01:41:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f8684031740 10 client.8184 fetch_fsmap learned FSMap version 79 2023-11-04T01:41:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f8684031740 1 -- 172.21.15.114:0/3395463686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x55d8b8cbc500 con 0x55d8b8dbb850 2023-11-04T01:41:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f8659ffb640 1 -- 172.21.15.114:0/3395463686 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8674030d10 con 0x55d8b8dbb850 2023-11-04T01:41:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f8659ffb640 1 -- 172.21.15.114:0/3395463686 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 79) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f8670005990 con 0x55d8b8dbb850 2023-11-04T01:41:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f8684031740 10 client.8184 fetch_fsmap finished waiting for FSMap version 79 2023-11-04T01:41:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f8684031740 10 client.8184 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:41:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f8684031740 20 client.8184 populate_metadata read hostname 'smithi114' 2023-11-04T01:41:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f8684031740 1 --2- 172.21.15.114:0/3395463686 >> [v2:172.21.15.114:6834/1629274449,v1:172.21.15.114:6836/1629274449] conn(0x55d8b8d92440 0x55d8b8d92820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f8684031740 4 client.8184 mds_command: new command op to 8013 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:41:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f8684031740 1 -- 172.21.15.114:0/3395463686 --> [v2:172.21.15.114:6834/1629274449,v1:172.21.15.114:6836/1629274449] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d8b8cf35b0 con 0x55d8b8d92440 2023-11-04T01:41:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f867affd640 1 --2- 172.21.15.114:0/3395463686 >> [v2:172.21.15.114:6834/1629274449,v1:172.21.15.114:6836/1629274449] conn(0x55d8b8d92440 0x55d8b8d92820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f8659ffb640 10 client.8184 ms_handle_connect on v2:172.21.15.114:6834/1629274449 2023-11-04T01:41:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.454+0000 7f867affd640 1 --2- 172.21.15.114:0/3395463686 >> [v2:172.21.15.114:6834/1629274449,v1:172.21.15.114:6836/1629274449] conn(0x55d8b8d92440 0x55d8b8d92820 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78118aca2f198171 server_cookie=7dd9d16cd72319d8 in_seq=0 out_seq=0 2023-11-04T01:41:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f8659ffb640 1 -- 172.21.15.114:0/3395463686 <== mds.0 v2:172.21.15.114:6834/1629274449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55d8b8cf35b0 con 0x55d8b8d92440 2023-11-04T01:41:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f8659ffb640 10 client.8184 handle_command_reply: tid=0 2023-11-04T01:41:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f8684031740 1 client.8184 shutdown 2023-11-04T01:41:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f8684031740 1 -- 172.21.15.114:0/3395463686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbb850 msgr2=0x55d8b8dda830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f8684031740 1 --2- 172.21.15.114:0/3395463686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbb850 0x55d8b8dda830 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f86700144b0 tx=0x7f8670016000 comp rx=0 tx=0).stop 2023-11-04T01:41:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f8684031740 1 -- 172.21.15.114:0/3395463686 shutdown_connections 2023-11-04T01:41:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f8684031740 1 --2- 172.21.15.114:0/3395463686 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x55d8b8dbbc30 0x55d8b8df2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f8684031740 1 --2- 172.21.15.114:0/3395463686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d8b8dbb850 0x55d8b8dda830 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f8684031740 1 --2- 172.21.15.114:0/3395463686 >> [v2:172.21.15.114:6834/1629274449,v1:172.21.15.114:6836/1629274449] conn(0x55d8b8d92440 0x55d8b8d92820 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f8684031740 1 --2- 172.21.15.114:0/3395463686 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x55d8b8dafd40 0x55d8b8e3dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f8659ffb640 0 client.8184 ms_handle_reset on v2:172.21.15.114:6834/1629274449 2023-11-04T01:41:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f8684031740 1 -- 172.21.15.114:0/3395463686 >> 172.21.15.114:0/3395463686 conn(0x55d8b8d8ec90 msgr2=0x55d8b8d8d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f8684031740 1 -- 172.21.15.114:0/3395463686 shutdown_connections 2023-11-04T01:41:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f8684031740 1 -- 172.21.15.114:0/3395463686 wait complete. 2023-11-04T01:41:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f8684031740 20 client.8184 trim_cache size 0 max 16384 2023-11-04T01:41:55.466 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:41:55.466 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d683c50f-778a-409d-b3d8-acedf37b842d", 2023-11-04T01:41:55.466 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-11-04T01:41:55.466 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 8013, 2023-11-04T01:41:55.466 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-11-04T01:41:55.466 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-11-04T01:41:55.466 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-11-04T01:41:55.466 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 6.6947674450000001, 2023-11-04T01:41:55.466 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 79, 2023-11-04T01:41:55.466 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 102, 2023-11-04T01:41:55.466 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 102, 2023-11-04T01:41:55.466 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 32.533265030000003 2023-11-04T01:41:55.467 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:41:55.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f86813c5640 1 -- 172.21.15.114:0/828113360 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f866806ae70 msgr2=0x7f866806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f86813c5640 1 --2- 172.21.15.114:0/828113360 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f866806ae70 0x7f866806d330 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f867c1576e0 tx=0x7f8670008040 comp rx=0 tx=0).stop 2023-11-04T01:41:55.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f86813c5640 1 -- 172.21.15.114:0/828113360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867c0b4880 msgr2=0x7f867c1534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f86813c5640 1 --2- 172.21.15.114:0/828113360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867c0b4880 0x7f867c1534c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f866c00c7a0 tx=0x7f866c00cc60 comp rx=0 tx=0).stop 2023-11-04T01:41:55.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f86813c5640 1 -- 172.21.15.114:0/828113360 shutdown_connections 2023-11-04T01:41:55.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f86813c5640 1 --2- 172.21.15.114:0/828113360 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f866806ae70 0x7f866806d330 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f86813c5640 1 --2- 172.21.15.114:0/828113360 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f867c153e60 0x7f867c0cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f86813c5640 1 --2- 172.21.15.114:0/828113360 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f867c0cd6d0 0x7f867c1f39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f86813c5640 1 --2- 172.21.15.114:0/828113360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867c0b4880 0x7f867c1534c0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.455+0000 7f86813c5640 1 -- 172.21.15.114:0/828113360 >> 172.21.15.114:0/828113360 conn(0x7f867c0cf880 msgr2=0x7f867c0b67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.456+0000 7f86813c5640 1 -- 172.21.15.114:0/828113360 shutdown_connections 2023-11-04T01:41:55.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.456+0000 7f86813c5640 1 -- 172.21.15.114:0/828113360 wait complete. 2023-11-04T01:41:55.470 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:55.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.567+0000 7f24d1da9640 1 Processor -- start 2023-11-04T01:41:55.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.567+0000 7f24d1da9640 1 -- start start 2023-11-04T01:41:55.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.568+0000 7f24d1da9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f24cc0aec80 0x7f24cc0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.568+0000 7f24d1da9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f24cc0af060 0x7f24cc06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.568+0000 7f24d1da9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24cc06ef40 0x7f24cc0cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.568+0000 7f24d1da9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24cc155a40 con 0x7f24cc0aec80 2023-11-04T01:41:55.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.568+0000 7f24d1da9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24cc0b1590 con 0x7f24cc0af060 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.568+0000 7f24d1da9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc06a660 con 0x7f24cc06ef40 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.568+0000 7f24cb7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f24cc0aec80 0x7f24cc0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.568+0000 7f24cb7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f24cc0aec80 0x7f24cc0b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53086/0 (socket says 172.21.15.114:53086) 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.568+0000 7f24cb7fe640 1 -- 172.21.15.114:0/2534820963 learned_addr learned my addr 172.21.15.114:0/2534820963 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.568+0000 7f24cb7fe640 1 -- 172.21.15.114:0/2534820963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24cc06ef40 msgr2=0x7f24cc0cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.568+0000 7f24cb7fe640 1 --2- 172.21.15.114:0/2534820963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24cc06ef40 0x7f24cc0cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.568+0000 7f24cb7fe640 1 -- 172.21.15.114:0/2534820963 >> v2:172.21.15.141:3300/0 conn(0x7f24cc0af060 msgr2=0x7f24cc06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.568+0000 7f24cb7fe640 1 --2- 172.21.15.114:0/2534820963 >> v2:172.21.15.141:3300/0 conn(0x7f24cc0af060 0x7f24cc06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.568+0000 7f24cb7fe640 1 -- 172.21.15.114:0/2534820963 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc06a8e0 con 0x7f24cc0aec80 2023-11-04T01:41:55.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.569+0000 7f24cb7fe640 1 --2- 172.21.15.114:0/2534820963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24cc0aec80 0x7f24cc0b1fe0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f24cc0676d0 tx=0x7f24bc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652d459269b1823a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.569+0000 7f24ca7fc640 1 -- 172.21.15.114:0/2534820963 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc004230 con 0x7f24cc0aec80 2023-11-04T01:41:55.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.569+0000 7f24ca7fc640 1 -- 172.21.15.114:0/2534820963 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc004390 con 0x7f24cc0aec80 2023-11-04T01:41:55.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.569+0000 7f24ca7fc640 1 -- 172.21.15.114:0/2534820963 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc003810 con 0x7f24cc0aec80 2023-11-04T01:41:55.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.570+0000 7f24d1da9640 1 -- 172.21.15.114:0/2534820963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24cc0aec80 msgr2=0x7f24cc0b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.570+0000 7f24d1da9640 1 --2- 172.21.15.114:0/2534820963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24cc0aec80 0x7f24cc0b1fe0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f24cc0676d0 tx=0x7f24bc02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.570+0000 7f24d1da9640 1 -- 172.21.15.114:0/2534820963 shutdown_connections 2023-11-04T01:41:55.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.570+0000 7f24d1da9640 1 --2- 172.21.15.114:0/2534820963 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24cc06ef40 0x7f24cc0cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.570+0000 7f24d1da9640 1 --2- 172.21.15.114:0/2534820963 >> v2:172.21.15.141:3300/0 conn(0x7f24cc0af060 0x7f24cc06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.570+0000 7f24d1da9640 1 --2- 172.21.15.114:0/2534820963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24cc0aec80 0x7f24cc0b1fe0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.570+0000 7f24d1da9640 1 -- 172.21.15.114:0/2534820963 >> 172.21.15.114:0/2534820963 conn(0x7f24cc098d40 msgr2=0x7f24cc0cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.570+0000 7f24d1da9640 1 -- 172.21.15.114:0/2534820963 shutdown_connections 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.570+0000 7f24d1da9640 1 -- 172.21.15.114:0/2534820963 wait complete. 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.571+0000 7f24d1da9640 1 Processor -- start 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.571+0000 7f24d1da9640 1 -- start start 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.572+0000 7f24d1da9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24cc06ef40 0x7f24cc15d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.572+0000 7f24d1da9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24cc0aec80 0x7f24cc0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.572+0000 7f24d1da9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24cc0af060 0x7f24cc159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.572+0000 7f24d1da9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc0b3f40 con 0x7f24cc0af060 2023-11-04T01:41:55.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.572+0000 7f24d1da9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc154070 con 0x7f24cc0aec80 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.572+0000 7f24d1da9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc154350 con 0x7f24cc06ef40 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.572+0000 7f24cbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24cc0af060 0x7f24cc159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.572+0000 7f24cbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24cc0af060 0x7f24cc159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53088/0 (socket says 172.21.15.114:53088) 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.572+0000 7f24cbfff640 1 -- 172.21.15.114:0/2000434277 learned_addr learned my addr 172.21.15.114:0/2000434277 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.572+0000 7f24cb7fe640 1 --2- 172.21.15.114:0/2000434277 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24cc06ef40 0x7f24cc15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.572+0000 7f24caffd640 1 --2- 172.21.15.114:0/2000434277 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24cc0aec80 0x7f24cc0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.572+0000 7f24cbfff640 1 -- 172.21.15.114:0/2000434277 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24cc06ef40 msgr2=0x7f24cc15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.572+0000 7f24cbfff640 1 --2- 172.21.15.114:0/2000434277 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24cc06ef40 0x7f24cc15d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.572+0000 7f24cbfff640 1 -- 172.21.15.114:0/2000434277 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24cc0aec80 msgr2=0x7f24cc0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.572+0000 7f24cbfff640 1 --2- 172.21.15.114:0/2000434277 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24cc0aec80 0x7f24cc0cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.572+0000 7f24cbfff640 1 -- 172.21.15.114:0/2000434277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc009460 con 0x7f24cc0af060 2023-11-04T01:41:55.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.573+0000 7f24cbfff640 1 --2- 172.21.15.114:0/2000434277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24cc0af060 0x7f24cc159f90 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f24c400b970 tx=0x7f24c400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.573+0000 7f24b3fff640 1 -- 172.21.15.114:0/2000434277 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c400cb40 con 0x7f24cc0af060 2023-11-04T01:41:55.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.573+0000 7f24b3fff640 1 -- 172.21.15.114:0/2000434277 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c400ccc0 con 0x7f24cc0af060 2023-11-04T01:41:55.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.573+0000 7f24d1da9640 1 -- 172.21.15.114:0/2000434277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24cc0b4200 con 0x7f24cc0af060 2023-11-04T01:41:55.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.573+0000 7f24b3fff640 1 -- 172.21.15.114:0/2000434277 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c4014680 con 0x7f24cc0af060 2023-11-04T01:41:55.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.573+0000 7f24d1da9640 1 -- 172.21.15.114:0/2000434277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24cc15db70 con 0x7f24cc0af060 2023-11-04T01:41:55.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.574+0000 7f24d1da9640 1 -- 172.21.15.114:0/2000434277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24cc0b4720 con 0x7f24cc0af060 2023-11-04T01:41:55.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.574+0000 7f24b3fff640 1 -- 172.21.15.114:0/2000434277 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f24c401d3b0 con 0x7f24cc0af060 2023-11-04T01:41:55.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.575+0000 7f24b3fff640 1 --2- 172.21.15.114:0/2000434277 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24b806ae70 0x7f24b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.575+0000 7f24b3fff640 1 -- 172.21.15.114:0/2000434277 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f24c4089ce0 con 0x7f24cc0af060 2023-11-04T01:41:55.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.575+0000 7f24cb7fe640 1 --2- 172.21.15.114:0/2000434277 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24b806ae70 0x7f24b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.575+0000 7f24cb7fe640 1 --2- 172.21.15.114:0/2000434277 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24b806ae70 0x7f24b806d330 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f24bc035000 tx=0x7f24bc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.579+0000 7f24b3fff640 1 -- 172.21.15.114:0/2000434277 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f24cc0b4720 con 0x7f24cc0af060 2023-11-04T01:41:55.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.779+0000 7f24d1da9640 1 -- 172.21.15.114:0/2000434277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24cc0b4720 con 0x7f24cc0af060 2023-11-04T01:41:55.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.780+0000 7f24b3fff640 1 -- 172.21.15.114:0/2000434277 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f24cc0b4720 con 0x7f24cc0af060 2023-11-04T01:41:55.782 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.782 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":79,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:51.777191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8013,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8013":{"gid":8013,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:55.782 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 79 2023-11-04T01:41:55.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.782+0000 7f24d1da9640 1 -- 172.21.15.114:0/2000434277 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24b806ae70 msgr2=0x7f24b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.782+0000 7f24d1da9640 1 --2- 172.21.15.114:0/2000434277 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24b806ae70 0x7f24b806d330 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f24bc035000 tx=0x7f24bc008030 comp rx=0 tx=0).stop 2023-11-04T01:41:55.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.782+0000 7f24d1da9640 1 -- 172.21.15.114:0/2000434277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24cc0af060 msgr2=0x7f24cc159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.782+0000 7f24d1da9640 1 --2- 172.21.15.114:0/2000434277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24cc0af060 0x7f24cc159f90 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f24c400b970 tx=0x7f24c400be30 comp rx=0 tx=0).stop 2023-11-04T01:41:55.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.782+0000 7f24d1da9640 1 -- 172.21.15.114:0/2000434277 shutdown_connections 2023-11-04T01:41:55.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.782+0000 7f24d1da9640 1 --2- 172.21.15.114:0/2000434277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24cc0af060 0x7f24cc159f90 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.782+0000 7f24d1da9640 1 --2- 172.21.15.114:0/2000434277 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24b806ae70 0x7f24b806d330 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.782+0000 7f24d1da9640 1 --2- 172.21.15.114:0/2000434277 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f24cc0aec80 0x7f24cc0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.782+0000 7f24d1da9640 1 --2- 172.21.15.114:0/2000434277 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24cc06ef40 0x7f24cc15d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.782+0000 7f24d1da9640 1 -- 172.21.15.114:0/2000434277 >> 172.21.15.114:0/2000434277 conn(0x7f24cc098d40 msgr2=0x7f24cc0b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.782+0000 7f24d1da9640 1 -- 172.21.15.114:0/2000434277 shutdown_connections 2023-11-04T01:41:55.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:55.782+0000 7f24d1da9640 1 -- 172.21.15.114:0/2000434277 wait complete. 2023-11-04T01:41:55.794 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:41:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:{"last_snap":5,"last_created":5,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:40:15.002825+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:40:40.232732+0000","name":"s12","metadata":{}},{"snapid":4,"ino":1099511627777,"stamp":"2023-11-04T01:41:05.777702+0000","name":"s15","metadata":{}},{"snapid":5,"ino":1099511627777,"stamp":"2023-11-04T01:41:31.747439+0000","name":"s16","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:41:55.909 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 1, "last_snap": 5, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:40:15.002825+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:40:40.232732+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s15", "snapid": 4, "stamp": "2023-11-04T01:41:05.777702+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s16", "snapid": 5, "stamp": "2023-11-04T01:41:31.747439+0000" } ] } 2023-11-04T01:41:55.909 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:41:55.910 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:41:55.913 DEBUG:teuthology.orchestra.run.smithi141:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:41:55.960 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2023-11-04T01:41:55.960 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2023-11-04T01:41:55.961 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:41:55.961 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2023-11-04T01:41:55.961 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.961 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2023-11-04T01:41:55.961 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.961 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2023-11-04T01:41:55.961 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.961 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2023-11-04T01:41:55.961 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2023-11-04T01:41:55.961 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.961 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2023-11-04T01:41:55.961 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2023-11-04T01:41:55.961 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.962 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:41:55.962 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2023-11-04T01:41:55.962 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.962 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:41:55.962 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:41:55.962 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.962 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2023-11-04T01:41:55.962 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.962 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2023-11-04T01:41:55.962 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2023-11-04T01:41:55.962 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:41:55.962 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:41:55.962 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2023-11-04T01:41:55.963 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:41:55.963 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2023-11-04T01:41:55.963 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:41:55.963 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:41:55.963 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2023-11-04T01:41:55.963 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.963 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:41:55.963 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.963 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2023-11-04T01:41:55.963 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.964 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2023-11-04T01:41:55.964 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.964 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2023-11-04T01:41:55.964 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2023-11-04T01:41:55.964 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2023-11-04T01:41:55.964 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = "172.21.15.114,172.21.15.141,[v2:172.21.15.141:3301,v1:172.21.15.141:6790]" 2023-11-04T01:41:55.964 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = d683c50f-778a-409d-b3d8-acedf37b842d 2023-11-04T01:41:55.964 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.964 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2023-11-04T01:41:55.964 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2023-11-04T01:41:55.964 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.964 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2023-11-04T01:41:55.964 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2023-11-04T01:41:55.965 INFO:teuthology.orchestra.run.smithi114.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:41:55.965 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.965 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2023-11-04T01:41:55.965 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2023-11-04T01:41:55.965 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.965 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2023-11-04T01:41:55.965 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2023-11-04T01:41:55.965 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2023-11-04T01:41:55.965 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug trim objects = true 2023-11-04T01:41:55.965 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.965 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2023-11-04T01:41:55.965 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2023-11-04T01:41:55.965 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.966 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:41:55.966 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.966 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2023-11-04T01:41:55.966 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.966 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2023-11-04T01:41:55.966 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.966 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:41:55.966 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2023-11-04T01:41:55.966 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.966 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2023-11-04T01:41:55.966 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2023-11-04T01:41:55.966 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2023-11-04T01:41:55.966 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2023-11-04T01:41:55.967 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 20 2023-11-04T01:41:55.967 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 20 2023-11-04T01:41:55.967 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-11-04T01:41:55.967 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2023-11-04T01:41:55.967 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 10 2023-11-04T01:41:55.967 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:41:55.967 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2023-11-04T01:41:55.967 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:41:55.967 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:41:55.967 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2023-11-04T01:41:55.967 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2023-11-04T01:41:55.967 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.967 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2023-11-04T01:41:55.968 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-11-04T01:41:55.968 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2023-11-04T01:41:55.968 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2023-11-04T01:41:55.968 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2023-11-04T01:41:55.968 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:41:55.968 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:41:55.968 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2023-11-04T01:41:55.968 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.968 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2023-11-04T01:41:55.969 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-11-04T01:41:55.969 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2023-11-04T01:41:55.969 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2023-11-04T01:41:55.969 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2023-11-04T01:41:55.969 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2023-11-04T01:41:55.969 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2023-11-04T01:41:55.969 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:41:55.969 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2023-11-04T01:41:55.969 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2023-11-04T01:41:55.969 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:41:55.969 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.969 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:41:55.969 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:41:55.970 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:41:55.970 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.970 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:41:55.970 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:41:55.970 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:41:55.970 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.970 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2023-11-04T01:41:55.970 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:41:55.970 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.970 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:41:55.970 INFO:teuthology.orchestra.run.smithi114.stdout: mon op complaint time = 120 2023-11-04T01:41:55.970 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:55.971 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2023-11-04T01:41:55.971 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2023-11-04T01:41:55.971 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2023-11-04T01:41:55.971 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2023-11-04T01:41:55.971 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:41:55.971 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:41:55.971 INFO:teuthology.orchestra.run.smithi114.stdout: client mount timeout = 600 2023-11-04T01:41:55.971 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2023-11-04T01:41:55.971 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-11-04T01:41:55.971 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = "" 2023-11-04T01:41:55.971 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2023-11-04T01:41:55.971 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2023-11-04T01:41:55.971 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2023-11-04T01:41:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.b] 2023-11-04T01:41:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.c] 2023-11-04T01:41:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2023-11-04T01:41:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2023-11-04T01:41:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2023-11-04T01:41:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2023-11-04T01:41:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:[mds] 2023-11-04T01:41:55.972 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds = 20 2023-11-04T01:41:55.972 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds balancer = 20 2023-11-04T01:41:55.972 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-11-04T01:41:55.972 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug frag = True 2023-11-04T01:41:55.972 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug scatterstat = True 2023-11-04T01:41:55.972 INFO:teuthology.orchestra.run.smithi114.stdout: mds op complaint time = 180 2023-11-04T01:41:55.973 INFO:teuthology.orchestra.run.smithi114.stdout: mds verify scatter = True 2023-11-04T01:41:55.973 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2023-11-04T01:41:55.973 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2023-11-04T01:41:55.973 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2023-11-04T01:41:55.973 INFO:teuthology.orchestra.run.smithi114.stdout: mds_reconnect_timeout = 5 2023-11-04T01:41:55.973 INFO:teuthology.orchestra.run.smithi141.stdout:[global] 2023-11-04T01:41:55.974 INFO:teuthology.orchestra.run.smithi141.stdout: chdir = "" 2023-11-04T01:41:55.974 INFO:teuthology.orchestra.run.smithi141.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:41:55.974 INFO:teuthology.orchestra.run.smithi141.stdout: auth supported = cephx 2023-11-04T01:41:55.974 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.974 INFO:teuthology.orchestra.run.smithi141.stdout: filestore xattr use omap = true 2023-11-04T01:41:55.974 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.974 INFO:teuthology.orchestra.run.smithi141.stdout: mon clock drift allowed = 1.000 2023-11-04T01:41:55.974 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.974 INFO:teuthology.orchestra.run.smithi141.stdout: osd crush chooseleaf type = 0 2023-11-04T01:41:55.974 INFO:teuthology.orchestra.run.smithi141.stdout: auth debug = true 2023-11-04T01:41:55.974 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.974 INFO:teuthology.orchestra.run.smithi141.stdout: ms die on old message = true 2023-11-04T01:41:55.975 INFO:teuthology.orchestra.run.smithi141.stdout: ms die on bug = true 2023-11-04T01:41:55.975 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.975 INFO:teuthology.orchestra.run.smithi141.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:41:55.975 INFO:teuthology.orchestra.run.smithi141.stdout: mon pg warn max object skew = 0 2023-11-04T01:41:55.975 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.975 INFO:teuthology.orchestra.run.smithi141.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:41:55.975 INFO:teuthology.orchestra.run.smithi141.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:41:55.975 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.975 INFO:teuthology.orchestra.run.smithi141.stdout: osd pool default size = 2 2023-11-04T01:41:55.976 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.976 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd allow primary affinity = true 2023-11-04T01:41:55.976 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd allow pg remap = true 2023-11-04T01:41:55.976 INFO:teuthology.orchestra.run.smithi141.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:41:55.976 INFO:teuthology.orchestra.run.smithi141.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:41:55.976 INFO:teuthology.orchestra.run.smithi141.stdout: mon warn on no sortbitwise = false 2023-11-04T01:41:55.976 INFO:teuthology.orchestra.run.smithi141.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:41:55.976 INFO:teuthology.orchestra.run.smithi141.stdout: mon warn on too few osds = false 2023-11-04T01:41:55.976 INFO:teuthology.orchestra.run.smithi141.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:41:55.976 INFO:teuthology.orchestra.run.smithi141.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:41:55.976 INFO:teuthology.orchestra.run.smithi141.stdout: mon_allow_pool_size_one = true 2023-11-04T01:41:55.976 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.976 INFO:teuthology.orchestra.run.smithi141.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:41:55.977 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.977 INFO:teuthology.orchestra.run.smithi141.stdout: osd default data pool replay window = 5 2023-11-04T01:41:55.977 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.977 INFO:teuthology.orchestra.run.smithi141.stdout: mon allow pool delete = true 2023-11-04T01:41:55.977 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.977 INFO:teuthology.orchestra.run.smithi141.stdout: mon cluster log file level = debug 2023-11-04T01:41:55.977 INFO:teuthology.orchestra.run.smithi141.stdout: debug asserts on shutdown = true 2023-11-04T01:41:55.977 INFO:teuthology.orchestra.run.smithi141.stdout: mon health detail to clog = false 2023-11-04T01:41:55.977 INFO:teuthology.orchestra.run.smithi141.stdout: mon host = "172.21.15.114,172.21.15.141,[v2:172.21.15.141:3301,v1:172.21.15.141:6790]" 2023-11-04T01:41:55.977 INFO:teuthology.orchestra.run.smithi141.stdout: fsid = d683c50f-778a-409d-b3d8-acedf37b842d 2023-11-04T01:41:55.977 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.977 INFO:teuthology.orchestra.run.smithi141.stdout:[osd] 2023-11-04T01:41:55.977 INFO:teuthology.orchestra.run.smithi141.stdout: osd journal size = 100 2023-11-04T01:41:55.978 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.978 INFO:teuthology.orchestra.run.smithi141.stdout: osd scrub load threshold = 5.0 2023-11-04T01:41:55.978 INFO:teuthology.orchestra.run.smithi141.stdout: osd scrub max interval = 600 2023-11-04T01:41:55.978 INFO:teuthology.orchestra.run.smithi141.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:41:55.978 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.978 INFO:teuthology.orchestra.run.smithi141.stdout: osd recover clone overlap = true 2023-11-04T01:41:55.978 INFO:teuthology.orchestra.run.smithi141.stdout: osd recovery max chunk = 1048576 2023-11-04T01:41:55.978 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.978 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug shutdown = true 2023-11-04T01:41:55.978 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug op order = true 2023-11-04T01:41:55.978 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug verify stray on activate = true 2023-11-04T01:41:55.978 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug trim objects = true 2023-11-04T01:41:55.979 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.979 INFO:teuthology.orchestra.run.smithi141.stdout: osd open classes on start = true 2023-11-04T01:41:55.979 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug pg log writeout = true 2023-11-04T01:41:55.979 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.979 INFO:teuthology.orchestra.run.smithi141.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:41:55.979 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.979 INFO:teuthology.orchestra.run.smithi141.stdout: osd map max advance = 10 2023-11-04T01:41:55.979 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.979 INFO:teuthology.orchestra.run.smithi141.stdout: journal zero on create = true 2023-11-04T01:41:55.980 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.980 INFO:teuthology.orchestra.run.smithi141.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:41:55.980 INFO:teuthology.orchestra.run.smithi141.stdout: filestore apply finisher threads = 3 2023-11-04T01:41:55.980 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.980 INFO:teuthology.orchestra.run.smithi141.stdout: bdev debug aio = true 2023-11-04T01:41:55.980 INFO:teuthology.orchestra.run.smithi141.stdout: osd debug misdirected ops = true 2023-11-04T01:41:55.980 INFO:teuthology.orchestra.run.smithi141.stdout: bluestore block size = 96636764160 2023-11-04T01:41:55.980 INFO:teuthology.orchestra.run.smithi141.stdout: bluestore fsck on mount = True 2023-11-04T01:41:55.980 INFO:teuthology.orchestra.run.smithi141.stdout: debug bluefs = 20 2023-11-04T01:41:55.980 INFO:teuthology.orchestra.run.smithi141.stdout: debug bluestore = 20 2023-11-04T01:41:55.980 INFO:teuthology.orchestra.run.smithi141.stdout: debug ms = 1 2023-11-04T01:41:55.980 INFO:teuthology.orchestra.run.smithi141.stdout: debug osd = 20 2023-11-04T01:41:55.980 INFO:teuthology.orchestra.run.smithi141.stdout: debug rocksdb = 10 2023-11-04T01:41:55.981 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:41:55.981 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd full ratio = 0.9 2023-11-04T01:41:55.981 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:41:55.981 INFO:teuthology.orchestra.run.smithi141.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:41:55.981 INFO:teuthology.orchestra.run.smithi141.stdout: osd objectstore = bluestore 2023-11-04T01:41:55.981 INFO:teuthology.orchestra.run.smithi141.stdout: osd op complaint time = 180 2023-11-04T01:41:55.981 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.981 INFO:teuthology.orchestra.run.smithi141.stdout:[mgr] 2023-11-04T01:41:55.981 INFO:teuthology.orchestra.run.smithi141.stdout: debug ms = 1 2023-11-04T01:41:55.981 INFO:teuthology.orchestra.run.smithi141.stdout: debug mgr = 20 2023-11-04T01:41:55.981 INFO:teuthology.orchestra.run.smithi141.stdout: debug mon = 20 2023-11-04T01:41:55.981 INFO:teuthology.orchestra.run.smithi141.stdout: debug auth = 20 2023-11-04T01:41:55.982 INFO:teuthology.orchestra.run.smithi141.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:41:55.982 INFO:teuthology.orchestra.run.smithi141.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:41:55.982 INFO:teuthology.orchestra.run.smithi141.stdout: mgr/telemetry/nag = false 2023-11-04T01:41:55.982 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.982 INFO:teuthology.orchestra.run.smithi141.stdout:[mon] 2023-11-04T01:41:55.982 INFO:teuthology.orchestra.run.smithi141.stdout: debug ms = 1 2023-11-04T01:41:55.982 INFO:teuthology.orchestra.run.smithi141.stdout: debug mon = 20 2023-11-04T01:41:55.982 INFO:teuthology.orchestra.run.smithi141.stdout: debug paxos = 20 2023-11-04T01:41:55.982 INFO:teuthology.orchestra.run.smithi141.stdout: debug auth = 20 2023-11-04T01:41:55.982 INFO:teuthology.orchestra.run.smithi141.stdout: mon data avail warn = 5 2023-11-04T01:41:55.982 INFO:teuthology.orchestra.run.smithi141.stdout: mon mgr mkfs grace = 240 2023-11-04T01:41:55.982 INFO:teuthology.orchestra.run.smithi141.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:41:55.982 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd reporter subtree level = osd 2023-11-04T01:41:55.983 INFO:teuthology.orchestra.run.smithi141.stdout: mon osd prime pg temp = true 2023-11-04T01:41:55.983 INFO:teuthology.orchestra.run.smithi141.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:41:55.983 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.983 INFO:teuthology.orchestra.run.smithi141.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:41:55.983 INFO:teuthology.orchestra.run.smithi141.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:41:55.983 INFO:teuthology.orchestra.run.smithi141.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:41:55.983 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.983 INFO:teuthology.orchestra.run.smithi141.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:41:55.983 INFO:teuthology.orchestra.run.smithi141.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:41:55.983 INFO:teuthology.orchestra.run.smithi141.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:41:55.983 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.983 INFO:teuthology.orchestra.run.smithi141.stdout: # 1m isn't quite enough 2023-11-04T01:41:55.984 INFO:teuthology.orchestra.run.smithi141.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:41:55.984 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.984 INFO:teuthology.orchestra.run.smithi141.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:41:55.984 INFO:teuthology.orchestra.run.smithi141.stdout: mon op complaint time = 120 2023-11-04T01:41:55.984 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-11-04T01:41:55.984 INFO:teuthology.orchestra.run.smithi141.stdout:[client] 2023-11-04T01:41:55.984 INFO:teuthology.orchestra.run.smithi141.stdout: rgw cache enabled = true 2023-11-04T01:41:55.984 INFO:teuthology.orchestra.run.smithi141.stdout: rgw enable ops log = true 2023-11-04T01:41:55.984 INFO:teuthology.orchestra.run.smithi141.stdout: rgw enable usage log = true 2023-11-04T01:41:55.984 INFO:teuthology.orchestra.run.smithi141.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:41:55.984 INFO:teuthology.orchestra.run.smithi141.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:41:55.984 INFO:teuthology.orchestra.run.smithi141.stdout: client mount timeout = 600 2023-11-04T01:41:55.984 INFO:teuthology.orchestra.run.smithi141.stdout: debug client = 20 2023-11-04T01:41:55.985 INFO:teuthology.orchestra.run.smithi141.stdout: debug ms = 1 2023-11-04T01:41:55.985 INFO:teuthology.orchestra.run.smithi141.stdout: pid file = "" 2023-11-04T01:41:55.985 INFO:teuthology.orchestra.run.smithi141.stdout: rados mon op timeout = 900 2023-11-04T01:41:55.985 INFO:teuthology.orchestra.run.smithi141.stdout: rados osd op timeout = 900 2023-11-04T01:41:55.985 INFO:teuthology.orchestra.run.smithi141.stdout:[mon.a] 2023-11-04T01:41:55.985 INFO:teuthology.orchestra.run.smithi141.stdout:[mon.b] 2023-11-04T01:41:55.985 INFO:teuthology.orchestra.run.smithi141.stdout:[mon.c] 2023-11-04T01:41:55.985 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.a] 2023-11-04T01:41:55.985 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.c] 2023-11-04T01:41:55.985 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.b] 2023-11-04T01:41:55.985 INFO:teuthology.orchestra.run.smithi141.stdout:[mds.d] 2023-11-04T01:41:55.985 INFO:teuthology.orchestra.run.smithi141.stdout:[mds] 2023-11-04T01:41:55.985 INFO:teuthology.orchestra.run.smithi141.stdout: debug mds = 20 2023-11-04T01:41:55.985 INFO:teuthology.orchestra.run.smithi141.stdout: debug mds balancer = 20 2023-11-04T01:41:55.986 INFO:teuthology.orchestra.run.smithi141.stdout: debug ms = 1 2023-11-04T01:41:55.986 INFO:teuthology.orchestra.run.smithi141.stdout: mds debug frag = True 2023-11-04T01:41:55.986 INFO:teuthology.orchestra.run.smithi141.stdout: mds debug scatterstat = True 2023-11-04T01:41:55.986 INFO:teuthology.orchestra.run.smithi141.stdout: mds op complaint time = 180 2023-11-04T01:41:55.986 INFO:teuthology.orchestra.run.smithi141.stdout: mds verify scatter = True 2023-11-04T01:41:55.986 INFO:teuthology.orchestra.run.smithi141.stdout: osd op complaint time = 180 2023-11-04T01:41:55.986 INFO:teuthology.orchestra.run.smithi141.stdout: rados mon op timeout = 900 2023-11-04T01:41:55.986 INFO:teuthology.orchestra.run.smithi141.stdout: rados osd op timeout = 900 2023-11-04T01:41:55.986 INFO:teuthology.orchestra.run.smithi141.stdout: mds_reconnect_timeout = 5 2023-11-04T01:41:55.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:55.988 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir d1/dir/.snap/*) 2023-11-04T01:41:56.032 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=2, also kill snapclient 2023-11-04T01:41:56.033 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:56.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.129+0000 7fbfbc426640 1 Processor -- start 2023-11-04T01:41:56.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.129+0000 7fbfbc426640 1 -- start start 2023-11-04T01:41:56.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.130+0000 7fbfbc426640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfb4070700 0x7fbfb4164b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.130+0000 7fbfbc426640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb4071500 con 0x7fbfb40b0c40 2023-11-04T01:41:56.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.130+0000 7fbfbc426640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb415dae0 con 0x7fbfb4159e40 2023-11-04T01:41:56.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.130+0000 7fbfbc426640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb4070c60 con 0x7fbfb4070700 2023-11-04T01:41:56.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.130+0000 7fbfb99c1640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbfb40b0c40 0x7fbfb406fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49430/0 (socket says 172.21.15.114:49430) 2023-11-04T01:41:56.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.130+0000 7fbfb99c1640 1 -- 172.21.15.114:0/2681847314 learned_addr learned my addr 172.21.15.114:0/2681847314 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:56.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.130+0000 7fbfba9c3640 1 --2- 172.21.15.114:0/2681847314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfb4070700 0x7fbfb4164b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfb91c0640 1 -- 172.21.15.114:0/2681847314 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972284642 0 0) 0x7fbfb4071500 con 0x7fbfb40b0c40 2023-11-04T01:41:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfb91c0640 1 -- 172.21.15.114:0/2681847314 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfa0003520 con 0x7fbfb40b0c40 2023-11-04T01:41:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfb91c0640 1 -- 172.21.15.114:0/2681847314 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3383619930 0 0) 0x7fbfa0003520 con 0x7fbfb40b0c40 2023-11-04T01:41:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfb91c0640 1 -- 172.21.15.114:0/2681847314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfb4070700 msgr2=0x7fbfb4164b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfb91c0640 1 --2- 172.21.15.114:0/2681847314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfb4070700 0x7fbfb4164b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfb91c0640 1 -- 172.21.15.114:0/2681847314 >> v1:172.21.15.141:6789/0 conn(0x7fbfb4159e40 legacy=0x7fbfb40b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfb91c0640 1 -- 172.21.15.114:0/2681847314 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb4070f40 con 0x7fbfb40b0c40 2023-11-04T01:41:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfb91c0640 1 -- 172.21.15.114:0/2681847314 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fbfa4001670 con 0x7fbfb40b0c40 2023-11-04T01:41:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfb91c0640 1 -- 172.21.15.114:0/2681847314 >> v1:172.21.15.114:6789/0 conn(0x7fbfb40b0c40 legacy=0x7fbfb406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfb91c0640 1 --2- 172.21.15.114:0/2681847314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfb4070700 0x7fbfa00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfb91c0640 1 --2- 172.21.15.114:0/2681847314 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfa0003ee0 0x7fbfa00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfb91c0640 1 --2- 172.21.15.114:0/2681847314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa0004d00 0x7fbfa0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfb91c0640 1 -- 172.21.15.114:0/2681847314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb4070c60 con 0x7fbfa0004d00 2023-11-04T01:41:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfb91c0640 1 -- 172.21.15.114:0/2681847314 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa000ba90 con 0x7fbfa0003ee0 2023-11-04T01:41:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfb91c0640 1 -- 172.21.15.114:0/2681847314 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa000bc50 con 0x7fbfb4070700 2023-11-04T01:41:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfba1c2640 1 --2- 172.21.15.114:0/2681847314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfb4070700 0x7fbfa00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfba9c3640 1 --2- 172.21.15.114:0/2681847314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa0004d00 0x7fbfa0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfb99c1640 1 --2- 172.21.15.114:0/2681847314 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfa0003ee0 0x7fbfa00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfba9c3640 1 -- 172.21.15.114:0/2681847314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfb4070700 msgr2=0x7fbfa00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfba9c3640 1 --2- 172.21.15.114:0/2681847314 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfb4070700 0x7fbfa00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfba9c3640 1 -- 172.21.15.114:0/2681847314 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfa0003ee0 msgr2=0x7fbfa00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfba9c3640 1 --2- 172.21.15.114:0/2681847314 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfa0003ee0 0x7fbfa00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.131+0000 7fbfba9c3640 1 -- 172.21.15.114:0/2681847314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa0003520 con 0x7fbfa0004d00 2023-11-04T01:41:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.132+0000 7fbfba9c3640 1 --2- 172.21.15.114:0/2681847314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa0004d00 0x7fbfa0005180 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009ac0 tx=0x7fbfa00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be956d678e30a8bf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.132+0000 7fbfb91c0640 1 -- 172.21.15.114:0/2681847314 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac02c6b0 con 0x7fbfa0004d00 2023-11-04T01:41:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.132+0000 7fbfb91c0640 1 -- 172.21.15.114:0/2681847314 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac02c810 con 0x7fbfa0004d00 2023-11-04T01:41:56.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.132+0000 7fbfb91c0640 1 -- 172.21.15.114:0/2681847314 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac02cba0 con 0x7fbfa0004d00 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.133+0000 7fbfbc426640 1 -- 172.21.15.114:0/2681847314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa0004d00 msgr2=0x7fbfa0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.133+0000 7fbfbc426640 1 --2- 172.21.15.114:0/2681847314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa0004d00 0x7fbfa0005180 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009ac0 tx=0x7fbfa00057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.133+0000 7fbfba9c3640 1 -- 172.21.15.114:0/2681847314 reap_dead start 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.133+0000 7fbfbc426640 1 -- 172.21.15.114:0/2681847314 shutdown_connections 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.133+0000 7fbfbc426640 1 -- 172.21.15.114:0/2681847314 >> 172.21.15.114:0/2681847314 conn(0x7fbfb40cb530 msgr2=0x7fbfb40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.133+0000 7fbfbc426640 1 -- 172.21.15.114:0/2681847314 shutdown_connections 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.133+0000 7fbfbc426640 1 -- 172.21.15.114:0/2681847314 wait complete. 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.134+0000 7fbfbc426640 1 Processor -- start 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.134+0000 7fbfbc426640 1 -- start start 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfbc426640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfa0004d00 0x7fbfb41f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfbc426640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfb40cc680 0x7fbfb414c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfbc426640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfb414e880 0x7fbfb41f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfbc426640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb41f5e10 con 0x7fbfb414e880 2023-11-04T01:41:56.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfbc426640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb414b7c0 con 0x7fbfb40cc680 2023-11-04T01:41:56.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfbc426640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb40ccb60 con 0x7fbfa0004d00 2023-11-04T01:41:56.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfba9c3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfb414e880 0x7fbfb41f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfba9c3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfb414e880 0x7fbfb41f6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53114/0 (socket says 172.21.15.114:53114) 2023-11-04T01:41:56.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfba9c3640 1 -- 172.21.15.114:0/3101874586 learned_addr learned my addr 172.21.15.114:0/3101874586 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:56.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfba1c2640 1 --2- 172.21.15.114:0/3101874586 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfa0004d00 0x7fbfb41f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfb99c1640 1 --2- 172.21.15.114:0/3101874586 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfb40cc680 0x7fbfb414c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfba9c3640 1 -- 172.21.15.114:0/3101874586 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfa0004d00 msgr2=0x7fbfb41f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfba9c3640 1 --2- 172.21.15.114:0/3101874586 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfa0004d00 0x7fbfb41f1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfba9c3640 1 -- 172.21.15.114:0/3101874586 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfb40cc680 msgr2=0x7fbfb414c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfba9c3640 1 --2- 172.21.15.114:0/3101874586 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfb40cc680 0x7fbfb414c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfba9c3640 1 -- 172.21.15.114:0/3101874586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb40cce40 con 0x7fbfb414e880 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfb99c1640 1 --2- 172.21.15.114:0/3101874586 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfb40cc680 0x7fbfb414c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfba9c3640 1 --2- 172.21.15.114:0/3101874586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfb414e880 0x7fbfb41f6230 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009ac0 tx=0x7fbfac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfaaffd640 1 -- 172.21.15.114:0/3101874586 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac02c6b0 con 0x7fbfb414e880 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfaaffd640 1 -- 172.21.15.114:0/3101874586 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac003830 con 0x7fbfb414e880 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.135+0000 7fbfbc426640 1 -- 172.21.15.114:0/3101874586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb40cd120 con 0x7fbfb414e880 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.136+0000 7fbfaaffd640 1 -- 172.21.15.114:0/3101874586 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac003be0 con 0x7fbfb414e880 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.136+0000 7fbfbc426640 1 -- 172.21.15.114:0/3101874586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb41f23b0 con 0x7fbfb414e880 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.137+0000 7fbfbc426640 1 -- 172.21.15.114:0/3101874586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb41f5f50 con 0x7fbfb414e880 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.137+0000 7fbfaaffd640 1 -- 172.21.15.114:0/3101874586 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbfac003d40 con 0x7fbfb414e880 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.137+0000 7fbfaaffd640 1 --2- 172.21.15.114:0/3101874586 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbf9806ae70 0x7fbf9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.137+0000 7fbfaaffd640 1 -- 172.21.15.114:0/3101874586 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7fbfac0ab460 con 0x7fbfb414e880 2023-11-04T01:41:56.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.137+0000 7fbfba1c2640 1 --2- 172.21.15.114:0/3101874586 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbf9806ae70 0x7fbf9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.138+0000 7fbfba1c2640 1 --2- 172.21.15.114:0/3101874586 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbf9806ae70 0x7fbf9806d330 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0002010 tx=0x7fbfb0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.141+0000 7fbfaaffd640 1 -- 172.21.15.114:0/3101874586 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbfb41f5f50 con 0x7fbfb414e880 2023-11-04T01:41:56.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.340+0000 7fbfbc426640 1 -- 172.21.15.114:0/3101874586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbfb41f5f50 con 0x7fbfb414e880 2023-11-04T01:41:56.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.341+0000 7fbfaaffd640 1 -- 172.21.15.114:0/3101874586 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fbfb41f5f50 con 0x7fbfb414e880 2023-11-04T01:41:56.343 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:56.343 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":79,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:51.777191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8013,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8013":{"gid":8013,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:56.343 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 79 2023-11-04T01:41:56.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.343+0000 7fbfbc426640 1 -- 172.21.15.114:0/3101874586 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbf9806ae70 msgr2=0x7fbf9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.343+0000 7fbfbc426640 1 --2- 172.21.15.114:0/3101874586 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbf9806ae70 0x7fbf9806d330 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0002010 tx=0x7fbfb0009040 comp rx=0 tx=0).stop 2023-11-04T01:41:56.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.343+0000 7fbfbc426640 1 -- 172.21.15.114:0/3101874586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfb414e880 msgr2=0x7fbfb41f6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.343+0000 7fbfbc426640 1 --2- 172.21.15.114:0/3101874586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfb414e880 0x7fbfb41f6230 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009ac0 tx=0x7fbfac004730 comp rx=0 tx=0).stop 2023-11-04T01:41:56.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.343+0000 7fbfbc426640 1 -- 172.21.15.114:0/3101874586 shutdown_connections 2023-11-04T01:41:56.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.343+0000 7fbfbc426640 1 --2- 172.21.15.114:0/3101874586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfb414e880 0x7fbfb41f6230 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.343+0000 7fbfbc426640 1 --2- 172.21.15.114:0/3101874586 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbf9806ae70 0x7fbf9806d330 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.343+0000 7fbfbc426640 1 --2- 172.21.15.114:0/3101874586 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbfb40cc680 0x7fbfb414c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.343+0000 7fbfbc426640 1 --2- 172.21.15.114:0/3101874586 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbfa0004d00 0x7fbfb41f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.343+0000 7fbfbc426640 1 -- 172.21.15.114:0/3101874586 >> 172.21.15.114:0/3101874586 conn(0x7fbfb40cb530 msgr2=0x7fbfb406c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:56.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.343+0000 7fbfbc426640 1 -- 172.21.15.114:0/3101874586 shutdown_connections 2023-11-04T01:41:56.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.343+0000 7fbfbc426640 1 -- 172.21.15.114:0/3101874586 wait complete. 2023-11-04T01:41:56.355 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:41:56.467 INFO:teuthology.orchestra.run.smithi114.stdout:{"last_snap":9,"last_created":5,"last_destroyed":8,"pending_noop":[],"snaps":[{"snapid":5,"ino":1099511627777,"stamp":"2023-11-04T01:41:31.747439+0000","name":"s16","metadata":{}}],"need_to_purge":{"17":[2,3,4,6,7,8]},"pending_update":[],"pending_destroy":[{"version":16,"removed_snap":5,"seq":9}]} 2023-11-04T01:41:56.467 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 8, "last_snap": 9, "need_to_purge": { "17": [ 2, 3, 4, 6, 7, 8 ] }, "pending_destroy": [ { "removed_snap": 5, "seq": 9, "version": 16 } ], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s16", "snapid": 5, "stamp": "2023-11-04T01:41:31.747439+0000" } ] } 2023-11-04T01:41:56.467 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:41:56.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.566+0000 7f956ef6c640 1 Processor -- start 2023-11-04T01:41:56.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.566+0000 7f956ef6c640 1 -- start start 2023-11-04T01:41:56.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.567+0000 7f956ef6c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f95680ca620 0x7f956806a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.567+0000 7f956ef6c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95680b25a0 con 0x7f956815d4e0 2023-11-04T01:41:56.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.567+0000 7f956ef6c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95680b2300 con 0x7f95680ca1a0 2023-11-04T01:41:56.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.567+0000 7f956ef6c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f956815d8c0 con 0x7f95680ca620 2023-11-04T01:41:56.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.567+0000 7f956d509640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f95680ca620 0x7f956806a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.567+0000 7f956cd08640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f956815d4e0 0x7f95680ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:36238/0 (socket says 172.21.15.114:36238) 2023-11-04T01:41:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.567+0000 7f956cd08640 1 -- 172.21.15.114:0/2472724753 learned_addr learned my addr 172.21.15.114:0/2472724753 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:41:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.567+0000 7f956d509640 1 -- 172.21.15.114:0/2472724753 >> v1:172.21.15.141:6789/0 conn(0x7f95680ca1a0 legacy=0x7f956806a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.567+0000 7f956d509640 1 -- 172.21.15.114:0/2472724753 >> v1:172.21.15.114:6789/0 conn(0x7f956815d4e0 legacy=0x7f95680ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.567+0000 7f95677fe640 1 -- 172.21.15.114:0/2472724753 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768672366 0 0) 0x7f95680b25a0 con 0x7f956815d4e0 2023-11-04T01:41:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.567+0000 7f956d509640 1 -- 172.21.15.114:0/2472724753 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95680caab0 con 0x7f95680ca620 2023-11-04T01:41:56.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.568+0000 7f956d509640 1 --2- 172.21.15.114:0/2472724753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95680ca620 0x7f956806a7e0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f9560009d90 tx=0x7f956002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706ca6681893dfd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.568+0000 7f95677fe640 1 -- 172.21.15.114:0/2472724753 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956002cbd0 con 0x7f95680ca620 2023-11-04T01:41:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.568+0000 7f95677fe640 1 -- 172.21.15.114:0/2472724753 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956002cd30 con 0x7f95680ca620 2023-11-04T01:41:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.568+0000 7f95677fe640 1 -- 172.21.15.114:0/2472724753 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956002cea0 con 0x7f95680ca620 2023-11-04T01:41:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.569+0000 7f956ef6c640 1 -- 172.21.15.114:0/2472724753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95680ca620 msgr2=0x7f956806a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.569+0000 7f956ef6c640 1 --2- 172.21.15.114:0/2472724753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95680ca620 0x7f956806a7e0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f9560009d90 tx=0x7f956002be20 comp rx=0 tx=0).stop 2023-11-04T01:41:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.569+0000 7f956ef6c640 1 -- 172.21.15.114:0/2472724753 shutdown_connections 2023-11-04T01:41:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.569+0000 7f956ef6c640 1 --2- 172.21.15.114:0/2472724753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95680ca620 0x7f956806a7e0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.569+0000 7f956ef6c640 1 -- 172.21.15.114:0/2472724753 >> 172.21.15.114:0/2472724753 conn(0x7f95680b1640 msgr2=0x7f95680b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.569+0000 7f956ef6c640 1 -- 172.21.15.114:0/2472724753 shutdown_connections 2023-11-04T01:41:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.569+0000 7f956ef6c640 1 -- 172.21.15.114:0/2472724753 wait complete. 2023-11-04T01:41:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.570+0000 7f956ef6c640 1 Processor -- start 2023-11-04T01:41:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.570+0000 7f956ef6c640 1 -- start start 2023-11-04T01:41:56.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.571+0000 7f956ef6c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95680ca1a0 0x7f95680add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.571+0000 7f956ef6c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95680ca620 0x7f95680c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.571+0000 7f956ef6c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f956815d4e0 0x7f95680c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.571+0000 7f956ef6c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95680ae2c0 con 0x7f95680ca1a0 2023-11-04T01:41:56.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.571+0000 7f956ef6c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95681551d0 con 0x7f956815d4e0 2023-11-04T01:41:56.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.571+0000 7f956ef6c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95681e40c0 con 0x7f95680ca620 2023-11-04T01:41:56.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.571+0000 7f956cd08640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95680ca1a0 0x7f95680add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.571+0000 7f956cd08640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95680ca1a0 0x7f95680add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45988/0 (socket says 172.21.15.114:45988) 2023-11-04T01:41:56.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.571+0000 7f956cd08640 1 -- 172.21.15.114:0/729919116 learned_addr learned my addr 172.21.15.114:0/729919116 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:56.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.571+0000 7f956cd08640 1 -- 172.21.15.114:0/729919116 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95680ca620 msgr2=0x7f95680c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.571+0000 7f956cd08640 1 --2- 172.21.15.114:0/729919116 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95680ca620 0x7f95680c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.571+0000 7f956cd08640 1 -- 172.21.15.114:0/729919116 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f956815d4e0 msgr2=0x7f95680c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.571+0000 7f956cd08640 1 --2- 172.21.15.114:0/729919116 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f956815d4e0 0x7f95680c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.571+0000 7f956cd08640 1 -- 172.21.15.114:0/729919116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9560009a70 con 0x7f95680ca1a0 2023-11-04T01:41:56.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.571+0000 7f956cd08640 1 --2- 172.21.15.114:0/729919116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95680ca1a0 0x7f95680add80 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f955800c4d0 tx=0x7f955800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.572+0000 7f95657fa640 1 -- 172.21.15.114:0/729919116 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95580074e0 con 0x7f95680ca1a0 2023-11-04T01:41:56.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.572+0000 7f95657fa640 1 -- 172.21.15.114:0/729919116 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9558007640 con 0x7f95680ca1a0 2023-11-04T01:41:56.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.572+0000 7f95657fa640 1 -- 172.21.15.114:0/729919116 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9558004a20 con 0x7f95680ca1a0 2023-11-04T01:41:56.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.572+0000 7f956ef6c640 1 -- 172.21.15.114:0/729919116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95680c6340 con 0x7f95680ca1a0 2023-11-04T01:41:56.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.572+0000 7f956ef6c640 1 -- 172.21.15.114:0/729919116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95681e3d50 con 0x7f95680ca1a0 2023-11-04T01:41:56.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.572+0000 7f956ef6c640 1 -- 172.21.15.114:0/729919116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95681e38d0 con 0x7f95680ca1a0 2023-11-04T01:41:56.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.573+0000 7f95657fa640 1 -- 172.21.15.114:0/729919116 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9558004b80 con 0x7f95680ca1a0 2023-11-04T01:41:56.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.573+0000 7f95657fa640 1 --2- 172.21.15.114:0/729919116 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f955406aea0 0x7f955406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.573+0000 7f95657fa640 1 -- 172.21.15.114:0/729919116 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f9558088f60 con 0x7f95680ca1a0 2023-11-04T01:41:56.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.573+0000 7f9567fff640 1 --2- 172.21.15.114:0/729919116 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f955406aea0 0x7f955406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.574+0000 7f9567fff640 1 --2- 172.21.15.114:0/729919116 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f955406aea0 0x7f955406d360 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f955c006fd0 tx=0x7f955c006bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.578+0000 7f95657fa640 1 -- 172.21.15.114:0/729919116 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f95681e38d0 con 0x7f95680ca1a0 2023-11-04T01:41:56.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:56.812+0000 7f956ef6c640 1 -- 172.21.15.114:0/729919116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f95681e38d0 con 0x7f95680ca1a0 2023-11-04T01:41:57.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.802+0000 7f95657fa640 1 -- 172.21.15.114:0/729919116 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.8013 v80) v1 ==== 112+0+0 (secure 0 0 0) 0x7f95681e38d0 con 0x7f95680ca1a0 2023-11-04T01:41:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:freezing mds.8013 2023-11-04T01:41:57.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.805+0000 7f956ef6c640 1 -- 172.21.15.114:0/729919116 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f955406aea0 msgr2=0x7f955406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.805+0000 7f956ef6c640 1 --2- 172.21.15.114:0/729919116 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f955406aea0 0x7f955406d360 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f955c006fd0 tx=0x7f955c006bc0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.805+0000 7f956ef6c640 1 -- 172.21.15.114:0/729919116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95680ca1a0 msgr2=0x7f95680add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.805+0000 7f956ef6c640 1 --2- 172.21.15.114:0/729919116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95680ca1a0 0x7f95680add80 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f955800c4d0 tx=0x7f955800c990 comp rx=0 tx=0).stop 2023-11-04T01:41:57.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.805+0000 7f956ef6c640 1 -- 172.21.15.114:0/729919116 shutdown_connections 2023-11-04T01:41:57.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.805+0000 7f956ef6c640 1 --2- 172.21.15.114:0/729919116 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f955406aea0 0x7f955406d360 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.805+0000 7f956ef6c640 1 --2- 172.21.15.114:0/729919116 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f956815d4e0 0x7f95680c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.805+0000 7f956ef6c640 1 --2- 172.21.15.114:0/729919116 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f95680ca620 0x7f95680c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.805+0000 7f956ef6c640 1 --2- 172.21.15.114:0/729919116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95680ca1a0 0x7f95680add80 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.805+0000 7f956ef6c640 1 -- 172.21.15.114:0/729919116 >> 172.21.15.114:0/729919116 conn(0x7f95680b1640 msgr2=0x7f9568071190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.805+0000 7f956ef6c640 1 -- 172.21.15.114:0/729919116 shutdown_connections 2023-11-04T01:41:57.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.805+0000 7f956ef6c640 1 -- 172.21.15.114:0/729919116 wait complete. 2023-11-04T01:41:57.820 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:41:57.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.927+0000 7fac97797640 1 Processor -- start 2023-11-04T01:41:57.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.927+0000 7fac97797640 1 -- start start 2023-11-04T01:41:57.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.928+0000 7fac97797640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fac9015d100 0x7fac900ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.928+0000 7fac97797640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fac9015d4e0 0x7fac900d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.928+0000 7fac97797640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fac900d3b60 0x7fac900d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.928+0000 7fac97797640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac900b32b0 con 0x7fac9015d100 2023-11-04T01:41:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.928+0000 7fac97797640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac900cee10 con 0x7fac900d3b60 2023-11-04T01:41:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.928+0000 7fac97797640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac900b2980 con 0x7fac9015d4e0 2023-11-04T01:41:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.928+0000 7fac95533640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fac9015d100 0x7fac900ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.928+0000 7fac95533640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fac9015d100 0x7fac900ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45996/0 (socket says 172.21.15.114:45996) 2023-11-04T01:41:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.928+0000 7fac95533640 1 -- 172.21.15.114:0/1914115976 learned_addr learned my addr 172.21.15.114:0/1914115976 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.928+0000 7fac95d34640 1 --2- 172.21.15.114:0/1914115976 >> v2:172.21.15.141:3300/0 conn(0x7fac900d3b60 0x7fac900d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.928+0000 7fac94d32640 1 --2- 172.21.15.114:0/1914115976 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fac9015d4e0 0x7fac900d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.928+0000 7fac95533640 1 -- 172.21.15.114:0/1914115976 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fac9015d4e0 msgr2=0x7fac900d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.928+0000 7fac95533640 1 --2- 172.21.15.114:0/1914115976 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fac9015d4e0 0x7fac900d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.928+0000 7fac95533640 1 -- 172.21.15.114:0/1914115976 >> v2:172.21.15.141:3300/0 conn(0x7fac900d3b60 msgr2=0x7fac900d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:57.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.928+0000 7fac95533640 1 --2- 172.21.15.114:0/1914115976 >> v2:172.21.15.141:3300/0 conn(0x7fac900d3b60 0x7fac900d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.929+0000 7fac95533640 1 -- 172.21.15.114:0/1914115976 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac900b2c60 con 0x7fac9015d100 2023-11-04T01:41:57.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.929+0000 7fac95d34640 1 --2- 172.21.15.114:0/1914115976 >> v2:172.21.15.141:3300/0 conn(0x7fac900d3b60 0x7fac900d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:57.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.929+0000 7fac94d32640 1 --2- 172.21.15.114:0/1914115976 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fac9015d4e0 0x7fac900d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.929+0000 7fac95533640 1 --2- 172.21.15.114:0/1914115976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac9015d100 0x7fac900ce510 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fac900b27a0 tx=0x7fac8802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb7065593269b84 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.929+0000 7fac8ffff640 1 -- 172.21.15.114:0/1914115976 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac88004230 con 0x7fac9015d100 2023-11-04T01:41:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.929+0000 7fac8ffff640 1 -- 172.21.15.114:0/1914115976 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac88004390 con 0x7fac9015d100 2023-11-04T01:41:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.929+0000 7fac8ffff640 1 -- 172.21.15.114:0/1914115976 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac88003810 con 0x7fac9015d100 2023-11-04T01:41:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.930+0000 7fac97797640 1 -- 172.21.15.114:0/1914115976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac9015d100 msgr2=0x7fac900ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.930+0000 7fac97797640 1 --2- 172.21.15.114:0/1914115976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac9015d100 0x7fac900ce510 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fac900b27a0 tx=0x7fac8802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.930+0000 7fac97797640 1 -- 172.21.15.114:0/1914115976 shutdown_connections 2023-11-04T01:41:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.930+0000 7fac97797640 1 --2- 172.21.15.114:0/1914115976 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fac9015d4e0 0x7fac900d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.930+0000 7fac97797640 1 --2- 172.21.15.114:0/1914115976 >> v2:172.21.15.141:3300/0 conn(0x7fac900d3b60 0x7fac900d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.930+0000 7fac97797640 1 --2- 172.21.15.114:0/1914115976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac9015d100 0x7fac900ce510 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.930+0000 7fac97797640 1 -- 172.21.15.114:0/1914115976 >> 172.21.15.114:0/1914115976 conn(0x7fac900d2ef0 msgr2=0x7fac900d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.930+0000 7fac97797640 1 -- 172.21.15.114:0/1914115976 shutdown_connections 2023-11-04T01:41:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.930+0000 7fac97797640 1 -- 172.21.15.114:0/1914115976 wait complete. 2023-11-04T01:41:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.931+0000 7fac97797640 1 Processor -- start 2023-11-04T01:41:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.931+0000 7fac97797640 1 -- start start 2023-11-04T01:41:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac97797640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac900d3b60 0x7fac900b8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac97797640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fac9015d100 0x7fac901f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac97797640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac9015d4e0 0x7fac9015f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac97797640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9015acd0 con 0x7fac9015d4e0 2023-11-04T01:41:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac97797640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac901f62a0 con 0x7fac900d3b60 2023-11-04T01:41:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac97797640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac900cbf00 con 0x7fac9015d100 2023-11-04T01:41:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac95d34640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac9015d4e0 0x7fac9015f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac95d34640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac9015d4e0 0x7fac9015f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46012/0 (socket says 172.21.15.114:46012) 2023-11-04T01:41:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac95d34640 1 -- 172.21.15.114:0/2594347656 learned_addr learned my addr 172.21.15.114:0/2594347656 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac94d32640 1 --2- 172.21.15.114:0/2594347656 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fac9015d100 0x7fac901f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac95533640 1 --2- 172.21.15.114:0/2594347656 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac900d3b60 0x7fac900b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac95d34640 1 -- 172.21.15.114:0/2594347656 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fac9015d100 msgr2=0x7fac901f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac95d34640 1 --2- 172.21.15.114:0/2594347656 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fac9015d100 0x7fac901f2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac95d34640 1 -- 172.21.15.114:0/2594347656 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac900d3b60 msgr2=0x7fac900b8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac95d34640 1 --2- 172.21.15.114:0/2594347656 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac900d3b60 0x7fac900b8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac95d34640 1 -- 172.21.15.114:0/2594347656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac88009460 con 0x7fac9015d4e0 2023-11-04T01:41:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.932+0000 7fac95d34640 1 --2- 172.21.15.114:0/2594347656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac9015d4e0 0x7fac9015f020 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fac8000cef0 tx=0x7fac8000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.933+0000 7fac8dffb640 1 -- 172.21.15.114:0/2594347656 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8000d840 con 0x7fac9015d4e0 2023-11-04T01:41:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.933+0000 7fac8dffb640 1 -- 172.21.15.114:0/2594347656 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8000d9a0 con 0x7fac9015d4e0 2023-11-04T01:41:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.933+0000 7fac97797640 1 -- 172.21.15.114:0/2594347656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac900b8770 con 0x7fac9015d4e0 2023-11-04T01:41:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.933+0000 7fac8dffb640 1 -- 172.21.15.114:0/2594347656 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8000dd50 con 0x7fac9015d4e0 2023-11-04T01:41:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.933+0000 7fac97797640 1 -- 172.21.15.114:0/2594347656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9009cdc0 con 0x7fac9015d4e0 2023-11-04T01:41:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.934+0000 7fac8dffb640 1 -- 172.21.15.114:0/2594347656 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fac8001e3b0 con 0x7fac9015d4e0 2023-11-04T01:41:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.934+0000 7fac97797640 1 -- 172.21.15.114:0/2594347656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac900684b0 con 0x7fac9015d4e0 2023-11-04T01:41:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.934+0000 7fac8dffb640 1 --2- 172.21.15.114:0/2594347656 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fac7c06ae70 0x7fac7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.934+0000 7fac8dffb640 1 -- 172.21.15.114:0/2594347656 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7fac8008a6f0 con 0x7fac9015d4e0 2023-11-04T01:41:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.934+0000 7fac95533640 1 --2- 172.21.15.114:0/2594347656 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fac7c06ae70 0x7fac7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.935+0000 7fac95533640 1 --2- 172.21.15.114:0/2594347656 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fac7c06ae70 0x7fac7c06d330 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fac88035000 tx=0x7fac88008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:57.939+0000 7fac8dffb640 1 -- 172.21.15.114:0/2594347656 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fac80055110 con 0x7fac9015d4e0 2023-11-04T01:41:58.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:58.172+0000 7fac97797640 1 -- 172.21.15.114:0/2594347656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7fac900d2cd0 con 0x7fac9015d4e0 2023-11-04T01:41:58.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:58.807+0000 7fac8dffb640 1 -- 172.21.15.114:0/2594347656 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.6298 v81) v1 ==== 112+0+0 (secure 0 0 0) 0x7fac80058730 con 0x7fac9015d4e0 2023-11-04T01:41:58.809 INFO:teuthology.orchestra.run.smithi114.stderr:freezing mds.6298 2023-11-04T01:41:58.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:58.811+0000 7fac97797640 1 -- 172.21.15.114:0/2594347656 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fac7c06ae70 msgr2=0x7fac7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:58.811+0000 7fac97797640 1 --2- 172.21.15.114:0/2594347656 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fac7c06ae70 0x7fac7c06d330 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fac88035000 tx=0x7fac88008030 comp rx=0 tx=0).stop 2023-11-04T01:41:58.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:58.811+0000 7fac97797640 1 -- 172.21.15.114:0/2594347656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac9015d4e0 msgr2=0x7fac9015f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:58.811+0000 7fac97797640 1 --2- 172.21.15.114:0/2594347656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac9015d4e0 0x7fac9015f020 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fac8000cef0 tx=0x7fac8000a710 comp rx=0 tx=0).stop 2023-11-04T01:41:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:58.811+0000 7fac97797640 1 -- 172.21.15.114:0/2594347656 shutdown_connections 2023-11-04T01:41:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:58.811+0000 7fac97797640 1 --2- 172.21.15.114:0/2594347656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac9015d4e0 0x7fac9015f020 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:58.811+0000 7fac97797640 1 --2- 172.21.15.114:0/2594347656 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fac9015d100 0x7fac901f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:58.811+0000 7fac97797640 1 --2- 172.21.15.114:0/2594347656 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fac7c06ae70 0x7fac7c06d330 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:58.811+0000 7fac97797640 1 --2- 172.21.15.114:0/2594347656 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fac900d3b60 0x7fac900b8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:58.811+0000 7fac97797640 1 -- 172.21.15.114:0/2594347656 >> 172.21.15.114:0/2594347656 conn(0x7fac900d2ef0 msgr2=0x7fac9015ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:58.811+0000 7fac97797640 1 -- 172.21.15.114:0/2594347656 shutdown_connections 2023-11-04T01:41:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:58.811+0000 7fac97797640 1 -- 172.21.15.114:0/2594347656 wait complete. 2023-11-04T01:41:58.826 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_kill_mdstable_at 2 2023-11-04T01:41:58.943 INFO:teuthology.orchestra.run.smithi114.stdout:{"success":"mds_kill_mdstable_at = '2' (not observed, change may require restart) "} 2023-11-04T01:41:58.944 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '2' (not observed, change may require restart) " } 2023-11-04T01:41:58.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:58.944 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s22) 2023-11-04T01:41:58.946 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:41:58.969 INFO:tasks.ceph.mds.c.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7ff35f0c7640 time 2023-11-04T01:41:58.966665+0000 2023-11-04T01:41:58.969 INFO:tasks.ceph.mds.c.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:41:58.969 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:58.969 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff36ab6efaf] 2023-11-04T01:41:58.969 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7ff36ab6f16d] 2023-11-04T01:41:58.969 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55cdc4d379ce] 2023-11-04T01:41:58.969 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55cdc4d67bcc] 2023-11-04T01:41:58.969 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55cdc4d70b0c] 2023-11-04T01:41:58.969 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55cdc4d70c63] 2023-11-04T01:41:58.970 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7ff36ac164a5] 2023-11-04T01:41:58.970 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7ff36a29f802] 2023-11-04T01:41:58.970 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7ff36a23f450] 2023-11-04T01:41:58.970 INFO:tasks.ceph.mds.c.smithi114.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:41:58.970 INFO:tasks.ceph.mds.c.smithi114.stderr: in thread 7ff35f0c7640 thread_name:MR_Finisher 2023-11-04T01:41:58.970 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:41:58.966+0000 7ff35f0c7640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7ff35f0c7640 time 2023-11-04T01:41:58.966665+0000 2023-11-04T01:41:58.970 INFO:tasks.ceph.mds.c.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:41:58.970 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:58.970 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:58.970 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff36ab6efaf] 2023-11-04T01:41:58.970 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7ff36ab6f16d] 2023-11-04T01:41:58.970 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55cdc4d379ce] 2023-11-04T01:41:58.971 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55cdc4d67bcc] 2023-11-04T01:41:58.971 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55cdc4d70b0c] 2023-11-04T01:41:58.971 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55cdc4d70c63] 2023-11-04T01:41:58.971 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7ff36ac164a5] 2023-11-04T01:41:58.971 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7ff36a29f802] 2023-11-04T01:41:58.971 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7ff36a23f450] 2023-11-04T01:41:58.971 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:58.971 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:58.971 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7ff36a254db0] 2023-11-04T01:41:58.971 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7ff36a2a154c] 2023-11-04T01:41:58.971 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: raise() 2023-11-04T01:41:58.971 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: abort() 2023-11-04T01:41:58.972 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff36ab6f009] 2023-11-04T01:41:58.972 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7ff36ab6f16d] 2023-11-04T01:41:58.972 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55cdc4d379ce] 2023-11-04T01:41:58.972 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55cdc4d67bcc] 2023-11-04T01:41:58.972 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55cdc4d70b0c] 2023-11-04T01:41:58.972 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55cdc4d70c63] 2023-11-04T01:41:58.972 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7ff36ac164a5] 2023-11-04T01:41:58.972 INFO:tasks.ceph.mds.c.smithi114.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7ff36a29f802] 2023-11-04T01:41:58.972 INFO:tasks.ceph.mds.c.smithi114.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7ff36a23f450] 2023-11-04T01:41:58.972 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:41:58.967+0000 7ff35f0c7640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:58.972 INFO:tasks.ceph.mds.c.smithi114.stderr: in thread 7ff35f0c7640 thread_name:MR_Finisher 2023-11-04T01:41:58.972 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:58.972 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:58.973 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7ff36a254db0] 2023-11-04T01:41:58.973 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7ff36a2a154c] 2023-11-04T01:41:58.973 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: raise() 2023-11-04T01:41:58.973 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: abort() 2023-11-04T01:41:58.973 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff36ab6f009] 2023-11-04T01:41:58.973 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7ff36ab6f16d] 2023-11-04T01:41:58.973 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55cdc4d379ce] 2023-11-04T01:41:58.973 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55cdc4d67bcc] 2023-11-04T01:41:58.973 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55cdc4d70b0c] 2023-11-04T01:41:58.973 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55cdc4d70c63] 2023-11-04T01:41:58.973 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7ff36ac164a5] 2023-11-04T01:41:58.974 INFO:tasks.ceph.mds.c.smithi114.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7ff36a29f802] 2023-11-04T01:41:58.974 INFO:tasks.ceph.mds.c.smithi114.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7ff36a23f450] 2023-11-04T01:41:58.974 INFO:tasks.ceph.mds.c.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:58.974 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:58.975 INFO:tasks.ceph.mds.c.smithi114.stderr: -1043> 2023-11-04T01:41:53.844+0000 7ff3628ce640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:58.975 INFO:tasks.ceph.mds.c.smithi114.stderr: -1041> 2023-11-04T01:41:53.844+0000 7ff3628ce640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:58.977 INFO:tasks.ceph.mds.c.smithi114.stderr: -1> 2023-11-04T01:41:58.966+0000 7ff35f0c7640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7ff35f0c7640 time 2023-11-04T01:41:58.966665+0000 2023-11-04T01:41:58.978 INFO:tasks.ceph.mds.c.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:41:58.978 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:58.978 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:58.978 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff36ab6efaf] 2023-11-04T01:41:58.978 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7ff36ab6f16d] 2023-11-04T01:41:58.978 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55cdc4d379ce] 2023-11-04T01:41:58.978 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55cdc4d67bcc] 2023-11-04T01:41:58.978 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55cdc4d70b0c] 2023-11-04T01:41:58.978 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55cdc4d70c63] 2023-11-04T01:41:58.978 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7ff36ac164a5] 2023-11-04T01:41:58.978 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7ff36a29f802] 2023-11-04T01:41:58.978 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7ff36a23f450] 2023-11-04T01:41:58.979 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:58.979 INFO:tasks.ceph.mds.c.smithi114.stderr: 0> 2023-11-04T01:41:58.967+0000 7ff35f0c7640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:58.979 INFO:tasks.ceph.mds.c.smithi114.stderr: in thread 7ff35f0c7640 thread_name:MR_Finisher 2023-11-04T01:41:58.979 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:58.979 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:58.979 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7ff36a254db0] 2023-11-04T01:41:58.979 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7ff36a2a154c] 2023-11-04T01:41:58.979 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: raise() 2023-11-04T01:41:58.979 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: abort() 2023-11-04T01:41:58.979 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff36ab6f009] 2023-11-04T01:41:58.979 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7ff36ab6f16d] 2023-11-04T01:41:58.979 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55cdc4d379ce] 2023-11-04T01:41:58.980 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55cdc4d67bcc] 2023-11-04T01:41:58.980 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55cdc4d70b0c] 2023-11-04T01:41:58.980 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55cdc4d70c63] 2023-11-04T01:41:58.980 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7ff36ac164a5] 2023-11-04T01:41:58.980 INFO:tasks.ceph.mds.c.smithi114.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7ff36a29f802] 2023-11-04T01:41:58.980 INFO:tasks.ceph.mds.c.smithi114.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7ff36a23f450] 2023-11-04T01:41:58.980 INFO:tasks.ceph.mds.c.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:58.980 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:58.981 INFO:tasks.ceph.mds.c.smithi114.stderr: -1043> 2023-11-04T01:41:53.844+0000 7ff3628ce640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:58.981 INFO:tasks.ceph.mds.c.smithi114.stderr: -1041> 2023-11-04T01:41:53.844+0000 7ff3628ce640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:41:58.982 INFO:tasks.ceph.mds.c.smithi114.stderr: -1> 2023-11-04T01:41:58.966+0000 7ff35f0c7640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7ff35f0c7640 time 2023-11-04T01:41:58.966665+0000 2023-11-04T01:41:58.982 INFO:tasks.ceph.mds.c.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:41:58.982 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:58.982 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:58.982 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff36ab6efaf] 2023-11-04T01:41:58.983 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7ff36ab6f16d] 2023-11-04T01:41:58.983 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55cdc4d379ce] 2023-11-04T01:41:58.983 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55cdc4d67bcc] 2023-11-04T01:41:58.983 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55cdc4d70b0c] 2023-11-04T01:41:58.983 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55cdc4d70c63] 2023-11-04T01:41:58.983 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7ff36ac164a5] 2023-11-04T01:41:58.983 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7ff36a29f802] 2023-11-04T01:41:58.983 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7ff36a23f450] 2023-11-04T01:41:58.983 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:58.983 INFO:tasks.ceph.mds.c.smithi114.stderr: 0> 2023-11-04T01:41:58.967+0000 7ff35f0c7640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:41:58.983 INFO:tasks.ceph.mds.c.smithi114.stderr: in thread 7ff35f0c7640 thread_name:MR_Finisher 2023-11-04T01:41:58.983 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:58.983 INFO:tasks.ceph.mds.c.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:41:58.984 INFO:tasks.ceph.mds.c.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7ff36a254db0] 2023-11-04T01:41:58.984 INFO:tasks.ceph.mds.c.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7ff36a2a154c] 2023-11-04T01:41:58.984 INFO:tasks.ceph.mds.c.smithi114.stderr: 3: raise() 2023-11-04T01:41:58.984 INFO:tasks.ceph.mds.c.smithi114.stderr: 4: abort() 2023-11-04T01:41:58.984 INFO:tasks.ceph.mds.c.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff36ab6f009] 2023-11-04T01:41:58.984 INFO:tasks.ceph.mds.c.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7ff36ab6f16d] 2023-11-04T01:41:58.984 INFO:tasks.ceph.mds.c.smithi114.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x55cdc4d379ce] 2023-11-04T01:41:58.985 INFO:tasks.ceph.mds.c.smithi114.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55cdc4d67bcc] 2023-11-04T01:41:58.985 INFO:tasks.ceph.mds.c.smithi114.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55cdc4d70b0c] 2023-11-04T01:41:58.985 INFO:tasks.ceph.mds.c.smithi114.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55cdc4d70c63] 2023-11-04T01:41:58.985 INFO:tasks.ceph.mds.c.smithi114.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7ff36ac164a5] 2023-11-04T01:41:58.985 INFO:tasks.ceph.mds.c.smithi114.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7ff36a29f802] 2023-11-04T01:41:58.985 INFO:tasks.ceph.mds.c.smithi114.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7ff36a23f450] 2023-11-04T01:41:58.985 INFO:tasks.ceph.mds.c.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:41:58.985 INFO:tasks.ceph.mds.c.smithi114.stderr: 2023-11-04T01:41:59.077 INFO:teuthology.orchestra.run.smithi114.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:41:59.078 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:41:59.078 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:59.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.216+0000 7f2436f4c640 1 Processor -- start 2023-11-04T01:41:59.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.216+0000 7f2436f4c640 1 -- start start 2023-11-04T01:41:59.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.217+0000 7f2436f4c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f24301605b0 0x7f24300ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.217+0000 7f2436f4c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f24300b0c40 0x7f24300cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.217+0000 7f2436f4c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24300c9100 con 0x7f243006b950 2023-11-04T01:41:59.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.217+0000 7f2436f4c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24300ae230 con 0x7f24300b0c40 2023-11-04T01:41:59.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.217+0000 7f2436f4c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24300aceb0 con 0x7f24301605b0 2023-11-04T01:41:59.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.217+0000 7f24354e9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f24300b0c40 0x7f24300cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.217+0000 7f24354e9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f24300b0c40 0x7f24300cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46028/0 (socket says 172.21.15.114:46028) 2023-11-04T01:41:59.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.217+0000 7f24354e9640 1 -- 172.21.15.114:0/2127971478 learned_addr learned my addr 172.21.15.114:0/2127971478 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:59.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.217+0000 7f2427fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f243006b950 0x7f24300b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:36254/0 (socket says 172.21.15.114:36254) 2023-11-04T01:41:59.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.217+0000 7f2434ce8640 1 --2- 172.21.15.114:0/2127971478 >> v2:172.21.15.141:3300/0 conn(0x7f24301605b0 0x7f24300ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.217+0000 7f24354e9640 1 -- 172.21.15.114:0/2127971478 >> v2:172.21.15.141:3300/0 conn(0x7f24301605b0 msgr2=0x7f24300ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:59.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.217+0000 7f24354e9640 1 --2- 172.21.15.114:0/2127971478 >> v2:172.21.15.141:3300/0 conn(0x7f24301605b0 0x7f24300ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.217+0000 7f24354e9640 1 -- 172.21.15.114:0/2127971478 >> v1:172.21.15.114:6789/0 conn(0x7f243006b950 legacy=0x7f24300b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.217+0000 7f24354e9640 1 -- 172.21.15.114:0/2127971478 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24300ad190 con 0x7f24300b0c40 2023-11-04T01:41:59.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.218+0000 7f24354e9640 1 --2- 172.21.15.114:0/2127971478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24300b0c40 0x7f24300cd090 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f24300cc2b0 tx=0x7f242802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb0581f6613005b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:59.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.218+0000 7f24277fe640 1 -- 172.21.15.114:0/2127971478 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242802ca80 con 0x7f24300b0c40 2023-11-04T01:41:59.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.218+0000 7f24277fe640 1 -- 172.21.15.114:0/2127971478 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242802cbe0 con 0x7f24300b0c40 2023-11-04T01:41:59.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.218+0000 7f24277fe640 1 -- 172.21.15.114:0/2127971478 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24280343f0 con 0x7f24300b0c40 2023-11-04T01:41:59.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.218+0000 7f2436f4c640 1 -- 172.21.15.114:0/2127971478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24300b0c40 msgr2=0x7f24300cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.218+0000 7f2436f4c640 1 --2- 172.21.15.114:0/2127971478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24300b0c40 0x7f24300cd090 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f24300cc2b0 tx=0x7f242802bee0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.218+0000 7f2436f4c640 1 -- 172.21.15.114:0/2127971478 shutdown_connections 2023-11-04T01:41:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.218+0000 7f2436f4c640 1 --2- 172.21.15.114:0/2127971478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24300b0c40 0x7f24300cd090 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.218+0000 7f2436f4c640 1 --2- 172.21.15.114:0/2127971478 >> v2:172.21.15.141:3300/0 conn(0x7f24301605b0 0x7f24300ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.218+0000 7f2436f4c640 1 -- 172.21.15.114:0/2127971478 >> 172.21.15.114:0/2127971478 conn(0x7f24300cb530 msgr2=0x7f24300cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.218+0000 7f2436f4c640 1 -- 172.21.15.114:0/2127971478 shutdown_connections 2023-11-04T01:41:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.218+0000 7f2436f4c640 1 -- 172.21.15.114:0/2127971478 wait complete. 2023-11-04T01:41:59.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.220+0000 7f2436f4c640 1 Processor -- start 2023-11-04T01:41:59.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.220+0000 7f2436f4c640 1 -- start start 2023-11-04T01:41:59.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.220+0000 7f2436f4c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f243006b950 0x7f24300c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.220+0000 7f2436f4c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24300b0c40 0x7f24300b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.220+0000 7f2436f4c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24301605b0 0x7f2430151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.220+0000 7f2436f4c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24300c6ad0 con 0x7f24300b0c40 2023-11-04T01:41:59.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.220+0000 7f2436f4c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24300b3e50 con 0x7f243006b950 2023-11-04T01:41:59.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.220+0000 7f2436f4c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24300c6ce0 con 0x7f24301605b0 2023-11-04T01:41:59.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.221+0000 7f2427fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24300b0c40 0x7f24300b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.221+0000 7f2427fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24300b0c40 0x7f24300b3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46034/0 (socket says 172.21.15.114:46034) 2023-11-04T01:41:59.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.221+0000 7f2427fff640 1 -- 172.21.15.114:0/2124323240 learned_addr learned my addr 172.21.15.114:0/2124323240 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:41:59.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.221+0000 7f2427fff640 1 -- 172.21.15.114:0/2124323240 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24301605b0 msgr2=0x7f2430151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.221+0000 7f2427fff640 1 --2- 172.21.15.114:0/2124323240 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24301605b0 0x7f2430151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.221+0000 7f2427fff640 1 -- 172.21.15.114:0/2124323240 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f243006b950 msgr2=0x7f24300c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.221+0000 7f2427fff640 1 --2- 172.21.15.114:0/2124323240 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f243006b950 0x7f24300c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.221+0000 7f2427fff640 1 -- 172.21.15.114:0/2124323240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2428009b30 con 0x7f24300b0c40 2023-11-04T01:41:59.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.221+0000 7f2427fff640 1 --2- 172.21.15.114:0/2124323240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24300b0c40 0x7f24300b3910 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f242000c450 tx=0x7f242000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:59.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.221+0000 7f24257fa640 1 -- 172.21.15.114:0/2124323240 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420007480 con 0x7f24300b0c40 2023-11-04T01:41:59.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.221+0000 7f24257fa640 1 -- 172.21.15.114:0/2124323240 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24200075e0 con 0x7f24300b0c40 2023-11-04T01:41:59.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.221+0000 7f24257fa640 1 -- 172.21.15.114:0/2124323240 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420004a00 con 0x7f24300b0c40 2023-11-04T01:41:59.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.221+0000 7f2436f4c640 1 -- 172.21.15.114:0/2124323240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24300c6fc0 con 0x7f24300b0c40 2023-11-04T01:41:59.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.221+0000 7f2436f4c640 1 -- 172.21.15.114:0/2124323240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24300c7580 con 0x7f24300b0c40 2023-11-04T01:41:59.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.222+0000 7f2436f4c640 1 -- 172.21.15.114:0/2124323240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24300684b0 con 0x7f24300b0c40 2023-11-04T01:41:59.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.223+0000 7f24257fa640 1 -- 172.21.15.114:0/2124323240 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2420004b60 con 0x7f24300b0c40 2023-11-04T01:41:59.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.223+0000 7f24257fa640 1 --2- 172.21.15.114:0/2124323240 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f241c06ae70 0x7f241c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.223+0000 7f2434ce8640 1 --2- 172.21.15.114:0/2124323240 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f241c06ae70 0x7f241c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.223+0000 7f24257fa640 1 -- 172.21.15.114:0/2124323240 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7610+0+0 (secure 0 0 0) 0x7f2420088e80 con 0x7f24300b0c40 2023-11-04T01:41:59.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.223+0000 7f2434ce8640 1 --2- 172.21.15.114:0/2124323240 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f241c06ae70 0x7f241c06d330 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f242c006fd0 tx=0x7f242c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:59.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.227+0000 7f24257fa640 1 -- 172.21.15.114:0/2124323240 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2420053850 con 0x7f24300b0c40 2023-11-04T01:41:59.350 INFO:tasks.ceph.mds.c.smithi114.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:41:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.437+0000 7f2436f4c640 1 -- 172.21.15.114:0/2124323240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24300b4a30 con 0x7f24300b0c40 2023-11-04T01:41:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.438+0000 7f24257fa640 1 -- 172.21.15.114:0/2124323240 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f2420018020 con 0x7f24300b0c40 2023-11-04T01:41:59.440 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:41:59.440 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":81,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:58.174193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8013,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8013":{"gid":8013,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:41:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 81 2023-11-04T01:41:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.440+0000 7f2436f4c640 1 -- 172.21.15.114:0/2124323240 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f241c06ae70 msgr2=0x7f241c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.440+0000 7f2436f4c640 1 --2- 172.21.15.114:0/2124323240 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f241c06ae70 0x7f241c06d330 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f242c006fd0 tx=0x7f242c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.440+0000 7f2436f4c640 1 -- 172.21.15.114:0/2124323240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24300b0c40 msgr2=0x7f24300b3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.440+0000 7f2436f4c640 1 --2- 172.21.15.114:0/2124323240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24300b0c40 0x7f24300b3910 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f242000c450 tx=0x7f242000c910 comp rx=0 tx=0).stop 2023-11-04T01:41:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.440+0000 7f2436f4c640 1 -- 172.21.15.114:0/2124323240 shutdown_connections 2023-11-04T01:41:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.440+0000 7f2436f4c640 1 --2- 172.21.15.114:0/2124323240 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f24301605b0 0x7f2430151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.440+0000 7f2436f4c640 1 --2- 172.21.15.114:0/2124323240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24300b0c40 0x7f24300b3910 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.440+0000 7f2436f4c640 1 --2- 172.21.15.114:0/2124323240 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f241c06ae70 0x7f241c06d330 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.440+0000 7f2436f4c640 1 --2- 172.21.15.114:0/2124323240 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f243006b950 0x7f24300c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.440+0000 7f2436f4c640 1 -- 172.21.15.114:0/2124323240 >> 172.21.15.114:0/2124323240 conn(0x7f24300cb530 msgr2=0x7f24300cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.440+0000 7f2436f4c640 1 -- 172.21.15.114:0/2124323240 shutdown_connections 2023-11-04T01:41:59.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:41:59.440+0000 7f2436f4c640 1 -- 172.21.15.114:0/2124323240 wait complete. 2023-11-04T01:41:59.452 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:42:04.453 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:04.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.562+0000 7f6d100b0640 1 Processor -- start 2023-11-04T01:42:04.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.562+0000 7f6d100b0640 1 -- start start 2023-11-04T01:42:04.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.563+0000 7f6d100b0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6d08159e40 0x7f6d080b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.563+0000 7f6d100b0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d0806bb60 0x7f6d080b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.563+0000 7f6d100b0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d08071500 con 0x7f6d0806fff0 2023-11-04T01:42:04.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.563+0000 7f6d100b0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0815dae0 con 0x7f6d08159e40 2023-11-04T01:42:04.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.563+0000 7f6d100b0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d08070c60 con 0x7f6d0806bb60 2023-11-04T01:42:04.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.563+0000 7f6d0de4c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6d08159e40 0x7f6d080b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.563+0000 7f6d0de4c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6d08159e40 0x7f6d080b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46050/0 (socket says 172.21.15.114:46050) 2023-11-04T01:42:04.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.563+0000 7f6d0de4c640 1 -- 172.21.15.114:0/1392026082 learned_addr learned my addr 172.21.15.114:0/1392026082 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:04.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.563+0000 7f6d0e64d640 1 --1- 172.21.15.114:0/1392026082 >> v1:172.21.15.114:6789/0 conn(0x7f6d0806fff0 0x7f6d08070480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:36266/0 (socket says 172.21.15.114:36266) 2023-11-04T01:42:04.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.563+0000 7f6d0d64b640 1 --2- 172.21.15.114:0/1392026082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d0806bb60 0x7f6d080b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.563+0000 7f6d0de4c640 1 -- 172.21.15.114:0/1392026082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d0806bb60 msgr2=0x7f6d080b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:04.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.563+0000 7f6d0de4c640 1 --2- 172.21.15.114:0/1392026082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d0806bb60 0x7f6d080b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.563+0000 7f6d0de4c640 1 -- 172.21.15.114:0/1392026082 >> v1:172.21.15.114:6789/0 conn(0x7f6d0806fff0 legacy=0x7f6d08070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.563+0000 7f6d0de4c640 1 -- 172.21.15.114:0/1392026082 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d08070f40 con 0x7f6d08159e40 2023-11-04T01:42:04.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.564+0000 7f6d0de4c640 1 --2- 172.21.15.114:0/1392026082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d08159e40 0x7f6d080b0530 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009870 tx=0x7f6d0402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7013106a26ec837 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:04.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.564+0000 7f6d0ce4a640 1 -- 172.21.15.114:0/1392026082 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04031640 con 0x7f6d08159e40 2023-11-04T01:42:04.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.564+0000 7f6d0ce4a640 1 -- 172.21.15.114:0/1392026082 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d040317a0 con 0x7f6d08159e40 2023-11-04T01:42:04.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.564+0000 7f6d0ce4a640 1 -- 172.21.15.114:0/1392026082 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04031b30 con 0x7f6d08159e40 2023-11-04T01:42:04.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.565+0000 7f6d100b0640 1 -- 172.21.15.114:0/1392026082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d08159e40 msgr2=0x7f6d080b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.565+0000 7f6d100b0640 1 --2- 172.21.15.114:0/1392026082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d08159e40 0x7f6d080b0530 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009870 tx=0x7f6d0402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.565+0000 7f6d100b0640 1 -- 172.21.15.114:0/1392026082 shutdown_connections 2023-11-04T01:42:04.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.565+0000 7f6d100b0640 1 --2- 172.21.15.114:0/1392026082 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d0806bb60 0x7f6d080b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.565+0000 7f6d100b0640 1 --2- 172.21.15.114:0/1392026082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d08159e40 0x7f6d080b0530 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.565+0000 7f6d100b0640 1 -- 172.21.15.114:0/1392026082 >> 172.21.15.114:0/1392026082 conn(0x7f6d080cb530 msgr2=0x7f6d080cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:04.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.565+0000 7f6d100b0640 1 -- 172.21.15.114:0/1392026082 shutdown_connections 2023-11-04T01:42:04.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.565+0000 7f6d100b0640 1 -- 172.21.15.114:0/1392026082 wait complete. 2023-11-04T01:42:04.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.566+0000 7f6d100b0640 1 Processor -- start 2023-11-04T01:42:04.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.566+0000 7f6d100b0640 1 -- start start 2023-11-04T01:42:04.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.567+0000 7f6d100b0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d0806bb60 0x7f6d080c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.567+0000 7f6d100b0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d0806fff0 0x7f6d0806c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.567+0000 7f6d100b0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d08159e40 0x7f6d080c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.567+0000 7f6d100b0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080c5b80 con 0x7f6d08159e40 2023-11-04T01:42:04.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.567+0000 7f6d100b0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080c6420 con 0x7f6d0806fff0 2023-11-04T01:42:04.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.567+0000 7f6d100b0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080c8270 con 0x7f6d0806bb60 2023-11-04T01:42:04.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.567+0000 7f6d0e64d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d08159e40 0x7f6d080c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.567+0000 7f6d0e64d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d08159e40 0x7f6d080c77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46060/0 (socket says 172.21.15.114:46060) 2023-11-04T01:42:04.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.567+0000 7f6d0e64d640 1 -- 172.21.15.114:0/101557231 learned_addr learned my addr 172.21.15.114:0/101557231 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:04.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.567+0000 7f6d0e64d640 1 -- 172.21.15.114:0/101557231 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d0806bb60 msgr2=0x7f6d080c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.567+0000 7f6d0e64d640 1 --2- 172.21.15.114:0/101557231 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d0806bb60 0x7f6d080c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.567+0000 7f6d0e64d640 1 -- 172.21.15.114:0/101557231 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d0806fff0 msgr2=0x7f6d0806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.567+0000 7f6d0e64d640 1 --2- 172.21.15.114:0/101557231 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d0806fff0 0x7f6d0806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.567+0000 7f6d0e64d640 1 -- 172.21.15.114:0/101557231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d040094d0 con 0x7f6d08159e40 2023-11-04T01:42:04.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.567+0000 7f6d0e64d640 1 --2- 172.21.15.114:0/101557231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d08159e40 0x7f6d080c77b0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000ea00 tx=0x7f6d0000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:04.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.568+0000 7f6cfe7fc640 1 -- 172.21.15.114:0/101557231 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000c970 con 0x7f6d08159e40 2023-11-04T01:42:04.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.568+0000 7f6cfe7fc640 1 -- 172.21.15.114:0/101557231 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0000cad0 con 0x7f6d08159e40 2023-11-04T01:42:04.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.568+0000 7f6d100b0640 1 -- 172.21.15.114:0/101557231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d080c5d60 con 0x7f6d08159e40 2023-11-04T01:42:04.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.568+0000 7f6cfe7fc640 1 -- 172.21.15.114:0/101557231 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000ce80 con 0x7f6d08159e40 2023-11-04T01:42:04.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.568+0000 7f6d100b0640 1 -- 172.21.15.114:0/101557231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d08156ee0 con 0x7f6d08159e40 2023-11-04T01:42:04.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.569+0000 7f6d100b0640 1 -- 172.21.15.114:0/101557231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d080684b0 con 0x7f6d08159e40 2023-11-04T01:42:04.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.569+0000 7f6cfe7fc640 1 -- 172.21.15.114:0/101557231 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d00007070 con 0x7f6d08159e40 2023-11-04T01:42:04.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.569+0000 7f6cfe7fc640 1 --2- 172.21.15.114:0/101557231 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6cec06ae70 0x7f6cec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.570+0000 7f6cfe7fc640 1 -- 172.21.15.114:0/101557231 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7594+0+0 (secure 0 0 0) 0x7f6d0008c4a0 con 0x7f6d08159e40 2023-11-04T01:42:04.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.570+0000 7f6d0de4c640 1 --2- 172.21.15.114:0/101557231 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6cec06ae70 0x7f6cec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.570+0000 7f6d0de4c640 1 --2- 172.21.15.114:0/101557231 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6cec06ae70 0x7f6cec06d330 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6d04036000 tx=0x7f6d04030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:04.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.574+0000 7f6cfe7fc640 1 -- 172.21.15.114:0/101557231 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6d00056df0 con 0x7f6d08159e40 2023-11-04T01:42:04.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.772+0000 7f6d100b0640 1 -- 172.21.15.114:0/101557231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d080c6560 con 0x7f6d08159e40 2023-11-04T01:42:04.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.772+0000 7f6cfe7fc640 1 -- 172.21.15.114:0/101557231 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f6d080c6560 con 0x7f6d08159e40 2023-11-04T01:42:04.775 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:04.775 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":81,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:58.174193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8013,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8013":{"gid":8013,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:04.775 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 81 2023-11-04T01:42:04.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.774+0000 7f6d100b0640 1 -- 172.21.15.114:0/101557231 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6cec06ae70 msgr2=0x7f6cec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.774+0000 7f6d100b0640 1 --2- 172.21.15.114:0/101557231 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6cec06ae70 0x7f6cec06d330 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6d04036000 tx=0x7f6d04030000 comp rx=0 tx=0).stop 2023-11-04T01:42:04.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.774+0000 7f6d100b0640 1 -- 172.21.15.114:0/101557231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d08159e40 msgr2=0x7f6d080c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.774+0000 7f6d100b0640 1 --2- 172.21.15.114:0/101557231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d08159e40 0x7f6d080c77b0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000ea00 tx=0x7f6d0000eec0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.774+0000 7f6d100b0640 1 -- 172.21.15.114:0/101557231 shutdown_connections 2023-11-04T01:42:04.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.774+0000 7f6d100b0640 1 --2- 172.21.15.114:0/101557231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d08159e40 0x7f6d080c77b0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.774+0000 7f6d100b0640 1 --2- 172.21.15.114:0/101557231 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6cec06ae70 0x7f6cec06d330 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.774+0000 7f6d100b0640 1 --2- 172.21.15.114:0/101557231 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6d0806fff0 0x7f6d0806c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.774+0000 7f6d100b0640 1 --2- 172.21.15.114:0/101557231 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6d0806bb60 0x7f6d080c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.774+0000 7f6d100b0640 1 -- 172.21.15.114:0/101557231 >> 172.21.15.114:0/101557231 conn(0x7f6d080cb530 msgr2=0x7f6d08157e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:04.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.774+0000 7f6d100b0640 1 -- 172.21.15.114:0/101557231 shutdown_connections 2023-11-04T01:42:04.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:04.774+0000 7f6d100b0640 1 -- 172.21.15.114:0/101557231 wait complete. 2023-11-04T01:42:04.787 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:42:05.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:42:09.788 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.898+0000 7f790344b640 1 Processor -- start 2023-11-04T01:42:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.898+0000 7f790344b640 1 -- start start 2023-11-04T01:42:09.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.899+0000 7f790344b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f78fc06d9c0 0x7f78fc0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.899+0000 7f790344b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78fc06c5f0 0x7f78fc071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.899+0000 7f790344b640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc06cc90 con 0x7f78fc0ade00 2023-11-04T01:42:09.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.899+0000 7f790344b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78fc0b0c40 con 0x7f78fc06d9c0 2023-11-04T01:42:09.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.899+0000 7f790344b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc071b50 con 0x7f78fc06c5f0 2023-11-04T01:42:09.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.899+0000 7f79009e6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f78fc06d9c0 0x7f78fc0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.899+0000 7f79009e6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f78fc06d9c0 0x7f78fc0710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60946/0 (socket says 172.21.15.114:60946) 2023-11-04T01:42:09.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.899+0000 7f79009e6640 1 -- 172.21.15.114:0/1479995107 learned_addr learned my addr 172.21.15.114:0/1479995107 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:09.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.899+0000 7f79019e8640 1 --2- 172.21.15.114:0/1479995107 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78fc06c5f0 0x7f78fc071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.899+0000 7f79009e6640 1 -- 172.21.15.114:0/1479995107 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78fc06c5f0 msgr2=0x7f78fc071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:09.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.899+0000 7f79009e6640 1 --2- 172.21.15.114:0/1479995107 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78fc06c5f0 0x7f78fc071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.899+0000 7f79009e6640 1 -- 172.21.15.114:0/1479995107 >> v1:172.21.15.141:6789/0 conn(0x7f78fc0ade00 legacy=0x7f78fc0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:09.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.899+0000 7f79009e6640 1 -- 172.21.15.114:0/1479995107 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc0b0e60 con 0x7f78fc06d9c0 2023-11-04T01:42:09.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.899+0000 7f79019e8640 1 --2- 172.21.15.114:0/1479995107 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78fc06c5f0 0x7f78fc071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:09.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.900+0000 7f79009e6640 1 --2- 172.21.15.114:0/1479995107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc06d9c0 0x7f78fc0710d0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009870 tx=0x7f78ec02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdc33f88440ea51 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.900+0000 7f78f3fff640 1 -- 172.21.15.114:0/1479995107 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec031740 con 0x7f78fc06d9c0 2023-11-04T01:42:09.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.900+0000 7f78f3fff640 1 -- 172.21.15.114:0/1479995107 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec0318a0 con 0x7f78fc06d9c0 2023-11-04T01:42:09.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.900+0000 7f78f3fff640 1 -- 172.21.15.114:0/1479995107 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec031c30 con 0x7f78fc06d9c0 2023-11-04T01:42:09.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.901+0000 7f790344b640 1 -- 172.21.15.114:0/1479995107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc06d9c0 msgr2=0x7f78fc0710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.901+0000 7f790344b640 1 --2- 172.21.15.114:0/1479995107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc06d9c0 0x7f78fc0710d0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009870 tx=0x7f78ec02b7e0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.901+0000 7f790344b640 1 -- 172.21.15.114:0/1479995107 shutdown_connections 2023-11-04T01:42:09.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.901+0000 7f790344b640 1 --2- 172.21.15.114:0/1479995107 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78fc06c5f0 0x7f78fc071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.901+0000 7f790344b640 1 --2- 172.21.15.114:0/1479995107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc06d9c0 0x7f78fc0710d0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.901+0000 7f790344b640 1 -- 172.21.15.114:0/1479995107 >> 172.21.15.114:0/1479995107 conn(0x7f78fc0cb530 msgr2=0x7f78fc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:09.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.901+0000 7f790344b640 1 -- 172.21.15.114:0/1479995107 shutdown_connections 2023-11-04T01:42:09.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.901+0000 7f790344b640 1 -- 172.21.15.114:0/1479995107 wait complete. 2023-11-04T01:42:09.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.902+0000 7f790344b640 1 Processor -- start 2023-11-04T01:42:09.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.902+0000 7f790344b640 1 -- start start 2023-11-04T01:42:09.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.903+0000 7f790344b640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78fc06c5f0 0x7f78fc1e4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.903+0000 7f790344b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc06d9c0 0x7f78fc1e5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.903+0000 7f790344b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78fc0ade00 0x7f78fc1e61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.903+0000 7f790344b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0c62a0 con 0x7f78fc06d9c0 2023-11-04T01:42:09.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.903+0000 7f790344b640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0c5f00 con 0x7f78fc06c5f0 2023-11-04T01:42:09.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.903+0000 7f790344b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc1e4b90 con 0x7f78fc0ade00 2023-11-04T01:42:09.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.903+0000 7f79009e6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc06d9c0 0x7f78fc1e5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.903+0000 7f79009e6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc06d9c0 0x7f78fc1e5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60958/0 (socket says 172.21.15.114:60958) 2023-11-04T01:42:09.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.903+0000 7f79009e6640 1 -- 172.21.15.114:0/344879513 learned_addr learned my addr 172.21.15.114:0/344879513 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:09.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.903+0000 7f79009e6640 1 -- 172.21.15.114:0/344879513 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78fc0ade00 msgr2=0x7f78fc1e61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.903+0000 7f79009e6640 1 --2- 172.21.15.114:0/344879513 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78fc0ade00 0x7f78fc1e61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.903+0000 7f79009e6640 1 -- 172.21.15.114:0/344879513 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78fc06c5f0 msgr2=0x7f78fc1e4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.903+0000 7f79009e6640 1 --2- 172.21.15.114:0/344879513 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78fc06c5f0 0x7f78fc1e4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.903+0000 7f79009e6640 1 -- 172.21.15.114:0/344879513 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec0094d0 con 0x7f78fc06d9c0 2023-11-04T01:42:09.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.903+0000 7f79009e6640 1 --2- 172.21.15.114:0/344879513 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc06d9c0 0x7f78fc1e5ca0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009870 tx=0x7f78ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.903+0000 7f78f1ffb640 1 -- 172.21.15.114:0/344879513 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec033c70 con 0x7f78fc06d9c0 2023-11-04T01:42:09.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.904+0000 7f78f1ffb640 1 -- 172.21.15.114:0/344879513 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec033dd0 con 0x7f78fc06d9c0 2023-11-04T01:42:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.904+0000 7f790344b640 1 -- 172.21.15.114:0/344879513 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc1e4e70 con 0x7f78fc06d9c0 2023-11-04T01:42:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.904+0000 7f78f1ffb640 1 -- 172.21.15.114:0/344879513 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec03c640 con 0x7f78fc06d9c0 2023-11-04T01:42:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.904+0000 7f790344b640 1 -- 172.21.15.114:0/344879513 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc15d050 con 0x7f78fc06d9c0 2023-11-04T01:42:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.905+0000 7f790344b640 1 -- 172.21.15.114:0/344879513 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc0c23d0 con 0x7f78fc06d9c0 2023-11-04T01:42:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.905+0000 7f78f1ffb640 1 -- 172.21.15.114:0/344879513 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f78ec03a040 con 0x7f78fc06d9c0 2023-11-04T01:42:09.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.906+0000 7f78f1ffb640 1 --2- 172.21.15.114:0/344879513 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f78e006aea0 0x7f78e006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.906+0000 7f78f1ffb640 1 -- 172.21.15.114:0/344879513 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7550+0+0 (secure 0 0 0) 0x7f78ec0ab830 con 0x7f78fc06d9c0 2023-11-04T01:42:09.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.906+0000 7f79011e7640 1 --2- 172.21.15.114:0/344879513 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f78e006aea0 0x7f78e006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.906+0000 7f79011e7640 1 --2- 172.21.15.114:0/344879513 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f78e006aea0 0x7f78e006d360 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f78f8003cc0 tx=0x7f78f80079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:09.910+0000 7f78f1ffb640 1 -- 172.21.15.114:0/344879513 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78ec076240 con 0x7f78fc06d9c0 2023-11-04T01:42:10.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:10.112+0000 7f790344b640 1 -- 172.21.15.114:0/344879513 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78fc0684b0 con 0x7f78fc06d9c0 2023-11-04T01:42:10.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:10.113+0000 7f78f1ffb640 1 -- 172.21.15.114:0/344879513 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f78ec079860 con 0x7f78fc06d9c0 2023-11-04T01:42:10.115 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:10.115 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":81,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:58.174193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8013,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8013":{"gid":8013,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:10.115 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 81 2023-11-04T01:42:10.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:10.115+0000 7f790344b640 1 -- 172.21.15.114:0/344879513 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f78e006aea0 msgr2=0x7f78e006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:10.115+0000 7f790344b640 1 --2- 172.21.15.114:0/344879513 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f78e006aea0 0x7f78e006d360 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f78f8003cc0 tx=0x7f78f80079b0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:10.115+0000 7f790344b640 1 -- 172.21.15.114:0/344879513 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc06d9c0 msgr2=0x7f78fc1e5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:10.115+0000 7f790344b640 1 --2- 172.21.15.114:0/344879513 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc06d9c0 0x7f78fc1e5ca0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009870 tx=0x7f78ec0046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:10.115+0000 7f790344b640 1 -- 172.21.15.114:0/344879513 shutdown_connections 2023-11-04T01:42:10.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:10.115+0000 7f790344b640 1 --2- 172.21.15.114:0/344879513 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f78fc0ade00 0x7f78fc1e61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:10.115+0000 7f790344b640 1 --2- 172.21.15.114:0/344879513 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78fc06d9c0 0x7f78fc1e5ca0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:10.115+0000 7f790344b640 1 --2- 172.21.15.114:0/344879513 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f78e006aea0 0x7f78e006d360 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:10.115+0000 7f790344b640 1 --2- 172.21.15.114:0/344879513 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f78fc06c5f0 0x7f78fc1e4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:10.115+0000 7f790344b640 1 -- 172.21.15.114:0/344879513 >> 172.21.15.114:0/344879513 conn(0x7f78fc0cb530 msgr2=0x7f78fc0b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:10.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:10.115+0000 7f790344b640 1 -- 172.21.15.114:0/344879513 shutdown_connections 2023-11-04T01:42:10.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:10.115+0000 7f790344b640 1 -- 172.21.15.114:0/344879513 wait complete. 2023-11-04T01:42:10.127 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:42:11.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-04T01:42:15.128 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:15.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.239+0000 7fa495056640 1 Processor -- start 2023-11-04T01:42:15.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.239+0000 7fa495056640 1 -- start start 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.239+0000 7fa495056640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa49015d100 0x7fa4900ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.239+0000 7fa495056640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa4900d1be0 0x7fa4900b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.239+0000 7fa495056640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4900b32b0 con 0x7fa49015d4e0 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.239+0000 7fa495056640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4900cee10 con 0x7fa4900d1be0 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.239+0000 7fa495056640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900b2980 con 0x7fa49015d100 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.240+0000 7fa48ed9d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa49015d100 0x7fa4900ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.240+0000 7fa48f59e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa4900d1be0 0x7fa4900b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.240+0000 7fa487fff640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fa49015d4e0 0x7fa4900d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:41394/0 (socket says 172.21.15.114:41394) 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.240+0000 7fa48f59e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa4900d1be0 0x7fa4900b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:44672/0 (socket says 172.21.15.114:44672) 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.240+0000 7fa487fff640 1 -- 172.21.15.114:0/2738226552 learned_addr learned my addr 172.21.15.114:0/2738226552 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.240+0000 7fa48ed9d640 1 --2- 172.21.15.114:0/2738226552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa49015d100 0x7fa4900ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:44294/0 (socket says 172.21.15.114:44294) 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.240+0000 7fa48ed9d640 1 -- 172.21.15.114:0/2738226552 >> v2:172.21.15.141:3300/0 conn(0x7fa4900d1be0 msgr2=0x7fa4900b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.240+0000 7fa48ed9d640 1 --2- 172.21.15.114:0/2738226552 >> v2:172.21.15.141:3300/0 conn(0x7fa4900d1be0 0x7fa4900b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.240+0000 7fa48ed9d640 1 -- 172.21.15.114:0/2738226552 >> v1:172.21.15.141:6789/0 conn(0x7fa49015d4e0 legacy=0x7fa4900d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.240+0000 7fa48ed9d640 1 -- 172.21.15.114:0/2738226552 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4900b2c60 con 0x7fa49015d100 2023-11-04T01:42:15.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.240+0000 7fa48f59e640 1 --2- 172.21.15.114:0/2738226552 >> v2:172.21.15.141:3300/0 conn(0x7fa4900d1be0 0x7fa4900b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:15.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.241+0000 7fa48ed9d640 1 --2- 172.21.15.114:0/2738226552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa49015d100 0x7fa4900ce510 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa4800097c0 tx=0x7fa48002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=177b7281f547f951 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.241+0000 7fa48e59c640 1 -- 172.21.15.114:0/2738226552 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480031800 con 0x7fa49015d100 2023-11-04T01:42:15.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.241+0000 7fa48e59c640 1 -- 172.21.15.114:0/2738226552 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa480031960 con 0x7fa49015d100 2023-11-04T01:42:15.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.241+0000 7fa48e59c640 1 -- 172.21.15.114:0/2738226552 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480031cf0 con 0x7fa49015d100 2023-11-04T01:42:15.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.242+0000 7fa495056640 1 -- 172.21.15.114:0/2738226552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa49015d100 msgr2=0x7fa4900ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.242+0000 7fa495056640 1 --2- 172.21.15.114:0/2738226552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa49015d100 0x7fa4900ce510 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa4800097c0 tx=0x7fa48002b8a0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.242+0000 7fa495056640 1 -- 172.21.15.114:0/2738226552 shutdown_connections 2023-11-04T01:42:15.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.242+0000 7fa495056640 1 --2- 172.21.15.114:0/2738226552 >> v2:172.21.15.141:3300/0 conn(0x7fa4900d1be0 0x7fa4900b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.242+0000 7fa495056640 1 --2- 172.21.15.114:0/2738226552 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa49015d100 0x7fa4900ce510 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.242+0000 7fa495056640 1 -- 172.21.15.114:0/2738226552 >> 172.21.15.114:0/2738226552 conn(0x7fa4900d2ef0 msgr2=0x7fa4900d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.242+0000 7fa495056640 1 -- 172.21.15.114:0/2738226552 shutdown_connections 2023-11-04T01:42:15.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.242+0000 7fa495056640 1 -- 172.21.15.114:0/2738226552 wait complete. 2023-11-04T01:42:15.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.243+0000 7fa495056640 1 Processor -- start 2023-11-04T01:42:15.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.243+0000 7fa495056640 1 -- start start 2023-11-04T01:42:15.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.244+0000 7fa495056640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4900d1be0 0x7fa49009de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.244+0000 7fa495056640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa49015d100 0x7fa49015c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.244+0000 7fa495056640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa49015d4e0 0x7fa4900b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.244+0000 7fa495056640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49015c960 con 0x7fa4900d1be0 2023-11-04T01:42:15.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.244+0000 7fa495056640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900ca060 con 0x7fa49015d100 2023-11-04T01:42:15.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.244+0000 7fa495056640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900ca340 con 0x7fa49015d4e0 2023-11-04T01:42:15.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.244+0000 7fa48ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4900d1be0 0x7fa49009de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.244+0000 7fa48ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4900d1be0 0x7fa49009de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60966/0 (socket says 172.21.15.114:60966) 2023-11-04T01:42:15.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.244+0000 7fa48ed9d640 1 -- 172.21.15.114:0/1573837240 learned_addr learned my addr 172.21.15.114:0/1573837240 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:15.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.244+0000 7fa48ed9d640 1 -- 172.21.15.114:0/1573837240 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa49015d4e0 msgr2=0x7fa4900b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.244+0000 7fa48ed9d640 1 --2- 172.21.15.114:0/1573837240 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa49015d4e0 0x7fa4900b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.244+0000 7fa48ed9d640 1 -- 172.21.15.114:0/1573837240 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa49015d100 msgr2=0x7fa49015c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.244+0000 7fa487fff640 1 --2- 172.21.15.114:0/1573837240 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa49015d100 0x7fa49015c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.244+0000 7fa48ed9d640 1 --2- 172.21.15.114:0/1573837240 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa49015d100 0x7fa49015c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.244+0000 7fa48ed9d640 1 -- 172.21.15.114:0/1573837240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa488009a70 con 0x7fa4900d1be0 2023-11-04T01:42:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.245+0000 7fa48ed9d640 1 --2- 172.21.15.114:0/1573837240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4900d1be0 0x7fa49009de80 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fa4800098e0 tx=0x7fa4800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.245+0000 7fa4877fe640 1 -- 172.21.15.114:0/1573837240 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48003bbf0 con 0x7fa4900d1be0 2023-11-04T01:42:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.245+0000 7fa4877fe640 1 -- 172.21.15.114:0/1573837240 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48003bd70 con 0x7fa4900d1be0 2023-11-04T01:42:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.245+0000 7fa495056640 1 -- 172.21.15.114:0/1573837240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4800093a0 con 0x7fa4900d1be0 2023-11-04T01:42:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.245+0000 7fa4877fe640 1 -- 172.21.15.114:0/1573837240 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480045630 con 0x7fa4900d1be0 2023-11-04T01:42:15.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.245+0000 7fa495056640 1 -- 172.21.15.114:0/1573837240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4900ca900 con 0x7fa4900d1be0 2023-11-04T01:42:15.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.246+0000 7fa495056640 1 -- 172.21.15.114:0/1573837240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4900684b0 con 0x7fa4900d1be0 2023-11-04T01:42:15.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.246+0000 7fa4877fe640 1 -- 172.21.15.114:0/1573837240 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa480045790 con 0x7fa4900d1be0 2023-11-04T01:42:15.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.247+0000 7fa4877fe640 1 --2- 172.21.15.114:0/1573837240 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa47006ae70 0x7fa47006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.247+0000 7fa4877fe640 1 -- 172.21.15.114:0/1573837240 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7550+0+0 (secure 0 0 0) 0x7fa48002e070 con 0x7fa4900d1be0 2023-11-04T01:42:15.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.247+0000 7fa487fff640 1 --2- 172.21.15.114:0/1573837240 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa47006ae70 0x7fa47006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.247+0000 7fa487fff640 1 --2- 172.21.15.114:0/1573837240 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa47006ae70 0x7fa47006d330 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa49009cd40 tx=0x7fa478009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.251+0000 7fa4877fe640 1 -- 172.21.15.114:0/1573837240 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa480076ae0 con 0x7fa4900d1be0 2023-11-04T01:42:15.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.451+0000 7fa495056640 1 -- 172.21.15.114:0/1573837240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4900d2cd0 con 0x7fa4900d1be0 2023-11-04T01:42:15.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.452+0000 7fa4877fe640 1 -- 172.21.15.114:0/1573837240 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fa480035020 con 0x7fa4900d1be0 2023-11-04T01:42:15.454 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:15.454 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":81,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:41:58.174193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8013,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8013":{"gid":8013,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 81 2023-11-04T01:42:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.453+0000 7fa495056640 1 -- 172.21.15.114:0/1573837240 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa47006ae70 msgr2=0x7fa47006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.453+0000 7fa495056640 1 --2- 172.21.15.114:0/1573837240 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa47006ae70 0x7fa47006d330 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa49009cd40 tx=0x7fa478009040 comp rx=0 tx=0).stop 2023-11-04T01:42:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.454+0000 7fa495056640 1 -- 172.21.15.114:0/1573837240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4900d1be0 msgr2=0x7fa49009de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.454+0000 7fa495056640 1 --2- 172.21.15.114:0/1573837240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4900d1be0 0x7fa49009de80 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fa4800098e0 tx=0x7fa4800046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.454+0000 7fa495056640 1 -- 172.21.15.114:0/1573837240 shutdown_connections 2023-11-04T01:42:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.454+0000 7fa495056640 1 --2- 172.21.15.114:0/1573837240 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa49015d4e0 0x7fa4900b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.454+0000 7fa495056640 1 --2- 172.21.15.114:0/1573837240 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa47006ae70 0x7fa47006d330 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.454+0000 7fa495056640 1 --2- 172.21.15.114:0/1573837240 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa49015d100 0x7fa49015c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.454+0000 7fa495056640 1 --2- 172.21.15.114:0/1573837240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4900d1be0 0x7fa49009de80 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.454+0000 7fa495056640 1 -- 172.21.15.114:0/1573837240 >> 172.21.15.114:0/1573837240 conn(0x7fa4900d2ef0 msgr2=0x7fa4900cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.454+0000 7fa495056640 1 -- 172.21.15.114:0/1573837240 shutdown_connections 2023-11-04T01:42:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:15.454+0000 7fa495056640 1 -- 172.21.15.114:0/1573837240 wait complete. 2023-11-04T01:42:15.466 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:42:18.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-11-04T01:42:20.467 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:20.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.576+0000 7fb1ad626640 1 Processor -- start 2023-11-04T01:42:20.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.576+0000 7fb1ad626640 1 -- start start 2023-11-04T01:42:20.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.577+0000 7fb1ad626640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb1a80d1be0 0x7fb1a8167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.577+0000 7fb1ad626640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a80b32b0 con 0x7fb1a815d4e0 2023-11-04T01:42:20.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.577+0000 7fb1ad626640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a80cee10 con 0x7fb1a815d100 2023-11-04T01:42:20.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.577+0000 7fb1ad626640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a80cec20 con 0x7fb1a80d1be0 2023-11-04T01:42:20.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.577+0000 7fb1a67fc640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb1a815d4e0 0x7fb1a80d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58576/0 (socket says 172.21.15.114:58576) 2023-11-04T01:42:20.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.577+0000 7fb1a67fc640 1 -- 172.21.15.114:0/48955385 learned_addr learned my addr 172.21.15.114:0/48955385 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:20.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a77fe640 1 --2- 172.21.15.114:0/48955385 >> v2:172.21.15.141:3300/0 conn(0x7fb1a80d1be0 0x7fb1a8167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a5ffb640 1 -- 172.21.15.114:0/48955385 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584210827 0 0) 0x7fb1a80b32b0 con 0x7fb1a815d4e0 2023-11-04T01:42:20.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a5ffb640 1 -- 172.21.15.114:0/48955385 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb190003520 con 0x7fb1a815d4e0 2023-11-04T01:42:20.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a5ffb640 1 -- 172.21.15.114:0/48955385 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 551329137 0 0) 0x7fb190003520 con 0x7fb1a815d4e0 2023-11-04T01:42:20.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a5ffb640 1 -- 172.21.15.114:0/48955385 >> v2:172.21.15.141:3300/0 conn(0x7fb1a80d1be0 msgr2=0x7fb1a8167e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:20.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a5ffb640 1 --2- 172.21.15.114:0/48955385 >> v2:172.21.15.141:3300/0 conn(0x7fb1a80d1be0 0x7fb1a8167e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a5ffb640 1 -- 172.21.15.114:0/48955385 >> v1:172.21.15.141:6789/0 conn(0x7fb1a815d100 legacy=0x7fb1a80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a5ffb640 1 -- 172.21.15.114:0/48955385 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a80b4750 con 0x7fb1a815d4e0 2023-11-04T01:42:20.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a5ffb640 1 -- 172.21.15.114:0/48955385 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fb19c001670 con 0x7fb1a815d4e0 2023-11-04T01:42:20.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a5ffb640 1 -- 172.21.15.114:0/48955385 >> v1:172.21.15.114:6789/0 conn(0x7fb1a815d4e0 legacy=0x7fb1a80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a5ffb640 1 --2- 172.21.15.114:0/48955385 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb190003970 0x7fb190003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a5ffb640 1 --2- 172.21.15.114:0/48955385 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1900047c0 0x7fb190004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a5ffb640 1 --2- 172.21.15.114:0/48955385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb190005180 0x7fb19000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a5ffb640 1 -- 172.21.15.114:0/48955385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19000bff0 con 0x7fb190005180 2023-11-04T01:42:20.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a5ffb640 1 -- 172.21.15.114:0/48955385 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19000c160 con 0x7fb1900047c0 2023-11-04T01:42:20.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a5ffb640 1 -- 172.21.15.114:0/48955385 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19000c320 con 0x7fb190003970 2023-11-04T01:42:20.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a77fe640 1 --2- 172.21.15.114:0/48955385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb190005180 0x7fb19000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a67fc640 1 --2- 172.21.15.114:0/48955385 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1900047c0 0x7fb190004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a6ffd640 1 --2- 172.21.15.114:0/48955385 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb190003970 0x7fb190003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a77fe640 1 -- 172.21.15.114:0/48955385 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb190003970 msgr2=0x7fb190003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:20.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a77fe640 1 --2- 172.21.15.114:0/48955385 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb190003970 0x7fb190003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a77fe640 1 -- 172.21.15.114:0/48955385 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1900047c0 msgr2=0x7fb190004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:20.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a77fe640 1 --2- 172.21.15.114:0/48955385 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb1900047c0 0x7fb190004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.578+0000 7fb1a77fe640 1 -- 172.21.15.114:0/48955385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb190003520 con 0x7fb190005180 2023-11-04T01:42:20.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.579+0000 7fb1a77fe640 1 -- 172.21.15.114:0/48955385 reap_dead start 2023-11-04T01:42:20.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.579+0000 7fb1a77fe640 1 --2- 172.21.15.114:0/48955385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb190005180 0x7fb19000b980 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009ac0 tx=0x7fb1900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2d1dde1954e60b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.579+0000 7fb1a5ffb640 1 -- 172.21.15.114:0/48955385 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0004020 con 0x7fb190005180 2023-11-04T01:42:20.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.579+0000 7fb1a5ffb640 1 -- 172.21.15.114:0/48955385 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a0004180 con 0x7fb190005180 2023-11-04T01:42:20.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.579+0000 7fb1a5ffb640 1 -- 172.21.15.114:0/48955385 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a002c710 con 0x7fb190005180 2023-11-04T01:42:20.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.580+0000 7fb1ad626640 1 -- 172.21.15.114:0/48955385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb190005180 msgr2=0x7fb19000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.580+0000 7fb1ad626640 1 --2- 172.21.15.114:0/48955385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb190005180 0x7fb19000b980 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009ac0 tx=0x7fb1900057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.580+0000 7fb1ad626640 1 -- 172.21.15.114:0/48955385 shutdown_connections 2023-11-04T01:42:20.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.580+0000 7fb1ad626640 1 --2- 172.21.15.114:0/48955385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb190005180 0x7fb19000b980 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.580+0000 7fb1ad626640 1 -- 172.21.15.114:0/48955385 >> 172.21.15.114:0/48955385 conn(0x7fb1a80d2ef0 msgr2=0x7fb1a80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:20.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.580+0000 7fb1ad626640 1 -- 172.21.15.114:0/48955385 shutdown_connections 2023-11-04T01:42:20.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.580+0000 7fb1ad626640 1 -- 172.21.15.114:0/48955385 wait complete. 2023-11-04T01:42:20.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.581+0000 7fb1ad626640 1 Processor -- start 2023-11-04T01:42:20.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.581+0000 7fb1ad626640 1 -- start start 2023-11-04T01:42:20.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1ad626640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb190005180 0x7fb1a80b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1ad626640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1a8160290 0x7fb1a80cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1ad626640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1a81f5ee0 0x7fb1a81f6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1ad626640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a815e0a0 con 0x7fb1a81f5ee0 2023-11-04T01:42:20.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1ad626640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a81f68a0 con 0x7fb190005180 2023-11-04T01:42:20.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1ad626640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a80b8520 con 0x7fb1a8160290 2023-11-04T01:42:20.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1a77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1a81f5ee0 0x7fb1a81f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1a77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1a81f5ee0 0x7fb1a81f6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45176/0 (socket says 172.21.15.114:45176) 2023-11-04T01:42:20.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1a77fe640 1 -- 172.21.15.114:0/3507351273 learned_addr learned my addr 172.21.15.114:0/3507351273 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:20.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1a6ffd640 1 --2- 172.21.15.114:0/3507351273 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb190005180 0x7fb1a80b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1a67fc640 1 --2- 172.21.15.114:0/3507351273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1a8160290 0x7fb1a80cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1a77fe640 1 -- 172.21.15.114:0/3507351273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1a8160290 msgr2=0x7fb1a80cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1a77fe640 1 --2- 172.21.15.114:0/3507351273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1a8160290 0x7fb1a80cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1a77fe640 1 -- 172.21.15.114:0/3507351273 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb190005180 msgr2=0x7fb1a80b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1a77fe640 1 --2- 172.21.15.114:0/3507351273 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb190005180 0x7fb1a80b7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1a77fe640 1 -- 172.21.15.114:0/3507351273 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a80b8240 con 0x7fb1a81f5ee0 2023-11-04T01:42:20.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.582+0000 7fb1a6ffd640 1 --2- 172.21.15.114:0/3507351273 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb190005180 0x7fb1a80b7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:20.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.583+0000 7fb1a77fe640 1 --2- 172.21.15.114:0/3507351273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1a81f5ee0 0x7fb1a81f6360 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb1a002c380 tx=0x7fb1a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.583+0000 7fb18f7fe640 1 -- 172.21.15.114:0/3507351273 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a003a070 con 0x7fb1a81f5ee0 2023-11-04T01:42:20.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.583+0000 7fb18f7fe640 1 -- 172.21.15.114:0/3507351273 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a000f0c0 con 0x7fb1a81f5ee0 2023-11-04T01:42:20.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.583+0000 7fb1ad626640 1 -- 172.21.15.114:0/3507351273 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a815d9e0 con 0x7fb1a81f5ee0 2023-11-04T01:42:20.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.583+0000 7fb18f7fe640 1 -- 172.21.15.114:0/3507351273 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0003830 con 0x7fb1a81f5ee0 2023-11-04T01:42:20.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.583+0000 7fb1ad626640 1 -- 172.21.15.114:0/3507351273 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a8160710 con 0x7fb1a81f5ee0 2023-11-04T01:42:20.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.584+0000 7fb1ad626640 1 -- 172.21.15.114:0/3507351273 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a815e1e0 con 0x7fb1a81f5ee0 2023-11-04T01:42:20.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.584+0000 7fb18f7fe640 1 -- 172.21.15.114:0/3507351273 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1a0003990 con 0x7fb1a81f5ee0 2023-11-04T01:42:20.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.584+0000 7fb18f7fe640 1 --2- 172.21.15.114:0/3507351273 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb19406aea0 0x7fb19406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.585+0000 7fb18f7fe640 1 -- 172.21.15.114:0/3507351273 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7550+0+0 (secure 0 0 0) 0x7fb1a00a9c50 con 0x7fb1a81f5ee0 2023-11-04T01:42:20.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.585+0000 7fb1a6ffd640 1 --2- 172.21.15.114:0/3507351273 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb19406aea0 0x7fb19406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.585+0000 7fb1a6ffd640 1 --2- 172.21.15.114:0/3507351273 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb19406aea0 0x7fb19406d360 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb198000f80 tx=0x7fb198009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.589+0000 7fb18f7fe640 1 -- 172.21.15.114:0/3507351273 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1a815e1e0 con 0x7fb1a81f5ee0 2023-11-04T01:42:20.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.791+0000 7fb1ad626640 1 -- 172.21.15.114:0/3507351273 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1a80684b0 con 0x7fb1a81f5ee0 2023-11-04T01:42:20.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.791+0000 7fb18f7fe640 1 -- 172.21.15.114:0/3507351273 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4992 (secure 0 0 0) 0x7fb1a00745d0 con 0x7fb1a81f5ee0 2023-11-04T01:42:20.793 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:20.793 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":82,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:15.600624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8013,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8013":{"gid":8013,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:42:15.600624+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:20.793 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 82 2023-11-04T01:42:20.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.793+0000 7fb1ad626640 1 -- 172.21.15.114:0/3507351273 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb19406aea0 msgr2=0x7fb19406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.793+0000 7fb1ad626640 1 --2- 172.21.15.114:0/3507351273 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb19406aea0 0x7fb19406d360 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb198000f80 tx=0x7fb198009040 comp rx=0 tx=0).stop 2023-11-04T01:42:20.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.793+0000 7fb1ad626640 1 -- 172.21.15.114:0/3507351273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1a81f5ee0 msgr2=0x7fb1a81f6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.793+0000 7fb1ad626640 1 --2- 172.21.15.114:0/3507351273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1a81f5ee0 0x7fb1a81f6360 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb1a002c380 tx=0x7fb1a0004730 comp rx=0 tx=0).stop 2023-11-04T01:42:20.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.793+0000 7fb1ad626640 1 -- 172.21.15.114:0/3507351273 shutdown_connections 2023-11-04T01:42:20.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.793+0000 7fb1ad626640 1 --2- 172.21.15.114:0/3507351273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1a81f5ee0 0x7fb1a81f6360 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.793+0000 7fb1ad626640 1 --2- 172.21.15.114:0/3507351273 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb1a8160290 0x7fb1a80cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.793+0000 7fb1ad626640 1 --2- 172.21.15.114:0/3507351273 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb19406aea0 0x7fb19406d360 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.793+0000 7fb1ad626640 1 --2- 172.21.15.114:0/3507351273 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb190005180 0x7fb1a80b7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.793+0000 7fb1ad626640 1 -- 172.21.15.114:0/3507351273 >> 172.21.15.114:0/3507351273 conn(0x7fb1a80d2ef0 msgr2=0x7fb1a815c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.793+0000 7fb1ad626640 1 -- 172.21.15.114:0/3507351273 shutdown_connections 2023-11-04T01:42:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:20.793+0000 7fb1ad626640 1 -- 172.21.15.114:0/3507351273 wait complete. 2023-11-04T01:42:20.805 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-11-04T01:42:20.806 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:42:20.822 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:20.831 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:42:20.832 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:42:20.833 DEBUG:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:42:20.833 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:20.903 INFO:teuthology.orchestra.run.smithi114.stdout:1699062118.120891.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:42:20.904 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062118.120891.core'] 2023-11-04T01:42:20.904 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062118.120891.core, deleting it 2023-11-04T01:42:20.905 DEBUG:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062118.120891.core 2023-11-04T01:42:20.980 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:21.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.118+0000 7f7de3426640 1 Processor -- start 2023-11-04T01:42:21.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.119+0000 7f7de3426640 1 -- start start 2023-11-04T01:42:21.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.119+0000 7f7de3426640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7ddc159e40 0x7f7ddc0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.119+0000 7f7de3426640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ddc071500 con 0x7f7ddc06bb60 2023-11-04T01:42:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.119+0000 7f7de3426640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ddc15dae0 con 0x7f7ddc070700 2023-11-04T01:42:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.119+0000 7f7de3426640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ddc070c60 con 0x7f7ddc159e40 2023-11-04T01:42:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7de09c1640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7ddc06bb60 0x7f7ddc06fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58586/0 (socket says 172.21.15.114:58586) 2023-11-04T01:42:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7de09c1640 1 -- 172.21.15.114:0/235964144 learned_addr learned my addr 172.21.15.114:0/235964144 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7ddbfff640 1 -- 172.21.15.114:0/235964144 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640473664 0 0) 0x7f7ddc071500 con 0x7f7ddc06bb60 2023-11-04T01:42:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7ddbfff640 1 -- 172.21.15.114:0/235964144 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dc4003520 con 0x7f7ddc06bb60 2023-11-04T01:42:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7de11c2640 1 --2- 172.21.15.114:0/235964144 >> v2:172.21.15.141:3300/0 conn(0x7f7ddc159e40 0x7f7ddc0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7ddbfff640 1 -- 172.21.15.114:0/235964144 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1558402258 0 0) 0x7f7dc4003520 con 0x7f7ddc06bb60 2023-11-04T01:42:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7ddbfff640 1 -- 172.21.15.114:0/235964144 >> v2:172.21.15.141:3300/0 conn(0x7f7ddc159e40 msgr2=0x7f7ddc0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7ddbfff640 1 --2- 172.21.15.114:0/235964144 >> v2:172.21.15.141:3300/0 conn(0x7f7ddc159e40 0x7f7ddc0b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7ddbfff640 1 -- 172.21.15.114:0/235964144 >> v1:172.21.15.141:6789/0 conn(0x7f7ddc070700 legacy=0x7f7ddc0cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7ddbfff640 1 -- 172.21.15.114:0/235964144 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc070f40 con 0x7f7ddc06bb60 2023-11-04T01:42:21.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7ddbfff640 1 -- 172.21.15.114:0/235964144 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f7dd0001670 con 0x7f7ddc06bb60 2023-11-04T01:42:21.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7ddbfff640 1 -- 172.21.15.114:0/235964144 >> v1:172.21.15.114:6789/0 conn(0x7f7ddc06bb60 legacy=0x7f7ddc06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7ddbfff640 1 --2- 172.21.15.114:0/235964144 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dc4003970 0x7f7dc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7ddbfff640 1 --2- 172.21.15.114:0/235964144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dc40047c0 0x7f7dc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7ddbfff640 1 --2- 172.21.15.114:0/235964144 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7dc4005380 0x7f7dc400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7ddbfff640 1 -- 172.21.15.114:0/235964144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc070c60 con 0x7f7dc40047c0 2023-11-04T01:42:21.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7ddbfff640 1 -- 172.21.15.114:0/235964144 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc400c210 con 0x7f7dc4003970 2023-11-04T01:42:21.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7ddbfff640 1 -- 172.21.15.114:0/235964144 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc400c3d0 con 0x7f7dc4005380 2023-11-04T01:42:21.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7de09c1640 1 --2- 172.21.15.114:0/235964144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dc40047c0 0x7f7dc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7de11c2640 1 --2- 172.21.15.114:0/235964144 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dc4003970 0x7f7dc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.120+0000 7f7de19c3640 1 --2- 172.21.15.114:0/235964144 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7dc4005380 0x7f7dc400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.121+0000 7f7de09c1640 1 -- 172.21.15.114:0/235964144 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7dc4005380 msgr2=0x7f7dc400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.121+0000 7f7de09c1640 1 --2- 172.21.15.114:0/235964144 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7dc4005380 0x7f7dc400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.121+0000 7f7de09c1640 1 -- 172.21.15.114:0/235964144 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dc4003970 msgr2=0x7f7dc4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.121+0000 7f7de09c1640 1 --2- 172.21.15.114:0/235964144 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dc4003970 0x7f7dc4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.121+0000 7f7de09c1640 1 -- 172.21.15.114:0/235964144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc4003520 con 0x7f7dc40047c0 2023-11-04T01:42:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.121+0000 7f7de19c3640 1 -- 172.21.15.114:0/235964144 reap_dead start 2023-11-04T01:42:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.121+0000 7f7de09c1640 1 --2- 172.21.15.114:0/235964144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dc40047c0 0x7f7dc4004c40 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000c240 tx=0x7f7dc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709d06d567e4f5f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.121+0000 7f7ddbfff640 1 -- 172.21.15.114:0/235964144 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0005ad0 con 0x7f7dc40047c0 2023-11-04T01:42:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.121+0000 7f7ddbfff640 1 -- 172.21.15.114:0/235964144 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd0005c50 con 0x7f7dc40047c0 2023-11-04T01:42:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.121+0000 7f7ddbfff640 1 -- 172.21.15.114:0/235964144 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd002c8b0 con 0x7f7dc40047c0 2023-11-04T01:42:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.122+0000 7f7de3426640 1 -- 172.21.15.114:0/235964144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dc40047c0 msgr2=0x7f7dc4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.122+0000 7f7de3426640 1 --2- 172.21.15.114:0/235964144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dc40047c0 0x7f7dc4004c40 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000c240 tx=0x7f7dc40057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.122+0000 7f7de3426640 1 -- 172.21.15.114:0/235964144 shutdown_connections 2023-11-04T01:42:21.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.122+0000 7f7de3426640 1 --2- 172.21.15.114:0/235964144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dc40047c0 0x7f7dc4004c40 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.122+0000 7f7de3426640 1 -- 172.21.15.114:0/235964144 >> 172.21.15.114:0/235964144 conn(0x7f7ddc0cb530 msgr2=0x7f7ddc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.122+0000 7f7de3426640 1 -- 172.21.15.114:0/235964144 shutdown_connections 2023-11-04T01:42:21.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.122+0000 7f7de3426640 1 -- 172.21.15.114:0/235964144 wait complete. 2023-11-04T01:42:21.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.123+0000 7f7de3426640 1 Processor -- start 2023-11-04T01:42:21.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.123+0000 7f7de3426640 1 -- start start 2023-11-04T01:42:21.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de3426640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dc40047c0 0x7f7ddc0acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de3426640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ddc15cff0 0x7f7ddc15a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de3426640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc15a760 0x7f7ddc1420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de3426640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc15abf0 con 0x7f7ddc15a760 2023-11-04T01:42:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de3426640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0ad2b0 con 0x7f7dc40047c0 2023-11-04T01:42:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de3426640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc142e60 con 0x7f7ddc15cff0 2023-11-04T01:42:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de19c3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc15a760 0x7f7ddc1420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de19c3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc15a760 0x7f7ddc1420f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45184/0 (socket says 172.21.15.114:45184) 2023-11-04T01:42:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de19c3640 1 -- 172.21.15.114:0/1164762013 learned_addr learned my addr 172.21.15.114:0/1164762013 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de09c1640 1 --2- 172.21.15.114:0/1164762013 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ddc15cff0 0x7f7ddc15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de11c2640 1 --2- 172.21.15.114:0/1164762013 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dc40047c0 0x7f7ddc0acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de19c3640 1 -- 172.21.15.114:0/1164762013 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ddc15cff0 msgr2=0x7f7ddc15a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de19c3640 1 --2- 172.21.15.114:0/1164762013 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ddc15cff0 0x7f7ddc15a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de19c3640 1 -- 172.21.15.114:0/1164762013 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dc40047c0 msgr2=0x7f7ddc0acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de19c3640 1 --2- 172.21.15.114:0/1164762013 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dc40047c0 0x7f7ddc0acd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de19c3640 1 -- 172.21.15.114:0/1164762013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc15c230 con 0x7f7ddc15a760 2023-11-04T01:42:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de09c1640 1 --2- 172.21.15.114:0/1164762013 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ddc15cff0 0x7f7ddc15a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de11c2640 1 --2- 172.21.15.114:0/1164762013 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dc40047c0 0x7f7ddc0acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7de19c3640 1 --2- 172.21.15.114:0/1164762013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc15a760 0x7f7ddc1420f0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc000c00 tx=0x7f7dcc00e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.124+0000 7f7dd9ffb640 1 -- 172.21.15.114:0/1164762013 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0052e0 con 0x7f7ddc15a760 2023-11-04T01:42:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.125+0000 7f7dd9ffb640 1 -- 172.21.15.114:0/1164762013 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc005440 con 0x7f7ddc15a760 2023-11-04T01:42:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.125+0000 7f7de3426640 1 -- 172.21.15.114:0/1164762013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ddc15c510 con 0x7f7ddc15a760 2023-11-04T01:42:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.125+0000 7f7dd9ffb640 1 -- 172.21.15.114:0/1164762013 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc003830 con 0x7f7ddc15a760 2023-11-04T01:42:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.125+0000 7f7de3426640 1 -- 172.21.15.114:0/1164762013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc15cad0 con 0x7f7ddc15a760 2023-11-04T01:42:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.126+0000 7f7de3426640 1 -- 172.21.15.114:0/1164762013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc0684b0 con 0x7f7ddc15a760 2023-11-04T01:42:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.126+0000 7f7dd9ffb640 1 -- 172.21.15.114:0/1164762013 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7dcc003990 con 0x7f7ddc15a760 2023-11-04T01:42:21.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.126+0000 7f7dd9ffb640 1 --2- 172.21.15.114:0/1164762013 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7dc806ae70 0x7f7dc806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.126+0000 7f7dd9ffb640 1 -- 172.21.15.114:0/1164762013 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7550+0+0 (secure 0 0 0) 0x7f7dcc089340 con 0x7f7ddc15a760 2023-11-04T01:42:21.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.127+0000 7f7de11c2640 1 --2- 172.21.15.114:0/1164762013 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7dc806ae70 0x7f7dc806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.127+0000 7f7de11c2640 1 --2- 172.21.15.114:0/1164762013 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7dc806ae70 0x7f7dc806d330 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4003b80 tx=0x7f7dd4009760 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.131+0000 7f7dd9ffb640 1 -- 172.21.15.114:0/1164762013 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7dcc053cc0 con 0x7f7ddc15a760 2023-11-04T01:42:21.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.331+0000 7f7de3426640 1 -- 172.21.15.114:0/1164762013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ddc0b0750 con 0x7f7ddc15a760 2023-11-04T01:42:21.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.331+0000 7f7dd9ffb640 1 -- 172.21.15.114:0/1164762013 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4992 (secure 0 0 0) 0x7f7dcc019090 con 0x7f7ddc15a760 2023-11-04T01:42:21.333 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:21.333 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":82,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8133,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:15.600624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8013,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8013":{"gid":8013,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":11,"addr":"172.21.15.114:6836/1629274449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1629274449},{"type":"v1","addr":"172.21.15.114:6836","nonce":1629274449}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:42:15.600624+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:21.334 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 82 2023-11-04T01:42:21.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.333+0000 7f7de3426640 1 -- 172.21.15.114:0/1164762013 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7dc806ae70 msgr2=0x7f7dc806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.333+0000 7f7de3426640 1 --2- 172.21.15.114:0/1164762013 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7dc806ae70 0x7f7dc806d330 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4003b80 tx=0x7f7dd4009760 comp rx=0 tx=0).stop 2023-11-04T01:42:21.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.333+0000 7f7de3426640 1 -- 172.21.15.114:0/1164762013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc15a760 msgr2=0x7f7ddc1420f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.333+0000 7f7de3426640 1 --2- 172.21.15.114:0/1164762013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc15a760 0x7f7ddc1420f0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc000c00 tx=0x7f7dcc00e820 comp rx=0 tx=0).stop 2023-11-04T01:42:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.333+0000 7f7de3426640 1 -- 172.21.15.114:0/1164762013 shutdown_connections 2023-11-04T01:42:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.333+0000 7f7de3426640 1 --2- 172.21.15.114:0/1164762013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc15a760 0x7f7ddc1420f0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.333+0000 7f7de3426640 1 --2- 172.21.15.114:0/1164762013 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7ddc15cff0 0x7f7ddc15a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.333+0000 7f7de3426640 1 --2- 172.21.15.114:0/1164762013 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7dc806ae70 0x7f7dc806d330 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.333+0000 7f7de3426640 1 --2- 172.21.15.114:0/1164762013 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dc40047c0 0x7f7ddc0acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.333+0000 7f7de3426640 1 -- 172.21.15.114:0/1164762013 >> 172.21.15.114:0/1164762013 conn(0x7f7ddc0cb530 msgr2=0x7f7ddc0af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.333+0000 7f7de3426640 1 -- 172.21.15.114:0/1164762013 shutdown_connections 2023-11-04T01:42:21.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.333+0000 7f7de3426640 1 -- 172.21.15.114:0/1164762013 wait complete. 2023-11-04T01:42:21.346 INFO:tasks.ceph.mds.b:Sent signal 9 2023-11-04T01:42:21.346 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:21.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:21.346 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 down 2023-11-04T01:42:21.374 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:42:21.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.514+0000 7f51c2b4c640 1 Processor -- start 2023-11-04T01:42:21.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.514+0000 7f51c2b4c640 1 -- start start 2023-11-04T01:42:21.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.514+0000 7f51c2b4c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f51bc0addd0 0x7f51bc0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.514+0000 7f51c2b4c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc0cd720 con 0x7f51bc06c220 2023-11-04T01:42:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.514+0000 7f51c2b4c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc0ae1b0 con 0x7f51bc0cc680 2023-11-04T01:42:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.514+0000 7f51c2b4c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc0ccb10 con 0x7f51bc0addd0 2023-11-04T01:42:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51c10e9640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f51bc06c220 0x7f51bc06f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58602/0 (socket says 172.21.15.114:58602) 2023-11-04T01:42:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51c10e9640 1 -- 172.21.15.114:0/4077319133 learned_addr learned my addr 172.21.15.114:0/4077319133 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51c08e8640 1 --2- 172.21.15.114:0/4077319133 >> v2:172.21.15.141:3300/0 conn(0x7f51bc0addd0 0x7f51bc0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51bb7fe640 1 -- 172.21.15.114:0/4077319133 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864633164 0 0) 0x7f51bc0cd720 con 0x7f51bc06c220 2023-11-04T01:42:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51bb7fe640 1 -- 172.21.15.114:0/4077319133 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51ac003520 con 0x7f51bc06c220 2023-11-04T01:42:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51bb7fe640 1 -- 172.21.15.114:0/4077319133 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2939187493 0 0) 0x7f51ac003520 con 0x7f51bc06c220 2023-11-04T01:42:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51bb7fe640 1 -- 172.21.15.114:0/4077319133 >> v2:172.21.15.141:3300/0 conn(0x7f51bc0addd0 msgr2=0x7f51bc0cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51bb7fe640 1 --2- 172.21.15.114:0/4077319133 >> v2:172.21.15.141:3300/0 conn(0x7f51bc0addd0 0x7f51bc0cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51bb7fe640 1 -- 172.21.15.114:0/4077319133 >> v1:172.21.15.141:6789/0 conn(0x7f51bc0cc680 legacy=0x7f51bc06bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51bb7fe640 1 -- 172.21.15.114:0/4077319133 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc0ccdf0 con 0x7f51bc06c220 2023-11-04T01:42:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51bb7fe640 1 -- 172.21.15.114:0/4077319133 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f51b40019f0 con 0x7f51bc06c220 2023-11-04T01:42:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51bb7fe640 1 -- 172.21.15.114:0/4077319133 >> v1:172.21.15.114:6789/0 conn(0x7f51bc06c220 legacy=0x7f51bc06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51bb7fe640 1 --2- 172.21.15.114:0/4077319133 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ac003970 0x7f51ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51bb7fe640 1 --2- 172.21.15.114:0/4077319133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51ac0047c0 0x7f51ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51bb7fe640 1 --2- 172.21.15.114:0/4077319133 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51ac005180 0x7f51ac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51bb7fe640 1 -- 172.21.15.114:0/4077319133 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0ccb10 con 0x7f51ac0047c0 2023-11-04T01:42:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51bb7fe640 1 -- 172.21.15.114:0/4077319133 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac00c020 con 0x7f51ac005180 2023-11-04T01:42:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51bb7fe640 1 -- 172.21.15.114:0/4077319133 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac00c1e0 con 0x7f51ac003970 2023-11-04T01:42:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51bbfff640 1 --2- 172.21.15.114:0/4077319133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51ac0047c0 0x7f51ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51c08e8640 1 --2- 172.21.15.114:0/4077319133 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ac003970 0x7f51ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.515+0000 7f51c10e9640 1 --2- 172.21.15.114:0/4077319133 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51ac005180 0x7f51ac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.516+0000 7f51bbfff640 1 -- 172.21.15.114:0/4077319133 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ac003970 msgr2=0x7f51ac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.516+0000 7f51bbfff640 1 --2- 172.21.15.114:0/4077319133 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51ac003970 0x7f51ac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.516+0000 7f51bbfff640 1 -- 172.21.15.114:0/4077319133 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51ac005180 msgr2=0x7f51ac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.516+0000 7f51bbfff640 1 --2- 172.21.15.114:0/4077319133 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51ac005180 0x7f51ac00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.516+0000 7f51c10e9640 1 -- 172.21.15.114:0/4077319133 reap_dead start 2023-11-04T01:42:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.516+0000 7f51bbfff640 1 -- 172.21.15.114:0/4077319133 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac003520 con 0x7f51ac0047c0 2023-11-04T01:42:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.516+0000 7f51bbfff640 1 --2- 172.21.15.114:0/4077319133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51ac0047c0 0x7f51ac004c40 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f51a8001750 tx=0x7f51ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461a91badc41ddea server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.516+0000 7f51bb7fe640 1 -- 172.21.15.114:0/4077319133 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a80052d0 con 0x7f51ac0047c0 2023-11-04T01:42:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.517+0000 7f51bb7fe640 1 -- 172.21.15.114:0/4077319133 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a802e050 con 0x7f51ac0047c0 2023-11-04T01:42:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.517+0000 7f51bb7fe640 1 -- 172.21.15.114:0/4077319133 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8003830 con 0x7f51ac0047c0 2023-11-04T01:42:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.517+0000 7f51c2b4c640 1 -- 172.21.15.114:0/4077319133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51ac0047c0 msgr2=0x7f51ac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.517+0000 7f51c2b4c640 1 --2- 172.21.15.114:0/4077319133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51ac0047c0 0x7f51ac004c40 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f51a8001750 tx=0x7f51ac0057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.517+0000 7f51c2b4c640 1 -- 172.21.15.114:0/4077319133 shutdown_connections 2023-11-04T01:42:21.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.517+0000 7f51c2b4c640 1 --2- 172.21.15.114:0/4077319133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51ac0047c0 0x7f51ac004c40 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.517+0000 7f51c2b4c640 1 -- 172.21.15.114:0/4077319133 >> 172.21.15.114:0/4077319133 conn(0x7f51bc0cb530 msgr2=0x7f51bc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.517+0000 7f51c2b4c640 1 -- 172.21.15.114:0/4077319133 shutdown_connections 2023-11-04T01:42:21.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.517+0000 7f51c2b4c640 1 -- 172.21.15.114:0/4077319133 wait complete. 2023-11-04T01:42:21.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.518+0000 7f51c2b4c640 1 Processor -- start 2023-11-04T01:42:21.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.518+0000 7f51c2b4c640 1 -- start start 2023-11-04T01:42:21.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.519+0000 7f51c2b4c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51ac0047c0 0x7f51bc14ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.519+0000 7f51c2b4c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51bc152000 0x7f51bc14f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.519+0000 7f51c2b4c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51bc14f950 0x7f51bc15b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.519+0000 7f51c2b4c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc150f60 con 0x7f51bc152000 2023-11-04T01:42:21.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.519+0000 7f51c2b4c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc151240 con 0x7f51ac0047c0 2023-11-04T01:42:21.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.519+0000 7f51c2b4c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc151520 con 0x7f51bc14f950 2023-11-04T01:42:21.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.519+0000 7f51bbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51bc152000 0x7f51bc14f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.519+0000 7f51bbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51bc152000 0x7f51bc14f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45198/0 (socket says 172.21.15.114:45198) 2023-11-04T01:42:21.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.519+0000 7f51bbfff640 1 -- 172.21.15.114:0/295485077 learned_addr learned my addr 172.21.15.114:0/295485077 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.519+0000 7f51c10e9640 1 --2- 172.21.15.114:0/295485077 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51bc14f950 0x7f51bc15b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.519+0000 7f51c08e8640 1 --2- 172.21.15.114:0/295485077 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51ac0047c0 0x7f51bc14ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.519+0000 7f51bbfff640 1 -- 172.21.15.114:0/295485077 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51bc14f950 msgr2=0x7f51bc15b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.519+0000 7f51bbfff640 1 --2- 172.21.15.114:0/295485077 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51bc14f950 0x7f51bc15b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.519+0000 7f51bbfff640 1 -- 172.21.15.114:0/295485077 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51ac0047c0 msgr2=0x7f51bc14ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.519+0000 7f51bbfff640 1 --2- 172.21.15.114:0/295485077 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51ac0047c0 0x7f51bc14ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.520+0000 7f51bbfff640 1 -- 172.21.15.114:0/295485077 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc151800 con 0x7f51bc152000 2023-11-04T01:42:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.520+0000 7f51c08e8640 1 --2- 172.21.15.114:0/295485077 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51ac0047c0 0x7f51bc14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.520+0000 7f51bbfff640 1 --2- 172.21.15.114:0/295485077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51bc152000 0x7f51bc14f410 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f51a802bc00 tx=0x7f51a8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.520+0000 7f51b97fa640 1 -- 172.21.15.114:0/295485077 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a80076c0 con 0x7f51bc152000 2023-11-04T01:42:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.520+0000 7f51b97fa640 1 -- 172.21.15.114:0/295485077 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a8007a30 con 0x7f51bc152000 2023-11-04T01:42:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.520+0000 7f51c2b4c640 1 -- 172.21.15.114:0/295485077 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51bc151ae0 con 0x7f51bc152000 2023-11-04T01:42:21.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.520+0000 7f51b97fa640 1 -- 172.21.15.114:0/295485077 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8006be0 con 0x7f51bc152000 2023-11-04T01:42:21.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.520+0000 7f51c2b4c640 1 -- 172.21.15.114:0/295485077 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc15bb50 con 0x7f51bc152000 2023-11-04T01:42:21.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.521+0000 7f51c2b4c640 1 -- 172.21.15.114:0/295485077 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51bc14fd60 con 0x7f51bc152000 2023-11-04T01:42:21.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.521+0000 7f51b97fa640 1 -- 172.21.15.114:0/295485077 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51a8006d40 con 0x7f51bc152000 2023-11-04T01:42:21.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.522+0000 7f51b97fa640 1 --2- 172.21.15.114:0/295485077 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51a006ae70 0x7f51a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.522+0000 7f51b97fa640 1 -- 172.21.15.114:0/295485077 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7550+0+0 (secure 0 0 0) 0x7f51a80ab910 con 0x7f51bc152000 2023-11-04T01:42:21.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.522+0000 7f51c08e8640 1 --2- 172.21.15.114:0/295485077 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51a006ae70 0x7f51a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.522+0000 7f51c08e8640 1 --2- 172.21.15.114:0/295485077 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51a006ae70 0x7f51a006d330 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f51bc168460 tx=0x7f51b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.526+0000 7f51b97fa640 1 -- 172.21.15.114:0/295485077 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51a8076320 con 0x7f51bc152000 2023-11-04T01:42:21.547 INFO:tasks.ceph.mds.b.smithi141.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:42:21.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.760+0000 7f51c2b4c640 1 -- 172.21.15.114:0/295485077 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f51bc151c70 con 0x7f51bc152000 2023-11-04T01:42:21.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.762+0000 7f51b97fa640 1 -- 172.21.15.114:0/295485077 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 8013 v83) v1 ==== 97+0+0 (secure 0 0 0) 0x7f51a8079940 con 0x7f51bc152000 2023-11-04T01:42:21.764 INFO:teuthology.orchestra.run.smithi114.stderr:failed mds gid 8013 2023-11-04T01:42:21.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.765+0000 7f51c2b4c640 1 -- 172.21.15.114:0/295485077 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51a006ae70 msgr2=0x7f51a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.765+0000 7f51c2b4c640 1 --2- 172.21.15.114:0/295485077 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51a006ae70 0x7f51a006d330 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f51bc168460 tx=0x7f51b0008040 comp rx=0 tx=0).stop 2023-11-04T01:42:21.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.765+0000 7f51c2b4c640 1 -- 172.21.15.114:0/295485077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51bc152000 msgr2=0x7f51bc14f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.765+0000 7f51c2b4c640 1 --2- 172.21.15.114:0/295485077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51bc152000 0x7f51bc14f410 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f51a802bc00 tx=0x7f51a8001120 comp rx=0 tx=0).stop 2023-11-04T01:42:21.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.765+0000 7f51c2b4c640 1 -- 172.21.15.114:0/295485077 shutdown_connections 2023-11-04T01:42:21.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.765+0000 7f51c2b4c640 1 --2- 172.21.15.114:0/295485077 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f51bc14f950 0x7f51bc15b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.765+0000 7f51c2b4c640 1 --2- 172.21.15.114:0/295485077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51bc152000 0x7f51bc14f410 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.765+0000 7f51c2b4c640 1 --2- 172.21.15.114:0/295485077 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f51a006ae70 0x7f51a006d330 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.765+0000 7f51c2b4c640 1 --2- 172.21.15.114:0/295485077 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f51ac0047c0 0x7f51bc14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.765+0000 7f51c2b4c640 1 -- 172.21.15.114:0/295485077 >> 172.21.15.114:0/295485077 conn(0x7f51bc0cb530 msgr2=0x7f51bc0b0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.765+0000 7f51c2b4c640 1 -- 172.21.15.114:0/295485077 shutdown_connections 2023-11-04T01:42:21.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.765+0000 7f51c2b4c640 1 -- 172.21.15.114:0/295485077 wait complete. 2023-11-04T01:42:21.778 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:42:21.778 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:42:21.778 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:42:21.779 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:21.779 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:21.779 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:42:21.779 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:42:21.779 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:42:21.782 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:42:21.782 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:21.856 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2023-11-04T01:42:21.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.881+0000 7f08d8056640 1 Processor -- start 2023-11-04T01:42:21.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.881+0000 7f08d8056640 1 -- start start 2023-11-04T01:42:21.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.882+0000 7f08d8056640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08d015d4e0 0x7f08d00d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.882+0000 7f08d8056640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f08d00d3b60 0x7f08d00d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.882+0000 7f08d8056640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d00b32b0 con 0x7f08d015d100 2023-11-04T01:42:21.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.882+0000 7f08d8056640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d00cec20 con 0x7f08d00d3b60 2023-11-04T01:42:21.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.882+0000 7f08d8056640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00cee10 con 0x7f08d015d4e0 2023-11-04T01:42:21.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.882+0000 7f08d65f3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f08d00d3b60 0x7f08d00d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.882+0000 7f08d65f3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f08d00d3b60 0x7f08d00d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45228/0 (socket says 172.21.15.114:45228) 2023-11-04T01:42:21.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.882+0000 7f08d65f3640 1 -- 172.21.15.114:0/3743212369 learned_addr learned my addr 172.21.15.114:0/3743212369 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:21.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.882+0000 7f08d55f1640 1 --2- 172.21.15.114:0/3743212369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08d015d4e0 0x7f08d00d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.882+0000 7f08d65f3640 1 -- 172.21.15.114:0/3743212369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08d015d4e0 msgr2=0x7f08d00d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.882+0000 7f08d65f3640 1 --2- 172.21.15.114:0/3743212369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08d015d4e0 0x7f08d00d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.882+0000 7f08d65f3640 1 -- 172.21.15.114:0/3743212369 >> v1:172.21.15.141:6789/0 conn(0x7f08d015d100 legacy=0x7f08d00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.882+0000 7f08d65f3640 1 -- 172.21.15.114:0/3743212369 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d00b4750 con 0x7f08d00d3b60 2023-11-04T01:42:21.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.882+0000 7f08d55f1640 1 --2- 172.21.15.114:0/3743212369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08d015d4e0 0x7f08d00d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:21.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.883+0000 7f08d65f3640 1 --2- 172.21.15.114:0/3743212369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d00d3b60 0x7f08d00d1a10 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009870 tx=0x7f08c802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad283ce7a4e28f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.883+0000 7f08d4df0640 1 -- 172.21.15.114:0/3743212369 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c8030840 con 0x7f08d00d3b60 2023-11-04T01:42:21.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.883+0000 7f08d4df0640 1 -- 172.21.15.114:0/3743212369 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c80309a0 con 0x7f08d00d3b60 2023-11-04T01:42:21.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.883+0000 7f08d4df0640 1 -- 172.21.15.114:0/3743212369 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c8030d30 con 0x7f08d00d3b60 2023-11-04T01:42:21.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.884+0000 7f08d8056640 1 -- 172.21.15.114:0/3743212369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d00d3b60 msgr2=0x7f08d00d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.884+0000 7f08d8056640 1 --2- 172.21.15.114:0/3743212369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d00d3b60 0x7f08d00d1a10 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009870 tx=0x7f08c802b980 comp rx=0 tx=0).stop 2023-11-04T01:42:21.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.884+0000 7f08d8056640 1 -- 172.21.15.114:0/3743212369 shutdown_connections 2023-11-04T01:42:21.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.884+0000 7f08d8056640 1 --2- 172.21.15.114:0/3743212369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d00d3b60 0x7f08d00d1a10 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.884+0000 7f08d8056640 1 --2- 172.21.15.114:0/3743212369 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08d015d4e0 0x7f08d00d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.884+0000 7f08d8056640 1 -- 172.21.15.114:0/3743212369 >> 172.21.15.114:0/3743212369 conn(0x7f08d00d2ef0 msgr2=0x7f08d00d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.884+0000 7f08d8056640 1 -- 172.21.15.114:0/3743212369 shutdown_connections 2023-11-04T01:42:21.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.884+0000 7f08d8056640 1 -- 172.21.15.114:0/3743212369 wait complete. 2023-11-04T01:42:21.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.885+0000 7f08d8056640 1 Processor -- start 2023-11-04T01:42:21.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.885+0000 7f08d8056640 1 -- start start 2023-11-04T01:42:21.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d8056640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d00d3b60 0x7f08d00cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d8056640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08d015d100 0x7f08d009cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d8056640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08d015d4e0 0x7f08d015ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d8056640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d009fb30 con 0x7f08d00d3b60 2023-11-04T01:42:21.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d8056640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d01507e0 con 0x7f08d015d4e0 2023-11-04T01:42:21.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d8056640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00cb0b0 con 0x7f08d015d100 2023-11-04T01:42:21.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d5df2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d00d3b60 0x7f08d00cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d5df2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d00d3b60 0x7f08d00cb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45234/0 (socket says 172.21.15.114:45234) 2023-11-04T01:42:21.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d5df2640 1 -- 172.21.15.114:0/3985434673 learned_addr learned my addr 172.21.15.114:0/3985434673 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:21.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d65f3640 1 --2- 172.21.15.114:0/3985434673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08d015d4e0 0x7f08d015ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d55f1640 1 --2- 172.21.15.114:0/3985434673 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08d015d100 0x7f08d009cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d5df2640 1 -- 172.21.15.114:0/3985434673 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08d015d100 msgr2=0x7f08d009cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d5df2640 1 --2- 172.21.15.114:0/3985434673 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08d015d100 0x7f08d009cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d5df2640 1 -- 172.21.15.114:0/3985434673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08d015d4e0 msgr2=0x7f08d015ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d5df2640 1 --2- 172.21.15.114:0/3985434673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08d015d4e0 0x7f08d015ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d5df2640 1 -- 172.21.15.114:0/3985434673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c80094d0 con 0x7f08d00d3b60 2023-11-04T01:42:21.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08d5df2640 1 --2- 172.21.15.114:0/3985434673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d00d3b60 0x7f08d00cb4a0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00c7c0 tx=0x7f08cc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08c67fc640 1 -- 172.21.15.114:0/3985434673 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc003bc0 con 0x7f08d00d3b60 2023-11-04T01:42:21.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.886+0000 7f08c67fc640 1 -- 172.21.15.114:0/3985434673 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc003d40 con 0x7f08d00d3b60 2023-11-04T01:42:21.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.887+0000 7f08d8056640 1 -- 172.21.15.114:0/3985434673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d00ca530 con 0x7f08d00d3b60 2023-11-04T01:42:21.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.887+0000 7f08c67fc640 1 -- 172.21.15.114:0/3985434673 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00aa30 con 0x7f08d00d3b60 2023-11-04T01:42:21.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.887+0000 7f08d8056640 1 -- 172.21.15.114:0/3985434673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d00caaf0 con 0x7f08d00d3b60 2023-11-04T01:42:21.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.887+0000 7f08d8056640 1 -- 172.21.15.114:0/3985434673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d009fca0 con 0x7f08d00d3b60 2023-11-04T01:42:21.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.888+0000 7f08c67fc640 1 -- 172.21.15.114:0/3985434673 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08cc00ab90 con 0x7f08d00d3b60 2023-11-04T01:42:21.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.888+0000 7f08c67fc640 1 --2- 172.21.15.114:0/3985434673 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08b406ae70 0x7f08b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.888+0000 7f08c67fc640 1 -- 172.21.15.114:0/3985434673 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7608+0+0 (secure 0 0 0) 0x7f08cc089c20 con 0x7f08d00d3b60 2023-11-04T01:42:21.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.888+0000 7f08d55f1640 1 --2- 172.21.15.114:0/3985434673 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08b406ae70 0x7f08b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.889+0000 7f08d55f1640 1 --2- 172.21.15.114:0/3985434673 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08b406ae70 0x7f08b406d330 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f08d0150a50 tx=0x7f08c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:21.892+0000 7f08c67fc640 1 -- 172.21.15.114:0/3985434673 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08cc054560 con 0x7f08d00d3b60 2023-11-04T01:42:22.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:22.098+0000 7f08d8056640 1 -- 172.21.15.114:0/3985434673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08d00684b0 con 0x7f08d00d3b60 2023-11-04T01:42:22.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:22.099+0000 7f08c67fc640 1 -- 172.21.15.114:0/3985434673 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4149 (secure 0 0 0) 0x7f08cc057b80 con 0x7f08d00d3b60 2023-11-04T01:42:22.100 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:22.101 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":84,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:21.766604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:22.101 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 84 2023-11-04T01:42:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:22.101+0000 7f08d8056640 1 -- 172.21.15.114:0/3985434673 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08b406ae70 msgr2=0x7f08b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:22.101+0000 7f08d8056640 1 --2- 172.21.15.114:0/3985434673 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08b406ae70 0x7f08b406d330 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f08d0150a50 tx=0x7f08c0008040 comp rx=0 tx=0).stop 2023-11-04T01:42:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:22.101+0000 7f08d8056640 1 -- 172.21.15.114:0/3985434673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d00d3b60 msgr2=0x7f08d00cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:22.101+0000 7f08d8056640 1 --2- 172.21.15.114:0/3985434673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d00d3b60 0x7f08d00cb4a0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00c7c0 tx=0x7f08cc00cc80 comp rx=0 tx=0).stop 2023-11-04T01:42:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:22.101+0000 7f08d8056640 1 -- 172.21.15.114:0/3985434673 shutdown_connections 2023-11-04T01:42:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:22.101+0000 7f08d8056640 1 --2- 172.21.15.114:0/3985434673 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f08b406ae70 0x7f08b406d330 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:22.101+0000 7f08d8056640 1 --2- 172.21.15.114:0/3985434673 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f08d015d4e0 0x7f08d015ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:22.101+0000 7f08d8056640 1 --2- 172.21.15.114:0/3985434673 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08d015d100 0x7f08d009cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:22.101+0000 7f08d8056640 1 --2- 172.21.15.114:0/3985434673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d00d3b60 0x7f08d00cb4a0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:22.101+0000 7f08d8056640 1 -- 172.21.15.114:0/3985434673 >> 172.21.15.114:0/3985434673 conn(0x7f08d00d2ef0 msgr2=0x7f08d00aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:22.101+0000 7f08d8056640 1 -- 172.21.15.114:0/3985434673 shutdown_connections 2023-11-04T01:42:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:22.101+0000 7f08d8056640 1 -- 172.21.15.114:0/3985434673 wait complete. 2023-11-04T01:42:22.113 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:42:25.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-04T01:42:25.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:42:27.114 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.223+0000 7f282fbb6640 1 Processor -- start 2023-11-04T01:42:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.223+0000 7f282fbb6640 1 -- start start 2023-11-04T01:42:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.224+0000 7f282fbb6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28280b0c40 0x7f282806fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.224+0000 7f282fbb6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2828071500 con 0x7f2828159e40 2023-11-04T01:42:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.224+0000 7f282fbb6640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282815dae0 con 0x7f282806bb60 2023-11-04T01:42:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.224+0000 7f282fbb6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2828070c60 con 0x7f28280b0c40 2023-11-04T01:42:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.224+0000 7f282d952640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2828159e40 0x7f28280b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52204/0 (socket says 172.21.15.114:52204) 2023-11-04T01:42:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.224+0000 7f282d952640 1 -- 172.21.15.114:0/1629513805 learned_addr learned my addr 172.21.15.114:0/1629513805 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.224+0000 7f282c950640 1 -- 172.21.15.114:0/1629513805 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892711453 0 0) 0x7f2828071500 con 0x7f2828159e40 2023-11-04T01:42:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.224+0000 7f282c950640 1 -- 172.21.15.114:0/1629513805 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2814003520 con 0x7f2828159e40 2023-11-04T01:42:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.224+0000 7f282d151640 1 --2- 172.21.15.114:0/1629513805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28280b0c40 0x7f282806fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282c950640 1 -- 172.21.15.114:0/1629513805 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1770060685 0 0) 0x7f2814003520 con 0x7f2828159e40 2023-11-04T01:42:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282c950640 1 -- 172.21.15.114:0/1629513805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28280b0c40 msgr2=0x7f282806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282c950640 1 --2- 172.21.15.114:0/1629513805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28280b0c40 0x7f282806fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282c950640 1 -- 172.21.15.114:0/1629513805 >> v1:172.21.15.141:6789/0 conn(0x7f282806bb60 legacy=0x7f28280cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282c950640 1 -- 172.21.15.114:0/1629513805 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2828070f40 con 0x7f2828159e40 2023-11-04T01:42:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282d151640 1 --2- 172.21.15.114:0/1629513805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28280b0c40 0x7f282806fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282c950640 1 -- 172.21.15.114:0/1629513805 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f2824001670 con 0x7f2828159e40 2023-11-04T01:42:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282c950640 1 -- 172.21.15.114:0/1629513805 >> v1:172.21.15.114:6789/0 conn(0x7f2828159e40 legacy=0x7f28280b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282c950640 1 --2- 172.21.15.114:0/1629513805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28280b0c40 0x7f28140039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282c950640 1 --2- 172.21.15.114:0/1629513805 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2814003f90 0x7f28140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282c950640 1 --2- 172.21.15.114:0/1629513805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2814004d00 0x7f2814005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282c950640 1 -- 172.21.15.114:0/1629513805 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2828070c60 con 0x7f2814004d00 2023-11-04T01:42:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282c950640 1 -- 172.21.15.114:0/1629513805 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281400bb70 con 0x7f2814003f90 2023-11-04T01:42:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282c950640 1 -- 172.21.15.114:0/1629513805 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281400bd30 con 0x7f28280b0c40 2023-11-04T01:42:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282e153640 1 --2- 172.21.15.114:0/1629513805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2814004d00 0x7f2814005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282d952640 1 --2- 172.21.15.114:0/1629513805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28280b0c40 0x7f28140039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282d151640 1 --2- 172.21.15.114:0/1629513805 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2814003f90 0x7f28140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282e153640 1 -- 172.21.15.114:0/1629513805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28280b0c40 msgr2=0x7f28140039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282e153640 1 --2- 172.21.15.114:0/1629513805 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28280b0c40 0x7f28140039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282e153640 1 -- 172.21.15.114:0/1629513805 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2814003f90 msgr2=0x7f28140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282e153640 1 --2- 172.21.15.114:0/1629513805 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2814003f90 0x7f28140047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.225+0000 7f282e153640 1 -- 172.21.15.114:0/1629513805 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2814003520 con 0x7f2814004d00 2023-11-04T01:42:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.226+0000 7f282e153640 1 --2- 172.21.15.114:0/1629513805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2814004d00 0x7f2814005180 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f2820001e50 tx=0x7f28140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1e70f0529981a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.226+0000 7f282c950640 1 -- 172.21.15.114:0/1629513805 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2820003b70 con 0x7f2814004d00 2023-11-04T01:42:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.226+0000 7f282c950640 1 -- 172.21.15.114:0/1629513805 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2820003cd0 con 0x7f2814004d00 2023-11-04T01:42:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.226+0000 7f282c950640 1 -- 172.21.15.114:0/1629513805 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2820005310 con 0x7f2814004d00 2023-11-04T01:42:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.227+0000 7f282fbb6640 1 -- 172.21.15.114:0/1629513805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2814004d00 msgr2=0x7f2814005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.227+0000 7f282fbb6640 1 --2- 172.21.15.114:0/1629513805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2814004d00 0x7f2814005180 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f2820001e50 tx=0x7f28140057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.227+0000 7f282e153640 1 -- 172.21.15.114:0/1629513805 reap_dead start 2023-11-04T01:42:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.227+0000 7f282fbb6640 1 -- 172.21.15.114:0/1629513805 shutdown_connections 2023-11-04T01:42:27.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.227+0000 7f282fbb6640 1 -- 172.21.15.114:0/1629513805 >> 172.21.15.114:0/1629513805 conn(0x7f28280cb530 msgr2=0x7f28280cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.227+0000 7f282fbb6640 1 -- 172.21.15.114:0/1629513805 shutdown_connections 2023-11-04T01:42:27.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.227+0000 7f282fbb6640 1 -- 172.21.15.114:0/1629513805 wait complete. 2023-11-04T01:42:27.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.228+0000 7f282fbb6640 1 Processor -- start 2023-11-04T01:42:27.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.228+0000 7f282fbb6640 1 -- start start 2023-11-04T01:42:27.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282fbb6640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f28280c1420 0x7f28281478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282fbb6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28280c53f0 0x7f282815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282fbb6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815e280 0x7f2828144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282fbb6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282815e700 con 0x7f282815e280 2023-11-04T01:42:27.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282fbb6640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28280c1800 con 0x7f28280c1420 2023-11-04T01:42:27.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282fbb6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28280c4f60 con 0x7f28280c53f0 2023-11-04T01:42:27.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282e153640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815e280 0x7f2828144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282e153640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815e280 0x7f2828144e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56956/0 (socket says 172.21.15.114:56956) 2023-11-04T01:42:27.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282e153640 1 -- 172.21.15.114:0/2870371759 learned_addr learned my addr 172.21.15.114:0/2870371759 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:27.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282d151640 1 --2- 172.21.15.114:0/2870371759 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28280c53f0 0x7f282815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282d952640 1 --2- 172.21.15.114:0/2870371759 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f28280c1420 0x7f28281478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282e153640 1 -- 172.21.15.114:0/2870371759 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28280c53f0 msgr2=0x7f282815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282e153640 1 --2- 172.21.15.114:0/2870371759 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28280c53f0 0x7f282815dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282e153640 1 -- 172.21.15.114:0/2870371759 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f28280c1420 msgr2=0x7f28281478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282e153640 1 --2- 172.21.15.114:0/2870371759 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f28280c1420 0x7f28281478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282e153640 1 -- 172.21.15.114:0/2870371759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2828147e00 con 0x7f282815e280 2023-11-04T01:42:27.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282d151640 1 --2- 172.21.15.114:0/2870371759 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28280c53f0 0x7f282815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:27.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282d952640 1 --2- 172.21.15.114:0/2870371759 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f28280c1420 0x7f28281478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:27.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282e153640 1 --2- 172.21.15.114:0/2870371759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815e280 0x7f2828144e60 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f2820001f40 tx=0x7f28200014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f281e7fc640 1 -- 172.21.15.114:0/2870371759 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282003e070 con 0x7f282815e280 2023-11-04T01:42:27.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f281e7fc640 1 -- 172.21.15.114:0/2870371759 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2820003e40 con 0x7f282815e280 2023-11-04T01:42:27.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282fbb6640 1 -- 172.21.15.114:0/2870371759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28280c4350 con 0x7f282815e280 2023-11-04T01:42:27.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f281e7fc640 1 -- 172.21.15.114:0/2870371759 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2820006d90 con 0x7f282815e280 2023-11-04T01:42:27.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.229+0000 7f282fbb6640 1 -- 172.21.15.114:0/2870371759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28280c4910 con 0x7f282815e280 2023-11-04T01:42:27.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.230+0000 7f282fbb6640 1 -- 172.21.15.114:0/2870371759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28280684b0 con 0x7f282815e280 2023-11-04T01:42:27.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.231+0000 7f281e7fc640 1 -- 172.21.15.114:0/2870371759 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2820041070 con 0x7f282815e280 2023-11-04T01:42:27.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.231+0000 7f281e7fc640 1 --2- 172.21.15.114:0/2870371759 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f280c06aea0 0x7f280c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.231+0000 7f281e7fc640 1 -- 172.21.15.114:0/2870371759 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7608+0+0 (secure 0 0 0) 0x7f28200aac50 con 0x7f282815e280 2023-11-04T01:42:27.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.231+0000 7f282d952640 1 --2- 172.21.15.114:0/2870371759 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f280c06aea0 0x7f280c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.232+0000 7f282d952640 1 --2- 172.21.15.114:0/2870371759 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f280c06aea0 0x7f280c06d360 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2824004840 tx=0x7f2824009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.235+0000 7f281e7fc640 1 -- 172.21.15.114:0/2870371759 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2820075500 con 0x7f282815e280 2023-11-04T01:42:27.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.440+0000 7f282fbb6640 1 -- 172.21.15.114:0/2870371759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28280c8de0 con 0x7f282815e280 2023-11-04T01:42:27.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.441+0000 7f281e7fc640 1 -- 172.21.15.114:0/2870371759 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4945 (secure 0 0 0) 0x7f2820078b20 con 0x7f282815e280 2023-11-04T01:42:27.442 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:27.443 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8262,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:21.785691+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:resolve","state_seq":10,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:27.443 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 85 2023-11-04T01:42:27.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.443+0000 7f282fbb6640 1 -- 172.21.15.114:0/2870371759 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f280c06aea0 msgr2=0x7f280c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.443+0000 7f282fbb6640 1 --2- 172.21.15.114:0/2870371759 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f280c06aea0 0x7f280c06d360 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2824004840 tx=0x7f2824009040 comp rx=0 tx=0).stop 2023-11-04T01:42:27.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.443+0000 7f282fbb6640 1 -- 172.21.15.114:0/2870371759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815e280 msgr2=0x7f2828144e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.443+0000 7f282fbb6640 1 --2- 172.21.15.114:0/2870371759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815e280 0x7f2828144e60 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f2820001f40 tx=0x7f28200014a0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.443+0000 7f282fbb6640 1 -- 172.21.15.114:0/2870371759 shutdown_connections 2023-11-04T01:42:27.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.443+0000 7f282fbb6640 1 --2- 172.21.15.114:0/2870371759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815e280 0x7f2828144e60 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.443+0000 7f282fbb6640 1 --2- 172.21.15.114:0/2870371759 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f28280c53f0 0x7f282815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.443+0000 7f282fbb6640 1 --2- 172.21.15.114:0/2870371759 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f280c06aea0 0x7f280c06d360 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.443+0000 7f282fbb6640 1 --2- 172.21.15.114:0/2870371759 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f28280c1420 0x7f28281478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.443+0000 7f282fbb6640 1 -- 172.21.15.114:0/2870371759 >> 172.21.15.114:0/2870371759 conn(0x7f28280cb530 msgr2=0x7f28280ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.443+0000 7f282fbb6640 1 -- 172.21.15.114:0/2870371759 shutdown_connections 2023-11-04T01:42:27.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.443+0000 7f282fbb6640 1 -- 172.21.15.114:0/2870371759 wait complete. 2023-11-04T01:42:27.457 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:42:27.457 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:27.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.555+0000 7facd8705640 1 Processor -- start 2023-11-04T01:42:27.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.555+0000 7facd8705640 1 -- start start 2023-11-04T01:42:27.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.556+0000 7facd8705640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7facd015d4e0 0x7facd00ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.556+0000 7facd8705640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd00b25a0 con 0x7facd00ced90 2023-11-04T01:42:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.556+0000 7facd8705640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd00b2300 con 0x7facd00ca8b0 2023-11-04T01:42:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.556+0000 7facd8705640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd015d8c0 con 0x7facd015d4e0 2023-11-04T01:42:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.556+0000 7facd64a1640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7facd015d4e0 0x7facd00ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.557+0000 7facd5ca0640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7facd00ced90 0x7facd00ca1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52216/0 (socket says 172.21.15.114:52216) 2023-11-04T01:42:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.557+0000 7facd5ca0640 1 -- 172.21.15.114:0/2811911956 learned_addr learned my addr 172.21.15.114:0/2811911956 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.557+0000 7facd64a1640 1 -- 172.21.15.114:0/2811911956 >> v1:172.21.15.141:6789/0 conn(0x7facd00ca8b0 legacy=0x7facd006a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.557+0000 7facd64a1640 1 -- 172.21.15.114:0/2811911956 >> v1:172.21.15.114:6789/0 conn(0x7facd00ced90 legacy=0x7facd00ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.557+0000 7facd549f640 1 -- 172.21.15.114:0/2811911956 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619531966 0 0) 0x7facd00b25a0 con 0x7facd00ced90 2023-11-04T01:42:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.557+0000 7facd64a1640 1 -- 172.21.15.114:0/2811911956 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd015e5f0 con 0x7facd015d4e0 2023-11-04T01:42:27.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.558+0000 7facd64a1640 1 --2- 172.21.15.114:0/2811911956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facd015d4e0 0x7facd00ce850 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7faccc009dc0 tx=0x7faccc02be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a596e2419367a27a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.558+0000 7facd549f640 1 -- 172.21.15.114:0/2811911956 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc02cc40 con 0x7facd015d4e0 2023-11-04T01:42:27.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.558+0000 7facd549f640 1 -- 172.21.15.114:0/2811911956 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc02cda0 con 0x7facd015d4e0 2023-11-04T01:42:27.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.558+0000 7facd549f640 1 -- 172.21.15.114:0/2811911956 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc034660 con 0x7facd015d4e0 2023-11-04T01:42:27.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.558+0000 7facd8705640 1 -- 172.21.15.114:0/2811911956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facd015d4e0 msgr2=0x7facd00ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.558+0000 7facd8705640 1 --2- 172.21.15.114:0/2811911956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facd015d4e0 0x7facd00ce850 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7faccc009dc0 tx=0x7faccc02be90 comp rx=0 tx=0).stop 2023-11-04T01:42:27.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.558+0000 7facd8705640 1 -- 172.21.15.114:0/2811911956 shutdown_connections 2023-11-04T01:42:27.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.558+0000 7facd8705640 1 --2- 172.21.15.114:0/2811911956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facd015d4e0 0x7facd00ce850 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.558+0000 7facd8705640 1 -- 172.21.15.114:0/2811911956 >> 172.21.15.114:0/2811911956 conn(0x7facd00b1640 msgr2=0x7facd00b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.558+0000 7facd8705640 1 -- 172.21.15.114:0/2811911956 shutdown_connections 2023-11-04T01:42:27.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.558+0000 7facd8705640 1 -- 172.21.15.114:0/2811911956 wait complete. 2023-11-04T01:42:27.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.559+0000 7facd8705640 1 Processor -- start 2023-11-04T01:42:27.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.559+0000 7facd8705640 1 -- start start 2023-11-04T01:42:27.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.560+0000 7facd8705640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7facd00ca8b0 0x7facd00c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.560+0000 7facd8705640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7facd00ced90 0x7facd0070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.560+0000 7facd8705640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facd015d4e0 0x7facd0157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.560+0000 7facd8705640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd00c3680 con 0x7facd015d4e0 2023-11-04T01:42:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.560+0000 7facd8705640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd00c6c20 con 0x7facd00ced90 2023-11-04T01:42:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.560+0000 7facd8705640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd00c9b80 con 0x7facd00ca8b0 2023-11-04T01:42:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.560+0000 7facd6ca2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facd015d4e0 0x7facd0157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.560+0000 7facd6ca2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facd015d4e0 0x7facd0157180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56966/0 (socket says 172.21.15.114:56966) 2023-11-04T01:42:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.560+0000 7facd6ca2640 1 -- 172.21.15.114:0/495274440 learned_addr learned my addr 172.21.15.114:0/495274440 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.560+0000 7facd64a1640 1 --2- 172.21.15.114:0/495274440 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7facd00ca8b0 0x7facd00c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.560+0000 7facd5ca0640 1 --2- 172.21.15.114:0/495274440 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7facd00ced90 0x7facd0070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.561+0000 7facd6ca2640 1 -- 172.21.15.114:0/495274440 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7facd00ca8b0 msgr2=0x7facd00c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.561+0000 7facd6ca2640 1 --2- 172.21.15.114:0/495274440 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7facd00ca8b0 0x7facd00c61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.561+0000 7facd6ca2640 1 -- 172.21.15.114:0/495274440 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7facd00ced90 msgr2=0x7facd0070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.561+0000 7facd6ca2640 1 --2- 172.21.15.114:0/495274440 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7facd00ced90 0x7facd0070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.561+0000 7facd6ca2640 1 -- 172.21.15.114:0/495274440 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc009a70 con 0x7facd015d4e0 2023-11-04T01:42:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.561+0000 7facd5ca0640 1 --2- 172.21.15.114:0/495274440 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7facd00ced90 0x7facd0070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.561+0000 7facd6ca2640 1 --2- 172.21.15.114:0/495274440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facd015d4e0 0x7facd0157180 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7facc800c440 tx=0x7facc800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.561+0000 7facc6ffd640 1 -- 172.21.15.114:0/495274440 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8011790 con 0x7facd015d4e0 2023-11-04T01:42:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.561+0000 7facc6ffd640 1 -- 172.21.15.114:0/495274440 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc80118f0 con 0x7facd015d4e0 2023-11-04T01:42:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.561+0000 7facd8705640 1 -- 172.21.15.114:0/495274440 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd00c6e70 con 0x7facd015d4e0 2023-11-04T01:42:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.561+0000 7facc6ffd640 1 -- 172.21.15.114:0/495274440 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8011ca0 con 0x7facd015d4e0 2023-11-04T01:42:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.561+0000 7facd8705640 1 -- 172.21.15.114:0/495274440 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd00710b0 con 0x7facd015d4e0 2023-11-04T01:42:27.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.562+0000 7facd8705640 1 -- 172.21.15.114:0/495274440 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd00c37f0 con 0x7facd015d4e0 2023-11-04T01:42:27.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.562+0000 7facc6ffd640 1 -- 172.21.15.114:0/495274440 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7facc801c460 con 0x7facd015d4e0 2023-11-04T01:42:27.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.563+0000 7facc6ffd640 1 --2- 172.21.15.114:0/495274440 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7facb406ae70 0x7facb406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.563+0000 7facc6ffd640 1 -- 172.21.15.114:0/495274440 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7608+0+0 (secure 0 0 0) 0x7facc8089b50 con 0x7facd015d4e0 2023-11-04T01:42:27.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.563+0000 7facd64a1640 1 --2- 172.21.15.114:0/495274440 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7facb406ae70 0x7facb406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.563+0000 7facd64a1640 1 --2- 172.21.15.114:0/495274440 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7facb406ae70 0x7facb406d330 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7faccc036000 tx=0x7faccc030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.567+0000 7facc6ffd640 1 -- 172.21.15.114:0/495274440 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7facd00c37f0 con 0x7facd015d4e0 2023-11-04T01:42:27.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.768+0000 7facd8705640 1 -- 172.21.15.114:0/495274440 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7facd00c37c0 con 0x7facd015d4e0 2023-11-04T01:42:27.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.769+0000 7facc6ffd640 1 -- 172.21.15.114:0/495274440 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4945 (secure 0 0 0) 0x7facc8054490 con 0x7facd015d4e0 2023-11-04T01:42:27.770 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:27.771 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8262,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:21.785691+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:resolve","state_seq":10,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:27.771 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 85 2023-11-04T01:42:27.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.770+0000 7facd8705640 1 -- 172.21.15.114:0/495274440 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7facb406ae70 msgr2=0x7facb406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.770+0000 7facd8705640 1 --2- 172.21.15.114:0/495274440 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7facb406ae70 0x7facb406d330 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7faccc036000 tx=0x7faccc030000 comp rx=0 tx=0).stop 2023-11-04T01:42:27.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.770+0000 7facd8705640 1 -- 172.21.15.114:0/495274440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facd015d4e0 msgr2=0x7facd0157180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.770+0000 7facd8705640 1 --2- 172.21.15.114:0/495274440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facd015d4e0 0x7facd0157180 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7facc800c440 tx=0x7facc800c900 comp rx=0 tx=0).stop 2023-11-04T01:42:27.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.770+0000 7facd8705640 1 -- 172.21.15.114:0/495274440 shutdown_connections 2023-11-04T01:42:27.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.770+0000 7facd8705640 1 --2- 172.21.15.114:0/495274440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facd015d4e0 0x7facd0157180 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.770+0000 7facd8705640 1 --2- 172.21.15.114:0/495274440 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7facb406ae70 0x7facb406d330 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.770+0000 7facd8705640 1 --2- 172.21.15.114:0/495274440 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7facd00ced90 0x7facd0070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.770+0000 7facd8705640 1 --2- 172.21.15.114:0/495274440 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7facd00ca8b0 0x7facd00c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.770+0000 7facd8705640 1 -- 172.21.15.114:0/495274440 >> 172.21.15.114:0/495274440 conn(0x7facd00b1640 msgr2=0x7facd015dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.771+0000 7facd8705640 1 -- 172.21.15.114:0/495274440 shutdown_connections 2023-11-04T01:42:27.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.771+0000 7facd8705640 1 -- 172.21.15.114:0/495274440 wait complete. 2023-11-04T01:42:27.783 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:42:27.783 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.32571840286254883s 2023-11-04T01:42:27.783 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:27.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.881+0000 7f68f97ce640 1 Processor -- start 2023-11-04T01:42:27.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.881+0000 7f68f97ce640 1 -- start start 2023-11-04T01:42:27.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.882+0000 7f68f97ce640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f68f40ceda0 0x7f68f415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.882+0000 7f68f97ce640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f68f40cf890 0x7f68f415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.882+0000 7f68f97ce640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f415d9a0 con 0x7f68f40b2210 2023-11-04T01:42:27.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.882+0000 7f68f97ce640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f40b1df0 con 0x7f68f40ceda0 2023-11-04T01:42:27.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.882+0000 7f68f97ce640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f40cfd00 con 0x7f68f40cf890 2023-11-04T01:42:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.882+0000 7f68f2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f68f40ceda0 0x7f68f415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.882+0000 7f68f2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f68f40ceda0 0x7f68f415cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56980/0 (socket says 172.21.15.114:56980) 2023-11-04T01:42:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.882+0000 7f68f2ffd640 1 -- 172.21.15.114:0/3910940421 learned_addr learned my addr 172.21.15.114:0/3910940421 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.883+0000 7f68f37fe640 1 --2- 172.21.15.114:0/3910940421 >> v2:172.21.15.141:3300/0 conn(0x7f68f40cf890 0x7f68f415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.883+0000 7f68f2ffd640 1 -- 172.21.15.114:0/3910940421 >> v2:172.21.15.141:3300/0 conn(0x7f68f40cf890 msgr2=0x7f68f415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.883+0000 7f68f2ffd640 1 --2- 172.21.15.114:0/3910940421 >> v2:172.21.15.141:3300/0 conn(0x7f68f40cf890 0x7f68f415d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.883+0000 7f68f2ffd640 1 -- 172.21.15.114:0/3910940421 >> v1:172.21.15.141:6789/0 conn(0x7f68f40b2210 legacy=0x7f68f40cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.883+0000 7f68f2ffd640 1 -- 172.21.15.114:0/3910940421 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f40b0150 con 0x7f68f40ceda0 2023-11-04T01:42:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.883+0000 7f68f37fe640 1 --2- 172.21.15.114:0/3910940421 >> v2:172.21.15.141:3300/0 conn(0x7f68f40cf890 0x7f68f415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.883+0000 7f68f2ffd640 1 --2- 172.21.15.114:0/3910940421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68f40ceda0 0x7f68f415cf20 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f68f40c7c90 tx=0x7f68e402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4114fb7c8cfad9e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.883+0000 7f68f1ffb640 1 -- 172.21.15.114:0/3910940421 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e402ca40 con 0x7f68f40ceda0 2023-11-04T01:42:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.884+0000 7f68f1ffb640 1 -- 172.21.15.114:0/3910940421 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e402cba0 con 0x7f68f40ceda0 2023-11-04T01:42:27.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.884+0000 7f68f1ffb640 1 -- 172.21.15.114:0/3910940421 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e40343f0 con 0x7f68f40ceda0 2023-11-04T01:42:27.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.884+0000 7f68f97ce640 1 -- 172.21.15.114:0/3910940421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68f40ceda0 msgr2=0x7f68f415cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.884+0000 7f68f97ce640 1 --2- 172.21.15.114:0/3910940421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68f40ceda0 0x7f68f415cf20 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f68f40c7c90 tx=0x7f68e402bea0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.884+0000 7f68f97ce640 1 -- 172.21.15.114:0/3910940421 shutdown_connections 2023-11-04T01:42:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.884+0000 7f68f97ce640 1 --2- 172.21.15.114:0/3910940421 >> v2:172.21.15.141:3300/0 conn(0x7f68f40cf890 0x7f68f415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.884+0000 7f68f97ce640 1 --2- 172.21.15.114:0/3910940421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68f40ceda0 0x7f68f415cf20 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.884+0000 7f68f97ce640 1 -- 172.21.15.114:0/3910940421 >> 172.21.15.114:0/3910940421 conn(0x7f68f40d0c30 msgr2=0x7f68f40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.884+0000 7f68f97ce640 1 -- 172.21.15.114:0/3910940421 shutdown_connections 2023-11-04T01:42:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.884+0000 7f68f97ce640 1 -- 172.21.15.114:0/3910940421 wait complete. 2023-11-04T01:42:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.885+0000 7f68f97ce640 1 Processor -- start 2023-11-04T01:42:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.885+0000 7f68f97ce640 1 -- start start 2023-11-04T01:42:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f97ce640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68f40b2210 0x7f68f4157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f97ce640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68f40ceda0 0x7f68f40ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f97ce640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68f40cf890 0x7f68f41f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f97ce640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f4149bb0 con 0x7f68f40b2210 2023-11-04T01:42:27.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f97ce640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f41583f0 con 0x7f68f40cf890 2023-11-04T01:42:27.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f97ce640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f41586d0 con 0x7f68f40ceda0 2023-11-04T01:42:27.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68f40b2210 0x7f68f4157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68f40b2210 0x7f68f4157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56994/0 (socket says 172.21.15.114:56994) 2023-11-04T01:42:27.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f2ffd640 1 -- 172.21.15.114:0/548639650 learned_addr learned my addr 172.21.15.114:0/548639650 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:27.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f37fe640 1 --2- 172.21.15.114:0/548639650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68f40cf890 0x7f68f41f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f27fc640 1 --2- 172.21.15.114:0/548639650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68f40ceda0 0x7f68f40ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f2ffd640 1 -- 172.21.15.114:0/548639650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68f40ceda0 msgr2=0x7f68f40ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f2ffd640 1 --2- 172.21.15.114:0/548639650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68f40ceda0 0x7f68f40ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f2ffd640 1 -- 172.21.15.114:0/548639650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68f40cf890 msgr2=0x7f68f41f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f2ffd640 1 --2- 172.21.15.114:0/548639650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68f40cf890 0x7f68f41f5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f2ffd640 1 -- 172.21.15.114:0/548639650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e4009b30 con 0x7f68f40b2210 2023-11-04T01:42:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.886+0000 7f68f37fe640 1 --2- 172.21.15.114:0/548639650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68f40cf890 0x7f68f41f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.887+0000 7f68f27fc640 1 --2- 172.21.15.114:0/548639650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68f40ceda0 0x7f68f40ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.887+0000 7f68f2ffd640 1 --2- 172.21.15.114:0/548639650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68f40b2210 0x7f68f4157d50 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f68e4000f80 tx=0x7f68e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.887+0000 7f68db7fe640 1 -- 172.21.15.114:0/548639650 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e403e450 con 0x7f68f40b2210 2023-11-04T01:42:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.887+0000 7f68db7fe640 1 -- 172.21.15.114:0/548639650 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e403e5f0 con 0x7f68f40b2210 2023-11-04T01:42:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.887+0000 7f68db7fe640 1 -- 172.21.15.114:0/548639650 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e403e9a0 con 0x7f68f40b2210 2023-11-04T01:42:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.887+0000 7f68f97ce640 1 -- 172.21.15.114:0/548639650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f41589b0 con 0x7f68f40b2210 2023-11-04T01:42:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.887+0000 7f68f97ce640 1 -- 172.21.15.114:0/548639650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f4158f70 con 0x7f68f40b2210 2023-11-04T01:42:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.888+0000 7f68f97ce640 1 -- 172.21.15.114:0/548639650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f4146c90 con 0x7f68f40b2210 2023-11-04T01:42:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.888+0000 7f68db7fe640 1 -- 172.21.15.114:0/548639650 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f68e403eb00 con 0x7f68f40b2210 2023-11-04T01:42:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.889+0000 7f68db7fe640 1 --2- 172.21.15.114:0/548639650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f68e006ae70 0x7f68e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.889+0000 7f68f27fc640 1 --2- 172.21.15.114:0/548639650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f68e006ae70 0x7f68e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.889+0000 7f68db7fe640 1 -- 172.21.15.114:0/548639650 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7608+0+0 (secure 0 0 0) 0x7f68e40acd70 con 0x7f68f40b2210 2023-11-04T01:42:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.889+0000 7f68f27fc640 1 --2- 172.21.15.114:0/548639650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f68e006ae70 0x7f68e006d330 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f68f4149eb0 tx=0x7f68e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:27.893+0000 7f68db7fe640 1 -- 172.21.15.114:0/548639650 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f68e4077860 con 0x7f68f40b2210 2023-11-04T01:42:28.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.098+0000 7f68f97ce640 1 -- 172.21.15.114:0/548639650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68f40684b0 con 0x7f68f40b2210 2023-11-04T01:42:28.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.099+0000 7f68db7fe640 1 -- 172.21.15.114:0/548639650 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4945 (secure 0 0 0) 0x7f68e403edb0 con 0x7f68f40b2210 2023-11-04T01:42:28.100 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:28.101 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8262,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:21.785691+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":6298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6298":{"gid":6298,"name":"b","rank":1,"incarnation":45,"state":"up:active","state_seq":5,"addr":"172.21.15.141:6834/1296600989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":1296600989},{"type":"v1","addr":"172.21.15.141:6834","nonce":1296600989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:resolve","state_seq":10,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:28.101 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 85 2023-11-04T01:42:28.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.100+0000 7f68f97ce640 1 -- 172.21.15.114:0/548639650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f68e006ae70 msgr2=0x7f68e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.100+0000 7f68f97ce640 1 --2- 172.21.15.114:0/548639650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f68e006ae70 0x7f68e006d330 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f68f4149eb0 tx=0x7f68e8009040 comp rx=0 tx=0).stop 2023-11-04T01:42:28.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.100+0000 7f68f97ce640 1 -- 172.21.15.114:0/548639650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68f40b2210 msgr2=0x7f68f4157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.100+0000 7f68f97ce640 1 --2- 172.21.15.114:0/548639650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68f40b2210 0x7f68f4157d50 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f68e4000f80 tx=0x7f68e4004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:28.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.100+0000 7f68f97ce640 1 -- 172.21.15.114:0/548639650 shutdown_connections 2023-11-04T01:42:28.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.100+0000 7f68f97ce640 1 --2- 172.21.15.114:0/548639650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f68e006ae70 0x7f68e006d330 secure :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f68f4149eb0 tx=0x7f68e8009040 comp rx=0 tx=0).stop 2023-11-04T01:42:28.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.100+0000 7f68f97ce640 1 --2- 172.21.15.114:0/548639650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f68f40cf890 0x7f68f41f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.100+0000 7f68f97ce640 1 --2- 172.21.15.114:0/548639650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f68f40ceda0 0x7f68f40ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.100+0000 7f68f97ce640 1 --2- 172.21.15.114:0/548639650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68f40b2210 0x7f68f4157d50 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.100+0000 7f68f97ce640 1 -- 172.21.15.114:0/548639650 >> 172.21.15.114:0/548639650 conn(0x7f68f40d0c30 msgr2=0x7f68f406cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.101+0000 7f68f97ce640 1 -- 172.21.15.114:0/548639650 shutdown_connections 2023-11-04T01:42:28.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.101+0000 7f68f97ce640 1 -- 172.21.15.114:0/548639650 wait complete. 2023-11-04T01:42:28.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:42:28.227 INFO:teuthology.orchestra.run.smithi114.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{"17":[5,9]},"pending_update":[{"version":19,"snapinfo":{"snapid":10,"ino":1099511627777,"stamp":"2023-11-04T01:41:58.960272+0000","name":"s22","metadata":{}}}],"pending_destroy":[]} 2023-11-04T01:42:28.227 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": { "17": [ 5, 9 ] }, "pending_destroy": [], "pending_noop": [], "pending_update": [ { "snapInfinityo": { "ino": 1099511627777, "metadata": {}, "name": "s22", "snapid": 10, "stamp": "2023-11-04T01:41:58.960272+0000" }, "version": 19 } ], "snaps": [] } 2023-11-04T01:42:28.227 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:42:28.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.326+0000 7f41fecc2640 1 Processor -- start 2023-11-04T01:42:28.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.326+0000 7f41fecc2640 1 -- start start 2023-11-04T01:42:28.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.327+0000 7f41fecc2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f80ade00 0x7f41f80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.327+0000 7f41fecc2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f41f806c5f0 0x7f41f80cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.327+0000 7f41fecc2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f806cc90 con 0x7f41f806d9c0 2023-11-04T01:42:28.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.327+0000 7f41fecc2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f80b0e60 con 0x7f41f806c5f0 2023-11-04T01:42:28.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.327+0000 7f41fecc2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f806cee0 con 0x7f41f80ade00 2023-11-04T01:42:28.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.327+0000 7f41fd25f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f41f806c5f0 0x7f41f80cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.327+0000 7f41f7fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f41f806d9c0 0x7f41f80710d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52228/0 (socket says 172.21.15.114:52228) 2023-11-04T01:42:28.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.327+0000 7f41f7fff640 1 -- 172.21.15.114:0/4046562222 learned_addr learned my addr 172.21.15.114:0/4046562222 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:28.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.327+0000 7f41fca5e640 1 --2- 172.21.15.114:0/4046562222 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f80ade00 0x7f41f80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.328+0000 7f41fd25f640 1 -- 172.21.15.114:0/4046562222 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f80ade00 msgr2=0x7f41f80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.328+0000 7f41fd25f640 1 --2- 172.21.15.114:0/4046562222 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f80ade00 0x7f41f80b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.328+0000 7f41fd25f640 1 -- 172.21.15.114:0/4046562222 >> v1:172.21.15.114:6789/0 conn(0x7f41f806d9c0 legacy=0x7f41f80710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.328+0000 7f41fd25f640 1 -- 172.21.15.114:0/4046562222 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f806d1c0 con 0x7f41f806c5f0 2023-11-04T01:42:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.328+0000 7f41f77fe640 1 -- 172.21.15.114:0/4046562222 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939399759 0 0) 0x7f41f806cc90 con 0x7f41f806d9c0 2023-11-04T01:42:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.328+0000 7f41fd25f640 1 --2- 172.21.15.114:0/4046562222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f806c5f0 0x7f41f80cc680 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f41f0009d90 tx=0x7f41f002bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e536c9c34b34490 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.328+0000 7f41f77fe640 1 -- 172.21.15.114:0/4046562222 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f002cb30 con 0x7f41f806c5f0 2023-11-04T01:42:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.328+0000 7f41f77fe640 1 -- 172.21.15.114:0/4046562222 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f002cc90 con 0x7f41f806c5f0 2023-11-04T01:42:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.328+0000 7f41f77fe640 1 -- 172.21.15.114:0/4046562222 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0034440 con 0x7f41f806c5f0 2023-11-04T01:42:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.329+0000 7f41fecc2640 1 -- 172.21.15.114:0/4046562222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f806c5f0 msgr2=0x7f41f80cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.329+0000 7f41fecc2640 1 --2- 172.21.15.114:0/4046562222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f806c5f0 0x7f41f80cc680 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f41f0009d90 tx=0x7f41f002bd80 comp rx=0 tx=0).stop 2023-11-04T01:42:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.329+0000 7f41fecc2640 1 -- 172.21.15.114:0/4046562222 shutdown_connections 2023-11-04T01:42:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.329+0000 7f41fecc2640 1 --2- 172.21.15.114:0/4046562222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f806c5f0 0x7f41f80cc680 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.329+0000 7f41fecc2640 1 --2- 172.21.15.114:0/4046562222 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f80ade00 0x7f41f80b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.329+0000 7f41fecc2640 1 -- 172.21.15.114:0/4046562222 >> 172.21.15.114:0/4046562222 conn(0x7f41f80cb530 msgr2=0x7f41f80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.329+0000 7f41fecc2640 1 -- 172.21.15.114:0/4046562222 shutdown_connections 2023-11-04T01:42:28.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.329+0000 7f41fecc2640 1 -- 172.21.15.114:0/4046562222 wait complete. 2023-11-04T01:42:28.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.330+0000 7f41fecc2640 1 Processor -- start 2023-11-04T01:42:28.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.330+0000 7f41fecc2640 1 -- start start 2023-11-04T01:42:28.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41fecc2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f806c5f0 0x7f41f815ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41fecc2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f806d9c0 0x7f41f81474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41fecc2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f80ade00 0x7f41f8156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41fecc2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f815a960 con 0x7f41f80ade00 2023-11-04T01:42:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41fecc2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f8144750 con 0x7f41f806c5f0 2023-11-04T01:42:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41fecc2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f8159a40 con 0x7f41f806d9c0 2023-11-04T01:42:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41fd25f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f80ade00 0x7f41f8156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41fd25f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f80ade00 0x7f41f8156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57012/0 (socket says 172.21.15.114:57012) 2023-11-04T01:42:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41fd25f640 1 -- 172.21.15.114:0/367111049 learned_addr learned my addr 172.21.15.114:0/367111049 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41f7fff640 1 --2- 172.21.15.114:0/367111049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f806d9c0 0x7f41f81474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41fca5e640 1 --2- 172.21.15.114:0/367111049 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f806c5f0 0x7f41f815ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41fd25f640 1 -- 172.21.15.114:0/367111049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f806d9c0 msgr2=0x7f41f81474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41fd25f640 1 --2- 172.21.15.114:0/367111049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f806d9c0 0x7f41f81474b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41fd25f640 1 -- 172.21.15.114:0/367111049 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f806c5f0 msgr2=0x7f41f815ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41fd25f640 1 --2- 172.21.15.114:0/367111049 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f806c5f0 0x7f41f815ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41fd25f640 1 -- 172.21.15.114:0/367111049 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f0009a70 con 0x7f41f80ade00 2023-11-04T01:42:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.331+0000 7f41fd25f640 1 --2- 172.21.15.114:0/367111049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f80ade00 0x7f41f8156d60 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f41f0009d90 tx=0x7f41f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.332+0000 7f41f57fa640 1 -- 172.21.15.114:0/367111049 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0040450 con 0x7f41f80ade00 2023-11-04T01:42:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.332+0000 7f41f57fa640 1 -- 172.21.15.114:0/367111049 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f00405d0 con 0x7f41f80ade00 2023-11-04T01:42:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.332+0000 7f41fecc2640 1 -- 172.21.15.114:0/367111049 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f81479f0 con 0x7f41f80ade00 2023-11-04T01:42:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.332+0000 7f41f57fa640 1 -- 172.21.15.114:0/367111049 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0040780 con 0x7f41f80ade00 2023-11-04T01:42:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.332+0000 7f41fecc2640 1 -- 172.21.15.114:0/367111049 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f8159d90 con 0x7f41f80ade00 2023-11-04T01:42:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.333+0000 7f41fecc2640 1 -- 172.21.15.114:0/367111049 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f815aaa0 con 0x7f41f80ade00 2023-11-04T01:42:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.333+0000 7f41f57fa640 1 -- 172.21.15.114:0/367111049 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41f00408e0 con 0x7f41f80ade00 2023-11-04T01:42:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.333+0000 7f41f57fa640 1 --2- 172.21.15.114:0/367111049 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41e406ae70 0x7f41e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.333+0000 7f41f57fa640 1 -- 172.21.15.114:0/367111049 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7608+0+0 (secure 0 0 0) 0x7f41f00ac640 con 0x7f41f80ade00 2023-11-04T01:42:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.333+0000 7f41fca5e640 1 --2- 172.21.15.114:0/367111049 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41e406ae70 0x7f41e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.334+0000 7f41fca5e640 1 --2- 172.21.15.114:0/367111049 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41e406ae70 0x7f41e406d330 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f41e8006fd0 tx=0x7f41e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.337+0000 7f41f57fa640 1 -- 172.21.15.114:0/367111049 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41f0077010 con 0x7f41f80ade00 2023-11-04T01:42:28.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.567+0000 7f41fecc2640 1 -- 172.21.15.114:0/367111049 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7f41f80684b0 con 0x7f41f80ade00 2023-11-04T01:42:28.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.569+0000 7f41f57fa640 1 -- 172.21.15.114:0/367111049 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 6298 v86) v1 ==== 97+0+0 (secure 0 0 0) 0x7f41f007a630 con 0x7f41f80ade00 2023-11-04T01:42:28.571 INFO:teuthology.orchestra.run.smithi114.stderr:failed mds gid 6298 2023-11-04T01:42:28.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.571+0000 7f41fecc2640 1 -- 172.21.15.114:0/367111049 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41e406ae70 msgr2=0x7f41e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.571+0000 7f41fecc2640 1 --2- 172.21.15.114:0/367111049 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41e406ae70 0x7f41e406d330 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f41e8006fd0 tx=0x7f41e8008040 comp rx=0 tx=0).stop 2023-11-04T01:42:28.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.571+0000 7f41fecc2640 1 -- 172.21.15.114:0/367111049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f80ade00 msgr2=0x7f41f8156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.571+0000 7f41fecc2640 1 --2- 172.21.15.114:0/367111049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f80ade00 0x7f41f8156d60 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f41f0009d90 tx=0x7f41f0004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:28.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.571+0000 7f41fecc2640 1 -- 172.21.15.114:0/367111049 shutdown_connections 2023-11-04T01:42:28.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.571+0000 7f41fecc2640 1 --2- 172.21.15.114:0/367111049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f80ade00 0x7f41f8156d60 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.571+0000 7f41fecc2640 1 --2- 172.21.15.114:0/367111049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f806d9c0 0x7f41f81474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.571+0000 7f41fecc2640 1 --2- 172.21.15.114:0/367111049 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41e406ae70 0x7f41e406d330 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.571+0000 7f41fecc2640 1 --2- 172.21.15.114:0/367111049 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f806c5f0 0x7f41f815ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.571+0000 7f41fecc2640 1 -- 172.21.15.114:0/367111049 >> 172.21.15.114:0/367111049 conn(0x7f41f80cb530 msgr2=0x7f41f80710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.572+0000 7f41fecc2640 1 -- 172.21.15.114:0/367111049 shutdown_connections 2023-11-04T01:42:28.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.572+0000 7f41fecc2640 1 -- 172.21.15.114:0/367111049 wait complete. 2023-11-04T01:42:28.586 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:42:28.586 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:42:28.586 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:42:28.586 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:28.586 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:28.587 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi141 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-11-04T01:42:28.587 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:42:28.587 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:42:28.589 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:42:28.590 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:28.671 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-04T01:42:28.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.688+0000 7fef63a90640 1 Processor -- start 2023-11-04T01:42:28.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.688+0000 7fef63a90640 1 -- start start 2023-11-04T01:42:28.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef63a90640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef5c0caba0 0x7fef5c0b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef63a90640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c0ca5c0 con 0x7fef5c0cc400 2023-11-04T01:42:28.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef63a90640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c0cb0f0 con 0x7fef5c0cda40 2023-11-04T01:42:28.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef63a90640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c06c140 con 0x7fef5c0caba0 2023-11-04T01:42:28.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6102b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fef5c0cc400 0x7fef5c0b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52236/0 (socket says 172.21.15.114:52236) 2023-11-04T01:42:28.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6102b640 1 -- 172.21.15.114:0/2219932705 learned_addr learned my addr 172.21.15.114:0/2219932705 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:28.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6202d640 1 --2- 172.21.15.114:0/2219932705 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef5c0caba0 0x7fef5c0b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6082a640 1 -- 172.21.15.114:0/2219932705 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914379774 0 0) 0x7fef5c0ca5c0 con 0x7fef5c0cc400 2023-11-04T01:42:28.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6082a640 1 -- 172.21.15.114:0/2219932705 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef48003520 con 0x7fef5c0cc400 2023-11-04T01:42:28.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6082a640 1 -- 172.21.15.114:0/2219932705 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 60735294 0 0) 0x7fef48003520 con 0x7fef5c0cc400 2023-11-04T01:42:28.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6082a640 1 -- 172.21.15.114:0/2219932705 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef5c0caba0 msgr2=0x7fef5c0b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6082a640 1 --2- 172.21.15.114:0/2219932705 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef5c0caba0 0x7fef5c0b2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6082a640 1 -- 172.21.15.114:0/2219932705 >> v1:172.21.15.141:6789/0 conn(0x7fef5c0cda40 legacy=0x7fef5c0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6082a640 1 -- 172.21.15.114:0/2219932705 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c06c560 con 0x7fef5c0cc400 2023-11-04T01:42:28.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6082a640 1 -- 172.21.15.114:0/2219932705 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fef4c001670 con 0x7fef5c0cc400 2023-11-04T01:42:28.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6082a640 1 -- 172.21.15.114:0/2219932705 >> v1:172.21.15.114:6789/0 conn(0x7fef5c0cc400 legacy=0x7fef5c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6082a640 1 --2- 172.21.15.114:0/2219932705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef480039a0 0x7fef48003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6082a640 1 --2- 172.21.15.114:0/2219932705 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef5c0caba0 0x7fef480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6082a640 1 --2- 172.21.15.114:0/2219932705 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef48004d00 0x7fef48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6082a640 1 -- 172.21.15.114:0/2219932705 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c06c140 con 0x7fef480039a0 2023-11-04T01:42:28.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6082a640 1 -- 172.21.15.114:0/2219932705 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4800ba60 con 0x7fef48004d00 2023-11-04T01:42:28.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6082a640 1 -- 172.21.15.114:0/2219932705 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4800bc20 con 0x7fef5c0caba0 2023-11-04T01:42:28.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6182c640 1 --2- 172.21.15.114:0/2219932705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef480039a0 0x7fef48003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.689+0000 7fef6102b640 1 --2- 172.21.15.114:0/2219932705 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef5c0caba0 0x7fef480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.690+0000 7fef6202d640 1 --2- 172.21.15.114:0/2219932705 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef48004d00 0x7fef48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.690+0000 7fef6182c640 1 -- 172.21.15.114:0/2219932705 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef5c0caba0 msgr2=0x7fef480047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.690+0000 7fef6182c640 1 --2- 172.21.15.114:0/2219932705 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef5c0caba0 0x7fef480047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.690+0000 7fef6182c640 1 -- 172.21.15.114:0/2219932705 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef48004d00 msgr2=0x7fef48005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.690+0000 7fef6182c640 1 --2- 172.21.15.114:0/2219932705 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef48004d00 0x7fef48005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.690+0000 7fef6182c640 1 -- 172.21.15.114:0/2219932705 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48003520 con 0x7fef480039a0 2023-11-04T01:42:28.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.690+0000 7fef6182c640 1 --2- 172.21.15.114:0/2219932705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef480039a0 0x7fef48003d80 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fef58001910 tx=0x7fef480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56124de23f61001 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.690+0000 7fef6082a640 1 -- 172.21.15.114:0/2219932705 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58032650 con 0x7fef480039a0 2023-11-04T01:42:28.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.691+0000 7fef6082a640 1 -- 172.21.15.114:0/2219932705 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef580327b0 con 0x7fef480039a0 2023-11-04T01:42:28.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.691+0000 7fef6082a640 1 -- 172.21.15.114:0/2219932705 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58032b40 con 0x7fef480039a0 2023-11-04T01:42:28.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.691+0000 7fef63a90640 1 -- 172.21.15.114:0/2219932705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef480039a0 msgr2=0x7fef48003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.691+0000 7fef63a90640 1 --2- 172.21.15.114:0/2219932705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef480039a0 0x7fef48003d80 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fef58001910 tx=0x7fef480057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.691+0000 7fef6202d640 1 -- 172.21.15.114:0/2219932705 reap_dead start 2023-11-04T01:42:28.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.691+0000 7fef63a90640 1 -- 172.21.15.114:0/2219932705 shutdown_connections 2023-11-04T01:42:28.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.691+0000 7fef63a90640 1 -- 172.21.15.114:0/2219932705 >> 172.21.15.114:0/2219932705 conn(0x7fef5c0cb8e0 msgr2=0x7fef5c0cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.691+0000 7fef63a90640 1 -- 172.21.15.114:0/2219932705 shutdown_connections 2023-11-04T01:42:28.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.691+0000 7fef63a90640 1 -- 172.21.15.114:0/2219932705 wait complete. 2023-11-04T01:42:28.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.692+0000 7fef63a90640 1 Processor -- start 2023-11-04T01:42:28.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.692+0000 7fef63a90640 1 -- start start 2023-11-04T01:42:28.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef63a90640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef480039a0 0x7fef5c1577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef63a90640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef5c0c4b20 0x7fef5c13cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef63a90640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef5c1efa90 0x7fef5c1eff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef63a90640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c1580c0 con 0x7fef5c1efa90 2023-11-04T01:42:28.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef63a90640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0c3dc0 con 0x7fef480039a0 2023-11-04T01:42:28.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef63a90640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c157de0 con 0x7fef5c0c4b20 2023-11-04T01:42:28.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef6202d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef5c1efa90 0x7fef5c1eff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef6202d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef5c1efa90 0x7fef5c1eff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57030/0 (socket says 172.21.15.114:57030) 2023-11-04T01:42:28.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef6202d640 1 -- 172.21.15.114:0/2795177625 learned_addr learned my addr 172.21.15.114:0/2795177625 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:28.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef6182c640 1 --2- 172.21.15.114:0/2795177625 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef480039a0 0x7fef5c1577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef6202d640 1 -- 172.21.15.114:0/2795177625 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef5c0c4b20 msgr2=0x7fef5c13cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef6102b640 1 --2- 172.21.15.114:0/2795177625 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef5c0c4b20 0x7fef5c13cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef6202d640 1 --2- 172.21.15.114:0/2795177625 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef5c0c4b20 0x7fef5c13cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef6202d640 1 -- 172.21.15.114:0/2795177625 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef480039a0 msgr2=0x7fef5c1577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef6202d640 1 --2- 172.21.15.114:0/2795177625 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef480039a0 0x7fef5c1577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef6202d640 1 -- 172.21.15.114:0/2795177625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c0c4040 con 0x7fef5c1efa90 2023-11-04T01:42:28.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.693+0000 7fef6182c640 1 --2- 172.21.15.114:0/2795177625 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef480039a0 0x7fef5c1577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:28.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.694+0000 7fef6202d640 1 --2- 172.21.15.114:0/2795177625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef5c1efa90 0x7fef5c1eff10 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0c2600 tx=0x7fef5400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.694+0000 7fef527fc640 1 -- 172.21.15.114:0/2795177625 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5400e040 con 0x7fef5c1efa90 2023-11-04T01:42:28.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.694+0000 7fef527fc640 1 -- 172.21.15.114:0/2795177625 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5400f040 con 0x7fef5c1efa90 2023-11-04T01:42:28.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.694+0000 7fef63a90640 1 -- 172.21.15.114:0/2795177625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5c0c4320 con 0x7fef5c1efa90 2023-11-04T01:42:28.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.694+0000 7fef527fc640 1 -- 172.21.15.114:0/2795177625 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54015430 con 0x7fef5c1efa90 2023-11-04T01:42:28.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.694+0000 7fef63a90640 1 -- 172.21.15.114:0/2795177625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5c1f0450 con 0x7fef5c1efa90 2023-11-04T01:42:28.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.695+0000 7fef63a90640 1 -- 172.21.15.114:0/2795177625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5c0cec60 con 0x7fef5c1efa90 2023-11-04T01:42:28.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.695+0000 7fef527fc640 1 -- 172.21.15.114:0/2795177625 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef54015590 con 0x7fef5c1efa90 2023-11-04T01:42:28.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.695+0000 7fef527fc640 1 --2- 172.21.15.114:0/2795177625 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fef4006aea0 0x7fef4006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.696+0000 7fef6182c640 1 --2- 172.21.15.114:0/2795177625 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fef4006aea0 0x7fef4006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.696+0000 7fef527fc640 1 -- 172.21.15.114:0/2795177625 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7694+0+0 (secure 0 0 0) 0x7fef5408a3e0 con 0x7fef5c1efa90 2023-11-04T01:42:28.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.696+0000 7fef6182c640 1 --2- 172.21.15.114:0/2795177625 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fef4006aea0 0x7fef4006d360 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fef58036000 tx=0x7fef58009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.700+0000 7fef527fc640 1 -- 172.21.15.114:0/2795177625 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fef54054cd0 con 0x7fef5c1efa90 2023-11-04T01:42:28.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.904+0000 7fef63a90640 1 -- 172.21.15.114:0/2795177625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef5c0c4840 con 0x7fef5c1efa90 2023-11-04T01:42:28.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.904+0000 7fef527fc640 1 -- 172.21.15.114:0/2795177625 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4151 (secure 0 0 0) 0x7fef5c0c4840 con 0x7fef5c1efa90 2023-11-04T01:42:28.906 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:28.906 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":87,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:28.572785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:resolve","state_seq":10,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:28.907 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 87 2023-11-04T01:42:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.907+0000 7fef63a90640 1 -- 172.21.15.114:0/2795177625 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fef4006aea0 msgr2=0x7fef4006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.907+0000 7fef63a90640 1 --2- 172.21.15.114:0/2795177625 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fef4006aea0 0x7fef4006d360 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fef58036000 tx=0x7fef58009030 comp rx=0 tx=0).stop 2023-11-04T01:42:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.907+0000 7fef63a90640 1 -- 172.21.15.114:0/2795177625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef5c1efa90 msgr2=0x7fef5c1eff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.907+0000 7fef63a90640 1 --2- 172.21.15.114:0/2795177625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef5c1efa90 0x7fef5c1eff10 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0c2600 tx=0x7fef5400f580 comp rx=0 tx=0).stop 2023-11-04T01:42:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.907+0000 7fef63a90640 1 -- 172.21.15.114:0/2795177625 shutdown_connections 2023-11-04T01:42:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.907+0000 7fef63a90640 1 --2- 172.21.15.114:0/2795177625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef5c1efa90 0x7fef5c1eff10 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.907+0000 7fef63a90640 1 --2- 172.21.15.114:0/2795177625 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fef5c0c4b20 0x7fef5c13cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.907+0000 7fef63a90640 1 --2- 172.21.15.114:0/2795177625 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fef4006aea0 0x7fef4006d360 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.907+0000 7fef63a90640 1 --2- 172.21.15.114:0/2795177625 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fef480039a0 0x7fef5c1577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.907+0000 7fef63a90640 1 -- 172.21.15.114:0/2795177625 >> 172.21.15.114:0/2795177625 conn(0x7fef5c0cb8e0 msgr2=0x7fef5c1e02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.907+0000 7fef63a90640 1 -- 172.21.15.114:0/2795177625 shutdown_connections 2023-11-04T01:42:28.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:28.907+0000 7fef63a90640 1 -- 172.21.15.114:0/2795177625 wait complete. 2023-11-04T01:42:28.919 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:42:31.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-04T01:42:33.921 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:34.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.031+0000 7f1e4dbce640 1 Processor -- start 2023-11-04T01:42:34.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.031+0000 7f1e4dbce640 1 -- start start 2023-11-04T01:42:34.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.032+0000 7f1e4dbce640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1e48160630 0x7f1e480cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.032+0000 7f1e4dbce640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e4806e1d0 0x7f1e480cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.032+0000 7f1e4dbce640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e4806e660 con 0x7f1e480ca0e0 2023-11-04T01:42:34.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.032+0000 7f1e4dbce640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4806d0e0 con 0x7f1e48160630 2023-11-04T01:42:34.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.032+0000 7f1e4dbce640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4806d3c0 con 0x7f1e4806e1d0 2023-11-04T01:42:34.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.032+0000 7f1e477fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1e48160630 0x7f1e480cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.032+0000 7f1e477fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1e48160630 0x7f1e480cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57032/0 (socket says 172.21.15.114:57032) 2023-11-04T01:42:34.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.032+0000 7f1e477fe640 1 -- 172.21.15.114:0/1487732802 learned_addr learned my addr 172.21.15.114:0/1487732802 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:34.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.032+0000 7f1e46ffd640 1 --2- 172.21.15.114:0/1487732802 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e4806e1d0 0x7f1e480cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.032+0000 7f1e477fe640 1 -- 172.21.15.114:0/1487732802 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e4806e1d0 msgr2=0x7f1e480cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.032+0000 7f1e477fe640 1 --2- 172.21.15.114:0/1487732802 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e4806e1d0 0x7f1e480cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.032+0000 7f1e477fe640 1 -- 172.21.15.114:0/1487732802 >> v1:172.21.15.141:6789/0 conn(0x7f1e480ca0e0 legacy=0x7f1e4806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.032+0000 7f1e477fe640 1 -- 172.21.15.114:0/1487732802 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4806d6a0 con 0x7f1e48160630 2023-11-04T01:42:34.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.032+0000 7f1e46ffd640 1 --2- 172.21.15.114:0/1487732802 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e4806e1d0 0x7f1e480cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:34.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.033+0000 7f1e477fe640 1 --2- 172.21.15.114:0/1487732802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e48160630 0x7f1e480cda40 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009870 tx=0x7f1e3802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ed0d0bb0355d29 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.033+0000 7f1e467fc640 1 -- 172.21.15.114:0/1487732802 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e380317c0 con 0x7f1e48160630 2023-11-04T01:42:34.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.033+0000 7f1e467fc640 1 -- 172.21.15.114:0/1487732802 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e38031920 con 0x7f1e48160630 2023-11-04T01:42:34.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.033+0000 7f1e467fc640 1 -- 172.21.15.114:0/1487732802 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38031cb0 con 0x7f1e48160630 2023-11-04T01:42:34.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.034+0000 7f1e4dbce640 1 -- 172.21.15.114:0/1487732802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e48160630 msgr2=0x7f1e480cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.034+0000 7f1e4dbce640 1 --2- 172.21.15.114:0/1487732802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e48160630 0x7f1e480cda40 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009870 tx=0x7f1e3802b860 comp rx=0 tx=0).stop 2023-11-04T01:42:34.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.034+0000 7f1e4dbce640 1 -- 172.21.15.114:0/1487732802 shutdown_connections 2023-11-04T01:42:34.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.034+0000 7f1e4dbce640 1 --2- 172.21.15.114:0/1487732802 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e4806e1d0 0x7f1e480cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.034+0000 7f1e4dbce640 1 --2- 172.21.15.114:0/1487732802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e48160630 0x7f1e480cda40 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.034+0000 7f1e4dbce640 1 -- 172.21.15.114:0/1487732802 >> 172.21.15.114:0/1487732802 conn(0x7f1e480cb8e0 msgr2=0x7f1e480cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.034+0000 7f1e4dbce640 1 -- 172.21.15.114:0/1487732802 shutdown_connections 2023-11-04T01:42:34.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.034+0000 7f1e4dbce640 1 -- 172.21.15.114:0/1487732802 wait complete. 2023-11-04T01:42:34.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.035+0000 7f1e4dbce640 1 Processor -- start 2023-11-04T01:42:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.035+0000 7f1e4dbce640 1 -- start start 2023-11-04T01:42:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e4dbce640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e480ca0e0 0x7f1e480c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e4dbce640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e48160630 0x7f1e48158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e4dbce640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e48158ab0 0x7f1e48156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e4dbce640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e48158f60 con 0x7f1e48158ab0 2023-11-04T01:42:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e4dbce640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e480c8fd0 con 0x7f1e480ca0e0 2023-11-04T01:42:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e4dbce640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e48157000 con 0x7f1e48160630 2023-11-04T01:42:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e47fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e48158ab0 0x7f1e48156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e47fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e48158ab0 0x7f1e48156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57036/0 (socket says 172.21.15.114:57036) 2023-11-04T01:42:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e47fff640 1 -- 172.21.15.114:0/1420984872 learned_addr learned my addr 172.21.15.114:0/1420984872 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e477fe640 1 --2- 172.21.15.114:0/1420984872 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e480ca0e0 0x7f1e480c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e46ffd640 1 --2- 172.21.15.114:0/1420984872 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e48160630 0x7f1e48158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e47fff640 1 -- 172.21.15.114:0/1420984872 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e48160630 msgr2=0x7f1e48158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e47fff640 1 --2- 172.21.15.114:0/1420984872 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e48160630 0x7f1e48158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e47fff640 1 -- 172.21.15.114:0/1420984872 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e480ca0e0 msgr2=0x7f1e480c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e47fff640 1 --2- 172.21.15.114:0/1420984872 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e480ca0e0 0x7f1e480c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e47fff640 1 -- 172.21.15.114:0/1420984872 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e380094d0 con 0x7f1e48158ab0 2023-11-04T01:42:34.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e46ffd640 1 --2- 172.21.15.114:0/1420984872 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e48160630 0x7f1e48158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:34.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.036+0000 7f1e47fff640 1 --2- 172.21.15.114:0/1420984872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e48158ab0 0x7f1e48156280 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000b970 tx=0x7f1e4000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.037+0000 7f1e3ffff640 1 -- 172.21.15.114:0/1420984872 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000cae0 con 0x7f1e48158ab0 2023-11-04T01:42:34.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.037+0000 7f1e3ffff640 1 -- 172.21.15.114:0/1420984872 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4000cc40 con 0x7f1e48158ab0 2023-11-04T01:42:34.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.037+0000 7f1e3ffff640 1 -- 172.21.15.114:0/1420984872 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40014680 con 0x7f1e48158ab0 2023-11-04T01:42:34.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.037+0000 7f1e4dbce640 1 -- 172.21.15.114:0/1420984872 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e481572e0 con 0x7f1e48158ab0 2023-11-04T01:42:34.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.037+0000 7f1e4dbce640 1 -- 172.21.15.114:0/1420984872 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e481578a0 con 0x7f1e48158ab0 2023-11-04T01:42:34.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.038+0000 7f1e4dbce640 1 -- 172.21.15.114:0/1420984872 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e480cabd0 con 0x7f1e48158ab0 2023-11-04T01:42:34.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.038+0000 7f1e3ffff640 1 -- 172.21.15.114:0/1420984872 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e4001d3b0 con 0x7f1e48158ab0 2023-11-04T01:42:34.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.038+0000 7f1e3ffff640 1 --2- 172.21.15.114:0/1420984872 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e2806ae70 0x7f1e2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.039+0000 7f1e477fe640 1 --2- 172.21.15.114:0/1420984872 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e2806ae70 0x7f1e2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.039+0000 7f1e3ffff640 1 -- 172.21.15.114:0/1420984872 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7694+0+0 (secure 0 0 0) 0x7f1e40089b00 con 0x7f1e48158ab0 2023-11-04T01:42:34.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.039+0000 7f1e477fe640 1 --2- 172.21.15.114:0/1420984872 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e2806ae70 0x7f1e2806d330 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1e38036000 tx=0x7f1e3803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.043+0000 7f1e3ffff640 1 -- 172.21.15.114:0/1420984872 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1e400544a0 con 0x7f1e48158ab0 2023-11-04T01:42:34.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.244+0000 7f1e4dbce640 1 -- 172.21.15.114:0/1420984872 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e480c6ad0 con 0x7f1e48158ab0 2023-11-04T01:42:34.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.245+0000 7f1e3ffff640 1 -- 172.21.15.114:0/1420984872 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f1e40057ac0 con 0x7f1e48158ab0 2023-11-04T01:42:34.247 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:34.247 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":89,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:29.581319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:reconnect","state_seq":12,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:34.247 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 89 2023-11-04T01:42:34.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.247+0000 7f1e4dbce640 1 -- 172.21.15.114:0/1420984872 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e2806ae70 msgr2=0x7f1e2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.247+0000 7f1e4dbce640 1 --2- 172.21.15.114:0/1420984872 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e2806ae70 0x7f1e2806d330 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1e38036000 tx=0x7f1e3803d040 comp rx=0 tx=0).stop 2023-11-04T01:42:34.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.247+0000 7f1e4dbce640 1 -- 172.21.15.114:0/1420984872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e48158ab0 msgr2=0x7f1e48156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.247+0000 7f1e4dbce640 1 --2- 172.21.15.114:0/1420984872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e48158ab0 0x7f1e48156280 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000b970 tx=0x7f1e4000be30 comp rx=0 tx=0).stop 2023-11-04T01:42:34.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.247+0000 7f1e4dbce640 1 -- 172.21.15.114:0/1420984872 shutdown_connections 2023-11-04T01:42:34.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.247+0000 7f1e4dbce640 1 --2- 172.21.15.114:0/1420984872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e48158ab0 0x7f1e48156280 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.247+0000 7f1e4dbce640 1 --2- 172.21.15.114:0/1420984872 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f1e48160630 0x7f1e48158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.247+0000 7f1e4dbce640 1 --2- 172.21.15.114:0/1420984872 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f1e2806ae70 0x7f1e2806d330 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.247+0000 7f1e4dbce640 1 --2- 172.21.15.114:0/1420984872 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1e480ca0e0 0x7f1e480c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.247+0000 7f1e4dbce640 1 -- 172.21.15.114:0/1420984872 >> 172.21.15.114:0/1420984872 conn(0x7f1e480cb8e0 msgr2=0x7f1e480af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.247+0000 7f1e4dbce640 1 -- 172.21.15.114:0/1420984872 shutdown_connections 2023-11-04T01:42:34.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.247+0000 7f1e4dbce640 1 -- 172.21.15.114:0/1420984872 wait complete. 2023-11-04T01:42:34.259 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:42:34.260 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:34.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.357+0000 7f529417c640 1 Processor -- start 2023-11-04T01:42:34.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.357+0000 7f529417c640 1 -- start start 2023-11-04T01:42:34.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f529417c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f528c0afda0 0x7f528c0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f529417c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528c0cf240 con 0x7f528c0cd7f0 2023-11-04T01:42:34.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f529417c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528c0cdc20 con 0x7f528c15b200 2023-11-04T01:42:34.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f529417c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528c0cde80 con 0x7f528c0afda0 2023-11-04T01:42:34.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5292719640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f528c0cd7f0 0x7f528c0ae2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52240/0 (socket says 172.21.15.114:52240) 2023-11-04T01:42:34.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5292719640 1 -- 172.21.15.114:0/2416989330 learned_addr learned my addr 172.21.15.114:0/2416989330 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:34.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5290f16640 1 -- 172.21.15.114:0/2416989330 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036509625 0 0) 0x7f5284001490 con 0x7f528c0cd7f0 2023-11-04T01:42:34.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5290f16640 1 -- 172.21.15.114:0/2416989330 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5278003520 con 0x7f528c0cd7f0 2023-11-04T01:42:34.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5291717640 1 --2- 172.21.15.114:0/2416989330 >> v2:172.21.15.141:3300/0 conn(0x7f528c0afda0 0x7f528c0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5290f16640 1 -- 172.21.15.114:0/2416989330 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3013599032 0 0) 0x7f5278003520 con 0x7f528c0cd7f0 2023-11-04T01:42:34.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5290f16640 1 -- 172.21.15.114:0/2416989330 >> v2:172.21.15.141:3300/0 conn(0x7f528c0afda0 msgr2=0x7f528c0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5290f16640 1 --2- 172.21.15.114:0/2416989330 >> v2:172.21.15.141:3300/0 conn(0x7f528c0afda0 0x7f528c0cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5290f16640 1 -- 172.21.15.114:0/2416989330 >> v1:172.21.15.141:6789/0 conn(0x7f528c15b200 legacy=0x7f528c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5290f16640 1 -- 172.21.15.114:0/2416989330 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c0cf670 con 0x7f528c0cd7f0 2023-11-04T01:42:34.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5290f16640 1 -- 172.21.15.114:0/2416989330 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f5284001b80 con 0x7f528c0cd7f0 2023-11-04T01:42:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5290f16640 1 -- 172.21.15.114:0/2416989330 >> v1:172.21.15.114:6789/0 conn(0x7f528c0cd7f0 legacy=0x7f528c0ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5290f16640 1 --2- 172.21.15.114:0/2416989330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5278003970 0x7f5278003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5290f16640 1 --2- 172.21.15.114:0/2416989330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52780047c0 0x7f5278004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5290f16640 1 --2- 172.21.15.114:0/2416989330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5278005180 0x7f527800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5290f16640 1 -- 172.21.15.114:0/2416989330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528c0cde80 con 0x7f5278003970 2023-11-04T01:42:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5290f16640 1 -- 172.21.15.114:0/2416989330 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527800c120 con 0x7f5278005180 2023-11-04T01:42:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.358+0000 7f5290f16640 1 -- 172.21.15.114:0/2416989330 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527800c2e0 con 0x7f52780047c0 2023-11-04T01:42:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.359+0000 7f5291f18640 1 --2- 172.21.15.114:0/2416989330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5278003970 0x7f5278003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.359+0000 7f5291717640 1 --2- 172.21.15.114:0/2416989330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52780047c0 0x7f5278004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.359+0000 7f5292719640 1 --2- 172.21.15.114:0/2416989330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5278005180 0x7f527800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.359+0000 7f5291f18640 1 -- 172.21.15.114:0/2416989330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52780047c0 msgr2=0x7f5278004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.359+0000 7f5291f18640 1 --2- 172.21.15.114:0/2416989330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52780047c0 0x7f5278004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.359+0000 7f5291f18640 1 -- 172.21.15.114:0/2416989330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5278005180 msgr2=0x7f527800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.359+0000 7f5291f18640 1 --2- 172.21.15.114:0/2416989330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5278005180 0x7f527800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.359+0000 7f5291f18640 1 -- 172.21.15.114:0/2416989330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5278003520 con 0x7f5278003970 2023-11-04T01:42:34.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.359+0000 7f5292719640 1 --2- 172.21.15.114:0/2416989330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5278005180 0x7f527800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:34.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.359+0000 7f5292719640 1 -- 172.21.15.114:0/2416989330 reap_dead start 2023-11-04T01:42:34.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.360+0000 7f5291f18640 1 --2- 172.21.15.114:0/2416989330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5278003970 0x7f5278003d90 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f5288001770 tx=0x7f52780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d996de85997e12c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.360+0000 7f5290f16640 1 -- 172.21.15.114:0/2416989330 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52880052d0 con 0x7f5278003970 2023-11-04T01:42:34.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.360+0000 7f5290f16640 1 -- 172.21.15.114:0/2416989330 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528802e050 con 0x7f5278003970 2023-11-04T01:42:34.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.360+0000 7f5290f16640 1 -- 172.21.15.114:0/2416989330 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5288003640 con 0x7f5278003970 2023-11-04T01:42:34.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.360+0000 7f529417c640 1 -- 172.21.15.114:0/2416989330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5278003970 msgr2=0x7f5278003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.360+0000 7f529417c640 1 --2- 172.21.15.114:0/2416989330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5278003970 0x7f5278003d90 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f5288001770 tx=0x7f52780057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.360+0000 7f529417c640 1 -- 172.21.15.114:0/2416989330 shutdown_connections 2023-11-04T01:42:34.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.360+0000 7f529417c640 1 --2- 172.21.15.114:0/2416989330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5278003970 0x7f5278003d90 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.360+0000 7f529417c640 1 -- 172.21.15.114:0/2416989330 >> 172.21.15.114:0/2416989330 conn(0x7f528c0d0c30 msgr2=0x7f528c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.360+0000 7f529417c640 1 -- 172.21.15.114:0/2416989330 shutdown_connections 2023-11-04T01:42:34.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.360+0000 7f529417c640 1 -- 172.21.15.114:0/2416989330 wait complete. 2023-11-04T01:42:34.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.361+0000 7f529417c640 1 Processor -- start 2023-11-04T01:42:34.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.361+0000 7f529417c640 1 -- start start 2023-11-04T01:42:34.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.362+0000 7f529417c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5278003970 0x7f528c1f06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.362+0000 7f529417c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f528c0c7530 0x7f528c0c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.362+0000 7f529417c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f528c140750 0x7f528c140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.362+0000 7f529417c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528c141110 con 0x7f528c0c7530 2023-11-04T01:42:34.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.362+0000 7f529417c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528c158040 con 0x7f5278003970 2023-11-04T01:42:34.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.362+0000 7f529417c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528c1582b0 con 0x7f528c140750 2023-11-04T01:42:34.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.362+0000 7f5291717640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f528c0c7530 0x7f528c0c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.362+0000 7f5291717640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f528c0c7530 0x7f528c0c4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57058/0 (socket says 172.21.15.114:57058) 2023-11-04T01:42:34.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.362+0000 7f5291717640 1 -- 172.21.15.114:0/316475172 learned_addr learned my addr 172.21.15.114:0/316475172 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:34.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.362+0000 7f5291f18640 1 --2- 172.21.15.114:0/316475172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5278003970 0x7f528c1f06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.362+0000 7f5292719640 1 --2- 172.21.15.114:0/316475172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f528c140750 0x7f528c140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.362+0000 7f5291717640 1 -- 172.21.15.114:0/316475172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f528c140750 msgr2=0x7f528c140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.362+0000 7f5291717640 1 --2- 172.21.15.114:0/316475172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f528c140750 0x7f528c140bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.363+0000 7f5291717640 1 -- 172.21.15.114:0/316475172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5278003970 msgr2=0x7f528c1f06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.363+0000 7f5291717640 1 --2- 172.21.15.114:0/316475172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5278003970 0x7f528c1f06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.363+0000 7f5291717640 1 -- 172.21.15.114:0/316475172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c158590 con 0x7f528c0c7530 2023-11-04T01:42:34.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.363+0000 7f5291f18640 1 --2- 172.21.15.114:0/316475172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5278003970 0x7f528c1f06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:34.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.363+0000 7f5291717640 1 --2- 172.21.15.114:0/316475172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f528c0c7530 0x7f528c0c4740 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f527c011a70 tx=0x7f527c011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.363+0000 7f52827fc640 1 -- 172.21.15.114:0/316475172 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c009680 con 0x7f528c0c7530 2023-11-04T01:42:34.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.363+0000 7f52827fc640 1 -- 172.21.15.114:0/316475172 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c00fb50 con 0x7f528c0c7530 2023-11-04T01:42:34.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.363+0000 7f529417c640 1 -- 172.21.15.114:0/316475172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f528c158870 con 0x7f528c0c7530 2023-11-04T01:42:34.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.363+0000 7f52827fc640 1 -- 172.21.15.114:0/316475172 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c00fee0 con 0x7f528c0c7530 2023-11-04T01:42:34.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.363+0000 7f529417c640 1 -- 172.21.15.114:0/316475172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f528c0c4c80 con 0x7f528c0c7530 2023-11-04T01:42:34.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.364+0000 7f529417c640 1 -- 172.21.15.114:0/316475172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528c0684b0 con 0x7f528c0c7530 2023-11-04T01:42:34.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.364+0000 7f52827fc640 1 -- 172.21.15.114:0/316475172 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f527c014440 con 0x7f528c0c7530 2023-11-04T01:42:34.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.365+0000 7f52827fc640 1 --2- 172.21.15.114:0/316475172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f527006aea0 0x7f527006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.365+0000 7f52827fc640 1 -- 172.21.15.114:0/316475172 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7694+0+0 (secure 0 0 0) 0x7f527c08a560 con 0x7f528c0c7530 2023-11-04T01:42:34.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.365+0000 7f5291f18640 1 --2- 172.21.15.114:0/316475172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f527006aea0 0x7f527006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.365+0000 7f5291f18640 1 --2- 172.21.15.114:0/316475172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f527006aea0 0x7f527006d360 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5288033000 tx=0x7f5288009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.369+0000 7f52827fc640 1 -- 172.21.15.114:0/316475172 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f527c054ee0 con 0x7f528c0c7530 2023-11-04T01:42:34.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.568+0000 7f529417c640 1 -- 172.21.15.114:0/316475172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f528c0ae9f0 con 0x7f528c0c7530 2023-11-04T01:42:34.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.569+0000 7f52827fc640 1 -- 172.21.15.114:0/316475172 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f527c058500 con 0x7f528c0c7530 2023-11-04T01:42:34.571 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:34.571 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":89,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:29.581319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:reconnect","state_seq":12,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:34.571 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 89 2023-11-04T01:42:34.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.570+0000 7f529417c640 1 -- 172.21.15.114:0/316475172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f527006aea0 msgr2=0x7f527006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.570+0000 7f529417c640 1 --2- 172.21.15.114:0/316475172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f527006aea0 0x7f527006d360 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5288033000 tx=0x7f5288009030 comp rx=0 tx=0).stop 2023-11-04T01:42:34.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.570+0000 7f529417c640 1 -- 172.21.15.114:0/316475172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f528c0c7530 msgr2=0x7f528c0c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.570+0000 7f529417c640 1 --2- 172.21.15.114:0/316475172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f528c0c7530 0x7f528c0c4740 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f527c011a70 tx=0x7f527c011f30 comp rx=0 tx=0).stop 2023-11-04T01:42:34.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.570+0000 7f529417c640 1 -- 172.21.15.114:0/316475172 shutdown_connections 2023-11-04T01:42:34.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.570+0000 7f529417c640 1 --2- 172.21.15.114:0/316475172 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f528c140750 0x7f528c140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.570+0000 7f529417c640 1 --2- 172.21.15.114:0/316475172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f528c0c7530 0x7f528c0c4740 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.570+0000 7f529417c640 1 --2- 172.21.15.114:0/316475172 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f527006aea0 0x7f527006d360 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.570+0000 7f529417c640 1 --2- 172.21.15.114:0/316475172 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5278003970 0x7f528c1f06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.570+0000 7f529417c640 1 -- 172.21.15.114:0/316475172 >> 172.21.15.114:0/316475172 conn(0x7f528c0d0c30 msgr2=0x7f528c0af1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.571+0000 7f529417c640 1 -- 172.21.15.114:0/316475172 shutdown_connections 2023-11-04T01:42:34.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:34.571+0000 7f529417c640 1 -- 172.21.15.114:0/316475172 wait complete. 2023-11-04T01:42:34.583 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:42:35.584 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:35.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.694+0000 7f52c71d7640 1 Processor -- start 2023-11-04T01:42:35.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.694+0000 7f52c71d7640 1 -- start start 2023-11-04T01:42:35.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.695+0000 7f52c71d7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f52c0159e40 0x7f52c00b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.695+0000 7f52c71d7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52c006bb60 0x7f52c00b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.695+0000 7f52c71d7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c0071500 con 0x7f52c006fff0 2023-11-04T01:42:35.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.695+0000 7f52c71d7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c015dae0 con 0x7f52c0159e40 2023-11-04T01:42:35.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.695+0000 7f52c71d7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0070c60 con 0x7f52c006bb60 2023-11-04T01:42:35.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.695+0000 7f52c4f73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f52c0159e40 0x7f52c00b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.695+0000 7f52c5774640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f52c006fff0 0x7f52c0070480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52256/0 (socket says 172.21.15.114:52256) 2023-11-04T01:42:35.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.695+0000 7f52c5774640 1 -- 172.21.15.114:0/444705648 learned_addr learned my addr 172.21.15.114:0/444705648 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:35.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.695+0000 7f52b7fff640 1 --2- 172.21.15.114:0/444705648 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52c006bb60 0x7f52c00b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.695+0000 7f52c4f73640 1 -- 172.21.15.114:0/444705648 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52c006bb60 msgr2=0x7f52c00b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.695+0000 7f52c4f73640 1 --2- 172.21.15.114:0/444705648 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52c006bb60 0x7f52c00b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.695+0000 7f52c4f73640 1 -- 172.21.15.114:0/444705648 >> v1:172.21.15.114:6789/0 conn(0x7f52c006fff0 legacy=0x7f52c0070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.695+0000 7f52c4f73640 1 -- 172.21.15.114:0/444705648 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c0070f40 con 0x7f52c0159e40 2023-11-04T01:42:35.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.695+0000 7f52b77fe640 1 -- 172.21.15.114:0/444705648 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988655055 0 0) 0x7f52c0071500 con 0x7f52c006fff0 2023-11-04T01:42:35.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.696+0000 7f52c4f73640 1 --2- 172.21.15.114:0/444705648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52c0159e40 0x7f52c00b0530 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0097a0 tx=0x7f52bc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bbf657f96795ad server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.696+0000 7f52b77fe640 1 -- 172.21.15.114:0/444705648 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc02e070 con 0x7f52c0159e40 2023-11-04T01:42:35.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.696+0000 7f52b77fe640 1 -- 172.21.15.114:0/444705648 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc0315a0 con 0x7f52c0159e40 2023-11-04T01:42:35.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.696+0000 7f52b77fe640 1 -- 172.21.15.114:0/444705648 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc031930 con 0x7f52c0159e40 2023-11-04T01:42:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.697+0000 7f52c71d7640 1 -- 172.21.15.114:0/444705648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52c0159e40 msgr2=0x7f52c00b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.697+0000 7f52c71d7640 1 --2- 172.21.15.114:0/444705648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52c0159e40 0x7f52c00b0530 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0097a0 tx=0x7f52bc02b840 comp rx=0 tx=0).stop 2023-11-04T01:42:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.697+0000 7f52c71d7640 1 -- 172.21.15.114:0/444705648 shutdown_connections 2023-11-04T01:42:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.697+0000 7f52c71d7640 1 --2- 172.21.15.114:0/444705648 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52c006bb60 0x7f52c00b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.697+0000 7f52c71d7640 1 --2- 172.21.15.114:0/444705648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52c0159e40 0x7f52c00b0530 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.697+0000 7f52c71d7640 1 -- 172.21.15.114:0/444705648 >> 172.21.15.114:0/444705648 conn(0x7f52c00cb530 msgr2=0x7f52c00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.697+0000 7f52c71d7640 1 -- 172.21.15.114:0/444705648 shutdown_connections 2023-11-04T01:42:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.697+0000 7f52c71d7640 1 -- 172.21.15.114:0/444705648 wait complete. 2023-11-04T01:42:35.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.698+0000 7f52c71d7640 1 Processor -- start 2023-11-04T01:42:35.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.698+0000 7f52c71d7640 1 -- start start 2023-11-04T01:42:35.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52c71d7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52c006bb60 0x7f52c015cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52c71d7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52c006fff0 0x7f52c00a9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52c71d7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52c0159e40 0x7f52c015a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52c71d7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c015b6f0 con 0x7f52c006fff0 2023-11-04T01:42:35.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52c71d7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00a96b0 con 0x7f52c0159e40 2023-11-04T01:42:35.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52c71d7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c015aa70 con 0x7f52c006bb60 2023-11-04T01:42:35.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52b7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52c006fff0 0x7f52c00a9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52b7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52c006fff0 0x7f52c00a9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57072/0 (socket says 172.21.15.114:57072) 2023-11-04T01:42:35.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52b7fff640 1 -- 172.21.15.114:0/3470595238 learned_addr learned my addr 172.21.15.114:0/3470595238 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:35.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52c4f73640 1 --2- 172.21.15.114:0/3470595238 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52c006bb60 0x7f52c015cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52c5774640 1 --2- 172.21.15.114:0/3470595238 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52c0159e40 0x7f52c015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52b7fff640 1 -- 172.21.15.114:0/3470595238 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52c006bb60 msgr2=0x7f52c015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52b7fff640 1 --2- 172.21.15.114:0/3470595238 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52c006bb60 0x7f52c015cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52b7fff640 1 -- 172.21.15.114:0/3470595238 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52c0159e40 msgr2=0x7f52c015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52b7fff640 1 --2- 172.21.15.114:0/3470595238 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52c0159e40 0x7f52c015a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52b7fff640 1 -- 172.21.15.114:0/3470595238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc009400 con 0x7f52c006fff0 2023-11-04T01:42:35.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52c4f73640 1 --2- 172.21.15.114:0/3470595238 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52c006bb60 0x7f52c015cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:35.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52c5774640 1 --2- 172.21.15.114:0/3470595238 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52c0159e40 0x7f52c015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:35.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.699+0000 7f52b7fff640 1 --2- 172.21.15.114:0/3470595238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52c006fff0 0x7f52c00a9170 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f52b000d830 tx=0x7f52b000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.700+0000 7f52b57fa640 1 -- 172.21.15.114:0/3470595238 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b000b660 con 0x7f52c006fff0 2023-11-04T01:42:35.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.700+0000 7f52b57fa640 1 -- 172.21.15.114:0/3470595238 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b000b7c0 con 0x7f52c006fff0 2023-11-04T01:42:35.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.700+0000 7f52c71d7640 1 -- 172.21.15.114:0/3470595238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c015ad50 con 0x7f52c006fff0 2023-11-04T01:42:35.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.700+0000 7f52b57fa640 1 -- 172.21.15.114:0/3470595238 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b000bb50 con 0x7f52c006fff0 2023-11-04T01:42:35.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.700+0000 7f52c71d7640 1 -- 172.21.15.114:0/3470595238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c015b310 con 0x7f52c006fff0 2023-11-04T01:42:35.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.701+0000 7f52c71d7640 1 -- 172.21.15.114:0/3470595238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c015b830 con 0x7f52c006fff0 2023-11-04T01:42:35.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.701+0000 7f52b57fa640 1 -- 172.21.15.114:0/3470595238 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52b001e460 con 0x7f52c006fff0 2023-11-04T01:42:35.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.702+0000 7f52b57fa640 1 --2- 172.21.15.114:0/3470595238 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f52ac06ae70 0x7f52ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.702+0000 7f52c4f73640 1 --2- 172.21.15.114:0/3470595238 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f52ac06ae70 0x7f52ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.702+0000 7f52b57fa640 1 -- 172.21.15.114:0/3470595238 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7694+0+0 (secure 0 0 0) 0x7f52b008a520 con 0x7f52c006fff0 2023-11-04T01:42:35.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.702+0000 7f52c4f73640 1 --2- 172.21.15.114:0/3470595238 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f52ac06ae70 0x7f52ac06d330 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f52bc036000 tx=0x7f52bc03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.706+0000 7f52b57fa640 1 -- 172.21.15.114:0/3470595238 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52b0054e10 con 0x7f52c006fff0 2023-11-04T01:42:35.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.908+0000 7f52c71d7640 1 -- 172.21.15.114:0/3470595238 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52c015b4d0 con 0x7f52c006fff0 2023-11-04T01:42:35.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.909+0000 7f52b57fa640 1 -- 172.21.15.114:0/3470595238 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f52b0058430 con 0x7f52c006fff0 2023-11-04T01:42:35.911 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:35.911 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":89,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:29.581319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:reconnect","state_seq":12,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:35.911 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 89 2023-11-04T01:42:35.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.910+0000 7f52c71d7640 1 -- 172.21.15.114:0/3470595238 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f52ac06ae70 msgr2=0x7f52ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.910+0000 7f52c71d7640 1 --2- 172.21.15.114:0/3470595238 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f52ac06ae70 0x7f52ac06d330 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f52bc036000 tx=0x7f52bc03d040 comp rx=0 tx=0).stop 2023-11-04T01:42:35.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.911+0000 7f52c71d7640 1 -- 172.21.15.114:0/3470595238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52c006fff0 msgr2=0x7f52c00a9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.911+0000 7f52c71d7640 1 --2- 172.21.15.114:0/3470595238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52c006fff0 0x7f52c00a9170 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f52b000d830 tx=0x7f52b000dcf0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.911+0000 7f52c71d7640 1 -- 172.21.15.114:0/3470595238 shutdown_connections 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.911+0000 7f52c71d7640 1 --2- 172.21.15.114:0/3470595238 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f52ac06ae70 0x7f52ac06d330 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.911+0000 7f52c71d7640 1 --2- 172.21.15.114:0/3470595238 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f52c0159e40 0x7f52c015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.911+0000 7f52c71d7640 1 --2- 172.21.15.114:0/3470595238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52c006fff0 0x7f52c00a9170 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.911+0000 7f52c71d7640 1 --2- 172.21.15.114:0/3470595238 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f52c006bb60 0x7f52c015cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.911+0000 7f52c71d7640 1 -- 172.21.15.114:0/3470595238 >> 172.21.15.114:0/3470595238 conn(0x7f52c00cb530 msgr2=0x7f52c00c7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.911+0000 7f52c71d7640 1 -- 172.21.15.114:0/3470595238 shutdown_connections 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:35.911+0000 7f52c71d7640 1 -- 172.21.15.114:0/3470595238 wait complete. 2023-11-04T01:42:35.923 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:42:36.924 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:37.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.033+0000 7fe00ea10640 1 Processor -- start 2023-11-04T01:42:37.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.033+0000 7fe00ea10640 1 -- start start 2023-11-04T01:42:37.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.034+0000 7fe00ea10640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe0080ceda0 0x7fe00815cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.034+0000 7fe00ea10640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0080b2210 0x7fe00815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.034+0000 7fe00ea10640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00815d9a0 con 0x7fe0080cf180 2023-11-04T01:42:37.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.034+0000 7fe00ea10640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0080b1df0 con 0x7fe0080ceda0 2023-11-04T01:42:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.034+0000 7fe00ea10640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080cfd20 con 0x7fe0080b2210 2023-11-04T01:42:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.034+0000 7fe007fff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe0080ceda0 0x7fe00815cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.034+0000 7fe0077fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0080b2210 0x7fe00815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.034+0000 7fe0077fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0080b2210 0x7fe00815d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:41480/0 (socket says 172.21.15.114:41480) 2023-11-04T01:42:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.034+0000 7fe007fff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe0080ceda0 0x7fe00815cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:60194/0 (socket says 172.21.15.114:60194) 2023-11-04T01:42:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.034+0000 7fe0077fe640 1 -- 172.21.15.114:0/1505319032 learned_addr learned my addr 172.21.15.114:0/1505319032 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.034+0000 7fe00cfad640 1 --1- 172.21.15.114:0/1505319032 >> v1:172.21.15.141:6789/0 conn(0x7fe0080cf180 0x7fe0080cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:33584/0 (socket says 172.21.15.114:33584) 2023-11-04T01:42:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.035+0000 7fe007fff640 1 -- 172.21.15.114:0/1505319032 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0080b2210 msgr2=0x7fe00815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.035+0000 7fe007fff640 1 --2- 172.21.15.114:0/1505319032 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0080b2210 0x7fe00815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.035+0000 7fe007fff640 1 -- 172.21.15.114:0/1505319032 >> v1:172.21.15.141:6789/0 conn(0x7fe0080cf180 legacy=0x7fe0080cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.035+0000 7fe007fff640 1 -- 172.21.15.114:0/1505319032 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0080b0150 con 0x7fe0080ceda0 2023-11-04T01:42:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.035+0000 7fe007fff640 1 --2- 172.21.15.114:0/1505319032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0080ceda0 0x7fe00815cf20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009790 tx=0x7fdffc02b650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93dad9f23acc7ace server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.036+0000 7fe006ffd640 1 -- 172.21.15.114:0/1505319032 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc030710 con 0x7fe0080ceda0 2023-11-04T01:42:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.036+0000 7fe006ffd640 1 -- 172.21.15.114:0/1505319032 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc02e050 con 0x7fe0080ceda0 2023-11-04T01:42:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.036+0000 7fe006ffd640 1 -- 172.21.15.114:0/1505319032 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc030a90 con 0x7fe0080ceda0 2023-11-04T01:42:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.036+0000 7fe00ea10640 1 -- 172.21.15.114:0/1505319032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0080ceda0 msgr2=0x7fe00815cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.036+0000 7fe00ea10640 1 --2- 172.21.15.114:0/1505319032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0080ceda0 0x7fe00815cf20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009790 tx=0x7fdffc02b650 comp rx=0 tx=0).stop 2023-11-04T01:42:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.036+0000 7fe00ea10640 1 -- 172.21.15.114:0/1505319032 shutdown_connections 2023-11-04T01:42:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.036+0000 7fe00ea10640 1 --2- 172.21.15.114:0/1505319032 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0080b2210 0x7fe00815d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.036+0000 7fe00ea10640 1 --2- 172.21.15.114:0/1505319032 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0080ceda0 0x7fe00815cf20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.036+0000 7fe00ea10640 1 -- 172.21.15.114:0/1505319032 >> 172.21.15.114:0/1505319032 conn(0x7fe0080d0c30 msgr2=0x7fe0080d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.036+0000 7fe00ea10640 1 -- 172.21.15.114:0/1505319032 shutdown_connections 2023-11-04T01:42:37.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.036+0000 7fe00ea10640 1 -- 172.21.15.114:0/1505319032 wait complete. 2023-11-04T01:42:37.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.037+0000 7fe00ea10640 1 Processor -- start 2023-11-04T01:42:37.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.038+0000 7fe00ea10640 1 -- start start 2023-11-04T01:42:37.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.038+0000 7fe00ea10640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0080b2210 0x7fe0080cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.038+0000 7fe00ea10640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0080ceda0 0x7fe008155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.038+0000 7fe00ea10640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0080cf180 0x7fe0080ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.038+0000 7fe00ea10640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0081f7230 con 0x7fe0080b2210 2023-11-04T01:42:37.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.038+0000 7fe00ea10640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0081555a0 con 0x7fe0080cf180 2023-11-04T01:42:37.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.038+0000 7fe00ea10640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080cc920 con 0x7fe0080ceda0 2023-11-04T01:42:37.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.038+0000 7fe007fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0080b2210 0x7fe0080cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.038+0000 7fe007fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0080b2210 0x7fe0080cd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56276/0 (socket says 172.21.15.114:56276) 2023-11-04T01:42:37.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.038+0000 7fe007fff640 1 -- 172.21.15.114:0/3060314977 learned_addr learned my addr 172.21.15.114:0/3060314977 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.039+0000 7fe00cfad640 1 --2- 172.21.15.114:0/3060314977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0080cf180 0x7fe0080ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.039+0000 7fe0077fe640 1 --2- 172.21.15.114:0/3060314977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0080ceda0 0x7fe008155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.039+0000 7fe007fff640 1 -- 172.21.15.114:0/3060314977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0080ceda0 msgr2=0x7fe008155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.039+0000 7fe007fff640 1 --2- 172.21.15.114:0/3060314977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0080ceda0 0x7fe008155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.039+0000 7fe007fff640 1 -- 172.21.15.114:0/3060314977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0080cf180 msgr2=0x7fe0080ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.039+0000 7fe007fff640 1 --2- 172.21.15.114:0/3060314977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0080cf180 0x7fe0080ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.039+0000 7fe007fff640 1 -- 172.21.15.114:0/3060314977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc0093a0 con 0x7fe0080b2210 2023-11-04T01:42:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.039+0000 7fe007fff640 1 --2- 172.21.15.114:0/3060314977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0080b2210 0x7fe0080cd6e0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0098b0 tx=0x7fdffc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.039+0000 7fe004ff9640 1 -- 172.21.15.114:0/3060314977 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc005e60 con 0x7fe0080b2210 2023-11-04T01:42:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.039+0000 7fe004ff9640 1 -- 172.21.15.114:0/3060314977 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc006030 con 0x7fe0080b2210 2023-11-04T01:42:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.039+0000 7fe00ea10640 1 -- 172.21.15.114:0/3060314977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0080ccc00 con 0x7fe0080b2210 2023-11-04T01:42:37.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.039+0000 7fe004ff9640 1 -- 172.21.15.114:0/3060314977 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0063e0 con 0x7fe0080b2210 2023-11-04T01:42:37.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.039+0000 7fe00ea10640 1 -- 172.21.15.114:0/3060314977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0080cd1c0 con 0x7fe0080b2210 2023-11-04T01:42:37.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.040+0000 7fe00ea10640 1 -- 172.21.15.114:0/3060314977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0080684b0 con 0x7fe0080b2210 2023-11-04T01:42:37.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.041+0000 7fe004ff9640 1 -- 172.21.15.114:0/3060314977 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdffc039040 con 0x7fe0080b2210 2023-11-04T01:42:37.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.041+0000 7fe004ff9640 1 --2- 172.21.15.114:0/3060314977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdff406ae70 0x7fdff406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.041+0000 7fe004ff9640 1 -- 172.21.15.114:0/3060314977 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7694+0+0 (secure 0 0 0) 0x7fdffc0ab370 con 0x7fe0080b2210 2023-11-04T01:42:37.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.041+0000 7fe0077fe640 1 --2- 172.21.15.114:0/3060314977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdff406ae70 0x7fdff406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.041+0000 7fe0077fe640 1 --2- 172.21.15.114:0/3060314977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdff406ae70 0x7fdff406d330 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe0080ca0a0 tx=0x7fdff8009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.045+0000 7fe004ff9640 1 -- 172.21.15.114:0/3060314977 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdffc075d10 con 0x7fe0080b2210 2023-11-04T01:42:37.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.244+0000 7fe00ea10640 1 -- 172.21.15.114:0/3060314977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0080c6750 con 0x7fe0080b2210 2023-11-04T01:42:37.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.245+0000 7fe004ff9640 1 -- 172.21.15.114:0/3060314977 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fdffc079330 con 0x7fe0080b2210 2023-11-04T01:42:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:37.246 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":89,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:29.581319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:reconnect","state_seq":12,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:37.247 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 89 2023-11-04T01:42:37.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.246+0000 7fe00ea10640 1 -- 172.21.15.114:0/3060314977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdff406ae70 msgr2=0x7fdff406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.246+0000 7fe00ea10640 1 --2- 172.21.15.114:0/3060314977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdff406ae70 0x7fdff406d330 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe0080ca0a0 tx=0x7fdff8009240 comp rx=0 tx=0).stop 2023-11-04T01:42:37.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.246+0000 7fe00ea10640 1 -- 172.21.15.114:0/3060314977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0080b2210 msgr2=0x7fe0080cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.246+0000 7fe00ea10640 1 --2- 172.21.15.114:0/3060314977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0080b2210 0x7fe0080cd6e0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0098b0 tx=0x7fdffc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.246+0000 7fe00ea10640 1 -- 172.21.15.114:0/3060314977 shutdown_connections 2023-11-04T01:42:37.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.246+0000 7fe00ea10640 1 --2- 172.21.15.114:0/3060314977 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdff406ae70 0x7fdff406d330 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.246+0000 7fe00ea10640 1 --2- 172.21.15.114:0/3060314977 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe0080cf180 0x7fe0080ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.246+0000 7fe00ea10640 1 --2- 172.21.15.114:0/3060314977 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe0080ceda0 0x7fe008155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.246+0000 7fe00ea10640 1 --2- 172.21.15.114:0/3060314977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0080b2210 0x7fe0080cd6e0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.246+0000 7fe00ea10640 1 -- 172.21.15.114:0/3060314977 >> 172.21.15.114:0/3060314977 conn(0x7fe0080d0c30 msgr2=0x7fe00806c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.247+0000 7fe00ea10640 1 -- 172.21.15.114:0/3060314977 shutdown_connections 2023-11-04T01:42:37.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:37.247+0000 7fe00ea10640 1 -- 172.21.15.114:0/3060314977 wait complete. 2023-11-04T01:42:37.259 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:42:38.260 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:38.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.370+0000 7fdae41f5640 1 Processor -- start 2023-11-04T01:42:38.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.370+0000 7fdae41f5640 1 -- start start 2023-11-04T01:42:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.371+0000 7fdae41f5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdadc0afda0 0x7fdadc0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.371+0000 7fdae41f5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc0cf240 con 0x7fdadc0cd7f0 2023-11-04T01:42:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.371+0000 7fdae41f5640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc0cdc40 con 0x7fdadc15b200 2023-11-04T01:42:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.371+0000 7fdae41f5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc0cde80 con 0x7fdadc0afda0 2023-11-04T01:42:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.371+0000 7fdae2792640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdadc0cd7f0 0x7fdadc0ae2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32902/0 (socket says 172.21.15.114:32902) 2023-11-04T01:42:38.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.371+0000 7fdae2792640 1 -- 172.21.15.114:0/2110372531 learned_addr learned my addr 172.21.15.114:0/2110372531 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:38.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.371+0000 7fdae1790640 1 --2- 172.21.15.114:0/2110372531 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdadc0afda0 0x7fdadc0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.371+0000 7fdae0f8f640 1 -- 172.21.15.114:0/2110372531 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410501949 0 0) 0x7fdad4001490 con 0x7fdadc0cd7f0 2023-11-04T01:42:38.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.371+0000 7fdae0f8f640 1 -- 172.21.15.114:0/2110372531 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac8003520 con 0x7fdadc0cd7f0 2023-11-04T01:42:38.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.371+0000 7fdae0f8f640 1 -- 172.21.15.114:0/2110372531 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087995071 0 0) 0x7fdad8001160 con 0x7fdadc15b200 2023-11-04T01:42:38.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.371+0000 7fdae0f8f640 1 -- 172.21.15.114:0/2110372531 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdad4001490 con 0x7fdadc15b200 2023-11-04T01:42:38.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.371+0000 7fdae1790640 1 -- 172.21.15.114:0/2110372531 >> v1:172.21.15.141:6789/0 conn(0x7fdadc15b200 legacy=0x7fdadc0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.371+0000 7fdae1790640 1 -- 172.21.15.114:0/2110372531 >> v1:172.21.15.114:6789/0 conn(0x7fdadc0cd7f0 legacy=0x7fdadc0ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.371+0000 7fdae1790640 1 -- 172.21.15.114:0/2110372531 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc0cf670 con 0x7fdadc0afda0 2023-11-04T01:42:38.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.372+0000 7fdae1790640 1 --2- 172.21.15.114:0/2110372531 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdadc0afda0 0x7fdadc0cd2b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0097d0 tx=0x7fdacc02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27b3b378eec97800 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.372+0000 7fdae0f8f640 1 -- 172.21.15.114:0/2110372531 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc031800 con 0x7fdadc0afda0 2023-11-04T01:42:38.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.372+0000 7fdae0f8f640 1 -- 172.21.15.114:0/2110372531 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc031960 con 0x7fdadc0afda0 2023-11-04T01:42:38.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.372+0000 7fdae0f8f640 1 -- 172.21.15.114:0/2110372531 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc031cf0 con 0x7fdadc0afda0 2023-11-04T01:42:38.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.373+0000 7fdae41f5640 1 -- 172.21.15.114:0/2110372531 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdadc0afda0 msgr2=0x7fdadc0cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.373+0000 7fdae41f5640 1 --2- 172.21.15.114:0/2110372531 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdadc0afda0 0x7fdadc0cd2b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0097d0 tx=0x7fdacc02b8a0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.373+0000 7fdae41f5640 1 -- 172.21.15.114:0/2110372531 shutdown_connections 2023-11-04T01:42:38.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.373+0000 7fdae41f5640 1 --2- 172.21.15.114:0/2110372531 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdadc0afda0 0x7fdadc0cd2b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.373+0000 7fdae41f5640 1 -- 172.21.15.114:0/2110372531 >> 172.21.15.114:0/2110372531 conn(0x7fdadc0d0c30 msgr2=0x7fdadc0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.373+0000 7fdae41f5640 1 -- 172.21.15.114:0/2110372531 shutdown_connections 2023-11-04T01:42:38.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.373+0000 7fdae41f5640 1 -- 172.21.15.114:0/2110372531 wait complete. 2023-11-04T01:42:38.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.374+0000 7fdae41f5640 1 Processor -- start 2023-11-04T01:42:38.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.374+0000 7fdae41f5640 1 -- start start 2023-11-04T01:42:38.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.375+0000 7fdae41f5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdadc0afda0 0x7fdadc0af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.375+0000 7fdae41f5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdadc0cd7f0 0x7fdadc06bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.375+0000 7fdae41f5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdadc15b200 0x7fdadc0ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.375+0000 7fdae41f5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc15be40 con 0x7fdadc15b200 2023-11-04T01:42:38.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.375+0000 7fdae41f5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc06d1e0 con 0x7fdadc0cd7f0 2023-11-04T01:42:38.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.375+0000 7fdae41f5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc06c2f0 con 0x7fdadc0afda0 2023-11-04T01:42:38.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.375+0000 7fdae2792640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdadc15b200 0x7fdadc0ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.375+0000 7fdae2792640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdadc15b200 0x7fdadc0ae4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56288/0 (socket says 172.21.15.114:56288) 2023-11-04T01:42:38.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.375+0000 7fdae2792640 1 -- 172.21.15.114:0/3849699728 learned_addr learned my addr 172.21.15.114:0/3849699728 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:38.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.375+0000 7fdae1f91640 1 --2- 172.21.15.114:0/3849699728 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdadc0afda0 0x7fdadc0af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.375+0000 7fdae1790640 1 --2- 172.21.15.114:0/3849699728 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdadc0cd7f0 0x7fdadc06bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.375+0000 7fdae2792640 1 -- 172.21.15.114:0/3849699728 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdadc0afda0 msgr2=0x7fdadc0af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.375+0000 7fdae2792640 1 --2- 172.21.15.114:0/3849699728 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdadc0afda0 0x7fdadc0af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.375+0000 7fdae2792640 1 -- 172.21.15.114:0/3849699728 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdadc0cd7f0 msgr2=0x7fdadc06bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.375+0000 7fdae2792640 1 --2- 172.21.15.114:0/3849699728 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdadc0cd7f0 0x7fdadc06bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.376+0000 7fdae2792640 1 -- 172.21.15.114:0/3849699728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc009400 con 0x7fdadc15b200 2023-11-04T01:42:38.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.376+0000 7fdae2792640 1 --2- 172.21.15.114:0/3849699728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdadc15b200 0x7fdadc0ae4b0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fdad4001f50 tx=0x7fdad400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.376+0000 7fdad27fc640 1 -- 172.21.15.114:0/3849699728 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4012400 con 0x7fdadc15b200 2023-11-04T01:42:38.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.376+0000 7fdad27fc640 1 -- 172.21.15.114:0/3849699728 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad4012560 con 0x7fdadc15b200 2023-11-04T01:42:38.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.376+0000 7fdae41f5640 1 -- 172.21.15.114:0/3849699728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc15b780 con 0x7fdadc15b200 2023-11-04T01:42:38.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.376+0000 7fdad27fc640 1 -- 172.21.15.114:0/3849699728 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad40128d0 con 0x7fdadc15b200 2023-11-04T01:42:38.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.376+0000 7fdae41f5640 1 -- 172.21.15.114:0/3849699728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc0ae9f0 con 0x7fdadc15b200 2023-11-04T01:42:38.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.377+0000 7fdae41f5640 1 -- 172.21.15.114:0/3849699728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc0aebe0 con 0x7fdadc15b200 2023-11-04T01:42:38.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.377+0000 7fdad27fc640 1 -- 172.21.15.114:0/3849699728 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdad4007070 con 0x7fdadc15b200 2023-11-04T01:42:38.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.378+0000 7fdad27fc640 1 --2- 172.21.15.114:0/3849699728 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdac006ae70 0x7fdac006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.378+0000 7fdad27fc640 1 -- 172.21.15.114:0/3849699728 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fdad4089d70 con 0x7fdadc15b200 2023-11-04T01:42:38.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.378+0000 7fdae1f91640 1 --2- 172.21.15.114:0/3849699728 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdac006ae70 0x7fdac006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.378+0000 7fdae1f91640 1 --2- 172.21.15.114:0/3849699728 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdac006ae70 0x7fdac006d330 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdad80013c0 tx=0x7fdad8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.382+0000 7fdad27fc640 1 -- 172.21.15.114:0/3849699728 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdad4054650 con 0x7fdadc15b200 2023-11-04T01:42:38.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.583+0000 7fdae41f5640 1 -- 172.21.15.114:0/3849699728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdadc15b5e0 con 0x7fdadc15b200 2023-11-04T01:42:38.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.583+0000 7fdad27fc640 1 -- 172.21.15.114:0/3849699728 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fdadc15b5e0 con 0x7fdadc15b200 2023-11-04T01:42:38.585 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:38.585 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":89,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:29.581319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:reconnect","state_seq":12,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:38.586 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 89 2023-11-04T01:42:38.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.585+0000 7fdae41f5640 1 -- 172.21.15.114:0/3849699728 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdac006ae70 msgr2=0x7fdac006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.585+0000 7fdae41f5640 1 --2- 172.21.15.114:0/3849699728 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdac006ae70 0x7fdac006d330 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdad80013c0 tx=0x7fdad8009040 comp rx=0 tx=0).stop 2023-11-04T01:42:38.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.585+0000 7fdae41f5640 1 -- 172.21.15.114:0/3849699728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdadc15b200 msgr2=0x7fdadc0ae4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.585+0000 7fdae41f5640 1 --2- 172.21.15.114:0/3849699728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdadc15b200 0x7fdadc0ae4b0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fdad4001f50 tx=0x7fdad400a430 comp rx=0 tx=0).stop 2023-11-04T01:42:38.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.585+0000 7fdae41f5640 1 -- 172.21.15.114:0/3849699728 shutdown_connections 2023-11-04T01:42:38.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.585+0000 7fdae41f5640 1 --2- 172.21.15.114:0/3849699728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdadc15b200 0x7fdadc0ae4b0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.585+0000 7fdae41f5640 1 --2- 172.21.15.114:0/3849699728 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdac006ae70 0x7fdac006d330 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.585+0000 7fdae41f5640 1 --2- 172.21.15.114:0/3849699728 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdadc0cd7f0 0x7fdadc06bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.585+0000 7fdae41f5640 1 --2- 172.21.15.114:0/3849699728 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdadc0afda0 0x7fdadc0af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.585+0000 7fdae41f5640 1 -- 172.21.15.114:0/3849699728 >> 172.21.15.114:0/3849699728 conn(0x7fdadc0d0c30 msgr2=0x7fdadc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.585+0000 7fdae41f5640 1 -- 172.21.15.114:0/3849699728 shutdown_connections 2023-11-04T01:42:38.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:38.585+0000 7fdae41f5640 1 -- 172.21.15.114:0/3849699728 wait complete. 2023-11-04T01:42:38.597 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:42:39.599 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:39.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.709+0000 7fbdb3010640 1 Processor -- start 2023-11-04T01:42:39.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.709+0000 7fbdb3010640 1 -- start start 2023-11-04T01:42:39.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.710+0000 7fbdb3010640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbdac15ade0 0x7fbdac06c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.710+0000 7fbdb3010640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbdac0b1440 0x7fbdac066010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.710+0000 7fbdb3010640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdac0ad6a0 con 0x7fbdac06b740 2023-11-04T01:42:39.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.710+0000 7fbdb3010640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdac0acaf0 con 0x7fbdac0b1440 2023-11-04T01:42:39.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.710+0000 7fbdb3010640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0acdd0 con 0x7fbdac15ade0 2023-11-04T01:42:39.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.710+0000 7fbdb15ad640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbdac0b1440 0x7fbdac066010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.710+0000 7fbdb15ad640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbdac0b1440 0x7fbdac066010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56290/0 (socket says 172.21.15.114:56290) 2023-11-04T01:42:39.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.710+0000 7fbdb15ad640 1 -- 172.21.15.114:0/4234363222 learned_addr learned my addr 172.21.15.114:0/4234363222 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:39.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.710+0000 7fbdb0dac640 1 --2- 172.21.15.114:0/4234363222 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbdac15ade0 0x7fbdac06c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.711+0000 7fbdb15ad640 1 -- 172.21.15.114:0/4234363222 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbdac15ade0 msgr2=0x7fbdac06c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.711+0000 7fbdb15ad640 1 --2- 172.21.15.114:0/4234363222 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbdac15ade0 0x7fbdac06c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.711+0000 7fbdb15ad640 1 -- 172.21.15.114:0/4234363222 >> v1:172.21.15.141:6789/0 conn(0x7fbdac06b740 legacy=0x7fbdac0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.711+0000 7fbdb15ad640 1 -- 172.21.15.114:0/4234363222 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac0ad0e0 con 0x7fbdac0b1440 2023-11-04T01:42:39.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.711+0000 7fbdb15ad640 1 --2- 172.21.15.114:0/4234363222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdac0b1440 0x7fbdac066010 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009e50 tx=0x7fbda402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ebcbb12168a20 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.711+0000 7fbdab7fe640 1 -- 172.21.15.114:0/4234363222 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda402ca70 con 0x7fbdac0b1440 2023-11-04T01:42:39.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.712+0000 7fbdab7fe640 1 -- 172.21.15.114:0/4234363222 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda402cbd0 con 0x7fbdac0b1440 2023-11-04T01:42:39.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.712+0000 7fbdab7fe640 1 -- 172.21.15.114:0/4234363222 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda40343f0 con 0x7fbdac0b1440 2023-11-04T01:42:39.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.712+0000 7fbdb3010640 1 -- 172.21.15.114:0/4234363222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdac0b1440 msgr2=0x7fbdac066010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.712+0000 7fbdb3010640 1 --2- 172.21.15.114:0/4234363222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdac0b1440 0x7fbdac066010 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009e50 tx=0x7fbda402bed0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.712+0000 7fbdb3010640 1 -- 172.21.15.114:0/4234363222 shutdown_connections 2023-11-04T01:42:39.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.712+0000 7fbdb3010640 1 --2- 172.21.15.114:0/4234363222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdac0b1440 0x7fbdac066010 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.712+0000 7fbdb3010640 1 --2- 172.21.15.114:0/4234363222 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbdac15ade0 0x7fbdac06c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.712+0000 7fbdb3010640 1 -- 172.21.15.114:0/4234363222 >> 172.21.15.114:0/4234363222 conn(0x7fbdac0cbd30 msgr2=0x7fbdac0cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.712+0000 7fbdb3010640 1 -- 172.21.15.114:0/4234363222 shutdown_connections 2023-11-04T01:42:39.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.712+0000 7fbdb3010640 1 -- 172.21.15.114:0/4234363222 wait complete. 2023-11-04T01:42:39.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.713+0000 7fbdb3010640 1 Processor -- start 2023-11-04T01:42:39.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.713+0000 7fbdb3010640 1 -- start start 2023-11-04T01:42:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.714+0000 7fbdb3010640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdac06b740 0x7fbdac0c2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.714+0000 7fbdb3010640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbdac0b1440 0x7fbdac0b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.714+0000 7fbdb3010640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbdac15ade0 0x7fbdac0afe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.714+0000 7fbdb3010640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac153f40 con 0x7fbdac06b740 2023-11-04T01:42:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.714+0000 7fbdb3010640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0c2570 con 0x7fbdac15ade0 2023-11-04T01:42:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.714+0000 7fbdb3010640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0b3310 con 0x7fbdac0b1440 2023-11-04T01:42:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.714+0000 7fbdb0dac640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdac06b740 0x7fbdac0c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.714+0000 7fbdb0dac640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdac06b740 0x7fbdac0c2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56292/0 (socket says 172.21.15.114:56292) 2023-11-04T01:42:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.714+0000 7fbdb0dac640 1 -- 172.21.15.114:0/2922449850 learned_addr learned my addr 172.21.15.114:0/2922449850 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:39.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.714+0000 7fbdabfff640 1 --2- 172.21.15.114:0/2922449850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbdac0b1440 0x7fbdac0b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.714+0000 7fbdb15ad640 1 --2- 172.21.15.114:0/2922449850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbdac15ade0 0x7fbdac0afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.715+0000 7fbdb0dac640 1 -- 172.21.15.114:0/2922449850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbdac0b1440 msgr2=0x7fbdac0b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.715+0000 7fbdb0dac640 1 --2- 172.21.15.114:0/2922449850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbdac0b1440 0x7fbdac0b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.715+0000 7fbdb0dac640 1 -- 172.21.15.114:0/2922449850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbdac15ade0 msgr2=0x7fbdac0afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.715+0000 7fbdb0dac640 1 --2- 172.21.15.114:0/2922449850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbdac15ade0 0x7fbdac0afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.715+0000 7fbdb0dac640 1 -- 172.21.15.114:0/2922449850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda4009b30 con 0x7fbdac06b740 2023-11-04T01:42:39.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.715+0000 7fbdb0dac640 1 --2- 172.21.15.114:0/2922449850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdac06b740 0x7fbdac0c2030 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00d800 tx=0x7fbd9c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.715+0000 7fbda97fa640 1 -- 172.21.15.114:0/2922449850 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c0096c0 con 0x7fbdac06b740 2023-11-04T01:42:39.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.715+0000 7fbda97fa640 1 -- 172.21.15.114:0/2922449850 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c009820 con 0x7fbdac06b740 2023-11-04T01:42:39.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.715+0000 7fbdb3010640 1 -- 172.21.15.114:0/2922449850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdac0b35f0 con 0x7fbdac06b740 2023-11-04T01:42:39.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.715+0000 7fbda97fa640 1 -- 172.21.15.114:0/2922449850 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c009bd0 con 0x7fbdac06b740 2023-11-04T01:42:39.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.715+0000 7fbdb3010640 1 -- 172.21.15.114:0/2922449850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdac0b3bb0 con 0x7fbdac06b740 2023-11-04T01:42:39.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.716+0000 7fbdb3010640 1 -- 172.21.15.114:0/2922449850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdac0684b0 con 0x7fbdac06b740 2023-11-04T01:42:39.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.716+0000 7fbda97fa640 1 -- 172.21.15.114:0/2922449850 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd9c009d30 con 0x7fbdac06b740 2023-11-04T01:42:39.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.717+0000 7fbda97fa640 1 --2- 172.21.15.114:0/2922449850 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd9806ae70 0x7fbd9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.717+0000 7fbda97fa640 1 -- 172.21.15.114:0/2922449850 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fbd9c08a380 con 0x7fbdac06b740 2023-11-04T01:42:39.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.717+0000 7fbdabfff640 1 --2- 172.21.15.114:0/2922449850 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd9806ae70 0x7fbd9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.717+0000 7fbdabfff640 1 --2- 172.21.15.114:0/2922449850 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd9806ae70 0x7fbd9806d330 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbdac0b1f60 tx=0x7fbda0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.721+0000 7fbda97fa640 1 -- 172.21.15.114:0/2922449850 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd9c054d80 con 0x7fbdac06b740 2023-11-04T01:42:39.771 INFO:tasks.ceph.mds.a.smithi114.stderr:2023-11-04T01:42:39.770+0000 7f4ea224a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:39.772 INFO:tasks.ceph.mds.a.smithi114.stderr:2023-11-04T01:42:39.770+0000 7f4ea224a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:42:39.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.922+0000 7fbdb3010640 1 -- 172.21.15.114:0/2922449850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdac0c26b0 con 0x7fbdac06b740 2023-11-04T01:42:39.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.922+0000 7fbda97fa640 1 -- 172.21.15.114:0/2922449850 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fbd9c0583a0 con 0x7fbdac06b740 2023-11-04T01:42:39.924 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:39.924 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":91,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:38.634213+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:39.925 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 91 2023-11-04T01:42:39.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.924+0000 7fbdb3010640 1 -- 172.21.15.114:0/2922449850 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd9806ae70 msgr2=0x7fbd9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.924+0000 7fbdb3010640 1 --2- 172.21.15.114:0/2922449850 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd9806ae70 0x7fbd9806d330 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbdac0b1f60 tx=0x7fbda0009040 comp rx=0 tx=0).stop 2023-11-04T01:42:39.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.924+0000 7fbdb3010640 1 -- 172.21.15.114:0/2922449850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdac06b740 msgr2=0x7fbdac0c2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.924+0000 7fbdb3010640 1 --2- 172.21.15.114:0/2922449850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdac06b740 0x7fbdac0c2030 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00d800 tx=0x7fbd9c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.924+0000 7fbdb3010640 1 -- 172.21.15.114:0/2922449850 shutdown_connections 2023-11-04T01:42:39.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.924+0000 7fbdb3010640 1 --2- 172.21.15.114:0/2922449850 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd9806ae70 0x7fbd9806d330 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.924+0000 7fbdb3010640 1 --2- 172.21.15.114:0/2922449850 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbdac15ade0 0x7fbdac0afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.924+0000 7fbdb3010640 1 --2- 172.21.15.114:0/2922449850 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbdac0b1440 0x7fbdac0b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.924+0000 7fbdb3010640 1 --2- 172.21.15.114:0/2922449850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbdac06b740 0x7fbdac0c2030 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.924+0000 7fbdb3010640 1 -- 172.21.15.114:0/2922449850 >> 172.21.15.114:0/2922449850 conn(0x7fbdac0cbd30 msgr2=0x7fbdac158600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.924+0000 7fbdb3010640 1 -- 172.21.15.114:0/2922449850 shutdown_connections 2023-11-04T01:42:39.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:39.924+0000 7fbdb3010640 1 -- 172.21.15.114:0/2922449850 wait complete. 2023-11-04T01:42:39.937 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:42:39.937 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.6771886348724365s 2023-11-04T01:42:39.937 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:40.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.034+0000 7fc36f8a9640 1 Processor -- start 2023-11-04T01:42:40.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.035+0000 7fc36f8a9640 1 -- start start 2023-11-04T01:42:40.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.035+0000 7fc36f8a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc36815d100 0x7fc3680ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.035+0000 7fc36f8a9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc36815d4e0 0x7fc3680d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.035+0000 7fc36f8a9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3680b32b0 con 0x7fc3680d3b60 2023-11-04T01:42:40.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.035+0000 7fc36f8a9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3680cee10 con 0x7fc36815d4e0 2023-11-04T01:42:40.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.035+0000 7fc36f8a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680b4750 con 0x7fc36815d100 2023-11-04T01:42:40.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.036+0000 7fc36d645640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc36815d100 0x7fc3680ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.036+0000 7fc36ce44640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc36815d4e0 0x7fc3680d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.036+0000 7fc36ce44640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc36815d4e0 0x7fc3680d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:60236/0 (socket says 172.21.15.114:60236) 2023-11-04T01:42:40.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.036+0000 7fc36d645640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc36815d100 0x7fc3680ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:41564/0 (socket says 172.21.15.114:41564) 2023-11-04T01:42:40.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.036+0000 7fc36ce44640 1 -- 172.21.15.114:0/3928139859 learned_addr learned my addr 172.21.15.114:0/3928139859 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:40.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.036+0000 7fc36ce44640 1 -- 172.21.15.114:0/3928139859 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc36815d100 msgr2=0x7fc3680ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.036+0000 7fc36ce44640 1 --2- 172.21.15.114:0/3928139859 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc36815d100 0x7fc3680ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.036+0000 7fc36ce44640 1 -- 172.21.15.114:0/3928139859 >> v1:172.21.15.141:6789/0 conn(0x7fc3680d3b60 legacy=0x7fc3680cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.036+0000 7fc36ce44640 1 -- 172.21.15.114:0/3928139859 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3680b2980 con 0x7fc36815d4e0 2023-11-04T01:42:40.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.037+0000 7fc36ce44640 1 --2- 172.21.15.114:0/3928139859 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc36815d4e0 0x7fc3680d14d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc358009870 tx=0x7fc35802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19c47c207e50defa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.037+0000 7fc35ffff640 1 -- 172.21.15.114:0/3928139859 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358030840 con 0x7fc36815d4e0 2023-11-04T01:42:40.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.037+0000 7fc35ffff640 1 -- 172.21.15.114:0/3928139859 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3580309a0 con 0x7fc36815d4e0 2023-11-04T01:42:40.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.037+0000 7fc35ffff640 1 -- 172.21.15.114:0/3928139859 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358030d30 con 0x7fc36815d4e0 2023-11-04T01:42:40.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.037+0000 7fc36f8a9640 1 -- 172.21.15.114:0/3928139859 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc36815d4e0 msgr2=0x7fc3680d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.037+0000 7fc36f8a9640 1 --2- 172.21.15.114:0/3928139859 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc36815d4e0 0x7fc3680d14d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc358009870 tx=0x7fc35802b980 comp rx=0 tx=0).stop 2023-11-04T01:42:40.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.037+0000 7fc36f8a9640 1 -- 172.21.15.114:0/3928139859 shutdown_connections 2023-11-04T01:42:40.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.037+0000 7fc36f8a9640 1 --2- 172.21.15.114:0/3928139859 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc36815d4e0 0x7fc3680d14d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.037+0000 7fc36f8a9640 1 --2- 172.21.15.114:0/3928139859 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc36815d100 0x7fc3680ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.038+0000 7fc36f8a9640 1 -- 172.21.15.114:0/3928139859 >> 172.21.15.114:0/3928139859 conn(0x7fc3680d2ef0 msgr2=0x7fc3680d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.038+0000 7fc36f8a9640 1 -- 172.21.15.114:0/3928139859 shutdown_connections 2023-11-04T01:42:40.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.038+0000 7fc36f8a9640 1 -- 172.21.15.114:0/3928139859 wait complete. 2023-11-04T01:42:40.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.039+0000 7fc36f8a9640 1 Processor -- start 2023-11-04T01:42:40.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.039+0000 7fc36f8a9640 1 -- start start 2023-11-04T01:42:40.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.039+0000 7fc36f8a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3680d3b60 0x7fc3680c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.039+0000 7fc36f8a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc36815d100 0x7fc3680b8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.039+0000 7fc36f8a9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc36815d4e0 0x7fc368149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.039+0000 7fc36f8a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680ca810 con 0x7fc3680d3b60 2023-11-04T01:42:40.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.039+0000 7fc36f8a9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680cd210 con 0x7fc36815d4e0 2023-11-04T01:42:40.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.039+0000 7fc36f8a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680cc970 con 0x7fc36815d100 2023-11-04T01:42:40.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.039+0000 7fc36d645640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3680d3b60 0x7fc3680c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.040+0000 7fc36d645640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3680d3b60 0x7fc3680c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56294/0 (socket says 172.21.15.114:56294) 2023-11-04T01:42:40.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.040+0000 7fc36d645640 1 -- 172.21.15.114:0/1068609643 learned_addr learned my addr 172.21.15.114:0/1068609643 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:40.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.040+0000 7fc36ce44640 1 --2- 172.21.15.114:0/1068609643 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc36815d100 0x7fc3680b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.040+0000 7fc36de46640 1 --2- 172.21.15.114:0/1068609643 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc36815d4e0 0x7fc368149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.040+0000 7fc36d645640 1 -- 172.21.15.114:0/1068609643 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc36815d100 msgr2=0x7fc3680b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.040+0000 7fc36d645640 1 --2- 172.21.15.114:0/1068609643 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc36815d100 0x7fc3680b8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.040+0000 7fc36d645640 1 -- 172.21.15.114:0/1068609643 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc36815d4e0 msgr2=0x7fc368149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.040+0000 7fc36d645640 1 --2- 172.21.15.114:0/1068609643 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc36815d4e0 0x7fc368149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.040+0000 7fc36d645640 1 -- 172.21.15.114:0/1068609643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3580094d0 con 0x7fc3680d3b60 2023-11-04T01:42:40.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.040+0000 7fc36d645640 1 --2- 172.21.15.114:0/1068609643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3680d3b60 0x7fc3680c9fc0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc36400e870 tx=0x7fc36400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.040+0000 7fc35dffb640 1 -- 172.21.15.114:0/1068609643 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3640095c0 con 0x7fc3680d3b60 2023-11-04T01:42:40.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.040+0000 7fc35dffb640 1 -- 172.21.15.114:0/1068609643 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36400c940 con 0x7fc3680d3b60 2023-11-04T01:42:40.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.040+0000 7fc36f8a9640 1 -- 172.21.15.114:0/1068609643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3680ccc50 con 0x7fc3680d3b60 2023-11-04T01:42:40.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.040+0000 7fc35dffb640 1 -- 172.21.15.114:0/1068609643 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36400ccb0 con 0x7fc3680d3b60 2023-11-04T01:42:40.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.040+0000 7fc36f8a9640 1 -- 172.21.15.114:0/1068609643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3680ca500 con 0x7fc3680d3b60 2023-11-04T01:42:40.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.041+0000 7fc36f8a9640 1 -- 172.21.15.114:0/1068609643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3680684b0 con 0x7fc3680d3b60 2023-11-04T01:42:40.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.042+0000 7fc35dffb640 1 -- 172.21.15.114:0/1068609643 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc364013470 con 0x7fc3680d3b60 2023-11-04T01:42:40.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.042+0000 7fc35dffb640 1 --2- 172.21.15.114:0/1068609643 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc34c06ae70 0x7fc34c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.042+0000 7fc35dffb640 1 -- 172.21.15.114:0/1068609643 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fc36408a2e0 con 0x7fc3680d3b60 2023-11-04T01:42:40.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.042+0000 7fc36ce44640 1 --2- 172.21.15.114:0/1068609643 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc34c06ae70 0x7fc34c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.043+0000 7fc36ce44640 1 --2- 172.21.15.114:0/1068609643 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc34c06ae70 0x7fc34c06d330 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc358036000 tx=0x7fc358008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.046+0000 7fc35dffb640 1 -- 172.21.15.114:0/1068609643 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc364054d20 con 0x7fc3680d3b60 2023-11-04T01:42:40.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.250+0000 7fc36f8a9640 1 -- 172.21.15.114:0/1068609643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3680d2cd0 con 0x7fc3680d3b60 2023-11-04T01:42:40.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.251+0000 7fc35dffb640 1 -- 172.21.15.114:0/1068609643 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fc364058340 con 0x7fc3680d3b60 2023-11-04T01:42:40.253 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:40.253 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":91,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:38.634213+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:40.253 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 91 2023-11-04T01:42:40.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.253+0000 7fc36f8a9640 1 -- 172.21.15.114:0/1068609643 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc34c06ae70 msgr2=0x7fc34c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.253+0000 7fc36f8a9640 1 --2- 172.21.15.114:0/1068609643 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc34c06ae70 0x7fc34c06d330 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc358036000 tx=0x7fc358008030 comp rx=0 tx=0).stop 2023-11-04T01:42:40.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.253+0000 7fc36f8a9640 1 -- 172.21.15.114:0/1068609643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3680d3b60 msgr2=0x7fc3680c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.253+0000 7fc36f8a9640 1 --2- 172.21.15.114:0/1068609643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3680d3b60 0x7fc3680c9fc0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc36400e870 tx=0x7fc36400ed30 comp rx=0 tx=0).stop 2023-11-04T01:42:40.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.253+0000 7fc36f8a9640 1 -- 172.21.15.114:0/1068609643 shutdown_connections 2023-11-04T01:42:40.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.253+0000 7fc36f8a9640 1 --2- 172.21.15.114:0/1068609643 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc34c06ae70 0x7fc34c06d330 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.253+0000 7fc36f8a9640 1 --2- 172.21.15.114:0/1068609643 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc36815d4e0 0x7fc368149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.253+0000 7fc36f8a9640 1 --2- 172.21.15.114:0/1068609643 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc36815d100 0x7fc3680b8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.253+0000 7fc36f8a9640 1 --2- 172.21.15.114:0/1068609643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3680d3b60 0x7fc3680c9fc0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.253+0000 7fc36f8a9640 1 -- 172.21.15.114:0/1068609643 >> 172.21.15.114:0/1068609643 conn(0x7fc3680d2ef0 msgr2=0x7fc3680cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.253+0000 7fc36f8a9640 1 -- 172.21.15.114:0/1068609643 shutdown_connections 2023-11-04T01:42:40.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.253+0000 7fc36f8a9640 1 -- 172.21.15.114:0/1068609643 wait complete. 2023-11-04T01:42:40.265 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:42:40.378 INFO:teuthology.orchestra.run.smithi114.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{"17":[5,9]},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:42:40.378 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": { "17": [ 5, 9 ] }, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:42:40.378 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:42:40.378 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:40.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.476+0000 7f8249f65640 1 Processor -- start 2023-11-04T01:42:40.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.476+0000 7f8249f65640 1 -- start start 2023-11-04T01:42:40.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.477+0000 7f8249f65640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82440b1440 0x7f824406c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.477+0000 7f8249f65640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82440ad6a0 con 0x7f824406b740 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.477+0000 7f8249f65640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82440acaf0 con 0x7f824415ade0 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.477+0000 7f8249f65640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82440acdd0 con 0x7f82440b1440 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.477+0000 7f8243fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f824406b740 0x7f824406a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32914/0 (socket says 172.21.15.114:32914) 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.477+0000 7f8243fff640 1 -- 172.21.15.114:0/1606031302 learned_addr learned my addr 172.21.15.114:0/1606031302 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.477+0000 7f8242ffd640 1 --2- 172.21.15.114:0/1606031302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82440b1440 0x7f824406c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.477+0000 7f82427fc640 1 -- 172.21.15.114:0/1606031302 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559519731 0 0) 0x7f82440ad6a0 con 0x7f824406b740 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.477+0000 7f82427fc640 1 -- 172.21.15.114:0/1606031302 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f822c003520 con 0x7f824406b740 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.477+0000 7f82427fc640 1 -- 172.21.15.114:0/1606031302 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3809492660 0 0) 0x7f822c003520 con 0x7f824406b740 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.477+0000 7f82427fc640 1 -- 172.21.15.114:0/1606031302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82440b1440 msgr2=0x7f824406c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.477+0000 7f82427fc640 1 --2- 172.21.15.114:0/1606031302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82440b1440 0x7f824406c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.477+0000 7f82427fc640 1 -- 172.21.15.114:0/1606031302 >> v1:172.21.15.141:6789/0 conn(0x7f824415ade0 legacy=0x7f82440b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.477+0000 7f82427fc640 1 -- 172.21.15.114:0/1606031302 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82440ad0e0 con 0x7f824406b740 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.477+0000 7f82427fc640 1 -- 172.21.15.114:0/1606031302 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f823c0019f0 con 0x7f824406b740 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.478+0000 7f82427fc640 1 -- 172.21.15.114:0/1606031302 >> v1:172.21.15.114:6789/0 conn(0x7f824406b740 legacy=0x7f824406a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.478+0000 7f82427fc640 1 --2- 172.21.15.114:0/1606031302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82440b1440 0x7f822c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.478+0000 7f82427fc640 1 --2- 172.21.15.114:0/1606031302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f822c003ee0 0x7f822c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.478+0000 7f82427fc640 1 --2- 172.21.15.114:0/1606031302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f822c004d00 0x7f822c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.478+0000 7f82427fc640 1 -- 172.21.15.114:0/1606031302 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82440acdd0 con 0x7f822c003ee0 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.478+0000 7f82427fc640 1 -- 172.21.15.114:0/1606031302 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c00ba90 con 0x7f822c004d00 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.478+0000 7f82427fc640 1 -- 172.21.15.114:0/1606031302 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822c00bc50 con 0x7f82440b1440 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.478+0000 7f8242ffd640 1 --2- 172.21.15.114:0/1606031302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f822c003ee0 0x7f822c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.478+0000 7f82437fe640 1 --2- 172.21.15.114:0/1606031302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82440b1440 0x7f822c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.478+0000 7f8243fff640 1 --2- 172.21.15.114:0/1606031302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f822c004d00 0x7f822c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.478+0000 7f8242ffd640 1 -- 172.21.15.114:0/1606031302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82440b1440 msgr2=0x7f822c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.478+0000 7f8242ffd640 1 --2- 172.21.15.114:0/1606031302 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82440b1440 0x7f822c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.478+0000 7f8242ffd640 1 -- 172.21.15.114:0/1606031302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f822c004d00 msgr2=0x7f822c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.478+0000 7f8242ffd640 1 --2- 172.21.15.114:0/1606031302 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f822c004d00 0x7f822c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.478+0000 7f8242ffd640 1 -- 172.21.15.114:0/1606031302 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c003520 con 0x7f822c003ee0 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.479+0000 7f8242ffd640 1 --2- 172.21.15.114:0/1606031302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f822c003ee0 0x7f822c0047c0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f8238009ac0 tx=0x7f822c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227200c34b58a7ff server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.479+0000 7f82427fc640 1 -- 172.21.15.114:0/1606031302 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823802c6b0 con 0x7f822c003ee0 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.479+0000 7f82427fc640 1 -- 172.21.15.114:0/1606031302 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823802c810 con 0x7f822c003ee0 2023-11-04T01:42:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.479+0000 7f82427fc640 1 -- 172.21.15.114:0/1606031302 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823802cba0 con 0x7f822c003ee0 2023-11-04T01:42:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.479+0000 7f8249f65640 1 -- 172.21.15.114:0/1606031302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f822c003ee0 msgr2=0x7f822c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.479+0000 7f8249f65640 1 --2- 172.21.15.114:0/1606031302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f822c003ee0 0x7f822c0047c0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f8238009ac0 tx=0x7f822c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.479+0000 7f8243fff640 1 -- 172.21.15.114:0/1606031302 reap_dead start 2023-11-04T01:42:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.479+0000 7f8249f65640 1 -- 172.21.15.114:0/1606031302 shutdown_connections 2023-11-04T01:42:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.479+0000 7f8249f65640 1 -- 172.21.15.114:0/1606031302 >> 172.21.15.114:0/1606031302 conn(0x7f82440cbd30 msgr2=0x7f82440cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.479+0000 7f8249f65640 1 -- 172.21.15.114:0/1606031302 shutdown_connections 2023-11-04T01:42:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.479+0000 7f8249f65640 1 -- 172.21.15.114:0/1606031302 wait complete. 2023-11-04T01:42:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.480+0000 7f8249f65640 1 Processor -- start 2023-11-04T01:42:40.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.481+0000 7f8249f65640 1 -- start start 2023-11-04T01:42:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.481+0000 7f8249f65640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f822c003ee0 0x7f824415b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.481+0000 7f8249f65640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f824414a770 0x7f82440b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.481+0000 7f8249f65640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8244155190 0x7f8244155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.481+0000 7f8249f65640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8244155b50 con 0x7f8244155190 2023-11-04T01:42:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.481+0000 7f8249f65640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82440b4040 con 0x7f822c003ee0 2023-11-04T01:42:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.481+0000 7f8249f65640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824415dbe0 con 0x7f824414a770 2023-11-04T01:42:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.481+0000 7f8243fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8244155190 0x7f8244155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.481+0000 7f8243fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8244155190 0x7f8244155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56300/0 (socket says 172.21.15.114:56300) 2023-11-04T01:42:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.481+0000 7f8243fff640 1 -- 172.21.15.114:0/292493181 learned_addr learned my addr 172.21.15.114:0/292493181 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.482+0000 7f8242ffd640 1 --2- 172.21.15.114:0/292493181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f824414a770 0x7f82440b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.482+0000 7f82437fe640 1 --2- 172.21.15.114:0/292493181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f822c003ee0 0x7f824415b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.482+0000 7f8243fff640 1 -- 172.21.15.114:0/292493181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f824414a770 msgr2=0x7f82440b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.482+0000 7f8243fff640 1 --2- 172.21.15.114:0/292493181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f824414a770 0x7f82440b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.482+0000 7f8243fff640 1 -- 172.21.15.114:0/292493181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f822c003ee0 msgr2=0x7f824415b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.482+0000 7f8243fff640 1 --2- 172.21.15.114:0/292493181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f822c003ee0 0x7f824415b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.482+0000 7f8243fff640 1 -- 172.21.15.114:0/292493181 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82440b1230 con 0x7f8244155190 2023-11-04T01:42:40.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.482+0000 7f8243fff640 1 --2- 172.21.15.114:0/292493181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8244155190 0x7f8244155610 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f82440c2d80 tx=0x7f823c007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.482+0000 7f822bfff640 1 -- 172.21.15.114:0/292493181 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c00ea40 con 0x7f8244155190 2023-11-04T01:42:40.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.482+0000 7f822bfff640 1 -- 172.21.15.114:0/292493181 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823c00ebc0 con 0x7f8244155190 2023-11-04T01:42:40.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.482+0000 7f8249f65640 1 -- 172.21.15.114:0/292493181 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82440b3a80 con 0x7f8244155190 2023-11-04T01:42:40.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.482+0000 7f822bfff640 1 -- 172.21.15.114:0/292493181 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c014430 con 0x7f8244155190 2023-11-04T01:42:40.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.482+0000 7f8249f65640 1 -- 172.21.15.114:0/292493181 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824415d870 con 0x7f8244155190 2023-11-04T01:42:40.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.483+0000 7f8249f65640 1 -- 172.21.15.114:0/292493181 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82440684b0 con 0x7f8244155190 2023-11-04T01:42:40.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.483+0000 7f822bfff640 1 -- 172.21.15.114:0/292493181 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f823c014590 con 0x7f8244155190 2023-11-04T01:42:40.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.484+0000 7f822bfff640 1 --2- 172.21.15.114:0/292493181 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f823006ae70 0x7f823006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.484+0000 7f82437fe640 1 --2- 172.21.15.114:0/292493181 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f823006ae70 0x7f823006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.484+0000 7f822bfff640 1 -- 172.21.15.114:0/292493181 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f823c089a20 con 0x7f8244155190 2023-11-04T01:42:40.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.484+0000 7f82437fe640 1 --2- 172.21.15.114:0/292493181 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f823006ae70 0x7f823006d330 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8234000ef0 tx=0x7f8234009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.488+0000 7f822bfff640 1 -- 172.21.15.114:0/292493181 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f823c0542e0 con 0x7f8244155190 2023-11-04T01:42:40.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.691+0000 7f8249f65640 1 -- 172.21.15.114:0/292493181 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8244065df0 con 0x7f8244155190 2023-11-04T01:42:40.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.691+0000 7f822bfff640 1 -- 172.21.15.114:0/292493181 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f823c057900 con 0x7f8244155190 2023-11-04T01:42:40.693 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:40.693 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":91,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:38.634213+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:40.693 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 91 2023-11-04T01:42:40.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.693+0000 7f8249f65640 1 -- 172.21.15.114:0/292493181 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f823006ae70 msgr2=0x7f823006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.693+0000 7f8249f65640 1 --2- 172.21.15.114:0/292493181 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f823006ae70 0x7f823006d330 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8234000ef0 tx=0x7f8234009040 comp rx=0 tx=0).stop 2023-11-04T01:42:40.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.693+0000 7f8249f65640 1 -- 172.21.15.114:0/292493181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8244155190 msgr2=0x7f8244155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.693+0000 7f8249f65640 1 --2- 172.21.15.114:0/292493181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8244155190 0x7f8244155610 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f82440c2d80 tx=0x7f823c007bc0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.693+0000 7f8249f65640 1 -- 172.21.15.114:0/292493181 shutdown_connections 2023-11-04T01:42:40.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.693+0000 7f8249f65640 1 --2- 172.21.15.114:0/292493181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8244155190 0x7f8244155610 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.693+0000 7f8249f65640 1 --2- 172.21.15.114:0/292493181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f824414a770 0x7f82440b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.693+0000 7f8249f65640 1 --2- 172.21.15.114:0/292493181 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f823006ae70 0x7f823006d330 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.693+0000 7f8249f65640 1 --2- 172.21.15.114:0/292493181 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f822c003ee0 0x7f824415b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.693+0000 7f8249f65640 1 -- 172.21.15.114:0/292493181 >> 172.21.15.114:0/292493181 conn(0x7f82440cbd30 msgr2=0x7f82441583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.693+0000 7f8249f65640 1 -- 172.21.15.114:0/292493181 shutdown_connections 2023-11-04T01:42:40.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:40.693+0000 7f8249f65640 1 -- 172.21.15.114:0/292493181 wait complete. 2023-11-04T01:42:40.706 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:42:40.818 INFO:teuthology.orchestra.run.smithi114.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{"17":[5,9]},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:42:40.819 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": { "17": [ 5, 9 ] }, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:42:40.819 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:40.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:40.819 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-11-04T01:42:40.846 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:42:40.846 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:40.907 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:41.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.044+0000 7f59d075a640 1 Processor -- start 2023-11-04T01:42:41.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.044+0000 7f59d075a640 1 -- start start 2023-11-04T01:42:41.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.044+0000 7f59d075a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f59c815b200 0x7f59c80ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.044+0000 7f59d075a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59c80afda0 0x7f59c80cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.045+0000 7f59d075a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c80cdc40 con 0x7f59c80cd7f0 2023-11-04T01:42:41.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.045+0000 7f59d075a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c80cde80 con 0x7f59c815b200 2023-11-04T01:42:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.045+0000 7f59d075a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80cf670 con 0x7f59c80afda0 2023-11-04T01:42:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.045+0000 7f59ce4f6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f59c815b200 0x7f59c80ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.045+0000 7f59cecf7640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f59c80cd7f0 0x7f59c80cb840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32924/0 (socket says 172.21.15.114:32924) 2023-11-04T01:42:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.045+0000 7f59cecf7640 1 -- 172.21.15.114:0/1259328202 learned_addr learned my addr 172.21.15.114:0/1259328202 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.045+0000 7f59cdcf5640 1 --2- 172.21.15.114:0/1259328202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59c80afda0 0x7f59c80cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.045+0000 7f59ce4f6640 1 -- 172.21.15.114:0/1259328202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59c80afda0 msgr2=0x7f59c80cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.045+0000 7f59ce4f6640 1 --2- 172.21.15.114:0/1259328202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59c80afda0 0x7f59c80cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.045+0000 7f59ce4f6640 1 -- 172.21.15.114:0/1259328202 >> v1:172.21.15.114:6789/0 conn(0x7f59c80cd7f0 legacy=0x7f59c80cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.045+0000 7f59ce4f6640 1 -- 172.21.15.114:0/1259328202 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80cf950 con 0x7f59c815b200 2023-11-04T01:42:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.045+0000 7f59cd4f4640 1 -- 172.21.15.114:0/1259328202 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572832604 0 0) 0x7f59c0001490 con 0x7f59c80cd7f0 2023-11-04T01:42:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.045+0000 7f59cdcf5640 1 --2- 172.21.15.114:0/1259328202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59c80afda0 0x7f59c80cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.046+0000 7f59ce4f6640 1 --2- 172.21.15.114:0/1259328202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c815b200 0x7f59c80ceb30 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009790 tx=0x7f59c402b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff12cbb159ae8d96 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.046+0000 7f59cd4f4640 1 -- 172.21.15.114:0/1259328202 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4031770 con 0x7f59c815b200 2023-11-04T01:42:41.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.046+0000 7f59cd4f4640 1 -- 172.21.15.114:0/1259328202 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c40318d0 con 0x7f59c815b200 2023-11-04T01:42:41.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.046+0000 7f59cd4f4640 1 -- 172.21.15.114:0/1259328202 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4031c60 con 0x7f59c815b200 2023-11-04T01:42:41.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.046+0000 7f59d075a640 1 -- 172.21.15.114:0/1259328202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c815b200 msgr2=0x7f59c80ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.046+0000 7f59d075a640 1 --2- 172.21.15.114:0/1259328202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c815b200 0x7f59c80ceb30 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009790 tx=0x7f59c402b810 comp rx=0 tx=0).stop 2023-11-04T01:42:41.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.046+0000 7f59d075a640 1 -- 172.21.15.114:0/1259328202 shutdown_connections 2023-11-04T01:42:41.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.046+0000 7f59d075a640 1 --2- 172.21.15.114:0/1259328202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59c80afda0 0x7f59c80cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.046+0000 7f59d075a640 1 --2- 172.21.15.114:0/1259328202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c815b200 0x7f59c80ceb30 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.046+0000 7f59d075a640 1 -- 172.21.15.114:0/1259328202 >> 172.21.15.114:0/1259328202 conn(0x7f59c80d0c30 msgr2=0x7f59c80d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.046+0000 7f59d075a640 1 -- 172.21.15.114:0/1259328202 shutdown_connections 2023-11-04T01:42:41.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.046+0000 7f59d075a640 1 -- 172.21.15.114:0/1259328202 wait complete. 2023-11-04T01:42:41.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.048+0000 7f59d075a640 1 Processor -- start 2023-11-04T01:42:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.048+0000 7f59d075a640 1 -- start start 2023-11-04T01:42:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.048+0000 7f59d075a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59c80afda0 0x7f59c80b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.048+0000 7f59d075a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c80cd7f0 0x7f59c81f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.048+0000 7f59d075a640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f59c815b200 0x7f59c81f0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.048+0000 7f59d075a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80b4b10 con 0x7f59c80cd7f0 2023-11-04T01:42:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.048+0000 7f59d075a640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80b3f90 con 0x7f59c815b200 2023-11-04T01:42:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.048+0000 7f59d075a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80b4270 con 0x7f59c80afda0 2023-11-04T01:42:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.048+0000 7f59cdcf5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c80cd7f0 0x7f59c81f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.048+0000 7f59cdcf5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c80cd7f0 0x7f59c81f4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56326/0 (socket says 172.21.15.114:56326) 2023-11-04T01:42:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.048+0000 7f59cdcf5640 1 -- 172.21.15.114:0/3242363901 learned_addr learned my addr 172.21.15.114:0/3242363901 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.049+0000 7f59ce4f6640 1 --2- 172.21.15.114:0/3242363901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59c80afda0 0x7f59c80b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.049+0000 7f59cecf7640 1 --2- 172.21.15.114:0/3242363901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f59c815b200 0x7f59c81f0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.049+0000 7f59cdcf5640 1 -- 172.21.15.114:0/3242363901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59c80afda0 msgr2=0x7f59c80b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.049+0000 7f59cdcf5640 1 --2- 172.21.15.114:0/3242363901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59c80afda0 0x7f59c80b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.049+0000 7f59cdcf5640 1 -- 172.21.15.114:0/3242363901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f59c815b200 msgr2=0x7f59c81f0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.049+0000 7f59cdcf5640 1 --2- 172.21.15.114:0/3242363901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f59c815b200 0x7f59c81f0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.049+0000 7f59cdcf5640 1 -- 172.21.15.114:0/3242363901 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c40093a0 con 0x7f59c80cd7f0 2023-11-04T01:42:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.049+0000 7f59cecf7640 1 --2- 172.21.15.114:0/3242363901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f59c815b200 0x7f59c81f0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.049+0000 7f59cdcf5640 1 --2- 172.21.15.114:0/3242363901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c80cd7f0 0x7f59c81f4a00 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f59b800c7f0 tx=0x7f59b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.049+0000 7f59beffd640 1 -- 172.21.15.114:0/3242363901 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8007a30 con 0x7f59c80cd7f0 2023-11-04T01:42:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.049+0000 7f59beffd640 1 -- 172.21.15.114:0/3242363901 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b8007b90 con 0x7f59c80cd7f0 2023-11-04T01:42:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.049+0000 7f59d075a640 1 -- 172.21.15.114:0/3242363901 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c80b4550 con 0x7f59c80cd7f0 2023-11-04T01:42:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.049+0000 7f59beffd640 1 -- 172.21.15.114:0/3242363901 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b800ce40 con 0x7f59c80cd7f0 2023-11-04T01:42:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.049+0000 7f59d075a640 1 -- 172.21.15.114:0/3242363901 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c81f0870 con 0x7f59c80cd7f0 2023-11-04T01:42:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.050+0000 7f59d075a640 1 -- 172.21.15.114:0/3242363901 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c80684b0 con 0x7f59c80cd7f0 2023-11-04T01:42:41.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.051+0000 7f59beffd640 1 -- 172.21.15.114:0/3242363901 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f59b80113f0 con 0x7f59c80cd7f0 2023-11-04T01:42:41.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.051+0000 7f59beffd640 1 --2- 172.21.15.114:0/3242363901 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f59ac06ae70 0x7f59ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.051+0000 7f59beffd640 1 -- 172.21.15.114:0/3242363901 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f59b8089fa0 con 0x7f59c80cd7f0 2023-11-04T01:42:41.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.051+0000 7f59ce4f6640 1 --2- 172.21.15.114:0/3242363901 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f59ac06ae70 0x7f59ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.051+0000 7f59ce4f6640 1 --2- 172.21.15.114:0/3242363901 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f59ac06ae70 0x7f59ac06d330 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f59c4036000 tx=0x7f59c4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.055+0000 7f59beffd640 1 -- 172.21.15.114:0/3242363901 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f59b80bcca0 con 0x7f59c80cd7f0 2023-11-04T01:42:41.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.221+0000 7f59d075a640 1 -- 172.21.15.114:0/3242363901 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59c80ae7d0 con 0x7f59c80cd7f0 2023-11-04T01:42:41.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.223+0000 7f59beffd640 1 -- 172.21.15.114:0/3242363901 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+23035 (secure 0 0 0) 0x7f59b801f090 con 0x7f59c80cd7f0 2023-11-04T01:42:41.225 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:41.225 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":108,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:42:37.613085+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:50.031565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:50.411946+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":2}]},{"pgid":"17.3c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6834/1629274449":"2023-11-05T01:42:21.762099+0000","172.21.15.114:6836/1629274449":"2023-11-05T01:42:21.762099+0000","172.21.15.114:6837/1052115332":"2023-11-05T01:41:48.753700+0000","172.21.15.114:6835/1052115332":"2023-11-05T01:41:48.753700+0000","172.21.15.114:6836/2722332212":"2023-11-05T01:41:22.824334+0000","192.168.0.1:0/958873281":"2023-11-04T02:42:36.859026+0000","172.21.15.114:6837/1768068040":"2023-11-05T01:40:57.284155+0000","172.21.15.114:6834/2722332212":"2023-11-05T01:41:22.824334+0000","172.21.15.114:6835/1768068040":"2023-11-05T01:40:57.284155+0000","172.21.15.141:6834/1296600989":"2023-11-05T01:42:28.568489+0000","172.21.15.141:6832/1296600989":"2023-11-05T01:42:28.568489+0000","172.21.15.114:6836/3780323525":"2023-11-05T01:40:32.050690+0000","172.21.15.114:6834/3780323525":"2023-11-05T01:40:32.050690+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.225+0000 7f59d075a640 1 -- 172.21.15.114:0/3242363901 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f59ac06ae70 msgr2=0x7f59ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.225+0000 7f59d075a640 1 --2- 172.21.15.114:0/3242363901 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f59ac06ae70 0x7f59ac06d330 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f59c4036000 tx=0x7f59c4008030 comp rx=0 tx=0).stop 2023-11-04T01:42:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.225+0000 7f59d075a640 1 -- 172.21.15.114:0/3242363901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c80cd7f0 msgr2=0x7f59c81f4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.225+0000 7f59d075a640 1 --2- 172.21.15.114:0/3242363901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c80cd7f0 0x7f59c81f4a00 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f59b800c7f0 tx=0x7f59b800cbf0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.225+0000 7f59d075a640 1 -- 172.21.15.114:0/3242363901 shutdown_connections 2023-11-04T01:42:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.225+0000 7f59d075a640 1 --2- 172.21.15.114:0/3242363901 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f59ac06ae70 0x7f59ac06d330 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.225+0000 7f59d075a640 1 --2- 172.21.15.114:0/3242363901 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f59c815b200 0x7f59c81f0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.225+0000 7f59d075a640 1 --2- 172.21.15.114:0/3242363901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c80cd7f0 0x7f59c81f4a00 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.225+0000 7f59d075a640 1 --2- 172.21.15.114:0/3242363901 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f59c80afda0 0x7f59c80b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.225+0000 7f59d075a640 1 -- 172.21.15.114:0/3242363901 >> 172.21.15.114:0/3242363901 conn(0x7f59c80d0c30 msgr2=0x7f59c80ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.225+0000 7f59d075a640 1 -- 172.21.15.114:0/3242363901 shutdown_connections 2023-11-04T01:42:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.225+0000 7f59d075a640 1 -- 172.21.15.114:0/3242363901 wait complete. 2023-11-04T01:42:41.237 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:58.316710+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:59.185397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:50.031565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:50.411946+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 104, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:41.238 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:41.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.339+0000 7fbd8a497640 1 Processor -- start 2023-11-04T01:42:41.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.339+0000 7fbd8a497640 1 -- start start 2023-11-04T01:42:41.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.340+0000 7fbd8a497640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd84159e40 0x7fbd840b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.340+0000 7fbd8a497640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbd84070700 0x7fbd840b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.340+0000 7fbd8a497640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd84071500 con 0x7fbd8406bb60 2023-11-04T01:42:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.340+0000 7fbd8a497640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8415dae0 con 0x7fbd84070700 2023-11-04T01:42:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.340+0000 7fbd8a497640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd84070c60 con 0x7fbd84159e40 2023-11-04T01:42:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.340+0000 7fbd83fff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd84159e40 0x7fbd840b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.340+0000 7fbd88a34640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbd84070700 0x7fbd840b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.340+0000 7fbd83fff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd84159e40 0x7fbd840b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:41638/0 (socket says 172.21.15.114:41638) 2023-11-04T01:42:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.340+0000 7fbd83fff640 1 -- 172.21.15.114:0/2295223819 learned_addr learned my addr 172.21.15.114:0/2295223819 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.340+0000 7fbd837fe640 1 --1- 172.21.15.114:0/2295223819 >> v1:172.21.15.141:6789/0 conn(0x7fbd8406bb60 0x7fbd8406fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:33630/0 (socket says 172.21.15.114:33630) 2023-11-04T01:42:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.341+0000 7fbd83fff640 1 -- 172.21.15.114:0/2295223819 >> v2:172.21.15.141:3300/0 conn(0x7fbd84070700 msgr2=0x7fbd840b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.341+0000 7fbd83fff640 1 --2- 172.21.15.114:0/2295223819 >> v2:172.21.15.141:3300/0 conn(0x7fbd84070700 0x7fbd840b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.341+0000 7fbd83fff640 1 -- 172.21.15.114:0/2295223819 >> v1:172.21.15.141:6789/0 conn(0x7fbd8406bb60 legacy=0x7fbd8406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.341+0000 7fbd83fff640 1 -- 172.21.15.114:0/2295223819 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd84070f40 con 0x7fbd84159e40 2023-11-04T01:42:41.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.341+0000 7fbd88a34640 1 --2- 172.21.15.114:0/2295223819 >> v2:172.21.15.141:3300/0 conn(0x7fbd84070700 0x7fbd840b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.342+0000 7fbd83fff640 1 --2- 172.21.15.114:0/2295223819 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd84159e40 0x7fbd840b0530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009870 tx=0x7fbd7402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a2e6d3f9354d86d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.342+0000 7fbd82ffd640 1 -- 172.21.15.114:0/2295223819 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74031640 con 0x7fbd84159e40 2023-11-04T01:42:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.342+0000 7fbd82ffd640 1 -- 172.21.15.114:0/2295223819 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd740317a0 con 0x7fbd84159e40 2023-11-04T01:42:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.342+0000 7fbd82ffd640 1 -- 172.21.15.114:0/2295223819 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74031b30 con 0x7fbd84159e40 2023-11-04T01:42:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.342+0000 7fbd8a497640 1 -- 172.21.15.114:0/2295223819 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd84159e40 msgr2=0x7fbd840b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.342+0000 7fbd8a497640 1 --2- 172.21.15.114:0/2295223819 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd84159e40 0x7fbd840b0530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009870 tx=0x7fbd7402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.342+0000 7fbd8a497640 1 -- 172.21.15.114:0/2295223819 shutdown_connections 2023-11-04T01:42:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.342+0000 7fbd8a497640 1 --2- 172.21.15.114:0/2295223819 >> v2:172.21.15.141:3300/0 conn(0x7fbd84070700 0x7fbd840b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.342+0000 7fbd8a497640 1 --2- 172.21.15.114:0/2295223819 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd84159e40 0x7fbd840b0530 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.342+0000 7fbd8a497640 1 -- 172.21.15.114:0/2295223819 >> 172.21.15.114:0/2295223819 conn(0x7fbd840cb530 msgr2=0x7fbd840cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.342+0000 7fbd8a497640 1 -- 172.21.15.114:0/2295223819 shutdown_connections 2023-11-04T01:42:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.342+0000 7fbd8a497640 1 -- 172.21.15.114:0/2295223819 wait complete. 2023-11-04T01:42:41.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.343+0000 7fbd8a497640 1 Processor -- start 2023-11-04T01:42:41.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.344+0000 7fbd8a497640 1 -- start start 2023-11-04T01:42:41.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.344+0000 7fbd8a497640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd8406bb60 0x7fbd84147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.344+0000 7fbd8a497640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd84070700 0x7fbd840c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.344+0000 7fbd8a497640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd84159e40 0x7fbd840c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.344+0000 7fbd8a497640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd840c74a0 con 0x7fbd8406bb60 2023-11-04T01:42:41.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.344+0000 7fbd8a497640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd84148490 con 0x7fbd84070700 2023-11-04T01:42:41.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.344+0000 7fbd8a497640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd840c6920 con 0x7fbd84159e40 2023-11-04T01:42:41.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.345+0000 7fbd83fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd8406bb60 0x7fbd84147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.345+0000 7fbd83fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd8406bb60 0x7fbd84147f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56336/0 (socket says 172.21.15.114:56336) 2023-11-04T01:42:41.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.345+0000 7fbd83fff640 1 -- 172.21.15.114:0/2095884713 learned_addr learned my addr 172.21.15.114:0/2095884713 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:41.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.345+0000 7fbd837fe640 1 --2- 172.21.15.114:0/2095884713 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd84070700 0x7fbd840c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.345+0000 7fbd88a34640 1 --2- 172.21.15.114:0/2095884713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd84159e40 0x7fbd840c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.345+0000 7fbd83fff640 1 -- 172.21.15.114:0/2095884713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd84159e40 msgr2=0x7fbd840c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.345+0000 7fbd83fff640 1 --2- 172.21.15.114:0/2095884713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd84159e40 0x7fbd840c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.345+0000 7fbd83fff640 1 -- 172.21.15.114:0/2095884713 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd84070700 msgr2=0x7fbd840c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.345+0000 7fbd83fff640 1 --2- 172.21.15.114:0/2095884713 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd84070700 0x7fbd840c25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.345+0000 7fbd83fff640 1 -- 172.21.15.114:0/2095884713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7c009a70 con 0x7fbd8406bb60 2023-11-04T01:42:41.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.345+0000 7fbd83fff640 1 --2- 172.21.15.114:0/2095884713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd8406bb60 0x7fbd84147f50 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009870 tx=0x7fbd740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.345+0000 7fbd80ff9640 1 -- 172.21.15.114:0/2095884713 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7403a930 con 0x7fbd8406bb60 2023-11-04T01:42:41.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.345+0000 7fbd80ff9640 1 -- 172.21.15.114:0/2095884713 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7403aa90 con 0x7fbd8406bb60 2023-11-04T01:42:41.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.345+0000 7fbd80ff9640 1 -- 172.21.15.114:0/2095884713 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7403ae40 con 0x7fbd8406bb60 2023-11-04T01:42:41.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.345+0000 7fbd8a497640 1 -- 172.21.15.114:0/2095884713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd740094d0 con 0x7fbd8406bb60 2023-11-04T01:42:41.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.345+0000 7fbd8a497640 1 -- 172.21.15.114:0/2095884713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd840c6ee0 con 0x7fbd8406bb60 2023-11-04T01:42:41.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.346+0000 7fbd8a497640 1 -- 172.21.15.114:0/2095884713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd840684b0 con 0x7fbd8406bb60 2023-11-04T01:42:41.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.347+0000 7fbd80ff9640 1 -- 172.21.15.114:0/2095884713 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd7402f050 con 0x7fbd8406bb60 2023-11-04T01:42:41.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.347+0000 7fbd80ff9640 1 --2- 172.21.15.114:0/2095884713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd7006ae70 0x7fbd7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.347+0000 7fbd80ff9640 1 -- 172.21.15.114:0/2095884713 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fbd740abd10 con 0x7fbd8406bb60 2023-11-04T01:42:41.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.347+0000 7fbd837fe640 1 --2- 172.21.15.114:0/2095884713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd7006ae70 0x7fbd7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.348+0000 7fbd837fe640 1 --2- 172.21.15.114:0/2095884713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd7006ae70 0x7fbd7006d330 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbd84159850 tx=0x7fbd78000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.351+0000 7fbd80ff9640 1 -- 172.21.15.114:0/2095884713 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd74076600 con 0x7fbd8406bb60 2023-11-04T01:42:41.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.518+0000 7fbd8a497640 1 -- 172.21.15.114:0/2095884713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd840c9750 con 0x7fbd8406bb60 2023-11-04T01:42:41.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.519+0000 7fbd80ff9640 1 -- 172.21.15.114:0/2095884713 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd74079c20 con 0x7fbd8406bb60 2023-11-04T01:42:41.521 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:42:41.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.521+0000 7fbd8a497640 1 -- 172.21.15.114:0/2095884713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd7006ae70 msgr2=0x7fbd7006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.521+0000 7fbd8a497640 1 --2- 172.21.15.114:0/2095884713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd7006ae70 0x7fbd7006d330 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbd84159850 tx=0x7fbd78000ed0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.521+0000 7fbd8a497640 1 -- 172.21.15.114:0/2095884713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd8406bb60 msgr2=0x7fbd84147f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.521+0000 7fbd8a497640 1 --2- 172.21.15.114:0/2095884713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd8406bb60 0x7fbd84147f50 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009870 tx=0x7fbd740046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.521+0000 7fbd8a497640 1 -- 172.21.15.114:0/2095884713 shutdown_connections 2023-11-04T01:42:41.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.521+0000 7fbd8a497640 1 --2- 172.21.15.114:0/2095884713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbd84159e40 0x7fbd840c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.521+0000 7fbd8a497640 1 --2- 172.21.15.114:0/2095884713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbd7006ae70 0x7fbd7006d330 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.521+0000 7fbd8a497640 1 --2- 172.21.15.114:0/2095884713 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbd84070700 0x7fbd840c25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.521+0000 7fbd8a497640 1 --2- 172.21.15.114:0/2095884713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd8406bb60 0x7fbd84147f50 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.521+0000 7fbd8a497640 1 -- 172.21.15.114:0/2095884713 >> 172.21.15.114:0/2095884713 conn(0x7fbd840cb530 msgr2=0x7fbd840ae560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.521+0000 7fbd8a497640 1 -- 172.21.15.114:0/2095884713 shutdown_connections 2023-11-04T01:42:41.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.521+0000 7fbd8a497640 1 -- 172.21.15.114:0/2095884713 wait complete. 2023-11-04T01:42:41.533 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:41.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.633+0000 7f26a31d0640 1 Processor -- start 2023-11-04T01:42:41.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.633+0000 7f26a31d0640 1 -- start start 2023-11-04T01:42:41.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.634+0000 7f26a31d0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f269c0cc680 0x7f269c0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.634+0000 7f26a31d0640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f269c06c220 0x7f269c0ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.634+0000 7f26a31d0640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269c0cd720 con 0x7f269c0addd0 2023-11-04T01:42:41.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.634+0000 7f26a31d0640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f269c0ae1b0 con 0x7f269c06c220 2023-11-04T01:42:41.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.634+0000 7f26a31d0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269c0ccb10 con 0x7f269c0cc680 2023-11-04T01:42:41.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.634+0000 7f269bfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f269c0cc680 0x7f269c0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.634+0000 7f269bfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f269c0cc680 0x7f269c0cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:41658/0 (socket says 172.21.15.114:41658) 2023-11-04T01:42:41.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.634+0000 7f269bfff640 1 -- 172.21.15.114:0/486789143 learned_addr learned my addr 172.21.15.114:0/486789143 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:41.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.634+0000 7f26a176d640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f269c06c220 0x7f269c0ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.635+0000 7f269bfff640 1 -- 172.21.15.114:0/486789143 >> v2:172.21.15.141:3300/0 conn(0x7f269c06c220 msgr2=0x7f269c0ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.635+0000 7f269bfff640 1 --2- 172.21.15.114:0/486789143 >> v2:172.21.15.141:3300/0 conn(0x7f269c06c220 0x7f269c0ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.635+0000 7f269bfff640 1 -- 172.21.15.114:0/486789143 >> v1:172.21.15.141:6789/0 conn(0x7f269c0addd0 legacy=0x7f269c06bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.635+0000 7f269bfff640 1 -- 172.21.15.114:0/486789143 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c0ccdf0 con 0x7f269c0cc680 2023-11-04T01:42:41.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.635+0000 7f26a176d640 1 --2- 172.21.15.114:0/486789143 >> v2:172.21.15.141:3300/0 conn(0x7f269c06c220 0x7f269c0ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:41.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.635+0000 7f269bfff640 1 --2- 172.21.15.114:0/486789143 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f269c0cc680 0x7f269c0cdbb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f269000bb10 tx=0x7f269002e150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52b4f16d7fda2d96 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.636+0000 7f269b7fe640 1 -- 172.21.15.114:0/486789143 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690036440 con 0x7f269c0cc680 2023-11-04T01:42:41.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.636+0000 7f269b7fe640 1 -- 172.21.15.114:0/486789143 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26900365a0 con 0x7f269c0cc680 2023-11-04T01:42:41.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.636+0000 7f269b7fe640 1 -- 172.21.15.114:0/486789143 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690036930 con 0x7f269c0cc680 2023-11-04T01:42:41.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.636+0000 7f26a31d0640 1 -- 172.21.15.114:0/486789143 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f269c0cc680 msgr2=0x7f269c0cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.636+0000 7f26a31d0640 1 --2- 172.21.15.114:0/486789143 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f269c0cc680 0x7f269c0cdbb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f269000bb10 tx=0x7f269002e150 comp rx=0 tx=0).stop 2023-11-04T01:42:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.636+0000 7f26a31d0640 1 -- 172.21.15.114:0/486789143 shutdown_connections 2023-11-04T01:42:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.636+0000 7f26a31d0640 1 --2- 172.21.15.114:0/486789143 >> v2:172.21.15.141:3300/0 conn(0x7f269c06c220 0x7f269c0ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.636+0000 7f26a31d0640 1 --2- 172.21.15.114:0/486789143 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f269c0cc680 0x7f269c0cdbb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.636+0000 7f26a31d0640 1 -- 172.21.15.114:0/486789143 >> 172.21.15.114:0/486789143 conn(0x7f269c0cb530 msgr2=0x7f269c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.636+0000 7f26a31d0640 1 -- 172.21.15.114:0/486789143 shutdown_connections 2023-11-04T01:42:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.636+0000 7f26a31d0640 1 -- 172.21.15.114:0/486789143 wait complete. 2023-11-04T01:42:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.637+0000 7f26a31d0640 1 Processor -- start 2023-11-04T01:42:41.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.637+0000 7f26a31d0640 1 -- start start 2023-11-04T01:42:41.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.638+0000 7f26a31d0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c06c220 0x7f269c153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.638+0000 7f26a31d0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f269c0addd0 0x7f269c0b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.638+0000 7f26a31d0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f269c0b1c10 0x7f269c0aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.638+0000 7f26a31d0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c0b2d60 con 0x7f269c06c220 2023-11-04T01:42:41.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.638+0000 7f26a31d0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c0b2150 con 0x7f269c0addd0 2023-11-04T01:42:41.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.638+0000 7f26a31d0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269c0b2430 con 0x7f269c0b1c10 2023-11-04T01:42:41.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.638+0000 7f26a0f6c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c06c220 0x7f269c153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.638+0000 7f26a0f6c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c06c220 0x7f269c153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56350/0 (socket says 172.21.15.114:56350) 2023-11-04T01:42:41.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.638+0000 7f26a0f6c640 1 -- 172.21.15.114:0/3659155750 learned_addr learned my addr 172.21.15.114:0/3659155750 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:41.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.639+0000 7f269bfff640 1 --2- 172.21.15.114:0/3659155750 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f269c0addd0 0x7f269c0b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.639+0000 7f26a176d640 1 --2- 172.21.15.114:0/3659155750 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f269c0b1c10 0x7f269c0aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.639+0000 7f26a0f6c640 1 -- 172.21.15.114:0/3659155750 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f269c0b1c10 msgr2=0x7f269c0aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.639+0000 7f26a0f6c640 1 --2- 172.21.15.114:0/3659155750 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f269c0b1c10 0x7f269c0aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.639+0000 7f26a0f6c640 1 -- 172.21.15.114:0/3659155750 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f269c0addd0 msgr2=0x7f269c0b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.639+0000 7f26a0f6c640 1 --2- 172.21.15.114:0/3659155750 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f269c0addd0 0x7f269c0b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.639+0000 7f26a0f6c640 1 -- 172.21.15.114:0/3659155750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2694006680 con 0x7f269c06c220 2023-11-04T01:42:41.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.639+0000 7f26a0f6c640 1 --2- 172.21.15.114:0/3659155750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c06c220 0x7f269c153f30 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f268c00c450 tx=0x7f268c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.639+0000 7f26997fa640 1 -- 172.21.15.114:0/3659155750 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c0052d0 con 0x7f269c06c220 2023-11-04T01:42:41.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.639+0000 7f26997fa640 1 -- 172.21.15.114:0/3659155750 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268c005430 con 0x7f269c06c220 2023-11-04T01:42:41.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.639+0000 7f26997fa640 1 -- 172.21.15.114:0/3659155750 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c012870 con 0x7f269c06c220 2023-11-04T01:42:41.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.639+0000 7f26a31d0640 1 -- 172.21.15.114:0/3659155750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269000b770 con 0x7f269c06c220 2023-11-04T01:42:41.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.639+0000 7f26a31d0640 1 -- 172.21.15.114:0/3659155750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269c0b29f0 con 0x7f269c06c220 2023-11-04T01:42:41.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.640+0000 7f26a31d0640 1 -- 172.21.15.114:0/3659155750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269c0684b0 con 0x7f269c06c220 2023-11-04T01:42:41.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.641+0000 7f26997fa640 1 -- 172.21.15.114:0/3659155750 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f268c0129d0 con 0x7f269c06c220 2023-11-04T01:42:41.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.641+0000 7f26997fa640 1 --2- 172.21.15.114:0/3659155750 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f268806ae70 0x7f268806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.642+0000 7f269bfff640 1 --2- 172.21.15.114:0/3659155750 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f268806ae70 0x7f268806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.642+0000 7f269bfff640 1 --2- 172.21.15.114:0/3659155750 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f268806ae70 0x7f268806d330 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2690038000 tx=0x7f2690032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.642+0000 7f26997fa640 1 -- 172.21.15.114:0/3659155750 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f268c057e20 con 0x7f269c06c220 2023-11-04T01:42:41.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.647+0000 7f26997fa640 1 -- 172.21.15.114:0/3659155750 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f268c054160 con 0x7f269c06c220 2023-11-04T01:42:41.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.814+0000 7f26a31d0640 1 -- 172.21.15.114:0/3659155750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f269c0b4a30 con 0x7f269c06c220 2023-11-04T01:42:41.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.814+0000 7f26997fa640 1 -- 172.21.15.114:0/3659155750 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v108) v1 ==== 103+0+11 (secure 0 0 0) 0x7f268c057780 con 0x7f269c06c220 2023-11-04T01:42:41.816 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:42:41.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.816+0000 7f26a31d0640 1 -- 172.21.15.114:0/3659155750 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f268806ae70 msgr2=0x7f268806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.816+0000 7f26a31d0640 1 --2- 172.21.15.114:0/3659155750 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f268806ae70 0x7f268806d330 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2690038000 tx=0x7f2690032000 comp rx=0 tx=0).stop 2023-11-04T01:42:41.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.816+0000 7f26a31d0640 1 -- 172.21.15.114:0/3659155750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c06c220 msgr2=0x7f269c153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.816+0000 7f26a31d0640 1 --2- 172.21.15.114:0/3659155750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c06c220 0x7f269c153f30 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f268c00c450 tx=0x7f268c00c910 comp rx=0 tx=0).stop 2023-11-04T01:42:41.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.816+0000 7f26a31d0640 1 -- 172.21.15.114:0/3659155750 shutdown_connections 2023-11-04T01:42:41.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.816+0000 7f26a31d0640 1 --2- 172.21.15.114:0/3659155750 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f269c0b1c10 0x7f269c0aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.816+0000 7f26a31d0640 1 --2- 172.21.15.114:0/3659155750 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f268806ae70 0x7f268806d330 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.816+0000 7f26a31d0640 1 --2- 172.21.15.114:0/3659155750 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f269c0addd0 0x7f269c0b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.816+0000 7f26a31d0640 1 --2- 172.21.15.114:0/3659155750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c06c220 0x7f269c153f30 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.816+0000 7f26a31d0640 1 -- 172.21.15.114:0/3659155750 >> 172.21.15.114:0/3659155750 conn(0x7f269c0cb530 msgr2=0x7f269c071320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.816+0000 7f26a31d0640 1 -- 172.21.15.114:0/3659155750 shutdown_connections 2023-11-04T01:42:41.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.816+0000 7f26a31d0640 1 -- 172.21.15.114:0/3659155750 wait complete. 2023-11-04T01:42:41.828 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:42:41.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.929+0000 7fc2dd283640 1 Processor -- start 2023-11-04T01:42:41.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.929+0000 7fc2dd283640 1 -- start start 2023-11-04T01:42:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.930+0000 7fc2dd283640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc2d80b2210 0x7fc2d80cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.930+0000 7fc2dd283640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2d815d630 0x7fc2d80cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.930+0000 7fc2dd283640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d80b0150 con 0x7fc2d80ceda0 2023-11-04T01:42:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.930+0000 7fc2dd283640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d80b1df0 con 0x7fc2d80b2210 2023-11-04T01:42:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.930+0000 7fc2dd283640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80b1170 con 0x7fc2d815d630 2023-11-04T01:42:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.930+0000 7fc2d67fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc2d80b2210 0x7fc2d80cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.930+0000 7fc2d67fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc2d80b2210 0x7fc2d80cf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56354/0 (socket says 172.21.15.114:56354) 2023-11-04T01:42:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.930+0000 7fc2d67fc640 1 -- 172.21.15.114:0/3882694009 learned_addr learned my addr 172.21.15.114:0/3882694009 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.930+0000 7fc2d67fc640 1 -- 172.21.15.114:0/3882694009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2d815d630 msgr2=0x7fc2d80cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.930+0000 7fc2d67fc640 1 --2- 172.21.15.114:0/3882694009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2d815d630 0x7fc2d80cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.930+0000 7fc2d67fc640 1 -- 172.21.15.114:0/3882694009 >> v1:172.21.15.141:6789/0 conn(0x7fc2d80ceda0 legacy=0x7fc2d815cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.930+0000 7fc2d67fc640 1 -- 172.21.15.114:0/3882694009 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d80b1450 con 0x7fc2d80b2210 2023-11-04T01:42:41.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.931+0000 7fc2d67fc640 1 --2- 172.21.15.114:0/3882694009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2d80b2210 0x7fc2d80cf180 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009870 tx=0x7fc2cc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfb8d5b640e15f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.931+0000 7fc2d5ffb640 1 -- 172.21.15.114:0/3882694009 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc0317c0 con 0x7fc2d80b2210 2023-11-04T01:42:41.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.931+0000 7fc2d5ffb640 1 -- 172.21.15.114:0/3882694009 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2cc031920 con 0x7fc2d80b2210 2023-11-04T01:42:41.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.931+0000 7fc2d5ffb640 1 -- 172.21.15.114:0/3882694009 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc031cb0 con 0x7fc2d80b2210 2023-11-04T01:42:41.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.931+0000 7fc2dd283640 1 -- 172.21.15.114:0/3882694009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2d80b2210 msgr2=0x7fc2d80cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.931+0000 7fc2dd283640 1 --2- 172.21.15.114:0/3882694009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2d80b2210 0x7fc2d80cf180 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009870 tx=0x7fc2cc02b860 comp rx=0 tx=0).stop 2023-11-04T01:42:41.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.932+0000 7fc2dd283640 1 -- 172.21.15.114:0/3882694009 shutdown_connections 2023-11-04T01:42:41.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.932+0000 7fc2dd283640 1 --2- 172.21.15.114:0/3882694009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2d815d630 0x7fc2d80cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.932+0000 7fc2dd283640 1 --2- 172.21.15.114:0/3882694009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2d80b2210 0x7fc2d80cf180 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.932+0000 7fc2dd283640 1 -- 172.21.15.114:0/3882694009 >> 172.21.15.114:0/3882694009 conn(0x7fc2d80d0c30 msgr2=0x7fc2d80d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.932+0000 7fc2dd283640 1 -- 172.21.15.114:0/3882694009 shutdown_connections 2023-11-04T01:42:41.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.932+0000 7fc2dd283640 1 -- 172.21.15.114:0/3882694009 wait complete. 2023-11-04T01:42:41.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.933+0000 7fc2dd283640 1 Processor -- start 2023-11-04T01:42:41.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.933+0000 7fc2dd283640 1 -- start start 2023-11-04T01:42:41.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2dd283640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2d80b2210 0x7fc2d81f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2dd283640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2d80ceda0 0x7fc2d80c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2dd283640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2d815d630 0x7fc2d80ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2dd283640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80c9ea0 con 0x7fc2d80b2210 2023-11-04T01:42:41.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2dd283640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80c9bd0 con 0x7fc2d815d630 2023-11-04T01:42:41.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2dd283640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d81f3c90 con 0x7fc2d80ceda0 2023-11-04T01:42:41.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2d6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2d80b2210 0x7fc2d81f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2d6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2d80b2210 0x7fc2d81f6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56370/0 (socket says 172.21.15.114:56370) 2023-11-04T01:42:41.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2d6ffd640 1 -- 172.21.15.114:0/2481057898 learned_addr learned my addr 172.21.15.114:0/2481057898 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:41.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2d67fc640 1 --2- 172.21.15.114:0/2481057898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2d80ceda0 0x7fc2d80c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2d77fe640 1 --2- 172.21.15.114:0/2481057898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2d815d630 0x7fc2d80ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2d6ffd640 1 -- 172.21.15.114:0/2481057898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2d80ceda0 msgr2=0x7fc2d80c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2d6ffd640 1 --2- 172.21.15.114:0/2481057898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2d80ceda0 0x7fc2d80c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2d6ffd640 1 -- 172.21.15.114:0/2481057898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2d815d630 msgr2=0x7fc2d80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2d6ffd640 1 --2- 172.21.15.114:0/2481057898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2d815d630 0x7fc2d80ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2d6ffd640 1 -- 172.21.15.114:0/2481057898 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc0094d0 con 0x7fc2d80b2210 2023-11-04T01:42:41.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2d77fe640 1 --2- 172.21.15.114:0/2481057898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2d815d630 0x7fc2d80ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:41.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2d6ffd640 1 --2- 172.21.15.114:0/2481057898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2d80b2210 0x7fc2d81f6ec0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800b3c0 tx=0x7fc2c800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2bf7fe640 1 -- 172.21.15.114:0/2481057898 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8015070 con 0x7fc2d80b2210 2023-11-04T01:42:41.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2bf7fe640 1 -- 172.21.15.114:0/2481057898 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c8005920 con 0x7fc2d80b2210 2023-11-04T01:42:41.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2dd283640 1 -- 172.21.15.114:0/2481057898 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d81f2ed0 con 0x7fc2d80b2210 2023-11-04T01:42:41.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2bf7fe640 1 -- 172.21.15.114:0/2481057898 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8005d30 con 0x7fc2d80b2210 2023-11-04T01:42:41.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.934+0000 7fc2dd283640 1 -- 172.21.15.114:0/2481057898 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d81f3490 con 0x7fc2d80b2210 2023-11-04T01:42:41.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.935+0000 7fc2dd283640 1 -- 172.21.15.114:0/2481057898 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d80684b0 con 0x7fc2d80b2210 2023-11-04T01:42:41.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.936+0000 7fc2bf7fe640 1 -- 172.21.15.114:0/2481057898 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc2c8011630 con 0x7fc2d80b2210 2023-11-04T01:42:41.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.936+0000 7fc2bf7fe640 1 --2- 172.21.15.114:0/2481057898 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc2c406ae70 0x7fc2c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.936+0000 7fc2bf7fe640 1 -- 172.21.15.114:0/2481057898 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fc2c8089470 con 0x7fc2d80b2210 2023-11-04T01:42:41.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.936+0000 7fc2d67fc640 1 --2- 172.21.15.114:0/2481057898 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc2c406ae70 0x7fc2c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.937+0000 7fc2d67fc640 1 --2- 172.21.15.114:0/2481057898 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc2c406ae70 0x7fc2c406d330 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc036000 tx=0x7fc2cc03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:41.940+0000 7fc2bf7fe640 1 -- 172.21.15.114:0/2481057898 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc2c8053dc0 con 0x7fc2d80b2210 2023-11-04T01:42:42.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.105+0000 7fc2dd283640 1 -- 172.21.15.114:0/2481057898 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fc2d81587b0 con 0x7fc2d80b2210 2023-11-04T01:42:42.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.106+0000 7fc2bf7fe640 1 -- 172.21.15.114:0/2481057898 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v108) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc2c80573e0 con 0x7fc2d80b2210 2023-11-04T01:42:42.110 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:42:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.108+0000 7fc2dd283640 1 -- 172.21.15.114:0/2481057898 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc2c406ae70 msgr2=0x7fc2c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.108+0000 7fc2dd283640 1 --2- 172.21.15.114:0/2481057898 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc2c406ae70 0x7fc2c406d330 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc036000 tx=0x7fc2cc03d040 comp rx=0 tx=0).stop 2023-11-04T01:42:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.108+0000 7fc2dd283640 1 -- 172.21.15.114:0/2481057898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2d80b2210 msgr2=0x7fc2d81f6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.108+0000 7fc2dd283640 1 --2- 172.21.15.114:0/2481057898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2d80b2210 0x7fc2d81f6ec0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800b3c0 tx=0x7fc2c800b880 comp rx=0 tx=0).stop 2023-11-04T01:42:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.108+0000 7fc2dd283640 1 -- 172.21.15.114:0/2481057898 shutdown_connections 2023-11-04T01:42:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.108+0000 7fc2dd283640 1 --2- 172.21.15.114:0/2481057898 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc2c406ae70 0x7fc2c406d330 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.108+0000 7fc2dd283640 1 --2- 172.21.15.114:0/2481057898 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc2d815d630 0x7fc2d80ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.108+0000 7fc2dd283640 1 --2- 172.21.15.114:0/2481057898 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc2d80ceda0 0x7fc2d80c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.108+0000 7fc2dd283640 1 --2- 172.21.15.114:0/2481057898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2d80b2210 0x7fc2d81f6ec0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.108+0000 7fc2dd283640 1 -- 172.21.15.114:0/2481057898 >> 172.21.15.114:0/2481057898 conn(0x7fc2d80d0c30 msgr2=0x7fc2d80cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.108+0000 7fc2dd283640 1 -- 172.21.15.114:0/2481057898 shutdown_connections 2023-11-04T01:42:42.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.108+0000 7fc2dd283640 1 -- 172.21.15.114:0/2481057898 wait complete. 2023-11-04T01:42:42.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:42:42.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.220+0000 7f0860290640 1 Processor -- start 2023-11-04T01:42:42.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.220+0000 7f0860290640 1 -- start start 2023-11-04T01:42:42.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.221+0000 7f0860290640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f085815d4e0 0x7f08580ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.221+0000 7f0860290640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08580b25a0 con 0x7f08580ced90 2023-11-04T01:42:42.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.221+0000 7f0860290640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08580b2300 con 0x7f08580ca8b0 2023-11-04T01:42:42.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.221+0000 7f0860290640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085815d8c0 con 0x7f085815d4e0 2023-11-04T01:42:42.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d82b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f08580ced90 0x7f08580ca1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32928/0 (socket says 172.21.15.114:32928) 2023-11-04T01:42:42.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d82b640 1 -- 172.21.15.114:0/1904199681 learned_addr learned my addr 172.21.15.114:0/1904199681 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:42.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d02a640 1 -- 172.21.15.114:0/1904199681 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591498474 0 0) 0x7f08580b25a0 con 0x7f08580ced90 2023-11-04T01:42:42.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085e02c640 1 --2- 172.21.15.114:0/1904199681 >> v2:172.21.15.141:3300/0 conn(0x7f085815d4e0 0x7f08580ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d02a640 1 -- 172.21.15.114:0/1904199681 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0844003520 con 0x7f08580ced90 2023-11-04T01:42:42.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d02a640 1 -- 172.21.15.114:0/1904199681 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1921853049 0 0) 0x7f0844003520 con 0x7f08580ced90 2023-11-04T01:42:42.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d02a640 1 -- 172.21.15.114:0/1904199681 >> v2:172.21.15.141:3300/0 conn(0x7f085815d4e0 msgr2=0x7f08580ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d02a640 1 --2- 172.21.15.114:0/1904199681 >> v2:172.21.15.141:3300/0 conn(0x7f085815d4e0 0x7f08580ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d02a640 1 -- 172.21.15.114:0/1904199681 >> v1:172.21.15.141:6789/0 conn(0x7f08580ca8b0 legacy=0x7f085806a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d02a640 1 -- 172.21.15.114:0/1904199681 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085815e5f0 con 0x7f08580ced90 2023-11-04T01:42:42.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d02a640 1 -- 172.21.15.114:0/1904199681 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f0848001670 con 0x7f08580ced90 2023-11-04T01:42:42.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d02a640 1 -- 172.21.15.114:0/1904199681 >> v1:172.21.15.114:6789/0 conn(0x7f08580ced90 legacy=0x7f08580ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d02a640 1 --2- 172.21.15.114:0/1904199681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0844003970 0x7f0844003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d02a640 1 --2- 172.21.15.114:0/1904199681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08440047c0 0x7f0844004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d02a640 1 --2- 172.21.15.114:0/1904199681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0844005180 0x7f084400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d02a640 1 -- 172.21.15.114:0/1904199681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085815d8c0 con 0x7f0844005180 2023-11-04T01:42:42.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d02a640 1 -- 172.21.15.114:0/1904199681 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084400c020 con 0x7f0844003970 2023-11-04T01:42:42.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d02a640 1 -- 172.21.15.114:0/1904199681 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084400c1e0 con 0x7f08440047c0 2023-11-04T01:42:42.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085e82d640 1 --2- 172.21.15.114:0/1904199681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0844005180 0x7f084400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085e02c640 1 --2- 172.21.15.114:0/1904199681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0844003970 0x7f0844003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.222+0000 7f085d82b640 1 --2- 172.21.15.114:0/1904199681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08440047c0 0x7f0844004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.223+0000 7f085e82d640 1 -- 172.21.15.114:0/1904199681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08440047c0 msgr2=0x7f0844004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.223+0000 7f085e82d640 1 --2- 172.21.15.114:0/1904199681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f08440047c0 0x7f0844004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.223+0000 7f085e82d640 1 -- 172.21.15.114:0/1904199681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0844003970 msgr2=0x7f0844003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.223+0000 7f085e82d640 1 --2- 172.21.15.114:0/1904199681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0844003970 0x7f0844003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.223+0000 7f085e82d640 1 -- 172.21.15.114:0/1904199681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0844003520 con 0x7f0844005180 2023-11-04T01:42:42.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.223+0000 7f085e82d640 1 -- 172.21.15.114:0/1904199681 reap_dead start 2023-11-04T01:42:42.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.223+0000 7f085e82d640 1 --2- 172.21.15.114:0/1904199681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0844005180 0x7f084400b980 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f0854001750 tx=0x7f08440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f57f75592fee2aa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.223+0000 7f085d02a640 1 -- 172.21.15.114:0/1904199681 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08540052d0 con 0x7f0844005180 2023-11-04T01:42:42.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.223+0000 7f085d02a640 1 -- 172.21.15.114:0/1904199681 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085402e050 con 0x7f0844005180 2023-11-04T01:42:42.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.223+0000 7f085d02a640 1 -- 172.21.15.114:0/1904199681 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0854003830 con 0x7f0844005180 2023-11-04T01:42:42.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.224+0000 7f0860290640 1 -- 172.21.15.114:0/1904199681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0844005180 msgr2=0x7f084400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.224+0000 7f0860290640 1 --2- 172.21.15.114:0/1904199681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0844005180 0x7f084400b980 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f0854001750 tx=0x7f08440057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.224+0000 7f0860290640 1 -- 172.21.15.114:0/1904199681 shutdown_connections 2023-11-04T01:42:42.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.224+0000 7f0860290640 1 --2- 172.21.15.114:0/1904199681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0844005180 0x7f084400b980 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.224+0000 7f0860290640 1 -- 172.21.15.114:0/1904199681 >> 172.21.15.114:0/1904199681 conn(0x7f08580b1640 msgr2=0x7f08580b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.224+0000 7f0860290640 1 -- 172.21.15.114:0/1904199681 shutdown_connections 2023-11-04T01:42:42.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.224+0000 7f0860290640 1 -- 172.21.15.114:0/1904199681 wait complete. 2023-11-04T01:42:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.225+0000 7f0860290640 1 Processor -- start 2023-11-04T01:42:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.225+0000 7f0860290640 1 -- start start 2023-11-04T01:42:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f0860290640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0844005180 0x7f08580b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f0860290640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08581549c0 0x7f08581581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f0860290640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0858158700 0x7f08580b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f0860290640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0858158b80 con 0x7f08581549c0 2023-11-04T01:42:42.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f0860290640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08580c9b60 con 0x7f0844005180 2023-11-04T01:42:42.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f0860290640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08580c5fc0 con 0x7f0858158700 2023-11-04T01:42:42.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f085d82b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08581549c0 0x7f08581581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f085d82b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08581549c0 0x7f08581581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56378/0 (socket says 172.21.15.114:56378) 2023-11-04T01:42:42.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f085d82b640 1 -- 172.21.15.114:0/2569350879 learned_addr learned my addr 172.21.15.114:0/2569350879 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:42.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f085e02c640 1 --2- 172.21.15.114:0/2569350879 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0844005180 0x7f08580b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f085e82d640 1 --2- 172.21.15.114:0/2569350879 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0858158700 0x7f08580b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f085d82b640 1 -- 172.21.15.114:0/2569350879 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0858158700 msgr2=0x7f08580b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f085d82b640 1 --2- 172.21.15.114:0/2569350879 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0858158700 0x7f08580b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f085d82b640 1 -- 172.21.15.114:0/2569350879 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0844005180 msgr2=0x7f08580b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f085d82b640 1 --2- 172.21.15.114:0/2569350879 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0844005180 0x7f08580b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f085d82b640 1 -- 172.21.15.114:0/2569350879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08580c9230 con 0x7f08581549c0 2023-11-04T01:42:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.226+0000 7f085d82b640 1 --2- 172.21.15.114:0/2569350879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08581549c0 0x7f08581581c0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f0848007340 tx=0x7f0848007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.227+0000 7f084effd640 1 -- 172.21.15.114:0/2569350879 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084800f8c0 con 0x7f08581549c0 2023-11-04T01:42:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.227+0000 7f084effd640 1 -- 172.21.15.114:0/2569350879 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084800fa20 con 0x7f08581549c0 2023-11-04T01:42:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.227+0000 7f084effd640 1 -- 172.21.15.114:0/2569350879 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084800fdd0 con 0x7f08581549c0 2023-11-04T01:42:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.227+0000 7f0860290640 1 -- 172.21.15.114:0/2569350879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08580c9510 con 0x7f08581549c0 2023-11-04T01:42:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.227+0000 7f0860290640 1 -- 172.21.15.114:0/2569350879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0858154e40 con 0x7f08581549c0 2023-11-04T01:42:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.228+0000 7f0860290640 1 -- 172.21.15.114:0/2569350879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08580c9d10 con 0x7f08581549c0 2023-11-04T01:42:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.228+0000 7f084effd640 1 -- 172.21.15.114:0/2569350879 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f084801d460 con 0x7f08581549c0 2023-11-04T01:42:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.228+0000 7f084effd640 1 --2- 172.21.15.114:0/2569350879 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f083c06ae70 0x7f083c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.228+0000 7f084effd640 1 -- 172.21.15.114:0/2569350879 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f0848089ed0 con 0x7f08581549c0 2023-11-04T01:42:42.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.229+0000 7f085e02c640 1 --2- 172.21.15.114:0/2569350879 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f083c06ae70 0x7f083c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.229+0000 7f085e02c640 1 --2- 172.21.15.114:0/2569350879 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f083c06ae70 0x7f083c06d330 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0850014450 tx=0x7f085000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.233+0000 7f084effd640 1 -- 172.21.15.114:0/2569350879 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08580c9d10 con 0x7f08581549c0 2023-11-04T01:42:42.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.396+0000 7f0860290640 1 -- 172.21.15.114:0/2569350879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f08580c9d10 con 0x7f08581549c0 2023-11-04T01:42:42.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.397+0000 7f084effd640 1 -- 172.21.15.114:0/2569350879 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v108) v1 ==== 107+0+11 (secure 0 0 0) 0x7f08580c9d10 con 0x7f08581549c0 2023-11-04T01:42:42.399 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:42:42.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.398+0000 7f0860290640 1 -- 172.21.15.114:0/2569350879 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f083c06ae70 msgr2=0x7f083c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.398+0000 7f0860290640 1 --2- 172.21.15.114:0/2569350879 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f083c06ae70 0x7f083c06d330 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0850014450 tx=0x7f085000b040 comp rx=0 tx=0).stop 2023-11-04T01:42:42.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.398+0000 7f0860290640 1 -- 172.21.15.114:0/2569350879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08581549c0 msgr2=0x7f08581581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.398+0000 7f0860290640 1 --2- 172.21.15.114:0/2569350879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08581549c0 0x7f08581581c0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f0848007340 tx=0x7f0848007800 comp rx=0 tx=0).stop 2023-11-04T01:42:42.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.399+0000 7f0860290640 1 -- 172.21.15.114:0/2569350879 shutdown_connections 2023-11-04T01:42:42.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.399+0000 7f0860290640 1 --2- 172.21.15.114:0/2569350879 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0858158700 0x7f08580b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.399+0000 7f0860290640 1 --2- 172.21.15.114:0/2569350879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08581549c0 0x7f08581581c0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.399+0000 7f0860290640 1 --2- 172.21.15.114:0/2569350879 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f083c06ae70 0x7f083c06d330 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.399+0000 7f0860290640 1 --2- 172.21.15.114:0/2569350879 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0844005180 0x7f08580b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.399+0000 7f0860290640 1 -- 172.21.15.114:0/2569350879 >> 172.21.15.114:0/2569350879 conn(0x7f08580b1640 msgr2=0x7f085806e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.399+0000 7f0860290640 1 -- 172.21.15.114:0/2569350879 shutdown_connections 2023-11-04T01:42:42.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.399+0000 7f0860290640 1 -- 172.21.15.114:0/2569350879 wait complete. 2023-11-04T01:42:42.411 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:42.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.512+0000 7f4454a87640 1 Processor -- start 2023-11-04T01:42:42.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.512+0000 7f4454a87640 1 -- start start 2023-11-04T01:42:42.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.512+0000 7f4454a87640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4450159e40 0x7f44500b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f4454a87640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f445006bb60 0x7f44500b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f4454a87640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f445006fff0 0x7f4450070480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f4454a87640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4450071500 con 0x7f445006bb60 2023-11-04T01:42:42.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f4454a87640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445015dae0 con 0x7f445006fff0 2023-11-04T01:42:42.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f4454a87640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44500709c0 con 0x7f4450159e40 2023-11-04T01:42:42.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f444dd9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f445006bb60 0x7f44500b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f444dd9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f445006bb60 0x7f44500b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56382/0 (socket says 172.21.15.114:56382) 2023-11-04T01:42:42.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f444dd9b640 1 -- 172.21.15.114:0/81463549 learned_addr learned my addr 172.21.15.114:0/81463549 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:42.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f444e59c640 1 --2- 172.21.15.114:0/81463549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4450159e40 0x7f44500b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f444ed9d640 1 --2- 172.21.15.114:0/81463549 >> v2:172.21.15.141:3300/0 conn(0x7f445006fff0 0x7f4450070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f444dd9b640 1 -- 172.21.15.114:0/81463549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4450159e40 msgr2=0x7f44500b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f444dd9b640 1 --2- 172.21.15.114:0/81463549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4450159e40 0x7f44500b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f444dd9b640 1 -- 172.21.15.114:0/81463549 >> v2:172.21.15.141:3300/0 conn(0x7f445006fff0 msgr2=0x7f4450070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f444dd9b640 1 --2- 172.21.15.114:0/81463549 >> v2:172.21.15.141:3300/0 conn(0x7f445006fff0 0x7f4450070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f444dd9b640 1 -- 172.21.15.114:0/81463549 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4450070c60 con 0x7f445006bb60 2023-11-04T01:42:42.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f444e59c640 1 --2- 172.21.15.114:0/81463549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4450159e40 0x7f44500b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:42.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.513+0000 7f444ed9d640 1 --2- 172.21.15.114:0/81463549 >> v2:172.21.15.141:3300/0 conn(0x7f445006fff0 0x7f4450070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:42.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.514+0000 7f444dd9b640 1 --2- 172.21.15.114:0/81463549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f445006bb60 0x7f44500b0a70 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f44500cea40 tx=0x7f444002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c40e83b219b5b66 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.514+0000 7f444d59a640 1 -- 172.21.15.114:0/81463549 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44400317d0 con 0x7f445006bb60 2023-11-04T01:42:42.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.514+0000 7f444d59a640 1 -- 172.21.15.114:0/81463549 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4440031930 con 0x7f445006bb60 2023-11-04T01:42:42.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.514+0000 7f444d59a640 1 -- 172.21.15.114:0/81463549 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440031cc0 con 0x7f445006bb60 2023-11-04T01:42:42.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.514+0000 7f4454a87640 1 -- 172.21.15.114:0/81463549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f445006bb60 msgr2=0x7f44500b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.514+0000 7f4454a87640 1 --2- 172.21.15.114:0/81463549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f445006bb60 0x7f44500b0a70 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f44500cea40 tx=0x7f444002b870 comp rx=0 tx=0).stop 2023-11-04T01:42:42.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.514+0000 7f4454a87640 1 -- 172.21.15.114:0/81463549 shutdown_connections 2023-11-04T01:42:42.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.514+0000 7f4454a87640 1 --2- 172.21.15.114:0/81463549 >> v2:172.21.15.141:3300/0 conn(0x7f445006fff0 0x7f4450070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.514+0000 7f4454a87640 1 --2- 172.21.15.114:0/81463549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f445006bb60 0x7f44500b0a70 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.514+0000 7f4454a87640 1 --2- 172.21.15.114:0/81463549 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4450159e40 0x7f44500b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.514+0000 7f4454a87640 1 -- 172.21.15.114:0/81463549 >> 172.21.15.114:0/81463549 conn(0x7f44500cb530 msgr2=0x7f44500cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.514+0000 7f4454a87640 1 -- 172.21.15.114:0/81463549 shutdown_connections 2023-11-04T01:42:42.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.514+0000 7f4454a87640 1 -- 172.21.15.114:0/81463549 wait complete. 2023-11-04T01:42:42.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.516+0000 7f4454a87640 1 Processor -- start 2023-11-04T01:42:42.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.516+0000 7f4454a87640 1 -- start start 2023-11-04T01:42:42.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.516+0000 7f4454a87640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f445006bb60 0x7f44501f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.516+0000 7f4454a87640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f445006fff0 0x7f44501f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.516+0000 7f4454a87640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4450159e40 0x7f44501f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.516+0000 7f4454a87640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44500b2330 con 0x7f4450159e40 2023-11-04T01:42:42.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.516+0000 7f4454a87640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44500b16b0 con 0x7f445006fff0 2023-11-04T01:42:42.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.516+0000 7f4454a87640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44500b1990 con 0x7f445006bb60 2023-11-04T01:42:42.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.516+0000 7f444ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4450159e40 0x7f44501f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.517+0000 7f444ed9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4450159e40 0x7f44501f67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56396/0 (socket says 172.21.15.114:56396) 2023-11-04T01:42:42.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.517+0000 7f444ed9d640 1 -- 172.21.15.114:0/1619025409 learned_addr learned my addr 172.21.15.114:0/1619025409 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:42.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.517+0000 7f444e59c640 1 --2- 172.21.15.114:0/1619025409 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f445006bb60 0x7f44501f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.517+0000 7f444dd9b640 1 --2- 172.21.15.114:0/1619025409 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f445006fff0 0x7f44501f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.517+0000 7f444ed9d640 1 -- 172.21.15.114:0/1619025409 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f445006bb60 msgr2=0x7f44501f2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.517+0000 7f444ed9d640 1 --2- 172.21.15.114:0/1619025409 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f445006bb60 0x7f44501f2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.517+0000 7f444ed9d640 1 -- 172.21.15.114:0/1619025409 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f445006fff0 msgr2=0x7f44501f62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.517+0000 7f444ed9d640 1 --2- 172.21.15.114:0/1619025409 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f445006fff0 0x7f44501f62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.517+0000 7f444ed9d640 1 -- 172.21.15.114:0/1619025409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44400094d0 con 0x7f4450159e40 2023-11-04T01:42:42.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.517+0000 7f444dd9b640 1 --2- 172.21.15.114:0/1619025409 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f445006fff0 0x7f44501f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:42.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.517+0000 7f444ed9d640 1 --2- 172.21.15.114:0/1619025409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4450159e40 0x7f44501f67f0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f444800cd10 tx=0x7f444800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.517+0000 7f443effd640 1 -- 172.21.15.114:0/1619025409 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444800f680 con 0x7f4450159e40 2023-11-04T01:42:42.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.517+0000 7f443effd640 1 -- 172.21.15.114:0/1619025409 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444800f800 con 0x7f4450159e40 2023-11-04T01:42:42.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.517+0000 7f4454a87640 1 -- 172.21.15.114:0/1619025409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44500b1c70 con 0x7f4450159e40 2023-11-04T01:42:42.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.517+0000 7f443effd640 1 -- 172.21.15.114:0/1619025409 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444800fbb0 con 0x7f4450159e40 2023-11-04T01:42:42.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.517+0000 7f4454a87640 1 -- 172.21.15.114:0/1619025409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44501f2b60 con 0x7f4450159e40 2023-11-04T01:42:42.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.518+0000 7f4454a87640 1 -- 172.21.15.114:0/1619025409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44500b2470 con 0x7f4450159e40 2023-11-04T01:42:42.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.519+0000 7f443effd640 1 -- 172.21.15.114:0/1619025409 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f444800b040 con 0x7f4450159e40 2023-11-04T01:42:42.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.519+0000 7f443effd640 1 --2- 172.21.15.114:0/1619025409 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f443006ae70 0x7f443006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.519+0000 7f444e59c640 1 --2- 172.21.15.114:0/1619025409 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f443006ae70 0x7f443006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.519+0000 7f443effd640 1 -- 172.21.15.114:0/1619025409 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f444808a6e0 con 0x7f4450159e40 2023-11-04T01:42:42.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.519+0000 7f444e59c640 1 --2- 172.21.15.114:0/1619025409 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f443006ae70 0x7f443006d330 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4444008850 tx=0x7f4444008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.523+0000 7f443effd640 1 -- 172.21.15.114:0/1619025409 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f44500b2470 con 0x7f4450159e40 2023-11-04T01:42:42.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.689+0000 7f4454a87640 1 -- 172.21.15.114:0/1619025409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44500b2470 con 0x7f4450159e40 2023-11-04T01:42:42.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.690+0000 7f443effd640 1 -- 172.21.15.114:0/1619025409 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) v1 ==== 104+0+11 (secure 0 0 0) 0x7f44500b2470 con 0x7f4450159e40 2023-11-04T01:42:42.692 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:42:42.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.691+0000 7f4454a87640 1 -- 172.21.15.114:0/1619025409 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f443006ae70 msgr2=0x7f443006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.691+0000 7f4454a87640 1 --2- 172.21.15.114:0/1619025409 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f443006ae70 0x7f443006d330 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4444008850 tx=0x7f4444008040 comp rx=0 tx=0).stop 2023-11-04T01:42:42.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.691+0000 7f4454a87640 1 -- 172.21.15.114:0/1619025409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4450159e40 msgr2=0x7f44501f67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.691+0000 7f4454a87640 1 --2- 172.21.15.114:0/1619025409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4450159e40 0x7f44501f67f0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f444800cd10 tx=0x7f444800a650 comp rx=0 tx=0).stop 2023-11-04T01:42:42.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.691+0000 7f4454a87640 1 -- 172.21.15.114:0/1619025409 shutdown_connections 2023-11-04T01:42:42.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.691+0000 7f4454a87640 1 --2- 172.21.15.114:0/1619025409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4450159e40 0x7f44501f67f0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.691+0000 7f4454a87640 1 --2- 172.21.15.114:0/1619025409 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f443006ae70 0x7f443006d330 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.691+0000 7f4454a87640 1 --2- 172.21.15.114:0/1619025409 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f445006fff0 0x7f44501f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.691+0000 7f4454a87640 1 --2- 172.21.15.114:0/1619025409 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f445006bb60 0x7f44501f2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.691+0000 7f4454a87640 1 -- 172.21.15.114:0/1619025409 >> 172.21.15.114:0/1619025409 conn(0x7f44500cb530 msgr2=0x7f44500b0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.692+0000 7f4454a87640 1 -- 172.21.15.114:0/1619025409 shutdown_connections 2023-11-04T01:42:42.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.692+0000 7f4454a87640 1 -- 172.21.15.114:0/1619025409 wait complete. 2023-11-04T01:42:42.704 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:42.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.803+0000 7fe230044640 1 Processor -- start 2023-11-04T01:42:42.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.804+0000 7fe230044640 1 -- start start 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.804+0000 7fe230044640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe22815d100 0x7fe2280ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.805+0000 7fe230044640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2280d1be0 0x7fe2280b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.805+0000 7fe230044640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2280b32b0 con 0x7fe22815d4e0 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.805+0000 7fe230044640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2280cee10 con 0x7fe22815d100 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.805+0000 7fe230044640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2280b2980 con 0x7fe2280d1be0 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.805+0000 7fe22d5df640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe22815d4e0 0x7fe2280d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32938/0 (socket says 172.21.15.114:32938) 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.805+0000 7fe22d5df640 1 -- 172.21.15.114:0/1602249659 learned_addr learned my addr 172.21.15.114:0/1602249659 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.805+0000 7fe22dde0640 1 --2- 172.21.15.114:0/1602249659 >> v2:172.21.15.141:3300/0 conn(0x7fe22815d100 0x7fe2280ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.805+0000 7fe22e5e1640 1 --2- 172.21.15.114:0/1602249659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2280d1be0 0x7fe2280b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.805+0000 7fe22cdde640 1 -- 172.21.15.114:0/1602249659 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686027187 0 0) 0x7fe2280b32b0 con 0x7fe22815d4e0 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.805+0000 7fe22cdde640 1 -- 172.21.15.114:0/1602249659 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe214003520 con 0x7fe22815d4e0 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.805+0000 7fe22dde0640 1 -- 172.21.15.114:0/1602249659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2280d1be0 msgr2=0x7fe2280b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.805+0000 7fe22dde0640 1 --2- 172.21.15.114:0/1602249659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2280d1be0 0x7fe2280b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.805+0000 7fe22dde0640 1 -- 172.21.15.114:0/1602249659 >> v1:172.21.15.114:6789/0 conn(0x7fe22815d4e0 legacy=0x7fe2280d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.805+0000 7fe22dde0640 1 -- 172.21.15.114:0/1602249659 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2280b2c60 con 0x7fe22815d100 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.805+0000 7fe22e5e1640 1 --2- 172.21.15.114:0/1602249659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2280d1be0 0x7fe2280b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.806+0000 7fe22dde0640 1 --2- 172.21.15.114:0/1602249659 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe22815d100 0x7fe2280ce510 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe224009790 tx=0x7fe22402b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9da8d83ef9a2fa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.806+0000 7fe22cdde640 1 -- 172.21.15.114:0/1602249659 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224031800 con 0x7fe22815d100 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.806+0000 7fe22cdde640 1 -- 172.21.15.114:0/1602249659 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe224031960 con 0x7fe22815d100 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.806+0000 7fe22cdde640 1 -- 172.21.15.114:0/1602249659 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224031cd0 con 0x7fe22815d100 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.807+0000 7fe230044640 1 -- 172.21.15.114:0/1602249659 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe22815d100 msgr2=0x7fe2280ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.807+0000 7fe230044640 1 --2- 172.21.15.114:0/1602249659 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe22815d100 0x7fe2280ce510 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe224009790 tx=0x7fe22402b8a0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.807+0000 7fe230044640 1 -- 172.21.15.114:0/1602249659 shutdown_connections 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.807+0000 7fe230044640 1 --2- 172.21.15.114:0/1602249659 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2280d1be0 0x7fe2280b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.807+0000 7fe230044640 1 --2- 172.21.15.114:0/1602249659 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe22815d100 0x7fe2280ce510 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.807+0000 7fe230044640 1 -- 172.21.15.114:0/1602249659 >> 172.21.15.114:0/1602249659 conn(0x7fe2280d2ef0 msgr2=0x7fe2280d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.807+0000 7fe230044640 1 -- 172.21.15.114:0/1602249659 shutdown_connections 2023-11-04T01:42:42.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.807+0000 7fe230044640 1 -- 172.21.15.114:0/1602249659 wait complete. 2023-11-04T01:42:42.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.808+0000 7fe230044640 1 Processor -- start 2023-11-04T01:42:42.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.808+0000 7fe230044640 1 -- start start 2023-11-04T01:42:42.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe230044640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2280d1be0 0x7fe2280b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe230044640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe22815d100 0x7fe22806b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe230044640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe22815d4e0 0x7fe22806b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe230044640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2280b6530 con 0x7fe2280d1be0 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe230044640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2280b6810 con 0x7fe22815d100 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe230044640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2280b6af0 con 0x7fe22815d4e0 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe22dde0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2280d1be0 0x7fe2280b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe22dde0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2280d1be0 0x7fe2280b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56412/0 (socket says 172.21.15.114:56412) 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe22dde0640 1 -- 172.21.15.114:0/3738016375 learned_addr learned my addr 172.21.15.114:0/3738016375 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe22e5e1640 1 --2- 172.21.15.114:0/3738016375 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe22815d4e0 0x7fe22806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe22d5df640 1 --2- 172.21.15.114:0/3738016375 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe22815d100 0x7fe22806b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe22dde0640 1 -- 172.21.15.114:0/3738016375 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe22815d4e0 msgr2=0x7fe22806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe22dde0640 1 --2- 172.21.15.114:0/3738016375 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe22815d4e0 0x7fe22806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe22dde0640 1 -- 172.21.15.114:0/3738016375 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe22815d100 msgr2=0x7fe22806b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe22dde0640 1 --2- 172.21.15.114:0/3738016375 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe22815d100 0x7fe22806b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe22dde0640 1 -- 172.21.15.114:0/3738016375 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe220009a70 con 0x7fe2280d1be0 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe22d5df640 1 --2- 172.21.15.114:0/3738016375 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe22815d100 0x7fe22806b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe22e5e1640 1 --2- 172.21.15.114:0/3738016375 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe22815d4e0 0x7fe22806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe22dde0640 1 --2- 172.21.15.114:0/3738016375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2280d1be0 0x7fe2280b5a70 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fe224000c00 tx=0x7fe2240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe21e7fc640 1 -- 172.21.15.114:0/3738016375 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22403bc70 con 0x7fe2280d1be0 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe21e7fc640 1 -- 172.21.15.114:0/3738016375 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22403bdf0 con 0x7fe2280d1be0 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe230044640 1 -- 172.21.15.114:0/3738016375 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2240093a0 con 0x7fe2280d1be0 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe21e7fc640 1 -- 172.21.15.114:0/3738016375 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224045630 con 0x7fe2280d1be0 2023-11-04T01:42:42.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.809+0000 7fe230044640 1 -- 172.21.15.114:0/3738016375 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2281f3a50 con 0x7fe2280d1be0 2023-11-04T01:42:42.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.810+0000 7fe230044640 1 -- 172.21.15.114:0/3738016375 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2280684b0 con 0x7fe2280d1be0 2023-11-04T01:42:42.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.811+0000 7fe21e7fc640 1 -- 172.21.15.114:0/3738016375 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe22404e450 con 0x7fe2280d1be0 2023-11-04T01:42:42.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.811+0000 7fe21e7fc640 1 --2- 172.21.15.114:0/3738016375 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe20c06ae70 0x7fe20c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.811+0000 7fe21e7fc640 1 -- 172.21.15.114:0/3738016375 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fe22402e070 con 0x7fe2280d1be0 2023-11-04T01:42:42.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.811+0000 7fe22d5df640 1 --2- 172.21.15.114:0/3738016375 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe20c06ae70 0x7fe20c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.812+0000 7fe22d5df640 1 --2- 172.21.15.114:0/3738016375 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe20c06ae70 0x7fe20c06d330 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe218007fd0 tx=0x7fe218009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.815+0000 7fe21e7fc640 1 -- 172.21.15.114:0/3738016375 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe224076980 con 0x7fe2280d1be0 2023-11-04T01:42:42.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.983+0000 7fe230044640 1 -- 172.21.15.114:0/3738016375 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2280d2cd0 con 0x7fe2280d1be0 2023-11-04T01:42:42.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.984+0000 7fe21e7fc640 1 -- 172.21.15.114:0/3738016375 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe224035070 con 0x7fe2280d1be0 2023-11-04T01:42:42.986 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:42:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.986+0000 7fe230044640 1 -- 172.21.15.114:0/3738016375 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe20c06ae70 msgr2=0x7fe20c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.986+0000 7fe230044640 1 --2- 172.21.15.114:0/3738016375 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe20c06ae70 0x7fe20c06d330 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe218007fd0 tx=0x7fe218009040 comp rx=0 tx=0).stop 2023-11-04T01:42:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.986+0000 7fe230044640 1 -- 172.21.15.114:0/3738016375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2280d1be0 msgr2=0x7fe2280b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.986+0000 7fe230044640 1 --2- 172.21.15.114:0/3738016375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2280d1be0 0x7fe2280b5a70 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fe224000c00 tx=0x7fe2240046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.986+0000 7fe230044640 1 -- 172.21.15.114:0/3738016375 shutdown_connections 2023-11-04T01:42:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.986+0000 7fe230044640 1 --2- 172.21.15.114:0/3738016375 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe22815d4e0 0x7fe22806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.986+0000 7fe230044640 1 --2- 172.21.15.114:0/3738016375 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe20c06ae70 0x7fe20c06d330 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.986+0000 7fe230044640 1 --2- 172.21.15.114:0/3738016375 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe22815d100 0x7fe22806b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.986+0000 7fe230044640 1 --2- 172.21.15.114:0/3738016375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2280d1be0 0x7fe2280b5a70 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.986+0000 7fe230044640 1 -- 172.21.15.114:0/3738016375 >> 172.21.15.114:0/3738016375 conn(0x7fe2280d2ef0 msgr2=0x7fe2280b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.986+0000 7fe230044640 1 -- 172.21.15.114:0/3738016375 shutdown_connections 2023-11-04T01:42:42.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:42.986+0000 7fe230044640 1 -- 172.21.15.114:0/3738016375 wait complete. 2023-11-04T01:42:42.998 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:42:43.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.097+0000 7fd246f0c640 1 Processor -- start 2023-11-04T01:42:43.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.097+0000 7fd246f0c640 1 -- start start 2023-11-04T01:42:43.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.097+0000 7fd246f0c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd240159dd0 0x7fd24006c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.097+0000 7fd246f0c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2400b4070 con 0x7fd2400b3b00 2023-11-04T01:42:43.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.097+0000 7fd246f0c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24006a170 con 0x7fd2400acb00 2023-11-04T01:42:43.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.097+0000 7fd246f0c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24006a450 con 0x7fd240159dd0 2023-11-04T01:42:43.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.098+0000 7fd244ca8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd240159dd0 0x7fd24006c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.098+0000 7fd23ffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd2400b3b00 0x7fd24006af30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32944/0 (socket says 172.21.15.114:32944) 2023-11-04T01:42:43.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.098+0000 7fd23ffff640 1 -- 172.21.15.114:0/3485610911 learned_addr learned my addr 172.21.15.114:0/3485610911 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:43.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.098+0000 7fd244ca8640 1 -- 172.21.15.114:0/3485610911 >> v1:172.21.15.141:6789/0 conn(0x7fd2400acb00 legacy=0x7fd2400abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:43.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.098+0000 7fd244ca8640 1 -- 172.21.15.114:0/3485610911 >> v1:172.21.15.114:6789/0 conn(0x7fd2400b3b00 legacy=0x7fd24006af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.098+0000 7fd244ca8640 1 -- 172.21.15.114:0/3485610911 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24006a730 con 0x7fd240159dd0 2023-11-04T01:42:43.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.098+0000 7fd23f7fe640 1 -- 172.21.15.114:0/3485610911 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2146580493 0 0) 0x7fd2400b4070 con 0x7fd2400b3b00 2023-11-04T01:42:43.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.099+0000 7fd244ca8640 1 --2- 172.21.15.114:0/3485610911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd240159dd0 0x7fd24006c240 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fd234009790 tx=0x7fd23402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9428317f654fb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.099+0000 7fd23f7fe640 1 -- 172.21.15.114:0/3485610911 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234030610 con 0x7fd240159dd0 2023-11-04T01:42:43.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.099+0000 7fd23f7fe640 1 -- 172.21.15.114:0/3485610911 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd234030770 con 0x7fd240159dd0 2023-11-04T01:42:43.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.099+0000 7fd23f7fe640 1 -- 172.21.15.114:0/3485610911 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234030b00 con 0x7fd240159dd0 2023-11-04T01:42:43.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.099+0000 7fd246f0c640 1 -- 172.21.15.114:0/3485610911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd240159dd0 msgr2=0x7fd24006c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.099+0000 7fd246f0c640 1 --2- 172.21.15.114:0/3485610911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd240159dd0 0x7fd24006c240 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fd234009790 tx=0x7fd23402b960 comp rx=0 tx=0).stop 2023-11-04T01:42:43.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.099+0000 7fd246f0c640 1 -- 172.21.15.114:0/3485610911 shutdown_connections 2023-11-04T01:42:43.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.099+0000 7fd246f0c640 1 --2- 172.21.15.114:0/3485610911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd240159dd0 0x7fd24006c240 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.099+0000 7fd246f0c640 1 -- 172.21.15.114:0/3485610911 >> 172.21.15.114:0/3485610911 conn(0x7fd2400cbd30 msgr2=0x7fd2400cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.099+0000 7fd246f0c640 1 -- 172.21.15.114:0/3485610911 shutdown_connections 2023-11-04T01:42:43.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.099+0000 7fd246f0c640 1 -- 172.21.15.114:0/3485610911 wait complete. 2023-11-04T01:42:43.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.101+0000 7fd246f0c640 1 Processor -- start 2023-11-04T01:42:43.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.101+0000 7fd246f0c640 1 -- start start 2023-11-04T01:42:43.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.101+0000 7fd246f0c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2400acb00 0x7fd2400c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.101+0000 7fd246f0c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd2400b3b00 0x7fd240154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.101+0000 7fd246f0c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd240159dd0 0x7fd2400c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.101+0000 7fd246f0c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd240155380 con 0x7fd240159dd0 2023-11-04T01:42:43.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.101+0000 7fd246f0c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2400c6d60 con 0x7fd2400acb00 2023-11-04T01:42:43.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.101+0000 7fd246f0c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd240152f70 con 0x7fd2400b3b00 2023-11-04T01:42:43.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd2454a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd240159dd0 0x7fd2400c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd2454a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd240159dd0 0x7fd2400c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56434/0 (socket says 172.21.15.114:56434) 2023-11-04T01:42:43.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd2454a9640 1 -- 172.21.15.114:0/319723223 learned_addr learned my addr 172.21.15.114:0/319723223 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:43.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd244ca8640 1 --2- 172.21.15.114:0/319723223 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2400acb00 0x7fd2400c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd23ffff640 1 --2- 172.21.15.114:0/319723223 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd2400b3b00 0x7fd240154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd2454a9640 1 -- 172.21.15.114:0/319723223 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd2400b3b00 msgr2=0x7fd240154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd2454a9640 1 --2- 172.21.15.114:0/319723223 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd2400b3b00 0x7fd240154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd2454a9640 1 -- 172.21.15.114:0/319723223 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2400acb00 msgr2=0x7fd2400c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd2454a9640 1 --2- 172.21.15.114:0/319723223 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2400acb00 0x7fd2400c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd2454a9640 1 -- 172.21.15.114:0/319723223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2340093a0 con 0x7fd240159dd0 2023-11-04T01:42:43.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd244ca8640 1 --2- 172.21.15.114:0/319723223 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2400acb00 0x7fd2400c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:43.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd2454a9640 1 --2- 172.21.15.114:0/319723223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd240159dd0 0x7fd2400c6820 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fd23800c780 tx=0x7fd23800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd23d7fa640 1 -- 172.21.15.114:0/319723223 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238004b60 con 0x7fd240159dd0 2023-11-04T01:42:43.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd23d7fa640 1 -- 172.21.15.114:0/319723223 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23800ce90 con 0x7fd240159dd0 2023-11-04T01:42:43.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd23d7fa640 1 -- 172.21.15.114:0/319723223 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23800a7f0 con 0x7fd240159dd0 2023-11-04T01:42:43.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd246f0c640 1 -- 172.21.15.114:0/319723223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2400c8780 con 0x7fd240159dd0 2023-11-04T01:42:43.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.102+0000 7fd246f0c640 1 -- 172.21.15.114:0/319723223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2400c8d40 con 0x7fd240159dd0 2023-11-04T01:42:43.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.103+0000 7fd246f0c640 1 -- 172.21.15.114:0/319723223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd240067fe0 con 0x7fd240159dd0 2023-11-04T01:42:43.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.104+0000 7fd23d7fa640 1 -- 172.21.15.114:0/319723223 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd23800a950 con 0x7fd240159dd0 2023-11-04T01:42:43.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.104+0000 7fd23d7fa640 1 --2- 172.21.15.114:0/319723223 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd22406aea0 0x7fd22406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.104+0000 7fd23d7fa640 1 -- 172.21.15.114:0/319723223 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fd238089f60 con 0x7fd240159dd0 2023-11-04T01:42:43.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.104+0000 7fd244ca8640 1 --2- 172.21.15.114:0/319723223 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd22406aea0 0x7fd22406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.104+0000 7fd244ca8640 1 --2- 172.21.15.114:0/319723223 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd22406aea0 0x7fd22406d360 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd234036000 tx=0x7fd23403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.108+0000 7fd23d7fa640 1 -- 172.21.15.114:0/319723223 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd238054790 con 0x7fd240159dd0 2023-11-04T01:42:43.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.285+0000 7fd246f0c640 1 -- 172.21.15.114:0/319723223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd2400684b0 con 0x7fd240159dd0 2023-11-04T01:42:43.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.286+0000 7fd23d7fa640 1 -- 172.21.15.114:0/319723223 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 13 entries v108) v1 ==== 81+0+800 (secure 0 0 0) 0x7fd238057db0 con 0x7fd240159dd0 2023-11-04T01:42:43.288 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/1629274449 2023-11-05T01:42:21.762099+0000 2023-11-04T01:42:43.288 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/1629274449 2023-11-05T01:42:21.762099+0000 2023-11-04T01:42:43.288 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/1052115332 2023-11-05T01:41:48.753700+0000 2023-11-04T01:42:43.288 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/1052115332 2023-11-05T01:41:48.753700+0000 2023-11-04T01:42:43.288 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/2722332212 2023-11-05T01:41:22.824334+0000 2023-11-04T01:42:43.288 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.1:0/958873281 2023-11-04T02:42:36.859026+0000 2023-11-04T01:42:43.288 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/1768068040 2023-11-05T01:40:57.284155+0000 2023-11-04T01:42:43.288 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/2722332212 2023-11-05T01:41:22.824334+0000 2023-11-04T01:42:43.288 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/1768068040 2023-11-05T01:40:57.284155+0000 2023-11-04T01:42:43.288 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.141:6834/1296600989 2023-11-05T01:42:28.568489+0000 2023-11-04T01:42:43.289 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.141:6832/1296600989 2023-11-05T01:42:28.568489+0000 2023-11-04T01:42:43.289 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/3780323525 2023-11-05T01:40:32.050690+0000 2023-11-04T01:42:43.289 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/3780323525 2023-11-05T01:40:32.050690+0000 2023-11-04T01:42:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:listed 13 entries 2023-11-04T01:42:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.288+0000 7fd246f0c640 1 -- 172.21.15.114:0/319723223 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd22406aea0 msgr2=0x7fd22406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.288+0000 7fd246f0c640 1 --2- 172.21.15.114:0/319723223 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd22406aea0 0x7fd22406d360 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd234036000 tx=0x7fd23403b040 comp rx=0 tx=0).stop 2023-11-04T01:42:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.288+0000 7fd246f0c640 1 -- 172.21.15.114:0/319723223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd240159dd0 msgr2=0x7fd2400c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.288+0000 7fd246f0c640 1 --2- 172.21.15.114:0/319723223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd240159dd0 0x7fd2400c6820 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fd23800c780 tx=0x7fd23800cc40 comp rx=0 tx=0).stop 2023-11-04T01:42:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.288+0000 7fd246f0c640 1 -- 172.21.15.114:0/319723223 shutdown_connections 2023-11-04T01:42:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.288+0000 7fd246f0c640 1 --2- 172.21.15.114:0/319723223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd240159dd0 0x7fd2400c6820 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.288+0000 7fd246f0c640 1 --2- 172.21.15.114:0/319723223 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd2400b3b00 0x7fd240154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.288+0000 7fd246f0c640 1 --2- 172.21.15.114:0/319723223 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd22406aea0 0x7fd22406d360 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.288+0000 7fd246f0c640 1 --2- 172.21.15.114:0/319723223 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd2400acb00 0x7fd2400c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.288+0000 7fd246f0c640 1 -- 172.21.15.114:0/319723223 >> 172.21.15.114:0/319723223 conn(0x7fd2400cbd30 msgr2=0x7fd2400abf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.288+0000 7fd246f0c640 1 -- 172.21.15.114:0/319723223 shutdown_connections 2023-11-04T01:42:43.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.288+0000 7fd246f0c640 1 -- 172.21.15.114:0/319723223 wait complete. 2023-11-04T01:42:43.300 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:42:43.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:43.300 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:43.325 INFO:teuthology.orchestra.run.smithi114.stderr:mkdir: cannot create directory ‘d1/dir/.snap/s22’: Software caused connection abort 2023-11-04T01:42:43.357 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:42:43.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:43.358 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:42:43.412 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:42:43.412 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:43.467 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:42:43.467 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:42:43.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.604+0000 7fe51380e640 1 Processor -- start 2023-11-04T01:42:43.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.605+0000 7fe51380e640 1 -- start start 2023-11-04T01:42:43.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.605+0000 7fe51380e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe50c15d4e0 0x7fe50c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.605+0000 7fe51380e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe50c0d3b60 0x7fe50c0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.605+0000 7fe51380e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe50c0b32b0 con 0x7fe50c15d100 2023-11-04T01:42:43.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.605+0000 7fe51380e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe50c0cec20 con 0x7fe50c15d4e0 2023-11-04T01:42:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.605+0000 7fe51380e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0cee10 con 0x7fe50c0d3b60 2023-11-04T01:42:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.605+0000 7fe510da9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe50c15d4e0 0x7fe50c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.605+0000 7fe510da9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe50c15d4e0 0x7fe50c0d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56450/0 (socket says 172.21.15.114:56450) 2023-11-04T01:42:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.606+0000 7fe510da9640 1 -- 172.21.15.114:0/2380320771 learned_addr learned my addr 172.21.15.114:0/2380320771 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.606+0000 7fe511dab640 1 --2- 172.21.15.114:0/2380320771 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe50c0d3b60 0x7fe50c0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.606+0000 7fe510da9640 1 -- 172.21.15.114:0/2380320771 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe50c0d3b60 msgr2=0x7fe50c0d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.606+0000 7fe510da9640 1 --2- 172.21.15.114:0/2380320771 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe50c0d3b60 0x7fe50c0d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.606+0000 7fe510da9640 1 -- 172.21.15.114:0/2380320771 >> v1:172.21.15.141:6789/0 conn(0x7fe50c15d100 legacy=0x7fe50c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.606+0000 7fe510da9640 1 -- 172.21.15.114:0/2380320771 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c0b4750 con 0x7fe50c15d4e0 2023-11-04T01:42:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.606+0000 7fe511dab640 1 --2- 172.21.15.114:0/2380320771 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe50c0d3b60 0x7fe50c0d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:43.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.606+0000 7fe510da9640 1 --2- 172.21.15.114:0/2380320771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe50c15d4e0 0x7fe50c0d14d0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc009870 tx=0x7fe4fc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b1289480fa1261 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.607+0000 7fe503fff640 1 -- 172.21.15.114:0/2380320771 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc031640 con 0x7fe50c15d4e0 2023-11-04T01:42:43.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.607+0000 7fe503fff640 1 -- 172.21.15.114:0/2380320771 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc0317a0 con 0x7fe50c15d4e0 2023-11-04T01:42:43.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.607+0000 7fe503fff640 1 -- 172.21.15.114:0/2380320771 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc031b30 con 0x7fe50c15d4e0 2023-11-04T01:42:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.607+0000 7fe51380e640 1 -- 172.21.15.114:0/2380320771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe50c15d4e0 msgr2=0x7fe50c0d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.607+0000 7fe51380e640 1 --2- 172.21.15.114:0/2380320771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe50c15d4e0 0x7fe50c0d14d0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc009870 tx=0x7fe4fc02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.607+0000 7fe51380e640 1 -- 172.21.15.114:0/2380320771 shutdown_connections 2023-11-04T01:42:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.607+0000 7fe51380e640 1 --2- 172.21.15.114:0/2380320771 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe50c0d3b60 0x7fe50c0d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.607+0000 7fe51380e640 1 --2- 172.21.15.114:0/2380320771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe50c15d4e0 0x7fe50c0d14d0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.607+0000 7fe51380e640 1 -- 172.21.15.114:0/2380320771 >> 172.21.15.114:0/2380320771 conn(0x7fe50c0d2ef0 msgr2=0x7fe50c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.607+0000 7fe51380e640 1 -- 172.21.15.114:0/2380320771 shutdown_connections 2023-11-04T01:42:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.607+0000 7fe51380e640 1 -- 172.21.15.114:0/2380320771 wait complete. 2023-11-04T01:42:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.608+0000 7fe51380e640 1 Processor -- start 2023-11-04T01:42:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.608+0000 7fe51380e640 1 -- start start 2023-11-04T01:42:43.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.609+0000 7fe51380e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe50c0d3b60 0x7fe50c0cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.609+0000 7fe51380e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe50c15d100 0x7fe50c0cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.609+0000 7fe51380e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe50c15d4e0 0x7fe50c14b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.609+0000 7fe51380e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0cd1d0 con 0x7fe50c15d100 2023-11-04T01:42:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.609+0000 7fe51380e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0ccef0 con 0x7fe50c15d4e0 2023-11-04T01:42:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.609+0000 7fe51380e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c14bc60 con 0x7fe50c0d3b60 2023-11-04T01:42:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.609+0000 7fe510da9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe50c15d100 0x7fe50c0cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.609+0000 7fe510da9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe50c15d100 0x7fe50c0cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56464/0 (socket says 172.21.15.114:56464) 2023-11-04T01:42:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.609+0000 7fe510da9640 1 -- 172.21.15.114:0/1117787572 learned_addr learned my addr 172.21.15.114:0/1117787572 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.609+0000 7fe5115aa640 1 --2- 172.21.15.114:0/1117787572 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe50c0d3b60 0x7fe50c0cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.609+0000 7fe511dab640 1 --2- 172.21.15.114:0/1117787572 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe50c15d4e0 0x7fe50c14b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.610+0000 7fe510da9640 1 -- 172.21.15.114:0/1117787572 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe50c0d3b60 msgr2=0x7fe50c0cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.610+0000 7fe510da9640 1 --2- 172.21.15.114:0/1117787572 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe50c0d3b60 0x7fe50c0cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.610+0000 7fe510da9640 1 -- 172.21.15.114:0/1117787572 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe50c15d4e0 msgr2=0x7fe50c14b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.610+0000 7fe510da9640 1 --2- 172.21.15.114:0/1117787572 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe50c15d4e0 0x7fe50c14b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.610+0000 7fe510da9640 1 -- 172.21.15.114:0/1117787572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc0094d0 con 0x7fe50c15d100 2023-11-04T01:42:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.610+0000 7fe5115aa640 1 --2- 172.21.15.114:0/1117787572 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe50c0d3b60 0x7fe50c0cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.610+0000 7fe511dab640 1 --2- 172.21.15.114:0/1117787572 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe50c15d4e0 0x7fe50c14b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.610+0000 7fe510da9640 1 --2- 172.21.15.114:0/1117787572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe50c15d100 0x7fe50c0cc6a0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0090b0 tx=0x7fe4fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.610+0000 7fe501ffb640 1 -- 172.21.15.114:0/1117787572 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc03bc70 con 0x7fe50c15d100 2023-11-04T01:42:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.610+0000 7fe501ffb640 1 -- 172.21.15.114:0/1117787572 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc03bdd0 con 0x7fe50c15d100 2023-11-04T01:42:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.610+0000 7fe51380e640 1 -- 172.21.15.114:0/1117787572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50c14bf40 con 0x7fe50c15d100 2023-11-04T01:42:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.610+0000 7fe501ffb640 1 -- 172.21.15.114:0/1117787572 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc045630 con 0x7fe50c15d100 2023-11-04T01:42:43.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.610+0000 7fe51380e640 1 -- 172.21.15.114:0/1117787572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50c0ccbe0 con 0x7fe50c15d100 2023-11-04T01:42:43.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.611+0000 7fe51380e640 1 -- 172.21.15.114:0/1117787572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50c14c460 con 0x7fe50c15d100 2023-11-04T01:42:43.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.612+0000 7fe501ffb640 1 -- 172.21.15.114:0/1117787572 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4fc02f050 con 0x7fe50c15d100 2023-11-04T01:42:43.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.612+0000 7fe501ffb640 1 --2- 172.21.15.114:0/1117787572 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe4f006ae70 0x7fe4f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.612+0000 7fe5115aa640 1 --2- 172.21.15.114:0/1117787572 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe4f006ae70 0x7fe4f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.612+0000 7fe501ffb640 1 -- 172.21.15.114:0/1117787572 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fe4fc0abee0 con 0x7fe50c15d100 2023-11-04T01:42:43.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.612+0000 7fe5115aa640 1 --2- 172.21.15.114:0/1117787572 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe4f006ae70 0x7fe4f006d330 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe504003ee0 tx=0x7fe504009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.616+0000 7fe501ffb640 1 -- 172.21.15.114:0/1117787572 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe50c14c460 con 0x7fe50c15d100 2023-11-04T01:42:43.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.822+0000 7fe51380e640 1 -- 172.21.15.114:0/1117787572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe50c14c460 con 0x7fe50c15d100 2023-11-04T01:42:43.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.823+0000 7fe501ffb640 1 -- 172.21.15.114:0/1117787572 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v91) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe50c14c460 con 0x7fe50c15d100 2023-11-04T01:42:43.825 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:42:43.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.825+0000 7fe51380e640 1 -- 172.21.15.114:0/1117787572 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe4f006ae70 msgr2=0x7fe4f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.825+0000 7fe51380e640 1 --2- 172.21.15.114:0/1117787572 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe4f006ae70 0x7fe4f006d330 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe504003ee0 tx=0x7fe504009040 comp rx=0 tx=0).stop 2023-11-04T01:42:43.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.825+0000 7fe51380e640 1 -- 172.21.15.114:0/1117787572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe50c15d100 msgr2=0x7fe50c0cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.825+0000 7fe51380e640 1 --2- 172.21.15.114:0/1117787572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe50c15d100 0x7fe50c0cc6a0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0090b0 tx=0x7fe4fc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.825+0000 7fe51380e640 1 -- 172.21.15.114:0/1117787572 shutdown_connections 2023-11-04T01:42:43.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.825+0000 7fe51380e640 1 --2- 172.21.15.114:0/1117787572 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe4f006ae70 0x7fe4f006d330 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.825+0000 7fe51380e640 1 --2- 172.21.15.114:0/1117787572 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe50c15d4e0 0x7fe50c14b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.825+0000 7fe51380e640 1 --2- 172.21.15.114:0/1117787572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe50c15d100 0x7fe50c0cc6a0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.825+0000 7fe51380e640 1 --2- 172.21.15.114:0/1117787572 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe50c0d3b60 0x7fe50c0cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.825+0000 7fe51380e640 1 -- 172.21.15.114:0/1117787572 >> 172.21.15.114:0/1117787572 conn(0x7fe50c0d2ef0 msgr2=0x7fe50c06be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.825+0000 7fe51380e640 1 -- 172.21.15.114:0/1117787572 shutdown_connections 2023-11-04T01:42:43.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:43.825+0000 7fe51380e640 1 -- 172.21.15.114:0/1117787572 wait complete. 2023-11-04T01:42:43.837 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:42:43.837 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:42:43.837 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-11-04T01:42:43.837 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:42:43.837 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:43.837 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:42:43.838 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:42:43.838 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:42:43.838 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:43.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:43.838 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-11-04T01:42:43.853 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:42:43.853 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:42:43.853 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:42:43.853 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:43.853 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-04T01:42:43.854 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:43.854 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:42:43.854 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:43.854 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-11-04T01:42:43.854 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:42:43.854 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:43.854 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-11-04T01:42:43.854 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:42:43.854 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:43.854 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:42:43.854 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:43.854 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:42:43.854 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42112sec preferred_lft 42112sec 2023-11-04T01:42:43.855 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-11-04T01:42:43.855 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:43.855 INFO:teuthology.orchestra.run.smithi114.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:42:43.855 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 7e:72:41:ca:70:95 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:43.855 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:42:43.855 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:43.855 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9c8d:d6ff:fe6f:d555/64 scope link 2023-11-04T01:42:43.855 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:43.855 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:42:43.855 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether f6:4c:1e:67:08:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:43.855 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::f44c:1eff:fe67:85a/64 scope link 2023-11-04T01:42:43.855 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:43.855 INFO:teuthology.orchestra.run.smithi114.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:42:43.856 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 7e:72:41:ca:70:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:43.856 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::7c72:41ff:feca:7095/64 scope link 2023-11-04T01:42:43.856 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:43.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:43.856 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:42:43.920 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-11-04T01:42:43.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:43.921 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-11-04T01:42:43.977 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-11-04T01:42:43.977 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:42:43.977 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:42:43.977 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:42:43.977 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:42:43.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:43.978 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:42:43.978 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:42:43.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:42:43.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:42:43.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:42:43.978 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:42:44.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:44.073 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-04T01:42:44.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:42:44.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:42:44.087 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:44.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:44.087 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-11-04T01:42:44.154 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:42:44.154 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:44.154 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:44.209 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:44.209 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:44.210 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:44.264 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:44.319 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:42:44.319 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:42:44.319 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:42:44.319 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:42:44.319 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:42:44.320 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:42:44.320 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:42:44.320 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:42:44.320 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:42:44.320 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:42:44.320 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:42:44.320 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:42:44.320 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:44.320 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:42:44.320 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:42:44.320 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:42:44.320 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:42:44.320 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:42:44.320 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:44.321 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:42:44.321 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:42:44.321 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:42:44.321 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:42:44.321 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:42:44.321 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:42:44.321 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:44.321 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:44.321 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:44.321 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:44.321 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:42:44.321 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:44.321 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:44.321 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:44.322 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:44.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:44.322 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:42:44.374 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:42:44.374 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:42:44.417 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:44.418 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:42:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:44.432 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:42:44.433 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:42:44.433 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:42:44.433 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:42:44.433 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:42:44.433 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:42:44.433 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:42:44.433 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:42:44.433 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:42:44.433 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:42:44.433 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:42:44.433 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:42:44.433 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:44.433 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:42:44.434 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:42:44.434 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:42:44.434 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:42:44.434 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:42:44.434 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:44.434 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:42:44.434 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:42:44.434 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:42:44.434 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:42:44.434 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:42:44.435 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:42:44.435 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:44.435 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:44.435 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:44.435 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:44.435 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:42:44.435 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:44.436 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:44.436 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:44.436 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:44.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:44.436 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:42:44.506 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:42:44.505+0000 7f252cbdb480 -1 init, newargv = 0x562f6fcfaaf0 newargc=15 2023-11-04T01:42:44.506 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[124062]: starting ceph client 2023-11-04T01:42:44.512 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[124062]: starting fuse 2023-11-04T01:42:45.588 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:45.607 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:42:45.608 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:42:45.608 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:42:45.608 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:42:45.608 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:42:45.608 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:42:45.608 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:42:45.608 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:42:45.608 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:42:45.608 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:42:45.608 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:42:45.609 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:42:45.609 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:45.609 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:42:45.609 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:42:45.609 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:42:45.609 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:42:45.609 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:42:45.609 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:45.609 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:42:45.609 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:42:45.609 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:42:45.610 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:42:45.610 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:42:45.610 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:42:45.610 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:45.610 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:45.610 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:45.610 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:45.610 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:42:45.610 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:45.610 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:45.610 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:45.611 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:45.611 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:45.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:45.612 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:42:45.669 INFO:teuthology.orchestra.run.smithi114.stdout:41 2023-11-04T01:42:45.669 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:42:45.670 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:42:45.670 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2023-11-04T01:42:45.670 DEBUG:teuthology.orchestra.run.smithi114:> import re 2023-11-04T01:42:45.670 DEBUG:teuthology.orchestra.run.smithi114:> import os 2023-11-04T01:42:45.670 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2023-11-04T01:42:45.670 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:42:45.670 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2023-11-04T01:42:45.670 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:42:45.670 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2023-11-04T01:42:45.670 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:42:45.670 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:42:45.670 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2023-11-04T01:42:45.671 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2023-11-04T01:42:45.671 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2023-11-04T01:42:45.671 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2023-11-04T01:42:45.671 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:42:45.671 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2023-11-04T01:42:45.671 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:42:45.671 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:42:45.671 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:42:45.671 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2023-11-04T01:42:45.671 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2023-11-04T01:42:45.671 DEBUG:teuthology.orchestra.run.smithi114:> return f 2023-11-04T01:42:45.671 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:42:45.671 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:42:45.672 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.0")) 2023-11-04T01:42:45.672 DEBUG:teuthology.orchestra.run.smithi114:> ' 2023-11-04T01:42:45.796 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.0.124062.asok 2023-11-04T01:42:45.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:45.806 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.124062.asok 2023-11-04T01:42:45.807 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:45.807 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.124062.asok status 2023-11-04T01:42:45.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:45.976 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:42:45.976 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2023-11-04T01:42:45.976 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:42:45.976 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:42:45.976 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "0", 2023-11-04T01:42:45.976 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2023-11-04T01:42:45.976 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:42:45.976 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "124062", 2023-11-04T01:42:45.977 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2023-11-04T01:42:45.977 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:42:45.977 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2023-11-04T01:42:45.977 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2023-11-04T01:42:45.977 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 8421, 2023-11-04T01:42:45.977 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2023-11-04T01:42:45.977 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2023-11-04T01:42:45.977 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2023-11-04T01:42:45.977 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 8421 2023-11-04T01:42:45.977 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:42:45.977 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:42:45.977 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:42:45.977 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:45.978 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 3180677097 2023-11-04T01:42:45.978 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:42:45.978 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:42:45.978 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:42:45.978 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:42:45.978 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:45.978 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 3180677097 2023-11-04T01:42:45.978 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:42:45.978 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.8421 192.168.0.1:0/3180677097", 2023-11-04T01:42:45.978 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "192.168.0.1:0/3180677097", 2023-11-04T01:42:45.978 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2023-11-04T01:42:45.978 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 91, 2023-11-04T01:42:45.979 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 108, 2023-11-04T01:42:45.979 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:42:45.979 INFO:teuthology.orchestra.run.smithi114.stdout: "blocklisted": false, 2023-11-04T01:42:45.979 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2023-11-04T01:42:45.979 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:42:45.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:45.990 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:45.990 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:42:45.990 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:46.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:46.049 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2023-11-04T01:42:46.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:46.055 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:46.055 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:46.055 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:46.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:46.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:46.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:42:46.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.219+0000 7fab133ee640 1 Processor -- start 2023-11-04T01:42:46.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.220+0000 7fab133ee640 1 -- start start 2023-11-04T01:42:46.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.220+0000 7fab133ee640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fab0c15d4e0 0x7fab0c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.220+0000 7fab133ee640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab0c0b32b0 con 0x7fab0c0d3b60 2023-11-04T01:42:46.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.220+0000 7fab133ee640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab0c0cee10 con 0x7fab0c15d100 2023-11-04T01:42:46.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.220+0000 7fab133ee640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0c0cec20 con 0x7fab0c15d4e0 2023-11-04T01:42:46.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.220+0000 7fab10989640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fab0c15d4e0 0x7fab0c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.220+0000 7fab1198b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fab0c0d3b60 0x7fab0c0b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32952/0 (socket says 172.21.15.114:32952) 2023-11-04T01:42:46.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.220+0000 7fab1198b640 1 -- 172.21.15.114:0/2293327516 learned_addr learned my addr 172.21.15.114:0/2293327516 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:46.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.221+0000 7fab10989640 1 -- 172.21.15.114:0/2293327516 >> v1:172.21.15.141:6789/0 conn(0x7fab0c15d100 legacy=0x7fab0c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.221+0000 7fab10989640 1 -- 172.21.15.114:0/2293327516 >> v1:172.21.15.114:6789/0 conn(0x7fab0c0d3b60 legacy=0x7fab0c0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.221+0000 7fab10989640 1 -- 172.21.15.114:0/2293327516 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0c0b2980 con 0x7fab0c15d4e0 2023-11-04T01:42:46.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.221+0000 7fab03fff640 1 -- 172.21.15.114:0/2293327516 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391818749 0 0) 0x7fab0c0b32b0 con 0x7fab0c0d3b60 2023-11-04T01:42:46.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.221+0000 7fab10989640 1 --2- 172.21.15.114:0/2293327516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0c15d4e0 0x7fab0c0d14d0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7faafc0097a0 tx=0x7faafc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc48277ad91228e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.222+0000 7fab03fff640 1 -- 172.21.15.114:0/2293327516 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc031830 con 0x7fab0c15d4e0 2023-11-04T01:42:46.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.222+0000 7fab03fff640 1 -- 172.21.15.114:0/2293327516 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc031990 con 0x7fab0c15d4e0 2023-11-04T01:42:46.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.222+0000 7fab03fff640 1 -- 172.21.15.114:0/2293327516 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc031d20 con 0x7fab0c15d4e0 2023-11-04T01:42:46.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.222+0000 7fab133ee640 1 -- 172.21.15.114:0/2293327516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0c15d4e0 msgr2=0x7fab0c0d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.222+0000 7fab133ee640 1 --2- 172.21.15.114:0/2293327516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0c15d4e0 0x7fab0c0d14d0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7faafc0097a0 tx=0x7faafc02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.222+0000 7fab133ee640 1 -- 172.21.15.114:0/2293327516 shutdown_connections 2023-11-04T01:42:46.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.222+0000 7fab133ee640 1 --2- 172.21.15.114:0/2293327516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0c15d4e0 0x7fab0c0d14d0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.222+0000 7fab133ee640 1 -- 172.21.15.114:0/2293327516 >> 172.21.15.114:0/2293327516 conn(0x7fab0c0d2ef0 msgr2=0x7fab0c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.222+0000 7fab133ee640 1 -- 172.21.15.114:0/2293327516 shutdown_connections 2023-11-04T01:42:46.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.222+0000 7fab133ee640 1 -- 172.21.15.114:0/2293327516 wait complete. 2023-11-04T01:42:46.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.223+0000 7fab133ee640 1 Processor -- start 2023-11-04T01:42:46.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.223+0000 7fab133ee640 1 -- start start 2023-11-04T01:42:46.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.224+0000 7fab133ee640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab0c0d3b60 0x7fab0c0c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.224+0000 7fab133ee640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0c15d100 0x7fab0c0cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.224+0000 7fab133ee640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab0c15d4e0 0x7fab0c151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.224+0000 7fab133ee640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c0ca810 con 0x7fab0c15d100 2023-11-04T01:42:46.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.224+0000 7fab133ee640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c0caaf0 con 0x7fab0c15d4e0 2023-11-04T01:42:46.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.224+0000 7fab133ee640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c0cadd0 con 0x7fab0c0d3b60 2023-11-04T01:42:46.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.224+0000 7fab10989640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0c15d100 0x7fab0c0cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.224+0000 7fab10989640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0c15d100 0x7fab0c0cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56484/0 (socket says 172.21.15.114:56484) 2023-11-04T01:42:46.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.224+0000 7fab10989640 1 -- 172.21.15.114:0/674861084 learned_addr learned my addr 172.21.15.114:0/674861084 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:46.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.224+0000 7fab1198b640 1 --2- 172.21.15.114:0/674861084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab0c15d4e0 0x7fab0c151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.224+0000 7fab1118a640 1 --2- 172.21.15.114:0/674861084 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab0c0d3b60 0x7fab0c0c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.224+0000 7fab10989640 1 -- 172.21.15.114:0/674861084 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab0c0d3b60 msgr2=0x7fab0c0c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.224+0000 7fab10989640 1 --2- 172.21.15.114:0/674861084 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab0c0d3b60 0x7fab0c0c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.224+0000 7fab10989640 1 -- 172.21.15.114:0/674861084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab0c15d4e0 msgr2=0x7fab0c151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.224+0000 7fab10989640 1 --2- 172.21.15.114:0/674861084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab0c15d4e0 0x7fab0c151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.224+0000 7fab10989640 1 -- 172.21.15.114:0/674861084 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc009400 con 0x7fab0c15d100 2023-11-04T01:42:46.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.225+0000 7fab10989640 1 --2- 172.21.15.114:0/674861084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0c15d100 0x7fab0c0cc970 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7faafc034040 tx=0x7faafc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.225+0000 7fab01ffb640 1 -- 172.21.15.114:0/674861084 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc03ba70 con 0x7fab0c15d100 2023-11-04T01:42:46.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.225+0000 7fab01ffb640 1 -- 172.21.15.114:0/674861084 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc03bbf0 con 0x7fab0c15d100 2023-11-04T01:42:46.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.225+0000 7fab133ee640 1 -- 172.21.15.114:0/674861084 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0c0cb0b0 con 0x7fab0c15d100 2023-11-04T01:42:46.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.225+0000 7fab01ffb640 1 -- 172.21.15.114:0/674861084 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc0453f0 con 0x7fab0c15d100 2023-11-04T01:42:46.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.225+0000 7fab133ee640 1 -- 172.21.15.114:0/674861084 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0c0ca500 con 0x7fab0c15d100 2023-11-04T01:42:46.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.227+0000 7fab01ffb640 1 -- 172.21.15.114:0/674861084 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faafc04e450 con 0x7fab0c15d100 2023-11-04T01:42:46.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.227+0000 7fab01ffb640 1 --2- 172.21.15.114:0/674861084 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faaf006ae70 0x7faaf006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.227+0000 7fab01ffb640 1 -- 172.21.15.114:0/674861084 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7faafc0ac130 con 0x7fab0c15d100 2023-11-04T01:42:46.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.227+0000 7fab1118a640 1 --2- 172.21.15.114:0/674861084 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faaf006ae70 0x7faaf006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.228+0000 7fab1118a640 1 --2- 172.21.15.114:0/674861084 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faaf006ae70 0x7faaf006d330 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fab08001d10 tx=0x7fab08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.228+0000 7fab15f7f740 1 Processor -- start 2023-11-04T01:42:46.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.228+0000 7fab15f7f740 1 -- start start 2023-11-04T01:42:46.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab15f7f740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c5f74c0 0x56421c5f78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab15f7f740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c5c76d0 0x56421c5f4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab15f7f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5cb040 0x56421c5f4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab15f7f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421c53ad70 con 0x56421c5cb040 2023-11-04T01:42:46.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab15f7f740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421c538460 con 0x56421c5f74c0 2023-11-04T01:42:46.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab15f7f740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x56421c533d50 con 0x56421c5c76d0 2023-11-04T01:42:46.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab1198b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5cb040 0x56421c5f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab1198b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5cb040 0x56421c5f4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56492/0 (socket says 172.21.15.114:56492) 2023-11-04T01:42:46.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab1198b640 1 -- 172.21.15.114:0/2573853578 learned_addr learned my addr 172.21.15.114:0/2573853578 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:46.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab10989640 1 --2- 172.21.15.114:0/2573853578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c5c76d0 0x56421c5f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab1198b640 1 -- 172.21.15.114:0/2573853578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c5c76d0 msgr2=0x56421c5f4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab1198b640 1 --2- 172.21.15.114:0/2573853578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c5c76d0 0x56421c5f4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab1118a640 1 --2- 172.21.15.114:0/2573853578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c5f74c0 0x56421c5f78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab1198b640 1 -- 172.21.15.114:0/2573853578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c5f74c0 msgr2=0x56421c5f78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab1198b640 1 --2- 172.21.15.114:0/2573853578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c5f74c0 0x56421c5f78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab1198b640 1 -- 172.21.15.114:0/2573853578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56421c4f6e30 con 0x56421c5cb040 2023-11-04T01:42:46.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab1118a640 1 --2- 172.21.15.114:0/2573853578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c5f74c0 0x56421c5f78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:46.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7fab1198b640 1 --2- 172.21.15.114:0/2573853578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5cb040 0x56421c5f4c70 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fab040016a0 tx=0x7fab04001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0153f83a5b844c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7faaf6ffd640 1 -- 172.21.15.114:0/2573853578 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab040074e0 con 0x56421c5cb040 2023-11-04T01:42:46.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7faaf6ffd640 1 -- 172.21.15.114:0/2573853578 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab04007640 con 0x56421c5cb040 2023-11-04T01:42:46.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.229+0000 7faaf6ffd640 1 -- 172.21.15.114:0/2573853578 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab040049e0 con 0x56421c5cb040 2023-11-04T01:42:46.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.230+0000 7fab15f7f740 1 -- 172.21.15.114:0/2573853578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5cb040 msgr2=0x56421c5f4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.230+0000 7fab15f7f740 1 --2- 172.21.15.114:0/2573853578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5cb040 0x56421c5f4c70 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fab040016a0 tx=0x7fab04001b60 comp rx=0 tx=0).stop 2023-11-04T01:42:46.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.230+0000 7fab15f7f740 1 -- 172.21.15.114:0/2573853578 shutdown_connections 2023-11-04T01:42:46.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.230+0000 7fab15f7f740 1 --2- 172.21.15.114:0/2573853578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5cb040 0x56421c5f4c70 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.230+0000 7fab15f7f740 1 --2- 172.21.15.114:0/2573853578 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c5c76d0 0x56421c5f4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.230+0000 7fab15f7f740 1 --2- 172.21.15.114:0/2573853578 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c5f74c0 0x56421c5f78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.230+0000 7fab15f7f740 1 -- 172.21.15.114:0/2573853578 >> 172.21.15.114:0/2573853578 conn(0x56421c5c99e0 msgr2=0x56421c6122d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.230+0000 7fab15f7f740 1 -- 172.21.15.114:0/2573853578 shutdown_connections 2023-11-04T01:42:46.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.230+0000 7fab15f7f740 1 -- 172.21.15.114:0/2573853578 wait complete. 2023-11-04T01:42:46.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.231+0000 7fab15f7f740 1 -- start start 2023-11-04T01:42:46.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.231+0000 7fab15f7f740 1 Processor -- start 2023-11-04T01:42:46.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.231+0000 7fab15f7f740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c5cb040 0x56421c6256b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.231+0000 7fab15f7f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5f74c0 0x56421c60ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.231+0000 7fab15f7f740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c609c40 0x56421c60b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.231+0000 7fab15f7f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421c4edee0 con 0x56421c5f74c0 2023-11-04T01:42:46.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.231+0000 7fab15f7f740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421c4edb80 con 0x56421c5cb040 2023-11-04T01:42:46.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.231+0000 7fab15f7f740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x56421c4b33a0 con 0x56421c609c40 2023-11-04T01:42:46.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab15f7f740 10 client.0 _ll_register_callbacks cb 0x56421c4b78b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:46.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab10989640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5f74c0 0x56421c60ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab10989640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5f74c0 0x56421c60ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56506/0 (socket says 172.21.15.114:56506) 2023-11-04T01:42:46.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab10989640 1 -- 172.21.15.114:0/1237634443 learned_addr learned my addr 172.21.15.114:0/1237634443 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:46.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab10989640 1 -- 172.21.15.114:0/1237634443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c609c40 msgr2=0x56421c60b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab10989640 1 --2- 172.21.15.114:0/1237634443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c609c40 0x56421c60b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab10989640 1 -- 172.21.15.114:0/1237634443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c5cb040 msgr2=0x56421c6256b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab10989640 1 --2- 172.21.15.114:0/1237634443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c5cb040 0x56421c6256b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab10989640 1 -- 172.21.15.114:0/1237634443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab040012d0 con 0x56421c5f74c0 2023-11-04T01:42:46.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab10989640 1 --2- 172.21.15.114:0/1237634443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5f74c0 0x56421c60ae00 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7faafc076b20 tx=0x7faafc07a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d95d843dafd084f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7faaebfff640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:42:46.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7faaebfff640 1 -- 172.21.15.114:0/1237634443 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc0a9070 con 0x56421c5f74c0 2023-11-04T01:42:46.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7faaebfff640 1 -- 172.21.15.114:0/1237634443 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7faafc0829b0 con 0x56421c5f74c0 2023-11-04T01:42:46.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab15f7f740 1 -- 172.21.15.114:0/1237634443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56421c52cd30 con 0x56421c5f74c0 2023-11-04T01:42:46.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7faaebfff640 1 -- 172.21.15.114:0/1237634443 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7faafc076d30 con 0x56421c5f74c0 2023-11-04T01:42:46.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab15f7f740 10 client.8436 fetch_fsmap learned FSMap version 91 2023-11-04T01:42:46.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab15f7f740 1 -- 172.21.15.114:0/1237634443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x56421c5323d0 con 0x56421c5f74c0 2023-11-04T01:42:46.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7faaebfff640 1 -- 172.21.15.114:0/1237634443 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc09f080 con 0x56421c5f74c0 2023-11-04T01:42:46.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7faaebfff640 1 -- 172.21.15.114:0/1237634443 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 91) v1 ==== 3306+0+0 (secure 0 0 0) 0x7faafc095020 con 0x56421c5f74c0 2023-11-04T01:42:46.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab15f7f740 10 client.8436 fetch_fsmap finished waiting for FSMap version 91 2023-11-04T01:42:46.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab15f7f740 10 client.8436 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-04T01:42:46.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab15f7f740 20 client.8436 populate_metadata read hostname 'smithi114' 2023-11-04T01:42:46.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab15f7f740 1 --2- 172.21.15.114:0/1237634443 >> [v2:172.21.15.114:6835/3825479201,v1:172.21.15.114:6837/3825479201] conn(0x56421c5f93a0 0x56421c5f97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab15f7f740 4 client.8436 mds_command: new command op to 8133 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:42:46.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.232+0000 7fab15f7f740 1 -- 172.21.15.114:0/1237634443 --> [v2:172.21.15.114:6835/3825479201,v1:172.21.15.114:6837/3825479201] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56421c52ca50 con 0x56421c5f93a0 2023-11-04T01:42:46.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.233+0000 7fab1118a640 1 --2- 172.21.15.114:0/1237634443 >> [v2:172.21.15.114:6835/3825479201,v1:172.21.15.114:6837/3825479201] conn(0x56421c5f93a0 0x56421c5f97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.233+0000 7faaebfff640 10 client.8436 ms_handle_connect on v2:172.21.15.114:6835/3825479201 2023-11-04T01:42:46.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.233+0000 7fab1118a640 1 --2- 172.21.15.114:0/1237634443 >> [v2:172.21.15.114:6835/3825479201,v1:172.21.15.114:6837/3825479201] conn(0x56421c5f93a0 0x56421c5f97f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c57ebb30f07090e server_cookie=9be1631564dd1027 in_seq=0 out_seq=0 2023-11-04T01:42:46.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.233+0000 7faaebfff640 1 -- 172.21.15.114:0/1237634443 <== mds.0 v2:172.21.15.114:6835/3825479201 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56421c52ca50 con 0x56421c5f93a0 2023-11-04T01:42:46.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.233+0000 7faaebfff640 10 client.8436 handle_command_reply: tid=0 2023-11-04T01:42:46.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.233+0000 7fab15f7f740 1 client.8436 shutdown 2023-11-04T01:42:46.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.234+0000 7fab15f7f740 1 -- 172.21.15.114:0/1237634443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5f74c0 msgr2=0x56421c60ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.234+0000 7fab15f7f740 1 --2- 172.21.15.114:0/1237634443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5f74c0 0x56421c60ae00 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7faafc076b20 tx=0x7faafc07a6e0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.234+0000 7fab15f7f740 1 -- 172.21.15.114:0/1237634443 shutdown_connections 2023-11-04T01:42:46.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.234+0000 7fab15f7f740 1 --2- 172.21.15.114:0/1237634443 >> [v2:172.21.15.114:6835/3825479201,v1:172.21.15.114:6837/3825479201] conn(0x56421c5f93a0 0x56421c5f97f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.234+0000 7fab15f7f740 1 --2- 172.21.15.114:0/1237634443 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c609c40 0x56421c60b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.234+0000 7faaebfff640 0 client.8436 ms_handle_reset on v2:172.21.15.114:6835/3825479201 2023-11-04T01:42:46.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.234+0000 7fab15f7f740 1 --2- 172.21.15.114:0/1237634443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5f74c0 0x56421c60ae00 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.234+0000 7fab15f7f740 1 --2- 172.21.15.114:0/1237634443 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c5cb040 0x56421c6256b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.234+0000 7fab15f7f740 1 -- 172.21.15.114:0/1237634443 >> 172.21.15.114:0/1237634443 conn(0x56421c5c76d0 msgr2=0x56421c5cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.234+0000 7fab15f7f740 1 -- 172.21.15.114:0/1237634443 shutdown_connections 2023-11-04T01:42:46.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.234+0000 7fab15f7f740 1 -- 172.21.15.114:0/1237634443 wait complete. 2023-11-04T01:42:46.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.234+0000 7fab15f7f740 20 client.8436 trim_cache size 0 max 16384 2023-11-04T01:42:46.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.247+0000 7fab15f7f740 1 Processor -- start 2023-11-04T01:42:46.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.247+0000 7fab15f7f740 1 -- start start 2023-11-04T01:42:46.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.247+0000 7fab15f7f740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c5cb040 0x56421c6159d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.247+0000 7fab15f7f740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c5f74c0 0x56421c613d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.247+0000 7fab15f7f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c609c40 0x56421c614240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.247+0000 7fab15f7f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421c5c6a00 con 0x56421c609c40 2023-11-04T01:42:46.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.247+0000 7fab15f7f740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421c5ceb20 con 0x56421c5cb040 2023-11-04T01:42:46.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.247+0000 7fab15f7f740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x56421c5f2280 con 0x56421c5f74c0 2023-11-04T01:42:46.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.247+0000 7fab1198b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c609c40 0x56421c614240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.248+0000 7fab1198b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c609c40 0x56421c614240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56522/0 (socket says 172.21.15.114:56522) 2023-11-04T01:42:46.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.248+0000 7fab1198b640 1 -- 172.21.15.114:0/1564668734 learned_addr learned my addr 172.21.15.114:0/1564668734 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:46.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.248+0000 7fab10989640 1 --2- 172.21.15.114:0/1564668734 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c5f74c0 0x56421c613d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.248+0000 7fab1118a640 1 --2- 172.21.15.114:0/1564668734 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c5cb040 0x56421c6159d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.248+0000 7fab1198b640 1 -- 172.21.15.114:0/1564668734 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c5f74c0 msgr2=0x56421c613d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.248+0000 7fab1198b640 1 --2- 172.21.15.114:0/1564668734 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c5f74c0 0x56421c613d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.248+0000 7fab1198b640 1 -- 172.21.15.114:0/1564668734 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c5cb040 msgr2=0x56421c6159d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.248+0000 7fab1198b640 1 --2- 172.21.15.114:0/1564668734 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c5cb040 0x56421c6159d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.248+0000 7fab1198b640 1 -- 172.21.15.114:0/1564668734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56421c4cfea0 con 0x56421c609c40 2023-11-04T01:42:46.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.248+0000 7fab1198b640 1 --2- 172.21.15.114:0/1564668734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c609c40 0x56421c614240 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fab04001670 tx=0x7fab04010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40db94ed1caf9ca2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.248+0000 7faaf77fe640 1 -- 172.21.15.114:0/1564668734 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab04022070 con 0x56421c609c40 2023-11-04T01:42:46.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.248+0000 7faaf77fe640 1 -- 172.21.15.114:0/1564668734 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab040072e0 con 0x56421c609c40 2023-11-04T01:42:46.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.248+0000 7faaf77fe640 1 -- 172.21.15.114:0/1564668734 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab04007ea0 con 0x56421c609c40 2023-11-04T01:42:46.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.248+0000 7fab15f7f740 1 -- 172.21.15.114:0/1564668734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c609c40 msgr2=0x56421c614240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.248+0000 7fab15f7f740 1 --2- 172.21.15.114:0/1564668734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c609c40 0x56421c614240 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fab04001670 tx=0x7fab04010000 comp rx=0 tx=0).stop 2023-11-04T01:42:46.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.249+0000 7fab15f7f740 1 -- 172.21.15.114:0/1564668734 shutdown_connections 2023-11-04T01:42:46.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.249+0000 7fab15f7f740 1 --2- 172.21.15.114:0/1564668734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c609c40 0x56421c614240 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.249+0000 7fab15f7f740 1 --2- 172.21.15.114:0/1564668734 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c5f74c0 0x56421c613d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.249+0000 7fab15f7f740 1 --2- 172.21.15.114:0/1564668734 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c5cb040 0x56421c6159d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.249+0000 7fab15f7f740 1 -- 172.21.15.114:0/1564668734 >> 172.21.15.114:0/1564668734 conn(0x56421c5c76d0 msgr2=0x56421c622610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.249+0000 7fab15f7f740 1 -- 172.21.15.114:0/1564668734 shutdown_connections 2023-11-04T01:42:46.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.249+0000 7fab15f7f740 1 -- 172.21.15.114:0/1564668734 wait complete. 2023-11-04T01:42:46.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.249+0000 7fab15f7f740 1 -- start start 2023-11-04T01:42:46.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.249+0000 7fab15f7f740 1 Processor -- start 2023-11-04T01:42:46.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab15f7f740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5cb040 0x56421c614620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab15f7f740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c5f74c0 0x56421c5cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab15f7f740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c609c40 0x56421c5cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab15f7f740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421c5f44d0 con 0x56421c5cb040 2023-11-04T01:42:46.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab15f7f740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421c67e920 con 0x56421c609c40 2023-11-04T01:42:46.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab15f7f740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x56421c613ce0 con 0x56421c5f74c0 2023-11-04T01:42:46.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab15f7f740 10 client.0 _ll_register_callbacks cb 0x7fab04007bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:46.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab1118a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5cb040 0x56421c614620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab1118a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5cb040 0x56421c614620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56532/0 (socket says 172.21.15.114:56532) 2023-11-04T01:42:46.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab1118a640 1 -- 172.21.15.114:0/701178148 learned_addr learned my addr 172.21.15.114:0/701178148 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:46.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab10989640 1 --2- 172.21.15.114:0/701178148 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c5f74c0 0x56421c5cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab1198b640 1 --2- 172.21.15.114:0/701178148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c609c40 0x56421c5cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab1118a640 1 -- 172.21.15.114:0/701178148 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c5f74c0 msgr2=0x56421c5cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab1118a640 1 --2- 172.21.15.114:0/701178148 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c5f74c0 0x56421c5cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab1118a640 1 -- 172.21.15.114:0/701178148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c609c40 msgr2=0x56421c5cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab1118a640 1 --2- 172.21.15.114:0/701178148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c609c40 0x56421c5cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab1118a640 1 -- 172.21.15.114:0/701178148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56421c4f6e30 con 0x56421c5cb040 2023-11-04T01:42:46.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7fab1118a640 1 --2- 172.21.15.114:0/701178148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5cb040 0x56421c614620 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x56421c623930 tx=0x7fab08001380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4fe3fc44c5a16d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.250+0000 7faaebfff640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:42:46.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7faaebfff640 1 -- 172.21.15.114:0/701178148 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080052d0 con 0x56421c5cb040 2023-11-04T01:42:46.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7faaebfff640 1 -- 172.21.15.114:0/701178148 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fab08005430 con 0x56421c5cb040 2023-11-04T01:42:46.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7fab15f7f740 1 -- 172.21.15.114:0/701178148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab04007640 con 0x56421c5cb040 2023-11-04T01:42:46.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7faaebfff640 1 -- 172.21.15.114:0/701178148 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab08005630 con 0x56421c5cb040 2023-11-04T01:42:46.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7fab15f7f740 10 client.8442 fetch_fsmap learned FSMap version 91 2023-11-04T01:42:46.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7fab15f7f740 1 -- 172.21.15.114:0/701178148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x56421c4f5690 con 0x56421c5cb040 2023-11-04T01:42:46.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7faaebfff640 1 -- 172.21.15.114:0/701178148 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab04007640 con 0x56421c5cb040 2023-11-04T01:42:46.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7faaebfff640 1 -- 172.21.15.114:0/701178148 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 91) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fab0801f040 con 0x56421c5cb040 2023-11-04T01:42:46.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7fab15f7f740 10 client.8442 fetch_fsmap finished waiting for FSMap version 91 2023-11-04T01:42:46.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7fab15f7f740 10 client.8442 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-04T01:42:46.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7fab15f7f740 20 client.8442 populate_metadata read hostname 'smithi114' 2023-11-04T01:42:46.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7fab15f7f740 1 --2- 172.21.15.114:0/701178148 >> [v2:172.21.15.114:6835/3825479201,v1:172.21.15.114:6837/3825479201] conn(0x56421c5f46c0 0x56421c67d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7fab15f7f740 4 client.8442 mds_command: new command op to 8133 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:42:46.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7fab15f7f740 1 -- 172.21.15.114:0/701178148 --> [v2:172.21.15.114:6835/3825479201,v1:172.21.15.114:6837/3825479201] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56421c2347e0 con 0x56421c5f46c0 2023-11-04T01:42:46.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7fab10989640 1 --2- 172.21.15.114:0/701178148 >> [v2:172.21.15.114:6835/3825479201,v1:172.21.15.114:6837/3825479201] conn(0x56421c5f46c0 0x56421c67d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7fab10989640 1 --2- 172.21.15.114:0/701178148 >> [v2:172.21.15.114:6835/3825479201,v1:172.21.15.114:6837/3825479201] conn(0x56421c5f46c0 0x56421c67d750 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae86d428f18d0f10 server_cookie=3d49853dd6700016 in_seq=0 out_seq=0 2023-11-04T01:42:46.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.251+0000 7faaebfff640 10 client.8442 ms_handle_connect on v2:172.21.15.114:6835/3825479201 2023-11-04T01:42:46.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.260+0000 7faaebfff640 1 -- 172.21.15.114:0/701178148 <== mds.0 v2:172.21.15.114:6835/3825479201 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56421c2347e0 con 0x56421c5f46c0 2023-11-04T01:42:46.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.260+0000 7faaebfff640 10 client.8442 handle_command_reply: tid=0 2023-11-04T01:42:46.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.260+0000 7fab15f7f740 1 client.8442 shutdown 2023-11-04T01:42:46.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.260+0000 7fab15f7f740 1 -- 172.21.15.114:0/701178148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5cb040 msgr2=0x56421c614620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.260+0000 7fab15f7f740 1 --2- 172.21.15.114:0/701178148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5cb040 0x56421c614620 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x56421c623930 tx=0x7fab08001380 comp rx=0 tx=0).stop 2023-11-04T01:42:46.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.260+0000 7fab15f7f740 1 -- 172.21.15.114:0/701178148 shutdown_connections 2023-11-04T01:42:46.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.260+0000 7fab15f7f740 1 --2- 172.21.15.114:0/701178148 >> [v2:172.21.15.114:6835/3825479201,v1:172.21.15.114:6837/3825479201] conn(0x56421c5f46c0 0x56421c67d750 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.260+0000 7fab15f7f740 1 --2- 172.21.15.114:0/701178148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x56421c609c40 0x56421c5cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.260+0000 7fab15f7f740 1 --2- 172.21.15.114:0/701178148 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x56421c5f74c0 0x56421c5cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.260+0000 7fab15f7f740 1 --2- 172.21.15.114:0/701178148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56421c5cb040 0x56421c614620 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.260+0000 7faaebfff640 0 client.8442 ms_handle_reset on v2:172.21.15.114:6835/3825479201 2023-11-04T01:42:46.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.260+0000 7fab15f7f740 1 -- 172.21.15.114:0/701178148 >> 172.21.15.114:0/701178148 conn(0x56421c5c76d0 msgr2=0x56421c6159d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.260+0000 7fab15f7f740 1 -- 172.21.15.114:0/701178148 shutdown_connections 2023-11-04T01:42:46.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.260+0000 7fab15f7f740 1 -- 172.21.15.114:0/701178148 wait complete. 2023-11-04T01:42:46.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.260+0000 7fab15f7f740 20 client.8442 trim_cache size 0 max 16384 2023-11-04T01:42:46.264 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:42:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: "message": "", 2023-11-04T01:42:46.264 INFO:teuthology.orchestra.run.smithi114.stdout: "return_code": 0 2023-11-04T01:42:46.264 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:42:46.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.261+0000 7fab133ee640 1 -- 172.21.15.114:0/674861084 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faaf006ae70 msgr2=0x7faaf006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.261+0000 7fab133ee640 1 --2- 172.21.15.114:0/674861084 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faaf006ae70 0x7faaf006d330 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fab08001d10 tx=0x7fab08009040 comp rx=0 tx=0).stop 2023-11-04T01:42:46.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.261+0000 7fab133ee640 1 -- 172.21.15.114:0/674861084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0c15d100 msgr2=0x7fab0c0cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.261+0000 7fab133ee640 1 --2- 172.21.15.114:0/674861084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0c15d100 0x7fab0c0cc970 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7faafc034040 tx=0x7faafc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.261+0000 7fab133ee640 1 -- 172.21.15.114:0/674861084 shutdown_connections 2023-11-04T01:42:46.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.261+0000 7fab133ee640 1 --2- 172.21.15.114:0/674861084 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faaf006ae70 0x7faaf006d330 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.261+0000 7fab133ee640 1 --2- 172.21.15.114:0/674861084 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab0c15d4e0 0x7fab0c151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.261+0000 7fab133ee640 1 --2- 172.21.15.114:0/674861084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0c15d100 0x7fab0c0cc970 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.261+0000 7fab133ee640 1 --2- 172.21.15.114:0/674861084 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab0c0d3b60 0x7fab0c0c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.261+0000 7fab133ee640 1 -- 172.21.15.114:0/674861084 >> 172.21.15.114:0/674861084 conn(0x7fab0c0d2ef0 msgr2=0x7fab0c0d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.261+0000 7fab133ee640 1 -- 172.21.15.114:0/674861084 shutdown_connections 2023-11-04T01:42:46.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.261+0000 7fab133ee640 1 -- 172.21.15.114:0/674861084 wait complete. 2023-11-04T01:42:46.273 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=5, also kill snapclient 2023-11-04T01:42:46.273 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:46.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.371+0000 7f4e59d41640 1 Processor -- start 2023-11-04T01:42:46.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.372+0000 7f4e59d41640 1 -- start start 2023-11-04T01:42:46.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.372+0000 7f4e59d41640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4e540afda0 0x7f4e540cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.372+0000 7f4e59d41640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e540cf240 con 0x7f4e540cd7f0 2023-11-04T01:42:46.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.372+0000 7f4e59d41640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e540cdc20 con 0x7f4e5415b200 2023-11-04T01:42:46.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.372+0000 7f4e59d41640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e540cde80 con 0x7f4e540afda0 2023-11-04T01:42:46.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.372+0000 7f4e4bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4e540afda0 0x7f4e540cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.373+0000 7f4e4bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4e540afda0 0x7f4e540cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56536/0 (socket says 172.21.15.114:56536) 2023-11-04T01:42:46.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.373+0000 7f4e53fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4e540cd7f0 0x7f4e540ae2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32960/0 (socket says 172.21.15.114:32960) 2023-11-04T01:42:46.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.373+0000 7f4e4bfff640 1 -- 172.21.15.114:0/909697177 learned_addr learned my addr 172.21.15.114:0/909697177 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:46.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.373+0000 7f4e4bfff640 1 -- 172.21.15.114:0/909697177 >> v1:172.21.15.141:6789/0 conn(0x7f4e5415b200 legacy=0x7f4e540ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.373+0000 7f4e4bfff640 1 -- 172.21.15.114:0/909697177 >> v1:172.21.15.114:6789/0 conn(0x7f4e540cd7f0 legacy=0x7f4e540ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.373+0000 7f4e52ffd640 1 -- 172.21.15.114:0/909697177 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592907939 0 0) 0x7f4e4c001490 con 0x7f4e540cd7f0 2023-11-04T01:42:46.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.373+0000 7f4e4bfff640 1 -- 172.21.15.114:0/909697177 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e540cf670 con 0x7f4e540afda0 2023-11-04T01:42:46.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.374+0000 7f4e4bfff640 1 --2- 172.21.15.114:0/909697177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e540afda0 0x7f4e540cd2b0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009870 tx=0x7f4e3c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bdb410bbfac5ce2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.374+0000 7f4e52ffd640 1 -- 172.21.15.114:0/909697177 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c031870 con 0x7f4e540afda0 2023-11-04T01:42:46.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.374+0000 7f4e52ffd640 1 -- 172.21.15.114:0/909697177 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3c0319d0 con 0x7f4e540afda0 2023-11-04T01:42:46.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.374+0000 7f4e52ffd640 1 -- 172.21.15.114:0/909697177 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c031d60 con 0x7f4e540afda0 2023-11-04T01:42:46.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.374+0000 7f4e59d41640 1 -- 172.21.15.114:0/909697177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e540afda0 msgr2=0x7f4e540cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.374+0000 7f4e59d41640 1 --2- 172.21.15.114:0/909697177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e540afda0 0x7f4e540cd2b0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009870 tx=0x7f4e3c02b910 comp rx=0 tx=0).stop 2023-11-04T01:42:46.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.374+0000 7f4e59d41640 1 -- 172.21.15.114:0/909697177 shutdown_connections 2023-11-04T01:42:46.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.374+0000 7f4e59d41640 1 --2- 172.21.15.114:0/909697177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e540afda0 0x7f4e540cd2b0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.374+0000 7f4e59d41640 1 -- 172.21.15.114:0/909697177 >> 172.21.15.114:0/909697177 conn(0x7f4e540d0c30 msgr2=0x7f4e540d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.374+0000 7f4e59d41640 1 -- 172.21.15.114:0/909697177 shutdown_connections 2023-11-04T01:42:46.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.374+0000 7f4e59d41640 1 -- 172.21.15.114:0/909697177 wait complete. 2023-11-04T01:42:46.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.375+0000 7f4e59d41640 1 Processor -- start 2023-11-04T01:42:46.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.375+0000 7f4e59d41640 1 -- start start 2023-11-04T01:42:46.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.376+0000 7f4e59d41640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4e540afda0 0x7f4e5414c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.376+0000 7f4e59d41640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4e540cd7f0 0x7f4e540b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.376+0000 7f4e59d41640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e5415b200 0x7f4e540b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.376+0000 7f4e59d41640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540b4260 con 0x7f4e5415b200 2023-11-04T01:42:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.376+0000 7f4e59d41640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540b46f0 con 0x7f4e540cd7f0 2023-11-04T01:42:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.376+0000 7f4e59d41640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540b3650 con 0x7f4e540afda0 2023-11-04T01:42:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.376+0000 7f4e53fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e5415b200 0x7f4e540b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.376+0000 7f4e53fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e5415b200 0x7f4e540b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56546/0 (socket says 172.21.15.114:56546) 2023-11-04T01:42:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.376+0000 7f4e53fff640 1 -- 172.21.15.114:0/4232569909 learned_addr learned my addr 172.21.15.114:0/4232569909 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.376+0000 7f4e4bfff640 1 --2- 172.21.15.114:0/4232569909 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4e540cd7f0 0x7f4e540b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.376+0000 7f4e537fe640 1 --2- 172.21.15.114:0/4232569909 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4e540afda0 0x7f4e5414c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.377+0000 7f4e53fff640 1 -- 172.21.15.114:0/4232569909 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4e540afda0 msgr2=0x7f4e5414c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.377+0000 7f4e53fff640 1 --2- 172.21.15.114:0/4232569909 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4e540afda0 0x7f4e5414c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.377+0000 7f4e53fff640 1 -- 172.21.15.114:0/4232569909 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4e540cd7f0 msgr2=0x7f4e540b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.377+0000 7f4e53fff640 1 --2- 172.21.15.114:0/4232569909 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4e540cd7f0 0x7f4e540b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.377+0000 7f4e53fff640 1 -- 172.21.15.114:0/4232569909 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c0094d0 con 0x7f4e5415b200 2023-11-04T01:42:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.377+0000 7f4e537fe640 1 --2- 172.21.15.114:0/4232569909 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4e540afda0 0x7f4e5414c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.377+0000 7f4e53fff640 1 --2- 172.21.15.114:0/4232569909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e5415b200 0x7f4e540b5430 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00c7d0 tx=0x7f4e4c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.377+0000 7f4e50ff9640 1 -- 172.21.15.114:0/4232569909 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00a640 con 0x7f4e5415b200 2023-11-04T01:42:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.377+0000 7f4e50ff9640 1 -- 172.21.15.114:0/4232569909 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c00a7c0 con 0x7f4e5415b200 2023-11-04T01:42:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.377+0000 7f4e59d41640 1 -- 172.21.15.114:0/4232569909 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e540b3930 con 0x7f4e5415b200 2023-11-04T01:42:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.377+0000 7f4e50ff9640 1 -- 172.21.15.114:0/4232569909 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00abb0 con 0x7f4e5415b200 2023-11-04T01:42:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.377+0000 7f4e59d41640 1 -- 172.21.15.114:0/4232569909 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e540b3ef0 con 0x7f4e5415b200 2023-11-04T01:42:46.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.378+0000 7f4e59d41640 1 -- 172.21.15.114:0/4232569909 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e540b4410 con 0x7f4e5415b200 2023-11-04T01:42:46.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.378+0000 7f4e50ff9640 1 -- 172.21.15.114:0/4232569909 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e4c00ad10 con 0x7f4e5415b200 2023-11-04T01:42:46.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.379+0000 7f4e50ff9640 1 --2- 172.21.15.114:0/4232569909 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4e3406ae70 0x7f4e3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.379+0000 7f4e50ff9640 1 -- 172.21.15.114:0/4232569909 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f4e4c0893c0 con 0x7f4e5415b200 2023-11-04T01:42:46.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.379+0000 7f4e537fe640 1 --2- 172.21.15.114:0/4232569909 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4e3406ae70 0x7f4e3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.379+0000 7f4e537fe640 1 --2- 172.21.15.114:0/4232569909 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4e3406ae70 0x7f4e3406d330 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4e541e7780 tx=0x7f4e44008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.383+0000 7f4e50ff9640 1 -- 172.21.15.114:0/4232569909 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e540b4410 con 0x7f4e5415b200 2023-11-04T01:42:46.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.586+0000 7f4e59d41640 1 -- 172.21.15.114:0/4232569909 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e540cf240 con 0x7f4e5415b200 2023-11-04T01:42:46.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.586+0000 7f4e50ff9640 1 -- 172.21.15.114:0/4232569909 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f4e540cf240 con 0x7f4e5415b200 2023-11-04T01:42:46.589 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:46.589 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":91,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:38.634213+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:46.589 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 91 2023-11-04T01:42:46.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.588+0000 7f4e59d41640 1 -- 172.21.15.114:0/4232569909 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4e3406ae70 msgr2=0x7f4e3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.588+0000 7f4e59d41640 1 --2- 172.21.15.114:0/4232569909 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4e3406ae70 0x7f4e3406d330 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4e541e7780 tx=0x7f4e44008040 comp rx=0 tx=0).stop 2023-11-04T01:42:46.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.588+0000 7f4e59d41640 1 -- 172.21.15.114:0/4232569909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e5415b200 msgr2=0x7f4e540b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.588+0000 7f4e59d41640 1 --2- 172.21.15.114:0/4232569909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e5415b200 0x7f4e540b5430 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00c7d0 tx=0x7f4e4c00cc90 comp rx=0 tx=0).stop 2023-11-04T01:42:46.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.588+0000 7f4e59d41640 1 -- 172.21.15.114:0/4232569909 shutdown_connections 2023-11-04T01:42:46.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.588+0000 7f4e59d41640 1 --2- 172.21.15.114:0/4232569909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e5415b200 0x7f4e540b5430 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.588+0000 7f4e59d41640 1 --2- 172.21.15.114:0/4232569909 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f4e3406ae70 0x7f4e3406d330 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.588+0000 7f4e59d41640 1 --2- 172.21.15.114:0/4232569909 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4e540cd7f0 0x7f4e540b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.588+0000 7f4e59d41640 1 --2- 172.21.15.114:0/4232569909 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f4e540afda0 0x7f4e5414c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.588+0000 7f4e59d41640 1 -- 172.21.15.114:0/4232569909 >> 172.21.15.114:0/4232569909 conn(0x7f4e540d0c30 msgr2=0x7f4e5406f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.588+0000 7f4e59d41640 1 -- 172.21.15.114:0/4232569909 shutdown_connections 2023-11-04T01:42:46.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.588+0000 7f4e59d41640 1 -- 172.21.15.114:0/4232569909 wait complete. 2023-11-04T01:42:46.600 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:42:46.713 INFO:teuthology.orchestra.run.smithi114.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:42:46.714 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:42:46.714 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:42:46.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.814+0000 7fc632caf640 1 Processor -- start 2023-11-04T01:42:46.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.814+0000 7fc632caf640 1 -- start start 2023-11-04T01:42:46.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.814+0000 7fc632caf640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc62c0cd9c0 0x7fc62c165e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.814+0000 7fc632caf640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62c0cf240 con 0x7fc62c15b200 2023-11-04T01:42:46.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.814+0000 7fc632caf640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62c0cde80 con 0x7fc62c0afda0 2023-11-04T01:42:46.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.814+0000 7fc632caf640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc62c0cf670 con 0x7fc62c0cd9c0 2023-11-04T01:42:46.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.814+0000 7fc63124c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc62c0cd9c0 0x7fc62c165e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.814+0000 7fc630a4b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc62c15b200 0x7fc62c0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51930/0 (socket says 172.21.15.114:51930) 2023-11-04T01:42:46.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.814+0000 7fc630a4b640 1 -- 172.21.15.114:0/3330893361 learned_addr learned my addr 172.21.15.114:0/3330893361 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:46.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.815+0000 7fc63124c640 1 -- 172.21.15.114:0/3330893361 >> v1:172.21.15.141:6789/0 conn(0x7fc62c0afda0 legacy=0x7fc62c0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.815+0000 7fc63124c640 1 -- 172.21.15.114:0/3330893361 >> v1:172.21.15.114:6789/0 conn(0x7fc62c15b200 legacy=0x7fc62c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.815+0000 7fc63124c640 1 -- 172.21.15.114:0/3330893361 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c0cf950 con 0x7fc62c0cd9c0 2023-11-04T01:42:46.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.815+0000 7fc62b7fe640 1 -- 172.21.15.114:0/3330893361 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127878917 0 0) 0x7fc61c001290 con 0x7fc62c15b200 2023-11-04T01:42:46.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.816+0000 7fc63124c640 1 --2- 172.21.15.114:0/3330893361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc62c0cd9c0 0x7fc62c165e40 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fc624009d90 tx=0x7fc62402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f23c96b70a4608 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.816+0000 7fc62b7fe640 1 -- 172.21.15.114:0/3330893361 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62402cbd0 con 0x7fc62c0cd9c0 2023-11-04T01:42:46.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.816+0000 7fc62b7fe640 1 -- 172.21.15.114:0/3330893361 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62402cd30 con 0x7fc62c0cd9c0 2023-11-04T01:42:46.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.816+0000 7fc62b7fe640 1 -- 172.21.15.114:0/3330893361 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62402cea0 con 0x7fc62c0cd9c0 2023-11-04T01:42:46.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.816+0000 7fc632caf640 1 -- 172.21.15.114:0/3330893361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc62c0cd9c0 msgr2=0x7fc62c165e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.816+0000 7fc632caf640 1 --2- 172.21.15.114:0/3330893361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc62c0cd9c0 0x7fc62c165e40 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fc624009d90 tx=0x7fc62402be20 comp rx=0 tx=0).stop 2023-11-04T01:42:46.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.816+0000 7fc632caf640 1 -- 172.21.15.114:0/3330893361 shutdown_connections 2023-11-04T01:42:46.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.816+0000 7fc632caf640 1 --2- 172.21.15.114:0/3330893361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc62c0cd9c0 0x7fc62c165e40 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.816+0000 7fc632caf640 1 -- 172.21.15.114:0/3330893361 >> 172.21.15.114:0/3330893361 conn(0x7fc62c0d0c30 msgr2=0x7fc62c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.816+0000 7fc632caf640 1 -- 172.21.15.114:0/3330893361 shutdown_connections 2023-11-04T01:42:46.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.816+0000 7fc632caf640 1 -- 172.21.15.114:0/3330893361 wait complete. 2023-11-04T01:42:46.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.817+0000 7fc632caf640 1 Processor -- start 2023-11-04T01:42:46.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.817+0000 7fc632caf640 1 -- start start 2023-11-04T01:42:46.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.818+0000 7fc632caf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc62c0afda0 0x7fc62c1f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.818+0000 7fc632caf640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc62c0cd9c0 0x7fc62c06bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.818+0000 7fc632caf640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc62c15b200 0x7fc62c154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.818+0000 7fc632caf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0c55a0 con 0x7fc62c0afda0 2023-11-04T01:42:46.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.818+0000 7fc632caf640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c06c100 con 0x7fc62c0cd9c0 2023-11-04T01:42:46.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.818+0000 7fc632caf640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c1f3650 con 0x7fc62c15b200 2023-11-04T01:42:46.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.818+0000 7fc630a4b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc62c0afda0 0x7fc62c1f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.818+0000 7fc630a4b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc62c0afda0 0x7fc62c1f3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36270/0 (socket says 172.21.15.114:36270) 2023-11-04T01:42:46.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.818+0000 7fc630a4b640 1 -- 172.21.15.114:0/2564236506 learned_addr learned my addr 172.21.15.114:0/2564236506 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:46.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.819+0000 7fc62bfff640 1 --2- 172.21.15.114:0/2564236506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc62c0cd9c0 0x7fc62c06bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.819+0000 7fc630a4b640 1 -- 172.21.15.114:0/2564236506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc62c15b200 msgr2=0x7fc62c154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.819+0000 7fc63124c640 1 --2- 172.21.15.114:0/2564236506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc62c15b200 0x7fc62c154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.819+0000 7fc630a4b640 1 --2- 172.21.15.114:0/2564236506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc62c15b200 0x7fc62c154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.819+0000 7fc630a4b640 1 -- 172.21.15.114:0/2564236506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc62c0cd9c0 msgr2=0x7fc62c06bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.819+0000 7fc630a4b640 1 --2- 172.21.15.114:0/2564236506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc62c0cd9c0 0x7fc62c06bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.819+0000 7fc630a4b640 1 -- 172.21.15.114:0/2564236506 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc624009a70 con 0x7fc62c0afda0 2023-11-04T01:42:46.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.819+0000 7fc62bfff640 1 --2- 172.21.15.114:0/2564236506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc62c0cd9c0 0x7fc62c06bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:46.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.819+0000 7fc63124c640 1 --2- 172.21.15.114:0/2564236506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc62c15b200 0x7fc62c154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:46.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.819+0000 7fc630a4b640 1 --2- 172.21.15.114:0/2564236506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc62c0afda0 0x7fc62c1f3000 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00c440 tx=0x7fc61c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.819+0000 7fc6297fa640 1 -- 172.21.15.114:0/2564236506 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c007480 con 0x7fc62c0afda0 2023-11-04T01:42:46.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.819+0000 7fc6297fa640 1 -- 172.21.15.114:0/2564236506 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c007600 con 0x7fc62c0afda0 2023-11-04T01:42:46.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.819+0000 7fc632caf640 1 -- 172.21.15.114:0/2564236506 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62c1f3930 con 0x7fc62c0afda0 2023-11-04T01:42:46.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.819+0000 7fc6297fa640 1 -- 172.21.15.114:0/2564236506 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c0059e0 con 0x7fc62c0afda0 2023-11-04T01:42:46.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.819+0000 7fc632caf640 1 -- 172.21.15.114:0/2564236506 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c1545d0 con 0x7fc62c0afda0 2023-11-04T01:42:46.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.820+0000 7fc632caf640 1 -- 172.21.15.114:0/2564236506 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62c0c5400 con 0x7fc62c0afda0 2023-11-04T01:42:46.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.820+0000 7fc6297fa640 1 -- 172.21.15.114:0/2564236506 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc61c005c00 con 0x7fc62c0afda0 2023-11-04T01:42:46.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.821+0000 7fc6297fa640 1 --2- 172.21.15.114:0/2564236506 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc61806ae70 0x7fc61806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.821+0000 7fc6297fa640 1 -- 172.21.15.114:0/2564236506 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fc61c089170 con 0x7fc62c0afda0 2023-11-04T01:42:46.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.821+0000 7fc62bfff640 1 --2- 172.21.15.114:0/2564236506 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc61806ae70 0x7fc61806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.821+0000 7fc62bfff640 1 --2- 172.21.15.114:0/2564236506 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc61806ae70 0x7fc61806d330 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0adca0 tx=0x7fc620009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:46.825+0000 7fc6297fa640 1 -- 172.21.15.114:0/2564236506 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc62c0c5400 con 0x7fc62c0afda0 2023-11-04T01:42:47.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.056+0000 7fc632caf640 1 -- 172.21.15.114:0/2564236506 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7fc62c0cf240 con 0x7fc62c0afda0 2023-11-04T01:42:47.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.664+0000 7fc6297fa640 1 -- 172.21.15.114:0/2564236506 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.8133 v92) v1 ==== 112+0+0 (secure 0 0 0) 0x7fc62c0cf240 con 0x7fc62c0afda0 2023-11-04T01:42:47.666 INFO:teuthology.orchestra.run.smithi114.stderr:freezing mds.8133 2023-11-04T01:42:47.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.667+0000 7fc632caf640 1 -- 172.21.15.114:0/2564236506 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc61806ae70 msgr2=0x7fc61806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.667+0000 7fc632caf640 1 --2- 172.21.15.114:0/2564236506 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc61806ae70 0x7fc61806d330 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0adca0 tx=0x7fc620009040 comp rx=0 tx=0).stop 2023-11-04T01:42:47.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.667+0000 7fc632caf640 1 -- 172.21.15.114:0/2564236506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc62c0afda0 msgr2=0x7fc62c1f3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.667+0000 7fc632caf640 1 --2- 172.21.15.114:0/2564236506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc62c0afda0 0x7fc62c1f3000 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00c440 tx=0x7fc61c00c900 comp rx=0 tx=0).stop 2023-11-04T01:42:47.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.667+0000 7fc632caf640 1 -- 172.21.15.114:0/2564236506 shutdown_connections 2023-11-04T01:42:47.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.667+0000 7fc632caf640 1 --2- 172.21.15.114:0/2564236506 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc62c15b200 0x7fc62c154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.667+0000 7fc632caf640 1 --2- 172.21.15.114:0/2564236506 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc61806ae70 0x7fc61806d330 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.667+0000 7fc632caf640 1 --2- 172.21.15.114:0/2564236506 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc62c0cd9c0 0x7fc62c06bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.667+0000 7fc632caf640 1 --2- 172.21.15.114:0/2564236506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc62c0afda0 0x7fc62c1f3000 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.668+0000 7fc632caf640 1 -- 172.21.15.114:0/2564236506 >> 172.21.15.114:0/2564236506 conn(0x7fc62c0d0c30 msgr2=0x7fc62c0b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:47.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.668+0000 7fc632caf640 1 -- 172.21.15.114:0/2564236506 shutdown_connections 2023-11-04T01:42:47.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.668+0000 7fc632caf640 1 -- 172.21.15.114:0/2564236506 wait complete. 2023-11-04T01:42:47.682 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:42:47.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.784+0000 7fe6142e5640 1 Processor -- start 2023-11-04T01:42:47.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.784+0000 7fe6142e5640 1 -- start start 2023-11-04T01:42:47.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe6142e5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe60c0d1be0 0x7fe60c167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe6142e5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60c0b32b0 con 0x7fe60c15d100 2023-11-04T01:42:47.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe6142e5640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60c0cee10 con 0x7fe60c15d4e0 2023-11-04T01:42:47.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe6142e5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0cec20 con 0x7fe60c0d1be0 2023-11-04T01:42:47.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe612081640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe60c15d100 0x7fe60c0ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51940/0 (socket says 172.21.15.114:51940) 2023-11-04T01:42:47.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe612081640 1 -- 172.21.15.114:0/1733692728 learned_addr learned my addr 172.21.15.114:0/1733692728 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:47.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe61107f640 1 -- 172.21.15.114:0/1733692728 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768669594 0 0) 0x7fe60c0b32b0 con 0x7fe60c15d100 2023-11-04T01:42:47.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe61107f640 1 -- 172.21.15.114:0/1733692728 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5f8003520 con 0x7fe60c15d100 2023-11-04T01:42:47.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe612882640 1 --2- 172.21.15.114:0/1733692728 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe60c0d1be0 0x7fe60c167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe61107f640 1 -- 172.21.15.114:0/1733692728 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3676661387 0 0) 0x7fe5f8003520 con 0x7fe60c15d100 2023-11-04T01:42:47.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe61107f640 1 -- 172.21.15.114:0/1733692728 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe60c0d1be0 msgr2=0x7fe60c167e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:47.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe61107f640 1 --2- 172.21.15.114:0/1733692728 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe60c0d1be0 0x7fe60c167e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe61107f640 1 -- 172.21.15.114:0/1733692728 >> v1:172.21.15.141:6789/0 conn(0x7fe60c15d4e0 legacy=0x7fe60c0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe61107f640 1 -- 172.21.15.114:0/1733692728 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c0b4750 con 0x7fe60c15d100 2023-11-04T01:42:47.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe61107f640 1 -- 172.21.15.114:0/1733692728 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fe6080017f0 con 0x7fe60c15d100 2023-11-04T01:42:47.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe61107f640 1 -- 172.21.15.114:0/1733692728 >> v1:172.21.15.114:6789/0 conn(0x7fe60c15d100 legacy=0x7fe60c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe61107f640 1 --2- 172.21.15.114:0/1733692728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5f80039a0 0x7fe5f8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe61107f640 1 --2- 172.21.15.114:0/1733692728 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5f80047c0 0x7fe5f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe61107f640 1 --2- 172.21.15.114:0/1733692728 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe60c0d1be0 0x7fe5f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe61107f640 1 -- 172.21.15.114:0/1733692728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f800bab0 con 0x7fe5f80039a0 2023-11-04T01:42:47.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe61107f640 1 -- 172.21.15.114:0/1733692728 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f800bc20 con 0x7fe5f80047c0 2023-11-04T01:42:47.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.785+0000 7fe61107f640 1 -- 172.21.15.114:0/1733692728 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f800bde0 con 0x7fe60c0d1be0 2023-11-04T01:42:47.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.786+0000 7fe612081640 1 --2- 172.21.15.114:0/1733692728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5f80039a0 0x7fe5f8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.786+0000 7fe611880640 1 --2- 172.21.15.114:0/1733692728 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5f80047c0 0x7fe5f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.786+0000 7fe612882640 1 --2- 172.21.15.114:0/1733692728 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe60c0d1be0 0x7fe5f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.786+0000 7fe612081640 1 -- 172.21.15.114:0/1733692728 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe60c0d1be0 msgr2=0x7fe5f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:47.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.786+0000 7fe612081640 1 --2- 172.21.15.114:0/1733692728 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe60c0d1be0 0x7fe5f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.786+0000 7fe612081640 1 -- 172.21.15.114:0/1733692728 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5f80047c0 msgr2=0x7fe5f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:47.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.786+0000 7fe612081640 1 --2- 172.21.15.114:0/1733692728 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5f80047c0 0x7fe5f8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.786+0000 7fe612081640 1 -- 172.21.15.114:0/1733692728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8003520 con 0x7fe5f80039a0 2023-11-04T01:42:47.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.786+0000 7fe611880640 1 --2- 172.21.15.114:0/1733692728 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5f80047c0 0x7fe5f8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:47.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.786+0000 7fe612081640 1 --2- 172.21.15.114:0/1733692728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5f80039a0 0x7fe5f8003dc0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fe60800c190 tx=0x7fe5f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9072ef4f11b0f98c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.787+0000 7fe61107f640 1 -- 172.21.15.114:0/1733692728 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608007270 con 0x7fe5f80039a0 2023-11-04T01:42:47.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.787+0000 7fe61107f640 1 -- 172.21.15.114:0/1733692728 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6080073f0 con 0x7fe5f80039a0 2023-11-04T01:42:47.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.787+0000 7fe61107f640 1 -- 172.21.15.114:0/1733692728 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60802c8a0 con 0x7fe5f80039a0 2023-11-04T01:42:47.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.787+0000 7fe6142e5640 1 -- 172.21.15.114:0/1733692728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5f80039a0 msgr2=0x7fe5f8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.787+0000 7fe6142e5640 1 --2- 172.21.15.114:0/1733692728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5f80039a0 0x7fe5f8003dc0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fe60800c190 tx=0x7fe5f80057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.787+0000 7fe612882640 1 -- 172.21.15.114:0/1733692728 reap_dead start 2023-11-04T01:42:47.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.787+0000 7fe6142e5640 1 -- 172.21.15.114:0/1733692728 shutdown_connections 2023-11-04T01:42:47.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.787+0000 7fe6142e5640 1 -- 172.21.15.114:0/1733692728 >> 172.21.15.114:0/1733692728 conn(0x7fe60c0d2ef0 msgr2=0x7fe60c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:47.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.787+0000 7fe6142e5640 1 -- 172.21.15.114:0/1733692728 shutdown_connections 2023-11-04T01:42:47.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.787+0000 7fe6142e5640 1 -- 172.21.15.114:0/1733692728 wait complete. 2023-11-04T01:42:47.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.788+0000 7fe6142e5640 1 Processor -- start 2023-11-04T01:42:47.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.788+0000 7fe6142e5640 1 -- start start 2023-11-04T01:42:47.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.789+0000 7fe6142e5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5f80039a0 0x7fe60c152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.789+0000 7fe6142e5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe60c0ca960 0x7fe60c15e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.789+0000 7fe6142e5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe60c0cc450 0x7fe60c0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.789+0000 7fe6142e5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0ca260 con 0x7fe5f80039a0 2023-11-04T01:42:47.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.789+0000 7fe6142e5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c152d80 con 0x7fe60c0ca960 2023-11-04T01:42:47.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.789+0000 7fe6142e5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c15eed0 con 0x7fe60c0cc450 2023-11-04T01:42:47.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.789+0000 7fe612081640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5f80039a0 0x7fe60c152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.789+0000 7fe612081640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5f80039a0 0x7fe60c152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36296/0 (socket says 172.21.15.114:36296) 2023-11-04T01:42:47.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.789+0000 7fe612081640 1 -- 172.21.15.114:0/1753238853 learned_addr learned my addr 172.21.15.114:0/1753238853 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:47.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.789+0000 7fe612081640 1 -- 172.21.15.114:0/1753238853 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe60c0cc450 msgr2=0x7fe60c0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.789+0000 7fe612081640 1 --2- 172.21.15.114:0/1753238853 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe60c0cc450 0x7fe60c0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.789+0000 7fe612081640 1 -- 172.21.15.114:0/1753238853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe60c0ca960 msgr2=0x7fe60c15e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.789+0000 7fe611880640 1 --2- 172.21.15.114:0/1753238853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe60c0ca960 0x7fe60c15e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.789+0000 7fe612081640 1 --2- 172.21.15.114:0/1753238853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe60c0ca960 0x7fe60c15e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.790+0000 7fe612081640 1 -- 172.21.15.114:0/1753238853 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c15f170 con 0x7fe5f80039a0 2023-11-04T01:42:47.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.790+0000 7fe612081640 1 --2- 172.21.15.114:0/1753238853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5f80039a0 0x7fe60c152840 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fe60800c190 tx=0x7fe60c0b3220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.790+0000 7fe602ffd640 1 -- 172.21.15.114:0/1753238853 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608039070 con 0x7fe5f80039a0 2023-11-04T01:42:47.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.790+0000 7fe602ffd640 1 -- 172.21.15.114:0/1753238853 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60802cab0 con 0x7fe5f80039a0 2023-11-04T01:42:47.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.790+0000 7fe6142e5640 1 -- 172.21.15.114:0/1753238853 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60c15f450 con 0x7fe5f80039a0 2023-11-04T01:42:47.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.790+0000 7fe602ffd640 1 -- 172.21.15.114:0/1753238853 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60803c040 con 0x7fe5f80039a0 2023-11-04T01:42:47.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.790+0000 7fe6142e5640 1 -- 172.21.15.114:0/1753238853 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60c15fa10 con 0x7fe5f80039a0 2023-11-04T01:42:47.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.791+0000 7fe6142e5640 1 -- 172.21.15.114:0/1753238853 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60c067f00 con 0x7fe5f80039a0 2023-11-04T01:42:47.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.791+0000 7fe602ffd640 1 -- 172.21.15.114:0/1753238853 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe608032070 con 0x7fe5f80039a0 2023-11-04T01:42:47.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.792+0000 7fe602ffd640 1 --2- 172.21.15.114:0/1753238853 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe5f006ae70 0x7fe5f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.792+0000 7fe602ffd640 1 -- 172.21.15.114:0/1753238853 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fe6080ab1b0 con 0x7fe5f80039a0 2023-11-04T01:42:47.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.792+0000 7fe611880640 1 --2- 172.21.15.114:0/1753238853 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe5f006ae70 0x7fe5f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.792+0000 7fe611880640 1 --2- 172.21.15.114:0/1753238853 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe5f006ae70 0x7fe5f006d330 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0ca5c0 tx=0x7fe5fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:47.796+0000 7fe602ffd640 1 -- 172.21.15.114:0/1753238853 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe608075a70 con 0x7fe5f80039a0 2023-11-04T01:42:48.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:48.029+0000 7fe6142e5640 1 -- 172.21.15.114:0/1753238853 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7fe60c0684b0 con 0x7fe5f80039a0 2023-11-04T01:42:48.311 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:42:48.309+0000 7f3bc27fc640 -1 client.7629 I was blocklisted at osd epoch 108 2023-11-04T01:42:48.311 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[118081]: fuse finished with error 0 and tester_r 0 2023-11-04T01:42:48.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:48.673+0000 7fe602ffd640 1 -- 172.21.15.114:0/1753238853 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.8262 v93) v1 ==== 112+0+0 (secure 0 0 0) 0x7fe608079090 con 0x7fe5f80039a0 2023-11-04T01:42:48.675 INFO:teuthology.orchestra.run.smithi114.stderr:freezing mds.8262 2023-11-04T01:42:48.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:48.675+0000 7fe6142e5640 1 -- 172.21.15.114:0/1753238853 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe5f006ae70 msgr2=0x7fe5f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:48.675+0000 7fe6142e5640 1 --2- 172.21.15.114:0/1753238853 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe5f006ae70 0x7fe5f006d330 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0ca5c0 tx=0x7fe5fc009040 comp rx=0 tx=0).stop 2023-11-04T01:42:48.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:48.675+0000 7fe6142e5640 1 -- 172.21.15.114:0/1753238853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5f80039a0 msgr2=0x7fe60c152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:48.675+0000 7fe6142e5640 1 --2- 172.21.15.114:0/1753238853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5f80039a0 0x7fe60c152840 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fe60800c190 tx=0x7fe60c0b3220 comp rx=0 tx=0).stop 2023-11-04T01:42:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:48.675+0000 7fe6142e5640 1 -- 172.21.15.114:0/1753238853 shutdown_connections 2023-11-04T01:42:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:48.675+0000 7fe6142e5640 1 --2- 172.21.15.114:0/1753238853 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe60c0cc450 0x7fe60c0cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:48.675+0000 7fe6142e5640 1 --2- 172.21.15.114:0/1753238853 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe5f006ae70 0x7fe5f006d330 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:48.675+0000 7fe6142e5640 1 --2- 172.21.15.114:0/1753238853 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe60c0ca960 0x7fe60c15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:48.675+0000 7fe6142e5640 1 --2- 172.21.15.114:0/1753238853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5f80039a0 0x7fe60c152840 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:48.675+0000 7fe6142e5640 1 -- 172.21.15.114:0/1753238853 >> 172.21.15.114:0/1753238853 conn(0x7fe60c0d2ef0 msgr2=0x7fe60c0cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:48.676+0000 7fe6142e5640 1 -- 172.21.15.114:0/1753238853 shutdown_connections 2023-11-04T01:42:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:48.676+0000 7fe6142e5640 1 -- 172.21.15.114:0/1753238853 wait complete. 2023-11-04T01:42:48.688 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_kill_mdstable_at 5 2023-11-04T01:42:48.713 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:42:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:48.803 INFO:teuthology.orchestra.run.smithi114.stdout:{"success":"mds_kill_mdstable_at = '5' (not observed, change may require restart) "} 2023-11-04T01:42:48.803 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '5' (not observed, change may require restart) " } 2023-11-04T01:42:48.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:48.803 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s25) 2023-11-04T01:42:48.806 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:42:48.825 INFO:tasks.ceph.mds.a.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f4ea4a4f640 time 2023-11-04T01:42:48.824840+0000 2023-11-04T01:42:48.825 INFO:tasks.ceph.mds.a.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:42:48.827 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:48.827 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4eaa56efaf] 2023-11-04T01:42:48.827 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f4eaa56f16d] 2023-11-04T01:42:48.827 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55d1175d0187] 2023-11-04T01:42:48.827 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d11735f0a9] 2023-11-04T01:42:48.827 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55d117361b2b] 2023-11-04T01:42:48.827 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d11736201c] 2023-11-04T01:42:48.827 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55d11734b325] 2023-11-04T01:42:48.827 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f4eaa75ff9a] 2023-11-04T01:42:48.827 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f4eaa7f1741] 2023-11-04T01:42:48.827 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f4ea9c9f802] 2023-11-04T01:42:48.827 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f4ea9c3f450] 2023-11-04T01:42:48.827 INFO:tasks.ceph.mds.a.smithi114.stderr:2023-11-04T01:42:48.824+0000 7f4ea4a4f640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f4ea4a4f640 time 2023-11-04T01:42:48.824840+0000 2023-11-04T01:42:48.828 INFO:tasks.ceph.mds.a.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:42:48.828 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:42:48.828 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:48.828 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4eaa56efaf] 2023-11-04T01:42:48.828 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f4eaa56f16d] 2023-11-04T01:42:48.828 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55d1175d0187] 2023-11-04T01:42:48.828 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d11735f0a9] 2023-11-04T01:42:48.828 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55d117361b2b] 2023-11-04T01:42:48.828 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d11736201c] 2023-11-04T01:42:48.828 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55d11734b325] 2023-11-04T01:42:48.828 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f4eaa75ff9a] 2023-11-04T01:42:48.828 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f4eaa7f1741] 2023-11-04T01:42:48.828 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f4ea9c9f802] 2023-11-04T01:42:48.828 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f4ea9c3f450] 2023-11-04T01:42:48.829 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:42:48.829 INFO:tasks.ceph.mds.a.smithi114.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:42:48.829 INFO:tasks.ceph.mds.a.smithi114.stderr: in thread 7f4ea4a4f640 thread_name:ms_dispatch 2023-11-04T01:42:48.830 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:48.830 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f4ea9c54db0] 2023-11-04T01:42:48.830 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f4ea9ca154c] 2023-11-04T01:42:48.830 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: raise() 2023-11-04T01:42:48.830 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: abort() 2023-11-04T01:42:48.830 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4eaa56f009] 2023-11-04T01:42:48.830 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f4eaa56f16d] 2023-11-04T01:42:48.830 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55d1175d0187] 2023-11-04T01:42:48.830 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d11735f0a9] 2023-11-04T01:42:48.830 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55d117361b2b] 2023-11-04T01:42:48.830 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d11736201c] 2023-11-04T01:42:48.831 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55d11734b325] 2023-11-04T01:42:48.831 INFO:tasks.ceph.mds.a.smithi114.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f4eaa75ff9a] 2023-11-04T01:42:48.831 INFO:tasks.ceph.mds.a.smithi114.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f4eaa7f1741] 2023-11-04T01:42:48.831 INFO:tasks.ceph.mds.a.smithi114.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f4ea9c9f802] 2023-11-04T01:42:48.831 INFO:tasks.ceph.mds.a.smithi114.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f4ea9c3f450] 2023-11-04T01:42:48.831 INFO:tasks.ceph.mds.a.smithi114.stderr:2023-11-04T01:42:48.825+0000 7f4ea4a4f640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:42:48.831 INFO:tasks.ceph.mds.a.smithi114.stderr: in thread 7f4ea4a4f640 thread_name:ms_dispatch 2023-11-04T01:42:48.831 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:42:48.831 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:48.831 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f4ea9c54db0] 2023-11-04T01:42:48.831 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f4ea9ca154c] 2023-11-04T01:42:48.832 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: raise() 2023-11-04T01:42:48.832 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: abort() 2023-11-04T01:42:48.832 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4eaa56f009] 2023-11-04T01:42:48.832 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f4eaa56f16d] 2023-11-04T01:42:48.832 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55d1175d0187] 2023-11-04T01:42:48.832 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d11735f0a9] 2023-11-04T01:42:48.832 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55d117361b2b] 2023-11-04T01:42:48.832 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d11736201c] 2023-11-04T01:42:48.832 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55d11734b325] 2023-11-04T01:42:48.832 INFO:tasks.ceph.mds.a.smithi114.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f4eaa75ff9a] 2023-11-04T01:42:48.832 INFO:tasks.ceph.mds.a.smithi114.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f4eaa7f1741] 2023-11-04T01:42:48.832 INFO:tasks.ceph.mds.a.smithi114.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f4ea9c9f802] 2023-11-04T01:42:48.832 INFO:tasks.ceph.mds.a.smithi114.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f4ea9c3f450] 2023-11-04T01:42:48.832 INFO:tasks.ceph.mds.a.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:42:48.833 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:42:48.833 INFO:tasks.ceph.mds.a.smithi114.stderr: -1111> 2023-11-04T01:42:39.770+0000 7f4ea224a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:48.833 INFO:tasks.ceph.mds.a.smithi114.stderr: -1109> 2023-11-04T01:42:39.770+0000 7f4ea224a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:42:48.833 INFO:tasks.ceph.mds.a.smithi114.stderr: -1> 2023-11-04T01:42:48.824+0000 7f4ea4a4f640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f4ea4a4f640 time 2023-11-04T01:42:48.824840+0000 2023-11-04T01:42:48.833 INFO:tasks.ceph.mds.a.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:42:48.833 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:42:48.833 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:48.834 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4eaa56efaf] 2023-11-04T01:42:48.834 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f4eaa56f16d] 2023-11-04T01:42:48.834 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55d1175d0187] 2023-11-04T01:42:48.834 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d11735f0a9] 2023-11-04T01:42:48.834 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55d117361b2b] 2023-11-04T01:42:48.834 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d11736201c] 2023-11-04T01:42:48.834 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55d11734b325] 2023-11-04T01:42:48.834 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f4eaa75ff9a] 2023-11-04T01:42:48.834 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f4eaa7f1741] 2023-11-04T01:42:48.834 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f4ea9c9f802] 2023-11-04T01:42:48.834 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f4ea9c3f450] 2023-11-04T01:42:48.834 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:42:48.835 INFO:tasks.ceph.mds.a.smithi114.stderr: 0> 2023-11-04T01:42:48.825+0000 7f4ea4a4f640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:42:48.835 INFO:tasks.ceph.mds.a.smithi114.stderr: in thread 7f4ea4a4f640 thread_name:ms_dispatch 2023-11-04T01:42:48.835 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:42:48.835 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:48.835 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f4ea9c54db0] 2023-11-04T01:42:48.835 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f4ea9ca154c] 2023-11-04T01:42:48.835 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: raise() 2023-11-04T01:42:48.835 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: abort() 2023-11-04T01:42:48.835 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4eaa56f009] 2023-11-04T01:42:48.835 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f4eaa56f16d] 2023-11-04T01:42:48.835 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55d1175d0187] 2023-11-04T01:42:48.835 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d11735f0a9] 2023-11-04T01:42:48.835 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55d117361b2b] 2023-11-04T01:42:48.835 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d11736201c] 2023-11-04T01:42:48.836 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55d11734b325] 2023-11-04T01:42:48.836 INFO:tasks.ceph.mds.a.smithi114.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f4eaa75ff9a] 2023-11-04T01:42:48.836 INFO:tasks.ceph.mds.a.smithi114.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f4eaa7f1741] 2023-11-04T01:42:48.836 INFO:tasks.ceph.mds.a.smithi114.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f4ea9c9f802] 2023-11-04T01:42:48.836 INFO:tasks.ceph.mds.a.smithi114.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f4ea9c3f450] 2023-11-04T01:42:48.836 INFO:tasks.ceph.mds.a.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:42:48.836 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:42:48.836 INFO:tasks.ceph.mds.a.smithi114.stderr: -1111> 2023-11-04T01:42:39.770+0000 7f4ea224a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:48.836 INFO:tasks.ceph.mds.a.smithi114.stderr: -1109> 2023-11-04T01:42:39.770+0000 7f4ea224a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:42:48.837 INFO:tasks.ceph.mds.a.smithi114.stderr: -1> 2023-11-04T01:42:48.824+0000 7f4ea4a4f640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f4ea4a4f640 time 2023-11-04T01:42:48.824840+0000 2023-11-04T01:42:48.837 INFO:tasks.ceph.mds.a.smithi114.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:42:48.837 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:42:48.837 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:48.837 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4eaa56efaf] 2023-11-04T01:42:48.838 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f4eaa56f16d] 2023-11-04T01:42:48.838 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55d1175d0187] 2023-11-04T01:42:48.838 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d11735f0a9] 2023-11-04T01:42:48.838 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55d117361b2b] 2023-11-04T01:42:48.838 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d11736201c] 2023-11-04T01:42:48.838 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55d11734b325] 2023-11-04T01:42:48.838 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f4eaa75ff9a] 2023-11-04T01:42:48.838 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f4eaa7f1741] 2023-11-04T01:42:48.839 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f4ea9c9f802] 2023-11-04T01:42:48.839 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f4ea9c3f450] 2023-11-04T01:42:48.839 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:42:48.839 INFO:tasks.ceph.mds.a.smithi114.stderr: 0> 2023-11-04T01:42:48.825+0000 7f4ea4a4f640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:42:48.839 INFO:tasks.ceph.mds.a.smithi114.stderr: in thread 7f4ea4a4f640 thread_name:ms_dispatch 2023-11-04T01:42:48.839 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:42:48.839 INFO:tasks.ceph.mds.a.smithi114.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:42:48.839 INFO:tasks.ceph.mds.a.smithi114.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f4ea9c54db0] 2023-11-04T01:42:48.839 INFO:tasks.ceph.mds.a.smithi114.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f4ea9ca154c] 2023-11-04T01:42:48.839 INFO:tasks.ceph.mds.a.smithi114.stderr: 3: raise() 2023-11-04T01:42:48.839 INFO:tasks.ceph.mds.a.smithi114.stderr: 4: abort() 2023-11-04T01:42:48.839 INFO:tasks.ceph.mds.a.smithi114.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4eaa56f009] 2023-11-04T01:42:48.840 INFO:tasks.ceph.mds.a.smithi114.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f4eaa56f16d] 2023-11-04T01:42:48.840 INFO:tasks.ceph.mds.a.smithi114.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55d1175d0187] 2023-11-04T01:42:48.840 INFO:tasks.ceph.mds.a.smithi114.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d11735f0a9] 2023-11-04T01:42:48.840 INFO:tasks.ceph.mds.a.smithi114.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55d117361b2b] 2023-11-04T01:42:48.840 INFO:tasks.ceph.mds.a.smithi114.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d11736201c] 2023-11-04T01:42:48.840 INFO:tasks.ceph.mds.a.smithi114.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55d11734b325] 2023-11-04T01:42:48.840 INFO:tasks.ceph.mds.a.smithi114.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f4eaa75ff9a] 2023-11-04T01:42:48.840 INFO:tasks.ceph.mds.a.smithi114.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f4eaa7f1741] 2023-11-04T01:42:48.840 INFO:tasks.ceph.mds.a.smithi114.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f4ea9c9f802] 2023-11-04T01:42:48.840 INFO:tasks.ceph.mds.a.smithi114.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f4ea9c3f450] 2023-11-04T01:42:48.840 INFO:tasks.ceph.mds.a.smithi114.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:42:48.840 INFO:tasks.ceph.mds.a.smithi114.stderr: 2023-11-04T01:42:48.933 INFO:teuthology.orchestra.run.smithi114.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:42:48.933 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:42:48.934 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:49.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.072+0000 7f3dd579e640 1 Processor -- start 2023-11-04T01:42:49.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.072+0000 7f3dd579e640 1 -- start start 2023-11-04T01:42:49.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.073+0000 7f3dd579e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd015cf60 0x7f3dd01608c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.073+0000 7f3dd579e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3dd00b84e0 0x7f3dd00d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.073+0000 7f3dd579e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd01611c0 con 0x7f3dd00cd820 2023-11-04T01:42:49.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.073+0000 7f3dd579e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd01614a0 con 0x7f3dd00b84e0 2023-11-04T01:42:49.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.073+0000 7f3dd579e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd0161780 con 0x7f3dd015cf60 2023-11-04T01:42:49.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.073+0000 7f3dd4f9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3dd00b84e0 0x7f3dd00d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.073+0000 7f3dcffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3dd00cd820 0x7f3dd00cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51952/0 (socket says 172.21.15.114:51952) 2023-11-04T01:42:49.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.073+0000 7f3dcffff640 1 -- 172.21.15.114:0/1416180896 learned_addr learned my addr 172.21.15.114:0/1416180896 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:49.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.073+0000 7f3dcf7fe640 1 --2- 172.21.15.114:0/1416180896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd015cf60 0x7f3dd01608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.073+0000 7f3dd4f9d640 1 -- 172.21.15.114:0/1416180896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd015cf60 msgr2=0x7f3dd01608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.073+0000 7f3dd4f9d640 1 --2- 172.21.15.114:0/1416180896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd015cf60 0x7f3dd01608c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.073+0000 7f3dd4f9d640 1 -- 172.21.15.114:0/1416180896 >> v1:172.21.15.114:6789/0 conn(0x7f3dd00cd820 legacy=0x7f3dd00cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.073+0000 7f3dd4f9d640 1 -- 172.21.15.114:0/1416180896 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd00d0ce0 con 0x7f3dd00b84e0 2023-11-04T01:42:49.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.073+0000 7f3dceffd640 1 -- 172.21.15.114:0/1416180896 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040167321 0 0) 0x7f3dd01611c0 con 0x7f3dd00cd820 2023-11-04T01:42:49.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.074+0000 7f3dd4f9d640 1 --2- 172.21.15.114:0/1416180896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd00b84e0 0x7f3dd00d14e0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009d90 tx=0x7f3dc802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1928fa9d411ac4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.074+0000 7f3dceffd640 1 -- 172.21.15.114:0/1416180896 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc802cc50 con 0x7f3dd00b84e0 2023-11-04T01:42:49.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.074+0000 7f3dceffd640 1 -- 172.21.15.114:0/1416180896 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc802cdb0 con 0x7f3dd00b84e0 2023-11-04T01:42:49.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.074+0000 7f3dceffd640 1 -- 172.21.15.114:0/1416180896 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8034660 con 0x7f3dd00b84e0 2023-11-04T01:42:49.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.075+0000 7f3dd579e640 1 -- 172.21.15.114:0/1416180896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd00b84e0 msgr2=0x7f3dd00d14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.075+0000 7f3dd579e640 1 --2- 172.21.15.114:0/1416180896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd00b84e0 0x7f3dd00d14e0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009d90 tx=0x7f3dc802bea0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.075+0000 7f3dd579e640 1 -- 172.21.15.114:0/1416180896 shutdown_connections 2023-11-04T01:42:49.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.075+0000 7f3dd579e640 1 --2- 172.21.15.114:0/1416180896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd00b84e0 0x7f3dd00d14e0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.075+0000 7f3dd579e640 1 --2- 172.21.15.114:0/1416180896 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd015cf60 0x7f3dd01608c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.075+0000 7f3dd579e640 1 -- 172.21.15.114:0/1416180896 >> 172.21.15.114:0/1416180896 conn(0x7f3dd006a5e0 msgr2=0x7f3dd006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.075+0000 7f3dd579e640 1 -- 172.21.15.114:0/1416180896 shutdown_connections 2023-11-04T01:42:49.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.075+0000 7f3dd579e640 1 -- 172.21.15.114:0/1416180896 wait complete. 2023-11-04T01:42:49.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.076+0000 7f3dd579e640 1 Processor -- start 2023-11-04T01:42:49.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.076+0000 7f3dd579e640 1 -- start start 2023-11-04T01:42:49.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.077+0000 7f3dd579e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd00b84e0 0x7f3dd00ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.077+0000 7f3dd579e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dd00cd820 0x7f3dd00b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.077+0000 7f3dd579e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd015cf60 0x7f3dd015dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.077+0000 7f3dd579e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00ca690 con 0x7f3dd015cf60 2023-11-04T01:42:49.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.077+0000 7f3dd579e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00c6890 con 0x7f3dd00cd820 2023-11-04T01:42:49.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.077+0000 7f3dd579e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00c6b70 con 0x7f3dd00b84e0 2023-11-04T01:42:49.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.077+0000 7f3dd4f9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd015cf60 0x7f3dd015dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.077+0000 7f3dd4f9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd015cf60 0x7f3dd015dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36318/0 (socket says 172.21.15.114:36318) 2023-11-04T01:42:49.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.077+0000 7f3dd4f9d640 1 -- 172.21.15.114:0/828202104 learned_addr learned my addr 172.21.15.114:0/828202104 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:49.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.077+0000 7f3dcffff640 1 --2- 172.21.15.114:0/828202104 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd00b84e0 0x7f3dd00ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.077+0000 7f3dcf7fe640 1 --2- 172.21.15.114:0/828202104 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dd00cd820 0x7f3dd00b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.077+0000 7f3dd4f9d640 1 -- 172.21.15.114:0/828202104 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd00b84e0 msgr2=0x7f3dd00ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.077+0000 7f3dd4f9d640 1 --2- 172.21.15.114:0/828202104 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd00b84e0 0x7f3dd00ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.077+0000 7f3dd4f9d640 1 -- 172.21.15.114:0/828202104 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dd00cd820 msgr2=0x7f3dd00b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.077+0000 7f3dd4f9d640 1 --2- 172.21.15.114:0/828202104 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dd00cd820 0x7f3dd00b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.077+0000 7f3dd4f9d640 1 -- 172.21.15.114:0/828202104 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc8009a70 con 0x7f3dd015cf60 2023-11-04T01:42:49.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.078+0000 7f3dd4f9d640 1 --2- 172.21.15.114:0/828202104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd015cf60 0x7f3dd015dd70 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009d90 tx=0x7f3dc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.078+0000 7f3dccff9640 1 -- 172.21.15.114:0/828202104 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8040650 con 0x7f3dd015cf60 2023-11-04T01:42:49.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.078+0000 7f3dccff9640 1 -- 172.21.15.114:0/828202104 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc80407d0 con 0x7f3dd015cf60 2023-11-04T01:42:49.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.078+0000 7f3dccff9640 1 -- 172.21.15.114:0/828202104 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8040b80 con 0x7f3dd015cf60 2023-11-04T01:42:49.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.078+0000 7f3dd579e640 1 -- 172.21.15.114:0/828202104 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd00c6e50 con 0x7f3dd015cf60 2023-11-04T01:42:49.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.078+0000 7f3dd579e640 1 -- 172.21.15.114:0/828202104 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd00c7410 con 0x7f3dd015cf60 2023-11-04T01:42:49.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.079+0000 7f3dd579e640 1 -- 172.21.15.114:0/828202104 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd00742c0 con 0x7f3dd015cf60 2023-11-04T01:42:49.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.079+0000 7f3dccff9640 1 -- 172.21.15.114:0/828202104 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3dc8040ce0 con 0x7f3dd015cf60 2023-11-04T01:42:49.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.080+0000 7f3dccff9640 1 --2- 172.21.15.114:0/828202104 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3dbc06ae70 0x7f3dbc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.080+0000 7f3dccff9640 1 -- 172.21.15.114:0/828202104 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f3dc80acc60 con 0x7f3dd015cf60 2023-11-04T01:42:49.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.080+0000 7f3dcffff640 1 --2- 172.21.15.114:0/828202104 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3dbc06ae70 0x7f3dbc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.080+0000 7f3dcffff640 1 --2- 172.21.15.114:0/828202104 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3dbc06ae70 0x7f3dbc06d330 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0000f60 tx=0x7f3dc0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.084+0000 7f3dccff9640 1 -- 172.21.15.114:0/828202104 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3dc8077520 con 0x7f3dd015cf60 2023-11-04T01:42:49.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.286+0000 7f3dd579e640 1 -- 172.21.15.114:0/828202104 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3dd00b8190 con 0x7f3dd015cf60 2023-11-04T01:42:49.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.286+0000 7f3dccff9640 1 -- 172.21.15.114:0/828202104 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f3dc807ab40 con 0x7f3dd015cf60 2023-11-04T01:42:49.288 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:49.288 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:48.031237+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:49.289 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 93 2023-11-04T01:42:49.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.288+0000 7f3dd579e640 1 -- 172.21.15.114:0/828202104 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3dbc06ae70 msgr2=0x7f3dbc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.288+0000 7f3dd579e640 1 --2- 172.21.15.114:0/828202104 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3dbc06ae70 0x7f3dbc06d330 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0000f60 tx=0x7f3dc0009040 comp rx=0 tx=0).stop 2023-11-04T01:42:49.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.288+0000 7f3dd579e640 1 -- 172.21.15.114:0/828202104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd015cf60 msgr2=0x7f3dd015dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.288+0000 7f3dd579e640 1 --2- 172.21.15.114:0/828202104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd015cf60 0x7f3dd015dd70 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009d90 tx=0x7f3dc8004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:49.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.288+0000 7f3dd579e640 1 -- 172.21.15.114:0/828202104 shutdown_connections 2023-11-04T01:42:49.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.288+0000 7f3dd579e640 1 --2- 172.21.15.114:0/828202104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd015cf60 0x7f3dd015dd70 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.288+0000 7f3dd579e640 1 --2- 172.21.15.114:0/828202104 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3dbc06ae70 0x7f3dbc06d330 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.288+0000 7f3dd579e640 1 --2- 172.21.15.114:0/828202104 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dd00cd820 0x7f3dd00b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.288+0000 7f3dd579e640 1 --2- 172.21.15.114:0/828202104 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dd00b84e0 0x7f3dd00ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.288+0000 7f3dd579e640 1 -- 172.21.15.114:0/828202104 >> 172.21.15.114:0/828202104 conn(0x7f3dd006a5e0 msgr2=0x7f3dd015ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.288+0000 7f3dd579e640 1 -- 172.21.15.114:0/828202104 shutdown_connections 2023-11-04T01:42:49.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:49.288+0000 7f3dd579e640 1 -- 172.21.15.114:0/828202104 wait complete. 2023-11-04T01:42:49.301 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:42:49.511 INFO:tasks.ceph.mds.a.smithi114.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:42:50.938 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:50.942 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:51.757 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:42:54.302 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:54.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.411+0000 7feb5df39640 1 Processor -- start 2023-11-04T01:42:54.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.411+0000 7feb5df39640 1 -- start start 2023-11-04T01:42:54.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.412+0000 7feb5df39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb580ade00 0x7feb580b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.412+0000 7feb5df39640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb5806c5f0 0x7feb580cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.412+0000 7feb5df39640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5806cc90 con 0x7feb5806d9c0 2023-11-04T01:42:54.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.412+0000 7feb5df39640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb580b0e60 con 0x7feb5806c5f0 2023-11-04T01:42:54.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.412+0000 7feb5df39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5806cee0 con 0x7feb580ade00 2023-11-04T01:42:54.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.412+0000 7feb57fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb5806c5f0 0x7feb580cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.412+0000 7feb57fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb5806c5f0 0x7feb580cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36330/0 (socket says 172.21.15.114:36330) 2023-11-04T01:42:54.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.412+0000 7feb57fff640 1 -- 172.21.15.114:0/403000654 learned_addr learned my addr 172.21.15.114:0/403000654 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:54.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.412+0000 7feb577fe640 1 --2- 172.21.15.114:0/403000654 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb580ade00 0x7feb580b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.413+0000 7feb57fff640 1 -- 172.21.15.114:0/403000654 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb580ade00 msgr2=0x7feb580b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:54.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.413+0000 7feb57fff640 1 --2- 172.21.15.114:0/403000654 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb580ade00 0x7feb580b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.413+0000 7feb57fff640 1 -- 172.21.15.114:0/403000654 >> v1:172.21.15.141:6789/0 conn(0x7feb5806d9c0 legacy=0x7feb580710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.413+0000 7feb57fff640 1 -- 172.21.15.114:0/403000654 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5806d1c0 con 0x7feb5806c5f0 2023-11-04T01:42:54.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.413+0000 7feb577fe640 1 --2- 172.21.15.114:0/403000654 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb580ade00 0x7feb580b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.413+0000 7feb57fff640 1 --2- 172.21.15.114:0/403000654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb5806c5f0 0x7feb580cc680 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7feb50009e50 tx=0x7feb5002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b409e9f39d9800c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.413+0000 7feb567fc640 1 -- 172.21.15.114:0/403000654 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5002c9e0 con 0x7feb5806c5f0 2023-11-04T01:42:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.413+0000 7feb567fc640 1 -- 172.21.15.114:0/403000654 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5002cb40 con 0x7feb5806c5f0 2023-11-04T01:42:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.414+0000 7feb567fc640 1 -- 172.21.15.114:0/403000654 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb500343f0 con 0x7feb5806c5f0 2023-11-04T01:42:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.414+0000 7feb5df39640 1 -- 172.21.15.114:0/403000654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb5806c5f0 msgr2=0x7feb580cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.414+0000 7feb5df39640 1 --2- 172.21.15.114:0/403000654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb5806c5f0 0x7feb580cc680 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7feb50009e50 tx=0x7feb5002be40 comp rx=0 tx=0).stop 2023-11-04T01:42:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.414+0000 7feb5df39640 1 -- 172.21.15.114:0/403000654 shutdown_connections 2023-11-04T01:42:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.414+0000 7feb5df39640 1 --2- 172.21.15.114:0/403000654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb5806c5f0 0x7feb580cc680 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.414+0000 7feb5df39640 1 --2- 172.21.15.114:0/403000654 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb580ade00 0x7feb580b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.414+0000 7feb5df39640 1 -- 172.21.15.114:0/403000654 >> 172.21.15.114:0/403000654 conn(0x7feb580cb530 msgr2=0x7feb580cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:54.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.414+0000 7feb5df39640 1 -- 172.21.15.114:0/403000654 shutdown_connections 2023-11-04T01:42:54.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.414+0000 7feb5df39640 1 -- 172.21.15.114:0/403000654 wait complete. 2023-11-04T01:42:54.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.415+0000 7feb5df39640 1 Processor -- start 2023-11-04T01:42:54.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.416+0000 7feb5df39640 1 -- start start 2023-11-04T01:42:54.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.416+0000 7feb5df39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb5806c5f0 0x7feb581f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.416+0000 7feb5df39640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb5806d9c0 0x7feb5815d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.416+0000 7feb5df39640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb580ade00 0x7feb580aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.416+0000 7feb5df39640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb581f4f10 con 0x7feb5806d9c0 2023-11-04T01:42:54.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.416+0000 7feb5df39640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5815d550 con 0x7feb580ade00 2023-11-04T01:42:54.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.416+0000 7feb5df39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb581f0d70 con 0x7feb5806c5f0 2023-11-04T01:42:54.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.416+0000 7feb56ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb5806d9c0 0x7feb5815d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.416+0000 7feb56ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb5806d9c0 0x7feb5815d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36332/0 (socket says 172.21.15.114:36332) 2023-11-04T01:42:54.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.416+0000 7feb56ffd640 1 -- 172.21.15.114:0/1452556384 learned_addr learned my addr 172.21.15.114:0/1452556384 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:54.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.417+0000 7feb577fe640 1 --2- 172.21.15.114:0/1452556384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb5806c5f0 0x7feb581f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.417+0000 7feb57fff640 1 --2- 172.21.15.114:0/1452556384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb580ade00 0x7feb580aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.417+0000 7feb56ffd640 1 -- 172.21.15.114:0/1452556384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb5806c5f0 msgr2=0x7feb581f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.417+0000 7feb56ffd640 1 --2- 172.21.15.114:0/1452556384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb5806c5f0 0x7feb581f49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.417+0000 7feb56ffd640 1 -- 172.21.15.114:0/1452556384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb580ade00 msgr2=0x7feb580aa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.417+0000 7feb56ffd640 1 --2- 172.21.15.114:0/1452556384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb580ade00 0x7feb580aa2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.417+0000 7feb56ffd640 1 -- 172.21.15.114:0/1452556384 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb50009b30 con 0x7feb5806d9c0 2023-11-04T01:42:54.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.417+0000 7feb577fe640 1 --2- 172.21.15.114:0/1452556384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb5806c5f0 0x7feb581f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:54.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.417+0000 7feb57fff640 1 --2- 172.21.15.114:0/1452556384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb580ade00 0x7feb580aa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.417+0000 7feb56ffd640 1 --2- 172.21.15.114:0/1452556384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb5806d9c0 0x7feb5815d010 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00c3c0 tx=0x7feb4c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.417+0000 7feb3ffff640 1 -- 172.21.15.114:0/1452556384 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c0052d0 con 0x7feb5806d9c0 2023-11-04T01:42:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.417+0000 7feb3ffff640 1 -- 172.21.15.114:0/1452556384 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c005450 con 0x7feb5806d9c0 2023-11-04T01:42:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.417+0000 7feb5df39640 1 -- 172.21.15.114:0/1452556384 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb581f1050 con 0x7feb5806d9c0 2023-11-04T01:42:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.417+0000 7feb3ffff640 1 -- 172.21.15.114:0/1452556384 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c003830 con 0x7feb5806d9c0 2023-11-04T01:42:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.417+0000 7feb5df39640 1 -- 172.21.15.114:0/1452556384 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb581f1610 con 0x7feb5806d9c0 2023-11-04T01:42:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.418+0000 7feb5df39640 1 -- 172.21.15.114:0/1452556384 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb580c8a60 con 0x7feb5806d9c0 2023-11-04T01:42:54.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.419+0000 7feb3ffff640 1 -- 172.21.15.114:0/1452556384 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb4c003990 con 0x7feb5806d9c0 2023-11-04T01:42:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.419+0000 7feb3ffff640 1 --2- 172.21.15.114:0/1452556384 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feb4406aea0 0x7feb4406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.419+0000 7feb3ffff640 1 -- 172.21.15.114:0/1452556384 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7feb4c0892d0 con 0x7feb5806d9c0 2023-11-04T01:42:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.419+0000 7feb577fe640 1 --2- 172.21.15.114:0/1452556384 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feb4406aea0 0x7feb4406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.419+0000 7feb577fe640 1 --2- 172.21.15.114:0/1452556384 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feb4406aea0 0x7feb4406d360 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7feb580ac1f0 tx=0x7feb48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.423+0000 7feb3ffff640 1 -- 172.21.15.114:0/1452556384 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feb4c053ba0 con 0x7feb5806d9c0 2023-11-04T01:42:54.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.623+0000 7feb5df39640 1 -- 172.21.15.114:0/1452556384 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb580684b0 con 0x7feb5806d9c0 2023-11-04T01:42:54.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.623+0000 7feb3ffff640 1 -- 172.21.15.114:0/1452556384 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4941 (secure 0 0 0) 0x7feb4c0571c0 con 0x7feb5806d9c0 2023-11-04T01:42:54.625 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:54.625 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:48.031237+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:54.625 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 93 2023-11-04T01:42:54.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.625+0000 7feb5df39640 1 -- 172.21.15.114:0/1452556384 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feb4406aea0 msgr2=0x7feb4406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.625+0000 7feb5df39640 1 --2- 172.21.15.114:0/1452556384 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feb4406aea0 0x7feb4406d360 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7feb580ac1f0 tx=0x7feb48008040 comp rx=0 tx=0).stop 2023-11-04T01:42:54.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.625+0000 7feb5df39640 1 -- 172.21.15.114:0/1452556384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb5806d9c0 msgr2=0x7feb5815d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.625+0000 7feb5df39640 1 --2- 172.21.15.114:0/1452556384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb5806d9c0 0x7feb5815d010 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00c3c0 tx=0x7feb4c00c880 comp rx=0 tx=0).stop 2023-11-04T01:42:54.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.625+0000 7feb5df39640 1 -- 172.21.15.114:0/1452556384 shutdown_connections 2023-11-04T01:42:54.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.625+0000 7feb5df39640 1 --2- 172.21.15.114:0/1452556384 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7feb4406aea0 0x7feb4406d360 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.625+0000 7feb5df39640 1 --2- 172.21.15.114:0/1452556384 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feb580ade00 0x7feb580aa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.625+0000 7feb5df39640 1 --2- 172.21.15.114:0/1452556384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb5806d9c0 0x7feb5815d010 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.625+0000 7feb5df39640 1 --2- 172.21.15.114:0/1452556384 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feb5806c5f0 0x7feb581f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.625+0000 7feb5df39640 1 -- 172.21.15.114:0/1452556384 >> 172.21.15.114:0/1452556384 conn(0x7feb580cb530 msgr2=0x7feb580cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:54.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.625+0000 7feb5df39640 1 -- 172.21.15.114:0/1452556384 shutdown_connections 2023-11-04T01:42:54.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:54.625+0000 7feb5df39640 1 -- 172.21.15.114:0/1452556384 wait complete. 2023-11-04T01:42:54.638 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:42:58.368 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-11-04T01:42:59.639 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.750+0000 7f7a855e7640 1 Processor -- start 2023-11-04T01:42:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.750+0000 7f7a855e7640 1 -- start start 2023-11-04T01:42:59.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.751+0000 7f7a855e7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a8015d4e0 0x7f7a800d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.751+0000 7f7a855e7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a800b32b0 con 0x7f7a8015d100 2023-11-04T01:42:59.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.751+0000 7f7a855e7640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a800cee10 con 0x7f7a800d3b60 2023-11-04T01:42:59.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.751+0000 7f7a855e7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a800cec20 con 0x7f7a8015d4e0 2023-11-04T01:42:59.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.751+0000 7f7a7effd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7a8015d100 0x7f7a800ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:36428/0 (socket says 172.21.15.114:36428) 2023-11-04T01:42:59.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.751+0000 7f7a7effd640 1 -- 172.21.15.114:0/1644578283 learned_addr learned my addr 172.21.15.114:0/1644578283 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:42:59.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.751+0000 7f7a7e7fc640 1 --2- 172.21.15.114:0/1644578283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a8015d4e0 0x7f7a800d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.751+0000 7f7a7dffb640 1 -- 172.21.15.114:0/1644578283 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826341495 0 0) 0x7f7a800b32b0 con 0x7f7a8015d100 2023-11-04T01:42:59.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.751+0000 7f7a7dffb640 1 -- 172.21.15.114:0/1644578283 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a68003520 con 0x7f7a8015d100 2023-11-04T01:42:59.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.751+0000 7f7a7dffb640 1 -- 172.21.15.114:0/1644578283 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757271460 0 0) 0x7f7a800cee10 con 0x7f7a800d3b60 2023-11-04T01:42:59.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.751+0000 7f7a7dffb640 1 -- 172.21.15.114:0/1644578283 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a800b32b0 con 0x7f7a800d3b60 2023-11-04T01:42:59.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.751+0000 7f7a7dffb640 1 -- 172.21.15.114:0/1644578283 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2477534918 0 0) 0x7f7a68003520 con 0x7f7a8015d100 2023-11-04T01:42:59.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7dffb640 1 -- 172.21.15.114:0/1644578283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a8015d4e0 msgr2=0x7f7a800d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7dffb640 1 --2- 172.21.15.114:0/1644578283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a8015d4e0 0x7f7a800d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7dffb640 1 -- 172.21.15.114:0/1644578283 >> v1:172.21.15.141:6789/0 conn(0x7f7a800d3b60 legacy=0x7f7a800b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7dffb640 1 -- 172.21.15.114:0/1644578283 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a800b2980 con 0x7f7a8015d100 2023-11-04T01:42:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7dffb640 1 -- 172.21.15.114:0/1644578283 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f7a700017f0 con 0x7f7a8015d100 2023-11-04T01:42:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7dffb640 1 -- 172.21.15.114:0/1644578283 >> v1:172.21.15.114:6789/0 conn(0x7f7a8015d100 legacy=0x7f7a800ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7dffb640 1 --2- 172.21.15.114:0/1644578283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a68003b30 0x7f7a68003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7dffb640 1 --2- 172.21.15.114:0/1644578283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a8015d4e0 0x7f7a680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7dffb640 1 --2- 172.21.15.114:0/1644578283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7a68004d00 0x7f7a68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7dffb640 1 -- 172.21.15.114:0/1644578283 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6800ba30 con 0x7f7a68003b30 2023-11-04T01:42:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7dffb640 1 -- 172.21.15.114:0/1644578283 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6800bb70 con 0x7f7a68004d00 2023-11-04T01:42:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7dffb640 1 -- 172.21.15.114:0/1644578283 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6800bd30 con 0x7f7a8015d4e0 2023-11-04T01:42:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7effd640 1 --2- 172.21.15.114:0/1644578283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a68003b30 0x7f7a68003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7e7fc640 1 --2- 172.21.15.114:0/1644578283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a8015d4e0 0x7f7a680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7f7fe640 1 --2- 172.21.15.114:0/1644578283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7a68004d00 0x7f7a68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7effd640 1 -- 172.21.15.114:0/1644578283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a8015d4e0 msgr2=0x7f7a680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7effd640 1 --2- 172.21.15.114:0/1644578283 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a8015d4e0 0x7f7a680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7effd640 1 -- 172.21.15.114:0/1644578283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7a68004d00 msgr2=0x7f7a68005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7effd640 1 --2- 172.21.15.114:0/1644578283 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7a68004d00 0x7f7a68005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.752+0000 7f7a7effd640 1 -- 172.21.15.114:0/1644578283 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a68003520 con 0x7f7a68003b30 2023-11-04T01:42:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.753+0000 7f7a7effd640 1 --2- 172.21.15.114:0/1644578283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a68003b30 0x7f7a68003f30 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f7a70007fa0 tx=0x7f7a680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c7c402f90d8218 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.753+0000 7f7a7dffb640 1 -- 172.21.15.114:0/1644578283 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70007270 con 0x7f7a68003b30 2023-11-04T01:42:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.753+0000 7f7a7dffb640 1 -- 172.21.15.114:0/1644578283 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a700073f0 con 0x7f7a68003b30 2023-11-04T01:42:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.753+0000 7f7a7dffb640 1 -- 172.21.15.114:0/1644578283 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a700057a0 con 0x7f7a68003b30 2023-11-04T01:42:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.753+0000 7f7a855e7640 1 -- 172.21.15.114:0/1644578283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a68003b30 msgr2=0x7f7a68003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.753+0000 7f7a855e7640 1 --2- 172.21.15.114:0/1644578283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a68003b30 0x7f7a68003f30 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f7a70007fa0 tx=0x7f7a680057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.753+0000 7f7a7f7fe640 1 -- 172.21.15.114:0/1644578283 reap_dead start 2023-11-04T01:42:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.753+0000 7f7a855e7640 1 -- 172.21.15.114:0/1644578283 shutdown_connections 2023-11-04T01:42:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.753+0000 7f7a855e7640 1 -- 172.21.15.114:0/1644578283 >> 172.21.15.114:0/1644578283 conn(0x7f7a800d2ef0 msgr2=0x7f7a800d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.753+0000 7f7a855e7640 1 -- 172.21.15.114:0/1644578283 shutdown_connections 2023-11-04T01:42:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.753+0000 7f7a855e7640 1 -- 172.21.15.114:0/1644578283 wait complete. 2023-11-04T01:42:59.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.755+0000 7f7a855e7640 1 Processor -- start 2023-11-04T01:42:59.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.755+0000 7f7a855e7640 1 -- start start 2023-11-04T01:42:59.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.755+0000 7f7a855e7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7a68003b30 0x7f7a80152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a855e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a800cc840 0x7f7a8015f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a855e7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a8015fee0 0x7f7a801f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a855e7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8015d8c0 con 0x7f7a800cc840 2023-11-04T01:42:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a855e7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a80160360 con 0x7f7a68003b30 2023-11-04T01:42:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a855e7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8015dad0 con 0x7f7a8015fee0 2023-11-04T01:42:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a7e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a800cc840 0x7f7a8015f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a7e7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a800cc840 0x7f7a8015f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46754/0 (socket says 172.21.15.114:46754) 2023-11-04T01:42:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a7e7fc640 1 -- 172.21.15.114:0/3914207763 learned_addr learned my addr 172.21.15.114:0/3914207763 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:42:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a7f7fe640 1 --2- 172.21.15.114:0/3914207763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a8015fee0 0x7f7a801f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a7e7fc640 1 -- 172.21.15.114:0/3914207763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a8015fee0 msgr2=0x7f7a801f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a7e7fc640 1 --2- 172.21.15.114:0/3914207763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a8015fee0 0x7f7a801f6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a7effd640 1 --2- 172.21.15.114:0/3914207763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7a68003b30 0x7f7a80152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a7e7fc640 1 -- 172.21.15.114:0/3914207763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7a68003b30 msgr2=0x7f7a80152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a7e7fc640 1 --2- 172.21.15.114:0/3914207763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7a68003b30 0x7f7a80152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a7e7fc640 1 -- 172.21.15.114:0/3914207763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8015ddb0 con 0x7f7a800cc840 2023-11-04T01:42:59.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a7e7fc640 1 --2- 172.21.15.114:0/3914207763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a800cc840 0x7f7a8015f9a0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f7a740119a0 tx=0x7f7a74011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a677fe640 1 -- 172.21.15.114:0/3914207763 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7400faf0 con 0x7f7a800cc840 2023-11-04T01:42:59.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a677fe640 1 -- 172.21.15.114:0/3914207763 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7400fc50 con 0x7f7a800cc840 2023-11-04T01:42:59.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a855e7640 1 -- 172.21.15.114:0/3914207763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8015e090 con 0x7f7a800cc840 2023-11-04T01:42:59.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a677fe640 1 -- 172.21.15.114:0/3914207763 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a74014440 con 0x7f7a800cc840 2023-11-04T01:42:59.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.756+0000 7f7a855e7640 1 -- 172.21.15.114:0/3914207763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8015e650 con 0x7f7a800cc840 2023-11-04T01:42:59.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.757+0000 7f7a855e7640 1 -- 172.21.15.114:0/3914207763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a800684b0 con 0x7f7a800cc840 2023-11-04T01:42:59.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.758+0000 7f7a677fe640 1 -- 172.21.15.114:0/3914207763 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a740145a0 con 0x7f7a800cc840 2023-11-04T01:42:59.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.758+0000 7f7a677fe640 1 --2- 172.21.15.114:0/3914207763 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a6c06aea0 0x7f7a6c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.758+0000 7f7a677fe640 1 -- 172.21.15.114:0/3914207763 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f7a7408a6a0 con 0x7f7a800cc840 2023-11-04T01:42:59.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.758+0000 7f7a7effd640 1 --2- 172.21.15.114:0/3914207763 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a6c06aea0 0x7f7a6c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.759+0000 7f7a7effd640 1 --2- 172.21.15.114:0/3914207763 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a6c06aea0 0x7f7a6c06d360 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7a70034000 tx=0x7f7a70009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.762+0000 7f7a677fe640 1 -- 172.21.15.114:0/3914207763 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a74054f60 con 0x7f7a800cc840 2023-11-04T01:42:59.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.966+0000 7f7a855e7640 1 -- 172.21.15.114:0/3914207763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a80155b60 con 0x7f7a800cc840 2023-11-04T01:42:59.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.967+0000 7f7a677fe640 1 -- 172.21.15.114:0/3914207763 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f7a74058580 con 0x7f7a800cc840 2023-11-04T01:42:59.969 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:42:59.969 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:48.031237+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:42:59.969 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 93 2023-11-04T01:42:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.969+0000 7f7a855e7640 1 -- 172.21.15.114:0/3914207763 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a6c06aea0 msgr2=0x7f7a6c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.969+0000 7f7a855e7640 1 --2- 172.21.15.114:0/3914207763 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a6c06aea0 0x7f7a6c06d360 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7a70034000 tx=0x7f7a70009030 comp rx=0 tx=0).stop 2023-11-04T01:42:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.969+0000 7f7a855e7640 1 -- 172.21.15.114:0/3914207763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a800cc840 msgr2=0x7f7a8015f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.969+0000 7f7a855e7640 1 --2- 172.21.15.114:0/3914207763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a800cc840 0x7f7a8015f9a0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f7a740119a0 tx=0x7f7a74011e60 comp rx=0 tx=0).stop 2023-11-04T01:42:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.969+0000 7f7a855e7640 1 -- 172.21.15.114:0/3914207763 shutdown_connections 2023-11-04T01:42:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.969+0000 7f7a855e7640 1 --2- 172.21.15.114:0/3914207763 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7a8015fee0 0x7f7a801f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.969+0000 7f7a855e7640 1 --2- 172.21.15.114:0/3914207763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a800cc840 0x7f7a8015f9a0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.969+0000 7f7a855e7640 1 --2- 172.21.15.114:0/3914207763 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7a6c06aea0 0x7f7a6c06d360 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.969+0000 7f7a855e7640 1 --2- 172.21.15.114:0/3914207763 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7a68003b30 0x7f7a80152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.969+0000 7f7a855e7640 1 -- 172.21.15.114:0/3914207763 >> 172.21.15.114:0/3914207763 conn(0x7f7a800d2ef0 msgr2=0x7f7a800d0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.969+0000 7f7a855e7640 1 -- 172.21.15.114:0/3914207763 shutdown_connections 2023-11-04T01:42:59.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:42:59.969+0000 7f7a855e7640 1 -- 172.21.15.114:0/3914207763 wait complete. 2023-11-04T01:42:59.981 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:04.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2023-11-04T01:43:04.983 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:05.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.092+0000 7fb31274c640 1 Processor -- start 2023-11-04T01:43:05.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.092+0000 7fb31274c640 1 -- start start 2023-11-04T01:43:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.092+0000 7fb31274c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb30c15d100 0x7fb30c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.092+0000 7fb31274c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb30c15d4e0 0x7fb30c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.092+0000 7fb31274c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c0b32b0 con 0x7fb30c0d3b60 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.092+0000 7fb31274c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30c0cee10 con 0x7fb30c15d100 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.092+0000 7fb31274c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c0b4750 con 0x7fb30c15d4e0 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.093+0000 7fb30b7fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb30c15d4e0 0x7fb30c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.093+0000 7fb30bfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb30c15d100 0x7fb30c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.093+0000 7fb30bfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fb30c15d100 0x7fb30c0ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:39578/0 (socket says 172.21.15.114:39578) 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.093+0000 7fb30b7fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb30c15d4e0 0x7fb30c0d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:41334/0 (socket says 172.21.15.114:41334) 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.093+0000 7fb30bfff640 1 -- 172.21.15.114:0/3096915473 learned_addr learned my addr 172.21.15.114:0/3096915473 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.093+0000 7fb30b7fe640 1 -- 172.21.15.114:0/3096915473 >> v2:172.21.15.141:3300/0 conn(0x7fb30c15d100 msgr2=0x7fb30c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.093+0000 7fb30b7fe640 1 --2- 172.21.15.114:0/3096915473 >> v2:172.21.15.141:3300/0 conn(0x7fb30c15d100 0x7fb30c0ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.093+0000 7fb30b7fe640 1 -- 172.21.15.114:0/3096915473 >> v1:172.21.15.141:6789/0 conn(0x7fb30c0d3b60 legacy=0x7fb30c0cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.093+0000 7fb30b7fe640 1 -- 172.21.15.114:0/3096915473 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c0b2980 con 0x7fb30c15d4e0 2023-11-04T01:43:05.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.093+0000 7fb30bfff640 1 --2- 172.21.15.114:0/3096915473 >> v2:172.21.15.141:3300/0 conn(0x7fb30c15d100 0x7fb30c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:05.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.094+0000 7fb30b7fe640 1 --2- 172.21.15.114:0/3096915473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb30c15d4e0 0x7fb30c0d14d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb3000097a0 tx=0x7fb30002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acbd91a27054feda server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.094+0000 7fb30affd640 1 -- 172.21.15.114:0/3096915473 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300031830 con 0x7fb30c15d4e0 2023-11-04T01:43:05.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.094+0000 7fb30affd640 1 -- 172.21.15.114:0/3096915473 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb300031990 con 0x7fb30c15d4e0 2023-11-04T01:43:05.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.094+0000 7fb30affd640 1 -- 172.21.15.114:0/3096915473 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300031d20 con 0x7fb30c15d4e0 2023-11-04T01:43:05.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.095+0000 7fb31274c640 1 -- 172.21.15.114:0/3096915473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb30c15d4e0 msgr2=0x7fb30c0d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.095+0000 7fb31274c640 1 --2- 172.21.15.114:0/3096915473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb30c15d4e0 0x7fb30c0d14d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb3000097a0 tx=0x7fb30002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.095+0000 7fb31274c640 1 -- 172.21.15.114:0/3096915473 shutdown_connections 2023-11-04T01:43:05.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.095+0000 7fb31274c640 1 --2- 172.21.15.114:0/3096915473 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb30c15d4e0 0x7fb30c0d14d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.095+0000 7fb31274c640 1 --2- 172.21.15.114:0/3096915473 >> v2:172.21.15.141:3300/0 conn(0x7fb30c15d100 0x7fb30c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.095+0000 7fb31274c640 1 -- 172.21.15.114:0/3096915473 >> 172.21.15.114:0/3096915473 conn(0x7fb30c0d2ef0 msgr2=0x7fb30c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.095+0000 7fb31274c640 1 -- 172.21.15.114:0/3096915473 shutdown_connections 2023-11-04T01:43:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.095+0000 7fb31274c640 1 -- 172.21.15.114:0/3096915473 wait complete. 2023-11-04T01:43:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.096+0000 7fb31274c640 1 Processor -- start 2023-11-04T01:43:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.096+0000 7fb31274c640 1 -- start start 2023-11-04T01:43:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.097+0000 7fb31274c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb30c0d3b60 0x7fb30c0c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.097+0000 7fb31274c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb30c15d100 0x7fb30c149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.097+0000 7fb31274c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb30c15d4e0 0x7fb30c147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.097+0000 7fb31274c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c1600b0 con 0x7fb30c0d3b60 2023-11-04T01:43:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.097+0000 7fb31274c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c14a160 con 0x7fb30c15d4e0 2023-11-04T01:43:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.097+0000 7fb31274c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c1602f0 con 0x7fb30c15d100 2023-11-04T01:43:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.097+0000 7fb30bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb30c0d3b60 0x7fb30c0c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.097+0000 7fb30bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb30c0d3b60 0x7fb30c0c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46762/0 (socket says 172.21.15.114:46762) 2023-11-04T01:43:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.097+0000 7fb30bfff640 1 -- 172.21.15.114:0/972528554 learned_addr learned my addr 172.21.15.114:0/972528554 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.097+0000 7fb310ce9640 1 --2- 172.21.15.114:0/972528554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb30c15d4e0 0x7fb30c147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.097+0000 7fb30b7fe640 1 --2- 172.21.15.114:0/972528554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb30c15d100 0x7fb30c149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.098+0000 7fb30bfff640 1 -- 172.21.15.114:0/972528554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb30c15d100 msgr2=0x7fb30c149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.098+0000 7fb30bfff640 1 --2- 172.21.15.114:0/972528554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb30c15d100 0x7fb30c149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.098+0000 7fb30bfff640 1 -- 172.21.15.114:0/972528554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb30c15d4e0 msgr2=0x7fb30c147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.098+0000 7fb30bfff640 1 --2- 172.21.15.114:0/972528554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb30c15d4e0 0x7fb30c147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.098+0000 7fb30bfff640 1 -- 172.21.15.114:0/972528554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc009460 con 0x7fb30c0d3b60 2023-11-04T01:43:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.098+0000 7fb30bfff640 1 --2- 172.21.15.114:0/972528554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb30c0d3b60 0x7fb30c0c8ba0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00e9b0 tx=0x7fb2fc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.098+0000 7fb308ff9640 1 -- 172.21.15.114:0/972528554 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc00c9a0 con 0x7fb30c0d3b60 2023-11-04T01:43:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.098+0000 7fb308ff9640 1 -- 172.21.15.114:0/972528554 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc00cb00 con 0x7fb30c0d3b60 2023-11-04T01:43:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.098+0000 7fb31274c640 1 -- 172.21.15.114:0/972528554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb300009400 con 0x7fb30c0d3b60 2023-11-04T01:43:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.098+0000 7fb308ff9640 1 -- 172.21.15.114:0/972528554 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc00ce70 con 0x7fb30c0d3b60 2023-11-04T01:43:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.098+0000 7fb31274c640 1 -- 172.21.15.114:0/972528554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30c0cba80 con 0x7fb30c0d3b60 2023-11-04T01:43:05.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.099+0000 7fb31274c640 1 -- 172.21.15.114:0/972528554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30c0684b0 con 0x7fb30c0d3b60 2023-11-04T01:43:05.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.100+0000 7fb308ff9640 1 -- 172.21.15.114:0/972528554 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb2fc005990 con 0x7fb30c0d3b60 2023-11-04T01:43:05.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.100+0000 7fb308ff9640 1 --2- 172.21.15.114:0/972528554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2f806ae70 0x7fb2f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.100+0000 7fb30b7fe640 1 --2- 172.21.15.114:0/972528554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2f806ae70 0x7fb2f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.100+0000 7fb308ff9640 1 -- 172.21.15.114:0/972528554 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fb2fc08a140 con 0x7fb30c0d3b60 2023-11-04T01:43:05.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.101+0000 7fb30b7fe640 1 --2- 172.21.15.114:0/972528554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2f806ae70 0x7fb2f806d330 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb300036000 tx=0x7fb30003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.104+0000 7fb308ff9640 1 -- 172.21.15.114:0/972528554 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb2fc054b40 con 0x7fb30c0d3b60 2023-11-04T01:43:05.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.302+0000 7fb31274c640 1 -- 172.21.15.114:0/972528554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb30c0d2cd0 con 0x7fb30c0d3b60 2023-11-04T01:43:05.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.303+0000 7fb308ff9640 1 -- 172.21.15.114:0/972528554 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fb2fc020090 con 0x7fb30c0d3b60 2023-11-04T01:43:05.306 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:05.306 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:42:48.031237+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:05.306 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 93 2023-11-04T01:43:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.305+0000 7fb31274c640 1 -- 172.21.15.114:0/972528554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2f806ae70 msgr2=0x7fb2f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.305+0000 7fb31274c640 1 --2- 172.21.15.114:0/972528554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2f806ae70 0x7fb2f806d330 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb300036000 tx=0x7fb30003c040 comp rx=0 tx=0).stop 2023-11-04T01:43:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.305+0000 7fb31274c640 1 -- 172.21.15.114:0/972528554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb30c0d3b60 msgr2=0x7fb30c0c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.305+0000 7fb31274c640 1 --2- 172.21.15.114:0/972528554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb30c0d3b60 0x7fb30c0c8ba0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00e9b0 tx=0x7fb2fc00ee70 comp rx=0 tx=0).stop 2023-11-04T01:43:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.305+0000 7fb31274c640 1 -- 172.21.15.114:0/972528554 shutdown_connections 2023-11-04T01:43:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.305+0000 7fb31274c640 1 --2- 172.21.15.114:0/972528554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb2f806ae70 0x7fb2f806d330 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.305+0000 7fb31274c640 1 --2- 172.21.15.114:0/972528554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb30c15d4e0 0x7fb30c147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.305+0000 7fb31274c640 1 --2- 172.21.15.114:0/972528554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb30c15d100 0x7fb30c149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.305+0000 7fb31274c640 1 --2- 172.21.15.114:0/972528554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb30c0d3b60 0x7fb30c0c8ba0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.305+0000 7fb31274c640 1 -- 172.21.15.114:0/972528554 >> 172.21.15.114:0/972528554 conn(0x7fb30c0d2ef0 msgr2=0x7fb30c06bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.305+0000 7fb31274c640 1 -- 172.21.15.114:0/972528554 shutdown_connections 2023-11-04T01:43:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:05.305+0000 7fb31274c640 1 -- 172.21.15.114:0/972528554 wait complete. 2023-11-04T01:43:05.319 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:10.320 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:10.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.429+0000 7fd0e3644640 1 Processor -- start 2023-11-04T01:43:10.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.430+0000 7fd0e3644640 1 -- start start 2023-11-04T01:43:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.430+0000 7fd0e3644640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd0dc15d4e0 0x7fd0dc0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.430+0000 7fd0e3644640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc0d3b60 0x7fd0dc0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.430+0000 7fd0e3644640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0dc0b32b0 con 0x7fd0dc15d100 2023-11-04T01:43:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.430+0000 7fd0e3644640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0dc0cec20 con 0x7fd0dc15d4e0 2023-11-04T01:43:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.430+0000 7fd0e3644640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0cee10 con 0x7fd0dc0d3b60 2023-11-04T01:43:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.431+0000 7fd0e1be1640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc0d3b60 0x7fd0dc0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.431+0000 7fd0e0bdf640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd0dc15d4e0 0x7fd0dc0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.431+0000 7fd0e1be1640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc0d3b60 0x7fd0dc0d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:59022/0 (socket says 172.21.15.114:59022) 2023-11-04T01:43:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.431+0000 7fd0e1be1640 1 -- 172.21.15.114:0/4018212724 learned_addr learned my addr 172.21.15.114:0/4018212724 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.431+0000 7fd0e1be1640 1 -- 172.21.15.114:0/4018212724 >> v2:172.21.15.141:3300/0 conn(0x7fd0dc15d4e0 msgr2=0x7fd0dc0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.431+0000 7fd0e1be1640 1 --2- 172.21.15.114:0/4018212724 >> v2:172.21.15.141:3300/0 conn(0x7fd0dc15d4e0 0x7fd0dc0d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.431+0000 7fd0e1be1640 1 -- 172.21.15.114:0/4018212724 >> v1:172.21.15.141:6789/0 conn(0x7fd0dc15d100 legacy=0x7fd0dc0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.431+0000 7fd0e1be1640 1 -- 172.21.15.114:0/4018212724 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc0b4750 con 0x7fd0dc0d3b60 2023-11-04T01:43:10.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.432+0000 7fd0e1be1640 1 --2- 172.21.15.114:0/4018212724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc0d3b60 0x7fd0dc0d1a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009e50 tx=0x7fd0d402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7f39e3d3668b4b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.432+0000 7fd0d3fff640 1 -- 172.21.15.114:0/4018212724 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d402cb00 con 0x7fd0dc0d3b60 2023-11-04T01:43:10.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.432+0000 7fd0d3fff640 1 -- 172.21.15.114:0/4018212724 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d402cc60 con 0x7fd0dc0d3b60 2023-11-04T01:43:10.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.432+0000 7fd0d3fff640 1 -- 172.21.15.114:0/4018212724 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40343f0 con 0x7fd0dc0d3b60 2023-11-04T01:43:10.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.433+0000 7fd0e3644640 1 -- 172.21.15.114:0/4018212724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc0d3b60 msgr2=0x7fd0dc0d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.433+0000 7fd0e3644640 1 --2- 172.21.15.114:0/4018212724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc0d3b60 0x7fd0dc0d1a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009e50 tx=0x7fd0d402bf60 comp rx=0 tx=0).stop 2023-11-04T01:43:10.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.433+0000 7fd0e3644640 1 -- 172.21.15.114:0/4018212724 shutdown_connections 2023-11-04T01:43:10.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.433+0000 7fd0e3644640 1 --2- 172.21.15.114:0/4018212724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc0d3b60 0x7fd0dc0d1a10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.433+0000 7fd0e3644640 1 --2- 172.21.15.114:0/4018212724 >> v2:172.21.15.141:3300/0 conn(0x7fd0dc15d4e0 0x7fd0dc0d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.433+0000 7fd0e3644640 1 -- 172.21.15.114:0/4018212724 >> 172.21.15.114:0/4018212724 conn(0x7fd0dc0d2ef0 msgr2=0x7fd0dc0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.433+0000 7fd0e3644640 1 -- 172.21.15.114:0/4018212724 shutdown_connections 2023-11-04T01:43:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.433+0000 7fd0e3644640 1 -- 172.21.15.114:0/4018212724 wait complete. 2023-11-04T01:43:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.434+0000 7fd0e3644640 1 Processor -- start 2023-11-04T01:43:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.434+0000 7fd0e3644640 1 -- start start 2023-11-04T01:43:10.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.435+0000 7fd0e3644640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd0dc0d3b60 0x7fd0dc1f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.435+0000 7fd0e3644640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc15d100 0x7fd0dc0b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.435+0000 7fd0e3644640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc15d4e0 0x7fd0dc15a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.435+0000 7fd0e3644640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0cc530 con 0x7fd0dc15d4e0 2023-11-04T01:43:10.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.435+0000 7fd0e3644640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0b0fa0 con 0x7fd0dc0d3b60 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.435+0000 7fd0e3644640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0cc7b0 con 0x7fd0dc15d100 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.435+0000 7fd0e1be1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc15d4e0 0x7fd0dc15a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.435+0000 7fd0e1be1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc15d4e0 0x7fd0dc15a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35846/0 (socket says 172.21.15.114:35846) 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.435+0000 7fd0e1be1640 1 -- 172.21.15.114:0/1930455221 learned_addr learned my addr 172.21.15.114:0/1930455221 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.435+0000 7fd0e0bdf640 1 --2- 172.21.15.114:0/1930455221 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc15d100 0x7fd0dc0b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.435+0000 7fd0e13e0640 1 --2- 172.21.15.114:0/1930455221 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd0dc0d3b60 0x7fd0dc1f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.436+0000 7fd0e1be1640 1 -- 172.21.15.114:0/1930455221 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc15d100 msgr2=0x7fd0dc0b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.436+0000 7fd0e1be1640 1 --2- 172.21.15.114:0/1930455221 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc15d100 0x7fd0dc0b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.436+0000 7fd0e1be1640 1 -- 172.21.15.114:0/1930455221 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd0dc0d3b60 msgr2=0x7fd0dc1f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.436+0000 7fd0e1be1640 1 --2- 172.21.15.114:0/1930455221 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd0dc0d3b60 0x7fd0dc1f21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.436+0000 7fd0e1be1640 1 -- 172.21.15.114:0/1930455221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d4009b30 con 0x7fd0dc15d4e0 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.436+0000 7fd0e13e0640 1 --2- 172.21.15.114:0/1930455221 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd0dc0d3b60 0x7fd0dc1f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:10.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.436+0000 7fd0e1be1640 1 --2- 172.21.15.114:0/1930455221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc15d4e0 0x7fd0dc15a510 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4036040 tx=0x7fd0d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.436+0000 7fd0d1ffb640 1 -- 172.21.15.114:0/1930455221 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4009510 con 0x7fd0dc15d4e0 2023-11-04T01:43:10.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.436+0000 7fd0d1ffb640 1 -- 172.21.15.114:0/1930455221 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d403e450 con 0x7fd0dc15d4e0 2023-11-04T01:43:10.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.436+0000 7fd0e3644640 1 -- 172.21.15.114:0/1930455221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc0cca90 con 0x7fd0dc15d4e0 2023-11-04T01:43:10.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.436+0000 7fd0d1ffb640 1 -- 172.21.15.114:0/1930455221 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d403e820 con 0x7fd0dc15d4e0 2023-11-04T01:43:10.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.436+0000 7fd0e3644640 1 -- 172.21.15.114:0/1930455221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc0b0c00 con 0x7fd0dc15d4e0 2023-11-04T01:43:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.437+0000 7fd0e3644640 1 -- 172.21.15.114:0/1930455221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc0ccfb0 con 0x7fd0dc15d4e0 2023-11-04T01:43:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.438+0000 7fd0d1ffb640 1 -- 172.21.15.114:0/1930455221 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0d403e980 con 0x7fd0dc15d4e0 2023-11-04T01:43:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.438+0000 7fd0d1ffb640 1 --2- 172.21.15.114:0/1930455221 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd0c006ae70 0x7fd0c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.438+0000 7fd0d1ffb640 1 -- 172.21.15.114:0/1930455221 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fd0d40ac9e0 con 0x7fd0dc15d4e0 2023-11-04T01:43:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.438+0000 7fd0e13e0640 1 --2- 172.21.15.114:0/1930455221 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd0c006ae70 0x7fd0c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.439+0000 7fd0e13e0640 1 --2- 172.21.15.114:0/1930455221 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd0c006ae70 0x7fd0c006d330 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8001730 tx=0x7fd0d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.443+0000 7fd0d1ffb640 1 -- 172.21.15.114:0/1930455221 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd0dc0ccfb0 con 0x7fd0dc15d4e0 2023-11-04T01:43:10.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.644+0000 7fd0e3644640 1 -- 172.21.15.114:0/1930455221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0dc0ccfb0 con 0x7fd0dc15d4e0 2023-11-04T01:43:10.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.645+0000 7fd0d1ffb640 1 -- 172.21.15.114:0/1930455221 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4989 (secure 0 0 0) 0x7fd0dc0ccfb0 con 0x7fd0dc15d4e0 2023-11-04T01:43:10.647 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:10.647 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:05.610940+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:43:05.610940+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 94 2023-11-04T01:43:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.647+0000 7fd0e3644640 1 -- 172.21.15.114:0/1930455221 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd0c006ae70 msgr2=0x7fd0c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.647+0000 7fd0e3644640 1 --2- 172.21.15.114:0/1930455221 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd0c006ae70 0x7fd0c006d330 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8001730 tx=0x7fd0d8009040 comp rx=0 tx=0).stop 2023-11-04T01:43:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.647+0000 7fd0e3644640 1 -- 172.21.15.114:0/1930455221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc15d4e0 msgr2=0x7fd0dc15a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.647+0000 7fd0e3644640 1 --2- 172.21.15.114:0/1930455221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc15d4e0 0x7fd0dc15a510 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4036040 tx=0x7fd0d4004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.647+0000 7fd0e3644640 1 -- 172.21.15.114:0/1930455221 shutdown_connections 2023-11-04T01:43:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.647+0000 7fd0e3644640 1 --2- 172.21.15.114:0/1930455221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc15d4e0 0x7fd0dc15a510 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.647+0000 7fd0e3644640 1 --2- 172.21.15.114:0/1930455221 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd0dc15d100 0x7fd0dc0b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.647+0000 7fd0e3644640 1 --2- 172.21.15.114:0/1930455221 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd0c006ae70 0x7fd0c006d330 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.647+0000 7fd0e3644640 1 --2- 172.21.15.114:0/1930455221 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd0dc0d3b60 0x7fd0dc1f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.647+0000 7fd0e3644640 1 -- 172.21.15.114:0/1930455221 >> 172.21.15.114:0/1930455221 conn(0x7fd0dc0d2ef0 msgr2=0x7fd0dc0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.647+0000 7fd0e3644640 1 -- 172.21.15.114:0/1930455221 shutdown_connections 2023-11-04T01:43:10.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.647+0000 7fd0e3644640 1 -- 172.21.15.114:0/1930455221 wait complete. 2023-11-04T01:43:10.659 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-11-04T01:43:10.659 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:43:10.685 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:43:10.686 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:43:10.686 DEBUG:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:43:10.755 INFO:teuthology.orchestra.run.smithi114.stdout:1699062168.121675.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:43:10.757 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062168.121675.core'] 2023-11-04T01:43:10.757 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062168.121675.core, deleting it 2023-11-04T01:43:10.758 DEBUG:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062168.121675.core 2023-11-04T01:43:10.828 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:10.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.965+0000 7fa8a3089640 1 Processor -- start 2023-11-04T01:43:10.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.965+0000 7fa8a3089640 1 -- start start 2023-11-04T01:43:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.966+0000 7fa8a3089640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa89c0addd0 0x7fa89c0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.966+0000 7fa8a3089640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fa89c0cc680 0x7fa89c0ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.966+0000 7fa8a3089640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa89c06bb10 0x7fa89c06bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.966+0000 7fa8a3089640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa89c06c4c0 con 0x7fa89c06bb10 2023-11-04T01:43:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.966+0000 7fa8a3089640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa89c0cd720 con 0x7fa89c0cc680 2023-11-04T01:43:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.966+0000 7fa8a3089640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0ae1b0 con 0x7fa89c0addd0 2023-11-04T01:43:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.966+0000 7fa8a1626640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa89c06bb10 0x7fa89c06bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.966+0000 7fa8a1626640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa89c06bb10 0x7fa89c06bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35862/0 (socket says 172.21.15.114:35862) 2023-11-04T01:43:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.966+0000 7fa8a1626640 1 -- 172.21.15.114:0/2757470296 learned_addr learned my addr 172.21.15.114:0/2757470296 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.966+0000 7fa89bfff640 1 --2- 172.21.15.114:0/2757470296 >> v2:172.21.15.141:3300/0 conn(0x7fa89c0cc680 0x7fa89c0ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.966+0000 7fa8a0e25640 1 --2- 172.21.15.114:0/2757470296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa89c0addd0 0x7fa89c0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.966+0000 7fa8a1626640 1 -- 172.21.15.114:0/2757470296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa89c0addd0 msgr2=0x7fa89c0cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.966+0000 7fa8a1626640 1 --2- 172.21.15.114:0/2757470296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa89c0addd0 0x7fa89c0cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.966+0000 7fa8a1626640 1 -- 172.21.15.114:0/2757470296 >> v2:172.21.15.141:3300/0 conn(0x7fa89c0cc680 msgr2=0x7fa89c0ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.966+0000 7fa8a1626640 1 --2- 172.21.15.114:0/2757470296 >> v2:172.21.15.141:3300/0 conn(0x7fa89c0cc680 0x7fa89c0ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.966+0000 7fa8a1626640 1 -- 172.21.15.114:0/2757470296 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c0ccb10 con 0x7fa89c06bb10 2023-11-04T01:43:10.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.967+0000 7fa8a1626640 1 --2- 172.21.15.114:0/2757470296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa89c06bb10 0x7fa89c06bf80 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0cc2b0 tx=0x7fa89402cfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0724838bc013022 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.967+0000 7fa89b7fe640 1 -- 172.21.15.114:0/2757470296 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89402d980 con 0x7fa89c06bb10 2023-11-04T01:43:10.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.967+0000 7fa89b7fe640 1 -- 172.21.15.114:0/2757470296 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89402dae0 con 0x7fa89c06bb10 2023-11-04T01:43:10.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.967+0000 7fa89b7fe640 1 -- 172.21.15.114:0/2757470296 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89402de70 con 0x7fa89c06bb10 2023-11-04T01:43:10.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.968+0000 7fa8a3089640 1 -- 172.21.15.114:0/2757470296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa89c06bb10 msgr2=0x7fa89c06bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.968+0000 7fa8a3089640 1 --2- 172.21.15.114:0/2757470296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa89c06bb10 0x7fa89c06bf80 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0cc2b0 tx=0x7fa89402cfe0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.968+0000 7fa8a3089640 1 -- 172.21.15.114:0/2757470296 shutdown_connections 2023-11-04T01:43:10.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.968+0000 7fa8a3089640 1 --2- 172.21.15.114:0/2757470296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa89c06bb10 0x7fa89c06bf80 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.968+0000 7fa8a3089640 1 --2- 172.21.15.114:0/2757470296 >> v2:172.21.15.141:3300/0 conn(0x7fa89c0cc680 0x7fa89c0ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.968+0000 7fa8a3089640 1 --2- 172.21.15.114:0/2757470296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa89c0addd0 0x7fa89c0cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.968+0000 7fa8a3089640 1 -- 172.21.15.114:0/2757470296 >> 172.21.15.114:0/2757470296 conn(0x7fa89c0cb530 msgr2=0x7fa89c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.968+0000 7fa8a3089640 1 -- 172.21.15.114:0/2757470296 shutdown_connections 2023-11-04T01:43:10.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.968+0000 7fa8a3089640 1 -- 172.21.15.114:0/2757470296 wait complete. 2023-11-04T01:43:10.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.969+0000 7fa8a3089640 1 Processor -- start 2023-11-04T01:43:10.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.969+0000 7fa8a3089640 1 -- start start 2023-11-04T01:43:10.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8a3089640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa89c06bb10 0x7fa89c1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8a3089640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa89c0addd0 0x7fa89c0c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8a3089640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa89c15b210 0x7fa89c0c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8a3089640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c158920 con 0x7fa89c15b210 2023-11-04T01:43:10.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8a3089640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0c7cc0 con 0x7fa89c0addd0 2023-11-04T01:43:10.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8a3089640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c15a450 con 0x7fa89c06bb10 2023-11-04T01:43:10.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8a1626640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa89c15b210 0x7fa89c0c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8a1626640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa89c15b210 0x7fa89c0c4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35864/0 (socket says 172.21.15.114:35864) 2023-11-04T01:43:10.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8a1626640 1 -- 172.21.15.114:0/4072188255 learned_addr learned my addr 172.21.15.114:0/4072188255 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:10.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8a0e25640 1 --2- 172.21.15.114:0/4072188255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa89c06bb10 0x7fa89c1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa89bfff640 1 --2- 172.21.15.114:0/4072188255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa89c0addd0 0x7fa89c0c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8a1626640 1 -- 172.21.15.114:0/4072188255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa89c06bb10 msgr2=0x7fa89c1583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8a1626640 1 --2- 172.21.15.114:0/4072188255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa89c06bb10 0x7fa89c1583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8a1626640 1 -- 172.21.15.114:0/4072188255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa89c0addd0 msgr2=0x7fa89c0c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8a1626640 1 --2- 172.21.15.114:0/4072188255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa89c0addd0 0x7fa89c0c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8a1626640 1 -- 172.21.15.114:0/4072188255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89400ac40 con 0x7fa89c15b210 2023-11-04T01:43:10.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa89bfff640 1 --2- 172.21.15.114:0/4072188255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa89c0addd0 0x7fa89c0c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:10.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8a1626640 1 --2- 172.21.15.114:0/4072188255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa89c15b210 0x7fa89c0c4790 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fa89402d020 tx=0x7fa894004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.970+0000 7fa8997fa640 1 -- 172.21.15.114:0/4072188255 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894009cd0 con 0x7fa89c15b210 2023-11-04T01:43:10.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.971+0000 7fa8997fa640 1 -- 172.21.15.114:0/4072188255 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa894009e30 con 0x7fa89c15b210 2023-11-04T01:43:10.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.971+0000 7fa8a3089640 1 -- 172.21.15.114:0/4072188255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89c15a730 con 0x7fa89c15b210 2023-11-04T01:43:10.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.971+0000 7fa8997fa640 1 -- 172.21.15.114:0/4072188255 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8940406b0 con 0x7fa89c15b210 2023-11-04T01:43:10.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.971+0000 7fa8a3089640 1 -- 172.21.15.114:0/4072188255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89c15acf0 con 0x7fa89c15b210 2023-11-04T01:43:10.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.971+0000 7fa8a3089640 1 -- 172.21.15.114:0/4072188255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89c15a590 con 0x7fa89c15b210 2023-11-04T01:43:10.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.972+0000 7fa8997fa640 1 -- 172.21.15.114:0/4072188255 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa894040810 con 0x7fa89c15b210 2023-11-04T01:43:10.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.972+0000 7fa8997fa640 1 --2- 172.21.15.114:0/4072188255 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa88806aea0 0x7fa88806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.972+0000 7fa8a0e25640 1 --2- 172.21.15.114:0/4072188255 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa88806aea0 0x7fa88806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.972+0000 7fa8997fa640 1 -- 172.21.15.114:0/4072188255 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fa8940acda0 con 0x7fa89c15b210 2023-11-04T01:43:10.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.973+0000 7fa8a0e25640 1 --2- 172.21.15.114:0/4072188255 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa88806aea0 0x7fa88806d360 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa88c006fd0 tx=0x7fa88c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:10.977+0000 7fa8997fa640 1 -- 172.21.15.114:0/4072188255 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa89c15a590 con 0x7fa89c15b210 2023-11-04T01:43:11.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.178+0000 7fa8a3089640 1 -- 172.21.15.114:0/4072188255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa89c15a590 con 0x7fa89c15b210 2023-11-04T01:43:11.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.179+0000 7fa8997fa640 1 -- 172.21.15.114:0/4072188255 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4989 (secure 0 0 0) 0x7fa89c15a590 con 0x7fa89c15b210 2023-11-04T01:43:11.180 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:11.181 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:05.610940+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8133,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":16,"addr":"172.21.15.114:6837/3825479201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825479201},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825479201}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:43:05.610940+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:11.181 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 94 2023-11-04T01:43:11.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.180+0000 7fa8a3089640 1 -- 172.21.15.114:0/4072188255 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa88806aea0 msgr2=0x7fa88806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.180+0000 7fa8a3089640 1 --2- 172.21.15.114:0/4072188255 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa88806aea0 0x7fa88806d360 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa88c006fd0 tx=0x7fa88c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:11.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.180+0000 7fa8a3089640 1 -- 172.21.15.114:0/4072188255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa89c15b210 msgr2=0x7fa89c0c4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.180+0000 7fa8a3089640 1 --2- 172.21.15.114:0/4072188255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa89c15b210 0x7fa89c0c4790 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fa89402d020 tx=0x7fa894004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:11.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.181+0000 7fa8a3089640 1 -- 172.21.15.114:0/4072188255 shutdown_connections 2023-11-04T01:43:11.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.181+0000 7fa8a3089640 1 --2- 172.21.15.114:0/4072188255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa89c15b210 0x7fa89c0c4790 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.181+0000 7fa8a3089640 1 --2- 172.21.15.114:0/4072188255 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa88806aea0 0x7fa88806d360 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.181+0000 7fa8a3089640 1 --2- 172.21.15.114:0/4072188255 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa89c0addd0 0x7fa89c0c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.181+0000 7fa8a3089640 1 --2- 172.21.15.114:0/4072188255 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa89c06bb10 0x7fa89c1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.181+0000 7fa8a3089640 1 -- 172.21.15.114:0/4072188255 >> 172.21.15.114:0/4072188255 conn(0x7fa89c0cb530 msgr2=0x7fa89c0afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.181+0000 7fa8a3089640 1 -- 172.21.15.114:0/4072188255 shutdown_connections 2023-11-04T01:43:11.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.181+0000 7fa8a3089640 1 -- 172.21.15.114:0/4072188255 wait complete. 2023-11-04T01:43:11.193 INFO:tasks.ceph.mds.c:Sent signal 9 2023-11-04T01:43:11.194 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:11.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:11.194 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 down 2023-11-04T01:43:11.221 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:43:11.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.365+0000 7f93a06e5640 1 Processor -- start 2023-11-04T01:43:11.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.365+0000 7f93a06e5640 1 -- start start 2023-11-04T01:43:11.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.366+0000 7f93a06e5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9398159e40 0x7f93980b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.366+0000 7f93a06e5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f939806bb60 0x7f93980b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.366+0000 7f93a06e5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9398071500 con 0x7f939806fff0 2023-11-04T01:43:11.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.366+0000 7f93a06e5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939815dae0 con 0x7f939806bb60 2023-11-04T01:43:11.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.366+0000 7f93a06e5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9398070c60 con 0x7f9398159e40 2023-11-04T01:43:11.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.366+0000 7f939dc80640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f939806bb60 0x7f93980b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.366+0000 7f939dc80640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f939806bb60 0x7f93980b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35868/0 (socket says 172.21.15.114:35868) 2023-11-04T01:43:11.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.366+0000 7f939ec82640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f939806fff0 0x7f9398070480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:36766/0 (socket says 172.21.15.114:36766) 2023-11-04T01:43:11.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.366+0000 7f939dc80640 1 -- 172.21.15.114:0/558394783 learned_addr learned my addr 172.21.15.114:0/558394783 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:11.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.366+0000 7f939e481640 1 --2- 172.21.15.114:0/558394783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9398159e40 0x7f93980b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.366+0000 7f939dc80640 1 -- 172.21.15.114:0/558394783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9398159e40 msgr2=0x7f93980b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.366+0000 7f939dc80640 1 --2- 172.21.15.114:0/558394783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9398159e40 0x7f93980b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.366+0000 7f939dc80640 1 -- 172.21.15.114:0/558394783 >> v1:172.21.15.114:6789/0 conn(0x7f939806fff0 legacy=0x7f9398070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.366+0000 7f939dc80640 1 -- 172.21.15.114:0/558394783 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9398070f40 con 0x7f939806bb60 2023-11-04T01:43:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.366+0000 7f939e481640 1 --2- 172.21.15.114:0/558394783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9398159e40 0x7f93980b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.367+0000 7f939dc80640 1 --2- 172.21.15.114:0/558394783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f939806bb60 0x7f93980b0a70 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f9388009870 tx=0x7f938802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f60bfcb9456667 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.367+0000 7f939d47f640 1 -- 172.21.15.114:0/558394783 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388031640 con 0x7f939806bb60 2023-11-04T01:43:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.367+0000 7f939d47f640 1 -- 172.21.15.114:0/558394783 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93880317a0 con 0x7f939806bb60 2023-11-04T01:43:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.367+0000 7f939d47f640 1 -- 172.21.15.114:0/558394783 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388031b30 con 0x7f939806bb60 2023-11-04T01:43:11.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.367+0000 7f93a06e5640 1 -- 172.21.15.114:0/558394783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f939806bb60 msgr2=0x7f93980b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.368+0000 7f93a06e5640 1 --2- 172.21.15.114:0/558394783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f939806bb60 0x7f93980b0a70 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f9388009870 tx=0x7f938802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.368+0000 7f93a06e5640 1 -- 172.21.15.114:0/558394783 shutdown_connections 2023-11-04T01:43:11.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.368+0000 7f93a06e5640 1 --2- 172.21.15.114:0/558394783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f939806bb60 0x7f93980b0a70 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.368+0000 7f93a06e5640 1 --2- 172.21.15.114:0/558394783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9398159e40 0x7f93980b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.368+0000 7f93a06e5640 1 -- 172.21.15.114:0/558394783 >> 172.21.15.114:0/558394783 conn(0x7f93980cb530 msgr2=0x7f93980cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.368+0000 7f93a06e5640 1 -- 172.21.15.114:0/558394783 shutdown_connections 2023-11-04T01:43:11.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.368+0000 7f93a06e5640 1 -- 172.21.15.114:0/558394783 wait complete. 2023-11-04T01:43:11.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.369+0000 7f93a06e5640 1 Processor -- start 2023-11-04T01:43:11.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.369+0000 7f93a06e5640 1 -- start start 2023-11-04T01:43:11.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f93a06e5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f939806bb60 0x7f93981f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f93a06e5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f939806fff0 0x7f93980c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f93a06e5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9398159e40 0x7f93980a8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f93a06e5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93981f47b0 con 0x7f9398159e40 2023-11-04T01:43:11.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f93a06e5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93980c5f40 con 0x7f939806fff0 2023-11-04T01:43:11.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f93a06e5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93980c6220 con 0x7f939806bb60 2023-11-04T01:43:11.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f939ec82640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9398159e40 0x7f93980a8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f939ec82640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9398159e40 0x7f93980a8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35880/0 (socket says 172.21.15.114:35880) 2023-11-04T01:43:11.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f939ec82640 1 -- 172.21.15.114:0/1281200215 learned_addr learned my addr 172.21.15.114:0/1281200215 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:11.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f939dc80640 1 --2- 172.21.15.114:0/1281200215 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f939806fff0 0x7f93980c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f939e481640 1 --2- 172.21.15.114:0/1281200215 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f939806bb60 0x7f93981f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f939ec82640 1 -- 172.21.15.114:0/1281200215 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f939806bb60 msgr2=0x7f93981f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f939ec82640 1 --2- 172.21.15.114:0/1281200215 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f939806bb60 0x7f93981f4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f939ec82640 1 -- 172.21.15.114:0/1281200215 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f939806fff0 msgr2=0x7f93980c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f939ec82640 1 --2- 172.21.15.114:0/1281200215 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f939806fff0 0x7f93980c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f939ec82640 1 -- 172.21.15.114:0/1281200215 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93880094d0 con 0x7f9398159e40 2023-11-04T01:43:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f939ec82640 1 --2- 172.21.15.114:0/1281200215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9398159e40 0x7f93980a8bb0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f939000c7a0 tx=0x7f939000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f938effd640 1 -- 172.21.15.114:0/1281200215 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939000a640 con 0x7f9398159e40 2023-11-04T01:43:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f938effd640 1 -- 172.21.15.114:0/1281200215 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939000a7a0 con 0x7f9398159e40 2023-11-04T01:43:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f938effd640 1 -- 172.21.15.114:0/1281200215 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939000ab10 con 0x7f9398159e40 2023-11-04T01:43:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f93a06e5640 1 -- 172.21.15.114:0/1281200215 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93980c6500 con 0x7f9398159e40 2023-11-04T01:43:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.370+0000 7f93a06e5640 1 -- 172.21.15.114:0/1281200215 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93980c58e0 con 0x7f9398159e40 2023-11-04T01:43:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.371+0000 7f93a06e5640 1 -- 172.21.15.114:0/1281200215 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93980684b0 con 0x7f9398159e40 2023-11-04T01:43:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.372+0000 7f938effd640 1 -- 172.21.15.114:0/1281200215 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f939000ac70 con 0x7f9398159e40 2023-11-04T01:43:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.372+0000 7f938effd640 1 --2- 172.21.15.114:0/1281200215 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f937c06aea0 0x7f937c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.372+0000 7f938effd640 1 -- 172.21.15.114:0/1281200215 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f9390089420 con 0x7f9398159e40 2023-11-04T01:43:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.372+0000 7f939e481640 1 --2- 172.21.15.114:0/1281200215 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f937c06aea0 0x7f937c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.372+0000 7f939e481640 1 --2- 172.21.15.114:0/1281200215 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f937c06aea0 0x7f937c06d360 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f939400a950 tx=0x7f9394008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.376+0000 7f938effd640 1 -- 172.21.15.114:0/1281200215 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9390053e20 con 0x7f9398159e40 2023-11-04T01:43:11.394 INFO:tasks.ceph.mds.c.smithi114.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:43:11.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2023-11-04T01:43:11.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.610+0000 7f93a06e5640 1 -- 172.21.15.114:0/1281200215 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f93980c9750 con 0x7f9398159e40 2023-11-04T01:43:11.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.612+0000 7f938effd640 1 -- 172.21.15.114:0/1281200215 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 8133 v95) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9390057440 con 0x7f9398159e40 2023-11-04T01:43:11.614 INFO:teuthology.orchestra.run.smithi114.stderr:failed mds gid 8133 2023-11-04T01:43:11.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.615+0000 7f93a06e5640 1 -- 172.21.15.114:0/1281200215 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f937c06aea0 msgr2=0x7f937c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.615+0000 7f93a06e5640 1 --2- 172.21.15.114:0/1281200215 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f937c06aea0 0x7f937c06d360 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f939400a950 tx=0x7f9394008040 comp rx=0 tx=0).stop 2023-11-04T01:43:11.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.615+0000 7f93a06e5640 1 -- 172.21.15.114:0/1281200215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9398159e40 msgr2=0x7f93980a8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.615+0000 7f93a06e5640 1 --2- 172.21.15.114:0/1281200215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9398159e40 0x7f93980a8bb0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f939000c7a0 tx=0x7f939000cc60 comp rx=0 tx=0).stop 2023-11-04T01:43:11.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.615+0000 7f93a06e5640 1 -- 172.21.15.114:0/1281200215 shutdown_connections 2023-11-04T01:43:11.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.615+0000 7f93a06e5640 1 --2- 172.21.15.114:0/1281200215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9398159e40 0x7f93980a8bb0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.615+0000 7f93a06e5640 1 --2- 172.21.15.114:0/1281200215 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f937c06aea0 0x7f937c06d360 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.615+0000 7f93a06e5640 1 --2- 172.21.15.114:0/1281200215 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f939806fff0 0x7f93980c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.615+0000 7f93a06e5640 1 --2- 172.21.15.114:0/1281200215 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f939806bb60 0x7f93981f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.615+0000 7f93a06e5640 1 -- 172.21.15.114:0/1281200215 >> 172.21.15.114:0/1281200215 conn(0x7f93980cb530 msgr2=0x7f939815cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.615+0000 7f93a06e5640 1 -- 172.21.15.114:0/1281200215 shutdown_connections 2023-11-04T01:43:11.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.615+0000 7f93a06e5640 1 -- 172.21.15.114:0/1281200215 wait complete. 2023-11-04T01:43:11.629 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:43:11.629 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:43:11.629 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:43:11.630 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:11.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:43:11.630 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:43:11.630 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:43:11.630 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:43:11.632 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:43:11.633 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:11.707 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2023-11-04T01:43:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.732+0000 7ff63b125640 1 Processor -- start 2023-11-04T01:43:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.732+0000 7ff63b125640 1 -- start start 2023-11-04T01:43:11.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.733+0000 7ff63b125640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff63415d100 0x7ff6340ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.733+0000 7ff63b125640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6340b32b0 con 0x7ff6340d1be0 2023-11-04T01:43:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.733+0000 7ff63b125640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6340cee10 con 0x7ff63415d4e0 2023-11-04T01:43:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.733+0000 7ff63b125640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6340b2980 con 0x7ff63415d100 2023-11-04T01:43:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.733+0000 7ff6396c2640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff6340d1be0 0x7ff6340b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:36778/0 (socket says 172.21.15.114:36778) 2023-11-04T01:43:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.733+0000 7ff6396c2640 1 -- 172.21.15.114:0/4108917382 learned_addr learned my addr 172.21.15.114:0/4108917382 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:43:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.733+0000 7ff638ec1640 1 --2- 172.21.15.114:0/4108917382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff63415d100 0x7ff6340ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.733+0000 7ff6337fe640 1 -- 172.21.15.114:0/4108917382 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264731062 0 0) 0x7ff6340b32b0 con 0x7ff6340d1be0 2023-11-04T01:43:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.733+0000 7ff6337fe640 1 -- 172.21.15.114:0/4108917382 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff624003520 con 0x7ff6340d1be0 2023-11-04T01:43:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.733+0000 7ff6337fe640 1 -- 172.21.15.114:0/4108917382 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 685930076 0 0) 0x7ff624003520 con 0x7ff6340d1be0 2023-11-04T01:43:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.733+0000 7ff6337fe640 1 -- 172.21.15.114:0/4108917382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff63415d100 msgr2=0x7ff6340ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.733+0000 7ff6337fe640 1 --2- 172.21.15.114:0/4108917382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff63415d100 0x7ff6340ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.733+0000 7ff6337fe640 1 -- 172.21.15.114:0/4108917382 >> v1:172.21.15.141:6789/0 conn(0x7ff63415d4e0 legacy=0x7ff6340d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.733+0000 7ff6337fe640 1 -- 172.21.15.114:0/4108917382 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6340b2c60 con 0x7ff6340d1be0 2023-11-04T01:43:11.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.733+0000 7ff6337fe640 1 -- 172.21.15.114:0/4108917382 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7ff62c0019f0 con 0x7ff6340d1be0 2023-11-04T01:43:11.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.733+0000 7ff6337fe640 1 -- 172.21.15.114:0/4108917382 >> v1:172.21.15.114:6789/0 conn(0x7ff6340d1be0 legacy=0x7ff6340b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.734+0000 7ff6337fe640 1 --2- 172.21.15.114:0/4108917382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6240039a0 0x7ff624003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.734+0000 7ff6337fe640 1 --2- 172.21.15.114:0/4108917382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff63415d100 0x7ff6240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.734+0000 7ff6337fe640 1 --2- 172.21.15.114:0/4108917382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff624004d00 0x7ff624005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.734+0000 7ff6337fe640 1 -- 172.21.15.114:0/4108917382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6340b2980 con 0x7ff6240039a0 2023-11-04T01:43:11.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.734+0000 7ff6337fe640 1 -- 172.21.15.114:0/4108917382 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62400ba30 con 0x7ff624004d00 2023-11-04T01:43:11.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.734+0000 7ff6337fe640 1 -- 172.21.15.114:0/4108917382 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62400bbf0 con 0x7ff63415d100 2023-11-04T01:43:11.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.734+0000 7ff638ec1640 1 --2- 172.21.15.114:0/4108917382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6240039a0 0x7ff624003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.734+0000 7ff633fff640 1 --2- 172.21.15.114:0/4108917382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff63415d100 0x7ff6240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.734+0000 7ff6396c2640 1 --2- 172.21.15.114:0/4108917382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff624004d00 0x7ff624005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.734+0000 7ff638ec1640 1 -- 172.21.15.114:0/4108917382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff63415d100 msgr2=0x7ff6240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.734+0000 7ff638ec1640 1 --2- 172.21.15.114:0/4108917382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff63415d100 0x7ff6240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.734+0000 7ff638ec1640 1 -- 172.21.15.114:0/4108917382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff624004d00 msgr2=0x7ff624005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.734+0000 7ff638ec1640 1 --2- 172.21.15.114:0/4108917382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff624004d00 0x7ff624005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.734+0000 7ff638ec1640 1 -- 172.21.15.114:0/4108917382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff624003520 con 0x7ff6240039a0 2023-11-04T01:43:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.735+0000 7ff638ec1640 1 --2- 172.21.15.114:0/4108917382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6240039a0 0x7ff624003dc0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7ff628009a80 tx=0x7ff6240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9feab04757026 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.735+0000 7ff6337fe640 1 -- 172.21.15.114:0/4108917382 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628005990 con 0x7ff6240039a0 2023-11-04T01:43:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.735+0000 7ff6337fe640 1 -- 172.21.15.114:0/4108917382 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff628005af0 con 0x7ff6240039a0 2023-11-04T01:43:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.735+0000 7ff6337fe640 1 -- 172.21.15.114:0/4108917382 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628005ea0 con 0x7ff6240039a0 2023-11-04T01:43:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.735+0000 7ff63b125640 1 -- 172.21.15.114:0/4108917382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6240039a0 msgr2=0x7ff624003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.735+0000 7ff63b125640 1 --2- 172.21.15.114:0/4108917382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6240039a0 0x7ff624003dc0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7ff628009a80 tx=0x7ff6240057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.735+0000 7ff6396c2640 1 -- 172.21.15.114:0/4108917382 reap_dead start 2023-11-04T01:43:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.735+0000 7ff63b125640 1 -- 172.21.15.114:0/4108917382 shutdown_connections 2023-11-04T01:43:11.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.735+0000 7ff63b125640 1 -- 172.21.15.114:0/4108917382 >> 172.21.15.114:0/4108917382 conn(0x7ff6340d2ef0 msgr2=0x7ff6340d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.735+0000 7ff63b125640 1 -- 172.21.15.114:0/4108917382 shutdown_connections 2023-11-04T01:43:11.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.735+0000 7ff63b125640 1 -- 172.21.15.114:0/4108917382 wait complete. 2023-11-04T01:43:11.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.736+0000 7ff63b125640 1 Processor -- start 2023-11-04T01:43:11.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.737+0000 7ff63b125640 1 -- start start 2023-11-04T01:43:11.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.737+0000 7ff63b125640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6240039a0 0x7ff6341f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.737+0000 7ff63b125640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6341f2630 0x7ff6340cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.737+0000 7ff63b125640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6340ccd10 0x7ff6340ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.737+0000 7ff63b125640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63415f820 con 0x7ff6341f2630 2023-11-04T01:43:11.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.737+0000 7ff63b125640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63415fb00 con 0x7ff6240039a0 2023-11-04T01:43:11.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.737+0000 7ff63b125640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63415fde0 con 0x7ff6340ccd10 2023-11-04T01:43:11.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.737+0000 7ff633fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6341f2630 0x7ff6340cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.738+0000 7ff633fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6341f2630 0x7ff6340cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35918/0 (socket says 172.21.15.114:35918) 2023-11-04T01:43:11.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.738+0000 7ff633fff640 1 -- 172.21.15.114:0/2504780669 learned_addr learned my addr 172.21.15.114:0/2504780669 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:11.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.738+0000 7ff6396c2640 1 --2- 172.21.15.114:0/2504780669 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6340ccd10 0x7ff6340ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.738+0000 7ff638ec1640 1 --2- 172.21.15.114:0/2504780669 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6240039a0 0x7ff6341f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.738+0000 7ff633fff640 1 -- 172.21.15.114:0/2504780669 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6340ccd10 msgr2=0x7ff6340ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.738+0000 7ff633fff640 1 --2- 172.21.15.114:0/2504780669 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6340ccd10 0x7ff6340ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.738+0000 7ff633fff640 1 -- 172.21.15.114:0/2504780669 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6240039a0 msgr2=0x7ff6341f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.738+0000 7ff633fff640 1 --2- 172.21.15.114:0/2504780669 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6240039a0 0x7ff6341f20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.738+0000 7ff633fff640 1 -- 172.21.15.114:0/2504780669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6341600c0 con 0x7ff6341f2630 2023-11-04T01:43:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.738+0000 7ff6396c2640 1 --2- 172.21.15.114:0/2504780669 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6340ccd10 0x7ff6340ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.738+0000 7ff633fff640 1 --2- 172.21.15.114:0/2504780669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6341f2630 0x7ff6340cc7d0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7ff62000f820 tx=0x7ff62000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.738+0000 7ff6317fa640 1 -- 172.21.15.114:0/2504780669 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6200050d0 con 0x7ff6341f2630 2023-11-04T01:43:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.738+0000 7ff6317fa640 1 -- 172.21.15.114:0/2504780669 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff620005230 con 0x7ff6341f2630 2023-11-04T01:43:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.738+0000 7ff63b125640 1 -- 172.21.15.114:0/2504780669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6341603a0 con 0x7ff6341f2630 2023-11-04T01:43:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.738+0000 7ff6317fa640 1 -- 172.21.15.114:0/2504780669 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62000d730 con 0x7ff6341f2630 2023-11-04T01:43:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.738+0000 7ff63b125640 1 -- 172.21.15.114:0/2504780669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6340caea0 con 0x7ff6341f2630 2023-11-04T01:43:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.739+0000 7ff63b125640 1 -- 172.21.15.114:0/2504780669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6340684b0 con 0x7ff6341f2630 2023-11-04T01:43:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.739+0000 7ff6317fa640 1 -- 172.21.15.114:0/2504780669 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff62000d890 con 0x7ff6341f2630 2023-11-04T01:43:11.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.740+0000 7ff6317fa640 1 --2- 172.21.15.114:0/2504780669 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff61806aea0 0x7ff61806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.740+0000 7ff638ec1640 1 --2- 172.21.15.114:0/2504780669 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff61806aea0 0x7ff61806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.740+0000 7ff6317fa640 1 -- 172.21.15.114:0/2504780669 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7823+0+0 (secure 0 0 0) 0x7ff620089db0 con 0x7ff6341f2630 2023-11-04T01:43:11.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.740+0000 7ff638ec1640 1 --2- 172.21.15.114:0/2504780669 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff61806aea0 0x7ff61806d360 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff628035000 tx=0x7ff628030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.744+0000 7ff6317fa640 1 -- 172.21.15.114:0/2504780669 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff620054620 con 0x7ff6341f2630 2023-11-04T01:43:11.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.946+0000 7ff63b125640 1 -- 172.21.15.114:0/2504780669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6340d2cd0 con 0x7ff6341f2630 2023-11-04T01:43:11.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.946+0000 7ff6317fa640 1 -- 172.21.15.114:0/2504780669 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4146 (secure 0 0 0) 0x7ff62005e030 con 0x7ff6341f2630 2023-11-04T01:43:11.948 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:11.948 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":96,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:11.616260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:replay","state_seq":1,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:11.948 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 96 2023-11-04T01:43:11.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.948+0000 7ff63b125640 1 -- 172.21.15.114:0/2504780669 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff61806aea0 msgr2=0x7ff61806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.948+0000 7ff63b125640 1 --2- 172.21.15.114:0/2504780669 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff61806aea0 0x7ff61806d360 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff628035000 tx=0x7ff628030000 comp rx=0 tx=0).stop 2023-11-04T01:43:11.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.948+0000 7ff63b125640 1 -- 172.21.15.114:0/2504780669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6341f2630 msgr2=0x7ff6340cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.948+0000 7ff63b125640 1 --2- 172.21.15.114:0/2504780669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6341f2630 0x7ff6340cc7d0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7ff62000f820 tx=0x7ff62000fce0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.948+0000 7ff63b125640 1 -- 172.21.15.114:0/2504780669 shutdown_connections 2023-11-04T01:43:11.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.948+0000 7ff63b125640 1 --2- 172.21.15.114:0/2504780669 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff6340ccd10 0x7ff6340ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.948+0000 7ff63b125640 1 --2- 172.21.15.114:0/2504780669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6341f2630 0x7ff6340cc7d0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.948+0000 7ff63b125640 1 --2- 172.21.15.114:0/2504780669 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff61806aea0 0x7ff61806d360 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.948+0000 7ff63b125640 1 --2- 172.21.15.114:0/2504780669 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6240039a0 0x7ff6341f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.948+0000 7ff63b125640 1 -- 172.21.15.114:0/2504780669 >> 172.21.15.114:0/2504780669 conn(0x7ff6340d2ef0 msgr2=0x7ff6340b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.948+0000 7ff63b125640 1 -- 172.21.15.114:0/2504780669 shutdown_connections 2023-11-04T01:43:11.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:11.948+0000 7ff63b125640 1 -- 172.21.15.114:0/2504780669 wait complete. 2023-11-04T01:43:11.961 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:43:16.962 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:17.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.071+0000 7f39bc32c640 1 Processor -- start 2023-11-04T01:43:17.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.071+0000 7f39bc32c640 1 -- start start 2023-11-04T01:43:17.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.072+0000 7f39bc32c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f39b415d4e0 0x7f39b40d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.072+0000 7f39bc32c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b40d3b60 0x7f39b40d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.072+0000 7f39bc32c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b40b32b0 con 0x7f39b415d100 2023-11-04T01:43:17.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.072+0000 7f39bc32c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b40cec20 con 0x7f39b415d4e0 2023-11-04T01:43:17.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.072+0000 7f39bc32c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40cee10 con 0x7f39b40d3b60 2023-11-04T01:43:17.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.073+0000 7f39ba8c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b40d3b60 0x7f39b40d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.073+0000 7f39b98c7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f39b415d4e0 0x7f39b40d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.073+0000 7f39ba8c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b40d3b60 0x7f39b40d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:50644/0 (socket says 172.21.15.114:50644) 2023-11-04T01:43:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.073+0000 7f39ba8c9640 1 -- 172.21.15.114:0/3387058734 learned_addr learned my addr 172.21.15.114:0/3387058734 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.073+0000 7f39ba8c9640 1 -- 172.21.15.114:0/3387058734 >> v2:172.21.15.141:3300/0 conn(0x7f39b415d4e0 msgr2=0x7f39b40d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.073+0000 7f39ba8c9640 1 --2- 172.21.15.114:0/3387058734 >> v2:172.21.15.141:3300/0 conn(0x7f39b415d4e0 0x7f39b40d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.073+0000 7f39ba8c9640 1 -- 172.21.15.114:0/3387058734 >> v1:172.21.15.141:6789/0 conn(0x7f39b415d100 legacy=0x7f39b40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.073+0000 7f39ba8c9640 1 -- 172.21.15.114:0/3387058734 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b40b4750 con 0x7f39b40d3b60 2023-11-04T01:43:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.073+0000 7f39b98c7640 1 --2- 172.21.15.114:0/3387058734 >> v2:172.21.15.141:3300/0 conn(0x7f39b415d4e0 0x7f39b40d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:17.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.074+0000 7f39ba8c9640 1 --2- 172.21.15.114:0/3387058734 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b40d3b60 0x7f39b40d1a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009870 tx=0x7f39ac02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2f3f8ecb2ea5253 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.074+0000 7f39b90c6640 1 -- 172.21.15.114:0/3387058734 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac030840 con 0x7f39b40d3b60 2023-11-04T01:43:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.074+0000 7f39b90c6640 1 -- 172.21.15.114:0/3387058734 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac0309a0 con 0x7f39b40d3b60 2023-11-04T01:43:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.074+0000 7f39b90c6640 1 -- 172.21.15.114:0/3387058734 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac030d30 con 0x7f39b40d3b60 2023-11-04T01:43:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.075+0000 7f39bc32c640 1 -- 172.21.15.114:0/3387058734 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b40d3b60 msgr2=0x7f39b40d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.075+0000 7f39bc32c640 1 --2- 172.21.15.114:0/3387058734 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b40d3b60 0x7f39b40d1a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009870 tx=0x7f39ac02b980 comp rx=0 tx=0).stop 2023-11-04T01:43:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.075+0000 7f39bc32c640 1 -- 172.21.15.114:0/3387058734 shutdown_connections 2023-11-04T01:43:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.075+0000 7f39bc32c640 1 --2- 172.21.15.114:0/3387058734 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b40d3b60 0x7f39b40d1a10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.075+0000 7f39bc32c640 1 --2- 172.21.15.114:0/3387058734 >> v2:172.21.15.141:3300/0 conn(0x7f39b415d4e0 0x7f39b40d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.075+0000 7f39bc32c640 1 -- 172.21.15.114:0/3387058734 >> 172.21.15.114:0/3387058734 conn(0x7f39b40d2ef0 msgr2=0x7f39b40d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.075+0000 7f39bc32c640 1 -- 172.21.15.114:0/3387058734 shutdown_connections 2023-11-04T01:43:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.075+0000 7f39bc32c640 1 -- 172.21.15.114:0/3387058734 wait complete. 2023-11-04T01:43:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.076+0000 7f39bc32c640 1 Processor -- start 2023-11-04T01:43:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.076+0000 7f39bc32c640 1 -- start start 2023-11-04T01:43:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.077+0000 7f39bc32c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39b40d3b60 0x7f39b40b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.077+0000 7f39bc32c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b415d100 0x7f39b40b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.077+0000 7f39bc32c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b415d4e0 0x7f39b4151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.077+0000 7f39bc32c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40cc290 con 0x7f39b415d4e0 2023-11-04T01:43:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.077+0000 7f39bc32c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40b5fb0 con 0x7f39b40d3b60 2023-11-04T01:43:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.077+0000 7f39bc32c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40cb680 con 0x7f39b415d100 2023-11-04T01:43:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.077+0000 7f39ba8c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b415d4e0 0x7f39b4151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.077+0000 7f39ba8c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b415d4e0 0x7f39b4151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38520/0 (socket says 172.21.15.114:38520) 2023-11-04T01:43:17.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.077+0000 7f39ba8c9640 1 -- 172.21.15.114:0/3095636607 learned_addr learned my addr 172.21.15.114:0/3095636607 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.077+0000 7f39b98c7640 1 --2- 172.21.15.114:0/3095636607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b415d100 0x7f39b40b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.077+0000 7f39ba0c8640 1 --2- 172.21.15.114:0/3095636607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39b40d3b60 0x7f39b40b8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.077+0000 7f39ba8c9640 1 -- 172.21.15.114:0/3095636607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b415d100 msgr2=0x7f39b40b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.077+0000 7f39ba8c9640 1 --2- 172.21.15.114:0/3095636607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b415d100 0x7f39b40b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.077+0000 7f39ba8c9640 1 -- 172.21.15.114:0/3095636607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39b40d3b60 msgr2=0x7f39b40b8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.077+0000 7f39ba8c9640 1 --2- 172.21.15.114:0/3095636607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39b40d3b60 0x7f39b40b8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.077+0000 7f39ba8c9640 1 -- 172.21.15.114:0/3095636607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a4009400 con 0x7f39b415d4e0 2023-11-04T01:43:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.078+0000 7f39ba8c9640 1 --2- 172.21.15.114:0/3095636607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b415d4e0 0x7f39b4151490 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009870 tx=0x7f39ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.078+0000 7f39aaffd640 1 -- 172.21.15.114:0/3095636607 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac039a90 con 0x7f39b415d4e0 2023-11-04T01:43:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.078+0000 7f39aaffd640 1 -- 172.21.15.114:0/3095636607 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac039c10 con 0x7f39b415d4e0 2023-11-04T01:43:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.078+0000 7f39bc32c640 1 -- 172.21.15.114:0/3095636607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ac0094d0 con 0x7f39b415d4e0 2023-11-04T01:43:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.078+0000 7f39aaffd640 1 -- 172.21.15.114:0/3095636607 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac043410 con 0x7f39b415d4e0 2023-11-04T01:43:17.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.078+0000 7f39bc32c640 1 -- 172.21.15.114:0/3095636607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b40cbc40 con 0x7f39b415d4e0 2023-11-04T01:43:17.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.079+0000 7f39bc32c640 1 -- 172.21.15.114:0/3095636607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b40cc440 con 0x7f39b415d4e0 2023-11-04T01:43:17.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.079+0000 7f39aaffd640 1 -- 172.21.15.114:0/3095636607 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f39ac02f390 con 0x7f39b415d4e0 2023-11-04T01:43:17.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.079+0000 7f39aaffd640 1 --2- 172.21.15.114:0/3095636607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f399806aea0 0x7f399806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.080+0000 7f39aaffd640 1 -- 172.21.15.114:0/3095636607 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7823+0+0 (secure 0 0 0) 0x7f39ac0abf50 con 0x7f39b415d4e0 2023-11-04T01:43:17.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.080+0000 7f39ba0c8640 1 --2- 172.21.15.114:0/3095636607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f399806aea0 0x7f399806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.080+0000 7f39ba0c8640 1 --2- 172.21.15.114:0/3095636607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f399806aea0 0x7f399806d360 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f39b0001330 tx=0x7f39b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.084+0000 7f39aaffd640 1 -- 172.21.15.114:0/3095636607 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39b40cc440 con 0x7f39b415d4e0 2023-11-04T01:43:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.284+0000 7f39bc32c640 1 -- 172.21.15.114:0/3095636607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39b40684b0 con 0x7f39b415d4e0 2023-11-04T01:43:17.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.285+0000 7f39aaffd640 1 -- 172.21.15.114:0/3095636607 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f39ac034090 con 0x7f39b415d4e0 2023-11-04T01:43:17.287 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:17.287 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8514,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:11.633249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:resolve","state_seq":12,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:17.287 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 97 2023-11-04T01:43:17.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.286+0000 7f39bc32c640 1 -- 172.21.15.114:0/3095636607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f399806aea0 msgr2=0x7f399806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.286+0000 7f39bc32c640 1 --2- 172.21.15.114:0/3095636607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f399806aea0 0x7f399806d360 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f39b0001330 tx=0x7f39b0009040 comp rx=0 tx=0).stop 2023-11-04T01:43:17.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.286+0000 7f39bc32c640 1 -- 172.21.15.114:0/3095636607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b415d4e0 msgr2=0x7f39b4151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.286+0000 7f39bc32c640 1 --2- 172.21.15.114:0/3095636607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b415d4e0 0x7f39b4151490 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009870 tx=0x7f39ac004730 comp rx=0 tx=0).stop 2023-11-04T01:43:17.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.286+0000 7f39bc32c640 1 -- 172.21.15.114:0/3095636607 shutdown_connections 2023-11-04T01:43:17.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.286+0000 7f39bc32c640 1 --2- 172.21.15.114:0/3095636607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39b415d4e0 0x7f39b4151490 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.286+0000 7f39bc32c640 1 --2- 172.21.15.114:0/3095636607 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f39b415d100 0x7f39b40b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.286+0000 7f39bc32c640 1 --2- 172.21.15.114:0/3095636607 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f399806aea0 0x7f399806d360 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.286+0000 7f39bc32c640 1 --2- 172.21.15.114:0/3095636607 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f39b40d3b60 0x7f39b40b8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.286+0000 7f39bc32c640 1 -- 172.21.15.114:0/3095636607 >> 172.21.15.114:0/3095636607 conn(0x7f39b40d2ef0 msgr2=0x7f39b40d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.286+0000 7f39bc32c640 1 -- 172.21.15.114:0/3095636607 shutdown_connections 2023-11-04T01:43:17.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.287+0000 7f39bc32c640 1 -- 172.21.15.114:0/3095636607 wait complete. 2023-11-04T01:43:17.299 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:43:17.299 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:17.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.396+0000 7f9b03432640 1 Processor -- start 2023-11-04T01:43:17.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.396+0000 7f9b03432640 1 -- start start 2023-11-04T01:43:17.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.396+0000 7f9b03432640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9afc159e40 0x7f9afc0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.396+0000 7f9b03432640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f9afc06bb60 0x7f9afc0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.397+0000 7f9b03432640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9afc071500 con 0x7f9afc06fff0 2023-11-04T01:43:17.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.397+0000 7f9b03432640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9afc15dae0 con 0x7f9afc06bb60 2023-11-04T01:43:17.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.397+0000 7f9b03432640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc070c60 con 0x7f9afc159e40 2023-11-04T01:43:17.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.397+0000 7f9b019cf640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9afc06fff0 0x7f9afc070480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:36060/0 (socket says 172.21.15.114:36060) 2023-11-04T01:43:17.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.397+0000 7f9b019cf640 1 -- 172.21.15.114:0/3611024743 learned_addr learned my addr 172.21.15.114:0/3611024743 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:43:17.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.397+0000 7f9b011ce640 1 --2- 172.21.15.114:0/3611024743 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9afc159e40 0x7f9afc0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.397+0000 7f9b009cd640 1 --2- 172.21.15.114:0/3611024743 >> v2:172.21.15.141:3300/0 conn(0x7f9afc06bb60 0x7f9afc0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.397+0000 7f9af3fff640 1 -- 172.21.15.114:0/3611024743 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735364671 0 0) 0x7f9afc071500 con 0x7f9afc06fff0 2023-11-04T01:43:17.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.397+0000 7f9af3fff640 1 -- 172.21.15.114:0/3611024743 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae8003520 con 0x7f9afc06fff0 2023-11-04T01:43:17.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.397+0000 7f9b011ce640 1 -- 172.21.15.114:0/3611024743 >> v2:172.21.15.141:3300/0 conn(0x7f9afc06bb60 msgr2=0x7f9afc0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:17.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.397+0000 7f9b011ce640 1 --2- 172.21.15.114:0/3611024743 >> v2:172.21.15.141:3300/0 conn(0x7f9afc06bb60 0x7f9afc0b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.397+0000 7f9b011ce640 1 -- 172.21.15.114:0/3611024743 >> v1:172.21.15.114:6789/0 conn(0x7f9afc06fff0 legacy=0x7f9afc070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.397+0000 7f9b011ce640 1 -- 172.21.15.114:0/3611024743 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc070f40 con 0x7f9afc159e40 2023-11-04T01:43:17.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.398+0000 7f9b011ce640 1 --2- 172.21.15.114:0/3611024743 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9afc159e40 0x7f9afc0b0530 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9af80097a0 tx=0x7f9af802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76d69968aa8ad57f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.398+0000 7f9af3fff640 1 -- 172.21.15.114:0/3611024743 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af802e070 con 0x7f9afc159e40 2023-11-04T01:43:17.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.398+0000 7f9af3fff640 1 -- 172.21.15.114:0/3611024743 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af80315a0 con 0x7f9afc159e40 2023-11-04T01:43:17.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.398+0000 7f9af3fff640 1 -- 172.21.15.114:0/3611024743 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8031910 con 0x7f9afc159e40 2023-11-04T01:43:17.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.399+0000 7f9b03432640 1 -- 172.21.15.114:0/3611024743 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9afc159e40 msgr2=0x7f9afc0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.399+0000 7f9b03432640 1 --2- 172.21.15.114:0/3611024743 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9afc159e40 0x7f9afc0b0530 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9af80097a0 tx=0x7f9af802b840 comp rx=0 tx=0).stop 2023-11-04T01:43:17.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.399+0000 7f9b03432640 1 -- 172.21.15.114:0/3611024743 shutdown_connections 2023-11-04T01:43:17.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.399+0000 7f9b03432640 1 --2- 172.21.15.114:0/3611024743 >> v2:172.21.15.141:3300/0 conn(0x7f9afc06bb60 0x7f9afc0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.399+0000 7f9b03432640 1 --2- 172.21.15.114:0/3611024743 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9afc159e40 0x7f9afc0b0530 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.399+0000 7f9b03432640 1 -- 172.21.15.114:0/3611024743 >> 172.21.15.114:0/3611024743 conn(0x7f9afc0cb530 msgr2=0x7f9afc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.399+0000 7f9b03432640 1 -- 172.21.15.114:0/3611024743 shutdown_connections 2023-11-04T01:43:17.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.399+0000 7f9b03432640 1 -- 172.21.15.114:0/3611024743 wait complete. 2023-11-04T01:43:17.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.400+0000 7f9b03432640 1 Processor -- start 2023-11-04T01:43:17.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.400+0000 7f9b03432640 1 -- start start 2023-11-04T01:43:17.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b03432640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9afc06bb60 0x7f9afc1f38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b03432640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9afc06fff0 0x7f9afc152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b03432640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9afc159e40 0x7f9afc0afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b03432640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc0ae940 con 0x7f9afc06fff0 2023-11-04T01:43:17.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b03432640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc0aec20 con 0x7f9afc06bb60 2023-11-04T01:43:17.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b03432640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc0aef00 con 0x7f9afc159e40 2023-11-04T01:43:17.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b009cd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9afc06fff0 0x7f9afc152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b009cd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9afc06fff0 0x7f9afc152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38524/0 (socket says 172.21.15.114:38524) 2023-11-04T01:43:17.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b009cd640 1 -- 172.21.15.114:0/117407713 learned_addr learned my addr 172.21.15.114:0/117407713 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:17.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b019cf640 1 --2- 172.21.15.114:0/117407713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9afc159e40 0x7f9afc0afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b011ce640 1 --2- 172.21.15.114:0/117407713 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9afc06bb60 0x7f9afc1f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b009cd640 1 -- 172.21.15.114:0/117407713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9afc159e40 msgr2=0x7f9afc0afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b009cd640 1 --2- 172.21.15.114:0/117407713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9afc159e40 0x7f9afc0afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b009cd640 1 -- 172.21.15.114:0/117407713 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9afc06bb60 msgr2=0x7f9afc1f38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b009cd640 1 --2- 172.21.15.114:0/117407713 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9afc06bb60 0x7f9afc1f38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b009cd640 1 -- 172.21.15.114:0/117407713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af8009400 con 0x7f9afc06fff0 2023-11-04T01:43:17.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b019cf640 1 --2- 172.21.15.114:0/117407713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9afc159e40 0x7f9afc0afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:17.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b009cd640 1 --2- 172.21.15.114:0/117407713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9afc06fff0 0x7f9afc152f20 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00e9b0 tx=0x7f9aec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9af1ffb640 1 -- 172.21.15.114:0/117407713 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec009670 con 0x7f9afc06fff0 2023-11-04T01:43:17.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9af1ffb640 1 -- 172.21.15.114:0/117407713 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec00c9a0 con 0x7f9afc06fff0 2023-11-04T01:43:17.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9b03432640 1 -- 172.21.15.114:0/117407713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9afc0af1e0 con 0x7f9afc06fff0 2023-11-04T01:43:17.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.401+0000 7f9af1ffb640 1 -- 172.21.15.114:0/117407713 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec00cd50 con 0x7f9afc06fff0 2023-11-04T01:43:17.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.402+0000 7f9b03432640 1 -- 172.21.15.114:0/117407713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9afc153460 con 0x7f9afc06fff0 2023-11-04T01:43:17.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.402+0000 7f9b03432640 1 -- 172.21.15.114:0/117407713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9afc0af370 con 0x7f9afc06fff0 2023-11-04T01:43:17.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.403+0000 7f9af1ffb640 1 -- 172.21.15.114:0/117407713 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9aec013470 con 0x7f9afc06fff0 2023-11-04T01:43:17.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.403+0000 7f9af1ffb640 1 --2- 172.21.15.114:0/117407713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ae006ae70 0x7f9ae006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.403+0000 7f9af1ffb640 1 -- 172.21.15.114:0/117407713 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7823+0+0 (secure 0 0 0) 0x7f9aec08a100 con 0x7f9afc06fff0 2023-11-04T01:43:17.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.403+0000 7f9b011ce640 1 --2- 172.21.15.114:0/117407713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ae006ae70 0x7f9ae006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.404+0000 7f9b011ce640 1 --2- 172.21.15.114:0/117407713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ae006ae70 0x7f9ae006d330 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9af8036000 tx=0x7f9af803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.407+0000 7f9af1ffb640 1 -- 172.21.15.114:0/117407713 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9aec054970 con 0x7f9afc06fff0 2023-11-04T01:43:17.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.607+0000 7f9b03432640 1 -- 172.21.15.114:0/117407713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9afc0684b0 con 0x7f9afc06fff0 2023-11-04T01:43:17.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.607+0000 7f9af1ffb640 1 -- 172.21.15.114:0/117407713 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f9aec017090 con 0x7f9afc06fff0 2023-11-04T01:43:17.609 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:17.609 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8514,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:11.633249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:resolve","state_seq":12,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:17.610 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 97 2023-11-04T01:43:17.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.609+0000 7f9b03432640 1 -- 172.21.15.114:0/117407713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ae006ae70 msgr2=0x7f9ae006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.609+0000 7f9b03432640 1 --2- 172.21.15.114:0/117407713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ae006ae70 0x7f9ae006d330 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9af8036000 tx=0x7f9af803d040 comp rx=0 tx=0).stop 2023-11-04T01:43:17.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.609+0000 7f9b03432640 1 -- 172.21.15.114:0/117407713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9afc06fff0 msgr2=0x7f9afc152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.609+0000 7f9b03432640 1 --2- 172.21.15.114:0/117407713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9afc06fff0 0x7f9afc152f20 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00e9b0 tx=0x7f9aec00ee70 comp rx=0 tx=0).stop 2023-11-04T01:43:17.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.609+0000 7f9b03432640 1 -- 172.21.15.114:0/117407713 shutdown_connections 2023-11-04T01:43:17.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.609+0000 7f9b03432640 1 --2- 172.21.15.114:0/117407713 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f9afc159e40 0x7f9afc0afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.609+0000 7f9b03432640 1 --2- 172.21.15.114:0/117407713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9afc06fff0 0x7f9afc152f20 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.609+0000 7f9b03432640 1 --2- 172.21.15.114:0/117407713 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f9ae006ae70 0x7f9ae006d330 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.609+0000 7f9b03432640 1 --2- 172.21.15.114:0/117407713 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f9afc06bb60 0x7f9afc1f38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.609+0000 7f9b03432640 1 -- 172.21.15.114:0/117407713 >> 172.21.15.114:0/117407713 conn(0x7f9afc0cb530 msgr2=0x7f9afc0cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.609+0000 7f9b03432640 1 -- 172.21.15.114:0/117407713 shutdown_connections 2023-11-04T01:43:17.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.609+0000 7f9b03432640 1 -- 172.21.15.114:0/117407713 wait complete. 2023-11-04T01:43:17.621 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:43:17.622 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.32259154319763184s 2023-11-04T01:43:17.622 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:17.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.719+0000 7fadf8f9e640 1 Processor -- start 2023-11-04T01:43:17.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.719+0000 7fadf8f9e640 1 -- start start 2023-11-04T01:43:17.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.720+0000 7fadf8f9e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fadf415b200 0x7fadf40ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.720+0000 7fadf8f9e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fadf40afda0 0x7fadf40cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.720+0000 7fadf8f9e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fadf40cd7f0 0x7fadf40cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.720+0000 7fadf8f9e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf40cdc40 con 0x7fadf40afda0 2023-11-04T01:43:17.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.720+0000 7fadf8f9e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf40cde80 con 0x7fadf40cd7f0 2023-11-04T01:43:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.720+0000 7fadf8f9e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40cf670 con 0x7fadf415b200 2023-11-04T01:43:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.720+0000 7fadf1d9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fadf40afda0 0x7fadf40cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.720+0000 7fadf1d9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fadf40afda0 0x7fadf40cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38528/0 (socket says 172.21.15.114:38528) 2023-11-04T01:43:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.720+0000 7fadf1d9b640 1 -- 172.21.15.114:0/2204274595 learned_addr learned my addr 172.21.15.114:0/2204274595 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.721+0000 7fadf259c640 1 --2- 172.21.15.114:0/2204274595 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fadf415b200 0x7fadf40ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.721+0000 7fadf2d9d640 1 --2- 172.21.15.114:0/2204274595 >> v2:172.21.15.141:3300/0 conn(0x7fadf40cd7f0 0x7fadf40cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.721+0000 7fadf1d9b640 1 -- 172.21.15.114:0/2204274595 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fadf415b200 msgr2=0x7fadf40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.721+0000 7fadf1d9b640 1 --2- 172.21.15.114:0/2204274595 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fadf415b200 0x7fadf40ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.721+0000 7fadf1d9b640 1 -- 172.21.15.114:0/2204274595 >> v2:172.21.15.141:3300/0 conn(0x7fadf40cd7f0 msgr2=0x7fadf40cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.721+0000 7fadf1d9b640 1 --2- 172.21.15.114:0/2204274595 >> v2:172.21.15.141:3300/0 conn(0x7fadf40cd7f0 0x7fadf40cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.721+0000 7fadf1d9b640 1 -- 172.21.15.114:0/2204274595 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf40cf950 con 0x7fadf40afda0 2023-11-04T01:43:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.721+0000 7fadf2d9d640 1 --2- 172.21.15.114:0/2204274595 >> v2:172.21.15.141:3300/0 conn(0x7fadf40cd7f0 0x7fadf40cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.721+0000 7fadf1d9b640 1 --2- 172.21.15.114:0/2204274595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf40afda0 0x7fadf40cd2b0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fadf415ed40 tx=0x7fade802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ce2fd09a14f098 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.721+0000 7fadf159a640 1 -- 172.21.15.114:0/2204274595 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade80317e0 con 0x7fadf40afda0 2023-11-04T01:43:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.722+0000 7fadf159a640 1 -- 172.21.15.114:0/2204274595 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade8031940 con 0x7fadf40afda0 2023-11-04T01:43:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.722+0000 7fadf159a640 1 -- 172.21.15.114:0/2204274595 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade8031cd0 con 0x7fadf40afda0 2023-11-04T01:43:17.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.722+0000 7fadf8f9e640 1 -- 172.21.15.114:0/2204274595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf40afda0 msgr2=0x7fadf40cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.722+0000 7fadf8f9e640 1 --2- 172.21.15.114:0/2204274595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf40afda0 0x7fadf40cd2b0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fadf415ed40 tx=0x7fade802b880 comp rx=0 tx=0).stop 2023-11-04T01:43:17.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.722+0000 7fadf8f9e640 1 -- 172.21.15.114:0/2204274595 shutdown_connections 2023-11-04T01:43:17.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.722+0000 7fadf8f9e640 1 --2- 172.21.15.114:0/2204274595 >> v2:172.21.15.141:3300/0 conn(0x7fadf40cd7f0 0x7fadf40cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.722+0000 7fadf8f9e640 1 --2- 172.21.15.114:0/2204274595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf40afda0 0x7fadf40cd2b0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.722+0000 7fadf8f9e640 1 --2- 172.21.15.114:0/2204274595 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fadf415b200 0x7fadf40ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.722+0000 7fadf8f9e640 1 -- 172.21.15.114:0/2204274595 >> 172.21.15.114:0/2204274595 conn(0x7fadf40d0c30 msgr2=0x7fadf40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.722+0000 7fadf8f9e640 1 -- 172.21.15.114:0/2204274595 shutdown_connections 2023-11-04T01:43:17.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.722+0000 7fadf8f9e640 1 -- 172.21.15.114:0/2204274595 wait complete. 2023-11-04T01:43:17.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.723+0000 7fadf8f9e640 1 Processor -- start 2023-11-04T01:43:17.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.724+0000 7fadf8f9e640 1 -- start start 2023-11-04T01:43:17.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.724+0000 7fadf8f9e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fadf40afda0 0x7fadf41572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.724+0000 7fadf8f9e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf40cd7f0 0x7fadf406cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.724+0000 7fadf8f9e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fadf415b200 0x7fadf415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.724+0000 7fadf8f9e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40c3940 con 0x7fadf40cd7f0 2023-11-04T01:43:17.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.724+0000 7fadf8f9e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf4157800 con 0x7fadf40afda0 2023-11-04T01:43:17.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.724+0000 7fadf8f9e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf406c050 con 0x7fadf415b200 2023-11-04T01:43:17.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.724+0000 7fadf1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf40cd7f0 0x7fadf406cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.724+0000 7fadf1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf40cd7f0 0x7fadf406cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38534/0 (socket says 172.21.15.114:38534) 2023-11-04T01:43:17.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.724+0000 7fadf1d9b640 1 -- 172.21.15.114:0/2255052681 learned_addr learned my addr 172.21.15.114:0/2255052681 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:17.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.724+0000 7fadf2d9d640 1 --2- 172.21.15.114:0/2255052681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fadf415b200 0x7fadf415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.724+0000 7fadf259c640 1 --2- 172.21.15.114:0/2255052681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fadf40afda0 0x7fadf41572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.725+0000 7fadf1d9b640 1 -- 172.21.15.114:0/2255052681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fadf415b200 msgr2=0x7fadf415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.725+0000 7fadf1d9b640 1 --2- 172.21.15.114:0/2255052681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fadf415b200 0x7fadf415cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.725+0000 7fadf1d9b640 1 -- 172.21.15.114:0/2255052681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fadf40afda0 msgr2=0x7fadf41572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.725+0000 7fadf1d9b640 1 --2- 172.21.15.114:0/2255052681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fadf40afda0 0x7fadf41572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.725+0000 7fadf1d9b640 1 -- 172.21.15.114:0/2255052681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade80094d0 con 0x7fadf40cd7f0 2023-11-04T01:43:17.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.725+0000 7fadf2d9d640 1 --2- 172.21.15.114:0/2255052681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fadf415b200 0x7fadf415cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:17.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.725+0000 7fadf1d9b640 1 --2- 172.21.15.114:0/2255052681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf40cd7f0 0x7fadf406cb00 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fade8000c00 tx=0x7fade80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.725+0000 7fade2ffd640 1 -- 172.21.15.114:0/2255052681 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade8032880 con 0x7fadf40cd7f0 2023-11-04T01:43:17.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.725+0000 7fade2ffd640 1 -- 172.21.15.114:0/2255052681 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade8032a20 con 0x7fadf40cd7f0 2023-11-04T01:43:17.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.725+0000 7fadf8f9e640 1 -- 172.21.15.114:0/2255052681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf406c330 con 0x7fadf40cd7f0 2023-11-04T01:43:17.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.725+0000 7fade2ffd640 1 -- 172.21.15.114:0/2255052681 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade8032dd0 con 0x7fadf40cd7f0 2023-11-04T01:43:17.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.725+0000 7fadf8f9e640 1 -- 172.21.15.114:0/2255052681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf415c2d0 con 0x7fadf40cd7f0 2023-11-04T01:43:17.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.726+0000 7fadf8f9e640 1 -- 172.21.15.114:0/2255052681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf40684b0 con 0x7fadf40cd7f0 2023-11-04T01:43:17.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.726+0000 7fade2ffd640 1 -- 172.21.15.114:0/2255052681 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fade80453f0 con 0x7fadf40cd7f0 2023-11-04T01:43:17.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.727+0000 7fade2ffd640 1 --2- 172.21.15.114:0/2255052681 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fadd406aea0 0x7fadd406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.727+0000 7fadf259c640 1 --2- 172.21.15.114:0/2255052681 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fadd406aea0 0x7fadd406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.727+0000 7fade2ffd640 1 -- 172.21.15.114:0/2255052681 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7823+0+0 (secure 0 0 0) 0x7fade80abfb0 con 0x7fadf40cd7f0 2023-11-04T01:43:17.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.727+0000 7fadf259c640 1 --2- 172.21.15.114:0/2255052681 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fadd406aea0 0x7fadd406d360 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fade4009ab0 tx=0x7fade4003990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.731+0000 7fade2ffd640 1 -- 172.21.15.114:0/2255052681 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fade80deca0 con 0x7fadf40cd7f0 2023-11-04T01:43:17.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.934+0000 7fadf8f9e640 1 -- 172.21.15.114:0/2255052681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadf40ae430 con 0x7fadf40cd7f0 2023-11-04T01:43:17.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.934+0000 7fade2ffd640 1 -- 172.21.15.114:0/2255052681 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4939 (secure 0 0 0) 0x7fade80768e0 con 0x7fadf40cd7f0 2023-11-04T01:43:17.936 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:17.936 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8514,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:11.633249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:resolve","state_seq":12,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8262":{"gid":8262,"name":"c","rank":1,"incarnation":87,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/3145796350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3145796350},{"type":"v1","addr":"172.21.15.114:6836","nonce":3145796350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:17.937 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 97 2023-11-04T01:43:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.936+0000 7fadf8f9e640 1 -- 172.21.15.114:0/2255052681 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fadd406aea0 msgr2=0x7fadd406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.936+0000 7fadf8f9e640 1 --2- 172.21.15.114:0/2255052681 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fadd406aea0 0x7fadd406d360 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fade4009ab0 tx=0x7fade4003990 comp rx=0 tx=0).stop 2023-11-04T01:43:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.936+0000 7fadf8f9e640 1 -- 172.21.15.114:0/2255052681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf40cd7f0 msgr2=0x7fadf406cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.936+0000 7fadf8f9e640 1 --2- 172.21.15.114:0/2255052681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf40cd7f0 0x7fadf406cb00 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fade8000c00 tx=0x7fade80046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.936+0000 7fadf8f9e640 1 -- 172.21.15.114:0/2255052681 shutdown_connections 2023-11-04T01:43:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.936+0000 7fadf8f9e640 1 --2- 172.21.15.114:0/2255052681 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fadf415b200 0x7fadf415cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.936+0000 7fadf8f9e640 1 --2- 172.21.15.114:0/2255052681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf40cd7f0 0x7fadf406cb00 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.936+0000 7fadf8f9e640 1 --2- 172.21.15.114:0/2255052681 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fadd406aea0 0x7fadd406d360 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.936+0000 7fadf8f9e640 1 --2- 172.21.15.114:0/2255052681 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fadf40afda0 0x7fadf41572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.936+0000 7fadf8f9e640 1 -- 172.21.15.114:0/2255052681 >> 172.21.15.114:0/2255052681 conn(0x7fadf40d0c30 msgr2=0x7fadf4159190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.936+0000 7fadf8f9e640 1 -- 172.21.15.114:0/2255052681 shutdown_connections 2023-11-04T01:43:17.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:17.936+0000 7fadf8f9e640 1 -- 172.21.15.114:0/2255052681 wait complete. 2023-11-04T01:43:17.949 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:43:18.075 INFO:teuthology.orchestra.run.smithi141.stdout:{"last_snap":11,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[{"version":22,"snapinfo":{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:48.820894+0000","name":"s25","metadata":{}}}],"pending_destroy":[]} 2023-11-04T01:43:18.075 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [ { "snapInfinityo": { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:48.820894+0000" }, "version": 22 } ], "snaps": [] } 2023-11-04T01:43:18.076 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:43:18.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.174+0000 7fab491c0640 1 Processor -- start 2023-11-04T01:43:18.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.174+0000 7fab491c0640 1 -- start start 2023-11-04T01:43:18.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.175+0000 7fab491c0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fab4415d4e0 0x7fab440d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.175+0000 7fab491c0640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fab440d3b60 0x7fab440d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.175+0000 7fab491c0640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab440b32b0 con 0x7fab4415d100 2023-11-04T01:43:18.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.175+0000 7fab491c0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab440cec20 con 0x7fab4415d4e0 2023-11-04T01:43:18.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.175+0000 7fab491c0640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab440cee10 con 0x7fab440d3b60 2023-11-04T01:43:18.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.175+0000 7fab4259c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fab4415d4e0 0x7fab440d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.175+0000 7fab4259c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fab4415d4e0 0x7fab440d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38542/0 (socket says 172.21.15.114:38542) 2023-11-04T01:43:18.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.175+0000 7fab4259c640 1 -- 172.21.15.114:0/1013513404 learned_addr learned my addr 172.21.15.114:0/1013513404 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:18.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.176+0000 7fab4359e640 1 --2- 172.21.15.114:0/1013513404 >> v2:172.21.15.141:3300/0 conn(0x7fab440d3b60 0x7fab440d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.176+0000 7fab4259c640 1 -- 172.21.15.114:0/1013513404 >> v2:172.21.15.141:3300/0 conn(0x7fab440d3b60 msgr2=0x7fab440d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.176+0000 7fab4259c640 1 --2- 172.21.15.114:0/1013513404 >> v2:172.21.15.141:3300/0 conn(0x7fab440d3b60 0x7fab440d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.176+0000 7fab4259c640 1 -- 172.21.15.114:0/1013513404 >> v1:172.21.15.141:6789/0 conn(0x7fab4415d100 legacy=0x7fab440ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.176+0000 7fab4259c640 1 -- 172.21.15.114:0/1013513404 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab440b4750 con 0x7fab4415d4e0 2023-11-04T01:43:18.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.176+0000 7fab4359e640 1 --2- 172.21.15.114:0/1013513404 >> v2:172.21.15.141:3300/0 conn(0x7fab440d3b60 0x7fab440d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:18.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.176+0000 7fab4259c640 1 --2- 172.21.15.114:0/1013513404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab4415d4e0 0x7fab440d14d0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fab4408d6a0 tx=0x7fab3402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9e2f4e97f133f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.176+0000 7fab41d9b640 1 -- 172.21.15.114:0/1013513404 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34031870 con 0x7fab4415d4e0 2023-11-04T01:43:18.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.177+0000 7fab41d9b640 1 -- 172.21.15.114:0/1013513404 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab340319d0 con 0x7fab4415d4e0 2023-11-04T01:43:18.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.177+0000 7fab41d9b640 1 -- 172.21.15.114:0/1013513404 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34031d60 con 0x7fab4415d4e0 2023-11-04T01:43:18.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.177+0000 7fab491c0640 1 -- 172.21.15.114:0/1013513404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab4415d4e0 msgr2=0x7fab440d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.177+0000 7fab491c0640 1 --2- 172.21.15.114:0/1013513404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab4415d4e0 0x7fab440d14d0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fab4408d6a0 tx=0x7fab3402b910 comp rx=0 tx=0).stop 2023-11-04T01:43:18.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.177+0000 7fab491c0640 1 -- 172.21.15.114:0/1013513404 shutdown_connections 2023-11-04T01:43:18.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.177+0000 7fab491c0640 1 --2- 172.21.15.114:0/1013513404 >> v2:172.21.15.141:3300/0 conn(0x7fab440d3b60 0x7fab440d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.177+0000 7fab491c0640 1 --2- 172.21.15.114:0/1013513404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab4415d4e0 0x7fab440d14d0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.177+0000 7fab491c0640 1 -- 172.21.15.114:0/1013513404 >> 172.21.15.114:0/1013513404 conn(0x7fab440d2ef0 msgr2=0x7fab440d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.177+0000 7fab491c0640 1 -- 172.21.15.114:0/1013513404 shutdown_connections 2023-11-04T01:43:18.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.177+0000 7fab491c0640 1 -- 172.21.15.114:0/1013513404 wait complete. 2023-11-04T01:43:18.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.178+0000 7fab491c0640 1 Processor -- start 2023-11-04T01:43:18.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.179+0000 7fab491c0640 1 -- start start 2023-11-04T01:43:18.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.179+0000 7fab491c0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab440d3b60 0x7fab4414f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.179+0000 7fab491c0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab4415d100 0x7fab4415fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.179+0000 7fab491c0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab4415d4e0 0x7fab44160300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.179+0000 7fab491c0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4414f900 con 0x7fab4415d100 2023-11-04T01:43:18.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.179+0000 7fab491c0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4415d8f0 con 0x7fab440d3b60 2023-11-04T01:43:18.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.179+0000 7fab491c0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab440b7100 con 0x7fab4415d4e0 2023-11-04T01:43:18.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.179+0000 7fab4259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab4415d100 0x7fab4415fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.179+0000 7fab4259c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab4415d100 0x7fab4415fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38558/0 (socket says 172.21.15.114:38558) 2023-11-04T01:43:18.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.179+0000 7fab4259c640 1 -- 172.21.15.114:0/859805794 learned_addr learned my addr 172.21.15.114:0/859805794 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:18.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.179+0000 7fab42d9d640 1 --2- 172.21.15.114:0/859805794 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab440d3b60 0x7fab4414f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.180+0000 7fab4359e640 1 --2- 172.21.15.114:0/859805794 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab4415d4e0 0x7fab44160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.180+0000 7fab4259c640 1 -- 172.21.15.114:0/859805794 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab4415d4e0 msgr2=0x7fab44160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.180+0000 7fab4259c640 1 --2- 172.21.15.114:0/859805794 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab4415d4e0 0x7fab44160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.180+0000 7fab4259c640 1 -- 172.21.15.114:0/859805794 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab440d3b60 msgr2=0x7fab4414f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.180+0000 7fab4259c640 1 --2- 172.21.15.114:0/859805794 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab440d3b60 0x7fab4414f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.180+0000 7fab4259c640 1 -- 172.21.15.114:0/859805794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab340094d0 con 0x7fab4415d100 2023-11-04T01:43:18.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.180+0000 7fab4259c640 1 --2- 172.21.15.114:0/859805794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab4415d100 0x7fab4415fdc0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fab3402b950 tx=0x7fab340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.180+0000 7fab2b7fe640 1 -- 172.21.15.114:0/859805794 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34031820 con 0x7fab4415d100 2023-11-04T01:43:18.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.180+0000 7fab2b7fe640 1 -- 172.21.15.114:0/859805794 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab340443f0 con 0x7fab4415d100 2023-11-04T01:43:18.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.180+0000 7fab491c0640 1 -- 172.21.15.114:0/859805794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4415db40 con 0x7fab4415d100 2023-11-04T01:43:18.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.180+0000 7fab2b7fe640 1 -- 172.21.15.114:0/859805794 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340447a0 con 0x7fab4415d100 2023-11-04T01:43:18.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.180+0000 7fab491c0640 1 -- 172.21.15.114:0/859805794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4415e100 con 0x7fab4415d100 2023-11-04T01:43:18.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.181+0000 7fab491c0640 1 -- 172.21.15.114:0/859805794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab440b1a30 con 0x7fab4415d100 2023-11-04T01:43:18.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.181+0000 7fab2b7fe640 1 -- 172.21.15.114:0/859805794 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab3404d450 con 0x7fab4415d100 2023-11-04T01:43:18.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.182+0000 7fab2b7fe640 1 --2- 172.21.15.114:0/859805794 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab3006ae70 0x7fab3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.182+0000 7fab2b7fe640 1 -- 172.21.15.114:0/859805794 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7823+0+0 (secure 0 0 0) 0x7fab3402d040 con 0x7fab4415d100 2023-11-04T01:43:18.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.182+0000 7fab42d9d640 1 --2- 172.21.15.114:0/859805794 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab3006ae70 0x7fab3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.182+0000 7fab42d9d640 1 --2- 172.21.15.114:0/859805794 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab3006ae70 0x7fab3006d330 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fab38007fd0 tx=0x7fab38007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.186+0000 7fab2b7fe640 1 -- 172.21.15.114:0/859805794 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fab34076de0 con 0x7fab4415d100 2023-11-04T01:43:18.202 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:43:18.202 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:43:18.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.418+0000 7fab491c0640 1 -- 172.21.15.114:0/859805794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7fab440684b0 con 0x7fab4415d100 2023-11-04T01:43:18.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.420+0000 7fab2b7fe640 1 -- 172.21.15.114:0/859805794 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 8262 v98) v1 ==== 97+0+0 (secure 0 0 0) 0x7fab3407a400 con 0x7fab4415d100 2023-11-04T01:43:18.421 INFO:teuthology.orchestra.run.smithi114.stderr:failed mds gid 8262 2023-11-04T01:43:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.422+0000 7fab491c0640 1 -- 172.21.15.114:0/859805794 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab3006ae70 msgr2=0x7fab3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.422+0000 7fab491c0640 1 --2- 172.21.15.114:0/859805794 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab3006ae70 0x7fab3006d330 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fab38007fd0 tx=0x7fab38007e80 comp rx=0 tx=0).stop 2023-11-04T01:43:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.422+0000 7fab491c0640 1 -- 172.21.15.114:0/859805794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab4415d100 msgr2=0x7fab4415fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.422+0000 7fab491c0640 1 --2- 172.21.15.114:0/859805794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab4415d100 0x7fab4415fdc0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fab3402b950 tx=0x7fab340046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.422+0000 7fab491c0640 1 -- 172.21.15.114:0/859805794 shutdown_connections 2023-11-04T01:43:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.422+0000 7fab491c0640 1 --2- 172.21.15.114:0/859805794 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fab4415d4e0 0x7fab44160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.422+0000 7fab491c0640 1 --2- 172.21.15.114:0/859805794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab4415d100 0x7fab4415fdc0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.422+0000 7fab491c0640 1 --2- 172.21.15.114:0/859805794 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fab3006ae70 0x7fab3006d330 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.422+0000 7fab491c0640 1 --2- 172.21.15.114:0/859805794 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab440d3b60 0x7fab4414f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.422+0000 7fab491c0640 1 -- 172.21.15.114:0/859805794 >> 172.21.15.114:0/859805794 conn(0x7fab440d2ef0 msgr2=0x7fab440cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.422+0000 7fab491c0640 1 -- 172.21.15.114:0/859805794 shutdown_connections 2023-11-04T01:43:18.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.422+0000 7fab491c0640 1 -- 172.21.15.114:0/859805794 wait complete. 2023-11-04T01:43:18.435 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:43:18.435 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:43:18.435 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:43:18.435 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:18.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:43:18.436 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:43:18.436 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:43:18.436 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:43:18.439 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:43:18.439 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:18.514 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2023-11-04T01:43:18.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.539+0000 7f84e7ce7640 1 Processor -- start 2023-11-04T01:43:18.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.539+0000 7f84e7ce7640 1 -- start start 2023-11-04T01:43:18.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e7ce7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84e00ca1a0 0x7f84e00ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e7ce7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f84e006a0d0 0x7f84e006a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e7ce7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e00b25a0 con 0x7f84e015d4e0 2023-11-04T01:43:18.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e7ce7640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e00cab60 con 0x7f84e006a0d0 2023-11-04T01:43:18.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e7ce7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e00b2300 con 0x7f84e00ca1a0 2023-11-04T01:43:18.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e5a83640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f84e015d4e0 0x7f84e00ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:36072/0 (socket says 172.21.15.114:36072) 2023-11-04T01:43:18.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e5a83640 1 -- 172.21.15.114:0/1777704530 learned_addr learned my addr 172.21.15.114:0/1777704530 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:43:18.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e5282640 1 --2- 172.21.15.114:0/1777704530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84e00ca1a0 0x7f84e00ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e4a81640 1 -- 172.21.15.114:0/1777704530 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584103419 0 0) 0x7f84e00b25a0 con 0x7f84e015d4e0 2023-11-04T01:43:18.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e6284640 1 --2- 172.21.15.114:0/1777704530 >> v2:172.21.15.141:3300/0 conn(0x7f84e006a0d0 0x7f84e006a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e4a81640 1 -- 172.21.15.114:0/1777704530 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84cc003520 con 0x7f84e015d4e0 2023-11-04T01:43:18.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e4a81640 1 -- 172.21.15.114:0/1777704530 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2637197747 0 0) 0x7f84cc003520 con 0x7f84e015d4e0 2023-11-04T01:43:18.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e4a81640 1 -- 172.21.15.114:0/1777704530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84e00ca1a0 msgr2=0x7f84e00ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e4a81640 1 --2- 172.21.15.114:0/1777704530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84e00ca1a0 0x7f84e00ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e4a81640 1 -- 172.21.15.114:0/1777704530 >> v2:172.21.15.141:3300/0 conn(0x7f84e006a0d0 msgr2=0x7f84e006a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e4a81640 1 --2- 172.21.15.114:0/1777704530 >> v2:172.21.15.141:3300/0 conn(0x7f84e006a0d0 0x7f84e006a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e4a81640 1 -- 172.21.15.114:0/1777704530 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e015d8c0 con 0x7f84e015d4e0 2023-11-04T01:43:18.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e4a81640 1 -- 172.21.15.114:0/1777704530 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f84dc001670 con 0x7f84e015d4e0 2023-11-04T01:43:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e4a81640 1 -- 172.21.15.114:0/1777704530 >> v1:172.21.15.114:6789/0 conn(0x7f84e015d4e0 legacy=0x7f84e00ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e4a81640 1 --2- 172.21.15.114:0/1777704530 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84cc003970 0x7f84cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e4a81640 1 --2- 172.21.15.114:0/1777704530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84e00ca1a0 0x7f84cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e4a81640 1 --2- 172.21.15.114:0/1777704530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84cc004d00 0x7f84cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e4a81640 1 -- 172.21.15.114:0/1777704530 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e00cab60 con 0x7f84cc004d00 2023-11-04T01:43:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e4a81640 1 -- 172.21.15.114:0/1777704530 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e00b2300 con 0x7f84cc003970 2023-11-04T01:43:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e4a81640 1 -- 172.21.15.114:0/1777704530 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc00b980 con 0x7f84e00ca1a0 2023-11-04T01:43:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.540+0000 7f84e6284640 1 --2- 172.21.15.114:0/1777704530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84cc004d00 0x7f84cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.541+0000 7f84e5a83640 1 --2- 172.21.15.114:0/1777704530 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84cc003970 0x7f84cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.541+0000 7f84e5282640 1 --2- 172.21.15.114:0/1777704530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84e00ca1a0 0x7f84cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.541+0000 7f84e6284640 1 -- 172.21.15.114:0/1777704530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84e00ca1a0 msgr2=0x7f84cc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.541+0000 7f84e6284640 1 --2- 172.21.15.114:0/1777704530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84e00ca1a0 0x7f84cc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.541+0000 7f84e6284640 1 -- 172.21.15.114:0/1777704530 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84cc003970 msgr2=0x7f84cc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.541+0000 7f84e6284640 1 --2- 172.21.15.114:0/1777704530 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84cc003970 0x7f84cc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.541+0000 7f84e6284640 1 -- 172.21.15.114:0/1777704530 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc003520 con 0x7f84cc004d00 2023-11-04T01:43:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.541+0000 7f84e6284640 1 --2- 172.21.15.114:0/1777704530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84cc004d00 0x7f84cc005180 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f84d8009fc0 tx=0x7f84cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b057d549ec10a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.542+0000 7f84e4a81640 1 -- 172.21.15.114:0/1777704530 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d802cc60 con 0x7f84cc004d00 2023-11-04T01:43:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.542+0000 7f84e4a81640 1 -- 172.21.15.114:0/1777704530 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d800f040 con 0x7f84cc004d00 2023-11-04T01:43:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.542+0000 7f84e4a81640 1 -- 172.21.15.114:0/1777704530 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8034440 con 0x7f84cc004d00 2023-11-04T01:43:18.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.542+0000 7f84e7ce7640 1 -- 172.21.15.114:0/1777704530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84cc004d00 msgr2=0x7f84cc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.542+0000 7f84e7ce7640 1 --2- 172.21.15.114:0/1777704530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84cc004d00 0x7f84cc005180 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f84d8009fc0 tx=0x7f84cc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.542+0000 7f84e6284640 1 -- 172.21.15.114:0/1777704530 reap_dead start 2023-11-04T01:43:18.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.542+0000 7f84e7ce7640 1 -- 172.21.15.114:0/1777704530 shutdown_connections 2023-11-04T01:43:18.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.542+0000 7f84e7ce7640 1 -- 172.21.15.114:0/1777704530 >> 172.21.15.114:0/1777704530 conn(0x7f84e00b1640 msgr2=0x7f84e00b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.542+0000 7f84e7ce7640 1 -- 172.21.15.114:0/1777704530 shutdown_connections 2023-11-04T01:43:18.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.542+0000 7f84e7ce7640 1 -- 172.21.15.114:0/1777704530 wait complete. 2023-11-04T01:43:18.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.543+0000 7f84e7ce7640 1 Processor -- start 2023-11-04T01:43:18.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.543+0000 7f84e7ce7640 1 -- start start 2023-11-04T01:43:18.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.544+0000 7f84e7ce7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84cc004d00 0x7f84e014ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.544+0000 7f84e7ce7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e00afd00 0x7f84e00c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.544+0000 7f84e7ce7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84e00b0180 0x7f84e00c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.544+0000 7f84e7ce7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e00c7f20 con 0x7f84e00afd00 2023-11-04T01:43:18.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.544+0000 7f84e7ce7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e00c4d00 con 0x7f84cc004d00 2023-11-04T01:43:18.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.544+0000 7f84e7ce7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e00c81e0 con 0x7f84e00b0180 2023-11-04T01:43:18.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.544+0000 7f84e5282640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e00afd00 0x7f84e00c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.544+0000 7f84e5282640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e00afd00 0x7f84e00c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38592/0 (socket says 172.21.15.114:38592) 2023-11-04T01:43:18.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.544+0000 7f84e5282640 1 -- 172.21.15.114:0/4013610128 learned_addr learned my addr 172.21.15.114:0/4013610128 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:18.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.544+0000 7f84e6284640 1 --2- 172.21.15.114:0/4013610128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84e00b0180 0x7f84e00c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.544+0000 7f84e5a83640 1 --2- 172.21.15.114:0/4013610128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84cc004d00 0x7f84e014ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.545+0000 7f84e5282640 1 -- 172.21.15.114:0/4013610128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84e00b0180 msgr2=0x7f84e00c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.545+0000 7f84e5282640 1 --2- 172.21.15.114:0/4013610128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84e00b0180 0x7f84e00c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.545+0000 7f84e5282640 1 -- 172.21.15.114:0/4013610128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84cc004d00 msgr2=0x7f84e014ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.545+0000 7f84e5282640 1 --2- 172.21.15.114:0/4013610128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84cc004d00 0x7f84e014ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.545+0000 7f84e5282640 1 -- 172.21.15.114:0/4013610128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e00c84c0 con 0x7f84e00afd00 2023-11-04T01:43:18.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.545+0000 7f84e5a83640 1 --2- 172.21.15.114:0/4013610128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84cc004d00 0x7f84e014ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:18.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.545+0000 7f84e5282640 1 --2- 172.21.15.114:0/4013610128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e00afd00 0x7f84e00c4240 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f84d00119a0 tx=0x7f84d0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.545+0000 7f84d67fc640 1 -- 172.21.15.114:0/4013610128 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d000faf0 con 0x7f84e00afd00 2023-11-04T01:43:18.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.545+0000 7f84d67fc640 1 -- 172.21.15.114:0/4013610128 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d000fc50 con 0x7f84e00afd00 2023-11-04T01:43:18.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.545+0000 7f84e7ce7640 1 -- 172.21.15.114:0/4013610128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e00c87a0 con 0x7f84e00afd00 2023-11-04T01:43:18.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.545+0000 7f84d67fc640 1 -- 172.21.15.114:0/4013610128 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0014440 con 0x7f84e00afd00 2023-11-04T01:43:18.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.545+0000 7f84e7ce7640 1 -- 172.21.15.114:0/4013610128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e00c4780 con 0x7f84e00afd00 2023-11-04T01:43:18.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.546+0000 7f84e7ce7640 1 -- 172.21.15.114:0/4013610128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e00c4a60 con 0x7f84e00afd00 2023-11-04T01:43:18.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.546+0000 7f84d67fc640 1 -- 172.21.15.114:0/4013610128 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f84d001d400 con 0x7f84e00afd00 2023-11-04T01:43:18.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.546+0000 7f84d67fc640 1 --2- 172.21.15.114:0/4013610128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f84c406ae70 0x7f84c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.547+0000 7f84d67fc640 1 -- 172.21.15.114:0/4013610128 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7909+0+0 (secure 0 0 0) 0x7f84d008a6f0 con 0x7f84e00afd00 2023-11-04T01:43:18.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.547+0000 7f84e5a83640 1 --2- 172.21.15.114:0/4013610128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f84c406ae70 0x7f84c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.547+0000 7f84e5a83640 1 --2- 172.21.15.114:0/4013610128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f84c406ae70 0x7f84c406d330 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f84dc007dd0 tx=0x7f84dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.551+0000 7f84d67fc640 1 -- 172.21.15.114:0/4013610128 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f84d0054f00 con 0x7f84e00afd00 2023-11-04T01:43:18.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.755+0000 7f84e7ce7640 1 -- 172.21.15.114:0/4013610128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84e00684b0 con 0x7f84e00afd00 2023-11-04T01:43:18.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.756+0000 7f84d67fc640 1 -- 172.21.15.114:0/4013610128 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4145 (secure 0 0 0) 0x7f84d0058520 con 0x7f84e00afd00 2023-11-04T01:43:18.758 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:18.758 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":99,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:18.423903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:resolve","state_seq":12,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:18.758 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 99 2023-11-04T01:43:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.757+0000 7f84e7ce7640 1 -- 172.21.15.114:0/4013610128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f84c406ae70 msgr2=0x7f84c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.757+0000 7f84e7ce7640 1 --2- 172.21.15.114:0/4013610128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f84c406ae70 0x7f84c406d330 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f84dc007dd0 tx=0x7f84dc009040 comp rx=0 tx=0).stop 2023-11-04T01:43:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.757+0000 7f84e7ce7640 1 -- 172.21.15.114:0/4013610128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e00afd00 msgr2=0x7f84e00c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.757+0000 7f84e7ce7640 1 --2- 172.21.15.114:0/4013610128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e00afd00 0x7f84e00c4240 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f84d00119a0 tx=0x7f84d0011e60 comp rx=0 tx=0).stop 2023-11-04T01:43:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.757+0000 7f84e7ce7640 1 -- 172.21.15.114:0/4013610128 shutdown_connections 2023-11-04T01:43:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.757+0000 7f84e7ce7640 1 --2- 172.21.15.114:0/4013610128 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f84e00b0180 0x7f84e00c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.757+0000 7f84e7ce7640 1 --2- 172.21.15.114:0/4013610128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e00afd00 0x7f84e00c4240 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.757+0000 7f84e7ce7640 1 --2- 172.21.15.114:0/4013610128 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f84c406ae70 0x7f84c406d330 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.757+0000 7f84e7ce7640 1 --2- 172.21.15.114:0/4013610128 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f84cc004d00 0x7f84e014ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.758+0000 7f84e7ce7640 1 -- 172.21.15.114:0/4013610128 >> 172.21.15.114:0/4013610128 conn(0x7f84e00b1640 msgr2=0x7f84e006ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.758+0000 7f84e7ce7640 1 -- 172.21.15.114:0/4013610128 shutdown_connections 2023-11-04T01:43:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:18.758+0000 7f84e7ce7640 1 -- 172.21.15.114:0/4013610128 wait complete. 2023-11-04T01:43:18.770 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:43:21.011 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:21.014 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:23.771 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:23.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.880+0000 7ff5fb99e640 1 Processor -- start 2023-11-04T01:43:23.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.880+0000 7ff5fb99e640 1 -- start start 2023-11-04T01:43:23.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.881+0000 7ff5fb99e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff5f406d9c0 0x7ff5f40710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.881+0000 7ff5fb99e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5f406c5f0 0x7ff5f4071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.881+0000 7ff5fb99e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f406cc90 con 0x7ff5f40ade00 2023-11-04T01:43:23.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.881+0000 7ff5fb99e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f40b0c40 con 0x7ff5f406d9c0 2023-11-04T01:43:23.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.881+0000 7ff5fb99e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f4071b50 con 0x7ff5f406c5f0 2023-11-04T01:43:23.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.882+0000 7ff5f9f3b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5f406c5f0 0x7ff5f4071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.882+0000 7ff5f8f39640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff5f406d9c0 0x7ff5f40710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.882+0000 7ff5f9f3b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5f406c5f0 0x7ff5f4071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:50712/0 (socket says 172.21.15.114:50712) 2023-11-04T01:43:23.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.882+0000 7ff5f973a640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7ff5f40ade00 0x7ff5f40b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:54454/0 (socket says 172.21.15.114:54454) 2023-11-04T01:43:23.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.882+0000 7ff5f9f3b640 1 -- 172.21.15.114:0/3425921195 learned_addr learned my addr 172.21.15.114:0/3425921195 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:23.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.882+0000 7ff5f9f3b640 1 -- 172.21.15.114:0/3425921195 >> v2:172.21.15.141:3300/0 conn(0x7ff5f406d9c0 msgr2=0x7ff5f40710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:23.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.882+0000 7ff5f9f3b640 1 --2- 172.21.15.114:0/3425921195 >> v2:172.21.15.141:3300/0 conn(0x7ff5f406d9c0 0x7ff5f40710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.882+0000 7ff5f9f3b640 1 -- 172.21.15.114:0/3425921195 >> v1:172.21.15.141:6789/0 conn(0x7ff5f40ade00 legacy=0x7ff5f40b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.882+0000 7ff5f9f3b640 1 -- 172.21.15.114:0/3425921195 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f40b0e60 con 0x7ff5f406c5f0 2023-11-04T01:43:23.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.882+0000 7ff5f8f39640 1 --2- 172.21.15.114:0/3425921195 >> v2:172.21.15.141:3300/0 conn(0x7ff5f406d9c0 0x7ff5f40710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:23.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.883+0000 7ff5f9f3b640 1 --2- 172.21.15.114:0/3425921195 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5f406c5f0 0x7ff5f4071610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009e50 tx=0x7ff5ec02be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=455e52135144c03e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.883+0000 7ff5ebfff640 1 -- 172.21.15.114:0/3425921195 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec02c9e0 con 0x7ff5f406c5f0 2023-11-04T01:43:23.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.883+0000 7ff5ebfff640 1 -- 172.21.15.114:0/3425921195 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec02cb40 con 0x7ff5f406c5f0 2023-11-04T01:43:23.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.883+0000 7ff5ebfff640 1 -- 172.21.15.114:0/3425921195 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0343f0 con 0x7ff5f406c5f0 2023-11-04T01:43:23.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.884+0000 7ff5fb99e640 1 -- 172.21.15.114:0/3425921195 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5f406c5f0 msgr2=0x7ff5f4071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.884+0000 7ff5fb99e640 1 --2- 172.21.15.114:0/3425921195 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5f406c5f0 0x7ff5f4071610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009e50 tx=0x7ff5ec02be40 comp rx=0 tx=0).stop 2023-11-04T01:43:23.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.884+0000 7ff5fb99e640 1 -- 172.21.15.114:0/3425921195 shutdown_connections 2023-11-04T01:43:23.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.884+0000 7ff5fb99e640 1 --2- 172.21.15.114:0/3425921195 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5f406c5f0 0x7ff5f4071610 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.884+0000 7ff5fb99e640 1 --2- 172.21.15.114:0/3425921195 >> v2:172.21.15.141:3300/0 conn(0x7ff5f406d9c0 0x7ff5f40710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.884+0000 7ff5fb99e640 1 -- 172.21.15.114:0/3425921195 >> 172.21.15.114:0/3425921195 conn(0x7ff5f40cb530 msgr2=0x7ff5f40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:23.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.884+0000 7ff5fb99e640 1 -- 172.21.15.114:0/3425921195 shutdown_connections 2023-11-04T01:43:23.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.884+0000 7ff5fb99e640 1 -- 172.21.15.114:0/3425921195 wait complete. 2023-11-04T01:43:23.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.885+0000 7ff5fb99e640 1 Processor -- start 2023-11-04T01:43:23.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.885+0000 7ff5fb99e640 1 -- start start 2023-11-04T01:43:23.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5fb99e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5f406c5f0 0x7ff5f40c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5fb99e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5f406d9c0 0x7ff5f41efd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5fb99e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f40ade00 0x7ff5f40c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5fb99e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f414ac80 con 0x7ff5f40ade00 2023-11-04T01:43:23.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5fb99e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f414af20 con 0x7ff5f406d9c0 2023-11-04T01:43:23.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5fb99e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f414b200 con 0x7ff5f406c5f0 2023-11-04T01:43:23.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5f9f3b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f40ade00 0x7ff5f40c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5f9f3b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f40ade00 0x7ff5f40c3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38608/0 (socket says 172.21.15.114:38608) 2023-11-04T01:43:23.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5f9f3b640 1 -- 172.21.15.114:0/2878373202 learned_addr learned my addr 172.21.15.114:0/2878373202 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:23.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5f8f39640 1 --2- 172.21.15.114:0/2878373202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5f406d9c0 0x7ff5f41efd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5f973a640 1 --2- 172.21.15.114:0/2878373202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5f406c5f0 0x7ff5f40c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5f9f3b640 1 -- 172.21.15.114:0/2878373202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5f406c5f0 msgr2=0x7ff5f40c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5f9f3b640 1 --2- 172.21.15.114:0/2878373202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5f406c5f0 0x7ff5f40c4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5f9f3b640 1 -- 172.21.15.114:0/2878373202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5f406d9c0 msgr2=0x7ff5f41efd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5f9f3b640 1 --2- 172.21.15.114:0/2878373202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5f406d9c0 0x7ff5f41efd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5f9f3b640 1 -- 172.21.15.114:0/2878373202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e4009400 con 0x7ff5f40ade00 2023-11-04T01:43:23.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5f9f3b640 1 --2- 172.21.15.114:0/2878373202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f40ade00 0x7ff5f40c3af0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec036040 tx=0x7ff5ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5e9ffb640 1 -- 172.21.15.114:0/2878373202 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec009510 con 0x7ff5f40ade00 2023-11-04T01:43:23.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5e9ffb640 1 -- 172.21.15.114:0/2878373202 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec03e450 con 0x7ff5f40ade00 2023-11-04T01:43:23.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5e9ffb640 1 -- 172.21.15.114:0/2878373202 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec03e820 con 0x7ff5f40ade00 2023-11-04T01:43:23.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.886+0000 7ff5fb99e640 1 -- 172.21.15.114:0/2878373202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ec009b30 con 0x7ff5f40ade00 2023-11-04T01:43:23.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.887+0000 7ff5fb99e640 1 -- 172.21.15.114:0/2878373202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f414b7c0 con 0x7ff5f40ade00 2023-11-04T01:43:23.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.888+0000 7ff5fb99e640 1 -- 172.21.15.114:0/2878373202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f414b950 con 0x7ff5f40ade00 2023-11-04T01:43:23.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.888+0000 7ff5e9ffb640 1 -- 172.21.15.114:0/2878373202 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5ec03e980 con 0x7ff5f40ade00 2023-11-04T01:43:23.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.889+0000 7ff5e9ffb640 1 --2- 172.21.15.114:0/2878373202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff5d806aea0 0x7ff5d806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.889+0000 7ff5f973a640 1 --2- 172.21.15.114:0/2878373202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff5d806aea0 0x7ff5d806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.889+0000 7ff5e9ffb640 1 -- 172.21.15.114:0/2878373202 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7909+0+0 (secure 0 0 0) 0x7ff5ec0acb20 con 0x7ff5f40ade00 2023-11-04T01:43:23.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.889+0000 7ff5f973a640 1 --2- 172.21.15.114:0/2878373202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff5d806aea0 0x7ff5d806d360 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0000f60 tx=0x7ff5f0007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:23.893+0000 7ff5e9ffb640 1 -- 172.21.15.114:0/2878373202 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff5ec0773c0 con 0x7ff5f40ade00 2023-11-04T01:43:24.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.095+0000 7ff5fb99e640 1 -- 172.21.15.114:0/2878373202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5f40684b0 con 0x7ff5f40ade00 2023-11-04T01:43:24.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.096+0000 7ff5e9ffb640 1 -- 172.21.15.114:0/2878373202 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4947 (secure 0 0 0) 0x7ff5ec07a9e0 con 0x7ff5f40ade00 2023-11-04T01:43:24.098 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:24.098 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":101,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:19.435841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:24.098 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 101 2023-11-04T01:43:24.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.098+0000 7ff5fb99e640 1 -- 172.21.15.114:0/2878373202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff5d806aea0 msgr2=0x7ff5d806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.098+0000 7ff5fb99e640 1 --2- 172.21.15.114:0/2878373202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff5d806aea0 0x7ff5d806d360 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0000f60 tx=0x7ff5f0007ce0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.098+0000 7ff5fb99e640 1 -- 172.21.15.114:0/2878373202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f40ade00 msgr2=0x7ff5f40c3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.098+0000 7ff5fb99e640 1 --2- 172.21.15.114:0/2878373202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f40ade00 0x7ff5f40c3af0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec036040 tx=0x7ff5ec004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:24.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.098+0000 7ff5fb99e640 1 -- 172.21.15.114:0/2878373202 shutdown_connections 2023-11-04T01:43:24.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.098+0000 7ff5fb99e640 1 --2- 172.21.15.114:0/2878373202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f40ade00 0x7ff5f40c3af0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.098+0000 7ff5fb99e640 1 --2- 172.21.15.114:0/2878373202 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff5d806aea0 0x7ff5d806d360 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.098+0000 7ff5fb99e640 1 --2- 172.21.15.114:0/2878373202 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff5f406d9c0 0x7ff5f41efd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.098+0000 7ff5fb99e640 1 --2- 172.21.15.114:0/2878373202 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff5f406c5f0 0x7ff5f40c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.098+0000 7ff5fb99e640 1 -- 172.21.15.114:0/2878373202 >> 172.21.15.114:0/2878373202 conn(0x7ff5f40cb530 msgr2=0x7ff5f40b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.098+0000 7ff5fb99e640 1 -- 172.21.15.114:0/2878373202 shutdown_connections 2023-11-04T01:43:24.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.098+0000 7ff5fb99e640 1 -- 172.21.15.114:0/2878373202 wait complete. 2023-11-04T01:43:24.110 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:43:24.110 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:24.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.208+0000 7efc879b7640 1 Processor -- start 2023-11-04T01:43:24.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.208+0000 7efc879b7640 1 -- start start 2023-11-04T01:43:24.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc879b7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc80159e40 0x7efc800b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc879b7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efc8006bb60 0x7efc800b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc879b7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc80071500 con 0x7efc8006fff0 2023-11-04T01:43:24.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc879b7640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8015dae0 con 0x7efc8006bb60 2023-11-04T01:43:24.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc879b7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc80070c60 con 0x7efc80159e40 2023-11-04T01:43:24.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc85f54640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7efc8006fff0 0x7efc80070480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:36080/0 (socket says 172.21.15.114:36080) 2023-11-04T01:43:24.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc85f54640 1 -- 172.21.15.114:0/3549371849 learned_addr learned my addr 172.21.15.114:0/3549371849 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:43:24.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc85753640 1 --2- 172.21.15.114:0/3549371849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc80159e40 0x7efc800b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc84f52640 1 --2- 172.21.15.114:0/3549371849 >> v2:172.21.15.141:3300/0 conn(0x7efc8006bb60 0x7efc800b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc77fff640 1 -- 172.21.15.114:0/3549371849 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753775424 0 0) 0x7efc80071500 con 0x7efc8006fff0 2023-11-04T01:43:24.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc77fff640 1 -- 172.21.15.114:0/3549371849 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc6c003520 con 0x7efc8006fff0 2023-11-04T01:43:24.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc77fff640 1 -- 172.21.15.114:0/3549371849 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1826569389 0 0) 0x7efc6c003520 con 0x7efc8006fff0 2023-11-04T01:43:24.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc77fff640 1 -- 172.21.15.114:0/3549371849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc80159e40 msgr2=0x7efc800b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc77fff640 1 --2- 172.21.15.114:0/3549371849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc80159e40 0x7efc800b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc77fff640 1 -- 172.21.15.114:0/3549371849 >> v2:172.21.15.141:3300/0 conn(0x7efc8006bb60 msgr2=0x7efc800b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc77fff640 1 --2- 172.21.15.114:0/3549371849 >> v2:172.21.15.141:3300/0 conn(0x7efc8006bb60 0x7efc800b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc77fff640 1 -- 172.21.15.114:0/3549371849 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc80070f40 con 0x7efc8006fff0 2023-11-04T01:43:24.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc77fff640 1 -- 172.21.15.114:0/3549371849 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7efc780019f0 con 0x7efc8006fff0 2023-11-04T01:43:24.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc77fff640 1 -- 172.21.15.114:0/3549371849 >> v1:172.21.15.114:6789/0 conn(0x7efc8006fff0 legacy=0x7efc80070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc77fff640 1 --2- 172.21.15.114:0/3549371849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc6c003970 0x7efc6c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc77fff640 1 --2- 172.21.15.114:0/3549371849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc80159e40 0x7efc6c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc77fff640 1 --2- 172.21.15.114:0/3549371849 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc6c004d00 0x7efc6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc77fff640 1 -- 172.21.15.114:0/3549371849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8015dae0 con 0x7efc6c003970 2023-11-04T01:43:24.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc77fff640 1 -- 172.21.15.114:0/3549371849 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc80070c60 con 0x7efc6c004d00 2023-11-04T01:43:24.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc77fff640 1 -- 172.21.15.114:0/3549371849 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c00b980 con 0x7efc80159e40 2023-11-04T01:43:24.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.209+0000 7efc85753640 1 --2- 172.21.15.114:0/3549371849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc6c003970 0x7efc6c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.210+0000 7efc84f52640 1 --2- 172.21.15.114:0/3549371849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc80159e40 0x7efc6c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.210+0000 7efc85f54640 1 --2- 172.21.15.114:0/3549371849 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc6c004d00 0x7efc6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.210+0000 7efc85753640 1 -- 172.21.15.114:0/3549371849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc80159e40 msgr2=0x7efc6c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.210+0000 7efc85753640 1 --2- 172.21.15.114:0/3549371849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc80159e40 0x7efc6c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.210+0000 7efc85753640 1 -- 172.21.15.114:0/3549371849 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc6c004d00 msgr2=0x7efc6c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.210+0000 7efc85753640 1 --2- 172.21.15.114:0/3549371849 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc6c004d00 0x7efc6c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.210+0000 7efc85753640 1 -- 172.21.15.114:0/3549371849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c003520 con 0x7efc6c003970 2023-11-04T01:43:24.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.210+0000 7efc85f54640 1 --2- 172.21.15.114:0/3549371849 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc6c004d00 0x7efc6c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:24.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.210+0000 7efc85753640 1 --2- 172.21.15.114:0/3549371849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc6c003970 0x7efc6c003d90 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009650 tx=0x7efc6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3777a4e8436cf6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.210+0000 7efc77fff640 1 -- 172.21.15.114:0/3549371849 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c02e8c0 con 0x7efc6c003970 2023-11-04T01:43:24.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.211+0000 7efc77fff640 1 -- 172.21.15.114:0/3549371849 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c02ea20 con 0x7efc6c003970 2023-11-04T01:43:24.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.211+0000 7efc77fff640 1 -- 172.21.15.114:0/3549371849 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c02edb0 con 0x7efc6c003970 2023-11-04T01:43:24.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.211+0000 7efc879b7640 1 -- 172.21.15.114:0/3549371849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc6c003970 msgr2=0x7efc6c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.211+0000 7efc879b7640 1 --2- 172.21.15.114:0/3549371849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc6c003970 0x7efc6c003d90 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009650 tx=0x7efc6c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.211+0000 7efc85f54640 1 -- 172.21.15.114:0/3549371849 reap_dead start 2023-11-04T01:43:24.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.211+0000 7efc879b7640 1 -- 172.21.15.114:0/3549371849 shutdown_connections 2023-11-04T01:43:24.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.211+0000 7efc879b7640 1 -- 172.21.15.114:0/3549371849 >> 172.21.15.114:0/3549371849 conn(0x7efc800cb530 msgr2=0x7efc800cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.211+0000 7efc879b7640 1 -- 172.21.15.114:0/3549371849 shutdown_connections 2023-11-04T01:43:24.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.211+0000 7efc879b7640 1 -- 172.21.15.114:0/3549371849 wait complete. 2023-11-04T01:43:24.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.212+0000 7efc879b7640 1 Processor -- start 2023-11-04T01:43:24.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.212+0000 7efc879b7640 1 -- start start 2023-11-04T01:43:24.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc879b7640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc6c003970 0x7efc800acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc879b7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc80152ad0 0x7efc80152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc879b7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc800c4bc0 0x7efc800c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc879b7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc80153550 con 0x7efc80152ad0 2023-11-04T01:43:24.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc879b7640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc80153830 con 0x7efc6c003970 2023-11-04T01:43:24.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc879b7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8015a3e0 con 0x7efc800c4bc0 2023-11-04T01:43:24.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc84f52640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc80152ad0 0x7efc80152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc84f52640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc80152ad0 0x7efc80152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38622/0 (socket says 172.21.15.114:38622) 2023-11-04T01:43:24.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc84f52640 1 -- 172.21.15.114:0/3191938013 learned_addr learned my addr 172.21.15.114:0/3191938013 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:24.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc84f52640 1 -- 172.21.15.114:0/3191938013 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc800c4bc0 msgr2=0x7efc800c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc85753640 1 --2- 172.21.15.114:0/3191938013 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc6c003970 0x7efc800acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc85f54640 1 --2- 172.21.15.114:0/3191938013 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc800c4bc0 0x7efc800c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc84f52640 1 --2- 172.21.15.114:0/3191938013 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc800c4bc0 0x7efc800c5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc84f52640 1 -- 172.21.15.114:0/3191938013 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc6c003970 msgr2=0x7efc800acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc84f52640 1 --2- 172.21.15.114:0/3191938013 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc6c003970 0x7efc800acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc84f52640 1 -- 172.21.15.114:0/3191938013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8015a6c0 con 0x7efc80152ad0 2023-11-04T01:43:24.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc85753640 1 --2- 172.21.15.114:0/3191938013 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc6c003970 0x7efc800acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:24.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.213+0000 7efc84f52640 1 --2- 172.21.15.114:0/3191938013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc80152ad0 0x7efc80152f50 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7efc70011a70 tx=0x7efc70011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.214+0000 7efc75ffb640 1 -- 172.21.15.114:0/3191938013 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70009680 con 0x7efc80152ad0 2023-11-04T01:43:24.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.214+0000 7efc75ffb640 1 -- 172.21.15.114:0/3191938013 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7000fb50 con 0x7efc80152ad0 2023-11-04T01:43:24.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.214+0000 7efc879b7640 1 -- 172.21.15.114:0/3191938013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc800c5580 con 0x7efc80152ad0 2023-11-04T01:43:24.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.214+0000 7efc75ffb640 1 -- 172.21.15.114:0/3191938013 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7000fee0 con 0x7efc80152ad0 2023-11-04T01:43:24.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.214+0000 7efc879b7640 1 -- 172.21.15.114:0/3191938013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc800ad080 con 0x7efc80152ad0 2023-11-04T01:43:24.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.215+0000 7efc879b7640 1 -- 172.21.15.114:0/3191938013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc8015a220 con 0x7efc80152ad0 2023-11-04T01:43:24.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.215+0000 7efc75ffb640 1 -- 172.21.15.114:0/3191938013 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc70014440 con 0x7efc80152ad0 2023-11-04T01:43:24.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.216+0000 7efc75ffb640 1 --2- 172.21.15.114:0/3191938013 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efc6406aea0 0x7efc6406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.216+0000 7efc85753640 1 --2- 172.21.15.114:0/3191938013 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efc6406aea0 0x7efc6406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.216+0000 7efc75ffb640 1 -- 172.21.15.114:0/3191938013 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7909+0+0 (secure 0 0 0) 0x7efc7008a640 con 0x7efc80152ad0 2023-11-04T01:43:24.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.216+0000 7efc85753640 1 --2- 172.21.15.114:0/3191938013 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efc6406aea0 0x7efc6406d360 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7efc7c038000 tx=0x7efc7c032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.220+0000 7efc75ffb640 1 -- 172.21.15.114:0/3191938013 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc70054e50 con 0x7efc80152ad0 2023-11-04T01:43:24.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.421+0000 7efc879b7640 1 -- 172.21.15.114:0/3191938013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc8015a850 con 0x7efc80152ad0 2023-11-04T01:43:24.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.421+0000 7efc75ffb640 1 -- 172.21.15.114:0/3191938013 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4947 (secure 0 0 0) 0x7efc70058470 con 0x7efc80152ad0 2023-11-04T01:43:24.423 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:24.423 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":101,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:19.435841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:24.424 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 101 2023-11-04T01:43:24.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.423+0000 7efc879b7640 1 -- 172.21.15.114:0/3191938013 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efc6406aea0 msgr2=0x7efc6406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.423+0000 7efc879b7640 1 --2- 172.21.15.114:0/3191938013 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efc6406aea0 0x7efc6406d360 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7efc7c038000 tx=0x7efc7c032000 comp rx=0 tx=0).stop 2023-11-04T01:43:24.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.423+0000 7efc879b7640 1 -- 172.21.15.114:0/3191938013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc80152ad0 msgr2=0x7efc80152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.423+0000 7efc879b7640 1 --2- 172.21.15.114:0/3191938013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc80152ad0 0x7efc80152f50 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7efc70011a70 tx=0x7efc70011f30 comp rx=0 tx=0).stop 2023-11-04T01:43:24.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.423+0000 7efc879b7640 1 -- 172.21.15.114:0/3191938013 shutdown_connections 2023-11-04T01:43:24.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.423+0000 7efc879b7640 1 --2- 172.21.15.114:0/3191938013 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efc800c4bc0 0x7efc800c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.423+0000 7efc879b7640 1 --2- 172.21.15.114:0/3191938013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc80152ad0 0x7efc80152f50 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.423+0000 7efc879b7640 1 --2- 172.21.15.114:0/3191938013 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7efc6406aea0 0x7efc6406d360 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.423+0000 7efc879b7640 1 --2- 172.21.15.114:0/3191938013 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7efc6c003970 0x7efc800acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.423+0000 7efc879b7640 1 -- 172.21.15.114:0/3191938013 >> 172.21.15.114:0/3191938013 conn(0x7efc800cb530 msgr2=0x7efc8015dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.423+0000 7efc879b7640 1 -- 172.21.15.114:0/3191938013 shutdown_connections 2023-11-04T01:43:24.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:24.423+0000 7efc879b7640 1 -- 172.21.15.114:0/3191938013 wait complete. 2023-11-04T01:43:24.435 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:43:24.914 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:43:25.437 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.545+0000 7fbc3f7cc640 1 Processor -- start 2023-11-04T01:43:25.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.545+0000 7fbc3f7cc640 1 -- start start 2023-11-04T01:43:25.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.546+0000 7fbc3f7cc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc38159e40 0x7fbc380b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.546+0000 7fbc3f7cc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fbc3806bb60 0x7fbc380b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.546+0000 7fbc3f7cc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbc3806fff0 0x7fbc38070480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.546+0000 7fbc3f7cc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc38071500 con 0x7fbc3806fff0 2023-11-04T01:43:25.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.546+0000 7fbc3f7cc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3815dae0 con 0x7fbc3806bb60 2023-11-04T01:43:25.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.546+0000 7fbc3f7cc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380709c0 con 0x7fbc38159e40 2023-11-04T01:43:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.546+0000 7fbc3dd69640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbc3806fff0 0x7fbc38070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.546+0000 7fbc3dd69640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbc3806fff0 0x7fbc38070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38626/0 (socket says 172.21.15.114:38626) 2023-11-04T01:43:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.546+0000 7fbc3dd69640 1 -- 172.21.15.114:0/3206210169 learned_addr learned my addr 172.21.15.114:0/3206210169 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.546+0000 7fbc3d568640 1 --2- 172.21.15.114:0/3206210169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc38159e40 0x7fbc380b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.546+0000 7fbc3cd67640 1 --2- 172.21.15.114:0/3206210169 >> v2:172.21.15.141:3300/0 conn(0x7fbc3806bb60 0x7fbc380b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.546+0000 7fbc3dd69640 1 -- 172.21.15.114:0/3206210169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc38159e40 msgr2=0x7fbc380b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.546+0000 7fbc3dd69640 1 --2- 172.21.15.114:0/3206210169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc38159e40 0x7fbc380b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.546+0000 7fbc3dd69640 1 -- 172.21.15.114:0/3206210169 >> v2:172.21.15.141:3300/0 conn(0x7fbc3806bb60 msgr2=0x7fbc380b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.546+0000 7fbc3dd69640 1 --2- 172.21.15.114:0/3206210169 >> v2:172.21.15.141:3300/0 conn(0x7fbc3806bb60 0x7fbc380b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.546+0000 7fbc3dd69640 1 -- 172.21.15.114:0/3206210169 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc38070c60 con 0x7fbc3806fff0 2023-11-04T01:43:25.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.547+0000 7fbc3dd69640 1 --2- 172.21.15.114:0/3206210169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc3806fff0 0x7fbc38070480 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fbc380ce820 tx=0x7fbc3002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79941eb3f0bfe37 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.547+0000 7fbc2ffff640 1 -- 172.21.15.114:0/3206210169 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3002c9e0 con 0x7fbc3806fff0 2023-11-04T01:43:25.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.547+0000 7fbc2ffff640 1 -- 172.21.15.114:0/3206210169 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3002cb40 con 0x7fbc3806fff0 2023-11-04T01:43:25.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.547+0000 7fbc2ffff640 1 -- 172.21.15.114:0/3206210169 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc300343f0 con 0x7fbc3806fff0 2023-11-04T01:43:25.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.548+0000 7fbc3f7cc640 1 -- 172.21.15.114:0/3206210169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc3806fff0 msgr2=0x7fbc38070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.548+0000 7fbc3f7cc640 1 --2- 172.21.15.114:0/3206210169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc3806fff0 0x7fbc38070480 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fbc380ce820 tx=0x7fbc3002be40 comp rx=0 tx=0).stop 2023-11-04T01:43:25.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.548+0000 7fbc3f7cc640 1 -- 172.21.15.114:0/3206210169 shutdown_connections 2023-11-04T01:43:25.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.548+0000 7fbc3f7cc640 1 --2- 172.21.15.114:0/3206210169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc3806fff0 0x7fbc38070480 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.548+0000 7fbc3f7cc640 1 --2- 172.21.15.114:0/3206210169 >> v2:172.21.15.141:3300/0 conn(0x7fbc3806bb60 0x7fbc380b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.548+0000 7fbc3f7cc640 1 --2- 172.21.15.114:0/3206210169 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc38159e40 0x7fbc380b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.548+0000 7fbc3f7cc640 1 -- 172.21.15.114:0/3206210169 >> 172.21.15.114:0/3206210169 conn(0x7fbc380cb530 msgr2=0x7fbc380cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.548+0000 7fbc3f7cc640 1 -- 172.21.15.114:0/3206210169 shutdown_connections 2023-11-04T01:43:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.548+0000 7fbc3f7cc640 1 -- 172.21.15.114:0/3206210169 wait complete. 2023-11-04T01:43:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.549+0000 7fbc3f7cc640 1 Processor -- start 2023-11-04T01:43:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.549+0000 7fbc3f7cc640 1 -- start start 2023-11-04T01:43:25.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3f7cc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc3806bb60 0x7fbc3814a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3f7cc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc3806fff0 0x7fbc380cece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3f7cc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc38159e40 0x7fbc381f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3f7cc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc381479b0 con 0x7fbc38159e40 2023-11-04T01:43:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3f7cc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3814a370 con 0x7fbc3806fff0 2023-11-04T01:43:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3f7cc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3814dfc0 con 0x7fbc3806bb60 2023-11-04T01:43:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3dd69640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc38159e40 0x7fbc381f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3dd69640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc38159e40 0x7fbc381f3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38630/0 (socket says 172.21.15.114:38630) 2023-11-04T01:43:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3dd69640 1 -- 172.21.15.114:0/512400344 learned_addr learned my addr 172.21.15.114:0/512400344 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3cd67640 1 --2- 172.21.15.114:0/512400344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc3806fff0 0x7fbc380cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3d568640 1 --2- 172.21.15.114:0/512400344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc3806bb60 0x7fbc3814a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3dd69640 1 -- 172.21.15.114:0/512400344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc3806bb60 msgr2=0x7fbc3814a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3dd69640 1 --2- 172.21.15.114:0/512400344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc3806bb60 0x7fbc3814a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3dd69640 1 -- 172.21.15.114:0/512400344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc3806fff0 msgr2=0x7fbc380cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3dd69640 1 --2- 172.21.15.114:0/512400344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc3806fff0 0x7fbc380cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3dd69640 1 -- 172.21.15.114:0/512400344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc30009b30 con 0x7fbc38159e40 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3cd67640 1 --2- 172.21.15.114:0/512400344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc3806fff0 0x7fbc380cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3d568640 1 --2- 172.21.15.114:0/512400344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc3806bb60 0x7fbc3814a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3dd69640 1 --2- 172.21.15.114:0/512400344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc38159e40 0x7fbc381f3b20 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fbc30036040 tx=0x7fbc30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc2dffb640 1 -- 172.21.15.114:0/512400344 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc30009510 con 0x7fbc38159e40 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc2dffb640 1 -- 172.21.15.114:0/512400344 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3003e450 con 0x7fbc38159e40 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc3f7cc640 1 -- 172.21.15.114:0/512400344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc381f4700 con 0x7fbc38159e40 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.550+0000 7fbc2dffb640 1 -- 172.21.15.114:0/512400344 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3003e7e0 con 0x7fbc38159e40 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.551+0000 7fbc3f7cc640 1 -- 172.21.15.114:0/512400344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc38149d20 con 0x7fbc38159e40 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.552+0000 7fbc3f7cc640 1 -- 172.21.15.114:0/512400344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3814a500 con 0x7fbc38159e40 2023-11-04T01:43:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.552+0000 7fbc2dffb640 1 -- 172.21.15.114:0/512400344 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc3003e940 con 0x7fbc38159e40 2023-11-04T01:43:25.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.552+0000 7fbc2dffb640 1 --2- 172.21.15.114:0/512400344 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbc1c06aea0 0x7fbc1c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.552+0000 7fbc2dffb640 1 -- 172.21.15.114:0/512400344 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7909+0+0 (secure 0 0 0) 0x7fbc300ac980 con 0x7fbc38159e40 2023-11-04T01:43:25.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.552+0000 7fbc3d568640 1 --2- 172.21.15.114:0/512400344 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbc1c06aea0 0x7fbc1c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.553+0000 7fbc3d568640 1 --2- 172.21.15.114:0/512400344 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbc1c06aea0 0x7fbc1c06d360 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbc34006fd0 tx=0x7fbc34008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.557+0000 7fbc2dffb640 1 -- 172.21.15.114:0/512400344 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc30077190 con 0x7fbc38159e40 2023-11-04T01:43:25.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.758+0000 7fbc3f7cc640 1 -- 172.21.15.114:0/512400344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc380684b0 con 0x7fbc38159e40 2023-11-04T01:43:25.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.758+0000 7fbc2dffb640 1 -- 172.21.15.114:0/512400344 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4947 (secure 0 0 0) 0x7fbc30047e90 con 0x7fbc38159e40 2023-11-04T01:43:25.760 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:25.760 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":101,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:19.435841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:25.760 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 101 2023-11-04T01:43:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.760+0000 7fbc3f7cc640 1 -- 172.21.15.114:0/512400344 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbc1c06aea0 msgr2=0x7fbc1c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.760+0000 7fbc3f7cc640 1 --2- 172.21.15.114:0/512400344 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbc1c06aea0 0x7fbc1c06d360 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbc34006fd0 tx=0x7fbc34008040 comp rx=0 tx=0).stop 2023-11-04T01:43:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.760+0000 7fbc3f7cc640 1 -- 172.21.15.114:0/512400344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc38159e40 msgr2=0x7fbc381f3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.760+0000 7fbc3f7cc640 1 --2- 172.21.15.114:0/512400344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc38159e40 0x7fbc381f3b20 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fbc30036040 tx=0x7fbc30004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.760+0000 7fbc3f7cc640 1 -- 172.21.15.114:0/512400344 shutdown_connections 2023-11-04T01:43:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.760+0000 7fbc3f7cc640 1 --2- 172.21.15.114:0/512400344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc38159e40 0x7fbc381f3b20 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.760+0000 7fbc3f7cc640 1 --2- 172.21.15.114:0/512400344 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbc1c06aea0 0x7fbc1c06d360 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.760+0000 7fbc3f7cc640 1 --2- 172.21.15.114:0/512400344 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbc3806fff0 0x7fbc380cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.760+0000 7fbc3f7cc640 1 --2- 172.21.15.114:0/512400344 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbc3806bb60 0x7fbc3814a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.760+0000 7fbc3f7cc640 1 -- 172.21.15.114:0/512400344 >> 172.21.15.114:0/512400344 conn(0x7fbc380cb530 msgr2=0x7fbc380ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.760+0000 7fbc3f7cc640 1 -- 172.21.15.114:0/512400344 shutdown_connections 2023-11-04T01:43:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:25.760+0000 7fbc3f7cc640 1 -- 172.21.15.114:0/512400344 wait complete. 2023-11-04T01:43:25.772 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:43:26.774 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:26.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.883+0000 7f829c294640 1 Processor -- start 2023-11-04T01:43:26.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.883+0000 7f829c294640 1 -- start start 2023-11-04T01:43:26.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.884+0000 7f829c294640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f829415ade0 0x7f829406c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.884+0000 7f829c294640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82940b1440 0x7f8294066010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.884+0000 7f829c294640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82940ad6a0 con 0x7f829406b740 2023-11-04T01:43:26.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.884+0000 7f829c294640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82940acaf0 con 0x7f829415ade0 2023-11-04T01:43:26.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.884+0000 7f829c294640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82940acdd0 con 0x7f82940b1440 2023-11-04T01:43:26.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.885+0000 7f829a030640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f829415ade0 0x7f829406c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.885+0000 7f829a831640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82940b1440 0x7f8294066010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.885+0000 7f829a831640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82940b1440 0x7f8294066010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:58240/0 (socket says 172.21.15.114:58240) 2023-11-04T01:43:26.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.885+0000 7f829a831640 1 -- 172.21.15.114:0/3334308567 learned_addr learned my addr 172.21.15.114:0/3334308567 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:26.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.885+0000 7f829a831640 1 -- 172.21.15.114:0/3334308567 >> v2:172.21.15.141:3300/0 conn(0x7f829415ade0 msgr2=0x7f829406c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.885+0000 7f829a831640 1 --2- 172.21.15.114:0/3334308567 >> v2:172.21.15.141:3300/0 conn(0x7f829415ade0 0x7f829406c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.885+0000 7f829a831640 1 -- 172.21.15.114:0/3334308567 >> v1:172.21.15.141:6789/0 conn(0x7f829406b740 legacy=0x7f82940b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.885+0000 7f829a831640 1 -- 172.21.15.114:0/3334308567 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82940ad0e0 con 0x7f82940b1440 2023-11-04T01:43:26.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.885+0000 7f829a030640 1 --2- 172.21.15.114:0/3334308567 >> v2:172.21.15.141:3300/0 conn(0x7f829415ade0 0x7f829406c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:26.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.886+0000 7f829a831640 1 --2- 172.21.15.114:0/3334308567 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82940b1440 0x7f8294066010 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f828c009870 tx=0x7f828c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=431d3285d74c3687 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.886+0000 7f829902e640 1 -- 172.21.15.114:0/3334308567 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c031640 con 0x7f82940b1440 2023-11-04T01:43:26.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.886+0000 7f829902e640 1 -- 172.21.15.114:0/3334308567 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c0317a0 con 0x7f82940b1440 2023-11-04T01:43:26.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.886+0000 7f829902e640 1 -- 172.21.15.114:0/3334308567 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c031b30 con 0x7f82940b1440 2023-11-04T01:43:26.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.887+0000 7f829c294640 1 -- 172.21.15.114:0/3334308567 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82940b1440 msgr2=0x7f8294066010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.887+0000 7f829c294640 1 --2- 172.21.15.114:0/3334308567 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82940b1440 0x7f8294066010 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f828c009870 tx=0x7f828c02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.887+0000 7f829c294640 1 -- 172.21.15.114:0/3334308567 shutdown_connections 2023-11-04T01:43:26.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.887+0000 7f829c294640 1 --2- 172.21.15.114:0/3334308567 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82940b1440 0x7f8294066010 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.887+0000 7f829c294640 1 --2- 172.21.15.114:0/3334308567 >> v2:172.21.15.141:3300/0 conn(0x7f829415ade0 0x7f829406c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.887+0000 7f829c294640 1 -- 172.21.15.114:0/3334308567 >> 172.21.15.114:0/3334308567 conn(0x7f82940cbd30 msgr2=0x7f82940cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.887+0000 7f829c294640 1 -- 172.21.15.114:0/3334308567 shutdown_connections 2023-11-04T01:43:26.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.887+0000 7f829c294640 1 -- 172.21.15.114:0/3334308567 wait complete. 2023-11-04T01:43:26.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.888+0000 7f829c294640 1 Processor -- start 2023-11-04T01:43:26.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.888+0000 7f829c294640 1 -- start start 2023-11-04T01:43:26.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829c294640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f829406b740 0x7f82940c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829c294640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82940b1440 0x7f82940713a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829c294640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f829415ade0 0x7f82940af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829c294640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82940b0ce0 con 0x7f82940b1440 2023-11-04T01:43:26.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829c294640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82940b0440 con 0x7f829406b740 2023-11-04T01:43:26.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829c294640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82940b0720 con 0x7f829415ade0 2023-11-04T01:43:26.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829982f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82940b1440 0x7f82940713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829982f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82940b1440 0x7f82940713a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56106/0 (socket says 172.21.15.114:56106) 2023-11-04T01:43:26.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829982f640 1 -- 172.21.15.114:0/2240412249 learned_addr learned my addr 172.21.15.114:0/2240412249 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:26.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829a831640 1 --2- 172.21.15.114:0/2240412249 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f829415ade0 0x7f82940af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829a030640 1 --2- 172.21.15.114:0/2240412249 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f829406b740 0x7f82940c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829982f640 1 -- 172.21.15.114:0/2240412249 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f829415ade0 msgr2=0x7f82940af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829982f640 1 --2- 172.21.15.114:0/2240412249 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f829415ade0 0x7f82940af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829982f640 1 -- 172.21.15.114:0/2240412249 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f829406b740 msgr2=0x7f82940c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829982f640 1 --2- 172.21.15.114:0/2240412249 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f829406b740 0x7f82940c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829982f640 1 -- 172.21.15.114:0/2240412249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8290009a70 con 0x7f82940b1440 2023-11-04T01:43:26.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829a030640 1 --2- 172.21.15.114:0/2240412249 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f829406b740 0x7f82940c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:26.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829982f640 1 --2- 172.21.15.114:0/2240412249 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82940b1440 0x7f82940713a0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f828400c450 tx=0x7f828400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f828affd640 1 -- 172.21.15.114:0/2240412249 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82840052d0 con 0x7f82940b1440 2023-11-04T01:43:26.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f828affd640 1 -- 172.21.15.114:0/2240412249 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8284005430 con 0x7f82940b1440 2023-11-04T01:43:26.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f829c294640 1 -- 172.21.15.114:0/2240412249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828c0094d0 con 0x7f82940b1440 2023-11-04T01:43:26.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.889+0000 7f828affd640 1 -- 172.21.15.114:0/2240412249 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284012870 con 0x7f82940b1440 2023-11-04T01:43:26.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.890+0000 7f829c294640 1 -- 172.21.15.114:0/2240412249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82940aed40 con 0x7f82940b1440 2023-11-04T01:43:26.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.891+0000 7f829c294640 1 -- 172.21.15.114:0/2240412249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82940c26f0 con 0x7f82940b1440 2023-11-04T01:43:26.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.891+0000 7f828affd640 1 -- 172.21.15.114:0/2240412249 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f82840129d0 con 0x7f82940b1440 2023-11-04T01:43:26.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.891+0000 7f828affd640 1 --2- 172.21.15.114:0/2240412249 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f827806ae70 0x7f827806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.891+0000 7f828affd640 1 -- 172.21.15.114:0/2240412249 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7909+0+0 (secure 0 0 0) 0x7f8284089960 con 0x7f82940b1440 2023-11-04T01:43:26.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.891+0000 7f829a030640 1 --2- 172.21.15.114:0/2240412249 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f827806ae70 0x7f827806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.892+0000 7f829a030640 1 --2- 172.21.15.114:0/2240412249 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f827806ae70 0x7f827806d330 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f82940b0060 tx=0x7f829000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:26.896+0000 7f828affd640 1 -- 172.21.15.114:0/2240412249 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8284054200 con 0x7f82940b1440 2023-11-04T01:43:27.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:27.096+0000 7f829c294640 1 -- 172.21.15.114:0/2240412249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82940ad3a0 con 0x7f82940b1440 2023-11-04T01:43:27.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:27.097+0000 7f828affd640 1 -- 172.21.15.114:0/2240412249 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4947 (secure 0 0 0) 0x7f82940ad3a0 con 0x7f82940b1440 2023-11-04T01:43:27.099 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:27.099 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":101,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:19.435841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:27.099 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 101 2023-11-04T01:43:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:27.099+0000 7f829c294640 1 -- 172.21.15.114:0/2240412249 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f827806ae70 msgr2=0x7f827806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:27.099+0000 7f829c294640 1 --2- 172.21.15.114:0/2240412249 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f827806ae70 0x7f827806d330 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f82940b0060 tx=0x7f829000b040 comp rx=0 tx=0).stop 2023-11-04T01:43:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:27.099+0000 7f829c294640 1 -- 172.21.15.114:0/2240412249 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82940b1440 msgr2=0x7f82940713a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:27.099+0000 7f829c294640 1 --2- 172.21.15.114:0/2240412249 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82940b1440 0x7f82940713a0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f828400c450 tx=0x7f828400c910 comp rx=0 tx=0).stop 2023-11-04T01:43:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:27.099+0000 7f829c294640 1 -- 172.21.15.114:0/2240412249 shutdown_connections 2023-11-04T01:43:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:27.099+0000 7f829c294640 1 --2- 172.21.15.114:0/2240412249 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f829415ade0 0x7f82940af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:27.099+0000 7f829c294640 1 --2- 172.21.15.114:0/2240412249 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82940b1440 0x7f82940713a0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:27.099+0000 7f829c294640 1 --2- 172.21.15.114:0/2240412249 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f827806ae70 0x7f827806d330 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:27.099+0000 7f829c294640 1 --2- 172.21.15.114:0/2240412249 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f829406b740 0x7f82940c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:27.099+0000 7f829c294640 1 -- 172.21.15.114:0/2240412249 >> 172.21.15.114:0/2240412249 conn(0x7f82940cbd30 msgr2=0x7f8294158460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:27.099+0000 7f829c294640 1 -- 172.21.15.114:0/2240412249 shutdown_connections 2023-11-04T01:43:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:27.099+0000 7f829c294640 1 -- 172.21.15.114:0/2240412249 wait complete. 2023-11-04T01:43:27.111 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:43:28.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:28.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.221+0000 7f6b3fe34640 1 Processor -- start 2023-11-04T01:43:28.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.222+0000 7f6b3fe34640 1 -- start start 2023-11-04T01:43:28.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.222+0000 7f6b3fe34640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6b3815d4e0 0x7f6b380d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.222+0000 7f6b3fe34640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b380d3b60 0x7f6b380d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.222+0000 7f6b3fe34640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b380b32b0 con 0x7f6b3815d100 2023-11-04T01:43:28.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.222+0000 7f6b3fe34640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b380cec20 con 0x7f6b3815d4e0 2023-11-04T01:43:28.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.222+0000 7f6b3fe34640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b380cee10 con 0x7f6b380d3b60 2023-11-04T01:43:28.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.223+0000 7f6b3e3d1640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b380d3b60 0x7f6b380d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:28.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.223+0000 7f6b3d3cf640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f6b3815d4e0 0x7f6b380d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:28.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.223+0000 7f6b3e3d1640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b380d3b60 0x7f6b380d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:58252/0 (socket says 172.21.15.114:58252) 2023-11-04T01:43:28.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.223+0000 7f6b3e3d1640 1 -- 172.21.15.114:0/3256891340 learned_addr learned my addr 172.21.15.114:0/3256891340 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:28.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.223+0000 7f6b3e3d1640 1 -- 172.21.15.114:0/3256891340 >> v2:172.21.15.141:3300/0 conn(0x7f6b3815d4e0 msgr2=0x7f6b380d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:28.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.223+0000 7f6b3e3d1640 1 --2- 172.21.15.114:0/3256891340 >> v2:172.21.15.141:3300/0 conn(0x7f6b3815d4e0 0x7f6b380d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.223+0000 7f6b3e3d1640 1 -- 172.21.15.114:0/3256891340 >> v1:172.21.15.141:6789/0 conn(0x7f6b3815d100 legacy=0x7f6b380ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.223+0000 7f6b3e3d1640 1 -- 172.21.15.114:0/3256891340 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b380b4750 con 0x7f6b380d3b60 2023-11-04T01:43:28.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.224+0000 7f6b3e3d1640 1 --2- 172.21.15.114:0/3256891340 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b380d3b60 0x7f6b380d1a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6b30009870 tx=0x7f6b3002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1564712814f08528 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:28.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.224+0000 7f6b3cbce640 1 -- 172.21.15.114:0/3256891340 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30030840 con 0x7f6b380d3b60 2023-11-04T01:43:28.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.224+0000 7f6b3cbce640 1 -- 172.21.15.114:0/3256891340 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b300309a0 con 0x7f6b380d3b60 2023-11-04T01:43:28.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.224+0000 7f6b3cbce640 1 -- 172.21.15.114:0/3256891340 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30030d30 con 0x7f6b380d3b60 2023-11-04T01:43:28.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.225+0000 7f6b3fe34640 1 -- 172.21.15.114:0/3256891340 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b380d3b60 msgr2=0x7f6b380d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.225+0000 7f6b3fe34640 1 --2- 172.21.15.114:0/3256891340 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b380d3b60 0x7f6b380d1a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6b30009870 tx=0x7f6b3002b980 comp rx=0 tx=0).stop 2023-11-04T01:43:28.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.225+0000 7f6b3fe34640 1 -- 172.21.15.114:0/3256891340 shutdown_connections 2023-11-04T01:43:28.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.225+0000 7f6b3fe34640 1 --2- 172.21.15.114:0/3256891340 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b380d3b60 0x7f6b380d1a10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.225+0000 7f6b3fe34640 1 --2- 172.21.15.114:0/3256891340 >> v2:172.21.15.141:3300/0 conn(0x7f6b3815d4e0 0x7f6b380d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.225+0000 7f6b3fe34640 1 -- 172.21.15.114:0/3256891340 >> 172.21.15.114:0/3256891340 conn(0x7f6b380d2ef0 msgr2=0x7f6b380d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:28.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.225+0000 7f6b3fe34640 1 -- 172.21.15.114:0/3256891340 shutdown_connections 2023-11-04T01:43:28.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.225+0000 7f6b3fe34640 1 -- 172.21.15.114:0/3256891340 wait complete. 2023-11-04T01:43:28.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.226+0000 7f6b3fe34640 1 Processor -- start 2023-11-04T01:43:28.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.226+0000 7f6b3fe34640 1 -- start start 2023-11-04T01:43:28.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.227+0000 7f6b3fe34640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b380d3b60 0x7f6b381597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.227+0000 7f6b3fe34640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3815d100 0x7f6b380b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.227+0000 7f6b3fe34640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b3815d4e0 0x7f6b3806b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.227+0000 7f6b3fe34640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b38159ce0 con 0x7f6b3815d100 2023-11-04T01:43:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.227+0000 7f6b3fe34640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b381f7110 con 0x7f6b380d3b60 2023-11-04T01:43:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.227+0000 7f6b3fe34640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b381f6590 con 0x7f6b3815d4e0 2023-11-04T01:43:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.227+0000 7f6b3d3cf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3815d100 0x7f6b380b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.227+0000 7f6b3d3cf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3815d100 0x7f6b380b81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56116/0 (socket says 172.21.15.114:56116) 2023-11-04T01:43:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.227+0000 7f6b3d3cf640 1 -- 172.21.15.114:0/1629640062 learned_addr learned my addr 172.21.15.114:0/1629640062 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.227+0000 7f6b3e3d1640 1 --2- 172.21.15.114:0/1629640062 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b3815d4e0 0x7f6b3806b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.227+0000 7f6b3dbd0640 1 --2- 172.21.15.114:0/1629640062 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b380d3b60 0x7f6b381597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.227+0000 7f6b3d3cf640 1 -- 172.21.15.114:0/1629640062 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b3815d4e0 msgr2=0x7f6b3806b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.227+0000 7f6b3d3cf640 1 --2- 172.21.15.114:0/1629640062 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b3815d4e0 0x7f6b3806b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.227+0000 7f6b3d3cf640 1 -- 172.21.15.114:0/1629640062 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b380d3b60 msgr2=0x7f6b381597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.227+0000 7f6b3d3cf640 1 --2- 172.21.15.114:0/1629640062 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b380d3b60 0x7f6b381597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.227+0000 7f6b3d3cf640 1 -- 172.21.15.114:0/1629640062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b300094d0 con 0x7f6b3815d100 2023-11-04T01:43:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.228+0000 7f6b3d3cf640 1 --2- 172.21.15.114:0/1629640062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3815d100 0x7f6b380b81f0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f6b2800e980 tx=0x7f6b2800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.228+0000 7f6b2e7fc640 1 -- 172.21.15.114:0/1629640062 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b28009670 con 0x7f6b3815d100 2023-11-04T01:43:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.228+0000 7f6b2e7fc640 1 -- 172.21.15.114:0/1629640062 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2800ca00 con 0x7f6b3815d100 2023-11-04T01:43:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.228+0000 7f6b2e7fc640 1 -- 172.21.15.114:0/1629640062 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2800cd90 con 0x7f6b3815d100 2023-11-04T01:43:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.228+0000 7f6b3fe34640 1 -- 172.21.15.114:0/1629640062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b381f6870 con 0x7f6b3815d100 2023-11-04T01:43:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.228+0000 7f6b3fe34640 1 -- 172.21.15.114:0/1629640062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b381f6e30 con 0x7f6b3815d100 2023-11-04T01:43:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.229+0000 7f6b3fe34640 1 -- 172.21.15.114:0/1629640062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b380684b0 con 0x7f6b3815d100 2023-11-04T01:43:28.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.229+0000 7f6b2e7fc640 1 -- 172.21.15.114:0/1629640062 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b28013470 con 0x7f6b3815d100 2023-11-04T01:43:28.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.230+0000 7f6b2e7fc640 1 --2- 172.21.15.114:0/1629640062 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6b1c06ae70 0x7f6b1c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.230+0000 7f6b2e7fc640 1 -- 172.21.15.114:0/1629640062 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f6b2808a100 con 0x7f6b3815d100 2023-11-04T01:43:28.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.230+0000 7f6b3dbd0640 1 --2- 172.21.15.114:0/1629640062 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6b1c06ae70 0x7f6b1c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:28.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.230+0000 7f6b3dbd0640 1 --2- 172.21.15.114:0/1629640062 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6b1c06ae70 0x7f6b1c06d330 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6b34001ec0 tx=0x7f6b34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:28.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.234+0000 7f6b2e7fc640 1 -- 172.21.15.114:0/1629640062 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b28054930 con 0x7f6b3815d100 2023-11-04T01:43:28.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.434+0000 7f6b3fe34640 1 -- 172.21.15.114:0/1629640062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b380d2cd0 con 0x7f6b3815d100 2023-11-04T01:43:28.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.435+0000 7f6b2e7fc640 1 -- 172.21.15.114:0/1629640062 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4947 (secure 0 0 0) 0x7f6b28057f50 con 0x7f6b3815d100 2023-11-04T01:43:28.437 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:28.437 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":101,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:19.435841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:28.437 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 101 2023-11-04T01:43:28.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.437+0000 7f6b3fe34640 1 -- 172.21.15.114:0/1629640062 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6b1c06ae70 msgr2=0x7f6b1c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.437+0000 7f6b3fe34640 1 --2- 172.21.15.114:0/1629640062 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6b1c06ae70 0x7f6b1c06d330 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6b34001ec0 tx=0x7f6b34009040 comp rx=0 tx=0).stop 2023-11-04T01:43:28.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.437+0000 7f6b3fe34640 1 -- 172.21.15.114:0/1629640062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3815d100 msgr2=0x7f6b380b81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.437+0000 7f6b3fe34640 1 --2- 172.21.15.114:0/1629640062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3815d100 0x7f6b380b81f0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f6b2800e980 tx=0x7f6b2800ee40 comp rx=0 tx=0).stop 2023-11-04T01:43:28.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.437+0000 7f6b3fe34640 1 -- 172.21.15.114:0/1629640062 shutdown_connections 2023-11-04T01:43:28.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.437+0000 7f6b3fe34640 1 --2- 172.21.15.114:0/1629640062 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6b3815d4e0 0x7f6b3806b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.437+0000 7f6b3fe34640 1 --2- 172.21.15.114:0/1629640062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b3815d100 0x7f6b380b81f0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.437+0000 7f6b3fe34640 1 --2- 172.21.15.114:0/1629640062 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6b1c06ae70 0x7f6b1c06d330 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.437+0000 7f6b3fe34640 1 --2- 172.21.15.114:0/1629640062 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6b380d3b60 0x7f6b381597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.437+0000 7f6b3fe34640 1 -- 172.21.15.114:0/1629640062 >> 172.21.15.114:0/1629640062 conn(0x7f6b380d2ef0 msgr2=0x7f6b380cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:28.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.437+0000 7f6b3fe34640 1 -- 172.21.15.114:0/1629640062 shutdown_connections 2023-11-04T01:43:28.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:28.437+0000 7f6b3fe34640 1 -- 172.21.15.114:0/1629640062 wait complete. 2023-11-04T01:43:28.449 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:43:29.449 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:29.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.559+0000 7fc8fd607640 1 Processor -- start 2023-11-04T01:43:29.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.559+0000 7fc8fd607640 1 -- start start 2023-11-04T01:43:29.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.560+0000 7fc8fd607640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc8f815d100 0x7fc8f80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.560+0000 7fc8fd607640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc8f815d4e0 0x7fc8f80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.560+0000 7fc8fd607640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f80b32b0 con 0x7fc8f80d3b60 2023-11-04T01:43:29.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.560+0000 7fc8fd607640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f80cee10 con 0x7fc8f815d100 2023-11-04T01:43:29.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.560+0000 7fc8fd607640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f80b4750 con 0x7fc8f815d4e0 2023-11-04T01:43:29.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.560+0000 7fc8f77fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc8f80d3b60 0x7fc8f80cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35372/0 (socket says 172.21.15.114:35372) 2023-11-04T01:43:29.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.560+0000 7fc8f77fe640 1 -- 172.21.15.114:0/1180502972 learned_addr learned my addr 172.21.15.114:0/1180502972 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:43:29.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.560+0000 7fc8f6ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc8f815d100 0x7fc8f80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.560+0000 7fc8f67fc640 1 --2- 172.21.15.114:0/1180502972 >> v2:172.21.15.141:3300/0 conn(0x7fc8f815d4e0 0x7fc8f80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.560+0000 7fc8f6ffd640 1 -- 172.21.15.114:0/1180502972 >> v2:172.21.15.141:3300/0 conn(0x7fc8f815d4e0 msgr2=0x7fc8f80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.560+0000 7fc8f6ffd640 1 --2- 172.21.15.114:0/1180502972 >> v2:172.21.15.141:3300/0 conn(0x7fc8f815d4e0 0x7fc8f80d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.560+0000 7fc8f6ffd640 1 -- 172.21.15.114:0/1180502972 >> v1:172.21.15.114:6789/0 conn(0x7fc8f80d3b60 legacy=0x7fc8f80cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.560+0000 7fc8f5ffb640 1 -- 172.21.15.114:0/1180502972 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325909673 0 0) 0x7fc8f80b32b0 con 0x7fc8f80d3b60 2023-11-04T01:43:29.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.560+0000 7fc8f6ffd640 1 -- 172.21.15.114:0/1180502972 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f80b2980 con 0x7fc8f815d100 2023-11-04T01:43:29.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.561+0000 7fc8f6ffd640 1 --2- 172.21.15.114:0/1180502972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f815d100 0x7fc8f80ce510 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8160da0 tx=0x7fc8e802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65feaf004f2d46dd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.561+0000 7fc8f5ffb640 1 -- 172.21.15.114:0/1180502972 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8031830 con 0x7fc8f815d100 2023-11-04T01:43:29.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.561+0000 7fc8f5ffb640 1 -- 172.21.15.114:0/1180502972 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e8031990 con 0x7fc8f815d100 2023-11-04T01:43:29.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.561+0000 7fc8f5ffb640 1 -- 172.21.15.114:0/1180502972 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8031d20 con 0x7fc8f815d100 2023-11-04T01:43:29.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.562+0000 7fc8fd607640 1 -- 172.21.15.114:0/1180502972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f815d100 msgr2=0x7fc8f80ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.562+0000 7fc8fd607640 1 --2- 172.21.15.114:0/1180502972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f815d100 0x7fc8f80ce510 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8160da0 tx=0x7fc8e802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.562+0000 7fc8fd607640 1 -- 172.21.15.114:0/1180502972 shutdown_connections 2023-11-04T01:43:29.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.562+0000 7fc8fd607640 1 --2- 172.21.15.114:0/1180502972 >> v2:172.21.15.141:3300/0 conn(0x7fc8f815d4e0 0x7fc8f80d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.562+0000 7fc8fd607640 1 --2- 172.21.15.114:0/1180502972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f815d100 0x7fc8f80ce510 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.562+0000 7fc8fd607640 1 -- 172.21.15.114:0/1180502972 >> 172.21.15.114:0/1180502972 conn(0x7fc8f80d2ef0 msgr2=0x7fc8f80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.562+0000 7fc8fd607640 1 -- 172.21.15.114:0/1180502972 shutdown_connections 2023-11-04T01:43:29.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.562+0000 7fc8fd607640 1 -- 172.21.15.114:0/1180502972 wait complete. 2023-11-04T01:43:29.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.563+0000 7fc8fd607640 1 Processor -- start 2023-11-04T01:43:29.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.563+0000 7fc8fd607640 1 -- start start 2023-11-04T01:43:29.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8fd607640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8f80d3b60 0x7fc8f80cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8fd607640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8f815d100 0x7fc8f80b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8fd607640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f815d4e0 0x7fc8f8156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8fd607640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80ccf80 con 0x7fc8f815d4e0 2023-11-04T01:43:29.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8fd607640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80cc6e0 con 0x7fc8f815d100 2023-11-04T01:43:29.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8fd607640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80cc9c0 con 0x7fc8f80d3b60 2023-11-04T01:43:29.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8f77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f815d4e0 0x7fc8f8156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8f77fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f815d4e0 0x7fc8f8156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56138/0 (socket says 172.21.15.114:56138) 2023-11-04T01:43:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8f77fe640 1 -- 172.21.15.114:0/2045890346 learned_addr learned my addr 172.21.15.114:0/2045890346 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8f77fe640 1 -- 172.21.15.114:0/2045890346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8f80d3b60 msgr2=0x7fc8f80cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8f6ffd640 1 --2- 172.21.15.114:0/2045890346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8f80d3b60 0x7fc8f80cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8f67fc640 1 --2- 172.21.15.114:0/2045890346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8f815d100 0x7fc8f80b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8f77fe640 1 --2- 172.21.15.114:0/2045890346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8f80d3b60 0x7fc8f80cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8f77fe640 1 -- 172.21.15.114:0/2045890346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8f815d100 msgr2=0x7fc8f80b84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8f77fe640 1 --2- 172.21.15.114:0/2045890346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8f815d100 0x7fc8f80b84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8f77fe640 1 -- 172.21.15.114:0/2045890346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80093a0 con 0x7fc8f815d4e0 2023-11-04T01:43:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8f6ffd640 1 --2- 172.21.15.114:0/2045890346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8f80d3b60 0x7fc8f80cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.564+0000 7fc8f67fc640 1 --2- 172.21.15.114:0/2045890346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8f815d100 0x7fc8f80b84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.565+0000 7fc8f77fe640 1 --2- 172.21.15.114:0/2045890346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f815d4e0 0x7fc8f8156000 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000c780 tx=0x7fc8f000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.565+0000 7fc8df7fe640 1 -- 172.21.15.114:0/2045890346 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f000ce90 con 0x7fc8f815d4e0 2023-11-04T01:43:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.565+0000 7fc8df7fe640 1 -- 172.21.15.114:0/2045890346 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f000a640 con 0x7fc8f815d4e0 2023-11-04T01:43:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.565+0000 7fc8fd607640 1 -- 172.21.15.114:0/2045890346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f80ccca0 con 0x7fc8f815d4e0 2023-11-04T01:43:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.565+0000 7fc8df7fe640 1 -- 172.21.15.114:0/2045890346 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f000a9d0 con 0x7fc8f815d4e0 2023-11-04T01:43:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.565+0000 7fc8fd607640 1 -- 172.21.15.114:0/2045890346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f8156540 con 0x7fc8f815d4e0 2023-11-04T01:43:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.566+0000 7fc8fd607640 1 -- 172.21.15.114:0/2045890346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f80b6160 con 0x7fc8f815d4e0 2023-11-04T01:43:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.566+0000 7fc8df7fe640 1 -- 172.21.15.114:0/2045890346 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc8f000ab30 con 0x7fc8f815d4e0 2023-11-04T01:43:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.566+0000 7fc8df7fe640 1 --2- 172.21.15.114:0/2045890346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8e406ae70 0x7fc8e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.566+0000 7fc8df7fe640 1 -- 172.21.15.114:0/2045890346 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fc8f0089770 con 0x7fc8f815d4e0 2023-11-04T01:43:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.567+0000 7fc8f6ffd640 1 --2- 172.21.15.114:0/2045890346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8e406ae70 0x7fc8e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.567+0000 7fc8f6ffd640 1 --2- 172.21.15.114:0/2045890346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8e406ae70 0x7fc8e406d330 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8036000 tx=0x7fc8e803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.571+0000 7fc8df7fe640 1 -- 172.21.15.114:0/2045890346 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc8f80b6160 con 0x7fc8f815d4e0 2023-11-04T01:43:29.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.779+0000 7fc8fd607640 1 -- 172.21.15.114:0/2045890346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8f80b6540 con 0x7fc8f815d4e0 2023-11-04T01:43:29.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.780+0000 7fc8df7fe640 1 -- 172.21.15.114:0/2045890346 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4941 (secure 0 0 0) 0x7fc8f80b6540 con 0x7fc8f815d4e0 2023-11-04T01:43:29.782 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:29.782 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":103,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:28.632221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":18,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:29.782 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 103 2023-11-04T01:43:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.781+0000 7fc8fd607640 1 -- 172.21.15.114:0/2045890346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8e406ae70 msgr2=0x7fc8e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.781+0000 7fc8fd607640 1 --2- 172.21.15.114:0/2045890346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8e406ae70 0x7fc8e406d330 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8036000 tx=0x7fc8e803c040 comp rx=0 tx=0).stop 2023-11-04T01:43:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.781+0000 7fc8fd607640 1 -- 172.21.15.114:0/2045890346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f815d4e0 msgr2=0x7fc8f8156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.781+0000 7fc8fd607640 1 --2- 172.21.15.114:0/2045890346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f815d4e0 0x7fc8f8156000 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000c780 tx=0x7fc8f000cc40 comp rx=0 tx=0).stop 2023-11-04T01:43:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.781+0000 7fc8fd607640 1 -- 172.21.15.114:0/2045890346 shutdown_connections 2023-11-04T01:43:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.782+0000 7fc8fd607640 1 --2- 172.21.15.114:0/2045890346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f815d4e0 0x7fc8f8156000 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.782+0000 7fc8fd607640 1 --2- 172.21.15.114:0/2045890346 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8e406ae70 0x7fc8e406d330 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.782+0000 7fc8fd607640 1 --2- 172.21.15.114:0/2045890346 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8f815d100 0x7fc8f80b84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.782+0000 7fc8fd607640 1 --2- 172.21.15.114:0/2045890346 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8f80d3b60 0x7fc8f80cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.782+0000 7fc8fd607640 1 -- 172.21.15.114:0/2045890346 >> 172.21.15.114:0/2045890346 conn(0x7fc8f80d2ef0 msgr2=0x7fc8f815c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.782+0000 7fc8fd607640 1 -- 172.21.15.114:0/2045890346 shutdown_connections 2023-11-04T01:43:29.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.782+0000 7fc8fd607640 1 -- 172.21.15.114:0/2045890346 wait complete. 2023-11-04T01:43:29.794 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:43:29.794 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.6835010051727295s 2023-11-04T01:43:29.794 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:29.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.892+0000 7f60fa5cc640 1 Processor -- start 2023-11-04T01:43:29.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.892+0000 7f60fa5cc640 1 -- start start 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.893+0000 7f60fa5cc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f60f4159e40 0x7f60f40b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.893+0000 7f60fa5cc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60f406bb60 0x7f60f40b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.893+0000 7f60fa5cc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f60f406fff0 0x7f60f4070480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.893+0000 7f60fa5cc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f4071500 con 0x7f60f406fff0 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.893+0000 7f60fa5cc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f415dae0 con 0x7f60f4159e40 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.893+0000 7f60fa5cc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40709c0 con 0x7f60f406bb60 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.893+0000 7f60f8b69640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f60f406fff0 0x7f60f4070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.893+0000 7f60f8b69640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f60f406fff0 0x7f60f4070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56148/0 (socket says 172.21.15.114:56148) 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.893+0000 7f60f8b69640 1 -- 172.21.15.114:0/1883330998 learned_addr learned my addr 172.21.15.114:0/1883330998 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.893+0000 7f60f8b69640 1 -- 172.21.15.114:0/1883330998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60f406bb60 msgr2=0x7f60f40b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.893+0000 7f60f8b69640 1 --2- 172.21.15.114:0/1883330998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60f406bb60 0x7f60f40b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.893+0000 7f60f8b69640 1 -- 172.21.15.114:0/1883330998 >> v2:172.21.15.141:3300/0 conn(0x7f60f4159e40 msgr2=0x7f60f40b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.893+0000 7f60f8b69640 1 --2- 172.21.15.114:0/1883330998 >> v2:172.21.15.141:3300/0 conn(0x7f60f4159e40 0x7f60f40b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.893+0000 7f60f8b69640 1 -- 172.21.15.114:0/1883330998 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f4070c60 con 0x7f60f406fff0 2023-11-04T01:43:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.894+0000 7f60f8b69640 1 --2- 172.21.15.114:0/1883330998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f406fff0 0x7f60f4070480 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f60f40ce7f0 tx=0x7f60ec02e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ab0b6a0c493180 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.894+0000 7f60f2ffd640 1 -- 172.21.15.114:0/1883330998 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec02ea00 con 0x7f60f406fff0 2023-11-04T01:43:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.894+0000 7f60f2ffd640 1 -- 172.21.15.114:0/1883330998 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec02eb60 con 0x7f60f406fff0 2023-11-04T01:43:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.894+0000 7f60f2ffd640 1 -- 172.21.15.114:0/1883330998 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec009600 con 0x7f60f406fff0 2023-11-04T01:43:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.894+0000 7f60fa5cc640 1 -- 172.21.15.114:0/1883330998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f406fff0 msgr2=0x7f60f4070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.894+0000 7f60fa5cc640 1 --2- 172.21.15.114:0/1883330998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f406fff0 0x7f60f4070480 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f60f40ce7f0 tx=0x7f60ec02e060 comp rx=0 tx=0).stop 2023-11-04T01:43:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.894+0000 7f60fa5cc640 1 -- 172.21.15.114:0/1883330998 shutdown_connections 2023-11-04T01:43:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.894+0000 7f60fa5cc640 1 --2- 172.21.15.114:0/1883330998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60f406bb60 0x7f60f40b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.894+0000 7f60fa5cc640 1 --2- 172.21.15.114:0/1883330998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f406fff0 0x7f60f4070480 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.894+0000 7f60fa5cc640 1 --2- 172.21.15.114:0/1883330998 >> v2:172.21.15.141:3300/0 conn(0x7f60f4159e40 0x7f60f40b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.894+0000 7f60fa5cc640 1 -- 172.21.15.114:0/1883330998 >> 172.21.15.114:0/1883330998 conn(0x7f60f40cb530 msgr2=0x7f60f40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.894+0000 7f60fa5cc640 1 -- 172.21.15.114:0/1883330998 shutdown_connections 2023-11-04T01:43:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.895+0000 7f60fa5cc640 1 -- 172.21.15.114:0/1883330998 wait complete. 2023-11-04T01:43:29.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.896+0000 7f60fa5cc640 1 Processor -- start 2023-11-04T01:43:29.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.896+0000 7f60fa5cc640 1 -- start start 2023-11-04T01:43:29.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.896+0000 7f60fa5cc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f406bb60 0x7f60f40c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.896+0000 7f60fa5cc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60f406fff0 0x7f60f40af700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.896+0000 7f60fa5cc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60f4159e40 0x7f60f41552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.896+0000 7f60fa5cc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f415bed0 con 0x7f60f406bb60 2023-11-04T01:43:29.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.896+0000 7f60fa5cc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f415c1b0 con 0x7f60f406fff0 2023-11-04T01:43:29.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.896+0000 7f60fa5cc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f415c490 con 0x7f60f4159e40 2023-11-04T01:43:29.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.897+0000 7f60f3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f406bb60 0x7f60f40c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.897+0000 7f60f3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f406bb60 0x7f60f40c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56156/0 (socket says 172.21.15.114:56156) 2023-11-04T01:43:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.897+0000 7f60f3fff640 1 -- 172.21.15.114:0/1590340863 learned_addr learned my addr 172.21.15.114:0/1590340863 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.897+0000 7f60f3fff640 1 -- 172.21.15.114:0/1590340863 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60f4159e40 msgr2=0x7f60f41552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.897+0000 7f60f3fff640 1 --2- 172.21.15.114:0/1590340863 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60f4159e40 0x7f60f41552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.897+0000 7f60f3fff640 1 -- 172.21.15.114:0/1590340863 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60f406fff0 msgr2=0x7f60f40af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.897+0000 7f60f3fff640 1 --2- 172.21.15.114:0/1590340863 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60f406fff0 0x7f60f40af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.897+0000 7f60f3fff640 1 -- 172.21.15.114:0/1590340863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec00bd40 con 0x7f60f406bb60 2023-11-04T01:43:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.897+0000 7f60f3fff640 1 --2- 172.21.15.114:0/1590340863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f406bb60 0x7f60f40c8590 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f60e400b4a0 tx=0x7f60e400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.897+0000 7f60f0ff9640 1 -- 172.21.15.114:0/1590340863 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4010610 con 0x7f60f406bb60 2023-11-04T01:43:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.897+0000 7f60f0ff9640 1 -- 172.21.15.114:0/1590340863 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e4010770 con 0x7f60f406bb60 2023-11-04T01:43:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.897+0000 7f60f0ff9640 1 -- 172.21.15.114:0/1590340863 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4010b20 con 0x7f60f406bb60 2023-11-04T01:43:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.897+0000 7f60fa5cc640 1 -- 172.21.15.114:0/1590340863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f415c770 con 0x7f60f406bb60 2023-11-04T01:43:29.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.897+0000 7f60fa5cc640 1 -- 172.21.15.114:0/1590340863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f40afc40 con 0x7f60f406bb60 2023-11-04T01:43:29.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.898+0000 7f60fa5cc640 1 -- 172.21.15.114:0/1590340863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f415cc90 con 0x7f60f406bb60 2023-11-04T01:43:29.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.899+0000 7f60f0ff9640 1 -- 172.21.15.114:0/1590340863 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60e4010c80 con 0x7f60f406bb60 2023-11-04T01:43:29.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.899+0000 7f60f0ff9640 1 --2- 172.21.15.114:0/1590340863 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60e006ae70 0x7f60e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.899+0000 7f60f0ff9640 1 -- 172.21.15.114:0/1590340863 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f60e4089b30 con 0x7f60f406bb60 2023-11-04T01:43:29.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.899+0000 7f60f37fe640 1 --2- 172.21.15.114:0/1590340863 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60e006ae70 0x7f60e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.899+0000 7f60f37fe640 1 --2- 172.21.15.114:0/1590340863 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60e006ae70 0x7f60e006d330 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f60f414f940 tx=0x7f60e8006bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:29.903+0000 7f60f0ff9640 1 -- 172.21.15.114:0/1590340863 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60f415cc90 con 0x7f60f406bb60 2023-11-04T01:43:30.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.105+0000 7f60fa5cc640 1 -- 172.21.15.114:0/1590340863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60f415cc90 con 0x7f60f406bb60 2023-11-04T01:43:30.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.105+0000 7f60f0ff9640 1 -- 172.21.15.114:0/1590340863 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4941 (secure 0 0 0) 0x7f60f415cc90 con 0x7f60f406bb60 2023-11-04T01:43:30.107 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:30.107 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":103,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:28.632221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":18,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:30.108 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 103 2023-11-04T01:43:30.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.107+0000 7f60fa5cc640 1 -- 172.21.15.114:0/1590340863 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60e006ae70 msgr2=0x7f60e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.107+0000 7f60fa5cc640 1 --2- 172.21.15.114:0/1590340863 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60e006ae70 0x7f60e006d330 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f60f414f940 tx=0x7f60e8006bf0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.107+0000 7f60fa5cc640 1 -- 172.21.15.114:0/1590340863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f406bb60 msgr2=0x7f60f40c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.107+0000 7f60fa5cc640 1 --2- 172.21.15.114:0/1590340863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f406bb60 0x7f60f40c8590 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f60e400b4a0 tx=0x7f60e400b960 comp rx=0 tx=0).stop 2023-11-04T01:43:30.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.107+0000 7f60fa5cc640 1 -- 172.21.15.114:0/1590340863 shutdown_connections 2023-11-04T01:43:30.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.107+0000 7f60fa5cc640 1 --2- 172.21.15.114:0/1590340863 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f60f4159e40 0x7f60f41552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.107+0000 7f60fa5cc640 1 --2- 172.21.15.114:0/1590340863 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f60e006ae70 0x7f60e006d330 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.107+0000 7f60fa5cc640 1 --2- 172.21.15.114:0/1590340863 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f60f406fff0 0x7f60f40af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.107+0000 7f60fa5cc640 1 --2- 172.21.15.114:0/1590340863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f406bb60 0x7f60f40c8590 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.107+0000 7f60fa5cc640 1 -- 172.21.15.114:0/1590340863 >> 172.21.15.114:0/1590340863 conn(0x7f60f40cb530 msgr2=0x7f60f40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.108+0000 7f60fa5cc640 1 -- 172.21.15.114:0/1590340863 shutdown_connections 2023-11-04T01:43:30.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.108+0000 7f60fa5cc640 1 -- 172.21.15.114:0/1590340863 wait complete. 2023-11-04T01:43:30.120 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:43:30.244 INFO:teuthology.orchestra.run.smithi141.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:48.820894+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:43:30.244 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:48.820894+0000" } ] } 2023-11-04T01:43:30.244 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:43:30.245 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:30.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.342+0000 7f81d20fc640 1 Processor -- start 2023-11-04T01:43:30.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.342+0000 7f81d20fc640 1 -- start start 2023-11-04T01:43:30.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.343+0000 7f81d20fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f81cc15d4e0 0x7f81cc0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.343+0000 7f81d20fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81cc0ced90 0x7f81cc0ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.343+0000 7f81d20fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f81cc0ca6e0 0x7f81cc160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.343+0000 7f81d20fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81cc0cab70 con 0x7f81cc15d4e0 2023-11-04T01:43:30.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.343+0000 7f81d20fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81cc0b25a0 con 0x7f81cc0ca6e0 2023-11-04T01:43:30.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.343+0000 7f81d20fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0b2300 con 0x7f81cc0ced90 2023-11-04T01:43:30.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.343+0000 7f81cb7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f81cc15d4e0 0x7f81cc0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.343+0000 7f81cb7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f81cc15d4e0 0x7f81cc0ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56168/0 (socket says 172.21.15.114:56168) 2023-11-04T01:43:30.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.343+0000 7f81cb7fe640 1 -- 172.21.15.114:0/1135017049 learned_addr learned my addr 172.21.15.114:0/1135017049 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:30.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.343+0000 7f81caffd640 1 --2- 172.21.15.114:0/1135017049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81cc0ced90 0x7f81cc0ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.343+0000 7f81cbfff640 1 --2- 172.21.15.114:0/1135017049 >> v2:172.21.15.141:3300/0 conn(0x7f81cc0ca6e0 0x7f81cc160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.343+0000 7f81cb7fe640 1 -- 172.21.15.114:0/1135017049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81cc0ced90 msgr2=0x7f81cc0ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.343+0000 7f81cb7fe640 1 --2- 172.21.15.114:0/1135017049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81cc0ced90 0x7f81cc0ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.343+0000 7f81cb7fe640 1 -- 172.21.15.114:0/1135017049 >> v2:172.21.15.141:3300/0 conn(0x7f81cc0ca6e0 msgr2=0x7f81cc160fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.343+0000 7f81cb7fe640 1 --2- 172.21.15.114:0/1135017049 >> v2:172.21.15.141:3300/0 conn(0x7f81cc0ca6e0 0x7f81cc160fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.343+0000 7f81cb7fe640 1 -- 172.21.15.114:0/1135017049 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc15d8c0 con 0x7f81cc15d4e0 2023-11-04T01:43:30.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.344+0000 7f81cb7fe640 1 --2- 172.21.15.114:0/1135017049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81cc15d4e0 0x7f81cc0ce850 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0cbe70 tx=0x7f81bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd67bdec162f9a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.344+0000 7f81ca7fc640 1 -- 172.21.15.114:0/1135017049 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc031870 con 0x7f81cc15d4e0 2023-11-04T01:43:30.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.344+0000 7f81ca7fc640 1 -- 172.21.15.114:0/1135017049 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81bc0319d0 con 0x7f81cc15d4e0 2023-11-04T01:43:30.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.344+0000 7f81ca7fc640 1 -- 172.21.15.114:0/1135017049 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc031d60 con 0x7f81cc15d4e0 2023-11-04T01:43:30.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.345+0000 7f81d20fc640 1 -- 172.21.15.114:0/1135017049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81cc15d4e0 msgr2=0x7f81cc0ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.345+0000 7f81d20fc640 1 --2- 172.21.15.114:0/1135017049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81cc15d4e0 0x7f81cc0ce850 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0cbe70 tx=0x7f81bc02b910 comp rx=0 tx=0).stop 2023-11-04T01:43:30.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.345+0000 7f81d20fc640 1 -- 172.21.15.114:0/1135017049 shutdown_connections 2023-11-04T01:43:30.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.345+0000 7f81d20fc640 1 --2- 172.21.15.114:0/1135017049 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81cc0ced90 0x7f81cc0ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.345+0000 7f81d20fc640 1 --2- 172.21.15.114:0/1135017049 >> v2:172.21.15.141:3300/0 conn(0x7f81cc0ca6e0 0x7f81cc160fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.345+0000 7f81d20fc640 1 --2- 172.21.15.114:0/1135017049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81cc15d4e0 0x7f81cc0ce850 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.345+0000 7f81d20fc640 1 -- 172.21.15.114:0/1135017049 >> 172.21.15.114:0/1135017049 conn(0x7f81cc0b1640 msgr2=0x7f81cc0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.345+0000 7f81d20fc640 1 -- 172.21.15.114:0/1135017049 shutdown_connections 2023-11-04T01:43:30.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.345+0000 7f81d20fc640 1 -- 172.21.15.114:0/1135017049 wait complete. 2023-11-04T01:43:30.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.346+0000 7f81d20fc640 1 Processor -- start 2023-11-04T01:43:30.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.346+0000 7f81d20fc640 1 -- start start 2023-11-04T01:43:30.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.347+0000 7f81d20fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81cc0ca6e0 0x7f81cc158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.347+0000 7f81d20fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81cc0ced90 0x7f81cc0b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.347+0000 7f81d20fc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81cc15d4e0 0x7f81cc15a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.347+0000 7f81d20fc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0b4500 con 0x7f81cc0ced90 2023-11-04T01:43:30.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.347+0000 7f81d20fc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0b47e0 con 0x7f81cc15d4e0 2023-11-04T01:43:30.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.347+0000 7f81d20fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0b4ac0 con 0x7f81cc0ca6e0 2023-11-04T01:43:30.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.347+0000 7f81caffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81cc0ced90 0x7f81cc0b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.347+0000 7f81caffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81cc0ced90 0x7f81cc0b3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56174/0 (socket says 172.21.15.114:56174) 2023-11-04T01:43:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.347+0000 7f81caffd640 1 -- 172.21.15.114:0/394345919 learned_addr learned my addr 172.21.15.114:0/394345919 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.347+0000 7f81caffd640 1 -- 172.21.15.114:0/394345919 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81cc0ca6e0 msgr2=0x7f81cc158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.347+0000 7f81caffd640 1 --2- 172.21.15.114:0/394345919 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81cc0ca6e0 0x7f81cc158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.347+0000 7f81caffd640 1 -- 172.21.15.114:0/394345919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81cc15d4e0 msgr2=0x7f81cc15a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.347+0000 7f81caffd640 1 --2- 172.21.15.114:0/394345919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81cc15d4e0 0x7f81cc15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.347+0000 7f81caffd640 1 -- 172.21.15.114:0/394345919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81bc0094d0 con 0x7f81cc0ced90 2023-11-04T01:43:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.347+0000 7f81caffd640 1 --2- 172.21.15.114:0/394345919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81cc0ced90 0x7f81cc0b3a80 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f81c000d800 tx=0x7f81c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.347+0000 7f81b3fff640 1 -- 172.21.15.114:0/394345919 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c000b6c0 con 0x7f81cc0ced90 2023-11-04T01:43:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.348+0000 7f81b3fff640 1 -- 172.21.15.114:0/394345919 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c000b820 con 0x7f81cc0ced90 2023-11-04T01:43:30.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.348+0000 7f81d20fc640 1 -- 172.21.15.114:0/394345919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81cc0b4da0 con 0x7f81cc0ced90 2023-11-04T01:43:30.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.348+0000 7f81b3fff640 1 -- 172.21.15.114:0/394345919 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c000bbb0 con 0x7f81cc0ced90 2023-11-04T01:43:30.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.348+0000 7f81d20fc640 1 -- 172.21.15.114:0/394345919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81cc15c550 con 0x7f81cc0ced90 2023-11-04T01:43:30.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.349+0000 7f81d20fc640 1 -- 172.21.15.114:0/394345919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81cc0684b0 con 0x7f81cc0ced90 2023-11-04T01:43:30.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.349+0000 7f81b3fff640 1 -- 172.21.15.114:0/394345919 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81c000bd10 con 0x7f81cc0ced90 2023-11-04T01:43:30.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.349+0000 7f81b3fff640 1 --2- 172.21.15.114:0/394345919 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f81b806ae70 0x7f81b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.350+0000 7f81cb7fe640 1 --2- 172.21.15.114:0/394345919 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f81b806ae70 0x7f81b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.350+0000 7f81b3fff640 1 -- 172.21.15.114:0/394345919 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f81c008a3e0 con 0x7f81cc0ced90 2023-11-04T01:43:30.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.350+0000 7f81cb7fe640 1 --2- 172.21.15.114:0/394345919 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f81b806ae70 0x7f81b806d330 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f81bc036000 tx=0x7f81bc030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.354+0000 7f81b3fff640 1 -- 172.21.15.114:0/394345919 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81c0054c60 con 0x7f81cc0ced90 2023-11-04T01:43:30.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.555+0000 7f81d20fc640 1 -- 172.21.15.114:0/394345919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81cc0c9ff0 con 0x7f81cc0ced90 2023-11-04T01:43:30.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.555+0000 7f81b3fff640 1 -- 172.21.15.114:0/394345919 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4941 (secure 0 0 0) 0x7f81c0058280 con 0x7f81cc0ced90 2023-11-04T01:43:30.557 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:30.557 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":103,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:28.632221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":18,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:30.558 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 103 2023-11-04T01:43:30.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.557+0000 7f81d20fc640 1 -- 172.21.15.114:0/394345919 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f81b806ae70 msgr2=0x7f81b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.557+0000 7f81d20fc640 1 --2- 172.21.15.114:0/394345919 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f81b806ae70 0x7f81b806d330 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f81bc036000 tx=0x7f81bc030000 comp rx=0 tx=0).stop 2023-11-04T01:43:30.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.557+0000 7f81d20fc640 1 -- 172.21.15.114:0/394345919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81cc0ced90 msgr2=0x7f81cc0b3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.557+0000 7f81d20fc640 1 --2- 172.21.15.114:0/394345919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81cc0ced90 0x7f81cc0b3a80 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f81c000d800 tx=0x7f81c000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.557+0000 7f81d20fc640 1 -- 172.21.15.114:0/394345919 shutdown_connections 2023-11-04T01:43:30.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.557+0000 7f81d20fc640 1 --2- 172.21.15.114:0/394345919 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f81b806ae70 0x7f81b806d330 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.557+0000 7f81d20fc640 1 --2- 172.21.15.114:0/394345919 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f81cc15d4e0 0x7f81cc15a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.557+0000 7f81d20fc640 1 --2- 172.21.15.114:0/394345919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81cc0ced90 0x7f81cc0b3a80 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.557+0000 7f81d20fc640 1 --2- 172.21.15.114:0/394345919 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f81cc0ca6e0 0x7f81cc158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.557+0000 7f81d20fc640 1 -- 172.21.15.114:0/394345919 >> 172.21.15.114:0/394345919 conn(0x7f81cc0b1640 msgr2=0x7f81cc0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.557+0000 7f81d20fc640 1 -- 172.21.15.114:0/394345919 shutdown_connections 2023-11-04T01:43:30.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.557+0000 7f81d20fc640 1 -- 172.21.15.114:0/394345919 wait complete. 2023-11-04T01:43:30.570 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:43:30.692 INFO:teuthology.orchestra.run.smithi141.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:48.820894+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:43:30.693 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:48.820894+0000" } ] } 2023-11-04T01:43:30.693 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:30.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:30.693 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-11-04T01:43:30.721 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:43:30.721 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:30.777 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:30.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.916+0000 7f9774b4c640 1 Processor -- start 2023-11-04T01:43:30.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.916+0000 7f9774b4c640 1 -- start start 2023-11-04T01:43:30.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.917+0000 7f9774b4c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f97700ade00 0x7f97700b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.917+0000 7f9774b4c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f977006d9c0 0x7f97700710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.917+0000 7f9774b4c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f977006c5f0 0x7f9770071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.917+0000 7f9774b4c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977006cc90 con 0x7f977006d9c0 2023-11-04T01:43:30.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.917+0000 7f9774b4c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9770071b50 con 0x7f97700ade00 2023-11-04T01:43:30.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.917+0000 7f9774b4c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97700b0e60 con 0x7f977006c5f0 2023-11-04T01:43:30.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.917+0000 7f9767fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f977006d9c0 0x7f97700710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.917+0000 7f9767fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f977006d9c0 0x7f97700710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56176/0 (socket says 172.21.15.114:56176) 2023-11-04T01:43:30.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.917+0000 7f9767fff640 1 -- 172.21.15.114:0/2253229303 learned_addr learned my addr 172.21.15.114:0/2253229303 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:30.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.917+0000 7f976ed9d640 1 --2- 172.21.15.114:0/2253229303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f977006c5f0 0x7f9770071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.917+0000 7f9767fff640 1 -- 172.21.15.114:0/2253229303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f977006c5f0 msgr2=0x7f9770071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.917+0000 7f976e59c640 1 --2- 172.21.15.114:0/2253229303 >> v2:172.21.15.141:3300/0 conn(0x7f97700ade00 0x7f97700b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.917+0000 7f9767fff640 1 --2- 172.21.15.114:0/2253229303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f977006c5f0 0x7f9770071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.917+0000 7f9767fff640 1 -- 172.21.15.114:0/2253229303 >> v2:172.21.15.141:3300/0 conn(0x7f97700ade00 msgr2=0x7f97700b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.917+0000 7f9767fff640 1 --2- 172.21.15.114:0/2253229303 >> v2:172.21.15.141:3300/0 conn(0x7f97700ade00 0x7f97700b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.917+0000 7f9767fff640 1 -- 172.21.15.114:0/2253229303 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977006cee0 con 0x7f977006d9c0 2023-11-04T01:43:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.918+0000 7f9767fff640 1 --2- 172.21.15.114:0/2253229303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977006d9c0 0x7f97700710d0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f97700cb430 tx=0x7f975802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548d1efca7a787d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.918+0000 7f976dd9b640 1 -- 172.21.15.114:0/2253229303 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758031750 con 0x7f977006d9c0 2023-11-04T01:43:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.918+0000 7f976dd9b640 1 -- 172.21.15.114:0/2253229303 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97580318b0 con 0x7f977006d9c0 2023-11-04T01:43:30.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.918+0000 7f976dd9b640 1 -- 172.21.15.114:0/2253229303 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758031c40 con 0x7f977006d9c0 2023-11-04T01:43:30.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.918+0000 7f9774b4c640 1 -- 172.21.15.114:0/2253229303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977006d9c0 msgr2=0x7f97700710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.918+0000 7f9774b4c640 1 --2- 172.21.15.114:0/2253229303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977006d9c0 0x7f97700710d0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f97700cb430 tx=0x7f975802b7f0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.918+0000 7f9774b4c640 1 -- 172.21.15.114:0/2253229303 shutdown_connections 2023-11-04T01:43:30.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.918+0000 7f9774b4c640 1 --2- 172.21.15.114:0/2253229303 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f977006c5f0 0x7f9770071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.918+0000 7f9774b4c640 1 --2- 172.21.15.114:0/2253229303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977006d9c0 0x7f97700710d0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.918+0000 7f9774b4c640 1 --2- 172.21.15.114:0/2253229303 >> v2:172.21.15.141:3300/0 conn(0x7f97700ade00 0x7f97700b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.918+0000 7f9774b4c640 1 -- 172.21.15.114:0/2253229303 >> 172.21.15.114:0/2253229303 conn(0x7f97700cb530 msgr2=0x7f97700cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.918+0000 7f9774b4c640 1 -- 172.21.15.114:0/2253229303 shutdown_connections 2023-11-04T01:43:30.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.918+0000 7f9774b4c640 1 -- 172.21.15.114:0/2253229303 wait complete. 2023-11-04T01:43:30.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.920+0000 7f9774b4c640 1 Processor -- start 2023-11-04T01:43:30.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.920+0000 7f9774b4c640 1 -- start start 2023-11-04T01:43:30.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.920+0000 7f9774b4c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f977006c5f0 0x7f97701e43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.920+0000 7f9774b4c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977006d9c0 0x7f97701e4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.920+0000 7f9774b4c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97700ade00 0x7f97701e5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.920+0000 7f9774b4c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97701e3980 con 0x7f977006d9c0 2023-11-04T01:43:30.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.920+0000 7f9774b4c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9770159600 con 0x7f97700ade00 2023-11-04T01:43:30.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.920+0000 7f9774b4c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97701598e0 con 0x7f977006c5f0 2023-11-04T01:43:30.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.921+0000 7f9767fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977006d9c0 0x7f97701e4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.921+0000 7f9767fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977006d9c0 0x7f97701e4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56192/0 (socket says 172.21.15.114:56192) 2023-11-04T01:43:30.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.921+0000 7f9767fff640 1 -- 172.21.15.114:0/4115763932 learned_addr learned my addr 172.21.15.114:0/4115763932 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:30.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.921+0000 7f976e59c640 1 --2- 172.21.15.114:0/4115763932 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f977006c5f0 0x7f97701e43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.921+0000 7f976ed9d640 1 --2- 172.21.15.114:0/4115763932 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97700ade00 0x7f97701e5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.921+0000 7f9767fff640 1 -- 172.21.15.114:0/4115763932 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f977006c5f0 msgr2=0x7f97701e43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.921+0000 7f9767fff640 1 --2- 172.21.15.114:0/4115763932 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f977006c5f0 0x7f97701e43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.921+0000 7f9767fff640 1 -- 172.21.15.114:0/4115763932 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97700ade00 msgr2=0x7f97701e5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.921+0000 7f9767fff640 1 --2- 172.21.15.114:0/4115763932 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97700ade00 0x7f97701e5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.921+0000 7f9767fff640 1 -- 172.21.15.114:0/4115763932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97580094d0 con 0x7f977006d9c0 2023-11-04T01:43:30.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.921+0000 7f9767fff640 1 --2- 172.21.15.114:0/4115763932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977006d9c0 0x7f97701e4ef0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f9758000c00 tx=0x7f97580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.921+0000 7f9766ffd640 1 -- 172.21.15.114:0/4115763932 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758033c80 con 0x7f977006d9c0 2023-11-04T01:43:30.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.921+0000 7f9766ffd640 1 -- 172.21.15.114:0/4115763932 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9758033e00 con 0x7f977006d9c0 2023-11-04T01:43:30.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.921+0000 7f9774b4c640 1 -- 172.21.15.114:0/4115763932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9770159bc0 con 0x7f977006d9c0 2023-11-04T01:43:30.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.921+0000 7f9766ffd640 1 -- 172.21.15.114:0/4115763932 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975803c640 con 0x7f977006d9c0 2023-11-04T01:43:30.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.921+0000 7f9774b4c640 1 -- 172.21.15.114:0/4115763932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977015a180 con 0x7f977006d9c0 2023-11-04T01:43:30.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.922+0000 7f9774b4c640 1 -- 172.21.15.114:0/4115763932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977015a370 con 0x7f977006d9c0 2023-11-04T01:43:30.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.923+0000 7f9766ffd640 1 -- 172.21.15.114:0/4115763932 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f975803a040 con 0x7f977006d9c0 2023-11-04T01:43:30.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.923+0000 7f9766ffd640 1 --2- 172.21.15.114:0/4115763932 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f975006aea0 0x7f975006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.923+0000 7f976e59c640 1 --2- 172.21.15.114:0/4115763932 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f975006aea0 0x7f975006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.923+0000 7f9766ffd640 1 -- 172.21.15.114:0/4115763932 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f97580abaf0 con 0x7f977006d9c0 2023-11-04T01:43:30.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.924+0000 7f976e59c640 1 --2- 172.21.15.114:0/4115763932 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f975006aea0 0x7f975006d360 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f97701e4d80 tx=0x7f9760008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:30.928+0000 7f9766ffd640 1 -- 172.21.15.114:0/4115763932 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9758076390 con 0x7f977006d9c0 2023-11-04T01:43:31.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.094+0000 7f9774b4c640 1 -- 172.21.15.114:0/4115763932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97700684b0 con 0x7f977006d9c0 2023-11-04T01:43:31.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.096+0000 7f9766ffd640 1 -- 172.21.15.114:0/4115763932 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+23360 (secure 0 0 0) 0x7f97580799b0 con 0x7f977006d9c0 2023-11-04T01:43:31.098 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:31.098 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":111,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:43:27.626174+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:50.031565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:50.411946+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":2}]},{"pgid":"17.3c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3180677097":"2023-11-04T02:43:26.710151+0000","172.21.15.114:6836/3145796350":"2023-11-05T01:43:18.419560+0000","172.21.15.114:6837/3825479201":"2023-11-05T01:43:11.612005+0000","172.21.15.114:6835/3825479201":"2023-11-05T01:43:11.612005+0000","172.21.15.114:6834/3145796350":"2023-11-05T01:43:18.419560+0000","172.21.15.114:6834/3780323525":"2023-11-05T01:40:32.050690+0000","172.21.15.114:6836/3780323525":"2023-11-05T01:40:32.050690+0000","172.21.15.141:6834/1296600989":"2023-11-05T01:42:28.568489+0000","172.21.15.114:6835/1768068040":"2023-11-05T01:40:57.284155+0000","172.21.15.114:6837/1768068040":"2023-11-05T01:40:57.284155+0000","172.21.15.141:6832/1296600989":"2023-11-05T01:42:28.568489+0000","172.21.15.114:6836/2722332212":"2023-11-05T01:41:22.824334+0000","172.21.15.114:6835/1052115332":"2023-11-05T01:41:48.753700+0000","192.168.0.1:0/958873281":"2023-11-04T02:42:36.859026+0000","172.21.15.114:6837/1052115332":"2023-11-05T01:41:48.753700+0000","172.21.15.114:6836/1629274449":"2023-11-05T01:42:21.762099+0000","172.21.15.114:6834/2722332212":"2023-11-05T01:41:22.824334+0000","172.21.15.114:6834/1629274449":"2023-11-05T01:42:21.762099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:31.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.098+0000 7f9774b4c640 1 -- 172.21.15.114:0/4115763932 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f975006aea0 msgr2=0x7f975006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.098+0000 7f9774b4c640 1 --2- 172.21.15.114:0/4115763932 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f975006aea0 0x7f975006d360 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f97701e4d80 tx=0x7f9760008040 comp rx=0 tx=0).stop 2023-11-04T01:43:31.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.098+0000 7f9774b4c640 1 -- 172.21.15.114:0/4115763932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977006d9c0 msgr2=0x7f97701e4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.098+0000 7f9774b4c640 1 --2- 172.21.15.114:0/4115763932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977006d9c0 0x7f97701e4ef0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f9758000c00 tx=0x7f97580046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.098+0000 7f9774b4c640 1 -- 172.21.15.114:0/4115763932 shutdown_connections 2023-11-04T01:43:31.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.098+0000 7f9774b4c640 1 --2- 172.21.15.114:0/4115763932 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f975006aea0 0x7f975006d360 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.098+0000 7f9774b4c640 1 --2- 172.21.15.114:0/4115763932 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f97700ade00 0x7f97701e5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.098+0000 7f9774b4c640 1 --2- 172.21.15.114:0/4115763932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f977006d9c0 0x7f97701e4ef0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.098+0000 7f9774b4c640 1 --2- 172.21.15.114:0/4115763932 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f977006c5f0 0x7f97701e43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.098+0000 7f9774b4c640 1 -- 172.21.15.114:0/4115763932 >> 172.21.15.114:0/4115763932 conn(0x7f97700cb530 msgr2=0x7f97700ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.098+0000 7f9774b4c640 1 -- 172.21.15.114:0/4115763932 shutdown_connections 2023-11-04T01:43:31.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.098+0000 7f9774b4c640 1 -- 172.21.15.114:0/4115763932 wait complete. 2023-11-04T01:43:31.111 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:58.316710+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:59.185397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:50.031565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:50.411946+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 104, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:31.111 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:31.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.211+0000 7eff38d25640 1 Processor -- start 2023-11-04T01:43:31.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.212+0000 7eff38d25640 1 -- start start 2023-11-04T01:43:31.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.212+0000 7eff38d25640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3406d9c0 0x7eff340710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.212+0000 7eff38d25640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7eff3406c5f0 0x7eff34071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.212+0000 7eff38d25640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3406cc90 con 0x7eff340ade00 2023-11-04T01:43:31.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.212+0000 7eff38d25640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff340b0c40 con 0x7eff3406c5f0 2023-11-04T01:43:31.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.212+0000 7eff38d25640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff34071b50 con 0x7eff3406d9c0 2023-11-04T01:43:31.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.213+0000 7eff32d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7eff3406c5f0 0x7eff34071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.213+0000 7eff32d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7eff3406c5f0 0x7eff34071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56202/0 (socket says 172.21.15.114:56202) 2023-11-04T01:43:31.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.213+0000 7eff32d9d640 1 -- 172.21.15.114:0/406746837 learned_addr learned my addr 172.21.15.114:0/406746837 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:31.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.213+0000 7eff31d9b640 1 --2- 172.21.15.114:0/406746837 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3406d9c0 0x7eff340710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.213+0000 7eff32d9d640 1 -- 172.21.15.114:0/406746837 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3406d9c0 msgr2=0x7eff340710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.213+0000 7eff32d9d640 1 --2- 172.21.15.114:0/406746837 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3406d9c0 0x7eff340710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.213+0000 7eff32d9d640 1 -- 172.21.15.114:0/406746837 >> v1:172.21.15.141:6789/0 conn(0x7eff340ade00 legacy=0x7eff340b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.213+0000 7eff32d9d640 1 -- 172.21.15.114:0/406746837 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff340b0e60 con 0x7eff3406c5f0 2023-11-04T01:43:31.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.214+0000 7eff32d9d640 1 --2- 172.21.15.114:0/406746837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff3406c5f0 0x7eff34071610 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7eff2c009e50 tx=0x7eff2c02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afcdae0111831ac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.214+0000 7eff3159a640 1 -- 172.21.15.114:0/406746837 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c02c950 con 0x7eff3406c5f0 2023-11-04T01:43:31.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.214+0000 7eff3159a640 1 -- 172.21.15.114:0/406746837 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c02cab0 con 0x7eff3406c5f0 2023-11-04T01:43:31.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.214+0000 7eff3159a640 1 -- 172.21.15.114:0/406746837 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c02ce40 con 0x7eff3406c5f0 2023-11-04T01:43:31.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.214+0000 7eff38d25640 1 -- 172.21.15.114:0/406746837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff3406c5f0 msgr2=0x7eff34071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.214+0000 7eff38d25640 1 --2- 172.21.15.114:0/406746837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff3406c5f0 0x7eff34071610 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7eff2c009e50 tx=0x7eff2c02bdb0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.214+0000 7eff38d25640 1 -- 172.21.15.114:0/406746837 shutdown_connections 2023-11-04T01:43:31.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.214+0000 7eff38d25640 1 --2- 172.21.15.114:0/406746837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff3406c5f0 0x7eff34071610 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.214+0000 7eff38d25640 1 --2- 172.21.15.114:0/406746837 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3406d9c0 0x7eff340710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.214+0000 7eff38d25640 1 -- 172.21.15.114:0/406746837 >> 172.21.15.114:0/406746837 conn(0x7eff340cb530 msgr2=0x7eff340cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.214+0000 7eff38d25640 1 -- 172.21.15.114:0/406746837 shutdown_connections 2023-11-04T01:43:31.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.214+0000 7eff38d25640 1 -- 172.21.15.114:0/406746837 wait complete. 2023-11-04T01:43:31.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.216+0000 7eff38d25640 1 Processor -- start 2023-11-04T01:43:31.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.216+0000 7eff38d25640 1 -- start start 2023-11-04T01:43:31.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.216+0000 7eff38d25640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff3406c5f0 0x7eff34150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.216+0000 7eff38d25640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3406d9c0 0x7eff340ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.216+0000 7eff38d25640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff340ade00 0x7eff340ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.216+0000 7eff38d25640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff340caef0 con 0x7eff340ade00 2023-11-04T01:43:31.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.216+0000 7eff38d25640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff34151880 con 0x7eff3406c5f0 2023-11-04T01:43:31.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.216+0000 7eff38d25640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff34151b60 con 0x7eff3406d9c0 2023-11-04T01:43:31.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff32d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff340ade00 0x7eff340ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff32d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff340ade00 0x7eff340ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56208/0 (socket says 172.21.15.114:56208) 2023-11-04T01:43:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff32d9d640 1 -- 172.21.15.114:0/48850454 learned_addr learned my addr 172.21.15.114:0/48850454 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff31d9b640 1 --2- 172.21.15.114:0/48850454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3406d9c0 0x7eff340ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff3259c640 1 --2- 172.21.15.114:0/48850454 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff3406c5f0 0x7eff34150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff32d9d640 1 -- 172.21.15.114:0/48850454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3406d9c0 msgr2=0x7eff340ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff32d9d640 1 --2- 172.21.15.114:0/48850454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3406d9c0 0x7eff340ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff32d9d640 1 -- 172.21.15.114:0/48850454 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff3406c5f0 msgr2=0x7eff34150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff32d9d640 1 --2- 172.21.15.114:0/48850454 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff3406c5f0 0x7eff34150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff32d9d640 1 -- 172.21.15.114:0/48850454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c009b30 con 0x7eff340ade00 2023-11-04T01:43:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff3259c640 1 --2- 172.21.15.114:0/48850454 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff3406c5f0 0x7eff34150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff31d9b640 1 --2- 172.21.15.114:0/48850454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3406d9c0 0x7eff340ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff32d9d640 1 --2- 172.21.15.114:0/48850454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff340ade00 0x7eff340ace10 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7eff2c036040 tx=0x7eff2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff22ffd640 1 -- 172.21.15.114:0/48850454 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c03e450 con 0x7eff340ade00 2023-11-04T01:43:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff22ffd640 1 -- 172.21.15.114:0/48850454 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c03e5d0 con 0x7eff340ade00 2023-11-04T01:43:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff38d25640 1 -- 172.21.15.114:0/48850454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff34151e40 con 0x7eff340ade00 2023-11-04T01:43:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff22ffd640 1 -- 172.21.15.114:0/48850454 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c03e980 con 0x7eff340ade00 2023-11-04T01:43:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.217+0000 7eff38d25640 1 -- 172.21.15.114:0/48850454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff34151620 con 0x7eff340ade00 2023-11-04T01:43:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.218+0000 7eff38d25640 1 -- 172.21.15.114:0/48850454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff34152030 con 0x7eff340ade00 2023-11-04T01:43:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.219+0000 7eff22ffd640 1 -- 172.21.15.114:0/48850454 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff2c03eae0 con 0x7eff340ade00 2023-11-04T01:43:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.219+0000 7eff22ffd640 1 --2- 172.21.15.114:0/48850454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7eff1406ae70 0x7eff1406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.219+0000 7eff3259c640 1 --2- 172.21.15.114:0/48850454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7eff1406ae70 0x7eff1406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.219+0000 7eff22ffd640 1 -- 172.21.15.114:0/48850454 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7eff2c0acd90 con 0x7eff340ade00 2023-11-04T01:43:31.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.219+0000 7eff3259c640 1 --2- 172.21.15.114:0/48850454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7eff1406ae70 0x7eff1406d330 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7eff340c7370 tx=0x7eff28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.223+0000 7eff22ffd640 1 -- 172.21.15.114:0/48850454 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7eff2c077630 con 0x7eff340ade00 2023-11-04T01:43:31.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.389+0000 7eff38d25640 1 -- 172.21.15.114:0/48850454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff340684b0 con 0x7eff340ade00 2023-11-04T01:43:31.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.389+0000 7eff22ffd640 1 -- 172.21.15.114:0/48850454 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff2c0430a0 con 0x7eff340ade00 2023-11-04T01:43:31.391 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:43:31.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.391+0000 7eff38d25640 1 -- 172.21.15.114:0/48850454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7eff1406ae70 msgr2=0x7eff1406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.391+0000 7eff38d25640 1 --2- 172.21.15.114:0/48850454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7eff1406ae70 0x7eff1406d330 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7eff340c7370 tx=0x7eff28009040 comp rx=0 tx=0).stop 2023-11-04T01:43:31.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.391+0000 7eff38d25640 1 -- 172.21.15.114:0/48850454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff340ade00 msgr2=0x7eff340ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.391+0000 7eff38d25640 1 --2- 172.21.15.114:0/48850454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff340ade00 0x7eff340ace10 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7eff2c036040 tx=0x7eff2c004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:31.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.391+0000 7eff38d25640 1 -- 172.21.15.114:0/48850454 shutdown_connections 2023-11-04T01:43:31.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.391+0000 7eff38d25640 1 --2- 172.21.15.114:0/48850454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff340ade00 0x7eff340ace10 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.391+0000 7eff38d25640 1 --2- 172.21.15.114:0/48850454 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7eff3406d9c0 0x7eff340ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.391+0000 7eff38d25640 1 --2- 172.21.15.114:0/48850454 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7eff1406ae70 0x7eff1406d330 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.391+0000 7eff38d25640 1 --2- 172.21.15.114:0/48850454 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7eff3406c5f0 0x7eff34150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.391+0000 7eff38d25640 1 -- 172.21.15.114:0/48850454 >> 172.21.15.114:0/48850454 conn(0x7eff340cb530 msgr2=0x7eff340b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.391+0000 7eff38d25640 1 -- 172.21.15.114:0/48850454 shutdown_connections 2023-11-04T01:43:31.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.391+0000 7eff38d25640 1 -- 172.21.15.114:0/48850454 wait complete. 2023-11-04T01:43:31.403 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:43:31.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.503+0000 7fe53f7e2640 1 Processor -- start 2023-11-04T01:43:31.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.503+0000 7fe53f7e2640 1 -- start start 2023-11-04T01:43:31.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.504+0000 7fe53f7e2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe538160630 0x7fe5380cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.504+0000 7fe53f7e2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fe53806e1d0 0x7fe5380cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.504+0000 7fe53f7e2640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53806e660 con 0x7fe5380ca0e0 2023-11-04T01:43:31.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.504+0000 7fe53f7e2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53806d0e0 con 0x7fe538160630 2023-11-04T01:43:31.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.504+0000 7fe53f7e2640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53806d3c0 con 0x7fe53806e1d0 2023-11-04T01:43:31.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.504+0000 7fe53d57e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe538160630 0x7fe5380cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.504+0000 7fe53d57e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe538160630 0x7fe5380cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56222/0 (socket says 172.21.15.114:56222) 2023-11-04T01:43:31.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.504+0000 7fe53d57e640 1 -- 172.21.15.114:0/2232566216 learned_addr learned my addr 172.21.15.114:0/2232566216 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:31.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.505+0000 7fe53cd7d640 1 --2- 172.21.15.114:0/2232566216 >> v2:172.21.15.141:3300/0 conn(0x7fe53806e1d0 0x7fe5380cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.505+0000 7fe53d57e640 1 -- 172.21.15.114:0/2232566216 >> v2:172.21.15.141:3300/0 conn(0x7fe53806e1d0 msgr2=0x7fe5380cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.505+0000 7fe53d57e640 1 --2- 172.21.15.114:0/2232566216 >> v2:172.21.15.141:3300/0 conn(0x7fe53806e1d0 0x7fe5380cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.505+0000 7fe53d57e640 1 -- 172.21.15.114:0/2232566216 >> v1:172.21.15.141:6789/0 conn(0x7fe5380ca0e0 legacy=0x7fe53806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.505+0000 7fe53d57e640 1 -- 172.21.15.114:0/2232566216 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53806d6a0 con 0x7fe538160630 2023-11-04T01:43:31.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.505+0000 7fe53d57e640 1 --2- 172.21.15.114:0/2232566216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe538160630 0x7fe5380cda40 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fe5380738c0 tx=0x7fe53402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324f22cf89b0f562 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.505+0000 7fe52ffff640 1 -- 172.21.15.114:0/2232566216 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53402c9f0 con 0x7fe538160630 2023-11-04T01:43:31.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.505+0000 7fe52ffff640 1 -- 172.21.15.114:0/2232566216 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53402cb50 con 0x7fe538160630 2023-11-04T01:43:31.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.505+0000 7fe52ffff640 1 -- 172.21.15.114:0/2232566216 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5340343f0 con 0x7fe538160630 2023-11-04T01:43:31.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.506+0000 7fe53f7e2640 1 -- 172.21.15.114:0/2232566216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe538160630 msgr2=0x7fe5380cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.506+0000 7fe53f7e2640 1 --2- 172.21.15.114:0/2232566216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe538160630 0x7fe5380cda40 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fe5380738c0 tx=0x7fe53402be50 comp rx=0 tx=0).stop 2023-11-04T01:43:31.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.506+0000 7fe53f7e2640 1 -- 172.21.15.114:0/2232566216 shutdown_connections 2023-11-04T01:43:31.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.506+0000 7fe53f7e2640 1 --2- 172.21.15.114:0/2232566216 >> v2:172.21.15.141:3300/0 conn(0x7fe53806e1d0 0x7fe5380cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.506+0000 7fe53f7e2640 1 --2- 172.21.15.114:0/2232566216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe538160630 0x7fe5380cda40 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.506+0000 7fe53f7e2640 1 -- 172.21.15.114:0/2232566216 >> 172.21.15.114:0/2232566216 conn(0x7fe5380cb8e0 msgr2=0x7fe5380cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.506+0000 7fe53f7e2640 1 -- 172.21.15.114:0/2232566216 shutdown_connections 2023-11-04T01:43:31.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.506+0000 7fe53f7e2640 1 -- 172.21.15.114:0/2232566216 wait complete. 2023-11-04T01:43:31.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.507+0000 7fe53f7e2640 1 Processor -- start 2023-11-04T01:43:31.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.507+0000 7fe53f7e2640 1 -- start start 2023-11-04T01:43:31.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53f7e2640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe5380ca0e0 0x7fe5380c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53f7e2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe538160630 0x7fe5381f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53f7e2640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5381553b0 0x7fe5380af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53f7e2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380b29d0 con 0x7fe538160630 2023-11-04T01:43:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53f7e2640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380c4890 con 0x7fe5381553b0 2023-11-04T01:43:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53f7e2640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380b1ae0 con 0x7fe5380ca0e0 2023-11-04T01:43:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53cd7d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe538160630 0x7fe5381f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53cd7d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe538160630 0x7fe5381f1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56234/0 (socket says 172.21.15.114:56234) 2023-11-04T01:43:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53cd7d640 1 -- 172.21.15.114:0/213628009 learned_addr learned my addr 172.21.15.114:0/213628009 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53d57e640 1 --2- 172.21.15.114:0/213628009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe5380ca0e0 0x7fe5380c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53dd7f640 1 --2- 172.21.15.114:0/213628009 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5381553b0 0x7fe5380af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53cd7d640 1 -- 172.21.15.114:0/213628009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe5380ca0e0 msgr2=0x7fe5380c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53cd7d640 1 --2- 172.21.15.114:0/213628009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe5380ca0e0 0x7fe5380c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53cd7d640 1 -- 172.21.15.114:0/213628009 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5381553b0 msgr2=0x7fe5380af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53cd7d640 1 --2- 172.21.15.114:0/213628009 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5381553b0 0x7fe5380af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53cd7d640 1 -- 172.21.15.114:0/213628009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe534009b30 con 0x7fe538160630 2023-11-04T01:43:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53d57e640 1 --2- 172.21.15.114:0/213628009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe5380ca0e0 0x7fe5380c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53dd7f640 1 --2- 172.21.15.114:0/213628009 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5381553b0 0x7fe5380af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.508+0000 7fe53cd7d640 1 --2- 172.21.15.114:0/213628009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe538160630 0x7fe5381f1f90 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fe52800c7f0 tx=0x7fe52800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.509+0000 7fe52dffb640 1 -- 172.21.15.114:0/213628009 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528004220 con 0x7fe538160630 2023-11-04T01:43:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.509+0000 7fe52dffb640 1 -- 172.21.15.114:0/213628009 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe528004380 con 0x7fe538160630 2023-11-04T01:43:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.509+0000 7fe53f7e2640 1 -- 172.21.15.114:0/213628009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5380b1dc0 con 0x7fe538160630 2023-11-04T01:43:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.509+0000 7fe52dffb640 1 -- 172.21.15.114:0/213628009 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528007840 con 0x7fe538160630 2023-11-04T01:43:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.509+0000 7fe53f7e2640 1 -- 172.21.15.114:0/213628009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5380b2380 con 0x7fe538160630 2023-11-04T01:43:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.510+0000 7fe53f7e2640 1 -- 172.21.15.114:0/213628009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5380cabd0 con 0x7fe538160630 2023-11-04T01:43:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.510+0000 7fe52dffb640 1 -- 172.21.15.114:0/213628009 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe528007bb0 con 0x7fe538160630 2023-11-04T01:43:31.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.510+0000 7fe52dffb640 1 --2- 172.21.15.114:0/213628009 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe51c06aea0 0x7fe51c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.511+0000 7fe52dffb640 1 -- 172.21.15.114:0/213628009 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fe528089e60 con 0x7fe538160630 2023-11-04T01:43:31.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.511+0000 7fe53d57e640 1 --2- 172.21.15.114:0/213628009 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe51c06aea0 0x7fe51c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.511+0000 7fe53d57e640 1 --2- 172.21.15.114:0/213628009 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe51c06aea0 0x7fe51c06d360 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe534035000 tx=0x7fe534030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.515+0000 7fe52dffb640 1 -- 172.21.15.114:0/213628009 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe5280545d0 con 0x7fe538160630 2023-11-04T01:43:31.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.679+0000 7fe53f7e2640 1 -- 172.21.15.114:0/213628009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fe5380684b0 con 0x7fe538160630 2023-11-04T01:43:31.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.679+0000 7fe52dffb640 1 -- 172.21.15.114:0/213628009 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v111) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe52801e020 con 0x7fe538160630 2023-11-04T01:43:31.682 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:43:31.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.681+0000 7fe53f7e2640 1 -- 172.21.15.114:0/213628009 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe51c06aea0 msgr2=0x7fe51c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.681+0000 7fe53f7e2640 1 --2- 172.21.15.114:0/213628009 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe51c06aea0 0x7fe51c06d360 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe534035000 tx=0x7fe534030000 comp rx=0 tx=0).stop 2023-11-04T01:43:31.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.681+0000 7fe53f7e2640 1 -- 172.21.15.114:0/213628009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe538160630 msgr2=0x7fe5381f1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.681+0000 7fe53f7e2640 1 --2- 172.21.15.114:0/213628009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe538160630 0x7fe5381f1f90 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fe52800c7f0 tx=0x7fe52800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.681+0000 7fe53f7e2640 1 -- 172.21.15.114:0/213628009 shutdown_connections 2023-11-04T01:43:31.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.681+0000 7fe53f7e2640 1 --2- 172.21.15.114:0/213628009 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe51c06aea0 0x7fe51c06d360 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.681+0000 7fe53f7e2640 1 --2- 172.21.15.114:0/213628009 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe5381553b0 0x7fe5380af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.681+0000 7fe53f7e2640 1 --2- 172.21.15.114:0/213628009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe538160630 0x7fe5381f1f90 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.681+0000 7fe53f7e2640 1 --2- 172.21.15.114:0/213628009 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe5380ca0e0 0x7fe5380c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.681+0000 7fe53f7e2640 1 -- 172.21.15.114:0/213628009 >> 172.21.15.114:0/213628009 conn(0x7fe5380cb8e0 msgr2=0x7fe5380cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.681+0000 7fe53f7e2640 1 -- 172.21.15.114:0/213628009 shutdown_connections 2023-11-04T01:43:31.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.681+0000 7fe53f7e2640 1 -- 172.21.15.114:0/213628009 wait complete. 2023-11-04T01:43:31.694 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:43:31.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.794+0000 7f3dcb687640 1 Processor -- start 2023-11-04T01:43:31.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.795+0000 7f3dcb687640 1 -- start start 2023-11-04T01:43:31.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.795+0000 7f3dcb687640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3dc40b0c40 0x7f3dc406fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.795+0000 7f3dcb687640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f3dc406bb60 0x7f3dc4070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.795+0000 7f3dcb687640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc4071500 con 0x7f3dc4159e40 2023-11-04T01:43:31.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.795+0000 7f3dcb687640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc4070a70 con 0x7f3dc40b0c40 2023-11-04T01:43:31.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.795+0000 7f3dcb687640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc415dae0 con 0x7f3dc406bb60 2023-11-04T01:43:31.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.795+0000 7f3dc8c22640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3dc40b0c40 0x7f3dc406fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.796+0000 7f3dc9423640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3dc4159e40 0x7f3dc40b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35386/0 (socket says 172.21.15.114:35386) 2023-11-04T01:43:31.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.796+0000 7f3dc9423640 1 -- 172.21.15.114:0/3226307829 learned_addr learned my addr 172.21.15.114:0/3226307829 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:43:31.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.796+0000 7f3dc8c22640 1 -- 172.21.15.114:0/3226307829 >> v2:172.21.15.141:3300/0 conn(0x7f3dc406bb60 msgr2=0x7f3dc4070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.796+0000 7f3dc8c22640 1 --2- 172.21.15.114:0/3226307829 >> v2:172.21.15.141:3300/0 conn(0x7f3dc406bb60 0x7f3dc4070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.796+0000 7f3dc8c22640 1 -- 172.21.15.114:0/3226307829 >> v1:172.21.15.114:6789/0 conn(0x7f3dc4159e40 legacy=0x7f3dc40b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.796+0000 7f3dbbfff640 1 -- 172.21.15.114:0/3226307829 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304784625 0 0) 0x7f3dc4071500 con 0x7f3dc4159e40 2023-11-04T01:43:31.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.796+0000 7f3dc8c22640 1 -- 172.21.15.114:0/3226307829 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc4070c60 con 0x7f3dc40b0c40 2023-11-04T01:43:31.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.797+0000 7f3dc8c22640 1 --2- 172.21.15.114:0/3226307829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc40b0c40 0x7f3dc406fff0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40cea40 tx=0x7f3dc002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da340dc6b61c40d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.797+0000 7f3dbbfff640 1 -- 172.21.15.114:0/3226307829 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc002e070 con 0x7f3dc40b0c40 2023-11-04T01:43:31.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.797+0000 7f3dbbfff640 1 -- 172.21.15.114:0/3226307829 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc00315a0 con 0x7f3dc40b0c40 2023-11-04T01:43:31.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.797+0000 7f3dbbfff640 1 -- 172.21.15.114:0/3226307829 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0031930 con 0x7f3dc40b0c40 2023-11-04T01:43:31.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.797+0000 7f3dcb687640 1 -- 172.21.15.114:0/3226307829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc40b0c40 msgr2=0x7f3dc406fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.797+0000 7f3dcb687640 1 --2- 172.21.15.114:0/3226307829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc40b0c40 0x7f3dc406fff0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40cea40 tx=0x7f3dc002b840 comp rx=0 tx=0).stop 2023-11-04T01:43:31.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.797+0000 7f3dcb687640 1 -- 172.21.15.114:0/3226307829 shutdown_connections 2023-11-04T01:43:31.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.797+0000 7f3dcb687640 1 --2- 172.21.15.114:0/3226307829 >> v2:172.21.15.141:3300/0 conn(0x7f3dc406bb60 0x7f3dc4070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.797+0000 7f3dcb687640 1 --2- 172.21.15.114:0/3226307829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc40b0c40 0x7f3dc406fff0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.797+0000 7f3dcb687640 1 -- 172.21.15.114:0/3226307829 >> 172.21.15.114:0/3226307829 conn(0x7f3dc40cb530 msgr2=0x7f3dc40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.797+0000 7f3dcb687640 1 -- 172.21.15.114:0/3226307829 shutdown_connections 2023-11-04T01:43:31.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.797+0000 7f3dcb687640 1 -- 172.21.15.114:0/3226307829 wait complete. 2023-11-04T01:43:31.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.798+0000 7f3dcb687640 1 Processor -- start 2023-11-04T01:43:31.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.798+0000 7f3dcb687640 1 -- start start 2023-11-04T01:43:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.799+0000 7f3dcb687640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dc406bb60 0x7f3dc40cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.799+0000 7f3dcb687640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc40b0c40 0x7f3dc40a8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.799+0000 7f3dcb687640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dc4159e40 0x7f3dc414e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.799+0000 7f3dcb687640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40aa410 con 0x7f3dc40b0c40 2023-11-04T01:43:31.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.799+0000 7f3dcb687640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40c6e60 con 0x7f3dc406bb60 2023-11-04T01:43:31.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.799+0000 7f3dcb687640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40c6630 con 0x7f3dc4159e40 2023-11-04T01:43:31.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.799+0000 7f3dc8c22640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc40b0c40 0x7f3dc40a8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.799+0000 7f3dc8c22640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc40b0c40 0x7f3dc40a8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56248/0 (socket says 172.21.15.114:56248) 2023-11-04T01:43:31.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.799+0000 7f3dc8c22640 1 -- 172.21.15.114:0/4223057327 learned_addr learned my addr 172.21.15.114:0/4223057327 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:31.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.800+0000 7f3dc8c22640 1 -- 172.21.15.114:0/4223057327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dc4159e40 msgr2=0x7f3dc414e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.800+0000 7f3dc9423640 1 --2- 172.21.15.114:0/4223057327 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dc406bb60 0x7f3dc40cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.800+0000 7f3dc9c24640 1 --2- 172.21.15.114:0/4223057327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dc4159e40 0x7f3dc414e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.800+0000 7f3dc8c22640 1 --2- 172.21.15.114:0/4223057327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dc4159e40 0x7f3dc414e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.800+0000 7f3dc8c22640 1 -- 172.21.15.114:0/4223057327 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dc406bb60 msgr2=0x7f3dc40cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.800+0000 7f3dc8c22640 1 --2- 172.21.15.114:0/4223057327 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dc406bb60 0x7f3dc40cdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.800+0000 7f3dc8c22640 1 -- 172.21.15.114:0/4223057327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc0009400 con 0x7f3dc40b0c40 2023-11-04T01:43:31.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.800+0000 7f3dc9423640 1 --2- 172.21.15.114:0/4223057327 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dc406bb60 0x7f3dc40cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:31.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.800+0000 7f3dc9c24640 1 --2- 172.21.15.114:0/4223057327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dc4159e40 0x7f3dc414e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:31.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.800+0000 7f3dc8c22640 1 --2- 172.21.15.114:0/4223057327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc40b0c40 0x7f3dc40a8eb0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f3dc002be50 tx=0x7f3dc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.800+0000 7f3db9ffb640 1 -- 172.21.15.114:0/4223057327 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0004230 con 0x7f3dc40b0c40 2023-11-04T01:43:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.800+0000 7f3db9ffb640 1 -- 172.21.15.114:0/4223057327 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc0004390 con 0x7f3dc40b0c40 2023-11-04T01:43:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.800+0000 7f3dcb687640 1 -- 172.21.15.114:0/4223057327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc40c68a0 con 0x7f3dc40b0c40 2023-11-04T01:43:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.800+0000 7f3db9ffb640 1 -- 172.21.15.114:0/4223057327 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0032940 con 0x7f3dc40b0c40 2023-11-04T01:43:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.800+0000 7f3dcb687640 1 -- 172.21.15.114:0/4223057327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc40c7190 con 0x7f3dc40b0c40 2023-11-04T01:43:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.801+0000 7f3dcb687640 1 -- 172.21.15.114:0/4223057327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc40cf8c0 con 0x7f3dc40b0c40 2023-11-04T01:43:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.802+0000 7f3db9ffb640 1 -- 172.21.15.114:0/4223057327 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3dc0032aa0 con 0x7f3dc40b0c40 2023-11-04T01:43:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.802+0000 7f3db9ffb640 1 --2- 172.21.15.114:0/4223057327 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3da806ae70 0x7f3da806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.802+0000 7f3db9ffb640 1 -- 172.21.15.114:0/4223057327 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f3dc00ac080 con 0x7f3dc40b0c40 2023-11-04T01:43:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.802+0000 7f3dc9423640 1 --2- 172.21.15.114:0/4223057327 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3da806ae70 0x7f3da806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.803+0000 7f3dc9423640 1 --2- 172.21.15.114:0/4223057327 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3da806ae70 0x7f3da806d330 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f3db4000f60 tx=0x7f3db4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.806+0000 7f3db9ffb640 1 -- 172.21.15.114:0/4223057327 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3dc0076900 con 0x7f3dc40b0c40 2023-11-04T01:43:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.974+0000 7f3dcb687640 1 -- 172.21.15.114:0/4223057327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f3dc40684b0 con 0x7f3dc40b0c40 2023-11-04T01:43:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.974+0000 7f3db9ffb640 1 -- 172.21.15.114:0/4223057327 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v111) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3dc0079f20 con 0x7f3dc40b0c40 2023-11-04T01:43:31.976 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:43:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.976+0000 7f3dcb687640 1 -- 172.21.15.114:0/4223057327 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3da806ae70 msgr2=0x7f3da806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.976+0000 7f3dcb687640 1 --2- 172.21.15.114:0/4223057327 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3da806ae70 0x7f3da806d330 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f3db4000f60 tx=0x7f3db4009040 comp rx=0 tx=0).stop 2023-11-04T01:43:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.976+0000 7f3dcb687640 1 -- 172.21.15.114:0/4223057327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc40b0c40 msgr2=0x7f3dc40a8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.976+0000 7f3dcb687640 1 --2- 172.21.15.114:0/4223057327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc40b0c40 0x7f3dc40a8eb0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f3dc002be50 tx=0x7f3dc00046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.976+0000 7f3dcb687640 1 -- 172.21.15.114:0/4223057327 shutdown_connections 2023-11-04T01:43:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.976+0000 7f3dcb687640 1 --2- 172.21.15.114:0/4223057327 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3dc4159e40 0x7f3dc414e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.976+0000 7f3dcb687640 1 --2- 172.21.15.114:0/4223057327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc40b0c40 0x7f3dc40a8eb0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.976+0000 7f3dcb687640 1 --2- 172.21.15.114:0/4223057327 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3da806ae70 0x7f3da806d330 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.976+0000 7f3dcb687640 1 --2- 172.21.15.114:0/4223057327 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3dc406bb60 0x7f3dc40cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.976+0000 7f3dcb687640 1 -- 172.21.15.114:0/4223057327 >> 172.21.15.114:0/4223057327 conn(0x7f3dc40cb530 msgr2=0x7f3dc40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.976+0000 7f3dcb687640 1 -- 172.21.15.114:0/4223057327 shutdown_connections 2023-11-04T01:43:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:31.976+0000 7f3dcb687640 1 -- 172.21.15.114:0/4223057327 wait complete. 2023-11-04T01:43:31.989 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:43:32.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.089+0000 7fd4cafa9640 1 Processor -- start 2023-11-04T01:43:32.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.089+0000 7fd4cafa9640 1 -- start start 2023-11-04T01:43:32.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.090+0000 7fd4cafa9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fd4c40b0c40 0x7fd4c406fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.090+0000 7fd4cafa9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd4c406bb60 0x7fd4c4070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.090+0000 7fd4cafa9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c4071500 con 0x7fd4c4159e40 2023-11-04T01:43:32.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.090+0000 7fd4cafa9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c4070a70 con 0x7fd4c406bb60 2023-11-04T01:43:32.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.090+0000 7fd4cafa9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c415dae0 con 0x7fd4c40b0c40 2023-11-04T01:43:32.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.090+0000 7fd4c9546640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd4c406bb60 0x7fd4c4070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.090+0000 7fd4c8d45640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd4c4159e40 0x7fd4c40b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35394/0 (socket says 172.21.15.114:35394) 2023-11-04T01:43:32.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.090+0000 7fd4c8d45640 1 -- 172.21.15.114:0/2597957001 learned_addr learned my addr 172.21.15.114:0/2597957001 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:43:32.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.090+0000 7fd4c3fff640 1 --2- 172.21.15.114:0/2597957001 >> v2:172.21.15.141:3300/0 conn(0x7fd4c40b0c40 0x7fd4c406fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.090+0000 7fd4c9546640 1 -- 172.21.15.114:0/2597957001 >> v2:172.21.15.141:3300/0 conn(0x7fd4c40b0c40 msgr2=0x7fd4c406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:32.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.090+0000 7fd4c9546640 1 --2- 172.21.15.114:0/2597957001 >> v2:172.21.15.141:3300/0 conn(0x7fd4c40b0c40 0x7fd4c406fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.090+0000 7fd4c9546640 1 -- 172.21.15.114:0/2597957001 >> v1:172.21.15.114:6789/0 conn(0x7fd4c4159e40 legacy=0x7fd4c40b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.090+0000 7fd4c37fe640 1 -- 172.21.15.114:0/2597957001 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894902055 0 0) 0x7fd4c4071500 con 0x7fd4c4159e40 2023-11-04T01:43:32.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.090+0000 7fd4c9546640 1 -- 172.21.15.114:0/2597957001 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c4070c60 con 0x7fd4c406bb60 2023-11-04T01:43:32.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.091+0000 7fd4c9546640 1 --2- 172.21.15.114:0/2597957001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4c406bb60 0x7fd4c4070530 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fd4c406fdc0 tx=0x7fd4bc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d1af2cb141b58d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.091+0000 7fd4c37fe640 1 -- 172.21.15.114:0/2597957001 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc02cbf0 con 0x7fd4c406bb60 2023-11-04T01:43:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.091+0000 7fd4c37fe640 1 -- 172.21.15.114:0/2597957001 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc02cd50 con 0x7fd4c406bb60 2023-11-04T01:43:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.091+0000 7fd4c37fe640 1 -- 172.21.15.114:0/2597957001 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc034660 con 0x7fd4c406bb60 2023-11-04T01:43:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.092+0000 7fd4cafa9640 1 -- 172.21.15.114:0/2597957001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4c406bb60 msgr2=0x7fd4c4070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.092+0000 7fd4cafa9640 1 --2- 172.21.15.114:0/2597957001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4c406bb60 0x7fd4c4070530 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fd4c406fdc0 tx=0x7fd4bc02be40 comp rx=0 tx=0).stop 2023-11-04T01:43:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.092+0000 7fd4cafa9640 1 -- 172.21.15.114:0/2597957001 shutdown_connections 2023-11-04T01:43:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.092+0000 7fd4cafa9640 1 --2- 172.21.15.114:0/2597957001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4c406bb60 0x7fd4c4070530 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.092+0000 7fd4cafa9640 1 --2- 172.21.15.114:0/2597957001 >> v2:172.21.15.141:3300/0 conn(0x7fd4c40b0c40 0x7fd4c406fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.092+0000 7fd4cafa9640 1 -- 172.21.15.114:0/2597957001 >> 172.21.15.114:0/2597957001 conn(0x7fd4c40cb530 msgr2=0x7fd4c40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.092+0000 7fd4cafa9640 1 -- 172.21.15.114:0/2597957001 shutdown_connections 2023-11-04T01:43:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.092+0000 7fd4cafa9640 1 -- 172.21.15.114:0/2597957001 wait complete. 2023-11-04T01:43:32.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.093+0000 7fd4cafa9640 1 Processor -- start 2023-11-04T01:43:32.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.093+0000 7fd4cafa9640 1 -- start start 2023-11-04T01:43:32.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4cafa9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4c406bb60 0x7fd4c40c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4cafa9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4c40b0c40 0x7fd4c40af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4cafa9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4c4159e40 0x7fd4c4150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4cafa9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c40c4cd0 con 0x7fd4c40b0c40 2023-11-04T01:43:32.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4cafa9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c40c4050 con 0x7fd4c4159e40 2023-11-04T01:43:32.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4cafa9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c40c4330 con 0x7fd4c406bb60 2023-11-04T01:43:32.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4c3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4c40b0c40 0x7fd4c40af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4c3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4c40b0c40 0x7fd4c40af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56268/0 (socket says 172.21.15.114:56268) 2023-11-04T01:43:32.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4c3fff640 1 -- 172.21.15.114:0/2600544190 learned_addr learned my addr 172.21.15.114:0/2600544190 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4c3fff640 1 -- 172.21.15.114:0/2600544190 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4c406bb60 msgr2=0x7fd4c40c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4c3fff640 1 --2- 172.21.15.114:0/2600544190 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4c406bb60 0x7fd4c40c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4c3fff640 1 -- 172.21.15.114:0/2600544190 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4c4159e40 msgr2=0x7fd4c4150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4c3fff640 1 --2- 172.21.15.114:0/2600544190 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4c4159e40 0x7fd4c4150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4c3fff640 1 -- 172.21.15.114:0/2600544190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc009a70 con 0x7fd4c40b0c40 2023-11-04T01:43:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4c3fff640 1 --2- 172.21.15.114:0/2600544190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4c40b0c40 0x7fd4c40af2e0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800d800 tx=0x7fd4b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4c17fa640 1 -- 172.21.15.114:0/2600544190 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b800b6c0 con 0x7fd4c40b0c40 2023-11-04T01:43:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4c17fa640 1 -- 172.21.15.114:0/2600544190 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b800b820 con 0x7fd4c40b0c40 2023-11-04T01:43:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4cafa9640 1 -- 172.21.15.114:0/2600544190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c40c4610 con 0x7fd4c40b0c40 2023-11-04T01:43:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4c17fa640 1 -- 172.21.15.114:0/2600544190 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b800bbb0 con 0x7fd4c40b0c40 2023-11-04T01:43:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.094+0000 7fd4cafa9640 1 -- 172.21.15.114:0/2600544190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c40c3c30 con 0x7fd4c40b0c40 2023-11-04T01:43:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.095+0000 7fd4cafa9640 1 -- 172.21.15.114:0/2600544190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c40c3df0 con 0x7fd4c40b0c40 2023-11-04T01:43:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.096+0000 7fd4c17fa640 1 -- 172.21.15.114:0/2600544190 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4b800bd10 con 0x7fd4c40b0c40 2023-11-04T01:43:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.096+0000 7fd4c17fa640 1 --2- 172.21.15.114:0/2600544190 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd4b006ae70 0x7fd4b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.096+0000 7fd4c8d45640 1 --2- 172.21.15.114:0/2600544190 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd4b006ae70 0x7fd4b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.096+0000 7fd4c17fa640 1 -- 172.21.15.114:0/2600544190 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fd4b808a450 con 0x7fd4c40b0c40 2023-11-04T01:43:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.097+0000 7fd4c8d45640 1 --2- 172.21.15.114:0/2600544190 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd4b006ae70 0x7fd4b006d330 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4007fd0 tx=0x7fd4b4007960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.100+0000 7fd4c17fa640 1 -- 172.21.15.114:0/2600544190 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd4b8054c40 con 0x7fd4c40b0c40 2023-11-04T01:43:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.265+0000 7fd4cafa9640 1 -- 172.21.15.114:0/2600544190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fd4c40684b0 con 0x7fd4c40b0c40 2023-11-04T01:43:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.265+0000 7fd4c17fa640 1 -- 172.21.15.114:0/2600544190 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v111) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd4b8058260 con 0x7fd4c40b0c40 2023-11-04T01:43:32.267 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:43:32.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.267+0000 7fd4cafa9640 1 -- 172.21.15.114:0/2600544190 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd4b006ae70 msgr2=0x7fd4b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.267+0000 7fd4cafa9640 1 --2- 172.21.15.114:0/2600544190 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd4b006ae70 0x7fd4b006d330 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4007fd0 tx=0x7fd4b4007960 comp rx=0 tx=0).stop 2023-11-04T01:43:32.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.267+0000 7fd4cafa9640 1 -- 172.21.15.114:0/2600544190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4c40b0c40 msgr2=0x7fd4c40af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.267+0000 7fd4cafa9640 1 --2- 172.21.15.114:0/2600544190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4c40b0c40 0x7fd4c40af2e0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800d800 tx=0x7fd4b800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.267+0000 7fd4cafa9640 1 -- 172.21.15.114:0/2600544190 shutdown_connections 2023-11-04T01:43:32.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.267+0000 7fd4cafa9640 1 --2- 172.21.15.114:0/2600544190 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd4b006ae70 0x7fd4b006d330 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.267+0000 7fd4cafa9640 1 --2- 172.21.15.114:0/2600544190 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd4c4159e40 0x7fd4c4150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.267+0000 7fd4cafa9640 1 --2- 172.21.15.114:0/2600544190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4c40b0c40 0x7fd4c40af2e0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.267+0000 7fd4cafa9640 1 --2- 172.21.15.114:0/2600544190 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd4c406bb60 0x7fd4c40c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.267+0000 7fd4cafa9640 1 -- 172.21.15.114:0/2600544190 >> 172.21.15.114:0/2600544190 conn(0x7fd4c40cb530 msgr2=0x7fd4c40cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:32.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.267+0000 7fd4cafa9640 1 -- 172.21.15.114:0/2600544190 shutdown_connections 2023-11-04T01:43:32.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.267+0000 7fd4cafa9640 1 -- 172.21.15.114:0/2600544190 wait complete. 2023-11-04T01:43:32.279 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:32.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.379+0000 7f7db7a4b640 1 Processor -- start 2023-11-04T01:43:32.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.379+0000 7f7db7a4b640 1 -- start start 2023-11-04T01:43:32.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.380+0000 7f7db7a4b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7db015b200 0x7f7db00ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.380+0000 7f7db7a4b640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7db00afda0 0x7f7db00cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.380+0000 7f7db7a4b640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db00cdc20 con 0x7f7db00cd7f0 2023-11-04T01:43:32.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.380+0000 7f7db7a4b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db00cde80 con 0x7f7db015b200 2023-11-04T01:43:32.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.380+0000 7f7db7a4b640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db00cf670 con 0x7f7db00afda0 2023-11-04T01:43:32.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.381+0000 7f7db57e7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7db015b200 0x7f7db00ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.381+0000 7f7db57e7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7db015b200 0x7f7db00ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56284/0 (socket says 172.21.15.114:56284) 2023-11-04T01:43:32.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.381+0000 7f7db57e7640 1 -- 172.21.15.114:0/1045196364 learned_addr learned my addr 172.21.15.114:0/1045196364 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:32.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.381+0000 7f7db4fe6640 1 --2- 172.21.15.114:0/1045196364 >> v2:172.21.15.141:3300/0 conn(0x7f7db00afda0 0x7f7db00cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.381+0000 7f7db57e7640 1 -- 172.21.15.114:0/1045196364 >> v2:172.21.15.141:3300/0 conn(0x7f7db00afda0 msgr2=0x7f7db00cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:32.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.381+0000 7f7db57e7640 1 --2- 172.21.15.114:0/1045196364 >> v2:172.21.15.141:3300/0 conn(0x7f7db00afda0 0x7f7db00cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.381+0000 7f7db57e7640 1 -- 172.21.15.114:0/1045196364 >> v1:172.21.15.141:6789/0 conn(0x7f7db00cd7f0 legacy=0x7f7db00cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:32.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.381+0000 7f7db57e7640 1 -- 172.21.15.114:0/1045196364 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db00cf950 con 0x7f7db015b200 2023-11-04T01:43:32.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.382+0000 7f7db57e7640 1 --2- 172.21.15.114:0/1045196364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7db015b200 0x7f7db00ceb30 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f7db0070130 tx=0x7f7dac02be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8112f8fa04e77e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.382+0000 7f7da7fff640 1 -- 172.21.15.114:0/1045196364 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac02ca10 con 0x7f7db015b200 2023-11-04T01:43:32.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.382+0000 7f7da7fff640 1 -- 172.21.15.114:0/1045196364 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac02cb70 con 0x7f7db015b200 2023-11-04T01:43:32.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.382+0000 7f7da7fff640 1 -- 172.21.15.114:0/1045196364 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac0343f0 con 0x7f7db015b200 2023-11-04T01:43:32.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.382+0000 7f7db7a4b640 1 -- 172.21.15.114:0/1045196364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7db015b200 msgr2=0x7f7db00ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.382+0000 7f7db7a4b640 1 --2- 172.21.15.114:0/1045196364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7db015b200 0x7f7db00ceb30 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f7db0070130 tx=0x7f7dac02be70 comp rx=0 tx=0).stop 2023-11-04T01:43:32.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.382+0000 7f7db7a4b640 1 -- 172.21.15.114:0/1045196364 shutdown_connections 2023-11-04T01:43:32.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.382+0000 7f7db7a4b640 1 --2- 172.21.15.114:0/1045196364 >> v2:172.21.15.141:3300/0 conn(0x7f7db00afda0 0x7f7db00cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.382+0000 7f7db7a4b640 1 --2- 172.21.15.114:0/1045196364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7db015b200 0x7f7db00ceb30 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.382+0000 7f7db7a4b640 1 -- 172.21.15.114:0/1045196364 >> 172.21.15.114:0/1045196364 conn(0x7f7db00d0c30 msgr2=0x7f7db00d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:32.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.382+0000 7f7db7a4b640 1 -- 172.21.15.114:0/1045196364 shutdown_connections 2023-11-04T01:43:32.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.382+0000 7f7db7a4b640 1 -- 172.21.15.114:0/1045196364 wait complete. 2023-11-04T01:43:32.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.384+0000 7f7db7a4b640 1 Processor -- start 2023-11-04T01:43:32.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.384+0000 7f7db7a4b640 1 -- start start 2023-11-04T01:43:32.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.384+0000 7f7db7a4b640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7db00afda0 0x7f7db00c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.384+0000 7f7db7a4b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7db00cd7f0 0x7f7db00c4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.384+0000 7f7db7a4b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7db015b200 0x7f7db00c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.384+0000 7f7db7a4b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00c7b00 con 0x7f7db015b200 2023-11-04T01:43:32.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.384+0000 7f7db7a4b640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00c7260 con 0x7f7db00afda0 2023-11-04T01:43:32.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.384+0000 7f7db7a4b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00c7540 con 0x7f7db00cd7f0 2023-11-04T01:43:32.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.384+0000 7f7db5fe8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7db015b200 0x7f7db00c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.384+0000 7f7db5fe8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7db015b200 0x7f7db00c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56298/0 (socket says 172.21.15.114:56298) 2023-11-04T01:43:32.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.384+0000 7f7db5fe8640 1 -- 172.21.15.114:0/3911091724 learned_addr learned my addr 172.21.15.114:0/3911091724 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:32.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.385+0000 7f7db4fe6640 1 --2- 172.21.15.114:0/3911091724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7db00cd7f0 0x7f7db00c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.385+0000 7f7db57e7640 1 --2- 172.21.15.114:0/3911091724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7db00afda0 0x7f7db00c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.385+0000 7f7db5fe8640 1 -- 172.21.15.114:0/3911091724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7db00cd7f0 msgr2=0x7f7db00c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.385+0000 7f7db5fe8640 1 --2- 172.21.15.114:0/3911091724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7db00cd7f0 0x7f7db00c4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.385+0000 7f7db5fe8640 1 -- 172.21.15.114:0/3911091724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7db00afda0 msgr2=0x7f7db00c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.385+0000 7f7db5fe8640 1 --2- 172.21.15.114:0/3911091724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7db00afda0 0x7f7db00c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.385+0000 7f7db5fe8640 1 -- 172.21.15.114:0/3911091724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac009b30 con 0x7f7db015b200 2023-11-04T01:43:32.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.385+0000 7f7db4fe6640 1 --2- 172.21.15.114:0/3911091724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7db00cd7f0 0x7f7db00c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:32.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.385+0000 7f7db57e7640 1 --2- 172.21.15.114:0/3911091724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7db00afda0 0x7f7db00c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:32.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.385+0000 7f7db5fe8640 1 --2- 172.21.15.114:0/3911091724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7db015b200 0x7f7db00c9ed0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f7da800c410 tx=0x7f7da800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.385+0000 7f7da5ffb640 1 -- 172.21.15.114:0/3911091724 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da8011790 con 0x7f7db015b200 2023-11-04T01:43:32.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.385+0000 7f7da5ffb640 1 -- 172.21.15.114:0/3911091724 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da80118f0 con 0x7f7db015b200 2023-11-04T01:43:32.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.385+0000 7f7db7a4b640 1 -- 172.21.15.114:0/3911091724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db00c7820 con 0x7f7db015b200 2023-11-04T01:43:32.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.385+0000 7f7da5ffb640 1 -- 172.21.15.114:0/3911091724 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da8011ca0 con 0x7f7db015b200 2023-11-04T01:43:32.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.385+0000 7f7db7a4b640 1 -- 172.21.15.114:0/3911091724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db01597a0 con 0x7f7db015b200 2023-11-04T01:43:32.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.386+0000 7f7db7a4b640 1 -- 172.21.15.114:0/3911091724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db00cee60 con 0x7f7db015b200 2023-11-04T01:43:32.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.387+0000 7f7da5ffb640 1 -- 172.21.15.114:0/3911091724 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7da801c460 con 0x7f7db015b200 2023-11-04T01:43:32.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.387+0000 7f7da5ffb640 1 --2- 172.21.15.114:0/3911091724 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7d9406ae70 0x7f7d9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.387+0000 7f7da5ffb640 1 -- 172.21.15.114:0/3911091724 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f7da8089b70 con 0x7f7db015b200 2023-11-04T01:43:32.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.387+0000 7f7db57e7640 1 --2- 172.21.15.114:0/3911091724 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7d9406ae70 0x7f7d9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.387+0000 7f7db57e7640 1 --2- 172.21.15.114:0/3911091724 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7d9406ae70 0x7f7d9406d330 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7dac035000 tx=0x7f7dac030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.391+0000 7f7da5ffb640 1 -- 172.21.15.114:0/3911091724 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7da8054360 con 0x7f7db015b200 2023-11-04T01:43:32.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.557+0000 7f7db7a4b640 1 -- 172.21.15.114:0/3911091724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7db0159a20 con 0x7f7db015b200 2023-11-04T01:43:32.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.557+0000 7f7da5ffb640 1 -- 172.21.15.114:0/3911091724 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7da8057980 con 0x7f7db015b200 2023-11-04T01:43:32.559 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:43:32.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.559+0000 7f7db7a4b640 1 -- 172.21.15.114:0/3911091724 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7d9406ae70 msgr2=0x7f7d9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.559+0000 7f7db7a4b640 1 --2- 172.21.15.114:0/3911091724 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7d9406ae70 0x7f7d9406d330 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7dac035000 tx=0x7f7dac030000 comp rx=0 tx=0).stop 2023-11-04T01:43:32.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.559+0000 7f7db7a4b640 1 -- 172.21.15.114:0/3911091724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7db015b200 msgr2=0x7f7db00c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.559+0000 7f7db7a4b640 1 --2- 172.21.15.114:0/3911091724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7db015b200 0x7f7db00c9ed0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f7da800c410 tx=0x7f7da800c8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.559+0000 7f7db7a4b640 1 -- 172.21.15.114:0/3911091724 shutdown_connections 2023-11-04T01:43:32.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.559+0000 7f7db7a4b640 1 --2- 172.21.15.114:0/3911091724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7db015b200 0x7f7db00c9ed0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.559+0000 7f7db7a4b640 1 --2- 172.21.15.114:0/3911091724 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7db00cd7f0 0x7f7db00c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.559+0000 7f7db7a4b640 1 --2- 172.21.15.114:0/3911091724 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7d9406ae70 0x7f7d9406d330 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.559+0000 7f7db7a4b640 1 --2- 172.21.15.114:0/3911091724 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7db00afda0 0x7f7db00c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.559+0000 7f7db7a4b640 1 -- 172.21.15.114:0/3911091724 >> 172.21.15.114:0/3911091724 conn(0x7f7db00d0c30 msgr2=0x7f7db00ae0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.559+0000 7f7db7a4b640 1 -- 172.21.15.114:0/3911091724 shutdown_connections 2023-11-04T01:43:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.559+0000 7f7db7a4b640 1 -- 172.21.15.114:0/3911091724 wait complete. 2023-11-04T01:43:32.572 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:32.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.673+0000 7f56ec4d4640 1 Processor -- start 2023-11-04T01:43:32.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.673+0000 7f56ec4d4640 1 -- start start 2023-11-04T01:43:32.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.674+0000 7f56ec4d4640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f56e40cb680 0x7f56e40cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.674+0000 7f56ec4d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56e415afb0 0x7f56e40cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.674+0000 7f56ec4d4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e415ea20 con 0x7f56e41597a0 2023-11-04T01:43:32.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.674+0000 7f56ec4d4640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e415b520 con 0x7f56e40cb680 2023-11-04T01:43:32.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.674+0000 7f56ec4d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e40cbfa0 con 0x7f56e415afb0 2023-11-04T01:43:32.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56eaa71640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f56e41597a0 0x7f56e4159c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35410/0 (socket says 172.21.15.114:35410) 2023-11-04T01:43:32.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56eaa71640 1 -- 172.21.15.114:0/288358594 learned_addr learned my addr 172.21.15.114:0/288358594 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:43:32.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e9a6f640 1 --2- 172.21.15.114:0/288358594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56e415afb0 0x7f56e40cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56ea270640 1 --2- 172.21.15.114:0/288358594 >> v2:172.21.15.141:3300/0 conn(0x7f56e40cb680 0x7f56e40cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e926e640 1 -- 172.21.15.114:0/288358594 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502662887 0 0) 0x7f56e415ea20 con 0x7f56e41597a0 2023-11-04T01:43:32.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e926e640 1 -- 172.21.15.114:0/288358594 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56d0003520 con 0x7f56e41597a0 2023-11-04T01:43:32.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e926e640 1 -- 172.21.15.114:0/288358594 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2134715078 0 0) 0x7f56d0003520 con 0x7f56e41597a0 2023-11-04T01:43:32.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e926e640 1 -- 172.21.15.114:0/288358594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56e415afb0 msgr2=0x7f56e40cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e926e640 1 --2- 172.21.15.114:0/288358594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56e415afb0 0x7f56e40cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e926e640 1 -- 172.21.15.114:0/288358594 >> v2:172.21.15.141:3300/0 conn(0x7f56e40cb680 msgr2=0x7f56e40cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e926e640 1 --2- 172.21.15.114:0/288358594 >> v2:172.21.15.141:3300/0 conn(0x7f56e40cb680 0x7f56e40cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e926e640 1 -- 172.21.15.114:0/288358594 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e415dc60 con 0x7f56e41597a0 2023-11-04T01:43:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e926e640 1 -- 172.21.15.114:0/288358594 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f56e00019f0 con 0x7f56e41597a0 2023-11-04T01:43:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56ea270640 1 --2- 172.21.15.114:0/288358594 >> v2:172.21.15.141:3300/0 conn(0x7f56e40cb680 0x7f56e40cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e9a6f640 1 --2- 172.21.15.114:0/288358594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56e415afb0 0x7f56e40cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e926e640 1 -- 172.21.15.114:0/288358594 >> v1:172.21.15.114:6789/0 conn(0x7f56e41597a0 legacy=0x7f56e4159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e926e640 1 --2- 172.21.15.114:0/288358594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56e415afb0 0x7f56d0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e926e640 1 --2- 172.21.15.114:0/288358594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56d0003eb0 0x7f56d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e926e640 1 --2- 172.21.15.114:0/288358594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56d0004d00 0x7f56d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e926e640 1 -- 172.21.15.114:0/288358594 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e415b520 con 0x7f56d0003eb0 2023-11-04T01:43:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e926e640 1 -- 172.21.15.114:0/288358594 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e40cbfa0 con 0x7f56d0004d00 2023-11-04T01:43:32.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e926e640 1 -- 172.21.15.114:0/288358594 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d000b980 con 0x7f56e415afb0 2023-11-04T01:43:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56e9a6f640 1 --2- 172.21.15.114:0/288358594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56d0003eb0 0x7f56d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56ea270640 1 --2- 172.21.15.114:0/288358594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56e415afb0 0x7f56d0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.675+0000 7f56eaa71640 1 --2- 172.21.15.114:0/288358594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56d0004d00 0x7f56d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.676+0000 7f56e9a6f640 1 -- 172.21.15.114:0/288358594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56e415afb0 msgr2=0x7f56d0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.676+0000 7f56e9a6f640 1 --2- 172.21.15.114:0/288358594 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56e415afb0 0x7f56d0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.676+0000 7f56e9a6f640 1 -- 172.21.15.114:0/288358594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56d0004d00 msgr2=0x7f56d0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.676+0000 7f56e9a6f640 1 --2- 172.21.15.114:0/288358594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56d0004d00 0x7f56d0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.676+0000 7f56e9a6f640 1 -- 172.21.15.114:0/288358594 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d4009400 con 0x7f56d0003eb0 2023-11-04T01:43:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.676+0000 7f56eaa71640 1 --2- 172.21.15.114:0/288358594 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56d0004d00 0x7f56d0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.676+0000 7f56e9a6f640 1 --2- 172.21.15.114:0/288358594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56d0003eb0 0x7f56d00047c0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009c90 tx=0x7f56d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0b0ea561b1b04e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.676+0000 7f56e926e640 1 -- 172.21.15.114:0/288358594 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d402c8f0 con 0x7f56d0003eb0 2023-11-04T01:43:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.676+0000 7f56e926e640 1 -- 172.21.15.114:0/288358594 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d402ca50 con 0x7f56d0003eb0 2023-11-04T01:43:32.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.676+0000 7f56e926e640 1 -- 172.21.15.114:0/288358594 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d402ce40 con 0x7f56d0003eb0 2023-11-04T01:43:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.677+0000 7f56ec4d4640 1 -- 172.21.15.114:0/288358594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56d0003eb0 msgr2=0x7f56d00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.677+0000 7f56ec4d4640 1 --2- 172.21.15.114:0/288358594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56d0003eb0 0x7f56d00047c0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009c90 tx=0x7f56d00057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.677+0000 7f56eaa71640 1 -- 172.21.15.114:0/288358594 reap_dead start 2023-11-04T01:43:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.677+0000 7f56ec4d4640 1 -- 172.21.15.114:0/288358594 shutdown_connections 2023-11-04T01:43:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.677+0000 7f56ec4d4640 1 -- 172.21.15.114:0/288358594 >> 172.21.15.114:0/288358594 conn(0x7f56e40b1640 msgr2=0x7f56e40b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.677+0000 7f56ec4d4640 1 -- 172.21.15.114:0/288358594 shutdown_connections 2023-11-04T01:43:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.677+0000 7f56ec4d4640 1 -- 172.21.15.114:0/288358594 wait complete. 2023-11-04T01:43:32.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.678+0000 7f56ec4d4640 1 Processor -- start 2023-11-04T01:43:32.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.678+0000 7f56ec4d4640 1 -- start start 2023-11-04T01:43:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56ec4d4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56d0003eb0 0x7f56e41f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56ec4d4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56e41509d0 0x7f56e41f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56ec4d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56e40c4100 0x7f56e40c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56ec4d4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e40c4ff0 con 0x7f56e41509d0 2023-11-04T01:43:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56ec4d4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e413bf00 con 0x7f56d0003eb0 2023-11-04T01:43:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56ec4d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e413c1e0 con 0x7f56e40c4100 2023-11-04T01:43:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56e9a6f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56e41509d0 0x7f56e41f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56e9a6f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56e41509d0 0x7f56e41f4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56312/0 (socket says 172.21.15.114:56312) 2023-11-04T01:43:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56e9a6f640 1 -- 172.21.15.114:0/3326559911 learned_addr learned my addr 172.21.15.114:0/3326559911 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56eaa71640 1 --2- 172.21.15.114:0/3326559911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56e40c4100 0x7f56e40c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56e9a6f640 1 -- 172.21.15.114:0/3326559911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56e40c4100 msgr2=0x7f56e40c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56ea270640 1 --2- 172.21.15.114:0/3326559911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56d0003eb0 0x7f56e41f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56e9a6f640 1 --2- 172.21.15.114:0/3326559911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56e40c4100 0x7f56e40c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56e9a6f640 1 -- 172.21.15.114:0/3326559911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56d0003eb0 msgr2=0x7f56e41f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56e9a6f640 1 --2- 172.21.15.114:0/3326559911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56d0003eb0 0x7f56e41f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56e9a6f640 1 -- 172.21.15.114:0/3326559911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e413c4c0 con 0x7f56e41509d0 2023-11-04T01:43:32.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56eaa71640 1 --2- 172.21.15.114:0/3326559911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56e40c4100 0x7f56e40c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:32.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56e9a6f640 1 --2- 172.21.15.114:0/3326559911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56e41509d0 0x7f56e41f4b50 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f56d4037040 tx=0x7f56d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56daffd640 1 -- 172.21.15.114:0/3326559911 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d4034a80 con 0x7f56e41509d0 2023-11-04T01:43:32.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56daffd640 1 -- 172.21.15.114:0/3326559911 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d4034be0 con 0x7f56e41509d0 2023-11-04T01:43:32.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56ec4d4640 1 -- 172.21.15.114:0/3326559911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e413c7a0 con 0x7f56e41509d0 2023-11-04T01:43:32.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.679+0000 7f56daffd640 1 -- 172.21.15.114:0/3326559911 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d4004020 con 0x7f56e41509d0 2023-11-04T01:43:32.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.680+0000 7f56ec4d4640 1 -- 172.21.15.114:0/3326559911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e40c4af0 con 0x7f56e41509d0 2023-11-04T01:43:32.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.680+0000 7f56ec4d4640 1 -- 172.21.15.114:0/3326559911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e40c4da0 con 0x7f56e41509d0 2023-11-04T01:43:32.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.681+0000 7f56daffd640 1 -- 172.21.15.114:0/3326559911 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f56d4004180 con 0x7f56e41509d0 2023-11-04T01:43:32.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.681+0000 7f56daffd640 1 --2- 172.21.15.114:0/3326559911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f56c806aea0 0x7f56c806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.681+0000 7f56daffd640 1 -- 172.21.15.114:0/3326559911 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f56d40ac130 con 0x7f56e41509d0 2023-11-04T01:43:32.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.681+0000 7f56ea270640 1 --2- 172.21.15.114:0/3326559911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f56c806aea0 0x7f56c806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.682+0000 7f56ea270640 1 --2- 172.21.15.114:0/3326559911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f56c806aea0 0x7f56c806d360 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009bf0 tx=0x7f56dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.685+0000 7f56daffd640 1 -- 172.21.15.114:0/3326559911 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f56d4076920 con 0x7f56e41509d0 2023-11-04T01:43:32.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.852+0000 7f56ec4d4640 1 -- 172.21.15.114:0/3326559911 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56e40684b0 con 0x7f56e41509d0 2023-11-04T01:43:32.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.853+0000 7f56daffd640 1 -- 172.21.15.114:0/3326559911 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56d4079f40 con 0x7f56e41509d0 2023-11-04T01:43:32.855 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:43:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.855+0000 7f56ec4d4640 1 -- 172.21.15.114:0/3326559911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f56c806aea0 msgr2=0x7f56c806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.855+0000 7f56ec4d4640 1 --2- 172.21.15.114:0/3326559911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f56c806aea0 0x7f56c806d360 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009bf0 tx=0x7f56dc008040 comp rx=0 tx=0).stop 2023-11-04T01:43:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.855+0000 7f56ec4d4640 1 -- 172.21.15.114:0/3326559911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56e41509d0 msgr2=0x7f56e41f4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.855+0000 7f56ec4d4640 1 --2- 172.21.15.114:0/3326559911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56e41509d0 0x7f56e41f4b50 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f56d4037040 tx=0x7f56d4004730 comp rx=0 tx=0).stop 2023-11-04T01:43:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.855+0000 7f56ec4d4640 1 -- 172.21.15.114:0/3326559911 shutdown_connections 2023-11-04T01:43:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.855+0000 7f56ec4d4640 1 --2- 172.21.15.114:0/3326559911 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f56e40c4100 0x7f56e40c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.855+0000 7f56ec4d4640 1 --2- 172.21.15.114:0/3326559911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56e41509d0 0x7f56e41f4b50 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.855+0000 7f56ec4d4640 1 --2- 172.21.15.114:0/3326559911 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f56c806aea0 0x7f56c806d360 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.855+0000 7f56ec4d4640 1 --2- 172.21.15.114:0/3326559911 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f56d0003eb0 0x7f56e41f4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.855+0000 7f56ec4d4640 1 -- 172.21.15.114:0/3326559911 >> 172.21.15.114:0/3326559911 conn(0x7f56e40b1640 msgr2=0x7f56e40b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:32.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.855+0000 7f56ec4d4640 1 -- 172.21.15.114:0/3326559911 shutdown_connections 2023-11-04T01:43:32.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.855+0000 7f56ec4d4640 1 -- 172.21.15.114:0/3326559911 wait complete. 2023-11-04T01:43:32.867 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:43:32.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.968+0000 7f41ffa89640 1 Processor -- start 2023-11-04T01:43:32.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.968+0000 7f41ffa89640 1 -- start start 2023-11-04T01:43:32.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.969+0000 7f41ffa89640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f41f815b200 0x7f41f80ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.969+0000 7f41ffa89640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f80afda0 0x7f41f80cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.969+0000 7f41ffa89640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f80cdc40 con 0x7f41f80cd7f0 2023-11-04T01:43:32.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.969+0000 7f41ffa89640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f80cde80 con 0x7f41f815b200 2023-11-04T01:43:32.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.969+0000 7f41ffa89640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80cf670 con 0x7f41f80afda0 2023-11-04T01:43:32.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.969+0000 7f41fd825640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f41f815b200 0x7f41f80ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.969+0000 7f41fe026640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f41f80cd7f0 0x7f41f80cb840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35418/0 (socket says 172.21.15.114:35418) 2023-11-04T01:43:32.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.969+0000 7f41fe026640 1 -- 172.21.15.114:0/3703502450 learned_addr learned my addr 172.21.15.114:0/3703502450 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:43:32.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.969+0000 7f41fd024640 1 --2- 172.21.15.114:0/3703502450 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f80afda0 0x7f41f80cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.969+0000 7f41fd825640 1 -- 172.21.15.114:0/3703502450 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f80afda0 msgr2=0x7f41f80cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:32.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.969+0000 7f41fd825640 1 --2- 172.21.15.114:0/3703502450 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f80afda0 0x7f41f80cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.969+0000 7f41fd825640 1 -- 172.21.15.114:0/3703502450 >> v1:172.21.15.114:6789/0 conn(0x7f41f80cd7f0 legacy=0x7f41f80cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.969+0000 7f41fd825640 1 -- 172.21.15.114:0/3703502450 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f80cf950 con 0x7f41f815b200 2023-11-04T01:43:32.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.970+0000 7f41fd825640 1 --2- 172.21.15.114:0/3703502450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f815b200 0x7f41f80ceb30 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009790 tx=0x7f41f402b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133a98578ae5252b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.970+0000 7f41fc823640 1 -- 172.21.15.114:0/3703502450 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4030710 con 0x7f41f815b200 2023-11-04T01:43:32.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.970+0000 7f41fc823640 1 -- 172.21.15.114:0/3703502450 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f402e050 con 0x7f41f815b200 2023-11-04T01:43:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.970+0000 7f41fc823640 1 -- 172.21.15.114:0/3703502450 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4030a90 con 0x7f41f815b200 2023-11-04T01:43:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.971+0000 7f41ffa89640 1 -- 172.21.15.114:0/3703502450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f815b200 msgr2=0x7f41f80ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.971+0000 7f41ffa89640 1 --2- 172.21.15.114:0/3703502450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f815b200 0x7f41f80ceb30 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009790 tx=0x7f41f402b650 comp rx=0 tx=0).stop 2023-11-04T01:43:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.971+0000 7f41ffa89640 1 -- 172.21.15.114:0/3703502450 shutdown_connections 2023-11-04T01:43:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.971+0000 7f41ffa89640 1 --2- 172.21.15.114:0/3703502450 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f80afda0 0x7f41f80cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.971+0000 7f41ffa89640 1 --2- 172.21.15.114:0/3703502450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f815b200 0x7f41f80ceb30 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.971+0000 7f41ffa89640 1 -- 172.21.15.114:0/3703502450 >> 172.21.15.114:0/3703502450 conn(0x7f41f80d0c30 msgr2=0x7f41f80d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.971+0000 7f41ffa89640 1 -- 172.21.15.114:0/3703502450 shutdown_connections 2023-11-04T01:43:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.971+0000 7f41ffa89640 1 -- 172.21.15.114:0/3703502450 wait complete. 2023-11-04T01:43:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.972+0000 7f41ffa89640 1 Processor -- start 2023-11-04T01:43:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.972+0000 7f41ffa89640 1 -- start start 2023-11-04T01:43:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.972+0000 7f41ffa89640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f80afda0 0x7f41f80c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.972+0000 7f41ffa89640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f80cd7f0 0x7f41f80b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.972+0000 7f41ffa89640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f815b200 0x7f41f80b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41ffa89640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f81f41c0 con 0x7f41f815b200 2023-11-04T01:43:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41ffa89640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f81458c0 con 0x7f41f80afda0 2023-11-04T01:43:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41ffa89640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80c9920 con 0x7f41f80cd7f0 2023-11-04T01:43:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41fe026640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f815b200 0x7f41f80b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41fe026640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f815b200 0x7f41f80b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56332/0 (socket says 172.21.15.114:56332) 2023-11-04T01:43:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41fe026640 1 -- 172.21.15.114:0/4064455933 learned_addr learned my addr 172.21.15.114:0/4064455933 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41fd825640 1 --2- 172.21.15.114:0/4064455933 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f80afda0 0x7f41f80c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41fd024640 1 --2- 172.21.15.114:0/4064455933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f80cd7f0 0x7f41f80b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41fe026640 1 -- 172.21.15.114:0/4064455933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f80cd7f0 msgr2=0x7f41f80b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41fe026640 1 --2- 172.21.15.114:0/4064455933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f80cd7f0 0x7f41f80b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41fe026640 1 -- 172.21.15.114:0/4064455933 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f80afda0 msgr2=0x7f41f80c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41fe026640 1 --2- 172.21.15.114:0/4064455933 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f80afda0 0x7f41f80c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41fe026640 1 -- 172.21.15.114:0/4064455933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f40093a0 con 0x7f41f815b200 2023-11-04T01:43:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41fd024640 1 --2- 172.21.15.114:0/4064455933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f80cd7f0 0x7f41f80b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41fe026640 1 --2- 172.21.15.114:0/4064455933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f815b200 0x7f41f80b0aa0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f41f000cb10 tx=0x7f41f000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41ee7fc640 1 -- 172.21.15.114:0/4064455933 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000a860 con 0x7f41f815b200 2023-11-04T01:43:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41ee7fc640 1 -- 172.21.15.114:0/4064455933 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f000a9e0 con 0x7f41f815b200 2023-11-04T01:43:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41ffa89640 1 -- 172.21.15.114:0/4064455933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f81489b0 con 0x7f41f815b200 2023-11-04T01:43:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41ee7fc640 1 -- 172.21.15.114:0/4064455933 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000ae10 con 0x7f41f815b200 2023-11-04T01:43:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.973+0000 7f41ffa89640 1 -- 172.21.15.114:0/4064455933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f81f46b0 con 0x7f41f815b200 2023-11-04T01:43:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.974+0000 7f41ffa89640 1 -- 172.21.15.114:0/4064455933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f80684b0 con 0x7f41f815b200 2023-11-04T01:43:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.975+0000 7f41ee7fc640 1 -- 172.21.15.114:0/4064455933 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41f00070d0 con 0x7f41f815b200 2023-11-04T01:43:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.975+0000 7f41ee7fc640 1 --2- 172.21.15.114:0/4064455933 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41dc06aea0 0x7f41dc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.975+0000 7f41ee7fc640 1 -- 172.21.15.114:0/4064455933 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f41f0089830 con 0x7f41f815b200 2023-11-04T01:43:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.975+0000 7f41fd825640 1 --2- 172.21.15.114:0/4064455933 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41dc06aea0 0x7f41dc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.975+0000 7f41fd825640 1 --2- 172.21.15.114:0/4064455933 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41dc06aea0 0x7f41dc06d360 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f41f4034000 tx=0x7f41f4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:32.979+0000 7f41ee7fc640 1 -- 172.21.15.114:0/4064455933 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41f00540d0 con 0x7f41f815b200 2023-11-04T01:43:33.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.156+0000 7f41ffa89640 1 -- 172.21.15.114:0/4064455933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f41f80cdc40 con 0x7f41f815b200 2023-11-04T01:43:33.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.157+0000 7f41ee7fc640 1 -- 172.21.15.114:0/4064455933 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 18 entries v111) v1 ==== 81+0+1105 (secure 0 0 0) 0x7f41f80cdc40 con 0x7f41f815b200 2023-11-04T01:43:33.159 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.1:0/3180677097 2023-11-04T02:43:26.710151+0000 2023-11-04T01:43:33.159 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/3145796350 2023-11-05T01:43:18.419560+0000 2023-11-04T01:43:33.159 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/3825479201 2023-11-05T01:43:11.612005+0000 2023-11-04T01:43:33.159 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/3825479201 2023-11-05T01:43:11.612005+0000 2023-11-04T01:43:33.159 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/3145796350 2023-11-05T01:43:18.419560+0000 2023-11-04T01:43:33.159 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/3780323525 2023-11-05T01:40:32.050690+0000 2023-11-04T01:43:33.159 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/3780323525 2023-11-05T01:40:32.050690+0000 2023-11-04T01:43:33.159 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.141:6834/1296600989 2023-11-05T01:42:28.568489+0000 2023-11-04T01:43:33.159 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/1768068040 2023-11-05T01:40:57.284155+0000 2023-11-04T01:43:33.160 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/1768068040 2023-11-05T01:40:57.284155+0000 2023-11-04T01:43:33.160 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.141:6832/1296600989 2023-11-05T01:42:28.568489+0000 2023-11-04T01:43:33.160 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/2722332212 2023-11-05T01:41:22.824334+0000 2023-11-04T01:43:33.160 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/1052115332 2023-11-05T01:41:48.753700+0000 2023-11-04T01:43:33.160 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.1:0/958873281 2023-11-04T02:42:36.859026+0000 2023-11-04T01:43:33.160 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/1052115332 2023-11-05T01:41:48.753700+0000 2023-11-04T01:43:33.160 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/1629274449 2023-11-05T01:42:21.762099+0000 2023-11-04T01:43:33.160 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/2722332212 2023-11-05T01:41:22.824334+0000 2023-11-04T01:43:33.160 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/1629274449 2023-11-05T01:42:21.762099+0000 2023-11-04T01:43:33.161 INFO:teuthology.orchestra.run.smithi114.stderr:listed 18 entries 2023-11-04T01:43:33.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.158+0000 7f41ffa89640 1 -- 172.21.15.114:0/4064455933 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41dc06aea0 msgr2=0x7f41dc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.158+0000 7f41ffa89640 1 --2- 172.21.15.114:0/4064455933 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41dc06aea0 0x7f41dc06d360 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f41f4034000 tx=0x7f41f4008030 comp rx=0 tx=0).stop 2023-11-04T01:43:33.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.158+0000 7f41ffa89640 1 -- 172.21.15.114:0/4064455933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f815b200 msgr2=0x7f41f80b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.158+0000 7f41ffa89640 1 --2- 172.21.15.114:0/4064455933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f815b200 0x7f41f80b0aa0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f41f000cb10 tx=0x7f41f000a060 comp rx=0 tx=0).stop 2023-11-04T01:43:33.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.158+0000 7f41ffa89640 1 -- 172.21.15.114:0/4064455933 shutdown_connections 2023-11-04T01:43:33.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.158+0000 7f41ffa89640 1 --2- 172.21.15.114:0/4064455933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41f815b200 0x7f41f80b0aa0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.158+0000 7f41ffa89640 1 --2- 172.21.15.114:0/4064455933 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f41f80cd7f0 0x7f41f80b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.158+0000 7f41ffa89640 1 --2- 172.21.15.114:0/4064455933 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41dc06aea0 0x7f41dc06d360 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.158+0000 7f41ffa89640 1 --2- 172.21.15.114:0/4064455933 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f41f80afda0 0x7f41f80c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.158+0000 7f41ffa89640 1 -- 172.21.15.114:0/4064455933 >> 172.21.15.114:0/4064455933 conn(0x7f41f80d0c30 msgr2=0x7f41f80d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.159+0000 7f41ffa89640 1 -- 172.21.15.114:0/4064455933 shutdown_connections 2023-11-04T01:43:33.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.159+0000 7f41ffa89640 1 -- 172.21.15.114:0/4064455933 wait complete. 2023-11-04T01:43:33.171 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:43:33.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:33.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:33.197 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[124062]: fuse finished with error 0 and tester_r 0 2023-11-04T01:43:33.198 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:43:33.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:33.198 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:43:33.253 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:43:33.253 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:33.308 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:43:33.309 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:43:33.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.445+0000 7f0be1b39640 1 Processor -- start 2023-11-04T01:43:33.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.445+0000 7f0be1b39640 1 -- start start 2023-11-04T01:43:33.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.446+0000 7f0be1b39640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0bdc15d100 0x7f0bdc0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.446+0000 7f0be1b39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bdc15d4e0 0x7f0bdc0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.446+0000 7f0be1b39640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc0b32b0 con 0x7f0bdc0d3b60 2023-11-04T01:43:33.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.446+0000 7f0be1b39640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bdc0cee10 con 0x7f0bdc15d100 2023-11-04T01:43:33.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.446+0000 7f0be1b39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0b4750 con 0x7f0bdc15d4e0 2023-11-04T01:43:33.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.446+0000 7f0bdb7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0bdc15d100 0x7f0bdc0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.446+0000 7f0bdb7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0bdc15d100 0x7f0bdc0ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56342/0 (socket says 172.21.15.114:56342) 2023-11-04T01:43:33.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.446+0000 7f0bdb7fe640 1 -- 172.21.15.114:0/2465511596 learned_addr learned my addr 172.21.15.114:0/2465511596 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:33.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.447+0000 7f0bdaffd640 1 --2- 172.21.15.114:0/2465511596 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bdc15d4e0 0x7f0bdc0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.447+0000 7f0bdb7fe640 1 -- 172.21.15.114:0/2465511596 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bdc15d4e0 msgr2=0x7f0bdc0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.447+0000 7f0bdb7fe640 1 --2- 172.21.15.114:0/2465511596 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bdc15d4e0 0x7f0bdc0d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.447+0000 7f0bdb7fe640 1 -- 172.21.15.114:0/2465511596 >> v1:172.21.15.141:6789/0 conn(0x7f0bdc0d3b60 legacy=0x7f0bdc0cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.447+0000 7f0bdb7fe640 1 -- 172.21.15.114:0/2465511596 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc0b2980 con 0x7f0bdc15d100 2023-11-04T01:43:33.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.447+0000 7f0bdb7fe640 1 --2- 172.21.15.114:0/2465511596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bdc15d100 0x7f0bdc0ce510 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009850 tx=0x7f0bcc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f9a1d303f91cba server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.448+0000 7f0bda7fc640 1 -- 172.21.15.114:0/2465511596 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc004230 con 0x7f0bdc15d100 2023-11-04T01:43:33.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.448+0000 7f0bda7fc640 1 -- 172.21.15.114:0/2465511596 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc004390 con 0x7f0bdc15d100 2023-11-04T01:43:33.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.448+0000 7f0bda7fc640 1 -- 172.21.15.114:0/2465511596 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc031830 con 0x7f0bdc15d100 2023-11-04T01:43:33.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.448+0000 7f0be1b39640 1 -- 172.21.15.114:0/2465511596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bdc15d100 msgr2=0x7f0bdc0ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.448+0000 7f0be1b39640 1 --2- 172.21.15.114:0/2465511596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bdc15d100 0x7f0bdc0ce510 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009850 tx=0x7f0bcc02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.448+0000 7f0be1b39640 1 -- 172.21.15.114:0/2465511596 shutdown_connections 2023-11-04T01:43:33.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.448+0000 7f0be1b39640 1 --2- 172.21.15.114:0/2465511596 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bdc15d4e0 0x7f0bdc0d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.448+0000 7f0be1b39640 1 --2- 172.21.15.114:0/2465511596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bdc15d100 0x7f0bdc0ce510 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.448+0000 7f0be1b39640 1 -- 172.21.15.114:0/2465511596 >> 172.21.15.114:0/2465511596 conn(0x7f0bdc0d2ef0 msgr2=0x7f0bdc0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.448+0000 7f0be1b39640 1 -- 172.21.15.114:0/2465511596 shutdown_connections 2023-11-04T01:43:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.448+0000 7f0be1b39640 1 -- 172.21.15.114:0/2465511596 wait complete. 2023-11-04T01:43:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.449+0000 7f0be1b39640 1 Processor -- start 2023-11-04T01:43:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.449+0000 7f0be1b39640 1 -- start start 2023-11-04T01:43:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.450+0000 7f0be1b39640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0bdc0d3b60 0x7f0bdc15a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.450+0000 7f0be1b39640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bdc15d100 0x7f0bdc0b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.450+0000 7f0be1b39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bdc15d4e0 0x7f0bdc0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.450+0000 7f0be1b39640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc15aa20 con 0x7f0bdc15d100 2023-11-04T01:43:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.450+0000 7f0be1b39640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0b63e0 con 0x7f0bdc0d3b60 2023-11-04T01:43:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.450+0000 7f0be1b39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0b66c0 con 0x7f0bdc15d4e0 2023-11-04T01:43:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.450+0000 7f0bdaffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bdc15d100 0x7f0bdc0b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.450+0000 7f0bdaffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bdc15d100 0x7f0bdc0b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56346/0 (socket says 172.21.15.114:56346) 2023-11-04T01:43:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.450+0000 7f0bdaffd640 1 -- 172.21.15.114:0/3349026643 learned_addr learned my addr 172.21.15.114:0/3349026643 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.450+0000 7f0bdb7fe640 1 --2- 172.21.15.114:0/3349026643 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0bdc0d3b60 0x7f0bdc15a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.450+0000 7f0bdbfff640 1 --2- 172.21.15.114:0/3349026643 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bdc15d4e0 0x7f0bdc0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.451+0000 7f0bdaffd640 1 -- 172.21.15.114:0/3349026643 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bdc15d4e0 msgr2=0x7f0bdc0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.451+0000 7f0bdaffd640 1 --2- 172.21.15.114:0/3349026643 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bdc15d4e0 0x7f0bdc0b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.451+0000 7f0bdaffd640 1 -- 172.21.15.114:0/3349026643 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0bdc0d3b60 msgr2=0x7f0bdc15a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.451+0000 7f0bdaffd640 1 --2- 172.21.15.114:0/3349026643 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0bdc0d3b60 0x7f0bdc15a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.451+0000 7f0bdaffd640 1 -- 172.21.15.114:0/3349026643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc009460 con 0x7f0bdc15d100 2023-11-04T01:43:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.451+0000 7f0bdb7fe640 1 --2- 172.21.15.114:0/3349026643 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0bdc0d3b60 0x7f0bdc15a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.451+0000 7f0bdaffd640 1 --2- 172.21.15.114:0/3349026643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bdc15d100 0x7f0bdc0b5a70 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000c7f0 tx=0x7f0bd000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.451+0000 7f0bc3fff640 1 -- 172.21.15.114:0/3349026643 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0004220 con 0x7f0bdc15d100 2023-11-04T01:43:33.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.451+0000 7f0bc3fff640 1 -- 172.21.15.114:0/3349026643 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd00043a0 con 0x7f0bdc15d100 2023-11-04T01:43:33.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.451+0000 7f0be1b39640 1 -- 172.21.15.114:0/3349026643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc0b69a0 con 0x7f0bdc15d100 2023-11-04T01:43:33.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.451+0000 7f0bc3fff640 1 -- 172.21.15.114:0/3349026643 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0007860 con 0x7f0bdc15d100 2023-11-04T01:43:33.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.451+0000 7f0be1b39640 1 -- 172.21.15.114:0/3349026643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc0b6f60 con 0x7f0bdc15d100 2023-11-04T01:43:33.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.452+0000 7f0be1b39640 1 -- 172.21.15.114:0/3349026643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc0684b0 con 0x7f0bdc15d100 2023-11-04T01:43:33.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.452+0000 7f0bc3fff640 1 -- 172.21.15.114:0/3349026643 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0bd0007bd0 con 0x7f0bdc15d100 2023-11-04T01:43:33.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.453+0000 7f0bc3fff640 1 --2- 172.21.15.114:0/3349026643 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0bc806aea0 0x7f0bc806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.453+0000 7f0bc3fff640 1 -- 172.21.15.114:0/3349026643 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f0bd0089dd0 con 0x7f0bdc15d100 2023-11-04T01:43:33.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.453+0000 7f0bdb7fe640 1 --2- 172.21.15.114:0/3349026643 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0bc806aea0 0x7f0bc806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.453+0000 7f0bdb7fe640 1 --2- 172.21.15.114:0/3349026643 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0bc806aea0 0x7f0bc806d360 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc035000 tx=0x7f0bcc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.457+0000 7f0bc3fff640 1 -- 172.21.15.114:0/3349026643 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0bd0054650 con 0x7f0bdc15d100 2023-11-04T01:43:33.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.659+0000 7f0be1b39640 1 -- 172.21.15.114:0/3349026643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0bdc0d2cd0 con 0x7f0bdc15d100 2023-11-04T01:43:33.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.659+0000 7f0bc3fff640 1 -- 172.21.15.114:0/3349026643 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v103) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0bd0087e60 con 0x7f0bdc15d100 2023-11-04T01:43:33.661 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:43:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.661+0000 7f0be1b39640 1 -- 172.21.15.114:0/3349026643 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0bc806aea0 msgr2=0x7f0bc806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.661+0000 7f0be1b39640 1 --2- 172.21.15.114:0/3349026643 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0bc806aea0 0x7f0bc806d360 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc035000 tx=0x7f0bcc008030 comp rx=0 tx=0).stop 2023-11-04T01:43:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.661+0000 7f0be1b39640 1 -- 172.21.15.114:0/3349026643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bdc15d100 msgr2=0x7f0bdc0b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.661+0000 7f0be1b39640 1 --2- 172.21.15.114:0/3349026643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bdc15d100 0x7f0bdc0b5a70 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000c7f0 tx=0x7f0bd000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.661+0000 7f0be1b39640 1 -- 172.21.15.114:0/3349026643 shutdown_connections 2023-11-04T01:43:33.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.661+0000 7f0be1b39640 1 --2- 172.21.15.114:0/3349026643 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0bdc15d4e0 0x7f0bdc0b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.661+0000 7f0be1b39640 1 --2- 172.21.15.114:0/3349026643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bdc15d100 0x7f0bdc0b5a70 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.661+0000 7f0be1b39640 1 --2- 172.21.15.114:0/3349026643 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0bc806aea0 0x7f0bc806d360 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.661+0000 7f0be1b39640 1 --2- 172.21.15.114:0/3349026643 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0bdc0d3b60 0x7f0bdc15a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.661+0000 7f0be1b39640 1 -- 172.21.15.114:0/3349026643 >> 172.21.15.114:0/3349026643 conn(0x7f0bdc0d2ef0 msgr2=0x7f0bdc0b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.661+0000 7f0be1b39640 1 -- 172.21.15.114:0/3349026643 shutdown_connections 2023-11-04T01:43:33.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:33.661+0000 7f0be1b39640 1 -- 172.21.15.114:0/3349026643 wait complete. 2023-11-04T01:43:33.674 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:43:33.674 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:43:33.674 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-11-04T01:43:33.674 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:43:33.674 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:33.674 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:43:33.674 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:43:33.674 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:43:33.674 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:33.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:33.675 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-11-04T01:43:33.689 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:43:33.690 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:43:33.690 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:43:33.690 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:33.690 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-04T01:43:33.690 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:33.690 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:33.690 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:33.690 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-11-04T01:43:33.690 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:33.690 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:33.690 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-11-04T01:43:33.691 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:33.691 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:33.691 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:43:33.691 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:33.691 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:43:33.691 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42062sec preferred_lft 42062sec 2023-11-04T01:43:33.691 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-11-04T01:43:33.691 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:33.691 INFO:teuthology.orchestra.run.smithi114.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:43:33.691 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 7e:72:41:ca:70:95 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:33.691 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:43:33.691 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:33.691 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9c8d:d6ff:fe6f:d555/64 scope link 2023-11-04T01:43:33.691 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:33.692 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:43:33.692 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether f6:4c:1e:67:08:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:33.692 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::f44c:1eff:fe67:85a/64 scope link 2023-11-04T01:43:33.692 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:33.692 INFO:teuthology.orchestra.run.smithi114.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:43:33.692 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 7e:72:41:ca:70:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:33.692 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::7c72:41ff:feca:7095/64 scope link 2023-11-04T01:43:33.692 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:33.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:33.692 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:43:33.755 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-11-04T01:43:33.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:33.757 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-11-04T01:43:33.813 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-11-04T01:43:33.813 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:43:33.813 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:43:33.813 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:43:33.813 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:43:33.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:33.814 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:43:33.814 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:43:33.814 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:43:33.814 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:43:33.814 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:43:33.814 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:43:33.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:33.909 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-04T01:43:33.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:43:33.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:43:33.923 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:33.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:33.924 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-11-04T01:43:33.990 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:43:33.990 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:43:33.990 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:34.045 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:34.045 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:43:34.045 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:34.100 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:34.155 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:43:34.155 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:43:34.155 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:43:34.155 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:43:34.155 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:43:34.155 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:43:34.155 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:43:34.155 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:43:34.155 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:43:34.155 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:43:34.155 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:43:34.156 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:43:34.156 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:34.156 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:43:34.156 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:43:34.156 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:43:34.156 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:43:34.156 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:34.156 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:34.156 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:43:34.156 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:34.156 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:34.156 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:34.156 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:43:34.157 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:43:34.157 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:34.157 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:34.157 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:34.157 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:34.157 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:43:34.157 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:34.157 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:34.157 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:34.157 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:34.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:34.158 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:43:34.214 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:43:34.214 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:43:34.257 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:34.258 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:43:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:34.272 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:43:34.272 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:43:34.272 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:43:34.272 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:43:34.272 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:43:34.272 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:43:34.272 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:43:34.272 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:43:34.272 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:43:34.272 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:43:34.273 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:43:34.273 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:43:34.273 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:34.273 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:43:34.273 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:43:34.273 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:43:34.273 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:43:34.273 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:34.273 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:34.273 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:43:34.273 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:34.273 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:34.273 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:34.274 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:43:34.274 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:43:34.274 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:34.274 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:34.274 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:34.274 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:34.274 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:43:34.274 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:34.274 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:34.274 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:34.274 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:34.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:34.275 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:43:34.346 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:43:34.344+0000 7f266e636480 -1 init, newargv = 0x55a15688abd0 newargc=15 2023-11-04T01:43:34.346 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[126262]: starting ceph client 2023-11-04T01:43:34.352 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[126262]: starting fuse 2023-11-04T01:43:34.588 INFO:tasks.ceph.mds.b.smithi141.stderr:2023-11-04T01:43:34.587+0000 7f702711b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:34.588 INFO:tasks.ceph.mds.b.smithi141.stderr:2023-11-04T01:43:34.587+0000 7f702711b640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:43:35.428 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:35.448 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:43:35.448 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:43:35.448 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:43:35.449 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:43:35.449 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:43:35.449 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:43:35.449 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:43:35.449 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:43:35.449 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:43:35.449 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:43:35.449 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:43:35.449 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:43:35.449 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:35.449 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:43:35.449 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:43:35.449 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:43:35.450 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:43:35.450 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:35.450 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:35.450 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:43:35.450 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:35.450 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:35.450 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:35.450 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:43:35.450 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:43:35.450 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:35.450 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:35.451 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:35.451 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:35.451 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:43:35.451 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:35.451 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:35.451 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:35.451 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:35.451 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:35.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:35.451 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:43:35.505 INFO:teuthology.orchestra.run.smithi114.stdout:41 2023-11-04T01:43:35.505 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:43:35.506 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:43:35.506 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2023-11-04T01:43:35.506 DEBUG:teuthology.orchestra.run.smithi114:> import re 2023-11-04T01:43:35.506 DEBUG:teuthology.orchestra.run.smithi114:> import os 2023-11-04T01:43:35.506 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2023-11-04T01:43:35.506 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:43:35.506 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2023-11-04T01:43:35.506 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:43:35.506 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2023-11-04T01:43:35.506 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:43:35.506 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:43:35.506 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2023-11-04T01:43:35.507 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2023-11-04T01:43:35.507 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2023-11-04T01:43:35.507 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2023-11-04T01:43:35.507 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:43:35.507 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2023-11-04T01:43:35.507 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:43:35.507 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:43:35.507 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:43:35.507 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2023-11-04T01:43:35.507 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2023-11-04T01:43:35.507 DEBUG:teuthology.orchestra.run.smithi114:> return f 2023-11-04T01:43:35.507 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:43:35.507 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:43:35.507 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.0")) 2023-11-04T01:43:35.508 DEBUG:teuthology.orchestra.run.smithi114:> ' 2023-11-04T01:43:35.632 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.0.126262.asok 2023-11-04T01:43:35.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:35.643 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.126262.asok 2023-11-04T01:43:35.643 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:35.644 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.126262.asok status 2023-11-04T01:43:35.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:35.810 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:43:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2023-11-04T01:43:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:43:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:43:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "0", 2023-11-04T01:43:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2023-11-04T01:43:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:43:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "126262", 2023-11-04T01:43:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2023-11-04T01:43:35.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:43:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2023-11-04T01:43:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2023-11-04T01:43:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 8664, 2023-11-04T01:43:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2023-11-04T01:43:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2023-11-04T01:43:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2023-11-04T01:43:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 8664 2023-11-04T01:43:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:43:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:43:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:43:35.812 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:43:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 76750670 2023-11-04T01:43:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:43:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:43:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:43:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:43:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:43:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 76750670 2023-11-04T01:43:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:43:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.8664 192.168.0.1:0/76750670", 2023-11-04T01:43:35.813 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "192.168.0.1:0/76750670", 2023-11-04T01:43:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2023-11-04T01:43:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 103, 2023-11-04T01:43:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 111, 2023-11-04T01:43:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:43:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: "blocklisted": false, 2023-11-04T01:43:35.814 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2023-11-04T01:43:35.814 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:43:35.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:35.824 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:35.824 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:43:35.824 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:35.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:35.883 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2023-11-04T01:43:35.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:35.889 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:35.889 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:35.889 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:35.954 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:43:36.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.052+0000 7f451694c640 1 Processor -- start 2023-11-04T01:43:36.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.052+0000 7f451694c640 1 -- start start 2023-11-04T01:43:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.052+0000 7f451694c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45100b0c40 0x7f451006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.052+0000 7f451694c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f451006bb60 0x7f4510070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.052+0000 7f451694c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4510071500 con 0x7f4510159e40 2023-11-04T01:43:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.052+0000 7f451694c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4510070a70 con 0x7f451006bb60 2023-11-04T01:43:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.052+0000 7f451694c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451015dae0 con 0x7f45100b0c40 2023-11-04T01:43:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450ffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4510159e40 0x7f45100b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35424/0 (socket says 172.21.15.114:35424) 2023-11-04T01:43:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450ffff640 1 -- 172.21.15.114:0/563281902 learned_addr learned my addr 172.21.15.114:0/563281902 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:43:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450effd640 1 -- 172.21.15.114:0/563281902 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455565351 0 0) 0x7f4510071500 con 0x7f4510159e40 2023-11-04T01:43:36.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450effd640 1 -- 172.21.15.114:0/563281902 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44f8003520 con 0x7f4510159e40 2023-11-04T01:43:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450f7fe640 1 --2- 172.21.15.114:0/563281902 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45100b0c40 0x7f451006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f4514ee9640 1 --2- 172.21.15.114:0/563281902 >> v2:172.21.15.141:3300/0 conn(0x7f451006bb60 0x7f4510070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450effd640 1 -- 172.21.15.114:0/563281902 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3466126880 0 0) 0x7f44f8003520 con 0x7f4510159e40 2023-11-04T01:43:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450effd640 1 -- 172.21.15.114:0/563281902 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45100b0c40 msgr2=0x7f451006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450effd640 1 --2- 172.21.15.114:0/563281902 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45100b0c40 0x7f451006fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450effd640 1 -- 172.21.15.114:0/563281902 >> v2:172.21.15.141:3300/0 conn(0x7f451006bb60 msgr2=0x7f4510070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450effd640 1 --2- 172.21.15.114:0/563281902 >> v2:172.21.15.141:3300/0 conn(0x7f451006bb60 0x7f4510070530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450effd640 1 -- 172.21.15.114:0/563281902 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4510070c60 con 0x7f4510159e40 2023-11-04T01:43:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450effd640 1 -- 172.21.15.114:0/563281902 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f4500001670 con 0x7f4510159e40 2023-11-04T01:43:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f4514ee9640 1 --2- 172.21.15.114:0/563281902 >> v2:172.21.15.141:3300/0 conn(0x7f451006bb60 0x7f4510070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450effd640 1 -- 172.21.15.114:0/563281902 >> v1:172.21.15.114:6789/0 conn(0x7f4510159e40 legacy=0x7f45100b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450effd640 1 --2- 172.21.15.114:0/563281902 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44f8003970 0x7f44f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450effd640 1 --2- 172.21.15.114:0/563281902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44f80047c0 0x7f44f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450effd640 1 --2- 172.21.15.114:0/563281902 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45100b0c40 0x7f44f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450effd640 1 -- 172.21.15.114:0/563281902 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451015dae0 con 0x7f44f80047c0 2023-11-04T01:43:36.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450effd640 1 -- 172.21.15.114:0/563281902 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f800b9b0 con 0x7f44f8003970 2023-11-04T01:43:36.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450effd640 1 -- 172.21.15.114:0/563281902 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f800bb70 con 0x7f45100b0c40 2023-11-04T01:43:36.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450f7fe640 1 --2- 172.21.15.114:0/563281902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44f80047c0 0x7f44f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f450ffff640 1 --2- 172.21.15.114:0/563281902 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44f8003970 0x7f44f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.053+0000 7f4514ee9640 1 --2- 172.21.15.114:0/563281902 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45100b0c40 0x7f44f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.054+0000 7f450f7fe640 1 -- 172.21.15.114:0/563281902 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45100b0c40 msgr2=0x7f44f8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.054+0000 7f450f7fe640 1 --2- 172.21.15.114:0/563281902 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f45100b0c40 0x7f44f8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.054+0000 7f450f7fe640 1 -- 172.21.15.114:0/563281902 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44f8003970 msgr2=0x7f44f8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.054+0000 7f450f7fe640 1 --2- 172.21.15.114:0/563281902 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f44f8003970 0x7f44f8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.054+0000 7f450f7fe640 1 -- 172.21.15.114:0/563281902 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f8003520 con 0x7f44f80047c0 2023-11-04T01:43:36.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.054+0000 7f450f7fe640 1 --2- 172.21.15.114:0/563281902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44f80047c0 0x7f44f8004c40 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f4504009a90 tx=0x7f44f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56891de42deff0ea server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.054+0000 7f450effd640 1 -- 172.21.15.114:0/563281902 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450402c5a0 con 0x7f44f80047c0 2023-11-04T01:43:36.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.054+0000 7f450effd640 1 -- 172.21.15.114:0/563281902 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450402c700 con 0x7f44f80047c0 2023-11-04T01:43:36.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.054+0000 7f450effd640 1 -- 172.21.15.114:0/563281902 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450402ca90 con 0x7f44f80047c0 2023-11-04T01:43:36.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.055+0000 7f451694c640 1 -- 172.21.15.114:0/563281902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44f80047c0 msgr2=0x7f44f8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.055+0000 7f451694c640 1 --2- 172.21.15.114:0/563281902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44f80047c0 0x7f44f8004c40 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f4504009a90 tx=0x7f44f80057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.055+0000 7f4514ee9640 1 -- 172.21.15.114:0/563281902 reap_dead start 2023-11-04T01:43:36.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.055+0000 7f451694c640 1 -- 172.21.15.114:0/563281902 shutdown_connections 2023-11-04T01:43:36.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.055+0000 7f451694c640 1 -- 172.21.15.114:0/563281902 >> 172.21.15.114:0/563281902 conn(0x7f45100cb530 msgr2=0x7f45100cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:36.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.055+0000 7f451694c640 1 -- 172.21.15.114:0/563281902 shutdown_connections 2023-11-04T01:43:36.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.055+0000 7f451694c640 1 -- 172.21.15.114:0/563281902 wait complete. 2023-11-04T01:43:36.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.056+0000 7f451694c640 1 Processor -- start 2023-11-04T01:43:36.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.056+0000 7f451694c640 1 -- start start 2023-11-04T01:43:36.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f451694c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44f80047c0 0x7f451014ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f451694c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4510152560 0x7f4510154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f451694c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45101529c0 0x7f4510155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f451694c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4510150540 con 0x7f4510152560 2023-11-04T01:43:36.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f451694c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4510150730 con 0x7f45101529c0 2023-11-04T01:43:36.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f451694c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45101509d0 con 0x7f44f80047c0 2023-11-04T01:43:36.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f450f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4510152560 0x7f4510154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f450f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4510152560 0x7f4510154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56364/0 (socket says 172.21.15.114:56364) 2023-11-04T01:43:36.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f450f7fe640 1 -- 172.21.15.114:0/3250665756 learned_addr learned my addr 172.21.15.114:0/3250665756 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:36.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f450ffff640 1 --2- 172.21.15.114:0/3250665756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44f80047c0 0x7f451014ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f4514ee9640 1 --2- 172.21.15.114:0/3250665756 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45101529c0 0x7f4510155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f450f7fe640 1 -- 172.21.15.114:0/3250665756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44f80047c0 msgr2=0x7f451014ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f450f7fe640 1 --2- 172.21.15.114:0/3250665756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44f80047c0 0x7f451014ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f450f7fe640 1 -- 172.21.15.114:0/3250665756 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45101529c0 msgr2=0x7f4510155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f450f7fe640 1 --2- 172.21.15.114:0/3250665756 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45101529c0 0x7f4510155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f450f7fe640 1 -- 172.21.15.114:0/3250665756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4510150cb0 con 0x7f4510152560 2023-11-04T01:43:36.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f450ffff640 1 --2- 172.21.15.114:0/3250665756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44f80047c0 0x7f451014ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:36.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.057+0000 7f4514ee9640 1 --2- 172.21.15.114:0/3250665756 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45101529c0 0x7f4510155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:36.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.058+0000 7f450f7fe640 1 --2- 172.21.15.114:0/3250665756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4510152560 0x7f4510154e50 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f450402c140 tx=0x7f4504004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.058+0000 7f450cff9640 1 -- 172.21.15.114:0/3250665756 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504003810 con 0x7f4510152560 2023-11-04T01:43:36.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.058+0000 7f450cff9640 1 -- 172.21.15.114:0/3250665756 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4504003970 con 0x7f4510152560 2023-11-04T01:43:36.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.058+0000 7f450cff9640 1 -- 172.21.15.114:0/3250665756 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504003ce0 con 0x7f4510152560 2023-11-04T01:43:36.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.058+0000 7f451694c640 1 -- 172.21.15.114:0/3250665756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4510150f90 con 0x7f4510152560 2023-11-04T01:43:36.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.058+0000 7f451694c640 1 -- 172.21.15.114:0/3250665756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451014ef90 con 0x7f4510152560 2023-11-04T01:43:36.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.059+0000 7f450cff9640 1 -- 172.21.15.114:0/3250665756 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4504034440 con 0x7f4510152560 2023-11-04T01:43:36.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.059+0000 7f450cff9640 1 --2- 172.21.15.114:0/3250665756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44fc06aea0 0x7f44fc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.059+0000 7f450cff9640 1 -- 172.21.15.114:0/3250665756 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f45040abd40 con 0x7f4510152560 2023-11-04T01:43:36.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.059+0000 7f450ffff640 1 --2- 172.21.15.114:0/3250665756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44fc06aea0 0x7f44fc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.060+0000 7f450ffff640 1 --2- 172.21.15.114:0/3250665756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44fc06aea0 0x7f44fc06d360 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4500001050 tx=0x7f4500009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.060+0000 7f45195b6740 1 Processor -- start 2023-11-04T01:43:36.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.060+0000 7f45195b6740 1 -- start start 2023-11-04T01:43:36.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.061+0000 7f45195b6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8a4c0 0x5565bba8a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.061+0000 7f45195b6740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba5a6d0 0x5565bba87730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.061+0000 7f45195b6740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba5e040 0x5565bba87c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.061+0000 7f45195b6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bb9cdd70 con 0x5565bba8a4c0 2023-11-04T01:43:36.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.061+0000 7f45195b6740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bb9cb460 con 0x5565bba5e040 2023-11-04T01:43:36.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.061+0000 7f45195b6740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5565bb9c6d50 con 0x5565bba5a6d0 2023-11-04T01:43:36.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.061+0000 7f450ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8a4c0 0x5565bba8a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.061+0000 7f450ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8a4c0 0x5565bba8a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56366/0 (socket says 172.21.15.114:56366) 2023-11-04T01:43:36.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.061+0000 7f450ffff640 1 -- 172.21.15.114:0/3188698276 learned_addr learned my addr 172.21.15.114:0/3188698276 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:36.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.061+0000 7f450f7fe640 1 --2- 172.21.15.114:0/3188698276 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba5a6d0 0x5565bba87730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.061+0000 7f4514ee9640 1 --2- 172.21.15.114:0/3188698276 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba5e040 0x5565bba87c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.061+0000 7f450ffff640 1 -- 172.21.15.114:0/3188698276 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba5a6d0 msgr2=0x5565bba87730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.061+0000 7f450ffff640 1 --2- 172.21.15.114:0/3188698276 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba5a6d0 0x5565bba87730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.061+0000 7f450ffff640 1 -- 172.21.15.114:0/3188698276 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba5e040 msgr2=0x5565bba87c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.061+0000 7f450ffff640 1 --2- 172.21.15.114:0/3188698276 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba5e040 0x5565bba87c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.062+0000 7f450ffff640 1 -- 172.21.15.114:0/3188698276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565bb989e30 con 0x5565bba8a4c0 2023-11-04T01:43:36.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.062+0000 7f450ffff640 1 --2- 172.21.15.114:0/3188698276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8a4c0 0x5565bba8a8a0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f4500007fd0 tx=0x7f4500013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f53c4b36bdf182c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.062+0000 7f44f5ffb640 1 -- 172.21.15.114:0/3188698276 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4500004c70 con 0x5565bba8a4c0 2023-11-04T01:43:36.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.062+0000 7f44f5ffb640 1 -- 172.21.15.114:0/3188698276 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4500004dd0 con 0x5565bba8a4c0 2023-11-04T01:43:36.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.062+0000 7f44f5ffb640 1 -- 172.21.15.114:0/3188698276 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4500021610 con 0x5565bba8a4c0 2023-11-04T01:43:36.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.062+0000 7f45195b6740 1 -- 172.21.15.114:0/3188698276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8a4c0 msgr2=0x5565bba8a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.062+0000 7f45195b6740 1 --2- 172.21.15.114:0/3188698276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8a4c0 0x5565bba8a8a0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f4500007fd0 tx=0x7f4500013000 comp rx=0 tx=0).stop 2023-11-04T01:43:36.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.062+0000 7f45195b6740 1 -- 172.21.15.114:0/3188698276 shutdown_connections 2023-11-04T01:43:36.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.062+0000 7f45195b6740 1 --2- 172.21.15.114:0/3188698276 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba5e040 0x5565bba87c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.062+0000 7f45195b6740 1 --2- 172.21.15.114:0/3188698276 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba5a6d0 0x5565bba87730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.062+0000 7f45195b6740 1 --2- 172.21.15.114:0/3188698276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8a4c0 0x5565bba8a8a0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.062+0000 7f45195b6740 1 -- 172.21.15.114:0/3188698276 >> 172.21.15.114:0/3188698276 conn(0x5565bba5c9e0 msgr2=0x5565bbaa52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:36.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.062+0000 7f45195b6740 1 -- 172.21.15.114:0/3188698276 shutdown_connections 2023-11-04T01:43:36.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.062+0000 7f45195b6740 1 -- 172.21.15.114:0/3188698276 wait complete. 2023-11-04T01:43:36.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.063+0000 7f45195b6740 1 -- start start 2023-11-04T01:43:36.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.063+0000 7f45195b6740 1 Processor -- start 2023-11-04T01:43:36.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f45195b6740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba5e040 0x5565bba8c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f45195b6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8a4c0 0x5565bbab8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f45195b6740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba8c990 0x5565bbab93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f45195b6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bb980ee0 con 0x5565bba8a4c0 2023-11-04T01:43:36.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f45195b6740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bb980b80 con 0x5565bba5e040 2023-11-04T01:43:36.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f45195b6740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5565bb9463a0 con 0x5565bba8c990 2023-11-04T01:43:36.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f45195b6740 10 client.0 _ll_register_callbacks cb 0x5565bb94a8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:36.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f450f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8a4c0 0x5565bbab8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f450f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8a4c0 0x5565bbab8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56380/0 (socket says 172.21.15.114:56380) 2023-11-04T01:43:36.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f450f7fe640 1 -- 172.21.15.114:0/1377079209 learned_addr learned my addr 172.21.15.114:0/1377079209 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:36.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f4514ee9640 1 --2- 172.21.15.114:0/1377079209 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba8c990 0x5565bbab93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f450ffff640 1 --2- 172.21.15.114:0/1377079209 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba5e040 0x5565bba8c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f450f7fe640 1 -- 172.21.15.114:0/1377079209 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba8c990 msgr2=0x5565bbab93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f450f7fe640 1 --2- 172.21.15.114:0/1377079209 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba8c990 0x5565bbab93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f450f7fe640 1 -- 172.21.15.114:0/1377079209 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba5e040 msgr2=0x5565bba8c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f450f7fe640 1 --2- 172.21.15.114:0/1377079209 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba5e040 0x5565bba8c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f450f7fe640 1 -- 172.21.15.114:0/1377079209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450000f040 con 0x5565bba8a4c0 2023-11-04T01:43:36.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f450f7fe640 1 --2- 172.21.15.114:0/1377079209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8a4c0 0x5565bbab8eb0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f4504076660 tx=0x7f45040044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca96108759dc502 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.064+0000 7f44eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:43:36.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.065+0000 7f44eeffd640 1 -- 172.21.15.114:0/1377079209 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450407e0d0 con 0x5565bba8a4c0 2023-11-04T01:43:36.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.065+0000 7f44eeffd640 1 -- 172.21.15.114:0/1377079209 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f450407a160 con 0x5565bba8a4c0 2023-11-04T01:43:36.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.065+0000 7f45195b6740 1 -- 172.21.15.114:0/1377079209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5565bb9bfd30 con 0x5565bba8a4c0 2023-11-04T01:43:36.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.065+0000 7f44eeffd640 1 -- 172.21.15.114:0/1377079209 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) v2 ==== 24+0+0 (secure 0 0 0) 0x7f450407e2b0 con 0x5565bba8a4c0 2023-11-04T01:43:36.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.065+0000 7f45195b6740 10 client.8676 fetch_fsmap learned FSMap version 103 2023-11-04T01:43:36.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.065+0000 7f45195b6740 1 -- 172.21.15.114:0/1377079209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) v3 -- 0x5565bb9c53d0 con 0x5565bba8a4c0 2023-11-04T01:43:36.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.065+0000 7f44eeffd640 1 -- 172.21.15.114:0/1377079209 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5565bb9bfd30 con 0x5565bba8a4c0 2023-11-04T01:43:36.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.065+0000 7f44eeffd640 1 -- 172.21.15.114:0/1377079209 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 103) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f450407a3c0 con 0x5565bba8a4c0 2023-11-04T01:43:36.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.065+0000 7f45195b6740 10 client.8676 fetch_fsmap finished waiting for FSMap version 103 2023-11-04T01:43:36.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.065+0000 7f45195b6740 10 client.8676 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2023-11-04T01:43:36.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.065+0000 7f45195b6740 20 client.8676 populate_metadata read hostname 'smithi114' 2023-11-04T01:43:36.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.065+0000 7f45195b6740 1 --2- 172.21.15.114:0/1377079209 >> [v2:172.21.15.141:6832/224279622,v1:172.21.15.141:6834/224279622] conn(0x5565bba77060 0x5565bba77440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.065+0000 7f45195b6740 4 client.8676 mds_command: new command op to 6083 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:43:36.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.065+0000 7f45195b6740 1 -- 172.21.15.114:0/1377079209 --> [v2:172.21.15.141:6832/224279622,v1:172.21.15.141:6834/224279622] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5565bb9bfa50 con 0x5565bba77060 2023-11-04T01:43:36.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.065+0000 7f450ffff640 1 --2- 172.21.15.114:0/1377079209 >> [v2:172.21.15.141:6832/224279622,v1:172.21.15.141:6834/224279622] conn(0x5565bba77060 0x5565bba77440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.066+0000 7f44eeffd640 10 client.8676 ms_handle_connect on v2:172.21.15.141:6832/224279622 2023-11-04T01:43:36.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.066+0000 7f450ffff640 1 --2- 172.21.15.114:0/1377079209 >> [v2:172.21.15.141:6832/224279622,v1:172.21.15.141:6834/224279622] conn(0x5565bba77060 0x5565bba77440 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca827425cb28238d server_cookie=52deb6faec04b128 in_seq=0 out_seq=0 2023-11-04T01:43:36.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.066+0000 7f44eeffd640 1 -- 172.21.15.114:0/1377079209 <== mds.0 v2:172.21.15.141:6832/224279622 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5565bb9bfa50 con 0x5565bba77060 2023-11-04T01:43:36.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.066+0000 7f44eeffd640 10 client.8676 handle_command_reply: tid=0 2023-11-04T01:43:36.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.066+0000 7f45195b6740 1 client.8676 shutdown 2023-11-04T01:43:36.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.066+0000 7f45195b6740 1 -- 172.21.15.114:0/1377079209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8a4c0 msgr2=0x5565bbab8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.066+0000 7f45195b6740 1 --2- 172.21.15.114:0/1377079209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8a4c0 0x5565bbab8eb0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f4504076660 tx=0x7f45040044e0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.066+0000 7f45195b6740 1 -- 172.21.15.114:0/1377079209 shutdown_connections 2023-11-04T01:43:36.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.066+0000 7f45195b6740 1 --2- 172.21.15.114:0/1377079209 >> [v2:172.21.15.141:6832/224279622,v1:172.21.15.141:6834/224279622] conn(0x5565bba77060 0x5565bba77440 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.066+0000 7f45195b6740 1 --2- 172.21.15.114:0/1377079209 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba8c990 0x5565bbab93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.066+0000 7f44eeffd640 0 client.8676 ms_handle_reset on v2:172.21.15.141:6832/224279622 2023-11-04T01:43:36.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.066+0000 7f45195b6740 1 --2- 172.21.15.114:0/1377079209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8a4c0 0x5565bbab8eb0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.066+0000 7f45195b6740 1 --2- 172.21.15.114:0/1377079209 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba5e040 0x5565bba8c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.066+0000 7f45195b6740 1 -- 172.21.15.114:0/1377079209 >> 172.21.15.114:0/1377079209 conn(0x5565bba5a6d0 msgr2=0x5565bbaa87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:36.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.067+0000 7f45195b6740 1 -- 172.21.15.114:0/1377079209 shutdown_connections 2023-11-04T01:43:36.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.067+0000 7f45195b6740 1 -- 172.21.15.114:0/1377079209 wait complete. 2023-11-04T01:43:36.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.067+0000 7f45195b6740 20 client.8676 trim_cache size 0 max 16384 2023-11-04T01:43:36.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.079+0000 7f45195b6740 1 Processor -- start 2023-11-04T01:43:36.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.080+0000 7f45195b6740 1 -- start start 2023-11-04T01:43:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.080+0000 7f45195b6740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba5e040 0x5565bba77b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.080+0000 7f45195b6740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba8a4c0 0x5565bba5e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.080+0000 7f45195b6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8c990 0x5565bba5eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.080+0000 7f45195b6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bba744a0 con 0x5565bba8c990 2023-11-04T01:43:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.080+0000 7f45195b6740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bbaa5cc0 con 0x5565bba5e040 2023-11-04T01:43:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.080+0000 7f45195b6740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5565bb97c010 con 0x5565bba8a4c0 2023-11-04T01:43:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.080+0000 7f4514ee9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8c990 0x5565bba5eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.080+0000 7f4514ee9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8c990 0x5565bba5eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56390/0 (socket says 172.21.15.114:56390) 2023-11-04T01:43:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.080+0000 7f4514ee9640 1 -- 172.21.15.114:0/4065864847 learned_addr learned my addr 172.21.15.114:0/4065864847 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f450f7fe640 1 --2- 172.21.15.114:0/4065864847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba8a4c0 0x5565bba5e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f450ffff640 1 --2- 172.21.15.114:0/4065864847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba5e040 0x5565bba77b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f4514ee9640 1 -- 172.21.15.114:0/4065864847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba8a4c0 msgr2=0x5565bba5e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f4514ee9640 1 --2- 172.21.15.114:0/4065864847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba8a4c0 0x5565bba5e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f4514ee9640 1 -- 172.21.15.114:0/4065864847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba5e040 msgr2=0x5565bba77b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f4514ee9640 1 --2- 172.21.15.114:0/4065864847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba5e040 0x5565bba77b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f4514ee9640 1 -- 172.21.15.114:0/4065864847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565bb962ea0 con 0x5565bba8c990 2023-11-04T01:43:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f450f7fe640 1 --2- 172.21.15.114:0/4065864847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba8a4c0 0x5565bba5e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f450ffff640 1 --2- 172.21.15.114:0/4065864847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba5e040 0x5565bba77b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f4514ee9640 1 --2- 172.21.15.114:0/4065864847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8c990 0x5565bba5eb20 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f45100cea40 tx=0x7f4508009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30093bca9c78280 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f44f67fc640 1 -- 172.21.15.114:0/4065864847 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508018450 con 0x5565bba8c990 2023-11-04T01:43:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f44f67fc640 1 -- 172.21.15.114:0/4065864847 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45080185d0 con 0x5565bba8c990 2023-11-04T01:43:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f44f67fc640 1 -- 172.21.15.114:0/4065864847 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508018980 con 0x5565bba8c990 2023-11-04T01:43:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f45195b6740 1 -- 172.21.15.114:0/4065864847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8c990 msgr2=0x5565bba5eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f45195b6740 1 --2- 172.21.15.114:0/4065864847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8c990 0x5565bba5eb20 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f45100cea40 tx=0x7f4508009820 comp rx=0 tx=0).stop 2023-11-04T01:43:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f45195b6740 1 -- 172.21.15.114:0/4065864847 shutdown_connections 2023-11-04T01:43:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f45195b6740 1 --2- 172.21.15.114:0/4065864847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8c990 0x5565bba5eb20 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f45195b6740 1 --2- 172.21.15.114:0/4065864847 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba8a4c0 0x5565bba5e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f45195b6740 1 --2- 172.21.15.114:0/4065864847 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba5e040 0x5565bba77b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f45195b6740 1 -- 172.21.15.114:0/4065864847 >> 172.21.15.114:0/4065864847 conn(0x5565bba5a6d0 msgr2=0x5565bba8e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:36.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f45195b6740 1 -- 172.21.15.114:0/4065864847 shutdown_connections 2023-11-04T01:43:36.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.081+0000 7f45195b6740 1 -- 172.21.15.114:0/4065864847 wait complete. 2023-11-04T01:43:36.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.082+0000 7f45195b6740 1 -- start start 2023-11-04T01:43:36.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.082+0000 7f45195b6740 1 Processor -- start 2023-11-04T01:43:36.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f45195b6740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba5e040 0x5565bbaa78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f45195b6740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba8a4c0 0x5565bba90c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f45195b6740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8c990 0x5565bba5e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f45195b6740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bba91960 con 0x5565bba8c990 2023-11-04T01:43:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f45195b6740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565bba8c340 con 0x5565bba8a4c0 2023-11-04T01:43:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f45195b6740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5565bbac0440 con 0x5565bba5e040 2023-11-04T01:43:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f45195b6740 10 client.0 _ll_register_callbacks cb 0x7f4500018040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f4514ee9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8c990 0x5565bba5e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f4514ee9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8c990 0x5565bba5e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56404/0 (socket says 172.21.15.114:56404) 2023-11-04T01:43:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f4514ee9640 1 -- 172.21.15.114:0/1447515441 learned_addr learned my addr 172.21.15.114:0/1447515441 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f4514ee9640 1 -- 172.21.15.114:0/1447515441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba5e040 msgr2=0x5565bbaa78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f4514ee9640 1 --2- 172.21.15.114:0/1447515441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba5e040 0x5565bbaa78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f4514ee9640 1 -- 172.21.15.114:0/1447515441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba8a4c0 msgr2=0x5565bba90c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f4514ee9640 1 --2- 172.21.15.114:0/1447515441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba8a4c0 0x5565bba90c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f4514ee9640 1 -- 172.21.15.114:0/1447515441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565bb988690 con 0x5565bba8c990 2023-11-04T01:43:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f4514ee9640 1 --2- 172.21.15.114:0/1447515441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8c990 0x5565bba5e5e0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x5565bba745e0 tx=0x7f4508004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2181c7d218c4de5f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f44eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:43:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f44eeffd640 1 -- 172.21.15.114:0/1447515441 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508021650 con 0x5565bba8c990 2023-11-04T01:43:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.083+0000 7f44eeffd640 1 -- 172.21.15.114:0/1447515441 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f45080217b0 con 0x5565bba8c990 2023-11-04T01:43:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.084+0000 7f45195b6740 1 -- 172.21.15.114:0/1447515441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4500004dd0 con 0x5565bba8c990 2023-11-04T01:43:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.084+0000 7f44eeffd640 1 -- 172.21.15.114:0/1447515441 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4508018450 con 0x5565bba8c990 2023-11-04T01:43:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.084+0000 7f45195b6740 10 client.8682 fetch_fsmap learned FSMap version 103 2023-11-04T01:43:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.084+0000 7f45195b6740 1 -- 172.21.15.114:0/1447515441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) v3 -- 0x5565bb96f260 con 0x5565bba8c990 2023-11-04T01:43:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.084+0000 7f44eeffd640 1 -- 172.21.15.114:0/1447515441 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4500004dd0 con 0x5565bba8c990 2023-11-04T01:43:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.084+0000 7f44eeffd640 1 -- 172.21.15.114:0/1447515441 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 103) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f4508021b80 con 0x5565bba8c990 2023-11-04T01:43:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.084+0000 7f45195b6740 10 client.8682 fetch_fsmap finished waiting for FSMap version 103 2023-11-04T01:43:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.084+0000 7f45195b6740 10 client.8682 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2023-11-04T01:43:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.084+0000 7f45195b6740 20 client.8682 populate_metadata read hostname 'smithi114' 2023-11-04T01:43:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.084+0000 7f45195b6740 1 --2- 172.21.15.114:0/1447515441 >> [v2:172.21.15.141:6832/224279622,v1:172.21.15.141:6834/224279622] conn(0x5565bbb10120 0x5565bba5eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.084+0000 7f45195b6740 4 client.8682 mds_command: new command op to 6083 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:43:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.084+0000 7f45195b6740 1 -- 172.21.15.114:0/1447515441 --> [v2:172.21.15.141:6832/224279622,v1:172.21.15.141:6834/224279622] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5565bb6c77e0 con 0x5565bbb10120 2023-11-04T01:43:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.084+0000 7f450ffff640 1 --2- 172.21.15.114:0/1447515441 >> [v2:172.21.15.141:6832/224279622,v1:172.21.15.141:6834/224279622] conn(0x5565bbb10120 0x5565bba5eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.084+0000 7f44eeffd640 10 client.8682 ms_handle_connect on v2:172.21.15.141:6832/224279622 2023-11-04T01:43:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.084+0000 7f450ffff640 1 --2- 172.21.15.114:0/1447515441 >> [v2:172.21.15.141:6832/224279622,v1:172.21.15.141:6834/224279622] conn(0x5565bbb10120 0x5565bba5eb20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6206f51d65725e2d server_cookie=f340c040731d667 in_seq=0 out_seq=0 2023-11-04T01:43:36.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.090+0000 7f44eeffd640 1 -- 172.21.15.114:0/1447515441 <== mds.0 v2:172.21.15.141:6832/224279622 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5565bb6c77e0 con 0x5565bbb10120 2023-11-04T01:43:36.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.090+0000 7f44eeffd640 10 client.8682 handle_command_reply: tid=0 2023-11-04T01:43:36.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.090+0000 7f45195b6740 1 client.8682 shutdown 2023-11-04T01:43:36.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f45195b6740 1 -- 172.21.15.114:0/1447515441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8c990 msgr2=0x5565bba5e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f45195b6740 1 --2- 172.21.15.114:0/1447515441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8c990 0x5565bba5e5e0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x5565bba745e0 tx=0x7f4508004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:36.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f45195b6740 1 -- 172.21.15.114:0/1447515441 shutdown_connections 2023-11-04T01:43:36.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f45195b6740 1 --2- 172.21.15.114:0/1447515441 >> [v2:172.21.15.141:6832/224279622,v1:172.21.15.141:6834/224279622] conn(0x5565bbb10120 0x5565bba5eb20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f45195b6740 1 --2- 172.21.15.114:0/1447515441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5565bba8c990 0x5565bba5e5e0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f45195b6740 1 --2- 172.21.15.114:0/1447515441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5565bba8a4c0 0x5565bba90c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f45195b6740 1 --2- 172.21.15.114:0/1447515441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5565bba5e040 0x5565bbaa78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f44eeffd640 0 client.8682 ms_handle_reset on v2:172.21.15.141:6832/224279622 2023-11-04T01:43:36.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f45195b6740 1 -- 172.21.15.114:0/1447515441 >> 172.21.15.114:0/1447515441 conn(0x5565bba5a6d0 msgr2=0x5565bba8e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:36.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f45195b6740 1 -- 172.21.15.114:0/1447515441 shutdown_connections 2023-11-04T01:43:36.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f45195b6740 1 -- 172.21.15.114:0/1447515441 wait complete. 2023-11-04T01:43:36.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f45195b6740 20 client.8682 trim_cache size 0 max 16384 2023-11-04T01:43:36.094 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:43:36.094 INFO:teuthology.orchestra.run.smithi114.stdout: "message": "", 2023-11-04T01:43:36.094 INFO:teuthology.orchestra.run.smithi114.stdout: "return_code": 0 2023-11-04T01:43:36.094 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:43:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f451694c640 1 -- 172.21.15.114:0/3250665756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44fc06aea0 msgr2=0x7f44fc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f451694c640 1 --2- 172.21.15.114:0/3250665756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44fc06aea0 0x7f44fc06d360 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4500001050 tx=0x7f4500009040 comp rx=0 tx=0).stop 2023-11-04T01:43:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f451694c640 1 -- 172.21.15.114:0/3250665756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4510152560 msgr2=0x7f4510154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f451694c640 1 --2- 172.21.15.114:0/3250665756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4510152560 0x7f4510154e50 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f450402c140 tx=0x7f4504004730 comp rx=0 tx=0).stop 2023-11-04T01:43:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f451694c640 1 -- 172.21.15.114:0/3250665756 shutdown_connections 2023-11-04T01:43:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f451694c640 1 --2- 172.21.15.114:0/3250665756 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f44fc06aea0 0x7f44fc06d360 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f451694c640 1 --2- 172.21.15.114:0/3250665756 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f45101529c0 0x7f4510155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f451694c640 1 --2- 172.21.15.114:0/3250665756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4510152560 0x7f4510154e50 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f451694c640 1 --2- 172.21.15.114:0/3250665756 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f44f80047c0 0x7f451014ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f451694c640 1 -- 172.21.15.114:0/3250665756 >> 172.21.15.114:0/3250665756 conn(0x7f45100cb530 msgr2=0x7f45100cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f451694c640 1 -- 172.21.15.114:0/3250665756 shutdown_connections 2023-11-04T01:43:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.091+0000 7f451694c640 1 -- 172.21.15.114:0/3250665756 wait complete. 2023-11-04T01:43:36.103 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=6, also kill snapclient 2023-11-04T01:43:36.104 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:36.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.202+0000 7fdbcf1ee640 1 Processor -- start 2023-11-04T01:43:36.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.202+0000 7fdbcf1ee640 1 -- start start 2023-11-04T01:43:36.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.202+0000 7fdbcf1ee640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdbc80d1be0 0x7fdbc8167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.202+0000 7fdbcf1ee640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc80b32b0 con 0x7fdbc815d100 2023-11-04T01:43:36.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.202+0000 7fdbcf1ee640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc80cee10 con 0x7fdbc815d4e0 2023-11-04T01:43:36.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.202+0000 7fdbcf1ee640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc80cec20 con 0x7fdbc80d1be0 2023-11-04T01:43:36.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.203+0000 7fdbcd78b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdbc80d1be0 0x7fdbc8167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.203+0000 7fdbcd78b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdbc80d1be0 0x7fdbc8167e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56416/0 (socket says 172.21.15.114:56416) 2023-11-04T01:43:36.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.203+0000 7fdbcd78b640 1 -- 172.21.15.114:0/3686863663 learned_addr learned my addr 172.21.15.114:0/3686863663 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:36.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.203+0000 7fdbcd78b640 1 -- 172.21.15.114:0/3686863663 >> v1:172.21.15.141:6789/0 conn(0x7fdbc815d4e0 legacy=0x7fdbc80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.203+0000 7fdbcd78b640 1 -- 172.21.15.114:0/3686863663 >> v1:172.21.15.114:6789/0 conn(0x7fdbc815d100 legacy=0x7fdbc80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.203+0000 7fdbcd78b640 1 -- 172.21.15.114:0/3686863663 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc80b4750 con 0x7fdbc80d1be0 2023-11-04T01:43:36.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.203+0000 7fdbc77fe640 1 -- 172.21.15.114:0/3686863663 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897204416 0 0) 0x7fdbc80b32b0 con 0x7fdbc815d100 2023-11-04T01:43:36.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.204+0000 7fdbcd78b640 1 --2- 172.21.15.114:0/3686863663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbc80d1be0 0x7fdbc8167e80 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009e50 tx=0x7fdbc002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a18a5d68839849 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.204+0000 7fdbc77fe640 1 -- 172.21.15.114:0/3686863663 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc002cbb0 con 0x7fdbc80d1be0 2023-11-04T01:43:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.204+0000 7fdbc77fe640 1 -- 172.21.15.114:0/3686863663 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc002cd10 con 0x7fdbc80d1be0 2023-11-04T01:43:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.204+0000 7fdbc77fe640 1 -- 172.21.15.114:0/3686863663 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0034610 con 0x7fdbc80d1be0 2023-11-04T01:43:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.204+0000 7fdbcf1ee640 1 -- 172.21.15.114:0/3686863663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbc80d1be0 msgr2=0x7fdbc8167e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.204+0000 7fdbcf1ee640 1 --2- 172.21.15.114:0/3686863663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbc80d1be0 0x7fdbc8167e80 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009e50 tx=0x7fdbc002c010 comp rx=0 tx=0).stop 2023-11-04T01:43:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.204+0000 7fdbcf1ee640 1 -- 172.21.15.114:0/3686863663 shutdown_connections 2023-11-04T01:43:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.204+0000 7fdbcf1ee640 1 --2- 172.21.15.114:0/3686863663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbc80d1be0 0x7fdbc8167e80 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.204+0000 7fdbcf1ee640 1 -- 172.21.15.114:0/3686863663 >> 172.21.15.114:0/3686863663 conn(0x7fdbc80d2ef0 msgr2=0x7fdbc80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.204+0000 7fdbcf1ee640 1 -- 172.21.15.114:0/3686863663 shutdown_connections 2023-11-04T01:43:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.204+0000 7fdbcf1ee640 1 -- 172.21.15.114:0/3686863663 wait complete. 2023-11-04T01:43:36.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.205+0000 7fdbcf1ee640 1 Processor -- start 2023-11-04T01:43:36.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.205+0000 7fdbcf1ee640 1 -- start start 2023-11-04T01:43:36.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.206+0000 7fdbcf1ee640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdbc80d1be0 0x7fdbc81f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.206+0000 7fdbcf1ee640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbc815d100 0x7fdbc80c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.206+0000 7fdbcf1ee640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbc815d4e0 0x7fdbc80ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.206+0000 7fdbcf1ee640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80c9910 con 0x7fdbc815d100 2023-11-04T01:43:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.206+0000 7fdbcf1ee640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80cd070 con 0x7fdbc80d1be0 2023-11-04T01:43:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.206+0000 7fdbcf1ee640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc815eea0 con 0x7fdbc815d4e0 2023-11-04T01:43:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.206+0000 7fdbc7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbc815d100 0x7fdbc80c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.206+0000 7fdbc7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbc815d100 0x7fdbc80c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56430/0 (socket says 172.21.15.114:56430) 2023-11-04T01:43:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.206+0000 7fdbc7fff640 1 -- 172.21.15.114:0/4086686161 learned_addr learned my addr 172.21.15.114:0/4086686161 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.207+0000 7fdbcd78b640 1 --2- 172.21.15.114:0/4086686161 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbc815d4e0 0x7fdbc80ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.207+0000 7fdbccf8a640 1 --2- 172.21.15.114:0/4086686161 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdbc80d1be0 0x7fdbc81f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.207+0000 7fdbc7fff640 1 -- 172.21.15.114:0/4086686161 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbc815d4e0 msgr2=0x7fdbc80ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.207+0000 7fdbc7fff640 1 --2- 172.21.15.114:0/4086686161 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbc815d4e0 0x7fdbc80ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.207+0000 7fdbc7fff640 1 -- 172.21.15.114:0/4086686161 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdbc80d1be0 msgr2=0x7fdbc81f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.207+0000 7fdbc7fff640 1 --2- 172.21.15.114:0/4086686161 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdbc80d1be0 0x7fdbc81f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.207+0000 7fdbc7fff640 1 -- 172.21.15.114:0/4086686161 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc0009b30 con 0x7fdbc815d100 2023-11-04T01:43:36.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.207+0000 7fdbccf8a640 1 --2- 172.21.15.114:0/4086686161 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdbc80d1be0 0x7fdbc81f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:36.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.207+0000 7fdbc7fff640 1 --2- 172.21.15.114:0/4086686161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbc815d100 0x7fdbc80c9fc0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400c3c0 tx=0x7fdbb400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.207+0000 7fdbc57fa640 1 -- 172.21.15.114:0/4086686161 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40052d0 con 0x7fdbc815d100 2023-11-04T01:43:36.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.207+0000 7fdbc57fa640 1 -- 172.21.15.114:0/4086686161 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb4005450 con 0x7fdbc815d100 2023-11-04T01:43:36.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.207+0000 7fdbc57fa640 1 -- 172.21.15.114:0/4086686161 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4003830 con 0x7fdbc815d100 2023-11-04T01:43:36.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.207+0000 7fdbcf1ee640 1 -- 172.21.15.114:0/4086686161 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc80cc7d0 con 0x7fdbc815d100 2023-11-04T01:43:36.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.207+0000 7fdbcf1ee640 1 -- 172.21.15.114:0/4086686161 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc80ccd90 con 0x7fdbc815d100 2023-11-04T01:43:36.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.208+0000 7fdbcf1ee640 1 -- 172.21.15.114:0/4086686161 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc815f030 con 0x7fdbc815d100 2023-11-04T01:43:36.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.209+0000 7fdbc57fa640 1 -- 172.21.15.114:0/4086686161 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdbb4003990 con 0x7fdbc815d100 2023-11-04T01:43:36.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.209+0000 7fdbc57fa640 1 --2- 172.21.15.114:0/4086686161 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdbac06ae70 0x7fdbac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.209+0000 7fdbc57fa640 1 -- 172.21.15.114:0/4086686161 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fdbb4089380 con 0x7fdbc815d100 2023-11-04T01:43:36.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.209+0000 7fdbccf8a640 1 --2- 172.21.15.114:0/4086686161 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdbac06ae70 0x7fdbac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.209+0000 7fdbccf8a640 1 --2- 172.21.15.114:0/4086686161 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdbac06ae70 0x7fdbac06d330 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc001250 tx=0x7fdbbc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.213+0000 7fdbc57fa640 1 -- 172.21.15.114:0/4086686161 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdbb4053c00 con 0x7fdbc815d100 2023-11-04T01:43:36.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.416+0000 7fdbcf1ee640 1 -- 172.21.15.114:0/4086686161 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbc80684b0 con 0x7fdbc815d100 2023-11-04T01:43:36.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.417+0000 7fdbc57fa640 1 -- 172.21.15.114:0/4086686161 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4941 (secure 0 0 0) 0x7fdbb4017090 con 0x7fdbc815d100 2023-11-04T01:43:36.419 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:36.419 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":103,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:28.632221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":18,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:36.419 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 103 2023-11-04T01:43:36.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.419+0000 7fdbcf1ee640 1 -- 172.21.15.114:0/4086686161 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdbac06ae70 msgr2=0x7fdbac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.419+0000 7fdbcf1ee640 1 --2- 172.21.15.114:0/4086686161 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdbac06ae70 0x7fdbac06d330 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc001250 tx=0x7fdbbc009040 comp rx=0 tx=0).stop 2023-11-04T01:43:36.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.419+0000 7fdbcf1ee640 1 -- 172.21.15.114:0/4086686161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbc815d100 msgr2=0x7fdbc80c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.419+0000 7fdbcf1ee640 1 --2- 172.21.15.114:0/4086686161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbc815d100 0x7fdbc80c9fc0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400c3c0 tx=0x7fdbb400c880 comp rx=0 tx=0).stop 2023-11-04T01:43:36.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.419+0000 7fdbcf1ee640 1 -- 172.21.15.114:0/4086686161 shutdown_connections 2023-11-04T01:43:36.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.419+0000 7fdbcf1ee640 1 --2- 172.21.15.114:0/4086686161 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbc815d4e0 0x7fdbc80ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.419+0000 7fdbcf1ee640 1 --2- 172.21.15.114:0/4086686161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbc815d100 0x7fdbc80c9fc0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.419+0000 7fdbcf1ee640 1 --2- 172.21.15.114:0/4086686161 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdbac06ae70 0x7fdbac06d330 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.419+0000 7fdbcf1ee640 1 --2- 172.21.15.114:0/4086686161 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdbc80d1be0 0x7fdbc81f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.419+0000 7fdbcf1ee640 1 -- 172.21.15.114:0/4086686161 >> 172.21.15.114:0/4086686161 conn(0x7fdbc80d2ef0 msgr2=0x7fdbc80d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.419+0000 7fdbcf1ee640 1 -- 172.21.15.114:0/4086686161 shutdown_connections 2023-11-04T01:43:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.419+0000 7fdbcf1ee640 1 -- 172.21.15.114:0/4086686161 wait complete. 2023-11-04T01:43:36.431 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:43:36.555 INFO:teuthology.orchestra.run.smithi141.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:48.820894+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:43:36.555 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:48.820894+0000" } ] } 2023-11-04T01:43:36.555 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:43:36.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.655+0000 7f3932658640 1 Processor -- start 2023-11-04T01:43:36.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.655+0000 7f3932658640 1 -- start start 2023-11-04T01:43:36.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.655+0000 7f3932658640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f392c15d110 0x7f392c06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.655+0000 7f3932658640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f392c0b3ca0 0x7f392c0ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.655+0000 7f3932658640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392c15d4f0 con 0x7f392c0ad3b0 2023-11-04T01:43:36.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.655+0000 7f3932658640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392c0664f0 con 0x7f392c0b3ca0 2023-11-04T01:43:36.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.655+0000 7f3932658640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392c06b9f0 con 0x7f392c15d110 2023-11-04T01:43:36.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.656+0000 7f392b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f392c0b3ca0 0x7f392c0ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.656+0000 7f3930bf5640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f392c0ad3b0 0x7f392c0b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58942/0 (socket says 172.21.15.114:58942) 2023-11-04T01:43:36.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.656+0000 7f392b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f392c0b3ca0 0x7f392c0ace70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58550/0 (socket says 172.21.15.114:58550) 2023-11-04T01:43:36.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.656+0000 7f3930bf5640 1 -- 172.21.15.114:0/3874892318 learned_addr learned my addr 172.21.15.114:0/3874892318 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:43:36.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.656+0000 7f392bfff640 1 --2- 172.21.15.114:0/3874892318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f392c15d110 0x7f392c06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.656+0000 7f392b7fe640 1 -- 172.21.15.114:0/3874892318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f392c15d110 msgr2=0x7f392c06b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.656+0000 7f392b7fe640 1 --2- 172.21.15.114:0/3874892318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f392c15d110 0x7f392c06b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.656+0000 7f392b7fe640 1 -- 172.21.15.114:0/3874892318 >> v1:172.21.15.114:6789/0 conn(0x7f392c0ad3b0 legacy=0x7f392c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.656+0000 7f392b7fe640 1 -- 172.21.15.114:0/3874892318 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c06c2e0 con 0x7f392c0b3ca0 2023-11-04T01:43:36.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.656+0000 7f392affd640 1 -- 172.21.15.114:0/3874892318 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361013099 0 0) 0x7f392c15d4f0 con 0x7f392c0ad3b0 2023-11-04T01:43:36.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.657+0000 7f392b7fe640 1 --2- 172.21.15.114:0/3874892318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0b3ca0 0x7f392c0ace70 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f39200097a0 tx=0x7f392002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da9e8cf05409f82 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.657+0000 7f392affd640 1 -- 172.21.15.114:0/3874892318 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920031830 con 0x7f392c0b3ca0 2023-11-04T01:43:36.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.657+0000 7f392affd640 1 -- 172.21.15.114:0/3874892318 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3920031990 con 0x7f392c0b3ca0 2023-11-04T01:43:36.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.657+0000 7f392affd640 1 -- 172.21.15.114:0/3874892318 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920031d20 con 0x7f392c0b3ca0 2023-11-04T01:43:36.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.657+0000 7f3932658640 1 -- 172.21.15.114:0/3874892318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0b3ca0 msgr2=0x7f392c0ace70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.657+0000 7f3932658640 1 --2- 172.21.15.114:0/3874892318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0b3ca0 0x7f392c0ace70 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f39200097a0 tx=0x7f392002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.657+0000 7f3932658640 1 -- 172.21.15.114:0/3874892318 shutdown_connections 2023-11-04T01:43:36.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.657+0000 7f3932658640 1 --2- 172.21.15.114:0/3874892318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0b3ca0 0x7f392c0ace70 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.657+0000 7f3932658640 1 --2- 172.21.15.114:0/3874892318 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f392c15d110 0x7f392c06b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.657+0000 7f3932658640 1 -- 172.21.15.114:0/3874892318 >> 172.21.15.114:0/3874892318 conn(0x7f392c0cbd30 msgr2=0x7f392c0cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:36.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.657+0000 7f3932658640 1 -- 172.21.15.114:0/3874892318 shutdown_connections 2023-11-04T01:43:36.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.657+0000 7f3932658640 1 -- 172.21.15.114:0/3874892318 wait complete. 2023-11-04T01:43:36.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.658+0000 7f3932658640 1 Processor -- start 2023-11-04T01:43:36.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.659+0000 7f3932658640 1 -- start start 2023-11-04T01:43:36.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.659+0000 7f3932658640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0ad3b0 0x7f392c157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.659+0000 7f3932658640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f392c0b3ca0 0x7f392c15f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.659+0000 7f3932658640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f392c15d110 0x7f392c0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.659+0000 7f3932658640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c0aed10 con 0x7f392c0ad3b0 2023-11-04T01:43:36.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.659+0000 7f3932658640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c15ff60 con 0x7f392c0b3ca0 2023-11-04T01:43:36.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.659+0000 7f3932658640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392c160240 con 0x7f392c15d110 2023-11-04T01:43:36.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.659+0000 7f392bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0ad3b0 0x7f392c157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.660+0000 7f392bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0ad3b0 0x7f392c157a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58562/0 (socket says 172.21.15.114:58562) 2023-11-04T01:43:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.660+0000 7f392bfff640 1 -- 172.21.15.114:0/2842761545 learned_addr learned my addr 172.21.15.114:0/2842761545 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.660+0000 7f3930bf5640 1 --2- 172.21.15.114:0/2842761545 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f392c15d110 0x7f392c0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.660+0000 7f392b7fe640 1 --2- 172.21.15.114:0/2842761545 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f392c0b3ca0 0x7f392c15f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.660+0000 7f392bfff640 1 -- 172.21.15.114:0/2842761545 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f392c15d110 msgr2=0x7f392c0b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.660+0000 7f392bfff640 1 --2- 172.21.15.114:0/2842761545 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f392c15d110 0x7f392c0b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.660+0000 7f392bfff640 1 -- 172.21.15.114:0/2842761545 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f392c0b3ca0 msgr2=0x7f392c15f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.660+0000 7f392bfff640 1 --2- 172.21.15.114:0/2842761545 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f392c0b3ca0 0x7f392c15f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.660+0000 7f392bfff640 1 -- 172.21.15.114:0/2842761545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3920009400 con 0x7f392c0ad3b0 2023-11-04T01:43:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.660+0000 7f392b7fe640 1 --2- 172.21.15.114:0/2842761545 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f392c0b3ca0 0x7f392c15f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:36.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.660+0000 7f392bfff640 1 --2- 172.21.15.114:0/2842761545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0ad3b0 0x7f392c157a60 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f391c00d800 tx=0x7f391c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.660+0000 7f3928ff9640 1 -- 172.21.15.114:0/2842761545 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00b6c0 con 0x7f392c0ad3b0 2023-11-04T01:43:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.660+0000 7f3928ff9640 1 -- 172.21.15.114:0/2842761545 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c00b820 con 0x7f392c0ad3b0 2023-11-04T01:43:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.660+0000 7f3932658640 1 -- 172.21.15.114:0/2842761545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392c0aefd0 con 0x7f392c0ad3b0 2023-11-04T01:43:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.660+0000 7f3928ff9640 1 -- 172.21.15.114:0/2842761545 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00bbd0 con 0x7f392c0ad3b0 2023-11-04T01:43:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.660+0000 7f3932658640 1 -- 172.21.15.114:0/2842761545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c157fa0 con 0x7f392c0ad3b0 2023-11-04T01:43:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.661+0000 7f3932658640 1 -- 172.21.15.114:0/2842761545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392c0684b0 con 0x7f392c0ad3b0 2023-11-04T01:43:36.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.662+0000 7f3928ff9640 1 -- 172.21.15.114:0/2842761545 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f391c00bd30 con 0x7f392c0ad3b0 2023-11-04T01:43:36.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.662+0000 7f3928ff9640 1 --2- 172.21.15.114:0/2842761545 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f391806ae70 0x7f391806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.662+0000 7f3928ff9640 1 -- 172.21.15.114:0/2842761545 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f391c08a2b0 con 0x7f392c0ad3b0 2023-11-04T01:43:36.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.662+0000 7f392b7fe640 1 --2- 172.21.15.114:0/2842761545 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f391806ae70 0x7f391806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.663+0000 7f392b7fe640 1 --2- 172.21.15.114:0/2842761545 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f391806ae70 0x7f391806d330 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3920036000 tx=0x7f392003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.666+0000 7f3928ff9640 1 -- 172.21.15.114:0/2842761545 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f391c054b30 con 0x7f392c0ad3b0 2023-11-04T01:43:36.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:36.899+0000 7f3932658640 1 -- 172.21.15.114:0/2842761545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f392c0ce510 con 0x7f392c0ad3b0 2023-11-04T01:43:37.517 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:43:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:37.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.675+0000 7f3928ff9640 1 -- 172.21.15.114:0/2842761545 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.6083 v104) v1 ==== 112+0+0 (secure 0 0 0) 0x7f391c058150 con 0x7f392c0ad3b0 2023-11-04T01:43:37.677 INFO:teuthology.orchestra.run.smithi114.stderr:freezing mds.6083 2023-11-04T01:43:37.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.678+0000 7f3932658640 1 -- 172.21.15.114:0/2842761545 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f391806ae70 msgr2=0x7f391806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.678+0000 7f3932658640 1 --2- 172.21.15.114:0/2842761545 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f391806ae70 0x7f391806d330 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3920036000 tx=0x7f392003c040 comp rx=0 tx=0).stop 2023-11-04T01:43:37.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.678+0000 7f3932658640 1 -- 172.21.15.114:0/2842761545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0ad3b0 msgr2=0x7f392c157a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.678+0000 7f3932658640 1 --2- 172.21.15.114:0/2842761545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0ad3b0 0x7f392c157a60 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f391c00d800 tx=0x7f391c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.678+0000 7f3932658640 1 -- 172.21.15.114:0/2842761545 shutdown_connections 2023-11-04T01:43:37.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.678+0000 7f3932658640 1 --2- 172.21.15.114:0/2842761545 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f392c15d110 0x7f392c0b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.678+0000 7f3932658640 1 --2- 172.21.15.114:0/2842761545 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f391806ae70 0x7f391806d330 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.678+0000 7f3932658640 1 --2- 172.21.15.114:0/2842761545 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f392c0b3ca0 0x7f392c15f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.678+0000 7f3932658640 1 --2- 172.21.15.114:0/2842761545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0ad3b0 0x7f392c157a60 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.678+0000 7f3932658640 1 -- 172.21.15.114:0/2842761545 >> 172.21.15.114:0/2842761545 conn(0x7f392c0cbd30 msgr2=0x7f392c06adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:37.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.678+0000 7f3932658640 1 -- 172.21.15.114:0/2842761545 shutdown_connections 2023-11-04T01:43:37.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.678+0000 7f3932658640 1 -- 172.21.15.114:0/2842761545 wait complete. 2023-11-04T01:43:37.692 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:43:37.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.796+0000 7fc12d59e640 1 Processor -- start 2023-11-04T01:43:37.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.796+0000 7fc12d59e640 1 -- start start 2023-11-04T01:43:37.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.796+0000 7fc12d59e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc12815d100 0x7fc1280ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.796+0000 7fc12d59e640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1280d1be0 0x7fc1280b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.796+0000 7fc12d59e640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1280b32b0 con 0x7fc12815d4e0 2023-11-04T01:43:37.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.796+0000 7fc12d59e640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1280cee10 con 0x7fc1280d1be0 2023-11-04T01:43:37.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.796+0000 7fc12d59e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1280b2980 con 0x7fc12815d100 2023-11-04T01:43:37.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.797+0000 7fc1277fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1280d1be0 0x7fc1280b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.797+0000 7fc126ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc12815d100 0x7fc1280ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.797+0000 7fc1277fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1280d1be0 0x7fc1280b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:45668/0 (socket says 172.21.15.114:45668) 2023-11-04T01:43:37.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.797+0000 7fc126ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc12815d100 0x7fc1280ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:34904/0 (socket says 172.21.15.114:34904) 2023-11-04T01:43:37.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.797+0000 7fc1277fe640 1 -- 172.21.15.114:0/2930611231 learned_addr learned my addr 172.21.15.114:0/2930611231 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:37.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.797+0000 7fc126ffd640 1 -- 172.21.15.114:0/2930611231 >> v2:172.21.15.141:3300/0 conn(0x7fc1280d1be0 msgr2=0x7fc1280b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:37.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.797+0000 7fc126ffd640 1 --2- 172.21.15.114:0/2930611231 >> v2:172.21.15.141:3300/0 conn(0x7fc1280d1be0 0x7fc1280b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.797+0000 7fc126ffd640 1 -- 172.21.15.114:0/2930611231 >> v1:172.21.15.141:6789/0 conn(0x7fc12815d4e0 legacy=0x7fc1280d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.797+0000 7fc126ffd640 1 -- 172.21.15.114:0/2930611231 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1280b2c60 con 0x7fc12815d100 2023-11-04T01:43:37.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.797+0000 7fc1277fe640 1 --2- 172.21.15.114:0/2930611231 >> v2:172.21.15.141:3300/0 conn(0x7fc1280d1be0 0x7fc1280b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:37.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.798+0000 7fc126ffd640 1 --2- 172.21.15.114:0/2930611231 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc12815d100 0x7fc1280ce510 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc118009e10 tx=0x7fc11802bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a13494f6016fa3a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:37.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.798+0000 7fc125ffb640 1 -- 172.21.15.114:0/2930611231 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11802cc80 con 0x7fc12815d100 2023-11-04T01:43:37.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.798+0000 7fc125ffb640 1 -- 172.21.15.114:0/2930611231 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11802cde0 con 0x7fc12815d100 2023-11-04T01:43:37.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.798+0000 7fc125ffb640 1 -- 172.21.15.114:0/2930611231 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118034660 con 0x7fc12815d100 2023-11-04T01:43:37.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.799+0000 7fc12d59e640 1 -- 172.21.15.114:0/2930611231 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc12815d100 msgr2=0x7fc1280ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.799+0000 7fc12d59e640 1 --2- 172.21.15.114:0/2930611231 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc12815d100 0x7fc1280ce510 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc118009e10 tx=0x7fc11802bed0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.799+0000 7fc12d59e640 1 -- 172.21.15.114:0/2930611231 shutdown_connections 2023-11-04T01:43:37.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.799+0000 7fc12d59e640 1 --2- 172.21.15.114:0/2930611231 >> v2:172.21.15.141:3300/0 conn(0x7fc1280d1be0 0x7fc1280b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.799+0000 7fc12d59e640 1 --2- 172.21.15.114:0/2930611231 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc12815d100 0x7fc1280ce510 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.799+0000 7fc12d59e640 1 -- 172.21.15.114:0/2930611231 >> 172.21.15.114:0/2930611231 conn(0x7fc1280d2ef0 msgr2=0x7fc1280d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:37.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.799+0000 7fc12d59e640 1 -- 172.21.15.114:0/2930611231 shutdown_connections 2023-11-04T01:43:37.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.799+0000 7fc12d59e640 1 -- 172.21.15.114:0/2930611231 wait complete. 2023-11-04T01:43:37.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.800+0000 7fc12d59e640 1 Processor -- start 2023-11-04T01:43:37.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.800+0000 7fc12d59e640 1 -- start start 2023-11-04T01:43:37.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc12d59e640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1280d1be0 0x7fc1280b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc12d59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc12815d100 0x7fc128151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc12d59e640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc12815d4e0 0x7fc12815eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc12d59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1280cb500 con 0x7fc12815d100 2023-11-04T01:43:37.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc12d59e640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc128151890 con 0x7fc12815d4e0 2023-11-04T01:43:37.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc12d59e640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1280ca4a0 con 0x7fc1280d1be0 2023-11-04T01:43:37.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc1267fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc12815d100 0x7fc128151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc1267fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc12815d100 0x7fc128151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58574/0 (socket says 172.21.15.114:58574) 2023-11-04T01:43:37.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc1267fc640 1 -- 172.21.15.114:0/2493919975 learned_addr learned my addr 172.21.15.114:0/2493919975 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:37.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc1277fe640 1 --2- 172.21.15.114:0/2493919975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc12815d4e0 0x7fc12815eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc126ffd640 1 --2- 172.21.15.114:0/2493919975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1280d1be0 0x7fc1280b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc1267fc640 1 -- 172.21.15.114:0/2493919975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1280d1be0 msgr2=0x7fc1280b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc1267fc640 1 --2- 172.21.15.114:0/2493919975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1280d1be0 0x7fc1280b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc1267fc640 1 -- 172.21.15.114:0/2493919975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc12815d4e0 msgr2=0x7fc12815eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc1267fc640 1 --2- 172.21.15.114:0/2493919975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc12815d4e0 0x7fc12815eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc1267fc640 1 -- 172.21.15.114:0/2493919975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1200094d0 con 0x7fc12815d100 2023-11-04T01:43:37.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc1267fc640 1 --2- 172.21.15.114:0/2493919975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc12815d100 0x7fc128151350 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00c400 tx=0x7fc11c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:37.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.801+0000 7fc10f7fe640 1 -- 172.21.15.114:0/2493919975 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c0052d0 con 0x7fc12815d100 2023-11-04T01:43:37.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.802+0000 7fc10f7fe640 1 -- 172.21.15.114:0/2493919975 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c005430 con 0x7fc12815d100 2023-11-04T01:43:37.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.802+0000 7fc12d59e640 1 -- 172.21.15.114:0/2493919975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc118009a70 con 0x7fc12815d100 2023-11-04T01:43:37.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.802+0000 7fc10f7fe640 1 -- 172.21.15.114:0/2493919975 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c003830 con 0x7fc12815d100 2023-11-04T01:43:37.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.802+0000 7fc12d59e640 1 -- 172.21.15.114:0/2493919975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1280caa60 con 0x7fc12815d100 2023-11-04T01:43:37.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.802+0000 7fc12d59e640 1 -- 172.21.15.114:0/2493919975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1280684b0 con 0x7fc12815d100 2023-11-04T01:43:37.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.803+0000 7fc10f7fe640 1 -- 172.21.15.114:0/2493919975 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc11c003990 con 0x7fc12815d100 2023-11-04T01:43:37.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.803+0000 7fc10f7fe640 1 --2- 172.21.15.114:0/2493919975 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc11406ae70 0x7fc11406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.803+0000 7fc10f7fe640 1 -- 172.21.15.114:0/2493919975 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fc11c0893a0 con 0x7fc12815d100 2023-11-04T01:43:37.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.804+0000 7fc126ffd640 1 --2- 172.21.15.114:0/2493919975 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc11406ae70 0x7fc11406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.804+0000 7fc126ffd640 1 --2- 172.21.15.114:0/2493919975 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc11406ae70 0x7fc11406d330 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc118036000 tx=0x7fc118030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:37.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:37.808+0000 7fc10f7fe640 1 -- 172.21.15.114:0/2493919975 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc11c053c40 con 0x7fc12815d100 2023-11-04T01:43:38.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:38.043+0000 7fc12d59e640 1 -- 172.21.15.114:0/2493919975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7fc1280d2cd0 con 0x7fc12815d100 2023-11-04T01:43:38.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:38.683+0000 7fc10f7fe640 1 -- 172.21.15.114:0/2493919975 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.8514 v105) v1 ==== 112+0+0 (secure 0 0 0) 0x7fc11c0170a0 con 0x7fc12815d100 2023-11-04T01:43:38.685 INFO:teuthology.orchestra.run.smithi114.stderr:freezing mds.8514 2023-11-04T01:43:38.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:38.685+0000 7fc12d59e640 1 -- 172.21.15.114:0/2493919975 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc11406ae70 msgr2=0x7fc11406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:38.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:38.685+0000 7fc12d59e640 1 --2- 172.21.15.114:0/2493919975 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc11406ae70 0x7fc11406d330 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc118036000 tx=0x7fc118030000 comp rx=0 tx=0).stop 2023-11-04T01:43:38.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:38.685+0000 7fc12d59e640 1 -- 172.21.15.114:0/2493919975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc12815d100 msgr2=0x7fc128151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:38.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:38.685+0000 7fc12d59e640 1 --2- 172.21.15.114:0/2493919975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc12815d100 0x7fc128151350 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00c400 tx=0x7fc11c00c8c0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:38.685+0000 7fc12d59e640 1 -- 172.21.15.114:0/2493919975 shutdown_connections 2023-11-04T01:43:38.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:38.685+0000 7fc12d59e640 1 --2- 172.21.15.114:0/2493919975 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc11406ae70 0x7fc11406d330 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:38.685+0000 7fc12d59e640 1 --2- 172.21.15.114:0/2493919975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc12815d4e0 0x7fc12815eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:38.685+0000 7fc12d59e640 1 --2- 172.21.15.114:0/2493919975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc12815d100 0x7fc128151350 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:38.685+0000 7fc12d59e640 1 --2- 172.21.15.114:0/2493919975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1280d1be0 0x7fc1280b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:38.685+0000 7fc12d59e640 1 -- 172.21.15.114:0/2493919975 >> 172.21.15.114:0/2493919975 conn(0x7fc1280d2ef0 msgr2=0x7fc12815af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:38.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:38.685+0000 7fc12d59e640 1 -- 172.21.15.114:0/2493919975 shutdown_connections 2023-11-04T01:43:38.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:38.685+0000 7fc12d59e640 1 -- 172.21.15.114:0/2493919975 wait complete. 2023-11-04T01:43:38.699 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_kill_mdstable_at 6 2023-11-04T01:43:38.821 INFO:teuthology.orchestra.run.smithi141.stdout:{"success":"mds_kill_mdstable_at = '6' (not observed, change may require restart) "} 2023-11-04T01:43:38.821 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '6' (not observed, change may require restart) " } 2023-11-04T01:43:38.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:38.822 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s26) 2023-11-04T01:43:38.824 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:43:38.956 INFO:teuthology.orchestra.run.smithi114.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:43:38.956 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:43:38.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:39.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.053+0000 7f5eca51d640 1 Processor -- start 2023-11-04T01:43:39.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.053+0000 7f5eca51d640 1 -- start start 2023-11-04T01:43:39.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.054+0000 7f5eca51d640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5ec40ade00 0x7f5ec40b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.054+0000 7f5eca51d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ec406c5f0 0x7f5ec40cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.054+0000 7f5eca51d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec406cc90 con 0x7f5ec406d9c0 2023-11-04T01:43:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.054+0000 7f5eca51d640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec40b0e60 con 0x7f5ec40ade00 2023-11-04T01:43:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.054+0000 7f5eca51d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec406cee0 con 0x7f5ec406c5f0 2023-11-04T01:43:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.054+0000 7f5ec37fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5ec406d9c0 0x7f5ec40710d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58950/0 (socket says 172.21.15.114:58950) 2023-11-04T01:43:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.054+0000 7f5ec37fe640 1 -- 172.21.15.114:0/4242038869 learned_addr learned my addr 172.21.15.114:0/4242038869 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:43:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.054+0000 7f5ec8aba640 1 --2- 172.21.15.114:0/4242038869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ec406c5f0 0x7f5ec40cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.054+0000 7f5ec3fff640 1 --2- 172.21.15.114:0/4242038869 >> v2:172.21.15.141:3300/0 conn(0x7f5ec40ade00 0x7f5ec40b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.054+0000 7f5ec2ffd640 1 -- 172.21.15.114:0/4242038869 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767612794 0 0) 0x7f5ec406cc90 con 0x7f5ec406d9c0 2023-11-04T01:43:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.054+0000 7f5ec2ffd640 1 -- 172.21.15.114:0/4242038869 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eac003520 con 0x7f5ec406d9c0 2023-11-04T01:43:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.054+0000 7f5ec8aba640 1 -- 172.21.15.114:0/4242038869 >> v2:172.21.15.141:3300/0 conn(0x7f5ec40ade00 msgr2=0x7f5ec40b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.054+0000 7f5ec8aba640 1 --2- 172.21.15.114:0/4242038869 >> v2:172.21.15.141:3300/0 conn(0x7f5ec40ade00 0x7f5ec40b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.054+0000 7f5ec2ffd640 1 -- 172.21.15.114:0/4242038869 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3734943911 0 0) 0x7f5eac003520 con 0x7f5ec406d9c0 2023-11-04T01:43:39.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.054+0000 7f5ec8aba640 1 -- 172.21.15.114:0/4242038869 >> v1:172.21.15.114:6789/0 conn(0x7f5ec406d9c0 legacy=0x7f5ec40710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.054+0000 7f5ec8aba640 1 -- 172.21.15.114:0/4242038869 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec406d1c0 con 0x7f5ec406c5f0 2023-11-04T01:43:39.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.055+0000 7f5ec8aba640 1 --2- 172.21.15.114:0/4242038869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ec406c5f0 0x7f5ec40cc680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009d90 tx=0x7f5ebc02bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be71c034c23f7edc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.055+0000 7f5ec2ffd640 1 -- 172.21.15.114:0/4242038869 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8001670 con 0x7f5ec406c5f0 2023-11-04T01:43:39.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.055+0000 7f5ec2ffd640 1 -- 172.21.15.114:0/4242038869 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc02c780 con 0x7f5ec406c5f0 2023-11-04T01:43:39.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.055+0000 7f5ec2ffd640 1 -- 172.21.15.114:0/4242038869 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc02cb10 con 0x7f5ec406c5f0 2023-11-04T01:43:39.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.056+0000 7f5eca51d640 1 -- 172.21.15.114:0/4242038869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ec406c5f0 msgr2=0x7f5ec40cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.056+0000 7f5eca51d640 1 --2- 172.21.15.114:0/4242038869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ec406c5f0 0x7f5ec40cc680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009d90 tx=0x7f5ebc02bc50 comp rx=0 tx=0).stop 2023-11-04T01:43:39.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.056+0000 7f5eca51d640 1 -- 172.21.15.114:0/4242038869 shutdown_connections 2023-11-04T01:43:39.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.056+0000 7f5eca51d640 1 --2- 172.21.15.114:0/4242038869 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ec406c5f0 0x7f5ec40cc680 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.056+0000 7f5eca51d640 1 --2- 172.21.15.114:0/4242038869 >> v2:172.21.15.141:3300/0 conn(0x7f5ec40ade00 0x7f5ec40b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.056+0000 7f5eca51d640 1 -- 172.21.15.114:0/4242038869 >> 172.21.15.114:0/4242038869 conn(0x7f5ec40cb530 msgr2=0x7f5ec40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.056+0000 7f5eca51d640 1 -- 172.21.15.114:0/4242038869 shutdown_connections 2023-11-04T01:43:39.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.056+0000 7f5eca51d640 1 -- 172.21.15.114:0/4242038869 wait complete. 2023-11-04T01:43:39.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.057+0000 7f5eca51d640 1 Processor -- start 2023-11-04T01:43:39.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.057+0000 7f5eca51d640 1 -- start start 2023-11-04T01:43:39.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5eca51d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ec406c5f0 0x7f5ec4144830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5eca51d640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ec406d9c0 0x7f5ec40c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5eca51d640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ec40ade00 0x7f5ec4157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5eca51d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec40c82e0 con 0x7f5ec406c5f0 2023-11-04T01:43:39.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5eca51d640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec40c76d0 con 0x7f5ec406d9c0 2023-11-04T01:43:39.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5eca51d640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec40c79b0 con 0x7f5ec40ade00 2023-11-04T01:43:39.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5ec3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ec406c5f0 0x7f5ec4144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5ec3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ec406c5f0 0x7f5ec4144830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58578/0 (socket says 172.21.15.114:58578) 2023-11-04T01:43:39.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5ec3fff640 1 -- 172.21.15.114:0/2855630922 learned_addr learned my addr 172.21.15.114:0/2855630922 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:39.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5ec8aba640 1 --2- 172.21.15.114:0/2855630922 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ec40ade00 0x7f5ec4157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5ec37fe640 1 --2- 172.21.15.114:0/2855630922 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ec406d9c0 0x7f5ec40c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5ec3fff640 1 -- 172.21.15.114:0/2855630922 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ec40ade00 msgr2=0x7f5ec4157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5ec3fff640 1 --2- 172.21.15.114:0/2855630922 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ec40ade00 0x7f5ec4157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5ec3fff640 1 -- 172.21.15.114:0/2855630922 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ec406d9c0 msgr2=0x7f5ec40c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5ec3fff640 1 --2- 172.21.15.114:0/2855630922 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ec406d9c0 0x7f5ec40c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5ec3fff640 1 -- 172.21.15.114:0/2855630922 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc009a70 con 0x7f5ec406c5f0 2023-11-04T01:43:39.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5ec37fe640 1 --2- 172.21.15.114:0/2855630922 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ec406d9c0 0x7f5ec40c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:39.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.058+0000 7f5ec3fff640 1 --2- 172.21.15.114:0/2855630922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ec406c5f0 0x7f5ec4144830 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400e9b0 tx=0x7f5eb400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.059+0000 7f5ec0ff9640 1 -- 172.21.15.114:0/2855630922 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4009670 con 0x7f5ec406c5f0 2023-11-04T01:43:39.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.059+0000 7f5ec0ff9640 1 -- 172.21.15.114:0/2855630922 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb400c9a0 con 0x7f5ec406c5f0 2023-11-04T01:43:39.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.059+0000 7f5eca51d640 1 -- 172.21.15.114:0/2855630922 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec40c7c90 con 0x7f5ec406c5f0 2023-11-04T01:43:39.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.059+0000 7f5ec0ff9640 1 -- 172.21.15.114:0/2855630922 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb400cd50 con 0x7f5ec406c5f0 2023-11-04T01:43:39.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.059+0000 7f5eca51d640 1 -- 172.21.15.114:0/2855630922 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec4154ae0 con 0x7f5ec406c5f0 2023-11-04T01:43:39.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.060+0000 7f5eca51d640 1 -- 172.21.15.114:0/2855630922 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec40b3f80 con 0x7f5ec406c5f0 2023-11-04T01:43:39.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.060+0000 7f5ec0ff9640 1 -- 172.21.15.114:0/2855630922 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5eb4013470 con 0x7f5ec406c5f0 2023-11-04T01:43:39.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.060+0000 7f5ec0ff9640 1 --2- 172.21.15.114:0/2855630922 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5eb006ae70 0x7f5eb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.060+0000 7f5ec0ff9640 1 -- 172.21.15.114:0/2855630922 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f5eb4089fe0 con 0x7f5ec406c5f0 2023-11-04T01:43:39.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.060+0000 7f5ec37fe640 1 --2- 172.21.15.114:0/2855630922 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5eb006ae70 0x7f5eb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.061+0000 7f5ec37fe640 1 --2- 172.21.15.114:0/2855630922 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5eb006ae70 0x7f5eb006d330 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40adb00 tx=0x7f5eb8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.065+0000 7f5ec0ff9640 1 -- 172.21.15.114:0/2855630922 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5eb4054910 con 0x7f5ec406c5f0 2023-11-04T01:43:39.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.266+0000 7f5eca51d640 1 -- 172.21.15.114:0/2855630922 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ec40cb910 con 0x7f5ec406c5f0 2023-11-04T01:43:39.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.266+0000 7f5ec0ff9640 1 -- 172.21.15.114:0/2855630922 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4941 (secure 0 0 0) 0x7f5eb4017090 con 0x7f5ec406c5f0 2023-11-04T01:43:39.269 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:39.269 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":105,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:38.044279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":18,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:39.269 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 105 2023-11-04T01:43:39.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.268+0000 7f5eca51d640 1 -- 172.21.15.114:0/2855630922 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5eb006ae70 msgr2=0x7f5eb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.268+0000 7f5eca51d640 1 --2- 172.21.15.114:0/2855630922 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5eb006ae70 0x7f5eb006d330 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40adb00 tx=0x7f5eb8009040 comp rx=0 tx=0).stop 2023-11-04T01:43:39.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.268+0000 7f5eca51d640 1 -- 172.21.15.114:0/2855630922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ec406c5f0 msgr2=0x7f5ec4144830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.268+0000 7f5eca51d640 1 --2- 172.21.15.114:0/2855630922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ec406c5f0 0x7f5ec4144830 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400e9b0 tx=0x7f5eb400ee70 comp rx=0 tx=0).stop 2023-11-04T01:43:39.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.268+0000 7f5eca51d640 1 -- 172.21.15.114:0/2855630922 shutdown_connections 2023-11-04T01:43:39.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.268+0000 7f5eca51d640 1 --2- 172.21.15.114:0/2855630922 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5ec40ade00 0x7f5ec4157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.268+0000 7f5eca51d640 1 --2- 172.21.15.114:0/2855630922 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5eb006ae70 0x7f5eb006d330 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.268+0000 7f5eca51d640 1 --2- 172.21.15.114:0/2855630922 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5ec406d9c0 0x7f5ec40c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.269+0000 7f5eca51d640 1 --2- 172.21.15.114:0/2855630922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ec406c5f0 0x7f5ec4144830 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.269+0000 7f5eca51d640 1 -- 172.21.15.114:0/2855630922 >> 172.21.15.114:0/2855630922 conn(0x7f5ec40cb530 msgr2=0x7f5ec40cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.269+0000 7f5eca51d640 1 -- 172.21.15.114:0/2855630922 shutdown_connections 2023-11-04T01:43:39.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:39.269+0000 7f5eca51d640 1 -- 172.21.15.114:0/2855630922 wait complete. 2023-11-04T01:43:39.281 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:43.679 INFO:tasks.ceph.mds.b.smithi141.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f7023914640 time 2023-11-04T01:43:43.677759+0000 2023-11-04T01:43:43.679 INFO:tasks.ceph.mds.b.smithi141.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:43:43.679 INFO:tasks.ceph.mds.b.smithi141.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:43.679 INFO:tasks.ceph.mds.b.smithi141.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f702f56efaf] 2023-11-04T01:43:43.679 INFO:tasks.ceph.mds.b.smithi141.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f702f56f16d] 2023-11-04T01:43:43.679 INFO:tasks.ceph.mds.b.smithi141.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55c77812221b] 2023-11-04T01:43:43.679 INFO:tasks.ceph.mds.b.smithi141.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55c778151bcc] 2023-11-04T01:43:43.679 INFO:tasks.ceph.mds.b.smithi141.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55c77815ab0c] 2023-11-04T01:43:43.680 INFO:tasks.ceph.mds.b.smithi141.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55c77815ac63] 2023-11-04T01:43:43.680 INFO:tasks.ceph.mds.b.smithi141.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f702f6164a5] 2023-11-04T01:43:43.680 INFO:tasks.ceph.mds.b.smithi141.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f702ec9f802] 2023-11-04T01:43:43.680 INFO:tasks.ceph.mds.b.smithi141.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f702ec3f450] 2023-11-04T01:43:43.680 INFO:tasks.ceph.mds.b.smithi141.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:43:43.680 INFO:tasks.ceph.mds.b.smithi141.stderr: in thread 7f7023914640 thread_name:MR_Finisher 2023-11-04T01:43:43.680 INFO:tasks.ceph.mds.b.smithi141.stderr:2023-11-04T01:43:43.676+0000 7f7023914640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f7023914640 time 2023-11-04T01:43:43.677759+0000 2023-11-04T01:43:43.680 INFO:tasks.ceph.mds.b.smithi141.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:43:43.680 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:43:43.680 INFO:tasks.ceph.mds.b.smithi141.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:43.680 INFO:tasks.ceph.mds.b.smithi141.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f702f56efaf] 2023-11-04T01:43:43.681 INFO:tasks.ceph.mds.b.smithi141.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f702f56f16d] 2023-11-04T01:43:43.681 INFO:tasks.ceph.mds.b.smithi141.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55c77812221b] 2023-11-04T01:43:43.681 INFO:tasks.ceph.mds.b.smithi141.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55c778151bcc] 2023-11-04T01:43:43.681 INFO:tasks.ceph.mds.b.smithi141.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55c77815ab0c] 2023-11-04T01:43:43.681 INFO:tasks.ceph.mds.b.smithi141.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55c77815ac63] 2023-11-04T01:43:43.681 INFO:tasks.ceph.mds.b.smithi141.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f702f6164a5] 2023-11-04T01:43:43.681 INFO:tasks.ceph.mds.b.smithi141.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f702ec9f802] 2023-11-04T01:43:43.681 INFO:tasks.ceph.mds.b.smithi141.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f702ec3f450] 2023-11-04T01:43:43.681 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:43:43.681 INFO:tasks.ceph.mds.b.smithi141.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:43.681 INFO:tasks.ceph.mds.b.smithi141.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f702ec54db0] 2023-11-04T01:43:43.681 INFO:tasks.ceph.mds.b.smithi141.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f702eca154c] 2023-11-04T01:43:43.682 INFO:tasks.ceph.mds.b.smithi141.stderr: 3: raise() 2023-11-04T01:43:43.682 INFO:tasks.ceph.mds.b.smithi141.stderr: 4: abort() 2023-11-04T01:43:43.682 INFO:tasks.ceph.mds.b.smithi141.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f702f56f009] 2023-11-04T01:43:43.682 INFO:tasks.ceph.mds.b.smithi141.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f702f56f16d] 2023-11-04T01:43:43.682 INFO:tasks.ceph.mds.b.smithi141.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55c77812221b] 2023-11-04T01:43:43.682 INFO:tasks.ceph.mds.b.smithi141.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55c778151bcc] 2023-11-04T01:43:43.682 INFO:tasks.ceph.mds.b.smithi141.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55c77815ab0c] 2023-11-04T01:43:43.682 INFO:tasks.ceph.mds.b.smithi141.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55c77815ac63] 2023-11-04T01:43:43.682 INFO:tasks.ceph.mds.b.smithi141.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f702f6164a5] 2023-11-04T01:43:43.682 INFO:tasks.ceph.mds.b.smithi141.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f702ec9f802] 2023-11-04T01:43:43.682 INFO:tasks.ceph.mds.b.smithi141.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f702ec3f450] 2023-11-04T01:43:43.683 INFO:tasks.ceph.mds.b.smithi141.stderr:2023-11-04T01:43:43.677+0000 7f7023914640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:43:43.683 INFO:tasks.ceph.mds.b.smithi141.stderr: in thread 7f7023914640 thread_name:MR_Finisher 2023-11-04T01:43:43.683 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:43:43.683 INFO:tasks.ceph.mds.b.smithi141.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:43.683 INFO:tasks.ceph.mds.b.smithi141.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f702ec54db0] 2023-11-04T01:43:43.683 INFO:tasks.ceph.mds.b.smithi141.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f702eca154c] 2023-11-04T01:43:43.683 INFO:tasks.ceph.mds.b.smithi141.stderr: 3: raise() 2023-11-04T01:43:43.683 INFO:tasks.ceph.mds.b.smithi141.stderr: 4: abort() 2023-11-04T01:43:43.683 INFO:tasks.ceph.mds.b.smithi141.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f702f56f009] 2023-11-04T01:43:43.683 INFO:tasks.ceph.mds.b.smithi141.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f702f56f16d] 2023-11-04T01:43:43.683 INFO:tasks.ceph.mds.b.smithi141.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55c77812221b] 2023-11-04T01:43:43.683 INFO:tasks.ceph.mds.b.smithi141.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55c778151bcc] 2023-11-04T01:43:43.684 INFO:tasks.ceph.mds.b.smithi141.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55c77815ab0c] 2023-11-04T01:43:43.684 INFO:tasks.ceph.mds.b.smithi141.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55c77815ac63] 2023-11-04T01:43:43.684 INFO:tasks.ceph.mds.b.smithi141.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f702f6164a5] 2023-11-04T01:43:43.684 INFO:tasks.ceph.mds.b.smithi141.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f702ec9f802] 2023-11-04T01:43:43.684 INFO:tasks.ceph.mds.b.smithi141.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f702ec3f450] 2023-11-04T01:43:43.684 INFO:tasks.ceph.mds.b.smithi141.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:43:43.684 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:43:43.684 INFO:tasks.ceph.mds.b.smithi141.stderr: -790> 2023-11-04T01:43:34.587+0000 7f702711b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:43.684 INFO:tasks.ceph.mds.b.smithi141.stderr: -788> 2023-11-04T01:43:34.587+0000 7f702711b640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:43:43.685 INFO:tasks.ceph.mds.b.smithi141.stderr: -1> 2023-11-04T01:43:43.676+0000 7f7023914640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f7023914640 time 2023-11-04T01:43:43.677759+0000 2023-11-04T01:43:43.685 INFO:tasks.ceph.mds.b.smithi141.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:43:43.685 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:43:43.685 INFO:tasks.ceph.mds.b.smithi141.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:43.685 INFO:tasks.ceph.mds.b.smithi141.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f702f56efaf] 2023-11-04T01:43:43.685 INFO:tasks.ceph.mds.b.smithi141.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f702f56f16d] 2023-11-04T01:43:43.685 INFO:tasks.ceph.mds.b.smithi141.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55c77812221b] 2023-11-04T01:43:43.685 INFO:tasks.ceph.mds.b.smithi141.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55c778151bcc] 2023-11-04T01:43:43.685 INFO:tasks.ceph.mds.b.smithi141.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55c77815ab0c] 2023-11-04T01:43:43.686 INFO:tasks.ceph.mds.b.smithi141.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55c77815ac63] 2023-11-04T01:43:43.686 INFO:tasks.ceph.mds.b.smithi141.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f702f6164a5] 2023-11-04T01:43:43.686 INFO:tasks.ceph.mds.b.smithi141.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f702ec9f802] 2023-11-04T01:43:43.686 INFO:tasks.ceph.mds.b.smithi141.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f702ec3f450] 2023-11-04T01:43:43.686 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:43:43.686 INFO:tasks.ceph.mds.b.smithi141.stderr: 0> 2023-11-04T01:43:43.677+0000 7f7023914640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:43:43.686 INFO:tasks.ceph.mds.b.smithi141.stderr: in thread 7f7023914640 thread_name:MR_Finisher 2023-11-04T01:43:43.686 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:43:43.686 INFO:tasks.ceph.mds.b.smithi141.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:43.686 INFO:tasks.ceph.mds.b.smithi141.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f702ec54db0] 2023-11-04T01:43:43.686 INFO:tasks.ceph.mds.b.smithi141.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f702eca154c] 2023-11-04T01:43:43.686 INFO:tasks.ceph.mds.b.smithi141.stderr: 3: raise() 2023-11-04T01:43:43.686 INFO:tasks.ceph.mds.b.smithi141.stderr: 4: abort() 2023-11-04T01:43:43.687 INFO:tasks.ceph.mds.b.smithi141.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f702f56f009] 2023-11-04T01:43:43.687 INFO:tasks.ceph.mds.b.smithi141.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f702f56f16d] 2023-11-04T01:43:43.687 INFO:tasks.ceph.mds.b.smithi141.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55c77812221b] 2023-11-04T01:43:43.687 INFO:tasks.ceph.mds.b.smithi141.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55c778151bcc] 2023-11-04T01:43:43.687 INFO:tasks.ceph.mds.b.smithi141.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55c77815ab0c] 2023-11-04T01:43:43.687 INFO:tasks.ceph.mds.b.smithi141.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55c77815ac63] 2023-11-04T01:43:43.687 INFO:tasks.ceph.mds.b.smithi141.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f702f6164a5] 2023-11-04T01:43:43.687 INFO:tasks.ceph.mds.b.smithi141.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f702ec9f802] 2023-11-04T01:43:43.687 INFO:tasks.ceph.mds.b.smithi141.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f702ec3f450] 2023-11-04T01:43:43.687 INFO:tasks.ceph.mds.b.smithi141.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:43:43.687 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:43:43.689 INFO:tasks.ceph.mds.b.smithi141.stderr: -793> 2023-11-04T01:43:34.587+0000 7f702711b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:43.689 INFO:tasks.ceph.mds.b.smithi141.stderr: -791> 2023-11-04T01:43:34.587+0000 7f702711b640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:43:43.690 INFO:tasks.ceph.mds.b.smithi141.stderr: -4> 2023-11-04T01:43:43.676+0000 7f7023914640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f7023914640 time 2023-11-04T01:43:43.677759+0000 2023-11-04T01:43:43.690 INFO:tasks.ceph.mds.b.smithi141.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:43:43.690 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:43:43.690 INFO:tasks.ceph.mds.b.smithi141.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:43.690 INFO:tasks.ceph.mds.b.smithi141.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f702f56efaf] 2023-11-04T01:43:43.690 INFO:tasks.ceph.mds.b.smithi141.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f702f56f16d] 2023-11-04T01:43:43.690 INFO:tasks.ceph.mds.b.smithi141.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55c77812221b] 2023-11-04T01:43:43.690 INFO:tasks.ceph.mds.b.smithi141.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55c778151bcc] 2023-11-04T01:43:43.690 INFO:tasks.ceph.mds.b.smithi141.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55c77815ab0c] 2023-11-04T01:43:43.690 INFO:tasks.ceph.mds.b.smithi141.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55c77815ac63] 2023-11-04T01:43:43.690 INFO:tasks.ceph.mds.b.smithi141.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f702f6164a5] 2023-11-04T01:43:43.691 INFO:tasks.ceph.mds.b.smithi141.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f702ec9f802] 2023-11-04T01:43:43.691 INFO:tasks.ceph.mds.b.smithi141.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f702ec3f450] 2023-11-04T01:43:43.691 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:43:43.691 INFO:tasks.ceph.mds.b.smithi141.stderr: -3> 2023-11-04T01:43:43.677+0000 7f7023914640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:43:43.691 INFO:tasks.ceph.mds.b.smithi141.stderr: in thread 7f7023914640 thread_name:MR_Finisher 2023-11-04T01:43:43.691 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:43:43.691 INFO:tasks.ceph.mds.b.smithi141.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:43.691 INFO:tasks.ceph.mds.b.smithi141.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f702ec54db0] 2023-11-04T01:43:43.691 INFO:tasks.ceph.mds.b.smithi141.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f702eca154c] 2023-11-04T01:43:43.691 INFO:tasks.ceph.mds.b.smithi141.stderr: 3: raise() 2023-11-04T01:43:43.691 INFO:tasks.ceph.mds.b.smithi141.stderr: 4: abort() 2023-11-04T01:43:43.692 INFO:tasks.ceph.mds.b.smithi141.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f702f56f009] 2023-11-04T01:43:43.692 INFO:tasks.ceph.mds.b.smithi141.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f702f56f16d] 2023-11-04T01:43:43.692 INFO:tasks.ceph.mds.b.smithi141.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55c77812221b] 2023-11-04T01:43:43.692 INFO:tasks.ceph.mds.b.smithi141.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55c778151bcc] 2023-11-04T01:43:43.692 INFO:tasks.ceph.mds.b.smithi141.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55c77815ab0c] 2023-11-04T01:43:43.692 INFO:tasks.ceph.mds.b.smithi141.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55c77815ac63] 2023-11-04T01:43:43.692 INFO:tasks.ceph.mds.b.smithi141.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f702f6164a5] 2023-11-04T01:43:43.692 INFO:tasks.ceph.mds.b.smithi141.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f702ec9f802] 2023-11-04T01:43:43.692 INFO:tasks.ceph.mds.b.smithi141.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f702ec3f450] 2023-11-04T01:43:43.692 INFO:tasks.ceph.mds.b.smithi141.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:43:43.692 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:43:43.957 INFO:tasks.ceph.mds.b.smithi141.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:43:44.282 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:44.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.392+0000 7f5dc7325640 1 Processor -- start 2023-11-04T01:43:44.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.392+0000 7f5dc7325640 1 -- start start 2023-11-04T01:43:44.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.393+0000 7f5dc7325640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f5dc00cc680 0x7f5dc00cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.393+0000 7f5dc7325640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc00cd720 con 0x7f5dc006c220 2023-11-04T01:43:44.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.393+0000 7f5dc7325640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc00ae1b0 con 0x7f5dc00addd0 2023-11-04T01:43:44.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.393+0000 7f5dc7325640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc00ccb10 con 0x7f5dc00cc680 2023-11-04T01:43:44.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.393+0000 7f5dc58c2640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5dc006c220 0x7f5dc006f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58956/0 (socket says 172.21.15.114:58956) 2023-11-04T01:43:44.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.393+0000 7f5dc58c2640 1 -- 172.21.15.114:0/4259434296 learned_addr learned my addr 172.21.15.114:0/4259434296 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:43:44.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.393+0000 7f5db7fff640 1 -- 172.21.15.114:0/4259434296 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432957197 0 0) 0x7f5dc00cd720 con 0x7f5dc006c220 2023-11-04T01:43:44.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.393+0000 7f5db7fff640 1 -- 172.21.15.114:0/4259434296 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dac003520 con 0x7f5dc006c220 2023-11-04T01:43:44.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.393+0000 7f5dc48c0640 1 --2- 172.21.15.114:0/4259434296 >> v2:172.21.15.141:3300/0 conn(0x7f5dc00cc680 0x7f5dc00cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.393+0000 7f5db7fff640 1 -- 172.21.15.114:0/4259434296 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3829409907 0 0) 0x7f5dac003520 con 0x7f5dc006c220 2023-11-04T01:43:44.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.393+0000 7f5db7fff640 1 -- 172.21.15.114:0/4259434296 >> v2:172.21.15.141:3300/0 conn(0x7f5dc00cc680 msgr2=0x7f5dc00cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:44.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.393+0000 7f5db7fff640 1 --2- 172.21.15.114:0/4259434296 >> v2:172.21.15.141:3300/0 conn(0x7f5dc00cc680 0x7f5dc00cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.393+0000 7f5db7fff640 1 -- 172.21.15.114:0/4259434296 >> v1:172.21.15.141:6789/0 conn(0x7f5dc00addd0 legacy=0x7f5dc006bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5db7fff640 1 -- 172.21.15.114:0/4259434296 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc00ccdf0 con 0x7f5dc006c220 2023-11-04T01:43:44.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5db7fff640 1 -- 172.21.15.114:0/4259434296 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f5db80019f0 con 0x7f5dc006c220 2023-11-04T01:43:44.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5db7fff640 1 -- 172.21.15.114:0/4259434296 >> v1:172.21.15.114:6789/0 conn(0x7f5dc006c220 legacy=0x7f5dc006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5db7fff640 1 --2- 172.21.15.114:0/4259434296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dac003970 0x7f5dac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5db7fff640 1 --2- 172.21.15.114:0/4259434296 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dac0047c0 0x7f5dac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5db7fff640 1 --2- 172.21.15.114:0/4259434296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dac005180 0x7f5dac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5db7fff640 1 -- 172.21.15.114:0/4259434296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc00ccb10 con 0x7f5dac003970 2023-11-04T01:43:44.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5db7fff640 1 -- 172.21.15.114:0/4259434296 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac00c0d0 con 0x7f5dac0047c0 2023-11-04T01:43:44.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5db7fff640 1 -- 172.21.15.114:0/4259434296 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac00c290 con 0x7f5dac005180 2023-11-04T01:43:44.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5dc50c1640 1 --2- 172.21.15.114:0/4259434296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dac003970 0x7f5dac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5dc48c0640 1 --2- 172.21.15.114:0/4259434296 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dac0047c0 0x7f5dac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5dc58c2640 1 --2- 172.21.15.114:0/4259434296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dac005180 0x7f5dac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5dc50c1640 1 -- 172.21.15.114:0/4259434296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dac005180 msgr2=0x7f5dac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:44.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5dc50c1640 1 --2- 172.21.15.114:0/4259434296 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dac005180 0x7f5dac00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5dc50c1640 1 -- 172.21.15.114:0/4259434296 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dac0047c0 msgr2=0x7f5dac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:44.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5dc50c1640 1 --2- 172.21.15.114:0/4259434296 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dac0047c0 0x7f5dac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5dc50c1640 1 -- 172.21.15.114:0/4259434296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac003520 con 0x7f5dac003970 2023-11-04T01:43:44.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.394+0000 7f5dc58c2640 1 -- 172.21.15.114:0/4259434296 reap_dead start 2023-11-04T01:43:44.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.395+0000 7f5dc50c1640 1 --2- 172.21.15.114:0/4259434296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dac003970 0x7f5dac003d90 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc001750 tx=0x7f5dac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3776d1c9d5b3be95 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.395+0000 7f5db7fff640 1 -- 172.21.15.114:0/4259434296 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc0052d0 con 0x7f5dac003970 2023-11-04T01:43:44.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.395+0000 7f5db7fff640 1 -- 172.21.15.114:0/4259434296 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc02e050 con 0x7f5dac003970 2023-11-04T01:43:44.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.395+0000 7f5db7fff640 1 -- 172.21.15.114:0/4259434296 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc003830 con 0x7f5dac003970 2023-11-04T01:43:44.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.395+0000 7f5dc7325640 1 -- 172.21.15.114:0/4259434296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dac003970 msgr2=0x7f5dac003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.395+0000 7f5dc7325640 1 --2- 172.21.15.114:0/4259434296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dac003970 0x7f5dac003d90 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc001750 tx=0x7f5dac0057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.395+0000 7f5dc7325640 1 -- 172.21.15.114:0/4259434296 shutdown_connections 2023-11-04T01:43:44.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.395+0000 7f5dc7325640 1 --2- 172.21.15.114:0/4259434296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dac003970 0x7f5dac003d90 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.396+0000 7f5dc7325640 1 -- 172.21.15.114:0/4259434296 >> 172.21.15.114:0/4259434296 conn(0x7f5dc00cb530 msgr2=0x7f5dc00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:44.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.396+0000 7f5dc7325640 1 -- 172.21.15.114:0/4259434296 shutdown_connections 2023-11-04T01:43:44.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.396+0000 7f5dc7325640 1 -- 172.21.15.114:0/4259434296 wait complete. 2023-11-04T01:43:44.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.397+0000 7f5dc7325640 1 Processor -- start 2023-11-04T01:43:44.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.397+0000 7f5dc7325640 1 -- start start 2023-11-04T01:43:44.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.397+0000 7f5dc7325640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dac003970 0x7f5dc00b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.397+0000 7f5dc7325640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dc00c5b80 0x7f5dc01f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.397+0000 7f5dc7325640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dc0147a90 0x7f5dc00c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.397+0000 7f5dc7325640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc00c6040 con 0x7f5dc00c5b80 2023-11-04T01:43:44.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.397+0000 7f5dc7325640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc00c6320 con 0x7f5dac003970 2023-11-04T01:43:44.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.397+0000 7f5dc7325640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc00c6600 con 0x7f5dc0147a90 2023-11-04T01:43:44.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5dc48c0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dc00c5b80 0x7f5dc01f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5dc48c0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dc00c5b80 0x7f5dc01f68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58584/0 (socket says 172.21.15.114:58584) 2023-11-04T01:43:44.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5dc48c0640 1 -- 172.21.15.114:0/614171710 learned_addr learned my addr 172.21.15.114:0/614171710 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:44.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5dc58c2640 1 --2- 172.21.15.114:0/614171710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dc0147a90 0x7f5dc00c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5dc50c1640 1 --2- 172.21.15.114:0/614171710 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dac003970 0x7f5dc00b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5dc48c0640 1 -- 172.21.15.114:0/614171710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dc0147a90 msgr2=0x7f5dc00c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5dc48c0640 1 --2- 172.21.15.114:0/614171710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dc0147a90 0x7f5dc00c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5dc48c0640 1 -- 172.21.15.114:0/614171710 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dac003970 msgr2=0x7f5dc00b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5dc48c0640 1 --2- 172.21.15.114:0/614171710 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dac003970 0x7f5dc00b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5dc48c0640 1 -- 172.21.15.114:0/614171710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc00c68e0 con 0x7f5dc00c5b80 2023-11-04T01:43:44.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5dc50c1640 1 --2- 172.21.15.114:0/614171710 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dac003970 0x7f5dc00b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:44.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5dc58c2640 1 --2- 172.21.15.114:0/614171710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dc0147a90 0x7f5dc00c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:44.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5dc48c0640 1 --2- 172.21.15.114:0/614171710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dc00c5b80 0x7f5dc01f68e0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f5db000b7f0 tx=0x7f5db000bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5db5ffb640 1 -- 172.21.15.114:0/614171710 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db0010830 con 0x7f5dc00c5b80 2023-11-04T01:43:44.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5db5ffb640 1 -- 172.21.15.114:0/614171710 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db0010990 con 0x7f5dc00c5b80 2023-11-04T01:43:44.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5dc7325640 1 -- 172.21.15.114:0/614171710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc00c6bc0 con 0x7f5dc00c5b80 2023-11-04T01:43:44.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5db5ffb640 1 -- 172.21.15.114:0/614171710 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db0010d20 con 0x7f5dc00c5b80 2023-11-04T01:43:44.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.398+0000 7f5dc7325640 1 -- 172.21.15.114:0/614171710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc014cd70 con 0x7f5dc00c5b80 2023-11-04T01:43:44.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.399+0000 7f5dc7325640 1 -- 172.21.15.114:0/614171710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc00684b0 con 0x7f5dc00c5b80 2023-11-04T01:43:44.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.400+0000 7f5db5ffb640 1 -- 172.21.15.114:0/614171710 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5db0014430 con 0x7f5dc00c5b80 2023-11-04T01:43:44.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.400+0000 7f5db5ffb640 1 --2- 172.21.15.114:0/614171710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5da406aea0 0x7f5da406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.400+0000 7f5db5ffb640 1 -- 172.21.15.114:0/614171710 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f5db008a4a0 con 0x7f5dc00c5b80 2023-11-04T01:43:44.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.400+0000 7f5dc50c1640 1 --2- 172.21.15.114:0/614171710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5da406aea0 0x7f5da406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.401+0000 7f5dc50c1640 1 --2- 172.21.15.114:0/614171710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5da406aea0 0x7f5da406d360 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc033000 tx=0x7f5dbc009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.405+0000 7f5db5ffb640 1 -- 172.21.15.114:0/614171710 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5db0054c90 con 0x7f5dc00c5b80 2023-11-04T01:43:44.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.606+0000 7f5dc7325640 1 -- 172.21.15.114:0/614171710 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5dc00b4a30 con 0x7f5dc00c5b80 2023-11-04T01:43:44.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.607+0000 7f5db5ffb640 1 -- 172.21.15.114:0/614171710 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4941 (secure 0 0 0) 0x7f5db0022090 con 0x7f5dc00c5b80 2023-11-04T01:43:44.609 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:44.609 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":105,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:38.044279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":18,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:44.609 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 105 2023-11-04T01:43:44.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.609+0000 7f5dc7325640 1 -- 172.21.15.114:0/614171710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5da406aea0 msgr2=0x7f5da406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.609+0000 7f5dc7325640 1 --2- 172.21.15.114:0/614171710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5da406aea0 0x7f5da406d360 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc033000 tx=0x7f5dbc009030 comp rx=0 tx=0).stop 2023-11-04T01:43:44.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.609+0000 7f5dc7325640 1 -- 172.21.15.114:0/614171710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dc00c5b80 msgr2=0x7f5dc01f68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.609+0000 7f5dc7325640 1 --2- 172.21.15.114:0/614171710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dc00c5b80 0x7f5dc01f68e0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f5db000b7f0 tx=0x7f5db000bcb0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.609+0000 7f5dc7325640 1 -- 172.21.15.114:0/614171710 shutdown_connections 2023-11-04T01:43:44.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.609+0000 7f5dc7325640 1 --2- 172.21.15.114:0/614171710 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f5dc0147a90 0x7f5dc00c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.609+0000 7f5dc7325640 1 --2- 172.21.15.114:0/614171710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dc00c5b80 0x7f5dc01f68e0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.609+0000 7f5dc7325640 1 --2- 172.21.15.114:0/614171710 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f5da406aea0 0x7f5da406d360 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.609+0000 7f5dc7325640 1 --2- 172.21.15.114:0/614171710 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f5dac003970 0x7f5dc00b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.609+0000 7f5dc7325640 1 -- 172.21.15.114:0/614171710 >> 172.21.15.114:0/614171710 conn(0x7f5dc00cb530 msgr2=0x7f5dc014dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:44.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.609+0000 7f5dc7325640 1 -- 172.21.15.114:0/614171710 shutdown_connections 2023-11-04T01:43:44.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:44.609+0000 7f5dc7325640 1 -- 172.21.15.114:0/614171710 wait complete. 2023-11-04T01:43:44.621 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:44.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-04T01:43:49.623 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:49.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.734+0000 7fc8fc8fc640 1 Processor -- start 2023-11-04T01:43:49.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.734+0000 7fc8fc8fc640 1 -- start start 2023-11-04T01:43:49.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.735+0000 7fc8fc8fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc8f80ade00 0x7fc8f80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.735+0000 7fc8fc8fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc8f806c5f0 0x7fc8f80cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.735+0000 7fc8fc8fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f806cc90 con 0x7fc8f806d9c0 2023-11-04T01:43:49.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.735+0000 7fc8fc8fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f80b0e60 con 0x7fc8f806c5f0 2023-11-04T01:43:49.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.735+0000 7fc8fc8fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f806cee0 con 0x7fc8f80ade00 2023-11-04T01:43:49.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.735+0000 7fc8f6d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc8f806c5f0 0x7fc8f80cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.735+0000 7fc8f6d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc8f806c5f0 0x7fc8f80cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39306/0 (socket says 172.21.15.114:39306) 2023-11-04T01:43:49.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.735+0000 7fc8f6d9d640 1 -- 172.21.15.114:0/2636214300 learned_addr learned my addr 172.21.15.114:0/2636214300 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:49.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.735+0000 7fc8f659c640 1 --2- 172.21.15.114:0/2636214300 >> v2:172.21.15.141:3300/0 conn(0x7fc8f80ade00 0x7fc8f80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.735+0000 7fc8f6d9d640 1 -- 172.21.15.114:0/2636214300 >> v2:172.21.15.141:3300/0 conn(0x7fc8f80ade00 msgr2=0x7fc8f80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:49.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.735+0000 7fc8f6d9d640 1 --2- 172.21.15.114:0/2636214300 >> v2:172.21.15.141:3300/0 conn(0x7fc8f80ade00 0x7fc8f80b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.735+0000 7fc8f6d9d640 1 -- 172.21.15.114:0/2636214300 >> v1:172.21.15.141:6789/0 conn(0x7fc8f806d9c0 legacy=0x7fc8f80710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:49.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.735+0000 7fc8f6d9d640 1 -- 172.21.15.114:0/2636214300 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f806d1c0 con 0x7fc8f806c5f0 2023-11-04T01:43:49.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.736+0000 7fc8f6d9d640 1 --2- 172.21.15.114:0/2636214300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f806c5f0 0x7fc8f80cc680 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80cb430 tx=0x7fc8f002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0718da65c75add server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.736+0000 7fc8f5d9b640 1 -- 172.21.15.114:0/2636214300 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f002c960 con 0x7fc8f806c5f0 2023-11-04T01:43:49.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.736+0000 7fc8f5d9b640 1 -- 172.21.15.114:0/2636214300 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f002cac0 con 0x7fc8f806c5f0 2023-11-04T01:43:49.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.736+0000 7fc8f5d9b640 1 -- 172.21.15.114:0/2636214300 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f002ce50 con 0x7fc8f806c5f0 2023-11-04T01:43:49.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.737+0000 7fc8fc8fc640 1 -- 172.21.15.114:0/2636214300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f806c5f0 msgr2=0x7fc8f80cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.737+0000 7fc8fc8fc640 1 --2- 172.21.15.114:0/2636214300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f806c5f0 0x7fc8f80cc680 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80cb430 tx=0x7fc8f002bdc0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.737+0000 7fc8fc8fc640 1 -- 172.21.15.114:0/2636214300 shutdown_connections 2023-11-04T01:43:49.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.737+0000 7fc8fc8fc640 1 --2- 172.21.15.114:0/2636214300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f806c5f0 0x7fc8f80cc680 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.737+0000 7fc8fc8fc640 1 --2- 172.21.15.114:0/2636214300 >> v2:172.21.15.141:3300/0 conn(0x7fc8f80ade00 0x7fc8f80b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.737+0000 7fc8fc8fc640 1 -- 172.21.15.114:0/2636214300 >> 172.21.15.114:0/2636214300 conn(0x7fc8f80cb530 msgr2=0x7fc8f80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.737+0000 7fc8fc8fc640 1 -- 172.21.15.114:0/2636214300 shutdown_connections 2023-11-04T01:43:49.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.737+0000 7fc8fc8fc640 1 -- 172.21.15.114:0/2636214300 wait complete. 2023-11-04T01:43:49.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.738+0000 7fc8fc8fc640 1 Processor -- start 2023-11-04T01:43:49.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.738+0000 7fc8fc8fc640 1 -- start start 2023-11-04T01:43:49.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.739+0000 7fc8fc8fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8f806c5f0 0x7fc8f814e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.739+0000 7fc8fc8fc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8f806d9c0 0x7fc8f81f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.739+0000 7fc8fc8fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f80ade00 0x7fc8f81f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.739+0000 7fc8fc8fc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f81572c0 con 0x7fc8f80ade00 2023-11-04T01:43:49.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.739+0000 7fc8fc8fc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80c7530 con 0x7fc8f806d9c0 2023-11-04T01:43:49.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.739+0000 7fc8fc8fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80c8560 con 0x7fc8f806c5f0 2023-11-04T01:43:49.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.739+0000 7fc8f6d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f80ade00 0x7fc8f81f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.739+0000 7fc8f6d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f80ade00 0x7fc8f81f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39322/0 (socket says 172.21.15.114:39322) 2023-11-04T01:43:49.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.739+0000 7fc8f6d9d640 1 -- 172.21.15.114:0/2705481548 learned_addr learned my addr 172.21.15.114:0/2705481548 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:49.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.739+0000 7fc8effff640 1 --2- 172.21.15.114:0/2705481548 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8f806d9c0 0x7fc8f81f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.739+0000 7fc8f659c640 1 --2- 172.21.15.114:0/2705481548 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8f806c5f0 0x7fc8f814e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.740+0000 7fc8f6d9d640 1 -- 172.21.15.114:0/2705481548 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8f806c5f0 msgr2=0x7fc8f814e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.740+0000 7fc8f6d9d640 1 --2- 172.21.15.114:0/2705481548 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8f806c5f0 0x7fc8f814e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.740+0000 7fc8f6d9d640 1 -- 172.21.15.114:0/2705481548 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8f806d9c0 msgr2=0x7fc8f81f4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.740+0000 7fc8f6d9d640 1 --2- 172.21.15.114:0/2705481548 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8f806d9c0 0x7fc8f81f4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.740+0000 7fc8f6d9d640 1 -- 172.21.15.114:0/2705481548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f0009b30 con 0x7fc8f80ade00 2023-11-04T01:43:49.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.740+0000 7fc8f6d9d640 1 --2- 172.21.15.114:0/2705481548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f80ade00 0x7fc8f81f4680 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0036040 tx=0x7fc8f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.740+0000 7fc8eeffd640 1 -- 172.21.15.114:0/2705481548 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0009510 con 0x7fc8f80ade00 2023-11-04T01:43:49.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.740+0000 7fc8eeffd640 1 -- 172.21.15.114:0/2705481548 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f003e450 con 0x7fc8f80ade00 2023-11-04T01:43:49.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.740+0000 7fc8fc8fc640 1 -- 172.21.15.114:0/2705481548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f80c8840 con 0x7fc8f80ade00 2023-11-04T01:43:49.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.740+0000 7fc8eeffd640 1 -- 172.21.15.114:0/2705481548 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f003e7e0 con 0x7fc8f80ade00 2023-11-04T01:43:49.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.740+0000 7fc8fc8fc640 1 -- 172.21.15.114:0/2705481548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f8156ac0 con 0x7fc8f80ade00 2023-11-04T01:43:49.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.741+0000 7fc8fc8fc640 1 -- 172.21.15.114:0/2705481548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f80684b0 con 0x7fc8f80ade00 2023-11-04T01:43:49.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.741+0000 7fc8eeffd640 1 -- 172.21.15.114:0/2705481548 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc8f003e940 con 0x7fc8f80ade00 2023-11-04T01:43:49.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.742+0000 7fc8eeffd640 1 --2- 172.21.15.114:0/2705481548 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8d806ae70 0x7fc8d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.742+0000 7fc8f659c640 1 --2- 172.21.15.114:0/2705481548 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8d806ae70 0x7fc8d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.742+0000 7fc8eeffd640 1 -- 172.21.15.114:0/2705481548 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fc8f00ace60 con 0x7fc8f80ade00 2023-11-04T01:43:49.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.742+0000 7fc8f659c640 1 --2- 172.21.15.114:0/2705481548 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8d806ae70 0x7fc8d806d330 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80079a0 tx=0x7fc8e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.746+0000 7fc8eeffd640 1 -- 172.21.15.114:0/2705481548 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc8f0077820 con 0x7fc8f80ade00 2023-11-04T01:43:49.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.947+0000 7fc8fc8fc640 1 -- 172.21.15.114:0/2705481548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8f8157d70 con 0x7fc8f80ade00 2023-11-04T01:43:49.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.948+0000 7fc8eeffd640 1 -- 172.21.15.114:0/2705481548 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4941 (secure 0 0 0) 0x7fc8f0043090 con 0x7fc8f80ade00 2023-11-04T01:43:49.950 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:49.950 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":105,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:38.044279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":18,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:49.950 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 105 2023-11-04T01:43:49.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.950+0000 7fc8fc8fc640 1 -- 172.21.15.114:0/2705481548 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8d806ae70 msgr2=0x7fc8d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.950+0000 7fc8fc8fc640 1 --2- 172.21.15.114:0/2705481548 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8d806ae70 0x7fc8d806d330 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80079a0 tx=0x7fc8e8008040 comp rx=0 tx=0).stop 2023-11-04T01:43:49.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.950+0000 7fc8fc8fc640 1 -- 172.21.15.114:0/2705481548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f80ade00 msgr2=0x7fc8f81f4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.950+0000 7fc8fc8fc640 1 --2- 172.21.15.114:0/2705481548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f80ade00 0x7fc8f81f4680 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0036040 tx=0x7fc8f0004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:49.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.950+0000 7fc8fc8fc640 1 -- 172.21.15.114:0/2705481548 shutdown_connections 2023-11-04T01:43:49.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.950+0000 7fc8fc8fc640 1 --2- 172.21.15.114:0/2705481548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f80ade00 0x7fc8f81f4680 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.950+0000 7fc8fc8fc640 1 --2- 172.21.15.114:0/2705481548 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc8d806ae70 0x7fc8d806d330 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.950+0000 7fc8fc8fc640 1 --2- 172.21.15.114:0/2705481548 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc8f806d9c0 0x7fc8f81f4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.950+0000 7fc8fc8fc640 1 --2- 172.21.15.114:0/2705481548 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc8f806c5f0 0x7fc8f814e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.950+0000 7fc8fc8fc640 1 -- 172.21.15.114:0/2705481548 >> 172.21.15.114:0/2705481548 conn(0x7fc8f80cb530 msgr2=0x7fc8f80afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.950+0000 7fc8fc8fc640 1 -- 172.21.15.114:0/2705481548 shutdown_connections 2023-11-04T01:43:49.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:49.950+0000 7fc8fc8fc640 1 -- 172.21.15.114:0/2705481548 wait complete. 2023-11-04T01:43:49.962 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:51.158 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:51.161 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:51.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2023-11-04T01:43:54.963 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.071+0000 7fdbded4c640 1 Processor -- start 2023-11-04T01:43:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.071+0000 7fdbded4c640 1 -- start start 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.072+0000 7fdbded4c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fdbd80ade00 0x7fdbd80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.072+0000 7fdbded4c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbd806d9c0 0x7fdbd80710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.072+0000 7fdbded4c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd806cc90 con 0x7fdbd806c5f0 2023-11-04T01:43:55.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.072+0000 7fdbded4c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd80b0e60 con 0x7fdbd80ade00 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.072+0000 7fdbded4c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd806cee0 con 0x7fdbd806d9c0 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.072+0000 7fdbdd2e9640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdbd806c5f0 0x7fdbd815e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52280/0 (socket says 172.21.15.114:52280) 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.072+0000 7fdbdd2e9640 1 -- 172.21.15.114:0/4043824368 learned_addr learned my addr 172.21.15.114:0/4043824368 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.072+0000 7fdbd7fff640 1 --2- 172.21.15.114:0/4043824368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbd806d9c0 0x7fdbd80710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.072+0000 7fdbdcae8640 1 --2- 172.21.15.114:0/4043824368 >> v2:172.21.15.141:3300/0 conn(0x7fdbd80ade00 0x7fdbd80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.072+0000 7fdbd77fe640 1 -- 172.21.15.114:0/4043824368 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211524203 0 0) 0x7fdbd806cc90 con 0x7fdbd806c5f0 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd77fe640 1 -- 172.21.15.114:0/4043824368 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbc0003520 con 0x7fdbd806c5f0 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd77fe640 1 -- 172.21.15.114:0/4043824368 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4213138515 0 0) 0x7fdbc0003520 con 0x7fdbd806c5f0 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd77fe640 1 -- 172.21.15.114:0/4043824368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbd806d9c0 msgr2=0x7fdbd80710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd77fe640 1 --2- 172.21.15.114:0/4043824368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbd806d9c0 0x7fdbd80710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd77fe640 1 -- 172.21.15.114:0/4043824368 >> v2:172.21.15.141:3300/0 conn(0x7fdbd80ade00 msgr2=0x7fdbd80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd77fe640 1 --2- 172.21.15.114:0/4043824368 >> v2:172.21.15.141:3300/0 conn(0x7fdbd80ade00 0x7fdbd80b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd77fe640 1 -- 172.21.15.114:0/4043824368 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd806d1c0 con 0x7fdbd806c5f0 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd77fe640 1 -- 172.21.15.114:0/4043824368 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fdbd00019f0 con 0x7fdbd806c5f0 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd77fe640 1 -- 172.21.15.114:0/4043824368 >> v1:172.21.15.114:6789/0 conn(0x7fdbd806c5f0 legacy=0x7fdbd815e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd77fe640 1 --2- 172.21.15.114:0/4043824368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbd806d9c0 0x7fdbc0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd77fe640 1 --2- 172.21.15.114:0/4043824368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbc0003ef0 0x7fdbc00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd77fe640 1 --2- 172.21.15.114:0/4043824368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdbc0004d00 0x7fdbc0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd77fe640 1 -- 172.21.15.114:0/4043824368 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd80b0e60 con 0x7fdbc0003ef0 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd77fe640 1 -- 172.21.15.114:0/4043824368 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd806cee0 con 0x7fdbc0004d00 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd77fe640 1 -- 172.21.15.114:0/4043824368 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc000ba60 con 0x7fdbd806d9c0 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd7fff640 1 --2- 172.21.15.114:0/4043824368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbc0003ef0 0x7fdbc00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbdd2e9640 1 --2- 172.21.15.114:0/4043824368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdbc0004d00 0x7fdbc0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbdcae8640 1 --2- 172.21.15.114:0/4043824368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbd806d9c0 0x7fdbc0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd7fff640 1 -- 172.21.15.114:0/4043824368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbd806d9c0 msgr2=0x7fdbc0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd7fff640 1 --2- 172.21.15.114:0/4043824368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbd806d9c0 0x7fdbc0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd7fff640 1 -- 172.21.15.114:0/4043824368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdbc0004d00 msgr2=0x7fdbc0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd7fff640 1 --2- 172.21.15.114:0/4043824368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdbc0004d00 0x7fdbc0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbd7fff640 1 -- 172.21.15.114:0/4043824368 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc0003520 con 0x7fdbc0003ef0 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.073+0000 7fdbdd2e9640 1 --2- 172.21.15.114:0/4043824368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdbc0004d00 0x7fdbc0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.074+0000 7fdbd7fff640 1 --2- 172.21.15.114:0/4043824368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbc0003ef0 0x7fdbc00047c0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009a90 tx=0x7fdbc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fbef93086c20ad server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.074+0000 7fdbd77fe640 1 -- 172.21.15.114:0/4043824368 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc02c680 con 0x7fdbc0003ef0 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.074+0000 7fdbd77fe640 1 -- 172.21.15.114:0/4043824368 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc02c7e0 con 0x7fdbc0003ef0 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.074+0000 7fdbd77fe640 1 -- 172.21.15.114:0/4043824368 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc02cb90 con 0x7fdbc0003ef0 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.075+0000 7fdbded4c640 1 -- 172.21.15.114:0/4043824368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbc0003ef0 msgr2=0x7fdbc00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.075+0000 7fdbded4c640 1 --2- 172.21.15.114:0/4043824368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbc0003ef0 0x7fdbc00047c0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009a90 tx=0x7fdbc00057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.075+0000 7fdbdd2e9640 1 -- 172.21.15.114:0/4043824368 reap_dead start 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.075+0000 7fdbded4c640 1 -- 172.21.15.114:0/4043824368 shutdown_connections 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.075+0000 7fdbded4c640 1 -- 172.21.15.114:0/4043824368 >> 172.21.15.114:0/4043824368 conn(0x7fdbd80cb530 msgr2=0x7fdbd80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.075+0000 7fdbded4c640 1 -- 172.21.15.114:0/4043824368 shutdown_connections 2023-11-04T01:43:55.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.075+0000 7fdbded4c640 1 -- 172.21.15.114:0/4043824368 wait complete. 2023-11-04T01:43:55.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.076+0000 7fdbded4c640 1 Processor -- start 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.076+0000 7fdbded4c640 1 -- start start 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbded4c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbc0003ef0 0x7fdbd814f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbded4c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbd80ce950 0x7fdbd80cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbded4c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdbd80c7ab0 0x7fdbd80c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbded4c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd80c8ae0 con 0x7fdbd80ce950 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbded4c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd80cf2f0 con 0x7fdbd80c7ab0 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbded4c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd80c3770 con 0x7fdbc0003ef0 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbd7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbd80ce950 0x7fdbd80cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbd7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbd80ce950 0x7fdbd80cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39348/0 (socket says 172.21.15.114:39348) 2023-11-04T01:43:55.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbd7fff640 1 -- 172.21.15.114:0/319302438 learned_addr learned my addr 172.21.15.114:0/319302438 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbd7fff640 1 -- 172.21.15.114:0/319302438 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbc0003ef0 msgr2=0x7fdbd814f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbd7fff640 1 --2- 172.21.15.114:0/319302438 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbc0003ef0 0x7fdbd814f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbd7fff640 1 -- 172.21.15.114:0/319302438 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdbd80c7ab0 msgr2=0x7fdbd80c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbd7fff640 1 --2- 172.21.15.114:0/319302438 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdbd80c7ab0 0x7fdbd80c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbd7fff640 1 -- 172.21.15.114:0/319302438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd80c8800 con 0x7fdbd80ce950 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbd7fff640 1 --2- 172.21.15.114:0/319302438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbd80ce950 0x7fdbd80cedb0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009bb0 tx=0x7fdbcc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbd57fa640 1 -- 172.21.15.114:0/319302438 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc034950 con 0x7fdbd80ce950 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbd57fa640 1 -- 172.21.15.114:0/319302438 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc034ab0 con 0x7fdbd80ce950 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.077+0000 7fdbd57fa640 1 -- 172.21.15.114:0/319302438 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc034e60 con 0x7fdbd80ce950 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.078+0000 7fdbded4c640 1 -- 172.21.15.114:0/319302438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd80c92a0 con 0x7fdbd80ce950 2023-11-04T01:43:55.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.078+0000 7fdbded4c640 1 -- 172.21.15.114:0/319302438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd80c9860 con 0x7fdbd80ce950 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.078+0000 7fdbded4c640 1 -- 172.21.15.114:0/319302438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd80c9a20 con 0x7fdbd80ce950 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.079+0000 7fdbd57fa640 1 -- 172.21.15.114:0/319302438 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdbcc03e400 con 0x7fdbd80ce950 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.079+0000 7fdbd57fa640 1 --2- 172.21.15.114:0/319302438 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdbc406aea0 0x7fdbc406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.079+0000 7fdbd57fa640 1 -- 172.21.15.114:0/319302438 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fdbcc0abcd0 con 0x7fdbd80ce950 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.079+0000 7fdbdcae8640 1 --2- 172.21.15.114:0/319302438 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdbc406aea0 0x7fdbc406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.080+0000 7fdbdcae8640 1 --2- 172.21.15.114:0/319302438 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdbc406aea0 0x7fdbc406d360 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8006e80 tx=0x7fdbc8006df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.084+0000 7fdbd57fa640 1 -- 172.21.15.114:0/319302438 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdbcc076570 con 0x7fdbd80ce950 2023-11-04T01:43:55.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.284+0000 7fdbded4c640 1 -- 172.21.15.114:0/319302438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbd80c9100 con 0x7fdbd80ce950 2023-11-04T01:43:55.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.284+0000 7fdbd57fa640 1 -- 172.21.15.114:0/319302438 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4941 (secure 0 0 0) 0x7fdbd80c9100 con 0x7fdbd80ce950 2023-11-04T01:43:55.286 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:43:55.287 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":105,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:43:38.044279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":18,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:55.287 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 105 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.286+0000 7fdbded4c640 1 -- 172.21.15.114:0/319302438 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdbc406aea0 msgr2=0x7fdbc406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.286+0000 7fdbded4c640 1 --2- 172.21.15.114:0/319302438 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdbc406aea0 0x7fdbc406d360 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8006e80 tx=0x7fdbc8006df0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.286+0000 7fdbded4c640 1 -- 172.21.15.114:0/319302438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbd80ce950 msgr2=0x7fdbd80cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.286+0000 7fdbded4c640 1 --2- 172.21.15.114:0/319302438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbd80ce950 0x7fdbd80cedb0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009bb0 tx=0x7fdbcc004730 comp rx=0 tx=0).stop 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.286+0000 7fdbded4c640 1 -- 172.21.15.114:0/319302438 shutdown_connections 2023-11-04T01:43:55.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.286+0000 7fdbded4c640 1 --2- 172.21.15.114:0/319302438 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdbc406aea0 0x7fdbc406d360 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.286+0000 7fdbded4c640 1 --2- 172.21.15.114:0/319302438 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdbd80c7ab0 0x7fdbd80c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.286+0000 7fdbded4c640 1 --2- 172.21.15.114:0/319302438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbd80ce950 0x7fdbd80cedb0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.286+0000 7fdbded4c640 1 --2- 172.21.15.114:0/319302438 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdbc0003ef0 0x7fdbd814f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.286+0000 7fdbded4c640 1 -- 172.21.15.114:0/319302438 >> 172.21.15.114:0/319302438 conn(0x7fdbd80cb530 msgr2=0x7fdbd80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.286+0000 7fdbded4c640 1 -- 172.21.15.114:0/319302438 shutdown_connections 2023-11-04T01:43:55.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:43:55.286+0000 7fdbded4c640 1 -- 172.21.15.114:0/319302438 wait complete. 2023-11-04T01:43:55.298 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:58.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2023-11-04T01:44:00.299 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:00.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.409+0000 7fa6a2ab4640 1 Processor -- start 2023-11-04T01:44:00.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.409+0000 7fa6a2ab4640 1 -- start start 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa6a2ab4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa69c06d9c0 0x7fa69c0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa6a2ab4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69c06cc90 con 0x7fa69c06c5f0 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa6a2ab4640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69c0b0e60 con 0x7fa69c0ade00 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa6a2ab4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c0b0c40 con 0x7fa69c06d9c0 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa6a1051640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa69c06c5f0 0x7fa69c0cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52482/0 (socket says 172.21.15.114:52482) 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa6a1051640 1 -- 172.21.15.114:0/3559317849 learned_addr learned my addr 172.21.15.114:0/3559317849 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa69bfff640 1 --2- 172.21.15.114:0/3559317849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa69c06d9c0 0x7fa69c0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa69b7fe640 1 -- 172.21.15.114:0/3559317849 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3896972018 0 0) 0x7fa69c06cc90 con 0x7fa69c06c5f0 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa69b7fe640 1 -- 172.21.15.114:0/3559317849 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa688003520 con 0x7fa69c06c5f0 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa69b7fe640 1 -- 172.21.15.114:0/3559317849 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2482115666 0 0) 0x7fa688003520 con 0x7fa69c06c5f0 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa69b7fe640 1 -- 172.21.15.114:0/3559317849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa69c06d9c0 msgr2=0x7fa69c0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa69b7fe640 1 --2- 172.21.15.114:0/3559317849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa69c06d9c0 0x7fa69c0710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa69b7fe640 1 -- 172.21.15.114:0/3559317849 >> v1:172.21.15.141:6789/0 conn(0x7fa69c0ade00 legacy=0x7fa69c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa69b7fe640 1 -- 172.21.15.114:0/3559317849 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c06cee0 con 0x7fa69c06c5f0 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa69b7fe640 1 -- 172.21.15.114:0/3559317849 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fa68c001670 con 0x7fa69c06c5f0 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa69b7fe640 1 -- 172.21.15.114:0/3559317849 >> v1:172.21.15.114:6789/0 conn(0x7fa69c06c5f0 legacy=0x7fa69c0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa69b7fe640 1 --2- 172.21.15.114:0/3559317849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa69c06d9c0 0x7fa6880039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa69b7fe640 1 --2- 172.21.15.114:0/3559317849 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa688003f20 0x7fa6880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa69b7fe640 1 --2- 172.21.15.114:0/3559317849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa688004d00 0x7fa688005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa69b7fe640 1 -- 172.21.15.114:0/3559317849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c0b0c40 con 0x7fa688004d00 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa69b7fe640 1 -- 172.21.15.114:0/3559317849 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68800bbc0 con 0x7fa688003f20 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.410+0000 7fa69b7fe640 1 -- 172.21.15.114:0/3559317849 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68800bd80 con 0x7fa69c06d9c0 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.411+0000 7fa6a1051640 1 --2- 172.21.15.114:0/3559317849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa688004d00 0x7fa688005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.411+0000 7fa69bfff640 1 --2- 172.21.15.114:0/3559317849 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa688003f20 0x7fa6880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.411+0000 7fa6a0850640 1 --2- 172.21.15.114:0/3559317849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa69c06d9c0 0x7fa6880039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.411+0000 7fa6a1051640 1 -- 172.21.15.114:0/3559317849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa69c06d9c0 msgr2=0x7fa6880039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.411+0000 7fa6a1051640 1 --2- 172.21.15.114:0/3559317849 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa69c06d9c0 0x7fa6880039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.411+0000 7fa6a1051640 1 -- 172.21.15.114:0/3559317849 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa688003f20 msgr2=0x7fa6880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.411+0000 7fa6a1051640 1 --2- 172.21.15.114:0/3559317849 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa688003f20 0x7fa6880047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.411+0000 7fa6a1051640 1 -- 172.21.15.114:0/3559317849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa688003520 con 0x7fa688004d00 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.412+0000 7fa6a1051640 1 --2- 172.21.15.114:0/3559317849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa688004d00 0x7fa688005180 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00c240 tx=0x7fa6880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a229c4743fb2639 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.412+0000 7fa69b7fe640 1 -- 172.21.15.114:0/3559317849 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c005ad0 con 0x7fa688004d00 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.412+0000 7fa69b7fe640 1 -- 172.21.15.114:0/3559317849 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c005c30 con 0x7fa688004d00 2023-11-04T01:44:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.412+0000 7fa69b7fe640 1 -- 172.21.15.114:0/3559317849 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c02caf0 con 0x7fa688004d00 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.412+0000 7fa6a2ab4640 1 -- 172.21.15.114:0/3559317849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa688004d00 msgr2=0x7fa688005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.412+0000 7fa6a2ab4640 1 --2- 172.21.15.114:0/3559317849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa688004d00 0x7fa688005180 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00c240 tx=0x7fa6880057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.412+0000 7fa6a1051640 1 -- 172.21.15.114:0/3559317849 reap_dead start 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.412+0000 7fa6a2ab4640 1 -- 172.21.15.114:0/3559317849 shutdown_connections 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.412+0000 7fa6a2ab4640 1 -- 172.21.15.114:0/3559317849 >> 172.21.15.114:0/3559317849 conn(0x7fa69c0cb530 msgr2=0x7fa69c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.412+0000 7fa6a2ab4640 1 -- 172.21.15.114:0/3559317849 shutdown_connections 2023-11-04T01:44:00.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.412+0000 7fa6a2ab4640 1 -- 172.21.15.114:0/3559317849 wait complete. 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.413+0000 7fa6a2ab4640 1 Processor -- start 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.413+0000 7fa6a2ab4640 1 -- start start 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.414+0000 7fa6a2ab4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa69c14d0c0 0x7fa69c0b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.414+0000 7fa6a2ab4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa69c0b3870 0x7fa69c0ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.414+0000 7fa6a2ab4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa69c15a970 0x7fa69c0ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.414+0000 7fa6a2ab4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c0b3cf0 con 0x7fa69c15a970 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.414+0000 7fa6a2ab4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c0b3fd0 con 0x7fa69c0b3870 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.414+0000 7fa6a2ab4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c0b42b0 con 0x7fa69c14d0c0 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.414+0000 7fa6a1051640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa69c15a970 0x7fa69c0ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.414+0000 7fa6a1051640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa69c15a970 0x7fa69c0ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38578/0 (socket says 172.21.15.114:38578) 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.414+0000 7fa6a1051640 1 -- 172.21.15.114:0/2482237928 learned_addr learned my addr 172.21.15.114:0/2482237928 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.415+0000 7fa6a0850640 1 --2- 172.21.15.114:0/2482237928 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa69c14d0c0 0x7fa69c0b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.415+0000 7fa69bfff640 1 --2- 172.21.15.114:0/2482237928 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa69c0b3870 0x7fa69c0ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.415+0000 7fa6a1051640 1 -- 172.21.15.114:0/2482237928 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa69c14d0c0 msgr2=0x7fa69c0b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.415+0000 7fa6a1051640 1 --2- 172.21.15.114:0/2482237928 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa69c14d0c0 0x7fa69c0b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.415+0000 7fa6a1051640 1 -- 172.21.15.114:0/2482237928 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa69c0b3870 msgr2=0x7fa69c0ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.415+0000 7fa6a1051640 1 --2- 172.21.15.114:0/2482237928 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa69c0b3870 0x7fa69c0ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.415+0000 7fa6a1051640 1 -- 172.21.15.114:0/2482237928 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c0c91a0 con 0x7fa69c15a970 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.415+0000 7fa69bfff640 1 --2- 172.21.15.114:0/2482237928 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa69c0b3870 0x7fa69c0ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.415+0000 7fa6a1051640 1 --2- 172.21.15.114:0/2482237928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa69c15a970 0x7fa69c0ace10 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00c240 tx=0x7fa68c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.415+0000 7fa6997fa640 1 -- 172.21.15.114:0/2482237928 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c004aa0 con 0x7fa69c15a970 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.415+0000 7fa6997fa640 1 -- 172.21.15.114:0/2482237928 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c004c20 con 0x7fa69c15a970 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.415+0000 7fa6997fa640 1 -- 172.21.15.114:0/2482237928 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c007070 con 0x7fa69c15a970 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.415+0000 7fa6a2ab4640 1 -- 172.21.15.114:0/2482237928 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa69c0c9480 con 0x7fa69c15a970 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.415+0000 7fa6a2ab4640 1 -- 172.21.15.114:0/2482237928 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69c14d4a0 con 0x7fa69c15a970 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.416+0000 7fa6a2ab4640 1 -- 172.21.15.114:0/2482237928 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69c0684b0 con 0x7fa69c15a970 2023-11-04T01:44:00.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.417+0000 7fa6997fa640 1 -- 172.21.15.114:0/2482237928 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa68c032070 con 0x7fa69c15a970 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.417+0000 7fa6997fa640 1 --2- 172.21.15.114:0/2482237928 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa67c06ae70 0x7fa67c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.417+0000 7fa6997fa640 1 -- 172.21.15.114:0/2482237928 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fa68c03c070 con 0x7fa69c15a970 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.417+0000 7fa6a0850640 1 --2- 172.21.15.114:0/2482237928 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa67c06ae70 0x7fa67c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.418+0000 7fa6a0850640 1 --2- 172.21.15.114:0/2482237928 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa67c06ae70 0x7fa67c06d330 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa694001ee0 tx=0x7fa694009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.421+0000 7fa6997fa640 1 -- 172.21.15.114:0/2482237928 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa68c075510 con 0x7fa69c15a970 2023-11-04T01:44:00.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.623+0000 7fa6a2ab4640 1 -- 172.21.15.114:0/2482237928 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa69c0cddc0 con 0x7fa69c15a970 2023-11-04T01:44:00.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.624+0000 7fa6997fa640 1 -- 172.21.15.114:0/2482237928 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4989 (secure 0 0 0) 0x7fa68c039030 con 0x7fa69c15a970 2023-11-04T01:44:00.626 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:00.626 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:00.622019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":18,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:44:00.622019+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:00.626 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 106 2023-11-04T01:44:00.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.626+0000 7fa6a2ab4640 1 -- 172.21.15.114:0/2482237928 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa67c06ae70 msgr2=0x7fa67c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.626+0000 7fa6a2ab4640 1 --2- 172.21.15.114:0/2482237928 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa67c06ae70 0x7fa67c06d330 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa694001ee0 tx=0x7fa694009040 comp rx=0 tx=0).stop 2023-11-04T01:44:00.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.626+0000 7fa6a2ab4640 1 -- 172.21.15.114:0/2482237928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa69c15a970 msgr2=0x7fa69c0ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.626+0000 7fa6a2ab4640 1 --2- 172.21.15.114:0/2482237928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa69c15a970 0x7fa69c0ace10 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00c240 tx=0x7fa68c001a00 comp rx=0 tx=0).stop 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.626+0000 7fa6a2ab4640 1 -- 172.21.15.114:0/2482237928 shutdown_connections 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.626+0000 7fa6a2ab4640 1 --2- 172.21.15.114:0/2482237928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa69c15a970 0x7fa69c0ace10 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.626+0000 7fa6a2ab4640 1 --2- 172.21.15.114:0/2482237928 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fa67c06ae70 0x7fa67c06d330 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.626+0000 7fa6a2ab4640 1 --2- 172.21.15.114:0/2482237928 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fa69c0b3870 0x7fa69c0ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.626+0000 7fa6a2ab4640 1 --2- 172.21.15.114:0/2482237928 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fa69c14d0c0 0x7fa69c0b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.626+0000 7fa6a2ab4640 1 -- 172.21.15.114:0/2482237928 >> 172.21.15.114:0/2482237928 conn(0x7fa69c0cb530 msgr2=0x7fa69c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.626+0000 7fa6a2ab4640 1 -- 172.21.15.114:0/2482237928 shutdown_connections 2023-11-04T01:44:00.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.626+0000 7fa6a2ab4640 1 -- 172.21.15.114:0/2482237928 wait complete. 2023-11-04T01:44:00.639 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-11-04T01:44:00.639 DEBUG:teuthology.orchestra.run.smithi141:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:44:00.669 INFO:teuthology.orchestra.run.smithi141.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:44:00.671 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:44:00.671 DEBUG:teuthology.orchestra.run.smithi141:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi141.stdout:1699062223.127262.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i b', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:44:00.747 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062223.127262.core'] 2023-11-04T01:44:00.747 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062223.127262.core, deleting it 2023-11-04T01:44:00.747 DEBUG:teuthology.orchestra.run.smithi141:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062223.127262.core 2023-11-04T01:44:00.819 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:00.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.916+0000 7f50b827c640 1 Processor -- start 2023-11-04T01:44:00.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.916+0000 7f50b827c640 1 -- start start 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.917+0000 7f50b827c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50b0070700 0x7f50b0164b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.917+0000 7f50b827c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b0071500 con 0x7f50b0159e40 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.917+0000 7f50b827c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b015dae0 con 0x7f50b00b0c40 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.917+0000 7f50b827c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b0070c60 con 0x7f50b0070700 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b6018640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f50b0159e40 0x7f50b00b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52496/0 (socket says 172.21.15.114:52496) 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b6018640 1 -- 172.21.15.114:0/2443449599 learned_addr learned my addr 172.21.15.114:0/2443449599 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5016640 1 -- 172.21.15.114:0/2443449599 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655775361 0 0) 0x7f50b0071500 con 0x7f50b0159e40 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5016640 1 -- 172.21.15.114:0/2443449599 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f509c003520 con 0x7f50b0159e40 2023-11-04T01:44:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b6819640 1 --2- 172.21.15.114:0/2443449599 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50b0070700 0x7f50b0164b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5016640 1 -- 172.21.15.114:0/2443449599 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1631278154 0 0) 0x7f509c003520 con 0x7f50b0159e40 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5016640 1 -- 172.21.15.114:0/2443449599 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50b0070700 msgr2=0x7f50b0164b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5016640 1 --2- 172.21.15.114:0/2443449599 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50b0070700 0x7f50b0164b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5016640 1 -- 172.21.15.114:0/2443449599 >> v1:172.21.15.141:6789/0 conn(0x7f50b00b0c40 legacy=0x7f50b006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5016640 1 -- 172.21.15.114:0/2443449599 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0070f40 con 0x7f50b0159e40 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5016640 1 -- 172.21.15.114:0/2443449599 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f50a4001670 con 0x7f50b0159e40 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5016640 1 -- 172.21.15.114:0/2443449599 >> v1:172.21.15.114:6789/0 conn(0x7f50b0159e40 legacy=0x7f50b00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5016640 1 --2- 172.21.15.114:0/2443449599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f509c0039a0 0x7f509c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5016640 1 --2- 172.21.15.114:0/2443449599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f509c0047c0 0x7f509c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5016640 1 --2- 172.21.15.114:0/2443449599 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50b0070700 0x7f509c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5016640 1 -- 172.21.15.114:0/2443449599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b0070c60 con 0x7f509c0047c0 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5016640 1 -- 172.21.15.114:0/2443449599 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c00bab0 con 0x7f509c0039a0 2023-11-04T01:44:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5016640 1 -- 172.21.15.114:0/2443449599 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c00bc70 con 0x7f50b0070700 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5817640 1 --2- 172.21.15.114:0/2443449599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f509c0047c0 0x7f509c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b6018640 1 --2- 172.21.15.114:0/2443449599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f509c0039a0 0x7f509c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b6819640 1 --2- 172.21.15.114:0/2443449599 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50b0070700 0x7f509c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5817640 1 -- 172.21.15.114:0/2443449599 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50b0070700 msgr2=0x7f509c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.918+0000 7f50b5817640 1 --2- 172.21.15.114:0/2443449599 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f50b0070700 0x7f509c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.919+0000 7f50b5817640 1 -- 172.21.15.114:0/2443449599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f509c0039a0 msgr2=0x7f509c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.919+0000 7f50b5817640 1 --2- 172.21.15.114:0/2443449599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f509c0039a0 0x7f509c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.919+0000 7f50b5817640 1 -- 172.21.15.114:0/2443449599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c003520 con 0x7f509c0047c0 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.919+0000 7f50b6018640 1 --2- 172.21.15.114:0/2443449599 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f509c0039a0 0x7f509c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:00.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.919+0000 7f50b5817640 1 --2- 172.21.15.114:0/2443449599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f509c0047c0 0x7f509c004c40 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f50ac001750 tx=0x7f509c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b39582236c6a0a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.919+0000 7f50b5016640 1 -- 172.21.15.114:0/2443449599 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0052d0 con 0x7f509c0047c0 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.919+0000 7f50b5016640 1 -- 172.21.15.114:0/2443449599 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac02e050 con 0x7f509c0047c0 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.919+0000 7f50b5016640 1 -- 172.21.15.114:0/2443449599 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0035f0 con 0x7f509c0047c0 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.920+0000 7f50b827c640 1 -- 172.21.15.114:0/2443449599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f509c0047c0 msgr2=0x7f509c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.920+0000 7f50b827c640 1 --2- 172.21.15.114:0/2443449599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f509c0047c0 0x7f509c004c40 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f50ac001750 tx=0x7f509c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.920+0000 7f50b6819640 1 -- 172.21.15.114:0/2443449599 reap_dead start 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.920+0000 7f50b827c640 1 -- 172.21.15.114:0/2443449599 shutdown_connections 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.920+0000 7f50b827c640 1 -- 172.21.15.114:0/2443449599 >> 172.21.15.114:0/2443449599 conn(0x7f50b00cb530 msgr2=0x7f50b00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.920+0000 7f50b827c640 1 -- 172.21.15.114:0/2443449599 shutdown_connections 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.920+0000 7f50b827c640 1 -- 172.21.15.114:0/2443449599 wait complete. 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.921+0000 7f50b827c640 1 Processor -- start 2023-11-04T01:44:00.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.921+0000 7f50b827c640 1 -- start start 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b827c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f509c0047c0 0x7f50b014e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b827c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50b0158450 0x7f50b01512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b827c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f50b00ac8d0 0x7f50b00acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b827c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b015b9e0 con 0x7f50b0158450 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b827c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b00ad2a0 con 0x7f50b00ac8d0 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b827c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b014e810 con 0x7f509c0047c0 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b5817640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50b0158450 0x7f50b01512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b5817640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50b0158450 0x7f50b01512f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38594/0 (socket says 172.21.15.114:38594) 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b5817640 1 -- 172.21.15.114:0/2483267113 learned_addr learned my addr 172.21.15.114:0/2483267113 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b6018640 1 --2- 172.21.15.114:0/2483267113 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f509c0047c0 0x7f50b014e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b6819640 1 --2- 172.21.15.114:0/2483267113 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f50b00ac8d0 0x7f50b00acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b5817640 1 -- 172.21.15.114:0/2483267113 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f509c0047c0 msgr2=0x7f50b014e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b5817640 1 --2- 172.21.15.114:0/2483267113 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f509c0047c0 0x7f50b014e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b5817640 1 -- 172.21.15.114:0/2483267113 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f50b00ac8d0 msgr2=0x7f50b00acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b5817640 1 --2- 172.21.15.114:0/2483267113 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f50b00ac8d0 0x7f50b00acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b5817640 1 -- 172.21.15.114:0/2483267113 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b015ad60 con 0x7f50b0158450 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50b5817640 1 --2- 172.21.15.114:0/2483267113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50b0158450 0x7f50b01512f0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f50ac008fd0 tx=0x7f50ac001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.922+0000 7f50a2ffd640 1 -- 172.21.15.114:0/2483267113 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0076c0 con 0x7f50b0158450 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.923+0000 7f50a2ffd640 1 -- 172.21.15.114:0/2483267113 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac007a30 con 0x7f50b0158450 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.923+0000 7f50b827c640 1 -- 172.21.15.114:0/2483267113 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b015b040 con 0x7f50b0158450 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.923+0000 7f50a2ffd640 1 -- 172.21.15.114:0/2483267113 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac006c00 con 0x7f50b0158450 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.923+0000 7f50b827c640 1 -- 172.21.15.114:0/2483267113 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b015b600 con 0x7f50b0158450 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.924+0000 7f50b827c640 1 -- 172.21.15.114:0/2483267113 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b00cb330 con 0x7f50b0158450 2023-11-04T01:44:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.924+0000 7f50a2ffd640 1 -- 172.21.15.114:0/2483267113 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f50ac0035f0 con 0x7f50b0158450 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.924+0000 7f50a2ffd640 1 --2- 172.21.15.114:0/2483267113 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f509406ae70 0x7f509406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.924+0000 7f50b6018640 1 --2- 172.21.15.114:0/2483267113 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f509406ae70 0x7f509406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.924+0000 7f50a2ffd640 1 -- 172.21.15.114:0/2483267113 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f50ac0abc20 con 0x7f50b0158450 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.925+0000 7f50b6018640 1 --2- 172.21.15.114:0/2483267113 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f509406ae70 0x7f509406d330 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f50a4000fb0 tx=0x7f50a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:00.929+0000 7f50a2ffd640 1 -- 172.21.15.114:0/2483267113 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f50ac079fc0 con 0x7f50b0158450 2023-11-04T01:44:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.128+0000 7f50b827c640 1 -- 172.21.15.114:0/2483267113 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50b00684b0 con 0x7f50b0158450 2023-11-04T01:44:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.129+0000 7f50a2ffd640 1 -- 172.21.15.114:0/2483267113 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4989 (secure 0 0 0) 0x7f50ac04b020 con 0x7f50b0158450 2023-11-04T01:44:01.131 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:00.622019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6083,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6083":{"gid":6083,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":18,"addr":"172.21.15.141:6834/224279622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":224279622},{"type":"v1","addr":"172.21.15.141:6834","nonce":224279622}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:44:00.622019+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:01.131 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 106 2023-11-04T01:44:01.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.131+0000 7f50b827c640 1 -- 172.21.15.114:0/2483267113 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f509406ae70 msgr2=0x7f509406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.131+0000 7f50b827c640 1 --2- 172.21.15.114:0/2483267113 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f509406ae70 0x7f509406d330 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f50a4000fb0 tx=0x7f50a4009040 comp rx=0 tx=0).stop 2023-11-04T01:44:01.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.131+0000 7f50b827c640 1 -- 172.21.15.114:0/2483267113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50b0158450 msgr2=0x7f50b01512f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.131+0000 7f50b827c640 1 --2- 172.21.15.114:0/2483267113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50b0158450 0x7f50b01512f0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f50ac008fd0 tx=0x7f50ac001120 comp rx=0 tx=0).stop 2023-11-04T01:44:01.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.131+0000 7f50b827c640 1 -- 172.21.15.114:0/2483267113 shutdown_connections 2023-11-04T01:44:01.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.131+0000 7f50b827c640 1 --2- 172.21.15.114:0/2483267113 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f509406ae70 0x7f509406d330 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.131+0000 7f50b827c640 1 --2- 172.21.15.114:0/2483267113 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f50b00ac8d0 0x7f50b00acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.131+0000 7f50b827c640 1 --2- 172.21.15.114:0/2483267113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50b0158450 0x7f50b01512f0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.131+0000 7f50b827c640 1 --2- 172.21.15.114:0/2483267113 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f509c0047c0 0x7f50b014e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.131+0000 7f50b827c640 1 -- 172.21.15.114:0/2483267113 >> 172.21.15.114:0/2483267113 conn(0x7f50b00cb530 msgr2=0x7f50b00afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:01.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.131+0000 7f50b827c640 1 -- 172.21.15.114:0/2483267113 shutdown_connections 2023-11-04T01:44:01.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.131+0000 7f50b827c640 1 -- 172.21.15.114:0/2483267113 wait complete. 2023-11-04T01:44:01.143 INFO:tasks.ceph.mds.a:Sent signal 9 2023-11-04T01:44:01.143 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:44:01.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:01.144 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 down 2023-11-04T01:44:01.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:44:01.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.309+0000 7f8c445b6640 1 Processor -- start 2023-11-04T01:44:01.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.309+0000 7f8c445b6640 1 -- start start 2023-11-04T01:44:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.310+0000 7f8c445b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c3c0afda0 0x7f8c3c0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.310+0000 7f8c445b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8c3c0cd7f0 0x7f8c3c0ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.310+0000 7f8c445b6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3c0cf240 con 0x7f8c3c15b200 2023-11-04T01:44:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.310+0000 7f8c445b6640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c0cdc20 con 0x7f8c3c0afda0 2023-11-04T01:44:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.310+0000 7f8c445b6640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c0cde80 con 0x7f8c3c0cd7f0 2023-11-04T01:44:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.311+0000 7f8c41b51640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c3c0afda0 0x7f8c3c0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.311+0000 7f8c42352640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8c3c15b200 0x7f8c3c0ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52504/0 (socket says 172.21.15.114:52504) 2023-11-04T01:44:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.311+0000 7f8c41b51640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c3c0afda0 0x7f8c3c0cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38600/0 (socket says 172.21.15.114:38600) 2023-11-04T01:44:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.311+0000 7f8c42352640 1 -- 172.21.15.114:0/559868707 learned_addr learned my addr 172.21.15.114:0/559868707 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.311+0000 7f8c42b53640 1 --2- 172.21.15.114:0/559868707 >> v2:172.21.15.141:3300/0 conn(0x7f8c3c0cd7f0 0x7f8c3c0ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.311+0000 7f8c41b51640 1 -- 172.21.15.114:0/559868707 >> v2:172.21.15.141:3300/0 conn(0x7f8c3c0cd7f0 msgr2=0x7f8c3c0ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.311+0000 7f8c41b51640 1 --2- 172.21.15.114:0/559868707 >> v2:172.21.15.141:3300/0 conn(0x7f8c3c0cd7f0 0x7f8c3c0ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.311+0000 7f8c41b51640 1 -- 172.21.15.114:0/559868707 >> v1:172.21.15.114:6789/0 conn(0x7f8c3c15b200 legacy=0x7f8c3c0ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.311+0000 7f8c41350640 1 -- 172.21.15.114:0/559868707 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599008895 0 0) 0x7f8c34001610 con 0x7f8c3c15b200 2023-11-04T01:44:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.311+0000 7f8c41b51640 1 -- 172.21.15.114:0/559868707 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c0cf670 con 0x7f8c3c0afda0 2023-11-04T01:44:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.311+0000 7f8c42b53640 1 --2- 172.21.15.114:0/559868707 >> v2:172.21.15.141:3300/0 conn(0x7f8c3c0cd7f0 0x7f8c3c0ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:01.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.312+0000 7f8c41b51640 1 --2- 172.21.15.114:0/559868707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c3c0afda0 0x7f8c3c0cd2b0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0711b0 tx=0x7f8c2c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e2900e45361940 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:01.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.312+0000 7f8c41350640 1 -- 172.21.15.114:0/559868707 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c02e070 con 0x7f8c3c0afda0 2023-11-04T01:44:01.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.312+0000 7f8c41350640 1 -- 172.21.15.114:0/559868707 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c0315a0 con 0x7f8c3c0afda0 2023-11-04T01:44:01.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.312+0000 7f8c41350640 1 -- 172.21.15.114:0/559868707 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c031930 con 0x7f8c3c0afda0 2023-11-04T01:44:01.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.312+0000 7f8c445b6640 1 -- 172.21.15.114:0/559868707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c3c0afda0 msgr2=0x7f8c3c0cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.312+0000 7f8c445b6640 1 --2- 172.21.15.114:0/559868707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c3c0afda0 0x7f8c3c0cd2b0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0711b0 tx=0x7f8c2c02b840 comp rx=0 tx=0).stop 2023-11-04T01:44:01.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.312+0000 7f8c445b6640 1 -- 172.21.15.114:0/559868707 shutdown_connections 2023-11-04T01:44:01.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.312+0000 7f8c445b6640 1 --2- 172.21.15.114:0/559868707 >> v2:172.21.15.141:3300/0 conn(0x7f8c3c0cd7f0 0x7f8c3c0ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.312+0000 7f8c445b6640 1 --2- 172.21.15.114:0/559868707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c3c0afda0 0x7f8c3c0cd2b0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.312+0000 7f8c445b6640 1 -- 172.21.15.114:0/559868707 >> 172.21.15.114:0/559868707 conn(0x7f8c3c0d0c30 msgr2=0x7f8c3c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:01.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.312+0000 7f8c445b6640 1 -- 172.21.15.114:0/559868707 shutdown_connections 2023-11-04T01:44:01.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.312+0000 7f8c445b6640 1 -- 172.21.15.114:0/559868707 wait complete. 2023-11-04T01:44:01.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.314+0000 7f8c445b6640 1 Processor -- start 2023-11-04T01:44:01.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.314+0000 7f8c445b6640 1 -- start start 2023-11-04T01:44:01.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.314+0000 7f8c445b6640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c3c0afda0 0x7f8c3c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.314+0000 7f8c445b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c3c0cd7f0 0x7f8c3c0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.314+0000 7f8c445b6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c3c15b200 0x7f8c3c1f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.314+0000 7f8c445b6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c06ccb0 con 0x7f8c3c15b200 2023-11-04T01:44:01.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.314+0000 7f8c445b6640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c06c2e0 con 0x7f8c3c0afda0 2023-11-04T01:44:01.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.314+0000 7f8c445b6640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0c8240 con 0x7f8c3c0cd7f0 2023-11-04T01:44:01.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.314+0000 7f8c42b53640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c3c15b200 0x7f8c3c1f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.314+0000 7f8c42b53640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c3c15b200 0x7f8c3c1f6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38610/0 (socket says 172.21.15.114:38610) 2023-11-04T01:44:01.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.314+0000 7f8c42b53640 1 -- 172.21.15.114:0/2493608939 learned_addr learned my addr 172.21.15.114:0/2493608939 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:01.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.315+0000 7f8c42352640 1 --2- 172.21.15.114:0/2493608939 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c3c0afda0 0x7f8c3c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.315+0000 7f8c41b51640 1 --2- 172.21.15.114:0/2493608939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c3c0cd7f0 0x7f8c3c0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.315+0000 7f8c42b53640 1 -- 172.21.15.114:0/2493608939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c3c0cd7f0 msgr2=0x7f8c3c0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.315+0000 7f8c42b53640 1 --2- 172.21.15.114:0/2493608939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c3c0cd7f0 0x7f8c3c0c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.315+0000 7f8c42b53640 1 -- 172.21.15.114:0/2493608939 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c3c0afda0 msgr2=0x7f8c3c06c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.315+0000 7f8c42b53640 1 --2- 172.21.15.114:0/2493608939 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c3c0afda0 0x7f8c3c06c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.315+0000 7f8c42b53640 1 -- 172.21.15.114:0/2493608939 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c009400 con 0x7f8c3c15b200 2023-11-04T01:44:01.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.315+0000 7f8c41b51640 1 --2- 172.21.15.114:0/2493608939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c3c0cd7f0 0x7f8c3c0c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:01.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.315+0000 7f8c42b53640 1 --2- 172.21.15.114:0/2493608939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c3c15b200 0x7f8c3c1f6020 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800c820 tx=0x7f8c3800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:01.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.315+0000 7f8c32ffd640 1 -- 172.21.15.114:0/2493608939 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38007a30 con 0x7f8c3c15b200 2023-11-04T01:44:01.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.315+0000 7f8c32ffd640 1 -- 172.21.15.114:0/2493608939 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c38007b90 con 0x7f8c3c15b200 2023-11-04T01:44:01.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.315+0000 7f8c445b6640 1 -- 172.21.15.114:0/2493608939 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3c0caf30 con 0x7f8c3c15b200 2023-11-04T01:44:01.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.315+0000 7f8c32ffd640 1 -- 172.21.15.114:0/2493608939 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800ce10 con 0x7f8c3c15b200 2023-11-04T01:44:01.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.315+0000 7f8c445b6640 1 -- 172.21.15.114:0/2493608939 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c06bc90 con 0x7f8c3c15b200 2023-11-04T01:44:01.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.316+0000 7f8c445b6640 1 -- 172.21.15.114:0/2493608939 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3c06c470 con 0x7f8c3c15b200 2023-11-04T01:44:01.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.316+0000 7f8c32ffd640 1 -- 172.21.15.114:0/2493608939 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c380113f0 con 0x7f8c3c15b200 2023-11-04T01:44:01.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.317+0000 7f8c32ffd640 1 --2- 172.21.15.114:0/2493608939 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c2006ae70 0x7f8c2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.317+0000 7f8c32ffd640 1 -- 172.21.15.114:0/2493608939 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f8c3808a050 con 0x7f8c3c15b200 2023-11-04T01:44:01.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.317+0000 7f8c42352640 1 --2- 172.21.15.114:0/2493608939 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c2006ae70 0x7f8c2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.317+0000 7f8c42352640 1 --2- 172.21.15.114:0/2493608939 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c2006ae70 0x7f8c2006d330 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8c34001870 tx=0x7f8c34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:01.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.321+0000 7f8c32ffd640 1 -- 172.21.15.114:0/2493608939 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8c38054840 con 0x7f8c3c15b200 2023-11-04T01:44:01.345 INFO:tasks.ceph.mds.a.smithi114.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:44:01.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.556+0000 7f8c445b6640 1 -- 172.21.15.114:0/2493608939 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f8c3c0684b0 con 0x7f8c3c15b200 2023-11-04T01:44:01.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.558+0000 7f8c32ffd640 1 -- 172.21.15.114:0/2493608939 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 6083 v107) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8c3801f090 con 0x7f8c3c15b200 2023-11-04T01:44:01.559 INFO:teuthology.orchestra.run.smithi114.stderr:failed mds gid 6083 2023-11-04T01:44:01.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.561+0000 7f8c445b6640 1 -- 172.21.15.114:0/2493608939 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c2006ae70 msgr2=0x7f8c2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.561+0000 7f8c445b6640 1 --2- 172.21.15.114:0/2493608939 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c2006ae70 0x7f8c2006d330 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8c34001870 tx=0x7f8c34009040 comp rx=0 tx=0).stop 2023-11-04T01:44:01.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.561+0000 7f8c445b6640 1 -- 172.21.15.114:0/2493608939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c3c15b200 msgr2=0x7f8c3c1f6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.561+0000 7f8c445b6640 1 --2- 172.21.15.114:0/2493608939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c3c15b200 0x7f8c3c1f6020 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800c820 tx=0x7f8c3800cce0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.561+0000 7f8c445b6640 1 -- 172.21.15.114:0/2493608939 shutdown_connections 2023-11-04T01:44:01.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.561+0000 7f8c445b6640 1 --2- 172.21.15.114:0/2493608939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c3c15b200 0x7f8c3c1f6020 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.561+0000 7f8c445b6640 1 --2- 172.21.15.114:0/2493608939 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8c3c0cd7f0 0x7f8c3c0c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.561+0000 7f8c445b6640 1 --2- 172.21.15.114:0/2493608939 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8c2006ae70 0x7f8c2006d330 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.561+0000 7f8c445b6640 1 --2- 172.21.15.114:0/2493608939 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8c3c0afda0 0x7f8c3c06c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.561+0000 7f8c445b6640 1 -- 172.21.15.114:0/2493608939 >> 172.21.15.114:0/2493608939 conn(0x7f8c3c0d0c30 msgr2=0x7f8c3c159060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:01.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.561+0000 7f8c445b6640 1 -- 172.21.15.114:0/2493608939 shutdown_connections 2023-11-04T01:44:01.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.561+0000 7f8c445b6640 1 -- 172.21.15.114:0/2493608939 wait complete. 2023-11-04T01:44:01.576 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:44:01.576 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:44:01.576 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:44:01.577 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:44:01.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:01.577 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi141 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-11-04T01:44:01.577 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:44:01.577 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:44:01.580 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:44:01.580 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:01.661 INFO:tasks.ceph.mds.b.smithi141.stdout:starting mds.b at 2023-11-04T01:44:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.677+0000 7f44340da640 1 Processor -- start 2023-11-04T01:44:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.677+0000 7f44340da640 1 -- start start 2023-11-04T01:44:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.678+0000 7f44340da640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f442c0b1440 0x7f442c06a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.678+0000 7f44340da640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442c06c950 con 0x7f442c15d1b0 2023-11-04T01:44:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.678+0000 7f44340da640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442c0b2310 con 0x7f442c0b30d0 2023-11-04T01:44:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.678+0000 7f44340da640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442c0b3560 con 0x7f442c0b1440 2023-11-04T01:44:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.678+0000 7f4432677640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f442c0b1440 0x7f442c06a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.678+0000 7f4431e76640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f442c15d1b0 0x7f442c06c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52512/0 (socket says 172.21.15.114:52512) 2023-11-04T01:44:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.678+0000 7f4431e76640 1 -- 172.21.15.114:0/3323732142 learned_addr learned my addr 172.21.15.114:0/3323732142 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.678+0000 7f4430e74640 1 -- 172.21.15.114:0/3323732142 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143514177 0 0) 0x7f442c06c950 con 0x7f442c15d1b0 2023-11-04T01:44:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.678+0000 7f4430e74640 1 -- 172.21.15.114:0/3323732142 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4418003520 con 0x7f442c15d1b0 2023-11-04T01:44:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.678+0000 7f4432677640 1 -- 172.21.15.114:0/3323732142 >> v1:172.21.15.141:6789/0 conn(0x7f442c0b30d0 legacy=0x7f442c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.678+0000 7f4432677640 1 -- 172.21.15.114:0/3323732142 >> v1:172.21.15.114:6789/0 conn(0x7f442c15d1b0 legacy=0x7f442c06c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.678+0000 7f4432677640 1 -- 172.21.15.114:0/3323732142 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c0b25f0 con 0x7f442c0b1440 2023-11-04T01:44:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.679+0000 7f4432677640 1 --2- 172.21.15.114:0/3323732142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f442c0b1440 0x7f442c06a0d0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f44240097a0 tx=0x7f442402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3fb0ce51e2e42b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.679+0000 7f4430e74640 1 -- 172.21.15.114:0/3323732142 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424030610 con 0x7f442c0b1440 2023-11-04T01:44:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.679+0000 7f4430e74640 1 -- 172.21.15.114:0/3323732142 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4424030770 con 0x7f442c0b1440 2023-11-04T01:44:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.679+0000 7f4430e74640 1 -- 172.21.15.114:0/3323732142 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424030ae0 con 0x7f442c0b1440 2023-11-04T01:44:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.680+0000 7f44340da640 1 -- 172.21.15.114:0/3323732142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f442c0b1440 msgr2=0x7f442c06a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.680+0000 7f44340da640 1 --2- 172.21.15.114:0/3323732142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f442c0b1440 0x7f442c06a0d0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f44240097a0 tx=0x7f442402b960 comp rx=0 tx=0).stop 2023-11-04T01:44:01.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.680+0000 7f44340da640 1 -- 172.21.15.114:0/3323732142 shutdown_connections 2023-11-04T01:44:01.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.680+0000 7f44340da640 1 --2- 172.21.15.114:0/3323732142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f442c0b1440 0x7f442c06a0d0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.680+0000 7f44340da640 1 -- 172.21.15.114:0/3323732142 >> 172.21.15.114:0/3323732142 conn(0x7f442c0cbd30 msgr2=0x7f442c0cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:01.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.680+0000 7f44340da640 1 -- 172.21.15.114:0/3323732142 shutdown_connections 2023-11-04T01:44:01.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.680+0000 7f44340da640 1 -- 172.21.15.114:0/3323732142 wait complete. 2023-11-04T01:44:01.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.681+0000 7f44340da640 1 Processor -- start 2023-11-04T01:44:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.681+0000 7f44340da640 1 -- start start 2023-11-04T01:44:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.682+0000 7f44340da640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f442c0b1440 0x7f442c09bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.682+0000 7f44340da640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f442c0b30d0 0x7f442c09aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.682+0000 7f44340da640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f442c15d1b0 0x7f442c0c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.682+0000 7f44340da640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c0c8920 con 0x7f442c0b30d0 2023-11-04T01:44:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.682+0000 7f44340da640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c09afe0 con 0x7f442c15d1b0 2023-11-04T01:44:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.682+0000 7f44340da640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442c09b260 con 0x7f442c0b1440 2023-11-04T01:44:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.682+0000 7f4431675640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f442c0b30d0 0x7f442c09aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.682+0000 7f4431675640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f442c0b30d0 0x7f442c09aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38628/0 (socket says 172.21.15.114:38628) 2023-11-04T01:44:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.682+0000 7f4431675640 1 -- 172.21.15.114:0/1673065787 learned_addr learned my addr 172.21.15.114:0/1673065787 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.682+0000 7f4431675640 1 -- 172.21.15.114:0/1673065787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f442c0b1440 msgr2=0x7f442c09bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.682+0000 7f4431675640 1 --2- 172.21.15.114:0/1673065787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f442c0b1440 0x7f442c09bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.682+0000 7f4431675640 1 -- 172.21.15.114:0/1673065787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f442c15d1b0 msgr2=0x7f442c0c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.682+0000 7f4431675640 1 --2- 172.21.15.114:0/1673065787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f442c15d1b0 0x7f442c0c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.682+0000 7f4431675640 1 -- 172.21.15.114:0/1673065787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4424009400 con 0x7f442c0b30d0 2023-11-04T01:44:01.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.682+0000 7f4431675640 1 --2- 172.21.15.114:0/1673065787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f442c0b30d0 0x7f442c09aaa0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c460 tx=0x7f441c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:01.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.682+0000 7f44227fc640 1 -- 172.21.15.114:0/1673065787 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c012830 con 0x7f442c0b30d0 2023-11-04T01:44:01.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.683+0000 7f44227fc640 1 -- 172.21.15.114:0/1673065787 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c0129d0 con 0x7f442c0b30d0 2023-11-04T01:44:01.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.683+0000 7f44227fc640 1 -- 172.21.15.114:0/1673065787 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c012d80 con 0x7f442c0b30d0 2023-11-04T01:44:01.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.683+0000 7f44340da640 1 -- 172.21.15.114:0/1673065787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442c09b540 con 0x7f442c0b30d0 2023-11-04T01:44:01.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.683+0000 7f44340da640 1 -- 172.21.15.114:0/1673065787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442c09bb00 con 0x7f442c0b30d0 2023-11-04T01:44:01.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.683+0000 7f44340da640 1 -- 172.21.15.114:0/1673065787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f442c066600 con 0x7f442c0b30d0 2023-11-04T01:44:01.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.684+0000 7f44227fc640 1 -- 172.21.15.114:0/1673065787 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f441c01a3b0 con 0x7f442c0b30d0 2023-11-04T01:44:01.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.684+0000 7f44227fc640 1 --2- 172.21.15.114:0/1673065787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f441006ae70 0x7f441006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.684+0000 7f44227fc640 1 -- 172.21.15.114:0/1673065787 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8038+0+0 (secure 0 0 0) 0x7f441c089ae0 con 0x7f442c0b30d0 2023-11-04T01:44:01.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.684+0000 7f4431e76640 1 --2- 172.21.15.114:0/1673065787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f441006ae70 0x7f441006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.685+0000 7f4431e76640 1 --2- 172.21.15.114:0/1673065787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f441006ae70 0x7f441006d330 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f44280015e0 tx=0x7f4428007b40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:01.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.688+0000 7f44227fc640 1 -- 172.21.15.114:0/1673065787 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f441c054300 con 0x7f442c0b30d0 2023-11-04T01:44:01.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.889+0000 7f44340da640 1 -- 172.21.15.114:0/1673065787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f442c0684b0 con 0x7f442c0b30d0 2023-11-04T01:44:01.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.889+0000 7f44227fc640 1 -- 172.21.15.114:0/1673065787 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4149 (secure 0 0 0) 0x7f441c057920 con 0x7f442c0b30d0 2023-11-04T01:44:01.891 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:01.891 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":108,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:01.562419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:01.891 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 108 2023-11-04T01:44:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.891+0000 7f44340da640 1 -- 172.21.15.114:0/1673065787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f441006ae70 msgr2=0x7f441006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.891+0000 7f44340da640 1 --2- 172.21.15.114:0/1673065787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f441006ae70 0x7f441006d330 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f44280015e0 tx=0x7f4428007b40 comp rx=0 tx=0).stop 2023-11-04T01:44:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.891+0000 7f44340da640 1 -- 172.21.15.114:0/1673065787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f442c0b30d0 msgr2=0x7f442c09aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.891+0000 7f44340da640 1 --2- 172.21.15.114:0/1673065787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f442c0b30d0 0x7f442c09aaa0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c460 tx=0x7f441c00c920 comp rx=0 tx=0).stop 2023-11-04T01:44:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.891+0000 7f44340da640 1 -- 172.21.15.114:0/1673065787 shutdown_connections 2023-11-04T01:44:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.891+0000 7f44340da640 1 --2- 172.21.15.114:0/1673065787 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f441006ae70 0x7f441006d330 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.891+0000 7f44340da640 1 --2- 172.21.15.114:0/1673065787 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f442c15d1b0 0x7f442c0c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.891+0000 7f44340da640 1 --2- 172.21.15.114:0/1673065787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f442c0b30d0 0x7f442c09aaa0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.891+0000 7f44340da640 1 --2- 172.21.15.114:0/1673065787 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f442c0b1440 0x7f442c09bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.891+0000 7f44340da640 1 -- 172.21.15.114:0/1673065787 >> 172.21.15.114:0/1673065787 conn(0x7f442c0cbd30 msgr2=0x7f442c159f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:01.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.891+0000 7f44340da640 1 -- 172.21.15.114:0/1673065787 shutdown_connections 2023-11-04T01:44:01.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:01.891+0000 7f44340da640 1 -- 172.21.15.114:0/1673065787 wait complete. 2023-11-04T01:44:01.903 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:44:04.786 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:44:04.787 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-04T01:44:06.905 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:07.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.014+0000 7f314c46f640 1 Processor -- start 2023-11-04T01:44:07.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.014+0000 7f314c46f640 1 -- start start 2023-11-04T01:44:07.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.015+0000 7f314c46f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f31440ade00 0x7f31440b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.015+0000 7f314c46f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f314406c5f0 0x7f31440cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.015+0000 7f314c46f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314406cc90 con 0x7f314406d9c0 2023-11-04T01:44:07.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.015+0000 7f314c46f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31440b0e60 con 0x7f314406c5f0 2023-11-04T01:44:07.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.015+0000 7f314c46f640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314406cee0 con 0x7f31440ade00 2023-11-04T01:44:07.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.015+0000 7f314aa0c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f314406c5f0 0x7f31440cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.015+0000 7f3149a0a640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f314406d9c0 0x7f31440710d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44684/0 (socket says 172.21.15.114:44684) 2023-11-04T01:44:07.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.015+0000 7f3149a0a640 1 -- 172.21.15.114:0/677773562 learned_addr learned my addr 172.21.15.114:0/677773562 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:07.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.015+0000 7f3149209640 1 -- 172.21.15.114:0/677773562 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443740022 0 0) 0x7f314406cc90 con 0x7f314406d9c0 2023-11-04T01:44:07.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.015+0000 7f314a20b640 1 --2- 172.21.15.114:0/677773562 >> v2:172.21.15.141:3300/0 conn(0x7f31440ade00 0x7f31440b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.015+0000 7f3149209640 1 -- 172.21.15.114:0/677773562 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3130003520 con 0x7f314406d9c0 2023-11-04T01:44:07.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.015+0000 7f314aa0c640 1 -- 172.21.15.114:0/677773562 >> v2:172.21.15.141:3300/0 conn(0x7f31440ade00 msgr2=0x7f31440b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.015+0000 7f314aa0c640 1 --2- 172.21.15.114:0/677773562 >> v2:172.21.15.141:3300/0 conn(0x7f31440ade00 0x7f31440b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.015+0000 7f314aa0c640 1 -- 172.21.15.114:0/677773562 >> v1:172.21.15.114:6789/0 conn(0x7f314406d9c0 legacy=0x7f31440710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.015+0000 7f314aa0c640 1 -- 172.21.15.114:0/677773562 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314406d1c0 con 0x7f314406c5f0 2023-11-04T01:44:07.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.015+0000 7f314a20b640 1 --2- 172.21.15.114:0/677773562 >> v2:172.21.15.141:3300/0 conn(0x7f31440ade00 0x7f31440b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:07.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.016+0000 7f314aa0c640 1 --2- 172.21.15.114:0/677773562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f314406c5f0 0x7f31440cc680 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f31440cb430 tx=0x7f313c02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59aeed05efdbf853 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.016+0000 7f3149209640 1 -- 172.21.15.114:0/677773562 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c02cb60 con 0x7f314406c5f0 2023-11-04T01:44:07.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.016+0000 7f3149209640 1 -- 172.21.15.114:0/677773562 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c02ccc0 con 0x7f314406c5f0 2023-11-04T01:44:07.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.016+0000 7f3149209640 1 -- 172.21.15.114:0/677773562 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c034660 con 0x7f314406c5f0 2023-11-04T01:44:07.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.017+0000 7f314c46f640 1 -- 172.21.15.114:0/677773562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f314406c5f0 msgr2=0x7f31440cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.017+0000 7f314c46f640 1 --2- 172.21.15.114:0/677773562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f314406c5f0 0x7f31440cc680 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f31440cb430 tx=0x7f313c02bdb0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.017+0000 7f314c46f640 1 -- 172.21.15.114:0/677773562 shutdown_connections 2023-11-04T01:44:07.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.017+0000 7f314c46f640 1 --2- 172.21.15.114:0/677773562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f314406c5f0 0x7f31440cc680 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.017+0000 7f314c46f640 1 --2- 172.21.15.114:0/677773562 >> v2:172.21.15.141:3300/0 conn(0x7f31440ade00 0x7f31440b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.017+0000 7f314c46f640 1 -- 172.21.15.114:0/677773562 >> 172.21.15.114:0/677773562 conn(0x7f31440cb530 msgr2=0x7f31440cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.017+0000 7f314c46f640 1 -- 172.21.15.114:0/677773562 shutdown_connections 2023-11-04T01:44:07.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.017+0000 7f314c46f640 1 -- 172.21.15.114:0/677773562 wait complete. 2023-11-04T01:44:07.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.018+0000 7f314c46f640 1 Processor -- start 2023-11-04T01:44:07.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.018+0000 7f314c46f640 1 -- start start 2023-11-04T01:44:07.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314c46f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f314406c5f0 0x7f31441f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314c46f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f314406d9c0 0x7f31441f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314c46f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31440ade00 0x7f31441547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314c46f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31441f6da0 con 0x7f31440ade00 2023-11-04T01:44:07.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314c46f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3144154ce0 con 0x7f314406d9c0 2023-11-04T01:44:07.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314c46f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31441f6500 con 0x7f314406c5f0 2023-11-04T01:44:07.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314aa0c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31440ade00 0x7f31441547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314aa0c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31440ade00 0x7f31441547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55558/0 (socket says 172.21.15.114:55558) 2023-11-04T01:44:07.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314aa0c640 1 -- 172.21.15.114:0/3477729270 learned_addr learned my addr 172.21.15.114:0/3477729270 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:07.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f3149a0a640 1 --2- 172.21.15.114:0/3477729270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f314406d9c0 0x7f31441f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314a20b640 1 --2- 172.21.15.114:0/3477729270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f314406c5f0 0x7f31441f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314aa0c640 1 -- 172.21.15.114:0/3477729270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f314406c5f0 msgr2=0x7f31441f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314aa0c640 1 --2- 172.21.15.114:0/3477729270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f314406c5f0 0x7f31441f5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314aa0c640 1 -- 172.21.15.114:0/3477729270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f314406d9c0 msgr2=0x7f31441f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314aa0c640 1 --2- 172.21.15.114:0/3477729270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f314406d9c0 0x7f31441f3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314aa0c640 1 -- 172.21.15.114:0/3477729270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c009a70 con 0x7f31440ade00 2023-11-04T01:44:07.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314a20b640 1 --2- 172.21.15.114:0/3477729270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f314406c5f0 0x7f31441f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:07.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f314aa0c640 1 --2- 172.21.15.114:0/3477729270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31440ade00 0x7f31441547a0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f313c037040 tx=0x7f313c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.019+0000 7f313affd640 1 -- 172.21.15.114:0/3477729270 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c040650 con 0x7f31440ade00 2023-11-04T01:44:07.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.020+0000 7f313affd640 1 -- 172.21.15.114:0/3477729270 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c0407b0 con 0x7f31440ade00 2023-11-04T01:44:07.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.020+0000 7f314c46f640 1 -- 172.21.15.114:0/3477729270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31441f67e0 con 0x7f31440ade00 2023-11-04T01:44:07.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.020+0000 7f313affd640 1 -- 172.21.15.114:0/3477729270 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c040b60 con 0x7f31440ade00 2023-11-04T01:44:07.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.020+0000 7f314c46f640 1 -- 172.21.15.114:0/3477729270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31440c9c70 con 0x7f31440ade00 2023-11-04T01:44:07.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.020+0000 7f314c46f640 1 -- 172.21.15.114:0/3477729270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31440c9e60 con 0x7f31440ade00 2023-11-04T01:44:07.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.021+0000 7f313affd640 1 -- 172.21.15.114:0/3477729270 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f313c040cc0 con 0x7f31440ade00 2023-11-04T01:44:07.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.021+0000 7f313affd640 1 --2- 172.21.15.114:0/3477729270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f312806aea0 0x7f312806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.022+0000 7f313affd640 1 -- 172.21.15.114:0/3477729270 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8038+0+0 (secure 0 0 0) 0x7f313c0accb0 con 0x7f31440ade00 2023-11-04T01:44:07.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.022+0000 7f314a20b640 1 --2- 172.21.15.114:0/3477729270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f312806aea0 0x7f312806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.022+0000 7f314a20b640 1 --2- 172.21.15.114:0/3477729270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f312806aea0 0x7f312806d360 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f314000aa30 tx=0x7f3140008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.026+0000 7f313affd640 1 -- 172.21.15.114:0/3477729270 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f313c0773b0 con 0x7f31440ade00 2023-11-04T01:44:07.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.228+0000 7f314c46f640 1 -- 172.21.15.114:0/3477729270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31440684b0 con 0x7f31440ade00 2023-11-04T01:44:07.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.229+0000 7f313affd640 1 -- 172.21.15.114:0/3477729270 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4946 (secure 0 0 0) 0x7f313c039090 con 0x7f31440ade00 2023-11-04T01:44:07.231 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:07.231 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":109,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:01.577843+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:resolve","state_seq":12,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:07.231 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 109 2023-11-04T01:44:07.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.231+0000 7f314c46f640 1 -- 172.21.15.114:0/3477729270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f312806aea0 msgr2=0x7f312806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.231+0000 7f314c46f640 1 --2- 172.21.15.114:0/3477729270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f312806aea0 0x7f312806d360 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f314000aa30 tx=0x7f3140008040 comp rx=0 tx=0).stop 2023-11-04T01:44:07.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.231+0000 7f314c46f640 1 -- 172.21.15.114:0/3477729270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31440ade00 msgr2=0x7f31441547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.231+0000 7f314c46f640 1 --2- 172.21.15.114:0/3477729270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31440ade00 0x7f31441547a0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f313c037040 tx=0x7f313c004a40 comp rx=0 tx=0).stop 2023-11-04T01:44:07.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.231+0000 7f314c46f640 1 -- 172.21.15.114:0/3477729270 shutdown_connections 2023-11-04T01:44:07.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.231+0000 7f314c46f640 1 --2- 172.21.15.114:0/3477729270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31440ade00 0x7f31441547a0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.231+0000 7f314c46f640 1 --2- 172.21.15.114:0/3477729270 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f312806aea0 0x7f312806d360 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.231+0000 7f314c46f640 1 --2- 172.21.15.114:0/3477729270 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f314406d9c0 0x7f31441f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.231+0000 7f314c46f640 1 --2- 172.21.15.114:0/3477729270 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f314406c5f0 0x7f31441f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.231+0000 7f314c46f640 1 -- 172.21.15.114:0/3477729270 >> 172.21.15.114:0/3477729270 conn(0x7f31440cb530 msgr2=0x7f31440ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.231+0000 7f314c46f640 1 -- 172.21.15.114:0/3477729270 shutdown_connections 2023-11-04T01:44:07.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.231+0000 7f314c46f640 1 -- 172.21.15.114:0/3477729270 wait complete. 2023-11-04T01:44:07.243 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:44:07.243 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:07.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.341+0000 7fdcd5d6c640 1 Processor -- start 2023-11-04T01:44:07.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.341+0000 7fdcd5d6c640 1 -- start start 2023-11-04T01:44:07.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.341+0000 7fdcd5d6c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdcd0159e40 0x7fdcd00b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.341+0000 7fdcd5d6c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcd006bb60 0x7fdcd00b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.341+0000 7fdcd5d6c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fdcd006fff0 0x7fdcd0070480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.341+0000 7fdcd5d6c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd0071500 con 0x7fdcd0159e40 2023-11-04T01:44:07.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.341+0000 7fdcd5d6c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd015dae0 con 0x7fdcd006fff0 2023-11-04T01:44:07.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.341+0000 7fdcd5d6c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd00709c0 con 0x7fdcd006bb60 2023-11-04T01:44:07.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.342+0000 7fdccf7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdcd0159e40 0x7fdcd00b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.342+0000 7fdccf7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdcd0159e40 0x7fdcd00b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55570/0 (socket says 172.21.15.114:55570) 2023-11-04T01:44:07.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.342+0000 7fdccf7fe640 1 -- 172.21.15.114:0/1076775175 learned_addr learned my addr 172.21.15.114:0/1076775175 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:07.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.342+0000 7fdcceffd640 1 --2- 172.21.15.114:0/1076775175 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcd006bb60 0x7fdcd00b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.342+0000 7fdccffff640 1 --2- 172.21.15.114:0/1076775175 >> v2:172.21.15.141:3300/0 conn(0x7fdcd006fff0 0x7fdcd0070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.342+0000 7fdccf7fe640 1 -- 172.21.15.114:0/1076775175 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcd006bb60 msgr2=0x7fdcd00b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.342+0000 7fdccf7fe640 1 --2- 172.21.15.114:0/1076775175 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcd006bb60 0x7fdcd00b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.342+0000 7fdccf7fe640 1 -- 172.21.15.114:0/1076775175 >> v2:172.21.15.141:3300/0 conn(0x7fdcd006fff0 msgr2=0x7fdcd0070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.342+0000 7fdccf7fe640 1 --2- 172.21.15.114:0/1076775175 >> v2:172.21.15.141:3300/0 conn(0x7fdcd006fff0 0x7fdcd0070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.342+0000 7fdccf7fe640 1 -- 172.21.15.114:0/1076775175 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd0070c60 con 0x7fdcd0159e40 2023-11-04T01:44:07.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.342+0000 7fdccffff640 1 --2- 172.21.15.114:0/1076775175 >> v2:172.21.15.141:3300/0 conn(0x7fdcd006fff0 0x7fdcd0070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:07.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.343+0000 7fdccf7fe640 1 --2- 172.21.15.114:0/1076775175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd0159e40 0x7fdcd00b0530 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00cea40 tx=0x7fdcc002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c070a5424523e0f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.343+0000 7fdcce7fc640 1 -- 172.21.15.114:0/1076775175 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00317e0 con 0x7fdcd0159e40 2023-11-04T01:44:07.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.343+0000 7fdcce7fc640 1 -- 172.21.15.114:0/1076775175 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc0031940 con 0x7fdcd0159e40 2023-11-04T01:44:07.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.343+0000 7fdcce7fc640 1 -- 172.21.15.114:0/1076775175 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0031cd0 con 0x7fdcd0159e40 2023-11-04T01:44:07.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.343+0000 7fdcd5d6c640 1 -- 172.21.15.114:0/1076775175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd0159e40 msgr2=0x7fdcd00b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.343+0000 7fdcd5d6c640 1 --2- 172.21.15.114:0/1076775175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd0159e40 0x7fdcd00b0530 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00cea40 tx=0x7fdcc002b880 comp rx=0 tx=0).stop 2023-11-04T01:44:07.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.343+0000 7fdcd5d6c640 1 -- 172.21.15.114:0/1076775175 shutdown_connections 2023-11-04T01:44:07.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.343+0000 7fdcd5d6c640 1 --2- 172.21.15.114:0/1076775175 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcd006bb60 0x7fdcd00b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.343+0000 7fdcd5d6c640 1 --2- 172.21.15.114:0/1076775175 >> v2:172.21.15.141:3300/0 conn(0x7fdcd006fff0 0x7fdcd0070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.343+0000 7fdcd5d6c640 1 --2- 172.21.15.114:0/1076775175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd0159e40 0x7fdcd00b0530 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.343+0000 7fdcd5d6c640 1 -- 172.21.15.114:0/1076775175 >> 172.21.15.114:0/1076775175 conn(0x7fdcd00cb530 msgr2=0x7fdcd00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.343+0000 7fdcd5d6c640 1 -- 172.21.15.114:0/1076775175 shutdown_connections 2023-11-04T01:44:07.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.343+0000 7fdcd5d6c640 1 -- 172.21.15.114:0/1076775175 wait complete. 2023-11-04T01:44:07.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.344+0000 7fdcd5d6c640 1 Processor -- start 2023-11-04T01:44:07.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.345+0000 7fdcd5d6c640 1 -- start start 2023-11-04T01:44:07.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.345+0000 7fdcd5d6c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcd006bb60 0x7fdcd0150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.345+0000 7fdcd5d6c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd006fff0 0x7fdcd00c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.345+0000 7fdcd5d6c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdcd0159e40 0x7fdcd00ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.345+0000 7fdcd5d6c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd00c6240 con 0x7fdcd006fff0 2023-11-04T01:44:07.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.345+0000 7fdcd5d6c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd0151180 con 0x7fdcd0159e40 2023-11-04T01:44:07.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.345+0000 7fdcd5d6c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd00af060 con 0x7fdcd006bb60 2023-11-04T01:44:07.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.345+0000 7fdcceffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd006fff0 0x7fdcd00c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdcceffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd006fff0 0x7fdcd00c4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55584/0 (socket says 172.21.15.114:55584) 2023-11-04T01:44:07.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdcceffd640 1 -- 172.21.15.114:0/3510961555 learned_addr learned my addr 172.21.15.114:0/3510961555 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:07.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdccf7fe640 1 --2- 172.21.15.114:0/3510961555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcd006bb60 0x7fdcd0150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdccffff640 1 --2- 172.21.15.114:0/3510961555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdcd0159e40 0x7fdcd00ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdcceffd640 1 -- 172.21.15.114:0/3510961555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcd006bb60 msgr2=0x7fdcd0150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdcceffd640 1 --2- 172.21.15.114:0/3510961555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcd006bb60 0x7fdcd0150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdcceffd640 1 -- 172.21.15.114:0/3510961555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdcd0159e40 msgr2=0x7fdcd00ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdcceffd640 1 --2- 172.21.15.114:0/3510961555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdcd0159e40 0x7fdcd00ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdcceffd640 1 -- 172.21.15.114:0/3510961555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc00094d0 con 0x7fdcd006fff0 2023-11-04T01:44:07.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdccf7fe640 1 --2- 172.21.15.114:0/3510961555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcd006bb60 0x7fdcd0150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:07.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdccffff640 1 --2- 172.21.15.114:0/3510961555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdcd0159e40 0x7fdcd00ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:07.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdcceffd640 1 --2- 172.21.15.114:0/3510961555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd006fff0 0x7fdcd00c4fa0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400d800 tx=0x7fdcc400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdcb7fff640 1 -- 172.21.15.114:0/3510961555 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40096a0 con 0x7fdcd006fff0 2023-11-04T01:44:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdcb7fff640 1 -- 172.21.15.114:0/3510961555 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc4009800 con 0x7fdcd006fff0 2023-11-04T01:44:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdcd5d6c640 1 -- 172.21.15.114:0/3510961555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd00af340 con 0x7fdcd006fff0 2023-11-04T01:44:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdcb7fff640 1 -- 172.21.15.114:0/3510961555 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4009990 con 0x7fdcd006fff0 2023-11-04T01:44:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.346+0000 7fdcd5d6c640 1 -- 172.21.15.114:0/3510961555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd00c5e60 con 0x7fdcd006fff0 2023-11-04T01:44:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.347+0000 7fdcd5d6c640 1 -- 172.21.15.114:0/3510961555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd00b0930 con 0x7fdcd006fff0 2023-11-04T01:44:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.347+0000 7fdcb7fff640 1 -- 172.21.15.114:0/3510961555 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdcc4009af0 con 0x7fdcd006fff0 2023-11-04T01:44:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.348+0000 7fdcb7fff640 1 --2- 172.21.15.114:0/3510961555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdcbc06ae70 0x7fdcbc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.348+0000 7fdccf7fe640 1 --2- 172.21.15.114:0/3510961555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdcbc06ae70 0x7fdcbc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.348+0000 7fdcb7fff640 1 -- 172.21.15.114:0/3510961555 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8038+0+0 (secure 0 0 0) 0x7fdcc408a310 con 0x7fdcd006fff0 2023-11-04T01:44:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.348+0000 7fdccf7fe640 1 --2- 172.21.15.114:0/3510961555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdcbc06ae70 0x7fdcbc06d330 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0036000 tx=0x7fdcc003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.352+0000 7fdcb7fff640 1 -- 172.21.15.114:0/3510961555 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdcc4054bf0 con 0x7fdcd006fff0 2023-11-04T01:44:07.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.552+0000 7fdcd5d6c640 1 -- 172.21.15.114:0/3510961555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcd00684b0 con 0x7fdcd006fff0 2023-11-04T01:44:07.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.552+0000 7fdcb7fff640 1 -- 172.21.15.114:0/3510961555 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4946 (secure 0 0 0) 0x7fdcc4058210 con 0x7fdcd006fff0 2023-11-04T01:44:07.554 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:07.554 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":109,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:01.577843+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:resolve","state_seq":12,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:07.555 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 109 2023-11-04T01:44:07.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.554+0000 7fdcd5d6c640 1 -- 172.21.15.114:0/3510961555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdcbc06ae70 msgr2=0x7fdcbc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.554+0000 7fdcd5d6c640 1 --2- 172.21.15.114:0/3510961555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdcbc06ae70 0x7fdcbc06d330 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0036000 tx=0x7fdcc003d040 comp rx=0 tx=0).stop 2023-11-04T01:44:07.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.554+0000 7fdcd5d6c640 1 -- 172.21.15.114:0/3510961555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd006fff0 msgr2=0x7fdcd00c4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.554+0000 7fdcd5d6c640 1 --2- 172.21.15.114:0/3510961555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd006fff0 0x7fdcd00c4fa0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400d800 tx=0x7fdcc400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.554+0000 7fdcd5d6c640 1 -- 172.21.15.114:0/3510961555 shutdown_connections 2023-11-04T01:44:07.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.554+0000 7fdcd5d6c640 1 --2- 172.21.15.114:0/3510961555 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdcbc06ae70 0x7fdcbc06d330 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.554+0000 7fdcd5d6c640 1 --2- 172.21.15.114:0/3510961555 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdcd0159e40 0x7fdcd00ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.554+0000 7fdcd5d6c640 1 --2- 172.21.15.114:0/3510961555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcd006fff0 0x7fdcd00c4fa0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.554+0000 7fdcd5d6c640 1 --2- 172.21.15.114:0/3510961555 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdcd006bb60 0x7fdcd0150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.554+0000 7fdcd5d6c640 1 -- 172.21.15.114:0/3510961555 >> 172.21.15.114:0/3510961555 conn(0x7fdcd00cb530 msgr2=0x7fdcd00ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.554+0000 7fdcd5d6c640 1 -- 172.21.15.114:0/3510961555 shutdown_connections 2023-11-04T01:44:07.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.554+0000 7fdcd5d6c640 1 -- 172.21.15.114:0/3510961555 wait complete. 2023-11-04T01:44:07.567 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:44:07.567 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.3236703872680664s 2023-11-04T01:44:07.567 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:07.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.665+0000 7f7fb5705640 1 Processor -- start 2023-11-04T01:44:07.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.665+0000 7f7fb5705640 1 -- start start 2023-11-04T01:44:07.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.666+0000 7f7fb5705640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fb015b200 0x7f7fb00ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.666+0000 7f7fb5705640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7fb00cd9c0 0x7f7fb00ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.666+0000 7f7fb5705640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb00cde80 con 0x7f7fb00afda0 2023-11-04T01:44:07.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.666+0000 7f7fb5705640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb00cf670 con 0x7f7fb00cd9c0 2023-11-04T01:44:07.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.666+0000 7f7fb5705640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00cf950 con 0x7f7fb015b200 2023-11-04T01:44:07.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.666+0000 7f7faeffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fb015b200 0x7f7fb00ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.666+0000 7f7faf7fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7fb00cd9c0 0x7f7fb00ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.666+0000 7f7faeffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fb015b200 0x7f7fb00ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:43114/0 (socket says 172.21.15.114:43114) 2023-11-04T01:44:07.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.666+0000 7f7fae7fc640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f7fb00afda0 0x7f7fb00cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:41480/0 (socket says 172.21.15.114:41480) 2023-11-04T01:44:07.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.666+0000 7f7faf7fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7fb00cd9c0 0x7f7fb00ae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:38640/0 (socket says 172.21.15.114:38640) 2023-11-04T01:44:07.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.666+0000 7f7faeffd640 1 -- 172.21.15.114:0/3375406517 learned_addr learned my addr 172.21.15.114:0/3375406517 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:07.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.667+0000 7f7faeffd640 1 -- 172.21.15.114:0/3375406517 >> v2:172.21.15.141:3300/0 conn(0x7f7fb00cd9c0 msgr2=0x7f7fb00ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.667+0000 7f7faeffd640 1 --2- 172.21.15.114:0/3375406517 >> v2:172.21.15.141:3300/0 conn(0x7f7fb00cd9c0 0x7f7fb00ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.667+0000 7f7faeffd640 1 -- 172.21.15.114:0/3375406517 >> v1:172.21.15.141:6789/0 conn(0x7f7fb00afda0 legacy=0x7f7fb00cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.667+0000 7f7faeffd640 1 -- 172.21.15.114:0/3375406517 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb00ce120 con 0x7f7fb015b200 2023-11-04T01:44:07.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.667+0000 7f7faf7fe640 1 --2- 172.21.15.114:0/3375406517 >> v2:172.21.15.141:3300/0 conn(0x7f7fb00cd9c0 0x7f7fb00ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:07.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.667+0000 7f7faeffd640 1 --2- 172.21.15.114:0/3375406517 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fb015b200 0x7f7fb00ceb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009ea0 tx=0x7f7fa002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edfc6121f0ac4014 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.668+0000 7f7fadffb640 1 -- 172.21.15.114:0/3375406517 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa002cac0 con 0x7f7fb015b200 2023-11-04T01:44:07.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.668+0000 7f7fadffb640 1 -- 172.21.15.114:0/3375406517 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa002cc20 con 0x7f7fb015b200 2023-11-04T01:44:07.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.668+0000 7f7fadffb640 1 -- 172.21.15.114:0/3375406517 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00343f0 con 0x7f7fb015b200 2023-11-04T01:44:07.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.668+0000 7f7fb5705640 1 -- 172.21.15.114:0/3375406517 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fb015b200 msgr2=0x7f7fb00ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.668+0000 7f7fb5705640 1 --2- 172.21.15.114:0/3375406517 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fb015b200 0x7f7fb00ceb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009ea0 tx=0x7f7fa002bf20 comp rx=0 tx=0).stop 2023-11-04T01:44:07.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.668+0000 7f7fb5705640 1 -- 172.21.15.114:0/3375406517 shutdown_connections 2023-11-04T01:44:07.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.668+0000 7f7fb5705640 1 --2- 172.21.15.114:0/3375406517 >> v2:172.21.15.141:3300/0 conn(0x7f7fb00cd9c0 0x7f7fb00ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.668+0000 7f7fb5705640 1 --2- 172.21.15.114:0/3375406517 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fb015b200 0x7f7fb00ceb30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.668+0000 7f7fb5705640 1 -- 172.21.15.114:0/3375406517 >> 172.21.15.114:0/3375406517 conn(0x7f7fb00d0c30 msgr2=0x7f7fb00d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.668+0000 7f7fb5705640 1 -- 172.21.15.114:0/3375406517 shutdown_connections 2023-11-04T01:44:07.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.668+0000 7f7fb5705640 1 -- 172.21.15.114:0/3375406517 wait complete. 2023-11-04T01:44:07.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.670+0000 7f7fb5705640 1 Processor -- start 2023-11-04T01:44:07.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.670+0000 7f7fb5705640 1 -- start start 2023-11-04T01:44:07.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.670+0000 7f7fb5705640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fb00afda0 0x7f7fb00c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.670+0000 7f7fb5705640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fb00cd9c0 0x7f7fb006e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.670+0000 7f7fb5705640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fb015b200 0x7f7fb00b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.670+0000 7f7fb5705640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00b4b60 con 0x7f7fb00cd9c0 2023-11-04T01:44:07.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.670+0000 7f7fb5705640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00b4e40 con 0x7f7fb015b200 2023-11-04T01:44:07.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.670+0000 7f7fb5705640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00b5120 con 0x7f7fb00afda0 2023-11-04T01:44:07.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.670+0000 7f7fae7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fb00cd9c0 0x7f7fb006e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.670+0000 7f7fae7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fb00cd9c0 0x7f7fb006e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55596/0 (socket says 172.21.15.114:55596) 2023-11-04T01:44:07.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.670+0000 7f7fae7fc640 1 -- 172.21.15.114:0/1181511001 learned_addr learned my addr 172.21.15.114:0/1181511001 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:07.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.670+0000 7f7faeffd640 1 --2- 172.21.15.114:0/1181511001 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fb00afda0 0x7f7fb00c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.670+0000 7f7faf7fe640 1 --2- 172.21.15.114:0/1181511001 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fb015b200 0x7f7fb00b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.671+0000 7f7fae7fc640 1 -- 172.21.15.114:0/1181511001 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fb00afda0 msgr2=0x7f7fb00c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.671+0000 7f7fae7fc640 1 --2- 172.21.15.114:0/1181511001 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fb00afda0 0x7f7fb00c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.671+0000 7f7fae7fc640 1 -- 172.21.15.114:0/1181511001 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fb015b200 msgr2=0x7f7fb00b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.671+0000 7f7fae7fc640 1 --2- 172.21.15.114:0/1181511001 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fb015b200 0x7f7fb00b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.671+0000 7f7fae7fc640 1 -- 172.21.15.114:0/1181511001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa8009400 con 0x7f7fb00cd9c0 2023-11-04T01:44:07.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.671+0000 7f7fae7fc640 1 --2- 172.21.15.114:0/1181511001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fb00cd9c0 0x7f7fb006e540 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400c4d0 tx=0x7f7fa400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.671+0000 7f7f977fe640 1 -- 172.21.15.114:0/1181511001 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40074e0 con 0x7f7fb00cd9c0 2023-11-04T01:44:07.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.671+0000 7f7f977fe640 1 -- 172.21.15.114:0/1181511001 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa4007640 con 0x7f7fb00cd9c0 2023-11-04T01:44:07.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.671+0000 7f7fb5705640 1 -- 172.21.15.114:0/1181511001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa0009b30 con 0x7f7fb00cd9c0 2023-11-04T01:44:07.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.671+0000 7f7f977fe640 1 -- 172.21.15.114:0/1181511001 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40049e0 con 0x7f7fb00cd9c0 2023-11-04T01:44:07.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.671+0000 7f7fb5705640 1 -- 172.21.15.114:0/1181511001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb00b47f0 con 0x7f7fb00cd9c0 2023-11-04T01:44:07.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.672+0000 7f7fb5705640 1 -- 172.21.15.114:0/1181511001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb00684b0 con 0x7f7fb00cd9c0 2023-11-04T01:44:07.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.672+0000 7f7f977fe640 1 -- 172.21.15.114:0/1181511001 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7fa4004c00 con 0x7f7fb00cd9c0 2023-11-04T01:44:07.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.673+0000 7f7f977fe640 1 --2- 172.21.15.114:0/1181511001 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7f9c06ae70 0x7f7f9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.673+0000 7f7f977fe640 1 -- 172.21.15.114:0/1181511001 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8038+0+0 (secure 0 0 0) 0x7f7fa40897c0 con 0x7f7fb00cd9c0 2023-11-04T01:44:07.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.673+0000 7f7faeffd640 1 --2- 172.21.15.114:0/1181511001 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7f9c06ae70 0x7f7f9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.673+0000 7f7faeffd640 1 --2- 172.21.15.114:0/1181511001 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7f9c06ae70 0x7f7f9c06d330 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0035000 tx=0x7f7fa0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.677+0000 7f7f977fe640 1 -- 172.21.15.114:0/1181511001 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7fa4053fe0 con 0x7f7fb00cd9c0 2023-11-04T01:44:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.877+0000 7f7fb5705640 1 -- 172.21.15.114:0/1181511001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fb015a470 con 0x7f7fb00cd9c0 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.878+0000 7f7f977fe640 1 -- 172.21.15.114:0/1181511001 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4946 (secure 0 0 0) 0x7f7fa4057600 con 0x7f7fb00cd9c0 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":109,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:01.577843+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:resolve","state_seq":12,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 109 2023-11-04T01:44:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.880+0000 7f7fb5705640 1 -- 172.21.15.114:0/1181511001 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7f9c06ae70 msgr2=0x7f7f9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.880+0000 7f7fb5705640 1 --2- 172.21.15.114:0/1181511001 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7f9c06ae70 0x7f7f9c06d330 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0035000 tx=0x7f7fa0030000 comp rx=0 tx=0).stop 2023-11-04T01:44:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.880+0000 7f7fb5705640 1 -- 172.21.15.114:0/1181511001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fb00cd9c0 msgr2=0x7f7fb006e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.880+0000 7f7fb5705640 1 --2- 172.21.15.114:0/1181511001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fb00cd9c0 0x7f7fb006e540 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400c4d0 tx=0x7f7fa400c8d0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.880+0000 7f7fb5705640 1 -- 172.21.15.114:0/1181511001 shutdown_connections 2023-11-04T01:44:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.880+0000 7f7fb5705640 1 --2- 172.21.15.114:0/1181511001 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7f9c06ae70 0x7f7f9c06d330 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.880+0000 7f7fb5705640 1 --2- 172.21.15.114:0/1181511001 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7fb015b200 0x7f7fb00b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.880+0000 7f7fb5705640 1 --2- 172.21.15.114:0/1181511001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fb00cd9c0 0x7f7fb006e540 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.880+0000 7f7fb5705640 1 --2- 172.21.15.114:0/1181511001 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7fb00afda0 0x7f7fb00c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.880+0000 7f7fb5705640 1 -- 172.21.15.114:0/1181511001 >> 172.21.15.114:0/1181511001 conn(0x7f7fb00d0c30 msgr2=0x7f7fb00ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.880+0000 7f7fb5705640 1 -- 172.21.15.114:0/1181511001 shutdown_connections 2023-11-04T01:44:07.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:07.880+0000 7f7fb5705640 1 -- 172.21.15.114:0/1181511001 wait complete. 2023-11-04T01:44:07.892 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:44:08.006 INFO:teuthology.orchestra.run.smithi114.stdout:{"last_snap":12,"last_created":12,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:48.820894+0000","name":"s25","metadata":{}},{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:43:38.841671+0000","name":"s26","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:44:08.006 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 9, "last_snap": 12, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:48.820894+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:43:38.841671+0000" } ] } 2023-11-04T01:44:08.007 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:08.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.104+0000 7f7bed24b640 1 Processor -- start 2023-11-04T01:44:08.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.104+0000 7f7bed24b640 1 -- start start 2023-11-04T01:44:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.105+0000 7f7bed24b640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7be80cc680 0x7f7be80cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.105+0000 7f7bed24b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be80cd720 con 0x7f7be80addd0 2023-11-04T01:44:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.105+0000 7f7bed24b640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be80ae1b0 con 0x7f7be806c220 2023-11-04T01:44:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.105+0000 7f7bed24b640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be80ccb10 con 0x7f7be80cc680 2023-11-04T01:44:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.105+0000 7f7be6d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7be80addd0 0x7f7be806bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44686/0 (socket says 172.21.15.114:44686) 2023-11-04T01:44:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.105+0000 7f7be6d9d640 1 -- 172.21.15.114:0/3310741376 learned_addr learned my addr 172.21.15.114:0/3310741376 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.105+0000 7f7be5d9b640 1 -- 172.21.15.114:0/3310741376 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656569023 0 0) 0x7f7be80cd720 con 0x7f7be80addd0 2023-11-04T01:44:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.105+0000 7f7be5d9b640 1 -- 172.21.15.114:0/3310741376 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bd0003520 con 0x7f7be80addd0 2023-11-04T01:44:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.105+0000 7f7be659c640 1 --2- 172.21.15.114:0/3310741376 >> v2:172.21.15.141:3300/0 conn(0x7f7be80cc680 0x7f7be80cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.105+0000 7f7be5d9b640 1 -- 172.21.15.114:0/3310741376 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4085316388 0 0) 0x7f7bd0003520 con 0x7f7be80addd0 2023-11-04T01:44:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.105+0000 7f7be5d9b640 1 -- 172.21.15.114:0/3310741376 >> v2:172.21.15.141:3300/0 conn(0x7f7be80cc680 msgr2=0x7f7be80cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.105+0000 7f7be5d9b640 1 --2- 172.21.15.114:0/3310741376 >> v2:172.21.15.141:3300/0 conn(0x7f7be80cc680 0x7f7be80cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.105+0000 7f7be5d9b640 1 -- 172.21.15.114:0/3310741376 >> v1:172.21.15.141:6789/0 conn(0x7f7be806c220 legacy=0x7f7be806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.105+0000 7f7be5d9b640 1 -- 172.21.15.114:0/3310741376 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be80ccdf0 con 0x7f7be80addd0 2023-11-04T01:44:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.105+0000 7f7be5d9b640 1 -- 172.21.15.114:0/3310741376 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f7bd8001670 con 0x7f7be80addd0 2023-11-04T01:44:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.105+0000 7f7be5d9b640 1 -- 172.21.15.114:0/3310741376 >> v1:172.21.15.114:6789/0 conn(0x7f7be80addd0 legacy=0x7f7be806bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.106+0000 7f7be5d9b640 1 --2- 172.21.15.114:0/3310741376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bd0003970 0x7f7bd0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.106+0000 7f7be5d9b640 1 --2- 172.21.15.114:0/3310741376 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bd00047c0 0x7f7bd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.106+0000 7f7be5d9b640 1 --2- 172.21.15.114:0/3310741376 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7bd0005180 0x7f7bd000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.106+0000 7f7be5d9b640 1 -- 172.21.15.114:0/3310741376 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be80ccb10 con 0x7f7bd0003970 2023-11-04T01:44:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.106+0000 7f7be5d9b640 1 -- 172.21.15.114:0/3310741376 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd000c0d0 con 0x7f7bd00047c0 2023-11-04T01:44:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.106+0000 7f7be5d9b640 1 -- 172.21.15.114:0/3310741376 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd000c290 con 0x7f7bd0005180 2023-11-04T01:44:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.106+0000 7f7be6d9d640 1 --2- 172.21.15.114:0/3310741376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bd0003970 0x7f7bd0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.106+0000 7f7be659c640 1 --2- 172.21.15.114:0/3310741376 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bd00047c0 0x7f7bd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.106+0000 7f7be759e640 1 --2- 172.21.15.114:0/3310741376 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7bd0005180 0x7f7bd000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.106+0000 7f7be6d9d640 1 -- 172.21.15.114:0/3310741376 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7bd0005180 msgr2=0x7f7bd000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.106+0000 7f7be6d9d640 1 --2- 172.21.15.114:0/3310741376 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7bd0005180 0x7f7bd000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.106+0000 7f7be6d9d640 1 -- 172.21.15.114:0/3310741376 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bd00047c0 msgr2=0x7f7bd0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.106+0000 7f7be6d9d640 1 --2- 172.21.15.114:0/3310741376 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7bd00047c0 0x7f7bd0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.106+0000 7f7be6d9d640 1 -- 172.21.15.114:0/3310741376 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd0003520 con 0x7f7bd0003970 2023-11-04T01:44:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.106+0000 7f7be759e640 1 -- 172.21.15.114:0/3310741376 reap_dead start 2023-11-04T01:44:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.107+0000 7f7be6d9d640 1 --2- 172.21.15.114:0/3310741376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bd0003970 0x7f7bd0003d90 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800c240 tx=0x7f7bd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6548b935fdcddbbf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.107+0000 7f7be5d9b640 1 -- 172.21.15.114:0/3310741376 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8005ad0 con 0x7f7bd0003970 2023-11-04T01:44:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.107+0000 7f7be5d9b640 1 -- 172.21.15.114:0/3310741376 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd8005c50 con 0x7f7bd0003970 2023-11-04T01:44:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.107+0000 7f7be5d9b640 1 -- 172.21.15.114:0/3310741376 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd802c8b0 con 0x7f7bd0003970 2023-11-04T01:44:08.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.107+0000 7f7bed24b640 1 -- 172.21.15.114:0/3310741376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bd0003970 msgr2=0x7f7bd0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.107+0000 7f7bed24b640 1 --2- 172.21.15.114:0/3310741376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bd0003970 0x7f7bd0003d90 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800c240 tx=0x7f7bd00057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.107+0000 7f7bed24b640 1 -- 172.21.15.114:0/3310741376 shutdown_connections 2023-11-04T01:44:08.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.107+0000 7f7bed24b640 1 --2- 172.21.15.114:0/3310741376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bd0003970 0x7f7bd0003d90 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.107+0000 7f7bed24b640 1 -- 172.21.15.114:0/3310741376 >> 172.21.15.114:0/3310741376 conn(0x7f7be80cb530 msgr2=0x7f7be80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.107+0000 7f7bed24b640 1 -- 172.21.15.114:0/3310741376 shutdown_connections 2023-11-04T01:44:08.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.107+0000 7f7bed24b640 1 -- 172.21.15.114:0/3310741376 wait complete. 2023-11-04T01:44:08.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.109+0000 7f7bed24b640 1 Processor -- start 2023-11-04T01:44:08.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.109+0000 7f7bed24b640 1 -- start start 2023-11-04T01:44:08.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.109+0000 7f7bed24b640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7bd0003970 0x7f7be80acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.109+0000 7f7bed24b640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7be80c66e0 0x7f7be80c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.109+0000 7f7bed24b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be806f7f0 0x7f7be806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7bed24b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be80c7450 con 0x7f7be806f7f0 2023-11-04T01:44:08.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7bed24b640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be80c7730 con 0x7f7be80c66e0 2023-11-04T01:44:08.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7bed24b640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be80c7a10 con 0x7f7bd0003970 2023-11-04T01:44:08.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7be759e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be806f7f0 0x7f7be806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7be759e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be806f7f0 0x7f7be806fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55608/0 (socket says 172.21.15.114:55608) 2023-11-04T01:44:08.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7be759e640 1 -- 172.21.15.114:0/2302242216 learned_addr learned my addr 172.21.15.114:0/2302242216 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:08.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7be6d9d640 1 --2- 172.21.15.114:0/2302242216 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7bd0003970 0x7f7be80acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7be659c640 1 --2- 172.21.15.114:0/2302242216 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7be80c66e0 0x7f7be80c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7be759e640 1 -- 172.21.15.114:0/2302242216 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7bd0003970 msgr2=0x7f7be80acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7be759e640 1 --2- 172.21.15.114:0/2302242216 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7bd0003970 0x7f7be80acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7be759e640 1 -- 172.21.15.114:0/2302242216 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7be80c66e0 msgr2=0x7f7be80c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7be759e640 1 --2- 172.21.15.114:0/2302242216 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7be80c66e0 0x7f7be80c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7be759e640 1 -- 172.21.15.114:0/2302242216 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be80c7cf0 con 0x7f7be806f7f0 2023-11-04T01:44:08.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7be759e640 1 --2- 172.21.15.114:0/2302242216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be806f7f0 0x7f7be806fca0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f7be815cf60 tx=0x7f7be000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7bcf7fe640 1 -- 172.21.15.114:0/2302242216 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0017070 con 0x7f7be806f7f0 2023-11-04T01:44:08.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7bcf7fe640 1 -- 172.21.15.114:0/2302242216 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be000eed0 con 0x7f7be806f7f0 2023-11-04T01:44:08.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7bed24b640 1 -- 172.21.15.114:0/2302242216 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be80c7fd0 con 0x7f7be806f7f0 2023-11-04T01:44:08.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7bcf7fe640 1 -- 172.21.15.114:0/2302242216 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0006b50 con 0x7f7be806f7f0 2023-11-04T01:44:08.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.110+0000 7f7bed24b640 1 -- 172.21.15.114:0/2302242216 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be80ad080 con 0x7f7be806f7f0 2023-11-04T01:44:08.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.111+0000 7f7bed24b640 1 -- 172.21.15.114:0/2302242216 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be80ad2a0 con 0x7f7be806f7f0 2023-11-04T01:44:08.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.112+0000 7f7bcf7fe640 1 -- 172.21.15.114:0/2302242216 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7be0003970 con 0x7f7be806f7f0 2023-11-04T01:44:08.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.112+0000 7f7bcf7fe640 1 --2- 172.21.15.114:0/2302242216 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7bd406ae70 0x7f7bd406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.112+0000 7f7be6d9d640 1 --2- 172.21.15.114:0/2302242216 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7bd406ae70 0x7f7bd406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.112+0000 7f7bcf7fe640 1 -- 172.21.15.114:0/2302242216 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8038+0+0 (secure 0 0 0) 0x7f7be00894e0 con 0x7f7be806f7f0 2023-11-04T01:44:08.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.113+0000 7f7be6d9d640 1 --2- 172.21.15.114:0/2302242216 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7bd406ae70 0x7f7bd406d330 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8034000 tx=0x7f7bd8009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.118+0000 7f7bcf7fe640 1 -- 172.21.15.114:0/2302242216 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7be0053de0 con 0x7f7be806f7f0 2023-11-04T01:44:08.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.318+0000 7f7bed24b640 1 -- 172.21.15.114:0/2302242216 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7be81f2aa0 con 0x7f7be806f7f0 2023-11-04T01:44:08.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.318+0000 7f7bcf7fe640 1 -- 172.21.15.114:0/2302242216 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4946 (secure 0 0 0) 0x7f7be0057400 con 0x7f7be806f7f0 2023-11-04T01:44:08.320 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:08.320 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":109,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":109}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:01.577843+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":8514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8514":{"gid":8514,"name":"a","rank":1,"incarnation":99,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6835/979876939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":979876939},{"type":"v1","addr":"172.21.15.114:6835","nonce":979876939}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:resolve","state_seq":12,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:08.320 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 109 2023-11-04T01:44:08.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.320+0000 7f7bed24b640 1 -- 172.21.15.114:0/2302242216 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7bd406ae70 msgr2=0x7f7bd406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.320+0000 7f7bed24b640 1 --2- 172.21.15.114:0/2302242216 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7bd406ae70 0x7f7bd406d330 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8034000 tx=0x7f7bd8009030 comp rx=0 tx=0).stop 2023-11-04T01:44:08.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.320+0000 7f7bed24b640 1 -- 172.21.15.114:0/2302242216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be806f7f0 msgr2=0x7f7be806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.320+0000 7f7bed24b640 1 --2- 172.21.15.114:0/2302242216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be806f7f0 0x7f7be806fca0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f7be815cf60 tx=0x7f7be000eb90 comp rx=0 tx=0).stop 2023-11-04T01:44:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.320+0000 7f7bed24b640 1 -- 172.21.15.114:0/2302242216 shutdown_connections 2023-11-04T01:44:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.320+0000 7f7bed24b640 1 --2- 172.21.15.114:0/2302242216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be806f7f0 0x7f7be806fca0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.320+0000 7f7bed24b640 1 --2- 172.21.15.114:0/2302242216 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7bd406ae70 0x7f7bd406d330 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.320+0000 7f7bed24b640 1 --2- 172.21.15.114:0/2302242216 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7be80c66e0 0x7f7be80c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.320+0000 7f7bed24b640 1 --2- 172.21.15.114:0/2302242216 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7bd0003970 0x7f7be80acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.321+0000 7f7bed24b640 1 -- 172.21.15.114:0/2302242216 >> 172.21.15.114:0/2302242216 conn(0x7f7be80cb530 msgr2=0x7f7be80afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.321+0000 7f7bed24b640 1 -- 172.21.15.114:0/2302242216 shutdown_connections 2023-11-04T01:44:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.321+0000 7f7bed24b640 1 -- 172.21.15.114:0/2302242216 wait complete. 2023-11-04T01:44:08.333 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:44:08.445 INFO:teuthology.orchestra.run.smithi114.stdout:{"last_snap":12,"last_created":12,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:42:48.820894+0000","name":"s25","metadata":{}},{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:43:38.841671+0000","name":"s26","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:44:08.446 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 9, "last_snap": 12, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:42:48.820894+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:43:38.841671+0000" } ] } 2023-11-04T01:44:08.446 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:44:08.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.544+0000 7f32736e1640 1 Processor -- start 2023-11-04T01:44:08.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.544+0000 7f32736e1640 1 -- start start 2023-11-04T01:44:08.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.545+0000 7f32736e1640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f326c15b200 0x7f326c0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.545+0000 7f32736e1640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f326c0afda0 0x7f326c0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.545+0000 7f32736e1640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f326c0cd7f0 0x7f326c0cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.545+0000 7f32736e1640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326c0cdc40 con 0x7f326c15b200 2023-11-04T01:44:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.545+0000 7f32736e1640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326c0cde80 con 0x7f326c0cd7f0 2023-11-04T01:44:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.545+0000 7f32736e1640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0cf670 con 0x7f326c0afda0 2023-11-04T01:44:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.545+0000 7f327147d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f326c15b200 0x7f326c0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.545+0000 7f327147d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f326c15b200 0x7f326c0ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55616/0 (socket says 172.21.15.114:55616) 2023-11-04T01:44:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.545+0000 7f327147d640 1 -- 172.21.15.114:0/4162971044 learned_addr learned my addr 172.21.15.114:0/4162971044 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.546+0000 7f3271c7e640 1 --2- 172.21.15.114:0/4162971044 >> v2:172.21.15.141:3300/0 conn(0x7f326c0cd7f0 0x7f326c0cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.546+0000 7f3270c7c640 1 --2- 172.21.15.114:0/4162971044 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f326c0afda0 0x7f326c0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.546+0000 7f327147d640 1 -- 172.21.15.114:0/4162971044 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f326c0afda0 msgr2=0x7f326c0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.546+0000 7f327147d640 1 --2- 172.21.15.114:0/4162971044 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f326c0afda0 0x7f326c0cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.546+0000 7f327147d640 1 -- 172.21.15.114:0/4162971044 >> v2:172.21.15.141:3300/0 conn(0x7f326c0cd7f0 msgr2=0x7f326c0cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.546+0000 7f327147d640 1 --2- 172.21.15.114:0/4162971044 >> v2:172.21.15.141:3300/0 conn(0x7f326c0cd7f0 0x7f326c0cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.546+0000 7f327147d640 1 -- 172.21.15.114:0/4162971044 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326c0cf950 con 0x7f326c15b200 2023-11-04T01:44:08.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.546+0000 7f327147d640 1 --2- 172.21.15.114:0/4162971044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f326c15b200 0x7f326c0ceb30 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f326c15ed40 tx=0x7f326802be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9567b557c1c8d83c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.547+0000 7f3263fff640 1 -- 172.21.15.114:0/4162971044 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326802ca30 con 0x7f326c15b200 2023-11-04T01:44:08.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.547+0000 7f3263fff640 1 -- 172.21.15.114:0/4162971044 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326802cb90 con 0x7f326c15b200 2023-11-04T01:44:08.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.547+0000 7f3263fff640 1 -- 172.21.15.114:0/4162971044 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32680343f0 con 0x7f326c15b200 2023-11-04T01:44:08.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.547+0000 7f32736e1640 1 -- 172.21.15.114:0/4162971044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f326c15b200 msgr2=0x7f326c0ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.547+0000 7f32736e1640 1 --2- 172.21.15.114:0/4162971044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f326c15b200 0x7f326c0ceb30 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f326c15ed40 tx=0x7f326802be90 comp rx=0 tx=0).stop 2023-11-04T01:44:08.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.547+0000 7f32736e1640 1 -- 172.21.15.114:0/4162971044 shutdown_connections 2023-11-04T01:44:08.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.547+0000 7f32736e1640 1 --2- 172.21.15.114:0/4162971044 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f326c0afda0 0x7f326c0cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.547+0000 7f32736e1640 1 --2- 172.21.15.114:0/4162971044 >> v2:172.21.15.141:3300/0 conn(0x7f326c0cd7f0 0x7f326c0cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.547+0000 7f32736e1640 1 --2- 172.21.15.114:0/4162971044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f326c15b200 0x7f326c0ceb30 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.547+0000 7f32736e1640 1 -- 172.21.15.114:0/4162971044 >> 172.21.15.114:0/4162971044 conn(0x7f326c0d0c30 msgr2=0x7f326c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.547+0000 7f32736e1640 1 -- 172.21.15.114:0/4162971044 shutdown_connections 2023-11-04T01:44:08.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.547+0000 7f32736e1640 1 -- 172.21.15.114:0/4162971044 wait complete. 2023-11-04T01:44:08.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.548+0000 7f32736e1640 1 Processor -- start 2023-11-04T01:44:08.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.548+0000 7f32736e1640 1 -- start start 2023-11-04T01:44:08.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.549+0000 7f32736e1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f326c0afda0 0x7f326c0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.549+0000 7f32736e1640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f326c0cd7f0 0x7f326c1570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.549+0000 7f32736e1640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f326c15b200 0x7f326c15b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.549+0000 7f32736e1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0c7950 con 0x7f326c0afda0 2023-11-04T01:44:08.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.549+0000 7f32736e1640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0c4ca0 con 0x7f326c0cd7f0 2023-11-04T01:44:08.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.549+0000 7f32736e1640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0c4f70 con 0x7f326c15b200 2023-11-04T01:44:08.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.549+0000 7f327147d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f326c0afda0 0x7f326c0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.549+0000 7f327147d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f326c0afda0 0x7f326c0c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55630/0 (socket says 172.21.15.114:55630) 2023-11-04T01:44:08.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.549+0000 7f327147d640 1 -- 172.21.15.114:0/3556520717 learned_addr learned my addr 172.21.15.114:0/3556520717 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:08.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.549+0000 7f3271c7e640 1 --2- 172.21.15.114:0/3556520717 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f326c15b200 0x7f326c15b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.549+0000 7f3270c7c640 1 --2- 172.21.15.114:0/3556520717 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f326c0cd7f0 0x7f326c1570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.550+0000 7f327147d640 1 -- 172.21.15.114:0/3556520717 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f326c15b200 msgr2=0x7f326c15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.550+0000 7f327147d640 1 --2- 172.21.15.114:0/3556520717 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f326c15b200 0x7f326c15b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.550+0000 7f327147d640 1 -- 172.21.15.114:0/3556520717 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f326c0cd7f0 msgr2=0x7f326c1570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.550+0000 7f327147d640 1 --2- 172.21.15.114:0/3556520717 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f326c0cd7f0 0x7f326c1570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.550+0000 7f327147d640 1 -- 172.21.15.114:0/3556520717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3268009b30 con 0x7f326c0afda0 2023-11-04T01:44:08.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.550+0000 7f3271c7e640 1 --2- 172.21.15.114:0/3556520717 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f326c15b200 0x7f326c15b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:08.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.550+0000 7f3270c7c640 1 --2- 172.21.15.114:0/3556520717 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f326c0cd7f0 0x7f326c1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:08.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.550+0000 7f327147d640 1 --2- 172.21.15.114:0/3556520717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f326c0afda0 0x7f326c0c4760 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f3268000f80 tx=0x7f3268004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.550+0000 7f3261ffb640 1 -- 172.21.15.114:0/3556520717 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326803e450 con 0x7f326c0afda0 2023-11-04T01:44:08.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.550+0000 7f3261ffb640 1 -- 172.21.15.114:0/3556520717 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326803e5f0 con 0x7f326c0afda0 2023-11-04T01:44:08.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.550+0000 7f32736e1640 1 -- 172.21.15.114:0/3556520717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326c0c5250 con 0x7f326c0afda0 2023-11-04T01:44:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.550+0000 7f3261ffb640 1 -- 172.21.15.114:0/3556520717 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326803e9a0 con 0x7f326c0afda0 2023-11-04T01:44:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.550+0000 7f32736e1640 1 -- 172.21.15.114:0/3556520717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f326c0c5810 con 0x7f326c0afda0 2023-11-04T01:44:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.551+0000 7f32736e1640 1 -- 172.21.15.114:0/3556520717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326c0684b0 con 0x7f326c0afda0 2023-11-04T01:44:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.551+0000 7f3261ffb640 1 -- 172.21.15.114:0/3556520717 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f326803eb00 con 0x7f326c0afda0 2023-11-04T01:44:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.552+0000 7f3261ffb640 1 --2- 172.21.15.114:0/3556520717 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f325006ae70 0x7f325006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.552+0000 7f3261ffb640 1 -- 172.21.15.114:0/3556520717 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8038+0+0 (secure 0 0 0) 0x7f32680acf00 con 0x7f326c0afda0 2023-11-04T01:44:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.552+0000 7f3270c7c640 1 --2- 172.21.15.114:0/3556520717 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f325006ae70 0x7f325006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.552+0000 7f3270c7c640 1 --2- 172.21.15.114:0/3556520717 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f325006ae70 0x7f325006d330 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f325c006fd0 tx=0x7f325c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.556+0000 7f3261ffb640 1 -- 172.21.15.114:0/3556520717 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3268077860 con 0x7f326c0afda0 2023-11-04T01:44:08.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.793+0000 7f32736e1640 1 -- 172.21.15.114:0/3556520717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7f326c15a6d0 con 0x7f326c0afda0 2023-11-04T01:44:08.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.795+0000 7f3261ffb640 1 -- 172.21.15.114:0/3556520717 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 8514 v110) v1 ==== 97+0+0 (secure 0 0 0) 0x7f326803edb0 con 0x7f326c0afda0 2023-11-04T01:44:08.797 INFO:teuthology.orchestra.run.smithi114.stderr:failed mds gid 8514 2023-11-04T01:44:08.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.798+0000 7f32736e1640 1 -- 172.21.15.114:0/3556520717 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f325006ae70 msgr2=0x7f325006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.798+0000 7f32736e1640 1 --2- 172.21.15.114:0/3556520717 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f325006ae70 0x7f325006d330 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f325c006fd0 tx=0x7f325c008040 comp rx=0 tx=0).stop 2023-11-04T01:44:08.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.798+0000 7f32736e1640 1 -- 172.21.15.114:0/3556520717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f326c0afda0 msgr2=0x7f326c0c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.798+0000 7f32736e1640 1 --2- 172.21.15.114:0/3556520717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f326c0afda0 0x7f326c0c4760 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f3268000f80 tx=0x7f3268004a40 comp rx=0 tx=0).stop 2023-11-04T01:44:08.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.798+0000 7f32736e1640 1 -- 172.21.15.114:0/3556520717 shutdown_connections 2023-11-04T01:44:08.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.798+0000 7f32736e1640 1 --2- 172.21.15.114:0/3556520717 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f326c15b200 0x7f326c15b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.798+0000 7f32736e1640 1 --2- 172.21.15.114:0/3556520717 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f325006ae70 0x7f325006d330 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.798+0000 7f32736e1640 1 --2- 172.21.15.114:0/3556520717 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f326c0cd7f0 0x7f326c1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.798+0000 7f32736e1640 1 --2- 172.21.15.114:0/3556520717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f326c0afda0 0x7f326c0c4760 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.798+0000 7f32736e1640 1 -- 172.21.15.114:0/3556520717 >> 172.21.15.114:0/3556520717 conn(0x7f326c0d0c30 msgr2=0x7f326c06f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.798+0000 7f32736e1640 1 -- 172.21.15.114:0/3556520717 shutdown_connections 2023-11-04T01:44:08.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.798+0000 7f32736e1640 1 -- 172.21.15.114:0/3556520717 wait complete. 2023-11-04T01:44:08.812 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:44:08.812 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:44:08.812 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:44:08.812 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:44:08.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:08.812 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:44:08.813 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:44:08.813 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:44:08.815 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:44:08.815 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:08.890 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2023-11-04T01:44:08.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.915+0000 7fd370bc9640 1 Processor -- start 2023-11-04T01:44:08.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.915+0000 7fd370bc9640 1 -- start start 2023-11-04T01:44:08.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.916+0000 7fd370bc9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd36c15d4e0 0x7fd36c0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.916+0000 7fd370bc9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd36c0b25a0 con 0x7fd36c0ca8b0 2023-11-04T01:44:08.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.916+0000 7fd370bc9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd36c0b2300 con 0x7fd36c0ced90 2023-11-04T01:44:08.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.916+0000 7fd370bc9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36c15d8c0 con 0x7fd36c15d4e0 2023-11-04T01:44:08.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.916+0000 7fd36a59c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd36c15d4e0 0x7fd36c0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.916+0000 7fd36ad9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd36c0ca8b0 0x7fd36c06a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44716/0 (socket says 172.21.15.114:44716) 2023-11-04T01:44:08.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.916+0000 7fd36ad9d640 1 -- 172.21.15.114:0/2924544593 learned_addr learned my addr 172.21.15.114:0/2924544593 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:08.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.916+0000 7fd36a59c640 1 -- 172.21.15.114:0/2924544593 >> v1:172.21.15.141:6789/0 conn(0x7fd36c0ced90 legacy=0x7fd36c0ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.916+0000 7fd36a59c640 1 -- 172.21.15.114:0/2924544593 >> v1:172.21.15.114:6789/0 conn(0x7fd36c0ca8b0 legacy=0x7fd36c06a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.916+0000 7fd36a59c640 1 -- 172.21.15.114:0/2924544593 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c15e5f0 con 0x7fd36c15d4e0 2023-11-04T01:44:08.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.916+0000 7fd369d9b640 1 -- 172.21.15.114:0/2924544593 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632934346 0 0) 0x7fd36c0b25a0 con 0x7fd36c0ca8b0 2023-11-04T01:44:08.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.917+0000 7fd36a59c640 1 --2- 172.21.15.114:0/2924544593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd36c15d4e0 0x7fd36c0ce850 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fd3540097d0 tx=0x7fd35402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509cc25904c51203 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.917+0000 7fd369d9b640 1 -- 172.21.15.114:0/2924544593 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354031830 con 0x7fd36c15d4e0 2023-11-04T01:44:08.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.917+0000 7fd369d9b640 1 -- 172.21.15.114:0/2924544593 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd354031990 con 0x7fd36c15d4e0 2023-11-04T01:44:08.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.917+0000 7fd369d9b640 1 -- 172.21.15.114:0/2924544593 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354031d20 con 0x7fd36c15d4e0 2023-11-04T01:44:08.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.918+0000 7fd370bc9640 1 -- 172.21.15.114:0/2924544593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd36c15d4e0 msgr2=0x7fd36c0ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.918+0000 7fd370bc9640 1 --2- 172.21.15.114:0/2924544593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd36c15d4e0 0x7fd36c0ce850 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fd3540097d0 tx=0x7fd35402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.918+0000 7fd370bc9640 1 -- 172.21.15.114:0/2924544593 shutdown_connections 2023-11-04T01:44:08.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.918+0000 7fd370bc9640 1 --2- 172.21.15.114:0/2924544593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd36c15d4e0 0x7fd36c0ce850 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.918+0000 7fd370bc9640 1 -- 172.21.15.114:0/2924544593 >> 172.21.15.114:0/2924544593 conn(0x7fd36c0b1640 msgr2=0x7fd36c0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.918+0000 7fd370bc9640 1 -- 172.21.15.114:0/2924544593 shutdown_connections 2023-11-04T01:44:08.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.918+0000 7fd370bc9640 1 -- 172.21.15.114:0/2924544593 wait complete. 2023-11-04T01:44:08.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.919+0000 7fd370bc9640 1 Processor -- start 2023-11-04T01:44:08.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.919+0000 7fd370bc9640 1 -- start start 2023-11-04T01:44:08.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd370bc9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd36c0ca8b0 0x7fd36c1e9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd370bc9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd36c0ced90 0x7fd36c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd370bc9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd36c15d4e0 0x7fd36c0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd370bc9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c1e6080 con 0x7fd36c15d4e0 2023-11-04T01:44:08.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd370bc9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c1e5da0 con 0x7fd36c0ced90 2023-11-04T01:44:08.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd370bc9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c0c4a50 con 0x7fd36c0ca8b0 2023-11-04T01:44:08.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd36ad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd36c15d4e0 0x7fd36c0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd36ad9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd36c15d4e0 0x7fd36c0b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55650/0 (socket says 172.21.15.114:55650) 2023-11-04T01:44:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd36ad9d640 1 -- 172.21.15.114:0/859516278 learned_addr learned my addr 172.21.15.114:0/859516278 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd36a59c640 1 --2- 172.21.15.114:0/859516278 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd36c0ca8b0 0x7fd36c1e9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd361d9b640 1 --2- 172.21.15.114:0/859516278 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd36c0ced90 0x7fd36c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd36ad9d640 1 -- 172.21.15.114:0/859516278 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd36c0ca8b0 msgr2=0x7fd36c1e9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd36ad9d640 1 --2- 172.21.15.114:0/859516278 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd36c0ca8b0 0x7fd36c1e9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd36ad9d640 1 -- 172.21.15.114:0/859516278 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd36c0ced90 msgr2=0x7fd36c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd36ad9d640 1 --2- 172.21.15.114:0/859516278 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd36c0ced90 0x7fd36c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd36ad9d640 1 -- 172.21.15.114:0/859516278 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd354009400 con 0x7fd36c15d4e0 2023-11-04T01:44:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.920+0000 7fd361d9b640 1 --2- 172.21.15.114:0/859516278 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd36c0ced90 0x7fd36c0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.921+0000 7fd36ad9d640 1 --2- 172.21.15.114:0/859516278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd36c15d4e0 0x7fd36c0b2770 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fd36400c7e0 tx=0x7fd36400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.921+0000 7fd3637fe640 1 -- 172.21.15.114:0/859516278 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36400a640 con 0x7fd36c15d4e0 2023-11-04T01:44:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.921+0000 7fd3637fe640 1 -- 172.21.15.114:0/859516278 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36400a7c0 con 0x7fd36c15d4e0 2023-11-04T01:44:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.921+0000 7fd370bc9640 1 -- 172.21.15.114:0/859516278 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36c0c4d30 con 0x7fd36c15d4e0 2023-11-04T01:44:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.921+0000 7fd3637fe640 1 -- 172.21.15.114:0/859516278 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36400ab70 con 0x7fd36c15d4e0 2023-11-04T01:44:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.921+0000 7fd370bc9640 1 -- 172.21.15.114:0/859516278 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36c1e99c0 con 0x7fd36c15d4e0 2023-11-04T01:44:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.922+0000 7fd370bc9640 1 -- 172.21.15.114:0/859516278 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36c0c5250 con 0x7fd36c15d4e0 2023-11-04T01:44:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.922+0000 7fd3637fe640 1 -- 172.21.15.114:0/859516278 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd36400acd0 con 0x7fd36c15d4e0 2023-11-04T01:44:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.922+0000 7fd3637fe640 1 --2- 172.21.15.114:0/859516278 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd34c06ae70 0x7fd34c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.923+0000 7fd3637fe640 1 -- 172.21.15.114:0/859516278 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fd364089840 con 0x7fd36c15d4e0 2023-11-04T01:44:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.923+0000 7fd36a59c640 1 --2- 172.21.15.114:0/859516278 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd34c06ae70 0x7fd34c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.923+0000 7fd36a59c640 1 --2- 172.21.15.114:0/859516278 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd34c06ae70 0x7fd34c06d330 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd354036000 tx=0x7fd35403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:08.927+0000 7fd3637fe640 1 -- 172.21.15.114:0/859516278 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd36c0c5250 con 0x7fd36c15d4e0 2023-11-04T01:44:09.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:09.130+0000 7fd370bc9640 1 -- 172.21.15.114:0/859516278 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd36c0c5250 con 0x7fd36c15d4e0 2023-11-04T01:44:09.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:09.130+0000 7fd3637fe640 1 -- 172.21.15.114:0/859516278 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4155 (secure 0 0 0) 0x7fd36c0c5250 con 0x7fd36c15d4e0 2023-11-04T01:44:09.132 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:09.132 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":111,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:08.799478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":7063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7063":{"gid":7063,"name":"b","rank":1,"incarnation":111,"state":"up:replay","state_seq":1,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:resolve","state_seq":12,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:09.132 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 111 2023-11-04T01:44:09.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:09.132+0000 7fd370bc9640 1 -- 172.21.15.114:0/859516278 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd34c06ae70 msgr2=0x7fd34c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:09.132+0000 7fd370bc9640 1 --2- 172.21.15.114:0/859516278 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd34c06ae70 0x7fd34c06d330 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd354036000 tx=0x7fd35403c040 comp rx=0 tx=0).stop 2023-11-04T01:44:09.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:09.132+0000 7fd370bc9640 1 -- 172.21.15.114:0/859516278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd36c15d4e0 msgr2=0x7fd36c0b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:09.132+0000 7fd370bc9640 1 --2- 172.21.15.114:0/859516278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd36c15d4e0 0x7fd36c0b2770 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fd36400c7e0 tx=0x7fd36400cca0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:09.132+0000 7fd370bc9640 1 -- 172.21.15.114:0/859516278 shutdown_connections 2023-11-04T01:44:09.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:09.132+0000 7fd370bc9640 1 --2- 172.21.15.114:0/859516278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd36c15d4e0 0x7fd36c0b2770 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:09.132+0000 7fd370bc9640 1 --2- 172.21.15.114:0/859516278 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fd34c06ae70 0x7fd34c06d330 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:09.132+0000 7fd370bc9640 1 --2- 172.21.15.114:0/859516278 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fd36c0ced90 0x7fd36c0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:09.132+0000 7fd370bc9640 1 --2- 172.21.15.114:0/859516278 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fd36c0ca8b0 0x7fd36c1e9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:09.132+0000 7fd370bc9640 1 -- 172.21.15.114:0/859516278 >> 172.21.15.114:0/859516278 conn(0x7fd36c0b1640 msgr2=0x7fd36c0af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:09.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:09.132+0000 7fd370bc9640 1 -- 172.21.15.114:0/859516278 shutdown_connections 2023-11-04T01:44:09.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:09.132+0000 7fd370bc9640 1 -- 172.21.15.114:0/859516278 wait complete. 2023-11-04T01:44:09.144 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:44:11.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:44:14.146 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:14.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.255+0000 7febc5e21640 1 Processor -- start 2023-11-04T01:44:14.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.255+0000 7febc5e21640 1 -- start start 2023-11-04T01:44:14.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.255+0000 7febc5e21640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7febc015d100 0x7febc00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.255+0000 7febc5e21640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7febc00d1be0 0x7febc00b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.255+0000 7febc5e21640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc00b32b0 con 0x7febc015d4e0 2023-11-04T01:44:14.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.255+0000 7febc5e21640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc00cee10 con 0x7febc015d100 2023-11-04T01:44:14.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.255+0000 7febc5e21640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc00b2980 con 0x7febc00d1be0 2023-11-04T01:44:14.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.256+0000 7febbffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7febc00d1be0 0x7febc00b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.256+0000 7febbf7fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7febc015d100 0x7febc00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.256+0000 7febbffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7febc00d1be0 0x7febc00b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:43192/0 (socket says 172.21.15.114:43192) 2023-11-04T01:44:14.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.256+0000 7febbffff640 1 -- 172.21.15.114:0/119564037 learned_addr learned my addr 172.21.15.114:0/119564037 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:14.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.256+0000 7febbeffd640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7febc015d4e0 0x7febc00d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:41528/0 (socket says 172.21.15.114:41528) 2023-11-04T01:44:14.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.256+0000 7febbffff640 1 -- 172.21.15.114:0/119564037 >> v2:172.21.15.141:3300/0 conn(0x7febc015d100 msgr2=0x7febc00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:14.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.256+0000 7febbffff640 1 --2- 172.21.15.114:0/119564037 >> v2:172.21.15.141:3300/0 conn(0x7febc015d100 0x7febc00ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.256+0000 7febbffff640 1 -- 172.21.15.114:0/119564037 >> v1:172.21.15.141:6789/0 conn(0x7febc015d4e0 legacy=0x7febc00d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.256+0000 7febbffff640 1 -- 172.21.15.114:0/119564037 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc00b2c60 con 0x7febc00d1be0 2023-11-04T01:44:14.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.256+0000 7febbf7fe640 1 --2- 172.21.15.114:0/119564037 >> v2:172.21.15.141:3300/0 conn(0x7febc015d100 0x7febc00ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:14.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.257+0000 7febbffff640 1 --2- 172.21.15.114:0/119564037 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7febc00d1be0 0x7febc00b3740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7febb8009e50 tx=0x7febb802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e9cbcd8cdf36bd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:14.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.257+0000 7febbe7fc640 1 -- 172.21.15.114:0/119564037 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb802cb00 con 0x7febc00d1be0 2023-11-04T01:44:14.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.257+0000 7febbe7fc640 1 -- 172.21.15.114:0/119564037 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb802cc60 con 0x7febc00d1be0 2023-11-04T01:44:14.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.257+0000 7febbe7fc640 1 -- 172.21.15.114:0/119564037 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb80343f0 con 0x7febc00d1be0 2023-11-04T01:44:14.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.258+0000 7febc5e21640 1 -- 172.21.15.114:0/119564037 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7febc00d1be0 msgr2=0x7febc00b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.258+0000 7febc5e21640 1 --2- 172.21.15.114:0/119564037 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7febc00d1be0 0x7febc00b3740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7febb8009e50 tx=0x7febb802bf60 comp rx=0 tx=0).stop 2023-11-04T01:44:14.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.258+0000 7febc5e21640 1 -- 172.21.15.114:0/119564037 shutdown_connections 2023-11-04T01:44:14.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.258+0000 7febc5e21640 1 --2- 172.21.15.114:0/119564037 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7febc00d1be0 0x7febc00b3740 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.258+0000 7febc5e21640 1 --2- 172.21.15.114:0/119564037 >> v2:172.21.15.141:3300/0 conn(0x7febc015d100 0x7febc00ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.258+0000 7febc5e21640 1 -- 172.21.15.114:0/119564037 >> 172.21.15.114:0/119564037 conn(0x7febc00d2ef0 msgr2=0x7febc00d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:14.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.258+0000 7febc5e21640 1 -- 172.21.15.114:0/119564037 shutdown_connections 2023-11-04T01:44:14.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.258+0000 7febc5e21640 1 -- 172.21.15.114:0/119564037 wait complete. 2023-11-04T01:44:14.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.259+0000 7febc5e21640 1 Processor -- start 2023-11-04T01:44:14.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.259+0000 7febc5e21640 1 -- start start 2023-11-04T01:44:14.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.260+0000 7febc5e21640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc00d1be0 0x7febc015a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.260+0000 7febc5e21640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7febc015d100 0x7febc00b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.260+0000 7febc5e21640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7febc015d4e0 0x7febc00b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.260+0000 7febc5e21640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc00c9fc0 con 0x7febc00d1be0 2023-11-04T01:44:14.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.260+0000 7febc5e21640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc00ca210 con 0x7febc015d4e0 2023-11-04T01:44:14.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.260+0000 7febc5e21640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc00ca4f0 con 0x7febc015d100 2023-11-04T01:44:14.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.260+0000 7febbf7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc00d1be0 0x7febc015a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.260+0000 7febbf7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc00d1be0 0x7febc015a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55662/0 (socket says 172.21.15.114:55662) 2023-11-04T01:44:14.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.260+0000 7febbf7fe640 1 -- 172.21.15.114:0/3780349252 learned_addr learned my addr 172.21.15.114:0/3780349252 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:14.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.260+0000 7febbeffd640 1 --2- 172.21.15.114:0/3780349252 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7febc015d100 0x7febc00b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.260+0000 7febbffff640 1 --2- 172.21.15.114:0/3780349252 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7febc015d4e0 0x7febc00b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.260+0000 7febbf7fe640 1 -- 172.21.15.114:0/3780349252 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7febc015d100 msgr2=0x7febc00b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.260+0000 7febbf7fe640 1 --2- 172.21.15.114:0/3780349252 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7febc015d100 0x7febc00b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.260+0000 7febbf7fe640 1 -- 172.21.15.114:0/3780349252 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7febc015d4e0 msgr2=0x7febc00b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.260+0000 7febbf7fe640 1 --2- 172.21.15.114:0/3780349252 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7febc015d4e0 0x7febc00b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.261+0000 7febbf7fe640 1 -- 172.21.15.114:0/3780349252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb00093a0 con 0x7febc00d1be0 2023-11-04T01:44:14.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.261+0000 7febbf7fe640 1 --2- 172.21.15.114:0/3780349252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc00d1be0 0x7febc015a570 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7febb000ebe0 tx=0x7febb000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:14.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.261+0000 7feba7fff640 1 -- 172.21.15.114:0/3780349252 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0009750 con 0x7febc00d1be0 2023-11-04T01:44:14.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.261+0000 7feba7fff640 1 -- 172.21.15.114:0/3780349252 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb000cc30 con 0x7febc00d1be0 2023-11-04T01:44:14.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.261+0000 7febc5e21640 1 -- 172.21.15.114:0/3780349252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb8009b30 con 0x7febc00d1be0 2023-11-04T01:44:14.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.261+0000 7feba7fff640 1 -- 172.21.15.114:0/3780349252 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb000eee0 con 0x7febc00d1be0 2023-11-04T01:44:14.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.261+0000 7febc5e21640 1 -- 172.21.15.114:0/3780349252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc00caab0 con 0x7febc00d1be0 2023-11-04T01:44:14.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.262+0000 7febc5e21640 1 -- 172.21.15.114:0/3780349252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc00cac70 con 0x7febc00d1be0 2023-11-04T01:44:14.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.262+0000 7feba7fff640 1 -- 172.21.15.114:0/3780349252 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7febb0005990 con 0x7febc00d1be0 2023-11-04T01:44:14.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.263+0000 7feba7fff640 1 --2- 172.21.15.114:0/3780349252 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7febac06ae70 0x7febac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.263+0000 7feba7fff640 1 -- 172.21.15.114:0/3780349252 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8124+0+0 (secure 0 0 0) 0x7febb008a4d0 con 0x7febc00d1be0 2023-11-04T01:44:14.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.263+0000 7febbeffd640 1 --2- 172.21.15.114:0/3780349252 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7febac06ae70 0x7febac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.263+0000 7febbeffd640 1 --2- 172.21.15.114:0/3780349252 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7febac06ae70 0x7febac06d330 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7febc015aab0 tx=0x7febb4007cc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:14.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.267+0000 7feba7fff640 1 -- 172.21.15.114:0/3780349252 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7febb0054c00 con 0x7febc00d1be0 2023-11-04T01:44:14.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.470+0000 7febc5e21640 1 -- 172.21.15.114:0/3780349252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febc00d0a20 con 0x7febc00d1be0 2023-11-04T01:44:14.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.470+0000 7feba7fff640 1 -- 172.21.15.114:0/3780349252 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4955 (secure 0 0 0) 0x7febb0058220 con 0x7febc00d1be0 2023-11-04T01:44:14.472 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:14.472 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":113,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2540656643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2540656643},{"type":"v1","addr":"172.21.15.114:6835","nonce":2540656643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:09.806173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":7063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7063":{"gid":7063,"name":"b","rank":1,"incarnation":111,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:14.472 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 113 2023-11-04T01:44:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.472+0000 7febc5e21640 1 -- 172.21.15.114:0/3780349252 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7febac06ae70 msgr2=0x7febac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.472+0000 7febc5e21640 1 --2- 172.21.15.114:0/3780349252 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7febac06ae70 0x7febac06d330 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7febc015aab0 tx=0x7febb4007cc0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.472+0000 7febc5e21640 1 -- 172.21.15.114:0/3780349252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc00d1be0 msgr2=0x7febc015a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.472+0000 7febc5e21640 1 --2- 172.21.15.114:0/3780349252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc00d1be0 0x7febc015a570 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7febb000ebe0 tx=0x7febb000c520 comp rx=0 tx=0).stop 2023-11-04T01:44:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.472+0000 7febc5e21640 1 -- 172.21.15.114:0/3780349252 shutdown_connections 2023-11-04T01:44:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.472+0000 7febc5e21640 1 --2- 172.21.15.114:0/3780349252 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7febac06ae70 0x7febac06d330 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.472+0000 7febc5e21640 1 --2- 172.21.15.114:0/3780349252 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7febc015d4e0 0x7febc00b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.472+0000 7febc5e21640 1 --2- 172.21.15.114:0/3780349252 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7febc015d100 0x7febc00b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.472+0000 7febc5e21640 1 --2- 172.21.15.114:0/3780349252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc00d1be0 0x7febc015a570 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.472+0000 7febc5e21640 1 -- 172.21.15.114:0/3780349252 >> 172.21.15.114:0/3780349252 conn(0x7febc00d2ef0 msgr2=0x7febc00b3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.472+0000 7febc5e21640 1 -- 172.21.15.114:0/3780349252 shutdown_connections 2023-11-04T01:44:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.472+0000 7febc5e21640 1 -- 172.21.15.114:0/3780349252 wait complete. 2023-11-04T01:44:14.484 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:44:14.484 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:14.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.583+0000 7f4429d39640 1 Processor -- start 2023-11-04T01:44:14.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.583+0000 7f4429d39640 1 -- start start 2023-11-04T01:44:14.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f4429d39640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f44240cc400 0x7f44240b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f4429d39640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44240ca5c0 con 0x7f44240cda40 2023-11-04T01:44:14.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f4429d39640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44240cb0f0 con 0x7f44240caba0 2023-11-04T01:44:14.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f4429d39640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442406c140 con 0x7f44240cc400 2023-11-04T01:44:14.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44237fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f44240cda40 0x7f44240cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44730/0 (socket says 172.21.15.114:44730) 2023-11-04T01:44:14.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44237fe640 1 -- 172.21.15.114:0/3502026379 learned_addr learned my addr 172.21.15.114:0/3502026379 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:14.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44227fc640 1 -- 172.21.15.114:0/3502026379 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685700198 0 0) 0x7f44240ca5c0 con 0x7f44240cda40 2023-11-04T01:44:14.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44227fc640 1 -- 172.21.15.114:0/3502026379 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f440c003520 con 0x7f44240cda40 2023-11-04T01:44:14.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f4422ffd640 1 --2- 172.21.15.114:0/3502026379 >> v2:172.21.15.141:3300/0 conn(0x7f44240cc400 0x7f44240b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44227fc640 1 -- 172.21.15.114:0/3502026379 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1817371435 0 0) 0x7f440c003520 con 0x7f44240cda40 2023-11-04T01:44:14.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44227fc640 1 -- 172.21.15.114:0/3502026379 >> v2:172.21.15.141:3300/0 conn(0x7f44240cc400 msgr2=0x7f44240b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:14.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44227fc640 1 --2- 172.21.15.114:0/3502026379 >> v2:172.21.15.141:3300/0 conn(0x7f44240cc400 0x7f44240b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44227fc640 1 -- 172.21.15.114:0/3502026379 >> v1:172.21.15.141:6789/0 conn(0x7f44240caba0 legacy=0x7f44240b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44227fc640 1 -- 172.21.15.114:0/3502026379 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442406c560 con 0x7f44240cda40 2023-11-04T01:44:14.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44227fc640 1 -- 172.21.15.114:0/3502026379 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f4418001670 con 0x7f44240cda40 2023-11-04T01:44:14.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44227fc640 1 -- 172.21.15.114:0/3502026379 >> v1:172.21.15.114:6789/0 conn(0x7f44240cda40 legacy=0x7f44240cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44227fc640 1 --2- 172.21.15.114:0/3502026379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f440c0039c0 0x7f440c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44227fc640 1 --2- 172.21.15.114:0/3502026379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440c0047c0 0x7f440c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44227fc640 1 --2- 172.21.15.114:0/3502026379 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f440c0051d0 0x7f440c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44227fc640 1 -- 172.21.15.114:0/3502026379 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442406c140 con 0x7f440c0047c0 2023-11-04T01:44:14.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44227fc640 1 -- 172.21.15.114:0/3502026379 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c00c120 con 0x7f440c0039c0 2023-11-04T01:44:14.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.584+0000 7f44227fc640 1 -- 172.21.15.114:0/3502026379 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440c00c2e0 con 0x7f440c0051d0 2023-11-04T01:44:14.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.585+0000 7f4422ffd640 1 --2- 172.21.15.114:0/3502026379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440c0047c0 0x7f440c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.585+0000 7f44237fe640 1 --2- 172.21.15.114:0/3502026379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f440c0039c0 0x7f440c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.585+0000 7f4423fff640 1 --2- 172.21.15.114:0/3502026379 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f440c0051d0 0x7f440c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.585+0000 7f4422ffd640 1 -- 172.21.15.114:0/3502026379 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f440c0051d0 msgr2=0x7f440c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:14.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.585+0000 7f4422ffd640 1 --2- 172.21.15.114:0/3502026379 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f440c0051d0 0x7f440c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.585+0000 7f4422ffd640 1 -- 172.21.15.114:0/3502026379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f440c0039c0 msgr2=0x7f440c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:14.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.585+0000 7f4422ffd640 1 --2- 172.21.15.114:0/3502026379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f440c0039c0 0x7f440c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.585+0000 7f4422ffd640 1 -- 172.21.15.114:0/3502026379 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440c003520 con 0x7f440c0047c0 2023-11-04T01:44:14.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.585+0000 7f4423fff640 1 -- 172.21.15.114:0/3502026379 reap_dead start 2023-11-04T01:44:14.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.585+0000 7f44237fe640 1 --2- 172.21.15.114:0/3502026379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f440c0039c0 0x7f440c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:14.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.585+0000 7f4422ffd640 1 --2- 172.21.15.114:0/3502026379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440c0047c0 0x7f440c004c40 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f44240cc820 tx=0x7f440c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797d3f6bb5aa5e15 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:14.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.586+0000 7f44227fc640 1 -- 172.21.15.114:0/3502026379 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441402c660 con 0x7f440c0047c0 2023-11-04T01:44:14.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.586+0000 7f44227fc640 1 -- 172.21.15.114:0/3502026379 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441402c7c0 con 0x7f440c0047c0 2023-11-04T01:44:14.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.586+0000 7f44227fc640 1 -- 172.21.15.114:0/3502026379 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441402cb70 con 0x7f440c0047c0 2023-11-04T01:44:14.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.586+0000 7f4429d39640 1 -- 172.21.15.114:0/3502026379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440c0047c0 msgr2=0x7f440c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.586+0000 7f4429d39640 1 --2- 172.21.15.114:0/3502026379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440c0047c0 0x7f440c004c40 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f44240cc820 tx=0x7f440c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.586+0000 7f4429d39640 1 -- 172.21.15.114:0/3502026379 shutdown_connections 2023-11-04T01:44:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.586+0000 7f4429d39640 1 --2- 172.21.15.114:0/3502026379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440c0047c0 0x7f440c004c40 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.586+0000 7f4429d39640 1 -- 172.21.15.114:0/3502026379 >> 172.21.15.114:0/3502026379 conn(0x7f44240cb8e0 msgr2=0x7f44240cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.586+0000 7f4429d39640 1 -- 172.21.15.114:0/3502026379 shutdown_connections 2023-11-04T01:44:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.586+0000 7f4429d39640 1 -- 172.21.15.114:0/3502026379 wait complete. 2023-11-04T01:44:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.587+0000 7f4429d39640 1 Processor -- start 2023-11-04T01:44:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.587+0000 7f4429d39640 1 -- start start 2023-11-04T01:44:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.588+0000 7f4429d39640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440c0047c0 0x7f442414f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.588+0000 7f4429d39640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f442414cc90 0x7f442414bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.588+0000 7f4429d39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f442414d9a0 0x7f44240b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.588+0000 7f4429d39640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442414d1c0 con 0x7f440c0047c0 2023-11-04T01:44:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.588+0000 7f4429d39640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442414b230 con 0x7f442414cc90 2023-11-04T01:44:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.588+0000 7f4429d39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442414b510 con 0x7f442414d9a0 2023-11-04T01:44:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.588+0000 7f44237fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440c0047c0 0x7f442414f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.588+0000 7f44237fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440c0047c0 0x7f442414f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55678/0 (socket says 172.21.15.114:55678) 2023-11-04T01:44:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.588+0000 7f44237fe640 1 -- 172.21.15.114:0/2470815862 learned_addr learned my addr 172.21.15.114:0/2470815862 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.588+0000 7f4423fff640 1 --2- 172.21.15.114:0/2470815862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f442414d9a0 0x7f44240b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.588+0000 7f4422ffd640 1 --2- 172.21.15.114:0/2470815862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f442414cc90 0x7f442414bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.589+0000 7f44237fe640 1 -- 172.21.15.114:0/2470815862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f442414d9a0 msgr2=0x7f44240b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.589+0000 7f44237fe640 1 --2- 172.21.15.114:0/2470815862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f442414d9a0 0x7f44240b3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.589+0000 7f44237fe640 1 -- 172.21.15.114:0/2470815862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f442414cc90 msgr2=0x7f442414bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.589+0000 7f44237fe640 1 --2- 172.21.15.114:0/2470815862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f442414cc90 0x7f442414bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.589+0000 7f44237fe640 1 -- 172.21.15.114:0/2470815862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442414b7f0 con 0x7f440c0047c0 2023-11-04T01:44:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.589+0000 7f44237fe640 1 --2- 172.21.15.114:0/2470815862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440c0047c0 0x7f442414f5d0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f441800e700 tx=0x7f441800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.589+0000 7f440bfff640 1 -- 172.21.15.114:0/2470815862 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441800ee10 con 0x7f440c0047c0 2023-11-04T01:44:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.589+0000 7f440bfff640 1 -- 172.21.15.114:0/2470815862 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441800c8d0 con 0x7f440c0047c0 2023-11-04T01:44:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.589+0000 7f440bfff640 1 -- 172.21.15.114:0/2470815862 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441800cc60 con 0x7f440c0047c0 2023-11-04T01:44:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.589+0000 7f4429d39640 1 -- 172.21.15.114:0/2470815862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44240c3290 con 0x7f440c0047c0 2023-11-04T01:44:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.589+0000 7f4429d39640 1 -- 172.21.15.114:0/2470815862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442414c430 con 0x7f440c0047c0 2023-11-04T01:44:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.590+0000 7f4429d39640 1 -- 172.21.15.114:0/2470815862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44240cec60 con 0x7f440c0047c0 2023-11-04T01:44:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.590+0000 7f440bfff640 1 -- 172.21.15.114:0/2470815862 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f441801d460 con 0x7f440c0047c0 2023-11-04T01:44:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.591+0000 7f440bfff640 1 --2- 172.21.15.114:0/2470815862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f441006ae70 0x7f441006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.591+0000 7f440bfff640 1 -- 172.21.15.114:0/2470815862 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f4418089f20 con 0x7f440c0047c0 2023-11-04T01:44:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.591+0000 7f4422ffd640 1 --2- 172.21.15.114:0/2470815862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f441006ae70 0x7f441006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.591+0000 7f4422ffd640 1 --2- 172.21.15.114:0/2470815862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f441006ae70 0x7f441006d330 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4414036000 tx=0x7f4414030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.595+0000 7f440bfff640 1 -- 172.21.15.114:0/2470815862 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4418054660 con 0x7f440c0047c0 2023-11-04T01:44:14.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.795+0000 7f4429d39640 1 -- 172.21.15.114:0/2470815862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44240cb310 con 0x7f440c0047c0 2023-11-04T01:44:14.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.795+0000 7f440bfff640 1 -- 172.21.15.114:0/2470815862 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4955 (secure 0 0 0) 0x7f4418057c80 con 0x7f440c0047c0 2023-11-04T01:44:14.797 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:14.797 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":113,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2540656643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2540656643},{"type":"v1","addr":"172.21.15.114:6835","nonce":2540656643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:09.806173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":7063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7063":{"gid":7063,"name":"b","rank":1,"incarnation":111,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:14.798 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 113 2023-11-04T01:44:14.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.797+0000 7f4429d39640 1 -- 172.21.15.114:0/2470815862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f441006ae70 msgr2=0x7f441006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.797+0000 7f4429d39640 1 --2- 172.21.15.114:0/2470815862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f441006ae70 0x7f441006d330 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4414036000 tx=0x7f4414030000 comp rx=0 tx=0).stop 2023-11-04T01:44:14.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.797+0000 7f4429d39640 1 -- 172.21.15.114:0/2470815862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440c0047c0 msgr2=0x7f442414f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.797+0000 7f4429d39640 1 --2- 172.21.15.114:0/2470815862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440c0047c0 0x7f442414f5d0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f441800e700 tx=0x7f441800ebc0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.797+0000 7f4429d39640 1 -- 172.21.15.114:0/2470815862 shutdown_connections 2023-11-04T01:44:14.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.797+0000 7f4429d39640 1 --2- 172.21.15.114:0/2470815862 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f442414d9a0 0x7f44240b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.797+0000 7f4429d39640 1 --2- 172.21.15.114:0/2470815862 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f441006ae70 0x7f441006d330 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.797+0000 7f4429d39640 1 --2- 172.21.15.114:0/2470815862 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f442414cc90 0x7f442414bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.797+0000 7f4429d39640 1 --2- 172.21.15.114:0/2470815862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f440c0047c0 0x7f442414f5d0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.797+0000 7f4429d39640 1 -- 172.21.15.114:0/2470815862 >> 172.21.15.114:0/2470815862 conn(0x7f44240cb8e0 msgr2=0x7f4424153ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:14.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.798+0000 7f4429d39640 1 -- 172.21.15.114:0/2470815862 shutdown_connections 2023-11-04T01:44:14.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:14.798+0000 7f4429d39640 1 -- 172.21.15.114:0/2470815862 wait complete. 2023-11-04T01:44:14.810 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:44:15.811 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:15.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.922+0000 7f33b74d4640 1 Processor -- start 2023-11-04T01:44:15.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.922+0000 7f33b74d4640 1 -- start start 2023-11-04T01:44:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.923+0000 7f33b74d4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33b00cb680 0x7f33b00cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.923+0000 7f33b74d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33b01597a0 0x7f33b0159c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.923+0000 7f33b74d4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b015ea20 con 0x7f33b015afb0 2023-11-04T01:44:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.923+0000 7f33b74d4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b015b520 con 0x7f33b00cb680 2023-11-04T01:44:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.923+0000 7f33b74d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b015dc60 con 0x7f33b01597a0 2023-11-04T01:44:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.923+0000 7f33b5270640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33b00cb680 0x7f33b00cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.923+0000 7f33b4a6f640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f33b015afb0 0x7f33b00cba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44738/0 (socket says 172.21.15.114:44738) 2023-11-04T01:44:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.923+0000 7f33b4a6f640 1 -- 172.21.15.114:0/1687154181 learned_addr learned my addr 172.21.15.114:0/1687154181 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:15.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.923+0000 7f33b5270640 1 -- 172.21.15.114:0/1687154181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33b01597a0 msgr2=0x7f33b0159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:15.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.923+0000 7f33b5a71640 1 --2- 172.21.15.114:0/1687154181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33b01597a0 0x7f33b0159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.924+0000 7f33b5270640 1 --2- 172.21.15.114:0/1687154181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33b01597a0 0x7f33b0159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.924+0000 7f33b5270640 1 -- 172.21.15.114:0/1687154181 >> v1:172.21.15.114:6789/0 conn(0x7f33b015afb0 legacy=0x7f33b00cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:15.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.924+0000 7f33a7fff640 1 -- 172.21.15.114:0/1687154181 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509162458 0 0) 0x7f33b015ea20 con 0x7f33b015afb0 2023-11-04T01:44:15.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.924+0000 7f33b5270640 1 -- 172.21.15.114:0/1687154181 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b015df40 con 0x7f33b00cb680 2023-11-04T01:44:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.924+0000 7f33b5a71640 1 --2- 172.21.15.114:0/1687154181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33b01597a0 0x7f33b0159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.924+0000 7f33b5270640 1 --2- 172.21.15.114:0/1687154181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b00cb680 0x7f33b00cf470 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0097a0 tx=0x7f33ac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6011dadf682b0c3f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.924+0000 7f33a7fff640 1 -- 172.21.15.114:0/1687154181 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac02e070 con 0x7f33b00cb680 2023-11-04T01:44:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.924+0000 7f33a7fff640 1 -- 172.21.15.114:0/1687154181 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac0315a0 con 0x7f33b00cb680 2023-11-04T01:44:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.924+0000 7f33a7fff640 1 -- 172.21.15.114:0/1687154181 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac031930 con 0x7f33b00cb680 2023-11-04T01:44:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.925+0000 7f33b74d4640 1 -- 172.21.15.114:0/1687154181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b00cb680 msgr2=0x7f33b00cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.925+0000 7f33b74d4640 1 --2- 172.21.15.114:0/1687154181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b00cb680 0x7f33b00cf470 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0097a0 tx=0x7f33ac02b840 comp rx=0 tx=0).stop 2023-11-04T01:44:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.925+0000 7f33b74d4640 1 -- 172.21.15.114:0/1687154181 shutdown_connections 2023-11-04T01:44:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.925+0000 7f33b74d4640 1 --2- 172.21.15.114:0/1687154181 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33b01597a0 0x7f33b0159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.925+0000 7f33b74d4640 1 --2- 172.21.15.114:0/1687154181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b00cb680 0x7f33b00cf470 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.925+0000 7f33b74d4640 1 -- 172.21.15.114:0/1687154181 >> 172.21.15.114:0/1687154181 conn(0x7f33b00b1640 msgr2=0x7f33b00b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.925+0000 7f33b74d4640 1 -- 172.21.15.114:0/1687154181 shutdown_connections 2023-11-04T01:44:15.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.925+0000 7f33b74d4640 1 -- 172.21.15.114:0/1687154181 wait complete. 2023-11-04T01:44:15.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.926+0000 7f33b74d4640 1 Processor -- start 2023-11-04T01:44:15.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.926+0000 7f33b74d4640 1 -- start start 2023-11-04T01:44:15.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b74d4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33b00cb680 0x7f33b015d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b74d4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33b01597a0 0x7f33b01f38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b74d4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b015afb0 0x7f33b01f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b74d4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b01f3490 con 0x7f33b015afb0 2023-11-04T01:44:15.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b74d4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b014d870 con 0x7f33b01597a0 2023-11-04T01:44:15.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b74d4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b01f2e40 con 0x7f33b00cb680 2023-11-04T01:44:15.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b5a71640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b015afb0 0x7f33b01f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b5a71640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b015afb0 0x7f33b01f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55692/0 (socket says 172.21.15.114:55692) 2023-11-04T01:44:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b5a71640 1 -- 172.21.15.114:0/2610360569 learned_addr learned my addr 172.21.15.114:0/2610360569 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b4a6f640 1 --2- 172.21.15.114:0/2610360569 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33b01597a0 0x7f33b01f38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b5270640 1 --2- 172.21.15.114:0/2610360569 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33b00cb680 0x7f33b015d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b5a71640 1 -- 172.21.15.114:0/2610360569 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33b00cb680 msgr2=0x7f33b015d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b5a71640 1 --2- 172.21.15.114:0/2610360569 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33b00cb680 0x7f33b015d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b5a71640 1 -- 172.21.15.114:0/2610360569 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33b01597a0 msgr2=0x7f33b01f38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b5a71640 1 --2- 172.21.15.114:0/2610360569 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33b01597a0 0x7f33b01f38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b5a71640 1 -- 172.21.15.114:0/2610360569 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac009400 con 0x7f33b015afb0 2023-11-04T01:44:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.927+0000 7f33b4a6f640 1 --2- 172.21.15.114:0/2610360569 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33b01597a0 0x7f33b01f38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.928+0000 7f33b5a71640 1 --2- 172.21.15.114:0/2610360569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b015afb0 0x7f33b01f64b0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f33a800cd50 tx=0x7f33a800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.928+0000 7f33a5ffb640 1 -- 172.21.15.114:0/2610360569 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a800f680 con 0x7f33b015afb0 2023-11-04T01:44:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.928+0000 7f33a5ffb640 1 -- 172.21.15.114:0/2610360569 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a800f800 con 0x7f33b015afb0 2023-11-04T01:44:15.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.928+0000 7f33b74d4640 1 -- 172.21.15.114:0/2610360569 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b01f6f00 con 0x7f33b015afb0 2023-11-04T01:44:15.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.928+0000 7f33a5ffb640 1 -- 172.21.15.114:0/2610360569 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a800fbb0 con 0x7f33b015afb0 2023-11-04T01:44:15.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.928+0000 7f33b74d4640 1 -- 172.21.15.114:0/2610360569 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b01f30b0 con 0x7f33b015afb0 2023-11-04T01:44:15.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.929+0000 7f33b74d4640 1 -- 172.21.15.114:0/2610360569 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b01f7420 con 0x7f33b015afb0 2023-11-04T01:44:15.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.929+0000 7f33a5ffb640 1 -- 172.21.15.114:0/2610360569 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f33a800b040 con 0x7f33b015afb0 2023-11-04T01:44:15.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.930+0000 7f33a5ffb640 1 --2- 172.21.15.114:0/2610360569 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f339406ae70 0x7f339406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.930+0000 7f33b5270640 1 --2- 172.21.15.114:0/2610360569 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f339406ae70 0x7f339406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.930+0000 7f33a5ffb640 1 -- 172.21.15.114:0/2610360569 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f33a808a980 con 0x7f33b015afb0 2023-11-04T01:44:15.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.930+0000 7f33b5270640 1 --2- 172.21.15.114:0/2610360569 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f339406ae70 0x7f339406d330 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f33ac036000 tx=0x7f33ac03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:15.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:15.934+0000 7f33a5ffb640 1 -- 172.21.15.114:0/2610360569 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f33a80550c0 con 0x7f33b015afb0 2023-11-04T01:44:16.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:16.137+0000 7f33b74d4640 1 -- 172.21.15.114:0/2610360569 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33b00684b0 con 0x7f33b015afb0 2023-11-04T01:44:16.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:16.138+0000 7f33a5ffb640 1 -- 172.21.15.114:0/2610360569 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4955 (secure 0 0 0) 0x7f33a801d020 con 0x7f33b015afb0 2023-11-04T01:44:16.140 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:16.140 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":113,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2540656643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2540656643},{"type":"v1","addr":"172.21.15.114:6835","nonce":2540656643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:09.806173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":7063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7063":{"gid":7063,"name":"b","rank":1,"incarnation":111,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:16.140 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 113 2023-11-04T01:44:16.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:16.140+0000 7f33b74d4640 1 -- 172.21.15.114:0/2610360569 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f339406ae70 msgr2=0x7f339406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:16.140+0000 7f33b74d4640 1 --2- 172.21.15.114:0/2610360569 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f339406ae70 0x7f339406d330 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f33ac036000 tx=0x7f33ac03d040 comp rx=0 tx=0).stop 2023-11-04T01:44:16.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:16.140+0000 7f33b74d4640 1 -- 172.21.15.114:0/2610360569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b015afb0 msgr2=0x7f33b01f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:16.140+0000 7f33b74d4640 1 --2- 172.21.15.114:0/2610360569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b015afb0 0x7f33b01f64b0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f33a800cd50 tx=0x7f33a800a650 comp rx=0 tx=0).stop 2023-11-04T01:44:16.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:16.140+0000 7f33b74d4640 1 -- 172.21.15.114:0/2610360569 shutdown_connections 2023-11-04T01:44:16.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:16.140+0000 7f33b74d4640 1 --2- 172.21.15.114:0/2610360569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b015afb0 0x7f33b01f64b0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:16.140+0000 7f33b74d4640 1 --2- 172.21.15.114:0/2610360569 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f339406ae70 0x7f339406d330 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:16.140+0000 7f33b74d4640 1 --2- 172.21.15.114:0/2610360569 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f33b01597a0 0x7f33b01f38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:16.140+0000 7f33b74d4640 1 --2- 172.21.15.114:0/2610360569 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f33b00cb680 0x7f33b015d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:16.140+0000 7f33b74d4640 1 -- 172.21.15.114:0/2610360569 >> 172.21.15.114:0/2610360569 conn(0x7f33b00b1640 msgr2=0x7f33b00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:16.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:16.140+0000 7f33b74d4640 1 -- 172.21.15.114:0/2610360569 shutdown_connections 2023-11-04T01:44:16.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:16.140+0000 7f33b74d4640 1 -- 172.21.15.114:0/2610360569 wait complete. 2023-11-04T01:44:16.152 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:44:17.153 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:17.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.262+0000 7f8913968640 1 Processor -- start 2023-11-04T01:44:17.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.262+0000 7f8913968640 1 -- start start 2023-11-04T01:44:17.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.263+0000 7f8913968640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f890c0ceda0 0x7f890c15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.263+0000 7f8913968640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f890c0b0150 con 0x7f890c0b2210 2023-11-04T01:44:17.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.263+0000 7f8913968640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f890c0b1170 con 0x7f890c0cf890 2023-11-04T01:44:17.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.263+0000 7f8913968640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f890c0b1df0 con 0x7f890c0ceda0 2023-11-04T01:44:17.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.263+0000 7f8910f03640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f890c0b2210 0x7f890c0cf180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34506/0 (socket says 172.21.15.114:34506) 2023-11-04T01:44:17.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.263+0000 7f8910f03640 1 -- 172.21.15.114:0/1414599058 learned_addr learned my addr 172.21.15.114:0/1414599058 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:17.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.263+0000 7f8903fff640 1 -- 172.21.15.114:0/1414599058 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683572815 0 0) 0x7f890c0b0150 con 0x7f890c0b2210 2023-11-04T01:44:17.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.263+0000 7f8911704640 1 --2- 172.21.15.114:0/1414599058 >> v2:172.21.15.141:3300/0 conn(0x7f890c0ceda0 0x7f890c15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.263+0000 7f8903fff640 1 -- 172.21.15.114:0/1414599058 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88f8003520 con 0x7f890c0b2210 2023-11-04T01:44:17.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.263+0000 7f8903fff640 1 -- 172.21.15.114:0/1414599058 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2894710118 0 0) 0x7f88f8003520 con 0x7f890c0b2210 2023-11-04T01:44:17.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.263+0000 7f8903fff640 1 -- 172.21.15.114:0/1414599058 >> v2:172.21.15.141:3300/0 conn(0x7f890c0ceda0 msgr2=0x7f890c15cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.263+0000 7f8903fff640 1 --2- 172.21.15.114:0/1414599058 >> v2:172.21.15.141:3300/0 conn(0x7f890c0ceda0 0x7f890c15cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.263+0000 7f8903fff640 1 -- 172.21.15.114:0/1414599058 >> v1:172.21.15.141:6789/0 conn(0x7f890c0cf890 legacy=0x7f890c06b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.263+0000 7f8903fff640 1 -- 172.21.15.114:0/1414599058 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c0b1450 con 0x7f890c0b2210 2023-11-04T01:44:17.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.263+0000 7f8903fff640 1 -- 172.21.15.114:0/1414599058 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f88fc001670 con 0x7f890c0b2210 2023-11-04T01:44:17.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.264+0000 7f8903fff640 1 -- 172.21.15.114:0/1414599058 >> v1:172.21.15.114:6789/0 conn(0x7f890c0b2210 legacy=0x7f890c0cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.264+0000 7f8903fff640 1 --2- 172.21.15.114:0/1414599058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88f8003970 0x7f88f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.264+0000 7f8903fff640 1 --2- 172.21.15.114:0/1414599058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f88f80047c0 0x7f88f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.264+0000 7f8903fff640 1 --2- 172.21.15.114:0/1414599058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88f8005180 0x7f88f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.264+0000 7f8903fff640 1 -- 172.21.15.114:0/1414599058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c0b1df0 con 0x7f88f8005180 2023-11-04T01:44:17.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.264+0000 7f8903fff640 1 -- 172.21.15.114:0/1414599058 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f800c120 con 0x7f88f8003970 2023-11-04T01:44:17.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.264+0000 7f8903fff640 1 -- 172.21.15.114:0/1414599058 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f800c2e0 con 0x7f88f80047c0 2023-11-04T01:44:17.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.264+0000 7f8911f05640 1 --2- 172.21.15.114:0/1414599058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88f8005180 0x7f88f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.264+0000 7f8911704640 1 --2- 172.21.15.114:0/1414599058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88f8003970 0x7f88f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.264+0000 7f8910f03640 1 --2- 172.21.15.114:0/1414599058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f88f80047c0 0x7f88f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.264+0000 7f8911f05640 1 -- 172.21.15.114:0/1414599058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f88f80047c0 msgr2=0x7f88f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.264+0000 7f8911f05640 1 --2- 172.21.15.114:0/1414599058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f88f80047c0 0x7f88f8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.264+0000 7f8911f05640 1 -- 172.21.15.114:0/1414599058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88f8003970 msgr2=0x7f88f8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.264+0000 7f8911f05640 1 --2- 172.21.15.114:0/1414599058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88f8003970 0x7f88f8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.264+0000 7f8911f05640 1 -- 172.21.15.114:0/1414599058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f8003520 con 0x7f88f8005180 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.265+0000 7f8911f05640 1 -- 172.21.15.114:0/1414599058 reap_dead start 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.265+0000 7f8911f05640 1 --2- 172.21.15.114:0/1414599058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88f8005180 0x7f88f800b980 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f8904001e50 tx=0x7f88f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dedb8b8343de1399 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.265+0000 7f8903fff640 1 -- 172.21.15.114:0/1414599058 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8904003b70 con 0x7f88f8005180 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.265+0000 7f8903fff640 1 -- 172.21.15.114:0/1414599058 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8904003cf0 con 0x7f88f8005180 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.265+0000 7f8903fff640 1 -- 172.21.15.114:0/1414599058 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8904005310 con 0x7f88f8005180 2023-11-04T01:44:17.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.265+0000 7f8913968640 1 -- 172.21.15.114:0/1414599058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88f8005180 msgr2=0x7f88f800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.265+0000 7f8913968640 1 --2- 172.21.15.114:0/1414599058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88f8005180 0x7f88f800b980 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f8904001e50 tx=0x7f88f80057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.265+0000 7f8913968640 1 -- 172.21.15.114:0/1414599058 shutdown_connections 2023-11-04T01:44:17.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.265+0000 7f8913968640 1 --2- 172.21.15.114:0/1414599058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88f8005180 0x7f88f800b980 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.266+0000 7f8913968640 1 -- 172.21.15.114:0/1414599058 >> 172.21.15.114:0/1414599058 conn(0x7f890c0d0c30 msgr2=0x7f890c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.266+0000 7f8913968640 1 -- 172.21.15.114:0/1414599058 shutdown_connections 2023-11-04T01:44:17.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.266+0000 7f8913968640 1 -- 172.21.15.114:0/1414599058 wait complete. 2023-11-04T01:44:17.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.267+0000 7f8913968640 1 Processor -- start 2023-11-04T01:44:17.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.267+0000 7f8913968640 1 -- start start 2023-11-04T01:44:17.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.267+0000 7f8913968640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88f8005180 0x7f890c0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.267+0000 7f8913968640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f890c1520e0 0x7f890c0c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.267+0000 7f8913968640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f890c1e6d20 0x7f890c1e71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.267+0000 7f8913968640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c0c9ce0 con 0x7f890c1520e0 2023-11-04T01:44:17.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.267+0000 7f8913968640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c1e76e0 con 0x7f88f8005180 2023-11-04T01:44:17.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.267+0000 7f8913968640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890c0c6430 con 0x7f890c1e6d20 2023-11-04T01:44:17.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.268+0000 7f8910f03640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f890c1520e0 0x7f890c0c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.268+0000 7f8910f03640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f890c1520e0 0x7f890c0c9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55042/0 (socket says 172.21.15.114:55042) 2023-11-04T01:44:17.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.268+0000 7f8910f03640 1 -- 172.21.15.114:0/2544786112 learned_addr learned my addr 172.21.15.114:0/2544786112 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:17.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.268+0000 7f8911704640 1 --2- 172.21.15.114:0/2544786112 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88f8005180 0x7f890c0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.268+0000 7f8911f05640 1 --2- 172.21.15.114:0/2544786112 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f890c1e6d20 0x7f890c1e71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.268+0000 7f8910f03640 1 -- 172.21.15.114:0/2544786112 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f890c1e6d20 msgr2=0x7f890c1e71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.268+0000 7f8910f03640 1 --2- 172.21.15.114:0/2544786112 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f890c1e6d20 0x7f890c1e71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.268+0000 7f8910f03640 1 -- 172.21.15.114:0/2544786112 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88f8005180 msgr2=0x7f890c0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.268+0000 7f8910f03640 1 --2- 172.21.15.114:0/2544786112 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88f8005180 0x7f890c0c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.268+0000 7f8910f03640 1 -- 172.21.15.114:0/2544786112 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c152560 con 0x7f890c1520e0 2023-11-04T01:44:17.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.268+0000 7f8910f03640 1 --2- 172.21.15.114:0/2544786112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f890c1520e0 0x7f890c0c9500 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f88fc000fb0 tx=0x7f88fc007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.268+0000 7f8901ffb640 1 -- 172.21.15.114:0/2544786112 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc00f990 con 0x7f890c1520e0 2023-11-04T01:44:17.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.268+0000 7f8901ffb640 1 -- 172.21.15.114:0/2544786112 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88fc00fb10 con 0x7f890c1520e0 2023-11-04T01:44:17.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.268+0000 7f8901ffb640 1 -- 172.21.15.114:0/2544786112 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc00fec0 con 0x7f890c1520e0 2023-11-04T01:44:17.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.268+0000 7f8913968640 1 -- 172.21.15.114:0/2544786112 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f890c0c9a40 con 0x7f890c1520e0 2023-11-04T01:44:17.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.268+0000 7f8913968640 1 -- 172.21.15.114:0/2544786112 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f890c0c5de0 con 0x7f890c1520e0 2023-11-04T01:44:17.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.270+0000 7f8913968640 1 -- 172.21.15.114:0/2544786112 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890c0c65a0 con 0x7f890c1520e0 2023-11-04T01:44:17.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.270+0000 7f8901ffb640 1 -- 172.21.15.114:0/2544786112 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f88fc01d460 con 0x7f890c1520e0 2023-11-04T01:44:17.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.270+0000 7f8901ffb640 1 --2- 172.21.15.114:0/2544786112 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f88f006aea0 0x7f88f006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.270+0000 7f8911704640 1 --2- 172.21.15.114:0/2544786112 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f88f006aea0 0x7f88f006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.270+0000 7f8901ffb640 1 -- 172.21.15.114:0/2544786112 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f88fc08a180 con 0x7f890c1520e0 2023-11-04T01:44:17.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.271+0000 7f8911704640 1 --2- 172.21.15.114:0/2544786112 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f88f006aea0 0x7f88f006d360 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8908009a70 tx=0x7f8908008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.275+0000 7f8901ffb640 1 -- 172.21.15.114:0/2544786112 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88fc054890 con 0x7f890c1520e0 2023-11-04T01:44:17.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.478+0000 7f8913968640 1 -- 172.21.15.114:0/2544786112 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f890c0684b0 con 0x7f890c1520e0 2023-11-04T01:44:17.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.478+0000 7f8901ffb640 1 -- 172.21.15.114:0/2544786112 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4955 (secure 0 0 0) 0x7f88fc057eb0 con 0x7f890c1520e0 2023-11-04T01:44:17.480 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:17.480 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":113,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2540656643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2540656643},{"type":"v1","addr":"172.21.15.114:6835","nonce":2540656643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:09.806173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":7063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7063":{"gid":7063,"name":"b","rank":1,"incarnation":111,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:17.481 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 113 2023-11-04T01:44:17.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.480+0000 7f8913968640 1 -- 172.21.15.114:0/2544786112 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f88f006aea0 msgr2=0x7f88f006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.480+0000 7f8913968640 1 --2- 172.21.15.114:0/2544786112 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f88f006aea0 0x7f88f006d360 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8908009a70 tx=0x7f8908008040 comp rx=0 tx=0).stop 2023-11-04T01:44:17.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.480+0000 7f8913968640 1 -- 172.21.15.114:0/2544786112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f890c1520e0 msgr2=0x7f890c0c9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.480+0000 7f8913968640 1 --2- 172.21.15.114:0/2544786112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f890c1520e0 0x7f890c0c9500 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f88fc000fb0 tx=0x7f88fc007720 comp rx=0 tx=0).stop 2023-11-04T01:44:17.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.480+0000 7f8913968640 1 -- 172.21.15.114:0/2544786112 shutdown_connections 2023-11-04T01:44:17.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.480+0000 7f8913968640 1 --2- 172.21.15.114:0/2544786112 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f890c1e6d20 0x7f890c1e71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.480+0000 7f8913968640 1 --2- 172.21.15.114:0/2544786112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f890c1520e0 0x7f890c0c9500 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.480+0000 7f8913968640 1 --2- 172.21.15.114:0/2544786112 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f88f006aea0 0x7f88f006d360 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.480+0000 7f8913968640 1 --2- 172.21.15.114:0/2544786112 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f88f8005180 0x7f890c0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.480+0000 7f8913968640 1 -- 172.21.15.114:0/2544786112 >> 172.21.15.114:0/2544786112 conn(0x7f890c0d0c30 msgr2=0x7f890c0add30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.480+0000 7f8913968640 1 -- 172.21.15.114:0/2544786112 shutdown_connections 2023-11-04T01:44:17.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:17.480+0000 7f8913968640 1 -- 172.21.15.114:0/2544786112 wait complete. 2023-11-04T01:44:17.492 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:44:18.494 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:18.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.598+0000 7f421b489640 1 Processor -- start 2023-11-04T01:44:18.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.598+0000 7f421b489640 1 -- start start 2023-11-04T01:44:18.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f421b489640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f42140addd0 0x7f42140cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f421b489640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f421406c220 0x7f42140ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f421b489640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42140cd720 con 0x7f42140cc680 2023-11-04T01:44:18.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f421b489640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42140ae1b0 con 0x7f42140addd0 2023-11-04T01:44:18.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f421b489640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42140ccb10 con 0x7f421406c220 2023-11-04T01:44:18.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f4218a24640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f42140cc680 0x7f421406bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34508/0 (socket says 172.21.15.114:34508) 2023-11-04T01:44:18.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f4218a24640 1 -- 172.21.15.114:0/3033748821 learned_addr learned my addr 172.21.15.114:0/3033748821 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:18.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f420bfff640 1 -- 172.21.15.114:0/3033748821 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699266404 0 0) 0x7f42140cd720 con 0x7f42140cc680 2023-11-04T01:44:18.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f420bfff640 1 -- 172.21.15.114:0/3033748821 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4200004630 con 0x7f42140cc680 2023-11-04T01:44:18.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f4219a26640 1 --2- 172.21.15.114:0/3033748821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f421406c220 0x7f42140ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f4219225640 1 --2- 172.21.15.114:0/3033748821 >> v2:172.21.15.141:3300/0 conn(0x7f42140addd0 0x7f42140cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f420bfff640 1 -- 172.21.15.114:0/3033748821 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 67844736 0 0) 0x7f4200004630 con 0x7f42140cc680 2023-11-04T01:44:18.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f420bfff640 1 -- 172.21.15.114:0/3033748821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f421406c220 msgr2=0x7f42140ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f420bfff640 1 --2- 172.21.15.114:0/3033748821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f421406c220 0x7f42140ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f420bfff640 1 -- 172.21.15.114:0/3033748821 >> v2:172.21.15.141:3300/0 conn(0x7f42140addd0 msgr2=0x7f42140cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f420bfff640 1 --2- 172.21.15.114:0/3033748821 >> v2:172.21.15.141:3300/0 conn(0x7f42140addd0 0x7f42140cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f420bfff640 1 -- 172.21.15.114:0/3033748821 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42140ccdf0 con 0x7f42140cc680 2023-11-04T01:44:18.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f420bfff640 1 -- 172.21.15.114:0/3033748821 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f4204001670 con 0x7f42140cc680 2023-11-04T01:44:18.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f420bfff640 1 -- 172.21.15.114:0/3033748821 >> v1:172.21.15.114:6789/0 conn(0x7f42140cc680 legacy=0x7f421406bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.599+0000 7f420bfff640 1 --2- 172.21.15.114:0/3033748821 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4200004a80 0x7f4200004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.600+0000 7f420bfff640 1 --2- 172.21.15.114:0/3033748821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f421406c220 0x7f42000058d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.600+0000 7f420bfff640 1 --2- 172.21.15.114:0/3033748821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4200005e10 0x7f4200006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.600+0000 7f420bfff640 1 -- 172.21.15.114:0/3033748821 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42140ae1b0 con 0x7f4200005e10 2023-11-04T01:44:18.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.600+0000 7f420bfff640 1 -- 172.21.15.114:0/3033748821 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42140ccb10 con 0x7f4200004a80 2023-11-04T01:44:18.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.600+0000 7f420bfff640 1 -- 172.21.15.114:0/3033748821 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420000cb90 con 0x7f421406c220 2023-11-04T01:44:18.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.600+0000 7f4219225640 1 --2- 172.21.15.114:0/3033748821 >> v2:172.21.15.141:3300/0 conn(0x7f42140addd0 0x7f42140cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:18.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.600+0000 7f4219a26640 1 --2- 172.21.15.114:0/3033748821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4200005e10 0x7f4200006290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.600+0000 7f4218a24640 1 --2- 172.21.15.114:0/3033748821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f421406c220 0x7f42000058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.600+0000 7f4219225640 1 --2- 172.21.15.114:0/3033748821 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4200004a80 0x7f4200004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.600+0000 7f4219a26640 1 -- 172.21.15.114:0/3033748821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f421406c220 msgr2=0x7f42000058d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.600+0000 7f4219a26640 1 --2- 172.21.15.114:0/3033748821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f421406c220 0x7f42000058d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.600+0000 7f4219a26640 1 -- 172.21.15.114:0/3033748821 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4200004a80 msgr2=0x7f4200004ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.600+0000 7f4219a26640 1 --2- 172.21.15.114:0/3033748821 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4200004a80 0x7f4200004ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.600+0000 7f4219a26640 1 -- 172.21.15.114:0/3033748821 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4200004630 con 0x7f4200005e10 2023-11-04T01:44:18.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.600+0000 7f4219225640 1 --2- 172.21.15.114:0/3033748821 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4200004a80 0x7f4200004ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:18.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.600+0000 7f4218a24640 1 --2- 172.21.15.114:0/3033748821 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f421406c220 0x7f42000058d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:18.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.601+0000 7f4219a26640 1 --2- 172.21.15.114:0/3033748821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4200005e10 0x7f4200006290 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f420c007330 tx=0x7f4200006900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6af6977d1b9097 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.601+0000 7f420bfff640 1 -- 172.21.15.114:0/3033748821 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c02cca0 con 0x7f4200005e10 2023-11-04T01:44:18.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.601+0000 7f420bfff640 1 -- 172.21.15.114:0/3033748821 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c02ce00 con 0x7f4200005e10 2023-11-04T01:44:18.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.601+0000 7f420bfff640 1 -- 172.21.15.114:0/3033748821 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c034660 con 0x7f4200005e10 2023-11-04T01:44:18.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.601+0000 7f421b489640 1 -- 172.21.15.114:0/3033748821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4200005e10 msgr2=0x7f4200006290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.601+0000 7f421b489640 1 --2- 172.21.15.114:0/3033748821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4200005e10 0x7f4200006290 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f420c007330 tx=0x7f4200006900 comp rx=0 tx=0).stop 2023-11-04T01:44:18.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.601+0000 7f4219a26640 1 -- 172.21.15.114:0/3033748821 reap_dead start 2023-11-04T01:44:18.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.601+0000 7f421b489640 1 -- 172.21.15.114:0/3033748821 shutdown_connections 2023-11-04T01:44:18.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.601+0000 7f421b489640 1 -- 172.21.15.114:0/3033748821 >> 172.21.15.114:0/3033748821 conn(0x7f42140cb530 msgr2=0x7f42140cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:18.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.601+0000 7f421b489640 1 -- 172.21.15.114:0/3033748821 shutdown_connections 2023-11-04T01:44:18.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.601+0000 7f421b489640 1 -- 172.21.15.114:0/3033748821 wait complete. 2023-11-04T01:44:18.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.602+0000 7f421b489640 1 Processor -- start 2023-11-04T01:44:18.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.603+0000 7f421b489640 1 -- start start 2023-11-04T01:44:18.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.603+0000 7f421b489640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4200005e10 0x7f421414b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.603+0000 7f421b489640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42140c7d90 0x7f42140c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.603+0000 7f421b489640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42140c3ca0 0x7f42140c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.603+0000 7f421b489640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42140c8750 con 0x7f42140c3ca0 2023-11-04T01:44:18.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.603+0000 7f421b489640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42140b36b0 con 0x7f4200005e10 2023-11-04T01:44:18.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.603+0000 7f421b489640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42140c4a10 con 0x7f42140c7d90 2023-11-04T01:44:18.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.603+0000 7f4219a26640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42140c3ca0 0x7f42140c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.603+0000 7f4219a26640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42140c3ca0 0x7f42140c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55054/0 (socket says 172.21.15.114:55054) 2023-11-04T01:44:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.603+0000 7f4219a26640 1 -- 172.21.15.114:0/1657927557 learned_addr learned my addr 172.21.15.114:0/1657927557 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.603+0000 7f4219225640 1 --2- 172.21.15.114:0/1657927557 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4200005e10 0x7f421414b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.603+0000 7f4218a24640 1 --2- 172.21.15.114:0/1657927557 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42140c7d90 0x7f42140c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.604+0000 7f4219a26640 1 -- 172.21.15.114:0/1657927557 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42140c7d90 msgr2=0x7f42140c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.604+0000 7f4219a26640 1 --2- 172.21.15.114:0/1657927557 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42140c7d90 0x7f42140c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.604+0000 7f4219a26640 1 -- 172.21.15.114:0/1657927557 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4200005e10 msgr2=0x7f421414b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.604+0000 7f4219a26640 1 --2- 172.21.15.114:0/1657927557 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4200005e10 0x7f421414b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.604+0000 7f4219a26640 1 -- 172.21.15.114:0/1657927557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42140b28f0 con 0x7f42140c3ca0 2023-11-04T01:44:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.604+0000 7f4219225640 1 --2- 172.21.15.114:0/1657927557 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4200005e10 0x7f421414b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.604+0000 7f4219a26640 1 --2- 172.21.15.114:0/1657927557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42140c3ca0 0x7f42140c4150 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f420c007330 tx=0x7f420c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.604+0000 7f4209ffb640 1 -- 172.21.15.114:0/1657927557 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c03e600 con 0x7f42140c3ca0 2023-11-04T01:44:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.604+0000 7f4209ffb640 1 -- 172.21.15.114:0/1657927557 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c03e760 con 0x7f42140c3ca0 2023-11-04T01:44:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.604+0000 7f4209ffb640 1 -- 172.21.15.114:0/1657927557 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c03eb10 con 0x7f42140c3ca0 2023-11-04T01:44:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.604+0000 7f421b489640 1 -- 172.21.15.114:0/1657927557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42140b2bd0 con 0x7f42140c3ca0 2023-11-04T01:44:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.604+0000 7f421b489640 1 -- 172.21.15.114:0/1657927557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42140b3190 con 0x7f42140c3ca0 2023-11-04T01:44:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.605+0000 7f421b489640 1 -- 172.21.15.114:0/1657927557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42140684b0 con 0x7f42140c3ca0 2023-11-04T01:44:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.605+0000 7f4209ffb640 1 -- 172.21.15.114:0/1657927557 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f420c03ec70 con 0x7f42140c3ca0 2023-11-04T01:44:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.606+0000 7f4209ffb640 1 --2- 172.21.15.114:0/1657927557 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41f806aea0 0x7f41f806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.606+0000 7f4209ffb640 1 -- 172.21.15.114:0/1657927557 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f420c0ac3e0 con 0x7f42140c3ca0 2023-11-04T01:44:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.606+0000 7f4219225640 1 --2- 172.21.15.114:0/1657927557 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41f806aea0 0x7f41f806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.606+0000 7f4219225640 1 --2- 172.21.15.114:0/1657927557 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41f806aea0 0x7f41f806d360 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4210006e80 tx=0x7f4210008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.610+0000 7f4209ffb640 1 -- 172.21.15.114:0/1657927557 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f420c076c30 con 0x7f42140c3ca0 2023-11-04T01:44:18.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.810+0000 7f421b489640 1 -- 172.21.15.114:0/1657927557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42140c8750 con 0x7f42140c3ca0 2023-11-04T01:44:18.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.810+0000 7f4209ffb640 1 -- 172.21.15.114:0/1657927557 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4949 (secure 0 0 0) 0x7f420c039090 con 0x7f42140c3ca0 2023-11-04T01:44:18.812 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:18.812 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":114,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2540656643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2540656643},{"type":"v1","addr":"172.21.15.114:6835","nonce":2540656643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:16.843315+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":7063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7063":{"gid":7063,"name":"b","rank":1,"incarnation":111,"state":"up:rejoin","state_seq":6,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:rejoin","state_seq":17,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:18.812 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 114 2023-11-04T01:44:18.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.812+0000 7f421b489640 1 -- 172.21.15.114:0/1657927557 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41f806aea0 msgr2=0x7f41f806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.812+0000 7f421b489640 1 --2- 172.21.15.114:0/1657927557 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41f806aea0 0x7f41f806d360 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4210006e80 tx=0x7f4210008040 comp rx=0 tx=0).stop 2023-11-04T01:44:18.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.812+0000 7f421b489640 1 -- 172.21.15.114:0/1657927557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42140c3ca0 msgr2=0x7f42140c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.812+0000 7f421b489640 1 --2- 172.21.15.114:0/1657927557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42140c3ca0 0x7f42140c4150 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f420c007330 tx=0x7f420c004ab0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.812+0000 7f421b489640 1 -- 172.21.15.114:0/1657927557 shutdown_connections 2023-11-04T01:44:18.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.812+0000 7f421b489640 1 --2- 172.21.15.114:0/1657927557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42140c3ca0 0x7f42140c4150 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.812+0000 7f421b489640 1 --2- 172.21.15.114:0/1657927557 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f42140c7d90 0x7f42140c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.812+0000 7f421b489640 1 --2- 172.21.15.114:0/1657927557 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f41f806aea0 0x7f41f806d360 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.812+0000 7f421b489640 1 --2- 172.21.15.114:0/1657927557 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f4200005e10 0x7f421414b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.812+0000 7f421b489640 1 -- 172.21.15.114:0/1657927557 >> 172.21.15.114:0/1657927557 conn(0x7f42140cb530 msgr2=0x7f42140ae2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:18.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.812+0000 7f421b489640 1 -- 172.21.15.114:0/1657927557 shutdown_connections 2023-11-04T01:44:18.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:18.812+0000 7f421b489640 1 -- 172.21.15.114:0/1657927557 wait complete. 2023-11-04T01:44:18.824 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:rejoin 2023-11-04T01:44:19.441 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:44:19.440+0000 7f2fddf56640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:19.441 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:44:19.440+0000 7f2fddf56640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:44:19.825 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:19.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.937+0000 7f0e1b776640 1 Processor -- start 2023-11-04T01:44:19.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.937+0000 7f0e1b776640 1 -- start start 2023-11-04T01:44:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.938+0000 7f0e1b776640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0e1406d9c0 0x7f0e140710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.938+0000 7f0e1b776640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e1406c5f0 0x7f0e14071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.938+0000 7f0e1b776640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1406cc90 con 0x7f0e140ade00 2023-11-04T01:44:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.938+0000 7f0e1b776640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e140b0c40 con 0x7f0e1406d9c0 2023-11-04T01:44:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.938+0000 7f0e1b776640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e14071b50 con 0x7f0e1406c5f0 2023-11-04T01:44:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.938+0000 7f0e18d11640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0e1406d9c0 0x7f0e140710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.938+0000 7f0e19512640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0e140ade00 0x7f0e140b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34518/0 (socket says 172.21.15.114:34518) 2023-11-04T01:44:19.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.938+0000 7f0e19512640 1 -- 172.21.15.114:0/3171111286 learned_addr learned my addr 172.21.15.114:0/3171111286 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:19.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.938+0000 7f0e19d13640 1 --2- 172.21.15.114:0/3171111286 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e1406c5f0 0x7f0e14071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:19.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.938+0000 7f0e18d11640 1 -- 172.21.15.114:0/3171111286 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e1406c5f0 msgr2=0x7f0e14071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:19.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.938+0000 7f0e18d11640 1 --2- 172.21.15.114:0/3171111286 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e1406c5f0 0x7f0e14071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.938+0000 7f0e18d11640 1 -- 172.21.15.114:0/3171111286 >> v1:172.21.15.114:6789/0 conn(0x7f0e140ade00 legacy=0x7f0e140b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:19.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.938+0000 7f0e18d11640 1 -- 172.21.15.114:0/3171111286 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e140b0e60 con 0x7f0e1406d9c0 2023-11-04T01:44:19.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.939+0000 7f0e18d11640 1 --2- 172.21.15.114:0/3171111286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e1406d9c0 0x7f0e140710d0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f0e040097a0 tx=0x7f0e0402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fa37d262e587ae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:19.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.939+0000 7f0e0bfff640 1 -- 172.21.15.114:0/3171111286 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0402f050 con 0x7f0e1406d9c0 2023-11-04T01:44:19.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.939+0000 7f0e0bfff640 1 -- 172.21.15.114:0/3171111286 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e04031700 con 0x7f0e1406d9c0 2023-11-04T01:44:19.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.939+0000 7f0e0bfff640 1 -- 172.21.15.114:0/3171111286 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e04031a90 con 0x7f0e1406d9c0 2023-11-04T01:44:19.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.940+0000 7f0e1b776640 1 -- 172.21.15.114:0/3171111286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e1406d9c0 msgr2=0x7f0e140710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:19.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.940+0000 7f0e1b776640 1 --2- 172.21.15.114:0/3171111286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e1406d9c0 0x7f0e140710d0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f0e040097a0 tx=0x7f0e0402b7a0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.940+0000 7f0e1b776640 1 -- 172.21.15.114:0/3171111286 shutdown_connections 2023-11-04T01:44:19.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.940+0000 7f0e1b776640 1 --2- 172.21.15.114:0/3171111286 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e1406c5f0 0x7f0e14071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.940+0000 7f0e1b776640 1 --2- 172.21.15.114:0/3171111286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e1406d9c0 0x7f0e140710d0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.940+0000 7f0e1b776640 1 -- 172.21.15.114:0/3171111286 >> 172.21.15.114:0/3171111286 conn(0x7f0e140cb530 msgr2=0x7f0e140cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:19.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.940+0000 7f0e1b776640 1 -- 172.21.15.114:0/3171111286 shutdown_connections 2023-11-04T01:44:19.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.940+0000 7f0e1b776640 1 -- 172.21.15.114:0/3171111286 wait complete. 2023-11-04T01:44:19.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.941+0000 7f0e1b776640 1 Processor -- start 2023-11-04T01:44:19.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.941+0000 7f0e1b776640 1 -- start start 2023-11-04T01:44:19.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e1b776640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e1406c5f0 0x7f0e14153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:19.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e1b776640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e1406d9c0 0x7f0e141581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:19.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e1b776640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e140ade00 0x7f0e14158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:19.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e1b776640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e14154460 con 0x7f0e140ade00 2023-11-04T01:44:19.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e1b776640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e14159dd0 con 0x7f0e1406d9c0 2023-11-04T01:44:19.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e1b776640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e14158d50 con 0x7f0e1406c5f0 2023-11-04T01:44:19.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e19d13640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e140ade00 0x7f0e14158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:19.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e19d13640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e140ade00 0x7f0e14158710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55084/0 (socket says 172.21.15.114:55084) 2023-11-04T01:44:19.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e19d13640 1 -- 172.21.15.114:0/1423089349 learned_addr learned my addr 172.21.15.114:0/1423089349 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:19.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e19d13640 1 -- 172.21.15.114:0/1423089349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e1406c5f0 msgr2=0x7f0e14153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:19.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e19512640 1 --2- 172.21.15.114:0/1423089349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e1406c5f0 0x7f0e14153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:19.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e19d13640 1 --2- 172.21.15.114:0/1423089349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e1406c5f0 0x7f0e14153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e19d13640 1 -- 172.21.15.114:0/1423089349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e1406d9c0 msgr2=0x7f0e141581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:19.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e19d13640 1 --2- 172.21.15.114:0/1423089349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e1406d9c0 0x7f0e141581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e19d13640 1 -- 172.21.15.114:0/1423089349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e04009400 con 0x7f0e140ade00 2023-11-04T01:44:19.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e19d13640 1 --2- 172.21.15.114:0/1423089349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e140ade00 0x7f0e14158710 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c007e60 tx=0x7f0e0c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:19.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e09ffb640 1 -- 172.21.15.114:0/1423089349 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c014420 con 0x7f0e140ade00 2023-11-04T01:44:19.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e09ffb640 1 -- 172.21.15.114:0/1423089349 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c014580 con 0x7f0e140ade00 2023-11-04T01:44:19.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e1b776640 1 -- 172.21.15.114:0/1423089349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e14159010 con 0x7f0e140ade00 2023-11-04T01:44:19.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.942+0000 7f0e09ffb640 1 -- 172.21.15.114:0/1423089349 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c014930 con 0x7f0e140ade00 2023-11-04T01:44:19.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.943+0000 7f0e1b776640 1 -- 172.21.15.114:0/1423089349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e141595d0 con 0x7f0e140ade00 2023-11-04T01:44:19.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.944+0000 7f0e1b776640 1 -- 172.21.15.114:0/1423089349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e140684b0 con 0x7f0e140ade00 2023-11-04T01:44:19.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.944+0000 7f0e09ffb640 1 -- 172.21.15.114:0/1423089349 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e0c014a90 con 0x7f0e140ade00 2023-11-04T01:44:19.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.944+0000 7f0e09ffb640 1 --2- 172.21.15.114:0/1423089349 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0df806ae70 0x7f0df806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:19.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.944+0000 7f0e09ffb640 1 -- 172.21.15.114:0/1423089349 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f0e0c08a810 con 0x7f0e140ade00 2023-11-04T01:44:19.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.944+0000 7f0e19512640 1 --2- 172.21.15.114:0/1423089349 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0df806ae70 0x7f0df806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:19.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.945+0000 7f0e19512640 1 --2- 172.21.15.114:0/1423089349 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0df806ae70 0x7f0df806d330 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0e10005880 tx=0x7f0e10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:19.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:19.949+0000 7f0e09ffb640 1 -- 172.21.15.114:0/1423089349 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e0c054fb0 con 0x7f0e140ade00 2023-11-04T01:44:20.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.149+0000 7f0e1b776640 1 -- 172.21.15.114:0/1423089349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e140cbdb0 con 0x7f0e140ade00 2023-11-04T01:44:20.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.149+0000 7f0e09ffb640 1 -- 172.21.15.114:0/1423089349 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4949 (secure 0 0 0) 0x7f0e0c0585d0 con 0x7f0e140ade00 2023-11-04T01:44:20.151 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:20.151 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":115,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2540656643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2540656643},{"type":"v1","addr":"172.21.15.114:6835","nonce":2540656643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:17.850751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":7063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7063":{"gid":7063,"name":"b","rank":1,"incarnation":111,"state":"up:active","state_seq":7,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:active","state_seq":18,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:20.151 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 115 2023-11-04T01:44:20.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.151+0000 7f0e1b776640 1 -- 172.21.15.114:0/1423089349 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0df806ae70 msgr2=0x7f0df806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.151+0000 7f0e1b776640 1 --2- 172.21.15.114:0/1423089349 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0df806ae70 0x7f0df806d330 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0e10005880 tx=0x7f0e10009040 comp rx=0 tx=0).stop 2023-11-04T01:44:20.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.151+0000 7f0e1b776640 1 -- 172.21.15.114:0/1423089349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e140ade00 msgr2=0x7f0e14158710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.151+0000 7f0e1b776640 1 --2- 172.21.15.114:0/1423089349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e140ade00 0x7f0e14158710 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c007e60 tx=0x7f0e0c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.151+0000 7f0e1b776640 1 -- 172.21.15.114:0/1423089349 shutdown_connections 2023-11-04T01:44:20.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.151+0000 7f0e1b776640 1 --2- 172.21.15.114:0/1423089349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e140ade00 0x7f0e14158710 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.151+0000 7f0e1b776640 1 --2- 172.21.15.114:0/1423089349 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f0df806ae70 0x7f0df806d330 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.151+0000 7f0e1b776640 1 --2- 172.21.15.114:0/1423089349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0e1406d9c0 0x7f0e141581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.151+0000 7f0e1b776640 1 --2- 172.21.15.114:0/1423089349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f0e1406c5f0 0x7f0e14153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.151+0000 7f0e1b776640 1 -- 172.21.15.114:0/1423089349 >> 172.21.15.114:0/1423089349 conn(0x7f0e140cb530 msgr2=0x7f0e140b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:20.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.151+0000 7f0e1b776640 1 -- 172.21.15.114:0/1423089349 shutdown_connections 2023-11-04T01:44:20.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.151+0000 7f0e1b776640 1 -- 172.21.15.114:0/1423089349 wait complete. 2023-11-04T01:44:20.163 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:44:20.163 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.678999185562134s 2023-11-04T01:44:20.163 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:44:20.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:20.164 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-11-04T01:44:20.191 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:44:20.191 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:20.250 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:20.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.387+0000 7f49d5f16640 1 Processor -- start 2023-11-04T01:44:20.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.387+0000 7f49d5f16640 1 -- start start 2023-11-04T01:44:20.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.388+0000 7f49d5f16640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f49d015d100 0x7f49d00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.388+0000 7f49d5f16640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f49d00d1be0 0x7f49d00b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.388+0000 7f49d5f16640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d00b32b0 con 0x7f49d015d4e0 2023-11-04T01:44:20.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.388+0000 7f49d5f16640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d00cee10 con 0x7f49d00d1be0 2023-11-04T01:44:20.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.388+0000 7f49d5f16640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d00b2980 con 0x7f49d015d100 2023-11-04T01:44:20.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.388+0000 7f49cffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f49d00d1be0 0x7f49d00b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.388+0000 7f49cffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f49d00d1be0 0x7f49d00b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55092/0 (socket says 172.21.15.114:55092) 2023-11-04T01:44:20.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.388+0000 7f49cffff640 1 -- 172.21.15.114:0/894890187 learned_addr learned my addr 172.21.15.114:0/894890187 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:20.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.389+0000 7f49cf7fe640 1 --2- 172.21.15.114:0/894890187 >> v2:172.21.15.141:3300/0 conn(0x7f49d015d100 0x7f49d00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.389+0000 7f49cffff640 1 -- 172.21.15.114:0/894890187 >> v2:172.21.15.141:3300/0 conn(0x7f49d015d100 msgr2=0x7f49d00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:20.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.389+0000 7f49cffff640 1 --2- 172.21.15.114:0/894890187 >> v2:172.21.15.141:3300/0 conn(0x7f49d015d100 0x7f49d00ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.389+0000 7f49cffff640 1 -- 172.21.15.114:0/894890187 >> v1:172.21.15.141:6789/0 conn(0x7f49d015d4e0 legacy=0x7f49d00d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:20.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.389+0000 7f49cffff640 1 -- 172.21.15.114:0/894890187 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d00b2c60 con 0x7f49d00d1be0 2023-11-04T01:44:20.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.389+0000 7f49cffff640 1 --2- 172.21.15.114:0/894890187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d00d1be0 0x7f49d00b3740 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f49d00d09f0 tx=0x7f49c802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d17df4be02c3887 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.389+0000 7f49ceffd640 1 -- 172.21.15.114:0/894890187 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c802ca80 con 0x7f49d00d1be0 2023-11-04T01:44:20.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.389+0000 7f49ceffd640 1 -- 172.21.15.114:0/894890187 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c802cbe0 con 0x7f49d00d1be0 2023-11-04T01:44:20.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.389+0000 7f49ceffd640 1 -- 172.21.15.114:0/894890187 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c80343f0 con 0x7f49d00d1be0 2023-11-04T01:44:20.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.390+0000 7f49d5f16640 1 -- 172.21.15.114:0/894890187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d00d1be0 msgr2=0x7f49d00b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.390+0000 7f49d5f16640 1 --2- 172.21.15.114:0/894890187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d00d1be0 0x7f49d00b3740 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f49d00d09f0 tx=0x7f49c802bee0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.390+0000 7f49d5f16640 1 -- 172.21.15.114:0/894890187 shutdown_connections 2023-11-04T01:44:20.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.390+0000 7f49d5f16640 1 --2- 172.21.15.114:0/894890187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d00d1be0 0x7f49d00b3740 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.390+0000 7f49d5f16640 1 --2- 172.21.15.114:0/894890187 >> v2:172.21.15.141:3300/0 conn(0x7f49d015d100 0x7f49d00ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.390+0000 7f49d5f16640 1 -- 172.21.15.114:0/894890187 >> 172.21.15.114:0/894890187 conn(0x7f49d00d2ef0 msgr2=0x7f49d00d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:20.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.390+0000 7f49d5f16640 1 -- 172.21.15.114:0/894890187 shutdown_connections 2023-11-04T01:44:20.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.390+0000 7f49d5f16640 1 -- 172.21.15.114:0/894890187 wait complete. 2023-11-04T01:44:20.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.391+0000 7f49d5f16640 1 Processor -- start 2023-11-04T01:44:20.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.391+0000 7f49d5f16640 1 -- start start 2023-11-04T01:44:20.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.392+0000 7f49d5f16640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49d00d1be0 0x7f49d00caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.392+0000 7f49d5f16640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d015d100 0x7f49d0154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.392+0000 7f49d5f16640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49d015d4e0 0x7f49d0156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.392+0000 7f49d5f16640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d0157710 con 0x7f49d015d100 2023-11-04T01:44:20.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.392+0000 7f49d5f16640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d0157fb0 con 0x7f49d00d1be0 2023-11-04T01:44:20.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.392+0000 7f49d5f16640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d00caf80 con 0x7f49d015d4e0 2023-11-04T01:44:20.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.392+0000 7f49c6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d015d100 0x7f49d0154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.392+0000 7f49c6ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d015d100 0x7f49d0154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55098/0 (socket says 172.21.15.114:55098) 2023-11-04T01:44:20.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.392+0000 7f49c6ffd640 1 -- 172.21.15.114:0/1215685968 learned_addr learned my addr 172.21.15.114:0/1215685968 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:20.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.392+0000 7f49cf7fe640 1 --2- 172.21.15.114:0/1215685968 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49d00d1be0 0x7f49d00caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.392+0000 7f49cffff640 1 --2- 172.21.15.114:0/1215685968 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49d015d4e0 0x7f49d0156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.392+0000 7f49c6ffd640 1 -- 172.21.15.114:0/1215685968 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49d015d4e0 msgr2=0x7f49d0156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.392+0000 7f49c6ffd640 1 --2- 172.21.15.114:0/1215685968 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49d015d4e0 0x7f49d0156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.392+0000 7f49c6ffd640 1 -- 172.21.15.114:0/1215685968 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49d00d1be0 msgr2=0x7f49d00caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.392+0000 7f49c6ffd640 1 --2- 172.21.15.114:0/1215685968 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49d00d1be0 0x7f49d00caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.392+0000 7f49c6ffd640 1 -- 172.21.15.114:0/1215685968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c8009b30 con 0x7f49d015d100 2023-11-04T01:44:20.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.393+0000 7f49c6ffd640 1 --2- 172.21.15.114:0/1215685968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d015d100 0x7f49d0154ba0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f49b800c430 tx=0x7f49b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.393+0000 7f49ccff9640 1 -- 172.21.15.114:0/1215685968 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b80035f0 con 0x7f49d015d100 2023-11-04T01:44:20.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.393+0000 7f49ccff9640 1 -- 172.21.15.114:0/1215685968 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b8003750 con 0x7f49d015d100 2023-11-04T01:44:20.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.393+0000 7f49ccff9640 1 -- 172.21.15.114:0/1215685968 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b8003b00 con 0x7f49d015d100 2023-11-04T01:44:20.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.393+0000 7f49d5f16640 1 -- 172.21.15.114:0/1215685968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d01554a0 con 0x7f49d015d100 2023-11-04T01:44:20.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.393+0000 7f49d5f16640 1 -- 172.21.15.114:0/1215685968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d0157c40 con 0x7f49d015d100 2023-11-04T01:44:20.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.394+0000 7f49d5f16640 1 -- 172.21.15.114:0/1215685968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d0158120 con 0x7f49d015d100 2023-11-04T01:44:20.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.394+0000 7f49ccff9640 1 -- 172.21.15.114:0/1215685968 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f49b8003c60 con 0x7f49d015d100 2023-11-04T01:44:20.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.394+0000 7f49ccff9640 1 --2- 172.21.15.114:0/1215685968 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f49b006ae70 0x7f49b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.394+0000 7f49ccff9640 1 -- 172.21.15.114:0/1215685968 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f49b8089130 con 0x7f49d015d100 2023-11-04T01:44:20.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.395+0000 7f49cf7fe640 1 --2- 172.21.15.114:0/1215685968 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f49b006ae70 0x7f49b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.395+0000 7f49cf7fe640 1 --2- 172.21.15.114:0/1215685968 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f49b006ae70 0x7f49b006d330 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f49d0154140 tx=0x7f49c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.399+0000 7f49ccff9640 1 -- 172.21.15.114:0/1215685968 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f49b80538f0 con 0x7f49d015d100 2023-11-04T01:44:20.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.567+0000 7f49d5f16640 1 -- 172.21.15.114:0/1215685968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49d00684b0 con 0x7f49d015d100 2023-11-04T01:44:20.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.569+0000 7f49ccff9640 1 -- 172.21.15.114:0/1215685968 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+23679 (secure 0 0 0) 0x7f49b8017090 con 0x7f49d015d100 2023-11-04T01:44:20.571 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:20.571 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":114,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:44:16.827068+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:50.031565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:50.411946+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":2}]},{"pgid":"17.3c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/979876939":"2023-11-05T01:44:08.794891+0000","172.21.15.114:6834/979876939":"2023-11-05T01:44:08.794891+0000","192.168.0.1:0/3180677097":"2023-11-04T02:43:26.710151+0000","172.21.15.114:6836/3145796350":"2023-11-05T01:43:18.419560+0000","172.21.15.114:6837/3825479201":"2023-11-05T01:43:11.612005+0000","172.21.15.114:6835/3825479201":"2023-11-05T01:43:11.612005+0000","172.21.15.114:6834/3145796350":"2023-11-05T01:43:18.419560+0000","172.21.15.114:6834/3780323525":"2023-11-05T01:40:32.050690+0000","192.168.0.1:0/76750670":"2023-11-04T02:44:16.664609+0000","172.21.15.114:6836/3780323525":"2023-11-05T01:40:32.050690+0000","172.21.15.141:6834/1296600989":"2023-11-05T01:42:28.568489+0000","172.21.15.114:6835/1768068040":"2023-11-05T01:40:57.284155+0000","172.21.15.141:6834/224279622":"2023-11-05T01:44:01.557691+0000","172.21.15.114:6837/1768068040":"2023-11-05T01:40:57.284155+0000","172.21.15.141:6832/1296600989":"2023-11-05T01:42:28.568489+0000","172.21.15.114:6836/2722332212":"2023-11-05T01:41:22.824334+0000","172.21.15.114:6835/1052115332":"2023-11-05T01:41:48.753700+0000","192.168.0.1:0/958873281":"2023-11-04T02:42:36.859026+0000","172.21.15.114:6837/1052115332":"2023-11-05T01:41:48.753700+0000","172.21.15.141:6832/224279622":"2023-11-05T01:44:01.557691+0000","172.21.15.114:6836/1629274449":"2023-11-05T01:42:21.762099+0000","172.21.15.114:6834/2722332212":"2023-11-05T01:41:22.824334+0000","172.21.15.114:6834/1629274449":"2023-11-05T01:42:21.762099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:20.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.571+0000 7f49d5f16640 1 -- 172.21.15.114:0/1215685968 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f49b006ae70 msgr2=0x7f49b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.571+0000 7f49d5f16640 1 --2- 172.21.15.114:0/1215685968 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f49b006ae70 0x7f49b006d330 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f49d0154140 tx=0x7f49c0008040 comp rx=0 tx=0).stop 2023-11-04T01:44:20.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.571+0000 7f49d5f16640 1 -- 172.21.15.114:0/1215685968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d015d100 msgr2=0x7f49d0154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.571+0000 7f49d5f16640 1 --2- 172.21.15.114:0/1215685968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d015d100 0x7f49d0154ba0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f49b800c430 tx=0x7f49b800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.571+0000 7f49d5f16640 1 -- 172.21.15.114:0/1215685968 shutdown_connections 2023-11-04T01:44:20.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.571+0000 7f49d5f16640 1 --2- 172.21.15.114:0/1215685968 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f49d015d4e0 0x7f49d0156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.571+0000 7f49d5f16640 1 --2- 172.21.15.114:0/1215685968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d015d100 0x7f49d0154ba0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.571+0000 7f49d5f16640 1 --2- 172.21.15.114:0/1215685968 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f49b006ae70 0x7f49b006d330 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.571+0000 7f49d5f16640 1 --2- 172.21.15.114:0/1215685968 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f49d00d1be0 0x7f49d00caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.571+0000 7f49d5f16640 1 -- 172.21.15.114:0/1215685968 >> 172.21.15.114:0/1215685968 conn(0x7f49d00d2ef0 msgr2=0x7f49d00afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:20.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.571+0000 7f49d5f16640 1 -- 172.21.15.114:0/1215685968 shutdown_connections 2023-11-04T01:44:20.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.571+0000 7f49d5f16640 1 -- 172.21.15.114:0/1215685968 wait complete. 2023-11-04T01:44:20.583 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:58.316710+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:59.185397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:50.031565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:50.411946+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 104, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:44:20.584 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:44:20.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.685+0000 7fc74e92c640 1 Processor -- start 2023-11-04T01:44:20.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.685+0000 7fc74e92c640 1 -- start start 2023-11-04T01:44:20.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.685+0000 7fc74e92c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc7480d1be0 0x7fc748167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.685+0000 7fc74e92c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7480b32b0 con 0x7fc74815d4e0 2023-11-04T01:44:20.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.685+0000 7fc74e92c640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7480cee10 con 0x7fc74815d100 2023-11-04T01:44:20.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.685+0000 7fc74e92c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7480cec20 con 0x7fc7480d1be0 2023-11-04T01:44:20.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc7477fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc74815d4e0 0x7fc7480d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34530/0 (socket says 172.21.15.114:34530) 2023-11-04T01:44:20.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc7477fe640 1 -- 172.21.15.114:0/2331049783 learned_addr learned my addr 172.21.15.114:0/2331049783 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:20.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc746ffd640 1 -- 172.21.15.114:0/2331049783 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066366555 0 0) 0x7fc7480b32b0 con 0x7fc74815d4e0 2023-11-04T01:44:20.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc746ffd640 1 -- 172.21.15.114:0/2331049783 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc730003520 con 0x7fc74815d4e0 2023-11-04T01:44:20.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc74cec9640 1 --2- 172.21.15.114:0/2331049783 >> v2:172.21.15.141:3300/0 conn(0x7fc7480d1be0 0x7fc748167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc746ffd640 1 -- 172.21.15.114:0/2331049783 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1051457740 0 0) 0x7fc730003520 con 0x7fc74815d4e0 2023-11-04T01:44:20.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc746ffd640 1 -- 172.21.15.114:0/2331049783 >> v2:172.21.15.141:3300/0 conn(0x7fc7480d1be0 msgr2=0x7fc748167e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:20.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc746ffd640 1 --2- 172.21.15.114:0/2331049783 >> v2:172.21.15.141:3300/0 conn(0x7fc7480d1be0 0x7fc748167e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc746ffd640 1 -- 172.21.15.114:0/2331049783 >> v1:172.21.15.141:6789/0 conn(0x7fc74815d100 legacy=0x7fc7480ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc746ffd640 1 -- 172.21.15.114:0/2331049783 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7480b4750 con 0x7fc74815d4e0 2023-11-04T01:44:20.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc746ffd640 1 -- 172.21.15.114:0/2331049783 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fc73c001670 con 0x7fc74815d4e0 2023-11-04T01:44:20.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc746ffd640 1 -- 172.21.15.114:0/2331049783 >> v1:172.21.15.114:6789/0 conn(0x7fc74815d4e0 legacy=0x7fc7480d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc746ffd640 1 --2- 172.21.15.114:0/2331049783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc730003970 0x7fc730003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc746ffd640 1 --2- 172.21.15.114:0/2331049783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7300047c0 0x7fc730004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc746ffd640 1 --2- 172.21.15.114:0/2331049783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc730005180 0x7fc73000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc746ffd640 1 -- 172.21.15.114:0/2331049783 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73000c0a0 con 0x7fc7300047c0 2023-11-04T01:44:20.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc746ffd640 1 -- 172.21.15.114:0/2331049783 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73000c210 con 0x7fc730005180 2023-11-04T01:44:20.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc746ffd640 1 -- 172.21.15.114:0/2331049783 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73000c3d0 con 0x7fc730003970 2023-11-04T01:44:20.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc7477fe640 1 --2- 172.21.15.114:0/2331049783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7300047c0 0x7fc730004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc747fff640 1 --2- 172.21.15.114:0/2331049783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc730003970 0x7fc730003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc74cec9640 1 --2- 172.21.15.114:0/2331049783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc730005180 0x7fc73000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc7477fe640 1 -- 172.21.15.114:0/2331049783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc730003970 msgr2=0x7fc730003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:20.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc7477fe640 1 --2- 172.21.15.114:0/2331049783 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc730003970 0x7fc730003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc7477fe640 1 -- 172.21.15.114:0/2331049783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc730005180 msgr2=0x7fc73000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:20.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc7477fe640 1 --2- 172.21.15.114:0/2331049783 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc730005180 0x7fc73000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc74cec9640 1 -- 172.21.15.114:0/2331049783 reap_dead start 2023-11-04T01:44:20.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.686+0000 7fc7477fe640 1 -- 172.21.15.114:0/2331049783 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc730003520 con 0x7fc7300047c0 2023-11-04T01:44:20.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.687+0000 7fc7477fe640 1 --2- 172.21.15.114:0/2331049783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7300047c0 0x7fc730004c40 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fc73c007fd0 tx=0x7fc7300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5967db8ffd6189ee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.687+0000 7fc746ffd640 1 -- 172.21.15.114:0/2331049783 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c005ad0 con 0x7fc7300047c0 2023-11-04T01:44:20.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.687+0000 7fc746ffd640 1 -- 172.21.15.114:0/2331049783 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c005c30 con 0x7fc7300047c0 2023-11-04T01:44:20.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.687+0000 7fc746ffd640 1 -- 172.21.15.114:0/2331049783 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c02c870 con 0x7fc7300047c0 2023-11-04T01:44:20.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.688+0000 7fc74e92c640 1 -- 172.21.15.114:0/2331049783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7300047c0 msgr2=0x7fc730004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.688+0000 7fc74e92c640 1 --2- 172.21.15.114:0/2331049783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7300047c0 0x7fc730004c40 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fc73c007fd0 tx=0x7fc7300057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.688+0000 7fc74e92c640 1 -- 172.21.15.114:0/2331049783 shutdown_connections 2023-11-04T01:44:20.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.688+0000 7fc74e92c640 1 --2- 172.21.15.114:0/2331049783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7300047c0 0x7fc730004c40 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.688+0000 7fc74e92c640 1 -- 172.21.15.114:0/2331049783 >> 172.21.15.114:0/2331049783 conn(0x7fc7480d2ef0 msgr2=0x7fc7480d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:20.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.688+0000 7fc74e92c640 1 -- 172.21.15.114:0/2331049783 shutdown_connections 2023-11-04T01:44:20.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.688+0000 7fc74e92c640 1 -- 172.21.15.114:0/2331049783 wait complete. 2023-11-04T01:44:20.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.689+0000 7fc74e92c640 1 Processor -- start 2023-11-04T01:44:20.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.689+0000 7fc74e92c640 1 -- start start 2023-11-04T01:44:20.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc74e92c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc7300047c0 0x7fc7481f6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc74e92c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc7480c9fc0 0x7fc7480cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc74e92c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc74815dc20 0x7fc74815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc74e92c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7481f6f70 con 0x7fc74815dc20 2023-11-04T01:44:20.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc74e92c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7480cc9c0 con 0x7fc7300047c0 2023-11-04T01:44:20.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc74e92c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7480ca440 con 0x7fc7480c9fc0 2023-11-04T01:44:20.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc74cec9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc74815dc20 0x7fc74815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc74cec9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc74815dc20 0x7fc74815e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55110/0 (socket says 172.21.15.114:55110) 2023-11-04T01:44:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc74cec9640 1 -- 172.21.15.114:0/1675733173 learned_addr learned my addr 172.21.15.114:0/1675733173 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc74cec9640 1 -- 172.21.15.114:0/1675733173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc7480c9fc0 msgr2=0x7fc7480cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc74cec9640 1 --2- 172.21.15.114:0/1675733173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc7480c9fc0 0x7fc7480cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc74cec9640 1 -- 172.21.15.114:0/1675733173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc7300047c0 msgr2=0x7fc7481f6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc74cec9640 1 --2- 172.21.15.114:0/1675733173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc7300047c0 0x7fc7481f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc74cec9640 1 -- 172.21.15.114:0/1675733173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7480ca720 con 0x7fc74815dc20 2023-11-04T01:44:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc74cec9640 1 --2- 172.21.15.114:0/1675733173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc74815dc20 0x7fc74815e0b0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fc74815d8c0 tx=0x7fc740009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc744ff9640 1 -- 172.21.15.114:0/1675733173 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740003bc0 con 0x7fc74815dc20 2023-11-04T01:44:20.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc744ff9640 1 -- 172.21.15.114:0/1675733173 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74000f050 con 0x7fc74815dc20 2023-11-04T01:44:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc74e92c640 1 -- 172.21.15.114:0/1675733173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7480caa00 con 0x7fc74815dc20 2023-11-04T01:44:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.690+0000 7fc744ff9640 1 -- 172.21.15.114:0/1675733173 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740014410 con 0x7fc74815dc20 2023-11-04T01:44:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.691+0000 7fc74e92c640 1 -- 172.21.15.114:0/1675733173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7480cafc0 con 0x7fc74815dc20 2023-11-04T01:44:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.692+0000 7fc74e92c640 1 -- 172.21.15.114:0/1675733173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74815d940 con 0x7fc74815dc20 2023-11-04T01:44:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.692+0000 7fc744ff9640 1 -- 172.21.15.114:0/1675733173 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc740014570 con 0x7fc74815dc20 2023-11-04T01:44:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.692+0000 7fc744ff9640 1 --2- 172.21.15.114:0/1675733173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc73406ae70 0x7fc73406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.692+0000 7fc744ff9640 1 -- 172.21.15.114:0/1675733173 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fc74008a5a0 con 0x7fc74815dc20 2023-11-04T01:44:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.692+0000 7fc747fff640 1 --2- 172.21.15.114:0/1675733173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc73406ae70 0x7fc73406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.693+0000 7fc747fff640 1 --2- 172.21.15.114:0/1675733173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc73406ae70 0x7fc73406d330 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc7380015a0 tx=0x7fc738009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.697+0000 7fc744ff9640 1 -- 172.21.15.114:0/1675733173 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc74815d940 con 0x7fc74815dc20 2023-11-04T01:44:20.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.865+0000 7fc74e92c640 1 -- 172.21.15.114:0/1675733173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc74815d940 con 0x7fc74815dc20 2023-11-04T01:44:20.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.865+0000 7fc744ff9640 1 -- 172.21.15.114:0/1675733173 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v114) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc74815d940 con 0x7fc74815dc20 2023-11-04T01:44:20.867 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:44:20.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.867+0000 7fc74e92c640 1 -- 172.21.15.114:0/1675733173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc73406ae70 msgr2=0x7fc73406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.867+0000 7fc74e92c640 1 --2- 172.21.15.114:0/1675733173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc73406ae70 0x7fc73406d330 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc7380015a0 tx=0x7fc738009040 comp rx=0 tx=0).stop 2023-11-04T01:44:20.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.867+0000 7fc74e92c640 1 -- 172.21.15.114:0/1675733173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc74815dc20 msgr2=0x7fc74815e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.867+0000 7fc74e92c640 1 --2- 172.21.15.114:0/1675733173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc74815dc20 0x7fc74815e0b0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fc74815d8c0 tx=0x7fc740009cd0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.867+0000 7fc74e92c640 1 -- 172.21.15.114:0/1675733173 shutdown_connections 2023-11-04T01:44:20.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.867+0000 7fc74e92c640 1 --2- 172.21.15.114:0/1675733173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc74815dc20 0x7fc74815e0b0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.867+0000 7fc74e92c640 1 --2- 172.21.15.114:0/1675733173 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc7480c9fc0 0x7fc7480cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.867+0000 7fc74e92c640 1 --2- 172.21.15.114:0/1675733173 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc73406ae70 0x7fc73406d330 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.867+0000 7fc74e92c640 1 --2- 172.21.15.114:0/1675733173 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc7300047c0 0x7fc7481f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.867+0000 7fc74e92c640 1 -- 172.21.15.114:0/1675733173 >> 172.21.15.114:0/1675733173 conn(0x7fc7480d2ef0 msgr2=0x7fc7480d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:20.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.867+0000 7fc74e92c640 1 -- 172.21.15.114:0/1675733173 shutdown_connections 2023-11-04T01:44:20.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.867+0000 7fc74e92c640 1 -- 172.21.15.114:0/1675733173 wait complete. 2023-11-04T01:44:20.879 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:44:20.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.980+0000 7f25144a9640 1 Processor -- start 2023-11-04T01:44:20.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.981+0000 7f25144a9640 1 -- start start 2023-11-04T01:44:20.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.981+0000 7f25144a9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f250c15d100 0x7f250c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.981+0000 7f25144a9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f250c0d1be0 0x7f250c0b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.981+0000 7f25144a9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250c0b32b0 con 0x7f250c15d4e0 2023-11-04T01:44:20.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.981+0000 7f25144a9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250c0cee10 con 0x7f250c0d1be0 2023-11-04T01:44:20.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.981+0000 7f25144a9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250c0b2980 con 0x7f250c15d100 2023-11-04T01:44:20.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.982+0000 7f2512a46640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f250c0d1be0 0x7f250c0b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.982+0000 7f2511a44640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f250c15d4e0 0x7f250c0d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34540/0 (socket says 172.21.15.114:34540) 2023-11-04T01:44:20.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.982+0000 7f2511a44640 1 -- 172.21.15.114:0/2462331345 learned_addr learned my addr 172.21.15.114:0/2462331345 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:20.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.982+0000 7f2512245640 1 --2- 172.21.15.114:0/2462331345 >> v2:172.21.15.141:3300/0 conn(0x7f250c15d100 0x7f250c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.982+0000 7f2512a46640 1 -- 172.21.15.114:0/2462331345 >> v2:172.21.15.141:3300/0 conn(0x7f250c15d100 msgr2=0x7f250c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:20.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.982+0000 7f2512a46640 1 --2- 172.21.15.114:0/2462331345 >> v2:172.21.15.141:3300/0 conn(0x7f250c15d100 0x7f250c0ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.982+0000 7f2512a46640 1 -- 172.21.15.114:0/2462331345 >> v1:172.21.15.114:6789/0 conn(0x7f250c15d4e0 legacy=0x7f250c0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.982+0000 7f2511243640 1 -- 172.21.15.114:0/2462331345 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763496071 0 0) 0x7f250c0b32b0 con 0x7f250c15d4e0 2023-11-04T01:44:20.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.982+0000 7f2512a46640 1 -- 172.21.15.114:0/2462331345 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c0b2c60 con 0x7f250c0d1be0 2023-11-04T01:44:20.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.983+0000 7f2512a46640 1 --2- 172.21.15.114:0/2462331345 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f250c0d1be0 0x7f250c0b3740 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f250c0d09f0 tx=0x7f24fc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca7570fc9f0c3b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.983+0000 7f2511243640 1 -- 172.21.15.114:0/2462331345 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc031830 con 0x7f250c0d1be0 2023-11-04T01:44:20.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.983+0000 7f2511243640 1 -- 172.21.15.114:0/2462331345 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc031990 con 0x7f250c0d1be0 2023-11-04T01:44:20.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.983+0000 7f2511243640 1 -- 172.21.15.114:0/2462331345 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc031d20 con 0x7f250c0d1be0 2023-11-04T01:44:20.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.983+0000 7f25144a9640 1 -- 172.21.15.114:0/2462331345 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f250c0d1be0 msgr2=0x7f250c0b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.983+0000 7f25144a9640 1 --2- 172.21.15.114:0/2462331345 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f250c0d1be0 0x7f250c0b3740 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f250c0d09f0 tx=0x7f24fc02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.983+0000 7f25144a9640 1 -- 172.21.15.114:0/2462331345 shutdown_connections 2023-11-04T01:44:20.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.983+0000 7f25144a9640 1 --2- 172.21.15.114:0/2462331345 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f250c0d1be0 0x7f250c0b3740 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.983+0000 7f25144a9640 1 --2- 172.21.15.114:0/2462331345 >> v2:172.21.15.141:3300/0 conn(0x7f250c15d100 0x7f250c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.983+0000 7f25144a9640 1 -- 172.21.15.114:0/2462331345 >> 172.21.15.114:0/2462331345 conn(0x7f250c0d2ef0 msgr2=0x7f250c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:20.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.983+0000 7f25144a9640 1 -- 172.21.15.114:0/2462331345 shutdown_connections 2023-11-04T01:44:20.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.983+0000 7f25144a9640 1 -- 172.21.15.114:0/2462331345 wait complete. 2023-11-04T01:44:20.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.984+0000 7f25144a9640 1 Processor -- start 2023-11-04T01:44:20.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.985+0000 7f25144a9640 1 -- start start 2023-11-04T01:44:20.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.985+0000 7f25144a9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f250c0d1be0 0x7f250c1f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.985+0000 7f25144a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f250c15d100 0x7f250c15a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.985+0000 7f25144a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f250c15d4e0 0x7f250c155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.985+0000 7f25144a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c1577d0 con 0x7f250c15d100 2023-11-04T01:44:20.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.985+0000 7f25144a9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c1517c0 con 0x7f250c0d1be0 2023-11-04T01:44:20.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.985+0000 7f25144a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250c154f80 con 0x7f250c15d4e0 2023-11-04T01:44:20.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.985+0000 7f2511a44640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f250c15d100 0x7f250c15a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.985+0000 7f2511a44640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f250c15d100 0x7f250c15a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55126/0 (socket says 172.21.15.114:55126) 2023-11-04T01:44:20.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.985+0000 7f2511a44640 1 -- 172.21.15.114:0/1575396803 learned_addr learned my addr 172.21.15.114:0/1575396803 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:20.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.985+0000 7f2512245640 1 --2- 172.21.15.114:0/1575396803 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f250c0d1be0 0x7f250c1f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.986+0000 7f2512a46640 1 --2- 172.21.15.114:0/1575396803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f250c15d4e0 0x7f250c155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.986+0000 7f2511a44640 1 -- 172.21.15.114:0/1575396803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f250c15d4e0 msgr2=0x7f250c155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.986+0000 7f2511a44640 1 --2- 172.21.15.114:0/1575396803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f250c15d4e0 0x7f250c155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.986+0000 7f2511a44640 1 -- 172.21.15.114:0/1575396803 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f250c0d1be0 msgr2=0x7f250c1f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.986+0000 7f2511a44640 1 --2- 172.21.15.114:0/1575396803 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f250c0d1be0 0x7f250c1f21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.986+0000 7f2511a44640 1 -- 172.21.15.114:0/1575396803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc009400 con 0x7f250c15d100 2023-11-04T01:44:20.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.986+0000 7f2512a46640 1 --2- 172.21.15.114:0/1575396803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f250c15d4e0 0x7f250c155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:20.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.986+0000 7f2512245640 1 --2- 172.21.15.114:0/1575396803 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f250c0d1be0 0x7f250c1f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:20.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.986+0000 7f2511a44640 1 --2- 172.21.15.114:0/1575396803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f250c15d100 0x7f250c15a300 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f250000c4b0 tx=0x7f250000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.986+0000 7f250affd640 1 -- 172.21.15.114:0/1575396803 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25000074e0 con 0x7f250c15d100 2023-11-04T01:44:20.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.986+0000 7f250affd640 1 -- 172.21.15.114:0/1575396803 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2500007660 con 0x7f250c15d100 2023-11-04T01:44:20.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.986+0000 7f25144a9640 1 -- 172.21.15.114:0/1575396803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250c155260 con 0x7f250c15d100 2023-11-04T01:44:20.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.986+0000 7f250affd640 1 -- 172.21.15.114:0/1575396803 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500004a20 con 0x7f250c15d100 2023-11-04T01:44:20.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.986+0000 7f25144a9640 1 -- 172.21.15.114:0/1575396803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250c155540 con 0x7f250c15d100 2023-11-04T01:44:20.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.987+0000 7f25144a9640 1 -- 172.21.15.114:0/1575396803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250c157cb0 con 0x7f250c15d100 2023-11-04T01:44:20.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.987+0000 7f250affd640 1 -- 172.21.15.114:0/1575396803 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2500004b80 con 0x7f250c15d100 2023-11-04T01:44:20.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.988+0000 7f250affd640 1 --2- 172.21.15.114:0/1575396803 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24f806ae70 0x7f24f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.988+0000 7f250affd640 1 -- 172.21.15.114:0/1575396803 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f25000894d0 con 0x7f250c15d100 2023-11-04T01:44:20.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.988+0000 7f2512245640 1 --2- 172.21.15.114:0/1575396803 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24f806ae70 0x7f24f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.988+0000 7f2512245640 1 --2- 172.21.15.114:0/1575396803 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24f806ae70 0x7f24f806d330 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2504007500 tx=0x7f250400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:20.992+0000 7f250affd640 1 -- 172.21.15.114:0/1575396803 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f250c157cb0 con 0x7f250c15d100 2023-11-04T01:44:21.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.156+0000 7f25144a9640 1 -- 172.21.15.114:0/1575396803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f250c157cb0 con 0x7f250c15d100 2023-11-04T01:44:21.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.157+0000 7f250affd640 1 -- 172.21.15.114:0/1575396803 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v114) v1 ==== 103+0+11 (secure 0 0 0) 0x7f250c157cb0 con 0x7f250c15d100 2023-11-04T01:44:21.159 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:44:21.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.158+0000 7f25144a9640 1 -- 172.21.15.114:0/1575396803 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24f806ae70 msgr2=0x7f24f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.158+0000 7f25144a9640 1 --2- 172.21.15.114:0/1575396803 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24f806ae70 0x7f24f806d330 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2504007500 tx=0x7f250400b040 comp rx=0 tx=0).stop 2023-11-04T01:44:21.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.158+0000 7f25144a9640 1 -- 172.21.15.114:0/1575396803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f250c15d100 msgr2=0x7f250c15a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.158+0000 7f25144a9640 1 --2- 172.21.15.114:0/1575396803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f250c15d100 0x7f250c15a300 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f250000c4b0 tx=0x7f250000c970 comp rx=0 tx=0).stop 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.159+0000 7f25144a9640 1 -- 172.21.15.114:0/1575396803 shutdown_connections 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.159+0000 7f25144a9640 1 --2- 172.21.15.114:0/1575396803 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f250c15d4e0 0x7f250c155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.159+0000 7f25144a9640 1 --2- 172.21.15.114:0/1575396803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f250c15d100 0x7f250c15a300 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.159+0000 7f25144a9640 1 --2- 172.21.15.114:0/1575396803 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f24f806ae70 0x7f24f806d330 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.159+0000 7f25144a9640 1 --2- 172.21.15.114:0/1575396803 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f250c0d1be0 0x7f250c1f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.159+0000 7f25144a9640 1 -- 172.21.15.114:0/1575396803 >> 172.21.15.114:0/1575396803 conn(0x7f250c0d2ef0 msgr2=0x7f250c0c9550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.159+0000 7f25144a9640 1 -- 172.21.15.114:0/1575396803 shutdown_connections 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.159+0000 7f25144a9640 1 -- 172.21.15.114:0/1575396803 wait complete. 2023-11-04T01:44:21.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:44:21.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.271+0000 7fc71df39640 1 Processor -- start 2023-11-04T01:44:21.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.271+0000 7fc71df39640 1 -- start start 2023-11-04T01:44:21.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc71df39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc71815d630 0x7fc7180cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc71df39640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7180b0150 con 0x7fc7180ceda0 2023-11-04T01:44:21.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc71df39640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7180b1170 con 0x7fc7180b2210 2023-11-04T01:44:21.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc71df39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180b1df0 con 0x7fc71815d630 2023-11-04T01:44:21.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc7177fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc7180ceda0 0x7fc71815cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34556/0 (socket says 172.21.15.114:34556) 2023-11-04T01:44:21.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc7177fe640 1 -- 172.21.15.114:0/2608660975 learned_addr learned my addr 172.21.15.114:0/2608660975 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:21.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc717fff640 1 --2- 172.21.15.114:0/2608660975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc71815d630 0x7fc7180cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc7167fc640 1 -- 172.21.15.114:0/2608660975 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620499610 0 0) 0x7fc7180b0150 con 0x7fc7180ceda0 2023-11-04T01:44:21.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc7167fc640 1 -- 172.21.15.114:0/2608660975 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc700003520 con 0x7fc7180ceda0 2023-11-04T01:44:21.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc7167fc640 1 -- 172.21.15.114:0/2608660975 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117470405 0 0) 0x7fc7180b1170 con 0x7fc7180b2210 2023-11-04T01:44:21.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc7167fc640 1 -- 172.21.15.114:0/2608660975 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7180b0150 con 0x7fc7180b2210 2023-11-04T01:44:21.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc7167fc640 1 -- 172.21.15.114:0/2608660975 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3017253082 0 0) 0x7fc700003520 con 0x7fc7180ceda0 2023-11-04T01:44:21.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc7167fc640 1 -- 172.21.15.114:0/2608660975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc71815d630 msgr2=0x7fc7180cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:21.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc7167fc640 1 --2- 172.21.15.114:0/2608660975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc71815d630 0x7fc7180cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc7167fc640 1 -- 172.21.15.114:0/2608660975 >> v1:172.21.15.141:6789/0 conn(0x7fc7180b2210 legacy=0x7fc7180cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc7167fc640 1 -- 172.21.15.114:0/2608660975 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7180b1450 con 0x7fc7180ceda0 2023-11-04T01:44:21.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc7167fc640 1 -- 172.21.15.114:0/2608660975 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fc7080017f0 con 0x7fc7180ceda0 2023-11-04T01:44:21.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.272+0000 7fc717fff640 1 --2- 172.21.15.114:0/2608660975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc71815d630 0x7fc7180cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:21.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.273+0000 7fc7167fc640 1 -- 172.21.15.114:0/2608660975 >> v1:172.21.15.114:6789/0 conn(0x7fc7180ceda0 legacy=0x7fc71815cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.273+0000 7fc7167fc640 1 --2- 172.21.15.114:0/2608660975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc700003b30 0x7fc700003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.273+0000 7fc7167fc640 1 --2- 172.21.15.114:0/2608660975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc71815d630 0x7fc7000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.273+0000 7fc7167fc640 1 --2- 172.21.15.114:0/2608660975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc700004d00 0x7fc700005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.273+0000 7fc7167fc640 1 -- 172.21.15.114:0/2608660975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180b1df0 con 0x7fc700003b30 2023-11-04T01:44:21.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.273+0000 7fc7167fc640 1 -- 172.21.15.114:0/2608660975 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70000bb40 con 0x7fc700004d00 2023-11-04T01:44:21.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.273+0000 7fc7167fc640 1 -- 172.21.15.114:0/2608660975 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70000bd00 con 0x7fc71815d630 2023-11-04T01:44:21.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.273+0000 7fc7177fe640 1 --2- 172.21.15.114:0/2608660975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc700003b30 0x7fc700003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.273+0000 7fc716ffd640 1 --2- 172.21.15.114:0/2608660975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc71815d630 0x7fc7000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.273+0000 7fc717fff640 1 --2- 172.21.15.114:0/2608660975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc700004d00 0x7fc700005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.273+0000 7fc7177fe640 1 -- 172.21.15.114:0/2608660975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc71815d630 msgr2=0x7fc7000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:21.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.273+0000 7fc7177fe640 1 --2- 172.21.15.114:0/2608660975 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc71815d630 0x7fc7000047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.273+0000 7fc7177fe640 1 -- 172.21.15.114:0/2608660975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc700004d00 msgr2=0x7fc700005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:21.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.273+0000 7fc7177fe640 1 --2- 172.21.15.114:0/2608660975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc700004d00 0x7fc700005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.273+0000 7fc7177fe640 1 -- 172.21.15.114:0/2608660975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc710009a70 con 0x7fc700003b30 2023-11-04T01:44:21.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.273+0000 7fc717fff640 1 --2- 172.21.15.114:0/2608660975 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc700004d00 0x7fc700005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:21.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.274+0000 7fc7177fe640 1 --2- 172.21.15.114:0/2608660975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc700003b30 0x7fc700003f30 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fc708007f70 tx=0x7fc7000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ffe9164c3fd7b23 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:21.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.274+0000 7fc7167fc640 1 -- 172.21.15.114:0/2608660975 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708007270 con 0x7fc700003b30 2023-11-04T01:44:21.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.274+0000 7fc7167fc640 1 -- 172.21.15.114:0/2608660975 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7080073f0 con 0x7fc700003b30 2023-11-04T01:44:21.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.274+0000 7fc7167fc640 1 -- 172.21.15.114:0/2608660975 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7080057a0 con 0x7fc700003b30 2023-11-04T01:44:21.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.274+0000 7fc71df39640 1 -- 172.21.15.114:0/2608660975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc700003b30 msgr2=0x7fc700003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.274+0000 7fc71df39640 1 --2- 172.21.15.114:0/2608660975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc700003b30 0x7fc700003f30 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fc708007f70 tx=0x7fc7000057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.274+0000 7fc717fff640 1 -- 172.21.15.114:0/2608660975 reap_dead start 2023-11-04T01:44:21.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.274+0000 7fc71df39640 1 -- 172.21.15.114:0/2608660975 shutdown_connections 2023-11-04T01:44:21.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.274+0000 7fc71df39640 1 -- 172.21.15.114:0/2608660975 >> 172.21.15.114:0/2608660975 conn(0x7fc7180d0c30 msgr2=0x7fc7180d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:21.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.274+0000 7fc71df39640 1 -- 172.21.15.114:0/2608660975 shutdown_connections 2023-11-04T01:44:21.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.274+0000 7fc71df39640 1 -- 172.21.15.114:0/2608660975 wait complete. 2023-11-04T01:44:21.280 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:21.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.275+0000 7fc71df39640 1 Processor -- start 2023-11-04T01:44:21.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.276+0000 7fc71df39640 1 -- start start 2023-11-04T01:44:21.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.276+0000 7fc71df39640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc700003b30 0x7fc7181e49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.276+0000 7fc71df39640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc7180ca6a0 0x7fc7181e4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.276+0000 7fc71df39640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7181f62a0 0x7fc7181f6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.276+0000 7fc71df39640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181e6350 con 0x7fc7181f62a0 2023-11-04T01:44:21.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.276+0000 7fc71df39640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181e6630 con 0x7fc7180ca6a0 2023-11-04T01:44:21.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.276+0000 7fc71df39640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181e6910 con 0x7fc700003b30 2023-11-04T01:44:21.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.276+0000 7fc717fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7181f62a0 0x7fc7181f6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.276+0000 7fc717fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7181f62a0 0x7fc7181f6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55146/0 (socket says 172.21.15.114:55146) 2023-11-04T01:44:21.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.276+0000 7fc717fff640 1 -- 172.21.15.114:0/4153254880 learned_addr learned my addr 172.21.15.114:0/4153254880 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:21.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.277+0000 7fc7177fe640 1 --2- 172.21.15.114:0/4153254880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc700003b30 0x7fc7181e49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.277+0000 7fc716ffd640 1 --2- 172.21.15.114:0/4153254880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc7180ca6a0 0x7fc7181e4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.277+0000 7fc717fff640 1 -- 172.21.15.114:0/4153254880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc700003b30 msgr2=0x7fc7181e49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.277+0000 7fc717fff640 1 --2- 172.21.15.114:0/4153254880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc700003b30 0x7fc7181e49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.277+0000 7fc717fff640 1 -- 172.21.15.114:0/4153254880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc7180ca6a0 msgr2=0x7fc7181e4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.277+0000 7fc717fff640 1 --2- 172.21.15.114:0/4153254880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc7180ca6a0 0x7fc7181e4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.277+0000 7fc717fff640 1 -- 172.21.15.114:0/4153254880 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7181e6bf0 con 0x7fc7181f62a0 2023-11-04T01:44:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.277+0000 7fc716ffd640 1 --2- 172.21.15.114:0/4153254880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc7180ca6a0 0x7fc7181e4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.277+0000 7fc717fff640 1 --2- 172.21.15.114:0/4153254880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7181f62a0 0x7fc7181f6730 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fc71815da10 tx=0x7fc7100115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.277+0000 7fc6fffff640 1 -- 172.21.15.114:0/4153254880 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71000e070 con 0x7fc7181f62a0 2023-11-04T01:44:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.277+0000 7fc6fffff640 1 -- 172.21.15.114:0/4153254880 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc710003990 con 0x7fc7181f62a0 2023-11-04T01:44:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.277+0000 7fc6fffff640 1 -- 172.21.15.114:0/4153254880 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710003b40 con 0x7fc7181f62a0 2023-11-04T01:44:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.277+0000 7fc71df39640 1 -- 172.21.15.114:0/4153254880 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7181e6ed0 con 0x7fc7181f62a0 2023-11-04T01:44:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.277+0000 7fc71df39640 1 -- 172.21.15.114:0/4153254880 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7181f6c70 con 0x7fc7181f62a0 2023-11-04T01:44:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.278+0000 7fc71df39640 1 -- 172.21.15.114:0/4153254880 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7181e70c0 con 0x7fc7181f62a0 2023-11-04T01:44:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.278+0000 7fc6fffff640 1 -- 172.21.15.114:0/4153254880 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc710003ca0 con 0x7fc7181f62a0 2023-11-04T01:44:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.279+0000 7fc6fffff640 1 --2- 172.21.15.114:0/4153254880 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc70406aea0 0x7fc70406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.279+0000 7fc6fffff640 1 -- 172.21.15.114:0/4153254880 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fc71008a740 con 0x7fc7181f62a0 2023-11-04T01:44:21.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.279+0000 7fc7177fe640 1 --2- 172.21.15.114:0/4153254880 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc70406aea0 0x7fc70406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.279+0000 7fc7177fe640 1 --2- 172.21.15.114:0/4153254880 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc70406aea0 0x7fc70406d360 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc708034000 tx=0x7fc708009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:21.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.283+0000 7fc6fffff640 1 -- 172.21.15.114:0/4153254880 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc710054e50 con 0x7fc7181f62a0 2023-11-04T01:44:21.288 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:21.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.451+0000 7fc71df39640 1 -- 172.21.15.114:0/4153254880 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fc7180684b0 con 0x7fc7181f62a0 2023-11-04T01:44:21.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.451+0000 7fc6fffff640 1 -- 172.21.15.114:0/4153254880 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v114) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc710058470 con 0x7fc7181f62a0 2023-11-04T01:44:21.453 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:44:21.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.453+0000 7fc71df39640 1 -- 172.21.15.114:0/4153254880 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc70406aea0 msgr2=0x7fc70406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.453+0000 7fc71df39640 1 --2- 172.21.15.114:0/4153254880 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc70406aea0 0x7fc70406d360 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc708034000 tx=0x7fc708009030 comp rx=0 tx=0).stop 2023-11-04T01:44:21.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.453+0000 7fc71df39640 1 -- 172.21.15.114:0/4153254880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7181f62a0 msgr2=0x7fc7181f6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.453+0000 7fc71df39640 1 --2- 172.21.15.114:0/4153254880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7181f62a0 0x7fc7181f6730 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fc71815da10 tx=0x7fc7100115a0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.453+0000 7fc71df39640 1 -- 172.21.15.114:0/4153254880 shutdown_connections 2023-11-04T01:44:21.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.453+0000 7fc71df39640 1 --2- 172.21.15.114:0/4153254880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7181f62a0 0x7fc7181f6730 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.453+0000 7fc71df39640 1 --2- 172.21.15.114:0/4153254880 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc70406aea0 0x7fc70406d360 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.453+0000 7fc71df39640 1 --2- 172.21.15.114:0/4153254880 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc7180ca6a0 0x7fc7181e4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.453+0000 7fc71df39640 1 --2- 172.21.15.114:0/4153254880 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc700003b30 0x7fc7181e49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.453+0000 7fc71df39640 1 -- 172.21.15.114:0/4153254880 >> 172.21.15.114:0/4153254880 conn(0x7fc7180d0c30 msgr2=0x7fc7180d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:21.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.453+0000 7fc71df39640 1 -- 172.21.15.114:0/4153254880 shutdown_connections 2023-11-04T01:44:21.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.453+0000 7fc71df39640 1 -- 172.21.15.114:0/4153254880 wait complete. 2023-11-04T01:44:21.465 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:44:21.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.565+0000 7f6f0ace5640 1 Processor -- start 2023-11-04T01:44:21.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.565+0000 7f6f0ace5640 1 -- start start 2023-11-04T01:44:21.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.566+0000 7f6f0ace5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f0415d4e0 0x7f6f040d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.566+0000 7f6f0ace5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f040b32b0 con 0x7f6f040d3b60 2023-11-04T01:44:21.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.566+0000 7f6f0ace5640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f040cee10 con 0x7f6f0415d100 2023-11-04T01:44:21.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.566+0000 7f6f0ace5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040cec20 con 0x7f6f0415d4e0 2023-11-04T01:44:21.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.566+0000 7f6f09282640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6f040d3b60 0x7f6f040b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34570/0 (socket says 172.21.15.114:34570) 2023-11-04T01:44:21.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.566+0000 7f6f09282640 1 -- 172.21.15.114:0/579423530 learned_addr learned my addr 172.21.15.114:0/579423530 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:21.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f03fff640 1 --2- 172.21.15.114:0/579423530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f0415d4e0 0x7f6f040d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f037fe640 1 -- 172.21.15.114:0/579423530 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958280256 0 0) 0x7f6f040b32b0 con 0x7f6f040d3b60 2023-11-04T01:44:21.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f037fe640 1 -- 172.21.15.114:0/579423530 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ef4003520 con 0x7f6f040d3b60 2023-11-04T01:44:21.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f037fe640 1 -- 172.21.15.114:0/579423530 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 227988926 0 0) 0x7f6ef4003520 con 0x7f6f040d3b60 2023-11-04T01:44:21.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f037fe640 1 -- 172.21.15.114:0/579423530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f0415d4e0 msgr2=0x7f6f040d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:21.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f037fe640 1 --2- 172.21.15.114:0/579423530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f0415d4e0 0x7f6f040d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f037fe640 1 -- 172.21.15.114:0/579423530 >> v1:172.21.15.141:6789/0 conn(0x7f6f0415d100 legacy=0x7f6f040ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f037fe640 1 -- 172.21.15.114:0/579423530 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f040b2980 con 0x7f6f040d3b60 2023-11-04T01:44:21.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f037fe640 1 -- 172.21.15.114:0/579423530 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f6efc0019f0 con 0x7f6f040d3b60 2023-11-04T01:44:21.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f037fe640 1 -- 172.21.15.114:0/579423530 >> v1:172.21.15.114:6789/0 conn(0x7f6f040d3b60 legacy=0x7f6f040b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f037fe640 1 --2- 172.21.15.114:0/579423530 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ef40039a0 0x7f6ef4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f037fe640 1 --2- 172.21.15.114:0/579423530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f0415d4e0 0x7f6ef40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f037fe640 1 --2- 172.21.15.114:0/579423530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef4004d00 0x7f6ef4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f037fe640 1 -- 172.21.15.114:0/579423530 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef400ba30 con 0x7f6ef4004d00 2023-11-04T01:44:21.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f037fe640 1 -- 172.21.15.114:0/579423530 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef400bb70 con 0x7f6ef40039a0 2023-11-04T01:44:21.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f037fe640 1 -- 172.21.15.114:0/579423530 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef400bd30 con 0x7f6f0415d4e0 2023-11-04T01:44:21.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f09282640 1 --2- 172.21.15.114:0/579423530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef4004d00 0x7f6ef4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f03fff640 1 --2- 172.21.15.114:0/579423530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f0415d4e0 0x7f6ef40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f08a81640 1 --2- 172.21.15.114:0/579423530 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ef40039a0 0x7f6ef4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f09282640 1 -- 172.21.15.114:0/579423530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f0415d4e0 msgr2=0x7f6ef40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:21.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f09282640 1 --2- 172.21.15.114:0/579423530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f0415d4e0 0x7f6ef40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f09282640 1 -- 172.21.15.114:0/579423530 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ef40039a0 msgr2=0x7f6ef4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:21.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f09282640 1 --2- 172.21.15.114:0/579423530 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6ef40039a0 0x7f6ef4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f09282640 1 -- 172.21.15.114:0/579423530 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef4003520 con 0x7f6ef4004d00 2023-11-04T01:44:21.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.567+0000 7f6f03fff640 1 --2- 172.21.15.114:0/579423530 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f0415d4e0 0x7f6ef40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:21.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.568+0000 7f6f09282640 1 --2- 172.21.15.114:0/579423530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef4004d00 0x7f6ef4005180 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00a800 tx=0x7f6ef40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a945a2519039c42 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:21.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.568+0000 7f6f037fe640 1 -- 172.21.15.114:0/579423530 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc0072d0 con 0x7f6ef4004d00 2023-11-04T01:44:21.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.568+0000 7f6f037fe640 1 -- 172.21.15.114:0/579423530 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6efc02f070 con 0x7f6ef4004d00 2023-11-04T01:44:21.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.568+0000 7f6f037fe640 1 -- 172.21.15.114:0/579423530 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc0076b0 con 0x7f6ef4004d00 2023-11-04T01:44:21.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.569+0000 7f6f0ace5640 1 -- 172.21.15.114:0/579423530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef4004d00 msgr2=0x7f6ef4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.569+0000 7f6f0ace5640 1 --2- 172.21.15.114:0/579423530 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef4004d00 0x7f6ef4005180 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00a800 tx=0x7f6ef40057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.569+0000 7f6f09282640 1 -- 172.21.15.114:0/579423530 reap_dead start 2023-11-04T01:44:21.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.569+0000 7f6f0ace5640 1 -- 172.21.15.114:0/579423530 shutdown_connections 2023-11-04T01:44:21.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.569+0000 7f6f0ace5640 1 -- 172.21.15.114:0/579423530 >> 172.21.15.114:0/579423530 conn(0x7f6f040d2ef0 msgr2=0x7f6f040d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:21.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.569+0000 7f6f0ace5640 1 -- 172.21.15.114:0/579423530 shutdown_connections 2023-11-04T01:44:21.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.569+0000 7f6f0ace5640 1 -- 172.21.15.114:0/579423530 wait complete. 2023-11-04T01:44:21.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.570+0000 7f6f0ace5640 1 Processor -- start 2023-11-04T01:44:21.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.570+0000 7f6f0ace5640 1 -- start start 2023-11-04T01:44:21.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f0ace5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f041523f0 0x7f6f040ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f0ace5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f040caf10 0x7f6f040b7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f0ace5640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f040b84e0 0x7f6f041f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f0ace5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040b8960 con 0x7f6f041523f0 2023-11-04T01:44:21.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f0ace5640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040b6590 con 0x7f6f040b84e0 2023-11-04T01:44:21.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f0ace5640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040cb540 con 0x7f6f040caf10 2023-11-04T01:44:21.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f08a81640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f041523f0 0x7f6f040ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f08a81640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f041523f0 0x7f6f040ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55178/0 (socket says 172.21.15.114:55178) 2023-11-04T01:44:21.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f08a81640 1 -- 172.21.15.114:0/1062057354 learned_addr learned my addr 172.21.15.114:0/1062057354 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:21.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f09282640 1 --2- 172.21.15.114:0/1062057354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f040b84e0 0x7f6f041f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f03fff640 1 --2- 172.21.15.114:0/1062057354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f040caf10 0x7f6f040b7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f08a81640 1 -- 172.21.15.114:0/1062057354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f040caf10 msgr2=0x7f6f040b7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f08a81640 1 --2- 172.21.15.114:0/1062057354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f040caf10 0x7f6f040b7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f08a81640 1 -- 172.21.15.114:0/1062057354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f040b84e0 msgr2=0x7f6f041f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f08a81640 1 --2- 172.21.15.114:0/1062057354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f040b84e0 0x7f6f041f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f08a81640 1 -- 172.21.15.114:0/1062057354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f040cb820 con 0x7f6f041523f0 2023-11-04T01:44:21.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f03fff640 1 --2- 172.21.15.114:0/1062057354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f040caf10 0x7f6f040b7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:21.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f08a81640 1 --2- 172.21.15.114:0/1062057354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f041523f0 0x7f6f040ca9d0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800e4b0 tx=0x7f6ef800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:21.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f017fa640 1 -- 172.21.15.114:0/1062057354 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80052e0 con 0x7f6f041523f0 2023-11-04T01:44:21.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f017fa640 1 -- 172.21.15.114:0/1062057354 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef8005440 con 0x7f6f041523f0 2023-11-04T01:44:21.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f0ace5640 1 -- 172.21.15.114:0/1062057354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f040b5f40 con 0x7f6f041523f0 2023-11-04T01:44:21.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f017fa640 1 -- 172.21.15.114:0/1062057354 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8003860 con 0x7f6f041523f0 2023-11-04T01:44:21.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.571+0000 7f6f0ace5640 1 -- 172.21.15.114:0/1062057354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f040cce70 con 0x7f6f041523f0 2023-11-04T01:44:21.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.572+0000 7f6f0ace5640 1 -- 172.21.15.114:0/1062057354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f040cb2f0 con 0x7f6f041523f0 2023-11-04T01:44:21.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.573+0000 7f6f017fa640 1 -- 172.21.15.114:0/1062057354 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ef80039c0 con 0x7f6f041523f0 2023-11-04T01:44:21.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.573+0000 7f6f017fa640 1 --2- 172.21.15.114:0/1062057354 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ee806aea0 0x7f6ee806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.573+0000 7f6f017fa640 1 -- 172.21.15.114:0/1062057354 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f6ef8089d10 con 0x7f6f041523f0 2023-11-04T01:44:21.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.573+0000 7f6f03fff640 1 --2- 172.21.15.114:0/1062057354 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ee806aea0 0x7f6ee806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.574+0000 7f6f03fff640 1 --2- 172.21.15.114:0/1062057354 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ee806aea0 0x7f6ee806d360 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6f041f5c60 tx=0x7f6ef0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:21.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.577+0000 7f6f017fa640 1 -- 172.21.15.114:0/1062057354 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ef80544b0 con 0x7f6f041523f0 2023-11-04T01:44:21.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.744+0000 7f6f0ace5640 1 -- 172.21.15.114:0/1062057354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f6f040684b0 con 0x7f6f041523f0 2023-11-04T01:44:21.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.744+0000 7f6f017fa640 1 -- 172.21.15.114:0/1062057354 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v114) v1 ==== 107+0+11 (secure 0 0 0) 0x7f6ef8057ad0 con 0x7f6f041523f0 2023-11-04T01:44:21.746 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:44:21.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.746+0000 7f6f0ace5640 1 -- 172.21.15.114:0/1062057354 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ee806aea0 msgr2=0x7f6ee806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.746+0000 7f6f0ace5640 1 --2- 172.21.15.114:0/1062057354 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ee806aea0 0x7f6ee806d360 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6f041f5c60 tx=0x7f6ef0008040 comp rx=0 tx=0).stop 2023-11-04T01:44:21.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.746+0000 7f6f0ace5640 1 -- 172.21.15.114:0/1062057354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f041523f0 msgr2=0x7f6f040ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.746+0000 7f6f0ace5640 1 --2- 172.21.15.114:0/1062057354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f041523f0 0x7f6f040ca9d0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800e4b0 tx=0x7f6ef800e970 comp rx=0 tx=0).stop 2023-11-04T01:44:21.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.746+0000 7f6f0ace5640 1 -- 172.21.15.114:0/1062057354 shutdown_connections 2023-11-04T01:44:21.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.746+0000 7f6f0ace5640 1 --2- 172.21.15.114:0/1062057354 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f6ee806aea0 0x7f6ee806d360 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.746+0000 7f6f0ace5640 1 --2- 172.21.15.114:0/1062057354 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f6f040b84e0 0x7f6f041f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.746+0000 7f6f0ace5640 1 --2- 172.21.15.114:0/1062057354 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f6f040caf10 0x7f6f040b7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.746+0000 7f6f0ace5640 1 --2- 172.21.15.114:0/1062057354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f041523f0 0x7f6f040ca9d0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.746+0000 7f6f0ace5640 1 -- 172.21.15.114:0/1062057354 >> 172.21.15.114:0/1062057354 conn(0x7f6f040d2ef0 msgr2=0x7f6f040d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.746+0000 7f6f0ace5640 1 -- 172.21.15.114:0/1062057354 shutdown_connections 2023-11-04T01:44:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.746+0000 7f6f0ace5640 1 -- 172.21.15.114:0/1062057354 wait complete. 2023-11-04T01:44:21.758 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:44:21.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.859+0000 7f265e789640 1 Processor -- start 2023-11-04T01:44:21.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.859+0000 7f265e789640 1 -- start start 2023-11-04T01:44:21.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.860+0000 7f265e789640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f265815d4e0 0x7f26580d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.860+0000 7f265e789640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f26580d3b60 0x7f26580d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.860+0000 7f265e789640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26580b32b0 con 0x7f265815d100 2023-11-04T01:44:21.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.860+0000 7f265e789640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26580cec20 con 0x7f26580d3b60 2023-11-04T01:44:21.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.860+0000 7f265e789640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26580cee10 con 0x7f265815d4e0 2023-11-04T01:44:21.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.860+0000 7f265cd26640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f26580d3b60 0x7f26580d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.860+0000 7f265cd26640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f26580d3b60 0x7f26580d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55188/0 (socket says 172.21.15.114:55188) 2023-11-04T01:44:21.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.860+0000 7f265cd26640 1 -- 172.21.15.114:0/1100128350 learned_addr learned my addr 172.21.15.114:0/1100128350 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:21.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.860+0000 7f26577fe640 1 --2- 172.21.15.114:0/1100128350 >> v2:172.21.15.141:3300/0 conn(0x7f265815d4e0 0x7f26580d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.861+0000 7f265cd26640 1 -- 172.21.15.114:0/1100128350 >> v2:172.21.15.141:3300/0 conn(0x7f265815d4e0 msgr2=0x7f26580d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:21.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.861+0000 7f265cd26640 1 --2- 172.21.15.114:0/1100128350 >> v2:172.21.15.141:3300/0 conn(0x7f265815d4e0 0x7f26580d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.861+0000 7f265cd26640 1 -- 172.21.15.114:0/1100128350 >> v1:172.21.15.141:6789/0 conn(0x7f265815d100 legacy=0x7f26580ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.861+0000 7f265cd26640 1 -- 172.21.15.114:0/1100128350 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26580b4750 con 0x7f26580d3b60 2023-11-04T01:44:21.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.861+0000 7f265cd26640 1 --2- 172.21.15.114:0/1100128350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26580d3b60 0x7f26580d1a10 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f2658160da0 tx=0x7f265002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86c51951d12949d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:21.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.861+0000 7f2656ffd640 1 -- 172.21.15.114:0/1100128350 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265002cb20 con 0x7f26580d3b60 2023-11-04T01:44:21.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.861+0000 7f2656ffd640 1 -- 172.21.15.114:0/1100128350 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265002cc80 con 0x7f26580d3b60 2023-11-04T01:44:21.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.861+0000 7f2656ffd640 1 -- 172.21.15.114:0/1100128350 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26500343f0 con 0x7f26580d3b60 2023-11-04T01:44:21.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.862+0000 7f265e789640 1 -- 172.21.15.114:0/1100128350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26580d3b60 msgr2=0x7f26580d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.862+0000 7f265e789640 1 --2- 172.21.15.114:0/1100128350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26580d3b60 0x7f26580d1a10 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f2658160da0 tx=0x7f265002bf80 comp rx=0 tx=0).stop 2023-11-04T01:44:21.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.862+0000 7f265e789640 1 -- 172.21.15.114:0/1100128350 shutdown_connections 2023-11-04T01:44:21.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.862+0000 7f265e789640 1 --2- 172.21.15.114:0/1100128350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26580d3b60 0x7f26580d1a10 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.862+0000 7f265e789640 1 --2- 172.21.15.114:0/1100128350 >> v2:172.21.15.141:3300/0 conn(0x7f265815d4e0 0x7f26580d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.862+0000 7f265e789640 1 -- 172.21.15.114:0/1100128350 >> 172.21.15.114:0/1100128350 conn(0x7f26580d2ef0 msgr2=0x7f26580d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:21.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.862+0000 7f265e789640 1 -- 172.21.15.114:0/1100128350 shutdown_connections 2023-11-04T01:44:21.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.862+0000 7f265e789640 1 -- 172.21.15.114:0/1100128350 wait complete. 2023-11-04T01:44:21.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.863+0000 7f265e789640 1 Processor -- start 2023-11-04T01:44:21.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.863+0000 7f265e789640 1 -- start start 2023-11-04T01:44:21.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.864+0000 7f265e789640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26580d3b60 0x7f265814f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.864+0000 7f265e789640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265815d100 0x7f265814c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.864+0000 7f265e789640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f265815d4e0 0x7f265809e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.864+0000 7f265e789640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265814ff20 con 0x7f265815d100 2023-11-04T01:44:21.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.864+0000 7f265e789640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265814cc10 con 0x7f265815d4e0 2023-11-04T01:44:21.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.864+0000 7f265e789640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265814d0c0 con 0x7f26580d3b60 2023-11-04T01:44:21.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.864+0000 7f26577fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265815d100 0x7f265814c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.864+0000 7f26577fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265815d100 0x7f265814c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55196/0 (socket says 172.21.15.114:55196) 2023-11-04T01:44:21.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.864+0000 7f26577fe640 1 -- 172.21.15.114:0/3295895836 learned_addr learned my addr 172.21.15.114:0/3295895836 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:21.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.864+0000 7f265cd26640 1 --2- 172.21.15.114:0/3295895836 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f265815d4e0 0x7f265809e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.864+0000 7f2657fff640 1 --2- 172.21.15.114:0/3295895836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26580d3b60 0x7f265814f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.864+0000 7f26577fe640 1 -- 172.21.15.114:0/3295895836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26580d3b60 msgr2=0x7f265814f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.864+0000 7f26577fe640 1 --2- 172.21.15.114:0/3295895836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26580d3b60 0x7f265814f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.864+0000 7f26577fe640 1 -- 172.21.15.114:0/3295895836 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f265815d4e0 msgr2=0x7f265809e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.864+0000 7f26577fe640 1 --2- 172.21.15.114:0/3295895836 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f265815d4e0 0x7f265809e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.864+0000 7f26577fe640 1 -- 172.21.15.114:0/3295895836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2650009b30 con 0x7f265815d100 2023-11-04T01:44:21.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.865+0000 7f26577fe640 1 --2- 172.21.15.114:0/3295895836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265815d100 0x7f265814c6d0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f264c00e840 tx=0x7f264c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:21.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.865+0000 7f2654ff9640 1 -- 172.21.15.114:0/3295895836 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c0094f0 con 0x7f265815d100 2023-11-04T01:44:21.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.865+0000 7f2654ff9640 1 -- 172.21.15.114:0/3295895836 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c00c940 con 0x7f265815d100 2023-11-04T01:44:21.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.865+0000 7f265e789640 1 -- 172.21.15.114:0/3295895836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265814d3a0 con 0x7f265815d100 2023-11-04T01:44:21.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.865+0000 7f2654ff9640 1 -- 172.21.15.114:0/3295895836 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c00ccd0 con 0x7f265815d100 2023-11-04T01:44:21.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.865+0000 7f265e789640 1 -- 172.21.15.114:0/3295895836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265814d960 con 0x7f265815d100 2023-11-04T01:44:21.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.866+0000 7f265e789640 1 -- 172.21.15.114:0/3295895836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26580684b0 con 0x7f265815d100 2023-11-04T01:44:21.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.866+0000 7f2654ff9640 1 -- 172.21.15.114:0/3295895836 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f264c013470 con 0x7f265815d100 2023-11-04T01:44:21.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.866+0000 7f2654ff9640 1 --2- 172.21.15.114:0/3295895836 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f264406ae70 0x7f264406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.866+0000 7f2654ff9640 1 -- 172.21.15.114:0/3295895836 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f264c08a340 con 0x7f265815d100 2023-11-04T01:44:21.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.866+0000 7f2657fff640 1 --2- 172.21.15.114:0/3295895836 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f264406ae70 0x7f264406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.867+0000 7f2657fff640 1 --2- 172.21.15.114:0/3295895836 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f264406ae70 0x7f264406d330 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f26581f6260 tx=0x7f2648009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:21.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:21.871+0000 7f2654ff9640 1 -- 172.21.15.114:0/3295895836 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f264c054ae0 con 0x7f265815d100 2023-11-04T01:44:22.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.035+0000 7f265e789640 1 -- 172.21.15.114:0/3295895836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26580d11b0 con 0x7f265815d100 2023-11-04T01:44:22.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.036+0000 7f2654ff9640 1 -- 172.21.15.114:0/3295895836 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v114) v1 ==== 104+0+11 (secure 0 0 0) 0x7f264c017020 con 0x7f265815d100 2023-11-04T01:44:22.038 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:44:22.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.038+0000 7f265e789640 1 -- 172.21.15.114:0/3295895836 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f264406ae70 msgr2=0x7f264406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.038+0000 7f265e789640 1 --2- 172.21.15.114:0/3295895836 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f264406ae70 0x7f264406d330 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f26581f6260 tx=0x7f2648009040 comp rx=0 tx=0).stop 2023-11-04T01:44:22.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.038+0000 7f265e789640 1 -- 172.21.15.114:0/3295895836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265815d100 msgr2=0x7f265814c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.038+0000 7f265e789640 1 --2- 172.21.15.114:0/3295895836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265815d100 0x7f265814c6d0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f264c00e840 tx=0x7f264c00ed00 comp rx=0 tx=0).stop 2023-11-04T01:44:22.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.038+0000 7f265e789640 1 -- 172.21.15.114:0/3295895836 shutdown_connections 2023-11-04T01:44:22.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.038+0000 7f265e789640 1 --2- 172.21.15.114:0/3295895836 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f264406ae70 0x7f264406d330 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.038+0000 7f265e789640 1 --2- 172.21.15.114:0/3295895836 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f265815d4e0 0x7f265809e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.038+0000 7f265e789640 1 --2- 172.21.15.114:0/3295895836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265815d100 0x7f265814c6d0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.038+0000 7f265e789640 1 --2- 172.21.15.114:0/3295895836 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f26580d3b60 0x7f265814f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.038+0000 7f265e789640 1 -- 172.21.15.114:0/3295895836 >> 172.21.15.114:0/3295895836 conn(0x7f26580d2ef0 msgr2=0x7f26580cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:22.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.038+0000 7f265e789640 1 -- 172.21.15.114:0/3295895836 shutdown_connections 2023-11-04T01:44:22.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.038+0000 7f265e789640 1 -- 172.21.15.114:0/3295895836 wait complete. 2023-11-04T01:44:22.050 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:44:22.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.150+0000 7f03b4583640 1 Processor -- start 2023-11-04T01:44:22.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.150+0000 7f03b4583640 1 -- start start 2023-11-04T01:44:22.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.151+0000 7f03b4583640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f03ac0d1be0 0x7f03ac167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.151+0000 7f03b4583640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ac0b32b0 con 0x7f03ac15d100 2023-11-04T01:44:22.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.151+0000 7f03b4583640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ac0cee10 con 0x7f03ac15d4e0 2023-11-04T01:44:22.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.151+0000 7f03b4583640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ac0cec20 con 0x7f03ac0d1be0 2023-11-04T01:44:22.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.151+0000 7f03b231f640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f03ac15d100 0x7f03ac0ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34578/0 (socket says 172.21.15.114:34578) 2023-11-04T01:44:22.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.151+0000 7f03b231f640 1 -- 172.21.15.114:0/2073598592 learned_addr learned my addr 172.21.15.114:0/2073598592 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:22.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b131d640 1 -- 172.21.15.114:0/2073598592 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272668628 0 0) 0x7f03ac0b32b0 con 0x7f03ac15d100 2023-11-04T01:44:22.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b2b20640 1 --2- 172.21.15.114:0/2073598592 >> v2:172.21.15.141:3300/0 conn(0x7f03ac0d1be0 0x7f03ac167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b131d640 1 -- 172.21.15.114:0/2073598592 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0398003520 con 0x7f03ac15d100 2023-11-04T01:44:22.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b131d640 1 -- 172.21.15.114:0/2073598592 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2224536882 0 0) 0x7f0398003520 con 0x7f03ac15d100 2023-11-04T01:44:22.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b131d640 1 -- 172.21.15.114:0/2073598592 >> v2:172.21.15.141:3300/0 conn(0x7f03ac0d1be0 msgr2=0x7f03ac167e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:22.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b131d640 1 --2- 172.21.15.114:0/2073598592 >> v2:172.21.15.141:3300/0 conn(0x7f03ac0d1be0 0x7f03ac167e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b131d640 1 -- 172.21.15.114:0/2073598592 >> v1:172.21.15.141:6789/0 conn(0x7f03ac15d4e0 legacy=0x7f03ac0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b131d640 1 -- 172.21.15.114:0/2073598592 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac0b4750 con 0x7f03ac15d100 2023-11-04T01:44:22.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b131d640 1 -- 172.21.15.114:0/2073598592 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f03a8001b70 con 0x7f03ac15d100 2023-11-04T01:44:22.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b131d640 1 -- 172.21.15.114:0/2073598592 >> v1:172.21.15.114:6789/0 conn(0x7f03ac15d100 legacy=0x7f03ac0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b131d640 1 --2- 172.21.15.114:0/2073598592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0398003970 0x7f0398003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b131d640 1 --2- 172.21.15.114:0/2073598592 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03980047c0 0x7f0398004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b131d640 1 --2- 172.21.15.114:0/2073598592 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0398005180 0x7f039800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b131d640 1 -- 172.21.15.114:0/2073598592 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039800bff0 con 0x7f0398003970 2023-11-04T01:44:22.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b131d640 1 -- 172.21.15.114:0/2073598592 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039800c160 con 0x7f0398005180 2023-11-04T01:44:22.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b131d640 1 -- 172.21.15.114:0/2073598592 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039800c320 con 0x7f03980047c0 2023-11-04T01:44:22.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b231f640 1 --2- 172.21.15.114:0/2073598592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0398003970 0x7f0398003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b2b20640 1 --2- 172.21.15.114:0/2073598592 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0398005180 0x7f039800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b1b1e640 1 --2- 172.21.15.114:0/2073598592 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03980047c0 0x7f0398004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b231f640 1 -- 172.21.15.114:0/2073598592 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03980047c0 msgr2=0x7f0398004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:22.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b231f640 1 --2- 172.21.15.114:0/2073598592 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03980047c0 0x7f0398004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b231f640 1 -- 172.21.15.114:0/2073598592 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0398005180 msgr2=0x7f039800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:22.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b231f640 1 --2- 172.21.15.114:0/2073598592 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0398005180 0x7f039800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b231f640 1 -- 172.21.15.114:0/2073598592 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0398003520 con 0x7f0398003970 2023-11-04T01:44:22.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b2b20640 1 --2- 172.21.15.114:0/2073598592 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f0398005180 0x7f039800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:22.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.152+0000 7f03b2b20640 1 -- 172.21.15.114:0/2073598592 reap_dead start 2023-11-04T01:44:22.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.153+0000 7f03b231f640 1 --2- 172.21.15.114:0/2073598592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0398003970 0x7f0398003d90 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f03a800c4d0 tx=0x7f03980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6ec52de4ef5108 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.153+0000 7f03b131d640 1 -- 172.21.15.114:0/2073598592 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a802cdc0 con 0x7f0398003970 2023-11-04T01:44:22.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.153+0000 7f03b131d640 1 -- 172.21.15.114:0/2073598592 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a8005b20 con 0x7f0398003970 2023-11-04T01:44:22.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.153+0000 7f03b131d640 1 -- 172.21.15.114:0/2073598592 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8007070 con 0x7f0398003970 2023-11-04T01:44:22.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.154+0000 7f03b4583640 1 -- 172.21.15.114:0/2073598592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0398003970 msgr2=0x7f0398003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.154+0000 7f03b4583640 1 --2- 172.21.15.114:0/2073598592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0398003970 0x7f0398003d90 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f03a800c4d0 tx=0x7f03980057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.154+0000 7f03b4583640 1 -- 172.21.15.114:0/2073598592 shutdown_connections 2023-11-04T01:44:22.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.154+0000 7f03b4583640 1 --2- 172.21.15.114:0/2073598592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0398003970 0x7f0398003d90 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.154+0000 7f03b4583640 1 -- 172.21.15.114:0/2073598592 >> 172.21.15.114:0/2073598592 conn(0x7f03ac0d2ef0 msgr2=0x7f03ac0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:22.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.154+0000 7f03b4583640 1 -- 172.21.15.114:0/2073598592 shutdown_connections 2023-11-04T01:44:22.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.154+0000 7f03b4583640 1 -- 172.21.15.114:0/2073598592 wait complete. 2023-11-04T01:44:22.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.155+0000 7f03b4583640 1 Processor -- start 2023-11-04T01:44:22.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.155+0000 7f03b4583640 1 -- start start 2023-11-04T01:44:22.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b4583640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0398003970 0x7f03ac0b8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b4583640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03ac0cb910 0x7f03ac1f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b4583640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03ac1f6390 0x7f03ac1f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b4583640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac15e760 con 0x7f0398003970 2023-11-04T01:44:22.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b4583640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac15dae0 con 0x7f03ac1f6390 2023-11-04T01:44:22.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b4583640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac15ddc0 con 0x7f03ac0cb910 2023-11-04T01:44:22.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b231f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0398003970 0x7f03ac0b8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b231f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0398003970 0x7f03ac0b8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55218/0 (socket says 172.21.15.114:55218) 2023-11-04T01:44:22.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b231f640 1 -- 172.21.15.114:0/1407190272 learned_addr learned my addr 172.21.15.114:0/1407190272 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:22.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b2b20640 1 --2- 172.21.15.114:0/1407190272 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03ac1f6390 0x7f03ac1f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b1b1e640 1 --2- 172.21.15.114:0/1407190272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03ac0cb910 0x7f03ac1f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b231f640 1 -- 172.21.15.114:0/1407190272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03ac0cb910 msgr2=0x7f03ac1f5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b231f640 1 --2- 172.21.15.114:0/1407190272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03ac0cb910 0x7f03ac1f5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b231f640 1 -- 172.21.15.114:0/1407190272 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03ac1f6390 msgr2=0x7f03ac1f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b231f640 1 --2- 172.21.15.114:0/1407190272 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03ac1f6390 0x7f03ac1f6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b231f640 1 -- 172.21.15.114:0/1407190272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac15e0a0 con 0x7f0398003970 2023-11-04T01:44:22.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b2b20640 1 --2- 172.21.15.114:0/1407190272 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03ac1f6390 0x7f03ac1f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:22.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b231f640 1 --2- 172.21.15.114:0/1407190272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0398003970 0x7f03ac0b8480 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f03a802c760 tx=0x7f03ac0b48e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03a2ffd640 1 -- 172.21.15.114:0/1407190272 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a803c070 con 0x7f0398003970 2023-11-04T01:44:22.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03a2ffd640 1 -- 172.21.15.114:0/1407190272 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a8035680 con 0x7f0398003970 2023-11-04T01:44:22.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b4583640 1 -- 172.21.15.114:0/1407190272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ac15e380 con 0x7f0398003970 2023-11-04T01:44:22.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03a2ffd640 1 -- 172.21.15.114:0/1407190272 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a80359f0 con 0x7f0398003970 2023-11-04T01:44:22.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.156+0000 7f03b4583640 1 -- 172.21.15.114:0/1407190272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ac15f480 con 0x7f0398003970 2023-11-04T01:44:22.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.157+0000 7f03b4583640 1 -- 172.21.15.114:0/1407190272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ac0684b0 con 0x7f0398003970 2023-11-04T01:44:22.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.158+0000 7f03a2ffd640 1 -- 172.21.15.114:0/1407190272 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03a8032070 con 0x7f0398003970 2023-11-04T01:44:22.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.158+0000 7f03a2ffd640 1 --2- 172.21.15.114:0/1407190272 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f039006aea0 0x7f039006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.158+0000 7f03b1b1e640 1 --2- 172.21.15.114:0/1407190272 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f039006aea0 0x7f039006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.158+0000 7f03a2ffd640 1 -- 172.21.15.114:0/1407190272 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f03a80aaf30 con 0x7f0398003970 2023-11-04T01:44:22.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.159+0000 7f03b1b1e640 1 --2- 172.21.15.114:0/1407190272 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f039006aea0 0x7f039006d360 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f039c007fd0 tx=0x7f039c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.163+0000 7f03a2ffd640 1 -- 172.21.15.114:0/1407190272 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f03a80756d0 con 0x7f0398003970 2023-11-04T01:44:22.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.327+0000 7f03b4583640 1 -- 172.21.15.114:0/1407190272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03ac0d2cd0 con 0x7f0398003970 2023-11-04T01:44:22.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.328+0000 7f03a2ffd640 1 -- 172.21.15.114:0/1407190272 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v114) v1 ==== 100+0+11 (secure 0 0 0) 0x7f03a8078cf0 con 0x7f0398003970 2023-11-04T01:44:22.329 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:44:22.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.329+0000 7f03b4583640 1 -- 172.21.15.114:0/1407190272 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f039006aea0 msgr2=0x7f039006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.329+0000 7f03b4583640 1 --2- 172.21.15.114:0/1407190272 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f039006aea0 0x7f039006d360 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f039c007fd0 tx=0x7f039c009040 comp rx=0 tx=0).stop 2023-11-04T01:44:22.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.329+0000 7f03b4583640 1 -- 172.21.15.114:0/1407190272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0398003970 msgr2=0x7f03ac0b8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.329+0000 7f03b4583640 1 --2- 172.21.15.114:0/1407190272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0398003970 0x7f03ac0b8480 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f03a802c760 tx=0x7f03ac0b48e0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.330+0000 7f03b4583640 1 -- 172.21.15.114:0/1407190272 shutdown_connections 2023-11-04T01:44:22.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.330+0000 7f03b4583640 1 --2- 172.21.15.114:0/1407190272 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f039006aea0 0x7f039006d360 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.330+0000 7f03b4583640 1 --2- 172.21.15.114:0/1407190272 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f03ac1f6390 0x7f03ac1f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.330+0000 7f03b4583640 1 --2- 172.21.15.114:0/1407190272 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f03ac0cb910 0x7f03ac1f5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.330+0000 7f03b4583640 1 --2- 172.21.15.114:0/1407190272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0398003970 0x7f03ac0b8480 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.330+0000 7f03b4583640 1 -- 172.21.15.114:0/1407190272 >> 172.21.15.114:0/1407190272 conn(0x7f03ac0d2ef0 msgr2=0x7f03ac06c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:22.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.330+0000 7f03b4583640 1 -- 172.21.15.114:0/1407190272 shutdown_connections 2023-11-04T01:44:22.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.330+0000 7f03b4583640 1 -- 172.21.15.114:0/1407190272 wait complete. 2023-11-04T01:44:22.342 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:44:22.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.440+0000 7f7ccf290640 1 Processor -- start 2023-11-04T01:44:22.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.440+0000 7f7ccf290640 1 -- start start 2023-11-04T01:44:22.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.441+0000 7f7ccf290640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7cc815b330 0x7f7cc80cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.441+0000 7f7ccf290640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f7cc806ca60 0x7f7cc806ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.441+0000 7f7ccf290640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc806d3f0 con 0x7f7cc80b2160 2023-11-04T01:44:22.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.441+0000 7f7ccf290640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc80cb5d0 con 0x7f7cc815b330 2023-11-04T01:44:22.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.441+0000 7f7ccf290640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc806f3f0 con 0x7f7cc806ca60 2023-11-04T01:44:22.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.441+0000 7f7ccd02c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7cc815b330 0x7f7cc80cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.441+0000 7f7ccc82b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7cc80b2160 0x7f7cc806ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34594/0 (socket says 172.21.15.114:34594) 2023-11-04T01:44:22.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.441+0000 7f7ccc82b640 1 -- 172.21.15.114:0/1253687787 learned_addr learned my addr 172.21.15.114:0/1253687787 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:22.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.441+0000 7f7ccd82d640 1 --2- 172.21.15.114:0/1253687787 >> v2:172.21.15.141:3300/0 conn(0x7f7cc806ca60 0x7f7cc806ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.442+0000 7f7ccd02c640 1 -- 172.21.15.114:0/1253687787 >> v2:172.21.15.141:3300/0 conn(0x7f7cc806ca60 msgr2=0x7f7cc806ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:22.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.442+0000 7f7ccd02c640 1 --2- 172.21.15.114:0/1253687787 >> v2:172.21.15.141:3300/0 conn(0x7f7cc806ca60 0x7f7cc806ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.442+0000 7f7ccd02c640 1 -- 172.21.15.114:0/1253687787 >> v1:172.21.15.114:6789/0 conn(0x7f7cc80b2160 legacy=0x7f7cc806ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.442+0000 7f7ccd02c640 1 -- 172.21.15.114:0/1253687787 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc80c3490 con 0x7f7cc815b330 2023-11-04T01:44:22.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.442+0000 7f7ccd82d640 1 --2- 172.21.15.114:0/1253687787 >> v2:172.21.15.141:3300/0 conn(0x7f7cc806ca60 0x7f7cc806ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:22.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.442+0000 7f7ccd02c640 1 --2- 172.21.15.114:0/1253687787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc815b330 0x7f7cc80cba60 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80704e0 tx=0x7f7cc402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9376da99f23a6152 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.442+0000 7f7cbffff640 1 -- 172.21.15.114:0/1253687787 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc402cc70 con 0x7f7cc815b330 2023-11-04T01:44:22.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.442+0000 7f7cbffff640 1 -- 172.21.15.114:0/1253687787 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc402cdd0 con 0x7f7cc815b330 2023-11-04T01:44:22.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.442+0000 7f7cbffff640 1 -- 172.21.15.114:0/1253687787 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4034660 con 0x7f7cc815b330 2023-11-04T01:44:22.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.443+0000 7f7ccf290640 1 -- 172.21.15.114:0/1253687787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc815b330 msgr2=0x7f7cc80cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.443+0000 7f7ccf290640 1 --2- 172.21.15.114:0/1253687787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc815b330 0x7f7cc80cba60 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80704e0 tx=0x7f7cc402bec0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.443+0000 7f7ccf290640 1 -- 172.21.15.114:0/1253687787 shutdown_connections 2023-11-04T01:44:22.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.443+0000 7f7ccf290640 1 --2- 172.21.15.114:0/1253687787 >> v2:172.21.15.141:3300/0 conn(0x7f7cc806ca60 0x7f7cc806ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.443+0000 7f7ccf290640 1 --2- 172.21.15.114:0/1253687787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc815b330 0x7f7cc80cba60 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.443+0000 7f7ccf290640 1 -- 172.21.15.114:0/1253687787 >> 172.21.15.114:0/1253687787 conn(0x7f7cc80b1640 msgr2=0x7f7cc80b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:22.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.443+0000 7f7ccf290640 1 -- 172.21.15.114:0/1253687787 shutdown_connections 2023-11-04T01:44:22.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.443+0000 7f7ccf290640 1 -- 172.21.15.114:0/1253687787 wait complete. 2023-11-04T01:44:22.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.444+0000 7f7ccf290640 1 Processor -- start 2023-11-04T01:44:22.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.444+0000 7f7ccf290640 1 -- start start 2023-11-04T01:44:22.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.445+0000 7f7ccf290640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7cc806ca60 0x7f7cc8155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.445+0000 7f7ccf290640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7cc80b2160 0x7f7cc80b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.445+0000 7f7ccf290640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc815b330 0x7f7cc80b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.445+0000 7f7ccf290640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc81f70c0 con 0x7f7cc815b330 2023-11-04T01:44:22.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.445+0000 7f7ccf290640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc81559a0 con 0x7f7cc80b2160 2023-11-04T01:44:22.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.445+0000 7f7ccf290640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc81f6de0 con 0x7f7cc806ca60 2023-11-04T01:44:22.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.445+0000 7f7ccd82d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc815b330 0x7f7cc80b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.445+0000 7f7ccd82d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc815b330 0x7f7cc80b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55248/0 (socket says 172.21.15.114:55248) 2023-11-04T01:44:22.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.445+0000 7f7ccd82d640 1 -- 172.21.15.114:0/3542572097 learned_addr learned my addr 172.21.15.114:0/3542572097 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:22.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.445+0000 7f7ccc82b640 1 --2- 172.21.15.114:0/3542572097 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7cc80b2160 0x7f7cc80b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.445+0000 7f7ccd82d640 1 -- 172.21.15.114:0/3542572097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7cc806ca60 msgr2=0x7f7cc8155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.445+0000 7f7ccd82d640 1 --2- 172.21.15.114:0/3542572097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7cc806ca60 0x7f7cc8155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.445+0000 7f7ccd82d640 1 -- 172.21.15.114:0/3542572097 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7cc80b2160 msgr2=0x7f7cc80b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.445+0000 7f7ccd82d640 1 --2- 172.21.15.114:0/3542572097 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7cc80b2160 0x7f7cc80b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.445+0000 7f7ccd82d640 1 -- 172.21.15.114:0/3542572097 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc4009a70 con 0x7f7cc815b330 2023-11-04T01:44:22.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.446+0000 7f7ccd82d640 1 --2- 172.21.15.114:0/3542572097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc815b330 0x7f7cc80b3bf0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000c7c0 tx=0x7f7cc000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.446+0000 7f7cbdffb640 1 -- 172.21.15.114:0/3542572097 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0004230 con 0x7f7cc815b330 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.446+0000 7f7cbdffb640 1 -- 172.21.15.114:0/3542572097 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc0004390 con 0x7f7cc815b330 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.446+0000 7f7ccf290640 1 -- 172.21.15.114:0/3542572097 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc80c6d50 con 0x7f7cc815b330 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.446+0000 7f7cbdffb640 1 -- 172.21.15.114:0/3542572097 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0007860 con 0x7f7cc815b330 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.446+0000 7f7ccf290640 1 -- 172.21.15.114:0/3542572097 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc80c7310 con 0x7f7cc815b330 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.447+0000 7f7ccf290640 1 -- 172.21.15.114:0/3542572097 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc806da20 con 0x7f7cc815b330 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.447+0000 7f7cbdffb640 1 -- 172.21.15.114:0/3542572097 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7cc00079c0 con 0x7f7cc815b330 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.448+0000 7f7cbdffb640 1 --2- 172.21.15.114:0/3542572097 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7cac06ae70 0x7f7cac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.448+0000 7f7ccd02c640 1 --2- 172.21.15.114:0/3542572097 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7cac06ae70 0x7f7cac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.448+0000 7f7cbdffb640 1 -- 172.21.15.114:0/3542572097 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f7cc008a1c0 con 0x7f7cc815b330 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.448+0000 7f7ccd02c640 1 --2- 172.21.15.114:0/3542572097 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7cac06ae70 0x7f7cac06d330 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4036000 tx=0x7f7cc402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.452+0000 7f7cbdffb640 1 -- 172.21.15.114:0/3542572097 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7cc0054ad0 con 0x7f7cc815b330 2023-11-04T01:44:22.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.629+0000 7f7ccf290640 1 -- 172.21.15.114:0/3542572097 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7cc80c7530 con 0x7f7cc815b330 2023-11-04T01:44:22.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.629+0000 7f7cbdffb640 1 -- 172.21.15.114:0/3542572097 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v114) v1 ==== 81+0+1404 (secure 0 0 0) 0x7f7cc0015590 con 0x7f7cc815b330 2023-11-04T01:44:22.631 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/979876939 2023-11-05T01:44:08.794891+0000 2023-11-04T01:44:22.631 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/979876939 2023-11-05T01:44:08.794891+0000 2023-11-04T01:44:22.631 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.1:0/3180677097 2023-11-04T02:43:26.710151+0000 2023-11-04T01:44:22.631 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/3145796350 2023-11-05T01:43:18.419560+0000 2023-11-04T01:44:22.632 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/3825479201 2023-11-05T01:43:11.612005+0000 2023-11-04T01:44:22.632 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/3825479201 2023-11-05T01:43:11.612005+0000 2023-11-04T01:44:22.632 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/3145796350 2023-11-05T01:43:18.419560+0000 2023-11-04T01:44:22.632 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/3780323525 2023-11-05T01:40:32.050690+0000 2023-11-04T01:44:22.632 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.1:0/76750670 2023-11-04T02:44:16.664609+0000 2023-11-04T01:44:22.632 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/3780323525 2023-11-05T01:40:32.050690+0000 2023-11-04T01:44:22.632 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.141:6834/1296600989 2023-11-05T01:42:28.568489+0000 2023-11-04T01:44:22.632 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/1768068040 2023-11-05T01:40:57.284155+0000 2023-11-04T01:44:22.632 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.141:6834/224279622 2023-11-05T01:44:01.557691+0000 2023-11-04T01:44:22.632 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/1768068040 2023-11-05T01:40:57.284155+0000 2023-11-04T01:44:22.632 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.141:6832/1296600989 2023-11-05T01:42:28.568489+0000 2023-11-04T01:44:22.632 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/2722332212 2023-11-05T01:41:22.824334+0000 2023-11-04T01:44:22.632 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/1052115332 2023-11-05T01:41:48.753700+0000 2023-11-04T01:44:22.633 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.1:0/958873281 2023-11-04T02:42:36.859026+0000 2023-11-04T01:44:22.633 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/1052115332 2023-11-05T01:41:48.753700+0000 2023-11-04T01:44:22.633 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.141:6832/224279622 2023-11-05T01:44:01.557691+0000 2023-11-04T01:44:22.633 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/1629274449 2023-11-05T01:42:21.762099+0000 2023-11-04T01:44:22.633 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/2722332212 2023-11-05T01:41:22.824334+0000 2023-11-04T01:44:22.633 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/1629274449 2023-11-05T01:42:21.762099+0000 2023-11-04T01:44:22.634 INFO:teuthology.orchestra.run.smithi114.stderr:listed 23 entries 2023-11-04T01:44:22.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.631+0000 7f7ccf290640 1 -- 172.21.15.114:0/3542572097 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7cac06ae70 msgr2=0x7f7cac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.631+0000 7f7ccf290640 1 --2- 172.21.15.114:0/3542572097 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7cac06ae70 0x7f7cac06d330 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4036000 tx=0x7f7cc402e000 comp rx=0 tx=0).stop 2023-11-04T01:44:22.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.631+0000 7f7ccf290640 1 -- 172.21.15.114:0/3542572097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc815b330 msgr2=0x7f7cc80b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.631+0000 7f7ccf290640 1 --2- 172.21.15.114:0/3542572097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc815b330 0x7f7cc80b3bf0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000c7c0 tx=0x7f7cc000cc80 comp rx=0 tx=0).stop 2023-11-04T01:44:22.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.631+0000 7f7ccf290640 1 -- 172.21.15.114:0/3542572097 shutdown_connections 2023-11-04T01:44:22.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.631+0000 7f7ccf290640 1 --2- 172.21.15.114:0/3542572097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cc815b330 0x7f7cc80b3bf0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.631+0000 7f7ccf290640 1 --2- 172.21.15.114:0/3542572097 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7cac06ae70 0x7f7cac06d330 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.631+0000 7f7ccf290640 1 --2- 172.21.15.114:0/3542572097 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7cc80b2160 0x7f7cc80b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.631+0000 7f7ccf290640 1 --2- 172.21.15.114:0/3542572097 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7cc806ca60 0x7f7cc8155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.631+0000 7f7ccf290640 1 -- 172.21.15.114:0/3542572097 >> 172.21.15.114:0/3542572097 conn(0x7f7cc80b1640 msgr2=0x7f7cc80b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:22.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.631+0000 7f7ccf290640 1 -- 172.21.15.114:0/3542572097 shutdown_connections 2023-11-04T01:44:22.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.631+0000 7f7ccf290640 1 -- 172.21.15.114:0/3542572097 wait complete. 2023-11-04T01:44:22.643 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:44:22.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:22.643 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:22.669 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[126262]: fuse finished with error 0 and tester_r 0 2023-11-04T01:44:22.670 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:44:22.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:22.670 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:44:22.725 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:44:22.725 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:22.781 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:44:22.781 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:44:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.921+0000 7fecd1044640 1 Processor -- start 2023-11-04T01:44:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.921+0000 7fecd1044640 1 -- start start 2023-11-04T01:44:22.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.922+0000 7fecd1044640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7feccc15b330 0x7feccc0cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.922+0000 7fecd1044640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feccc06ca60 0x7feccc06ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.922+0000 7fecd1044640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feccc06d3f0 con 0x7feccc0b2160 2023-11-04T01:44:22.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.922+0000 7fecd1044640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feccc0cb5d0 con 0x7feccc06ca60 2023-11-04T01:44:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.922+0000 7fecd1044640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feccc06f3f0 con 0x7feccc15b330 2023-11-04T01:44:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.922+0000 7feccb59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feccc06ca60 0x7feccc06ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.922+0000 7fecca59c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7feccc0b2160 0x7feccc06ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34596/0 (socket says 172.21.15.114:34596) 2023-11-04T01:44:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.922+0000 7fecca59c640 1 -- 172.21.15.114:0/1427650940 learned_addr learned my addr 172.21.15.114:0/1427650940 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.923+0000 7feccb59e640 1 -- 172.21.15.114:0/1427650940 >> v2:172.21.15.141:3300/0 conn(0x7feccc15b330 msgr2=0x7feccc0cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.923+0000 7feccad9d640 1 --2- 172.21.15.114:0/1427650940 >> v2:172.21.15.141:3300/0 conn(0x7feccc15b330 0x7feccc0cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.923+0000 7feccb59e640 1 --2- 172.21.15.114:0/1427650940 >> v2:172.21.15.141:3300/0 conn(0x7feccc15b330 0x7feccc0cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.923+0000 7feccb59e640 1 -- 172.21.15.114:0/1427650940 >> v1:172.21.15.114:6789/0 conn(0x7feccc0b2160 legacy=0x7feccc06ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.923+0000 7fecc9d9b640 1 -- 172.21.15.114:0/1427650940 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644022614 0 0) 0x7fecc0001110 con 0x7feccc0b2160 2023-11-04T01:44:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.923+0000 7feccb59e640 1 -- 172.21.15.114:0/1427650940 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc0c3490 con 0x7feccc06ca60 2023-11-04T01:44:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.923+0000 7feccb59e640 1 --2- 172.21.15.114:0/1427650940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc06ca60 0x7feccc06ceb0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7feccc0682b0 tx=0x7fecc402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce04e92010eced8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.923+0000 7fecc9d9b640 1 -- 172.21.15.114:0/1427650940 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4031830 con 0x7feccc06ca60 2023-11-04T01:44:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.923+0000 7fecc9d9b640 1 -- 172.21.15.114:0/1427650940 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc4031990 con 0x7feccc06ca60 2023-11-04T01:44:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.924+0000 7fecc9d9b640 1 -- 172.21.15.114:0/1427650940 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4031d20 con 0x7feccc06ca60 2023-11-04T01:44:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.924+0000 7fecd1044640 1 -- 172.21.15.114:0/1427650940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc06ca60 msgr2=0x7feccc06ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.924+0000 7fecd1044640 1 --2- 172.21.15.114:0/1427650940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc06ca60 0x7feccc06ceb0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7feccc0682b0 tx=0x7fecc402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.924+0000 7fecd1044640 1 -- 172.21.15.114:0/1427650940 shutdown_connections 2023-11-04T01:44:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.924+0000 7fecd1044640 1 --2- 172.21.15.114:0/1427650940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc06ca60 0x7feccc06ceb0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.924+0000 7fecd1044640 1 --2- 172.21.15.114:0/1427650940 >> v2:172.21.15.141:3300/0 conn(0x7feccc15b330 0x7feccc0cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.924+0000 7fecd1044640 1 -- 172.21.15.114:0/1427650940 >> 172.21.15.114:0/1427650940 conn(0x7feccc0b1640 msgr2=0x7feccc0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.924+0000 7fecd1044640 1 -- 172.21.15.114:0/1427650940 shutdown_connections 2023-11-04T01:44:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.924+0000 7fecd1044640 1 -- 172.21.15.114:0/1427650940 wait complete. 2023-11-04T01:44:22.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.926+0000 7fecd1044640 1 Processor -- start 2023-11-04T01:44:22.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.926+0000 7fecd1044640 1 -- start start 2023-11-04T01:44:22.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.926+0000 7fecd1044640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feccc06ca60 0x7feccc0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.926+0000 7fecd1044640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc0b2160 0x7feccc149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.926+0000 7fecd1044640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feccc15b330 0x7feccc1553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.926+0000 7fecd1044640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc0c8700 con 0x7feccc0b2160 2023-11-04T01:44:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.926+0000 7fecd1044640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc0c89e0 con 0x7feccc15b330 2023-11-04T01:44:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.926+0000 7fecd1044640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feccc0c8cc0 con 0x7feccc06ca60 2023-11-04T01:44:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.926+0000 7fecca59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc0b2160 0x7feccc149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.927+0000 7fecca59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc0b2160 0x7feccc149110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55254/0 (socket says 172.21.15.114:55254) 2023-11-04T01:44:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.927+0000 7fecca59c640 1 -- 172.21.15.114:0/4128038109 learned_addr learned my addr 172.21.15.114:0/4128038109 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.927+0000 7feccb59e640 1 --2- 172.21.15.114:0/4128038109 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feccc15b330 0x7feccc1553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.927+0000 7feccad9d640 1 --2- 172.21.15.114:0/4128038109 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feccc06ca60 0x7feccc0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.927+0000 7fecca59c640 1 -- 172.21.15.114:0/4128038109 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feccc06ca60 msgr2=0x7feccc0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.927+0000 7fecca59c640 1 --2- 172.21.15.114:0/4128038109 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feccc06ca60 0x7feccc0c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.927+0000 7fecca59c640 1 -- 172.21.15.114:0/4128038109 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feccc15b330 msgr2=0x7feccc1553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.927+0000 7fecca59c640 1 --2- 172.21.15.114:0/4128038109 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feccc15b330 0x7feccc1553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.927+0000 7fecca59c640 1 -- 172.21.15.114:0/4128038109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc4009400 con 0x7feccc0b2160 2023-11-04T01:44:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.927+0000 7feccb59e640 1 --2- 172.21.15.114:0/4128038109 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feccc15b330 0x7feccc1553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:22.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.927+0000 7fecca59c640 1 --2- 172.21.15.114:0/4128038109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc0b2160 0x7feccc149110 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fecc000c430 tx=0x7fecc000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.927+0000 7fecb37fe640 1 -- 172.21.15.114:0/4128038109 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc00074e0 con 0x7feccc0b2160 2023-11-04T01:44:22.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.927+0000 7fecb37fe640 1 -- 172.21.15.114:0/4128038109 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc0007660 con 0x7feccc0b2160 2023-11-04T01:44:22.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.927+0000 7fecb37fe640 1 -- 172.21.15.114:0/4128038109 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc0004a20 con 0x7feccc0b2160 2023-11-04T01:44:22.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.927+0000 7fecd1044640 1 -- 172.21.15.114:0/4128038109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feccc0c8fa0 con 0x7feccc0b2160 2023-11-04T01:44:22.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.927+0000 7fecd1044640 1 -- 172.21.15.114:0/4128038109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feccc158ee0 con 0x7feccc0b2160 2023-11-04T01:44:22.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.928+0000 7fecd1044640 1 -- 172.21.15.114:0/4128038109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feccc06da20 con 0x7feccc0b2160 2023-11-04T01:44:22.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.929+0000 7fecb37fe640 1 -- 172.21.15.114:0/4128038109 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fecc0004b80 con 0x7feccc0b2160 2023-11-04T01:44:22.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.929+0000 7fecb37fe640 1 --2- 172.21.15.114:0/4128038109 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fecb806ae70 0x7fecb806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.929+0000 7fecb37fe640 1 -- 172.21.15.114:0/4128038109 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fecc0089d10 con 0x7feccc0b2160 2023-11-04T01:44:22.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.929+0000 7feccad9d640 1 --2- 172.21.15.114:0/4128038109 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fecb806ae70 0x7fecb806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.929+0000 7feccad9d640 1 --2- 172.21.15.114:0/4128038109 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fecb806ae70 0x7fecb806d330 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0070b0 tx=0x7fecbc007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:22.933+0000 7fecb37fe640 1 -- 172.21.15.114:0/4128038109 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fecc0054390 con 0x7feccc0b2160 2023-11-04T01:44:23.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:23.136+0000 7fecd1044640 1 -- 172.21.15.114:0/4128038109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feccc06d3f0 con 0x7feccc0b2160 2023-11-04T01:44:23.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:23.137+0000 7fecb37fe640 1 -- 172.21.15.114:0/4128038109 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v115) v1 ==== 53+0+73 (secure 0 0 0) 0x7feccc06d3f0 con 0x7feccc0b2160 2023-11-04T01:44:23.138 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:44:23.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:23.138+0000 7fecd1044640 1 -- 172.21.15.114:0/4128038109 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fecb806ae70 msgr2=0x7fecb806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:23.138+0000 7fecd1044640 1 --2- 172.21.15.114:0/4128038109 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fecb806ae70 0x7fecb806d330 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0070b0 tx=0x7fecbc007040 comp rx=0 tx=0).stop 2023-11-04T01:44:23.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:23.138+0000 7fecd1044640 1 -- 172.21.15.114:0/4128038109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc0b2160 msgr2=0x7feccc149110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:23.138+0000 7fecd1044640 1 --2- 172.21.15.114:0/4128038109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc0b2160 0x7feccc149110 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fecc000c430 tx=0x7fecc000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:23.138+0000 7fecd1044640 1 -- 172.21.15.114:0/4128038109 shutdown_connections 2023-11-04T01:44:23.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:23.138+0000 7fecd1044640 1 --2- 172.21.15.114:0/4128038109 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fecb806ae70 0x7fecb806d330 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:23.138+0000 7fecd1044640 1 --2- 172.21.15.114:0/4128038109 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7feccc15b330 0x7feccc1553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:23.138+0000 7fecd1044640 1 --2- 172.21.15.114:0/4128038109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc0b2160 0x7feccc149110 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:23.138+0000 7fecd1044640 1 --2- 172.21.15.114:0/4128038109 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7feccc06ca60 0x7feccc0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:23.139+0000 7fecd1044640 1 -- 172.21.15.114:0/4128038109 >> 172.21.15.114:0/4128038109 conn(0x7feccc0b1640 msgr2=0x7feccc0b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:23.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:23.139+0000 7fecd1044640 1 -- 172.21.15.114:0/4128038109 shutdown_connections 2023-11-04T01:44:23.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:23.139+0000 7fecd1044640 1 -- 172.21.15.114:0/4128038109 wait complete. 2023-11-04T01:44:23.151 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:44:23.151 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:44:23.151 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-11-04T01:44:23.151 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:44:23.151 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:23.151 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:44:23.151 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:44:23.151 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:44:23.151 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:44:23.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:23.152 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-11-04T01:44:23.166 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:44:23.166 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:44:23.167 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:44:23.167 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:23.167 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-11-04T01:44:23.167 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:23.167 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:44:23.167 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:23.167 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-11-04T01:44:23.167 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:44:23.167 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:23.167 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-11-04T01:44:23.167 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:44:23.167 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:23.168 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:44:23.168 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:23.168 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:44:23.168 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42012sec preferred_lft 42012sec 2023-11-04T01:44:23.168 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-11-04T01:44:23.168 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:23.168 INFO:teuthology.orchestra.run.smithi114.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:44:23.168 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 7e:72:41:ca:70:95 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:23.168 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:44:23.168 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:23.168 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9c8d:d6ff:fe6f:d555/64 scope link 2023-11-04T01:44:23.168 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:23.169 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:44:23.169 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether f6:4c:1e:67:08:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:23.169 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::f44c:1eff:fe67:85a/64 scope link 2023-11-04T01:44:23.169 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:23.169 INFO:teuthology.orchestra.run.smithi114.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:44:23.169 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 7e:72:41:ca:70:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:23.169 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::7c72:41ff:feca:7095/64 scope link 2023-11-04T01:44:23.169 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:23.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:23.169 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:44:23.232 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-11-04T01:44:23.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:23.234 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-11-04T01:44:23.288 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-11-04T01:44:23.288 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:44:23.288 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:44:23.288 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:44:23.288 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:44:23.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:23.289 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-11-04T01:44:23.289 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-11-04T01:44:23.289 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:44:23.289 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:44:23.289 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:44:23.289 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-11-04T01:44:23.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:23.383 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-04T01:44:23.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:44:23.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:44:23.398 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:44:23.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:23.398 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-11-04T01:44:23.465 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:44:23.465 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:44:23.466 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:23.520 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:44:23.520 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:44:23.520 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:23.575 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:44:23.631 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:44:23.631 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:44:23.631 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:44:23.631 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:44:23.631 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:44:23.631 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:44:23.631 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:44:23.632 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:44:23.632 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:44:23.632 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:44:23.632 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:44:23.632 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:44:23.632 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:44:23.632 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:44:23.632 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:44:23.632 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:44:23.632 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:44:23.632 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:44:23.632 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:44:23.632 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:44:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:44:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:44:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:44:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:44:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:44:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:44:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:44:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:44:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:44:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:44:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:23.633 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:23.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:23.634 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:44:23.686 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:44:23.686 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:44:23.729 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:44:23.729 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:44:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:44:23.744 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:44:23.744 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:44:23.744 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:44:23.744 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:44:23.744 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:44:23.744 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:44:23.744 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:44:23.745 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:44:23.745 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:44:23.745 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:44:23.745 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:44:23.745 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:44:23.745 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:44:23.745 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:44:23.745 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:44:23.745 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:44:23.745 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:44:23.745 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:44:23.745 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:44:23.746 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:44:23.746 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:44:23.746 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:44:23.746 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:44:23.746 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:44:23.746 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:44:23.746 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:44:23.746 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:44:23.746 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:44:23.746 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:44:23.746 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:44:23.746 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:23.747 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:23.747 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:23.747 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:23.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:23.747 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:44:23.818 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:44:23.817+0000 7fcb5c580480 -1 init, newargv = 0x55ff96fae2c0 newargc=15 2023-11-04T01:44:23.819 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[128319]: starting ceph client 2023-11-04T01:44:23.825 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[128319]: starting fuse 2023-11-04T01:44:24.900 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:44:24.917 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2023-11-04T01:44:24.917 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2023-11-04T01:44:24.917 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2023-11-04T01:44:24.917 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2023-11-04T01:44:24.918 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2023-11-04T01:44:24.918 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2023-11-04T01:44:24.918 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2023-11-04T01:44:24.918 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2023-11-04T01:44:24.918 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2023-11-04T01:44:24.918 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2023-11-04T01:44:24.918 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2023-11-04T01:44:24.918 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2023-11-04T01:44:24.918 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:44:24.918 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2023-11-04T01:44:24.918 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2023-11-04T01:44:24.919 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2023-11-04T01:44:24.919 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2023-11-04T01:44:24.919 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:44:24.919 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2023-11-04T01:44:24.919 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2023-11-04T01:44:24.919 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:44:24.919 INFO:teuthology.orchestra.run.smithi114.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:44:24.919 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:44:24.919 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2023-11-04T01:44:24.919 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2023-11-04T01:44:24.919 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:44:24.919 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:44:24.919 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:44:24.920 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:44:24.920 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2023-11-04T01:44:24.920 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:24.920 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:24.920 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:24.920 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:24.920 INFO:teuthology.orchestra.run.smithi114.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:24.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:24.921 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-11-04T01:44:24.977 INFO:teuthology.orchestra.run.smithi114.stdout:41 2023-11-04T01:44:24.978 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:44:24.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:44:24.978 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2023-11-04T01:44:24.978 DEBUG:teuthology.orchestra.run.smithi114:> import re 2023-11-04T01:44:24.978 DEBUG:teuthology.orchestra.run.smithi114:> import os 2023-11-04T01:44:24.978 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2023-11-04T01:44:24.978 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:44:24.978 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2023-11-04T01:44:24.978 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:44:24.978 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2023-11-04T01:44:24.978 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:44:24.979 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:44:24.979 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2023-11-04T01:44:24.979 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2023-11-04T01:44:24.979 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2023-11-04T01:44:24.979 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2023-11-04T01:44:24.979 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:44:24.979 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2023-11-04T01:44:24.979 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:44:24.979 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:44:24.979 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:44:24.979 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2023-11-04T01:44:24.979 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2023-11-04T01:44:24.979 DEBUG:teuthology.orchestra.run.smithi114:> return f 2023-11-04T01:44:24.979 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:44:24.980 DEBUG:teuthology.orchestra.run.smithi114:> 2023-11-04T01:44:24.980 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.0")) 2023-11-04T01:44:24.980 DEBUG:teuthology.orchestra.run.smithi114:> ' 2023-11-04T01:44:25.101 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.0.128319.asok 2023-11-04T01:44:25.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:25.112 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.128319.asok 2023-11-04T01:44:25.112 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:44:25.112 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.128319.asok status 2023-11-04T01:44:25.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:44:25.281 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:44:25.281 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2023-11-04T01:44:25.281 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:44:25.281 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:44:25.282 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "0", 2023-11-04T01:44:25.282 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2023-11-04T01:44:25.282 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:44:25.282 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "128319", 2023-11-04T01:44:25.282 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2023-11-04T01:44:25.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:44:25.282 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2023-11-04T01:44:25.282 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2023-11-04T01:44:25.282 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 8919, 2023-11-04T01:44:25.282 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2023-11-04T01:44:25.282 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2023-11-04T01:44:25.282 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2023-11-04T01:44:25.282 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 8919 2023-11-04T01:44:25.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:44:25.283 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:44:25.283 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:44:25.283 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:44:25.283 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 473813248 2023-11-04T01:44:25.283 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-11-04T01:44:25.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:44:25.283 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-11-04T01:44:25.283 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-11-04T01:44:25.283 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:44:25.283 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 473813248 2023-11-04T01:44:25.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-11-04T01:44:25.283 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.8919 192.168.0.1:0/473813248", 2023-11-04T01:44:25.284 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "192.168.0.1:0/473813248", 2023-11-04T01:44:25.284 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2023-11-04T01:44:25.284 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 115, 2023-11-04T01:44:25.284 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 114, 2023-11-04T01:44:25.284 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:44:25.284 INFO:teuthology.orchestra.run.smithi114.stdout: "blocklisted": false, 2023-11-04T01:44:25.284 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2023-11-04T01:44:25.284 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:44:25.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:25.296 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:44:25.296 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:44:25.296 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:25.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:44:25.355 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2023-11-04T01:44:25.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:25.361 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:25.361 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:44:25.361 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:44:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:25.425 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:44:25.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.523+0000 7fdba7426640 1 Processor -- start 2023-11-04T01:44:25.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.523+0000 7fdba7426640 1 -- start start 2023-11-04T01:44:25.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.524+0000 7fdba7426640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdba00b0c40 0x7fdba006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.524+0000 7fdba7426640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba0071500 con 0x7fdba006bb60 2023-11-04T01:44:25.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.524+0000 7fdba7426640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba015dae0 con 0x7fdba0159e40 2023-11-04T01:44:25.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.524+0000 7fdba7426640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba0070c60 con 0x7fdba00b0c40 2023-11-04T01:44:25.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.524+0000 7fdba49c1640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdba00b0c40 0x7fdba006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.524+0000 7fdba59c3640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdba006bb60 0x7fdba00cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34598/0 (socket says 172.21.15.114:34598) 2023-11-04T01:44:25.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.524+0000 7fdba59c3640 1 -- 172.21.15.114:0/413334735 learned_addr learned my addr 172.21.15.114:0/413334735 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:25.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.524+0000 7fdba49c1640 1 -- 172.21.15.114:0/413334735 >> v1:172.21.15.141:6789/0 conn(0x7fdba0159e40 legacy=0x7fdba00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.524+0000 7fdb97fff640 1 -- 172.21.15.114:0/413334735 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753042776 0 0) 0x7fdba0071500 con 0x7fdba006bb60 2023-11-04T01:44:25.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.524+0000 7fdba49c1640 1 -- 172.21.15.114:0/413334735 >> v1:172.21.15.114:6789/0 conn(0x7fdba006bb60 legacy=0x7fdba00cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.524+0000 7fdba49c1640 1 -- 172.21.15.114:0/413334735 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba0070f40 con 0x7fdba00b0c40 2023-11-04T01:44:25.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.525+0000 7fdba49c1640 1 --2- 172.21.15.114:0/413334735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdba00b0c40 0x7fdba006fff0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fdb900097a0 tx=0x7fdb9002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3fd3855db13737 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.525+0000 7fdb97fff640 1 -- 172.21.15.114:0/413334735 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90031830 con 0x7fdba00b0c40 2023-11-04T01:44:25.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.525+0000 7fdb97fff640 1 -- 172.21.15.114:0/413334735 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb90031990 con 0x7fdba00b0c40 2023-11-04T01:44:25.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.525+0000 7fdb97fff640 1 -- 172.21.15.114:0/413334735 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90031d20 con 0x7fdba00b0c40 2023-11-04T01:44:25.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.526+0000 7fdba7426640 1 -- 172.21.15.114:0/413334735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdba00b0c40 msgr2=0x7fdba006fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.526+0000 7fdba7426640 1 --2- 172.21.15.114:0/413334735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdba00b0c40 0x7fdba006fff0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fdb900097a0 tx=0x7fdb9002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.526+0000 7fdba7426640 1 -- 172.21.15.114:0/413334735 shutdown_connections 2023-11-04T01:44:25.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.526+0000 7fdba7426640 1 --2- 172.21.15.114:0/413334735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdba00b0c40 0x7fdba006fff0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.526+0000 7fdba7426640 1 -- 172.21.15.114:0/413334735 >> 172.21.15.114:0/413334735 conn(0x7fdba00cb530 msgr2=0x7fdba00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.526+0000 7fdba7426640 1 -- 172.21.15.114:0/413334735 shutdown_connections 2023-11-04T01:44:25.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.526+0000 7fdba7426640 1 -- 172.21.15.114:0/413334735 wait complete. 2023-11-04T01:44:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.527+0000 7fdba7426640 1 Processor -- start 2023-11-04T01:44:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.527+0000 7fdba7426640 1 -- start start 2023-11-04T01:44:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba7426640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdba006bb60 0x7fdba00aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba7426640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdba00b0c40 0x7fdba01eeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba7426640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdba0159e40 0x7fdba014e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba7426640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba01ef500 con 0x7fdba00b0c40 2023-11-04T01:44:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba7426640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba01ef7e0 con 0x7fdba006bb60 2023-11-04T01:44:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba7426640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba01efac0 con 0x7fdba0159e40 2023-11-04T01:44:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba49c1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdba00b0c40 0x7fdba01eeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba49c1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdba00b0c40 0x7fdba01eeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55268/0 (socket says 172.21.15.114:55268) 2023-11-04T01:44:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba49c1640 1 -- 172.21.15.114:0/3923251998 learned_addr learned my addr 172.21.15.114:0/3923251998 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba59c3640 1 --2- 172.21.15.114:0/3923251998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdba0159e40 0x7fdba014e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba51c2640 1 --2- 172.21.15.114:0/3923251998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdba006bb60 0x7fdba00aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba49c1640 1 -- 172.21.15.114:0/3923251998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdba0159e40 msgr2=0x7fdba014e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba49c1640 1 --2- 172.21.15.114:0/3923251998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdba0159e40 0x7fdba014e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba49c1640 1 -- 172.21.15.114:0/3923251998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdba006bb60 msgr2=0x7fdba00aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba49c1640 1 --2- 172.21.15.114:0/3923251998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdba006bb60 0x7fdba00aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba49c1640 1 -- 172.21.15.114:0/3923251998 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb90009400 con 0x7fdba00b0c40 2023-11-04T01:44:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba59c3640 1 --2- 172.21.15.114:0/3923251998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdba0159e40 0x7fdba014e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba51c2640 1 --2- 172.21.15.114:0/3923251998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdba006bb60 0x7fdba00aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba49c1640 1 --2- 172.21.15.114:0/3923251998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdba00b0c40 0x7fdba01eeab0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fdb90000c00 tx=0x7fdb900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdb95ffb640 1 -- 172.21.15.114:0/3923251998 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9003ca00 con 0x7fdba00b0c40 2023-11-04T01:44:25.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdb95ffb640 1 -- 172.21.15.114:0/3923251998 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9003cb60 con 0x7fdba00b0c40 2023-11-04T01:44:25.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdba7426640 1 -- 172.21.15.114:0/3923251998 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba01efda0 con 0x7fdba00b0c40 2023-11-04T01:44:25.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.528+0000 7fdb95ffb640 1 -- 172.21.15.114:0/3923251998 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90004030 con 0x7fdba00b0c40 2023-11-04T01:44:25.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.529+0000 7fdba7426640 1 -- 172.21.15.114:0/3923251998 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba015a3e0 con 0x7fdba00b0c40 2023-11-04T01:44:25.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.530+0000 7fdb95ffb640 1 -- 172.21.15.114:0/3923251998 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb90004190 con 0x7fdba00b0c40 2023-11-04T01:44:25.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.531+0000 7fdb95ffb640 1 --2- 172.21.15.114:0/3923251998 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdb8406ae70 0x7fdb8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.531+0000 7fdb95ffb640 1 -- 172.21.15.114:0/3923251998 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fdb900ac6a0 con 0x7fdba00b0c40 2023-11-04T01:44:25.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.531+0000 7fdba51c2640 1 --2- 172.21.15.114:0/3923251998 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdb8406ae70 0x7fdb8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.531+0000 7fdba51c2640 1 --2- 172.21.15.114:0/3923251998 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdb8406ae70 0x7fdb8406d330 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0015e0 tx=0x7fdb9c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.531+0000 7fdba9fb9740 1 Processor -- start 2023-11-04T01:44:25.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.532+0000 7fdba9fb9740 1 -- start start 2023-11-04T01:44:25.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.532+0000 7fdba9fb9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f278a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.532+0000 7fdba9fb9740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6ef76d0 0x5585d6f24730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.532+0000 7fdba9fb9740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6efb040 0x5585d6f24c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.532+0000 7fdba9fb9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d6e6ad70 con 0x5585d6f274c0 2023-11-04T01:44:25.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.532+0000 7fdba9fb9740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d6e68460 con 0x5585d6efb040 2023-11-04T01:44:25.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.532+0000 7fdba9fb9740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585d6e63d50 con 0x5585d6ef76d0 2023-11-04T01:44:25.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.532+0000 7fdba51c2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f278a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.532+0000 7fdba51c2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f278a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55270/0 (socket says 172.21.15.114:55270) 2023-11-04T01:44:25.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.532+0000 7fdba51c2640 1 -- 172.21.15.114:0/2198288536 learned_addr learned my addr 172.21.15.114:0/2198288536 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:25.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.532+0000 7fdba49c1640 1 --2- 172.21.15.114:0/2198288536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6ef76d0 0x5585d6f24730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.532+0000 7fdba59c3640 1 --2- 172.21.15.114:0/2198288536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6efb040 0x5585d6f24c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.533+0000 7fdba51c2640 1 -- 172.21.15.114:0/2198288536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6ef76d0 msgr2=0x5585d6f24730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.533+0000 7fdba51c2640 1 --2- 172.21.15.114:0/2198288536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6ef76d0 0x5585d6f24730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.533+0000 7fdba51c2640 1 -- 172.21.15.114:0/2198288536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6efb040 msgr2=0x5585d6f24c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.533+0000 7fdba51c2640 1 --2- 172.21.15.114:0/2198288536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6efb040 0x5585d6f24c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.533+0000 7fdba51c2640 1 -- 172.21.15.114:0/2198288536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585d6e26e30 con 0x5585d6f274c0 2023-11-04T01:44:25.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.533+0000 7fdba51c2640 1 --2- 172.21.15.114:0/2198288536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f278a0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00d6d0 tx=0x7fdb9c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7dbced34069471 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.533+0000 7fdb8affd640 1 -- 172.21.15.114:0/2198288536 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c007460 con 0x5585d6f274c0 2023-11-04T01:44:25.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.533+0000 7fdb8affd640 1 -- 172.21.15.114:0/2198288536 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c0075c0 con 0x5585d6f274c0 2023-11-04T01:44:25.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.533+0000 7fdb8affd640 1 -- 172.21.15.114:0/2198288536 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0069d0 con 0x5585d6f274c0 2023-11-04T01:44:25.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.533+0000 7fdba9fb9740 1 -- 172.21.15.114:0/2198288536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 msgr2=0x5585d6f278a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.533+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/2198288536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f278a0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00d6d0 tx=0x7fdb9c010000 comp rx=0 tx=0).stop 2023-11-04T01:44:25.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.533+0000 7fdba9fb9740 1 -- 172.21.15.114:0/2198288536 shutdown_connections 2023-11-04T01:44:25.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.533+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/2198288536 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6efb040 0x5585d6f24c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.533+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/2198288536 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6ef76d0 0x5585d6f24730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.533+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/2198288536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f278a0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.533+0000 7fdba9fb9740 1 -- 172.21.15.114:0/2198288536 >> 172.21.15.114:0/2198288536 conn(0x5585d6ef99e0 msgr2=0x5585d6f422d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.534+0000 7fdba9fb9740 1 -- 172.21.15.114:0/2198288536 shutdown_connections 2023-11-04T01:44:25.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.534+0000 7fdba9fb9740 1 -- 172.21.15.114:0/2198288536 wait complete. 2023-11-04T01:44:25.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.534+0000 7fdba9fb9740 1 -- start start 2023-11-04T01:44:25.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.534+0000 7fdba9fb9740 1 Processor -- start 2023-11-04T01:44:25.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba9fb9740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6efb040 0x5585d6f2c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba9fb9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f2da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba9fb9740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6f17990 0x5585d6f2df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba9fb9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d6e1dee0 con 0x5585d6f274c0 2023-11-04T01:44:25.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba9fb9740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d6e1db80 con 0x5585d6efb040 2023-11-04T01:44:25.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba9fb9740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585d6de33a0 con 0x5585d6f17990 2023-11-04T01:44:25.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba9fb9740 10 client.0 _ll_register_callbacks cb 0x5585d6de78b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:25.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba49c1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f2da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba49c1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f2da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55276/0 (socket says 172.21.15.114:55276) 2023-11-04T01:44:25.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba49c1640 1 -- 172.21.15.114:0/2215965906 learned_addr learned my addr 172.21.15.114:0/2215965906 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:25.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba59c3640 1 --2- 172.21.15.114:0/2215965906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6f17990 0x5585d6f2df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba51c2640 1 --2- 172.21.15.114:0/2215965906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6efb040 0x5585d6f2c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba49c1640 1 -- 172.21.15.114:0/2215965906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6f17990 msgr2=0x5585d6f2df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba49c1640 1 --2- 172.21.15.114:0/2215965906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6f17990 0x5585d6f2df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba49c1640 1 -- 172.21.15.114:0/2215965906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6efb040 msgr2=0x5585d6f2c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba49c1640 1 --2- 172.21.15.114:0/2215965906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6efb040 0x5585d6f2c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba49c1640 1 -- 172.21.15.114:0/2215965906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba015dae0 con 0x5585d6f274c0 2023-11-04T01:44:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba51c2640 1 --2- 172.21.15.114:0/2215965906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6efb040 0x5585d6f2c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.535+0000 7fdba59c3640 1 --2- 172.21.15.114:0/2215965906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6f17990 0x5585d6f2df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdba49c1640 1 --2- 172.21.15.114:0/2215965906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f2da30 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fdb9007a770 tx=0x7fdb9007b2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d0cd985591e17d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdb7ffff640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:44:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdb7ffff640 1 -- 172.21.15.114:0/2215965906 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90077180 con 0x5585d6f274c0 2023-11-04T01:44:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdb7ffff640 1 -- 172.21.15.114:0/2215965906 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fdb900772e0 con 0x5585d6f274c0 2023-11-04T01:44:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdba9fb9740 1 -- 172.21.15.114:0/2215965906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585d6e5cd30 con 0x5585d6f274c0 2023-11-04T01:44:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdb7ffff640 1 -- 172.21.15.114:0/2215965906 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb90092170 con 0x5585d6f274c0 2023-11-04T01:44:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdba9fb9740 10 client.8934 fetch_fsmap learned FSMap version 115 2023-11-04T01:44:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdba9fb9740 1 -- 172.21.15.114:0/2215965906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x5585d6e623d0 con 0x5585d6f274c0 2023-11-04T01:44:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdb7ffff640 1 -- 172.21.15.114:0/2215965906 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5585d6e5cd30 con 0x5585d6f274c0 2023-11-04T01:44:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdb7ffff640 1 -- 172.21.15.114:0/2215965906 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 115) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fdb9004d060 con 0x5585d6f274c0 2023-11-04T01:44:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdba9fb9740 10 client.8934 fetch_fsmap finished waiting for FSMap version 115 2023-11-04T01:44:25.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdba9fb9740 10 client.8934 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2023-11-04T01:44:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdba9fb9740 20 client.8934 populate_metadata read hostname 'smithi114' 2023-11-04T01:44:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/2215965906 >> [v2:172.21.15.114:6836/2937931266,v1:172.21.15.114:6837/2937931266] conn(0x5585d6f55ee0 0x5585d6f562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdba9fb9740 4 client.8934 mds_command: new command op to 8547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:44:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdba9fb9740 1 -- 172.21.15.114:0/2215965906 --> [v2:172.21.15.114:6836/2937931266,v1:172.21.15.114:6837/2937931266] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585d6e5ca50 con 0x5585d6f55ee0 2023-11-04T01:44:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.536+0000 7fdba51c2640 1 --2- 172.21.15.114:0/2215965906 >> [v2:172.21.15.114:6836/2937931266,v1:172.21.15.114:6837/2937931266] conn(0x5585d6f55ee0 0x5585d6f562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdb7ffff640 10 client.8934 ms_handle_connect on v2:172.21.15.114:6836/2937931266 2023-11-04T01:44:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdba51c2640 1 --2- 172.21.15.114:0/2215965906 >> [v2:172.21.15.114:6836/2937931266,v1:172.21.15.114:6837/2937931266] conn(0x5585d6f55ee0 0x5585d6f562c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=332a27245c37b5d5 server_cookie=13192398e27bea78 in_seq=0 out_seq=0 2023-11-04T01:44:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdb7ffff640 1 -- 172.21.15.114:0/2215965906 <== mds.0 v2:172.21.15.114:6836/2937931266 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5585d6e5ca50 con 0x5585d6f55ee0 2023-11-04T01:44:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdb7ffff640 10 client.8934 handle_command_reply: tid=0 2023-11-04T01:44:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdba9fb9740 1 client.8934 shutdown 2023-11-04T01:44:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdba9fb9740 1 -- 172.21.15.114:0/2215965906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 msgr2=0x5585d6f2da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/2215965906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f2da30 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fdb9007a770 tx=0x7fdb9007b2b0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdba9fb9740 1 -- 172.21.15.114:0/2215965906 shutdown_connections 2023-11-04T01:44:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/2215965906 >> [v2:172.21.15.114:6836/2937931266,v1:172.21.15.114:6837/2937931266] conn(0x5585d6f55ee0 0x5585d6f562c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/2215965906 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6f17990 0x5585d6f2df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdb7ffff640 0 client.8934 ms_handle_reset on v2:172.21.15.114:6836/2937931266 2023-11-04T01:44:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/2215965906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f2da30 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/2215965906 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6efb040 0x5585d6f2c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdba9fb9740 1 -- 172.21.15.114:0/2215965906 >> 172.21.15.114:0/2215965906 conn(0x5585d6ef76d0 msgr2=0x5585d6f457e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdba9fb9740 1 -- 172.21.15.114:0/2215965906 shutdown_connections 2023-11-04T01:44:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdba9fb9740 1 -- 172.21.15.114:0/2215965906 wait complete. 2023-11-04T01:44:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.537+0000 7fdba9fb9740 20 client.8934 trim_cache size 0 max 16384 2023-11-04T01:44:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.550+0000 7fdba9fb9740 1 Processor -- start 2023-11-04T01:44:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.550+0000 7fdba9fb9740 1 -- start start 2023-11-04T01:44:25.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba9fb9740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6efb040 0x5585d6f2e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba9fb9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f17990 0x5585d6f64f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba9fb9740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6f274c0 0x5585d6f41ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba9fb9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d6ef9730 con 0x5585d6f17990 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba9fb9740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d6f43110 con 0x5585d6f274c0 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba9fb9740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585d6f177a0 con 0x5585d6efb040 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba49c1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f17990 0x5585d6f64f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba49c1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f17990 0x5585d6f64f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55284/0 (socket says 172.21.15.114:55284) 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba49c1640 1 -- 172.21.15.114:0/1713400331 learned_addr learned my addr 172.21.15.114:0/1713400331 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba51c2640 1 --2- 172.21.15.114:0/1713400331 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6efb040 0x5585d6f2e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba59c3640 1 --2- 172.21.15.114:0/1713400331 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6f274c0 0x5585d6f41ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba49c1640 1 -- 172.21.15.114:0/1713400331 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6efb040 msgr2=0x5585d6f2e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba49c1640 1 --2- 172.21.15.114:0/1713400331 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6efb040 0x5585d6f2e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba49c1640 1 -- 172.21.15.114:0/1713400331 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6f274c0 msgr2=0x5585d6f41ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba49c1640 1 --2- 172.21.15.114:0/1713400331 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6f274c0 0x5585d6f41ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba49c1640 1 -- 172.21.15.114:0/1713400331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585d6dffea0 con 0x5585d6f17990 2023-11-04T01:44:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.551+0000 7fdba59c3640 1 --2- 172.21.15.114:0/1713400331 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6f274c0 0x5585d6f41ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.552+0000 7fdba49c1640 1 --2- 172.21.15.114:0/1713400331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f17990 0x5585d6f64f10 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fdb90004650 tx=0x7fdb9007e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f080df0d7771e9e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.552+0000 7fdb8b7fe640 1 -- 172.21.15.114:0/1713400331 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90082b70 con 0x5585d6f17990 2023-11-04T01:44:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.552+0000 7fdb8b7fe640 1 -- 172.21.15.114:0/1713400331 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb900828e0 con 0x5585d6f17990 2023-11-04T01:44:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.552+0000 7fdb8b7fe640 1 -- 172.21.15.114:0/1713400331 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90077180 con 0x5585d6f17990 2023-11-04T01:44:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.552+0000 7fdba9fb9740 1 -- 172.21.15.114:0/1713400331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f17990 msgr2=0x5585d6f64f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.552+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/1713400331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f17990 0x5585d6f64f10 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fdb90004650 tx=0x7fdb9007e000 comp rx=0 tx=0).stop 2023-11-04T01:44:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.552+0000 7fdba9fb9740 1 -- 172.21.15.114:0/1713400331 shutdown_connections 2023-11-04T01:44:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.552+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/1713400331 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6f274c0 0x5585d6f41ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.552+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/1713400331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f17990 0x5585d6f64f10 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.552+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/1713400331 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6efb040 0x5585d6f2e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.552+0000 7fdba9fb9740 1 -- 172.21.15.114:0/1713400331 >> 172.21.15.114:0/1713400331 conn(0x5585d6ef76d0 msgr2=0x5585d6f549c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.552+0000 7fdba9fb9740 1 -- 172.21.15.114:0/1713400331 shutdown_connections 2023-11-04T01:44:25.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.552+0000 7fdba9fb9740 1 -- 172.21.15.114:0/1713400331 wait complete. 2023-11-04T01:44:25.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.553+0000 7fdba9fb9740 1 -- start start 2023-11-04T01:44:25.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.553+0000 7fdba9fb9740 1 Processor -- start 2023-11-04T01:44:25.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba9fb9740 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6efb040 0x5585d6fabe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba9fb9740 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6f17990 0x5585d6f23190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba9fb9740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f41ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba9fb9740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d6f2ee80 con 0x5585d6f274c0 2023-11-04T01:44:25.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba9fb9740 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585d6fac810 con 0x5585d6f17990 2023-11-04T01:44:25.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba9fb9740 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585d6f2ec30 con 0x5585d6efb040 2023-11-04T01:44:25.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba9fb9740 10 client.0 _ll_register_callbacks cb 0x7fdb9c0012e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:25.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba59c3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f41ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba59c3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f41ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55292/0 (socket says 172.21.15.114:55292) 2023-11-04T01:44:25.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba59c3640 1 -- 172.21.15.114:0/3528575349 learned_addr learned my addr 172.21.15.114:0/3528575349 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:25.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba49c1640 1 --2- 172.21.15.114:0/3528575349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6f17990 0x5585d6f23190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba51c2640 1 --2- 172.21.15.114:0/3528575349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6efb040 0x5585d6fabe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba59c3640 1 -- 172.21.15.114:0/3528575349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6efb040 msgr2=0x5585d6fabe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba59c3640 1 --2- 172.21.15.114:0/3528575349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6efb040 0x5585d6fabe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba59c3640 1 -- 172.21.15.114:0/3528575349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6f17990 msgr2=0x5585d6f23190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba59c3640 1 --2- 172.21.15.114:0/3528575349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6f17990 0x5585d6f23190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba59c3640 1 -- 172.21.15.114:0/3528575349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba015dae0 con 0x5585d6f274c0 2023-11-04T01:44:25.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdba59c3640 1 --2- 172.21.15.114:0/3528575349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f41ff0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fdb98007900 tx=0x7fdb98001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b83b41a5956253 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.554+0000 7fdb7ffff640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-11-04T01:44:25.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdb7ffff640 1 -- 172.21.15.114:0/3528575349 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb980157f0 con 0x5585d6f274c0 2023-11-04T01:44:25.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdb7ffff640 1 -- 172.21.15.114:0/3528575349 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fdb98015950 con 0x5585d6f274c0 2023-11-04T01:44:25.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdba9fb9740 1 -- 172.21.15.114:0/3528575349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb9c0075c0 con 0x5585d6f274c0 2023-11-04T01:44:25.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdb7ffff640 1 -- 172.21.15.114:0/3528575349 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb98015b10 con 0x5585d6f274c0 2023-11-04T01:44:25.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdba9fb9740 10 client.8940 fetch_fsmap learned FSMap version 115 2023-11-04T01:44:25.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdba9fb9740 1 -- 172.21.15.114:0/3528575349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x5585d6e25690 con 0x5585d6f274c0 2023-11-04T01:44:25.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdb7ffff640 1 -- 172.21.15.114:0/3528575349 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb98025020 con 0x5585d6f274c0 2023-11-04T01:44:25.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdb7ffff640 1 -- 172.21.15.114:0/3528575349 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 115) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fdb98015c70 con 0x5585d6f274c0 2023-11-04T01:44:25.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdba9fb9740 10 client.8940 fetch_fsmap finished waiting for FSMap version 115 2023-11-04T01:44:25.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdba9fb9740 10 client.8940 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2023-11-04T01:44:25.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdba9fb9740 20 client.8940 populate_metadata read hostname 'smithi114' 2023-11-04T01:44:25.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/3528575349 >> [v2:172.21.15.114:6836/2937931266,v1:172.21.15.114:6837/2937931266] conn(0x5585d6f236d0 0x5585d6f42530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdba9fb9740 4 client.8940 mds_command: new command op to 8547 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:44:25.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdba9fb9740 1 -- 172.21.15.114:0/3528575349 --> [v2:172.21.15.114:6836/2937931266,v1:172.21.15.114:6837/2937931266] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5585d6b647e0 con 0x5585d6f236d0 2023-11-04T01:44:25.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdba51c2640 1 --2- 172.21.15.114:0/3528575349 >> [v2:172.21.15.114:6836/2937931266,v1:172.21.15.114:6837/2937931266] conn(0x5585d6f236d0 0x5585d6f42530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdba51c2640 1 --2- 172.21.15.114:0/3528575349 >> [v2:172.21.15.114:6836/2937931266,v1:172.21.15.114:6837/2937931266] conn(0x5585d6f236d0 0x5585d6f42530 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee597a42af712558 server_cookie=2563118a809d9b2f in_seq=0 out_seq=0 2023-11-04T01:44:25.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.555+0000 7fdb7ffff640 10 client.8940 ms_handle_connect on v2:172.21.15.114:6836/2937931266 2023-11-04T01:44:25.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.561+0000 7fdb7ffff640 1 -- 172.21.15.114:0/3528575349 <== mds.0 v2:172.21.15.114:6836/2937931266 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5585d6b647e0 con 0x5585d6f236d0 2023-11-04T01:44:25.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.561+0000 7fdb7ffff640 10 client.8940 handle_command_reply: tid=0 2023-11-04T01:44:25.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.561+0000 7fdba9fb9740 1 client.8940 shutdown 2023-11-04T01:44:25.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba9fb9740 1 -- 172.21.15.114:0/3528575349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 msgr2=0x5585d6f41ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/3528575349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f41ff0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fdb98007900 tx=0x7fdb98001a70 comp rx=0 tx=0).stop 2023-11-04T01:44:25.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba9fb9740 1 -- 172.21.15.114:0/3528575349 shutdown_connections 2023-11-04T01:44:25.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/3528575349 >> [v2:172.21.15.114:6836/2937931266,v1:172.21.15.114:6837/2937931266] conn(0x5585d6f236d0 0x5585d6f42530 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/3528575349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5585d6f274c0 0x5585d6f41ff0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdb7ffff640 0 client.8940 ms_handle_reset on v2:172.21.15.114:6836/2937931266 2023-11-04T01:44:25.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/3528575349 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x5585d6f17990 0x5585d6f23190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba9fb9740 1 --2- 172.21.15.114:0/3528575349 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x5585d6efb040 0x5585d6fabe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba9fb9740 1 -- 172.21.15.114:0/3528575349 >> 172.21.15.114:0/3528575349 conn(0x5585d6ef76d0 msgr2=0x5585d6efb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba9fb9740 1 -- 172.21.15.114:0/3528575349 shutdown_connections 2023-11-04T01:44:25.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba9fb9740 1 -- 172.21.15.114:0/3528575349 wait complete. 2023-11-04T01:44:25.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba9fb9740 20 client.8940 trim_cache size 0 max 16384 2023-11-04T01:44:25.565 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-11-04T01:44:25.565 INFO:teuthology.orchestra.run.smithi114.stdout: "message": "", 2023-11-04T01:44:25.565 INFO:teuthology.orchestra.run.smithi114.stdout: "return_code": 0 2023-11-04T01:44:25.565 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-11-04T01:44:25.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba7426640 1 -- 172.21.15.114:0/3923251998 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdb8406ae70 msgr2=0x7fdb8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba7426640 1 --2- 172.21.15.114:0/3923251998 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdb8406ae70 0x7fdb8406d330 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0015e0 tx=0x7fdb9c009040 comp rx=0 tx=0).stop 2023-11-04T01:44:25.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba7426640 1 -- 172.21.15.114:0/3923251998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdba00b0c40 msgr2=0x7fdba01eeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba7426640 1 --2- 172.21.15.114:0/3923251998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdba00b0c40 0x7fdba01eeab0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fdb90000c00 tx=0x7fdb900046c0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba7426640 1 -- 172.21.15.114:0/3923251998 shutdown_connections 2023-11-04T01:44:25.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba7426640 1 --2- 172.21.15.114:0/3923251998 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdba0159e40 0x7fdba014e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba7426640 1 --2- 172.21.15.114:0/3923251998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdba00b0c40 0x7fdba01eeab0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba7426640 1 --2- 172.21.15.114:0/3923251998 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdb8406ae70 0x7fdb8406d330 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba7426640 1 --2- 172.21.15.114:0/3923251998 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdba006bb60 0x7fdba00aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.562+0000 7fdba7426640 1 -- 172.21.15.114:0/3923251998 >> 172.21.15.114:0/3923251998 conn(0x7fdba00cb530 msgr2=0x7fdba00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.563+0000 7fdba7426640 1 -- 172.21.15.114:0/3923251998 shutdown_connections 2023-11-04T01:44:25.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.563+0000 7fdba7426640 1 -- 172.21.15.114:0/3923251998 wait complete. 2023-11-04T01:44:25.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:25.575 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir d1/dir/.snap/*) 2023-11-04T01:44:25.606 INFO:tasks.cephfs.test_snapshots:testing snapclient mds_kill_mdstable_at=3 2023-11-04T01:44:25.606 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:25.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.744+0000 7f8b4ae94640 1 Processor -- start 2023-11-04T01:44:25.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.744+0000 7f8b4ae94640 1 -- start start 2023-11-04T01:44:25.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.745+0000 7f8b4ae94640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8b4415d4e0 0x7f8b440d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.745+0000 7f8b4ae94640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b440b32b0 con 0x7f8b440d3b60 2023-11-04T01:44:25.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.745+0000 7f8b4ae94640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b440cee10 con 0x7f8b4415d100 2023-11-04T01:44:25.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.745+0000 7f8b4ae94640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b440cec20 con 0x7f8b4415d4e0 2023-11-04T01:44:25.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.745+0000 7f8b43fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8b4415d4e0 0x7f8b440d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.745+0000 7f8b49431640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8b440d3b60 0x7f8b440b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34600/0 (socket says 172.21.15.114:34600) 2023-11-04T01:44:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.745+0000 7f8b49431640 1 -- 172.21.15.114:0/2328161441 learned_addr learned my addr 172.21.15.114:0/2328161441 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.746+0000 7f8b437fe640 1 -- 172.21.15.114:0/2328161441 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471679886 0 0) 0x7f8b440b32b0 con 0x7f8b440d3b60 2023-11-04T01:44:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.746+0000 7f8b437fe640 1 -- 172.21.15.114:0/2328161441 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b2c003520 con 0x7f8b440d3b60 2023-11-04T01:44:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.746+0000 7f8b43fff640 1 -- 172.21.15.114:0/2328161441 >> v1:172.21.15.141:6789/0 conn(0x7f8b4415d100 legacy=0x7f8b440ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.746+0000 7f8b43fff640 1 -- 172.21.15.114:0/2328161441 >> v1:172.21.15.114:6789/0 conn(0x7f8b440d3b60 legacy=0x7f8b440b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.746+0000 7f8b43fff640 1 -- 172.21.15.114:0/2328161441 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b440b2980 con 0x7f8b4415d4e0 2023-11-04T01:44:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.746+0000 7f8b43fff640 1 --2- 172.21.15.114:0/2328161441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b4415d4e0 0x7f8b440d14d0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f8b380097a0 tx=0x7f8b3802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6193ba64cd16fae2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.747+0000 7f8b437fe640 1 -- 172.21.15.114:0/2328161441 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b38030610 con 0x7f8b4415d4e0 2023-11-04T01:44:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.747+0000 7f8b437fe640 1 -- 172.21.15.114:0/2328161441 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b38030770 con 0x7f8b4415d4e0 2023-11-04T01:44:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.747+0000 7f8b437fe640 1 -- 172.21.15.114:0/2328161441 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b38030b00 con 0x7f8b4415d4e0 2023-11-04T01:44:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.747+0000 7f8b4ae94640 1 -- 172.21.15.114:0/2328161441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b4415d4e0 msgr2=0x7f8b440d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.747+0000 7f8b4ae94640 1 --2- 172.21.15.114:0/2328161441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b4415d4e0 0x7f8b440d14d0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f8b380097a0 tx=0x7f8b3802b960 comp rx=0 tx=0).stop 2023-11-04T01:44:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.747+0000 7f8b4ae94640 1 -- 172.21.15.114:0/2328161441 shutdown_connections 2023-11-04T01:44:25.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.747+0000 7f8b4ae94640 1 --2- 172.21.15.114:0/2328161441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b4415d4e0 0x7f8b440d14d0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.747+0000 7f8b4ae94640 1 -- 172.21.15.114:0/2328161441 >> 172.21.15.114:0/2328161441 conn(0x7f8b440d2ef0 msgr2=0x7f8b440d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.747+0000 7f8b4ae94640 1 -- 172.21.15.114:0/2328161441 shutdown_connections 2023-11-04T01:44:25.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.747+0000 7f8b4ae94640 1 -- 172.21.15.114:0/2328161441 wait complete. 2023-11-04T01:44:25.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.748+0000 7f8b4ae94640 1 Processor -- start 2023-11-04T01:44:25.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.748+0000 7f8b4ae94640 1 -- start start 2023-11-04T01:44:25.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.749+0000 7f8b4ae94640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b440d3b60 0x7f8b44159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.749+0000 7f8b4ae94640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b4415d100 0x7f8b440cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.749+0000 7f8b4ae94640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b4415d4e0 0x7f8b440d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.749+0000 7f8b4ae94640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4406a8d0 con 0x7f8b4415d4e0 2023-11-04T01:44:25.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.749+0000 7f8b4ae94640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4406ab20 con 0x7f8b4415d100 2023-11-04T01:44:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.749+0000 7f8b4ae94640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4406ae00 con 0x7f8b440d3b60 2023-11-04T01:44:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.749+0000 7f8b49431640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b4415d4e0 0x7f8b440d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.749+0000 7f8b49431640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b4415d4e0 0x7f8b440d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55322/0 (socket says 172.21.15.114:55322) 2023-11-04T01:44:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.749+0000 7f8b49431640 1 -- 172.21.15.114:0/2561528416 learned_addr learned my addr 172.21.15.114:0/2561528416 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.749+0000 7f8b43fff640 1 --2- 172.21.15.114:0/2561528416 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b4415d100 0x7f8b440cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.749+0000 7f8b48c30640 1 --2- 172.21.15.114:0/2561528416 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b440d3b60 0x7f8b44159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.750+0000 7f8b49431640 1 -- 172.21.15.114:0/2561528416 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b440d3b60 msgr2=0x7f8b44159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.750+0000 7f8b49431640 1 --2- 172.21.15.114:0/2561528416 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b440d3b60 0x7f8b44159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.750+0000 7f8b49431640 1 -- 172.21.15.114:0/2561528416 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b4415d100 msgr2=0x7f8b440cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.750+0000 7f8b49431640 1 --2- 172.21.15.114:0/2561528416 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b4415d100 0x7f8b440cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.750+0000 7f8b49431640 1 -- 172.21.15.114:0/2561528416 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b38009400 con 0x7f8b4415d4e0 2023-11-04T01:44:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.750+0000 7f8b49431640 1 --2- 172.21.15.114:0/2561528416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b4415d4e0 0x7f8b440d14d0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00cb40 tx=0x7f8b3c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.750+0000 7f8b417fa640 1 -- 172.21.15.114:0/2561528416 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00aca0 con 0x7f8b4415d4e0 2023-11-04T01:44:25.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.750+0000 7f8b417fa640 1 -- 172.21.15.114:0/2561528416 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c00ae00 con 0x7f8b4415d4e0 2023-11-04T01:44:25.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.750+0000 7f8b4ae94640 1 -- 172.21.15.114:0/2561528416 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4406b0e0 con 0x7f8b4415d4e0 2023-11-04T01:44:25.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.750+0000 7f8b417fa640 1 -- 172.21.15.114:0/2561528416 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c012620 con 0x7f8b4415d4e0 2023-11-04T01:44:25.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.750+0000 7f8b4ae94640 1 -- 172.21.15.114:0/2561528416 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4406b6a0 con 0x7f8b4415d4e0 2023-11-04T01:44:25.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.751+0000 7f8b4ae94640 1 -- 172.21.15.114:0/2561528416 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b440684b0 con 0x7f8b4415d4e0 2023-11-04T01:44:25.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.751+0000 7f8b417fa640 1 -- 172.21.15.114:0/2561528416 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b3c007070 con 0x7f8b4415d4e0 2023-11-04T01:44:25.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.752+0000 7f8b417fa640 1 --2- 172.21.15.114:0/2561528416 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8b3006aea0 0x7f8b3006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.752+0000 7f8b417fa640 1 -- 172.21.15.114:0/2561528416 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f8b3c089f50 con 0x7f8b4415d4e0 2023-11-04T01:44:25.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.752+0000 7f8b48c30640 1 --2- 172.21.15.114:0/2561528416 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8b3006aea0 0x7f8b3006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.752+0000 7f8b48c30640 1 --2- 172.21.15.114:0/2561528416 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8b3006aea0 0x7f8b3006d360 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8b34007fd0 tx=0x7f8b34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.756+0000 7f8b417fa640 1 -- 172.21.15.114:0/2561528416 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8b3c054710 con 0x7f8b4415d4e0 2023-11-04T01:44:25.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.960+0000 7f8b4ae94640 1 -- 172.21.15.114:0/2561528416 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b440d2cd0 con 0x7f8b4415d4e0 2023-11-04T01:44:25.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.961+0000 7f8b417fa640 1 -- 172.21.15.114:0/2561528416 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4949 (secure 0 0 0) 0x7f8b3c017070 con 0x7f8b4415d4e0 2023-11-04T01:44:25.963 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:25.963 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":115,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2540656643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2540656643},{"type":"v1","addr":"172.21.15.114:6835","nonce":2540656643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:17.850751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":7063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7063":{"gid":7063,"name":"b","rank":1,"incarnation":111,"state":"up:active","state_seq":7,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:active","state_seq":18,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:25.963 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 115 2023-11-04T01:44:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.963+0000 7f8b4ae94640 1 -- 172.21.15.114:0/2561528416 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8b3006aea0 msgr2=0x7f8b3006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.963+0000 7f8b4ae94640 1 --2- 172.21.15.114:0/2561528416 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8b3006aea0 0x7f8b3006d360 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8b34007fd0 tx=0x7f8b34009040 comp rx=0 tx=0).stop 2023-11-04T01:44:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.963+0000 7f8b4ae94640 1 -- 172.21.15.114:0/2561528416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b4415d4e0 msgr2=0x7f8b440d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.963+0000 7f8b4ae94640 1 --2- 172.21.15.114:0/2561528416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b4415d4e0 0x7f8b440d14d0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c00cb40 tx=0x7f8b3c00a060 comp rx=0 tx=0).stop 2023-11-04T01:44:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.963+0000 7f8b4ae94640 1 -- 172.21.15.114:0/2561528416 shutdown_connections 2023-11-04T01:44:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.963+0000 7f8b4ae94640 1 --2- 172.21.15.114:0/2561528416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8b4415d4e0 0x7f8b440d14d0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.963+0000 7f8b4ae94640 1 --2- 172.21.15.114:0/2561528416 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8b3006aea0 0x7f8b3006d360 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.963+0000 7f8b4ae94640 1 --2- 172.21.15.114:0/2561528416 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8b4415d100 0x7f8b440cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.963+0000 7f8b4ae94640 1 --2- 172.21.15.114:0/2561528416 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8b440d3b60 0x7f8b44159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.963+0000 7f8b4ae94640 1 -- 172.21.15.114:0/2561528416 >> 172.21.15.114:0/2561528416 conn(0x7f8b440d2ef0 msgr2=0x7f8b440b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.963+0000 7f8b4ae94640 1 -- 172.21.15.114:0/2561528416 shutdown_connections 2023-11-04T01:44:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:25.963+0000 7f8b4ae94640 1 -- 172.21.15.114:0/2561528416 wait complete. 2023-11-04T01:44:25.975 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:44:26.086 INFO:teuthology.orchestra.run.smithi114.stdout:{"last_snap":14,"last_created":12,"last_destroyed":13,"pending_noop":[],"snaps":[{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:43:38.841671+0000","name":"s26","metadata":{}}],"need_to_purge":{"17":[11,13]},"pending_update":[],"pending_destroy":[{"version":28,"removed_snap":12,"seq":14}]} 2023-11-04T01:44:26.086 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 13, "last_snap": 14, "need_to_purge": { "17": [ 11, 13 ] }, "pending_destroy": [ { "removed_snap": 12, "seq": 14, "version": 28 } ], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:43:38.841671+0000" } ] } 2023-11-04T01:44:26.086 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:26.176 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:44:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:26.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.184+0000 7fe24a8e0640 1 Processor -- start 2023-11-04T01:44:26.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.185+0000 7fe24a8e0640 1 -- start start 2023-11-04T01:44:26.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.185+0000 7fe24a8e0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe24415d630 0x7fe2440cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.185+0000 7fe24a8e0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2440b0150 con 0x7fe2440b2210 2023-11-04T01:44:26.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.185+0000 7fe24a8e0640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2440b1170 con 0x7fe2440ceda0 2023-11-04T01:44:26.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.185+0000 7fe24a8e0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2440b1df0 con 0x7fe24415d630 2023-11-04T01:44:26.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.185+0000 7fe248e7d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe24415d630 0x7fe2440cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.185+0000 7fe2437fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe2440b2210 0x7fe2440cf180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34608/0 (socket says 172.21.15.114:34608) 2023-11-04T01:44:26.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.185+0000 7fe2437fe640 1 -- 172.21.15.114:0/1406876298 learned_addr learned my addr 172.21.15.114:0/1406876298 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:26.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.186+0000 7fe248e7d640 1 -- 172.21.15.114:0/1406876298 >> v1:172.21.15.141:6789/0 conn(0x7fe2440ceda0 legacy=0x7fe24415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.186+0000 7fe248e7d640 1 -- 172.21.15.114:0/1406876298 >> v1:172.21.15.114:6789/0 conn(0x7fe2440b2210 legacy=0x7fe2440cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.186+0000 7fe248e7d640 1 -- 172.21.15.114:0/1406876298 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2440b1450 con 0x7fe24415d630 2023-11-04T01:44:26.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.186+0000 7fe242ffd640 1 -- 172.21.15.114:0/1406876298 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519533481 0 0) 0x7fe2440b0150 con 0x7fe2440b2210 2023-11-04T01:44:26.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.186+0000 7fe248e7d640 1 --2- 172.21.15.114:0/1406876298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe24415d630 0x7fe2440cf890 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009d90 tx=0x7fe23c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3db49567411023 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.187+0000 7fe242ffd640 1 -- 172.21.15.114:0/1406876298 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c02cbd0 con 0x7fe24415d630 2023-11-04T01:44:26.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.187+0000 7fe242ffd640 1 -- 172.21.15.114:0/1406876298 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c02cd30 con 0x7fe24415d630 2023-11-04T01:44:26.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.187+0000 7fe242ffd640 1 -- 172.21.15.114:0/1406876298 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c02cea0 con 0x7fe24415d630 2023-11-04T01:44:26.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.187+0000 7fe24a8e0640 1 -- 172.21.15.114:0/1406876298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe24415d630 msgr2=0x7fe2440cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.187+0000 7fe24a8e0640 1 --2- 172.21.15.114:0/1406876298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe24415d630 0x7fe2440cf890 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009d90 tx=0x7fe23c02be20 comp rx=0 tx=0).stop 2023-11-04T01:44:26.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.187+0000 7fe24a8e0640 1 -- 172.21.15.114:0/1406876298 shutdown_connections 2023-11-04T01:44:26.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.187+0000 7fe24a8e0640 1 --2- 172.21.15.114:0/1406876298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe24415d630 0x7fe2440cf890 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.187+0000 7fe24a8e0640 1 -- 172.21.15.114:0/1406876298 >> 172.21.15.114:0/1406876298 conn(0x7fe2440d0c30 msgr2=0x7fe2440d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:26.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.187+0000 7fe24a8e0640 1 -- 172.21.15.114:0/1406876298 shutdown_connections 2023-11-04T01:44:26.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.187+0000 7fe24a8e0640 1 -- 172.21.15.114:0/1406876298 wait complete. 2023-11-04T01:44:26.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.188+0000 7fe24a8e0640 1 Processor -- start 2023-11-04T01:44:26.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.189+0000 7fe24a8e0640 1 -- start start 2023-11-04T01:44:26.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.189+0000 7fe24a8e0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2440b2210 0x7fe2440ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.189+0000 7fe24a8e0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2440ceda0 0x7fe2440c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.189+0000 7fe24a8e0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe24415d630 0x7fe24414dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.189+0000 7fe24a8e0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2440cb770 con 0x7fe2440b2210 2023-11-04T01:44:26.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.189+0000 7fe24a8e0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2440b3d60 con 0x7fe24415d630 2023-11-04T01:44:26.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.189+0000 7fe24a8e0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2440b4040 con 0x7fe2440ceda0 2023-11-04T01:44:26.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.189+0000 7fe243fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2440b2210 0x7fe2440ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.189+0000 7fe243fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2440b2210 0x7fe2440ca810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55346/0 (socket says 172.21.15.114:55346) 2023-11-04T01:44:26.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.189+0000 7fe243fff640 1 -- 172.21.15.114:0/1895782165 learned_addr learned my addr 172.21.15.114:0/1895782165 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:26.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.190+0000 7fe2437fe640 1 --2- 172.21.15.114:0/1895782165 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2440ceda0 0x7fe2440c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.190+0000 7fe248e7d640 1 --2- 172.21.15.114:0/1895782165 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe24415d630 0x7fe24414dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.190+0000 7fe243fff640 1 -- 172.21.15.114:0/1895782165 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2440ceda0 msgr2=0x7fe2440c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.190+0000 7fe243fff640 1 --2- 172.21.15.114:0/1895782165 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2440ceda0 0x7fe2440c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.190+0000 7fe243fff640 1 -- 172.21.15.114:0/1895782165 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe24415d630 msgr2=0x7fe24414dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.190+0000 7fe243fff640 1 --2- 172.21.15.114:0/1895782165 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe24415d630 0x7fe24414dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.190+0000 7fe243fff640 1 -- 172.21.15.114:0/1895782165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c009a70 con 0x7fe2440b2210 2023-11-04T01:44:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.190+0000 7fe248e7d640 1 --2- 172.21.15.114:0/1895782165 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe24415d630 0x7fe24414dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.190+0000 7fe243fff640 1 --2- 172.21.15.114:0/1895782165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2440b2210 0x7fe2440ca810 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fe23800c3a0 tx=0x7fe23800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.190+0000 7fe240ff9640 1 -- 172.21.15.114:0/1895782165 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2380052d0 con 0x7fe2440b2210 2023-11-04T01:44:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.190+0000 7fe240ff9640 1 -- 172.21.15.114:0/1895782165 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe238005450 con 0x7fe2440b2210 2023-11-04T01:44:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.190+0000 7fe24a8e0640 1 -- 172.21.15.114:0/1895782165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2440b4320 con 0x7fe2440b2210 2023-11-04T01:44:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.190+0000 7fe240ff9640 1 -- 172.21.15.114:0/1895782165 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238003880 con 0x7fe2440b2210 2023-11-04T01:44:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.190+0000 7fe24a8e0640 1 -- 172.21.15.114:0/1895782165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2440c8360 con 0x7fe2440b2210 2023-11-04T01:44:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.191+0000 7fe24a8e0640 1 -- 172.21.15.114:0/1895782165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2440b4840 con 0x7fe2440b2210 2023-11-04T01:44:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.191+0000 7fe240ff9640 1 -- 172.21.15.114:0/1895782165 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe2380039e0 con 0x7fe2440b2210 2023-11-04T01:44:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.192+0000 7fe240ff9640 1 --2- 172.21.15.114:0/1895782165 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe23006ae70 0x7fe23006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.192+0000 7fe240ff9640 1 -- 172.21.15.114:0/1895782165 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fe238089500 con 0x7fe2440b2210 2023-11-04T01:44:26.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.192+0000 7fe2437fe640 1 --2- 172.21.15.114:0/1895782165 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe23006ae70 0x7fe23006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.192+0000 7fe2437fe640 1 --2- 172.21.15.114:0/1895782165 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe23006ae70 0x7fe23006d330 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe2441e7ea0 tx=0x7fe234009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.196+0000 7fe240ff9640 1 -- 172.21.15.114:0/1895782165 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe2440b4840 con 0x7fe2440b2210 2023-11-04T01:44:26.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.398+0000 7fe24a8e0640 1 -- 172.21.15.114:0/1895782165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2440c84f0 con 0x7fe2440b2210 2023-11-04T01:44:26.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.398+0000 7fe240ff9640 1 -- 172.21.15.114:0/1895782165 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4949 (secure 0 0 0) 0x7fe238017090 con 0x7fe2440b2210 2023-11-04T01:44:26.400 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:26.400 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":115,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2540656643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2540656643},{"type":"v1","addr":"172.21.15.114:6835","nonce":2540656643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:17.850751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":7063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7063":{"gid":7063,"name":"b","rank":1,"incarnation":111,"state":"up:active","state_seq":7,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:active","state_seq":18,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:26.401 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 115 2023-11-04T01:44:26.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.400+0000 7fe24a8e0640 1 -- 172.21.15.114:0/1895782165 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe23006ae70 msgr2=0x7fe23006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.400+0000 7fe24a8e0640 1 --2- 172.21.15.114:0/1895782165 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe23006ae70 0x7fe23006d330 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe2441e7ea0 tx=0x7fe234009040 comp rx=0 tx=0).stop 2023-11-04T01:44:26.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.400+0000 7fe24a8e0640 1 -- 172.21.15.114:0/1895782165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2440b2210 msgr2=0x7fe2440ca810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.400+0000 7fe24a8e0640 1 --2- 172.21.15.114:0/1895782165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2440b2210 0x7fe2440ca810 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fe23800c3a0 tx=0x7fe23800c860 comp rx=0 tx=0).stop 2023-11-04T01:44:26.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.400+0000 7fe24a8e0640 1 -- 172.21.15.114:0/1895782165 shutdown_connections 2023-11-04T01:44:26.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.400+0000 7fe24a8e0640 1 --2- 172.21.15.114:0/1895782165 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fe23006ae70 0x7fe23006d330 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.400+0000 7fe24a8e0640 1 --2- 172.21.15.114:0/1895782165 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fe24415d630 0x7fe24414dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.400+0000 7fe24a8e0640 1 --2- 172.21.15.114:0/1895782165 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fe2440ceda0 0x7fe2440c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.400+0000 7fe24a8e0640 1 --2- 172.21.15.114:0/1895782165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2440b2210 0x7fe2440ca810 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.400+0000 7fe24a8e0640 1 -- 172.21.15.114:0/1895782165 >> 172.21.15.114:0/1895782165 conn(0x7fe2440d0c30 msgr2=0x7fe24415c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:26.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.400+0000 7fe24a8e0640 1 -- 172.21.15.114:0/1895782165 shutdown_connections 2023-11-04T01:44:26.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.400+0000 7fe24a8e0640 1 -- 172.21.15.114:0/1895782165 wait complete. 2023-11-04T01:44:26.412 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:44:26.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.553+0000 7ff8c59c9640 1 Processor -- start 2023-11-04T01:44:26.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.553+0000 7ff8c59c9640 1 -- start start 2023-11-04T01:44:26.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8c59c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8c015d100 0x7ff8c00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8c59c9640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff8c00d1be0 0x7ff8c00b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8c59c9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c00b32b0 con 0x7ff8c015d4e0 2023-11-04T01:44:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8c59c9640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c00cee10 con 0x7ff8c00d1be0 2023-11-04T01:44:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8c59c9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c00b2980 con 0x7ff8c015d100 2023-11-04T01:44:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8b7fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff8c015d4e0 0x7ff8c00d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43608/0 (socket says 172.21.15.114:43608) 2023-11-04T01:44:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8b7fff640 1 -- 172.21.15.114:0/2506089197 learned_addr learned my addr 172.21.15.114:0/2506089197 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8beffd640 1 --2- 172.21.15.114:0/2506089197 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8c015d100 0x7ff8c00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8bf7fe640 1 --2- 172.21.15.114:0/2506089197 >> v2:172.21.15.141:3300/0 conn(0x7ff8c00d1be0 0x7ff8c00b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8be7fc640 1 -- 172.21.15.114:0/2506089197 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670143461 0 0) 0x7ff8c00b32b0 con 0x7ff8c015d4e0 2023-11-04T01:44:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8be7fc640 1 -- 172.21.15.114:0/2506089197 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8ac003520 con 0x7ff8c015d4e0 2023-11-04T01:44:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8be7fc640 1 -- 172.21.15.114:0/2506089197 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 159010812 0 0) 0x7ff8ac003520 con 0x7ff8c015d4e0 2023-11-04T01:44:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8be7fc640 1 -- 172.21.15.114:0/2506089197 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8c015d100 msgr2=0x7ff8c00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8be7fc640 1 --2- 172.21.15.114:0/2506089197 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8c015d100 0x7ff8c00ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8be7fc640 1 -- 172.21.15.114:0/2506089197 >> v2:172.21.15.141:3300/0 conn(0x7ff8c00d1be0 msgr2=0x7ff8c00b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8be7fc640 1 --2- 172.21.15.114:0/2506089197 >> v2:172.21.15.141:3300/0 conn(0x7ff8c00d1be0 0x7ff8c00b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8be7fc640 1 -- 172.21.15.114:0/2506089197 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c00b2c60 con 0x7ff8c015d4e0 2023-11-04T01:44:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8be7fc640 1 -- 172.21.15.114:0/2506089197 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7ff8a8001670 con 0x7ff8c015d4e0 2023-11-04T01:44:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8be7fc640 1 -- 172.21.15.114:0/2506089197 >> v1:172.21.15.114:6789/0 conn(0x7ff8c015d4e0 legacy=0x7ff8c00d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8be7fc640 1 --2- 172.21.15.114:0/2506089197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8ac003970 0x7ff8ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8be7fc640 1 --2- 172.21.15.114:0/2506089197 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8c015d100 0x7ff8ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8be7fc640 1 --2- 172.21.15.114:0/2506089197 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8ac004d00 0x7ff8ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8be7fc640 1 -- 172.21.15.114:0/2506089197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c00cee10 con 0x7ff8ac003970 2023-11-04T01:44:26.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8be7fc640 1 -- 172.21.15.114:0/2506089197 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c00b2980 con 0x7ff8ac004d00 2023-11-04T01:44:26.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.554+0000 7ff8be7fc640 1 -- 172.21.15.114:0/2506089197 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac00b980 con 0x7ff8c015d100 2023-11-04T01:44:26.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.555+0000 7ff8beffd640 1 --2- 172.21.15.114:0/2506089197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8ac003970 0x7ff8ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.555+0000 7ff8b7fff640 1 --2- 172.21.15.114:0/2506089197 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8c015d100 0x7ff8ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.555+0000 7ff8bf7fe640 1 --2- 172.21.15.114:0/2506089197 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8ac004d00 0x7ff8ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.555+0000 7ff8beffd640 1 -- 172.21.15.114:0/2506089197 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8c015d100 msgr2=0x7ff8ac0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:26.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.555+0000 7ff8beffd640 1 --2- 172.21.15.114:0/2506089197 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8c015d100 0x7ff8ac0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.555+0000 7ff8beffd640 1 -- 172.21.15.114:0/2506089197 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8ac004d00 msgr2=0x7ff8ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:26.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.555+0000 7ff8beffd640 1 --2- 172.21.15.114:0/2506089197 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8ac004d00 0x7ff8ac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.555+0000 7ff8beffd640 1 -- 172.21.15.114:0/2506089197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac003520 con 0x7ff8ac003970 2023-11-04T01:44:26.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.556+0000 7ff8beffd640 1 --2- 172.21.15.114:0/2506089197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8ac003970 0x7ff8ac003d90 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009ab0 tx=0x7ff8ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fea6b7fef029b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.556+0000 7ff8be7fc640 1 -- 172.21.15.114:0/2506089197 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0005990 con 0x7ff8ac003970 2023-11-04T01:44:26.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.556+0000 7ff8be7fc640 1 -- 172.21.15.114:0/2506089197 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b0005af0 con 0x7ff8ac003970 2023-11-04T01:44:26.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.556+0000 7ff8be7fc640 1 -- 172.21.15.114:0/2506089197 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0005ea0 con 0x7ff8ac003970 2023-11-04T01:44:26.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.556+0000 7ff8c59c9640 1 -- 172.21.15.114:0/2506089197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8ac003970 msgr2=0x7ff8ac003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.556+0000 7ff8c59c9640 1 --2- 172.21.15.114:0/2506089197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8ac003970 0x7ff8ac003d90 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009ab0 tx=0x7ff8ac0057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.556+0000 7ff8bf7fe640 1 -- 172.21.15.114:0/2506089197 reap_dead start 2023-11-04T01:44:26.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.556+0000 7ff8c59c9640 1 -- 172.21.15.114:0/2506089197 shutdown_connections 2023-11-04T01:44:26.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.556+0000 7ff8c59c9640 1 -- 172.21.15.114:0/2506089197 >> 172.21.15.114:0/2506089197 conn(0x7ff8c00d2ef0 msgr2=0x7ff8c00d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:26.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.556+0000 7ff8c59c9640 1 -- 172.21.15.114:0/2506089197 shutdown_connections 2023-11-04T01:44:26.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.556+0000 7ff8c59c9640 1 -- 172.21.15.114:0/2506089197 wait complete. 2023-11-04T01:44:26.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.557+0000 7ff8c59c9640 1 Processor -- start 2023-11-04T01:44:26.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.558+0000 7ff8c59c9640 1 -- start start 2023-11-04T01:44:26.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.558+0000 7ff8c59c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8ac003970 0x7ff8c00a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.558+0000 7ff8c59c9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8c015ad00 0x7ff8c015a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.558+0000 7ff8c59c9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8c015f100 0x7ff8c00cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.558+0000 7ff8c59c9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c015aa40 con 0x7ff8ac003970 2023-11-04T01:44:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.558+0000 7ff8c59c9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c015dce0 con 0x7ff8c015f100 2023-11-04T01:44:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.558+0000 7ff8c59c9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c015dfc0 con 0x7ff8c015ad00 2023-11-04T01:44:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.558+0000 7ff8beffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8ac003970 0x7ff8c00a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.558+0000 7ff8beffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8ac003970 0x7ff8c00a07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33214/0 (socket says 172.21.15.114:33214) 2023-11-04T01:44:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.558+0000 7ff8beffd640 1 -- 172.21.15.114:0/1893782368 learned_addr learned my addr 172.21.15.114:0/1893782368 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.558+0000 7ff8b7fff640 1 --2- 172.21.15.114:0/1893782368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8c015ad00 0x7ff8c015a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.558+0000 7ff8bf7fe640 1 --2- 172.21.15.114:0/1893782368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8c015f100 0x7ff8c00cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.559+0000 7ff8beffd640 1 -- 172.21.15.114:0/1893782368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8c015ad00 msgr2=0x7ff8c015a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.559+0000 7ff8beffd640 1 --2- 172.21.15.114:0/1893782368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8c015ad00 0x7ff8c015a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.559+0000 7ff8beffd640 1 -- 172.21.15.114:0/1893782368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8c015f100 msgr2=0x7ff8c00cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.559+0000 7ff8beffd640 1 --2- 172.21.15.114:0/1893782368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8c015f100 0x7ff8c00cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.559+0000 7ff8beffd640 1 -- 172.21.15.114:0/1893782368 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c015e2a0 con 0x7ff8ac003970 2023-11-04T01:44:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.559+0000 7ff8beffd640 1 --2- 172.21.15.114:0/1893782368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8ac003970 0x7ff8c00a07b0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0036040 tx=0x7ff8b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.559+0000 7ff8bcff9640 1 -- 172.21.15.114:0/1893782368 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0005e70 con 0x7ff8ac003970 2023-11-04T01:44:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.559+0000 7ff8bcff9640 1 -- 172.21.15.114:0/1893782368 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b0004020 con 0x7ff8ac003970 2023-11-04T01:44:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.559+0000 7ff8c59c9640 1 -- 172.21.15.114:0/1893782368 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c015aa40 con 0x7ff8ac003970 2023-11-04T01:44:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.559+0000 7ff8bcff9640 1 -- 172.21.15.114:0/1893782368 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b00043d0 con 0x7ff8ac003970 2023-11-04T01:44:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.559+0000 7ff8c59c9640 1 -- 172.21.15.114:0/1893782368 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c015f590 con 0x7ff8ac003970 2023-11-04T01:44:26.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.560+0000 7ff8c59c9640 1 -- 172.21.15.114:0/1893782368 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c00684b0 con 0x7ff8ac003970 2023-11-04T01:44:26.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.560+0000 7ff8bcff9640 1 -- 172.21.15.114:0/1893782368 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8b0003610 con 0x7ff8ac003970 2023-11-04T01:44:26.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.561+0000 7ff8bcff9640 1 --2- 172.21.15.114:0/1893782368 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8a006ae70 0x7ff8a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.561+0000 7ff8bcff9640 1 -- 172.21.15.114:0/1893782368 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7ff8b00ac130 con 0x7ff8ac003970 2023-11-04T01:44:26.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.561+0000 7ff8b7fff640 1 --2- 172.21.15.114:0/1893782368 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8a006ae70 0x7ff8a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.561+0000 7ff8b7fff640 1 --2- 172.21.15.114:0/1893782368 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8a006ae70 0x7ff8a006d330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8001050 tx=0x7ff8a8000f80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.565+0000 7ff8bcff9640 1 -- 172.21.15.114:0/1893782368 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8b00768f0 con 0x7ff8ac003970 2023-11-04T01:44:26.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.801+0000 7ff8c59c9640 1 -- 172.21.15.114:0/1893782368 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7ff8c00b5c60 con 0x7ff8ac003970 2023-11-04T01:44:26.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.871+0000 7ff8bcff9640 1 -- 172.21.15.114:0/1893782368 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.7063 v116) v1 ==== 112+0+0 (secure 0 0 0) 0x7ff8b0079f10 con 0x7ff8ac003970 2023-11-04T01:44:26.873 INFO:teuthology.orchestra.run.smithi114.stderr:freezing mds.7063 2023-11-04T01:44:26.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.873+0000 7ff8c59c9640 1 -- 172.21.15.114:0/1893782368 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8a006ae70 msgr2=0x7ff8a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.873+0000 7ff8c59c9640 1 --2- 172.21.15.114:0/1893782368 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8a006ae70 0x7ff8a006d330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8001050 tx=0x7ff8a8000f80 comp rx=0 tx=0).stop 2023-11-04T01:44:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.873+0000 7ff8c59c9640 1 -- 172.21.15.114:0/1893782368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8ac003970 msgr2=0x7ff8c00a07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.873+0000 7ff8c59c9640 1 --2- 172.21.15.114:0/1893782368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8ac003970 0x7ff8c00a07b0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0036040 tx=0x7ff8b0004730 comp rx=0 tx=0).stop 2023-11-04T01:44:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.873+0000 7ff8c59c9640 1 -- 172.21.15.114:0/1893782368 shutdown_connections 2023-11-04T01:44:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.873+0000 7ff8c59c9640 1 --2- 172.21.15.114:0/1893782368 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff8a006ae70 0x7ff8a006d330 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.874+0000 7ff8c59c9640 1 --2- 172.21.15.114:0/1893782368 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff8c015f100 0x7ff8c00cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.874+0000 7ff8c59c9640 1 --2- 172.21.15.114:0/1893782368 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff8c015ad00 0x7ff8c015a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.874+0000 7ff8c59c9640 1 --2- 172.21.15.114:0/1893782368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8ac003970 0x7ff8c00a07b0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.874+0000 7ff8c59c9640 1 -- 172.21.15.114:0/1893782368 >> 172.21.15.114:0/1893782368 conn(0x7ff8c00d2ef0 msgr2=0x7ff8c00b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.874+0000 7ff8c59c9640 1 -- 172.21.15.114:0/1893782368 shutdown_connections 2023-11-04T01:44:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:26.874+0000 7ff8c59c9640 1 -- 172.21.15.114:0/1893782368 wait complete. 2023-11-04T01:44:26.886 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_kill_mdstable_at 3 2023-11-04T01:44:27.008 INFO:teuthology.orchestra.run.smithi141.stdout:{"success":"mds_kill_mdstable_at = '3' (not observed, change may require restart) "} 2023-11-04T01:44:27.009 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '3' (not observed, change may require restart) " } 2023-11-04T01:44:27.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:27.009 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s33) 2023-11-04T01:44:27.011 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:44:27.027 INFO:tasks.ceph.mds.b.smithi141.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7fdf453f4640 time 2023-11-04T01:44:27.027158+0000 2023-11-04T01:44:27.027 INFO:tasks.ceph.mds.b.smithi141.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:44:27.028 INFO:tasks.ceph.mds.b.smithi141.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:27.028 INFO:tasks.ceph.mds.b.smithi141.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdf4af6efaf] 2023-11-04T01:44:27.028 INFO:tasks.ceph.mds.b.smithi141.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fdf4af6f16d] 2023-11-04T01:44:27.028 INFO:tasks.ceph.mds.b.smithi141.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55ae168d11b7] 2023-11-04T01:44:27.028 INFO:tasks.ceph.mds.b.smithi141.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55ae1665ed15] 2023-11-04T01:44:27.028 INFO:tasks.ceph.mds.b.smithi141.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55ae16660b2b] 2023-11-04T01:44:27.028 INFO:tasks.ceph.mds.b.smithi141.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae1666101c] 2023-11-04T01:44:27.028 INFO:tasks.ceph.mds.b.smithi141.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55ae1664a325] 2023-11-04T01:44:27.028 INFO:tasks.ceph.mds.b.smithi141.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7fdf4b15ff9a] 2023-11-04T01:44:27.029 INFO:tasks.ceph.mds.b.smithi141.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7fdf4b1f1741] 2023-11-04T01:44:27.029 INFO:tasks.ceph.mds.b.smithi141.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fdf4a69f802] 2023-11-04T01:44:27.029 INFO:tasks.ceph.mds.b.smithi141.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fdf4a63f450] 2023-11-04T01:44:27.029 INFO:tasks.ceph.mds.b.smithi141.stderr:2023-11-04T01:44:27.026+0000 7fdf453f4640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7fdf453f4640 time 2023-11-04T01:44:27.027158+0000 2023-11-04T01:44:27.029 INFO:tasks.ceph.mds.b.smithi141.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:44:27.029 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:44:27.029 INFO:tasks.ceph.mds.b.smithi141.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:27.029 INFO:tasks.ceph.mds.b.smithi141.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdf4af6efaf] 2023-11-04T01:44:27.029 INFO:tasks.ceph.mds.b.smithi141.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fdf4af6f16d] 2023-11-04T01:44:27.029 INFO:tasks.ceph.mds.b.smithi141.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55ae168d11b7] 2023-11-04T01:44:27.030 INFO:tasks.ceph.mds.b.smithi141.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55ae1665ed15] 2023-11-04T01:44:27.030 INFO:tasks.ceph.mds.b.smithi141.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55ae16660b2b] 2023-11-04T01:44:27.030 INFO:tasks.ceph.mds.b.smithi141.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae1666101c] 2023-11-04T01:44:27.030 INFO:tasks.ceph.mds.b.smithi141.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55ae1664a325] 2023-11-04T01:44:27.030 INFO:tasks.ceph.mds.b.smithi141.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7fdf4b15ff9a] 2023-11-04T01:44:27.030 INFO:tasks.ceph.mds.b.smithi141.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7fdf4b1f1741] 2023-11-04T01:44:27.030 INFO:tasks.ceph.mds.b.smithi141.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fdf4a69f802] 2023-11-04T01:44:27.030 INFO:tasks.ceph.mds.b.smithi141.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fdf4a63f450] 2023-11-04T01:44:27.030 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:44:27.030 INFO:tasks.ceph.mds.b.smithi141.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:44:27.031 INFO:tasks.ceph.mds.b.smithi141.stderr: in thread 7fdf453f4640 thread_name:ms_dispatch 2023-11-04T01:44:27.031 INFO:tasks.ceph.mds.b.smithi141.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:27.031 INFO:tasks.ceph.mds.b.smithi141.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fdf4a654db0] 2023-11-04T01:44:27.031 INFO:tasks.ceph.mds.b.smithi141.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fdf4a6a154c] 2023-11-04T01:44:27.031 INFO:tasks.ceph.mds.b.smithi141.stderr: 3: raise() 2023-11-04T01:44:27.031 INFO:tasks.ceph.mds.b.smithi141.stderr: 4: abort() 2023-11-04T01:44:27.032 INFO:tasks.ceph.mds.b.smithi141.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdf4af6f009] 2023-11-04T01:44:27.032 INFO:tasks.ceph.mds.b.smithi141.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fdf4af6f16d] 2023-11-04T01:44:27.032 INFO:tasks.ceph.mds.b.smithi141.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55ae168d11b7] 2023-11-04T01:44:27.032 INFO:tasks.ceph.mds.b.smithi141.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55ae1665ed15] 2023-11-04T01:44:27.032 INFO:tasks.ceph.mds.b.smithi141.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55ae16660b2b] 2023-11-04T01:44:27.032 INFO:tasks.ceph.mds.b.smithi141.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae1666101c] 2023-11-04T01:44:27.032 INFO:tasks.ceph.mds.b.smithi141.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55ae1664a325] 2023-11-04T01:44:27.032 INFO:tasks.ceph.mds.b.smithi141.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7fdf4b15ff9a] 2023-11-04T01:44:27.032 INFO:tasks.ceph.mds.b.smithi141.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7fdf4b1f1741] 2023-11-04T01:44:27.032 INFO:tasks.ceph.mds.b.smithi141.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7fdf4a69f802] 2023-11-04T01:44:27.032 INFO:tasks.ceph.mds.b.smithi141.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7fdf4a63f450] 2023-11-04T01:44:27.033 INFO:tasks.ceph.mds.b.smithi141.stderr:2023-11-04T01:44:27.027+0000 7fdf453f4640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:27.033 INFO:tasks.ceph.mds.b.smithi141.stderr: in thread 7fdf453f4640 thread_name:ms_dispatch 2023-11-04T01:44:27.033 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:44:27.033 INFO:tasks.ceph.mds.b.smithi141.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:27.033 INFO:tasks.ceph.mds.b.smithi141.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fdf4a654db0] 2023-11-04T01:44:27.033 INFO:tasks.ceph.mds.b.smithi141.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fdf4a6a154c] 2023-11-04T01:44:27.033 INFO:tasks.ceph.mds.b.smithi141.stderr: 3: raise() 2023-11-04T01:44:27.033 INFO:tasks.ceph.mds.b.smithi141.stderr: 4: abort() 2023-11-04T01:44:27.033 INFO:tasks.ceph.mds.b.smithi141.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdf4af6f009] 2023-11-04T01:44:27.033 INFO:tasks.ceph.mds.b.smithi141.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fdf4af6f16d] 2023-11-04T01:44:27.034 INFO:tasks.ceph.mds.b.smithi141.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55ae168d11b7] 2023-11-04T01:44:27.034 INFO:tasks.ceph.mds.b.smithi141.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55ae1665ed15] 2023-11-04T01:44:27.034 INFO:tasks.ceph.mds.b.smithi141.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55ae16660b2b] 2023-11-04T01:44:27.034 INFO:tasks.ceph.mds.b.smithi141.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae1666101c] 2023-11-04T01:44:27.034 INFO:tasks.ceph.mds.b.smithi141.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55ae1664a325] 2023-11-04T01:44:27.034 INFO:tasks.ceph.mds.b.smithi141.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7fdf4b15ff9a] 2023-11-04T01:44:27.034 INFO:tasks.ceph.mds.b.smithi141.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7fdf4b1f1741] 2023-11-04T01:44:27.034 INFO:tasks.ceph.mds.b.smithi141.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7fdf4a69f802] 2023-11-04T01:44:27.034 INFO:tasks.ceph.mds.b.smithi141.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7fdf4a63f450] 2023-11-04T01:44:27.034 INFO:tasks.ceph.mds.b.smithi141.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:27.034 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:44:27.035 INFO:tasks.ceph.mds.b.smithi141.stderr: -1> 2023-11-04T01:44:27.026+0000 7fdf453f4640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7fdf453f4640 time 2023-11-04T01:44:27.027158+0000 2023-11-04T01:44:27.035 INFO:tasks.ceph.mds.b.smithi141.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:44:27.035 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:44:27.035 INFO:tasks.ceph.mds.b.smithi141.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:27.035 INFO:tasks.ceph.mds.b.smithi141.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdf4af6efaf] 2023-11-04T01:44:27.035 INFO:tasks.ceph.mds.b.smithi141.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fdf4af6f16d] 2023-11-04T01:44:27.035 INFO:tasks.ceph.mds.b.smithi141.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55ae168d11b7] 2023-11-04T01:44:27.036 INFO:tasks.ceph.mds.b.smithi141.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55ae1665ed15] 2023-11-04T01:44:27.036 INFO:tasks.ceph.mds.b.smithi141.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55ae16660b2b] 2023-11-04T01:44:27.036 INFO:tasks.ceph.mds.b.smithi141.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae1666101c] 2023-11-04T01:44:27.036 INFO:tasks.ceph.mds.b.smithi141.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55ae1664a325] 2023-11-04T01:44:27.036 INFO:tasks.ceph.mds.b.smithi141.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7fdf4b15ff9a] 2023-11-04T01:44:27.036 INFO:tasks.ceph.mds.b.smithi141.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7fdf4b1f1741] 2023-11-04T01:44:27.036 INFO:tasks.ceph.mds.b.smithi141.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fdf4a69f802] 2023-11-04T01:44:27.036 INFO:tasks.ceph.mds.b.smithi141.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fdf4a63f450] 2023-11-04T01:44:27.036 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:44:27.036 INFO:tasks.ceph.mds.b.smithi141.stderr: 0> 2023-11-04T01:44:27.027+0000 7fdf453f4640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:27.036 INFO:tasks.ceph.mds.b.smithi141.stderr: in thread 7fdf453f4640 thread_name:ms_dispatch 2023-11-04T01:44:27.037 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:44:27.037 INFO:tasks.ceph.mds.b.smithi141.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:27.037 INFO:tasks.ceph.mds.b.smithi141.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fdf4a654db0] 2023-11-04T01:44:27.037 INFO:tasks.ceph.mds.b.smithi141.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fdf4a6a154c] 2023-11-04T01:44:27.037 INFO:tasks.ceph.mds.b.smithi141.stderr: 3: raise() 2023-11-04T01:44:27.037 INFO:tasks.ceph.mds.b.smithi141.stderr: 4: abort() 2023-11-04T01:44:27.037 INFO:tasks.ceph.mds.b.smithi141.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdf4af6f009] 2023-11-04T01:44:27.037 INFO:tasks.ceph.mds.b.smithi141.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fdf4af6f16d] 2023-11-04T01:44:27.037 INFO:tasks.ceph.mds.b.smithi141.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55ae168d11b7] 2023-11-04T01:44:27.037 INFO:tasks.ceph.mds.b.smithi141.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55ae1665ed15] 2023-11-04T01:44:27.038 INFO:tasks.ceph.mds.b.smithi141.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55ae16660b2b] 2023-11-04T01:44:27.038 INFO:tasks.ceph.mds.b.smithi141.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae1666101c] 2023-11-04T01:44:27.038 INFO:tasks.ceph.mds.b.smithi141.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55ae1664a325] 2023-11-04T01:44:27.038 INFO:tasks.ceph.mds.b.smithi141.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7fdf4b15ff9a] 2023-11-04T01:44:27.038 INFO:tasks.ceph.mds.b.smithi141.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7fdf4b1f1741] 2023-11-04T01:44:27.038 INFO:tasks.ceph.mds.b.smithi141.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7fdf4a69f802] 2023-11-04T01:44:27.038 INFO:tasks.ceph.mds.b.smithi141.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7fdf4a63f450] 2023-11-04T01:44:27.038 INFO:tasks.ceph.mds.b.smithi141.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:27.038 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:44:27.039 INFO:tasks.ceph.mds.b.smithi141.stderr: -1> 2023-11-04T01:44:27.026+0000 7fdf453f4640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7fdf453f4640 time 2023-11-04T01:44:27.027158+0000 2023-11-04T01:44:27.039 INFO:tasks.ceph.mds.b.smithi141.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:44:27.039 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:44:27.039 INFO:tasks.ceph.mds.b.smithi141.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:27.039 INFO:tasks.ceph.mds.b.smithi141.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdf4af6efaf] 2023-11-04T01:44:27.040 INFO:tasks.ceph.mds.b.smithi141.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fdf4af6f16d] 2023-11-04T01:44:27.040 INFO:tasks.ceph.mds.b.smithi141.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55ae168d11b7] 2023-11-04T01:44:27.040 INFO:tasks.ceph.mds.b.smithi141.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55ae1665ed15] 2023-11-04T01:44:27.040 INFO:tasks.ceph.mds.b.smithi141.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55ae16660b2b] 2023-11-04T01:44:27.040 INFO:tasks.ceph.mds.b.smithi141.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae1666101c] 2023-11-04T01:44:27.040 INFO:tasks.ceph.mds.b.smithi141.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55ae1664a325] 2023-11-04T01:44:27.040 INFO:tasks.ceph.mds.b.smithi141.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7fdf4b15ff9a] 2023-11-04T01:44:27.040 INFO:tasks.ceph.mds.b.smithi141.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7fdf4b1f1741] 2023-11-04T01:44:27.040 INFO:tasks.ceph.mds.b.smithi141.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fdf4a69f802] 2023-11-04T01:44:27.040 INFO:tasks.ceph.mds.b.smithi141.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fdf4a63f450] 2023-11-04T01:44:27.041 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:44:27.041 INFO:tasks.ceph.mds.b.smithi141.stderr: 0> 2023-11-04T01:44:27.027+0000 7fdf453f4640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:27.041 INFO:tasks.ceph.mds.b.smithi141.stderr: in thread 7fdf453f4640 thread_name:ms_dispatch 2023-11-04T01:44:27.041 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:44:27.041 INFO:tasks.ceph.mds.b.smithi141.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:27.041 INFO:tasks.ceph.mds.b.smithi141.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fdf4a654db0] 2023-11-04T01:44:27.041 INFO:tasks.ceph.mds.b.smithi141.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fdf4a6a154c] 2023-11-04T01:44:27.041 INFO:tasks.ceph.mds.b.smithi141.stderr: 3: raise() 2023-11-04T01:44:27.041 INFO:tasks.ceph.mds.b.smithi141.stderr: 4: abort() 2023-11-04T01:44:27.041 INFO:tasks.ceph.mds.b.smithi141.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdf4af6f009] 2023-11-04T01:44:27.041 INFO:tasks.ceph.mds.b.smithi141.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fdf4af6f16d] 2023-11-04T01:44:27.042 INFO:tasks.ceph.mds.b.smithi141.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55ae168d11b7] 2023-11-04T01:44:27.042 INFO:tasks.ceph.mds.b.smithi141.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55ae1665ed15] 2023-11-04T01:44:27.042 INFO:tasks.ceph.mds.b.smithi141.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55ae16660b2b] 2023-11-04T01:44:27.042 INFO:tasks.ceph.mds.b.smithi141.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae1666101c] 2023-11-04T01:44:27.042 INFO:tasks.ceph.mds.b.smithi141.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55ae1664a325] 2023-11-04T01:44:27.042 INFO:tasks.ceph.mds.b.smithi141.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7fdf4b15ff9a] 2023-11-04T01:44:27.042 INFO:tasks.ceph.mds.b.smithi141.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7fdf4b1f1741] 2023-11-04T01:44:27.042 INFO:tasks.ceph.mds.b.smithi141.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7fdf4a69f802] 2023-11-04T01:44:27.042 INFO:tasks.ceph.mds.b.smithi141.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7fdf4a63f450] 2023-11-04T01:44:27.042 INFO:tasks.ceph.mds.b.smithi141.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:27.043 INFO:tasks.ceph.mds.b.smithi141.stderr: 2023-11-04T01:44:27.159 INFO:teuthology.orchestra.run.smithi114.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:44:27.160 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:44:27.160 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:27.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.258+0000 7f871df89640 1 Processor -- start 2023-11-04T01:44:27.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.258+0000 7f871df89640 1 -- start start 2023-11-04T01:44:27.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f871df89640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f8718159e40 0x7f87180b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f871df89640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8718071500 con 0x7f8718070700 2023-11-04T01:44:27.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f871df89640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871815dae0 con 0x7f871806bb60 2023-11-04T01:44:27.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f871df89640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8718070c60 con 0x7f8718159e40 2023-11-04T01:44:27.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f8717fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8718070700 0x7f87180cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43624/0 (socket says 172.21.15.114:43624) 2023-11-04T01:44:27.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f8717fff640 1 -- 172.21.15.114:0/1440288131 learned_addr learned my addr 172.21.15.114:0/1440288131 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:27.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f87177fe640 1 --2- 172.21.15.114:0/1440288131 >> v2:172.21.15.141:3300/0 conn(0x7f8718159e40 0x7f87180b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f87167fc640 1 -- 172.21.15.114:0/1440288131 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658673294 0 0) 0x7f8718071500 con 0x7f8718070700 2023-11-04T01:44:27.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f87167fc640 1 -- 172.21.15.114:0/1440288131 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8700003520 con 0x7f8718070700 2023-11-04T01:44:27.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f87167fc640 1 -- 172.21.15.114:0/1440288131 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 968679998 0 0) 0x7f8700003520 con 0x7f8718070700 2023-11-04T01:44:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f87167fc640 1 -- 172.21.15.114:0/1440288131 >> v2:172.21.15.141:3300/0 conn(0x7f8718159e40 msgr2=0x7f87180b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f87167fc640 1 --2- 172.21.15.114:0/1440288131 >> v2:172.21.15.141:3300/0 conn(0x7f8718159e40 0x7f87180b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f87167fc640 1 -- 172.21.15.114:0/1440288131 >> v1:172.21.15.141:6789/0 conn(0x7f871806bb60 legacy=0x7f871806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f87167fc640 1 -- 172.21.15.114:0/1440288131 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8718070f40 con 0x7f8718070700 2023-11-04T01:44:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f87167fc640 1 -- 172.21.15.114:0/1440288131 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f87100019f0 con 0x7f8718070700 2023-11-04T01:44:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f87167fc640 1 -- 172.21.15.114:0/1440288131 >> v1:172.21.15.114:6789/0 conn(0x7f8718070700 legacy=0x7f87180cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f87167fc640 1 --2- 172.21.15.114:0/1440288131 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8700003970 0x7f8700003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f87167fc640 1 --2- 172.21.15.114:0/1440288131 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87000047c0 0x7f8700004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f87167fc640 1 --2- 172.21.15.114:0/1440288131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87000052a0 0x7f870000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f87167fc640 1 -- 172.21.15.114:0/1440288131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8718070c60 con 0x7f87000052a0 2023-11-04T01:44:27.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f87167fc640 1 -- 172.21.15.114:0/1440288131 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870000c170 con 0x7f8700003970 2023-11-04T01:44:27.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.259+0000 7f87167fc640 1 -- 172.21.15.114:0/1440288131 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870000c330 con 0x7f87000047c0 2023-11-04T01:44:27.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.260+0000 7f8717fff640 1 --2- 172.21.15.114:0/1440288131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87000052a0 0x7f870000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.260+0000 7f87177fe640 1 --2- 172.21.15.114:0/1440288131 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8700003970 0x7f8700003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.260+0000 7f8716ffd640 1 --2- 172.21.15.114:0/1440288131 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87000047c0 0x7f8700004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.260+0000 7f8717fff640 1 -- 172.21.15.114:0/1440288131 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87000047c0 msgr2=0x7f8700004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.260+0000 7f8717fff640 1 --2- 172.21.15.114:0/1440288131 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87000047c0 0x7f8700004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.260+0000 7f8717fff640 1 -- 172.21.15.114:0/1440288131 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8700003970 msgr2=0x7f8700003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.260+0000 7f8717fff640 1 --2- 172.21.15.114:0/1440288131 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8700003970 0x7f8700003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.260+0000 7f8717fff640 1 -- 172.21.15.114:0/1440288131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8700003520 con 0x7f87000052a0 2023-11-04T01:44:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.260+0000 7f8717fff640 1 -- 172.21.15.114:0/1440288131 reap_dead start 2023-11-04T01:44:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.260+0000 7f8717fff640 1 --2- 172.21.15.114:0/1440288131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87000052a0 0x7f870000b980 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f871000a800 tx=0x7f87000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2212c9db76ba108d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.261+0000 7f87167fc640 1 -- 172.21.15.114:0/1440288131 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87100072d0 con 0x7f87000052a0 2023-11-04T01:44:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.261+0000 7f87167fc640 1 -- 172.21.15.114:0/1440288131 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871002f070 con 0x7f87000052a0 2023-11-04T01:44:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.261+0000 7f87167fc640 1 -- 172.21.15.114:0/1440288131 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710007670 con 0x7f87000052a0 2023-11-04T01:44:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.261+0000 7f871df89640 1 -- 172.21.15.114:0/1440288131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87000052a0 msgr2=0x7f870000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.261+0000 7f871df89640 1 --2- 172.21.15.114:0/1440288131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87000052a0 0x7f870000b980 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f871000a800 tx=0x7f87000057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.261+0000 7f871df89640 1 -- 172.21.15.114:0/1440288131 shutdown_connections 2023-11-04T01:44:27.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.261+0000 7f871df89640 1 --2- 172.21.15.114:0/1440288131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87000052a0 0x7f870000b980 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.261+0000 7f871df89640 1 -- 172.21.15.114:0/1440288131 >> 172.21.15.114:0/1440288131 conn(0x7f87180cb530 msgr2=0x7f87180cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:27.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.261+0000 7f871df89640 1 -- 172.21.15.114:0/1440288131 shutdown_connections 2023-11-04T01:44:27.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.261+0000 7f871df89640 1 -- 172.21.15.114:0/1440288131 wait complete. 2023-11-04T01:44:27.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.262+0000 7f871df89640 1 Processor -- start 2023-11-04T01:44:27.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.263+0000 7f871df89640 1 -- start start 2023-11-04T01:44:27.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.263+0000 7f871df89640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87000052a0 0x7f871815aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.263+0000 7f871df89640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8718157100 0x7f8718144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.263+0000 7f871df89640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f871806c1d0 0x7f871806c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.263+0000 7f871df89640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87180c1b70 con 0x7f87000052a0 2023-11-04T01:44:27.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.263+0000 7f871df89640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871806cb90 con 0x7f871806c1d0 2023-11-04T01:44:27.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.263+0000 7f871df89640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8718146e60 con 0x7f8718157100 2023-11-04T01:44:27.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.263+0000 7f87177fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87000052a0 0x7f871815aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.263+0000 7f87177fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87000052a0 0x7f871815aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33226/0 (socket says 172.21.15.114:33226) 2023-11-04T01:44:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.263+0000 7f87177fe640 1 -- 172.21.15.114:0/2171366377 learned_addr learned my addr 172.21.15.114:0/2171366377 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.263+0000 7f8716ffd640 1 --2- 172.21.15.114:0/2171366377 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8718157100 0x7f8718144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.263+0000 7f8717fff640 1 --2- 172.21.15.114:0/2171366377 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f871806c1d0 0x7f871806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.264+0000 7f87177fe640 1 -- 172.21.15.114:0/2171366377 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8718157100 msgr2=0x7f8718144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.264+0000 7f87177fe640 1 --2- 172.21.15.114:0/2171366377 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8718157100 0x7f8718144dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.264+0000 7f87177fe640 1 -- 172.21.15.114:0/2171366377 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f871806c1d0 msgr2=0x7f871806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.264+0000 7f87177fe640 1 --2- 172.21.15.114:0/2171366377 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f871806c1d0 0x7f871806c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.264+0000 7f87177fe640 1 -- 172.21.15.114:0/2171366377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871815af40 con 0x7f87000052a0 2023-11-04T01:44:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.264+0000 7f8717fff640 1 --2- 172.21.15.114:0/2171366377 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f871806c1d0 0x7f871806c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:27.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.264+0000 7f87177fe640 1 --2- 172.21.15.114:0/2171366377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87000052a0 0x7f871815aa00 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f87080118e0 tx=0x7f8708011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.264+0000 7f86fffff640 1 -- 172.21.15.114:0/2171366377 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870800faf0 con 0x7f87000052a0 2023-11-04T01:44:27.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.264+0000 7f86fffff640 1 -- 172.21.15.114:0/2171366377 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870800fc50 con 0x7f87000052a0 2023-11-04T01:44:27.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.264+0000 7f871df89640 1 -- 172.21.15.114:0/2171366377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871815c810 con 0x7f87000052a0 2023-11-04T01:44:27.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.264+0000 7f86fffff640 1 -- 172.21.15.114:0/2171366377 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708014440 con 0x7f87000052a0 2023-11-04T01:44:27.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.264+0000 7f871df89640 1 -- 172.21.15.114:0/2171366377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871815cdd0 con 0x7f87000052a0 2023-11-04T01:44:27.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.265+0000 7f871df89640 1 -- 172.21.15.114:0/2171366377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87180684b0 con 0x7f87000052a0 2023-11-04T01:44:27.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.265+0000 7f86fffff640 1 -- 172.21.15.114:0/2171366377 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87080145a0 con 0x7f87000052a0 2023-11-04T01:44:27.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.266+0000 7f86fffff640 1 --2- 172.21.15.114:0/2171366377 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f870406ae60 0x7f870406d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.266+0000 7f86fffff640 1 -- 172.21.15.114:0/2171366377 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f870808a8c0 con 0x7f87000052a0 2023-11-04T01:44:27.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.266+0000 7f8716ffd640 1 --2- 172.21.15.114:0/2171366377 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f870406ae60 0x7f870406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.266+0000 7f8716ffd640 1 --2- 172.21.15.114:0/2171366377 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f870406ae60 0x7f870406d320 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f870c000c00 tx=0x7f870c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.270+0000 7f86fffff640 1 -- 172.21.15.114:0/2171366377 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8708054fd0 con 0x7f87000052a0 2023-11-04T01:44:27.277 INFO:tasks.ceph.mds.b.smithi141.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:44:27.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.469+0000 7f871df89640 1 -- 172.21.15.114:0/2171366377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87180c9750 con 0x7f87000052a0 2023-11-04T01:44:27.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.470+0000 7f86fffff640 1 -- 172.21.15.114:0/2171366377 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4949 (secure 0 0 0) 0x7f87080585f0 con 0x7f87000052a0 2023-11-04T01:44:27.472 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:27.472 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":116,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2540656643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2540656643},{"type":"v1","addr":"172.21.15.114:6835","nonce":2540656643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:26.802383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":7063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7063":{"gid":7063,"name":"b","rank":1,"incarnation":111,"state":"up:active","state_seq":7,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:active","state_seq":18,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:27.472 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 116 2023-11-04T01:44:27.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.472+0000 7f871df89640 1 -- 172.21.15.114:0/2171366377 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f870406ae60 msgr2=0x7f870406d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.472+0000 7f871df89640 1 --2- 172.21.15.114:0/2171366377 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f870406ae60 0x7f870406d320 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f870c000c00 tx=0x7f870c009040 comp rx=0 tx=0).stop 2023-11-04T01:44:27.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.472+0000 7f871df89640 1 -- 172.21.15.114:0/2171366377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87000052a0 msgr2=0x7f871815aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.472+0000 7f871df89640 1 --2- 172.21.15.114:0/2171366377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87000052a0 0x7f871815aa00 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f87080118e0 tx=0x7f8708011da0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.472+0000 7f871df89640 1 -- 172.21.15.114:0/2171366377 shutdown_connections 2023-11-04T01:44:27.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.472+0000 7f871df89640 1 --2- 172.21.15.114:0/2171366377 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f870406ae60 0x7f870406d320 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.472+0000 7f871df89640 1 --2- 172.21.15.114:0/2171366377 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f871806c1d0 0x7f871806c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.472+0000 7f871df89640 1 --2- 172.21.15.114:0/2171366377 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8718157100 0x7f8718144dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.472+0000 7f871df89640 1 --2- 172.21.15.114:0/2171366377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87000052a0 0x7f871815aa00 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.472+0000 7f871df89640 1 -- 172.21.15.114:0/2171366377 >> 172.21.15.114:0/2171366377 conn(0x7f87180cb530 msgr2=0x7f87180aea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:27.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.472+0000 7f871df89640 1 -- 172.21.15.114:0/2171366377 shutdown_connections 2023-11-04T01:44:27.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:27.472+0000 7f871df89640 1 -- 172.21.15.114:0/2171366377 wait complete. 2023-11-04T01:44:27.484 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:31.532 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-04T01:44:32.485 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:32.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.594+0000 7f7de59a9640 1 Processor -- start 2023-11-04T01:44:32.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.594+0000 7f7de59a9640 1 -- start start 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.595+0000 7f7de59a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7de015d100 0x7f7de00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.595+0000 7f7de59a9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de00b32b0 con 0x7f7de00d1be0 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.595+0000 7f7de59a9640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de00cee10 con 0x7f7de015d4e0 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.595+0000 7f7de59a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de00b2980 con 0x7f7de015d100 2023-11-04T01:44:32.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.595+0000 7f7ddf7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7de00d1be0 0x7f7de00b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43638/0 (socket says 172.21.15.114:43638) 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.595+0000 7f7ddf7fe640 1 -- 172.21.15.114:0/285006058 learned_addr learned my addr 172.21.15.114:0/285006058 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.595+0000 7f7ddeffd640 1 --2- 172.21.15.114:0/285006058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7de015d100 0x7f7de00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.595+0000 7f7dde7fc640 1 -- 172.21.15.114:0/285006058 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091355946 0 0) 0x7f7de00b32b0 con 0x7f7de00d1be0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.595+0000 7f7dde7fc640 1 -- 172.21.15.114:0/285006058 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dcc003520 con 0x7f7de00d1be0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.595+0000 7f7dde7fc640 1 -- 172.21.15.114:0/285006058 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1364107390 0 0) 0x7f7dcc003520 con 0x7f7de00d1be0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.595+0000 7f7dde7fc640 1 -- 172.21.15.114:0/285006058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7de015d100 msgr2=0x7f7de00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.595+0000 7f7dde7fc640 1 --2- 172.21.15.114:0/285006058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7de015d100 0x7f7de00ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.595+0000 7f7dde7fc640 1 -- 172.21.15.114:0/285006058 >> v1:172.21.15.141:6789/0 conn(0x7f7de015d4e0 legacy=0x7f7de00d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.595+0000 7f7dde7fc640 1 -- 172.21.15.114:0/285006058 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de00b2c60 con 0x7f7de00d1be0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.595+0000 7f7dde7fc640 1 -- 172.21.15.114:0/285006058 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f7dd80019f0 con 0x7f7de00d1be0 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.595+0000 7f7dde7fc640 1 -- 172.21.15.114:0/285006058 >> v1:172.21.15.114:6789/0 conn(0x7f7de00d1be0 legacy=0x7f7de00b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.596+0000 7f7dde7fc640 1 --2- 172.21.15.114:0/285006058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7de015d100 0x7f7dcc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.596+0000 7f7dde7fc640 1 --2- 172.21.15.114:0/285006058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dcc003ee0 0x7f7dcc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.596+0000 7f7dde7fc640 1 --2- 172.21.15.114:0/285006058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dcc004d00 0x7f7dcc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.596+0000 7f7dde7fc640 1 -- 172.21.15.114:0/285006058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de00b2980 con 0x7f7dcc003ee0 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.596+0000 7f7dde7fc640 1 -- 172.21.15.114:0/285006058 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc00b9e0 con 0x7f7dcc004d00 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.596+0000 7f7dde7fc640 1 -- 172.21.15.114:0/285006058 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc00bba0 con 0x7f7de015d100 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.596+0000 7f7dd7fff640 1 --2- 172.21.15.114:0/285006058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dcc003ee0 0x7f7dcc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.596+0000 7f7ddeffd640 1 --2- 172.21.15.114:0/285006058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7de015d100 0x7f7dcc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.596+0000 7f7ddf7fe640 1 --2- 172.21.15.114:0/285006058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dcc004d00 0x7f7dcc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.596+0000 7f7dd7fff640 1 -- 172.21.15.114:0/285006058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7de015d100 msgr2=0x7f7dcc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.596+0000 7f7dd7fff640 1 --2- 172.21.15.114:0/285006058 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7de015d100 0x7f7dcc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.596+0000 7f7dd7fff640 1 -- 172.21.15.114:0/285006058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dcc004d00 msgr2=0x7f7dcc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.596+0000 7f7dd7fff640 1 --2- 172.21.15.114:0/285006058 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dcc004d00 0x7f7dcc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.596+0000 7f7dd7fff640 1 -- 172.21.15.114:0/285006058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc003520 con 0x7f7dcc003ee0 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.597+0000 7f7dd7fff640 1 --2- 172.21.15.114:0/285006058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dcc003ee0 0x7f7dcc0047c0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8001860 tx=0x7f7dcc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc36f3392688fd9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.597+0000 7f7dde7fc640 1 -- 172.21.15.114:0/285006058 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8032600 con 0x7f7dcc003ee0 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.597+0000 7f7dde7fc640 1 -- 172.21.15.114:0/285006058 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc802e050 con 0x7f7dcc003ee0 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.597+0000 7f7dde7fc640 1 -- 172.21.15.114:0/285006058 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80329c0 con 0x7f7dcc003ee0 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.597+0000 7f7de59a9640 1 -- 172.21.15.114:0/285006058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dcc003ee0 msgr2=0x7f7dcc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.597+0000 7f7de59a9640 1 --2- 172.21.15.114:0/285006058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dcc003ee0 0x7f7dcc0047c0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8001860 tx=0x7f7dcc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.597+0000 7f7ddf7fe640 1 -- 172.21.15.114:0/285006058 reap_dead start 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.597+0000 7f7de59a9640 1 -- 172.21.15.114:0/285006058 shutdown_connections 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.597+0000 7f7de59a9640 1 -- 172.21.15.114:0/285006058 >> 172.21.15.114:0/285006058 conn(0x7f7de00d2ef0 msgr2=0x7f7de00d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.598+0000 7f7de59a9640 1 -- 172.21.15.114:0/285006058 shutdown_connections 2023-11-04T01:44:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.598+0000 7f7de59a9640 1 -- 172.21.15.114:0/285006058 wait complete. 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.599+0000 7f7de59a9640 1 Processor -- start 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.599+0000 7f7de59a9640 1 -- start start 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.599+0000 7f7de59a9640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dcc003ee0 0x7f7de015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.599+0000 7f7de59a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7de01f2800 0x7f7de009cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.599+0000 7f7de59a9640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7de01f2c80 0x7f7de009d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.599+0000 7f7de59a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de015bf10 con 0x7f7de01f2800 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.599+0000 7f7de59a9640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de009d800 con 0x7f7dcc003ee0 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.599+0000 7f7de59a9640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de009dae0 con 0x7f7de01f2c80 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.600+0000 7f7dd7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7de01f2800 0x7f7de009cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.600+0000 7f7dd7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7de01f2800 0x7f7de009cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33240/0 (socket says 172.21.15.114:33240) 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.600+0000 7f7dd7fff640 1 -- 172.21.15.114:0/1083619650 learned_addr learned my addr 172.21.15.114:0/1083619650 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.600+0000 7f7ddeffd640 1 --2- 172.21.15.114:0/1083619650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dcc003ee0 0x7f7de015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.600+0000 7f7ddf7fe640 1 --2- 172.21.15.114:0/1083619650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7de01f2c80 0x7f7de009d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.600+0000 7f7dd7fff640 1 -- 172.21.15.114:0/1083619650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7de01f2c80 msgr2=0x7f7de009d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.600+0000 7f7dd7fff640 1 --2- 172.21.15.114:0/1083619650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7de01f2c80 0x7f7de009d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.600+0000 7f7dd7fff640 1 -- 172.21.15.114:0/1083619650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dcc003ee0 msgr2=0x7f7de015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.600+0000 7f7dd7fff640 1 --2- 172.21.15.114:0/1083619650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dcc003ee0 0x7f7de015b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.600+0000 7f7dd7fff640 1 -- 172.21.15.114:0/1083619650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de009ddc0 con 0x7f7de01f2800 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.600+0000 7f7dd7fff640 1 --2- 172.21.15.114:0/1083619650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7de01f2800 0x7f7de009cc90 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8008fd0 tx=0x7f7dc8001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.600+0000 7f7ddcff9640 1 -- 172.21.15.114:0/1083619650 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8007050 con 0x7f7de01f2800 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.600+0000 7f7ddcff9640 1 -- 172.21.15.114:0/1083619650 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc80071b0 con 0x7f7de01f2800 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.600+0000 7f7de59a9640 1 -- 172.21.15.114:0/1083619650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de009e0a0 con 0x7f7de01f2800 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.600+0000 7f7ddcff9640 1 -- 172.21.15.114:0/1083619650 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8007540 con 0x7f7de01f2800 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.600+0000 7f7de59a9640 1 -- 172.21.15.114:0/1083619650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de00b20c0 con 0x7f7de01f2800 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.601+0000 7f7de59a9640 1 -- 172.21.15.114:0/1083619650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de00684b0 con 0x7f7de01f2800 2023-11-04T01:44:32.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.602+0000 7f7ddcff9640 1 -- 172.21.15.114:0/1083619650 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7dc80067d0 con 0x7f7de01f2800 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.602+0000 7f7ddcff9640 1 --2- 172.21.15.114:0/1083619650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7dc006aea0 0x7f7dc006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.602+0000 7f7ddcff9640 1 -- 172.21.15.114:0/1083619650 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8223+0+0 (secure 0 0 0) 0x7f7dc80ac0e0 con 0x7f7de01f2800 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.602+0000 7f7ddeffd640 1 --2- 172.21.15.114:0/1083619650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7dc006aea0 0x7f7dc006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.602+0000 7f7ddeffd640 1 --2- 172.21.15.114:0/1083619650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7dc006aea0 0x7f7dc006d360 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00099f0 tx=0x7f7dd0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:32.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.606+0000 7f7ddcff9640 1 -- 172.21.15.114:0/1083619650 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7dc8076800 con 0x7f7de01f2800 2023-11-04T01:44:32.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.814+0000 7f7de59a9640 1 -- 172.21.15.114:0/1083619650 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7de00d2cd0 con 0x7f7de01f2800 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.814+0000 7f7ddcff9640 1 -- 172.21.15.114:0/1083619650 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4949 (secure 0 0 0) 0x7f7dc804a090 con 0x7f7de01f2800 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":116,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2540656643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2540656643},{"type":"v1","addr":"172.21.15.114:6835","nonce":2540656643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:26.802383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":7063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7063":{"gid":7063,"name":"b","rank":1,"incarnation":111,"state":"up:active","state_seq":7,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:active","state_seq":18,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:32.816 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 116 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.816+0000 7f7de59a9640 1 -- 172.21.15.114:0/1083619650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7dc006aea0 msgr2=0x7f7dc006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.816+0000 7f7de59a9640 1 --2- 172.21.15.114:0/1083619650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7dc006aea0 0x7f7dc006d360 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00099f0 tx=0x7f7dd0008040 comp rx=0 tx=0).stop 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.816+0000 7f7de59a9640 1 -- 172.21.15.114:0/1083619650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7de01f2800 msgr2=0x7f7de009cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.816+0000 7f7de59a9640 1 --2- 172.21.15.114:0/1083619650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7de01f2800 0x7f7de009cc90 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8008fd0 tx=0x7f7dc8001230 comp rx=0 tx=0).stop 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.816+0000 7f7de59a9640 1 -- 172.21.15.114:0/1083619650 shutdown_connections 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.816+0000 7f7de59a9640 1 --2- 172.21.15.114:0/1083619650 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f7de01f2c80 0x7f7de009d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.816+0000 7f7de59a9640 1 --2- 172.21.15.114:0/1083619650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7de01f2800 0x7f7de009cc90 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.816+0000 7f7de59a9640 1 --2- 172.21.15.114:0/1083619650 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f7dc006aea0 0x7f7dc006d360 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.816+0000 7f7de59a9640 1 --2- 172.21.15.114:0/1083619650 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f7dcc003ee0 0x7f7de015b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.816+0000 7f7de59a9640 1 -- 172.21.15.114:0/1083619650 >> 172.21.15.114:0/1083619650 conn(0x7f7de00d2ef0 msgr2=0x7f7de00c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.816+0000 7f7de59a9640 1 -- 172.21.15.114:0/1083619650 shutdown_connections 2023-11-04T01:44:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:32.816+0000 7f7de59a9640 1 -- 172.21.15.114:0/1083619650 wait complete. 2023-11-04T01:44:32.829 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:37.830 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:37.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.941+0000 7f2fe3a4f640 1 Processor -- start 2023-11-04T01:44:37.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.941+0000 7f2fe3a4f640 1 -- start start 2023-11-04T01:44:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.942+0000 7f2fe3a4f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2fdc0addd0 0x7f2fdc0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.942+0000 7f2fe3a4f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2fdc0cc680 0x7f2fdc0ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.942+0000 7f2fe3a4f640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc0cd720 con 0x7f2fdc06bb10 2023-11-04T01:44:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.942+0000 7f2fe3a4f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fdc0ae1b0 con 0x7f2fdc0cc680 2023-11-04T01:44:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.942+0000 7f2fe3a4f640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fdc0ccb10 con 0x7f2fdc0addd0 2023-11-04T01:44:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.942+0000 7f2fe0fea640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2fdc0cc680 0x7f2fdc0ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.942+0000 7f2fe0fea640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2fdc0cc680 0x7f2fdc0ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60008/0 (socket says 172.21.15.114:60008) 2023-11-04T01:44:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.942+0000 7f2fe0fea640 1 -- 172.21.15.114:0/311079788 learned_addr learned my addr 172.21.15.114:0/311079788 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.943+0000 7f2fe0fea640 1 -- 172.21.15.114:0/311079788 >> v2:172.21.15.141:3300/0 conn(0x7f2fdc0addd0 msgr2=0x7f2fdc0cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.943+0000 7f2fe0fea640 1 --2- 172.21.15.114:0/311079788 >> v2:172.21.15.141:3300/0 conn(0x7f2fdc0addd0 0x7f2fdc0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.943+0000 7f2fe0fea640 1 -- 172.21.15.114:0/311079788 >> v1:172.21.15.141:6789/0 conn(0x7f2fdc06bb10 legacy=0x7f2fdc06bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.943+0000 7f2fe0fea640 1 -- 172.21.15.114:0/311079788 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc0ccdf0 con 0x7f2fdc0cc680 2023-11-04T01:44:37.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.943+0000 7f2fe0fea640 1 --2- 172.21.15.114:0/311079788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0cc680 0x7f2fdc0ca2d0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0cc630 tx=0x7f2fcc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c1abb042d95ac1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:37.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.943+0000 7f2fd3fff640 1 -- 172.21.15.114:0/311079788 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc031870 con 0x7f2fdc0cc680 2023-11-04T01:44:37.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.943+0000 7f2fd3fff640 1 -- 172.21.15.114:0/311079788 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc0319d0 con 0x7f2fdc0cc680 2023-11-04T01:44:37.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.943+0000 7f2fd3fff640 1 -- 172.21.15.114:0/311079788 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc031d60 con 0x7f2fdc0cc680 2023-11-04T01:44:37.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.944+0000 7f2fe3a4f640 1 -- 172.21.15.114:0/311079788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0cc680 msgr2=0x7f2fdc0ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:37.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.944+0000 7f2fe3a4f640 1 --2- 172.21.15.114:0/311079788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0cc680 0x7f2fdc0ca2d0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0cc630 tx=0x7f2fcc02b910 comp rx=0 tx=0).stop 2023-11-04T01:44:37.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.944+0000 7f2fe3a4f640 1 -- 172.21.15.114:0/311079788 shutdown_connections 2023-11-04T01:44:37.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.944+0000 7f2fe3a4f640 1 --2- 172.21.15.114:0/311079788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0cc680 0x7f2fdc0ca2d0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:37.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.944+0000 7f2fe3a4f640 1 --2- 172.21.15.114:0/311079788 >> v2:172.21.15.141:3300/0 conn(0x7f2fdc0addd0 0x7f2fdc0cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:37.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.944+0000 7f2fe3a4f640 1 -- 172.21.15.114:0/311079788 >> 172.21.15.114:0/311079788 conn(0x7f2fdc0cb530 msgr2=0x7f2fdc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:37.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.944+0000 7f2fe3a4f640 1 -- 172.21.15.114:0/311079788 shutdown_connections 2023-11-04T01:44:37.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.944+0000 7f2fe3a4f640 1 -- 172.21.15.114:0/311079788 wait complete. 2023-11-04T01:44:37.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.945+0000 7f2fe3a4f640 1 Processor -- start 2023-11-04T01:44:37.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.945+0000 7f2fe3a4f640 1 -- start start 2023-11-04T01:44:37.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.946+0000 7f2fe3a4f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fdc06bb10 0x7f2fdc0c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:37.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.946+0000 7f2fe3a4f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0addd0 0x7f2fdc0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.946+0000 7f2fe3a4f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fdc155b70 0x7f2fdc0c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.946+0000 7f2fe3a4f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0c49a0 con 0x7f2fdc0addd0 2023-11-04T01:44:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.946+0000 7f2fe3a4f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0c2b00 con 0x7f2fdc06bb10 2023-11-04T01:44:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.946+0000 7f2fe3a4f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0c89a0 con 0x7f2fdc155b70 2023-11-04T01:44:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.946+0000 7f2fe0fea640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0addd0 0x7f2fdc0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.946+0000 7f2fe0fea640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0addd0 0x7f2fdc0c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60016/0 (socket says 172.21.15.114:60016) 2023-11-04T01:44:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.946+0000 7f2fe0fea640 1 -- 172.21.15.114:0/1117407148 learned_addr learned my addr 172.21.15.114:0/1117407148 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.946+0000 7f2fe17eb640 1 --2- 172.21.15.114:0/1117407148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fdc06bb10 0x7f2fdc0c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.946+0000 7f2fe1fec640 1 --2- 172.21.15.114:0/1117407148 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fdc155b70 0x7f2fdc0c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.946+0000 7f2fe0fea640 1 -- 172.21.15.114:0/1117407148 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fdc155b70 msgr2=0x7f2fdc0c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.946+0000 7f2fe0fea640 1 --2- 172.21.15.114:0/1117407148 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fdc155b70 0x7f2fdc0c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.947+0000 7f2fe0fea640 1 -- 172.21.15.114:0/1117407148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fdc06bb10 msgr2=0x7f2fdc0c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.947+0000 7f2fe0fea640 1 --2- 172.21.15.114:0/1117407148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fdc06bb10 0x7f2fdc0c25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.947+0000 7f2fe0fea640 1 -- 172.21.15.114:0/1117407148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc0094d0 con 0x7f2fdc0addd0 2023-11-04T01:44:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.947+0000 7f2fe0fea640 1 --2- 172.21.15.114:0/1117407148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0addd0 0x7f2fdc0c5b80 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc000c00 tx=0x7f2fcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.947+0000 7f2fd1ffb640 1 -- 172.21.15.114:0/1117407148 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc03ad10 con 0x7f2fdc0addd0 2023-11-04T01:44:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.947+0000 7f2fd1ffb640 1 -- 172.21.15.114:0/1117407148 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc03ae70 con 0x7f2fdc0addd0 2023-11-04T01:44:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.947+0000 7f2fe3a4f640 1 -- 172.21.15.114:0/1117407148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fdc15a8f0 con 0x7f2fdc0addd0 2023-11-04T01:44:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.947+0000 7f2fd1ffb640 1 -- 172.21.15.114:0/1117407148 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc044610 con 0x7f2fdc0addd0 2023-11-04T01:44:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.947+0000 7f2fe3a4f640 1 -- 172.21.15.114:0/1117407148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fdc15aeb0 con 0x7f2fdc0addd0 2023-11-04T01:44:37.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.948+0000 7f2fe3a4f640 1 -- 172.21.15.114:0/1117407148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fdc0684b0 con 0x7f2fdc0addd0 2023-11-04T01:44:37.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.948+0000 7f2fd1ffb640 1 -- 172.21.15.114:0/1117407148 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2fcc04d450 con 0x7f2fdc0addd0 2023-11-04T01:44:37.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.949+0000 7f2fd1ffb640 1 --2- 172.21.15.114:0/1117407148 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2fc006ae70 0x7f2fc006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:37.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.949+0000 7f2fd1ffb640 1 -- 172.21.15.114:0/1117407148 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f2fcc02d040 con 0x7f2fdc0addd0 2023-11-04T01:44:37.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.949+0000 7f2fe17eb640 1 --2- 172.21.15.114:0/1117407148 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2fc006ae70 0x7f2fc006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:37.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.949+0000 7f2fe17eb640 1 --2- 172.21.15.114:0/1117407148 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2fc006ae70 0x7f2fc006d330 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009f20 tx=0x7f2fd80094f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:37.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:37.953+0000 7f2fd1ffb640 1 -- 172.21.15.114:0/1117407148 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2fcc076d80 con 0x7f2fdc0addd0 2023-11-04T01:44:38.143 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2023-11-04T01:44:38.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:38.153+0000 7f2fe3a4f640 1 -- 172.21.15.114:0/1117407148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fdc15cb00 con 0x7f2fdc0addd0 2023-11-04T01:44:38.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:38.153+0000 7f2fd1ffb640 1 -- 172.21.15.114:0/1117407148 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4949 (secure 0 0 0) 0x7f2fcc07a3a0 con 0x7f2fdc0addd0 2023-11-04T01:44:38.155 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:38.155 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":116,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2540656643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2540656643},{"type":"v1","addr":"172.21.15.114:6835","nonce":2540656643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:26.802383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":7063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7063":{"gid":7063,"name":"b","rank":1,"incarnation":111,"state":"up:active","state_seq":7,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:active","state_seq":18,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:38.155 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 116 2023-11-04T01:44:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:38.155+0000 7f2fe3a4f640 1 -- 172.21.15.114:0/1117407148 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2fc006ae70 msgr2=0x7f2fc006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:38.155+0000 7f2fe3a4f640 1 --2- 172.21.15.114:0/1117407148 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2fc006ae70 0x7f2fc006d330 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009f20 tx=0x7f2fd80094f0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:38.155+0000 7f2fe3a4f640 1 -- 172.21.15.114:0/1117407148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0addd0 msgr2=0x7f2fdc0c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:38.155+0000 7f2fe3a4f640 1 --2- 172.21.15.114:0/1117407148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0addd0 0x7f2fdc0c5b80 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc000c00 tx=0x7f2fcc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:38.155+0000 7f2fe3a4f640 1 -- 172.21.15.114:0/1117407148 shutdown_connections 2023-11-04T01:44:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:38.155+0000 7f2fe3a4f640 1 --2- 172.21.15.114:0/1117407148 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2fdc155b70 0x7f2fdc0c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:38.155+0000 7f2fe3a4f640 1 --2- 172.21.15.114:0/1117407148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fdc0addd0 0x7f2fdc0c5b80 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:38.155+0000 7f2fe3a4f640 1 --2- 172.21.15.114:0/1117407148 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2fc006ae70 0x7f2fc006d330 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:38.155+0000 7f2fe3a4f640 1 --2- 172.21.15.114:0/1117407148 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2fdc06bb10 0x7f2fdc0c25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:38.155+0000 7f2fe3a4f640 1 -- 172.21.15.114:0/1117407148 >> 172.21.15.114:0/1117407148 conn(0x7f2fdc0cb530 msgr2=0x7f2fdc0aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:38.155+0000 7f2fe3a4f640 1 -- 172.21.15.114:0/1117407148 shutdown_connections 2023-11-04T01:44:38.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:38.155+0000 7f2fe3a4f640 1 -- 172.21.15.114:0/1117407148 wait complete. 2023-11-04T01:44:38.167 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:43.168 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:43.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.276+0000 7faaf6607640 1 Processor -- start 2023-11-04T01:44:43.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.276+0000 7faaf6607640 1 -- start start 2023-11-04T01:44:43.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.277+0000 7faaf6607640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7faaf01605b0 0x7faaf00ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.277+0000 7faaf6607640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf00c9100 con 0x7faaf00b0c40 2023-11-04T01:44:43.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.277+0000 7faaf6607640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf00ae230 con 0x7faaf006b950 2023-11-04T01:44:43.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.277+0000 7faaf6607640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf00aceb0 con 0x7faaf01605b0 2023-11-04T01:44:43.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.277+0000 7faaf4ba4640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7faaf00b0c40 0x7faaf00c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33380/0 (socket says 172.21.15.114:33380) 2023-11-04T01:44:43.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.277+0000 7faaf4ba4640 1 -- 172.21.15.114:0/2972948003 learned_addr learned my addr 172.21.15.114:0/2972948003 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:43.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.277+0000 7faaeffff640 1 --2- 172.21.15.114:0/2972948003 >> v2:172.21.15.141:3300/0 conn(0x7faaf01605b0 0x7faaf00ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.277+0000 7faaeeffd640 1 -- 172.21.15.114:0/2972948003 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343532111 0 0) 0x7faaf00c9100 con 0x7faaf00b0c40 2023-11-04T01:44:43.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.277+0000 7faaeeffd640 1 -- 172.21.15.114:0/2972948003 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faad8003520 con 0x7faaf00b0c40 2023-11-04T01:44:43.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeeffd640 1 -- 172.21.15.114:0/2972948003 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497407177 0 0) 0x7faaf00ae230 con 0x7faaf006b950 2023-11-04T01:44:43.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeeffd640 1 -- 172.21.15.114:0/2972948003 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaf00c9100 con 0x7faaf006b950 2023-11-04T01:44:43.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeeffd640 1 -- 172.21.15.114:0/2972948003 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3777747488 0 0) 0x7faad8003520 con 0x7faaf00b0c40 2023-11-04T01:44:43.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeeffd640 1 -- 172.21.15.114:0/2972948003 >> v2:172.21.15.141:3300/0 conn(0x7faaf01605b0 msgr2=0x7faaf00ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeeffd640 1 --2- 172.21.15.114:0/2972948003 >> v2:172.21.15.141:3300/0 conn(0x7faaf01605b0 0x7faaf00ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeeffd640 1 -- 172.21.15.114:0/2972948003 >> v1:172.21.15.141:6789/0 conn(0x7faaf006b950 legacy=0x7faaf00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeeffd640 1 -- 172.21.15.114:0/2972948003 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf00ad190 con 0x7faaf00b0c40 2023-11-04T01:44:43.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeeffd640 1 -- 172.21.15.114:0/2972948003 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7faae80019f0 con 0x7faaf00b0c40 2023-11-04T01:44:43.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeffff640 1 --2- 172.21.15.114:0/2972948003 >> v2:172.21.15.141:3300/0 conn(0x7faaf01605b0 0x7faaf00ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:43.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeeffd640 1 -- 172.21.15.114:0/2972948003 >> v1:172.21.15.114:6789/0 conn(0x7faaf00b0c40 legacy=0x7faaf00c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeeffd640 1 --2- 172.21.15.114:0/2972948003 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faad8003b00 0x7faad8003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeeffd640 1 --2- 172.21.15.114:0/2972948003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faad80047c0 0x7faad8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeeffd640 1 --2- 172.21.15.114:0/2972948003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faad8005180 0x7faad800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeeffd640 1 -- 172.21.15.114:0/2972948003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf00aceb0 con 0x7faad8005180 2023-11-04T01:44:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeeffd640 1 -- 172.21.15.114:0/2972948003 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad800c0b0 con 0x7faad8003b00 2023-11-04T01:44:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeeffd640 1 -- 172.21.15.114:0/2972948003 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad800c270 con 0x7faad80047c0 2023-11-04T01:44:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaf4ba4640 1 --2- 172.21.15.114:0/2972948003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faad8005180 0x7faad800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaeffff640 1 --2- 172.21.15.114:0/2972948003 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faad8003b00 0x7faad8003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaef7fe640 1 --2- 172.21.15.114:0/2972948003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faad80047c0 0x7faad8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaf4ba4640 1 -- 172.21.15.114:0/2972948003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faad80047c0 msgr2=0x7faad8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaf4ba4640 1 --2- 172.21.15.114:0/2972948003 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faad80047c0 0x7faad8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaf4ba4640 1 -- 172.21.15.114:0/2972948003 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faad8003b00 msgr2=0x7faad8003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaf4ba4640 1 --2- 172.21.15.114:0/2972948003 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faad8003b00 0x7faad8003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.278+0000 7faaf4ba4640 1 -- 172.21.15.114:0/2972948003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad8003520 con 0x7faad8005180 2023-11-04T01:44:43.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.279+0000 7faaf4ba4640 1 -- 172.21.15.114:0/2972948003 reap_dead start 2023-11-04T01:44:43.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.279+0000 7faaf4ba4640 1 --2- 172.21.15.114:0/2972948003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faad8005180 0x7faad800b980 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7faaf00b12f0 tx=0x7faad80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317555c556cf919f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.279+0000 7faaeeffd640 1 -- 172.21.15.114:0/2972948003 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae8034630 con 0x7faad8005180 2023-11-04T01:44:43.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.279+0000 7faaeeffd640 1 -- 172.21.15.114:0/2972948003 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae802f070 con 0x7faad8005180 2023-11-04T01:44:43.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.279+0000 7faaeeffd640 1 -- 172.21.15.114:0/2972948003 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae80349b0 con 0x7faad8005180 2023-11-04T01:44:43.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.280+0000 7faaf6607640 1 -- 172.21.15.114:0/2972948003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faad8005180 msgr2=0x7faad800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.280+0000 7faaf6607640 1 --2- 172.21.15.114:0/2972948003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faad8005180 0x7faad800b980 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7faaf00b12f0 tx=0x7faad80057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.280+0000 7faaf6607640 1 -- 172.21.15.114:0/2972948003 shutdown_connections 2023-11-04T01:44:43.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.280+0000 7faaf6607640 1 --2- 172.21.15.114:0/2972948003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faad8005180 0x7faad800b980 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.280+0000 7faaf6607640 1 -- 172.21.15.114:0/2972948003 >> 172.21.15.114:0/2972948003 conn(0x7faaf00cb530 msgr2=0x7faaf00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.280+0000 7faaf6607640 1 -- 172.21.15.114:0/2972948003 shutdown_connections 2023-11-04T01:44:43.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.280+0000 7faaf6607640 1 -- 172.21.15.114:0/2972948003 wait complete. 2023-11-04T01:44:43.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.281+0000 7faaf6607640 1 Processor -- start 2023-11-04T01:44:43.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.281+0000 7faaf6607640 1 -- start start 2023-11-04T01:44:43.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaf6607640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faad8005180 0x7faaf00c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaf6607640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf00c8690 0x7faaf00c7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaf6607640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faaf00c76a0 0x7faaf00c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaf6607640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf01f2580 con 0x7faaf00c8690 2023-11-04T01:44:43.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaf6607640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf00c8b10 con 0x7faaf00c76a0 2023-11-04T01:44:43.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaf6607640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf00c8060 con 0x7faad8005180 2023-11-04T01:44:43.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaef7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf00c8690 0x7faaf00c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaef7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf00c8690 0x7faaf00c7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60036/0 (socket says 172.21.15.114:60036) 2023-11-04T01:44:43.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaef7fe640 1 -- 172.21.15.114:0/2881527448 learned_addr learned my addr 172.21.15.114:0/2881527448 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:43.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaeffff640 1 --2- 172.21.15.114:0/2881527448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faad8005180 0x7faaf00c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaf4ba4640 1 --2- 172.21.15.114:0/2881527448 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faaf00c76a0 0x7faaf00c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaef7fe640 1 -- 172.21.15.114:0/2881527448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faad8005180 msgr2=0x7faaf00c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaef7fe640 1 --2- 172.21.15.114:0/2881527448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faad8005180 0x7faaf00c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaef7fe640 1 -- 172.21.15.114:0/2881527448 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faaf00c76a0 msgr2=0x7faaf00c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaef7fe640 1 --2- 172.21.15.114:0/2881527448 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faaf00c76a0 0x7faaf00c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaef7fe640 1 -- 172.21.15.114:0/2881527448 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf00c3ee0 con 0x7faaf00c8690 2023-11-04T01:44:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaeffff640 1 --2- 172.21.15.114:0/2881527448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faad8005180 0x7faaf00c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaf4ba4640 1 --2- 172.21.15.114:0/2881527448 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faaf00c76a0 0x7faaf00c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaef7fe640 1 --2- 172.21.15.114:0/2881527448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf00c8690 0x7faaf00c7160 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7faae400e580 tx=0x7faae400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaecff9640 1 -- 172.21.15.114:0/2881527448 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae40052e0 con 0x7faaf00c8690 2023-11-04T01:44:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaecff9640 1 -- 172.21.15.114:0/2881527448 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae4005440 con 0x7faaf00c8690 2023-11-04T01:44:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.282+0000 7faaecff9640 1 -- 172.21.15.114:0/2881527448 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae4003830 con 0x7faaf00c8690 2023-11-04T01:44:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.283+0000 7faaf6607640 1 -- 172.21.15.114:0/2881527448 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf00c3640 con 0x7faaf00c8690 2023-11-04T01:44:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.283+0000 7faaf6607640 1 -- 172.21.15.114:0/2881527448 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf00c3c00 con 0x7faaf00c8690 2023-11-04T01:44:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.284+0000 7faaf6607640 1 -- 172.21.15.114:0/2881527448 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf0067fb0 con 0x7faaf00c8690 2023-11-04T01:44:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.284+0000 7faaecff9640 1 -- 172.21.15.114:0/2881527448 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faae4003990 con 0x7faaf00c8690 2023-11-04T01:44:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.284+0000 7faaecff9640 1 --2- 172.21.15.114:0/2881527448 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faadc06aea0 0x7faadc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.284+0000 7faaecff9640 1 -- 172.21.15.114:0/2881527448 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7faae4089e40 con 0x7faaf00c8690 2023-11-04T01:44:43.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.284+0000 7faaeffff640 1 --2- 172.21.15.114:0/2881527448 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faadc06aea0 0x7faadc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.285+0000 7faaeffff640 1 --2- 172.21.15.114:0/2881527448 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faadc06aea0 0x7faadc06d360 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7faae0006b10 tx=0x7faae0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.288+0000 7faaecff9640 1 -- 172.21.15.114:0/2881527448 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faae4057f80 con 0x7faaf00c8690 2023-11-04T01:44:43.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.493+0000 7faaf6607640 1 -- 172.21.15.114:0/2881527448 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faaf00684b0 con 0x7faaf00c8690 2023-11-04T01:44:43.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.494+0000 7faaecff9640 1 -- 172.21.15.114:0/2881527448 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4949 (secure 0 0 0) 0x7faae4057b10 con 0x7faaf00c8690 2023-11-04T01:44:43.496 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:43.496 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":116,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2540656643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2540656643},{"type":"v1","addr":"172.21.15.114:6835","nonce":2540656643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:26.802383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":7063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7063":{"gid":7063,"name":"b","rank":1,"incarnation":111,"state":"up:active","state_seq":7,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:active","state_seq":18,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:43.496 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 116 2023-11-04T01:44:43.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.496+0000 7faaf6607640 1 -- 172.21.15.114:0/2881527448 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faadc06aea0 msgr2=0x7faadc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.496+0000 7faaf6607640 1 --2- 172.21.15.114:0/2881527448 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faadc06aea0 0x7faadc06d360 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7faae0006b10 tx=0x7faae0008040 comp rx=0 tx=0).stop 2023-11-04T01:44:43.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.496+0000 7faaf6607640 1 -- 172.21.15.114:0/2881527448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf00c8690 msgr2=0x7faaf00c7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.496+0000 7faaf6607640 1 --2- 172.21.15.114:0/2881527448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf00c8690 0x7faaf00c7160 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7faae400e580 tx=0x7faae400ea40 comp rx=0 tx=0).stop 2023-11-04T01:44:43.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.496+0000 7faaf6607640 1 -- 172.21.15.114:0/2881527448 shutdown_connections 2023-11-04T01:44:43.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.496+0000 7faaf6607640 1 --2- 172.21.15.114:0/2881527448 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faadc06aea0 0x7faadc06d360 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.496+0000 7faaf6607640 1 --2- 172.21.15.114:0/2881527448 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faaf00c76a0 0x7faaf00c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.496+0000 7faaf6607640 1 --2- 172.21.15.114:0/2881527448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf00c8690 0x7faaf00c7160 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.496+0000 7faaf6607640 1 --2- 172.21.15.114:0/2881527448 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faad8005180 0x7faaf00c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.496+0000 7faaf6607640 1 -- 172.21.15.114:0/2881527448 >> 172.21.15.114:0/2881527448 conn(0x7faaf00cb530 msgr2=0x7faaf00cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.496+0000 7faaf6607640 1 -- 172.21.15.114:0/2881527448 shutdown_connections 2023-11-04T01:44:43.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:43.496+0000 7faaf6607640 1 -- 172.21.15.114:0/2881527448 wait complete. 2023-11-04T01:44:43.508 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:44.754 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2023-11-04T01:44:48.509 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:48.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.618+0000 7fdf44183640 1 Processor -- start 2023-11-04T01:44:48.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.618+0000 7fdf44183640 1 -- start start 2023-11-04T01:44:48.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.619+0000 7fdf44183640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fdf3c159e40 0x7fdf3c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.619+0000 7fdf44183640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3c070700 0x7fdf3c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.619+0000 7fdf44183640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf3c071500 con 0x7fdf3c06bb60 2023-11-04T01:44:48.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.619+0000 7fdf44183640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3c15dae0 con 0x7fdf3c159e40 2023-11-04T01:44:48.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.619+0000 7fdf44183640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c070c60 con 0x7fdf3c070700 2023-11-04T01:44:48.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.620+0000 7fdf41f1f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fdf3c159e40 0x7fdf3c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.620+0000 7fdf42720640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3c070700 0x7fdf3c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.620+0000 7fdf4171e640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fdf3c06bb60 0x7fdf3c06fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:43770/0 (socket says 172.21.15.114:43770) 2023-11-04T01:44:48.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.620+0000 7fdf4171e640 1 -- 172.21.15.114:0/3065693053 learned_addr learned my addr 172.21.15.114:0/3065693053 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:48.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.620+0000 7fdf42720640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3c070700 0x7fdf3c0b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:47566/0 (socket says 172.21.15.114:47566) 2023-11-04T01:44:48.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.620+0000 7fdf40f1d640 1 -- 172.21.15.114:0/3065693053 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615112200 0 0) 0x7fdf3c071500 con 0x7fdf3c06bb60 2023-11-04T01:44:48.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.620+0000 7fdf40f1d640 1 -- 172.21.15.114:0/3065693053 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf28003520 con 0x7fdf3c06bb60 2023-11-04T01:44:48.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.620+0000 7fdf42720640 1 -- 172.21.15.114:0/3065693053 >> v2:172.21.15.141:3300/0 conn(0x7fdf3c159e40 msgr2=0x7fdf3c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:48.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.620+0000 7fdf42720640 1 --2- 172.21.15.114:0/3065693053 >> v2:172.21.15.141:3300/0 conn(0x7fdf3c159e40 0x7fdf3c0b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.620+0000 7fdf42720640 1 -- 172.21.15.114:0/3065693053 >> v1:172.21.15.141:6789/0 conn(0x7fdf3c06bb60 legacy=0x7fdf3c06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.620+0000 7fdf42720640 1 -- 172.21.15.114:0/3065693053 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c070f40 con 0x7fdf3c070700 2023-11-04T01:44:48.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.621+0000 7fdf42720640 1 --2- 172.21.15.114:0/3065693053 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3c070700 0x7fdf3c0b0a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009d90 tx=0x7fdf3802be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6c12781eb105e5a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:48.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.621+0000 7fdf40f1d640 1 -- 172.21.15.114:0/3065693053 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3802cbd0 con 0x7fdf3c070700 2023-11-04T01:44:48.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.621+0000 7fdf40f1d640 1 -- 172.21.15.114:0/3065693053 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3802cd30 con 0x7fdf3c070700 2023-11-04T01:44:48.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.621+0000 7fdf40f1d640 1 -- 172.21.15.114:0/3065693053 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3802cea0 con 0x7fdf3c070700 2023-11-04T01:44:48.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.622+0000 7fdf44183640 1 -- 172.21.15.114:0/3065693053 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3c070700 msgr2=0x7fdf3c0b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.622+0000 7fdf44183640 1 --2- 172.21.15.114:0/3065693053 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3c070700 0x7fdf3c0b0a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009d90 tx=0x7fdf3802be20 comp rx=0 tx=0).stop 2023-11-04T01:44:48.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.622+0000 7fdf44183640 1 -- 172.21.15.114:0/3065693053 shutdown_connections 2023-11-04T01:44:48.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.622+0000 7fdf44183640 1 --2- 172.21.15.114:0/3065693053 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3c070700 0x7fdf3c0b0a70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.622+0000 7fdf44183640 1 --2- 172.21.15.114:0/3065693053 >> v2:172.21.15.141:3300/0 conn(0x7fdf3c159e40 0x7fdf3c0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.622+0000 7fdf44183640 1 -- 172.21.15.114:0/3065693053 >> 172.21.15.114:0/3065693053 conn(0x7fdf3c0cb530 msgr2=0x7fdf3c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:48.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.622+0000 7fdf44183640 1 -- 172.21.15.114:0/3065693053 shutdown_connections 2023-11-04T01:44:48.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.622+0000 7fdf44183640 1 -- 172.21.15.114:0/3065693053 wait complete. 2023-11-04T01:44:48.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.623+0000 7fdf44183640 1 Processor -- start 2023-11-04T01:44:48.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.623+0000 7fdf44183640 1 -- start start 2023-11-04T01:44:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf44183640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf3c06bb60 0x7fdf3c155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf44183640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3c070700 0x7fdf3c0c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf44183640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3c159e40 0x7fdf3c0ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf44183640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c0c4770 con 0x7fdf3c159e40 2023-11-04T01:44:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf44183640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c0c4a50 con 0x7fdf3c06bb60 2023-11-04T01:44:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf44183640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c0c4d30 con 0x7fdf3c070700 2023-11-04T01:44:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf42720640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3c159e40 0x7fdf3c0ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf42720640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3c159e40 0x7fdf3c0ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39836/0 (socket says 172.21.15.114:39836) 2023-11-04T01:44:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf42720640 1 -- 172.21.15.114:0/3188295030 learned_addr learned my addr 172.21.15.114:0/3188295030 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf41f1f640 1 --2- 172.21.15.114:0/3188295030 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf3c06bb60 0x7fdf3c155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf4171e640 1 --2- 172.21.15.114:0/3188295030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3c070700 0x7fdf3c0c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf42720640 1 -- 172.21.15.114:0/3188295030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3c070700 msgr2=0x7fdf3c0c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf42720640 1 --2- 172.21.15.114:0/3188295030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3c070700 0x7fdf3c0c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf42720640 1 -- 172.21.15.114:0/3188295030 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf3c06bb60 msgr2=0x7fdf3c155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf42720640 1 --2- 172.21.15.114:0/3188295030 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf3c06bb60 0x7fdf3c155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf42720640 1 -- 172.21.15.114:0/3188295030 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf38009a70 con 0x7fdf3c159e40 2023-11-04T01:44:48.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf41f1f640 1 --2- 172.21.15.114:0/3188295030 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf3c06bb60 0x7fdf3c155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:48.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf42720640 1 --2- 172.21.15.114:0/3188295030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3c159e40 0x7fdf3c0ccc20 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009eb0 tx=0x7fdf38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:48.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.624+0000 7fdf327fc640 1 -- 172.21.15.114:0/3188295030 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3802cea0 con 0x7fdf3c159e40 2023-11-04T01:44:48.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.625+0000 7fdf327fc640 1 -- 172.21.15.114:0/3188295030 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3803e610 con 0x7fdf3c159e40 2023-11-04T01:44:48.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.625+0000 7fdf44183640 1 -- 172.21.15.114:0/3188295030 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3c0c5010 con 0x7fdf3c159e40 2023-11-04T01:44:48.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.625+0000 7fdf327fc640 1 -- 172.21.15.114:0/3188295030 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3803ea00 con 0x7fdf3c159e40 2023-11-04T01:44:48.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.625+0000 7fdf44183640 1 -- 172.21.15.114:0/3188295030 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3c0cd340 con 0x7fdf3c159e40 2023-11-04T01:44:48.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.626+0000 7fdf44183640 1 -- 172.21.15.114:0/3188295030 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf3c0684b0 con 0x7fdf3c159e40 2023-11-04T01:44:48.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.626+0000 7fdf327fc640 1 -- 172.21.15.114:0/3188295030 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf3803b050 con 0x7fdf3c159e40 2023-11-04T01:44:48.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.626+0000 7fdf327fc640 1 --2- 172.21.15.114:0/3188295030 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf2006ae70 0x7fdf2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.627+0000 7fdf41f1f640 1 --2- 172.21.15.114:0/3188295030 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf2006ae70 0x7fdf2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.627+0000 7fdf327fc640 1 -- 172.21.15.114:0/3188295030 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7fdf380abfd0 con 0x7fdf3c159e40 2023-11-04T01:44:48.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.627+0000 7fdf41f1f640 1 --2- 172.21.15.114:0/3188295030 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf2006ae70 0x7fdf2006d330 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fdf34009a20 tx=0x7fdf34008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:48.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.631+0000 7fdf327fc640 1 -- 172.21.15.114:0/3188295030 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf38076710 con 0x7fdf3c159e40 2023-11-04T01:44:48.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.832+0000 7fdf44183640 1 -- 172.21.15.114:0/3188295030 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf3c0c48b0 con 0x7fdf3c159e40 2023-11-04T01:44:48.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.833+0000 7fdf327fc640 1 -- 172.21.15.114:0/3188295030 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4997 (secure 0 0 0) 0x7fdf3c0c48b0 con 0x7fdf3c159e40 2023-11-04T01:44:48.835 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:48.835 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":117,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.141:6835/3291351844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6833","nonce":3291351844},{"type":"v1","addr":"172.21.15.141:6835","nonce":3291351844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2540656643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2540656643},{"type":"v1","addr":"172.21.15.114:6835","nonce":2540656643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:39:51.430343+0000","modified":"2023-11-04T01:44:45.631477+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8547,"mds_1":7063},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7063":{"gid":7063,"name":"b","rank":1,"incarnation":111,"state":"up:active","state_seq":7,"addr":"172.21.15.141:6834/4135465257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6832","nonce":4135465257},{"type":"v1","addr":"172.21.15.141:6834","nonce":4135465257}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:44:45.631477+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":108,"state":"up:active","state_seq":18,"addr":"172.21.15.114:6837/2937931266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":2937931266},{"type":"v1","addr":"172.21.15.114:6837","nonce":2937931266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:48.835 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 117 2023-11-04T01:44:48.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.835+0000 7fdf44183640 1 -- 172.21.15.114:0/3188295030 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf2006ae70 msgr2=0x7fdf2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.835+0000 7fdf44183640 1 --2- 172.21.15.114:0/3188295030 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf2006ae70 0x7fdf2006d330 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fdf34009a20 tx=0x7fdf34008040 comp rx=0 tx=0).stop 2023-11-04T01:44:48.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.835+0000 7fdf44183640 1 -- 172.21.15.114:0/3188295030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3c159e40 msgr2=0x7fdf3c0ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.835+0000 7fdf44183640 1 --2- 172.21.15.114:0/3188295030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3c159e40 0x7fdf3c0ccc20 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009eb0 tx=0x7fdf38004a40 comp rx=0 tx=0).stop 2023-11-04T01:44:48.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.835+0000 7fdf44183640 1 -- 172.21.15.114:0/3188295030 shutdown_connections 2023-11-04T01:44:48.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.835+0000 7fdf44183640 1 --2- 172.21.15.114:0/3188295030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3c159e40 0x7fdf3c0ccc20 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.835+0000 7fdf44183640 1 --2- 172.21.15.114:0/3188295030 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fdf3c070700 0x7fdf3c0c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.835+0000 7fdf44183640 1 --2- 172.21.15.114:0/3188295030 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fdf2006ae70 0x7fdf2006d330 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.835+0000 7fdf44183640 1 --2- 172.21.15.114:0/3188295030 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fdf3c06bb60 0x7fdf3c155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.835+0000 7fdf44183640 1 -- 172.21.15.114:0/3188295030 >> 172.21.15.114:0/3188295030 conn(0x7fdf3c0cb530 msgr2=0x7fdf3c06d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:48.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.835+0000 7fdf44183640 1 -- 172.21.15.114:0/3188295030 shutdown_connections 2023-11-04T01:44:48.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:48.835+0000 7fdf44183640 1 -- 172.21.15.114:0/3188295030 wait complete. 2023-11-04T01:44:48.847 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-11-04T01:44:48.847 DEBUG:teuthology.orchestra.run.smithi141:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:44:48.877 INFO:teuthology.orchestra.run.smithi141.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:44:48.878 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:44:48.879 DEBUG:teuthology.orchestra.run.smithi141:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:44:48.951 INFO:teuthology.orchestra.run.smithi141.stdout:1699062267.127528.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i b', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:44:48.953 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062267.127528.core'] 2023-11-04T01:44:48.953 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062267.127528.core, deleting it 2023-11-04T01:44:48.954 DEBUG:teuthology.orchestra.run.smithi141:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062267.127528.core 2023-11-04T01:44:49.025 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi114.front.sepia.ceph.com... 2023-11-04T01:44:49.026 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:44:49.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:49.026 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 down 2023-11-04T01:44:49.054 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:44:49.054 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:44:49.054 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:49.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:49.154 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:44:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:44:49.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.250+0000 7fc6f6cb4640 1 Processor -- start 2023-11-04T01:44:49.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.250+0000 7fc6f6cb4640 1 -- start start 2023-11-04T01:44:49.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.251+0000 7fc6f6cb4640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc6f0159e40 0x7fc6f00b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.251+0000 7fc6f6cb4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6f006bb60 0x7fc6f00b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.251+0000 7fc6f6cb4640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f0071500 con 0x7fc6f006fff0 2023-11-04T01:44:49.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.251+0000 7fc6f6cb4640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f015dae0 con 0x7fc6f0159e40 2023-11-04T01:44:49.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.251+0000 7fc6f6cb4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f0070c60 con 0x7fc6f006bb60 2023-11-04T01:44:49.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.251+0000 7fc6effff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6f006bb60 0x7fc6f00b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.251+0000 7fc6f4a50640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc6f0159e40 0x7fc6f00b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.251+0000 7fc6f5251640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7fc6f006fff0 0x7fc6f0070480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:43784/0 (socket says 172.21.15.114:43784) 2023-11-04T01:44:49.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.251+0000 7fc6effff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6f006bb60 0x7fc6f00b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3301/0 says I am v2:172.21.15.114:47588/0 (socket says 172.21.15.114:47588) 2023-11-04T01:44:49.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.251+0000 7fc6f5251640 1 -- 172.21.15.114:0/2583341812 learned_addr learned my addr 172.21.15.114:0/2583341812 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:49.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.251+0000 7fc6f4a50640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc6f0159e40 0x7fc6f00b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:53078/0 (socket says 172.21.15.114:53078) 2023-11-04T01:44:49.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.251+0000 7fc6f4a50640 1 -- 172.21.15.114:0/2583341812 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6f006bb60 msgr2=0x7fc6f00b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:49.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.251+0000 7fc6f4a50640 1 --2- 172.21.15.114:0/2583341812 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6f006bb60 0x7fc6f00b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.251+0000 7fc6f4a50640 1 -- 172.21.15.114:0/2583341812 >> v1:172.21.15.141:6789/0 conn(0x7fc6f006fff0 legacy=0x7fc6f0070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.251+0000 7fc6f4a50640 1 -- 172.21.15.114:0/2583341812 --> v2:172.21.15.141:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f0070f40 con 0x7fc6f0159e40 2023-11-04T01:44:49.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.251+0000 7fc6effff640 1 --2- 172.21.15.114:0/2583341812 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6f006bb60 0x7fc6f00b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:49.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.252+0000 7fc6f4a50640 1 --2- 172.21.15.114:0/2583341812 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6f0159e40 0x7fc6f00b0530 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40097a0 tx=0x7fc6e402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3bcbc6708faf6ec server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.252+0000 7fc6ef7fe640 1 -- 172.21.15.114:0/2583341812 <== mon.1 v2:172.21.15.141:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e402e070 con 0x7fc6f0159e40 2023-11-04T01:44:49.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.252+0000 7fc6ef7fe640 1 -- 172.21.15.114:0/2583341812 <== mon.1 v2:172.21.15.141:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e40315a0 con 0x7fc6f0159e40 2023-11-04T01:44:49.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.252+0000 7fc6ef7fe640 1 -- 172.21.15.114:0/2583341812 <== mon.1 v2:172.21.15.141:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4031930 con 0x7fc6f0159e40 2023-11-04T01:44:49.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.253+0000 7fc6f6cb4640 1 -- 172.21.15.114:0/2583341812 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6f0159e40 msgr2=0x7fc6f00b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.253+0000 7fc6f6cb4640 1 --2- 172.21.15.114:0/2583341812 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6f0159e40 0x7fc6f00b0530 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40097a0 tx=0x7fc6e402b840 comp rx=0 tx=0).stop 2023-11-04T01:44:49.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.253+0000 7fc6f6cb4640 1 -- 172.21.15.114:0/2583341812 shutdown_connections 2023-11-04T01:44:49.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.253+0000 7fc6f6cb4640 1 --2- 172.21.15.114:0/2583341812 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6f006bb60 0x7fc6f00b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.253+0000 7fc6f6cb4640 1 --2- 172.21.15.114:0/2583341812 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6f0159e40 0x7fc6f00b0530 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.253+0000 7fc6f6cb4640 1 -- 172.21.15.114:0/2583341812 >> 172.21.15.114:0/2583341812 conn(0x7fc6f00cb530 msgr2=0x7fc6f00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:49.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.253+0000 7fc6f6cb4640 1 -- 172.21.15.114:0/2583341812 shutdown_connections 2023-11-04T01:44:49.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.253+0000 7fc6f6cb4640 1 -- 172.21.15.114:0/2583341812 wait complete. 2023-11-04T01:44:49.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.254+0000 7fc6f6cb4640 1 Processor -- start 2023-11-04T01:44:49.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.254+0000 7fc6f6cb4640 1 -- start start 2023-11-04T01:44:49.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.255+0000 7fc6f6cb4640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6f006bb60 0x7fc6f00cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.255+0000 7fc6f6cb4640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6f006fff0 0x7fc6f00c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.255+0000 7fc6f6cb4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6f0159e40 0x7fc6f00c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.255+0000 7fc6f6cb4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f00c1770 con 0x7fc6f0159e40 2023-11-04T01:44:49.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.255+0000 7fc6f6cb4640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f01f64e0 con 0x7fc6f006fff0 2023-11-04T01:44:49.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.255+0000 7fc6f6cb4640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f01f7060 con 0x7fc6f006bb60 2023-11-04T01:44:49.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.255+0000 7fc6f5251640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6f0159e40 0x7fc6f00c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.255+0000 7fc6f5251640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6f0159e40 0x7fc6f00c1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39848/0 (socket says 172.21.15.114:39848) 2023-11-04T01:44:49.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.255+0000 7fc6f5251640 1 -- 172.21.15.114:0/2520586745 learned_addr learned my addr 172.21.15.114:0/2520586745 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:49.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.255+0000 7fc6effff640 1 --2- 172.21.15.114:0/2520586745 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6f006fff0 0x7fc6f00c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.255+0000 7fc6f4a50640 1 --2- 172.21.15.114:0/2520586745 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6f006bb60 0x7fc6f00cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.255+0000 7fc6f5251640 1 -- 172.21.15.114:0/2520586745 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6f006bb60 msgr2=0x7fc6f00cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.255+0000 7fc6f5251640 1 --2- 172.21.15.114:0/2520586745 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6f006bb60 0x7fc6f00cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.255+0000 7fc6f5251640 1 -- 172.21.15.114:0/2520586745 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6f006fff0 msgr2=0x7fc6f00c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.255+0000 7fc6f5251640 1 --2- 172.21.15.114:0/2520586745 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6f006fff0 0x7fc6f00c0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.255+0000 7fc6f5251640 1 -- 172.21.15.114:0/2520586745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc009400 con 0x7fc6f0159e40 2023-11-04T01:44:49.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.256+0000 7fc6f5251640 1 --2- 172.21.15.114:0/2520586745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6f0159e40 0x7fc6f00c1230 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800caf0 tx=0x7fc6e800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.256+0000 7fc6ed7fa640 1 -- 172.21.15.114:0/2520586745 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e800aca0 con 0x7fc6f0159e40 2023-11-04T01:44:49.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.256+0000 7fc6ed7fa640 1 -- 172.21.15.114:0/2520586745 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e800ae00 con 0x7fc6f0159e40 2023-11-04T01:44:49.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.256+0000 7fc6f6cb4640 1 -- 172.21.15.114:0/2520586745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e4009400 con 0x7fc6f0159e40 2023-11-04T01:44:49.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.256+0000 7fc6ed7fa640 1 -- 172.21.15.114:0/2520586745 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8012600 con 0x7fc6f0159e40 2023-11-04T01:44:49.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.256+0000 7fc6f6cb4640 1 -- 172.21.15.114:0/2520586745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f01f6a10 con 0x7fc6f0159e40 2023-11-04T01:44:49.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.257+0000 7fc6f6cb4640 1 -- 172.21.15.114:0/2520586745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f01f71d0 con 0x7fc6f0159e40 2023-11-04T01:44:49.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.257+0000 7fc6ed7fa640 1 -- 172.21.15.114:0/2520586745 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc6e8007070 con 0x7fc6f0159e40 2023-11-04T01:44:49.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.257+0000 7fc6ed7fa640 1 --2- 172.21.15.114:0/2520586745 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc6d406ae70 0x7fc6d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.257+0000 7fc6ed7fa640 1 -- 172.21.15.114:0/2520586745 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7fc6e8089e20 con 0x7fc6f0159e40 2023-11-04T01:44:49.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.257+0000 7fc6f4a50640 1 --2- 172.21.15.114:0/2520586745 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc6d406ae70 0x7fc6d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.258+0000 7fc6f4a50640 1 --2- 172.21.15.114:0/2520586745 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc6d406ae70 0x7fc6d406d330 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4036000 tx=0x7fc6e403d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.262+0000 7fc6ed7fa640 1 -- 172.21.15.114:0/2520586745 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc6e8054570 con 0x7fc6f0159e40 2023-11-04T01:44:49.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.430+0000 7fc6f6cb4640 1 -- 172.21.15.114:0/2520586745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6f00684b0 con 0x7fc6f0159e40 2023-11-04T01:44:49.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.431+0000 7fc6ed7fa640 1 -- 172.21.15.114:0/2520586745 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+23725 (secure 0 0 0) 0x7fc6e8017070 con 0x7fc6f0159e40 2023-11-04T01:44:49.433 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:49.433 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":116,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:44:35.629413+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:50.031565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:50.411946+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":14,"snap_epoch":115,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":2}]},{"pgid":"17.3c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/979876939":"2023-11-05T01:44:08.794891+0000","172.21.15.114:6834/979876939":"2023-11-05T01:44:08.794891+0000","192.168.0.1:0/3180677097":"2023-11-04T02:43:26.710151+0000","172.21.15.114:6836/3145796350":"2023-11-05T01:43:18.419560+0000","172.21.15.114:6837/3825479201":"2023-11-05T01:43:11.612005+0000","172.21.15.114:6835/3825479201":"2023-11-05T01:43:11.612005+0000","172.21.15.114:6834/3145796350":"2023-11-05T01:43:18.419560+0000","172.21.15.114:6834/3780323525":"2023-11-05T01:40:32.050690+0000","192.168.0.1:0/76750670":"2023-11-04T02:44:16.664609+0000","172.21.15.114:6836/3780323525":"2023-11-05T01:40:32.050690+0000","172.21.15.141:6834/1296600989":"2023-11-05T01:42:28.568489+0000","172.21.15.114:6835/1768068040":"2023-11-05T01:40:57.284155+0000","172.21.15.141:6834/224279622":"2023-11-05T01:44:01.557691+0000","172.21.15.114:6837/1768068040":"2023-11-05T01:40:57.284155+0000","172.21.15.141:6832/1296600989":"2023-11-05T01:42:28.568489+0000","172.21.15.114:6836/2722332212":"2023-11-05T01:41:22.824334+0000","172.21.15.114:6835/1052115332":"2023-11-05T01:41:48.753700+0000","192.168.0.1:0/958873281":"2023-11-04T02:42:36.859026+0000","172.21.15.114:6837/1052115332":"2023-11-05T01:41:48.753700+0000","172.21.15.141:6832/224279622":"2023-11-05T01:44:01.557691+0000","172.21.15.114:6836/1629274449":"2023-11-05T01:42:21.762099+0000","172.21.15.114:6834/2722332212":"2023-11-05T01:41:22.824334+0000","172.21.15.114:6834/1629274449":"2023-11-05T01:42:21.762099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":11,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:49.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.433+0000 7fc6f6cb4640 1 -- 172.21.15.114:0/2520586745 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc6d406ae70 msgr2=0x7fc6d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.433+0000 7fc6f6cb4640 1 --2- 172.21.15.114:0/2520586745 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc6d406ae70 0x7fc6d406d330 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4036000 tx=0x7fc6e403d040 comp rx=0 tx=0).stop 2023-11-04T01:44:49.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.433+0000 7fc6f6cb4640 1 -- 172.21.15.114:0/2520586745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6f0159e40 msgr2=0x7fc6f00c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.433+0000 7fc6f6cb4640 1 --2- 172.21.15.114:0/2520586745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6f0159e40 0x7fc6f00c1230 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800caf0 tx=0x7fc6e800a060 comp rx=0 tx=0).stop 2023-11-04T01:44:49.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.433+0000 7fc6f6cb4640 1 -- 172.21.15.114:0/2520586745 shutdown_connections 2023-11-04T01:44:49.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.433+0000 7fc6f6cb4640 1 --2- 172.21.15.114:0/2520586745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6f0159e40 0x7fc6f00c1230 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.433+0000 7fc6f6cb4640 1 --2- 172.21.15.114:0/2520586745 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc6d406ae70 0x7fc6d406d330 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.433+0000 7fc6f6cb4640 1 --2- 172.21.15.114:0/2520586745 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc6f006fff0 0x7fc6f00c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.433+0000 7fc6f6cb4640 1 --2- 172.21.15.114:0/2520586745 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc6f006bb60 0x7fc6f00cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.433+0000 7fc6f6cb4640 1 -- 172.21.15.114:0/2520586745 >> 172.21.15.114:0/2520586745 conn(0x7fc6f00cb530 msgr2=0x7fc6f015dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:49.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.433+0000 7fc6f6cb4640 1 -- 172.21.15.114:0/2520586745 shutdown_connections 2023-11-04T01:44:49.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.433+0000 7fc6f6cb4640 1 -- 172.21.15.114:0/2520586745 wait complete. 2023-11-04T01:44:49.446 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:58.316710+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:59.185397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:50.031565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:50.411946+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 14, 'snap_epoch': 115, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:44:49.447 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:44:49.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.547+0000 7fc1f2a56640 1 Processor -- start 2023-11-04T01:44:49.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.547+0000 7fc1f2a56640 1 -- start start 2023-11-04T01:44:49.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.548+0000 7fc1f2a56640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1ec15d110 0x7fc1ec06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.548+0000 7fc1f2a56640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1ec0b3ca0 0x7fc1ec0ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.548+0000 7fc1f2a56640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ec15d4f0 con 0x7fc1ec0ad3b0 2023-11-04T01:44:49.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.548+0000 7fc1f2a56640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ec0664f0 con 0x7fc1ec0b3ca0 2023-11-04T01:44:49.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.548+0000 7fc1f2a56640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec06b9f0 con 0x7fc1ec15d110 2023-11-04T01:44:49.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.548+0000 7fc1f0ff3640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc1ec0ad3b0 0x7fc1ec0b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34546/0 (socket says 172.21.15.114:34546) 2023-11-04T01:44:49.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.548+0000 7fc1f0ff3640 1 -- 172.21.15.114:0/2579497441 learned_addr learned my addr 172.21.15.114:0/2579497441 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:49.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.548+0000 7fc1eb7fe640 1 --2- 172.21.15.114:0/2579497441 >> v2:172.21.15.141:3300/0 conn(0x7fc1ec0b3ca0 0x7fc1ec0ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.548+0000 7fc1ebfff640 1 --2- 172.21.15.114:0/2579497441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1ec15d110 0x7fc1ec06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.548+0000 7fc1eaffd640 1 -- 172.21.15.114:0/2579497441 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730584945 0 0) 0x7fc1ec15d4f0 con 0x7fc1ec0ad3b0 2023-11-04T01:44:49.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.548+0000 7fc1eaffd640 1 -- 172.21.15.114:0/2579497441 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d4003520 con 0x7fc1ec0ad3b0 2023-11-04T01:44:49.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1eaffd640 1 -- 172.21.15.114:0/2579497441 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1338350911 0 0) 0x7fc1d4003520 con 0x7fc1ec0ad3b0 2023-11-04T01:44:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1eaffd640 1 -- 172.21.15.114:0/2579497441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1ec15d110 msgr2=0x7fc1ec06b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1eaffd640 1 --2- 172.21.15.114:0/2579497441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1ec15d110 0x7fc1ec06b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1eaffd640 1 -- 172.21.15.114:0/2579497441 >> v2:172.21.15.141:3300/0 conn(0x7fc1ec0b3ca0 msgr2=0x7fc1ec0ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1eaffd640 1 --2- 172.21.15.114:0/2579497441 >> v2:172.21.15.141:3300/0 conn(0x7fc1ec0b3ca0 0x7fc1ec0ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1eaffd640 1 -- 172.21.15.114:0/2579497441 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec06c2e0 con 0x7fc1ec0ad3b0 2023-11-04T01:44:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1eaffd640 1 -- 172.21.15.114:0/2579497441 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fc1e40019f0 con 0x7fc1ec0ad3b0 2023-11-04T01:44:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1eaffd640 1 -- 172.21.15.114:0/2579497441 >> v1:172.21.15.114:6789/0 conn(0x7fc1ec0ad3b0 legacy=0x7fc1ec0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1eaffd640 1 --2- 172.21.15.114:0/2579497441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1d4003970 0x7fc1d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1eaffd640 1 --2- 172.21.15.114:0/2579497441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1d40047c0 0x7fc1d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1eaffd640 1 --2- 172.21.15.114:0/2579497441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1ec15d110 0x7fc1d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1eaffd640 1 -- 172.21.15.114:0/2579497441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0664f0 con 0x7fc1d4003970 2023-11-04T01:44:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1eaffd640 1 -- 172.21.15.114:0/2579497441 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec06b9f0 con 0x7fc1d40047c0 2023-11-04T01:44:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1eaffd640 1 -- 172.21.15.114:0/2579497441 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d400b980 con 0x7fc1ec15d110 2023-11-04T01:44:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1ebfff640 1 --2- 172.21.15.114:0/2579497441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1d4003970 0x7fc1d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1f0ff3640 1 --2- 172.21.15.114:0/2579497441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1ec15d110 0x7fc1d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1eb7fe640 1 --2- 172.21.15.114:0/2579497441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1d40047c0 0x7fc1d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1ebfff640 1 -- 172.21.15.114:0/2579497441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1ec15d110 msgr2=0x7fc1d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:49.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1ebfff640 1 --2- 172.21.15.114:0/2579497441 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1ec15d110 0x7fc1d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1ebfff640 1 -- 172.21.15.114:0/2579497441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1d40047c0 msgr2=0x7fc1d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:49.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1ebfff640 1 --2- 172.21.15.114:0/2579497441 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1d40047c0 0x7fc1d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.549+0000 7fc1ebfff640 1 -- 172.21.15.114:0/2579497441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d4003520 con 0x7fc1d4003970 2023-11-04T01:44:49.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.550+0000 7fc1ebfff640 1 --2- 172.21.15.114:0/2579497441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1d4003970 0x7fc1d4003d90 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009ab0 tx=0x7fc1d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403f5c51fe8fac8e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.550+0000 7fc1eaffd640 1 -- 172.21.15.114:0/2579497441 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc005990 con 0x7fc1d4003970 2023-11-04T01:44:49.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.550+0000 7fc1eaffd640 1 -- 172.21.15.114:0/2579497441 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc005af0 con 0x7fc1d4003970 2023-11-04T01:44:49.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.550+0000 7fc1eaffd640 1 -- 172.21.15.114:0/2579497441 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc005ea0 con 0x7fc1d4003970 2023-11-04T01:44:49.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.551+0000 7fc1f2a56640 1 -- 172.21.15.114:0/2579497441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1d4003970 msgr2=0x7fc1d4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.551+0000 7fc1f2a56640 1 --2- 172.21.15.114:0/2579497441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1d4003970 0x7fc1d4003d90 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009ab0 tx=0x7fc1d40057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.551+0000 7fc1f0ff3640 1 -- 172.21.15.114:0/2579497441 reap_dead start 2023-11-04T01:44:49.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.551+0000 7fc1f2a56640 1 -- 172.21.15.114:0/2579497441 shutdown_connections 2023-11-04T01:44:49.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.551+0000 7fc1f2a56640 1 -- 172.21.15.114:0/2579497441 >> 172.21.15.114:0/2579497441 conn(0x7fc1ec0cbd30 msgr2=0x7fc1ec0cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:49.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.551+0000 7fc1f2a56640 1 -- 172.21.15.114:0/2579497441 shutdown_connections 2023-11-04T01:44:49.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.551+0000 7fc1f2a56640 1 -- 172.21.15.114:0/2579497441 wait complete. 2023-11-04T01:44:49.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.552+0000 7fc1f2a56640 1 Processor -- start 2023-11-04T01:44:49.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.552+0000 7fc1f2a56640 1 -- start start 2023-11-04T01:44:49.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f2a56640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d4003970 0x7fc1ec0b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f2a56640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1ec0c6490 0x7fc1ec0af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f2a56640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1ec0713a0 0x7fc1ec1593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f2a56640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec15e080 con 0x7fc1ec0713a0 2023-11-04T01:44:49.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f2a56640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0afc80 con 0x7fc1ec0c6490 2023-11-04T01:44:49.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f2a56640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec0b06d0 con 0x7fc1d4003970 2023-11-04T01:44:49.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f0ff3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1ec0713a0 0x7fc1ec1593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f0ff3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1ec0713a0 0x7fc1ec1593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39864/0 (socket says 172.21.15.114:39864) 2023-11-04T01:44:49.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f0ff3640 1 -- 172.21.15.114:0/2068512379 learned_addr learned my addr 172.21.15.114:0/2068512379 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:49.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1eb7fe640 1 --2- 172.21.15.114:0/2068512379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1ec0c6490 0x7fc1ec0af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1ebfff640 1 --2- 172.21.15.114:0/2068512379 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d4003970 0x7fc1ec0b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f0ff3640 1 -- 172.21.15.114:0/2068512379 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d4003970 msgr2=0x7fc1ec0b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f0ff3640 1 --2- 172.21.15.114:0/2068512379 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d4003970 0x7fc1ec0b0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f0ff3640 1 -- 172.21.15.114:0/2068512379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1ec0c6490 msgr2=0x7fc1ec0af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f0ff3640 1 --2- 172.21.15.114:0/2068512379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1ec0c6490 0x7fc1ec0af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f0ff3640 1 -- 172.21.15.114:0/2068512379 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec15d6e0 con 0x7fc1ec0713a0 2023-11-04T01:44:49.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1eb7fe640 1 --2- 172.21.15.114:0/2068512379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1ec0c6490 0x7fc1ec0af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:49.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f0ff3640 1 --2- 172.21.15.114:0/2068512379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1ec0713a0 0x7fc1ec1593a0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4001330 tx=0x7fc1e400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1e8ff9640 1 -- 172.21.15.114:0/2068512379 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e400ebb0 con 0x7fc1ec0713a0 2023-11-04T01:44:49.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1e8ff9640 1 -- 172.21.15.114:0/2068512379 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e400ed30 con 0x7fc1ec0713a0 2023-11-04T01:44:49.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f2a56640 1 -- 172.21.15.114:0/2068512379 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ec15d9c0 con 0x7fc1ec0713a0 2023-11-04T01:44:49.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1e8ff9640 1 -- 172.21.15.114:0/2068512379 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4013660 con 0x7fc1ec0713a0 2023-11-04T01:44:49.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.553+0000 7fc1f2a56640 1 -- 172.21.15.114:0/2068512379 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ec071850 con 0x7fc1ec0713a0 2023-11-04T01:44:49.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.554+0000 7fc1f2a56640 1 -- 172.21.15.114:0/2068512379 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ec06c880 con 0x7fc1ec0713a0 2023-11-04T01:44:49.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.555+0000 7fc1e8ff9640 1 -- 172.21.15.114:0/2068512379 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1e40137c0 con 0x7fc1ec0713a0 2023-11-04T01:44:49.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.555+0000 7fc1e8ff9640 1 --2- 172.21.15.114:0/2068512379 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc1d806ae70 0x7fc1d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.555+0000 7fc1e8ff9640 1 -- 172.21.15.114:0/2068512379 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7fc1e408a3d0 con 0x7fc1ec0713a0 2023-11-04T01:44:49.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.555+0000 7fc1ebfff640 1 --2- 172.21.15.114:0/2068512379 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc1d806ae70 0x7fc1d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.556+0000 7fc1ebfff640 1 --2- 172.21.15.114:0/2068512379 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc1d806ae70 0x7fc1d806d330 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc035000 tx=0x7fc1dc030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.559+0000 7fc1e8ff9640 1 -- 172.21.15.114:0/2068512379 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc1ec06c880 con 0x7fc1ec0713a0 2023-11-04T01:44:49.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.727+0000 7fc1f2a56640 1 -- 172.21.15.114:0/2068512379 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1ec15e1c0 con 0x7fc1ec0713a0 2023-11-04T01:44:49.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.727+0000 7fc1e8ff9640 1 -- 172.21.15.114:0/2068512379 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1ec15e1c0 con 0x7fc1ec0713a0 2023-11-04T01:44:49.729 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:44:49.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.729+0000 7fc1f2a56640 1 -- 172.21.15.114:0/2068512379 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc1d806ae70 msgr2=0x7fc1d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.729+0000 7fc1f2a56640 1 --2- 172.21.15.114:0/2068512379 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc1d806ae70 0x7fc1d806d330 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc035000 tx=0x7fc1dc030000 comp rx=0 tx=0).stop 2023-11-04T01:44:49.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.729+0000 7fc1f2a56640 1 -- 172.21.15.114:0/2068512379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1ec0713a0 msgr2=0x7fc1ec1593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.729+0000 7fc1f2a56640 1 --2- 172.21.15.114:0/2068512379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1ec0713a0 0x7fc1ec1593a0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4001330 tx=0x7fc1e400e530 comp rx=0 tx=0).stop 2023-11-04T01:44:49.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.729+0000 7fc1f2a56640 1 -- 172.21.15.114:0/2068512379 shutdown_connections 2023-11-04T01:44:49.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.729+0000 7fc1f2a56640 1 --2- 172.21.15.114:0/2068512379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1ec0713a0 0x7fc1ec1593a0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.729+0000 7fc1f2a56640 1 --2- 172.21.15.114:0/2068512379 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fc1d806ae70 0x7fc1d806d330 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.729+0000 7fc1f2a56640 1 --2- 172.21.15.114:0/2068512379 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fc1ec0c6490 0x7fc1ec0af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.729+0000 7fc1f2a56640 1 --2- 172.21.15.114:0/2068512379 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1d4003970 0x7fc1ec0b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.729+0000 7fc1f2a56640 1 -- 172.21.15.114:0/2068512379 >> 172.21.15.114:0/2068512379 conn(0x7fc1ec0cbd30 msgr2=0x7fc1ec06ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:49.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.729+0000 7fc1f2a56640 1 -- 172.21.15.114:0/2068512379 shutdown_connections 2023-11-04T01:44:49.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.729+0000 7fc1f2a56640 1 -- 172.21.15.114:0/2068512379 wait complete. 2023-11-04T01:44:49.742 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:44:49.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.843+0000 7f87a464f640 1 Processor -- start 2023-11-04T01:44:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.843+0000 7f87a464f640 1 -- start start 2023-11-04T01:44:49.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a464f640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f879c070700 0x7f879c164b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a464f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879c071500 con 0x7f879c159e40 2023-11-04T01:44:49.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a464f640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879c15dae0 con 0x7f879c0b0c40 2023-11-04T01:44:49.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a464f640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879c070c60 con 0x7f879c070700 2023-11-04T01:44:49.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a23eb640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f879c159e40 0x7f879c0b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34560/0 (socket says 172.21.15.114:34560) 2023-11-04T01:44:49.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a23eb640 1 -- 172.21.15.114:0/3042350562 learned_addr learned my addr 172.21.15.114:0/3042350562 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:49.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a13e9640 1 -- 172.21.15.114:0/3042350562 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235941306 0 0) 0x7f879c071500 con 0x7f879c159e40 2023-11-04T01:44:49.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a2bec640 1 --2- 172.21.15.114:0/3042350562 >> v2:172.21.15.141:3300/0 conn(0x7f879c070700 0x7f879c164b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a13e9640 1 -- 172.21.15.114:0/3042350562 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8788003520 con 0x7f879c159e40 2023-11-04T01:44:49.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a13e9640 1 -- 172.21.15.114:0/3042350562 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2650988006 0 0) 0x7f8788003520 con 0x7f879c159e40 2023-11-04T01:44:49.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a13e9640 1 -- 172.21.15.114:0/3042350562 >> v2:172.21.15.141:3300/0 conn(0x7f879c070700 msgr2=0x7f879c164b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:49.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a13e9640 1 --2- 172.21.15.114:0/3042350562 >> v2:172.21.15.141:3300/0 conn(0x7f879c070700 0x7f879c164b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a13e9640 1 -- 172.21.15.114:0/3042350562 >> v1:172.21.15.141:6789/0 conn(0x7f879c0b0c40 legacy=0x7f879c06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a13e9640 1 -- 172.21.15.114:0/3042350562 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c070f40 con 0x7f879c159e40 2023-11-04T01:44:49.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a13e9640 1 -- 172.21.15.114:0/3042350562 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f8798001670 con 0x7f879c159e40 2023-11-04T01:44:49.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a13e9640 1 -- 172.21.15.114:0/3042350562 >> v1:172.21.15.114:6789/0 conn(0x7f879c159e40 legacy=0x7f879c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a13e9640 1 --2- 172.21.15.114:0/3042350562 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87880039c0 0x7f8788003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a13e9640 1 --2- 172.21.15.114:0/3042350562 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87880047c0 0x7f8788004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a13e9640 1 --2- 172.21.15.114:0/3042350562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87880051d0 0x7f878800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a13e9640 1 -- 172.21.15.114:0/3042350562 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c070c60 con 0x7f87880051d0 2023-11-04T01:44:49.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a13e9640 1 -- 172.21.15.114:0/3042350562 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878800c120 con 0x7f87880047c0 2023-11-04T01:44:49.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a13e9640 1 -- 172.21.15.114:0/3042350562 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878800c2e0 con 0x7f87880039c0 2023-11-04T01:44:49.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a2bec640 1 --2- 172.21.15.114:0/3042350562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87880051d0 0x7f878800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a23eb640 1 --2- 172.21.15.114:0/3042350562 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87880039c0 0x7f8788003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.844+0000 7f87a1bea640 1 --2- 172.21.15.114:0/3042350562 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87880047c0 0x7f8788004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.845+0000 7f87a2bec640 1 -- 172.21.15.114:0/3042350562 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87880039c0 msgr2=0x7f8788003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:49.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.845+0000 7f87a2bec640 1 --2- 172.21.15.114:0/3042350562 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87880039c0 0x7f8788003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.845+0000 7f87a2bec640 1 -- 172.21.15.114:0/3042350562 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87880047c0 msgr2=0x7f8788004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:49.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.845+0000 7f87a2bec640 1 --2- 172.21.15.114:0/3042350562 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87880047c0 0x7f8788004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.845+0000 7f87a2bec640 1 -- 172.21.15.114:0/3042350562 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8788003520 con 0x7f87880051d0 2023-11-04T01:44:49.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.845+0000 7f87a1bea640 1 --2- 172.21.15.114:0/3042350562 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f87880047c0 0x7f8788004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:49.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.845+0000 7f87a2bec640 1 -- 172.21.15.114:0/3042350562 reap_dead start 2023-11-04T01:44:49.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.845+0000 7f87a2bec640 1 --2- 172.21.15.114:0/3042350562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87880051d0 0x7f878800b980 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f8794009f90 tx=0x7f87880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326b43747686d431 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.846+0000 7f87a13e9640 1 -- 172.21.15.114:0/3042350562 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879402cc20 con 0x7f87880051d0 2023-11-04T01:44:49.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.846+0000 7f87a13e9640 1 -- 172.21.15.114:0/3042350562 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879400f040 con 0x7f87880051d0 2023-11-04T01:44:49.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.846+0000 7f87a13e9640 1 -- 172.21.15.114:0/3042350562 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794003990 con 0x7f87880051d0 2023-11-04T01:44:49.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.846+0000 7f87a464f640 1 -- 172.21.15.114:0/3042350562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87880051d0 msgr2=0x7f878800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.846+0000 7f87a464f640 1 --2- 172.21.15.114:0/3042350562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87880051d0 0x7f878800b980 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f8794009f90 tx=0x7f87880057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.846+0000 7f87a464f640 1 -- 172.21.15.114:0/3042350562 shutdown_connections 2023-11-04T01:44:49.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.846+0000 7f87a464f640 1 --2- 172.21.15.114:0/3042350562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87880051d0 0x7f878800b980 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.846+0000 7f87a464f640 1 -- 172.21.15.114:0/3042350562 >> 172.21.15.114:0/3042350562 conn(0x7f879c0cb530 msgr2=0x7f879c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:49.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.846+0000 7f87a464f640 1 -- 172.21.15.114:0/3042350562 shutdown_connections 2023-11-04T01:44:49.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.846+0000 7f87a464f640 1 -- 172.21.15.114:0/3042350562 wait complete. 2023-11-04T01:44:49.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.847+0000 7f87a464f640 1 Processor -- start 2023-11-04T01:44:49.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.847+0000 7f87a464f640 1 -- start start 2023-11-04T01:44:49.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.848+0000 7f87a464f640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87880051d0 0x7f879c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.848+0000 7f87a464f640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f879c0ccc00 0x7f879c14dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.848+0000 7f87a464f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f879c0aeb00 0x7f879c0aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.848+0000 7f87a464f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c151920 con 0x7f879c0aeb00 2023-11-04T01:44:49.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.848+0000 7f87a464f640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0af4f0 con 0x7f879c0ccc00 2023-11-04T01:44:49.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.848+0000 7f87a464f640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0cd600 con 0x7f87880051d0 2023-11-04T01:44:49.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.848+0000 7f87a2bec640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f879c0aeb00 0x7f879c0aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.848+0000 7f87a2bec640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f879c0aeb00 0x7f879c0aefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39886/0 (socket says 172.21.15.114:39886) 2023-11-04T01:44:49.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.848+0000 7f87a2bec640 1 -- 172.21.15.114:0/3345347330 learned_addr learned my addr 172.21.15.114:0/3345347330 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:49.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.848+0000 7f87a23eb640 1 --2- 172.21.15.114:0/3345347330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87880051d0 0x7f879c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.848+0000 7f87a1bea640 1 --2- 172.21.15.114:0/3345347330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f879c0ccc00 0x7f879c14dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.848+0000 7f87a2bec640 1 -- 172.21.15.114:0/3345347330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87880051d0 msgr2=0x7f879c0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.848+0000 7f87a2bec640 1 --2- 172.21.15.114:0/3345347330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87880051d0 0x7f879c0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.848+0000 7f87a2bec640 1 -- 172.21.15.114:0/3345347330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f879c0ccc00 msgr2=0x7f879c14dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.848+0000 7f87a2bec640 1 --2- 172.21.15.114:0/3345347330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f879c0ccc00 0x7f879c14dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.849+0000 7f87a2bec640 1 -- 172.21.15.114:0/3345347330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c14e2c0 con 0x7f879c0aeb00 2023-11-04T01:44:49.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.849+0000 7f87a2bec640 1 --2- 172.21.15.114:0/3345347330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f879c0aeb00 0x7f879c0aefb0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f879402c690 tx=0x7f8794009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.849+0000 7f8792ffd640 1 -- 172.21.15.114:0/3345347330 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794004230 con 0x7f879c0aeb00 2023-11-04T01:44:49.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.849+0000 7f8792ffd640 1 -- 172.21.15.114:0/3345347330 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8794004390 con 0x7f879c0aeb00 2023-11-04T01:44:49.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.849+0000 7f87a464f640 1 -- 172.21.15.114:0/3345347330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879c150ca0 con 0x7f879c0aeb00 2023-11-04T01:44:49.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.849+0000 7f8792ffd640 1 -- 172.21.15.114:0/3345347330 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794004740 con 0x7f879c0aeb00 2023-11-04T01:44:49.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.849+0000 7f87a464f640 1 -- 172.21.15.114:0/3345347330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879c151260 con 0x7f879c0aeb00 2023-11-04T01:44:49.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.850+0000 7f87a464f640 1 -- 172.21.15.114:0/3345347330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879c151a60 con 0x7f879c0aeb00 2023-11-04T01:44:49.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.850+0000 7f8792ffd640 1 -- 172.21.15.114:0/3345347330 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f879403f470 con 0x7f879c0aeb00 2023-11-04T01:44:49.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.851+0000 7f8792ffd640 1 --2- 172.21.15.114:0/3345347330 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f878006aea0 0x7f878006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.851+0000 7f8792ffd640 1 -- 172.21.15.114:0/3345347330 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f87940ac6f0 con 0x7f879c0aeb00 2023-11-04T01:44:49.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.851+0000 7f87a23eb640 1 --2- 172.21.15.114:0/3345347330 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f878006aea0 0x7f878006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.851+0000 7f87a23eb640 1 --2- 172.21.15.114:0/3345347330 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f878006aea0 0x7f878006d360 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8798001050 tx=0x7f8798009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:49.855+0000 7f8792ffd640 1 -- 172.21.15.114:0/3345347330 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f879c151a60 con 0x7f879c0aeb00 2023-11-04T01:44:50.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.021+0000 7f87a464f640 1 -- 172.21.15.114:0/3345347330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f879c14e2c0 con 0x7f879c0aeb00 2023-11-04T01:44:50.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.021+0000 7f8792ffd640 1 -- 172.21.15.114:0/3345347330 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v116) v1 ==== 103+0+11 (secure 0 0 0) 0x7f879c14e2c0 con 0x7f879c0aeb00 2023-11-04T01:44:50.023 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:44:50.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.023+0000 7f87a464f640 1 -- 172.21.15.114:0/3345347330 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f878006aea0 msgr2=0x7f878006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.023+0000 7f87a464f640 1 --2- 172.21.15.114:0/3345347330 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f878006aea0 0x7f878006d360 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8798001050 tx=0x7f8798009040 comp rx=0 tx=0).stop 2023-11-04T01:44:50.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.023+0000 7f87a464f640 1 -- 172.21.15.114:0/3345347330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f879c0aeb00 msgr2=0x7f879c0aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.023+0000 7f87a464f640 1 --2- 172.21.15.114:0/3345347330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f879c0aeb00 0x7f879c0aefb0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f879402c690 tx=0x7f8794009750 comp rx=0 tx=0).stop 2023-11-04T01:44:50.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.023+0000 7f87a464f640 1 -- 172.21.15.114:0/3345347330 shutdown_connections 2023-11-04T01:44:50.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.023+0000 7f87a464f640 1 --2- 172.21.15.114:0/3345347330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f879c0aeb00 0x7f879c0aefb0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.023+0000 7f87a464f640 1 --2- 172.21.15.114:0/3345347330 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f878006aea0 0x7f878006d360 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.023+0000 7f87a464f640 1 --2- 172.21.15.114:0/3345347330 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f879c0ccc00 0x7f879c14dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.023+0000 7f87a464f640 1 --2- 172.21.15.114:0/3345347330 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f87880051d0 0x7f879c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.023+0000 7f87a464f640 1 -- 172.21.15.114:0/3345347330 >> 172.21.15.114:0/3345347330 conn(0x7f879c0cb530 msgr2=0x7f879c0af960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:50.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.023+0000 7f87a464f640 1 -- 172.21.15.114:0/3345347330 shutdown_connections 2023-11-04T01:44:50.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.023+0000 7f87a464f640 1 -- 172.21.15.114:0/3345347330 wait complete. 2023-11-04T01:44:50.035 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:44:50.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.135+0000 7f7968555640 1 Processor -- start 2023-11-04T01:44:50.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.135+0000 7f7968555640 1 -- start start 2023-11-04T01:44:50.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.136+0000 7f7968555640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f796015d4e0 0x7f79600d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.136+0000 7f7968555640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f79600d3b60 0x7f79600d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.136+0000 7f7968555640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79600b32b0 con 0x7f796015d100 2023-11-04T01:44:50.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.136+0000 7f7968555640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79600cec20 con 0x7f79600d3b60 2023-11-04T01:44:50.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.136+0000 7f7968555640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79600cee10 con 0x7f796015d4e0 2023-11-04T01:44:50.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.136+0000 7f7966af2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f79600d3b60 0x7f79600d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.136+0000 7f7965af0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f796015d4e0 0x7f79600d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.137+0000 7f79662f1640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f796015d100 0x7f79600ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:43804/0 (socket says 172.21.15.114:43804) 2023-11-04T01:44:50.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.137+0000 7f7966af2640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f79600d3b60 0x7f79600d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:53166/0 (socket says 172.21.15.114:53166) 2023-11-04T01:44:50.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.137+0000 7f79662f1640 1 -- 172.21.15.114:0/1391136675 learned_addr learned my addr 172.21.15.114:0/1391136675 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:50.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.137+0000 7f79652ef640 1 -- 172.21.15.114:0/1391136675 <== mon.1 v1:172.21.15.141:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277828851 0 0) 0x7f79600b32b0 con 0x7f796015d100 2023-11-04T01:44:50.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.137+0000 7f79652ef640 1 -- 172.21.15.114:0/1391136675 --> v1:172.21.15.141:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f794c003520 con 0x7f796015d100 2023-11-04T01:44:50.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.137+0000 7f7965af0640 1 -- 172.21.15.114:0/1391136675 >> v2:172.21.15.141:3300/0 conn(0x7f79600d3b60 msgr2=0x7f79600d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:50.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.137+0000 7f7965af0640 1 --2- 172.21.15.114:0/1391136675 >> v2:172.21.15.141:3300/0 conn(0x7f79600d3b60 0x7f79600d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.137+0000 7f7965af0640 1 -- 172.21.15.114:0/1391136675 >> v1:172.21.15.141:6789/0 conn(0x7f796015d100 legacy=0x7f79600ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.137+0000 7f7965af0640 1 -- 172.21.15.114:0/1391136675 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79600b4750 con 0x7f796015d4e0 2023-11-04T01:44:50.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.137+0000 7f7966af2640 1 --2- 172.21.15.114:0/1391136675 >> v2:172.21.15.141:3300/0 conn(0x7f79600d3b60 0x7f79600d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:50.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.138+0000 7f7965af0640 1 --2- 172.21.15.114:0/1391136675 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f796015d4e0 0x7f79600d14d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79500097a0 tx=0x7f795002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8f79fd4ae60fd7e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.138+0000 7f79652ef640 1 -- 172.21.15.114:0/1391136675 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950031830 con 0x7f796015d4e0 2023-11-04T01:44:50.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.138+0000 7f79652ef640 1 -- 172.21.15.114:0/1391136675 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7950031990 con 0x7f796015d4e0 2023-11-04T01:44:50.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.138+0000 7f79652ef640 1 -- 172.21.15.114:0/1391136675 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950031d00 con 0x7f796015d4e0 2023-11-04T01:44:50.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.138+0000 7f7968555640 1 -- 172.21.15.114:0/1391136675 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f796015d4e0 msgr2=0x7f79600d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.138+0000 7f7968555640 1 --2- 172.21.15.114:0/1391136675 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f796015d4e0 0x7f79600d14d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79500097a0 tx=0x7f795002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.139+0000 7f7968555640 1 -- 172.21.15.114:0/1391136675 shutdown_connections 2023-11-04T01:44:50.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.139+0000 7f7968555640 1 --2- 172.21.15.114:0/1391136675 >> v2:172.21.15.141:3300/0 conn(0x7f79600d3b60 0x7f79600d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.139+0000 7f7968555640 1 --2- 172.21.15.114:0/1391136675 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f796015d4e0 0x7f79600d14d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.139+0000 7f7968555640 1 -- 172.21.15.114:0/1391136675 >> 172.21.15.114:0/1391136675 conn(0x7f79600d2ef0 msgr2=0x7f79600d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:50.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.139+0000 7f7968555640 1 -- 172.21.15.114:0/1391136675 shutdown_connections 2023-11-04T01:44:50.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.139+0000 7f7968555640 1 -- 172.21.15.114:0/1391136675 wait complete. 2023-11-04T01:44:50.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.140+0000 7f7968555640 1 Processor -- start 2023-11-04T01:44:50.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.140+0000 7f7968555640 1 -- start start 2023-11-04T01:44:50.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.140+0000 7f7968555640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79600d3b60 0x7f7960152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.140+0000 7f7968555640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f796015d100 0x7f7960154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.140+0000 7f7968555640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f796015d4e0 0x7f79601f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.140+0000 7f7968555640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7960153e70 con 0x7f796015d4e0 2023-11-04T01:44:50.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.140+0000 7f7968555640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79601548a0 con 0x7f796015d100 2023-11-04T01:44:50.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.140+0000 7f7968555640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79600cc370 con 0x7f79600d3b60 2023-11-04T01:44:50.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f7966af2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f796015d4e0 0x7f79601f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f7966af2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f796015d4e0 0x7f79601f27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39896/0 (socket says 172.21.15.114:39896) 2023-11-04T01:44:50.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f7966af2640 1 -- 172.21.15.114:0/2617876382 learned_addr learned my addr 172.21.15.114:0/2617876382 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:50.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f79662f1640 1 --2- 172.21.15.114:0/2617876382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79600d3b60 0x7f7960152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f7965af0640 1 --2- 172.21.15.114:0/2617876382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f796015d100 0x7f7960154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f7966af2640 1 -- 172.21.15.114:0/2617876382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79600d3b60 msgr2=0x7f7960152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f7966af2640 1 --2- 172.21.15.114:0/2617876382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79600d3b60 0x7f7960152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f7966af2640 1 -- 172.21.15.114:0/2617876382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f796015d100 msgr2=0x7f7960154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f7966af2640 1 --2- 172.21.15.114:0/2617876382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f796015d100 0x7f7960154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f7966af2640 1 -- 172.21.15.114:0/2617876382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7958009400 con 0x7f796015d4e0 2023-11-04T01:44:50.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f79662f1640 1 --2- 172.21.15.114:0/2617876382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79600d3b60 0x7f7960152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:50.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f7966af2640 1 --2- 172.21.15.114:0/2617876382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f796015d4e0 0x7f79601f27b0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f795800e930 tx=0x7f795800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f7956ffd640 1 -- 172.21.15.114:0/2617876382 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7958009700 con 0x7f796015d4e0 2023-11-04T01:44:50.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f7956ffd640 1 -- 172.21.15.114:0/2617876382 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795800ca00 con 0x7f796015d4e0 2023-11-04T01:44:50.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f7968555640 1 -- 172.21.15.114:0/2617876382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7950009400 con 0x7f796015d4e0 2023-11-04T01:44:50.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f7956ffd640 1 -- 172.21.15.114:0/2617876382 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795800cd90 con 0x7f796015d4e0 2023-11-04T01:44:50.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.141+0000 7f7968555640 1 -- 172.21.15.114:0/2617876382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79601f3630 con 0x7f796015d4e0 2023-11-04T01:44:50.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.142+0000 7f7968555640 1 -- 172.21.15.114:0/2617876382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79600ca780 con 0x7f796015d4e0 2023-11-04T01:44:50.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.143+0000 7f7956ffd640 1 -- 172.21.15.114:0/2617876382 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7958013470 con 0x7f796015d4e0 2023-11-04T01:44:50.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.143+0000 7f7956ffd640 1 --2- 172.21.15.114:0/2617876382 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f794406ae70 0x7f794406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.143+0000 7f7956ffd640 1 -- 172.21.15.114:0/2617876382 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f7958089ca0 con 0x7f796015d4e0 2023-11-04T01:44:50.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.143+0000 7f79662f1640 1 --2- 172.21.15.114:0/2617876382 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f794406ae70 0x7f794406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.143+0000 7f79662f1640 1 --2- 172.21.15.114:0/2617876382 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f794406ae70 0x7f794406d330 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f795c005c50 tx=0x7f795c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.147+0000 7f7956ffd640 1 -- 172.21.15.114:0/2617876382 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7958054410 con 0x7f796015d4e0 2023-11-04T01:44:50.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.310+0000 7f7968555640 1 -- 172.21.15.114:0/2617876382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f79600684b0 con 0x7f796015d4e0 2023-11-04T01:44:50.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.310+0000 7f7956ffd640 1 -- 172.21.15.114:0/2617876382 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v116) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7958057a30 con 0x7f796015d4e0 2023-11-04T01:44:50.312 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:44:50.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.312+0000 7f7968555640 1 -- 172.21.15.114:0/2617876382 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f794406ae70 msgr2=0x7f794406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.312+0000 7f7968555640 1 --2- 172.21.15.114:0/2617876382 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f794406ae70 0x7f794406d330 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f795c005c50 tx=0x7f795c009040 comp rx=0 tx=0).stop 2023-11-04T01:44:50.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.312+0000 7f7968555640 1 -- 172.21.15.114:0/2617876382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f796015d4e0 msgr2=0x7f79601f27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.312+0000 7f7968555640 1 --2- 172.21.15.114:0/2617876382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f796015d4e0 0x7f79601f27b0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f795800e930 tx=0x7f795800edf0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.312+0000 7f7968555640 1 -- 172.21.15.114:0/2617876382 shutdown_connections 2023-11-04T01:44:50.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.312+0000 7f7968555640 1 --2- 172.21.15.114:0/2617876382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f796015d4e0 0x7f79601f27b0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.312+0000 7f7968555640 1 --2- 172.21.15.114:0/2617876382 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f794406ae70 0x7f794406d330 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.312+0000 7f7968555640 1 --2- 172.21.15.114:0/2617876382 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f796015d100 0x7f7960154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.312+0000 7f7968555640 1 --2- 172.21.15.114:0/2617876382 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f79600d3b60 0x7f7960152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.312+0000 7f7968555640 1 -- 172.21.15.114:0/2617876382 >> 172.21.15.114:0/2617876382 conn(0x7f79600d2ef0 msgr2=0x7f79600b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:50.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.312+0000 7f7968555640 1 -- 172.21.15.114:0/2617876382 shutdown_connections 2023-11-04T01:44:50.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.312+0000 7f7968555640 1 -- 172.21.15.114:0/2617876382 wait complete. 2023-11-04T01:44:50.324 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:44:50.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.424+0000 7ff683ee0640 1 Processor -- start 2023-11-04T01:44:50.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.424+0000 7ff683ee0640 1 -- start start 2023-11-04T01:44:50.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.425+0000 7ff683ee0640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7ff67c15d100 0x7ff67c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.425+0000 7ff683ee0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67c0b32b0 con 0x7ff67c15d4e0 2023-11-04T01:44:50.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.425+0000 7ff683ee0640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67c0cee10 con 0x7ff67c0d1be0 2023-11-04T01:44:50.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.425+0000 7ff683ee0640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67c0b2980 con 0x7ff67c15d100 2023-11-04T01:44:50.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.425+0000 7ff68147b640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff67c15d4e0 0x7ff67c0d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34572/0 (socket says 172.21.15.114:34572) 2023-11-04T01:44:50.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.425+0000 7ff68147b640 1 -- 172.21.15.114:0/3580538037 learned_addr learned my addr 172.21.15.114:0/3580538037 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:50.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff680c7a640 1 -- 172.21.15.114:0/3580538037 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301357109 0 0) 0x7ff67c0b32b0 con 0x7ff67c15d4e0 2023-11-04T01:44:50.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff680c7a640 1 -- 172.21.15.114:0/3580538037 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff668003520 con 0x7ff67c15d4e0 2023-11-04T01:44:50.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff681c7c640 1 --2- 172.21.15.114:0/3580538037 >> v2:172.21.15.141:3300/0 conn(0x7ff67c15d100 0x7ff67c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff680c7a640 1 -- 172.21.15.114:0/3580538037 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 702989796 0 0) 0x7ff668003520 con 0x7ff67c15d4e0 2023-11-04T01:44:50.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff680c7a640 1 -- 172.21.15.114:0/3580538037 >> v2:172.21.15.141:3300/0 conn(0x7ff67c15d100 msgr2=0x7ff67c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:50.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff680c7a640 1 --2- 172.21.15.114:0/3580538037 >> v2:172.21.15.141:3300/0 conn(0x7ff67c15d100 0x7ff67c0ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff680c7a640 1 -- 172.21.15.114:0/3580538037 >> v1:172.21.15.141:6789/0 conn(0x7ff67c0d1be0 legacy=0x7ff67c0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:50.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff680c7a640 1 -- 172.21.15.114:0/3580538037 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c0b2c60 con 0x7ff67c15d4e0 2023-11-04T01:44:50.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff680c7a640 1 -- 172.21.15.114:0/3580538037 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7ff66c001670 con 0x7ff67c15d4e0 2023-11-04T01:44:50.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff681c7c640 1 --2- 172.21.15.114:0/3580538037 >> v2:172.21.15.141:3300/0 conn(0x7ff67c15d100 0x7ff67c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:50.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff680c7a640 1 -- 172.21.15.114:0/3580538037 >> v1:172.21.15.114:6789/0 conn(0x7ff67c15d4e0 legacy=0x7ff67c0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff680c7a640 1 --2- 172.21.15.114:0/3580538037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff668003970 0x7ff668003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff680c7a640 1 --2- 172.21.15.114:0/3580538037 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6680047c0 0x7ff668004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff680c7a640 1 --2- 172.21.15.114:0/3580538037 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff668005180 0x7ff66800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff680c7a640 1 -- 172.21.15.114:0/3580538037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0b2980 con 0x7ff668003970 2023-11-04T01:44:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff680c7a640 1 -- 172.21.15.114:0/3580538037 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66800c0d0 con 0x7ff6680047c0 2023-11-04T01:44:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff680c7a640 1 -- 172.21.15.114:0/3580538037 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66800c290 con 0x7ff668005180 2023-11-04T01:44:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff681c7c640 1 --2- 172.21.15.114:0/3580538037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff668003970 0x7ff668003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff68147b640 1 --2- 172.21.15.114:0/3580538037 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6680047c0 0x7ff668004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff68247d640 1 --2- 172.21.15.114:0/3580538037 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff668005180 0x7ff66800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff681c7c640 1 -- 172.21.15.114:0/3580538037 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff668005180 msgr2=0x7ff66800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:50.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff681c7c640 1 --2- 172.21.15.114:0/3580538037 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff668005180 0x7ff66800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff681c7c640 1 -- 172.21.15.114:0/3580538037 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6680047c0 msgr2=0x7ff668004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:50.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff681c7c640 1 --2- 172.21.15.114:0/3580538037 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff6680047c0 0x7ff668004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff681c7c640 1 -- 172.21.15.114:0/3580538037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff668003520 con 0x7ff668003970 2023-11-04T01:44:50.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.426+0000 7ff68247d640 1 -- 172.21.15.114:0/3580538037 reap_dead start 2023-11-04T01:44:50.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.427+0000 7ff681c7c640 1 --2- 172.21.15.114:0/3580538037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff668003970 0x7ff668003d90 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7ff678007430 tx=0x7ff6680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41d2b165d7d6be3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.427+0000 7ff680c7a640 1 -- 172.21.15.114:0/3580538037 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67802cda0 con 0x7ff668003970 2023-11-04T01:44:50.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.427+0000 7ff680c7a640 1 -- 172.21.15.114:0/3580538037 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff678034440 con 0x7ff668003970 2023-11-04T01:44:50.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.427+0000 7ff680c7a640 1 -- 172.21.15.114:0/3580538037 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6780347b0 con 0x7ff668003970 2023-11-04T01:44:50.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.428+0000 7ff683ee0640 1 -- 172.21.15.114:0/3580538037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff668003970 msgr2=0x7ff668003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.428+0000 7ff683ee0640 1 --2- 172.21.15.114:0/3580538037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff668003970 0x7ff668003d90 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7ff678007430 tx=0x7ff6680057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.428+0000 7ff683ee0640 1 -- 172.21.15.114:0/3580538037 shutdown_connections 2023-11-04T01:44:50.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.428+0000 7ff683ee0640 1 --2- 172.21.15.114:0/3580538037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff668003970 0x7ff668003d90 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.428+0000 7ff683ee0640 1 -- 172.21.15.114:0/3580538037 >> 172.21.15.114:0/3580538037 conn(0x7ff67c0d2ef0 msgr2=0x7ff67c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:50.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.428+0000 7ff683ee0640 1 -- 172.21.15.114:0/3580538037 shutdown_connections 2023-11-04T01:44:50.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.428+0000 7ff683ee0640 1 -- 172.21.15.114:0/3580538037 wait complete. 2023-11-04T01:44:50.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.429+0000 7ff683ee0640 1 Processor -- start 2023-11-04T01:44:50.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.429+0000 7ff683ee0640 1 -- start start 2023-11-04T01:44:50.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff683ee0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff668003970 0x7ff67c0cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff683ee0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff67c1f6040 0x7ff67c152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff683ee0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c0c9fc0 0x7ff67c15fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff683ee0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c1f2bc0 con 0x7ff67c0c9fc0 2023-11-04T01:44:50.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff683ee0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0cc650 con 0x7ff67c1f6040 2023-11-04T01:44:50.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff683ee0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c1f6500 con 0x7ff668003970 2023-11-04T01:44:50.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff68247d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c0c9fc0 0x7ff67c15fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff68247d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c0c9fc0 0x7ff67c15fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39910/0 (socket says 172.21.15.114:39910) 2023-11-04T01:44:50.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff68247d640 1 -- 172.21.15.114:0/3891542827 learned_addr learned my addr 172.21.15.114:0/3891542827 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:50.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff68147b640 1 --2- 172.21.15.114:0/3891542827 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff67c1f6040 0x7ff67c152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff681c7c640 1 --2- 172.21.15.114:0/3891542827 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff668003970 0x7ff67c0cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff68247d640 1 -- 172.21.15.114:0/3891542827 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff668003970 msgr2=0x7ff67c0cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff68247d640 1 --2- 172.21.15.114:0/3891542827 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff668003970 0x7ff67c0cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff68247d640 1 -- 172.21.15.114:0/3891542827 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff67c1f6040 msgr2=0x7ff67c152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff68247d640 1 --2- 172.21.15.114:0/3891542827 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff67c1f6040 0x7ff67c152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff68247d640 1 -- 172.21.15.114:0/3891542827 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c1f67e0 con 0x7ff67c0c9fc0 2023-11-04T01:44:50.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff68147b640 1 --2- 172.21.15.114:0/3891542827 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff67c1f6040 0x7ff67c152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:50.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff681c7c640 1 --2- 172.21.15.114:0/3891542827 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff668003970 0x7ff67c0cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:50.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff68247d640 1 --2- 172.21.15.114:0/3891542827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c0c9fc0 0x7ff67c15fb10 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7ff67c15d8c0 tx=0x7ff67400e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff6727fc640 1 -- 172.21.15.114:0/3891542827 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6740050d0 con 0x7ff67c0c9fc0 2023-11-04T01:44:50.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff6727fc640 1 -- 172.21.15.114:0/3891542827 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff674005250 con 0x7ff67c0c9fc0 2023-11-04T01:44:50.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.430+0000 7ff6727fc640 1 -- 172.21.15.114:0/3891542827 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6740035f0 con 0x7ff67c0c9fc0 2023-11-04T01:44:50.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.431+0000 7ff683ee0640 1 -- 172.21.15.114:0/3891542827 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67c1f6ac0 con 0x7ff67c0c9fc0 2023-11-04T01:44:50.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.431+0000 7ff683ee0640 1 -- 172.21.15.114:0/3891542827 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67c1528c0 con 0x7ff67c0c9fc0 2023-11-04T01:44:50.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.432+0000 7ff683ee0640 1 -- 172.21.15.114:0/3891542827 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67c1f2d00 con 0x7ff67c0c9fc0 2023-11-04T01:44:50.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.432+0000 7ff6727fc640 1 -- 172.21.15.114:0/3891542827 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff674003750 con 0x7ff67c0c9fc0 2023-11-04T01:44:50.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.432+0000 7ff6727fc640 1 --2- 172.21.15.114:0/3891542827 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff66006aea0 0x7ff66006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.432+0000 7ff6727fc640 1 -- 172.21.15.114:0/3891542827 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7ff6740894a0 con 0x7ff67c0c9fc0 2023-11-04T01:44:50.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.432+0000 7ff681c7c640 1 --2- 172.21.15.114:0/3891542827 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff66006aea0 0x7ff66006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.433+0000 7ff681c7c640 1 --2- 172.21.15.114:0/3891542827 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff66006aea0 0x7ff66006d360 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff678036000 tx=0x7ff678030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.436+0000 7ff6727fc640 1 -- 172.21.15.114:0/3891542827 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff67c1f2d00 con 0x7ff67c0c9fc0 2023-11-04T01:44:50.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.601+0000 7ff683ee0640 1 -- 172.21.15.114:0/3891542827 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7ff67c1f2d00 con 0x7ff67c0c9fc0 2023-11-04T01:44:50.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.602+0000 7ff6727fc640 1 -- 172.21.15.114:0/3891542827 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v116) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff67c1f2d00 con 0x7ff67c0c9fc0 2023-11-04T01:44:50.603 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:44:50.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.603+0000 7ff683ee0640 1 -- 172.21.15.114:0/3891542827 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff66006aea0 msgr2=0x7ff66006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.603+0000 7ff683ee0640 1 --2- 172.21.15.114:0/3891542827 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff66006aea0 0x7ff66006d360 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff678036000 tx=0x7ff678030000 comp rx=0 tx=0).stop 2023-11-04T01:44:50.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.603+0000 7ff683ee0640 1 -- 172.21.15.114:0/3891542827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c0c9fc0 msgr2=0x7ff67c15fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.603+0000 7ff683ee0640 1 --2- 172.21.15.114:0/3891542827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c0c9fc0 0x7ff67c15fb10 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7ff67c15d8c0 tx=0x7ff67400e610 comp rx=0 tx=0).stop 2023-11-04T01:44:50.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.603+0000 7ff683ee0640 1 -- 172.21.15.114:0/3891542827 shutdown_connections 2023-11-04T01:44:50.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.603+0000 7ff683ee0640 1 --2- 172.21.15.114:0/3891542827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c0c9fc0 0x7ff67c15fb10 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.603+0000 7ff683ee0640 1 --2- 172.21.15.114:0/3891542827 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7ff66006aea0 0x7ff66006d360 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.603+0000 7ff683ee0640 1 --2- 172.21.15.114:0/3891542827 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7ff67c1f6040 0x7ff67c152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.603+0000 7ff683ee0640 1 --2- 172.21.15.114:0/3891542827 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7ff668003970 0x7ff67c0cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.603+0000 7ff683ee0640 1 -- 172.21.15.114:0/3891542827 >> 172.21.15.114:0/3891542827 conn(0x7ff67c0d2ef0 msgr2=0x7ff67c0b0350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:50.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.604+0000 7ff683ee0640 1 -- 172.21.15.114:0/3891542827 shutdown_connections 2023-11-04T01:44:50.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.604+0000 7ff683ee0640 1 -- 172.21.15.114:0/3891542827 wait complete. 2023-11-04T01:44:50.616 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:44:50.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.718+0000 7f8fbc856640 1 Processor -- start 2023-11-04T01:44:50.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.718+0000 7f8fbc856640 1 -- start start 2023-11-04T01:44:50.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.719+0000 7f8fbc856640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fb80b2210 0x7f8fb80cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.719+0000 7f8fbc856640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8fb815d630 0x7f8fb80cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.719+0000 7f8fbc856640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb80b0150 con 0x7f8fb80ceda0 2023-11-04T01:44:50.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.719+0000 7f8fbc856640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb80b1df0 con 0x7f8fb815d630 2023-11-04T01:44:50.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.719+0000 7f8fbc856640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb80b1170 con 0x7f8fb80b2210 2023-11-04T01:44:50.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.719+0000 7f8fb6d9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8fb815d630 0x7f8fb80cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.719+0000 7f8fb659c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8fb80ceda0 0x7f8fb815cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34580/0 (socket says 172.21.15.114:34580) 2023-11-04T01:44:50.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.719+0000 7f8fb659c640 1 -- 172.21.15.114:0/1899700641 learned_addr learned my addr 172.21.15.114:0/1899700641 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:50.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.719+0000 7f8faffff640 1 --2- 172.21.15.114:0/1899700641 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fb80b2210 0x7f8fb80cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.719+0000 7f8fb6d9d640 1 -- 172.21.15.114:0/1899700641 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fb80b2210 msgr2=0x7f8fb80cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:50.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.719+0000 7f8fb6d9d640 1 --2- 172.21.15.114:0/1899700641 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fb80b2210 0x7f8fb80cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.719+0000 7f8fb6d9d640 1 -- 172.21.15.114:0/1899700641 >> v1:172.21.15.114:6789/0 conn(0x7f8fb80ceda0 legacy=0x7f8fb815cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.719+0000 7f8fb6d9d640 1 -- 172.21.15.114:0/1899700641 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb80b1450 con 0x7f8fb815d630 2023-11-04T01:44:50.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.719+0000 7f8fb5d9b640 1 -- 172.21.15.114:0/1899700641 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016029942 0 0) 0x7f8fb80b0150 con 0x7f8fb80ceda0 2023-11-04T01:44:50.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.719+0000 7f8faffff640 1 --2- 172.21.15.114:0/1899700641 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fb80b2210 0x7f8fb80cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:50.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.720+0000 7f8fb6d9d640 1 --2- 172.21.15.114:0/1899700641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb815d630 0x7f8fb80cf6c0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009d90 tx=0x7f8fb002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc83562cf31da4a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.720+0000 7f8fb5d9b640 1 -- 172.21.15.114:0/1899700641 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb002cbc0 con 0x7f8fb815d630 2023-11-04T01:44:50.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.720+0000 7f8fb5d9b640 1 -- 172.21.15.114:0/1899700641 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb002cd20 con 0x7f8fb815d630 2023-11-04T01:44:50.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.720+0000 7f8fb5d9b640 1 -- 172.21.15.114:0/1899700641 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0034660 con 0x7f8fb815d630 2023-11-04T01:44:50.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.720+0000 7f8fbc856640 1 -- 172.21.15.114:0/1899700641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb815d630 msgr2=0x7f8fb80cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.720+0000 7f8fbc856640 1 --2- 172.21.15.114:0/1899700641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb815d630 0x7f8fb80cf6c0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009d90 tx=0x7f8fb002be10 comp rx=0 tx=0).stop 2023-11-04T01:44:50.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.720+0000 7f8fbc856640 1 -- 172.21.15.114:0/1899700641 shutdown_connections 2023-11-04T01:44:50.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.720+0000 7f8fbc856640 1 --2- 172.21.15.114:0/1899700641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb815d630 0x7f8fb80cf6c0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.720+0000 7f8fbc856640 1 --2- 172.21.15.114:0/1899700641 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fb80b2210 0x7f8fb80cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.720+0000 7f8fbc856640 1 -- 172.21.15.114:0/1899700641 >> 172.21.15.114:0/1899700641 conn(0x7f8fb80d0c30 msgr2=0x7f8fb80d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:50.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.720+0000 7f8fbc856640 1 -- 172.21.15.114:0/1899700641 shutdown_connections 2023-11-04T01:44:50.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.721+0000 7f8fbc856640 1 -- 172.21.15.114:0/1899700641 wait complete. 2023-11-04T01:44:50.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.722+0000 7f8fbc856640 1 Processor -- start 2023-11-04T01:44:50.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.722+0000 7f8fbc856640 1 -- start start 2023-11-04T01:44:50.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.722+0000 7f8fbc856640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fb80b2210 0x7f8fb81500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.722+0000 7f8fbc856640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb80ceda0 0x7f8fb80cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.722+0000 7f8fbc856640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8fb815d630 0x7f8fb80cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.722+0000 7f8fbc856640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb80cb260 con 0x7f8fb80ceda0 2023-11-04T01:44:50.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.722+0000 7f8fbc856640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb81505e0 con 0x7f8fb815d630 2023-11-04T01:44:50.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.722+0000 7f8fbc856640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb80cb4b0 con 0x7f8fb80b2210 2023-11-04T01:44:50.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.723+0000 7f8faffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb80ceda0 0x7f8fb80cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.723+0000 7f8faffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb80ceda0 0x7f8fb80cd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39920/0 (socket says 172.21.15.114:39920) 2023-11-04T01:44:50.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.723+0000 7f8faffff640 1 -- 172.21.15.114:0/3447264462 learned_addr learned my addr 172.21.15.114:0/3447264462 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:50.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.723+0000 7f8fb659c640 1 --2- 172.21.15.114:0/3447264462 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fb80b2210 0x7f8fb81500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.723+0000 7f8fb6d9d640 1 --2- 172.21.15.114:0/3447264462 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8fb815d630 0x7f8fb80cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.723+0000 7f8faffff640 1 -- 172.21.15.114:0/3447264462 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fb80b2210 msgr2=0x7f8fb81500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.723+0000 7f8faffff640 1 --2- 172.21.15.114:0/3447264462 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fb80b2210 0x7f8fb81500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.723+0000 7f8faffff640 1 -- 172.21.15.114:0/3447264462 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8fb815d630 msgr2=0x7f8fb80cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.723+0000 7f8faffff640 1 --2- 172.21.15.114:0/3447264462 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8fb815d630 0x7f8fb80cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.723+0000 7f8faffff640 1 -- 172.21.15.114:0/3447264462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb0009a70 con 0x7f8fb80ceda0 2023-11-04T01:44:50.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.723+0000 7f8faffff640 1 --2- 172.21.15.114:0/3447264462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb80ceda0 0x7f8fb80cd1e0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000c7f0 tx=0x7f8fa000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.723+0000 7f8faeffd640 1 -- 172.21.15.114:0/3447264462 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0007820 con 0x7f8fb80ceda0 2023-11-04T01:44:50.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.723+0000 7f8faeffd640 1 -- 172.21.15.114:0/3447264462 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa0007980 con 0x7f8fb80ceda0 2023-11-04T01:44:50.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.723+0000 7f8fbc856640 1 -- 172.21.15.114:0/3447264462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb80cb790 con 0x7f8fb80ceda0 2023-11-04T01:44:50.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.723+0000 7f8faeffd640 1 -- 172.21.15.114:0/3447264462 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0007cf0 con 0x7f8fb80ceda0 2023-11-04T01:44:50.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.723+0000 7f8fbc856640 1 -- 172.21.15.114:0/3447264462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb80cbd50 con 0x7f8fb80ceda0 2023-11-04T01:44:50.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.724+0000 7f8fbc856640 1 -- 172.21.15.114:0/3447264462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb80684b0 con 0x7f8fb80ceda0 2023-11-04T01:44:50.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.725+0000 7f8faeffd640 1 -- 172.21.15.114:0/3447264462 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8fa00113f0 con 0x7f8fb80ceda0 2023-11-04T01:44:50.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.725+0000 7f8faeffd640 1 --2- 172.21.15.114:0/3447264462 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8f9806ae40 0x7f8f9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.725+0000 7f8faeffd640 1 -- 172.21.15.114:0/3447264462 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f8fa008a360 con 0x7f8fb80ceda0 2023-11-04T01:44:50.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.725+0000 7f8fb659c640 1 --2- 172.21.15.114:0/3447264462 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8f9806ae40 0x7f8f9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.725+0000 7f8fb659c640 1 --2- 172.21.15.114:0/3447264462 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8f9806ae40 0x7f8f9806d300 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8001670 tx=0x7f8fa8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.729+0000 7f8faeffd640 1 -- 172.21.15.114:0/3447264462 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8fa0054a00 con 0x7f8fb80ceda0 2023-11-04T01:44:50.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.894+0000 7f8fbc856640 1 -- 172.21.15.114:0/3447264462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8fb80af890 con 0x7f8fb80ceda0 2023-11-04T01:44:50.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.894+0000 7f8faeffd640 1 -- 172.21.15.114:0/3447264462 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8fa001f020 con 0x7f8fb80ceda0 2023-11-04T01:44:50.896 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:44:50.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.896+0000 7f8fbc856640 1 -- 172.21.15.114:0/3447264462 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8f9806ae40 msgr2=0x7f8f9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.896+0000 7f8fbc856640 1 --2- 172.21.15.114:0/3447264462 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8f9806ae40 0x7f8f9806d300 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8001670 tx=0x7f8fa8009040 comp rx=0 tx=0).stop 2023-11-04T01:44:50.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.896+0000 7f8fbc856640 1 -- 172.21.15.114:0/3447264462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb80ceda0 msgr2=0x7f8fb80cd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.896+0000 7f8fbc856640 1 --2- 172.21.15.114:0/3447264462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb80ceda0 0x7f8fb80cd1e0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000c7f0 tx=0x7f8fa000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.896+0000 7f8fbc856640 1 -- 172.21.15.114:0/3447264462 shutdown_connections 2023-11-04T01:44:50.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.896+0000 7f8fbc856640 1 --2- 172.21.15.114:0/3447264462 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f8f9806ae40 0x7f8f9806d300 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.896+0000 7f8fbc856640 1 --2- 172.21.15.114:0/3447264462 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f8fb815d630 0x7f8fb80cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.896+0000 7f8fbc856640 1 --2- 172.21.15.114:0/3447264462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb80ceda0 0x7f8fb80cd1e0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.896+0000 7f8fbc856640 1 --2- 172.21.15.114:0/3447264462 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f8fb80b2210 0x7f8fb81500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.896+0000 7f8fbc856640 1 -- 172.21.15.114:0/3447264462 >> 172.21.15.114:0/3447264462 conn(0x7f8fb80d0c30 msgr2=0x7f8fb81e2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:50.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.896+0000 7f8fbc856640 1 -- 172.21.15.114:0/3447264462 shutdown_connections 2023-11-04T01:44:50.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:50.896+0000 7f8fbc856640 1 -- 172.21.15.114:0/3447264462 wait complete. 2023-11-04T01:44:50.909 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:44:51.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.009+0000 7fab15244640 1 Processor -- start 2023-11-04T01:44:51.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.009+0000 7fab15244640 1 -- start start 2023-11-04T01:44:51.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.010+0000 7fab15244640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fab1006b740 0x7fab1006c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.010+0000 7fab15244640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab100ad6a0 con 0x7fab1015ade0 2023-11-04T01:44:51.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.010+0000 7fab15244640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab100acaf0 con 0x7fab100b1440 2023-11-04T01:44:51.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.010+0000 7fab15244640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab100acdd0 con 0x7fab1006b740 2023-11-04T01:44:51.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.010+0000 7fab0ed9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fab1015ade0 0x7fab100b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34586/0 (socket says 172.21.15.114:34586) 2023-11-04T01:44:51.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.010+0000 7fab0ed9d640 1 -- 172.21.15.114:0/4275238764 learned_addr learned my addr 172.21.15.114:0/4275238764 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:51.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.010+0000 7fab0dd9b640 1 -- 172.21.15.114:0/4275238764 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092940867 0 0) 0x7fab100ad6a0 con 0x7fab1015ade0 2023-11-04T01:44:51.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.010+0000 7fab0dd9b640 1 -- 172.21.15.114:0/4275238764 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaf8003520 con 0x7fab1015ade0 2023-11-04T01:44:51.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.010+0000 7fab0f59e640 1 --2- 172.21.15.114:0/4275238764 >> v2:172.21.15.141:3300/0 conn(0x7fab1006b740 0x7fab1006c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0dd9b640 1 -- 172.21.15.114:0/4275238764 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2750462185 0 0) 0x7faaf8003520 con 0x7fab1015ade0 2023-11-04T01:44:51.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0dd9b640 1 -- 172.21.15.114:0/4275238764 >> v2:172.21.15.141:3300/0 conn(0x7fab1006b740 msgr2=0x7fab1006c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:51.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0dd9b640 1 --2- 172.21.15.114:0/4275238764 >> v2:172.21.15.141:3300/0 conn(0x7fab1006b740 0x7fab1006c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0dd9b640 1 -- 172.21.15.114:0/4275238764 >> v1:172.21.15.141:6789/0 conn(0x7fab100b1440 legacy=0x7fab1006a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:51.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0dd9b640 1 -- 172.21.15.114:0/4275238764 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab100ad0e0 con 0x7fab1015ade0 2023-11-04T01:44:51.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0dd9b640 1 -- 172.21.15.114:0/4275238764 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7fab00001b70 con 0x7fab1015ade0 2023-11-04T01:44:51.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0dd9b640 1 -- 172.21.15.114:0/4275238764 >> v1:172.21.15.114:6789/0 conn(0x7fab1015ade0 legacy=0x7fab100b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0dd9b640 1 --2- 172.21.15.114:0/4275238764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faaf8003970 0x7faaf8003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0dd9b640 1 --2- 172.21.15.114:0/4275238764 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faaf80047c0 0x7faaf8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0dd9b640 1 --2- 172.21.15.114:0/4275238764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf80052a0 0x7faaf800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0dd9b640 1 -- 172.21.15.114:0/4275238764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab100acdd0 con 0x7faaf80052a0 2023-11-04T01:44:51.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0dd9b640 1 -- 172.21.15.114:0/4275238764 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf800c150 con 0x7faaf80047c0 2023-11-04T01:44:51.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0dd9b640 1 -- 172.21.15.114:0/4275238764 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf800c310 con 0x7faaf8003970 2023-11-04T01:44:51.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0f59e640 1 --2- 172.21.15.114:0/4275238764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf80052a0 0x7faaf800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0e59c640 1 --2- 172.21.15.114:0/4275238764 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faaf80047c0 0x7faaf8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0ed9d640 1 --2- 172.21.15.114:0/4275238764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faaf8003970 0x7faaf8003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0f59e640 1 -- 172.21.15.114:0/4275238764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faaf8003970 msgr2=0x7faaf8003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:51.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0f59e640 1 --2- 172.21.15.114:0/4275238764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faaf8003970 0x7faaf8003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0f59e640 1 -- 172.21.15.114:0/4275238764 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faaf80047c0 msgr2=0x7faaf8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:51.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0f59e640 1 --2- 172.21.15.114:0/4275238764 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7faaf80047c0 0x7faaf8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0f59e640 1 -- 172.21.15.114:0/4275238764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf8003520 con 0x7faaf80052a0 2023-11-04T01:44:51.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.011+0000 7fab0ed9d640 1 --2- 172.21.15.114:0/4275238764 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faaf8003970 0x7faaf8003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:51.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.012+0000 7fab0f59e640 1 -- 172.21.15.114:0/4275238764 reap_dead start 2023-11-04T01:44:51.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.012+0000 7fab0f59e640 1 --2- 172.21.15.114:0/4275238764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf80052a0 0x7faaf800b980 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fab0800ba00 tx=0x7faaf80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe036aed2cb847d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:51.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.012+0000 7fab0dd9b640 1 -- 172.21.15.114:0/4275238764 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab08004020 con 0x7faaf80052a0 2023-11-04T01:44:51.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.012+0000 7fab0dd9b640 1 -- 172.21.15.114:0/4275238764 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab08004180 con 0x7faaf80052a0 2023-11-04T01:44:51.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.012+0000 7fab0dd9b640 1 -- 172.21.15.114:0/4275238764 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab08003610 con 0x7faaf80052a0 2023-11-04T01:44:51.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.012+0000 7fab15244640 1 -- 172.21.15.114:0/4275238764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf80052a0 msgr2=0x7faaf800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.012+0000 7fab15244640 1 --2- 172.21.15.114:0/4275238764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf80052a0 0x7faaf800b980 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fab0800ba00 tx=0x7faaf80057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.012+0000 7fab15244640 1 -- 172.21.15.114:0/4275238764 shutdown_connections 2023-11-04T01:44:51.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.012+0000 7fab15244640 1 --2- 172.21.15.114:0/4275238764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf80052a0 0x7faaf800b980 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.012+0000 7fab15244640 1 -- 172.21.15.114:0/4275238764 >> 172.21.15.114:0/4275238764 conn(0x7fab100cbd30 msgr2=0x7fab100cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:51.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.013+0000 7fab15244640 1 -- 172.21.15.114:0/4275238764 shutdown_connections 2023-11-04T01:44:51.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.013+0000 7fab15244640 1 -- 172.21.15.114:0/4275238764 wait complete. 2023-11-04T01:44:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.014+0000 7fab15244640 1 Processor -- start 2023-11-04T01:44:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.014+0000 7fab15244640 1 -- start start 2023-11-04T01:44:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab15244640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faaf80052a0 0x7fab101557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab15244640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab100c7c20 0x7fab100c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab15244640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab10071260 0x7fab100716e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab15244640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab10071c20 con 0x7fab10071260 2023-11-04T01:44:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab15244640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab10099d90 con 0x7fab100c7c20 2023-11-04T01:44:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab15244640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1009a910 con 0x7faaf80052a0 2023-11-04T01:44:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab0f59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab10071260 0x7fab100716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab0f59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab10071260 0x7fab100716e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39934/0 (socket says 172.21.15.114:39934) 2023-11-04T01:44:51.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab0f59e640 1 -- 172.21.15.114:0/3673258615 learned_addr learned my addr 172.21.15.114:0/3673258615 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:51.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab0e59c640 1 --2- 172.21.15.114:0/3673258615 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab100c7c20 0x7fab100c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab0ed9d640 1 --2- 172.21.15.114:0/3673258615 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faaf80052a0 0x7fab101557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab0f59e640 1 -- 172.21.15.114:0/3673258615 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faaf80052a0 msgr2=0x7fab101557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab0f59e640 1 --2- 172.21.15.114:0/3673258615 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faaf80052a0 0x7fab101557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab0f59e640 1 -- 172.21.15.114:0/3673258615 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab100c7c20 msgr2=0x7fab100c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab0f59e640 1 --2- 172.21.15.114:0/3673258615 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab100c7c20 0x7fab100c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab0f59e640 1 -- 172.21.15.114:0/3673258615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab10099fe0 con 0x7fab10071260 2023-11-04T01:44:51.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab0e59c640 1 --2- 172.21.15.114:0/3673258615 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab100c7c20 0x7fab100c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:51.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab0f59e640 1 --2- 172.21.15.114:0/3673258615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab10071260 0x7fab100716e0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fab0800baf0 tx=0x7fab08004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:51.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7faaf77fe640 1 -- 172.21.15.114:0/3673258615 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab08004500 con 0x7fab10071260 2023-11-04T01:44:51.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7faaf77fe640 1 -- 172.21.15.114:0/3673258615 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0803b440 con 0x7fab10071260 2023-11-04T01:44:51.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7fab15244640 1 -- 172.21.15.114:0/3673258615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1009a2c0 con 0x7fab10071260 2023-11-04T01:44:51.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.015+0000 7faaf77fe640 1 -- 172.21.15.114:0/3673258615 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0803b5d0 con 0x7fab10071260 2023-11-04T01:44:51.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.016+0000 7fab15244640 1 -- 172.21.15.114:0/3673258615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab10155cf0 con 0x7fab10071260 2023-11-04T01:44:51.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.016+0000 7fab15244640 1 -- 172.21.15.114:0/3673258615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab100684b0 con 0x7fab10071260 2023-11-04T01:44:51.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.017+0000 7faaf77fe640 1 -- 172.21.15.114:0/3673258615 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab0803b730 con 0x7fab10071260 2023-11-04T01:44:51.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.017+0000 7faaf77fe640 1 --2- 172.21.15.114:0/3673258615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faafc06aea0 0x7faafc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.017+0000 7faaf77fe640 1 -- 172.21.15.114:0/3673258615 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7fab080abb90 con 0x7fab10071260 2023-11-04T01:44:51.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.017+0000 7fab0ed9d640 1 --2- 172.21.15.114:0/3673258615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faafc06aea0 0x7faafc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.018+0000 7fab0ed9d640 1 --2- 172.21.15.114:0/3673258615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faafc06aea0 0x7faafc06d360 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fab00002230 tx=0x7fab00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:51.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.021+0000 7faaf77fe640 1 -- 172.21.15.114:0/3673258615 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fab080761a0 con 0x7fab10071260 2023-11-04T01:44:51.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.187+0000 7fab15244640 1 -- 172.21.15.114:0/3673258615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab1009aa50 con 0x7fab10071260 2023-11-04T01:44:51.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.187+0000 7faaf77fe640 1 -- 172.21.15.114:0/3673258615 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab080360a0 con 0x7fab10071260 2023-11-04T01:44:51.189 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:44:51.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.189+0000 7fab15244640 1 -- 172.21.15.114:0/3673258615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faafc06aea0 msgr2=0x7faafc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.189+0000 7fab15244640 1 --2- 172.21.15.114:0/3673258615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faafc06aea0 0x7faafc06d360 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fab00002230 tx=0x7fab00009040 comp rx=0 tx=0).stop 2023-11-04T01:44:51.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.189+0000 7fab15244640 1 -- 172.21.15.114:0/3673258615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab10071260 msgr2=0x7fab100716e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.189+0000 7fab15244640 1 --2- 172.21.15.114:0/3673258615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab10071260 0x7fab100716e0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fab0800baf0 tx=0x7fab08004730 comp rx=0 tx=0).stop 2023-11-04T01:44:51.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.189+0000 7fab15244640 1 -- 172.21.15.114:0/3673258615 shutdown_connections 2023-11-04T01:44:51.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.189+0000 7fab15244640 1 --2- 172.21.15.114:0/3673258615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab10071260 0x7fab100716e0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.189+0000 7fab15244640 1 --2- 172.21.15.114:0/3673258615 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7faafc06aea0 0x7faafc06d360 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.189+0000 7fab15244640 1 --2- 172.21.15.114:0/3673258615 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fab100c7c20 0x7fab100c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.189+0000 7fab15244640 1 --2- 172.21.15.114:0/3673258615 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7faaf80052a0 0x7fab101557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.189+0000 7fab15244640 1 -- 172.21.15.114:0/3673258615 >> 172.21.15.114:0/3673258615 conn(0x7fab100cbd30 msgr2=0x7fab100b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:51.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.189+0000 7fab15244640 1 -- 172.21.15.114:0/3673258615 shutdown_connections 2023-11-04T01:44:51.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.189+0000 7fab15244640 1 -- 172.21.15.114:0/3673258615 wait complete. 2023-11-04T01:44:51.202 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:44:51.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.301+0000 7f82c8961640 1 Processor -- start 2023-11-04T01:44:51.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.301+0000 7f82c8961640 1 -- start start 2023-11-04T01:44:51.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.302+0000 7f82c8961640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f82c40b2210 0x7f82c40cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.302+0000 7f82c8961640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c40b0150 con 0x7f82c415d630 2023-11-04T01:44:51.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.302+0000 7f82c8961640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c40b1170 con 0x7f82c40ceda0 2023-11-04T01:44:51.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.302+0000 7f82c8961640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c40b1df0 con 0x7f82c40b2210 2023-11-04T01:44:51.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.302+0000 7f82c2d9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f82c415d630 0x7f82c40cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34588/0 (socket says 172.21.15.114:34588) 2023-11-04T01:44:51.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.302+0000 7f82c2d9d640 1 -- 172.21.15.114:0/407799657 learned_addr learned my addr 172.21.15.114:0/407799657 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:51.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.302+0000 7f82c1d9b640 1 --2- 172.21.15.114:0/407799657 >> v2:172.21.15.141:3300/0 conn(0x7f82c40b2210 0x7f82c40cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.302+0000 7f82c159a640 1 -- 172.21.15.114:0/407799657 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324435182 0 0) 0x7f82c40b0150 con 0x7f82c415d630 2023-11-04T01:44:51.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c159a640 1 -- 172.21.15.114:0/407799657 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82ac003520 con 0x7f82c415d630 2023-11-04T01:44:51.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c159a640 1 -- 172.21.15.114:0/407799657 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4164919165 0 0) 0x7f82ac003520 con 0x7f82c415d630 2023-11-04T01:44:51.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c159a640 1 -- 172.21.15.114:0/407799657 >> v2:172.21.15.141:3300/0 conn(0x7f82c40b2210 msgr2=0x7f82c40cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:51.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c159a640 1 --2- 172.21.15.114:0/407799657 >> v2:172.21.15.141:3300/0 conn(0x7f82c40b2210 0x7f82c40cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c159a640 1 -- 172.21.15.114:0/407799657 >> v1:172.21.15.141:6789/0 conn(0x7f82c40ceda0 legacy=0x7f82c415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c159a640 1 -- 172.21.15.114:0/407799657 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c40b1450 con 0x7f82c415d630 2023-11-04T01:44:51.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c159a640 1 -- 172.21.15.114:0/407799657 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f82bc001690 con 0x7f82c415d630 2023-11-04T01:44:51.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c159a640 1 -- 172.21.15.114:0/407799657 >> v1:172.21.15.114:6789/0 conn(0x7f82c415d630 legacy=0x7f82c40cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c159a640 1 --2- 172.21.15.114:0/407799657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac003970 0x7f82ac003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c159a640 1 --2- 172.21.15.114:0/407799657 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82ac0047c0 0x7f82ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c159a640 1 --2- 172.21.15.114:0/407799657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82ac0051d0 0x7f82ac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c159a640 1 -- 172.21.15.114:0/407799657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c40b1df0 con 0x7f82ac003970 2023-11-04T01:44:51.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c159a640 1 -- 172.21.15.114:0/407799657 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac00c120 con 0x7f82ac0047c0 2023-11-04T01:44:51.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c159a640 1 -- 172.21.15.114:0/407799657 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac00c2e0 con 0x7f82ac0051d0 2023-11-04T01:44:51.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c259c640 1 --2- 172.21.15.114:0/407799657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac003970 0x7f82ac003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c1d9b640 1 --2- 172.21.15.114:0/407799657 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82ac0047c0 0x7f82ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c2d9d640 1 --2- 172.21.15.114:0/407799657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82ac0051d0 0x7f82ac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c259c640 1 -- 172.21.15.114:0/407799657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82ac0051d0 msgr2=0x7f82ac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:51.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c259c640 1 --2- 172.21.15.114:0/407799657 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82ac0051d0 0x7f82ac00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c259c640 1 -- 172.21.15.114:0/407799657 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82ac0047c0 msgr2=0x7f82ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:51.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c259c640 1 --2- 172.21.15.114:0/407799657 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82ac0047c0 0x7f82ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c259c640 1 -- 172.21.15.114:0/407799657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac003520 con 0x7f82ac003970 2023-11-04T01:44:51.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.303+0000 7f82c2d9d640 1 -- 172.21.15.114:0/407799657 reap_dead start 2023-11-04T01:44:51.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.304+0000 7f82c259c640 1 --2- 172.21.15.114:0/407799657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac003970 0x7f82ac003d50 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f82b4001fb0 tx=0x7f82ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c59d3ae89657c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:51.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.304+0000 7f82c159a640 1 -- 172.21.15.114:0/407799657 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b402d6f0 con 0x7f82ac003970 2023-11-04T01:44:51.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.304+0000 7f82c159a640 1 -- 172.21.15.114:0/407799657 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b402d870 con 0x7f82ac003970 2023-11-04T01:44:51.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.304+0000 7f82c159a640 1 -- 172.21.15.114:0/407799657 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b402dc20 con 0x7f82ac003970 2023-11-04T01:44:51.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.305+0000 7f82c8961640 1 -- 172.21.15.114:0/407799657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac003970 msgr2=0x7f82ac003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.305+0000 7f82c8961640 1 --2- 172.21.15.114:0/407799657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac003970 0x7f82ac003d50 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f82b4001fb0 tx=0x7f82ac0057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.305+0000 7f82c8961640 1 -- 172.21.15.114:0/407799657 shutdown_connections 2023-11-04T01:44:51.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.305+0000 7f82c8961640 1 --2- 172.21.15.114:0/407799657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac003970 0x7f82ac003d50 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.305+0000 7f82c8961640 1 -- 172.21.15.114:0/407799657 >> 172.21.15.114:0/407799657 conn(0x7f82c40d0c30 msgr2=0x7f82c40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:51.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.305+0000 7f82c8961640 1 -- 172.21.15.114:0/407799657 shutdown_connections 2023-11-04T01:44:51.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.305+0000 7f82c8961640 1 -- 172.21.15.114:0/407799657 wait complete. 2023-11-04T01:44:51.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.306+0000 7f82c8961640 1 Processor -- start 2023-11-04T01:44:51.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.306+0000 7f82c8961640 1 -- start start 2023-11-04T01:44:51.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c8961640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82ac003970 0x7f82c40cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c8961640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82c415b270 0x7f82c40af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c8961640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82c40af9f0 0x7f82c40c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c8961640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c40afe80 con 0x7f82c415b270 2023-11-04T01:44:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c8961640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c40cc2c0 con 0x7f82ac003970 2023-11-04T01:44:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c8961640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c40cb6b0 con 0x7f82c40af9f0 2023-11-04T01:44:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82c415b270 0x7f82c40af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c1d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82c415b270 0x7f82c40af4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39942/0 (socket says 172.21.15.114:39942) 2023-11-04T01:44:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c1d9b640 1 -- 172.21.15.114:0/849630106 learned_addr learned my addr 172.21.15.114:0/849630106 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c2d9d640 1 --2- 172.21.15.114:0/849630106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82c40af9f0 0x7f82c40c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c1d9b640 1 -- 172.21.15.114:0/849630106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82c40af9f0 msgr2=0x7f82c40c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c259c640 1 --2- 172.21.15.114:0/849630106 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82ac003970 0x7f82c40cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c1d9b640 1 --2- 172.21.15.114:0/849630106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82c40af9f0 0x7f82c40c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c1d9b640 1 -- 172.21.15.114:0/849630106 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82ac003970 msgr2=0x7f82c40cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c1d9b640 1 --2- 172.21.15.114:0/849630106 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82ac003970 0x7f82c40cdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c1d9b640 1 -- 172.21.15.114:0/849630106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c40cb990 con 0x7f82c415b270 2023-11-04T01:44:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c1d9b640 1 --2- 172.21.15.114:0/849630106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82c415b270 0x7f82c40af4b0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f82b8011a70 tx=0x7f82b8011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82b2ffd640 1 -- 172.21.15.114:0/849630106 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8009680 con 0x7f82c415b270 2023-11-04T01:44:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82b2ffd640 1 -- 172.21.15.114:0/849630106 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b800fb50 con 0x7f82c415b270 2023-11-04T01:44:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c8961640 1 -- 172.21.15.114:0/849630106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c40cbc70 con 0x7f82c415b270 2023-11-04T01:44:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82b2ffd640 1 -- 172.21.15.114:0/849630106 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b800fee0 con 0x7f82c415b270 2023-11-04T01:44:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.307+0000 7f82c8961640 1 -- 172.21.15.114:0/849630106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c415b6f0 con 0x7f82c415b270 2023-11-04T01:44:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.309+0000 7f82c8961640 1 -- 172.21.15.114:0/849630106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c40cc430 con 0x7f82c415b270 2023-11-04T01:44:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.309+0000 7f82b2ffd640 1 -- 172.21.15.114:0/849630106 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f82b801d400 con 0x7f82c415b270 2023-11-04T01:44:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.309+0000 7f82b2ffd640 1 --2- 172.21.15.114:0/849630106 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f82a406aea0 0x7f82a406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.309+0000 7f82b2ffd640 1 -- 172.21.15.114:0/849630106 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f82b808a800 con 0x7f82c415b270 2023-11-04T01:44:51.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.309+0000 7f82c259c640 1 --2- 172.21.15.114:0/849630106 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f82a406aea0 0x7f82a406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.310+0000 7f82c259c640 1 --2- 172.21.15.114:0/849630106 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f82a406aea0 0x7f82a406d360 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f82b4036000 tx=0x7f82b4031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:51.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.313+0000 7f82b2ffd640 1 -- 172.21.15.114:0/849630106 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82b8054ea0 con 0x7f82c415b270 2023-11-04T01:44:51.348 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:51.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~20s 2023-11-04T01:44:51.408 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:51.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.494+0000 7f82c8961640 1 -- 172.21.15.114:0/849630106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f82c40684b0 con 0x7f82c415b270 2023-11-04T01:44:51.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.494+0000 7f82b2ffd640 1 -- 172.21.15.114:0/849630106 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v116) v1 ==== 81+0+1404 (secure 0 0 0) 0x7f82b80584c0 con 0x7f82c415b270 2023-11-04T01:44:51.496 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/979876939 2023-11-05T01:44:08.794891+0000 2023-11-04T01:44:51.496 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/979876939 2023-11-05T01:44:08.794891+0000 2023-11-04T01:44:51.496 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.1:0/3180677097 2023-11-04T02:43:26.710151+0000 2023-11-04T01:44:51.496 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/3145796350 2023-11-05T01:43:18.419560+0000 2023-11-04T01:44:51.496 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/3825479201 2023-11-05T01:43:11.612005+0000 2023-11-04T01:44:51.496 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/3825479201 2023-11-05T01:43:11.612005+0000 2023-11-04T01:44:51.496 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/3145796350 2023-11-05T01:43:18.419560+0000 2023-11-04T01:44:51.497 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/3780323525 2023-11-05T01:40:32.050690+0000 2023-11-04T01:44:51.497 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.1:0/76750670 2023-11-04T02:44:16.664609+0000 2023-11-04T01:44:51.497 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/3780323525 2023-11-05T01:40:32.050690+0000 2023-11-04T01:44:51.497 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.141:6834/1296600989 2023-11-05T01:42:28.568489+0000 2023-11-04T01:44:51.497 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/1768068040 2023-11-05T01:40:57.284155+0000 2023-11-04T01:44:51.497 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.141:6834/224279622 2023-11-05T01:44:01.557691+0000 2023-11-04T01:44:51.497 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/1768068040 2023-11-05T01:40:57.284155+0000 2023-11-04T01:44:51.497 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.141:6832/1296600989 2023-11-05T01:42:28.568489+0000 2023-11-04T01:44:51.497 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/2722332212 2023-11-05T01:41:22.824334+0000 2023-11-04T01:44:51.497 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/1052115332 2023-11-05T01:41:48.753700+0000 2023-11-04T01:44:51.497 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.1:0/958873281 2023-11-04T02:42:36.859026+0000 2023-11-04T01:44:51.497 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/1052115332 2023-11-05T01:41:48.753700+0000 2023-11-04T01:44:51.497 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.141:6832/224279622 2023-11-05T01:44:01.557691+0000 2023-11-04T01:44:51.497 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/1629274449 2023-11-05T01:42:21.762099+0000 2023-11-04T01:44:51.498 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/2722332212 2023-11-05T01:41:22.824334+0000 2023-11-04T01:44:51.498 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/1629274449 2023-11-05T01:42:21.762099+0000 2023-11-04T01:44:51.498 INFO:teuthology.orchestra.run.smithi114.stderr:listed 23 entries 2023-11-04T01:44:51.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.496+0000 7f82c8961640 1 -- 172.21.15.114:0/849630106 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f82a406aea0 msgr2=0x7f82a406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.496+0000 7f82c8961640 1 --2- 172.21.15.114:0/849630106 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f82a406aea0 0x7f82a406d360 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f82b4036000 tx=0x7f82b4031000 comp rx=0 tx=0).stop 2023-11-04T01:44:51.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.496+0000 7f82c8961640 1 -- 172.21.15.114:0/849630106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82c415b270 msgr2=0x7f82c40af4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.496+0000 7f82c8961640 1 --2- 172.21.15.114:0/849630106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82c415b270 0x7f82c40af4b0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f82b8011a70 tx=0x7f82b8011f30 comp rx=0 tx=0).stop 2023-11-04T01:44:51.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.496+0000 7f82c8961640 1 -- 172.21.15.114:0/849630106 shutdown_connections 2023-11-04T01:44:51.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.496+0000 7f82c8961640 1 --2- 172.21.15.114:0/849630106 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f82c40af9f0 0x7f82c40c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.496+0000 7f82c8961640 1 --2- 172.21.15.114:0/849630106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82c415b270 0x7f82c40af4b0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.496+0000 7f82c8961640 1 --2- 172.21.15.114:0/849630106 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f82a406aea0 0x7f82a406d360 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.496+0000 7f82c8961640 1 --2- 172.21.15.114:0/849630106 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f82ac003970 0x7f82c40cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.496+0000 7f82c8961640 1 -- 172.21.15.114:0/849630106 >> 172.21.15.114:0/849630106 conn(0x7f82c40d0c30 msgr2=0x7f82c415c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:51.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.496+0000 7f82c8961640 1 -- 172.21.15.114:0/849630106 shutdown_connections 2023-11-04T01:44:51.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.496+0000 7f82c8961640 1 -- 172.21.15.114:0/849630106 wait complete. 2023-11-04T01:44:51.508 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:44:51.508 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:51.564 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:51.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.701+0000 7f2e76378640 1 Processor -- start 2023-11-04T01:44:51.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.702+0000 7f2e76378640 1 -- start start 2023-11-04T01:44:51.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.702+0000 7f2e76378640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e700b2210 0x7f2e700cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.702+0000 7f2e76378640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2e7015d630 0x7f2e700cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.702+0000 7f2e76378640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e700b0150 con 0x7f2e700ceda0 2023-11-04T01:44:51.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.702+0000 7f2e76378640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e700b1df0 con 0x7f2e7015d630 2023-11-04T01:44:51.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.702+0000 7f2e76378640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700b1170 con 0x7f2e700b2210 2023-11-04T01:44:51.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.703+0000 7f2e6f7fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e700b2210 0x7f2e700cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.703+0000 7f2e74915640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2e7015d630 0x7f2e700cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.703+0000 7f2e74915640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f2e7015d630 0x7f2e700cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.141:3300/0 says I am v2:172.21.15.114:53258/0 (socket says 172.21.15.114:53258) 2023-11-04T01:44:51.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.703+0000 7f2e6ffff640 1 --1- >> v1:172.21.15.141:6789/0 conn(0x7f2e700ceda0 0x7f2e7015cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.141:6789/0 says I am v1:172.21.15.114:43842/0 (socket says 172.21.15.114:43842) 2023-11-04T01:44:51.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.703+0000 7f2e74915640 1 -- 172.21.15.114:0/616411034 learned_addr learned my addr 172.21.15.114:0/616411034 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:51.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.703+0000 7f2e6f7fe640 1 -- 172.21.15.114:0/616411034 >> v2:172.21.15.141:3300/0 conn(0x7f2e7015d630 msgr2=0x7f2e700cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:51.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.703+0000 7f2e6f7fe640 1 --2- 172.21.15.114:0/616411034 >> v2:172.21.15.141:3300/0 conn(0x7f2e7015d630 0x7f2e700cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.703+0000 7f2e6f7fe640 1 -- 172.21.15.114:0/616411034 >> v1:172.21.15.141:6789/0 conn(0x7f2e700ceda0 legacy=0x7f2e7015cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.703+0000 7f2e6f7fe640 1 -- 172.21.15.114:0/616411034 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e700b1450 con 0x7f2e700b2210 2023-11-04T01:44:51.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.703+0000 7f2e74915640 1 --2- 172.21.15.114:0/616411034 >> v2:172.21.15.141:3300/0 conn(0x7f2e7015d630 0x7f2e700cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:51.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.704+0000 7f2e6f7fe640 1 --2- 172.21.15.114:0/616411034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e700b2210 0x7f2e700cf180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2e600097a0 tx=0x7f2e6002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c81c97b479fe619 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:51.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.704+0000 7f2e6effd640 1 -- 172.21.15.114:0/616411034 <== mon.2 v2:172.21.15.141:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6002e070 con 0x7f2e700b2210 2023-11-04T01:44:51.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.704+0000 7f2e6effd640 1 -- 172.21.15.114:0/616411034 <== mon.2 v2:172.21.15.141:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e600315a0 con 0x7f2e700b2210 2023-11-04T01:44:51.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.704+0000 7f2e6effd640 1 -- 172.21.15.114:0/616411034 <== mon.2 v2:172.21.15.141:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60031930 con 0x7f2e700b2210 2023-11-04T01:44:51.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.705+0000 7f2e76378640 1 -- 172.21.15.114:0/616411034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e700b2210 msgr2=0x7f2e700cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.705+0000 7f2e76378640 1 --2- 172.21.15.114:0/616411034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e700b2210 0x7f2e700cf180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2e600097a0 tx=0x7f2e6002b840 comp rx=0 tx=0).stop 2023-11-04T01:44:51.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.705+0000 7f2e76378640 1 -- 172.21.15.114:0/616411034 shutdown_connections 2023-11-04T01:44:51.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.705+0000 7f2e76378640 1 --2- 172.21.15.114:0/616411034 >> v2:172.21.15.141:3300/0 conn(0x7f2e7015d630 0x7f2e700cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.705+0000 7f2e76378640 1 --2- 172.21.15.114:0/616411034 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e700b2210 0x7f2e700cf180 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.705+0000 7f2e76378640 1 -- 172.21.15.114:0/616411034 >> 172.21.15.114:0/616411034 conn(0x7f2e700d0c30 msgr2=0x7f2e700d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:51.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.705+0000 7f2e76378640 1 -- 172.21.15.114:0/616411034 shutdown_connections 2023-11-04T01:44:51.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.705+0000 7f2e76378640 1 -- 172.21.15.114:0/616411034 wait complete. 2023-11-04T01:44:51.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.706+0000 7f2e76378640 1 Processor -- start 2023-11-04T01:44:51.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.706+0000 7f2e76378640 1 -- start start 2023-11-04T01:44:51.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e76378640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e700b2210 0x7f2e700b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e76378640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2e700ceda0 0x7f2e700cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e76378640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e7015d630 0x7f2e700cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e76378640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e70148b30 con 0x7f2e7015d630 2023-11-04T01:44:51.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e76378640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7009b8c0 con 0x7f2e700ceda0 2023-11-04T01:44:51.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e76378640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e70148190 con 0x7f2e700b2210 2023-11-04T01:44:51.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e74915640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e7015d630 0x7f2e700cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e74915640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e7015d630 0x7f2e700cd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39958/0 (socket says 172.21.15.114:39958) 2023-11-04T01:44:51.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e74915640 1 -- 172.21.15.114:0/1650522920 learned_addr learned my addr 172.21.15.114:0/1650522920 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:51.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e6ffff640 1 --2- 172.21.15.114:0/1650522920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e700b2210 0x7f2e700b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e6f7fe640 1 --2- 172.21.15.114:0/1650522920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2e700ceda0 0x7f2e700cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e74915640 1 -- 172.21.15.114:0/1650522920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e700b2210 msgr2=0x7f2e700b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e74915640 1 --2- 172.21.15.114:0/1650522920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e700b2210 0x7f2e700b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e74915640 1 -- 172.21.15.114:0/1650522920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2e700ceda0 msgr2=0x7f2e700cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e74915640 1 --2- 172.21.15.114:0/1650522920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2e700ceda0 0x7f2e700cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e74915640 1 -- 172.21.15.114:0/1650522920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e68009b30 con 0x7f2e7015d630 2023-11-04T01:44:51.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e6ffff640 1 --2- 172.21.15.114:0/1650522920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e700b2210 0x7f2e700b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:51.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.707+0000 7f2e74915640 1 --2- 172.21.15.114:0/1650522920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e7015d630 0x7f2e700cd970 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800efc0 tx=0x7f2e6800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:51.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.708+0000 7f2e6cff9640 1 -- 172.21.15.114:0/1650522920 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68018070 con 0x7f2e7015d630 2023-11-04T01:44:51.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.708+0000 7f2e6cff9640 1 -- 172.21.15.114:0/1650522920 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6800f040 con 0x7f2e7015d630 2023-11-04T01:44:51.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.708+0000 7f2e6cff9640 1 -- 172.21.15.114:0/1650522920 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6800ce00 con 0x7f2e7015d630 2023-11-04T01:44:51.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.708+0000 7f2e76378640 1 -- 172.21.15.114:0/1650522920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e60009400 con 0x7f2e7015d630 2023-11-04T01:44:51.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.708+0000 7f2e76378640 1 -- 172.21.15.114:0/1650522920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e70148750 con 0x7f2e7015d630 2023-11-04T01:44:51.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.709+0000 7f2e76378640 1 -- 172.21.15.114:0/1650522920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e70148c70 con 0x7f2e7015d630 2023-11-04T01:44:51.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.709+0000 7f2e6cff9640 1 -- 172.21.15.114:0/1650522920 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e68014480 con 0x7f2e7015d630 2023-11-04T01:44:51.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.709+0000 7f2e6cff9640 1 --2- 172.21.15.114:0/1650522920 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2e5c06ae70 0x7f2e5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.710+0000 7f2e6cff9640 1 -- 172.21.15.114:0/1650522920 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f2e6808a280 con 0x7f2e7015d630 2023-11-04T01:44:51.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.710+0000 7f2e6ffff640 1 --2- 172.21.15.114:0/1650522920 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2e5c06ae70 0x7f2e5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.710+0000 7f2e6ffff640 1 --2- 172.21.15.114:0/1650522920 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2e5c06ae70 0x7f2e5c06d330 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2e64007fd0 tx=0x7f2e64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:51.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.714+0000 7f2e6cff9640 1 -- 172.21.15.114:0/1650522920 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e70148c70 con 0x7f2e7015d630 2023-11-04T01:44:51.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.880+0000 7f2e76378640 1 -- 172.21.15.114:0/1650522920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e70148c70 con 0x7f2e7015d630 2023-11-04T01:44:51.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.882+0000 7f2e6cff9640 1 -- 172.21.15.114:0/1650522920 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+23725 (secure 0 0 0) 0x7f2e70148c70 con 0x7f2e7015d630 2023-11-04T01:44:51.884 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-11-04T01:44:51.884 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":116,"fsid":"d683c50f-778a-409d-b3d8-acedf37b842d","created":"2023-11-04T01:36:05.821642+0000","modified":"2023-11-04T01:44:35.629413+0000","last_up_change":"2023-11-04T01:36:17.026392+0000","last_in_change":"2023-11-04T01:36:08.033113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:36:17.899206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:37:59.139968+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:38:58.316710+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:38:59.185397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:50.031565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:50.411946+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":14,"snap_epoch":115,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf03fd88-0363-478d-8cb0-afd2b8e110c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6801","nonce":2535026958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6803","nonce":2535026958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6807","nonce":2535026958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":2535026958},{"type":"v1","addr":"172.21.15.114:6805","nonce":2535026958}]},"public_addr":"172.21.15.114:6801/2535026958","cluster_addr":"172.21.15.114:6803/2535026958","heartbeat_back_addr":"172.21.15.114:6807/2535026958","heartbeat_front_addr":"172.21.15.114:6805/2535026958","state":["exists","up"]},{"osd":1,"uuid":"113b3539-702f-4596-8a3b-b3bdaab37075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6809","nonce":2234532734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6811","nonce":2234532734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6815","nonce":2234532734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2234532734},{"type":"v1","addr":"172.21.15.114:6813","nonce":2234532734}]},"public_addr":"172.21.15.114:6809/2234532734","cluster_addr":"172.21.15.114:6811/2234532734","heartbeat_back_addr":"172.21.15.114:6815/2234532734","heartbeat_front_addr":"172.21.15.114:6813/2234532734","state":["exists","up"]},{"osd":2,"uuid":"b0997e6c-31a7-46e7-8e9e-e550ad1010be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6825","nonce":3823972084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6827","nonce":3823972084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6831","nonce":3823972084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":3823972084},{"type":"v1","addr":"172.21.15.114:6829","nonce":3823972084}]},"public_addr":"172.21.15.114:6825/3823972084","cluster_addr":"172.21.15.114:6827/3823972084","heartbeat_back_addr":"172.21.15.114:6831/3823972084","heartbeat_front_addr":"172.21.15.114:6829/3823972084","state":["exists","up"]},{"osd":3,"uuid":"caa8d0cf-dcf6-442c-8540-81e0ac16ac26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6817","nonce":3751724895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6819","nonce":3751724895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6823","nonce":3751724895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3751724895},{"type":"v1","addr":"172.21.15.114:6821","nonce":3751724895}]},"public_addr":"172.21.15.114:6817/3751724895","cluster_addr":"172.21.15.114:6819/3751724895","heartbeat_back_addr":"172.21.15.114:6823/3751724895","heartbeat_front_addr":"172.21.15.114:6821/3751724895","state":["exists","up"]},{"osd":4,"uuid":"28711f7b-6b23-4495-b56a-ceb781be62f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6801","nonce":3610353173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6803","nonce":3610353173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6807","nonce":3610353173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":3610353173},{"type":"v1","addr":"172.21.15.141:6805","nonce":3610353173}]},"public_addr":"172.21.15.141:6801/3610353173","cluster_addr":"172.21.15.141:6803/3610353173","heartbeat_back_addr":"172.21.15.141:6807/3610353173","heartbeat_front_addr":"172.21.15.141:6805/3610353173","state":["exists","up"]},{"osd":5,"uuid":"aea1cd1f-d96a-48b5-bf75-30430c23dfd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6816","nonce":2089373315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6819","nonce":2089373315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6823","nonce":2089373315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6820","nonce":2089373315},{"type":"v1","addr":"172.21.15.141:6821","nonce":2089373315}]},"public_addr":"172.21.15.141:6816/2089373315","cluster_addr":"172.21.15.141:6819/2089373315","heartbeat_back_addr":"172.21.15.141:6823/2089373315","heartbeat_front_addr":"172.21.15.141:6821/2089373315","state":["exists","up"]},{"osd":6,"uuid":"8089dcf3-5d4c-4580-a21f-e6650bf52eae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6808","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6809","nonce":1912829833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6811","nonce":1912829833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6815","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6817","nonce":1912829833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":1912829833},{"type":"v1","addr":"172.21.15.141:6813","nonce":1912829833}]},"public_addr":"172.21.15.141:6809/1912829833","cluster_addr":"172.21.15.141:6811/1912829833","heartbeat_back_addr":"172.21.15.141:6817/1912829833","heartbeat_front_addr":"172.21.15.141:6813/1912829833","state":["exists","up"]},{"osd":7,"uuid":"376f771f-a662-4387-8ae2-4e41699973d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6824","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6825","nonce":4009772147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6827","nonce":4009772147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6831","nonce":4009772147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6828","nonce":4009772147},{"type":"v1","addr":"172.21.15.141:6829","nonce":4009772147}]},"public_addr":"172.21.15.141:6825/4009772147","cluster_addr":"172.21.15.141:6827/4009772147","heartbeat_back_addr":"172.21.15.141:6831/4009772147","heartbeat_front_addr":"172.21.15.141:6829/4009772147","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.112505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.098266+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.221368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.156165+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.287232+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.290458+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.245771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:36:13.277626+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":2}]},{"pgid":"17.3c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/979876939":"2023-11-05T01:44:08.794891+0000","172.21.15.114:6834/979876939":"2023-11-05T01:44:08.794891+0000","192.168.0.1:0/3180677097":"2023-11-04T02:43:26.710151+0000","172.21.15.114:6836/3145796350":"2023-11-05T01:43:18.419560+0000","172.21.15.114:6837/3825479201":"2023-11-05T01:43:11.612005+0000","172.21.15.114:6835/3825479201":"2023-11-05T01:43:11.612005+0000","172.21.15.114:6834/3145796350":"2023-11-05T01:43:18.419560+0000","172.21.15.114:6834/3780323525":"2023-11-05T01:40:32.050690+0000","192.168.0.1:0/76750670":"2023-11-04T02:44:16.664609+0000","172.21.15.114:6836/3780323525":"2023-11-05T01:40:32.050690+0000","172.21.15.141:6834/1296600989":"2023-11-05T01:42:28.568489+0000","172.21.15.114:6835/1768068040":"2023-11-05T01:40:57.284155+0000","172.21.15.141:6834/224279622":"2023-11-05T01:44:01.557691+0000","172.21.15.114:6837/1768068040":"2023-11-05T01:40:57.284155+0000","172.21.15.141:6832/1296600989":"2023-11-05T01:42:28.568489+0000","172.21.15.114:6836/2722332212":"2023-11-05T01:41:22.824334+0000","172.21.15.114:6835/1052115332":"2023-11-05T01:41:48.753700+0000","192.168.0.1:0/958873281":"2023-11-04T02:42:36.859026+0000","172.21.15.114:6837/1052115332":"2023-11-05T01:41:48.753700+0000","172.21.15.141:6832/224279622":"2023-11-05T01:44:01.557691+0000","172.21.15.114:6836/1629274449":"2023-11-05T01:42:21.762099+0000","172.21.15.114:6834/2722332212":"2023-11-05T01:41:22.824334+0000","172.21.15.114:6834/1629274449":"2023-11-05T01:42:21.762099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":11,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:51.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.884+0000 7f2e76378640 1 -- 172.21.15.114:0/1650522920 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2e5c06ae70 msgr2=0x7f2e5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.884+0000 7f2e76378640 1 --2- 172.21.15.114:0/1650522920 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2e5c06ae70 0x7f2e5c06d330 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2e64007fd0 tx=0x7f2e64009040 comp rx=0 tx=0).stop 2023-11-04T01:44:51.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.884+0000 7f2e76378640 1 -- 172.21.15.114:0/1650522920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e7015d630 msgr2=0x7f2e700cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.884+0000 7f2e76378640 1 --2- 172.21.15.114:0/1650522920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e7015d630 0x7f2e700cd970 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800efc0 tx=0x7f2e6800c490 comp rx=0 tx=0).stop 2023-11-04T01:44:51.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.884+0000 7f2e76378640 1 -- 172.21.15.114:0/1650522920 shutdown_connections 2023-11-04T01:44:51.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.884+0000 7f2e76378640 1 --2- 172.21.15.114:0/1650522920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e7015d630 0x7f2e700cd970 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.884+0000 7f2e76378640 1 --2- 172.21.15.114:0/1650522920 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f2e5c06ae70 0x7f2e5c06d330 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.884+0000 7f2e76378640 1 --2- 172.21.15.114:0/1650522920 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f2e700ceda0 0x7f2e700cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.884+0000 7f2e76378640 1 --2- 172.21.15.114:0/1650522920 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f2e700b2210 0x7f2e700b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.884+0000 7f2e76378640 1 -- 172.21.15.114:0/1650522920 >> 172.21.15.114:0/1650522920 conn(0x7f2e700d0c30 msgr2=0x7f2e700d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:51.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.884+0000 7f2e76378640 1 -- 172.21.15.114:0/1650522920 shutdown_connections 2023-11-04T01:44:51.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.884+0000 7f2e76378640 1 -- 172.21.15.114:0/1650522920 wait complete. 2023-11-04T01:44:51.896 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:36:17.899206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:37:59.139968+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:38:58.316710+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:38:59.185397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:50.031565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:50.411946+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 14, 'snap_epoch': 115, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:44:51.897 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:44:52.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.998+0000 7f03a3c64640 1 Processor -- start 2023-11-04T01:44:52.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.998+0000 7f03a3c64640 1 -- start start 2023-11-04T01:44:52.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.999+0000 7f03a3c64640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f039c06df80 0x7f039c164f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.999+0000 7f03a3c64640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f039c0ce8a0 con 0x7f039c0cda40 2023-11-04T01:44:52.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.999+0000 7f03a3c64640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f039c070ac0 con 0x7f039c070fc0 2023-11-04T01:44:52.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.999+0000 7f03a3c64640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039c06ca50 con 0x7f039c06df80 2023-11-04T01:44:52.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.999+0000 7f03a11ff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f039c0cda40 0x7f039c0703b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34604/0 (socket says 172.21.15.114:34604) 2023-11-04T01:44:52.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.999+0000 7f03a11ff640 1 -- 172.21.15.114:0/1683934349 learned_addr learned my addr 172.21.15.114:0/1683934349 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:52.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.999+0000 7f03a2201640 1 --2- 172.21.15.114:0/1683934349 >> v2:172.21.15.114:3300/0 conn(0x7f039c06df80 0x7f039c164f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.999+0000 7f03a09fe640 1 -- 172.21.15.114:0/1683934349 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198384562 0 0) 0x7f039c0ce8a0 con 0x7f039c0cda40 2023-11-04T01:44:52.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.999+0000 7f03a09fe640 1 -- 172.21.15.114:0/1683934349 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0388003520 con 0x7f039c0cda40 2023-11-04T01:44:52.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.999+0000 7f03a2201640 1 -- 172.21.15.114:0/1683934349 >> v1:172.21.15.141:6789/0 conn(0x7f039c070fc0 legacy=0x7f039c06fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.999+0000 7f03a2201640 1 -- 172.21.15.114:0/1683934349 >> v1:172.21.15.114:6789/0 conn(0x7f039c0cda40 legacy=0x7f039c0703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:51.999+0000 7f03a2201640 1 -- 172.21.15.114:0/1683934349 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c0cdf70 con 0x7f039c06df80 2023-11-04T01:44:52.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.000+0000 7f03a2201640 1 --2- 172.21.15.114:0/1683934349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f039c06df80 0x7f039c164f80 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f0394009d90 tx=0x7f039402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe6386ce76f7c40 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.000+0000 7f03a09fe640 1 -- 172.21.15.114:0/1683934349 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039402cd00 con 0x7f039c06df80 2023-11-04T01:44:52.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.000+0000 7f03a09fe640 1 -- 172.21.15.114:0/1683934349 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039402ce60 con 0x7f039c06df80 2023-11-04T01:44:52.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.000+0000 7f03a09fe640 1 -- 172.21.15.114:0/1683934349 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394034660 con 0x7f039c06df80 2023-11-04T01:44:52.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.001+0000 7f03a3c64640 1 -- 172.21.15.114:0/1683934349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f039c06df80 msgr2=0x7f039c164f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.001+0000 7f03a3c64640 1 --2- 172.21.15.114:0/1683934349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f039c06df80 0x7f039c164f80 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f0394009d90 tx=0x7f039402bf50 comp rx=0 tx=0).stop 2023-11-04T01:44:52.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.001+0000 7f03a3c64640 1 -- 172.21.15.114:0/1683934349 shutdown_connections 2023-11-04T01:44:52.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.001+0000 7f03a3c64640 1 --2- 172.21.15.114:0/1683934349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f039c06df80 0x7f039c164f80 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.001+0000 7f03a3c64640 1 -- 172.21.15.114:0/1683934349 >> 172.21.15.114:0/1683934349 conn(0x7f039c0cb8e0 msgr2=0x7f039c0cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:52.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.001+0000 7f03a3c64640 1 -- 172.21.15.114:0/1683934349 shutdown_connections 2023-11-04T01:44:52.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.001+0000 7f03a3c64640 1 -- 172.21.15.114:0/1683934349 wait complete. 2023-11-04T01:44:52.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.002+0000 7f03a3c64640 1 Processor -- start 2023-11-04T01:44:52.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.002+0000 7f03a3c64640 1 -- start start 2023-11-04T01:44:52.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03a3c64640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f039c06df80 0x7f039c0c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03a3c64640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f039c070fc0 0x7f039c0c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03a3c64640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f039c0cda40 0x7f039c0b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03a3c64640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c1f4200 con 0x7f039c070fc0 2023-11-04T01:44:52.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03a3c64640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c0c82e0 con 0x7f039c06df80 2023-11-04T01:44:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03a3c64640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039c1f4450 con 0x7f039c0cda40 2023-11-04T01:44:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03a11ff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f039c070fc0 0x7f039c0c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03a11ff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f039c070fc0 0x7f039c0c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39974/0 (socket says 172.21.15.114:39974) 2023-11-04T01:44:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03a11ff640 1 -- 172.21.15.114:0/1140272219 learned_addr learned my addr 172.21.15.114:0/1140272219 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03a11ff640 1 -- 172.21.15.114:0/1140272219 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f039c0cda40 msgr2=0x7f039c0b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03a11ff640 1 --2- 172.21.15.114:0/1140272219 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f039c0cda40 0x7f039c0b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03a11ff640 1 -- 172.21.15.114:0/1140272219 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f039c06df80 msgr2=0x7f039c0c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03a11ff640 1 --2- 172.21.15.114:0/1140272219 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f039c06df80 0x7f039c0c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03a11ff640 1 -- 172.21.15.114:0/1140272219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394009a70 con 0x7f039c070fc0 2023-11-04T01:44:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03a11ff640 1 --2- 172.21.15.114:0/1140272219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f039c070fc0 0x7f039c0c8830 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f038c00c530 tx=0x7f038c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03927fc640 1 -- 172.21.15.114:0/1140272219 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c005ce0 con 0x7f039c070fc0 2023-11-04T01:44:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03927fc640 1 -- 172.21.15.114:0/1140272219 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c005e40 con 0x7f039c070fc0 2023-11-04T01:44:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03927fc640 1 -- 172.21.15.114:0/1140272219 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c0072b0 con 0x7f039c070fc0 2023-11-04T01:44:52.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.003+0000 7f03a3c64640 1 -- 172.21.15.114:0/1140272219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039c1f4730 con 0x7f039c070fc0 2023-11-04T01:44:52.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.004+0000 7f03a3c64640 1 -- 172.21.15.114:0/1140272219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039c1f4cf0 con 0x7f039c070fc0 2023-11-04T01:44:52.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.004+0000 7f03a3c64640 1 -- 172.21.15.114:0/1140272219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039c0ce230 con 0x7f039c070fc0 2023-11-04T01:44:52.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.005+0000 7f03927fc640 1 -- 172.21.15.114:0/1140272219 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f038c007410 con 0x7f039c070fc0 2023-11-04T01:44:52.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.005+0000 7f03927fc640 1 --2- 172.21.15.114:0/1140272219 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f038006ae70 0x7f038006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.005+0000 7f03927fc640 1 -- 172.21.15.114:0/1140272219 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f038c0895e0 con 0x7f039c070fc0 2023-11-04T01:44:52.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.005+0000 7f03a1a00640 1 --2- 172.21.15.114:0/1140272219 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f038006ae70 0x7f038006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.006+0000 7f03a1a00640 1 --2- 172.21.15.114:0/1140272219 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f038006ae70 0x7f038006d330 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0398000f60 tx=0x7f03980079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.009+0000 7f03927fc640 1 -- 172.21.15.114:0/1140272219 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f039c0ce230 con 0x7f039c070fc0 2023-11-04T01:44:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.175+0000 7f03a3c64640 1 -- 172.21.15.114:0/1140272219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f039c0ce230 con 0x7f039c070fc0 2023-11-04T01:44:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.176+0000 7f03927fc640 1 -- 172.21.15.114:0/1140272219 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7f039c0ce230 con 0x7f039c070fc0 2023-11-04T01:44:52.178 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-11-04T01:44:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.178+0000 7f03a3c64640 1 -- 172.21.15.114:0/1140272219 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f038006ae70 msgr2=0x7f038006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.178+0000 7f03a3c64640 1 --2- 172.21.15.114:0/1140272219 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f038006ae70 0x7f038006d330 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0398000f60 tx=0x7f03980079b0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.178+0000 7f03a3c64640 1 -- 172.21.15.114:0/1140272219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f039c070fc0 msgr2=0x7f039c0c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.178+0000 7f03a3c64640 1 --2- 172.21.15.114:0/1140272219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f039c070fc0 0x7f039c0c8830 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f038c00c530 tx=0x7f038c00c9f0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.178+0000 7f03a3c64640 1 -- 172.21.15.114:0/1140272219 shutdown_connections 2023-11-04T01:44:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.178+0000 7f03a3c64640 1 --2- 172.21.15.114:0/1140272219 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f039c0cda40 0x7f039c0b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.178+0000 7f03a3c64640 1 --2- 172.21.15.114:0/1140272219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f039c070fc0 0x7f039c0c8830 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.178+0000 7f03a3c64640 1 --2- 172.21.15.114:0/1140272219 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f038006ae70 0x7f038006d330 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.178+0000 7f03a3c64640 1 --2- 172.21.15.114:0/1140272219 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f039c06df80 0x7f039c0c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.178+0000 7f03a3c64640 1 -- 172.21.15.114:0/1140272219 >> 172.21.15.114:0/1140272219 conn(0x7f039c0cb8e0 msgr2=0x7f039c159d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:52.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.178+0000 7f03a3c64640 1 -- 172.21.15.114:0/1140272219 shutdown_connections 2023-11-04T01:44:52.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.178+0000 7f03a3c64640 1 -- 172.21.15.114:0/1140272219 wait complete. 2023-11-04T01:44:52.190 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:44:52.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.290+0000 7f37c2bd0640 1 Processor -- start 2023-11-04T01:44:52.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.290+0000 7f37c2bd0640 1 -- start start 2023-11-04T01:44:52.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.291+0000 7f37c2bd0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37bc15b330 0x7f37bc0cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.291+0000 7f37c2bd0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f37bc0b2160 0x7f37bc06ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.291+0000 7f37c2bd0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37bc0cb5d0 con 0x7f37bc06ca60 2023-11-04T01:44:52.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.291+0000 7f37c2bd0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37bc06f3f0 con 0x7f37bc0b2160 2023-11-04T01:44:52.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.291+0000 7f37c2bd0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc0c3490 con 0x7f37bc15b330 2023-11-04T01:44:52.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.291+0000 7f37bbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f37bc0b2160 0x7f37bc06ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.291+0000 7f37c116d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f37bc06ca60 0x7f37bc0b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34618/0 (socket says 172.21.15.114:34618) 2023-11-04T01:44:52.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.291+0000 7f37c116d640 1 -- 172.21.15.114:0/119737984 learned_addr learned my addr 172.21.15.114:0/119737984 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:52.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.291+0000 7f37c096c640 1 --2- 172.21.15.114:0/119737984 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37bc15b330 0x7f37bc0cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.291+0000 7f37bbfff640 1 -- 172.21.15.114:0/119737984 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37bc15b330 msgr2=0x7f37bc0cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:52.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.291+0000 7f37bbfff640 1 --2- 172.21.15.114:0/119737984 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37bc15b330 0x7f37bc0cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.291+0000 7f37bbfff640 1 -- 172.21.15.114:0/119737984 >> v1:172.21.15.114:6789/0 conn(0x7f37bc06ca60 legacy=0x7f37bc0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.292+0000 7f37bbfff640 1 -- 172.21.15.114:0/119737984 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc0cbfa0 con 0x7f37bc0b2160 2023-11-04T01:44:52.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.291+0000 7f37bb7fe640 1 -- 172.21.15.114:0/119737984 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440961550 0 0) 0x7f37bc0cb5d0 con 0x7f37bc06ca60 2023-11-04T01:44:52.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.292+0000 7f37bbfff640 1 --2- 172.21.15.114:0/119737984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37bc0b2160 0x7f37bc06ebf0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f37b00097a0 tx=0x7f37b002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cea4d88217298c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.292+0000 7f37bb7fe640 1 -- 172.21.15.114:0/119737984 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0031830 con 0x7f37bc0b2160 2023-11-04T01:44:52.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.292+0000 7f37bb7fe640 1 -- 172.21.15.114:0/119737984 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b0031990 con 0x7f37bc0b2160 2023-11-04T01:44:52.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.292+0000 7f37bb7fe640 1 -- 172.21.15.114:0/119737984 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0031d20 con 0x7f37bc0b2160 2023-11-04T01:44:52.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.293+0000 7f37c2bd0640 1 -- 172.21.15.114:0/119737984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37bc0b2160 msgr2=0x7f37bc06ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.293+0000 7f37c2bd0640 1 --2- 172.21.15.114:0/119737984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37bc0b2160 0x7f37bc06ebf0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f37b00097a0 tx=0x7f37b002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.293+0000 7f37c2bd0640 1 -- 172.21.15.114:0/119737984 shutdown_connections 2023-11-04T01:44:52.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.293+0000 7f37c2bd0640 1 --2- 172.21.15.114:0/119737984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37bc0b2160 0x7f37bc06ebf0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.293+0000 7f37c2bd0640 1 --2- 172.21.15.114:0/119737984 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37bc15b330 0x7f37bc0cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.293+0000 7f37c2bd0640 1 -- 172.21.15.114:0/119737984 >> 172.21.15.114:0/119737984 conn(0x7f37bc0b1640 msgr2=0x7f37bc0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:52.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.293+0000 7f37c2bd0640 1 -- 172.21.15.114:0/119737984 shutdown_connections 2023-11-04T01:44:52.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.293+0000 7f37c2bd0640 1 -- 172.21.15.114:0/119737984 wait complete. 2023-11-04T01:44:52.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.294+0000 7f37c2bd0640 1 Processor -- start 2023-11-04T01:44:52.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.294+0000 7f37c2bd0640 1 -- start start 2023-11-04T01:44:52.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.295+0000 7f37c2bd0640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37bc06ca60 0x7f37bc156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.295+0000 7f37c2bd0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37bc0b2160 0x7f37bc1f0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.295+0000 7f37c2bd0640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37bc15b330 0x7f37bc0c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.295+0000 7f37c2bd0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc0c4d60 con 0x7f37bc0b2160 2023-11-04T01:44:52.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.295+0000 7f37c2bd0640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc1574f0 con 0x7f37bc15b330 2023-11-04T01:44:52.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.295+0000 7f37c2bd0640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc0c6dc0 con 0x7f37bc06ca60 2023-11-04T01:44:52.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.295+0000 7f37bbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37bc0b2160 0x7f37bc1f0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.295+0000 7f37bbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37bc0b2160 0x7f37bc1f0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39994/0 (socket says 172.21.15.114:39994) 2023-11-04T01:44:52.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.295+0000 7f37bbfff640 1 -- 172.21.15.114:0/3104556554 learned_addr learned my addr 172.21.15.114:0/3104556554 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:52.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.295+0000 7f37bbfff640 1 -- 172.21.15.114:0/3104556554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37bc06ca60 msgr2=0x7f37bc156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.295+0000 7f37bbfff640 1 --2- 172.21.15.114:0/3104556554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37bc06ca60 0x7f37bc156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.295+0000 7f37bbfff640 1 -- 172.21.15.114:0/3104556554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37bc15b330 msgr2=0x7f37bc0c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.295+0000 7f37bbfff640 1 --2- 172.21.15.114:0/3104556554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37bc15b330 0x7f37bc0c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.295+0000 7f37bbfff640 1 -- 172.21.15.114:0/3104556554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b0009400 con 0x7f37bc0b2160 2023-11-04T01:44:52.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.296+0000 7f37bbfff640 1 --2- 172.21.15.114:0/3104556554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37bc0b2160 0x7f37bc1f0be0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f37b0000c00 tx=0x7f37b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.296+0000 7f37b97fa640 1 -- 172.21.15.114:0/3104556554 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b003aa60 con 0x7f37bc0b2160 2023-11-04T01:44:52.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.296+0000 7f37b97fa640 1 -- 172.21.15.114:0/3104556554 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b003abc0 con 0x7f37bc0b2160 2023-11-04T01:44:52.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.296+0000 7f37c2bd0640 1 -- 172.21.15.114:0/3104556554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc0c70a0 con 0x7f37bc0b2160 2023-11-04T01:44:52.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.296+0000 7f37b97fa640 1 -- 172.21.15.114:0/3104556554 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b00443f0 con 0x7f37bc0b2160 2023-11-04T01:44:52.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.296+0000 7f37c2bd0640 1 -- 172.21.15.114:0/3104556554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc0c7660 con 0x7f37bc0b2160 2023-11-04T01:44:52.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.297+0000 7f37c2bd0640 1 -- 172.21.15.114:0/3104556554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37bc06da20 con 0x7f37bc0b2160 2023-11-04T01:44:52.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.297+0000 7f37b97fa640 1 -- 172.21.15.114:0/3104556554 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f37b004d450 con 0x7f37bc0b2160 2023-11-04T01:44:52.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.298+0000 7f37b97fa640 1 --2- 172.21.15.114:0/3104556554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f37a806ae70 0x7f37a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.298+0000 7f37b97fa640 1 -- 172.21.15.114:0/3104556554 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f37b00ac150 con 0x7f37bc0b2160 2023-11-04T01:44:52.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.298+0000 7f37c096c640 1 --2- 172.21.15.114:0/3104556554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f37a806ae70 0x7f37a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.298+0000 7f37c096c640 1 --2- 172.21.15.114:0/3104556554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f37a806ae70 0x7f37a806d330 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0098f0 tx=0x7f37ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.302+0000 7f37b97fa640 1 -- 172.21.15.114:0/3104556554 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f37b00767f0 con 0x7f37bc0b2160 2023-11-04T01:44:52.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.468+0000 7f37c2bd0640 1 -- 172.21.15.114:0/3104556554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f37bc0c7850 con 0x7f37bc0b2160 2023-11-04T01:44:52.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.468+0000 7f37b97fa640 1 -- 172.21.15.114:0/3104556554 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v116) v1 ==== 103+0+11 (secure 0 0 0) 0x7f37b0035020 con 0x7f37bc0b2160 2023-11-04T01:44:52.470 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:44:52.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.470+0000 7f37c2bd0640 1 -- 172.21.15.114:0/3104556554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f37a806ae70 msgr2=0x7f37a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.470+0000 7f37c2bd0640 1 --2- 172.21.15.114:0/3104556554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f37a806ae70 0x7f37a806d330 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0098f0 tx=0x7f37ac008040 comp rx=0 tx=0).stop 2023-11-04T01:44:52.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.470+0000 7f37c2bd0640 1 -- 172.21.15.114:0/3104556554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37bc0b2160 msgr2=0x7f37bc1f0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.470+0000 7f37c2bd0640 1 --2- 172.21.15.114:0/3104556554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37bc0b2160 0x7f37bc1f0be0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f37b0000c00 tx=0x7f37b00046c0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.471+0000 7f37c2bd0640 1 -- 172.21.15.114:0/3104556554 shutdown_connections 2023-11-04T01:44:52.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.471+0000 7f37c2bd0640 1 --2- 172.21.15.114:0/3104556554 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f37a806ae70 0x7f37a806d330 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.471+0000 7f37c2bd0640 1 --2- 172.21.15.114:0/3104556554 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f37bc15b330 0x7f37bc0c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.471+0000 7f37c2bd0640 1 --2- 172.21.15.114:0/3104556554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37bc0b2160 0x7f37bc1f0be0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.471+0000 7f37c2bd0640 1 --2- 172.21.15.114:0/3104556554 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f37bc06ca60 0x7f37bc156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.471+0000 7f37c2bd0640 1 -- 172.21.15.114:0/3104556554 >> 172.21.15.114:0/3104556554 conn(0x7f37bc0b1640 msgr2=0x7f37bc0b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:52.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.471+0000 7f37c2bd0640 1 -- 172.21.15.114:0/3104556554 shutdown_connections 2023-11-04T01:44:52.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.471+0000 7f37c2bd0640 1 -- 172.21.15.114:0/3104556554 wait complete. 2023-11-04T01:44:52.483 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:44:52.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.583+0000 7fbbe6eda640 1 Processor -- start 2023-11-04T01:44:52.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.583+0000 7fbbe6eda640 1 -- start start 2023-11-04T01:44:52.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.584+0000 7fbbe6eda640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbbe015ade0 0x7fbbe006c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.584+0000 7fbbe6eda640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe00ad6a0 con 0x7fbbe006b740 2023-11-04T01:44:52.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.584+0000 7fbbe6eda640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe00acaf0 con 0x7fbbe00b1440 2023-11-04T01:44:52.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.584+0000 7fbbe6eda640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe00acdd0 con 0x7fbbe015ade0 2023-11-04T01:44:52.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.584+0000 7fbbe4c76640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbbe015ade0 0x7fbbe006c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.584+0000 7fbbdffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbbe006b740 0x7fbbe00b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34628/0 (socket says 172.21.15.114:34628) 2023-11-04T01:44:52.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.584+0000 7fbbdffff640 1 -- 172.21.15.114:0/1399809032 learned_addr learned my addr 172.21.15.114:0/1399809032 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:52.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.585+0000 7fbbe4c76640 1 -- 172.21.15.114:0/1399809032 >> v1:172.21.15.141:6789/0 conn(0x7fbbe00b1440 legacy=0x7fbbe006a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:52.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.585+0000 7fbbe4c76640 1 -- 172.21.15.114:0/1399809032 >> v1:172.21.15.114:6789/0 conn(0x7fbbe006b740 legacy=0x7fbbe00b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.585+0000 7fbbdf7fe640 1 -- 172.21.15.114:0/1399809032 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460105882 0 0) 0x7fbbe00ad6a0 con 0x7fbbe006b740 2023-11-04T01:44:52.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.585+0000 7fbbe4c76640 1 -- 172.21.15.114:0/1399809032 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe00ad0e0 con 0x7fbbe015ade0 2023-11-04T01:44:52.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.585+0000 7fbbe4c76640 1 --2- 172.21.15.114:0/1399809032 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe015ade0 0x7fbbe006c520 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009790 tx=0x7fbbd002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e88f46808cd3ce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.585+0000 7fbbdf7fe640 1 -- 172.21.15.114:0/1399809032 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0031830 con 0x7fbbe015ade0 2023-11-04T01:44:52.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.585+0000 7fbbdf7fe640 1 -- 172.21.15.114:0/1399809032 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd0031990 con 0x7fbbe015ade0 2023-11-04T01:44:52.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.585+0000 7fbbdf7fe640 1 -- 172.21.15.114:0/1399809032 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0031d20 con 0x7fbbe015ade0 2023-11-04T01:44:52.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.586+0000 7fbbe6eda640 1 -- 172.21.15.114:0/1399809032 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe015ade0 msgr2=0x7fbbe006c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.586+0000 7fbbe6eda640 1 --2- 172.21.15.114:0/1399809032 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe015ade0 0x7fbbe006c520 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009790 tx=0x7fbbd002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.586+0000 7fbbe6eda640 1 -- 172.21.15.114:0/1399809032 shutdown_connections 2023-11-04T01:44:52.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.586+0000 7fbbe6eda640 1 --2- 172.21.15.114:0/1399809032 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe015ade0 0x7fbbe006c520 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.586+0000 7fbbe6eda640 1 -- 172.21.15.114:0/1399809032 >> 172.21.15.114:0/1399809032 conn(0x7fbbe00cbd30 msgr2=0x7fbbe00cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:52.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.586+0000 7fbbe6eda640 1 -- 172.21.15.114:0/1399809032 shutdown_connections 2023-11-04T01:44:52.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.586+0000 7fbbe6eda640 1 -- 172.21.15.114:0/1399809032 wait complete. 2023-11-04T01:44:52.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.587+0000 7fbbe6eda640 1 Processor -- start 2023-11-04T01:44:52.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.587+0000 7fbbe6eda640 1 -- start start 2023-11-04T01:44:52.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.588+0000 7fbbe6eda640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbbe006b740 0x7fbbe015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.588+0000 7fbbe6eda640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe00b1440 0x7fbbe015d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.588+0000 7fbbe6eda640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbbe015ade0 0x7fbbe015d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.588+0000 7fbbe6eda640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe0070af0 con 0x7fbbe00b1440 2023-11-04T01:44:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.588+0000 7fbbe6eda640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe0070dd0 con 0x7fbbe015ade0 2023-11-04T01:44:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.588+0000 7fbbe6eda640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00710b0 con 0x7fbbe006b740 2023-11-04T01:44:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.588+0000 7fbbdffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe00b1440 0x7fbbe015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.588+0000 7fbbdffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe00b1440 0x7fbbe015d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40008/0 (socket says 172.21.15.114:40008) 2023-11-04T01:44:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.588+0000 7fbbdffff640 1 -- 172.21.15.114:0/2606111364 learned_addr learned my addr 172.21.15.114:0/2606111364 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.588+0000 7fbbdffff640 1 -- 172.21.15.114:0/2606111364 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbbe006b740 msgr2=0x7fbbe015b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.588+0000 7fbbdffff640 1 --2- 172.21.15.114:0/2606111364 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbbe006b740 0x7fbbe015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.588+0000 7fbbdffff640 1 -- 172.21.15.114:0/2606111364 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbbe015ade0 msgr2=0x7fbbe015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.588+0000 7fbbdffff640 1 --2- 172.21.15.114:0/2606111364 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbbe015ade0 0x7fbbe015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.588+0000 7fbbdffff640 1 -- 172.21.15.114:0/2606111364 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd00093a0 con 0x7fbbe00b1440 2023-11-04T01:44:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.589+0000 7fbbdffff640 1 --2- 172.21.15.114:0/2606111364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe00b1440 0x7fbbe015d020 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400c4a0 tx=0x7fbbd400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.589+0000 7fbbdd7fa640 1 -- 172.21.15.114:0/2606111364 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40074e0 con 0x7fbbe00b1440 2023-11-04T01:44:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.589+0000 7fbbdd7fa640 1 -- 172.21.15.114:0/2606111364 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd4007640 con 0x7fbbe00b1440 2023-11-04T01:44:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.589+0000 7fbbe6eda640 1 -- 172.21.15.114:0/2606111364 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe0071390 con 0x7fbbe00b1440 2023-11-04T01:44:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.589+0000 7fbbdd7fa640 1 -- 172.21.15.114:0/2606111364 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4004a00 con 0x7fbbe00b1440 2023-11-04T01:44:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.589+0000 7fbbe6eda640 1 -- 172.21.15.114:0/2606111364 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe009c7b0 con 0x7fbbe00b1440 2023-11-04T01:44:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.590+0000 7fbbe6eda640 1 -- 172.21.15.114:0/2606111364 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe00684b0 con 0x7fbbe00b1440 2023-11-04T01:44:52.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.590+0000 7fbbdd7fa640 1 -- 172.21.15.114:0/2606111364 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbbd4004b60 con 0x7fbbe00b1440 2023-11-04T01:44:52.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.590+0000 7fbbdd7fa640 1 --2- 172.21.15.114:0/2606111364 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbbcc06ae70 0x7fbbcc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.591+0000 7fbbdd7fa640 1 -- 172.21.15.114:0/2606111364 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7fbbd40895a0 con 0x7fbbe00b1440 2023-11-04T01:44:52.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.591+0000 7fbbe4c76640 1 --2- 172.21.15.114:0/2606111364 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbbcc06ae70 0x7fbbcc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.591+0000 7fbbe4c76640 1 --2- 172.21.15.114:0/2606111364 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbbcc06ae70 0x7fbbcc06d330 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0036000 tx=0x7fbbd0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.595+0000 7fbbdd7fa640 1 -- 172.21.15.114:0/2606111364 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbbd4053c40 con 0x7fbbe00b1440 2023-11-04T01:44:52.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.760+0000 7fbbe6eda640 1 -- 172.21.15.114:0/2606111364 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fbbe00b18e0 con 0x7fbbe00b1440 2023-11-04T01:44:52.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.760+0000 7fbbdd7fa640 1 -- 172.21.15.114:0/2606111364 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v116) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbbd4018020 con 0x7fbbe00b1440 2023-11-04T01:44:52.762 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:44:52.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.762+0000 7fbbe6eda640 1 -- 172.21.15.114:0/2606111364 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbbcc06ae70 msgr2=0x7fbbcc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.762+0000 7fbbe6eda640 1 --2- 172.21.15.114:0/2606111364 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbbcc06ae70 0x7fbbcc06d330 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0036000 tx=0x7fbbd0030000 comp rx=0 tx=0).stop 2023-11-04T01:44:52.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.762+0000 7fbbe6eda640 1 -- 172.21.15.114:0/2606111364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe00b1440 msgr2=0x7fbbe015d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.762+0000 7fbbe6eda640 1 --2- 172.21.15.114:0/2606111364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe00b1440 0x7fbbe015d020 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400c4a0 tx=0x7fbbd400c960 comp rx=0 tx=0).stop 2023-11-04T01:44:52.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.762+0000 7fbbe6eda640 1 -- 172.21.15.114:0/2606111364 shutdown_connections 2023-11-04T01:44:52.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.762+0000 7fbbe6eda640 1 --2- 172.21.15.114:0/2606111364 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fbbcc06ae70 0x7fbbcc06d330 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.763+0000 7fbbe6eda640 1 --2- 172.21.15.114:0/2606111364 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fbbe015ade0 0x7fbbe015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.763+0000 7fbbe6eda640 1 --2- 172.21.15.114:0/2606111364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe00b1440 0x7fbbe015d020 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.763+0000 7fbbe6eda640 1 --2- 172.21.15.114:0/2606111364 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fbbe006b740 0x7fbbe015b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.763+0000 7fbbe6eda640 1 -- 172.21.15.114:0/2606111364 >> 172.21.15.114:0/2606111364 conn(0x7fbbe00cbd30 msgr2=0x7fbbe00b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:52.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.763+0000 7fbbe6eda640 1 -- 172.21.15.114:0/2606111364 shutdown_connections 2023-11-04T01:44:52.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.763+0000 7fbbe6eda640 1 -- 172.21.15.114:0/2606111364 wait complete. 2023-11-04T01:44:52.775 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:44:52.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.875+0000 7f3c51c10640 1 Processor -- start 2023-11-04T01:44:52.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.875+0000 7f3c51c10640 1 -- start start 2023-11-04T01:44:52.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.876+0000 7f3c51c10640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3c4c15d100 0x7f3c4c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.876+0000 7f3c51c10640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c4c15d4e0 0x7f3c4c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.876+0000 7f3c51c10640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c0b32b0 con 0x7f3c4c0d3b60 2023-11-04T01:44:52.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.876+0000 7f3c51c10640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c4c0cee10 con 0x7f3c4c15d100 2023-11-04T01:44:52.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.876+0000 7f3c51c10640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0b4750 con 0x7f3c4c15d4e0 2023-11-04T01:44:52.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.876+0000 7f3c4b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3c4c15d100 0x7f3c4c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.876+0000 7f3c4b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3c4c15d100 0x7f3c4c0ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40016/0 (socket says 172.21.15.114:40016) 2023-11-04T01:44:52.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.876+0000 7f3c4b7fe640 1 -- 172.21.15.114:0/1241389704 learned_addr learned my addr 172.21.15.114:0/1241389704 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:52.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.876+0000 7f3c4affd640 1 --2- 172.21.15.114:0/1241389704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c4c15d4e0 0x7f3c4c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.877+0000 7f3c4b7fe640 1 -- 172.21.15.114:0/1241389704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c4c15d4e0 msgr2=0x7f3c4c0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:52.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.877+0000 7f3c4b7fe640 1 --2- 172.21.15.114:0/1241389704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c4c15d4e0 0x7f3c4c0d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.877+0000 7f3c4b7fe640 1 -- 172.21.15.114:0/1241389704 >> v1:172.21.15.141:6789/0 conn(0x7f3c4c0d3b60 legacy=0x7f3c4c0cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.877+0000 7f3c4b7fe640 1 -- 172.21.15.114:0/1241389704 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c0b2980 con 0x7f3c4c15d100 2023-11-04T01:44:52.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.877+0000 7f3c4affd640 1 --2- 172.21.15.114:0/1241389704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c4c15d4e0 0x7f3c4c0d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:52.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.877+0000 7f3c4b7fe640 1 --2- 172.21.15.114:0/1241389704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c4c15d100 0x7f3c4c0ce510 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009850 tx=0x7f3c3c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afb7e80fe6ef19e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.877+0000 7f3c4a7fc640 1 -- 172.21.15.114:0/1241389704 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c004230 con 0x7f3c4c15d100 2023-11-04T01:44:52.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.877+0000 7f3c4a7fc640 1 -- 172.21.15.114:0/1241389704 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c004390 con 0x7f3c4c15d100 2023-11-04T01:44:52.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.878+0000 7f3c4a7fc640 1 -- 172.21.15.114:0/1241389704 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c003810 con 0x7f3c4c15d100 2023-11-04T01:44:52.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.878+0000 7f3c51c10640 1 -- 172.21.15.114:0/1241389704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c4c15d100 msgr2=0x7f3c4c0ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.878+0000 7f3c51c10640 1 --2- 172.21.15.114:0/1241389704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c4c15d100 0x7f3c4c0ce510 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009850 tx=0x7f3c3c02b960 comp rx=0 tx=0).stop 2023-11-04T01:44:52.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.878+0000 7f3c51c10640 1 -- 172.21.15.114:0/1241389704 shutdown_connections 2023-11-04T01:44:52.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.878+0000 7f3c51c10640 1 --2- 172.21.15.114:0/1241389704 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c4c15d4e0 0x7f3c4c0d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.878+0000 7f3c51c10640 1 --2- 172.21.15.114:0/1241389704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c4c15d100 0x7f3c4c0ce510 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.878+0000 7f3c51c10640 1 -- 172.21.15.114:0/1241389704 >> 172.21.15.114:0/1241389704 conn(0x7f3c4c0d2ef0 msgr2=0x7f3c4c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:52.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.878+0000 7f3c51c10640 1 -- 172.21.15.114:0/1241389704 shutdown_connections 2023-11-04T01:44:52.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.878+0000 7f3c51c10640 1 -- 172.21.15.114:0/1241389704 wait complete. 2023-11-04T01:44:52.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.879+0000 7f3c51c10640 1 Processor -- start 2023-11-04T01:44:52.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.879+0000 7f3c51c10640 1 -- start start 2023-11-04T01:44:52.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.880+0000 7f3c51c10640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c4c0d3b60 0x7f3c4c14d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.880+0000 7f3c51c10640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c4c15d100 0x7f3c4c0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.880+0000 7f3c51c10640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c4c15d4e0 0x7f3c4c0b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.880+0000 7f3c51c10640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0cca20 con 0x7f3c4c15d100 2023-11-04T01:44:52.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.880+0000 7f3c51c10640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c1568a0 con 0x7f3c4c15d4e0 2023-11-04T01:44:52.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.880+0000 7f3c51c10640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0cbea0 con 0x7f3c4c0d3b60 2023-11-04T01:44:52.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.880+0000 7f3c4affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c4c15d100 0x7f3c4c0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.880+0000 7f3c4affd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c4c15d100 0x7f3c4c0cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40028/0 (socket says 172.21.15.114:40028) 2023-11-04T01:44:52.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.880+0000 7f3c4affd640 1 -- 172.21.15.114:0/1464674940 learned_addr learned my addr 172.21.15.114:0/1464674940 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:52.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.880+0000 7f3c4b7fe640 1 --2- 172.21.15.114:0/1464674940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c4c0d3b60 0x7f3c4c14d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.880+0000 7f3c4bfff640 1 --2- 172.21.15.114:0/1464674940 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c4c15d4e0 0x7f3c4c0b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.880+0000 7f3c4affd640 1 -- 172.21.15.114:0/1464674940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c4c0d3b60 msgr2=0x7f3c4c14d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.880+0000 7f3c4affd640 1 --2- 172.21.15.114:0/1464674940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c4c0d3b60 0x7f3c4c14d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.880+0000 7f3c4affd640 1 -- 172.21.15.114:0/1464674940 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c4c15d4e0 msgr2=0x7f3c4c0b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.880+0000 7f3c4affd640 1 --2- 172.21.15.114:0/1464674940 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c4c15d4e0 0x7f3c4c0b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.880+0000 7f3c4affd640 1 -- 172.21.15.114:0/1464674940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c009460 con 0x7f3c4c15d100 2023-11-04T01:44:52.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.881+0000 7f3c4affd640 1 --2- 172.21.15.114:0/1464674940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c4c15d100 0x7f3c4c0cab00 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000e7e0 tx=0x7f3c4000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.881+0000 7f3c33fff640 1 -- 172.21.15.114:0/1464674940 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40004030 con 0x7f3c4c15d100 2023-11-04T01:44:52.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.881+0000 7f3c33fff640 1 -- 172.21.15.114:0/1464674940 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c40004190 con 0x7f3c4c15d100 2023-11-04T01:44:52.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.881+0000 7f3c51c10640 1 -- 172.21.15.114:0/1464674940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c0cc180 con 0x7f3c4c15d100 2023-11-04T01:44:52.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.881+0000 7f3c33fff640 1 -- 172.21.15.114:0/1464674940 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40004520 con 0x7f3c4c15d100 2023-11-04T01:44:52.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.881+0000 7f3c51c10640 1 -- 172.21.15.114:0/1464674940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c0cc740 con 0x7f3c4c15d100 2023-11-04T01:44:52.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.882+0000 7f3c51c10640 1 -- 172.21.15.114:0/1464674940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4c0684b0 con 0x7f3c4c15d100 2023-11-04T01:44:52.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.882+0000 7f3c33fff640 1 -- 172.21.15.114:0/1464674940 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c4000c6d0 con 0x7f3c4c15d100 2023-11-04T01:44:52.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.882+0000 7f3c33fff640 1 --2- 172.21.15.114:0/1464674940 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3c3806ae70 0x7f3c3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.883+0000 7f3c33fff640 1 -- 172.21.15.114:0/1464674940 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f3c40089c20 con 0x7f3c4c15d100 2023-11-04T01:44:52.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.883+0000 7f3c4b7fe640 1 --2- 172.21.15.114:0/1464674940 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3c3806ae70 0x7f3c3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.883+0000 7f3c4b7fe640 1 --2- 172.21.15.114:0/1464674940 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3c3806ae70 0x7f3c3806d330 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c035000 tx=0x7f3c3c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:52.887+0000 7f3c33fff640 1 -- 172.21.15.114:0/1464674940 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3c40054350 con 0x7f3c4c15d100 2023-11-04T01:44:53.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.058+0000 7f3c51c10640 1 -- 172.21.15.114:0/1464674940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f3c4c0d2cd0 con 0x7f3c4c15d100 2023-11-04T01:44:53.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.058+0000 7f3c33fff640 1 -- 172.21.15.114:0/1464674940 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v116) v1 ==== 107+0+11 (secure 0 0 0) 0x7f3c400200b0 con 0x7f3c4c15d100 2023-11-04T01:44:53.060 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:44:53.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.060+0000 7f3c51c10640 1 -- 172.21.15.114:0/1464674940 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3c3806ae70 msgr2=0x7f3c3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.060+0000 7f3c51c10640 1 --2- 172.21.15.114:0/1464674940 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3c3806ae70 0x7f3c3806d330 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c035000 tx=0x7f3c3c008030 comp rx=0 tx=0).stop 2023-11-04T01:44:53.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.060+0000 7f3c51c10640 1 -- 172.21.15.114:0/1464674940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c4c15d100 msgr2=0x7f3c4c0cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.060+0000 7f3c51c10640 1 --2- 172.21.15.114:0/1464674940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c4c15d100 0x7f3c4c0cab00 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000e7e0 tx=0x7f3c4000eca0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.060+0000 7f3c51c10640 1 -- 172.21.15.114:0/1464674940 shutdown_connections 2023-11-04T01:44:53.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.060+0000 7f3c51c10640 1 --2- 172.21.15.114:0/1464674940 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f3c3806ae70 0x7f3c3806d330 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.060+0000 7f3c51c10640 1 --2- 172.21.15.114:0/1464674940 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f3c4c15d4e0 0x7f3c4c0b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.060+0000 7f3c51c10640 1 --2- 172.21.15.114:0/1464674940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c4c15d100 0x7f3c4c0cab00 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.060+0000 7f3c51c10640 1 --2- 172.21.15.114:0/1464674940 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f3c4c0d3b60 0x7f3c4c14d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.060+0000 7f3c51c10640 1 -- 172.21.15.114:0/1464674940 >> 172.21.15.114:0/1464674940 conn(0x7f3c4c0d2ef0 msgr2=0x7f3c4c0cfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:53.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.060+0000 7f3c51c10640 1 -- 172.21.15.114:0/1464674940 shutdown_connections 2023-11-04T01:44:53.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.060+0000 7f3c51c10640 1 -- 172.21.15.114:0/1464674940 wait complete. 2023-11-04T01:44:53.072 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:44:53.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.173+0000 7fb45b8fc640 1 Processor -- start 2023-11-04T01:44:53.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.173+0000 7fb45b8fc640 1 -- start start 2023-11-04T01:44:53.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.174+0000 7fb45b8fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb45415d100 0x7fb4540ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.174+0000 7fb45b8fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4540b32b0 con 0x7fb45415d4e0 2023-11-04T01:44:53.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.174+0000 7fb45b8fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4540cee10 con 0x7fb4540d1be0 2023-11-04T01:44:53.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.174+0000 7fb45b8fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4540b2980 con 0x7fb45415d100 2023-11-04T01:44:53.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.174+0000 7fb459698640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb45415d100 0x7fb4540ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.174+0000 7fb458e97640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb45415d4e0 0x7fb4540d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34640/0 (socket says 172.21.15.114:34640) 2023-11-04T01:44:53.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.174+0000 7fb458e97640 1 -- 172.21.15.114:0/3629533135 learned_addr learned my addr 172.21.15.114:0/3629533135 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:53.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.175+0000 7fb459698640 1 -- 172.21.15.114:0/3629533135 >> v1:172.21.15.141:6789/0 conn(0x7fb4540d1be0 legacy=0x7fb4540b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:53.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.175+0000 7fb459698640 1 -- 172.21.15.114:0/3629533135 >> v1:172.21.15.114:6789/0 conn(0x7fb45415d4e0 legacy=0x7fb4540d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.175+0000 7fb44bfff640 1 -- 172.21.15.114:0/3629533135 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274135320 0 0) 0x7fb4540b32b0 con 0x7fb45415d4e0 2023-11-04T01:44:53.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.175+0000 7fb459698640 1 -- 172.21.15.114:0/3629533135 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540b2c60 con 0x7fb45415d100 2023-11-04T01:44:53.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.175+0000 7fb459698640 1 --2- 172.21.15.114:0/3629533135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb45415d100 0x7fb4540ce510 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fb450009de0 tx=0x7fb45002bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf15fff57e63f24 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:53.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.175+0000 7fb44bfff640 1 -- 172.21.15.114:0/3629533135 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45002ccb0 con 0x7fb45415d100 2023-11-04T01:44:53.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.176+0000 7fb44bfff640 1 -- 172.21.15.114:0/3629533135 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45002ce10 con 0x7fb45415d100 2023-11-04T01:44:53.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.176+0000 7fb44bfff640 1 -- 172.21.15.114:0/3629533135 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb450034660 con 0x7fb45415d100 2023-11-04T01:44:53.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.176+0000 7fb45b8fc640 1 -- 172.21.15.114:0/3629533135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb45415d100 msgr2=0x7fb4540ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.176+0000 7fb45b8fc640 1 --2- 172.21.15.114:0/3629533135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb45415d100 0x7fb4540ce510 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fb450009de0 tx=0x7fb45002bf00 comp rx=0 tx=0).stop 2023-11-04T01:44:53.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.176+0000 7fb45b8fc640 1 -- 172.21.15.114:0/3629533135 shutdown_connections 2023-11-04T01:44:53.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.176+0000 7fb45b8fc640 1 --2- 172.21.15.114:0/3629533135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb45415d100 0x7fb4540ce510 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.176+0000 7fb45b8fc640 1 -- 172.21.15.114:0/3629533135 >> 172.21.15.114:0/3629533135 conn(0x7fb4540d2ef0 msgr2=0x7fb4540d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:53.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.176+0000 7fb45b8fc640 1 -- 172.21.15.114:0/3629533135 shutdown_connections 2023-11-04T01:44:53.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.176+0000 7fb45b8fc640 1 -- 172.21.15.114:0/3629533135 wait complete. 2023-11-04T01:44:53.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.177+0000 7fb45b8fc640 1 Processor -- start 2023-11-04T01:44:53.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.177+0000 7fb45b8fc640 1 -- start start 2023-11-04T01:44:53.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb45b8fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4540d1be0 0x7fb45414e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb45b8fc640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb45415d100 0x7fb4540b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb45b8fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb45415d4e0 0x7fb4540b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb45b8fc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540b7600 con 0x7fb4540d1be0 2023-11-04T01:44:53.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb45b8fc640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540b78e0 con 0x7fb45415d100 2023-11-04T01:44:53.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb45b8fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540b7bc0 con 0x7fb45415d4e0 2023-11-04T01:44:53.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb459698640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4540d1be0 0x7fb45414e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb459698640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4540d1be0 0x7fb45414e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40054/0 (socket says 172.21.15.114:40054) 2023-11-04T01:44:53.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb459698640 1 -- 172.21.15.114:0/3484094801 learned_addr learned my addr 172.21.15.114:0/3484094801 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:53.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb459698640 1 -- 172.21.15.114:0/3484094801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb45415d4e0 msgr2=0x7fb4540b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb458e97640 1 --2- 172.21.15.114:0/3484094801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb45415d100 0x7fb4540b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb459e99640 1 --2- 172.21.15.114:0/3484094801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb45415d4e0 0x7fb4540b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb459698640 1 --2- 172.21.15.114:0/3484094801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb45415d4e0 0x7fb4540b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb459698640 1 -- 172.21.15.114:0/3484094801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb45415d100 msgr2=0x7fb4540b6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb459698640 1 --2- 172.21.15.114:0/3484094801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb45415d100 0x7fb4540b6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb459698640 1 -- 172.21.15.114:0/3484094801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb450009a70 con 0x7fb4540d1be0 2023-11-04T01:44:53.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb459e99640 1 --2- 172.21.15.114:0/3484094801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb45415d4e0 0x7fb4540b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:53.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.178+0000 7fb458e97640 1 --2- 172.21.15.114:0/3484094801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb45415d100 0x7fb4540b6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:53.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.179+0000 7fb459698640 1 --2- 172.21.15.114:0/3484094801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4540d1be0 0x7fb45414e440 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fb450009f00 tx=0x7fb450004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:53.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.179+0000 7fb449ffb640 1 -- 172.21.15.114:0/3484094801 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb450003990 con 0x7fb4540d1be0 2023-11-04T01:44:53.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.179+0000 7fb449ffb640 1 -- 172.21.15.114:0/3484094801 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb450003af0 con 0x7fb4540d1be0 2023-11-04T01:44:53.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.179+0000 7fb45b8fc640 1 -- 172.21.15.114:0/3484094801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4540b7ea0 con 0x7fb4540d1be0 2023-11-04T01:44:53.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.179+0000 7fb449ffb640 1 -- 172.21.15.114:0/3484094801 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb450003ea0 con 0x7fb4540d1be0 2023-11-04T01:44:53.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.179+0000 7fb45b8fc640 1 -- 172.21.15.114:0/3484094801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4540b71d0 con 0x7fb4540d1be0 2023-11-04T01:44:53.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.180+0000 7fb45b8fc640 1 -- 172.21.15.114:0/3484094801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4540b83c0 con 0x7fb4540d1be0 2023-11-04T01:44:53.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.180+0000 7fb449ffb640 1 -- 172.21.15.114:0/3484094801 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb450004000 con 0x7fb4540d1be0 2023-11-04T01:44:53.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.181+0000 7fb449ffb640 1 --2- 172.21.15.114:0/3484094801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb43806ae70 0x7fb43806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.181+0000 7fb449ffb640 1 -- 172.21.15.114:0/3484094801 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7fb4500acd30 con 0x7fb4540d1be0 2023-11-04T01:44:53.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.181+0000 7fb458e97640 1 --2- 172.21.15.114:0/3484094801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb43806ae70 0x7fb43806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.181+0000 7fb458e97640 1 --2- 172.21.15.114:0/3484094801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb43806ae70 0x7fb43806d330 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb4540ca6a0 tx=0x7fb444009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:53.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.185+0000 7fb449ffb640 1 -- 172.21.15.114:0/3484094801 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb4540b83c0 con 0x7fb4540d1be0 2023-11-04T01:44:53.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.349+0000 7fb45b8fc640 1 -- 172.21.15.114:0/3484094801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4540b83c0 con 0x7fb4540d1be0 2023-11-04T01:44:53.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.350+0000 7fb449ffb640 1 -- 172.21.15.114:0/3484094801 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb450039020 con 0x7fb4540d1be0 2023-11-04T01:44:53.351 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-11-04T01:44:53.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.351+0000 7fb45b8fc640 1 -- 172.21.15.114:0/3484094801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb43806ae70 msgr2=0x7fb43806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.351+0000 7fb45b8fc640 1 --2- 172.21.15.114:0/3484094801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb43806ae70 0x7fb43806d330 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb4540ca6a0 tx=0x7fb444009040 comp rx=0 tx=0).stop 2023-11-04T01:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.351+0000 7fb45b8fc640 1 -- 172.21.15.114:0/3484094801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4540d1be0 msgr2=0x7fb45414e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.351+0000 7fb45b8fc640 1 --2- 172.21.15.114:0/3484094801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4540d1be0 0x7fb45414e440 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fb450009f00 tx=0x7fb450004a40 comp rx=0 tx=0).stop 2023-11-04T01:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.352+0000 7fb45b8fc640 1 -- 172.21.15.114:0/3484094801 shutdown_connections 2023-11-04T01:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.352+0000 7fb45b8fc640 1 --2- 172.21.15.114:0/3484094801 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fb45415d4e0 0x7fb4540b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.352+0000 7fb45b8fc640 1 --2- 172.21.15.114:0/3484094801 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7fb43806ae70 0x7fb43806d330 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.352+0000 7fb45b8fc640 1 --2- 172.21.15.114:0/3484094801 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7fb45415d100 0x7fb4540b6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.352+0000 7fb45b8fc640 1 --2- 172.21.15.114:0/3484094801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4540d1be0 0x7fb45414e440 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.352+0000 7fb45b8fc640 1 -- 172.21.15.114:0/3484094801 >> 172.21.15.114:0/3484094801 conn(0x7fb4540d2ef0 msgr2=0x7fb4540b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.352+0000 7fb45b8fc640 1 -- 172.21.15.114:0/3484094801 shutdown_connections 2023-11-04T01:44:53.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.352+0000 7fb45b8fc640 1 -- 172.21.15.114:0/3484094801 wait complete. 2023-11-04T01:44:53.364 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:44:53.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.465+0000 7f137687c640 1 Processor -- start 2023-11-04T01:44:53.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.465+0000 7f137687c640 1 -- start start 2023-11-04T01:44:53.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.465+0000 7f137687c640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f137015d100 0x7f13700ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.465+0000 7f137687c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13700d1be0 0x7f13700b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.465+0000 7f137687c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13700b32b0 con 0x7f137015d4e0 2023-11-04T01:44:53.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.465+0000 7f137687c640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13700cee10 con 0x7f137015d100 2023-11-04T01:44:53.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.465+0000 7f137687c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13700b2980 con 0x7f13700d1be0 2023-11-04T01:44:53.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136f7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f137015d4e0 0x7f13700d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34652/0 (socket says 172.21.15.114:34652) 2023-11-04T01:44:53.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136f7fe640 1 -- 172.21.15.114:0/3566291248 learned_addr learned my addr 172.21.15.114:0/3566291248 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:53.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136effd640 1 -- 172.21.15.114:0/3566291248 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875572950 0 0) 0x7f13700b32b0 con 0x7f137015d4e0 2023-11-04T01:44:53.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f1374e19640 1 --2- 172.21.15.114:0/3566291248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13700d1be0 0x7f13700b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136ffff640 1 --2- 172.21.15.114:0/3566291248 >> v2:172.21.15.141:3300/0 conn(0x7f137015d100 0x7f13700ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136effd640 1 -- 172.21.15.114:0/3566291248 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1358003520 con 0x7f137015d4e0 2023-11-04T01:44:53.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136effd640 1 -- 172.21.15.114:0/3566291248 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2694998286 0 0) 0x7f1358003520 con 0x7f137015d4e0 2023-11-04T01:44:53.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136effd640 1 -- 172.21.15.114:0/3566291248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13700d1be0 msgr2=0x7f13700b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:53.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136effd640 1 --2- 172.21.15.114:0/3566291248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13700d1be0 0x7f13700b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136effd640 1 -- 172.21.15.114:0/3566291248 >> v2:172.21.15.141:3300/0 conn(0x7f137015d100 msgr2=0x7f13700ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:53.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136effd640 1 --2- 172.21.15.114:0/3566291248 >> v2:172.21.15.141:3300/0 conn(0x7f137015d100 0x7f13700ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136effd640 1 -- 172.21.15.114:0/3566291248 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13700b2c60 con 0x7f137015d4e0 2023-11-04T01:44:53.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136effd640 1 -- 172.21.15.114:0/3566291248 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280533198 0 0) 0x7f1364001670 con 0x7f137015d4e0 2023-11-04T01:44:53.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136effd640 1 -- 172.21.15.114:0/3566291248 >> v1:172.21.15.114:6789/0 conn(0x7f137015d4e0 legacy=0x7f13700d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136effd640 1 --2- 172.21.15.114:0/3566291248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1358003970 0x7f1358003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136effd640 1 --2- 172.21.15.114:0/3566291248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13580047c0 0x7f1358004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136effd640 1 --2- 172.21.15.114:0/3566291248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13700d1be0 0x7f1358005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136effd640 1 -- 172.21.15.114:0/3566291248 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13700cee10 con 0x7f13580047c0 2023-11-04T01:44:53.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136effd640 1 -- 172.21.15.114:0/3566291248 --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13700b2980 con 0x7f1358003970 2023-11-04T01:44:53.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136effd640 1 -- 172.21.15.114:0/3566291248 --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135800b980 con 0x7f13700d1be0 2023-11-04T01:44:53.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136f7fe640 1 --2- 172.21.15.114:0/3566291248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13580047c0 0x7f1358004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f136ffff640 1 --2- 172.21.15.114:0/3566291248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1358003970 0x7f1358003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.466+0000 7f1374e19640 1 --2- 172.21.15.114:0/3566291248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13700d1be0 0x7f1358005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.467+0000 7f136f7fe640 1 -- 172.21.15.114:0/3566291248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13700d1be0 msgr2=0x7f1358005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:53.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.467+0000 7f136f7fe640 1 --2- 172.21.15.114:0/3566291248 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13700d1be0 0x7f1358005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.467+0000 7f136f7fe640 1 -- 172.21.15.114:0/3566291248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1358003970 msgr2=0x7f1358003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:53.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.467+0000 7f136f7fe640 1 --2- 172.21.15.114:0/3566291248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1358003970 0x7f1358003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.467+0000 7f136f7fe640 1 -- 172.21.15.114:0/3566291248 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1358003520 con 0x7f13580047c0 2023-11-04T01:44:53.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.467+0000 7f136ffff640 1 --2- 172.21.15.114:0/3566291248 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f1358003970 0x7f1358003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:53.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.467+0000 7f136f7fe640 1 --2- 172.21.15.114:0/3566291248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13580047c0 0x7f1358004c40 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f137015d910 tx=0x7f13580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cda895b8b9edd9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:53.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.467+0000 7f136effd640 1 -- 172.21.15.114:0/3566291248 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364005ad0 con 0x7f13580047c0 2023-11-04T01:44:53.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.467+0000 7f136effd640 1 -- 172.21.15.114:0/3566291248 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1364005c30 con 0x7f13580047c0 2023-11-04T01:44:53.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.467+0000 7f136effd640 1 -- 172.21.15.114:0/3566291248 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136402c890 con 0x7f13580047c0 2023-11-04T01:44:53.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.468+0000 7f137687c640 1 -- 172.21.15.114:0/3566291248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13580047c0 msgr2=0x7f1358004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.468+0000 7f137687c640 1 --2- 172.21.15.114:0/3566291248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13580047c0 0x7f1358004c40 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f137015d910 tx=0x7f13580057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.468+0000 7f1374e19640 1 -- 172.21.15.114:0/3566291248 reap_dead start 2023-11-04T01:44:53.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.468+0000 7f137687c640 1 -- 172.21.15.114:0/3566291248 shutdown_connections 2023-11-04T01:44:53.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.468+0000 7f137687c640 1 -- 172.21.15.114:0/3566291248 >> 172.21.15.114:0/3566291248 conn(0x7f13700d2ef0 msgr2=0x7f13700d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:53.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.468+0000 7f137687c640 1 -- 172.21.15.114:0/3566291248 shutdown_connections 2023-11-04T01:44:53.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.468+0000 7f137687c640 1 -- 172.21.15.114:0/3566291248 wait complete. 2023-11-04T01:44:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.469+0000 7f137687c640 1 Processor -- start 2023-11-04T01:44:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.469+0000 7f137687c640 1 -- start start 2023-11-04T01:44:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f137687c640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13580047c0 0x7f137014c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f137687c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13700c9fc0 0x7f13700ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f137687c640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13700cbeb0 0x7f13700cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f137687c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13700cc870 con 0x7f13700c9fc0 2023-11-04T01:44:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f137687c640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13700caa80 con 0x7f13580047c0 2023-11-04T01:44:53.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f137687c640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13700cad60 con 0x7f13700cbeb0 2023-11-04T01:44:53.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f136f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13700c9fc0 0x7f13700ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f136f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13700c9fc0 0x7f13700ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40058/0 (socket says 172.21.15.114:40058) 2023-11-04T01:44:53.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f136f7fe640 1 -- 172.21.15.114:0/4193466951 learned_addr learned my addr 172.21.15.114:0/4193466951 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:53.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f136ffff640 1 --2- 172.21.15.114:0/4193466951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13580047c0 0x7f137014c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f1374e19640 1 --2- 172.21.15.114:0/4193466951 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13700cbeb0 0x7f13700cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f136f7fe640 1 -- 172.21.15.114:0/4193466951 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13700cbeb0 msgr2=0x7f13700cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f136f7fe640 1 --2- 172.21.15.114:0/4193466951 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13700cbeb0 0x7f13700cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f136f7fe640 1 -- 172.21.15.114:0/4193466951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13580047c0 msgr2=0x7f137014c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f136f7fe640 1 --2- 172.21.15.114:0/4193466951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13580047c0 0x7f137014c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f136f7fe640 1 -- 172.21.15.114:0/4193466951 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13700cb040 con 0x7f13700c9fc0 2023-11-04T01:44:53.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.470+0000 7f136f7fe640 1 --2- 172.21.15.114:0/4193466951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13700c9fc0 0x7f13700ca440 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f1364000f60 tx=0x7f1364000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:53.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.471+0000 7f136cff9640 1 -- 172.21.15.114:0/4193466951 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364039070 con 0x7f13700c9fc0 2023-11-04T01:44:53.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.471+0000 7f136cff9640 1 -- 172.21.15.114:0/4193466951 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136402dd70 con 0x7f13700c9fc0 2023-11-04T01:44:53.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.471+0000 7f137687c640 1 -- 172.21.15.114:0/4193466951 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13700cb320 con 0x7f13700c9fc0 2023-11-04T01:44:53.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.471+0000 7f136cff9640 1 -- 172.21.15.114:0/4193466951 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13640072b0 con 0x7f13700c9fc0 2023-11-04T01:44:53.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.471+0000 7f137687c640 1 -- 172.21.15.114:0/4193466951 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137014c7d0 con 0x7f13700c9fc0 2023-11-04T01:44:53.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.472+0000 7f137687c640 1 -- 172.21.15.114:0/4193466951 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13700684b0 con 0x7f13700c9fc0 2023-11-04T01:44:53.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.472+0000 7f136cff9640 1 -- 172.21.15.114:0/4193466951 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1364032070 con 0x7f13700c9fc0 2023-11-04T01:44:53.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.473+0000 7f136cff9640 1 --2- 172.21.15.114:0/4193466951 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f135c06aea0 0x7f135c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.473+0000 7f136cff9640 1 -- 172.21.15.114:0/4193466951 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f136403c040 con 0x7f13700c9fc0 2023-11-04T01:44:53.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.473+0000 7f136ffff640 1 --2- 172.21.15.114:0/4193466951 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f135c06aea0 0x7f135c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.473+0000 7f136ffff640 1 --2- 172.21.15.114:0/4193466951 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f135c06aea0 0x7f135c06d360 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f13700cbd40 tx=0x7f1360008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:53.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.477+0000 7f136cff9640 1 -- 172.21.15.114:0/4193466951 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1364075be0 con 0x7f13700c9fc0 2023-11-04T01:44:53.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.642+0000 7f137687c640 1 -- 172.21.15.114:0/4193466951 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f13700d2cd0 con 0x7f13700c9fc0 2023-11-04T01:44:53.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.642+0000 7f136cff9640 1 -- 172.21.15.114:0/4193466951 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1364045070 con 0x7f13700c9fc0 2023-11-04T01:44:53.644 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-11-04T01:44:53.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.644+0000 7f137687c640 1 -- 172.21.15.114:0/4193466951 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f135c06aea0 msgr2=0x7f135c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.644+0000 7f137687c640 1 --2- 172.21.15.114:0/4193466951 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f135c06aea0 0x7f135c06d360 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f13700cbd40 tx=0x7f1360008040 comp rx=0 tx=0).stop 2023-11-04T01:44:53.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.644+0000 7f137687c640 1 -- 172.21.15.114:0/4193466951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13700c9fc0 msgr2=0x7f13700ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.644+0000 7f137687c640 1 --2- 172.21.15.114:0/4193466951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13700c9fc0 0x7f13700ca440 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f1364000f60 tx=0x7f1364000fe0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.644+0000 7f137687c640 1 -- 172.21.15.114:0/4193466951 shutdown_connections 2023-11-04T01:44:53.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.644+0000 7f137687c640 1 --2- 172.21.15.114:0/4193466951 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f13700cbeb0 0x7f13700cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.644+0000 7f137687c640 1 --2- 172.21.15.114:0/4193466951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13700c9fc0 0x7f13700ca440 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.644+0000 7f137687c640 1 --2- 172.21.15.114:0/4193466951 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f135c06aea0 0x7f135c06d360 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.644+0000 7f137687c640 1 --2- 172.21.15.114:0/4193466951 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f13580047c0 0x7f137014c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.644+0000 7f137687c640 1 -- 172.21.15.114:0/4193466951 >> 172.21.15.114:0/4193466951 conn(0x7f13700d2ef0 msgr2=0x7f137006bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:53.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.645+0000 7f137687c640 1 -- 172.21.15.114:0/4193466951 shutdown_connections 2023-11-04T01:44:53.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.645+0000 7f137687c640 1 -- 172.21.15.114:0/4193466951 wait complete. 2023-11-04T01:44:53.657 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:44:53.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.755+0000 7f424161a640 1 Processor -- start 2023-11-04T01:44:53.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.755+0000 7f424161a640 1 -- start start 2023-11-04T01:44:53.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.756+0000 7f424161a640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f423c15d4e0 0x7f423c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.756+0000 7f424161a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f423c0d3b60 0x7f423c0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.756+0000 7f424161a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423c0b32b0 con 0x7f423c15d100 2023-11-04T01:44:53.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.756+0000 7f424161a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423c0cec20 con 0x7f423c0d3b60 2023-11-04T01:44:53.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.756+0000 7f424161a640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423c0cee10 con 0x7f423c15d4e0 2023-11-04T01:44:53.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.756+0000 7f423b7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f423c0d3b60 0x7f423c0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.756+0000 7f423affd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f423c15d100 0x7f423c0ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34668/0 (socket says 172.21.15.114:34668) 2023-11-04T01:44:53.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.756+0000 7f423affd640 1 -- 172.21.15.114:0/1087769848 learned_addr learned my addr 172.21.15.114:0/1087769848 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-11-04T01:44:53.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.756+0000 7f423b7fe640 1 -- 172.21.15.114:0/1087769848 >> v2:172.21.15.141:3300/0 conn(0x7f423c15d4e0 msgr2=0x7f423c0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:53.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.756+0000 7f423b7fe640 1 --2- 172.21.15.114:0/1087769848 >> v2:172.21.15.141:3300/0 conn(0x7f423c15d4e0 0x7f423c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.756+0000 7f423b7fe640 1 -- 172.21.15.114:0/1087769848 >> v1:172.21.15.114:6789/0 conn(0x7f423c15d100 legacy=0x7f423c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.756+0000 7f423b7fe640 1 -- 172.21.15.114:0/1087769848 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c0b4750 con 0x7f423c0d3b60 2023-11-04T01:44:53.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.757+0000 7f423b7fe640 1 --2- 172.21.15.114:0/1087769848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f423c0d3b60 0x7f423c0d1a10 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f423c160da0 tx=0x7f423402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca84de18883a5fa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:53.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.757+0000 7f4239ffb640 1 -- 172.21.15.114:0/1087769848 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423402cc80 con 0x7f423c0d3b60 2023-11-04T01:44:53.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.757+0000 7f4239ffb640 1 -- 172.21.15.114:0/1087769848 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423402cde0 con 0x7f423c0d3b60 2023-11-04T01:44:53.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.757+0000 7f4239ffb640 1 -- 172.21.15.114:0/1087769848 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234034660 con 0x7f423c0d3b60 2023-11-04T01:44:53.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.757+0000 7f424161a640 1 -- 172.21.15.114:0/1087769848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f423c0d3b60 msgr2=0x7f423c0d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.757+0000 7f424161a640 1 --2- 172.21.15.114:0/1087769848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f423c0d3b60 0x7f423c0d1a10 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f423c160da0 tx=0x7f423402bed0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.758+0000 7f424161a640 1 -- 172.21.15.114:0/1087769848 shutdown_connections 2023-11-04T01:44:53.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.758+0000 7f424161a640 1 --2- 172.21.15.114:0/1087769848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f423c0d3b60 0x7f423c0d1a10 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.758+0000 7f424161a640 1 --2- 172.21.15.114:0/1087769848 >> v2:172.21.15.141:3300/0 conn(0x7f423c15d4e0 0x7f423c0d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.758+0000 7f424161a640 1 -- 172.21.15.114:0/1087769848 >> 172.21.15.114:0/1087769848 conn(0x7f423c0d2ef0 msgr2=0x7f423c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:53.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.758+0000 7f424161a640 1 -- 172.21.15.114:0/1087769848 shutdown_connections 2023-11-04T01:44:53.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.758+0000 7f424161a640 1 -- 172.21.15.114:0/1087769848 wait complete. 2023-11-04T01:44:53.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.759+0000 7f424161a640 1 Processor -- start 2023-11-04T01:44:53.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.759+0000 7f424161a640 1 -- start start 2023-11-04T01:44:53.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f424161a640 1 --2- >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f423c0d3b60 0x7f423c15b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f424161a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f423c15d100 0x7f423c0b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f424161a640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f423c15d4e0 0x7f423c09daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f424161a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0b5a70 con 0x7f423c15d100 2023-11-04T01:44:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f424161a640 1 -- --> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0b5d50 con 0x7f423c0d3b60 2023-11-04T01:44:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f424161a640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0b6030 con 0x7f423c15d4e0 2023-11-04T01:44:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f423a7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f423c15d100 0x7f423c0b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f423a7fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f423c15d100 0x7f423c0b6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40074/0 (socket says 172.21.15.114:40074) 2023-11-04T01:44:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f423a7fc640 1 -- 172.21.15.114:0/4210939873 learned_addr learned my addr 172.21.15.114:0/4210939873 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-11-04T01:44:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f423b7fe640 1 --2- 172.21.15.114:0/4210939873 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f423c15d4e0 0x7f423c09daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f423affd640 1 --2- 172.21.15.114:0/4210939873 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f423c0d3b60 0x7f423c15b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f423a7fc640 1 -- 172.21.15.114:0/4210939873 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f423c15d4e0 msgr2=0x7f423c09daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f423a7fc640 1 --2- 172.21.15.114:0/4210939873 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f423c15d4e0 0x7f423c09daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f423a7fc640 1 -- 172.21.15.114:0/4210939873 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f423c0d3b60 msgr2=0x7f423c15b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f423a7fc640 1 --2- 172.21.15.114:0/4210939873 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f423c0d3b60 0x7f423c15b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f423a7fc640 1 -- 172.21.15.114:0/4210939873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4234009a70 con 0x7f423c15d100 2023-11-04T01:44:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f423b7fe640 1 --2- 172.21.15.114:0/4210939873 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f423c15d4e0 0x7f423c09daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f423affd640 1 --2- 172.21.15.114:0/4210939873 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f423c0d3b60 0x7f423c15b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f423a7fc640 1 --2- 172.21.15.114:0/4210939873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f423c15d100 0x7f423c0b6df0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f423000b410 tx=0x7f423000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f42237fe640 1 -- 172.21.15.114:0/4210939873 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230011830 con 0x7f423c15d100 2023-11-04T01:44:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f42237fe640 1 -- 172.21.15.114:0/4210939873 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42300119b0 con 0x7f423c15d100 2023-11-04T01:44:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f424161a640 1 -- 172.21.15.114:0/4210939873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c0b6310 con 0x7f423c15d100 2023-11-04T01:44:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f42237fe640 1 -- 172.21.15.114:0/4210939873 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230011d60 con 0x7f423c15d100 2023-11-04T01:44:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.760+0000 7f424161a640 1 -- 172.21.15.114:0/4210939873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423c0b68d0 con 0x7f423c15d100 2023-11-04T01:44:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.761+0000 7f424161a640 1 -- 172.21.15.114:0/4210939873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423c0b6af0 con 0x7f423c15d100 2023-11-04T01:44:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.762+0000 7f42237fe640 1 -- 172.21.15.114:0/4210939873 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f423001a400 con 0x7f423c15d100 2023-11-04T01:44:53.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.762+0000 7f42237fe640 1 --2- 172.21.15.114:0/4210939873 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f422806ae70 0x7f422806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.762+0000 7f423affd640 1 --2- 172.21.15.114:0/4210939873 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f422806ae70 0x7f422806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.762+0000 7f42237fe640 1 -- 172.21.15.114:0/4210939873 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f423008a0f0 con 0x7f423c15d100 2023-11-04T01:44:53.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.763+0000 7f423affd640 1 --2- 172.21.15.114:0/4210939873 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f422806ae70 0x7f422806d330 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f422c007fd0 tx=0x7f422c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:53.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.767+0000 7f42237fe640 1 -- 172.21.15.114:0/4210939873 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4230054820 con 0x7f423c15d100 2023-11-04T01:44:53.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.945+0000 7f424161a640 1 -- 172.21.15.114:0/4210939873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f423c0d0440 con 0x7f423c15d100 2023-11-04T01:44:53.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.945+0000 7f42237fe640 1 -- 172.21.15.114:0/4210939873 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v116) v1 ==== 81+0+1404 (secure 0 0 0) 0x7f4230015020 con 0x7f423c15d100 2023-11-04T01:44:53.947 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/979876939 2023-11-05T01:44:08.794891+0000 2023-11-04T01:44:53.948 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/979876939 2023-11-05T01:44:08.794891+0000 2023-11-04T01:44:53.948 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.1:0/3180677097 2023-11-04T02:43:26.710151+0000 2023-11-04T01:44:53.948 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/3145796350 2023-11-05T01:43:18.419560+0000 2023-11-04T01:44:53.948 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/3825479201 2023-11-05T01:43:11.612005+0000 2023-11-04T01:44:53.949 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/3825479201 2023-11-05T01:43:11.612005+0000 2023-11-04T01:44:53.949 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/3145796350 2023-11-05T01:43:18.419560+0000 2023-11-04T01:44:53.949 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/3780323525 2023-11-05T01:40:32.050690+0000 2023-11-04T01:44:53.949 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.1:0/76750670 2023-11-04T02:44:16.664609+0000 2023-11-04T01:44:53.949 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/3780323525 2023-11-05T01:40:32.050690+0000 2023-11-04T01:44:53.950 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.141:6834/1296600989 2023-11-05T01:42:28.568489+0000 2023-11-04T01:44:53.950 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/1768068040 2023-11-05T01:40:57.284155+0000 2023-11-04T01:44:53.950 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.141:6834/224279622 2023-11-05T01:44:01.557691+0000 2023-11-04T01:44:53.950 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/1768068040 2023-11-05T01:40:57.284155+0000 2023-11-04T01:44:53.951 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.141:6832/1296600989 2023-11-05T01:42:28.568489+0000 2023-11-04T01:44:53.951 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/2722332212 2023-11-05T01:41:22.824334+0000 2023-11-04T01:44:53.951 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/1052115332 2023-11-05T01:41:48.753700+0000 2023-11-04T01:44:53.951 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.1:0/958873281 2023-11-04T02:42:36.859026+0000 2023-11-04T01:44:53.951 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6837/1052115332 2023-11-05T01:41:48.753700+0000 2023-11-04T01:44:53.952 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.141:6832/224279622 2023-11-05T01:44:01.557691+0000 2023-11-04T01:44:53.952 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6836/1629274449 2023-11-05T01:42:21.762099+0000 2023-11-04T01:44:53.952 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/2722332212 2023-11-05T01:41:22.824334+0000 2023-11-04T01:44:53.952 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6834/1629274449 2023-11-05T01:42:21.762099+0000 2023-11-04T01:44:53.954 INFO:teuthology.orchestra.run.smithi114.stderr:listed 23 entries 2023-11-04T01:44:53.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.947+0000 7f424161a640 1 -- 172.21.15.114:0/4210939873 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f422806ae70 msgr2=0x7f422806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.947+0000 7f424161a640 1 --2- 172.21.15.114:0/4210939873 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f422806ae70 0x7f422806d330 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f422c007fd0 tx=0x7f422c009040 comp rx=0 tx=0).stop 2023-11-04T01:44:53.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.947+0000 7f424161a640 1 -- 172.21.15.114:0/4210939873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f423c15d100 msgr2=0x7f423c0b6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.947+0000 7f424161a640 1 --2- 172.21.15.114:0/4210939873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f423c15d100 0x7f423c0b6df0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f423000b410 tx=0x7f423000b8d0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.947+0000 7f424161a640 1 -- 172.21.15.114:0/4210939873 shutdown_connections 2023-11-04T01:44:53.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.947+0000 7f424161a640 1 --2- 172.21.15.114:0/4210939873 >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f423c15d4e0 0x7f423c09daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.947+0000 7f424161a640 1 --2- 172.21.15.114:0/4210939873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f423c15d100 0x7f423c0b6df0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.947+0000 7f424161a640 1 --2- 172.21.15.114:0/4210939873 >> [v2:172.21.15.114:6832/1641722674,v1:172.21.15.114:6833/1641722674] conn(0x7f422806ae70 0x7f422806d330 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.947+0000 7f424161a640 1 --2- 172.21.15.114:0/4210939873 >> [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] conn(0x7f423c0d3b60 0x7f423c15b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.947+0000 7f424161a640 1 -- 172.21.15.114:0/4210939873 >> 172.21.15.114:0/4210939873 conn(0x7f423c0d2ef0 msgr2=0x7f423c0cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:53.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.947+0000 7f424161a640 1 -- 172.21.15.114:0/4210939873 shutdown_connections 2023-11-04T01:44:53.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:53.947+0000 7f424161a640 1 -- 172.21.15.114:0/4210939873 wait complete. 2023-11-04T01:44:53.960 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi114.front.sepia.ceph.com... 2023-11-04T01:44:53.960 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:44:53.960 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:54.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:44:54.018 INFO:teuthology.orchestra.run.smithi114.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.0: Device or resource busy 2023-11-04T01:44:54.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:44:54 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2023-11-04T01:44:54.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:54.024 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi114.front.sepia.ceph.com, aborting... 2023-11-04T01:44:54.024 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:44:54.025 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer --timeout=300 -- env PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-11-04T01:44:55.039 INFO:teuthology.orchestra.run.smithi114.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-11-04T01:44:55.039 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.039 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.040 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-04T01:44:55.040 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 596532 1027 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:44:55.040 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.040 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.040 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.040 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.040 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 21219 1167 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:44:55.040 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.040 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.040 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.040 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.040 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.041 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:55.041 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.041 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:44:55.041 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:55.041 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.041 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.041 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.041 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.041 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.041 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:44:55.041 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:44:55.041 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.041 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.042 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:44:55.042 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-04T01:44:55.042 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.042 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:55.042 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:44:55.042 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.042 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.042 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:44:55.042 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.042 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.042 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.042 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 3w CHR 1,11 0t0 10 /dev/kmsg 2023-11-04T01:44:55.042 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 4u a_inode 0,14 0 13316 [eventpoll:5,6,8,9,11,14,15,16,17,18,19,44,45,49,50,54,71,81,84,85,86,93,107,110,111,112,113,114,118,125,129,133...] 2023-11-04T01:44:55.043 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 5u a_inode 0,14 0 13316 [signalfd] 2023-11-04T01:44:55.043 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 6r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.043 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 7r DIR 0,25 0 1 /sys/fs/cgroup 2023-11-04T01:44:55.043 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 8u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.043 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 9u a_inode 0,14 0 13316 [eventpoll:10,13] 2023-11-04T01:44:55.043 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 10r REG 0,20 0 1371 /proc/1/mountinfo 2023-11-04T01:44:55.043 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 11r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.043 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 12u netlink 0t0 2420 AUDIT 2023-11-04T01:44:55.043 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 13r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.043 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 14r REG 0,20 0 4026532076 /proc/swaps 2023-11-04T01:44:55.043 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 15u netlink 0t0 2412 KOBJECT_UEVENT 2023-11-04T01:44:55.043 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 16u unix 0xffff8d3398446600 0t0 2414 /run/systemd/private type=STREAM (LISTEN) 2023-11-04T01:44:55.043 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 17u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.044 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 18r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.044 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 19r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.044 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 20u a_inode 0,14 0 13316 bpf-prog 2023-11-04T01:44:55.044 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 21u a_inode 0,14 0 13316 bpf-prog 2023-11-04T01:44:55.044 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 22u a_inode 0,14 0 13316 bpf-prog 2023-11-04T01:44:55.044 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 23u a_inode 0,14 0 13316 bpf-prog 2023-11-04T01:44:55.044 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 24u a_inode 0,14 0 13316 bpf-prog 2023-11-04T01:44:55.044 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 25u unix 0xffff8d339840f2c0 0t0 19643 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.044 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 26u a_inode 0,14 0 13316 bpf-prog 2023-11-04T01:44:55.044 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 27r CHR 10,235 0t0 111 /dev/autofs 2023-11-04T01:44:55.044 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 28u a_inode 0,14 0 13316 bpf-prog 2023-11-04T01:44:55.044 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 29u a_inode 0,14 0 13316 bpf-prog 2023-11-04T01:44:55.044 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 30u a_inode 0,14 0 13316 bpf-prog 2023-11-04T01:44:55.045 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 31u a_inode 0,14 0 13316 bpf-prog 2023-11-04T01:44:55.045 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 44u unix 0xffff8d33983872c0 0t0 1379 /run/systemd/io.system.ManagedOOM type=STREAM (LISTEN) 2023-11-04T01:44:55.045 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 45u unix 0xffff8d3398380880 0t0 1378 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM (LISTEN) 2023-11-04T01:44:55.045 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 49u unix 0xffff8d339837bfc0 0t0 1373 /run/systemd/notify type=DGRAM (CONNECTED) 2023-11-04T01:44:55.045 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 50u unix 0xffff8d339837d0c0 0t0 1374 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.045 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 54u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.045 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 59u unix 0xffff8d3387c31980 0t0 16319 type=STREAM (CONNECTED) 2023-11-04T01:44:55.045 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 60u unix 0xffff8d3398379540 0t0 1375 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.045 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 71u unix 0xffff8d3398380000 0t0 1573 /run/lvm/lvmpolld.socket type=STREAM (LISTEN) 2023-11-04T01:44:55.045 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 72u unix 0xffff8d3398387b40 0t0 1575 /run/rpcbind.sock type=STREAM (LISTEN) 2023-11-04T01:44:55.045 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 73u IPv4 16716 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:44:55.045 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 74u IPv4 16722 0t0 UDP *:sunrpc 2023-11-04T01:44:55.045 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 76u IPv6 16728 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:44:55.046 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 77u IPv6 16734 0t0 UDP *:sunrpc 2023-11-04T01:44:55.046 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 79u netlink 0t0 1589 KOBJECT_UEVENT 2023-11-04T01:44:55.046 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 81u unix 0xffff8d339837c400 0t0 1585 /run/systemd/coredump type=SEQPACKET (LISTEN) 2023-11-04T01:44:55.046 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 82u unix 0xffff8d33815d6600 0t0 19786 /run/.heim_org.h5l.kcm-socket type=STREAM (LISTEN) 2023-11-04T01:44:55.046 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 83u unix 0xffff8d339837fb40 0t0 1587 /run/udev/control type=SEQPACKET (LISTEN) 2023-11-04T01:44:55.046 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 84u FIFO 0,24 0t0 441 /run/dmeventd-server 2023-11-04T01:44:55.046 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 85u FIFO 0,24 0t0 442 /run/dmeventd-client 2023-11-04T01:44:55.046 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 86u FIFO 0,24 0t0 447 /run/initctl 2023-11-04T01:44:55.046 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 87u unix 0xffff8d339837ee80 0t0 1388 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-11-04T01:44:55.046 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 88u unix 0xffff8d3398384400 0t0 1390 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-11-04T01:44:55.046 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 92u unix 0xffff8d3398379100 0t0 1386 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-11-04T01:44:55.046 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 93u CHR 10,242 0t0 165 /dev/rfkill 2023-11-04T01:44:55.046 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 107u unix 0xffff8d33815d0000 0t0 166992 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.047 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 108u unix 0xffff8d3387e5a640 0t0 17370 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.047 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 109u unix 0xffff8d3387c36e80 0t0 1874 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.047 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 110u unix 0xffff8d3398053b80 0t0 17026 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.047 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 111u unix 0xffff8d3398442a80 0t0 17025 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.047 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 112u unix 0xffff8d3398381100 0t0 17024 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.047 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 113u unix 0xffff8d3398384840 0t0 18068 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.047 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 114u unix 0xffff8d33831e3740 0t0 18064 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.047 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 118u unix 0xffff8d33831e0cc0 0t0 18063 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.047 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 119u unix 0xffff8d3387e59dc0 0t0 20529 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.047 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 124u unix 0xffff8d33831e2a80 0t0 20528 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.047 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 125u unix 0xffff8d3398050440 0t0 16313 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.047 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 126u unix 0xffff8d3398055d80 0t0 18026 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.048 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 129u unix 0xffff8d33815d3740 0t0 1619 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.048 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 133r FIFO 0,13 0t0 2424 pipe 2023-11-04T01:44:55.048 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 1 root 134u unix 0xffff8d33815d72c0 0t0 19783 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-04T01:44:55.048 INFO:teuthology.orchestra.run.smithi114.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.048 INFO:teuthology.orchestra.run.smithi114.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.048 INFO:teuthology.orchestra.run.smithi114.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-11-04T01:44:55.048 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.048 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.048 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-11-04T01:44:55.048 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.048 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.048 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-11-04T01:44:55.048 INFO:teuthology.orchestra.run.smithi114.stdout:slub_flus 5 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.049 INFO:teuthology.orchestra.run.smithi114.stdout:slub_flus 5 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.049 INFO:teuthology.orchestra.run.smithi114.stdout:slub_flus 5 root txt unknown /proc/5/exe 2023-11-04T01:44:55.049 INFO:teuthology.orchestra.run.smithi114.stdout:netns 6 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.049 INFO:teuthology.orchestra.run.smithi114.stdout:netns 6 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.049 INFO:teuthology.orchestra.run.smithi114.stdout:netns 6 root txt unknown /proc/6/exe 2023-11-04T01:44:55.049 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/0 8 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.049 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/0 8 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.049 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/0 8 root txt unknown /proc/8/exe 2023-11-04T01:44:55.049 INFO:teuthology.orchestra.run.smithi114.stdout:mm_percpu 11 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.049 INFO:teuthology.orchestra.run.smithi114.stdout:mm_percpu 11 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.049 INFO:teuthology.orchestra.run.smithi114.stdout:mm_percpu 11 root txt unknown /proc/11/exe 2023-11-04T01:44:55.049 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 12 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.050 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 12 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.050 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 12 root txt unknown /proc/12/exe 2023-11-04T01:44:55.050 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_tasks 13 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.050 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_tasks 13 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.050 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_tasks 13 root txt unknown /proc/13/exe 2023-11-04T01:44:55.050 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_tasks 14 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.050 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_tasks 14 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.050 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_tasks 14 root txt unknown /proc/14/exe 2023-11-04T01:44:55.050 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_tasks 15 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.050 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_tasks 15 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.050 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_tasks 15 root txt unknown /proc/15/exe 2023-11-04T01:44:55.050 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 16 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.050 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 16 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.050 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 16 root txt unknown /proc/16/exe 2023-11-04T01:44:55.051 INFO:teuthology.orchestra.run.smithi114.stdout:pr/ttyS1 17 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.051 INFO:teuthology.orchestra.run.smithi114.stdout:pr/ttyS1 17 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.051 INFO:teuthology.orchestra.run.smithi114.stdout:pr/ttyS1 17 root txt unknown /proc/17/exe 2023-11-04T01:44:55.051 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_preem 18 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.051 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_preem 18 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.051 INFO:teuthology.orchestra.run.smithi114.stdout:rcu_preem 18 root txt unknown /proc/18/exe 2023-11-04T01:44:55.051 INFO:teuthology.orchestra.run.smithi114.stdout:migration 19 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.051 INFO:teuthology.orchestra.run.smithi114.stdout:migration 19 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.051 INFO:teuthology.orchestra.run.smithi114.stdout:migration 19 root txt unknown /proc/19/exe 2023-11-04T01:44:55.051 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 20 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.051 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 20 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.051 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 20 root txt unknown /proc/20/exe 2023-11-04T01:44:55.051 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/0 21 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.052 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/0 21 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.052 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/0 21 root txt unknown /proc/21/exe 2023-11-04T01:44:55.052 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/1 22 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.052 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/1 22 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.052 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/1 22 root txt unknown /proc/22/exe 2023-11-04T01:44:55.052 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 23 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.052 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 23 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.052 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 23 root txt unknown /proc/23/exe 2023-11-04T01:44:55.052 INFO:teuthology.orchestra.run.smithi114.stdout:migration 24 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.052 INFO:teuthology.orchestra.run.smithi114.stdout:migration 24 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.052 INFO:teuthology.orchestra.run.smithi114.stdout:migration 24 root txt unknown /proc/24/exe 2023-11-04T01:44:55.052 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 25 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.052 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 25 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.052 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 25 root txt unknown /proc/25/exe 2023-11-04T01:44:55.053 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/1 27 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.053 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/1 27 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.053 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/1 27 root txt unknown /proc/27/exe 2023-11-04T01:44:55.053 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/2 28 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.053 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/2 28 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.053 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/2 28 root txt unknown /proc/28/exe 2023-11-04T01:44:55.053 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 29 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.053 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 29 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.053 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 29 root txt unknown /proc/29/exe 2023-11-04T01:44:55.053 INFO:teuthology.orchestra.run.smithi114.stdout:migration 30 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.053 INFO:teuthology.orchestra.run.smithi114.stdout:migration 30 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.053 INFO:teuthology.orchestra.run.smithi114.stdout:migration 30 root txt unknown /proc/30/exe 2023-11-04T01:44:55.053 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 31 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.053 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 31 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.053 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 31 root txt unknown /proc/31/exe 2023-11-04T01:44:55.054 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/2 33 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.054 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/2 33 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.054 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/2 33 root txt unknown /proc/33/exe 2023-11-04T01:44:55.054 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/3 34 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.054 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/3 34 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.054 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/3 34 root txt unknown /proc/34/exe 2023-11-04T01:44:55.054 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 35 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.054 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 35 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.054 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 35 root txt unknown /proc/35/exe 2023-11-04T01:44:55.054 INFO:teuthology.orchestra.run.smithi114.stdout:migration 36 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.054 INFO:teuthology.orchestra.run.smithi114.stdout:migration 36 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.054 INFO:teuthology.orchestra.run.smithi114.stdout:migration 36 root txt unknown /proc/36/exe 2023-11-04T01:44:55.054 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 37 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.055 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 37 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.055 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 37 root txt unknown /proc/37/exe 2023-11-04T01:44:55.055 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/3 39 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.055 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/3 39 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.055 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/3 39 root txt unknown /proc/39/exe 2023-11-04T01:44:55.055 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/4 40 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.055 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/4 40 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.055 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/4 40 root txt unknown /proc/40/exe 2023-11-04T01:44:55.055 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 41 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.055 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 41 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.055 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 41 root txt unknown /proc/41/exe 2023-11-04T01:44:55.055 INFO:teuthology.orchestra.run.smithi114.stdout:migration 42 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.055 INFO:teuthology.orchestra.run.smithi114.stdout:migration 42 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.055 INFO:teuthology.orchestra.run.smithi114.stdout:migration 42 root txt unknown /proc/42/exe 2023-11-04T01:44:55.056 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 43 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.056 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 43 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.056 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 43 root txt unknown /proc/43/exe 2023-11-04T01:44:55.056 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/4 45 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.056 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/4 45 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.056 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/4 45 root txt unknown /proc/45/exe 2023-11-04T01:44:55.056 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/5 46 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.056 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/5 46 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.056 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/5 46 root txt unknown /proc/46/exe 2023-11-04T01:44:55.056 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 47 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.056 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 47 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.056 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 47 root txt unknown /proc/47/exe 2023-11-04T01:44:55.056 INFO:teuthology.orchestra.run.smithi114.stdout:migration 48 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.057 INFO:teuthology.orchestra.run.smithi114.stdout:migration 48 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.057 INFO:teuthology.orchestra.run.smithi114.stdout:migration 48 root txt unknown /proc/48/exe 2023-11-04T01:44:55.057 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 49 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.057 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 49 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.057 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 49 root txt unknown /proc/49/exe 2023-11-04T01:44:55.057 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/5 51 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.057 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/5 51 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.057 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/5 51 root txt unknown /proc/51/exe 2023-11-04T01:44:55.057 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/6 52 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.057 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/6 52 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.057 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/6 52 root txt unknown /proc/52/exe 2023-11-04T01:44:55.057 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 53 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.057 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 53 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.057 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 53 root txt unknown /proc/53/exe 2023-11-04T01:44:55.058 INFO:teuthology.orchestra.run.smithi114.stdout:migration 54 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.058 INFO:teuthology.orchestra.run.smithi114.stdout:migration 54 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.058 INFO:teuthology.orchestra.run.smithi114.stdout:migration 54 root txt unknown /proc/54/exe 2023-11-04T01:44:55.058 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 55 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.058 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 55 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.058 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 55 root txt unknown /proc/55/exe 2023-11-04T01:44:55.058 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/6 57 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.058 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/6 57 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.058 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/6 57 root txt unknown /proc/57/exe 2023-11-04T01:44:55.058 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/7 58 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.058 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/7 58 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.058 INFO:teuthology.orchestra.run.smithi114.stdout:cpuhp/7 58 root txt unknown /proc/58/exe 2023-11-04T01:44:55.058 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 59 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.059 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 59 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.059 INFO:teuthology.orchestra.run.smithi114.stdout:idle_inje 59 root txt unknown /proc/59/exe 2023-11-04T01:44:55.059 INFO:teuthology.orchestra.run.smithi114.stdout:migration 60 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.059 INFO:teuthology.orchestra.run.smithi114.stdout:migration 60 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.059 INFO:teuthology.orchestra.run.smithi114.stdout:migration 60 root txt unknown /proc/60/exe 2023-11-04T01:44:55.059 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 61 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.059 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 61 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.059 INFO:teuthology.orchestra.run.smithi114.stdout:ksoftirqd 61 root txt unknown /proc/61/exe 2023-11-04T01:44:55.059 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 63 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.059 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 63 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.059 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 63 root txt unknown /proc/63/exe 2023-11-04T01:44:55.059 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 70 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.059 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 70 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.060 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 70 root txt unknown /proc/70/exe 2023-11-04T01:44:55.060 INFO:teuthology.orchestra.run.smithi114.stdout:kdevtmpfs 71 root cwd DIR 0,5 3500 1 / 2023-11-04T01:44:55.060 INFO:teuthology.orchestra.run.smithi114.stdout:kdevtmpfs 71 root rtd DIR 0,5 3500 1 / 2023-11-04T01:44:55.060 INFO:teuthology.orchestra.run.smithi114.stdout:kdevtmpfs 71 root txt unknown /proc/71/exe 2023-11-04T01:44:55.060 INFO:teuthology.orchestra.run.smithi114.stdout:inet_frag 72 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.060 INFO:teuthology.orchestra.run.smithi114.stdout:inet_frag 72 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.060 INFO:teuthology.orchestra.run.smithi114.stdout:inet_frag 72 root txt unknown /proc/72/exe 2023-11-04T01:44:55.060 INFO:teuthology.orchestra.run.smithi114.stdout:kauditd 73 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.060 INFO:teuthology.orchestra.run.smithi114.stdout:kauditd 73 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.060 INFO:teuthology.orchestra.run.smithi114.stdout:kauditd 73 root txt unknown /proc/73/exe 2023-11-04T01:44:55.060 INFO:teuthology.orchestra.run.smithi114.stdout:khungtask 75 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.060 INFO:teuthology.orchestra.run.smithi114.stdout:khungtask 75 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.060 INFO:teuthology.orchestra.run.smithi114.stdout:khungtask 75 root txt unknown /proc/75/exe 2023-11-04T01:44:55.061 INFO:teuthology.orchestra.run.smithi114.stdout:oom_reape 76 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.061 INFO:teuthology.orchestra.run.smithi114.stdout:oom_reape 76 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.061 INFO:teuthology.orchestra.run.smithi114.stdout:oom_reape 76 root txt unknown /proc/76/exe 2023-11-04T01:44:55.061 INFO:teuthology.orchestra.run.smithi114.stdout:writeback 77 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.061 INFO:teuthology.orchestra.run.smithi114.stdout:writeback 77 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.061 INFO:teuthology.orchestra.run.smithi114.stdout:writeback 77 root txt unknown /proc/77/exe 2023-11-04T01:44:55.061 INFO:teuthology.orchestra.run.smithi114.stdout:kcompactd 78 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.061 INFO:teuthology.orchestra.run.smithi114.stdout:kcompactd 78 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.061 INFO:teuthology.orchestra.run.smithi114.stdout:kcompactd 78 root txt unknown /proc/78/exe 2023-11-04T01:44:55.061 INFO:teuthology.orchestra.run.smithi114.stdout:ksmd 79 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.061 INFO:teuthology.orchestra.run.smithi114.stdout:ksmd 79 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.061 INFO:teuthology.orchestra.run.smithi114.stdout:ksmd 79 root txt unknown /proc/79/exe 2023-11-04T01:44:55.061 INFO:teuthology.orchestra.run.smithi114.stdout:khugepage 80 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.061 INFO:teuthology.orchestra.run.smithi114.stdout:khugepage 80 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.061 INFO:teuthology.orchestra.run.smithi114.stdout:khugepage 80 root txt unknown /proc/80/exe 2023-11-04T01:44:55.062 INFO:teuthology.orchestra.run.smithi114.stdout:cryptd 81 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.062 INFO:teuthology.orchestra.run.smithi114.stdout:cryptd 81 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.062 INFO:teuthology.orchestra.run.smithi114.stdout:cryptd 81 root txt unknown /proc/81/exe 2023-11-04T01:44:55.062 INFO:teuthology.orchestra.run.smithi114.stdout:kintegrit 82 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.062 INFO:teuthology.orchestra.run.smithi114.stdout:kintegrit 82 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.062 INFO:teuthology.orchestra.run.smithi114.stdout:kintegrit 82 root txt unknown /proc/82/exe 2023-11-04T01:44:55.062 INFO:teuthology.orchestra.run.smithi114.stdout:kblockd 83 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.062 INFO:teuthology.orchestra.run.smithi114.stdout:kblockd 83 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.062 INFO:teuthology.orchestra.run.smithi114.stdout:kblockd 83 root txt unknown /proc/83/exe 2023-11-04T01:44:55.062 INFO:teuthology.orchestra.run.smithi114.stdout:blkcg_pun 84 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.062 INFO:teuthology.orchestra.run.smithi114.stdout:blkcg_pun 84 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.063 INFO:teuthology.orchestra.run.smithi114.stdout:blkcg_pun 84 root txt unknown /proc/84/exe 2023-11-04T01:44:55.063 INFO:teuthology.orchestra.run.smithi114.stdout:tpm_dev_w 87 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.063 INFO:teuthology.orchestra.run.smithi114.stdout:tpm_dev_w 87 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.063 INFO:teuthology.orchestra.run.smithi114.stdout:tpm_dev_w 87 root txt unknown /proc/87/exe 2023-11-04T01:44:55.063 INFO:teuthology.orchestra.run.smithi114.stdout:md 88 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.063 INFO:teuthology.orchestra.run.smithi114.stdout:md 88 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.063 INFO:teuthology.orchestra.run.smithi114.stdout:md 88 root txt unknown /proc/88/exe 2023-11-04T01:44:55.063 INFO:teuthology.orchestra.run.smithi114.stdout:md_bitmap 89 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.063 INFO:teuthology.orchestra.run.smithi114.stdout:md_bitmap 89 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.063 INFO:teuthology.orchestra.run.smithi114.stdout:md_bitmap 89 root txt unknown /proc/89/exe 2023-11-04T01:44:55.063 INFO:teuthology.orchestra.run.smithi114.stdout:edac-poll 90 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.063 INFO:teuthology.orchestra.run.smithi114.stdout:edac-poll 90 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.063 INFO:teuthology.orchestra.run.smithi114.stdout:edac-poll 90 root txt unknown /proc/90/exe 2023-11-04T01:44:55.063 INFO:teuthology.orchestra.run.smithi114.stdout:watchdogd 91 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.064 INFO:teuthology.orchestra.run.smithi114.stdout:watchdogd 91 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.064 INFO:teuthology.orchestra.run.smithi114.stdout:watchdogd 91 root txt unknown /proc/91/exe 2023-11-04T01:44:55.064 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 93 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.064 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 93 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.064 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 93 root txt unknown /proc/93/exe 2023-11-04T01:44:55.064 INFO:teuthology.orchestra.run.smithi114.stdout:kswapd0 95 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.064 INFO:teuthology.orchestra.run.smithi114.stdout:kswapd0 95 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.064 INFO:teuthology.orchestra.run.smithi114.stdout:kswapd0 95 root txt unknown /proc/95/exe 2023-11-04T01:44:55.064 INFO:teuthology.orchestra.run.smithi114.stdout:kthrotld 101 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.064 INFO:teuthology.orchestra.run.smithi114.stdout:kthrotld 101 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.064 INFO:teuthology.orchestra.run.smithi114.stdout:kthrotld 101 root txt unknown /proc/101/exe 2023-11-04T01:44:55.064 INFO:teuthology.orchestra.run.smithi114.stdout:acpi_ther 108 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.064 INFO:teuthology.orchestra.run.smithi114.stdout:acpi_ther 108 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.065 INFO:teuthology.orchestra.run.smithi114.stdout:acpi_ther 108 root txt unknown /proc/108/exe 2023-11-04T01:44:55.065 INFO:teuthology.orchestra.run.smithi114.stdout:kmpath_rd 109 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.065 INFO:teuthology.orchestra.run.smithi114.stdout:kmpath_rd 109 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.065 INFO:teuthology.orchestra.run.smithi114.stdout:kmpath_rd 109 root txt unknown /proc/109/exe 2023-11-04T01:44:55.065 INFO:teuthology.orchestra.run.smithi114.stdout:kaluad 110 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.065 INFO:teuthology.orchestra.run.smithi114.stdout:kaluad 110 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.065 INFO:teuthology.orchestra.run.smithi114.stdout:kaluad 110 root txt unknown /proc/110/exe 2023-11-04T01:44:55.065 INFO:teuthology.orchestra.run.smithi114.stdout:mld 111 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.065 INFO:teuthology.orchestra.run.smithi114.stdout:mld 111 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.065 INFO:teuthology.orchestra.run.smithi114.stdout:mld 111 root txt unknown /proc/111/exe 2023-11-04T01:44:55.065 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/2 112 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.065 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/2 112 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.065 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/2 112 root txt unknown /proc/112/exe 2023-11-04T01:44:55.065 INFO:teuthology.orchestra.run.smithi114.stdout:ipv6_addr 113 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.066 INFO:teuthology.orchestra.run.smithi114.stdout:ipv6_addr 113 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.066 INFO:teuthology.orchestra.run.smithi114.stdout:ipv6_addr 113 root txt unknown /proc/113/exe 2023-11-04T01:44:55.066 INFO:teuthology.orchestra.run.smithi114.stdout:kstrp 122 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.066 INFO:teuthology.orchestra.run.smithi114.stdout:kstrp 122 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.066 INFO:teuthology.orchestra.run.smithi114.stdout:kstrp 122 root txt unknown /proc/122/exe 2023-11-04T01:44:55.066 INFO:teuthology.orchestra.run.smithi114.stdout:zswap-shr 128 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.066 INFO:teuthology.orchestra.run.smithi114.stdout:zswap-shr 128 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.066 INFO:teuthology.orchestra.run.smithi114.stdout:zswap-shr 128 root txt unknown /proc/128/exe 2023-11-04T01:44:55.066 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 238 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.066 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 238 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.066 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 238 root txt unknown /proc/238/exe 2023-11-04T01:44:55.066 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/1 277 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.066 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/1 277 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.067 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/1 277 root txt unknown /proc/277/exe 2023-11-04T01:44:55.067 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/0 289 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.067 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/0 289 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.067 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/0 289 root txt unknown /proc/289/exe 2023-11-04T01:44:55.067 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/3 290 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.067 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/3 290 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.067 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/3 290 root txt unknown /proc/290/exe 2023-11-04T01:44:55.067 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/6 357 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.067 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/6 357 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.067 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/6 357 root txt unknown /proc/357/exe 2023-11-04T01:44:55.067 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/5 398 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.067 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/5 398 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.067 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/5 398 root txt unknown /proc/398/exe 2023-11-04T01:44:55.067 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/4 399 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.068 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/4 399 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.068 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/4 399 root txt unknown /proc/399/exe 2023-11-04T01:44:55.068 INFO:teuthology.orchestra.run.smithi114.stdout:ata_sff 428 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.068 INFO:teuthology.orchestra.run.smithi114.stdout:ata_sff 428 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.068 INFO:teuthology.orchestra.run.smithi114.stdout:ata_sff 428 root txt unknown /proc/428/exe 2023-11-04T01:44:55.068 INFO:teuthology.orchestra.run.smithi114.stdout:nvme-wq 431 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.068 INFO:teuthology.orchestra.run.smithi114.stdout:nvme-wq 431 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.068 INFO:teuthology.orchestra.run.smithi114.stdout:nvme-wq 431 root txt unknown /proc/431/exe 2023-11-04T01:44:55.068 INFO:teuthology.orchestra.run.smithi114.stdout:nvme-rese 434 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.068 INFO:teuthology.orchestra.run.smithi114.stdout:nvme-rese 434 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.068 INFO:teuthology.orchestra.run.smithi114.stdout:nvme-rese 434 root txt unknown /proc/434/exe 2023-11-04T01:44:55.068 INFO:teuthology.orchestra.run.smithi114.stdout:nvme-dele 435 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.068 INFO:teuthology.orchestra.run.smithi114.stdout:nvme-dele 435 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.068 INFO:teuthology.orchestra.run.smithi114.stdout:nvme-dele 435 root txt unknown /proc/435/exe 2023-11-04T01:44:55.068 INFO:teuthology.orchestra.run.smithi114.stdout:nvme-auth 436 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.069 INFO:teuthology.orchestra.run.smithi114.stdout:nvme-auth 436 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.069 INFO:teuthology.orchestra.run.smithi114.stdout:nvme-auth 436 root txt unknown /proc/436/exe 2023-11-04T01:44:55.069 INFO:teuthology.orchestra.run.smithi114.stdout:ixgbe 443 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.069 INFO:teuthology.orchestra.run.smithi114.stdout:ixgbe 443 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.069 INFO:teuthology.orchestra.run.smithi114.stdout:ixgbe 443 root txt unknown /proc/443/exe 2023-11-04T01:44:55.069 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_0 448 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.069 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_0 448 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.069 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_0 448 root txt unknown /proc/448/exe 2023-11-04T01:44:55.069 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 449 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.069 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 449 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.069 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 449 root txt unknown /proc/449/exe 2023-11-04T01:44:55.069 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_1 450 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.070 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_1 450 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.070 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_1 450 root txt unknown /proc/450/exe 2023-11-04T01:44:55.070 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 451 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.070 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 451 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.070 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 451 root txt unknown /proc/451/exe 2023-11-04T01:44:55.070 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_2 452 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.070 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_2 452 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.070 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_2 452 root txt unknown /proc/452/exe 2023-11-04T01:44:55.070 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 453 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.070 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 453 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.070 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 453 root txt unknown /proc/453/exe 2023-11-04T01:44:55.070 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_3 454 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.070 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_3 454 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.070 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_3 454 root txt unknown /proc/454/exe 2023-11-04T01:44:55.070 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 455 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.071 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 455 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.071 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 455 root txt unknown /proc/455/exe 2023-11-04T01:44:55.071 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_4 456 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.071 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_4 456 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.071 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_4 456 root txt unknown /proc/456/exe 2023-11-04T01:44:55.071 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 457 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.071 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 457 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.071 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 457 root txt unknown /proc/457/exe 2023-11-04T01:44:55.071 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_5 458 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.071 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_5 458 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.071 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_5 458 root txt unknown /proc/458/exe 2023-11-04T01:44:55.071 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 459 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.071 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 459 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 459 root txt unknown /proc/459/exe 2023-11-04T01:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_6 460 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_6 460 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_6 460 root txt unknown /proc/460/exe 2023-11-04T01:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 461 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 461 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 461 root txt unknown /proc/461/exe 2023-11-04T01:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_7 462 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_7 462 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_7 462 root txt unknown /proc/462/exe 2023-11-04T01:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 463 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 463 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 463 root txt unknown /proc/463/exe 2023-11-04T01:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_8 464 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.072 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_8 464 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.073 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_8 464 root txt unknown /proc/464/exe 2023-11-04T01:44:55.073 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 465 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.073 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 465 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.073 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 465 root txt unknown /proc/465/exe 2023-11-04T01:44:55.073 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_9 466 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.073 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_9 466 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.073 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_eh_9 466 root txt unknown /proc/466/exe 2023-11-04T01:44:55.073 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 467 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.073 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 467 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.073 INFO:teuthology.orchestra.run.smithi114.stdout:scsi_tmf_ 467 root txt unknown /proc/467/exe 2023-11-04T01:44:55.073 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 468 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.073 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 468 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.073 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 468 root txt unknown /proc/468/exe 2023-11-04T01:44:55.073 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 469 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.073 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 469 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.074 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 469 root txt unknown /proc/469/exe 2023-11-04T01:44:55.074 INFO:teuthology.orchestra.run.smithi114.stdout:jbd2/sda1 491 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.074 INFO:teuthology.orchestra.run.smithi114.stdout:jbd2/sda1 491 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.074 INFO:teuthology.orchestra.run.smithi114.stdout:jbd2/sda1 491 root txt unknown /proc/491/exe 2023-11-04T01:44:55.074 INFO:teuthology.orchestra.run.smithi114.stdout:ext4-rsv- 492 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.074 INFO:teuthology.orchestra.run.smithi114.stdout:ext4-rsv- 492 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.074 INFO:teuthology.orchestra.run.smithi114.stdout:ext4-rsv- 492 root txt unknown /proc/492/exe 2023-11-04T01:44:55.074 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.074 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.074 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root txt REG 8,1 185496 20360 /usr/lib/systemd/systemd-journald 2023-11-04T01:44:55.074 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:44:55.074 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.074 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.074 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.075 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.075 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.075 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.075 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:55.075 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.075 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.075 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.075 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.075 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:55.075 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.075 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:44:55.075 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:44:55.075 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:55.075 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.076 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.076 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:44:55.076 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.076 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:44:55.076 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.076 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.076 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.076 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:44:55.076 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.076 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.076 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.076 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root mem REG 0,24 8 55 /run/systemd/journal/kernel-seqnum 2023-11-04T01:44:55.076 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.077 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.077 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.077 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 3u unix 0xffff8d339837ee80 0t0 1388 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-11-04T01:44:55.077 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 4u unix 0xffff8d3398384400 0t0 1390 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-11-04T01:44:55.077 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 5u unix 0xffff8d3398379100 0t0 1386 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-11-04T01:44:55.077 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 6w CHR 1,11 0t0 10 /dev/kmsg 2023-11-04T01:44:55.077 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 7u a_inode 0,14 0 13316 [eventpoll:3,4,5,8,9,10,11,12,13,15,17,18,19,20,21,23,24,25,27,28,29,30,32,33] 2023-11-04T01:44:55.077 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 8u CHR 1,11 0t0 10 /dev/kmsg 2023-11-04T01:44:55.077 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 9u unix 0xffff8d3398055500 0t0 18597 /run/systemd/journal/io.systemd.journal type=STREAM (LISTEN) 2023-11-04T01:44:55.077 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 10r REG 0,20 0 17559 /proc/sys/kernel/hostname 2023-11-04T01:44:55.077 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 11u a_inode 0,14 0 13316 [signalfd] 2023-11-04T01:44:55.077 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 12u a_inode 0,14 0 13316 [signalfd] 2023-11-04T01:44:55.077 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 13u a_inode 0,14 0 13316 [signalfd] 2023-11-04T01:44:55.077 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 14u unix 0xffff8d338319bfc0 0t0 18598 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.077 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 15u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.078 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 16u REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:44:55.078 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 17u unix 0xffff8d33815d3740 0t0 1619 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.078 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 18u unix 0xffff8d3398050440 0t0 16313 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.078 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 19u unix 0xffff8d3398055d80 0t0 18026 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.078 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 20u unix 0xffff8d33831e2a80 0t0 20528 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.078 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 21u unix 0xffff8d33815d0000 0t0 166992 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.078 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 23u unix 0xffff8d3387e59dc0 0t0 20529 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.078 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 24u unix 0xffff8d33831e0cc0 0t0 18063 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.078 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 25u unix 0xffff8d33831e3740 0t0 18064 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.078 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 27u unix 0xffff8d3398381100 0t0 17024 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.078 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 28u unix 0xffff8d3398384840 0t0 18068 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.078 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 29u unix 0xffff8d3398442a80 0t0 17025 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.079 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 30u unix 0xffff8d3398053b80 0t0 17026 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.079 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 32u unix 0xffff8d3387c36e80 0t0 1874 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.079 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-j 567 root 33u unix 0xffff8d3387e5a640 0t0 17370 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:44:55.079 INFO:teuthology.orchestra.run.smithi114.stdout:ext4lazyi 573 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.079 INFO:teuthology.orchestra.run.smithi114.stdout:ext4lazyi 573 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.082 INFO:teuthology.orchestra.run.smithi114.stdout:ext4lazyi 573 root txt unknown /proc/573/exe 2023-11-04T01:44:55.082 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.082 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.082 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root txt REG 8,1 597744 11595 /usr/bin/udevadm 2023-11-04T01:44:55.082 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2023-11-04T01:44:55.082 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 596532 1027 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:44:55.082 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 21219 1167 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:44:55.082 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 566315 265239 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.symbols.bin 2023-11-04T01:44:55.082 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 821166 265236 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.alias.bin 2023-11-04T01:44:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 383471 265245 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.dep.bin 2023-11-04T01:44:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.084 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:55.084 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.084 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:44:55.084 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:44:55.084 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:55.084 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.084 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.084 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.084 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:44:55.084 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.084 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.084 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:44:55.084 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.084 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.085 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:44:55.085 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 11812 265240 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.builtin.bin 2023-11-04T01:44:55.085 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.085 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:44:55.085 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.085 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root 1u unix 0xffff8d33815d7700 0t0 19678 type=STREAM (CONNECTED) 2023-11-04T01:44:55.085 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root 2u unix 0xffff8d33815d7700 0t0 19678 type=STREAM (CONNECTED) 2023-11-04T01:44:55.085 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root 3u netlink 0t0 1589 KOBJECT_UEVENT 2023-11-04T01:44:55.085 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root 4u unix 0xffff8d339837fb40 0t0 1587 /run/udev/control type=SEQPACKET (LISTEN) 2023-11-04T01:44:55.085 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root 5u unix 0xffff8d339840e1c0 0t0 19690 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.085 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root 6u unix 0xffff8d339840aec0 0t0 19694 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.085 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root 7u unix 0xffff8d339840bb80 0t0 19695 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.085 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root 8r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.085 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root 9u a_inode 0,14 0 13316 [eventpoll:3,4,6,8,10,11,14] 2023-11-04T01:44:55.086 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root 10u a_inode 0,14 0 13316 [signalfd] 2023-11-04T01:44:55.086 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root 11u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.086 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root 12r REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2023-11-04T01:44:55.086 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-u 582 root 14u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.086 INFO:teuthology.orchestra.run.smithi114.stdout:ipmi-msgh 631 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.086 INFO:teuthology.orchestra.run.smithi114.stdout:ipmi-msgh 631 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.086 INFO:teuthology.orchestra.run.smithi114.stdout:ipmi-msgh 631 root txt unknown /proc/631/exe 2023-11-04T01:44:55.086 INFO:teuthology.orchestra.run.smithi114.stdout:kipmi0 648 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.086 INFO:teuthology.orchestra.run.smithi114.stdout:kipmi0 648 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.086 INFO:teuthology.orchestra.run.smithi114.stdout:kipmi0 648 root txt unknown /proc/648/exe 2023-11-04T01:44:55.086 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.086 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.086 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc txt REG 8,1 61200 14999 /usr/bin/rpcbind 2023-11-04T01:44:55.086 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.086 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.087 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.087 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.087 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.087 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.087 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.087 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.087 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.087 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.087 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.087 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.087 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.087 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.087 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.087 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.088 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.088 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.088 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.088 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.088 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-04T01:44:55.088 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.088 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.088 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc 1u unix 0xffff8d33980561c0 0t0 18717 type=STREAM (CONNECTED) 2023-11-04T01:44:55.088 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc 2u unix 0xffff8d33980561c0 0t0 18717 type=STREAM (CONNECTED) 2023-11-04T01:44:55.088 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc 3u unix 0xffff8d3398387b40 0t0 1575 /run/rpcbind.sock type=STREAM (LISTEN) 2023-11-04T01:44:55.088 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc 4u IPv4 16716 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:44:55.088 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc 5u IPv4 16722 0t0 UDP *:sunrpc 2023-11-04T01:44:55.089 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc 6u IPv6 16728 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:44:55.089 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc 7u IPv6 16734 0t0 UDP *:sunrpc 2023-11-04T01:44:55.089 INFO:teuthology.orchestra.run.smithi114.stdout:rpcbind 652 rpc 8rW REG 0,24 0 1035 /run/rpcbind/rpcbind.lock 2023-11-04T01:44:55.089 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.089 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.089 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-04T01:44:55.089 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.089 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.089 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.089 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.089 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.089 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.089 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.089 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.089 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.090 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.090 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.090 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.090 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.090 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-04T01:44:55.090 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.090 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.090 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.090 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.090 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.090 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root 3u netlink 0t0 1708 AUDIT 2023-11-04T01:44:55.090 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root 4w REG 8,1 8027371 64150 /var/log/audit/audit.log 2023-11-04T01:44:55.091 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root 6u unix 0xffff8d3398161dc0 0t0 18029 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.091 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root 7u unix 0xffff8d339819b300 0t0 18028 type=STREAM (CONNECTED) 2023-11-04T01:44:55.091 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root 8u unix 0xffff8d339819d500 0t0 18030 type=STREAM (CONNECTED) 2023-11-04T01:44:55.091 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root 9u unix 0xffff8d339819ea40 0t0 18031 type=STREAM (CONNECTED) 2023-11-04T01:44:55.091 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 root 10u a_inode 0,14 0 13316 [eventfd:0] 2023-11-04T01:44:55.091 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.091 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.091 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-04T01:44:55.091 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.091 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.091 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.091 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.091 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.091 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.092 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.092 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.092 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.092 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.092 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.092 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.092 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.092 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-04T01:44:55.092 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.092 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.092 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.092 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.092 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.092 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root 3u netlink 0t0 1708 AUDIT 2023-11-04T01:44:55.093 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root 4w REG 8,1 8027371 64150 /var/log/audit/audit.log 2023-11-04T01:44:55.093 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root 6u unix 0xffff8d3398161dc0 0t0 18029 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.093 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root 7u unix 0xffff8d339819b300 0t0 18028 type=STREAM (CONNECTED) 2023-11-04T01:44:55.093 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root 8u unix 0xffff8d339819d500 0t0 18030 type=STREAM (CONNECTED) 2023-11-04T01:44:55.093 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root 9u unix 0xffff8d339819ea40 0t0 18031 type=STREAM (CONNECTED) 2023-11-04T01:44:55.093 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 659 auditd root 10u a_inode 0,14 0 13316 [eventfd:0] 2023-11-04T01:44:55.093 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.093 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.093 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-04T01:44:55.093 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.093 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.093 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.093 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.093 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.094 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.094 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.094 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.094 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.094 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.094 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.094 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.094 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.094 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-04T01:44:55.094 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.094 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.094 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.094 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.094 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.095 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root 3u netlink 0t0 1708 AUDIT 2023-11-04T01:44:55.095 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root 4w REG 8,1 8027371 64150 /var/log/audit/audit.log 2023-11-04T01:44:55.095 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root 6u unix 0xffff8d3398161dc0 0t0 18029 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.095 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root 7u unix 0xffff8d339819b300 0t0 18028 type=STREAM (CONNECTED) 2023-11-04T01:44:55.095 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root 8u unix 0xffff8d339819d500 0t0 18030 type=STREAM (CONNECTED) 2023-11-04T01:44:55.095 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root 9u unix 0xffff8d339819ea40 0t0 18031 type=STREAM (CONNECTED) 2023-11-04T01:44:55.095 INFO:teuthology.orchestra.run.smithi114.stdout:auditd 658 661 auditd root 10u a_inode 0,14 0 13316 [eventfd:0] 2023-11-04T01:44:55.095 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.095 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.095 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root txt REG 8,1 19624 11914 /usr/sbin/sedispatch 2023-11-04T01:44:55.095 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.095 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.095 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.095 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.095 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.096 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.096 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.096 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.096 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.096 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.096 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.096 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.096 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-04T01:44:55.096 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:44:55.096 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.096 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.096 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root 0u unix 0xffff8d339819fb40 0t0 18027 type=STREAM (CONNECTED) 2023-11-04T01:44:55.096 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.096 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.097 INFO:teuthology.orchestra.run.smithi114.stdout:sedispatc 660 root 3u unix 0xffff8d3398385940 0t0 24026 type=STREAM (CONNECTED) 2023-11-04T01:44:55.097 INFO:teuthology.orchestra.run.smithi114.stdout:rpciod 674 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.097 INFO:teuthology.orchestra.run.smithi114.stdout:rpciod 674 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.097 INFO:teuthology.orchestra.run.smithi114.stdout:rpciod 674 root txt unknown /proc/674/exe 2023-11-04T01:44:55.097 INFO:teuthology.orchestra.run.smithi114.stdout:xprtiod 675 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.097 INFO:teuthology.orchestra.run.smithi114.stdout:xprtiod 675 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.097 INFO:teuthology.orchestra.run.smithi114.stdout:xprtiod 675 root txt unknown /proc/675/exe 2023-11-04T01:44:55.097 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.097 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.097 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus txt REG 8,1 131896 11213 /usr/bin/dbus-broker-launch 2023-11-04T01:44:55.097 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus DEL REG 0,1 2 /memfd:dbus-broker-log 2023-11-04T01:44:55.097 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.097 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.097 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.098 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.098 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.098 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.098 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.098 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.098 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.098 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.098 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.098 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.098 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.098 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.098 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.099 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.099 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.099 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus 1u unix 0xffff8d3398053fc0 0t0 20517 type=STREAM (CONNECTED) 2023-11-04T01:44:55.099 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus 2u unix 0xffff8d3398053fc0 0t0 20517 type=STREAM (CONNECTED) 2023-11-04T01:44:55.099 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus 3u unix 0xffff8d33815d72c0 0t0 19783 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-04T01:44:55.099 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus 4u unix 0xffff8d3383199540 0t0 20527 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.099 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus 5u a_inode 0,14 0 13316 [eventpoll:6,7,8,9,10,11] 2023-11-04T01:44:55.099 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus 6u a_inode 0,14 0 13316 [signalfd] 2023-11-04T01:44:55.099 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus 7r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.099 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus 8u unix 0xffff8d3398383fc0 0t0 1725 type=STREAM (CONNECTED) 2023-11-04T01:44:55.099 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus 9u unix 0xffff8d33815d5d80 0t0 19795 type=STREAM (CONNECTED) 2023-11-04T01:44:55.099 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus 10u a_inode 0,14 0 13316 [pidfd:703] 2023-11-04T01:44:55.099 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus 11u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.100 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 702 dbus 12u REG 0,1 2097152 2 /memfd:dbus-broker-log (deleted) 2023-11-04T01:44:55.100 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.100 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.100 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus txt REG 8,1 236336 11212 /usr/bin/dbus-broker 2023-11-04T01:44:55.100 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.100 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.100 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.100 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.100 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.100 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.100 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.100 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.100 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:44:55.100 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.101 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 1u unix 0xffff8d3398053fc0 0t0 20517 type=STREAM (CONNECTED) 2023-11-04T01:44:55.101 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 2u unix 0xffff8d3398053fc0 0t0 20517 type=STREAM (CONNECTED) 2023-11-04T01:44:55.101 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 3u sock 0,8 0t0 21946 protocol: NETLINK 2023-11-04T01:44:55.101 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 4u unix 0xffff8d3383199540 0t0 20527 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.101 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 5u a_inode 0,14 0 13316 [eventpoll:6,7,8,9,10,11,12,13,15,17,18,19] 2023-11-04T01:44:55.101 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 6u a_inode 0,14 0 13316 [signalfd] 2023-11-04T01:44:55.101 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 7u unix 0xffff8d33815d72c0 0t0 19783 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-04T01:44:55.101 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 8u unix 0xffff8d3387c33fc0 0t0 21947 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:55.101 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 9u unix 0xffff8d3398381980 0t0 1726 type=STREAM (CONNECTED) 2023-11-04T01:44:55.101 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 10u unix 0xffff8d33815d61c0 0t0 21949 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:55.101 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 11u unix 0xffff8d3398381dc0 0t0 21955 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:55.101 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 12u unix 0xffff8d33831e6a40 0t0 20530 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:55.101 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 13u unix 0xffff8d33815d3fc0 0t0 20532 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:55.101 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 15u unix 0xffff8d3387e5dd80 0t0 21981 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:55.102 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 17u unix 0xffff8d3398384c80 0t0 22905 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:55.102 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 18u unix 0xffff8d33815d6a40 0t0 17044 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:55.102 INFO:teuthology.orchestra.run.smithi114.stdout:dbus-brok 703 dbus 19u unix 0xffff8d33815d5940 0t0 20809 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:44:55.102 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.102 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.102 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager (deleted) 2023-11-04T01:44:55.102 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root DEL REG 8,1 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-04T01:44:55.102 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:44:55.102 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-04T01:44:55.102 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-04T01:44:55.102 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:55.102 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root DEL REG 8,1 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-04T01:44:55.102 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.102 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:55.103 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:55.103 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.103 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.103 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.103 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.103 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.103 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.103 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.103 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.103 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.103 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.103 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.103 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.103 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.104 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.104 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.104 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.104 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.104 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.104 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.104 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.104 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.104 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.104 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.104 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.104 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.104 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.104 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.105 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.105 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.105 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.105 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-04T01:44:55.105 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.105 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.105 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.105 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.105 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.105 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.105 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-04T01:44:55.105 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.105 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:55.105 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.106 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.106 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.106 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.106 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.106 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.106 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-04T01:44:55.106 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:55.106 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.106 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.106 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-04T01:44:55.106 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.106 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.106 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:55.107 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:55.107 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:55.107 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:55.107 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:55.107 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:55.107 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.107 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:55.107 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.107 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 1u unix 0xffff8d33831e1dc0 0t0 16901 type=STREAM (CONNECTED) 2023-11-04T01:44:55.107 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 2u unix 0xffff8d33831e1dc0 0t0 16901 type=STREAM (CONNECTED) 2023-11-04T01:44:55.107 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 3u a_inode 0,14 0 13316 [eventfd:6] 2023-11-04T01:44:55.107 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 4u a_inode 0,14 0 13316 [eventfd:7] 2023-11-04T01:44:55.107 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 5u unix 0xffff8d3398408880 0t0 19824 type=DGRAM (UNCONNECTED) 2023-11-04T01:44:55.107 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 6u unix 0xffff8d33815d1980 0t0 19825 type=STREAM (CONNECTED) 2023-11-04T01:44:55.107 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 7u a_inode 0,14 0 13316 [eventfd:8] 2023-11-04T01:44:55.108 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 8r REG 0,4 0 4026531840 net 2023-11-04T01:44:55.108 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 9r REG 0,4 0 4026532495 mnt 2023-11-04T01:44:55.108 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 10u netlink 0t0 19829 KOBJECT_UEVENT 2023-11-04T01:44:55.108 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 11u netlink 0t0 19830 GENERIC 2023-11-04T01:44:55.108 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 12u netlink 0t0 19831 GENERIC 2023-11-04T01:44:55.108 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 13u netlink 0t0 19832 ROUTE 2023-11-04T01:44:55.108 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 14r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.108 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 15r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.108 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 16u netlink 0t0 1853 KOBJECT_UEVENT 2023-11-04T01:44:55.108 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 17u a_inode 0,14 0 13316 [eventpoll] 2023-11-04T01:44:55.108 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 18u unix 0xffff8d3387e5e1c0 0t0 13807 type=STREAM (CONNECTED) 2023-11-04T01:44:55.108 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 19u a_inode 0,14 0 13316 [eventpoll:21,26] 2023-11-04T01:44:55.109 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 20w FIFO 0,24 0t0 1159 /run/systemd/inhibit/1.ref 2023-11-04T01:44:55.109 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 21u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.109 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 23u a_inode 0,14 0 13316 [eventpoll:24,25] 2023-11-04T01:44:55.109 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 24u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.109 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 25u pack 20633 0t0 ARP type=SOCK_DGRAM 2023-11-04T01:44:55.109 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 root 26u IPv4 20634 0t0 UDP smithi114.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-04T01:44:55.109 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.109 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.109 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager (deleted) 2023-11-04T01:44:55.109 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root DEL REG 8,1 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-04T01:44:55.109 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:44:55.109 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-04T01:44:55.110 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-04T01:44:55.110 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:55.110 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root DEL REG 8,1 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-04T01:44:55.110 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.110 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:55.110 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:55.110 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.110 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.110 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.110 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.110 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.110 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.110 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.111 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.111 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.111 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.111 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.111 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.111 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.111 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.111 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.111 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.111 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.111 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.111 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.111 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.111 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.111 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.112 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.112 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.112 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.112 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.112 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.112 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.112 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.112 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.112 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-04T01:44:55.112 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.112 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.112 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.112 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.112 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.113 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.113 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-04T01:44:55.113 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.113 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:55.113 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.113 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.113 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.113 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.113 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.113 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.113 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-04T01:44:55.113 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:55.113 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.113 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.113 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-04T01:44:55.114 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.114 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.114 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:55.114 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:55.114 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:55.114 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:55.114 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:55.114 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:55.114 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.114 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:55.114 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.114 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 1u unix 0xffff8d33831e1dc0 0t0 16901 type=STREAM (CONNECTED) 2023-11-04T01:44:55.114 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 2u unix 0xffff8d33831e1dc0 0t0 16901 type=STREAM (CONNECTED) 2023-11-04T01:44:55.114 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 3u a_inode 0,14 0 13316 [eventfd:6] 2023-11-04T01:44:55.115 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 4u a_inode 0,14 0 13316 [eventfd:7] 2023-11-04T01:44:55.115 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 5u unix 0xffff8d3398408880 0t0 19824 type=DGRAM (UNCONNECTED) 2023-11-04T01:44:55.115 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 6u unix 0xffff8d33815d1980 0t0 19825 type=STREAM (CONNECTED) 2023-11-04T01:44:55.115 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 7u a_inode 0,14 0 13316 [eventfd:8] 2023-11-04T01:44:55.115 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 8r REG 0,4 0 4026531840 net 2023-11-04T01:44:55.115 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 9r REG 0,4 0 4026532495 mnt 2023-11-04T01:44:55.115 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 10u netlink 0t0 19829 KOBJECT_UEVENT 2023-11-04T01:44:55.115 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 11u netlink 0t0 19830 GENERIC 2023-11-04T01:44:55.115 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 12u netlink 0t0 19831 GENERIC 2023-11-04T01:44:55.115 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 13u netlink 0t0 19832 ROUTE 2023-11-04T01:44:55.115 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 14r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.115 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 15r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.115 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 16u netlink 0t0 1853 KOBJECT_UEVENT 2023-11-04T01:44:55.115 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 17u a_inode 0,14 0 13316 [eventpoll] 2023-11-04T01:44:55.115 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 18u unix 0xffff8d3387e5e1c0 0t0 13807 type=STREAM (CONNECTED) 2023-11-04T01:44:55.116 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 19u a_inode 0,14 0 13316 [eventpoll:21,26] 2023-11-04T01:44:55.116 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 20w FIFO 0,24 0t0 1159 /run/systemd/inhibit/1.ref 2023-11-04T01:44:55.116 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 21u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.116 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 23u a_inode 0,14 0 13316 [eventpoll:24,25] 2023-11-04T01:44:55.116 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 24u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.116 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 25u pack 20633 0t0 ARP type=SOCK_DGRAM 2023-11-04T01:44:55.116 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 732 gmain root 26u IPv4 20634 0t0 UDP smithi114.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-04T01:44:55.116 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.116 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.116 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager (deleted) 2023-11-04T01:44:55.116 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root DEL REG 8,1 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-04T01:44:55.116 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:44:55.116 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-04T01:44:55.116 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-04T01:44:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root DEL REG 8,1 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-04T01:44:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.117 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.118 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.118 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.118 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.118 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.118 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.118 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.118 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.118 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.118 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.118 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.118 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.118 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.119 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.119 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.119 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.119 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.119 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.119 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.119 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.119 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.119 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-04T01:44:55.119 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.119 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.119 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.120 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.120 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.120 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.120 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-04T01:44:55.120 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.120 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:55.120 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.120 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.120 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.120 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.120 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.120 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.120 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-04T01:44:55.121 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:55.121 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.121 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.121 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-04T01:44:55.121 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.121 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.121 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:55.121 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:55.121 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:55.121 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:55.121 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:55.121 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:55.122 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.122 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:55.122 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.122 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 1u unix 0xffff8d33831e1dc0 0t0 16901 type=STREAM (CONNECTED) 2023-11-04T01:44:55.122 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 2u unix 0xffff8d33831e1dc0 0t0 16901 type=STREAM (CONNECTED) 2023-11-04T01:44:55.122 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 3u a_inode 0,14 0 13316 [eventfd:6] 2023-11-04T01:44:55.122 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 4u a_inode 0,14 0 13316 [eventfd:7] 2023-11-04T01:44:55.122 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 5u unix 0xffff8d3398408880 0t0 19824 type=DGRAM (UNCONNECTED) 2023-11-04T01:44:55.122 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 6u unix 0xffff8d33815d1980 0t0 19825 type=STREAM (CONNECTED) 2023-11-04T01:44:55.122 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 7u a_inode 0,14 0 13316 [eventfd:8] 2023-11-04T01:44:55.122 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 8r REG 0,4 0 4026531840 net 2023-11-04T01:44:55.122 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 9r REG 0,4 0 4026532495 mnt 2023-11-04T01:44:55.123 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 10u netlink 0t0 19829 KOBJECT_UEVENT 2023-11-04T01:44:55.123 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 11u netlink 0t0 19830 GENERIC 2023-11-04T01:44:55.123 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 12u netlink 0t0 19831 GENERIC 2023-11-04T01:44:55.123 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 13u netlink 0t0 19832 ROUTE 2023-11-04T01:44:55.123 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 14r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.123 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 15r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.123 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 16u netlink 0t0 1853 KOBJECT_UEVENT 2023-11-04T01:44:55.123 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 17u a_inode 0,14 0 13316 [eventpoll] 2023-11-04T01:44:55.123 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 18u unix 0xffff8d3387e5e1c0 0t0 13807 type=STREAM (CONNECTED) 2023-11-04T01:44:55.123 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 19u a_inode 0,14 0 13316 [eventpoll:21,26] 2023-11-04T01:44:55.123 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 20w FIFO 0,24 0t0 1159 /run/systemd/inhibit/1.ref 2023-11-04T01:44:55.123 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 21u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.123 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 23u a_inode 0,14 0 13316 [eventpoll:24,25] 2023-11-04T01:44:55.123 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 24u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.124 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 25u pack 20633 0t0 ARP type=SOCK_DGRAM 2023-11-04T01:44:55.124 INFO:teuthology.orchestra.run.smithi114.stdout:NetworkMa 704 733 gdbus root 26u IPv4 20634 0t0 UDP smithi114.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-04T01:44:55.124 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.124 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.124 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2023-11-04T01:44:55.124 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.124 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.124 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.124 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root DEL REG 8,1 9998 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.124 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.124 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.124 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.124 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.124 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root 1u unix 0xffff8d3387e5a200 0t0 13757 type=STREAM (CONNECTED) 2023-11-04T01:44:55.125 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root 2u unix 0xffff8d3387e5a200 0t0 13757 type=STREAM (CONNECTED) 2023-11-04T01:44:55.125 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root 3u a_inode 0,14 0 13316 [eventfd:1] 2023-11-04T01:44:55.125 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root 4u a_inode 0,14 0 13316 [eventfd:2] 2023-11-04T01:44:55.125 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root 5u unix 0xffff8d3387e58440 0t0 13767 /run/irqbalance/irqbalance707.sock type=STREAM (LISTEN) 2023-11-04T01:44:55.125 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 root 6u unix 0xffff8d3387e60000 0t0 13856 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.125 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.125 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.125 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2023-11-04T01:44:55.125 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.125 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.125 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.125 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root DEL REG 8,1 9998 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.125 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.126 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.126 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.126 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.126 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root 1u unix 0xffff8d3387e5a200 0t0 13757 type=STREAM (CONNECTED) 2023-11-04T01:44:55.126 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root 2u unix 0xffff8d3387e5a200 0t0 13757 type=STREAM (CONNECTED) 2023-11-04T01:44:55.126 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root 3u a_inode 0,14 0 13316 [eventfd:1] 2023-11-04T01:44:55.126 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root 4u a_inode 0,14 0 13316 [eventfd:2] 2023-11-04T01:44:55.126 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root 5u unix 0xffff8d3387e58440 0t0 13767 /run/irqbalance/irqbalance707.sock type=STREAM (LISTEN) 2023-11-04T01:44:55.126 INFO:teuthology.orchestra.run.smithi114.stdout:irqbalanc 707 713 gmain root 6u unix 0xffff8d3387e60000 0t0 13856 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.126 INFO:teuthology.orchestra.run.smithi114.stdout:lsmd 708 libstoragemgmt cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.126 INFO:teuthology.orchestra.run.smithi114.stdout:lsmd 708 libstoragemgmt rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.126 INFO:teuthology.orchestra.run.smithi114.stdout:lsmd 708 libstoragemgmt txt REG 8,1 32280 11292 /usr/bin/lsmd 2023-11-04T01:44:55.126 INFO:teuthology.orchestra.run.smithi114.stdout:lsmd 708 libstoragemgmt mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.127 INFO:teuthology.orchestra.run.smithi114.stdout:lsmd 708 libstoragemgmt mem REG 8,1 56912 10811 /usr/lib64/libconfig.so.11.0.2 2023-11-04T01:44:55.127 INFO:teuthology.orchestra.run.smithi114.stdout:lsmd 708 libstoragemgmt mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.127 INFO:teuthology.orchestra.run.smithi114.stdout:lsmd 708 libstoragemgmt 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.127 INFO:teuthology.orchestra.run.smithi114.stdout:lsmd 708 libstoragemgmt 1u unix 0xffff8d33831e6e80 0t0 16913 type=STREAM (CONNECTED) 2023-11-04T01:44:55.127 INFO:teuthology.orchestra.run.smithi114.stdout:lsmd 708 libstoragemgmt 2u unix 0xffff8d33831e6e80 0t0 16913 type=STREAM (CONNECTED) 2023-11-04T01:44:55.127 INFO:teuthology.orchestra.run.smithi114.stdout:lsmd 708 libstoragemgmt 3uW REG 0,24 0 1106 /run/lsm/ipc/.lsmd-ipc-lock 2023-11-04T01:44:55.127 INFO:teuthology.orchestra.run.smithi114.stdout:lsmd 708 libstoragemgmt 5u unix 0xffff8d33831e5940 0t0 16925 /var/run/lsm/ipc/simc type=STREAM (LISTEN) 2023-11-04T01:44:55.127 INFO:teuthology.orchestra.run.smithi114.stdout:lsmd 708 libstoragemgmt 6u unix 0xffff8d33831e1100 0t0 16926 /var/run/lsm/ipc/sim type=STREAM (LISTEN) 2023-11-04T01:44:55.127 INFO:teuthology.orchestra.run.smithi114.stdout:mcelog 709 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.127 INFO:teuthology.orchestra.run.smithi114.stdout:mcelog 709 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.127 INFO:teuthology.orchestra.run.smithi114.stdout:mcelog 709 root txt REG 8,1 194568 12461 /usr/sbin/mcelog 2023-11-04T01:44:55.127 INFO:teuthology.orchestra.run.smithi114.stdout:mcelog 709 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.127 INFO:teuthology.orchestra.run.smithi114.stdout:mcelog 709 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.127 INFO:teuthology.orchestra.run.smithi114.stdout:mcelog 709 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.128 INFO:teuthology.orchestra.run.smithi114.stdout:mcelog 709 root 1u unix 0xffff8d33831e7700 0t0 16916 type=STREAM (CONNECTED) 2023-11-04T01:44:55.128 INFO:teuthology.orchestra.run.smithi114.stdout:mcelog 709 root 2u unix 0xffff8d33831e7700 0t0 16916 type=STREAM (CONNECTED) 2023-11-04T01:44:55.128 INFO:teuthology.orchestra.run.smithi114.stdout:mcelog 709 root 3r CHR 10,227 0t0 142 /dev/mcelog 2023-11-04T01:44:55.128 INFO:teuthology.orchestra.run.smithi114.stdout:mcelog 709 root 4u unix 0xffff8d33831e4400 0t0 16924 /var/run/mcelog-client type=STREAM (LISTEN) 2023-11-04T01:44:55.128 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.128 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.128 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:55.128 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.128 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.128 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.128 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.128 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.128 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.129 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.129 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:55.129 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.129 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.129 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.129 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.129 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.129 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.129 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.129 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.129 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.129 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.129 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.129 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.130 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.130 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.130 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.130 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.130 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.130 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:55.130 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.130 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.130 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.130 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.130 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd 3r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.130 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd 4u a_inode 0,14 0 13316 [eventfd:3] 2023-11-04T01:44:55.130 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd 5u a_inode 0,14 0 13316 [eventfd:4] 2023-11-04T01:44:55.131 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd 6u unix 0xffff8d33831e6600 0t0 16954 type=STREAM (CONNECTED) 2023-11-04T01:44:55.131 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd 7u a_inode 0,14 0 13316 [eventfd:5] 2023-11-04T01:44:55.131 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd 8r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.131 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd 9u a_inode 0,14 0 13316 [eventfd:9] 2023-11-04T01:44:55.131 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 polkitd 10u unix 0xffff8d3387e65940 0t0 13800 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.131 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.131 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.131 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:55.131 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.131 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.131 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.131 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.131 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.131 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.131 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.132 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:55.132 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.132 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.132 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.132 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.132 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.132 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.132 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.132 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.132 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.132 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.132 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.132 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.132 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.133 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.133 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.133 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.133 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.133 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:55.133 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.133 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.133 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.133 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.133 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd 3r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.133 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd 4u a_inode 0,14 0 13316 [eventfd:3] 2023-11-04T01:44:55.133 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd 5u a_inode 0,14 0 13316 [eventfd:4] 2023-11-04T01:44:55.133 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd 6u unix 0xffff8d33831e6600 0t0 16954 type=STREAM (CONNECTED) 2023-11-04T01:44:55.133 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd 7u a_inode 0,14 0 13316 [eventfd:5] 2023-11-04T01:44:55.134 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd 8r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.134 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd 9u a_inode 0,14 0 13316 [eventfd:9] 2023-11-04T01:44:55.134 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 722 gmain polkitd 10u unix 0xffff8d3387e65940 0t0 13800 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.134 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.134 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.134 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:55.134 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.134 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.134 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.134 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.134 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.134 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.135 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.135 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:55.135 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.135 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.135 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.135 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.135 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.135 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.135 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.135 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.135 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.135 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.135 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.135 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.136 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.136 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.136 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.136 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.136 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.136 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:55.136 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.136 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.136 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.136 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.136 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd 3r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.136 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd 4u a_inode 0,14 0 13316 [eventfd:3] 2023-11-04T01:44:55.136 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd 5u a_inode 0,14 0 13316 [eventfd:4] 2023-11-04T01:44:55.136 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd 6u unix 0xffff8d33831e6600 0t0 16954 type=STREAM (CONNECTED) 2023-11-04T01:44:55.137 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd 7u a_inode 0,14 0 13316 [eventfd:5] 2023-11-04T01:44:55.137 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd 8r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.137 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd 9u a_inode 0,14 0 13316 [eventfd:9] 2023-11-04T01:44:55.137 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 723 gdbus polkitd 10u unix 0xffff8d3387e65940 0t0 13800 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.137 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.137 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.137 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:55.137 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.137 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.137 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.137 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.137 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.137 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.137 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.138 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:55.138 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.138 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.138 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.138 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.138 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.138 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.138 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.138 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.138 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.138 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.138 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.139 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.139 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.139 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.139 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.139 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.139 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.139 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:55.139 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.139 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.139 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.139 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.139 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd 3r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.139 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd 4u a_inode 0,14 0 13316 [eventfd:3] 2023-11-04T01:44:55.139 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd 5u a_inode 0,14 0 13316 [eventfd:4] 2023-11-04T01:44:55.140 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd 6u unix 0xffff8d33831e6600 0t0 16954 type=STREAM (CONNECTED) 2023-11-04T01:44:55.140 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd 7u a_inode 0,14 0 13316 [eventfd:5] 2023-11-04T01:44:55.140 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd 8r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.140 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd 9u a_inode 0,14 0 13316 [eventfd:9] 2023-11-04T01:44:55.140 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 724 JS\x20Hel polkitd 10u unix 0xffff8d3387e65940 0t0 13800 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.140 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.140 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.140 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:55.140 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.140 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.140 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.140 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.140 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.140 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.141 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.141 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:55.141 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.141 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.141 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.141 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.141 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.141 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.141 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.141 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.141 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.141 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.141 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.141 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.142 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.142 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.142 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.142 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.142 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.142 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:55.142 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.142 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.142 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.142 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.142 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd 3r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.142 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd 4u a_inode 0,14 0 13316 [eventfd:3] 2023-11-04T01:44:55.143 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd 5u a_inode 0,14 0 13316 [eventfd:4] 2023-11-04T01:44:55.143 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd 6u unix 0xffff8d33831e6600 0t0 16954 type=STREAM (CONNECTED) 2023-11-04T01:44:55.143 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd 7u a_inode 0,14 0 13316 [eventfd:5] 2023-11-04T01:44:55.143 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd 8r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.143 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd 9u a_inode 0,14 0 13316 [eventfd:9] 2023-11-04T01:44:55.143 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 725 JS\x20Hel polkitd 10u unix 0xffff8d3387e65940 0t0 13800 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.143 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.143 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.143 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:55.143 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.143 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.143 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.143 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.143 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.143 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.144 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.144 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:55.144 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.144 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.144 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.144 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.144 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.144 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.144 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.144 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.144 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.144 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.144 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.144 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.144 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.145 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.145 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.145 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.145 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.145 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:55.145 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.145 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.145 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.145 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.145 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd 3r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.145 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd 4u a_inode 0,14 0 13316 [eventfd:3] 2023-11-04T01:44:55.145 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd 5u a_inode 0,14 0 13316 [eventfd:4] 2023-11-04T01:44:55.145 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd 6u unix 0xffff8d33831e6600 0t0 16954 type=STREAM (CONNECTED) 2023-11-04T01:44:55.145 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd 7u a_inode 0,14 0 13316 [eventfd:5] 2023-11-04T01:44:55.146 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd 8r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.146 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd 9u a_inode 0,14 0 13316 [eventfd:9] 2023-11-04T01:44:55.146 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 726 JS\x20Hel polkitd 10u unix 0xffff8d3387e65940 0t0 13800 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.146 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.146 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.146 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:55.146 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.146 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.146 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.146 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.146 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.146 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.146 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.146 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:55.146 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.147 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.147 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.147 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.147 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.147 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.147 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.147 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.147 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.147 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.147 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.147 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.147 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.147 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.148 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.148 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.148 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.148 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:55.148 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.148 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.148 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.148 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.148 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd 3r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.148 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd 4u a_inode 0,14 0 13316 [eventfd:3] 2023-11-04T01:44:55.148 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd 5u a_inode 0,14 0 13316 [eventfd:4] 2023-11-04T01:44:55.148 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd 6u unix 0xffff8d33831e6600 0t0 16954 type=STREAM (CONNECTED) 2023-11-04T01:44:55.148 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd 7u a_inode 0,14 0 13316 [eventfd:5] 2023-11-04T01:44:55.148 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd 8r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.149 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd 9u a_inode 0,14 0 13316 [eventfd:9] 2023-11-04T01:44:55.149 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 727 JS\x20Hel polkitd 10u unix 0xffff8d3387e65940 0t0 13800 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.149 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.149 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.149 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:55.149 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.149 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.149 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.149 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.149 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.149 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.149 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.149 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:55.149 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.150 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.150 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.150 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.150 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.150 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.150 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.150 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.150 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.150 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.150 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.150 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.150 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.150 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.151 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.151 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.151 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.151 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:55.151 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.151 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.151 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.151 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.151 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd 3r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.151 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd 4u a_inode 0,14 0 13316 [eventfd:3] 2023-11-04T01:44:55.151 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd 5u a_inode 0,14 0 13316 [eventfd:4] 2023-11-04T01:44:55.151 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd 6u unix 0xffff8d33831e6600 0t0 16954 type=STREAM (CONNECTED) 2023-11-04T01:44:55.151 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd 7u a_inode 0,14 0 13316 [eventfd:5] 2023-11-04T01:44:55.151 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd 8r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.152 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd 9u a_inode 0,14 0 13316 [eventfd:9] 2023-11-04T01:44:55.152 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 728 JS\x20Hel polkitd 10u unix 0xffff8d3387e65940 0t0 13800 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.152 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.152 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.152 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:55.152 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.152 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.152 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.152 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.152 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.152 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.152 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.152 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:55.152 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.153 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.153 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.153 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.153 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.153 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.153 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.153 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.153 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.153 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.153 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.153 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.153 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.153 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.153 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.153 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.154 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.154 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:55.154 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.154 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.154 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.154 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.154 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd 3r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.154 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd 4u a_inode 0,14 0 13316 [eventfd:3] 2023-11-04T01:44:55.154 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd 5u a_inode 0,14 0 13316 [eventfd:4] 2023-11-04T01:44:55.154 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd 6u unix 0xffff8d33831e6600 0t0 16954 type=STREAM (CONNECTED) 2023-11-04T01:44:55.154 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd 7u a_inode 0,14 0 13316 [eventfd:5] 2023-11-04T01:44:55.154 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd 8r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.154 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd 9u a_inode 0,14 0 13316 [eventfd:9] 2023-11-04T01:44:55.155 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 729 JS\x20Hel polkitd 10u unix 0xffff8d3387e65940 0t0 13800 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.155 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.155 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.155 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:55.155 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.155 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.155 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.155 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.155 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.155 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.155 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.155 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:55.155 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.155 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.155 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.156 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.156 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.156 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.156 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.156 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.156 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.156 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.156 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.156 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.156 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.156 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.156 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.156 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.156 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.157 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:55.157 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.157 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.157 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.157 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.157 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd 3r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.157 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd 4u a_inode 0,14 0 13316 [eventfd:3] 2023-11-04T01:44:55.157 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd 5u a_inode 0,14 0 13316 [eventfd:4] 2023-11-04T01:44:55.157 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd 6u unix 0xffff8d33831e6600 0t0 16954 type=STREAM (CONNECTED) 2023-11-04T01:44:55.157 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd 7u a_inode 0,14 0 13316 [eventfd:5] 2023-11-04T01:44:55.157 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd 8r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.157 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd 9u a_inode 0,14 0 13316 [eventfd:9] 2023-11-04T01:44:55.157 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 730 JS\x20Hel polkitd 10u unix 0xffff8d3387e65940 0t0 13800 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.157 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.158 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.158 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:55.158 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.158 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.158 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.158 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.158 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.158 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.158 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.158 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:55.158 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.158 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.159 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.159 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.159 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.159 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.159 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.159 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.159 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.159 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.159 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.159 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.159 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.159 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.159 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.160 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.160 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.160 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:55.160 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.160 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.160 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.160 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.160 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd 3r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.160 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd 4u a_inode 0,14 0 13316 [eventfd:3] 2023-11-04T01:44:55.160 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd 5u a_inode 0,14 0 13316 [eventfd:4] 2023-11-04T01:44:55.160 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd 6u unix 0xffff8d33831e6600 0t0 16954 type=STREAM (CONNECTED) 2023-11-04T01:44:55.160 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd 7u a_inode 0,14 0 13316 [eventfd:5] 2023-11-04T01:44:55.161 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd 8r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.161 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd 9u a_inode 0,14 0 13316 [eventfd:9] 2023-11-04T01:44:55.161 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 731 JS\x20Hel polkitd 10u unix 0xffff8d3387e65940 0t0 13800 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.161 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.161 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.161 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:44:55.161 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.161 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.161 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.161 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.161 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.161 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.161 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.162 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:44:55.162 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.162 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.162 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.162 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.162 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.162 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.162 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.162 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.162 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.162 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.162 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.163 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.163 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.163 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.163 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.163 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.163 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.163 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:44:55.163 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.163 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.163 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.163 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.163 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd 3r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.163 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd 4u a_inode 0,14 0 13316 [eventfd:3] 2023-11-04T01:44:55.163 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd 5u a_inode 0,14 0 13316 [eventfd:4] 2023-11-04T01:44:55.164 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd 6u unix 0xffff8d33831e6600 0t0 16954 type=STREAM (CONNECTED) 2023-11-04T01:44:55.164 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd 7u a_inode 0,14 0 13316 [eventfd:5] 2023-11-04T01:44:55.164 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd 8r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.164 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd 9u a_inode 0,14 0 13316 [eventfd:9] 2023-11-04T01:44:55.164 INFO:teuthology.orchestra.run.smithi114.stdout:polkitd 710 736 polkitd polkitd 10u unix 0xffff8d3387e65940 0t0 13800 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.164 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.164 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.164 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root txt REG 8,1 622048 12498 /usr/sbin/smartd 2023-11-04T01:44:55.164 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.164 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.164 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.164 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.164 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.164 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.164 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.165 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.165 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.165 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.165 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.165 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.165 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.165 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.165 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.165 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.165 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.165 INFO:teuthology.orchestra.run.smithi114.stdout:smartd 711 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.165 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.165 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.166 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root txt REG 8,1 306896 20362 /usr/lib/systemd/systemd-logind 2023-11-04T01:44:55.166 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root DEL REG 8,1 1168 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:44:55.166 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root DEL REG 8,1 1143 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:44:55.166 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:55.166 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.166 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:55.166 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.166 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.166 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.166 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.166 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.166 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.166 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.166 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.167 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:44:55.167 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.167 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.167 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:44:55.167 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:55.167 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.167 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.167 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.167 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:44:55.167 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.167 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.167 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:44:55.167 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:55.167 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.167 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.168 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:44:55.168 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.168 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.168 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:44:55.168 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.168 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 1u unix 0xffff8d3398381540 0t0 1743 type=STREAM (CONNECTED) 2023-11-04T01:44:55.168 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 2u unix 0xffff8d3398381540 0t0 1743 type=STREAM (CONNECTED) 2023-11-04T01:44:55.168 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 3u unix 0xffff8d339837a200 0t0 1768 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.168 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 4u a_inode 0,14 0 13316 [eventpoll:5,6,7,8,9,10,11,12,13,14,15,16,17,18,20] 2023-11-04T01:44:55.168 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 5u a_inode 0,14 0 13316 [signalfd] 2023-11-04T01:44:55.168 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 6u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.168 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 7r REG 0,21 4096 22919 /sys/devices/virtual/tty/tty0/active 2023-11-04T01:44:55.168 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 8u netlink 0t0 1779 KOBJECT_UEVENT 2023-11-04T01:44:55.169 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 9r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.169 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 10r FIFO 0,24 0t0 1159 /run/systemd/inhibit/1.ref 2023-11-04T01:44:55.169 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 11u netlink 0t0 1780 KOBJECT_UEVENT 2023-11-04T01:44:55.169 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 12u netlink 0t0 1781 KOBJECT_UEVENT 2023-11-04T01:44:55.169 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 13u netlink 0t0 1782 KOBJECT_UEVENT 2023-11-04T01:44:55.169 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 14u unix 0xffff8d3398382200 0t0 1783 type=STREAM (CONNECTED) 2023-11-04T01:44:55.169 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 15u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.169 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 16u CHR 13,65 0t0 138 /dev/input/event1 2023-11-04T01:44:55.169 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 17u CHR 13,64 0t0 137 /dev/input/event0 2023-11-04T01:44:55.169 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 18u CHR 13,66 0t0 148 /dev/input/event2 2023-11-04T01:44:55.169 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 19u CHR 4,6 0t0 25 /dev/tty6 2023-11-04T01:44:55.169 INFO:teuthology.orchestra.run.smithi114.stdout:systemd-l 714 root 20r FIFO 0,24 0t0 1627 /run/systemd/sessions/4.ref 2023-11-04T01:44:55.169 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.170 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.170 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-04T01:44:55.170 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.170 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.170 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.170 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.170 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.170 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.170 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.170 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.170 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.170 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.170 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.171 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.171 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.171 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.171 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.171 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:55.171 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.171 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.171 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.171 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.171 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.171 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.171 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.172 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.172 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:55.172 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.172 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.172 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.172 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root 1u unix 0xffff8d3398441dc0 0t0 21995 type=STREAM (CONNECTED) 2023-11-04T01:44:55.172 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root 2u unix 0xffff8d3398441dc0 0t0 21995 type=STREAM (CONNECTED) 2023-11-04T01:44:55.172 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root 3u IPv4 22008 0t0 TCP *:ssh (LISTEN) 2023-11-04T01:44:55.172 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 772 root 4u IPv6 22010 0t0 TCP *:ssh (LISTEN) 2023-11-04T01:44:55.172 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.172 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.172 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:55.172 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.173 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.173 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.173 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-11-04T01:44:55.173 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.173 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.173 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.173 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.173 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.173 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.173 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.173 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.173 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-11-04T01:44:55.173 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.177 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.177 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.177 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.177 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.177 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.177 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.177 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.177 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root 1u unix 0xffff8d3398051540 0t0 20592 type=STREAM (CONNECTED) 2023-11-04T01:44:55.177 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root 2u unix 0xffff8d3398051540 0t0 20592 type=STREAM (CONNECTED) 2023-11-04T01:44:55.177 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root 3w REG 8,1 10371 1216 /var/log/tuned/tuned.log 2023-11-04T01:44:55.177 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root 4u sock 0,8 0t0 19909 protocol: NETLINK 2023-11-04T01:44:55.177 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root 5u unix 0xffff8d33815d3b80 0t0 19921 type=STREAM (CONNECTED) 2023-11-04T01:44:55.178 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root 6u a_inode 0,14 0 13316 [eventfd:17] 2023-11-04T01:44:55.178 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root 7u unix 0xffff8d3398052200 0t0 20631 type=STREAM (CONNECTED) 2023-11-04T01:44:55.178 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 root 8u unix 0xffff8d3398051dc0 0t0 20632 type=STREAM (CONNECTED) 2023-11-04T01:44:55.178 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.178 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.178 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:55.178 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.178 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.178 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.178 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-11-04T01:44:55.178 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.179 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.179 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.179 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.179 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:44:55.179 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:44:55.179 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.179 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:44:55.179 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-11-04T01:44:55.179 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.179 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:44:55.179 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:44:55.179 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root 1u unix 0xffff8d3398051540 0t0 20592 type=STREAM (CONNECTED) 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root 2u unix 0xffff8d3398051540 0t0 20592 type=STREAM (CONNECTED) 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root 3w REG 8,1 10371 1216 /var/log/tuned/tuned.log 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root 4u sock 0,8 0t0 19909 protocol: NETLINK 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root 5u unix 0xffff8d33815d3b80 0t0 19921 type=STREAM (CONNECTED) 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root 6u a_inode 0,14 0 13316 [eventfd:17] 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root 7u unix 0xffff8d3398052200 0t0 20631 type=STREAM (CONNECTED) 2023-11-04T01:44:55.184 INFO:teuthology.orchestra.run.smithi114.stdout:tuned 774 864 tuned root 8u unix 0xffff8d3398051dc0 0t0 20632 type=STREAM (CONNECTED) 2023-11-04T01:44:55.184 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.184 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.184 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:44:55.184 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:55.184 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.184 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.184 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.184 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.184 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:44:55.184 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:44:55.184 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:55.184 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:55.185 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:55.185 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.185 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.185 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.185 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:44:55.185 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:44:55.185 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:44:55.185 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.185 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.185 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.185 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.185 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.186 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:44:55.186 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.186 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:44:55.186 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:44:55.186 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:44:55.186 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.186 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.186 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:44:55.186 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:55.186 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:55.186 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:55.186 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:55.187 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:55.187 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:55.187 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.187 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:55.187 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.187 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root 1u unix 0xffff8d3398383300 0t0 1868 type=STREAM (CONNECTED) 2023-11-04T01:44:55.187 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root 2u unix 0xffff8d3398383300 0t0 1868 type=STREAM (CONNECTED) 2023-11-04T01:44:55.187 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root 3u unix 0xffff8d339840b300 0t0 19896 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.187 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root 4r FIFO 0,13 0t0 19901 pipe 2023-11-04T01:44:55.187 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root 5u a_inode 0,14 0 13316 [eventpoll:4,6,7,8] 2023-11-04T01:44:55.187 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root 6u a_inode 0,14 0 13316 [eventfd:16] 2023-11-04T01:44:55.187 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root 7u unix 0xffff8d33815d4840 0t0 19897 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:44:55.187 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root 8u unix 0xffff8d33815d2200 0t0 19898 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:44:55.187 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 root 9w FIFO 0,13 0t0 19901 pipe 2023-11-04T01:44:55.188 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.188 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.188 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:44:55.188 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:55.188 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.188 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.188 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.188 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.188 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:44:55.188 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:44:55.188 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:55.188 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:55.189 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:55.189 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.189 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.189 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.189 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:44:55.189 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:44:55.189 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:44:55.189 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.189 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.189 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.189 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.189 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.190 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:44:55.190 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.190 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:44:55.190 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:44:55.190 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:44:55.190 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.190 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.190 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:44:55.190 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:55.190 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:55.190 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:55.190 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:55.191 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:55.191 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:55.191 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.191 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:55.191 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.191 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root 1u unix 0xffff8d3398383300 0t0 1868 type=STREAM (CONNECTED) 2023-11-04T01:44:55.191 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root 2u unix 0xffff8d3398383300 0t0 1868 type=STREAM (CONNECTED) 2023-11-04T01:44:55.191 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root 3u unix 0xffff8d339840b300 0t0 19896 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.191 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root 4r FIFO 0,13 0t0 19901 pipe 2023-11-04T01:44:55.191 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root 5u a_inode 0,14 0 13316 [eventpoll:4,6,7,8] 2023-11-04T01:44:55.191 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root 6u a_inode 0,14 0 13316 [eventfd:16] 2023-11-04T01:44:55.191 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root 7u unix 0xffff8d33815d4840 0t0 19897 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:44:55.192 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root 8u unix 0xffff8d33815d2200 0t0 19898 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:44:55.192 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 784 gssproxy root 9w FIFO 0,13 0t0 19901 pipe 2023-11-04T01:44:55.192 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.192 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.192 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:44:55.192 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:55.192 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.192 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.192 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.192 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.192 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:44:55.192 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:44:55.192 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:55.193 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:55.193 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:55.193 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.193 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.193 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.193 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:44:55.193 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:44:55.193 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:44:55.193 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.193 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.193 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.193 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.194 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.194 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:44:55.194 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.194 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:44:55.194 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:44:55.194 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:44:55.194 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.194 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.194 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:44:55.194 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:55.194 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:55.194 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:55.195 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:55.195 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:55.195 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:55.195 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.195 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:55.195 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.195 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root 1u unix 0xffff8d3398383300 0t0 1868 type=STREAM (CONNECTED) 2023-11-04T01:44:55.195 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root 2u unix 0xffff8d3398383300 0t0 1868 type=STREAM (CONNECTED) 2023-11-04T01:44:55.195 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root 3u unix 0xffff8d339840b300 0t0 19896 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.195 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root 4r FIFO 0,13 0t0 19901 pipe 2023-11-04T01:44:55.195 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root 5u a_inode 0,14 0 13316 [eventpoll:4,6,7,8] 2023-11-04T01:44:55.195 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root 6u a_inode 0,14 0 13316 [eventfd:16] 2023-11-04T01:44:55.195 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root 7u unix 0xffff8d33815d4840 0t0 19897 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:44:55.196 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root 8u unix 0xffff8d33815d2200 0t0 19898 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:44:55.196 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 785 gssproxy root 9w FIFO 0,13 0t0 19901 pipe 2023-11-04T01:44:55.196 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.196 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.196 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:44:55.196 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:55.196 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.196 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.196 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.196 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.196 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:44:55.196 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:44:55.197 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:55.197 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:55.197 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:55.197 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.197 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.197 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.197 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:44:55.197 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:44:55.197 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:44:55.197 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.197 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.197 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.197 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.197 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.198 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:44:55.198 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.198 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:44:55.198 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:44:55.198 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:44:55.198 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.198 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.198 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:44:55.198 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:55.198 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:55.198 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:55.198 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:55.199 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:55.199 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:55.199 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.199 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:55.199 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.199 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root 1u unix 0xffff8d3398383300 0t0 1868 type=STREAM (CONNECTED) 2023-11-04T01:44:55.199 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root 2u unix 0xffff8d3398383300 0t0 1868 type=STREAM (CONNECTED) 2023-11-04T01:44:55.199 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root 3u unix 0xffff8d339840b300 0t0 19896 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.199 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root 4r FIFO 0,13 0t0 19901 pipe 2023-11-04T01:44:55.199 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root 5u a_inode 0,14 0 13316 [eventpoll:4,6,7,8] 2023-11-04T01:44:55.199 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root 6u a_inode 0,14 0 13316 [eventfd:16] 2023-11-04T01:44:55.199 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root 7u unix 0xffff8d33815d4840 0t0 19897 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:44:55.199 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root 8u unix 0xffff8d33815d2200 0t0 19898 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:44:55.200 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 786 gssproxy root 9w FIFO 0,13 0t0 19901 pipe 2023-11-04T01:44:55.200 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.200 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.200 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:44:55.200 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:55.200 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.200 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.200 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.200 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.200 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:44:55.200 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:44:55.200 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:55.200 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:55.201 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:55.201 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.201 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.201 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.201 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:44:55.201 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:44:55.201 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:44:55.201 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.201 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.201 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.201 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.201 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.201 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:44:55.201 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.202 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:44:55.202 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:44:55.202 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:44:55.202 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.202 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.202 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:44:55.202 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:55.202 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:55.202 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:55.202 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:55.202 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:55.202 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:55.203 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.203 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:55.203 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.203 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root 1u unix 0xffff8d3398383300 0t0 1868 type=STREAM (CONNECTED) 2023-11-04T01:44:55.203 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root 2u unix 0xffff8d3398383300 0t0 1868 type=STREAM (CONNECTED) 2023-11-04T01:44:55.203 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root 3u unix 0xffff8d339840b300 0t0 19896 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.203 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root 4r FIFO 0,13 0t0 19901 pipe 2023-11-04T01:44:55.203 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root 5u a_inode 0,14 0 13316 [eventpoll:4,6,7,8] 2023-11-04T01:44:55.203 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root 6u a_inode 0,14 0 13316 [eventfd:16] 2023-11-04T01:44:55.203 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root 7u unix 0xffff8d33815d4840 0t0 19897 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:44:55.203 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root 8u unix 0xffff8d33815d2200 0t0 19898 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:44:55.203 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 787 gssproxy root 9w FIFO 0,13 0t0 19901 pipe 2023-11-04T01:44:55.203 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.204 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.204 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:44:55.204 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:55.204 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.204 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.204 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.204 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.204 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:44:55.204 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:44:55.204 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:55.204 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:55.204 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:55.204 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.205 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.205 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.205 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:44:55.205 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:44:55.205 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:44:55.205 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.205 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.205 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.205 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.205 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.205 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:44:55.205 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.205 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:44:55.205 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:44:55.206 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:44:55.206 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.206 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.206 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:44:55.206 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:55.206 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:55.206 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:55.206 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:55.206 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:55.206 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:55.206 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.206 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:55.206 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.206 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root 1u unix 0xffff8d3398383300 0t0 1868 type=STREAM (CONNECTED) 2023-11-04T01:44:55.207 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root 2u unix 0xffff8d3398383300 0t0 1868 type=STREAM (CONNECTED) 2023-11-04T01:44:55.207 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root 3u unix 0xffff8d339840b300 0t0 19896 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.207 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root 4r FIFO 0,13 0t0 19901 pipe 2023-11-04T01:44:55.207 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root 5u a_inode 0,14 0 13316 [eventpoll:4,6,7,8] 2023-11-04T01:44:55.207 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root 6u a_inode 0,14 0 13316 [eventfd:16] 2023-11-04T01:44:55.207 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root 7u unix 0xffff8d33815d4840 0t0 19897 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:44:55.207 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root 8u unix 0xffff8d33815d2200 0t0 19898 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:44:55.207 INFO:teuthology.orchestra.run.smithi114.stdout:gssproxy 783 788 gssproxy root 9w FIFO 0,13 0t0 19901 pipe 2023-11-04T01:44:55.207 INFO:teuthology.orchestra.run.smithi114.stdout:atd 790 root cwd DIR 8,1 4096 1657 /var/spool/at 2023-11-04T01:44:55.207 INFO:teuthology.orchestra.run.smithi114.stdout:atd 790 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.207 INFO:teuthology.orchestra.run.smithi114.stdout:atd 790 root txt REG 8,1 32680 12473 /usr/sbin/atd 2023-11-04T01:44:55.207 INFO:teuthology.orchestra.run.smithi114.stdout:atd 790 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.208 INFO:teuthology.orchestra.run.smithi114.stdout:atd 790 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.208 INFO:teuthology.orchestra.run.smithi114.stdout:atd 790 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.208 INFO:teuthology.orchestra.run.smithi114.stdout:atd 790 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.208 INFO:teuthology.orchestra.run.smithi114.stdout:atd 790 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:55.208 INFO:teuthology.orchestra.run.smithi114.stdout:atd 790 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.208 INFO:teuthology.orchestra.run.smithi114.stdout:atd 790 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.208 INFO:teuthology.orchestra.run.smithi114.stdout:atd 790 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:55.208 INFO:teuthology.orchestra.run.smithi114.stdout:atd 790 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.208 INFO:teuthology.orchestra.run.smithi114.stdout:atd 790 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.208 INFO:teuthology.orchestra.run.smithi114.stdout:atd 790 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.208 INFO:teuthology.orchestra.run.smithi114.stdout:atd 790 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.208 INFO:teuthology.orchestra.run.smithi114.stdout:atd 790 root 3uW REG 0,24 4 1182 /run/atd.pid 2023-11-04T01:44:55.208 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.209 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.209 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root txt REG 8,1 74552 11234 /usr/sbin/crond 2023-11-04T01:44:55.209 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:55.209 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.209 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.209 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.209 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:55.209 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:55.209 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:55.209 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.209 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.209 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:55.209 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.210 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.210 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:55.210 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.210 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:55.210 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:55.210 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:55.210 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:55.210 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:55.210 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:55.210 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.210 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:55.210 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.210 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root 1u unix 0xffff8d3387c30cc0 0t0 16371 type=STREAM (CONNECTED) 2023-11-04T01:44:55.211 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root 2u unix 0xffff8d3387c30cc0 0t0 16371 type=STREAM (CONNECTED) 2023-11-04T01:44:55.211 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root 3uW REG 0,24 4 1180 /run/crond.pid 2023-11-04T01:44:55.211 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root 4u unix 0xffff8d339b1ca640 0t0 16374 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.211 INFO:teuthology.orchestra.run.smithi114.stdout:crond 791 root 5r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.211 INFO:teuthology.orchestra.run.smithi114.stdout:nrpe 875 nrpe cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.211 INFO:teuthology.orchestra.run.smithi114.stdout:nrpe 875 nrpe rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.211 INFO:teuthology.orchestra.run.smithi114.stdout:nrpe 875 nrpe txt REG 8,1 80984 12959 /usr/sbin/nrpe 2023-11-04T01:44:55.211 INFO:teuthology.orchestra.run.smithi114.stdout:nrpe 875 nrpe mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.211 INFO:teuthology.orchestra.run.smithi114.stdout:nrpe 875 nrpe mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.211 INFO:teuthology.orchestra.run.smithi114.stdout:nrpe 875 nrpe mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.211 INFO:teuthology.orchestra.run.smithi114.stdout:nrpe 875 nrpe mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.211 INFO:teuthology.orchestra.run.smithi114.stdout:nrpe 875 nrpe mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.212 INFO:teuthology.orchestra.run.smithi114.stdout:nrpe 875 nrpe 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.212 INFO:teuthology.orchestra.run.smithi114.stdout:nrpe 875 nrpe 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.212 INFO:teuthology.orchestra.run.smithi114.stdout:nrpe 875 nrpe 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.212 INFO:teuthology.orchestra.run.smithi114.stdout:nrpe 875 nrpe 3u IPv4 18177 0t0 TCP *:nrpe (LISTEN) 2023-11-04T01:44:55.212 INFO:teuthology.orchestra.run.smithi114.stdout:nrpe 875 nrpe 4u unix 0xffff8d3398166a40 0t0 18169 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.212 INFO:teuthology.orchestra.run.smithi114.stdout:nrpe 875 nrpe 5u IPv6 18178 0t0 TCP *:nrpe (LISTEN) 2023-11-04T01:44:55.212 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1309 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.212 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1309 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.212 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1309 root txt REG 8,1 58072 13690 /usr/sbin/agetty 2023-11-04T01:44:55.212 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1309 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.212 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1309 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.212 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1309 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.212 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1309 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.213 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1309 root 0u CHR 4,1 0t0 20 /dev/tty1 2023-11-04T01:44:55.213 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1309 root 1u CHR 4,1 0t0 20 /dev/tty1 2023-11-04T01:44:55.213 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1309 root 2u CHR 4,1 0t0 20 /dev/tty1 2023-11-04T01:44:55.213 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1309 root 4r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.213 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.213 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.213 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root txt REG 8,1 58072 13690 /usr/sbin/agetty 2023-11-04T01:44:55.213 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:55.213 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.213 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.213 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:55.213 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:55.213 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:55.214 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.214 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:55.214 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:55.214 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:55.214 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:55.214 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:55.214 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:55.214 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.214 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:55.214 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root 0u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-04T01:44:55.214 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root 1u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-04T01:44:55.214 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root 2u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-04T01:44:55.214 INFO:teuthology.orchestra.run.smithi114.stdout:agetty 1310 root 4r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-04T01:44:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu DEL REG 8,1 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:44:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:44:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.215 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:44:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:44:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-04T01:44:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:44:55.216 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.217 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:55.217 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:44:55.217 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.217 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu DEL REG 8,1 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:44:55.217 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.217 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:44:55.217 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.217 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 1u unix 0xffff8d3387e5aec0 0t0 24696 type=STREAM (CONNECTED) 2023-11-04T01:44:55.217 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 2u unix 0xffff8d3387e5aec0 0t0 24696 type=STREAM (CONNECTED) 2023-11-04T01:44:55.217 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 3u unix 0xffff8d339840cc80 0t0 20172 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.217 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 4u a_inode 0,14 0 13316 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2023-11-04T01:44:55.217 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 5u a_inode 0,14 0 13316 [signalfd] 2023-11-04T01:44:55.217 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 6r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.217 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 7r DIR 0,25 0 3391 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2023-11-04T01:44:55.218 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 8u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.218 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 9u a_inode 0,14 0 13316 [eventpoll:10,13] 2023-11-04T01:44:55.218 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 10r REG 0,20 0 25695 /proc/3183/mountinfo 2023-11-04T01:44:55.218 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 11r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.218 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 12u unix 0xffff8d3398198880 0t0 25707 /run/user/1000/bus type=STREAM (LISTEN) 2023-11-04T01:44:55.218 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 13r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.218 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 14r REG 0,20 0 4026532076 /proc/swaps 2023-11-04T01:44:55.218 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 15u netlink 0t0 20180 KOBJECT_UEVENT 2023-11-04T01:44:55.218 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 16u unix 0xffff8d339840c840 0t0 20185 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2023-11-04T01:44:55.218 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 17u unix 0xffff8d3398408440 0t0 20186 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.218 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 18u unix 0xffff8d3398409dc0 0t0 20187 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.218 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 19u unix 0xffff8d33815d1100 0t0 20188 /run/user/1000/systemd/private type=STREAM (LISTEN) 2023-11-04T01:44:55.218 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 20u unix 0xffff8d33815d0880 0t0 20190 type=STREAM (CONNECTED) 2023-11-04T01:44:55.219 INFO:teuthology.orchestra.run.smithi114.stdout:systemd 3183 ubuntu 21u a_inode 0,14 0 13316 [timerfd] 2023-11-04T01:44:55.219 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.219 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.219 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-04T01:44:55.219 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:55.219 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:55.219 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:55.219 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:55.219 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:55.219 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:55.219 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-04T01:44:55.219 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:55.219 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu DEL REG 8,1 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:44:55.220 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.220 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.220 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.220 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.220 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-04T01:44:55.220 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:55.220 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-04T01:44:55.220 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-04T01:44:55.220 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.220 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.220 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.220 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.220 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.220 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:55.221 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.221 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:44:55.221 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:55.221 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.221 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.221 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.221 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.221 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.221 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:44:55.221 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:44:55.221 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:44:55.221 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.221 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:44:55.221 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-04T01:44:55.222 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.222 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:55.222 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:44:55.222 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.222 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu DEL REG 8,1 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:44:55.222 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.222 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:44:55.222 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.222 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu 1u unix 0xffff8d3387e5aec0 0t0 24696 type=STREAM (CONNECTED) 2023-11-04T01:44:55.222 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu 2u unix 0xffff8d3387e5aec0 0t0 24696 type=STREAM (CONNECTED) 2023-11-04T01:44:55.222 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu 3u a_inode 0,14 0 13316 [eventfd:13] 2023-11-04T01:44:55.222 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu 4u a_inode 0,14 0 13316 [eventfd:14] 2023-11-04T01:44:55.223 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu 6w FIFO 0,13 0t0 24700 pipe 2023-11-04T01:44:55.223 INFO:teuthology.orchestra.run.smithi114.stdout:(sd-pam) 3204 ubuntu 7u unix 0xffff8d3398165d80 0t0 25698 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.223 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.223 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.223 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-04T01:44:55.223 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:44:55.223 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-04T01:44:55.223 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-04T01:44:55.223 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-04T01:44:55.223 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.223 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.223 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.223 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.223 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.223 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.224 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.224 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.224 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.224 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.224 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.224 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-04T01:44:55.224 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-04T01:44:55.224 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.224 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.224 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.224 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.224 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.224 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-04T01:44:55.224 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root 4u unix 0xffff8d339837b300 0t0 24025 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.225 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root 5w REG 8,1 1082916 1642 /var/log/secure 2023-11-04T01:44:55.225 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root 6r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.225 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root 8w REG 8,1 1466548 1641 /var/log/messages 2023-11-04T01:44:55.225 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:44:55.225 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.225 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.225 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-04T01:44:55.225 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:44:55.225 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-04T01:44:55.225 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-04T01:44:55.225 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-04T01:44:55.225 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.226 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.226 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.226 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.226 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.226 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.226 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.226 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.226 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.226 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.226 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.226 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-04T01:44:55.226 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-04T01:44:55.227 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.227 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.227 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.227 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.227 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.227 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-04T01:44:55.227 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root 4u unix 0xffff8d339837b300 0t0 24025 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.227 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root 5w REG 8,1 1082916 1642 /var/log/secure 2023-11-04T01:44:55.227 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root 6r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.227 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root 8w REG 8,1 1466548 1641 /var/log/messages 2023-11-04T01:44:55.227 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 4999 in:imjour root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:44:55.227 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.227 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.228 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-04T01:44:55.228 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:44:55.228 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-04T01:44:55.228 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-04T01:44:55.228 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-04T01:44:55.228 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.228 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.228 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.228 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.228 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.228 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.228 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.228 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.229 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.229 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.229 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.229 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-04T01:44:55.229 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-04T01:44:55.229 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.229 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.229 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.229 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.229 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.229 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-04T01:44:55.229 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root 4u unix 0xffff8d339837b300 0t0 24025 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.229 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root 5w REG 8,1 1082916 1642 /var/log/secure 2023-11-04T01:44:55.230 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root 6r a_inode 0,14 0 13316 inotify 2023-11-04T01:44:55.230 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root 8w REG 8,1 1466548 1641 /var/log/messages 2023-11-04T01:44:55.230 INFO:teuthology.orchestra.run.smithi114.stdout:rsyslogd 4989 5000 rs:main root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:44:55.230 INFO:teuthology.orchestra.run.smithi114.stdout:tls-strp 61008 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.230 INFO:teuthology.orchestra.run.smithi114.stdout:tls-strp 61008 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.230 INFO:teuthology.orchestra.run.smithi114.stdout:tls-strp 61008 root txt unknown /proc/61008/exe 2023-11-04T01:44:55.230 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 61015 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.230 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 61015 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.230 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 61015 root txt unknown /proc/61015/exe 2023-11-04T01:44:55.230 INFO:teuthology.orchestra.run.smithi114.stdout:kdmflush/ 70311 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.230 INFO:teuthology.orchestra.run.smithi114.stdout:kdmflush/ 70311 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.230 INFO:teuthology.orchestra.run.smithi114.stdout:kdmflush/ 70311 root txt unknown /proc/70311/exe 2023-11-04T01:44:55.230 INFO:teuthology.orchestra.run.smithi114.stdout:kdmflush/ 70432 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.231 INFO:teuthology.orchestra.run.smithi114.stdout:kdmflush/ 70432 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.231 INFO:teuthology.orchestra.run.smithi114.stdout:kdmflush/ 70432 root txt unknown /proc/70432/exe 2023-11-04T01:44:55.231 INFO:teuthology.orchestra.run.smithi114.stdout:kdmflush/ 70552 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.231 INFO:teuthology.orchestra.run.smithi114.stdout:kdmflush/ 70552 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.231 INFO:teuthology.orchestra.run.smithi114.stdout:kdmflush/ 70552 root txt unknown /proc/70552/exe 2023-11-04T01:44:55.231 INFO:teuthology.orchestra.run.smithi114.stdout:kdmflush/ 70673 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.231 INFO:teuthology.orchestra.run.smithi114.stdout:kdmflush/ 70673 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.231 INFO:teuthology.orchestra.run.smithi114.stdout:kdmflush/ 70673 root txt unknown /proc/70673/exe 2023-11-04T01:44:55.231 INFO:teuthology.orchestra.run.smithi114.stdout:kdmflush/ 70804 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.231 INFO:teuthology.orchestra.run.smithi114.stdout:kdmflush/ 70804 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.231 INFO:teuthology.orchestra.run.smithi114.stdout:kdmflush/ 70804 root txt unknown /proc/70804/exe 2023-11-04T01:44:55.231 INFO:teuthology.orchestra.run.smithi114.stdout:xfsalloc 71699 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.231 INFO:teuthology.orchestra.run.smithi114.stdout:xfsalloc 71699 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.232 INFO:teuthology.orchestra.run.smithi114.stdout:xfsalloc 71699 root txt unknown /proc/71699/exe 2023-11-04T01:44:55.232 INFO:teuthology.orchestra.run.smithi114.stdout:xfs_mru_c 71700 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.232 INFO:teuthology.orchestra.run.smithi114.stdout:xfs_mru_c 71700 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.232 INFO:teuthology.orchestra.run.smithi114.stdout:xfs_mru_c 71700 root txt unknown /proc/71700/exe 2023-11-04T01:44:55.232 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-buf/d 71701 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.232 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-buf/d 71701 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.232 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-buf/d 71701 root txt unknown /proc/71701/exe 2023-11-04T01:44:55.232 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-conv/ 71702 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.232 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-conv/ 71702 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.232 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-conv/ 71702 root txt unknown /proc/71702/exe 2023-11-04T01:44:55.232 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-recla 71703 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.232 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-recla 71703 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.232 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-recla 71703 root txt unknown /proc/71703/exe 2023-11-04T01:44:55.232 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-block 71704 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.233 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-block 71704 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.233 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-block 71704 root txt unknown /proc/71704/exe 2023-11-04T01:44:55.233 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-inode 71705 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.233 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-inode 71705 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.233 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-inode 71705 root txt unknown /proc/71705/exe 2023-11-04T01:44:55.233 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-log/d 71706 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.233 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-log/d 71706 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.233 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-log/d 71706 root txt unknown /proc/71706/exe 2023-11-04T01:44:55.233 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-cil/d 71707 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.233 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-cil/d 71707 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.233 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-cil/d 71707 root txt unknown /proc/71707/exe 2023-11-04T01:44:55.233 INFO:teuthology.orchestra.run.smithi114.stdout:xfsaild/d 71708 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.234 INFO:teuthology.orchestra.run.smithi114.stdout:xfsaild/d 71708 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.234 INFO:teuthology.orchestra.run.smithi114.stdout:xfsaild/d 71708 root txt unknown /proc/71708/exe 2023-11-04T01:44:55.234 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.234 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.234 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-04T01:44:55.234 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:55.234 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-11-04T01:44:55.234 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-04T01:44:55.234 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.234 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:55.234 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:55.234 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:55.235 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:55.235 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:55.235 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-11-04T01:44:55.235 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:55.235 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-04T01:44:55.235 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-04T01:44:55.235 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:55.235 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:55.235 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-04T01:44:55.235 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:55.235 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-11-04T01:44:55.235 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-11-04T01:44:55.235 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:55.235 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:55.236 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:55.236 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.236 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.236 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.236 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.236 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.236 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.236 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.236 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.236 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.236 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.236 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.236 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.237 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.237 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.237 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.237 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:55.237 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.237 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.237 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.237 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.237 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.237 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.237 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.237 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.238 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:55.238 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.238 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:55.238 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.238 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:44:55.238 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.238 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.238 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.238 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root 3u unix 0xffff8d339837aa80 0t0 163189 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.238 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root 4u IPv4 153385 0t0 TCP smithi114.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:45322 (ESTABLISHED) 2023-11-04T01:44:55.238 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root 6u unix 0xffff8d3398387700 0t0 163164 type=STREAM (CONNECTED) 2023-11-04T01:44:55.238 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root 7w FIFO 0,24 0t0 1627 /run/systemd/sessions/4.ref 2023-11-04T01:44:55.239 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74730 root 8u unix 0xffff8d3398385d80 0t0 163193 type=STREAM (CONNECTED) 2023-11-04T01:44:55.239 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.239 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.239 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-04T01:44:55.239 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:55.239 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-11-04T01:44:55.239 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-04T01:44:55.239 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.239 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:55.239 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:55.239 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:55.239 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:55.239 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:55.239 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-11-04T01:44:55.240 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:55.240 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-04T01:44:55.240 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-04T01:44:55.240 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:55.240 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:55.240 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-04T01:44:55.240 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:55.240 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-11-04T01:44:55.240 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-11-04T01:44:55.240 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:55.240 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:55.240 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:55.240 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:44:55.240 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.241 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.241 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.241 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.241 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.241 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:44:55.241 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:44:55.241 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.241 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.241 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.241 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.241 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.241 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.241 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.242 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:55.242 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.242 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.242 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.242 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.242 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.242 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.242 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.242 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:44:55.242 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:55.242 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.242 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:55.243 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.243 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:44:55.243 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.243 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.243 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.243 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 3u unix 0xffff8d339837aa80 0t0 163189 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.243 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 4u IPv4 153385 0t0 TCP smithi114.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:45322 (ESTABLISHED) 2023-11-04T01:44:55.243 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 5u unix 0xffff8d3398383b80 0t0 163192 type=STREAM (CONNECTED) 2023-11-04T01:44:55.243 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 6u unix 0xffff8d3398387700 0t0 163164 type=STREAM (CONNECTED) 2023-11-04T01:44:55.243 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 7w FIFO 0,24 0t0 1627 /run/systemd/sessions/4.ref 2023-11-04T01:44:55.243 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 11w FIFO 0,13 0t0 177752 pipe 2023-11-04T01:44:55.243 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 12r FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.243 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 13w FIFO 0,13 0t0 177780 pipe 2023-11-04T01:44:55.243 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 14r FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.244 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 15r FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.244 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 16w FIFO 0,13 0t0 180624 pipe 2023-11-04T01:44:55.244 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 17r FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.244 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 18r FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:55.244 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 19w FIFO 0,13 0t0 180632 pipe 2023-11-04T01:44:55.244 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 20r FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:55.244 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 21r FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:55.244 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 22w FIFO 0,13 0t0 180637 pipe 2023-11-04T01:44:55.244 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 23r FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:55.244 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 24r FIFO 0,13 0t0 180638 pipe 2023-11-04T01:44:55.244 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 25w FIFO 0,13 0t0 177832 pipe 2023-11-04T01:44:55.244 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 26r FIFO 0,13 0t0 180639 pipe 2023-11-04T01:44:55.244 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 27r FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:55.244 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 28w FIFO 0,13 0t0 255684 pipe 2023-11-04T01:44:55.245 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 29r FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:55.245 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 30r FIFO 0,13 0t0 255685 pipe 2023-11-04T01:44:55.245 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 31w FIFO 0,13 0t0 253362 pipe 2023-11-04T01:44:55.245 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 32w FIFO 0,13 0t0 262689 pipe 2023-11-04T01:44:55.245 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 33r FIFO 0,13 0t0 255686 pipe 2023-11-04T01:44:55.245 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 34r FIFO 0,13 0t0 253363 pipe 2023-11-04T01:44:55.245 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 35r FIFO 0,13 0t0 262690 pipe 2023-11-04T01:44:55.245 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 36r FIFO 0,13 0t0 253364 pipe 2023-11-04T01:44:55.245 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 37r FIFO 0,13 0t0 260658 pipe 2023-11-04T01:44:55.245 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 38r FIFO 0,13 0t0 256814 pipe 2023-11-04T01:44:55.245 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 40r FIFO 0,13 0t0 260659 pipe 2023-11-04T01:44:55.245 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 41r FIFO 0,13 0t0 256815 pipe 2023-11-04T01:44:55.245 INFO:teuthology.orchestra.run.smithi114.stdout:sshd 74733 ubuntu 42r FIFO 0,13 0t0 262691 pipe 2023-11-04T01:44:55.245 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.246 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.246 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony txt REG 8,1 353408 12490 /usr/sbin/chronyd 2023-11-04T01:44:55.246 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-04T01:44:55.246 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.246 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.246 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-04T01:44:55.246 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.246 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.246 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-04T01:44:55.246 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.246 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:55.246 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:44:55.247 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.247 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.247 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.247 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.247 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.247 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.247 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony 3u unix 0xffff8d339b1561c0 0t0 164010 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.247 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony 5u IPv4 164015 0t0 UDP localhost:323 2023-11-04T01:44:55.247 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony 6u IPv6 164016 0t0 UDP localhost:323 2023-11-04T01:44:55.247 INFO:teuthology.orchestra.run.smithi114.stdout:chronyd 74793 chrony 7u unix 0xffff8d339b152ec0 0t0 164017 /run/chrony/chronyd.sock type=DGRAM (CONNECTED) 2023-11-04T01:44:55.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:55.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph 1u unix 0xffff8d33815d2ec0 0t0 165058 type=STREAM (CONNECTED) 2023-11-04T01:44:55.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-cras 75034 ceph 2u unix 0xffff8d33815d2ec0 0t0 165058 type=STREAM (CONNECTED) 2023-11-04T01:44:55.249 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/3 76065 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.249 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/3 76065 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.250 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/3 76065 root txt unknown /proc/76065/exe 2023-11-04T01:44:55.250 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/3 76166 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.250 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/3 76166 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.250 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/3 76166 root txt unknown /proc/76166/exe 2023-11-04T01:44:55.250 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-buf/d 81936 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.250 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-buf/d 81936 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.250 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-buf/d 81936 root txt unknown /proc/81936/exe 2023-11-04T01:44:55.250 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-conv/ 81937 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.250 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-conv/ 81937 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.250 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-conv/ 81937 root txt unknown /proc/81937/exe 2023-11-04T01:44:55.250 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-recla 81938 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.250 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-recla 81938 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.250 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-recla 81938 root txt unknown /proc/81938/exe 2023-11-04T01:44:55.250 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-block 81939 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.251 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-block 81939 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.251 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-block 81939 root txt unknown /proc/81939/exe 2023-11-04T01:44:55.251 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-inode 81940 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.251 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-inode 81940 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.251 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-inode 81940 root txt unknown /proc/81940/exe 2023-11-04T01:44:55.251 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-log/d 81941 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.251 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-log/d 81941 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.251 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-log/d 81941 root txt unknown /proc/81941/exe 2023-11-04T01:44:55.251 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-cil/d 81942 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.251 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-cil/d 81942 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.251 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-cil/d 81942 root txt unknown /proc/81942/exe 2023-11-04T01:44:55.251 INFO:teuthology.orchestra.run.smithi114.stdout:xfsaild/d 81943 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.251 INFO:teuthology.orchestra.run.smithi114.stdout:xfsaild/d 81943 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.252 INFO:teuthology.orchestra.run.smithi114.stdout:xfsaild/d 81943 root txt unknown /proc/81943/exe 2023-11-04T01:44:55.252 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-buf/d 82020 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.252 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-buf/d 82020 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.252 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-buf/d 82020 root txt unknown /proc/82020/exe 2023-11-04T01:44:55.252 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-conv/ 82021 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.252 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-conv/ 82021 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.252 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-conv/ 82021 root txt unknown /proc/82021/exe 2023-11-04T01:44:55.252 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-recla 82022 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.252 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-recla 82022 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.252 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-recla 82022 root txt unknown /proc/82022/exe 2023-11-04T01:44:55.252 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-block 82023 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.252 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-block 82023 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.252 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-block 82023 root txt unknown /proc/82023/exe 2023-11-04T01:44:55.252 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-inode 82024 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.252 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-inode 82024 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.253 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-inode 82024 root txt unknown /proc/82024/exe 2023-11-04T01:44:55.253 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-log/d 82025 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.253 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-log/d 82025 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.253 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-log/d 82025 root txt unknown /proc/82025/exe 2023-11-04T01:44:55.253 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-cil/d 82026 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.253 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-cil/d 82026 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.253 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-cil/d 82026 root txt unknown /proc/82026/exe 2023-11-04T01:44:55.253 INFO:teuthology.orchestra.run.smithi114.stdout:xfsaild/d 82027 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.253 INFO:teuthology.orchestra.run.smithi114.stdout:xfsaild/d 82027 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.253 INFO:teuthology.orchestra.run.smithi114.stdout:xfsaild/d 82027 root txt unknown /proc/82027/exe 2023-11-04T01:44:55.253 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-buf/d 82104 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.253 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-buf/d 82104 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.253 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-buf/d 82104 root txt unknown /proc/82104/exe 2023-11-04T01:44:55.253 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-conv/ 82105 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.254 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-conv/ 82105 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.254 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-conv/ 82105 root txt unknown /proc/82105/exe 2023-11-04T01:44:55.254 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-recla 82106 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.254 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-recla 82106 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.254 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-recla 82106 root txt unknown /proc/82106/exe 2023-11-04T01:44:55.254 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-block 82107 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.254 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-block 82107 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.254 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-block 82107 root txt unknown /proc/82107/exe 2023-11-04T01:44:55.254 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-inode 82108 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.254 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-inode 82108 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.254 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-inode 82108 root txt unknown /proc/82108/exe 2023-11-04T01:44:55.254 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-log/d 82109 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-log/d 82109 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-log/d 82109 root txt unknown /proc/82109/exe 2023-11-04T01:44:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-cil/d 82110 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-cil/d 82110 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-cil/d 82110 root txt unknown /proc/82110/exe 2023-11-04T01:44:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:xfsaild/d 82111 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:xfsaild/d 82111 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:xfsaild/d 82111 root txt unknown /proc/82111/exe 2023-11-04T01:44:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-buf/d 82188 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-buf/d 82188 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-buf/d 82188 root txt unknown /proc/82188/exe 2023-11-04T01:44:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-conv/ 82189 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-conv/ 82189 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-conv/ 82189 root txt unknown /proc/82189/exe 2023-11-04T01:44:55.256 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-recla 82190 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.256 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-recla 82190 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.256 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-recla 82190 root txt unknown /proc/82190/exe 2023-11-04T01:44:55.256 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-block 82191 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.256 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-block 82191 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.256 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-block 82191 root txt unknown /proc/82191/exe 2023-11-04T01:44:55.256 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-inode 82192 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.256 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-inode 82192 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.256 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-inode 82192 root txt unknown /proc/82192/exe 2023-11-04T01:44:55.256 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-log/d 82193 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.256 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-log/d 82193 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.256 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-log/d 82193 root txt unknown /proc/82193/exe 2023-11-04T01:44:55.257 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-cil/d 82194 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.257 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-cil/d 82194 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.257 INFO:teuthology.orchestra.run.smithi114.stdout:xfs-cil/d 82194 root txt unknown /proc/82194/exe 2023-11-04T01:44:55.257 INFO:teuthology.orchestra.run.smithi114.stdout:xfsaild/d 82195 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.257 INFO:teuthology.orchestra.run.smithi114.stdout:xfsaild/d 82195 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.257 INFO:teuthology.orchestra.run.smithi114.stdout:xfsaild/d 82195 root txt unknown /proc/82195/exe 2023-11-04T01:44:55.257 INFO:teuthology.orchestra.run.smithi114.stdout:dio/dm-0 82241 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.257 INFO:teuthology.orchestra.run.smithi114.stdout:dio/dm-0 82241 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.257 INFO:teuthology.orchestra.run.smithi114.stdout:dio/dm-0 82241 root txt unknown /proc/82241/exe 2023-11-04T01:44:55.257 INFO:teuthology.orchestra.run.smithi114.stdout:dio/dm-1 83403 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.257 INFO:teuthology.orchestra.run.smithi114.stdout:dio/dm-1 83403 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.257 INFO:teuthology.orchestra.run.smithi114.stdout:dio/dm-1 83403 root txt unknown /proc/83403/exe 2023-11-04T01:44:55.257 INFO:teuthology.orchestra.run.smithi114.stdout:dio/dm-2 84565 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.258 INFO:teuthology.orchestra.run.smithi114.stdout:dio/dm-2 84565 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.258 INFO:teuthology.orchestra.run.smithi114.stdout:dio/dm-2 84565 root txt unknown /proc/84565/exe 2023-11-04T01:44:55.258 INFO:teuthology.orchestra.run.smithi114.stdout:dio/dm-3 85728 root cwd DIR 8,1 4096 2 / 2023-11-04T01:44:55.258 INFO:teuthology.orchestra.run.smithi114.stdout:dio/dm-3 85728 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.258 INFO:teuthology.orchestra.run.smithi114.stdout:dio/dm-3 85728 root txt unknown /proc/85728/exe 2023-11-04T01:44:55.258 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.258 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.258 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:55.258 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:55.258 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.258 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.258 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:55.259 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.259 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:55.259 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:55.259 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:55.259 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:55.259 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:55.259 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:55.259 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:55.259 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:55.259 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:55.259 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:55.259 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:55.260 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.260 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.260 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.260 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.260 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.260 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.260 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.260 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.260 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:55.260 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.260 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.260 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.260 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.261 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.261 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:55.261 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.261 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:55.261 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.261 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.261 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.261 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:55.261 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:55.261 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.261 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:55.261 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:55.261 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.262 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root 0r FIFO 0,13 0t0 177752 pipe 2023-11-04T01:44:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root 3r FIFO 0,13 0t0 177766 pipe 2023-11-04T01:44:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root 4w FIFO 0,13 0t0 177766 pipe 2023-11-04T01:44:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root 5u netlink 0t0 177771 AUDIT 2023-11-04T01:44:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87528 root 6u unix 0xffff8d3387e64c80 0t0 177772 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.263 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root 0r FIFO 0,13 0t0 177752 pipe 2023-11-04T01:44:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87545 root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.265 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.267 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:55.268 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:55.269 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root 0r FIFO 0,13 0t0 177780 pipe 2023-11-04T01:44:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root 3r FIFO 0,13 0t0 178657 pipe 2023-11-04T01:44:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root 4w FIFO 0,13 0t0 178657 pipe 2023-11-04T01:44:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root 5u netlink 0t0 182460 AUDIT 2023-11-04T01:44:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87547 root 6u unix 0xffff8d339b1ce600 0t0 182461 type=DGRAM (CONNECTED) 2023-11-04T01:44:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87566 log root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87567 service root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87568 admin_soc root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87576 signal_ha root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87578 rocksdb:l root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87579 rocksdb:h root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87601 ceph-mon root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87602 fn_monsto root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87604 msgr-work root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87605 msgr-work root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87606 msgr-work root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87607 OpHistory root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87610 fin root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87611 safe_time root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87612 cpu_tp root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87613 cpu_tp root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87614 cpu_tp root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87615 cpu_tp root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87616 ms_dispat root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87617 ms_local root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87618 safe_time root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87619 ms_dispat root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 87620 ms_local root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root txt REG 8,1 12250256 3112 /usr/bin/ceph-mon 2023-11-04T01:44:55.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:55.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:55.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:55.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:55.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 1w FIFO 0,13 0t0 177753 pipe 2023-11-04T01:44:55.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 2w FIFO 0,13 0t0 177754 pipe 2023-11-04T01:44:55.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 3r FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 4w FIFO 0,13 0t0 179869 pipe 2023-11-04T01:44:55.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 5w REG 8,1 58251525 405333 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:44:55.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 6uW REG 0,24 6 1755 /run/ceph/ceph-mon.a.pid 2023-11-04T01:44:55.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 7r FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 8w FIFO 0,13 0t0 179871 pipe 2023-11-04T01:44:55.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 9u unix 0xffff8d3398386600 0t0 179872 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 10r FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 11w FIFO 0,13 0t0 179873 pipe 2023-11-04T01:44:55.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:44:55.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:44:55.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 15u IPv4 255710 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:55640 (ESTABLISHED) 2023-11-04T01:44:55.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 17w REG 253,4 654 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:44:55.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 18u a_inode 0,14 0 13316 [eventpoll:19,27,28,38,41,44,47,50] 2023-11-04T01:44:55.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 19r FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 20w FIFO 0,13 0t0 179879 pipe 2023-11-04T01:44:55.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 21u a_inode 0,14 0 13316 [eventpoll:15,22,34,42,45,48] 2023-11-04T01:44:55.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 22r FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 23w FIFO 0,13 0t0 179880 pipe 2023-11-04T01:44:55.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 24u a_inode 0,14 0 13316 [eventpoll:25,37,39,43,46,49,51] 2023-11-04T01:44:55.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 25r FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 26w FIFO 0,13 0t0 179881 pipe 2023-11-04T01:44:55.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 27u IPv4 178666 0t0 TCP smithi114.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:44:55.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 28u IPv4 178667 0t0 TCP smithi114.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:44:55.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 29w REG 8,1 190546 405427 /var/log/ceph/ceph.audit.log 2023-11-04T01:44:55.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 30r FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 31w FIFO 0,13 0t0 179882 pipe 2023-11-04T01:44:55.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 32r FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 33w FIFO 0,13 0t0 179883 pipe 2023-11-04T01:44:55.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 34u IPv4 182545 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:44:55.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 35r FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 36w FIFO 0,13 0t0 179884 pipe 2023-11-04T01:44:55.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 37u IPv4 177808 0t0 TCP smithi114.front.sepia.ceph.com:56754->smithi141.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 38u IPv4 179903 0t0 TCP smithi114.front.sepia.ceph.com:56530->smithi141.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:44:55.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 39u IPv4 182551 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45076 (ESTABLISHED) 2023-11-04T01:44:55.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 40w REG 8,1 104045 405335 /var/log/ceph/ceph.log 2023-11-04T01:44:55.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 41u IPv4 182557 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45098 (ESTABLISHED) 2023-11-04T01:44:55.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 42u IPv4 182564 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45116 (ESTABLISHED) 2023-11-04T01:44:55.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 43u IPv4 180764 0t0 TCP smithi114.front.sepia.ceph.com:52158->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 44u IPv4 182592 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45126 (ESTABLISHED) 2023-11-04T01:44:55.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 45u IPv4 177975 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45128 (ESTABLISHED) 2023-11-04T01:44:55.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 46u IPv4 177978 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45144 (ESTABLISHED) 2023-11-04T01:44:55.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 47u IPv4 177982 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:45146 (ESTABLISHED) 2023-11-04T01:44:55.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 48u IPv4 177985 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi141.front.sepia.ceph.com:51408 (ESTABLISHED) 2023-11-04T01:44:55.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 49u IPv4 178927 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:51618 (ESTABLISHED) 2023-11-04T01:44:55.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 50u IPv4 260615 0t0 TCP smithi114.front.sepia.ceph.com:3300->192.168.0.1:42172 (ESTABLISHED) 2023-11-04T01:44:55.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 51u IPv4 254154 0t0 TCP smithi114.front.sepia.ceph.com:3300->smithi114.front.sepia.ceph.com:38582 (ESTABLISHED) 2023-11-04T01:44:55.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 52w REG 253,4 51643 33816713 /var/lib/ceph/mon/ceph-a/store.db/000016.log 2023-11-04T01:44:55.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mon 87551 122744 rstore_co root 53r REG 253,4 5950977 33816724 /var/lib/ceph/mon/ceph-a/store.db/000018.sst 2023-11-04T01:44:55.507 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.507 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.507 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:55.507 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.507 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.507 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.507 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.508 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.508 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.508 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.508 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.508 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.508 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.508 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.508 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.508 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.508 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.508 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.508 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.508 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.509 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.509 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.509 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root 0r FIFO 0,13 0t0 177780 pipe 2023-11-04T01:44:55.509 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.509 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87572 root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87624 log root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87626 msgr-work root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87627 msgr-work root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87628 msgr-work root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87649 service root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87650 admin_soc root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87651 ceph_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87652 fn_anonym root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87653 signal_ha root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87654 mgrsb-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87655 ms_dispat root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87656 ms_local root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87657 io_contex root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87658 io_contex root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87660 safe_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87661 safe_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87664 safe_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87665 fn_anonym root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87666 flusher root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 87667 safe_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88014 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88015 ms_dispat root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88016 ms_local root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88017 safe_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88018 cmdfin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88022 io_contex root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88023 io_contex root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88024 ceph_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:55.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:55.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:55.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:55.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:55.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:55.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:55.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:55.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:55.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:55.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:55.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:55.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:55.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:55.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:55.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:55.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:55.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:55.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:55.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:55.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:55.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:55.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:55.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:55.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:55.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:55.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:55.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:55.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:55.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:55.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:55.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:55.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:55.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:55.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:55.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:55.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:55.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:55.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:55.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:55.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:55.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:55.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:55.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:55.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:55.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:55.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:55.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:55.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:55.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:55.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:55.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:55.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:55.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:55.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:55.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:55.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:55.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:55.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:55.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:55.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:55.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:55.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:55.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:55.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:55.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:55.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:55.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:55.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:55.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:55.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:55.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:55.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:55.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:55.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:55.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88025 ms_dispat root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:55.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:55.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:55.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:55.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:55.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:55.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:55.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:55.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:55.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:55.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:55.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:55.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:55.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:55.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:55.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:55.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:55.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:55.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:55.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:55.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:55.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:55.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:55.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:55.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:55.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:55.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:55.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:55.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:55.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:55.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:55.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:55.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:55.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:55.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:55.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:55.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:55.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:55.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:55.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:55.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:55.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:55.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:55.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:55.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:55.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:55.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:55.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:55.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:55.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:55.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88026 ms_local root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88027 safe_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88028 safe_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88029 balancer root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88030 m-fin-bal root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88031 crash root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88032 m-fin-cra root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88033 devicehea root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88034 m-fin-dev root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88036 m-fin-ios root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88038 m-fin-nfs root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88040 m-fin-orc root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88041 pg_autosc root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88042 m-fin-pg_ root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88043 progress root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88044 m-fin-pro root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88048 io_contex root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88049 io_contex root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88050 ceph_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88051 ms_dispat root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88052 ms_local root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88053 safe_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88054 safe_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88055 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88057 m-fin-rbd root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88058 restful root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88059 m-fin-res root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88061 m-fin-sta root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88062 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88063 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88064 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88065 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88066 telemetry root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88067 m-fin-tel root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88068 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88072 io_contex root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88073 io_contex root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88074 ceph_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88075 ms_dispat root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88076 ms_local root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88077 safe_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88078 safe_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88079 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88080 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88081 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88082 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88083 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88084 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88085 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88086 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88087 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88088 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:56.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:56.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:56.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:56.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:56.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:56.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:56.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:56.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:56.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:56.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:56.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:56.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:56.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:56.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:56.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:56.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:56.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:56.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:56.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:56.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:56.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:56.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:56.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:56.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:56.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:56.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:56.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:56.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:56.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:56.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:56.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:56.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:56.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:56.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:56.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:56.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:56.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:56.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:56.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:56.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:56.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:56.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:56.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:56.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:56.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:56.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:56.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:56.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:56.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:56.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:56.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:56.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:56.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:56.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:56.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:56.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:56.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:56.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:56.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:56.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:56.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:56.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:56.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:56.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88089 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:56.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:56.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:56.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:56.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:56.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:56.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:56.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:56.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:56.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:56.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:56.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:56.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:56.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:56.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:56.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:56.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:56.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:56.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:56.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:56.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:56.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:56.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:56.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:56.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:56.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:56.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:56.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:56.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:56.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:56.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:56.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:56.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:56.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:56.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:56.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:56.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:56.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:56.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:56.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:56.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:56.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:56.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:56.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:56.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:56.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:56.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:56.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:56.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:56.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:56.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:56.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:56.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:56.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:56.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:56.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:56.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:56.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:56.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:56.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:56.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:56.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:56.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:57.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:57.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:57.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:57.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:57.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:57.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:57.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:57.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:57.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:57.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:57.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:57.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:57.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:57.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:57.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:57.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:57.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:57.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:57.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:57.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:57.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:57.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:57.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:57.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:57.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:57.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:57.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:57.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:57.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:57.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:57.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:57.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88090 mgr-fin root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:57.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:57.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:57.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:57.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:57.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:57.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:57.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:57.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:57.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:57.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:57.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:57.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:57.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:57.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:57.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:57.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:57.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:57.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:57.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:57.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:57.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:57.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:57.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:57.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:57.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:57.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:57.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:57.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:57.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:57.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:57.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:57.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:57.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:57.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:57.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:57.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:57.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:57.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:57.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:57.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:57.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:57.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:57.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:57.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:57.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:57.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:57.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:57.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:57.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:57.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:57.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:57.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:57.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:57.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:57.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:57.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:57.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:57.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:57.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:57.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 88092 m-fin-vol root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:57.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:57.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:57.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:57.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:57.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:57.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:57.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:57.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:57.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:57.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:57.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:57.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:57.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:57.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:57.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:57.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:57.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:57.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:57.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:57.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:57.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:57.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:57.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:57.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:57.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:57.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:57.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:57.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:57.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:57.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:57.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:57.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:57.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:57.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:57.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:57.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:57.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:57.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:57.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:57.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:57.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:57.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:57.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:57.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:57.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:57.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:57.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:57.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:57.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:57.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:57.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:57.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:57.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93730 devicehea root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:57.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:57.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:57.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:57.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:57.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:57.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:57.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:57.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:57.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:57.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:57.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:57.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:57.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:57.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:57.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:57.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:57.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:57.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:57.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:57.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:57.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:57.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:57.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:57.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:57.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:57.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:57.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:57.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:57.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:57.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:57.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:57.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:57.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:57.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:57.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:57.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:57.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:57.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:57.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:57.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:57.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:57.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:57.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:57.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:57.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:57.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:57.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:57.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:57.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:57.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:57.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:57.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:57.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:57.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:57.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:57.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:57.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:57.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:57.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:57.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93752 io_contex root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:57.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:57.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:57.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:57.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:57.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:57.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:57.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:57.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:57.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:57.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:57.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:57.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:57.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:57.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:57.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:57.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:57.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:57.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:57.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:57.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:57.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:57.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:57.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:57.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:57.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:57.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:57.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:57.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:57.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:57.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:57.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:57.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:57.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:57.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:57.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:57.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:57.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:57.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:57.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:57.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:57.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:57.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:57.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:57.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:57.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:57.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:57.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:57.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:57.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:57.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:57.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:57.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:57.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:57.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:57.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:57.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:57.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:57.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:57.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:57.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93753 io_contex root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:57.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:57.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:57.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:57.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:57.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:57.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:57.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:57.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:57.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:57.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:57.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:57.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:57.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:57.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:57.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:57.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:57.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:57.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:57.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:57.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:57.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:57.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:57.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:57.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:57.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:57.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:57.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:57.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:57.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:57.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:57.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:57.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:57.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:57.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:57.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:57.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:57.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:57.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:57.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:57.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:57.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:57.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93754 ceph_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:57.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:57.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:57.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:57.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:57.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:57.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:57.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:57.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:57.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:57.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:57.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:57.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:57.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:57.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:57.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:57.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:57.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:57.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:57.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:57.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:57.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:57.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:57.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:57.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:57.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:57.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:57.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:57.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:57.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:57.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:57.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:57.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:57.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:57.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:57.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:57.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:57.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:57.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:57.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:57.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:57.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:57.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:57.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:57.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:57.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:57.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:57.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:57.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:57.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:57.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:57.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:57.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:57.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:57.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:57.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:57.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:57.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:57.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:57.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:57.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93755 ms_dispat root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:57.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:57.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:57.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:57.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:57.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:57.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:57.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:57.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:57.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:57.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:57.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:57.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:57.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:57.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:57.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:57.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:57.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:57.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:57.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:57.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:57.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:57.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:57.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:57.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:57.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:57.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:57.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:57.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:57.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:57.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:57.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:57.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:57.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:57.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:57.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:57.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:57.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:57.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:57.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:57.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:57.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:57.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:57.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:57.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:57.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:57.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:57.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:57.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:57.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:57.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:57.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:57.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:57.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:57.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:57.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:57.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:57.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:57.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:57.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:57.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93756 ms_local root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:57.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:57.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:57.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:57.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:57.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:57.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:57.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:57.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:57.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:57.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:57.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:57.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:57.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:57.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:57.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:57.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:57.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:57.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:57.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:57.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:57.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:57.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:57.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:57.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:57.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:57.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:57.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:57.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:57.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:57.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:57.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:57.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:57.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:57.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:57.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:57.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:57.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:57.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:57.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:57.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:57.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:57.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:57.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:57.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:57.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:57.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:57.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:57.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:57.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:57.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:57.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93757 safe_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:57.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root txt REG 8,1 4625312 3120 /usr/bin/ceph-mgr 2023-11-04T01:44:57.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:44:57.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 65240 400115 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 783584 399450 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 60264 399455 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 70784 399452 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 87608 399453 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 331936 399428 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 237384 399430 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 41112936 2759 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:44:57.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 177920 399456 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 654400 399461 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 7042240 398819 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:44:57.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 2883920 2473 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:44:57.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 96304 399451 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 155704 399338 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 3870704 2771 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:44:57.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 3784896 398869 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 73976 399236 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 132136 398868 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:44:57.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 40328 398817 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:44:57.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 382824 398820 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:44:57.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 299952 2469 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:44:57.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 20504 399339 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 8003360 1775 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:44:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:44:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:44:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:44:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 1129568 2920 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:44:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:44:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:44:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 721976 396282 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:44:57.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 2154416 396284 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:44:57.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 16192 393710 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:57.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:57.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 2103760 2040 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:44:57.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 515320 2482 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:57.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 198136 2576 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 49328 396821 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:44:57.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:44:57.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 1129032 2042 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 1892920 1771 /usr/lib64/librados.so.2.0.0 2023-11-04T01:44:57.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:44:57.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:57.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:44:57.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 435816 2332 /usr/lib64/libcephsqlite.so 2023-11-04T01:44:57.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 1w FIFO 0,13 0t0 177781 pipe 2023-11-04T01:44:57.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 2w FIFO 0,13 0t0 177782 pipe 2023-11-04T01:44:57.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 3r FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 4w FIFO 0,13 0t0 180475 pipe 2023-11-04T01:44:57.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,23,29,32,33,37,40,42,45,48,51,56,59,62,65,67] 2023-11-04T01:44:57.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 6r FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 7w FIFO 0,13 0t0 180477 pipe 2023-11-04T01:44:57.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,31,34,36,39,43,46,49,52,54,57,60,63,68,69] 2023-11-04T01:44:57.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 9r FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 10w FIFO 0,13 0t0 180478 pipe 2023-11-04T01:44:57.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,28,30,35,38,41,44,47,50,53,55,58,61,64] 2023-11-04T01:44:57.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 12r FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 13w FIFO 0,13 0t0 180479 pipe 2023-11-04T01:44:57.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 14w REG 8,1 9198558 405336 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:44:57.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 15uW REG 0,24 6 1758 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:44:57.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 16r FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 17w FIFO 0,13 0t0 169920 pipe 2023-11-04T01:44:57.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 18u unix 0xffff8d3398056600 0t0 169921 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 19r FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 20w FIFO 0,13 0t0 169925 pipe 2023-11-04T01:44:57.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 21r FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 22w FIFO 0,13 0t0 169926 pipe 2023-11-04T01:44:57.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 23u IPv4 176748 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:44:57.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 24r FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 25w FIFO 0,13 0t0 180753 pipe 2023-11-04T01:44:57.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 26r FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 27w FIFO 0,13 0t0 180754 pipe 2023-11-04T01:44:57.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 28u IPv4 183430 0t0 TCP smithi114.front.sepia.ceph.com:invision-ag->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 29u IPv4 176782 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:44:57.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 30u IPv4 180763 0t0 TCP smithi114.front.sepia.ceph.com:52122->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 31u IPv4 180760 0t0 TCP smithi114.front.sepia.ceph.com:45098->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 32u IPv4 182113 0t0 TCP smithi114.front.sepia.ceph.com:45076->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 33u IPv4 176784 0t0 TCP smithi114.front.sepia.ceph.com:45116->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 34u IPv4 183439 0t0 TCP smithi114.front.sepia.ceph.com:52136->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 35u IPv4 176785 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52122 (ESTABLISHED) 2023-11-04T01:44:57.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 36u IPv4 176786 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52136 (ESTABLISHED) 2023-11-04T01:44:57.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 37u IPv4 176789 0t0 TCP smithi114.front.sepia.ceph.com:52144->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 38u IPv4 176790 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52144 (ESTABLISHED) 2023-11-04T01:44:57.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 39u IPv4 182571 0t0 TCP smithi114.front.sepia.ceph.com:52152->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 40u IPv4 176793 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52152 (ESTABLISHED) 2023-11-04T01:44:57.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 41u IPv4 176796 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:52158 (ESTABLISHED) 2023-11-04T01:44:57.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 42u IPv4 176799 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57170 (ESTABLISHED) 2023-11-04T01:44:57.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 43u IPv4 178860 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57174 (ESTABLISHED) 2023-11-04T01:44:57.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 44u IPv4 177972 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:57188 (ESTABLISHED) 2023-11-04T01:44:57.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 45u IPv4 180832 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39206 (ESTABLISHED) 2023-11-04T01:44:57.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 46u IPv4 180835 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39212 (ESTABLISHED) 2023-11-04T01:44:57.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 47u IPv4 180838 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32884 (ESTABLISHED) 2023-11-04T01:44:57.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 48u IPv4 184513 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39220 (ESTABLISHED) 2023-11-04T01:44:57.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 49u IPv4 184516 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32890 (ESTABLISHED) 2023-11-04T01:44:57.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 50u IPv4 184519 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32894 (ESTABLISHED) 2023-11-04T01:44:57.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 51u IPv4 184522 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:39236 (ESTABLISHED) 2023-11-04T01:44:57.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 52u IPv4 184525 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32898 (ESTABLISHED) 2023-11-04T01:44:57.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 53u IPv4 184532 0t0 TCP smithi114.front.sepia.ceph.com:37928->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 54u IPv4 178045 0t0 TCP smithi114.front.sepia.ceph.com:51618->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 55u IPv4 180871 0t0 TCP smithi114.front.sepia.ceph.com:32902->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 56u IPv4 184545 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:32902 (ESTABLISHED) 2023-11-04T01:44:57.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 57u IPv4 182645 0t0 TCP smithi114.front.sepia.ceph.com:37938->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 58u IPv4 180872 0t0 TCP smithi114.front.sepia.ceph.com:52444->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 59u IPv4 184554 0t0 TCP smithi114.front.sepia.ceph.com:56368->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 60u IPv4 182646 0t0 TCP smithi114.front.sepia.ceph.com:44186->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 61u IPv4 180917 0t0 TCP smithi114.front.sepia.ceph.com:59602->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:44:57.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 62u IPv4 184584 0t0 TCP smithi114.front.sepia.ceph.com:46764->smithi141.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:44:57.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 63u IPv4 178052 0t0 TCP smithi114.front.sepia.ceph.com:50184->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 64u IPv4 176985 0t0 TCP smithi114.front.sepia.ceph.com:43374->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:44:57.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 65u IPv4 184585 0t0 TCP smithi114.front.sepia.ceph.com:37952->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:44:57.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 67u IPv4 257101 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:60866 (ESTABLISHED) 2023-11-04T01:44:57.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 68u IPv4 255718 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi114.front.sepia.ceph.com:59308 (ESTABLISHED) 2023-11-04T01:44:57.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mgr 87623 93758 safe_time root 69u IPv4 234758 0t0 TCP smithi114.front.sepia.ceph.com:6832->smithi141.front.sepia.ceph.com:41376 (ESTABLISHED) 2023-11-04T01:44:57.176 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.176 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.176 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:57.176 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:57.176 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:57.176 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.176 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:57.177 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.177 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:57.177 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:57.177 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:57.177 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:57.177 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:57.177 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:57.177 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:57.177 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:57.177 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.177 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:57.177 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:57.177 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:57.178 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.178 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.178 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.178 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.178 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.178 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.178 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.178 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.178 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.178 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.179 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.179 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:57.179 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.179 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.179 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.179 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:57.179 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.179 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.179 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:57.179 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root 0r FIFO 0,13 0t0 180624 pipe 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root 3r FIFO 0,13 0t0 180644 pipe 2023-11-04T01:44:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root 4w FIFO 0,13 0t0 180644 pipe 2023-11-04T01:44:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root 5u netlink 0t0 180654 AUDIT 2023-11-04T01:44:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87742 root 6u unix 0xffff8d339844e600 0t0 180655 type=DGRAM (CONNECTED) 2023-11-04T01:44:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root 0r FIFO 0,13 0t0 180632 pipe 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root 3r FIFO 0,13 0t0 178730 pipe 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root 4w FIFO 0,13 0t0 178730 pipe 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root 5u netlink 0t0 178739 AUDIT 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87755 root 6u unix 0xffff8d3398162200 0t0 178740 type=DGRAM (CONNECTED) 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.191 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.191 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.191 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:57.191 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:57.191 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:57.191 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.191 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.191 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.191 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.191 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root 0r FIFO 0,13 0t0 180637 pipe 2023-11-04T01:44:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:44:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:44:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root 3r FIFO 0,13 0t0 181840 pipe 2023-11-04T01:44:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root 4w FIFO 0,13 0t0 181840 pipe 2023-11-04T01:44:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root 5u netlink 0t0 181845 AUDIT 2023-11-04T01:44:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87762 root 6u unix 0xffff8d339b150880 0t0 181846 type=DGRAM (CONNECTED) 2023-11-04T01:44:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:44:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:44:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:44:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:44:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:44:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:44:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:44:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:44:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:44:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:44:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:44:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:44:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:44:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:44:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:44:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:44:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:44:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:44:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:44:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:44:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:44:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:44:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:44:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:44:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:44:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:44:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:44:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:44:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:44:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:44:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:44:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:44:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:44:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root 0r FIFO 0,13 0t0 177832 pipe 2023-11-04T01:44:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root 3r FIFO 0,13 0t0 177850 pipe 2023-11-04T01:44:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root 4w FIFO 0,13 0t0 177850 pipe 2023-11-04T01:44:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root 5u netlink 0t0 177857 AUDIT 2023-11-04T01:44:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 87768 root 6u unix 0xffff8d3387e64840 0t0 177858 type=DGRAM (CONNECTED) 2023-11-04T01:44:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root 0r FIFO 0,13 0t0 180624 pipe 2023-11-04T01:44:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87805 root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root 0r FIFO 0,13 0t0 180637 pipe 2023-11-04T01:44:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:44:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87812 root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:44:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root 0r FIFO 0,13 0t0 180632 pipe 2023-11-04T01:44:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87813 root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:44:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:44:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:44:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:44:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:44:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:44:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:44:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root 0r FIFO 0,13 0t0 177832 pipe 2023-11-04T01:44:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 87816 root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 14w REG 8,1 145550450 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87837 log root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 14w REG 8,1 145550450 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87839 msgr-work root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 14w REG 8,1 145550450 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87840 msgr-work root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 14w REG 8,1 145550450 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87841 msgr-work root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 14w REG 8,1 145550450 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87846 service root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 14w REG 8,1 145550450 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87847 admin_soc root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 14w REG 8,1 145550450 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87912 signal_ha root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 14w REG 8,1 145550450 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87913 io_contex root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87914 io_contex root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87928 OpHistory root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87929 ceph_time root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87977 ceph-osd root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 87999 ceph-osd root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88008 ceph-osd root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88095 ceph-osd root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88103 ceph-osd root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88111 ceph-osd root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88119 ceph-osd root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88318 ceph-osd root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88319 ceph-osd root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88320 safe_time root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88321 safe_time root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88322 safe_time root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88323 safe_time root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 14w REG 8,1 145553078 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88324 fn_anonym root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88327 rocksdb:l root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88328 rocksdb:l root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88329 rocksdb:l root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 88330 rocksdb:h root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 89807 bstore_ai root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90578 bstore_ai root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90759 ceph-osd root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90760 cfin root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90761 bstore_kv root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90762 bstore_kv root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90763 bstore_me root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90764 ms_dispat root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90765 ms_local root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90766 safe_time root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90767 safe_time root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90768 ms_dispat root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90769 ms_local root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90770 ms_dispat root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90771 ms_local root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90772 ms_dispat root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90773 ms_local root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90774 ms_dispat root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:57.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:57.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90775 ms_local root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:57.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:57.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:57.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:57.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:57.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:57.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:57.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:57.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:57.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:57.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:57.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:57.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:57.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:57.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:57.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:57.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:57.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:57.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:57.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:57.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:57.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:57.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:57.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:57.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:57.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:57.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:57.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:57.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:57.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:57.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:57.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:57.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:57.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:57.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:57.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:57.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:57.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:57.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:57.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:57.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:57.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:57.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:57.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:57.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:57.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:57.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:57.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:57.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:57.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:57.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:57.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:57.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:57.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:57.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:57.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:57.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:57.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:57.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:57.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:57.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:57.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:57.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:57.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:57.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:57.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:57.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:57.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:57.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:57.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:57.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:57.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:57.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:57.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:57.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:57.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:57.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:57.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:57.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:57.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:57.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:57.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:57.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:57.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:57.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:57.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:57.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:57.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:57.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:57.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:57.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:57.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:57.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:57.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:57.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:57.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:57.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:57.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:57.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:57.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:57.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:57.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:57.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:57.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:57.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:57.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:57.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:57.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:57.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:57.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:57.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:57.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:57.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:57.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:57.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:57.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:57.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:57.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:57.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:57.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:57.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:57.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:57.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:57.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:57.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:57.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:57.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:57.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:57.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:57.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:57.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:57.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:57.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:57.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:57.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:57.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:57.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:57.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:57.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90776 ms_dispat root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90777 ms_local root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 14w REG 8,1 145553361 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90778 ms_dispat root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90779 ms_local root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90780 fn_anonym root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90781 finisher root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90782 safe_time root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90783 safe_time root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90784 ceph-osd root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90785 osd_srv_a root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90786 tp_osd_tp root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90787 tp_osd_tp root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90788 tp_osd_tp root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90789 tp_osd_tp root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90790 tp_osd_tp root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90791 tp_osd_tp root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90792 tp_osd_tp root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90793 tp_osd_tp root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90794 tp_osd_tp root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90795 tp_osd_tp root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90796 tp_osd_tp root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90797 tp_osd_tp root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90798 tp_osd_tp root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90799 tp_osd_tp root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90800 tp_osd_tp root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90801 tp_osd_tp root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root DEL REG 0,17 180770 /[aio] 2023-11-04T01:44:58.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root DEL REG 0,17 180767 /[aio] 2023-11-04T01:44:58.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 1w FIFO 0,13 0t0 180625 pipe 2023-11-04T01:44:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 2w FIFO 0,13 0t0 180626 pipe 2023-11-04T01:44:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 3r FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 4w FIFO 0,13 0t0 180024 pipe 2023-11-04T01:44:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,74,77,79,83,85,88,91,94,97,101] 2023-11-04T01:44:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 6r FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 7w FIFO 0,13 0t0 180026 pipe 2023-11-04T01:44:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 8u a_inode 0,14 0 13316 [eventpoll:9,58,65,68,71,73,76,78,81,86,89,92,95,98] 2023-11-04T01:44:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 9r FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 10w FIFO 0,13 0t0 180027 pipe 2023-11-04T01:44:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 11u a_inode 0,14 0 13316 [eventpoll:12,63,66,69,72,75,80,82,84,87,90,93,96,99] 2023-11-04T01:44:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 12r FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 13w FIFO 0,13 0t0 180028 pipe 2023-11-04T01:44:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 14w REG 8,1 145553644 405329 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:44:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 15uW REG 0,24 6 1760 /run/ceph/ceph-osd.0.pid 2023-11-04T01:44:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 16r FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 17w FIFO 0,13 0t0 180031 pipe 2023-11-04T01:44:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 18u unix 0xffff8d3398380440 0t0 180032 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 19u IPv4 180690 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:44:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 20u IPv4 180692 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:44:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 21u IPv4 180695 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:44:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 22u IPv4 180699 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:44:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 23u IPv4 180704 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:44:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 24u IPv4 180710 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:44:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 25u IPv4 180717 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:44:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 26u IPv4 180725 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:44:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 27r FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 28w FIFO 0,13 0t0 178782 pipe 2023-11-04T01:44:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 29r FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 30w FIFO 0,13 0t0 178783 pipe 2023-11-04T01:44:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 31u sock 0,8 0t0 178868 protocol: UDPv6 2023-11-04T01:44:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:44:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:44:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:44:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 58u IPv4 178881 0t0 TCP smithi114.front.sepia.ceph.com:45128->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 59r FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 60w FIFO 0,13 0t0 183470 pipe 2023-11-04T01:44:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 61r FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 62w FIFO 0,13 0t0 183471 pipe 2023-11-04T01:44:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 63u IPv4 176830 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51172 (ESTABLISHED) 2023-11-04T01:44:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 64u IPv4 176831 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38204 (ESTABLISHED) 2023-11-04T01:44:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 65u IPv4 176834 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36368 (ESTABLISHED) 2023-11-04T01:44:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 66u IPv4 176835 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36384 (ESTABLISHED) 2023-11-04T01:44:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 67u IPv4 176836 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39826 (ESTABLISHED) 2023-11-04T01:44:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 68u IPv4 176839 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51186 (ESTABLISHED) 2023-11-04T01:44:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 69u IPv4 176842 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38208 (ESTABLISHED) 2023-11-04T01:44:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 70u IPv4 176843 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38218 (ESTABLISHED) 2023-11-04T01:44:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 71u IPv4 176846 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39830 (ESTABLISHED) 2023-11-04T01:44:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 72u IPv4 176847 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39836 (ESTABLISHED) 2023-11-04T01:44:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 73u IPv4 176850 0t0 TCP smithi114.front.sepia.ceph.com:46906->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 74u IPv4 178906 0t0 TCP smithi114.front.sepia.ceph.com:59422->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 75u IPv4 178023 0t0 TCP smithi114.front.sepia.ceph.com:53316->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 76u IPv4 176851 0t0 TCP smithi114.front.sepia.ceph.com:49494->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 77u IPv4 178907 0t0 TCP smithi114.front.sepia.ceph.com:50220->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 78u IPv4 176852 0t0 TCP smithi114.front.sepia.ceph.com:57630->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 79u IPv4 178908 0t0 TCP smithi114.front.sepia.ceph.com:38966->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 80u IPv4 178024 0t0 TCP smithi114.front.sepia.ceph.com:41638->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 81u IPv4 176853 0t0 TCP smithi114.front.sepia.ceph.com:41506->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 82u IPv4 178025 0t0 TCP smithi114.front.sepia.ceph.com:52362->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 83u IPv4 178909 0t0 TCP smithi114.front.sepia.ceph.com:46614->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 84u IPv4 178026 0t0 TCP smithi114.front.sepia.ceph.com:58286->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 85u IPv4 178910 0t0 TCP smithi114.front.sepia.ceph.com:44296->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 86u IPv4 176854 0t0 TCP smithi114.front.sepia.ceph.com:59768->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 87u IPv4 178911 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi114.front.sepia.ceph.com:36388 (ESTABLISHED) 2023-11-04T01:44:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 88u IPv4 178914 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi114.front.sepia.ceph.com:51190 (ESTABLISHED) 2023-11-04T01:44:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 89u IPv4 182627 0t0 TCP smithi114.front.sepia.ceph.com:6804->smithi141.front.sepia.ceph.com:39852 (ESTABLISHED) 2023-11-04T01:44:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 90u IPv4 182630 0t0 TCP smithi114.front.sepia.ceph.com:6806->smithi141.front.sepia.ceph.com:38226 (ESTABLISHED) 2023-11-04T01:44:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 91u IPv4 176869 0t0 TCP smithi114.front.sepia.ceph.com:32894->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 92u IPv4 178919 0t0 TCP smithi114.front.sepia.ceph.com:60204->smithi141.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:44:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 93u IPv4 178920 0t0 TCP smithi114.front.sepia.ceph.com:58156->smithi114.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 94u IPv4 176883 0t0 TCP smithi114.front.sepia.ceph.com:42282->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 95u IPv4 176887 0t0 TCP smithi114.front.sepia.ceph.com:6802->smithi141.front.sepia.ceph.com:49242 (ESTABLISHED) 2023-11-04T01:44:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 96u IPv4 183511 0t0 TCP smithi114.front.sepia.ceph.com:60508->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 97u IPv4 176904 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:44:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 98u IPv4 183543 0t0 TCP smithi114.front.sepia.ceph.com:54786->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 99u IPv4 260238 0t0 TCP smithi114.front.sepia.ceph.com:6800->smithi114.front.sepia.ceph.com:57334 (ESTABLISHED) 2023-11-04T01:44:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87822 90802 osd_srv_h root 101u IPv4 178083 0t0 TCP smithi114.front.sepia.ceph.com:36064->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 14w REG 8,1 130297804 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 14w REG 8,1 130296126 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87853 log root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 14w REG 8,1 130296126 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87855 msgr-work root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 14w REG 8,1 130296126 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87856 msgr-work root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 14w REG 8,1 130296126 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87857 msgr-work root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 14w REG 8,1 130296126 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87870 service root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 14w REG 8,1 130296126 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87871 admin_soc root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 14w REG 8,1 130296126 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87916 signal_ha root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 14w REG 8,1 130296126 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87917 io_contex root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 14w REG 8,1 130296126 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87918 io_contex root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 14w REG 8,1 130296126 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87931 OpHistory root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 14w REG 8,1 130296409 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87932 ceph_time root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 14w REG 8,1 130296409 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87989 ceph-osd root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 14w REG 8,1 130296409 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 87998 ceph-osd root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 14w REG 8,1 130296409 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88006 ceph-osd root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 14w REG 8,1 130296409 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88093 ceph-osd root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 14w REG 8,1 130296409 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88101 ceph-osd root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 14w REG 8,1 130296409 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88109 ceph-osd root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 14w REG 8,1 130296409 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88117 ceph-osd root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 14w REG 8,1 130296409 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88125 ceph-osd root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 14w REG 8,1 130296409 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88126 ceph-osd root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 14w REG 8,1 130296409 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88127 safe_time root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 14w REG 8,1 130297238 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88128 safe_time root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 14w REG 8,1 130297238 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88129 safe_time root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 14w REG 8,1 130297238 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88130 safe_time root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 14w REG 8,1 130297238 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88131 fn_anonym root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 14w REG 8,1 130297238 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88134 rocksdb:l root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 14w REG 8,1 130297238 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88135 rocksdb:l root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 14w REG 8,1 130297238 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88136 rocksdb:l root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 14w REG 8,1 130297238 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 88137 rocksdb:h root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 14w REG 8,1 130297238 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 89625 bstore_ai root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 14w REG 8,1 130297238 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90353 bstore_ai root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 14w REG 8,1 130297238 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90534 ceph-osd root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 14w REG 8,1 130297238 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90535 cfin root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 14w REG 8,1 130297238 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90536 bstore_kv root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 14w REG 8,1 130297238 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90537 bstore_kv root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 14w REG 8,1 130297238 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90538 bstore_me root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90539 ms_dispat root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90540 ms_local root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90541 safe_time root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90542 safe_time root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90543 ms_dispat root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:58.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:58.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:58.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:58.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:58.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:58.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:58.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:58.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:58.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:58.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:58.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:58.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:58.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:58.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:58.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:58.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:58.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:58.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:58.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:58.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:58.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:58.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:58.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:58.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:58.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:58.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:58.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:58.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:58.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:58.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:58.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90544 ms_local root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:58.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:58.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:58.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:58.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:58.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:58.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:58.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:58.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:58.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:58.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:58.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:58.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:58.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:58.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:58.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:58.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:58.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:58.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:58.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:58.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:58.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:58.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:58.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:58.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:58.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:58.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:58.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:58.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:58.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:58.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:58.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:58.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:58.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:58.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:58.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:58.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:58.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:58.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:58.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:58.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:58.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:58.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:58.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:58.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:58.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:58.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:58.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:58.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:58.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:58.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:58.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:58.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:58.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:58.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:58.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:58.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:58.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:58.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:58.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:58.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:58.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:58.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:58.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:58.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:58.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:58.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:58.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:58.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:58.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:58.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:58.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:58.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:58.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:58.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:58.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:58.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:58.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:58.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:58.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:58.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:58.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:58.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:58.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:58.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:58.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:58.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:58.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:58.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:58.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:58.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:58.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:58.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:58.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:58.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:58.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:58.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:58.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:58.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:58.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:58.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:58.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:58.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:58.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:58.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:58.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:58.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:58.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:58.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:58.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:58.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90545 ms_dispat root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90546 ms_local root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90547 ms_dispat root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90548 ms_local root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90549 ms_dispat root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90550 ms_local root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90551 ms_dispat root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90552 ms_local root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90553 ms_dispat root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90554 ms_local root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90555 fn_anonym root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90556 finisher root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90557 safe_time root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90558 safe_time root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90559 ceph-osd root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90560 osd_srv_a root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90561 tp_osd_tp root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90562 tp_osd_tp root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90563 tp_osd_tp root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 14w REG 8,1 130297521 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90564 tp_osd_tp root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 14w REG 8,1 130297804 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90565 tp_osd_tp root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 14w REG 8,1 130297804 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90566 tp_osd_tp root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 14w REG 8,1 130297804 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90567 tp_osd_tp root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 14w REG 8,1 130297804 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90568 tp_osd_tp root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 14w REG 8,1 130297804 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90569 tp_osd_tp root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 14w REG 8,1 130297804 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90570 tp_osd_tp root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 14w REG 8,1 130297804 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90571 tp_osd_tp root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 14w REG 8,1 130297804 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90572 tp_osd_tp root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 14w REG 8,1 130297804 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90573 tp_osd_tp root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 14w REG 8,1 130297804 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90574 tp_osd_tp root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 14w REG 8,1 130297804 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90575 tp_osd_tp root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 14w REG 8,1 130297804 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90576 tp_osd_tp root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root DEL REG 0,17 182591 /[aio] 2023-11-04T01:44:59.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root DEL REG 0,17 182589 /[aio] 2023-11-04T01:44:59.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 1w FIFO 0,13 0t0 180633 pipe 2023-11-04T01:44:59.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 2w FIFO 0,13 0t0 180634 pipe 2023-11-04T01:44:59.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 3r FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 4w FIFO 0,13 0t0 178773 pipe 2023-11-04T01:44:59.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,75,76,77,78,79,82,85,88,91,94,97,100] 2023-11-04T01:44:59.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 6r FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 7w FIFO 0,13 0t0 178775 pipe 2023-11-04T01:44:59.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,67,68,69,71,80,83,86,89,92,95,98] 2023-11-04T01:44:59.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 9r FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 10w FIFO 0,13 0t0 178776 pipe 2023-11-04T01:44:59.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,72,73,74,81,84,87,90,93,96,99] 2023-11-04T01:44:59.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 12r FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 13w FIFO 0,13 0t0 178777 pipe 2023-11-04T01:44:59.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 14w REG 8,1 130297804 405330 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:44:59.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 15uW REG 0,24 6 1762 /run/ceph/ceph-osd.1.pid 2023-11-04T01:44:59.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 16r FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 17w FIFO 0,13 0t0 180676 pipe 2023-11-04T01:44:59.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 18u unix 0xffff8d3398446a40 0t0 180677 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 19u IPv4 183323 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:44:59.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 20u IPv4 183333 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:44:59.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 21u IPv4 183344 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:44:59.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 22u IPv4 183356 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:44:59.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 23u IPv4 183369 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:44:59.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 24u IPv4 183383 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:44:59.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 25u IPv4 183398 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:44:59.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 26u IPv4 183414 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:44:59.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 27r FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 28w FIFO 0,13 0t0 180729 pipe 2023-11-04T01:44:59.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 29r FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 30w FIFO 0,13 0t0 180730 pipe 2023-11-04T01:44:59.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 31u sock 0,8 0t0 182577 protocol: UDPv6 2023-11-04T01:44:59.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:44:59.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:44:59.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:44:59.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 58r FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 59w FIFO 0,13 0t0 178887 pipe 2023-11-04T01:44:59.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 60u IPv4 182119 0t0 TCP smithi114.front.sepia.ceph.com:45126->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 61r FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 62w FIFO 0,13 0t0 178888 pipe 2023-11-04T01:44:59.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 63u IPv4 176825 0t0 TCP smithi114.front.sepia.ceph.com:51172->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 64u IPv4 182134 0t0 TCP smithi114.front.sepia.ceph.com:36368->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 65u IPv4 176826 0t0 TCP smithi114.front.sepia.ceph.com:38950->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 66u IPv4 182135 0t0 TCP smithi114.front.sepia.ceph.com:57614->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 67u IPv4 176827 0t0 TCP smithi114.front.sepia.ceph.com:50206->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 68u IPv4 176828 0t0 TCP smithi114.front.sepia.ceph.com:41488->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 69u IPv4 176829 0t0 TCP smithi114.front.sepia.ceph.com:59760->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 70u IPv4 178901 0t0 TCP smithi114.front.sepia.ceph.com:52360->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 71u IPv4 182136 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46894 (ESTABLISHED) 2023-11-04T01:44:59.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 72u IPv4 178902 0t0 TCP smithi114.front.sepia.ceph.com:58274->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 73u IPv4 178903 0t0 TCP smithi114.front.sepia.ceph.com:49488->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 74u IPv4 182139 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59418 (ESTABLISHED) 2023-11-04T01:44:59.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 75u IPv4 182142 0t0 TCP smithi114.front.sepia.ceph.com:53312->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 76u IPv4 178904 0t0 TCP smithi114.front.sepia.ceph.com:46608->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 77u IPv4 182143 0t0 TCP smithi114.front.sepia.ceph.com:44284->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 78u IPv4 182144 0t0 TCP smithi114.front.sepia.ceph.com:41624->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 79u IPv4 182145 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35612 (ESTABLISHED) 2023-11-04T01:44:59.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 80u IPv4 178905 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36186 (ESTABLISHED) 2023-11-04T01:44:59.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 81u IPv4 182154 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36198 (ESTABLISHED) 2023-11-04T01:44:59.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 82u IPv4 182155 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36200 (ESTABLISHED) 2023-11-04T01:44:59.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 83u IPv4 182158 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35624 (ESTABLISHED) 2023-11-04T01:44:59.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 84u IPv4 182159 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35640 (ESTABLISHED) 2023-11-04T01:44:59.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 85u IPv4 180811 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46906 (ESTABLISHED) 2023-11-04T01:44:59.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 86u IPv4 180814 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59422 (ESTABLISHED) 2023-11-04T01:44:59.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 87u IPv4 176860 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi114.front.sepia.ceph.com:59430 (ESTABLISHED) 2023-11-04T01:44:59.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 88u IPv4 176863 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi114.front.sepia.ceph.com:46908 (ESTABLISHED) 2023-11-04T01:44:59.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 89u IPv4 178027 0t0 TCP smithi114.front.sepia.ceph.com:6814->smithi141.front.sepia.ceph.com:35646 (ESTABLISHED) 2023-11-04T01:44:59.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 90u IPv4 178030 0t0 TCP smithi114.front.sepia.ceph.com:6812->smithi141.front.sepia.ceph.com:36212 (ESTABLISHED) 2023-11-04T01:44:59.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 91u IPv4 178033 0t0 TCP smithi114.front.sepia.ceph.com:32884->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 92u IPv4 182184 0t0 TCP smithi114.front.sepia.ceph.com:42272->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 93u IPv4 183505 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44306 (ESTABLISHED) 2023-11-04T01:44:59.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 94u IPv4 182635 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54766 (ESTABLISHED) 2023-11-04T01:44:59.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 95u IPv4 182641 0t0 TCP smithi114.front.sepia.ceph.com:60510->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 96u IPv4 178951 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:56368 (ESTABLISHED) 2023-11-04T01:44:59.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 97u IPv4 183544 0t0 TCP smithi114.front.sepia.ceph.com:36078->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 98u IPv4 184590 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi141.front.sepia.ceph.com:44332 (ESTABLISHED) 2023-11-04T01:44:59.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 99u IPv4 178080 0t0 TCP smithi114.front.sepia.ceph.com:6810->smithi114.front.sepia.ceph.com:54786 (ESTABLISHED) 2023-11-04T01:44:59.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87835 90577 osd_srv_h root 100u IPv4 257494 0t0 TCP smithi114.front.sepia.ceph.com:6808->smithi114.front.sepia.ceph.com:38564 (ESTABLISHED) 2023-11-04T01:44:59.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 14w REG 8,1 134791826 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 14w REG 8,1 134790977 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87862 log root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 14w REG 8,1 134790977 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87864 msgr-work root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 14w REG 8,1 134790977 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87865 msgr-work root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 14w REG 8,1 134790977 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87866 msgr-work root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 14w REG 8,1 134790977 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87874 service root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 14w REG 8,1 134790977 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87875 admin_soc root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 14w REG 8,1 134790977 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87920 signal_ha root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 14w REG 8,1 134790977 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.608 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.609 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.610 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87921 io_contex root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.611 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 14w REG 8,1 134790977 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87922 io_contex root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.628 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.629 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.630 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.631 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.632 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.633 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.634 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.635 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.636 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.638 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.639 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87934 OpHistory root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87935 ceph_time root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 87992 ceph-osd root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88002 ceph-osd root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88012 ceph-osd root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88099 ceph-osd root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88107 ceph-osd root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88115 ceph-osd root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88123 ceph-osd root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88656 ceph-osd root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88672 ceph-osd root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88675 safe_time root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88677 safe_time root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88678 safe_time root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88679 safe_time root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88680 fn_anonym root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88713 rocksdb:l root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88714 rocksdb:l root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88715 rocksdb:l root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 88716 rocksdb:h root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 89991 bstore_ai root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 90804 bstore_ai root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91170 ceph-osd root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91171 cfin root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91172 bstore_kv root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 14w REG 8,1 134791260 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:44:59.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:44:59.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:44:59.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:44:59.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:44:59.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:44:59.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:44:59.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:44:59.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:44:59.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:44:59.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:44:59.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:44:59.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:44:59.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:44:59.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:44:59.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:44:59.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:44:59.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:44:59.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:44:59.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:44:59.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:44:59.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:44:59.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91173 bstore_kv root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:44:59.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:44:59.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:44:59.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:44:59.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:44:59.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:44:59.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:44:59.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:44:59.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:44:59.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:44:59.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:44:59.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:44:59.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:44:59.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:44:59.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:44:59.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:44:59.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:44:59.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:44:59.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:44:59.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:44:59.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:44:59.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:44:59.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:44:59.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:44:59.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:44:59.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root DEL REG 0,17 182120 /[aio] 2023-11-04T01:44:59.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root DEL REG 0,17 184457 /[aio] 2023-11-04T01:44:59.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:44:59.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:44:59.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:44:59.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:44:59.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:44:59.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:44:59.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:44:59.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:44:59.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:44:59.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:44:59.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:44:59.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:44:59.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:44:59.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:44:59.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:44:59.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:44:59.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:44:59.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:44:59.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:44:59.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:44:59.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:44:59.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:44:59.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:44:59.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:44:59.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:44:59.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:44:59.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:44:59.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:44:59.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:44:59.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:44:59.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:44:59.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:44:59.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:44:59.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:44:59.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:44:59.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:44:59.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:44:59.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:44:59.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:44:59.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:44:59.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:44:59.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:44:59.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:44:59.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:44:59.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:44:59.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:44:59.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:44:59.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:44:59.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:44:59.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:44:59.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:44:59.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:44:59.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:44:59.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:44:59.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:44:59.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:44:59.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:44:59.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:44:59.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:44:59.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:44:59.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:44:59.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:44:59.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:44:59.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:44:59.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:44:59.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:44:59.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:44:59.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:44:59.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:44:59.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:44:59.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:44:59.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:44:59.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:44:59.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:44:59.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:44:59.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:44:59.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:44:59.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:44:59.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:44:59.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:44:59.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:44:59.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:44:59.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:44:59.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:44:59.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:44:59.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:44:59.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:44:59.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:44:59.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:44:59.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:44:59.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:44:59.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91174 bstore_me root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91214 ms_dispat root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91215 ms_local root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91216 safe_time root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91217 safe_time root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91218 ms_dispat root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91219 ms_local root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91220 ms_dispat root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91221 ms_local root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91222 ms_dispat root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91223 ms_local root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91224 ms_dispat root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91225 ms_local root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91226 ms_dispat root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91227 ms_local root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91228 ms_dispat root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91229 ms_local root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91230 fn_anonym root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91231 finisher root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91232 safe_time root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91233 safe_time root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91234 ceph-osd root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91235 osd_srv_a root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91236 tp_osd_tp root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91237 tp_osd_tp root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91238 tp_osd_tp root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 14w REG 8,1 134791543 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91239 tp_osd_tp root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 14w REG 8,1 134791826 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91240 tp_osd_tp root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 14w REG 8,1 134791826 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91241 tp_osd_tp root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 14w REG 8,1 134791826 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91242 tp_osd_tp root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 14w REG 8,1 134791826 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91243 tp_osd_tp root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 14w REG 8,1 134791826 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91244 tp_osd_tp root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 14w REG 8,1 134791826 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91245 tp_osd_tp root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 14w REG 8,1 134791826 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91246 tp_osd_tp root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 14w REG 8,1 134791826 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91247 tp_osd_tp root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 14w REG 8,1 134791826 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91248 tp_osd_tp root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 14w REG 8,1 134791826 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91249 tp_osd_tp root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 14w REG 8,1 134791826 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91250 tp_osd_tp root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 14w REG 8,1 134791826 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91251 tp_osd_tp root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root DEL REG 0,17 182120 /[aio] 2023-11-04T01:45:00.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root DEL REG 0,17 184457 /[aio] 2023-11-04T01:45:00.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 1w FIFO 0,13 0t0 177833 pipe 2023-11-04T01:45:00.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 2w FIFO 0,13 0t0 177834 pipe 2023-11-04T01:45:00.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 3r FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 4w FIFO 0,13 0t0 177877 pipe 2023-11-04T01:45:00.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,60,67,70,79,80,84,85,86,88,91,95,97,104] 2023-11-04T01:45:00.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 6r FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 7w FIFO 0,13 0t0 177879 pipe 2023-11-04T01:45:00.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 8u a_inode 0,14 0 13316 [eventpoll:9,63,65,68,71,78,81,82,83,87,89,92,98,103] 2023-11-04T01:45:00.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 9r FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 10w FIFO 0,13 0t0 177880 pipe 2023-11-04T01:45:00.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,69,72,73,74,75,76,77,90,93,94,102] 2023-11-04T01:45:00.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 12r FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 13w FIFO 0,13 0t0 177881 pipe 2023-11-04T01:45:00.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 14w REG 8,1 134791826 405332 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:45:00.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 15uW REG 0,24 6 1764 /run/ceph/ceph-osd.3.pid 2023-11-04T01:45:00.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 16r FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 17w FIFO 0,13 0t0 180680 pipe 2023-11-04T01:45:00.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 18u unix 0xffff8d33984450c0 0t0 180681 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 19u IPv4 177901 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:45:00.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 20u IPv4 177919 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:45:00.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 21u IPv4 177938 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:45:00.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 22u IPv4 177958 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:45:00.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 23u IPv4 181904 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:45:00.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 24u IPv4 181926 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:45:00.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 25u IPv4 181949 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:45:00.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 26u IPv4 181973 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:45:00.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 27r FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 28w FIFO 0,13 0t0 180066 pipe 2023-11-04T01:45:00.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 29r FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 30w FIFO 0,13 0t0 180067 pipe 2023-11-04T01:45:00.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 31u sock 0,8 0t0 184445 protocol: UDPv6 2023-11-04T01:45:00.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:45:00.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:45:00.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:45:00.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 58r FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 59w FIFO 0,13 0t0 182596 pipe 2023-11-04T01:45:00.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 60u IPv4 180772 0t0 TCP smithi114.front.sepia.ceph.com:45146->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 61r FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 62w FIFO 0,13 0t0 182597 pipe 2023-11-04T01:45:00.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 63u IPv4 183481 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46604 (ESTABLISHED) 2023-11-04T01:45:00.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 64u IPv4 183484 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52356 (ESTABLISHED) 2023-11-04T01:45:00.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 65u IPv4 183485 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52360 (ESTABLISHED) 2023-11-04T01:45:00.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 66u IPv4 183488 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47250 (ESTABLISHED) 2023-11-04T01:45:00.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 67u IPv4 183491 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46608 (ESTABLISHED) 2023-11-04T01:45:00.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 68u IPv4 183494 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51292 (ESTABLISHED) 2023-11-04T01:45:00.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 69u IPv4 182148 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47254 (ESTABLISHED) 2023-11-04T01:45:00.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 70u IPv4 182151 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51302 (ESTABLISHED) 2023-11-04T01:45:00.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 71u IPv4 183497 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47264 (ESTABLISHED) 2023-11-04T01:45:00.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 72u IPv4 183500 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51304 (ESTABLISHED) 2023-11-04T01:45:00.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 73u IPv4 182168 0t0 TCP smithi114.front.sepia.ceph.com:53328->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 74u IPv4 182169 0t0 TCP smithi114.front.sepia.ceph.com:41654->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 75u IPv4 182170 0t0 TCP smithi114.front.sepia.ceph.com:44300->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 76u IPv4 182171 0t0 TCP smithi114.front.sepia.ceph.com:36388->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 77u IPv4 182616 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi114.front.sepia.ceph.com:52362 (ESTABLISHED) 2023-11-04T01:45:00.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 78u IPv4 176855 0t0 TCP smithi114.front.sepia.ceph.com:57634->smithi114.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 79u IPv4 182619 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi114.front.sepia.ceph.com:46614 (ESTABLISHED) 2023-11-04T01:45:00.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 80u IPv4 182622 0t0 TCP smithi114.front.sepia.ceph.com:38972->smithi114.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 81u IPv4 176856 0t0 TCP smithi114.front.sepia.ceph.com:49508->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 82u IPv4 176857 0t0 TCP smithi114.front.sepia.ceph.com:58294->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 83u IPv4 176858 0t0 TCP smithi114.front.sepia.ceph.com:51190->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 84u IPv4 182623 0t0 TCP smithi114.front.sepia.ceph.com:50222->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 85u IPv4 182624 0t0 TCP smithi114.front.sepia.ceph.com:41522->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 86u IPv4 182625 0t0 TCP smithi114.front.sepia.ceph.com:59780->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 87u IPv4 176859 0t0 TCP smithi114.front.sepia.ceph.com:46908->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 88u IPv4 182626 0t0 TCP smithi114.front.sepia.ceph.com:59430->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 89u IPv4 182172 0t0 TCP smithi114.front.sepia.ceph.com:6820->smithi141.front.sepia.ceph.com:47276 (ESTABLISHED) 2023-11-04T01:45:00.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 90u IPv4 182175 0t0 TCP smithi114.front.sepia.ceph.com:6822->smithi141.front.sepia.ceph.com:51318 (ESTABLISHED) 2023-11-04T01:45:00.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 91u IPv4 178918 0t0 TCP smithi114.front.sepia.ceph.com:32898->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 92u IPv4 176961 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:59602 (ESTABLISHED) 2023-11-04T01:45:00.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 93u IPv4 182181 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi141.front.sepia.ceph.com:57364 (ESTABLISHED) 2023-11-04T01:45:00.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 94u IPv4 176871 0t0 TCP smithi114.front.sepia.ceph.com:6818->smithi114.front.sepia.ceph.com:58156 (ESTABLISHED) 2023-11-04T01:45:00.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 95u IPv4 261167 0t0 TCP smithi114.front.sepia.ceph.com:6816->smithi114.front.sepia.ceph.com:41302 (ESTABLISHED) 2023-11-04T01:45:00.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 97u IPv4 176876 0t0 TCP smithi114.front.sepia.ceph.com:54766->smithi114.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 98u IPv4 183509 0t0 TCP smithi114.front.sepia.ceph.com:60500->smithi114.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 102u IPv4 184528 0t0 TCP smithi114.front.sepia.ceph.com:42252->smithi141.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:45:00.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 103u IPv4 183510 0t0 TCP smithi114.front.sepia.ceph.com:36044->smithi141.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:45:00.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87836 91252 osd_srv_h root 104u IPv4 176882 0t0 TCP smithi114.front.sepia.ceph.com:60328->smithi141.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:45:00.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 14w REG 8,1 123734431 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87878 log root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 14w REG 8,1 123734714 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87880 msgr-work root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 14w REG 8,1 123734714 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87881 msgr-work root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 14w REG 8,1 123734714 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.602 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.603 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.604 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87882 msgr-work root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.605 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.606 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.607 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 14w REG 8,1 123734714 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87886 service root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 14w REG 8,1 123734714 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87887 admin_soc root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 14w REG 8,1 123734714 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87924 signal_ha root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 14w REG 8,1 123734714 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87925 io_contex root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 14w REG 8,1 123734714 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87926 io_contex root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 14w REG 8,1 123734714 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87937 OpHistory root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 14w REG 8,1 123734714 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87938 ceph_time root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 14w REG 8,1 123734714 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 87994 ceph-osd root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 14w REG 8,1 123734714 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88004 ceph-osd root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 14w REG 8,1 123734714 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88010 ceph-osd root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 14w REG 8,1 123734714 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.793 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.794 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88097 ceph-osd root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.795 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.796 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.797 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.798 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 14w REG 8,1 123734714 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88105 ceph-osd root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 14w REG 8,1 123734714 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88113 ceph-osd root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.828 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 14w REG 8,1 123737342 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88121 ceph-osd root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 14w REG 8,1 123737342 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88511 ceph-osd root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 14w REG 8,1 123737342 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88512 ceph-osd root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 14w REG 8,1 123737342 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88513 safe_time root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 14w REG 8,1 123737342 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88514 safe_time root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.893 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.894 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.895 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.896 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.897 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 14w REG 8,1 123737342 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.898 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.899 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.900 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.901 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.902 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.903 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.904 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88515 safe_time root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 14w REG 8,1 123737342 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88516 safe_time root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 14w REG 8,1 123737342 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88517 fn_anonym root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 14w REG 8,1 123737342 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88520 rocksdb:l root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 14w REG 8,1 123737342 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88521 rocksdb:l root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88522 rocksdb:l root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:00.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:00.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:00.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:00.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:00.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:00.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:00.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:00.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:00.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:00.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:00.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:00.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:00.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:00.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:00.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:00.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:00.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:00.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:00.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:00.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:00.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:00.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:00.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:00.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:00.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:00.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:00.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:00.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:00.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:00.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:00.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:00.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:00.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 88523 rocksdb:h root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:00.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:00.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:00.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:00.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:00.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:00.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:00.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:00.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:00.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:00.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:00.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:00.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:00.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:00.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:00.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:00.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:00.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:00.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:00.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:00.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:00.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:00.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:00.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:00.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:00.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:00.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:00.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:00.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:00.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:00.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:00.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:00.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:00.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:00.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:00.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:00.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:00.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:00.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:00.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:00.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:00.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:00.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:00.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:00.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:00.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:00.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:00.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:00.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:00.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:00.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:00.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:00.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:00.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:00.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:00.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:00.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:00.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:00.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:00.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:00.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:00.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:00.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:00.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:00.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:00.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:00.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:00.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:00.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:00.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:00.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:00.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:00.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:00.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:00.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:00.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:00.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:00.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:00.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:00.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:00.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:00.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:00.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:00.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:00.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:00.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:00.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:00.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:00.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:00.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:00.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:00.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:00.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:00.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:00.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:00.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:00.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:00.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:00.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:00.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:00.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:00.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:00.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:00.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:00.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:00.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:00.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:00.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:00.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:00.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 89989 bstore_ai root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 90803 bstore_ai root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91165 ceph-osd root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91166 cfin root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.046 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.047 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.048 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.049 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.050 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.051 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.052 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.053 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.054 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.055 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.056 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.057 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91167 bstore_kv root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.058 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.059 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.060 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.061 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.062 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.063 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.064 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.065 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.066 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.067 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.068 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.069 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.070 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.071 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91168 bstore_kv root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.072 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.073 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.074 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.075 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.076 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.079 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.080 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.081 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.082 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.083 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.084 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91169 bstore_me root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.085 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.086 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.087 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.088 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.089 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.090 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.091 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.092 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.093 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.094 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.095 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.096 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.097 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.098 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.099 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91175 ms_dispat root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.100 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.101 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.102 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.103 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.104 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.105 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.106 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.107 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.109 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.111 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91176 ms_local root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.113 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.114 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.116 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.117 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.118 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.119 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.120 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.121 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.122 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.123 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.124 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.125 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91177 safe_time root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.126 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.127 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.128 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.129 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.130 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.131 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.132 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.133 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.134 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.135 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.136 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.137 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.138 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.139 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91178 safe_time root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.140 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.141 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.142 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.143 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.144 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.145 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.146 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.147 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.148 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.149 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.150 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.152 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.153 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91179 ms_dispat root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.154 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.155 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.156 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.157 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.158 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.159 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.160 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.161 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.162 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.163 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.164 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.165 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.166 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91180 ms_local root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.168 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.169 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.170 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.171 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.172 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.174 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.175 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.177 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.179 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.180 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91181 ms_dispat root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.182 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.183 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.185 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.186 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.190 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.191 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.192 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.193 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.194 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.195 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91182 ms_local root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.196 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.197 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.198 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.199 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.200 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.201 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.202 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.203 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.204 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.205 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.206 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.207 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.208 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.209 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91183 ms_dispat root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.210 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.211 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.212 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.213 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.214 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.215 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.216 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.217 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.219 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.220 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.222 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.223 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91184 ms_local root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.224 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.225 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.226 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.227 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.228 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.229 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.234 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.235 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.236 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91185 ms_dispat root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.244 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.245 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.246 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.248 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.249 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91186 ms_local root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.250 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.251 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.252 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.253 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.254 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.255 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.256 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 14w REG 8,1 123737625 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.257 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.258 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.260 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.261 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.262 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91187 ms_dispat root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.263 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.264 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.265 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.266 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.267 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.268 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.269 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 14w REG 8,1 123745198 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.270 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.271 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.272 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.273 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.274 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.275 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91188 ms_local root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.276 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.277 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.278 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.279 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.280 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.281 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 14w REG 8,1 123745198 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.283 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.284 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.285 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.286 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.287 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.288 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91189 ms_dispat root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.289 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.290 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.291 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.292 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.293 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.294 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.295 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 14w REG 8,1 123745198 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.296 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.297 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.298 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.299 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.300 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.301 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91190 ms_local root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.302 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.303 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.304 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.305 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.306 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.307 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.308 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 14w REG 8,1 123745198 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.309 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.310 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.311 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.312 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.313 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.314 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.315 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91191 fn_anonym root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.316 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.317 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.318 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.319 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.320 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.321 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.322 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.324 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.325 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.326 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.327 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.328 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.329 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91192 finisher root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.330 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.331 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.332 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.333 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.334 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.335 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.336 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.337 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.338 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.339 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.340 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.341 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.342 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91193 safe_time root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.347 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.348 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.349 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.350 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.351 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.352 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.354 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.355 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91194 safe_time root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.356 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.357 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.358 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.359 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.360 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.361 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.362 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.363 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.364 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.365 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.366 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.368 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91195 ceph-osd root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.369 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.370 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.371 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.372 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.373 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.374 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.375 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.376 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.377 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.378 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.380 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.381 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.382 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91196 osd_srv_a root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.383 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.384 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.385 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.387 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.388 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.389 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.390 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.391 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.392 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.393 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.394 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.395 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91197 tp_osd_tp root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.396 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.397 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.398 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.399 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.400 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.401 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.402 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.403 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.404 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.405 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.406 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.407 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91198 tp_osd_tp root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.408 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.409 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.410 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.411 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.412 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.413 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.414 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.415 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.416 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.417 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.418 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.419 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.420 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91199 tp_osd_tp root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.421 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.422 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.423 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.424 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.425 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.426 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.427 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.428 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.429 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.430 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.431 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.432 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.433 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91200 tp_osd_tp root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.434 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.435 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.436 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.437 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.438 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.439 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.440 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.441 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.442 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.446 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91201 tp_osd_tp root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.447 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.448 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.452 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.453 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.454 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.455 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.457 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.458 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.459 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91202 tp_osd_tp root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.460 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.461 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.464 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.465 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.466 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.467 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.468 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.469 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.470 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.471 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.472 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91203 tp_osd_tp root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.473 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.474 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.475 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.476 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.477 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.478 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.479 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.480 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.481 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.482 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.483 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.484 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91204 tp_osd_tp root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.485 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.486 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.487 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.488 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.489 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.490 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.495 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.496 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91205 tp_osd_tp root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.501 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.502 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.503 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.504 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.505 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.506 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.507 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.508 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.509 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.510 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91206 tp_osd_tp root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.511 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.512 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.513 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.514 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.515 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.516 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.517 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.518 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.519 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.520 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.521 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.522 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.523 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91207 tp_osd_tp root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.524 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.527 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.528 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.529 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.530 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.531 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.532 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.533 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.534 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.535 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91208 tp_osd_tp root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.536 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.537 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.538 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.539 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.540 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.541 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.542 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.543 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.545 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.546 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.547 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.548 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91209 tp_osd_tp root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.549 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.550 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.551 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.552 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.553 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.554 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.555 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.557 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.558 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.559 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.560 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91210 tp_osd_tp root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.561 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.562 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.563 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.564 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.565 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.566 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.568 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.569 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.570 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.571 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.572 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.573 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91211 tp_osd_tp root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.574 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.575 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.576 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.577 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.578 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.579 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.580 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.581 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.582 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.583 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.584 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.585 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.586 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91212 tp_osd_tp root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root txt REG 8,1 25615776 3093 /usr/bin/ceph-osd 2023-11-04T01:45:01.587 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 74496 402197 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:45:01.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 116440 402224 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:45:01.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 128888 402176 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:45:01.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 91248 402212 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:45:01.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 83008 402194 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:45:01.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 49424 402200 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:45:01.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 1350912 402221 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:45:01.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 224600 402188 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:45:01.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 864280 402218 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:45:01.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 45176 402233 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:45:01.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 65968 402236 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:45:01.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 74936 402179 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:45:01.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 41168 402182 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:45:01.588 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 36976 402239 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:45:01.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 70536 402185 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:45:01.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 69736 2466 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:45:01.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 70424 402209 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:45:01.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 409304 402215 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:45:01.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 37064 402191 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:45:01.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 32512 402206 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:45:01.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 32664 402147 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:45:01.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root DEL REG 0,17 178882 /[aio] 2023-11-04T01:45:01.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root DEL REG 0,17 178879 /[aio] 2023-11-04T01:45:01.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 1469128 402166 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:45:01.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 353384 402162 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:45:01.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 74672 402172 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:45:01.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.589 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.590 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.591 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.592 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:45:01.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:45:01.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:45:01.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 1w FIFO 0,13 0t0 180638 pipe 2023-11-04T01:45:01.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 2w FIFO 0,13 0t0 180639 pipe 2023-11-04T01:45:01.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 3r FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 4w FIFO 0,13 0t0 180050 pipe 2023-11-04T01:45:01.593 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,21,22,23,24,25,26,59,65,68,72,77,79,82,85,88,91,94,97,98] 2023-11-04T01:45:01.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 6r FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 7w FIFO 0,13 0t0 180052 pipe 2023-11-04T01:45:01.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 8u a_inode 0,14 0 13316 [eventpoll:9,63,67,69,71,75,78,80,83,86,89,92,95,100] 2023-11-04T01:45:01.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 9r FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 10w FIFO 0,13 0t0 180053 pipe 2023-11-04T01:45:01.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 11u a_inode 0,14 0 13316 [eventpoll:12,64,66,70,73,74,76,81,84,87,90,93,96,101] 2023-11-04T01:45:01.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 12r FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 13w FIFO 0,13 0t0 180054 pipe 2023-11-04T01:45:01.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 14w REG 8,1 123745481 405331 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:45:01.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 15uW REG 0,24 6 1766 /run/ceph/ceph-osd.2.pid 2023-11-04T01:45:01.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 16r FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 17w FIFO 0,13 0t0 169981 pipe 2023-11-04T01:45:01.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 18u unix 0xffff8d3398050000 0t0 169982 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.594 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 19u IPv4 180093 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:45:01.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 20u IPv4 180119 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:45:01.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 21u IPv4 180146 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:45:01.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 22u IPv4 180174 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:45:01.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 23u IPv4 180203 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:45:01.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 24u IPv4 184329 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:45:01.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 25u IPv4 184360 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:45:01.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 26u IPv4 184392 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:45:01.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 27r FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 28w FIFO 0,13 0t0 181977 pipe 2023-11-04T01:45:01.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 29r FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 30w FIFO 0,13 0t0 181978 pipe 2023-11-04T01:45:01.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 31u sock 0,8 0t0 183445 protocol: UDPv6 2023-11-04T01:45:01.595 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:45:01.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:45:01.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.596 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:45:01.597 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 58r FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 59u IPv4 176803 0t0 TCP smithi114.front.sepia.ceph.com:45144->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 60w FIFO 0,13 0t0 176806 pipe 2023-11-04T01:45:01.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 61r FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 62w FIFO 0,13 0t0 176807 pipe 2023-11-04T01:45:01.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 63u IPv4 178018 0t0 TCP smithi114.front.sepia.ceph.com:59418->smithi114.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 64u IPv4 182610 0t0 TCP smithi114.front.sepia.ceph.com:46894->smithi114.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 65u IPv4 184492 0t0 TCP smithi114.front.sepia.ceph.com:44274->smithi141.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:45:01.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 66u IPv4 182611 0t0 TCP smithi114.front.sepia.ceph.com:46604->smithi114.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 67u IPv4 178019 0t0 TCP smithi114.front.sepia.ceph.com:52356->smithi114.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 68u IPv4 184493 0t0 TCP smithi114.front.sepia.ceph.com:50198->smithi141.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 69u IPv4 184494 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38950 (ESTABLISHED) 2023-11-04T01:45:01.598 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 70u IPv4 182612 0t0 TCP smithi114.front.sepia.ceph.com:53296->smithi141.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 71u IPv4 178020 0t0 TCP smithi114.front.sepia.ceph.com:59746->smithi141.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:45:01.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 72u IPv4 184497 0t0 TCP smithi114.front.sepia.ceph.com:49476->smithi141.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:45:01.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 73u IPv4 182613 0t0 TCP smithi114.front.sepia.ceph.com:58268->smithi141.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:45:01.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 74u IPv4 182614 0t0 TCP smithi114.front.sepia.ceph.com:41616->smithi141.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:45:01.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 75u IPv4 178021 0t0 TCP smithi114.front.sepia.ceph.com:41490->smithi141.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:45:01.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 76u IPv4 182615 0t0 TCP smithi114.front.sepia.ceph.com:36384->smithi114.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:45:01.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 77u IPv4 184498 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57614 (ESTABLISHED) 2023-11-04T01:45:01.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 78u IPv4 178022 0t0 TCP smithi114.front.sepia.ceph.com:51186->smithi114.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:45:01.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 79u IPv4 184501 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53174 (ESTABLISHED) 2023-11-04T01:45:01.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 80u IPv4 184504 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43060 (ESTABLISHED) 2023-11-04T01:45:01.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 81u IPv4 184507 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53178 (ESTABLISHED) 2023-11-04T01:45:01.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 82u IPv4 184510 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43062 (ESTABLISHED) 2023-11-04T01:45:01.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 83u IPv4 182162 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43070 (ESTABLISHED) 2023-11-04T01:45:01.599 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 84u IPv4 182165 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53182 (ESTABLISHED) 2023-11-04T01:45:01.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 85u IPv4 180817 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57630 (ESTABLISHED) 2023-11-04T01:45:01.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 86u IPv4 180820 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38966 (ESTABLISHED) 2023-11-04T01:45:01.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 87u IPv4 180823 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi114.front.sepia.ceph.com:57634 (ESTABLISHED) 2023-11-04T01:45:01.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 88u IPv4 180826 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi114.front.sepia.ceph.com:38972 (ESTABLISHED) 2023-11-04T01:45:01.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 89u IPv4 180829 0t0 TCP smithi114.front.sepia.ceph.com:6830->smithi141.front.sepia.ceph.com:53188 (ESTABLISHED) 2023-11-04T01:45:01.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 90u IPv4 176866 0t0 TCP smithi114.front.sepia.ceph.com:6828->smithi141.front.sepia.ceph.com:43072 (ESTABLISHED) 2023-11-04T01:45:01.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 91u IPv4 178917 0t0 TCP smithi114.front.sepia.ceph.com:32890->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 92u IPv4 184561 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:44186 (ESTABLISHED) 2023-11-04T01:45:01.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 93u IPv4 180841 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45030 (ESTABLISHED) 2023-11-04T01:45:01.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 94u IPv4 180847 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60500 (ESTABLISHED) 2023-11-04T01:45:01.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 95u IPv4 182638 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45032 (ESTABLISHED) 2023-11-04T01:45:01.600 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 96u IPv4 178034 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60508 (ESTABLISHED) 2023-11-04T01:45:01.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 97u IPv4 178035 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi114.front.sepia.ceph.com:60510 (ESTABLISHED) 2023-11-04T01:45:01.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 98u IPv4 254620 0t0 TCP smithi114.front.sepia.ceph.com:6824->smithi114.front.sepia.ceph.com:38724 (ESTABLISHED) 2023-11-04T01:45:01.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 100u IPv4 178922 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:45048 (ESTABLISHED) 2023-11-04T01:45:01.601 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-osd 87850 91213 osd_srv_h root 101u IPv4 178923 0t0 TCP smithi114.front.sepia.ceph.com:6826->smithi141.front.sepia.ceph.com:invision-ag (ESTABLISHED) 2023-11-04T01:45:01.601 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/5 91531 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.601 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/5 91531 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.601 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/5 91531 root txt unknown /proc/91531/exe 2023-11-04T01:45:01.601 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/5 91621 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.601 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/5 91621 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.601 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/5 91621 root txt unknown /proc/91621/exe 2023-11-04T01:45:01.601 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/6 91681 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.601 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/6 91681 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.601 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/6 91681 root txt unknown /proc/91681/exe 2023-11-04T01:45:01.602 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/1 91721 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.602 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/1 91721 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.602 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/1 91721 root txt unknown /proc/91721/exe 2023-11-04T01:45:01.602 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/1 91814 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.602 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/1 91814 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.602 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/1 91814 root txt unknown /proc/91814/exe 2023-11-04T01:45:01.602 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/6 91885 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.602 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/6 91885 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.602 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/6 91885 root txt unknown /proc/91885/exe 2023-11-04T01:45:01.602 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 92518 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.602 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 92518 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.602 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 92518 root txt unknown /proc/92518/exe 2023-11-04T01:45:01.602 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 92604 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.603 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 92604 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.603 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 92604 root txt unknown /proc/92604/exe 2023-11-04T01:45:01.603 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 92681 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.603 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 92681 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.603 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 92681 root txt unknown /proc/92681/exe 2023-11-04T01:45:01.603 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/4 92862 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.603 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/4 92862 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.603 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/4 92862 root txt unknown /proc/92862/exe 2023-11-04T01:45:01.603 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/4 92871 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.603 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/4 92871 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.603 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/4 92871 root txt unknown /proc/92871/exe 2023-11-04T01:45:01.603 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/0 93112 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.603 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/0 93112 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.604 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/0 93112 root txt unknown /proc/93112/exe 2023-11-04T01:45:01.604 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/0 93114 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.604 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/0 93114 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.604 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/0 93114 root txt unknown /proc/93114/exe 2023-11-04T01:45:01.604 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/2 93554 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.604 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/2 93554 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.604 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/2 93554 root txt unknown /proc/93554/exe 2023-11-04T01:45:01.604 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/2 93563 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.604 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/2 93563 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.604 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/2 93563 root txt unknown /proc/93563/exe 2023-11-04T01:45:01.604 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 120637 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.604 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 120637 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.604 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/u 120637 root txt unknown /proc/120637/exe 2023-11-04T01:45:01.604 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/4 120976 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.604 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/4 120976 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.605 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/4 120976 root txt unknown /proc/120976/exe 2023-11-04T01:45:01.605 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/1 124825 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.605 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/1 124825 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.605 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/1 124825 root txt unknown /proc/124825/exe 2023-11-04T01:45:01.605 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/6 124826 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.605 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/6 124826 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.605 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/6 124826 root txt unknown /proc/124826/exe 2023-11-04T01:45:01.605 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.605 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.605 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:45:01.605 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:45:01.605 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:45:01.605 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.606 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:45:01.606 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.606 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:45:01.606 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:45:01.606 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:45:01.606 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:45:01.606 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:45:01.606 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:45:01.606 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:45:01.606 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:45:01.606 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:45:01.606 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:45:01.606 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.607 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.607 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.607 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.607 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.607 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.607 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.607 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.607 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:45:01.607 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.607 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.607 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.607 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.607 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.607 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.608 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:45:01.608 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.608 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:45:01.608 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:45:01.608 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.608 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.608 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:45:01.608 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:45:01.608 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:45:01.608 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:45:01.608 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:45:01.608 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:45:01.608 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:45:01.608 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:45:01.608 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:45:01.609 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:45:01.609 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:45:01.609 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:45:01.609 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.609 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:45:01.609 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:45:01.609 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.609 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:45:01.609 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:45:01.609 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.609 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:45:01.609 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root 0r FIFO 0,13 0t0 253362 pipe 2023-11-04T01:45:01.609 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.610 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.610 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root 3r FIFO 0,13 0t0 252576 pipe 2023-11-04T01:45:01.610 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root 4w FIFO 0,13 0t0 252576 pipe 2023-11-04T01:45:01.610 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root 5u netlink 0t0 252581 AUDIT 2023-11-04T01:45:01.610 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 125127 root 6u unix 0xffff8d339b157700 0t0 252582 type=DGRAM (CONNECTED) 2023-11-04T01:45:01.610 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.610 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.610 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:45:01.610 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:45:01.610 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:45:01.610 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.610 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.610 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.610 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.611 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.611 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.611 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.611 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:45:01.611 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.611 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:45:01.611 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.611 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.611 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.611 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.611 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.611 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:45:01.611 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.612 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root 0r FIFO 0,13 0t0 253362 pipe 2023-11-04T01:45:01.612 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.612 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 125162 root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.612 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.613 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.614 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.615 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.616 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.617 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.618 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.619 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.621 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.622 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.623 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125168 log root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.624 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.625 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.640 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.641 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.643 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125170 msgr-work root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.644 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.645 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.646 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.647 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.648 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.649 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125171 msgr-work root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.651 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.652 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.653 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.654 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.655 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.656 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125172 msgr-work root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.657 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.658 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.659 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.660 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.661 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.662 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125176 service root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.663 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.664 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.666 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.667 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.668 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.669 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125177 admin_soc root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.670 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.672 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.673 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.674 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.675 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.676 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125178 signal_ha root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.677 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.679 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.680 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.681 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.682 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125179 io_contex root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.683 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.684 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.685 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.686 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.687 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.688 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.689 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125180 io_contex root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.690 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.691 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.692 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.693 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.694 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.695 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125181 ms_dispat root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.696 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.697 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.698 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.699 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.700 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.701 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.702 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125182 ms_local root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.705 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.706 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.707 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.708 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125183 safe_time root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.709 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.710 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.713 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.715 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125184 safe_time root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.716 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.717 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.718 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.719 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.720 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.721 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.722 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125185 ceph-mds root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.723 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.724 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.725 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.726 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.727 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.728 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 125208 safe_time root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.729 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.730 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.731 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.732 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.733 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.734 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126966 ceph_time root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.737 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.741 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126967 OpHistory root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.742 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126968 ms_dispat root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126969 mds_rank_ root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.754 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.755 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.756 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.757 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.759 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.760 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126970 PQ_Finish root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.761 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.762 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.763 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.764 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.765 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.766 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126971 safe_time root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.767 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.768 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.769 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.771 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.772 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126972 MR_Finish root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.773 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.774 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.775 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.776 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.777 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.778 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.779 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 126974 md_submit root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.780 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.781 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.782 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.783 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.784 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.785 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127559 ms_dispat root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.786 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.787 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.788 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 1w FIFO 0,13 0t0 253363 pipe 2023-11-04T01:45:01.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 2w FIFO 0,13 0t0 253364 pipe 2023-11-04T01:45:01.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 3r FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 4w FIFO 0,13 0t0 254145 pipe 2023-11-04T01:45:01.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27,34,37] 2023-11-04T01:45:01.789 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 6r FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 7w FIFO 0,13 0t0 254147 pipe 2023-11-04T01:45:01.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,30,32,35] 2023-11-04T01:45:01.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 9r FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 10w FIFO 0,13 0t0 254148 pipe 2023-11-04T01:45:01.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12,31,33,36,39] 2023-11-04T01:45:01.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 12r FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 13w FIFO 0,13 0t0 254149 pipe 2023-11-04T01:45:01.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 14w REG 8,1 5817967 405620 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:45:01.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 15uW REG 0,24 7 2419 /run/ceph/ceph-mds.c.pid 2023-11-04T01:45:01.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 16r FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 17w FIFO 0,13 0t0 255104 pipe 2023-11-04T01:45:01.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 18u unix 0xffff8d3387e59100 0t0 255105 /var/run/ceph/ceph-mds.c.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.790 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 19u IPv4 252627 0t0 TCP *:6836 (LISTEN) 2023-11-04T01:45:01.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 20u IPv4 252665 0t0 TCP *:6837 (LISTEN) 2023-11-04T01:45:01.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 21r FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 22w FIFO 0,13 0t0 255107 pipe 2023-11-04T01:45:01.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 23r FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 24w FIFO 0,13 0t0 255108 pipe 2023-11-04T01:45:01.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 25r FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 26w FIFO 0,13 0t0 254157 pipe 2023-11-04T01:45:01.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 27u IPv4 252666 0t0 TCP smithi114.front.sepia.ceph.com:38582->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 28r FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 29w FIFO 0,13 0t0 254158 pipe 2023-11-04T01:45:01.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 30u IPv4 246735 0t0 TCP smithi114.front.sepia.ceph.com:60866->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 31u IPv4 261162 0t0 TCP smithi114.front.sepia.ceph.com:38564->smithi114.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 32u IPv4 258544 0t0 TCP smithi114.front.sepia.ceph.com:57334->smithi114.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:45:01.791 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 33u IPv4 261163 0t0 TCP smithi114.front.sepia.ceph.com:59160->smithi141.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:45:01.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 34u IPv4 255637 0t0 TCP smithi114.front.sepia.ceph.com:38724->smithi114.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 35u IPv4 257497 0t0 TCP smithi114.front.sepia.ceph.com:40308->smithi141.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:45:01.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 36u IPv4 261166 0t0 TCP smithi114.front.sepia.ceph.com:41302->smithi114.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:45:01.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 37u IPv4 256511 0t0 TCP smithi114.front.sepia.ceph.com:51742->smithi141.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:45:01.792 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 125167 127560 ms_dispat root 39u IPv4 257817 0t0 TCP smithi114.front.sepia.ceph.com:6836->192.168.0.1:36336 (ESTABLISHED) 2023-11-04T01:45:01.792 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 126922 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.792 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 126922 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.792 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 126922 root txt unknown /proc/126922/exe 2023-11-04T01:45:01.792 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 126923 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:01.792 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 126923 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.792 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/7 126923 root txt unknown /proc/126923/exe 2023-11-04T01:45:01.792 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.792 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.792 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:45:01.792 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:45:01.793 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:45:01.793 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.793 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:45:01.793 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.793 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:45:01.793 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:45:01.793 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:45:01.793 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:45:01.793 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:45:01.793 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:45:01.793 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:45:01.793 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:45:01.793 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:45:01.793 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:45:01.793 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.794 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.794 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.794 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.794 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.794 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.794 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.794 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.794 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.794 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.794 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:45:01.794 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:45:01.794 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.794 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.795 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.795 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.795 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.795 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.795 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:45:01.795 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.795 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:45:01.795 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:45:01.795 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:45:01.795 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:45:01.795 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:45:01.795 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:45:01.795 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:45:01.795 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:45:01.796 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:45:01.796 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:45:01.796 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:45:01.796 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:45:01.796 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:45:01.796 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.796 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:45:01.796 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:45:01.796 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.796 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:45:01.796 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:45:01.796 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.796 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:45:01.796 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root 0r FIFO 0,13 0t0 255684 pipe 2023-11-04T01:45:01.796 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.797 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.797 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root 3r FIFO 0,13 0t0 255697 pipe 2023-11-04T01:45:01.797 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root 4w FIFO 0,13 0t0 255697 pipe 2023-11-04T01:45:01.797 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root 5u netlink 0t0 255702 AUDIT 2023-11-04T01:45:01.797 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 127268 root 6u unix 0xffff8d3387e672c0 0t0 255703 type=DGRAM (CONNECTED) 2023-11-04T01:45:01.797 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.797 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.797 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:45:01.797 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:45:01.797 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:45:01.797 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.797 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.797 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.797 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.797 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.798 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.798 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.798 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.798 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.798 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.798 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:45:01.798 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.798 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.798 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:45:01.798 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.798 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:45:01.798 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.798 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root 0r FIFO 0,13 0t0 255684 pipe 2023-11-04T01:45:01.799 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.799 INFO:teuthology.orchestra.run.smithi114.stdout:daemon-he 127302 root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.799 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.800 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.801 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 3r FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 4w FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27] 2023-11-04T01:45:01.802 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 6r FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 7w FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 8u a_inode 0,14 0 13316 [eventpoll:9,30] 2023-11-04T01:45:01.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 9r FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 10w FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 11u a_inode 0,14 0 13316 [eventpoll:12] 2023-11-04T01:45:01.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 12r FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 13w FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 14w REG 8,1 3853423 405619 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:45:01.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 15uW REG 0,24 7 2458 /run/ceph/ceph-mds.a.pid 2023-11-04T01:45:01.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 16r FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 17w FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 18u unix 0xffff8d3398198000 0t0 254745 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.803 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 19u IPv4 258645 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:45:01.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 20u IPv4 258681 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:45:01.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 21r FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 22w FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 23r FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 24w FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 25r FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 26w FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 27u IPv4 258682 0t0 TCP smithi114.front.sepia.ceph.com:55640->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 28r FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 29w FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 root 30u IPv4 259534 0t0 TCP smithi114.front.sepia.ceph.com:59308->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.804 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.806 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.807 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 3r FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 4w FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27] 2023-11-04T01:45:01.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 6r FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 7w FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.808 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 8u a_inode 0,14 0 13316 [eventpoll:9,30] 2023-11-04T01:45:01.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 9r FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 10w FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 11u a_inode 0,14 0 13316 [eventpoll:12] 2023-11-04T01:45:01.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 12r FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 13w FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 14w REG 8,1 3853423 405619 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:45:01.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 15uW REG 0,24 7 2458 /run/ceph/ceph-mds.a.pid 2023-11-04T01:45:01.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 16r FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 17w FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 18u unix 0xffff8d3398198000 0t0 254745 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 19u IPv4 258645 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:45:01.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 20u IPv4 258681 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:45:01.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 21r FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 22w FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.809 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 23r FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 24w FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 25r FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 26w FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 27u IPv4 258682 0t0 TCP smithi114.front.sepia.ceph.com:55640->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 28r FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 29w FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127308 log root 30u IPv4 259534 0t0 TCP smithi114.front.sepia.ceph.com:59308->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.810 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.811 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.812 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.813 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 3r FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 4w FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27] 2023-11-04T01:45:01.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 6r FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 7w FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,30] 2023-11-04T01:45:01.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 9r FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 10w FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12] 2023-11-04T01:45:01.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 12r FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 13w FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.814 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 14w REG 8,1 3853423 405619 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:45:01.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 15uW REG 0,24 7 2458 /run/ceph/ceph-mds.a.pid 2023-11-04T01:45:01.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 16r FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 17w FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 18u unix 0xffff8d3398198000 0t0 254745 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 19u IPv4 258645 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:45:01.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 20u IPv4 258681 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:45:01.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 21r FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 22w FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 23r FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 24w FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 25r FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 26w FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 27u IPv4 258682 0t0 TCP smithi114.front.sepia.ceph.com:55640->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 28r FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.815 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 29w FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127310 msgr-work root 30u IPv4 259534 0t0 TCP smithi114.front.sepia.ceph.com:59308->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.816 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.817 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.818 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.819 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 3r FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 4w FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27] 2023-11-04T01:45:01.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 6r FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 7w FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,30] 2023-11-04T01:45:01.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 9r FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 10w FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12] 2023-11-04T01:45:01.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 12r FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 13w FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 14w REG 8,1 3853423 405619 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:45:01.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 15uW REG 0,24 7 2458 /run/ceph/ceph-mds.a.pid 2023-11-04T01:45:01.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 16r FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 17w FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.820 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 18u unix 0xffff8d3398198000 0t0 254745 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 19u IPv4 258645 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:45:01.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 20u IPv4 258681 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:45:01.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 21r FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 22w FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 23r FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 24w FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 25r FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 26w FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 27u IPv4 258682 0t0 TCP smithi114.front.sepia.ceph.com:55640->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 28r FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 29w FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127311 msgr-work root 30u IPv4 259534 0t0 TCP smithi114.front.sepia.ceph.com:59308->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.821 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.822 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.823 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.824 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 3r FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 4w FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27] 2023-11-04T01:45:01.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 6r FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 7w FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.825 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 8u a_inode 0,14 0 13316 [eventpoll:9,30] 2023-11-04T01:45:01.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 9r FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 10w FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 11u a_inode 0,14 0 13316 [eventpoll:12] 2023-11-04T01:45:01.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 12r FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 13w FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 14w REG 8,1 3853423 405619 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:45:01.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 15uW REG 0,24 7 2458 /run/ceph/ceph-mds.a.pid 2023-11-04T01:45:01.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 16r FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 17w FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 18u unix 0xffff8d3398198000 0t0 254745 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 19u IPv4 258645 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:45:01.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 20u IPv4 258681 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:45:01.826 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 21r FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 22w FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 23r FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 24w FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 25r FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 26w FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.827 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 27u IPv4 258682 0t0 TCP smithi114.front.sepia.ceph.com:55640->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 28r FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 29w FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127312 msgr-work root 30u IPv4 259534 0t0 TCP smithi114.front.sepia.ceph.com:59308->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.829 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.830 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.831 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.832 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 3r FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 4w FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27] 2023-11-04T01:45:01.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 6r FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 7w FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 8u a_inode 0,14 0 13316 [eventpoll:9,30] 2023-11-04T01:45:01.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 9r FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.833 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 10w FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 11u a_inode 0,14 0 13316 [eventpoll:12] 2023-11-04T01:45:01.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 12r FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 13w FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 14w REG 8,1 3853423 405619 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:45:01.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 15uW REG 0,24 7 2458 /run/ceph/ceph-mds.a.pid 2023-11-04T01:45:01.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 16r FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 17w FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 18u unix 0xffff8d3398198000 0t0 254745 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 19u IPv4 258645 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:45:01.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 20u IPv4 258681 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:45:01.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 21r FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.834 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 22w FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 23r FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 24w FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 25r FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 26w FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 27u IPv4 258682 0t0 TCP smithi114.front.sepia.ceph.com:55640->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 28r FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 29w FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127316 service root 30u IPv4 259534 0t0 TCP smithi114.front.sepia.ceph.com:59308->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.835 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.836 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.837 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.838 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 3r FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 4w FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27] 2023-11-04T01:45:01.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 6r FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 7w FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 8u a_inode 0,14 0 13316 [eventpoll:9,30] 2023-11-04T01:45:01.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 9r FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.839 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 10w FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 11u a_inode 0,14 0 13316 [eventpoll:12] 2023-11-04T01:45:01.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 12r FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 13w FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 14w REG 8,1 3853423 405619 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:45:01.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 15uW REG 0,24 7 2458 /run/ceph/ceph-mds.a.pid 2023-11-04T01:45:01.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 16r FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 17w FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 18u unix 0xffff8d3398198000 0t0 254745 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 19u IPv4 258645 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:45:01.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 20u IPv4 258681 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:45:01.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 21r FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 22w FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 23r FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.840 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 24w FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 25r FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 26w FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 27u IPv4 258682 0t0 TCP smithi114.front.sepia.ceph.com:55640->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 28r FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 29w FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127317 admin_soc root 30u IPv4 259534 0t0 TCP smithi114.front.sepia.ceph.com:59308->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.841 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.842 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.843 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 3r FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 4w FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27] 2023-11-04T01:45:01.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 6r FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 7w FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 8u a_inode 0,14 0 13316 [eventpoll:9,30] 2023-11-04T01:45:01.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 9r FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 10w FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 11u a_inode 0,14 0 13316 [eventpoll:12] 2023-11-04T01:45:01.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 12r FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 13w FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 14w REG 8,1 3853423 405619 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:45:01.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 15uW REG 0,24 7 2458 /run/ceph/ceph-mds.a.pid 2023-11-04T01:45:01.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 16r FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 17w FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 18u unix 0xffff8d3398198000 0t0 254745 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 19u IPv4 258645 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:45:01.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 20u IPv4 258681 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:45:01.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 21r FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 22w FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 23r FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 24w FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 25r FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.846 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 26w FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 27u IPv4 258682 0t0 TCP smithi114.front.sepia.ceph.com:55640->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 28r FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 29w FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127318 signal_ha root 30u IPv4 259534 0t0 TCP smithi114.front.sepia.ceph.com:59308->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.847 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.848 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.849 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.850 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 3r FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 4w FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27] 2023-11-04T01:45:01.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 6r FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 7w FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,30] 2023-11-04T01:45:01.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 9r FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 10w FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12] 2023-11-04T01:45:01.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 12r FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 13w FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 14w REG 8,1 3853423 405619 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:45:01.851 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 15uW REG 0,24 7 2458 /run/ceph/ceph-mds.a.pid 2023-11-04T01:45:01.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 16r FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 17w FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 18u unix 0xffff8d3398198000 0t0 254745 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 19u IPv4 258645 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:45:01.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 20u IPv4 258681 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:45:01.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 21r FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 22w FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 23r FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 24w FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 25r FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 26w FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 27u IPv4 258682 0t0 TCP smithi114.front.sepia.ceph.com:55640->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 28r FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 29w FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127319 io_contex root 30u IPv4 259534 0t0 TCP smithi114.front.sepia.ceph.com:59308->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.853 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.854 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.855 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 3r FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 4w FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.856 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27] 2023-11-04T01:45:01.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 6r FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 7w FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 8u a_inode 0,14 0 13316 [eventpoll:9,30] 2023-11-04T01:45:01.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 9r FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 10w FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 11u a_inode 0,14 0 13316 [eventpoll:12] 2023-11-04T01:45:01.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 12r FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 13w FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 14w REG 8,1 3853423 405619 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:45:01.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 15uW REG 0,24 7 2458 /run/ceph/ceph-mds.a.pid 2023-11-04T01:45:01.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 16r FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 17w FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 18u unix 0xffff8d3398198000 0t0 254745 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.857 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 19u IPv4 258645 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:45:01.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 20u IPv4 258681 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:45:01.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 21r FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 22w FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 23r FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 24w FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 25r FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 26w FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 27u IPv4 258682 0t0 TCP smithi114.front.sepia.ceph.com:55640->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 28r FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 29w FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127320 io_contex root 30u IPv4 259534 0t0 TCP smithi114.front.sepia.ceph.com:59308->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.858 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.859 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.860 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.861 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 3r FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 4w FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27] 2023-11-04T01:45:01.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 6r FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 7w FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 8u a_inode 0,14 0 13316 [eventpoll:9,30] 2023-11-04T01:45:01.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 9r FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.862 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 10w FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 11u a_inode 0,14 0 13316 [eventpoll:12] 2023-11-04T01:45:01.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 12r FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 13w FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 14w REG 8,1 3853423 405619 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:45:01.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 15uW REG 0,24 7 2458 /run/ceph/ceph-mds.a.pid 2023-11-04T01:45:01.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 16r FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 17w FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 18u unix 0xffff8d3398198000 0t0 254745 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 19u IPv4 258645 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:45:01.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 20u IPv4 258681 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:45:01.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 21r FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 22w FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 23r FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 24w FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.863 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 25r FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 26w FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 27u IPv4 258682 0t0 TCP smithi114.front.sepia.ceph.com:55640->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 28r FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 29w FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127321 ms_dispat root 30u IPv4 259534 0t0 TCP smithi114.front.sepia.ceph.com:59308->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.865 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.866 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 3r FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 4w FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27] 2023-11-04T01:45:01.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 6r FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 7w FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 8u a_inode 0,14 0 13316 [eventpoll:9,30] 2023-11-04T01:45:01.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 9r FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 10w FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 11u a_inode 0,14 0 13316 [eventpoll:12] 2023-11-04T01:45:01.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 12r FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 13w FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 14w REG 8,1 3853423 405619 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:45:01.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 15uW REG 0,24 7 2458 /run/ceph/ceph-mds.a.pid 2023-11-04T01:45:01.868 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 16r FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 17w FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 18u unix 0xffff8d3398198000 0t0 254745 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 19u IPv4 258645 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:45:01.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 20u IPv4 258681 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:45:01.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 21r FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 22w FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 23r FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 24w FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 25r FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 26w FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 27u IPv4 258682 0t0 TCP smithi114.front.sepia.ceph.com:55640->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.869 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 28r FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 29w FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127322 ms_local root 30u IPv4 259534 0t0 TCP smithi114.front.sepia.ceph.com:59308->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.870 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.871 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.872 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 3r FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 4w FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27] 2023-11-04T01:45:01.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 6r FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.873 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 7w FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,30] 2023-11-04T01:45:01.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 9r FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 10w FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12] 2023-11-04T01:45:01.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 12r FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 13w FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 14w REG 8,1 3853423 405619 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:45:01.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 15uW REG 0,24 7 2458 /run/ceph/ceph-mds.a.pid 2023-11-04T01:45:01.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 16r FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 17w FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 18u unix 0xffff8d3398198000 0t0 254745 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 19u IPv4 258645 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:45:01.874 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 20u IPv4 258681 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:45:01.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 21r FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 22w FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 23r FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 24w FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 25r FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 26w FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 27u IPv4 258682 0t0 TCP smithi114.front.sepia.ceph.com:55640->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 28r FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 29w FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127323 safe_time root 30u IPv4 259534 0t0 TCP smithi114.front.sepia.ceph.com:59308->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.875 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.876 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.877 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.878 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 3r FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 4w FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27] 2023-11-04T01:45:01.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 6r FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 7w FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,30] 2023-11-04T01:45:01.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 9r FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 10w FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12] 2023-11-04T01:45:01.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 12r FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.879 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 13w FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 14w REG 8,1 3853423 405619 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:45:01.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 15uW REG 0,24 7 2458 /run/ceph/ceph-mds.a.pid 2023-11-04T01:45:01.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 16r FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 17w FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 18u unix 0xffff8d3398198000 0t0 254745 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 19u IPv4 258645 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:45:01.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 20u IPv4 258681 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:45:01.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 21r FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 22w FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 23r FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 24w FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 25r FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 26w FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 27u IPv4 258682 0t0 TCP smithi114.front.sepia.ceph.com:55640->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.880 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 28r FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 29w FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127324 safe_time root 30u IPv4 259534 0t0 TCP smithi114.front.sepia.ceph.com:59308->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.881 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.882 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.883 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 3r FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 4w FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27] 2023-11-04T01:45:01.884 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 6r FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 7w FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 8u a_inode 0,14 0 13316 [eventpoll:9,30] 2023-11-04T01:45:01.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 9r FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 10w FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 11u a_inode 0,14 0 13316 [eventpoll:12] 2023-11-04T01:45:01.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 12r FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 13w FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 14w REG 8,1 3853423 405619 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:45:01.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 15uW REG 0,24 7 2458 /run/ceph/ceph-mds.a.pid 2023-11-04T01:45:01.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 16r FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 17w FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 18u unix 0xffff8d3398198000 0t0 254745 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 19u IPv4 258645 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:45:01.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 20u IPv4 258681 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:45:01.885 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 21r FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 22w FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 23r FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 24w FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 25r FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 26w FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.886 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 27u IPv4 258682 0t0 TCP smithi114.front.sepia.ceph.com:55640->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 28r FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 29w FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127325 ceph-mds root 30u IPv4 259534 0t0 TCP smithi114.front.sepia.ceph.com:59308->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root txt REG 8,1 6696672 3106 /usr/bin/ceph-mds 2023-11-04T01:45:01.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.887 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.888 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 326760 2537 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:45:01.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 61880 2527 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:45:01.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:45:01.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:45:01.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 1w FIFO 0,13 0t0 255685 pipe 2023-11-04T01:45:01.890 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 2w FIFO 0,13 0t0 255686 pipe 2023-11-04T01:45:01.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 3r FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 4w FIFO 0,13 0t0 261309 pipe 2023-11-04T01:45:01.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 5u a_inode 0,14 0 13316 [eventpoll:6,19,20,27] 2023-11-04T01:45:01.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 6r FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 7w FIFO 0,13 0t0 261311 pipe 2023-11-04T01:45:01.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 8u a_inode 0,14 0 13316 [eventpoll:9,30] 2023-11-04T01:45:01.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 9r FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 10w FIFO 0,13 0t0 261312 pipe 2023-11-04T01:45:01.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 11u a_inode 0,14 0 13316 [eventpoll:12] 2023-11-04T01:45:01.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 12r FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 13w FIFO 0,13 0t0 261313 pipe 2023-11-04T01:45:01.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 14w REG 8,1 3853423 405619 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:45:01.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 15uW REG 0,24 7 2458 /run/ceph/ceph-mds.a.pid 2023-11-04T01:45:01.891 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 16r FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 17w FIFO 0,13 0t0 254744 pipe 2023-11-04T01:45:01.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 18u unix 0xffff8d3398198000 0t0 254745 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:45:01.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 19u IPv4 258645 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:45:01.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 20u IPv4 258681 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:45:01.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 21r FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 22w FIFO 0,13 0t0 254747 pipe 2023-11-04T01:45:01.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 23r FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 24w FIFO 0,13 0t0 254748 pipe 2023-11-04T01:45:01.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 25r FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 26w FIFO 0,13 0t0 254749 pipe 2023-11-04T01:45:01.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 27u IPv4 258682 0t0 TCP smithi114.front.sepia.ceph.com:55640->smithi114.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:45:01.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 28r FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 29w FIFO 0,13 0t0 254750 pipe 2023-11-04T01:45:01.892 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-mds 127307 127348 safe_time root 30u IPv4 259534 0t0 TCP smithi114.front.sepia.ceph.com:59308->smithi114.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:45:01.892 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-11-04T01:45:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:45:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:45:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:45:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:45:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:45:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:45:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:45:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:45:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:45:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:45:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:45:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-11-04T01:45:01.894 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:45:01.894 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.894 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:45:01.894 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu 0r FIFO 0,13 0t0 256813 pipe 2023-11-04T01:45:01.894 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.894 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128263 ubuntu 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.894 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.894 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.894 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:45:01.894 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:45:01.894 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:45:01.894 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:45:01.894 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:45:01.894 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.895 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.895 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.895 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.895 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:45:01.895 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:45:01.895 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:45:01.895 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:45:01.895 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:45:01.895 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:45:01.895 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:45:01.895 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:45:01.895 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:45:01.895 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.895 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.896 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.896 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.896 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.896 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.896 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.896 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.896 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.896 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.896 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.896 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.896 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:45:01.896 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:45:01.896 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:45:01.896 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.897 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:45:01.897 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:45:01.897 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.897 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.897 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.897 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:45:01.897 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:45:01.897 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:45:01.897 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:45:01.897 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:45:01.897 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:45:01.897 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:45:01.897 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:45:01.897 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:45:01.897 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:45:01.898 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:45:01.898 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:45:01.898 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:45:01.898 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.898 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:45:01.898 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:45:01.898 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.898 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:45:01.898 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root 0r FIFO 0,13 0t0 256813 pipe 2023-11-04T01:45:01.898 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.898 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.898 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root 3r FIFO 0,13 0t0 261681 pipe 2023-11-04T01:45:01.898 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root 4w FIFO 0,13 0t0 261681 pipe 2023-11-04T01:45:01.898 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root 5u netlink 0t0 261687 AUDIT 2023-11-04T01:45:01.898 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128293 root 6u unix 0xffff8d3398379dc0 0t0 261688 type=DGRAM (CONNECTED) 2023-11-04T01:45:01.899 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.899 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.899 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:45:01.899 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:45:01.899 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:45:01.899 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.899 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:45:01.899 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:01.899 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:45:01.899 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:45:01.899 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:45:01.899 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:45:01.899 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:45:01.900 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:45:01.900 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:45:01.900 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:45:01.900 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.900 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.900 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:45:01.900 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:45:01.900 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:45:01.900 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.900 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.900 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.900 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.900 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.900 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.901 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.901 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:45:01.901 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.901 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.901 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.901 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:45:01.901 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.901 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.901 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.901 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.901 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.901 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:45:01.901 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:45:01.901 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:45:01.901 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:45:01.902 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:45:01.902 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:45:01.902 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:45:01.902 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:45:01.902 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:45:01.902 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:45:01.902 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:45:01.902 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:45:01.902 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:45:01.902 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.902 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:45:01.902 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:45:01.902 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.902 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:45:01.902 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:45:01.903 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.903 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:45:01.903 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root 0r FIFO 0,13 0t0 256813 pipe 2023-11-04T01:45:01.903 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.903 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.903 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root 3r FIFO 0,13 0t0 257796 pipe 2023-11-04T01:45:01.903 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root 4w FIFO 0,13 0t0 257796 pipe 2023-11-04T01:45:01.903 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root 5u sock 0,8 0t0 257802 protocol: NETLINK 2023-11-04T01:45:01.903 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 128299 root 6u sock 0,8 0t0 257803 protocol: UNIX 2023-11-04T01:45:01.903 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.903 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.903 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:45:01.903 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:45:01.903 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.904 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:45:01.904 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.904 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.904 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.904 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.904 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.904 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:45:01.904 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.904 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.904 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.904 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.904 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.904 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.904 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:01.904 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:45:01.905 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:45:01.905 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.905 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root 0r FIFO 0,13 0t0 256813 pipe 2023-11-04T01:45:01.905 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.905 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.905 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root 3r FIFO 0,13 0t0 260609 pipe 2023-11-04T01:45:01.905 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 128301 root 4w FIFO 0,13 0t0 260609 pipe 2023-11-04T01:45:01.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.905 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.906 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.907 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.908 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.909 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.910 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.911 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.912 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.913 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.914 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.915 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128320 log root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.916 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.917 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.918 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.919 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.920 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128322 msgr-work root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.922 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.923 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.924 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128323 msgr-work root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.926 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.927 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.928 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.929 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.930 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.931 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128324 msgr-work root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.932 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.933 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.934 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.935 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128328 service root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.937 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.938 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.939 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.940 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.941 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.942 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128329 admin_soc root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.943 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.945 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.946 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.947 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128330 signal_ha root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.948 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.949 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.950 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.951 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.952 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128331 io_contex root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.953 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.954 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.955 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.956 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.957 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.958 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128332 io_contex root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.959 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.960 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.961 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.962 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.963 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128333 ceph_time root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.964 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.965 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.966 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.967 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.968 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128334 fn_anonym root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.970 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.971 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.972 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.973 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128335 fn_anonym root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.974 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.975 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.976 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.977 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.978 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.979 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128336 fn_anonym root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.980 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.981 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.982 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.983 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.984 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.985 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128337 fn_anonym root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.986 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.987 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128338 fn_anonym root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.991 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.992 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.993 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:01.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:01.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:01.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:01.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:01.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:01.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:01.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:01.994 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:01.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:01.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:01.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:01.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:01.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:01.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:01.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:01.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:01.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:01.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:01.995 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:01.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:01.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:01.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:01.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:01.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:01.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:01.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:01.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:01.996 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:01.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128339 safe_time root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:01.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:01.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:01.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:01.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:01.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:01.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:01.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:01.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:01.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:01.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:01.997 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:01.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:01.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:01.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:01.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:01.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:01.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:01.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:01.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:01.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:01.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:01.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:01.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:01.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:01.998 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:01.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:01.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:01.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:01.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:01.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:01.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:01.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:01.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:01.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:01.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:01.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:01.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:01.999 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:02.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:02.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:02.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:02.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:02.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:02.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:02.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:02.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:02.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:02.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:02.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:02.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:02.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:02.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:02.000 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:02.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:02.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:02.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.001 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:02.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:02.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:02.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128340 fn_anonym root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:02.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:02.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:02.002 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:02.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:02.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:02.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:02.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:02.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:02.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:02.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:02.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:02.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:02.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:02.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:02.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:02.003 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:02.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:02.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:02.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:02.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:02.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:02.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:02.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:02.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:02.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:02.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:02.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:02.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:02.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:02.004 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:02.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:02.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:02.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:02.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:02.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:02.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:02.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:02.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:02.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:02.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:02.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:02.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:02.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:02.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:02.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:02.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:02.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:02.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:02.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:02.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:02.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:02.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:02.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:02.006 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:02.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:02.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:02.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:02.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.007 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128341 flusher root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:02.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:02.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:02.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:02.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:02.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:02.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:02.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:02.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:02.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:02.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:02.008 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:02.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:02.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:02.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:02.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:02.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:02.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:02.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:02.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:02.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:02.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:02.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:02.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:02.009 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:02.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:02.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:02.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:02.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:02.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:02.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:02.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:02.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:02.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:02.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:02.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:02.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:02.010 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:02.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:02.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:02.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:02.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:02.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:02.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:02.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:02.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:02.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:02.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:02.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:02.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:02.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:02.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:02.011 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:02.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:02.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:02.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:02.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:02.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:02.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128342 ms_dispat root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:02.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:02.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:02.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:02.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:02.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:02.013 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:02.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:02.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:02.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:02.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:02.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:02.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:02.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:02.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:02.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:02.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:02.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:02.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:02.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:02.014 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:02.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:02.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:02.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:02.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:02.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:02.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:02.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:02.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:02.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:02.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:02.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:02.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:02.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:02.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:02.015 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:02.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:02.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:02.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:02.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:02.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:02.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:02.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:02.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:02.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:02.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:02.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:02.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:02.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:02.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:02.016 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:02.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:02.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:02.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:02.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:02.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.017 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:02.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:02.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:02.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128343 ms_local root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:02.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:02.018 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:02.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:02.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:02.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:02.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:02.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:02.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:02.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:02.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:02.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:02.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:02.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:02.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:02.019 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:02.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:02.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:02.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:02.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:02.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:02.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:02.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:02.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:02.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:02.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:02.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:02.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:02.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:02.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:02.020 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:02.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:02.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:02.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:02.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:02.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:02.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:02.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:02.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:02.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:02.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:02.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:02.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:02.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:02.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:02.021 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:02.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:02.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:02.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:02.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:02.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:02.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:02.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:02.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:02.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.022 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:02.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:02.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:02.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:02.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.023 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128344 safe_time root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:02.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:02.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:02.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:02.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:02.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:02.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:02.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:02.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:02.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:02.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:02.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:02.024 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:02.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:02.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:02.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:02.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:02.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:02.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:02.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:02.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:02.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:02.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:02.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:02.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:02.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:02.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:02.025 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:02.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:02.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:02.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:02.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:02.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:02.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:02.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:02.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:02.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:02.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:02.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:02.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:02.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:02.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:02.026 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:02.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:02.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:02.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:02.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:02.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:02.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:02.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:02.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:02.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:02.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:02.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.027 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:02.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:02.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:02.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:02.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:02.028 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128345 ceph-fuse root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:02.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:02.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:02.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:02.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:02.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:02.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:02.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:02.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:02.029 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:02.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:02.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:02.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:02.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:02.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:02.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:02.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:02.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:02.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:02.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:02.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:02.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:02.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:02.030 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:02.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:02.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:02.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:02.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:02.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:02.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:02.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:02.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:02.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:02.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:02.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:02.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:02.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:02.031 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:02.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:02.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:02.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:02.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:02.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:02.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:02.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:02.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:02.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:02.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:02.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:02.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:02.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:02.032 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:02.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:02.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:02.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:02.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:02.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:02.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:02.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128347 ceph-fuse root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:02.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:02.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:02.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:02.034 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:02.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:02.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:02.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:02.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:02.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:02.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:02.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:02.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:02.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:02.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:02.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:02.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:02.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:02.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:02.035 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:02.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:02.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:02.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:02.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:02.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:02.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:02.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:02.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:02.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:02.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:02.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:02.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:02.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:02.036 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:02.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:02.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:02.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:02.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:02.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:02.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:02.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:02.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:02.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:02.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:02.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:02.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:02.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:02.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:02.037 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:02.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:02.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:02.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:02.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:02.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:02.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.038 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:02.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:02.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:02.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:02.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128349 ceph-fuse root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root cwd DIR 8,1 4096 265827 /home/ubuntu/cephtest 2023-11-04T01:45:02.039 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:02.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root txt REG 8,1 2635024 20950 /usr/bin/ceph-fuse 2023-11-04T01:45:02.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:45:02.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:45:02.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:45:02.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 53816 1704 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:45:02.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 53272 2022 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:45:02.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:02.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:02.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:02.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:45:02.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:02.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:02.040 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:02.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:02.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:45:02.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:02.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:02.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:02.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:45:02.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:02.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:02.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:02.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:02.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:45:02.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:45:02.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:02.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:45:02.041 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:45:02.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 639224 1986 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:45:02.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:45:02.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:45:02.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:45:02.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:45:02.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:02.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:45:02.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:45:02.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:45:02.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:45:02.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:02.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 9894040 265438 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:45:02.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:02.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:02.042 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:02.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:45:02.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:02.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 0r FIFO 0,13 0t0 260610 pipe 2023-11-04T01:45:02.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 1w FIFO 0,13 0t0 256814 pipe 2023-11-04T01:45:02.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 2w FIFO 0,13 0t0 256815 pipe 2023-11-04T01:45:02.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 3w REG 8,1 309218 406249 /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:45:02.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 4u a_inode 0,14 0 13316 [eventpoll:5,22] 2023-11-04T01:45:02.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 5r FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 6w FIFO 0,13 0t0 256835 pipe 2023-11-04T01:45:02.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 7u a_inode 0,14 0 13316 [eventpoll:8] 2023-11-04T01:45:02.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 8r FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 9w FIFO 0,13 0t0 256836 pipe 2023-11-04T01:45:02.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 10u a_inode 0,14 0 13316 [eventpoll:11,21] 2023-11-04T01:45:02.043 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 11r FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 12w FIFO 0,13 0t0 256837 pipe 2023-11-04T01:45:02.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 13r FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 14w FIFO 0,13 0t0 257810 pipe 2023-11-04T01:45:02.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 15u sock 0,8 0t0 257811 protocol: UNIX-STREAM 2023-11-04T01:45:02.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 16r FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 17w FIFO 0,13 0t0 257812 pipe 2023-11-04T01:45:02.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 18r FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 19w FIFO 0,13 0t0 257813 pipe 2023-11-04T01:45:02.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 21u sock 0,8 0t0 262188 protocol: TCP 2023-11-04T01:45:02.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 22u sock 0,8 0t0 259881 protocol: TCP 2023-11-04T01:45:02.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:45:02.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 24r FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 25w FIFO 0,13 0t0 259882 pipe 2023-11-04T01:45:02.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 26r FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.044 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 27w FIFO 0,13 0t0 257820 pipe 2023-11-04T01:45:02.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 28r FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.045 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-fuse 128319 128544 ceph-fuse root 30w FIFO 0,13 0t0 262291 pipe 2023-11-04T01:45:02.045 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:02.045 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:45:02.045 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-11-04T01:45:02.045 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:45:02.045 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:02.045 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:45:02.045 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:45:02.045 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:45:02.045 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:45:02.045 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:45:02.045 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:45:02.045 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:45:02.045 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:45:02.046 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:45:02.046 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:45:02.046 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-11-04T01:45:02.046 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:45:02.046 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:02.046 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:45:02.046 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu 0r FIFO 0,13 0t0 260657 pipe 2023-11-04T01:45:02.046 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu 1w FIFO 0,13 0t0 260658 pipe 2023-11-04T01:45:02.046 INFO:teuthology.orchestra.run.smithi114.stdout:bash 128691 ubuntu 2w FIFO 0,13 0t0 260659 pipe 2023-11-04T01:45:02.046 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu cwd DIR 0,41 0 1 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:02.046 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:45:02.046 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu txt REG 8,1 69752 10054 /usr/bin/mkdir 2023-11-04T01:45:02.046 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:45:02.046 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:02.047 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:45:02.047 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:45:02.047 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:45:02.047 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:45:02.047 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:45:02.047 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:45:02.047 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:45:02.047 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:45:02.047 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:45:02.047 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:45:02.047 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:02.047 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:02.047 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:45:02.047 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:02.048 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:45:02.048 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu 0r FIFO 0,13 0t0 260657 pipe 2023-11-04T01:45:02.048 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu 1w FIFO 0,13 0t0 260658 pipe 2023-11-04T01:45:02.048 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir 128707 ubuntu 2w FIFO 0,13 0t0 260659 pipe 2023-11-04T01:45:02.048 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/3 128956 root cwd DIR 8,1 4096 2 / 2023-11-04T01:45:02.048 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/3 128956 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:02.048 INFO:teuthology.orchestra.run.smithi114.stdout:kworker/3 128956 root txt unknown /proc/128956/exe 2023-11-04T01:45:02.048 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:02.048 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:45:02.048 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-11-04T01:45:02.048 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:45:02.048 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:02.048 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:45:02.048 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:45:02.048 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:45:02.049 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:45:02.049 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:45:02.049 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:45:02.049 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:45:02.049 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:45:02.049 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:45:02.049 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:45:02.049 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-11-04T01:45:02.049 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:45:02.049 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:02.049 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:45:02.049 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu 0r FIFO 0,13 0t0 262689 pipe 2023-11-04T01:45:02.049 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu 1w FIFO 0,13 0t0 262690 pipe 2023-11-04T01:45:02.049 INFO:teuthology.orchestra.run.smithi114.stdout:bash 129698 ubuntu 2w FIFO 0,13 0t0 262691 pipe 2023-11-04T01:45:02.050 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:02.050 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:02.050 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:45:02.050 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:45:02.050 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:45:02.050 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:45:02.050 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:45:02.050 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:45:02.050 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:02.050 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:02.050 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:45:02.050 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:45:02.051 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:45:02.051 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:45:02.051 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:45:02.051 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:45:02.051 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:45:02.051 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:45:02.051 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:45:02.051 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:02.051 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:02.051 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:02.051 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:02.051 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:02.051 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:02.052 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:45:02.052 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:45:02.052 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:45:02.052 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:45:02.052 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:02.052 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:02.052 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:45:02.052 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:45:02.052 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:45:02.052 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:45:02.052 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:45:02.052 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:45:02.052 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:45:02.052 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:45:02.053 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:02.053 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:02.053 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:45:02.053 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:45:02.053 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:45:02.053 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:45:02.053 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:45:02.053 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:45:02.053 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:45:02.053 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:45:02.053 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:45:02.053 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:45:02.053 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:45:02.053 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:45:02.054 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:45:02.054 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:02.054 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:45:02.054 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:45:02.054 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:02.054 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:45:02.054 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root 0r FIFO 0,13 0t0 262689 pipe 2023-11-04T01:45:02.054 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root 1w FIFO 0,13 0t0 262690 pipe 2023-11-04T01:45:02.054 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root 2w FIFO 0,13 0t0 262691 pipe 2023-11-04T01:45:02.054 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root 3r FIFO 0,13 0t0 267325 pipe 2023-11-04T01:45:02.054 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root 4w FIFO 0,13 0t0 267325 pipe 2023-11-04T01:45:02.054 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root 5u netlink 0t0 267331 AUDIT 2023-11-04T01:45:02.054 INFO:teuthology.orchestra.run.smithi114.stdout:sudo 129714 root 6u unix 0xffff8d3398448cc0 0t0 267332 type=DGRAM (CONNECTED) 2023-11-04T01:45:02.054 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:02.054 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:45:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:45:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:45:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:45:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:45:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:02.055 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:02.056 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:02.056 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:45:02.056 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:45:02.056 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:45:02.056 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:02.056 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root 0r FIFO 0,13 0t0 262689 pipe 2023-11-04T01:45:02.056 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root 1w FIFO 0,13 0t0 262690 pipe 2023-11-04T01:45:02.056 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root 2w FIFO 0,13 0t0 262691 pipe 2023-11-04T01:45:02.056 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root 3r FIFO 0,13 0t0 266376 pipe 2023-11-04T01:45:02.056 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root 4w FIFO 0,13 0t0 266376 pipe 2023-11-04T01:45:02.056 INFO:teuthology.orchestra.run.smithi114.stdout:stdin-kil 129716 root 6w FIFO 0,13 0t0 266377 pipe 2023-11-04T01:45:02.056 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:02.056 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:02.056 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root txt REG 8,1 179232 12343 /usr/bin/lsof 2023-11-04T01:45:02.056 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:02.057 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:45:02.057 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:02.057 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:02.057 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:02.057 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:02.057 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:02.057 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:02.057 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:02.057 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:02.057 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:02.057 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:02.057 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-04T01:45:02.057 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:02.057 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:45:02.058 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:02.058 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root 0r FIFO 0,13 0t0 266377 pipe 2023-11-04T01:45:02.058 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root 1w FIFO 0,13 0t0 262690 pipe 2023-11-04T01:45:02.058 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root 2w FIFO 0,13 0t0 262691 pipe 2023-11-04T01:45:02.058 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root 3r DIR 0,20 0 1 /proc 2023-11-04T01:45:02.058 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root 4r DIR 0,20 0 268301 /proc/129717/fd 2023-11-04T01:45:02.058 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root 5w FIFO 0,13 0t0 268313 pipe 2023-11-04T01:45:02.058 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129717 root 6r FIFO 0,13 0t0 268314 pipe 2023-11-04T01:45:02.058 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:45:02.058 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root rtd DIR 8,1 4096 2 / 2023-11-04T01:45:02.058 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root txt REG 8,1 179232 12343 /usr/bin/lsof 2023-11-04T01:45:02.058 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:45:02.058 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:45:02.058 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:45:02.059 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:45:02.059 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:45:02.059 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:45:02.059 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:45:02.059 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:45:02.059 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:45:02.059 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:45:02.059 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:45:02.059 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:45:02.059 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-04T01:45:02.059 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:45:02.059 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:45:02.059 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:45:02.059 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root 4r FIFO 0,13 0t0 268313 pipe 2023-11-04T01:45:02.060 INFO:teuthology.orchestra.run.smithi114.stdout:lsof 129718 root 7w FIFO 0,13 0t0 268314 pipe 2023-11-04T01:45:02.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:45:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:45:02.061 INFO:teuthology.orchestra.run.smithi114.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-11-04T01:45:02.061 INFO:teuthology.orchestra.run.smithi114.stdout:root 2 0.0 0.0 0 0 ? S 01:24 0:00 [kthreadd] 2023-11-04T01:45:02.062 INFO:teuthology.orchestra.run.smithi114.stdout:root 3 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [rcu_gp] 2023-11-04T01:45:02.062 INFO:teuthology.orchestra.run.smithi114.stdout:root 4 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [rcu_par_gp] 2023-11-04T01:45:02.062 INFO:teuthology.orchestra.run.smithi114.stdout:root 5 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [slub_flushwq] 2023-11-04T01:45:02.062 INFO:teuthology.orchestra.run.smithi114.stdout:root 6 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [netns] 2023-11-04T01:45:02.062 INFO:teuthology.orchestra.run.smithi114.stdout:root 8 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/0:0H-events_highpri] 2023-11-04T01:45:02.062 INFO:teuthology.orchestra.run.smithi114.stdout:root 11 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [mm_percpu_wq] 2023-11-04T01:45:02.062 INFO:teuthology.orchestra.run.smithi114.stdout:root 12 0.0 0.0 0 0 ? I 01:24 0:00 \_ [kworker/u16:1-events_unbound] 2023-11-04T01:45:02.062 INFO:teuthology.orchestra.run.smithi114.stdout:root 13 0.0 0.0 0 0 ? I 01:24 0:00 \_ [rcu_tasks_kthre] 2023-11-04T01:45:02.062 INFO:teuthology.orchestra.run.smithi114.stdout:root 14 0.0 0.0 0 0 ? I 01:24 0:00 \_ [rcu_tasks_rude_] 2023-11-04T01:45:02.062 INFO:teuthology.orchestra.run.smithi114.stdout:root 15 0.0 0.0 0 0 ? I 01:24 0:00 \_ [rcu_tasks_trace] 2023-11-04T01:45:02.062 INFO:teuthology.orchestra.run.smithi114.stdout:root 16 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/0] 2023-11-04T01:45:02.062 INFO:teuthology.orchestra.run.smithi114.stdout:root 17 0.4 0.0 0 0 ? S 01:24 0:05 \_ [pr/ttyS1] 2023-11-04T01:45:02.062 INFO:teuthology.orchestra.run.smithi114.stdout:root 18 0.0 0.0 0 0 ? I 01:24 0:00 \_ [rcu_preempt] 2023-11-04T01:45:02.063 INFO:teuthology.orchestra.run.smithi114.stdout:root 19 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/0] 2023-11-04T01:45:02.063 INFO:teuthology.orchestra.run.smithi114.stdout:root 20 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/0] 2023-11-04T01:45:02.063 INFO:teuthology.orchestra.run.smithi114.stdout:root 21 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/0] 2023-11-04T01:45:02.063 INFO:teuthology.orchestra.run.smithi114.stdout:root 22 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/1] 2023-11-04T01:45:02.063 INFO:teuthology.orchestra.run.smithi114.stdout:root 23 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/1] 2023-11-04T01:45:02.063 INFO:teuthology.orchestra.run.smithi114.stdout:root 24 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/1] 2023-11-04T01:45:02.063 INFO:teuthology.orchestra.run.smithi114.stdout:root 25 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/1] 2023-11-04T01:45:02.063 INFO:teuthology.orchestra.run.smithi114.stdout:root 27 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/1:0H-events_highpri] 2023-11-04T01:45:02.063 INFO:teuthology.orchestra.run.smithi114.stdout:root 28 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/2] 2023-11-04T01:45:02.063 INFO:teuthology.orchestra.run.smithi114.stdout:root 29 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/2] 2023-11-04T01:45:02.063 INFO:teuthology.orchestra.run.smithi114.stdout:root 30 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/2] 2023-11-04T01:45:02.063 INFO:teuthology.orchestra.run.smithi114.stdout:root 31 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/2] 2023-11-04T01:45:02.063 INFO:teuthology.orchestra.run.smithi114.stdout:root 33 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/2:0H-events_highpri] 2023-11-04T01:45:02.063 INFO:teuthology.orchestra.run.smithi114.stdout:root 34 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/3] 2023-11-04T01:45:02.063 INFO:teuthology.orchestra.run.smithi114.stdout:root 35 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/3] 2023-11-04T01:45:02.064 INFO:teuthology.orchestra.run.smithi114.stdout:root 36 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/3] 2023-11-04T01:45:02.064 INFO:teuthology.orchestra.run.smithi114.stdout:root 37 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/3] 2023-11-04T01:45:02.064 INFO:teuthology.orchestra.run.smithi114.stdout:root 39 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/3:0H-events_highpri] 2023-11-04T01:45:02.064 INFO:teuthology.orchestra.run.smithi114.stdout:root 40 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/4] 2023-11-04T01:45:02.064 INFO:teuthology.orchestra.run.smithi114.stdout:root 41 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/4] 2023-11-04T01:45:02.064 INFO:teuthology.orchestra.run.smithi114.stdout:root 42 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/4] 2023-11-04T01:45:02.064 INFO:teuthology.orchestra.run.smithi114.stdout:root 43 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/4] 2023-11-04T01:45:02.064 INFO:teuthology.orchestra.run.smithi114.stdout:root 45 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/4:0H-events_highpri] 2023-11-04T01:45:02.064 INFO:teuthology.orchestra.run.smithi114.stdout:root 46 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/5] 2023-11-04T01:45:02.064 INFO:teuthology.orchestra.run.smithi114.stdout:root 47 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/5] 2023-11-04T01:45:02.064 INFO:teuthology.orchestra.run.smithi114.stdout:root 48 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/5] 2023-11-04T01:45:02.064 INFO:teuthology.orchestra.run.smithi114.stdout:root 49 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/5] 2023-11-04T01:45:02.064 INFO:teuthology.orchestra.run.smithi114.stdout:root 51 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/5:0H-events_highpri] 2023-11-04T01:45:02.064 INFO:teuthology.orchestra.run.smithi114.stdout:root 52 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/6] 2023-11-04T01:45:02.064 INFO:teuthology.orchestra.run.smithi114.stdout:root 53 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/6] 2023-11-04T01:45:02.065 INFO:teuthology.orchestra.run.smithi114.stdout:root 54 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/6] 2023-11-04T01:45:02.065 INFO:teuthology.orchestra.run.smithi114.stdout:root 55 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/6] 2023-11-04T01:45:02.065 INFO:teuthology.orchestra.run.smithi114.stdout:root 57 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/6:0H-events_highpri] 2023-11-04T01:45:02.065 INFO:teuthology.orchestra.run.smithi114.stdout:root 58 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/7] 2023-11-04T01:45:02.065 INFO:teuthology.orchestra.run.smithi114.stdout:root 59 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/7] 2023-11-04T01:45:02.065 INFO:teuthology.orchestra.run.smithi114.stdout:root 60 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/7] 2023-11-04T01:45:02.065 INFO:teuthology.orchestra.run.smithi114.stdout:root 61 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/7] 2023-11-04T01:45:02.065 INFO:teuthology.orchestra.run.smithi114.stdout:root 63 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/7:0H-events_highpri] 2023-11-04T01:45:02.065 INFO:teuthology.orchestra.run.smithi114.stdout:root 70 0.0 0.0 0 0 ? I 01:24 0:00 \_ [kworker/u16:7-events_unbound] 2023-11-04T01:45:02.065 INFO:teuthology.orchestra.run.smithi114.stdout:root 71 0.0 0.0 0 0 ? S 01:24 0:00 \_ [kdevtmpfs] 2023-11-04T01:45:02.065 INFO:teuthology.orchestra.run.smithi114.stdout:root 72 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [inet_frag_wq] 2023-11-04T01:45:02.065 INFO:teuthology.orchestra.run.smithi114.stdout:root 73 0.0 0.0 0 0 ? S 01:24 0:00 \_ [kauditd] 2023-11-04T01:45:02.065 INFO:teuthology.orchestra.run.smithi114.stdout:root 75 0.0 0.0 0 0 ? S 01:24 0:00 \_ [khungtaskd] 2023-11-04T01:45:02.065 INFO:teuthology.orchestra.run.smithi114.stdout:root 76 0.0 0.0 0 0 ? S 01:24 0:00 \_ [oom_reaper] 2023-11-04T01:45:02.065 INFO:teuthology.orchestra.run.smithi114.stdout:root 77 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [writeback] 2023-11-04T01:45:02.066 INFO:teuthology.orchestra.run.smithi114.stdout:root 78 0.0 0.0 0 0 ? S 01:24 0:00 \_ [kcompactd0] 2023-11-04T01:45:02.066 INFO:teuthology.orchestra.run.smithi114.stdout:root 79 0.0 0.0 0 0 ? SN 01:24 0:00 \_ [ksmd] 2023-11-04T01:45:02.066 INFO:teuthology.orchestra.run.smithi114.stdout:root 80 0.0 0.0 0 0 ? SN 01:24 0:00 \_ [khugepaged] 2023-11-04T01:45:02.066 INFO:teuthology.orchestra.run.smithi114.stdout:root 81 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [cryptd] 2023-11-04T01:45:02.066 INFO:teuthology.orchestra.run.smithi114.stdout:root 82 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kintegrityd] 2023-11-04T01:45:02.066 INFO:teuthology.orchestra.run.smithi114.stdout:root 83 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kblockd] 2023-11-04T01:45:02.066 INFO:teuthology.orchestra.run.smithi114.stdout:root 84 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [blkcg_punt_bio] 2023-11-04T01:45:02.066 INFO:teuthology.orchestra.run.smithi114.stdout:root 87 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [tpm_dev_wq] 2023-11-04T01:45:02.066 INFO:teuthology.orchestra.run.smithi114.stdout:root 88 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [md] 2023-11-04T01:45:02.066 INFO:teuthology.orchestra.run.smithi114.stdout:root 89 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [md_bitmap] 2023-11-04T01:45:02.066 INFO:teuthology.orchestra.run.smithi114.stdout:root 90 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [edac-poller] 2023-11-04T01:45:02.066 INFO:teuthology.orchestra.run.smithi114.stdout:root 91 0.0 0.0 0 0 ? S 01:24 0:00 \_ [watchdogd] 2023-11-04T01:45:02.066 INFO:teuthology.orchestra.run.smithi114.stdout:root 93 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/7:1H-xfs-log/dm-4] 2023-11-04T01:45:02.066 INFO:teuthology.orchestra.run.smithi114.stdout:root 95 0.0 0.0 0 0 ? S 01:24 0:00 \_ [kswapd0] 2023-11-04T01:45:02.067 INFO:teuthology.orchestra.run.smithi114.stdout:root 101 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kthrotld] 2023-11-04T01:45:02.067 INFO:teuthology.orchestra.run.smithi114.stdout:root 108 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [acpi_thermal_pm] 2023-11-04T01:45:02.067 INFO:teuthology.orchestra.run.smithi114.stdout:root 109 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kmpath_rdacd] 2023-11-04T01:45:02.067 INFO:teuthology.orchestra.run.smithi114.stdout:root 110 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kaluad] 2023-11-04T01:45:02.067 INFO:teuthology.orchestra.run.smithi114.stdout:root 111 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [mld] 2023-11-04T01:45:02.067 INFO:teuthology.orchestra.run.smithi114.stdout:root 112 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/2:1H-kblockd] 2023-11-04T01:45:02.067 INFO:teuthology.orchestra.run.smithi114.stdout:root 113 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ipv6_addrconf] 2023-11-04T01:45:02.067 INFO:teuthology.orchestra.run.smithi114.stdout:root 122 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kstrp] 2023-11-04T01:45:02.067 INFO:teuthology.orchestra.run.smithi114.stdout:root 128 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [zswap-shrink] 2023-11-04T01:45:02.067 INFO:teuthology.orchestra.run.smithi114.stdout:root 238 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/u17:0] 2023-11-04T01:45:02.067 INFO:teuthology.orchestra.run.smithi114.stdout:root 277 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/1:1H-xfs-log/dm-4] 2023-11-04T01:45:02.067 INFO:teuthology.orchestra.run.smithi114.stdout:root 289 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/0:1H-xfs-log/dm-1] 2023-11-04T01:45:02.067 INFO:teuthology.orchestra.run.smithi114.stdout:root 290 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/3:1H-kblockd] 2023-11-04T01:45:02.067 INFO:teuthology.orchestra.run.smithi114.stdout:root 357 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/6:1H-xfs-log/dm-4] 2023-11-04T01:45:02.067 INFO:teuthology.orchestra.run.smithi114.stdout:root 398 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/5:1H-kblockd] 2023-11-04T01:45:02.068 INFO:teuthology.orchestra.run.smithi114.stdout:root 399 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/4:1H-xfs-log/dm-3] 2023-11-04T01:45:02.068 INFO:teuthology.orchestra.run.smithi114.stdout:root 428 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ata_sff] 2023-11-04T01:45:02.068 INFO:teuthology.orchestra.run.smithi114.stdout:root 431 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [nvme-wq] 2023-11-04T01:45:02.068 INFO:teuthology.orchestra.run.smithi114.stdout:root 434 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [nvme-reset-wq] 2023-11-04T01:45:02.068 INFO:teuthology.orchestra.run.smithi114.stdout:root 435 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [nvme-delete-wq] 2023-11-04T01:45:02.068 INFO:teuthology.orchestra.run.smithi114.stdout:root 436 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [nvme-auth-wq] 2023-11-04T01:45:02.068 INFO:teuthology.orchestra.run.smithi114.stdout:root 443 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ixgbe] 2023-11-04T01:45:02.068 INFO:teuthology.orchestra.run.smithi114.stdout:root 448 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_0] 2023-11-04T01:45:02.068 INFO:teuthology.orchestra.run.smithi114.stdout:root 449 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_0] 2023-11-04T01:45:02.068 INFO:teuthology.orchestra.run.smithi114.stdout:root 450 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_1] 2023-11-04T01:45:02.068 INFO:teuthology.orchestra.run.smithi114.stdout:root 451 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_1] 2023-11-04T01:45:02.068 INFO:teuthology.orchestra.run.smithi114.stdout:root 452 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_2] 2023-11-04T01:45:02.068 INFO:teuthology.orchestra.run.smithi114.stdout:root 453 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_2] 2023-11-04T01:45:02.068 INFO:teuthology.orchestra.run.smithi114.stdout:root 454 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_3] 2023-11-04T01:45:02.068 INFO:teuthology.orchestra.run.smithi114.stdout:root 455 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_3] 2023-11-04T01:45:02.069 INFO:teuthology.orchestra.run.smithi114.stdout:root 456 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_4] 2023-11-04T01:45:02.069 INFO:teuthology.orchestra.run.smithi114.stdout:root 457 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_4] 2023-11-04T01:45:02.069 INFO:teuthology.orchestra.run.smithi114.stdout:root 458 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_5] 2023-11-04T01:45:02.069 INFO:teuthology.orchestra.run.smithi114.stdout:root 459 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_5] 2023-11-04T01:45:02.069 INFO:teuthology.orchestra.run.smithi114.stdout:root 460 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_6] 2023-11-04T01:45:02.069 INFO:teuthology.orchestra.run.smithi114.stdout:root 461 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_6] 2023-11-04T01:45:02.069 INFO:teuthology.orchestra.run.smithi114.stdout:root 462 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_7] 2023-11-04T01:45:02.069 INFO:teuthology.orchestra.run.smithi114.stdout:root 463 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_7] 2023-11-04T01:45:02.069 INFO:teuthology.orchestra.run.smithi114.stdout:root 464 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_8] 2023-11-04T01:45:02.069 INFO:teuthology.orchestra.run.smithi114.stdout:root 465 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_8] 2023-11-04T01:45:02.069 INFO:teuthology.orchestra.run.smithi114.stdout:root 466 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_9] 2023-11-04T01:45:02.069 INFO:teuthology.orchestra.run.smithi114.stdout:root 467 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_9] 2023-11-04T01:45:02.069 INFO:teuthology.orchestra.run.smithi114.stdout:root 468 0.0 0.0 0 0 ? I 01:24 0:00 \_ [kworker/u16:8-events_unbound] 2023-11-04T01:45:02.069 INFO:teuthology.orchestra.run.smithi114.stdout:root 469 0.0 0.0 0 0 ? I 01:24 0:00 \_ [kworker/u16:9-events_unbound] 2023-11-04T01:45:02.069 INFO:teuthology.orchestra.run.smithi114.stdout:root 491 0.0 0.0 0 0 ? S 01:24 0:00 \_ [jbd2/sda1-8] 2023-11-04T01:45:02.070 INFO:teuthology.orchestra.run.smithi114.stdout:root 492 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ext4-rsv-conver] 2023-11-04T01:45:02.070 INFO:teuthology.orchestra.run.smithi114.stdout:root 573 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ext4lazyinit] 2023-11-04T01:45:02.070 INFO:teuthology.orchestra.run.smithi114.stdout:root 631 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ipmi-msghandler] 2023-11-04T01:45:02.070 INFO:teuthology.orchestra.run.smithi114.stdout:root 648 0.0 0.0 0 0 ? SN 01:24 0:00 \_ [kipmi0] 2023-11-04T01:45:02.070 INFO:teuthology.orchestra.run.smithi114.stdout:root 674 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [rpciod] 2023-11-04T01:45:02.070 INFO:teuthology.orchestra.run.smithi114.stdout:root 675 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [xprtiod] 2023-11-04T01:45:02.070 INFO:teuthology.orchestra.run.smithi114.stdout:root 61008 0.0 0.0 0 0 ? I< 01:29 0:00 \_ [tls-strp] 2023-11-04T01:45:02.070 INFO:teuthology.orchestra.run.smithi114.stdout:root 61015 0.0 0.0 0 0 ? I 01:29 0:00 \_ [kworker/u16:2-xfs-cil/dm-1] 2023-11-04T01:45:02.070 INFO:teuthology.orchestra.run.smithi114.stdout:root 70311 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush/253:0] 2023-11-04T01:45:02.070 INFO:teuthology.orchestra.run.smithi114.stdout:root 70432 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush/253:1] 2023-11-04T01:45:02.070 INFO:teuthology.orchestra.run.smithi114.stdout:root 70552 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush/253:2] 2023-11-04T01:45:02.070 INFO:teuthology.orchestra.run.smithi114.stdout:root 70673 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush/253:3] 2023-11-04T01:45:02.070 INFO:teuthology.orchestra.run.smithi114.stdout:root 70804 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush/253:4] 2023-11-04T01:45:02.070 INFO:teuthology.orchestra.run.smithi114.stdout:root 71699 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfsalloc] 2023-11-04T01:45:02.071 INFO:teuthology.orchestra.run.smithi114.stdout:root 71700 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs_mru_cache] 2023-11-04T01:45:02.071 INFO:teuthology.orchestra.run.smithi114.stdout:root 71701 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-buf/dm-4] 2023-11-04T01:45:02.071 INFO:teuthology.orchestra.run.smithi114.stdout:root 71702 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-conv/dm-4] 2023-11-04T01:45:02.071 INFO:teuthology.orchestra.run.smithi114.stdout:root 71703 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:45:02.071 INFO:teuthology.orchestra.run.smithi114.stdout:root 71704 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:45:02.071 INFO:teuthology.orchestra.run.smithi114.stdout:root 71705 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:45:02.071 INFO:teuthology.orchestra.run.smithi114.stdout:root 71706 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-log/dm-4] 2023-11-04T01:45:02.071 INFO:teuthology.orchestra.run.smithi114.stdout:root 71707 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-cil/dm-4] 2023-11-04T01:45:02.071 INFO:teuthology.orchestra.run.smithi114.stdout:root 71708 0.0 0.0 0 0 ? S 01:32 0:00 \_ [xfsaild/dm-4] 2023-11-04T01:45:02.071 INFO:teuthology.orchestra.run.smithi114.stdout:root 76065 0.0 0.0 0 0 ? I 01:34 0:00 \_ [kworker/3:81-events] 2023-11-04T01:45:02.071 INFO:teuthology.orchestra.run.smithi114.stdout:root 76166 0.0 0.0 0 0 ? I 01:34 0:00 \_ [kworker/3:182-rcu_gp] 2023-11-04T01:45:02.071 INFO:teuthology.orchestra.run.smithi114.stdout:root 81936 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-buf/dm-0] 2023-11-04T01:45:02.071 INFO:teuthology.orchestra.run.smithi114.stdout:root 81937 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-conv/dm-0] 2023-11-04T01:45:02.071 INFO:teuthology.orchestra.run.smithi114.stdout:root 81938 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:45:02.072 INFO:teuthology.orchestra.run.smithi114.stdout:root 81939 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:45:02.072 INFO:teuthology.orchestra.run.smithi114.stdout:root 81940 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:45:02.072 INFO:teuthology.orchestra.run.smithi114.stdout:root 81941 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-log/dm-0] 2023-11-04T01:45:02.072 INFO:teuthology.orchestra.run.smithi114.stdout:root 81942 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-cil/dm-0] 2023-11-04T01:45:02.072 INFO:teuthology.orchestra.run.smithi114.stdout:root 81943 0.0 0.0 0 0 ? S 01:35 0:00 \_ [xfsaild/dm-0] 2023-11-04T01:45:02.072 INFO:teuthology.orchestra.run.smithi114.stdout:root 82020 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-buf/dm-1] 2023-11-04T01:45:02.072 INFO:teuthology.orchestra.run.smithi114.stdout:root 82021 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-conv/dm-1] 2023-11-04T01:45:02.072 INFO:teuthology.orchestra.run.smithi114.stdout:root 82022 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:45:02.072 INFO:teuthology.orchestra.run.smithi114.stdout:root 82023 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:45:02.072 INFO:teuthology.orchestra.run.smithi114.stdout:root 82024 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:45:02.072 INFO:teuthology.orchestra.run.smithi114.stdout:root 82025 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-log/dm-1] 2023-11-04T01:45:02.072 INFO:teuthology.orchestra.run.smithi114.stdout:root 82026 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-cil/dm-1] 2023-11-04T01:45:02.072 INFO:teuthology.orchestra.run.smithi114.stdout:root 82027 0.0 0.0 0 0 ? S 01:35 0:00 \_ [xfsaild/dm-1] 2023-11-04T01:45:02.072 INFO:teuthology.orchestra.run.smithi114.stdout:root 82104 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-buf/dm-2] 2023-11-04T01:45:02.072 INFO:teuthology.orchestra.run.smithi114.stdout:root 82105 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-conv/dm-2] 2023-11-04T01:45:02.073 INFO:teuthology.orchestra.run.smithi114.stdout:root 82106 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:45:02.073 INFO:teuthology.orchestra.run.smithi114.stdout:root 82107 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:45:02.073 INFO:teuthology.orchestra.run.smithi114.stdout:root 82108 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:45:02.073 INFO:teuthology.orchestra.run.smithi114.stdout:root 82109 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-log/dm-2] 2023-11-04T01:45:02.073 INFO:teuthology.orchestra.run.smithi114.stdout:root 82110 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-cil/dm-2] 2023-11-04T01:45:02.073 INFO:teuthology.orchestra.run.smithi114.stdout:root 82111 0.0 0.0 0 0 ? S 01:35 0:00 \_ [xfsaild/dm-2] 2023-11-04T01:45:02.073 INFO:teuthology.orchestra.run.smithi114.stdout:root 82188 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-buf/dm-3] 2023-11-04T01:45:02.073 INFO:teuthology.orchestra.run.smithi114.stdout:root 82189 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-conv/dm-3] 2023-11-04T01:45:02.073 INFO:teuthology.orchestra.run.smithi114.stdout:root 82190 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:45:02.073 INFO:teuthology.orchestra.run.smithi114.stdout:root 82191 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:45:02.073 INFO:teuthology.orchestra.run.smithi114.stdout:root 82192 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:45:02.073 INFO:teuthology.orchestra.run.smithi114.stdout:root 82193 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-log/dm-3] 2023-11-04T01:45:02.073 INFO:teuthology.orchestra.run.smithi114.stdout:root 82194 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-cil/dm-3] 2023-11-04T01:45:02.073 INFO:teuthology.orchestra.run.smithi114.stdout:root 82195 0.0 0.0 0 0 ? S 01:35 0:00 \_ [xfsaild/dm-3] 2023-11-04T01:45:02.073 INFO:teuthology.orchestra.run.smithi114.stdout:root 82241 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [dio/dm-0] 2023-11-04T01:45:02.074 INFO:teuthology.orchestra.run.smithi114.stdout:root 83403 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [dio/dm-1] 2023-11-04T01:45:02.074 INFO:teuthology.orchestra.run.smithi114.stdout:root 84565 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [dio/dm-2] 2023-11-04T01:45:02.074 INFO:teuthology.orchestra.run.smithi114.stdout:root 85728 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [dio/dm-3] 2023-11-04T01:45:02.074 INFO:teuthology.orchestra.run.smithi114.stdout:root 91531 0.0 0.0 0 0 ? I 01:36 0:00 \_ [kworker/5:136-mm_percpu_wq] 2023-11-04T01:45:02.074 INFO:teuthology.orchestra.run.smithi114.stdout:root 91621 0.0 0.0 0 0 ? I 01:36 0:00 \_ [kworker/5:226-cgwb_release] 2023-11-04T01:45:02.074 INFO:teuthology.orchestra.run.smithi114.stdout:root 91681 0.0 0.0 0 0 ? I 01:36 0:00 \_ [kworker/6:75-events_long] 2023-11-04T01:45:02.074 INFO:teuthology.orchestra.run.smithi114.stdout:root 91721 0.0 0.0 0 0 ? I 01:36 0:00 \_ [kworker/1:29-events] 2023-11-04T01:45:02.074 INFO:teuthology.orchestra.run.smithi114.stdout:root 91814 0.0 0.0 0 0 ? I 01:36 0:00 \_ [kworker/1:60-rcu_gp] 2023-11-04T01:45:02.074 INFO:teuthology.orchestra.run.smithi114.stdout:root 91885 0.0 0.0 0 0 ? I 01:36 0:00 \_ [kworker/6:140-events] 2023-11-04T01:45:02.074 INFO:teuthology.orchestra.run.smithi114.stdout:root 92518 0.0 0.0 0 0 ? I 01:36 0:00 \_ [kworker/7:100-events] 2023-11-04T01:45:02.074 INFO:teuthology.orchestra.run.smithi114.stdout:root 92604 0.0 0.0 0 0 ? I 01:36 0:00 \_ [kworker/7:186-xfs-conv/dm-4] 2023-11-04T01:45:02.074 INFO:teuthology.orchestra.run.smithi114.stdout:root 92681 0.0 0.0 0 0 ? I 01:36 0:00 \_ [kworker/7:254-rcu_gp] 2023-11-04T01:45:02.074 INFO:teuthology.orchestra.run.smithi114.stdout:root 92862 0.0 0.0 0 0 ? I 01:36 0:00 \_ [kworker/4:424-mm_percpu_wq] 2023-11-04T01:45:02.074 INFO:teuthology.orchestra.run.smithi114.stdout:root 92871 0.0 0.0 0 0 ? I 01:36 0:00 \_ [kworker/4:433-mm_percpu_wq] 2023-11-04T01:45:02.075 INFO:teuthology.orchestra.run.smithi114.stdout:root 93112 0.0 0.0 0 0 ? I 01:36 0:00 \_ [kworker/0:452-events] 2023-11-04T01:45:02.075 INFO:teuthology.orchestra.run.smithi114.stdout:root 93114 0.0 0.0 0 0 ? I 01:36 0:00 \_ [kworker/0:454-kacpi_notify] 2023-11-04T01:45:02.075 INFO:teuthology.orchestra.run.smithi114.stdout:root 93554 0.0 0.0 0 0 ? I 01:36 0:00 \_ [kworker/2:227-mm_percpu_wq] 2023-11-04T01:45:02.075 INFO:teuthology.orchestra.run.smithi114.stdout:root 93563 0.0 0.0 0 0 ? I 01:36 0:00 \_ [kworker/2:232-cgroup_destroy] 2023-11-04T01:45:02.075 INFO:teuthology.orchestra.run.smithi114.stdout:root 120637 0.0 0.0 0 0 ? I 01:41 0:00 \_ [kworker/u16:0-events_unbound] 2023-11-04T01:45:02.075 INFO:teuthology.orchestra.run.smithi114.stdout:root 120976 0.0 0.0 0 0 ? I 01:41 0:00 \_ [kworker/4:0-events_freezable] 2023-11-04T01:45:02.075 INFO:teuthology.orchestra.run.smithi114.stdout:root 124825 0.0 0.0 0 0 ? I 01:43 0:00 \_ [kworker/1:0-xfs-conv/dm-4] 2023-11-04T01:45:02.075 INFO:teuthology.orchestra.run.smithi114.stdout:root 124826 0.0 0.0 0 0 ? I 01:43 0:00 \_ [kworker/6:0-xfs-conv/dm-4] 2023-11-04T01:45:02.075 INFO:teuthology.orchestra.run.smithi114.stdout:root 126922 0.0 0.0 0 0 ? I 01:44 0:00 \_ [kworker/7:0-events_long] 2023-11-04T01:45:02.075 INFO:teuthology.orchestra.run.smithi114.stdout:root 126923 0.0 0.0 0 0 ? I 01:44 0:00 \_ [kworker/7:1] 2023-11-04T01:45:02.075 INFO:teuthology.orchestra.run.smithi114.stdout:root 128956 0.0 0.0 0 0 ? I 01:44 0:00 \_ [kworker/3:0-mm_percpu_wq] 2023-11-04T01:45:02.075 INFO:teuthology.orchestra.run.smithi114.stdout:root 1 0.2 0.0 175852 20180 ? Ss 01:24 0:02 /usr/lib/systemd/systemd --switched-root --system --deserialize 31 2023-11-04T01:45:02.075 INFO:teuthology.orchestra.run.smithi114.stdout:root 567 0.0 0.0 26792 16948 ? Ss 01:24 0:01 /usr/lib/systemd/systemd-journald 2023-11-04T01:45:02.075 INFO:teuthology.orchestra.run.smithi114.stdout:root 582 0.0 0.0 37676 15912 ? Ss 01:24 0:00 /usr/lib/systemd/systemd-udevd 2023-11-04T01:45:02.075 INFO:teuthology.orchestra.run.smithi114.stdout:rpc 652 0.0 0.0 13244 5648 ? Ss 01:24 0:00 /usr/bin/rpcbind -w -f 2023-11-04T01:45:02.076 INFO:teuthology.orchestra.run.smithi114.stdout:root 658 0.1 0.0 91932 4676 ? S stdin-killer -- python3 -c ' 2023-11-04T01:45:02.080 DEBUG:teuthology.orchestra.run.smithi114:> import os 2023-11-04T01:45:02.080 DEBUG:teuthology.orchestra.run.smithi114:> path = "/sys/fs/fuse/connections/41/abort" 2023-11-04T01:45:02.080 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists(path): 2023-11-04T01:45:02.080 DEBUG:teuthology.orchestra.run.smithi114:> open(path, "w").write("1") 2023-11-04T01:45:02.080 DEBUG:teuthology.orchestra.run.smithi114:> ' 2023-11-04T01:45:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:45:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:45:02.164 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:45:02.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:02.164 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:02.233 INFO:teuthology.orchestra.run.smithi114.stderr:mkdir: cannot create directory ‘d1/dir/.snap/s33’: Software caused connection abort 2023-11-04T01:45:02.235 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:45:03.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~28s 2023-11-04T01:45:09.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~38s 2023-11-04T01:45:16.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~45s 2023-11-04T01:45:21.482 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:21.485 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:22.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~51s 2023-11-04T01:45:29.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~58s 2023-11-04T01:45:36.217 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~65s 2023-11-04T01:45:42.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~71s 2023-11-04T01:45:49.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~78s 2023-11-04T01:45:51.620 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:51.624 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:56.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~85s 2023-11-04T01:46:02.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~91s 2023-11-04T01:46:09.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~98s 2023-11-04T01:46:15.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~104s 2023-11-04T01:46:21.705 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:21.708 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:22.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~111s 2023-11-04T01:46:29.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~118s 2023-11-04T01:46:35.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~124s 2023-11-04T01:46:42.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~131s 2023-11-04T01:46:48.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~137s 2023-11-04T01:46:51.779 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:51.782 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:55.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~144s 2023-11-04T01:47:02.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~151s 2023-11-04T01:47:08.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~157s 2023-11-04T01:47:15.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~164s 2023-11-04T01:47:21.934 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:21.938 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:21.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~170s 2023-11-04T01:47:28.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~177s 2023-11-04T01:47:35.220 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~184s 2023-11-04T01:47:41.832 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~190s 2023-11-04T01:47:48.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~197s 2023-11-04T01:47:52.056 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:52.060 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:55.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~204s 2023-11-04T01:48:01.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~210s 2023-11-04T01:48:08.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~217s 2023-11-04T01:48:14.886 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~223s 2023-11-04T01:48:21.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~230s 2023-11-04T01:48:22.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:22.165 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:28.106 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~237s 2023-11-04T01:48:34.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~243s 2023-11-04T01:48:41.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~250s 2023-11-04T01:48:47.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~256s 2023-11-04T01:48:52.315 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:52.319 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:54.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~263s 2023-11-04T01:49:01.162 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~270s 2023-11-04T01:49:07.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~276s 2023-11-04T01:49:14.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~283s 2023-11-04T01:49:20.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~289s 2023-11-04T01:49:22.461 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:22.464 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:27.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~296s 2023-11-04T01:49:34.221 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~303s 2023-11-04T01:49:34.221 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-11-04T01:49:34.222 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:49:34.222 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:49:34.241 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:49:34.241 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi114.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-11-04T01:49:34.241 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:49:34.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:34.241 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:49:34.299 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:49:34.299 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:49:34.357 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:49:34.357 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi114.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-11-04T01:49:34.357 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:49:34.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:34.357 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:49:34.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:49:34.414 INFO:teuthology.orchestra.run.smithi114.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:49:34.414 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:49:34.414 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:49:34.433 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:49:34.433 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi141.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-11-04T01:49:34.433 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:49:34.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:34.434 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:49:34.491 INFO:teuthology.orchestra.run.smithi141.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:49:34.492 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:49:34.492 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:49:34.492 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:49:34.550 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:49:34.551 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi141.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-11-04T01:49:34.551 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:49:34.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:34.551 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:49:34.608 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:49:34.608 INFO:teuthology.orchestra.run.smithi141.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:49:36.217 INFO:tasks.ceph.osd.0:Sent signal 15 2023-11-04T01:49:36.218 INFO:tasks.ceph.osd.1:Sent signal 15 2023-11-04T01:49:36.218 INFO:tasks.ceph.osd.2:Sent signal 15 2023-11-04T01:49:36.218 INFO:tasks.ceph.osd.3:Sent signal 15 2023-11-04T01:49:36.218 INFO:tasks.ceph.osd.4:Sent signal 15 2023-11-04T01:49:36.219 INFO:tasks.ceph.osd.5:Sent signal 15 2023-11-04T01:49:36.219 INFO:tasks.ceph.osd.6:Sent signal 15 2023-11-04T01:49:36.219 INFO:tasks.ceph.osd.7:Sent signal 15 2023-11-04T01:49:36.219 INFO:tasks.ceph.mds.a:Sent signal 15 2023-11-04T01:49:36.220 INFO:tasks.ceph.mds.c:Sent signal 15 2023-11-04T01:49:36.220 INFO:tasks.ceph.mds.d:Sent signal 15 2023-11-04T01:49:36.220 INFO:tasks.ceph.mon.a:Sent signal 15 2023-11-04T01:49:36.220 INFO:tasks.ceph.mon.b:Sent signal 15 2023-11-04T01:49:36.220 INFO:tasks.ceph.mon.c:Sent signal 15 2023-11-04T01:49:36.221 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-11-04T01:49:36.221 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-11-04T01:49:36.222 INFO:tasks.ceph.osd.4.smithi141.stderr:2023-11-04T01:49:36.218+0000 7f4a027ec640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 118832) UID: 0 2023-11-04T01:49:36.222 INFO:tasks.ceph.osd.4.smithi141.stderr:2023-11-04T01:49:36.218+0000 7f4a027ec640 -1 osd.4 116 *** Got signal Terminated *** 2023-11-04T01:49:36.222 INFO:tasks.ceph.osd.4.smithi141.stderr:2023-11-04T01:49:36.218+0000 7f4a027ec640 -1 osd.4 116 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:49:36.222 INFO:tasks.ceph.osd.5.smithi141.stderr:2023-11-04T01:49:36.218+0000 7ff22d0f4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 118834) UID: 0 2023-11-04T01:49:36.222 INFO:tasks.ceph.osd.5.smithi141.stderr:2023-11-04T01:49:36.218+0000 7ff22d0f4640 -1 osd.5 116 *** Got signal Terminated *** 2023-11-04T01:49:36.222 INFO:tasks.ceph.osd.5.smithi141.stderr:2023-11-04T01:49:36.218+0000 7ff22d0f4640 -1 osd.5 116 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:49:36.223 INFO:tasks.ceph.osd.6.smithi141.stderr:2023-11-04T01:49:36.218+0000 7f2867d25640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 118837) UID: 0 2023-11-04T01:49:36.223 INFO:tasks.ceph.osd.6.smithi141.stderr:2023-11-04T01:49:36.218+0000 7f2867d25640 -1 osd.6 116 *** Got signal Terminated *** 2023-11-04T01:49:36.223 INFO:tasks.ceph.osd.6.smithi141.stderr:2023-11-04T01:49:36.218+0000 7f2867d25640 -1 osd.6 116 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:49:36.223 INFO:tasks.ceph.osd.7.smithi141.stderr:2023-11-04T01:49:36.219+0000 7f6452f6f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 118839) UID: 0 2023-11-04T01:49:36.223 INFO:tasks.ceph.osd.7.smithi141.stderr:2023-11-04T01:49:36.219+0000 7f6452f6f640 -1 osd.7 116 *** Got signal Terminated *** 2023-11-04T01:49:36.223 INFO:tasks.ceph.osd.7.smithi141.stderr:2023-11-04T01:49:36.219+0000 7f6452f6f640 -1 osd.7 116 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:49:36.224 INFO:tasks.ceph.mds.d.smithi141.stderr:2023-11-04T01:49:36.219+0000 7efcb2c24640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 126951) UID: 0 2023-11-04T01:49:36.224 INFO:tasks.ceph.mds.d.smithi141.stderr:2023-11-04T01:49:36.219+0000 7efcb2c24640 -1 mds.d *** got signal Terminated *** 2023-11-04T01:49:36.224 INFO:tasks.ceph.mon.b.smithi141.stderr:2023-11-04T01:49:36.220+0000 7f5134701640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 118261) UID: 0 2023-11-04T01:49:36.224 INFO:tasks.ceph.mon.b.smithi141.stderr:2023-11-04T01:49:36.220+0000 7f5134701640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-11-04T01:49:36.224 INFO:tasks.ceph.mon.c.smithi141.stderr:2023-11-04T01:49:36.220+0000 7f31533e0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 118265) UID: 0 2023-11-04T01:49:36.224 INFO:tasks.ceph.mon.c.smithi141.stderr:2023-11-04T01:49:36.220+0000 7f31533e0640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-11-04T01:49:36.225 INFO:tasks.ceph.osd.0.smithi114.stderr:2023-11-04T01:49:36.217+0000 7fc7f9502640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 87805) UID: 0 2023-11-04T01:49:36.225 INFO:tasks.ceph.osd.0.smithi114.stderr:2023-11-04T01:49:36.217+0000 7fc7f9502640 -1 osd.0 116 *** Got signal Terminated *** 2023-11-04T01:49:36.225 INFO:tasks.ceph.osd.0.smithi114.stderr:2023-11-04T01:49:36.217+0000 7fc7f9502640 -1 osd.0 116 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:49:36.225 INFO:tasks.ceph.osd.1.smithi114.stderr:2023-11-04T01:49:36.217+0000 7f9b1f08b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 87813) UID: 0 2023-11-04T01:49:36.226 INFO:tasks.ceph.osd.1.smithi114.stderr:2023-11-04T01:49:36.217+0000 7f9b1f08b640 -1 osd.1 116 *** Got signal Terminated *** 2023-11-04T01:49:36.226 INFO:tasks.ceph.osd.1.smithi114.stderr:2023-11-04T01:49:36.217+0000 7f9b1f08b640 -1 osd.1 116 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:49:36.226 INFO:tasks.ceph.osd.2.smithi114.stderr:2023-11-04T01:49:36.217+0000 7f3942b7a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 87812) UID: 0 2023-11-04T01:49:36.226 INFO:tasks.ceph.osd.2.smithi114.stderr:2023-11-04T01:49:36.217+0000 7f3942b7a640 -1 osd.2 116 *** Got signal Terminated *** 2023-11-04T01:49:36.226 INFO:tasks.ceph.osd.2.smithi114.stderr:2023-11-04T01:49:36.217+0000 7f3942b7a640 -1 osd.2 116 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:49:36.226 INFO:tasks.ceph.osd.3.smithi114.stderr:2023-11-04T01:49:36.218+0000 7f1274831640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 87816) UID: 0 2023-11-04T01:49:36.226 INFO:tasks.ceph.osd.3.smithi114.stderr:2023-11-04T01:49:36.218+0000 7f1274831640 -1 osd.3 116 *** Got signal Terminated *** 2023-11-04T01:49:36.227 INFO:tasks.ceph.osd.3.smithi114.stderr:2023-11-04T01:49:36.218+0000 7f1274831640 -1 osd.3 116 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:49:36.227 INFO:tasks.ceph.mds.a.smithi114.stderr:2023-11-04T01:49:36.219+0000 7f8d4ac10640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 127302) UID: 0 2023-11-04T01:49:36.227 INFO:tasks.ceph.mds.a.smithi114.stderr:2023-11-04T01:49:36.219+0000 7f8d4ac10640 -1 mds.a *** got signal Terminated *** 2023-11-04T01:49:36.228 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:49:36.219+0000 7f2fe1f5e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 125162) UID: 0 2023-11-04T01:49:36.228 INFO:tasks.ceph.mds.c.smithi114.stderr:2023-11-04T01:49:36.219+0000 7f2fe1f5e640 -1 mds.c *** got signal Terminated *** 2023-11-04T01:49:36.228 INFO:tasks.ceph.mon.a.smithi114.stderr:2023-11-04T01:49:36.219+0000 7f5b2a6c3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 87545) UID: 0 2023-11-04T01:49:36.228 INFO:tasks.ceph.mon.a.smithi114.stderr:2023-11-04T01:49:36.219+0000 7f5b2a6c3640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-04T01:49:36.228 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:49:36.220+0000 7f6b127a0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 87572) UID: 0 2023-11-04T01:49:36.228 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-11-04T01:49:36.220+0000 7f6b127a0640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-11-04T01:49:36.422 INFO:tasks.ceph.mgr.x.smithi141.stderr:daemon-helper: command crashed with signal 15 2023-11-04T01:49:49.174 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2023-11-04T01:49:49 stdin-killer ERROR: timeout expired: sending signal 9 to command and myself 2023-11-04T01:49:49.178 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:bash: line 1: 128293 Killed ( cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 ) 2023-11-04T01:49:52.571 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:52.574 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:55.101 DEBUG:teuthology.orchestra.run:got remote process result: 137 2023-11-04T01:49:55.101 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:49:55.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:55.101 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:49:55.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:49:55.119 INFO:teuthology.orchestra.run.smithi114.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-04T01:49:55.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:55.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.268+0000 7efde949b640 1 Processor -- start 2023-11-04T01:49:55.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.268+0000 7efde949b640 1 -- start start 2023-11-04T01:49:55.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.269+0000 7efde949b640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efde415d4e0 0x7efde40d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:55.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.269+0000 7efde949b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 0x7efde40d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:55.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.269+0000 7efde949b640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b32b0 con 0x7efde415d100 2023-11-04T01:49:55.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.269+0000 7efde949b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cec20 con 0x7efde40d3b60 2023-11-04T01:49:55.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.269+0000 7efde949b640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efde415d4e0 2023-11-04T01:49:55.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.269+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 msgr2=0x7efde40d1a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:49:55.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.269+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 0x7efde40d1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:55.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.269+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efde40ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:49:55.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.269+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efde415d4e0 msgr2=0x7efde40d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:49:55.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.269+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efde415d4e0 0x7efde40d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.470+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 msgr2=0x7efde40d1a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:49:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.470+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 0x7efde40d1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.470+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efde415d4e0 msgr2=0x7efde40d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:49:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.470+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efde40ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:49:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.470+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efde415d4e0 0x7efde40d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:55.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.871+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 msgr2=0x7efde40d1a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:49:55.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.871+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 0x7efde40d1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:55.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.871+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efde415d4e0 msgr2=0x7efde40d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:49:55.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.871+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efde40ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:49:55.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:55.871+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efde415d4e0 0x7efde40d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:56.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:56.672+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 msgr2=0x7efde40d1a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:49:56.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:56.672+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 0x7efde40d1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:56.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:56.672+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efde415d4e0 msgr2=0x7efde40d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:49:56.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:56.672+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efde40ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:49:56.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:56.672+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efde415d4e0 0x7efde40d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:49:58.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.270+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efde415d4e0 msgr2=0x7efde40d14d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:58.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.270+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efde415d4e0 0x7efde40d14d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:58.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.270+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 msgr2=0x7efde40d1a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:58.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.270+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 0x7efde40d1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:58.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.270+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efde40ce510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:49:58.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.270+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003690 0x7efdc4005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:58.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.270+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b4750 con 0x7efdc4006120 2023-11-04T01:49:58.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.270+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4003690 2023-11-04T01:49:58.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.270+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4006120 legacy=0x7efdc40085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:49:58.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.270+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003690 msgr2=0x7efdc4005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:49:58.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.270+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003690 0x7efdc4005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:49:58.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.471+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4006120 legacy=0x7efdc40085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:49:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.471+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003690 msgr2=0x7efdc4005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:49:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.471+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003690 0x7efdc4005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:49:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.872+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4006120 legacy=0x7efdc40085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:49:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.872+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003690 msgr2=0x7efdc4005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:49:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:58.872+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003690 0x7efdc4005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:49:59.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:59.673+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4006120 legacy=0x7efdc40085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:49:59.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:59.673+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003690 msgr2=0x7efdc4005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:49:59.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:49:59.673+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003690 0x7efdc4005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:01.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.270+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003690 msgr2=0x7efdc4005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:01.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.270+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003690 0x7efdc4005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:01.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.270+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4006120 legacy=0x7efdc40085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:01.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.270+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:50:01.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.270+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 0x7efdc4009eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:01.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.270+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b32b0 con 0x7efdc4006120 2023-11-04T01:50:01.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.270+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b4750 con 0x7efde415d100 2023-11-04T01:50:01.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.270+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efde40d3b60 2023-11-04T01:50:01.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.270+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4006120 legacy=0x7efdc40085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:01.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.270+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 msgr2=0x7efdc4009eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:01.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.270+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 0x7efdc4009eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:01.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.270+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.471+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4006120 legacy=0x7efdc40085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.471+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 msgr2=0x7efdc4009eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.471+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 0x7efdc4009eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.471+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:01.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.872+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4006120 legacy=0x7efdc40085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:01.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.872+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 msgr2=0x7efdc4009eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:01.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.872+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 0x7efdc4009eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:01.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:01.872+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:02.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:02.672+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 msgr2=0x7efdc4009eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:02.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:02.672+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4006120 legacy=0x7efdc40085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:02.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:02.672+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 0x7efdc4009eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:02.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:02.672+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:04.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.270+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 msgr2=0x7efdc4009eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:04.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.270+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efde40d3b60 0x7efdc4009eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.270+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:04.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.270+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4006120 legacy=0x7efdc40085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:04.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.270+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.270+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010600 0x7efdc4012aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.270+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4010600 2023-11-04T01:50:04.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.270+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc4003ad0 2023-11-04T01:50:04.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.270+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc40100c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:04.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.270+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010600 msgr2=0x7efdc4012aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:04.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.270+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:04.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.270+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010600 0x7efdc4012aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:04.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.471+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010600 msgr2=0x7efdc4012aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:04.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.471+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc40100c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:04.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.471+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010600 0x7efdc4012aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:04.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.471+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.872+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010600 msgr2=0x7efdc4012aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.872+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc40100c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.872+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010600 0x7efdc4012aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:04.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:04.872+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:05.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:05.674+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc40100c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:05.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:05.674+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010600 msgr2=0x7efdc4012aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:05.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:05.674+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:05.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:05.674+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010600 0x7efdc4012aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:07.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.270+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc40100c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.270+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.270+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010600 msgr2=0x7efdc4012aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.270+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010600 0x7efdc4012aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.270+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:50:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.270+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.270+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc400ac60 con 0x7efdc4006120 2023-11-04T01:50:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.270+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b32b0 con 0x7efde415d100 2023-11-04T01:50:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.270+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4003ad0 2023-11-04T01:50:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.270+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4006120 legacy=0x7efdc40085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.270+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.270+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc40100c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.270+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:07.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.471+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4006120 legacy=0x7efdc40085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:07.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.471+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc40100c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:07.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.471+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:07.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.471+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:07.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.872+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4006120 legacy=0x7efdc40085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:07.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.872+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:07.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.872+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc40100c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:07.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:07.872+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:08.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:08.673+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4006120 legacy=0x7efdc40085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:08.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:08.673+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:08.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:08.673+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc40100c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:08.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:08.673+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:10.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.270+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc40100c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:10.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.270+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:10.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.270+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:10.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.270+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4006120 legacy=0x7efdc40085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:10.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.270+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4009f10 0x7efdc4010a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:10.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.270+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010ff0 0x7efdc4011480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:10.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.270+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4009f10 2023-11-04T01:50:10.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.270+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc4010ff0 2023-11-04T01:50:10.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.270+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4009f10 msgr2=0x7efdc4010a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:10.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.270+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4009f10 0x7efdc4010a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:10.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.271+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010ff0 msgr2=0x7efdc4011480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:10.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.271+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010ff0 0x7efdc4011480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:10.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.471+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4009f10 msgr2=0x7efdc4010a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:10.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.471+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4009f10 0x7efdc4010a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:10.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.472+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010ff0 msgr2=0x7efdc4011480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:10.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.472+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010ff0 0x7efdc4011480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:10.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.872+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4009f10 msgr2=0x7efdc4010a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:10.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.872+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4009f10 0x7efdc4010a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.873+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010ff0 msgr2=0x7efdc4011480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:10.873+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010ff0 0x7efdc4011480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:11.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:11.673+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4009f10 msgr2=0x7efdc4010a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:11.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:11.673+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4009f10 0x7efdc4010a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:11.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:11.674+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010ff0 msgr2=0x7efdc4011480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:11.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:11.674+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010ff0 0x7efdc4011480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:13.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.271+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010ff0 msgr2=0x7efdc4011480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:13.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.271+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4010ff0 0x7efdc4011480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:13.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.271+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4009f10 msgr2=0x7efdc4010a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:13.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.271+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4009f10 0x7efdc4010a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:13.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.271+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:13.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.271+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:50:13.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.271+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:13.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.271+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b4750 con 0x7efde415d100 2023-11-04T01:50:13.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.271+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4011b50 2023-11-04T01:50:13.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.271+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc4003ad0 2023-11-04T01:50:13.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.271+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:13.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.271+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:13.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.271+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:13.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.271+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc40100c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:13.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.271+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:13.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.472+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:13.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.472+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:13.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.472+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:13.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.472+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc40100c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:13.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.472+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:13.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.873+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:13.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.873+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:13.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.873+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:13.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.873+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc40100c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:13.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:13.873+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:14.674+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:14.674+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:14.674+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:14.674+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc40100c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:14.674+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.271+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc40100c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.271+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc40100c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.271+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.271+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.271+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.271+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011530 0x7efdc4010a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.271+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc400ac60 con 0x7efdc4012510 2023-11-04T01:50:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.271+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4011530 2023-11-04T01:50:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.271+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012510 legacy=0x7efdc40065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.271+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011530 msgr2=0x7efdc4010a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.271+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011530 0x7efdc4010a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:16.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.472+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012510 legacy=0x7efdc40065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:16.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.472+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011530 msgr2=0x7efdc4010a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:16.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.472+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011530 0x7efdc4010a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:16.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.873+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012510 legacy=0x7efdc40065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:16.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.873+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011530 msgr2=0x7efdc4010a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:16.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:16.873+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011530 0x7efdc4010a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:17.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:17.674+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012510 legacy=0x7efdc40065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:17.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:17.674+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011530 msgr2=0x7efdc4010a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:17.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:17.674+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011530 0x7efdc4010a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:19.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.271+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011530 msgr2=0x7efdc4010a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.271+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011530 0x7efdc4010a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.271+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012510 legacy=0x7efdc40065d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.271+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 0x7efdc40172f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.271+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:50:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.271+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.271+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b4750 con 0x7efde415d100 2023-11-04T01:50:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.271+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4011b50 2023-11-04T01:50:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.271+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc4012a80 2023-11-04T01:50:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.271+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:19.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.271+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:19.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.271+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 msgr2=0x7efdc40172f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:19.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.271+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:19.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.271+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 0x7efdc40172f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:19.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.472+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:19.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.472+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:19.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.472+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:19.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.472+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 msgr2=0x7efdc40172f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:19.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.472+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 0x7efdc40172f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:19.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.873+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:19.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.873+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:19.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.873+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:19.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.873+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 msgr2=0x7efdc40172f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:19.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:19.873+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 0x7efdc40172f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:20.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:20.674+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:20.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:20.674+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:20.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:20.674+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 msgr2=0x7efdc40172f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:20.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:20.674+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:20.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:20.674+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 0x7efdc40172f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:22.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.271+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 msgr2=0x7efdc40172f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:22.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.271+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 0x7efdc40172f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:22.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.271+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:22.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.271+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:22.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.271+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efde415d100 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:22.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.271+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc4010a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:22.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.272+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc400ac60 con 0x7efdc40065b0 2023-11-04T01:50:22.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.272+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4003ad0 2023-11-04T01:50:22.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.272+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc40065b0 legacy=0x7efdc4006990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:22.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.272+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc4010a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:22.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.272+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc4010a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:22.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.473+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc40065b0 legacy=0x7efdc4006990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:22.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.473+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc4010a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:22.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.473+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc4010a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:22.646 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:22.649 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:22.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.874+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc40065b0 legacy=0x7efdc4006990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:22.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.874+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc4010a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:22.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:22.874+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc4010a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:23.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:23.675+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc40065b0 legacy=0x7efdc4006990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:23.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:23.675+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc4010a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:23.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:23.675+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc4010a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:25.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.272+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 msgr2=0x7efdc4010a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:25.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.272+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4003ad0 0x7efdc4010a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:25.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.272+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc40065b0 legacy=0x7efdc4006990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:25.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.272+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 0x7efdc40090b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:25.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.272+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:50:25.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.272+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 0x7efdc4010a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:25.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.272+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b4750 con 0x7efdc40065b0 2023-11-04T01:50:25.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.272+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4012a80 2023-11-04T01:50:25.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.272+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc4010110 2023-11-04T01:50:25.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.272+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc40065b0 legacy=0x7efdc4006990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:25.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.272+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 msgr2=0x7efdc40090b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:25.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.272+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 0x7efdc40090b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:25.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.272+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 msgr2=0x7efdc4010a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:25.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.272+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 0x7efdc4010a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:25.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.473+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc40065b0 legacy=0x7efdc4006990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:25.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.473+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 msgr2=0x7efdc40090b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:25.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.473+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 msgr2=0x7efdc4010a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:25.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.473+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 0x7efdc40090b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:25.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.473+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 0x7efdc4010a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:25.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.874+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc40065b0 legacy=0x7efdc4006990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:25.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.874+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 msgr2=0x7efdc40090b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:25.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.874+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 msgr2=0x7efdc4010a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:25.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.874+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 0x7efdc4010a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:25.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:25.874+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 0x7efdc40090b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:26.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:26.675+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc40065b0 legacy=0x7efdc4006990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:26.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:26.675+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 msgr2=0x7efdc4010a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:26.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:26.675+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 0x7efdc4010a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:26.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:26.675+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 msgr2=0x7efdc40090b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:26.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:26.675+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 0x7efdc40090b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:28.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.272+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 msgr2=0x7efdc4010a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:28.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.272+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 0x7efdc4010a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:28.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.272+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 msgr2=0x7efdc40090b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:28.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.272+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a80 0x7efdc40090b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:28.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.272+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc40065b0 legacy=0x7efdc4006990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:28.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.272+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a480 0x7efdc40095f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:28.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.272+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc400ac60 con 0x7efdc4011b50 2023-11-04T01:50:28.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.272+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc400a480 2023-11-04T01:50:28.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.272+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a480 msgr2=0x7efdc40095f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:28.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.272+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a480 0x7efdc40095f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:28.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.272+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4011b50 legacy=0x7efdc400f0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:28.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.473+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a480 msgr2=0x7efdc40095f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:28.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.473+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a480 0x7efdc40095f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:28.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.473+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4011b50 legacy=0x7efdc400f0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:28.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.874+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a480 msgr2=0x7efdc40095f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:28.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.874+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a480 0x7efdc40095f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:28.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:28.874+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4011b50 legacy=0x7efdc400f0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:29.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:29.675+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a480 msgr2=0x7efdc40095f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:29.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:29.675+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a480 0x7efdc40095f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:29.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:29.675+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4011b50 legacy=0x7efdc400f0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.273+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a480 msgr2=0x7efdc40095f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.273+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a480 0x7efdc40095f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.273+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4011b50 legacy=0x7efdc400f0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.273+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 0x7efdc4010a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.273+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:50:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.273+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:31.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.273+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b4750 con 0x7efdc4012a80 2023-11-04T01:50:31.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.273+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4011b50 2023-11-04T01:50:31.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.273+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc4010110 2023-11-04T01:50:31.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.273+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 msgr2=0x7efdc4010a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:31.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.273+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012a80 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:31.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.273+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:31.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.273+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 0x7efdc4010a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:31.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.273+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:31.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.474+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012a80 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:31.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.474+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:31.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.474+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 msgr2=0x7efdc4010a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:31.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.474+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 0x7efdc4010a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:31.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.474+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:31.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.875+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 msgr2=0x7efdc4010a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:31.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.875+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:31.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.875+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012a80 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:31.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.875+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 0x7efdc4010a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:31.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:31.875+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:32.676+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012a80 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:32.676+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 msgr2=0x7efdc4010a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:32.676+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:32.676+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:32.676+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 0x7efdc4010a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.273+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 msgr2=0x7efdc4010a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.273+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4010110 0x7efdc4010a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.273+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.273+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.273+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012a80 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.273+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.273+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc400ac60 con 0x7efdc4005ae0 2023-11-04T01:50:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.273+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc40095d0 2023-11-04T01:50:34.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.273+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:34.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.273+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005ae0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:34.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.273+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:34.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.474+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:34.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.474+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005ae0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:34.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.474+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:34.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.875+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:34.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.875+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005ae0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:34.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:34.875+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:35.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:35.676+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:35.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:35.676+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005ae0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:35.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:35.676+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:37.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.274+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:37.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.274+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.274+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005ae0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.274+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.274+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.274+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:50:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.274+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b4750 con 0x7efdc4005ae0 2023-11-04T01:50:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.274+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc40095d0 2023-11-04T01:50:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.274+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc4011b50 2023-11-04T01:50:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.274+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005ae0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.274+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.274+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.274+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.274+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:37.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.475+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005ae0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:37.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.475+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:37.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.475+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:37.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.475+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:37.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.475+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:37.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.876+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005ae0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:37.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.876+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:37.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.876+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:37.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.876+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:37.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:37.876+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:38.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:38.677+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:38.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:38.677+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005ae0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:38.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:38.677+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:38.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:38.677+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:38.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:38.677+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:40.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.274+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:40.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.274+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:40.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.274+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.274+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.274+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005ae0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.274+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012a50 0x7efdc4010a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.274+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc400ac60 con 0x7efdc4010110 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.274+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4012a50 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.274+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4010110 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.274+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012a50 msgr2=0x7efdc4010a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.274+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012a50 0x7efdc4010a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:40.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.475+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012a50 msgr2=0x7efdc4010a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:40.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.475+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4010110 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:40.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.475+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012a50 0x7efdc4010a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:40.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.876+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4010110 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:40.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.876+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012a50 msgr2=0x7efdc4010a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:40.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:40.876+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012a50 0x7efdc4010a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:41.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:41.677+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4010110 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:41.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:41.677+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012a50 msgr2=0x7efdc4010a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:41.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:41.677+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012a50 0x7efdc4010a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.274+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012a50 msgr2=0x7efdc4010a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.274+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012a50 0x7efdc4010a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.274+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4010110 legacy=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.274+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.274+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.274+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.274+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b4750 con 0x7efdc4016270 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.274+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4012a50 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.274+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc4011b50 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.274+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.274+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.274+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.274+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4016270 legacy=0x7efdc4018660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.274+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:43.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.475+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:43.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.475+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:43.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.475+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4016270 legacy=0x7efdc4018660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:43.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.475+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:43.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.475+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.876+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.876+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.876+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4016270 legacy=0x7efdc4018660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.876+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:43.876+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:44.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:44.677+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:44.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:44.677+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:44.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:44.677+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:44.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:44.677+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4016270 legacy=0x7efdc4018660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:44.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:44.677+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:46.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.274+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 msgr2=0x7efdc4011f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:46.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.274+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4011b50 0x7efdc4011f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:46.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.274+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:46.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.274+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:46.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.274+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4016270 legacy=0x7efdc4018660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:46.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.274+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a480 0x7efdc40085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:46.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.274+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc400ac60 con 0x7efdc4005ae0 2023-11-04T01:50:46.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.274+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc400a480 2023-11-04T01:50:46.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.274+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005ae0 legacy=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:46.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.274+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a480 msgr2=0x7efdc40085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:46.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.274+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a480 0x7efdc40085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:46.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.475+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005ae0 legacy=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:46.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.475+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a480 msgr2=0x7efdc40085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:46.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.475+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a480 0x7efdc40085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:46.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.876+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005ae0 legacy=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:46.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.876+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a480 msgr2=0x7efdc40085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:46.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:46.876+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a480 0x7efdc40085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:47.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:47.677+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005ae0 legacy=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:47.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:47.677+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a480 msgr2=0x7efdc40085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:47.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:47.677+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a480 0x7efdc40085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:49.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.274+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a480 msgr2=0x7efdc40085c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:49.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.274+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a480 0x7efdc40085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:49.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.274+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005ae0 legacy=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:49.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.274+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:49.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.274+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:50:49.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.274+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc400a480 0x7efdc4011b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:49.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.274+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 0x7efdc400f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:49.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.274+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4012a50 2023-11-04T01:50:49.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.274+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc400a480 2023-11-04T01:50:49.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.274+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc400fd80 con 0x7efdc4012090 2023-11-04T01:50:49.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.274+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:49.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.274+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:49.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.274+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc400a480 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:49.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.274+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:49.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.274+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc400a480 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:49.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.274+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:49.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.475+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:49.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.475+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:49.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.475+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:49.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.475+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc400a480 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:49.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.475+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:49.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.475+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc400a480 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:49.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.876+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:49.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.876+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:49.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.876+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc400a480 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:49.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.876+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:49.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.876+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:49.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:49.876+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc400a480 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:50.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:50.677+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:50.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:50.677+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:50.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:50.677+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:50.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:50.677+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:50.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:50.677+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc400a480 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:50.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:50.677+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc400a480 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:52.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:52.274+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:52.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:52.274+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:52.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:52.274+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc400a480 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:52.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:52.274+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc400a480 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:52.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:52.274+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:52.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:52.274+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:52.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:52.274+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b4750 con 0x7efdc4005aa0 2023-11-04T01:50:52.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:52.274+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc400ac60 con 0x7efdc40095d0 2023-11-04T01:50:52.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:52.274+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:52.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:52.274+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc40095d0 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:52.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:52.475+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:52.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:52.475+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc40095d0 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:52.791 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:52.794 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:52.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:52.876+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:52.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:52.876+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc40095d0 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:53.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:53.677+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:53.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:53.677+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc40095d0 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.274+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc40095d0 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.274+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.274+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.274+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 0x7efdc400f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.274+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:50:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.275+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b32b0 con 0x7efdc4011b50 2023-11-04T01:50:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.275+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4012a50 2023-11-04T01:50:55.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.275+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc4012090 2023-11-04T01:50:55.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.275+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:55.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.275+0000 7efde37fe640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4011b50 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:55.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.275+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:55.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.275+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:55.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.275+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:55.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.476+0000 7efde37fe640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4011b50 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:55.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.476+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:55.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.476+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:55.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.476+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:55.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.476+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:55.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.877+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:55.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.877+0000 7efde37fe640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4011b50 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:55.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.877+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:55.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.877+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:55.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:55.877+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:56.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:56.678+0000 7efde37fe640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4011b50 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:50:56.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:56.678+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:50:56.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:56.678+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:56.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:56.678+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:50:56.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:56.678+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:50:58.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.275+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:58.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.275+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4012090 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:58.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.275+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:58.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.275+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:58.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.275+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4011b50 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:50:58.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.275+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 0x7efdc400a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:58.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.275+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b4750 con 0x7efdc40095d0 2023-11-04T01:50:58.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.275+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4005aa0 2023-11-04T01:50:58.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.275+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc40095d0 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:58.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.275+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 msgr2=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:58.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.275+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 0x7efdc400a480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:50:58.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.476+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 msgr2=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:58.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.476+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc40095d0 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:58.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.476+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 0x7efdc400a480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:50:58.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.877+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc40095d0 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:58.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.877+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 msgr2=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:58.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:58.877+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 0x7efdc400a480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:50:59.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:59.678+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc40095d0 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:50:59.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:59.678+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 msgr2=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:50:59.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:50:59.678+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 0x7efdc400a480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:01.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.275+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 msgr2=0x7efdc400a480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:01.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.275+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 0x7efdc400a480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:01.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.275+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc40095d0 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:01.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.275+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:01.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.275+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:51:01.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.275+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 0x7efdc4011b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:01.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.275+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b32b0 con 0x7efdc4005aa0 2023-11-04T01:51:01.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.275+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4012a50 2023-11-04T01:51:01.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.275+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc400a420 2023-11-04T01:51:01.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.275+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:01.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.275+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:01.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.275+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:01.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.275+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:01.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.275+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:01.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.476+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:01.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.476+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:01.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.476+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:01.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.476+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:01.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.476+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:01.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.877+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:01.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.877+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:01.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.877+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:01.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.877+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:01.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:01.877+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:02.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:02.678+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:02.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:02.678+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:02.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:02.678+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:02.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:02.678+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:02.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:02.678+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:04.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.275+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:04.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.275+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:04.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.275+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:04.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.275+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:04.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.275+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:04.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.275+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc400f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:04.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.275+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b4750 con 0x7efdc4012090 2023-11-04T01:51:04.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.275+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc40095d0 2023-11-04T01:51:04.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.275+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:04.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.276+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:04.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.276+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc400f780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:04.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.476+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:04.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.477+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:04.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.477+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc400f780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:04.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.877+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.878+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:04.878+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc400f780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:05.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:05.678+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:05.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:05.679+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:05.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:05.679+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc400f780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:07.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.276+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:07.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.276+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc400f780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:07.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.276+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:07.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.276+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:07.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.276+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:51:07.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.276+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 0x7efdc4011b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:07.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.276+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b32b0 con 0x7efdc4012090 2023-11-04T01:51:07.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.276+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4012a50 2023-11-04T01:51:07.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.276+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc400a420 2023-11-04T01:51:07.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.276+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:07.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.276+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:07.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.276+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:07.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.276+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:07.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.276+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:07.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.477+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:07.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.477+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:07.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.477+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:07.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.477+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:07.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.477+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.878+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:07.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.878+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:07.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.878+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:07.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.878+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:07.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:07.878+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:08.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:08.679+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:08.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:08.679+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:08.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:08.679+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:08.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:08.679+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:08.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:08.679+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:10.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.276+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:10.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.276+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400a420 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:10.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.276+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:10.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.276+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:10.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.276+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:10.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.276+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:10.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.276+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b4750 con 0x7efdc4005aa0 2023-11-04T01:51:10.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.276+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc40095d0 2023-11-04T01:51:10.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.276+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:10.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.276+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:10.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.276+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:10.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.477+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:10.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.477+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:10.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.477+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:10.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.878+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:10.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.878+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:10.878+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:11.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:11.679+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:11.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:11.679+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:11.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:11.679+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:13.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.276+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc400f070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:13.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.276+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc400f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:13.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.276+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:13.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.276+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:51:13.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.276+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:13.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.276+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:13.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.276+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b32b0 con 0x7efdc4012090 2023-11-04T01:51:13.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.276+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc400a420 2023-11-04T01:51:13.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.276+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc40095d0 2023-11-04T01:51:13.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.276+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:13.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.276+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:13.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.276+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:13.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.276+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:13.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.276+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:13.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.477+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:13.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.477+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:13.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.477+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:13.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.477+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:13.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.477+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:13.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.878+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:13.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.878+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:13.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.878+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:13.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.878+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:13.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:13.878+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:14.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:14.679+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:14.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:14.679+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:14.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:14.679+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:14.679+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:14.679+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:16.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.277+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 msgr2=0x7efdc4011b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:16.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.277+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:16.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.277+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:16.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.277+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:16.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.277+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:16.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.277+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 0x7efdc400f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:16.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.277+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b4750 con 0x7efdc4012a50 2023-11-04T01:51:16.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.277+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4005aa0 2023-11-04T01:51:16.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.277+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:16.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.277+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 msgr2=0x7efdc400f030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:16.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.277+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 0x7efdc400f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:16.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.478+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:16.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.478+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 msgr2=0x7efdc400f030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:16.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.478+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 0x7efdc400f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:16.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.879+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 msgr2=0x7efdc400f030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:16.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.879+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:16.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:16.879+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 0x7efdc400f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:17.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:17.680+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:17.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:17.680+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 msgr2=0x7efdc400f030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:17.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:17.680+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 0x7efdc400f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:19.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.277+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 msgr2=0x7efdc400f030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:19.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.277+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4005aa0 0x7efdc400f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:19.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.277+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:19.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.277+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:51:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.277+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.277+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.277+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b32b0 con 0x7efdc4012090 2023-11-04T01:51:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.277+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc400a420 2023-11-04T01:51:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.277+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc40095d0 2023-11-04T01:51:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.277+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.277+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.277+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.277+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 msgr2=0x7efdc4011b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.277+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:19.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.478+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:19.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.478+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:19.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.478+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:19.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.478+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 msgr2=0x7efdc4011b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:19.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.478+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:19.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.879+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:19.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.879+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:19.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.879+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:19.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.879+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 msgr2=0x7efdc4011b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:19.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:19.879+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:20.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:20.680+0000 7efde37fe640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:20.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:20.680+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:20.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:20.680+0000 7efde37fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:20.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:20.680+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 msgr2=0x7efdc4011b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:20.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:20.680+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:22.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.277+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 msgr2=0x7efdc4011b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:22.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.277+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:22.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.277+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:22.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.277+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:22.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.277+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:22.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.277+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 0x7efdc400f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:22.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.277+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b4750 con 0x7efdc4005aa0 2023-11-04T01:51:22.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.277+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4012a50 2023-11-04T01:51:22.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.277+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:22.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.277+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc400f030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:22.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.277+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 0x7efdc400f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:22.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.478+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc400f030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:22.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.478+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:22.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.478+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 0x7efdc400f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:22.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.879+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:22.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.879+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc400f030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:22.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:22.879+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 0x7efdc400f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:23.063 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:23.067 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:23.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:23.680+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:23.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:23.680+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc400f030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:23.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:23.680+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 0x7efdc400f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:25.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.277+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc400f030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:25.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.277+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 0x7efdc400f030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:25.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.277+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:25.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.277+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:51:25.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.277+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 0x7efdc400f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:25.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.277+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:25.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.277+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:25.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.277+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc400a420 2023-11-04T01:51:25.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.277+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc4012a50 2023-11-04T01:51:25.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.277+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc400fd80 con 0x7efdc40095d0 2023-11-04T01:51:25.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.277+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:25.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.277+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:25.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.277+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 msgr2=0x7efdc4011b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:25.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.277+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc400f010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:25.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.277+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 0x7efdc400f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:25.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.277+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.478+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.478+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:25.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.478+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 msgr2=0x7efdc4011b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.478+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc400f010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.478+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.478+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 0x7efdc400f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:25.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.879+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:25.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.879+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:25.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.879+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc400f010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:25.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.879+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 msgr2=0x7efdc4011b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:25.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.879+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 0x7efdc400f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:25.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:25.879+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:26.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:26.680+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:26.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:26.680+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:26.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:26.680+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc400f010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:26.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:26.680+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 0x7efdc400f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:26.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:26.680+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 msgr2=0x7efdc4011b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:26.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:26.680+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:28.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:28.278+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 msgr2=0x7efdc4011b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:28.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:28.278+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc40095d0 0x7efdc4011b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:28.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:28.278+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc400f010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:28.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:28.278+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012a50 0x7efdc400f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:28.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:28.278+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:28.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:28.278+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:28.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:28.278+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b32b0 con 0x7efdc4012090 2023-11-04T01:51:28.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:28.278+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b4750 con 0x7efdc4005aa0 2023-11-04T01:51:28.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:28.278+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:28.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:28.278+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:28.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:28.479+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:28.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:28.479+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:28.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:28.880+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:28.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:28.880+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:29.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:29.681+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:29.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:29.681+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:31.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.278+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4005aa0 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:31.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.278+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:31.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.278+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:51:31.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.278+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:31.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.278+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:31.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.278+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc400ac60 con 0x7efdc4012090 2023-11-04T01:51:31.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.278+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4012a50 2023-11-04T01:51:31.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.278+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc40095d0 2023-11-04T01:51:31.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.278+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:31.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.278+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:31.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.278+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:31.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.278+0000 7efde37fe640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:31.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.278+0000 7efde37fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.479+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.479+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.479+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.479+0000 7efde37fe640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:31.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.479+0000 7efde37fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:31.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.880+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:31.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.880+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:31.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.880+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:31.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.880+0000 7efde37fe640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:31.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:31.880+0000 7efde37fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:32.681+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:32.681+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:32.681+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:32.681+0000 7efde37fe640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:32.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:32.681+0000 7efde37fe640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.278+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.278+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.278+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.278+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc4012a50 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.278+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.278+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4005aa0 0x7efdc400f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.278+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b32b0 con 0x7efdc400a420 2023-11-04T01:51:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.278+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4005aa0 2023-11-04T01:51:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.278+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc400a420 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.278+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4005aa0 msgr2=0x7efdc400f010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.278+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4005aa0 0x7efdc400f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:34.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.479+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc400a420 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:34.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.479+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4005aa0 msgr2=0x7efdc400f010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:34.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.479+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4005aa0 0x7efdc400f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:34.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.880+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc400a420 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:34.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.880+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4005aa0 msgr2=0x7efdc400f010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:34.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:34.880+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4005aa0 0x7efdc400f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:35.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:35.681+0000 7efddbfff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc400a420 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:35.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:35.681+0000 7efde2ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4005aa0 msgr2=0x7efdc400f010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:35.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:35.681+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4005aa0 0x7efdc400f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:37.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.278+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4005aa0 msgr2=0x7efdc400f010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:37.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.278+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4005aa0 0x7efdc400f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:37.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.278+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc400a420 legacy=0x7efdc4015260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:37.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.278+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:51:37.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.278+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:37.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.278+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 0x7efdc4016d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:37.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.278+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc400ac60 con 0x7efdc4012090 2023-11-04T01:51:37.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.278+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc40095d0 2023-11-04T01:51:37.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.278+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc4016980 2023-11-04T01:51:37.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.278+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 msgr2=0x7efdc4016d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:37.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.278+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:37.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.278+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 0x7efdc4016d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:37.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.278+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:37.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.278+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:37.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.479+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:37.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.479+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 msgr2=0x7efdc4016d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:37.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.479+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:37.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.479+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 0x7efdc4016d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:37.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.479+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:37.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.880+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:37.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.880+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 msgr2=0x7efdc4016d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:37.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.880+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:37.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.880+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:37.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:37.880+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 0x7efdc4016d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:38.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:38.681+0000 7efde37fe640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:38.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:38.681+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 msgr2=0x7efdc4016d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:38.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:38.681+0000 7efde2ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:38.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:38.681+0000 7efde2ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:38.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:38.681+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 0x7efdc4016d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:40.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.278+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 msgr2=0x7efdc4016d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:40.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.278+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 0x7efdc4016d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:40.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.278+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:40.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.278+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:40.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.278+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:40.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.278+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:40.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.278+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b32b0 con 0x7efdc4012a50 2023-11-04T01:51:40.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.278+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc400a420 2023-11-04T01:51:40.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.278+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:40.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.278+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:40.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.278+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:40.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.479+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:40.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.479+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:40.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.479+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:40.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.880+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:40.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.880+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:40.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:40.880+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:41.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:41.681+0000 7efddbfff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:41.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:41.681+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:41.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:41.681+0000 7efddbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:43.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.279+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:43.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.279+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400a420 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:43.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.279+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:43.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.279+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:51:43.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.279+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f010 0x7efdc40192b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:43.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.279+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 0x7efdc40109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:43.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.279+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc400ac60 con 0x7efdc4012a50 2023-11-04T01:51:43.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.279+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc400f010 2023-11-04T01:51:43.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.279+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc4016980 2023-11-04T01:51:43.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.279+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f010 msgr2=0x7efdc40192b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:43.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.279+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f010 0x7efdc40192b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:43.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.279+0000 7efde37fe640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:43.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.279+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:43.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.279+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.480+0000 7efde37fe640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.480+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f010 msgr2=0x7efdc40192b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.480+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f010 0x7efdc40192b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:43.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.480+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:43.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.480+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:43.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.881+0000 7efde37fe640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:43.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.881+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f010 msgr2=0x7efdc40192b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:43.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.881+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f010 0x7efdc40192b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:43.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.881+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:43.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:43.881+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:44.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:44.682+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f010 msgr2=0x7efdc40192b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:44.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:44.682+0000 7efde37fe640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:44.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:44.682+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f010 0x7efdc40192b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:44.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:44.682+0000 7efddbfff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:44.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:44.682+0000 7efddbfff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:46.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.279+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:46.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.279+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc4016980 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:46.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.279+0000 7efde17fa640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f010 msgr2=0x7efdc40192b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:46.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.279+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f010 0x7efdc40192b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:46.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.279+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:46.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.279+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:46.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.279+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b32b0 con 0x7efdc4012090 2023-11-04T01:51:46.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.279+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc40095d0 2023-11-04T01:51:46.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.279+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:46.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.279+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:46.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.279+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:46.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.480+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:46.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.480+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:46.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.480+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:46.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.881+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:46.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.881+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:46.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:46.881+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:47.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:47.682+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:47.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:47.682+0000 7efde2ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:47.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:47.682+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.279+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.279+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc40095d0 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.279+0000 7efde17fa640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc4012090 legacy=0x7efdc400f570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:49.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.279+0000 7efde37fe640 1 -- reap_dead start 2023-11-04T01:51:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.279+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012090 0x7efdc4011b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.279+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400f010 0x7efdc40109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.279+0000 7efde17fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc400ac60 con 0x7efdc4012a50 2023-11-04T01:51:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.279+0000 7efde17fa640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc4012090 2023-11-04T01:51:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.279+0000 7efde17fa640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4013110 con 0x7efdc400f010 2023-11-04T01:51:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.279+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.279+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400f010 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.279+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012090 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.279+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012090 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:49.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.279+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400f010 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:49.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.480+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:49.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.480+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012090 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:49.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.480+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400f010 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:49.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.480+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012090 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:49.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.480+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400f010 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:49.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.881+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:49.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.881+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012090 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:49.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.881+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400f010 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:49.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.881+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012090 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:49.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:49.881+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400f010 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:50.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:50.682+0000 7efde2ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:50.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:50.682+0000 7efddbfff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012090 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:50.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:50.682+0000 7efde37fe640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400f010 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:50.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:50.682+0000 7efddbfff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012090 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:50.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:50.682+0000 7efde37fe640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400f010 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:52.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.279+0000 7efde17fa640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400f010 msgr2=0x7efdc40109e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:52.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.279+0000 7efde17fa640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7efdc400f010 0x7efdc40109e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:52.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.279+0000 7efde17fa640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012090 msgr2=0x7efdc4011b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:52.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.279+0000 7efde17fa640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7efdc4012090 0x7efdc4011b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:52.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.279+0000 7efde17fa640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7efdc4012a50 legacy=0x7efdc4013250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:52.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.279+0000 7efde17fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f570 0x7efdc4006590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:52.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.279+0000 7efde17fa640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde40b32b0 con 0x7efdc40095d0 2023-11-04T01:51:52.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.279+0000 7efde17fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cee10 con 0x7efdc400f570 2023-11-04T01:51:52.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.279+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f570 msgr2=0x7efdc4006590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:52.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.279+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f570 0x7efdc4006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:52.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.280+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc40095d0 legacy=0x7efdc4006ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:52.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.480+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f570 msgr2=0x7efdc4006590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:52.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.480+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f570 0x7efdc4006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:52.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.481+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc40095d0 legacy=0x7efdc4006ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:52.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.881+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f570 msgr2=0x7efdc4006590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:52.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.881+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f570 0x7efdc4006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:52.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:52.882+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc40095d0 legacy=0x7efdc4006ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:53.194 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:53.197 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:53.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:53.682+0000 7efde2ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f570 msgr2=0x7efdc4006590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:53.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:53.682+0000 7efde2ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efdc400f570 0x7efdc4006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:53.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:53.683+0000 7efddbfff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7efdc40095d0 legacy=0x7efdc4006ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:55.196 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:51:55.196 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:51:55.197 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:51:55.250 DEBUG:teuthology.orchestra.run.smithi141:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:51:55.296 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:51:55.296 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:51:55.296 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:51:55.314 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:51:55.314 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:51:55.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:51:55.314 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:51:55.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:51:55.371 INFO:teuthology.orchestra.run.smithi114.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-04T01:51:55.371 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:51:55.371 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:51:55.389 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:51:55.389 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:51:55.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:51:55.390 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:51:55.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:51:55.446 INFO:teuthology.orchestra.run.smithi141.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:51:55.446 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:51:55.446 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:51:55.464 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:51:55.464 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:51:55.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:51:55.464 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:51:55.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:51:55.521 INFO:teuthology.orchestra.run.smithi114.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:51:55.521 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:51:55.521 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:51:55.538 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:51:55.539 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:51:55.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:51:55.539 DEBUG:teuthology.orchestra.run.smithi141:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:51:55.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:51:55.596 INFO:teuthology.orchestra.run.smithi141.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:51:55.596 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:51:55.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.701+0000 7fc21381a640 1 Processor -- start 2023-11-04T01:51:55.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.701+0000 7fc21381a640 1 -- start start 2023-11-04T01:51:55.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.702+0000 7fc21381a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc20c0b0c40 0x7fc20c06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:55.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.702+0000 7fc21381a640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc20c06bb60 0x7fc20c070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:55.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.702+0000 7fc21381a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c071500 con 0x7fc20c159e40 2023-11-04T01:51:55.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.702+0000 7fc21381a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c070a70 con 0x7fc20c0b0c40 2023-11-04T01:51:55.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.702+0000 7fc21381a640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc20c06bb60 2023-11-04T01:51:55.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.702+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc20c159e40 legacy=0x7fc20c0b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:55.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.702+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc20c0b0c40 msgr2=0x7fc20c06fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:55.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.702+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc20c0b0c40 0x7fc20c06fff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:55.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.702+0000 7fc211db7640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc20c06bb60 msgr2=0x7fc20c070530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:55.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.702+0000 7fc211db7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc20c06bb60 0x7fc20c070530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:55.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.903+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc20c159e40 legacy=0x7fc20c0b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:55.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.903+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc20c0b0c40 msgr2=0x7fc20c06fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:55.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.903+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc20c0b0c40 0x7fc20c06fff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:55.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.903+0000 7fc211db7640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc20c06bb60 msgr2=0x7fc20c070530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:55.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:55.903+0000 7fc211db7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc20c06bb60 0x7fc20c070530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:56.304+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc20c159e40 legacy=0x7fc20c0b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:56.304+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc20c0b0c40 msgr2=0x7fc20c06fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:56.304+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc20c0b0c40 0x7fc20c06fff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:56.304+0000 7fc211db7640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc20c06bb60 msgr2=0x7fc20c070530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:56.304+0000 7fc211db7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc20c06bb60 0x7fc20c070530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:51:57.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:57.105+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc20c0b0c40 msgr2=0x7fc20c06fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:51:57.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:57.105+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc20c159e40 legacy=0x7fc20c0b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:51:57.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:57.105+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc20c0b0c40 0x7fc20c06fff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:57.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:57.105+0000 7fc211db7640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc20c06bb60 msgr2=0x7fc20c070530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:51:57.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:57.105+0000 7fc211db7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc20c06bb60 0x7fc20c070530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:51:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:58.702+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc20c06bb60 msgr2=0x7fc20c070530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:58.702+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc20c06bb60 0x7fc20c070530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:58.702+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc20c0b0c40 msgr2=0x7fc20c06fff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:58.702+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc20c0b0c40 0x7fc20c06fff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:51:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:58.702+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc20c159e40 legacy=0x7fc20c0b0530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:51:58.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:58.702+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000b6f0 0x7fc1f000dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:51:58.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:58.702+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c070c60 con 0x7fc1f0007aa0 2023-11-04T01:51:58.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:58.702+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f000b6f0 2023-11-04T01:51:58.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:58.702+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000b6f0 msgr2=0x7fc1f000dbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:58.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:58.702+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0007aa0 legacy=0x7fc1f0009f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:58.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:58.702+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000b6f0 0x7fc1f000dbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:51:58.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:58.903+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0007aa0 legacy=0x7fc1f0009f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:58.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:58.903+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000b6f0 msgr2=0x7fc1f000dbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:58.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:58.903+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000b6f0 0x7fc1f000dbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:51:59.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:59.304+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0007aa0 legacy=0x7fc1f0009f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:51:59.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:59.304+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000b6f0 msgr2=0x7fc1f000dbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:51:59.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:51:59.304+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000b6f0 0x7fc1f000dbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:00.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:00.105+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000b6f0 msgr2=0x7fc1f000dbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:00.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:00.105+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0007aa0 legacy=0x7fc1f0009f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:00.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:00.105+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000b6f0 0x7fc1f000dbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:01.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.703+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000b6f0 msgr2=0x7fc1f000dbb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:01.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.703+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000b6f0 0x7fc1f000dbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:01.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.703+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0007aa0 legacy=0x7fc1f0009f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:01.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.703+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:52:01.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.703+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000e2d0 0x7fc1f000dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:01.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.703+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000e750 0x7fc1f0009f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:01.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.703+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c071500 con 0x7fc1f000eb50 2023-11-04T01:52:01.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.703+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f000e2d0 2023-11-04T01:52:01.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.703+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f000e750 2023-11-04T01:52:01.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.703+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000e2d0 msgr2=0x7fc1f000dbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:01.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.703+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000e2d0 0x7fc1f000dbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:01.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.703+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000e750 msgr2=0x7fc1f0009f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:01.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.703+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000eb50 legacy=0x7fc1f000a650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:01.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.703+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000e750 0x7fc1f0009f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:01.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.904+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000e2d0 msgr2=0x7fc1f000dbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:01.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.904+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000e2d0 0x7fc1f000dbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:01.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.904+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000e750 msgr2=0x7fc1f0009f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:01.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.904+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000eb50 legacy=0x7fc1f000a650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:01.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:01.904+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000e750 0x7fc1f0009f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:02.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:02.305+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000e2d0 msgr2=0x7fc1f000dbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:02.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:02.305+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000e2d0 0x7fc1f000dbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:02.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:02.305+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000eb50 legacy=0x7fc1f000a650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:02.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:02.305+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000e750 msgr2=0x7fc1f0009f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:02.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:02.305+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000e750 0x7fc1f0009f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:03.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:03.106+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000e2d0 msgr2=0x7fc1f000dbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:03.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:03.106+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000e2d0 0x7fc1f000dbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:03.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:03.106+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000e750 msgr2=0x7fc1f0009f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:03.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:03.106+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000eb50 legacy=0x7fc1f000a650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:03.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:03.106+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000e750 0x7fc1f0009f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:04.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:04.703+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000e750 msgr2=0x7fc1f0009f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:04.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:04.703+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000e750 0x7fc1f0009f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:04.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:04.703+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000e2d0 msgr2=0x7fc1f000dbb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:04.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:04.703+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000e2d0 0x7fc1f000dbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:04.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:04.703+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000eb50 legacy=0x7fc1f000a650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:04.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:04.703+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0015c00 0x7fc1f0017ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:04.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:04.703+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c070c60 con 0x7fc1f000b070 2023-11-04T01:52:04.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:04.703+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0015c00 2023-11-04T01:52:04.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:04.703+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000b070 legacy=0x7fc1f00144e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:04.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:04.703+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0015c00 msgr2=0x7fc1f0017ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:04.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:04.703+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0015c00 0x7fc1f0017ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:04.904+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000b070 legacy=0x7fc1f00144e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:04.904+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0015c00 msgr2=0x7fc1f0017ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:04.904+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0015c00 0x7fc1f0017ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:05.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:05.305+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000b070 legacy=0x7fc1f00144e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:05.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:05.305+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0015c00 msgr2=0x7fc1f0017ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:05.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:05.305+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0015c00 0x7fc1f0017ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:06.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:06.106+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000b070 legacy=0x7fc1f00144e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:06.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:06.106+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0015c00 msgr2=0x7fc1f0017ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:06.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:06.106+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0015c00 0x7fc1f0017ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:07.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.703+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0015c00 msgr2=0x7fc1f0017ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:07.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.703+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0015c00 0x7fc1f0017ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.703+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000b070 legacy=0x7fc1f00144e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.703+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:52:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.703+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000e2d0 0x7fc1f0009ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.703+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a670 0x7fc1f0017ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.703+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c071500 con 0x7fc1f00185b0 2023-11-04T01:52:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.703+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f000a670 2023-11-04T01:52:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.703+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f000e2d0 2023-11-04T01:52:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.703+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a670 msgr2=0x7fc1f0017ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.703+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a670 0x7fc1f0017ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.703+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000e2d0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.703+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00185b0 legacy=0x7fc1f0018a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:07.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.703+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000e2d0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:07.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.904+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a670 msgr2=0x7fc1f0017ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:07.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.904+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a670 0x7fc1f0017ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:07.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.904+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000e2d0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:07.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.904+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00185b0 legacy=0x7fc1f0018a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:07.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:07.904+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000e2d0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:08.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:08.305+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a670 msgr2=0x7fc1f0017ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:08.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:08.305+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a670 0x7fc1f0017ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:08.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:08.305+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00185b0 legacy=0x7fc1f0018a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:08.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:08.305+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000e2d0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:08.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:08.305+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000e2d0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:09.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:09.106+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a670 msgr2=0x7fc1f0017ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:09.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:09.106+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a670 0x7fc1f0017ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:09.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:09.106+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00185b0 legacy=0x7fc1f0018a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:09.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:09.106+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000e2d0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:09.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:09.106+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000e2d0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:10.704+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000e2d0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:10.704+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000e2d0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:10.704+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a670 msgr2=0x7fc1f0017ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:10.704+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a670 0x7fc1f0017ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:10.704+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00185b0 legacy=0x7fc1f0018a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:10.704+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dc70 0x7fc1f0019610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:10.704+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c070c60 con 0x7fc1f0019130 2023-11-04T01:52:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:10.704+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f000dc70 2023-11-04T01:52:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:10.704+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0019130 legacy=0x7fc1f00124d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:10.704+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dc70 msgr2=0x7fc1f0019610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:10.704+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dc70 0x7fc1f0019610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:10.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:10.905+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0019130 legacy=0x7fc1f00124d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:10.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:10.905+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dc70 msgr2=0x7fc1f0019610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:10.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:10.905+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dc70 0x7fc1f0019610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:11.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:11.306+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0019130 legacy=0x7fc1f00124d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:11.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:11.306+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dc70 msgr2=0x7fc1f0019610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:11.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:11.306+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dc70 0x7fc1f0019610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:12.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:12.107+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0019130 legacy=0x7fc1f00124d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:12.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:12.107+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dc70 msgr2=0x7fc1f0019610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:12.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:12.107+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dc70 0x7fc1f0019610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:13.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:13.704+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dc70 msgr2=0x7fc1f0019610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:13.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:13.704+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dc70 0x7fc1f0019610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:13.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:13.704+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0019130 legacy=0x7fc1f00124d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:13.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:13.704+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:52:13.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:13.704+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a670 0x7fc1f0019610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:13.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:13.704+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0019b50 legacy=0x7fc1f001bf40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:13.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:13.704+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c071500 con 0x7fc1f0019b50 2023-11-04T01:52:13.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:13.704+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c070c60 con 0x7fc1f000dc70 2023-11-04T01:52:13.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:13.704+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f000a670 2023-11-04T01:52:13.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:13.704+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dc70 legacy=0x7fc1f00189f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:13.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:13.704+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a670 msgr2=0x7fc1f0019610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:13.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:13.704+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a670 0x7fc1f0019610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:13.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:13.905+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0019b50 legacy=0x7fc1f001bf40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:13.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:13.905+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dc70 legacy=0x7fc1f00189f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:13.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:13.905+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a670 msgr2=0x7fc1f0019610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:13.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:13.905+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a670 0x7fc1f0019610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:14.306+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0019b50 legacy=0x7fc1f001bf40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:14.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:14.306+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a670 msgr2=0x7fc1f0019610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:14.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:14.306+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a670 0x7fc1f0019610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:14.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:14.306+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dc70 legacy=0x7fc1f00189f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:15.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:15.107+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0019b50 legacy=0x7fc1f001bf40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:15.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:15.107+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dc70 legacy=0x7fc1f00189f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:15.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:15.107+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a670 msgr2=0x7fc1f0019610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:15.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:15.107+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a670 0x7fc1f0019610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:16.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:16.705+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a670 msgr2=0x7fc1f0019610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:16.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:16.705+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a670 0x7fc1f0019610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:16.705+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dc70 legacy=0x7fc1f00189f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:16.705+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0019b50 legacy=0x7fc1f001bf40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:16.705+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f00185b0 0x7fc1f0009ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:16.705+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:16.705+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f00185b0 2023-11-04T01:52:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:16.705+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f0016ff0 2023-11-04T01:52:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:16.705+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f00185b0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:16.705+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f00185b0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:16.705+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:16.705+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:16.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:16.906+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f00185b0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:16.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:16.906+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f00185b0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:16.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:16.906+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:16.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:16.906+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:17.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:17.307+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f00185b0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:17.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:17.307+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f00185b0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:17.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:17.307+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:17.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:17.307+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:18.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:18.108+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f00185b0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:18.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:18.108+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f00185b0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:18.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:18.108+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:18.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:18.108+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:19.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.704+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:19.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.704+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:19.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.704+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f00185b0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:19.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.704+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f00185b0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:19.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.704+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:52:19.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.704+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0009ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:19.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.704+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f000e2d0 con 0x7fc1f000a5a0 2023-11-04T01:52:19.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.704+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c071500 con 0x7fc1f000dc70 2023-11-04T01:52:19.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.704+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0016ff0 2023-11-04T01:52:19.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.704+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:19.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.704+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:19.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.704+0000 7fc211db7640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a5a0 legacy=0x7fc1f0017aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:19.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.704+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dc70 legacy=0x7fc1f00189f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:19.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.905+0000 7fc211db7640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a5a0 legacy=0x7fc1f0017aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:19.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.905+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:19.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.905+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:19.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:19.905+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dc70 legacy=0x7fc1f00189f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:20.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:20.306+0000 7fc211db7640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a5a0 legacy=0x7fc1f0017aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:20.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:20.306+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:20.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:20.306+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:20.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:20.306+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dc70 legacy=0x7fc1f00189f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:21.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:21.107+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:21.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:21.107+0000 7fc211db7640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a5a0 legacy=0x7fc1f0017aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:21.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:21.107+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:21.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:21.107+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dc70 legacy=0x7fc1f00189f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:22.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:22.704+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:22.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:22.704+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:22.704+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dc70 legacy=0x7fc1f00189f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:22.704+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a5a0 legacy=0x7fc1f0017aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:22.704+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00181b0 0x7fc1f00173d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:22.704+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0014440 0x7fc1f0014850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:22.704+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f00181b0 2023-11-04T01:52:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:22.704+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f0014440 2023-11-04T01:52:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:22.705+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00181b0 msgr2=0x7fc1f00173d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:22.705+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0014440 msgr2=0x7fc1f0014850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:22.705+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00181b0 0x7fc1f00173d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:22.705+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0014440 0x7fc1f0014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:22.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:22.906+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0014440 msgr2=0x7fc1f0014850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:22.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:22.906+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00181b0 msgr2=0x7fc1f00173d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:22.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:22.906+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0014440 0x7fc1f0014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:22.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:22.906+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00181b0 0x7fc1f00173d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:23.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:23.307+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0014440 msgr2=0x7fc1f0014850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:23.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:23.307+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00181b0 msgr2=0x7fc1f00173d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:23.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:23.307+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00181b0 0x7fc1f00173d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:23.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:23.307+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0014440 0x7fc1f0014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:23.366 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:23.369 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:24.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:24.108+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0014440 msgr2=0x7fc1f0014850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:24.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:24.108+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00181b0 msgr2=0x7fc1f00173d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:24.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:24.108+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00181b0 0x7fc1f00173d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:24.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:24.108+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0014440 0x7fc1f0014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:25.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.705+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0014440 msgr2=0x7fc1f0014850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:25.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.705+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0014440 0x7fc1f0014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:25.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.705+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00181b0 msgr2=0x7fc1f00173d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:25.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.705+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00181b0 0x7fc1f00173d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:25.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.705+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:52:25.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.705+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f00181b0 0x7fc1f00189d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:25.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.705+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c070c60 con 0x7fc1f000a5a0 2023-11-04T01:52:25.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.705+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f000e2d0 con 0x7fc1f000dbb0 2023-11-04T01:52:25.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.705+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f00181b0 2023-11-04T01:52:25.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.705+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a5a0 legacy=0x7fc1f0017aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:25.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.705+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0014e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:25.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.705+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f00181b0 msgr2=0x7fc1f00189d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:25.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.705+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f00181b0 0x7fc1f00189d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:25.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.906+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a5a0 legacy=0x7fc1f0017aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:25.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.906+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f00181b0 msgr2=0x7fc1f00189d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:25.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.906+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0014e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:25.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:25.906+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f00181b0 0x7fc1f00189d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:26.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:26.307+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a5a0 legacy=0x7fc1f0017aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:26.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:26.307+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f00181b0 msgr2=0x7fc1f00189d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:26.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:26.307+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0014e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:26.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:26.307+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f00181b0 0x7fc1f00189d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:27.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:27.108+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a5a0 legacy=0x7fc1f0017aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:27.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:27.108+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f00181b0 msgr2=0x7fc1f00189d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:27.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:27.108+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0014e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:27.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:27.108+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f00181b0 0x7fc1f00189d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:28.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:28.705+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f00181b0 msgr2=0x7fc1f00189d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:28.705+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f00181b0 0x7fc1f00189d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:28.705+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0014e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:28.705+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a5a0 legacy=0x7fc1f0017aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:28.705+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0015580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:28.705+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f0014850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:28.705+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0009ef0 2023-11-04T01:52:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:28.705+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f0014440 2023-11-04T01:52:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:28.705+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0009ef0 msgr2=0x7fc1f0015580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:28.705+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0015580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:28.705+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f0014850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:28.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:28.705+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f0014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:28.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:28.906+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0009ef0 msgr2=0x7fc1f0015580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:28.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:28.906+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0015580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:28.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:28.906+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f0014850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:28.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:28.906+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f0014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:29.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:29.307+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0009ef0 msgr2=0x7fc1f0015580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:29.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:29.307+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0015580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:29.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:29.307+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f0014850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:29.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:29.307+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f0014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:30.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:30.108+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0009ef0 msgr2=0x7fc1f0015580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:30.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:30.108+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0015580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:30.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:30.108+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f0014850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:30.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:30.108+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f0014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:31.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.705+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f0014850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:31.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.705+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f0014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:31.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.705+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0009ef0 msgr2=0x7fc1f0015580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:31.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.705+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0015580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:31.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.705+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:52:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.705+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0016ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.705+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 0x7fc1f0017aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.705+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c071500 con 0x7fc1f000a500 2023-11-04T01:52:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.705+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f000dbb0 2023-11-04T01:52:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.705+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f0009ef0 2023-11-04T01:52:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.706+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.706+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.706+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.706+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 msgr2=0x7fc1f0017aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:31.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.706+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 0x7fc1f0017aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:31.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.907+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.907+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.907+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.907+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 msgr2=0x7fc1f0017aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:31.907+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 0x7fc1f0017aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:32.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:32.308+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:32.308+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:32.308+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 msgr2=0x7fc1f0017aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:32.308+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:32.308+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 0x7fc1f0017aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:33.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:33.109+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:33.109+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:33.109+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 msgr2=0x7fc1f0017aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:33.109+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:33.109+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 0x7fc1f0017aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:34.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:34.706+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 msgr2=0x7fc1f0017aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:34.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:34.706+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 0x7fc1f0017aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:34.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:34.706+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:34.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:34.706+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:34.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:34.706+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:34.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:34.706+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0017530 0x7fc1f0017fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:34.706+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c070c60 con 0x7fc1f0014e40 2023-11-04T01:52:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:34.706+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0017530 2023-11-04T01:52:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:34.706+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0014e40 legacy=0x7fc1f0015250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:34.706+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0017530 msgr2=0x7fc1f0017fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:34.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:34.706+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0017530 0x7fc1f0017fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:34.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:34.907+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0014e40 legacy=0x7fc1f0015250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:34.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:34.907+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0017530 msgr2=0x7fc1f0017fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:34.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:34.907+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0017530 0x7fc1f0017fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:35.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:35.308+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0014e40 legacy=0x7fc1f0015250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:35.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:35.308+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0017530 msgr2=0x7fc1f0017fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:35.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:35.308+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0017530 0x7fc1f0017fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:36.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:36.109+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0014e40 legacy=0x7fc1f0015250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:36.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:36.109+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0017530 msgr2=0x7fc1f0017fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:36.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:36.109+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0017530 0x7fc1f0017fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:37.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.706+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0017530 msgr2=0x7fc1f0017fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:37.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.706+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0017530 0x7fc1f0017fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:37.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.706+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0014e40 legacy=0x7fc1f0015250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:37.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.706+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:52:37.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.706+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0016ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:37.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.706+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0015220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:37.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.706+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:37.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.706+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:37.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.706+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c071500 con 0x7fc1f0009ef0 2023-11-04T01:52:37.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.706+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f000dbb0 2023-11-04T01:52:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.706+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0009ef0 legacy=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.706+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f000a500 2023-11-04T01:52:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.707+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 msgr2=0x7fc1f0015220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.707+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0015220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:37.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.907+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:37.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.907+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:37.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.907+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0009ef0 legacy=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:37.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.908+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 msgr2=0x7fc1f0015220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:37.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:37.908+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0015220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:38.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:38.308+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:38.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:38.308+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0009ef0 legacy=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:38.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:38.308+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:38.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:38.309+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 msgr2=0x7fc1f0015220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:38.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:38.309+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0015220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:39.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:39.109+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0009ef0 legacy=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:39.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:39.109+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:39.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:39.109+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:39.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:39.110+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 msgr2=0x7fc1f0015220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:39.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:39.110+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0015220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:40.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:40.707+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 msgr2=0x7fc1f0015220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:40.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:40.707+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0015220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:40.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:40.707+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:40.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:40.707+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:40.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:40.707+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0009ef0 legacy=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:40.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:40.707+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014e40 0x7fc1f0017a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:40.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:40.707+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c070c60 con 0x7fc1f0017530 2023-11-04T01:52:40.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:40.707+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0014e40 2023-11-04T01:52:40.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:40.707+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014e40 msgr2=0x7fc1f0017a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:40.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:40.707+0000 7fc210db5640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0017530 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:40.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:40.707+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014e40 0x7fc1f0017a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:40.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:40.908+0000 7fc210db5640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0017530 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:40.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:40.908+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014e40 msgr2=0x7fc1f0017a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:40.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:40.908+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014e40 0x7fc1f0017a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:41.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:41.309+0000 7fc210db5640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0017530 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:41.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:41.309+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014e40 msgr2=0x7fc1f0017a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:41.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:41.309+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014e40 0x7fc1f0017a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:42.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:42.110+0000 7fc210db5640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0017530 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:42.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:42.110+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014e40 msgr2=0x7fc1f0017a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:42.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:42.110+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014e40 0x7fc1f0017a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.707+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014e40 msgr2=0x7fc1f0017a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.707+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014e40 0x7fc1f0017a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.707+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0017530 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.707+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:52:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.707+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.707+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0014e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.707+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c071500 con 0x7fc1f000dbb0 2023-11-04T01:52:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.707+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f000a500 2023-11-04T01:52:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.707+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.707+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f0009ef0 2023-11-04T01:52:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.707+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.707+0000 7fc211db7640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0017a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:43.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.707+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 msgr2=0x7fc1f0014e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:43.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.707+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0014e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:43.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.908+0000 7fc211db7640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0017a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.908+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.908+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.908+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 msgr2=0x7fc1f0014e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:43.908+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0014e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:44.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:44.309+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:44.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:44.309+0000 7fc211db7640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0017a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:44.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:44.309+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:44.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:44.309+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 msgr2=0x7fc1f0014e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:44.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:44.309+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0014e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:45.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:45.110+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:45.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:45.110+0000 7fc211db7640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0017a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:45.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:45.110+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:45.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:45.110+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 msgr2=0x7fc1f0014e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:45.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:45.110+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0014e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:46.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:46.707+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 msgr2=0x7fc1f0014e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:46.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:46.707+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0014e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:46.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:46.707+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:46.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:46.707+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:46.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:46.707+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0017a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:46.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:46.707+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 0x7fc1f0014440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:46.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:46.708+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c070c60 con 0x7fc1f0018170 2023-11-04T01:52:46.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:46.708+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0015350 2023-11-04T01:52:46.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:46.708+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0018170 legacy=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:46.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:46.708+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 msgr2=0x7fc1f0014440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:46.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:46.708+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 0x7fc1f0014440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:46.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:46.909+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 msgr2=0x7fc1f0014440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:46.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:46.909+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0018170 legacy=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:46.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:46.909+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 0x7fc1f0014440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:47.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:47.310+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0018170 legacy=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:47.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:47.310+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 msgr2=0x7fc1f0014440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:47.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:47.310+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 0x7fc1f0014440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:48.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:48.111+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 msgr2=0x7fc1f0014440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:48.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:48.111+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0018170 legacy=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:48.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:48.111+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 0x7fc1f0014440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:49.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.708+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 msgr2=0x7fc1f0014440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:49.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.708+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 0x7fc1f0014440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:49.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.708+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0018170 legacy=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:49.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.708+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0014e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:49.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.708+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:52:49.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.708+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:49.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.708+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 0x7fc1f0014440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:49.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.708+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f000a500 2023-11-04T01:52:49.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.708+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f0009ef0 2023-11-04T01:52:49.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.708+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00157b0 con 0x7fc1f0015350 2023-11-04T01:52:49.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.708+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:49.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.708+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:49.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.708+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 msgr2=0x7fc1f0014e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:49.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.708+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 msgr2=0x7fc1f0014440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:49.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.708+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 0x7fc1f0014440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:49.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.708+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0014e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.909+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:49.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.909+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:49.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.909+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 msgr2=0x7fc1f0014e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:49.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.909+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 msgr2=0x7fc1f0014440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:49.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.909+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0014e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:49.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:49.909+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 0x7fc1f0014440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:50.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:50.310+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:50.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:50.310+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:50.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:50.310+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 msgr2=0x7fc1f0014440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:50.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:50.310+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 msgr2=0x7fc1f0014e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:50.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:50.310+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 0x7fc1f0014440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:50.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:50.310+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0014e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:51.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:51.111+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:51.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:51.111+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:51.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:51.111+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 msgr2=0x7fc1f0014e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:51.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:51.111+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 msgr2=0x7fc1f0014440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:51.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:51.111+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0014e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:51.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:51.111+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 0x7fc1f0014440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:52.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:52.709+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 msgr2=0x7fc1f0014440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:52.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:52.709+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0015350 0x7fc1f0014440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:52.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:52.709+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 msgr2=0x7fc1f0014e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:52.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:52.709+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0009ef0 0x7fc1f0014e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:52.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:52.709+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:52.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:52.709+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:52.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:52.709+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c071500 con 0x7fc1f0014980 2023-11-04T01:52:52.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:52.709+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c070c60 con 0x7fc1f0018130 2023-11-04T01:52:52.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:52.709+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0014980 legacy=0x7fc1f0017a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:52.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:52.709+0000 7fc210db5640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0018130 legacy=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:52.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:52.910+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0014980 legacy=0x7fc1f0017a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:52.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:52.910+0000 7fc210db5640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0018130 legacy=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:53.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:53.311+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0014980 legacy=0x7fc1f0017a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:53.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:53.311+0000 7fc210db5640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0018130 legacy=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:53.454 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:53.458 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:54.112+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0014980 legacy=0x7fc1f0017a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:54.112+0000 7fc210db5640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0018130 legacy=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:55.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.709+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0018130 legacy=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:55.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.709+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0014980 legacy=0x7fc1f0017a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:55.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.709+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:52:55.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.709+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:55.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.709+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014d80 0x7fc1f0015160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:55.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.709+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f001d5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:55.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.709+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f000e2d0 con 0x7fc1f000dbb0 2023-11-04T01:52:55.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.709+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:55.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.709+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f000a500 2023-11-04T01:52:55.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.709+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:55.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.709+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f0014d80 2023-11-04T01:52:55.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.709+0000 7fc211db7640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014d80 msgr2=0x7fc1f0015160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:55.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.709+0000 7fc211db7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014d80 0x7fc1f0015160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:55.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.910+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:55.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.910+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f001d5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:55.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.910+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:55.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.910+0000 7fc211db7640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014d80 msgr2=0x7fc1f0015160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:55.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:55.910+0000 7fc211db7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014d80 0x7fc1f0015160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:56.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:56.311+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:56.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:56.311+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f001d5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:56.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:56.311+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:56.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:56.311+0000 7fc211db7640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014d80 msgr2=0x7fc1f0015160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:56.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:56.311+0000 7fc211db7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014d80 0x7fc1f0015160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:52:57.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:57.112+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:52:57.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:57.112+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f001d5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:52:57.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:57.112+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:57.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:57.112+0000 7fc211db7640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014d80 msgr2=0x7fc1f0015160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:52:57.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:57.112+0000 7fc211db7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014d80 0x7fc1f0015160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:52:58.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:58.710+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014d80 msgr2=0x7fc1f0015160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:58.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:58.710+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014d80 0x7fc1f0015160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:58.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:58.710+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:58.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:58.710+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:52:58.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:58.710+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f001d5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:52:58.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:58.710+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 0x7fc1f0016ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:52:58.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:58.710+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c071500 con 0x7fc1f0017a20 2023-11-04T01:52:58.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:58.710+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0009ef0 2023-11-04T01:52:58.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:58.710+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0017a20 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:58.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:58.710+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:58.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:58.710+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:52:58.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:58.911+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:58.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:58.911+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0017a20 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:58.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:58.911+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:52:59.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:59.312+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0017a20 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:52:59.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:59.312+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:52:59.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:52:59.312+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:00.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:00.113+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:00.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:00.113+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0017a20 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:00.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:00.113+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:01.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.710+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:01.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.710+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0009ef0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:01.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.710+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0017a20 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:01.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.710+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:53:01.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.710+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:01.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.710+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:01.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.710+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f000e2d0 con 0x7fc1f0017530 2023-11-04T01:53:01.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.710+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0017e00 2023-11-04T01:53:01.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.710+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f000a500 2023-11-04T01:53:01.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.710+0000 7fc211db7640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:01.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.710+0000 7fc211db7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:01.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.710+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0017530 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:01.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.710+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:01.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.710+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:01.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.911+0000 7fc211db7640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:01.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.911+0000 7fc211db7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:01.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.911+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0017530 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:01.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.911+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:01.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:01.911+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:02.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:02.312+0000 7fc211db7640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:02.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:02.312+0000 7fc211db7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:02.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:02.312+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:02.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:02.312+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0017530 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:02.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:02.312+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:03.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:03.113+0000 7fc211db7640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:03.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:03.113+0000 7fc211db7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:03.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:03.113+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:03.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:03.113+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0017530 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:03.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:03.113+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:04.709+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:04.709+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:04.709+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:04.709+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:04.709+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0017530 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:04.709+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152c0 0x7fc1f0016ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:04.709+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c071500 con 0x7fc1f000dbb0 2023-11-04T01:53:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:04.709+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f00152c0 2023-11-04T01:53:04.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:04.709+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:04.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:04.709+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152c0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:04.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:04.709+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152c0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:04.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:04.910+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:04.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:04.910+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152c0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:04.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:04.910+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152c0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:05.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:05.311+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:05.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:05.311+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152c0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:05.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:05.311+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152c0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:06.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:06.112+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:06.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:06.112+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152c0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:06.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:06.112+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152c0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:07.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.710+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152c0 msgr2=0x7fc1f0016ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:07.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.710+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152c0 0x7fc1f0016ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:07.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.710+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0013b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:07.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.710+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:07.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.710+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:53:07.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.710+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0009ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:07.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.710+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0018990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:07.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.710+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0017e00 2023-11-04T01:53:07.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.710+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f000dbb0 2023-11-04T01:53:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.710+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00157b0 con 0x7fc1f000a500 2023-11-04T01:53:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.710+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.710+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.710+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.710+0000 7fc211db7640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.710+0000 7fc211db7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.710+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.911+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.911+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.911+0000 7fc211db7640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.911+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.911+0000 7fc211db7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:07.911+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:08.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:08.312+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:08.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:08.312+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:08.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:08.312+0000 7fc211db7640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:08.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:08.312+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:08.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:08.312+0000 7fc211db7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:08.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:08.312+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:09.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:09.113+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:09.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:09.113+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:09.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:09.113+0000 7fc211db7640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:09.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:09.113+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:09.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:09.113+0000 7fc211db7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:09.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:09.113+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:10.710+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:10.710+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000a500 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:10.710+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:10.710+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:10.710+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:10.710+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:10.710+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f000e2d0 con 0x7fc1f0016ff0 2023-11-04T01:53:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:10.710+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c071500 con 0x7fc1f00152a0 2023-11-04T01:53:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:10.710+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0016ff0 legacy=0x7fc1f0013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:10.710+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00152a0 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:10.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:10.911+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0016ff0 legacy=0x7fc1f0013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:10.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:10.911+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00152a0 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:11.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:11.312+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0016ff0 legacy=0x7fc1f0013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:11.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:11.312+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00152a0 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:12.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:12.113+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0016ff0 legacy=0x7fc1f0013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:12.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:12.113+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00152a0 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.710+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00152a0 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.710+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0016ff0 legacy=0x7fc1f0013b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.710+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:53:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.710+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.710+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.711+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c070c60 con 0x7fc1f0016ff0 2023-11-04T01:53:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.711+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0016ff0 legacy=0x7fc1f0013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.711+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0017e00 2023-11-04T01:53:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.711+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.711+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f000dbb0 2023-11-04T01:53:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.711+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.711+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:13.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.711+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:13.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.912+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0016ff0 legacy=0x7fc1f0013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:13.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.912+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:13.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.912+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:13.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.912+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:13.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:13.912+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:14.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:14.313+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:14.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:14.313+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0016ff0 legacy=0x7fc1f0013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:14.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:14.313+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:14.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:14.313+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:14.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:14.313+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:15.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:15.114+0000 7fc2115b6640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0016ff0 legacy=0x7fc1f0013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:15.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:15.114+0000 7fc210db5640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:15.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:15.114+0000 7fc210db5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:15.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:15.114+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:15.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:15.114+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:16.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:16.711+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:16.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:16.711+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:16.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:16.711+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:16.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:16.711+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:16.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:16.711+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0016ff0 legacy=0x7fc1f0013b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:16.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:16.711+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:16.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:16.711+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f000e2d0 con 0x7fc1f00152a0 2023-11-04T01:53:16.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:16.711+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f000a500 2023-11-04T01:53:16.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:16.711+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00152a0 legacy=0x7fc1f0014250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:16.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:16.711+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:16.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:16.711+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:16.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:16.912+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:16.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:16.912+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00152a0 legacy=0x7fc1f0014250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:16.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:16.912+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:17.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:17.313+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00152a0 legacy=0x7fc1f0014250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:17.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:17.313+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:17.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:17.313+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:18.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:18.114+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:18.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:18.114+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00152a0 legacy=0x7fc1f0014250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:18.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:18.114+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:19.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.711+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:19.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.711+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:19.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.711+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00152a0 legacy=0x7fc1f0014250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:19.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.711+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:53:19.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.711+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:19.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.711+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152a0 0x7fc1f0009ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:19.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.711+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c070c60 con 0x7fc1f000a500 2023-11-04T01:53:19.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.711+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0017e00 2023-11-04T01:53:19.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.711+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f00152a0 2023-11-04T01:53:19.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.711+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:19.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.711+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:19.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.711+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0015fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:19.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.711+0000 7fc211db7640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152a0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:19.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.711+0000 7fc211db7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152a0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:19.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.912+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0015fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:19.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.912+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:19.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.912+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:19.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.912+0000 7fc211db7640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152a0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:19.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:19.912+0000 7fc211db7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152a0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:20.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:20.313+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0015fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:20.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:20.313+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:20.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:20.313+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:20.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:20.313+0000 7fc211db7640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152a0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:20.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:20.313+0000 7fc211db7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152a0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:21.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:21.114+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0015fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:21.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:21.114+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:21.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:21.114+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:21.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:21.114+0000 7fc211db7640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152a0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:21.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:21.114+0000 7fc211db7640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152a0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:22.711+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152a0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:22.711+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f00152a0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:22.711+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:22.711+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0017e00 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:22.711+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0015fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:22.711+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0018990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:22.711+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f000e2d0 con 0x7fc1f0014440 2023-11-04T01:53:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:22.711+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f000dbb0 2023-11-04T01:53:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:22.711+0000 7fc2115b6640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:22.711+0000 7fc210db5640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0014440 legacy=0x7fc1f00166f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:22.711+0000 7fc2115b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:22.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:22.912+0000 7fc210db5640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0014440 legacy=0x7fc1f00166f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:22.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:22.912+0000 7fc2115b6640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:22.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:22.912+0000 7fc2115b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:23.313+0000 7fc210db5640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0014440 legacy=0x7fc1f00166f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:23.313+0000 7fc2115b6640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:23.313+0000 7fc2115b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:23.610 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:23.613 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:24.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:24.114+0000 7fc2115b6640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:24.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:24.114+0000 7fc210db5640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0014440 legacy=0x7fc1f00166f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:24.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:24.114+0000 7fc2115b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:25.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.712+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:25.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.712+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:25.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.712+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0014440 legacy=0x7fc1f00166f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:25.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.712+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:53:25.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.712+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:25.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.712+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:25.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.712+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c070c60 con 0x7fc1f0017420 2023-11-04T01:53:25.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.712+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f000a500 2023-11-04T01:53:25.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.712+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f000dbb0 2023-11-04T01:53:25.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.712+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:25.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.712+0000 7fc211db7640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0017420 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:25.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.712+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:25.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.712+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:25.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.712+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:25.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.913+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:25.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.913+0000 7fc211db7640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0017420 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:25.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.913+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:25.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.913+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:25.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:25.913+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:26.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:26.314+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:26.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:26.314+0000 7fc211db7640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0017420 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:26.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:26.314+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:26.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:26.314+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:26.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:26.314+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:27.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:27.115+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:27.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:27.115+0000 7fc211db7640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0017420 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:27.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:27.115+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:27.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:27.115+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:27.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:27.115+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:28.712+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:28.712+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:28.712+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:28.712+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:28.712+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0017420 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:28.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:28.712+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0014d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:28.712+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f000e2d0 con 0x7fc1f00152a0 2023-11-04T01:53:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:28.712+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0016ff0 2023-11-04T01:53:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:28.712+0000 7fc210db5640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00152a0 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:28.712+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:28.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:28.712+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:28.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:28.913+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:28.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:28.913+0000 7fc210db5640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00152a0 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:28.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:28.913+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:29.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:29.314+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:29.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:29.314+0000 7fc210db5640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00152a0 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:29.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:29.314+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:30.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:30.115+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:30.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:30.115+0000 7fc210db5640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00152a0 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:30.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:30.115+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:31.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:31.713+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:31.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:31.713+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0014d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:31.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:31.713+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f00152a0 legacy=0x7fc1f0013430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:31.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:31.713+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:53:31.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:31.713+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:31.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:31.713+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c070c60 con 0x7fc1f0017420 2023-11-04T01:53:31.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:31.713+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f000e2d0 con 0x7fc1f000dbb0 2023-11-04T01:53:31.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:31.713+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f000a500 2023-11-04T01:53:31.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:31.713+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:31.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:31.713+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0017420 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:31.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:31.713+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:31.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:31.713+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:31.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:31.914+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0017420 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:31.914+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:31.914+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:31.914+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:32.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:32.315+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0017420 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:32.315+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:32.315+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:32.315+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:33.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:33.116+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0017420 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:33.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:33.116+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:33.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:33.116+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:33.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:33.116+0000 7fc211db7640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:34.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:34.713+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 msgr2=0x7fc1f0018990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:34.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:34.713+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000a500 0x7fc1f0018990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:34.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:34.713+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:34.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:34.713+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f0017420 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:34.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:34.713+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 0x7fc1f0009ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:34.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:34.713+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:34.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:34.713+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0014440 2023-11-04T01:53:34.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:34.713+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f0016ff0 2023-11-04T01:53:34.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:34.713+0000 7fc2115b6640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:34.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:34.713+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:34.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:34.713+0000 7fc2115b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:34.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:34.713+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:34.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:34.914+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:34.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:34.914+0000 7fc2115b6640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:34.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:34.914+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:34.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:34.914+0000 7fc2115b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:35.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:35.315+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:35.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:35.315+0000 7fc2115b6640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:35.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:35.315+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:35.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:35.315+0000 7fc2115b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:36.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:36.116+0000 7fc2115b6640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:36.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:36.116+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:36.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:36.116+0000 7fc2115b6640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:36.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:36.116+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:37.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.713+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.713+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.713+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.713+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.713+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.713+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 0x7fc1f0009ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.713+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c071500 con 0x7fc1f000a500 2023-11-04T01:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.713+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c070c60 con 0x7fc1f000dbb0 2023-11-04T01:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.713+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0018990 2023-11-04T01:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.713+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.713+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.713+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.713+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:37.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.914+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:37.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.914+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:37.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.914+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:37.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:37.914+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:38.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:38.315+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:38.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:38.315+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:38.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:38.315+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:38.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:38.315+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:39.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:39.116+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:39.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:39.116+0000 7fc211db7640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:39.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:39.116+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:39.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:39.116+0000 7fc211db7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:40.714+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:40.714+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:40.714+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f000dbb0 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:40.714+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:40.714+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:40.714+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:40.714+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0016ff0 2023-11-04T01:53:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:40.714+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f0014440 2023-11-04T01:53:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:40.714+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:40.714+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:40.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:40.714+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:40.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:40.714+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:40.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:40.915+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:40.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:40.915+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:40.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:40.915+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:40.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:40.915+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:41.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:41.316+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:41.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:41.316+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:41.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:41.316+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:41.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:41.316+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:42.117+0000 7fc2115b6640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:42.117+0000 7fc2115b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:42.117+0000 7fc210db5640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:42.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:42.117+0000 7fc210db5640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:43.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.714+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:43.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.714+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:43.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.714+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:43.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.714+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:43.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.714+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:43.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.714+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:53:43.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.714+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:43.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.714+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f000e2d0 con 0x7fc1f000a500 2023-11-04T01:53:43.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.714+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f000dbb0 2023-11-04T01:53:43.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.714+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f0014440 2023-11-04T01:53:43.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.714+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:43.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.714+0000 7fc211db7640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:43.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.714+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:43.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.714+0000 7fc211db7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:43.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.714+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:43.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.915+0000 7fc211db7640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:43.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.915+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:43.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.915+0000 7fc211db7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:43.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.915+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:43.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:43.915+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:44.316+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:44.316+0000 7fc211db7640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:44.316+0000 7fc211db7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:44.316+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:44.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:44.316+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:45.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:45.117+0000 7fc211db7640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:45.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:45.117+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:45.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:45.117+0000 7fc211db7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:45.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:45.117+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:45.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:45.117+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:46.715+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:46.715+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:46.715+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:46.715+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:46.715+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:46.715+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:46.715+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c071500 con 0x7fc1f0018990 2023-11-04T01:53:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:46.715+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0016ff0 2023-11-04T01:53:46.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:46.715+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0018990 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:46.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:46.715+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:46.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:46.715+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:46.916+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0018990 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:46.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:46.916+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:46.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:46.916+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:47.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:47.317+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0018990 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:47.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:47.317+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:47.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:47.317+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:48.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:48.118+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0018990 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:48.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:48.118+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:48.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:48.118+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:49.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.715+0000 7fc202ffd640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:49.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.715+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0016ff0 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:49.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.715+0000 7fc202ffd640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0018990 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:49.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.715+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:49.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.715+0000 7fc211db7640 1 -- reap_dead start 2023-11-04T01:53:49.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.715+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:49.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.715+0000 7fc202ffd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f000e2d0 con 0x7fc1f000a500 2023-11-04T01:53:49.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.715+0000 7fc202ffd640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f000dbb0 2023-11-04T01:53:49.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.715+0000 7fc202ffd640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f000ad60 con 0x7fc1f0014440 2023-11-04T01:53:49.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.715+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:49.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.715+0000 7fc211db7640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:49.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.715+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:49.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.715+0000 7fc211db7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:49.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.715+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.916+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.916+0000 7fc211db7640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.916+0000 7fc211db7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.916+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:49.916+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:50.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:50.316+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:50.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:50.316+0000 7fc211db7640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:50.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:50.316+0000 7fc211db7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:50.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:50.316+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:50.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:50.316+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:51.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:51.117+0000 7fc210db5640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:51.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:51.117+0000 7fc211db7640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:51.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:51.117+0000 7fc211db7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:51.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:51.117+0000 7fc2115b6640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:51.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:51.117+0000 7fc2115b6640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:52.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:52.715+0000 7fc202ffd640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 msgr2=0x7fc1f001b580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:52.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:52.715+0000 7fc202ffd640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7fc1f0014440 0x7fc1f001b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:52.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:52.715+0000 7fc202ffd640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 msgr2=0x7fc1f0009ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:52.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:52.715+0000 7fc202ffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1f000dbb0 0x7fc1f0009ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:52.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:52.715+0000 7fc202ffd640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7fc1f000a500 legacy=0x7fc1f0017e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:52.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:52.715+0000 7fc202ffd640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 0x7fc1f0017400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:52.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:52.715+0000 7fc202ffd640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c071500 con 0x7fc1f0016ff0 2023-11-04T01:53:52.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:52.715+0000 7fc202ffd640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c15dae0 con 0x7fc1f0018990 2023-11-04T01:53:52.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:52.715+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:52.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:52.715+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0016ff0 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:52.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:52.715+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:52.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:52.916+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0016ff0 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:52.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:52.916+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:52.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:52.916+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:53.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:53.317+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0016ff0 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:53.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:53.317+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:53.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:53.317+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:53.681 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:53.684 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:54.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:54.118+0000 7fc2115b6640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7fc1f0016ff0 legacy=0x7fc1f0014d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:54.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:54.118+0000 7fc210db5640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 msgr2=0x7fc1f0017400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:54.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:54.118+0000 7fc210db5640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7fc1f0018990 0x7fc1f0017400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:55.631 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:53:55.633 INFO:tasks.cephfs_test_runner:check snaptable transcation ... ERROR 2023-11-04T01:53:55.633 INFO:tasks.cephfs_test_runner:ERROR 2023-11-04T01:53:55.634 INFO:tasks.cephfs_test_runner: 2023-11-04T01:53:55.634 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:53:55.634 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:53:55.634 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:53:55.634 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:53:55.634 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:53:55.634 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 174, in test_kill_mdstable 2023-11-04T01:53:55.634 INFO:tasks.cephfs_test_runner: self.assertEqual(len(self._get_pending_snap_update(rank=0)), 1) 2023-11-04T01:53:55.634 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 38, in _get_pending_snap_update 2023-11-04T01:53:55.634 INFO:tasks.cephfs_test_runner: return self._get_snapserver_dump(rank,status=status)["pending_update"] 2023-11-04T01:53:55.634 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 29, in _get_snapserver_dump 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: return self.fs.rank_asok(["dump", "snaps", "--server"], rank=rank, status=status) 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1295, in rank_asok 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: info = self.get_rank(rank=rank, status=status) 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1101, in get_rank 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: status = self.getinfo() 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 565, in getinfo 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: status = self.status() 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:53:55.635 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:53:55.636 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:53:55.636 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:53:55.636 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:53:55.636 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:53:55.636 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:53:55.636 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:53:55.636 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:53:55.636 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:53:55.636 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:53:55.636 INFO:tasks.cephfs_test_runner: 2023-11-04T01:53:55.636 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:53:55.636 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:53:55.636 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:53:55.636 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:53:55.636 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:53:55.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/cephfs_test_case.py", line 208, in tearDown 2023-11-04T01:53:55.637 INFO:tasks.cephfs_test_runner: self.mds_cluster.delete_all_filesystems() 2023-11-04T01:53:55.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 493, in delete_all_filesystems 2023-11-04T01:53:55.637 INFO:tasks.cephfs_test_runner: for fs in self.status().get_filesystems(): 2023-11-04T01:53:55.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:53:55.637 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:53:55.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:53:55.637 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:53:55.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:53:55.637 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:53:55.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:53:55.637 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:53:55.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:53:55.637 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:53:55.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:53:55.637 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:53:55.638 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:53:55.638 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:53:55.638 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:53:55.638 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:53:55.638 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:53:55.638 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:53:55.638 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:53:55.638 INFO:tasks.cephfs_test_runner: 2023-11-04T01:53:55.638 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:53:55.638 INFO:tasks.cephfs_test_runner:Ran 5 tests in 996.977s 2023-11-04T01:53:55.638 INFO:tasks.cephfs_test_runner: 2023-11-04T01:53:55.638 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2023-11-04T01:53:55.639 INFO:tasks.cephfs_test_runner: 2023-11-04T01:53:55.639 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:53:55.639 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:53:55.639 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:53:55.639 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:53:55.639 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:53:55.639 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 174, in test_kill_mdstable 2023-11-04T01:53:55.639 INFO:tasks.cephfs_test_runner: self.assertEqual(len(self._get_pending_snap_update(rank=0)), 1) 2023-11-04T01:53:55.639 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 38, in _get_pending_snap_update 2023-11-04T01:53:55.639 INFO:tasks.cephfs_test_runner: return self._get_snapserver_dump(rank,status=status)["pending_update"] 2023-11-04T01:53:55.639 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 29, in _get_snapserver_dump 2023-11-04T01:53:55.639 INFO:tasks.cephfs_test_runner: return self.fs.rank_asok(["dump", "snaps", "--server"], rank=rank, status=status) 2023-11-04T01:53:55.639 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1295, in rank_asok 2023-11-04T01:53:55.639 INFO:tasks.cephfs_test_runner: info = self.get_rank(rank=rank, status=status) 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1101, in get_rank 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: status = self.getinfo() 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 565, in getinfo 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: status = self.status() 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:53:55.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:53:55.641 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:53:55.641 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:53:55.641 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:53:55.641 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:53:55.641 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:53:55.641 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:53:55.641 INFO:tasks.cephfs_test_runner: 2023-11-04T01:53:55.641 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:53:55.641 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:53:55.641 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:53:55.641 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:53:55.641 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:53:55.641 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/cephfs_test_case.py", line 208, in tearDown 2023-11-04T01:53:55.641 INFO:tasks.cephfs_test_runner: self.mds_cluster.delete_all_filesystems() 2023-11-04T01:53:55.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 493, in delete_all_filesystems 2023-11-04T01:53:55.642 INFO:tasks.cephfs_test_runner: for fs in self.status().get_filesystems(): 2023-11-04T01:53:55.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:53:55.642 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:53:55.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:53:55.642 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:53:55.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:53:55.642 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:53:55.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:53:55.642 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:53:55.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:53:55.642 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:53:55.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:53:55.642 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:53:55.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:53:55.643 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:53:55.643 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:53:55.643 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:53:55.643 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:53:55.643 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:53:55.643 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:53:55.643 INFO:tasks.cephfs_test_runner: 2023-11-04T01:53:55.643 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:53:55.747 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9a28bc0cb2e34be2a8617be5fe0eedf2 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:53:55.748 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-04T01:53:55.759 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-04T01:53:55.768 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-04T01:53:55.768 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:53:55.768 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:53:55.789 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:53:55.789 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-11-04T01:53:55.790 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:53:55.847 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2424 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:53:55.848 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:53:55.848 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:53:55.866 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:53:55.866 DEBUG:teuthology.orchestra.run.smithi141:> set -ex 2023-11-04T01:53:55.866 DEBUG:teuthology.orchestra.run.smithi141:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:53:55.924 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19738 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:53:55.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:55.924 DEBUG:teuthology.orchestra.run.smithi141:> ip netns list 2023-11-04T01:53:55.982 INFO:teuthology.orchestra.run.smithi141.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-04T01:53:55.982 INFO:teuthology.orchestra.run.smithi141.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-04T01:53:55.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:55.983 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:53:56.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:56.053 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:53:56.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:56.124 DEBUG:teuthology.orchestra.run.smithi141:> sudo ip link delete ceph-brx 2023-11-04T01:53:56.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:56.224 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-11-04T01:53:56.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:53:56.242 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:53:56.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:56.243 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:53:56.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:56.314 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:53:56.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:56.384 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2023-11-04T01:53:56.480 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-04T01:53:56.489 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-04T01:53:56.490 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:53:56.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.588+0000 7f2576fd7640 1 Processor -- start 2023-11-04T01:53:56.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.589+0000 7f2576fd7640 1 -- start start 2023-11-04T01:53:56.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.589+0000 7f2576fd7640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f257015d100 0x7f25700ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:56.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.589+0000 7f2576fd7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25700d1be0 0x7f25700b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:56.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.589+0000 7f2576fd7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b32b0 con 0x7f257015d4e0 2023-11-04T01:53:56.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.589+0000 7f2576fd7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f25700d1be0 2023-11-04T01:53:56.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.589+0000 7f2576fd7640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f257015d100 2023-11-04T01:53:56.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.590+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f257015d4e0 legacy=0x7f25700d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:56.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.590+0000 7f2575574640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f25700d1be0 msgr2=0x7f25700b3740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:56.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.590+0000 7f2575574640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25700d1be0 0x7f25700b3740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:56.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.590+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f257015d100 msgr2=0x7f25700ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:56.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.590+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f257015d100 0x7f25700ce510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:56.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.791+0000 7f2575574640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f25700d1be0 msgr2=0x7f25700b3740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:56.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.791+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f257015d4e0 legacy=0x7f25700d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:56.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.791+0000 7f2575574640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25700d1be0 0x7f25700b3740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:56.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.791+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f257015d100 msgr2=0x7f25700ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:56.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:56.791+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f257015d100 0x7f25700ce510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:57.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:57.192+0000 7f2575574640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f25700d1be0 msgr2=0x7f25700b3740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:57.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:57.192+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f257015d4e0 legacy=0x7f25700d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:57.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:57.192+0000 7f2575574640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25700d1be0 0x7f25700b3740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:57.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:57.192+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f257015d100 msgr2=0x7f25700ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:57.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:57.192+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f257015d100 0x7f25700ce510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:57.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:57.993+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f257015d4e0 legacy=0x7f25700d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:53:57.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:57.993+0000 7f2575574640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f25700d1be0 msgr2=0x7f25700b3740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:53:57.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:57.993+0000 7f2575574640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25700d1be0 0x7f25700b3740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:57.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:57.993+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f257015d100 msgr2=0x7f25700ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:53:57.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:57.993+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f257015d100 0x7f25700ce510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:59.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:59.589+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f257015d100 msgr2=0x7f25700ce510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:59.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:59.589+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f257015d100 0x7f25700ce510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:59.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:59.589+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f25700d1be0 msgr2=0x7f25700b3740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:59.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:59.589+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25700d1be0 0x7f25700b3740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:59.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:59.589+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f257015d4e0 legacy=0x7f25700d14d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:59.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:59.589+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0036f0 0x7f255c005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:59.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:59.589+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b2c60 con 0x7f255c0061c0 2023-11-04T01:53:59.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:59.589+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c0036f0 2023-11-04T01:53:59.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:59.590+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0036f0 msgr2=0x7f255c005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:59.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:59.590+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c0061c0 legacy=0x7f255c008680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:59.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:59.590+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0036f0 0x7f255c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:59.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:59.791+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c0061c0 legacy=0x7f255c008680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:53:59.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:59.791+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0036f0 msgr2=0x7f255c005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:53:59.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:53:59.791+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0036f0 0x7f255c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:00.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:00.192+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c0061c0 legacy=0x7f255c008680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:00.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:00.192+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0036f0 msgr2=0x7f255c005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:00.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:00.192+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0036f0 0x7f255c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:00.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:00.993+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0036f0 msgr2=0x7f255c005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:00.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:00.993+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c0061c0 legacy=0x7f255c008680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:00.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:00.993+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0036f0 0x7f255c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.590+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0036f0 msgr2=0x7f255c005b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.590+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0036f0 0x7f255c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.590+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c0061c0 legacy=0x7f255c008680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.590+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:54:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.590+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00aab0 0x7f255c005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.590+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.590+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b32b0 con 0x7f255c009f20 2023-11-04T01:54:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.590+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c00aab0 2023-11-04T01:54:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.590+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c008830 2023-11-04T01:54:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.590+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009f20 legacy=0x7f255c00a300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.590+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00aab0 msgr2=0x7f255c005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.590+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00aab0 0x7f255c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.590+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.590+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:02.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.791+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00aab0 msgr2=0x7f255c005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:02.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.791+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009f20 legacy=0x7f255c00a300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:02.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.791+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00aab0 0x7f255c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:02.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.791+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:02.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:02.791+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:03.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:03.192+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00aab0 msgr2=0x7f255c005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:03.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:03.192+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009f20 legacy=0x7f255c00a300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:03.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:03.192+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00aab0 0x7f255c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:03.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:03.192+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:03.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:03.192+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:03.993+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00aab0 msgr2=0x7f255c005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:03.993+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00aab0 0x7f255c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:03.993+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009f20 legacy=0x7f255c00a300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:03.993+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:03.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:03.993+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:05.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:05.590+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:05.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:05.590+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:05.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:05.590+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00aab0 msgr2=0x7f255c005b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:05.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:05.590+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00aab0 0x7f255c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:05.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:05.590+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009f20 legacy=0x7f255c00a300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:05.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:05.590+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d5f0 0x7f255c00d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:05.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:05.590+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b2c60 con 0x7f255c00e040 2023-11-04T01:54:05.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:05.590+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c00d5f0 2023-11-04T01:54:05.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:05.590+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d5f0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:05.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:05.590+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c00e040 legacy=0x7f255c0126f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:05.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:05.590+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d5f0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:05.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:05.791+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d5f0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:05.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:05.791+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c00e040 legacy=0x7f255c0126f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:05.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:05.791+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d5f0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:06.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:06.192+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c00e040 legacy=0x7f255c0126f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:06.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:06.192+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d5f0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:06.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:06.192+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d5f0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:06.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:06.993+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d5f0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:06.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:06.993+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c00e040 legacy=0x7f255c0126f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:06.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:06.993+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d5f0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:08.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.591+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d5f0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:08.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.591+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d5f0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:08.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.591+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c00e040 legacy=0x7f255c0126f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:08.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.591+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:54:08.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.591+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c013e40 0x7f255c00d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:08.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.591+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:08.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.591+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b32b0 con 0x7f255c009f20 2023-11-04T01:54:08.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.591+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c008830 2023-11-04T01:54:08.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.591+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c013e40 2023-11-04T01:54:08.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.591+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c013e40 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:08.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.591+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:08.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.591+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009f20 legacy=0x7f255c00a300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:08.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.591+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c013e40 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:08.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.591+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:08.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.792+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:08.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.792+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009f20 legacy=0x7f255c00a300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:08.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.792+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c013e40 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:08.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.792+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:08.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:08.792+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c013e40 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:09.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:09.193+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c013e40 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:09.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:09.193+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:09.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:09.193+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009f20 legacy=0x7f255c00a300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:09.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:09.193+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:09.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:09.193+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c013e40 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:09.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:09.994+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:09.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:09.994+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009f20 legacy=0x7f255c00a300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:09.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:09.994+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c013e40 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:09.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:09.994+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:09.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:09.994+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c013e40 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:11.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:11.591+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c013e40 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:11.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:11.591+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c013e40 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:11.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:11.591+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:11.591+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:11.591+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009f20 legacy=0x7f255c00a300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:11.591+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005c10 0x7f255c014850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:11.591+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b2c60 con 0x7f255c014470 2023-11-04T01:54:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:11.591+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c005c10 2023-11-04T01:54:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:11.591+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014470 legacy=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:11.591+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c005c10 msgr2=0x7f255c014850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:11.591+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005c10 0x7f255c014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:11.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:11.792+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014470 legacy=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:11.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:11.792+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c005c10 msgr2=0x7f255c014850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:11.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:11.792+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005c10 0x7f255c014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:12.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:12.193+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014470 legacy=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:12.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:12.193+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c005c10 msgr2=0x7f255c014850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:12.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:12.193+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005c10 0x7f255c014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:12.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:12.994+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014470 legacy=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:12.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:12.994+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c005c10 msgr2=0x7f255c014850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:12.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:12.994+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005c10 0x7f255c014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:14.591+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c005c10 msgr2=0x7f255c014850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:14.591+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005c10 0x7f255c014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:14.591+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014470 legacy=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:14.591+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:54:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:14.591+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c014850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:14.591+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b32b0 con 0x7f255c014f40 2023-11-04T01:54:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:14.591+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b2c60 con 0x7f255c005c10 2023-11-04T01:54:14.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:14.591+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c008830 2023-11-04T01:54:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:14.591+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014f40 legacy=0x7f255c017330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:14.591+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c014850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:14.591+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005c10 legacy=0x7f255c009f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:14.591+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:14.792+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014f40 legacy=0x7f255c017330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:14.792+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005c10 legacy=0x7f255c009f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:14.792+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c014850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:14.792+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:15.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:15.193+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014f40 legacy=0x7f255c017330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:15.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:15.193+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c014850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:15.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:15.193+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005c10 legacy=0x7f255c009f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:15.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:15.193+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:15.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:15.994+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014f40 legacy=0x7f255c017330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:15.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:15.994+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c014850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:15.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:15.994+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005c10 legacy=0x7f255c009f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:15.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:15.994+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:17.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:17.592+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c014850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:17.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:17.592+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c014850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:17.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:17.592+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005c10 legacy=0x7f255c009f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:17.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:17.592+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014f40 legacy=0x7f255c017330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:17.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:17.592+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c013e40 0x7f255c00d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:17.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:17.592+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:17.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:17.592+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c013e40 2023-11-04T01:54:17.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:17.592+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c00d010 2023-11-04T01:54:17.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:17.592+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c013e40 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:17.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:17.592+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c013e40 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:17.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:17.592+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:17.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:17.592+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:17.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:17.793+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c013e40 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:17.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:17.793+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c013e40 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:17.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:17.793+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:17.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:17.793+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:18.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:18.194+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c013e40 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:18.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:18.194+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c013e40 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:18.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:18.194+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:18.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:18.194+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:18.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:18.995+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c013e40 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:18.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:18.995+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c013e40 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:18.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:18.995+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:18.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:18.995+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:20.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.592+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:20.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.592+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:20.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.592+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c013e40 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:20.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.592+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c013e40 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:20.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.592+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:20.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.592+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:54:20.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.592+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c00a770 con 0x7f255c014f40 2023-11-04T01:54:20.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.592+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b32b0 con 0x7f255c005c10 2023-11-04T01:54:20.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.592+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c00d010 2023-11-04T01:54:20.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.592+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014f40 legacy=0x7f255c017330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:20.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.592+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005c10 legacy=0x7f255c009f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:20.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.592+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:20.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.592+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:20.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.793+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014f40 legacy=0x7f255c017330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:20.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.793+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005c10 legacy=0x7f255c009f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:20.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.793+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:20.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:20.793+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:21.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:21.194+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014f40 legacy=0x7f255c017330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:21.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:21.194+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005c10 legacy=0x7f255c009f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:21.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:21.194+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:21.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:21.194+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:21.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:21.995+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014f40 legacy=0x7f255c017330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:21.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:21.995+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:21.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:21.995+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005c10 legacy=0x7f255c009f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:21.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:21.995+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:23.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:23.593+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:23.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:23.593+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:23.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:23.593+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005c10 legacy=0x7f255c009f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:23.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:23.593+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014f40 legacy=0x7f255c017330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:23.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:23.593+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:23.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:23.593+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 0x7f255c011c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:23.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:23.593+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c008830 2023-11-04T01:54:23.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:23.593+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c014850 2023-11-04T01:54:23.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:23.593+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:23.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:23.593+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:23.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:23.593+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 msgr2=0x7f255c011c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:23.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:23.593+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 0x7f255c011c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:23.752 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:23.755 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:23.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:23.794+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:23.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:23.794+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:23.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:23.794+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 msgr2=0x7f255c011c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:23.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:23.794+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 0x7f255c011c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:24.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:24.195+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:24.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:24.195+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:24.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:24.195+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 msgr2=0x7f255c011c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:24.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:24.195+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 0x7f255c011c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:24.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:24.996+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:24.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:24.996+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:24.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:24.996+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 msgr2=0x7f255c011c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:24.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:24.996+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 0x7f255c011c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:26.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.593+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 msgr2=0x7f255c011c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:26.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.593+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 0x7f255c011c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:26.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.593+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:26.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.593+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:26.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.593+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:54:26.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.593+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 0x7f255c011c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:26.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.593+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:26.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.593+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b2c60 con 0x7f255c014f40 2023-11-04T01:54:26.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.593+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c014850 2023-11-04T01:54:26.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.593+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c008830 2023-11-04T01:54:26.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.593+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014f40 legacy=0x7f255c010c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:26.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.593+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 msgr2=0x7f255c011c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:26.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.593+0000 7f2575574640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:26.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.593+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 0x7f255c011c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:26.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.593+0000 7f2575574640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:26.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.794+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014f40 legacy=0x7f255c010c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:26.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.794+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 msgr2=0x7f255c011c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:26.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.794+0000 7f2575574640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:26.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.794+0000 7f2575574640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:26.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:26.794+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 0x7f255c011c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:27.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:27.195+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014f40 legacy=0x7f255c010c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:27.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:27.195+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 msgr2=0x7f255c011c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:27.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:27.195+0000 7f2575574640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:27.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:27.195+0000 7f2575574640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:27.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:27.195+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 0x7f255c011c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:27.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:27.996+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014f40 legacy=0x7f255c010c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:27.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:27.996+0000 7f2575574640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:27.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:27.996+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 msgr2=0x7f255c011c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:27.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:27.996+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 0x7f255c011c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:27.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:27.996+0000 7f2575574640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:29.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:29.592+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:29.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:29.592+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:29.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:29.592+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 msgr2=0x7f255c011c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:29.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:29.592+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c014850 0x7f255c011c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:29.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:29.592+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014f40 legacy=0x7f255c010c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:29.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:29.593+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:29.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:29.593+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c00a770 con 0x7f255c005b60 2023-11-04T01:54:29.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:29.593+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c00d010 2023-11-04T01:54:29.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:29.593+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005b60 legacy=0x7f255c009ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:29.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:29.593+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:29.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:29.593+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:29.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:29.794+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:29.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:29.794+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:29.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:29.794+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005b60 legacy=0x7f255c009ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:30.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:30.195+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:30.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:30.195+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:30.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:30.195+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005b60 legacy=0x7f255c009ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:30.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:30.996+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:30.996+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:30.996+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005b60 legacy=0x7f255c009ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:32.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:32.594+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:32.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:32.594+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:32.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:32.594+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005b60 legacy=0x7f255c009ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:32.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:32.594+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:32.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:32.594+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:54:32.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:32.594+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b2c60 con 0x7f255c008830 2023-11-04T01:54:32.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:32.594+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c00a770 con 0x7f255c005b60 2023-11-04T01:54:32.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:32.594+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c00d010 2023-11-04T01:54:32.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:32.594+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:32.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:32.594+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:32.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:32.594+0000 7f2575574640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c008830 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:32.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:32.594+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005b60 legacy=0x7f255c009ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:32.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:32.795+0000 7f2575574640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c008830 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:32.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:32.795+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:32.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:32.795+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:32.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:32.795+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005b60 legacy=0x7f255c009ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:33.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:33.196+0000 7f2575574640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c008830 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:33.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:33.196+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:33.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:33.196+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:33.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:33.196+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005b60 legacy=0x7f255c009ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:33.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:33.997+0000 7f2575574640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c008830 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:33.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:33.997+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:33.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:33.997+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:33.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:33.997+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005b60 legacy=0x7f255c009ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:35.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:35.593+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:35.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:35.593+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:35.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:35.593+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005b60 legacy=0x7f255c009ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:35.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:35.593+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c008830 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:35.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:35.593+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c014850 0x7f255c00d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:35.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:35.593+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0051f0 0x7f255c0055d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:35.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:35.593+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c0051f0 2023-11-04T01:54:35.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:35.593+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c014850 2023-11-04T01:54:35.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:35.593+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c014850 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:35.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:35.593+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0051f0 msgr2=0x7f255c0055d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:35.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:35.593+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c014850 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:35.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:35.593+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0051f0 0x7f255c0055d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:35.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:35.794+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0051f0 msgr2=0x7f255c0055d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:35.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:35.794+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c014850 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:35.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:35.794+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0051f0 0x7f255c0055d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:35.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:35.794+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c014850 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:36.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:36.195+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c014850 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:36.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:36.195+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0051f0 msgr2=0x7f255c0055d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:36.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:36.195+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c014850 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:36.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:36.195+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0051f0 0x7f255c0055d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:36.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:36.997+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0051f0 msgr2=0x7f255c0055d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:36.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:36.997+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c014850 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:36.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:36.997+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0051f0 0x7f255c0055d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:36.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:36.997+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c014850 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.593+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c014850 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.593+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c014850 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.593+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0051f0 msgr2=0x7f255c0055d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:38.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.593+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0051f0 0x7f255c0055d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:38.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.593+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:54:38.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.593+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:38.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.593+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:38.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.594+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b32b0 con 0x7f255c005b60 2023-11-04T01:54:38.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.594+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c00d010 2023-11-04T01:54:38.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.594+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c008830 2023-11-04T01:54:38.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.594+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:38.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.594+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:38.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.594+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:38.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.594+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005b60 legacy=0x7f255c009ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:38.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.594+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:38.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.795+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:38.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.795+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:38.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.795+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:38.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.795+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005b60 legacy=0x7f255c009ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:38.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:38.795+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:39.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:39.196+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:39.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:39.196+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:39.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:39.196+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:39.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:39.196+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005b60 legacy=0x7f255c009ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:39.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:39.196+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:39.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:39.997+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:39.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:39.997+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:39.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:39.997+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005b60 legacy=0x7f255c009ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:39.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:39.997+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:39.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:39.997+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:41.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:41.594+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:41.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:41.594+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:41.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:41.594+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 msgr2=0x7f255c0106e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:41.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:41.594+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c00d010 0x7f255c0106e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:41.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:41.594+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c005b60 legacy=0x7f255c009ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:41.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:41.594+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c012340 0x7f255c012750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:41.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:41.594+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b2c60 con 0x7f255c014850 2023-11-04T01:54:41.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:41.594+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c012340 2023-11-04T01:54:41.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:41.594+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014850 legacy=0x7f255c010c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:41.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:41.594+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c012340 msgr2=0x7f255c012750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:41.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:41.594+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c012340 0x7f255c012750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:41.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:41.795+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014850 legacy=0x7f255c010c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:41.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:41.795+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c012340 msgr2=0x7f255c012750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:41.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:41.795+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c012340 0x7f255c012750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:42.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:42.196+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014850 legacy=0x7f255c010c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:42.196+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c012340 msgr2=0x7f255c012750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:42.196+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c012340 0x7f255c012750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:42.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:42.997+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014850 legacy=0x7f255c010c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:42.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:42.997+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c012340 msgr2=0x7f255c012750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:42.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:42.997+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c012340 0x7f255c012750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:44.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:44.594+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c012340 msgr2=0x7f255c012750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:44.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:44.594+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c012340 0x7f255c012750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:44.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:44.594+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c014850 legacy=0x7f255c010c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:44.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:44.594+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:54:44.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:44.594+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:44.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:44.594+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b32b0 con 0x7f255c012e10 2023-11-04T01:54:44.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:44.594+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b2c60 con 0x7f255c009ee0 2023-11-04T01:54:44.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:44.594+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c008830 2023-11-04T01:54:44.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:44.594+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c012e10 legacy=0x7f255c0131f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:44.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:44.594+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0139a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:44.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:44.594+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:44.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:44.594+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:44.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:44.795+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c012e10 legacy=0x7f255c0131f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:44.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:44.795+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:44.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:44.795+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0139a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:44.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:44.795+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:45.196+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c012e10 legacy=0x7f255c0131f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:45.196+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0139a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:45.196+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:45.196+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:45.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:45.997+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c012e10 legacy=0x7f255c0131f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:45.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:45.997+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:45.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:45.997+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0139a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:45.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:45.997+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:47.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:47.595+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:47.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:47.595+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:47.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:47.595+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0139a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:47.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:47.595+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c012e10 legacy=0x7f255c0131f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:47.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:47.595+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00b000 0x7f255c003ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:47.595+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c004010 0x7f255c004420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:47.595+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c004010 2023-11-04T01:54:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:47.595+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c00b000 2023-11-04T01:54:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:47.595+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c004010 msgr2=0x7f255c004420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:47.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:47.595+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c004010 0x7f255c004420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:47.595+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00b000 msgr2=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:47.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:47.595+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00b000 0x7f255c003ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:47.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:47.796+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c004010 msgr2=0x7f255c004420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:47.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:47.796+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c004010 0x7f255c004420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:47.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:47.796+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00b000 msgr2=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:47.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:47.796+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00b000 0x7f255c003ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:48.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:48.197+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c004010 msgr2=0x7f255c004420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:48.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:48.197+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c004010 0x7f255c004420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:48.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:48.197+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00b000 msgr2=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:48.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:48.197+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00b000 0x7f255c003ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:49.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:48.998+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c004010 msgr2=0x7f255c004420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:49.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:48.998+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c004010 0x7f255c004420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:49.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:48.998+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00b000 msgr2=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:49.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:48.998+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00b000 0x7f255c003ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:50.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.595+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00b000 msgr2=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:50.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.595+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00b000 0x7f255c003ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:50.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.595+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c004010 msgr2=0x7f255c004420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:50.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.595+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c004010 0x7f255c004420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:50.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.595+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:50.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.595+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:54:50.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.595+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:50.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.595+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c00a770 con 0x7f255c009ee0 2023-11-04T01:54:50.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.595+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c005ae0 2023-11-04T01:54:50.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.595+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c008830 2023-11-04T01:54:50.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.595+0000 7f2575574640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:50.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.595+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:50.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.595+0000 7f2575574640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:50.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.595+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:50.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.595+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:50.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.796+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:50.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.796+0000 7f2575574640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:50.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.796+0000 7f2575574640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:50.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.796+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:50.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:50.796+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:51.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:51.197+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:51.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:51.197+0000 7f2575574640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:51.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:51.197+0000 7f2575574640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:51.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:51.197+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:51.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:51.197+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:52.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:51.998+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:52.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:51.998+0000 7f2575574640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:52.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:51.998+0000 7f2575574640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:52.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:51.998+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:52.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:51.998+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:53.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:53.595+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:53.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:53.595+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:53.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:53.595+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:53.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:53.595+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:53.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:53.595+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:53.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:53.595+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 0x7f255c011dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:53.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:53.595+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b32b0 con 0x7f255c00cff0 2023-11-04T01:54:53.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:53.595+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c0099e0 2023-11-04T01:54:53.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:53.595+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c011dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:53.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:53.595+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:53.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:53.595+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 0x7f255c011dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:53.796+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c011dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:53.796+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:53.796+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 0x7f255c011dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:53.890 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:53.893 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:54.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:54.197+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c011dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:54.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:54.197+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:54.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:54.197+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 0x7f255c011dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:55.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:54.998+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c011dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:55.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:54.998+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:55.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:54.998+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 0x7f255c011dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:56.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.596+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c011dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:56.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.596+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 0x7f255c011dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:56.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.596+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:56.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.596+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:54:56.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.596+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:56.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.596+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:56.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.596+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 0x7f255c011dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:56.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.596+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c005ae0 2023-11-04T01:54:56.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.596+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c0099e0 2023-11-04T01:54:56.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.596+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c00a2c0 con 0x7f255c008830 2023-11-04T01:54:56.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.596+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:56.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.596+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:56.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.596+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c011dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:56.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.596+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:56.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.596+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 0x7f255c011dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:56.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.596+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:56.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.797+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:56.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.797+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:56.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.797+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:56.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.797+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c011dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:56.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.797+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 0x7f255c011dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:56.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:56.797+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:57.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:57.198+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:57.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:57.198+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:57.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:57.198+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c011dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:57.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:57.198+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:57.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:57.198+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 0x7f255c011dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:57.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:57.198+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:58.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:57.999+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:54:58.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:57.999+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:58.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:57.999+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:54:58.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:57.999+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c011dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:54:58.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:57.999+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:58.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:57.999+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 0x7f255c011dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:59.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:59.596+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:59.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:59.596+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:59.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:59.596+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c011dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:59.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:59.596+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c0099e0 0x7f255c011dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:59.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:59.596+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:59.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:59.596+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:59.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:59.596+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c00a770 con 0x7f255c00cff0 2023-11-04T01:54:59.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:59.596+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b32b0 con 0x7f255c009ee0 2023-11-04T01:54:59.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:59.596+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:59.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:59.596+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:54:59.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:59.797+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:54:59.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:54:59.797+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:00.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:00.198+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:00.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:00.198+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:01.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:00.999+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:01.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:00.999+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:02.596+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:02.596+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:02.596+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:02.596+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:55:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:02.596+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b2c60 con 0x7f255c00cff0 2023-11-04T01:55:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:02.596+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c00a770 con 0x7f255c009ee0 2023-11-04T01:55:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:02.596+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c008830 2023-11-04T01:55:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:02.596+0000 7f2575574640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:02.596+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:02.596+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:02.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:02.596+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:02.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:02.797+0000 7f2575574640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:02.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:02.797+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:02.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:02.797+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:02.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:02.797+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:03.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:03.198+0000 7f2575574640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:03.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:03.198+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:03.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:03.198+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:03.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:03.198+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:04.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:03.999+0000 7f2575574640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:04.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:03.999+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:04.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:03.999+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:04.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:03.999+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:05.597+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:05.597+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:05.597+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:05.597+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:05.597+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:05.597+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 0x7f255c0116b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:05.597+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c0099e0 2023-11-04T01:55:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:05.597+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c005ae0 2023-11-04T01:55:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:05.597+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c0116b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:05.597+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 0x7f255c0116b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:05.597+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:05.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:05.597+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:05.798+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c0116b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:05.798+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 0x7f255c0116b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:05.798+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:05.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:05.798+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:06.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:06.199+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c0116b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:06.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:06.199+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 0x7f255c0116b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:06.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:06.199+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:06.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:06.199+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:07.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:07.000+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c0116b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:07.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:07.000+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 0x7f255c0116b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:07.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:07.000+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:07.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:07.000+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:08.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.597+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:08.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.597+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:08.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.597+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c0116b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:08.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.597+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 0x7f255c0116b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:08.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.597+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:55:08.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.597+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 0x7f255c010db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:08.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.597+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b32b0 con 0x7f255c00cff0 2023-11-04T01:55:08.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.597+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b2c60 con 0x7f255c009ee0 2023-11-04T01:55:08.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.597+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c0099e0 2023-11-04T01:55:08.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.597+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:08.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.597+0000 7f2575574640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c010db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:08.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.597+0000 7f2575574640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 0x7f255c010db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:08.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.597+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:08.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.798+0000 7f2575574640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c010db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:08.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.798+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:08.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.798+0000 7f2575574640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 0x7f255c010db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:08.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:08.798+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:09.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:09.199+0000 7f2575574640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c010db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:09.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:09.199+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:09.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:09.199+0000 7f2575574640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 0x7f255c010db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:09.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:09.199+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:10.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:10.000+0000 7f2575574640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c010db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:10.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:10.000+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:10.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:10.000+0000 7f2575574640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 0x7f255c010db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:10.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:10.000+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:11.597+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 msgr2=0x7f255c010db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:11.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:11.597+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0099e0 0x7f255c010db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:11.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:11.597+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:11.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:11.597+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:11.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:11.597+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c0094a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:11.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:11.597+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:11.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:11.597+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c005ae0 2023-11-04T01:55:11.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:11.597+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c008830 2023-11-04T01:55:11.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:11.597+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:11.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:11.597+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:11.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:11.597+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:11.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:11.597+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:11.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:11.798+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:11.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:11.798+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:11.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:11.798+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:11.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:11.798+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:12.199+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:12.199+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:12.199+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:12.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:12.199+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:13.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:13.000+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:13.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:13.000+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:13.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:13.000+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:13.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:13.000+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.598+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c0094a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.598+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c0094a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.598+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.598+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.598+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:55:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.598+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.598+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c00a770 con 0x7f255c00cff0 2023-11-04T01:55:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.598+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b32b0 con 0x7f255c009ee0 2023-11-04T01:55:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.598+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c005ae0 2023-11-04T01:55:14.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.598+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:14.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.598+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:14.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.598+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:14.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.598+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:14.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.799+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:14.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.799+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:14.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.799+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:14.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:14.799+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:15.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:15.200+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:15.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:15.200+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:15.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:15.200+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:15.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:15.200+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:16.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:16.001+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:16.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:16.001+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:16.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:16.001+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:16.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:16.001+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:17.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:17.598+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:17.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:17.598+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:17.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:17.598+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:17.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:17.598+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:17.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:17.598+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c010db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:17.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:17.598+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0094a0 0x7f255c012300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:17.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:17.598+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c0094a0 2023-11-04T01:55:17.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:17.598+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c008830 2023-11-04T01:55:17.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:17.598+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c0094a0 msgr2=0x7f255c012300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:17.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:17.598+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0094a0 0x7f255c012300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:17.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:17.598+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c010db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:17.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:17.598+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c010db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:17.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:17.799+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c0094a0 msgr2=0x7f255c012300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:17.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:17.799+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0094a0 0x7f255c012300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:17.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:17.799+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c010db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:17.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:17.799+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c010db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:18.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:18.200+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c0094a0 msgr2=0x7f255c012300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:18.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:18.200+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0094a0 0x7f255c012300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:18.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:18.200+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c010db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:18.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:18.200+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c010db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:19.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:19.001+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c0094a0 msgr2=0x7f255c012300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:19.001+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0094a0 0x7f255c012300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:19.001+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c010db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:19.001+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c010db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:20.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.597+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 msgr2=0x7f255c010db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:20.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.597+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c008830 0x7f255c010db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:20.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.597+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c0094a0 msgr2=0x7f255c012300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:20.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.597+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c0094a0 0x7f255c012300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:20.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.597+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:55:20.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.597+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:20.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.597+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b2c60 con 0x7f255c00cff0 2023-11-04T01:55:20.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.597+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c00a770 con 0x7f255c009ee0 2023-11-04T01:55:20.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.597+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c005ae0 2023-11-04T01:55:20.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.597+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:20.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.597+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:20.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.597+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:20.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.597+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:20.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.798+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:20.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.798+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:20.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.798+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:20.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:20.798+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:21.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:21.199+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:21.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:21.199+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:21.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:21.199+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:21.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:21.199+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:22.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:22.000+0000 7f2574d73640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:22.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:22.000+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:22.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:22.000+0000 7f256ffff640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:22.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:22.000+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:23.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:23.598+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:23.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:23.598+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005ae0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:23.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:23.598+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c0106a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:23.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:23.598+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c00cff0 legacy=0x7f255c008d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:23.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:23.598+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 0x7f255c010db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:23.598+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c0094a0 0x7f255c009880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:23.598+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c008830 2023-11-04T01:55:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:23.598+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c0094a0 2023-11-04T01:55:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:23.598+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 msgr2=0x7f255c010db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:23.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:23.598+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 0x7f255c010db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:23.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:23.598+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c0094a0 msgr2=0x7f255c009880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:23.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:23.598+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c0094a0 0x7f255c009880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:23.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:23.799+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 msgr2=0x7f255c010db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:23.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:23.799+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 0x7f255c010db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:23.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:23.799+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c0094a0 msgr2=0x7f255c009880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:23.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:23.799+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c0094a0 0x7f255c009880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:24.029 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:24.032 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:24.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:24.200+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 msgr2=0x7f255c010db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:24.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:24.200+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 0x7f255c010db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:24.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:24.200+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c0094a0 msgr2=0x7f255c009880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:24.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:24.200+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c0094a0 0x7f255c009880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:25.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:25.001+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 msgr2=0x7f255c010db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:25.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:25.001+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 0x7f255c010db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:25.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:25.001+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c0094a0 msgr2=0x7f255c009880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:25.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:25.001+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c0094a0 0x7f255c009880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:26.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.598+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c0094a0 msgr2=0x7f255c009880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.598+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c0094a0 0x7f255c009880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.598+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 msgr2=0x7f255c010db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.598+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c008830 0x7f255c010db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.598+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.598+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:55:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.598+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c013470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.598+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b32b0 con 0x7f255c009ee0 2023-11-04T01:55:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.598+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c012300 2023-11-04T01:55:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.598+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c00d9d0 2023-11-04T01:55:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.598+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.598+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.598+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.598+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 msgr2=0x7f255c013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.598+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:26.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.799+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:26.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.799+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:26.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.799+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:26.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.799+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 msgr2=0x7f255c013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:26.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:26.799+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:27.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:27.200+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:27.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:27.200+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:27.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:27.200+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:27.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:27.200+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 msgr2=0x7f255c013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:27.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:27.200+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:28.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:28.001+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:28.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:28.001+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:28.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:28.001+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:28.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:28.001+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 msgr2=0x7f255c013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:28.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:28.001+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:29.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:29.598+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 msgr2=0x7f255c013470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:29.598+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:29.598+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:29.598+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:29.598+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:29.598+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:29.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:29.598+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b2c60 con 0x7f255c0139b0 2023-11-04T01:55:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:29.598+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c00cff0 2023-11-04T01:55:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:29.599+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c0139b0 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:29.599+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0051f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:29.599+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:29.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:29.800+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0051f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:29.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:29.800+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c0139b0 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:29.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:29.800+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:30.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:30.201+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0051f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:30.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:30.201+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c0139b0 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:30.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:30.201+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:31.002+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0051f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:31.002+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c0139b0 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:31.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:31.002+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.599+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0051f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.599+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.599+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c0139b0 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.599+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:55:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.599+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c013470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.599+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.599+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.599+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c012300 2023-11-04T01:55:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.599+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c00d9d0 2023-11-04T01:55:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.599+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c00a2c0 con 0x7f255c00cff0 2023-11-04T01:55:32.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.599+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:32.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.599+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:32.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.599+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 msgr2=0x7f255c013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:32.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.599+0000 7f2575574640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0051f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:32.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.599+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:32.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.599+0000 7f2575574640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:32.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.800+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:32.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.800+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:32.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.800+0000 7f2575574640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0051f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:32.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.800+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 msgr2=0x7f255c013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:32.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.800+0000 7f2575574640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:32.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:32.800+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:33.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:33.201+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:33.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:33.201+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:33.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:33.201+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 msgr2=0x7f255c013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:33.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:33.201+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:33.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:33.201+0000 7f2575574640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0051f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:33.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:33.201+0000 7f2575574640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:34.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:34.002+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:34.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:34.002+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:34.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:34.002+0000 7f2575574640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0051f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:34.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:34.002+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 msgr2=0x7f255c013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:34.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:34.002+0000 7f2575574640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:34.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:34.002+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:35.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:35.599+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0051f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:35.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:35.599+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:35.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:35.599+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 msgr2=0x7f255c013470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:35.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:35.599+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:35.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:35.599+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:35.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:35.599+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:35.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:35.599+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b32b0 con 0x7f255c005730 2023-11-04T01:55:35.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:35.599+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b2c60 con 0x7f255c009ee0 2023-11-04T01:55:35.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:35.599+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c005730 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:35.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:35.599+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:35.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:35.800+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c005730 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:35.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:35.800+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:36.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:36.201+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c005730 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:36.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:36.201+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:37.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:37.002+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c005730 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:37.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:37.002+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:38.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.599+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:38.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.599+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c005730 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:38.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.599+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:38.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.599+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:38.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.599+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:55:38.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.599+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c00a770 con 0x7f255c009ee0 2023-11-04T01:55:38.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.599+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c012300 2023-11-04T01:55:38.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.599+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c00cff0 2023-11-04T01:55:38.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.599+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.599+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.599+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0051f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.599+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.599+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:38.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.800+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:38.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.800+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:38.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.800+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:38.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.800+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0051f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:38.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:38.800+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:39.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:39.201+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:39.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:39.201+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:39.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:39.201+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0051f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:39.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:39.201+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:39.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:39.201+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:40.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:40.002+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:40.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:40.002+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:40.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:40.002+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0051f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:40.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:40.002+0000 7f2575574640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:40.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:40.002+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:41.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:41.599+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0051f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:41.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:41.599+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0051f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:41.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:41.599+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:41.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:41.599+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:41.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:41.599+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:41.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:41.599+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005730 0x7f255c00d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:41.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:41.599+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b32b0 con 0x7f255c013470 2023-11-04T01:55:41.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:41.599+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c005730 2023-11-04T01:55:41.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:41.599+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c013470 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:41.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:41.599+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005730 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:41.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:41.599+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005730 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:41.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:41.800+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c013470 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:41.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:41.800+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005730 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:41.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:41.800+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005730 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:42.201+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c013470 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:42.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:42.201+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005730 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:42.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:42.201+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005730 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:43.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:43.002+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c013470 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:43.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:43.002+0000 7f2574d73640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005730 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:43.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:43.002+0000 7f2574d73640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005730 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:44.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.600+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c005730 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:44.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.600+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c005730 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:44.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.600+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c013470 legacy=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:44.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.600+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:44.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.600+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:55:44.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.600+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c003ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:44.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.600+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c00a770 con 0x7f255c009ee0 2023-11-04T01:55:44.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.600+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c012300 2023-11-04T01:55:44.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.600+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c00d9d0 2023-11-04T01:55:44.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.600+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:44.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.600+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:44.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.600+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:44.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.600+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 msgr2=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:44.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.600+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c003ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:44.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.801+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:44.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.801+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:44.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.801+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:44.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.801+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 msgr2=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:44.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:44.801+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c003ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:45.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:45.202+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:45.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:45.202+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:45.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:45.202+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:45.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:45.202+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 msgr2=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:45.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:45.202+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c003ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:46.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:46.003+0000 7f256ffff640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:46.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:46.003+0000 7f2574d73640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:46.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:46.003+0000 7f2574d73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:46.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:46.003+0000 7f2575574640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 msgr2=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:46.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:46.003+0000 7f2575574640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c003ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:47.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:47.600+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 msgr2=0x7f255c003ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:47.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:47.600+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c00d9d0 0x7f255c003ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:47.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:47.600+0000 7f256e7fc640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 msgr2=0x7f255c0126e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:47.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:47.600+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c012300 0x7f255c0126e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:47.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:47.600+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c009ee0 legacy=0x7f255c012d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:47.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:47.600+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0116b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:47.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:47.600+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b32b0 con 0x7f255c004010 2023-11-04T01:55:47.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:47.600+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c00cff0 2023-11-04T01:55:47.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:47.600+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c004010 legacy=0x7f255c004450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:47.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:47.600+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0116b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:47.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:47.600+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0116b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:47.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:47.801+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0116b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:47.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:47.801+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c004010 legacy=0x7f255c004450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:47.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:47.801+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0116b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:48.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:48.202+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0116b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:48.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:48.202+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c004010 legacy=0x7f255c004450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:48.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:48.202+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0116b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:49.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:49.003+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c004010 legacy=0x7f255c004450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:49.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:49.003+0000 7f256ffff640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0116b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:49.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:49.003+0000 7f256ffff640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0116b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:50.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:50.600+0000 7f256e7fc640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c0116b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:50.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:50.600+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c0116b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:50.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:50.600+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c004010 legacy=0x7f255c004450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:50.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:50.600+0000 7f2575574640 1 -- reap_dead start 2023-11-04T01:55:50.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:50.600+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c009ee0 0x7f255c00d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:50.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:50.600+0000 7f256e7fc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c00a770 con 0x7f255c003ad0 2023-11-04T01:55:50.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:50.600+0000 7f256e7fc640 1 -- --> v1:172.21.15.141:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700b32b0 con 0x7f255c011bf0 2023-11-04T01:55:50.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:50.600+0000 7f256e7fc640 1 -- --> v2:172.21.15.141:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c009ee0 2023-11-04T01:55:50.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:50.600+0000 7f2575574640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c003ad0 legacy=0x7f255c012d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:50.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:50.600+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c009ee0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:50.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:50.600+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c011bf0 legacy=0x7f255c004b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:50.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:50.600+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c009ee0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:50.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:50.801+0000 7f2575574640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c003ad0 legacy=0x7f255c012d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:50.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:50.801+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c009ee0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:50.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:50.801+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c011bf0 legacy=0x7f255c004b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:50.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:50.801+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c009ee0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:51.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:51.202+0000 7f2575574640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c003ad0 legacy=0x7f255c012d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:51.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:51.202+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c009ee0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:51.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:51.202+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c011bf0 legacy=0x7f255c004b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:51.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:51.202+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c009ee0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:52.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:52.003+0000 7f2575574640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c003ad0 legacy=0x7f255c012d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.114:6789/0 2023-11-04T01:55:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:52.003+0000 7f256ffff640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c009ee0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3300/0 2023-11-04T01:55:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:52.003+0000 7f2574d73640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c011bf0 legacy=0x7f255c004b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.141:6789/0 2023-11-04T01:55:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:52.003+0000 7f256ffff640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c009ee0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:53.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:53.601+0000 7f256e7fc640 1 -- >> v2:172.21.15.141:3300/0 conn(0x7f255c009ee0 msgr2=0x7f255c00d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:53.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:53.601+0000 7f256e7fc640 1 --2- >> v2:172.21.15.141:3300/0 conn(0x7f255c009ee0 0x7f255c00d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:53.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:53.601+0000 7f256e7fc640 1 -- >> v1:172.21.15.141:6789/0 conn(0x7f255c011bf0 legacy=0x7f255c004b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:53.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:53.601+0000 7f256e7fc640 1 -- >> v1:172.21.15.114:6789/0 conn(0x7f255c003ad0 legacy=0x7f255c012d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:53.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:53.601+0000 7f256e7fc640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c004450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:53.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:53.601+0000 7f256e7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c011fd0 0x7f255c0123e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:53.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:53.601+0000 7f256e7fc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cee10 con 0x7f255c011fd0 2023-11-04T01:55:53.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:53.601+0000 7f256e7fc640 1 -- --> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700b2980 con 0x7f255c00cff0 2023-11-04T01:55:53.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:53.601+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c011fd0 msgr2=0x7f255c0123e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:53.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:53.601+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c011fd0 0x7f255c0123e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:53.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:53.601+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c004450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:53.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:53.601+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c004450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:53.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:53.802+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c011fd0 msgr2=0x7f255c0123e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:53.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:53.802+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c011fd0 0x7f255c0123e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:53.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:53.802+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c004450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:53.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:53.802+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c004450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:54.086 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:54.089 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:54.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:54.203+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c011fd0 msgr2=0x7f255c0123e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:54.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:54.203+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c011fd0 0x7f255c0123e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:54.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:54.203+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c004450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:54.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:54.203+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c004450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:55.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:55.004+0000 7f256ffff640 1 -- >> v2:172.21.15.114:3300/0 conn(0x7f255c011fd0 msgr2=0x7f255c0123e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.114:3300/0 2023-11-04T01:55:55.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:55.004+0000 7f256ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f255c011fd0 0x7f255c0123e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:55.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:55.004+0000 7f2574d73640 1 -- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 msgr2=0x7f255c004450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.141:3301/0 2023-11-04T01:55:55.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-11-04T01:55:55.004+0000 7f2574d73640 1 --2- >> [v2:172.21.15.141:3301/0,v1:172.21.15.141:6790/0] conn(0x7f255c00cff0 0x7f255c004450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:56.522 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:55:56.523 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:55:56.533 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-04T01:55:56.533 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:55:56.533 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.536 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:55:56.536 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:55:56.536 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.536 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:55:56.537 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:55:56.537 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.537 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:56.537 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi141 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-11-04T01:55:56.547 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:55:56.547 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:55:56.547 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.547 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:55:56.547 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-04T01:55:56.548 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-04T01:55:56.548 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.548 INFO:tasks.ceph.osd.0:Stopped 2023-11-04T01:55:56.548 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-04T01:55:56.548 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.548 INFO:tasks.ceph.osd.1:Stopped 2023-11-04T01:55:56.548 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-04T01:55:56.549 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.549 INFO:tasks.ceph.osd.2:Stopped 2023-11-04T01:55:56.549 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-04T01:55:56.549 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.550 INFO:tasks.ceph.osd.3:Stopped 2023-11-04T01:55:56.550 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-04T01:55:56.550 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.550 INFO:tasks.ceph.osd.4:Stopped 2023-11-04T01:55:56.550 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-04T01:55:56.550 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.551 INFO:tasks.ceph.osd.5:Stopped 2023-11-04T01:55:56.551 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-04T01:55:56.551 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.551 INFO:tasks.ceph.osd.6:Stopped 2023-11-04T01:55:56.551 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-04T01:55:56.551 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.551 INFO:tasks.ceph.osd.7:Stopped 2023-11-04T01:55:56.552 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-04T01:55:56.552 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-04T01:55:56.552 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.552 INFO:tasks.ceph.mgr.y:Stopped 2023-11-04T01:55:56.552 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-04T01:55:56.552 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:56.553 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi141 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-11-04T01:55:56.563 INFO:tasks.ceph.mgr.x:Stopped 2023-11-04T01:55:56.563 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-04T01:55:56.563 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-04T01:55:56.563 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.564 INFO:tasks.ceph.mon.a:Stopped 2023-11-04T01:55:56.564 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-04T01:55:56.564 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.564 INFO:tasks.ceph.mon.b:Stopped 2023-11-04T01:55:56.564 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-04T01:55:56.564 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:55:56.565 INFO:tasks.ceph.mon.c:Stopped 2023-11-04T01:55:56.565 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-04T01:55:56.565 DEBUG:teuthology.orchestra.run.smithi114:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v RECENT_CRASH | head -n 1 2023-11-04T01:55:56.687 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:55:56.688 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-04T01:55:56.770 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:55:56.771 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-04T01:55:56.873 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:55:56.873 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-04T01:55:56.950 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:55:56.950 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-04T01:55:57.015 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:55:57.015 DEBUG:teuthology.orchestra.run.smithi141:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-04T01:55:57.178 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:55:57.179 DEBUG:teuthology.orchestra.run.smithi141:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-04T01:55:57.258 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:55:57.258 DEBUG:teuthology.orchestra.run.smithi141:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-04T01:55:57.316 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:55:57.317 DEBUG:teuthology.orchestra.run.smithi141:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-04T01:55:57.374 INFO:tasks.ceph:Archiving mon data... 2023-11-04T01:55:57.375 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918/data/mon.a.tgz 2023-11-04T01:55:57.375 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2023-11-04T01:55:57.392 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.6to0Y8Jjq8 2023-11-04T01:55:57.393 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.6to0Y8Jjq8 2023-11-04T01:55:57.550 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.6to0Y8Jjq8 2023-11-04T01:55:57.635 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.6to0Y8Jjq8 is 368KB 2023-11-04T01:55:57.692 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.6to0Y8Jjq8 2023-11-04T01:55:57.706 DEBUG:teuthology.misc:Transferring archived files from smithi141:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918/data/mon.b.tgz 2023-11-04T01:55:57.706 DEBUG:teuthology.orchestra.run.smithi141:> mktemp 2023-11-04T01:55:57.723 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.DePaIljBGt 2023-11-04T01:55:57.724 DEBUG:teuthology.orchestra.run.smithi141:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.DePaIljBGt 2023-11-04T01:55:57.880 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.DePaIljBGt 2023-11-04T01:55:57.965 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.DePaIljBGt is 372KB 2023-11-04T01:55:58.062 DEBUG:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.DePaIljBGt 2023-11-04T01:55:58.077 DEBUG:teuthology.misc:Transferring archived files from smithi141:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918/data/mon.c.tgz 2023-11-04T01:55:58.077 DEBUG:teuthology.orchestra.run.smithi141:> mktemp 2023-11-04T01:55:58.130 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.2JAl1eeDKM 2023-11-04T01:55:58.131 DEBUG:teuthology.orchestra.run.smithi141:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.2JAl1eeDKM 2023-11-04T01:55:58.269 DEBUG:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.2JAl1eeDKM 2023-11-04T01:55:58.353 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.2JAl1eeDKM is 372KB 2023-11-04T01:55:58.449 DEBUG:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.2JAl1eeDKM 2023-11-04T01:55:58.463 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-04T01:55:58.464 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-04T01:55:58.466 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-04T01:55:58.529 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-04T01:55:58.530 DEBUG:teuthology.orchestra.run.smithi114:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-04T01:55:58.537 DEBUG:teuthology.orchestra.run.smithi141:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-04T01:55:58.567 INFO:teuthology.orchestra.run.smithi114.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-04T01:55:58.597 INFO:teuthology.orchestra.run.smithi141.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-04T01:55:58.602 INFO:tasks.ceph:Archiving crash dumps... 2023-11-04T01:55:58.603 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918/remote/smithi114/crash 2023-11-04T01:55:58.604 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-04T01:55:58.744 DEBUG:teuthology.misc:Transferring archived files from smithi141:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918/remote/smithi141/crash 2023-11-04T01:55:58.745 DEBUG:teuthology.orchestra.run.smithi141:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-04T01:55:58.804 INFO:tasks.ceph:Shutting down logrotate 2023-11-04T01:55:58.804 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:58.807 DEBUG:teuthology.orchestra.run.smithi141:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:58.893 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:58.921 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:58.947 INFO:tasks.ceph:Compressing logs... 2023-11-04T01:55:58.947 DEBUG:teuthology.orchestra.run.smithi114:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-04T01:55:58.964 DEBUG:teuthology.orchestra.run.smithi141:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-04T01:55:59.045 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-04T01:55:59.045 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.125465.log 2023-11-04T01:55:59.045 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-04T01:55:59.046 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.3.125465.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-04T01:55:59.046 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118742.log 2023-11-04T01:55:59.046 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.125013.log 2023-11-04T01:55:59.047 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-client.admin.118742.log: 91.6% -- replaced with /var/log/ceph/ceph-client.3.125465.log.gz 2023-11-04T01:55:59.047 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118662.log 2023-11-04T01:55:59.047 INFO:teuthology.orchestra.run.smithi141.stderr: 88.4%/var/log/ceph/ceph-client.1.125013.log: -- replaced with /var/log/ceph/ceph-client.admin.118742.log.gz 2023-11-04T01:55:59.047 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118502.log 2023-11-04T01:55:59.048 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-04T01:55:59.048 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.admin.118662.log: /var/log/ceph/ceph-client.admin.118502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118622.log 2023-11-04T01:55:59.048 INFO:teuthology.orchestra.run.smithi141.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118662.log.gz 2023-11-04T01:55:59.048 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-04T01:55:59.049 INFO:teuthology.orchestra.run.smithi141.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118502.log.gz 2023-11-04T01:55:59.049 INFO:teuthology.orchestra.run.smithi141.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.1.125013.log.gz 2023-11-04T01:55:59.049 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.admin.118622.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-04T01:55:59.049 INFO:teuthology.orchestra.run.smithi141.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118622.log.gz 2023-11-04T01:55:59.049 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-04T01:55:59.050 INFO:teuthology.orchestra.run.smithi141.stderr:gzip/var/log/ceph/ceph-osd.5.log: -5 --verbose -- /var/log/ceph/ceph.log 2023-11-04T01:55:59.050 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-04T01:55:59.050 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-04T01:55:59.050 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118582.log 2023-11-04T01:55:59.051 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-mon.b.log: 93.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-04T01:55:59.051 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118542.log 2023-11-04T01:55:59.051 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.admin.118582.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118582.log.gz 2023-11-04T01:55:59.052 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118462.log 2023-11-04T01:55:59.052 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.admin.118542.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118542.log.gz 2023-11-04T01:55:59.052 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-04T01:55:59.052 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.admin.118462.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118462.log.gz 2023-11-04T01:55:59.052 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118702.log 2023-11-04T01:55:59.053 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-mds.d.log: 94.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-04T01:55:59.053 INFO:teuthology.orchestra.run.smithi141.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-04T01:55:59.053 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-client.admin.118702.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118702.log.gz 2023-11-04T01:55:59.053 INFO:teuthology.orchestra.run.smithi141.stderr:/var/log/ceph/ceph-mon.c.log: 90.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-04T01:55:59.154 INFO:teuthology.orchestra.run.smithi141.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-04T01:55:59.263 INFO:teuthology.orchestra.run.smithi141.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-04T01:55:59.324 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129244.log 2023-11-04T01:55:59.325 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104570.log 2023-11-04T01:55:59.325 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106370.log 2023-11-04T01:55:59.325 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.129244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110771.log 2023-11-04T01:55:59.325 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104570.log: /var/log/ceph/ceph-client.admin.106370.log: gzip -5 89.1% -- replaced with /var/log/ceph/ceph-client.admin.129244.log.gz 2023-11-04T01:55:59.325 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.99146.log 2023-11-04T01:55:59.326 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104570.log.gz 2023-11-04T01:55:59.326 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110771.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.106370.log.gz 2023-11-04T01:55:59.326 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97246.log 2023-11-04T01:55:59.326 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.99146.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110771.log.gz 2023-11-04T01:55:59.326 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98217.log 2023-11-04T01:55:59.326 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97246.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.99146.log.gz 2023-11-04T01:55:59.327 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106286.log 2023-11-04T01:55:59.327 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97246.log.gz 2023-11-04T01:55:59.327 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111753.log 2023-11-04T01:55:59.327 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.98217.log: /var/log/ceph/ceph-client.admin.106286.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.98217.log.gz 2023-11-04T01:55:59.327 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.129530.log 2023-11-04T01:55:59.327 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.111753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106328.log 2023-11-04T01:55:59.327 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.106286.log.gz 2023-11-04T01:55:59.327 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.129530.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.111753.log.gz 2023-11-04T01:55:59.328 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110813.log 2023-11-04T01:55:59.328 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106328.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129530.log.gz 2023-11-04T01:55:59.328 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106160.log 2023-11-04T01:55:59.328 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3%/var/log/ceph/ceph-client.admin.110813.log: -- replaced with /var/log/ceph/ceph-client.admin.106328.log.gz 2023-11-04T01:55:59.328 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113034.log 2023-11-04T01:55:59.329 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106160.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110813.log.gz 2023-11-04T01:55:59.329 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126881.log 2023-11-04T01:55:59.329 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113034.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106160.log.gz 2023-11-04T01:55:59.329 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117716.log 2023-11-04T01:55:59.329 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.126881.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-04T01:55:59.330 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113034.log.gz 2023-11-04T01:55:59.330 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117716.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.126881.log.gz 2023-11-04T01:55:59.330 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124351.log 2023-11-04T01:55:59.330 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mon.a.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117716.log.gz 2023-11-04T01:55:59.330 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129488.log 2023-11-04T01:55:59.331 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.124351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100259.log 2023-11-04T01:55:59.331 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.129488.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.108045.log 2023-11-04T01:55:59.331 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.124351.log.gz 2023-11-04T01:55:59.331 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.129488.log.gz 2023-11-04T01:55:59.331 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112404.log 2023-11-04T01:55:59.332 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.108045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121501.log 2023-11-04T01:55:59.332 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100259.log.gz 2023-11-04T01:55:59.332 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112404.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108045.log.gz 2023-11-04T01:55:59.332 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130244.log 2023-11-04T01:55:59.333 INFO:teuthology.orchestra.run.smithi114.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.112404.log.gz 2023-11-04T01:55:59.333 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.121501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96589.log 2023-11-04T01:55:59.333 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.130244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103378.log 2023-11-04T01:55:59.333 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.121501.log.gz 2023-11-04T01:55:59.334 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112278.log 2023-11-04T01:55:59.334 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103378.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.81567.log 2023-11-04T01:55:59.334 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96589.log.gz 2023-11-04T01:55:59.334 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103378.log.gz 2023-11-04T01:55:59.335 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106454.log 2023-11-04T01:55:59.335 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.tmp-client.admin.81567.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.112278.log.gz 2023-11-04T01:55:59.335 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.81567.log.gz 2023-11-04T01:55:59.335 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99681.log 2023-11-04T01:55:59.336 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111023.log 2023-11-04T01:55:59.336 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106454.log: /var/log/ceph/ceph-client.admin.99681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128789.log 2023-11-04T01:55:59.336 INFO:teuthology.orchestra.run.smithi114.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.130244.log.gz 2023-11-04T01:55:59.336 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106454.log.gz 2023-11-04T01:55:59.337 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.111023.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99681.log.gz 2023-11-04T01:55:59.337 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105578.log 2023-11-04T01:55:59.337 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111023.log.gz 2023-11-04T01:55:59.337 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.128789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103588.log 2023-11-04T01:55:59.337 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.105578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127656.log 2023-11-04T01:55:59.338 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128789.log.gz 2023-11-04T01:55:59.338 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96921.log 2023-11-04T01:55:59.338 INFO:teuthology.orchestra.run.smithi114.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.105578.log.gz 2023-11-04T01:55:59.338 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103588.log.gz 2023-11-04T01:55:59.339 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101224.log 2023-11-04T01:55:59.339 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96921.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.94655.log -- replaced with /var/log/ceph/ceph-client.admin.127656.log.gz 2023-11-04T01:55:59.339 INFO:teuthology.orchestra.run.smithi114.stderr: 2023-11-04T01:55:59.340 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101224.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96921.log.gz 2023-11-04T01:55:59.340 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106580.log 2023-11-04T01:55:59.340 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101224.log.gz 2023-11-04T01:55:59.340 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118498.log 2023-11-04T01:55:59.341 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106580.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94655.log.gz 2023-11-04T01:55:59.341 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100764.log 2023-11-04T01:55:59.341 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106580.log.gz 2023-11-04T01:55:59.341 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.118498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94805.log 2023-11-04T01:55:59.341 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94229.log 2023-11-04T01:55:59.341 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100764.log.gz 2023-11-04T01:55:59.342 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94805.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.118498.log.gz 2023-11-04T01:55:59.342 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95404.log 2023-11-04T01:55:59.342 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101140.log 2023-11-04T01:55:59.342 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94229.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94805.log.gz 2023-11-04T01:55:59.342 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.95404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121674.log 2023-11-04T01:55:59.342 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94229.log.gz 2023-11-04T01:55:59.342 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101140.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.95404.log.gz 2023-11-04T01:55:59.343 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98133.log 2023-11-04T01:55:59.343 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101140.log.gz 2023-11-04T01:55:59.343 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.121674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96340.log 2023-11-04T01:55:59.343 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.98133.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.121674.log.gz 2023-11-04T01:55:59.343 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98007.log 2023-11-04T01:55:59.343 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98133.log.gz 2023-11-04T01:55:59.343 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124289.log 2023-11-04T01:55:59.344 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.98007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102149.log 2023-11-04T01:55:59.344 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96340.log.gz 2023-11-04T01:55:59.344 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.124289.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.98007.log.gz 2023-11-04T01:55:59.344 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95530.log 2023-11-04T01:55:59.344 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124289.log.gz 2023-11-04T01:55:59.344 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110981.log 2023-11-04T01:55:59.344 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.95530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118432.log 2023-11-04T01:55:59.344 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102149.log.gz 2023-11-04T01:55:59.345 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110981.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.95530.log.gz 2023-11-04T01:55:59.345 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112166.log 2023-11-04T01:55:59.345 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110981.log.gz 2023-11-04T01:55:59.345 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.118432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114461.log 2023-11-04T01:55:59.345 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109465.log 2023-11-04T01:55:59.345 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.114461.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112166.log.gz 2023-11-04T01:55:59.345 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125659.log 2023-11-04T01:55:59.346 INFO:teuthology.orchestra.run.smithi114.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.118432.log.gz 2023-11-04T01:55:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104296.log 2023-11-04T01:55:59.346 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109465.log.gz 2023-11-04T01:55:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125659.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.114461.log.gz 2023-11-04T01:55:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111550.log 2023-11-04T01:55:59.346 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.125659.log.gz 2023-11-04T01:55:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96925.log 2023-11-04T01:55:59.347 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0%/var/log/ceph/ceph-client.admin.111550.log: -- replaced with /var/log/ceph/ceph-client.admin.104296.log.gz 2023-11-04T01:55:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105922.log 2023-11-04T01:55:59.347 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111550.log.gz/var/log/ceph/ceph-client.admin.96925.log: 2023-11-04T01:55:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105796.log 2023-11-04T01:55:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.105922.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.96925.log.gz -5 2023-11-04T01:55:59.347 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.129572.log 2023-11-04T01:55:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.105796.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105922.log.gz 2023-11-04T01:55:59.348 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103294.log 2023-11-04T01:55:59.348 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105796.log.gz 2023-11-04T01:55:59.348 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.129572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117012.log 2023-11-04T01:55:59.348 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97286.log 2023-11-04T01:55:59.348 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129572.log.gz 2023-11-04T01:55:59.348 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117012.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103294.log.gz -5 2023-11-04T01:55:59.349 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.115621.log 2023-11-04T01:55:59.349 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97286.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117012.log.gz 2023-11-04T01:55:59.349 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120237.log 2023-11-04T01:55:59.349 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97286.log.gz 2023-11-04T01:55:59.349 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127926.log 2023-11-04T01:55:59.349 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.120237.log: gzip 89.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.115621.log.gz --verbose 2023-11-04T01:55:59.349 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-client.admin.117590.log 2023-11-04T01:55:59.349 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113288.log 2023-11-04T01:55:59.350 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127926.log.gz 2023-11-04T01:55:59.350 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114335.log 2023-11-04T01:55:59.350 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.120237.log.gz 2023-11-04T01:55:59.350 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117758.log 2023-11-04T01:55:59.350 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117590.log.gz 2023-11-04T01:55:59.350 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.114335.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113288.log.gz 2023-11-04T01:55:59.350 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104170.log 2023-11-04T01:55:59.351 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114335.log.gz 2023-11-04T01:55:59.351 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111675.log 2023-11-04T01:55:59.351 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94571.log 2023-11-04T01:55:59.351 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104170.log.gz 2023-11-04T01:55:59.351 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.111675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111794.log 2023-11-04T01:55:59.351 INFO:teuthology.orchestra.run.smithi114.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.117758.log.gz 2023-11-04T01:55:59.351 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116125.log 2023-11-04T01:55:59.352 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94571.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111675.log.gz 2023-11-04T01:55:59.352 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.admin.111794.log: -5 --verbose -- /var/log/ceph/ceph-client.2.99516.log 2023-11-04T01:55:59.352 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94571.log.gz 2023-11-04T01:55:59.352 INFO:teuthology.orchestra.run.smithi114.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.111794.log.gz 2023-11-04T01:55:59.352 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119630.log/var/log/ceph/ceph-client.admin.116125.log: 2023-11-04T01:55:59.352 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.2.99516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96922.log 2023-11-04T01:55:59.352 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116125.log.gz 2023-11-04T01:55:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.119630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116209.log 2023-11-04T01:55:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104780.log 2023-11-04T01:55:59.353 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119630.log.gz 2023-11-04T01:55:59.353 INFO:teuthology.orchestra.run.smithi114.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.2.99516.log.gz 2023-11-04T01:55:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.116209.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96922.log.gz 2023-11-04T01:55:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113162.log 2023-11-04T01:55:59.353 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116209.log.gz 2023-11-04T01:55:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106916.log 2023-11-04T01:55:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104780.log: /var/log/ceph/ceph-client.admin.113162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100091.log 2023-11-04T01:55:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106916.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.104780.log.gz 2023-11-04T01:55:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107299.log 2023-11-04T01:55:59.354 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113162.log.gz 2023-11-04T01:55:59.354 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106916.log.gz 2023-11-04T01:55:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100217.log 2023-11-04T01:55:59.354 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100091.log.gz 2023-11-04T01:55:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123214.log 2023-11-04T01:55:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99839.log 2023-11-04T01:55:59.355 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107299.log.gz 2023-11-04T01:55:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.123214.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100217.log.gz 2023-11-04T01:55:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113841.log 2023-11-04T01:55:59.355 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.123214.log.gz 2023-11-04T01:55:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.99839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110729.log 2023-11-04T01:55:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113841.log: gzip 87.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.99839.log.gz -- 2023-11-04T01:55:59.356 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.108087.log 2023-11-04T01:55:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110729.log: gzip 88.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.113841.log.gz -- 2023-11-04T01:55:59.356 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.114527.log 2023-11-04T01:55:59.356 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110729.log.gz 2023-11-04T01:55:59.357 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.108087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95572.log 2023-11-04T01:55:59.357 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.114527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109591.log 2023-11-04T01:55:59.357 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108087.log.gz 2023-11-04T01:55:59.357 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.95572.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.114527.log.gz 2023-11-04T01:55:59.357 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.118305.log 2023-11-04T01:55:59.357 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95572.log.gz 2023-11-04T01:55:59.357 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103630.log 2023-11-04T01:55:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.118305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110125.log 2023-11-04T01:55:59.358 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109591.log.gz 2023-11-04T01:55:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103630.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118305.log.gz 2023-11-04T01:55:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112782.log 2023-11-04T01:55:59.358 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103630.log.gz 2023-11-04T01:55:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96255.log 2023-11-04T01:55:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125785.log 2023-11-04T01:55:59.359 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110125.log.gz 2023-11-04T01:55:59.359 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112782.log.gz 2023-11-04T01:55:59.359 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120088.log 2023-11-04T01:55:59.359 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96255.log.gz 2023-11-04T01:55:59.359 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101865.log 2023-11-04T01:55:59.359 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.120088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123711.log 2023-11-04T01:55:59.359 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125785.log.gz 2023-11-04T01:55:59.360 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101865.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120088.log.gz 2023-11-04T01:55:59.360 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116928.log 2023-11-04T01:55:59.360 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101865.log.gz 2023-11-04T01:55:59.360 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.123711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119568.log 2023-11-04T01:55:59.360 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.116928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112446.log 2023-11-04T01:55:59.360 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.123711.log.gz 2023-11-04T01:55:59.360 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.119568.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116928.log.gz 2023-11-04T01:55:59.361 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101534.log 2023-11-04T01:55:59.361 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119568.log.gz 2023-11-04T01:55:59.361 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127410.log 2023-11-04T01:55:59.361 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114419.log 2023-11-04T01:55:59.361 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112446.log.gz 2023-11-04T01:55:59.361 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127410.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.101534.log.gz 2023-11-04T01:55:59.362 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94401.log 2023-11-04T01:55:59.362 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127410.log.gz 2023-11-04T01:55:59.362 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.114419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102748.log 2023-11-04T01:55:59.362 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104254.log 2023-11-04T01:55:59.362 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114419.log.gz 2023-11-04T01:55:59.362 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109423.log 2023-11-04T01:55:59.363 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94401.log.gz 2023-11-04T01:55:59.363 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102748.log.gz 2023-11-04T01:55:59.363 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101098.log 2023-11-04T01:55:59.363 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109423.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104254.log.gz 2023-11-04T01:55:59.363 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112740.log 2023-11-04T01:55:59.363 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101098.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109423.log.gz 2023-11-04T01:55:59.363 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103210.log 2023-11-04T01:55:59.364 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101098.log.gz 2023-11-04T01:55:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104612.log 2023-11-04T01:55:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112488.log 2023-11-04T01:55:59.364 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112740.log.gz 2023-11-04T01:55:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104612.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103210.log.gz 2023-11-04T01:55:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124497.log 2023-11-04T01:55:59.364 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104612.log.gz 2023-11-04T01:55:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112992.log 2023-11-04T01:55:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.124497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97558.log 2023-11-04T01:55:59.365 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112488.log.gz 2023-11-04T01:55:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112992.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124497.log.gz 2023-11-04T01:55:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93799.log 2023-11-04T01:55:59.365 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.112992.log.gz 2023-11-04T01:55:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112572.log 2023-11-04T01:55:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97558.log: /var/log/ceph/ceph-client.admin.93799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124641.log 2023-11-04T01:55:59.366 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97558.log.gz 2023-11-04T01:55:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112572.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93799.log.gz 2023-11-04T01:55:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115915.log 2023-11-04T01:55:59.366 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112572.log.gz 2023-11-04T01:55:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.124641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127079.log 2023-11-04T01:55:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128915.log 2023-11-04T01:55:59.366 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124641.log.gz 2023-11-04T01:55:59.367 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94187.log 2023-11-04T01:55:59.367 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115915.log.gz 2023-11-04T01:55:59.367 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.127079.log.gz 2023-11-04T01:55:59.367 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.128915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96584.log 2023-11-04T01:55:59.367 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128915.log.gz 2023-11-04T01:55:59.367 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97205.log 2023-11-04T01:55:59.367 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100637.log 2023-11-04T01:55:59.368 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94187.log.gz 2023-11-04T01:55:59.368 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96584.log.gz 2023-11-04T01:55:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105313.log 2023-11-04T01:55:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100637.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97205.log.gz 2023-11-04T01:55:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109213.log 2023-11-04T01:55:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.105313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116587.log 2023-11-04T01:55:59.368 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100637.log.gz 2023-11-04T01:55:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108688.log 2023-11-04T01:55:59.369 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.116587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119287.log 2023-11-04T01:55:59.369 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.0.105313.log.gz 2023-11-04T01:55:59.369 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109213.log.gz 2023-11-04T01:55:59.369 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116587.log.gz 2023-11-04T01:55:59.369 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.108688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127037.log 2023-11-04T01:55:59.369 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.119287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105056.log 2023-11-04T01:55:59.370 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108688.log.gz 2023-11-04T01:55:59.370 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.119287.log.gz 2023-11-04T01:55:59.370 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96928.log 2023-11-04T01:55:59.370 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127037.log.gz 2023-11-04T01:55:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.105056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105475.log 2023-11-04T01:55:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96928.log: gzip 89.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.105056.log.gz --verbose 2023-11-04T01:55:59.371 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-client.admin.127884.log 2023-11-04T01:55:59.371 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96928.log.gz 2023-11-04T01:55:59.372 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.105475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123130.log 2023-11-04T01:55:59.372 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102075.log 2023-11-04T01:55:59.372 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105475.log.gz 2023-11-04T01:55:59.372 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.123130.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.122910.log 2023-11-04T01:55:59.373 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.127884.log.gz 2023-11-04T01:55:59.373 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.123130.log.gz 2023-11-04T01:55:59.373 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124557.log 2023-11-04T01:55:59.373 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.122910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98175.log 2023-11-04T01:55:59.373 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102075.log.gz 2023-11-04T01:55:59.374 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.124557.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122910.log.gz 2023-11-04T01:55:59.374 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116083.log 2023-11-04T01:55:59.374 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124557.log.gz 2023-11-04T01:55:59.374 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.98175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104466.log 2023-11-04T01:55:59.374 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.116083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107877.log 2023-11-04T01:55:59.375 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.98175.log.gz 2023-11-04T01:55:59.375 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107835.log 2023-11-04T01:55:59.375 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116083.log.gz 2023-11-04T01:55:59.375 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104466.log.gz 2023-11-04T01:55:59.376 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105556.log 2023-11-04T01:55:59.376 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117224.log 2023-11-04T01:55:59.376 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107877.log.gz 2023-11-04T01:55:59.376 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.105556.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107835.log.gz 2023-11-04T01:55:59.376 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121973.log 2023-11-04T01:55:59.376 INFO:teuthology.orchestra.run.smithi114.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.105556.log.gz 2023-11-04T01:55:59.377 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104906.log 2023-11-04T01:55:59.377 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.121973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121907.log 2023-11-04T01:55:59.377 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117224.log.gz 2023-11-04T01:55:59.377 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104906.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.121973.log.gz 2023-11-04T01:55:59.377 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120572.log 2023-11-04T01:55:59.377 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.104906.log.gz 2023-11-04T01:55:59.378 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.121907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95961.log 2023-11-04T01:55:59.378 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.120572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102275.log 2023-11-04T01:55:59.378 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.95961.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120572.log.gz 2023-11-04T01:55:59.378 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121234.log 2023-11-04T01:55:59.378 INFO:teuthology.orchestra.run.smithi114.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.121907.log.gz 2023-11-04T01:55:59.378 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95961.log.gz 2023-11-04T01:55:59.378 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107581.log 2023-11-04T01:55:59.379 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102275.log.gz 2023-11-04T01:55:59.379 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.121234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103798.log 2023-11-04T01:55:59.379 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115425.log 2023-11-04T01:55:59.379 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.121234.log.gz 2023-11-04T01:55:59.379 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103798.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107581.log.gz 2023-11-04T01:55:59.379 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107011.log 2023-11-04T01:55:59.380 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103798.log.gz 2023-11-04T01:55:59.380 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124223.log 2023-11-04T01:55:59.380 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125541.log 2023-11-04T01:55:59.380 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115425.log.gz 2023-11-04T01:55:59.380 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.124223.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107011.log.gz 2023-11-04T01:55:59.380 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119672.log 2023-11-04T01:55:59.381 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115999.log 2023-11-04T01:55:59.381 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.119672.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125541.log.gz 2023-11-04T01:55:59.381 INFO:teuthology.orchestra.run.smithi114.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.124223.log.gz 2023-11-04T01:55:59.381 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101949.log 2023-11-04T01:55:59.381 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119672.log.gz 2023-11-04T01:55:59.382 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100301.log 2023-11-04T01:55:59.382 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115999.log: /var/log/ceph/ceph-client.admin.101949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109507.log 2023-11-04T01:55:59.382 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115999.log.gz 2023-11-04T01:55:59.382 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100301.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101949.log.gz 2023-11-04T01:55:59.382 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119502.log 2023-11-04T01:55:59.382 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100301.log.gz 2023-11-04T01:55:59.383 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128480.log 2023-11-04T01:55:59.383 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.119502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104738.log 2023-11-04T01:55:59.383 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109507.log.gz 2023-11-04T01:55:59.383 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.128480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127782.log 2023-11-04T01:55:59.383 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117674.log 2023-11-04T01:55:59.383 INFO:teuthology.orchestra.run.smithi114.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.119502.log.gz 2023-11-04T01:55:59.383 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104738.log.gz 2023-11-04T01:55:59.383 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111956.log 2023-11-04T01:55:59.384 INFO:teuthology.orchestra.run.smithi114.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.128480.log.gz 2023-11-04T01:55:59.384 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109297.log 2023-11-04T01:55:59.384 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.127782.log.gz 2023-11-04T01:55:59.384 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.111956.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117674.log.gz 2023-11-04T01:55:59.384 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123088.log 2023-11-04T01:55:59.384 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125617.log 2023-11-04T01:55:59.385 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111956.log.gz 2023-11-04T01:55:59.385 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.123088.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109297.log.gz 2023-11-04T01:55:59.385 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102790.log 2023-11-04T01:55:59.385 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109946.log 2023-11-04T01:55:59.385 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123088.log.gz 2023-11-04T01:55:59.385 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.125617.log.gz 2023-11-04T01:55:59.385 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122451.log 2023-11-04T01:55:59.385 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102790.log.gz 2023-11-04T01:55:59.386 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112656.log 2023-11-04T01:55:59.386 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.122451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123046.log 2023-11-04T01:55:59.386 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109946.log.gz 2023-11-04T01:55:59.386 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103084.log 2023-11-04T01:55:59.386 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122451.log.gz 2023-11-04T01:55:59.386 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112656.log.gz 2023-11-04T01:55:59.386 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.123046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121459.log 2023-11-04T01:55:59.387 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105754.log 2023-11-04T01:55:59.387 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123046.log.gz 2023-11-04T01:55:59.387 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.121459.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103084.log.gz 2023-11-04T01:55:59.387 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96129.log 2023-11-04T01:55:59.387 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121459.log.gz 2023-11-04T01:55:59.387 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.105754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113755.log 2023-11-04T01:55:59.387 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127245.log 2023-11-04T01:55:59.387 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105754.log.gz 2023-11-04T01:55:59.388 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113755.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96129.log.gz 2023-11-04T01:55:59.388 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102585.log 2023-11-04T01:55:59.388 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113755.log.gz 2023-11-04T01:55:59.388 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87622.log 2023-11-04T01:55:59.388 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98301.log 2023-11-04T01:55:59.388 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.127245.log.gz 2023-11-04T01:55:59.388 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.87622.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102585.log.gz 2023-11-04T01:55:59.389 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128873.log 2023-11-04T01:55:59.389 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.98301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108891.log 2023-11-04T01:55:59.389 INFO:teuthology.orchestra.run.smithi114.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.87622.log.gz 2023-11-04T01:55:59.389 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.128873.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.98301.log.gz 2023-11-04T01:55:59.389 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117286.log 2023-11-04T01:55:59.389 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119915.log 2023-11-04T01:55:59.390 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.108891.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128873.log.gz 2023-11-04T01:55:59.390 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106790.log 2023-11-04T01:55:59.390 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108891.log.gz 2023-11-04T01:55:59.390 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.119915.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117286.log.gz 2023-11-04T01:55:59.390 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113076.log 2023-11-04T01:55:59.391 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.119915.log.gz 2023-11-04T01:55:59.391 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113587.log 2023-11-04T01:55:59.391 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87861.log 2023-11-04T01:55:59.391 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.106790.log.gz 2023-11-04T01:55:59.391 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112362.log 2023-11-04T01:55:59.392 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113076.log.gz 2023-11-04T01:55:59.392 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.87861.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113587.log.gz 2023-11-04T01:55:59.392 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107919.log 2023-11-04T01:55:59.392 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87861.log.gz 2023-11-04T01:55:59.392 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118725.log 2023-11-04T01:55:59.393 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.112362.log.gz 2023-11-04T01:55:59.393 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110455.log 2023-11-04T01:55:59.393 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.118725.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107919.log.gz 2023-11-04T01:55:59.393 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117824.log 2023-11-04T01:55:59.393 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.118725.log.gz/var/log/ceph/ceph-client.admin.110455.log: 2023-11-04T01:55:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96578.log 2023-11-04T01:55:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123627.log 2023-11-04T01:55:59.394 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110455.log.gz 2023-11-04T01:55:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96578.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117824.log.gz 2023-11-04T01:55:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101697.log 2023-11-04T01:55:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.123627.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96578.log.gz 2023-11-04T01:55:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97202.log 2023-11-04T01:55:59.395 INFO:teuthology.orchestra.run.smithi114.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.123627.log.gz 2023-11-04T01:55:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127740.log 2023-11-04T01:55:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95488.log 2023-11-04T01:55:59.396 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101697.log.gz 2023-11-04T01:55:59.396 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127740.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97202.log.gz 2023-11-04T01:55:59.396 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119436.log 2023-11-04T01:55:59.396 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127740.log.gz 2023-11-04T01:55:59.396 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.95488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122848.log 2023-11-04T01:55:59.397 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.119436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102874.log 2023-11-04T01:55:59.397 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95488.log.gz 2023-11-04T01:55:59.397 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.122848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104128.log 2023-11-04T01:55:59.397 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122848.log.gz 2023-11-04T01:55:59.397 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102874.log: gzip 91.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.119436.log.gz -- 2023-11-04T01:55:59.398 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.119030.log 2023-11-04T01:55:59.398 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104128.log: gzip -5 --verbose -- 89.2% /var/log/ceph/ceph-client.admin.97625.log 2023-11-04T01:55:59.398 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102874.log.gz 2023-11-04T01:55:59.398 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104128.log.gz 2023-11-04T01:55:59.398 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.119030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109904.log 2023-11-04T01:55:59.399 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119030.log.gz 2023-11-04T01:55:59.399 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97461.log 2023-11-04T01:55:59.399 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125456.log 2023-11-04T01:55:59.399 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97625.log.gz 2023-11-04T01:55:59.399 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109904.log.gz 2023-11-04T01:55:59.400 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102417.log 2023-11-04T01:55:59.400 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110497.log 2023-11-04T01:55:59.400 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97461.log.gz 2023-11-04T01:55:59.400 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128831.log 2023-11-04T01:55:59.400 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.125456.log.gz 2023-11-04T01:55:59.400 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110497.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102417.log.gz 2023-11-04T01:55:59.401 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97881.log 2023-11-04T01:55:59.401 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110497.log.gz 2023-11-04T01:55:59.401 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.128831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110371.log 2023-11-04T01:55:59.401 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97881.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.128831.log.gzgzip 2023-11-04T01:55:59.401 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.111065.log 2023-11-04T01:55:59.401 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110371.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97881.log.gz 2023-11-04T01:55:59.402 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128992.log 2023-11-04T01:55:59.402 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110371.log.gz 2023-11-04T01:55:59.402 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.111065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123004.log 2023-11-04T01:55:59.402 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.128992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104085.log 2023-11-04T01:55:59.402 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128992.log.gz 2023-11-04T01:55:59.402 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.123004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122283.log 2023-11-04T01:55:59.403 INFO:teuthology.orchestra.run.smithi114.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.111065.log.gz 2023-11-04T01:55:59.403 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116167.log 2023-11-04T01:55:59.403 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104085.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123004.log.gz 2023-11-04T01:55:59.403 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.122283.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104085.log.gz 2023-11-04T01:55:59.403 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122283.log.gz 2023-11-04T01:55:59.403 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130052.log 2023-11-04T01:55:59.403 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.116167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101823.log 2023-11-04T01:55:59.403 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.130052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114167.log 2023-11-04T01:55:59.404 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116167.log.gz 2023-11-04T01:55:59.404 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95798.log 2023-11-04T01:55:59.404 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.114167.log: gzip -5 --verbose -- 89.2% /var/log/ceph/ceph-client.admin.87944.log 2023-11-04T01:55:59.404 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101823.log.gz 2023-11-04T01:55:59.404 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114167.log.gz 2023-11-04T01:55:59.404 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.95798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116724.log 2023-11-04T01:55:59.404 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95798.log.gz 2023-11-04T01:55:59.404 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119352.log 2023-11-04T01:55:59.405 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.87944.log: /var/log/ceph/ceph-client.admin.116724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119215.log 2023-11-04T01:55:59.405 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.87944.log.gz 2023-11-04T01:55:59.405 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.119352.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116724.log.gz 2023-11-04T01:55:59.405 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115043.log 2023-11-04T01:55:59.405 INFO:teuthology.orchestra.run.smithi114.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.130052.log.gz 2023-11-04T01:55:59.405 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.119352.log.gz 2023-11-04T01:55:59.405 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119813.log 2023-11-04T01:55:59.406 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.119215.log: /var/log/ceph/ceph-client.admin.115043.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.119215.log.gz 2023-11-04T01:55:59.406 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106832.log 2023-11-04T01:55:59.406 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115043.log.gz 2023-11-04T01:55:59.406 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.119813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100511.log 2023-11-04T01:55:59.406 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106832.log: gzip -5 --verbose 87.7% -- -- replaced with /var/log/ceph/ceph-client.admin.119813.log.gz /var/log/ceph/ceph-client.admin.121172.log 2023-11-04T01:55:59.406 INFO:teuthology.orchestra.run.smithi114.stderr: 2023-11-04T01:55:59.406 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94103.log 2023-11-04T01:55:59.406 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.106832.log.gz 2023-11-04T01:55:59.407 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100511.log.gz 2023-11-04T01:55:59.407 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.121172.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-04T01:55:59.407 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.121172.log.gz 2023-11-04T01:55:59.407 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.94103.log: /var/log/ceph/ceph-client.admin.129362.log 2023-11-04T01:55:59.407 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101266.log 2023-11-04T01:55:59.407 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94103.log.gz 2023-11-04T01:55:59.407 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.129362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102832.log 2023-11-04T01:55:59.407 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107793.log 2023-11-04T01:55:59.408 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.129362.log.gz 2023-11-04T01:55:59.408 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101266.log.gz 2023-11-04T01:55:59.408 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107709.log 2023-11-04T01:55:59.408 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose 88.5% -- -- replaced with /var/log/ceph/ceph-client.admin.102832.log.gz /var/log/ceph/ceph-client.admin.109736.log 2023-11-04T01:55:59.408 INFO:teuthology.orchestra.run.smithi114.stderr: 2023-11-04T01:55:59.408 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107793.log: /var/log/ceph/ceph-client.admin.107709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106874.log 2023-11-04T01:55:59.408 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.107793.log.gz 2023-11-04T01:55:59.408 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107709.log.gz 2023-11-04T01:55:59.409 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104422.log 2023-11-04T01:55:59.409 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124907.log 2023-11-04T01:55:59.409 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106874.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109736.log.gz 2023-11-04T01:55:59.409 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125330.log 2023-11-04T01:55:59.409 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106874.log.gz 2023-11-04T01:55:59.409 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.104422.log.gz -5 2023-11-04T01:55:59.409 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.94697.log 2023-11-04T01:55:59.409 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.124907.log: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-04T01:55:59.410 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97200.log 2023-11-04T01:55:59.410 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.124907.log.gz 2023-11-04T01:55:59.410 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94697.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.125330.log.gz 2023-11-04T01:55:59.410 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110541.log 2023-11-04T01:55:59.410 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94697.log.gz 2023-11-04T01:55:59.410 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100553.log 2023-11-04T01:55:59.410 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112530.log 2023-11-04T01:55:59.411 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97200.log.gz 2023-11-04T01:55:59.411 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100553.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110541.log.gz 2023-11-04T01:55:59.411 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101781.log 2023-11-04T01:55:59.411 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100553.log.gz 2023-11-04T01:55:59.411 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100133.log 2023-11-04T01:55:59.411 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112530.log.gz 2023-11-04T01:55:59.411 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96213.log 2023-11-04T01:55:59.411 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129118.log 2023-11-04T01:55:59.411 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101781.log.gz 2023-11-04T01:55:59.412 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96213.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100133.log.gz 2023-11-04T01:55:59.412 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107667.log 2023-11-04T01:55:59.412 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96213.log.gz 2023-11-04T01:55:59.412 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.129118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101408.log 2023-11-04T01:55:59.412 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95672.log 2023-11-04T01:55:59.413 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129118.log.gz 2023-11-04T01:55:59.413 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101408.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107667.log.gz 2023-11-04T01:55:59.413 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103546.log 2023-11-04T01:55:59.413 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101408.log.gz 2023-11-04T01:55:59.413 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.95672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104990.log 2023-11-04T01:55:59.413 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111914.log 2023-11-04T01:55:59.413 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.95672.log.gz 2023-11-04T01:55:59.413 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104990.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103546.log.gz 2023-11-04T01:55:59.414 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119873.log 2023-11-04T01:55:59.414 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116970.log/var/log/ceph/ceph-client.admin.111914.log: 2023-11-04T01:55:59.414 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.104990.log.gz 2023-11-04T01:55:59.414 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.119873.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111914.log.gz 2023-11-04T01:55:59.414 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105880.log 2023-11-04T01:55:59.414 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123459.log 2023-11-04T01:55:59.414 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.116970.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.119873.log.gz 2023-11-04T01:55:59.415 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.105880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104380.log 2023-11-04T01:55:59.415 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116970.log.gz 2023-11-04T01:55:59.415 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.123459.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105880.log.gz 2023-11-04T01:55:59.415 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113671.log 2023-11-04T01:55:59.415 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123172.log 2023-11-04T01:55:59.415 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123459.log.gz 2023-11-04T01:55:59.415 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104380.log.gz/var/log/ceph/ceph-client.admin.113671.log: 2023-11-04T01:55:59.415 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103504.log 2023-11-04T01:55:59.416 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113671.log.gz 2023-11-04T01:55:59.416 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.123172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121602.log 2023-11-04T01:55:59.416 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103714.log 2023-11-04T01:55:59.416 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123172.log.gz 2023-11-04T01:55:59.416 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.121602.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103504.log.gz 2023-11-04T01:55:59.416 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126797.log 2023-11-04T01:55:59.416 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103714.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.121602.log.gz 2023-11-04T01:55:59.416 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107341.log 2023-11-04T01:55:59.417 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103714.log.gz 2023-11-04T01:55:59.417 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.126797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115831.log 2023-11-04T01:55:59.417 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107341.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.126797.log.gz 2023-11-04T01:55:59.417 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129202.log 2023-11-04T01:55:59.417 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.124062.log 2023-11-04T01:55:59.417 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107341.log.gz 2023-11-04T01:55:59.417 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115831.log.gz 2023-11-04T01:55:59.417 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.129202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97923.log 2023-11-04T01:55:59.418 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129202.log.gz 2023-11-04T01:55:59.418 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.124062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94273.log 2023-11-04T01:55:59.418 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97201.log 2023-11-04T01:55:59.418 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94273.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97923.log.gz 2023-11-04T01:55:59.418 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97797.log 2023-11-04T01:55:59.418 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124784.log 2023-11-04T01:55:59.418 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97201.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94273.log.gz 2023-11-04T01:55:59.418 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122080.log 2023-11-04T01:55:59.419 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.97201.log.gz 2023-11-04T01:55:59.419 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113505.log 2023-11-04T01:55:59.419 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.124784.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97797.log.gz 2023-11-04T01:55:59.419 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.122080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127842.log 2023-11-04T01:55:59.419 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.124784.log.gz 2023-11-04T01:55:59.419 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117464.log 2023-11-04T01:55:59.419 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113505.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.122080.log.gz 2023-11-04T01:55:59.419 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122142.log 2023-11-04T01:55:59.420 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113505.log.gz 2023-11-04T01:55:59.420 INFO:teuthology.orchestra.run.smithi114.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.124062.log.gz 2023-11-04T01:55:59.420 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96297.log 2023-11-04T01:55:59.420 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117464.log: /var/log/ceph/ceph-client.admin.122142.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127842.log.gz 2023-11-04T01:55:59.420 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98385.log 2023-11-04T01:55:59.420 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117464.log.gz 2023-11-04T01:55:59.421 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96297.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122142.log.gz 2023-11-04T01:55:59.421 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119072.log 2023-11-04T01:55:59.421 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96297.log.gz 2023-11-04T01:55:59.421 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.98385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110687.log 2023-11-04T01:55:59.421 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.119072.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98385.log.gz 2023-11-04T01:55:59.421 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118683.log 2023-11-04T01:55:59.422 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101056.log 2023-11-04T01:55:59.422 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.119072.log.gz 2023-11-04T01:55:59.422 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.118683.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.111998.log 2023-11-04T01:55:59.422 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.110687.log.gz 2023-11-04T01:55:59.423 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101056.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118683.log.gz 2023-11-04T01:55:59.423 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116461.log 2023-11-04T01:55:59.423 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.101056.log.gz 2023-11-04T01:55:59.423 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.111998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101492.log 2023-11-04T01:55:59.423 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.116461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129034.log 2023-11-04T01:55:59.424 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111998.log.gz 2023-11-04T01:55:59.424 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116461.log.gz 2023-11-04T01:55:59.424 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100807.log 2023-11-04T01:55:59.424 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101492.log.gz 2023-11-04T01:55:59.424 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.129034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111872.log 2023-11-04T01:55:59.425 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94445.log 2023-11-04T01:55:59.425 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129034.log.gz 2023-11-04T01:55:59.425 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100807.log.gz 2023-11-04T01:55:59.425 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.111872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94359.log 2023-11-04T01:55:59.425 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111872.log.gz 2023-11-04T01:55:59.426 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94487.log 2023-11-04T01:55:59.426 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94359.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94445.log.gz -5 2023-11-04T01:55:59.426 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.104822.log 2023-11-04T01:55:59.426 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94359.log.gz 2023-11-04T01:55:59.426 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125743.log 2023-11-04T01:55:59.427 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94487.log.gz 2023-11-04T01:55:59.427 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103420.log 2023-11-04T01:55:59.427 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101739.log 2023-11-04T01:55:59.427 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104822.log.gz 2023-11-04T01:55:59.427 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.125743.log.gz 2023-11-04T01:55:59.428 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127368.log 2023-11-04T01:55:59.428 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112614.log 2023-11-04T01:55:59.428 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101739.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.103420.log.gz 2023-11-04T01:55:59.428 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107427.log 2023-11-04T01:55:59.428 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101739.log.gz 2023-11-04T01:55:59.429 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112614.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127368.log.gz 2023-11-04T01:55:59.429 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113890.log 2023-11-04T01:55:59.429 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112614.log.gz 2023-11-04T01:55:59.429 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115467.log 2023-11-04T01:55:59.429 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113890.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107427.log.gz 2023-11-04T01:55:59.430 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115663.log 2023-11-04T01:55:59.430 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115467.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113890.log.gz 2023-11-04T01:55:59.430 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101450.log 2023-11-04T01:55:59.430 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107091.log 2023-11-04T01:55:59.431 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115467.log.gz 2023-11-04T01:55:59.431 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101450.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115663.log.gz -5 2023-11-04T01:55:59.431 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.108595.log 2023-11-04T01:55:59.431 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107091.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101450.log.gz 2023-11-04T01:55:59.431 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115873.log 2023-11-04T01:55:59.431 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107091.log.gz 2023-11-04T01:55:59.432 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.108595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96087.log 2023-11-04T01:55:59.432 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106202.log 2023-11-04T01:55:59.432 INFO:teuthology.orchestra.run.smithi114.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.108595.log.gz 2023-11-04T01:55:59.432 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96087.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115873.log.gz 2023-11-04T01:55:59.432 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98259.log 2023-11-04T01:55:59.432 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96087.log.gz 2023-11-04T01:55:59.433 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97245.log 2023-11-04T01:55:59.433 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.98259.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.106202.log.gz -5 2023-11-04T01:55:59.433 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.125372.log 2023-11-04T01:55:59.433 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98259.log.gz 2023-11-04T01:55:59.433 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114209.log 2023-11-04T01:55:59.433 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125372.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.97245.log.gz 2023-11-04T01:55:59.433 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115173.log 2023-11-04T01:55:59.433 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.114209.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.125372.log.gz -5 2023-11-04T01:55:59.434 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.96918.log 2023-11-04T01:55:59.434 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114209.log.gz 2023-11-04T01:55:59.434 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118390.log 2023-11-04T01:55:59.434 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96918.log: gzip 88.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.115173.log.gz -- 2023-11-04T01:55:59.434 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.104528.log 2023-11-04T01:55:59.435 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.118390.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96918.log.gz 2023-11-04T01:55:59.435 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-04T01:55:59.435 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118390.log.gz 2023-11-04T01:55:59.435 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.admin.104528.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.120303.log 2023-11-04T01:55:59.435 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114251.log 2023-11-04T01:55:59.435 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104528.log.gz 2023-11-04T01:55:59.435 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.120303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106244.log 2023-11-04T01:55:59.436 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.114251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118641.log 2023-11-04T01:55:59.436 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114251.log.gz 2023-11-04T01:55:59.436 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122701.log 2023-11-04T01:55:59.436 INFO:teuthology.orchestra.run.smithi114.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.120303.log.gz 2023-11-04T01:55:59.436 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103042.log 2023-11-04T01:55:59.436 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106244.log.gz 2023-11-04T01:55:59.436 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.118641.log: /var/log/ceph/ceph-client.admin.122701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120614.log 2023-11-04T01:55:59.436 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118641.log.gz 2023-11-04T01:55:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103042.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122701.log.gz 2023-11-04T01:55:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128062.log 2023-11-04T01:55:59.437 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103042.log.gz 2023-11-04T01:55:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100679.log 2023-11-04T01:55:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.120614.log: /var/log/ceph/ceph-client.admin.128062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102233.log 2023-11-04T01:55:59.437 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120614.log.gz 2023-11-04T01:55:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100679.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128062.log.gz 2023-11-04T01:55:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102359.log 2023-11-04T01:55:59.438 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100679.log.gz 2023-11-04T01:55:59.438 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120657.log 2023-11-04T01:55:59.438 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102359.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102233.log.gz 2023-11-04T01:55:59.438 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116293.log 2023-11-04T01:55:59.438 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103840.log 2023-11-04T01:55:59.438 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.120657.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102359.log.gz 2023-11-04T01:55:59.438 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.116293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108849.log 2023-11-04T01:55:59.438 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120657.log.gz 2023-11-04T01:55:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125095.log 2023-11-04T01:55:59.439 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116293.log.gz 2023-11-04T01:55:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.108849.log: gzip -5 88.7% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.103840.log.gz 2023-11-04T01:55:59.439 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.125166.log 2023-11-04T01:55:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109339.log 2023-11-04T01:55:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125095.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108849.log.gz 2023-11-04T01:55:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128564.log 2023-11-04T01:55:59.439 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125095.log.gz 2023-11-04T01:55:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129446.log 2023-11-04T01:55:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109339.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.125166.log.gz 2023-11-04T01:55:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.128564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103672.log 2023-11-04T01:55:59.440 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109339.log.gz 2023-11-04T01:55:59.440 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128564.log.gz 2023-11-04T01:55:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.129446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121375.log 2023-11-04T01:55:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104338.log 2023-11-04T01:55:59.440 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129446.log.gz 2023-11-04T01:55:59.441 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.121375.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103672.log.gz 2023-11-04T01:55:59.441 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117138.log 2023-11-04T01:55:59.441 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114083.log 89.3% 2023-11-04T01:55:59.441 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.121375.log.gz 2023-11-04T01:55:59.441 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104338.log.gz 2023-11-04T01:55:59.441 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122325.log 2023-11-04T01:55:59.441 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117138.log.gz 2023-11-04T01:55:59.441 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.114083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99023.log 2023-11-04T01:55:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115383.log 2023-11-04T01:55:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.122325.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.114083.log.gz 2023-11-04T01:55:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.99023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120153.log 2023-11-04T01:55:59.442 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122325.log.gz 2023-11-04T01:55:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125053.log 2023-11-04T01:55:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115383.log: /var/log/ceph/ceph-client.admin.120153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122409.log 2023-11-04T01:55:59.442 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115383.log.gz 2023-11-04T01:55:59.442 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125053.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.120153.log.gz 2023-11-04T01:55:59.443 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.113798.log 2023-11-04T01:55:59.443 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.99023.log.gz 2023-11-04T01:55:59.443 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.125053.log.gz 2023-11-04T01:55:59.443 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.122409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127121.log 2023-11-04T01:55:59.444 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113330.log 2023-11-04T01:55:59.444 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113798.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122409.log.gz 2023-11-04T01:55:59.444 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.admin.127121.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.95882.log 2023-11-04T01:55:59.444 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113798.log.gz 2023-11-04T01:55:59.444 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125499.log 2023-11-04T01:55:59.444 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127121.log.gz 2023-11-04T01:55:59.444 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9%/var/log/ceph/ceph-client.admin.95882.log: -- replaced with /var/log/ceph/ceph-client.admin.113330.log.gz 2023-11-04T01:55:59.445 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121757.log 2023-11-04T01:55:59.445 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95882.log.gz 2023-11-04T01:55:59.445 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.125499.log: -- /var/log/ceph/ceph-client.admin.100049.log 2023-11-04T01:55:59.445 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123501.log/var/log/ceph/ceph-client.admin.121757.log: 2023-11-04T01:55:59.445 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125499.log.gz 2023-11-04T01:55:59.445 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100049.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.121757.log.gz -5 2023-11-04T01:55:59.446 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.125011.log 2023-11-04T01:55:59.446 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.123501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98427.log 2023-11-04T01:55:59.446 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100049.log.gz 2023-11-04T01:55:59.446 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125011.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123501.log.gz 2023-11-04T01:55:59.446 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.118081.log 2023-11-04T01:55:59.446 INFO:teuthology.orchestra.run.smithi114.stderr:gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.125011.log.gz 2023-11-04T01:55:59.446 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.129404.log 2023-11-04T01:55:59.447 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.98427.log: /var/log/ceph/ceph-client.0.118081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120717.log 2023-11-04T01:55:59.447 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98427.log.gz 2023-11-04T01:55:59.447 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.129404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120955.log 2023-11-04T01:55:59.447 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.129404.log.gz 2023-11-04T01:55:59.447 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.120717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114125.log 2023-11-04T01:55:59.447 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102627.log 2023-11-04T01:55:59.447 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.120955.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120717.log.gz 2023-11-04T01:55:59.447 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.admin.114125.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.115299.log 2023-11-04T01:55:59.448 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120955.log.gz 2023-11-04T01:55:59.448 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111619.log 2023-11-04T01:55:59.448 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.114125.log.gz 2023-11-04T01:55:59.448 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102627.log.gz 2023-11-04T01:55:59.448 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127968.log 2023-11-04T01:55:59.448 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115299.log.gz 2023-11-04T01:55:59.448 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose --/var/log/ceph/ceph-client.admin.111619.log: /var/log/ceph/ceph-client.admin.105838.log 2023-11-04T01:55:59.449 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123669.log 2023-11-04T01:55:59.449 INFO:teuthology.orchestra.run.smithi114.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.111619.log.gz 2023-11-04T01:55:59.449 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127968.log.gz 2023-11-04T01:55:59.449 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.105838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101324.log 2023-11-04T01:55:59.449 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105838.log.gz 2023-11-04T01:55:59.449 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.123669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121276.log 2023-11-04T01:55:59.449 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106748.log 2023-11-04T01:55:59.449 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101324.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.123669.log.gz 2023-11-04T01:55:59.450 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.121276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99639.log 2023-11-04T01:55:59.450 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101324.log.gz 2023-11-04T01:55:59.450 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.121276.log.gz 2023-11-04T01:55:59.450 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127306.log 2023-11-04T01:55:59.450 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104001.log 2023-11-04T01:55:59.450 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.99639.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106748.log.gz 2023-11-04T01:55:59.450 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125911.log 2023-11-04T01:55:59.451 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99639.log.gz 2023-11-04T01:55:59.451 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106412.log 2023-11-04T01:55:59.451 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127306.log.gz 2023-11-04T01:55:59.451 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104001.log.gz 2023-11-04T01:55:59.451 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104654.log 2023-11-04T01:55:59.451 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108807.log 2023-11-04T01:55:59.451 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.125911.log.gz 2023-11-04T01:55:59.451 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106412.log: /var/log/ceph/ceph-client.admin.104654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97125.log 2023-11-04T01:55:59.452 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106412.log.gz 2023-11-04T01:55:59.452 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104654.log.gz 2023-11-04T01:55:59.452 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.108807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123259.log 2023-11-04T01:55:59.452 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5/var/log/ceph/ceph-client.admin.97125.log: --verbose 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108807.log.gz 2023-11-04T01:55:59.452 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-client.admin.94529.log 2023-11-04T01:55:59.452 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.123259.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97125.log.gz 2023-11-04T01:55:59.453 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115579.log 2023-11-04T01:55:59.453 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.123259.log.gz 2023-11-04T01:55:59.453 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102033.log 2023-11-04T01:55:59.453 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97563.log 2023-11-04T01:55:59.453 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94529.log.gz 2023-11-04T01:55:59.453 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115579.log.gz 2023-11-04T01:55:59.453 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103168.log 2023-11-04T01:55:59.453 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117548.log 2023-11-04T01:55:59.454 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97563.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102033.log.gz 2023-11-04T01:55:59.454 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108729.log 2023-11-04T01:55:59.454 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97563.log.gz 2023-11-04T01:55:59.454 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122764.log 89.3% 2023-11-04T01:55:59.454 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103168.log.gz 2023-11-04T01:55:59.454 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117548.log: /var/log/ceph/ceph-client.admin.108729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127580.log 2023-11-04T01:55:59.454 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117548.log.gz 2023-11-04T01:55:59.454 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.122764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109694.log 2023-11-04T01:55:59.455 INFO:teuthology.orchestra.run.smithi114.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.108729.log.gz 2023-11-04T01:55:59.455 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126005.log 2023-11-04T01:55:59.455 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127580.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.122764.log.gz 2023-11-04T01:55:59.455 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99923.log 2023-11-04T01:55:59.455 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127580.log.gz 2023-11-04T01:55:59.455 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102459.log 2023-11-04T01:55:59.455 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.126005.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.109694.log.gz 2023-11-04T01:55:59.455 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.99923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109820.log 2023-11-04T01:55:59.456 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.126005.log.gz 2023-11-04T01:55:59.456 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112040.log 2023-11-04T01:55:59.456 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99923.log.gz 2023-11-04T01:55:59.456 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109820.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102459.log.gz 2023-11-04T01:55:59.456 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.107257.log 2023-11-04T01:55:59.456 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109820.log.gz 2023-11-04T01:55:59.456 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127494.log 2023-11-04T01:55:59.456 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112040.log.gz 2023-11-04T01:55:59.457 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120890.log 2023-11-04T01:55:59.457 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95840.log 2023-11-04T01:55:59.457 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107257.log.gz 2023-11-04T01:55:59.457 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.120890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109381.log 2023-11-04T01:55:59.457 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127494.log.gz 2023-11-04T01:55:59.457 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120890.log.gz 2023-11-04T01:55:59.457 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.95840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117632.log 2023-11-04T01:55:59.458 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109381.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95840.log.gz 2023-11-04T01:55:59.458 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.115215.log 2023-11-04T01:55:59.458 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109381.log.gz 2023-11-04T01:55:59.458 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126995.log 2023-11-04T01:55:59.458 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117632.log.gz 2023-11-04T01:55:59.458 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115215.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-04T01:55:59.458 INFO:teuthology.orchestra.run.smithi114.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.118081.log.gz 2023-11-04T01:55:59.459 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4%/var/log/ceph/ceph-client.admin.126995.log: -- replaced with /var/log/ceph/ceph-client.admin.115215.log.gz 2023-11-04T01:55:59.459 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96591.log 2023-11-04T01:55:59.459 INFO:teuthology.orchestra.run.smithi114.stderr:gzip 87.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.126995.log.gz -- 2023-11-04T01:55:59.459 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.123805.log 2023-11-04T01:55:59.459 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.96591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97839.log 2023-11-04T01:55:59.459 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.123805.log: gzip 87.0% -- replaced with /var/log/ceph/ceph-client.admin.96591.log.gz 2023-11-04T01:55:59.459 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.120473.log 2023-11-04T01:55:59.459 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.123805.log.gz 2023-11-04T01:55:59.460 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96592.log 2023-11-04T01:55:59.460 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.120473.log: gzip -5 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97839.log.gz 2023-11-04T01:55:59.460 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.116251.log 2023-11-04T01:55:59.460 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.120473.log.gz 2023-11-04T01:55:59.460 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120016.log 2023-11-04T01:55:59.460 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96592.log.gz 2023-11-04T01:55:59.460 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.116251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126695.log 2023-11-04T01:55:59.460 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.120016.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116251.log.gz 2023-11-04T01:55:59.461 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97965.log 2023-11-04T01:55:59.461 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.120016.log.gz 2023-11-04T01:55:59.461 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.126695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106538.log 2023-11-04T01:55:59.461 INFO:teuthology.orchestra.run.smithi114.stderr:gzip 89.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.126695.log.gz 2023-11-04T01:55:59.461 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.107173.log 2023-11-04T01:55:59.461 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97965.log: /var/log/ceph/ceph-client.admin.106538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110855.log 2023-11-04T01:55:59.461 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97965.log.gz 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106538.log.gz 2023-11-04T01:55:59.462 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107173.log: 2023-11-04T01:55:59.462 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125246.log 2023-11-04T01:55:59.462 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95208.log 2023-11-04T01:55:59.462 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110855.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107173.log.gz 2023-11-04T01:55:59.463 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107625.log 2023-11-04T01:55:59.463 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.110855.log.gz 2023-11-04T01:55:59.463 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.125246.log.gz 2023-11-04T01:55:59.463 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.admin.95208.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.121106.log 2023-11-04T01:55:59.463 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102191.log 2023-11-04T01:55:59.463 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.121106.log: gzip 89.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.95756.log 2023-11-04T01:55:59.463 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.107625.log.gz 2023-11-04T01:55:59.463 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118970.log 2023-11-04T01:55:59.463 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127183.log 2023-11-04T01:55:59.464 INFO:teuthology.orchestra.run.smithi114.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.121106.log.gz 2023-11-04T01:55:59.464 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102191.log.gz 2023-11-04T01:55:59.464 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.95756.log: /var/log/ceph/ceph-client.admin.118970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102501.log 2023-11-04T01:55:59.464 INFO:teuthology.orchestra.run.smithi114.stderr: 92.4%/var/log/ceph/ceph-client.admin.127183.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.95208.log.gz 2023-11-04T01:55:59.464 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.118970.log.gz 2023-11-04T01:55:59.464 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.117378.log 2023-11-04T01:55:59.464 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95756.log.gz 2023-11-04T01:55:59.465 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102501.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.127183.log.gz -5 2023-11-04T01:55:59.465 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.115341.log 2023-11-04T01:55:59.465 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116804.log 2023-11-04T01:55:59.465 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.102501.log.gz 2023-11-04T01:55:59.465 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115341.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117378.log.gz 2023-11-04T01:55:59.465 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94018.log 2023-11-04T01:55:59.465 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.115341.log.gz 2023-11-04T01:55:59.466 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.116804.log: -- /var/log/ceph/ceph-client.admin.125869.log 2023-11-04T01:55:59.466 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118871.log 2023-11-04T01:55:59.466 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116804.log.gz 2023-11-04T01:55:59.466 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125869.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94018.log.gz 2023-11-04T01:55:59.466 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113999.log 2023-11-04T01:55:59.466 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.118871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103252.log 2023-11-04T01:55:59.466 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.125869.log.gz 2023-11-04T01:55:59.466 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118871.log.gz 2023-11-04T01:55:59.467 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102317.log 2023-11-04T01:55:59.467 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117180.log 2023-11-04T01:55:59.467 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103252.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113999.log.gz 2023-11-04T01:55:59.467 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120998.log 2023-11-04T01:55:59.467 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103252.log.gz 2023-11-04T01:55:59.467 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113713.log 2023-11-04T01:55:59.467 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102317.log.gz 2023-11-04T01:55:59.467 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.120998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100385.log 2023-11-04T01:55:59.467 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117180.log.gz 2023-11-04T01:55:59.468 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118348.log 2023-11-04T01:55:59.468 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113713.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.120998.log.gz 2023-11-04T01:55:59.468 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113425.log 2023-11-04T01:55:59.468 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113713.log.gz 2023-11-04T01:55:59.468 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.admin.118348.log: -5 --verbose 89.2% -- /var/log/ceph/ceph-client.admin.108975.log -- replaced with /var/log/ceph/ceph-client.admin.100385.log.gz 2023-11-04T01:55:59.468 INFO:teuthology.orchestra.run.smithi114.stderr: 2023-11-04T01:55:59.468 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113425.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118348.log.gz 2023-11-04T01:55:59.468 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115257.log 2023-11-04T01:55:59.469 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113425.log.gz 2023-11-04T01:55:59.469 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106622.log 2023-11-04T01:55:59.469 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.108975.log: /var/log/ceph/ceph-client.admin.115257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112950.log 2023-11-04T01:55:59.469 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108975.log.gz 2023-11-04T01:55:59.469 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115257.log.gz 2023-11-04T01:55:59.469 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109549.log 2023-11-04T01:55:59.469 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106622.log.gz 2023-11-04T01:55:59.470 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110287.log 2023-11-04T01:55:59.470 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112950.log: /var/log/ceph/ceph-client.admin.109549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123543.log 2023-11-04T01:55:59.470 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112950.log.gz 2023-11-04T01:55:59.470 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109549.log.gz 2023-11-04T01:55:59.470 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121040.log 2023-11-04T01:55:59.470 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100343.log 2023-11-04T01:55:59.470 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.123543.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110287.log.gz 2023-11-04T01:55:59.470 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.121040.log: gzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.123543.log.gz 2023-11-04T01:55:59.471 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-client.admin.123321.log 2023-11-04T01:55:59.471 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126423.log 2023-11-04T01:55:59.471 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.123321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113119.log 2023-11-04T01:55:59.471 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.100343.log.gz 2023-11-04T01:55:59.471 INFO:teuthology.orchestra.run.smithi114.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.121040.log.gz 2023-11-04T01:55:59.471 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.126423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111594.log 2023-11-04T01:55:59.471 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123321.log.gz 2023-11-04T01:55:59.471 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100469.log 2023-11-04T01:55:59.472 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.111594.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113119.log.gz 2023-11-04T01:55:59.472 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose 91.2% -- replaced with /var/log/ceph/ceph-client.admin.126423.log.gz 2023-11-04T01:55:59.472 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-client.admin.103000.log 2023-11-04T01:55:59.472 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111594.log.gz 2023-11-04T01:55:59.472 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126839.log 2023-11-04T01:55:59.472 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100469.log.gz 2023-11-04T01:55:59.472 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112082.log 2023-11-04T01:55:59.473 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103000.log.gz 2023-11-04T01:55:59.473 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97500.log 2023-11-04T01:55:59.473 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.126839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115747.log 2023-11-04T01:55:59.473 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112082.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126839.log.gz 2023-11-04T01:55:59.473 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97500.log: gzip -5 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112082.log.gz 2023-11-04T01:55:59.473 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.108632.log 2023-11-04T01:55:59.473 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97500.log.gz 2023-11-04T01:55:59.473 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105634.log 2023-11-04T01:55:59.474 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.108632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129286.log 2023-11-04T01:55:59.474 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115747.log.gz 2023-11-04T01:55:59.474 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.105634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105712.log 2023-11-04T01:55:59.474 INFO:teuthology.orchestra.run.smithi114.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.108632.log.gz 2023-11-04T01:55:59.474 INFO:teuthology.orchestra.run.smithi114.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.105634.log.gz 2023-11-04T01:55:59.474 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.129286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116335.log 2023-11-04T01:55:59.474 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117506.log 2023-11-04T01:55:59.474 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.105712.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.129286.log.gz 2023-11-04T01:55:59.475 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.116335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98343.log 2023-11-04T01:55:59.475 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105712.log.gz 2023-11-04T01:55:59.475 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117506.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.116335.log.gz 2023-11-04T01:55:59.475 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.122962.log 2023-11-04T01:55:59.475 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.98343.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117506.log.gz 2023-11-04T01:55:59.475 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121417.log 2023-11-04T01:55:59.475 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98343.log.gz 2023-11-04T01:55:59.475 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107383.log 2023-11-04T01:55:59.476 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.122962.log: /var/log/ceph/ceph-client.admin.121417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118767.log 2023-11-04T01:55:59.476 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1%/var/log/ceph/ceph-client.admin.107383.log: -- replaced with /var/log/ceph/ceph-client.admin.122962.log.gz 2023-11-04T01:55:59.476 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104696.log 2023-11-04T01:55:59.476 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.121417.log.gz 2023-11-04T01:55:59.476 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107383.log.gz 2023-11-04T01:55:59.476 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.118767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124599.log 2023-11-04T01:55:59.476 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104696.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118767.log.gz 2023-11-04T01:55:59.477 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102916.log 2023-11-04T01:55:59.477 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104696.log.gz 2023-11-04T01:55:59.477 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.admin.124599.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.102706.log 2023-11-04T01:55:59.477 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126489.log 2023-11-04T01:55:59.477 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.124599.log.gz 2023-11-04T01:55:59.477 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102706.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102916.log.gz 2023-11-04T01:55:59.477 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117096.log 2023-11-04T01:55:59.477 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101907.log 2023-11-04T01:55:59.478 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.126489.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102706.log.gz 2023-11-04T01:55:59.478 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117096.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126489.log.gz 2023-11-04T01:55:59.478 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129160.log 2023-11-04T01:55:59.478 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110205.log 2023-11-04T01:55:59.478 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117096.log.gz 2023-11-04T01:55:59.478 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101907.log: /var/log/ceph/ceph-client.admin.129160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100961.log 2023-11-04T01:55:59.478 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101907.log.gz 2023-11-04T01:55:59.478 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110205.log: gzip 89.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.129160.log.gz -- 2023-11-04T01:55:59.479 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.128626.log 2023-11-04T01:55:59.479 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125827.log 2023-11-04T01:55:59.479 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100961.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110205.log.gz 2023-11-04T01:55:59.479 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.128626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108129.log 2023-11-04T01:55:59.479 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100961.log.gz 2023-11-04T01:55:59.479 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124683.log 2023-11-04T01:55:59.479 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128626.log.gz 2023-11-04T01:55:59.479 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125827.log: /var/log/ceph/ceph-client.admin.108129.log: gzip 88.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.125827.log.gz -- 2023-11-04T01:55:59.480 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.117336.log 2023-11-04T01:55:59.480 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.124683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130460.log 2023-11-04T01:55:59.480 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.admin.117336.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124683.log.gz 2023-11-04T01:55:59.480 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- 91.2% -- replaced with /var/log/ceph/ceph-client.admin.108129.log.gz 2023-11-04T01:55:59.480 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.100427.log 2023-11-04T01:55:59.480 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.130460.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117336.log.gz 2023-11-04T01:55:59.480 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:55:59.480 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101613.log 2023-11-04T01:55:59.481 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mgr.y.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100427.log.gz 2023-11-04T01:55:59.481 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114983.log 2023-11-04T01:55:59.481 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99881.log 2023-11-04T01:55:59.481 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6%/var/log/ceph/ceph-client.admin.114983.log: -- replaced with /var/log/ceph/ceph-client.admin.101613.log.gz 2023-11-04T01:55:59.481 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112320.log 2023-11-04T01:55:59.481 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114983.log.gz 2023-11-04T01:55:59.481 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- 95.6% /var/log/ceph/ceph-client.admin.125288.log 2023-11-04T01:55:59.482 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.130460.log.gz 2023-11-04T01:55:59.482 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.99881.log: /var/log/ceph/ceph-client.admin.112320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103462.log 2023-11-04T01:55:59.482 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125288.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.104864.log 2023-11-04T01:55:59.482 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.112320.log.gz 2023-11-04T01:55:59.482 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99881.log.gz 2023-11-04T01:55:59.482 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124969.log 2023-11-04T01:55:59.482 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.125288.log.gz 2023-11-04T01:55:59.483 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95446.log 2023-11-04T01:55:59.483 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103462.log.gz 2023-11-04T01:55:59.483 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102958.log 2023-11-04T01:55:59.483 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.124969.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104864.log.gz 2023-11-04T01:55:59.483 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.95446.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124969.log.gz 2023-11-04T01:55:59.483 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96171.log 2023-11-04T01:55:59.483 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95446.log.gz 2023-11-04T01:55:59.483 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112866.log 2023-11-04T01:55:59.484 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1%/var/log/ceph/ceph-client.admin.96171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123417.log 2023-11-04T01:55:59.484 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102958.log.gz 2023-11-04T01:55:59.484 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93689.log 2023-11-04T01:55:59.484 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96171.log.gz 2023-11-04T01:55:59.484 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112866.log.gz 2023-11-04T01:55:59.484 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.123417.log: --verbose -- /var/log/ceph/ceph-client.admin.122570.log 2023-11-04T01:55:59.484 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.93689.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.123417.log.gz 2023-11-04T01:55:59.484 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.93976.log 2023-11-04T01:55:59.485 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93689.log.gz 2023-11-04T01:55:59.485 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.122570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103920.log 2023-11-04T01:55:59.485 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122570.log.gz 2023-11-04T01:55:59.485 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.93976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114041.log 2023-11-04T01:55:59.485 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103920.log: gzip 89.5% -- replaced with /var/log/ceph/ceph-client.admin.93976.log.gz 2023-11-04T01:55:59.485 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.106118.log 2023-11-04T01:55:59.485 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.114041.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103920.log.gz 2023-11-04T01:55:59.485 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94145.log 2023-11-04T01:55:59.486 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.114041.log.gz 2023-11-04T01:55:59.486 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106076.log 2023-11-04T01:55:59.486 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106118.log.gz 2023-11-04T01:55:59.486 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93895.log 2023-11-04T01:55:59.486 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7%/var/log/ceph/ceph-client.admin.106076.log: -- replaced with /var/log/ceph/ceph-client.admin.94145.log.gz 2023-11-04T01:55:59.486 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115957.log 2023-11-04T01:55:59.486 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106076.log.gz 2023-11-04T01:55:59.486 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.93895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120369.log 2023-11-04T01:55:59.487 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115957.log: gzip 88.9% -5 --verbose -- /var/log/ceph/ceph-client.admin.112908.log 2023-11-04T01:55:59.487 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93895.log.gz 2023-11-04T01:55:59.487 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.120369.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115957.log.gz 2023-11-04T01:55:59.487 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110585.log 2023-11-04T01:55:59.487 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120369.log.gz 2023-11-04T01:55:59.487 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109171.log 2023-11-04T01:55:59.487 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122630.log 2023-11-04T01:55:59.487 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112908.log.gz/var/log/ceph/ceph-client.admin.110585.log: 2023-11-04T01:55:59.488 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109988.log 2023-11-04T01:55:59.488 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.122630.log: 89.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113955.log 2023-11-04T01:55:59.488 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.109171.log.gz 2023-11-04T01:55:59.488 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110585.log.gz 2023-11-04T01:55:59.488 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109988.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123585.log 2023-11-04T01:55:59.488 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.122630.log.gz 2023-11-04T01:55:59.488 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113955.log: gzip -5 --verbose 87.8% -- /var/log/ceph/ceph-client.admin.114377.log -- replaced with /var/log/ceph/ceph-client.admin.109988.log.gz 2023-11-04T01:55:59.488 INFO:teuthology.orchestra.run.smithi114.stderr: 2023-11-04T01:55:59.489 INFO:teuthology.orchestra.run.smithi114.stderr:gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113955.log.gz 2023-11-04T01:55:59.489 INFO:teuthology.orchestra.run.smithi114.stderr: -5/var/log/ceph/ceph-client.admin.123585.log: --verbose -- /var/log/ceph/ceph-client.admin.118599.log 2023-11-04T01:55:59.489 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.114377.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96904.log 2023-11-04T01:55:59.489 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.123585.log.gz 2023-11-04T01:55:59.489 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114377.log.gz 2023-11-04T01:55:59.489 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.118599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105500.log 2023-11-04T01:55:59.489 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96904.log: gzip 89.6% -- replaced with /var/log/ceph/ceph-client.admin.118599.log.gz 2023-11-04T01:55:59.489 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.126737.log 2023-11-04T01:55:59.489 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.105500.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96904.log.gz 2023-11-04T01:55:59.490 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101366.log 2023-11-04T01:55:59.490 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.126737.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.105500.log.gz 2023-11-04T01:55:59.490 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120195.log 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126737.log.gz 2023-11-04T01:55:59.490 INFO:teuthology.orchestra.run.smithi114.stderr: 2023-11-04T01:55:59.490 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114784.log 2023-11-04T01:55:59.490 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101366.log.gz 2023-11-04T01:55:59.490 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.admin.120195.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.101655.log 2023-11-04T01:55:59.491 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.114784.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.120195.log.gz 2023-11-04T01:55:59.491 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107215.log 2023-11-04T01:55:59.491 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127698.log 2023-11-04T01:55:59.491 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107215.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101655.log.gz 2023-11-04T01:55:59.491 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95714.log 2023-11-04T01:55:59.491 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107215.log.gz 2023-11-04T01:55:59.491 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100721.log 2023-11-04T01:55:59.492 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127698.log: /var/log/ceph/ceph-client.admin.95714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109862.log 2023-11-04T01:55:59.492 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127698.log.gz 2023-11-04T01:55:59.492 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95714.log.gz 2023-11-04T01:55:59.492 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100721.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100721.log.gz 2023-11-04T01:55:59.492 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112124.log 2023-11-04T01:55:59.492 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117054.log 2023-11-04T01:55:59.492 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112124.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109862.log.gz 2023-11-04T01:55:59.492 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118263.log 2023-11-04T01:55:59.493 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112124.log.gz 2023-11-04T01:55:59.493 INFO:teuthology.orchestra.run.smithi114.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.0.114784.log.gz 2023-11-04T01:55:59.493 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99965.log 2023-11-04T01:55:59.493 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4%/var/log/ceph/ceph-client.admin.118263.log: -- replaced with /var/log/ceph/ceph-client.admin.117054.log.gz 2023-11-04T01:55:59.493 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-04T01:55:59.493 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.99965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111131.log 88.8% 2023-11-04T01:55:59.493 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.118263.log.gz 2023-11-04T01:55:59.493 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-osd.0.log: -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99965.log.gz 2023-11-04T01:55:59.494 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.114293.log 2023-11-04T01:55:59.494 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.111131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101991.log 2023-11-04T01:55:59.494 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.111131.log.gz/var/log/ceph/ceph-client.admin.114293.log: 2023-11-04T01:55:59.494 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116041.log 2023-11-04T01:55:59.494 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114293.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106034.log 2023-11-04T01:55:59.494 INFO:teuthology.orchestra.run.smithi114.stderr: 2023-11-04T01:55:59.494 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101991.log: /var/log/ceph/ceph-client.admin.116041.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101991.log.gz 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116041.log.gz 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116629.log 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118829.log 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106034.log.gz 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.116629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106664.log 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3%/var/log/ceph/ceph-client.admin.118829.log: -- replaced with /var/log/ceph/ceph-client.admin.116629.log.gz 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116419.log 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118829.log.gz 2023-11-04T01:55:59.496 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119394.log 2023-11-04T01:55:59.496 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106664.log: /var/log/ceph/ceph-client.admin.116419.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106664.log.gz 2023-11-04T01:55:59.496 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116419.log.gz 2023-11-04T01:55:59.496 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102543.log 2023-11-04T01:55:59.496 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.119394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98049.log 2023-11-04T01:55:59.496 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119394.log.gz 2023-11-04T01:55:59.496 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.102543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116545.log 2023-11-04T01:55:59.496 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102543.log.gz 2023-11-04T01:55:59.496 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.98049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108195.log 2023-11-04T01:55:59.497 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98049.log.gz 2023-11-04T01:55:59.497 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110939.log 2023-11-04T01:55:59.497 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.116545.log: /var/log/ceph/ceph-client.admin.108195.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116545.log.gz 2023-11-04T01:55:59.497 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108195.log.gz 2023-11-04T01:55:59.497 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120818.log 2023-11-04T01:55:59.497 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97621.log 2023-11-04T01:55:59.497 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6%/var/log/ceph/ceph-client.admin.120818.log: -- replaced with /var/log/ceph/ceph-client.admin.110939.log.gz 2023-11-04T01:55:59.497 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117420.log 2023-11-04T01:55:59.498 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120818.log.gz 2023-11-04T01:55:59.498 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.97621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107471.log 2023-11-04T01:55:59.498 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97621.log.gz 2023-11-04T01:55:59.498 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127536.log 2023-11-04T01:55:59.498 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.117420.log: /var/log/ceph/ceph-client.admin.107471.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117420.log.gz 2023-11-04T01:55:59.498 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107471.log.gz 2023-11-04T01:55:59.498 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97501.log 2023-11-04T01:55:59.498 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.128319.log 2023-11-04T01:55:59.499 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.127536.log.gz/var/log/ceph/ceph-client.admin.97501.log: 2023-11-04T01:55:59.499 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107961.log 2023-11-04T01:55:59.499 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97501.log.gz 2023-11-04T01:55:59.499 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.128319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128747.log 2023-11-04T01:55:59.499 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95614.log 2023-11-04T01:55:59.499 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107961.log: /var/log/ceph/ceph-client.admin.128747.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107961.log.gz 2023-11-04T01:55:59.499 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128747.log.gz 2023-11-04T01:55:59.500 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109778.log 2023-11-04T01:55:59.500 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.95614.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95614.log.gz 2023-11-04T01:55:59.500 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-04T01:55:59.500 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112698.log 2023-11-04T01:55:59.500 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109778.log: /var/log/ceph/ceph.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109778.log.gz 2023-11-04T01:55:59.500 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126573.log 2023-11-04T01:55:59.500 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112698.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112698.log.gz 2023-11-04T01:55:59.500 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116377.log 2023-11-04T01:55:59.500 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.126573.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126573.log.gz 2023-11-04T01:55:59.501 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108933.log 2023-11-04T01:55:59.501 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-04T01:55:59.501 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.116377.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116377.log.gz 2023-11-04T01:55:59.501 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109129.log 2023-11-04T01:55:59.501 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96045.log 2023-11-04T01:55:59.501 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.108933.log: /var/log/ceph/ceph-client.admin.109129.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108933.log.gz 2023-11-04T01:55:59.501 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99797.log 2023-11-04T01:55:59.501 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.109129.log.gz 2023-11-04T01:55:59.502 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96045.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96045.log.gz 2023-11-04T01:55:59.502 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96003.log 2023-11-04T01:55:59.502 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-04T01:55:59.502 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.99797.log: /var/log/ceph/ceph-client.admin.96003.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.99797.log.gz 2023-11-04T01:55:59.502 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96003.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94061.log 2023-11-04T01:55:59.502 INFO:teuthology.orchestra.run.smithi114.stderr: 2023-11-04T01:55:59.502 INFO:teuthology.orchestra.run.smithi114.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.0.128319.log.gz 2023-11-04T01:55:59.503 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103756.log 2023-11-04T01:55:59.503 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103126.log 2023-11-04T01:55:59.503 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103756.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94061.log.gz 2023-11-04T01:55:59.503 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103756.log.gz 2023-11-04T01:55:59.503 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116503.log 2023-11-04T01:55:59.503 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113629.log 2023-11-04T01:55:59.503 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103126.log.gz 2023-11-04T01:55:59.503 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.116503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100007.log 2023-11-04T01:55:59.503 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113629.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116503.log.gz 2023-11-04T01:55:59.504 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113629.log.gz 2023-11-04T01:55:59.504 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126531.log 2023-11-04T01:55:59.504 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100007.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-04T01:55:59.504 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100007.log.gz 2023-11-04T01:55:59.504 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.126531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112824.log 2023-11-04T01:55:59.504 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mds.c.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.126531.log.gz 2023-11-04T01:55:59.504 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126653.log 2023-11-04T01:55:59.504 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.112824.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112824.log.gz 2023-11-04T01:55:59.505 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94317.log 2023-11-04T01:55:59.505 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.126653.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126653.log.gz 2023-11-04T01:55:59.505 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106706.log 2023-11-04T01:55:59.505 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94317.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94317.log.gz 2023-11-04T01:55:59.505 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98511.log 2023-11-04T01:55:59.505 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106706.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106706.log.gz 2023-11-04T01:55:59.505 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104043.log 2023-11-04T01:55:59.505 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.98511.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.98511.log.gz 2023-11-04T01:55:59.505 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109651.log 2023-11-04T01:55:59.506 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104043.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104043.log.gz 2023-11-04T01:55:59.506 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104212.log 2023-11-04T01:55:59.506 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109651.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109651.log.gz 2023-11-04T01:55:59.506 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122806.log 2023-11-04T01:55:59.506 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104212.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104212.log.gz 2023-11-04T01:55:59.506 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110030.log 2023-11-04T01:55:59.506 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.122806.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122806.log.gz 2023-11-04T01:55:59.506 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113246.log 2023-11-04T01:55:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110030.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110030.log.gz 2023-11-04T01:55:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119114.log 2023-11-04T01:55:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113246.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113246.log.gz 2023-11-04T01:55:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110645.log 2023-11-04T01:55:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.119114.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119114.log.gz 2023-11-04T01:55:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129614.log 2023-11-04T01:55:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110645.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.110645.log.gz 2023-11-04T01:55:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109255.log 2023-11-04T01:55:59.508 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.129614.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129614.log.gz 2023-11-04T01:55:59.508 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115789.log 2023-11-04T01:55:59.508 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109255.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109255.log.gz 2023-11-04T01:55:59.508 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100595.log 2023-11-04T01:55:59.508 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115789.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115789.log.gz 2023-11-04T01:55:59.508 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94739.log 2023-11-04T01:55:59.508 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100595.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100595.log.gz 2023-11-04T01:55:59.508 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110329.log 2023-11-04T01:55:59.509 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94739.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.94739.log.gz 2023-11-04T01:55:59.509 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111388.log 2023-11-04T01:55:59.509 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110329.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110329.log.gz 2023-11-04T01:55:59.509 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126943.log 2023-11-04T01:55:59.509 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.111388.log: 89.2% -- replaced with /var/log/ceph/ceph-client.0.111388.log.gz 2023-11-04T01:55:59.509 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113204.log 2023-11-04T01:55:59.509 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.126943.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.126943.log.gz 2023-11-04T01:55:59.509 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96917.log 2023-11-04T01:55:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.113204.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.113204.log.gz 2023-11-04T01:55:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98091.log 2023-11-04T01:55:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96917.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96917.log.gz 2023-11-04T01:55:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124846.log 2023-11-04T01:55:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.98091.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98091.log.gz 2023-11-04T01:55:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103336.log 2023-11-04T01:55:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.124846.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124846.log.gz 2023-11-04T01:55:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96576.log 2023-11-04T01:55:59.511 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.103336.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103336.log.gz 2023-11-04T01:55:59.511 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100175.log 2023-11-04T01:55:59.511 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96576.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96576.log.gz 2023-11-04T01:55:59.511 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125414.log 2023-11-04T01:55:59.511 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100175.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100175.log.gz 2023-11-04T01:55:59.511 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129656.log 2023-11-04T01:55:59.511 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125414.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125414.log.gz 2023-11-04T01:55:59.511 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125701.log 2023-11-04T01:55:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.129656.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129656.log.gz 2023-11-04T01:55:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121841.log 2023-11-04T01:55:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.125701.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.125701.log.gz 2023-11-04T01:55:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107539.log 2023-11-04T01:55:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.121841.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.121841.log.gz 2023-11-04T01:55:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100918.log 2023-11-04T01:55:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107539.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.107539.log.gz 2023-11-04T01:55:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128668.log 2023-11-04T01:55:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100918.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100918.log.gz 2023-11-04T01:55:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116886.log 2023-11-04T01:55:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.128668.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128668.log.gz 2023-11-04T01:55:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96586.log 2023-11-04T01:55:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.116886.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116886.log.gz 2023-11-04T01:55:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98469.log 2023-11-04T01:55:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96586.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96586.log.gz 2023-11-04T01:55:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.108452.log 2023-11-04T01:55:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.98469.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98469.log.gz 2023-11-04T01:55:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115705.log 2023-11-04T01:55:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.108452.log: 88.8% -- replaced with /var/log/ceph/ceph-client.0.108452.log.gz 2023-11-04T01:55:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96582.log 2023-11-04T01:55:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.115705.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115705.log.gz 2023-11-04T01:55:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119771.log 2023-11-04T01:55:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96582.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96582.log.gz 2023-11-04T01:55:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101182.log 2023-11-04T01:55:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.119771.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.119771.log.gz 2023-11-04T01:55:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108003.log 2023-11-04T01:55:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.101182.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101182.log.gz 2023-11-04T01:55:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.126262.log 2023-11-04T01:55:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.108003.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108003.log.gz 2023-11-04T01:55:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106496.log 2023-11-04T01:55:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.126262.log: 93.0% -- replaced with /var/log/ceph/ceph-client.0.126262.log.gz 2023-11-04T01:55:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129076.log 2023-11-04T01:55:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.106496.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106496.log.gz 2023-11-04T01:55:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109017.log 2023-11-04T01:55:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.129076.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.129076.log.gz 2023-11-04T01:55:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104948.log 2023-11-04T01:55:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.109017.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109017.log.gz 2023-11-04T01:55:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107751.log 2023-11-04T01:55:59.516 INFO:teuthology.orchestra.run.smithi114.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-04T01:55:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.104948.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104948.log.gz 2023-11-04T01:55:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120431.log 2023-11-04T01:55:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.107751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110413.log 2023-11-04T01:55:59.517 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107751.log.gz 2023-11-04T01:55:59.517 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.120431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94613.log 2023-11-04T01:55:59.517 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110413.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120431.log.gz 2023-11-04T01:55:59.517 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124393.log 2023-11-04T01:55:59.517 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110413.log.gz 2023-11-04T01:55:59.517 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.94613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97561.log 2023-11-04T01:55:59.517 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.124393.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94613.log.gz 2023-11-04T01:55:59.517 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124393.log.gz 2023-11-04T01:55:59.517 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98639.log 2023-11-04T01:55:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.97561.log: -- /var/log/ceph/ceph-mds.a.log 2023-11-04T01:55:59.518 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97561.log.gz 2023-11-04T01:55:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.98639.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98639.log.gz 2023-11-04T01:55:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96403.log 2023-11-04T01:55:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122367.log 2023-11-04T01:55:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96403.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96403.log.gz 2023-11-04T01:55:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121799.log 2023-11-04T01:55:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.122367.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122367.log.gz 2023-11-04T01:55:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100874.log 2023-11-04T01:55:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.121799.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.121799.log.gz 2023-11-04T01:55:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122184.log 2023-11-04T01:55:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.100874.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100874.log.gz 2023-11-04T01:55:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127452.log 2023-11-04T01:55:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.122184.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.122184.log.gz 2023-11-04T01:55:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111697.log 2023-11-04T01:55:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.127452.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127452.log.gz 2023-11-04T01:55:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96919.log 2023-11-04T01:55:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.111697.log: 91.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-04T01:55:59.520 INFO:teuthology.orchestra.run.smithi114.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.111697.log.gz 2023-11-04T01:55:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110897.log 2023-11-04T01:55:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.96919.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96919.log.gz 2023-11-04T01:55:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.110897.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110897.log.gz 2023-11-04T01:55:59.521 INFO:teuthology.orchestra.run.smithi114.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-04T01:55:59.521 INFO:teuthology.orchestra.run.smithi141.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-04T01:55:59.801 INFO:teuthology.orchestra.run.smithi114.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-04T01:56:00.262 INFO:teuthology.orchestra.run.smithi141.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-04T01:56:00.267 INFO:teuthology.orchestra.run.smithi141.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-04T01:56:00.320 INFO:teuthology.orchestra.run.smithi141.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-04T01:56:00.327 INFO:teuthology.orchestra.run.smithi141.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-04T01:56:00.329 INFO:teuthology.orchestra.run.smithi141.stderr: 2023-11-04T01:56:00.330 INFO:teuthology.orchestra.run.smithi141.stderr:real 0m1.329s 2023-11-04T01:56:00.330 INFO:teuthology.orchestra.run.smithi141.stderr:user 0m5.653s 2023-11-04T01:56:00.330 INFO:teuthology.orchestra.run.smithi141.stderr:sys 0m0.214s 2023-11-04T01:56:00.331 INFO:teuthology.orchestra.run.smithi114.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-04T01:56:00.442 INFO:teuthology.orchestra.run.smithi114.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-04T01:56:00.527 INFO:teuthology.orchestra.run.smithi114.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-04T01:56:00.721 INFO:teuthology.orchestra.run.smithi114.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-04T01:56:00.723 INFO:teuthology.orchestra.run.smithi114.stderr: 2023-11-04T01:56:00.723 INFO:teuthology.orchestra.run.smithi114.stderr:real 0m1.747s 2023-11-04T01:56:00.723 INFO:teuthology.orchestra.run.smithi114.stderr:user 0m6.747s 2023-11-04T01:56:00.723 INFO:teuthology.orchestra.run.smithi114.stderr:sys 0m0.556s 2023-11-04T01:56:00.723 INFO:tasks.ceph:Archiving logs... 2023-11-04T01:56:00.724 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918/remote/smithi114/log 2023-11-04T01:56:00.725 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-04T01:56:02.226 DEBUG:teuthology.misc:Transferring archived files from smithi141:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918/remote/smithi141/log 2023-11-04T01:56:02.226 DEBUG:teuthology.orchestra.run.smithi141:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-04T01:56:03.079 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:56:03.089 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-04T01:56:03.099 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:56:03.104 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-04T01:56:03.104 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-04T01:56:03.110 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-04T01:56:03.183 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-04T01:56:03.192 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-04T01:56:03.192 DEBUG:teuthology.orchestra.run.smithi114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:56:03.195 DEBUG:teuthology.orchestra.run.smithi141:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:56:03.208 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: ntpq: command not found 2023-11-04T01:56:03.210 INFO:teuthology.orchestra.run.smithi141.stderr:bash: line 1: ntpq: command not found 2023-11-04T01:56:03.213 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T01:56:03.213 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2023-11-04T01:56:03.213 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 64 +1683us[+1683us] +/- 82ms 2023-11-04T01:56:03.213 INFO:teuthology.orchestra.run.smithi114.stdout:^* hv02.front.sepia.ceph.com 3 6 377 64 -386us[ -385us] +/- 78ms 2023-11-04T01:56:03.213 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 -1438us[-1438us] +/- 61ms 2023-11-04T01:56:03.213 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:56:03.215 INFO:teuthology.orchestra.run.smithi141.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T01:56:03.215 INFO:teuthology.orchestra.run.smithi141.stdout:=============================================================================== 2023-11-04T01:56:03.215 INFO:teuthology.orchestra.run.smithi141.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 63 +1674us[+1676us] +/- 82ms 2023-11-04T01:56:03.215 INFO:teuthology.orchestra.run.smithi141.stdout:^* hv02.front.sepia.ceph.com 3 6 377 62 -396us[ -394us] +/- 78ms 2023-11-04T01:56:03.215 INFO:teuthology.orchestra.run.smithi141.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 -1434us[-1434us] +/- 61ms 2023-11-04T01:56:03.216 INFO:teuthology.orchestra.run.smithi141.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:56:03.216 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-04T01:56:03.225 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-04T01:56:03.225 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-04T01:56:03.234 DEBUG:teuthology.orchestra.run.smithi114:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-04T01:56:03.373 DEBUG:teuthology.orchestra.run.smithi141:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-04T01:56:03.472 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T01:56:03.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:56:03.506 DEBUG:teuthology.orchestra.run.smithi141:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T01:56:03.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:56:03.540 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-04T01:56:03.550 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-04T01:56:03.627 INFO:teuthology.task.internal:Duration was 1881.476928 seconds 2023-11-04T01:56:03.628 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-04T01:56:03.637 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-04T01:56:03.637 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-04T01:56:03.640 DEBUG:teuthology.orchestra.run.smithi141:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-04T01:56:03.680 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T01:56:03.682 INFO:teuthology.orchestra.run.smithi141.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T01:56:03.957 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-04T01:56:03.957 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi114.front.sepia.ceph.com 2023-11-04T01:56:03.957 DEBUG:teuthology.orchestra.run.smithi114:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-04T01:56:03.977 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi141.front.sepia.ceph.com 2023-11-04T01:56:03.977 DEBUG:teuthology.orchestra.run.smithi141:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-04T01:56:04.024 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-04T01:56:04.025 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T01:56:04.028 DEBUG:teuthology.orchestra.run.smithi141:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T01:56:04.092 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-04T01:56:04.092 DEBUG:teuthology.orchestra.run.smithi114:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-04T01:56:04.095 DEBUG:teuthology.orchestra.run.smithi141:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-04T01:56:04.238 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-04T01:56:04.247 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-04T01:56:04.248 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-04T01:56:04.274 DEBUG:teuthology.orchestra.run.smithi141:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-04T01:56:04.301 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-04T01:56:04.310 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:56:04.317 DEBUG:teuthology.orchestra.run.smithi141:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:56:04.339 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = core 2023-11-04T01:56:04.366 INFO:teuthology.orchestra.run.smithi141.stdout:kernel.core_pattern = core 2023-11-04T01:56:04.381 DEBUG:teuthology.orchestra.run.smithi114:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:56:04.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:56:04.409 DEBUG:teuthology.orchestra.run.smithi141:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:56:04.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:56:04.436 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-04T01:56:04.445 INFO:teuthology.task.internal:Transferring archived files... 2023-11-04T01:56:04.446 DEBUG:teuthology.misc:Transferring archived files from smithi114:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918/remote/smithi114 2023-11-04T01:56:04.446 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-04T01:56:04.493 DEBUG:teuthology.misc:Transferring archived files from smithi141:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918/remote/smithi141 2023-11-04T01:56:04.493 DEBUG:teuthology.orchestra.run.smithi141:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-04T01:56:04.529 INFO:teuthology.task.internal:Removing archive directory... 2023-11-04T01:56:04.529 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-04T01:56:04.531 DEBUG:teuthology.orchestra.run.smithi141:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-04T01:56:04.577 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-04T01:56:04.587 INFO:teuthology.task.internal:Not uploading archives. 2023-11-04T01:56:04.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-04T01:56:04.596 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-04T01:56:04.597 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-04T01:56:04.599 DEBUG:teuthology.orchestra.run.smithi141:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-04T01:56:04.610 INFO:teuthology.orchestra.run.smithi114.stdout: 265827 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 4 01:56 /home/ubuntu/cephtest 2023-11-04T01:56:04.631 INFO:teuthology.orchestra.run.smithi141.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 4 01:56 /home/ubuntu/cephtest 2023-11-04T01:56:04.632 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-04T01:56:04.642 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-04T01:56:04.652 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi114 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:56:04.652 INFO:teuthology.nuke:Checking targets against current locks 2023-11-04T01:56:04.677 DEBUG:teuthology.nuke:shortname: smithi114 2023-11-04T01:56:04.678 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:56:04.702 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:35.341149', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGNwtC3sRo9An1v0162xAkwK5ps/9wuy22pqR7mLCVyuHAp+SMJP1gJTJrIcOGhgZ5r3AB7uteoz2/0A66uhnyc='} 2023-11-04T01:56:04.705 DEBUG:teuthology.nuke:shortname: smithi141 2023-11-04T01:56:04.705 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:56:04.725 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445918', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:35.342577', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHbgkzfTEigi1OIdnkvi6vLGap0GXnDZHAy7U0RidR/plsRSMGBTBmY6ay7iBTK7Wx0oHt5X/mViCu1YWdr+z04='} 2023-11-04T01:56:04.751 INFO:teuthology.orchestra.console.smithi114:Power off 2023-11-04T01:56:04.752 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T01:56:04.776 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-11-04T01:56:04.776 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:56:04.797 INFO:teuthology.orchestra.console.smithi141:Power off 2023-11-04T01:56:04.798 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T01:56:04.807 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-11-04T01:56:04.821 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-11-04T01:56:04.821 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:56:04.845 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-11-04T01:56:08.808 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:56:08.846 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:56:08.918 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-11-04T01:56:08.956 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-11-04T01:56:12.922 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:56:12.957 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:56:13.032 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-11-04T01:56:13.066 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-11-04T01:56:13.134 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-11-04T01:56:17.070 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:56:17.181 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-11-04T01:56:17.282 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-11-04T01:56:17.387 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} duration: 1881.4769277572632 failure_reason: 'Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9a28bc0cb2e34be2a8617be5fe0eedf2 status: fail success: false 2023-11-04T01:56:17.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:56:17.467 INFO:teuthology.run:FAIL